2024-09-10T23:00:00.580 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T23:00:00.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:00:00.701 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} email: hyelloji@redhat.com first_in_suite: false job_id: '7899775' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' mds: mds cache max size: 1000 mds log max segments: 1 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMv31f0I4P91k4gVrj6h8hDWP95+QcDw4YlyEbtuW+kwlz2iHQonWwt6wV1zaCQTszLTZYH4a3S2CO8m9mYb3Go= smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO931+jJRRyChCnY03ZZZ0N3obAnb5zkIE0abVjxRCkzXEmSTI/eZfBWGM3p92Y0b/gBcT8z6Y7ywU28MARcHa8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T23:00:00.701 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T23:00:00.702 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T23:00:00.702 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T23:00:00.703 INFO:teuthology.task.internal:Checking packages... 2024-09-10T23:00:00.724 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T23:00:00.725 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T23:00:00.725 INFO:teuthology.packaging:ref: None 2024-09-10T23:00:00.725 INFO:teuthology.packaging:tag: None 2024-09-10T23:00:00.725 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:00:00.725 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:00:00.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T23:00:00.889 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854-g8f219c47-1jammy 2024-09-10T23:00:00.890 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T23:00:00.896 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T23:00:00.897 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T23:00:00.937 INFO:teuthology.task.internal:Saving configuration 2024-09-10T23:00:00.953 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T23:00:00.971 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T23:00:01.004 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:54:25.957603', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA2bkpnEamOA4gXpW2lTtpfUyNeB9kbBhTKVmfYGxB+W'} 2024-09-10T23:00:01.038 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 22:54:25.955852', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE4PcBJRlLsef1acNj+x3TqbrjSR+DkD2g463C08Ky5b'} 2024-09-10T23:00:01.039 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T23:00:01.044 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T23:00:01.044 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T23:00:01.044 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T23:00:01.161 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2592753be0>, signals=[15]) 2024-09-10T23:00:01.161 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T23:00:01.167 INFO:teuthology.task.internal:Opening connections... 2024-09-10T23:00:01.167 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:00:01.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:00:01.258 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:00:01.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:00:01.347 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T23:00:01.352 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-10T23:00:01.358 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-10T23:00:01.359 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-10T23:00:01.409 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T23:00:01.409 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Ubuntu" 2024-09-10T23:00:01.409 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="22.04" 2024-09-10T23:00:01.409 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T23:00:01.409 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_CODENAME=jammy 2024-09-10T23:00:01.409 INFO:teuthology.orchestra.run.smithi017.stdout:ID=ubuntu 2024-09-10T23:00:01.409 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE=debian 2024-09-10T23:00:01.410 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T23:00:01.410 INFO:teuthology.orchestra.run.smithi017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T23:00:01.410 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T23:00:01.410 INFO:teuthology.orchestra.run.smithi017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T23:00:01.410 INFO:teuthology.orchestra.run.smithi017.stdout:UBUNTU_CODENAME=jammy 2024-09-10T23:00:01.410 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-10T23:00:01.445 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-09-10T23:00:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-09-10T23:00:01.450 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-09-10T23:00:01.498 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T23:00:01.499 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2024-09-10T23:00:01.499 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="22.04" 2024-09-10T23:00:01.499 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T23:00:01.499 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=jammy 2024-09-10T23:00:01.499 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2024-09-10T23:00:01.499 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2024-09-10T23:00:01.499 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T23:00:01.500 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T23:00:01.500 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T23:00:01.500 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T23:00:01.500 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=jammy 2024-09-10T23:00:01.500 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-09-10T23:00:01.528 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T23:00:01.537 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T23:00:01.562 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T23:00:01.563 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:00:01.565 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-09-10T23:00:01.572 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T23:00:01.596 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T23:00:01.596 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:00:01.610 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-09-10T23:00:01.620 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T23:00:01.693 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T23:00:01.708 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T23:00:01.708 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-10T23:00:01.708 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:00:01.709 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T23:00:01.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:00:01.714 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:00:01.714 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:00:01.714 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-10T23:00:01.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:00:01.715 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:00:01.715 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T23:00:01.715 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-10T23:00:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:5.15.0-56-generic 2024-09-10T23:00:01.765 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:00:01.765 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:00:01.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:00:01.777 INFO:teuthology.orchestra.run.smithi017.stdout:5.15.0-56-generic 2024-09-10T23:00:01.778 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:00:01.778 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T23:00:01.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:00:01.915 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-09-10T23:00:01.916 DEBUG:teuthology.orchestra.run.smithi077:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-10T23:00:01.947 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-09-10T23:00:01.947 DEBUG:teuthology.orchestra.run.smithi017:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-10T23:00:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-10T23:00:01.980 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-10T23:00:02.084 INFO:teuthology.orchestra.run.smithi017.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-10T23:00:02.085 INFO:teuthology.orchestra.run.smithi017.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-10T23:00:02.085 INFO:teuthology.orchestra.run.smithi017.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-10T23:00:02.085 INFO:teuthology.orchestra.run.smithi017.stderr:hint: 2024-09-10T23:00:02.085 INFO:teuthology.orchestra.run.smithi017.stderr:hint: git config --global init.defaultBranch 2024-09-10T23:00:02.085 INFO:teuthology.orchestra.run.smithi017.stderr:hint: 2024-09-10T23:00:02.085 INFO:teuthology.orchestra.run.smithi017.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-10T23:00:02.085 INFO:teuthology.orchestra.run.smithi017.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-10T23:00:02.085 INFO:teuthology.orchestra.run.smithi017.stderr:hint: 2024-09-10T23:00:02.085 INFO:teuthology.orchestra.run.smithi017.stderr:hint: git branch -m 2024-09-10T23:00:02.086 INFO:teuthology.orchestra.run.smithi017.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-10T23:00:02.088 DEBUG:teuthology.orchestra.run.smithi017:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: git config --global init.defaultBranch 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: 2024-09-10T23:00:02.105 INFO:teuthology.orchestra.run.smithi077.stderr:hint: git branch -m 2024-09-10T23:00:02.106 INFO:teuthology.orchestra.run.smithi077.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-10T23:00:02.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-10T23:00:02.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-10T23:00:02.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-10T23:00:02.187 DEBUG:teuthology.orchestra.run.smithi077:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-10T23:00:02.211 DEBUG:teuthology.orchestra.run.smithi017:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-10T23:00:25.530 INFO:teuthology.orchestra.run.smithi077.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-10T23:00:25.530 INFO:teuthology.orchestra.run.smithi077.stderr: * [new branch] main -> origin/main 2024-09-10T23:00:25.558 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190312 -> 20190312 2024-09-10T23:00:25.558 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190416 -> 20190416 2024-09-10T23:00:25.559 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190514 -> 20190514 2024-09-10T23:00:25.559 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190618 -> 20190618 2024-09-10T23:00:25.559 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190717 -> 20190717 2024-09-10T23:00:25.560 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190815 -> 20190815 2024-09-10T23:00:25.560 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190923 -> 20190923 2024-09-10T23:00:25.560 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20191022 -> 20191022 2024-09-10T23:00:25.560 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20191215 -> 20191215 2024-09-10T23:00:25.560 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200122 -> 20200122 2024-09-10T23:00:25.560 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200316 -> 20200316 2024-09-10T23:00:25.560 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200421 -> 20200421 2024-09-10T23:00:25.560 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200519 -> 20200519 2024-09-10T23:00:25.561 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200619 -> 20200619 2024-09-10T23:00:25.561 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200721 -> 20200721 2024-09-10T23:00:25.561 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200817 -> 20200817 2024-09-10T23:00:25.562 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200918 -> 20200918 2024-09-10T23:00:25.562 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20201022 -> 20201022 2024-09-10T23:00:25.562 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20201118 -> 20201118 2024-09-10T23:00:25.562 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20201218 -> 20201218 2024-09-10T23:00:25.562 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210208 -> 20210208 2024-09-10T23:00:25.563 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210315 -> 20210315 2024-09-10T23:00:25.563 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210511 -> 20210511 2024-09-10T23:00:25.563 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210716 -> 20210716 2024-09-10T23:00:25.563 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210818 -> 20210818 2024-09-10T23:00:25.563 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210919 -> 20210919 2024-09-10T23:00:25.563 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20211027 -> 20211027 2024-09-10T23:00:25.563 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20211216 -> 20211216 2024-09-10T23:00:25.564 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220209 -> 20220209 2024-09-10T23:00:25.564 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220310 -> 20220310 2024-09-10T23:00:25.564 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220411 -> 20220411 2024-09-10T23:00:25.564 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220509 -> 20220509 2024-09-10T23:00:25.564 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220610 -> 20220610 2024-09-10T23:00:25.564 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220708 -> 20220708 2024-09-10T23:00:25.565 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220815 -> 20220815 2024-09-10T23:00:25.566 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220913 -> 20220913 2024-09-10T23:00:25.566 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20221012 -> 20221012 2024-09-10T23:00:25.566 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20221109 -> 20221109 2024-09-10T23:00:25.566 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20221214 -> 20221214 2024-09-10T23:00:25.566 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230117 -> 20230117 2024-09-10T23:00:25.566 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230210 -> 20230210 2024-09-10T23:00:25.566 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230310 -> 20230310 2024-09-10T23:00:25.566 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230404 -> 20230404 2024-09-10T23:00:25.567 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230515 -> 20230515 2024-09-10T23:00:25.567 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230625 -> 20230625 2024-09-10T23:00:25.567 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230804 -> 20230804 2024-09-10T23:00:25.567 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230919 -> 20230919 2024-09-10T23:00:25.567 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20231030 -> 20231030 2024-09-10T23:00:25.568 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20231111 -> 20231111 2024-09-10T23:00:25.568 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20231211 -> 20231211 2024-09-10T23:00:25.568 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20240115 -> 20240115 2024-09-10T23:00:25.569 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20240220 -> 20240220 2024-09-10T23:00:25.569 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20240312 -> 20240312 2024-09-10T23:00:25.569 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20240410 -> 20240410 2024-09-10T23:00:25.569 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20240513 -> 20240513 2024-09-10T23:00:25.569 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20240610 -> 20240610 2024-09-10T23:00:25.569 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20240709 -> 20240709 2024-09-10T23:00:25.569 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20240811 -> 20240811 2024-09-10T23:00:25.569 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20240909 -> 20240909 2024-09-10T23:00:27.669 INFO:teuthology.orchestra.run.smithi017.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-10T23:00:27.670 INFO:teuthology.orchestra.run.smithi017.stderr: * [new branch] main -> origin/main 2024-09-10T23:00:27.708 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20190312 -> 20190312 2024-09-10T23:00:27.708 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20190416 -> 20190416 2024-09-10T23:00:27.708 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20190514 -> 20190514 2024-09-10T23:00:27.708 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20190618 -> 20190618 2024-09-10T23:00:27.708 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20190717 -> 20190717 2024-09-10T23:00:27.708 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20190815 -> 20190815 2024-09-10T23:00:27.709 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20190923 -> 20190923 2024-09-10T23:00:27.709 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20191022 -> 20191022 2024-09-10T23:00:27.709 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20191215 -> 20191215 2024-09-10T23:00:27.709 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20200122 -> 20200122 2024-09-10T23:00:27.709 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20200316 -> 20200316 2024-09-10T23:00:27.709 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20200421 -> 20200421 2024-09-10T23:00:27.711 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20200519 -> 20200519 2024-09-10T23:00:27.711 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20200619 -> 20200619 2024-09-10T23:00:27.711 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20200721 -> 20200721 2024-09-10T23:00:27.711 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20200817 -> 20200817 2024-09-10T23:00:27.711 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20200918 -> 20200918 2024-09-10T23:00:27.711 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20201022 -> 20201022 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20201118 -> 20201118 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20201218 -> 20201218 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20210208 -> 20210208 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20210315 -> 20210315 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20210511 -> 20210511 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20210716 -> 20210716 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20210818 -> 20210818 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20210919 -> 20210919 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20211027 -> 20211027 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20211216 -> 20211216 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20220209 -> 20220209 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20220310 -> 20220310 2024-09-10T23:00:27.712 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20220411 -> 20220411 2024-09-10T23:00:27.713 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20220509 -> 20220509 2024-09-10T23:00:27.713 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20220610 -> 20220610 2024-09-10T23:00:27.713 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20220708 -> 20220708 2024-09-10T23:00:27.715 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20220815 -> 20220815 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20220913 -> 20220913 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20221012 -> 20221012 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20221109 -> 20221109 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20221214 -> 20221214 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20230117 -> 20230117 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20230210 -> 20230210 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20230310 -> 20230310 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20230404 -> 20230404 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20230515 -> 20230515 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20230625 -> 20230625 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20230804 -> 20230804 2024-09-10T23:00:27.716 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20230919 -> 20230919 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20231030 -> 20231030 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20231111 -> 20231111 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20231211 -> 20231211 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20240115 -> 20240115 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20240220 -> 20240220 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20240312 -> 20240312 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20240410 -> 20240410 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20240513 -> 20240513 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20240610 -> 20240610 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20240709 -> 20240709 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20240811 -> 20240811 2024-09-10T23:00:27.717 INFO:teuthology.orchestra.run.smithi017.stderr: * [new tag] 20240909 -> 20240909 2024-09-10T23:00:30.058 INFO:teuthology.orchestra.run.smithi077.stderr:Updating files: 44% (1563/3501) Updating files: 45% (1576/3501) Updating files: 46% (1611/3501) Updating files: 47% (1646/3501) Updating files: 48% (1681/3501) Updating files: 49% (1716/3501) Updating files: 50% (1751/3501) Updating files: 51% (1786/3501) Updating files: 52% (1821/3501) Updating files: 53% (1856/3501) Updating files: 54% (1891/3501) Updating files: 55% (1926/3501) Updating files: 56% (1961/3501) Updating files: 57% (1996/3501) Updating files: 58% (2031/3501) Updating files: 59% (2066/3501) Updating files: 59% (2070/3501) Updating files: 60% (2101/3501) Updating files: 61% (2136/3501) Updating files: 62% (2171/3501) Updating files: 63% (2206/3501) Updating files: 64% (2241/3501) Updating files: 65% (2276/3501) Updating files: 66% (2311/3501) Updating files: 67% (2346/3501) Updating files: 68% (2381/3501) Updating files: 69% (2416/3501) Updating files: 69% (2428/3501) Updating files: 70% (2451/3501) Updating files: 71% (2486/3501) Updating files: 72% (2521/3501) Updating files: 73% (2556/3501) Updating files: 74% (2591/3501) Updating files: 75% (2626/3501) Updating files: 76% (2661/3501) Updating files: 77% (2696/3501) Updating files: 78% (2731/3501) Updating files: 79% (2766/3501) Updating files: 80% (2801/3501) Updating files: 81% (2836/3501) Updating files: 82% (2871/3501) Updating files: 82% (2891/3501) Updating files: 83% (2906/3501) Updating files: 84% (2941/3501) Updating files: 85% (2976/3501) Updating files: 86% (3011/3501) Updating files: 87% (3046/3501) Updating files: 88% (3081/3501) Updating files: 89% (3116/3501) Updating files: 90% (3151/3501) Updating files: 91% (3186/3501) Updating files: 92% (3221/3501) Updating files: 93% (3256/3501) Updating files: 94% (3291/3501) Updating files: 95% (3326/3501) Updating files: 96% (3361/3501) Updating files: 97% (3396/3501) Updating files: 98% (3431/3501) Updating files: 99% (3466/3501) Updating files: 100% (3501/3501) Updating files: 100% (3501/3501), done. 2024-09-10T23:00:30.063 INFO:teuthology.orchestra.run.smithi077.stdout:HEAD is now at ce299c0f Merge branch 'rt1320' into 'main' 2024-09-10T23:00:30.083 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T23:00:30.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:00:30.235 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T23:00:30.235 DEBUG:teuthology.orchestra.run.smithi077:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-10T23:00:30.238 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi077.front.sepia.ceph.com to complete... 2024-09-10T23:00:31.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10 23:00:31 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-10T23:00:31.223 INFO:teuthology.orchestra.run.smithi077.stderr:FINISHED --2024-09-10 23:00:31-- 2024-09-10T23:00:31.223 INFO:teuthology.orchestra.run.smithi077.stderr:Total wall clock time: 0.9s 2024-09-10T23:00:31.223 INFO:teuthology.orchestra.run.smithi077.stderr:Downloaded: 1 files, 43M in 0.8s (51.9 MB/s) 2024-09-10T23:00:31.228 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T23:00:31.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo dpkg -i /tmp/linux-image.deb 2024-09-10T23:00:31.460 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-10T23:00:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:Updating files: 28% (1012/3501) Updating files: 29% (1016/3501) Updating files: 30% (1051/3501) Updating files: 31% (1086/3501) Updating files: 32% (1121/3501) Updating files: 33% (1156/3501) Updating files: 34% (1191/3501) Updating files: 35% (1226/3501) Updating files: 36% (1261/3501) Updating files: 37% (1296/3501) Updating files: 38% (1331/3501) Updating files: 39% (1366/3501) Updating files: 40% (1401/3501) Updating files: 41% (1436/3501) Updating files: 42% (1471/3501) Updating files: 43% (1506/3501) Updating files: 44% (1541/3501) Updating files: 45% (1576/3501) Updating files: 46% (1611/3501) Updating files: 47% (1646/3501) Updating files: 48% (1681/3501) Updating files: 49% (1716/3501) Updating files: 50% (1751/3501) Updating files: 51% (1786/3501) Updating files: 52% (1821/3501) Updating files: 53% (1856/3501) Updating files: 54% (1891/3501) Updating files: 55% (1926/3501) Updating files: 56% (1961/3501) Updating files: 57% (1996/3501) Updating files: 58% (2031/3501) Updating files: 58% (2047/3501) Updating files: 59% (2066/3501) Updating files: 60% (2101/3501) Updating files: 61% (2136/3501) Updating files: 62% (2171/3501) Updating files: 63% (2206/3501) Updating files: 64% (2241/3501) Updating files: 65% (2276/3501) Updating files: 66% (2311/3501) Updating files: 67% (2346/3501) Updating files: 68% (2381/3501) Updating files: 69% (2416/3501) Updating files: 70% (2451/3501) Updating files: 71% (2486/3501) Updating files: 72% (2521/3501) Updating files: 73% (2556/3501) Updating files: 74% (2591/3501) Updating files: 75% (2626/3501) Updating files: 76% (2661/3501) Updating files: 77% (2696/3501) Updating files: 78% (2731/3501) Updating files: 79% (2766/3501) Updating files: 80% (2801/3501) Updating files: 81% (2836/3501) Updating files: 82% (2871/3501) Updating files: 82% (2875/3501) Updating files: 83% (2906/3501) Updating files: 84% (2941/3501) Updating files: 85% (2976/3501) Updating files: 86% (3011/3501) Updating files: 87% (3046/3501) Updating files: 88% (3081/3501) Updating files: 89% (3116/3501) Updating files: 90% (3151/3501) Updating files: 91% (3186/3501) Updating files: 92% (3221/3501) Updating files: 93% (3256/3501) Updating files: 94% (3291/3501) Updating files: 95% (3326/3501) Updating files: 96% (3361/3501) Updating files: 97% (3396/3501) Updating files: 98% (3431/3501) Updating files: 99% (3466/3501) Updating files: 100% (3501/3501) Updating files: 100% (3501/3501), done. 2024-09-10T23:00:32.477 INFO:teuthology.orchestra.run.smithi017.stdout:HEAD is now at ce299c0f Merge branch 'rt1320' into 'main' 2024-09-10T23:00:32.500 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T23:00:32.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T23:00:32.659 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T23:00:32.659 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-10T23:00:32.662 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi017.front.sepia.ceph.com to complete... 2024-09-10T23:00:33.451 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-10T23:00:33.455 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-10T23:00:33.583 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-10T23:00:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10 23:00:34 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-10T23:00:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:FINISHED --2024-09-10 23:00:34-- 2024-09-10T23:00:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:Total wall clock time: 1.0s 2024-09-10T23:00:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:Downloaded: 1 files, 43M in 0.8s (52.0 MB/s) 2024-09-10T23:00:33.645 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T23:00:33.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo dpkg -i /tmp/linux-image.deb 2024-09-10T23:00:34.139 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-10T23:00:36.068 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-10T23:00:36.072 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-10T23:00:36.194 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-10T23:00:37.329 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-10T23:00:37.437 INFO:teuthology.orchestra.run.smithi077.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:00:39.871 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-10T23:00:39.997 INFO:teuthology.orchestra.run.smithi017.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:00.233 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub' 2024-09-10T23:01:00.243 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T23:01:00.280 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2024-09-10T23:01:00.547 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:00.568 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:00.872 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T23:01:00.878 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T23:01:00.941 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T23:01:00.946 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T23:01:01.089 INFO:teuthology.orchestra.run.smithi077.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T23:01:01.089 INFO:teuthology.orchestra.run.smithi077.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T23:01:01.089 INFO:teuthology.orchestra.run.smithi077.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T23:01:01.130 INFO:teuthology.orchestra.run.smithi077.stderr:done 2024-09-10T23:01:01.307 DEBUG:teuthology.orchestra.run.smithi077:> dpkg-deb -c /tmp/linux-image.deb 2024-09-10T23:01:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-10T23:01:01.315 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-10T23:01:01.315 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:01.332 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:01.332 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:01.359 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-10T23:01:01.359 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-10T23:01:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:01:01.361 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-10T23:01:01.362 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-10T23:01:01.363 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-10T23:01:01.363 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:01:01.363 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:01:01.363 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-10T23:01:01.413 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:01:01.414 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:01:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:01:01.416 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-10T23:01:01.417 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:01:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:01:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:01:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:01:01.421 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:01:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:01:01.423 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:01:01.424 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-10T23:01:01.425 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-10T23:01:01.426 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-10T23:01:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:01:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:01:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:01:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-10T23:01:01.431 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-10T23:01:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-10T23:01:01.433 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-10T23:01:01.434 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:01:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-10T23:01:01.436 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:01:01.437 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:01:01.438 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:01:01.439 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-10T23:01:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:01:01.441 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:01:01.442 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-10T23:01:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:01:01.444 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:01:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:01:01.446 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:01:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:01:01.448 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:01:01.449 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:01:01.450 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:01:01.451 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-10T23:01:01.452 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:01:01.453 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:01:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:01:01.455 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:01:01.456 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:01:01.457 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-10T23:01:01.458 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:01:01.516 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-10T23:01:01.517 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-10T23:01:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-10T23:01:01.519 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-10T23:01:01.520 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-10T23:01:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:01:01.522 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:01:01.523 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:01:01.524 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:01:01.525 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-10T23:01:01.526 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-10T23:01:01.527 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:01:01.528 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-10T23:01:01.529 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-10T23:01:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:01:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:01:01.532 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:01:01.533 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:01:01.534 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:01:01.535 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-10T23:01:01.536 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:01:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-10T23:01:01.538 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-10T23:01:01.539 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:01:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:01:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:01:01.542 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:01:01.543 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:01:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:01:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:01:01.546 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:01:01.547 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-10T23:01:01.548 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:01:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:01:01.550 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-10T23:01:01.551 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:01:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-10T23:01:01.553 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-10T23:01:01.554 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:01:01.555 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-10T23:01:01.556 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:01:01.557 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:01:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-10T23:01:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-10T23:01:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:01:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:01:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:01:01.563 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-10T23:01:01.564 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:01:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-10T23:01:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-10T23:01:01.567 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:01:01.568 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-10T23:01:01.569 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:01:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:01:01.571 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:01:01.572 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-10T23:01:01.573 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:01:01.615 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-10T23:01:01.615 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:01:01.616 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-10T23:01:01.617 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-10T23:01:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:01:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-10T23:01:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:01:01.621 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:01:01.622 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-10T23:01:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-10T23:01:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-10T23:01:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-10T23:01:01.626 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-10T23:01:01.627 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-10T23:01:01.628 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-10T23:01:01.629 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-10T23:01:01.629 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-10T23:01:01.629 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-10T23:01:01.629 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-10T23:01:01.629 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:01:01.692 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-10T23:01:01.692 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-10T23:01:01.692 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-10T23:01:01.692 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-10T23:01:01.692 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:01:01.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:01:01.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:01:01.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:01:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:01:01.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:01:01.698 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:01:01.699 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:01:01.700 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-10T23:01:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:01:01.702 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-10T23:01:01.703 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-10T23:01:01.704 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:01:01.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-10T23:01:01.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-10T23:01:01.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:01:01.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:01:01.709 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:01:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-10T23:01:01.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-10T23:01:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:01:01.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-10T23:01:01.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-10T23:01:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:01:01.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:01:01.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:01:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:01:01.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-10T23:01:01.720 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:01:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-10T23:01:01.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:01:01.723 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-10T23:01:01.724 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:01:01.762 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-10T23:01:01.762 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-10T23:01:01.762 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-10T23:01:01.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-10T23:01:01.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-10T23:01:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-10T23:01:01.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:01:01.767 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:01:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:01:01.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:01:01.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:01:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-10T23:01:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:01:01.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:01:01.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:01:01.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:01:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:01:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-10T23:01:01.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:01:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:01:01.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:01:01.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:01:01.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:01:01.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:01:01.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:01:01.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-10T23:01:01.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:01:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:01:01.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:01:01.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:01:01.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:01:01.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:01:01.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:01:01.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:01:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-10T23:01:01.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:01:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-10T23:01:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-10T23:01:01.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:01:01.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:01:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:01:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:01:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:01:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-10T23:01:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-10T23:01:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-10T23:01:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T23:01:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-10T23:01:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-10T23:01:01.806 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:01.806 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:01.806 DEBUG:teuthology.orchestra.run.smithi077:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-10T23:01:01.813 INFO:teuthology.orchestra.run.smithi077.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T23:01:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T23:01:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T23:01:01.814 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-10T23:01:01.814 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:01.814 DEBUG:teuthology.orchestra.run.smithi077:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-10T23:01:01.855 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi077.front.sepia.ceph.com to complete... 2024-09-10T23:01:02.126 INFO:teuthology.orchestra.run.smithi017.stderr:Sourcing file `/etc/default/grub' 2024-09-10T23:01:02.140 INFO:teuthology.orchestra.run.smithi017.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T23:01:02.156 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-10T23:01:02.284 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub' 2024-09-10T23:01:02.285 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T23:01:02.297 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2024-09-10T23:01:02.431 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:02.449 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:02.717 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T23:01:02.727 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T23:01:02.732 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T23:01:02.732 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T23:01:02.774 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T23:01:02.779 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T23:01:02.797 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T23:01:02.802 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T23:01:02.920 INFO:teuthology.orchestra.run.smithi077.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T23:01:02.921 INFO:teuthology.orchestra.run.smithi077.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T23:01:02.921 INFO:teuthology.orchestra.run.smithi077.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T23:01:02.934 INFO:teuthology.orchestra.run.smithi077.stderr:done 2024-09-10T23:01:02.976 INFO:teuthology.orchestra.run.smithi017.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T23:01:02.977 INFO:teuthology.orchestra.run.smithi017.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T23:01:02.977 INFO:teuthology.orchestra.run.smithi017.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T23:01:03.015 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-10T23:01:03.214 DEBUG:teuthology.orchestra.run.smithi017:> dpkg-deb -c /tmp/linux-image.deb 2024-09-10T23:01:03.221 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-10T23:01:03.222 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-10T23:01:03.222 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:03.242 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:03.242 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-10T23:01:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-10T23:01:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-10T23:01:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T23:01:03.270 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-10T23:01:03.271 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T23:01:03.272 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T23:01:03.272 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T23:01:03.288 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-10T23:01:03.288 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T23:01:03.289 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T23:01:03.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T23:01:03.291 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T23:01:03.292 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-10T23:01:03.293 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-10T23:01:03.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T23:01:03.295 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T23:01:03.296 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T23:01:03.297 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T23:01:03.298 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-10T23:01:03.299 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T23:01:03.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T23:01:03.332 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-10T23:01:03.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T23:01:03.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T23:01:03.332 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-10T23:01:03.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T23:01:03.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T23:01:03.332 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T23:01:03.332 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T23:01:03.333 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T23:01:03.334 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-10T23:01:03.335 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-10T23:01:03.336 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-10T23:01:03.337 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T23:01:03.338 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-10T23:01:03.339 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-10T23:01:03.340 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-10T23:01:03.341 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-10T23:01:03.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T23:01:03.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T23:01:03.344 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T23:01:03.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T23:01:03.346 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T23:01:03.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T23:01:03.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-10T23:01:03.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T23:01:03.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-10T23:01:03.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T23:01:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T23:01:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T23:01:03.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T23:01:03.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T23:01:03.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T23:01:03.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T23:01:03.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T23:01:03.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-10T23:01:03.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T23:01:03.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T23:01:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-10T23:01:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-10T23:01:03.364 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-10T23:01:03.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T23:01:03.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T23:01:03.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T23:01:03.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T23:01:03.387 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-10T23:01:03.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T23:01:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-10T23:01:03.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-10T23:01:03.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T23:01:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-10T23:01:03.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-10T23:01:03.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-10T23:01:03.395 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-10T23:01:03.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T23:01:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T23:01:03.398 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-10T23:01:03.399 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-10T23:01:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-10T23:01:03.401 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-10T23:01:03.402 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-10T23:01:03.404 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-10T23:01:03.405 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-10T23:01:03.406 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T23:01:03.407 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T23:01:03.408 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T23:01:03.409 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-10T23:01:03.410 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T23:01:03.411 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-10T23:01:03.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T23:01:03.412 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-10T23:01:03.412 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T23:01:03.419 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-10T23:01:03.419 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T23:01:03.419 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-10T23:01:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T23:01:03.421 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-10T23:01:03.422 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T23:01:03.423 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-10T23:01:03.424 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-10T23:01:03.425 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-10T23:01:03.426 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T23:01:03.427 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T23:01:03.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-10T23:01:03.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-10T23:01:03.450 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-10T23:01:03.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T23:01:03.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T23:01:03.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T23:01:03.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-10T23:01:03.455 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T23:01:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-10T23:01:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-10T23:01:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T23:01:03.459 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T23:01:03.460 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-10T23:01:03.461 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-10T23:01:03.462 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T23:01:03.463 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-10T23:01:03.464 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T23:01:03.465 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-10T23:01:03.466 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T23:01:03.467 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-10T23:01:03.468 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-10T23:01:03.469 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-10T23:01:03.475 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T23:01:03.475 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T23:01:03.476 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T23:01:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T23:01:03.478 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-10T23:01:03.479 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-10T23:01:03.480 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-10T23:01:03.481 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-10T23:01:03.481 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-10T23:01:03.481 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-10T23:01:03.481 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T23:01:03.481 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T23:01:03.481 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-10T23:01:03.481 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T23:01:03.481 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-10T23:01:03.481 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T23:01:03.482 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T23:01:03.482 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-10T23:01:03.482 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T23:01:03.482 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-10T23:01:03.483 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T23:01:03.483 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T23:01:03.483 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T23:01:03.483 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T23:01:03.484 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T23:01:03.484 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T23:01:03.484 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T23:01:03.484 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T23:01:03.484 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T23:01:03.484 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T23:01:03.484 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-10T23:01:03.484 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T23:01:03.485 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T23:01:03.485 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T23:01:03.485 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T23:01:03.486 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-10T23:01:03.486 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-10T23:01:03.486 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T23:01:03.486 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-10T23:01:03.486 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-10T23:01:03.486 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T23:01:03.487 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-10T23:01:03.487 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T23:01:03.487 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T23:01:03.487 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T23:01:03.487 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T23:01:03.489 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T23:01:03.489 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T23:01:03.490 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-10T23:01:03.490 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T23:01:03.493 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T23:01:03.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-10T23:01:03.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T23:01:03.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-10T23:01:03.497 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-10T23:01:03.497 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-10T23:01:03.497 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-10T23:01:03.497 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-10T23:01:03.497 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T23:01:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-10T23:01:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T23:01:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-10T23:01:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-10T23:01:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T23:01:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T23:01:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T23:01:03.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-10T23:01:03.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-10T23:01:03.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-10T23:01:03.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-10T23:01:03.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-10T23:01:03.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-10T23:01:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-10T23:01:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-10T23:01:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-10T23:01:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-10T23:01:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-10T23:01:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-10T23:01:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-10T23:01:03.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-10T23:01:03.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T23:01:03.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T23:01:03.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-10T23:01:03.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T23:01:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T23:01:03.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T23:01:03.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T23:01:03.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T23:01:03.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-10T23:01:03.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-10T23:01:03.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-10T23:01:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-10T23:01:03.539 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T23:01:03.540 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T23:01:03.541 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-10T23:01:03.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-10T23:01:03.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-10T23:01:03.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-10T23:01:03.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-10T23:01:03.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T23:01:03.548 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-10T23:01:03.548 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-10T23:01:03.549 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T23:01:03.550 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-10T23:01:03.551 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T23:01:03.551 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-10T23:01:03.551 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-10T23:01:03.551 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-10T23:01:03.551 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T23:01:03.552 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-10T23:01:03.552 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T23:01:03.552 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-10T23:01:03.552 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T23:01:03.552 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-10T23:01:03.552 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T23:01:03.552 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-10T23:01:03.552 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T23:01:03.553 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-10T23:01:03.553 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-10T23:01:03.553 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T23:01:03.553 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-10T23:01:03.553 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T23:01:03.553 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-10T23:01:03.554 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T23:01:03.554 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T23:01:03.555 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-10T23:01:03.555 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T23:01:03.555 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T23:01:03.559 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-10T23:01:03.560 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T23:01:03.560 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T23:01:03.560 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-10T23:01:03.560 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T23:01:03.563 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-10T23:01:03.563 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T23:01:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T23:01:03.569 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T23:01:03.570 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T23:01:03.571 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-10T23:01:03.572 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-10T23:01:03.572 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-10T23:01:03.572 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-10T23:01:03.573 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T23:01:03.573 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-10T23:01:03.573 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T23:01:03.573 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-10T23:01:03.573 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T23:01:03.573 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T23:01:03.576 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T23:01:03.576 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T23:01:03.577 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T23:01:03.577 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-10T23:01:03.577 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-10T23:01:03.577 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-10T23:01:03.577 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T23:01:03.578 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-10T23:01:03.578 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T23:01:03.578 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-10T23:01:03.578 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-10T23:01:03.578 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-10T23:01:03.579 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-10T23:01:03.579 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-10T23:01:03.579 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-10T23:01:03.579 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-10T23:01:03.579 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-10T23:01:03.579 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-10T23:01:03.579 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T23:01:03.580 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-10T23:01:03.580 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T23:01:03.580 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-10T23:01:03.580 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-10T23:01:03.580 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T23:01:03.585 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-10T23:01:03.585 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T23:01:03.586 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T23:01:03.586 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-10T23:01:03.586 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T23:01:03.586 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-10T23:01:03.586 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T23:01:03.586 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-10T23:01:03.586 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T23:01:03.587 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-10T23:01:03.587 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T23:01:03.587 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-10T23:01:03.587 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T23:01:03.597 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T23:01:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-10T23:01:03.599 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-10T23:01:03.600 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T23:01:03.600 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-10T23:01:03.600 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-10T23:01:03.600 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T23:01:03.600 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-10T23:01:03.600 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-10T23:01:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-10T23:01:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-10T23:01:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T23:01:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T23:01:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T23:01:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-10T23:01:03.603 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T23:01:03.604 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T23:01:03.605 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-10T23:01:03.606 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T23:01:03.610 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T23:01:03.611 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T23:01:03.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-10T23:01:03.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T23:01:03.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T23:01:03.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T23:01:03.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T23:01:03.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T23:01:03.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T23:01:03.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T23:01:03.633 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T23:01:03.634 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-10T23:01:03.635 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-10T23:01:03.636 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T23:01:03.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T23:01:03.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T23:01:03.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T23:01:03.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T23:01:03.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T23:01:03.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T23:01:03.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T23:01:03.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T23:01:03.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T23:01:03.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T23:01:03.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T23:01:03.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T23:01:03.656 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T23:01:03.656 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T23:01:03.656 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T23:01:03.657 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T23:01:03.658 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T23:01:03.659 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T23:01:03.660 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T23:01:03.661 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T23:01:03.662 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-10T23:01:03.663 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T23:01:03.664 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T23:01:03.665 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T23:01:03.666 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T23:01:03.667 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-10T23:01:03.668 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-10T23:01:03.669 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-10T23:01:03.670 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T23:01:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-10T23:01:03.672 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-10T23:01:03.672 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-10T23:01:03.672 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-10T23:01:03.672 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-10T23:01:03.672 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-10T23:01:03.677 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:03.677 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:03.677 DEBUG:teuthology.orchestra.run.smithi017:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-10T23:01:03.706 INFO:teuthology.orchestra.run.smithi017.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T23:01:03.706 INFO:teuthology.orchestra.run.smithi017.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T23:01:03.706 INFO:teuthology.orchestra.run.smithi017.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-10T23:01:03.707 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-10T23:01:03.707 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:03.707 DEBUG:teuthology.orchestra.run.smithi017:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-10T23:01:03.750 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi017.front.sepia.ceph.com to complete... 2024-09-10T23:01:04.261 INFO:teuthology.orchestra.run.smithi017.stderr:Sourcing file `/etc/default/grub' 2024-09-10T23:01:04.263 INFO:teuthology.orchestra.run.smithi017.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T23:01:04.272 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-10T23:01:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:04.455 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:01:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T23:01:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T23:01:04.749 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T23:01:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T23:01:04.906 INFO:teuthology.orchestra.run.smithi017.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T23:01:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T23:01:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T23:01:04.925 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-10T23:01:34.073 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T23:01:34.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-10T23:01:34.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:01:36.073 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T23:01:36.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T23:01:36.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:01:52.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-10T23:01:54.621 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-10T23:02:01.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-10T23:02:01.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:02:03.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T23:02:03.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:02:04.669 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-10T23:02:16.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-10T23:02:16.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:02:35.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-10T23:02:50.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-10T23:02:50.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:02:50.434 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-10T23:02:51.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-10T23:02:51.545 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:02:51.545 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-10T23:02:51.596 INFO:teuthology.orchestra.run.smithi077.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:02:51.596 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:02:51.596 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:02:51.596 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T23:02:52.597 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T23:02:52.597 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:02:52.672 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2024-09-10T23:02:52.732 DEBUG:teuthology.parallel:result is None 2024-09-10T23:03:03.635 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T23:03:15.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T23:03:15.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:03:15.870 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-10T23:03:16.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T23:03:16.620 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T23:03:16.620 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-10T23:03:16.672 INFO:teuthology.orchestra.run.smithi017.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:16.672 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T23:03:16.672 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T23:03:16.672 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T23:03:17.673 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T23:03:17.673 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T23:03:17.745 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-09-10T23:03:17.805 DEBUG:teuthology.parallel:result is None 2024-09-10T23:03:17.805 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T23:03:17.815 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T23:03:17.815 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:03:17.818 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T23:03:17.827 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T23:03:17.848 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T23:03:17.881 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T23:03:17.882 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:03:17.885 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T23:03:17.904 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T23:03:17.915 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T23:03:17.915 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:03:17.943 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T23:03:17.968 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:03:17.976 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:03:17.982 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:03:17.989 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T23:03:17.992 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T23:03:17.998 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T23:03:17.998 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:03:18.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T23:03:18.057 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T23:03:18.067 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T23:03:18.067 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:03:18.099 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T23:03:18.109 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:03:18.157 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:03:18.209 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:03:18.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:03:18.281 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T23:03:18.290 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T23:03:18.342 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:03:18.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T23:03:18.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-10T23:03:18.422 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-09-10T23:03:18.538 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T23:03:18.546 INFO:teuthology.task.internal:Starting timer... 2024-09-10T23:03:18.546 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T23:03:18.586 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T23:03:18.619 DEBUG:teuthology.task.selinux:Excluding smithi017: OS 'ubuntu' does not support SELinux 2024-09-10T23:03:18.619 DEBUG:teuthology.task.selinux:Excluding smithi077: OS 'ubuntu' does not support SELinux 2024-09-10T23:03:18.620 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T23:03:18.620 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T23:03:18.620 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T23:03:18.620 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T23:03:18.651 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T23:03:18.664 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T23:03:18.665 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi077.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T23:11:40.008 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi077.front.sepia.ceph.com')] 2024-09-10T23:11:40.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T23:11:40.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:11:40.119 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-10T23:11:40.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-10T23:11:40.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-10T23:11:40.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T23:11:40.359 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-10T23:11:40.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-10T23:11:40.500 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T23:11:40.510 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T23:11:40.511 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:11:40.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:11:40.514 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T23:11:40.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:11:40.551 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T23:11:40.551 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: Command line: ntpd -gq 2024-09-10T23:11:40.552 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: ---------------------------------------------------- 2024-09-10T23:11:40.552 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T23:11:40.552 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T23:11:40.552 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: corporation. Support and training for ntp-4 are 2024-09-10T23:11:40.552 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: available at https://www.nwtime.org/support 2024-09-10T23:11:40.552 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: ---------------------------------------------------- 2024-09-10T23:11:40.552 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: proto: precision = 0.042 usec (-24) 2024-09-10T23:11:40.553 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: basedate set to 2022-02-04 2024-09-10T23:11:40.553 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: gps base set to 2022-02-06 (week 2196) 2024-09-10T23:11:40.553 INFO:teuthology.orchestra.run.smithi017.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T23:11:40.553 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T23:11:40.553 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T23:11:40.554 INFO:teuthology.orchestra.run.smithi017.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T23:11:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T23:11:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T23:11:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T23:11:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: Listen normally on 3 ens1f0 172.21.15.17:123 2024-09-10T23:11:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: Listen normally on 4 lo [::1]:123 2024-09-10T23:11:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:fe59:d992%3]:123 2024-09-10T23:11:40.555 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:40 ntpd[18381]: Listening on routing socket on fd #22 for interface updates 2024-09-10T23:11:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T23:11:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: Command line: ntpd -gq 2024-09-10T23:11:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: ---------------------------------------------------- 2024-09-10T23:11:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T23:11:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T23:11:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: corporation. Support and training for ntp-4 are 2024-09-10T23:11:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: available at https://www.nwtime.org/support 2024-09-10T23:11:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: ---------------------------------------------------- 2024-09-10T23:11:40.582 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: proto: precision = 0.040 usec (-24) 2024-09-10T23:11:40.582 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: basedate set to 2022-02-04 2024-09-10T23:11:40.582 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: gps base set to 2022-02-06 (week 2196) 2024-09-10T23:11:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T23:11:40.583 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T23:11:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T23:11:40.583 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T23:11:40.584 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T23:11:40.584 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T23:11:40.585 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T23:11:40.585 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: Listen normally on 3 enp3s0f1 172.21.15.77:123 2024-09-10T23:11:40.585 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: Listen normally on 4 lo [::1]:123 2024-09-10T23:11:40.585 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3d3%5]:123 2024-09-10T23:11:40.585 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:40 ntpd[18436]: Listening on routing socket on fd #22 for interface updates 2024-09-10T23:11:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:41 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:41.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:41 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:41.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:41 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:41.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:41 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:41.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:41 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:41.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:41 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:41.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:41 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:41.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:41 ntpd[18436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:41.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:41 ntpd[18436]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:42.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:42 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:42.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:42 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:42.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:42 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:42.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:42 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:42.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:42 ntpd[18436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:42.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:42 ntpd[18436]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:43.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:43 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:43.581 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:43 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:43.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:43 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:43.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:43 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:43.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:43 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:43.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:43 ntpd[18436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:43.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:43 ntpd[18436]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:44.552 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:44 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:44.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:44 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:44.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:44 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:44.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:44 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:44.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:44 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:44.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:44 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:44.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:44 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:44.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:44 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:44.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:44 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:44.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:44 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:44.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:44 ntpd[18436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:44.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:44 ntpd[18436]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:45.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:45.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:45.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:45.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:45.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:45.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:45 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:45.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:45.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:45 ntpd[18436]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:46 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:46 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:46 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:46 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:46 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:46 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:46.581 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:46 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:46.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:46 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:46.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:46 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:46.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:46 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:46.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:46 ntpd[18436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:46.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:46 ntpd[18436]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:47.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:47.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:47.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:47.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:47.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:47.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:47.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:47.553 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:47.554 INFO:teuthology.orchestra.run.smithi017.stdout:10 Sep 23:11:47 ntpd[18381]: ntpd: time slew -0.001348 s 2024-09-10T23:11:47.554 INFO:teuthology.orchestra.run.smithi017.stdout:ntpd: time slew -0.001348s 2024-09-10T23:11:47.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T23:11:47.554 INFO:teuthology.orchestra.run.smithi017.stderr:10 Sep 23:11:47 ntpd[18381]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T23:11:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T23:11:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T23:11:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T23:11:47.582 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T23:11:47.583 INFO:teuthology.orchestra.run.smithi077.stdout:10 Sep 23:11:47 ntpd[18436]: ntpd: time slew -0.000479 s 2024-09-10T23:11:47.583 INFO:teuthology.orchestra.run.smithi077.stdout:ntpd: time slew -0.000479s 2024-09-10T23:11:47.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T23:11:47.583 INFO:teuthology.orchestra.run.smithi077.stderr:10 Sep 23:11:47 ntpd[18436]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T23:11:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T23:11:47.663 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================== 2024-09-10T23:11:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T23:11:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T23:11:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T23:11:47.663 INFO:teuthology.orchestra.run.smithi017.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T23:11:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T23:11:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================== 2024-09-10T23:11:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T23:11:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T23:11:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T23:11:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T23:11:47.697 INFO:teuthology.run_tasks:Running task install... 2024-09-10T23:11:47.705 DEBUG:teuthology.task.install:project ceph 2024-09-10T23:11:47.705 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T23:11:47.705 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T23:11:47.705 INFO:teuthology.task.install:Using flavor: default 2024-09-10T23:11:47.710 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T23:11:47.711 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T23:11:47.711 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-key list | grep Ceph 2024-09-10T23:11:47.711 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-key list | grep Ceph 2024-09-10T23:11:47.816 INFO:teuthology.orchestra.run.smithi017.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T23:11:47.844 INFO:teuthology.orchestra.run.smithi077.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T23:11:47.867 INFO:teuthology.orchestra.run.smithi017.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T23:11:47.868 INFO:teuthology.orchestra.run.smithi017.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T23:11:47.869 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-10T23:11:47.869 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-10T23:11:47.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:11:47.894 INFO:teuthology.orchestra.run.smithi077.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T23:11:47.894 INFO:teuthology.orchestra.run.smithi077.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T23:11:47.895 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-10T23:11:47.895 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-10T23:11:47.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:11:48.026 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default/ 2024-09-10T23:11:48.026 INFO:teuthology.task.install.deb:Package version is 19.3.0-4854-g8f219c47-1jammy 2024-09-10T23:11:48.076 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default/ 2024-09-10T23:11:48.076 INFO:teuthology.task.install.deb:Package version is 19.3.0-4854-g8f219c47-1jammy 2024-09-10T23:11:48.184 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:11:48.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T23:11:48.194 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:11:48.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T23:11:48.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get update 2024-09-10T23:11:48.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-get update 2024-09-10T23:11:48.391 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T23:11:48.397 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T23:11:48.398 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T23:11:48.400 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T23:11:48.405 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T23:11:48.414 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T23:11:48.422 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T23:11:48.442 INFO:teuthology.orchestra.run.smithi017.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T23:11:48.454 INFO:teuthology.orchestra.run.smithi077.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T23:11:48.463 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T23:11:48.476 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T23:11:48.486 INFO:teuthology.orchestra.run.smithi017.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T23:11:48.498 INFO:teuthology.orchestra.run.smithi077.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T23:11:48.507 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T23:11:48.519 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-10T23:11:48.528 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T23:11:48.540 INFO:teuthology.orchestra.run.smithi017.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-10T23:11:48.555 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T23:11:49.003 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 29.3 kB in 1s (52.4 kB/s) 2024-09-10T23:11:49.010 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 29.3 kB in 1s (51.2 kB/s) 2024-09-10T23:11:50.033 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-09-10T23:11:50.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4854-g8f219c47-1jammy cephadm=19.3.0-4854-g8f219c47-1jammy ceph-mds=19.3.0-4854-g8f219c47-1jammy ceph-mgr=19.3.0-4854-g8f219c47-1jammy ceph-common=19.3.0-4854-g8f219c47-1jammy ceph-fuse=19.3.0-4854-g8f219c47-1jammy ceph-test=19.3.0-4854-g8f219c47-1jammy ceph-volume=19.3.0-4854-g8f219c47-1jammy radosgw=19.3.0-4854-g8f219c47-1jammy python3-rados=19.3.0-4854-g8f219c47-1jammy python3-rgw=19.3.0-4854-g8f219c47-1jammy python3-cephfs=19.3.0-4854-g8f219c47-1jammy python3-rbd=19.3.0-4854-g8f219c47-1jammy libcephfs2=19.3.0-4854-g8f219c47-1jammy libcephfs-dev=19.3.0-4854-g8f219c47-1jammy librados2=19.3.0-4854-g8f219c47-1jammy librbd1=19.3.0-4854-g8f219c47-1jammy rbd-fuse=19.3.0-4854-g8f219c47-1jammy python3-cephfs=19.3.0-4854-g8f219c47-1jammy cephfs-shell=19.3.0-4854-g8f219c47-1jammy cephfs-top=19.3.0-4854-g8f219c47-1jammy cephfs-mirror=19.3.0-4854-g8f219c47-1jammy 2024-09-10T23:11:50.073 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-10T23:11:50.088 DEBUG:teuthology.orchestra.run.smithi017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4854-g8f219c47-1jammy cephadm=19.3.0-4854-g8f219c47-1jammy ceph-mds=19.3.0-4854-g8f219c47-1jammy ceph-mgr=19.3.0-4854-g8f219c47-1jammy ceph-common=19.3.0-4854-g8f219c47-1jammy ceph-fuse=19.3.0-4854-g8f219c47-1jammy ceph-test=19.3.0-4854-g8f219c47-1jammy ceph-volume=19.3.0-4854-g8f219c47-1jammy radosgw=19.3.0-4854-g8f219c47-1jammy python3-rados=19.3.0-4854-g8f219c47-1jammy python3-rgw=19.3.0-4854-g8f219c47-1jammy python3-cephfs=19.3.0-4854-g8f219c47-1jammy python3-rbd=19.3.0-4854-g8f219c47-1jammy libcephfs2=19.3.0-4854-g8f219c47-1jammy libcephfs-dev=19.3.0-4854-g8f219c47-1jammy librados2=19.3.0-4854-g8f219c47-1jammy librbd1=19.3.0-4854-g8f219c47-1jammy rbd-fuse=19.3.0-4854-g8f219c47-1jammy python3-cephfs=19.3.0-4854-g8f219c47-1jammy cephfs-shell=19.3.0-4854-g8f219c47-1jammy cephfs-top=19.3.0-4854-g8f219c47-1jammy cephfs-mirror=19.3.0-4854-g8f219c47-1jammy 2024-09-10T23:11:50.124 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-09-10T23:11:50.166 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-10T23:11:50.307 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2024-09-10T23:11:50.307 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2024-09-10T23:11:50.354 INFO:teuthology.orchestra.run.smithi017.stdout:Building dependency tree... 2024-09-10T23:11:50.354 INFO:teuthology.orchestra.run.smithi017.stdout:Reading state information... 2024-09-10T23:11:50.490 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T23:11:50.490 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T23:11:50.490 INFO:teuthology.orchestra.run.smithi077.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T23:11:50.490 INFO:teuthology.orchestra.run.smithi077.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T23:11:50.491 INFO:teuthology.orchestra.run.smithi077.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T23:11:50.491 INFO:teuthology.orchestra.run.smithi077.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T23:11:50.491 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T23:11:50.492 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2024-09-10T23:11:50.492 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T23:11:50.492 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T23:11:50.492 INFO:teuthology.orchestra.run.smithi077.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T23:11:50.492 INFO:teuthology.orchestra.run.smithi077.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-10T23:11:50.492 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-10T23:11:50.494 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-10T23:11:50.495 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-10T23:11:50.495 INFO:teuthology.orchestra.run.smithi077.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-10T23:11:50.495 INFO:teuthology.orchestra.run.smithi077.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-10T23:11:50.495 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-10T23:11:50.495 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-10T23:11:50.495 INFO:teuthology.orchestra.run.smithi077.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-10T23:11:50.495 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2024-09-10T23:11:50.495 INFO:teuthology.orchestra.run.smithi077.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T23:11:50.495 INFO:teuthology.orchestra.run.smithi077.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T23:11:50.496 INFO:teuthology.orchestra.run.smithi077.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T23:11:50.496 INFO:teuthology.orchestra.run.smithi077.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T23:11:50.496 INFO:teuthology.orchestra.run.smithi077.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T23:11:50.496 INFO:teuthology.orchestra.run.smithi077.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T23:11:50.496 INFO:teuthology.orchestra.run.smithi077.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T23:11:50.496 INFO:teuthology.orchestra.run.smithi077.stdout:Recommended packages: 2024-09-10T23:11:50.496 INFO:teuthology.orchestra.run.smithi077.stdout: btrfs-tools 2024-09-10T23:11:50.551 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T23:11:50.551 INFO:teuthology.orchestra.run.smithi017.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T23:11:50.551 INFO:teuthology.orchestra.run.smithi017.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T23:11:50.551 INFO:teuthology.orchestra.run.smithi017.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T23:11:50.551 INFO:teuthology.orchestra.run.smithi017.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T23:11:50.552 INFO:teuthology.orchestra.run.smithi017.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T23:11:50.552 INFO:teuthology.orchestra.run.smithi017.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T23:11:50.552 INFO:teuthology.orchestra.run.smithi017.stdout:The following additional packages will be installed: 2024-09-10T23:11:50.553 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T23:11:50.553 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T23:11:50.553 INFO:teuthology.orchestra.run.smithi017.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T23:11:50.553 INFO:teuthology.orchestra.run.smithi017.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-10T23:11:50.553 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-10T23:11:50.554 INFO:teuthology.orchestra.run.smithi017.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-10T23:11:50.554 INFO:teuthology.orchestra.run.smithi017.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T23:11:50.554 INFO:teuthology.orchestra.run.smithi017.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T23:11:50.554 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-10T23:11:50.555 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout:Suggested packages: 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T23:11:50.556 INFO:teuthology.orchestra.run.smithi017.stdout:Recommended packages: 2024-09-10T23:11:50.557 INFO:teuthology.orchestra.run.smithi017.stdout: btrfs-tools 2024-09-10T23:11:50.650 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2024-09-10T23:11:50.650 INFO:teuthology.orchestra.run.smithi077.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T23:11:50.650 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T23:11:50.650 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-10T23:11:50.650 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-10T23:11:50.650 INFO:teuthology.orchestra.run.smithi077.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T23:11:50.650 INFO:teuthology.orchestra.run.smithi077.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-10T23:11:50.650 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T23:11:50.652 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-10T23:11:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: socat unzip xmlstarlet zip 2024-09-10T23:11:50.717 INFO:teuthology.orchestra.run.smithi017.stdout:The following NEW packages will be installed: 2024-09-10T23:11:50.717 INFO:teuthology.orchestra.run.smithi017.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T23:11:50.717 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T23:11:50.717 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-10T23:11:50.717 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-10T23:11:50.717 INFO:teuthology.orchestra.run.smithi017.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T23:11:50.717 INFO:teuthology.orchestra.run.smithi017.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-10T23:11:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-10T23:11:50.718 INFO:teuthology.orchestra.run.smithi017.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T23:11:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi017.stdout: socat unzip xmlstarlet zip 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi077.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-10T23:11:50.720 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 251 MB of archives. 2024-09-10T23:11:50.721 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 936 MB of additional disk space will be used. 2024-09-10T23:11:50.721 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-10T23:11:50.737 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T23:11:50.747 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-10T23:11:50.788 INFO:teuthology.orchestra.run.smithi017.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-10T23:11:50.788 INFO:teuthology.orchestra.run.smithi017.stdout:Need to get 251 MB of archives. 2024-09-10T23:11:50.788 INFO:teuthology.orchestra.run.smithi017.stdout:After this operation, 936 MB of additional disk space will be used. 2024-09-10T23:11:50.788 INFO:teuthology.orchestra.run.smithi017.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-10T23:11:50.788 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T23:11:50.799 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4854-g8f219c47-1jammy [3,633 kB] 2024-09-10T23:11:50.806 INFO:teuthology.orchestra.run.smithi017.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T23:11:50.809 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T23:11:50.812 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T23:11:50.816 INFO:teuthology.orchestra.run.smithi017.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-10T23:11:50.823 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T23:11:50.857 INFO:teuthology.orchestra.run.smithi017.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T23:11:50.861 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T23:11:50.863 INFO:teuthology.orchestra.run.smithi077.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T23:11:50.869 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4854-g8f219c47-1jammy [3,633 kB] 2024-09-10T23:11:50.870 INFO:teuthology.orchestra.run.smithi077.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T23:11:50.873 INFO:teuthology.orchestra.run.smithi077.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-10T23:11:50.873 INFO:teuthology.orchestra.run.smithi077.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T23:11:50.874 INFO:teuthology.orchestra.run.smithi077.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T23:11:50.880 INFO:teuthology.orchestra.run.smithi017.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T23:11:50.880 INFO:teuthology.orchestra.run.smithi077.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T23:11:50.881 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T23:11:50.882 INFO:teuthology.orchestra.run.smithi077.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T23:11:50.883 INFO:teuthology.orchestra.run.smithi077.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T23:11:50.885 INFO:teuthology.orchestra.run.smithi077.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T23:11:50.892 INFO:teuthology.orchestra.run.smithi017.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T23:11:50.898 INFO:teuthology.orchestra.run.smithi077.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T23:11:50.899 INFO:teuthology.orchestra.run.smithi077.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T23:11:50.901 INFO:teuthology.orchestra.run.smithi077.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T23:11:50.903 INFO:teuthology.orchestra.run.smithi077.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T23:11:50.904 INFO:teuthology.orchestra.run.smithi077.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T23:11:50.915 INFO:teuthology.orchestra.run.smithi077.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T23:11:50.916 INFO:teuthology.orchestra.run.smithi077.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T23:11:50.916 INFO:teuthology.orchestra.run.smithi077.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T23:11:50.917 INFO:teuthology.orchestra.run.smithi077.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T23:11:50.917 INFO:teuthology.orchestra.run.smithi077.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T23:11:50.932 INFO:teuthology.orchestra.run.smithi077.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T23:11:50.932 INFO:teuthology.orchestra.run.smithi077.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T23:11:50.933 INFO:teuthology.orchestra.run.smithi077.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T23:11:50.934 INFO:teuthology.orchestra.run.smithi017.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T23:11:50.935 INFO:teuthology.orchestra.run.smithi077.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T23:11:50.935 INFO:teuthology.orchestra.run.smithi077.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T23:11:50.937 INFO:teuthology.orchestra.run.smithi017.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T23:11:50.945 INFO:teuthology.orchestra.run.smithi017.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T23:11:50.948 INFO:teuthology.orchestra.run.smithi017.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-10T23:11:50.949 INFO:teuthology.orchestra.run.smithi017.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T23:11:50.949 INFO:teuthology.orchestra.run.smithi017.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T23:11:50.950 INFO:teuthology.orchestra.run.smithi077.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T23:11:50.950 INFO:teuthology.orchestra.run.smithi077.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T23:11:50.950 INFO:teuthology.orchestra.run.smithi077.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T23:11:50.951 INFO:teuthology.orchestra.run.smithi077.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T23:11:50.951 INFO:teuthology.orchestra.run.smithi077.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T23:11:50.955 INFO:teuthology.orchestra.run.smithi017.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T23:11:50.957 INFO:teuthology.orchestra.run.smithi017.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T23:11:50.959 INFO:teuthology.orchestra.run.smithi017.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T23:11:50.960 INFO:teuthology.orchestra.run.smithi017.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T23:11:50.967 INFO:teuthology.orchestra.run.smithi077.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T23:11:50.967 INFO:teuthology.orchestra.run.smithi077.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T23:11:50.968 INFO:teuthology.orchestra.run.smithi077.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T23:11:50.972 INFO:teuthology.orchestra.run.smithi077.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T23:11:50.973 INFO:teuthology.orchestra.run.smithi077.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T23:11:50.973 INFO:teuthology.orchestra.run.smithi017.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T23:11:50.975 INFO:teuthology.orchestra.run.smithi077.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4854-g8f219c47-1jammy [3,330 kB] 2024-09-10T23:11:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T23:11:50.977 INFO:teuthology.orchestra.run.smithi017.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T23:11:50.978 INFO:teuthology.orchestra.run.smithi017.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T23:11:50.979 INFO:teuthology.orchestra.run.smithi017.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T23:11:50.984 INFO:teuthology.orchestra.run.smithi077.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T23:11:50.984 INFO:teuthology.orchestra.run.smithi077.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T23:11:50.985 INFO:teuthology.orchestra.run.smithi077.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T23:11:50.987 INFO:teuthology.orchestra.run.smithi077.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T23:11:50.988 INFO:teuthology.orchestra.run.smithi077.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T23:11:50.990 INFO:teuthology.orchestra.run.smithi017.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T23:11:50.991 INFO:teuthology.orchestra.run.smithi017.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T23:11:50.991 INFO:teuthology.orchestra.run.smithi017.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T23:11:50.992 INFO:teuthology.orchestra.run.smithi017.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T23:11:50.992 INFO:teuthology.orchestra.run.smithi017.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T23:11:51.001 INFO:teuthology.orchestra.run.smithi077.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T23:11:51.002 INFO:teuthology.orchestra.run.smithi077.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T23:11:51.004 INFO:teuthology.orchestra.run.smithi077.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T23:11:51.004 INFO:teuthology.orchestra.run.smithi077.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T23:11:51.005 INFO:teuthology.orchestra.run.smithi077.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T23:11:51.007 INFO:teuthology.orchestra.run.smithi017.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T23:11:51.008 INFO:teuthology.orchestra.run.smithi017.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T23:11:51.008 INFO:teuthology.orchestra.run.smithi017.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T23:11:51.010 INFO:teuthology.orchestra.run.smithi017.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T23:11:51.011 INFO:teuthology.orchestra.run.smithi017.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T23:11:51.018 INFO:teuthology.orchestra.run.smithi077.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T23:11:51.025 INFO:teuthology.orchestra.run.smithi017.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T23:11:51.026 INFO:teuthology.orchestra.run.smithi017.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T23:11:51.026 INFO:teuthology.orchestra.run.smithi077.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4854-g8f219c47-1jammy [721 kB] 2024-09-10T23:11:51.027 INFO:teuthology.orchestra.run.smithi017.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T23:11:51.027 INFO:teuthology.orchestra.run.smithi017.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T23:11:51.027 INFO:teuthology.orchestra.run.smithi017.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T23:11:51.039 INFO:teuthology.orchestra.run.smithi077.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4854-g8f219c47-1jammy [356 kB] 2024-09-10T23:11:51.043 INFO:teuthology.orchestra.run.smithi017.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T23:11:51.043 INFO:teuthology.orchestra.run.smithi017.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T23:11:51.044 INFO:teuthology.orchestra.run.smithi017.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T23:11:51.045 INFO:teuthology.orchestra.run.smithi077.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4854-g8f219c47-1jammy [32.8 kB] 2024-09-10T23:11:51.045 INFO:teuthology.orchestra.run.smithi077.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4854-g8f219c47-1jammy [180 kB] 2024-09-10T23:11:51.048 INFO:teuthology.orchestra.run.smithi017.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T23:11:51.048 INFO:teuthology.orchestra.run.smithi017.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T23:11:51.049 INFO:teuthology.orchestra.run.smithi077.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4854-g8f219c47-1jammy [71.2 kB] 2024-09-10T23:11:51.050 INFO:teuthology.orchestra.run.smithi077.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4854-g8f219c47-1jammy [338 kB] 2024-09-10T23:11:51.056 INFO:teuthology.orchestra.run.smithi077.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4854-g8f219c47-1jammy [7,988 kB] 2024-09-10T23:11:51.060 INFO:teuthology.orchestra.run.smithi017.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T23:11:51.061 INFO:teuthology.orchestra.run.smithi017.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T23:11:51.062 INFO:teuthology.orchestra.run.smithi017.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T23:11:51.064 INFO:teuthology.orchestra.run.smithi077.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T23:11:51.064 INFO:teuthology.orchestra.run.smithi017.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T23:11:51.065 INFO:teuthology.orchestra.run.smithi077.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T23:11:51.065 INFO:teuthology.orchestra.run.smithi017.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T23:11:51.066 INFO:teuthology.orchestra.run.smithi077.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T23:11:51.066 INFO:teuthology.orchestra.run.smithi077.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T23:11:51.067 INFO:teuthology.orchestra.run.smithi077.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T23:11:51.078 INFO:teuthology.orchestra.run.smithi017.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T23:11:51.078 INFO:teuthology.orchestra.run.smithi017.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T23:11:51.080 INFO:teuthology.orchestra.run.smithi017.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T23:11:51.081 INFO:teuthology.orchestra.run.smithi017.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T23:11:51.084 INFO:teuthology.orchestra.run.smithi017.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T23:11:51.086 INFO:teuthology.orchestra.run.smithi077.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T23:11:51.088 INFO:teuthology.orchestra.run.smithi077.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T23:11:51.089 INFO:teuthology.orchestra.run.smithi077.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T23:11:51.095 INFO:teuthology.orchestra.run.smithi017.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T23:11:51.105 INFO:teuthology.orchestra.run.smithi077.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T23:11:51.106 INFO:teuthology.orchestra.run.smithi077.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T23:11:51.106 INFO:teuthology.orchestra.run.smithi077.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T23:11:51.107 INFO:teuthology.orchestra.run.smithi077.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T23:11:51.108 INFO:teuthology.orchestra.run.smithi077.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T23:11:51.108 INFO:teuthology.orchestra.run.smithi077.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T23:11:51.118 INFO:teuthology.orchestra.run.smithi077.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T23:11:51.119 INFO:teuthology.orchestra.run.smithi077.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T23:11:51.123 INFO:teuthology.orchestra.run.smithi077.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T23:11:51.136 INFO:teuthology.orchestra.run.smithi077.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T23:11:51.137 INFO:teuthology.orchestra.run.smithi077.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T23:11:51.138 INFO:teuthology.orchestra.run.smithi077.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T23:11:51.139 INFO:teuthology.orchestra.run.smithi017.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T23:11:51.140 INFO:teuthology.orchestra.run.smithi017.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T23:11:51.141 INFO:teuthology.orchestra.run.smithi077.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T23:11:51.142 INFO:teuthology.orchestra.run.smithi017.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T23:11:51.142 INFO:teuthology.orchestra.run.smithi017.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T23:11:51.143 INFO:teuthology.orchestra.run.smithi017.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T23:11:51.144 INFO:teuthology.orchestra.run.smithi077.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-10T23:11:51.144 INFO:teuthology.orchestra.run.smithi077.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T23:11:51.146 INFO:teuthology.orchestra.run.smithi077.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T23:11:51.153 INFO:teuthology.orchestra.run.smithi077.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T23:11:51.158 INFO:teuthology.orchestra.run.smithi077.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T23:11:51.158 INFO:teuthology.orchestra.run.smithi077.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T23:11:51.163 INFO:teuthology.orchestra.run.smithi017.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T23:11:51.165 INFO:teuthology.orchestra.run.smithi017.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T23:11:51.165 INFO:teuthology.orchestra.run.smithi017.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T23:11:51.170 INFO:teuthology.orchestra.run.smithi077.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T23:11:51.171 INFO:teuthology.orchestra.run.smithi077.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T23:11:51.171 INFO:teuthology.orchestra.run.smithi077.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T23:11:51.172 INFO:teuthology.orchestra.run.smithi077.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T23:11:51.173 INFO:teuthology.orchestra.run.smithi077.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T23:11:51.174 INFO:teuthology.orchestra.run.smithi077.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T23:11:51.181 INFO:teuthology.orchestra.run.smithi077.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T23:11:51.182 INFO:teuthology.orchestra.run.smithi017.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T23:11:51.182 INFO:teuthology.orchestra.run.smithi017.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T23:11:51.183 INFO:teuthology.orchestra.run.smithi017.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T23:11:51.184 INFO:teuthology.orchestra.run.smithi017.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T23:11:51.184 INFO:teuthology.orchestra.run.smithi017.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T23:11:51.185 INFO:teuthology.orchestra.run.smithi017.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T23:11:51.187 INFO:teuthology.orchestra.run.smithi077.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T23:11:51.188 INFO:teuthology.orchestra.run.smithi077.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T23:11:51.190 INFO:teuthology.orchestra.run.smithi077.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T23:11:51.193 INFO:teuthology.orchestra.run.smithi017.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T23:11:51.194 INFO:teuthology.orchestra.run.smithi017.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T23:11:51.197 INFO:teuthology.orchestra.run.smithi017.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T23:11:51.203 INFO:teuthology.orchestra.run.smithi077.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4854-g8f219c47-1jammy [112 kB] 2024-09-10T23:11:51.204 INFO:teuthology.orchestra.run.smithi077.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4854-g8f219c47-1jammy [473 kB] 2024-09-10T23:11:51.204 INFO:teuthology.orchestra.run.smithi077.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T23:11:51.211 INFO:teuthology.orchestra.run.smithi017.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T23:11:51.211 INFO:teuthology.orchestra.run.smithi077.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4854-g8f219c47-1jammy [28.3 MB] 2024-09-10T23:11:51.212 INFO:teuthology.orchestra.run.smithi017.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T23:11:51.213 INFO:teuthology.orchestra.run.smithi017.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T23:11:51.216 INFO:teuthology.orchestra.run.smithi017.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T23:11:51.219 INFO:teuthology.orchestra.run.smithi017.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-10T23:11:51.219 INFO:teuthology.orchestra.run.smithi017.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T23:11:51.221 INFO:teuthology.orchestra.run.smithi017.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T23:11:51.228 INFO:teuthology.orchestra.run.smithi017.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T23:11:51.233 INFO:teuthology.orchestra.run.smithi017.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T23:11:51.233 INFO:teuthology.orchestra.run.smithi017.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T23:11:51.245 INFO:teuthology.orchestra.run.smithi017.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T23:11:51.246 INFO:teuthology.orchestra.run.smithi017.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T23:11:51.247 INFO:teuthology.orchestra.run.smithi017.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T23:11:51.247 INFO:teuthology.orchestra.run.smithi017.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T23:11:51.249 INFO:teuthology.orchestra.run.smithi017.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T23:11:51.250 INFO:teuthology.orchestra.run.smithi017.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T23:11:51.257 INFO:teuthology.orchestra.run.smithi017.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T23:11:51.263 INFO:teuthology.orchestra.run.smithi017.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T23:11:51.264 INFO:teuthology.orchestra.run.smithi017.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T23:11:51.266 INFO:teuthology.orchestra.run.smithi017.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T23:11:51.280 INFO:teuthology.orchestra.run.smithi017.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T23:11:51.505 INFO:teuthology.orchestra.run.smithi017.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4854-g8f219c47-1jammy [3,330 kB] 2024-09-10T23:11:51.746 INFO:teuthology.orchestra.run.smithi077.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4854-g8f219c47-1jammy [5,206 kB] 2024-09-10T23:11:51.842 INFO:teuthology.orchestra.run.smithi077.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4854-g8f219c47-1jammy [251 kB] 2024-09-10T23:11:51.844 INFO:teuthology.orchestra.run.smithi077.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4854-g8f219c47-1jammy [124 kB] 2024-09-10T23:11:51.846 INFO:teuthology.orchestra.run.smithi077.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4854-g8f219c47-1jammy [1,562 kB] 2024-09-10T23:11:51.872 INFO:teuthology.orchestra.run.smithi077.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4854-g8f219c47-1jammy [6,308 kB] 2024-09-10T23:11:51.882 INFO:teuthology.orchestra.run.smithi017.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4854-g8f219c47-1jammy [721 kB] 2024-09-10T23:11:51.939 INFO:teuthology.orchestra.run.smithi017.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4854-g8f219c47-1jammy [356 kB] 2024-09-10T23:11:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4854-g8f219c47-1jammy [32.8 kB] 2024-09-10T23:11:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4854-g8f219c47-1jammy [180 kB] 2024-09-10T23:11:51.994 INFO:teuthology.orchestra.run.smithi017.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4854-g8f219c47-1jammy [71.2 kB] 2024-09-10T23:11:51.995 INFO:teuthology.orchestra.run.smithi017.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4854-g8f219c47-1jammy [338 kB] 2024-09-10T23:11:52.004 INFO:teuthology.orchestra.run.smithi077.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4854-g8f219c47-1jammy [23.1 MB] 2024-09-10T23:11:52.047 INFO:teuthology.orchestra.run.smithi017.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4854-g8f219c47-1jammy [7,988 kB] 2024-09-10T23:11:52.493 INFO:teuthology.orchestra.run.smithi077.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4854-g8f219c47-1jammy [14.0 kB] 2024-09-10T23:11:52.493 INFO:teuthology.orchestra.run.smithi077.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4854-g8f219c47-1jammy [880 kB] 2024-09-10T23:11:52.500 INFO:teuthology.orchestra.run.smithi077.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4854-g8f219c47-1jammy [2,454 kB] 2024-09-10T23:11:52.556 INFO:teuthology.orchestra.run.smithi077.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4854-g8f219c47-1jammy [813 kB] 2024-09-10T23:11:52.570 INFO:teuthology.orchestra.run.smithi077.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4854-g8f219c47-1jammy [160 kB] 2024-09-10T23:11:52.572 INFO:teuthology.orchestra.run.smithi077.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4854-g8f219c47-1jammy [61.4 MB] 2024-09-10T23:11:52.605 INFO:teuthology.orchestra.run.smithi017.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4854-g8f219c47-1jammy [112 kB] 2024-09-10T23:11:52.607 INFO:teuthology.orchestra.run.smithi017.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4854-g8f219c47-1jammy [473 kB] 2024-09-10T23:11:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4854-g8f219c47-1jammy [28.3 MB] 2024-09-10T23:11:53.841 INFO:teuthology.orchestra.run.smithi017.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4854-g8f219c47-1jammy [5,206 kB] 2024-09-10T23:11:53.989 INFO:teuthology.orchestra.run.smithi017.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4854-g8f219c47-1jammy [251 kB] 2024-09-10T23:11:53.992 INFO:teuthology.orchestra.run.smithi017.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4854-g8f219c47-1jammy [124 kB] 2024-09-10T23:11:53.994 INFO:teuthology.orchestra.run.smithi017.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4854-g8f219c47-1jammy [1,562 kB] 2024-09-10T23:11:54.136 INFO:teuthology.orchestra.run.smithi017.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4854-g8f219c47-1jammy [6,308 kB] 2024-09-10T23:11:54.248 INFO:teuthology.orchestra.run.smithi017.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4854-g8f219c47-1jammy [23.1 MB] 2024-09-10T23:11:54.348 INFO:teuthology.orchestra.run.smithi077.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4854-g8f219c47-1jammy [8,625 kB] 2024-09-10T23:11:54.675 INFO:teuthology.orchestra.run.smithi077.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4854-g8f219c47-1jammy [14.2 kB] 2024-09-10T23:11:54.675 INFO:teuthology.orchestra.run.smithi077.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4854-g8f219c47-1jammy [55.8 MB] 2024-09-10T23:11:54.917 INFO:teuthology.orchestra.run.smithi017.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4854-g8f219c47-1jammy [14.0 kB] 2024-09-10T23:11:54.917 INFO:teuthology.orchestra.run.smithi017.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4854-g8f219c47-1jammy [880 kB] 2024-09-10T23:11:54.950 INFO:teuthology.orchestra.run.smithi017.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4854-g8f219c47-1jammy [2,454 kB] 2024-09-10T23:11:55.017 INFO:teuthology.orchestra.run.smithi017.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4854-g8f219c47-1jammy [813 kB] 2024-09-10T23:11:55.030 INFO:teuthology.orchestra.run.smithi017.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4854-g8f219c47-1jammy [160 kB] 2024-09-10T23:11:55.032 INFO:teuthology.orchestra.run.smithi017.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4854-g8f219c47-1jammy [61.4 MB] 2024-09-10T23:11:56.807 INFO:teuthology.orchestra.run.smithi017.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4854-g8f219c47-1jammy [8,625 kB] 2024-09-10T23:11:56.834 INFO:teuthology.orchestra.run.smithi077.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4854-g8f219c47-1jammy [130 kB] 2024-09-10T23:11:56.835 INFO:teuthology.orchestra.run.smithi077.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4854-g8f219c47-1jammy [233 kB] 2024-09-10T23:11:56.837 INFO:teuthology.orchestra.run.smithi077.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4854-g8f219c47-1jammy [33.9 kB] 2024-09-10T23:11:56.837 INFO:teuthology.orchestra.run.smithi077.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4854-g8f219c47-1jammy [23.4 kB] 2024-09-10T23:11:56.838 INFO:teuthology.orchestra.run.smithi077.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4854-g8f219c47-1jammy [39.0 kB] 2024-09-10T23:11:56.838 INFO:teuthology.orchestra.run.smithi077.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4854-g8f219c47-1jammy [15.9 MB] 2024-09-10T23:11:57.032 INFO:teuthology.orchestra.run.smithi017.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4854-g8f219c47-1jammy [14.2 kB] 2024-09-10T23:11:57.032 INFO:teuthology.orchestra.run.smithi017.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4854-g8f219c47-1jammy [55.8 MB] 2024-09-10T23:11:57.468 INFO:teuthology.orchestra.run.smithi077.stdout:Get:125 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4854-g8f219c47-1jammy [91.2 kB] 2024-09-10T23:11:58.119 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 251 MB in 7s (37.0 MB/s) 2024-09-10T23:11:58.144 INFO:teuthology.orchestra.run.smithi017.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4854-g8f219c47-1jammy [130 kB] 2024-09-10T23:11:58.145 INFO:teuthology.orchestra.run.smithi017.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4854-g8f219c47-1jammy [233 kB] 2024-09-10T23:11:58.147 INFO:teuthology.orchestra.run.smithi017.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4854-g8f219c47-1jammy [33.9 kB] 2024-09-10T23:11:58.148 INFO:teuthology.orchestra.run.smithi017.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4854-g8f219c47-1jammy [23.4 kB] 2024-09-10T23:11:58.148 INFO:teuthology.orchestra.run.smithi017.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4854-g8f219c47-1jammy [39.0 kB] 2024-09-10T23:11:58.149 INFO:teuthology.orchestra.run.smithi017.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4854-g8f219c47-1jammy [15.9 MB] 2024-09-10T23:11:58.261 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-10T23:11:58.326 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-10T23:11:58.329 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-10T23:11:58.377 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-10T23:11:58.400 INFO:teuthology.orchestra.run.smithi017.stdout:Get:125 https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4854-g8f219c47-1jammy [91.2 kB] 2024-09-10T23:11:58.662 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T23:11:58.676 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T23:11:58.712 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T23:11:59.065 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cmd2. 2024-09-10T23:11:59.078 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-10T23:11:59.088 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 251 MB in 8s (32.8 MB/s) 2024-09-10T23:11:59.123 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-10T23:11:59.211 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-10T23:11:59.278 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-10T23:11:59.281 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-10T23:11:59.326 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-10T23:11:59.493 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T23:11:59.507 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T23:11:59.593 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T23:11:59.645 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T23:11:59.659 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T23:11:59.703 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T23:11:59.963 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T23:11:59.977 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T23:12:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T23:12:00.023 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cmd2. 2024-09-10T23:12:00.038 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-10T23:12:00.098 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-10T23:12:00.341 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T23:12:00.356 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T23:12:00.424 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T23:12:00.442 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T23:12:00.458 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T23:12:00.551 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T23:12:00.837 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T23:12:00.853 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T23:12:00.869 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T23:12:00.884 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T23:12:00.887 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T23:12:00.936 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:12:01.232 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T23:12:01.247 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T23:12:01.290 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T23:12:01.331 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T23:12:01.345 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T23:12:01.381 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:12:01.742 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T23:12:01.743 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T23:12:01.756 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T23:12:01.758 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T23:12:01.800 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:12:01.810 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:12:02.178 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T23:12:02.193 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T23:12:02.213 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T23:12:02.229 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T23:12:02.236 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T23:12:02.271 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:12:02.581 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librados2. 2024-09-10T23:12:02.596 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../010-librados2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:02.639 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librados2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:02.649 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T23:12:02.665 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T23:12:02.708 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:12:03.052 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T23:12:03.068 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T23:12:03.110 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T23:12:03.284 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libnbd0. 2024-09-10T23:12:03.299 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-10T23:12:03.342 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-10T23:12:03.671 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librados2. 2024-09-10T23:12:03.678 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librbd1. 2024-09-10T23:12:03.687 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../010-librados2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:03.693 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../012-librbd1_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:03.721 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librados2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:03.736 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librbd1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:04.197 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T23:12:04.201 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libnbd0. 2024-09-10T23:12:04.212 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:04.213 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-10T23:12:04.251 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-10T23:12:04.256 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libcephfs2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:04.537 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librbd1. 2024-09-10T23:12:04.541 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rados. 2024-09-10T23:12:04.549 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../012-librbd1_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:04.555 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:04.587 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librbd1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:04.591 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rados (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:04.919 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T23:12:04.933 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:04.986 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-ceph-argparse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:04.998 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T23:12:05.010 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:05.048 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libcephfs2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:05.272 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T23:12:05.286 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:05.330 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cephfs (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:05.350 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rados. 2024-09-10T23:12:05.362 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:05.400 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rados (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:05.666 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T23:12:05.677 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:05.716 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:05.728 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T23:12:05.739 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:05.778 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-ceph-argparse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:06.030 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T23:12:06.042 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:06.069 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T23:12:06.080 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cephfs (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:06.083 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T23:12:06.127 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T23:12:06.366 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T23:12:06.378 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:06.405 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T23:12:06.416 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:06.417 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:06.446 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rbd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:06.735 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T23:12:06.746 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T23:12:06.786 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T23:12:06.816 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T23:12:06.828 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T23:12:06.866 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T23:12:06.996 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T23:12:07.008 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:07.046 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rbd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:07.135 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T23:12:07.149 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T23:12:07.193 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T23:12:07.424 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T23:12:07.435 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T23:12:07.474 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T23:12:07.546 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T23:12:07.559 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T23:12:07.595 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T23:12:07.776 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T23:12:07.788 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T23:12:07.826 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T23:12:07.907 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package lua5.1. 2024-09-10T23:12:07.920 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T23:12:07.965 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T23:12:08.112 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T23:12:08.124 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T23:12:08.162 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T23:12:08.310 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package lua-any. 2024-09-10T23:12:08.323 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-10T23:12:08.385 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T23:12:08.614 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package zip. 2024-09-10T23:12:08.627 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-10T23:12:08.665 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T23:12:08.724 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package lua5.1. 2024-09-10T23:12:08.736 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T23:12:08.799 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T23:12:08.959 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package unzip. 2024-09-10T23:12:08.972 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T23:12:09.001 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T23:12:09.110 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package lua-any. 2024-09-10T23:12:09.122 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-10T23:12:09.177 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T23:12:09.429 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package luarocks. 2024-09-10T23:12:09.442 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T23:12:09.446 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package zip. 2024-09-10T23:12:09.457 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-10T23:12:09.479 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T23:12:09.496 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T23:12:09.816 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package unzip. 2024-09-10T23:12:09.827 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T23:12:09.862 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librgw2. 2024-09-10T23:12:09.865 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T23:12:09.873 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../028-librgw2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:09.911 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librgw2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:10.236 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package luarocks. 2024-09-10T23:12:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T23:12:10.318 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T23:12:10.414 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T23:12:10.427 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:10.489 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:10.727 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librgw2. 2024-09-10T23:12:10.738 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../028-librgw2_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:10.776 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librgw2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:10.817 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T23:12:10.830 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T23:12:10.875 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T23:12:11.228 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T23:12:11.241 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:11.262 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T23:12:11.276 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:11.286 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libradosstriper1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:11.348 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:11.631 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T23:12:11.644 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T23:12:11.681 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T23:12:11.706 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-common. 2024-09-10T23:12:11.719 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:11.764 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:12.026 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T23:12:12.042 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libradosstriper1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:12.537 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-common. 2024-09-10T23:12:12.553 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:12.595 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:13.211 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-base. 2024-09-10T23:12:13.225 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:13.295 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-base (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:13.700 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-base. 2024-09-10T23:12:13.723 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:13.873 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T23:12:13.886 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T23:12:13.923 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T23:12:13.935 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-base (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:14.234 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T23:12:14.246 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T23:12:14.284 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T23:12:14.480 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T23:12:14.488 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T23:12:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T23:12:14.629 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T23:12:14.642 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T23:12:14.678 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T23:12:14.866 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T23:12:14.875 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T23:12:14.916 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T23:12:14.973 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T23:12:14.986 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T23:12:15.015 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T23:12:15.269 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T23:12:15.278 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T23:12:15.292 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T23:12:15.306 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T23:12:15.318 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T23:12:15.342 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T23:12:15.613 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T23:12:15.625 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T23:12:15.654 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T23:12:15.670 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T23:12:15.681 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T23:12:15.720 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T23:12:15.957 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T23:12:15.971 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T23:12:16.015 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T23:12:16.023 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-portend. 2024-09-10T23:12:16.039 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-10T23:12:16.073 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T23:12:16.360 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T23:12:16.372 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T23:12:16.384 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T23:12:16.396 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T23:12:16.410 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T23:12:16.434 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T23:12:16.696 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-portend. 2024-09-10T23:12:16.707 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-10T23:12:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T23:12:16.828 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T23:12:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T23:12:16.886 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T23:12:16.998 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T23:12:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T23:12:17.048 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T23:12:17.274 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T23:12:17.285 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T23:12:17.323 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T23:12:17.426 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T23:12:17.438 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T23:12:17.476 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T23:12:17.693 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T23:12:17.705 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T23:12:17.751 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T23:12:17.813 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T23:12:17.825 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T23:12:17.854 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T23:12:18.146 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T23:12:18.158 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T23:12:18.174 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T23:12:18.185 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T23:12:18.204 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T23:12:18.224 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T23:12:18.553 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T23:12:18.564 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T23:12:18.582 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-mako. 2024-09-10T23:12:18.595 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T23:12:18.626 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T23:12:18.666 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T23:12:18.930 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-mako. 2024-09-10T23:12:18.941 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T23:12:18.979 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T23:12:19.027 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T23:12:19.039 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T23:12:19.076 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T23:12:19.332 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T23:12:19.344 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T23:12:19.382 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T23:12:19.396 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T23:12:19.408 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T23:12:19.446 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T23:12:19.685 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T23:12:19.697 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T23:12:19.735 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T23:12:19.757 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-webob. 2024-09-10T23:12:19.769 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T23:12:19.807 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T23:12:20.038 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-webob. 2024-09-10T23:12:20.049 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T23:12:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T23:12:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T23:12:20.130 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T23:12:20.162 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T23:12:20.446 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T23:12:20.457 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T23:12:20.457 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T23:12:20.468 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T23:12:20.495 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T23:12:20.510 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T23:12:20.829 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-paste. 2024-09-10T23:12:20.841 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T23:12:20.851 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T23:12:20.863 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T23:12:20.890 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T23:12:20.901 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T23:12:21.193 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T23:12:21.204 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-paste. 2024-09-10T23:12:21.205 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T23:12:21.216 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T23:12:21.235 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T23:12:21.254 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T23:12:21.562 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T23:12:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T23:12:21.574 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T23:12:21.576 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T23:12:21.612 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T23:12:21.615 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T23:12:21.935 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T23:12:21.949 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T23:12:21.965 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T23:12:21.978 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T23:12:21.993 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T23:12:22.032 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T23:12:22.296 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T23:12:22.311 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T23:12:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T23:12:22.345 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T23:12:22.355 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T23:12:22.393 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T23:12:22.648 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T23:12:22.662 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T23:12:22.740 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T23:12:22.773 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T23:12:22.785 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T23:12:22.822 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T23:12:23.078 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T23:12:23.091 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T23:12:23.134 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-idna. 2024-09-10T23:12:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T23:12:23.146 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T23:12:23.175 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T23:12:24.264 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-idna. 2024-09-10T23:12:24.278 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T23:12:24.322 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T23:12:24.512 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T23:12:24.524 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T23:12:24.562 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T23:12:24.658 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T23:12:24.672 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T23:12:24.716 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T23:12:24.898 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-requests. 2024-09-10T23:12:24.911 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T23:12:24.948 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T23:12:25.028 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-requests. 2024-09-10T23:12:25.042 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T23:12:25.094 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T23:12:25.251 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T23:12:25.263 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T23:12:25.334 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T23:12:25.372 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T23:12:25.386 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T23:12:25.422 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T23:12:25.629 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T23:12:25.641 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:25.679 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:25.717 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T23:12:25.730 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:25.775 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:26.092 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T23:12:26.104 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:26.133 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:26.171 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T23:12:26.185 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:26.229 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:26.453 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T23:12:26.465 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T23:12:26.502 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T23:12:26.540 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T23:12:26.554 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T23:12:26.624 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T23:12:26.805 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T23:12:26.817 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T23:12:26.855 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T23:12:26.910 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T23:12:26.923 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T23:12:26.968 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T23:12:27.233 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T23:12:27.246 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:27.279 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T23:12:27.283 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:27.293 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:27.337 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:27.644 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T23:12:27.657 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mon (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:27.732 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T23:12:27.746 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:27.790 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mon (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:28.264 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T23:12:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:28.314 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-osd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:28.427 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T23:12:28.441 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:28.485 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-osd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:29.076 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph. 2024-09-10T23:12:29.088 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../069-ceph_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:29.142 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:29.439 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph. 2024-09-10T23:12:29.452 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../069-ceph_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:29.469 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T23:12:29.482 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:29.497 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:29.519 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:29.824 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T23:12:29.838 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:29.882 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:29.906 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T23:12:29.918 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:29.955 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mds (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:30.277 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T23:12:30.291 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:30.325 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephadm. 2024-09-10T23:12:30.335 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mds (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:30.338 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../072-cephadm_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:30.367 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:30.661 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T23:12:30.674 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T23:12:30.744 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T23:12:30.746 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package cephadm. 2024-09-10T23:12:30.760 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../072-cephadm_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:30.805 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:31.022 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T23:12:31.034 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T23:12:31.049 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T23:12:31.062 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T23:12:31.063 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T23:12:31.107 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T23:12:31.426 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T23:12:31.440 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T23:12:31.484 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T23:12:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-babel. 2024-09-10T23:12:32.113 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T23:12:32.151 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T23:12:32.431 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-babel. 2024-09-10T23:12:32.443 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T23:12:32.481 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T23:12:32.512 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T23:12:32.523 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T23:12:32.562 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T23:12:32.817 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T23:12:32.830 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T23:12:32.867 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T23:12:32.965 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T23:12:32.976 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:33.017 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:33.203 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T23:12:33.216 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:33.281 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:33.360 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T23:12:33.371 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T23:12:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T23:12:33.615 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T23:12:33.628 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T23:12:33.673 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T23:12:33.913 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-routes. 2024-09-10T23:12:33.924 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T23:12:33.994 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T23:12:34.000 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-routes. 2024-09-10T23:12:34.014 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T23:12:34.058 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T23:12:34.333 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T23:12:34.345 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:34.382 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:34.420 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T23:12:34.434 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:34.478 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:36.808 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T23:12:36.822 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T23:12:36.829 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T23:12:36.841 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T23:12:36.866 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T23:12:36.878 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T23:12:37.361 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T23:12:37.374 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T23:12:37.441 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T23:12:37.452 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T23:12:37.530 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T23:12:37.593 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T23:12:37.875 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T23:12:37.889 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T23:12:37.982 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T23:12:38.013 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T23:12:38.029 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T23:12:38.071 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T23:12:38.286 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T23:12:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T23:12:38.344 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T23:12:38.399 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T23:12:38.412 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T23:12:38.457 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T23:12:39.070 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T23:12:39.083 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:39.127 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:39.157 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T23:12:39.171 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:39.224 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:40.269 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T23:12:40.284 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T23:12:40.327 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T23:12:40.389 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T23:12:40.403 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T23:12:40.448 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T23:12:40.655 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T23:12:40.670 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T23:12:40.713 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T23:12:40.742 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T23:12:40.756 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T23:12:40.800 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T23:12:41.075 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T23:12:41.089 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T23:12:41.122 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T23:12:41.125 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T23:12:41.136 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T23:12:41.197 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T23:12:41.394 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T23:12:41.409 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-10T23:12:41.444 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T23:12:41.508 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T23:12:41.522 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-10T23:12:41.566 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T23:12:41.764 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T23:12:41.779 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T23:12:41.822 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T23:12:41.920 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T23:12:41.934 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T23:12:41.978 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T23:12:42.184 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T23:12:42.198 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T23:12:42.242 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T23:12:42.306 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T23:12:42.321 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T23:12:42.364 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T23:12:42.634 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T23:12:42.648 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T23:12:42.662 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T23:12:42.677 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T23:12:42.717 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T23:12:42.720 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T23:12:43.029 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T23:12:43.031 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T23:12:43.043 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T23:12:43.046 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T23:12:43.086 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T23:12:43.089 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T23:12:43.826 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T23:12:43.839 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:43.883 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:44.037 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T23:12:44.051 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:44.095 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:44.234 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T23:12:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T23:12:44.286 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T23:12:44.448 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T23:12:44.462 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T23:12:44.506 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T23:12:44.606 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T23:12:44.620 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T23:12:44.664 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T23:12:44.901 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T23:12:44.916 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T23:12:44.958 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package jq. 2024-09-10T23:12:44.959 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T23:12:44.973 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T23:12:45.016 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T23:12:45.203 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package jq. 2024-09-10T23:12:45.218 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T23:12:45.278 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package socat. 2024-09-10T23:12:45.286 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T23:12:45.295 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T23:12:45.335 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T23:12:45.522 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package socat. 2024-09-10T23:12:45.537 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T23:12:45.581 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T23:12:45.639 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T23:12:45.654 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T23:12:45.688 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T23:12:45.926 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T23:12:45.941 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T23:12:45.984 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T23:12:46.076 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-test. 2024-09-10T23:12:46.090 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:46.134 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-test (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:46.363 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-test. 2024-09-10T23:12:46.377 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:46.421 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-test (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:48.180 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T23:12:48.196 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:48.230 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-volume (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:48.601 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-10T23:12:48.616 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:48.633 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T23:12:48.648 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:48.658 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking cephfs-mirror (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:48.691 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-volume (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:48.953 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-colorama. 2024-09-10T23:12:48.969 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-10T23:12:49.003 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-10T23:12:49.095 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-10T23:12:49.110 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:49.153 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-mirror (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package cephfs-shell. 2024-09-10T23:12:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:49.297 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking cephfs-shell (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:49.440 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-colorama. 2024-09-10T23:12:49.455 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-10T23:12:49.514 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-10T23:12:49.591 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package cephfs-top. 2024-09-10T23:12:49.607 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:49.649 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking cephfs-top (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:49.744 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-shell. 2024-09-10T23:12:49.758 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:49.802 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-shell (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:49.893 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T23:12:49.909 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:49.968 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libcephfs-dev (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:50.105 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-top. 2024-09-10T23:12:50.119 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4854-g8f219c47-1jammy_all.deb ... 2024-09-10T23:12:50.163 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-top (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:50.254 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T23:12:50.269 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T23:12:50.312 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T23:12:50.390 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T23:12:50.405 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:50.465 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libcephfs-dev (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:50.684 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T23:12:50.699 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T23:12:50.735 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T23:12:50.742 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T23:12:50.750 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T23:12:50.793 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T23:12:51.145 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T23:12:51.161 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T23:12:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T23:12:51.179 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T23:12:51.203 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T23:12:51.222 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T23:12:51.613 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package pkg-config. 2024-09-10T23:12:51.624 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T23:12:51.634 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T23:12:51.650 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T23:12:51.658 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T23:12:51.692 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T23:12:51.878 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T23:12:51.894 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T23:12:51.928 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T23:12:52.122 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package pkg-config. 2024-09-10T23:12:52.136 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T23:12:52.180 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T23:12:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T23:12:52.363 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T23:12:52.397 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T23:12:52.441 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T23:12:52.455 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T23:12:52.500 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T23:12:52.684 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T23:12:52.700 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T23:12:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T23:12:52.961 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T23:12:52.975 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T23:12:53.019 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T23:12:53.053 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T23:12:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T23:12:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T23:12:53.347 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T23:12:53.360 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T23:12:53.405 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T23:12:53.406 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T23:12:53.422 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T23:12:53.464 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T23:12:53.709 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T23:12:53.722 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T23:12:53.766 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T23:12:53.817 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-py. 2024-09-10T23:12:53.832 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-10T23:12:53.875 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T23:12:54.036 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T23:12:54.050 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T23:12:54.119 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T23:12:54.220 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T23:12:54.236 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T23:12:54.278 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T23:12:54.430 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-py. 2024-09-10T23:12:54.444 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-10T23:12:54.480 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T23:12:54.716 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T23:12:54.730 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T23:12:54.765 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T23:12:54.775 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T23:12:54.789 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T23:12:54.825 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T23:12:55.102 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-toml. 2024-09-10T23:12:55.117 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-10T23:12:55.159 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T23:12:55.337 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T23:12:55.351 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T23:12:55.395 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T23:12:55.462 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T23:12:55.478 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T23:12:55.520 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T23:12:55.740 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-toml. 2024-09-10T23:12:55.754 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-10T23:12:55.798 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T23:12:55.857 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T23:12:55.873 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T23:12:55.915 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T23:12:56.076 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T23:12:56.090 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T23:12:56.125 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T23:12:56.218 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T23:12:56.233 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T23:12:56.276 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T23:12:56.496 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T23:12:56.511 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T23:12:56.554 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T23:12:56.865 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T23:12:56.880 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T23:12:56.923 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T23:12:56.980 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package radosgw. 2024-09-10T23:12:56.994 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../123-radosgw_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:57.029 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking radosgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:57.719 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package radosgw. 2024-09-10T23:12:57.724 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T23:12:57.733 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../123-radosgw_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:57.740 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:57.776 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking radosgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:57.782 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking rbd-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:58.095 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T23:12:58.404 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T23:12:58.472 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T23:12:58.487 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4854-g8f219c47-1jammy_amd64.deb ... 2024-09-10T23:12:58.530 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking rbd-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:12:58.530 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T23:12:58.844 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T23:12:58.857 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T23:12:59.246 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T23:12:59.376 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T23:12:59.527 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T23:12:59.790 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T23:12:59.893 INFO:teuthology.orchestra.run.smithi017.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T23:12:59.906 INFO:teuthology.orchestra.run.smithi017.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-10T23:12:59.973 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:00.224 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T23:13:00.812 INFO:teuthology.orchestra.run.smithi077.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T23:13:00.825 INFO:teuthology.orchestra.run.smithi077.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-10T23:13:00.871 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:01.261 INFO:teuthology.orchestra.run.smithi017.stdout:Adding system user cephadm....done 2024-09-10T23:13:01.381 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T23:13:01.490 INFO:teuthology.orchestra.run.smithi077.stdout:Adding system user cephadm....done 2024-09-10T23:13:01.674 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T23:13:01.686 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T23:13:01.967 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T23:13:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T23:13:02.093 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T23:13:02.359 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T23:13:02.360 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T23:13:02.620 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T23:13:02.636 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T23:13:02.770 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T23:13:02.957 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T23:13:03.072 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T23:13:03.225 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T23:13:03.351 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T23:13:03.433 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T23:13:03.661 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T23:13:03.717 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-10T23:13:04.010 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T23:13:04.055 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T23:13:04.303 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T23:13:04.306 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-10T23:13:04.538 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T23:13:04.574 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T23:13:04.856 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T23:13:04.858 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T23:13:05.107 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T23:13:05.160 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T23:13:05.374 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-ceph-argparse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:05.436 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T23:13:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T23:13:05.704 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T23:13:05.795 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-10T23:13:05.927 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T23:13:05.955 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-ceph-argparse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:06.053 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-10T23:13:06.206 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T23:13:06.338 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T23:13:06.365 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-10T23:13:06.447 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T23:13:06.491 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T23:13:06.617 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-10T23:13:06.690 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T23:13:06.901 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T23:13:07.036 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T23:13:07.239 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T23:13:07.270 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T23:13:07.304 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T23:13:07.335 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T23:13:07.502 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T23:13:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T23:13:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T23:13:07.798 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T23:13:07.921 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T23:13:07.966 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T23:13:08.054 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T23:13:08.325 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T23:13:08.330 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T23:13:08.476 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T23:13:08.607 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T23:13:08.752 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T23:13:08.941 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T23:13:09.029 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T23:13:09.067 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T23:13:09.330 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T23:13:09.455 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T23:13:09.802 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T23:13:10.078 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T23:13:10.166 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T23:13:10.179 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T23:13:10.280 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T23:13:10.434 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T23:13:10.551 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T23:13:10.598 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T23:13:10.710 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T23:13:11.016 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T23:13:11.028 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T23:13:11.283 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T23:13:11.429 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T23:13:11.685 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T23:13:11.705 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T23:13:12.020 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-10T23:13:12.098 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T23:13:12.345 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T23:13:12.400 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-10T23:13:12.688 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T23:13:12.701 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T23:13:12.940 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T23:13:13.085 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T23:13:13.090 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:13.362 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T23:13:13.409 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T23:13:13.479 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:13.768 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T23:13:13.772 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T23:13:14.140 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T23:13:15.049 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T23:13:15.333 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:13:15.395 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T23:13:15.468 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T23:13:15.647 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:13:15.743 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T23:13:15.781 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T23:13:15.869 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T23:13:15.987 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T23:13:16.074 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T23:13:16.200 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T23:13:16.280 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T23:13:16.326 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T23:13:16.531 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T23:13:16.652 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T23:13:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:13:16.928 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T23:13:16.950 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T23:13:17.213 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:13:17.276 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T23:13:17.313 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T23:13:17.586 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T23:13:17.606 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T23:13:17.858 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T23:13:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T23:13:18.117 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T23:13:18.179 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T23:13:18.359 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T23:13:18.431 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T23:13:18.627 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T23:13:18.698 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T23:13:18.824 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T23:13:18.904 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T23:13:19.030 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T23:13:19.117 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T23:13:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T23:13:19.339 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T23:13:19.465 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T23:13:19.577 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T23:13:19.766 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T23:13:19.911 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T23:13:20.050 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T23:13:20.213 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T23:13:20.322 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T23:13:20.326 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T23:13:20.423 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T23:13:20.469 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T23:13:20.504 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T23:13:20.595 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T23:13:20.717 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T23:13:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T23:13:20.884 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T23:13:20.955 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T23:13:21.081 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T23:13:21.294 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T23:13:21.516 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T23:13:21.570 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T23:13:21.696 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T23:13:21.775 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T23:13:21.876 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T23:13:21.980 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:13:22.089 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T23:13:22.119 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T23:13:22.295 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T23:13:22.399 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T23:13:22.621 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T23:13:22.717 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T23:13:22.930 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T23:13:23.120 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T23:13:23.278 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T23:13:23.333 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T23:13:23.451 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T23:13:23.547 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T23:13:23.719 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T23:13:23.815 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T23:13:24.029 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T23:13:24.083 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T23:13:24.297 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T23:13:24.476 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T23:13:24.740 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T23:13:24.821 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T23:13:25.025 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T23:13:25.188 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T23:13:25.308 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librados2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:25.369 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T23:13:25.424 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:25.545 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librados2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:25.550 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T23:13:25.671 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:25.797 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T23:13:25.928 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libcephfs2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:26.053 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libradosstriper1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:26.158 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libcephfs2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:26.171 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T23:13:26.267 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libradosstriper1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:26.368 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T23:13:26.456 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librbd1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:26.557 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-modules-core (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:26.662 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librbd1 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:26.683 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:26.788 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-modules-core (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:26.903 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T23:13:26.903 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T23:13:26.913 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:27.151 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T23:13:27.151 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T23:13:27.568 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libcephfs-dev (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:27.693 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rados (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libcephfs-dev (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:27.819 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librgw2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rados (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:27.978 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up cephfs-top (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librgw2 (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:28.096 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T23:13:28.167 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-top (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:28.285 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T23:13:29.435 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rbd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:29.561 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up rbd-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:29.564 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rbd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:29.687 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:29.715 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up rbd-fuse (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:29.838 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cephfs (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:29.872 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:29.964 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up cephfs-shell (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:30.090 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:30.291 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cephfs (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:30.393 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-shell (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:30.510 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-common (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:30.651 INFO:teuthology.orchestra.run.smithi017.stdout:Adding group ceph....done 2024-09-10T23:13:31.036 INFO:teuthology.orchestra.run.smithi017.stdout:Adding system user ceph....done 2024-09-10T23:13:31.096 INFO:teuthology.orchestra.run.smithi077.stdout:Adding group ceph....done 2024-09-10T23:13:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:Setting system user ceph properties....done 2024-09-10T23:13:31.206 INFO:teuthology.orchestra.run.smithi017.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T23:13:31.358 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T23:13:31.522 INFO:teuthology.orchestra.run.smithi077.stdout:Adding system user ceph....done 2024-09-10T23:13:31.649 INFO:teuthology.orchestra.run.smithi077.stdout:Setting system user ceph properties....done 2024-09-10T23:13:31.664 INFO:teuthology.orchestra.run.smithi077.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T23:13:31.785 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T23:13:31.806 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T23:13:32.218 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T23:13:32.499 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up cephfs-mirror (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:32.714 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:13:32.714 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:13:32.995 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-mirror (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:33.342 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-test (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:33.468 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up radosgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:33.613 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:13:33.613 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-10T23:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:13:34.049 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:13:34.222 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-test (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:34.347 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up radosgw (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:34.703 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-base (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:34.875 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:13:34.875 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T23:13:35.071 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T23:13:35.466 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-base (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mds (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:35.847 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T23:13:36.001 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T23:13:36.001 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T23:13:36.526 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mds (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:36.674 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:36.749 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T23:13:36.749 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T23:13:36.893 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T23:13:36.893 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T23:13:37.420 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:37.550 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-osd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:37.633 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T23:13:37.633 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T23:13:37.896 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T23:13:37.896 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T23:13:38.263 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-osd (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:38.560 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:38.585 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T23:13:38.585 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T23:13:38.710 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:38.853 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mon (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:39.062 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T23:13:39.062 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T23:13:39.264 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:39.390 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:39.533 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mon (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:39.696 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:39.734 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T23:13:39.734 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T23:13:39.813 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:39.939 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-dashboard (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:40.082 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-volume (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:40.401 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-cephadm (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:40.502 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T23:13:40.553 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:40.602 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T23:13:40.679 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-dashboard (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:40.829 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-volume (19.3.0-4854-g8f219c47-1jammy) ... 2024-09-10T23:13:40.838 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T23:13:41.190 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T23:13:41.316 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T23:13:41.485 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T23:13:42.014 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T23:13:42.585 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T23:13:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T23:13:42.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-10T23:13:42.920 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-10T23:13:43.106 INFO:teuthology.orchestra.run.smithi017.stdout:Building dependency tree... 2024-09-10T23:13:43.107 INFO:teuthology.orchestra.run.smithi017.stdout:Reading state information... 2024-09-10T23:13:43.296 INFO:teuthology.orchestra.run.smithi077.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T23:13:43.297 INFO:teuthology.orchestra.run.smithi017.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-10T23:13:43.297 INFO:teuthology.orchestra.run.smithi017.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-10T23:13:43.297 INFO:teuthology.orchestra.run.smithi017.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-10T23:13:43.297 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T23:13:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T23:13:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T23:13:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T23:13:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T23:13:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T23:13:43.298 INFO:teuthology.orchestra.run.smithi017.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T23:13:43.298 INFO:teuthology.orchestra.run.smithi017.stdout:The following additional packages will be installed: 2024-09-10T23:13:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-10T23:13:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-10T23:13:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-10T23:13:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-10T23:13:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T23:13:43.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-10T23:13:43.301 INFO:teuthology.orchestra.run.smithi017.stdout:Suggested packages: 2024-09-10T23:13:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-10T23:13:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-10T23:13:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-10T23:13:43.359 INFO:teuthology.orchestra.run.smithi017.stdout:The following NEW packages will be installed: 2024-09-10T23:13:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-10T23:13:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-10T23:13:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-10T23:13:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-10T23:13:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-10T23:13:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-10T23:13:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T23:13:43.361 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages will be upgraded: 2024-09-10T23:13:43.362 INFO:teuthology.orchestra.run.smithi017.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-10T23:13:43.378 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-09-10T23:13:43.561 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2024-09-10T23:13:43.561 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2024-09-10T23:13:43.564 INFO:teuthology.orchestra.run.smithi017.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-10T23:13:43.565 INFO:teuthology.orchestra.run.smithi017.stdout:Need to get 55.8 MB of archives. 2024-09-10T23:13:43.565 INFO:teuthology.orchestra.run.smithi017.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-10T23:13:43.565 INFO:teuthology.orchestra.run.smithi017.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-10T23:13:43.746 INFO:teuthology.orchestra.run.smithi077.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-10T23:13:43.746 INFO:teuthology.orchestra.run.smithi077.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-10T23:13:43.746 INFO:teuthology.orchestra.run.smithi077.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-10T23:13:43.746 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T23:13:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T23:13:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T23:13:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T23:13:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T23:13:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T23:13:43.747 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T23:13:43.748 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2024-09-10T23:13:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-10T23:13:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-10T23:13:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-10T23:13:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-10T23:13:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T23:13:43.750 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2024-09-10T23:13:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-10T23:13:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-10T23:13:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-10T23:13:43.807 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2024-09-10T23:13:43.807 INFO:teuthology.orchestra.run.smithi077.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-10T23:13:43.807 INFO:teuthology.orchestra.run.smithi077.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-10T23:13:43.808 INFO:teuthology.orchestra.run.smithi077.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-10T23:13:43.808 INFO:teuthology.orchestra.run.smithi077.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-10T23:13:43.808 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-10T23:13:43.808 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-10T23:13:43.808 INFO:teuthology.orchestra.run.smithi077.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-10T23:13:43.809 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages will be upgraded: 2024-09-10T23:13:43.809 INFO:teuthology.orchestra.run.smithi077.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-10T23:13:43.866 INFO:teuthology.orchestra.run.smithi077.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-10T23:13:43.866 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 55.8 MB of archives. 2024-09-10T23:13:43.866 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-10T23:13:43.866 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-10T23:13:43.999 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-10T23:13:44.002 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-10T23:13:44.029 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-10T23:13:44.030 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-10T23:13:44.030 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-10T23:13:44.038 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-10T23:13:44.038 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-10T23:13:44.040 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-10T23:13:44.041 INFO:teuthology.orchestra.run.smithi077.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-10T23:13:44.041 INFO:teuthology.orchestra.run.smithi077.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-10T23:13:44.042 INFO:teuthology.orchestra.run.smithi077.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-10T23:13:44.051 INFO:teuthology.orchestra.run.smithi077.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-10T23:13:44.052 INFO:teuthology.orchestra.run.smithi077.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-10T23:13:44.052 INFO:teuthology.orchestra.run.smithi077.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-10T23:13:44.068 INFO:teuthology.orchestra.run.smithi077.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-10T23:13:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-10T23:13:44.204 INFO:teuthology.orchestra.run.smithi017.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-10T23:13:44.279 INFO:teuthology.orchestra.run.smithi077.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-10T23:13:44.281 INFO:teuthology.orchestra.run.smithi077.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-10T23:13:44.282 INFO:teuthology.orchestra.run.smithi077.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-10T23:13:44.285 INFO:teuthology.orchestra.run.smithi077.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-10T23:13:44.285 INFO:teuthology.orchestra.run.smithi077.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-10T23:13:44.289 INFO:teuthology.orchestra.run.smithi077.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-10T23:13:44.291 INFO:teuthology.orchestra.run.smithi077.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-10T23:13:44.298 INFO:teuthology.orchestra.run.smithi077.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-10T23:13:44.298 INFO:teuthology.orchestra.run.smithi077.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-10T23:13:44.319 INFO:teuthology.orchestra.run.smithi077.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-10T23:13:44.319 INFO:teuthology.orchestra.run.smithi077.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-10T23:13:44.327 INFO:teuthology.orchestra.run.smithi017.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-10T23:13:44.328 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-10T23:13:44.329 INFO:teuthology.orchestra.run.smithi077.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-10T23:13:44.329 INFO:teuthology.orchestra.run.smithi017.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-10T23:13:44.348 INFO:teuthology.orchestra.run.smithi077.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-10T23:13:44.352 INFO:teuthology.orchestra.run.smithi077.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-10T23:13:44.353 INFO:teuthology.orchestra.run.smithi077.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-10T23:13:44.353 INFO:teuthology.orchestra.run.smithi077.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-10T23:13:44.354 INFO:teuthology.orchestra.run.smithi077.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-10T23:13:44.357 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-10T23:13:44.359 INFO:teuthology.orchestra.run.smithi017.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-10T23:13:44.362 INFO:teuthology.orchestra.run.smithi017.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-10T23:13:44.365 INFO:teuthology.orchestra.run.smithi077.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-10T23:13:44.365 INFO:teuthology.orchestra.run.smithi017.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-10T23:13:44.365 INFO:teuthology.orchestra.run.smithi017.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-10T23:13:44.367 INFO:teuthology.orchestra.run.smithi077.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-10T23:13:44.367 INFO:teuthology.orchestra.run.smithi017.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-10T23:13:44.431 INFO:teuthology.orchestra.run.smithi017.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-10T23:13:44.431 INFO:teuthology.orchestra.run.smithi017.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-10T23:13:44.432 INFO:teuthology.orchestra.run.smithi017.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-10T23:13:44.512 INFO:teuthology.orchestra.run.smithi077.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-10T23:13:44.512 INFO:teuthology.orchestra.run.smithi077.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-10T23:13:44.512 INFO:teuthology.orchestra.run.smithi077.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-10T23:13:44.512 INFO:teuthology.orchestra.run.smithi077.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-10T23:13:44.513 INFO:teuthology.orchestra.run.smithi017.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-10T23:13:44.513 INFO:teuthology.orchestra.run.smithi077.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-10T23:13:44.513 INFO:teuthology.orchestra.run.smithi077.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-10T23:13:44.525 INFO:teuthology.orchestra.run.smithi077.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-10T23:13:44.525 INFO:teuthology.orchestra.run.smithi077.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-10T23:13:44.911 INFO:teuthology.orchestra.run.smithi077.stdout:Preconfiguring packages ... 2024-09-10T23:13:45.095 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 55.8 MB in 1s (78.8 MB/s) 2024-09-10T23:13:45.195 INFO:teuthology.orchestra.run.smithi017.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-10T23:13:45.197 INFO:teuthology.orchestra.run.smithi017.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-10T23:13:45.197 INFO:teuthology.orchestra.run.smithi017.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-10T23:13:45.200 INFO:teuthology.orchestra.run.smithi017.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-10T23:13:45.200 INFO:teuthology.orchestra.run.smithi017.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-10T23:13:45.204 INFO:teuthology.orchestra.run.smithi017.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-10T23:13:45.206 INFO:teuthology.orchestra.run.smithi017.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-10T23:13:45.251 INFO:teuthology.orchestra.run.smithi017.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-10T23:13:45.251 INFO:teuthology.orchestra.run.smithi017.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-10T23:13:45.292 INFO:teuthology.orchestra.run.smithi017.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-10T23:13:45.333 INFO:teuthology.orchestra.run.smithi017.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-10T23:13:45.340 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143286 files and directories currently installed.) 2024-09-10T23:13:45.344 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T23:13:45.346 INFO:teuthology.orchestra.run.smithi017.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-10T23:13:45.420 INFO:teuthology.orchestra.run.smithi017.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-10T23:13:45.424 INFO:teuthology.orchestra.run.smithi017.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-10T23:13:45.424 INFO:teuthology.orchestra.run.smithi017.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-10T23:13:45.425 INFO:teuthology.orchestra.run.smithi017.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-10T23:13:45.425 INFO:teuthology.orchestra.run.smithi017.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-10T23:13:45.446 INFO:teuthology.orchestra.run.smithi017.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-10T23:13:45.448 INFO:teuthology.orchestra.run.smithi017.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-10T23:13:45.468 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T23:13:45.927 INFO:teuthology.orchestra.run.smithi017.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-10T23:13:45.928 INFO:teuthology.orchestra.run.smithi017.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-10T23:13:45.928 INFO:teuthology.orchestra.run.smithi017.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-10T23:13:45.928 INFO:teuthology.orchestra.run.smithi017.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-10T23:13:45.928 INFO:teuthology.orchestra.run.smithi017.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-10T23:13:45.928 INFO:teuthology.orchestra.run.smithi017.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-10T23:13:45.947 INFO:teuthology.orchestra.run.smithi017.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-10T23:13:45.947 INFO:teuthology.orchestra.run.smithi017.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-10T23:13:46.153 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-10T23:13:46.347 INFO:teuthology.orchestra.run.smithi017.stdout:Preconfiguring packages ... 2024-09-10T23:13:46.507 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 55.8 MB in 3s (21.6 MB/s) 2024-09-10T23:13:46.761 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143286 files and directories currently installed.) 2024-09-10T23:13:46.765 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T23:13:46.921 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T23:13:47.249 INFO:teuthology.orchestra.run.smithi077.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-10T23:13:47.484 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package flex. 2024-09-10T23:13:47.556 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143286 files and directories currently installed.) 2024-09-10T23:13:47.559 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-10T23:13:47.599 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-10T23:13:47.881 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-10T23:13:48.136 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T23:13:48.397 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-10T23:13:48.839 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T23:13:49.007 INFO:teuthology.orchestra.run.smithi017.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-10T23:13:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package flex. 2024-09-10T23:13:49.332 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143286 files and directories currently installed.) 2024-09-10T23:13:49.336 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-10T23:13:49.373 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-10T23:13:49.409 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143359 files and directories currently installed.) 2024-09-10T23:13:49.412 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T23:13:49.538 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T23:13:49.902 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T23:13:49.926 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T23:13:50.037 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T23:13:50.112 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-10T23:13:50.394 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T23:13:50.526 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T23:13:50.738 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package bison. 2024-09-10T23:13:50.808 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143359 files and directories currently installed.) 2024-09-10T23:13:50.812 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-10T23:13:50.848 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T23:13:51.119 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143359 files and directories currently installed.) 2024-09-10T23:13:51.123 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T23:13:51.253 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T23:13:51.308 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-10T23:13:51.322 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-10T23:13:51.366 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T23:13:51.661 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package dump. 2024-09-10T23:13:51.676 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-10T23:13:51.683 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-10T23:13:51.719 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking dump (0.4b47-3) ... 2024-09-10T23:13:51.818 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-10T23:13:52.068 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package indent. 2024-09-10T23:13:52.080 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:13:52.124 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T23:13:52.177 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T23:13:52.402 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-10T23:13:52.417 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-10T23:13:52.452 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T23:13:52.510 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package bison. 2024-09-10T23:13:52.589 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143359 files and directories currently installed.) 2024-09-10T23:13:52.593 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-10T23:13:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T23:13:52.790 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-10T23:13:52.804 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-10T23:13:52.881 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T23:13:53.013 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-10T23:13:53.029 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-10T23:13:53.088 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T23:13:53.142 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-10T23:13:53.157 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-10T23:13:53.201 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T23:13:53.399 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package dump. 2024-09-10T23:13:53.416 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-10T23:13:53.457 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking dump (0.4b47-3) ... 2024-09-10T23:13:53.529 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-10T23:13:53.544 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-10T23:13:53.579 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T23:13:53.761 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package indent. 2024-09-10T23:13:53.778 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:13:53.798 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-10T23:13:53.813 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-10T23:13:53.819 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T23:13:53.857 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T23:13:54.105 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-10T23:13:54.122 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-10T23:13:54.126 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjson-perl. 2024-09-10T23:13:54.141 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-10T23:13:54.163 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T23:13:54.185 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-10T23:13:54.484 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-10T23:13:54.501 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-10T23:13:54.521 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-10T23:13:54.536 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-10T23:13:54.542 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T23:13:54.571 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T23:13:54.786 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-10T23:13:54.803 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-10T23:13:54.836 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T23:13:55.214 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-10T23:13:55.231 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-10T23:13:55.272 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T23:13:55.534 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-10T23:13:55.550 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-10T23:13:55.592 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T23:13:55.828 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libjson-perl. 2024-09-10T23:13:55.845 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-10T23:13:55.878 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-10T23:13:56.025 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-10T23:13:56.041 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T23:13:56.108 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T23:13:56.223 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-10T23:13:56.241 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-10T23:13:56.282 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T23:13:56.361 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-10T23:13:56.377 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T23:13:56.419 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T23:13:56.755 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-10T23:13:56.771 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T23:13:56.813 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T23:13:57.210 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-10T23:13:57.225 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-10T23:13:57.268 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T23:13:57.596 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-10T23:13:57.612 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T23:13:57.671 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T23:13:57.960 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-10T23:13:57.977 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T23:13:58.016 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-10T23:13:58.018 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T23:13:58.032 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:13:58.074 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:13:58.246 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-10T23:13:58.263 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-10T23:13:58.295 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T23:13:58.527 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-10T23:13:58.543 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:13:58.585 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T23:13:58.598 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-10T23:13:58.615 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T23:13:58.656 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T23:13:58.922 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-10T23:13:58.938 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:13:58.980 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T23:13:59.009 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-10T23:13:59.026 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-10T23:13:59.067 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T23:13:59.249 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-10T23:13:59.265 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T23:13:59.299 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T23:13:59.370 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-10T23:13:59.387 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T23:13:59.420 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T23:13:59.714 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-10T23:13:59.731 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:13:59.765 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:13:59.845 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-10T23:13:59.860 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-10T23:13:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T23:14:00.176 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-10T23:14:00.193 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:14:00.223 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package modemmanager. 2024-09-10T23:14:00.234 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T23:14:00.238 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T23:14:00.290 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T23:14:00.553 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-10T23:14:00.570 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:14:00.611 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T23:14:00.847 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-10T23:14:00.864 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-10T23:14:00.897 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T23:14:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package network-manager. 2024-09-10T23:14:00.961 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T23:14:01.004 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-10T23:14:01.653 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-10T23:14:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-10T23:14:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ppp. 2024-09-10T23:14:01.711 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T23:14:01.712 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-10T23:14:02.047 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package modemmanager. 2024-09-10T23:14:02.057 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T23:14:02.064 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-10T23:14:02.097 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T23:14:02.766 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package network-manager. 2024-09-10T23:14:02.783 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-10T23:14:02.829 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-10T23:14:02.928 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package pptp-linux. 2024-09-10T23:14:02.943 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-10T23:14:02.995 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-10T23:14:03.340 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-10T23:14:03.355 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-10T23:14:03.414 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-10T23:14:03.578 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ppp. 2024-09-10T23:14:03.595 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-10T23:14:03.809 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-10T23:14:03.825 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-10T23:14:03.876 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client-common (238) ... 2024-09-10T23:14:03.975 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T23:14:04.139 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-10T23:14:04.154 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:14:04.213 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:04.332 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package pptp-linux. 2024-09-10T23:14:04.348 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-10T23:14:04.390 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-10T23:14:04.735 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-10T23:14:04.751 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-10T23:14:04.777 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-common. 2024-09-10T23:14:04.792 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-10T23:14:04.801 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-10T23:14:04.845 INFO:teuthology.orchestra.run.smithi077.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-10T23:14:04.875 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-common (238) ... 2024-09-10T23:14:05.179 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-10T23:14:05.196 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-10T23:14:05.246 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking postgresql-client-common (238) ... 2024-09-10T23:14:05.359 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-14. 2024-09-10T23:14:05.374 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:14:05.461 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:05.541 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-10T23:14:05.558 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:14:05.633 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:06.229 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package postgresql-common. 2024-09-10T23:14:06.246 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-10T23:14:06.307 INFO:teuthology.orchestra.run.smithi017.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-10T23:14:06.328 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking postgresql-common (238) ... 2024-09-10T23:14:06.579 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql. 2024-09-10T23:14:06.595 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-10T23:14:06.638 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql (14+238) ... 2024-09-10T23:14:06.803 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package postgresql-14. 2024-09-10T23:14:06.820 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-10T23:14:06.848 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client. 2024-09-10T23:14:06.856 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:06.863 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-10T23:14:06.907 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client (14+238) ... 2024-09-10T23:14:07.134 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-10T23:14:07.149 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-10T23:14:07.192 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-10T23:14:07.545 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package tcl8.6. 2024-09-10T23:14:07.560 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-10T23:14:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T23:14:07.873 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package tcl. 2024-09-10T23:14:07.887 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-10T23:14:07.952 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-10T23:14:07.963 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package postgresql. 2024-09-10T23:14:07.979 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-10T23:14:08.022 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking postgresql (14+238) ... 2024-09-10T23:14:08.284 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package wpasupplicant. 2024-09-10T23:14:08.290 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package postgresql-client. 2024-09-10T23:14:08.299 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-10T23:14:08.306 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-10T23:14:08.342 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T23:14:08.348 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking postgresql-client (14+238) ... 2024-09-10T23:14:08.592 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-10T23:14:08.608 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-10T23:14:08.675 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-10T23:14:08.714 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-10T23:14:08.728 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-10T23:14:08.772 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-10T23:14:08.987 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package tcl8.6. 2024-09-10T23:14:09.004 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-10T23:14:09.045 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T23:14:09.142 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-10T23:14:09.157 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-10T23:14:09.199 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T23:14:09.339 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package tcl. 2024-09-10T23:14:09.357 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-10T23:14:09.402 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-10T23:14:09.467 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client-common (238) ... 2024-09-10T23:14:09.740 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-10T23:14:09.758 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package wpasupplicant. 2024-09-10T23:14:09.776 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-10T23:14:09.816 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T23:14:09.891 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T23:14:10.059 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:10.145 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-10T23:14:10.162 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-10T23:14:10.210 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T23:14:10.229 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-10T23:14:10.361 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T23:14:10.496 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:10.607 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-10T23:14:10.624 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-10T23:14:10.674 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T23:14:11.003 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up postgresql-client-common (238) ... 2024-09-10T23:14:11.230 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-10T23:14:11.364 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-10T23:14:11.493 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-10T23:14:11.506 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:11.602 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T23:14:11.632 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-10T23:14:11.775 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-10T23:14:11.901 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:12.013 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T23:14:12.013 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T23:14:12.747 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T23:14:12.847 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T23:14:12.866 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-10T23:14:12.949 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T23:14:12.964 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-10T23:14:13.075 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-10T23:14:13.226 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T23:14:13.352 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T23:14:13.352 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-10T23:14:13.352 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T23:14:13.478 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T23:14:13.604 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T23:14:14.067 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-10T23:14:14.193 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-10T23:14:14.335 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T23:14:14.336 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-10T23:14:14.437 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-10T23:14:14.461 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up dump (0.4b47-3) ... 2024-09-10T23:14:14.538 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-10T23:14:14.556 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-10T23:14:14.621 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T23:14:14.639 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-10T23:14:14.747 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T23:14:14.764 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-10T23:14:14.889 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-10T23:14:14.915 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-10T23:14:14.990 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-10T23:14:15.100 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T23:14:15.189 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-10T23:14:15.252 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T23:14:15.403 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T23:14:15.579 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T23:14:15.606 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-10T23:14:15.705 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T23:14:15.732 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up dump (0.4b47-3) ... 2024-09-10T23:14:15.828 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-10T23:14:15.831 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-10T23:14:15.917 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T23:14:16.016 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client (14+238) ... 2024-09-10T23:14:16.043 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-10T23:14:16.125 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-10T23:14:16.169 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-10T23:14:16.287 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-10T23:14:16.421 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-10T23:14:16.494 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-10T23:14:16.573 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-10T23:14:16.746 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:16.746 INFO:teuthology.orchestra.run.smithi077.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-10T23:14:16.746 INFO:teuthology.orchestra.run.smithi077.stdout:which means they are currently configured by ifupdown: 2024-09-10T23:14:16.747 INFO:teuthology.orchestra.run.smithi077.stdout:- enp3s0f1 2024-09-10T23:14:16.747 INFO:teuthology.orchestra.run.smithi077.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-10T23:14:16.747 INFO:teuthology.orchestra.run.smithi077.stdout:remove their configuration from /etc/network/interfaces. 2024-09-10T23:14:16.747 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:16.879 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-10T23:14:17.124 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-10T23:14:17.287 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-10T23:14:17.300 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-10T23:14:17.468 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T23:14:17.619 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-10T23:14:17.724 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-10T23:14:17.787 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up postgresql-client (14+238) ... 2024-09-10T23:14:17.888 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-10T23:14:18.445 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T23:14:18.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:18.503 INFO:teuthology.orchestra.run.smithi017.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-10T23:14:18.503 INFO:teuthology.orchestra.run.smithi017.stdout:which means they are currently configured by ifupdown: 2024-09-10T23:14:18.503 INFO:teuthology.orchestra.run.smithi017.stdout:- ens1f0 2024-09-10T23:14:18.503 INFO:teuthology.orchestra.run.smithi017.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-10T23:14:18.503 INFO:teuthology.orchestra.run.smithi017.stdout:remove their configuration from /etc/network/interfaces. 2024-09-10T23:14:18.503 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:18.621 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T23:14:18.643 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-10T23:14:18.772 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-10T23:14:18.932 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-common (238) ... 2024-09-10T23:14:19.060 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-10T23:14:19.474 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-10T23:14:19.844 INFO:teuthology.orchestra.run.smithi077.stdout:Adding user postgres to group ssl-cert 2024-09-10T23:14:20.096 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:20.097 INFO:teuthology.orchestra.run.smithi077.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-10T23:14:20.241 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-10T23:14:20.380 INFO:teuthology.orchestra.run.smithi077.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-10T23:14:20.380 INFO:teuthology.orchestra.run.smithi077.stdout:Removing obsolete dictionary files: 2024-09-10T23:14:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-10T23:14:20.502 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-10T23:14:20.653 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up postgresql-common (238) ... 2024-09-10T23:14:21.119 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-10T23:14:21.644 INFO:teuthology.orchestra.run.smithi017.stdout:Adding user postgres to group ssl-cert 2024-09-10T23:14:21.793 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:21.895 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:21.895 INFO:teuthology.orchestra.run.smithi017.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-10T23:14:22.058 INFO:teuthology.orchestra.run.smithi077.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-10T23:14:22.074 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-10T23:14:22.133 INFO:teuthology.orchestra.run.smithi077.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-10T23:14:22.133 INFO:teuthology.orchestra.run.smithi077.stdout:This user must also own the server process. 2024-09-10T23:14:22.134 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:The database cluster will be initialized with locale "en_US". 2024-09-10T23:14:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-10T23:14:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:The default text search configuration will be set to "english". 2024-09-10T23:14:22.134 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:Data page checksums are disabled. 2024-09-10T23:14:22.134 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:22.134 INFO:teuthology.orchestra.run.smithi077.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-10T23:14:22.135 INFO:teuthology.orchestra.run.smithi077.stdout:creating subdirectories ... ok 2024-09-10T23:14:22.135 INFO:teuthology.orchestra.run.smithi077.stdout:selecting dynamic shared memory implementation ... posix 2024-09-10T23:14:22.145 INFO:teuthology.orchestra.run.smithi017.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-10T23:14:22.145 INFO:teuthology.orchestra.run.smithi017.stdout:Removing obsolete dictionary files: 2024-09-10T23:14:22.158 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default max_connections ... 100 2024-09-10T23:14:22.192 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default shared_buffers ... 128MB 2024-09-10T23:14:22.205 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default time zone ... Etc/UTC 2024-09-10T23:14:22.206 INFO:teuthology.orchestra.run.smithi077.stdout:creating configuration files ... ok 2024-09-10T23:14:22.368 INFO:teuthology.orchestra.run.smithi077.stdout:running bootstrap script ... ok 2024-09-10T23:14:22.875 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-10T23:14:22.984 INFO:teuthology.orchestra.run.smithi077.stdout:performing post-bootstrap initialization ... ok 2024-09-10T23:14:23.346 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-10T23:14:23.548 INFO:teuthology.orchestra.run.smithi077.stdout:syncing data to disk ... ok 2024-09-10T23:14:23.681 INFO:teuthology.orchestra.run.smithi017.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-10T23:14:23.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-10T23:14:23.767 INFO:teuthology.orchestra.run.smithi017.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-10T23:14:23.767 INFO:teuthology.orchestra.run.smithi017.stdout:This user must also own the server process. 2024-09-10T23:14:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:23.768 INFO:teuthology.orchestra.run.smithi017.stdout:The database cluster will be initialized with locale "en_US". 2024-09-10T23:14:23.768 INFO:teuthology.orchestra.run.smithi017.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-10T23:14:23.768 INFO:teuthology.orchestra.run.smithi017.stdout:The default text search configuration will be set to "english". 2024-09-10T23:14:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:23.768 INFO:teuthology.orchestra.run.smithi017.stdout:Data page checksums are disabled. 2024-09-10T23:14:23.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:23.768 INFO:teuthology.orchestra.run.smithi017.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-10T23:14:23.769 INFO:teuthology.orchestra.run.smithi017.stdout:creating subdirectories ... ok 2024-09-10T23:14:23.769 INFO:teuthology.orchestra.run.smithi017.stdout:selecting dynamic shared memory implementation ... posix 2024-09-10T23:14:23.793 INFO:teuthology.orchestra.run.smithi017.stdout:selecting default max_connections ... 100 2024-09-10T23:14:23.828 INFO:teuthology.orchestra.run.smithi017.stdout:selecting default shared_buffers ... 128MB 2024-09-10T23:14:23.842 INFO:teuthology.orchestra.run.smithi017.stdout:selecting default time zone ... Etc/UTC 2024-09-10T23:14:23.843 INFO:teuthology.orchestra.run.smithi017.stdout:creating configuration files ... ok 2024-09-10T23:14:24.014 INFO:teuthology.orchestra.run.smithi017.stdout:running bootstrap script ... ok 2024-09-10T23:14:24.069 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-10T23:14:24.658 INFO:teuthology.orchestra.run.smithi017.stdout:performing post-bootstrap initialization ... ok 2024-09-10T23:14:25.204 INFO:teuthology.orchestra.run.smithi017.stdout:syncing data to disk ... ok 2024-09-10T23:14:25.717 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-10T23:14:27.072 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T23:14:27.220 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-10T23:14:27.346 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql (14+238) ... 2024-09-10T23:14:27.464 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T23:14:27.607 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T23:14:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T23:14:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T23:14:28.667 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T23:14:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T23:14:28.768 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-10T23:14:28.856 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-10T23:14:29.007 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up postgresql (14+238) ... 2024-09-10T23:14:29.079 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T23:14:29.133 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-10T23:14:29.259 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-10T23:14:29.272 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T23:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T23:14:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-10T23:14:30.261 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T23:14:30.353 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-10T23:14:30.697 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T23:14:30.826 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-10T23:14:30.849 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T23:14:30.926 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T23:14:31.475 INFO:teuthology.orchestra.run.smithi077.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T23:14:31.483 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:31.684 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-10T23:14:31.775 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T23:14:32.356 INFO:teuthology.orchestra.run.smithi017.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T23:14:32.363 DEBUG:teuthology.parallel:result is None 2024-09-10T23:14:32.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:14:32.513 DEBUG:teuthology.orchestra.run.smithi017:> dpkg-query -W -f '${Version}' ceph 2024-09-10T23:14:32.536 INFO:teuthology.orchestra.run.smithi017.stdout:19.3.0-4854-g8f219c47-1jammy 2024-09-10T23:14:32.536 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854-g8f219c47-1jammy 2024-09-10T23:14:32.537 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854-g8f219c47-1jammy is installed. 2024-09-10T23:14:32.538 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T23:14:32.710 DEBUG:teuthology.orchestra.run.smithi077:> dpkg-query -W -f '${Version}' ceph 2024-09-10T23:14:32.734 INFO:teuthology.orchestra.run.smithi077.stdout:19.3.0-4854-g8f219c47-1jammy 2024-09-10T23:14:32.734 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854-g8f219c47-1jammy 2024-09-10T23:14:32.734 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854-g8f219c47-1jammy is installed. 2024-09-10T23:14:32.736 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T23:14:32.737 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:32.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:14:32.757 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:14:32.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T23:14:32.798 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T23:14:32.798 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:32.798 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:14:32.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:14:32.883 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:14:32.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T23:14:32.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T23:14:32.964 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T23:14:32.964 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:32.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:14:32.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:14:33.043 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:14:33.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T23:14:33.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T23:14:33.125 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T23:14:33.125 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:33.126 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:14:33.145 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:14:33.211 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:14:33.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T23:14:33.231 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T23:14:33.292 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T23:14:33.371 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T23:14:33.371 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2024-09-10T23:14:33.374 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2024-09-10T23:14:33.394 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T23:14:33.394 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T23:14:33.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T23:14:33.458 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T23:14:33.458 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T23:14:33.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T23:14:33.593 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T23:14:33.593 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T23:14:33.593 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T23:14:33.594 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:33.594 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T23:14:33.602 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T23:14:33.691 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:14:33.691 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T23:14:33.699 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T23:14:33.793 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T23:14:33.793 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T23:14:33.793 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899775', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6190, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '479/1024', 'suite': 'fs', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMv31f0I4P91k4gVrj6h8hDWP95+QcDw4YlyEbtuW+kwlz2iHQonWwt6wV1zaCQTszLTZYH4a3S2CO8m9mYb3Go=', 'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO931+jJRRyChCnY03ZZZ0N3obAnb5zkIE0abVjxRCkzXEmSTI/eZfBWGM3p92Y0b/gBcT8z6Y7ywU28MARcHa8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_16:59:47', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T23:14:33.794 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T23:14:33.797 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T23:14:33.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T23:14:33.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T23:14:33.868 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:33.868 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:14:33.916 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:14:33.917 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-10T23:14:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:14:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:14:33.973 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 903 Links: 1 2024-09-10T23:14:33.973 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:14:33.973 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-10 23:07:50.789188581 +0000 2024-09-10T23:14:33.973 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-10 23:07:50.501191153 +0000 2024-09-10T23:14:33.973 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-10 23:07:50.501191153 +0000 2024-09-10T23:14:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-10 23:07:50.501191153 +0000 2024-09-10T23:14:33.973 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:14:34.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:14:34.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:14:34.038 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000236563 s, 2.2 MB/s 2024-09-10T23:14:34.040 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:14:34.094 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-10T23:14:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:14:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:14:34.149 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 920 Links: 1 2024-09-10T23:14:34.149 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:14:34.149 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-10 23:07:51.373183364 +0000 2024-09-10T23:14:34.149 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-10 23:07:51.077186009 +0000 2024-09-10T23:14:34.149 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-10 23:07:51.077186009 +0000 2024-09-10T23:14:34.149 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-10 23:07:51.077186009 +0000 2024-09-10T23:14:34.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:14:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:14:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:14:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000238498 s, 2.1 MB/s 2024-09-10T23:14:34.213 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:14:34.270 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-10T23:14:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:14:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:14:34.325 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 937 Links: 1 2024-09-10T23:14:34.325 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:14:34.325 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-10 23:07:51.673180685 +0000 2024-09-10T23:14:34.325 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-10 23:07:51.669180721 +0000 2024-09-10T23:14:34.325 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-10 23:07:51.669180721 +0000 2024-09-10T23:14:34.325 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-10 23:07:51.669180721 +0000 2024-09-10T23:14:34.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:14:34.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:14:34.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:14:34.390 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000244531 s, 2.1 MB/s 2024-09-10T23:14:34.392 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:14:34.446 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-10T23:14:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:14:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:14:34.501 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 6h/6d Inode: 953 Links: 1 2024-09-10T23:14:34.501 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:14:34.502 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-10 23:07:52.573172646 +0000 2024-09-10T23:14:34.502 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-10 23:07:52.269175361 +0000 2024-09-10T23:14:34.502 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-10 23:07:52.269175361 +0000 2024-09-10T23:14:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-09-10 23:07:52.269175361 +0000 2024-09-10T23:14:34.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:14:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:14:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:14:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000250198 s, 2.0 MB/s 2024-09-10T23:14:34.565 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:14:34.619 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:34.619 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:14:34.619 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T23:14:34.628 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T23:14:34.628 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-09-10T23:14:34.677 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T23:14:34.677 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:14:34.678 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 6h/6d Inode: 882 Links: 1 2024-09-10T23:14:34.678 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:14:34.678 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-10 23:07:41.537486802 +0000 2024-09-10T23:14:34.678 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-10 23:07:41.253489339 +0000 2024-09-10T23:14:34.678 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-10 23:07:41.253489339 +0000 2024-09-10T23:14:34.678 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-10 23:07:41.253489339 +0000 2024-09-10T23:14:34.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T23:14:34.739 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-10T23:14:34.739 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-10T23:14:34.740 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000693266 s, 739 kB/s 2024-09-10T23:14:34.741 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T23:14:34.795 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-09-10T23:14:34.845 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T23:14:34.845 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:14:34.845 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 6h/6d Inode: 898 Links: 1 2024-09-10T23:14:34.845 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:14:34.846 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-10 23:07:42.085481907 +0000 2024-09-10T23:14:34.846 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-10 23:07:41.817484300 +0000 2024-09-10T23:14:34.846 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-10 23:07:41.817484300 +0000 2024-09-10T23:14:34.846 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-10 23:07:41.817484300 +0000 2024-09-10T23:14:34.846 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T23:14:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-10T23:14:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-10T23:14:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.00038049 s, 1.3 MB/s 2024-09-10T23:14:34.909 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T23:14:34.963 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-09-10T23:14:35.017 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T23:14:35.017 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:14:35.017 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-09-10T23:14:35.017 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:14:35.018 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-10 23:07:42.621477119 +0000 2024-09-10T23:14:35.018 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-10 23:07:42.353479512 +0000 2024-09-10T23:14:35.018 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-10 23:07:42.353479512 +0000 2024-09-10T23:14:35.018 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-10 23:07:42.353479512 +0000 2024-09-10T23:14:35.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T23:14:35.079 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-10T23:14:35.079 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-10T23:14:35.079 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000383892 s, 1.3 MB/s 2024-09-10T23:14:35.081 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T23:14:35.135 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-09-10T23:14:35.185 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T23:14:35.185 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T23:14:35.185 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 6h/6d Inode: 931 Links: 1 2024-09-10T23:14:35.186 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T23:14:35.186 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-10 23:07:43.165472260 +0000 2024-09-10T23:14:35.186 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-10 23:07:42.913474511 +0000 2024-09-10T23:14:35.186 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-10 23:07:42.913474511 +0000 2024-09-10T23:14:35.186 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-10 23:07:42.913474511 +0000 2024-09-10T23:14:35.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T23:14:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-10T23:14:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-10T23:14:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000394329 s, 1.3 MB/s 2024-09-10T23:14:35.249 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T23:14:35.307 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:35.307 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T23:14:35.307 INFO:tasks.ceph:Generating config... 2024-09-10T23:14:35.308 INFO:tasks.ceph:[client] pid file = 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T23:14:35.309 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T23:14:35.309 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T23:14:35.309 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T23:14:35.309 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-10T23:14:35.309 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-10T23:14:35.310 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T23:14:35.310 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T23:14:35.310 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-10T23:14:35.310 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T23:14:35.310 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T23:14:35.310 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T23:14:35.310 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T23:14:35.310 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T23:14:35.310 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T23:14:35.310 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T23:14:35.358 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T23:14:35.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T23:14:35.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T23:14:35.442 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.b', '172.21.15.77'), ('mon.c', '[v2:172.21.15.77:3301,v1:172.21.15.77:6790]')] 2024-09-10T23:14:35.443 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}} 2024-09-10T23:14:35.443 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:35.443 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T23:14:35.492 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --add b 172.21.15.77 --addv c '[v2:172.21.15.77:3301,v1:172.21.15.77:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:fsid ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2024-09-10T23:14:35.583603+0000 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-10T23:14:35.583603+0000 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 17 (quincy) 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-10T23:14:35.584 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-10T23:14:35.585 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] mon.c 2024-09-10T23:14:35.585 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T23:14:35.587 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T23:14:35.595 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442... 2024-09-10T23:14:35.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:14:35.639 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-10T23:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-10T23:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-10T23:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-10T23:14:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:14:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-10T23:14:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-10T23:14:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-09-10T23:14:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-10T23:14:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 20 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 20 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 10 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-10T23:14:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 30 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:14:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: mon down mkfs grace = 300 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-10T23:14:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = "" 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: mds cache max size = 1000 2024-09-10T23:14:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: mds log max segments = 1 2024-09-10T23:14:35.690 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-10T23:14:35.690 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-10T23:14:35.690 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:14:35.690 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-10T23:14:35.690 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.690 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-10T23:14:35.690 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.690 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-10T23:14:35.690 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-10T23:14:35.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:14:35.692 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.693 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-10T23:14:35.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-10T23:14:35.695 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:14:35.696 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 30 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-10T23:14:35.697 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:14:35.698 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-10T23:14:35.699 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout: mds cache max size = 1000 2024-09-10T23:14:35.700 INFO:teuthology.orchestra.run.smithi077.stdout: mds log max segments = 1 2024-09-10T23:14:35.702 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T23:14:35.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T23:14:35.807 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T23:14:35.807 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:35.807 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T23:14:35.816 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:35.816 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T23:14:35.868 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:14:35.868 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:35.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T23:14:35.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T23:14:35.943 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:14:35.943 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:35.992 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:14:35.992 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:14:35.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T23:14:35.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T23:14:36.027 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:14:36.027 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:36.081 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T23:14:36.081 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T23:14:36.081 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T23:14:36.137 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T23:14:36.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T23:14:36.202 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T23:14:36.231 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T23:14:36.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T23:14:36.288 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T23:14:36.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T23:14:36.313 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T23:14:36.416 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T23:14:36.420 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T23:14:36.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T23:14:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T23:14:36.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T23:14:36.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T23:14:36.619 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T23:14:36.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T23:14:36.643 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T23:14:36.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T23:14:36.685 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T23:14:36.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T23:14:36.790 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T23:14:36.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T23:14:36.848 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T23:14:36.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T23:14:36.950 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T23:14:36.966 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T23:14:36.966 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T23:14:36.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T23:14:36.986 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:36.986 INFO:tasks.ceph:role: osd.0 2024-09-10T23:14:36.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:14:36.987 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:14:37.047 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:14:37.071 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-10T23:14:37.074 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-10T23:14:37.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T23:14:37.145 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T23:14:37.204 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T23:14:37.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:37.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T23:14:37.268 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:37.268 INFO:tasks.ceph:role: osd.1 2024-09-10T23:14:37.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:14:37.268 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T23:14:37.327 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:14:37.327 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:14:37.327 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:14:37.327 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T23:14:37.327 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:14:37.327 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:14:37.328 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:14:37.328 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T23:14:37.328 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:14:37.328 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:14:37.352 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-10T23:14:37.355 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-10T23:14:37.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T23:14:37.421 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T23:14:37.480 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T23:14:37.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:37.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T23:14:37.543 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:37.543 INFO:tasks.ceph:role: osd.2 2024-09-10T23:14:37.543 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:14:37.543 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:14:37.603 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:14:37.627 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-10T23:14:37.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-10T23:14:37.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T23:14:37.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T23:14:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T23:14:37.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:37.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T23:14:37.827 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:37.827 INFO:tasks.ceph:role: osd.3 2024-09-10T23:14:37.827 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:14:37.827 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T23:14:37.887 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:14:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:14:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:14:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T23:14:37.887 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:14:37.887 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:14:37.887 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:14:37.888 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T23:14:37.888 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:14:37.888 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:14:37.911 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-10T23:14:37.914 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-10T23:14:37.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T23:14:37.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T23:14:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T23:14:38.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:38.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:38.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:38.164+0000 7f1392d0b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T23:14:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:38.164+0000 7f1392d0b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T23:14:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:38.164+0000 7f1392d0b7c0 -1 bdev(0x55e01137f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T23:14:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:38.164+0000 7f1392d0b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T23:14:41.361 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T23:14:41.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:41.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:41.484+0000 7f2381e807c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T23:14:41.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:41.488+0000 7f2381e807c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T23:14:41.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:41.488+0000 7f2381e807c0 -1 bdev(0x5640604ff800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T23:14:41.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:41.488+0000 7f2381e807c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T23:14:44.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T23:14:44.758 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:44.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:44.856+0000 7feab7bcf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T23:14:44.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:44.856+0000 7feab7bcf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T23:14:44.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:44.856+0000 7feab7bcf7c0 -1 bdev(0x560e4356b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T23:14:44.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:44.856+0000 7feab7bcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T23:14:48.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T23:14:48.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:48.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:48.236+0000 7fd739fbf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T23:14:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:48.236+0000 7fd739fbf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T23:14:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:48.236+0000 7fd739fbf7c0 -1 bdev(0x558218af3800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T23:14:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:14:48.236+0000 7fd739fbf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T23:14:51.696 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T23:14:51.718 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T23:14:51.740 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:51.740 INFO:tasks.ceph:role: osd.4 2024-09-10T23:14:51.740 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:14:51.740 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T23:14:51.808 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:14:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:14:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:14:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T23:14:51.808 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:14:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:14:51.808 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:14:51.808 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T23:14:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:14:51.809 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:14:52.198 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-10T23:14:52.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-10T23:14:52.201 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T23:14:52.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T23:14:52.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:52.325 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T23:14:52.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T23:14:52.392 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:52.392 INFO:tasks.ceph:role: osd.5 2024-09-10T23:14:52.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:14:52.392 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:14:52.460 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:14:52.870 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-10T23:14:52.872 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-10T23:14:52.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T23:14:53.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T23:14:53.032 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T23:14:53.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:53.033 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T23:14:53.097 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:53.097 INFO:tasks.ceph:role: osd.6 2024-09-10T23:14:53.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:14:53.097 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T23:14:53.168 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:14:53.168 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:14:53.168 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:14:53.168 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T23:14:53.168 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:14:53.168 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:14:53.168 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:14:53.169 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T23:14:53.169 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:14:53.169 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:14:53.588 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-10T23:14:53.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-10T23:14:53.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T23:14:53.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T23:14:53.745 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T23:14:53.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:53.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T23:14:53.809 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T23:14:53.809 INFO:tasks.ceph:role: osd.7 2024-09-10T23:14:53.809 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:14:53.809 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T23:14:53.881 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T23:14:54.246 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-10T23:14:54.249 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-10T23:14:54.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T23:14:54.333 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T23:14:54.392 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T23:14:54.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:14:54.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:54.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:14:54.525+0000 7f629fd6e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T23:14:54.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:14:54.525+0000 7f629fd6e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T23:14:54.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:14:54.525+0000 7f629fd6e7c0 -1 bdev(0x55b530701800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T23:14:54.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:14:54.525+0000 7f629fd6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T23:14:57.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T23:14:57.792 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:14:57.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:14:57.885+0000 7f8beceed7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T23:14:57.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:14:57.889+0000 7f8beceed7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T23:14:57.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:14:57.889+0000 7f8beceed7c0 -1 bdev(0x555ad26c9800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T23:14:57.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:14:57.889+0000 7f8beceed7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T23:15:01.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T23:15:01.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:15:01.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:01.225+0000 7fd4483c27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T23:15:01.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:01.229+0000 7fd4483c27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T23:15:01.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:01.229+0000 7fd4483c27c0 -1 bdev(0x5567d9cc9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T23:15:01.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:01.229+0000 7fd4483c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T23:15:03.796 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:15:03.799 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:15:04.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T23:15:04.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:15:04.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:04.573+0000 7fa6162dc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T23:15:04.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:04.577+0000 7fa6162dc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T23:15:04.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:04.577+0000 7fa6162dc7c0 -1 bdev(0x55b263f25800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T23:15:04.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:04.577+0000 7fa6162dc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T23:15:07.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T23:15:07.876 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T23:15:07.876 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:07.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T23:15:07.899 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:07.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T23:15:07.961 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:07.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T23:15:08.025 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:08.025 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T23:15:08.090 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:08.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T23:15:08.153 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:08.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T23:15:08.217 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:08.217 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T23:15:08.280 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:08.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T23:15:08.301 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:08.302 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T23:15:08.365 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:08.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T23:15:08.429 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:08.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T23:15:08.493 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:08.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T23:15:08.556 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:08.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T23:15:08.621 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:08.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T23:15:08.685 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:08.685 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T23:15:08.694 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:08.694 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T23:15:08.744 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:08.744 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T23:15:08.753 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:08.753 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T23:15:08.805 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T23:15:08.805 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T23:15:08.808 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T23:15:08.856 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2024-09-10T23:15:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ== 2024-09-10T23:15:08.857 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-09-10T23:15:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ== 2024-09-10T23:15:08.857 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-09-10T23:15:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag== 2024-09-10T23:15:08.857 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2024-09-10T23:15:08.857 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg== 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg== 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw== 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g== 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA== 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ== 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-09-10T23:15:08.858 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w== 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.4] 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg== 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.5] 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A== 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.6] 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ== 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.7] 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ== 2024-09-10T23:15:08.859 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi017.stdout:[client.2] 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ== 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi017.stdout:[client.1] 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw== 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi017.stdout:[client.3] 2024-09-10T23:15:08.860 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ== 2024-09-10T23:15:08.870 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2024-09-10T23:15:08.871 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ== 2024-09-10T23:15:08.871 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-10T23:15:08.871 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ== 2024-09-10T23:15:08.871 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-10T23:15:08.871 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag== 2024-09-10T23:15:08.871 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-09-10T23:15:08.871 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg== 2024-09-10T23:15:08.871 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-09-10T23:15:08.872 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg== 2024-09-10T23:15:08.872 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-09-10T23:15:08.872 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw== 2024-09-10T23:15:08.872 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-09-10T23:15:08.872 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g== 2024-09-10T23:15:08.873 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2024-09-10T23:15:08.873 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA== 2024-09-10T23:15:08.873 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-10T23:15:08.873 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ== 2024-09-10T23:15:08.873 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-10T23:15:08.873 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w== 2024-09-10T23:15:08.873 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2024-09-10T23:15:08.874 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg== 2024-09-10T23:15:08.874 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2024-09-10T23:15:08.874 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A== 2024-09-10T23:15:08.874 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2024-09-10T23:15:08.874 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ== 2024-09-10T23:15:08.874 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2024-09-10T23:15:08.874 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ== 2024-09-10T23:15:08.875 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-09-10T23:15:08.875 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:15:08.875 INFO:teuthology.orchestra.run.smithi077.stdout:[client.2] 2024-09-10T23:15:08.875 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ== 2024-09-10T23:15:08.875 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2024-09-10T23:15:08.875 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw== 2024-09-10T23:15:08.875 INFO:teuthology.orchestra.run.smithi077.stdout:[client.3] 2024-09-10T23:15:08.875 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ== 2024-09-10T23:15:08.877 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T23:15:08.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T23:15:08.978 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:15:08.982 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:15:09.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:15:09.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:15:09.101 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.215 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.328 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T23:15:09.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T23:15:09.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:15:09.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:15:09.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:15:09.446 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T23:15:09.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.505 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.674 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T23:15:09.728 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:15:09.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:15:09.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:15:09.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:15:09.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:15:09.850 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:15:09.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:15:09.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T23:15:09.969 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T23:15:09.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T23:15:09.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T23:15:10.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T23:15:10.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T23:15:10.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T23:15:10.256 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T23:15:10.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T23:15:10.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T23:15:10.444 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T23:15:10.463 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:15:10.466 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T23:15:10.512 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T23:15:10.512 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T23:15:10.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T23:15:10.515 INFO:tasks.ceph.mon.a:Started 2024-09-10T23:15:10.516 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T23:15:10.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T23:15:10.555 INFO:tasks.ceph.mon.b:Started 2024-09-10T23:15:10.556 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T23:15:10.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T23:15:10.559 INFO:tasks.ceph.mon.c:Started 2024-09-10T23:15:10.559 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T23:15:10.559 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T23:15:10.559 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T23:15:10.562 INFO:tasks.ceph.mgr.y:Started 2024-09-10T23:15:10.562 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T23:15:10.562 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T23:15:10.568 INFO:tasks.ceph.mgr.x:Started 2024-09-10T23:15:10.568 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-10T23:15:10.568 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-10T23:15:10.571 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-10T23:15:10.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-10T23:15:10.624 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-10T23:15:10.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-10T23:15:10.675 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-10T23:15:10.675 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-10T23:15:10.725 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-10T23:15:10.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-10T23:15:10.775 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-10T23:15:10.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-10T23:15:10.827 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-10T23:15:10.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-10T23:15:10.879 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-10T23:15:10.879 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-10T23:15:10.932 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-10T23:15:10.932 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-10T23:15:10.979 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-10T23:15:10.980 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-10T23:15:11.035 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-10T23:15:11.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-10T23:15:11.069 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-10T23:15:11.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-10T23:15:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.083+0000 7f2205400640 1 -- 172.21.15.17:0/3290811780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f21d4005110 con 0x7f220015df60 2024-09-10T23:15:11.089 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-10T23:15:11.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-10T23:15:11.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f15b6000640 1 -- 172.21.15.17:0/4015667488 <== mon.1 v2:172.21.15.77:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f15b80173b0 con 0x7f15c015f8d0 2024-09-10T23:15:11.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f09e6c00640 1 -- 172.21.15.17:0/350639963 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d80e90c0 con 0x7f09c80039c0 2024-09-10T23:15:11.098 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T23:15:11.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-10T23:15:11.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f57fea00640 1 -- 172.21.15.17:0/4222078362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f580c1fba00 msgr2=0x7f580c0c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f57fea00640 1 --2- 172.21.15.17:0/4222078362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f580c1fba00 0x7f580c0c9690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f580c06fce0 tx=0x7f5804010ee0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f57fea00640 1 -- 172.21.15.17:0/4222078362 shutdown_connections 2024-09-10T23:15:11.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f57fea00640 1 --2- 172.21.15.17:0/4222078362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f580c1fba00 0x7f580c0c9690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f57fea00640 1 --2- 172.21.15.17:0/4222078362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f580c1fb040 0x7f580c1fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f57fea00640 1 --2- 172.21.15.17:0/4222078362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57f4003a60 0x7f580c1f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f57fea00640 1 -- 172.21.15.17:0/4222078362 >> 172.21.15.17:0/4222078362 conn(0x7f580c0d3ed0 msgr2=0x7f580c0d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f57fea00640 1 -- 172.21.15.17:0/4222078362 shutdown_connections 2024-09-10T23:15:11.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f57fea00640 1 -- 172.21.15.17:0/4222078362 wait complete. 2024-09-10T23:15:11.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f21f6a00640 1 -- 172.21.15.17:0/3290811780 <== mon.1 v2:172.21.15.77:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f21f801a790 con 0x7f220015df60 2024-09-10T23:15:11.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f21f6a00640 1 -- 172.21.15.17:0/3290811780 <== mon.1 v2:172.21.15.77:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f21f801aa70 con 0x7f220015df60 2024-09-10T23:15:11.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f09e6c00640 1 -- 172.21.15.17:0/350639963 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d80ea480 con 0x7f09c80039c0 2024-09-10T23:15:11.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.091+0000 7f09d3e00640 1 -- 172.21.15.17:0/350639963 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f09cc0060d0 con 0x7f09c80039c0 2024-09-10T23:15:11.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.099+0000 7f09e6c00640 1 -- 172.21.15.17:0/350639963 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d80eb110 con 0x7f09c80039c0 2024-09-10T23:15:11.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.103+0000 7f09d3e00640 1 -- 172.21.15.17:0/350639963 <== mon.2 v2:172.21.15.77:3301/0 5 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f09cc003990 con 0x7f09c80039c0 2024-09-10T23:15:11.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.103+0000 7f09d3e00640 1 -- 172.21.15.17:0/350639963 <== mon.2 v2:172.21.15.77:3301/0 6 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f09cc0b8c70 con 0x7f09c80039c0 2024-09-10T23:15:11.109 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T23:15:11.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-10T23:15:11.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f2205400640 1 -- 172.21.15.17:0/3290811780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220015df60 msgr2=0x7f220014b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f2205400640 1 --2- 172.21.15.17:0/3290811780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220015df60 0x7f220014b640 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c580 tx=0x7f21f800ca40 comp rx=0 tx=0).stop 2024-09-10T23:15:11.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f2205400640 1 -- 172.21.15.17:0/3290811780 shutdown_connections 2024-09-10T23:15:11.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f2205400640 1 --2- 172.21.15.17:0/3290811780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f220015df60 0x7f220014b640 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f2205400640 1 --2- 172.21.15.17:0/3290811780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f220015db80 0x7f22001547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f2205400640 1 --2- 172.21.15.17:0/3290811780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2200073f20 0x7f220014e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f2205400640 1 -- 172.21.15.17:0/3290811780 >> 172.21.15.17:0/3290811780 conn(0x7f22000b17a0 msgr2=0x7f220015ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f2205400640 1 -- 172.21.15.17:0/3290811780 shutdown_connections 2024-09-10T23:15:11.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f2205400640 1 -- 172.21.15.17:0/3290811780 wait complete. 2024-09-10T23:15:11.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.107+0000 7f09d3e00640 1 -- 172.21.15.17:0/350639963 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f09cc016d10 con 0x7f09c80039c0 2024-09-10T23:15:11.155 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-10T23:15:11.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-10T23:15:11.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.151+0000 7f6c09600640 1 -- 172.21.15.17:0/2860407860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c040709a0 msgr2=0x7f6c0406e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.151+0000 7f6c09600640 1 --2- 172.21.15.17:0/2860407860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c040709a0 0x7f6c0406e960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6c0415f5c0 tx=0x7f6bf001c6b0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.159+0000 7f6c09600640 1 -- 172.21.15.17:0/2860407860 shutdown_connections 2024-09-10T23:15:11.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.159+0000 7f6c09600640 1 --2- 172.21.15.17:0/2860407860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c040709a0 0x7f6c0406e960 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.159+0000 7f6c09600640 1 --2- 172.21.15.17:0/2860407860 >> v2:172.21.15.17:3300/0 conn(0x7f6c0415bae0 0x7f6c040b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.159+0000 7f6c09600640 1 -- 172.21.15.17:0/2860407860 >> 172.21.15.17:0/2860407860 conn(0x7f6c040cfa00 msgr2=0x7f6c040cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.159+0000 7f6c09600640 1 -- 172.21.15.17:0/2860407860 shutdown_connections 2024-09-10T23:15:11.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.159+0000 7f6c09600640 1 -- 172.21.15.17:0/2860407860 wait complete. 2024-09-10T23:15:11.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.167+0000 7f6c09600640 1 Processor -- start 2024-09-10T23:15:11.176 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T23:15:11.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T23:15:11.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c09600640 1 -- start start 2024-09-10T23:15:11.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c09600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c0406e520 0x7f6c04156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c09600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c040709a0 0x7f6c040c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c09600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0415bae0 0x7f6c040c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c09600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6c040cea40 con 0x7f6c040709a0 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c09600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c040ce8c0 con 0x7f6c0415bae0 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c09600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c040cebc0 con 0x7f6c0406e520 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c0406e520 0x7f6c04156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c040709a0 0x7f6c040c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c0406e520 0x7f6c04156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:53434/0 (socket says 172.21.15.17:53434) 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02a00640 1 -- 172.21.15.17:0/805882411 learned_addr learned my addr 172.21.15.17:0/805882411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c03400640 1 --2- 172.21.15.17:0/805882411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0415bae0 0x7f6c040c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02a00640 1 -- 172.21.15.17:0/805882411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0415bae0 msgr2=0x7f6c040c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02a00640 1 --2- 172.21.15.17:0/805882411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0415bae0 0x7f6c040c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02a00640 1 -- 172.21.15.17:0/805882411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c040709a0 msgr2=0x7f6c040c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02a00640 1 --2- 172.21.15.17:0/805882411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c040709a0 0x7f6c040c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02a00640 1 -- 172.21.15.17:0/805882411 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c040c6ed0 con 0x7f6c0406e520 2024-09-10T23:15:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c03400640 1 --2- 172.21.15.17:0/805882411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0415bae0 0x7f6c040c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.171+0000 7f6c02a00640 1 --2- 172.21.15.17:0/805882411 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c0406e520 0x7f6c04156180 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00ccb0 tx=0x7f6bfc00a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.187 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-10T23:15:11.187 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-10T23:15:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.179+0000 7f6bfaa00640 1 -- 172.21.15.17:0/805882411 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00f450 con 0x7f6c0406e520 2024-09-10T23:15:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.179+0000 7f6bfaa00640 1 -- 172.21.15.17:0/805882411 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f6bfc00f5f0 con 0x7f6c0406e520 2024-09-10T23:15:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.179+0000 7f6bfaa00640 1 -- 172.21.15.17:0/805882411 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00fa00 con 0x7f6c0406e520 2024-09-10T23:15:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.183+0000 7f6c09600640 1 -- 172.21.15.17:0/805882411 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c040c3530 con 0x7f6c0406e520 2024-09-10T23:15:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.183+0000 7f6c09600640 1 -- 172.21.15.17:0/805882411 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c040c3af0 con 0x7f6c0406e520 2024-09-10T23:15:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.183+0000 7f6bfaa00640 1 -- 172.21.15.17:0/805882411 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f6bfc00fba0 con 0x7f6c0406e520 2024-09-10T23:15:11.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.183+0000 7f6bfaa00640 1 -- 172.21.15.17:0/805882411 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6bfc00e970 con 0x7f6c0406e520 2024-09-10T23:15:11.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.183+0000 7f6befe00640 1 -- 172.21.15.17:0/805882411 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd80052a0 con 0x7f6c0406e520 2024-09-10T23:15:11.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.183+0000 7f15c4a00640 1 -- 172.21.15.17:0/4015667488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f1594005320 con 0x7f15c015f8d0 2024-09-10T23:15:11.193 DEBUG:tasks.ceph:set 18 configs 2024-09-10T23:15:11.193 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.193 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.194 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.194 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.194 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.187+0000 7f6bfaa00640 1 -- 172.21.15.17:0/805882411 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f6bfc014030 con 0x7f6c0406e520 2024-09-10T23:15:11.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.203+0000 7f15b6000640 1 -- 172.21.15.17:0/4015667488 <== mon.1 v2:172.21.15.77:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15b8017640 con 0x7f15c015f8d0 2024-09-10T23:15:11.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.203+0000 7f6bfaa00640 1 -- 172.21.15.17:0/805882411 <== mon.2 v2:172.21.15.77:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bfc00eb70 con 0x7f6c0406e520 2024-09-10T23:15:11.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.207+0000 7f09d3e00640 1 -- 172.21.15.17:0/350639963 <== mon.2 v2:172.21.15.77:3301/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09cc003cb0 con 0x7f09c80039c0 2024-09-10T23:15:11.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.215+0000 7f15b6000640 1 -- 172.21.15.17:0/4015667488 <== mon.1 v2:172.21.15.77:3300/0 12 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f15b80178e0 con 0x7f15c015f8d0 2024-09-10T23:15:11.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.223+0000 7f15c4a00640 1 -- 172.21.15.17:0/4015667488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15c015f8d0 msgr2=0x7f15c00c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.223+0000 7f15c4a00640 1 --2- 172.21.15.17:0/4015667488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15c015f8d0 0x7f15c00c5b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f15c002eb60 tx=0x7f15b800ce00 comp rx=0 tx=0).stop 2024-09-10T23:15:11.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.231+0000 7f15c4a00640 1 -- 172.21.15.17:0/4015667488 shutdown_connections 2024-09-10T23:15:11.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.231+0000 7f15c4a00640 1 --2- 172.21.15.17:0/4015667488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15c00cb4c0 0x7f15c00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.231+0000 7f15c4a00640 1 --2- 172.21.15.17:0/4015667488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15c015f8d0 0x7f15c00c5b30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.231+0000 7f15c4a00640 1 --2- 172.21.15.17:0/4015667488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a4004ca0 0x7f15c006e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.231+0000 7f15c4a00640 1 -- 172.21.15.17:0/4015667488 >> 172.21.15.17:0/4015667488 conn(0x7f15c00cfa00 msgr2=0x7f15c00af900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.231+0000 7f15c4a00640 1 -- 172.21.15.17:0/4015667488 shutdown_connections 2024-09-10T23:15:11.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.231+0000 7f15c4a00640 1 -- 172.21.15.17:0/4015667488 wait complete. 2024-09-10T23:15:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.307+0000 7f0fb7200640 1 -- 172.21.15.17:0/2991511059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb80ccd10 msgr2=0x7f0fb80cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.307+0000 7f0fb7200640 1 --2- 172.21.15.17:0/2991511059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb80ccd10 0x7f0fb80cc100 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80cf090 tx=0x7f0fa401c890 comp rx=0 tx=0).stop 2024-09-10T23:15:11.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.315+0000 7f0fb7200640 1 -- 172.21.15.17:0/2991511059 shutdown_connections 2024-09-10T23:15:11.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.315+0000 7f0fb7200640 1 --2- 172.21.15.17:0/2991511059 >> v2:172.21.15.17:3300/0 conn(0x7f0fb81457d0 0x7f0fb80cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.315+0000 7f0fb7200640 1 --2- 172.21.15.17:0/2991511059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb80ccd10 0x7f0fb80cc100 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.315+0000 7f0fb7200640 1 -- 172.21.15.17:0/2991511059 >> 172.21.15.17:0/2991511059 conn(0x7f0fb80cfa30 msgr2=0x7f0fb80cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.315+0000 7f0fb7200640 1 -- 172.21.15.17:0/2991511059 shutdown_connections 2024-09-10T23:15:11.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.315+0000 7f0fb7200640 1 -- 172.21.15.17:0/2991511059 wait complete. 2024-09-10T23:15:11.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.315+0000 7f0fb7200640 1 Processor -- start 2024-09-10T23:15:11.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb7200640 1 -- start start 2024-09-10T23:15:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb80ccd10 0x7f0fb8072b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fb81453f0 0x7f0fb8136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb81457d0 0x7f0fb81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8070860 con 0x7f0fb80ccd10 2024-09-10T23:15:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb80706e0 con 0x7f0fb81457d0 2024-09-10T23:15:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb8168950 con 0x7f0fb81453f0 2024-09-10T23:15:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb80ccd10 0x7f0fb8072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb80ccd10 0x7f0fb8072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52074/0 (socket says 172.21.15.17:52074) 2024-09-10T23:15:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5e00640 1 -- 172.21.15.17:0/540350316 learned_addr learned my addr 172.21.15.17:0/540350316 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5400640 1 --2- 172.21.15.17:0/540350316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fb81453f0 0x7f0fb8136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5400640 1 -- 172.21.15.17:0/540350316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb81457d0 msgr2=0x7f0fb81555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5400640 1 --2- 172.21.15.17:0/540350316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb81457d0 0x7f0fb81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5400640 1 -- 172.21.15.17:0/540350316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb80ccd10 msgr2=0x7f0fb8072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5400640 1 --2- 172.21.15.17:0/540350316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb80ccd10 0x7f0fb8072b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5400640 1 -- 172.21.15.17:0/540350316 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb8073050 con 0x7f0fb81453f0 2024-09-10T23:15:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.323+0000 7f0fb5400640 1 --2- 172.21.15.17:0/540350316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fb81453f0 0x7f0fb8136a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ac000 tx=0x7f0fa4004220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.333 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.331+0000 7f0fae000640 1 -- 172.21.15.17:0/540350316 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40b2040 con 0x7f0fb81453f0 2024-09-10T23:15:11.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.331+0000 7f0fae000640 1 -- 172.21.15.17:0/540350316 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fa4003710 con 0x7f0fb81453f0 2024-09-10T23:15:11.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.331+0000 7f0fae000640 1 -- 172.21.15.17:0/540350316 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4003b60 con 0x7f0fb81453f0 2024-09-10T23:15:11.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.331+0000 7f0fb7200640 1 -- 172.21.15.17:0/540350316 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb81ff5d0 con 0x7f0fb81453f0 2024-09-10T23:15:11.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.331+0000 7f0fae000640 1 -- 172.21.15.17:0/540350316 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0fa40b67f0 con 0x7f0fb81453f0 2024-09-10T23:15:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.335+0000 7f0fb7200640 1 -- 172.21.15.17:0/540350316 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb81ff8b0 con 0x7f0fb81453f0 2024-09-10T23:15:11.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.335+0000 7f0fb7200640 1 -- 172.21.15.17:0/540350316 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb80cf140 con 0x7f0fb81453f0 2024-09-10T23:15:11.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.335+0000 7f09e6c00640 1 -- 172.21.15.17:0/350639963 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f09d80565f0 con 0x7f09c80039c0 2024-09-10T23:15:11.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.339+0000 7f0fae000640 1 -- 172.21.15.17:0/540350316 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0fa40a5c30 con 0x7f0fb81453f0 2024-09-10T23:15:11.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.339+0000 7f0fae000640 1 -- 172.21.15.17:0/540350316 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0fa40c6080 con 0x7f0fb81453f0 2024-09-10T23:15:11.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.363+0000 7f09d3e00640 1 -- 172.21.15.17:0/350639963 <== mon.2 v2:172.21.15.77:3301/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f09cc0b8420 con 0x7f09c80039c0 2024-09-10T23:15:11.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.371+0000 7f09e6c00640 1 -- 172.21.15.17:0/350639963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c80039c0 msgr2=0x7f09d80e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.371+0000 7f09e6c00640 1 --2- 172.21.15.17:0/350639963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c80039c0 0x7f09d80e9f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f09c800c360 tx=0x7f09c8005840 comp rx=0 tx=0).stop 2024-09-10T23:15:11.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.371+0000 7f09e6c00640 1 -- 172.21.15.17:0/350639963 shutdown_connections 2024-09-10T23:15:11.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.371+0000 7f09e6c00640 1 --2- 172.21.15.17:0/350639963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09d804d8a0 0x7f09d804dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.371+0000 7f09e6c00640 1 --2- 172.21.15.17:0/350639963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09d80e7cc0 0x7f09d80da980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.371+0000 7f09e6c00640 1 --2- 172.21.15.17:0/350639963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c80039c0 0x7f09d80e9f40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.371+0000 7f09e6c00640 1 -- 172.21.15.17:0/350639963 >> 172.21.15.17:0/350639963 conn(0x7f09d8058900 msgr2=0x7f09d803a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.383+0000 7f09e6c00640 1 -- 172.21.15.17:0/350639963 shutdown_connections 2024-09-10T23:15:11.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.383+0000 7f09e6c00640 1 -- 172.21.15.17:0/350639963 wait complete. 2024-09-10T23:15:11.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.395+0000 7f6befe00640 1 -- 172.21.15.17:0/805882411 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f6bd8005860 con 0x7f6c0406e520 2024-09-10T23:15:11.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.403+0000 7f6bfaa00640 1 -- 172.21.15.17:0/805882411 <== mon.2 v2:172.21.15.77:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f6bfc014030 con 0x7f6c0406e520 2024-09-10T23:15:11.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.403+0000 7f6befe00640 1 -- 172.21.15.17:0/805882411 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c0406e520 msgr2=0x7f6c04156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.403+0000 7f6befe00640 1 --2- 172.21.15.17:0/805882411 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c0406e520 0x7f6c04156180 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00ccb0 tx=0x7f6bfc00a620 comp rx=0 tx=0).stop 2024-09-10T23:15:11.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.403+0000 7f6befe00640 1 -- 172.21.15.17:0/805882411 shutdown_connections 2024-09-10T23:15:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.403+0000 7f6befe00640 1 --2- 172.21.15.17:0/805882411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c0415bae0 0x7f6c040c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.407+0000 7f6befe00640 1 --2- 172.21.15.17:0/805882411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c040709a0 0x7f6c040c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.407+0000 7f6befe00640 1 --2- 172.21.15.17:0/805882411 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c0406e520 0x7f6c04156180 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.407+0000 7f6befe00640 1 -- 172.21.15.17:0/805882411 >> 172.21.15.17:0/805882411 conn(0x7f6c040cfa00 msgr2=0x7f6c040ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.407+0000 7f6befe00640 1 -- 172.21.15.17:0/805882411 shutdown_connections 2024-09-10T23:15:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.407+0000 7f6befe00640 1 -- 172.21.15.17:0/805882411 wait complete. 2024-09-10T23:15:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.431+0000 7fe397200640 1 -- 172.21.15.17:0/3806561301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe37c0053d0 msgr2=0x7fe37c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.431+0000 7fe397200640 1 --2- 172.21.15.17:0/3806561301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe37c0053d0 0x7fe37c00b9d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe3980b2f50 tx=0x7fe39001c950 comp rx=0 tx=0).stop 2024-09-10T23:15:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.439+0000 7fe397200640 1 -- 172.21.15.17:0/3806561301 shutdown_connections 2024-09-10T23:15:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.439+0000 7fe397200640 1 --2- 172.21.15.17:0/3806561301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe37c0053d0 0x7fe37c00b9d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.439+0000 7fe397200640 1 -- 172.21.15.17:0/3806561301 >> 172.21.15.17:0/3806561301 conn(0x7fe3980cfa30 msgr2=0x7fe3980cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.439+0000 7fe397200640 1 -- 172.21.15.17:0/3806561301 shutdown_connections 2024-09-10T23:15:11.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.439+0000 7fe397200640 1 -- 172.21.15.17:0/3806561301 wait complete. 2024-09-10T23:15:11.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.443+0000 7fe397200640 1 Processor -- start 2024-09-10T23:15:11.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.447+0000 7fe397200640 1 -- start start 2024-09-10T23:15:11.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe397200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe37c0053d0 0x7fe39813c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe397200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3981e8540 0x7fe398200b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe397200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe39815e6d0 0x7fe39806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe395e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe37c0053d0 0x7fe39813c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe395e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe37c0053d0 0x7fe39813c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:39890/0 (socket says 172.21.15.17:39890) 2024-09-10T23:15:11.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe396800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe39815e6d0 0x7fe39806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe396800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe39815e6d0 0x7fe39806fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52120/0 (socket says 172.21.15.17:52120) 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe395e00640 1 -- 172.21.15.17:0/542040518 learned_addr learned my addr 172.21.15.17:0/542040518 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe39815f230 con 0x7fe39815e6d0 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe39815f0b0 con 0x7fe37c0053d0 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe39815f3b0 con 0x7fe3981e8540 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe395e00640 1 -- 172.21.15.17:0/542040518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3981e8540 msgr2=0x7fe398200b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe395e00640 1 --2- 172.21.15.17:0/542040518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3981e8540 0x7fe398200b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe395e00640 1 -- 172.21.15.17:0/542040518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe39815e6d0 msgr2=0x7fe39806fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe395e00640 1 --2- 172.21.15.17:0/542040518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe39815e6d0 0x7fe39806fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe395e00640 1 -- 172.21.15.17:0/542040518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3981e8a40 con 0x7fe37c0053d0 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.451+0000 7fe395e00640 1 --2- 172.21.15.17:0/542040518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe37c0053d0 0x7fe39813c6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe38800f960 tx=0x7fe38800fe20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.455+0000 7fe38e000640 1 -- 172.21.15.17:0/542040518 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38801d070 con 0x7fe37c0053d0 2024-09-10T23:15:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.455+0000 7fe38e000640 1 -- 172.21.15.17:0/542040518 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe38800dd30 con 0x7fe37c0053d0 2024-09-10T23:15:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.455+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3981e8d20 con 0x7fe37c0053d0 2024-09-10T23:15:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.455+0000 7fe38e000640 1 -- 172.21.15.17:0/542040518 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38801d070 con 0x7fe37c0053d0 2024-09-10T23:15:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.455+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39813fc10 con 0x7fe37c0053d0 2024-09-10T23:15:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.455+0000 7fe38e000640 1 -- 172.21.15.17:0/542040518 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe388018440 con 0x7fe37c0053d0 2024-09-10T23:15:11.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.455+0000 7fe38e000640 1 -- 172.21.15.17:0/542040518 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe38800db30 con 0x7fe37c0053d0 2024-09-10T23:15:11.461 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f6a98600640 1 -- 172.21.15.17:0/962286626 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a90073ce0 msgr2=0x7f6a900ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f6a98600640 1 --2- 172.21.15.17:0/962286626 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a90073ce0 0x7f6a900ca7e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009bc0 tx=0x7f6a8801cb40 comp rx=0 tx=0).stop 2024-09-10T23:15:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f6a98600640 1 -- 172.21.15.17:0/962286626 shutdown_connections 2024-09-10T23:15:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f6a98600640 1 --2- 172.21.15.17:0/962286626 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a90073ce0 0x7f6a900ca7e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f6a98600640 1 --2- 172.21.15.17:0/962286626 >> v2:172.21.15.17:3300/0 conn(0x7f6a9015aa60 0x7f6a900cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f6a98600640 1 -- 172.21.15.17:0/962286626 >> 172.21.15.17:0/962286626 conn(0x7f6a900cfa00 msgr2=0x7f6a900cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3700052a0 con 0x7fe37c0053d0 2024-09-10T23:15:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f1df4200640 1 -- 172.21.15.17:0/2242085589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dec073300 msgr2=0x7f1dec073750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f1df4200640 1 --2- 172.21.15.17:0/2242085589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dec073300 0x7f1dec073750 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dec0b2840 tx=0x7f1de401f390 comp rx=0 tx=0).stop 2024-09-10T23:15:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f1df4200640 1 -- 172.21.15.17:0/2242085589 shutdown_connections 2024-09-10T23:15:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f1df4200640 1 --2- 172.21.15.17:0/2242085589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dec073300 0x7f1dec073750 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f1df4200640 1 --2- 172.21.15.17:0/2242085589 >> v2:172.21.15.17:3300/0 conn(0x7f1dec074560 0x7f1dec072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f1df4200640 1 -- 172.21.15.17:0/2242085589 >> 172.21.15.17:0/2242085589 conn(0x7f1dec0b17a0 msgr2=0x7f1dec0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f1df4200640 1 -- 172.21.15.17:0/2242085589 shutdown_connections 2024-09-10T23:15:11.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7f1df4200640 1 -- 172.21.15.17:0/2242085589 wait complete. 2024-09-10T23:15:11.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.463+0000 7f6a98600640 1 -- 172.21.15.17:0/962286626 shutdown_connections 2024-09-10T23:15:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.463+0000 7f6a98600640 1 -- 172.21.15.17:0/962286626 wait complete. 2024-09-10T23:15:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.463+0000 7f6a98600640 1 Processor -- start 2024-09-10T23:15:11.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.463+0000 7f1df4200640 1 Processor -- start 2024-09-10T23:15:11.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.467+0000 7f1df4200640 1 -- start start 2024-09-10T23:15:11.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.459+0000 7fe38e000640 1 -- 172.21.15.17:0/542040518 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe388010430 con 0x7fe37c0053d0 2024-09-10T23:15:11.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a98600640 1 -- start start 2024-09-10T23:15:11.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df4200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec073300 0x7f1dec15f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df4200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dec074180 0x7f1dec0aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df4200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dec074560 0x7f1dec0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df4200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec159510 con 0x7f1dec074180 2024-09-10T23:15:11.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df4200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec159390 con 0x7f1dec074560 2024-09-10T23:15:11.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df4200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1dec159690 con 0x7f1dec073300 2024-09-10T23:15:11.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df1800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec073300 0x7f1dec15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df1800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec073300 0x7f1dec15f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:53466/0 (socket says 172.21.15.17:53466) 2024-09-10T23:15:11.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df1800640 1 -- 172.21.15.17:0/3336174488 learned_addr learned my addr 172.21.15.17:0/3336174488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df2200640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dec074560 0x7f1dec0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a98600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a90073ce0 0x7f6a9014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a98600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cf4b0 0x7f6a901666c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df0e00640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dec074180 0x7f1dec0aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df2200640 1 -- 172.21.15.17:0/3336174488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec073300 msgr2=0x7f1dec15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df2200640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec073300 0x7f1dec15f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df2200640 1 -- 172.21.15.17:0/3336174488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dec074180 msgr2=0x7f1dec0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df2200640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dec074180 0x7f1dec0aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df2200640 1 -- 172.21.15.17:0/3336174488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dec15e9c0 con 0x7f1dec074560 2024-09-10T23:15:11.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df1800640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec073300 0x7f1dec15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:11.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a98600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a9015aa60 0x7f6a9014be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a98600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a90165830 con 0x7f6a900cf4b0 2024-09-10T23:15:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a98600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a901656b0 con 0x7f6a90073ce0 2024-09-10T23:15:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a98600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a901659b0 con 0x7f6a9015aa60 2024-09-10T23:15:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a96600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a9015aa60 0x7f6a9014be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a95200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cf4b0 0x7f6a901666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a96600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a9015aa60 0x7f6a9014be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:53480/0 (socket says 172.21.15.17:53480) 2024-09-10T23:15:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a96600640 1 -- 172.21.15.17:0/1227267143 learned_addr learned my addr 172.21.15.17:0/1227267143 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a95c00640 1 --2- 172.21.15.17:0/1227267143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a90073ce0 0x7f6a9014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df2200640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dec074560 0x7f1dec0a9450 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009000 tx=0x7f1de40b08f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1de9600640 1 -- 172.21.15.17:0/3336174488 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de40b4070 con 0x7f1dec074560 2024-09-10T23:15:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1de9600640 1 -- 172.21.15.17:0/3336174488 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1de40b5040 con 0x7f1dec074560 2024-09-10T23:15:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a95c00640 1 -- 172.21.15.17:0/1227267143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a9015aa60 msgr2=0x7f6a9014be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a95c00640 1 --2- 172.21.15.17:0/1227267143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a9015aa60 0x7f6a9014be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a95c00640 1 -- 172.21.15.17:0/1227267143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cf4b0 msgr2=0x7f6a901666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a95c00640 1 --2- 172.21.15.17:0/1227267143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cf4b0 0x7f6a901666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a95c00640 1 -- 172.21.15.17:0/1227267143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a90166c00 con 0x7f6a90073ce0 2024-09-10T23:15:11.483 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f6a95c00640 1 --2- 172.21.15.17:0/1227267143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a90073ce0 0x7f6a9014cb20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400b410 tx=0x7f6a8400b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1de9600640 1 -- 172.21.15.17:0/3336174488 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4003980 con 0x7f1dec074560 2024-09-10T23:15:11.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df4200640 1 -- 172.21.15.17:0/3336174488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dec15eca0 con 0x7f1dec074560 2024-09-10T23:15:11.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.475+0000 7f1df4200640 1 -- 172.21.15.17:0/3336174488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dec15f260 con 0x7f1dec074560 2024-09-10T23:15:11.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f1de9600640 1 -- 172.21.15.17:0/3336174488 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f1de40b03b0 con 0x7f1dec074560 2024-09-10T23:15:11.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f1de9600640 1 -- 172.21.15.17:0/3336174488 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1de40bb7c0 con 0x7f1dec074560 2024-09-10T23:15:11.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f6a8d600640 1 -- 172.21.15.17:0/1227267143 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84015020 con 0x7f6a90073ce0 2024-09-10T23:15:11.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f6a8d600640 1 -- 172.21.15.17:0/1227267143 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a84011920 con 0x7f6a90073ce0 2024-09-10T23:15:11.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f6a98600640 1 -- 172.21.15.17:0/1227267143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9014c840 con 0x7f6a90073ce0 2024-09-10T23:15:11.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f1df4200640 1 -- 172.21.15.17:0/3336174488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dec15f460 con 0x7f1dec074560 2024-09-10T23:15:11.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f6a8d600640 1 -- 172.21.15.17:0/1227267143 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84011d70 con 0x7f6a90073ce0 2024-09-10T23:15:11.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f6a98600640 1 -- 172.21.15.17:0/1227267143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a900b3490 con 0x7f6a90073ce0 2024-09-10T23:15:11.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f6a8d600640 1 -- 172.21.15.17:0/1227267143 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f6a8401a790 con 0x7f6a90073ce0 2024-09-10T23:15:11.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.479+0000 7f6a8d600640 1 -- 172.21.15.17:0/1227267143 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6a84019ba0 con 0x7f6a90073ce0 2024-09-10T23:15:11.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.483+0000 7f1de9600640 1 -- 172.21.15.17:0/3336174488 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f1dec15f460 con 0x7f1dec074560 2024-09-10T23:15:11.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.487+0000 7f6a82a00640 1 -- 172.21.15.17:0/1227267143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c0052a0 con 0x7f6a90073ce0 2024-09-10T23:15:11.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.491+0000 7f6a8d600640 1 -- 172.21.15.17:0/1227267143 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f6a8401f020 con 0x7f6a90073ce0 2024-09-10T23:15:11.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.519+0000 7f0fb7200640 1 -- 172.21.15.17:0/540350316 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f0fb80b1240 con 0x7f0fb81453f0 2024-09-10T23:15:11.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.523+0000 7fc713e00640 1 -- 172.21.15.17:0/663655740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7140cd930 msgr2=0x7fc7141582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.523+0000 7fc713e00640 1 --2- 172.21.15.17:0/663655740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7140cd930 0x7fc7141582e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009840 tx=0x7fc6fc01c530 comp rx=0 tx=0).stop 2024-09-10T23:15:11.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.523+0000 7fc713e00640 1 -- 172.21.15.17:0/663655740 shutdown_connections 2024-09-10T23:15:11.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.523+0000 7fc713e00640 1 --2- 172.21.15.17:0/663655740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7140cd930 0x7fc7141582e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.523+0000 7fc713e00640 1 -- 172.21.15.17:0/663655740 >> 172.21.15.17:0/663655740 conn(0x7fc7140cfa30 msgr2=0x7fc7140cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.523+0000 7fc713e00640 1 -- 172.21.15.17:0/663655740 shutdown_connections 2024-09-10T23:15:11.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.523+0000 7fc713e00640 1 -- 172.21.15.17:0/663655740 wait complete. 2024-09-10T23:15:11.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.527+0000 7fc713e00640 1 Processor -- start 2024-09-10T23:15:11.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.527+0000 7fc713e00640 1 -- start start 2024-09-10T23:15:11.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7f0fae000640 1 -- 172.21.15.17:0/540350316 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f0fa40164b0 con 0x7f0fb81453f0 2024-09-10T23:15:11.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7140cd930 0x7fc714159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc714157f00 0x7fc7141fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc71415f510 0x7fc7141ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc71415fb00 con 0x7fc71415f510 2024-09-10T23:15:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc71415f980 con 0x7fc7140cd930 2024-09-10T23:15:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc71415fc80 con 0x7fc714157f00 2024-09-10T23:15:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc71415f510 0x7fc7141ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc712a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7140cd930 0x7fc714159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc71415f510 0x7fc7141ff180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52140/0 (socket says 172.21.15.17:52140) 2024-09-10T23:15:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713400640 1 -- 172.21.15.17:0/3732482394 learned_addr learned my addr 172.21.15.17:0/3732482394 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc70a000640 1 --2- 172.21.15.17:0/3732482394 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc714157f00 0x7fc7141fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713400640 1 -- 172.21.15.17:0/3732482394 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc714157f00 msgr2=0x7fc7141fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713400640 1 --2- 172.21.15.17:0/3732482394 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc714157f00 0x7fc7141fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713400640 1 -- 172.21.15.17:0/3732482394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7140cd930 msgr2=0x7fc714159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713400640 1 --2- 172.21.15.17:0/3732482394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7140cd930 0x7fc714159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713400640 1 -- 172.21.15.17:0/3732482394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7141448c0 con 0x7fc71415f510 2024-09-10T23:15:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.531+0000 7fc713400640 1 --2- 172.21.15.17:0/3732482394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc71415f510 0x7fc7141ff180 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00caa0 tx=0x7fc70c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.535+0000 7fc70be00640 1 -- 172.21.15.17:0/3732482394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c017070 con 0x7fc71415f510 2024-09-10T23:15:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.535+0000 7fc713e00640 1 -- 172.21.15.17:0/3732482394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc714070510 con 0x7fc71415f510 2024-09-10T23:15:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.535+0000 7fc713e00640 1 -- 172.21.15.17:0/3732482394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71415c830 con 0x7fc71415f510 2024-09-10T23:15:11.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.535+0000 7fc70be00640 1 -- 172.21.15.17:0/3732482394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc70c005070 con 0x7fc71415f510 2024-09-10T23:15:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.535+0000 7fc70be00640 1 -- 172.21.15.17:0/3732482394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c017070 con 0x7fc71415f510 2024-09-10T23:15:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7fc713e00640 1 -- 172.21.15.17:0/3732482394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e80052a0 con 0x7fc71415f510 2024-09-10T23:15:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7fc70be00640 1 -- 172.21.15.17:0/3732482394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc70c005220 con 0x7fc71415f510 2024-09-10T23:15:11.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7fc70be00640 1 -- 172.21.15.17:0/3732482394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc70c007360 con 0x7fc71415f510 2024-09-10T23:15:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f0fb7200640 1 -- 172.21.15.17:0/540350316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fb81453f0 msgr2=0x7f0fb8136a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f0fb7200640 1 --2- 172.21.15.17:0/540350316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fb81453f0 0x7f0fb8136a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ac000 tx=0x7f0fa4004220 comp rx=0 tx=0).stop 2024-09-10T23:15:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f0fb7200640 1 -- 172.21.15.17:0/540350316 shutdown_connections 2024-09-10T23:15:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f0fb7200640 1 --2- 172.21.15.17:0/540350316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb81457d0 0x7f0fb81555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f0fb7200640 1 --2- 172.21.15.17:0/540350316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fb81453f0 0x7f0fb8136a20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f0fb7200640 1 --2- 172.21.15.17:0/540350316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fb80ccd10 0x7f0fb8072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f0fb7200640 1 -- 172.21.15.17:0/540350316 >> 172.21.15.17:0/540350316 conn(0x7f0fb80cfa30 msgr2=0x7f0fb8143fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f0fb7200640 1 -- 172.21.15.17:0/540350316 shutdown_connections 2024-09-10T23:15:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f0fb7200640 1 -- 172.21.15.17:0/540350316 wait complete. 2024-09-10T23:15:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.539+0000 7f27fe200640 1 -- 172.21.15.17:0/1225078236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f815e670 msgr2=0x7f27f80cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.543+0000 7f27fe200640 1 --2- 172.21.15.17:0/1225078236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f815e670 0x7f27f80cd5d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009c80 tx=0x7f27f001cd90 comp rx=0 tx=0).stop 2024-09-10T23:15:11.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.543+0000 7f27fe200640 1 -- 172.21.15.17:0/1225078236 shutdown_connections 2024-09-10T23:15:11.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.543+0000 7f27fe200640 1 --2- 172.21.15.17:0/1225078236 >> v2:172.21.15.17:3300/0 conn(0x7f27f80cdfe0 0x7f27f80ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.543+0000 7f27fe200640 1 --2- 172.21.15.17:0/1225078236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f815e670 0x7f27f80cd5d0 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009c80 tx=0x7f27f001cd90 comp rx=0 tx=0).stop 2024-09-10T23:15:11.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.543+0000 7f27fe200640 1 -- 172.21.15.17:0/1225078236 >> 172.21.15.17:0/1225078236 conn(0x7f27f80cfa00 msgr2=0x7f27f80cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.555+0000 7f27fe200640 1 -- 172.21.15.17:0/1225078236 shutdown_connections 2024-09-10T23:15:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.555+0000 7f27fe200640 1 -- 172.21.15.17:0/1225078236 wait complete. 2024-09-10T23:15:11.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.555+0000 7f27fe200640 1 Processor -- start 2024-09-10T23:15:11.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27fe200640 1 -- start start 2024-09-10T23:15:11.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27fe200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f8073b40 0x7f27f815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27fe200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27f80cdfe0 0x7f27f8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27fe200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27f80b2870 0x7f27f80b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27fe200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f27f80ad9f0 con 0x7f27f80b2870 2024-09-10T23:15:11.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27fe200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f27f80ad870 con 0x7f27f80cdfe0 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27fe200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f27f80adb70 con 0x7f27f8073b40 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f8073b40 0x7f27f815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f8073b40 0x7f27f815b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:53512/0 (socket says 172.21.15.17:53512) 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f7400640 1 -- 172.21.15.17:0/1440638831 learned_addr learned my addr 172.21.15.17:0/1440638831 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f6a00640 1 --2- 172.21.15.17:0/1440638831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27f80cdfe0 0x7f27f8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f7400640 1 -- 172.21.15.17:0/1440638831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27f80cdfe0 msgr2=0x7f27f8159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f7400640 1 --2- 172.21.15.17:0/1440638831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27f80cdfe0 0x7f27f8159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f7400640 1 -- 172.21.15.17:0/1440638831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27f80b2870 msgr2=0x7f27f80b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f7400640 1 --2- 172.21.15.17:0/1440638831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27f80b2870 0x7f27f80b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f7400640 1 -- 172.21.15.17:0/1440638831 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f815a520 con 0x7f27f8073b40 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27f7400640 1 --2- 172.21.15.17:0/1440638831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f8073b40 0x7f27f815b180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009bd0 tx=0x7f27f00ae600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.563+0000 7f27ef400640 1 -- 172.21.15.17:0/1440638831 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00b2040 con 0x7f27f8073b40 2024-09-10T23:15:11.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.567+0000 7f27ef400640 1 -- 172.21.15.17:0/1440638831 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27f0003a70 con 0x7f27f8073b40 2024-09-10T23:15:11.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.567+0000 7f27ef400640 1 -- 172.21.15.17:0/1440638831 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0003e60 con 0x7f27f8073b40 2024-09-10T23:15:11.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.567+0000 7f27fe200640 1 -- 172.21.15.17:0/1440638831 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f815a7c0 con 0x7f27f8073b40 2024-09-10T23:15:11.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.567+0000 7f27fe200640 1 -- 172.21.15.17:0/1440638831 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f8205240 con 0x7f27f8073b40 2024-09-10T23:15:11.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.571+0000 7f27ef400640 1 -- 172.21.15.17:0/1440638831 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f27f00b5070 con 0x7f27f8073b40 2024-09-10T23:15:11.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.571+0000 7f27ef400640 1 -- 172.21.15.17:0/1440638831 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f27f0004370 con 0x7f27f8073b40 2024-09-10T23:15:11.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.575+0000 7fc70be00640 1 -- 172.21.15.17:0/3732482394 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fc70c005770 con 0x7fc71415f510 2024-09-10T23:15:11.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.575+0000 7f27fe200640 1 -- 172.21.15.17:0/1440638831 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f80cd5d0 con 0x7f27f8073b40 2024-09-10T23:15:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7f3b44a00640 1 -- 172.21.15.17:0/167702683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b4015ed50 msgr2=0x7f3b40073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7f3b44a00640 1 --2- 172.21.15.17:0/167702683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b4015ed50 0x7f3b40073990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b40073680 tx=0x7f3b2c01c840 comp rx=0 tx=0).stop 2024-09-10T23:15:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7f78a1c00640 1 -- 172.21.15.17:0/2483899506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15f0c0 msgr2=0x7f789c072500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7f78a1c00640 1 --2- 172.21.15.17:0/2483899506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15f0c0 0x7f789c072500 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f788c009840 tx=0x7f788c01c840 comp rx=0 tx=0).stop 2024-09-10T23:15:11.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7fdb6f000640 1 -- 172.21.15.17:0/1256961162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 msgr2=0x7fdb6001ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7fdb67e00640 1 -- 172.21.15.17:0/1256961162 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540b7620 con 0x7fdb600e30f0 2024-09-10T23:15:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7fdb6f000640 1 --2- 172.21.15.17:0/1256961162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 0x7fdb6001ccb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdb54013f30 tx=0x7fdb540275b0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7ff1ca800640 1 -- 172.21.15.17:0/3118143784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 msgr2=0x7ff1a800cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7fdb6f000640 1 -- 172.21.15.17:0/1256961162 shutdown_connections 2024-09-10T23:15:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7ff1ca800640 1 --2- 172.21.15.17:0/3118143784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 0x7ff1a800cae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00c5c0 tx=0x7ff1bc01d2e0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7fdb6f000640 1 --2- 172.21.15.17:0/1256961162 >> v2:172.21.15.17:3300/0 conn(0x7fdb6001d1f0 0x7fdb60009b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7fdb6f000640 1 --2- 172.21.15.17:0/1256961162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 0x7fdb6001ccb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7f78a1c00640 1 -- 172.21.15.17:0/2483899506 shutdown_connections 2024-09-10T23:15:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7f78a1c00640 1 --2- 172.21.15.17:0/2483899506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15f0c0 0x7f789c072500 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7f78a1c00640 1 --2- 172.21.15.17:0/2483899506 >> v2:172.21.15.77:3300/0 conn(0x7f789c15e850 0x7f789c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7f78a1c00640 1 -- 172.21.15.17:0/2483899506 >> 172.21.15.17:0/2483899506 conn(0x7f789c0cfa30 msgr2=0x7f789c0cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7f27ef400640 1 -- 172.21.15.17:0/1440638831 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f27f00169b0 con 0x7f27f8073b40 2024-09-10T23:15:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7ff1ca800640 1 -- 172.21.15.17:0/3118143784 shutdown_connections 2024-09-10T23:15:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7ff1ca800640 1 --2- 172.21.15.17:0/3118143784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 0x7ff1a800cae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7ff1ca800640 1 -- 172.21.15.17:0/3118143784 >> 172.21.15.17:0/3118143784 conn(0x7ff1c40b17a0 msgr2=0x7ff1c40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.579+0000 7fdb6f000640 1 -- 172.21.15.17:0/1256961162 >> 172.21.15.17:0/1256961162 conn(0x7fdb600511c0 msgr2=0x7fdb600515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7fdb6f000640 1 -- 172.21.15.17:0/1256961162 shutdown_connections 2024-09-10T23:15:11.588 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7f78a1c00640 1 -- 172.21.15.17:0/2483899506 shutdown_connections 2024-09-10T23:15:11.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7f78a1c00640 1 -- 172.21.15.17:0/2483899506 wait complete. 2024-09-10T23:15:11.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7f78a1c00640 1 Processor -- start 2024-09-10T23:15:11.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7f3b44a00640 1 -- 172.21.15.17:0/167702683 shutdown_connections 2024-09-10T23:15:11.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7f3b44a00640 1 --2- 172.21.15.17:0/167702683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b4015ed50 0x7f3b40073990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7f3b44a00640 1 -- 172.21.15.17:0/167702683 >> 172.21.15.17:0/167702683 conn(0x7f3b400cfa00 msgr2=0x7f3b400cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7ff1ca800640 1 -- 172.21.15.17:0/3118143784 shutdown_connections 2024-09-10T23:15:11.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7f3b44a00640 1 -- 172.21.15.17:0/167702683 shutdown_connections 2024-09-10T23:15:11.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7f3b44a00640 1 -- 172.21.15.17:0/167702683 wait complete. 2024-09-10T23:15:11.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f78a1c00640 1 -- start start 2024-09-10T23:15:11.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f78a1c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f789c15e850 0x7f789c145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.583+0000 7fdb6f000640 1 -- 172.21.15.17:0/1256961162 wait complete. 2024-09-10T23:15:11.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f78a1c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15ec30 0x7f789c0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f78a1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789c15f0c0 0x7f789c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f78a1c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f789c16b330 con 0x7f789c15f0c0 2024-09-10T23:15:11.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f78a1c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f789c16b1b0 con 0x7f789c15e850 2024-09-10T23:15:11.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f78a1c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f789c16b4b0 con 0x7f789c15ec30 2024-09-10T23:15:11.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7fdb6f000640 1 Processor -- start 2024-09-10T23:15:11.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789b400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15ec30 0x7f789c0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789b400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15ec30 0x7f789c0b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:53542/0 (socket says 172.21.15.17:53542) 2024-09-10T23:15:11.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789b400640 1 -- 172.21.15.17:0/2667124481 learned_addr learned my addr 172.21.15.17:0/2667124481 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f78a1200640 1 --2- 172.21.15.17:0/2667124481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789c15f0c0 0x7f789c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f3b44a00640 1 Processor -- start 2024-09-10T23:15:11.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789be00640 1 --2- 172.21.15.17:0/2667124481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f789c15e850 0x7f789c145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789b400640 1 -- 172.21.15.17:0/2667124481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f789c15e850 msgr2=0x7f789c145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789b400640 1 --2- 172.21.15.17:0/2667124481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f789c15e850 0x7f789c145370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789b400640 1 -- 172.21.15.17:0/2667124481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789c15f0c0 msgr2=0x7f789c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789b400640 1 --2- 172.21.15.17:0/2667124481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789c15f0c0 0x7f789c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789b400640 1 -- 172.21.15.17:0/2667124481 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789c1fc090 con 0x7f789c15ec30 2024-09-10T23:15:11.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.587+0000 7f789b400640 1 --2- 172.21.15.17:0/2667124481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15ec30 0x7f789c0b4580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f788800c4e0 tx=0x7f788800c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f7893e00640 1 -- 172.21.15.17:0/2667124481 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78880052d0 con 0x7f789c15ec30 2024-09-10T23:15:11.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f7893e00640 1 -- 172.21.15.17:0/2667124481 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7888005470 con 0x7f789c15ec30 2024-09-10T23:15:11.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7fdb6f000640 1 -- start start 2024-09-10T23:15:11.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f3b44a00640 1 -- start start 2024-09-10T23:15:11.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7ff1ca800640 1 -- 172.21.15.17:0/3118143784 wait complete. 2024-09-10T23:15:11.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f3b44a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b400aee90 0x7f3b4016cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f3b44a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b4015b650 0x7f3b40157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7ff1ca800640 1 Processor -- start 2024-09-10T23:15:11.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7ff1ca800640 1 -- start start 2024-09-10T23:15:11.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f3b44a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b4015ed50 0x7f3b40155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f3b3de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b400aee90 0x7f3b4016cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f3b3de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b400aee90 0x7f3b4016cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:53554/0 (socket says 172.21.15.17:53554) 2024-09-10T23:15:11.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f3b3d400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b4015b650 0x7f3b40157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f3b3d400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b4015b650 0x7f3b40157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:39994/0 (socket says 172.21.15.17:39994) 2024-09-10T23:15:11.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7f3b3e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b4015ed50 0x7f3b40155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b3e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b4015ed50 0x7f3b40155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52196/0 (socket says 172.21.15.17:52196) 2024-09-10T23:15:11.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.591+0000 7fdb6f000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb6000bbe0 0x7fdb60176310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6f000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 0x7fdb6004aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6f000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb600deb80 0x7fdb60038ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6f000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6000a420 con 0x7fdb600deb80 2024-09-10T23:15:11.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6f000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6000a2a0 con 0x7fdb6000bbe0 2024-09-10T23:15:11.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6f000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdb600361c0 con 0x7fdb600e30f0 2024-09-10T23:15:11.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 0x7fdb6004aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6dc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb6000bbe0 0x7fdb60176310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 0x7fdb6004aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:53564/0 (socket says 172.21.15.17:53564) 2024-09-10T23:15:11.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6d200640 1 -- 172.21.15.17:0/571276661 learned_addr learned my addr 172.21.15.17:0/571276661 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6d200640 1 -- 172.21.15.17:0/571276661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb6000bbe0 msgr2=0x7fdb60176310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6d200640 1 --2- 172.21.15.17:0/571276661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb6000bbe0 0x7fdb60176310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6d200640 1 -- 172.21.15.17:0/571276661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb600deb80 msgr2=0x7fdb60038ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6d200640 1 --2- 172.21.15.17:0/571276661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb600deb80 0x7fdb60038ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6d200640 1 -- 172.21.15.17:0/571276661 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb60048510 con 0x7fdb600e30f0 2024-09-10T23:15:11.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6d200640 1 --2- 172.21.15.17:0/571276661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 0x7fdb6004aaf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdb540251e0 tx=0x7fdb540b7530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 0x7ff1c4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c40cc580 0x7ff1c413bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1ca800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c415c8a0 0x7ff1c414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1c3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 0x7ff1c4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1c3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 0x7ff1c4138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:40024/0 (socket says 172.21.15.17:40024) 2024-09-10T23:15:11.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1ca800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c413f660 con 0x7ff1c40cc580 2024-09-10T23:15:11.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1ca800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4072b20 con 0x7ff1a80053d0 2024-09-10T23:15:11.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1ca800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c413f7e0 con 0x7ff1c415c8a0 2024-09-10T23:15:11.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1c3400640 1 -- 172.21.15.17:0/2680277681 learned_addr learned my addr 172.21.15.17:0/2680277681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7ff1c3e00640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c415c8a0 0x7ff1c414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1c3400640 1 -- 172.21.15.17:0/2680277681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c415c8a0 msgr2=0x7ff1c414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1c3400640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c415c8a0 0x7ff1c414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1c3400640 1 -- 172.21.15.17:0/2680277681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c40cc580 msgr2=0x7ff1c413bdd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T23:15:11.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f7893e00640 1 -- 172.21.15.17:0/2667124481 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888012890 con 0x7f789c15ec30 2024-09-10T23:15:11.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f78a1c00640 1 -- 172.21.15.17:0/2667124481 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789c1fb2d0 con 0x7f789c15ec30 2024-09-10T23:15:11.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f78a1c00640 1 -- 172.21.15.17:0/2667124481 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f789c1fb890 con 0x7f789c15ec30 2024-09-10T23:15:11.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb65600640 1 -- 172.21.15.17:0/571276661 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54004240 con 0x7fdb600e30f0 2024-09-10T23:15:11.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6f000640 1 -- 172.21.15.17:0/571276661 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb600487f0 con 0x7fdb600e30f0 2024-09-10T23:15:11.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7fdb6f000640 1 -- 172.21.15.17:0/571276661 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb60048db0 con 0x7fdb600e30f0 2024-09-10T23:15:11.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7fdb65600640 1 -- 172.21.15.17:0/571276661 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb540043e0 con 0x7fdb600e30f0 2024-09-10T23:15:11.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7fdb65600640 1 -- 172.21.15.17:0/571276661 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54004240 con 0x7fdb600e30f0 2024-09-10T23:15:11.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7fdb65600640 1 -- 172.21.15.17:0/571276661 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdb540d4060 con 0x7fdb600e30f0 2024-09-10T23:15:11.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7fdb65600640 1 -- 172.21.15.17:0/571276661 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb54004040 con 0x7fdb600e30f0 2024-09-10T23:15:11.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f78a1c00640 1 -- 172.21.15.17:0/2667124481 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f789c0cd930 con 0x7f789c15ec30 2024-09-10T23:15:11.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b44a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40170780 con 0x7f3b4015ed50 2024-09-10T23:15:11.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b44a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40170600 con 0x7f3b4015b650 2024-09-10T23:15:11.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b44a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3b40170900 con 0x7f3b400aee90 2024-09-10T23:15:11.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b3de00640 1 -- 172.21.15.17:0/2288318202 learned_addr learned my addr 172.21.15.17:0/2288318202 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b3d400640 1 -- 172.21.15.17:0/2288318202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b400aee90 msgr2=0x7f3b4016cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b3d400640 1 --2- 172.21.15.17:0/2288318202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b400aee90 0x7f3b4016cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b3d400640 1 -- 172.21.15.17:0/2288318202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b4015ed50 msgr2=0x7f3b40155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b3d400640 1 --2- 172.21.15.17:0/2288318202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b4015ed50 0x7f3b40155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b3d400640 1 -- 172.21.15.17:0/2288318202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4016d8f0 con 0x7f3b4015b650 2024-09-10T23:15:11.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.595+0000 7f3b3d400640 1 --2- 172.21.15.17:0/2288318202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b4015b650 0x7f3b40157c70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3b4015e280 tx=0x7f3b2c0a5700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f3b36000640 1 -- 172.21.15.17:0/2288318202 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0bc070 con 0x7f3b4015b650 2024-09-10T23:15:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f3b36000640 1 -- 172.21.15.17:0/2288318202 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b2c0b3040 con 0x7f3b4015b650 2024-09-10T23:15:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f3b36000640 1 -- 172.21.15.17:0/2288318202 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0b2070 con 0x7f3b4015b650 2024-09-10T23:15:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f3b44a00640 1 -- 172.21.15.17:0/2288318202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4016dbb0 con 0x7f3b4015b650 2024-09-10T23:15:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f3b44a00640 1 -- 172.21.15.17:0/2288318202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b400c4220 con 0x7f3b4015b650 2024-09-10T23:15:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f3b36000640 1 -- 172.21.15.17:0/2288318202 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f3b2c004030 con 0x7f3b4015b650 2024-09-10T23:15:11.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7f3b36000640 1 -- 172.21.15.17:0/2288318202 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3b2c003980 con 0x7f3b4015b650 2024-09-10T23:15:11.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7fdb6f000640 1 -- 172.21.15.17:0/571276661 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb440052a0 con 0x7fdb600e30f0 2024-09-10T23:15:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1c2a00640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c40cc580 0x7ff1c413bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1c3400640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c40cc580 0x7ff1c413bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1c3400640 1 -- 172.21.15.17:0/2680277681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c40ccd60 con 0x7ff1a80053d0 2024-09-10T23:15:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1c3e00640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c415c8a0 0x7ff1c414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1c3400640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 0x7ff1c4138d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4001350 tx=0x7ff1b4001810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1bb400640 1 -- 172.21.15.17:0/2680277681 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4012700 con 0x7ff1a80053d0 2024-09-10T23:15:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1bb400640 1 -- 172.21.15.17:0/2680277681 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1b40129d0 con 0x7ff1a80053d0 2024-09-10T23:15:11.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.599+0000 7ff1bb400640 1 -- 172.21.15.17:0/2680277681 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4012e20 con 0x7ff1a80053d0 2024-09-10T23:15:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7ff1ca800640 1 -- 172.21.15.17:0/2680277681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c40cd040 con 0x7ff1a80053d0 2024-09-10T23:15:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7f7893e00640 1 -- 172.21.15.17:0/2667124481 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7888012a30 con 0x7f789c15ec30 2024-09-10T23:15:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7ff1ca800640 1 -- 172.21.15.17:0/2680277681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c413b8b0 con 0x7ff1a80053d0 2024-09-10T23:15:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7f7893e00640 1 -- 172.21.15.17:0/2667124481 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7888003940 con 0x7f789c15ec30 2024-09-10T23:15:11.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7fdb65600640 1 -- 172.21.15.17:0/571276661 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fdb54021110 con 0x7fdb600e30f0 2024-09-10T23:15:11.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7f3b2b400640 1 -- 172.21.15.17:0/2288318202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b40073990 con 0x7f3b4015b650 2024-09-10T23:15:11.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7ff1bb400640 1 -- 172.21.15.17:0/2680277681 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff1b4003600 con 0x7ff1a80053d0 2024-09-10T23:15:11.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7ff1bb400640 1 -- 172.21.15.17:0/2680277681 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff1b401ad80 con 0x7ff1a80053d0 2024-09-10T23:15:11.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7ff1ca800640 1 -- 172.21.15.17:0/2680277681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c413fd40 con 0x7ff1a80053d0 2024-09-10T23:15:11.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.603+0000 7f7893e00640 1 -- 172.21.15.17:0/2667124481 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7888020020 con 0x7f789c15ec30 2024-09-10T23:15:11.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.607+0000 7f3b36000640 1 -- 172.21.15.17:0/2288318202 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f3b2c0c6080 con 0x7f3b4015b650 2024-09-10T23:15:11.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.607+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fe370005590 con 0x7fe37c0053d0 2024-09-10T23:15:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.611+0000 7ff1bb400640 1 -- 172.21.15.17:0/2680277681 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7ff1b4016030 con 0x7ff1a80053d0 2024-09-10T23:15:11.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.627+0000 7fe38e000640 1 -- 172.21.15.17:0/542040518 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fe388010d20 con 0x7fe37c0053d0 2024-09-10T23:15:11.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.635+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe37c0053d0 msgr2=0x7fe39813c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.635+0000 7fe397200640 1 --2- 172.21.15.17:0/542040518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe37c0053d0 0x7fe39813c6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe38800f960 tx=0x7fe38800fe20 comp rx=0 tx=0).stop 2024-09-10T23:15:11.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.635+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 shutdown_connections 2024-09-10T23:15:11.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.635+0000 7fe397200640 1 --2- 172.21.15.17:0/542040518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe39815e6d0 0x7fe39806fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.635+0000 7fe397200640 1 --2- 172.21.15.17:0/542040518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3981e8540 0x7fe398200b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.635+0000 7fe397200640 1 --2- 172.21.15.17:0/542040518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe37c0053d0 0x7fe39813c6b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.635+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 >> 172.21.15.17:0/542040518 conn(0x7fe3980cfa30 msgr2=0x7fe3980b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.639+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 shutdown_connections 2024-09-10T23:15:11.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.639+0000 7fe397200640 1 -- 172.21.15.17:0/542040518 wait complete. 2024-09-10T23:15:11.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.675+0000 7fa43da00640 1 -- 172.21.15.17:0/2882304142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43003bf90 msgr2=0x7fa4300e6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.675+0000 7fa43da00640 1 --2- 172.21.15.17:0/2882304142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43003bf90 0x7fa4300e6460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa43806aea0 tx=0x7fa438098080 comp rx=0 tx=0).stop 2024-09-10T23:15:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.675+0000 7fa43da00640 1 -- 172.21.15.17:0/2882304142 shutdown_connections 2024-09-10T23:15:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.675+0000 7fa43da00640 1 --2- 172.21.15.17:0/2882304142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43003bf90 0x7fa4300e6460 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.675+0000 7fa43da00640 1 --2- 172.21.15.17:0/2882304142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4300565f0 0x7fa43003ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.675+0000 7fa43da00640 1 -- 172.21.15.17:0/2882304142 >> 172.21.15.17:0/2882304142 conn(0x7fa43003a450 msgr2=0x7fa43003a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.675+0000 7fa43da00640 1 -- 172.21.15.17:0/2882304142 shutdown_connections 2024-09-10T23:15:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.675+0000 7fa43da00640 1 -- 172.21.15.17:0/2882304142 wait complete. 2024-09-10T23:15:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.679+0000 7fa43da00640 1 Processor -- start 2024-09-10T23:15:11.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.683+0000 7fa43da00640 1 -- start start 2024-09-10T23:15:11.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.683+0000 7fa43da00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43003bf90 0x7fa4300d71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa43da00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4300565f0 0x7fa4300e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa43da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4300e28b0 0x7fa4300d79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:11.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa43da00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300efc50 con 0x7fa4300e28b0 2024-09-10T23:15:11.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa43da00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300efad0 con 0x7fa43003bf90 2024-09-10T23:15:11.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa43da00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa4300efdd0 con 0x7fa4300565f0 2024-09-10T23:15:11.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa437400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4300e28b0 0x7fa4300d79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa437400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4300e28b0 0x7fa4300d79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52214/0 (socket says 172.21.15.17:52214) 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa437400640 1 -- 172.21.15.17:0/1316778640 learned_addr learned my addr 172.21.15.17:0/1316778640 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa436a00640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43003bf90 0x7fa4300d71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa436000640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4300565f0 0x7fa4300e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa436a00640 1 -- 172.21.15.17:0/1316778640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4300565f0 msgr2=0x7fa4300e36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa436a00640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4300565f0 0x7fa4300e36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa436a00640 1 -- 172.21.15.17:0/1316778640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4300e28b0 msgr2=0x7fa4300d79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa436a00640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4300e28b0 0x7fa4300d79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa436a00640 1 -- 172.21.15.17:0/1316778640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4300e5370 con 0x7fa43003bf90 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa437400640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4300e28b0 0x7fa4300d79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa436a00640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43003bf90 0x7fa4300d71f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c3f0 tx=0x7fa42800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa42ea00640 1 -- 172.21.15.17:0/1316778640 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428005230 con 0x7fa43003bf90 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa42ea00640 1 -- 172.21.15.17:0/1316778640 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4280053d0 con 0x7fa43003bf90 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa43da00640 1 -- 172.21.15.17:0/1316778640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4300e55f0 con 0x7fa43003bf90 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa42ea00640 1 -- 172.21.15.17:0/1316778640 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428004840 con 0x7fa43003bf90 2024-09-10T23:15:11.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa43da00640 1 -- 172.21.15.17:0/1316778640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4300ddb90 con 0x7fa43003bf90 2024-09-10T23:15:11.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa42ea00640 1 -- 172.21.15.17:0/1316778640 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa4280049e0 con 0x7fa43003bf90 2024-09-10T23:15:11.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.691+0000 7fa42ea00640 1 -- 172.21.15.17:0/1316778640 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa428012760 con 0x7fa43003bf90 2024-09-10T23:15:11.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.695+0000 7fa43da00640 1 -- 172.21.15.17:0/1316778640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4300ddd90 con 0x7fa43003bf90 2024-09-10T23:15:11.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.699+0000 7f6a82a00640 1 -- 172.21.15.17:0/1227267143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f6a6c005860 con 0x7f6a90073ce0 2024-09-10T23:15:11.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.703+0000 7fa42ea00640 1 -- 172.21.15.17:0/1316778640 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa4300ddd90 con 0x7fa43003bf90 2024-09-10T23:15:11.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.707+0000 7f6a8d600640 1 -- 172.21.15.17:0/1227267143 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v11)=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f6a84019da0 con 0x7f6a90073ce0 2024-09-10T23:15:11.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.711+0000 7f6a82a00640 1 -- 172.21.15.17:0/1227267143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a90073ce0 msgr2=0x7f6a9014cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.711+0000 7f6a82a00640 1 --2- 172.21.15.17:0/1227267143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a90073ce0 0x7f6a9014cb20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400b410 tx=0x7f6a8400b810 comp rx=0 tx=0).stop 2024-09-10T23:15:11.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.711+0000 7f6a82a00640 1 -- 172.21.15.17:0/1227267143 shutdown_connections 2024-09-10T23:15:11.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.711+0000 7f6a82a00640 1 --2- 172.21.15.17:0/1227267143 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a9015aa60 0x7f6a9014be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.711+0000 7f6a82a00640 1 --2- 172.21.15.17:0/1227267143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a900cf4b0 0x7f6a901666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.711+0000 7f6a82a00640 1 --2- 172.21.15.17:0/1227267143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a90073ce0 0x7f6a9014cb20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.711+0000 7f6a82a00640 1 -- 172.21.15.17:0/1227267143 >> 172.21.15.17:0/1227267143 conn(0x7f6a900cfa00 msgr2=0x7f6a90151490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.711+0000 7f6a82a00640 1 -- 172.21.15.17:0/1227267143 shutdown_connections 2024-09-10T23:15:11.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.711+0000 7f6a82a00640 1 -- 172.21.15.17:0/1227267143 wait complete. 2024-09-10T23:15:11.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.719+0000 7f1df4200640 1 -- 172.21.15.17:0/3336174488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f1dec06eeb0 con 0x7f1dec074560 2024-09-10T23:15:11.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.719+0000 7fc713e00640 1 -- 172.21.15.17:0/3732482394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc6e8005590 con 0x7fc71415f510 2024-09-10T23:15:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.723+0000 7f1de9600640 1 -- 172.21.15.17:0/3336174488 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v12)=0 v12) ==== 119+0+0 (secure 0 0 0) 0x7f1de40ca060 con 0x7f1dec074560 2024-09-10T23:15:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7f1df4200640 1 -- 172.21.15.17:0/3336174488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dec074560 msgr2=0x7f1dec0a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7f1df4200640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dec074560 0x7f1dec0a9450 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009000 tx=0x7f1de40b08f0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7f1df4200640 1 -- 172.21.15.17:0/3336174488 shutdown_connections 2024-09-10T23:15:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7f1df4200640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dec074560 0x7f1dec0a9450 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7f1df4200640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dec074180 0x7f1dec0aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7f1df4200640 1 --2- 172.21.15.17:0/3336174488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec073300 0x7f1dec15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7f1df4200640 1 -- 172.21.15.17:0/3336174488 >> 172.21.15.17:0/3336174488 conn(0x7f1dec0b17a0 msgr2=0x7f1dec153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7f1df4200640 1 -- 172.21.15.17:0/3336174488 shutdown_connections 2024-09-10T23:15:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7f1df4200640 1 -- 172.21.15.17:0/3336174488 wait complete. 2024-09-10T23:15:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.727+0000 7fc70be00640 1 -- 172.21.15.17:0/3732482394 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7fc70c0075b0 con 0x7fc71415f510 2024-09-10T23:15:11.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.735+0000 7fc713e00640 1 -- 172.21.15.17:0/3732482394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc71415f510 msgr2=0x7fc7141ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.735+0000 7fc713e00640 1 --2- 172.21.15.17:0/3732482394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc71415f510 0x7fc7141ff180 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00caa0 tx=0x7fc70c00cf60 comp rx=0 tx=0).stop 2024-09-10T23:15:11.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.735+0000 7fc713e00640 1 -- 172.21.15.17:0/3732482394 shutdown_connections 2024-09-10T23:15:11.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.735+0000 7fc713e00640 1 --2- 172.21.15.17:0/3732482394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc71415f510 0x7fc7141ff180 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.735+0000 7fc713e00640 1 --2- 172.21.15.17:0/3732482394 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc714157f00 0x7fc7141fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.735+0000 7fc713e00640 1 --2- 172.21.15.17:0/3732482394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7140cd930 0x7fc714159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.735+0000 7fc713e00640 1 -- 172.21.15.17:0/3732482394 >> 172.21.15.17:0/3732482394 conn(0x7fc7140cfa30 msgr2=0x7fc714160890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.735+0000 7fc713e00640 1 -- 172.21.15.17:0/3732482394 shutdown_connections 2024-09-10T23:15:11.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.735+0000 7fc713e00640 1 -- 172.21.15.17:0/3732482394 wait complete. 2024-09-10T23:15:11.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.739+0000 7f78a1c00640 1 -- 172.21.15.17:0/2667124481 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f789c0ae6f0 con 0x7f789c15ec30 2024-09-10T23:15:11.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.743+0000 7f27fe200640 1 -- 172.21.15.17:0/1440638831 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f27f8075090 con 0x7f27f8073b40 2024-09-10T23:15:11.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.747+0000 7f7893e00640 1 -- 172.21.15.17:0/2667124481 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7f789c158830 con 0x7f789c15ec30 2024-09-10T23:15:11.750 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.751 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.747+0000 7f78a1c00640 1 -- 172.21.15.17:0/2667124481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15ec30 msgr2=0x7f789c0b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.747+0000 7f78a1c00640 1 --2- 172.21.15.17:0/2667124481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15ec30 0x7f789c0b4580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f788800c4e0 tx=0x7f788800c9a0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.751+0000 7f78a1c00640 1 -- 172.21.15.17:0/2667124481 shutdown_connections 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.751+0000 7f78a1c00640 1 --2- 172.21.15.17:0/2667124481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f789c15f0c0 0x7f789c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.751+0000 7f78a1c00640 1 --2- 172.21.15.17:0/2667124481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f789c15ec30 0x7f789c0b4580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.751+0000 7f78a1c00640 1 --2- 172.21.15.17:0/2667124481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f789c15e850 0x7f789c145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.751+0000 7f78a1c00640 1 -- 172.21.15.17:0/2667124481 >> 172.21.15.17:0/2667124481 conn(0x7f789c0cfa30 msgr2=0x7f789c157940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.751+0000 7f78a1c00640 1 -- 172.21.15.17:0/2667124481 shutdown_connections 2024-09-10T23:15:11.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.751+0000 7f78a1c00640 1 -- 172.21.15.17:0/2667124481 wait complete. 2024-09-10T23:15:11.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.755+0000 7f27ef400640 1 -- 172.21.15.17:0/1440638831 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f27f00aede0 con 0x7f27f8073b40 2024-09-10T23:15:11.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.759+0000 7f27fe200640 1 -- 172.21.15.17:0/1440638831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f8073b40 msgr2=0x7f27f815b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.759+0000 7f27fe200640 1 --2- 172.21.15.17:0/1440638831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f8073b40 0x7f27f815b180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009bd0 tx=0x7f27f00ae600 comp rx=0 tx=0).stop 2024-09-10T23:15:11.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.759+0000 7f27fe200640 1 -- 172.21.15.17:0/1440638831 shutdown_connections 2024-09-10T23:15:11.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.759+0000 7f27fe200640 1 --2- 172.21.15.17:0/1440638831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27f80b2870 0x7f27f80b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.759+0000 7f27fe200640 1 --2- 172.21.15.17:0/1440638831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27f80cdfe0 0x7f27f8159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.759+0000 7f27fe200640 1 --2- 172.21.15.17:0/1440638831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27f8073b40 0x7f27f815b180 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.759+0000 7f27fe200640 1 -- 172.21.15.17:0/1440638831 >> 172.21.15.17:0/1440638831 conn(0x7f27f80cfa00 msgr2=0x7f27f80706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.759+0000 7f27fe200640 1 -- 172.21.15.17:0/1440638831 shutdown_connections 2024-09-10T23:15:11.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.759+0000 7f27fe200640 1 -- 172.21.15.17:0/1440638831 wait complete. 2024-09-10T23:15:11.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.767+0000 7fdb6f000640 1 -- 172.21.15.17:0/571276661 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fdb44005860 con 0x7fdb600e30f0 2024-09-10T23:15:11.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7f3b2b400640 1 -- 172.21.15.17:0/2288318202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3b40075670 con 0x7f3b4015b650 2024-09-10T23:15:11.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb65600640 1 -- 172.21.15.17:0/571276661 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7fdb54021110 con 0x7fdb600e30f0 2024-09-10T23:15:11.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb6f000640 1 -- 172.21.15.17:0/571276661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 msgr2=0x7fdb6004aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb6f000640 1 --2- 172.21.15.17:0/571276661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 0x7fdb6004aaf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdb540251e0 tx=0x7fdb540b7530 comp rx=0 tx=0).stop 2024-09-10T23:15:11.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb6f000640 1 -- 172.21.15.17:0/571276661 shutdown_connections 2024-09-10T23:15:11.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb6f000640 1 --2- 172.21.15.17:0/571276661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb600deb80 0x7fdb60038ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb6f000640 1 --2- 172.21.15.17:0/571276661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb600e30f0 0x7fdb6004aaf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb6f000640 1 --2- 172.21.15.17:0/571276661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb6000bbe0 0x7fdb60176310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb6f000640 1 -- 172.21.15.17:0/571276661 >> 172.21.15.17:0/571276661 conn(0x7fdb600511c0 msgr2=0x7fdb600e1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb6f000640 1 -- 172.21.15.17:0/571276661 shutdown_connections 2024-09-10T23:15:11.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.775+0000 7fdb6f000640 1 -- 172.21.15.17:0/571276661 wait complete. 2024-09-10T23:15:11.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.779+0000 7f3b36000640 1 -- 172.21.15.17:0/2288318202 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7f3b2c016430 con 0x7f3b4015b650 2024-09-10T23:15:11.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.783+0000 7f3b2b400640 1 -- 172.21.15.17:0/2288318202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b4015b650 msgr2=0x7f3b40157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.783+0000 7f3b2b400640 1 --2- 172.21.15.17:0/2288318202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b4015b650 0x7f3b40157c70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3b4015e280 tx=0x7f3b2c0a5700 comp rx=0 tx=0).stop 2024-09-10T23:15:11.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.783+0000 7f3b2b400640 1 -- 172.21.15.17:0/2288318202 shutdown_connections 2024-09-10T23:15:11.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.783+0000 7f3b2b400640 1 --2- 172.21.15.17:0/2288318202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b4015ed50 0x7f3b40155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.783+0000 7f3b2b400640 1 --2- 172.21.15.17:0/2288318202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b4015b650 0x7f3b40157c70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.783+0000 7f3b2b400640 1 --2- 172.21.15.17:0/2288318202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3b400aee90 0x7f3b4016cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.783+0000 7f3b2b400640 1 -- 172.21.15.17:0/2288318202 >> 172.21.15.17:0/2288318202 conn(0x7f3b400cfa00 msgr2=0x7f3b4006e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.783+0000 7f3b2b400640 1 -- 172.21.15.17:0/2288318202 shutdown_connections 2024-09-10T23:15:11.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.783+0000 7f3b2b400640 1 -- 172.21.15.17:0/2288318202 wait complete. 2024-09-10T23:15:11.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.791+0000 7ff1ca800640 1 -- 172.21.15.17:0/2680277681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7ff1c413c310 con 0x7ff1a80053d0 2024-09-10T23:15:11.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1bb400640 1 -- 172.21.15.17:0/2680277681 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7ff1b401a400 con 0x7ff1a80053d0 2024-09-10T23:15:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1ca800640 1 -- 172.21.15.17:0/2680277681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 msgr2=0x7ff1c4138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1ca800640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 0x7ff1c4138d10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4001350 tx=0x7ff1b4001810 comp rx=0 tx=0).stop 2024-09-10T23:15:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1ca800640 1 -- 172.21.15.17:0/2680277681 shutdown_connections 2024-09-10T23:15:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1ca800640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1c415c8a0 0x7ff1c414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1ca800640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1c40cc580 0x7ff1c413bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1ca800640 1 --2- 172.21.15.17:0/2680277681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a80053d0 0x7ff1c4138d10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1ca800640 1 -- 172.21.15.17:0/2680277681 >> 172.21.15.17:0/2680277681 conn(0x7ff1c40b17a0 msgr2=0x7ff1c40b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1ca800640 1 -- 172.21.15.17:0/2680277681 shutdown_connections 2024-09-10T23:15:11.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.795+0000 7ff1ca800640 1 -- 172.21.15.17:0/2680277681 wait complete. 2024-09-10T23:15:11.821 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.822 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.822 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.822 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.822 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.822 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.859+0000 7fa43da00640 1 -- 172.21.15.17:0/1316778640 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fa43004f1e0 con 0x7fa43003bf90 2024-09-10T23:15:11.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.859+0000 7fa42ea00640 1 -- 172.21.15.17:0/1316778640 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v19)=0 v19) ==== 125+0+0 (secure 0 0 0) 0x7fa4300e5370 con 0x7fa43003bf90 2024-09-10T23:15:11.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.863+0000 7fa43da00640 1 -- 172.21.15.17:0/1316778640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43003bf90 msgr2=0x7fa4300d71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:11.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.863+0000 7fa43da00640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43003bf90 0x7fa4300d71f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c3f0 tx=0x7fa42800c8b0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.863+0000 7fa43da00640 1 -- 172.21.15.17:0/1316778640 shutdown_connections 2024-09-10T23:15:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.863+0000 7fa43da00640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4300e28b0 0x7fa4300d79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.863+0000 7fa43da00640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4300565f0 0x7fa4300e36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.863+0000 7fa43da00640 1 --2- 172.21.15.17:0/1316778640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa43003bf90 0x7fa4300d71f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.863+0000 7fa43da00640 1 -- 172.21.15.17:0/1316778640 >> 172.21.15.17:0/1316778640 conn(0x7fa43003a450 msgr2=0x7fa4300ecc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.863+0000 7fa43da00640 1 -- 172.21.15.17:0/1316778640 shutdown_connections 2024-09-10T23:15:11.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:11.863+0000 7fa43da00640 1 -- 172.21.15.17:0/1316778640 wait complete. 2024-09-10T23:15:11.885 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi017') 2024-09-10T23:15:11.885 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T23:15:11.885 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T23:15:12.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 -- 172.21.15.17:0/2652299589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d040cff00 msgr2=0x7f8d040d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 --2- 172.21.15.17:0/2652299589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d040cff00 0x7f8d040d02e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009870 tx=0x7f8cf401c7a0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 -- 172.21.15.17:0/2652299589 shutdown_connections 2024-09-10T23:15:12.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 --2- 172.21.15.17:0/2652299589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d040cff00 0x7f8d040d02e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 -- 172.21.15.17:0/2652299589 >> 172.21.15.17:0/2652299589 conn(0x7f8d040d1da0 msgr2=0x7f8d040d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:12.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 -- 172.21.15.17:0/2652299589 shutdown_connections 2024-09-10T23:15:12.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 -- 172.21.15.17:0/2652299589 wait complete. 2024-09-10T23:15:12.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 Processor -- start 2024-09-10T23:15:12.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 -- start start 2024-09-10T23:15:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d040aea70 0x7f8d0414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d040b0b00 0x7f8d04159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d040cff00 0x7f8d0415a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0416c230 con 0x7f8d040cff00 2024-09-10T23:15:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0416c0b0 con 0x7f8d040aea70 2024-09-10T23:15:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.071+0000 7f8d08a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0416c3b0 con 0x7f8d040b0b00 2024-09-10T23:15:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d02800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d040cff00 0x7f8d0415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d02800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d040cff00 0x7f8d0415a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52224/0 (socket says 172.21.15.17:52224) 2024-09-10T23:15:12.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d02800640 1 -- 172.21.15.17:0/2608896184 learned_addr learned my addr 172.21.15.17:0/2608896184 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d01e00640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d040aea70 0x7f8d0414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8cfbe00640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d040b0b00 0x7f8d04159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d02800640 1 -- 172.21.15.17:0/2608896184 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d040b0b00 msgr2=0x7f8d04159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d02800640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d040b0b00 0x7f8d04159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d02800640 1 -- 172.21.15.17:0/2608896184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d040aea70 msgr2=0x7f8d0414eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d02800640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d040aea70 0x7f8d0414eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d02800640 1 -- 172.21.15.17:0/2608896184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0414f0a0 con 0x7f8d040cff00 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8cfbe00640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d040b0b00 0x7f8d04159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d02800640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d040cff00 0x7f8d0415a170 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00cbf0 tx=0x7f8cfc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8cfa000640 1 -- 172.21.15.17:0/2608896184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc016020 con 0x7f8d040cff00 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8cfa000640 1 -- 172.21.15.17:0/2608896184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cfc00ab00 con 0x7f8d040cff00 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d08a00640 1 -- 172.21.15.17:0/2608896184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d04158610 con 0x7f8d040cff00 2024-09-10T23:15:12.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8cfa000640 1 -- 172.21.15.17:0/2608896184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc012420 con 0x7f8d040cff00 2024-09-10T23:15:12.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d08a00640 1 -- 172.21.15.17:0/2608896184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d04158bd0 con 0x7f8d040cff00 2024-09-10T23:15:12.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8cfa000640 1 -- 172.21.15.17:0/2608896184 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f8cfc012950 con 0x7f8d040cff00 2024-09-10T23:15:12.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8cfa000640 1 -- 172.21.15.17:0/2608896184 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8cfc01bd40 con 0x7f8d040cff00 2024-09-10T23:15:12.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.075+0000 7f8d08a00640 1 -- 172.21.15.17:0/2608896184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d040d02e0 con 0x7f8d040cff00 2024-09-10T23:15:12.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.079+0000 7f8cfa000640 1 -- 172.21.15.17:0/2608896184 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f8cfc020020 con 0x7f8d040cff00 2024-09-10T23:15:12.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.147+0000 7f8d08a00640 1 -- 172.21.15.17:0/2608896184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8d0406fa80 con 0x7f8d040cff00 2024-09-10T23:15:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.147+0000 7f8cfa000640 1 -- 172.21.15.17:0/2608896184 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8cfc004a50 con 0x7f8d040cff00 2024-09-10T23:15:12.152 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-10T23:15:12.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.151+0000 7f8d08a00640 1 -- 172.21.15.17:0/2608896184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d040cff00 msgr2=0x7f8d0415a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.151+0000 7f8d08a00640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d040cff00 0x7f8d0415a170 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00cbf0 tx=0x7f8cfc00cce0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.151+0000 7f8d08a00640 1 -- 172.21.15.17:0/2608896184 shutdown_connections 2024-09-10T23:15:12.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.151+0000 7f8d08a00640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d040cff00 0x7f8d0415a170 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.151+0000 7f8d08a00640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d040b0b00 0x7f8d04159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.151+0000 7f8d08a00640 1 --2- 172.21.15.17:0/2608896184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d040aea70 0x7f8d0414eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.151+0000 7f8d08a00640 1 -- 172.21.15.17:0/2608896184 >> 172.21.15.17:0/2608896184 conn(0x7f8d040d1da0 msgr2=0x7f8d040af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:12.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.151+0000 7f8d08a00640 1 -- 172.21.15.17:0/2608896184 shutdown_connections 2024-09-10T23:15:12.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:12.151+0000 7f8d08a00640 1 -- 172.21.15.17:0/2608896184 wait complete. 2024-09-10T23:15:12.173 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T23:15:12.173 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T23:15:12.173 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:12.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T23:15:12.192 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:12.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T23:15:12.259 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:12.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T23:15:12.323 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:12.324 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T23:15:12.388 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:12.388 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T23:15:12.408 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:12.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T23:15:12.467 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:12.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T23:15:12.528 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:15:12.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T23:15:12.588 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 28b1dc72-2c49-4bc9-9803-d4c4ef108f7b 0 2024-09-10T23:15:12.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 -- 172.21.15.77:0/1120495410 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aec0b31b0 msgr2=0x7f4aec0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 --2- 172.21.15.77:0/1120495410 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aec0b31b0 0x7f4aec0cc8b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0cec20 tx=0x7f4ae401cda0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 -- 172.21.15.77:0/1120495410 shutdown_connections 2024-09-10T23:15:12.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 --2- 172.21.15.77:0/1120495410 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aec0b31b0 0x7f4aec0cc8b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 --2- 172.21.15.77:0/1120495410 >> v2:172.21.15.17:3300/0 conn(0x7f4aec0b2540 0x7f4aec0d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 -- 172.21.15.77:0/1120495410 >> 172.21.15.77:0/1120495410 conn(0x7f4aec0d1da0 msgr2=0x7f4aec0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:12.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 -- 172.21.15.77:0/1120495410 shutdown_connections 2024-09-10T23:15:12.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 -- 172.21.15.77:0/1120495410 wait complete. 2024-09-10T23:15:12.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 Processor -- start 2024-09-10T23:15:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 -- start start 2024-09-10T23:15:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aec0b2540 0x7f4aec0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec0b31b0 0x7f4aec14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aec15f400 0x7f4aec0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec168de0 con 0x7f4aec0b31b0 2024-09-10T23:15:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec168c60 con 0x7f4aec15f400 2024-09-10T23:15:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af3600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec168f60 con 0x7f4aec0b2540 2024-09-10T23:15:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af0c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aec0b2540 0x7f4aec0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4aebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec0b31b0 0x7f4aec14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4af1600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aec15f400 0x7f4aec0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4aebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec0b31b0 0x7f4aec14dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.77:39078/0 (socket says 172.21.15.77:39078) 2024-09-10T23:15:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4aebe00640 1 -- 172.21.15.77:0/1626662869 learned_addr learned my addr 172.21.15.77:0/1626662869 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-10T23:15:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4aebe00640 1 -- 172.21.15.77:0/1626662869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aec0b2540 msgr2=0x7f4aec0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4aebe00640 1 --2- 172.21.15.77:0/1626662869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aec0b2540 0x7f4aec0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4aebe00640 1 -- 172.21.15.77:0/1626662869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aec15f400 msgr2=0x7f4aec0c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4aebe00640 1 --2- 172.21.15.77:0/1626662869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aec15f400 0x7f4aec0c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.768+0000 7f4aebe00640 1 -- 172.21.15.77:0/1626662869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec14e250 con 0x7f4aec0b31b0 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4af0c00640 1 --2- 172.21.15.77:0/1626662869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aec0b2540 0x7f4aec0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4af1600640 1 --2- 172.21.15.77:0/1626662869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aec15f400 0x7f4aec0c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4aebe00640 1 --2- 172.21.15.77:0/1626662869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec0b31b0 0x7f4aec14dd10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800e940 tx=0x7f4ad800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4ae8c00640 1 -- 172.21.15.77:0/1626662869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800cd80 con 0x7f4aec0b31b0 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4ae8c00640 1 -- 172.21.15.77:0/1626662869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ad8005020 con 0x7f4aec0b31b0 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4af3600640 1 -- 172.21.15.77:0/1626662869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec15dae0 con 0x7f4aec0b31b0 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4ae8c00640 1 -- 172.21.15.77:0/1626662869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8005450 con 0x7f4aec0b31b0 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4af3600640 1 -- 172.21.15.77:0/1626662869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec0c6cb0 con 0x7f4aec0b31b0 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4ae8c00640 1 -- 172.21.15.77:0/1626662869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4ad8004b40 con 0x7f4aec0b31b0 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4ae8c00640 1 -- 172.21.15.77:0/1626662869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4ad8018770 con 0x7f4aec0b31b0 2024-09-10T23:15:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.772+0000 7f4af3600640 1 -- 172.21.15.77:0/1626662869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aec0c67a0 con 0x7f4aec0b31b0 2024-09-10T23:15:12.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.776+0000 7f4ae8c00640 1 -- 172.21.15.77:0/1626662869 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f4ad80055f0 con 0x7f4aec0b31b0 2024-09-10T23:15:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.844+0000 7f4af3600640 1 -- 172.21.15.77:0/1626662869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd new", "uuid": "28b1dc72-2c49-4bc9-9803-d4c4ef108f7b", "id": 0} v 0) -- 0x7f4aec0cc890 con 0x7f4aec0b31b0 2024-09-10T23:15:12.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.848+0000 7f4ae8c00640 1 -- 172.21.15.77:0/1626662869 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "28b1dc72-2c49-4bc9-9803-d4c4ef108f7b", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f4ad8021d00 con 0x7f4aec0b31b0 2024-09-10T23:15:12.852 INFO:teuthology.orchestra.run.smithi077.stdout:0 2024-09-10T23:15:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.848+0000 7f4af3600640 1 -- 172.21.15.77:0/1626662869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec0b31b0 msgr2=0x7f4aec14dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.848+0000 7f4af3600640 1 --2- 172.21.15.77:0/1626662869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec0b31b0 0x7f4aec14dd10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800e940 tx=0x7f4ad800ee00 comp rx=0 tx=0).stop 2024-09-10T23:15:12.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.848+0000 7f4af3600640 1 -- 172.21.15.77:0/1626662869 shutdown_connections 2024-09-10T23:15:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.848+0000 7f4af3600640 1 --2- 172.21.15.77:0/1626662869 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aec15f400 0x7f4aec0c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.848+0000 7f4af3600640 1 --2- 172.21.15.77:0/1626662869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aec0b31b0 0x7f4aec14dd10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.848+0000 7f4af3600640 1 --2- 172.21.15.77:0/1626662869 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aec0b2540 0x7f4aec0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.848+0000 7f4af3600640 1 -- 172.21.15.77:0/1626662869 >> 172.21.15.77:0/1626662869 conn(0x7f4aec0d1da0 msgr2=0x7f4aec15e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.852+0000 7f4af3600640 1 -- 172.21.15.77:0/1626662869 shutdown_connections 2024-09-10T23:15:12.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:12.852+0000 7f4af3600640 1 -- 172.21.15.77:0/1626662869 wait complete. 2024-09-10T23:15:12.872 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new d51150ef-7e0f-43ba-a1ac-75614e6c3a5b 1 2024-09-10T23:15:13.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.008+0000 7f2a9f600640 1 -- 172.21.15.77:0/211355158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a980b5230 msgr2=0x7f2a980af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.008+0000 7f2a9f600640 1 --2- 172.21.15.77:0/211355158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a980b5230 0x7f2a980af910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2a980b1f50 tx=0x7f2a8401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.008+0000 7f2a9f600640 1 -- 172.21.15.77:0/211355158 shutdown_connections 2024-09-10T23:15:13.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.008+0000 7f2a9f600640 1 --2- 172.21.15.77:0/211355158 >> v2:172.21.15.17:3300/0 conn(0x7f2a980b0ab0 0x7f2a980b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.008+0000 7f2a9f600640 1 --2- 172.21.15.77:0/211355158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a980b5230 0x7f2a980af910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.008+0000 7f2a9f600640 1 -- 172.21.15.77:0/211355158 >> 172.21.15.77:0/211355158 conn(0x7f2a980b3e00 msgr2=0x7f2a980b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.008+0000 7f2a9f600640 1 -- 172.21.15.77:0/211355158 shutdown_connections 2024-09-10T23:15:13.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.008+0000 7f2a9f600640 1 -- 172.21.15.77:0/211355158 wait complete. 2024-09-10T23:15:13.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9f600640 1 Processor -- start 2024-09-10T23:15:13.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9f600640 1 -- start start 2024-09-10T23:15:13.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9f600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a980b0ab0 0x7f2a980cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9f600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a980b5230 0x7f2a980cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9f600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9815f2d0 0x7f2a980cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9f600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98168ec0 con 0x7f2a980b0ab0 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9f600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98168d40 con 0x7f2a9815f2d0 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9f600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2a98169040 con 0x7f2a980b5230 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a97e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a980b5230 0x7f2a980cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9d600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9815f2d0 0x7f2a980cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a97e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a980b5230 0x7f2a980cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:47002/0 (socket says 172.21.15.77:47002) 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a97e00640 1 -- 172.21.15.77:0/3607123230 learned_addr learned my addr 172.21.15.77:0/3607123230 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9cc00640 1 --2- 172.21.15.77:0/3607123230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a980b0ab0 0x7f2a980cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a97e00640 1 -- 172.21.15.77:0/3607123230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9815f2d0 msgr2=0x7f2a980cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a97e00640 1 --2- 172.21.15.77:0/3607123230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9815f2d0 0x7f2a980cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a97e00640 1 -- 172.21.15.77:0/3607123230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a980b0ab0 msgr2=0x7f2a980cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a97e00640 1 --2- 172.21.15.77:0/3607123230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a980b0ab0 0x7f2a980cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a97e00640 1 -- 172.21.15.77:0/3607123230 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a98154870 con 0x7f2a980b5230 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9d600640 1 --2- 172.21.15.77:0/3607123230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9815f2d0 0x7f2a980cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a97e00640 1 --2- 172.21.15.77:0/3607123230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a980b5230 0x7f2a980cf700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2a840194d0 tx=0x7f2a840a57b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a94c00640 1 -- 172.21.15.77:0/3607123230 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a840b2040 con 0x7f2a980b5230 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a94c00640 1 -- 172.21.15.77:0/3607123230 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a840044a0 con 0x7f2a980b5230 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a9f600640 1 -- 172.21.15.77:0/3607123230 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a98153100 con 0x7f2a980b5230 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.012+0000 7f2a94c00640 1 -- 172.21.15.77:0/3607123230 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84005290 con 0x7f2a980b5230 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.016+0000 7f2a9f600640 1 -- 172.21.15.77:0/3607123230 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a981f8c30 con 0x7f2a980b5230 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.016+0000 7f2a94c00640 1 -- 172.21.15.77:0/3607123230 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f2a980d0b70 con 0x7f2a980b5230 2024-09-10T23:15:13.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.016+0000 7f2a94c00640 1 -- 172.21.15.77:0/3607123230 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f2a84003c80 con 0x7f2a980b5230 2024-09-10T23:15:13.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.016+0000 7f2a9f600640 1 -- 172.21.15.77:0/3607123230 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a981f8780 con 0x7f2a980b5230 2024-09-10T23:15:13.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.020+0000 7f2a94c00640 1 -- 172.21.15.77:0/3607123230 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f2a840c4060 con 0x7f2a980b5230 2024-09-10T23:15:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.088+0000 7f2a9f600640 1 -- 172.21.15.77:0/3607123230 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d51150ef-7e0f-43ba-a1ac-75614e6c3a5b", "id": 1} v 0) -- 0x7f2a980b0f20 con 0x7f2a980b5230 2024-09-10T23:15:13.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a94c00640 1 -- 172.21.15.77:0/3607123230 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d51150ef-7e0f-43ba-a1ac-75614e6c3a5b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2a98154870 con 0x7f2a980b5230 2024-09-10T23:15:13.095 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-10T23:15:13.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a9f600640 1 -- 172.21.15.77:0/3607123230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a980b5230 msgr2=0x7f2a980cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a9f600640 1 --2- 172.21.15.77:0/3607123230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a980b5230 0x7f2a980cf700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2a840194d0 tx=0x7f2a840a57b0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a9f600640 1 -- 172.21.15.77:0/3607123230 shutdown_connections 2024-09-10T23:15:13.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a9f600640 1 --2- 172.21.15.77:0/3607123230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9815f2d0 0x7f2a980cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a9f600640 1 --2- 172.21.15.77:0/3607123230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a980b5230 0x7f2a980cf700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a9f600640 1 --2- 172.21.15.77:0/3607123230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a980b0ab0 0x7f2a980cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a9f600640 1 -- 172.21.15.77:0/3607123230 >> 172.21.15.77:0/3607123230 conn(0x7f2a980b3e00 msgr2=0x7f2a9815e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a9f600640 1 -- 172.21.15.77:0/3607123230 shutdown_connections 2024-09-10T23:15:13.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.092+0000 7f2a9f600640 1 -- 172.21.15.77:0/3607123230 wait complete. 2024-09-10T23:15:13.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new e54744d6-eaf8-4bae-9641-2990477143c9 2 2024-09-10T23:15:13.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 -- 172.21.15.77:0/3981946674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340b2540 msgr2=0x7fdd340d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 --2- 172.21.15.77:0/3981946674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340b2540 0x7fdd340d03b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009840 tx=0x7fdd1c01c820 comp rx=0 tx=0).stop 2024-09-10T23:15:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 -- 172.21.15.77:0/3981946674 shutdown_connections 2024-09-10T23:15:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 --2- 172.21.15.77:0/3981946674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340b2540 0x7fdd340d03b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 -- 172.21.15.77:0/3981946674 >> 172.21.15.77:0/3981946674 conn(0x7fdd340d1da0 msgr2=0x7fdd340d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 -- 172.21.15.77:0/3981946674 shutdown_connections 2024-09-10T23:15:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 -- 172.21.15.77:0/3981946674 wait complete. 2024-09-10T23:15:13.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 Processor -- start 2024-09-10T23:15:13.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 -- start start 2024-09-10T23:15:13.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd340b2540 0x7fdd3414fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340b31b0 0x7fdd34167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3415f400 0x7fdd34151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34169df0 con 0x7fdd340b31b0 2024-09-10T23:15:13.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34169c70 con 0x7fdd3415f400 2024-09-10T23:15:13.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd38c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdd34169f70 con 0x7fdd340b2540 2024-09-10T23:15:13.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd32800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3415f400 0x7fdd34151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd31e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd340b2540 0x7fdd3414fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340b31b0 0x7fdd34167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd31e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd340b2540 0x7fdd3414fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:47008/0 (socket says 172.21.15.77:47008) 2024-09-10T23:15:13.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.252+0000 7fdd31e00640 1 -- 172.21.15.77:0/605533879 learned_addr learned my addr 172.21.15.77:0/605533879 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-10T23:15:13.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2be00640 1 -- 172.21.15.77:0/605533879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd340b2540 msgr2=0x7fdd3414fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2be00640 1 --2- 172.21.15.77:0/605533879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd340b2540 0x7fdd3414fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2be00640 1 -- 172.21.15.77:0/605533879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3415f400 msgr2=0x7fdd34151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2be00640 1 --2- 172.21.15.77:0/605533879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3415f400 0x7fdd34151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2be00640 1 -- 172.21.15.77:0/605533879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd34151780 con 0x7fdd340b31b0 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd31e00640 1 --2- 172.21.15.77:0/605533879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd340b2540 0x7fdd3414fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd32800640 1 --2- 172.21.15.77:0/605533879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3415f400 0x7fdd34151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2be00640 1 --2- 172.21.15.77:0/605533879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340b31b0 0x7fdd34167590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0ac000 tx=0x7fdd1c0a55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2a000640 1 -- 172.21.15.77:0/605533879 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c0b2040 con 0x7fdd340b31b0 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2a000640 1 -- 172.21.15.77:0/605533879 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd1c004470 con 0x7fdd340b31b0 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd38c00640 1 -- 172.21.15.77:0/605533879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd341503d0 con 0x7fdd340b31b0 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2a000640 1 -- 172.21.15.77:0/605533879 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c005260 con 0x7fdd340b31b0 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd38c00640 1 -- 172.21.15.77:0/605533879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd341f7bb0 con 0x7fdd340b31b0 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2a000640 1 -- 172.21.15.77:0/605533879 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdd1c0b5070 con 0x7fdd340b31b0 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd2a000640 1 -- 172.21.15.77:0/605533879 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fdd1c0a57f0 con 0x7fdd340b31b0 2024-09-10T23:15:13.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.256+0000 7fdd38c00640 1 -- 172.21.15.77:0/605533879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd341f79a0 con 0x7fdd340b31b0 2024-09-10T23:15:13.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.260+0000 7fdd2a000640 1 -- 172.21.15.77:0/605533879 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fdd1c016410 con 0x7fdd340b31b0 2024-09-10T23:15:13.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.328+0000 7fdd38c00640 1 -- 172.21.15.77:0/605533879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e54744d6-eaf8-4bae-9641-2990477143c9", "id": 2} v 0) -- 0x7fdd340cc8b0 con 0x7fdd340b31b0 2024-09-10T23:15:13.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd2a000640 1 -- 172.21.15.77:0/605533879 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e54744d6-eaf8-4bae-9641-2990477143c9", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fdd1c0046d0 con 0x7fdd340b31b0 2024-09-10T23:15:13.335 INFO:teuthology.orchestra.run.smithi077.stdout:2 2024-09-10T23:15:13.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd38c00640 1 -- 172.21.15.77:0/605533879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340b31b0 msgr2=0x7fdd34167590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd38c00640 1 --2- 172.21.15.77:0/605533879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340b31b0 0x7fdd34167590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0ac000 tx=0x7fdd1c0a55f0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd38c00640 1 -- 172.21.15.77:0/605533879 shutdown_connections 2024-09-10T23:15:13.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd38c00640 1 --2- 172.21.15.77:0/605533879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3415f400 0x7fdd34151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd38c00640 1 --2- 172.21.15.77:0/605533879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340b31b0 0x7fdd34167590 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd38c00640 1 --2- 172.21.15.77:0/605533879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd340b2540 0x7fdd3414fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd38c00640 1 -- 172.21.15.77:0/605533879 >> 172.21.15.77:0/605533879 conn(0x7fdd340d1da0 msgr2=0x7fdd340aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd38c00640 1 -- 172.21.15.77:0/605533879 shutdown_connections 2024-09-10T23:15:13.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.332+0000 7fdd38c00640 1 -- 172.21.15.77:0/605533879 wait complete. 2024-09-10T23:15:13.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 954fb5c5-85f7-40f0-8faa-198e6d1efd78 3 2024-09-10T23:15:13.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 -- 172.21.15.77:0/509519322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69300cd490 msgr2=0x7f69300cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 --2- 172.21.15.77:0/509519322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69300cd490 0x7f69300cd920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6928009bf0 tx=0x7f692801cac0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 -- 172.21.15.77:0/509519322 shutdown_connections 2024-09-10T23:15:13.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 --2- 172.21.15.77:0/509519322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69300cd490 0x7f69300cd920 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 -- 172.21.15.77:0/509519322 >> 172.21.15.77:0/509519322 conn(0x7f69300b2840 msgr2=0x7f69300b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 -- 172.21.15.77:0/509519322 shutdown_connections 2024-09-10T23:15:13.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 -- 172.21.15.77:0/509519322 wait complete. 2024-09-10T23:15:13.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 Processor -- start 2024-09-10T23:15:13.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 -- start start 2024-09-10T23:15:13.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69300cd490 0x7f6930155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69301583d0 0x7f69300b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69301587b0 0x7f6930157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6930169060 con 0x7f69300cd490 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6930168ee0 con 0x7f69301587b0 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6934e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f69301691e0 con 0x7f69301583d0 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f692e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69301587b0 0x7f6930157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f692e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69301587b0 0x7f6930157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51808/0 (socket says 172.21.15.77:51808) 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f692e800640 1 -- 172.21.15.77:0/2038952825 learned_addr learned my addr 172.21.15.77:0/2038952825 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f6927e00640 1 --2- 172.21.15.77:0/2038952825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69301583d0 0x7f69300b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.496+0000 7f692de00640 1 --2- 172.21.15.77:0/2038952825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69300cd490 0x7f6930155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f692e800640 1 -- 172.21.15.77:0/2038952825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69301583d0 msgr2=0x7f69300b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f692e800640 1 --2- 172.21.15.77:0/2038952825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69301583d0 0x7f69300b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f692e800640 1 -- 172.21.15.77:0/2038952825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69300cd490 msgr2=0x7f6930155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f692e800640 1 --2- 172.21.15.77:0/2038952825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69300cd490 0x7f6930155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f692e800640 1 -- 172.21.15.77:0/2038952825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6930156460 con 0x7f69301587b0 2024-09-10T23:15:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f692e800640 1 --2- 172.21.15.77:0/2038952825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69301587b0 0x7f6930157500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f692801a6f0 tx=0x7f69280092a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f6926000640 1 -- 172.21.15.77:0/2038952825 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280b2040 con 0x7f69301587b0 2024-09-10T23:15:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f6926000640 1 -- 172.21.15.77:0/2038952825 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6928004200 con 0x7f69301587b0 2024-09-10T23:15:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f6926000640 1 -- 172.21.15.77:0/2038952825 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6928004610 con 0x7f69301587b0 2024-09-10T23:15:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f6934e00640 1 -- 172.21.15.77:0/2038952825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6930156740 con 0x7f69301587b0 2024-09-10T23:15:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f6934e00640 1 -- 172.21.15.77:0/2038952825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6930156d00 con 0x7f69301587b0 2024-09-10T23:15:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f6926000640 1 -- 172.21.15.77:0/2038952825 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f69280b5070 con 0x7f69301587b0 2024-09-10T23:15:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f6926000640 1 -- 172.21.15.77:0/2038952825 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f69280047b0 con 0x7f69301587b0 2024-09-10T23:15:13.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f6934e00640 1 -- 172.21.15.77:0/2038952825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69300cd920 con 0x7f69301587b0 2024-09-10T23:15:13.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.500+0000 7f6926000640 1 -- 172.21.15.77:0/2038952825 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f69280167d0 con 0x7f69301587b0 2024-09-10T23:15:13.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.572+0000 7f6934e00640 1 -- 172.21.15.77:0/2038952825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "954fb5c5-85f7-40f0-8faa-198e6d1efd78", "id": 3} v 0) -- 0x7f69300b23a0 con 0x7f69301587b0 2024-09-10T23:15:13.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6926000640 1 -- 172.21.15.77:0/2038952825 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "954fb5c5-85f7-40f0-8faa-198e6d1efd78", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f69280a5890 con 0x7f69301587b0 2024-09-10T23:15:13.579 INFO:teuthology.orchestra.run.smithi077.stdout:3 2024-09-10T23:15:13.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6934e00640 1 -- 172.21.15.77:0/2038952825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69301587b0 msgr2=0x7f6930157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6934e00640 1 --2- 172.21.15.77:0/2038952825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69301587b0 0x7f6930157500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f692801a6f0 tx=0x7f69280092a0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6934e00640 1 -- 172.21.15.77:0/2038952825 shutdown_connections 2024-09-10T23:15:13.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6934e00640 1 --2- 172.21.15.77:0/2038952825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69301587b0 0x7f6930157500 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6934e00640 1 --2- 172.21.15.77:0/2038952825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69301583d0 0x7f69300b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6934e00640 1 --2- 172.21.15.77:0/2038952825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69300cd490 0x7f6930155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6934e00640 1 -- 172.21.15.77:0/2038952825 >> 172.21.15.77:0/2038952825 conn(0x7f69300b2840 msgr2=0x7f69300b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6934e00640 1 -- 172.21.15.77:0/2038952825 shutdown_connections 2024-09-10T23:15:13.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.576+0000 7f6934e00640 1 -- 172.21.15.77:0/2038952825 wait complete. 2024-09-10T23:15:13.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 597cbd01-5fb5-41a8-b847-9a7183e259e7 4 2024-09-10T23:15:13.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.768+0000 7f2374800640 1 -- 172.21.15.77:0/1375876711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c0d0a40 msgr2=0x7f236c0cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.768+0000 7f2374800640 1 --2- 172.21.15.77:0/1375876711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c0d0a40 0x7f236c0cdfa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2368009bc0 tx=0x7f236801cb10 comp rx=0 tx=0).stop 2024-09-10T23:15:13.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.768+0000 7f2374800640 1 -- 172.21.15.77:0/1375876711 shutdown_connections 2024-09-10T23:15:13.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.768+0000 7f2374800640 1 --2- 172.21.15.77:0/1375876711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c0d0a40 0x7f236c0cdfa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.768+0000 7f2374800640 1 -- 172.21.15.77:0/1375876711 >> 172.21.15.77:0/1375876711 conn(0x7f236c0b3e00 msgr2=0x7f236c0b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.768+0000 7f2374800640 1 -- 172.21.15.77:0/1375876711 shutdown_connections 2024-09-10T23:15:13.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.768+0000 7f2374800640 1 -- 172.21.15.77:0/1375876711 wait complete. 2024-09-10T23:15:13.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 Processor -- start 2024-09-10T23:15:13.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 -- start start 2024-09-10T23:15:13.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236c0691b0 0x7f236c0998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f236c0d0a40 0x7f236c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c15df90 0x7f236c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:13.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f236c16c700 con 0x7f236c0691b0 2024-09-10T23:15:13.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f236c16c580 con 0x7f236c15df90 2024-09-10T23:15:13.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f236c16c880 con 0x7f236c0d0a40 2024-09-10T23:15:13.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2372800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c15df90 0x7f236c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2372800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c15df90 0x7f236c15c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51828/0 (socket says 172.21.15.77:51828) 2024-09-10T23:15:13.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2372800640 1 -- 172.21.15.77:0/9850462 learned_addr learned my addr 172.21.15.77:0/9850462 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-10T23:15:13.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2371e00640 1 --2- 172.21.15.77:0/9850462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236c0691b0 0x7f236c0998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2371400640 1 --2- 172.21.15.77:0/9850462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f236c0d0a40 0x7f236c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:13.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2372800640 1 -- 172.21.15.77:0/9850462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f236c0d0a40 msgr2=0x7f236c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2372800640 1 --2- 172.21.15.77:0/9850462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f236c0d0a40 0x7f236c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2372800640 1 -- 172.21.15.77:0/9850462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236c0691b0 msgr2=0x7f236c0998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2372800640 1 --2- 172.21.15.77:0/9850462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236c0691b0 0x7f236c0998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2372800640 1 -- 172.21.15.77:0/9850462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c0c4980 con 0x7f236c15df90 2024-09-10T23:15:13.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2372800640 1 --2- 172.21.15.77:0/9850462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c15df90 0x7f236c15c550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2368019720 tx=0x7f23680a59f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:13.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2366000640 1 -- 172.21.15.77:0/9850462 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23680bb070 con 0x7f236c15df90 2024-09-10T23:15:13.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2366000640 1 -- 172.21.15.77:0/9850462 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2368004e00 con 0x7f236c15df90 2024-09-10T23:15:13.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2366000640 1 -- 172.21.15.77:0/9850462 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23680b2040 con 0x7f236c15df90 2024-09-10T23:15:13.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 -- 172.21.15.77:0/9850462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c0c4c60 con 0x7f236c15df90 2024-09-10T23:15:13.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2374800640 1 -- 172.21.15.77:0/9850462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c0c5220 con 0x7f236c15df90 2024-09-10T23:15:13.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2366000640 1 -- 172.21.15.77:0/9850462 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f23680b5030 con 0x7f236c15df90 2024-09-10T23:15:13.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.772+0000 7f2366000640 1 -- 172.21.15.77:0/9850462 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f23680a5a70 con 0x7f236c15df90 2024-09-10T23:15:13.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.776+0000 7f2374800640 1 -- 172.21.15.77:0/9850462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c0cdfa0 con 0x7f236c15df90 2024-09-10T23:15:13.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.776+0000 7f2366000640 1 -- 172.21.15.77:0/9850462 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f23680c4020 con 0x7f236c15df90 2024-09-10T23:15:13.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.848+0000 7f2374800640 1 -- 172.21.15.77:0/9850462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "597cbd01-5fb5-41a8-b847-9a7183e259e7", "id": 4} v 0) -- 0x7f236c0b2260 con 0x7f236c15df90 2024-09-10T23:15:13.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2366000640 1 -- 172.21.15.77:0/9850462 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "597cbd01-5fb5-41a8-b847-9a7183e259e7", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f2368016790 con 0x7f236c15df90 2024-09-10T23:15:13.854 INFO:teuthology.orchestra.run.smithi077.stdout:4 2024-09-10T23:15:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2374800640 1 -- 172.21.15.77:0/9850462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c15df90 msgr2=0x7f236c15c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2374800640 1 --2- 172.21.15.77:0/9850462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c15df90 0x7f236c15c550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2368019720 tx=0x7f23680a59f0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2374800640 1 -- 172.21.15.77:0/9850462 shutdown_connections 2024-09-10T23:15:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2374800640 1 --2- 172.21.15.77:0/9850462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f236c15df90 0x7f236c15c550 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2374800640 1 --2- 172.21.15.77:0/9850462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f236c0d0a40 0x7f236c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2374800640 1 --2- 172.21.15.77:0/9850462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236c0691b0 0x7f236c0998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2374800640 1 -- 172.21.15.77:0/9850462 >> 172.21.15.77:0/9850462 conn(0x7f236c0b3e00 msgr2=0x7f236c0ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2374800640 1 -- 172.21.15.77:0/9850462 shutdown_connections 2024-09-10T23:15:13.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:13.852+0000 7f2374800640 1 -- 172.21.15.77:0/9850462 wait complete. 2024-09-10T23:15:13.874 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new fb58fd63-b1c8-4016-9c56-b4038e6e6901 5 2024-09-10T23:15:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 -- 172.21.15.77:0/277298868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63415f400 msgr2=0x7fd6340cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 --2- 172.21.15.77:0/277298868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63415f400 0x7fd6340cfca0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd634070750 tx=0x7fd62401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 -- 172.21.15.77:0/277298868 shutdown_connections 2024-09-10T23:15:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 --2- 172.21.15.77:0/277298868 >> v2:172.21.15.17:3300/0 conn(0x7fd6340b2540 0x7fd6340cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 --2- 172.21.15.77:0/277298868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63415f400 0x7fd6340cfca0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 -- 172.21.15.77:0/277298868 >> 172.21.15.77:0/277298868 conn(0x7fd6340d1da0 msgr2=0x7fd6340d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 -- 172.21.15.77:0/277298868 shutdown_connections 2024-09-10T23:15:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 -- 172.21.15.77:0/277298868 wait complete. 2024-09-10T23:15:14.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 Processor -- start 2024-09-10T23:15:14.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 -- start start 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6340b2540 0x7fd634153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340b31b0 0x7fd6340aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63415f400 0x7fd6340b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd634168de0 con 0x7fd6340b31b0 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd634168c60 con 0x7fd6340b2540 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.012+0000 7fd63ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd634168f60 con 0x7fd63415f400 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd633e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6340b2540 0x7fd634153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd633e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6340b2540 0x7fd634153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51840/0 (socket says 172.21.15.77:51840) 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd633e00640 1 -- 172.21.15.77:0/2122245022 learned_addr learned my addr 172.21.15.77:0/2122245022 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd62be00640 1 --2- 172.21.15.77:0/2122245022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340b31b0 0x7fd6340aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd638c00640 1 --2- 172.21.15.77:0/2122245022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63415f400 0x7fd6340b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd633e00640 1 -- 172.21.15.77:0/2122245022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63415f400 msgr2=0x7fd6340b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd633e00640 1 --2- 172.21.15.77:0/2122245022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63415f400 0x7fd6340b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd633e00640 1 -- 172.21.15.77:0/2122245022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340b31b0 msgr2=0x7fd6340aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd633e00640 1 --2- 172.21.15.77:0/2122245022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340b31b0 0x7fd6340aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd633e00640 1 -- 172.21.15.77:0/2122245022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd634165a00 con 0x7fd6340b2540 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd633e00640 1 --2- 172.21.15.77:0/2122245022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6340b2540 0x7fd634153de0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd6240b0040 tx=0x7fd6240a5740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd630c00640 1 -- 172.21.15.77:0/2122245022 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6240b2040 con 0x7fd6340b2540 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd630c00640 1 -- 172.21.15.77:0/2122245022 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd624004450 con 0x7fd6340b2540 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd630c00640 1 -- 172.21.15.77:0/2122245022 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624005290 con 0x7fd6340b2540 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd63ac00640 1 -- 172.21.15.77:0/2122245022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd634165ce0 con 0x7fd6340b2540 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd63ac00640 1 -- 172.21.15.77:0/2122245022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6341662a0 con 0x7fd6340b2540 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd630c00640 1 -- 172.21.15.77:0/2122245022 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd6240bf060 con 0x7fd6340b2540 2024-09-10T23:15:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd630c00640 1 -- 172.21.15.77:0/2122245022 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd624005430 con 0x7fd6340b2540 2024-09-10T23:15:14.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.016+0000 7fd63ac00640 1 -- 172.21.15.77:0/2122245022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6340cc8b0 con 0x7fd6340b2540 2024-09-10T23:15:14.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.020+0000 7fd630c00640 1 -- 172.21.15.77:0/2122245022 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fd6240164d0 con 0x7fd6340b2540 2024-09-10T23:15:14.026 INFO:tasks.ceph.mgr.x.smithi077.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T23:15:14.026 INFO:tasks.ceph.mgr.x.smithi077.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T23:15:14.026 INFO:tasks.ceph.mgr.x.smithi077.stderr: from numpy import show_config as show_numpy_config 2024-09-10T23:15:14.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.088+0000 7fd63ac00640 1 -- 172.21.15.77:0/2122245022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb58fd63-b1c8-4016-9c56-b4038e6e6901", "id": 5} v 0) -- 0x7fd6340d2650 con 0x7fd6340b2540 2024-09-10T23:15:14.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.092+0000 7fd630c00640 1 -- 172.21.15.77:0/2122245022 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb58fd63-b1c8-4016-9c56-b4038e6e6901", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd624004a60 con 0x7fd6340b2540 2024-09-10T23:15:14.097 INFO:teuthology.orchestra.run.smithi077.stdout:5 2024-09-10T23:15:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.096+0000 7fd63ac00640 1 -- 172.21.15.77:0/2122245022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6340b2540 msgr2=0x7fd634153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.096+0000 7fd63ac00640 1 --2- 172.21.15.77:0/2122245022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6340b2540 0x7fd634153de0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd6240b0040 tx=0x7fd6240a5740 comp rx=0 tx=0).stop 2024-09-10T23:15:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.096+0000 7fd63ac00640 1 -- 172.21.15.77:0/2122245022 shutdown_connections 2024-09-10T23:15:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.096+0000 7fd63ac00640 1 --2- 172.21.15.77:0/2122245022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63415f400 0x7fd6340b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.096+0000 7fd63ac00640 1 --2- 172.21.15.77:0/2122245022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6340b31b0 0x7fd6340aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.096+0000 7fd63ac00640 1 --2- 172.21.15.77:0/2122245022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6340b2540 0x7fd634153de0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.096+0000 7fd63ac00640 1 -- 172.21.15.77:0/2122245022 >> 172.21.15.77:0/2122245022 conn(0x7fd6340d1da0 msgr2=0x7fd634072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.096+0000 7fd63ac00640 1 -- 172.21.15.77:0/2122245022 shutdown_connections 2024-09-10T23:15:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.096+0000 7fd63ac00640 1 -- 172.21.15.77:0/2122245022 wait complete. 2024-09-10T23:15:14.116 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 150cca06-fd47-4852-a69b-20244531d93e 6 2024-09-10T23:15:14.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.252+0000 7f2246800640 1 -- 172.21.15.77:0/3654525695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224015f400 msgr2=0x7f22400cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.252+0000 7f2246800640 1 --2- 172.21.15.77:0/3654525695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224015f400 0x7f22400cfca0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2230009930 tx=0x7f223001c920 comp rx=0 tx=0).stop 2024-09-10T23:15:14.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.252+0000 7f2246800640 1 -- 172.21.15.77:0/3654525695 shutdown_connections 2024-09-10T23:15:14.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.252+0000 7f2246800640 1 --2- 172.21.15.77:0/3654525695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224015f400 0x7f22400cfca0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.252+0000 7f2246800640 1 -- 172.21.15.77:0/3654525695 >> 172.21.15.77:0/3654525695 conn(0x7f22400d1da0 msgr2=0x7f22400d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.252+0000 7f2246800640 1 -- 172.21.15.77:0/3654525695 shutdown_connections 2024-09-10T23:15:14.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.252+0000 7f2246800640 1 -- 172.21.15.77:0/3654525695 wait complete. 2024-09-10T23:15:14.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 Processor -- start 2024-09-10T23:15:14.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 -- start start 2024-09-10T23:15:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22400b2540 0x7f224015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22400b31b0 0x7f22400c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224015f400 0x7f22400c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f224016a000 con 0x7f224015f400 2024-09-10T23:15:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2240169e80 con 0x7f22400b31b0 2024-09-10T23:15:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f224016a180 con 0x7f22400b2540 2024-09-10T23:15:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22400b2540 0x7f224015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22400b2540 0x7f224015ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:47074/0 (socket says 172.21.15.77:47074) 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22400b31b0 0x7f22400c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223f400640 1 -- 172.21.15.77:0/2279734148 learned_addr learned my addr 172.21.15.77:0/2279734148 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223fe00640 1 --2- 172.21.15.77:0/2279734148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224015f400 0x7f22400c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223f400640 1 -- 172.21.15.77:0/2279734148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22400b31b0 msgr2=0x7f22400c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223f400640 1 --2- 172.21.15.77:0/2279734148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22400b31b0 0x7f22400c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223f400640 1 -- 172.21.15.77:0/2279734148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224015f400 msgr2=0x7f22400c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223f400640 1 --2- 172.21.15.77:0/2279734148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224015f400 0x7f22400c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223f400640 1 -- 172.21.15.77:0/2279734148 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22400ca340 con 0x7f22400b2540 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f223f400640 1 --2- 172.21.15.77:0/2279734148 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22400b2540 0x7f224015ace0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2230019530 tx=0x7f22300040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2237400640 1 -- 172.21.15.77:0/2279734148 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300b2040 con 0x7f22400b2540 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2237400640 1 -- 172.21.15.77:0/2279734148 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2230003600 con 0x7f22400b2540 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2237400640 1 -- 172.21.15.77:0/2279734148 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230003a50 con 0x7f22400b2540 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 -- 172.21.15.77:0/2279734148 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2240167370 con 0x7f22400b2540 2024-09-10T23:15:14.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 -- 172.21.15.77:0/2279734148 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22400ca040 con 0x7f22400b2540 2024-09-10T23:15:14.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2237400640 1 -- 172.21.15.77:0/2279734148 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f22300ad440 con 0x7f22400b2540 2024-09-10T23:15:14.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2237400640 1 -- 172.21.15.77:0/2279734148 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f22300add50 con 0x7f22400b2540 2024-09-10T23:15:14.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.256+0000 7f2246800640 1 -- 172.21.15.77:0/2279734148 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22400cc8b0 con 0x7f22400b2540 2024-09-10T23:15:14.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.260+0000 7f2237400640 1 -- 172.21.15.77:0/2279734148 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f2230016510 con 0x7f22400b2540 2024-09-10T23:15:14.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.332+0000 7f2246800640 1 -- 172.21.15.77:0/2279734148 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "150cca06-fd47-4852-a69b-20244531d93e", "id": 6} v 0) -- 0x7f22400b0b10 con 0x7f22400b2540 2024-09-10T23:15:14.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2237400640 1 -- 172.21.15.77:0/2279734148 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "150cca06-fd47-4852-a69b-20244531d93e", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f22300ad760 con 0x7f22400b2540 2024-09-10T23:15:14.343 INFO:teuthology.orchestra.run.smithi077.stdout:6 2024-09-10T23:15:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2246800640 1 -- 172.21.15.77:0/2279734148 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22400b2540 msgr2=0x7f224015ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2246800640 1 --2- 172.21.15.77:0/2279734148 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22400b2540 0x7f224015ace0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2230019530 tx=0x7f22300040c0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2246800640 1 -- 172.21.15.77:0/2279734148 shutdown_connections 2024-09-10T23:15:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2246800640 1 --2- 172.21.15.77:0/2279734148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224015f400 0x7f22400c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2246800640 1 --2- 172.21.15.77:0/2279734148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22400b31b0 0x7f22400c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2246800640 1 --2- 172.21.15.77:0/2279734148 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22400b2540 0x7f224015ace0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2246800640 1 -- 172.21.15.77:0/2279734148 >> 172.21.15.77:0/2279734148 conn(0x7f22400d1da0 msgr2=0x7f22400d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2246800640 1 -- 172.21.15.77:0/2279734148 shutdown_connections 2024-09-10T23:15:14.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.340+0000 7f2246800640 1 -- 172.21.15.77:0/2279734148 wait complete. 2024-09-10T23:15:14.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 09f6ab2a-1995-4690-8b7f-240550242914 7 2024-09-10T23:15:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 -- 172.21.15.77:0/87083528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d0140210 msgr2=0x7f56d0073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 --2- 172.21.15.77:0/87083528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d0140210 0x7f56d0073650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56d00d0be0 tx=0x7f56b801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 -- 172.21.15.77:0/87083528 shutdown_connections 2024-09-10T23:15:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 --2- 172.21.15.77:0/87083528 >> v2:172.21.15.17:3300/0 conn(0x7f56d0073b90 0x7f56d00cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 --2- 172.21.15.77:0/87083528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d0140210 0x7f56d0073650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 -- 172.21.15.77:0/87083528 >> 172.21.15.77:0/87083528 conn(0x7f56d00d0c10 msgr2=0x7f56d00d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 -- 172.21.15.77:0/87083528 shutdown_connections 2024-09-10T23:15:14.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 -- 172.21.15.77:0/87083528 wait complete. 2024-09-10T23:15:14.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 Processor -- start 2024-09-10T23:15:14.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 -- start start 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d0071bd0 0x7f56d00b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d0073b90 0x7f56d013c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d0140210 0x7f56d00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f56d015b740 con 0x7f56d0140210 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56d015b5c0 con 0x7f56d0071bd0 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.500+0000 7f56d5c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56d015b8c0 con 0x7f56d0073b90 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56cea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d0071bd0 0x7f56d00b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d0073b90 0x7f56d013c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56cea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d0071bd0 0x7f56d00b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51864/0 (socket says 172.21.15.77:51864) 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56cea00640 1 -- 172.21.15.77:0/1452272281 learned_addr learned my addr 172.21.15.77:0/1452272281 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-10T23:15:14.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56cf400640 1 --2- 172.21.15.77:0/1452272281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d0140210 0x7f56d00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c7e00640 1 -- 172.21.15.77:0/1452272281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d0071bd0 msgr2=0x7f56d00b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c7e00640 1 --2- 172.21.15.77:0/1452272281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d0071bd0 0x7f56d00b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c7e00640 1 -- 172.21.15.77:0/1452272281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d0140210 msgr2=0x7f56d00b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c7e00640 1 --2- 172.21.15.77:0/1452272281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d0140210 0x7f56d00b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c7e00640 1 -- 172.21.15.77:0/1452272281 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d00c9640 con 0x7f56d0073b90 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c7e00640 1 --2- 172.21.15.77:0/1452272281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d0073b90 0x7f56d013c870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f56b80ac000 tx=0x7f56b80a5540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c6a00640 1 -- 172.21.15.77:0/1452272281 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b80ba020 con 0x7f56d0073b90 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c6a00640 1 -- 172.21.15.77:0/1452272281 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56b80043d0 con 0x7f56d0073b90 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c6a00640 1 -- 172.21.15.77:0/1452272281 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b80b2040 con 0x7f56d0073b90 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56d5c00640 1 -- 172.21.15.77:0/1452272281 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d00c98e0 con 0x7f56d0073b90 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56d5c00640 1 -- 172.21.15.77:0/1452272281 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d00c9ea0 con 0x7f56d0073b90 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c6a00640 1 -- 172.21.15.77:0/1452272281 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f56b8003860 con 0x7f56d0073b90 2024-09-10T23:15:14.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56c6a00640 1 -- 172.21.15.77:0/1452272281 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f56b80bf440 con 0x7f56d0073b90 2024-09-10T23:15:14.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.504+0000 7f56d5c00640 1 -- 172.21.15.77:0/1452272281 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d015bda0 con 0x7f56d0073b90 2024-09-10T23:15:14.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.508+0000 7f56c6a00640 1 -- 172.21.15.77:0/1452272281 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f56b80164b0 con 0x7f56d0073b90 2024-09-10T23:15:14.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.576+0000 7f56d5c00640 1 -- 172.21.15.77:0/1452272281 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "09f6ab2a-1995-4690-8b7f-240550242914", "id": 7} v 0) -- 0x7f56d0159a50 con 0x7f56d0073b90 2024-09-10T23:15:14.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56c6a00640 1 -- 172.21.15.77:0/1452272281 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09f6ab2a-1995-4690-8b7f-240550242914", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f56b8003b80 con 0x7f56d0073b90 2024-09-10T23:15:14.583 INFO:teuthology.orchestra.run.smithi077.stdout:7 2024-09-10T23:15:14.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56d5c00640 1 -- 172.21.15.77:0/1452272281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d0073b90 msgr2=0x7f56d013c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56d5c00640 1 --2- 172.21.15.77:0/1452272281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d0073b90 0x7f56d013c870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f56b80ac000 tx=0x7f56b80a5540 comp rx=0 tx=0).stop 2024-09-10T23:15:14.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56d5c00640 1 -- 172.21.15.77:0/1452272281 shutdown_connections 2024-09-10T23:15:14.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56d5c00640 1 --2- 172.21.15.77:0/1452272281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d0140210 0x7f56d00b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56d5c00640 1 --2- 172.21.15.77:0/1452272281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d0073b90 0x7f56d013c870 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56d5c00640 1 --2- 172.21.15.77:0/1452272281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d0071bd0 0x7f56d00b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56d5c00640 1 -- 172.21.15.77:0/1452272281 >> 172.21.15.77:0/1452272281 conn(0x7f56d00d0c10 msgr2=0x7f56d00b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56d5c00640 1 -- 172.21.15.77:0/1452272281 shutdown_connections 2024-09-10T23:15:14.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:15:14.580+0000 7f56d5c00640 1 -- 172.21.15.77:0/1452272281 wait complete. 2024-09-10T23:15:14.603 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T23:15:14.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T23:15:14.607 INFO:tasks.ceph.osd.0:Started 2024-09-10T23:15:14.607 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T23:15:14.607 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T23:15:14.610 INFO:tasks.ceph.osd.1:Started 2024-09-10T23:15:14.610 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T23:15:14.610 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T23:15:14.611 INFO:tasks.ceph.mgr.y.smithi017.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T23:15:14.611 INFO:tasks.ceph.mgr.y.smithi017.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T23:15:14.611 INFO:tasks.ceph.mgr.y.smithi017.stderr: from numpy import show_config as show_numpy_config 2024-09-10T23:15:14.613 INFO:tasks.ceph.osd.2:Started 2024-09-10T23:15:14.613 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T23:15:14.613 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T23:15:14.616 INFO:tasks.ceph.osd.3:Started 2024-09-10T23:15:14.616 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T23:15:14.616 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T23:15:14.619 INFO:tasks.ceph.osd.4:Started 2024-09-10T23:15:14.619 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T23:15:14.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T23:15:14.622 INFO:tasks.ceph.osd.5:Started 2024-09-10T23:15:14.622 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T23:15:14.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T23:15:14.626 INFO:tasks.ceph.osd.6:Started 2024-09-10T23:15:14.626 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T23:15:14.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T23:15:14.630 INFO:tasks.ceph.osd.7:Started 2024-09-10T23:15:14.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 -- 172.21.15.17:0/2891443367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd31c070ad0 msgr2=0x7fd31c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 --2- 172.21.15.17:0/2891443367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd31c070ad0 0x7fd31c15f060 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009870 tx=0x7fd30c01c750 comp rx=0 tx=0).stop 2024-09-10T23:15:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 -- 172.21.15.17:0/2891443367 shutdown_connections 2024-09-10T23:15:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 --2- 172.21.15.17:0/2891443367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd31c070ad0 0x7fd31c15f060 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 -- 172.21.15.17:0/2891443367 >> 172.21.15.17:0/2891443367 conn(0x7fd31c0d1d60 msgr2=0x7fd31c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 -- 172.21.15.17:0/2891443367 shutdown_connections 2024-09-10T23:15:14.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 -- 172.21.15.17:0/2891443367 wait complete. 2024-09-10T23:15:14.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 Processor -- start 2024-09-10T23:15:14.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 -- start start 2024-09-10T23:15:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c070ad0 0x7fd31c0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd31c0cf320 0x7fd31c15d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd31c0d1830 0x7fd31c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c16a660 con 0x7fd31c070ad0 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c16a4e0 con 0x7fd31c0cf320 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.811+0000 7fd322a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd31c16a7e0 con 0x7fd31c0d1830 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd31be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c070ad0 0x7fd31c0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd31be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c070ad0 0x7fd31c0b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52236/0 (socket says 172.21.15.17:52236) 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd31be00640 1 -- 172.21.15.17:0/4049905327 learned_addr learned my addr 172.21.15.17:0/4049905327 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd320a00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd31c0d1830 0x7fd31c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd313e00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd31c0cf320 0x7fd31c15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd31be00640 1 -- 172.21.15.17:0/4049905327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd31c0d1830 msgr2=0x7fd31c15ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd31be00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd31c0d1830 0x7fd31c15ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd31be00640 1 -- 172.21.15.17:0/4049905327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd31c0cf320 msgr2=0x7fd31c15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd31be00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd31c0cf320 0x7fd31c15d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd31be00640 1 -- 172.21.15.17:0/4049905327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c0b3210 con 0x7fd31c070ad0 2024-09-10T23:15:14.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd320a00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd31c0d1830 0x7fd31c15ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd31be00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c070ad0 0x7fd31c0b2be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd30c000c10 tx=0x7fd30c005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd318c00640 1 -- 172.21.15.17:0/4049905327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0bb070 con 0x7fd31c070ad0 2024-09-10T23:15:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd318c00640 1 -- 172.21.15.17:0/4049905327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd30c0a5c80 con 0x7fd31c070ad0 2024-09-10T23:15:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd318c00640 1 -- 172.21.15.17:0/4049905327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0b2040 con 0x7fd31c070ad0 2024-09-10T23:15:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd322a00640 1 -- 172.21.15.17:0/4049905327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c0b34f0 con 0x7fd31c070ad0 2024-09-10T23:15:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd322a00640 1 -- 172.21.15.17:0/4049905327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c0b3ab0 con 0x7fd31c070ad0 2024-09-10T23:15:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd318c00640 1 -- 172.21.15.17:0/4049905327 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd30c0b5030 con 0x7fd31c070ad0 2024-09-10T23:15:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd318c00640 1 -- 172.21.15.17:0/4049905327 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd30c0a55b0 con 0x7fd31c070ad0 2024-09-10T23:15:14.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.815+0000 7fd322a00640 1 -- 172.21.15.17:0/4049905327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31c15f040 con 0x7fd31c070ad0 2024-09-10T23:15:14.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.819+0000 7fd318c00640 1 -- 172.21.15.17:0/4049905327 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fd30c0c4080 con 0x7fd31c070ad0 2024-09-10T23:15:14.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.879+0000 7fd322a00640 1 -- 172.21.15.17:0/4049905327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd31c0b7760 con 0x7fd31c070ad0 2024-09-10T23:15:14.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.879+0000 7fd318c00640 1 -- 172.21.15.17:0/4049905327 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd30c016370 con 0x7fd31c070ad0 2024-09-10T23:15:14.884 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:14.884 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:14.579735+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.883+0000 7fd322a00640 1 -- 172.21.15.17:0/4049905327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c070ad0 msgr2=0x7fd31c0b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.883+0000 7fd322a00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c070ad0 0x7fd31c0b2be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd30c000c10 tx=0x7fd30c005cc0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.883+0000 7fd322a00640 1 -- 172.21.15.17:0/4049905327 shutdown_connections 2024-09-10T23:15:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.883+0000 7fd322a00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd31c0d1830 0x7fd31c15ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.883+0000 7fd322a00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd31c0cf320 0x7fd31c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.883+0000 7fd322a00640 1 --2- 172.21.15.17:0/4049905327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c070ad0 0x7fd31c0b2be0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:14.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.883+0000 7fd322a00640 1 -- 172.21.15.17:0/4049905327 >> 172.21.15.17:0/4049905327 conn(0x7fd31c0d1d60 msgr2=0x7fd31c0cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:14.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.883+0000 7fd322a00640 1 -- 172.21.15.17:0/4049905327 shutdown_connections 2024-09-10T23:15:14.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:14.883+0000 7fd322a00640 1 -- 172.21.15.17:0/4049905327 wait complete. 2024-09-10T23:15:14.904 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T23:15:14.904 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T23:15:15.709 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:15.848 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.843+0000 7f9dd6a00640 1 -- 172.21.15.17:0/2592934339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd015bad0 msgr2=0x7f9dd0073a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.848 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.843+0000 7f9dd6a00640 1 --2- 172.21.15.17:0/2592934339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd015bad0 0x7f9dd0073a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00cb270 tx=0x7f9dc001c7d0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.848 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.843+0000 7f9dd6a00640 1 -- 172.21.15.17:0/2592934339 shutdown_connections 2024-09-10T23:15:15.848 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.843+0000 7f9dd6a00640 1 --2- 172.21.15.17:0/2592934339 >> v2:172.21.15.77:3300/0 conn(0x7f9dd00cc790 0x7f9dd0160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.848 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.843+0000 7f9dd6a00640 1 --2- 172.21.15.17:0/2592934339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd015bad0 0x7f9dd0073a80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.848 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.843+0000 7f9dd6a00640 1 -- 172.21.15.17:0/2592934339 >> 172.21.15.17:0/2592934339 conn(0x7f9dd00b2940 msgr2=0x7f9dd00b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:15.848 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.843+0000 7f9dd6a00640 1 -- 172.21.15.17:0/2592934339 shutdown_connections 2024-09-10T23:15:15.848 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.843+0000 7f9dd6a00640 1 -- 172.21.15.17:0/2592934339 wait complete. 2024-09-10T23:15:15.849 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 Processor -- start 2024-09-10T23:15:15.849 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 -- start start 2024-09-10T23:15:15.851 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd006cc20 0x7f9dd01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.851 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd00cc790 0x7f9dd0157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.851 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd015bad0 0x7f9dd01face0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:15.851 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0169260 con 0x7f9dd006cc20 2024-09-10T23:15:15.851 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01690e0 con 0x7f9dd015bad0 2024-09-10T23:15:15.851 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd01693e0 con 0x7f9dd00cc790 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dcfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd006cc20 0x7f9dd01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dcfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd006cc20 0x7f9dd01568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52254/0 (socket says 172.21.15.17:52254) 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dcfe00640 1 -- 172.21.15.17:0/299466308 learned_addr learned my addr 172.21.15.17:0/299466308 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dc7e00640 1 --2- 172.21.15.17:0/299466308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd00cc790 0x7f9dd0157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd4a00640 1 --2- 172.21.15.17:0/299466308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd015bad0 0x7f9dd01face0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dcfe00640 1 -- 172.21.15.17:0/299466308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd00cc790 msgr2=0x7f9dd0157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dcfe00640 1 --2- 172.21.15.17:0/299466308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd00cc790 0x7f9dd0157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dcfe00640 1 -- 172.21.15.17:0/299466308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd015bad0 msgr2=0x7f9dd01face0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dcfe00640 1 --2- 172.21.15.17:0/299466308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd015bad0 0x7f9dd01face0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dcfe00640 1 -- 172.21.15.17:0/299466308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd006f8c0 con 0x7f9dd006cc20 2024-09-10T23:15:15.852 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dcfe00640 1 --2- 172.21.15.17:0/299466308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd006cc20 0x7f9dd01568c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9dc001ccb0 tx=0x7f9dc0005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:15.853 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dccc00640 1 -- 172.21.15.17:0/299466308 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00b2040 con 0x7f9dd006cc20 2024-09-10T23:15:15.853 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dccc00640 1 -- 172.21.15.17:0/299466308 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dc00bb070 con 0x7f9dd006cc20 2024-09-10T23:15:15.853 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dccc00640 1 -- 172.21.15.17:0/299466308 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0003600 con 0x7f9dd006cc20 2024-09-10T23:15:15.854 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 -- 172.21.15.17:0/299466308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd006fba0 con 0x7f9dd006cc20 2024-09-10T23:15:15.854 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dd6a00640 1 -- 172.21.15.17:0/299466308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd01584c0 con 0x7f9dd006cc20 2024-09-10T23:15:15.854 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dccc00640 1 -- 172.21.15.17:0/299466308 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f9dc00b5070 con 0x7f9dd006cc20 2024-09-10T23:15:15.854 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.847+0000 7f9dccc00640 1 -- 172.21.15.17:0/299466308 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9dc00a5620 con 0x7f9dd006cc20 2024-09-10T23:15:15.854 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.851+0000 7f9dd6a00640 1 -- 172.21.15.17:0/299466308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd0160000 con 0x7f9dd006cc20 2024-09-10T23:15:15.855 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.851+0000 7f9dccc00640 1 -- 172.21.15.17:0/299466308 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f9dc00163f0 con 0x7f9dd006cc20 2024-09-10T23:15:15.917 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 -- 172.21.15.17:0/299466308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9dd00aeed0 con 0x7f9dd006cc20 2024-09-10T23:15:15.917 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dccc00640 1 -- 172.21.15.17:0/299466308 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9dc00037a0 con 0x7f9dd006cc20 2024-09-10T23:15:15.918 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-10T23:15:15.918 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":10,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:14.579735+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:15.919 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 -- 172.21.15.17:0/299466308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd006cc20 msgr2=0x7f9dd01568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:15.919 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 --2- 172.21.15.17:0/299466308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd006cc20 0x7f9dd01568c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9dc001ccb0 tx=0x7f9dc0005ca0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.919 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 -- 172.21.15.17:0/299466308 shutdown_connections 2024-09-10T23:15:15.919 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 --2- 172.21.15.17:0/299466308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd015bad0 0x7f9dd01face0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.919 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 --2- 172.21.15.17:0/299466308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd00cc790 0x7f9dd0157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.919 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 --2- 172.21.15.17:0/299466308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dd006cc20 0x7f9dd01568c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:15.919 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 -- 172.21.15.17:0/299466308 >> 172.21.15.17:0/299466308 conn(0x7f9dd00b2940 msgr2=0x7f9dd0151800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:15.919 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 -- 172.21.15.17:0/299466308 shutdown_connections 2024-09-10T23:15:15.920 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:15.915+0000 7f9dd6a00640 1 -- 172.21.15.17:0/299466308 wait complete. 2024-09-10T23:15:15.935 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T23:15:16.042 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-10T23:15:16.039+0000 7f6ec29e17c0 -1 Falling back to public interface 2024-09-10T23:15:16.226 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-10T23:15:16.223+0000 7f60fb62f7c0 -1 Falling back to public interface 2024-09-10T23:15:16.298 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-10T23:15:16.295+0000 7f4b015317c0 -1 Falling back to public interface 2024-09-10T23:15:16.325 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-10T23:15:16.323+0000 7ff146b677c0 -1 Falling back to public interface 2024-09-10T23:15:16.363 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-10T23:15:16.360+0000 7f983c5317c0 -1 Falling back to public interface 2024-09-10T23:15:16.386 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-10T23:15:16.384+0000 7f5a3e62b7c0 -1 Falling back to public interface 2024-09-10T23:15:16.394 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-10T23:15:16.392+0000 7fd96c0597c0 -1 Falling back to public interface 2024-09-10T23:15:16.622 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-10T23:15:16.620+0000 7fcc401437c0 -1 Falling back to public interface 2024-09-10T23:15:17.297 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-10T23:15:17.292+0000 7f7b01e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T23:15:17.297 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-10T23:15:17.292+0000 7f7b01e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T23:15:20.234 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-10T23:15:20.231+0000 7f6ec29e17c0 -1 osd.3 0 log_to_monitors true 2024-09-10T23:15:20.457 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-10T23:15:20.455+0000 7f60fb62f7c0 -1 osd.1 0 log_to_monitors true 2024-09-10T23:15:20.468 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-10T23:15:20.463+0000 7ff146b677c0 -1 osd.0 0 log_to_monitors true 2024-09-10T23:15:20.638 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-10T23:15:20.636+0000 7f983c5317c0 -1 osd.4 0 log_to_monitors true 2024-09-10T23:15:20.842 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-10T23:15:20.840+0000 7fcc401437c0 -1 osd.5 0 log_to_monitors true 2024-09-10T23:15:20.868 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-10T23:15:20.864+0000 7fd96c0597c0 -1 osd.6 0 log_to_monitors true 2024-09-10T23:15:20.925 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-10T23:15:20.923+0000 7f4b015317c0 -1 osd.2 0 log_to_monitors true 2024-09-10T23:15:21.072 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-10T23:15:21.068+0000 7f5a3e62b7c0 -1 osd.7 0 log_to_monitors true 2024-09-10T23:15:22.121 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-10T23:15:22.119+0000 7f6ebd800640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T23:15:22.142 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-10T23:15:22.139+0000 7f6eb3800640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:15:22.742 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:22.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.935+0000 7fb609200640 1 -- 172.21.15.17:0/1971609172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6040b2680 msgr2=0x7fb6040d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.935+0000 7fb609200640 1 --2- 172.21.15.17:0/1971609172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6040b2680 0x7fb6040d0420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009840 tx=0x7fb5f001c300 comp rx=0 tx=0).stop 2024-09-10T23:15:22.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.939+0000 7fb609200640 1 -- 172.21.15.17:0/1971609172 shutdown_connections 2024-09-10T23:15:22.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.939+0000 7fb609200640 1 --2- 172.21.15.17:0/1971609172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6040b2680 0x7fb6040d0420 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.939+0000 7fb609200640 1 --2- 172.21.15.17:0/1971609172 >> v2:172.21.15.77:3300/0 conn(0x7fb6040b19d0 0x7fb6040b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.939+0000 7fb609200640 1 -- 172.21.15.17:0/1971609172 >> 172.21.15.17:0/1971609172 conn(0x7fb6040d1e40 msgr2=0x7fb6040d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:22.941 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.939+0000 7fb609200640 1 -- 172.21.15.17:0/1971609172 shutdown_connections 2024-09-10T23:15:22.942 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.939+0000 7fb609200640 1 -- 172.21.15.17:0/1971609172 wait complete. 2024-09-10T23:15:22.944 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.939+0000 7fb609200640 1 Processor -- start 2024-09-10T23:15:22.944 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.939+0000 7fb609200640 1 -- start start 2024-09-10T23:15:22.945 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb609200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6040b19d0 0x7fb60414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.945 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb609200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6040b2680 0x7fb60415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.945 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb609200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6040b2b40 0x7fb60415f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.945 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb609200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb60416a120 con 0x7fb6040b2680 2024-09-10T23:15:22.946 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb609200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb604169fa0 con 0x7fb6040b19d0 2024-09-10T23:15:22.946 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb609200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb60416a2a0 con 0x7fb6040b2b40 2024-09-10T23:15:22.946 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb601400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6040b2680 0x7fb60415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.947 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb601400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6040b2680 0x7fb60415eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35174/0 (socket says 172.21.15.17:35174) 2024-09-10T23:15:22.947 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb601400640 1 -- 172.21.15.17:0/301790270 learned_addr learned my addr 172.21.15.17:0/301790270 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:22.947 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb602800640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6040b2b40 0x7fb60415f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.947 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb601400640 1 -- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6040b2b40 msgr2=0x7fb60415f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:22.947 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb601400640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6040b2b40 0x7fb60415f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.947 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb601400640 1 -- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6040b19d0 msgr2=0x7fb60414e230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T23:15:22.947 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb601400640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6040b19d0 0x7fb60414e230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:22.947 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb601400640 1 -- 172.21.15.17:0/301790270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb604158320 con 0x7fb6040b2680 2024-09-10T23:15:22.948 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb601400640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6040b2680 0x7fb60415eec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009790 tx=0x7fb5f0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:22.948 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb5fa000640 1 -- 172.21.15.17:0/301790270 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00b9020 con 0x7fb6040b2680 2024-09-10T23:15:22.948 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb5fa000640 1 -- 172.21.15.17:0/301790270 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5f0005020 con 0x7fb6040b2680 2024-09-10T23:15:22.948 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb5fa000640 1 -- 172.21.15.17:0/301790270 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00b1040 con 0x7fb6040b2680 2024-09-10T23:15:22.948 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60414e770 con 0x7fb6040b2680 2024-09-10T23:15:22.948 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.943+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60415c400 con 0x7fb6040b2680 2024-09-10T23:15:22.952 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.947+0000 7fb5fa000640 1 -- 172.21.15.17:0/301790270 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 96338+0+0 (secure 0 0 0) 0x7fb5f00b4070 con 0x7fb6040b2680 2024-09-10T23:15:22.952 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.947+0000 7fb5fa000640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5e4076960 0x7fb5e4078e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:22.952 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.947+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6040b1db0 con 0x7fb6040b2680 2024-09-10T23:15:22.953 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.951+0000 7fb5fa000640 1 -- 172.21.15.17:0/301790270 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7fb5f012b4a0 con 0x7fb6040b2680 2024-09-10T23:15:22.953 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.951+0000 7fb601e00640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5e4076960 0x7fb5e4078e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:22.954 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.951+0000 7fb601e00640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5e4076960 0x7fb5e4078e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009aa0 tx=0x7fb5f40091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:22.959 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:22.955+0000 7fb5fa000640 1 -- 172.21.15.17:0/301790270 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb5f00c3020 con 0x7fb6040b2680 2024-09-10T23:15:23.270 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.267+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6040d0200 con 0x7fb6040b2680 2024-09-10T23:15:23.271 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.267+0000 7fb5fa000640 1 -- 172.21.15.17:0/301790270 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7555 (secure 0 0 0) 0x7fb5f0016330 con 0x7fb6040b2680 2024-09-10T23:15:23.271 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-10T23:15:23.271 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":13,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:22.302034+0000","last_up_change":"2024-09-10T23:15:22.302034+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:23.275 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5e4076960 msgr2=0x7fb5e4078e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5e4076960 0x7fb5e4078e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009aa0 tx=0x7fb5f40091e0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6040b2680 msgr2=0x7fb60415eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:23.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6040b2680 0x7fb60415eec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0009790 tx=0x7fb5f0004040 comp rx=0 tx=0).stop 2024-09-10T23:15:23.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 shutdown_connections 2024-09-10T23:15:23.276 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5e4076960 0x7fb5e4078e20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.277 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6040b2b40 0x7fb60415f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.277 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6040b2680 0x7fb60415eec0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.277 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 --2- 172.21.15.17:0/301790270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6040b19d0 0x7fb60414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:23.277 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 >> 172.21.15.17:0/301790270 conn(0x7fb6040d1e40 msgr2=0x7fb6040d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:23.277 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 shutdown_connections 2024-09-10T23:15:23.277 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:23.271+0000 7fb609200640 1 -- 172.21.15.17:0/301790270 wait complete. 2024-09-10T23:15:23.304 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-10T23:15:23.725 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-10T23:15:23.723+0000 7f60f6e00640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T23:15:23.754 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-10T23:15:23.751+0000 7f60ec400640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:15:23.777 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-10T23:15:23.775+0000 7f4afc400640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T23:15:23.798 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-10T23:15:23.795+0000 7ff141a00640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T23:15:23.801 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-10T23:15:23.799+0000 7f4af2400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:15:23.821 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-10T23:15:23.819+0000 7ff137a00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:15:24.580 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-10T23:15:24.575+0000 7fcc3b000640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T23:15:24.608 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-10T23:15:24.607+0000 7fcc31000640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:15:24.662 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-10T23:15:24.659+0000 7f9837400640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T23:15:24.684 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-10T23:15:24.683+0000 7f5a38a00640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T23:15:24.695 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-10T23:15:24.695+0000 7f982d400640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:15:24.706 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-10T23:15:24.707+0000 7f5a2ea00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:15:24.708 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-10T23:15:24.707+0000 7fd967000640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T23:15:24.740 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-10T23:15:24.739+0000 7fd95d000640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T23:15:30.111 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:30.260 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.255+0000 7fad3fc00640 1 -- 172.21.15.17:0/116930923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b19d0 msgr2=0x7fad380b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.260 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.255+0000 7fad3fc00640 1 --2- 172.21.15.17:0/116930923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b19d0 0x7fad380b1db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad380d1da0 tx=0x7fad2c01c7a0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.260 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.255+0000 7fad3fc00640 1 -- 172.21.15.17:0/116930923 shutdown_connections 2024-09-10T23:15:30.261 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.255+0000 7fad3fc00640 1 --2- 172.21.15.17:0/116930923 >> v2:172.21.15.77:3300/0 conn(0x7fad380b2680 0x7fad380d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.261 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.255+0000 7fad3fc00640 1 --2- 172.21.15.17:0/116930923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b19d0 0x7fad380b1db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.261 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.255+0000 7fad3fc00640 1 -- 172.21.15.17:0/116930923 >> 172.21.15.17:0/116930923 conn(0x7fad380d1e40 msgr2=0x7fad380d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.261 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.255+0000 7fad3fc00640 1 -- 172.21.15.17:0/116930923 shutdown_connections 2024-09-10T23:15:30.261 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.255+0000 7fad3fc00640 1 -- 172.21.15.17:0/116930923 wait complete. 2024-09-10T23:15:30.262 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 Processor -- start 2024-09-10T23:15:30.262 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 -- start start 2024-09-10T23:15:30.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad380b19d0 0x7fad38158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b2680 0x7fad381579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad380b2b40 0x7fad3814f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fad38160a10 con 0x7fad380b2680 2024-09-10T23:15:30.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad38160890 con 0x7fad380b2b40 2024-09-10T23:15:30.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fad38160b90 con 0x7fad380b19d0 2024-09-10T23:15:30.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad37e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b2680 0x7fad381579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.263 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad37e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b2680 0x7fad381579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52796/0 (socket says 172.21.15.17:52796) 2024-09-10T23:15:30.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad37e00640 1 -- 172.21.15.17:0/4182288244 learned_addr learned my addr 172.21.15.17:0/4182288244 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:30.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3d200640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad380b19d0 0x7fad38158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3dc00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad380b2b40 0x7fad3814f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad37e00640 1 -- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad380b19d0 msgr2=0x7fad38158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad37e00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad380b19d0 0x7fad38158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad37e00640 1 -- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad380b2b40 msgr2=0x7fad3814f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad37e00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad380b2b40 0x7fad3814f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad37e00640 1 -- 172.21.15.17:0/4182288244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad38157f20 con 0x7fad380b2680 2024-09-10T23:15:30.264 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3dc00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad380b2b40 0x7fad3814f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:30.265 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad37e00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b2680 0x7fad381579e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c970 tx=0x7fad2400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.266 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad34c00640 1 -- 172.21.15.17:0/4182288244 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24007c70 con 0x7fad380b2680 2024-09-10T23:15:30.266 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad34c00640 1 -- 172.21.15.17:0/4182288244 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad2400f450 con 0x7fad380b2680 2024-09-10T23:15:30.266 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad381f8a50 con 0x7fad380b2680 2024-09-10T23:15:30.266 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad34c00640 1 -- 172.21.15.17:0/4182288244 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2400f8a0 con 0x7fad380b2680 2024-09-10T23:15:30.266 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.259+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad381f92f0 con 0x7fad380b2680 2024-09-10T23:15:30.266 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.263+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad380b1db0 con 0x7fad380b2680 2024-09-10T23:15:30.266 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.263+0000 7fad34c00640 1 -- 172.21.15.17:0/4182288244 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 96338+0+0 (secure 0 0 0) 0x7fad24020030 con 0x7fad380b2680 2024-09-10T23:15:30.267 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.263+0000 7fad34c00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad18072550 0x7fad18074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.267 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.263+0000 7fad34c00640 1 -- 172.21.15.17:0/4182288244 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fad24093850 con 0x7fad380b2680 2024-09-10T23:15:30.267 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.263+0000 7fad3d200640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad18072550 0x7fad18074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.268 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.263+0000 7fad3d200640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad18072550 0x7fad18074a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0af000 tx=0x7fad2c01afe0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.270 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.267+0000 7fad34c00640 1 -- 172.21.15.17:0/4182288244 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fad24026020 con 0x7fad380b2680 2024-09-10T23:15:30.445 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.443+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad381f8c20 con 0x7fad380b2680 2024-09-10T23:15:30.446 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.443+0000 7fad34c00640 1 -- 172.21.15.17:0/4182288244 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12836 (secure 0 0 0) 0x7fad24014030 con 0x7fad380b2680 2024-09-10T23:15:30.446 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-10T23:15:30.446 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":19,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:28.751770+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:30.449 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.443+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad18072550 msgr2=0x7fad18074a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.449 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.443+0000 7fad3fc00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad18072550 0x7fad18074a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0af000 tx=0x7fad2c01afe0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.449 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.443+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b2680 msgr2=0x7fad381579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.449 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.443+0000 7fad3fc00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b2680 0x7fad381579e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c970 tx=0x7fad2400ce30 comp rx=0 tx=0).stop 2024-09-10T23:15:30.449 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.447+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 shutdown_connections 2024-09-10T23:15:30.449 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.447+0000 7fad3fc00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad18072550 0x7fad18074a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.449 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.447+0000 7fad3fc00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad380b2b40 0x7fad3814f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.449 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.447+0000 7fad3fc00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad380b2680 0x7fad381579e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.449 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.447+0000 7fad3fc00640 1 --2- 172.21.15.17:0/4182288244 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad380b19d0 0x7fad38158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.450 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.447+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 >> 172.21.15.17:0/4182288244 conn(0x7fad380d1e40 msgr2=0x7fad381598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.450 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.447+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 shutdown_connections 2024-09-10T23:15:30.450 INFO:teuthology.misc.health.smithi017.stderr:2024-09-10T23:15:30.447+0000 7fad3fc00640 1 -- 172.21.15.17:0/4182288244 wait complete. 2024-09-10T23:15:30.465 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T23:15:30.466 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T23:15:30.466 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:15:30.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:15:30.469 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:15:30.469 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:15:30.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:15:30.472 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:15:30.472 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:15:30.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:15:30.476 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:15:30.476 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:15:30.476 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:15:30.479 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:15:30.479 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T23:15:30.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:30.573 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:15:30.574 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:15:30.591 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:15:30.592 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:15:30.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 -- 172.21.15.17:0/24398886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 msgr2=0x7f8b50161470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 --2- 172.21.15.17:0/24398886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 0x7f8b50161470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009c80 tx=0x7f8b4801cce0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 -- 172.21.15.17:0/24398886 shutdown_connections 2024-09-10T23:15:30.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 --2- 172.21.15.17:0/24398886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 0x7f8b50161470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 -- 172.21.15.17:0/24398886 >> 172.21.15.17:0/24398886 conn(0x7f8b500d1d60 msgr2=0x7f8b500d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 -- 172.21.15.17:0/24398886 shutdown_connections 2024-09-10T23:15:30.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 -- 172.21.15.17:0/24398886 wait complete. 2024-09-10T23:15:30.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 Processor -- start 2024-09-10T23:15:30.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 -- start start 2024-09-10T23:15:30.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5006df30 0x7f8b5014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015f060 0x7f8b5014f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 0x7f8b500d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5016c070 con 0x7f8b50161040 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5006ef90 con 0x7f8b5006df30 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.631+0000 7f8b57a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5016c1f0 con 0x7f8b5015f060 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 0x7f8b500d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 0x7f8b500d2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52824/0 (socket says 172.21.15.17:52824) 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55a00640 1 -- 172.21.15.17:0/3304452006 learned_addr learned my addr 172.21.15.17:0/3304452006 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55000640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5006df30 0x7f8b5014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b4fe00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015f060 0x7f8b5014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55a00640 1 -- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015f060 msgr2=0x7f8b5014f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55a00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015f060 0x7f8b5014f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55a00640 1 -- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5006df30 msgr2=0x7f8b5014fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55a00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5006df30 0x7f8b5014fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55a00640 1 -- 172.21.15.17:0/3304452006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b501516e0 con 0x7f8b50161040 2024-09-10T23:15:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b55a00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 0x7f8b500d2140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b4801a910 tx=0x7f8b480093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b4cc00640 1 -- 172.21.15.17:0/3304452006 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b480bc070 con 0x7f8b50161040 2024-09-10T23:15:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b4cc00640 1 -- 172.21.15.17:0/3304452006 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b480042f0 con 0x7f8b50161040 2024-09-10T23:15:30.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b4cc00640 1 -- 172.21.15.17:0/3304452006 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b480b2040 con 0x7f8b50161040 2024-09-10T23:15:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b50150140 con 0x7f8b50161040 2024-09-10T23:15:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b50150700 con 0x7f8b50161040 2024-09-10T23:15:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5015d190 con 0x7f8b50161040 2024-09-10T23:15:30.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.635+0000 7f8b4cc00640 1 -- 172.21.15.17:0/3304452006 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) ==== 96338+0+0 (secure 0 0 0) 0x7f8b480b5070 con 0x7f8b50161040 2024-09-10T23:15:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.639+0000 7f8b4cc00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b30072550 0x7f8b30074a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.639+0000 7f8b4cc00640 1 -- 172.21.15.17:0/3304452006 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f8b4812cb10 con 0x7f8b50161040 2024-09-10T23:15:30.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.639+0000 7f8b55000640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b30072550 0x7f8b30074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:30.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.639+0000 7f8b55000640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b30072550 0x7f8b30074a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8b44007fd0 tx=0x7f8b44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:30.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.639+0000 7f8b4cc00640 1 -- 172.21.15.17:0/3304452006 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8b5015d190 con 0x7f8b50161040 2024-09-10T23:15:30.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.767+0000 7f8b4cc00640 1 -- 172.21.15.17:0/3304452006 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8b480a5c40 con 0x7f8b50161040 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.851+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b50161470 con 0x7f8b50161040 2024-09-10T23:15:30.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.851+0000 7f8b4cc00640 1 -- 172.21.15.17:0/3304452006 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f8b480c5080 con 0x7f8b50161040 2024-09-10T23:15:30.856 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:30.856 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"btime":"2024-09-10T23:15:30:579846+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T23:15:30.856 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b30072550 msgr2=0x7f8b30074a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b30072550 0x7f8b30074a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8b44007fd0 tx=0x7f8b44009040 comp rx=0 tx=0).stop 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 msgr2=0x7f8b500d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 0x7f8b500d2140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b4801a910 tx=0x7f8b480093d0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 shutdown_connections 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b30072550 0x7f8b30074a10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b50161040 0x7f8b500d2140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b5015f060 0x7f8b5014f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 --2- 172.21.15.17:0/3304452006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5006df30 0x7f8b5014fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 >> 172.21.15.17:0/3304452006 conn(0x7f8b500d1d60 msgr2=0x7f8b50068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:30.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 shutdown_connections 2024-09-10T23:15:30.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:30.855+0000 7f8b57a00640 1 -- 172.21.15.17:0/3304452006 wait complete. 2024-09-10T23:15:32.877 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 -- 172.21.15.17:0/4070369932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600d1830 msgr2=0x7fed6015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 --2- 172.21.15.17:0/4070369932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600d1830 0x7fed6015f5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed600cf010 tx=0x7fed4801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 -- 172.21.15.17:0/4070369932 shutdown_connections 2024-09-10T23:15:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 --2- 172.21.15.17:0/4070369932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600d1830 0x7fed6015f5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 --2- 172.21.15.17:0/4070369932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed60070ad0 0x7fed6015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 -- 172.21.15.17:0/4070369932 >> 172.21.15.17:0/4070369932 conn(0x7fed600d1d60 msgr2=0x7fed600d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 -- 172.21.15.17:0/4070369932 shutdown_connections 2024-09-10T23:15:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 -- 172.21.15.17:0/4070369932 wait complete. 2024-09-10T23:15:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 Processor -- start 2024-09-10T23:15:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.031+0000 7fed66e00640 1 -- start start 2024-09-10T23:15:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed66e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed60070ad0 0x7fed60150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed66e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600cf320 0x7fed601fb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed66e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed600d1830 0x7fed60142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed66e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed60169480 con 0x7fed600cf320 2024-09-10T23:15:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed66e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed60169300 con 0x7fed600d1830 2024-09-10T23:15:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed66e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed60169600 con 0x7fed60070ad0 2024-09-10T23:15:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed57e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600cf320 0x7fed601fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed5fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed60070ad0 0x7fed60150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed57e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600cf320 0x7fed601fb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52838/0 (socket says 172.21.15.17:52838) 2024-09-10T23:15:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed57e00640 1 -- 172.21.15.17:0/3457828658 learned_addr learned my addr 172.21.15.17:0/3457828658 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed64e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed600d1830 0x7fed60142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed57e00640 1 -- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed60070ad0 msgr2=0x7fed60150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed57e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed60070ad0 0x7fed60150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed57e00640 1 -- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed600d1830 msgr2=0x7fed60142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed57e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed600d1830 0x7fed60142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed57e00640 1 -- 172.21.15.17:0/3457828658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed601fbdd0 con 0x7fed600cf320 2024-09-10T23:15:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed57e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600cf320 0x7fed601fb660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed4801d180 tx=0x7fed48005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed5cc00640 1 -- 172.21.15.17:0/3457828658 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed480b2040 con 0x7fed600cf320 2024-09-10T23:15:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed5cc00640 1 -- 172.21.15.17:0/3457828658 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed480038f0 con 0x7fed600cf320 2024-09-10T23:15:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed5cc00640 1 -- 172.21.15.17:0/3457828658 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed48003d40 con 0x7fed600cf320 2024-09-10T23:15:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed601fc0b0 con 0x7fed600cf320 2024-09-10T23:15:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed60156b60 con 0x7fed600cf320 2024-09-10T23:15:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.035+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed600cfc60 con 0x7fed600cf320 2024-09-10T23:15:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.039+0000 7fed5cc00640 1 -- 172.21.15.17:0/3457828658 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fed480ad440 con 0x7fed600cf320 2024-09-10T23:15:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.039+0000 7fed5cc00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed3c0725e0 0x7fed3c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.039+0000 7fed5cc00640 1 -- 172.21.15.17:0/3457828658 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fed4812d030 con 0x7fed600cf320 2024-09-10T23:15:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.039+0000 7fed5fe00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed3c0725e0 0x7fed3c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.039+0000 7fed5fe00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed3c0725e0 0x7fed3c074aa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fed5000abe0 tx=0x7fed5000a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.043+0000 7fed5cc00640 1 -- 172.21.15.17:0/3457828658 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fed480164d0 con 0x7fed600cf320 2024-09-10T23:15:33.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed60159190 con 0x7fed600cf320 2024-09-10T23:15:33.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed5cc00640 1 -- 172.21.15.17:0/3457828658 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3897 (secure 0 0 0) 0x7fed480f8400 con 0x7fed600cf320 2024-09-10T23:15:33.254 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:33.254 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"btime":"2024-09-10T23:15:31:581715+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T23:15:33.255 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2024-09-10T23:15:33.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed3c0725e0 msgr2=0x7fed3c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed3c0725e0 0x7fed3c074aa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fed5000abe0 tx=0x7fed5000a2d0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600cf320 msgr2=0x7fed601fb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600cf320 0x7fed601fb660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed4801d180 tx=0x7fed48005790 comp rx=0 tx=0).stop 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 shutdown_connections 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed3c0725e0 0x7fed3c074aa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed600d1830 0x7fed60142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed600cf320 0x7fed601fb660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 --2- 172.21.15.17:0/3457828658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed60070ad0 0x7fed60150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 >> 172.21.15.17:0/3457828658 conn(0x7fed600d1d60 msgr2=0x7fed600b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 shutdown_connections 2024-09-10T23:15:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.251+0000 7fed66e00640 1 -- 172.21.15.17:0/3457828658 wait complete. 2024-09-10T23:15:33.275 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:15:33.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.419+0000 7f6d6e600640 1 -- 172.21.15.17:0/1032851803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d68070ad0 msgr2=0x7f6d6815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.419+0000 7f6d6e600640 1 --2- 172.21.15.17:0/1032851803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d68070ad0 0x7f6d6815f060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d680cf010 tx=0x7f6d5801c7f0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.419+0000 7f6d6e600640 1 -- 172.21.15.17:0/1032851803 shutdown_connections 2024-09-10T23:15:33.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.419+0000 7f6d6e600640 1 --2- 172.21.15.17:0/1032851803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d68070ad0 0x7f6d6815f060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.419+0000 7f6d6e600640 1 -- 172.21.15.17:0/1032851803 >> 172.21.15.17:0/1032851803 conn(0x7f6d680d1d60 msgr2=0x7f6d680d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:33.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.419+0000 7f6d6e600640 1 -- 172.21.15.17:0/1032851803 shutdown_connections 2024-09-10T23:15:33.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.419+0000 7f6d6e600640 1 -- 172.21.15.17:0/1032851803 wait complete. 2024-09-10T23:15:33.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 Processor -- start 2024-09-10T23:15:33.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 -- start start 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d68070ad0 0x7f6d68167410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d680cf320 0x7f6d680af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d680d1830 0x7f6d680afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6816a660 con 0x7f6d680cf320 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6816a4e0 con 0x7f6d68070ad0 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6d6816a7e0 con 0x7f6d680d1830 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d66a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d680cf320 0x7f6d680af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d66a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d680cf320 0x7f6d680af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52850/0 (socket says 172.21.15.17:52850) 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d66a00640 1 -- 172.21.15.17:0/1352765810 learned_addr learned my addr 172.21.15.17:0/1352765810 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d67400640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d68070ad0 0x7f6d68167410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d67e00640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d680d1830 0x7f6d680afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d66a00640 1 -- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d680d1830 msgr2=0x7f6d680afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d66a00640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d680d1830 0x7f6d680afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d66a00640 1 -- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d68070ad0 msgr2=0x7f6d68167410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d66a00640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d68070ad0 0x7f6d68167410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d66a00640 1 -- 172.21.15.17:0/1352765810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d681559f0 con 0x7f6d680cf320 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d66a00640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d680cf320 0x7f6d680af720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400c4e0 tx=0x7f6d5400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d5f400640 1 -- 172.21.15.17:0/1352765810 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d540052d0 con 0x7f6d680cf320 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d5f400640 1 -- 172.21.15.17:0/1352765810 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d54005470 con 0x7f6d680cf320 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d68155cd0 con 0x7f6d680cf320 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d5f400640 1 -- 172.21.15.17:0/1352765810 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54012890 con 0x7f6d680cf320 2024-09-10T23:15:33.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d68167950 con 0x7f6d680cf320 2024-09-10T23:15:33.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.423+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6815f060 con 0x7f6d680cf320 2024-09-10T23:15:33.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.427+0000 7f6d5f400640 1 -- 172.21.15.17:0/1352765810 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6d54003600 con 0x7f6d680cf320 2024-09-10T23:15:33.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.427+0000 7f6d5f400640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d480725e0 0x7f6d48074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.427+0000 7f6d5f400640 1 -- 172.21.15.17:0/1352765810 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f6d540929c0 con 0x7f6d680cf320 2024-09-10T23:15:33.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.427+0000 7f6d67400640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d480725e0 0x7f6d48074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.427+0000 7f6d67400640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d480725e0 0x7f6d48074aa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d580af000 tx=0x7f6d5801b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:33.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.431+0000 7f6d5f400640 1 -- 172.21.15.17:0/1352765810 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6d5405e460 con 0x7f6d680cf320 2024-09-10T23:15:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6d68157b20 con 0x7f6d680cf320 2024-09-10T23:15:33.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d5f400640 1 -- 172.21.15.17:0/1352765810 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f6d5405dd60 con 0x7f6d680cf320 2024-09-10T23:15:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:33.610 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:15:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:15:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:15:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:15:33.610 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:15:33.610 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:15:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d480725e0 msgr2=0x7f6d48074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d480725e0 0x7f6d48074aa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6d580af000 tx=0x7f6d5801b030 comp rx=0 tx=0).stop 2024-09-10T23:15:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d680cf320 msgr2=0x7f6d680af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d680cf320 0x7f6d680af720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400c4e0 tx=0x7f6d5400c9a0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 shutdown_connections 2024-09-10T23:15:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d480725e0 0x7f6d48074aa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d680d1830 0x7f6d680afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d680cf320 0x7f6d680af720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 --2- 172.21.15.17:0/1352765810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d68070ad0 0x7f6d68167410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 >> 172.21.15.17:0/1352765810 conn(0x7f6d680d1d60 msgr2=0x7f6d680cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 shutdown_connections 2024-09-10T23:15:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.607+0000 7f6d6e600640 1 -- 172.21.15.17:0/1352765810 wait complete. 2024-09-10T23:15:33.631 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:15:33.631 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:15:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.779+0000 7fddaf200640 1 -- 172.21.15.17:0/1729331965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 msgr2=0x7fddb00696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.779+0000 7fddaf200640 1 --2- 172.21.15.17:0/1729331965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 0x7fddb00696f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddb00cddc0 tx=0x7fdd9801eff0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.779+0000 7fddaf200640 1 -- 172.21.15.17:0/1729331965 shutdown_connections 2024-09-10T23:15:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.779+0000 7fddaf200640 1 --2- 172.21.15.17:0/1729331965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 0x7fddb00696f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.779+0000 7fddaf200640 1 --2- 172.21.15.17:0/1729331965 >> v2:172.21.15.77:3300/0 conn(0x7fddb015f1d0 0x7fddb00691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.779+0000 7fddaf200640 1 -- 172.21.15.17:0/1729331965 >> 172.21.15.17:0/1729331965 conn(0x7fddb00b3ca0 msgr2=0x7fddb00d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.779+0000 7fddaf200640 1 -- 172.21.15.17:0/1729331965 shutdown_connections 2024-09-10T23:15:33.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.779+0000 7fddaf200640 1 -- 172.21.15.17:0/1729331965 wait complete. 2024-09-10T23:15:33.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 Processor -- start 2024-09-10T23:15:33.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 -- start start 2024-09-10T23:15:33.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb0074f20 0x7fddb0155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb015f1d0 0x7fddb00cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 0x7fddb0152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fddb00b0ce0 con 0x7fddb015f5b0 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fddb00b5820 con 0x7fddb015f1d0 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fddb00b0e60 con 0x7fddb0074f20 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddae800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 0x7fddb0152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddae800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 0x7fddb0152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52862/0 (socket says 172.21.15.17:52862) 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddae800640 1 -- 172.21.15.17:0/562458388 learned_addr learned my addr 172.21.15.17:0/562458388 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fdda5400640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb015f1d0 0x7fddb00cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddade00640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb0074f20 0x7fddb0155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddae800640 1 -- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb0074f20 msgr2=0x7fddb0155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddae800640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb0074f20 0x7fddb0155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddae800640 1 -- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb015f1d0 msgr2=0x7fddb00cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddae800640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb015f1d0 0x7fddb00cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddae800640 1 -- 172.21.15.17:0/562458388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb00cda00 con 0x7fddb015f5b0 2024-09-10T23:15:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fdda5400640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb015f1d0 0x7fddb00cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:15:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddae800640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 0x7fddb0152350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdda800c760 tx=0x7fdda800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fdda6a00640 1 -- 172.21.15.17:0/562458388 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8003db0 con 0x7fddb015f5b0 2024-09-10T23:15:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb00c95a0 con 0x7fddb015f5b0 2024-09-10T23:15:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fdda6a00640 1 -- 172.21.15.17:0/562458388 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdda8005070 con 0x7fddb015f5b0 2024-09-10T23:15:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fdda6a00640 1 -- 172.21.15.17:0/562458388 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8005440 con 0x7fddb015f5b0 2024-09-10T23:15:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.783+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb00c9b60 con 0x7fddb015f5b0 2024-09-10T23:15:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.787+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb015fa70 con 0x7fddb015f5b0 2024-09-10T23:15:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.787+0000 7fdda6a00640 1 -- 172.21.15.17:0/562458388 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdda80055e0 con 0x7fddb015f5b0 2024-09-10T23:15:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.787+0000 7fdda6a00640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd8c0725e0 0x7fdd8c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.787+0000 7fdda6a00640 1 -- 172.21.15.17:0/562458388 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fdda8092a60 con 0x7fddb015f5b0 2024-09-10T23:15:33.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.787+0000 7fddade00640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd8c0725e0 0x7fdd8c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.787+0000 7fddade00640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd8c0725e0 0x7fdd8c074aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009be0 tx=0x7fdda00091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.791+0000 7fdda6a00640 1 -- 172.21.15.17:0/562458388 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fddb00cda00 con 0x7fddb015f5b0 2024-09-10T23:15:33.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:33.967+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fddb00d0d60 con 0x7fddb015f5b0 2024-09-10T23:15:33.990 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:15:33.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:15:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.775+0000 7fdda6a00640 1 -- 172.21.15.17:0/562458388 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7fdda805de30 con 0x7fddb015f5b0 2024-09-10T23:15:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:15:34.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd8c0725e0 msgr2=0x7fdd8c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd8c0725e0 0x7fdd8c074aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009be0 tx=0x7fdda00091e0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 msgr2=0x7fddb0152350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 0x7fddb0152350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdda800c760 tx=0x7fdda800cc20 comp rx=0 tx=0).stop 2024-09-10T23:15:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 shutdown_connections 2024-09-10T23:15:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd8c0725e0 0x7fdd8c074aa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddb015f5b0 0x7fddb0152350 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb015f1d0 0x7fddb00cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 --2- 172.21.15.17:0/562458388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb0074f20 0x7fddb0155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 >> 172.21.15.17:0/562458388 conn(0x7fddb00b3ca0 msgr2=0x7fddb0070520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 shutdown_connections 2024-09-10T23:15:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.779+0000 7fddaf200640 1 -- 172.21.15.17:0/562458388 wait complete. 2024-09-10T23:15:34.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-10T23:15:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 -- 172.21.15.17:0/226027410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa780b2540 msgr2=0x7faa780cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 --2- 172.21.15.17:0/226027410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa780b2540 0x7faa780cc8b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa74009c80 tx=0x7faa7401cda0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 -- 172.21.15.17:0/226027410 shutdown_connections 2024-09-10T23:15:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 --2- 172.21.15.17:0/226027410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa780b2540 0x7faa780cc8b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 --2- 172.21.15.17:0/226027410 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa7815f400 0x7faa780cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 -- 172.21.15.17:0/226027410 >> 172.21.15.17:0/226027410 conn(0x7faa780d1da0 msgr2=0x7faa780d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 -- 172.21.15.17:0/226027410 shutdown_connections 2024-09-10T23:15:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 -- 172.21.15.17:0/226027410 wait complete. 2024-09-10T23:15:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 Processor -- start 2024-09-10T23:15:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.967+0000 7faa80800640 1 -- start start 2024-09-10T23:15:34.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa80800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa780b2540 0x7faa7806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:34.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa80800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa780b31b0 0x7faa7815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa80800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa7815f400 0x7faa7806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa80800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faa78168de0 con 0x7faa7815f400 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa80800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa78168c60 con 0x7faa780b31b0 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa80800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faa78168f60 con 0x7faa780b2540 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa7815f400 0x7faa7806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa780b2540 0x7faa7806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa780b2540 0x7faa7806e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:36102/0 (socket says 172.21.15.17:36102) 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa7815f400 0x7faa7806f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52876/0 (socket says 172.21.15.17:52876) 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7de00640 1 -- 172.21.15.17:0/959384534 learned_addr learned my addr 172.21.15.17:0/959384534 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7d400640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa780b31b0 0x7faa7815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7e800640 1 -- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa780b2540 msgr2=0x7faa7806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7e800640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa780b2540 0x7faa7806e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7e800640 1 -- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa780b31b0 msgr2=0x7faa7815c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:34.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7e800640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa780b31b0 0x7faa7815c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:34.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7e800640 1 -- 172.21.15.17:0/959384534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa780c8110 con 0x7faa7815f400 2024-09-10T23:15:34.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa7e800640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa7815f400 0x7faa7806f1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa78074b20 tx=0x7faa740a5b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa72000640 1 -- 172.21.15.17:0/959384534 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa740bb070 con 0x7faa7815f400 2024-09-10T23:15:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa72000640 1 -- 172.21.15.17:0/959384534 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa74004d40 con 0x7faa7815f400 2024-09-10T23:15:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa780c6410 con 0x7faa7815f400 2024-09-10T23:15:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa72000640 1 -- 172.21.15.17:0/959384534 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa740b2040 con 0x7faa7815f400 2024-09-10T23:15:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa780c69d0 con 0x7faa7815f400 2024-09-10T23:15:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.971+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa780cc8b0 con 0x7faa7815f400 2024-09-10T23:15:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.975+0000 7faa72000640 1 -- 172.21.15.17:0/959384534 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faa740b5030 con 0x7faa7815f400 2024-09-10T23:15:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.975+0000 7faa72000640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa5c0725e0 0x7faa5c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.975+0000 7faa72000640 1 -- 172.21.15.17:0/959384534 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7faa7412cce0 con 0x7faa7815f400 2024-09-10T23:15:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.975+0000 7faa7de00640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa5c0725e0 0x7faa5c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:34.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.975+0000 7faa7de00640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa5c0725e0 0x7faa5c074aa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa6c005fd0 tx=0x7faa6c00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:34.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:34.979+0000 7faa72000640 1 -- 172.21.15.17:0/959384534 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faa74016990 con 0x7faa7815f400 2024-09-10T23:15:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.155+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7faa780c60c0 con 0x7faa7815f400 2024-09-10T23:15:35.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.783+0000 7faa72000640 1 -- 172.21.15.17:0/959384534 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7faa740f7f40 con 0x7faa7815f400 2024-09-10T23:15:35.789 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:15:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.787+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa5c0725e0 msgr2=0x7faa5c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.787+0000 7faa80800640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa5c0725e0 0x7faa5c074aa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faa6c005fd0 tx=0x7faa6c00b390 comp rx=0 tx=0).stop 2024-09-10T23:15:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.787+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa7815f400 msgr2=0x7faa7806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.787+0000 7faa80800640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa7815f400 0x7faa7806f1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa78074b20 tx=0x7faa740a5b80 comp rx=0 tx=0).stop 2024-09-10T23:15:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.791+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 shutdown_connections 2024-09-10T23:15:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.791+0000 7faa80800640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa5c0725e0 0x7faa5c074aa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.791+0000 7faa80800640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa7815f400 0x7faa7806f1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.791+0000 7faa80800640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa780b31b0 0x7faa7815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.791+0000 7faa80800640 1 --2- 172.21.15.17:0/959384534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa780b2540 0x7faa7806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.791+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 >> 172.21.15.17:0/959384534 conn(0x7faa780d1da0 msgr2=0x7faa7815dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:35.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.791+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 shutdown_connections 2024-09-10T23:15:35.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.791+0000 7faa80800640 1 -- 172.21.15.17:0/959384534 wait complete. 2024-09-10T23:15:35.833 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:15:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.983+0000 7f7f98c00640 1 -- 172.21.15.17:0/1881266378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f78004d50 msgr2=0x7f7f780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.983+0000 7f7f98c00640 1 --2- 172.21.15.17:0/1881266378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f78004d50 0x7f7f780051d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00c660 tx=0x7f7f8c01d2e0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.983+0000 7f7f92800640 1 -- 172.21.15.17:0/1881266378 reap_dead start 2024-09-10T23:15:35.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.983+0000 7f7f98c00640 1 -- 172.21.15.17:0/1881266378 shutdown_connections 2024-09-10T23:15:35.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.983+0000 7f7f98c00640 1 -- 172.21.15.17:0/1881266378 >> 172.21.15.17:0/1881266378 conn(0x7f7f9409a9f0 msgr2=0x7f7f9409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:35.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.983+0000 7f7f98c00640 1 -- 172.21.15.17:0/1881266378 shutdown_connections 2024-09-10T23:15:35.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.983+0000 7f7f98c00640 1 -- 172.21.15.17:0/1881266378 wait complete. 2024-09-10T23:15:35.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.983+0000 7f7f98c00640 1 Processor -- start 2024-09-10T23:15:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.983+0000 7f7f98c00640 1 -- start start 2024-09-10T23:15:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f98c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f78004d50 0x7f7f940b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f98c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940cba60 0x7f7f940c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f98c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f941e75e0 0x7f7f940c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f98c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7f940cd580 con 0x7f7f940cba60 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f98c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f940d1ff0 con 0x7f7f78004d50 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f98c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f940cd700 con 0x7f7f941e75e0 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f89400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940cba60 0x7f7f940c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f89400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940cba60 0x7f7f940c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52880/0 (socket says 172.21.15.17:52880) 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f89400640 1 -- 172.21.15.17:0/2372751815 learned_addr learned my addr 172.21.15.17:0/2372751815 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f92800640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f941e75e0 0x7f7f940c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f91e00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f78004d50 0x7f7f940b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f89400640 1 -- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f941e75e0 msgr2=0x7f7f940c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f89400640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f941e75e0 0x7f7f940c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f89400640 1 -- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f78004d50 msgr2=0x7f7f940b72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f89400640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f78004d50 0x7f7f940b72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f89400640 1 -- 172.21.15.17:0/2372751815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f941f5ab0 con 0x7f7f940cba60 2024-09-10T23:15:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f89400640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940cba60 0x7f7f940c8f10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c003ef0 tx=0x7f7f7c00f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f8aa00640 1 -- 172.21.15.17:0/2372751815 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c015070 con 0x7f7f940cba60 2024-09-10T23:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f8aa00640 1 -- 172.21.15.17:0/2372751815 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f7c011840 con 0x7f7f940cba60 2024-09-10T23:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f941f4ea0 con 0x7f7f940cba60 2024-09-10T23:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f8aa00640 1 -- 172.21.15.17:0/2372751815 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c011c90 con 0x7f7f940cba60 2024-09-10T23:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f941f5460 con 0x7f7f940cba60 2024-09-10T23:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f940cdc60 con 0x7f7f940cba60 2024-09-10T23:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.987+0000 7f7f8aa00640 1 -- 172.21.15.17:0/2372751815 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7f7c0103c0 con 0x7f7f940cba60 2024-09-10T23:15:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.991+0000 7f7f8aa00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f700725e0 0x7f7f70074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.991+0000 7f7f8aa00640 1 -- 172.21.15.17:0/2372751815 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f7f7c093da0 con 0x7f7f940cba60 2024-09-10T23:15:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.991+0000 7f7f91e00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f700725e0 0x7f7f70074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.991+0000 7f7f91e00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f700725e0 0x7f7f70074aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f94068f70 tx=0x7f7f840091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:35.995+0000 7f7f8aa00640 1 -- 172.21.15.17:0/2372751815 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7f7c05f440 con 0x7f7f940cba60 2024-09-10T23:15:36.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.203+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7f941e5720 con 0x7f7f940cba60 2024-09-10T23:15:36.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.799+0000 7f7f8aa00640 1 -- 172.21.15.17:0/2372751815 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f7f7c05ed40 con 0x7f7f940cba60 2024-09-10T23:15:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T23:15:36.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f700725e0 msgr2=0x7f7f70074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f700725e0 0x7f7f70074aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f94068f70 tx=0x7f7f840091e0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940cba60 msgr2=0x7f7f940c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:36.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940cba60 0x7f7f940c8f10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c003ef0 tx=0x7f7f7c00f720 comp rx=0 tx=0).stop 2024-09-10T23:15:36.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 shutdown_connections 2024-09-10T23:15:36.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f700725e0 0x7f7f70074aa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f941e75e0 0x7f7f940c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f940cba60 0x7f7f940c8f10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 --2- 172.21.15.17:0/2372751815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f78004d50 0x7f7f940b72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:36.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 >> 172.21.15.17:0/2372751815 conn(0x7f7f9409a9f0 msgr2=0x7f7f940cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:36.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 shutdown_connections 2024-09-10T23:15:36.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.811+0000 7f7f98c00640 1 -- 172.21.15.17:0/2372751815 wait complete. 2024-09-10T23:15:36.849 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-10T23:15:36.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-10T23:15:37.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.999+0000 7f9dfe400640 1 -- 172.21.15.17:0/126141995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806d2d0 msgr2=0x7f9df806f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.999+0000 7f9dfe400640 1 --2- 172.21.15.17:0/126141995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806d2d0 0x7f9df806f510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9df80d0920 tx=0x7f9de401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.999+0000 7f9dfe400640 1 -- 172.21.15.17:0/126141995 shutdown_connections 2024-09-10T23:15:37.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:36.999+0000 7f9dfe400640 1 --2- 172.21.15.17:0/126141995 >> v2:172.21.15.77:3300/0 conn(0x7f9df806fa50 0x7f9df815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 --2- 172.21.15.17:0/126141995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806d2d0 0x7f9df806f510 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 -- 172.21.15.17:0/126141995 >> 172.21.15.17:0/126141995 conn(0x7f9df80d0c90 msgr2=0x7f9df80d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:37.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 -- 172.21.15.17:0/126141995 shutdown_connections 2024-09-10T23:15:37.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 -- 172.21.15.17:0/126141995 wait complete. 2024-09-10T23:15:37.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 Processor -- start 2024-09-10T23:15:37.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 -- start start 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df806d2d0 0x7f9df81f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806fa50 0x7f9df8151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9df80b6230 0x7f9df80ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8168e10 con 0x7f9df806fa50 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8168c90 con 0x7f9df806d2d0 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9df8168f90 con 0x7f9df80b6230 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806fa50 0x7f9df8151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806fa50 0x7f9df8151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49088/0 (socket says 172.21.15.17:49088) 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df6a00640 1 -- 172.21.15.17:0/516829185 learned_addr learned my addr 172.21.15.17:0/516829185 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df7400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df806d2d0 0x7f9df81f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df7e00640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9df80b6230 0x7f9df80ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df6a00640 1 -- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9df80b6230 msgr2=0x7f9df80ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df6a00640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9df80b6230 0x7f9df80ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df6a00640 1 -- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df806d2d0 msgr2=0x7f9df81f87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df6a00640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df806d2d0 0x7f9df81f87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df6a00640 1 -- 172.21.15.17:0/516829185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df8152300 con 0x7f9df806fa50 2024-09-10T23:15:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df7e00640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9df80b6230 0x7f9df80ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9df6a00640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806fa50 0x7f9df8151dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9de40194d0 tx=0x7f9de40a55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9def400640 1 -- 172.21.15.17:0/516829185 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de40b2040 con 0x7f9df806fa50 2024-09-10T23:15:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9def400640 1 -- 172.21.15.17:0/516829185 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9de4004380 con 0x7f9df806fa50 2024-09-10T23:15:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9def400640 1 -- 172.21.15.17:0/516829185 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4005290 con 0x7f9df806fa50 2024-09-10T23:15:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.003+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df81515c0 con 0x7f9df806fa50 2024-09-10T23:15:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.007+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df80cb0b0 con 0x7f9df806fa50 2024-09-10T23:15:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.007+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df80caea0 con 0x7f9df806fa50 2024-09-10T23:15:37.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.007+0000 7f9def400640 1 -- 172.21.15.17:0/516829185 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9de4005430 con 0x7f9df806fa50 2024-09-10T23:15:37.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.007+0000 7f9def400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd80725e0 0x7f9dd8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:37.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.007+0000 7f9def400640 1 -- 172.21.15.17:0/516829185 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9de412ce30 con 0x7f9df806fa50 2024-09-10T23:15:37.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.007+0000 7f9df7400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd80725e0 0x7f9dd8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:37.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.011+0000 7f9df7400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd80725e0 0x7f9dd8074aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9de8007fd0 tx=0x7f9de8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.011+0000 7f9def400640 1 -- 172.21.15.17:0/516829185 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9df8152300 con 0x7f9df806fa50 2024-09-10T23:15:37.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.195+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f9df806ce70 con 0x7f9df806fa50 2024-09-10T23:15:37.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.807+0000 7f9def400640 1 -- 172.21.15.17:0/516829185 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7f9de40164b0 con 0x7f9df806fa50 2024-09-10T23:15:37.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd80725e0 msgr2=0x7f9dd8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd80725e0 0x7f9dd8074aa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9de8007fd0 tx=0x7f9de8009040 comp rx=0 tx=0).stop 2024-09-10T23:15:37.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806fa50 msgr2=0x7f9df8151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806fa50 0x7f9df8151dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9de40194d0 tx=0x7f9de40a55a0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 shutdown_connections 2024-09-10T23:15:37.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd80725e0 0x7f9dd8074aa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9df80b6230 0x7f9df80ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9df806fa50 0x7f9df8151dc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 --2- 172.21.15.17:0/516829185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9df806d2d0 0x7f9df81f87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 >> 172.21.15.17:0/516829185 conn(0x7f9df80d0c90 msgr2=0x7f9df8150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:37.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 shutdown_connections 2024-09-10T23:15:37.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.811+0000 7f9dfe400640 1 -- 172.21.15.17:0/516829185 wait complete. 2024-09-10T23:15:37.838 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:15:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.991+0000 7f3418e00640 1 -- 172.21.15.17:0/3826323765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34140ccb10 msgr2=0x7f34140ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.991+0000 7f3418e00640 1 --2- 172.21.15.17:0/3826323765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34140ccb10 0x7f34140ccef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3404009870 tx=0x7f340401c7d0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 -- 172.21.15.17:0/3826323765 shutdown_connections 2024-09-10T23:15:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 --2- 172.21.15.17:0/3826323765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34140ccb10 0x7f34140ccef0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 -- 172.21.15.17:0/3826323765 >> 172.21.15.17:0/3826323765 conn(0x7f34140d0c50 msgr2=0x7f34140d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 -- 172.21.15.17:0/3826323765 shutdown_connections 2024-09-10T23:15:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 -- 172.21.15.17:0/3826323765 wait complete. 2024-09-10T23:15:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 Processor -- start 2024-09-10T23:15:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 -- start start 2024-09-10T23:15:38.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3414074040 0x7f34141515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140ccb10 0x7f3414150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34140d1850 0x7f3414070910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f341415fdf0 con 0x7f34140ccb10 2024-09-10T23:15:38.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f341415fc70 con 0x7f34140d1850 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3418e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f341415ff70 con 0x7f3414074040 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3409400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140ccb10 0x7f3414150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3409400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140ccb10 0x7f3414150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49104/0 (socket says 172.21.15.17:49104) 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3409400640 1 -- 172.21.15.17:0/1496502095 learned_addr learned my addr 172.21.15.17:0/1496502095 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3411e00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3414074040 0x7f34141515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3412800640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34140d1850 0x7f3414070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3409400640 1 -- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3414074040 msgr2=0x7f34141515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3409400640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3414074040 0x7f34141515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3409400640 1 -- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34140d1850 msgr2=0x7f3414070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3409400640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34140d1850 0x7f3414070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3409400640 1 -- 172.21.15.17:0/1496502095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34140ca8b0 con 0x7f34140ccb10 2024-09-10T23:15:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3412800640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34140d1850 0x7f3414070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.995+0000 7f3409400640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140ccb10 0x7f3414150a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00c400 tx=0x7f33fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f340aa00640 1 -- 172.21.15.17:0/1496502095 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc017070 con 0x7f34140ccb10 2024-09-10T23:15:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f340aa00640 1 -- 172.21.15.17:0/1496502095 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33fc005400 con 0x7f34140ccb10 2024-09-10T23:15:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f340aa00640 1 -- 172.21.15.17:0/1496502095 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc003860 con 0x7f34140ccb10 2024-09-10T23:15:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341415c3d0 con 0x7f34140ccb10 2024-09-10T23:15:38.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341415c990 con 0x7f34140ccb10 2024-09-10T23:15:38.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34140ccef0 con 0x7f34140ccb10 2024-09-10T23:15:38.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f340aa00640 1 -- 172.21.15.17:0/1496502095 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f33fc003a00 con 0x7f34140ccb10 2024-09-10T23:15:38.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f340aa00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33f00725e0 0x7f33f0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:38.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f340aa00640 1 -- 172.21.15.17:0/1496502095 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7f33fc0929d0 con 0x7f34140ccb10 2024-09-10T23:15:38.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:37.999+0000 7f3411e00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33f00725e0 0x7f33f0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:38.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:38.003+0000 7f3411e00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33f00725e0 0x7f33f0074aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34040af000 tx=0x7f340401b010 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:38.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:38.003+0000 7f340aa00640 1 -- 172.21.15.17:0/1496502095 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f33fc05d940 con 0x7f34140ccb10 2024-09-10T23:15:38.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:38.179+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f34140b12f0 con 0x7f34140ccb10 2024-09-10T23:15:39.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.815+0000 7f340aa00640 1 -- 172.21.15.17:0/1496502095 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7f33fc062370 con 0x7f34140ccb10 2024-09-10T23:15:39.818 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data_ec' created 2024-09-10T23:15:39.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33f00725e0 msgr2=0x7f33f0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:39.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33f00725e0 0x7f33f0074aa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34040af000 tx=0x7f340401b010 comp rx=0 tx=0).stop 2024-09-10T23:15:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140ccb10 msgr2=0x7f3414150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140ccb10 0x7f3414150a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00c400 tx=0x7f33fc00c8c0 comp rx=0 tx=0).stop 2024-09-10T23:15:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 shutdown_connections 2024-09-10T23:15:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33f00725e0 0x7f33f0074aa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34140d1850 0x7f3414070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34140ccb10 0x7f3414150a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 --2- 172.21.15.17:0/1496502095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3414074040 0x7f34141515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 >> 172.21.15.17:0/1496502095 conn(0x7f34140d0c50 msgr2=0x7f34140d03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 shutdown_connections 2024-09-10T23:15:39.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:39.819+0000 7f3418e00640 1 -- 172.21.15.17:0/1496502095 wait complete. 2024-09-10T23:15:39.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-10T23:15:40.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 -- 172.21.15.17:0/3695542238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6300d2080 msgr2=0x7fa6300aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 --2- 172.21.15.17:0/3695542238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6300d2080 0x7fa6300aea00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa628009c80 tx=0x7fa62801ccd0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 -- 172.21.15.17:0/3695542238 shutdown_connections 2024-09-10T23:15:40.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 --2- 172.21.15.17:0/3695542238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6300d2080 0x7fa6300aea00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 --2- 172.21.15.17:0/3695542238 >> v2:172.21.15.77:3300/0 conn(0x7fa6300b1220 0x7fa6300d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 -- 172.21.15.17:0/3695542238 >> 172.21.15.17:0/3695542238 conn(0x7fa63009a9f0 msgr2=0x7fa63009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:40.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 -- 172.21.15.17:0/3695542238 shutdown_connections 2024-09-10T23:15:40.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 -- 172.21.15.17:0/3695542238 wait complete. 2024-09-10T23:15:40.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 Processor -- start 2024-09-10T23:15:40.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 -- start start 2024-09-10T23:15:40.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6300b1220 0x7fa630159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6300d2080 0x7fa6300cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa63015f390 0x7fa63006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa630168cc0 con 0x7fa63015f390 2024-09-10T23:15:40.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa630168b40 con 0x7fa6300b1220 2024-09-10T23:15:40.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa636400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa630168e40 con 0x7fa6300d2080 2024-09-10T23:15:40.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa63015f390 0x7fa63006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa63015f390 0x7fa63006f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49116/0 (socket says 172.21.15.17:49116) 2024-09-10T23:15:40.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa62fe00640 1 -- 172.21.15.17:0/2925045178 learned_addr learned my addr 172.21.15.17:0/2925045178 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:40.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.011+0000 7fa62f400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6300b1220 0x7fa630159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa627e00640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6300d2080 0x7fa6300cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa62fe00640 1 -- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6300d2080 msgr2=0x7fa6300cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa62fe00640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6300d2080 0x7fa6300cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa62fe00640 1 -- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6300b1220 msgr2=0x7fa630159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa62fe00640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6300b1220 0x7fa630159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa62fe00640 1 -- 172.21.15.17:0/2925045178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63006e220 con 0x7fa63015f390 2024-09-10T23:15:40.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa62fe00640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa63015f390 0x7fa63006f2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa62801b380 tx=0x7fa628004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:40.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa627400640 1 -- 172.21.15.17:0/2925045178 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6280bb070 con 0x7fa63015f390 2024-09-10T23:15:40.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa627400640 1 -- 172.21.15.17:0/2925045178 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa628004a50 con 0x7fa63015f390 2024-09-10T23:15:40.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa627400640 1 -- 172.21.15.17:0/2925045178 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6280b2040 con 0x7fa63015f390 2024-09-10T23:15:40.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63006e500 con 0x7fa63015f390 2024-09-10T23:15:40.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa63006eac0 con 0x7fa63015f390 2024-09-10T23:15:40.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6300d1b40 con 0x7fa63015f390 2024-09-10T23:15:40.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.015+0000 7fa627400640 1 -- 172.21.15.17:0/2925045178 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa6280b5030 con 0x7fa63015f390 2024-09-10T23:15:40.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.019+0000 7fa627400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa60c0725e0 0x7fa60c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:40.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.019+0000 7fa627400640 1 -- 172.21.15.17:0/2925045178 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fa62812d940 con 0x7fa63015f390 2024-09-10T23:15:40.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.019+0000 7fa62f400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa60c0725e0 0x7fa60c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:40.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.019+0000 7fa62f400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa60c0725e0 0x7fa60c074aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa6200098e0 tx=0x7fa620009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:40.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.023+0000 7fa627400640 1 -- 172.21.15.17:0/2925045178 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa628016950 con 0x7fa63015f390 2024-09-10T23:15:40.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.199+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fa6300d2b50 con 0x7fa63015f390 2024-09-10T23:15:40.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.815+0000 7fa627400640 1 -- 172.21.15.17:0/2925045178 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7fa6280f8720 con 0x7fa63015f390 2024-09-10T23:15:40.820 INFO:teuthology.orchestra.run.smithi017.stderr:set pool 4 allow_ec_overwrites to true 2024-09-10T23:15:40.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa60c0725e0 msgr2=0x7fa60c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa60c0725e0 0x7fa60c074aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa6200098e0 tx=0x7fa620009060 comp rx=0 tx=0).stop 2024-09-10T23:15:40.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa63015f390 msgr2=0x7fa63006f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:40.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa63015f390 0x7fa63006f2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa62801b380 tx=0x7fa628004270 comp rx=0 tx=0).stop 2024-09-10T23:15:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 shutdown_connections 2024-09-10T23:15:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa60c0725e0 0x7fa60c074aa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa63015f390 0x7fa63006f2c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6300d2080 0x7fa6300cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 --2- 172.21.15.17:0/2925045178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6300b1220 0x7fa630159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 >> 172.21.15.17:0/2925045178 conn(0x7fa63009a9f0 msgr2=0x7fa6300711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 shutdown_connections 2024-09-10T23:15:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:40.823+0000 7fa636400640 1 -- 172.21.15.17:0/2925045178 wait complete. 2024-09-10T23:15:40.877 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-10T23:15:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 -- 172.21.15.17:0/787047987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb90815bca0 msgr2=0x7fb9080b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 --2- 172.21.15.17:0/787047987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb90815bca0 0x7fb9080b29d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009840 tx=0x7fb8f401c740 comp rx=0 tx=0).stop 2024-09-10T23:15:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 -- 172.21.15.17:0/787047987 shutdown_connections 2024-09-10T23:15:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 --2- 172.21.15.17:0/787047987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb90815bca0 0x7fb9080b29d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 -- 172.21.15.17:0/787047987 >> 172.21.15.17:0/787047987 conn(0x7fb90809a9f0 msgr2=0x7fb90809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 -- 172.21.15.17:0/787047987 shutdown_connections 2024-09-10T23:15:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 -- 172.21.15.17:0/787047987 wait complete. 2024-09-10T23:15:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 Processor -- start 2024-09-10T23:15:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 -- start start 2024-09-10T23:15:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9080b2f10 0x7fb9080b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb90815b8c0 0x7fb9081f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb90815bca0 0x7fb908151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb908169a60 con 0x7fb90815bca0 2024-09-10T23:15:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9081698e0 con 0x7fb90815b8c0 2024-09-10T23:15:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90e400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb908169be0 con 0x7fb9080b2f10 2024-09-10T23:15:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb90815bca0 0x7fb908151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb90815bca0 0x7fb908151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49122/0 (socket says 172.21.15.17:49122) 2024-09-10T23:15:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90da00640 1 -- 172.21.15.17:0/2194858676 learned_addr learned my addr 172.21.15.17:0/2194858676 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb907e00640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb90815b8c0 0x7fb9081f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90d000640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9080b2f10 0x7fb9080b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90da00640 1 -- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9080b2f10 msgr2=0x7fb9080b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90da00640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9080b2f10 0x7fb9080b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90da00640 1 -- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb90815b8c0 msgr2=0x7fb9081f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90da00640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb90815b8c0 0x7fb9081f7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90da00640 1 -- 172.21.15.17:0/2194858676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9081faaf0 con 0x7fb90815bca0 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb907e00640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb90815b8c0 0x7fb9081f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.031+0000 7fb90d000640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9080b2f10 0x7fb9080b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb90da00640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb90815bca0 0x7fb908151770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb900001ee0 tx=0x7fb900001fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:41.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb904c00640 1 -- 172.21.15.17:0/2194858676 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb900016020 con 0x7fb90815bca0 2024-09-10T23:15:41.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb904c00640 1 -- 172.21.15.17:0/2194858676 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb90000ab60 con 0x7fb90815bca0 2024-09-10T23:15:41.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb904c00640 1 -- 172.21.15.17:0/2194858676 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb900012420 con 0x7fb90815bca0 2024-09-10T23:15:41.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9081fadd0 con 0x7fb90815bca0 2024-09-10T23:15:41.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9081fb390 con 0x7fb90815bca0 2024-09-10T23:15:41.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9080b29d0 con 0x7fb90815bca0 2024-09-10T23:15:41.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb904c00640 1 -- 172.21.15.17:0/2194858676 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb90001b400 con 0x7fb90815bca0 2024-09-10T23:15:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb904c00640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8e80725e0 0x7fb8e8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb904c00640 1 -- 172.21.15.17:0/2194858676 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7fb900093e20 con 0x7fb90815bca0 2024-09-10T23:15:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.035+0000 7fb90d000640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8e80725e0 0x7fb8e8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.039+0000 7fb90d000640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8e80725e0 0x7fb8e8074aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc001720 tx=0x7fb8fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.039+0000 7fb904c00640 1 -- 172.21.15.17:0/2194858676 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb900020020 con 0x7fb90815bca0 2024-09-10T23:15:41.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.255+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fb908158940 con 0x7fb90815bca0 2024-09-10T23:15:41.591 INFO:tasks.ceph.mds.d.smithi077.stderr:2024-09-10T23:15:41.590+0000 7f4bc2a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:15:41.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.855+0000 7fb904c00640 1 -- 172.21.15.17:0/2194858676 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fb90005f0c0 con 0x7fb90815bca0 2024-09-10T23:15:41.859 INFO:teuthology.orchestra.run.smithi017.stderr:added data pool 4 to fsmap 2024-09-10T23:15:41.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8e80725e0 msgr2=0x7fb8e8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8e80725e0 0x7fb8e8074aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc001720 tx=0x7fb8fc009040 comp rx=0 tx=0).stop 2024-09-10T23:15:41.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb90815bca0 msgr2=0x7fb908151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:41.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb90815bca0 0x7fb908151770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb900001ee0 tx=0x7fb900001fd0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 shutdown_connections 2024-09-10T23:15:41.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8e80725e0 0x7fb8e8074aa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb90815bca0 0x7fb908151770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb90815b8c0 0x7fb9081f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 --2- 172.21.15.17:0/2194858676 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9080b2f10 0x7fb9080b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:41.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 >> 172.21.15.17:0/2194858676 conn(0x7fb90809a9f0 msgr2=0x7fb908154a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:41.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 shutdown_connections 2024-09-10T23:15:41.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:41.859+0000 7fb90e400640 1 -- 172.21.15.17:0/2194858676 wait complete. 2024-09-10T23:15:41.886 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.035+0000 7fc027200640 1 -- 172.21.15.17:0/1360853697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc020070ad0 msgr2=0x7fc02015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.035+0000 7fc027200640 1 --2- 172.21.15.17:0/1360853697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc020070ad0 0x7fc02015f060 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0200cf010 tx=0x7fc01001c8e0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.035+0000 7fc027200640 1 -- 172.21.15.17:0/1360853697 shutdown_connections 2024-09-10T23:15:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.035+0000 7fc027200640 1 --2- 172.21.15.17:0/1360853697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0200d1830 0x7fc02015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.035+0000 7fc027200640 1 --2- 172.21.15.17:0/1360853697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc020070ad0 0x7fc02015f060 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.035+0000 7fc027200640 1 -- 172.21.15.17:0/1360853697 >> 172.21.15.17:0/1360853697 conn(0x7fc0200d1d60 msgr2=0x7fc0200d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.035+0000 7fc027200640 1 -- 172.21.15.17:0/1360853697 shutdown_connections 2024-09-10T23:15:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.035+0000 7fc027200640 1 -- 172.21.15.17:0/1360853697 wait complete. 2024-09-10T23:15:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 Processor -- start 2024-09-10T23:15:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 -- start start 2024-09-10T23:15:42.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc020070ad0 0x7fc020165200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0200cf320 0x7fc020157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0200d1830 0x7fc0200b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0201693d0 con 0x7fc020070ad0 2024-09-10T23:15:42.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc020169250 con 0x7fc0200d1830 2024-09-10T23:15:42.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc020169550 con 0x7fc0200cf320 2024-09-10T23:15:42.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc020070ad0 0x7fc020165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc020070ad0 0x7fc020165200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49132/0 (socket says 172.21.15.17:49132) 2024-09-10T23:15:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01fe00640 1 -- 172.21.15.17:0/3451634850 learned_addr learned my addr 172.21.15.17:0/3451634850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc017e00640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0200cf320 0x7fc020157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc025200640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0200d1830 0x7fc0200b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01fe00640 1 -- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0200cf320 msgr2=0x7fc020157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01fe00640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0200cf320 0x7fc020157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01fe00640 1 -- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0200d1830 msgr2=0x7fc0200b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01fe00640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0200d1830 0x7fc0200b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01fe00640 1 -- 172.21.15.17:0/3451634850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc020152730 con 0x7fc020070ad0 2024-09-10T23:15:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01fe00640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc020070ad0 0x7fc020165200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc01001a510 tx=0x7fc010005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01cc00640 1 -- 172.21.15.17:0/3451634850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0100ba020 con 0x7fc020070ad0 2024-09-10T23:15:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01cc00640 1 -- 172.21.15.17:0/3451634850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc010005400 con 0x7fc020070ad0 2024-09-10T23:15:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc01cc00640 1 -- 172.21.15.17:0/3451634850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0100b2040 con 0x7fc020070ad0 2024-09-10T23:15:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02006fce0 con 0x7fc020070ad0 2024-09-10T23:15:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.039+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc020165990 con 0x7fc020070ad0 2024-09-10T23:15:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.043+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0200cfc60 con 0x7fc020070ad0 2024-09-10T23:15:42.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.043+0000 7fc01cc00640 1 -- 172.21.15.17:0/3451634850 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc0100046d0 con 0x7fc020070ad0 2024-09-10T23:15:42.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.043+0000 7fc01cc00640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbffc0725e0 0x7fbffc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.043+0000 7fc01cc00640 1 -- 172.21.15.17:0/3451634850 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc01012d6c0 con 0x7fc020070ad0 2024-09-10T23:15:42.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.043+0000 7fc017e00640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbffc0725e0 0x7fbffc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.043+0000 7fc017e00640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbffc0725e0 0x7fbffc074aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc008009600 tx=0x7fc0080091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:42.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.047+0000 7fc01cc00640 1 -- 172.21.15.17:0/3451634850 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc0100c4060 con 0x7fc020070ad0 2024-09-10T23:15:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc020159070 con 0x7fc020070ad0 2024-09-10T23:15:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc01cc00640 1 -- 172.21.15.17:0/3451634850 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5210 (secure 0 0 0) 0x7fc0100164d0 con 0x7fc020070ad0 2024-09-10T23:15:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:42.266 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"btime":"2024-09-10T23:15:41:856495+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:41.259151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:15:42.266 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-09-10T23:15:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbffc0725e0 msgr2=0x7fbffc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbffc0725e0 0x7fbffc074aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc008009600 tx=0x7fc0080091e0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc020070ad0 msgr2=0x7fc020165200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc020070ad0 0x7fc020165200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc01001a510 tx=0x7fc010005e20 comp rx=0 tx=0).stop 2024-09-10T23:15:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 shutdown_connections 2024-09-10T23:15:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbffc0725e0 0x7fbffc074aa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0200d1830 0x7fc0200b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0200cf320 0x7fc020157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 --2- 172.21.15.17:0/3451634850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc020070ad0 0x7fc020165200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 >> 172.21.15.17:0/3451634850 conn(0x7fc0200d1d60 msgr2=0x7fc0200d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 shutdown_connections 2024-09-10T23:15:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.263+0000 7fc027200640 1 -- 172.21.15.17:0/3451634850 wait complete. 2024-09-10T23:15:42.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:42.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.431+0000 7f445fe00640 1 -- 172.21.15.17:0/1030844602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445815f770 msgr2=0x7f44580cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.431+0000 7f445fe00640 1 --2- 172.21.15.17:0/1030844602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445815f770 0x7f44580cc870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4444009900 tx=0x7f444401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.431+0000 7f445fe00640 1 -- 172.21.15.17:0/1030844602 shutdown_connections 2024-09-10T23:15:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.431+0000 7f445fe00640 1 --2- 172.21.15.17:0/1030844602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445815f770 0x7f44580cc870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.431+0000 7f445fe00640 1 -- 172.21.15.17:0/1030844602 >> 172.21.15.17:0/1030844602 conn(0x7f44580d1d60 msgr2=0x7f44580d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.431+0000 7f445fe00640 1 -- 172.21.15.17:0/1030844602 shutdown_connections 2024-09-10T23:15:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.431+0000 7f445fe00640 1 -- 172.21.15.17:0/1030844602 wait complete. 2024-09-10T23:15:42.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 Processor -- start 2024-09-10T23:15:42.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 -- start start 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4458070ad0 0x7f4458149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44580d1830 0x7f445814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445815f770 0x7f445814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f445816a520 con 0x7f44580d1830 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f445816a3a0 con 0x7f4458070ad0 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f445816a6a0 con 0x7f445815f770 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44580d1830 0x7f445814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44580d1830 0x7f445814e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49152/0 (socket says 172.21.15.17:49152) 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445ca00640 1 -- 172.21.15.17:0/200980560 learned_addr learned my addr 172.21.15.17:0/200980560 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:42.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445d400640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4458070ad0 0x7f4458149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445de00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445815f770 0x7f445814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445ca00640 1 -- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445815f770 msgr2=0x7f445814e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445ca00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445815f770 0x7f445814e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445ca00640 1 -- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4458070ad0 msgr2=0x7f4458149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445ca00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4458070ad0 0x7f4458149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445ca00640 1 -- 172.21.15.17:0/200980560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44580b78a0 con 0x7f44580d1830 2024-09-10T23:15:42.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445ca00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44580d1830 0x7f445814e0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44440b0040 tx=0x7f44440a5840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:42.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f4455600640 1 -- 172.21.15.17:0/200980560 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44440b2040 con 0x7f44580d1830 2024-09-10T23:15:42.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f4455600640 1 -- 172.21.15.17:0/200980560 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4444003970 con 0x7f44580d1830 2024-09-10T23:15:42.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f4455600640 1 -- 172.21.15.17:0/200980560 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444003d80 con 0x7f44580d1830 2024-09-10T23:15:42.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44580b4de0 con 0x7f44580d1830 2024-09-10T23:15:42.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44580b50c0 con 0x7f44580d1830 2024-09-10T23:15:42.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.435+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445815f060 con 0x7f44580d1830 2024-09-10T23:15:42.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.439+0000 7f4455600640 1 -- 172.21.15.17:0/200980560 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f44440c1450 con 0x7f44580d1830 2024-09-10T23:15:42.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.439+0000 7f4455600640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4438072610 0x7f4438074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.439+0000 7f4455600640 1 -- 172.21.15.17:0/200980560 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f444412dc30 con 0x7f44580d1830 2024-09-10T23:15:42.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.439+0000 7f445d400640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4438072610 0x7f4438074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.439+0000 7f445d400640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4438072610 0x7f4438074ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f44580cd440 tx=0x7f444c007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:42.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.443+0000 7f4455600640 1 -- 172.21.15.17:0/200980560 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f44440164d0 con 0x7f44580d1830 2024-09-10T23:15:42.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.619+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4458159de0 con 0x7f44580d1830 2024-09-10T23:15:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f4455600640 1 -- 172.21.15.17:0/200980560 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18538 (secure 0 0 0) 0x7f44440f89b0 con 0x7f44580d1830 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:42.625 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:41.258986+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4438072610 msgr2=0x7f4438074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4438072610 0x7f4438074ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f44580cd440 tx=0x7f444c007e40 comp rx=0 tx=0).stop 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44580d1830 msgr2=0x7f445814e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44580d1830 0x7f445814e0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44440b0040 tx=0x7f44440a5840 comp rx=0 tx=0).stop 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 shutdown_connections 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4438072610 0x7f4438074ad0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445815f770 0x7f445814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44580d1830 0x7f445814e0f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 --2- 172.21.15.17:0/200980560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4458070ad0 0x7f4458149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 >> 172.21.15.17:0/200980560 conn(0x7f44580d1d60 msgr2=0x7f44580cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 shutdown_connections 2024-09-10T23:15:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.623+0000 7f445fe00640 1 -- 172.21.15.17:0/200980560 wait complete. 2024-09-10T23:15:42.647 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.787+0000 7fd95d200640 1 -- 172.21.15.17:0/1923939633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9580d20c0 msgr2=0x7fd958072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.787+0000 7fd95d200640 1 --2- 172.21.15.17:0/1923939633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9580d20c0 0x7fd958072320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd940009900 tx=0x7fd94001c7c0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.787+0000 7fd95d200640 1 -- 172.21.15.17:0/1923939633 shutdown_connections 2024-09-10T23:15:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.787+0000 7fd95d200640 1 --2- 172.21.15.17:0/1923939633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9580d20c0 0x7fd958072320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.787+0000 7fd95d200640 1 -- 172.21.15.17:0/1923939633 >> 172.21.15.17:0/1923939633 conn(0x7fd95809a9f0 msgr2=0x7fd95809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:42.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.787+0000 7fd95d200640 1 -- 172.21.15.17:0/1923939633 shutdown_connections 2024-09-10T23:15:42.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.787+0000 7fd95d200640 1 -- 172.21.15.17:0/1923939633 wait complete. 2024-09-10T23:15:42.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 Processor -- start 2024-09-10T23:15:42.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 -- start start 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9580d20c0 0x7fd958152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95815b890 0x7fd958154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95815bc70 0x7fd958155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd958169bd0 con 0x7fd95815bc70 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd958169a50 con 0x7fd95815b890 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd958169d50 con 0x7fd9580d20c0 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95815bc70 0x7fd958155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95815bc70 0x7fd958155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49178/0 (socket says 172.21.15.17:49178) 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957e00640 1 -- 172.21.15.17:0/3784835554 learned_addr learned my addr 172.21.15.17:0/3784835554 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd94ea00640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95815b890 0x7fd958154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957400640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9580d20c0 0x7fd958152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957e00640 1 -- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9580d20c0 msgr2=0x7fd958152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957e00640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9580d20c0 0x7fd958152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957e00640 1 -- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95815b890 msgr2=0x7fd958154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957e00640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95815b890 0x7fd958154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957e00640 1 -- 172.21.15.17:0/3784835554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd958152680 con 0x7fd95815bc70 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd94ea00640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95815b890 0x7fd958154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd957e00640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95815bc70 0x7fd958155260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd95000c710 tx=0x7fd95000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd94fe00640 1 -- 172.21.15.17:0/3784835554 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950003b80 con 0x7fd95815bc70 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd94fe00640 1 -- 172.21.15.17:0/3784835554 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd950003d20 con 0x7fd95815bc70 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd94fe00640 1 -- 172.21.15.17:0/3784835554 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95000aab0 con 0x7fd95815bc70 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9580b66b0 con 0x7fd95815bc70 2024-09-10T23:15:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.791+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9580b6c70 con 0x7fd95815bc70 2024-09-10T23:15:42.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.795+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd958072320 con 0x7fd95815bc70 2024-09-10T23:15:42.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.795+0000 7fd94fe00640 1 -- 172.21.15.17:0/3784835554 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd95000ac50 con 0x7fd95815bc70 2024-09-10T23:15:42.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.795+0000 7fd94fe00640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9340725e0 0x7fd934074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:42.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.795+0000 7fd94fe00640 1 -- 172.21.15.17:0/3784835554 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd950093380 con 0x7fd95815bc70 2024-09-10T23:15:42.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.795+0000 7fd957400640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9340725e0 0x7fd934074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:42.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.795+0000 7fd957400640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9340725e0 0x7fd934074aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd948000f70 tx=0x7fd948009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:42.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.799+0000 7fd94fe00640 1 -- 172.21.15.17:0/3784835554 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd95000ce20 con 0x7fd95815bc70 2024-09-10T23:15:42.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.975+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9581559a0 con 0x7fd95815bc70 2024-09-10T23:15:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd94fe00640 1 -- 172.21.15.17:0/3784835554 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18538 (secure 0 0 0) 0x7fd95005e710 con 0x7fd95815bc70 2024-09-10T23:15:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:42.981 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:41.258986+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9340725e0 msgr2=0x7fd934074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9340725e0 0x7fd934074aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd948000f70 tx=0x7fd948009040 comp rx=0 tx=0).stop 2024-09-10T23:15:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95815bc70 msgr2=0x7fd958155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95815bc70 0x7fd958155260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd95000c710 tx=0x7fd95000cbd0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 shutdown_connections 2024-09-10T23:15:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9340725e0 0x7fd934074aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd95815bc70 0x7fd958155260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd95815b890 0x7fd958154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 --2- 172.21.15.17:0/3784835554 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9580d20c0 0x7fd958152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 >> 172.21.15.17:0/3784835554 conn(0x7fd95809a9f0 msgr2=0x7fd9580aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 shutdown_connections 2024-09-10T23:15:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:42.979+0000 7fd95d200640 1 -- 172.21.15.17:0/3784835554 wait complete. 2024-09-10T23:15:43.020 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:43.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 -- 172.21.15.17:0/375020067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 msgr2=0x7f559006e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 --2- 172.21.15.17:0/375020067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 0x7f559006e750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f55900b4480 tx=0x7f557c0203e0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 -- 172.21.15.17:0/375020067 shutdown_connections 2024-09-10T23:15:43.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 --2- 172.21.15.17:0/375020067 >> v2:172.21.15.77:3300/0 conn(0x7f55900b32d0 0x7f5590150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 --2- 172.21.15.17:0/375020067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 0x7f559006e750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 -- 172.21.15.17:0/375020067 >> 172.21.15.17:0/375020067 conn(0x7f559006cfc0 msgr2=0x7f559006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:43.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 -- 172.21.15.17:0/375020067 shutdown_connections 2024-09-10T23:15:43.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 -- 172.21.15.17:0/375020067 wait complete. 2024-09-10T23:15:43.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 Processor -- start 2024-09-10T23:15:43.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 -- start start 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900b32d0 0x7f559013be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55900cf230 0x7f55900b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 0x7f55900b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f55900d0330 con 0x7f55900cf610 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f55900d01b0 con 0x7f55900b32d0 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.163+0000 7f5598400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f55900d04b0 con 0x7f55900cf230 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5596400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 0x7f55900b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5595a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900b32d0 0x7f559013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5596400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 0x7f55900b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49196/0 (socket says 172.21.15.17:49196) 2024-09-10T23:15:43.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5596400640 1 -- 172.21.15.17:0/4244852423 learned_addr learned my addr 172.21.15.17:0/4244852423 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5595000640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55900cf230 0x7f55900b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5596400640 1 -- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55900cf230 msgr2=0x7f55900b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5596400640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55900cf230 0x7f55900b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5596400640 1 -- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900b32d0 msgr2=0x7f559013be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5596400640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900b32d0 0x7f559013be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5596400640 1 -- 172.21.15.17:0/4244852423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55901f5f30 con 0x7f55900cf610 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5596400640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 0x7f55900b1db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f558800ea50 tx=0x7f558800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f558d600640 1 -- 172.21.15.17:0/4244852423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558800cdc0 con 0x7f55900cf610 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f558d600640 1 -- 172.21.15.17:0/4244852423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5588004c40 con 0x7f55900cf610 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f558d600640 1 -- 172.21.15.17:0/4244852423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588005280 con 0x7f55900cf610 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55901f6210 con 0x7f55900cf610 2024-09-10T23:15:43.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55901f67d0 con 0x7f55900cf610 2024-09-10T23:15:43.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5590150d70 con 0x7f55900cf610 2024-09-10T23:15:43.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.167+0000 7f558d600640 1 -- 172.21.15.17:0/4244852423 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f558800f040 con 0x7f55900cf610 2024-09-10T23:15:43.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.171+0000 7f558d600640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55700725e0 0x7f5570074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.171+0000 7f558d600640 1 -- 172.21.15.17:0/4244852423 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5588093c80 con 0x7f55900cf610 2024-09-10T23:15:43.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.171+0000 7f5595a00640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55700725e0 0x7f5570074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.171+0000 7f5595a00640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55700725e0 0x7f5570074aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5584007fd0 tx=0x7f5584009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.175+0000 7f558d600640 1 -- 172.21.15.17:0/4244852423 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5588016030 con 0x7f55900cf610 2024-09-10T23:15:43.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5590153a00 con 0x7f55900cf610 2024-09-10T23:15:43.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f558d600640 1 -- 172.21.15.17:0/4244852423 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5210 (secure 0 0 0) 0x7f558805e930 con 0x7f55900cf610 2024-09-10T23:15:43.386 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:43.386 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"btime":"2024-09-10T23:15:41:856495+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:41.259151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:15:43.387 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-09-10T23:15:43.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55700725e0 msgr2=0x7f5570074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55700725e0 0x7f5570074aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5584007fd0 tx=0x7f5584009040 comp rx=0 tx=0).stop 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 msgr2=0x7f55900b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 0x7f55900b1db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f558800ea50 tx=0x7f558800ef10 comp rx=0 tx=0).stop 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 shutdown_connections 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55700725e0 0x7f5570074aa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900cf610 0x7f55900b1db0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55900cf230 0x7f55900b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 --2- 172.21.15.17:0/4244852423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900b32d0 0x7f559013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 >> 172.21.15.17:0/4244852423 conn(0x7f559006cfc0 msgr2=0x7f55901525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 shutdown_connections 2024-09-10T23:15:43.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.383+0000 7f5598400640 1 -- 172.21.15.17:0/4244852423 wait complete. 2024-09-10T23:15:43.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:43.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 -- 172.21.15.17:0/1663255524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81602d0 msgr2=0x7f49f80cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 --2- 172.21.15.17:0/1663255524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81602d0 0x7f49f80cffe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49f806fc80 tx=0x7f49e001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 -- 172.21.15.17:0/1663255524 shutdown_connections 2024-09-10T23:15:43.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 --2- 172.21.15.17:0/1663255524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f81602d0 0x7f49f80cffe0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 --2- 172.21.15.17:0/1663255524 >> v2:172.21.15.77:3300/0 conn(0x7f49f8152b40 0x7f49f80b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 -- 172.21.15.17:0/1663255524 >> 172.21.15.17:0/1663255524 conn(0x7f49f806cfc0 msgr2=0x7f49f806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:43.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 -- 172.21.15.17:0/1663255524 shutdown_connections 2024-09-10T23:15:43.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 -- 172.21.15.17:0/1663255524 wait complete. 2024-09-10T23:15:43.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 Processor -- start 2024-09-10T23:15:43.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 -- start start 2024-09-10T23:15:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f80d0520 0x7f49f8142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.551+0000 7f49fd200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8152b40 0x7f49f8141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49fd200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f81602d0 0x7f49f81442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49fd200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f49f8168fd0 con 0x7f49f80d0520 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49fd200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49f8168e50 con 0x7f49f81602d0 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49fd200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f49f8169150 con 0x7f49f8152b40 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f80d0520 0x7f49f8142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f80d0520 0x7f49f8142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49218/0 (socket says 172.21.15.17:49218) 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f5e00640 1 -- 172.21.15.17:0/3898652555 learned_addr learned my addr 172.21.15.17:0/3898652555 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49efe00640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8152b40 0x7f49f8141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f6800640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f81602d0 0x7f49f81442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f5e00640 1 -- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8152b40 msgr2=0x7f49f8141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f5e00640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8152b40 0x7f49f8141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f5e00640 1 -- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f81602d0 msgr2=0x7f49f81442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f5e00640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f81602d0 0x7f49f81442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f5e00640 1 -- 172.21.15.17:0/3898652555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f81542a0 con 0x7f49f80d0520 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f6800640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f81602d0 0x7f49f81442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49f5e00640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f80d0520 0x7f49f8142690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49e800b580 tx=0x7f49e800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:43.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49ee000640 1 -- 172.21.15.17:0/3898652555 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8014070 con 0x7f49f80d0520 2024-09-10T23:15:43.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49ee000640 1 -- 172.21.15.17:0/3898652555 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49e8010980 con 0x7f49f80d0520 2024-09-10T23:15:43.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f81420e0 con 0x7f49f80d0520 2024-09-10T23:15:43.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49ee000640 1 -- 172.21.15.17:0/3898652555 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8010dd0 con 0x7f49f80d0520 2024-09-10T23:15:43.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f8153650 con 0x7f49f80d0520 2024-09-10T23:15:43.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f8153890 con 0x7f49f80d0520 2024-09-10T23:15:43.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.555+0000 7f49ee000640 1 -- 172.21.15.17:0/3898652555 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f49e800f3c0 con 0x7f49f80d0520 2024-09-10T23:15:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.559+0000 7f49ee000640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49d4072610 0x7f49d4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.559+0000 7f49ee000640 1 -- 172.21.15.17:0/3898652555 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f49e8093720 con 0x7f49f80d0520 2024-09-10T23:15:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.559+0000 7f49efe00640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49d4072610 0x7f49d4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.559+0000 7f49efe00640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49d4072610 0x7f49d4074ad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f49e00af000 tx=0x7f49e001b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.563+0000 7f49ee000640 1 -- 172.21.15.17:0/3898652555 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f49f8153890 con 0x7f49f80d0520 2024-09-10T23:15:43.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.747+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49f80b48d0 con 0x7f49f80d0520 2024-09-10T23:15:43.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.747+0000 7f49ee000640 1 -- 172.21.15.17:0/3898652555 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18538 (secure 0 0 0) 0x7f49e805ea30 con 0x7f49f80d0520 2024-09-10T23:15:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:43.752 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:41.258986+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:43.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49d4072610 msgr2=0x7f49d4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49d4072610 0x7f49d4074ad0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f49e00af000 tx=0x7f49e001b100 comp rx=0 tx=0).stop 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f80d0520 msgr2=0x7f49f8142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f80d0520 0x7f49f8142690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f49e800b580 tx=0x7f49e800ba40 comp rx=0 tx=0).stop 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 shutdown_connections 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49d4072610 0x7f49d4074ad0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49f81602d0 0x7f49f81442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49f8152b40 0x7f49f8141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 --2- 172.21.15.17:0/3898652555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49f80d0520 0x7f49f8142690 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 >> 172.21.15.17:0/3898652555 conn(0x7f49f806cfc0 msgr2=0x7f49f814e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 shutdown_connections 2024-09-10T23:15:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:43.751+0000 7f49fd200640 1 -- 172.21.15.17:0/3898652555 wait complete. 2024-09-10T23:15:44.176 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:15:36.206224+0000', 'modified': '2024-09-10T23:15:41.259151+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4378}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4378': {'gid': 4378, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6836/913768740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 913768740}, {'type': 'v1', 'addr': '172.21.15.77:6836', 'nonce': 913768740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4378, 'qdb_cluster': [4378]} 2024-09-10T23:15:44.177 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:15:44.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T23:15:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 -- 172.21.15.17:0/1072277935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 msgr2=0x7fa1c415fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 --2- 172.21.15.17:0/1072277935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 0x7fa1c415fa00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4073640 tx=0x7fa1bc01ccc0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 -- 172.21.15.17:0/1072277935 shutdown_connections 2024-09-10T23:15:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 --2- 172.21.15.17:0/1072277935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 0x7fa1c415fa00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 --2- 172.21.15.17:0/1072277935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c40cedf0 0x7fa1c40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 --2- 172.21.15.17:0/1072277935 >> v2:172.21.15.77:3300/0 conn(0x7fa1c415be80 0x7fa1c40d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 -- 172.21.15.17:0/1072277935 >> 172.21.15.17:0/1072277935 conn(0x7fa1c40d1da0 msgr2=0x7fa1c40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 -- 172.21.15.17:0/1072277935 shutdown_connections 2024-09-10T23:15:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 -- 172.21.15.17:0/1072277935 wait complete. 2024-09-10T23:15:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 Processor -- start 2024-09-10T23:15:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 -- start start 2024-09-10T23:15:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 0x7fa1c4152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c415be80 0x7fa1c415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1c415a070 0x7fa1c4157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c40ccd90 con 0x7fa1c40b5130 2024-09-10T23:15:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c40ccc10 con 0x7fa1c415a070 2024-09-10T23:15:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1caa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c40ccf10 con 0x7fa1c415be80 2024-09-10T23:15:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 0x7fa1c4152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 0x7fa1c4152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49228/0 (socket says 172.21.15.17:49228) 2024-09-10T23:15:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c3e00640 1 -- 172.21.15.17:0/481508925 learned_addr learned my addr 172.21.15.17:0/481508925 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c3e00640 1 -- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c415be80 msgr2=0x7fa1c415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c415be80 0x7fa1c415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c3e00640 1 -- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1c415a070 msgr2=0x7fa1c4157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1c415a070 0x7fa1c4157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c3e00640 1 -- 172.21.15.17:0/481508925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c40c6d40 con 0x7fa1c40b5130 2024-09-10T23:15:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 0x7fa1c4152810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400d980 tx=0x7fa1b400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.323+0000 7fa1c0c00640 1 -- 172.21.15.17:0/481508925 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4017070 con 0x7fa1c40b5130 2024-09-10T23:15:44.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.327+0000 7fa1c0c00640 1 -- 172.21.15.17:0/481508925 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b4009d20 con 0x7fa1c40b5130 2024-09-10T23:15:44.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.327+0000 7fa1c0c00640 1 -- 172.21.15.17:0/481508925 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4004280 con 0x7fa1c40b5130 2024-09-10T23:15:44.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.327+0000 7fa1caa00640 1 -- 172.21.15.17:0/481508925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c40c7020 con 0x7fa1c40b5130 2024-09-10T23:15:44.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.327+0000 7fa1caa00640 1 -- 172.21.15.17:0/481508925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c40c75e0 con 0x7fa1c40b5130 2024-09-10T23:15:44.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.327+0000 7fa1c0c00640 1 -- 172.21.15.17:0/481508925 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa1b4005020 con 0x7fa1c40b5130 2024-09-10T23:15:44.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1c0c00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1a00725e0 0x7fa1a0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1c0c00640 1 -- 172.21.15.17:0/481508925 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa1b4093a60 con 0x7fa1c40b5130 2024-09-10T23:15:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 Processor -- start 2024-09-10T23:15:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 -- start start 2024-09-10T23:15:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1a00725e0 0x7fa1a0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b838fdc0 0x5635b83901a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b83906e0 0x5635b8343ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1a00725e0 0x7fa1a0074aa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac005d90 tx=0x7fa1ac005ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 0x5635b8344600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5635b82603f0 con 0x5635b83906e0 2024-09-10T23:15:44.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5635b819db20 con 0x5635b838fdc0 2024-09-10T23:15:44.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5635b818cf50 con 0x5635b8344220 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b83906e0 0x5635b8343ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b83906e0 0x5635b8343ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49242/0 (socket says 172.21.15.17:49242) 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 -- 172.21.15.17:0/1515176796 learned_addr learned my addr 172.21.15.17:0/1515176796 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1c8a00640 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 0x5635b8344600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b838fdc0 0x5635b83901a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 -- 172.21.15.17:0/1515176796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 msgr2=0x5635b8344600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 0x5635b8344600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 -- 172.21.15.17:0/1515176796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b838fdc0 msgr2=0x5635b83901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b838fdc0 0x5635b83901a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 -- 172.21.15.17:0/1515176796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b8154590 con 0x5635b83906e0 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1c8a00640 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 0x5635b8344600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b83906e0 0x5635b8343ce0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00dc90 tx=0x7fa1ac010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964574147a7c711c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1b8c00640 1 -- 172.21.15.17:0/1515176796 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac01d440 con 0x5635b83906e0 2024-09-10T23:15:44.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1b8c00640 1 -- 172.21.15.17:0/1515176796 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1ac022070 con 0x5635b83906e0 2024-09-10T23:15:44.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1b8c00640 1 -- 172.21.15.17:0/1515176796 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac01d950 con 0x5635b83906e0 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 -- 172.21.15.17:0/1515176796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b83906e0 msgr2=0x5635b8343ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b83906e0 0x5635b8343ce0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac00dc90 tx=0x7fa1ac010000 comp rx=0 tx=0).stop 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 -- 172.21.15.17:0/1515176796 shutdown_connections 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 0x5635b8344600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b83906e0 0x5635b8343ce0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/1515176796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b838fdc0 0x5635b83901a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 -- 172.21.15.17:0/1515176796 >> 172.21.15.17:0/1515176796 conn(0x5635b8229130 msgr2=0x5635b836ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 -- 172.21.15.17:0/1515176796 shutdown_connections 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.331+0000 7fa1cdda0000 1 -- 172.21.15.17:0/1515176796 wait complete. 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 -- start start 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 Processor -- start 2024-09-10T23:15:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b837a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b838fdc0 0x5635b837a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b837ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5635b81275d0 con 0x5635b8344220 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5635b8190d60 con 0x5635b83906e0 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5635b8133500 con 0x5635b838fdc0 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 10 client.0 _ll_register_callbacks cb 0x5635b8137810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b837a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b837a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49250/0 (socket says 172.21.15.17:49250) 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c3e00640 1 -- 172.21.15.17:0/3843863243 learned_addr learned my addr 172.21.15.17:0/3843863243 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c8a00640 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b837ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b838fdc0 0x5635b837a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c3e00640 1 -- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b838fdc0 msgr2=0x5635b837a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:44.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b838fdc0 0x5635b837a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c3e00640 1 -- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 msgr2=0x5635b837ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:44.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b837ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c3e00640 1 -- 172.21.15.17:0/3843863243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b812b170 con 0x5635b8344220 2024-09-10T23:15:44.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b837a360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4091bb0 tx=0x7fa1b405dec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfb10860409b5ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1b1600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:15:44.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1b1600640 1 -- 172.21.15.17:0/3843863243 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4023550 con 0x5635b8344220 2024-09-10T23:15:44.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1b1600640 1 -- 172.21.15.17:0/3843863243 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa1b405d8c0 con 0x5635b8344220 2024-09-10T23:15:44.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 -- 172.21.15.17:0/3843863243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635b81250f0 con 0x5635b8344220 2024-09-10T23:15:44.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1b1600640 1 -- 172.21.15.17:0/3843863243 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa1b4063140 con 0x5635b8344220 2024-09-10T23:15:44.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 10 client.4485 fetch_fsmap learned FSMap version 7 2024-09-10T23:15:44.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 -- 172.21.15.17:0/3843863243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5635b8211ef0 con 0x5635b8344220 2024-09-10T23:15:44.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1b1600640 1 -- 172.21.15.17:0/3843863243 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5635b81250f0 con 0x5635b8344220 2024-09-10T23:15:44.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1b1600640 1 -- 172.21.15.17:0/3843863243 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7fa1b407fb20 con 0x5635b8344220 2024-09-10T23:15:44.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 10 client.4485 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T23:15:44.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 10 client.4485 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 20 client.4485 populate_metadata read hostname 'smithi017' 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x5635b837b7f0 0x5635b83a1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 4 client.4485 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1cdda0000 1 -- 172.21.15.17:0/3843863243 --> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635b819fa70 con 0x5635b837b7f0 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.335+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x5635b837b7f0 0x5635b83a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x5635b837b7f0 0x5635b83a1070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7993419f7f275b8e server_cookie=5a73c9e1e5c864b5 in_seq=0 out_seq=0 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1b1600640 10 client.4485 ms_handle_connect on v2:172.21.15.77:6834/913768740 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1b1600640 1 -- 172.21.15.17:0/3843863243 <== mds.0 v2:172.21.15.77:6834/913768740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5635b819fa70 con 0x5635b837b7f0 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1b1600640 10 client.4485 handle_command_reply: tid=0 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 client.4485 shutdown 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 -- 172.21.15.17:0/3843863243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 msgr2=0x5635b837a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b837a360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4091bb0 tx=0x7fa1b405dec0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 -- 172.21.15.17:0/3843863243 shutdown_connections 2024-09-10T23:15:44.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x5635b837b7f0 0x5635b83a1070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b837ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b838fdc0 0x5635b837a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/3843863243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b837a360 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1b1600640 0 client.4485 ms_handle_reset on v2:172.21.15.77:6834/913768740 2024-09-10T23:15:44.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 -- 172.21.15.17:0/3843863243 >> 172.21.15.17:0/3843863243 conn(0x5635b8229130 msgr2=0x5635b833e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 -- 172.21.15.17:0/3843863243 shutdown_connections 2024-09-10T23:15:44.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 1 -- 172.21.15.17:0/3843863243 wait complete. 2024-09-10T23:15:44.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.339+0000 7fa1cdda0000 20 client.4485 trim_cache size 0 max 16384 2024-09-10T23:15:44.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 Processor -- start 2024-09-10T23:15:44.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- start start 2024-09-10T23:15:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b834ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b838fdc0 0x5635b834cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b83a1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c41f9e90 con 0x5635b8344220 2024-09-10T23:15:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5635b8158ec0 con 0x5635b83906e0 2024-09-10T23:15:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5635b819c8f0 con 0x5635b838fdc0 2024-09-10T23:15:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b834ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b834ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49252/0 (socket says 172.21.15.17:49252) 2024-09-10T23:15:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c3e00640 1 -- 172.21.15.17:0/942779488 learned_addr learned my addr 172.21.15.17:0/942779488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c3e00640 1 -- 172.21.15.17:0/942779488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b838fdc0 msgr2=0x5635b834cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c8a00640 1 --2- 172.21.15.17:0/942779488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b83a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/942779488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b838fdc0 0x5635b834cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c3e00640 1 -- 172.21.15.17:0/942779488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 msgr2=0x5635b83a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/942779488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b83a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c3e00640 1 -- 172.21.15.17:0/942779488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b81e8d90 con 0x5635b8344220 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c8a00640 1 --2- 172.21.15.17:0/942779488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b83a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/942779488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b834ca60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1b407ffd0 tx=0x7fa1b405e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4489887a30992e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1b3e00640 1 -- 172.21.15.17:0/942779488 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b405ed60 con 0x5635b8344220 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1b3e00640 1 -- 172.21.15.17:0/942779488 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b4067b60 con 0x5635b8344220 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1b3e00640 1 -- 172.21.15.17:0/942779488 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b405d8c0 con 0x5635b8344220 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- 172.21.15.17:0/942779488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 msgr2=0x5635b834ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/942779488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b834ca60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1b407ffd0 tx=0x7fa1b405e4c0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- 172.21.15.17:0/942779488 shutdown_connections 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/942779488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b83a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/942779488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b838fdc0 0x5635b834cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/942779488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b8344220 0x5635b834ca60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- 172.21.15.17:0/942779488 >> 172.21.15.17:0/942779488 conn(0x5635b8229130 msgr2=0x5635b836c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- 172.21.15.17:0/942779488 shutdown_connections 2024-09-10T23:15:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- 172.21.15.17:0/942779488 wait complete. 2024-09-10T23:15:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 -- start start 2024-09-10T23:15:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.359+0000 7fa1cdda0000 1 Processor -- start 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 0x5635b8405de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b838fdc0 0x5635b8406320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b8406860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5635b8195390 con 0x5635b838fdc0 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5635b824c730 con 0x5635b83906e0 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5635b8211a60 con 0x5635b8344220 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 10 client.0 _ll_register_callbacks cb 0x7fa1b400bed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b838fdc0 0x5635b8406320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b838fdc0 0x5635b8406320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49258/0 (socket says 172.21.15.17:49258) 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1bbe00640 1 -- 172.21.15.17:0/596781025 learned_addr learned my addr 172.21.15.17:0/596781025 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1bbe00640 1 -- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 msgr2=0x5635b8405de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 0x5635b8405de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1bbe00640 1 -- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 msgr2=0x5635b8406860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b8406860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1bbe00640 1 -- 172.21.15.17:0/596781025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b8153a90 con 0x5635b838fdc0 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1bbe00640 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b838fdc0 0x5635b8406320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0058d0 tx=0x7fa1ac00d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d59f39bc3ab07eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 1 -- 172.21.15.17:0/596781025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac01d680 con 0x5635b838fdc0 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 1 -- 172.21.15.17:0/596781025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa1ac01d820 con 0x5635b838fdc0 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 -- 172.21.15.17:0/596781025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1b4067b60 con 0x5635b838fdc0 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 1 -- 172.21.15.17:0/596781025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa1ac03f050 con 0x5635b838fdc0 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 10 client.4491 fetch_fsmap learned FSMap version 7 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 -- 172.21.15.17:0/596781025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5635b8132050 con 0x5635b838fdc0 2024-09-10T23:15:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 1 -- 172.21.15.17:0/596781025 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b4067b60 con 0x5635b838fdc0 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 1 -- 172.21.15.17:0/596781025 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7fa1ac042020 con 0x5635b838fdc0 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 10 client.4491 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 10 client.4491 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 20 client.4491 populate_metadata read hostname 'smithi017' 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x5635b840d030 0x5635b83a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 4 client.4491 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 -- 172.21.15.17:0/596781025 --> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] -- command(tid 0: {"prefix": "status"}) -- 0x5635b819b520 con 0x5635b840d030 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x5635b840d030 0x5635b83a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1c3e00640 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x5635b840d030 0x5635b83a40b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44b580a53d4cebc5 server_cookie=58f3270723438082 in_seq=0 out_seq=0 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 10 client.4491 ms_handle_connect on v2:172.21.15.77:6834/913768740 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 1 -- 172.21.15.17:0/596781025 <== mds.0 v2:172.21.15.77:6834/913768740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+317 (crc 0 0 0) 0x5635b819b520 con 0x5635b840d030 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 10 client.4491 handle_command_reply: tid=0 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 client.4491 shutdown 2024-09-10T23:15:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 -- 172.21.15.17:0/596781025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b838fdc0 msgr2=0x5635b8406320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b838fdc0 0x5635b8406320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac0058d0 tx=0x7fa1ac00d750 comp rx=0 tx=0).stop 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 -- 172.21.15.17:0/596781025 shutdown_connections 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x5635b840d030 0x5635b83a40b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5635b83906e0 0x5635b8406860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b838fdc0 0x5635b8406320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 --2- 172.21.15.17:0/596781025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5635b8344220 0x5635b8405de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1b1600640 0 client.4491 ms_handle_reset on v2:172.21.15.77:6834/913768740 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.363+0000 7fa1cdda0000 1 -- 172.21.15.17:0/596781025 >> 172.21.15.17:0/596781025 conn(0x5635b8229130 msgr2=0x5635b834d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1cdda0000 1 -- 172.21.15.17:0/596781025 shutdown_connections 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1cdda0000 1 -- 172.21.15.17:0/596781025 wait complete. 2024-09-10T23:15:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1cdda0000 20 client.4491 trim_cache size 0 max 16384 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4378, 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 7.559738566, 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 7, 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 27, 2024-09-10T23:15:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 26, 2024-09-10T23:15:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 13.772957024 2024-09-10T23:15:44.374 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:15:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 -- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1a00725e0 msgr2=0x7fa1a0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1a00725e0 0x7fa1a0074aa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac005d90 tx=0x7fa1ac005ca0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 -- 172.21.15.17:0/481508925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 msgr2=0x7fa1c4152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 0x7fa1c4152810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400d980 tx=0x7fa1b400de40 comp rx=0 tx=0).stop 2024-09-10T23:15:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 -- 172.21.15.17:0/481508925 shutdown_connections 2024-09-10T23:15:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1a00725e0 0x7fa1a0074aa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1c415a070 0x7fa1c4157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1c415be80 0x7fa1c415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 --2- 172.21.15.17:0/481508925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1c40b5130 0x7fa1c4152810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 -- 172.21.15.17:0/481508925 >> 172.21.15.17:0/481508925 conn(0x7fa1c40d1da0 msgr2=0x7fa1c40ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 -- 172.21.15.17:0/481508925 shutdown_connections 2024-09-10T23:15:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.367+0000 7fa1caa00640 1 -- 172.21.15.17:0/481508925 wait complete. 2024-09-10T23:15:44.388 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:15:44.388 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:15:44.388 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:15:44.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.531+0000 7fa57ae00640 1 -- 172.21.15.17:0/515183999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574070ad0 msgr2=0x7fa57415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.531+0000 7fa57ae00640 1 --2- 172.21.15.17:0/515183999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574070ad0 0x7fa57415f060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa5740b7de0 tx=0x7fa56401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.531+0000 7fa57ae00640 1 -- 172.21.15.17:0/515183999 shutdown_connections 2024-09-10T23:15:44.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.531+0000 7fa57ae00640 1 --2- 172.21.15.17:0/515183999 >> v2:172.21.15.77:3300/0 conn(0x7fa5740cf320 0x7fa5740cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.531+0000 7fa57ae00640 1 --2- 172.21.15.17:0/515183999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa574070ad0 0x7fa57415f060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.531+0000 7fa57ae00640 1 -- 172.21.15.17:0/515183999 >> 172.21.15.17:0/515183999 conn(0x7fa5740d1d60 msgr2=0x7fa5740d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.531+0000 7fa57ae00640 1 -- 172.21.15.17:0/515183999 shutdown_connections 2024-09-10T23:15:44.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.531+0000 7fa57ae00640 1 -- 172.21.15.17:0/515183999 wait complete. 2024-09-10T23:15:44.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 Processor -- start 2024-09-10T23:15:44.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 -- start start 2024-09-10T23:15:44.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa574070ad0 0x7fa574150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5740cf320 0x7fa5740ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5740d1830 0x7fa5740b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa574169350 con 0x7fa5740d1830 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa5741691d0 con 0x7fa574070ad0 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa5741694d0 con 0x7fa5740cf320 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa578e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5740d1830 0x7fa5740b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa578e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5740d1830 0x7fa5740b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49286/0 (socket says 172.21.15.17:49286) 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa578e00640 1 -- 172.21.15.17:0/3765983613 learned_addr learned my addr 172.21.15.17:0/3765983613 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa573e00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa574070ad0 0x7fa574150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa56be00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5740cf320 0x7fa5740ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa578e00640 1 -- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5740cf320 msgr2=0x7fa5740ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa578e00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5740cf320 0x7fa5740ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa578e00640 1 -- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa574070ad0 msgr2=0x7fa574150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa578e00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa574070ad0 0x7fa574150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa578e00640 1 -- 172.21.15.17:0/3765983613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa574151360 con 0x7fa5740d1830 2024-09-10T23:15:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa573e00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa574070ad0 0x7fa574150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa578e00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5740d1830 0x7fa5740b2810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00b970 tx=0x7fa56c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa570c00640 1 -- 172.21.15.17:0/3765983613 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c019070 con 0x7fa5740d1830 2024-09-10T23:15:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa570c00640 1 -- 172.21.15.17:0/3765983613 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa56c00cc50 con 0x7fa5740d1830 2024-09-10T23:15:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5740caea0 con 0x7fa5740d1830 2024-09-10T23:15:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa570c00640 1 -- 172.21.15.17:0/3765983613 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0146a0 con 0x7fa5740d1830 2024-09-10T23:15:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5741f9a30 con 0x7fa5740d1830 2024-09-10T23:15:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.535+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa57415f060 con 0x7fa5740d1830 2024-09-10T23:15:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.539+0000 7fa570c00640 1 -- 172.21.15.17:0/3765983613 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa56c01d3b0 con 0x7fa5740d1830 2024-09-10T23:15:44.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.539+0000 7fa570c00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5500725e0 0x7fa550074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:44.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.539+0000 7fa570c00640 1 -- 172.21.15.17:0/3765983613 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa56c093620 con 0x7fa5740d1830 2024-09-10T23:15:44.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.539+0000 7fa573e00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5500725e0 0x7fa550074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:44.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.539+0000 7fa573e00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5500725e0 0x7fa550074aa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5640af000 tx=0x7fa56401b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:44.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.543+0000 7fa570c00640 1 -- 172.21.15.17:0/3765983613 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa56c05e9b0 con 0x7fa5740d1830 2024-09-10T23:15:44.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa5740b4760 con 0x7fa5740d1830 2024-09-10T23:15:44.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa570c00640 1 -- 172.21.15.17:0/3765983613 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fa56c05e2b0 con 0x7fa5740d1830 2024-09-10T23:15:44.758 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T23:15:44.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5500725e0 msgr2=0x7fa550074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5500725e0 0x7fa550074aa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5640af000 tx=0x7fa56401b100 comp rx=0 tx=0).stop 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5740d1830 msgr2=0x7fa5740b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5740d1830 0x7fa5740b2810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00b970 tx=0x7fa56c00be30 comp rx=0 tx=0).stop 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 shutdown_connections 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5500725e0 0x7fa550074aa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5740d1830 0x7fa5740b2810 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5740cf320 0x7fa5740ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 --2- 172.21.15.17:0/3765983613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa574070ad0 0x7fa574150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 >> 172.21.15.17:0/3765983613 conn(0x7fa5740d1d60 msgr2=0x7fa5740b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 shutdown_connections 2024-09-10T23:15:44.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44.755+0000 7fa57ae00640 1 -- 172.21.15.17:0/3765983613 wait complete. 2024-09-10T23:15:44.778 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T23:15:44.778 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:15:44.778 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:15:44.778 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-10T23:15:44.779 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:15:44.779 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T23:15:44.779 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:15:44.779 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:15:44.779 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T23:15:44.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:44.779 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:15:44.788 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:15:44.789 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:15:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:15:44.790 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:15:44.791 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:15:44.791 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:44.791 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:15:44.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:15:44.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-10T23:15:44.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-10T23:15:44.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:15:44.791 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:15:44.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:44.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:44.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:44.954 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:15:45.014 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:15:45.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:45.016 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:15:45.089 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:15:45.089 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:15:45.089 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:15:45.090 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:15:45.090 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:15:45.090 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:15:45.090 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:45.090 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:15:45.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:15:45.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:15:45.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:15:45.090 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:15:45.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:45.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:45.227 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:15:45.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:45.236 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-10T23:15:45.293 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:45.293 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:15:45.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:15:45.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-10T23:15:45.293 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:15:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:45.422 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-10T23:15:45.422 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:45.422 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:15:45.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-10T23:15:45.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:15:45.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-10T23:15:45.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-10T23:15:45.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-10T23:15:45.423 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:15:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:45.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:45.597 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:15:45.597 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:15:45.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:15:45.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:15:45.598 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:15:45.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:15:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:45.684 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-10T23:15:45.684 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:45.684 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:15:45.692 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T23:15:45.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:15:45.693 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:15:45.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:15:45.812 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:15:45.870 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:15:45.870 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:15:45.870 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:15:45.870 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:15:45.870 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:15:45.870 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:15:45.870 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:15:45.870 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:15:45.870 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:15:45.871 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:15:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:15:45.873 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:15:45.873 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:15:45.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:45.874 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:15:45.929 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:15:45.929 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-10T23:15:45.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:15:45.996 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:15:46.054 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:15:46.054 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:15:46.054 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:15:46.054 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:15:46.054 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:15:46.054 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:15:46.054 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:15:46.054 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:15:46.054 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:15:46.055 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:15:46.056 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:15:46.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:15:46.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:15:46.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:15:46.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:15:46.056 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:15:46.056 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:15:46.056 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:15:46.056 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:15:46.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:46.057 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:15:46.073 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:2024-09-10T23:15:46.071+0000 7f3317848580 -1 init, newargv = 0x563b3cb09b60 newargc=15 2024-09-10T23:15:46.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[33889]: starting ceph client 2024-09-10T23:15:46.084 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[33889]: starting fuse 2024-09-10T23:15:47.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:15:47.208 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:15:47.259 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:15:47.259 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:15:47.259 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:15:47.259 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:15:47.259 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:15:47.259 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:15:47.259 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:15:47.259 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:15:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:15:47.261 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-10T23:15:47.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:47.262 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:15:47.313 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:15:47.313 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:15:47.314 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.admin")) 2024-09-10T23:15:47.315 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:15:47.452 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.admin.33889.asok 2024-09-10T23:15:47.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:47.464 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33889.asok 2024-09-10T23:15:47.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:47.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33889.asok status 2024-09-10T23:15:47.646 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:15:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:15:47.646 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "admin", 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "33889", 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4500, 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:15:47.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 4500 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2568870941 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2568870941 2024-09-10T23:15:47.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:15:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.4500 192.168.0.1:0/2568870941", 2024-09-10T23:15:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/2568870941", 2024-09-10T23:15:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:15:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 7, 2024-09-10T23:15:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 27, 2024-09-10T23:15:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:15:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:15:47.649 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:15:47.649 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:15:47.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:47.662 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:15:47.662 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:15:47.671 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:15:47.671 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:15:47.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:47.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:15:47.733 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-10T23:15:47.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:15:47.856 INFO:teuthology.orchestra.run.smithi017.stdout:# file: . 2024-09-10T23:15:47.856 INFO:teuthology.orchestra.run.smithi017.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-10T23:15:47.856 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:47.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:15:47.863 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:47.863 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:47.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:48.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.055+0000 7fa99d400640 1 -- 172.21.15.17:0/1310625725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c004810 msgr2=0x7fa97c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.055+0000 7fa99d400640 1 --2- 172.21.15.17:0/1310625725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa97c004810 0x7fa97c004c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa980009b60 tx=0x7fa98001d270 comp rx=0 tx=0).stop 2024-09-10T23:15:48.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.055+0000 7fa997200640 1 -- 172.21.15.17:0/1310625725 reap_dead start 2024-09-10T23:15:48.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.055+0000 7fa99d400640 1 -- 172.21.15.17:0/1310625725 shutdown_connections 2024-09-10T23:15:48.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.055+0000 7fa99d400640 1 -- 172.21.15.17:0/1310625725 >> 172.21.15.17:0/1310625725 conn(0x7fa9980b1730 msgr2=0x7fa9980b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:48.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.055+0000 7fa99d400640 1 -- 172.21.15.17:0/1310625725 shutdown_connections 2024-09-10T23:15:48.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.055+0000 7fa99d400640 1 -- 172.21.15.17:0/1310625725 wait complete. 2024-09-10T23:15:48.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 Processor -- start 2024-09-10T23:15:48.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 -- start start 2024-09-10T23:15:48.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa97c004810 0x7fa9981f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:48.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa998147380 0x7fa99814a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:48.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa99814aae0 0x7fa99814fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:48.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa9980b4720 con 0x7fa998147380 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa9980b45a0 con 0x7fa97c004810 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa9980b48a0 con 0x7fa99814aae0 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa998147380 0x7fa99814a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa998147380 0x7fa99814a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34330/0 (socket says 172.21.15.17:34330) 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98de00640 1 -- 172.21.15.17:0/2547802570 learned_addr learned my addr 172.21.15.17:0/2547802570 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa996800640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa97c004810 0x7fa9981f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa997200640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa99814aae0 0x7fa99814fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98de00640 1 -- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa99814aae0 msgr2=0x7fa99814fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98de00640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa99814aae0 0x7fa99814fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98de00640 1 -- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa97c004810 msgr2=0x7fa9981f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98de00640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa97c004810 0x7fa9981f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98de00640 1 -- 172.21.15.17:0/2547802570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99814afa0 con 0x7fa998147380 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa997200640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa99814aae0 0x7fa99814fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98de00640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa998147380 0x7fa99814a5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa9800af040 tx=0x7fa980005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98f400640 1 -- 172.21.15.17:0/2547802570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9800b1040 con 0x7fa998147380 2024-09-10T23:15:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98f400640 1 -- 172.21.15.17:0/2547802570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9800ac8a0 con 0x7fa998147380 2024-09-10T23:15:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99814b280 con 0x7fa998147380 2024-09-10T23:15:48.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa98f400640 1 -- 172.21.15.17:0/2547802570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9800accf0 con 0x7fa998147380 2024-09-10T23:15:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.059+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9981f5ab0 con 0x7fa998147380 2024-09-10T23:15:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.063+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa99815e650 con 0x7fa998147380 2024-09-10T23:15:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.063+0000 7fa98f400640 1 -- 172.21.15.17:0/2547802570 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa9800c7060 con 0x7fa998147380 2024-09-10T23:15:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.063+0000 7fa98f400640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa9740725e0 0x7fa974074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.063+0000 7fa98f400640 1 -- 172.21.15.17:0/2547802570 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa98012e660 con 0x7fa998147380 2024-09-10T23:15:48.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.063+0000 7fa996800640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa9740725e0 0x7fa974074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:48.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.063+0000 7fa996800640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa9740725e0 0x7fa974074aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa98800a580 tx=0x7fa98800a2f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:48.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.067+0000 7fa98f400640 1 -- 172.21.15.17:0/2547802570 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa980016f80 con 0x7fa998147380 2024-09-10T23:15:48.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.251+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa9980b2d70 con 0x7fa998147380 2024-09-10T23:15:48.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.251+0000 7fa98f400640 1 -- 172.21.15.17:0/2547802570 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fa9800f9320 con 0x7fa998147380 2024-09-10T23:15:48.255 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:15:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa9740725e0 msgr2=0x7fa974074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa9740725e0 0x7fa974074aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa98800a580 tx=0x7fa98800a2f0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa998147380 msgr2=0x7fa99814a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa998147380 0x7fa99814a5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa9800af040 tx=0x7fa980005620 comp rx=0 tx=0).stop 2024-09-10T23:15:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 shutdown_connections 2024-09-10T23:15:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa9740725e0 0x7fa974074aa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa99814aae0 0x7fa99814fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa998147380 0x7fa99814a5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 --2- 172.21.15.17:0/2547802570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa97c004810 0x7fa9981f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 >> 172.21.15.17:0/2547802570 conn(0x7fa9980b1730 msgr2=0x7fa998072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 shutdown_connections 2024-09-10T23:15:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.255+0000 7fa99d400640 1 -- 172.21.15.17:0/2547802570 wait complete. 2024-09-10T23:15:48.277 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:15:48.277 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:15:48.286 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:15:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 -- 172.21.15.17:0/1674200416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7328004d50 msgr2=0x7f73280051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 --2- 172.21.15.17:0/1674200416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7328004d50 0x7f73280051d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f733c00e400 tx=0x7f733c01d7d0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343400640 1 -- 172.21.15.17:0/1674200416 reap_dead start 2024-09-10T23:15:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 -- 172.21.15.17:0/1674200416 shutdown_connections 2024-09-10T23:15:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 -- 172.21.15.17:0/1674200416 >> 172.21.15.17:0/1674200416 conn(0x7f73440ccbf0 msgr2=0x7f73440cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 -- 172.21.15.17:0/1674200416 shutdown_connections 2024-09-10T23:15:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 -- 172.21.15.17:0/1674200416 wait complete. 2024-09-10T23:15:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 Processor -- start 2024-09-10T23:15:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 -- start start 2024-09-10T23:15:48.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7328004d50 0x7f73440c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:48.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73441566d0 0x7f73441e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:48.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73441e52a0 0x7f7344073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f73440b4d80 con 0x7f73441e52a0 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73440b4c00 con 0x7f73441566d0 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73440b4f00 con 0x7f7328004d50 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73441e52a0 0x7f7344073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73441e52a0 0x7f7344073cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34336/0 (socket says 172.21.15.17:34336) 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343400640 1 -- 172.21.15.17:0/3042251680 learned_addr learned my addr 172.21.15.17:0/3042251680 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7342a00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7328004d50 0x7f73440c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f733be00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73441566d0 0x7f73441e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343400640 1 -- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7328004d50 msgr2=0x7f73440c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343400640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7328004d50 0x7f73440c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343400640 1 -- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73441566d0 msgr2=0x7f73441e4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343400640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73441566d0 0x7f73441e4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.475+0000 7f7343400640 1 -- 172.21.15.17:0/3042251680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734409ab90 con 0x7f73441e52a0 2024-09-10T23:15:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f7343400640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73441e52a0 0x7f7344073cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f733c0b1040 tx=0x7f733c005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:48.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f733aa00640 1 -- 172.21.15.17:0/3042251680 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c009730 con 0x7f73441e52a0 2024-09-10T23:15:48.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f733aa00640 1 -- 172.21.15.17:0/3042251680 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f733c0be070 con 0x7f73441e52a0 2024-09-10T23:15:48.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734409ae70 con 0x7f73441e52a0 2024-09-10T23:15:48.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f733aa00640 1 -- 172.21.15.17:0/3042251680 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c009200 con 0x7f73441e52a0 2024-09-10T23:15:48.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734409b430 con 0x7f73441e52a0 2024-09-10T23:15:48.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73441e6230 con 0x7f73441e52a0 2024-09-10T23:15:48.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f733aa00640 1 -- 172.21.15.17:0/3042251680 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f733c0a7b70 con 0x7f73441e52a0 2024-09-10T23:15:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f733aa00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7320072610 0x7f7320074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f733aa00640 1 -- 172.21.15.17:0/3042251680 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f733c12eaa0 con 0x7f73441e52a0 2024-09-10T23:15:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.479+0000 7f7342a00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7320072610 0x7f7320074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.483+0000 7f7342a00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7320072610 0x7f7320074ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73440c7450 tx=0x7f7334000f80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:48.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.483+0000 7f733aa00640 1 -- 172.21.15.17:0/3042251680 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f733c0174e0 con 0x7f73441e52a0 2024-09-10T23:15:48.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.671+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7344156be0 con 0x7f73441e52a0 2024-09-10T23:15:48.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.671+0000 7f733aa00640 1 -- 172.21.15.17:0/3042251680 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f733c0f9db0 con 0x7f73441e52a0 2024-09-10T23:15:48.675 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:15:48.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7320072610 msgr2=0x7f7320074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7320072610 0x7f7320074ad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73440c7450 tx=0x7f7334000f80 comp rx=0 tx=0).stop 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73441e52a0 msgr2=0x7f7344073cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73441e52a0 0x7f7344073cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f733c0b1040 tx=0x7f733c005c80 comp rx=0 tx=0).stop 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 shutdown_connections 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7320072610 0x7f7320074ad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73441e52a0 0x7f7344073cd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73441566d0 0x7f73441e4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 --2- 172.21.15.17:0/3042251680 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7328004d50 0x7f73440c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 >> 172.21.15.17:0/3042251680 conn(0x7f73440ccbf0 msgr2=0x7f73440cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 shutdown_connections 2024-09-10T23:15:48.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:48.675+0000 7f7343e00640 1 -- 172.21.15.17:0/3042251680 wait complete. 2024-09-10T23:15:48.703 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:15:48.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:48.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-10T23:15:48.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[33889]: fuse finished with error 0 and tester_r 0 2024-09-10T23:15:48.738 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:15:54.840 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:15:54.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:15:54.841 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-10T23:15:54.861 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:55.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.059+0000 7f0e29e00640 1 -- 172.21.15.17:0/1588684047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e08004d50 msgr2=0x7f0e080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.059+0000 7f0e29e00640 1 --2- 172.21.15.17:0/1588684047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e08004d50 0x7f0e080051d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009ee0 tx=0x7f0e1c01d5f0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.059+0000 7f0e23400640 1 -- 172.21.15.17:0/1588684047 reap_dead start 2024-09-10T23:15:55.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.059+0000 7f0e29e00640 1 -- 172.21.15.17:0/1588684047 shutdown_connections 2024-09-10T23:15:55.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.059+0000 7f0e29e00640 1 -- 172.21.15.17:0/1588684047 >> 172.21.15.17:0/1588684047 conn(0x7f0e240b3870 msgr2=0x7f0e240b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:55.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.059+0000 7f0e29e00640 1 -- 172.21.15.17:0/1588684047 shutdown_connections 2024-09-10T23:15:55.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.059+0000 7f0e29e00640 1 -- 172.21.15.17:0/1588684047 wait complete. 2024-09-10T23:15:55.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 Processor -- start 2024-09-10T23:15:55.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 -- start start 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e08004d50 0x7f0e241574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24156510 0x7f0e2415bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e2414d360 0x7f0e2415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24071a20 con 0x7f0e08004d50 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e240d06b0 con 0x7f0e24156510 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0e24071ba0 con 0x7f0e2414d360 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e22a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e08004d50 0x7f0e241574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e22a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e08004d50 0x7f0e241574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34348/0 (socket says 172.21.15.17:34348) 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e22a00640 1 -- 172.21.15.17:0/2387151729 learned_addr learned my addr 172.21.15.17:0/2387151729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e1be00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24156510 0x7f0e2415bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e23400640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e2414d360 0x7f0e2415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e22a00640 1 -- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e2414d360 msgr2=0x7f0e2415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e22a00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e2414d360 0x7f0e2415bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e22a00640 1 -- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24156510 msgr2=0x7f0e2415bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e22a00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24156510 0x7f0e2415bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e22a00640 1 -- 172.21.15.17:0/2387151729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2415a600 con 0x7f0e08004d50 2024-09-10T23:15:55.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e22a00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e08004d50 0x7f0e241574e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e14006e40 tx=0x7f0e140049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e1b400640 1 -- 172.21.15.17:0/2387151729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14015020 con 0x7f0e08004d50 2024-09-10T23:15:55.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e1b400640 1 -- 172.21.15.17:0/2387151729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e14010980 con 0x7f0e08004d50 2024-09-10T23:15:55.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e1b400640 1 -- 172.21.15.17:0/2387151729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14010dd0 con 0x7f0e08004d50 2024-09-10T23:15:55.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e24158070 con 0x7f0e08004d50 2024-09-10T23:15:55.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e240b4b70 con 0x7f0e08004d50 2024-09-10T23:15:55.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.063+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e240b1270 con 0x7f0e08004d50 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.067+0000 7f0e1b400640 1 -- 172.21.15.17:0/2387151729 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0e1401a400 con 0x7f0e08004d50 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.067+0000 7f0e1b400640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0e000725e0 0x7f0e00074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.067+0000 7f0e1b400640 1 -- 172.21.15.17:0/2387151729 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0e14094460 con 0x7f0e08004d50 2024-09-10T23:15:55.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.067+0000 7f0e1be00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0e000725e0 0x7f0e00074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.067+0000 7f0e1be00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0e000725e0 0x7f0e00074aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0e240b1000 tx=0x7f0e0c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.071+0000 7f0e1b400640 1 -- 172.21.15.17:0/2387151729 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0e1401f020 con 0x7f0e08004d50 2024-09-10T23:15:55.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.247+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e240b5e30 con 0x7f0e08004d50 2024-09-10T23:15:55.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.247+0000 7f0e1b400640 1 -- 172.21.15.17:0/2387151729 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18538 (secure 0 0 0) 0x7f0e240712d0 con 0x7f0e08004d50 2024-09-10T23:15:55.251 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:41.258986+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:55.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0e000725e0 msgr2=0x7f0e00074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0e000725e0 0x7f0e00074aa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0e240b1000 tx=0x7f0e0c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e08004d50 msgr2=0x7f0e241574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e08004d50 0x7f0e241574e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e14006e40 tx=0x7f0e140049e0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 shutdown_connections 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0e000725e0 0x7f0e00074aa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e2414d360 0x7f0e2415bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24156510 0x7f0e2415bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 --2- 172.21.15.17:0/2387151729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e08004d50 0x7f0e241574e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 >> 172.21.15.17:0/2387151729 conn(0x7f0e240b3870 msgr2=0x7f0e2415dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 shutdown_connections 2024-09-10T23:15:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.251+0000 7f0e29e00640 1 -- 172.21.15.17:0/2387151729 wait complete. 2024-09-10T23:15:55.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 -- 172.21.15.17:0/580136163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf8070ad0 msgr2=0x7f1cf815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 --2- 172.21.15.17:0/580136163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf8070ad0 0x7f1cf815f060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80cf010 tx=0x7f1ce801c7f0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 -- 172.21.15.17:0/580136163 shutdown_connections 2024-09-10T23:15:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 --2- 172.21.15.17:0/580136163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf8070ad0 0x7f1cf815f060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 -- 172.21.15.17:0/580136163 >> 172.21.15.17:0/580136163 conn(0x7f1cf80d1d60 msgr2=0x7f1cf80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 -- 172.21.15.17:0/580136163 shutdown_connections 2024-09-10T23:15:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 -- 172.21.15.17:0/580136163 wait complete. 2024-09-10T23:15:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 Processor -- start 2024-09-10T23:15:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 -- start start 2024-09-10T23:15:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf8070ad0 0x7f1cf81512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80cf320 0x7f1cf814e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d1830 0x7f1cf80b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf816a660 con 0x7f1cf8070ad0 2024-09-10T23:15:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf816a4e0 con 0x7f1cf80cf320 2024-09-10T23:15:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cfe200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf816a7e0 con 0x7f1cf80d1830 2024-09-10T23:15:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf8070ad0 0x7f1cf81512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cf7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf8070ad0 0x7f1cf81512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34364/0 (socket says 172.21.15.17:34364) 2024-09-10T23:15:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cf7400640 1 -- 172.21.15.17:0/2247106136 learned_addr learned my addr 172.21.15.17:0/2247106136 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cf7e00640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d1830 0x7f1cf80b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cf6a00640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80cf320 0x7f1cf814e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cf7400640 1 -- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d1830 msgr2=0x7f1cf80b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cf7400640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d1830 0x7f1cf80b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.419+0000 7f1cf7400640 1 -- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80cf320 msgr2=0x7f1cf814e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cf7400640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80cf320 0x7f1cf814e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cf7400640 1 -- 172.21.15.17:0/2247106136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf814eda0 con 0x7f1cf8070ad0 2024-09-10T23:15:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cf7e00640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d1830 0x7f1cf80b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cf7400640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf8070ad0 0x7f1cf81512b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009790 tx=0x7f1ce8005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cef400640 1 -- 172.21.15.17:0/2247106136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce80b2040 con 0x7f1cf8070ad0 2024-09-10T23:15:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cef400640 1 -- 172.21.15.17:0/2247106136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ce8004130 con 0x7f1cf8070ad0 2024-09-10T23:15:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cef400640 1 -- 172.21.15.17:0/2247106136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8003600 con 0x7f1cf8070ad0 2024-09-10T23:15:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf80b3d00 con 0x7f1cf8070ad0 2024-09-10T23:15:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf80b42c0 con 0x7f1cf8070ad0 2024-09-10T23:15:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf815f060 con 0x7f1cf8070ad0 2024-09-10T23:15:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cef400640 1 -- 172.21.15.17:0/2247106136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1ce80b5070 con 0x7f1cf8070ad0 2024-09-10T23:15:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cef400640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cd80725e0 0x7f1cd8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.423+0000 7f1cef400640 1 -- 172.21.15.17:0/2247106136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1ce812d120 con 0x7f1cf8070ad0 2024-09-10T23:15:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.427+0000 7f1cf6a00640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cd80725e0 0x7f1cd8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.427+0000 7f1cf6a00640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cd80725e0 0x7f1cd8074aa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1cf815ece0 tx=0x7f1ce4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.427+0000 7f1cef400640 1 -- 172.21.15.17:0/2247106136 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1ce80c4020 con 0x7f1cf8070ad0 2024-09-10T23:15:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.603+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cf80d2400 con 0x7f1cf8070ad0 2024-09-10T23:15:55.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.603+0000 7f1cef400640 1 -- 172.21.15.17:0/2247106136 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18538 (secure 0 0 0) 0x7f1ce8016410 con 0x7f1cf8070ad0 2024-09-10T23:15:55.607 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:55.608 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:41.258986+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cd80725e0 msgr2=0x7f1cd8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cd80725e0 0x7f1cd8074aa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1cf815ece0 tx=0x7f1ce4009040 comp rx=0 tx=0).stop 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf8070ad0 msgr2=0x7f1cf81512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf8070ad0 0x7f1cf81512b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009790 tx=0x7f1ce8005d20 comp rx=0 tx=0).stop 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 shutdown_connections 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cd80725e0 0x7f1cd8074aa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cf80d1830 0x7f1cf80b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1cf80cf320 0x7f1cf814e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 --2- 172.21.15.17:0/2247106136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cf8070ad0 0x7f1cf81512b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 >> 172.21.15.17:0/2247106136 conn(0x7f1cf80d1d60 msgr2=0x7f1cf80b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 shutdown_connections 2024-09-10T23:15:55.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.607+0000 7f1cfe200640 1 -- 172.21.15.17:0/2247106136 wait complete. 2024-09-10T23:15:55.629 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:15:55.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.775+0000 7ff680600640 1 -- 172.21.15.17:0/3238393208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 msgr2=0x7ff678073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.775+0000 7ff680600640 1 --2- 172.21.15.17:0/3238393208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 0x7ff678073650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff664009900 tx=0x7ff66401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.775+0000 7ff680600640 1 -- 172.21.15.17:0/3238393208 shutdown_connections 2024-09-10T23:15:55.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.775+0000 7ff680600640 1 --2- 172.21.15.17:0/3238393208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 0x7ff678073650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.775+0000 7ff680600640 1 --2- 172.21.15.17:0/3238393208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff678071bd0 0x7ff678140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.775+0000 7ff680600640 1 -- 172.21.15.17:0/3238393208 >> 172.21.15.17:0/3238393208 conn(0x7ff6780d0c10 msgr2=0x7ff6780d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.775+0000 7ff680600640 1 -- 172.21.15.17:0/3238393208 shutdown_connections 2024-09-10T23:15:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.775+0000 7ff680600640 1 -- 172.21.15.17:0/3238393208 wait complete. 2024-09-10T23:15:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.775+0000 7ff680600640 1 Processor -- start 2024-09-10T23:15:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 -- start start 2024-09-10T23:15:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff678071bd0 0x7ff678142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 0x7ff67813adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6780cec20 0x7ff678159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff67815bbf0 con 0x7ff6780ce7e0 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff67815ba70 con 0x7ff678071bd0 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff67815bd70 con 0x7ff6780cec20 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 0x7ff67813adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 0x7ff67813adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34388/0 (socket says 172.21.15.17:34388) 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67d200640 1 -- 172.21.15.17:0/2701069272 learned_addr learned my addr 172.21.15.17:0/2701069272 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67dc00640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff678071bd0 0x7ff678142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67e600640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6780cec20 0x7ff678159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67d200640 1 -- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6780cec20 msgr2=0x7ff678159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67d200640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6780cec20 0x7ff678159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67d200640 1 -- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff678071bd0 msgr2=0x7ff678142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67d200640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff678071bd0 0x7ff678142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67d200640 1 -- 172.21.15.17:0/2701069272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff678139ca0 con 0x7ff6780ce7e0 2024-09-10T23:15:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff67d200640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 0x7ff67813adc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff664009850 tx=0x7ff6640a55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff675600640 1 -- 172.21.15.17:0/2701069272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640b2040 con 0x7ff6780ce7e0 2024-09-10T23:15:55.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff675600640 1 -- 172.21.15.17:0/2701069272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff664004380 con 0x7ff6780ce7e0 2024-09-10T23:15:55.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff675600640 1 -- 172.21.15.17:0/2701069272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664005290 con 0x7ff6780ce7e0 2024-09-10T23:15:55.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff678139f80 con 0x7ff6780ce7e0 2024-09-10T23:15:55.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67813a540 con 0x7ff6780ce7e0 2024-09-10T23:15:55.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.779+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff678140210 con 0x7ff6780ce7e0 2024-09-10T23:15:55.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.783+0000 7ff675600640 1 -- 172.21.15.17:0/2701069272 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff664005430 con 0x7ff6780ce7e0 2024-09-10T23:15:55.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.783+0000 7ff675600640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff6580725e0 0x7ff658074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:55.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.783+0000 7ff675600640 1 -- 172.21.15.17:0/2701069272 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff66412cf30 con 0x7ff6780ce7e0 2024-09-10T23:15:55.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.783+0000 7ff67dc00640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff6580725e0 0x7ff658074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:55.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.783+0000 7ff67dc00640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff6580725e0 0x7ff658074aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009be0 tx=0x7ff66c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:55.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.787+0000 7ff675600640 1 -- 172.21.15.17:0/2701069272 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff6640164d0 con 0x7ff6780ce7e0 2024-09-10T23:15:56.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:55.995+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff678142b40 con 0x7ff6780ce7e0 2024-09-10T23:15:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff675600640 1 -- 172.21.15.17:0/2701069272 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7ff6640f7c70 con 0x7ff6780ce7e0 2024-09-10T23:15:56.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff6580725e0 msgr2=0x7ff658074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff6580725e0 0x7ff658074aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009be0 tx=0x7ff66c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 msgr2=0x7ff67813adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 0x7ff67813adc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff664009850 tx=0x7ff6640a55a0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 shutdown_connections 2024-09-10T23:15:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff6580725e0 0x7ff658074aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6780cec20 0x7ff678159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6780ce7e0 0x7ff67813adc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 --2- 172.21.15.17:0/2701069272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff678071bd0 0x7ff678142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 >> 172.21.15.17:0/2701069272 conn(0x7ff6780d0c10 msgr2=0x7ff6780b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 shutdown_connections 2024-09-10T23:15:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.363+0000 7ff680600640 1 -- 172.21.15.17:0/2701069272 wait complete. 2024-09-10T23:15:56.389 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-10T23:15:56.389 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:15:56.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.535+0000 7fc1ce000640 1 -- 172.21.15.17:0/3125373317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 msgr2=0x7fc1c80cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.535+0000 7fc1ce000640 1 --2- 172.21.15.17:0/3125373317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 0x7fc1c80cfca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80cf770 tx=0x7fc1b801c800 comp rx=0 tx=0).stop 2024-09-10T23:15:56.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.535+0000 7fc1ce000640 1 -- 172.21.15.17:0/3125373317 shutdown_connections 2024-09-10T23:15:56.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.535+0000 7fc1ce000640 1 --2- 172.21.15.17:0/3125373317 >> v2:172.21.15.77:3300/0 conn(0x7fc1c80b2540 0x7fc1c80cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.535+0000 7fc1ce000640 1 --2- 172.21.15.17:0/3125373317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 0x7fc1c80cfca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.535+0000 7fc1ce000640 1 -- 172.21.15.17:0/3125373317 >> 172.21.15.17:0/3125373317 conn(0x7fc1c80d1da0 msgr2=0x7fc1c80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:56.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.535+0000 7fc1ce000640 1 -- 172.21.15.17:0/3125373317 shutdown_connections 2024-09-10T23:15:56.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.535+0000 7fc1ce000640 1 -- 172.21.15.17:0/3125373317 wait complete. 2024-09-10T23:15:56.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 Processor -- start 2024-09-10T23:15:56.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 -- start start 2024-09-10T23:15:56.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1c80b2540 0x7fc1c814f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c80b31b0 0x7fc1c80b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 0x7fc1c8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8168c60 con 0x7fc1c815f400 2024-09-10T23:15:56.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c80cdc00 con 0x7fc1c80b31b0 2024-09-10T23:15:56.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c8168de0 con 0x7fc1c80b2540 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 0x7fc1c8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 0x7fc1c8156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34402/0 (socket says 172.21.15.17:34402) 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7e00640 1 -- 172.21.15.17:0/223941426 learned_addr learned my addr 172.21.15.17:0/223941426 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1bea00640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c80b31b0 0x7fc1c80b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7400640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1c80b2540 0x7fc1c814f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7e00640 1 -- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1c80b2540 msgr2=0x7fc1c814f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7e00640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1c80b2540 0x7fc1c814f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7e00640 1 -- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c80b31b0 msgr2=0x7fc1c80b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7e00640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c80b31b0 0x7fc1c80b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:56.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7e00640 1 -- 172.21.15.17:0/223941426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c80b5e90 con 0x7fc1c815f400 2024-09-10T23:15:56.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1c7e00640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 0x7fc1c8156e00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000ea50 tx=0x7fc1c000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1bfe00640 1 -- 172.21.15.17:0/223941426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000cd60 con 0x7fc1c815f400 2024-09-10T23:15:56.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1bfe00640 1 -- 172.21.15.17:0/223941426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1c0004b30 con 0x7fc1c815f400 2024-09-10T23:15:56.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1bfe00640 1 -- 172.21.15.17:0/223941426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0005020 con 0x7fc1c815f400 2024-09-10T23:15:56.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c80b6170 con 0x7fc1c815f400 2024-09-10T23:15:56.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c80b6730 con 0x7fc1c815f400 2024-09-10T23:15:56.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.539+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c80cc8b0 con 0x7fc1c815f400 2024-09-10T23:15:56.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.543+0000 7fc1bfe00640 1 -- 172.21.15.17:0/223941426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc1c000f040 con 0x7fc1c815f400 2024-09-10T23:15:56.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.543+0000 7fc1bfe00640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc1a40725e0 0x7fc1a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:56.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.543+0000 7fc1bfe00640 1 -- 172.21.15.17:0/223941426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc1c0093c60 con 0x7fc1c815f400 2024-09-10T23:15:56.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.543+0000 7fc1c7400640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc1a40725e0 0x7fc1a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:56.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.543+0000 7fc1c7400640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc1a40725e0 0x7fc1a4074aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80af000 tx=0x7fc1b801b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:56.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.547+0000 7fc1bfe00640 1 -- 172.21.15.17:0/223941426 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc1c0016030 con 0x7fc1c815f400 2024-09-10T23:15:56.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:56.755+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc1c815bed0 con 0x7fc1c815f400 2024-09-10T23:15:57.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.363+0000 7fc1bfe00640 1 -- 172.21.15.17:0/223941426 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fc1c005eff0 con 0x7fc1c815f400 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc1a40725e0 msgr2=0x7fc1a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc1a40725e0 0x7fc1a4074aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80af000 tx=0x7fc1b801b040 comp rx=0 tx=0).stop 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 msgr2=0x7fc1c8156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 0x7fc1c8156e00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000ea50 tx=0x7fc1c000ef10 comp rx=0 tx=0).stop 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 shutdown_connections 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc1a40725e0 0x7fc1a4074aa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c815f400 0x7fc1c8156e00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1c80b31b0 0x7fc1c80b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 --2- 172.21.15.17:0/223941426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1c80b2540 0x7fc1c814f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 >> 172.21.15.17:0/223941426 conn(0x7fc1c80d1da0 msgr2=0x7fc1c80cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 shutdown_connections 2024-09-10T23:15:57.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.367+0000 7fc1ce000640 1 -- 172.21.15.17:0/223941426 wait complete. 2024-09-10T23:15:57.393 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:15:57.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:15:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.535+0000 7ff433a00640 1 -- 172.21.15.17:0/121993654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0d1830 msgr2=0x7ff42c15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.535+0000 7ff433a00640 1 --2- 172.21.15.17:0/121993654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0d1830 0x7ff42c15f5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0cf010 tx=0x7ff41801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.535+0000 7ff433a00640 1 -- 172.21.15.17:0/121993654 shutdown_connections 2024-09-10T23:15:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.535+0000 7ff433a00640 1 --2- 172.21.15.17:0/121993654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0d1830 0x7ff42c15f5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.535+0000 7ff433a00640 1 --2- 172.21.15.17:0/121993654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff42c070ad0 0x7ff42c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.535+0000 7ff433a00640 1 -- 172.21.15.17:0/121993654 >> 172.21.15.17:0/121993654 conn(0x7ff42c0d1d60 msgr2=0x7ff42c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.535+0000 7ff433a00640 1 -- 172.21.15.17:0/121993654 shutdown_connections 2024-09-10T23:15:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.535+0000 7ff433a00640 1 -- 172.21.15.17:0/121993654 wait complete. 2024-09-10T23:15:57.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 Processor -- start 2024-09-10T23:15:57.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 -- start start 2024-09-10T23:15:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff42c070ad0 0x7ff42c153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0cf320 0x7ff42c0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff42c0d1830 0x7ff42c165680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c169430 con 0x7ff42c0cf320 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c1692b0 con 0x7ff42c070ad0 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff42c1695b0 con 0x7ff42c0d1830 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff42be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0cf320 0x7ff42c0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff42be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0cf320 0x7ff42c0b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33800/0 (socket says 172.21.15.17:33800) 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff42be00640 1 -- 172.21.15.17:0/3131874686 learned_addr learned my addr 172.21.15.17:0/3131874686 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff431000640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff42c070ad0 0x7ff42c153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff431a00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff42c0d1830 0x7ff42c165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff42be00640 1 -- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff42c0d1830 msgr2=0x7ff42c165680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff42be00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff42c0d1830 0x7ff42c165680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff42be00640 1 -- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff42c070ad0 msgr2=0x7ff42c153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff42be00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff42c070ad0 0x7ff42c153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff42be00640 1 -- 172.21.15.17:0/3131874686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c0b2f10 con 0x7ff42c0cf320 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff431000640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff42c070ad0 0x7ff42c153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff42be00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0cf320 0x7ff42c0b3fb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff4180b0040 tx=0x7ff418005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff428c00640 1 -- 172.21.15.17:0/3131874686 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4180b2040 con 0x7ff42c0cf320 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff428c00640 1 -- 172.21.15.17:0/3131874686 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4180038f0 con 0x7ff42c0cf320 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff428c00640 1 -- 172.21.15.17:0/3131874686 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418003d40 con 0x7ff42c0cf320 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c0b31f0 con 0x7ff42c0cf320 2024-09-10T23:15:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42c0b37b0 con 0x7ff42c0cf320 2024-09-10T23:15:57.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.539+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42c0cfc60 con 0x7ff42c0cf320 2024-09-10T23:15:57.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.543+0000 7ff428c00640 1 -- 172.21.15.17:0/3131874686 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff4180c0060 con 0x7ff42c0cf320 2024-09-10T23:15:57.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.543+0000 7ff428c00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff40c0725e0 0x7ff40c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.543+0000 7ff428c00640 1 -- 172.21.15.17:0/3131874686 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff41812d030 con 0x7ff42c0cf320 2024-09-10T23:15:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.543+0000 7ff431000640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff40c0725e0 0x7ff40c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.543+0000 7ff431000640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff40c0725e0 0x7ff40c074aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff420005fd0 tx=0x7ff42000a5e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.547+0000 7ff428c00640 1 -- 172.21.15.17:0/3131874686 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff4180164d0 con 0x7ff42c0cf320 2024-09-10T23:15:57.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.755+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff42c0af440 con 0x7ff42c0cf320 2024-09-10T23:15:57.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.755+0000 7ff428c00640 1 -- 172.21.15.17:0/3131874686 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5210 (secure 0 0 0) 0x7ff4180f83c0 con 0x7ff42c0cf320 2024-09-10T23:15:57.759 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:57.759 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-10T23:15:57:364737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:56.758895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:15:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-10T23:15:57.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff40c0725e0 msgr2=0x7ff40c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff40c0725e0 0x7ff40c074aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff420005fd0 tx=0x7ff42000a5e0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0cf320 msgr2=0x7ff42c0b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0cf320 0x7ff42c0b3fb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff4180b0040 tx=0x7ff418005790 comp rx=0 tx=0).stop 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 shutdown_connections 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff40c0725e0 0x7ff40c074aa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff42c0d1830 0x7ff42c165680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff42c0cf320 0x7ff42c0b3fb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 --2- 172.21.15.17:0/3131874686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff42c070ad0 0x7ff42c153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 >> 172.21.15.17:0/3131874686 conn(0x7ff42c0d1d60 msgr2=0x7ff42c0af870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 shutdown_connections 2024-09-10T23:15:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.759+0000 7ff433a00640 1 -- 172.21.15.17:0/3131874686 wait complete. 2024-09-10T23:15:57.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:57.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.923+0000 7ff24ba00640 1 -- 172.21.15.17:0/3673684436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440b32d0 msgr2=0x7ff244150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.923+0000 7ff24ba00640 1 --2- 172.21.15.17:0/3673684436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440b32d0 0x7ff244150d70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00ad90 tx=0x7ff23c020490 comp rx=0 tx=0).stop 2024-09-10T23:15:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.923+0000 7ff24ba00640 1 -- 172.21.15.17:0/3673684436 shutdown_connections 2024-09-10T23:15:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.923+0000 7ff24ba00640 1 --2- 172.21.15.17:0/3673684436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440b32d0 0x7ff244150d70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.923+0000 7ff24ba00640 1 --2- 172.21.15.17:0/3673684436 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2440cf610 0x7ff24406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.923+0000 7ff24ba00640 1 -- 172.21.15.17:0/3673684436 >> 172.21.15.17:0/3673684436 conn(0x7ff24406cfc0 msgr2=0x7ff24406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.923+0000 7ff24ba00640 1 -- 172.21.15.17:0/3673684436 shutdown_connections 2024-09-10T23:15:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.923+0000 7ff24ba00640 1 -- 172.21.15.17:0/3673684436 wait complete. 2024-09-10T23:15:57.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 Processor -- start 2024-09-10T23:15:57.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 -- start start 2024-09-10T23:15:57.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2440b32d0 0x7ff2440ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440cf230 0x7ff24413eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2440cf610 0x7ff24413f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff2440d0330 con 0x7ff2440cf230 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff2440d01b0 con 0x7ff2440b32d0 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff2440d04b0 con 0x7ff2440cf610 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff23be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440cf230 0x7ff24413eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff249000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2440b32d0 0x7ff2440ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff23be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440cf230 0x7ff24413eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33826/0 (socket says 172.21.15.17:33826) 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff23be00640 1 -- 172.21.15.17:0/3377087895 learned_addr learned my addr 172.21.15.17:0/3377087895 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff249a00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2440cf610 0x7ff24413f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff23be00640 1 -- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2440cf610 msgr2=0x7ff24413f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff23be00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2440cf610 0x7ff24413f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff23be00640 1 -- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2440b32d0 msgr2=0x7ff2440ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:57.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff23be00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2440b32d0 0x7ff2440ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff23be00640 1 -- 172.21.15.17:0/3377087895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2441e7180 con 0x7ff2440cf230 2024-09-10T23:15:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff23be00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440cf230 0x7ff24413eb00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c9f0 tx=0x7ff22c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff241600640 1 -- 172.21.15.17:0/3377087895 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c007bb0 con 0x7ff2440cf230 2024-09-10T23:15:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff241600640 1 -- 172.21.15.17:0/3377087895 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff22c007e40 con 0x7ff2440cf230 2024-09-10T23:15:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff241600640 1 -- 172.21.15.17:0/3377087895 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00f690 con 0x7ff2440cf230 2024-09-10T23:15:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2441e7460 con 0x7ff2440cf230 2024-09-10T23:15:57.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.927+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2440cc900 con 0x7ff2440cf230 2024-09-10T23:15:57.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.931+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff244150d70 con 0x7ff2440cf230 2024-09-10T23:15:57.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.931+0000 7ff241600640 1 -- 172.21.15.17:0/3377087895 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff22c020030 con 0x7ff2440cf230 2024-09-10T23:15:57.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.931+0000 7ff241600640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2200725e0 0x7ff220074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:57.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.931+0000 7ff241600640 1 -- 172.21.15.17:0/3377087895 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff22c093950 con 0x7ff2440cf230 2024-09-10T23:15:57.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.931+0000 7ff249000640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2200725e0 0x7ff220074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:57.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.931+0000 7ff249000640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2200725e0 0x7ff220074aa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff2440cde90 tx=0x7ff234007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:57.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:57.935+0000 7ff241600640 1 -- 172.21.15.17:0/3377087895 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff22c014030 con 0x7ff2440cf230 2024-09-10T23:15:58.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.111+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff24415bcd0 con 0x7ff2440cf230 2024-09-10T23:15:58.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff241600640 1 -- 172.21.15.17:0/3377087895 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18538 (secure 0 0 0) 0x7ff22c05e690 con 0x7ff2440cf230 2024-09-10T23:15:58.117 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:58.117 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:41.258986+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:15:58.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2200725e0 msgr2=0x7ff220074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2200725e0 0x7ff220074aa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff2440cde90 tx=0x7ff234007e40 comp rx=0 tx=0).stop 2024-09-10T23:15:58.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440cf230 msgr2=0x7ff24413eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440cf230 0x7ff24413eb00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c9f0 tx=0x7ff22c00ceb0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 shutdown_connections 2024-09-10T23:15:58.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2200725e0 0x7ff220074aa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2440cf610 0x7ff24413f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2440cf230 0x7ff24413eb00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 --2- 172.21.15.17:0/3377087895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2440b32d0 0x7ff2440ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 >> 172.21.15.17:0/3377087895 conn(0x7ff24406cfc0 msgr2=0x7ff24415c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 shutdown_connections 2024-09-10T23:15:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.115+0000 7ff24ba00640 1 -- 172.21.15.17:0/3377087895 wait complete. 2024-09-10T23:15:58.139 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:15:58.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:58.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 -- 172.21.15.17:0/3949436541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd26c0cf320 msgr2=0x7fd26c0cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 --2- 172.21.15.17:0/3949436541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd26c0cf320 0x7fd26c0cd880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd264009bc0 tx=0x7fd26401cba0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 -- 172.21.15.17:0/3949436541 shutdown_connections 2024-09-10T23:15:58.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 --2- 172.21.15.17:0/3949436541 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd26c0cf320 0x7fd26c0cd880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 --2- 172.21.15.17:0/3949436541 >> v2:172.21.15.77:3300/0 conn(0x7fd26c070ad0 0x7fd26c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 -- 172.21.15.17:0/3949436541 >> 172.21.15.17:0/3949436541 conn(0x7fd26c0d1d60 msgr2=0x7fd26c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:58.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 -- 172.21.15.17:0/3949436541 shutdown_connections 2024-09-10T23:15:58.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 -- 172.21.15.17:0/3949436541 wait complete. 2024-09-10T23:15:58.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 Processor -- start 2024-09-10T23:15:58.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 -- start start 2024-09-10T23:15:58.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd26c070ad0 0x7fd26c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd26c0cf320 0x7fd26c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd26c0d1830 0x7fd26c1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c1693d0 con 0x7fd26c070ad0 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c169250 con 0x7fd26c0cf320 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd271200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd26c169550 con 0x7fd26c0d1830 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.283+0000 7fd269e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd26c070ad0 0x7fd26c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd269e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd26c070ad0 0x7fd26c06f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33834/0 (socket says 172.21.15.17:33834) 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd269e00640 1 -- 172.21.15.17:0/3831812176 learned_addr learned my addr 172.21.15.17:0/3831812176 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd26a800640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd26c0d1830 0x7fd26c1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd263e00640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd26c0cf320 0x7fd26c06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd269e00640 1 -- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd26c0d1830 msgr2=0x7fd26c1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd269e00640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd26c0d1830 0x7fd26c1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd269e00640 1 -- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd26c0cf320 msgr2=0x7fd26c06f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd269e00640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd26c0cf320 0x7fd26c06f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd269e00640 1 -- 172.21.15.17:0/3831812176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26c1fb5b0 con 0x7fd26c070ad0 2024-09-10T23:15:58.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd269e00640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd26c070ad0 0x7fd26c06f280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00e9f0 tx=0x7fd25c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:58.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd262000640 1 -- 172.21.15.17:0/3831812176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00cd80 con 0x7fd26c070ad0 2024-09-10T23:15:58.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd262000640 1 -- 172.21.15.17:0/3831812176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd25c010430 con 0x7fd26c070ad0 2024-09-10T23:15:58.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd262000640 1 -- 172.21.15.17:0/3831812176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c010860 con 0x7fd26c070ad0 2024-09-10T23:15:58.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26c1fb890 con 0x7fd26c070ad0 2024-09-10T23:15:58.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26c1fbe50 con 0x7fd26c070ad0 2024-09-10T23:15:58.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26c15f060 con 0x7fd26c070ad0 2024-09-10T23:15:58.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.287+0000 7fd262000640 1 -- 172.21.15.17:0/3831812176 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd25c010a00 con 0x7fd26c070ad0 2024-09-10T23:15:58.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.291+0000 7fd262000640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd248072610 0x7fd248074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.291+0000 7fd262000640 1 -- 172.21.15.17:0/3831812176 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd25c0941c0 con 0x7fd26c070ad0 2024-09-10T23:15:58.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.291+0000 7fd263e00640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd248072610 0x7fd248074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.291+0000 7fd263e00640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd248072610 0x7fd248074ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0c8a20 tx=0x7fd254009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:58.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.295+0000 7fd262000640 1 -- 172.21.15.17:0/3831812176 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd25c05f580 con 0x7fd26c070ad0 2024-09-10T23:15:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.467+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd26c069e10 con 0x7fd248072610 2024-09-10T23:15:58.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.475+0000 7fd262000640 1 -- 172.21.15.17:0/3831812176 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7fd254015430 con 0x7fd248072610 2024-09-10T23:15:58.481 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:58.483 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:15:58.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd248072610 msgr2=0x7fd248074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd248072610 0x7fd248074ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0c8a20 tx=0x7fd254009040 comp rx=0 tx=0).stop 2024-09-10T23:15:58.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd26c070ad0 msgr2=0x7fd26c06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd26c070ad0 0x7fd26c06f280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00e9f0 tx=0x7fd25c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 shutdown_connections 2024-09-10T23:15:58.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd248072610 0x7fd248074ad0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd26c0d1830 0x7fd26c1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd26c0cf320 0x7fd26c06f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 --2- 172.21.15.17:0/3831812176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd26c070ad0 0x7fd26c06f280 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 >> 172.21.15.17:0/3831812176 conn(0x7fd26c0d1d60 msgr2=0x7fd26c0b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:58.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 shutdown_connections 2024-09-10T23:15:58.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.479+0000 7fd271200640 1 -- 172.21.15.17:0/3831812176 wait complete. 2024-09-10T23:15:58.502 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-10T23:15:58.297369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232128,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742592,"statfs":{"total":773094113280,"available":772856414208,"internally_reserved":0,"allocated":3514368,"data_stored":2072232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003591"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976877+0000","last_change":"2024-09-10T23:15:35.814652+0000","last_active":"2024-09-10T23:15:41.976877+0000","last_peered":"2024-09-10T23:15:41.976877+0000","last_clean":"2024-09-10T23:15:41.976877+0000","last_became_active":"2024-09-10T23:15:35.813651+0000","last_became_peered":"2024-09-10T23:15:35.813651+0000","last_unstale":"2024-09-10T23:15:41.976877+0000","last_undegraded":"2024-09-10T23:15:41.976877+0000","last_fullsized":"2024-09-10T23:15:41.976877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:03.885457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478220+0000","last_change":"2024-09-10T23:15:36.816888+0000","last_active":"2024-09-10T23:15:42.478220+0000","last_peered":"2024-09-10T23:15:42.478220+0000","last_clean":"2024-09-10T23:15:42.478220+0000","last_became_active":"2024-09-10T23:15:36.816546+0000","last_became_peered":"2024-09-10T23:15:36.816546+0000","last_unstale":"2024-09-10T23:15:42.478220+0000","last_undegraded":"2024-09-10T23:15:42.478220+0000","last_fullsized":"2024-09-10T23:15:42.478220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:15.359059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477480+0000","last_change":"2024-09-10T23:15:40.918612+0000","last_active":"2024-09-10T23:15:42.477480+0000","last_peered":"2024-09-10T23:15:42.477480+0000","last_clean":"2024-09-10T23:15:42.477480+0000","last_became_active":"2024-09-10T23:15:40.917951+0000","last_became_peered":"2024-09-10T23:15:40.917951+0000","last_unstale":"2024-09-10T23:15:42.477480+0000","last_undegraded":"2024-09-10T23:15:42.477480+0000","last_fullsized":"2024-09-10T23:15:42.477480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:58.740153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478306+0000","last_change":"2024-09-10T23:15:35.820658+0000","last_active":"2024-09-10T23:15:42.478306+0000","last_peered":"2024-09-10T23:15:42.478306+0000","last_clean":"2024-09-10T23:15:42.478306+0000","last_became_active":"2024-09-10T23:15:35.820362+0000","last_became_peered":"2024-09-10T23:15:35.820362+0000","last_unstale":"2024-09-10T23:15:42.478306+0000","last_undegraded":"2024-09-10T23:15:42.478306+0000","last_fullsized":"2024-09-10T23:15:42.478306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:59.264177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976763+0000","last_change":"2024-09-10T23:15:36.826442+0000","last_active":"2024-09-10T23:15:41.976763+0000","last_peered":"2024-09-10T23:15:41.976763+0000","last_clean":"2024-09-10T23:15:41.976763+0000","last_became_active":"2024-09-10T23:15:36.826134+0000","last_became_peered":"2024-09-10T23:15:36.826134+0000","last_unstale":"2024-09-10T23:15:41.976763+0000","last_undegraded":"2024-09-10T23:15:41.976763+0000","last_fullsized":"2024-09-10T23:15:41.976763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:25.766975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050245+0000","last_change":"2024-09-10T23:15:40.846375+0000","last_active":"2024-09-10T23:15:42.050245+0000","last_peered":"2024-09-10T23:15:42.050245+0000","last_clean":"2024-09-10T23:15:42.050245+0000","last_became_active":"2024-09-10T23:15:40.845497+0000","last_became_peered":"2024-09-10T23:15:40.845497+0000","last_unstale":"2024-09-10T23:15:42.050245+0000","last_undegraded":"2024-09-10T23:15:42.050245+0000","last_fullsized":"2024-09-10T23:15:42.050245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:56.268422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083553+0000","last_change":"2024-09-10T23:15:35.824606+0000","last_active":"2024-09-10T23:15:42.083553+0000","last_peered":"2024-09-10T23:15:42.083553+0000","last_clean":"2024-09-10T23:15:42.083553+0000","last_became_active":"2024-09-10T23:15:35.824294+0000","last_became_peered":"2024-09-10T23:15:35.824294+0000","last_unstale":"2024-09-10T23:15:42.083553+0000","last_undegraded":"2024-09-10T23:15:42.083553+0000","last_fullsized":"2024-09-10T23:15:42.083553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453441+0000","last_change":"2024-09-10T23:15:36.833443+0000","last_active":"2024-09-10T23:15:42.453441+0000","last_peered":"2024-09-10T23:15:42.453441+0000","last_clean":"2024-09-10T23:15:42.453441+0000","last_became_active":"2024-09-10T23:15:36.831507+0000","last_became_peered":"2024-09-10T23:15:36.831507+0000","last_unstale":"2024-09-10T23:15:42.453441+0000","last_undegraded":"2024-09-10T23:15:42.453441+0000","last_fullsized":"2024-09-10T23:15:42.453441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:46.059643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050541+0000","last_change":"2024-09-10T23:15:40.848217+0000","last_active":"2024-09-10T23:15:42.050541+0000","last_peered":"2024-09-10T23:15:42.050541+0000","last_clean":"2024-09-10T23:15:42.050541+0000","last_became_active":"2024-09-10T23:15:40.847206+0000","last_became_peered":"2024-09-10T23:15:40.847206+0000","last_unstale":"2024-09-10T23:15:42.050541+0000","last_undegraded":"2024-09-10T23:15:42.050541+0000","last_fullsized":"2024-09-10T23:15:42.050541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:13.797702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083326+0000","last_change":"2024-09-10T23:15:35.824509+0000","last_active":"2024-09-10T23:15:42.083326+0000","last_peered":"2024-09-10T23:15:42.083326+0000","last_clean":"2024-09-10T23:15:42.083326+0000","last_became_active":"2024-09-10T23:15:35.824204+0000","last_became_peered":"2024-09-10T23:15:35.824204+0000","last_unstale":"2024-09-10T23:15:42.083326+0000","last_undegraded":"2024-09-10T23:15:42.083326+0000","last_fullsized":"2024-09-10T23:15:42.083326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:11.532685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453590+0000","last_change":"2024-09-10T23:15:36.828659+0000","last_active":"2024-09-10T23:15:42.453590+0000","last_peered":"2024-09-10T23:15:42.453590+0000","last_clean":"2024-09-10T23:15:42.453590+0000","last_became_active":"2024-09-10T23:15:36.828322+0000","last_became_peered":"2024-09-10T23:15:36.828322+0000","last_unstale":"2024-09-10T23:15:42.453590+0000","last_undegraded":"2024-09-10T23:15:42.453590+0000","last_fullsized":"2024-09-10T23:15:42.453590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:02.889244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050319+0000","last_change":"2024-09-10T23:15:40.849484+0000","last_active":"2024-09-10T23:15:42.050319+0000","last_peered":"2024-09-10T23:15:42.050319+0000","last_clean":"2024-09-10T23:15:42.050319+0000","last_became_active":"2024-09-10T23:15:40.848878+0000","last_became_peered":"2024-09-10T23:15:40.848878+0000","last_unstale":"2024-09-10T23:15:42.050319+0000","last_undegraded":"2024-09-10T23:15:42.050319+0000","last_fullsized":"2024-09-10T23:15:42.050319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:20.089945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866699+0000","last_change":"2024-09-10T23:15:36.837333+0000","last_active":"2024-09-10T23:15:41.866699+0000","last_peered":"2024-09-10T23:15:41.866699+0000","last_clean":"2024-09-10T23:15:41.866699+0000","last_became_active":"2024-09-10T23:15:36.837159+0000","last_became_peered":"2024-09-10T23:15:36.837159+0000","last_unstale":"2024-09-10T23:15:41.866699+0000","last_undegraded":"2024-09-10T23:15:41.866699+0000","last_fullsized":"2024-09-10T23:15:41.866699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:42.144340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083393+0000","last_change":"2024-09-10T23:15:35.821008+0000","last_active":"2024-09-10T23:15:42.083393+0000","last_peered":"2024-09-10T23:15:42.083393+0000","last_clean":"2024-09-10T23:15:42.083393+0000","last_became_active":"2024-09-10T23:15:35.820800+0000","last_became_peered":"2024-09-10T23:15:35.820800+0000","last_unstale":"2024-09-10T23:15:42.083393+0000","last_undegraded":"2024-09-10T23:15:42.083393+0000","last_fullsized":"2024-09-10T23:15:42.083393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050630+0000","last_change":"2024-09-10T23:15:40.850423+0000","last_active":"2024-09-10T23:15:42.050630+0000","last_peered":"2024-09-10T23:15:42.050630+0000","last_clean":"2024-09-10T23:15:42.050630+0000","last_became_active":"2024-09-10T23:15:40.848512+0000","last_became_peered":"2024-09-10T23:15:40.848512+0000","last_unstale":"2024-09-10T23:15:42.050630+0000","last_undegraded":"2024-09-10T23:15:42.050630+0000","last_fullsized":"2024-09-10T23:15:42.050630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:06.923809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477795+0000","last_change":"2024-09-10T23:15:36.815925+0000","last_active":"2024-09-10T23:15:42.477795+0000","last_peered":"2024-09-10T23:15:42.477795+0000","last_clean":"2024-09-10T23:15:42.477795+0000","last_became_active":"2024-09-10T23:15:36.815528+0000","last_became_peered":"2024-09-10T23:15:36.815528+0000","last_unstale":"2024-09-10T23:15:42.477795+0000","last_undegraded":"2024-09-10T23:15:42.477795+0000","last_fullsized":"2024-09-10T23:15:42.477795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:09.964148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965964+0000","last_change":"2024-09-10T23:15:35.819766+0000","last_active":"2024-09-10T23:15:41.965964+0000","last_peered":"2024-09-10T23:15:41.965964+0000","last_clean":"2024-09-10T23:15:41.965964+0000","last_became_active":"2024-09-10T23:15:35.819208+0000","last_became_peered":"2024-09-10T23:15:35.819208+0000","last_unstale":"2024-09-10T23:15:41.965964+0000","last_undegraded":"2024-09-10T23:15:41.965964+0000","last_fullsized":"2024-09-10T23:15:41.965964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050814+0000","last_change":"2024-09-10T23:15:40.845547+0000","last_active":"2024-09-10T23:15:42.050814+0000","last_peered":"2024-09-10T23:15:42.050814+0000","last_clean":"2024-09-10T23:15:42.050814+0000","last_became_active":"2024-09-10T23:15:40.842954+0000","last_became_peered":"2024-09-10T23:15:40.842954+0000","last_unstale":"2024-09-10T23:15:42.050814+0000","last_undegraded":"2024-09-10T23:15:42.050814+0000","last_fullsized":"2024-09-10T23:15:42.050814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:50.094208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477613+0000","last_change":"2024-09-10T23:15:36.810636+0000","last_active":"2024-09-10T23:15:42.477613+0000","last_peered":"2024-09-10T23:15:42.477613+0000","last_clean":"2024-09-10T23:15:42.477613+0000","last_became_active":"2024-09-10T23:15:36.810344+0000","last_became_peered":"2024-09-10T23:15:36.810344+0000","last_unstale":"2024-09-10T23:15:42.477613+0000","last_undegraded":"2024-09-10T23:15:42.477613+0000","last_fullsized":"2024-09-10T23:15:42.477613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:04.853549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965671+0000","last_change":"2024-09-10T23:15:35.817152+0000","last_active":"2024-09-10T23:15:41.965671+0000","last_peered":"2024-09-10T23:15:41.965671+0000","last_clean":"2024-09-10T23:15:41.965671+0000","last_became_active":"2024-09-10T23:15:35.815119+0000","last_became_peered":"2024-09-10T23:15:35.815119+0000","last_unstale":"2024-09-10T23:15:41.965671+0000","last_undegraded":"2024-09-10T23:15:41.965671+0000","last_fullsized":"2024-09-10T23:15:41.965671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966575+0000","last_change":"2024-09-10T23:15:40.922557+0000","last_active":"2024-09-10T23:15:41.966575+0000","last_peered":"2024-09-10T23:15:41.966575+0000","last_clean":"2024-09-10T23:15:41.966575+0000","last_became_active":"2024-09-10T23:15:40.921331+0000","last_became_peered":"2024-09-10T23:15:40.921331+0000","last_unstale":"2024-09-10T23:15:41.966575+0000","last_undegraded":"2024-09-10T23:15:41.966575+0000","last_fullsized":"2024-09-10T23:15:41.966575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:02.366453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050961+0000","last_change":"2024-09-10T23:15:36.807834+0000","last_active":"2024-09-10T23:15:42.050961+0000","last_peered":"2024-09-10T23:15:42.050961+0000","last_clean":"2024-09-10T23:15:42.050961+0000","last_became_active":"2024-09-10T23:15:36.807456+0000","last_became_peered":"2024-09-10T23:15:36.807456+0000","last_unstale":"2024-09-10T23:15:42.050961+0000","last_undegraded":"2024-09-10T23:15:42.050961+0000","last_fullsized":"2024-09-10T23:15:42.050961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:53.903864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.082975+0000","last_change":"2024-09-10T23:15:35.818465+0000","last_active":"2024-09-10T23:15:42.082975+0000","last_peered":"2024-09-10T23:15:42.082975+0000","last_clean":"2024-09-10T23:15:42.082975+0000","last_became_active":"2024-09-10T23:15:35.818170+0000","last_became_peered":"2024-09-10T23:15:35.818170+0000","last_unstale":"2024-09-10T23:15:42.082975+0000","last_undegraded":"2024-09-10T23:15:42.082975+0000","last_fullsized":"2024-09-10T23:15:42.082975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:18.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050681+0000","last_change":"2024-09-10T23:15:40.845836+0000","last_active":"2024-09-10T23:15:42.050681+0000","last_peered":"2024-09-10T23:15:42.050681+0000","last_clean":"2024-09-10T23:15:42.050681+0000","last_became_active":"2024-09-10T23:15:40.845311+0000","last_became_peered":"2024-09-10T23:15:40.845311+0000","last_unstale":"2024-09-10T23:15:42.050681+0000","last_undegraded":"2024-09-10T23:15:42.050681+0000","last_fullsized":"2024-09-10T23:15:42.050681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:19.885524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977347+0000","last_change":"2024-09-10T23:15:36.809745+0000","last_active":"2024-09-10T23:15:41.977347+0000","last_peered":"2024-09-10T23:15:41.977347+0000","last_clean":"2024-09-10T23:15:41.977347+0000","last_became_active":"2024-09-10T23:15:36.809472+0000","last_became_peered":"2024-09-10T23:15:36.809472+0000","last_unstale":"2024-09-10T23:15:41.977347+0000","last_undegraded":"2024-09-10T23:15:41.977347+0000","last_fullsized":"2024-09-10T23:15:41.977347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:46.554507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.867243+0000","last_change":"2024-09-10T23:15:35.817617+0000","last_active":"2024-09-10T23:15:41.867243+0000","last_peered":"2024-09-10T23:15:41.867243+0000","last_clean":"2024-09-10T23:15:41.867243+0000","last_became_active":"2024-09-10T23:15:35.817324+0000","last_became_peered":"2024-09-10T23:15:35.817324+0000","last_unstale":"2024-09-10T23:15:41.867243+0000","last_undegraded":"2024-09-10T23:15:41.867243+0000","last_fullsized":"2024-09-10T23:15:41.867243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050252+0000","last_change":"2024-09-10T23:15:40.918183+0000","last_active":"2024-09-10T23:15:42.050252+0000","last_peered":"2024-09-10T23:15:42.050252+0000","last_clean":"2024-09-10T23:15:42.050252+0000","last_became_active":"2024-09-10T23:15:40.917821+0000","last_became_peered":"2024-09-10T23:15:40.917821+0000","last_unstale":"2024-09-10T23:15:42.050252+0000","last_undegraded":"2024-09-10T23:15:42.050252+0000","last_fullsized":"2024-09-10T23:15:42.050252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:16.274683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478404+0000","last_change":"2024-09-10T23:15:36.819985+0000","last_active":"2024-09-10T23:15:42.478404+0000","last_peered":"2024-09-10T23:15:42.478404+0000","last_clean":"2024-09-10T23:15:42.478404+0000","last_became_active":"2024-09-10T23:15:36.819707+0000","last_became_peered":"2024-09-10T23:15:36.819707+0000","last_unstale":"2024-09-10T23:15:42.478404+0000","last_undegraded":"2024-09-10T23:15:42.478404+0000","last_fullsized":"2024-09-10T23:15:42.478404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:38.630118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966455+0000","last_change":"2024-09-10T23:15:35.815615+0000","last_active":"2024-09-10T23:15:41.966455+0000","last_peered":"2024-09-10T23:15:41.966455+0000","last_clean":"2024-09-10T23:15:41.966455+0000","last_became_active":"2024-09-10T23:15:35.813771+0000","last_became_peered":"2024-09-10T23:15:35.813771+0000","last_unstale":"2024-09-10T23:15:41.966455+0000","last_undegraded":"2024-09-10T23:15:41.966455+0000","last_fullsized":"2024-09-10T23:15:41.966455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477424+0000","last_change":"2024-09-10T23:15:40.918250+0000","last_active":"2024-09-10T23:15:42.477424+0000","last_peered":"2024-09-10T23:15:42.477424+0000","last_clean":"2024-09-10T23:15:42.477424+0000","last_became_active":"2024-09-10T23:15:40.917549+0000","last_became_peered":"2024-09-10T23:15:40.917549+0000","last_unstale":"2024-09-10T23:15:42.477424+0000","last_undegraded":"2024-09-10T23:15:42.477424+0000","last_fullsized":"2024-09-10T23:15:42.477424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:43.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966106+0000","last_change":"2024-09-10T23:15:36.805882+0000","last_active":"2024-09-10T23:15:41.966106+0000","last_peered":"2024-09-10T23:15:41.966106+0000","last_clean":"2024-09-10T23:15:41.966106+0000","last_became_active":"2024-09-10T23:15:36.805560+0000","last_became_peered":"2024-09-10T23:15:36.805560+0000","last_unstale":"2024-09-10T23:15:41.966106+0000","last_undegraded":"2024-09-10T23:15:41.966106+0000","last_fullsized":"2024-09-10T23:15:41.966106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083674+0000","last_change":"2024-09-10T23:15:35.825152+0000","last_active":"2024-09-10T23:15:42.083674+0000","last_peered":"2024-09-10T23:15:42.083674+0000","last_clean":"2024-09-10T23:15:42.083674+0000","last_became_active":"2024-09-10T23:15:35.824913+0000","last_became_peered":"2024-09-10T23:15:35.824913+0000","last_unstale":"2024-09-10T23:15:42.083674+0000","last_undegraded":"2024-09-10T23:15:42.083674+0000","last_fullsized":"2024-09-10T23:15:42.083674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976537+0000","last_change":"2024-09-10T23:15:40.923130+0000","last_active":"2024-09-10T23:15:41.976537+0000","last_peered":"2024-09-10T23:15:41.976537+0000","last_clean":"2024-09-10T23:15:41.976537+0000","last_became_active":"2024-09-10T23:15:40.922673+0000","last_became_peered":"2024-09-10T23:15:40.922673+0000","last_unstale":"2024-09-10T23:15:41.976537+0000","last_undegraded":"2024-09-10T23:15:41.976537+0000","last_fullsized":"2024-09-10T23:15:41.976537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453737+0000","last_change":"2024-09-10T23:15:36.823984+0000","last_active":"2024-09-10T23:15:42.453737+0000","last_peered":"2024-09-10T23:15:42.453737+0000","last_clean":"2024-09-10T23:15:42.453737+0000","last_became_active":"2024-09-10T23:15:36.821937+0000","last_became_peered":"2024-09-10T23:15:36.821937+0000","last_unstale":"2024-09-10T23:15:42.453737+0000","last_undegraded":"2024-09-10T23:15:42.453737+0000","last_fullsized":"2024-09-10T23:15:42.453737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:39.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966125+0000","last_change":"2024-09-10T23:15:35.814369+0000","last_active":"2024-09-10T23:15:41.966125+0000","last_peered":"2024-09-10T23:15:41.966125+0000","last_clean":"2024-09-10T23:15:41.966125+0000","last_became_active":"2024-09-10T23:15:35.813084+0000","last_became_peered":"2024-09-10T23:15:35.813084+0000","last_unstale":"2024-09-10T23:15:41.966125+0000","last_undegraded":"2024-09-10T23:15:41.966125+0000","last_fullsized":"2024-09-10T23:15:41.966125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965646+0000","last_change":"2024-09-10T23:15:40.856726+0000","last_active":"2024-09-10T23:15:41.965646+0000","last_peered":"2024-09-10T23:15:41.965646+0000","last_clean":"2024-09-10T23:15:41.965646+0000","last_became_active":"2024-09-10T23:15:40.852472+0000","last_became_peered":"2024-09-10T23:15:40.852472+0000","last_unstale":"2024-09-10T23:15:41.965646+0000","last_undegraded":"2024-09-10T23:15:41.965646+0000","last_fullsized":"2024-09-10T23:15:41.965646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.051146+0000","last_change":"2024-09-10T23:15:36.812895+0000","last_active":"2024-09-10T23:15:42.051146+0000","last_peered":"2024-09-10T23:15:42.051146+0000","last_clean":"2024-09-10T23:15:42.051146+0000","last_became_active":"2024-09-10T23:15:36.811704+0000","last_became_peered":"2024-09-10T23:15:36.811704+0000","last_unstale":"2024-09-10T23:15:42.051146+0000","last_undegraded":"2024-09-10T23:15:42.051146+0000","last_fullsized":"2024-09-10T23:15:42.051146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:15.129050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453461+0000","last_change":"2024-09-10T23:15:35.806612+0000","last_active":"2024-09-10T23:15:42.453461+0000","last_peered":"2024-09-10T23:15:42.453461+0000","last_clean":"2024-09-10T23:15:42.453461+0000","last_became_active":"2024-09-10T23:15:35.806252+0000","last_became_peered":"2024-09-10T23:15:35.806252+0000","last_unstale":"2024-09-10T23:15:42.453461+0000","last_undegraded":"2024-09-10T23:15:42.453461+0000","last_fullsized":"2024-09-10T23:15:42.453461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966028+0000","last_change":"2024-09-10T23:15:40.850623+0000","last_active":"2024-09-10T23:15:41.966028+0000","last_peered":"2024-09-10T23:15:41.966028+0000","last_clean":"2024-09-10T23:15:41.966028+0000","last_became_active":"2024-09-10T23:15:40.850268+0000","last_became_peered":"2024-09-10T23:15:40.850268+0000","last_unstale":"2024-09-10T23:15:41.966028+0000","last_undegraded":"2024-09-10T23:15:41.966028+0000","last_fullsized":"2024-09-10T23:15:41.966028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.634743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965723+0000","last_change":"2024-09-10T23:15:36.806814+0000","last_active":"2024-09-10T23:15:41.965723+0000","last_peered":"2024-09-10T23:15:41.965723+0000","last_clean":"2024-09-10T23:15:41.965723+0000","last_became_active":"2024-09-10T23:15:36.806543+0000","last_became_peered":"2024-09-10T23:15:36.806543+0000","last_unstale":"2024-09-10T23:15:41.965723+0000","last_undegraded":"2024-09-10T23:15:41.965723+0000","last_fullsized":"2024-09-10T23:15:41.965723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:27.255285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862034+0000","last_change":"2024-09-10T23:15:35.820635+0000","last_active":"2024-09-10T23:15:41.862034+0000","last_peered":"2024-09-10T23:15:41.862034+0000","last_clean":"2024-09-10T23:15:41.862034+0000","last_became_active":"2024-09-10T23:15:35.820316+0000","last_became_peered":"2024-09-10T23:15:35.820316+0000","last_unstale":"2024-09-10T23:15:41.862034+0000","last_undegraded":"2024-09-10T23:15:41.862034+0000","last_fullsized":"2024-09-10T23:15:41.862034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966617+0000","last_change":"2024-09-10T23:15:40.861082+0000","last_active":"2024-09-10T23:15:41.966617+0000","last_peered":"2024-09-10T23:15:41.966617+0000","last_clean":"2024-09-10T23:15:41.966617+0000","last_became_active":"2024-09-10T23:15:40.857518+0000","last_became_peered":"2024-09-10T23:15:40.857518+0000","last_unstale":"2024-09-10T23:15:41.966617+0000","last_undegraded":"2024-09-10T23:15:41.966617+0000","last_fullsized":"2024-09-10T23:15:41.966617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:15.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976242+0000","last_change":"2024-09-10T23:15:36.820294+0000","last_active":"2024-09-10T23:15:41.976242+0000","last_peered":"2024-09-10T23:15:41.976242+0000","last_clean":"2024-09-10T23:15:41.976242+0000","last_became_active":"2024-09-10T23:15:36.820007+0000","last_became_peered":"2024-09-10T23:15:36.820007+0000","last_unstale":"2024-09-10T23:15:41.976242+0000","last_undegraded":"2024-09-10T23:15:41.976242+0000","last_fullsized":"2024-09-10T23:15:41.976242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:59.107579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.082976+0000","last_change":"2024-09-10T23:15:35.821318+0000","last_active":"2024-09-10T23:15:42.082976+0000","last_peered":"2024-09-10T23:15:42.082976+0000","last_clean":"2024-09-10T23:15:42.082976+0000","last_became_active":"2024-09-10T23:15:35.821042+0000","last_became_peered":"2024-09-10T23:15:35.821042+0000","last_unstale":"2024-09-10T23:15:42.082976+0000","last_undegraded":"2024-09-10T23:15:42.082976+0000","last_fullsized":"2024-09-10T23:15:42.082976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:19.082501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977207+0000","last_change":"2024-09-10T23:15:40.919738+0000","last_active":"2024-09-10T23:15:41.977207+0000","last_peered":"2024-09-10T23:15:41.977207+0000","last_clean":"2024-09-10T23:15:41.977207+0000","last_became_active":"2024-09-10T23:15:40.919341+0000","last_became_peered":"2024-09-10T23:15:40.919341+0000","last_unstale":"2024-09-10T23:15:41.977207+0000","last_undegraded":"2024-09-10T23:15:41.977207+0000","last_fullsized":"2024-09-10T23:15:41.977207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:15.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477545+0000","last_change":"2024-09-10T23:15:36.825565+0000","last_active":"2024-09-10T23:15:42.477545+0000","last_peered":"2024-09-10T23:15:42.477545+0000","last_clean":"2024-09-10T23:15:42.477545+0000","last_became_active":"2024-09-10T23:15:36.825010+0000","last_became_peered":"2024-09-10T23:15:36.825010+0000","last_unstale":"2024-09-10T23:15:42.477545+0000","last_undegraded":"2024-09-10T23:15:42.477545+0000","last_fullsized":"2024-09-10T23:15:42.477545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:29.344583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453413+0000","last_change":"2024-09-10T23:15:35.809248+0000","last_active":"2024-09-10T23:15:42.453413+0000","last_peered":"2024-09-10T23:15:42.453413+0000","last_clean":"2024-09-10T23:15:42.453413+0000","last_became_active":"2024-09-10T23:15:35.808922+0000","last_became_peered":"2024-09-10T23:15:35.808922+0000","last_unstale":"2024-09-10T23:15:42.453413+0000","last_undegraded":"2024-09-10T23:15:42.453413+0000","last_fullsized":"2024-09-10T23:15:42.453413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083106+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:15:42.083106+0000","last_peered":"2024-09-10T23:15:42.083106+0000","last_clean":"2024-09-10T23:15:42.083106+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:15:42.083106+0000","last_undegraded":"2024-09-10T23:15:42.083106+0000","last_fullsized":"2024-09-10T23:15:42.083106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866508+0000","last_change":"2024-09-10T23:15:40.919822+0000","last_active":"2024-09-10T23:15:41.866508+0000","last_peered":"2024-09-10T23:15:41.866508+0000","last_clean":"2024-09-10T23:15:41.866508+0000","last_became_active":"2024-09-10T23:15:40.919328+0000","last_became_peered":"2024-09-10T23:15:40.919328+0000","last_unstale":"2024-09-10T23:15:41.866508+0000","last_undegraded":"2024-09-10T23:15:41.866508+0000","last_fullsized":"2024-09-10T23:15:41.866508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:06.923809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083445+0000","last_change":"2024-09-10T23:15:36.830835+0000","last_active":"2024-09-10T23:15:42.083445+0000","last_peered":"2024-09-10T23:15:42.083445+0000","last_clean":"2024-09-10T23:15:42.083445+0000","last_became_active":"2024-09-10T23:15:36.830577+0000","last_became_peered":"2024-09-10T23:15:36.830577+0000","last_unstale":"2024-09-10T23:15:42.083445+0000","last_undegraded":"2024-09-10T23:15:42.083445+0000","last_fullsized":"2024-09-10T23:15:42.083445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:02.889244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862500+0000","last_change":"2024-09-10T23:15:35.810227+0000","last_active":"2024-09-10T23:15:41.862500+0000","last_peered":"2024-09-10T23:15:41.862500+0000","last_clean":"2024-09-10T23:15:41.862500+0000","last_became_active":"2024-09-10T23:15:35.809934+0000","last_became_peered":"2024-09-10T23:15:35.809934+0000","last_unstale":"2024-09-10T23:15:41.862500+0000","last_undegraded":"2024-09-10T23:15:41.862500+0000","last_fullsized":"2024-09-10T23:15:41.862500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866742+0000","last_change":"2024-09-10T23:15:40.920305+0000","last_active":"2024-09-10T23:15:41.866742+0000","last_peered":"2024-09-10T23:15:41.866742+0000","last_clean":"2024-09-10T23:15:41.866742+0000","last_became_active":"2024-09-10T23:15:40.919525+0000","last_became_peered":"2024-09-10T23:15:40.919525+0000","last_unstale":"2024-09-10T23:15:41.866742+0000","last_undegraded":"2024-09-10T23:15:41.866742+0000","last_fullsized":"2024-09-10T23:15:41.866742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:19.885524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453520+0000","last_change":"2024-09-10T23:15:36.821403+0000","last_active":"2024-09-10T23:15:42.453520+0000","last_peered":"2024-09-10T23:15:42.453520+0000","last_clean":"2024-09-10T23:15:42.453520+0000","last_became_active":"2024-09-10T23:15:36.820075+0000","last_became_peered":"2024-09-10T23:15:36.820075+0000","last_unstale":"2024-09-10T23:15:42.453520+0000","last_undegraded":"2024-09-10T23:15:42.453520+0000","last_fullsized":"2024-09-10T23:15:42.453520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:58.090078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966385+0000","last_change":"2024-09-10T23:15:35.809772+0000","last_active":"2024-09-10T23:15:41.966385+0000","last_peered":"2024-09-10T23:15:41.966385+0000","last_clean":"2024-09-10T23:15:41.966385+0000","last_became_active":"2024-09-10T23:15:35.808856+0000","last_became_peered":"2024-09-10T23:15:35.808856+0000","last_unstale":"2024-09-10T23:15:41.966385+0000","last_undegraded":"2024-09-10T23:15:41.966385+0000","last_fullsized":"2024-09-10T23:15:41.966385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:11.532685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976700+0000","last_change":"2024-09-10T23:15:40.854344+0000","last_active":"2024-09-10T23:15:41.976700+0000","last_peered":"2024-09-10T23:15:41.976700+0000","last_clean":"2024-09-10T23:15:41.976700+0000","last_became_active":"2024-09-10T23:15:40.853674+0000","last_became_peered":"2024-09-10T23:15:40.853674+0000","last_unstale":"2024-09-10T23:15:41.976700+0000","last_undegraded":"2024-09-10T23:15:41.976700+0000","last_fullsized":"2024-09-10T23:15:41.976700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:02.124643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083823+0000","last_change":"2024-09-10T23:15:36.830949+0000","last_active":"2024-09-10T23:15:42.083823+0000","last_peered":"2024-09-10T23:15:42.083823+0000","last_clean":"2024-09-10T23:15:42.083823+0000","last_became_active":"2024-09-10T23:15:36.830634+0000","last_became_peered":"2024-09-10T23:15:36.830634+0000","last_unstale":"2024-09-10T23:15:42.083823+0000","last_undegraded":"2024-09-10T23:15:42.083823+0000","last_fullsized":"2024-09-10T23:15:42.083823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:58.331888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862700+0000","last_change":"2024-09-10T23:15:35.821546+0000","last_active":"2024-09-10T23:15:41.862700+0000","last_peered":"2024-09-10T23:15:41.862700+0000","last_clean":"2024-09-10T23:15:41.862700+0000","last_became_active":"2024-09-10T23:15:35.821344+0000","last_became_peered":"2024-09-10T23:15:35.821344+0000","last_unstale":"2024-09-10T23:15:41.862700+0000","last_undegraded":"2024-09-10T23:15:41.862700+0000","last_fullsized":"2024-09-10T23:15:41.862700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.452950+0000","last_change":"2024-09-10T23:15:40.916580+0000","last_active":"2024-09-10T23:15:42.452950+0000","last_peered":"2024-09-10T23:15:42.452950+0000","last_clean":"2024-09-10T23:15:42.452950+0000","last_became_active":"2024-09-10T23:15:40.915945+0000","last_became_peered":"2024-09-10T23:15:40.915945+0000","last_unstale":"2024-09-10T23:15:42.452950+0000","last_undegraded":"2024-09-10T23:15:42.452950+0000","last_fullsized":"2024-09-10T23:15:42.452950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:06.214916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083651+0000","last_change":"2024-09-10T23:15:36.829540+0000","last_active":"2024-09-10T23:15:42.083651+0000","last_peered":"2024-09-10T23:15:42.083651+0000","last_clean":"2024-09-10T23:15:42.083651+0000","last_became_active":"2024-09-10T23:15:36.829163+0000","last_became_peered":"2024-09-10T23:15:36.829163+0000","last_unstale":"2024-09-10T23:15:42.083651+0000","last_undegraded":"2024-09-10T23:15:42.083651+0000","last_fullsized":"2024-09-10T23:15:42.083651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:58.090078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050719+0000","last_change":"2024-09-10T23:15:35.819239+0000","last_active":"2024-09-10T23:15:42.050719+0000","last_peered":"2024-09-10T23:15:42.050719+0000","last_clean":"2024-09-10T23:15:42.050719+0000","last_became_active":"2024-09-10T23:15:35.818934+0000","last_became_peered":"2024-09-10T23:15:35.818934+0000","last_unstale":"2024-09-10T23:15:42.050719+0000","last_undegraded":"2024-09-10T23:15:42.050719+0000","last_fullsized":"2024-09-10T23:15:42.050719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:01.687726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050169+0000","last_change":"2024-09-10T23:15:40.842548+0000","last_active":"2024-09-10T23:15:42.050169+0000","last_peered":"2024-09-10T23:15:42.050169+0000","last_clean":"2024-09-10T23:15:42.050169+0000","last_became_active":"2024-09-10T23:15:40.842051+0000","last_became_peered":"2024-09-10T23:15:40.842051+0000","last_unstale":"2024-09-10T23:15:42.050169+0000","last_undegraded":"2024-09-10T23:15:42.050169+0000","last_fullsized":"2024-09-10T23:15:42.050169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:22.992518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083147+0000","last_change":"2024-09-10T23:15:36.838447+0000","last_active":"2024-09-10T23:15:42.083147+0000","last_peered":"2024-09-10T23:15:42.083147+0000","last_clean":"2024-09-10T23:15:42.083147+0000","last_became_active":"2024-09-10T23:15:36.836105+0000","last_became_peered":"2024-09-10T23:15:36.836105+0000","last_unstale":"2024-09-10T23:15:42.083147+0000","last_undegraded":"2024-09-10T23:15:42.083147+0000","last_fullsized":"2024-09-10T23:15:42.083147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:16.055380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.861808+0000","last_change":"2024-09-10T23:15:35.807363+0000","last_active":"2024-09-10T23:15:41.861808+0000","last_peered":"2024-09-10T23:15:41.861808+0000","last_clean":"2024-09-10T23:15:41.861808+0000","last_became_active":"2024-09-10T23:15:35.807055+0000","last_became_peered":"2024-09-10T23:15:35.807055+0000","last_unstale":"2024-09-10T23:15:41.861808+0000","last_undegraded":"2024-09-10T23:15:41.861808+0000","last_fullsized":"2024-09-10T23:15:41.861808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:08.518905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977108+0000","last_change":"2024-09-10T23:15:40.858906+0000","last_active":"2024-09-10T23:15:41.977108+0000","last_peered":"2024-09-10T23:15:41.977108+0000","last_clean":"2024-09-10T23:15:41.977108+0000","last_became_active":"2024-09-10T23:15:40.858496+0000","last_became_peered":"2024-09-10T23:15:40.858496+0000","last_unstale":"2024-09-10T23:15:41.977108+0000","last_undegraded":"2024-09-10T23:15:41.977108+0000","last_fullsized":"2024-09-10T23:15:41.977108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:02.366453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866358+0000","last_change":"2024-09-10T23:15:36.817753+0000","last_active":"2024-09-10T23:15:41.866358+0000","last_peered":"2024-09-10T23:15:41.866358+0000","last_clean":"2024-09-10T23:15:41.866358+0000","last_became_active":"2024-09-10T23:15:36.817206+0000","last_became_peered":"2024-09-10T23:15:36.817206+0000","last_unstale":"2024-09-10T23:15:41.866358+0000","last_undegraded":"2024-09-10T23:15:41.866358+0000","last_fullsized":"2024-09-10T23:15:41.866358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866623+0000","last_change":"2024-09-10T23:15:35.821188+0000","last_active":"2024-09-10T23:15:41.866623+0000","last_peered":"2024-09-10T23:15:41.866623+0000","last_clean":"2024-09-10T23:15:41.866623+0000","last_became_active":"2024-09-10T23:15:35.820920+0000","last_became_peered":"2024-09-10T23:15:35.820920+0000","last_unstale":"2024-09-10T23:15:41.866623+0000","last_undegraded":"2024-09-10T23:15:41.866623+0000","last_fullsized":"2024-09-10T23:15:41.866623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478460+0000","last_change":"2024-09-10T23:15:40.918593+0000","last_active":"2024-09-10T23:15:42.478460+0000","last_peered":"2024-09-10T23:15:42.478460+0000","last_clean":"2024-09-10T23:15:42.478460+0000","last_became_active":"2024-09-10T23:15:40.917690+0000","last_became_peered":"2024-09-10T23:15:40.917690+0000","last_unstale":"2024-09-10T23:15:42.478460+0000","last_undegraded":"2024-09-10T23:15:42.478460+0000","last_fullsized":"2024-09-10T23:15:42.478460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:29.798786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083337+0000","last_change":"2024-09-10T23:15:36.832264+0000","last_active":"2024-09-10T23:15:42.083337+0000","last_peered":"2024-09-10T23:15:42.083337+0000","last_clean":"2024-09-10T23:15:42.083337+0000","last_became_active":"2024-09-10T23:15:36.831964+0000","last_became_peered":"2024-09-10T23:15:36.831964+0000","last_unstale":"2024-09-10T23:15:42.083337+0000","last_undegraded":"2024-09-10T23:15:42.083337+0000","last_fullsized":"2024-09-10T23:15:42.083337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:11.927165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453323+0000","last_change":"2024-09-10T23:15:35.820445+0000","last_active":"2024-09-10T23:15:42.453323+0000","last_peered":"2024-09-10T23:15:42.453323+0000","last_clean":"2024-09-10T23:15:42.453323+0000","last_became_active":"2024-09-10T23:15:35.820097+0000","last_became_peered":"2024-09-10T23:15:35.820097+0000","last_unstale":"2024-09-10T23:15:42.453323+0000","last_undegraded":"2024-09-10T23:15:42.453323+0000","last_fullsized":"2024-09-10T23:15:42.453323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478082+0000","last_change":"2024-09-10T23:15:40.915679+0000","last_active":"2024-09-10T23:15:42.478082+0000","last_peered":"2024-09-10T23:15:42.478082+0000","last_clean":"2024-09-10T23:15:42.478082+0000","last_became_active":"2024-09-10T23:15:40.915242+0000","last_became_peered":"2024-09-10T23:15:40.915242+0000","last_unstale":"2024-09-10T23:15:42.478082+0000","last_undegraded":"2024-09-10T23:15:42.478082+0000","last_fullsized":"2024-09-10T23:15:42.478082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:03.887614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976508+0000","last_change":"2024-09-10T23:15:36.826848+0000","last_active":"2024-09-10T23:15:41.976508+0000","last_peered":"2024-09-10T23:15:41.976508+0000","last_clean":"2024-09-10T23:15:41.976508+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:41.976508+0000","last_undegraded":"2024-09-10T23:15:41.976508+0000","last_fullsized":"2024-09-10T23:15:41.976508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:50.455932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976827+0000","last_change":"2024-09-10T23:15:35.810368+0000","last_active":"2024-09-10T23:15:41.976827+0000","last_peered":"2024-09-10T23:15:41.976827+0000","last_clean":"2024-09-10T23:15:41.976827+0000","last_became_active":"2024-09-10T23:15:35.810056+0000","last_became_peered":"2024-09-10T23:15:35.810056+0000","last_unstale":"2024-09-10T23:15:41.976827+0000","last_undegraded":"2024-09-10T23:15:41.976827+0000","last_fullsized":"2024-09-10T23:15:41.976827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:31.969010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453668+0000","last_change":"2024-09-10T23:15:40.919743+0000","last_active":"2024-09-10T23:15:42.453668+0000","last_peered":"2024-09-10T23:15:42.453668+0000","last_clean":"2024-09-10T23:15:42.453668+0000","last_became_active":"2024-09-10T23:15:40.919307+0000","last_became_peered":"2024-09-10T23:15:40.919307+0000","last_unstale":"2024-09-10T23:15:42.453668+0000","last_undegraded":"2024-09-10T23:15:42.453668+0000","last_fullsized":"2024-09-10T23:15:42.453668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:51.552927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083357+0000","last_change":"2024-09-10T23:15:36.830195+0000","last_active":"2024-09-10T23:15:42.083357+0000","last_peered":"2024-09-10T23:15:42.083357+0000","last_clean":"2024-09-10T23:15:42.083357+0000","last_became_active":"2024-09-10T23:15:36.829550+0000","last_became_peered":"2024-09-10T23:15:36.829550+0000","last_unstale":"2024-09-10T23:15:42.083357+0000","last_undegraded":"2024-09-10T23:15:42.083357+0000","last_fullsized":"2024-09-10T23:15:42.083357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:09.763137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:47.850923+0000","last_change":"2024-09-10T23:15:35.822196+0000","last_active":"2024-09-10T23:15:47.850923+0000","last_peered":"2024-09-10T23:15:47.850923+0000","last_clean":"2024-09-10T23:15:47.850923+0000","last_became_active":"2024-09-10T23:15:35.821931+0000","last_became_peered":"2024-09-10T23:15:35.821931+0000","last_unstale":"2024-09-10T23:15:47.850923+0000","last_undegraded":"2024-09-10T23:15:47.850923+0000","last_fullsized":"2024-09-10T23:15:47.850923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965806+0000","last_change":"2024-09-10T23:15:40.857747+0000","last_active":"2024-09-10T23:15:41.965806+0000","last_peered":"2024-09-10T23:15:41.965806+0000","last_clean":"2024-09-10T23:15:41.965806+0000","last_became_active":"2024-09-10T23:15:40.851809+0000","last_became_peered":"2024-09-10T23:15:40.851809+0000","last_unstale":"2024-09-10T23:15:41.965806+0000","last_undegraded":"2024-09-10T23:15:41.965806+0000","last_fullsized":"2024-09-10T23:15:41.965806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:02.124643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050798+0000","last_change":"2024-09-10T23:15:36.819353+0000","last_active":"2024-09-10T23:15:42.050798+0000","last_peered":"2024-09-10T23:15:42.050798+0000","last_clean":"2024-09-10T23:15:42.050798+0000","last_became_active":"2024-09-10T23:15:36.818733+0000","last_became_peered":"2024-09-10T23:15:36.818733+0000","last_unstale":"2024-09-10T23:15:42.050798+0000","last_undegraded":"2024-09-10T23:15:42.050798+0000","last_fullsized":"2024-09-10T23:15:42.050798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:12.540137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966319+0000","last_change":"2024-09-10T23:15:35.809473+0000","last_active":"2024-09-10T23:15:41.966319+0000","last_peered":"2024-09-10T23:15:41.966319+0000","last_clean":"2024-09-10T23:15:41.966319+0000","last_became_active":"2024-09-10T23:15:35.808925+0000","last_became_peered":"2024-09-10T23:15:35.808925+0000","last_unstale":"2024-09-10T23:15:41.966319+0000","last_undegraded":"2024-09-10T23:15:41.966319+0000","last_fullsized":"2024-09-10T23:15:41.966319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:18.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050944+0000","last_change":"2024-09-10T23:15:40.845501+0000","last_active":"2024-09-10T23:15:42.050944+0000","last_peered":"2024-09-10T23:15:42.050944+0000","last_clean":"2024-09-10T23:15:42.050944+0000","last_became_active":"2024-09-10T23:15:40.845002+0000","last_became_peered":"2024-09-10T23:15:40.845002+0000","last_unstale":"2024-09-10T23:15:42.050944+0000","last_undegraded":"2024-09-10T23:15:42.050944+0000","last_fullsized":"2024-09-10T23:15:42.050944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976880+0000","last_change":"2024-09-10T23:15:36.823879+0000","last_active":"2024-09-10T23:15:41.976880+0000","last_peered":"2024-09-10T23:15:41.976880+0000","last_clean":"2024-09-10T23:15:41.976880+0000","last_became_active":"2024-09-10T23:15:36.823569+0000","last_became_peered":"2024-09-10T23:15:36.823569+0000","last_unstale":"2024-09-10T23:15:41.976880+0000","last_undegraded":"2024-09-10T23:15:41.976880+0000","last_fullsized":"2024-09-10T23:15:41.976880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453728+0000","last_change":"2024-09-10T23:15:35.821328+0000","last_active":"2024-09-10T23:15:42.453728+0000","last_peered":"2024-09-10T23:15:42.453728+0000","last_clean":"2024-09-10T23:15:42.453728+0000","last_became_active":"2024-09-10T23:15:35.820992+0000","last_became_peered":"2024-09-10T23:15:35.820992+0000","last_unstale":"2024-09-10T23:15:42.453728+0000","last_undegraded":"2024-09-10T23:15:42.453728+0000","last_fullsized":"2024-09-10T23:15:42.453728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477653+0000","last_change":"2024-09-10T23:15:40.853378+0000","last_active":"2024-09-10T23:15:42.477653+0000","last_peered":"2024-09-10T23:15:42.477653+0000","last_clean":"2024-09-10T23:15:42.477653+0000","last_became_active":"2024-09-10T23:15:40.851797+0000","last_became_peered":"2024-09-10T23:15:40.851797+0000","last_unstale":"2024-09-10T23:15:42.477653+0000","last_undegraded":"2024-09-10T23:15:42.477653+0000","last_fullsized":"2024-09-10T23:15:42.477653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:35.499058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453617+0000","last_change":"2024-09-10T23:15:36.827207+0000","last_active":"2024-09-10T23:15:42.453617+0000","last_peered":"2024-09-10T23:15:42.453617+0000","last_clean":"2024-09-10T23:15:42.453617+0000","last_became_active":"2024-09-10T23:15:36.826929+0000","last_became_peered":"2024-09-10T23:15:36.826929+0000","last_unstale":"2024-09-10T23:15:42.453617+0000","last_undegraded":"2024-09-10T23:15:42.453617+0000","last_fullsized":"2024-09-10T23:15:42.453617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:57.600178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.867150+0000","last_change":"2024-09-10T23:15:35.817151+0000","last_active":"2024-09-10T23:15:41.867150+0000","last_peered":"2024-09-10T23:15:41.867150+0000","last_clean":"2024-09-10T23:15:41.867150+0000","last_became_active":"2024-09-10T23:15:35.816069+0000","last_became_peered":"2024-09-10T23:15:35.816069+0000","last_unstale":"2024-09-10T23:15:41.867150+0000","last_undegraded":"2024-09-10T23:15:41.867150+0000","last_fullsized":"2024-09-10T23:15:41.867150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477587+0000","last_change":"2024-09-10T23:15:40.919083+0000","last_active":"2024-09-10T23:15:42.477587+0000","last_peered":"2024-09-10T23:15:42.477587+0000","last_clean":"2024-09-10T23:15:42.477587+0000","last_became_active":"2024-09-10T23:15:40.917807+0000","last_became_peered":"2024-09-10T23:15:40.917807+0000","last_unstale":"2024-09-10T23:15:42.477587+0000","last_undegraded":"2024-09-10T23:15:42.477587+0000","last_fullsized":"2024-09-10T23:15:42.477587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:53.108885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976987+0000","last_change":"2024-09-10T23:15:40.919668+0000","last_active":"2024-09-10T23:15:41.976987+0000","last_peered":"2024-09-10T23:15:41.976987+0000","last_clean":"2024-09-10T23:15:41.976987+0000","last_became_active":"2024-09-10T23:15:40.919242+0000","last_became_peered":"2024-09-10T23:15:40.919242+0000","last_unstale":"2024-09-10T23:15:41.976987+0000","last_undegraded":"2024-09-10T23:15:41.976987+0000","last_fullsized":"2024-09-10T23:15:41.976987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.634743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965554+0000","last_change":"2024-09-10T23:15:36.811659+0000","last_active":"2024-09-10T23:15:41.965554+0000","last_peered":"2024-09-10T23:15:41.965554+0000","last_clean":"2024-09-10T23:15:41.965554+0000","last_became_active":"2024-09-10T23:15:36.811297+0000","last_became_peered":"2024-09-10T23:15:36.811297+0000","last_unstale":"2024-09-10T23:15:41.965554+0000","last_undegraded":"2024-09-10T23:15:41.965554+0000","last_fullsized":"2024-09-10T23:15:41.965554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:51.803249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453169+0000","last_change":"2024-09-10T23:15:35.807726+0000","last_active":"2024-09-10T23:15:42.453169+0000","last_peered":"2024-09-10T23:15:42.453169+0000","last_clean":"2024-09-10T23:15:42.453169+0000","last_became_active":"2024-09-10T23:15:35.807144+0000","last_became_peered":"2024-09-10T23:15:35.807144+0000","last_unstale":"2024-09-10T23:15:42.453169+0000","last_undegraded":"2024-09-10T23:15:42.453169+0000","last_fullsized":"2024-09-10T23:15:42.453169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866991+0000","last_change":"2024-09-10T23:15:40.855753+0000","last_active":"2024-09-10T23:15:41.866991+0000","last_peered":"2024-09-10T23:15:41.866991+0000","last_clean":"2024-09-10T23:15:41.866991+0000","last_became_active":"2024-09-10T23:15:40.855320+0000","last_became_peered":"2024-09-10T23:15:40.855320+0000","last_unstale":"2024-09-10T23:15:41.866991+0000","last_undegraded":"2024-09-10T23:15:41.866991+0000","last_fullsized":"2024-09-10T23:15:41.866991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:50.094208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477523+0000","last_change":"2024-09-10T23:15:36.816132+0000","last_active":"2024-09-10T23:15:42.477523+0000","last_peered":"2024-09-10T23:15:42.477523+0000","last_clean":"2024-09-10T23:15:42.477523+0000","last_became_active":"2024-09-10T23:15:36.815801+0000","last_became_peered":"2024-09-10T23:15:36.815801+0000","last_unstale":"2024-09-10T23:15:42.477523+0000","last_undegraded":"2024-09-10T23:15:42.477523+0000","last_fullsized":"2024-09-10T23:15:42.477523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:01.311893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477667+0000","last_change":"2024-09-10T23:15:35.824434+0000","last_active":"2024-09-10T23:15:42.477667+0000","last_peered":"2024-09-10T23:15:42.477667+0000","last_clean":"2024-09-10T23:15:42.477667+0000","last_became_active":"2024-09-10T23:15:35.823485+0000","last_became_peered":"2024-09-10T23:15:35.823485+0000","last_unstale":"2024-09-10T23:15:42.477667+0000","last_undegraded":"2024-09-10T23:15:42.477667+0000","last_fullsized":"2024-09-10T23:15:42.477667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:04.088733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866955+0000","last_change":"2024-09-10T23:15:35.818427+0000","last_active":"2024-09-10T23:15:41.866955+0000","last_peered":"2024-09-10T23:15:41.866955+0000","last_clean":"2024-09-10T23:15:41.866955+0000","last_became_active":"2024-09-10T23:15:35.818167+0000","last_became_peered":"2024-09-10T23:15:35.818167+0000","last_unstale":"2024-09-10T23:15:41.866955+0000","last_undegraded":"2024-09-10T23:15:41.866955+0000","last_fullsized":"2024-09-10T23:15:41.866955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976819+0000","last_change":"2024-09-10T23:15:36.822253+0000","last_active":"2024-09-10T23:15:41.976819+0000","last_peered":"2024-09-10T23:15:41.976819+0000","last_clean":"2024-09-10T23:15:41.976819+0000","last_became_active":"2024-09-10T23:15:36.821990+0000","last_became_peered":"2024-09-10T23:15:36.821990+0000","last_unstale":"2024-09-10T23:15:41.976819+0000","last_undegraded":"2024-09-10T23:15:41.976819+0000","last_fullsized":"2024-09-10T23:15:41.976819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862372+0000","last_change":"2024-09-10T23:15:40.842622+0000","last_active":"2024-09-10T23:15:41.862372+0000","last_peered":"2024-09-10T23:15:41.862372+0000","last_clean":"2024-09-10T23:15:41.862372+0000","last_became_active":"2024-09-10T23:15:40.842113+0000","last_became_peered":"2024-09-10T23:15:40.842113+0000","last_unstale":"2024-09-10T23:15:41.862372+0000","last_undegraded":"2024-09-10T23:15:41.862372+0000","last_fullsized":"2024-09-10T23:15:41.862372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:03.142144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477876+0000","last_change":"2024-09-10T23:15:35.823540+0000","last_active":"2024-09-10T23:15:42.477876+0000","last_peered":"2024-09-10T23:15:42.477876+0000","last_clean":"2024-09-10T23:15:42.477876+0000","last_became_active":"2024-09-10T23:15:35.823054+0000","last_became_peered":"2024-09-10T23:15:35.823054+0000","last_unstale":"2024-09-10T23:15:42.477876+0000","last_undegraded":"2024-09-10T23:15:42.477876+0000","last_fullsized":"2024-09-10T23:15:42.477876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:04.057636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050474+0000","last_change":"2024-09-10T23:15:36.812487+0000","last_active":"2024-09-10T23:15:42.050474+0000","last_peered":"2024-09-10T23:15:42.050474+0000","last_clean":"2024-09-10T23:15:42.050474+0000","last_became_active":"2024-09-10T23:15:36.812141+0000","last_became_peered":"2024-09-10T23:15:36.812141+0000","last_unstale":"2024-09-10T23:15:42.050474+0000","last_undegraded":"2024-09-10T23:15:42.050474+0000","last_fullsized":"2024-09-10T23:15:42.050474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:51.808916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478078+0000","last_change":"2024-09-10T23:15:40.847773+0000","last_active":"2024-09-10T23:15:42.478078+0000","last_peered":"2024-09-10T23:15:42.478078+0000","last_clean":"2024-09-10T23:15:42.478078+0000","last_became_active":"2024-09-10T23:15:40.847351+0000","last_became_peered":"2024-09-10T23:15:40.847351+0000","last_unstale":"2024-09-10T23:15:42.478078+0000","last_undegraded":"2024-09-10T23:15:42.478078+0000","last_fullsized":"2024-09-10T23:15:42.478078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:56.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866237+0000","last_change":"2024-09-10T23:15:36.817479+0000","last_active":"2024-09-10T23:15:41.866237+0000","last_peered":"2024-09-10T23:15:41.866237+0000","last_clean":"2024-09-10T23:15:41.866237+0000","last_became_active":"2024-09-10T23:15:36.816922+0000","last_became_peered":"2024-09-10T23:15:36.816922+0000","last_unstale":"2024-09-10T23:15:41.866237+0000","last_undegraded":"2024-09-10T23:15:41.866237+0000","last_fullsized":"2024-09-10T23:15:41.866237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.142950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.861972+0000","last_change":"2024-09-10T23:15:36.819587+0000","last_active":"2024-09-10T23:15:41.861972+0000","last_peered":"2024-09-10T23:15:41.861972+0000","last_clean":"2024-09-10T23:15:41.861972+0000","last_became_active":"2024-09-10T23:15:36.819330+0000","last_became_peered":"2024-09-10T23:15:36.819330+0000","last_unstale":"2024-09-10T23:15:41.861972+0000","last_undegraded":"2024-09-10T23:15:41.861972+0000","last_fullsized":"2024-09-10T23:15:41.861972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453293+0000","last_change":"2024-09-10T23:15:36.821061+0000","last_active":"2024-09-10T23:15:42.453293+0000","last_peered":"2024-09-10T23:15:42.453293+0000","last_clean":"2024-09-10T23:15:42.453293+0000","last_became_active":"2024-09-10T23:15:36.820728+0000","last_became_peered":"2024-09-10T23:15:36.820728+0000","last_unstale":"2024-09-10T23:15:42.453293+0000","last_undegraded":"2024-09-10T23:15:42.453293+0000","last_fullsized":"2024-09-10T23:15:42.453293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:09.763137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976723+0000","last_change":"2024-09-10T23:15:36.817451+0000","last_active":"2024-09-10T23:15:41.976723+0000","last_peered":"2024-09-10T23:15:41.976723+0000","last_clean":"2024-09-10T23:15:41.976723+0000","last_became_active":"2024-09-10T23:15:36.817180+0000","last_became_peered":"2024-09-10T23:15:36.817180+0000","last_unstale":"2024-09-10T23:15:41.976723+0000","last_undegraded":"2024-09-10T23:15:41.976723+0000","last_fullsized":"2024-09-10T23:15:41.976723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:42.144340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478095+0000","last_change":"2024-09-10T23:15:36.834283+0000","last_active":"2024-09-10T23:15:42.478095+0000","last_peered":"2024-09-10T23:15:42.478095+0000","last_clean":"2024-09-10T23:15:42.478095+0000","last_became_active":"2024-09-10T23:15:36.832423+0000","last_became_peered":"2024-09-10T23:15:36.832423+0000","last_unstale":"2024-09-10T23:15:42.478095+0000","last_undegraded":"2024-09-10T23:15:42.478095+0000","last_fullsized":"2024-09-10T23:15:42.478095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:33.744306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966222+0000","last_change":"2024-09-10T23:15:36.817174+0000","last_active":"2024-09-10T23:15:41.966222+0000","last_peered":"2024-09-10T23:15:41.966222+0000","last_clean":"2024-09-10T23:15:41.966222+0000","last_became_active":"2024-09-10T23:15:36.816873+0000","last_became_peered":"2024-09-10T23:15:36.816873+0000","last_unstale":"2024-09-10T23:15:41.966222+0000","last_undegraded":"2024-09-10T23:15:41.966222+0000","last_fullsized":"2024-09-10T23:15:41.966222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866980+0000","last_change":"2024-09-10T23:15:36.814417+0000","last_active":"2024-09-10T23:15:41.866980+0000","last_peered":"2024-09-10T23:15:41.866980+0000","last_clean":"2024-09-10T23:15:41.866980+0000","last_became_active":"2024-09-10T23:15:36.814142+0000","last_became_peered":"2024-09-10T23:15:36.814142+0000","last_unstale":"2024-09-10T23:15:41.866980+0000","last_undegraded":"2024-09-10T23:15:41.866980+0000","last_fullsized":"2024-09-10T23:15:41.866980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478307+0000","last_change":"2024-09-10T23:15:36.827366+0000","last_active":"2024-09-10T23:15:42.478307+0000","last_peered":"2024-09-10T23:15:42.478307+0000","last_clean":"2024-09-10T23:15:42.478307+0000","last_became_active":"2024-09-10T23:15:36.827030+0000","last_became_peered":"2024-09-10T23:15:36.827030+0000","last_unstale":"2024-09-10T23:15:42.478307+0000","last_undegraded":"2024-09-10T23:15:42.478307+0000","last_fullsized":"2024-09-10T23:15:42.478307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:01.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453085+0000","last_change":"2024-09-10T23:15:36.825171+0000","last_active":"2024-09-10T23:15:42.453085+0000","last_peered":"2024-09-10T23:15:42.453085+0000","last_clean":"2024-09-10T23:15:42.453085+0000","last_became_active":"2024-09-10T23:15:36.824807+0000","last_became_peered":"2024-09-10T23:15:36.824807+0000","last_unstale":"2024-09-10T23:15:42.453085+0000","last_undegraded":"2024-09-10T23:15:42.453085+0000","last_fullsized":"2024-09-10T23:15:42.453085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:12.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477668+0000","last_change":"2024-09-10T23:15:36.828041+0000","last_active":"2024-09-10T23:15:42.477668+0000","last_peered":"2024-09-10T23:15:42.477668+0000","last_clean":"2024-09-10T23:15:42.477668+0000","last_became_active":"2024-09-10T23:15:36.827715+0000","last_became_peered":"2024-09-10T23:15:36.827715+0000","last_unstale":"2024-09-10T23:15:42.477668+0000","last_undegraded":"2024-09-10T23:15:42.477668+0000","last_fullsized":"2024-09-10T23:15:42.477668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:23.592896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453188+0000","last_change":"2024-09-10T23:15:36.827045+0000","last_active":"2024-09-10T23:15:42.453188+0000","last_peered":"2024-09-10T23:15:42.453188+0000","last_clean":"2024-09-10T23:15:42.453188+0000","last_became_active":"2024-09-10T23:15:36.826738+0000","last_became_peered":"2024-09-10T23:15:36.826738+0000","last_unstale":"2024-09-10T23:15:42.453188+0000","last_undegraded":"2024-09-10T23:15:42.453188+0000","last_fullsized":"2024-09-10T23:15:42.453188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:16.055380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976502+0000","last_change":"2024-09-10T23:15:36.826859+0000","last_active":"2024-09-10T23:15:41.976502+0000","last_peered":"2024-09-10T23:15:41.976502+0000","last_clean":"2024-09-10T23:15:41.976502+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:41.976502+0000","last_undegraded":"2024-09-10T23:15:41.976502+0000","last_fullsized":"2024-09-10T23:15:41.976502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.142950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866951+0000","last_change":"2024-09-10T23:15:36.840021+0000","last_active":"2024-09-10T23:15:41.866951+0000","last_peered":"2024-09-10T23:15:41.866951+0000","last_clean":"2024-09-10T23:15:41.866951+0000","last_became_active":"2024-09-10T23:15:36.839028+0000","last_became_peered":"2024-09-10T23:15:36.839028+0000","last_unstale":"2024-09-10T23:15:41.866951+0000","last_undegraded":"2024-09-10T23:15:41.866951+0000","last_fullsized":"2024-09-10T23:15:41.866951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:25.766975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083601+0000","last_change":"2024-09-10T23:15:36.817847+0000","last_active":"2024-09-10T23:15:42.083601+0000","last_peered":"2024-09-10T23:15:42.083601+0000","last_clean":"2024-09-10T23:15:42.083601+0000","last_became_active":"2024-09-10T23:15:36.817492+0000","last_became_peered":"2024-09-10T23:15:36.817492+0000","last_unstale":"2024-09-10T23:15:42.083601+0000","last_undegraded":"2024-09-10T23:15:42.083601+0000","last_fullsized":"2024-09-10T23:15:42.083601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:39.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862623+0000","last_change":"2024-09-10T23:15:36.818420+0000","last_active":"2024-09-10T23:15:41.862623+0000","last_peered":"2024-09-10T23:15:41.862623+0000","last_clean":"2024-09-10T23:15:41.862623+0000","last_became_active":"2024-09-10T23:15:36.818130+0000","last_became_peered":"2024-09-10T23:15:36.818130+0000","last_unstale":"2024-09-10T23:15:41.862623+0000","last_undegraded":"2024-09-10T23:15:41.862623+0000","last_fullsized":"2024-09-10T23:15:41.862623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:12.540137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453936+0000","last_change":"2024-09-10T23:15:36.823439+0000","last_active":"2024-09-10T23:15:42.453936+0000","last_peered":"2024-09-10T23:15:42.453936+0000","last_clean":"2024-09-10T23:15:42.453936+0000","last_became_active":"2024-09-10T23:15:36.823181+0000","last_became_peered":"2024-09-10T23:15:36.823181+0000","last_unstale":"2024-09-10T23:15:42.453936+0000","last_undegraded":"2024-09-10T23:15:42.453936+0000","last_fullsized":"2024-09-10T23:15:42.453936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:58.331888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.452952+0000","last_change":"2024-09-10T23:15:36.816826+0000","last_active":"2024-09-10T23:15:42.452952+0000","last_peered":"2024-09-10T23:15:42.452952+0000","last_clean":"2024-09-10T23:15:42.452952+0000","last_became_active":"2024-09-10T23:15:36.816557+0000","last_became_peered":"2024-09-10T23:15:36.816557+0000","last_unstale":"2024-09-10T23:15:42.452952+0000","last_undegraded":"2024-09-10T23:15:42.452952+0000","last_fullsized":"2024-09-10T23:15:42.452952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:58.172702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965639+0000","last_change":"2024-09-10T23:15:36.815890+0000","last_active":"2024-09-10T23:15:41.965639+0000","last_peered":"2024-09-10T23:15:41.965639+0000","last_clean":"2024-09-10T23:15:41.965639+0000","last_became_active":"2024-09-10T23:15:36.815610+0000","last_became_peered":"2024-09-10T23:15:36.815610+0000","last_unstale":"2024-09-10T23:15:41.965639+0000","last_undegraded":"2024-09-10T23:15:41.965639+0000","last_fullsized":"2024-09-10T23:15:41.965639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976461+0000","last_change":"2024-09-10T23:15:36.809792+0000","last_active":"2024-09-10T23:15:41.976461+0000","last_peered":"2024-09-10T23:15:41.976461+0000","last_clean":"2024-09-10T23:15:41.976461+0000","last_became_active":"2024-09-10T23:15:36.809448+0000","last_became_peered":"2024-09-10T23:15:36.809448+0000","last_unstale":"2024-09-10T23:15:41.976461+0000","last_undegraded":"2024-09-10T23:15:41.976461+0000","last_fullsized":"2024-09-10T23:15:41.976461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477756+0000","last_change":"2024-09-10T23:15:36.817574+0000","last_active":"2024-09-10T23:15:42.477756+0000","last_peered":"2024-09-10T23:15:42.477756+0000","last_clean":"2024-09-10T23:15:42.477756+0000","last_became_active":"2024-09-10T23:15:36.817319+0000","last_became_peered":"2024-09-10T23:15:36.817319+0000","last_unstale":"2024-09-10T23:15:42.477756+0000","last_undegraded":"2024-09-10T23:15:42.477756+0000","last_fullsized":"2024-09-10T23:15:42.477756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:13.250839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050667+0000","last_change":"2024-09-10T23:15:36.819031+0000","last_active":"2024-09-10T23:15:42.050667+0000","last_peered":"2024-09-10T23:15:42.050667+0000","last_clean":"2024-09-10T23:15:42.050667+0000","last_became_active":"2024-09-10T23:15:36.818398+0000","last_became_peered":"2024-09-10T23:15:36.818398+0000","last_unstale":"2024-09-10T23:15:42.050667+0000","last_undegraded":"2024-09-10T23:15:42.050667+0000","last_fullsized":"2024-09-10T23:15:42.050667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866752+0000","last_change":"2024-09-10T23:15:36.838074+0000","last_active":"2024-09-10T23:15:41.866752+0000","last_peered":"2024-09-10T23:15:41.866752+0000","last_clean":"2024-09-10T23:15:41.866752+0000","last_became_active":"2024-09-10T23:15:36.837841+0000","last_became_peered":"2024-09-10T23:15:36.837841+0000","last_unstale":"2024-09-10T23:15:41.866752+0000","last_undegraded":"2024-09-10T23:15:41.866752+0000","last_fullsized":"2024-09-10T23:15:41.866752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866888+0000","last_change":"2024-09-10T23:15:36.837828+0000","last_active":"2024-09-10T23:15:41.866888+0000","last_peered":"2024-09-10T23:15:41.866888+0000","last_clean":"2024-09-10T23:15:41.866888+0000","last_became_active":"2024-09-10T23:15:36.837356+0000","last_became_peered":"2024-09-10T23:15:36.837356+0000","last_unstale":"2024-09-10T23:15:41.866888+0000","last_undegraded":"2024-09-10T23:15:41.866888+0000","last_fullsized":"2024-09-10T23:15:41.866888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083795+0000","last_change":"2024-09-10T23:15:36.833388+0000","last_active":"2024-09-10T23:15:42.083795+0000","last_peered":"2024-09-10T23:15:42.083795+0000","last_clean":"2024-09-10T23:15:42.083795+0000","last_became_active":"2024-09-10T23:15:36.832978+0000","last_became_peered":"2024-09-10T23:15:36.832978+0000","last_unstale":"2024-09-10T23:15:42.083795+0000","last_undegraded":"2024-09-10T23:15:42.083795+0000","last_fullsized":"2024-09-10T23:15:42.083795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:46.059643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477408+0000","last_change":"2024-09-10T23:15:36.824751+0000","last_active":"2024-09-10T23:15:42.477408+0000","last_peered":"2024-09-10T23:15:42.477408+0000","last_clean":"2024-09-10T23:15:42.477408+0000","last_became_active":"2024-09-10T23:15:36.824453+0000","last_became_peered":"2024-09-10T23:15:36.824453+0000","last_unstale":"2024-09-10T23:15:42.477408+0000","last_undegraded":"2024-09-10T23:15:42.477408+0000","last_fullsized":"2024-09-10T23:15:42.477408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:15.565815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083075+0000","last_change":"2024-09-10T23:15:36.825819+0000","last_active":"2024-09-10T23:15:42.083075+0000","last_peered":"2024-09-10T23:15:42.083075+0000","last_clean":"2024-09-10T23:15:42.083075+0000","last_became_active":"2024-09-10T23:15:36.825572+0000","last_became_peered":"2024-09-10T23:15:36.825572+0000","last_unstale":"2024-09-10T23:15:42.083075+0000","last_undegraded":"2024-09-10T23:15:42.083075+0000","last_fullsized":"2024-09-10T23:15:42.083075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:12.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453098+0000","last_change":"2024-09-10T23:15:36.821090+0000","last_active":"2024-09-10T23:15:42.453098+0000","last_peered":"2024-09-10T23:15:42.453098+0000","last_clean":"2024-09-10T23:15:42.453098+0000","last_became_active":"2024-09-10T23:15:36.820786+0000","last_became_peered":"2024-09-10T23:15:36.820786+0000","last_unstale":"2024-09-10T23:15:42.453098+0000","last_undegraded":"2024-09-10T23:15:42.453098+0000","last_fullsized":"2024-09-10T23:15:42.453098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083221+0000","last_change":"2024-09-10T23:15:36.826772+0000","last_active":"2024-09-10T23:15:42.083221+0000","last_peered":"2024-09-10T23:15:42.083221+0000","last_clean":"2024-09-10T23:15:42.083221+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:42.083221+0000","last_undegraded":"2024-09-10T23:15:42.083221+0000","last_fullsized":"2024-09-10T23:15:42.083221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:57.600178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453408+0000","last_change":"2024-09-10T23:15:36.821049+0000","last_active":"2024-09-10T23:15:42.453408+0000","last_peered":"2024-09-10T23:15:42.453408+0000","last_clean":"2024-09-10T23:15:42.453408+0000","last_became_active":"2024-09-10T23:15:36.820392+0000","last_became_peered":"2024-09-10T23:15:36.820392+0000","last_unstale":"2024-09-10T23:15:42.453408+0000","last_undegraded":"2024-09-10T23:15:42.453408+0000","last_fullsized":"2024-09-10T23:15:42.453408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:15.850959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976642+0000","last_change":"2024-09-10T23:15:36.813236+0000","last_active":"2024-09-10T23:15:41.976642+0000","last_peered":"2024-09-10T23:15:41.976642+0000","last_clean":"2024-09-10T23:15:41.976642+0000","last_became_active":"2024-09-10T23:15:36.809383+0000","last_became_peered":"2024-09-10T23:15:36.809383+0000","last_unstale":"2024-09-10T23:15:41.976642+0000","last_undegraded":"2024-09-10T23:15:41.976642+0000","last_fullsized":"2024-09-10T23:15:41.976642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966446+0000","last_change":"2024-09-10T23:15:36.811515+0000","last_active":"2024-09-10T23:15:41.966446+0000","last_peered":"2024-09-10T23:15:41.966446+0000","last_clean":"2024-09-10T23:15:41.966446+0000","last_became_active":"2024-09-10T23:15:36.811215+0000","last_became_peered":"2024-09-10T23:15:36.811215+0000","last_unstale":"2024-09-10T23:15:41.966446+0000","last_undegraded":"2024-09-10T23:15:41.966446+0000","last_fullsized":"2024-09-10T23:15:41.966446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083737+0000","last_change":"2024-09-10T23:15:36.848698+0000","last_active":"2024-09-10T23:15:42.083737+0000","last_peered":"2024-09-10T23:15:42.083737+0000","last_clean":"2024-09-10T23:15:42.083737+0000","last_became_active":"2024-09-10T23:15:36.848106+0000","last_became_peered":"2024-09-10T23:15:36.848106+0000","last_unstale":"2024-09-10T23:15:42.083737+0000","last_undegraded":"2024-09-10T23:15:42.083737+0000","last_fullsized":"2024-09-10T23:15:42.083737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:15.850959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":110367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":110403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":110277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":110437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":888832,"data_stored":701283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:58.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:15:58.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 -- 172.21.15.17:0/824835432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 msgr2=0x7f525c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 --2- 172.21.15.17:0/824835432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 0x7f525c070350 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f524c009930 tx=0x7f524c01c8b0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 -- 172.21.15.17:0/824835432 shutdown_connections 2024-09-10T23:15:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 --2- 172.21.15.17:0/824835432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f525c0d1120 0x7f525c0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 --2- 172.21.15.17:0/824835432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 0x7f525c070350 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 -- 172.21.15.17:0/824835432 >> 172.21.15.17:0/824835432 conn(0x7f525c0d03d0 msgr2=0x7f525c0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 -- 172.21.15.17:0/824835432 shutdown_connections 2024-09-10T23:15:58.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 -- 172.21.15.17:0/824835432 wait complete. 2024-09-10T23:15:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 Processor -- start 2024-09-10T23:15:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 -- start start 2024-09-10T23:15:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f525c0d1120 0x7f525c148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 0x7f525c14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f525c153030 0x7f525c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f525c071750 con 0x7f525c152c50 2024-09-10T23:15:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0715d0 con 0x7f525c153030 2024-09-10T23:15:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.691+0000 7f5261e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f525c0b4a20 con 0x7f525c0d1120 2024-09-10T23:15:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 0x7f525c14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 0x7f525c14ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33860/0 (socket says 172.21.15.17:33860) 2024-09-10T23:15:58.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253e00640 1 -- 172.21.15.17:0/3288592536 learned_addr learned my addr 172.21.15.17:0/3288592536 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:58.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f525b400640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f525c153030 0x7f525c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f525aa00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f525c0d1120 0x7f525c148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253e00640 1 -- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f525c0d1120 msgr2=0x7f525c148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253e00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f525c0d1120 0x7f525c148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253e00640 1 -- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f525c153030 msgr2=0x7f525c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253e00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f525c153030 0x7f525c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253e00640 1 -- 172.21.15.17:0/3288592536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c14b370 con 0x7f525c152c50 2024-09-10T23:15:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253e00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 0x7f525c14ae30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f524400d980 tx=0x7f524400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253400640 1 -- 172.21.15.17:0/3288592536 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244017070 con 0x7f525c152c50 2024-09-10T23:15:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253400640 1 -- 172.21.15.17:0/3288592536 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5244009d60 con 0x7f525c152c50 2024-09-10T23:15:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253400640 1 -- 172.21.15.17:0/3288592536 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244005280 con 0x7f525c152c50 2024-09-10T23:15:58.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c0ce3c0 con 0x7f525c152c50 2024-09-10T23:15:58.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c0b0820 con 0x7f525c152c50 2024-09-10T23:15:58.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c0b3e30 con 0x7f525c152c50 2024-09-10T23:15:58.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.695+0000 7f5253400640 1 -- 172.21.15.17:0/3288592536 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5244005420 con 0x7f525c152c50 2024-09-10T23:15:58.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.699+0000 7f5253400640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52380725e0 0x7f5238074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.699+0000 7f5253400640 1 -- 172.21.15.17:0/3288592536 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52440937f0 con 0x7f525c152c50 2024-09-10T23:15:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.699+0000 7f525aa00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52380725e0 0x7f5238074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.699+0000 7f525aa00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52380725e0 0x7f5238074aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f524c0af000 tx=0x7f524c01b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.703+0000 7f5253400640 1 -- 172.21.15.17:0/3288592536 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f524405eb70 con 0x7f525c152c50 2024-09-10T23:15:58.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.871+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f525c15fe30 con 0x7f52380725e0 2024-09-10T23:15:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.879+0000 7f5253400640 1 -- 172.21.15.17:0/3288592536 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f525c15fe30 con 0x7f52380725e0 2024-09-10T23:15:58.888 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:58.890 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:15:58.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52380725e0 msgr2=0x7f5238074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52380725e0 0x7f5238074aa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f524c0af000 tx=0x7f524c01b0f0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 msgr2=0x7f525c14ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:58.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 0x7f525c14ae30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f524400d980 tx=0x7f524400de40 comp rx=0 tx=0).stop 2024-09-10T23:15:58.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 shutdown_connections 2024-09-10T23:15:58.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52380725e0 0x7f5238074aa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f525c153030 0x7f525c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f525c152c50 0x7f525c14ae30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 --2- 172.21.15.17:0/3288592536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f525c0d1120 0x7f525c148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:58.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 >> 172.21.15.17:0/3288592536 conn(0x7f525c0d03d0 msgr2=0x7f525c15f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:58.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 shutdown_connections 2024-09-10T23:15:58.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:58.883+0000 7f5261e00640 1 -- 172.21.15.17:0/3288592536 wait complete. 2024-09-10T23:15:58.906 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-10T23:15:58.297369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232128,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742592,"statfs":{"total":773094113280,"available":772856414208,"internally_reserved":0,"allocated":3514368,"data_stored":2072232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003591"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976877+0000","last_change":"2024-09-10T23:15:35.814652+0000","last_active":"2024-09-10T23:15:41.976877+0000","last_peered":"2024-09-10T23:15:41.976877+0000","last_clean":"2024-09-10T23:15:41.976877+0000","last_became_active":"2024-09-10T23:15:35.813651+0000","last_became_peered":"2024-09-10T23:15:35.813651+0000","last_unstale":"2024-09-10T23:15:41.976877+0000","last_undegraded":"2024-09-10T23:15:41.976877+0000","last_fullsized":"2024-09-10T23:15:41.976877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:03.885457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478220+0000","last_change":"2024-09-10T23:15:36.816888+0000","last_active":"2024-09-10T23:15:42.478220+0000","last_peered":"2024-09-10T23:15:42.478220+0000","last_clean":"2024-09-10T23:15:42.478220+0000","last_became_active":"2024-09-10T23:15:36.816546+0000","last_became_peered":"2024-09-10T23:15:36.816546+0000","last_unstale":"2024-09-10T23:15:42.478220+0000","last_undegraded":"2024-09-10T23:15:42.478220+0000","last_fullsized":"2024-09-10T23:15:42.478220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:15.359059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477480+0000","last_change":"2024-09-10T23:15:40.918612+0000","last_active":"2024-09-10T23:15:42.477480+0000","last_peered":"2024-09-10T23:15:42.477480+0000","last_clean":"2024-09-10T23:15:42.477480+0000","last_became_active":"2024-09-10T23:15:40.917951+0000","last_became_peered":"2024-09-10T23:15:40.917951+0000","last_unstale":"2024-09-10T23:15:42.477480+0000","last_undegraded":"2024-09-10T23:15:42.477480+0000","last_fullsized":"2024-09-10T23:15:42.477480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:58.740153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478306+0000","last_change":"2024-09-10T23:15:35.820658+0000","last_active":"2024-09-10T23:15:42.478306+0000","last_peered":"2024-09-10T23:15:42.478306+0000","last_clean":"2024-09-10T23:15:42.478306+0000","last_became_active":"2024-09-10T23:15:35.820362+0000","last_became_peered":"2024-09-10T23:15:35.820362+0000","last_unstale":"2024-09-10T23:15:42.478306+0000","last_undegraded":"2024-09-10T23:15:42.478306+0000","last_fullsized":"2024-09-10T23:15:42.478306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:59.264177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976763+0000","last_change":"2024-09-10T23:15:36.826442+0000","last_active":"2024-09-10T23:15:41.976763+0000","last_peered":"2024-09-10T23:15:41.976763+0000","last_clean":"2024-09-10T23:15:41.976763+0000","last_became_active":"2024-09-10T23:15:36.826134+0000","last_became_peered":"2024-09-10T23:15:36.826134+0000","last_unstale":"2024-09-10T23:15:41.976763+0000","last_undegraded":"2024-09-10T23:15:41.976763+0000","last_fullsized":"2024-09-10T23:15:41.976763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:25.766975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050245+0000","last_change":"2024-09-10T23:15:40.846375+0000","last_active":"2024-09-10T23:15:42.050245+0000","last_peered":"2024-09-10T23:15:42.050245+0000","last_clean":"2024-09-10T23:15:42.050245+0000","last_became_active":"2024-09-10T23:15:40.845497+0000","last_became_peered":"2024-09-10T23:15:40.845497+0000","last_unstale":"2024-09-10T23:15:42.050245+0000","last_undegraded":"2024-09-10T23:15:42.050245+0000","last_fullsized":"2024-09-10T23:15:42.050245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:56.268422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083553+0000","last_change":"2024-09-10T23:15:35.824606+0000","last_active":"2024-09-10T23:15:42.083553+0000","last_peered":"2024-09-10T23:15:42.083553+0000","last_clean":"2024-09-10T23:15:42.083553+0000","last_became_active":"2024-09-10T23:15:35.824294+0000","last_became_peered":"2024-09-10T23:15:35.824294+0000","last_unstale":"2024-09-10T23:15:42.083553+0000","last_undegraded":"2024-09-10T23:15:42.083553+0000","last_fullsized":"2024-09-10T23:15:42.083553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453441+0000","last_change":"2024-09-10T23:15:36.833443+0000","last_active":"2024-09-10T23:15:42.453441+0000","last_peered":"2024-09-10T23:15:42.453441+0000","last_clean":"2024-09-10T23:15:42.453441+0000","last_became_active":"2024-09-10T23:15:36.831507+0000","last_became_peered":"2024-09-10T23:15:36.831507+0000","last_unstale":"2024-09-10T23:15:42.453441+0000","last_undegraded":"2024-09-10T23:15:42.453441+0000","last_fullsized":"2024-09-10T23:15:42.453441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:46.059643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050541+0000","last_change":"2024-09-10T23:15:40.848217+0000","last_active":"2024-09-10T23:15:42.050541+0000","last_peered":"2024-09-10T23:15:42.050541+0000","last_clean":"2024-09-10T23:15:42.050541+0000","last_became_active":"2024-09-10T23:15:40.847206+0000","last_became_peered":"2024-09-10T23:15:40.847206+0000","last_unstale":"2024-09-10T23:15:42.050541+0000","last_undegraded":"2024-09-10T23:15:42.050541+0000","last_fullsized":"2024-09-10T23:15:42.050541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:13.797702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083326+0000","last_change":"2024-09-10T23:15:35.824509+0000","last_active":"2024-09-10T23:15:42.083326+0000","last_peered":"2024-09-10T23:15:42.083326+0000","last_clean":"2024-09-10T23:15:42.083326+0000","last_became_active":"2024-09-10T23:15:35.824204+0000","last_became_peered":"2024-09-10T23:15:35.824204+0000","last_unstale":"2024-09-10T23:15:42.083326+0000","last_undegraded":"2024-09-10T23:15:42.083326+0000","last_fullsized":"2024-09-10T23:15:42.083326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:11.532685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453590+0000","last_change":"2024-09-10T23:15:36.828659+0000","last_active":"2024-09-10T23:15:42.453590+0000","last_peered":"2024-09-10T23:15:42.453590+0000","last_clean":"2024-09-10T23:15:42.453590+0000","last_became_active":"2024-09-10T23:15:36.828322+0000","last_became_peered":"2024-09-10T23:15:36.828322+0000","last_unstale":"2024-09-10T23:15:42.453590+0000","last_undegraded":"2024-09-10T23:15:42.453590+0000","last_fullsized":"2024-09-10T23:15:42.453590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:02.889244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050319+0000","last_change":"2024-09-10T23:15:40.849484+0000","last_active":"2024-09-10T23:15:42.050319+0000","last_peered":"2024-09-10T23:15:42.050319+0000","last_clean":"2024-09-10T23:15:42.050319+0000","last_became_active":"2024-09-10T23:15:40.848878+0000","last_became_peered":"2024-09-10T23:15:40.848878+0000","last_unstale":"2024-09-10T23:15:42.050319+0000","last_undegraded":"2024-09-10T23:15:42.050319+0000","last_fullsized":"2024-09-10T23:15:42.050319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:20.089945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866699+0000","last_change":"2024-09-10T23:15:36.837333+0000","last_active":"2024-09-10T23:15:41.866699+0000","last_peered":"2024-09-10T23:15:41.866699+0000","last_clean":"2024-09-10T23:15:41.866699+0000","last_became_active":"2024-09-10T23:15:36.837159+0000","last_became_peered":"2024-09-10T23:15:36.837159+0000","last_unstale":"2024-09-10T23:15:41.866699+0000","last_undegraded":"2024-09-10T23:15:41.866699+0000","last_fullsized":"2024-09-10T23:15:41.866699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:42.144340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083393+0000","last_change":"2024-09-10T23:15:35.821008+0000","last_active":"2024-09-10T23:15:42.083393+0000","last_peered":"2024-09-10T23:15:42.083393+0000","last_clean":"2024-09-10T23:15:42.083393+0000","last_became_active":"2024-09-10T23:15:35.820800+0000","last_became_peered":"2024-09-10T23:15:35.820800+0000","last_unstale":"2024-09-10T23:15:42.083393+0000","last_undegraded":"2024-09-10T23:15:42.083393+0000","last_fullsized":"2024-09-10T23:15:42.083393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050630+0000","last_change":"2024-09-10T23:15:40.850423+0000","last_active":"2024-09-10T23:15:42.050630+0000","last_peered":"2024-09-10T23:15:42.050630+0000","last_clean":"2024-09-10T23:15:42.050630+0000","last_became_active":"2024-09-10T23:15:40.848512+0000","last_became_peered":"2024-09-10T23:15:40.848512+0000","last_unstale":"2024-09-10T23:15:42.050630+0000","last_undegraded":"2024-09-10T23:15:42.050630+0000","last_fullsized":"2024-09-10T23:15:42.050630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:06.923809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477795+0000","last_change":"2024-09-10T23:15:36.815925+0000","last_active":"2024-09-10T23:15:42.477795+0000","last_peered":"2024-09-10T23:15:42.477795+0000","last_clean":"2024-09-10T23:15:42.477795+0000","last_became_active":"2024-09-10T23:15:36.815528+0000","last_became_peered":"2024-09-10T23:15:36.815528+0000","last_unstale":"2024-09-10T23:15:42.477795+0000","last_undegraded":"2024-09-10T23:15:42.477795+0000","last_fullsized":"2024-09-10T23:15:42.477795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:09.964148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965964+0000","last_change":"2024-09-10T23:15:35.819766+0000","last_active":"2024-09-10T23:15:41.965964+0000","last_peered":"2024-09-10T23:15:41.965964+0000","last_clean":"2024-09-10T23:15:41.965964+0000","last_became_active":"2024-09-10T23:15:35.819208+0000","last_became_peered":"2024-09-10T23:15:35.819208+0000","last_unstale":"2024-09-10T23:15:41.965964+0000","last_undegraded":"2024-09-10T23:15:41.965964+0000","last_fullsized":"2024-09-10T23:15:41.965964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050814+0000","last_change":"2024-09-10T23:15:40.845547+0000","last_active":"2024-09-10T23:15:42.050814+0000","last_peered":"2024-09-10T23:15:42.050814+0000","last_clean":"2024-09-10T23:15:42.050814+0000","last_became_active":"2024-09-10T23:15:40.842954+0000","last_became_peered":"2024-09-10T23:15:40.842954+0000","last_unstale":"2024-09-10T23:15:42.050814+0000","last_undegraded":"2024-09-10T23:15:42.050814+0000","last_fullsized":"2024-09-10T23:15:42.050814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:50.094208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477613+0000","last_change":"2024-09-10T23:15:36.810636+0000","last_active":"2024-09-10T23:15:42.477613+0000","last_peered":"2024-09-10T23:15:42.477613+0000","last_clean":"2024-09-10T23:15:42.477613+0000","last_became_active":"2024-09-10T23:15:36.810344+0000","last_became_peered":"2024-09-10T23:15:36.810344+0000","last_unstale":"2024-09-10T23:15:42.477613+0000","last_undegraded":"2024-09-10T23:15:42.477613+0000","last_fullsized":"2024-09-10T23:15:42.477613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:04.853549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965671+0000","last_change":"2024-09-10T23:15:35.817152+0000","last_active":"2024-09-10T23:15:41.965671+0000","last_peered":"2024-09-10T23:15:41.965671+0000","last_clean":"2024-09-10T23:15:41.965671+0000","last_became_active":"2024-09-10T23:15:35.815119+0000","last_became_peered":"2024-09-10T23:15:35.815119+0000","last_unstale":"2024-09-10T23:15:41.965671+0000","last_undegraded":"2024-09-10T23:15:41.965671+0000","last_fullsized":"2024-09-10T23:15:41.965671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966575+0000","last_change":"2024-09-10T23:15:40.922557+0000","last_active":"2024-09-10T23:15:41.966575+0000","last_peered":"2024-09-10T23:15:41.966575+0000","last_clean":"2024-09-10T23:15:41.966575+0000","last_became_active":"2024-09-10T23:15:40.921331+0000","last_became_peered":"2024-09-10T23:15:40.921331+0000","last_unstale":"2024-09-10T23:15:41.966575+0000","last_undegraded":"2024-09-10T23:15:41.966575+0000","last_fullsized":"2024-09-10T23:15:41.966575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:02.366453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050961+0000","last_change":"2024-09-10T23:15:36.807834+0000","last_active":"2024-09-10T23:15:42.050961+0000","last_peered":"2024-09-10T23:15:42.050961+0000","last_clean":"2024-09-10T23:15:42.050961+0000","last_became_active":"2024-09-10T23:15:36.807456+0000","last_became_peered":"2024-09-10T23:15:36.807456+0000","last_unstale":"2024-09-10T23:15:42.050961+0000","last_undegraded":"2024-09-10T23:15:42.050961+0000","last_fullsized":"2024-09-10T23:15:42.050961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:53.903864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.082975+0000","last_change":"2024-09-10T23:15:35.818465+0000","last_active":"2024-09-10T23:15:42.082975+0000","last_peered":"2024-09-10T23:15:42.082975+0000","last_clean":"2024-09-10T23:15:42.082975+0000","last_became_active":"2024-09-10T23:15:35.818170+0000","last_became_peered":"2024-09-10T23:15:35.818170+0000","last_unstale":"2024-09-10T23:15:42.082975+0000","last_undegraded":"2024-09-10T23:15:42.082975+0000","last_fullsized":"2024-09-10T23:15:42.082975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:18.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050681+0000","last_change":"2024-09-10T23:15:40.845836+0000","last_active":"2024-09-10T23:15:42.050681+0000","last_peered":"2024-09-10T23:15:42.050681+0000","last_clean":"2024-09-10T23:15:42.050681+0000","last_became_active":"2024-09-10T23:15:40.845311+0000","last_became_peered":"2024-09-10T23:15:40.845311+0000","last_unstale":"2024-09-10T23:15:42.050681+0000","last_undegraded":"2024-09-10T23:15:42.050681+0000","last_fullsized":"2024-09-10T23:15:42.050681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:19.885524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977347+0000","last_change":"2024-09-10T23:15:36.809745+0000","last_active":"2024-09-10T23:15:41.977347+0000","last_peered":"2024-09-10T23:15:41.977347+0000","last_clean":"2024-09-10T23:15:41.977347+0000","last_became_active":"2024-09-10T23:15:36.809472+0000","last_became_peered":"2024-09-10T23:15:36.809472+0000","last_unstale":"2024-09-10T23:15:41.977347+0000","last_undegraded":"2024-09-10T23:15:41.977347+0000","last_fullsized":"2024-09-10T23:15:41.977347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:46.554507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.867243+0000","last_change":"2024-09-10T23:15:35.817617+0000","last_active":"2024-09-10T23:15:41.867243+0000","last_peered":"2024-09-10T23:15:41.867243+0000","last_clean":"2024-09-10T23:15:41.867243+0000","last_became_active":"2024-09-10T23:15:35.817324+0000","last_became_peered":"2024-09-10T23:15:35.817324+0000","last_unstale":"2024-09-10T23:15:41.867243+0000","last_undegraded":"2024-09-10T23:15:41.867243+0000","last_fullsized":"2024-09-10T23:15:41.867243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050252+0000","last_change":"2024-09-10T23:15:40.918183+0000","last_active":"2024-09-10T23:15:42.050252+0000","last_peered":"2024-09-10T23:15:42.050252+0000","last_clean":"2024-09-10T23:15:42.050252+0000","last_became_active":"2024-09-10T23:15:40.917821+0000","last_became_peered":"2024-09-10T23:15:40.917821+0000","last_unstale":"2024-09-10T23:15:42.050252+0000","last_undegraded":"2024-09-10T23:15:42.050252+0000","last_fullsized":"2024-09-10T23:15:42.050252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:16.274683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478404+0000","last_change":"2024-09-10T23:15:36.819985+0000","last_active":"2024-09-10T23:15:42.478404+0000","last_peered":"2024-09-10T23:15:42.478404+0000","last_clean":"2024-09-10T23:15:42.478404+0000","last_became_active":"2024-09-10T23:15:36.819707+0000","last_became_peered":"2024-09-10T23:15:36.819707+0000","last_unstale":"2024-09-10T23:15:42.478404+0000","last_undegraded":"2024-09-10T23:15:42.478404+0000","last_fullsized":"2024-09-10T23:15:42.478404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:38.630118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966455+0000","last_change":"2024-09-10T23:15:35.815615+0000","last_active":"2024-09-10T23:15:41.966455+0000","last_peered":"2024-09-10T23:15:41.966455+0000","last_clean":"2024-09-10T23:15:41.966455+0000","last_became_active":"2024-09-10T23:15:35.813771+0000","last_became_peered":"2024-09-10T23:15:35.813771+0000","last_unstale":"2024-09-10T23:15:41.966455+0000","last_undegraded":"2024-09-10T23:15:41.966455+0000","last_fullsized":"2024-09-10T23:15:41.966455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477424+0000","last_change":"2024-09-10T23:15:40.918250+0000","last_active":"2024-09-10T23:15:42.477424+0000","last_peered":"2024-09-10T23:15:42.477424+0000","last_clean":"2024-09-10T23:15:42.477424+0000","last_became_active":"2024-09-10T23:15:40.917549+0000","last_became_peered":"2024-09-10T23:15:40.917549+0000","last_unstale":"2024-09-10T23:15:42.477424+0000","last_undegraded":"2024-09-10T23:15:42.477424+0000","last_fullsized":"2024-09-10T23:15:42.477424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:43.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966106+0000","last_change":"2024-09-10T23:15:36.805882+0000","last_active":"2024-09-10T23:15:41.966106+0000","last_peered":"2024-09-10T23:15:41.966106+0000","last_clean":"2024-09-10T23:15:41.966106+0000","last_became_active":"2024-09-10T23:15:36.805560+0000","last_became_peered":"2024-09-10T23:15:36.805560+0000","last_unstale":"2024-09-10T23:15:41.966106+0000","last_undegraded":"2024-09-10T23:15:41.966106+0000","last_fullsized":"2024-09-10T23:15:41.966106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083674+0000","last_change":"2024-09-10T23:15:35.825152+0000","last_active":"2024-09-10T23:15:42.083674+0000","last_peered":"2024-09-10T23:15:42.083674+0000","last_clean":"2024-09-10T23:15:42.083674+0000","last_became_active":"2024-09-10T23:15:35.824913+0000","last_became_peered":"2024-09-10T23:15:35.824913+0000","last_unstale":"2024-09-10T23:15:42.083674+0000","last_undegraded":"2024-09-10T23:15:42.083674+0000","last_fullsized":"2024-09-10T23:15:42.083674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976537+0000","last_change":"2024-09-10T23:15:40.923130+0000","last_active":"2024-09-10T23:15:41.976537+0000","last_peered":"2024-09-10T23:15:41.976537+0000","last_clean":"2024-09-10T23:15:41.976537+0000","last_became_active":"2024-09-10T23:15:40.922673+0000","last_became_peered":"2024-09-10T23:15:40.922673+0000","last_unstale":"2024-09-10T23:15:41.976537+0000","last_undegraded":"2024-09-10T23:15:41.976537+0000","last_fullsized":"2024-09-10T23:15:41.976537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453737+0000","last_change":"2024-09-10T23:15:36.823984+0000","last_active":"2024-09-10T23:15:42.453737+0000","last_peered":"2024-09-10T23:15:42.453737+0000","last_clean":"2024-09-10T23:15:42.453737+0000","last_became_active":"2024-09-10T23:15:36.821937+0000","last_became_peered":"2024-09-10T23:15:36.821937+0000","last_unstale":"2024-09-10T23:15:42.453737+0000","last_undegraded":"2024-09-10T23:15:42.453737+0000","last_fullsized":"2024-09-10T23:15:42.453737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:39.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966125+0000","last_change":"2024-09-10T23:15:35.814369+0000","last_active":"2024-09-10T23:15:41.966125+0000","last_peered":"2024-09-10T23:15:41.966125+0000","last_clean":"2024-09-10T23:15:41.966125+0000","last_became_active":"2024-09-10T23:15:35.813084+0000","last_became_peered":"2024-09-10T23:15:35.813084+0000","last_unstale":"2024-09-10T23:15:41.966125+0000","last_undegraded":"2024-09-10T23:15:41.966125+0000","last_fullsized":"2024-09-10T23:15:41.966125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965646+0000","last_change":"2024-09-10T23:15:40.856726+0000","last_active":"2024-09-10T23:15:41.965646+0000","last_peered":"2024-09-10T23:15:41.965646+0000","last_clean":"2024-09-10T23:15:41.965646+0000","last_became_active":"2024-09-10T23:15:40.852472+0000","last_became_peered":"2024-09-10T23:15:40.852472+0000","last_unstale":"2024-09-10T23:15:41.965646+0000","last_undegraded":"2024-09-10T23:15:41.965646+0000","last_fullsized":"2024-09-10T23:15:41.965646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.051146+0000","last_change":"2024-09-10T23:15:36.812895+0000","last_active":"2024-09-10T23:15:42.051146+0000","last_peered":"2024-09-10T23:15:42.051146+0000","last_clean":"2024-09-10T23:15:42.051146+0000","last_became_active":"2024-09-10T23:15:36.811704+0000","last_became_peered":"2024-09-10T23:15:36.811704+0000","last_unstale":"2024-09-10T23:15:42.051146+0000","last_undegraded":"2024-09-10T23:15:42.051146+0000","last_fullsized":"2024-09-10T23:15:42.051146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:15.129050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453461+0000","last_change":"2024-09-10T23:15:35.806612+0000","last_active":"2024-09-10T23:15:42.453461+0000","last_peered":"2024-09-10T23:15:42.453461+0000","last_clean":"2024-09-10T23:15:42.453461+0000","last_became_active":"2024-09-10T23:15:35.806252+0000","last_became_peered":"2024-09-10T23:15:35.806252+0000","last_unstale":"2024-09-10T23:15:42.453461+0000","last_undegraded":"2024-09-10T23:15:42.453461+0000","last_fullsized":"2024-09-10T23:15:42.453461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966028+0000","last_change":"2024-09-10T23:15:40.850623+0000","last_active":"2024-09-10T23:15:41.966028+0000","last_peered":"2024-09-10T23:15:41.966028+0000","last_clean":"2024-09-10T23:15:41.966028+0000","last_became_active":"2024-09-10T23:15:40.850268+0000","last_became_peered":"2024-09-10T23:15:40.850268+0000","last_unstale":"2024-09-10T23:15:41.966028+0000","last_undegraded":"2024-09-10T23:15:41.966028+0000","last_fullsized":"2024-09-10T23:15:41.966028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.634743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965723+0000","last_change":"2024-09-10T23:15:36.806814+0000","last_active":"2024-09-10T23:15:41.965723+0000","last_peered":"2024-09-10T23:15:41.965723+0000","last_clean":"2024-09-10T23:15:41.965723+0000","last_became_active":"2024-09-10T23:15:36.806543+0000","last_became_peered":"2024-09-10T23:15:36.806543+0000","last_unstale":"2024-09-10T23:15:41.965723+0000","last_undegraded":"2024-09-10T23:15:41.965723+0000","last_fullsized":"2024-09-10T23:15:41.965723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:27.255285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862034+0000","last_change":"2024-09-10T23:15:35.820635+0000","last_active":"2024-09-10T23:15:41.862034+0000","last_peered":"2024-09-10T23:15:41.862034+0000","last_clean":"2024-09-10T23:15:41.862034+0000","last_became_active":"2024-09-10T23:15:35.820316+0000","last_became_peered":"2024-09-10T23:15:35.820316+0000","last_unstale":"2024-09-10T23:15:41.862034+0000","last_undegraded":"2024-09-10T23:15:41.862034+0000","last_fullsized":"2024-09-10T23:15:41.862034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966617+0000","last_change":"2024-09-10T23:15:40.861082+0000","last_active":"2024-09-10T23:15:41.966617+0000","last_peered":"2024-09-10T23:15:41.966617+0000","last_clean":"2024-09-10T23:15:41.966617+0000","last_became_active":"2024-09-10T23:15:40.857518+0000","last_became_peered":"2024-09-10T23:15:40.857518+0000","last_unstale":"2024-09-10T23:15:41.966617+0000","last_undegraded":"2024-09-10T23:15:41.966617+0000","last_fullsized":"2024-09-10T23:15:41.966617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:15.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976242+0000","last_change":"2024-09-10T23:15:36.820294+0000","last_active":"2024-09-10T23:15:41.976242+0000","last_peered":"2024-09-10T23:15:41.976242+0000","last_clean":"2024-09-10T23:15:41.976242+0000","last_became_active":"2024-09-10T23:15:36.820007+0000","last_became_peered":"2024-09-10T23:15:36.820007+0000","last_unstale":"2024-09-10T23:15:41.976242+0000","last_undegraded":"2024-09-10T23:15:41.976242+0000","last_fullsized":"2024-09-10T23:15:41.976242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:59.107579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.082976+0000","last_change":"2024-09-10T23:15:35.821318+0000","last_active":"2024-09-10T23:15:42.082976+0000","last_peered":"2024-09-10T23:15:42.082976+0000","last_clean":"2024-09-10T23:15:42.082976+0000","last_became_active":"2024-09-10T23:15:35.821042+0000","last_became_peered":"2024-09-10T23:15:35.821042+0000","last_unstale":"2024-09-10T23:15:42.082976+0000","last_undegraded":"2024-09-10T23:15:42.082976+0000","last_fullsized":"2024-09-10T23:15:42.082976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:19.082501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977207+0000","last_change":"2024-09-10T23:15:40.919738+0000","last_active":"2024-09-10T23:15:41.977207+0000","last_peered":"2024-09-10T23:15:41.977207+0000","last_clean":"2024-09-10T23:15:41.977207+0000","last_became_active":"2024-09-10T23:15:40.919341+0000","last_became_peered":"2024-09-10T23:15:40.919341+0000","last_unstale":"2024-09-10T23:15:41.977207+0000","last_undegraded":"2024-09-10T23:15:41.977207+0000","last_fullsized":"2024-09-10T23:15:41.977207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:15.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477545+0000","last_change":"2024-09-10T23:15:36.825565+0000","last_active":"2024-09-10T23:15:42.477545+0000","last_peered":"2024-09-10T23:15:42.477545+0000","last_clean":"2024-09-10T23:15:42.477545+0000","last_became_active":"2024-09-10T23:15:36.825010+0000","last_became_peered":"2024-09-10T23:15:36.825010+0000","last_unstale":"2024-09-10T23:15:42.477545+0000","last_undegraded":"2024-09-10T23:15:42.477545+0000","last_fullsized":"2024-09-10T23:15:42.477545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:29.344583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453413+0000","last_change":"2024-09-10T23:15:35.809248+0000","last_active":"2024-09-10T23:15:42.453413+0000","last_peered":"2024-09-10T23:15:42.453413+0000","last_clean":"2024-09-10T23:15:42.453413+0000","last_became_active":"2024-09-10T23:15:35.808922+0000","last_became_peered":"2024-09-10T23:15:35.808922+0000","last_unstale":"2024-09-10T23:15:42.453413+0000","last_undegraded":"2024-09-10T23:15:42.453413+0000","last_fullsized":"2024-09-10T23:15:42.453413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083106+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:15:42.083106+0000","last_peered":"2024-09-10T23:15:42.083106+0000","last_clean":"2024-09-10T23:15:42.083106+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:15:42.083106+0000","last_undegraded":"2024-09-10T23:15:42.083106+0000","last_fullsized":"2024-09-10T23:15:42.083106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866508+0000","last_change":"2024-09-10T23:15:40.919822+0000","last_active":"2024-09-10T23:15:41.866508+0000","last_peered":"2024-09-10T23:15:41.866508+0000","last_clean":"2024-09-10T23:15:41.866508+0000","last_became_active":"2024-09-10T23:15:40.919328+0000","last_became_peered":"2024-09-10T23:15:40.919328+0000","last_unstale":"2024-09-10T23:15:41.866508+0000","last_undegraded":"2024-09-10T23:15:41.866508+0000","last_fullsized":"2024-09-10T23:15:41.866508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:06.923809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083445+0000","last_change":"2024-09-10T23:15:36.830835+0000","last_active":"2024-09-10T23:15:42.083445+0000","last_peered":"2024-09-10T23:15:42.083445+0000","last_clean":"2024-09-10T23:15:42.083445+0000","last_became_active":"2024-09-10T23:15:36.830577+0000","last_became_peered":"2024-09-10T23:15:36.830577+0000","last_unstale":"2024-09-10T23:15:42.083445+0000","last_undegraded":"2024-09-10T23:15:42.083445+0000","last_fullsized":"2024-09-10T23:15:42.083445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:02.889244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862500+0000","last_change":"2024-09-10T23:15:35.810227+0000","last_active":"2024-09-10T23:15:41.862500+0000","last_peered":"2024-09-10T23:15:41.862500+0000","last_clean":"2024-09-10T23:15:41.862500+0000","last_became_active":"2024-09-10T23:15:35.809934+0000","last_became_peered":"2024-09-10T23:15:35.809934+0000","last_unstale":"2024-09-10T23:15:41.862500+0000","last_undegraded":"2024-09-10T23:15:41.862500+0000","last_fullsized":"2024-09-10T23:15:41.862500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866742+0000","last_change":"2024-09-10T23:15:40.920305+0000","last_active":"2024-09-10T23:15:41.866742+0000","last_peered":"2024-09-10T23:15:41.866742+0000","last_clean":"2024-09-10T23:15:41.866742+0000","last_became_active":"2024-09-10T23:15:40.919525+0000","last_became_peered":"2024-09-10T23:15:40.919525+0000","last_unstale":"2024-09-10T23:15:41.866742+0000","last_undegraded":"2024-09-10T23:15:41.866742+0000","last_fullsized":"2024-09-10T23:15:41.866742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:19.885524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453520+0000","last_change":"2024-09-10T23:15:36.821403+0000","last_active":"2024-09-10T23:15:42.453520+0000","last_peered":"2024-09-10T23:15:42.453520+0000","last_clean":"2024-09-10T23:15:42.453520+0000","last_became_active":"2024-09-10T23:15:36.820075+0000","last_became_peered":"2024-09-10T23:15:36.820075+0000","last_unstale":"2024-09-10T23:15:42.453520+0000","last_undegraded":"2024-09-10T23:15:42.453520+0000","last_fullsized":"2024-09-10T23:15:42.453520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:58.090078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966385+0000","last_change":"2024-09-10T23:15:35.809772+0000","last_active":"2024-09-10T23:15:41.966385+0000","last_peered":"2024-09-10T23:15:41.966385+0000","last_clean":"2024-09-10T23:15:41.966385+0000","last_became_active":"2024-09-10T23:15:35.808856+0000","last_became_peered":"2024-09-10T23:15:35.808856+0000","last_unstale":"2024-09-10T23:15:41.966385+0000","last_undegraded":"2024-09-10T23:15:41.966385+0000","last_fullsized":"2024-09-10T23:15:41.966385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:11.532685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976700+0000","last_change":"2024-09-10T23:15:40.854344+0000","last_active":"2024-09-10T23:15:41.976700+0000","last_peered":"2024-09-10T23:15:41.976700+0000","last_clean":"2024-09-10T23:15:41.976700+0000","last_became_active":"2024-09-10T23:15:40.853674+0000","last_became_peered":"2024-09-10T23:15:40.853674+0000","last_unstale":"2024-09-10T23:15:41.976700+0000","last_undegraded":"2024-09-10T23:15:41.976700+0000","last_fullsized":"2024-09-10T23:15:41.976700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:02.124643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083823+0000","last_change":"2024-09-10T23:15:36.830949+0000","last_active":"2024-09-10T23:15:42.083823+0000","last_peered":"2024-09-10T23:15:42.083823+0000","last_clean":"2024-09-10T23:15:42.083823+0000","last_became_active":"2024-09-10T23:15:36.830634+0000","last_became_peered":"2024-09-10T23:15:36.830634+0000","last_unstale":"2024-09-10T23:15:42.083823+0000","last_undegraded":"2024-09-10T23:15:42.083823+0000","last_fullsized":"2024-09-10T23:15:42.083823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:58.331888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862700+0000","last_change":"2024-09-10T23:15:35.821546+0000","last_active":"2024-09-10T23:15:41.862700+0000","last_peered":"2024-09-10T23:15:41.862700+0000","last_clean":"2024-09-10T23:15:41.862700+0000","last_became_active":"2024-09-10T23:15:35.821344+0000","last_became_peered":"2024-09-10T23:15:35.821344+0000","last_unstale":"2024-09-10T23:15:41.862700+0000","last_undegraded":"2024-09-10T23:15:41.862700+0000","last_fullsized":"2024-09-10T23:15:41.862700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.452950+0000","last_change":"2024-09-10T23:15:40.916580+0000","last_active":"2024-09-10T23:15:42.452950+0000","last_peered":"2024-09-10T23:15:42.452950+0000","last_clean":"2024-09-10T23:15:42.452950+0000","last_became_active":"2024-09-10T23:15:40.915945+0000","last_became_peered":"2024-09-10T23:15:40.915945+0000","last_unstale":"2024-09-10T23:15:42.452950+0000","last_undegraded":"2024-09-10T23:15:42.452950+0000","last_fullsized":"2024-09-10T23:15:42.452950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:06.214916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083651+0000","last_change":"2024-09-10T23:15:36.829540+0000","last_active":"2024-09-10T23:15:42.083651+0000","last_peered":"2024-09-10T23:15:42.083651+0000","last_clean":"2024-09-10T23:15:42.083651+0000","last_became_active":"2024-09-10T23:15:36.829163+0000","last_became_peered":"2024-09-10T23:15:36.829163+0000","last_unstale":"2024-09-10T23:15:42.083651+0000","last_undegraded":"2024-09-10T23:15:42.083651+0000","last_fullsized":"2024-09-10T23:15:42.083651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:58.090078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050719+0000","last_change":"2024-09-10T23:15:35.819239+0000","last_active":"2024-09-10T23:15:42.050719+0000","last_peered":"2024-09-10T23:15:42.050719+0000","last_clean":"2024-09-10T23:15:42.050719+0000","last_became_active":"2024-09-10T23:15:35.818934+0000","last_became_peered":"2024-09-10T23:15:35.818934+0000","last_unstale":"2024-09-10T23:15:42.050719+0000","last_undegraded":"2024-09-10T23:15:42.050719+0000","last_fullsized":"2024-09-10T23:15:42.050719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:01.687726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050169+0000","last_change":"2024-09-10T23:15:40.842548+0000","last_active":"2024-09-10T23:15:42.050169+0000","last_peered":"2024-09-10T23:15:42.050169+0000","last_clean":"2024-09-10T23:15:42.050169+0000","last_became_active":"2024-09-10T23:15:40.842051+0000","last_became_peered":"2024-09-10T23:15:40.842051+0000","last_unstale":"2024-09-10T23:15:42.050169+0000","last_undegraded":"2024-09-10T23:15:42.050169+0000","last_fullsized":"2024-09-10T23:15:42.050169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:22.992518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083147+0000","last_change":"2024-09-10T23:15:36.838447+0000","last_active":"2024-09-10T23:15:42.083147+0000","last_peered":"2024-09-10T23:15:42.083147+0000","last_clean":"2024-09-10T23:15:42.083147+0000","last_became_active":"2024-09-10T23:15:36.836105+0000","last_became_peered":"2024-09-10T23:15:36.836105+0000","last_unstale":"2024-09-10T23:15:42.083147+0000","last_undegraded":"2024-09-10T23:15:42.083147+0000","last_fullsized":"2024-09-10T23:15:42.083147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:16.055380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.861808+0000","last_change":"2024-09-10T23:15:35.807363+0000","last_active":"2024-09-10T23:15:41.861808+0000","last_peered":"2024-09-10T23:15:41.861808+0000","last_clean":"2024-09-10T23:15:41.861808+0000","last_became_active":"2024-09-10T23:15:35.807055+0000","last_became_peered":"2024-09-10T23:15:35.807055+0000","last_unstale":"2024-09-10T23:15:41.861808+0000","last_undegraded":"2024-09-10T23:15:41.861808+0000","last_fullsized":"2024-09-10T23:15:41.861808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:08.518905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977108+0000","last_change":"2024-09-10T23:15:40.858906+0000","last_active":"2024-09-10T23:15:41.977108+0000","last_peered":"2024-09-10T23:15:41.977108+0000","last_clean":"2024-09-10T23:15:41.977108+0000","last_became_active":"2024-09-10T23:15:40.858496+0000","last_became_peered":"2024-09-10T23:15:40.858496+0000","last_unstale":"2024-09-10T23:15:41.977108+0000","last_undegraded":"2024-09-10T23:15:41.977108+0000","last_fullsized":"2024-09-10T23:15:41.977108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:02.366453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866358+0000","last_change":"2024-09-10T23:15:36.817753+0000","last_active":"2024-09-10T23:15:41.866358+0000","last_peered":"2024-09-10T23:15:41.866358+0000","last_clean":"2024-09-10T23:15:41.866358+0000","last_became_active":"2024-09-10T23:15:36.817206+0000","last_became_peered":"2024-09-10T23:15:36.817206+0000","last_unstale":"2024-09-10T23:15:41.866358+0000","last_undegraded":"2024-09-10T23:15:41.866358+0000","last_fullsized":"2024-09-10T23:15:41.866358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866623+0000","last_change":"2024-09-10T23:15:35.821188+0000","last_active":"2024-09-10T23:15:41.866623+0000","last_peered":"2024-09-10T23:15:41.866623+0000","last_clean":"2024-09-10T23:15:41.866623+0000","last_became_active":"2024-09-10T23:15:35.820920+0000","last_became_peered":"2024-09-10T23:15:35.820920+0000","last_unstale":"2024-09-10T23:15:41.866623+0000","last_undegraded":"2024-09-10T23:15:41.866623+0000","last_fullsized":"2024-09-10T23:15:41.866623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478460+0000","last_change":"2024-09-10T23:15:40.918593+0000","last_active":"2024-09-10T23:15:42.478460+0000","last_peered":"2024-09-10T23:15:42.478460+0000","last_clean":"2024-09-10T23:15:42.478460+0000","last_became_active":"2024-09-10T23:15:40.917690+0000","last_became_peered":"2024-09-10T23:15:40.917690+0000","last_unstale":"2024-09-10T23:15:42.478460+0000","last_undegraded":"2024-09-10T23:15:42.478460+0000","last_fullsized":"2024-09-10T23:15:42.478460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:29.798786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083337+0000","last_change":"2024-09-10T23:15:36.832264+0000","last_active":"2024-09-10T23:15:42.083337+0000","last_peered":"2024-09-10T23:15:42.083337+0000","last_clean":"2024-09-10T23:15:42.083337+0000","last_became_active":"2024-09-10T23:15:36.831964+0000","last_became_peered":"2024-09-10T23:15:36.831964+0000","last_unstale":"2024-09-10T23:15:42.083337+0000","last_undegraded":"2024-09-10T23:15:42.083337+0000","last_fullsized":"2024-09-10T23:15:42.083337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:11.927165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453323+0000","last_change":"2024-09-10T23:15:35.820445+0000","last_active":"2024-09-10T23:15:42.453323+0000","last_peered":"2024-09-10T23:15:42.453323+0000","last_clean":"2024-09-10T23:15:42.453323+0000","last_became_active":"2024-09-10T23:15:35.820097+0000","last_became_peered":"2024-09-10T23:15:35.820097+0000","last_unstale":"2024-09-10T23:15:42.453323+0000","last_undegraded":"2024-09-10T23:15:42.453323+0000","last_fullsized":"2024-09-10T23:15:42.453323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478082+0000","last_change":"2024-09-10T23:15:40.915679+0000","last_active":"2024-09-10T23:15:42.478082+0000","last_peered":"2024-09-10T23:15:42.478082+0000","last_clean":"2024-09-10T23:15:42.478082+0000","last_became_active":"2024-09-10T23:15:40.915242+0000","last_became_peered":"2024-09-10T23:15:40.915242+0000","last_unstale":"2024-09-10T23:15:42.478082+0000","last_undegraded":"2024-09-10T23:15:42.478082+0000","last_fullsized":"2024-09-10T23:15:42.478082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:03.887614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976508+0000","last_change":"2024-09-10T23:15:36.826848+0000","last_active":"2024-09-10T23:15:41.976508+0000","last_peered":"2024-09-10T23:15:41.976508+0000","last_clean":"2024-09-10T23:15:41.976508+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:41.976508+0000","last_undegraded":"2024-09-10T23:15:41.976508+0000","last_fullsized":"2024-09-10T23:15:41.976508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:50.455932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976827+0000","last_change":"2024-09-10T23:15:35.810368+0000","last_active":"2024-09-10T23:15:41.976827+0000","last_peered":"2024-09-10T23:15:41.976827+0000","last_clean":"2024-09-10T23:15:41.976827+0000","last_became_active":"2024-09-10T23:15:35.810056+0000","last_became_peered":"2024-09-10T23:15:35.810056+0000","last_unstale":"2024-09-10T23:15:41.976827+0000","last_undegraded":"2024-09-10T23:15:41.976827+0000","last_fullsized":"2024-09-10T23:15:41.976827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:31.969010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453668+0000","last_change":"2024-09-10T23:15:40.919743+0000","last_active":"2024-09-10T23:15:42.453668+0000","last_peered":"2024-09-10T23:15:42.453668+0000","last_clean":"2024-09-10T23:15:42.453668+0000","last_became_active":"2024-09-10T23:15:40.919307+0000","last_became_peered":"2024-09-10T23:15:40.919307+0000","last_unstale":"2024-09-10T23:15:42.453668+0000","last_undegraded":"2024-09-10T23:15:42.453668+0000","last_fullsized":"2024-09-10T23:15:42.453668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:51.552927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083357+0000","last_change":"2024-09-10T23:15:36.830195+0000","last_active":"2024-09-10T23:15:42.083357+0000","last_peered":"2024-09-10T23:15:42.083357+0000","last_clean":"2024-09-10T23:15:42.083357+0000","last_became_active":"2024-09-10T23:15:36.829550+0000","last_became_peered":"2024-09-10T23:15:36.829550+0000","last_unstale":"2024-09-10T23:15:42.083357+0000","last_undegraded":"2024-09-10T23:15:42.083357+0000","last_fullsized":"2024-09-10T23:15:42.083357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:09.763137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:47.850923+0000","last_change":"2024-09-10T23:15:35.822196+0000","last_active":"2024-09-10T23:15:47.850923+0000","last_peered":"2024-09-10T23:15:47.850923+0000","last_clean":"2024-09-10T23:15:47.850923+0000","last_became_active":"2024-09-10T23:15:35.821931+0000","last_became_peered":"2024-09-10T23:15:35.821931+0000","last_unstale":"2024-09-10T23:15:47.850923+0000","last_undegraded":"2024-09-10T23:15:47.850923+0000","last_fullsized":"2024-09-10T23:15:47.850923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965806+0000","last_change":"2024-09-10T23:15:40.857747+0000","last_active":"2024-09-10T23:15:41.965806+0000","last_peered":"2024-09-10T23:15:41.965806+0000","last_clean":"2024-09-10T23:15:41.965806+0000","last_became_active":"2024-09-10T23:15:40.851809+0000","last_became_peered":"2024-09-10T23:15:40.851809+0000","last_unstale":"2024-09-10T23:15:41.965806+0000","last_undegraded":"2024-09-10T23:15:41.965806+0000","last_fullsized":"2024-09-10T23:15:41.965806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:02.124643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050798+0000","last_change":"2024-09-10T23:15:36.819353+0000","last_active":"2024-09-10T23:15:42.050798+0000","last_peered":"2024-09-10T23:15:42.050798+0000","last_clean":"2024-09-10T23:15:42.050798+0000","last_became_active":"2024-09-10T23:15:36.818733+0000","last_became_peered":"2024-09-10T23:15:36.818733+0000","last_unstale":"2024-09-10T23:15:42.050798+0000","last_undegraded":"2024-09-10T23:15:42.050798+0000","last_fullsized":"2024-09-10T23:15:42.050798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:12.540137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966319+0000","last_change":"2024-09-10T23:15:35.809473+0000","last_active":"2024-09-10T23:15:41.966319+0000","last_peered":"2024-09-10T23:15:41.966319+0000","last_clean":"2024-09-10T23:15:41.966319+0000","last_became_active":"2024-09-10T23:15:35.808925+0000","last_became_peered":"2024-09-10T23:15:35.808925+0000","last_unstale":"2024-09-10T23:15:41.966319+0000","last_undegraded":"2024-09-10T23:15:41.966319+0000","last_fullsized":"2024-09-10T23:15:41.966319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:18.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050944+0000","last_change":"2024-09-10T23:15:40.845501+0000","last_active":"2024-09-10T23:15:42.050944+0000","last_peered":"2024-09-10T23:15:42.050944+0000","last_clean":"2024-09-10T23:15:42.050944+0000","last_became_active":"2024-09-10T23:15:40.845002+0000","last_became_peered":"2024-09-10T23:15:40.845002+0000","last_unstale":"2024-09-10T23:15:42.050944+0000","last_undegraded":"2024-09-10T23:15:42.050944+0000","last_fullsized":"2024-09-10T23:15:42.050944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976880+0000","last_change":"2024-09-10T23:15:36.823879+0000","last_active":"2024-09-10T23:15:41.976880+0000","last_peered":"2024-09-10T23:15:41.976880+0000","last_clean":"2024-09-10T23:15:41.976880+0000","last_became_active":"2024-09-10T23:15:36.823569+0000","last_became_peered":"2024-09-10T23:15:36.823569+0000","last_unstale":"2024-09-10T23:15:41.976880+0000","last_undegraded":"2024-09-10T23:15:41.976880+0000","last_fullsized":"2024-09-10T23:15:41.976880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453728+0000","last_change":"2024-09-10T23:15:35.821328+0000","last_active":"2024-09-10T23:15:42.453728+0000","last_peered":"2024-09-10T23:15:42.453728+0000","last_clean":"2024-09-10T23:15:42.453728+0000","last_became_active":"2024-09-10T23:15:35.820992+0000","last_became_peered":"2024-09-10T23:15:35.820992+0000","last_unstale":"2024-09-10T23:15:42.453728+0000","last_undegraded":"2024-09-10T23:15:42.453728+0000","last_fullsized":"2024-09-10T23:15:42.453728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477653+0000","last_change":"2024-09-10T23:15:40.853378+0000","last_active":"2024-09-10T23:15:42.477653+0000","last_peered":"2024-09-10T23:15:42.477653+0000","last_clean":"2024-09-10T23:15:42.477653+0000","last_became_active":"2024-09-10T23:15:40.851797+0000","last_became_peered":"2024-09-10T23:15:40.851797+0000","last_unstale":"2024-09-10T23:15:42.477653+0000","last_undegraded":"2024-09-10T23:15:42.477653+0000","last_fullsized":"2024-09-10T23:15:42.477653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:35.499058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453617+0000","last_change":"2024-09-10T23:15:36.827207+0000","last_active":"2024-09-10T23:15:42.453617+0000","last_peered":"2024-09-10T23:15:42.453617+0000","last_clean":"2024-09-10T23:15:42.453617+0000","last_became_active":"2024-09-10T23:15:36.826929+0000","last_became_peered":"2024-09-10T23:15:36.826929+0000","last_unstale":"2024-09-10T23:15:42.453617+0000","last_undegraded":"2024-09-10T23:15:42.453617+0000","last_fullsized":"2024-09-10T23:15:42.453617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:57.600178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.867150+0000","last_change":"2024-09-10T23:15:35.817151+0000","last_active":"2024-09-10T23:15:41.867150+0000","last_peered":"2024-09-10T23:15:41.867150+0000","last_clean":"2024-09-10T23:15:41.867150+0000","last_became_active":"2024-09-10T23:15:35.816069+0000","last_became_peered":"2024-09-10T23:15:35.816069+0000","last_unstale":"2024-09-10T23:15:41.867150+0000","last_undegraded":"2024-09-10T23:15:41.867150+0000","last_fullsized":"2024-09-10T23:15:41.867150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477587+0000","last_change":"2024-09-10T23:15:40.919083+0000","last_active":"2024-09-10T23:15:42.477587+0000","last_peered":"2024-09-10T23:15:42.477587+0000","last_clean":"2024-09-10T23:15:42.477587+0000","last_became_active":"2024-09-10T23:15:40.917807+0000","last_became_peered":"2024-09-10T23:15:40.917807+0000","last_unstale":"2024-09-10T23:15:42.477587+0000","last_undegraded":"2024-09-10T23:15:42.477587+0000","last_fullsized":"2024-09-10T23:15:42.477587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:53.108885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976987+0000","last_change":"2024-09-10T23:15:40.919668+0000","last_active":"2024-09-10T23:15:41.976987+0000","last_peered":"2024-09-10T23:15:41.976987+0000","last_clean":"2024-09-10T23:15:41.976987+0000","last_became_active":"2024-09-10T23:15:40.919242+0000","last_became_peered":"2024-09-10T23:15:40.919242+0000","last_unstale":"2024-09-10T23:15:41.976987+0000","last_undegraded":"2024-09-10T23:15:41.976987+0000","last_fullsized":"2024-09-10T23:15:41.976987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.634743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965554+0000","last_change":"2024-09-10T23:15:36.811659+0000","last_active":"2024-09-10T23:15:41.965554+0000","last_peered":"2024-09-10T23:15:41.965554+0000","last_clean":"2024-09-10T23:15:41.965554+0000","last_became_active":"2024-09-10T23:15:36.811297+0000","last_became_peered":"2024-09-10T23:15:36.811297+0000","last_unstale":"2024-09-10T23:15:41.965554+0000","last_undegraded":"2024-09-10T23:15:41.965554+0000","last_fullsized":"2024-09-10T23:15:41.965554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:51.803249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453169+0000","last_change":"2024-09-10T23:15:35.807726+0000","last_active":"2024-09-10T23:15:42.453169+0000","last_peered":"2024-09-10T23:15:42.453169+0000","last_clean":"2024-09-10T23:15:42.453169+0000","last_became_active":"2024-09-10T23:15:35.807144+0000","last_became_peered":"2024-09-10T23:15:35.807144+0000","last_unstale":"2024-09-10T23:15:42.453169+0000","last_undegraded":"2024-09-10T23:15:42.453169+0000","last_fullsized":"2024-09-10T23:15:42.453169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866991+0000","last_change":"2024-09-10T23:15:40.855753+0000","last_active":"2024-09-10T23:15:41.866991+0000","last_peered":"2024-09-10T23:15:41.866991+0000","last_clean":"2024-09-10T23:15:41.866991+0000","last_became_active":"2024-09-10T23:15:40.855320+0000","last_became_peered":"2024-09-10T23:15:40.855320+0000","last_unstale":"2024-09-10T23:15:41.866991+0000","last_undegraded":"2024-09-10T23:15:41.866991+0000","last_fullsized":"2024-09-10T23:15:41.866991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:50.094208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477523+0000","last_change":"2024-09-10T23:15:36.816132+0000","last_active":"2024-09-10T23:15:42.477523+0000","last_peered":"2024-09-10T23:15:42.477523+0000","last_clean":"2024-09-10T23:15:42.477523+0000","last_became_active":"2024-09-10T23:15:36.815801+0000","last_became_peered":"2024-09-10T23:15:36.815801+0000","last_unstale":"2024-09-10T23:15:42.477523+0000","last_undegraded":"2024-09-10T23:15:42.477523+0000","last_fullsized":"2024-09-10T23:15:42.477523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:01.311893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477667+0000","last_change":"2024-09-10T23:15:35.824434+0000","last_active":"2024-09-10T23:15:42.477667+0000","last_peered":"2024-09-10T23:15:42.477667+0000","last_clean":"2024-09-10T23:15:42.477667+0000","last_became_active":"2024-09-10T23:15:35.823485+0000","last_became_peered":"2024-09-10T23:15:35.823485+0000","last_unstale":"2024-09-10T23:15:42.477667+0000","last_undegraded":"2024-09-10T23:15:42.477667+0000","last_fullsized":"2024-09-10T23:15:42.477667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:04.088733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866955+0000","last_change":"2024-09-10T23:15:35.818427+0000","last_active":"2024-09-10T23:15:41.866955+0000","last_peered":"2024-09-10T23:15:41.866955+0000","last_clean":"2024-09-10T23:15:41.866955+0000","last_became_active":"2024-09-10T23:15:35.818167+0000","last_became_peered":"2024-09-10T23:15:35.818167+0000","last_unstale":"2024-09-10T23:15:41.866955+0000","last_undegraded":"2024-09-10T23:15:41.866955+0000","last_fullsized":"2024-09-10T23:15:41.866955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976819+0000","last_change":"2024-09-10T23:15:36.822253+0000","last_active":"2024-09-10T23:15:41.976819+0000","last_peered":"2024-09-10T23:15:41.976819+0000","last_clean":"2024-09-10T23:15:41.976819+0000","last_became_active":"2024-09-10T23:15:36.821990+0000","last_became_peered":"2024-09-10T23:15:36.821990+0000","last_unstale":"2024-09-10T23:15:41.976819+0000","last_undegraded":"2024-09-10T23:15:41.976819+0000","last_fullsized":"2024-09-10T23:15:41.976819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862372+0000","last_change":"2024-09-10T23:15:40.842622+0000","last_active":"2024-09-10T23:15:41.862372+0000","last_peered":"2024-09-10T23:15:41.862372+0000","last_clean":"2024-09-10T23:15:41.862372+0000","last_became_active":"2024-09-10T23:15:40.842113+0000","last_became_peered":"2024-09-10T23:15:40.842113+0000","last_unstale":"2024-09-10T23:15:41.862372+0000","last_undegraded":"2024-09-10T23:15:41.862372+0000","last_fullsized":"2024-09-10T23:15:41.862372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:03.142144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477876+0000","last_change":"2024-09-10T23:15:35.823540+0000","last_active":"2024-09-10T23:15:42.477876+0000","last_peered":"2024-09-10T23:15:42.477876+0000","last_clean":"2024-09-10T23:15:42.477876+0000","last_became_active":"2024-09-10T23:15:35.823054+0000","last_became_peered":"2024-09-10T23:15:35.823054+0000","last_unstale":"2024-09-10T23:15:42.477876+0000","last_undegraded":"2024-09-10T23:15:42.477876+0000","last_fullsized":"2024-09-10T23:15:42.477876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:04.057636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050474+0000","last_change":"2024-09-10T23:15:36.812487+0000","last_active":"2024-09-10T23:15:42.050474+0000","last_peered":"2024-09-10T23:15:42.050474+0000","last_clean":"2024-09-10T23:15:42.050474+0000","last_became_active":"2024-09-10T23:15:36.812141+0000","last_became_peered":"2024-09-10T23:15:36.812141+0000","last_unstale":"2024-09-10T23:15:42.050474+0000","last_undegraded":"2024-09-10T23:15:42.050474+0000","last_fullsized":"2024-09-10T23:15:42.050474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:51.808916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478078+0000","last_change":"2024-09-10T23:15:40.847773+0000","last_active":"2024-09-10T23:15:42.478078+0000","last_peered":"2024-09-10T23:15:42.478078+0000","last_clean":"2024-09-10T23:15:42.478078+0000","last_became_active":"2024-09-10T23:15:40.847351+0000","last_became_peered":"2024-09-10T23:15:40.847351+0000","last_unstale":"2024-09-10T23:15:42.478078+0000","last_undegraded":"2024-09-10T23:15:42.478078+0000","last_fullsized":"2024-09-10T23:15:42.478078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:56.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866237+0000","last_change":"2024-09-10T23:15:36.817479+0000","last_active":"2024-09-10T23:15:41.866237+0000","last_peered":"2024-09-10T23:15:41.866237+0000","last_clean":"2024-09-10T23:15:41.866237+0000","last_became_active":"2024-09-10T23:15:36.816922+0000","last_became_peered":"2024-09-10T23:15:36.816922+0000","last_unstale":"2024-09-10T23:15:41.866237+0000","last_undegraded":"2024-09-10T23:15:41.866237+0000","last_fullsized":"2024-09-10T23:15:41.866237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.142950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.861972+0000","last_change":"2024-09-10T23:15:36.819587+0000","last_active":"2024-09-10T23:15:41.861972+0000","last_peered":"2024-09-10T23:15:41.861972+0000","last_clean":"2024-09-10T23:15:41.861972+0000","last_became_active":"2024-09-10T23:15:36.819330+0000","last_became_peered":"2024-09-10T23:15:36.819330+0000","last_unstale":"2024-09-10T23:15:41.861972+0000","last_undegraded":"2024-09-10T23:15:41.861972+0000","last_fullsized":"2024-09-10T23:15:41.861972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453293+0000","last_change":"2024-09-10T23:15:36.821061+0000","last_active":"2024-09-10T23:15:42.453293+0000","last_peered":"2024-09-10T23:15:42.453293+0000","last_clean":"2024-09-10T23:15:42.453293+0000","last_became_active":"2024-09-10T23:15:36.820728+0000","last_became_peered":"2024-09-10T23:15:36.820728+0000","last_unstale":"2024-09-10T23:15:42.453293+0000","last_undegraded":"2024-09-10T23:15:42.453293+0000","last_fullsized":"2024-09-10T23:15:42.453293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:09.763137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976723+0000","last_change":"2024-09-10T23:15:36.817451+0000","last_active":"2024-09-10T23:15:41.976723+0000","last_peered":"2024-09-10T23:15:41.976723+0000","last_clean":"2024-09-10T23:15:41.976723+0000","last_became_active":"2024-09-10T23:15:36.817180+0000","last_became_peered":"2024-09-10T23:15:36.817180+0000","last_unstale":"2024-09-10T23:15:41.976723+0000","last_undegraded":"2024-09-10T23:15:41.976723+0000","last_fullsized":"2024-09-10T23:15:41.976723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:42.144340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478095+0000","last_change":"2024-09-10T23:15:36.834283+0000","last_active":"2024-09-10T23:15:42.478095+0000","last_peered":"2024-09-10T23:15:42.478095+0000","last_clean":"2024-09-10T23:15:42.478095+0000","last_became_active":"2024-09-10T23:15:36.832423+0000","last_became_peered":"2024-09-10T23:15:36.832423+0000","last_unstale":"2024-09-10T23:15:42.478095+0000","last_undegraded":"2024-09-10T23:15:42.478095+0000","last_fullsized":"2024-09-10T23:15:42.478095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:33.744306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966222+0000","last_change":"2024-09-10T23:15:36.817174+0000","last_active":"2024-09-10T23:15:41.966222+0000","last_peered":"2024-09-10T23:15:41.966222+0000","last_clean":"2024-09-10T23:15:41.966222+0000","last_became_active":"2024-09-10T23:15:36.816873+0000","last_became_peered":"2024-09-10T23:15:36.816873+0000","last_unstale":"2024-09-10T23:15:41.966222+0000","last_undegraded":"2024-09-10T23:15:41.966222+0000","last_fullsized":"2024-09-10T23:15:41.966222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866980+0000","last_change":"2024-09-10T23:15:36.814417+0000","last_active":"2024-09-10T23:15:41.866980+0000","last_peered":"2024-09-10T23:15:41.866980+0000","last_clean":"2024-09-10T23:15:41.866980+0000","last_became_active":"2024-09-10T23:15:36.814142+0000","last_became_peered":"2024-09-10T23:15:36.814142+0000","last_unstale":"2024-09-10T23:15:41.866980+0000","last_undegraded":"2024-09-10T23:15:41.866980+0000","last_fullsized":"2024-09-10T23:15:41.866980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478307+0000","last_change":"2024-09-10T23:15:36.827366+0000","last_active":"2024-09-10T23:15:42.478307+0000","last_peered":"2024-09-10T23:15:42.478307+0000","last_clean":"2024-09-10T23:15:42.478307+0000","last_became_active":"2024-09-10T23:15:36.827030+0000","last_became_peered":"2024-09-10T23:15:36.827030+0000","last_unstale":"2024-09-10T23:15:42.478307+0000","last_undegraded":"2024-09-10T23:15:42.478307+0000","last_fullsized":"2024-09-10T23:15:42.478307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:01.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453085+0000","last_change":"2024-09-10T23:15:36.825171+0000","last_active":"2024-09-10T23:15:42.453085+0000","last_peered":"2024-09-10T23:15:42.453085+0000","last_clean":"2024-09-10T23:15:42.453085+0000","last_became_active":"2024-09-10T23:15:36.824807+0000","last_became_peered":"2024-09-10T23:15:36.824807+0000","last_unstale":"2024-09-10T23:15:42.453085+0000","last_undegraded":"2024-09-10T23:15:42.453085+0000","last_fullsized":"2024-09-10T23:15:42.453085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:12.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477668+0000","last_change":"2024-09-10T23:15:36.828041+0000","last_active":"2024-09-10T23:15:42.477668+0000","last_peered":"2024-09-10T23:15:42.477668+0000","last_clean":"2024-09-10T23:15:42.477668+0000","last_became_active":"2024-09-10T23:15:36.827715+0000","last_became_peered":"2024-09-10T23:15:36.827715+0000","last_unstale":"2024-09-10T23:15:42.477668+0000","last_undegraded":"2024-09-10T23:15:42.477668+0000","last_fullsized":"2024-09-10T23:15:42.477668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:23.592896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453188+0000","last_change":"2024-09-10T23:15:36.827045+0000","last_active":"2024-09-10T23:15:42.453188+0000","last_peered":"2024-09-10T23:15:42.453188+0000","last_clean":"2024-09-10T23:15:42.453188+0000","last_became_active":"2024-09-10T23:15:36.826738+0000","last_became_peered":"2024-09-10T23:15:36.826738+0000","last_unstale":"2024-09-10T23:15:42.453188+0000","last_undegraded":"2024-09-10T23:15:42.453188+0000","last_fullsized":"2024-09-10T23:15:42.453188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:16.055380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976502+0000","last_change":"2024-09-10T23:15:36.826859+0000","last_active":"2024-09-10T23:15:41.976502+0000","last_peered":"2024-09-10T23:15:41.976502+0000","last_clean":"2024-09-10T23:15:41.976502+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:41.976502+0000","last_undegraded":"2024-09-10T23:15:41.976502+0000","last_fullsized":"2024-09-10T23:15:41.976502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.142950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866951+0000","last_change":"2024-09-10T23:15:36.840021+0000","last_active":"2024-09-10T23:15:41.866951+0000","last_peered":"2024-09-10T23:15:41.866951+0000","last_clean":"2024-09-10T23:15:41.866951+0000","last_became_active":"2024-09-10T23:15:36.839028+0000","last_became_peered":"2024-09-10T23:15:36.839028+0000","last_unstale":"2024-09-10T23:15:41.866951+0000","last_undegraded":"2024-09-10T23:15:41.866951+0000","last_fullsized":"2024-09-10T23:15:41.866951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:25.766975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083601+0000","last_change":"2024-09-10T23:15:36.817847+0000","last_active":"2024-09-10T23:15:42.083601+0000","last_peered":"2024-09-10T23:15:42.083601+0000","last_clean":"2024-09-10T23:15:42.083601+0000","last_became_active":"2024-09-10T23:15:36.817492+0000","last_became_peered":"2024-09-10T23:15:36.817492+0000","last_unstale":"2024-09-10T23:15:42.083601+0000","last_undegraded":"2024-09-10T23:15:42.083601+0000","last_fullsized":"2024-09-10T23:15:42.083601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:39.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862623+0000","last_change":"2024-09-10T23:15:36.818420+0000","last_active":"2024-09-10T23:15:41.862623+0000","last_peered":"2024-09-10T23:15:41.862623+0000","last_clean":"2024-09-10T23:15:41.862623+0000","last_became_active":"2024-09-10T23:15:36.818130+0000","last_became_peered":"2024-09-10T23:15:36.818130+0000","last_unstale":"2024-09-10T23:15:41.862623+0000","last_undegraded":"2024-09-10T23:15:41.862623+0000","last_fullsized":"2024-09-10T23:15:41.862623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:12.540137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453936+0000","last_change":"2024-09-10T23:15:36.823439+0000","last_active":"2024-09-10T23:15:42.453936+0000","last_peered":"2024-09-10T23:15:42.453936+0000","last_clean":"2024-09-10T23:15:42.453936+0000","last_became_active":"2024-09-10T23:15:36.823181+0000","last_became_peered":"2024-09-10T23:15:36.823181+0000","last_unstale":"2024-09-10T23:15:42.453936+0000","last_undegraded":"2024-09-10T23:15:42.453936+0000","last_fullsized":"2024-09-10T23:15:42.453936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:58.331888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.452952+0000","last_change":"2024-09-10T23:15:36.816826+0000","last_active":"2024-09-10T23:15:42.452952+0000","last_peered":"2024-09-10T23:15:42.452952+0000","last_clean":"2024-09-10T23:15:42.452952+0000","last_became_active":"2024-09-10T23:15:36.816557+0000","last_became_peered":"2024-09-10T23:15:36.816557+0000","last_unstale":"2024-09-10T23:15:42.452952+0000","last_undegraded":"2024-09-10T23:15:42.452952+0000","last_fullsized":"2024-09-10T23:15:42.452952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:58.172702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965639+0000","last_change":"2024-09-10T23:15:36.815890+0000","last_active":"2024-09-10T23:15:41.965639+0000","last_peered":"2024-09-10T23:15:41.965639+0000","last_clean":"2024-09-10T23:15:41.965639+0000","last_became_active":"2024-09-10T23:15:36.815610+0000","last_became_peered":"2024-09-10T23:15:36.815610+0000","last_unstale":"2024-09-10T23:15:41.965639+0000","last_undegraded":"2024-09-10T23:15:41.965639+0000","last_fullsized":"2024-09-10T23:15:41.965639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976461+0000","last_change":"2024-09-10T23:15:36.809792+0000","last_active":"2024-09-10T23:15:41.976461+0000","last_peered":"2024-09-10T23:15:41.976461+0000","last_clean":"2024-09-10T23:15:41.976461+0000","last_became_active":"2024-09-10T23:15:36.809448+0000","last_became_peered":"2024-09-10T23:15:36.809448+0000","last_unstale":"2024-09-10T23:15:41.976461+0000","last_undegraded":"2024-09-10T23:15:41.976461+0000","last_fullsized":"2024-09-10T23:15:41.976461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477756+0000","last_change":"2024-09-10T23:15:36.817574+0000","last_active":"2024-09-10T23:15:42.477756+0000","last_peered":"2024-09-10T23:15:42.477756+0000","last_clean":"2024-09-10T23:15:42.477756+0000","last_became_active":"2024-09-10T23:15:36.817319+0000","last_became_peered":"2024-09-10T23:15:36.817319+0000","last_unstale":"2024-09-10T23:15:42.477756+0000","last_undegraded":"2024-09-10T23:15:42.477756+0000","last_fullsized":"2024-09-10T23:15:42.477756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:13.250839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050667+0000","last_change":"2024-09-10T23:15:36.819031+0000","last_active":"2024-09-10T23:15:42.050667+0000","last_peered":"2024-09-10T23:15:42.050667+0000","last_clean":"2024-09-10T23:15:42.050667+0000","last_became_active":"2024-09-10T23:15:36.818398+0000","last_became_peered":"2024-09-10T23:15:36.818398+0000","last_unstale":"2024-09-10T23:15:42.050667+0000","last_undegraded":"2024-09-10T23:15:42.050667+0000","last_fullsized":"2024-09-10T23:15:42.050667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866752+0000","last_change":"2024-09-10T23:15:36.838074+0000","last_active":"2024-09-10T23:15:41.866752+0000","last_peered":"2024-09-10T23:15:41.866752+0000","last_clean":"2024-09-10T23:15:41.866752+0000","last_became_active":"2024-09-10T23:15:36.837841+0000","last_became_peered":"2024-09-10T23:15:36.837841+0000","last_unstale":"2024-09-10T23:15:41.866752+0000","last_undegraded":"2024-09-10T23:15:41.866752+0000","last_fullsized":"2024-09-10T23:15:41.866752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866888+0000","last_change":"2024-09-10T23:15:36.837828+0000","last_active":"2024-09-10T23:15:41.866888+0000","last_peered":"2024-09-10T23:15:41.866888+0000","last_clean":"2024-09-10T23:15:41.866888+0000","last_became_active":"2024-09-10T23:15:36.837356+0000","last_became_peered":"2024-09-10T23:15:36.837356+0000","last_unstale":"2024-09-10T23:15:41.866888+0000","last_undegraded":"2024-09-10T23:15:41.866888+0000","last_fullsized":"2024-09-10T23:15:41.866888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083795+0000","last_change":"2024-09-10T23:15:36.833388+0000","last_active":"2024-09-10T23:15:42.083795+0000","last_peered":"2024-09-10T23:15:42.083795+0000","last_clean":"2024-09-10T23:15:42.083795+0000","last_became_active":"2024-09-10T23:15:36.832978+0000","last_became_peered":"2024-09-10T23:15:36.832978+0000","last_unstale":"2024-09-10T23:15:42.083795+0000","last_undegraded":"2024-09-10T23:15:42.083795+0000","last_fullsized":"2024-09-10T23:15:42.083795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:46.059643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477408+0000","last_change":"2024-09-10T23:15:36.824751+0000","last_active":"2024-09-10T23:15:42.477408+0000","last_peered":"2024-09-10T23:15:42.477408+0000","last_clean":"2024-09-10T23:15:42.477408+0000","last_became_active":"2024-09-10T23:15:36.824453+0000","last_became_peered":"2024-09-10T23:15:36.824453+0000","last_unstale":"2024-09-10T23:15:42.477408+0000","last_undegraded":"2024-09-10T23:15:42.477408+0000","last_fullsized":"2024-09-10T23:15:42.477408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:15.565815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083075+0000","last_change":"2024-09-10T23:15:36.825819+0000","last_active":"2024-09-10T23:15:42.083075+0000","last_peered":"2024-09-10T23:15:42.083075+0000","last_clean":"2024-09-10T23:15:42.083075+0000","last_became_active":"2024-09-10T23:15:36.825572+0000","last_became_peered":"2024-09-10T23:15:36.825572+0000","last_unstale":"2024-09-10T23:15:42.083075+0000","last_undegraded":"2024-09-10T23:15:42.083075+0000","last_fullsized":"2024-09-10T23:15:42.083075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:12.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453098+0000","last_change":"2024-09-10T23:15:36.821090+0000","last_active":"2024-09-10T23:15:42.453098+0000","last_peered":"2024-09-10T23:15:42.453098+0000","last_clean":"2024-09-10T23:15:42.453098+0000","last_became_active":"2024-09-10T23:15:36.820786+0000","last_became_peered":"2024-09-10T23:15:36.820786+0000","last_unstale":"2024-09-10T23:15:42.453098+0000","last_undegraded":"2024-09-10T23:15:42.453098+0000","last_fullsized":"2024-09-10T23:15:42.453098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083221+0000","last_change":"2024-09-10T23:15:36.826772+0000","last_active":"2024-09-10T23:15:42.083221+0000","last_peered":"2024-09-10T23:15:42.083221+0000","last_clean":"2024-09-10T23:15:42.083221+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:42.083221+0000","last_undegraded":"2024-09-10T23:15:42.083221+0000","last_fullsized":"2024-09-10T23:15:42.083221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:57.600178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453408+0000","last_change":"2024-09-10T23:15:36.821049+0000","last_active":"2024-09-10T23:15:42.453408+0000","last_peered":"2024-09-10T23:15:42.453408+0000","last_clean":"2024-09-10T23:15:42.453408+0000","last_became_active":"2024-09-10T23:15:36.820392+0000","last_became_peered":"2024-09-10T23:15:36.820392+0000","last_unstale":"2024-09-10T23:15:42.453408+0000","last_undegraded":"2024-09-10T23:15:42.453408+0000","last_fullsized":"2024-09-10T23:15:42.453408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:15.850959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976642+0000","last_change":"2024-09-10T23:15:36.813236+0000","last_active":"2024-09-10T23:15:41.976642+0000","last_peered":"2024-09-10T23:15:41.976642+0000","last_clean":"2024-09-10T23:15:41.976642+0000","last_became_active":"2024-09-10T23:15:36.809383+0000","last_became_peered":"2024-09-10T23:15:36.809383+0000","last_unstale":"2024-09-10T23:15:41.976642+0000","last_undegraded":"2024-09-10T23:15:41.976642+0000","last_fullsized":"2024-09-10T23:15:41.976642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966446+0000","last_change":"2024-09-10T23:15:36.811515+0000","last_active":"2024-09-10T23:15:41.966446+0000","last_peered":"2024-09-10T23:15:41.966446+0000","last_clean":"2024-09-10T23:15:41.966446+0000","last_became_active":"2024-09-10T23:15:36.811215+0000","last_became_peered":"2024-09-10T23:15:36.811215+0000","last_unstale":"2024-09-10T23:15:41.966446+0000","last_undegraded":"2024-09-10T23:15:41.966446+0000","last_fullsized":"2024-09-10T23:15:41.966446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083737+0000","last_change":"2024-09-10T23:15:36.848698+0000","last_active":"2024-09-10T23:15:42.083737+0000","last_peered":"2024-09-10T23:15:42.083737+0000","last_clean":"2024-09-10T23:15:42.083737+0000","last_became_active":"2024-09-10T23:15:36.848106+0000","last_became_peered":"2024-09-10T23:15:36.848106+0000","last_unstale":"2024-09-10T23:15:42.083737+0000","last_undegraded":"2024-09-10T23:15:42.083737+0000","last_fullsized":"2024-09-10T23:15:42.083737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:15.850959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":110367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":110403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":110277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":110437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":888832,"data_stored":701283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:15:58.911 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:15:58.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T23:15:58.912 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T23:15:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 -- 172.21.15.17:0/2505133568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141e80 msgr2=0x7f80000728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 --2- 172.21.15.17:0/2505133568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141e80 0x7f80000728a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009c80 tx=0x7f7ff801f5a0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 -- 172.21.15.17:0/2505133568 shutdown_connections 2024-09-10T23:15:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 --2- 172.21.15.17:0/2505133568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141e80 0x7f80000728a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 --2- 172.21.15.17:0/2505133568 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f80001416c0 0x7f80000ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 -- 172.21.15.17:0/2505133568 >> 172.21.15.17:0/2505133568 conn(0x7f80000b1730 msgr2=0x7f80000b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 -- 172.21.15.17:0/2505133568 shutdown_connections 2024-09-10T23:15:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 -- 172.21.15.17:0/2505133568 wait complete. 2024-09-10T23:15:59.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 Processor -- start 2024-09-10T23:15:59.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.091+0000 7f8004c00640 1 -- start start 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f8004c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80001416c0 0x7f8000151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f8004c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141aa0 0x7f800013f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f8004c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8000141e80 0x7f800013fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f8004c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8000073280 con 0x7f8000141aa0 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f8004c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8000073100 con 0x7f80001416c0 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f8004c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8000073400 con 0x7f8000141e80 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141aa0 0x7f800013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141aa0 0x7f800013f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33878/0 (socket says 172.21.15.17:33878) 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffd400640 1 -- 172.21.15.17:0/1027731207 learned_addr learned my addr 172.21.15.17:0/1027731207 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffe800640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8000141e80 0x7f800013fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffde00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80001416c0 0x7f8000151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffd400640 1 -- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8000141e80 msgr2=0x7f800013fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffd400640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8000141e80 0x7f800013fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffd400640 1 -- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80001416c0 msgr2=0x7f8000151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffd400640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80001416c0 0x7f8000151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffd400640 1 -- 172.21.15.17:0/1027731207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f800006e790 con 0x7f8000141aa0 2024-09-10T23:15:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffe800640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8000141e80 0x7f800013fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:59.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffde00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80001416c0 0x7f8000151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ffd400640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141aa0 0x7f800013f890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00c400 tx=0x7f7fec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ff6000640 1 -- 172.21.15.17:0/1027731207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec017070 con 0x7f8000141aa0 2024-09-10T23:15:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ff6000640 1 -- 172.21.15.17:0/1027731207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fec0053e0 con 0x7f8000141aa0 2024-09-10T23:15:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f7ff6000640 1 -- 172.21.15.17:0/1027731207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec003860 con 0x7f8000141aa0 2024-09-10T23:15:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f800006ea70 con 0x7f8000141aa0 2024-09-10T23:15:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f800006f030 con 0x7f8000141aa0 2024-09-10T23:15:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.095+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8000073990 con 0x7f8000141aa0 2024-09-10T23:15:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.099+0000 7f7ff6000640 1 -- 172.21.15.17:0/1027731207 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7fec003a00 con 0x7f8000141aa0 2024-09-10T23:15:59.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.099+0000 7f7ff6000640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fe00725e0 0x7f7fe0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.099+0000 7f7ff6000640 1 -- 172.21.15.17:0/1027731207 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7fec092d30 con 0x7f8000141aa0 2024-09-10T23:15:59.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.099+0000 7f7ffde00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fe00725e0 0x7f7fe0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.099+0000 7f7ffde00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fe00725e0 0x7f7fe0074aa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0005fd0 tx=0x7f7ff0005e80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.103+0000 7f7ff6000640 1 -- 172.21.15.17:0/1027731207 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7fec001130 con 0x7f8000141aa0 2024-09-10T23:15:59.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.275+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f80000745b0 con 0x7f8000141aa0 2024-09-10T23:15:59.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.275+0000 7f7ff6000640 1 -- 172.21.15.17:0/1027731207 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f7fec05e030 con 0x7f8000141aa0 2024-09-10T23:15:59.280 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:59.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fe00725e0 msgr2=0x7f7fe0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fe00725e0 0x7f7fe0074aa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0005fd0 tx=0x7f7ff0005e80 comp rx=0 tx=0).stop 2024-09-10T23:15:59.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141aa0 msgr2=0x7f800013f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141aa0 0x7f800013f890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00c400 tx=0x7f7fec00c8c0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 shutdown_connections 2024-09-10T23:15:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fe00725e0 0x7f7fe0074aa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8000141e80 0x7f800013fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8000141aa0 0x7f800013f890 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 --2- 172.21.15.17:0/1027731207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80001416c0 0x7f8000151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 >> 172.21.15.17:0/1027731207 conn(0x7f80000b1730 msgr2=0x7f80000cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 shutdown_connections 2024-09-10T23:15:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.279+0000 7f8004c00640 1 -- 172.21.15.17:0/1027731207 wait complete. 2024-09-10T23:15:59.301 INFO:teuthology.orchestra.run.smithi017.stdout:[{"version":27,"timestamp":"2024-09-10T23:15:24.709484+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"3646.468846"}]}] 2024-09-10T23:15:59.301 INFO:tasks.ceph_manager:config epoch is 27 2024-09-10T23:15:59.301 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T23:15:59.302 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T23:15:59.302 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T23:15:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.447+0000 7fe9f9400640 1 -- 172.21.15.17:0/2438718800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f415bc70 msgr2=0x7fe9f40cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.447+0000 7fe9f9400640 1 --2- 172.21.15.17:0/2438718800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f415bc70 0x7fe9f40cfa20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009900 tx=0x7fe9e401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 -- 172.21.15.17:0/2438718800 shutdown_connections 2024-09-10T23:15:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 --2- 172.21.15.17:0/2438718800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f415bc70 0x7fe9f40cfa20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 -- 172.21.15.17:0/2438718800 >> 172.21.15.17:0/2438718800 conn(0x7fe9f409a9f0 msgr2=0x7fe9f409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 -- 172.21.15.17:0/2438718800 shutdown_connections 2024-09-10T23:15:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 -- 172.21.15.17:0/2438718800 wait complete. 2024-09-10T23:15:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 Processor -- start 2024-09-10T23:15:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 -- start start 2024-09-10T23:15:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f40cc570 0x7fe9f4159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9f40d20a0 0x7fe9f4158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9f415bc70 0x7fe9f40af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4169ef0 con 0x7fe9f40cc570 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4169d70 con 0x7fe9f40d20a0 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f9400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f416a070 con 0x7fe9f415bc70 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f40cc570 0x7fe9f4159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f40cc570 0x7fe9f4159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33888/0 (socket says 172.21.15.17:33888) 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f3e00640 1 -- 172.21.15.17:0/607748537 learned_addr learned my addr 172.21.15.17:0/607748537 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f8a00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9f415bc70 0x7fe9f40af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9ebe00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9f40d20a0 0x7fe9f4158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f3e00640 1 -- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9f415bc70 msgr2=0x7fe9f40af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f3e00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9f415bc70 0x7fe9f40af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f3e00640 1 -- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9f40d20a0 msgr2=0x7fe9f4158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f3e00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9f40d20a0 0x7fe9f4158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f3e00640 1 -- 172.21.15.17:0/607748537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f406de00 con 0x7fe9f40cc570 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f8a00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9f415bc70 0x7fe9f40af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9ebe00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9f40d20a0 0x7fe9f4158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f3e00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f40cc570 0x7fe9f4159bb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009850 tx=0x7fe9e40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.451+0000 7fe9f0c00640 1 -- 172.21.15.17:0/607748537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e40bb070 con 0x7fe9f40cc570 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.455+0000 7fe9f0c00640 1 -- 172.21.15.17:0/607748537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9e4003600 con 0x7fe9f40cc570 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.455+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f415a400 con 0x7fe9f40cc570 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.455+0000 7fe9f0c00640 1 -- 172.21.15.17:0/607748537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e40b2040 con 0x7fe9f40cc570 2024-09-10T23:15:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.455+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f415a0f0 con 0x7fe9f40cc570 2024-09-10T23:15:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.455+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f40cfa20 con 0x7fe9f40cc570 2024-09-10T23:15:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.455+0000 7fe9f0c00640 1 -- 172.21.15.17:0/607748537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe9e4003a10 con 0x7fe9f40cc570 2024-09-10T23:15:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.455+0000 7fe9f0c00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9d00725e0 0x7fe9d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.455+0000 7fe9f0c00640 1 -- 172.21.15.17:0/607748537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe9e412d1d0 con 0x7fe9f40cc570 2024-09-10T23:15:59.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.455+0000 7fe9ebe00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9d00725e0 0x7fe9d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.459+0000 7fe9ebe00640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9d00725e0 0x7fe9d0074aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40c84c0 tx=0x7fe9dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.459+0000 7fe9f0c00640 1 -- 172.21.15.17:0/607748537 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe9e40164d0 con 0x7fe9f40cc570 2024-09-10T23:15:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.679+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe9f40d0750 con 0x7fe9f40cc570 2024-09-10T23:15:59.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f0c00640 1 -- 172.21.15.17:0/607748537 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+184981 (secure 0 0 0) 0x7fe9e40f86c0 con 0x7fe9f40cc570 2024-09-10T23:15:59.686 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:15:59.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9d00725e0 msgr2=0x7fe9d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9d00725e0 0x7fe9d0074aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40c84c0 tx=0x7fe9dc009040 comp rx=0 tx=0).stop 2024-09-10T23:15:59.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f40cc570 msgr2=0x7fe9f4159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f40cc570 0x7fe9f4159bb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009850 tx=0x7fe9e40040c0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 shutdown_connections 2024-09-10T23:15:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9d00725e0 0x7fe9d0074aa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9f415bc70 0x7fe9f40af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9f40d20a0 0x7fe9f4158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 --2- 172.21.15.17:0/607748537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9f40cc570 0x7fe9f4159bb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 >> 172.21.15.17:0/607748537 conn(0x7fe9f409a9f0 msgr2=0x7fe9f40c72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 shutdown_connections 2024-09-10T23:15:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.683+0000 7fe9f9400640 1 -- 172.21.15.17:0/607748537 wait complete. 2024-09-10T23:15:59.708 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2773663503},{"type":"v1","addr":"172.21.15.77:6801","nonce":2773663503}]},"active_addr":"172.21.15.77:6801/2773663503","active_change":"2024-09-10T23:15:16.275866+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4125,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":987774933}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3179162698}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":589073308}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":37977596}]}]} 2024-09-10T23:15:59.713 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T23:15:59.713 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T23:15:59.713 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:15:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 -- 172.21.15.17:0/3845413941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c415adb0 msgr2=0x7f38c415e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3845413941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c415adb0 0x7f38c415e810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f38c4071b50 tx=0x7f38b401c890 comp rx=0 tx=0).stop 2024-09-10T23:15:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 -- 172.21.15.17:0/3845413941 shutdown_connections 2024-09-10T23:15:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3845413941 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c40cf9e0 0x7f38c40705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3845413941 >> v2:172.21.15.77:3300/0 conn(0x7f38c415ed50 0x7f38c40cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3845413941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c415adb0 0x7f38c415e810 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 -- 172.21.15.17:0/3845413941 >> 172.21.15.17:0/3845413941 conn(0x7f38c40d0c40 msgr2=0x7f38c40d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:15:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 -- 172.21.15.17:0/3845413941 shutdown_connections 2024-09-10T23:15:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 -- 172.21.15.17:0/3845413941 wait complete. 2024-09-10T23:15:59.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 Processor -- start 2024-09-10T23:15:59.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 -- start start 2024-09-10T23:15:59.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c40cf9e0 0x7f38c40a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c415adb0 0x7f38c41596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c415ed50 0x7f38c415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f38c40cb870 con 0x7f38c40cf9e0 2024-09-10T23:15:59.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38c40cb6f0 con 0x7f38c415adb0 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c8a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f38c40cb9f0 con 0x7f38c415ed50 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c40cf9e0 0x7f38c40a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c40cf9e0 0x7f38c40a9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33902/0 (socket says 172.21.15.17:33902) 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c1e00640 1 -- 172.21.15.17:0/3330573087 learned_addr learned my addr 172.21.15.17:0/3330573087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c2800640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c415ed50 0x7f38c415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38bbe00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c415adb0 0x7f38c41596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c1e00640 1 -- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c415ed50 msgr2=0x7f38c415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c1e00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c415ed50 0x7f38c415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c1e00640 1 -- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c415adb0 msgr2=0x7f38c41596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c1e00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c415adb0 0x7f38c41596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38c1e00640 1 -- 172.21.15.17:0/3330573087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c40b4610 con 0x7f38c40cf9e0 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.859+0000 7f38bbe00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c415adb0 0x7f38c41596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38c1e00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c40cf9e0 0x7f38c40a9460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38b40b0040 tx=0x7f38b40a56a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38ba000640 1 -- 172.21.15.17:0/3330573087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40b2040 con 0x7f38c40cf9e0 2024-09-10T23:15:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38ba000640 1 -- 172.21.15.17:0/3330573087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38b40043a0 con 0x7f38c40cf9e0 2024-09-10T23:15:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38ba000640 1 -- 172.21.15.17:0/3330573087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4005290 con 0x7f38c40cf9e0 2024-09-10T23:15:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c40b48f0 con 0x7f38c40cf9e0 2024-09-10T23:15:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c4159be0 con 0x7f38c40cf9e0 2024-09-10T23:15:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c40b4b30 con 0x7f38c40cf9e0 2024-09-10T23:15:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38ba000640 1 -- 172.21.15.17:0/3330573087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f38c4073f40 con 0x7f38c40cf9e0 2024-09-10T23:15:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38ba000640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38a00725e0 0x7f38a0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:15:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38ba000640 1 -- 172.21.15.17:0/3330573087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f38b412cd60 con 0x7f38c40cf9e0 2024-09-10T23:15:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.863+0000 7f38bbe00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38a00725e0 0x7f38a0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:15:59.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.867+0000 7f38bbe00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38a00725e0 0x7f38a0074aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38ac005fd0 tx=0x7f38ac005cd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:15:59.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:15:59.867+0000 7f38ba000640 1 -- 172.21.15.17:0/3330573087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f38c40b4b30 con 0x7f38c40cf9e0 2024-09-10T23:16:00.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.043+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38c40cbfa0 con 0x7f38c40cf9e0 2024-09-10T23:16:00.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.043+0000 7f38ba000640 1 -- 172.21.15.17:0/3330573087 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18538 (secure 0 0 0) 0x7f38b40164b0 con 0x7f38c40cf9e0 2024-09-10T23:16:00.048 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:00.048 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:41.258986+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38a00725e0 msgr2=0x7f38a0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38a00725e0 0x7f38a0074aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f38ac005fd0 tx=0x7f38ac005cd0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c40cf9e0 msgr2=0x7f38c40a9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c40cf9e0 0x7f38c40a9460 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38b40b0040 tx=0x7f38b40a56a0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 shutdown_connections 2024-09-10T23:16:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38a00725e0 0x7f38a0074aa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c415ed50 0x7f38c415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c415adb0 0x7f38c41596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 --2- 172.21.15.17:0/3330573087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38c40cf9e0 0x7f38c40a9460 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 >> 172.21.15.17:0/3330573087 conn(0x7f38c40d0c40 msgr2=0x7f38c40c59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 shutdown_connections 2024-09-10T23:16:00.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.047+0000 7f38c8a00640 1 -- 172.21.15.17:0/3330573087 wait complete. 2024-09-10T23:16:00.070 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T23:16:00.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:00.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 -- 172.21.15.17:0/954999339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0d0630 msgr2=0x7fca1c0b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 --2- 172.21.15.17:0/954999339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0d0630 0x7fca1c0b37f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca14009bc0 tx=0x7fca1401cb10 comp rx=0 tx=0).stop 2024-09-10T23:16:00.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 -- 172.21.15.17:0/954999339 shutdown_connections 2024-09-10T23:16:00.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 --2- 172.21.15.17:0/954999339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0d0630 0x7fca1c0b37f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 -- 172.21.15.17:0/954999339 >> 172.21.15.17:0/954999339 conn(0x7fca1c06cfc0 msgr2=0x7fca1c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 -- 172.21.15.17:0/954999339 shutdown_connections 2024-09-10T23:16:00.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 -- 172.21.15.17:0/954999339 wait complete. 2024-09-10T23:16:00.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 Processor -- start 2024-09-10T23:16:00.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 -- start start 2024-09-10T23:16:00.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca1c0b48f0 0x7fca1c133680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0cf4f0 0x7fca1c14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca1c0d0630 0x7fca1c072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c169c90 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c169b10 con 0x7fca1c0b48f0 2024-09-10T23:16:00.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca22800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c169e10 con 0x7fca1c0d0630 2024-09-10T23:16:00.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca12a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0cf4f0 0x7fca1c14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca12a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0cf4f0 0x7fca1c14ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33932/0 (socket says 172.21.15.17:33932) 2024-09-10T23:16:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca12a00640 1 -- 172.21.15.17:0/4143527229 learned_addr learned my addr 172.21.15.17:0/4143527229 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca1be00640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca1c0d0630 0x7fca1c072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca1b400640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca1c0b48f0 0x7fca1c133680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca12a00640 1 -- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca1c0d0630 msgr2=0x7fca1c072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca12a00640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca1c0d0630 0x7fca1c072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca12a00640 1 -- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca1c0b48f0 msgr2=0x7fca1c133680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca12a00640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca1c0b48f0 0x7fca1c133680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.215+0000 7fca12a00640 1 -- 172.21.15.17:0/4143527229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c133cb0 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.219+0000 7fca12a00640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0cf4f0 0x7fca1c14ac20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fca0400c4e0 tx=0x7fca0400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.219+0000 7fca13e00640 1 -- 172.21.15.17:0/4143527229 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca040052d0 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.219+0000 7fca13e00640 1 -- 172.21.15.17:0/4143527229 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca04005470 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.219+0000 7fca13e00640 1 -- 172.21.15.17:0/4143527229 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04012890 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.219+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1c134240 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.219+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1c1316d0 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.219+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1c0b37f0 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.219+0000 7fca13e00640 1 -- 172.21.15.17:0/4143527229 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fca04003600 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.219+0000 7fca13e00640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9f80725e0 0x7fc9f8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.223+0000 7fca13e00640 1 -- 172.21.15.17:0/4143527229 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fca04092f70 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.223+0000 7fca1b400640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9f80725e0 0x7fc9f8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.223+0000 7fca1b400640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9f80725e0 0x7fc9f8074aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca0c000f70 tx=0x7fca0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.227+0000 7fca13e00640 1 -- 172.21.15.17:0/4143527229 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fca0405dcb0 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.399+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca1c133f60 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.399+0000 7fca13e00640 1 -- 172.21.15.17:0/4143527229 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18538 (secure 0 0 0) 0x7fca040626e0 con 0x7fca1c0cf4f0 2024-09-10T23:16:00.404 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:00.404 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:41.258986+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9f80725e0 msgr2=0x7fc9f8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9f80725e0 0x7fc9f8074aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca0c000f70 tx=0x7fca0c009040 comp rx=0 tx=0).stop 2024-09-10T23:16:00.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0cf4f0 msgr2=0x7fca1c14ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0cf4f0 0x7fca1c14ac20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fca0400c4e0 tx=0x7fca0400c9a0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 shutdown_connections 2024-09-10T23:16:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9f80725e0 0x7fc9f8074aa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca1c0d0630 0x7fca1c072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1c0cf4f0 0x7fca1c14ac20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 --2- 172.21.15.17:0/4143527229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca1c0b48f0 0x7fca1c133680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 >> 172.21.15.17:0/4143527229 conn(0x7fca1c06cfc0 msgr2=0x7fca1c15ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 shutdown_connections 2024-09-10T23:16:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.403+0000 7fca22800640 1 -- 172.21.15.17:0/4143527229 wait complete. 2024-09-10T23:16:00.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T23:16:00.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T23:16:00.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T23:16:00.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T23:16:00.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T23:16:00.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T23:16:00.429 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T23:16:00.429 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T23:16:00.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fe934200640 1 -- 172.21.15.17:0/2739931117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe92c0b3de0 msgr2=0x7fe92c06eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7f4518a00640 1 -- 172.21.15.17:0/1347858977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450c0e08e0 msgr2=0x7f450c03a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7f4518a00640 1 --2- 172.21.15.17:0/1347858977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450c0e08e0 0x7f450c03a4b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4504005fd0 tx=0x7f450401c760 comp rx=0 tx=0).stop 2024-09-10T23:16:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fe934200640 1 --2- 172.21.15.17:0/2739931117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe92c0b3de0 0x7fe92c06eca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe92c06ea90 tx=0x7fe92401cb70 comp rx=0 tx=0).stop 2024-09-10T23:16:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7f4518a00640 1 -- 172.21.15.17:0/1347858977 shutdown_connections 2024-09-10T23:16:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7f4518a00640 1 --2- 172.21.15.17:0/1347858977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450c0e5020 0x7f450c03a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7f4518a00640 1 --2- 172.21.15.17:0/1347858977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450c0e08e0 0x7f450c03a4b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7f4518a00640 1 -- 172.21.15.17:0/1347858977 >> 172.21.15.17:0/1347858977 conn(0x7f450c01e8b0 msgr2=0x7f450c055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fe934200640 1 -- 172.21.15.17:0/2739931117 shutdown_connections 2024-09-10T23:16:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fe934200640 1 --2- 172.21.15.17:0/2739931117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe92c0b3de0 0x7fe92c06eca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fe934200640 1 --2- 172.21.15.17:0/2739931117 >> v2:172.21.15.77:3300/0 conn(0x7fe92c0b3310 0x7fe92c162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fe934200640 1 -- 172.21.15.17:0/2739931117 >> 172.21.15.17:0/2739931117 conn(0x7fe92c0cf9c0 msgr2=0x7fe92c0cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fe934200640 1 -- 172.21.15.17:0/2739931117 shutdown_connections 2024-09-10T23:16:00.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fe934200640 1 -- 172.21.15.17:0/2739931117 wait complete. 2024-09-10T23:16:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7f4518a00640 1 -- 172.21.15.17:0/1347858977 shutdown_connections 2024-09-10T23:16:00.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7f4518a00640 1 -- 172.21.15.17:0/1347858977 wait complete. 2024-09-10T23:16:00.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fef41400640 1 -- 172.21.15.17:0/2575416463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef20005420 msgr2=0x7fef2000dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fef41400640 1 --2- 172.21.15.17:0/2575416463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef20005420 0x7fef2000dc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef2800c7c0 tx=0x7fef2801c780 comp rx=0 tx=0).stop 2024-09-10T23:16:00.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fef41400640 1 -- 172.21.15.17:0/2575416463 shutdown_connections 2024-09-10T23:16:00.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fef41400640 1 --2- 172.21.15.17:0/2575416463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef20005420 0x7fef2000dc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.687+0000 7fef41400640 1 -- 172.21.15.17:0/2575416463 >> 172.21.15.17:0/2575416463 conn(0x7fef3c0cfa00 msgr2=0x7fef3c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fef41400640 1 -- 172.21.15.17:0/2575416463 shutdown_connections 2024-09-10T23:16:00.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fef41400640 1 -- 172.21.15.17:0/2575416463 wait complete. 2024-09-10T23:16:00.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7f4518a00640 1 Processor -- start 2024-09-10T23:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe934200640 1 Processor -- start 2024-09-10T23:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe934200640 1 -- start start 2024-09-10T23:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe934200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe92c0b3310 0x7fe92c14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe934200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe92c0b3a00 0x7fe92c156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe934200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe92c0b3de0 0x7fe92c14a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe934200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c06fd80 con 0x7fe92c0b3a00 2024-09-10T23:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe934200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c06fc00 con 0x7fe92c0b3310 2024-09-10T23:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe934200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe92c15c750 con 0x7fe92c0b3de0 2024-09-10T23:16:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe930e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe92c0b3a00 0x7fe92c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe930e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe92c0b3a00 0x7fe92c156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33982/0 (socket says 172.21.15.17:33982) 2024-09-10T23:16:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fe930e00640 1 -- 172.21.15.17:0/780174652 learned_addr learned my addr 172.21.15.17:0/780174652 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe930e00640 1 -- 172.21.15.17:0/780174652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe92c0b3de0 msgr2=0x7fe92c14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe930e00640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe92c0b3de0 0x7fe92c14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7f4518a00640 1 -- start start 2024-09-10T23:16:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4518a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450c034b20 0x7f450c0e1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4518a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0e08e0 0x7f450c0dccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4518a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450c0e5020 0x7f450c0079c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.691+0000 7fef41400640 1 Processor -- start 2024-09-10T23:16:00.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe930e00640 1 -- 172.21.15.17:0/780174652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe92c0b3310 msgr2=0x7fe92c14fca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:16:00.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4518a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f450c0344d0 con 0x7f450c0e08e0 2024-09-10T23:16:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4518a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f450c033a50 con 0x7f450c0e5020 2024-09-10T23:16:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fd81a000640 1 -- 172.21.15.17:0/3801749642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd814070230 msgr2=0x7fd814073c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fd81a000640 1 --2- 172.21.15.17:0/3801749642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd814070230 0x7fd814073c00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd81406e5a0 tx=0x7fd80001ea30 comp rx=0 tx=0).stop 2024-09-10T23:16:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe930e00640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe92c0b3310 0x7fe92c14fca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4518a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f450c034650 con 0x7f450c034b20 2024-09-10T23:16:00.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef41400640 1 -- start start 2024-09-10T23:16:00.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fd81a000640 1 -- 172.21.15.17:0/3801749642 shutdown_connections 2024-09-10T23:16:00.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fd81a000640 1 --2- 172.21.15.17:0/3801749642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd814070230 0x7fd814073c00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fd81a000640 1 --2- 172.21.15.17:0/3801749642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8140b3b40 0x7fd81406fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fd81a000640 1 --2- 172.21.15.17:0/3801749642 >> v2:172.21.15.17:3300/0 conn(0x7fd8140b4a10 0x7fd81415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fd81a000640 1 -- 172.21.15.17:0/3801749642 >> 172.21.15.17:0/3801749642 conn(0x7fd8140cfb20 msgr2=0x7fd8140cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4513200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450c0e5020 0x7f450c0079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4513200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450c0e5020 0x7f450c0079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:49946/0 (socket says 172.21.15.17:49946) 2024-09-10T23:16:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4513200640 1 -- 172.21.15.17:0/3008364984 learned_addr learned my addr 172.21.15.17:0/3008364984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe930e00640 1 -- 172.21.15.17:0/780174652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c150c30 con 0x7fe92c0b3a00 2024-09-10T23:16:00.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe930e00640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe92c0b3a00 0x7fe92c156660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe91800b550 tx=0x7fe91800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4513200640 1 -- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450c034b20 msgr2=0x7f450c0e1090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:16:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4513200640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450c034b20 0x7f450c0e1090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4513200640 1 -- 172.21.15.17:0/3008364984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0e08e0 msgr2=0x7f450c0dccd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T23:16:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4513200640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f450c0e08e0 0x7f450c0dccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4513200640 1 -- 172.21.15.17:0/3008364984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c0e4360 con 0x7f450c0e5020 2024-09-10T23:16:00.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fd81a000640 1 -- 172.21.15.17:0/3801749642 shutdown_connections 2024-09-10T23:16:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fd81a000640 1 -- 172.21.15.17:0/3801749642 wait complete. 2024-09-10T23:16:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe929600640 1 -- 172.21.15.17:0/780174652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918014070 con 0x7fe92c0b3a00 2024-09-10T23:16:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe929600640 1 -- 172.21.15.17:0/780174652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe918010980 con 0x7fe92c0b3a00 2024-09-10T23:16:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe929600640 1 -- 172.21.15.17:0/780174652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918010dd0 con 0x7fe92c0b3a00 2024-09-10T23:16:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4513200640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450c0e5020 0x7f450c0079c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f451406b260 tx=0x7f451406a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92c1570c0 con 0x7fe92c0b3a00 2024-09-10T23:16:00.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef41400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef20005420 0x7fef3c13c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef41400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef3c151a30 0x7fef3c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef41400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef3c0b4310 0x7fef3c150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef3be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef20005420 0x7fef3c13c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef3be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef20005420 0x7fef3c13c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33994/0 (socket says 172.21.15.17:33994) 2024-09-10T23:16:00.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef3be00640 1 -- 172.21.15.17:0/3974257276 learned_addr learned my addr 172.21.15.17:0/3974257276 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:00.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f450aa00640 1 -- 172.21.15.17:0/3008364984 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514095070 con 0x7f450c0e5020 2024-09-10T23:16:00.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f450aa00640 1 -- 172.21.15.17:0/3008364984 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f451406c640 con 0x7f450c0e5020 2024-09-10T23:16:00.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f450aa00640 1 -- 172.21.15.17:0/3008364984 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514075740 con 0x7f450c0e5020 2024-09-10T23:16:00.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450c0e1b80 con 0x7f450c0e5020 2024-09-10T23:16:00.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92c157680 con 0x7fe92c0b3a00 2024-09-10T23:16:00.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450c1771d0 con 0x7f450c0e5020 2024-09-10T23:16:00.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe92c06eca0 con 0x7fe92c0b3a00 2024-09-10T23:16:00.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0c5fc0 con 0x7fef20005420 2024-09-10T23:16:00.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0c5e40 con 0x7fef3c151a30 2024-09-10T23:16:00.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fef3c06eed0 con 0x7fef3c0b4310 2024-09-10T23:16:00.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.695+0000 7fef40a00640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef3c0b4310 0x7fef3c150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f450c0e1770 con 0x7f450c0e5020 2024-09-10T23:16:00.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd81a000640 1 Processor -- start 2024-09-10T23:16:00.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef40a00640 1 -- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef3c151a30 msgr2=0x7fef3c0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef40a00640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef3c151a30 0x7fef3c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef40a00640 1 -- 172.21.15.17:0/3974257276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef20005420 msgr2=0x7fef3c13c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef40a00640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef20005420 0x7fef3c13c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef40a00640 1 -- 172.21.15.17:0/3974257276 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c13c920 con 0x7fef3c0b4310 2024-09-10T23:16:00.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef40a00640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef3c0b4310 0x7fef3c150d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0649f0 tx=0x7fef28004d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f4e80000640 1 -- 172.21.15.17:0/426131229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e780d4810 msgr2=0x7f4e780b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f4e80000640 1 --2- 172.21.15.17:0/426131229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e780d4810 0x7f4e780b1900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009900 tx=0x7f4e6401c820 comp rx=0 tx=0).stop 2024-09-10T23:16:00.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef33e00640 1 -- 172.21.15.17:0/3974257276 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280b6020 con 0x7fef3c0b4310 2024-09-10T23:16:00.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef33e00640 1 -- 172.21.15.17:0/3974257276 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef280064a0 con 0x7fef3c0b4310 2024-09-10T23:16:00.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef33e00640 1 -- 172.21.15.17:0/3974257276 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280ab040 con 0x7fef3c0b4310 2024-09-10T23:16:00.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3c0b47e0 con 0x7fef3c0b4310 2024-09-10T23:16:00.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c0b4da0 con 0x7fef3c0b4310 2024-09-10T23:16:00.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd81a000640 1 -- start start 2024-09-10T23:16:00.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f4e80000640 1 -- 172.21.15.17:0/426131229 shutdown_connections 2024-09-10T23:16:00.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f4e80000640 1 --2- 172.21.15.17:0/426131229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e780d4810 0x7f4e780b1900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f4e80000640 1 --2- 172.21.15.17:0/426131229 >> v2:172.21.15.17:3300/0 conn(0x7f4e780d24a0 0x7f4e780b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f4e80000640 1 -- 172.21.15.17:0/426131229 >> 172.21.15.17:0/426131229 conn(0x7f4e7809d240 msgr2=0x7f4e780d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f09f8000640 1 -- 172.21.15.17:0/310366348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09f01434c0 msgr2=0x7f09f015a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f09f8000640 1 --2- 172.21.15.17:0/310366348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09f01434c0 0x7f09f015a3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f09f006e560 tx=0x7f09e801fc60 comp rx=0 tx=0).stop 2024-09-10T23:16:00.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef3c0c4d10 con 0x7fef3c0b4310 2024-09-10T23:16:00.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f450aa00640 1 -- 172.21.15.17:0/3008364984 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f45140758e0 con 0x7f450c0e5020 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f09f8000640 1 -- 172.21.15.17:0/310366348 shutdown_connections 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f09f8000640 1 --2- 172.21.15.17:0/310366348 >> v2:172.21.15.17:3300/0 conn(0x7f09f0072900 0x7f09f0072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f09f8000640 1 --2- 172.21.15.17:0/310366348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09f01434c0 0x7f09f015a3d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7f09f8000640 1 -- 172.21.15.17:0/310366348 >> 172.21.15.17:0/310366348 conn(0x7f09f00b1730 msgr2=0x7f09f00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd81a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd814070230 0x7fd81414dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd81a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8140b3b40 0x7fd8140ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd81a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8140b4a10 0x7fd8140cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd81a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd81415e980 con 0x7fd8140b4a10 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd81a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd81415e800 con 0x7fd8140b3b40 2024-09-10T23:16:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd81a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd81415eb00 con 0x7fd814070230 2024-09-10T23:16:00.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fae56200640 1 -- 172.21.15.17:0/3442074307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae500d24a0 msgr2=0x7fae500b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fae56200640 1 --2- 172.21.15.17:0/3442074307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae500d24a0 0x7fae500b3760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae500b15f0 tx=0x7fae3c01c780 comp rx=0 tx=0).stop 2024-09-10T23:16:00.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd813400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd814070230 0x7fd81414dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd813400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd814070230 0x7fd81414dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56404/0 (socket says 172.21.15.17:56404) 2024-09-10T23:16:00.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd813400640 1 -- 172.21.15.17:0/125793302 learned_addr learned my addr 172.21.15.17:0/125793302 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:00.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd812a00640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8140b3b40 0x7fd8140ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.699+0000 7fd813e00640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8140b4a10 0x7fd8140cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f450aa00640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44f4072630 0x7f44f4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f450aa00640 1 -- 172.21.15.17:0/3008364984 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f45141133a0 con 0x7f450c0e5020 2024-09-10T23:16:00.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f450aa00640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7f44f407bda0 0x7f44f407e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f450aa00640 1 -- 172.21.15.17:0/3008364984 --> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44f407e8b0 con 0x7f44f407bda0 2024-09-10T23:16:00.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f450aa00640 1 -- 172.21.15.17:0/3008364984 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4514113750 con 0x7f450c0e5020 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd813400640 1 -- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8140b3b40 msgr2=0x7fd8140ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd813400640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8140b3b40 0x7fd8140ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd813400640 1 -- 172.21.15.17:0/125793302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8140b4a10 msgr2=0x7fd8140cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd813400640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8140b4a10 0x7fd8140cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd813400640 1 -- 172.21.15.17:0/125793302 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8140cec40 con 0x7fd814070230 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd813e00640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8140b4a10 0x7fd8140cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd813400640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd814070230 0x7fd81414dbf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00ba50 tx=0x7fd80c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f4e80000640 1 -- 172.21.15.17:0/426131229 shutdown_connections 2024-09-10T23:16:00.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f4e80000640 1 -- 172.21.15.17:0/426131229 wait complete. 2024-09-10T23:16:00.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f09f8000640 1 -- 172.21.15.17:0/310366348 shutdown_connections 2024-09-10T23:16:00.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f09f8000640 1 -- 172.21.15.17:0/310366348 wait complete. 2024-09-10T23:16:00.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fef33e00640 1 -- 172.21.15.17:0/3974257276 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fef280b1040 con 0x7fef3c0b4310 2024-09-10T23:16:00.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f4512800640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44f4072630 0x7f44f4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f4511e00640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7f44f407bda0 0x7f44f407e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd80b400640 1 -- 172.21.15.17:0/125793302 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c019070 con 0x7fd814070230 2024-09-10T23:16:00.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd80b400640 1 -- 172.21.15.17:0/125793302 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd80c00ccf0 con 0x7fd814070230 2024-09-10T23:16:00.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd80b400640 1 -- 172.21.15.17:0/125793302 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0146a0 con 0x7fd814070230 2024-09-10T23:16:00.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81414ed10 con 0x7fd814070230 2024-09-10T23:16:00.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8140cf190 con 0x7fd814070230 2024-09-10T23:16:00.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fae56200640 1 -- 172.21.15.17:0/3442074307 shutdown_connections 2024-09-10T23:16:00.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fae56200640 1 --2- 172.21.15.17:0/3442074307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae500d24a0 0x7fae500b3760 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fae56200640 1 -- 172.21.15.17:0/3442074307 >> 172.21.15.17:0/3442074307 conn(0x7fae5009d240 msgr2=0x7fae500d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f09f8000640 1 Processor -- start 2024-09-10T23:16:00.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7ec001040 con 0x7fd814070230 2024-09-10T23:16:00.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f4511e00640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7f44f407bda0 0x7f44f407e1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fe929600640 1 -- 172.21.15.17:0/780174652 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe918023440 con 0x7fe92c0b3a00 2024-09-10T23:16:00.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f4e80000640 1 Processor -- start 2024-09-10T23:16:00.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fae56200640 1 -- 172.21.15.17:0/3442074307 shutdown_connections 2024-09-10T23:16:00.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f4e80000640 1 -- start start 2024-09-10T23:16:00.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7fef33e00640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef1c0725e0 0x7fef1c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.703+0000 7f4512800640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44f4072630 0x7f44f4074af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45040ae000 tx=0x7f450401afa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fef33e00640 1 -- 172.21.15.17:0/3974257276 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fef2812ccc0 con 0x7fef3c0b4310 2024-09-10T23:16:00.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fef33e00640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7fef1c07bd60 0x7fef1c07e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fef33e00640 1 -- 172.21.15.17:0/3974257276 --> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef280a8ec0 con 0x7fef1c07bd60 2024-09-10T23:16:00.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fef3be00640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef1c0725e0 0x7fef1c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fef33e00640 1 -- 172.21.15.17:0/3974257276 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef2812d0b0 con 0x7fef3c0b4310 2024-09-10T23:16:00.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fae56200640 1 -- 172.21.15.17:0/3442074307 wait complete. 2024-09-10T23:16:00.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fe929600640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe90c072630 0x7fe90c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fe929600640 1 -- 172.21.15.17:0/780174652 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe918093b00 con 0x7fe92c0b3a00 2024-09-10T23:16:00.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fe929600640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7fe90c07bda0 0x7fe90c07e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f8000640 1 -- start start 2024-09-10T23:16:00.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fef3b400640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7fef1c07bd60 0x7fef1c07e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f450aa00640 1 -- 172.21.15.17:0/3008364984 <== osd.1 v2:172.21.15.17:6808/132168374 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f44f407e8b0 con 0x7f44f407bda0 2024-09-10T23:16:00.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fb489000640 1 -- 172.21.15.17:0/2130699981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb48415fba0 msgr2=0x7fb4840728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f8000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09f0072900 0x7f09f00cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e80000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e780b5130 0x7f4e780cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e80000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e780d24a0 0x7f4e780cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e80000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e780d4810 0x7f4e780c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e80000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780b2c30 con 0x7f4e780b5130 2024-09-10T23:16:00.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e80000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780b2ab0 con 0x7f4e780d24a0 2024-09-10T23:16:00.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e80000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7816b1b0 con 0x7f4e780d4810 2024-09-10T23:16:00.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f8000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09f01434c0 0x7f09f01f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f8000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09f01438a0 0x7f09f01f7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f8000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f09f006eba0 con 0x7f09f01438a0 2024-09-10T23:16:00.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f8000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09f006ea20 con 0x7f09f0072900 2024-09-10T23:16:00.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f8000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f09f006ed20 con 0x7f09f01434c0 2024-09-10T23:16:00.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f4c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09f01434c0 0x7f09f01f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f4c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09f01434c0 0x7f09f01f4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56412/0 (socket says 172.21.15.17:56412) 2024-09-10T23:16:00.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f4c00640 1 -- 172.21.15.17:0/1863640355 learned_addr learned my addr 172.21.15.17:0/1863640355 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:00.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fb489000640 1 --2- 172.21.15.17:0/2130699981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb48415fba0 0x7fb4840728a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009840 tx=0x7fb46c01ef30 comp rx=0 tx=0).stop 2024-09-10T23:16:00.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fef3b400640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7fef1c07bd60 0x7fef1c07e1a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fd80b400640 1 -- 172.21.15.17:0/125793302 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd80c039a50 con 0x7fd814070230 2024-09-10T23:16:00.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fb489000640 1 -- 172.21.15.17:0/2130699981 shutdown_connections 2024-09-10T23:16:00.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fb489000640 1 --2- 172.21.15.17:0/2130699981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb48415fba0 0x7fb4840728a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fb489000640 1 --2- 172.21.15.17:0/2130699981 >> v2:172.21.15.17:3300/0 conn(0x7fb4840ce250 0x7fb48415f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fb489000640 1 -- 172.21.15.17:0/2130699981 >> 172.21.15.17:0/2130699981 conn(0x7fb4840b1730 msgr2=0x7fb4840b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fae56200640 1 Processor -- start 2024-09-10T23:16:00.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f6000640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09f01438a0 0x7f09f01f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fef3be00640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef1c0725e0 0x7fef1c074aa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef34004a90 tx=0x7fef3400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e7cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e780d24a0 0x7f4e780cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e7cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e780d24a0 0x7f4e780cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:49984/0 (socket says 172.21.15.17:49984) 2024-09-10T23:16:00.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e7cc00640 1 -- 172.21.15.17:0/1686768067 learned_addr learned my addr 172.21.15.17:0/1686768067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:00.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e7e000640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e780d4810 0x7f4e780c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fb489000640 1 -- 172.21.15.17:0/2130699981 shutdown_connections 2024-09-10T23:16:00.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fe931800640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe90c072630 0x7fe90c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fe932200640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7fe90c07bda0 0x7fe90c07e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fe931800640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe90c072630 0x7fe90c074af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe920001580 tx=0x7fe9200078b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fe932200640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7fe90c07bda0 0x7fe90c07e1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fd80b400640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7f40726b0 0x7fd7f4074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fd80b400640 1 -- 172.21.15.17:0/125793302 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd80c093750 con 0x7fd814070230 2024-09-10T23:16:00.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fd80b400640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7fd7f407be20 0x7fd7f407e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fd80b400640 1 -- 172.21.15.17:0/125793302 --> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7f407e930 con 0x7fd7f407be20 2024-09-10T23:16:00.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fd80b400640 1 -- 172.21.15.17:0/125793302 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd80c093b40 con 0x7fd814070230 2024-09-10T23:16:00.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f4e7d600640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e780b5130 0x7f4e780cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fae56200640 1 -- start start 2024-09-10T23:16:00.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f5600640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09f0072900 0x7f09f00cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f6000640 1 -- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09f01434c0 msgr2=0x7f09f01f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f6000640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09f01434c0 0x7f09f01f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f6000640 1 -- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09f0072900 msgr2=0x7f09f00cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f6000640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09f0072900 0x7f09f00cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7f09f6000640 1 -- 172.21.15.17:0/1863640355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f01f51e0 con 0x7f09f01438a0 2024-09-10T23:16:00.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f09f6000640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09f01438a0 0x7f09f01f7880 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00e970 tx=0x7f09dc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.707+0000 7fb489000640 1 -- 172.21.15.17:0/2130699981 wait complete. 2024-09-10T23:16:00.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fe929600640 1 -- 172.21.15.17:0/780174652 --> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe91800de50 con 0x7fe90c07bda0 2024-09-10T23:16:00.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f09ed600640 1 -- 172.21.15.17:0/1863640355 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00ccc0 con 0x7f09f01438a0 2024-09-10T23:16:00.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fef33e00640 1 -- 172.21.15.17:0/3974257276 <== osd.0 v2:172.21.15.17:6824/2280070654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef280a8ec0 con 0x7fef1c07bd60 2024-09-10T23:16:00.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fe929600640 1 -- 172.21.15.17:0/780174652 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe918093f60 con 0x7fe92c0b3a00 2024-09-10T23:16:00.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fd812a00640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7f40726b0 0x7fd7f4074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fd813e00640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7fd7f407be20 0x7fd7f407e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f4e7cc00640 1 -- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e780d4810 msgr2=0x7f4e780c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f4e7cc00640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e780d4810 0x7f4e780c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f4e7cc00640 1 -- 172.21.15.17:0/1686768067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e780b5130 msgr2=0x7f4e780cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f4e7cc00640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e780b5130 0x7f4e780cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f4e7cc00640 1 -- 172.21.15.17:0/1686768067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e780b7190 con 0x7f4e780d24a0 2024-09-10T23:16:00.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f01f81f0 con 0x7f09f01438a0 2024-09-10T23:16:00.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f01f44a0 con 0x7f09f01438a0 2024-09-10T23:16:00.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f09ed600640 1 -- 172.21.15.17:0/1863640355 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09dc004020 con 0x7f09f01438a0 2024-09-10T23:16:00.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f09ed600640 1 -- 172.21.15.17:0/1863640355 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00ccc0 con 0x7f09f01438a0 2024-09-10T23:16:00.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae56200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae500b5130 0x7fae50158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae56200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae500d24a0 0x7fae501ff6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae56200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae500d4810 0x7fae501ffc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae56200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fae5016c340 con 0x7fae500b5130 2024-09-10T23:16:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae56200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fae5016c1c0 con 0x7fae500d24a0 2024-09-10T23:16:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae56200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fae5016c4c0 con 0x7fae500d4810 2024-09-10T23:16:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fb489000640 1 Processor -- start 2024-09-10T23:16:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae4fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae500d4810 0x7fae501ffc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae4fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae500d4810 0x7fae501ffc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56426/0 (socket says 172.21.15.17:56426) 2024-09-10T23:16:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae4fe00640 1 -- 172.21.15.17:0/1010913886 learned_addr learned my addr 172.21.15.17:0/1010913886 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f4e7cc00640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e780d24a0 0x7f4e780cd5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c4d0 tx=0x7f4e6800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fd813e00640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7fd7f407be20 0x7fd7f407e260 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fd812a00640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7f40726b0 0x7fd7f4074b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd814073910 tx=0x7fd804009260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fb489000640 1 -- start start 2024-09-10T23:16:00.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fd80b400640 1 -- 172.21.15.17:0/125793302 <== osd.3 v2:172.21.15.17:6800/1907203974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7f407e930 con 0x7fd7f407be20 2024-09-10T23:16:00.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fb489000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4840ce250 0x7fb4841f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f4e75600640 1 -- 172.21.15.17:0/1686768067 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680052d0 con 0x7f4e780d24a0 2024-09-10T23:16:00.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7fae4ea00640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae500d24a0 0x7fae501ff6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f4e75600640 1 -- 172.21.15.17:0/1686768067 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e68005470 con 0x7f4e780d24a0 2024-09-10T23:16:00.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.711+0000 7f4e75600640 1 -- 172.21.15.17:0/1686768067 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68012890 con 0x7f4e780d24a0 2024-09-10T23:16:00.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb489000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4841416c0 0x7fb4841e8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb489000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb48415fba0 0x7fb4841e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae4f400640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae500b5130 0x7fae50158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae4fe00640 1 -- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae500d24a0 msgr2=0x7fae501ff6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae4fe00640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae500d24a0 0x7fae501ff6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae4fe00640 1 -- 172.21.15.17:0/1010913886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae500b5130 msgr2=0x7fae50158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae4fe00640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae500b5130 0x7fae50158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae4fe00640 1 -- 172.21.15.17:0/1010913886 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae50159030 con 0x7fae500d4810 2024-09-10T23:16:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09cc001040 con 0x7f09f01438a0 2024-09-10T23:16:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb481400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4841416c0 0x7fb4841e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb481400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4841416c0 0x7fb4841e8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56430/0 (socket says 172.21.15.17:56430) 2024-09-10T23:16:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb481400640 1 -- 172.21.15.17:0/286142609 learned_addr learned my addr 172.21.15.17:0/286142609 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb484073250 con 0x7fb4840ce250 2024-09-10T23:16:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840730d0 con 0x7fb48415fba0 2024-09-10T23:16:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb4840733d0 con 0x7fb4841416c0 2024-09-10T23:16:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb482800640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb48415fba0 0x7fb4841e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f4e80000640 1 -- 172.21.15.17:0/1686768067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e780ccac0 con 0x7f4e780d24a0 2024-09-10T23:16:00.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f4e80000640 1 -- 172.21.15.17:0/1686768067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e780b7470 con 0x7f4e780d24a0 2024-09-10T23:16:00.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f09ed600640 1 -- 172.21.15.17:0/1863640355 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f09dc0041d0 con 0x7f09f01438a0 2024-09-10T23:16:00.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb481400640 1 -- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb48415fba0 msgr2=0x7fb4841e8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb481400640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb48415fba0 0x7fb4841e8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb481400640 1 -- 172.21.15.17:0/286142609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4840ce250 msgr2=0x7fb4841f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb481400640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4840ce250 0x7fb4841f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb481400640 1 -- 172.21.15.17:0/286142609 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4841fd220 con 0x7fb4841416c0 2024-09-10T23:16:00.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb481400640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4841416c0 0x7fb4841e8530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb47400e9f0 tx=0x7fb47400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae4fe00640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae500d4810 0x7fae501ffc00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fae4000b440 tx=0x7fae4000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae47400640 1 -- 172.21.15.17:0/1010913886 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40015020 con 0x7fae500d4810 2024-09-10T23:16:00.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae47400640 1 -- 172.21.15.17:0/1010913886 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae40011960 con 0x7fae500d4810 2024-09-10T23:16:00.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fae47400640 1 -- 172.21.15.17:0/1010913886 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40011db0 con 0x7fae500d4810 2024-09-10T23:16:00.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fe929600640 1 -- 172.21.15.17:0/780174652 <== osd.2 v2:172.21.15.17:6816/2333448301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe91800de50 con 0x7fe90c07bda0 2024-09-10T23:16:00.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb47a000640 1 -- 172.21.15.17:0/286142609 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47400cd80 con 0x7fb4841416c0 2024-09-10T23:16:00.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4841fc460 con 0x7fb4841416c0 2024-09-10T23:16:00.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4841fca20 con 0x7fb4841416c0 2024-09-10T23:16:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f09ed600640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f09d0072810 0x7f09d0074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb47a000640 1 -- 172.21.15.17:0/286142609 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb474010430 con 0x7fb4841416c0 2024-09-10T23:16:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7fb47a000640 1 -- 172.21.15.17:0/286142609 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47400cd80 con 0x7fb4841416c0 2024-09-10T23:16:00.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f4e6ea00640 1 -- 172.21.15.17:0/1686768067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e4c001040 con 0x7f4e780d24a0 2024-09-10T23:16:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f09ed600640 1 -- 172.21.15.17:0/1863640355 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f09dc093a70 con 0x7f09f01438a0 2024-09-10T23:16:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f09ed600640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7f09d007be80 0x7f09d007e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f09ed600640 1 -- 172.21.15.17:0/1863640355 --> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09dc011e50 con 0x7f09d007be80 2024-09-10T23:16:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.715+0000 7f09f4c00640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7f09d007be80 0x7f09d007e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f09f5600640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f09d0072810 0x7f09d0074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f09f5600640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f09d0072810 0x7f09d0074cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09e80b2000 tx=0x7f09e801e4a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f4e75600640 1 -- 172.21.15.17:0/1686768067 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4e68037ae0 con 0x7f4e780d24a0 2024-09-10T23:16:00.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f09f4c00640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7f09d007be80 0x7f09d007e2c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7fb47a000640 1 -- 172.21.15.17:0/286142609 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb4740105e0 con 0x7fb4841416c0 2024-09-10T23:16:00.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7fb47a000640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb4600729e0 0x7fb460074ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f09ed600640 1 -- 172.21.15.17:0/1863640355 <== osd.6 v2:172.21.15.77:6818/1112476977 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09dc011e50 con 0x7f09d007be80 2024-09-10T23:16:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7fb47a000640 1 -- 172.21.15.17:0/286142609 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb47400cb80 con 0x7fb4841416c0 2024-09-10T23:16:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fb489000640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fb45c001660 0x7fb45c003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 --> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb45c006bc0 con 0x7fb45c001660 2024-09-10T23:16:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fb481e00640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb4600729e0 0x7fb460074ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7f09ed600640 1 -- 172.21.15.17:0/1863640355 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f09dc05ad50 con 0x7f09f01438a0 2024-09-10T23:16:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fb482800640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fb45c001660 0x7fb45c003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae500b9460 con 0x7fae500d4810 2024-09-10T23:16:00.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae500b9a20 con 0x7fae500d4810 2024-09-10T23:16:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fb481e00640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb4600729e0 0x7fb460074ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0021e0 tx=0x7fb47c001430 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fb482800640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fb45c001660 0x7fb45c003b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fb47a000640 1 -- 172.21.15.17:0/286142609 <== osd.7 v2:172.21.15.77:6810/1526018425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb45c006bc0 con 0x7fb45c001660 2024-09-10T23:16:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae501ff290 con 0x7fae500d4810 2024-09-10T23:16:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7fae47400640 1 -- 172.21.15.17:0/1010913886 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fae40022060 con 0x7fae500d4810 2024-09-10T23:16:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f4e75600640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e58072630 0x7f4e58074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f4e75600640 1 -- 172.21.15.17:0/1686768067 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4e68092d90 con 0x7f4e780d24a0 2024-09-10T23:16:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f4e75600640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f4e5807bdb0 0x7f4e5807e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f4e75600640 1 -- 172.21.15.17:0/1686768067 --> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e5807e8c0 con 0x7f4e5807bdb0 2024-09-10T23:16:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.719+0000 7f4e75600640 1 -- 172.21.15.17:0/1686768067 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4e68093140 con 0x7f4e780d24a0 2024-09-10T23:16:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7f4e7e000640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f4e5807bdb0 0x7f4e5807e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.723+0000 7f4e7e000640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f4e5807bdb0 0x7f4e5807e1f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7f4e75600640 1 -- 172.21.15.17:0/1686768067 <== osd.4 v2:172.21.15.77:6802/328051167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e5807e8c0 con 0x7f4e5807bdb0 2024-09-10T23:16:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7f4e7d600640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e58072630 0x7f4e58074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7fae47400640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae300725e0 0x7fae30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7fae47400640 1 -- 172.21.15.17:0/1010913886 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fae40093700 con 0x7fae500d4810 2024-09-10T23:16:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7f4e7d600640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e58072630 0x7f4e58074af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009f60 tx=0x7f4e70009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7fae4f400640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae300725e0 0x7fae30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7fae47400640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7fae3007bd50 0x7fae3007e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7fae47400640 1 -- 172.21.15.17:0/1010913886 --> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae4003be50 con 0x7fae3007bd50 2024-09-10T23:16:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7fae47400640 1 -- 172.21.15.17:0/1010913886 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fae40093af0 con 0x7fae500d4810 2024-09-10T23:16:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7fae4ea00640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7fae3007bd50 0x7fae3007e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.727+0000 7fae4ea00640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7fae3007bd50 0x7fae3007e190 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.731+0000 7fae4f400640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae300725e0 0x7fae30074aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0af000 tx=0x7fae3c01afc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.731+0000 7fae47400640 1 -- 172.21.15.17:0/1010913886 <== osd.5 v2:172.21.15.77:6826/209138323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae4003be50 con 0x7fae3007bd50 2024-09-10T23:16:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.735+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 --> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd7ec002de0 con 0x7fd7f407be20 2024-09-10T23:16:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd80b400640 1 -- 172.21.15.17:0/125793302 <== osd.3 v2:172.21.15.17:6800/1907203974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd7ec002de0 con 0x7fd7f407be20 2024-09-10T23:16:00.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 --> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef3c151500 con 0x7fef1c07bd60 2024-09-10T23:16:00.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7fd7f407be20 msgr2=0x7fd7f407e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7fd7f407be20 0x7fd7f407e260 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7f40726b0 msgr2=0x7fd7f4074b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7f40726b0 0x7fd7f4074b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd814073910 tx=0x7fd804009260 comp rx=0 tx=0).stop 2024-09-10T23:16:00.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd814070230 msgr2=0x7fd81414dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 --2- 172.21.15.17:0/125793302 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd814070230 0x7fd81414dbf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00ba50 tx=0x7fd80c00bf10 comp rx=0 tx=0).stop 2024-09-10T23:16:00.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 --> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f450c051120 con 0x7f44f407bda0 2024-09-10T23:16:00.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd813e00640 1 -- 172.21.15.17:0/125793302 reap_dead start 2024-09-10T23:16:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fef33e00640 1 -- 172.21.15.17:0/3974257276 <== osd.0 v2:172.21.15.17:6824/2280070654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fef3c151500 con 0x7fef1c07bd60 2024-09-10T23:16:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7f450aa00640 1 -- 172.21.15.17:0/3008364984 <== osd.1 v2:172.21.15.17:6808/132168374 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f450c051120 con 0x7f44f407bda0 2024-09-10T23:16:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 shutdown_connections 2024-09-10T23:16:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 >> 172.21.15.17:0/125793302 conn(0x7fd8140cfb20 msgr2=0x7fd8140af680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 shutdown_connections 2024-09-10T23:16:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7fd81a000640 1 -- 172.21.15.17:0/125793302 wait complete. 2024-09-10T23:16:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7f44f407bda0 msgr2=0x7f44f407e1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7f4518a00640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7f44f407bda0 0x7f44f407e1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44f4072630 msgr2=0x7f44f4074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7f4518a00640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44f4072630 0x7f44f4074af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45040ae000 tx=0x7f450401afa0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450c0e5020 msgr2=0x7f450c0079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7f4518a00640 1 --2- 172.21.15.17:0/3008364984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450c0e5020 0x7f450c0079c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f451406b260 tx=0x7f451406a400 comp rx=0 tx=0).stop 2024-09-10T23:16:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.739+0000 7f4513200640 1 -- 172.21.15.17:0/3008364984 reap_dead start 2024-09-10T23:16:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7fef1c07bd60 msgr2=0x7fef1c07e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7fef1c07bd60 0x7fef1c07e1a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 shutdown_connections 2024-09-10T23:16:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 >> 172.21.15.17:0/3008364984 conn(0x7f450c01e8b0 msgr2=0x7f450c036f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef1c0725e0 msgr2=0x7fef1c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef1c0725e0 0x7fef1c074aa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef34004a90 tx=0x7fef3400b040 comp rx=0 tx=0).stop 2024-09-10T23:16:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef3c0b4310 msgr2=0x7fef3c150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 --2- 172.21.15.17:0/3974257276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef3c0b4310 0x7fef3c150d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0649f0 tx=0x7fef28004d30 comp rx=0 tx=0).stop 2024-09-10T23:16:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef40a00640 1 -- 172.21.15.17:0/3974257276 reap_dead start 2024-09-10T23:16:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 shutdown_connections 2024-09-10T23:16:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7f4518a00640 1 -- 172.21.15.17:0/3008364984 wait complete. 2024-09-10T23:16:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 shutdown_connections 2024-09-10T23:16:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 >> 172.21.15.17:0/3974257276 conn(0x7fef3c0cfa00 msgr2=0x7fef3c157970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 shutdown_connections 2024-09-10T23:16:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.743+0000 7fef41400640 1 -- 172.21.15.17:0/3974257276 wait complete. 2024-09-10T23:16:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.747+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 --> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe92c157850 con 0x7fe90c07bda0 2024-09-10T23:16:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.747+0000 7fe929600640 1 -- 172.21.15.17:0/780174652 <== osd.2 v2:172.21.15.17:6816/2333448301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe92c157850 con 0x7fe90c07bda0 2024-09-10T23:16:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7fe90c07bda0 msgr2=0x7fe90c07e1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7fe90c07bda0 0x7fe90c07e1e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe90c072630 msgr2=0x7fe90c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe90c072630 0x7fe90c074af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe920001580 tx=0x7fe9200078b0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe92c0b3a00 msgr2=0x7fe92c156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 --2- 172.21.15.17:0/780174652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe92c0b3a00 0x7fe92c156660 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe91800b550 tx=0x7fe91800ba10 comp rx=0 tx=0).stop 2024-09-10T23:16:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe932200640 1 -- 172.21.15.17:0/780174652 reap_dead start 2024-09-10T23:16:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 shutdown_connections 2024-09-10T23:16:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 >> 172.21.15.17:0/780174652 conn(0x7fe92c0cf9c0 msgr2=0x7fe92c1618c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 shutdown_connections 2024-09-10T23:16:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.751+0000 7fe934200640 1 -- 172.21.15.17:0/780174652 wait complete. 2024-09-10T23:16:00.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 --> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09cc002de0 con 0x7f09d007be80 2024-09-10T23:16:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 --> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb45c005c50 con 0x7fb45c001660 2024-09-10T23:16:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7f09ed600640 1 -- 172.21.15.17:0/1863640355 <== osd.6 v2:172.21.15.77:6818/1112476977 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f09cc002de0 con 0x7f09d007be80 2024-09-10T23:16:00.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7fb47a000640 1 -- 172.21.15.17:0/286142609 <== osd.7 v2:172.21.15.77:6810/1526018425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb45c005c50 con 0x7fb45c001660 2024-09-10T23:16:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7f09d007be80 msgr2=0x7f09d007e2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7f09f8000640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7f09d007be80 0x7f09d007e2c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f09d0072810 msgr2=0x7f09d0074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7f09f8000640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f09d0072810 0x7f09d0074cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09e80b2000 tx=0x7f09e801e4a0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09f01438a0 msgr2=0x7f09f01f7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7f09f8000640 1 --2- 172.21.15.17:0/1863640355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09f01438a0 0x7f09f01f7880 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00e970 tx=0x7f09dc00ee30 comp rx=0 tx=0).stop 2024-09-10T23:16:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.755+0000 7f09f6000640 1 -- 172.21.15.17:0/1863640355 reap_dead start 2024-09-10T23:16:00.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 shutdown_connections 2024-09-10T23:16:00.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 >> 172.21.15.17:0/1863640355 conn(0x7f09f00b1730 msgr2=0x7f09f00ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fb45c001660 msgr2=0x7fb45c003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7fb489000640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fb45c001660 0x7fb45c003b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb4600729e0 msgr2=0x7fb460074ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7fb489000640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb4600729e0 0x7fb460074ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0021e0 tx=0x7fb47c001430 comp rx=0 tx=0).stop 2024-09-10T23:16:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4841416c0 msgr2=0x7fb4841e8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7fb489000640 1 --2- 172.21.15.17:0/286142609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb4841416c0 0x7fb4841e8530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb47400e9f0 tx=0x7fb47400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 shutdown_connections 2024-09-10T23:16:00.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7f09f8000640 1 -- 172.21.15.17:0/1863640355 wait complete. 2024-09-10T23:16:00.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7fb482800640 1 -- 172.21.15.17:0/286142609 reap_dead start 2024-09-10T23:16:00.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 shutdown_connections 2024-09-10T23:16:00.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 >> 172.21.15.17:0/286142609 conn(0x7fb4840b1730 msgr2=0x7fb4841409c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7f4e6ea00640 1 -- 172.21.15.17:0/1686768067 --> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e4c002de0 con 0x7f4e5807bdb0 2024-09-10T23:16:00.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.759+0000 7f4e75600640 1 -- 172.21.15.17:0/1686768067 <== osd.4 v2:172.21.15.77:6802/328051167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4e4c002de0 con 0x7f4e5807bdb0 2024-09-10T23:16:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 shutdown_connections 2024-09-10T23:16:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7fb489000640 1 -- 172.21.15.17:0/286142609 wait complete. 2024-09-10T23:16:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 -- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f4e5807bdb0 msgr2=0x7f4e5807e1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f4e5807bdb0 0x7f4e5807e1f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 -- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e58072630 msgr2=0x7f4e58074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e58072630 0x7f4e58074af0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009f60 tx=0x7f4e70009500 comp rx=0 tx=0).stop 2024-09-10T23:16:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 -- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e780d24a0 msgr2=0x7f4e780cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 --2- 172.21.15.17:0/1686768067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e780d24a0 0x7f4e780cd5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c4d0 tx=0x7f4e6800c990 comp rx=0 tx=0).stop 2024-09-10T23:16:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e7e000640 1 -- 172.21.15.17:0/1686768067 reap_dead start 2024-09-10T23:16:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 -- 172.21.15.17:0/1686768067 shutdown_connections 2024-09-10T23:16:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 -- 172.21.15.17:0/1686768067 >> 172.21.15.17:0/1686768067 conn(0x7f4e7809d240 msgr2=0x7f4e78151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 --> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae500b18e0 con 0x7fae3007bd50 2024-09-10T23:16:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 -- 172.21.15.17:0/1686768067 shutdown_connections 2024-09-10T23:16:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7f4e6ea00640 1 -- 172.21.15.17:0/1686768067 wait complete. 2024-09-10T23:16:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.763+0000 7fae47400640 1 -- 172.21.15.17:0/1010913886 <== osd.5 v2:172.21.15.77:6826/209138323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae500b18e0 con 0x7fae3007bd50 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7fae3007bd50 msgr2=0x7fae3007e190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7fae3007bd50 0x7fae3007e190 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae300725e0 msgr2=0x7fae30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae300725e0 0x7fae30074aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0af000 tx=0x7fae3c01afc0 comp rx=0 tx=0).stop 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae500d4810 msgr2=0x7fae501ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 --2- 172.21.15.17:0/1010913886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae500d4810 0x7fae501ffc00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fae4000b440 tx=0x7fae4000b900 comp rx=0 tx=0).stop 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae4fe00640 1 -- 172.21.15.17:0/1010913886 reap_dead start 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 shutdown_connections 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 >> 172.21.15.17:0/1010913886 conn(0x7fae5009d240 msgr2=0x7fae50169730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:00.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 shutdown_connections 2024-09-10T23:16:00.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:00.767+0000 7fae56200640 1 -- 172.21.15.17:0/1010913886 wait complete. 2024-09-10T23:16:00.785 INFO:teuthology.orchestra.run.smithi017.stdout:55834574858 2024-09-10T23:16:00.785 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T23:16:00.791 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-10T23:16:00.792 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-10T23:16:00.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T23:16:00.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T23:16:00.795 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-10T23:16:00.796 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T23:16:00.804 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-10T23:16:00.805 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T23:16:00.806 INFO:teuthology.orchestra.run.smithi017.stdout:68719476745 2024-09-10T23:16:00.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T23:16:00.811 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-10T23:16:00.811 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-10T23:16:00.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T23:16:00.812 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T23:16:01.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.019+0000 7fa597200640 1 -- 172.21.15.17:0/928017792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57c003a60 msgr2=0x7fa57c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.019+0000 7fa597200640 1 --2- 172.21.15.17:0/928017792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57c003a60 0x7fa57c003e80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa58801ab40 tx=0x7fa58802df20 comp rx=0 tx=0).stop 2024-09-10T23:16:01.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.019+0000 7fa596800640 1 -- 172.21.15.17:0/928017792 reap_dead start 2024-09-10T23:16:01.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.019+0000 7fa597200640 1 -- 172.21.15.17:0/928017792 shutdown_connections 2024-09-10T23:16:01.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.019+0000 7fa597200640 1 -- 172.21.15.17:0/928017792 >> 172.21.15.17:0/928017792 conn(0x7fa5980d1b10 msgr2=0x7fa5980d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.019+0000 7fa597200640 1 -- 172.21.15.17:0/928017792 shutdown_connections 2024-09-10T23:16:01.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.019+0000 7fa597200640 1 -- 172.21.15.17:0/928017792 wait complete. 2024-09-10T23:16:01.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.023+0000 7fa597200640 1 Processor -- start 2024-09-10T23:16:01.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.023+0000 7fa597200640 1 -- start start 2024-09-10T23:16:01.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa597200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57c003a60 0x7fa5981f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa597200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5980b5370 0x7fa598157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa597200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5980b57f0 0x7fa598157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa595e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57c003a60 0x7fa5981f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa595e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57c003a60 0x7fa5981f31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56466/0 (socket says 172.21.15.17:56466) 2024-09-10T23:16:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa595400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5980b5370 0x7fa598157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa595400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5980b5370 0x7fa598157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50050/0 (socket says 172.21.15.17:50050) 2024-09-10T23:16:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa595e00640 1 -- 172.21.15.17:0/463153577 learned_addr learned my addr 172.21.15.17:0/463153577 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa596800640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5980b57f0 0x7fa598157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa59806eaa0 con 0x7fa5980b57f0 2024-09-10T23:16:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa59806e920 con 0x7fa5980b5370 2024-09-10T23:16:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.027+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa59806dcd0 con 0x7fa57c003a60 2024-09-10T23:16:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa595e00640 1 -- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5980b5370 msgr2=0x7fa598157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa595e00640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5980b5370 0x7fa598157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa595e00640 1 -- 172.21.15.17:0/463153577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5980b57f0 msgr2=0x7fa598157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa595e00640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5980b57f0 0x7fa598157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa595e00640 1 -- 172.21.15.17:0/463153577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5981f03e0 con 0x7fa57c003a60 2024-09-10T23:16:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa595e00640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57c003a60 0x7fa5981f31d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5880c0040 tx=0x7fa5880056a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa58e000640 1 -- 172.21.15.17:0/463153577 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5880c2070 con 0x7fa57c003a60 2024-09-10T23:16:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa58e000640 1 -- 172.21.15.17:0/463153577 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5880c3040 con 0x7fa57c003a60 2024-09-10T23:16:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa58e000640 1 -- 172.21.15.17:0/463153577 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588004d80 con 0x7fa57c003a60 2024-09-10T23:16:01.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5981f06a0 con 0x7fa57c003a60 2024-09-10T23:16:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.031+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5981f0c60 con 0x7fa57c003a60 2024-09-10T23:16:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5981f1320 con 0x7fa57c003a60 2024-09-10T23:16:01.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f52ca400640 1 -- 172.21.15.17:0/934598874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c415a9a0 msgr2=0x7f52c415ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f52ca400640 1 --2- 172.21.15.17:0/934598874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c415a9a0 0x7f52c415ad80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52b00097f0 tx=0x7f52b001c670 comp rx=0 tx=0).stop 2024-09-10T23:16:01.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f52ca400640 1 -- 172.21.15.17:0/934598874 shutdown_connections 2024-09-10T23:16:01.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f52ca400640 1 --2- 172.21.15.17:0/934598874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c415a9a0 0x7f52c415ad80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f710ec00640 1 -- 172.21.15.17:0/4288963870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710806f810 msgr2=0x7f710806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f710ec00640 1 --2- 172.21.15.17:0/4288963870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710806f810 0x7f710806e6f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71080cbbe0 tx=0x7f70f001c840 comp rx=0 tx=0).stop 2024-09-10T23:16:01.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f52ca400640 1 -- 172.21.15.17:0/934598874 >> 172.21.15.17:0/934598874 conn(0x7f52c40b2740 msgr2=0x7f52c40b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7fa58e000640 1 -- 172.21.15.17:0/463153577 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa5880ecae0 con 0x7fa57c003a60 2024-09-10T23:16:01.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f52ca400640 1 -- 172.21.15.17:0/934598874 shutdown_connections 2024-09-10T23:16:01.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f52ca400640 1 -- 172.21.15.17:0/934598874 wait complete. 2024-09-10T23:16:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f710ec00640 1 -- 172.21.15.17:0/4288963870 shutdown_connections 2024-09-10T23:16:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f710ec00640 1 --2- 172.21.15.17:0/4288963870 >> v2:172.21.15.77:3300/0 conn(0x7f710815ae20 0x7f71080b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.035+0000 7f710ec00640 1 --2- 172.21.15.17:0/4288963870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710806f810 0x7f710806e6f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7f710ec00640 1 -- 172.21.15.17:0/4288963870 >> 172.21.15.17:0/4288963870 conn(0x7f71080cfb20 msgr2=0x7f71080cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7f710ec00640 1 -- 172.21.15.17:0/4288963870 shutdown_connections 2024-09-10T23:16:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7fa58e000640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5780726b0 0x7fa578074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7fa58e000640 1 -- 172.21.15.17:0/463153577 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa58813ee70 con 0x7fa57c003a60 2024-09-10T23:16:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7fa595400640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5780726b0 0x7fa578074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7f710ec00640 1 -- 172.21.15.17:0/4288963870 wait complete. 2024-09-10T23:16:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7fa595400640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5780726b0 0x7fa578074b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa58400a470 tx=0x7fa58400a400 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7f52ca400640 1 Processor -- start 2024-09-10T23:16:01.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7f710ec00640 1 Processor -- start 2024-09-10T23:16:01.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7fa58e000640 1 -- 172.21.15.17:0/463153577 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa5981f1320 con 0x7fa57c003a60 2024-09-10T23:16:01.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7f710ec00640 1 -- start start 2024-09-10T23:16:01.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.039+0000 7f52ca400640 1 -- start start 2024-09-10T23:16:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710ec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710806f810 0x7f7108140340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710ec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7108143790 0x7f7108153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710ec00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710815ae20 0x7f710813c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f7107e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710806f810 0x7f7108140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52ca400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52c4073c30 0x7f52c41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52ca400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c415a9a0 0x7f52c40b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52ca400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c415b2c0 0x7f52c40b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52ca400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52c4165dd0 con 0x7f52c4073c30 2024-09-10T23:16:01.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52ca400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52c4165c50 con 0x7f52c415b2c0 2024-09-10T23:16:01.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52ca400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52c4165f50 con 0x7f52c415a9a0 2024-09-10T23:16:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f7107e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710806f810 0x7f7108140340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56480/0 (socket says 172.21.15.17:56480) 2024-09-10T23:16:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f70ff400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7108143790 0x7f7108153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710815ae20 0x7f710813c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f7107e00640 1 -- 172.21.15.17:0/3928529335 learned_addr learned my addr 172.21.15.17:0/3928529335 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52c9a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c415b2c0 0x7f52c40b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52c9a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c415b2c0 0x7f52c40b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50064/0 (socket says 172.21.15.17:50064) 2024-09-10T23:16:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52c3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c415a9a0 0x7f52c40b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52c9a00640 1 -- 172.21.15.17:0/3342085738 learned_addr learned my addr 172.21.15.17:0/3342085738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7108166eb0 con 0x7f710815ae20 2024-09-10T23:16:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7108166d30 con 0x7f7108143790 2024-09-10T23:16:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7108167030 con 0x7f710806f810 2024-09-10T23:16:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710cc00640 1 -- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710806f810 msgr2=0x7f7108140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710cc00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710806f810 0x7f7108140340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710cc00640 1 -- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7108143790 msgr2=0x7f7108153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710cc00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7108143790 0x7f7108153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f710cc00640 1 -- 172.21.15.17:0/3928529335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7108158e20 con 0x7f710815ae20 2024-09-10T23:16:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.043+0000 7f52c9000640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52c4073c30 0x7f52c41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f710cc00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710815ae20 0x7f710813c7b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71000079c0 tx=0x7f7100007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c3e00640 1 -- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c415b2c0 msgr2=0x7f52c40b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c3e00640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c415b2c0 0x7f52c40b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c3e00640 1 -- 172.21.15.17:0/3342085738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52c4073c30 msgr2=0x7f52c41563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c3e00640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52c4073c30 0x7f52c41563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c3e00640 1 -- 172.21.15.17:0/3342085738 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c42013b0 con 0x7f52c415a9a0 2024-09-10T23:16:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c9a00640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c415b2c0 0x7f52c40b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:01.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c3e00640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c415a9a0 0x7f52c40b0fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52c415b700 tx=0x7f52b800ff00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f7104c00640 1 -- 172.21.15.17:0/3928529335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100017030 con 0x7f710815ae20 2024-09-10T23:16:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71081536d0 con 0x7f710815ae20 2024-09-10T23:16:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f7104c00640 1 -- 172.21.15.17:0/3928529335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7100004b30 con 0x7f710815ae20 2024-09-10T23:16:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71081593c0 con 0x7f710815ae20 2024-09-10T23:16:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c0c00640 1 -- 172.21.15.17:0/3342085738 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b801a070 con 0x7f52c415a9a0 2024-09-10T23:16:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c0c00640 1 -- 172.21.15.17:0/3342085738 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52b8008570 con 0x7f52c415a9a0 2024-09-10T23:16:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52c0c00640 1 -- 172.21.15.17:0/3342085738 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8006980 con 0x7f52c415a9a0 2024-09-10T23:16:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c41510d0 con 0x7f52c415a9a0 2024-09-10T23:16:01.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f7104c00640 1 -- 172.21.15.17:0/3928529335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100017030 con 0x7f710815ae20 2024-09-10T23:16:01.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.047+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c4151690 con 0x7f52c415a9a0 2024-09-10T23:16:01.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.051+0000 7f7104c00640 1 -- 172.21.15.17:0/3928529335 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f710000d9d0 con 0x7f710815ae20 2024-09-10T23:16:01.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.055+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e00052a0 con 0x7f710815ae20 2024-09-10T23:16:01.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.051+0000 7f52c0c00640 1 -- 172.21.15.17:0/3342085738 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f52b8006b20 con 0x7f52c415a9a0 2024-09-10T23:16:01.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.051+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c415ad80 con 0x7f52c415a9a0 2024-09-10T23:16:01.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.055+0000 7f52c0c00640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52a4072630 0x7f52a4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.055+0000 7f52c0c00640 1 -- 172.21.15.17:0/3342085738 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52b8095fa0 con 0x7f52c415a9a0 2024-09-10T23:16:01.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.055+0000 7f7104c00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e4072a10 0x7f70e4074ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.055+0000 7f7104c00640 1 -- 172.21.15.17:0/3928529335 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7100018070 con 0x7f710815ae20 2024-09-10T23:16:01.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.055+0000 7f52c9000640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52a4072630 0x7f52a4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.055+0000 7f7107e00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e4072a10 0x7f70e4074ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.059+0000 7f52c9000640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52a4072630 0x7f52a4074af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f52b00af000 tx=0x7f52b001aeb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.063+0000 7f7107e00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e4072a10 0x7f70e4074ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70f8001750 tx=0x7f70f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.063+0000 7f52c0c00640 1 -- 172.21.15.17:0/3342085738 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f52b8060d50 con 0x7f52c415a9a0 2024-09-10T23:16:01.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.063+0000 7f7104c00640 1 -- 172.21.15.17:0/3928529335 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7100021070 con 0x7f710815ae20 2024-09-10T23:16:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.103+0000 7f20d7e00640 1 -- 172.21.15.17:0/3576730267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20bc004810 msgr2=0x7f20bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.103+0000 7f20d7400640 1 -- 172.21.15.17:0/3576730267 reap_dead start 2024-09-10T23:16:01.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.107+0000 7f20d5600640 1 -- 172.21.15.17:0/3576730267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4006bc0 con 0x7f20bc004810 2024-09-10T23:16:01.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.107+0000 7f20d7e00640 1 --2- 172.21.15.17:0/3576730267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20bc004810 0x7f20bc004c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f20c4006f70 tx=0x7f20c401f6b0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.107+0000 7f20d7e00640 1 -- 172.21.15.17:0/3576730267 shutdown_connections 2024-09-10T23:16:01.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.107+0000 7f20d7e00640 1 --2- 172.21.15.17:0/3576730267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20bc004810 0x7f20bc004c90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.107+0000 7f20d7e00640 1 -- 172.21.15.17:0/3576730267 >> 172.21.15.17:0/3576730267 conn(0x7f20d80ccbf0 msgr2=0x7f20d80cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.107+0000 7f20d7e00640 1 -- 172.21.15.17:0/3576730267 shutdown_connections 2024-09-10T23:16:01.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.107+0000 7f20d7e00640 1 -- 172.21.15.17:0/3576730267 wait complete. 2024-09-10T23:16:01.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.107+0000 7f20d7e00640 1 Processor -- start 2024-09-10T23:16:01.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.107+0000 7f20d7e00640 1 -- start start 2024-09-10T23:16:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20bc004810 0x7f20d814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80cee30 0x7f20d80cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20d8154100 0x7f20d8154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80cee30 0x7f20d80cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d7e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20d81690c0 con 0x7f20d8154100 2024-09-10T23:16:01.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f20d8168f40 con 0x7f20d80cee30 2024-09-10T23:16:01.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f20d8169240 con 0x7f20bc004810 2024-09-10T23:16:01.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80cee30 0x7f20d80cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50098/0 (socket says 172.21.15.17:50098) 2024-09-10T23:16:01.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6000640 1 -- 172.21.15.17:0/1147714597 learned_addr learned my addr 172.21.15.17:0/1147714597 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:01.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6a00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20bc004810 0x7f20d814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d7400640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20d8154100 0x7f20d8154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6a00640 1 -- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80cee30 msgr2=0x7f20d80cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6a00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80cee30 0x7f20d80cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6a00640 1 -- 172.21.15.17:0/1147714597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20d8154100 msgr2=0x7f20d8154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6a00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20d8154100 0x7f20d8154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6a00640 1 -- 172.21.15.17:0/1147714597 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d80b1500 con 0x7f20bc004810 2024-09-10T23:16:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.111+0000 7f20d6000640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80cee30 0x7f20d80cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f20d6a00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20bc004810 0x7f20d814c7e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c430 tx=0x7f20c800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f20cea00640 1 -- 172.21.15.17:0/1147714597 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8011790 con 0x7f20bc004810 2024-09-10T23:16:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f20cea00640 1 -- 172.21.15.17:0/1147714597 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20c8017070 con 0x7f20bc004810 2024-09-10T23:16:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f20cea00640 1 -- 172.21.15.17:0/1147714597 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8011ca0 con 0x7f20bc004810 2024-09-10T23:16:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d80b0980 con 0x7f20bc004810 2024-09-10T23:16:01.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d80b0f40 con 0x7f20bc004810 2024-09-10T23:16:01.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d806e960 con 0x7f20bc004810 2024-09-10T23:16:01.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f6a54a00640 1 -- 172.21.15.17:0/1826526594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a480e3e10 msgr2=0x7f6a48057210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f6a54a00640 1 --2- 172.21.15.17:0/1826526594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a480e3e10 0x7f6a48057210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009900 tx=0x7f6a4001c7e0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f6a54a00640 1 -- 172.21.15.17:0/1826526594 shutdown_connections 2024-09-10T23:16:01.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f6a54a00640 1 --2- 172.21.15.17:0/1826526594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a480e41f0 0x7f6a48053080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f6a54a00640 1 --2- 172.21.15.17:0/1826526594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a480e3e10 0x7f6a48057210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.115+0000 7f6a54a00640 1 -- 172.21.15.17:0/1826526594 >> 172.21.15.17:0/1826526594 conn(0x7f6a48056720 msgr2=0x7f6a48056b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f6a54a00640 1 -- 172.21.15.17:0/1826526594 shutdown_connections 2024-09-10T23:16:01.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f6a54a00640 1 -- 172.21.15.17:0/1826526594 wait complete. 2024-09-10T23:16:01.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f124d200640 1 -- 172.21.15.17:0/545273042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12480ceeb0 msgr2=0x7f1248073c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f124d200640 1 --2- 172.21.15.17:0/545273042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12480ceeb0 0x7f1248073c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f124815afb0 tx=0x7f123801c890 comp rx=0 tx=0).stop 2024-09-10T23:16:01.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f124d200640 1 -- 172.21.15.17:0/545273042 shutdown_connections 2024-09-10T23:16:01.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f124d200640 1 --2- 172.21.15.17:0/545273042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12480ceeb0 0x7f1248073c50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f124d200640 1 --2- 172.21.15.17:0/545273042 >> v2:172.21.15.17:3300/0 conn(0x7f12481519f0 0x7f12480c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f124d200640 1 -- 172.21.15.17:0/545273042 >> 172.21.15.17:0/545273042 conn(0x7f12480d0bd0 msgr2=0x7f12480d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f20cea00640 1 -- 172.21.15.17:0/1147714597 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f20c801c460 con 0x7f20bc004810 2024-09-10T23:16:01.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f124d200640 1 -- 172.21.15.17:0/545273042 shutdown_connections 2024-09-10T23:16:01.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f124d200640 1 -- 172.21.15.17:0/545273042 wait complete. 2024-09-10T23:16:01.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f20cea00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20b8072610 0x7f20b8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f6a54a00640 1 Processor -- start 2024-09-10T23:16:01.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f20cea00640 1 -- 172.21.15.17:0/1147714597 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f20c8093240 con 0x7f20bc004810 2024-09-10T23:16:01.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f20d6000640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20b8072610 0x7f20b8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.119+0000 7f6a54a00640 1 -- start start 2024-09-10T23:16:01.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f124d200640 1 Processor -- start 2024-09-10T23:16:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f20d6000640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20b8072610 0x7f20b8074ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20d8157300 tx=0x7f20bc005840 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a54a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a480375e0 0x7f6a4817b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a54a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a480e3e10 0x7f6a48050060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a54a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a480e41f0 0x7f6a48039c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a54a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a480edc70 con 0x7f6a480e41f0 2024-09-10T23:16:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a54a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a480edaf0 con 0x7f6a480375e0 2024-09-10T23:16:01.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a54a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a480eddf0 con 0x7f6a480e3e10 2024-09-10T23:16:01.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f124d200640 1 -- start start 2024-09-10T23:16:01.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a480375e0 0x7f6a4817b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a480e3e10 0x7f6a48050060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a480e41f0 0x7f6a48039c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a480e41f0 0x7f6a48039c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34160/0 (socket says 172.21.15.17:34160) 2024-09-10T23:16:01.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4f200640 1 -- 172.21.15.17:0/2101725367 learned_addr learned my addr 172.21.15.17:0/2101725367 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:01.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f20cea00640 1 -- 172.21.15.17:0/1147714597 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f20c805e5d0 con 0x7f20bc004810 2024-09-10T23:16:01.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4e800640 1 -- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a480e3e10 msgr2=0x7f6a48050060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4e800640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a480e3e10 0x7f6a48050060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4e800640 1 -- 172.21.15.17:0/2101725367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a480e41f0 msgr2=0x7f6a48039c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4e800640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a480e41f0 0x7f6a48039c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f6a4e800640 1 -- 172.21.15.17:0/2101725367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a480505a0 con 0x7f6a480375e0 2024-09-10T23:16:01.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f6a4e800640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a480375e0 0x7f6a4817b660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a400ac000 tx=0x7f6a400a6ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f124d200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1248073800 0x7f124814cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f124d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12480ceeb0 0x7f1248152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f124d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12481519f0 0x7f1248154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f124d200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f124806cf50 con 0x7f12481519f0 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f124d200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f124806cdd0 con 0x7f1248073800 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.123+0000 7f124d200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f124806d0d0 con 0x7f12480ceeb0 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1248073800 0x7f124814cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1248073800 0x7f124814cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50142/0 (socket says 172.21.15.17:50142) 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245e00640 1 -- 172.21.15.17:0/1732266127 learned_addr learned my addr 172.21.15.17:0/1732266127 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:01.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245400640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12480ceeb0 0x7f1248152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245e00640 1 -- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12480ceeb0 msgr2=0x7f1248152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245e00640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12480ceeb0 0x7f1248152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245e00640 1 -- 172.21.15.17:0/1732266127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12481519f0 msgr2=0x7f1248154d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T23:16:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245e00640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12481519f0 0x7f1248154d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245e00640 1 -- 172.21.15.17:0/1732266127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1248152b20 con 0x7f1248073800 2024-09-10T23:16:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245e00640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1248073800 0x7f124814cfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f123400e7d0 tx=0x7f123400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f1245400640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12480ceeb0 0x7f1248152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:01.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f6a46a00640 1 -- 172.21.15.17:0/2101725367 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a400bd020 con 0x7f6a480375e0 2024-09-10T23:16:01.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f6a46a00640 1 -- 172.21.15.17:0/2101725367 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a40004260 con 0x7f6a480375e0 2024-09-10T23:16:01.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f6a46a00640 1 -- 172.21.15.17:0/2101725367 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40003600 con 0x7f6a480375e0 2024-09-10T23:16:01.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f6a54a00640 1 -- 172.21.15.17:0/2101725367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4817e990 con 0x7f6a480375e0 2024-09-10T23:16:01.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f6a54a00640 1 -- 172.21.15.17:0/2101725367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4817e6b0 con 0x7f6a480375e0 2024-09-10T23:16:01.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f123e000640 1 -- 172.21.15.17:0/1732266127 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123400ccc0 con 0x7f1248073800 2024-09-10T23:16:01.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f123e000640 1 -- 172.21.15.17:0/1732266127 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1234021440 con 0x7f1248073800 2024-09-10T23:16:01.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f123e000640 1 -- 172.21.15.17:0/1732266127 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234021890 con 0x7f1248073800 2024-09-10T23:16:01.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12480c7ef0 con 0x7f1248073800 2024-09-10T23:16:01.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12481527b0 con 0x7f1248073800 2024-09-10T23:16:01.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f2495400640 1 -- 172.21.15.17:0/2209877309 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480009730 con 0x7f247c004810 2024-09-10T23:16:01.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f249ca00640 1 -- 172.21.15.17:0/2209877309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f247c004810 msgr2=0x7f247c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f249ca00640 1 --2- 172.21.15.17:0/2209877309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f247c004810 0x7f247c004c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2480009b30 tx=0x7f248001d210 comp rx=0 tx=0).stop 2024-09-10T23:16:01.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f249ca00640 1 -- 172.21.15.17:0/2209877309 shutdown_connections 2024-09-10T23:16:01.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f249ca00640 1 --2- 172.21.15.17:0/2209877309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f247c004810 0x7f247c004c90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f249ca00640 1 -- 172.21.15.17:0/2209877309 >> 172.21.15.17:0/2209877309 conn(0x7f24980d1d90 msgr2=0x7f24980d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f249ca00640 1 -- 172.21.15.17:0/2209877309 shutdown_connections 2024-09-10T23:16:01.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.127+0000 7f249ca00640 1 -- 172.21.15.17:0/2209877309 wait complete. 2024-09-10T23:16:01.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.131+0000 7f249ca00640 1 Processor -- start 2024-09-10T23:16:01.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.131+0000 7f6a3be00640 1 -- 172.21.15.17:0/2101725367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a240052a0 con 0x7f6a480375e0 2024-09-10T23:16:01.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.131+0000 7f6a46a00640 1 -- 172.21.15.17:0/2101725367 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6a400dc950 con 0x7f6a480375e0 2024-09-10T23:16:01.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.131+0000 7f249ca00640 1 -- start start 2024-09-10T23:16:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.131+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12200052a0 con 0x7f1248073800 2024-09-10T23:16:01.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.131+0000 7f123e000640 1 -- 172.21.15.17:0/1732266127 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1234021a30 con 0x7f1248073800 2024-09-10T23:16:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f6a46a00640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a30072620 0x7f6a30074ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f6a46a00640 1 -- 172.21.15.17:0/2101725367 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6a4012ddc0 con 0x7f6a480375e0 2024-09-10T23:16:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f249ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c004810 0x7f24980b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f249ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24982051f0 0x7f24982083d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f249ca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24981fabb0 0x7f24981fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f6a4de00640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a30072620 0x7f6a30074ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f123e000640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1228072630 0x7f1228074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f123e000640 1 -- 172.21.15.17:0/1732266127 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f12340a4de0 con 0x7f1248073800 2024-09-10T23:16:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f2495e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c004810 0x7f24980b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f2495e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c004810 0x7f24980b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50156/0 (socket says 172.21.15.17:50156) 2024-09-10T23:16:01.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f1245400640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1228072630 0x7f1228074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f2495e00640 1 -- 172.21.15.17:0/1598497001 learned_addr learned my addr 172.21.15.17:0/1598497001 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f2496800640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24981fabb0 0x7f24981fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2498070cf0 con 0x7f24982051f0 2024-09-10T23:16:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2498070b70 con 0x7f247c004810 2024-09-10T23:16:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2498070e70 con 0x7f24981fabb0 2024-09-10T23:16:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f1245400640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1228072630 0x7f1228074af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12480b68e0 tx=0x7f1240009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f6a46a00640 1 -- 172.21.15.17:0/2101725367 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6a400164f0 con 0x7f6a480375e0 2024-09-10T23:16:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f2496800640 1 -- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c004810 msgr2=0x7f24980b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f2496800640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c004810 0x7f24980b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f2496800640 1 -- 172.21.15.17:0/1598497001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24982051f0 msgr2=0x7f24982083d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f2496800640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24982051f0 0x7f24982083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.135+0000 7f2496800640 1 -- 172.21.15.17:0/1598497001 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2498208910 con 0x7f24981fabb0 2024-09-10T23:16:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f6a4de00640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a30072620 0x7f6a30074ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0058d0 tx=0x7f6a3c005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f5018e00640 1 -- 172.21.15.17:0/1191081384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 msgr2=0x7f501406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f5018e00640 1 --2- 172.21.15.17:0/1191081384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 0x7f501406eb50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5004009870 tx=0x7f500401f050 comp rx=0 tx=0).stop 2024-09-10T23:16:01.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f2496800640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24981fabb0 0x7f24981fb040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24980b4890 tx=0x7f24900039d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f248ea00640 1 -- 172.21.15.17:0/1598497001 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490011840 con 0x7f24981fabb0 2024-09-10T23:16:01.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f248ea00640 1 -- 172.21.15.17:0/1598497001 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2490017070 con 0x7f24981fabb0 2024-09-10T23:16:01.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f248ea00640 1 -- 172.21.15.17:0/1598497001 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490011c00 con 0x7f24981fabb0 2024-09-10T23:16:01.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24980b4210 con 0x7f24981fabb0 2024-09-10T23:16:01.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24982049f0 con 0x7f24981fabb0 2024-09-10T23:16:01.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f5018e00640 1 -- 172.21.15.17:0/1191081384 shutdown_connections 2024-09-10T23:16:01.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f5018e00640 1 --2- 172.21.15.17:0/1191081384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 0x7f501406eb50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f5018e00640 1 -- 172.21.15.17:0/1191081384 >> 172.21.15.17:0/1191081384 conn(0x7f501406cbc0 msgr2=0x7f501406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2498204500 con 0x7f24981fabb0 2024-09-10T23:16:01.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.139+0000 7f123e000640 1 -- 172.21.15.17:0/1732266127 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f12340702f0 con 0x7f1248073800 2024-09-10T23:16:01.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.143+0000 7f5018e00640 1 -- 172.21.15.17:0/1191081384 shutdown_connections 2024-09-10T23:16:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.143+0000 7f248ea00640 1 -- 172.21.15.17:0/1598497001 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f249003ab80 con 0x7f24981fabb0 2024-09-10T23:16:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.143+0000 7f5018e00640 1 -- 172.21.15.17:0/1191081384 wait complete. 2024-09-10T23:16:01.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.147+0000 7f248ea00640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2474072610 0x7f2474074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.147+0000 7f248ea00640 1 -- 172.21.15.17:0/1598497001 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2490093ec0 con 0x7f24981fabb0 2024-09-10T23:16:01.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.147+0000 7f248ea00640 1 -- 172.21.15.17:0/1598497001 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f249005f240 con 0x7f24981fabb0 2024-09-10T23:16:01.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.147+0000 7f2495e00640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2474072610 0x7f2474074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.147+0000 7f5018e00640 1 Processor -- start 2024-09-10T23:16:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.151+0000 7f2495e00640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2474072610 0x7f2474074ad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f24880012f0 tx=0x7f2488001750 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.151+0000 7f5018e00640 1 -- start start 2024-09-10T23:16:01.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.151+0000 7f5018e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 0x7f50142023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.151+0000 7f5018e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f501406f090 0x7f501409a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.151+0000 7f5011e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 0x7f50142023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.151+0000 7f5011e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 0x7f50142023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56568/0 (socket says 172.21.15.17:56568) 2024-09-10T23:16:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.151+0000 7f5011400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f501406f090 0x7f501409a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.151+0000 7f5011400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f501406f090 0x7f501409a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50162/0 (socket says 172.21.15.17:50162) 2024-09-10T23:16:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.151+0000 7f5018e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f501415dfa0 0x7f50142011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5018e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f501415a450 con 0x7f501415dfa0 2024-09-10T23:16:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5018e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f501415a2d0 con 0x7f501406f090 2024-09-10T23:16:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5018e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f501415a5d0 con 0x7f501406a030 2024-09-10T23:16:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5011e00640 1 -- 172.21.15.17:0/3449218559 learned_addr learned my addr 172.21.15.17:0/3449218559 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5012800640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f501415dfa0 0x7f50142011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5011e00640 1 -- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f501406f090 msgr2=0x7f501409a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5011e00640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f501406f090 0x7f501409a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5011e00640 1 -- 172.21.15.17:0/3449218559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f501415dfa0 msgr2=0x7f50142011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5011e00640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f501415dfa0 0x7f50142011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5011e00640 1 -- 172.21.15.17:0/3449218559 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501409b360 con 0x7f501406a030 2024-09-10T23:16:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f5011e00640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 0x7f50142023a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5004000c10 tx=0x7f50040056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f500a000640 1 -- 172.21.15.17:0/3449218559 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50040b5040 con 0x7f501406a030 2024-09-10T23:16:01.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f500a000640 1 -- 172.21.15.17:0/3449218559 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5004004120 con 0x7f501406a030 2024-09-10T23:16:01.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.155+0000 7f500a000640 1 -- 172.21.15.17:0/3449218559 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50040044f0 con 0x7f501406a030 2024-09-10T23:16:01.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.159+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501409b640 con 0x7f501406a030 2024-09-10T23:16:01.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.159+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f501409af30 con 0x7f501406a030 2024-09-10T23:16:01.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.159+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501409b880 con 0x7f501406a030 2024-09-10T23:16:01.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.163+0000 7f500a000640 1 -- 172.21.15.17:0/3449218559 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f50040b8070 con 0x7f501406a030 2024-09-10T23:16:01.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.163+0000 7f500a000640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ff40725e0 0x7f4ff4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:01.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.163+0000 7f500a000640 1 -- 172.21.15.17:0/3449218559 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5004130740 con 0x7f501406a030 2024-09-10T23:16:01.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.163+0000 7f5011400640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ff40725e0 0x7f4ff4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:01.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.171+0000 7f5011400640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ff40725e0 0x7f4ff4074aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f501415d610 tx=0x7f5000007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.175+0000 7f500a000640 1 -- 172.21.15.17:0/3449218559 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5004018bb0 con 0x7f501406a030 2024-09-10T23:16:01.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.415+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa598161ee0 con 0x7fa57c003a60 2024-09-10T23:16:01.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.419+0000 7fa58e000640 1 -- 172.21.15.17:0/463153577 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa5880d5060 con 0x7fa57c003a60 2024-09-10T23:16:01.421 INFO:teuthology.orchestra.run.smithi017.stdout:55834574857 2024-09-10T23:16:01.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5780726b0 msgr2=0x7fa578074b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5780726b0 0x7fa578074b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa58400a470 tx=0x7fa58400a400 comp rx=0 tx=0).stop 2024-09-10T23:16:01.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57c003a60 msgr2=0x7fa5981f31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57c003a60 0x7fa5981f31d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa5880c0040 tx=0x7fa5880056a0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 shutdown_connections 2024-09-10T23:16:01.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5780726b0 0x7fa578074b70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5980b57f0 0x7fa598157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5980b5370 0x7fa598157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 --2- 172.21.15.17:0/463153577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57c003a60 0x7fa5981f31d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 >> 172.21.15.17:0/463153577 conn(0x7fa5980d1b10 msgr2=0x7fa5980b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 shutdown_connections 2024-09-10T23:16:01.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.427+0000 7fa597200640 1 -- 172.21.15.17:0/463153577 wait complete. 2024-09-10T23:16:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.443+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f52c40b4000 con 0x7f52c415a9a0 2024-09-10T23:16:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.443+0000 7f52c0c00640 1 -- 172.21.15.17:0/3342085738 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52b8065780 con 0x7f52c415a9a0 2024-09-10T23:16:01.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f70e0005590 con 0x7f710815ae20 2024-09-10T23:16:01.449 INFO:teuthology.orchestra.run.smithi017.stdout:64424509449 2024-09-10T23:16:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52a4072630 msgr2=0x7f52a4074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52a4072630 0x7f52a4074af0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f52b00af000 tx=0x7f52b001aeb0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c415a9a0 msgr2=0x7f52c40b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c415a9a0 0x7f52c40b0fb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52c415b700 tx=0x7f52b800ff00 comp rx=0 tx=0).stop 2024-09-10T23:16:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 shutdown_connections 2024-09-10T23:16:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52a4072630 0x7f52a4074af0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52c415b2c0 0x7f52c40b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52c415a9a0 0x7f52c40b0fb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 --2- 172.21.15.17:0/3342085738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52c4073c30 0x7f52c41563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 >> 172.21.15.17:0/3342085738 conn(0x7f52c40b2740 msgr2=0x7f52c40afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.447+0000 7f7104c00640 1 -- 172.21.15.17:0/3928529335 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7100021070 con 0x7f710815ae20 2024-09-10T23:16:01.452 INFO:teuthology.orchestra.run.smithi017.stdout:64424509448 2024-09-10T23:16:01.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.451+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 shutdown_connections 2024-09-10T23:16:01.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.451+0000 7f52ca400640 1 -- 172.21.15.17:0/3342085738 wait complete. 2024-09-10T23:16:01.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e4072a10 msgr2=0x7f70e4074ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e4072a10 0x7f70e4074ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70f8001750 tx=0x7f70f8009040 comp rx=0 tx=0).stop 2024-09-10T23:16:01.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710815ae20 msgr2=0x7f710813c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710815ae20 0x7f710813c7b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71000079c0 tx=0x7f7100007e80 comp rx=0 tx=0).stop 2024-09-10T23:16:01.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 shutdown_connections 2024-09-10T23:16:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e4072a10 0x7f70e4074ed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710815ae20 0x7f710813c7b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7108143790 0x7f7108153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 --2- 172.21.15.17:0/3928529335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710806f810 0x7f7108140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 >> 172.21.15.17:0/3928529335 conn(0x7f71080cfb20 msgr2=0x7f710806f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 shutdown_connections 2024-09-10T23:16:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.455+0000 7f710ec00640 1 -- 172.21.15.17:0/3928529335 wait complete. 2024-09-10T23:16:01.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-09-10T23:16:01.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509449 for osd.1 2024-09-10T23:16:01.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.487+0000 7f6a3be00640 1 -- 172.21.15.17:0/2101725367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6a24005860 con 0x7f6a480375e0 2024-09-10T23:16:01.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.0 2024-09-10T23:16:01.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a46a00640 1 -- 172.21.15.17:0/2101725367 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a400dcc70 con 0x7f6a480375e0 2024-09-10T23:16:01.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f20d8159940 con 0x7f20bc004810 2024-09-10T23:16:01.496 INFO:teuthology.orchestra.run.smithi017.stdout:64424509448 2024-09-10T23:16:01.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f20cea00640 1 -- 172.21.15.17:0/1147714597 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f20c805ded0 con 0x7f20bc004810 2024-09-10T23:16:01.497 INFO:teuthology.orchestra.run.smithi017.stdout:68719476744 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 -- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a30072620 msgr2=0x7f6a30074ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a30072620 0x7f6a30074ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0058d0 tx=0x7f6a3c005860 comp rx=0 tx=0).stop 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 -- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a480375e0 msgr2=0x7f6a4817b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a480375e0 0x7f6a4817b660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a400ac000 tx=0x7f6a400a6ab0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 -- 172.21.15.17:0/2101725367 shutdown_connections 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a30072620 0x7f6a30074ae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a480e41f0 0x7f6a48039c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a480e3e10 0x7f6a48050060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 --2- 172.21.15.17:0/2101725367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a480375e0 0x7f6a4817b660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 -- 172.21.15.17:0/2101725367 >> 172.21.15.17:0/2101725367 conn(0x7f6a48056720 msgr2=0x7f6a480e0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 -- 172.21.15.17:0/2101725367 shutdown_connections 2024-09-10T23:16:01.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.491+0000 7f6a3be00640 1 -- 172.21.15.17:0/2101725367 wait complete. 2024-09-10T23:16:01.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20b8072610 msgr2=0x7f20b8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20b8072610 0x7f20b8074ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20d8157300 tx=0x7f20bc005840 comp rx=0 tx=0).stop 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20bc004810 msgr2=0x7f20d814c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20bc004810 0x7f20d814c7e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c430 tx=0x7f20c800c8f0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 shutdown_connections 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20b8072610 0x7f20b8074ad0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20d8154100 0x7f20d8154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80cee30 0x7f20d80cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 --2- 172.21.15.17:0/1147714597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20bc004810 0x7f20d814c7e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 >> 172.21.15.17:0/1147714597 conn(0x7f20d80ccbf0 msgr2=0x7f20d815a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 shutdown_connections 2024-09-10T23:16:01.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.495+0000 7f20d7e00640 1 -- 172.21.15.17:0/1147714597 wait complete. 2024-09-10T23:16:01.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.503+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5014073ee0 con 0x7f501406a030 2024-09-10T23:16:01.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.507+0000 7f500a000640 1 -- 172.21.15.17:0/3449218559 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5004018bb0 con 0x7f501406a030 2024-09-10T23:16:01.508 INFO:teuthology.orchestra.run.smithi017.stdout:64424509449 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.507+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ff40725e0 msgr2=0x7f4ff4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.507+0000 7f5018e00640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ff40725e0 0x7f4ff4074aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f501415d610 tx=0x7f5000007e40 comp rx=0 tx=0).stop 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.507+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 msgr2=0x7f50142023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.507+0000 7f5018e00640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 0x7f50142023a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5004000c10 tx=0x7f50040056d0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.507+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 shutdown_connections 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.507+0000 7f5018e00640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ff40725e0 0x7f4ff4074aa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.507+0000 7f5018e00640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f501415dfa0 0x7f50142011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.511+0000 7f5018e00640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f501406f090 0x7f501409a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.511+0000 7f5018e00640 1 --2- 172.21.15.17:0/3449218559 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f501406a030 0x7f50142023a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.511+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 >> 172.21.15.17:0/3449218559 conn(0x7f501406cbc0 msgr2=0x7f5014074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.511+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 shutdown_connections 2024-09-10T23:16:01.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.511+0000 7f5018e00640 1 -- 172.21.15.17:0/3449218559 wait complete. 2024-09-10T23:16:01.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.515+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1220005860 con 0x7f1248073800 2024-09-10T23:16:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.515+0000 7f123e000640 1 -- 172.21.15.17:0/1732266127 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f123406fbf0 con 0x7f1248073800 2024-09-10T23:16:01.519 INFO:teuthology.orchestra.run.smithi017.stdout:64424509448 2024-09-10T23:16:01.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476744 for osd.6 2024-09-10T23:16:01.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.5 2024-09-10T23:16:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1228072630 msgr2=0x7f1228074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1228072630 0x7f1228074af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f12480b68e0 tx=0x7f1240009040 comp rx=0 tx=0).stop 2024-09-10T23:16:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1248073800 msgr2=0x7f124814cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1248073800 0x7f124814cfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f123400e7d0 tx=0x7f123400ec90 comp rx=0 tx=0).stop 2024-09-10T23:16:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 shutdown_connections 2024-09-10T23:16:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1228072630 0x7f1228074af0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12481519f0 0x7f1248154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f12480ceeb0 0x7f1248152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 --2- 172.21.15.17:0/1732266127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1248073800 0x7f124814cfb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 >> 172.21.15.17:0/1732266127 conn(0x7f12480d0bd0 msgr2=0x7f124814dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 shutdown_connections 2024-09-10T23:16:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.519+0000 7f124d200640 1 -- 172.21.15.17:0/1732266127 wait complete. 2024-09-10T23:16:01.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.527+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2498071310 con 0x7f24981fabb0 2024-09-10T23:16:01.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.527+0000 7f248ea00640 1 -- 172.21.15.17:0/1598497001 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f249005eb40 con 0x7f24981fabb0 2024-09-10T23:16:01.529 INFO:teuthology.orchestra.run.smithi017.stdout:64424509449 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2474072610 msgr2=0x7f2474074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2474072610 0x7f2474074ad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f24880012f0 tx=0x7f2488001750 comp rx=0 tx=0).stop 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24981fabb0 msgr2=0x7f24981fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24981fabb0 0x7f24981fb040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f24980b4890 tx=0x7f24900039d0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 shutdown_connections 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2474072610 0x7f2474074ad0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24981fabb0 0x7f24981fb040 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24982051f0 0x7f24982083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 --2- 172.21.15.17:0/1598497001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c004810 0x7f24980b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 >> 172.21.15.17:0/1598497001 conn(0x7f24980d1d90 msgr2=0x7f24980d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:01.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 shutdown_connections 2024-09-10T23:16:01.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:01.531+0000 7f249ca00640 1 -- 172.21.15.17:0/1598497001 wait complete. 2024-09-10T23:16:01.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509449 for osd.4 2024-09-10T23:16:01.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.2 2024-09-10T23:16:01.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509449 for osd.7 2024-09-10T23:16:02.463 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T23:16:02.491 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T23:16:02.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T23:16:02.523 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T23:16:02.523 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T23:16:02.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T23:16:02.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T23:16:02.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T23:16:02.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.667+0000 7fc93aa00640 1 -- 172.21.15.17:0/3025318443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93406e5a0 msgr2=0x7fc93415d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.667+0000 7fc93aa00640 1 --2- 172.21.15.17:0/3025318443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93406e5a0 0x7fc93415d980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00afd0 tx=0x7fc92c01c6a0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.667+0000 7fc93aa00640 1 -- 172.21.15.17:0/3025318443 shutdown_connections 2024-09-10T23:16:02.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.667+0000 7fc93aa00640 1 --2- 172.21.15.17:0/3025318443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93406e5a0 0x7fc93415d980 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.667+0000 7fc93aa00640 1 --2- 172.21.15.17:0/3025318443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc93415d180 0x7fc934073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.667+0000 7fc93aa00640 1 -- 172.21.15.17:0/3025318443 >> 172.21.15.17:0/3025318443 conn(0x7fc9340cf9c0 msgr2=0x7fc9340cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.667+0000 7fc93aa00640 1 -- 172.21.15.17:0/3025318443 shutdown_connections 2024-09-10T23:16:02.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.667+0000 7fc93aa00640 1 -- 172.21.15.17:0/3025318443 wait complete. 2024-09-10T23:16:02.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.671+0000 7fc93aa00640 1 Processor -- start 2024-09-10T23:16:02.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.671+0000 7fc93aa00640 1 -- start start 2024-09-10T23:16:02.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc93aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93406e5a0 0x7fc934154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc93aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415d180 0x7fc9341642a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc93aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc93415dec0 0x7fc9340cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc93aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc934167000 con 0x7fc93415d180 2024-09-10T23:16:02.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc93aa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc934166e80 con 0x7fc93406e5a0 2024-09-10T23:16:02.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc938a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc93415dec0 0x7fc9340cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc938a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc93415dec0 0x7fc9340cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56576/0 (socket says 172.21.15.17:56576) 2024-09-10T23:16:02.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc938a00640 1 -- 172.21.15.17:0/1285860164 learned_addr learned my addr 172.21.15.17:0/1285860164 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:02.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc933e00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93406e5a0 0x7fc934154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc934167180 con 0x7fc93415dec0 2024-09-10T23:16:02.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc938a00640 1 -- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93406e5a0 msgr2=0x7fc934154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc938a00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93406e5a0 0x7fc934154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc938a00640 1 -- 172.21.15.17:0/1285860164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415d180 msgr2=0x7fc9341642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc938a00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415d180 0x7fc9341642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc938a00640 1 -- 172.21.15.17:0/1285860164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc934154ed0 con 0x7fc93415dec0 2024-09-10T23:16:02.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.675+0000 7fc933e00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93406e5a0 0x7fc934154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:02.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.679+0000 7fc938a00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc93415dec0 0x7fc9340cdda0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc92400c4d0 tx=0x7fc92400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.679+0000 7fc92be00640 1 -- 172.21.15.17:0/1285860164 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924016020 con 0x7fc93415dec0 2024-09-10T23:16:02.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.679+0000 7fc92be00640 1 -- 172.21.15.17:0/1285860164 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc924012940 con 0x7fc93415dec0 2024-09-10T23:16:02.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.679+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9341551b0 con 0x7fc93415dec0 2024-09-10T23:16:02.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.679+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc934155770 con 0x7fc93415dec0 2024-09-10T23:16:02.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.679+0000 7fc92be00640 1 -- 172.21.15.17:0/1285860164 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924012d90 con 0x7fc93415dec0 2024-09-10T23:16:02.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.679+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9341531a0 con 0x7fc93415dec0 2024-09-10T23:16:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.683+0000 7fc92be00640 1 -- 172.21.15.17:0/1285860164 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc92401b400 con 0x7fc93415dec0 2024-09-10T23:16:02.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.687+0000 7fc92be00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9140726e0 0x7fc914074ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.687+0000 7fc92be00640 1 -- 172.21.15.17:0/1285860164 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc924093fd0 con 0x7fc93415dec0 2024-09-10T23:16:02.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.687+0000 7fc933e00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9140726e0 0x7fc914074ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.687+0000 7fc933e00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9140726e0 0x7fc914074ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9200103d0 tx=0x7fc92000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.687+0000 7fc92be00640 1 -- 172.21.15.17:0/1285860164 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc924020020 con 0x7fc93415dec0 2024-09-10T23:16:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.751+0000 7f01d7c00640 1 -- 172.21.15.17:0/1242739676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01d015ae20 msgr2=0x7f01d00b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.755+0000 7f01cf400640 1 -- 172.21.15.17:0/1242739676 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c80b2070 con 0x7f01d015ae20 2024-09-10T23:16:02.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.755+0000 7f01d7c00640 1 --2- 172.21.15.17:0/1242739676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01d015ae20 0x7f01d00b4830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009bc0 tx=0x7f01c801cb60 comp rx=0 tx=0).stop 2024-09-10T23:16:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.755+0000 7f01d7c00640 1 -- 172.21.15.17:0/1242739676 shutdown_connections 2024-09-10T23:16:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.755+0000 7f01d7c00640 1 --2- 172.21.15.17:0/1242739676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01d015ae20 0x7f01d00b4830 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.755+0000 7f01d7c00640 1 --2- 172.21.15.17:0/1242739676 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01d006f810 0x7f01d006e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.755+0000 7f01d7c00640 1 -- 172.21.15.17:0/1242739676 >> 172.21.15.17:0/1242739676 conn(0x7f01d00cfb20 msgr2=0x7f01d00cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.755+0000 7f01d7c00640 1 -- 172.21.15.17:0/1242739676 shutdown_connections 2024-09-10T23:16:02.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.755+0000 7f01d7c00640 1 -- 172.21.15.17:0/1242739676 wait complete. 2024-09-10T23:16:02.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f8a87e00640 1 -- 172.21.15.17:0/3892534930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a6c004c80 msgr2=0x7f8a6c005060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f8a87e00640 1 --2- 172.21.15.17:0/3892534930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a6c004c80 0x7f8a6c005060 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a74006ec0 tx=0x7f8a7401ce10 comp rx=0 tx=0).stop 2024-09-10T23:16:02.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f8a87400640 1 -- 172.21.15.17:0/3892534930 reap_dead start 2024-09-10T23:16:02.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f01d7c00640 1 Processor -- start 2024-09-10T23:16:02.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f8a87e00640 1 -- 172.21.15.17:0/3892534930 shutdown_connections 2024-09-10T23:16:02.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f8a87e00640 1 -- 172.21.15.17:0/3892534930 >> 172.21.15.17:0/3892534930 conn(0x7f8a880cfa00 msgr2=0x7f8a880cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f8a87e00640 1 -- 172.21.15.17:0/3892534930 shutdown_connections 2024-09-10T23:16:02.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f8a87e00640 1 -- 172.21.15.17:0/3892534930 wait complete. 2024-09-10T23:16:02.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f01d7c00640 1 -- start start 2024-09-10T23:16:02.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f01d7c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006f810 0x7f01d01424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f01d7c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01d0143790 0x7f01d015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f01d7c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01d015ae20 0x7f01d015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.759+0000 7f01d7c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f01d0164f20 con 0x7f01d0143790 2024-09-10T23:16:02.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01d7c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01d0164da0 con 0x7f01d006f810 2024-09-10T23:16:02.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01d7c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f01d01650a0 con 0x7f01d015ae20 2024-09-10T23:16:02.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f8a87e00640 1 Processor -- start 2024-09-10T23:16:02.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01d0143790 0x7f01d015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01d0143790 0x7f01d015bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34220/0 (socket says 172.21.15.17:34220) 2024-09-10T23:16:02.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01cfe00640 1 -- 172.21.15.17:0/3195634571 learned_addr learned my addr 172.21.15.17:0/3195634571 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:02.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01d5c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01d015ae20 0x7f01d015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f8a87e00640 1 -- start start 2024-09-10T23:16:02.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01d5c00640 1 -- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006f810 msgr2=0x7f01d01424d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:16:02.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01d5c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006f810 0x7f01d01424d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01d5c00640 1 -- 172.21.15.17:0/3195634571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01d0143790 msgr2=0x7f01d015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01d5c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01d0143790 0x7f01d015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01d5c00640 1 -- 172.21.15.17:0/3195634571 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d01fedd0 con 0x7f01d015ae20 2024-09-10T23:16:02.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.763+0000 7f01d5c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01d015ae20 0x7f01d015c2d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01d00752c0 tx=0x7f01c8005a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f01ccc00640 1 -- 172.21.15.17:0/3195634571 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c80b2040 con 0x7f01d015ae20 2024-09-10T23:16:02.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a87e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a6c004c80 0x7f8a881422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a87e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a88164e10 0x7f8a8815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a87e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a881634b0 0x7f8a880733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f01ccc00640 1 -- 172.21.15.17:0/3195634571 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01c8004130 con 0x7f01d015ae20 2024-09-10T23:16:02.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f01ccc00640 1 -- 172.21.15.17:0/3195634571 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8004500 con 0x7f01d015ae20 2024-09-10T23:16:02.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a87e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88165c40 con 0x7f8a6c004c80 2024-09-10T23:16:02.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a87e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88165ac0 con 0x7f8a88164e10 2024-09-10T23:16:02.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a87e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a88165dc0 con 0x7f8a881634b0 2024-09-10T23:16:02.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d01ff070 con 0x7f01d015ae20 2024-09-10T23:16:02.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a88164e10 0x7f8a8815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a88164e10 0x7f8a8815ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50212/0 (socket says 172.21.15.17:50212) 2024-09-10T23:16:02.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86000640 1 -- 172.21.15.17:0/3444545051 learned_addr learned my addr 172.21.15.17:0/3444545051 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:02.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a87400640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a881634b0 0x7f8a880733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86000640 1 -- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a881634b0 msgr2=0x7f8a880733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d01ff630 con 0x7f01d015ae20 2024-09-10T23:16:02.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86a00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a6c004c80 0x7f8a881422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86000640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a881634b0 0x7f8a880733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86000640 1 -- 172.21.15.17:0/3444545051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a6c004c80 msgr2=0x7f8a881422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86000640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a6c004c80 0x7f8a881422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86000640 1 -- 172.21.15.17:0/3444545051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a88163d70 con 0x7f8a88164e10 2024-09-10T23:16:02.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a87400640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a881634b0 0x7f8a880733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:02.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f8a86a00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a6c004c80 0x7f8a881422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:02.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.767+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a80052a0 con 0x7f01d015ae20 2024-09-10T23:16:02.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.771+0000 7f01ccc00640 1 -- 172.21.15.17:0/3195634571 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f01c80b5070 con 0x7f01d015ae20 2024-09-10T23:16:02.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.771+0000 7f8a86000640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a88164e10 0x7f8a8815ce70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a78011a80 tx=0x7f8a78011f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.771+0000 7f8a7f400640 1 -- 172.21.15.17:0/3444545051 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7800fe50 con 0x7f8a88164e10 2024-09-10T23:16:02.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.771+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a88164050 con 0x7f8a88164e10 2024-09-10T23:16:02.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.771+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a88164610 con 0x7f8a88164e10 2024-09-10T23:16:02.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.771+0000 7f8a7f400640 1 -- 172.21.15.17:0/3444545051 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a78004140 con 0x7f8a88164e10 2024-09-10T23:16:02.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.771+0000 7f8a7f400640 1 -- 172.21.15.17:0/3444545051 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78003600 con 0x7f8a88164e10 2024-09-10T23:16:02.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.775+0000 7f01ccc00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01b00726b0 0x7f01b0074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.775+0000 7f01ccc00640 1 -- 172.21.15.17:0/3195634571 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f01c812cd70 con 0x7f01d015ae20 2024-09-10T23:16:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.775+0000 7f01d5200640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01b00726b0 0x7f01b0074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.775+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a600052a0 con 0x7f8a88164e10 2024-09-10T23:16:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.775+0000 7f01d5200640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01b00726b0 0x7f01b0074b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01c0001580 tx=0x7f01c00078b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.775+0000 7f8a7f400640 1 -- 172.21.15.17:0/3444545051 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8a780037a0 con 0x7f8a88164e10 2024-09-10T23:16:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.779+0000 7f8a7f400640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a680726b0 0x7f8a68074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.779+0000 7f8a7f400640 1 -- 172.21.15.17:0/3444545051 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8a78094200 con 0x7f8a88164e10 2024-09-10T23:16:02.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.779+0000 7f01ccc00640 1 -- 172.21.15.17:0/3195634571 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f01c8131070 con 0x7f01d015ae20 2024-09-10T23:16:02.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.779+0000 7f8a86a00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a680726b0 0x7f8a68074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.779+0000 7f8a86a00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a680726b0 0x7f8a68074b70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a740ab000 tx=0x7f8a740a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.783+0000 7f8a7f400640 1 -- 172.21.15.17:0/3444545051 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8a7805ef30 con 0x7f8a88164e10 2024-09-10T23:16:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.803+0000 7f51d9600640 1 -- 172.21.15.17:0/2541312898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 msgr2=0x7f51d40b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.803+0000 7f51d9600640 1 --2- 172.21.15.17:0/2541312898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 0x7f51d40b4340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009840 tx=0x7f51c001c840 comp rx=0 tx=0).stop 2024-09-10T23:16:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.803+0000 7f51d9600640 1 -- 172.21.15.17:0/2541312898 shutdown_connections 2024-09-10T23:16:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.803+0000 7f51d9600640 1 --2- 172.21.15.17:0/2541312898 >> v2:172.21.15.77:3300/0 conn(0x7f51d4073620 0x7f51d40b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.803+0000 7f51d9600640 1 --2- 172.21.15.17:0/2541312898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 0x7f51d40b4340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.803+0000 7f51d9600640 1 -- 172.21.15.17:0/2541312898 >> 172.21.15.17:0/2541312898 conn(0x7f51d40cfb20 msgr2=0x7f51d40cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.811+0000 7f51d9600640 1 -- 172.21.15.17:0/2541312898 shutdown_connections 2024-09-10T23:16:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.811+0000 7f51d9600640 1 -- 172.21.15.17:0/2541312898 wait complete. 2024-09-10T23:16:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d9600640 1 Processor -- start 2024-09-10T23:16:02.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d9600640 1 -- start start 2024-09-10T23:16:02.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d9600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 0x7f51d4203d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d9600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51d4073240 0x7f51d41456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51d4073620 0x7f51d4154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d2a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 0x7f51d4203d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d2a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 0x7f51d4203d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56650/0 (socket says 172.21.15.17:56650) 2024-09-10T23:16:02.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d2000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51d4073240 0x7f51d41456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d2000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51d4073240 0x7f51d41456d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50250/0 (socket says 172.21.15.17:50250) 2024-09-10T23:16:02.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d2a00640 1 -- 172.21.15.17:0/1198406855 learned_addr learned my addr 172.21.15.17:0/1198406855 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:02.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f51d416f420 con 0x7f51d4073620 2024-09-10T23:16:02.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f51d415f1a0 con 0x7f51d4073240 2024-09-10T23:16:02.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f51d416f5a0 con 0x7f51d4070920 2024-09-10T23:16:02.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7fe5a8800640 1 -- 172.21.15.17:0/1615660645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a006ef80 msgr2=0x7fe5a006f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.815+0000 7fe5a8800640 1 --2- 172.21.15.17:0/1615660645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a006ef80 0x7fe5a006f410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe590009840 tx=0x7fe59001c840 comp rx=0 tx=0).stop 2024-09-10T23:16:02.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51d2a00640 1 -- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51d4073240 msgr2=0x7f51d41456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51d2a00640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51d4073240 0x7f51d41456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51d2a00640 1 -- 172.21.15.17:0/1198406855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51d4073620 msgr2=0x7f51d4154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51d2a00640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51d4073620 0x7f51d4154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51d2a00640 1 -- 172.21.15.17:0/1198406855 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d4145f90 con 0x7f51d4070920 2024-09-10T23:16:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51d2000640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51d4073240 0x7f51d41456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7fe5a8800640 1 -- 172.21.15.17:0/1615660645 shutdown_connections 2024-09-10T23:16:02.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51d2a00640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 0x7f51d4203d70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c450 tx=0x7f51c400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7fe5a8800640 1 --2- 172.21.15.17:0/1615660645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a006ef80 0x7fe5a006f410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7fe5a8800640 1 --2- 172.21.15.17:0/1615660645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5a015bb40 0x7fe5a00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7fe5a8800640 1 -- 172.21.15.17:0/1615660645 >> 172.21.15.17:0/1615660645 conn(0x7fe5a00b1730 msgr2=0x7fe5a00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51caa00640 1 -- 172.21.15.17:0/1198406855 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4012830 con 0x7f51d4070920 2024-09-10T23:16:02.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51caa00640 1 -- 172.21.15.17:0/1198406855 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51c4017070 con 0x7f51d4070920 2024-09-10T23:16:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7fe5a8800640 1 -- 172.21.15.17:0/1615660645 shutdown_connections 2024-09-10T23:16:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51caa00640 1 -- 172.21.15.17:0/1198406855 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4012d60 con 0x7f51d4070920 2024-09-10T23:16:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7fe5a8800640 1 -- 172.21.15.17:0/1615660645 wait complete. 2024-09-10T23:16:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d4146270 con 0x7f51d4070920 2024-09-10T23:16:02.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.819+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d4146830 con 0x7f51d4070920 2024-09-10T23:16:02.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7f51caa00640 1 -- 172.21.15.17:0/1198406855 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f51c401c460 con 0x7f51d4070920 2024-09-10T23:16:02.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d406ee20 con 0x7f51d4070920 2024-09-10T23:16:02.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7fe5a8800640 1 Processor -- start 2024-09-10T23:16:02.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7fe5a8800640 1 -- start start 2024-09-10T23:16:02.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7f51caa00640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51b40726e0 0x7f51b4074ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7fe5a8800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a006ef80 0x7fe5a00cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7fe5a8800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a0070090 0x7fe5a013b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7fe5a8800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5a015bb40 0x7fe5a00ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7fe5a8800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a015a390 con 0x7fe5a006ef80 2024-09-10T23:16:02.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7fe5a8800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a015a210 con 0x7fe5a0070090 2024-09-10T23:16:02.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.823+0000 7fe5a8800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a015a510 con 0x7fe5a015bb40 2024-09-10T23:16:02.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7f51caa00640 1 -- 172.21.15.17:0/1198406855 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f51c4093350 con 0x7f51d4070920 2024-09-10T23:16:02.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7f51d2000640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51b40726e0 0x7f51b4074ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a0070090 0x7fe5a013b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a0070090 0x7fe5a013b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50262/0 (socket says 172.21.15.17:50262) 2024-09-10T23:16:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5400640 1 -- 172.21.15.17:0/1909070803 learned_addr learned my addr 172.21.15.17:0/1909070803 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5e00640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a006ef80 0x7fe5a00cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a6800640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5a015bb40 0x7fe5a00ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5400640 1 -- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5a015bb40 msgr2=0x7fe5a00ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5400640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5a015bb40 0x7fe5a00ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5400640 1 -- 172.21.15.17:0/1909070803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a006ef80 msgr2=0x7fe5a00cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5400640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a006ef80 0x7fe5a00cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5400640 1 -- 172.21.15.17:0/1909070803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a00b4d60 con 0x7fe5a0070090 2024-09-10T23:16:02.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a5400640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a0070090 0x7fe5a013b4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00eaa0 tx=0x7fe59c00ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe59a000640 1 -- 172.21.15.17:0/1909070803 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00ce10 con 0x7fe5a0070090 2024-09-10T23:16:02.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe59a000640 1 -- 172.21.15.17:0/1909070803 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe59c011470 con 0x7fe5a0070090 2024-09-10T23:16:02.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe59a000640 1 -- 172.21.15.17:0/1909070803 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0118a0 con 0x7fe5a0070090 2024-09-10T23:16:02.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a8800640 1 -- 172.21.15.17:0/1909070803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a013ba30 con 0x7fe5a0070090 2024-09-10T23:16:02.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7fe5a8800640 1 -- 172.21.15.17:0/1909070803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a00cda00 con 0x7fe5a0070090 2024-09-10T23:16:02.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.827+0000 7f51d2000640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51b40726e0 0x7f51b4074ba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f51c00af000 tx=0x7f51c001b080 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.831+0000 7f51caa00640 1 -- 172.21.15.17:0/1198406855 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f51c405e6d0 con 0x7f51d4070920 2024-09-10T23:16:02.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.831+0000 7fe59a000640 1 -- 172.21.15.17:0/1909070803 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe59c00f040 con 0x7fe5a0070090 2024-09-10T23:16:02.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.831+0000 7fe59a000640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe5840725e0 0x7fe584074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.831+0000 7fe59a000640 1 -- 172.21.15.17:0/1909070803 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe59c093ed0 con 0x7fe5a0070090 2024-09-10T23:16:02.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fe58f400640 1 -- 172.21.15.17:0/1909070803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a015aa60 con 0x7fe5a0070090 2024-09-10T23:16:02.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fe5a5e00640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe5840725e0 0x7fe584074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 -- 172.21.15.17:0/4036667313 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb44c0705d0 msgr2=0x7fb44c06ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 --2- 172.21.15.17:0/4036667313 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb44c0705d0 0x7fb44c06ef80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009900 tx=0x7fb43c01c890 comp rx=0 tx=0).stop 2024-09-10T23:16:02.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 -- 172.21.15.17:0/4036667313 shutdown_connections 2024-09-10T23:16:02.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 --2- 172.21.15.17:0/4036667313 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb44c0705d0 0x7fb44c06ef80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 --2- 172.21.15.17:0/4036667313 >> v2:172.21.15.77:3300/0 conn(0x7fb44c06e910 0x7fb44c070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 -- 172.21.15.17:0/4036667313 >> 172.21.15.17:0/4036667313 conn(0x7fb44c0b1730 msgr2=0x7fb44c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 -- 172.21.15.17:0/4036667313 shutdown_connections 2024-09-10T23:16:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 -- 172.21.15.17:0/4036667313 wait complete. 2024-09-10T23:16:02.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fe5a5e00640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe5840725e0 0x7fe584074aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe594000f70 tx=0x7fe594009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 Processor -- start 2024-09-10T23:16:02.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.835+0000 7fb452000640 1 -- start start 2024-09-10T23:16:02.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7f305e000640 1 -- 172.21.15.17:0/1522702551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3058072c30 msgr2=0x7f30580ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7f305e000640 1 --2- 172.21.15.17:0/1522702551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3058072c30 0x7f30580ceac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3050009bc0 tx=0x7f305001cba0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7f305e000640 1 -- 172.21.15.17:0/1522702551 shutdown_connections 2024-09-10T23:16:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7f305e000640 1 --2- 172.21.15.17:0/1522702551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3058072c30 0x7f30580ceac0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7f305e000640 1 --2- 172.21.15.17:0/1522702551 >> v2:172.21.15.17:3300/0 conn(0x7f30580d06b0 0x7f30580726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7f305e000640 1 -- 172.21.15.17:0/1522702551 >> 172.21.15.17:0/1522702551 conn(0x7f30580cfb20 msgr2=0x7f30580cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7f305e000640 1 -- 172.21.15.17:0/1522702551 shutdown_connections 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb452000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb44c06e910 0x7fb44c14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb452000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb44c0705d0 0x7fb44c1f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb452000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb44c073b80 0x7fb44c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb452000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c0b3de0 con 0x7fb44c073b80 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb452000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c0b3c60 con 0x7fb44c0705d0 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb452000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb44c0b3f60 con 0x7fb44c06e910 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb44c0705d0 0x7fb44c1f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb44c0705d0 0x7fb44c1f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50278/0 (socket says 172.21.15.17:50278) 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44aa00640 1 -- 172.21.15.17:0/643051549 learned_addr learned my addr 172.21.15.17:0/643051549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:02.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44be00640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb44c073b80 0x7fb44c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fe59a000640 1 -- 172.21.15.17:0/1909070803 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe59c016030 con 0x7fe5a0070090 2024-09-10T23:16:02.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7f305e000640 1 -- 172.21.15.17:0/1522702551 wait complete. 2024-09-10T23:16:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f305e000640 1 Processor -- start 2024-09-10T23:16:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44be00640 1 -- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb44c06e910 msgr2=0x7fb44c14b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44be00640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb44c06e910 0x7fb44c14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44be00640 1 -- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb44c0705d0 msgr2=0x7fb44c1f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44be00640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb44c0705d0 0x7fb44c1f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44be00640 1 -- 172.21.15.17:0/643051549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c1486d0 con 0x7fb44c073b80 2024-09-10T23:16:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.839+0000 7fb44be00640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb44c073b80 0x7fb44c15e500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0ac000 tx=0x7fb43c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7fb443400640 1 -- 172.21.15.17:0/643051549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0b2040 con 0x7fb44c073b80 2024-09-10T23:16:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7fb443400640 1 -- 172.21.15.17:0/643051549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb43c0043b0 con 0x7fb44c073b80 2024-09-10T23:16:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7fb443400640 1 -- 172.21.15.17:0/643051549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c003860 con 0x7fb44c073b80 2024-09-10T23:16:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f305e000640 1 -- start start 2024-09-10T23:16:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44c1489b0 con 0x7fb44c073b80 2024-09-10T23:16:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44c148f70 con 0x7fb44c073b80 2024-09-10T23:16:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f305e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3058072c30 0x7f30581507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f305e000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d06b0 0x7f30581fbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f305e000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f305815bbb0 0x7f305815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f305e000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3058169280 con 0x7f3058072c30 2024-09-10T23:16:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f305e000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3058169100 con 0x7f305815bbb0 2024-09-10T23:16:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f305e000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3058169400 con 0x7f30580d06b0 2024-09-10T23:16:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f3057e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f305815bbb0 0x7f305815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f3057e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f305815bbb0 0x7f305815ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50282/0 (socket says 172.21.15.17:50282) 2024-09-10T23:16:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7f3057e00640 1 -- 172.21.15.17:0/2409309329 learned_addr learned my addr 172.21.15.17:0/2409309329 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f3057e00640 1 -- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d06b0 msgr2=0x7f30581fbb40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:16:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f3057e00640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d06b0 0x7f30581fbb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f3057e00640 1 -- 172.21.15.17:0/2409309329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3058072c30 msgr2=0x7f30581507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f3057e00640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3058072c30 0x7f30581507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f3057e00640 1 -- 172.21.15.17:0/2409309329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30581fc080 con 0x7f305815bbb0 2024-09-10T23:16:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f3057e00640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f305815bbb0 0x7f305815ecb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f305001a7d0 tx=0x7f3050003ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.843+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4240052a0 con 0x7fb44c073b80 2024-09-10T23:16:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f304f400640 1 -- 172.21.15.17:0/2409309329 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30500b2040 con 0x7f305815bbb0 2024-09-10T23:16:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f304f400640 1 -- 172.21.15.17:0/2409309329 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3050004d40 con 0x7f305815bbb0 2024-09-10T23:16:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f304f400640 1 -- 172.21.15.17:0/2409309329 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3050005260 con 0x7f305815bbb0 2024-09-10T23:16:02.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3058150dd0 con 0x7f305815bbb0 2024-09-10T23:16:02.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3058151390 con 0x7f305815bbb0 2024-09-10T23:16:02.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.847+0000 7fb443400640 1 -- 172.21.15.17:0/643051549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb43c0b5070 con 0x7fb44c073b80 2024-09-10T23:16:02.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.851+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30580ceac0 con 0x7f305815bbb0 2024-09-10T23:16:02.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.851+0000 7fb443400640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb42c072610 0x7fb42c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.851+0000 7fb443400640 1 -- 172.21.15.17:0/643051549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb43c12d2e0 con 0x7fb44c073b80 2024-09-10T23:16:02.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.851+0000 7fb44b400640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb42c072610 0x7fb42c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.851+0000 7f304f400640 1 -- 172.21.15.17:0/2409309329 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f30500b5070 con 0x7f305815bbb0 2024-09-10T23:16:02.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.855+0000 7f304f400640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30340725e0 0x7f3034074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.855+0000 7f304f400640 1 -- 172.21.15.17:0/2409309329 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f305012cff0 con 0x7f305815bbb0 2024-09-10T23:16:02.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.855+0000 7fb44b400640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb42c072610 0x7fb42c074ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb444007fd0 tx=0x7fb444007d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.855+0000 7f3057400640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30340725e0 0x7f3034074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.855+0000 7f3057400640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30340725e0 0x7f3034074aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3040001530 tx=0x7f3040007a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.859+0000 7fb443400640 1 -- 172.21.15.17:0/643051549 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb43c016510 con 0x7fb44c073b80 2024-09-10T23:16:02.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.863+0000 7f304f400640 1 -- 172.21.15.17:0/2409309329 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f30581fc080 con 0x7f305815bbb0 2024-09-10T23:16:02.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.895+0000 7f5126e00640 1 -- 172.21.15.17:0/1679634899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5120072c50 msgr2=0x7f51200707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.895+0000 7f5126e00640 1 --2- 172.21.15.17:0/1679634899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5120072c50 0x7f51200707b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5118009bc0 tx=0x7f511801cba0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.895+0000 7f5126e00640 1 -- 172.21.15.17:0/1679634899 shutdown_connections 2024-09-10T23:16:02.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.895+0000 7f5126e00640 1 --2- 172.21.15.17:0/1679634899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5120072c50 0x7f51200707b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.895+0000 7f5126e00640 1 -- 172.21.15.17:0/1679634899 >> 172.21.15.17:0/1679634899 conn(0x7f51200cf9a0 msgr2=0x7f51200cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:02.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.895+0000 7f5126e00640 1 -- 172.21.15.17:0/1679634899 shutdown_connections 2024-09-10T23:16:02.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.895+0000 7f5126e00640 1 -- 172.21.15.17:0/1679634899 wait complete. 2024-09-10T23:16:02.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5126e00640 1 Processor -- start 2024-09-10T23:16:02.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5126e00640 1 -- start start 2024-09-10T23:16:02.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5126e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5120072c50 0x7f512015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5126e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5120073cb0 0x7f5120130af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5126e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512015bac0 0x7f512014f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5126e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5120169c40 con 0x7f512015bac0 2024-09-10T23:16:02.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5126e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5120169ac0 con 0x7f5120072c50 2024-09-10T23:16:02.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5126e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5120169dc0 con 0x7f5120073cb0 2024-09-10T23:16:02.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5125a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5120072c50 0x7f512015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5125a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5120072c50 0x7f512015aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50296/0 (socket says 172.21.15.17:50296) 2024-09-10T23:16:02.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5125a00640 1 -- 172.21.15.17:0/3784083360 learned_addr learned my addr 172.21.15.17:0/3784083360 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:02.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5125000640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5120073cb0 0x7f5120130af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.899+0000 7f5126400640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512015bac0 0x7f512014f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f5125a00640 1 -- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5120073cb0 msgr2=0x7f5120130af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f5125a00640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5120073cb0 0x7f5120130af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f5125a00640 1 -- 172.21.15.17:0/3784083360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512015bac0 msgr2=0x7f512014f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f5125a00640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512015bac0 0x7f512014f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f5125a00640 1 -- 172.21.15.17:0/3784083360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512014e400 con 0x7f5120072c50 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f5125a00640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5120072c50 0x7f512015aae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f511400b410 tx=0x7f511400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f511d600640 1 -- 172.21.15.17:0/3784083360 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511401d070 con 0x7f5120072c50 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f511d600640 1 -- 172.21.15.17:0/3784083360 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5114010b80 con 0x7f5120072c50 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f511d600640 1 -- 172.21.15.17:0/3784083360 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114018440 con 0x7f5120072c50 2024-09-10T23:16:02.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f5126e00640 1 -- 172.21.15.17:0/3784083360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512014e6e0 con 0x7f5120072c50 2024-09-10T23:16:02.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.903+0000 7f5126e00640 1 -- 172.21.15.17:0/3784083360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512014eca0 con 0x7f5120072c50 2024-09-10T23:16:02.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.911+0000 7f511d600640 1 -- 172.21.15.17:0/3784083360 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f51140213b0 con 0x7f5120072c50 2024-09-10T23:16:02.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.911+0000 7f5112a00640 1 -- 172.21.15.17:0/3784083360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f40052a0 con 0x7f5120072c50 2024-09-10T23:16:02.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.911+0000 7f511d600640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5100072630 0x7f5100074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:02.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.911+0000 7f511d600640 1 -- 172.21.15.17:0/3784083360 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5114097040 con 0x7f5120072c50 2024-09-10T23:16:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.915+0000 7f5125000640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5100072630 0x7f5100074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.915+0000 7f511d600640 1 -- 172.21.15.17:0/3784083360 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f51140625d0 con 0x7f5120072c50 2024-09-10T23:16:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:02.919+0000 7f5125000640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5100072630 0x7f5100074af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5120153b90 tx=0x7f510c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.067+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc934152ec0 con 0x7fc93415dec0 2024-09-10T23:16:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.067+0000 7fc92be00640 1 -- 172.21.15.17:0/1285860164 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc92405f2c0 con 0x7fc93415dec0 2024-09-10T23:16:03.070 INFO:teuthology.orchestra.run.smithi017.stdout:55834574858 2024-09-10T23:16:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.071+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9140726e0 msgr2=0x7fc914074ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.071+0000 7fc93aa00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9140726e0 0x7fc914074ba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9200103d0 tx=0x7fc92000b390 comp rx=0 tx=0).stop 2024-09-10T23:16:03.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.071+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc93415dec0 msgr2=0x7fc9340cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.071+0000 7fc93aa00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc93415dec0 0x7fc9340cdda0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc92400c4d0 tx=0x7fc92400c990 comp rx=0 tx=0).stop 2024-09-10T23:16:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.075+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 shutdown_connections 2024-09-10T23:16:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.075+0000 7fc93aa00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9140726e0 0x7fc914074ba0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.075+0000 7fc93aa00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc93415dec0 0x7fc9340cdda0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.075+0000 7fc93aa00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415d180 0x7fc9341642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.075+0000 7fc93aa00640 1 --2- 172.21.15.17:0/1285860164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc93406e5a0 0x7fc934154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.075+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 >> 172.21.15.17:0/1285860164 conn(0x7fc9340cf9c0 msgr2=0x7fc934150e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.075+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 shutdown_connections 2024-09-10T23:16:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.075+0000 7fc93aa00640 1 -- 172.21.15.17:0/1285860164 wait complete. 2024-09-10T23:16:03.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-09-10T23:16:03.107 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:03.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.127+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8a60005590 con 0x7f8a88164e10 2024-09-10T23:16:03.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a7f400640 1 -- 172.21.15.17:0/3444545051 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a78063960 con 0x7f8a88164e10 2024-09-10T23:16:03.133 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-10T23:16:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a680726b0 msgr2=0x7f8a68074b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a680726b0 0x7f8a68074b70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a740ab000 tx=0x7f8a740a7040 comp rx=0 tx=0).stop 2024-09-10T23:16:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a88164e10 msgr2=0x7f8a8815ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a88164e10 0x7f8a8815ce70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8a78011a80 tx=0x7f8a78011f40 comp rx=0 tx=0).stop 2024-09-10T23:16:03.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 shutdown_connections 2024-09-10T23:16:03.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a680726b0 0x7f8a68074b70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a881634b0 0x7f8a880733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a88164e10 0x7f8a8815ce70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 --2- 172.21.15.17:0/3444545051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a6c004c80 0x7f8a881422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 >> 172.21.15.17:0/3444545051 conn(0x7f8a880cfa00 msgr2=0x7f8a880ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 shutdown_connections 2024-09-10T23:16:03.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.131+0000 7f8a87e00640 1 -- 172.21.15.17:0/3444545051 wait complete. 2024-09-10T23:16:03.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2024-09-10T23:16:03.160 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.159+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f01a8005590 con 0x7f01d015ae20 2024-09-10T23:16:03.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.163+0000 7f01ccc00640 1 -- 172.21.15.17:0/3195634571 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f01c80167d0 con 0x7f01d015ae20 2024-09-10T23:16:03.168 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-10T23:16:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01b00726b0 msgr2=0x7f01b0074b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01b00726b0 0x7f01b0074b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01c0001580 tx=0x7f01c00078b0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01d015ae20 msgr2=0x7f01d015c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01d015ae20 0x7f01d015c2d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f01d00752c0 tx=0x7f01c8005a60 comp rx=0 tx=0).stop 2024-09-10T23:16:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 shutdown_connections 2024-09-10T23:16:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01b00726b0 0x7f01b0074b70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01d015ae20 0x7f01d015c2d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01d0143790 0x7f01d015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 --2- 172.21.15.17:0/3195634571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d006f810 0x7f01d01424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 >> 172.21.15.17:0/3195634571 conn(0x7f01d00cfb20 msgr2=0x7f01d006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 shutdown_connections 2024-09-10T23:16:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.167+0000 7f01d7c00640 1 -- 172.21.15.17:0/3195634571 wait complete. 2024-09-10T23:16:03.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-09-10T23:16:03.194 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.191+0000 7fe58f400640 1 -- 172.21.15.17:0/1909070803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe5a00ce960 con 0x7fe5a0070090 2024-09-10T23:16:03.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.191+0000 7fe59a000640 1 -- 172.21.15.17:0/1909070803 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe59c05f260 con 0x7fe5a0070090 2024-09-10T23:16:03.196 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-10T23:16:03.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 -- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe5840725e0 msgr2=0x7fe584074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe5840725e0 0x7fe584074aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe594000f70 tx=0x7fe594009040 comp rx=0 tx=0).stop 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 -- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a0070090 msgr2=0x7fe5a013b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a0070090 0x7fe5a013b4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00eaa0 tx=0x7fe59c00ef60 comp rx=0 tx=0).stop 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 -- 172.21.15.17:0/1909070803 shutdown_connections 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe5840725e0 0x7fe584074aa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5a015bb40 0x7fe5a00ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a0070090 0x7fe5a013b4f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 --2- 172.21.15.17:0/1909070803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5a006ef80 0x7fe5a00cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 -- 172.21.15.17:0/1909070803 >> 172.21.15.17:0/1909070803 conn(0x7fe5a00b1730 msgr2=0x7fe5a00b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 -- 172.21.15.17:0/1909070803 shutdown_connections 2024-09-10T23:16:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.195+0000 7fe58f400640 1 -- 172.21.15.17:0/1909070803 wait complete. 2024-09-10T23:16:03.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.199+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f51d40b35d0 con 0x7f51d4070920 2024-09-10T23:16:03.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.199+0000 7f51caa00640 1 -- 172.21.15.17:0/1198406855 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f51c405dfd0 con 0x7f51d4070920 2024-09-10T23:16:03.203 INFO:teuthology.orchestra.run.smithi017.stdout:68719476746 2024-09-10T23:16:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51b40726e0 msgr2=0x7f51b4074ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51b40726e0 0x7f51b4074ba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f51c00af000 tx=0x7f51c001b080 comp rx=0 tx=0).stop 2024-09-10T23:16:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 msgr2=0x7f51d4203d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 0x7f51d4203d70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c450 tx=0x7f51c400c910 comp rx=0 tx=0).stop 2024-09-10T23:16:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 shutdown_connections 2024-09-10T23:16:03.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51b40726e0 0x7f51b4074ba0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51d4073620 0x7f51d4154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51d4073240 0x7f51d41456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 --2- 172.21.15.17:0/1198406855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51d4070920 0x7f51d4203d70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 >> 172.21.15.17:0/1198406855 conn(0x7f51d40cfb20 msgr2=0x7f51d40b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 shutdown_connections 2024-09-10T23:16:03.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.203+0000 7f51d9600640 1 -- 172.21.15.17:0/1198406855 wait complete. 2024-09-10T23:16:03.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-09-10T23:16:03.222 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:03.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476746 for osd.6 2024-09-10T23:16:03.226 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:03.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.231+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3058074e90 con 0x7f305815bbb0 2024-09-10T23:16:03.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.231+0000 7f304f400640 1 -- 172.21.15.17:0/2409309329 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3050016790 con 0x7f305815bbb0 2024-09-10T23:16:03.236 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30340725e0 msgr2=0x7f3034074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30340725e0 0x7f3034074aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3040001530 tx=0x7f3040007a40 comp rx=0 tx=0).stop 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f305815bbb0 msgr2=0x7f305815ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f305815bbb0 0x7f305815ecb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f305001a7d0 tx=0x7f3050003ae0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 shutdown_connections 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30340725e0 0x7f3034074aa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f305815bbb0 0x7f305815ecb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f30580d06b0 0x7f30581fbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 --2- 172.21.15.17:0/2409309329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3058072c30 0x7f30581507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 >> 172.21.15.17:0/2409309329 conn(0x7f30580cfb20 msgr2=0x7f30580ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 shutdown_connections 2024-09-10T23:16:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.235+0000 7f305e000640 1 -- 172.21.15.17:0/2409309329 wait complete. 2024-09-10T23:16:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb424005590 con 0x7fb44c073b80 2024-09-10T23:16:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb443400640 1 -- 172.21.15.17:0/643051549 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb43c016510 con 0x7fb44c073b80 2024-09-10T23:16:03.241 INFO:teuthology.orchestra.run.smithi017.stdout:64424509450 2024-09-10T23:16:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb42c072610 msgr2=0x7fb42c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb42c072610 0x7fb42c074ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb444007fd0 tx=0x7fb444007d40 comp rx=0 tx=0).stop 2024-09-10T23:16:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb44c073b80 msgr2=0x7fb44c15e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb44c073b80 0x7fb44c15e500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0ac000 tx=0x7fb43c004040 comp rx=0 tx=0).stop 2024-09-10T23:16:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 shutdown_connections 2024-09-10T23:16:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb42c072610 0x7fb42c074ad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb44c073b80 0x7fb44c15e500 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb44c0705d0 0x7fb44c1f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 --2- 172.21.15.17:0/643051549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb44c06e910 0x7fb44c14b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.239+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 >> 172.21.15.17:0/643051549 conn(0x7fb44c0b1730 msgr2=0x7fb44c0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 shutdown_connections 2024-09-10T23:16:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7fb452000640 1 -- 172.21.15.17:0/643051549 wait complete. 2024-09-10T23:16:03.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 -- 172.21.15.17:0/3784083360 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f50f4005860 con 0x7f5120072c50 2024-09-10T23:16:03.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f511d600640 1 -- 172.21.15.17:0/3784083360 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5114061ed0 con 0x7f5120072c50 2024-09-10T23:16:03.247 INFO:teuthology.orchestra.run.smithi017.stdout:64424509451 2024-09-10T23:16:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 -- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5100072630 msgr2=0x7f5100074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5100072630 0x7f5100074af0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5120153b90 tx=0x7f510c009040 comp rx=0 tx=0).stop 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 -- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5120072c50 msgr2=0x7f512015aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5120072c50 0x7f512015aae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f511400b410 tx=0x7f511400b8d0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 -- 172.21.15.17:0/3784083360 shutdown_connections 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5100072630 0x7f5100074af0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f512015bac0 0x7f512014f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5120073cb0 0x7f5120130af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 --2- 172.21.15.17:0/3784083360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5120072c50 0x7f512015aae0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.243+0000 7f5112a00640 1 -- 172.21.15.17:0/3784083360 >> 172.21.15.17:0/3784083360 conn(0x7f51200cf9a0 msgr2=0x7f51200b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.247+0000 7f5112a00640 1 -- 172.21.15.17:0/3784083360 shutdown_connections 2024-09-10T23:16:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.247+0000 7f5112a00640 1 -- 172.21.15.17:0/3784083360 wait complete. 2024-09-10T23:16:03.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.7 2024-09-10T23:16:03.270 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:03.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.4 2024-09-10T23:16:03.271 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:03.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-09-10T23:16:03.276 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:03.276 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:16:03.277 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:16:03.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.463+0000 7f22abc00640 1 -- 172.21.15.17:0/2247025789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a40d1830 msgr2=0x7f22a40ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.463+0000 7f22abc00640 1 --2- 172.21.15.17:0/2247025789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a40d1830 0x7f22a40ccdb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f22a40c5320 tx=0x7f229c01cd60 comp rx=0 tx=0).stop 2024-09-10T23:16:03.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.463+0000 7f22abc00640 1 -- 172.21.15.17:0/2247025789 shutdown_connections 2024-09-10T23:16:03.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.463+0000 7f22abc00640 1 --2- 172.21.15.17:0/2247025789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a40d1830 0x7f22a40ccdb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.463+0000 7f22abc00640 1 --2- 172.21.15.17:0/2247025789 >> v2:172.21.15.77:3300/0 conn(0x7f22a415f770 0x7f22a40cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.463+0000 7f22abc00640 1 -- 172.21.15.17:0/2247025789 >> 172.21.15.17:0/2247025789 conn(0x7f22a40d1d60 msgr2=0x7f22a40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.463+0000 7f22abc00640 1 -- 172.21.15.17:0/2247025789 shutdown_connections 2024-09-10T23:16:03.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.463+0000 7f22abc00640 1 -- 172.21.15.17:0/2247025789 wait complete. 2024-09-10T23:16:03.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 Processor -- start 2024-09-10T23:16:03.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 -- start start 2024-09-10T23:16:03.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a4070ad0 0x7f22a41508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22a40d1830 0x7f22a40b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a415f770 0x7f22a4150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41693e0 con 0x7f22a4070ad0 2024-09-10T23:16:03.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22a4169260 con 0x7f22a415f770 2024-09-10T23:16:03.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f22a4169560 con 0x7f22a40d1830 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a4070ad0 0x7f22a41508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a4070ad0 0x7f22a41508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34304/0 (socket says 172.21.15.17:34304) 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9200640 1 -- 172.21.15.17:0/4174308609 learned_addr learned my addr 172.21.15.17:0/4174308609 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9c00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a415f770 0x7f22a4150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a3e00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22a40d1830 0x7f22a40b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9200640 1 -- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22a40d1830 msgr2=0x7f22a40b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9200640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22a40d1830 0x7f22a40b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9200640 1 -- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a415f770 msgr2=0x7f22a4150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9200640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a415f770 0x7f22a4150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9200640 1 -- 172.21.15.17:0/4174308609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a40b25b0 con 0x7f22a4070ad0 2024-09-10T23:16:03.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a9200640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a4070ad0 0x7f22a41508f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f229800c490 tx=0x7f2298001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:03.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a0c00640 1 -- 172.21.15.17:0/4174308609 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298017070 con 0x7f22a4070ad0 2024-09-10T23:16:03.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a0c00640 1 -- 172.21.15.17:0/4174308609 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2298003600 con 0x7f22a4070ad0 2024-09-10T23:16:03.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a40b5420 con 0x7f22a4070ad0 2024-09-10T23:16:03.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22a0c00640 1 -- 172.21.15.17:0/4174308609 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298003a90 con 0x7f22a4070ad0 2024-09-10T23:16:03.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.467+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a40b59e0 con 0x7f22a4070ad0 2024-09-10T23:16:03.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.471+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a415f060 con 0x7f22a4070ad0 2024-09-10T23:16:03.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.471+0000 7f22a0c00640 1 -- 172.21.15.17:0/4174308609 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2298003c30 con 0x7f22a4070ad0 2024-09-10T23:16:03.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.471+0000 7f22a0c00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22840725e0 0x7f2284074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.471+0000 7f22a0c00640 1 -- 172.21.15.17:0/4174308609 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2298092c50 con 0x7f22a4070ad0 2024-09-10T23:16:03.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.471+0000 7f22a3e00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22840725e0 0x7f2284074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.471+0000 7f22a3e00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22840725e0 0x7f2284074aa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f22a4074ab0 tx=0x7f2290006f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:03.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.475+0000 7f22a0c00640 1 -- 172.21.15.17:0/4174308609 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f229805d900 con 0x7f22a4070ad0 2024-09-10T23:16:03.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.647+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22a4069e10 con 0x7f22840725e0 2024-09-10T23:16:03.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.651+0000 7f22a0c00640 1 -- 172.21.15.17:0/4174308609 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f2290009540 con 0x7f22840725e0 2024-09-10T23:16:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:03.660 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:16:03.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22840725e0 msgr2=0x7f2284074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22840725e0 0x7f2284074aa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f22a4074ab0 tx=0x7f2290006f90 comp rx=0 tx=0).stop 2024-09-10T23:16:03.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a4070ad0 msgr2=0x7f22a41508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a4070ad0 0x7f22a41508f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f229800c490 tx=0x7f2298001e80 comp rx=0 tx=0).stop 2024-09-10T23:16:03.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 shutdown_connections 2024-09-10T23:16:03.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22840725e0 0x7f2284074aa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a415f770 0x7f22a4150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22a40d1830 0x7f22a40b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 --2- 172.21.15.17:0/4174308609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22a4070ad0 0x7f22a41508f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 >> 172.21.15.17:0/4174308609 conn(0x7f22a40d1d60 msgr2=0x7f22a415a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 shutdown_connections 2024-09-10T23:16:03.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.655+0000 7f22abc00640 1 -- 172.21.15.17:0/4174308609 wait complete. 2024-09-10T23:16:03.678 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-10T23:16:02.298252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232128,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742592,"statfs":{"total":773094113280,"available":772856414208,"internally_reserved":0,"allocated":3514368,"data_stored":2072232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003183"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976877+0000","last_change":"2024-09-10T23:15:35.814652+0000","last_active":"2024-09-10T23:15:41.976877+0000","last_peered":"2024-09-10T23:15:41.976877+0000","last_clean":"2024-09-10T23:15:41.976877+0000","last_became_active":"2024-09-10T23:15:35.813651+0000","last_became_peered":"2024-09-10T23:15:35.813651+0000","last_unstale":"2024-09-10T23:15:41.976877+0000","last_undegraded":"2024-09-10T23:15:41.976877+0000","last_fullsized":"2024-09-10T23:15:41.976877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:03.885457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478220+0000","last_change":"2024-09-10T23:15:36.816888+0000","last_active":"2024-09-10T23:15:42.478220+0000","last_peered":"2024-09-10T23:15:42.478220+0000","last_clean":"2024-09-10T23:15:42.478220+0000","last_became_active":"2024-09-10T23:15:36.816546+0000","last_became_peered":"2024-09-10T23:15:36.816546+0000","last_unstale":"2024-09-10T23:15:42.478220+0000","last_undegraded":"2024-09-10T23:15:42.478220+0000","last_fullsized":"2024-09-10T23:15:42.478220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:15.359059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477480+0000","last_change":"2024-09-10T23:15:40.918612+0000","last_active":"2024-09-10T23:15:42.477480+0000","last_peered":"2024-09-10T23:15:42.477480+0000","last_clean":"2024-09-10T23:15:42.477480+0000","last_became_active":"2024-09-10T23:15:40.917951+0000","last_became_peered":"2024-09-10T23:15:40.917951+0000","last_unstale":"2024-09-10T23:15:42.477480+0000","last_undegraded":"2024-09-10T23:15:42.477480+0000","last_fullsized":"2024-09-10T23:15:42.477480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:58.740153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478306+0000","last_change":"2024-09-10T23:15:35.820658+0000","last_active":"2024-09-10T23:15:42.478306+0000","last_peered":"2024-09-10T23:15:42.478306+0000","last_clean":"2024-09-10T23:15:42.478306+0000","last_became_active":"2024-09-10T23:15:35.820362+0000","last_became_peered":"2024-09-10T23:15:35.820362+0000","last_unstale":"2024-09-10T23:15:42.478306+0000","last_undegraded":"2024-09-10T23:15:42.478306+0000","last_fullsized":"2024-09-10T23:15:42.478306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:59.264177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976763+0000","last_change":"2024-09-10T23:15:36.826442+0000","last_active":"2024-09-10T23:15:41.976763+0000","last_peered":"2024-09-10T23:15:41.976763+0000","last_clean":"2024-09-10T23:15:41.976763+0000","last_became_active":"2024-09-10T23:15:36.826134+0000","last_became_peered":"2024-09-10T23:15:36.826134+0000","last_unstale":"2024-09-10T23:15:41.976763+0000","last_undegraded":"2024-09-10T23:15:41.976763+0000","last_fullsized":"2024-09-10T23:15:41.976763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:25.766975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050245+0000","last_change":"2024-09-10T23:15:40.846375+0000","last_active":"2024-09-10T23:15:42.050245+0000","last_peered":"2024-09-10T23:15:42.050245+0000","last_clean":"2024-09-10T23:15:42.050245+0000","last_became_active":"2024-09-10T23:15:40.845497+0000","last_became_peered":"2024-09-10T23:15:40.845497+0000","last_unstale":"2024-09-10T23:15:42.050245+0000","last_undegraded":"2024-09-10T23:15:42.050245+0000","last_fullsized":"2024-09-10T23:15:42.050245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:56.268422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083553+0000","last_change":"2024-09-10T23:15:35.824606+0000","last_active":"2024-09-10T23:15:42.083553+0000","last_peered":"2024-09-10T23:15:42.083553+0000","last_clean":"2024-09-10T23:15:42.083553+0000","last_became_active":"2024-09-10T23:15:35.824294+0000","last_became_peered":"2024-09-10T23:15:35.824294+0000","last_unstale":"2024-09-10T23:15:42.083553+0000","last_undegraded":"2024-09-10T23:15:42.083553+0000","last_fullsized":"2024-09-10T23:15:42.083553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453441+0000","last_change":"2024-09-10T23:15:36.833443+0000","last_active":"2024-09-10T23:15:42.453441+0000","last_peered":"2024-09-10T23:15:42.453441+0000","last_clean":"2024-09-10T23:15:42.453441+0000","last_became_active":"2024-09-10T23:15:36.831507+0000","last_became_peered":"2024-09-10T23:15:36.831507+0000","last_unstale":"2024-09-10T23:15:42.453441+0000","last_undegraded":"2024-09-10T23:15:42.453441+0000","last_fullsized":"2024-09-10T23:15:42.453441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:46.059643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050541+0000","last_change":"2024-09-10T23:15:40.848217+0000","last_active":"2024-09-10T23:15:42.050541+0000","last_peered":"2024-09-10T23:15:42.050541+0000","last_clean":"2024-09-10T23:15:42.050541+0000","last_became_active":"2024-09-10T23:15:40.847206+0000","last_became_peered":"2024-09-10T23:15:40.847206+0000","last_unstale":"2024-09-10T23:15:42.050541+0000","last_undegraded":"2024-09-10T23:15:42.050541+0000","last_fullsized":"2024-09-10T23:15:42.050541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:13.797702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083326+0000","last_change":"2024-09-10T23:15:35.824509+0000","last_active":"2024-09-10T23:15:42.083326+0000","last_peered":"2024-09-10T23:15:42.083326+0000","last_clean":"2024-09-10T23:15:42.083326+0000","last_became_active":"2024-09-10T23:15:35.824204+0000","last_became_peered":"2024-09-10T23:15:35.824204+0000","last_unstale":"2024-09-10T23:15:42.083326+0000","last_undegraded":"2024-09-10T23:15:42.083326+0000","last_fullsized":"2024-09-10T23:15:42.083326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:11.532685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453590+0000","last_change":"2024-09-10T23:15:36.828659+0000","last_active":"2024-09-10T23:15:42.453590+0000","last_peered":"2024-09-10T23:15:42.453590+0000","last_clean":"2024-09-10T23:15:42.453590+0000","last_became_active":"2024-09-10T23:15:36.828322+0000","last_became_peered":"2024-09-10T23:15:36.828322+0000","last_unstale":"2024-09-10T23:15:42.453590+0000","last_undegraded":"2024-09-10T23:15:42.453590+0000","last_fullsized":"2024-09-10T23:15:42.453590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:02.889244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050319+0000","last_change":"2024-09-10T23:15:40.849484+0000","last_active":"2024-09-10T23:15:42.050319+0000","last_peered":"2024-09-10T23:15:42.050319+0000","last_clean":"2024-09-10T23:15:42.050319+0000","last_became_active":"2024-09-10T23:15:40.848878+0000","last_became_peered":"2024-09-10T23:15:40.848878+0000","last_unstale":"2024-09-10T23:15:42.050319+0000","last_undegraded":"2024-09-10T23:15:42.050319+0000","last_fullsized":"2024-09-10T23:15:42.050319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:20.089945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866699+0000","last_change":"2024-09-10T23:15:36.837333+0000","last_active":"2024-09-10T23:15:41.866699+0000","last_peered":"2024-09-10T23:15:41.866699+0000","last_clean":"2024-09-10T23:15:41.866699+0000","last_became_active":"2024-09-10T23:15:36.837159+0000","last_became_peered":"2024-09-10T23:15:36.837159+0000","last_unstale":"2024-09-10T23:15:41.866699+0000","last_undegraded":"2024-09-10T23:15:41.866699+0000","last_fullsized":"2024-09-10T23:15:41.866699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:42.144340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083393+0000","last_change":"2024-09-10T23:15:35.821008+0000","last_active":"2024-09-10T23:15:42.083393+0000","last_peered":"2024-09-10T23:15:42.083393+0000","last_clean":"2024-09-10T23:15:42.083393+0000","last_became_active":"2024-09-10T23:15:35.820800+0000","last_became_peered":"2024-09-10T23:15:35.820800+0000","last_unstale":"2024-09-10T23:15:42.083393+0000","last_undegraded":"2024-09-10T23:15:42.083393+0000","last_fullsized":"2024-09-10T23:15:42.083393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050630+0000","last_change":"2024-09-10T23:15:40.850423+0000","last_active":"2024-09-10T23:15:42.050630+0000","last_peered":"2024-09-10T23:15:42.050630+0000","last_clean":"2024-09-10T23:15:42.050630+0000","last_became_active":"2024-09-10T23:15:40.848512+0000","last_became_peered":"2024-09-10T23:15:40.848512+0000","last_unstale":"2024-09-10T23:15:42.050630+0000","last_undegraded":"2024-09-10T23:15:42.050630+0000","last_fullsized":"2024-09-10T23:15:42.050630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:06.923809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477795+0000","last_change":"2024-09-10T23:15:36.815925+0000","last_active":"2024-09-10T23:15:42.477795+0000","last_peered":"2024-09-10T23:15:42.477795+0000","last_clean":"2024-09-10T23:15:42.477795+0000","last_became_active":"2024-09-10T23:15:36.815528+0000","last_became_peered":"2024-09-10T23:15:36.815528+0000","last_unstale":"2024-09-10T23:15:42.477795+0000","last_undegraded":"2024-09-10T23:15:42.477795+0000","last_fullsized":"2024-09-10T23:15:42.477795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:09.964148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965964+0000","last_change":"2024-09-10T23:15:35.819766+0000","last_active":"2024-09-10T23:15:41.965964+0000","last_peered":"2024-09-10T23:15:41.965964+0000","last_clean":"2024-09-10T23:15:41.965964+0000","last_became_active":"2024-09-10T23:15:35.819208+0000","last_became_peered":"2024-09-10T23:15:35.819208+0000","last_unstale":"2024-09-10T23:15:41.965964+0000","last_undegraded":"2024-09-10T23:15:41.965964+0000","last_fullsized":"2024-09-10T23:15:41.965964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050814+0000","last_change":"2024-09-10T23:15:40.845547+0000","last_active":"2024-09-10T23:15:42.050814+0000","last_peered":"2024-09-10T23:15:42.050814+0000","last_clean":"2024-09-10T23:15:42.050814+0000","last_became_active":"2024-09-10T23:15:40.842954+0000","last_became_peered":"2024-09-10T23:15:40.842954+0000","last_unstale":"2024-09-10T23:15:42.050814+0000","last_undegraded":"2024-09-10T23:15:42.050814+0000","last_fullsized":"2024-09-10T23:15:42.050814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:50.094208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477613+0000","last_change":"2024-09-10T23:15:36.810636+0000","last_active":"2024-09-10T23:15:42.477613+0000","last_peered":"2024-09-10T23:15:42.477613+0000","last_clean":"2024-09-10T23:15:42.477613+0000","last_became_active":"2024-09-10T23:15:36.810344+0000","last_became_peered":"2024-09-10T23:15:36.810344+0000","last_unstale":"2024-09-10T23:15:42.477613+0000","last_undegraded":"2024-09-10T23:15:42.477613+0000","last_fullsized":"2024-09-10T23:15:42.477613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:04.853549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965671+0000","last_change":"2024-09-10T23:15:35.817152+0000","last_active":"2024-09-10T23:15:41.965671+0000","last_peered":"2024-09-10T23:15:41.965671+0000","last_clean":"2024-09-10T23:15:41.965671+0000","last_became_active":"2024-09-10T23:15:35.815119+0000","last_became_peered":"2024-09-10T23:15:35.815119+0000","last_unstale":"2024-09-10T23:15:41.965671+0000","last_undegraded":"2024-09-10T23:15:41.965671+0000","last_fullsized":"2024-09-10T23:15:41.965671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966575+0000","last_change":"2024-09-10T23:15:40.922557+0000","last_active":"2024-09-10T23:15:41.966575+0000","last_peered":"2024-09-10T23:15:41.966575+0000","last_clean":"2024-09-10T23:15:41.966575+0000","last_became_active":"2024-09-10T23:15:40.921331+0000","last_became_peered":"2024-09-10T23:15:40.921331+0000","last_unstale":"2024-09-10T23:15:41.966575+0000","last_undegraded":"2024-09-10T23:15:41.966575+0000","last_fullsized":"2024-09-10T23:15:41.966575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:02.366453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050961+0000","last_change":"2024-09-10T23:15:36.807834+0000","last_active":"2024-09-10T23:15:42.050961+0000","last_peered":"2024-09-10T23:15:42.050961+0000","last_clean":"2024-09-10T23:15:42.050961+0000","last_became_active":"2024-09-10T23:15:36.807456+0000","last_became_peered":"2024-09-10T23:15:36.807456+0000","last_unstale":"2024-09-10T23:15:42.050961+0000","last_undegraded":"2024-09-10T23:15:42.050961+0000","last_fullsized":"2024-09-10T23:15:42.050961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:53.903864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.082975+0000","last_change":"2024-09-10T23:15:35.818465+0000","last_active":"2024-09-10T23:15:42.082975+0000","last_peered":"2024-09-10T23:15:42.082975+0000","last_clean":"2024-09-10T23:15:42.082975+0000","last_became_active":"2024-09-10T23:15:35.818170+0000","last_became_peered":"2024-09-10T23:15:35.818170+0000","last_unstale":"2024-09-10T23:15:42.082975+0000","last_undegraded":"2024-09-10T23:15:42.082975+0000","last_fullsized":"2024-09-10T23:15:42.082975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:18.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050681+0000","last_change":"2024-09-10T23:15:40.845836+0000","last_active":"2024-09-10T23:15:42.050681+0000","last_peered":"2024-09-10T23:15:42.050681+0000","last_clean":"2024-09-10T23:15:42.050681+0000","last_became_active":"2024-09-10T23:15:40.845311+0000","last_became_peered":"2024-09-10T23:15:40.845311+0000","last_unstale":"2024-09-10T23:15:42.050681+0000","last_undegraded":"2024-09-10T23:15:42.050681+0000","last_fullsized":"2024-09-10T23:15:42.050681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:19.885524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977347+0000","last_change":"2024-09-10T23:15:36.809745+0000","last_active":"2024-09-10T23:15:41.977347+0000","last_peered":"2024-09-10T23:15:41.977347+0000","last_clean":"2024-09-10T23:15:41.977347+0000","last_became_active":"2024-09-10T23:15:36.809472+0000","last_became_peered":"2024-09-10T23:15:36.809472+0000","last_unstale":"2024-09-10T23:15:41.977347+0000","last_undegraded":"2024-09-10T23:15:41.977347+0000","last_fullsized":"2024-09-10T23:15:41.977347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:46.554507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.867243+0000","last_change":"2024-09-10T23:15:35.817617+0000","last_active":"2024-09-10T23:15:41.867243+0000","last_peered":"2024-09-10T23:15:41.867243+0000","last_clean":"2024-09-10T23:15:41.867243+0000","last_became_active":"2024-09-10T23:15:35.817324+0000","last_became_peered":"2024-09-10T23:15:35.817324+0000","last_unstale":"2024-09-10T23:15:41.867243+0000","last_undegraded":"2024-09-10T23:15:41.867243+0000","last_fullsized":"2024-09-10T23:15:41.867243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050252+0000","last_change":"2024-09-10T23:15:40.918183+0000","last_active":"2024-09-10T23:15:42.050252+0000","last_peered":"2024-09-10T23:15:42.050252+0000","last_clean":"2024-09-10T23:15:42.050252+0000","last_became_active":"2024-09-10T23:15:40.917821+0000","last_became_peered":"2024-09-10T23:15:40.917821+0000","last_unstale":"2024-09-10T23:15:42.050252+0000","last_undegraded":"2024-09-10T23:15:42.050252+0000","last_fullsized":"2024-09-10T23:15:42.050252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:16.274683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478404+0000","last_change":"2024-09-10T23:15:36.819985+0000","last_active":"2024-09-10T23:15:42.478404+0000","last_peered":"2024-09-10T23:15:42.478404+0000","last_clean":"2024-09-10T23:15:42.478404+0000","last_became_active":"2024-09-10T23:15:36.819707+0000","last_became_peered":"2024-09-10T23:15:36.819707+0000","last_unstale":"2024-09-10T23:15:42.478404+0000","last_undegraded":"2024-09-10T23:15:42.478404+0000","last_fullsized":"2024-09-10T23:15:42.478404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:38.630118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966455+0000","last_change":"2024-09-10T23:15:35.815615+0000","last_active":"2024-09-10T23:15:41.966455+0000","last_peered":"2024-09-10T23:15:41.966455+0000","last_clean":"2024-09-10T23:15:41.966455+0000","last_became_active":"2024-09-10T23:15:35.813771+0000","last_became_peered":"2024-09-10T23:15:35.813771+0000","last_unstale":"2024-09-10T23:15:41.966455+0000","last_undegraded":"2024-09-10T23:15:41.966455+0000","last_fullsized":"2024-09-10T23:15:41.966455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477424+0000","last_change":"2024-09-10T23:15:40.918250+0000","last_active":"2024-09-10T23:15:42.477424+0000","last_peered":"2024-09-10T23:15:42.477424+0000","last_clean":"2024-09-10T23:15:42.477424+0000","last_became_active":"2024-09-10T23:15:40.917549+0000","last_became_peered":"2024-09-10T23:15:40.917549+0000","last_unstale":"2024-09-10T23:15:42.477424+0000","last_undegraded":"2024-09-10T23:15:42.477424+0000","last_fullsized":"2024-09-10T23:15:42.477424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:43.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966106+0000","last_change":"2024-09-10T23:15:36.805882+0000","last_active":"2024-09-10T23:15:41.966106+0000","last_peered":"2024-09-10T23:15:41.966106+0000","last_clean":"2024-09-10T23:15:41.966106+0000","last_became_active":"2024-09-10T23:15:36.805560+0000","last_became_peered":"2024-09-10T23:15:36.805560+0000","last_unstale":"2024-09-10T23:15:41.966106+0000","last_undegraded":"2024-09-10T23:15:41.966106+0000","last_fullsized":"2024-09-10T23:15:41.966106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083674+0000","last_change":"2024-09-10T23:15:35.825152+0000","last_active":"2024-09-10T23:15:42.083674+0000","last_peered":"2024-09-10T23:15:42.083674+0000","last_clean":"2024-09-10T23:15:42.083674+0000","last_became_active":"2024-09-10T23:15:35.824913+0000","last_became_peered":"2024-09-10T23:15:35.824913+0000","last_unstale":"2024-09-10T23:15:42.083674+0000","last_undegraded":"2024-09-10T23:15:42.083674+0000","last_fullsized":"2024-09-10T23:15:42.083674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976537+0000","last_change":"2024-09-10T23:15:40.923130+0000","last_active":"2024-09-10T23:15:41.976537+0000","last_peered":"2024-09-10T23:15:41.976537+0000","last_clean":"2024-09-10T23:15:41.976537+0000","last_became_active":"2024-09-10T23:15:40.922673+0000","last_became_peered":"2024-09-10T23:15:40.922673+0000","last_unstale":"2024-09-10T23:15:41.976537+0000","last_undegraded":"2024-09-10T23:15:41.976537+0000","last_fullsized":"2024-09-10T23:15:41.976537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453737+0000","last_change":"2024-09-10T23:15:36.823984+0000","last_active":"2024-09-10T23:15:42.453737+0000","last_peered":"2024-09-10T23:15:42.453737+0000","last_clean":"2024-09-10T23:15:42.453737+0000","last_became_active":"2024-09-10T23:15:36.821937+0000","last_became_peered":"2024-09-10T23:15:36.821937+0000","last_unstale":"2024-09-10T23:15:42.453737+0000","last_undegraded":"2024-09-10T23:15:42.453737+0000","last_fullsized":"2024-09-10T23:15:42.453737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:39.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966125+0000","last_change":"2024-09-10T23:15:35.814369+0000","last_active":"2024-09-10T23:15:41.966125+0000","last_peered":"2024-09-10T23:15:41.966125+0000","last_clean":"2024-09-10T23:15:41.966125+0000","last_became_active":"2024-09-10T23:15:35.813084+0000","last_became_peered":"2024-09-10T23:15:35.813084+0000","last_unstale":"2024-09-10T23:15:41.966125+0000","last_undegraded":"2024-09-10T23:15:41.966125+0000","last_fullsized":"2024-09-10T23:15:41.966125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965646+0000","last_change":"2024-09-10T23:15:40.856726+0000","last_active":"2024-09-10T23:15:41.965646+0000","last_peered":"2024-09-10T23:15:41.965646+0000","last_clean":"2024-09-10T23:15:41.965646+0000","last_became_active":"2024-09-10T23:15:40.852472+0000","last_became_peered":"2024-09-10T23:15:40.852472+0000","last_unstale":"2024-09-10T23:15:41.965646+0000","last_undegraded":"2024-09-10T23:15:41.965646+0000","last_fullsized":"2024-09-10T23:15:41.965646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.051146+0000","last_change":"2024-09-10T23:15:36.812895+0000","last_active":"2024-09-10T23:15:42.051146+0000","last_peered":"2024-09-10T23:15:42.051146+0000","last_clean":"2024-09-10T23:15:42.051146+0000","last_became_active":"2024-09-10T23:15:36.811704+0000","last_became_peered":"2024-09-10T23:15:36.811704+0000","last_unstale":"2024-09-10T23:15:42.051146+0000","last_undegraded":"2024-09-10T23:15:42.051146+0000","last_fullsized":"2024-09-10T23:15:42.051146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:15.129050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453461+0000","last_change":"2024-09-10T23:15:35.806612+0000","last_active":"2024-09-10T23:15:42.453461+0000","last_peered":"2024-09-10T23:15:42.453461+0000","last_clean":"2024-09-10T23:15:42.453461+0000","last_became_active":"2024-09-10T23:15:35.806252+0000","last_became_peered":"2024-09-10T23:15:35.806252+0000","last_unstale":"2024-09-10T23:15:42.453461+0000","last_undegraded":"2024-09-10T23:15:42.453461+0000","last_fullsized":"2024-09-10T23:15:42.453461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966028+0000","last_change":"2024-09-10T23:15:40.850623+0000","last_active":"2024-09-10T23:15:41.966028+0000","last_peered":"2024-09-10T23:15:41.966028+0000","last_clean":"2024-09-10T23:15:41.966028+0000","last_became_active":"2024-09-10T23:15:40.850268+0000","last_became_peered":"2024-09-10T23:15:40.850268+0000","last_unstale":"2024-09-10T23:15:41.966028+0000","last_undegraded":"2024-09-10T23:15:41.966028+0000","last_fullsized":"2024-09-10T23:15:41.966028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.634743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965723+0000","last_change":"2024-09-10T23:15:36.806814+0000","last_active":"2024-09-10T23:15:41.965723+0000","last_peered":"2024-09-10T23:15:41.965723+0000","last_clean":"2024-09-10T23:15:41.965723+0000","last_became_active":"2024-09-10T23:15:36.806543+0000","last_became_peered":"2024-09-10T23:15:36.806543+0000","last_unstale":"2024-09-10T23:15:41.965723+0000","last_undegraded":"2024-09-10T23:15:41.965723+0000","last_fullsized":"2024-09-10T23:15:41.965723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:27.255285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862034+0000","last_change":"2024-09-10T23:15:35.820635+0000","last_active":"2024-09-10T23:15:41.862034+0000","last_peered":"2024-09-10T23:15:41.862034+0000","last_clean":"2024-09-10T23:15:41.862034+0000","last_became_active":"2024-09-10T23:15:35.820316+0000","last_became_peered":"2024-09-10T23:15:35.820316+0000","last_unstale":"2024-09-10T23:15:41.862034+0000","last_undegraded":"2024-09-10T23:15:41.862034+0000","last_fullsized":"2024-09-10T23:15:41.862034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966617+0000","last_change":"2024-09-10T23:15:40.861082+0000","last_active":"2024-09-10T23:15:41.966617+0000","last_peered":"2024-09-10T23:15:41.966617+0000","last_clean":"2024-09-10T23:15:41.966617+0000","last_became_active":"2024-09-10T23:15:40.857518+0000","last_became_peered":"2024-09-10T23:15:40.857518+0000","last_unstale":"2024-09-10T23:15:41.966617+0000","last_undegraded":"2024-09-10T23:15:41.966617+0000","last_fullsized":"2024-09-10T23:15:41.966617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:15.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976242+0000","last_change":"2024-09-10T23:15:36.820294+0000","last_active":"2024-09-10T23:15:41.976242+0000","last_peered":"2024-09-10T23:15:41.976242+0000","last_clean":"2024-09-10T23:15:41.976242+0000","last_became_active":"2024-09-10T23:15:36.820007+0000","last_became_peered":"2024-09-10T23:15:36.820007+0000","last_unstale":"2024-09-10T23:15:41.976242+0000","last_undegraded":"2024-09-10T23:15:41.976242+0000","last_fullsized":"2024-09-10T23:15:41.976242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:59.107579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.082976+0000","last_change":"2024-09-10T23:15:35.821318+0000","last_active":"2024-09-10T23:15:42.082976+0000","last_peered":"2024-09-10T23:15:42.082976+0000","last_clean":"2024-09-10T23:15:42.082976+0000","last_became_active":"2024-09-10T23:15:35.821042+0000","last_became_peered":"2024-09-10T23:15:35.821042+0000","last_unstale":"2024-09-10T23:15:42.082976+0000","last_undegraded":"2024-09-10T23:15:42.082976+0000","last_fullsized":"2024-09-10T23:15:42.082976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:19.082501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977207+0000","last_change":"2024-09-10T23:15:40.919738+0000","last_active":"2024-09-10T23:15:41.977207+0000","last_peered":"2024-09-10T23:15:41.977207+0000","last_clean":"2024-09-10T23:15:41.977207+0000","last_became_active":"2024-09-10T23:15:40.919341+0000","last_became_peered":"2024-09-10T23:15:40.919341+0000","last_unstale":"2024-09-10T23:15:41.977207+0000","last_undegraded":"2024-09-10T23:15:41.977207+0000","last_fullsized":"2024-09-10T23:15:41.977207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:15.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477545+0000","last_change":"2024-09-10T23:15:36.825565+0000","last_active":"2024-09-10T23:15:42.477545+0000","last_peered":"2024-09-10T23:15:42.477545+0000","last_clean":"2024-09-10T23:15:42.477545+0000","last_became_active":"2024-09-10T23:15:36.825010+0000","last_became_peered":"2024-09-10T23:15:36.825010+0000","last_unstale":"2024-09-10T23:15:42.477545+0000","last_undegraded":"2024-09-10T23:15:42.477545+0000","last_fullsized":"2024-09-10T23:15:42.477545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:29.344583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453413+0000","last_change":"2024-09-10T23:15:35.809248+0000","last_active":"2024-09-10T23:15:42.453413+0000","last_peered":"2024-09-10T23:15:42.453413+0000","last_clean":"2024-09-10T23:15:42.453413+0000","last_became_active":"2024-09-10T23:15:35.808922+0000","last_became_peered":"2024-09-10T23:15:35.808922+0000","last_unstale":"2024-09-10T23:15:42.453413+0000","last_undegraded":"2024-09-10T23:15:42.453413+0000","last_fullsized":"2024-09-10T23:15:42.453413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083106+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:15:42.083106+0000","last_peered":"2024-09-10T23:15:42.083106+0000","last_clean":"2024-09-10T23:15:42.083106+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:15:42.083106+0000","last_undegraded":"2024-09-10T23:15:42.083106+0000","last_fullsized":"2024-09-10T23:15:42.083106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866508+0000","last_change":"2024-09-10T23:15:40.919822+0000","last_active":"2024-09-10T23:15:41.866508+0000","last_peered":"2024-09-10T23:15:41.866508+0000","last_clean":"2024-09-10T23:15:41.866508+0000","last_became_active":"2024-09-10T23:15:40.919328+0000","last_became_peered":"2024-09-10T23:15:40.919328+0000","last_unstale":"2024-09-10T23:15:41.866508+0000","last_undegraded":"2024-09-10T23:15:41.866508+0000","last_fullsized":"2024-09-10T23:15:41.866508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:06.923809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083445+0000","last_change":"2024-09-10T23:15:36.830835+0000","last_active":"2024-09-10T23:15:42.083445+0000","last_peered":"2024-09-10T23:15:42.083445+0000","last_clean":"2024-09-10T23:15:42.083445+0000","last_became_active":"2024-09-10T23:15:36.830577+0000","last_became_peered":"2024-09-10T23:15:36.830577+0000","last_unstale":"2024-09-10T23:15:42.083445+0000","last_undegraded":"2024-09-10T23:15:42.083445+0000","last_fullsized":"2024-09-10T23:15:42.083445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:02.889244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862500+0000","last_change":"2024-09-10T23:15:35.810227+0000","last_active":"2024-09-10T23:15:41.862500+0000","last_peered":"2024-09-10T23:15:41.862500+0000","last_clean":"2024-09-10T23:15:41.862500+0000","last_became_active":"2024-09-10T23:15:35.809934+0000","last_became_peered":"2024-09-10T23:15:35.809934+0000","last_unstale":"2024-09-10T23:15:41.862500+0000","last_undegraded":"2024-09-10T23:15:41.862500+0000","last_fullsized":"2024-09-10T23:15:41.862500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866742+0000","last_change":"2024-09-10T23:15:40.920305+0000","last_active":"2024-09-10T23:15:41.866742+0000","last_peered":"2024-09-10T23:15:41.866742+0000","last_clean":"2024-09-10T23:15:41.866742+0000","last_became_active":"2024-09-10T23:15:40.919525+0000","last_became_peered":"2024-09-10T23:15:40.919525+0000","last_unstale":"2024-09-10T23:15:41.866742+0000","last_undegraded":"2024-09-10T23:15:41.866742+0000","last_fullsized":"2024-09-10T23:15:41.866742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:19.885524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453520+0000","last_change":"2024-09-10T23:15:36.821403+0000","last_active":"2024-09-10T23:15:42.453520+0000","last_peered":"2024-09-10T23:15:42.453520+0000","last_clean":"2024-09-10T23:15:42.453520+0000","last_became_active":"2024-09-10T23:15:36.820075+0000","last_became_peered":"2024-09-10T23:15:36.820075+0000","last_unstale":"2024-09-10T23:15:42.453520+0000","last_undegraded":"2024-09-10T23:15:42.453520+0000","last_fullsized":"2024-09-10T23:15:42.453520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:58.090078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966385+0000","last_change":"2024-09-10T23:15:35.809772+0000","last_active":"2024-09-10T23:15:41.966385+0000","last_peered":"2024-09-10T23:15:41.966385+0000","last_clean":"2024-09-10T23:15:41.966385+0000","last_became_active":"2024-09-10T23:15:35.808856+0000","last_became_peered":"2024-09-10T23:15:35.808856+0000","last_unstale":"2024-09-10T23:15:41.966385+0000","last_undegraded":"2024-09-10T23:15:41.966385+0000","last_fullsized":"2024-09-10T23:15:41.966385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:11.532685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976700+0000","last_change":"2024-09-10T23:15:40.854344+0000","last_active":"2024-09-10T23:15:41.976700+0000","last_peered":"2024-09-10T23:15:41.976700+0000","last_clean":"2024-09-10T23:15:41.976700+0000","last_became_active":"2024-09-10T23:15:40.853674+0000","last_became_peered":"2024-09-10T23:15:40.853674+0000","last_unstale":"2024-09-10T23:15:41.976700+0000","last_undegraded":"2024-09-10T23:15:41.976700+0000","last_fullsized":"2024-09-10T23:15:41.976700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:02.124643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083823+0000","last_change":"2024-09-10T23:15:36.830949+0000","last_active":"2024-09-10T23:15:42.083823+0000","last_peered":"2024-09-10T23:15:42.083823+0000","last_clean":"2024-09-10T23:15:42.083823+0000","last_became_active":"2024-09-10T23:15:36.830634+0000","last_became_peered":"2024-09-10T23:15:36.830634+0000","last_unstale":"2024-09-10T23:15:42.083823+0000","last_undegraded":"2024-09-10T23:15:42.083823+0000","last_fullsized":"2024-09-10T23:15:42.083823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:58.331888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862700+0000","last_change":"2024-09-10T23:15:35.821546+0000","last_active":"2024-09-10T23:15:41.862700+0000","last_peered":"2024-09-10T23:15:41.862700+0000","last_clean":"2024-09-10T23:15:41.862700+0000","last_became_active":"2024-09-10T23:15:35.821344+0000","last_became_peered":"2024-09-10T23:15:35.821344+0000","last_unstale":"2024-09-10T23:15:41.862700+0000","last_undegraded":"2024-09-10T23:15:41.862700+0000","last_fullsized":"2024-09-10T23:15:41.862700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.452950+0000","last_change":"2024-09-10T23:15:40.916580+0000","last_active":"2024-09-10T23:15:42.452950+0000","last_peered":"2024-09-10T23:15:42.452950+0000","last_clean":"2024-09-10T23:15:42.452950+0000","last_became_active":"2024-09-10T23:15:40.915945+0000","last_became_peered":"2024-09-10T23:15:40.915945+0000","last_unstale":"2024-09-10T23:15:42.452950+0000","last_undegraded":"2024-09-10T23:15:42.452950+0000","last_fullsized":"2024-09-10T23:15:42.452950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:06.214916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083651+0000","last_change":"2024-09-10T23:15:36.829540+0000","last_active":"2024-09-10T23:15:42.083651+0000","last_peered":"2024-09-10T23:15:42.083651+0000","last_clean":"2024-09-10T23:15:42.083651+0000","last_became_active":"2024-09-10T23:15:36.829163+0000","last_became_peered":"2024-09-10T23:15:36.829163+0000","last_unstale":"2024-09-10T23:15:42.083651+0000","last_undegraded":"2024-09-10T23:15:42.083651+0000","last_fullsized":"2024-09-10T23:15:42.083651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:58.090078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050719+0000","last_change":"2024-09-10T23:15:35.819239+0000","last_active":"2024-09-10T23:15:42.050719+0000","last_peered":"2024-09-10T23:15:42.050719+0000","last_clean":"2024-09-10T23:15:42.050719+0000","last_became_active":"2024-09-10T23:15:35.818934+0000","last_became_peered":"2024-09-10T23:15:35.818934+0000","last_unstale":"2024-09-10T23:15:42.050719+0000","last_undegraded":"2024-09-10T23:15:42.050719+0000","last_fullsized":"2024-09-10T23:15:42.050719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:01.687726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050169+0000","last_change":"2024-09-10T23:15:40.842548+0000","last_active":"2024-09-10T23:15:42.050169+0000","last_peered":"2024-09-10T23:15:42.050169+0000","last_clean":"2024-09-10T23:15:42.050169+0000","last_became_active":"2024-09-10T23:15:40.842051+0000","last_became_peered":"2024-09-10T23:15:40.842051+0000","last_unstale":"2024-09-10T23:15:42.050169+0000","last_undegraded":"2024-09-10T23:15:42.050169+0000","last_fullsized":"2024-09-10T23:15:42.050169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:22.992518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083147+0000","last_change":"2024-09-10T23:15:36.838447+0000","last_active":"2024-09-10T23:15:42.083147+0000","last_peered":"2024-09-10T23:15:42.083147+0000","last_clean":"2024-09-10T23:15:42.083147+0000","last_became_active":"2024-09-10T23:15:36.836105+0000","last_became_peered":"2024-09-10T23:15:36.836105+0000","last_unstale":"2024-09-10T23:15:42.083147+0000","last_undegraded":"2024-09-10T23:15:42.083147+0000","last_fullsized":"2024-09-10T23:15:42.083147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:16.055380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.861808+0000","last_change":"2024-09-10T23:15:35.807363+0000","last_active":"2024-09-10T23:15:41.861808+0000","last_peered":"2024-09-10T23:15:41.861808+0000","last_clean":"2024-09-10T23:15:41.861808+0000","last_became_active":"2024-09-10T23:15:35.807055+0000","last_became_peered":"2024-09-10T23:15:35.807055+0000","last_unstale":"2024-09-10T23:15:41.861808+0000","last_undegraded":"2024-09-10T23:15:41.861808+0000","last_fullsized":"2024-09-10T23:15:41.861808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:08.518905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977108+0000","last_change":"2024-09-10T23:15:40.858906+0000","last_active":"2024-09-10T23:15:41.977108+0000","last_peered":"2024-09-10T23:15:41.977108+0000","last_clean":"2024-09-10T23:15:41.977108+0000","last_became_active":"2024-09-10T23:15:40.858496+0000","last_became_peered":"2024-09-10T23:15:40.858496+0000","last_unstale":"2024-09-10T23:15:41.977108+0000","last_undegraded":"2024-09-10T23:15:41.977108+0000","last_fullsized":"2024-09-10T23:15:41.977108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:02.366453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866358+0000","last_change":"2024-09-10T23:15:36.817753+0000","last_active":"2024-09-10T23:15:41.866358+0000","last_peered":"2024-09-10T23:15:41.866358+0000","last_clean":"2024-09-10T23:15:41.866358+0000","last_became_active":"2024-09-10T23:15:36.817206+0000","last_became_peered":"2024-09-10T23:15:36.817206+0000","last_unstale":"2024-09-10T23:15:41.866358+0000","last_undegraded":"2024-09-10T23:15:41.866358+0000","last_fullsized":"2024-09-10T23:15:41.866358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866623+0000","last_change":"2024-09-10T23:15:35.821188+0000","last_active":"2024-09-10T23:15:41.866623+0000","last_peered":"2024-09-10T23:15:41.866623+0000","last_clean":"2024-09-10T23:15:41.866623+0000","last_became_active":"2024-09-10T23:15:35.820920+0000","last_became_peered":"2024-09-10T23:15:35.820920+0000","last_unstale":"2024-09-10T23:15:41.866623+0000","last_undegraded":"2024-09-10T23:15:41.866623+0000","last_fullsized":"2024-09-10T23:15:41.866623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478460+0000","last_change":"2024-09-10T23:15:40.918593+0000","last_active":"2024-09-10T23:15:42.478460+0000","last_peered":"2024-09-10T23:15:42.478460+0000","last_clean":"2024-09-10T23:15:42.478460+0000","last_became_active":"2024-09-10T23:15:40.917690+0000","last_became_peered":"2024-09-10T23:15:40.917690+0000","last_unstale":"2024-09-10T23:15:42.478460+0000","last_undegraded":"2024-09-10T23:15:42.478460+0000","last_fullsized":"2024-09-10T23:15:42.478460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:29.798786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083337+0000","last_change":"2024-09-10T23:15:36.832264+0000","last_active":"2024-09-10T23:15:42.083337+0000","last_peered":"2024-09-10T23:15:42.083337+0000","last_clean":"2024-09-10T23:15:42.083337+0000","last_became_active":"2024-09-10T23:15:36.831964+0000","last_became_peered":"2024-09-10T23:15:36.831964+0000","last_unstale":"2024-09-10T23:15:42.083337+0000","last_undegraded":"2024-09-10T23:15:42.083337+0000","last_fullsized":"2024-09-10T23:15:42.083337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:11.927165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453323+0000","last_change":"2024-09-10T23:15:35.820445+0000","last_active":"2024-09-10T23:15:42.453323+0000","last_peered":"2024-09-10T23:15:42.453323+0000","last_clean":"2024-09-10T23:15:42.453323+0000","last_became_active":"2024-09-10T23:15:35.820097+0000","last_became_peered":"2024-09-10T23:15:35.820097+0000","last_unstale":"2024-09-10T23:15:42.453323+0000","last_undegraded":"2024-09-10T23:15:42.453323+0000","last_fullsized":"2024-09-10T23:15:42.453323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478082+0000","last_change":"2024-09-10T23:15:40.915679+0000","last_active":"2024-09-10T23:15:42.478082+0000","last_peered":"2024-09-10T23:15:42.478082+0000","last_clean":"2024-09-10T23:15:42.478082+0000","last_became_active":"2024-09-10T23:15:40.915242+0000","last_became_peered":"2024-09-10T23:15:40.915242+0000","last_unstale":"2024-09-10T23:15:42.478082+0000","last_undegraded":"2024-09-10T23:15:42.478082+0000","last_fullsized":"2024-09-10T23:15:42.478082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:03.887614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976508+0000","last_change":"2024-09-10T23:15:36.826848+0000","last_active":"2024-09-10T23:15:41.976508+0000","last_peered":"2024-09-10T23:15:41.976508+0000","last_clean":"2024-09-10T23:15:41.976508+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:41.976508+0000","last_undegraded":"2024-09-10T23:15:41.976508+0000","last_fullsized":"2024-09-10T23:15:41.976508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:50.455932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976827+0000","last_change":"2024-09-10T23:15:35.810368+0000","last_active":"2024-09-10T23:15:41.976827+0000","last_peered":"2024-09-10T23:15:41.976827+0000","last_clean":"2024-09-10T23:15:41.976827+0000","last_became_active":"2024-09-10T23:15:35.810056+0000","last_became_peered":"2024-09-10T23:15:35.810056+0000","last_unstale":"2024-09-10T23:15:41.976827+0000","last_undegraded":"2024-09-10T23:15:41.976827+0000","last_fullsized":"2024-09-10T23:15:41.976827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:31.969010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453668+0000","last_change":"2024-09-10T23:15:40.919743+0000","last_active":"2024-09-10T23:15:42.453668+0000","last_peered":"2024-09-10T23:15:42.453668+0000","last_clean":"2024-09-10T23:15:42.453668+0000","last_became_active":"2024-09-10T23:15:40.919307+0000","last_became_peered":"2024-09-10T23:15:40.919307+0000","last_unstale":"2024-09-10T23:15:42.453668+0000","last_undegraded":"2024-09-10T23:15:42.453668+0000","last_fullsized":"2024-09-10T23:15:42.453668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:51.552927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083357+0000","last_change":"2024-09-10T23:15:36.830195+0000","last_active":"2024-09-10T23:15:42.083357+0000","last_peered":"2024-09-10T23:15:42.083357+0000","last_clean":"2024-09-10T23:15:42.083357+0000","last_became_active":"2024-09-10T23:15:36.829550+0000","last_became_peered":"2024-09-10T23:15:36.829550+0000","last_unstale":"2024-09-10T23:15:42.083357+0000","last_undegraded":"2024-09-10T23:15:42.083357+0000","last_fullsized":"2024-09-10T23:15:42.083357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:09.763137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:47.850923+0000","last_change":"2024-09-10T23:15:35.822196+0000","last_active":"2024-09-10T23:15:47.850923+0000","last_peered":"2024-09-10T23:15:47.850923+0000","last_clean":"2024-09-10T23:15:47.850923+0000","last_became_active":"2024-09-10T23:15:35.821931+0000","last_became_peered":"2024-09-10T23:15:35.821931+0000","last_unstale":"2024-09-10T23:15:47.850923+0000","last_undegraded":"2024-09-10T23:15:47.850923+0000","last_fullsized":"2024-09-10T23:15:47.850923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965806+0000","last_change":"2024-09-10T23:15:40.857747+0000","last_active":"2024-09-10T23:15:41.965806+0000","last_peered":"2024-09-10T23:15:41.965806+0000","last_clean":"2024-09-10T23:15:41.965806+0000","last_became_active":"2024-09-10T23:15:40.851809+0000","last_became_peered":"2024-09-10T23:15:40.851809+0000","last_unstale":"2024-09-10T23:15:41.965806+0000","last_undegraded":"2024-09-10T23:15:41.965806+0000","last_fullsized":"2024-09-10T23:15:41.965806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:02.124643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050798+0000","last_change":"2024-09-10T23:15:36.819353+0000","last_active":"2024-09-10T23:15:42.050798+0000","last_peered":"2024-09-10T23:15:42.050798+0000","last_clean":"2024-09-10T23:15:42.050798+0000","last_became_active":"2024-09-10T23:15:36.818733+0000","last_became_peered":"2024-09-10T23:15:36.818733+0000","last_unstale":"2024-09-10T23:15:42.050798+0000","last_undegraded":"2024-09-10T23:15:42.050798+0000","last_fullsized":"2024-09-10T23:15:42.050798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:12.540137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966319+0000","last_change":"2024-09-10T23:15:35.809473+0000","last_active":"2024-09-10T23:15:41.966319+0000","last_peered":"2024-09-10T23:15:41.966319+0000","last_clean":"2024-09-10T23:15:41.966319+0000","last_became_active":"2024-09-10T23:15:35.808925+0000","last_became_peered":"2024-09-10T23:15:35.808925+0000","last_unstale":"2024-09-10T23:15:41.966319+0000","last_undegraded":"2024-09-10T23:15:41.966319+0000","last_fullsized":"2024-09-10T23:15:41.966319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:18.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050944+0000","last_change":"2024-09-10T23:15:40.845501+0000","last_active":"2024-09-10T23:15:42.050944+0000","last_peered":"2024-09-10T23:15:42.050944+0000","last_clean":"2024-09-10T23:15:42.050944+0000","last_became_active":"2024-09-10T23:15:40.845002+0000","last_became_peered":"2024-09-10T23:15:40.845002+0000","last_unstale":"2024-09-10T23:15:42.050944+0000","last_undegraded":"2024-09-10T23:15:42.050944+0000","last_fullsized":"2024-09-10T23:15:42.050944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976880+0000","last_change":"2024-09-10T23:15:36.823879+0000","last_active":"2024-09-10T23:15:41.976880+0000","last_peered":"2024-09-10T23:15:41.976880+0000","last_clean":"2024-09-10T23:15:41.976880+0000","last_became_active":"2024-09-10T23:15:36.823569+0000","last_became_peered":"2024-09-10T23:15:36.823569+0000","last_unstale":"2024-09-10T23:15:41.976880+0000","last_undegraded":"2024-09-10T23:15:41.976880+0000","last_fullsized":"2024-09-10T23:15:41.976880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453728+0000","last_change":"2024-09-10T23:15:35.821328+0000","last_active":"2024-09-10T23:15:42.453728+0000","last_peered":"2024-09-10T23:15:42.453728+0000","last_clean":"2024-09-10T23:15:42.453728+0000","last_became_active":"2024-09-10T23:15:35.820992+0000","last_became_peered":"2024-09-10T23:15:35.820992+0000","last_unstale":"2024-09-10T23:15:42.453728+0000","last_undegraded":"2024-09-10T23:15:42.453728+0000","last_fullsized":"2024-09-10T23:15:42.453728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477653+0000","last_change":"2024-09-10T23:15:40.853378+0000","last_active":"2024-09-10T23:15:42.477653+0000","last_peered":"2024-09-10T23:15:42.477653+0000","last_clean":"2024-09-10T23:15:42.477653+0000","last_became_active":"2024-09-10T23:15:40.851797+0000","last_became_peered":"2024-09-10T23:15:40.851797+0000","last_unstale":"2024-09-10T23:15:42.477653+0000","last_undegraded":"2024-09-10T23:15:42.477653+0000","last_fullsized":"2024-09-10T23:15:42.477653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:35.499058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453617+0000","last_change":"2024-09-10T23:15:36.827207+0000","last_active":"2024-09-10T23:15:42.453617+0000","last_peered":"2024-09-10T23:15:42.453617+0000","last_clean":"2024-09-10T23:15:42.453617+0000","last_became_active":"2024-09-10T23:15:36.826929+0000","last_became_peered":"2024-09-10T23:15:36.826929+0000","last_unstale":"2024-09-10T23:15:42.453617+0000","last_undegraded":"2024-09-10T23:15:42.453617+0000","last_fullsized":"2024-09-10T23:15:42.453617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:57.600178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.867150+0000","last_change":"2024-09-10T23:15:35.817151+0000","last_active":"2024-09-10T23:15:41.867150+0000","last_peered":"2024-09-10T23:15:41.867150+0000","last_clean":"2024-09-10T23:15:41.867150+0000","last_became_active":"2024-09-10T23:15:35.816069+0000","last_became_peered":"2024-09-10T23:15:35.816069+0000","last_unstale":"2024-09-10T23:15:41.867150+0000","last_undegraded":"2024-09-10T23:15:41.867150+0000","last_fullsized":"2024-09-10T23:15:41.867150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477587+0000","last_change":"2024-09-10T23:15:40.919083+0000","last_active":"2024-09-10T23:15:42.477587+0000","last_peered":"2024-09-10T23:15:42.477587+0000","last_clean":"2024-09-10T23:15:42.477587+0000","last_became_active":"2024-09-10T23:15:40.917807+0000","last_became_peered":"2024-09-10T23:15:40.917807+0000","last_unstale":"2024-09-10T23:15:42.477587+0000","last_undegraded":"2024-09-10T23:15:42.477587+0000","last_fullsized":"2024-09-10T23:15:42.477587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:53.108885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976987+0000","last_change":"2024-09-10T23:15:40.919668+0000","last_active":"2024-09-10T23:15:41.976987+0000","last_peered":"2024-09-10T23:15:41.976987+0000","last_clean":"2024-09-10T23:15:41.976987+0000","last_became_active":"2024-09-10T23:15:40.919242+0000","last_became_peered":"2024-09-10T23:15:40.919242+0000","last_unstale":"2024-09-10T23:15:41.976987+0000","last_undegraded":"2024-09-10T23:15:41.976987+0000","last_fullsized":"2024-09-10T23:15:41.976987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.634743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965554+0000","last_change":"2024-09-10T23:15:36.811659+0000","last_active":"2024-09-10T23:15:41.965554+0000","last_peered":"2024-09-10T23:15:41.965554+0000","last_clean":"2024-09-10T23:15:41.965554+0000","last_became_active":"2024-09-10T23:15:36.811297+0000","last_became_peered":"2024-09-10T23:15:36.811297+0000","last_unstale":"2024-09-10T23:15:41.965554+0000","last_undegraded":"2024-09-10T23:15:41.965554+0000","last_fullsized":"2024-09-10T23:15:41.965554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:51.803249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453169+0000","last_change":"2024-09-10T23:15:35.807726+0000","last_active":"2024-09-10T23:15:42.453169+0000","last_peered":"2024-09-10T23:15:42.453169+0000","last_clean":"2024-09-10T23:15:42.453169+0000","last_became_active":"2024-09-10T23:15:35.807144+0000","last_became_peered":"2024-09-10T23:15:35.807144+0000","last_unstale":"2024-09-10T23:15:42.453169+0000","last_undegraded":"2024-09-10T23:15:42.453169+0000","last_fullsized":"2024-09-10T23:15:42.453169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866991+0000","last_change":"2024-09-10T23:15:40.855753+0000","last_active":"2024-09-10T23:15:41.866991+0000","last_peered":"2024-09-10T23:15:41.866991+0000","last_clean":"2024-09-10T23:15:41.866991+0000","last_became_active":"2024-09-10T23:15:40.855320+0000","last_became_peered":"2024-09-10T23:15:40.855320+0000","last_unstale":"2024-09-10T23:15:41.866991+0000","last_undegraded":"2024-09-10T23:15:41.866991+0000","last_fullsized":"2024-09-10T23:15:41.866991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:50.094208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477523+0000","last_change":"2024-09-10T23:15:36.816132+0000","last_active":"2024-09-10T23:15:42.477523+0000","last_peered":"2024-09-10T23:15:42.477523+0000","last_clean":"2024-09-10T23:15:42.477523+0000","last_became_active":"2024-09-10T23:15:36.815801+0000","last_became_peered":"2024-09-10T23:15:36.815801+0000","last_unstale":"2024-09-10T23:15:42.477523+0000","last_undegraded":"2024-09-10T23:15:42.477523+0000","last_fullsized":"2024-09-10T23:15:42.477523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:01.311893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477667+0000","last_change":"2024-09-10T23:15:35.824434+0000","last_active":"2024-09-10T23:15:42.477667+0000","last_peered":"2024-09-10T23:15:42.477667+0000","last_clean":"2024-09-10T23:15:42.477667+0000","last_became_active":"2024-09-10T23:15:35.823485+0000","last_became_peered":"2024-09-10T23:15:35.823485+0000","last_unstale":"2024-09-10T23:15:42.477667+0000","last_undegraded":"2024-09-10T23:15:42.477667+0000","last_fullsized":"2024-09-10T23:15:42.477667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:04.088733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866955+0000","last_change":"2024-09-10T23:15:35.818427+0000","last_active":"2024-09-10T23:15:41.866955+0000","last_peered":"2024-09-10T23:15:41.866955+0000","last_clean":"2024-09-10T23:15:41.866955+0000","last_became_active":"2024-09-10T23:15:35.818167+0000","last_became_peered":"2024-09-10T23:15:35.818167+0000","last_unstale":"2024-09-10T23:15:41.866955+0000","last_undegraded":"2024-09-10T23:15:41.866955+0000","last_fullsized":"2024-09-10T23:15:41.866955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976819+0000","last_change":"2024-09-10T23:15:36.822253+0000","last_active":"2024-09-10T23:15:41.976819+0000","last_peered":"2024-09-10T23:15:41.976819+0000","last_clean":"2024-09-10T23:15:41.976819+0000","last_became_active":"2024-09-10T23:15:36.821990+0000","last_became_peered":"2024-09-10T23:15:36.821990+0000","last_unstale":"2024-09-10T23:15:41.976819+0000","last_undegraded":"2024-09-10T23:15:41.976819+0000","last_fullsized":"2024-09-10T23:15:41.976819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862372+0000","last_change":"2024-09-10T23:15:40.842622+0000","last_active":"2024-09-10T23:15:41.862372+0000","last_peered":"2024-09-10T23:15:41.862372+0000","last_clean":"2024-09-10T23:15:41.862372+0000","last_became_active":"2024-09-10T23:15:40.842113+0000","last_became_peered":"2024-09-10T23:15:40.842113+0000","last_unstale":"2024-09-10T23:15:41.862372+0000","last_undegraded":"2024-09-10T23:15:41.862372+0000","last_fullsized":"2024-09-10T23:15:41.862372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:03.142144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477876+0000","last_change":"2024-09-10T23:15:35.823540+0000","last_active":"2024-09-10T23:15:42.477876+0000","last_peered":"2024-09-10T23:15:42.477876+0000","last_clean":"2024-09-10T23:15:42.477876+0000","last_became_active":"2024-09-10T23:15:35.823054+0000","last_became_peered":"2024-09-10T23:15:35.823054+0000","last_unstale":"2024-09-10T23:15:42.477876+0000","last_undegraded":"2024-09-10T23:15:42.477876+0000","last_fullsized":"2024-09-10T23:15:42.477876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:04.057636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050474+0000","last_change":"2024-09-10T23:15:36.812487+0000","last_active":"2024-09-10T23:15:42.050474+0000","last_peered":"2024-09-10T23:15:42.050474+0000","last_clean":"2024-09-10T23:15:42.050474+0000","last_became_active":"2024-09-10T23:15:36.812141+0000","last_became_peered":"2024-09-10T23:15:36.812141+0000","last_unstale":"2024-09-10T23:15:42.050474+0000","last_undegraded":"2024-09-10T23:15:42.050474+0000","last_fullsized":"2024-09-10T23:15:42.050474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:51.808916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478078+0000","last_change":"2024-09-10T23:15:40.847773+0000","last_active":"2024-09-10T23:15:42.478078+0000","last_peered":"2024-09-10T23:15:42.478078+0000","last_clean":"2024-09-10T23:15:42.478078+0000","last_became_active":"2024-09-10T23:15:40.847351+0000","last_became_peered":"2024-09-10T23:15:40.847351+0000","last_unstale":"2024-09-10T23:15:42.478078+0000","last_undegraded":"2024-09-10T23:15:42.478078+0000","last_fullsized":"2024-09-10T23:15:42.478078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:56.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866237+0000","last_change":"2024-09-10T23:15:36.817479+0000","last_active":"2024-09-10T23:15:41.866237+0000","last_peered":"2024-09-10T23:15:41.866237+0000","last_clean":"2024-09-10T23:15:41.866237+0000","last_became_active":"2024-09-10T23:15:36.816922+0000","last_became_peered":"2024-09-10T23:15:36.816922+0000","last_unstale":"2024-09-10T23:15:41.866237+0000","last_undegraded":"2024-09-10T23:15:41.866237+0000","last_fullsized":"2024-09-10T23:15:41.866237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.142950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.861972+0000","last_change":"2024-09-10T23:15:36.819587+0000","last_active":"2024-09-10T23:15:41.861972+0000","last_peered":"2024-09-10T23:15:41.861972+0000","last_clean":"2024-09-10T23:15:41.861972+0000","last_became_active":"2024-09-10T23:15:36.819330+0000","last_became_peered":"2024-09-10T23:15:36.819330+0000","last_unstale":"2024-09-10T23:15:41.861972+0000","last_undegraded":"2024-09-10T23:15:41.861972+0000","last_fullsized":"2024-09-10T23:15:41.861972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453293+0000","last_change":"2024-09-10T23:15:36.821061+0000","last_active":"2024-09-10T23:15:42.453293+0000","last_peered":"2024-09-10T23:15:42.453293+0000","last_clean":"2024-09-10T23:15:42.453293+0000","last_became_active":"2024-09-10T23:15:36.820728+0000","last_became_peered":"2024-09-10T23:15:36.820728+0000","last_unstale":"2024-09-10T23:15:42.453293+0000","last_undegraded":"2024-09-10T23:15:42.453293+0000","last_fullsized":"2024-09-10T23:15:42.453293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:09.763137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976723+0000","last_change":"2024-09-10T23:15:36.817451+0000","last_active":"2024-09-10T23:15:41.976723+0000","last_peered":"2024-09-10T23:15:41.976723+0000","last_clean":"2024-09-10T23:15:41.976723+0000","last_became_active":"2024-09-10T23:15:36.817180+0000","last_became_peered":"2024-09-10T23:15:36.817180+0000","last_unstale":"2024-09-10T23:15:41.976723+0000","last_undegraded":"2024-09-10T23:15:41.976723+0000","last_fullsized":"2024-09-10T23:15:41.976723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:42.144340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478095+0000","last_change":"2024-09-10T23:15:36.834283+0000","last_active":"2024-09-10T23:15:42.478095+0000","last_peered":"2024-09-10T23:15:42.478095+0000","last_clean":"2024-09-10T23:15:42.478095+0000","last_became_active":"2024-09-10T23:15:36.832423+0000","last_became_peered":"2024-09-10T23:15:36.832423+0000","last_unstale":"2024-09-10T23:15:42.478095+0000","last_undegraded":"2024-09-10T23:15:42.478095+0000","last_fullsized":"2024-09-10T23:15:42.478095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:33.744306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966222+0000","last_change":"2024-09-10T23:15:36.817174+0000","last_active":"2024-09-10T23:15:41.966222+0000","last_peered":"2024-09-10T23:15:41.966222+0000","last_clean":"2024-09-10T23:15:41.966222+0000","last_became_active":"2024-09-10T23:15:36.816873+0000","last_became_peered":"2024-09-10T23:15:36.816873+0000","last_unstale":"2024-09-10T23:15:41.966222+0000","last_undegraded":"2024-09-10T23:15:41.966222+0000","last_fullsized":"2024-09-10T23:15:41.966222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866980+0000","last_change":"2024-09-10T23:15:36.814417+0000","last_active":"2024-09-10T23:15:41.866980+0000","last_peered":"2024-09-10T23:15:41.866980+0000","last_clean":"2024-09-10T23:15:41.866980+0000","last_became_active":"2024-09-10T23:15:36.814142+0000","last_became_peered":"2024-09-10T23:15:36.814142+0000","last_unstale":"2024-09-10T23:15:41.866980+0000","last_undegraded":"2024-09-10T23:15:41.866980+0000","last_fullsized":"2024-09-10T23:15:41.866980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478307+0000","last_change":"2024-09-10T23:15:36.827366+0000","last_active":"2024-09-10T23:15:42.478307+0000","last_peered":"2024-09-10T23:15:42.478307+0000","last_clean":"2024-09-10T23:15:42.478307+0000","last_became_active":"2024-09-10T23:15:36.827030+0000","last_became_peered":"2024-09-10T23:15:36.827030+0000","last_unstale":"2024-09-10T23:15:42.478307+0000","last_undegraded":"2024-09-10T23:15:42.478307+0000","last_fullsized":"2024-09-10T23:15:42.478307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:01.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453085+0000","last_change":"2024-09-10T23:15:36.825171+0000","last_active":"2024-09-10T23:15:42.453085+0000","last_peered":"2024-09-10T23:15:42.453085+0000","last_clean":"2024-09-10T23:15:42.453085+0000","last_became_active":"2024-09-10T23:15:36.824807+0000","last_became_peered":"2024-09-10T23:15:36.824807+0000","last_unstale":"2024-09-10T23:15:42.453085+0000","last_undegraded":"2024-09-10T23:15:42.453085+0000","last_fullsized":"2024-09-10T23:15:42.453085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:12.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477668+0000","last_change":"2024-09-10T23:15:36.828041+0000","last_active":"2024-09-10T23:15:42.477668+0000","last_peered":"2024-09-10T23:15:42.477668+0000","last_clean":"2024-09-10T23:15:42.477668+0000","last_became_active":"2024-09-10T23:15:36.827715+0000","last_became_peered":"2024-09-10T23:15:36.827715+0000","last_unstale":"2024-09-10T23:15:42.477668+0000","last_undegraded":"2024-09-10T23:15:42.477668+0000","last_fullsized":"2024-09-10T23:15:42.477668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:23.592896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453188+0000","last_change":"2024-09-10T23:15:36.827045+0000","last_active":"2024-09-10T23:15:42.453188+0000","last_peered":"2024-09-10T23:15:42.453188+0000","last_clean":"2024-09-10T23:15:42.453188+0000","last_became_active":"2024-09-10T23:15:36.826738+0000","last_became_peered":"2024-09-10T23:15:36.826738+0000","last_unstale":"2024-09-10T23:15:42.453188+0000","last_undegraded":"2024-09-10T23:15:42.453188+0000","last_fullsized":"2024-09-10T23:15:42.453188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:16.055380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976502+0000","last_change":"2024-09-10T23:15:36.826859+0000","last_active":"2024-09-10T23:15:41.976502+0000","last_peered":"2024-09-10T23:15:41.976502+0000","last_clean":"2024-09-10T23:15:41.976502+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:41.976502+0000","last_undegraded":"2024-09-10T23:15:41.976502+0000","last_fullsized":"2024-09-10T23:15:41.976502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.142950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866951+0000","last_change":"2024-09-10T23:15:36.840021+0000","last_active":"2024-09-10T23:15:41.866951+0000","last_peered":"2024-09-10T23:15:41.866951+0000","last_clean":"2024-09-10T23:15:41.866951+0000","last_became_active":"2024-09-10T23:15:36.839028+0000","last_became_peered":"2024-09-10T23:15:36.839028+0000","last_unstale":"2024-09-10T23:15:41.866951+0000","last_undegraded":"2024-09-10T23:15:41.866951+0000","last_fullsized":"2024-09-10T23:15:41.866951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:25.766975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083601+0000","last_change":"2024-09-10T23:15:36.817847+0000","last_active":"2024-09-10T23:15:42.083601+0000","last_peered":"2024-09-10T23:15:42.083601+0000","last_clean":"2024-09-10T23:15:42.083601+0000","last_became_active":"2024-09-10T23:15:36.817492+0000","last_became_peered":"2024-09-10T23:15:36.817492+0000","last_unstale":"2024-09-10T23:15:42.083601+0000","last_undegraded":"2024-09-10T23:15:42.083601+0000","last_fullsized":"2024-09-10T23:15:42.083601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:39.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862623+0000","last_change":"2024-09-10T23:15:36.818420+0000","last_active":"2024-09-10T23:15:41.862623+0000","last_peered":"2024-09-10T23:15:41.862623+0000","last_clean":"2024-09-10T23:15:41.862623+0000","last_became_active":"2024-09-10T23:15:36.818130+0000","last_became_peered":"2024-09-10T23:15:36.818130+0000","last_unstale":"2024-09-10T23:15:41.862623+0000","last_undegraded":"2024-09-10T23:15:41.862623+0000","last_fullsized":"2024-09-10T23:15:41.862623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:12.540137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453936+0000","last_change":"2024-09-10T23:15:36.823439+0000","last_active":"2024-09-10T23:15:42.453936+0000","last_peered":"2024-09-10T23:15:42.453936+0000","last_clean":"2024-09-10T23:15:42.453936+0000","last_became_active":"2024-09-10T23:15:36.823181+0000","last_became_peered":"2024-09-10T23:15:36.823181+0000","last_unstale":"2024-09-10T23:15:42.453936+0000","last_undegraded":"2024-09-10T23:15:42.453936+0000","last_fullsized":"2024-09-10T23:15:42.453936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:58.331888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.452952+0000","last_change":"2024-09-10T23:15:36.816826+0000","last_active":"2024-09-10T23:15:42.452952+0000","last_peered":"2024-09-10T23:15:42.452952+0000","last_clean":"2024-09-10T23:15:42.452952+0000","last_became_active":"2024-09-10T23:15:36.816557+0000","last_became_peered":"2024-09-10T23:15:36.816557+0000","last_unstale":"2024-09-10T23:15:42.452952+0000","last_undegraded":"2024-09-10T23:15:42.452952+0000","last_fullsized":"2024-09-10T23:15:42.452952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:58.172702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965639+0000","last_change":"2024-09-10T23:15:36.815890+0000","last_active":"2024-09-10T23:15:41.965639+0000","last_peered":"2024-09-10T23:15:41.965639+0000","last_clean":"2024-09-10T23:15:41.965639+0000","last_became_active":"2024-09-10T23:15:36.815610+0000","last_became_peered":"2024-09-10T23:15:36.815610+0000","last_unstale":"2024-09-10T23:15:41.965639+0000","last_undegraded":"2024-09-10T23:15:41.965639+0000","last_fullsized":"2024-09-10T23:15:41.965639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976461+0000","last_change":"2024-09-10T23:15:36.809792+0000","last_active":"2024-09-10T23:15:41.976461+0000","last_peered":"2024-09-10T23:15:41.976461+0000","last_clean":"2024-09-10T23:15:41.976461+0000","last_became_active":"2024-09-10T23:15:36.809448+0000","last_became_peered":"2024-09-10T23:15:36.809448+0000","last_unstale":"2024-09-10T23:15:41.976461+0000","last_undegraded":"2024-09-10T23:15:41.976461+0000","last_fullsized":"2024-09-10T23:15:41.976461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477756+0000","last_change":"2024-09-10T23:15:36.817574+0000","last_active":"2024-09-10T23:15:42.477756+0000","last_peered":"2024-09-10T23:15:42.477756+0000","last_clean":"2024-09-10T23:15:42.477756+0000","last_became_active":"2024-09-10T23:15:36.817319+0000","last_became_peered":"2024-09-10T23:15:36.817319+0000","last_unstale":"2024-09-10T23:15:42.477756+0000","last_undegraded":"2024-09-10T23:15:42.477756+0000","last_fullsized":"2024-09-10T23:15:42.477756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:13.250839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050667+0000","last_change":"2024-09-10T23:15:36.819031+0000","last_active":"2024-09-10T23:15:42.050667+0000","last_peered":"2024-09-10T23:15:42.050667+0000","last_clean":"2024-09-10T23:15:42.050667+0000","last_became_active":"2024-09-10T23:15:36.818398+0000","last_became_peered":"2024-09-10T23:15:36.818398+0000","last_unstale":"2024-09-10T23:15:42.050667+0000","last_undegraded":"2024-09-10T23:15:42.050667+0000","last_fullsized":"2024-09-10T23:15:42.050667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866752+0000","last_change":"2024-09-10T23:15:36.838074+0000","last_active":"2024-09-10T23:15:41.866752+0000","last_peered":"2024-09-10T23:15:41.866752+0000","last_clean":"2024-09-10T23:15:41.866752+0000","last_became_active":"2024-09-10T23:15:36.837841+0000","last_became_peered":"2024-09-10T23:15:36.837841+0000","last_unstale":"2024-09-10T23:15:41.866752+0000","last_undegraded":"2024-09-10T23:15:41.866752+0000","last_fullsized":"2024-09-10T23:15:41.866752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866888+0000","last_change":"2024-09-10T23:15:36.837828+0000","last_active":"2024-09-10T23:15:41.866888+0000","last_peered":"2024-09-10T23:15:41.866888+0000","last_clean":"2024-09-10T23:15:41.866888+0000","last_became_active":"2024-09-10T23:15:36.837356+0000","last_became_peered":"2024-09-10T23:15:36.837356+0000","last_unstale":"2024-09-10T23:15:41.866888+0000","last_undegraded":"2024-09-10T23:15:41.866888+0000","last_fullsized":"2024-09-10T23:15:41.866888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083795+0000","last_change":"2024-09-10T23:15:36.833388+0000","last_active":"2024-09-10T23:15:42.083795+0000","last_peered":"2024-09-10T23:15:42.083795+0000","last_clean":"2024-09-10T23:15:42.083795+0000","last_became_active":"2024-09-10T23:15:36.832978+0000","last_became_peered":"2024-09-10T23:15:36.832978+0000","last_unstale":"2024-09-10T23:15:42.083795+0000","last_undegraded":"2024-09-10T23:15:42.083795+0000","last_fullsized":"2024-09-10T23:15:42.083795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:46.059643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477408+0000","last_change":"2024-09-10T23:15:36.824751+0000","last_active":"2024-09-10T23:15:42.477408+0000","last_peered":"2024-09-10T23:15:42.477408+0000","last_clean":"2024-09-10T23:15:42.477408+0000","last_became_active":"2024-09-10T23:15:36.824453+0000","last_became_peered":"2024-09-10T23:15:36.824453+0000","last_unstale":"2024-09-10T23:15:42.477408+0000","last_undegraded":"2024-09-10T23:15:42.477408+0000","last_fullsized":"2024-09-10T23:15:42.477408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:15.565815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083075+0000","last_change":"2024-09-10T23:15:36.825819+0000","last_active":"2024-09-10T23:15:42.083075+0000","last_peered":"2024-09-10T23:15:42.083075+0000","last_clean":"2024-09-10T23:15:42.083075+0000","last_became_active":"2024-09-10T23:15:36.825572+0000","last_became_peered":"2024-09-10T23:15:36.825572+0000","last_unstale":"2024-09-10T23:15:42.083075+0000","last_undegraded":"2024-09-10T23:15:42.083075+0000","last_fullsized":"2024-09-10T23:15:42.083075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:12.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453098+0000","last_change":"2024-09-10T23:15:36.821090+0000","last_active":"2024-09-10T23:15:42.453098+0000","last_peered":"2024-09-10T23:15:42.453098+0000","last_clean":"2024-09-10T23:15:42.453098+0000","last_became_active":"2024-09-10T23:15:36.820786+0000","last_became_peered":"2024-09-10T23:15:36.820786+0000","last_unstale":"2024-09-10T23:15:42.453098+0000","last_undegraded":"2024-09-10T23:15:42.453098+0000","last_fullsized":"2024-09-10T23:15:42.453098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083221+0000","last_change":"2024-09-10T23:15:36.826772+0000","last_active":"2024-09-10T23:15:42.083221+0000","last_peered":"2024-09-10T23:15:42.083221+0000","last_clean":"2024-09-10T23:15:42.083221+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:42.083221+0000","last_undegraded":"2024-09-10T23:15:42.083221+0000","last_fullsized":"2024-09-10T23:15:42.083221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:57.600178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453408+0000","last_change":"2024-09-10T23:15:36.821049+0000","last_active":"2024-09-10T23:15:42.453408+0000","last_peered":"2024-09-10T23:15:42.453408+0000","last_clean":"2024-09-10T23:15:42.453408+0000","last_became_active":"2024-09-10T23:15:36.820392+0000","last_became_peered":"2024-09-10T23:15:36.820392+0000","last_unstale":"2024-09-10T23:15:42.453408+0000","last_undegraded":"2024-09-10T23:15:42.453408+0000","last_fullsized":"2024-09-10T23:15:42.453408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:15.850959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976642+0000","last_change":"2024-09-10T23:15:36.813236+0000","last_active":"2024-09-10T23:15:41.976642+0000","last_peered":"2024-09-10T23:15:41.976642+0000","last_clean":"2024-09-10T23:15:41.976642+0000","last_became_active":"2024-09-10T23:15:36.809383+0000","last_became_peered":"2024-09-10T23:15:36.809383+0000","last_unstale":"2024-09-10T23:15:41.976642+0000","last_undegraded":"2024-09-10T23:15:41.976642+0000","last_fullsized":"2024-09-10T23:15:41.976642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966446+0000","last_change":"2024-09-10T23:15:36.811515+0000","last_active":"2024-09-10T23:15:41.966446+0000","last_peered":"2024-09-10T23:15:41.966446+0000","last_clean":"2024-09-10T23:15:41.966446+0000","last_became_active":"2024-09-10T23:15:36.811215+0000","last_became_peered":"2024-09-10T23:15:36.811215+0000","last_unstale":"2024-09-10T23:15:41.966446+0000","last_undegraded":"2024-09-10T23:15:41.966446+0000","last_fullsized":"2024-09-10T23:15:41.966446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083737+0000","last_change":"2024-09-10T23:15:36.848698+0000","last_active":"2024-09-10T23:15:42.083737+0000","last_peered":"2024-09-10T23:15:42.083737+0000","last_clean":"2024-09-10T23:15:42.083737+0000","last_became_active":"2024-09-10T23:15:36.848106+0000","last_became_peered":"2024-09-10T23:15:36.848106+0000","last_unstale":"2024-09-10T23:15:42.083737+0000","last_undegraded":"2024-09-10T23:15:42.083737+0000","last_fullsized":"2024-09-10T23:15:42.083737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:15.850959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476746,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":110367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":110403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":110277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":110437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":888832,"data_stored":701283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:16:03.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:16:03.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 -- 172.21.15.17:0/459640445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c4c070ad0 msgr2=0x7f7c4c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 --2- 172.21.15.17:0/459640445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c4c070ad0 0x7f7c4c15f060 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0cf010 tx=0x7f7c3c01c7f0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 -- 172.21.15.17:0/459640445 shutdown_connections 2024-09-10T23:16:03.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 --2- 172.21.15.17:0/459640445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c4c070ad0 0x7f7c4c15f060 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 -- 172.21.15.17:0/459640445 >> 172.21.15.17:0/459640445 conn(0x7f7c4c0d1d60 msgr2=0x7f7c4c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:03.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 -- 172.21.15.17:0/459640445 shutdown_connections 2024-09-10T23:16:03.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 -- 172.21.15.17:0/459640445 wait complete. 2024-09-10T23:16:03.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 Processor -- start 2024-09-10T23:16:03.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 -- start start 2024-09-10T23:16:03.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.867+0000 7f7c53a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c4c070ad0 0x7f7c4c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c53a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c0cf320 0x7f7c4c0c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c53a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c4c0d1830 0x7f7c4c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c53a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c16a4e0 con 0x7f7c4c0cf320 2024-09-10T23:16:03.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c53a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c15fa00 con 0x7f7c4c0d1830 2024-09-10T23:16:03.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c53a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c16a660 con 0x7f7c4c070ad0 2024-09-10T23:16:03.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c43e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c0cf320 0x7f7c4c0c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c43e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c0cf320 0x7f7c4c0c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34320/0 (socket says 172.21.15.17:34320) 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c43e00640 1 -- 172.21.15.17:0/9581043 learned_addr learned my addr 172.21.15.17:0/9581043 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c51000640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c4c070ad0 0x7f7c4c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c51a00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c4c0d1830 0x7f7c4c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c43e00640 1 -- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c4c070ad0 msgr2=0x7f7c4c153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c43e00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c4c070ad0 0x7f7c4c153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c43e00640 1 -- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c4c0d1830 msgr2=0x7f7c4c0c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c43e00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c4c0d1830 0x7f7c4c0c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c43e00640 1 -- 172.21.15.17:0/9581043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c0c7fb0 con 0x7f7c4c0cf320 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c43e00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c0cf320 0x7f7c4c0c70e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400c420 tx=0x7f7c3400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c49600640 1 -- 172.21.15.17:0/9581043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c34017070 con 0x7f7c4c0cf320 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c49600640 1 -- 172.21.15.17:0/9581043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c340053c0 con 0x7f7c4c0cf320 2024-09-10T23:16:03.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c49600640 1 -- 172.21.15.17:0/9581043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c34003860 con 0x7f7c4c0cf320 2024-09-10T23:16:03.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c0c8290 con 0x7f7c4c0cf320 2024-09-10T23:16:03.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c0c7b60 con 0x7f7c4c0cf320 2024-09-10T23:16:03.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c15f060 con 0x7f7c4c0cf320 2024-09-10T23:16:03.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.871+0000 7f7c49600640 1 -- 172.21.15.17:0/9581043 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7c34003a00 con 0x7f7c4c0cf320 2024-09-10T23:16:03.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.875+0000 7f7c49600640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c280725e0 0x7f7c28074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:03.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.875+0000 7f7c49600640 1 -- 172.21.15.17:0/9581043 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7c34092b30 con 0x7f7c4c0cf320 2024-09-10T23:16:03.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.875+0000 7f7c51000640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c280725e0 0x7f7c28074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:03.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.875+0000 7f7c51000640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c280725e0 0x7f7c28074aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0af000 tx=0x7f7c3c01b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:03.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:03.879+0000 7f7c49600640 1 -- 172.21.15.17:0/9581043 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7c3405d870 con 0x7f7c4c0cf320 2024-09-10T23:16:04.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.047+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c4c0cc190 con 0x7f7c280725e0 2024-09-10T23:16:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.055+0000 7f7c49600640 1 -- 172.21.15.17:0/9581043 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f7c4c0cc190 con 0x7f7c280725e0 2024-09-10T23:16:04.061 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:16:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c280725e0 msgr2=0x7f7c28074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c280725e0 0x7f7c28074aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0af000 tx=0x7f7c3c01b030 comp rx=0 tx=0).stop 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c0cf320 msgr2=0x7f7c4c0c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c0cf320 0x7f7c4c0c70e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400c420 tx=0x7f7c3400c8e0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 shutdown_connections 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c280725e0 0x7f7c28074aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c4c0d1830 0x7f7c4c0c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c4c0cf320 0x7f7c4c0c70e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 --2- 172.21.15.17:0/9581043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c4c070ad0 0x7f7c4c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 >> 172.21.15.17:0/9581043 conn(0x7f7c4c0d1d60 msgr2=0x7f7c4c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 shutdown_connections 2024-09-10T23:16:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.059+0000 7f7c53a00640 1 -- 172.21.15.17:0/9581043 wait complete. 2024-09-10T23:16:04.081 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-10T23:16:02.298252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232128,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742592,"statfs":{"total":773094113280,"available":772856414208,"internally_reserved":0,"allocated":3514368,"data_stored":2072232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003183"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976877+0000","last_change":"2024-09-10T23:15:35.814652+0000","last_active":"2024-09-10T23:15:41.976877+0000","last_peered":"2024-09-10T23:15:41.976877+0000","last_clean":"2024-09-10T23:15:41.976877+0000","last_became_active":"2024-09-10T23:15:35.813651+0000","last_became_peered":"2024-09-10T23:15:35.813651+0000","last_unstale":"2024-09-10T23:15:41.976877+0000","last_undegraded":"2024-09-10T23:15:41.976877+0000","last_fullsized":"2024-09-10T23:15:41.976877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:03.885457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478220+0000","last_change":"2024-09-10T23:15:36.816888+0000","last_active":"2024-09-10T23:15:42.478220+0000","last_peered":"2024-09-10T23:15:42.478220+0000","last_clean":"2024-09-10T23:15:42.478220+0000","last_became_active":"2024-09-10T23:15:36.816546+0000","last_became_peered":"2024-09-10T23:15:36.816546+0000","last_unstale":"2024-09-10T23:15:42.478220+0000","last_undegraded":"2024-09-10T23:15:42.478220+0000","last_fullsized":"2024-09-10T23:15:42.478220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:15.359059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477480+0000","last_change":"2024-09-10T23:15:40.918612+0000","last_active":"2024-09-10T23:15:42.477480+0000","last_peered":"2024-09-10T23:15:42.477480+0000","last_clean":"2024-09-10T23:15:42.477480+0000","last_became_active":"2024-09-10T23:15:40.917951+0000","last_became_peered":"2024-09-10T23:15:40.917951+0000","last_unstale":"2024-09-10T23:15:42.477480+0000","last_undegraded":"2024-09-10T23:15:42.477480+0000","last_fullsized":"2024-09-10T23:15:42.477480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:58.740153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478306+0000","last_change":"2024-09-10T23:15:35.820658+0000","last_active":"2024-09-10T23:15:42.478306+0000","last_peered":"2024-09-10T23:15:42.478306+0000","last_clean":"2024-09-10T23:15:42.478306+0000","last_became_active":"2024-09-10T23:15:35.820362+0000","last_became_peered":"2024-09-10T23:15:35.820362+0000","last_unstale":"2024-09-10T23:15:42.478306+0000","last_undegraded":"2024-09-10T23:15:42.478306+0000","last_fullsized":"2024-09-10T23:15:42.478306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:59.264177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976763+0000","last_change":"2024-09-10T23:15:36.826442+0000","last_active":"2024-09-10T23:15:41.976763+0000","last_peered":"2024-09-10T23:15:41.976763+0000","last_clean":"2024-09-10T23:15:41.976763+0000","last_became_active":"2024-09-10T23:15:36.826134+0000","last_became_peered":"2024-09-10T23:15:36.826134+0000","last_unstale":"2024-09-10T23:15:41.976763+0000","last_undegraded":"2024-09-10T23:15:41.976763+0000","last_fullsized":"2024-09-10T23:15:41.976763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:25.766975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050245+0000","last_change":"2024-09-10T23:15:40.846375+0000","last_active":"2024-09-10T23:15:42.050245+0000","last_peered":"2024-09-10T23:15:42.050245+0000","last_clean":"2024-09-10T23:15:42.050245+0000","last_became_active":"2024-09-10T23:15:40.845497+0000","last_became_peered":"2024-09-10T23:15:40.845497+0000","last_unstale":"2024-09-10T23:15:42.050245+0000","last_undegraded":"2024-09-10T23:15:42.050245+0000","last_fullsized":"2024-09-10T23:15:42.050245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:56.268422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083553+0000","last_change":"2024-09-10T23:15:35.824606+0000","last_active":"2024-09-10T23:15:42.083553+0000","last_peered":"2024-09-10T23:15:42.083553+0000","last_clean":"2024-09-10T23:15:42.083553+0000","last_became_active":"2024-09-10T23:15:35.824294+0000","last_became_peered":"2024-09-10T23:15:35.824294+0000","last_unstale":"2024-09-10T23:15:42.083553+0000","last_undegraded":"2024-09-10T23:15:42.083553+0000","last_fullsized":"2024-09-10T23:15:42.083553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453441+0000","last_change":"2024-09-10T23:15:36.833443+0000","last_active":"2024-09-10T23:15:42.453441+0000","last_peered":"2024-09-10T23:15:42.453441+0000","last_clean":"2024-09-10T23:15:42.453441+0000","last_became_active":"2024-09-10T23:15:36.831507+0000","last_became_peered":"2024-09-10T23:15:36.831507+0000","last_unstale":"2024-09-10T23:15:42.453441+0000","last_undegraded":"2024-09-10T23:15:42.453441+0000","last_fullsized":"2024-09-10T23:15:42.453441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:46.059643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050541+0000","last_change":"2024-09-10T23:15:40.848217+0000","last_active":"2024-09-10T23:15:42.050541+0000","last_peered":"2024-09-10T23:15:42.050541+0000","last_clean":"2024-09-10T23:15:42.050541+0000","last_became_active":"2024-09-10T23:15:40.847206+0000","last_became_peered":"2024-09-10T23:15:40.847206+0000","last_unstale":"2024-09-10T23:15:42.050541+0000","last_undegraded":"2024-09-10T23:15:42.050541+0000","last_fullsized":"2024-09-10T23:15:42.050541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:13.797702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083326+0000","last_change":"2024-09-10T23:15:35.824509+0000","last_active":"2024-09-10T23:15:42.083326+0000","last_peered":"2024-09-10T23:15:42.083326+0000","last_clean":"2024-09-10T23:15:42.083326+0000","last_became_active":"2024-09-10T23:15:35.824204+0000","last_became_peered":"2024-09-10T23:15:35.824204+0000","last_unstale":"2024-09-10T23:15:42.083326+0000","last_undegraded":"2024-09-10T23:15:42.083326+0000","last_fullsized":"2024-09-10T23:15:42.083326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:11.532685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453590+0000","last_change":"2024-09-10T23:15:36.828659+0000","last_active":"2024-09-10T23:15:42.453590+0000","last_peered":"2024-09-10T23:15:42.453590+0000","last_clean":"2024-09-10T23:15:42.453590+0000","last_became_active":"2024-09-10T23:15:36.828322+0000","last_became_peered":"2024-09-10T23:15:36.828322+0000","last_unstale":"2024-09-10T23:15:42.453590+0000","last_undegraded":"2024-09-10T23:15:42.453590+0000","last_fullsized":"2024-09-10T23:15:42.453590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:02.889244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050319+0000","last_change":"2024-09-10T23:15:40.849484+0000","last_active":"2024-09-10T23:15:42.050319+0000","last_peered":"2024-09-10T23:15:42.050319+0000","last_clean":"2024-09-10T23:15:42.050319+0000","last_became_active":"2024-09-10T23:15:40.848878+0000","last_became_peered":"2024-09-10T23:15:40.848878+0000","last_unstale":"2024-09-10T23:15:42.050319+0000","last_undegraded":"2024-09-10T23:15:42.050319+0000","last_fullsized":"2024-09-10T23:15:42.050319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:20.089945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866699+0000","last_change":"2024-09-10T23:15:36.837333+0000","last_active":"2024-09-10T23:15:41.866699+0000","last_peered":"2024-09-10T23:15:41.866699+0000","last_clean":"2024-09-10T23:15:41.866699+0000","last_became_active":"2024-09-10T23:15:36.837159+0000","last_became_peered":"2024-09-10T23:15:36.837159+0000","last_unstale":"2024-09-10T23:15:41.866699+0000","last_undegraded":"2024-09-10T23:15:41.866699+0000","last_fullsized":"2024-09-10T23:15:41.866699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:42.144340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083393+0000","last_change":"2024-09-10T23:15:35.821008+0000","last_active":"2024-09-10T23:15:42.083393+0000","last_peered":"2024-09-10T23:15:42.083393+0000","last_clean":"2024-09-10T23:15:42.083393+0000","last_became_active":"2024-09-10T23:15:35.820800+0000","last_became_peered":"2024-09-10T23:15:35.820800+0000","last_unstale":"2024-09-10T23:15:42.083393+0000","last_undegraded":"2024-09-10T23:15:42.083393+0000","last_fullsized":"2024-09-10T23:15:42.083393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050630+0000","last_change":"2024-09-10T23:15:40.850423+0000","last_active":"2024-09-10T23:15:42.050630+0000","last_peered":"2024-09-10T23:15:42.050630+0000","last_clean":"2024-09-10T23:15:42.050630+0000","last_became_active":"2024-09-10T23:15:40.848512+0000","last_became_peered":"2024-09-10T23:15:40.848512+0000","last_unstale":"2024-09-10T23:15:42.050630+0000","last_undegraded":"2024-09-10T23:15:42.050630+0000","last_fullsized":"2024-09-10T23:15:42.050630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:06.923809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477795+0000","last_change":"2024-09-10T23:15:36.815925+0000","last_active":"2024-09-10T23:15:42.477795+0000","last_peered":"2024-09-10T23:15:42.477795+0000","last_clean":"2024-09-10T23:15:42.477795+0000","last_became_active":"2024-09-10T23:15:36.815528+0000","last_became_peered":"2024-09-10T23:15:36.815528+0000","last_unstale":"2024-09-10T23:15:42.477795+0000","last_undegraded":"2024-09-10T23:15:42.477795+0000","last_fullsized":"2024-09-10T23:15:42.477795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:09.964148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965964+0000","last_change":"2024-09-10T23:15:35.819766+0000","last_active":"2024-09-10T23:15:41.965964+0000","last_peered":"2024-09-10T23:15:41.965964+0000","last_clean":"2024-09-10T23:15:41.965964+0000","last_became_active":"2024-09-10T23:15:35.819208+0000","last_became_peered":"2024-09-10T23:15:35.819208+0000","last_unstale":"2024-09-10T23:15:41.965964+0000","last_undegraded":"2024-09-10T23:15:41.965964+0000","last_fullsized":"2024-09-10T23:15:41.965964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050814+0000","last_change":"2024-09-10T23:15:40.845547+0000","last_active":"2024-09-10T23:15:42.050814+0000","last_peered":"2024-09-10T23:15:42.050814+0000","last_clean":"2024-09-10T23:15:42.050814+0000","last_became_active":"2024-09-10T23:15:40.842954+0000","last_became_peered":"2024-09-10T23:15:40.842954+0000","last_unstale":"2024-09-10T23:15:42.050814+0000","last_undegraded":"2024-09-10T23:15:42.050814+0000","last_fullsized":"2024-09-10T23:15:42.050814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:50.094208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477613+0000","last_change":"2024-09-10T23:15:36.810636+0000","last_active":"2024-09-10T23:15:42.477613+0000","last_peered":"2024-09-10T23:15:42.477613+0000","last_clean":"2024-09-10T23:15:42.477613+0000","last_became_active":"2024-09-10T23:15:36.810344+0000","last_became_peered":"2024-09-10T23:15:36.810344+0000","last_unstale":"2024-09-10T23:15:42.477613+0000","last_undegraded":"2024-09-10T23:15:42.477613+0000","last_fullsized":"2024-09-10T23:15:42.477613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:04.853549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965671+0000","last_change":"2024-09-10T23:15:35.817152+0000","last_active":"2024-09-10T23:15:41.965671+0000","last_peered":"2024-09-10T23:15:41.965671+0000","last_clean":"2024-09-10T23:15:41.965671+0000","last_became_active":"2024-09-10T23:15:35.815119+0000","last_became_peered":"2024-09-10T23:15:35.815119+0000","last_unstale":"2024-09-10T23:15:41.965671+0000","last_undegraded":"2024-09-10T23:15:41.965671+0000","last_fullsized":"2024-09-10T23:15:41.965671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966575+0000","last_change":"2024-09-10T23:15:40.922557+0000","last_active":"2024-09-10T23:15:41.966575+0000","last_peered":"2024-09-10T23:15:41.966575+0000","last_clean":"2024-09-10T23:15:41.966575+0000","last_became_active":"2024-09-10T23:15:40.921331+0000","last_became_peered":"2024-09-10T23:15:40.921331+0000","last_unstale":"2024-09-10T23:15:41.966575+0000","last_undegraded":"2024-09-10T23:15:41.966575+0000","last_fullsized":"2024-09-10T23:15:41.966575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:02.366453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050961+0000","last_change":"2024-09-10T23:15:36.807834+0000","last_active":"2024-09-10T23:15:42.050961+0000","last_peered":"2024-09-10T23:15:42.050961+0000","last_clean":"2024-09-10T23:15:42.050961+0000","last_became_active":"2024-09-10T23:15:36.807456+0000","last_became_peered":"2024-09-10T23:15:36.807456+0000","last_unstale":"2024-09-10T23:15:42.050961+0000","last_undegraded":"2024-09-10T23:15:42.050961+0000","last_fullsized":"2024-09-10T23:15:42.050961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:53.903864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.082975+0000","last_change":"2024-09-10T23:15:35.818465+0000","last_active":"2024-09-10T23:15:42.082975+0000","last_peered":"2024-09-10T23:15:42.082975+0000","last_clean":"2024-09-10T23:15:42.082975+0000","last_became_active":"2024-09-10T23:15:35.818170+0000","last_became_peered":"2024-09-10T23:15:35.818170+0000","last_unstale":"2024-09-10T23:15:42.082975+0000","last_undegraded":"2024-09-10T23:15:42.082975+0000","last_fullsized":"2024-09-10T23:15:42.082975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:18.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050681+0000","last_change":"2024-09-10T23:15:40.845836+0000","last_active":"2024-09-10T23:15:42.050681+0000","last_peered":"2024-09-10T23:15:42.050681+0000","last_clean":"2024-09-10T23:15:42.050681+0000","last_became_active":"2024-09-10T23:15:40.845311+0000","last_became_peered":"2024-09-10T23:15:40.845311+0000","last_unstale":"2024-09-10T23:15:42.050681+0000","last_undegraded":"2024-09-10T23:15:42.050681+0000","last_fullsized":"2024-09-10T23:15:42.050681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:19.885524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977347+0000","last_change":"2024-09-10T23:15:36.809745+0000","last_active":"2024-09-10T23:15:41.977347+0000","last_peered":"2024-09-10T23:15:41.977347+0000","last_clean":"2024-09-10T23:15:41.977347+0000","last_became_active":"2024-09-10T23:15:36.809472+0000","last_became_peered":"2024-09-10T23:15:36.809472+0000","last_unstale":"2024-09-10T23:15:41.977347+0000","last_undegraded":"2024-09-10T23:15:41.977347+0000","last_fullsized":"2024-09-10T23:15:41.977347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:46.554507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.867243+0000","last_change":"2024-09-10T23:15:35.817617+0000","last_active":"2024-09-10T23:15:41.867243+0000","last_peered":"2024-09-10T23:15:41.867243+0000","last_clean":"2024-09-10T23:15:41.867243+0000","last_became_active":"2024-09-10T23:15:35.817324+0000","last_became_peered":"2024-09-10T23:15:35.817324+0000","last_unstale":"2024-09-10T23:15:41.867243+0000","last_undegraded":"2024-09-10T23:15:41.867243+0000","last_fullsized":"2024-09-10T23:15:41.867243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050252+0000","last_change":"2024-09-10T23:15:40.918183+0000","last_active":"2024-09-10T23:15:42.050252+0000","last_peered":"2024-09-10T23:15:42.050252+0000","last_clean":"2024-09-10T23:15:42.050252+0000","last_became_active":"2024-09-10T23:15:40.917821+0000","last_became_peered":"2024-09-10T23:15:40.917821+0000","last_unstale":"2024-09-10T23:15:42.050252+0000","last_undegraded":"2024-09-10T23:15:42.050252+0000","last_fullsized":"2024-09-10T23:15:42.050252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:16.274683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478404+0000","last_change":"2024-09-10T23:15:36.819985+0000","last_active":"2024-09-10T23:15:42.478404+0000","last_peered":"2024-09-10T23:15:42.478404+0000","last_clean":"2024-09-10T23:15:42.478404+0000","last_became_active":"2024-09-10T23:15:36.819707+0000","last_became_peered":"2024-09-10T23:15:36.819707+0000","last_unstale":"2024-09-10T23:15:42.478404+0000","last_undegraded":"2024-09-10T23:15:42.478404+0000","last_fullsized":"2024-09-10T23:15:42.478404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:23:38.630118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966455+0000","last_change":"2024-09-10T23:15:35.815615+0000","last_active":"2024-09-10T23:15:41.966455+0000","last_peered":"2024-09-10T23:15:41.966455+0000","last_clean":"2024-09-10T23:15:41.966455+0000","last_became_active":"2024-09-10T23:15:35.813771+0000","last_became_peered":"2024-09-10T23:15:35.813771+0000","last_unstale":"2024-09-10T23:15:41.966455+0000","last_undegraded":"2024-09-10T23:15:41.966455+0000","last_fullsized":"2024-09-10T23:15:41.966455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477424+0000","last_change":"2024-09-10T23:15:40.918250+0000","last_active":"2024-09-10T23:15:42.477424+0000","last_peered":"2024-09-10T23:15:42.477424+0000","last_clean":"2024-09-10T23:15:42.477424+0000","last_became_active":"2024-09-10T23:15:40.917549+0000","last_became_peered":"2024-09-10T23:15:40.917549+0000","last_unstale":"2024-09-10T23:15:42.477424+0000","last_undegraded":"2024-09-10T23:15:42.477424+0000","last_fullsized":"2024-09-10T23:15:42.477424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:43.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966106+0000","last_change":"2024-09-10T23:15:36.805882+0000","last_active":"2024-09-10T23:15:41.966106+0000","last_peered":"2024-09-10T23:15:41.966106+0000","last_clean":"2024-09-10T23:15:41.966106+0000","last_became_active":"2024-09-10T23:15:36.805560+0000","last_became_peered":"2024-09-10T23:15:36.805560+0000","last_unstale":"2024-09-10T23:15:41.966106+0000","last_undegraded":"2024-09-10T23:15:41.966106+0000","last_fullsized":"2024-09-10T23:15:41.966106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083674+0000","last_change":"2024-09-10T23:15:35.825152+0000","last_active":"2024-09-10T23:15:42.083674+0000","last_peered":"2024-09-10T23:15:42.083674+0000","last_clean":"2024-09-10T23:15:42.083674+0000","last_became_active":"2024-09-10T23:15:35.824913+0000","last_became_peered":"2024-09-10T23:15:35.824913+0000","last_unstale":"2024-09-10T23:15:42.083674+0000","last_undegraded":"2024-09-10T23:15:42.083674+0000","last_fullsized":"2024-09-10T23:15:42.083674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976537+0000","last_change":"2024-09-10T23:15:40.923130+0000","last_active":"2024-09-10T23:15:41.976537+0000","last_peered":"2024-09-10T23:15:41.976537+0000","last_clean":"2024-09-10T23:15:41.976537+0000","last_became_active":"2024-09-10T23:15:40.922673+0000","last_became_peered":"2024-09-10T23:15:40.922673+0000","last_unstale":"2024-09-10T23:15:41.976537+0000","last_undegraded":"2024-09-10T23:15:41.976537+0000","last_fullsized":"2024-09-10T23:15:41.976537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453737+0000","last_change":"2024-09-10T23:15:36.823984+0000","last_active":"2024-09-10T23:15:42.453737+0000","last_peered":"2024-09-10T23:15:42.453737+0000","last_clean":"2024-09-10T23:15:42.453737+0000","last_became_active":"2024-09-10T23:15:36.821937+0000","last_became_peered":"2024-09-10T23:15:36.821937+0000","last_unstale":"2024-09-10T23:15:42.453737+0000","last_undegraded":"2024-09-10T23:15:42.453737+0000","last_fullsized":"2024-09-10T23:15:42.453737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:39.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966125+0000","last_change":"2024-09-10T23:15:35.814369+0000","last_active":"2024-09-10T23:15:41.966125+0000","last_peered":"2024-09-10T23:15:41.966125+0000","last_clean":"2024-09-10T23:15:41.966125+0000","last_became_active":"2024-09-10T23:15:35.813084+0000","last_became_peered":"2024-09-10T23:15:35.813084+0000","last_unstale":"2024-09-10T23:15:41.966125+0000","last_undegraded":"2024-09-10T23:15:41.966125+0000","last_fullsized":"2024-09-10T23:15:41.966125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965646+0000","last_change":"2024-09-10T23:15:40.856726+0000","last_active":"2024-09-10T23:15:41.965646+0000","last_peered":"2024-09-10T23:15:41.965646+0000","last_clean":"2024-09-10T23:15:41.965646+0000","last_became_active":"2024-09-10T23:15:40.852472+0000","last_became_peered":"2024-09-10T23:15:40.852472+0000","last_unstale":"2024-09-10T23:15:41.965646+0000","last_undegraded":"2024-09-10T23:15:41.965646+0000","last_fullsized":"2024-09-10T23:15:41.965646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.051146+0000","last_change":"2024-09-10T23:15:36.812895+0000","last_active":"2024-09-10T23:15:42.051146+0000","last_peered":"2024-09-10T23:15:42.051146+0000","last_clean":"2024-09-10T23:15:42.051146+0000","last_became_active":"2024-09-10T23:15:36.811704+0000","last_became_peered":"2024-09-10T23:15:36.811704+0000","last_unstale":"2024-09-10T23:15:42.051146+0000","last_undegraded":"2024-09-10T23:15:42.051146+0000","last_fullsized":"2024-09-10T23:15:42.051146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:15.129050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453461+0000","last_change":"2024-09-10T23:15:35.806612+0000","last_active":"2024-09-10T23:15:42.453461+0000","last_peered":"2024-09-10T23:15:42.453461+0000","last_clean":"2024-09-10T23:15:42.453461+0000","last_became_active":"2024-09-10T23:15:35.806252+0000","last_became_peered":"2024-09-10T23:15:35.806252+0000","last_unstale":"2024-09-10T23:15:42.453461+0000","last_undegraded":"2024-09-10T23:15:42.453461+0000","last_fullsized":"2024-09-10T23:15:42.453461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:14.121598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966028+0000","last_change":"2024-09-10T23:15:40.850623+0000","last_active":"2024-09-10T23:15:41.966028+0000","last_peered":"2024-09-10T23:15:41.966028+0000","last_clean":"2024-09-10T23:15:41.966028+0000","last_became_active":"2024-09-10T23:15:40.850268+0000","last_became_peered":"2024-09-10T23:15:40.850268+0000","last_unstale":"2024-09-10T23:15:41.966028+0000","last_undegraded":"2024-09-10T23:15:41.966028+0000","last_fullsized":"2024-09-10T23:15:41.966028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.634743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965723+0000","last_change":"2024-09-10T23:15:36.806814+0000","last_active":"2024-09-10T23:15:41.965723+0000","last_peered":"2024-09-10T23:15:41.965723+0000","last_clean":"2024-09-10T23:15:41.965723+0000","last_became_active":"2024-09-10T23:15:36.806543+0000","last_became_peered":"2024-09-10T23:15:36.806543+0000","last_unstale":"2024-09-10T23:15:41.965723+0000","last_undegraded":"2024-09-10T23:15:41.965723+0000","last_fullsized":"2024-09-10T23:15:41.965723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:27.255285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862034+0000","last_change":"2024-09-10T23:15:35.820635+0000","last_active":"2024-09-10T23:15:41.862034+0000","last_peered":"2024-09-10T23:15:41.862034+0000","last_clean":"2024-09-10T23:15:41.862034+0000","last_became_active":"2024-09-10T23:15:35.820316+0000","last_became_peered":"2024-09-10T23:15:35.820316+0000","last_unstale":"2024-09-10T23:15:41.862034+0000","last_undegraded":"2024-09-10T23:15:41.862034+0000","last_fullsized":"2024-09-10T23:15:41.862034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966617+0000","last_change":"2024-09-10T23:15:40.861082+0000","last_active":"2024-09-10T23:15:41.966617+0000","last_peered":"2024-09-10T23:15:41.966617+0000","last_clean":"2024-09-10T23:15:41.966617+0000","last_became_active":"2024-09-10T23:15:40.857518+0000","last_became_peered":"2024-09-10T23:15:40.857518+0000","last_unstale":"2024-09-10T23:15:41.966617+0000","last_undegraded":"2024-09-10T23:15:41.966617+0000","last_fullsized":"2024-09-10T23:15:41.966617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:15.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976242+0000","last_change":"2024-09-10T23:15:36.820294+0000","last_active":"2024-09-10T23:15:41.976242+0000","last_peered":"2024-09-10T23:15:41.976242+0000","last_clean":"2024-09-10T23:15:41.976242+0000","last_became_active":"2024-09-10T23:15:36.820007+0000","last_became_peered":"2024-09-10T23:15:36.820007+0000","last_unstale":"2024-09-10T23:15:41.976242+0000","last_undegraded":"2024-09-10T23:15:41.976242+0000","last_fullsized":"2024-09-10T23:15:41.976242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:59.107579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.082976+0000","last_change":"2024-09-10T23:15:35.821318+0000","last_active":"2024-09-10T23:15:42.082976+0000","last_peered":"2024-09-10T23:15:42.082976+0000","last_clean":"2024-09-10T23:15:42.082976+0000","last_became_active":"2024-09-10T23:15:35.821042+0000","last_became_peered":"2024-09-10T23:15:35.821042+0000","last_unstale":"2024-09-10T23:15:42.082976+0000","last_undegraded":"2024-09-10T23:15:42.082976+0000","last_fullsized":"2024-09-10T23:15:42.082976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:19.082501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977207+0000","last_change":"2024-09-10T23:15:40.919738+0000","last_active":"2024-09-10T23:15:41.977207+0000","last_peered":"2024-09-10T23:15:41.977207+0000","last_clean":"2024-09-10T23:15:41.977207+0000","last_became_active":"2024-09-10T23:15:40.919341+0000","last_became_peered":"2024-09-10T23:15:40.919341+0000","last_unstale":"2024-09-10T23:15:41.977207+0000","last_undegraded":"2024-09-10T23:15:41.977207+0000","last_fullsized":"2024-09-10T23:15:41.977207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:15.961730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477545+0000","last_change":"2024-09-10T23:15:36.825565+0000","last_active":"2024-09-10T23:15:42.477545+0000","last_peered":"2024-09-10T23:15:42.477545+0000","last_clean":"2024-09-10T23:15:42.477545+0000","last_became_active":"2024-09-10T23:15:36.825010+0000","last_became_peered":"2024-09-10T23:15:36.825010+0000","last_unstale":"2024-09-10T23:15:42.477545+0000","last_undegraded":"2024-09-10T23:15:42.477545+0000","last_fullsized":"2024-09-10T23:15:42.477545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:29.344583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453413+0000","last_change":"2024-09-10T23:15:35.809248+0000","last_active":"2024-09-10T23:15:42.453413+0000","last_peered":"2024-09-10T23:15:42.453413+0000","last_clean":"2024-09-10T23:15:42.453413+0000","last_became_active":"2024-09-10T23:15:35.808922+0000","last_became_peered":"2024-09-10T23:15:35.808922+0000","last_unstale":"2024-09-10T23:15:42.453413+0000","last_undegraded":"2024-09-10T23:15:42.453413+0000","last_fullsized":"2024-09-10T23:15:42.453413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083106+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:15:42.083106+0000","last_peered":"2024-09-10T23:15:42.083106+0000","last_clean":"2024-09-10T23:15:42.083106+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:15:42.083106+0000","last_undegraded":"2024-09-10T23:15:42.083106+0000","last_fullsized":"2024-09-10T23:15:42.083106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866508+0000","last_change":"2024-09-10T23:15:40.919822+0000","last_active":"2024-09-10T23:15:41.866508+0000","last_peered":"2024-09-10T23:15:41.866508+0000","last_clean":"2024-09-10T23:15:41.866508+0000","last_became_active":"2024-09-10T23:15:40.919328+0000","last_became_peered":"2024-09-10T23:15:40.919328+0000","last_unstale":"2024-09-10T23:15:41.866508+0000","last_undegraded":"2024-09-10T23:15:41.866508+0000","last_fullsized":"2024-09-10T23:15:41.866508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:06.923809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083445+0000","last_change":"2024-09-10T23:15:36.830835+0000","last_active":"2024-09-10T23:15:42.083445+0000","last_peered":"2024-09-10T23:15:42.083445+0000","last_clean":"2024-09-10T23:15:42.083445+0000","last_became_active":"2024-09-10T23:15:36.830577+0000","last_became_peered":"2024-09-10T23:15:36.830577+0000","last_unstale":"2024-09-10T23:15:42.083445+0000","last_undegraded":"2024-09-10T23:15:42.083445+0000","last_fullsized":"2024-09-10T23:15:42.083445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:02.889244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862500+0000","last_change":"2024-09-10T23:15:35.810227+0000","last_active":"2024-09-10T23:15:41.862500+0000","last_peered":"2024-09-10T23:15:41.862500+0000","last_clean":"2024-09-10T23:15:41.862500+0000","last_became_active":"2024-09-10T23:15:35.809934+0000","last_became_peered":"2024-09-10T23:15:35.809934+0000","last_unstale":"2024-09-10T23:15:41.862500+0000","last_undegraded":"2024-09-10T23:15:41.862500+0000","last_fullsized":"2024-09-10T23:15:41.862500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866742+0000","last_change":"2024-09-10T23:15:40.920305+0000","last_active":"2024-09-10T23:15:41.866742+0000","last_peered":"2024-09-10T23:15:41.866742+0000","last_clean":"2024-09-10T23:15:41.866742+0000","last_became_active":"2024-09-10T23:15:40.919525+0000","last_became_peered":"2024-09-10T23:15:40.919525+0000","last_unstale":"2024-09-10T23:15:41.866742+0000","last_undegraded":"2024-09-10T23:15:41.866742+0000","last_fullsized":"2024-09-10T23:15:41.866742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:19.885524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453520+0000","last_change":"2024-09-10T23:15:36.821403+0000","last_active":"2024-09-10T23:15:42.453520+0000","last_peered":"2024-09-10T23:15:42.453520+0000","last_clean":"2024-09-10T23:15:42.453520+0000","last_became_active":"2024-09-10T23:15:36.820075+0000","last_became_peered":"2024-09-10T23:15:36.820075+0000","last_unstale":"2024-09-10T23:15:42.453520+0000","last_undegraded":"2024-09-10T23:15:42.453520+0000","last_fullsized":"2024-09-10T23:15:42.453520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:58.090078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966385+0000","last_change":"2024-09-10T23:15:35.809772+0000","last_active":"2024-09-10T23:15:41.966385+0000","last_peered":"2024-09-10T23:15:41.966385+0000","last_clean":"2024-09-10T23:15:41.966385+0000","last_became_active":"2024-09-10T23:15:35.808856+0000","last_became_peered":"2024-09-10T23:15:35.808856+0000","last_unstale":"2024-09-10T23:15:41.966385+0000","last_undegraded":"2024-09-10T23:15:41.966385+0000","last_fullsized":"2024-09-10T23:15:41.966385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:11.532685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976700+0000","last_change":"2024-09-10T23:15:40.854344+0000","last_active":"2024-09-10T23:15:41.976700+0000","last_peered":"2024-09-10T23:15:41.976700+0000","last_clean":"2024-09-10T23:15:41.976700+0000","last_became_active":"2024-09-10T23:15:40.853674+0000","last_became_peered":"2024-09-10T23:15:40.853674+0000","last_unstale":"2024-09-10T23:15:41.976700+0000","last_undegraded":"2024-09-10T23:15:41.976700+0000","last_fullsized":"2024-09-10T23:15:41.976700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:02.124643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083823+0000","last_change":"2024-09-10T23:15:36.830949+0000","last_active":"2024-09-10T23:15:42.083823+0000","last_peered":"2024-09-10T23:15:42.083823+0000","last_clean":"2024-09-10T23:15:42.083823+0000","last_became_active":"2024-09-10T23:15:36.830634+0000","last_became_peered":"2024-09-10T23:15:36.830634+0000","last_unstale":"2024-09-10T23:15:42.083823+0000","last_undegraded":"2024-09-10T23:15:42.083823+0000","last_fullsized":"2024-09-10T23:15:42.083823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:58.331888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862700+0000","last_change":"2024-09-10T23:15:35.821546+0000","last_active":"2024-09-10T23:15:41.862700+0000","last_peered":"2024-09-10T23:15:41.862700+0000","last_clean":"2024-09-10T23:15:41.862700+0000","last_became_active":"2024-09-10T23:15:35.821344+0000","last_became_peered":"2024-09-10T23:15:35.821344+0000","last_unstale":"2024-09-10T23:15:41.862700+0000","last_undegraded":"2024-09-10T23:15:41.862700+0000","last_fullsized":"2024-09-10T23:15:41.862700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.452950+0000","last_change":"2024-09-10T23:15:40.916580+0000","last_active":"2024-09-10T23:15:42.452950+0000","last_peered":"2024-09-10T23:15:42.452950+0000","last_clean":"2024-09-10T23:15:42.452950+0000","last_became_active":"2024-09-10T23:15:40.915945+0000","last_became_peered":"2024-09-10T23:15:40.915945+0000","last_unstale":"2024-09-10T23:15:42.452950+0000","last_undegraded":"2024-09-10T23:15:42.452950+0000","last_fullsized":"2024-09-10T23:15:42.452950+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:06.214916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083651+0000","last_change":"2024-09-10T23:15:36.829540+0000","last_active":"2024-09-10T23:15:42.083651+0000","last_peered":"2024-09-10T23:15:42.083651+0000","last_clean":"2024-09-10T23:15:42.083651+0000","last_became_active":"2024-09-10T23:15:36.829163+0000","last_became_peered":"2024-09-10T23:15:36.829163+0000","last_unstale":"2024-09-10T23:15:42.083651+0000","last_undegraded":"2024-09-10T23:15:42.083651+0000","last_fullsized":"2024-09-10T23:15:42.083651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:58.090078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050719+0000","last_change":"2024-09-10T23:15:35.819239+0000","last_active":"2024-09-10T23:15:42.050719+0000","last_peered":"2024-09-10T23:15:42.050719+0000","last_clean":"2024-09-10T23:15:42.050719+0000","last_became_active":"2024-09-10T23:15:35.818934+0000","last_became_peered":"2024-09-10T23:15:35.818934+0000","last_unstale":"2024-09-10T23:15:42.050719+0000","last_undegraded":"2024-09-10T23:15:42.050719+0000","last_fullsized":"2024-09-10T23:15:42.050719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:01.687726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050169+0000","last_change":"2024-09-10T23:15:40.842548+0000","last_active":"2024-09-10T23:15:42.050169+0000","last_peered":"2024-09-10T23:15:42.050169+0000","last_clean":"2024-09-10T23:15:42.050169+0000","last_became_active":"2024-09-10T23:15:40.842051+0000","last_became_peered":"2024-09-10T23:15:40.842051+0000","last_unstale":"2024-09-10T23:15:42.050169+0000","last_undegraded":"2024-09-10T23:15:42.050169+0000","last_fullsized":"2024-09-10T23:15:42.050169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:22.992518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083147+0000","last_change":"2024-09-10T23:15:36.838447+0000","last_active":"2024-09-10T23:15:42.083147+0000","last_peered":"2024-09-10T23:15:42.083147+0000","last_clean":"2024-09-10T23:15:42.083147+0000","last_became_active":"2024-09-10T23:15:36.836105+0000","last_became_peered":"2024-09-10T23:15:36.836105+0000","last_unstale":"2024-09-10T23:15:42.083147+0000","last_undegraded":"2024-09-10T23:15:42.083147+0000","last_fullsized":"2024-09-10T23:15:42.083147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:16.055380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.861808+0000","last_change":"2024-09-10T23:15:35.807363+0000","last_active":"2024-09-10T23:15:41.861808+0000","last_peered":"2024-09-10T23:15:41.861808+0000","last_clean":"2024-09-10T23:15:41.861808+0000","last_became_active":"2024-09-10T23:15:35.807055+0000","last_became_peered":"2024-09-10T23:15:35.807055+0000","last_unstale":"2024-09-10T23:15:41.861808+0000","last_undegraded":"2024-09-10T23:15:41.861808+0000","last_fullsized":"2024-09-10T23:15:41.861808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:08.518905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.977108+0000","last_change":"2024-09-10T23:15:40.858906+0000","last_active":"2024-09-10T23:15:41.977108+0000","last_peered":"2024-09-10T23:15:41.977108+0000","last_clean":"2024-09-10T23:15:41.977108+0000","last_became_active":"2024-09-10T23:15:40.858496+0000","last_became_peered":"2024-09-10T23:15:40.858496+0000","last_unstale":"2024-09-10T23:15:41.977108+0000","last_undegraded":"2024-09-10T23:15:41.977108+0000","last_fullsized":"2024-09-10T23:15:41.977108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:02.366453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866358+0000","last_change":"2024-09-10T23:15:36.817753+0000","last_active":"2024-09-10T23:15:41.866358+0000","last_peered":"2024-09-10T23:15:41.866358+0000","last_clean":"2024-09-10T23:15:41.866358+0000","last_became_active":"2024-09-10T23:15:36.817206+0000","last_became_peered":"2024-09-10T23:15:36.817206+0000","last_unstale":"2024-09-10T23:15:41.866358+0000","last_undegraded":"2024-09-10T23:15:41.866358+0000","last_fullsized":"2024-09-10T23:15:41.866358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866623+0000","last_change":"2024-09-10T23:15:35.821188+0000","last_active":"2024-09-10T23:15:41.866623+0000","last_peered":"2024-09-10T23:15:41.866623+0000","last_clean":"2024-09-10T23:15:41.866623+0000","last_became_active":"2024-09-10T23:15:35.820920+0000","last_became_peered":"2024-09-10T23:15:35.820920+0000","last_unstale":"2024-09-10T23:15:41.866623+0000","last_undegraded":"2024-09-10T23:15:41.866623+0000","last_fullsized":"2024-09-10T23:15:41.866623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478460+0000","last_change":"2024-09-10T23:15:40.918593+0000","last_active":"2024-09-10T23:15:42.478460+0000","last_peered":"2024-09-10T23:15:42.478460+0000","last_clean":"2024-09-10T23:15:42.478460+0000","last_became_active":"2024-09-10T23:15:40.917690+0000","last_became_peered":"2024-09-10T23:15:40.917690+0000","last_unstale":"2024-09-10T23:15:42.478460+0000","last_undegraded":"2024-09-10T23:15:42.478460+0000","last_fullsized":"2024-09-10T23:15:42.478460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:29.798786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083337+0000","last_change":"2024-09-10T23:15:36.832264+0000","last_active":"2024-09-10T23:15:42.083337+0000","last_peered":"2024-09-10T23:15:42.083337+0000","last_clean":"2024-09-10T23:15:42.083337+0000","last_became_active":"2024-09-10T23:15:36.831964+0000","last_became_peered":"2024-09-10T23:15:36.831964+0000","last_unstale":"2024-09-10T23:15:42.083337+0000","last_undegraded":"2024-09-10T23:15:42.083337+0000","last_fullsized":"2024-09-10T23:15:42.083337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:11.927165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453323+0000","last_change":"2024-09-10T23:15:35.820445+0000","last_active":"2024-09-10T23:15:42.453323+0000","last_peered":"2024-09-10T23:15:42.453323+0000","last_clean":"2024-09-10T23:15:42.453323+0000","last_became_active":"2024-09-10T23:15:35.820097+0000","last_became_peered":"2024-09-10T23:15:35.820097+0000","last_unstale":"2024-09-10T23:15:42.453323+0000","last_undegraded":"2024-09-10T23:15:42.453323+0000","last_fullsized":"2024-09-10T23:15:42.453323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478082+0000","last_change":"2024-09-10T23:15:40.915679+0000","last_active":"2024-09-10T23:15:42.478082+0000","last_peered":"2024-09-10T23:15:42.478082+0000","last_clean":"2024-09-10T23:15:42.478082+0000","last_became_active":"2024-09-10T23:15:40.915242+0000","last_became_peered":"2024-09-10T23:15:40.915242+0000","last_unstale":"2024-09-10T23:15:42.478082+0000","last_undegraded":"2024-09-10T23:15:42.478082+0000","last_fullsized":"2024-09-10T23:15:42.478082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:03.887614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976508+0000","last_change":"2024-09-10T23:15:36.826848+0000","last_active":"2024-09-10T23:15:41.976508+0000","last_peered":"2024-09-10T23:15:41.976508+0000","last_clean":"2024-09-10T23:15:41.976508+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:41.976508+0000","last_undegraded":"2024-09-10T23:15:41.976508+0000","last_fullsized":"2024-09-10T23:15:41.976508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:36:50.455932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976827+0000","last_change":"2024-09-10T23:15:35.810368+0000","last_active":"2024-09-10T23:15:41.976827+0000","last_peered":"2024-09-10T23:15:41.976827+0000","last_clean":"2024-09-10T23:15:41.976827+0000","last_became_active":"2024-09-10T23:15:35.810056+0000","last_became_peered":"2024-09-10T23:15:35.810056+0000","last_unstale":"2024-09-10T23:15:41.976827+0000","last_undegraded":"2024-09-10T23:15:41.976827+0000","last_fullsized":"2024-09-10T23:15:41.976827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:31.969010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453668+0000","last_change":"2024-09-10T23:15:40.919743+0000","last_active":"2024-09-10T23:15:42.453668+0000","last_peered":"2024-09-10T23:15:42.453668+0000","last_clean":"2024-09-10T23:15:42.453668+0000","last_became_active":"2024-09-10T23:15:40.919307+0000","last_became_peered":"2024-09-10T23:15:40.919307+0000","last_unstale":"2024-09-10T23:15:42.453668+0000","last_undegraded":"2024-09-10T23:15:42.453668+0000","last_fullsized":"2024-09-10T23:15:42.453668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:51.552927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083357+0000","last_change":"2024-09-10T23:15:36.830195+0000","last_active":"2024-09-10T23:15:42.083357+0000","last_peered":"2024-09-10T23:15:42.083357+0000","last_clean":"2024-09-10T23:15:42.083357+0000","last_became_active":"2024-09-10T23:15:36.829550+0000","last_became_peered":"2024-09-10T23:15:36.829550+0000","last_unstale":"2024-09-10T23:15:42.083357+0000","last_undegraded":"2024-09-10T23:15:42.083357+0000","last_fullsized":"2024-09-10T23:15:42.083357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:09.763137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:47.850923+0000","last_change":"2024-09-10T23:15:35.822196+0000","last_active":"2024-09-10T23:15:47.850923+0000","last_peered":"2024-09-10T23:15:47.850923+0000","last_clean":"2024-09-10T23:15:47.850923+0000","last_became_active":"2024-09-10T23:15:35.821931+0000","last_became_peered":"2024-09-10T23:15:35.821931+0000","last_unstale":"2024-09-10T23:15:47.850923+0000","last_undegraded":"2024-09-10T23:15:47.850923+0000","last_fullsized":"2024-09-10T23:15:47.850923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:50.801464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965806+0000","last_change":"2024-09-10T23:15:40.857747+0000","last_active":"2024-09-10T23:15:41.965806+0000","last_peered":"2024-09-10T23:15:41.965806+0000","last_clean":"2024-09-10T23:15:41.965806+0000","last_became_active":"2024-09-10T23:15:40.851809+0000","last_became_peered":"2024-09-10T23:15:40.851809+0000","last_unstale":"2024-09-10T23:15:41.965806+0000","last_undegraded":"2024-09-10T23:15:41.965806+0000","last_fullsized":"2024-09-10T23:15:41.965806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:02.124643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050798+0000","last_change":"2024-09-10T23:15:36.819353+0000","last_active":"2024-09-10T23:15:42.050798+0000","last_peered":"2024-09-10T23:15:42.050798+0000","last_clean":"2024-09-10T23:15:42.050798+0000","last_became_active":"2024-09-10T23:15:36.818733+0000","last_became_peered":"2024-09-10T23:15:36.818733+0000","last_unstale":"2024-09-10T23:15:42.050798+0000","last_undegraded":"2024-09-10T23:15:42.050798+0000","last_fullsized":"2024-09-10T23:15:42.050798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:12.540137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966319+0000","last_change":"2024-09-10T23:15:35.809473+0000","last_active":"2024-09-10T23:15:41.966319+0000","last_peered":"2024-09-10T23:15:41.966319+0000","last_clean":"2024-09-10T23:15:41.966319+0000","last_became_active":"2024-09-10T23:15:35.808925+0000","last_became_peered":"2024-09-10T23:15:35.808925+0000","last_unstale":"2024-09-10T23:15:41.966319+0000","last_undegraded":"2024-09-10T23:15:41.966319+0000","last_fullsized":"2024-09-10T23:15:41.966319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:18.382868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050944+0000","last_change":"2024-09-10T23:15:40.845501+0000","last_active":"2024-09-10T23:15:42.050944+0000","last_peered":"2024-09-10T23:15:42.050944+0000","last_clean":"2024-09-10T23:15:42.050944+0000","last_became_active":"2024-09-10T23:15:40.845002+0000","last_became_peered":"2024-09-10T23:15:40.845002+0000","last_unstale":"2024-09-10T23:15:42.050944+0000","last_undegraded":"2024-09-10T23:15:42.050944+0000","last_fullsized":"2024-09-10T23:15:42.050944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:43.622719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976880+0000","last_change":"2024-09-10T23:15:36.823879+0000","last_active":"2024-09-10T23:15:41.976880+0000","last_peered":"2024-09-10T23:15:41.976880+0000","last_clean":"2024-09-10T23:15:41.976880+0000","last_became_active":"2024-09-10T23:15:36.823569+0000","last_became_peered":"2024-09-10T23:15:36.823569+0000","last_unstale":"2024-09-10T23:15:41.976880+0000","last_undegraded":"2024-09-10T23:15:41.976880+0000","last_fullsized":"2024-09-10T23:15:41.976880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453728+0000","last_change":"2024-09-10T23:15:35.821328+0000","last_active":"2024-09-10T23:15:42.453728+0000","last_peered":"2024-09-10T23:15:42.453728+0000","last_clean":"2024-09-10T23:15:42.453728+0000","last_became_active":"2024-09-10T23:15:35.820992+0000","last_became_peered":"2024-09-10T23:15:35.820992+0000","last_unstale":"2024-09-10T23:15:42.453728+0000","last_undegraded":"2024-09-10T23:15:42.453728+0000","last_fullsized":"2024-09-10T23:15:42.453728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:57:28.264236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477653+0000","last_change":"2024-09-10T23:15:40.853378+0000","last_active":"2024-09-10T23:15:42.477653+0000","last_peered":"2024-09-10T23:15:42.477653+0000","last_clean":"2024-09-10T23:15:42.477653+0000","last_became_active":"2024-09-10T23:15:40.851797+0000","last_became_peered":"2024-09-10T23:15:40.851797+0000","last_unstale":"2024-09-10T23:15:42.477653+0000","last_undegraded":"2024-09-10T23:15:42.477653+0000","last_fullsized":"2024-09-10T23:15:42.477653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:35.499058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453617+0000","last_change":"2024-09-10T23:15:36.827207+0000","last_active":"2024-09-10T23:15:42.453617+0000","last_peered":"2024-09-10T23:15:42.453617+0000","last_clean":"2024-09-10T23:15:42.453617+0000","last_became_active":"2024-09-10T23:15:36.826929+0000","last_became_peered":"2024-09-10T23:15:36.826929+0000","last_unstale":"2024-09-10T23:15:42.453617+0000","last_undegraded":"2024-09-10T23:15:42.453617+0000","last_fullsized":"2024-09-10T23:15:42.453617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:57.600178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.867150+0000","last_change":"2024-09-10T23:15:35.817151+0000","last_active":"2024-09-10T23:15:41.867150+0000","last_peered":"2024-09-10T23:15:41.867150+0000","last_clean":"2024-09-10T23:15:41.867150+0000","last_became_active":"2024-09-10T23:15:35.816069+0000","last_became_peered":"2024-09-10T23:15:35.816069+0000","last_unstale":"2024-09-10T23:15:41.867150+0000","last_undegraded":"2024-09-10T23:15:41.867150+0000","last_fullsized":"2024-09-10T23:15:41.867150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.896411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477587+0000","last_change":"2024-09-10T23:15:40.919083+0000","last_active":"2024-09-10T23:15:42.477587+0000","last_peered":"2024-09-10T23:15:42.477587+0000","last_clean":"2024-09-10T23:15:42.477587+0000","last_became_active":"2024-09-10T23:15:40.917807+0000","last_became_peered":"2024-09-10T23:15:40.917807+0000","last_unstale":"2024-09-10T23:15:42.477587+0000","last_undegraded":"2024-09-10T23:15:42.477587+0000","last_fullsized":"2024-09-10T23:15:42.477587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:53.108885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976987+0000","last_change":"2024-09-10T23:15:40.919668+0000","last_active":"2024-09-10T23:15:41.976987+0000","last_peered":"2024-09-10T23:15:41.976987+0000","last_clean":"2024-09-10T23:15:41.976987+0000","last_became_active":"2024-09-10T23:15:40.919242+0000","last_became_peered":"2024-09-10T23:15:40.919242+0000","last_unstale":"2024-09-10T23:15:41.976987+0000","last_undegraded":"2024-09-10T23:15:41.976987+0000","last_fullsized":"2024-09-10T23:15:41.976987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:01.634743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965554+0000","last_change":"2024-09-10T23:15:36.811659+0000","last_active":"2024-09-10T23:15:41.965554+0000","last_peered":"2024-09-10T23:15:41.965554+0000","last_clean":"2024-09-10T23:15:41.965554+0000","last_became_active":"2024-09-10T23:15:36.811297+0000","last_became_peered":"2024-09-10T23:15:36.811297+0000","last_unstale":"2024-09-10T23:15:41.965554+0000","last_undegraded":"2024-09-10T23:15:41.965554+0000","last_fullsized":"2024-09-10T23:15:41.965554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:51.803249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453169+0000","last_change":"2024-09-10T23:15:35.807726+0000","last_active":"2024-09-10T23:15:42.453169+0000","last_peered":"2024-09-10T23:15:42.453169+0000","last_clean":"2024-09-10T23:15:42.453169+0000","last_became_active":"2024-09-10T23:15:35.807144+0000","last_became_peered":"2024-09-10T23:15:35.807144+0000","last_unstale":"2024-09-10T23:15:42.453169+0000","last_undegraded":"2024-09-10T23:15:42.453169+0000","last_fullsized":"2024-09-10T23:15:42.453169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866991+0000","last_change":"2024-09-10T23:15:40.855753+0000","last_active":"2024-09-10T23:15:41.866991+0000","last_peered":"2024-09-10T23:15:41.866991+0000","last_clean":"2024-09-10T23:15:41.866991+0000","last_became_active":"2024-09-10T23:15:40.855320+0000","last_became_peered":"2024-09-10T23:15:40.855320+0000","last_unstale":"2024-09-10T23:15:41.866991+0000","last_undegraded":"2024-09-10T23:15:41.866991+0000","last_fullsized":"2024-09-10T23:15:41.866991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:50.094208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477523+0000","last_change":"2024-09-10T23:15:36.816132+0000","last_active":"2024-09-10T23:15:42.477523+0000","last_peered":"2024-09-10T23:15:42.477523+0000","last_clean":"2024-09-10T23:15:42.477523+0000","last_became_active":"2024-09-10T23:15:36.815801+0000","last_became_peered":"2024-09-10T23:15:36.815801+0000","last_unstale":"2024-09-10T23:15:42.477523+0000","last_undegraded":"2024-09-10T23:15:42.477523+0000","last_fullsized":"2024-09-10T23:15:42.477523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:01.311893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477667+0000","last_change":"2024-09-10T23:15:35.824434+0000","last_active":"2024-09-10T23:15:42.477667+0000","last_peered":"2024-09-10T23:15:42.477667+0000","last_clean":"2024-09-10T23:15:42.477667+0000","last_became_active":"2024-09-10T23:15:35.823485+0000","last_became_peered":"2024-09-10T23:15:35.823485+0000","last_unstale":"2024-09-10T23:15:42.477667+0000","last_undegraded":"2024-09-10T23:15:42.477667+0000","last_fullsized":"2024-09-10T23:15:42.477667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:04.088733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866955+0000","last_change":"2024-09-10T23:15:35.818427+0000","last_active":"2024-09-10T23:15:41.866955+0000","last_peered":"2024-09-10T23:15:41.866955+0000","last_clean":"2024-09-10T23:15:41.866955+0000","last_became_active":"2024-09-10T23:15:35.818167+0000","last_became_peered":"2024-09-10T23:15:35.818167+0000","last_unstale":"2024-09-10T23:15:41.866955+0000","last_undegraded":"2024-09-10T23:15:41.866955+0000","last_fullsized":"2024-09-10T23:15:41.866955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:00.809417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976819+0000","last_change":"2024-09-10T23:15:36.822253+0000","last_active":"2024-09-10T23:15:41.976819+0000","last_peered":"2024-09-10T23:15:41.976819+0000","last_clean":"2024-09-10T23:15:41.976819+0000","last_became_active":"2024-09-10T23:15:36.821990+0000","last_became_peered":"2024-09-10T23:15:36.821990+0000","last_unstale":"2024-09-10T23:15:41.976819+0000","last_undegraded":"2024-09-10T23:15:41.976819+0000","last_fullsized":"2024-09-10T23:15:41.976819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862372+0000","last_change":"2024-09-10T23:15:40.842622+0000","last_active":"2024-09-10T23:15:41.862372+0000","last_peered":"2024-09-10T23:15:41.862372+0000","last_clean":"2024-09-10T23:15:41.862372+0000","last_became_active":"2024-09-10T23:15:40.842113+0000","last_became_peered":"2024-09-10T23:15:40.842113+0000","last_unstale":"2024-09-10T23:15:41.862372+0000","last_undegraded":"2024-09-10T23:15:41.862372+0000","last_fullsized":"2024-09-10T23:15:41.862372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:03.142144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477876+0000","last_change":"2024-09-10T23:15:35.823540+0000","last_active":"2024-09-10T23:15:42.477876+0000","last_peered":"2024-09-10T23:15:42.477876+0000","last_clean":"2024-09-10T23:15:42.477876+0000","last_became_active":"2024-09-10T23:15:35.823054+0000","last_became_peered":"2024-09-10T23:15:35.823054+0000","last_unstale":"2024-09-10T23:15:42.477876+0000","last_undegraded":"2024-09-10T23:15:42.477876+0000","last_fullsized":"2024-09-10T23:15:42.477876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:34.773122+0000","last_clean_scrub_stamp":"2024-09-10T23:15:34.773122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:04.057636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050474+0000","last_change":"2024-09-10T23:15:36.812487+0000","last_active":"2024-09-10T23:15:42.050474+0000","last_peered":"2024-09-10T23:15:42.050474+0000","last_clean":"2024-09-10T23:15:42.050474+0000","last_became_active":"2024-09-10T23:15:36.812141+0000","last_became_peered":"2024-09-10T23:15:36.812141+0000","last_unstale":"2024-09-10T23:15:42.050474+0000","last_undegraded":"2024-09-10T23:15:42.050474+0000","last_fullsized":"2024-09-10T23:15:42.050474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:51.808916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478078+0000","last_change":"2024-09-10T23:15:40.847773+0000","last_active":"2024-09-10T23:15:42.478078+0000","last_peered":"2024-09-10T23:15:42.478078+0000","last_clean":"2024-09-10T23:15:42.478078+0000","last_became_active":"2024-09-10T23:15:40.847351+0000","last_became_peered":"2024-09-10T23:15:40.847351+0000","last_unstale":"2024-09-10T23:15:42.478078+0000","last_undegraded":"2024-09-10T23:15:42.478078+0000","last_fullsized":"2024-09-10T23:15:42.478078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:39.815139+0000","last_clean_scrub_stamp":"2024-09-10T23:15:39.815139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:56.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866237+0000","last_change":"2024-09-10T23:15:36.817479+0000","last_active":"2024-09-10T23:15:41.866237+0000","last_peered":"2024-09-10T23:15:41.866237+0000","last_clean":"2024-09-10T23:15:41.866237+0000","last_became_active":"2024-09-10T23:15:36.816922+0000","last_became_peered":"2024-09-10T23:15:36.816922+0000","last_unstale":"2024-09-10T23:15:41.866237+0000","last_undegraded":"2024-09-10T23:15:41.866237+0000","last_fullsized":"2024-09-10T23:15:41.866237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.142950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.861972+0000","last_change":"2024-09-10T23:15:36.819587+0000","last_active":"2024-09-10T23:15:41.861972+0000","last_peered":"2024-09-10T23:15:41.861972+0000","last_clean":"2024-09-10T23:15:41.861972+0000","last_became_active":"2024-09-10T23:15:36.819330+0000","last_became_peered":"2024-09-10T23:15:36.819330+0000","last_unstale":"2024-09-10T23:15:41.861972+0000","last_undegraded":"2024-09-10T23:15:41.861972+0000","last_fullsized":"2024-09-10T23:15:41.861972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453293+0000","last_change":"2024-09-10T23:15:36.821061+0000","last_active":"2024-09-10T23:15:42.453293+0000","last_peered":"2024-09-10T23:15:42.453293+0000","last_clean":"2024-09-10T23:15:42.453293+0000","last_became_active":"2024-09-10T23:15:36.820728+0000","last_became_peered":"2024-09-10T23:15:36.820728+0000","last_unstale":"2024-09-10T23:15:42.453293+0000","last_undegraded":"2024-09-10T23:15:42.453293+0000","last_fullsized":"2024-09-10T23:15:42.453293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:09.763137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976723+0000","last_change":"2024-09-10T23:15:36.817451+0000","last_active":"2024-09-10T23:15:41.976723+0000","last_peered":"2024-09-10T23:15:41.976723+0000","last_clean":"2024-09-10T23:15:41.976723+0000","last_became_active":"2024-09-10T23:15:36.817180+0000","last_became_peered":"2024-09-10T23:15:36.817180+0000","last_unstale":"2024-09-10T23:15:41.976723+0000","last_undegraded":"2024-09-10T23:15:41.976723+0000","last_fullsized":"2024-09-10T23:15:41.976723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:42.144340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478095+0000","last_change":"2024-09-10T23:15:36.834283+0000","last_active":"2024-09-10T23:15:42.478095+0000","last_peered":"2024-09-10T23:15:42.478095+0000","last_clean":"2024-09-10T23:15:42.478095+0000","last_became_active":"2024-09-10T23:15:36.832423+0000","last_became_peered":"2024-09-10T23:15:36.832423+0000","last_unstale":"2024-09-10T23:15:42.478095+0000","last_undegraded":"2024-09-10T23:15:42.478095+0000","last_fullsized":"2024-09-10T23:15:42.478095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:33.744306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966222+0000","last_change":"2024-09-10T23:15:36.817174+0000","last_active":"2024-09-10T23:15:41.966222+0000","last_peered":"2024-09-10T23:15:41.966222+0000","last_clean":"2024-09-10T23:15:41.966222+0000","last_became_active":"2024-09-10T23:15:36.816873+0000","last_became_peered":"2024-09-10T23:15:36.816873+0000","last_unstale":"2024-09-10T23:15:41.966222+0000","last_undegraded":"2024-09-10T23:15:41.966222+0000","last_fullsized":"2024-09-10T23:15:41.966222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866980+0000","last_change":"2024-09-10T23:15:36.814417+0000","last_active":"2024-09-10T23:15:41.866980+0000","last_peered":"2024-09-10T23:15:41.866980+0000","last_clean":"2024-09-10T23:15:41.866980+0000","last_became_active":"2024-09-10T23:15:36.814142+0000","last_became_peered":"2024-09-10T23:15:36.814142+0000","last_unstale":"2024-09-10T23:15:41.866980+0000","last_undegraded":"2024-09-10T23:15:41.866980+0000","last_fullsized":"2024-09-10T23:15:41.866980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.478307+0000","last_change":"2024-09-10T23:15:36.827366+0000","last_active":"2024-09-10T23:15:42.478307+0000","last_peered":"2024-09-10T23:15:42.478307+0000","last_clean":"2024-09-10T23:15:42.478307+0000","last_became_active":"2024-09-10T23:15:36.827030+0000","last_became_peered":"2024-09-10T23:15:36.827030+0000","last_unstale":"2024-09-10T23:15:42.478307+0000","last_undegraded":"2024-09-10T23:15:42.478307+0000","last_fullsized":"2024-09-10T23:15:42.478307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:01.691766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453085+0000","last_change":"2024-09-10T23:15:36.825171+0000","last_active":"2024-09-10T23:15:42.453085+0000","last_peered":"2024-09-10T23:15:42.453085+0000","last_clean":"2024-09-10T23:15:42.453085+0000","last_became_active":"2024-09-10T23:15:36.824807+0000","last_became_peered":"2024-09-10T23:15:36.824807+0000","last_unstale":"2024-09-10T23:15:42.453085+0000","last_undegraded":"2024-09-10T23:15:42.453085+0000","last_fullsized":"2024-09-10T23:15:42.453085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:12.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477668+0000","last_change":"2024-09-10T23:15:36.828041+0000","last_active":"2024-09-10T23:15:42.477668+0000","last_peered":"2024-09-10T23:15:42.477668+0000","last_clean":"2024-09-10T23:15:42.477668+0000","last_became_active":"2024-09-10T23:15:36.827715+0000","last_became_peered":"2024-09-10T23:15:36.827715+0000","last_unstale":"2024-09-10T23:15:42.477668+0000","last_undegraded":"2024-09-10T23:15:42.477668+0000","last_fullsized":"2024-09-10T23:15:42.477668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:23.592896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453188+0000","last_change":"2024-09-10T23:15:36.827045+0000","last_active":"2024-09-10T23:15:42.453188+0000","last_peered":"2024-09-10T23:15:42.453188+0000","last_clean":"2024-09-10T23:15:42.453188+0000","last_became_active":"2024-09-10T23:15:36.826738+0000","last_became_peered":"2024-09-10T23:15:36.826738+0000","last_unstale":"2024-09-10T23:15:42.453188+0000","last_undegraded":"2024-09-10T23:15:42.453188+0000","last_fullsized":"2024-09-10T23:15:42.453188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:02:16.055380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976502+0000","last_change":"2024-09-10T23:15:36.826859+0000","last_active":"2024-09-10T23:15:41.976502+0000","last_peered":"2024-09-10T23:15:41.976502+0000","last_clean":"2024-09-10T23:15:41.976502+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:41.976502+0000","last_undegraded":"2024-09-10T23:15:41.976502+0000","last_fullsized":"2024-09-10T23:15:41.976502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:58.142950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866951+0000","last_change":"2024-09-10T23:15:36.840021+0000","last_active":"2024-09-10T23:15:41.866951+0000","last_peered":"2024-09-10T23:15:41.866951+0000","last_clean":"2024-09-10T23:15:41.866951+0000","last_became_active":"2024-09-10T23:15:36.839028+0000","last_became_peered":"2024-09-10T23:15:36.839028+0000","last_unstale":"2024-09-10T23:15:41.866951+0000","last_undegraded":"2024-09-10T23:15:41.866951+0000","last_fullsized":"2024-09-10T23:15:41.866951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:25.766975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083601+0000","last_change":"2024-09-10T23:15:36.817847+0000","last_active":"2024-09-10T23:15:42.083601+0000","last_peered":"2024-09-10T23:15:42.083601+0000","last_clean":"2024-09-10T23:15:42.083601+0000","last_became_active":"2024-09-10T23:15:36.817492+0000","last_became_peered":"2024-09-10T23:15:36.817492+0000","last_unstale":"2024-09-10T23:15:42.083601+0000","last_undegraded":"2024-09-10T23:15:42.083601+0000","last_fullsized":"2024-09-10T23:15:42.083601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:39.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.862623+0000","last_change":"2024-09-10T23:15:36.818420+0000","last_active":"2024-09-10T23:15:41.862623+0000","last_peered":"2024-09-10T23:15:41.862623+0000","last_clean":"2024-09-10T23:15:41.862623+0000","last_became_active":"2024-09-10T23:15:36.818130+0000","last_became_peered":"2024-09-10T23:15:36.818130+0000","last_unstale":"2024-09-10T23:15:41.862623+0000","last_undegraded":"2024-09-10T23:15:41.862623+0000","last_fullsized":"2024-09-10T23:15:41.862623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:12.540137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453936+0000","last_change":"2024-09-10T23:15:36.823439+0000","last_active":"2024-09-10T23:15:42.453936+0000","last_peered":"2024-09-10T23:15:42.453936+0000","last_clean":"2024-09-10T23:15:42.453936+0000","last_became_active":"2024-09-10T23:15:36.823181+0000","last_became_peered":"2024-09-10T23:15:36.823181+0000","last_unstale":"2024-09-10T23:15:42.453936+0000","last_undegraded":"2024-09-10T23:15:42.453936+0000","last_fullsized":"2024-09-10T23:15:42.453936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:58.331888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.452952+0000","last_change":"2024-09-10T23:15:36.816826+0000","last_active":"2024-09-10T23:15:42.452952+0000","last_peered":"2024-09-10T23:15:42.452952+0000","last_clean":"2024-09-10T23:15:42.452952+0000","last_became_active":"2024-09-10T23:15:36.816557+0000","last_became_peered":"2024-09-10T23:15:36.816557+0000","last_unstale":"2024-09-10T23:15:42.452952+0000","last_undegraded":"2024-09-10T23:15:42.452952+0000","last_fullsized":"2024-09-10T23:15:42.452952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:58.172702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.965639+0000","last_change":"2024-09-10T23:15:36.815890+0000","last_active":"2024-09-10T23:15:41.965639+0000","last_peered":"2024-09-10T23:15:41.965639+0000","last_clean":"2024-09-10T23:15:41.965639+0000","last_became_active":"2024-09-10T23:15:36.815610+0000","last_became_peered":"2024-09-10T23:15:36.815610+0000","last_unstale":"2024-09-10T23:15:41.965639+0000","last_undegraded":"2024-09-10T23:15:41.965639+0000","last_fullsized":"2024-09-10T23:15:41.965639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:48.015897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976461+0000","last_change":"2024-09-10T23:15:36.809792+0000","last_active":"2024-09-10T23:15:41.976461+0000","last_peered":"2024-09-10T23:15:41.976461+0000","last_clean":"2024-09-10T23:15:41.976461+0000","last_became_active":"2024-09-10T23:15:36.809448+0000","last_became_peered":"2024-09-10T23:15:36.809448+0000","last_unstale":"2024-09-10T23:15:41.976461+0000","last_undegraded":"2024-09-10T23:15:41.976461+0000","last_fullsized":"2024-09-10T23:15:41.976461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477756+0000","last_change":"2024-09-10T23:15:36.817574+0000","last_active":"2024-09-10T23:15:42.477756+0000","last_peered":"2024-09-10T23:15:42.477756+0000","last_clean":"2024-09-10T23:15:42.477756+0000","last_became_active":"2024-09-10T23:15:36.817319+0000","last_became_peered":"2024-09-10T23:15:36.817319+0000","last_unstale":"2024-09-10T23:15:42.477756+0000","last_undegraded":"2024-09-10T23:15:42.477756+0000","last_fullsized":"2024-09-10T23:15:42.477756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:13.250839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.050667+0000","last_change":"2024-09-10T23:15:36.819031+0000","last_active":"2024-09-10T23:15:42.050667+0000","last_peered":"2024-09-10T23:15:42.050667+0000","last_clean":"2024-09-10T23:15:42.050667+0000","last_became_active":"2024-09-10T23:15:36.818398+0000","last_became_peered":"2024-09-10T23:15:36.818398+0000","last_unstale":"2024-09-10T23:15:42.050667+0000","last_undegraded":"2024-09-10T23:15:42.050667+0000","last_fullsized":"2024-09-10T23:15:42.050667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:19.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866752+0000","last_change":"2024-09-10T23:15:36.838074+0000","last_active":"2024-09-10T23:15:41.866752+0000","last_peered":"2024-09-10T23:15:41.866752+0000","last_clean":"2024-09-10T23:15:41.866752+0000","last_became_active":"2024-09-10T23:15:36.837841+0000","last_became_peered":"2024-09-10T23:15:36.837841+0000","last_unstale":"2024-09-10T23:15:41.866752+0000","last_undegraded":"2024-09-10T23:15:41.866752+0000","last_fullsized":"2024-09-10T23:15:41.866752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:03.810921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.866888+0000","last_change":"2024-09-10T23:15:36.837828+0000","last_active":"2024-09-10T23:15:41.866888+0000","last_peered":"2024-09-10T23:15:41.866888+0000","last_clean":"2024-09-10T23:15:41.866888+0000","last_became_active":"2024-09-10T23:15:36.837356+0000","last_became_peered":"2024-09-10T23:15:36.837356+0000","last_unstale":"2024-09-10T23:15:41.866888+0000","last_undegraded":"2024-09-10T23:15:41.866888+0000","last_fullsized":"2024-09-10T23:15:41.866888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083795+0000","last_change":"2024-09-10T23:15:36.833388+0000","last_active":"2024-09-10T23:15:42.083795+0000","last_peered":"2024-09-10T23:15:42.083795+0000","last_clean":"2024-09-10T23:15:42.083795+0000","last_became_active":"2024-09-10T23:15:36.832978+0000","last_became_peered":"2024-09-10T23:15:36.832978+0000","last_unstale":"2024-09-10T23:15:42.083795+0000","last_undegraded":"2024-09-10T23:15:42.083795+0000","last_fullsized":"2024-09-10T23:15:42.083795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:45:46.059643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.477408+0000","last_change":"2024-09-10T23:15:36.824751+0000","last_active":"2024-09-10T23:15:42.477408+0000","last_peered":"2024-09-10T23:15:42.477408+0000","last_clean":"2024-09-10T23:15:42.477408+0000","last_became_active":"2024-09-10T23:15:36.824453+0000","last_became_peered":"2024-09-10T23:15:36.824453+0000","last_unstale":"2024-09-10T23:15:42.477408+0000","last_undegraded":"2024-09-10T23:15:42.477408+0000","last_fullsized":"2024-09-10T23:15:42.477408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:15.565815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083075+0000","last_change":"2024-09-10T23:15:36.825819+0000","last_active":"2024-09-10T23:15:42.083075+0000","last_peered":"2024-09-10T23:15:42.083075+0000","last_clean":"2024-09-10T23:15:42.083075+0000","last_became_active":"2024-09-10T23:15:36.825572+0000","last_became_peered":"2024-09-10T23:15:36.825572+0000","last_unstale":"2024-09-10T23:15:42.083075+0000","last_undegraded":"2024-09-10T23:15:42.083075+0000","last_fullsized":"2024-09-10T23:15:42.083075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:12.240118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453098+0000","last_change":"2024-09-10T23:15:36.821090+0000","last_active":"2024-09-10T23:15:42.453098+0000","last_peered":"2024-09-10T23:15:42.453098+0000","last_clean":"2024-09-10T23:15:42.453098+0000","last_became_active":"2024-09-10T23:15:36.820786+0000","last_became_peered":"2024-09-10T23:15:36.820786+0000","last_unstale":"2024-09-10T23:15:42.453098+0000","last_undegraded":"2024-09-10T23:15:42.453098+0000","last_fullsized":"2024-09-10T23:15:42.453098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083221+0000","last_change":"2024-09-10T23:15:36.826772+0000","last_active":"2024-09-10T23:15:42.083221+0000","last_peered":"2024-09-10T23:15:42.083221+0000","last_clean":"2024-09-10T23:15:42.083221+0000","last_became_active":"2024-09-10T23:15:36.826506+0000","last_became_peered":"2024-09-10T23:15:36.826506+0000","last_unstale":"2024-09-10T23:15:42.083221+0000","last_undegraded":"2024-09-10T23:15:42.083221+0000","last_fullsized":"2024-09-10T23:15:42.083221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:57.600178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.453408+0000","last_change":"2024-09-10T23:15:36.821049+0000","last_active":"2024-09-10T23:15:42.453408+0000","last_peered":"2024-09-10T23:15:42.453408+0000","last_clean":"2024-09-10T23:15:42.453408+0000","last_became_active":"2024-09-10T23:15:36.820392+0000","last_became_peered":"2024-09-10T23:15:36.820392+0000","last_unstale":"2024-09-10T23:15:42.453408+0000","last_undegraded":"2024-09-10T23:15:42.453408+0000","last_fullsized":"2024-09-10T23:15:42.453408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:15.850959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.976642+0000","last_change":"2024-09-10T23:15:36.813236+0000","last_active":"2024-09-10T23:15:41.976642+0000","last_peered":"2024-09-10T23:15:41.976642+0000","last_clean":"2024-09-10T23:15:41.976642+0000","last_became_active":"2024-09-10T23:15:36.809383+0000","last_became_peered":"2024-09-10T23:15:36.809383+0000","last_unstale":"2024-09-10T23:15:41.976642+0000","last_undegraded":"2024-09-10T23:15:41.976642+0000","last_fullsized":"2024-09-10T23:15:41.976642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:18.957953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:41.966446+0000","last_change":"2024-09-10T23:15:36.811515+0000","last_active":"2024-09-10T23:15:41.966446+0000","last_peered":"2024-09-10T23:15:41.966446+0000","last_clean":"2024-09-10T23:15:41.966446+0000","last_became_active":"2024-09-10T23:15:36.811215+0000","last_became_peered":"2024-09-10T23:15:36.811215+0000","last_unstale":"2024-09-10T23:15:41.966446+0000","last_undegraded":"2024-09-10T23:15:41.966446+0000","last_fullsized":"2024-09-10T23:15:41.966446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:52.233857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-10T23:15:42.083737+0000","last_change":"2024-09-10T23:15:36.848698+0000","last_active":"2024-09-10T23:15:42.083737+0000","last_peered":"2024-09-10T23:15:42.083737+0000","last_clean":"2024-09-10T23:15:42.083737+0000","last_became_active":"2024-09-10T23:15:36.848106+0000","last_became_peered":"2024-09-10T23:15:36.848106+0000","last_unstale":"2024-09-10T23:15:42.083737+0000","last_undegraded":"2024-09-10T23:15:42.083737+0000","last_fullsized":"2024-09-10T23:15:42.083737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:35.780574+0000","last_clean_scrub_stamp":"2024-09-10T23:15:35.780574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:15.850959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476746,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":701227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":110367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":110403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":282624,"data_stored":110277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509451,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":110437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":888832,"data_stored":701283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:16:04.086 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:16:04.086 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T23:16:04.087 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T23:16:04.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T23:16:04.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:16:04.177 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:16:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.271+0000 7feef7a00640 1 -- 172.21.15.17:0/3880972537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef0070ad0 msgr2=0x7feef015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.271+0000 7feef7a00640 1 --2- 172.21.15.17:0/3880972537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef0070ad0 0x7feef015f060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feee4009900 tx=0x7feee401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.271+0000 7feef7a00640 1 -- 172.21.15.17:0/3880972537 shutdown_connections 2024-09-10T23:16:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.271+0000 7feef7a00640 1 --2- 172.21.15.17:0/3880972537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feef00cf320 0x7feef00cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.271+0000 7feef7a00640 1 --2- 172.21.15.17:0/3880972537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef0070ad0 0x7feef015f060 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.271+0000 7feef7a00640 1 -- 172.21.15.17:0/3880972537 >> 172.21.15.17:0/3880972537 conn(0x7feef00d1d60 msgr2=0x7feef00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.271+0000 7feef7a00640 1 -- 172.21.15.17:0/3880972537 shutdown_connections 2024-09-10T23:16:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.271+0000 7feef7a00640 1 -- 172.21.15.17:0/3880972537 wait complete. 2024-09-10T23:16:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 Processor -- start 2024-09-10T23:16:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 -- start start 2024-09-10T23:16:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef0070ad0 0x7feef00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef00cf320 0x7feef00cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feef00d1830 0x7feef0149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feef0169430 con 0x7feef00cf320 2024-09-10T23:16:04.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feef01692b0 con 0x7feef0070ad0 2024-09-10T23:16:04.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7feef01695b0 con 0x7feef00d1830 2024-09-10T23:16:04.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeefe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef00cf320 0x7feef00cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef5000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef0070ad0 0x7feef00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeefe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef00cf320 0x7feef00cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34342/0 (socket says 172.21.15.17:34342) 2024-09-10T23:16:04.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeefe00640 1 -- 172.21.15.17:0/1490154573 learned_addr learned my addr 172.21.15.17:0/1490154573 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:04.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef5a00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feef00d1830 0x7feef0149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeefe00640 1 -- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feef00d1830 msgr2=0x7feef0149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeefe00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feef00d1830 0x7feef0149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeefe00640 1 -- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef0070ad0 msgr2=0x7feef00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeefe00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef0070ad0 0x7feef00b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeefe00640 1 -- 172.21.15.17:0/1490154573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef00b5ef0 con 0x7feef00cf320 2024-09-10T23:16:04.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeefe00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef00cf320 0x7feef00cb9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feedc00c3c0 tx=0x7feedc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:04.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeecc00640 1 -- 172.21.15.17:0/1490154573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc0052d0 con 0x7feef00cf320 2024-09-10T23:16:04.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeecc00640 1 -- 172.21.15.17:0/1490154573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feedc007020 con 0x7feef00cf320 2024-09-10T23:16:04.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feeecc00640 1 -- 172.21.15.17:0/1490154573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc007470 con 0x7feef00cf320 2024-09-10T23:16:04.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef00b61d0 con 0x7feef00cf320 2024-09-10T23:16:04.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.275+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef014a030 con 0x7feef00cf320 2024-09-10T23:16:04.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.279+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef015f060 con 0x7feef00cf320 2024-09-10T23:16:04.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.279+0000 7feeecc00640 1 -- 172.21.15.17:0/1490154573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7feedc0067e0 con 0x7feef00cf320 2024-09-10T23:16:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.279+0000 7feeecc00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feed0072610 0x7feed0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.279+0000 7feeecc00640 1 -- 172.21.15.17:0/1490154573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7feedc092950 con 0x7feef00cf320 2024-09-10T23:16:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.279+0000 7feef5000640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feed0072610 0x7feed0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.283+0000 7feef5000640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feed0072610 0x7feed0074ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feee40af000 tx=0x7feee401b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.283+0000 7feeecc00640 1 -- 172.21.15.17:0/1490154573 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7feedc001090 con 0x7feef00cf320 2024-09-10T23:16:04.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.499+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feef00cd7f0 con 0x7feef00cf320 2024-09-10T23:16:04.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.499+0000 7feeecc00640 1 -- 172.21.15.17:0/1490154573 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7feedc05d690 con 0x7feef00cf320 2024-09-10T23:16:04.503 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:04.503 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T23:16:04.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feed0072610 msgr2=0x7feed0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feed0072610 0x7feed0074ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feee40af000 tx=0x7feee401b120 comp rx=0 tx=0).stop 2024-09-10T23:16:04.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef00cf320 msgr2=0x7feef00cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef00cf320 0x7feef00cb9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feedc00c3c0 tx=0x7feedc00c880 comp rx=0 tx=0).stop 2024-09-10T23:16:04.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 shutdown_connections 2024-09-10T23:16:04.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feed0072610 0x7feed0074ad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feef00d1830 0x7feef0149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feef00cf320 0x7feef00cb9c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 --2- 172.21.15.17:0/1490154573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feef0070ad0 0x7feef00b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 >> 172.21.15.17:0/1490154573 conn(0x7feef00d1d60 msgr2=0x7feef0159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:04.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 shutdown_connections 2024-09-10T23:16:04.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.503+0000 7feef7a00640 1 -- 172.21.15.17:0/1490154573 wait complete. 2024-09-10T23:16:04.523 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T23:16:04.524 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:04.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.667+0000 7f5e02600640 1 -- 172.21.15.17:0/1547576660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5de0004810 msgr2=0x7f5de0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.667+0000 7f5e02600640 1 --2- 172.21.15.17:0/1547576660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5de0004810 0x7f5de0004c90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5de8006fc0 tx=0x7f5de801f660 comp rx=0 tx=0).stop 2024-09-10T23:16:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.667+0000 7f5dfbe00640 1 -- 172.21.15.17:0/1547576660 reap_dead start 2024-09-10T23:16:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.667+0000 7f5e02600640 1 -- 172.21.15.17:0/1547576660 shutdown_connections 2024-09-10T23:16:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.667+0000 7f5e02600640 1 -- 172.21.15.17:0/1547576660 >> 172.21.15.17:0/1547576660 conn(0x7f5dfc0d0c40 msgr2=0x7f5dfc0d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.667+0000 7f5e02600640 1 -- 172.21.15.17:0/1547576660 shutdown_connections 2024-09-10T23:16:04.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.667+0000 7f5e02600640 1 -- 172.21.15.17:0/1547576660 wait complete. 2024-09-10T23:16:04.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 Processor -- start 2024-09-10T23:16:04.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 -- start start 2024-09-10T23:16:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0004810 0x7f5dfc0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dfc1f4600 0x7f5dfc0c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc0b5dd0 0x7f5dfc0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc06d3c0 con 0x7f5dfc1f4600 2024-09-10T23:16:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc06d240 con 0x7f5dfc0b5dd0 2024-09-10T23:16:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5dfc06f4b0 con 0x7f5de0004810 2024-09-10T23:16:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dfc1f4600 0x7f5dfc0c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dfc1f4600 0x7f5dfc0c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34362/0 (socket says 172.21.15.17:34362) 2024-09-10T23:16:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfaa00640 1 -- 172.21.15.17:0/573767819 learned_addr learned my addr 172.21.15.17:0/573767819 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfb400640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0004810 0x7f5dfc0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfbe00640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc0b5dd0 0x7f5dfc0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfaa00640 1 -- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0004810 msgr2=0x7f5dfc0b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfaa00640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0004810 0x7f5dfc0b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfaa00640 1 -- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc0b5dd0 msgr2=0x7f5dfc0b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfaa00640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc0b5dd0 0x7f5dfc0b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfaa00640 1 -- 172.21.15.17:0/573767819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc15f570 con 0x7f5dfc1f4600 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5dfaa00640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dfc1f4600 0x7f5dfc0c6db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5de800c320 tx=0x7f5de8006c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5df3400640 1 -- 172.21.15.17:0/573767819 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8006480 con 0x7f5dfc1f4600 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5df3400640 1 -- 172.21.15.17:0/573767819 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5de8003600 con 0x7f5dfc1f4600 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5df3400640 1 -- 172.21.15.17:0/573767819 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8003a50 con 0x7f5dfc1f4600 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc1f4b50 con 0x7f5dfc1f4600 2024-09-10T23:16:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.671+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc1f5110 con 0x7f5dfc1f4600 2024-09-10T23:16:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.675+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dfc161ab0 con 0x7f5dfc1f4600 2024-09-10T23:16:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.675+0000 7f5df3400640 1 -- 172.21.15.17:0/573767819 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5de8003bf0 con 0x7f5dfc1f4600 2024-09-10T23:16:04.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.675+0000 7f5df3400640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ddc072610 0x7f5ddc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.675+0000 7f5df3400640 1 -- 172.21.15.17:0/573767819 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5de81312e0 con 0x7f5dfc1f4600 2024-09-10T23:16:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.675+0000 7f5dfb400640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ddc072610 0x7f5ddc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.675+0000 7f5dfb400640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ddc072610 0x7f5ddc074ad0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5dec006fd0 tx=0x7f5dec006ad0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:04.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.679+0000 7f5df3400640 1 -- 172.21.15.17:0/573767819 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5de80c2060 con 0x7f5dfc1f4600 2024-09-10T23:16:04.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.891+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dfc0c72f0 con 0x7f5dfc1f4600 2024-09-10T23:16:04.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.891+0000 7f5df3400640 1 -- 172.21.15.17:0/573767819 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5210 (secure 0 0 0) 0x7f5de8019410 con 0x7f5dfc1f4600 2024-09-10T23:16:04.895 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:04.895 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-10T23:15:57:364737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:56.758895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:16:04.895 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-10T23:16:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ddc072610 msgr2=0x7f5ddc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ddc072610 0x7f5ddc074ad0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5dec006fd0 tx=0x7f5dec006ad0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dfc1f4600 msgr2=0x7f5dfc0c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dfc1f4600 0x7f5dfc0c6db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5de800c320 tx=0x7f5de8006c60 comp rx=0 tx=0).stop 2024-09-10T23:16:04.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 shutdown_connections 2024-09-10T23:16:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ddc072610 0x7f5ddc074ad0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dfc0b5dd0 0x7f5dfc0b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dfc1f4600 0x7f5dfc0c6db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 --2- 172.21.15.17:0/573767819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5de0004810 0x7f5dfc0b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 >> 172.21.15.17:0/573767819 conn(0x7f5dfc0d0c40 msgr2=0x7f5dfc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:04.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 shutdown_connections 2024-09-10T23:16:04.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:04.895+0000 7f5e02600640 1 -- 172.21.15.17:0/573767819 wait complete. 2024-09-10T23:16:04.917 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:05.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.059+0000 7ffa4de00640 1 -- 172.21.15.17:0/4004223465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 msgr2=0x7ffa480d0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.059+0000 7ffa4de00640 1 --2- 172.21.15.17:0/4004223465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 0x7ffa480d0110 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009900 tx=0x7ffa3801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.059+0000 7ffa4de00640 1 -- 172.21.15.17:0/4004223465 shutdown_connections 2024-09-10T23:16:05.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.059+0000 7ffa4de00640 1 --2- 172.21.15.17:0/4004223465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 0x7ffa480d0110 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.059+0000 7ffa4de00640 1 -- 172.21.15.17:0/4004223465 >> 172.21.15.17:0/4004223465 conn(0x7ffa480d0c50 msgr2=0x7ffa480d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.059+0000 7ffa4de00640 1 -- 172.21.15.17:0/4004223465 shutdown_connections 2024-09-10T23:16:05.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.059+0000 7ffa4de00640 1 -- 172.21.15.17:0/4004223465 wait complete. 2024-09-10T23:16:05.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 Processor -- start 2024-09-10T23:16:05.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 -- start start 2024-09-10T23:16:05.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa48073e40 0x7ffa480afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa480d0650 0x7ffa480b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 0x7ffa480b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffa48168ce0 con 0x7ffa48158470 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa48168b60 con 0x7ffa480d0650 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffa48168e60 con 0x7ffa48073e40 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa47400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 0x7ffa480b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa47400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 0x7ffa480b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34370/0 (socket says 172.21.15.17:34370) 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa47400640 1 -- 172.21.15.17:0/312290067 learned_addr learned my addr 172.21.15.17:0/312290067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa46a00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa48073e40 0x7ffa480afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa3e000640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa480d0650 0x7ffa480b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa47400640 1 -- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa48073e40 msgr2=0x7ffa480afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa47400640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa48073e40 0x7ffa480afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa47400640 1 -- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa480d0650 msgr2=0x7ffa480b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa47400640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa480d0650 0x7ffa480b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa47400640 1 -- 172.21.15.17:0/312290067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa480b5c10 con 0x7ffa48158470 2024-09-10T23:16:05.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa47400640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 0x7ffa480b1a60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000c780 tx=0x7ffa4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa3fe00640 1 -- 172.21.15.17:0/312290067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40003b80 con 0x7ffa48158470 2024-09-10T23:16:05.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa3fe00640 1 -- 172.21.15.17:0/312290067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa40003d20 con 0x7ffa48158470 2024-09-10T23:16:05.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa480b5ef0 con 0x7ffa48158470 2024-09-10T23:16:05.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa3fe00640 1 -- 172.21.15.17:0/312290067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4000aab0 con 0x7ffa48158470 2024-09-10T23:16:05.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.063+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa480b64b0 con 0x7ffa48158470 2024-09-10T23:16:05.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.067+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa480d0110 con 0x7ffa48158470 2024-09-10T23:16:05.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.067+0000 7ffa3fe00640 1 -- 172.21.15.17:0/312290067 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffa4000ac50 con 0x7ffa48158470 2024-09-10T23:16:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.067+0000 7ffa3fe00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa240725e0 0x7ffa24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.067+0000 7ffa3fe00640 1 -- 172.21.15.17:0/312290067 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffa40093340 con 0x7ffa48158470 2024-09-10T23:16:05.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.067+0000 7ffa46a00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa240725e0 0x7ffa24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.071+0000 7ffa46a00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa240725e0 0x7ffa24074aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa380af000 tx=0x7ffa3801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.071+0000 7ffa3fe00640 1 -- 172.21.15.17:0/312290067 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ffa4005dff0 con 0x7ffa48158470 2024-09-10T23:16:05.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa480747f0 con 0x7ffa48158470 2024-09-10T23:16:05.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa3fe00640 1 -- 172.21.15.17:0/312290067 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5210 (secure 0 0 0) 0x7ffa40062a20 con 0x7ffa48158470 2024-09-10T23:16:05.285 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:05.285 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-10T23:15:57:364737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:56.758895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:16:05.286 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa240725e0 msgr2=0x7ffa24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa240725e0 0x7ffa24074aa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa380af000 tx=0x7ffa3801b120 comp rx=0 tx=0).stop 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 msgr2=0x7ffa480b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 0x7ffa480b1a60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000c780 tx=0x7ffa4000cc40 comp rx=0 tx=0).stop 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 shutdown_connections 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa240725e0 0x7ffa24074aa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa48158470 0x7ffa480b1a60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa480d0650 0x7ffa480b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 --2- 172.21.15.17:0/312290067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa48073e40 0x7ffa480afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 >> 172.21.15.17:0/312290067 conn(0x7ffa480d0c50 msgr2=0x7ffa4815a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 shutdown_connections 2024-09-10T23:16:05.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.283+0000 7ffa4de00640 1 -- 172.21.15.17:0/312290067 wait complete. 2024-09-10T23:16:05.307 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 -- 172.21.15.17:0/3633242743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00cdfc0 msgr2=0x7fecd00ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 --2- 172.21.15.17:0/3633242743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00cdfc0 0x7fecd00ce3d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fecd0072ba0 tx=0x7fecc801deb0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 -- 172.21.15.17:0/3633242743 shutdown_connections 2024-09-10T23:16:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 --2- 172.21.15.17:0/3633242743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00cdfc0 0x7fecd00ce3d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 --2- 172.21.15.17:0/3633242743 >> v2:172.21.15.77:3300/0 conn(0x7fecd00b5290 0x7fecd00d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 -- 172.21.15.17:0/3633242743 >> 172.21.15.17:0/3633242743 conn(0x7fecd00742c0 msgr2=0x7fecd00746a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 -- 172.21.15.17:0/3633242743 shutdown_connections 2024-09-10T23:16:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 -- 172.21.15.17:0/3633242743 wait complete. 2024-09-10T23:16:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 Processor -- start 2024-09-10T23:16:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 -- start start 2024-09-10T23:16:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00b5290 0x7fecd0152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd00cdfc0 0x7fecd00ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd00cfa20 0x7fecd00c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fecd00ceca0 con 0x7fecd00b5290 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fecd00ceb20 con 0x7fecd00cdfc0 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecd5c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fecd00cee20 con 0x7fecd00cfa20 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7feccea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00b5290 0x7fecd0152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7feccea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00b5290 0x7fecd0152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34392/0 (socket says 172.21.15.17:34392) 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7feccea00640 1 -- 172.21.15.17:0/746457058 learned_addr learned my addr 172.21.15.17:0/746457058 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7fecc7e00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd00cdfc0 0x7fecd00ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7feccea00640 1 -- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd00cfa20 msgr2=0x7fecd00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.451+0000 7feccf400640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd00cfa20 0x7fecd00c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7feccea00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd00cfa20 0x7fecd00c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7feccea00640 1 -- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd00cdfc0 msgr2=0x7fecd00ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7feccea00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd00cdfc0 0x7fecd00ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7feccea00640 1 -- 172.21.15.17:0/746457058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd0154540 con 0x7fecd00b5290 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7fecc7e00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd00cdfc0 0x7fecd00ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7feccf400640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd00cfa20 0x7fecd00c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7feccea00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00b5290 0x7fecd0152b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fecc000c400 tx=0x7fecc000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7fecc6a00640 1 -- 172.21.15.17:0/746457058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0011790 con 0x7fecd00b5290 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7fecc6a00640 1 -- 172.21.15.17:0/746457058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecc0017070 con 0x7fecd00b5290 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd01530b0 con 0x7fecd00b5290 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7fecc6a00640 1 -- 172.21.15.17:0/746457058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0011cc0 con 0x7fecd00b5290 2024-09-10T23:16:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd0154ac0 con 0x7fecd00b5290 2024-09-10T23:16:05.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd00ce3d0 con 0x7fecd00b5290 2024-09-10T23:16:05.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7fecc6a00640 1 -- 172.21.15.17:0/746457058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fecc001c460 con 0x7fecd00b5290 2024-09-10T23:16:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.455+0000 7fecc6a00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fecac072610 0x7fecac074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.459+0000 7fecc6a00640 1 -- 172.21.15.17:0/746457058 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fecc00932e0 con 0x7fecd00b5290 2024-09-10T23:16:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.459+0000 7fecc7e00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fecac072610 0x7fecac074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.459+0000 7fecc7e00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fecac072610 0x7fecac074ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fecd01fab20 tx=0x7fecb8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.459+0000 7fecc6a00640 1 -- 172.21.15.17:0/746457058 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fecc005e710 con 0x7fecd00b5290 2024-09-10T23:16:05.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.635+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecd00754e0 con 0x7fecd00b5290 2024-09-10T23:16:05.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.635+0000 7fecc6a00640 1 -- 172.21.15.17:0/746457058 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18538 (secure 0 0 0) 0x7fecc005e010 con 0x7fecd00b5290 2024-09-10T23:16:05.639 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:05.640 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:15:41.258986+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:05.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fecac072610 msgr2=0x7fecac074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fecac072610 0x7fecac074ad0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fecd01fab20 tx=0x7fecb8005f90 comp rx=0 tx=0).stop 2024-09-10T23:16:05.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00b5290 msgr2=0x7fecd0152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00b5290 0x7fecd0152b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fecc000c400 tx=0x7fecc000c8c0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 shutdown_connections 2024-09-10T23:16:05.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fecac072610 0x7fecac074ad0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd00cfa20 0x7fecd00c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd00cdfc0 0x7fecd00ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 --2- 172.21.15.17:0/746457058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecd00b5290 0x7fecd0152b70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 >> 172.21.15.17:0/746457058 conn(0x7fecd00742c0 msgr2=0x7fecd0158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 shutdown_connections 2024-09-10T23:16:05.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.639+0000 7fecd5c00640 1 -- 172.21.15.17:0/746457058 wait complete. 2024-09-10T23:16:05.662 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:05.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 -- 172.21.15.17:0/2222677781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe610003a10 msgr2=0x7fe610003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 --2- 172.21.15.17:0/2222677781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe610003a10 0x7fe610003e30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00c2c0 tx=0x7fe61c01cf50 comp rx=0 tx=0).stop 2024-09-10T23:16:05.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe631a00640 1 -- 172.21.15.17:0/2222677781 reap_dead start 2024-09-10T23:16:05.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 -- 172.21.15.17:0/2222677781 shutdown_connections 2024-09-10T23:16:05.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 -- 172.21.15.17:0/2222677781 >> 172.21.15.17:0/2222677781 conn(0x7fe62c06cfc0 msgr2=0x7fe62c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:05.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 -- 172.21.15.17:0/2222677781 shutdown_connections 2024-09-10T23:16:05.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 -- 172.21.15.17:0/2222677781 wait complete. 2024-09-10T23:16:05.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 Processor -- start 2024-09-10T23:16:05.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 -- start start 2024-09-10T23:16:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe610003a10 0x7fe62c1fa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.807+0000 7fe633a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe62c13db10 0x7fe62c149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe633a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe62c149c50 0x7fe62c14a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe633a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c165750 con 0x7fe62c149c50 2024-09-10T23:16:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe633a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c0742a0 con 0x7fe610003a10 2024-09-10T23:16:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe633a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe62c1658d0 con 0x7fe62c13db10 2024-09-10T23:16:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe62c149c50 0x7fe62c14a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe62c149c50 0x7fe62c14a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34400/0 (socket says 172.21.15.17:34400) 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631a00640 1 -- 172.21.15.17:0/3251648169 learned_addr learned my addr 172.21.15.17:0/3251648169 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe623e00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe62c13db10 0x7fe62c149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631000640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe610003a10 0x7fe62c1fa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631a00640 1 -- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe62c13db10 msgr2=0x7fe62c149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631a00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe62c13db10 0x7fe62c149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631a00640 1 -- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe610003a10 msgr2=0x7fe62c1fa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631a00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe610003a10 0x7fe62c1fa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631a00640 1 -- 172.21.15.17:0/3251648169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c0b25d0 con 0x7fe62c149c50 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe631a00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe62c149c50 0x7fe62c14a0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe62c158b20 tx=0x7fe624010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe629600640 1 -- 172.21.15.17:0/3251648169 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624017070 con 0x7fe62c149c50 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe629600640 1 -- 172.21.15.17:0/3251648169 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe624015070 con 0x7fe62c149c50 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe629600640 1 -- 172.21.15.17:0/3251648169 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624004d90 con 0x7fe62c149c50 2024-09-10T23:16:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62c0cd100 con 0x7fe62c149c50 2024-09-10T23:16:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62c0b2010 con 0x7fe62c149c50 2024-09-10T23:16:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62c0b3e30 con 0x7fe62c149c50 2024-09-10T23:16:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.811+0000 7fe629600640 1 -- 172.21.15.17:0/3251648169 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe624003980 con 0x7fe62c149c50 2024-09-10T23:16:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.815+0000 7fe629600640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6080725e0 0x7fe608074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.815+0000 7fe629600640 1 -- 172.21.15.17:0/3251648169 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe624093b30 con 0x7fe62c149c50 2024-09-10T23:16:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.815+0000 7fe631000640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6080725e0 0x7fe608074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.815+0000 7fe631000640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6080725e0 0x7fe608074aa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0ac000 tx=0x7fe61c019d90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:05.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:05.819+0000 7fe629600640 1 -- 172.21.15.17:0/3251648169 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe62405eec0 con 0x7fe62c149c50 2024-09-10T23:16:06.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe62c0aefb0 con 0x7fe62c149c50 2024-09-10T23:16:06.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe629600640 1 -- 172.21.15.17:0/3251648169 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5210 (secure 0 0 0) 0x7fe62405e7c0 con 0x7fe62c149c50 2024-09-10T23:16:06.034 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:06.034 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-10T23:15:57:364737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:56.758895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:16:06.034 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-10T23:16:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6080725e0 msgr2=0x7fe608074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6080725e0 0x7fe608074aa0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0ac000 tx=0x7fe61c019d90 comp rx=0 tx=0).stop 2024-09-10T23:16:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe62c149c50 msgr2=0x7fe62c14a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe62c149c50 0x7fe62c14a0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe62c158b20 tx=0x7fe624010f40 comp rx=0 tx=0).stop 2024-09-10T23:16:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 shutdown_connections 2024-09-10T23:16:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6080725e0 0x7fe608074aa0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe62c149c50 0x7fe62c14a0d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe62c13db10 0x7fe62c149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 --2- 172.21.15.17:0/3251648169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe610003a10 0x7fe62c1fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 >> 172.21.15.17:0/3251648169 conn(0x7fe62c06cfc0 msgr2=0x7fe62c1582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 shutdown_connections 2024-09-10T23:16:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.031+0000 7fe633a00640 1 -- 172.21.15.17:0/3251648169 wait complete. 2024-09-10T23:16:06.460 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:15:36.206224+0000', 'modified': '2024-09-10T23:15:56.758895+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4378}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4378': {'gid': 4378, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6836/913768740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 913768740}, {'type': 'v1', 'addr': '172.21.15.77:6836', 'nonce': 913768740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4378, 'qdb_cluster': [4378]} 2024-09-10T23:16:06.460 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:16:06.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T23:16:06.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 -- 172.21.15.17:0/3258266828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f2d0 msgr2=0x7f82400d00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 --2- 172.21.15.17:0/3258266828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f2d0 0x7f82400d00c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8240070140 tx=0x7f823001c780 comp rx=0 tx=0).stop 2024-09-10T23:16:06.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 -- 172.21.15.17:0/3258266828 shutdown_connections 2024-09-10T23:16:06.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 --2- 172.21.15.17:0/3258266828 >> v2:172.21.15.77:3300/0 conn(0x7f82400cfbe0 0x7f82400cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 --2- 172.21.15.17:0/3258266828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f2d0 0x7f82400d00c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 -- 172.21.15.17:0/3258266828 >> 172.21.15.17:0/3258266828 conn(0x7f82400d1ce0 msgr2=0x7f82400d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 -- 172.21.15.17:0/3258266828 shutdown_connections 2024-09-10T23:16:06.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 -- 172.21.15.17:0/3258266828 wait complete. 2024-09-10T23:16:06.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 Processor -- start 2024-09-10T23:16:06.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.607+0000 7f8246a00640 1 -- start start 2024-09-10T23:16:06.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8246a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82400cfbe0 0x7f82400c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8246a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f824015f2d0 0x7f82401ff120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8246a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f6b0 0x7f82401ff900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8246a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f82401692b0 con 0x7f824015f6b0 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8246a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8240169130 con 0x7f824015f2d0 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8246a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8240169430 con 0x7f82400cfbe0 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8244a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f6b0 0x7f82401ff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8244a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f6b0 0x7f82401ff900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34418/0 (socket says 172.21.15.17:34418) 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8244a00640 1 -- 172.21.15.17:0/2890314618 learned_addr learned my addr 172.21.15.17:0/2890314618 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f823f400640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f824015f2d0 0x7f82401ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f823fe00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82400cfbe0 0x7f82400c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8244a00640 1 -- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82400cfbe0 msgr2=0x7f82400c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8244a00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82400cfbe0 0x7f82400c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8244a00640 1 -- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f824015f2d0 msgr2=0x7f82401ff120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8244a00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f824015f2d0 0x7f82401ff120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8244a00640 1 -- 172.21.15.17:0/2890314618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82400af6c0 con 0x7f824015f6b0 2024-09-10T23:16:06.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f823fe00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82400cfbe0 0x7f82400c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:06.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8244a00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f6b0 0x7f82401ff900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f823800cad0 tx=0x7f823800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8237e00640 1 -- 172.21.15.17:0/2890314618 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823800ae20 con 0x7f824015f6b0 2024-09-10T23:16:06.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8237e00640 1 -- 172.21.15.17:0/2890314618 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82380039a0 con 0x7f824015f6b0 2024-09-10T23:16:06.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8237e00640 1 -- 172.21.15.17:0/2890314618 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238003e10 con 0x7f824015f6b0 2024-09-10T23:16:06.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8246a00640 1 -- 172.21.15.17:0/2890314618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82400c6560 con 0x7f824015f6b0 2024-09-10T23:16:06.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.611+0000 7f8246a00640 1 -- 172.21.15.17:0/2890314618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82401ff660 con 0x7f824015f6b0 2024-09-10T23:16:06.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8237e00640 1 -- 172.21.15.17:0/2890314618 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8238004030 con 0x7f824015f6b0 2024-09-10T23:16:06.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8237e00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8237e00640 1 -- 172.21.15.17:0/2890314618 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8238093da0 con 0x7f824015f6b0 2024-09-10T23:16:06.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8249deb000 1 Processor -- start 2024-09-10T23:16:06.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8249deb000 1 -- start start 2024-09-10T23:16:06.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8249deb000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8249deb000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cc2f0 0x55b1bc07f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8249deb000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc07fe10 0x55b1bc0801f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8249deb000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbfa03f0 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8249deb000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbeddb20 con 0x55b1bc0cc2f0 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8249deb000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b1bbeccf50 con 0x55b1bc07fe10 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f82300ae000 tx=0x7f823001afc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34434/0 (socket says 172.21.15.17:34434) 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 -- 172.21.15.17:0/2387445392 learned_addr learned my addr 172.21.15.17:0/2387445392 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8244a00640 1 --2- 172.21.15.17:0/2387445392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc07fe10 0x55b1bc0801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823f400640 1 --2- 172.21.15.17:0/2387445392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cc2f0 0x55b1bc07f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 -- 172.21.15.17:0/2387445392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc07fe10 msgr2=0x55b1bc0801f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 --2- 172.21.15.17:0/2387445392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc07fe10 0x55b1bc0801f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 -- 172.21.15.17:0/2387445392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cc2f0 msgr2=0x55b1bc07f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 --2- 172.21.15.17:0/2387445392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cc2f0 0x55b1bc07f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 -- 172.21.15.17:0/2387445392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1bbe94590 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f823fe00640 1 --2- 172.21.15.17:0/2387445392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0cbdb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f823001ae30 tx=0x7f82300b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ae2a7da41841bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8234c00640 1 -- 172.21.15.17:0/2387445392 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82300ac050 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8234c00640 1 -- 172.21.15.17:0/2387445392 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82300be420 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.615+0000 7f8234c00640 1 -- 172.21.15.17:0/2387445392 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82300be7f0 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- 172.21.15.17:0/2387445392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 msgr2=0x55b1bc0cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 --2- 172.21.15.17:0/2387445392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0cbdb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f823001ae30 tx=0x7f82300b6000 comp rx=0 tx=0).stop 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- 172.21.15.17:0/2387445392 shutdown_connections 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 --2- 172.21.15.17:0/2387445392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc07fe10 0x55b1bc0801f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 --2- 172.21.15.17:0/2387445392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cc2f0 0x55b1bc07f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 --2- 172.21.15.17:0/2387445392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0cbdb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- 172.21.15.17:0/2387445392 >> 172.21.15.17:0/2387445392 conn(0x55b1bbf69130 msgr2=0x55b1bc0aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- 172.21.15.17:0/2387445392 shutdown_connections 2024-09-10T23:16:06.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- 172.21.15.17:0/2387445392 wait complete. 2024-09-10T23:16:06.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- start start 2024-09-10T23:16:06.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 Processor -- start 2024-09-10T23:16:06.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc0ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbe675d0 con 0x55b1bc07fe10 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbed0d60 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b1bbe73500 con 0x55b1bc0cc2f0 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 10 client.0 _ll_register_callbacks cb 0x55b1bbe77810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc0ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34448/0 (socket says 172.21.15.17:34448) 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823fe00640 1 -- 172.21.15.17:0/716290734 learned_addr learned my addr 172.21.15.17:0/716290734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823f400640 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8244a00640 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc0ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823fe00640 1 -- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 msgr2=0x55b1bc0ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823fe00640 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc0ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823fe00640 1 -- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cb9d0 msgr2=0x55b1bc0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823fe00640 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823fe00640 1 -- 172.21.15.17:0/716290734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bbe6b170 con 0x55b1bc07fe10 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f823fe00640 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc0ac6a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f823001ae30 tx=0x7f82300be4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99069a959d05d9df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8229600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8229600640 1 -- 172.21.15.17:0/716290734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82300cc070 con 0x55b1bc07fe10 2024-09-10T23:16:06.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8229600640 1 -- 172.21.15.17:0/716290734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f82300be6a0 con 0x55b1bc07fe10 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- 172.21.15.17:0/716290734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b1bbe650f0 con 0x55b1bc07fe10 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8229600640 1 -- 172.21.15.17:0/716290734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f82300d4050 con 0x55b1bc07fe10 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 10 client.4761 fetch_fsmap learned FSMap version 9 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- 172.21.15.17:0/716290734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b1bbf51ef0 con 0x55b1bc07fe10 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8229600640 1 -- 172.21.15.17:0/716290734 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b1bbe650f0 con 0x55b1bc07fe10 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8229600640 1 -- 172.21.15.17:0/716290734 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f82300d7020 con 0x55b1bc07fe10 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 10 client.4761 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 10 client.4761 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 20 client.4761 populate_metadata read hostname 'smithi017' 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x55b1bc0ae0f0 0x55b1bc0ddc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 4 client.4761 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.619+0000 7f8249deb000 1 -- 172.21.15.17:0/716290734 --> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1bbedfa70 con 0x55b1bc0ae0f0 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f823f400640 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x55b1bc0ae0f0 0x55b1bc0ddc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f823f400640 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x55b1bc0ae0f0 0x55b1bc0ddc90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f528d74ac40d923 server_cookie=d4e78a5e86bfc5b1 in_seq=0 out_seq=0 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8229600640 10 client.4761 ms_handle_connect on v2:172.21.15.77:6834/913768740 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8229600640 1 -- 172.21.15.17:0/716290734 <== mds.0 v2:172.21.15.77:6834/913768740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1bbedfa70 con 0x55b1bc0ae0f0 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8229600640 10 client.4761 handle_command_reply: tid=0 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 client.4761 shutdown 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 -- 172.21.15.17:0/716290734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 msgr2=0x55b1bc0ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc0ac6a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f823001ae30 tx=0x7f82300be4b0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 -- 172.21.15.17:0/716290734 shutdown_connections 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x55b1bc0ae0f0 0x55b1bc0ddc90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc0ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc0ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 --2- 172.21.15.17:0/716290734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc0ac6a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 -- 172.21.15.17:0/716290734 >> 172.21.15.17:0/716290734 conn(0x55b1bbf69130 msgr2=0x55b1bc07efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8229600640 0 client.4761 ms_handle_reset on v2:172.21.15.77:6834/913768740 2024-09-10T23:16:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 -- 172.21.15.17:0/716290734 shutdown_connections 2024-09-10T23:16:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 1 -- 172.21.15.17:0/716290734 wait complete. 2024-09-10T23:16:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.623+0000 7f8249deb000 20 client.4761 trim_cache size 0 max 16384 2024-09-10T23:16:06.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 Processor -- start 2024-09-10T23:16:06.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 -- start start 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc13ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc13e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc13e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f824020a010 con 0x55b1bc07fe10 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8240208ff0 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82401fe900 con 0x55b1bc0cc2f0 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f823fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc13ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f823fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc13ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34462/0 (socket says 172.21.15.17:34462) 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f823fe00640 1 -- 172.21.15.17:0/56946232 learned_addr learned my addr 172.21.15.17:0/56946232 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f823fe00640 1 -- 172.21.15.17:0/56946232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 msgr2=0x55b1bc13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:06.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f823fe00640 1 --2- 172.21.15.17:0/56946232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc13e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f823fe00640 1 -- 172.21.15.17:0/56946232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cb9d0 msgr2=0x55b1bc13e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:06.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f823fe00640 1 --2- 172.21.15.17:0/56946232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc13e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f823fe00640 1 -- 172.21.15.17:0/56946232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1bbf28d90 con 0x55b1bc07fe10 2024-09-10T23:16:06.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f823fe00640 1 --2- 172.21.15.17:0/56946232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc13ddd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8230098120 tx=0x7f82300be7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42e8b6926ce717c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f822be00640 1 -- 172.21.15.17:0/56946232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82300cc040 con 0x55b1bc07fe10 2024-09-10T23:16:06.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f822be00640 1 -- 172.21.15.17:0/56946232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82300bebe0 con 0x55b1bc07fe10 2024-09-10T23:16:06.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f822be00640 1 -- 172.21.15.17:0/56946232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82300ac070 con 0x55b1bc07fe10 2024-09-10T23:16:06.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 -- 172.21.15.17:0/56946232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 msgr2=0x55b1bc13ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 --2- 172.21.15.17:0/56946232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc13ddd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8230098120 tx=0x7f82300be7b0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 -- 172.21.15.17:0/56946232 shutdown_connections 2024-09-10T23:16:06.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 --2- 172.21.15.17:0/56946232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc13e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 --2- 172.21.15.17:0/56946232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc13e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 --2- 172.21.15.17:0/56946232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc07fe10 0x55b1bc13ddd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 -- 172.21.15.17:0/56946232 >> 172.21.15.17:0/56946232 conn(0x55b1bbf69130 msgr2=0x55b1bc087b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 -- 172.21.15.17:0/56946232 shutdown_connections 2024-09-10T23:16:06.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.643+0000 7f8249deb000 1 -- 172.21.15.17:0/56946232 wait complete. 2024-09-10T23:16:06.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 -- start start 2024-09-10T23:16:06.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 Processor -- start 2024-09-10T23:16:06.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc07fe10 0x55b1bc141c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc142140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc142680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbed0d60 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82402089a0 con 0x55b1bc07fe10 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b1bbe675d0 con 0x55b1bc0cc2f0 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 10 client.0 _ll_register_callbacks cb 0x7f822c009310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34476/0 (socket says 172.21.15.17:34476) 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823f400640 1 -- 172.21.15.17:0/3102085615 learned_addr learned my addr 172.21.15.17:0/3102085615 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823fe00640 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc07fe10 0x55b1bc141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8244a00640 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823f400640 1 -- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 msgr2=0x55b1bc142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:06.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823f400640 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc142680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823f400640 1 -- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc07fe10 msgr2=0x55b1bc141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823f400640 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc07fe10 0x55b1bc141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823f400640 1 -- 172.21.15.17:0/3102085615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bbe93a90 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8244a00640 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823f400640 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc142140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f822c009b00 tx=0x7f822c009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1abbf817eaded7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8229600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8229600640 1 -- 172.21.15.17:0/3102085615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c015e00 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8229600640 1 -- 172.21.15.17:0/3102085615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f822c005920 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 -- 172.21.15.17:0/3102085615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82300bebe0 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8229600640 1 -- 172.21.15.17:0/3102085615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f822c02d050 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 10 client.4767 fetch_fsmap learned FSMap version 9 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 -- 172.21.15.17:0/3102085615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b1bbe72050 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8229600640 1 -- 172.21.15.17:0/3102085615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82300bebe0 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8229600640 1 -- 172.21.15.17:0/3102085615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f822c030020 con 0x55b1bc0cb9d0 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 10 client.4767 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 10 client.4767 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 20 client.4767 populate_metadata read hostname 'smithi017' 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x55b1bc0e0b50 0x55b1bc0dfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 4 client.4767 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f8249deb000 1 -- 172.21.15.17:0/3102085615 --> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] -- command(tid 0: {"prefix": "status"}) -- 0x55b1bbedb520 con 0x55b1bc0e0b50 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.647+0000 7f823fe00640 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x55b1bc0e0b50 0x55b1bc0dfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f823fe00640 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x55b1bc0e0b50 0x55b1bc0dfd00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2222544d6f386cc server_cookie=e73ed2a3fdf68ebe in_seq=0 out_seq=0 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8229600640 10 client.4767 ms_handle_connect on v2:172.21.15.77:6834/913768740 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8229600640 1 -- 172.21.15.17:0/3102085615 <== mds.0 v2:172.21.15.77:6834/913768740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55b1bbedb520 con 0x55b1bc0e0b50 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8229600640 10 client.4767 handle_command_reply: tid=0 2024-09-10T23:16:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 client.4767 shutdown 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 -- 172.21.15.17:0/3102085615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 msgr2=0x55b1bc142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc142140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f822c009b00 tx=0x7f822c009f80 comp rx=0 tx=0).stop 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 -- 172.21.15.17:0/3102085615 shutdown_connections 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:6834/913768740,v1:172.21.15.77:6836/913768740] conn(0x55b1bc0e0b50 0x55b1bc0dfd00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b1bc0cc2f0 0x55b1bc142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1bc0cb9d0 0x55b1bc142140 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 --2- 172.21.15.17:0/3102085615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b1bc07fe10 0x55b1bc141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8229600640 0 client.4767 ms_handle_reset on v2:172.21.15.77:6834/913768740 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 -- 172.21.15.17:0/3102085615 >> 172.21.15.17:0/3102085615 conn(0x55b1bbf69130 msgr2=0x55b1bc087b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 -- 172.21.15.17:0/3102085615 shutdown_connections 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 1 -- 172.21.15.17:0/3102085615 wait complete. 2024-09-10T23:16:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8249deb000 20 client.4767 trim_cache size 0 max 16384 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4378, 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 29.844535784000001, 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 9, 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 27, 2024-09-10T23:16:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 27, 2024-09-10T23:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 36.057755344 2024-09-10T23:16:06.659 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:16:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 -- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 msgr2=0x7f8220074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f82300ae000 tx=0x7f823001afc0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 -- 172.21.15.17:0/2890314618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f6b0 msgr2=0x7f82401ff900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f6b0 0x7f82401ff900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f823800cad0 tx=0x7f823800cf90 comp rx=0 tx=0).stop 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 -- 172.21.15.17:0/2890314618 shutdown_connections 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f824015f6b0 0x7f82401ff900 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f824015f2d0 0x7f82401ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 --2- 172.21.15.17:0/2890314618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82400cfbe0 0x7f82400c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 -- 172.21.15.17:0/2890314618 >> 172.21.15.17:0/2890314618 conn(0x7f82400d1ce0 msgr2=0x7f82400af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 -- 172.21.15.17:0/2890314618 shutdown_connections 2024-09-10T23:16:06.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:06.651+0000 7f8246a00640 1 -- 172.21.15.17:0/2890314618 wait complete. 2024-09-10T23:16:06.674 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T23:16:06.686 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T23:16:06.686 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T23:16:06.687 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-10T23:16:06.687 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:16:06.687 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:06.687 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-10T23:16:06.687 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:16:06.687 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T23:16:06.687 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-10T23:16:06.687 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:16:06.688 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:06.688 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-10T23:16:06.688 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T23:16:06.688 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T23:16:06.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:06.688 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:16:06.697 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-10T23:16:06.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:06.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T23:16:06.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:06.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-10T23:16:07.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:07.315 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-10T23:16:07.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:07.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-09-10T23:16:07.391 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2024-09-10T23:16:07.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:16:07.393 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T23:16:07.393 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T23:16:07.394 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 -- 172.21.15.17:0/3075189964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06e8073e40 msgr2=0x7f06e80ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 --2- 172.21.15.17:0/3075189964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06e8073e40 0x7f06e80ce820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009bc0 tx=0x7f06e001cba0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 -- 172.21.15.17:0/3075189964 shutdown_connections 2024-09-10T23:16:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 --2- 172.21.15.17:0/3075189964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06e8073e40 0x7f06e80ce820 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 --2- 172.21.15.17:0/3075189964 >> v2:172.21.15.77:3300/0 conn(0x7f06e8158470 0x7f06e80d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 -- 172.21.15.17:0/3075189964 >> 172.21.15.17:0/3075189964 conn(0x7f06e80d0c50 msgr2=0x7f06e80d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 -- 172.21.15.17:0/3075189964 shutdown_connections 2024-09-10T23:16:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 -- 172.21.15.17:0/3075189964 wait complete. 2024-09-10T23:16:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 Processor -- start 2024-09-10T23:16:07.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 -- start start 2024-09-10T23:16:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8073e40 0x7f06e80aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06e80d0650 0x7f06e80ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e8158470 0x7f06e80ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8167c80 con 0x7f06e8073e40 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8167b00 con 0x7f06e8158470 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.539+0000 7f06eca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f06e8167e00 con 0x7f06e80d0650 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06e5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8073e40 0x7f06e80aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06e5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8073e40 0x7f06e80aaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41244/0 (socket says 172.21.15.17:41244) 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06e5e00640 1 -- 172.21.15.17:0/1104472443 learned_addr learned my addr 172.21.15.17:0/1104472443 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06e5e00640 1 -- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06e80d0650 msgr2=0x7f06e80ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06e5e00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06e80d0650 0x7f06e80ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06e5e00640 1 -- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e8158470 msgr2=0x7f06e80ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06e5e00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e8158470 0x7f06e80ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06e5e00640 1 -- 172.21.15.17:0/1104472443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e8071df0 con 0x7f06e8073e40 2024-09-10T23:16:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06e5e00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8073e40 0x7f06e80aaac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f06d800e7a0 tx=0x7f06d800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06dea00640 1 -- 172.21.15.17:0/1104472443 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d800ccc0 con 0x7f06e8073e40 2024-09-10T23:16:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06dea00640 1 -- 172.21.15.17:0/1104472443 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06d8010430 con 0x7f06e8073e40 2024-09-10T23:16:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06dea00640 1 -- 172.21.15.17:0/1104472443 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8010860 con 0x7f06e8073e40 2024-09-10T23:16:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e80a9a20 con 0x7f06e8073e40 2024-09-10T23:16:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e80a9fe0 con 0x7f06e8073e40 2024-09-10T23:16:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e80ce820 con 0x7f06e8073e40 2024-09-10T23:16:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.543+0000 7f06dea00640 1 -- 172.21.15.17:0/1104472443 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f06d8010a00 con 0x7f06e8073e40 2024-09-10T23:16:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.547+0000 7f06dea00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c40725e0 0x7f06c4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.547+0000 7f06dea00640 1 -- 172.21.15.17:0/1104472443 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f06d80940f0 con 0x7f06e8073e40 2024-09-10T23:16:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.547+0000 7f06dd400640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c40725e0 0x7f06c4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:07.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.547+0000 7f06dd400640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c40725e0 0x7f06c4074aa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06d00046c0 tx=0x7f06d00078b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:07.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.551+0000 7f06dea00640 1 -- 172.21.15.17:0/1104472443 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f06d805f370 con 0x7f06e8073e40 2024-09-10T23:16:07.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.759+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06e80747f0 con 0x7f06e8073e40 2024-09-10T23:16:07.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.759+0000 7f06dea00640 1 -- 172.21.15.17:0/1104472443 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f06d805ec70 con 0x7f06e8073e40 2024-09-10T23:16:07.763 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T23:16:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c40725e0 msgr2=0x7f06c4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c40725e0 0x7f06c4074aa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06d00046c0 tx=0x7f06d00078b0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8073e40 msgr2=0x7f06e80aaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8073e40 0x7f06e80aaac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f06d800e7a0 tx=0x7f06d800ec60 comp rx=0 tx=0).stop 2024-09-10T23:16:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 shutdown_connections 2024-09-10T23:16:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c40725e0 0x7f06c4074aa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e8158470 0x7f06e80ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06e80d0650 0x7f06e80ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 --2- 172.21.15.17:0/1104472443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e8073e40 0x7f06e80aaac0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 >> 172.21.15.17:0/1104472443 conn(0x7f06e80d0c50 msgr2=0x7f06e8155a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 shutdown_connections 2024-09-10T23:16:07.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07.763+0000 7f06eca00640 1 -- 172.21.15.17:0/1104472443 wait complete. 2024-09-10T23:16:07.784 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:16:07.784 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:07.784 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:16:07.784 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:16:07.784 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:07.784 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:16:07.785 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:16:07.785 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:07.785 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:07.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:07.785 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:07.794 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42403sec preferred_lft 42403sec 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:07.795 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:16:07.796 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:07.797 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:16:07.797 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:07.797 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:07.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:16:07.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-09-10T23:16:07.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-09-10T23:16:07.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:16:07.797 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:07.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:07.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:07.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:07.957 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:07.976 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:16:07.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:07.978 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:16:08.037 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:16:08.038 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:08.038 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:08.038 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:08.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:16:08.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:16:08.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:16:08.039 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:08.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:08.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:08.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:08.175 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:16:08.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:08.184 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-10T23:16:08.241 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:08.241 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:08.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:08.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T23:16:08.241 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:08.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:08.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:08.370 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T23:16:08.370 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:08.370 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:08.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T23:16:08.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:16:08.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T23:16:08.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T23:16:08.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T23:16:08.371 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:08.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:08.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:08.510 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:08.511 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:08.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:16:08.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:16:08.511 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:08.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:08.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:08.639 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:16:08.639 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:08.639 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:08.649 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:08.649 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:08.650 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:08.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:16:08.765 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:08.822 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:16:08.822 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:16:08.822 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:16:08.823 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:16:08.823 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:16:08.823 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:16:08.823 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:16:08.823 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:16:08.824 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:16:08.824 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:16:08.824 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:16:08.824 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:16:08.824 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:08.824 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:16:08.824 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:16:08.824 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:16:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:16:08.826 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:16:08.826 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:08.826 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:08.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:08.827 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:16:08.876 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:16:08.876 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:16:08.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:16:08.947 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:16:08.998 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:16:08.999 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:16:09.000 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:16:09.000 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:16:09.000 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:16:09.000 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:16:09.000 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:09.000 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:09.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:09.001 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:16:09.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:16:09.019+0000 7fb7eb446580 -1 init, newargv = 0x555610482c90 newargc=15 2024-09-10T23:16:09.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[35310]: starting ceph client 2024-09-10T23:16:09.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[35310]: starting fuse 2024-09-10T23:16:09.032 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:16:09.032 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:16:09.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:16:09.032 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:16:09.032 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:16:09.032 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:16:09.032 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:16:09.032 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:16:09.033 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:16:09.034 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:16:09.034 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:16:09.034 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:16:09.034 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:16:09.034 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:09.034 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:16:09.034 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:16:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.35310.asok 2024-09-10T23:16:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:09.172 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35310.asok 2024-09-10T23:16:09.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:09.172 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35310.asok status 2024-09-10T23:16:09.348 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "35310", 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4779, 2024-09-10T23:16:09.349 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 4779 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 185433113 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:16:09.350 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 185433113 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.4779 192.168.0.1:0/185433113", 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/185433113", 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 9, 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 27, 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:16:09.351 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:16:09.363 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T23:16:09.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:09.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 -- 172.21.15.17:0/218177923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d2830 msgr2=0x7f77540b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 --2- 172.21.15.17:0/218177923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d2830 0x7f77540b1610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f77540b3010 tx=0x7f773c01f090 comp rx=0 tx=0).stop 2024-09-10T23:16:09.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 -- 172.21.15.17:0/218177923 shutdown_connections 2024-09-10T23:16:09.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 --2- 172.21.15.17:0/218177923 >> v2:172.21.15.77:3300/0 conn(0x7f77540d0200 0x7f77540b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 --2- 172.21.15.17:0/218177923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d2830 0x7f77540b1610 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 -- 172.21.15.17:0/218177923 >> 172.21.15.17:0/218177923 conn(0x7f77540d1d10 msgr2=0x7f77540d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:09.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 -- 172.21.15.17:0/218177923 shutdown_connections 2024-09-10T23:16:09.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 -- 172.21.15.17:0/218177923 wait complete. 2024-09-10T23:16:09.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 Processor -- start 2024-09-10T23:16:09.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 -- start start 2024-09-10T23:16:09.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d0200 0x7f775406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:09.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77540d2830 0x7f77541f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:09.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7754160280 0x7f77541f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:09.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f77541608d0 con 0x7f77540d0200 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f77540b07c0 con 0x7f7754160280 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.507+0000 7f775a600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f77540b2090 con 0x7f77540d2830 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d0200 0x7f775406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d0200 0x7f775406dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41260/0 (socket says 172.21.15.17:41260) 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753400640 1 -- 172.21.15.17:0/2155666100 learned_addr learned my addr 172.21.15.17:0/2155666100 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f774be00640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77540d2830 0x7f77541f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753e00640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7754160280 0x7f77541f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753400640 1 -- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77540d2830 msgr2=0x7f77541f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753400640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77540d2830 0x7f77541f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753400640 1 -- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7754160280 msgr2=0x7f77541f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753400640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7754160280 0x7f77541f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753400640 1 -- 172.21.15.17:0/2155666100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7754072430 con 0x7f77540d0200 2024-09-10T23:16:09.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f7753400640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d0200 0x7f775406dcd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f774400c410 tx=0x7f7744001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f774b400640 1 -- 172.21.15.17:0/2155666100 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744011790 con 0x7f77540d0200 2024-09-10T23:16:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f774b400640 1 -- 172.21.15.17:0/2155666100 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7744017070 con 0x7f77540d0200 2024-09-10T23:16:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775406e210 con 0x7f77540d0200 2024-09-10T23:16:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f774b400640 1 -- 172.21.15.17:0/2155666100 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744011d00 con 0x7f77540d0200 2024-09-10T23:16:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77540ceee0 con 0x7f77540d0200 2024-09-10T23:16:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77540b25b0 con 0x7f77540d0200 2024-09-10T23:16:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.511+0000 7f774b400640 1 -- 172.21.15.17:0/2155666100 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f774401c460 con 0x7f77540d0200 2024-09-10T23:16:09.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.515+0000 7f774b400640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f77300725e0 0x7f7730074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:09.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.515+0000 7f774b400640 1 -- 172.21.15.17:0/2155666100 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f77440932b0 con 0x7f77540d0200 2024-09-10T23:16:09.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.515+0000 7f774be00640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f77300725e0 0x7f7730074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:09.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.515+0000 7f774be00640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f77300725e0 0x7f7730074aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f773c0b2000 tx=0x7f773c01d8d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:09.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.519+0000 7f774b400640 1 -- 172.21.15.17:0/2155666100 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f774405dff0 con 0x7f77540d0200 2024-09-10T23:16:09.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.731+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f77540b5b40 con 0x7f77540d0200 2024-09-10T23:16:09.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.731+0000 7f774b400640 1 -- 172.21.15.17:0/2155666100 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f7744062a20 con 0x7f77540d0200 2024-09-10T23:16:09.736 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T23:16:09.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f77300725e0 msgr2=0x7f7730074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f77300725e0 0x7f7730074aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f773c0b2000 tx=0x7f773c01d8d0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d0200 msgr2=0x7f775406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:09.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d0200 0x7f775406dcd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f774400c410 tx=0x7f7744001e80 comp rx=0 tx=0).stop 2024-09-10T23:16:09.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 shutdown_connections 2024-09-10T23:16:09.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f77300725e0 0x7f7730074aa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7754160280 0x7f77541f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77540d2830 0x7f77541f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 --2- 172.21.15.17:0/2155666100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77540d0200 0x7f775406dcd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:09.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 >> 172.21.15.17:0/2155666100 conn(0x7f77540d1d10 msgr2=0x7f77540b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:09.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 shutdown_connections 2024-09-10T23:16:09.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09.735+0000 7f775a600640 1 -- 172.21.15.17:0/2155666100 wait complete. 2024-09-10T23:16:09.758 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:16:09.758 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:09.758 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:16:09.758 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T23:16:09.758 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T23:16:09.758 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:16:09.758 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:16:09.758 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:09.758 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T23:16:09.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:09.758 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:16:09.767 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:09.767 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:09.767 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42401sec preferred_lft 42401sec 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:16:09.768 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:09.769 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:16:09.770 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:09.770 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-09-10T23:16:09.770 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:09.770 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:09.770 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:09.770 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-09-10T23:16:09.770 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:09.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:09.771 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:09.834 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:16:09.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:09.836 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:16:09.886 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:16:09.886 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:09.886 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:16:09.886 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:16:09.886 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:16:09.886 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:09.886 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:09.887 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:09.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:16:09.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:16:09.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:16:09.887 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:09.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:10.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:10.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:10.024 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:16:10.033 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:16:10.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:10.034 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-09-10T23:16:10.090 INFO:teuthology.orchestra.run.smithi017.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T23:16:10.091 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:10.091 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:10.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:10.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T23:16:10.091 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:10.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:10.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:10.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:10.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T23:16:10.285 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:10.285 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:10.285 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:10.285 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:10.286 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:10.286 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:10.286 INFO:teuthology.orchestra.run.smithi017.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:10.286 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether e6:a3:de:f0:a5:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T23:16:10.286 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T23:16:10.286 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:10.286 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::e4a3:deff:fef0:a582/64 scope link tentative 2024-09-10T23:16:10.286 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:10.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:10.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T23:16:10.348 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether e6:a3:de:f0:a5:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::e4a3:deff:fef0:a582/64 scope link tentative 2024-09-10T23:16:10.349 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:10.351 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T23:16:10.351 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:10.351 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:10.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T23:16:10.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T23:16:10.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T23:16:10.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T23:16:10.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T23:16:10.351 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:10.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:10.532 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:10.532 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:10.532 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.1 up 2024-09-10T23:16:10.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T23:16:10.533 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:10.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:10.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:10.618 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-10T23:16:10.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:10.619 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T23:16:10.628 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T23:16:10.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:10.628 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T23:16:10.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:16:10.740 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:16:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:16:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:16:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:16:10.795 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:16:10.795 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:16:10.795 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:16:10.795 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:16:10.795 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:16:10.795 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:16:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:16:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:16:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:16:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:16:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:16:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:16:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:16:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:10.798 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:16:10.798 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:10.798 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:16:10.798 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:16:10.798 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:16:10.799 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:16:10.799 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:16:10.799 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:16:10.800 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:16:10.800 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:16:10.800 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:10.800 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:10.800 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:10.800 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:10.800 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:10.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:10.802 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:16:10.852 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:16:10.853 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-09-10T23:16:10.853 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-10T23:16:10.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:16:10.920 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:16:10.974 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:16:10.975 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:16:10.976 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:16:10.976 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:16:10.976 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:16:10.976 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:16:10.976 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:10.976 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:10.976 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:10.976 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:10.976 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:10.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:10.977 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:16:10.996 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi017.stderr:2024-09-10T23:16:10.991+0000 7fe28daee580 -1 init, newargv = 0x55d35963bac0 newargc=15 2024-09-10T23:16:10.996 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi017.stderr:ceph-fuse[35449]: starting ceph client 2024-09-10T23:16:11.004 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:16:11.004 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi017.stderr:ceph-fuse[35449]: starting fuse 2024-09-10T23:16:12.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:16:12.130 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:12.183 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:16:12.183 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:16:12.183 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:16:12.183 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:16:12.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:16:12.183 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:16:12.183 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:16:12.183 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:16:12.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:16:12.184 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.2 2024-09-10T23:16:12.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:12.186 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:16:12.237 INFO:teuthology.orchestra.run.smithi017.stdout:45 2024-09-10T23:16:12.237 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:16:12.238 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.2")) 2024-09-10T23:16:12.239 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:16:12.373 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.2.35449.asok 2024-09-10T23:16:12.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:12.386 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35449.asok 2024-09-10T23:16:12.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:12.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.35449.asok status 2024-09-10T23:16:12.563 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:16:12.563 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:16:12.563 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:16:12.563 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:16:12.563 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "2", 2024-09-10T23:16:12.563 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:16:12.563 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-10T23:16:12.563 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "35449", 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4791, 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 4791 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.2:0", 2024-09-10T23:16:12.564 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1664008734 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.2:0", 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1664008734 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.4791 192.168.0.2:0/1664008734", 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.2:0/1664008734", 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 9, 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 27, 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:16:12.565 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:16:12.566 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:16:12.566 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:16:12.578 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T23:16:12.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:12.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.719+0000 7f602b000640 1 -- 172.21.15.17:0/2242076005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 msgr2=0x7f60240cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.719+0000 7f602b000640 1 --2- 172.21.15.17:0/2242076005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 0x7f60240cfaf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6014009840 tx=0x7f601401f010 comp rx=0 tx=0).stop 2024-09-10T23:16:12.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 -- 172.21.15.17:0/2242076005 shutdown_connections 2024-09-10T23:16:12.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 --2- 172.21.15.17:0/2242076005 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60240d2830 0x7f60240d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 --2- 172.21.15.17:0/2242076005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 0x7f60240cfaf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 -- 172.21.15.17:0/2242076005 >> 172.21.15.17:0/2242076005 conn(0x7f60240d1d10 msgr2=0x7f60240d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:12.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 -- 172.21.15.17:0/2242076005 shutdown_connections 2024-09-10T23:16:12.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 -- 172.21.15.17:0/2242076005 wait complete. 2024-09-10T23:16:12.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 Processor -- start 2024-09-10T23:16:12.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 -- start start 2024-09-10T23:16:12.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60240d2830 0x7f60240c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:12.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 0x7f602406f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:12.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6024160660 0x7f60240c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:12.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f60240afe30 con 0x7f6024160280 2024-09-10T23:16:12.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f60240afcb0 con 0x7f6024160660 2024-09-10T23:16:12.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f602b000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f60240affb0 con 0x7f60240d2830 2024-09-10T23:16:12.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f601be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 0x7f602406f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:12.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f601be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 0x7f602406f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41278/0 (socket says 172.21.15.17:41278) 2024-09-10T23:16:12.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f601be00640 1 -- 172.21.15.17:0/4030745128 learned_addr learned my addr 172.21.15.17:0/4030745128 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:12.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f6023e00640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60240d2830 0x7f60240c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:12.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f6029000640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6024160660 0x7f60240c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:12.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f601be00640 1 -- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60240d2830 msgr2=0x7f60240c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f601be00640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60240d2830 0x7f60240c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f601be00640 1 -- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6024160660 msgr2=0x7f60240c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f601be00640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6024160660 0x7f60240c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f601be00640 1 -- 172.21.15.17:0/4030745128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602406e260 con 0x7f6024160280 2024-09-10T23:16:12.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.723+0000 7f6029000640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6024160660 0x7f60240c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:12.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f601be00640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 0x7f602406f300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f600c00d980 tx=0x7f600c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:12.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f6020c00640 1 -- 172.21.15.17:0/4030745128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c017070 con 0x7f6024160280 2024-09-10T23:16:12.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f6020c00640 1 -- 172.21.15.17:0/4030745128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f600c009d20 con 0x7f6024160280 2024-09-10T23:16:12.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f6020c00640 1 -- 172.21.15.17:0/4030745128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c0106c0 con 0x7f6024160280 2024-09-10T23:16:12.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602406e540 con 0x7f6024160280 2024-09-10T23:16:12.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602406eb00 con 0x7f6024160280 2024-09-10T23:16:12.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60240b04a0 con 0x7f6024160280 2024-09-10T23:16:12.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f6020c00640 1 -- 172.21.15.17:0/4030745128 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f600c010860 con 0x7f6024160280 2024-09-10T23:16:12.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f6020c00640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60000725e0 0x7f6000074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:12.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.727+0000 7f6020c00640 1 -- 172.21.15.17:0/4030745128 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f600c093b30 con 0x7f6024160280 2024-09-10T23:16:12.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.731+0000 7f6023e00640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60000725e0 0x7f6000074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:12.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.731+0000 7f6023e00640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60000725e0 0x7f6000074aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f60140b2000 tx=0x7f601401d850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:12.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.731+0000 7f6020c00640 1 -- 172.21.15.17:0/4030745128 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f600c05ee30 con 0x7f6024160280 2024-09-10T23:16:12.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.947+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6024074af0 con 0x7f6024160280 2024-09-10T23:16:12.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.947+0000 7f6020c00640 1 -- 172.21.15.17:0/4030745128 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f600c05e730 con 0x7f6024160280 2024-09-10T23:16:12.953 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T23:16:12.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60000725e0 msgr2=0x7f6000074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60000725e0 0x7f6000074aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f60140b2000 tx=0x7f601401d850 comp rx=0 tx=0).stop 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 msgr2=0x7f602406f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 0x7f602406f300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f600c00d980 tx=0x7f600c00de40 comp rx=0 tx=0).stop 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 shutdown_connections 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60000725e0 0x7f6000074aa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6024160660 0x7f60240c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6024160280 0x7f602406f300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 --2- 172.21.15.17:0/4030745128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60240d2830 0x7f60240c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 >> 172.21.15.17:0/4030745128 conn(0x7f60240d1d10 msgr2=0x7f60240b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 shutdown_connections 2024-09-10T23:16:12.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:12.951+0000 7f602b000640 1 -- 172.21.15.17:0/4030745128 wait complete. 2024-09-10T23:16:12.975 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:16:12.975 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:12.975 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-09-10T23:16:12.975 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T23:16:12.976 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:12.976 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:16:12.976 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:16:12.976 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:12.976 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:16:12.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:12.977 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-09-10T23:16:12.987 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:12.987 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:12.987 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:12.987 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:12.987 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:12.987 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:12.987 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42391sec preferred_lft 42391sec 2024-09-10T23:16:12.988 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2024-09-10T23:16:12.989 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:12.989 INFO:teuthology.orchestra.run.smithi077.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:16:12.989 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 02:42:e8:0a:53:af brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:12.989 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:16:12.989 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:12.990 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T23:16:12.990 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:12.990 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-10T23:16:12.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2024-09-10T23:16:12.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2024-09-10T23:16:12.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2024-09-10T23:16:12.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T23:16:12.990 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-10T23:16:13.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:13.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:13.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:13.152 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:13.170 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-10T23:16:13.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:13.172 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-09-10T23:16:13.251 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-09-10T23:16:13.251 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:13.251 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T23:16:13.251 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:16:13.251 INFO:teuthology.orchestra.run.smithi077.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T23:16:13.251 INFO:teuthology.orchestra.run.smithi077.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:16:13.251 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:16:13.251 INFO:teuthology.orchestra.run.smithi077.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T23:16:13.252 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T23:16:13.252 INFO:teuthology.orchestra.run.smithi077.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T23:16:13.252 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:13.252 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:13.252 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-10T23:16:13.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:16:13.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:16:13.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:16:13.253 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-10T23:16:13.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:13.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:13.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:13.392 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-10T23:16:13.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:13.401 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-09-10T23:16:13.451 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:13.452 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-10T23:16:13.452 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:13.452 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T23:16:13.452 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-10T23:16:13.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:13.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:13.581 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T23:16:13.581 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:13.581 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-10T23:16:13.581 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T23:16:13.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T23:16:13.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T23:16:13.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T23:16:13.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T23:16:13.582 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-10T23:16:13.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:13.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:13.741 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:13.741 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-10T23:16:13.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-09-10T23:16:13.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T23:16:13.741 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-10T23:16:13.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:13.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:13.870 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-10T23:16:13.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:13.870 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:13.879 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T23:16:13.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:13.879 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:13.934 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-10T23:16:13.995 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:14.048 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-10T23:16:14.048 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-10T23:16:14.048 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-10T23:16:14.048 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-10T23:16:14.048 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-10T23:16:14.048 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-10T23:16:14.048 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/run/lock 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/fs/nfsd 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:14.049 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/run/rpc_pipefs 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:14.050 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:14.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:14.051 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-10T23:16:14.106 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:16:14.106 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-10T23:16:14.149 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-10T23:16:14.169 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:14.221 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-10T23:16:14.221 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-10T23:16:14.221 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-10T23:16:14.221 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-10T23:16:14.221 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-10T23:16:14.221 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-10T23:16:14.221 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/run/lock 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/fs/nfsd 2024-09-10T23:16:14.222 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/run/rpc_pipefs 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:14.223 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:14.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:14.224 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-10T23:16:14.244 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi077.stderr:2024-09-10T23:16:14.241+0000 7f881af70580 -1 init, newargv = 0x5578b43dd920 newargc=15 2024-09-10T23:16:14.245 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi077.stderr:ceph-fuse[34680]: starting ceph client 2024-09-10T23:16:14.252 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi077.stderr:ceph-fuse[34680]: starting fuse 2024-09-10T23:16:15.354 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-10T23:16:15.376 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:15.428 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-10T23:16:15.428 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-10T23:16:15.428 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-10T23:16:15.428 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-10T23:16:15.428 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-10T23:16:15.428 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/run/lock 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/fs/nfsd 2024-09-10T23:16:15.429 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/run/rpc_pipefs 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:15.430 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:15.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:15.431 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-10T23:16:15.483 INFO:teuthology.orchestra.run.smithi077.stdout:44 2024-09-10T23:16:15.483 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:16:15.483 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:16:15.483 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> import re 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> import os 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2024-09-10T23:16:15.484 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> return f 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-10T23:16:15.485 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.1")) 2024-09-10T23:16:15.486 DEBUG:teuthology.orchestra.run.smithi077:> ' 2024-09-10T23:16:15.613 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.1.34680.asok 2024-09-10T23:16:15.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:15.624 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34680.asok 2024-09-10T23:16:15.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:15.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34680.asok status 2024-09-10T23:16:15.794 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-10T23:16:15.794 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2024-09-10T23:16:15.794 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:16:15.794 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:16:15.794 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "1", 2024-09-10T23:16:15.794 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2024-09-10T23:16:15.794 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-10T23:16:15.794 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "34680", 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4598, 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4598 2024-09-10T23:16:15.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1277417410 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1277417410 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4598 192.168.0.1:0/1277417410", 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/1277417410", 2024-09-10T23:16:15.796 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2024-09-10T23:16:15.797 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 9, 2024-09-10T23:16:15.797 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 27, 2024-09-10T23:16:15.797 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:16:15.797 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2024-09-10T23:16:15.797 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2024-09-10T23:16:15.797 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-10T23:16:15.809 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T23:16:15.809 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 -- 172.21.15.17:0/1535659064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac0cee30 msgr2=0x7f17ac0b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 --2- 172.21.15.17:0/1535659064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac0cee30 0x7f17ac0b1430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f17ac073bd0 tx=0x7f17a401caf0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 -- 172.21.15.17:0/1535659064 shutdown_connections 2024-09-10T23:16:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 --2- 172.21.15.17:0/1535659064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac0cee30 0x7f17ac0b1430 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 --2- 172.21.15.17:0/1535659064 >> v2:172.21.15.77:3300/0 conn(0x7f17ac15f350 0x7f17ac0b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 -- 172.21.15.17:0/1535659064 >> 172.21.15.17:0/1535659064 conn(0x7f17ac0d1d10 msgr2=0x7f17ac0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 -- 172.21.15.17:0/1535659064 shutdown_connections 2024-09-10T23:16:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 -- 172.21.15.17:0/1535659064 wait complete. 2024-09-10T23:16:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 Processor -- start 2024-09-10T23:16:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 -- start start 2024-09-10T23:16:15.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0cee30 0x7f17ac15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:15.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac15f350 0x7f17ac1f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:15.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac15f730 0x7f17ac1f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:15.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac168bd0 con 0x7f17ac15f730 2024-09-10T23:16:15.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac0b2440 con 0x7f17ac0cee30 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17b1800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac168d50 con 0x7f17ac15f350 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17ab400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac15f730 0x7f17ac1f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17ab400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac15f730 0x7f17ac1f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41292/0 (socket says 172.21.15.17:41292) 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17ab400640 1 -- 172.21.15.17:0/446865066 learned_addr learned my addr 172.21.15.17:0/446865066 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17aaa00640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0cee30 0x7f17ac15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17a3e00640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac15f350 0x7f17ac1f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17ab400640 1 -- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac15f350 msgr2=0x7f17ac1f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17ab400640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac15f350 0x7f17ac1f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17ab400640 1 -- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0cee30 msgr2=0x7f17ac15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17ab400640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0cee30 0x7f17ac15a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17ab400640 1 -- 172.21.15.17:0/446865066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac159fa0 con 0x7f17ac15f730 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17aaa00640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0cee30 0x7f17ac15a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:15.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17a3e00640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac15f350 0x7f17ac1f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:15.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.967+0000 7f17ab400640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac15f730 0x7f17ac1f81e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f17a401a720 tx=0x7f17a4003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:15.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17a2a00640 1 -- 172.21.15.17:0/446865066 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40bb070 con 0x7f17ac15f730 2024-09-10T23:16:15.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17a2a00640 1 -- 172.21.15.17:0/446865066 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17a4004d40 con 0x7f17ac15f730 2024-09-10T23:16:15.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17a2a00640 1 -- 172.21.15.17:0/446865066 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a40b2040 con 0x7f17ac15f730 2024-09-10T23:16:15.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ac1fbb00 con 0x7f17ac15f730 2024-09-10T23:16:15.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ac15a240 con 0x7f17ac15f730 2024-09-10T23:16:15.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ac1f7970 con 0x7f17ac15f730 2024-09-10T23:16:15.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17a2a00640 1 -- 172.21.15.17:0/446865066 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f17a40b5030 con 0x7f17ac15f730 2024-09-10T23:16:15.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17a2a00640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17880725e0 0x7f1788074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:15.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17a2a00640 1 -- 172.21.15.17:0/446865066 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f17a412d500 con 0x7f17ac15f730 2024-09-10T23:16:15.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.971+0000 7f17aaa00640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17880725e0 0x7f1788074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:15.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.975+0000 7f17aaa00640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17880725e0 0x7f1788074aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f179c009b60 tx=0x7f179c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:15.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:15.975+0000 7f17a2a00640 1 -- 172.21.15.17:0/446865066 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f17a40c4020 con 0x7f17ac15f730 2024-09-10T23:16:16.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.187+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f17ac072700 con 0x7f17ac15f730 2024-09-10T23:16:16.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.187+0000 7f17a2a00640 1 -- 172.21.15.17:0/446865066 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f17a4016770 con 0x7f17ac15f730 2024-09-10T23:16:16.191 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T23:16:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17880725e0 msgr2=0x7f1788074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17880725e0 0x7f1788074aa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f179c009b60 tx=0x7f179c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac15f730 msgr2=0x7f17ac1f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac15f730 0x7f17ac1f81e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f17a401a720 tx=0x7f17a4003f40 comp rx=0 tx=0).stop 2024-09-10T23:16:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 shutdown_connections 2024-09-10T23:16:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17880725e0 0x7f1788074aa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ac15f730 0x7f17ac1f81e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ac15f350 0x7f17ac1f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 --2- 172.21.15.17:0/446865066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ac0cee30 0x7f17ac15a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:16.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 >> 172.21.15.17:0/446865066 conn(0x7f17ac0d1d10 msgr2=0x7f17ac0ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:16.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 shutdown_connections 2024-09-10T23:16:16.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:16.191+0000 7f17b1800640 1 -- 172.21.15.17:0/446865066 wait complete. 2024-09-10T23:16:16.212 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:16:16.212 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:16.212 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-09-10T23:16:16.212 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T23:16:16.213 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T23:16:16.213 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:16:16.213 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:16:16.213 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:16.213 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T23:16:16.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:16.213 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-09-10T23:16:16.222 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:16.222 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:16.222 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:16.222 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.222 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-10T23:16:16.224 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42388sec preferred_lft 42388sec 2024-09-10T23:16:16.224 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2024-09-10T23:16:16.225 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.225 INFO:teuthology.orchestra.run.smithi077.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:16:16.225 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 02:42:e8:0a:53:af brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:16.225 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:16:16.225 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.225 INFO:teuthology.orchestra.run.smithi077.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:16.225 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:16.225 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:16:16.225 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.228 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:16:16.228 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.228 INFO:teuthology.orchestra.run.smithi077.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:16.228 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:16.228 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:16:16.228 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:16.230 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:16.288 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-10T23:16:16.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:16.290 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T23:16:16.347 INFO:teuthology.orchestra.run.smithi077.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-10T23:16:16.348 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:16.348 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:16.348 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-10T23:16:16.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T23:16:16.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T23:16:16.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T23:16:16.348 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-10T23:16:16.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:16.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:16.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:16.492 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-10T23:16:16.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:16:16.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:16.548 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-09-10T23:16:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T23:16:16.599 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:16.599 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-10T23:16:16.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:16:16.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T23:16:16.600 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-10T23:16:16.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:16.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:16.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:16.726 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T23:16:16.747 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:16.747 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:16.747 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:16.747 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.747 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:16.747 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.747 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:16.747 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 46:f9:85:ad:a6:b1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T23:16:16.748 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T23:16:16.748 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.748 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::44f9:85ff:fead:a6b1/64 scope link 2024-09-10T23:16:16.748 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:16.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T23:16:16.815 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:16.815 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:16.815 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:16.815 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.815 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:16.815 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.815 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:16.816 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 46:f9:85:ad:a6:b1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T23:16:16.816 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T23:16:16.816 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.816 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::44f9:85ff:fead:a6b1/64 scope link 2024-09-10T23:16:16.816 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:16.817 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T23:16:16.817 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:16.817 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-10T23:16:16.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T23:16:16.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T23:16:16.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T23:16:16.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T23:16:16.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T23:16:16.818 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-10T23:16:16.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:16.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:16.994 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:16.994 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-10T23:16:16.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.1 up 2024-09-10T23:16:16.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T23:16:16.995 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-10T23:16:17.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:17.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:17.078 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-10T23:16:17.078 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:17.078 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T23:16:17.087 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T23:16:17.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:17.087 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T23:16:17.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-10T23:16:17.206 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-10T23:16:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-10T23:16:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-10T23:16:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-10T23:16:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-10T23:16:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/run/lock 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/fs/nfsd 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:17.261 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/run/rpc_pipefs 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:16:17.262 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:16:17.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:17.264 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-10T23:16:17.318 INFO:teuthology.orchestra.run.smithi077.stdout:44 2024-09-10T23:16:17.318 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-09-10T23:16:17.319 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-10T23:16:17.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-10T23:16:17.385 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-10T23:16:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-10T23:16:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-10T23:16:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-10T23:16:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-10T23:16:17.436 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/run/lock 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/fs/nfsd 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:17.437 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/run/rpc_pipefs 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:16:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:16:17.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:17.439 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-10T23:16:17.460 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi077.stderr:2024-09-10T23:16:17.457+0000 7f2862047580 -1 init, newargv = 0x560a4072c1e0 newargc=15 2024-09-10T23:16:17.460 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi077.stderr:ceph-fuse[34799]: starting ceph client 2024-09-10T23:16:17.469 INFO:teuthology.orchestra.run.smithi077.stdout:44 2024-09-10T23:16:17.472 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi077.stderr:ceph-fuse[34799]: starting fuse 2024-09-10T23:16:18.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-10T23:16:18.592 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:18.644 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-10T23:16:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-10T23:16:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-10T23:16:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-10T23:16:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-10T23:16:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-10T23:16:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-10T23:16:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-10T23:16:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:/run/lock 2024-09-10T23:16:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-10T23:16:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-10T23:16:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-10T23:16:18.646 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-10T23:16:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/fs/nfsd 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:/run/rpc_pipefs 2024-09-10T23:16:18.648 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T23:16:18.649 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T23:16:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-10T23:16:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:16:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:18.650 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:16:18.651 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:16:18.651 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.3 2024-09-10T23:16:18.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:18.652 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-10T23:16:18.707 INFO:teuthology.orchestra.run.smithi077.stdout:44 2024-09-10T23:16:18.707 INFO:teuthology.orchestra.run.smithi077.stdout:45 2024-09-10T23:16:18.707 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-09-10T23:16:18.708 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:16:18.708 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2024-09-10T23:16:18.708 DEBUG:teuthology.orchestra.run.smithi077:> import re 2024-09-10T23:16:18.708 DEBUG:teuthology.orchestra.run.smithi077:> import os 2024-09-10T23:16:18.709 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2024-09-10T23:16:18.709 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-10T23:16:18.709 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2024-09-10T23:16:18.709 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-10T23:16:18.709 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2024-09-10T23:16:18.709 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-10T23:16:18.710 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-10T23:16:18.710 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2024-09-10T23:16:18.710 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2024-09-10T23:16:18.710 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2024-09-10T23:16:18.710 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2024-09-10T23:16:18.711 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-10T23:16:18.711 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2024-09-10T23:16:18.711 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:16:18.711 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:16:18.711 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:16:18.712 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2024-09-10T23:16:18.712 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2024-09-10T23:16:18.712 DEBUG:teuthology.orchestra.run.smithi077:> return f 2024-09-10T23:16:18.712 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:16:18.712 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-10T23:16:18.712 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.3")) 2024-09-10T23:16:18.713 DEBUG:teuthology.orchestra.run.smithi077:> ' 2024-09-10T23:16:18.833 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.3.34799.asok 2024-09-10T23:16:18.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-10T23:16:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:18.844 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.34799.asok 2024-09-10T23:16:18.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:18.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.34799.asok status 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "3", 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "34799", 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-10T23:16:19.015 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4601, 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4601 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3358183615 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-10T23:16:19.016 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3358183615 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4601 192.168.0.2:0/3358183615", 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.2:0/3358183615", 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 9, 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 28, 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2024-09-10T23:16:19.017 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-10T23:16:19.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.030 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:16:19.030 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:19.040 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:16:19.040 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:19.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:19.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.110 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:16:19.110 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-10T23:16:19.162 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:16:19.162 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-10T23:16:19.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T23:16:19.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.226 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2024-09-10T23:16:19.226 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:19.236 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2024-09-10T23:16:19.236 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:19.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.236 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:19.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.298 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2024-09-10T23:16:19.298 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-10T23:16:19.347 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2024-09-10T23:16:19.347 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-10T23:16:19.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:19.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T23:16:19.409 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T23:16:19.468 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-09-10T23:16:19.468 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T23:16:19.468 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.623+0000 7faf23200640 1 -- 172.21.15.17:0/2691648039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf240b4f40 msgr2=0x7faf24164460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.623+0000 7faf23200640 1 --2- 172.21.15.17:0/2691648039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf240b4f40 0x7faf24164460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009bc0 tx=0x7faf1c01cba0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.623+0000 7faf23200640 1 -- 172.21.15.17:0/2691648039 shutdown_connections 2024-09-10T23:16:19.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.623+0000 7faf23200640 1 --2- 172.21.15.17:0/2691648039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf240b4f40 0x7faf24164460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.623+0000 7faf23200640 1 --2- 172.21.15.17:0/2691648039 >> v2:172.21.15.77:3300/0 conn(0x7faf24070ab0 0x7faf240b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.623+0000 7faf23200640 1 -- 172.21.15.17:0/2691648039 >> 172.21.15.17:0/2691648039 conn(0x7faf240b2740 msgr2=0x7faf240b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:19.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.623+0000 7faf23200640 1 -- 172.21.15.17:0/2691648039 shutdown_connections 2024-09-10T23:16:19.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.623+0000 7faf23200640 1 -- 172.21.15.17:0/2691648039 wait complete. 2024-09-10T23:16:19.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.623+0000 7faf23200640 1 Processor -- start 2024-09-10T23:16:19.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 -- start start 2024-09-10T23:16:19.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf24070ab0 0x7faf241512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf240b4620 0x7faf24141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf240b4f40 0x7faf24141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faf241677c0 con 0x7faf24070ab0 2024-09-10T23:16:19.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf24167640 con 0x7faf240b4f40 2024-09-10T23:16:19.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faf24167940 con 0x7faf240b4620 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf21e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf24070ab0 0x7faf241512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf21e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf24070ab0 0x7faf241512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37628/0 (socket says 172.21.15.17:37628) 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf21e00640 1 -- 172.21.15.17:0/500393153 learned_addr learned my addr 172.21.15.17:0/500393153 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf1be00640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf240b4620 0x7faf24141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf22800640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf240b4f40 0x7faf24141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf21e00640 1 -- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf240b4620 msgr2=0x7faf24141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf21e00640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf240b4620 0x7faf24141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf21e00640 1 -- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf240b4f40 msgr2=0x7faf24141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf21e00640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf240b4f40 0x7faf24141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf21e00640 1 -- 172.21.15.17:0/500393153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf241fa8c0 con 0x7faf24070ab0 2024-09-10T23:16:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf21e00640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf24070ab0 0x7faf241512a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c490 tx=0x7faf1400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf1a000640 1 -- 172.21.15.17:0/500393153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14016020 con 0x7faf24070ab0 2024-09-10T23:16:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf1a000640 1 -- 172.21.15.17:0/500393153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf14012940 con 0x7faf24070ab0 2024-09-10T23:16:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf241fab60 con 0x7faf24070ab0 2024-09-10T23:16:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf1a000640 1 -- 172.21.15.17:0/500393153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14012d90 con 0x7faf24070ab0 2024-09-10T23:16:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf241fb120 con 0x7faf24070ab0 2024-09-10T23:16:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.627+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf240b4a00 con 0x7faf24070ab0 2024-09-10T23:16:19.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.631+0000 7faf1a000640 1 -- 172.21.15.17:0/500393153 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faf1401b400 con 0x7faf24070ab0 2024-09-10T23:16:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.631+0000 7faf1a000640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf000725e0 0x7faf00074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.631+0000 7faf1a000640 1 -- 172.21.15.17:0/500393153 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7faf140935b0 con 0x7faf24070ab0 2024-09-10T23:16:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.631+0000 7faf1be00640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf000725e0 0x7faf00074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.631+0000 7faf1be00640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf000725e0 0x7faf00074aa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009600 tx=0x7faf0c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.635+0000 7faf1a000640 1 -- 172.21.15.17:0/500393153 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faf14020030 con 0x7faf24070ab0 2024-09-10T23:16:19.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf240b1e00 con 0x7faf24070ab0 2024-09-10T23:16:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf1a000640 1 -- 172.21.15.17:0/500393153 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18917 (secure 0 0 0) 0x7faf14063e20 con 0x7faf24070ab0 2024-09-10T23:16:19.815 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:19.815 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":29,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:16:17.457339+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1},{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf000725e0 msgr2=0x7faf00074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf000725e0 0x7faf00074aa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009600 tx=0x7faf0c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf24070ab0 msgr2=0x7faf241512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf24070ab0 0x7faf241512a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c490 tx=0x7faf1400c950 comp rx=0 tx=0).stop 2024-09-10T23:16:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 shutdown_connections 2024-09-10T23:16:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf000725e0 0x7faf00074aa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf240b4f40 0x7faf24141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf240b4620 0x7faf24141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 --2- 172.21.15.17:0/500393153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf24070ab0 0x7faf241512a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 >> 172.21.15.17:0/500393153 conn(0x7faf240b2740 msgr2=0x7faf240d0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 shutdown_connections 2024-09-10T23:16:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.811+0000 7faf23200640 1 -- 172.21.15.17:0/500393153 wait complete. 2024-09-10T23:16:19.837 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T23:15:33.979589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T23:15:35.167051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-10T23:15:38.827993+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-10T23:16:19.837 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:16:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.983+0000 7fa766000640 1 -- 172.21.15.17:0/1404977374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7600b5150 msgr2=0x7fa7600b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.983+0000 7fa766000640 1 --2- 172.21.15.17:0/1404977374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7600b5150 0x7fa7600b08d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa748009840 tx=0x7fa74801c790 comp rx=0 tx=0).stop 2024-09-10T23:16:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.983+0000 7fa766000640 1 -- 172.21.15.17:0/1404977374 shutdown_connections 2024-09-10T23:16:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.983+0000 7fa766000640 1 --2- 172.21.15.17:0/1404977374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7600b5150 0x7fa7600b08d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.983+0000 7fa766000640 1 -- 172.21.15.17:0/1404977374 >> 172.21.15.17:0/1404977374 conn(0x7fa7600d0360 msgr2=0x7fa7600d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.983+0000 7fa766000640 1 -- 172.21.15.17:0/1404977374 shutdown_connections 2024-09-10T23:16:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.983+0000 7fa766000640 1 -- 172.21.15.17:0/1404977374 wait complete. 2024-09-10T23:16:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.983+0000 7fa766000640 1 Processor -- start 2024-09-10T23:16:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.983+0000 7fa766000640 1 -- start start 2024-09-10T23:16:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa766000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa760074550 0x7fa7600be820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa766000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa760074ea0 0x7fa7601fba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa766000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7601551d0 0x7fa7601548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa766000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa76016a280 con 0x7fa760074550 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa766000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa76016a100 con 0x7fa7601551d0 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa766000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa76016a400 con 0x7fa760074ea0 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa760074550 0x7fa7600be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa760074550 0x7fa7600be820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37634/0 (socket says 172.21.15.17:37634) 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75f400640 1 -- 172.21.15.17:0/1722171252 learned_addr learned my addr 172.21.15.17:0/1722171252 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa757e00640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa760074ea0 0x7fa7601fba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75fe00640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7601551d0 0x7fa7601548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75f400640 1 -- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa760074ea0 msgr2=0x7fa7601fba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75f400640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa760074ea0 0x7fa7601fba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75f400640 1 -- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7601551d0 msgr2=0x7fa7601548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75f400640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7601551d0 0x7fa7601548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75f400640 1 -- 172.21.15.17:0/1722171252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7600cff20 con 0x7fa760074550 2024-09-10T23:16:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75fe00640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7601551d0 0x7fa7601548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa75f400640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa760074550 0x7fa7600be820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa75000c480 tx=0x7fa75000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa757400640 1 -- 172.21.15.17:0/1722171252 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750017070 con 0x7fa760074550 2024-09-10T23:16:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa757400640 1 -- 172.21.15.17:0/1722171252 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7500053c0 con 0x7fa760074550 2024-09-10T23:16:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa757400640 1 -- 172.21.15.17:0/1722171252 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750012890 con 0x7fa760074550 2024-09-10T23:16:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7600cc450 con 0x7fa760074550 2024-09-10T23:16:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7600cfc40 con 0x7fa760074550 2024-09-10T23:16:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.987+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7600b5da0 con 0x7fa760074550 2024-09-10T23:16:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.991+0000 7fa757400640 1 -- 172.21.15.17:0/1722171252 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa750003600 con 0x7fa760074550 2024-09-10T23:16:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.991+0000 7fa757400640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa73c0725e0 0x7fa73c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.991+0000 7fa757400640 1 -- 172.21.15.17:0/1722171252 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fa750092b80 con 0x7fa760074550 2024-09-10T23:16:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.991+0000 7fa757e00640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa73c0725e0 0x7fa73c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.991+0000 7fa757e00640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa73c0725e0 0x7fa73c074aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa7480af000 tx=0x7fa7480b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:19.995+0000 7fa757400640 1 -- 172.21.15.17:0/1722171252 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa75005d800 con 0x7fa760074550 2024-09-10T23:16:20.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.167+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa7600af290 con 0x7fa760074550 2024-09-10T23:16:20.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.167+0000 7fa757400640 1 -- 172.21.15.17:0/1722171252 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fa750062230 con 0x7fa760074550 2024-09-10T23:16:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:16:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa73c0725e0 msgr2=0x7fa73c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa73c0725e0 0x7fa73c074aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa7480af000 tx=0x7fa7480b2040 comp rx=0 tx=0).stop 2024-09-10T23:16:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa760074550 msgr2=0x7fa7600be820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa760074550 0x7fa7600be820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa75000c480 tx=0x7fa75000c940 comp rx=0 tx=0).stop 2024-09-10T23:16:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 shutdown_connections 2024-09-10T23:16:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa73c0725e0 0x7fa73c074aa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7601551d0 0x7fa7601548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa760074ea0 0x7fa7601fba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 --2- 172.21.15.17:0/1722171252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa760074550 0x7fa7600be820 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 >> 172.21.15.17:0/1722171252 conn(0x7fa7600d0360 msgr2=0x7fa7600ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 shutdown_connections 2024-09-10T23:16:20.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.171+0000 7fa766000640 1 -- 172.21.15.17:0/1722171252 wait complete. 2024-09-10T23:16:20.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T23:16:20.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.339+0000 7f4eb4c00640 1 -- 172.21.15.17:0/2408154984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb00b2540 msgr2=0x7f4eb00d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.339+0000 7f4eb4c00640 1 --2- 172.21.15.17:0/2408154984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb00b2540 0x7f4eb00d03b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009840 tx=0x7f4e9801c740 comp rx=0 tx=0).stop 2024-09-10T23:16:20.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.339+0000 7f4eb4c00640 1 -- 172.21.15.17:0/2408154984 shutdown_connections 2024-09-10T23:16:20.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.339+0000 7f4eb4c00640 1 --2- 172.21.15.17:0/2408154984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb00b2540 0x7f4eb00d03b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.339+0000 7f4eb4c00640 1 -- 172.21.15.17:0/2408154984 >> 172.21.15.17:0/2408154984 conn(0x7f4eb00d1da0 msgr2=0x7f4eb00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:20.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.339+0000 7f4eb4c00640 1 -- 172.21.15.17:0/2408154984 shutdown_connections 2024-09-10T23:16:20.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.339+0000 7f4eb4c00640 1 -- 172.21.15.17:0/2408154984 wait complete. 2024-09-10T23:16:20.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 Processor -- start 2024-09-10T23:16:20.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 -- start start 2024-09-10T23:16:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eb00b2540 0x7f4eb00b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb00b31b0 0x7f4eb01f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eb015f400 0x7f4eb006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0169e80 con 0x7f4eb00b2540 2024-09-10T23:16:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00cdc80 con 0x7f4eb00b31b0 2024-09-10T23:16:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb016a000 con 0x7f4eb015f400 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eade00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eb00b2540 0x7f4eb00b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eade00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eb00b2540 0x7f4eb00b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37636/0 (socket says 172.21.15.17:37636) 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eade00640 1 -- 172.21.15.17:0/1047381168 learned_addr learned my addr 172.21.15.17:0/1047381168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4ea5400640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb00b31b0 0x7f4eb01f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eae800640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eb015f400 0x7f4eb006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eade00640 1 -- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eb015f400 msgr2=0x7f4eb006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eade00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eb015f400 0x7f4eb006ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eade00640 1 -- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb00b31b0 msgr2=0x7f4eb01f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eade00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb00b31b0 0x7f4eb01f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eade00640 1 -- 172.21.15.17:0/1047381168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb01f7ed0 con 0x7f4eb00b2540 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eade00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eb00b2540 0x7f4eb00b5490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c6e0 tx=0x7f4ea000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4ea6a00640 1 -- 172.21.15.17:0/1047381168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0016020 con 0x7f4eb00b2540 2024-09-10T23:16:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4ea6a00640 1 -- 172.21.15.17:0/1047381168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ea000a930 con 0x7f4eb00b2540 2024-09-10T23:16:20.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb01f81b0 con 0x7f4eb00b2540 2024-09-10T23:16:20.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4ea6a00640 1 -- 172.21.15.17:0/1047381168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000ad80 con 0x7f4eb00b2540 2024-09-10T23:16:20.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb00b4c90 con 0x7f4eb00b2540 2024-09-10T23:16:20.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.343+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb00cc8b0 con 0x7f4eb00b2540 2024-09-10T23:16:20.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.347+0000 7f4ea6a00640 1 -- 172.21.15.17:0/1047381168 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4ea0012420 con 0x7f4eb00b2540 2024-09-10T23:16:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.347+0000 7f4ea6a00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e8c0725e0 0x7f4e8c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.347+0000 7f4ea6a00640 1 -- 172.21.15.17:0/1047381168 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7f4ea0093920 con 0x7f4eb00b2540 2024-09-10T23:16:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.347+0000 7f4ea5400640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e8c0725e0 0x7f4e8c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.347+0000 7f4ea5400640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e8c0725e0 0x7f4e8c074aa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4e980af000 tx=0x7f4e980b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:20.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.351+0000 7f4ea6a00640 1 -- 172.21.15.17:0/1047381168 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4ea0020020 con 0x7f4eb00b2540 2024-09-10T23:16:20.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.527+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4eb0070bc0 con 0x7f4eb00b2540 2024-09-10T23:16:20.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.527+0000 7f4ea6a00640 1 -- 172.21.15.17:0/1047381168 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f4ea005e5a0 con 0x7f4eb00b2540 2024-09-10T23:16:20.531 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-10T23:16:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e8c0725e0 msgr2=0x7f4e8c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e8c0725e0 0x7f4e8c074aa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4e980af000 tx=0x7f4e980b2040 comp rx=0 tx=0).stop 2024-09-10T23:16:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eb00b2540 msgr2=0x7f4eb00b5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eb00b2540 0x7f4eb00b5490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c6e0 tx=0x7f4ea000cba0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 shutdown_connections 2024-09-10T23:16:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e8c0725e0 0x7f4e8c074aa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eb015f400 0x7f4eb006ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb00b31b0 0x7f4eb01f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 --2- 172.21.15.17:0/1047381168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eb00b2540 0x7f4eb00b5490 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 >> 172.21.15.17:0/1047381168 conn(0x7f4eb00d1da0 msgr2=0x7f4eb006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:20.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 shutdown_connections 2024-09-10T23:16:20.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.531+0000 7f4eb4c00640 1 -- 172.21.15.17:0/1047381168 wait complete. 2024-09-10T23:16:20.552 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T23:16:20.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.699+0000 7fdcd8600640 1 -- 172.21.15.17:0/237890208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcd015f400 msgr2=0x7fdcd00cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.699+0000 7fdcd8600640 1 --2- 172.21.15.17:0/237890208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcd015f400 0x7fdcd00cfca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009840 tx=0x7fdcc401c820 comp rx=0 tx=0).stop 2024-09-10T23:16:20.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.699+0000 7fdcd8600640 1 -- 172.21.15.17:0/237890208 shutdown_connections 2024-09-10T23:16:20.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.699+0000 7fdcd8600640 1 --2- 172.21.15.17:0/237890208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcd00b31b0 0x7fdcd00d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.699+0000 7fdcd8600640 1 --2- 172.21.15.17:0/237890208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcd015f400 0x7fdcd00cfca0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.699+0000 7fdcd8600640 1 -- 172.21.15.17:0/237890208 >> 172.21.15.17:0/237890208 conn(0x7fdcd00d1da0 msgr2=0x7fdcd00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:20.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.699+0000 7fdcd8600640 1 -- 172.21.15.17:0/237890208 shutdown_connections 2024-09-10T23:16:20.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.699+0000 7fdcd8600640 1 -- 172.21.15.17:0/237890208 wait complete. 2024-09-10T23:16:20.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 Processor -- start 2024-09-10T23:16:20.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 -- start start 2024-09-10T23:16:20.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcd00b1530 0x7fdcd00b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcd00b31b0 0x7fdcd015df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcd015f400 0x7fdcd015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd0169100 con 0x7fdcd015f400 2024-09-10T23:16:20.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd0168f80 con 0x7fdcd00b1530 2024-09-10T23:16:20.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd0169280 con 0x7fdcd00b31b0 2024-09-10T23:16:20.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd6600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcd015f400 0x7fdcd015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd6600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcd015f400 0x7fdcd015c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37644/0 (socket says 172.21.15.17:37644) 2024-09-10T23:16:20.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd6600640 1 -- 172.21.15.17:0/1517906403 learned_addr learned my addr 172.21.15.17:0/1517906403 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:20.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd5c00640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcd00b1530 0x7fdcd00b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd5200640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcd00b31b0 0x7fdcd015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd6600640 1 -- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcd00b31b0 msgr2=0x7fdcd015df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd6600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcd00b31b0 0x7fdcd015df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd6600640 1 -- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcd00b1530 msgr2=0x7fdcd00b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd6600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcd00b1530 0x7fdcd00b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd6600640 1 -- 172.21.15.17:0/1517906403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd00c98e0 con 0x7fdcd015f400 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd6600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcd015f400 0x7fdcd015c150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800cbc0 tx=0x7fdcc800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdccd600640 1 -- 172.21.15.17:0/1517906403 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8016020 con 0x7fdcd015f400 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdccd600640 1 -- 172.21.15.17:0/1517906403 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcc800ab00 con 0x7fdcd015f400 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd00c9bc0 con 0x7fdcd015f400 2024-09-10T23:16:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdccd600640 1 -- 172.21.15.17:0/1517906403 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8012420 con 0x7fdcd015f400 2024-09-10T23:16:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd00ca180 con 0x7fdcd015f400 2024-09-10T23:16:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.703+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd00b19e0 con 0x7fdcd015f400 2024-09-10T23:16:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.707+0000 7fdccd600640 1 -- 172.21.15.17:0/1517906403 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdcc80125c0 con 0x7fdcd015f400 2024-09-10T23:16:20.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.707+0000 7fdccd600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdcb00725e0 0x7fdcb0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:20.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.707+0000 7fdccd600640 1 -- 172.21.15.17:0/1517906403 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fdcc8093b00 con 0x7fdcd015f400 2024-09-10T23:16:20.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.707+0000 7fdcd5c00640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdcb00725e0 0x7fdcb0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:20.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.707+0000 7fdcd5c00640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdcb00725e0 0x7fdcb0074aa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40af000 tx=0x7fdcc401b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.711+0000 7fdccd600640 1 -- 172.21.15.17:0/1517906403 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdcc8020020 con 0x7fdcd015f400 2024-09-10T23:16:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdcd0075590 con 0x7fdcd015f400 2024-09-10T23:16:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdccd600640 1 -- 172.21.15.17:0/1517906403 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fdcc805e780 con 0x7fdcd015f400 2024-09-10T23:16:20.890 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-09-10T23:16:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdcb00725e0 msgr2=0x7fdcb0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdcb00725e0 0x7fdcb0074aa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40af000 tx=0x7fdcc401b060 comp rx=0 tx=0).stop 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcd015f400 msgr2=0x7fdcd015c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcd015f400 0x7fdcd015c150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800cbc0 tx=0x7fdcc800ccb0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 shutdown_connections 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdcb00725e0 0x7fdcb0074aa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcd015f400 0x7fdcd015c150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdcd00b31b0 0x7fdcd015df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 --2- 172.21.15.17:0/1517906403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcd00b1530 0x7fdcd00b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 >> 172.21.15.17:0/1517906403 conn(0x7fdcd00d1da0 msgr2=0x7fdcd00b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 shutdown_connections 2024-09-10T23:16:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:20.887+0000 7fdcd8600640 1 -- 172.21.15.17:0/1517906403 wait complete. 2024-09-10T23:16:20.911 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-10T23:16:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 -- 172.21.15.17:0/1065095199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a40d0320 msgr2=0x7fc8a415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 --2- 172.21.15.17:0/1065095199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a40d0320 0x7fc8a415c680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009cb0 tx=0x7fc89c01cd40 comp rx=0 tx=0).stop 2024-09-10T23:16:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 -- 172.21.15.17:0/1065095199 shutdown_connections 2024-09-10T23:16:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 --2- 172.21.15.17:0/1065095199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a40d0320 0x7fc8a415c680 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 --2- 172.21.15.17:0/1065095199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8a415d4f0 0x7fc8a40cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 -- 172.21.15.17:0/1065095199 >> 172.21.15.17:0/1065095199 conn(0x7fc8a409a9f0 msgr2=0x7fc8a409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 -- 172.21.15.17:0/1065095199 shutdown_connections 2024-09-10T23:16:21.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 -- 172.21.15.17:0/1065095199 wait complete. 2024-09-10T23:16:21.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 Processor -- start 2024-09-10T23:16:21.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.059+0000 7fc8aa600640 1 -- start start 2024-09-10T23:16:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8aa600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8a40d0320 0x7fc8a41fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8aa600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a415be00 0x7fc8a41508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8aa600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a415d4f0 0x7fc8a40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8aa600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a4168e40 con 0x7fc8a415be00 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8aa600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a4168cc0 con 0x7fc8a415d4f0 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8aa600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a4168fc0 con 0x7fc8a40d0320 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a415be00 0x7fc8a41508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a415be00 0x7fc8a41508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37670/0 (socket says 172.21.15.17:37670) 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89be00640 1 -- 172.21.15.17:0/495534909 learned_addr learned my addr 172.21.15.17:0/495534909 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8a3e00640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a415d4f0 0x7fc8a40cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8a3400640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8a40d0320 0x7fc8a41fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89be00640 1 -- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8a40d0320 msgr2=0x7fc8a41fb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89be00640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8a40d0320 0x7fc8a41fb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89be00640 1 -- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a415d4f0 msgr2=0x7fc8a40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89be00640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a415d4f0 0x7fc8a40cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89be00640 1 -- 172.21.15.17:0/495534909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a4156240 con 0x7fc8a415be00 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8a3e00640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a415d4f0 0x7fc8a40cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89be00640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a415be00 0x7fc8a41508c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00d6d0 tx=0x7fc88c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89b400640 1 -- 172.21.15.17:0/495534909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c017070 con 0x7fc8a415be00 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89b400640 1 -- 172.21.15.17:0/495534909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc88c009b10 con 0x7fc8a415be00 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89b400640 1 -- 172.21.15.17:0/495534909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c010460 con 0x7fc8a415be00 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a4156520 con 0x7fc8a415be00 2024-09-10T23:16:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a4156ae0 con 0x7fc8a415be00 2024-09-10T23:16:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a415c680 con 0x7fc8a415be00 2024-09-10T23:16:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.063+0000 7fc89b400640 1 -- 172.21.15.17:0/495534909 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc88c010810 con 0x7fc8a415be00 2024-09-10T23:16:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.067+0000 7fc89b400640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8800725e0 0x7fc880074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.067+0000 7fc89b400640 1 -- 172.21.15.17:0/495534909 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fc88c093d90 con 0x7fc8a415be00 2024-09-10T23:16:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.067+0000 7fc8a3400640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8800725e0 0x7fc880074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.067+0000 7fc8a3400640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8800725e0 0x7fc880074aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8940016f0 tx=0x7fc894009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.071+0000 7fc89b400640 1 -- 172.21.15.17:0/495534909 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc88c05efd0 con 0x7fc8a415be00 2024-09-10T23:16:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.243+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc8a4165c80 con 0x7fc8a415be00 2024-09-10T23:16:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.243+0000 7fc89b400640 1 -- 172.21.15.17:0/495534909 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fc88c05e8d0 con 0x7fc8a415be00 2024-09-10T23:16:21.247 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-09-10T23:16:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8800725e0 msgr2=0x7fc880074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8800725e0 0x7fc880074aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8940016f0 tx=0x7fc894009040 comp rx=0 tx=0).stop 2024-09-10T23:16:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a415be00 msgr2=0x7fc8a41508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a415be00 0x7fc8a41508c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00d6d0 tx=0x7fc88c00db90 comp rx=0 tx=0).stop 2024-09-10T23:16:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 shutdown_connections 2024-09-10T23:16:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8800725e0 0x7fc880074aa0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8a415d4f0 0x7fc8a40cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8a415be00 0x7fc8a41508c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 --2- 172.21.15.17:0/495534909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8a40d0320 0x7fc8a41fb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 >> 172.21.15.17:0/495534909 conn(0x7fc8a409a9f0 msgr2=0x7fc8a41662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 shutdown_connections 2024-09-10T23:16:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.247+0000 7fc8aa600640 1 -- 172.21.15.17:0/495534909 wait complete. 2024-09-10T23:16:21.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-10T23:16:21.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 -- 172.21.15.17:0/2639647277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8204004d50 msgr2=0x7f82040051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 --2- 172.21.15.17:0/2639647277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8204004d50 0x7f82040051d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8218009eb0 tx=0x7f821801d5f0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821f200640 1 -- 172.21.15.17:0/2639647277 reap_dead start 2024-09-10T23:16:21.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 -- 172.21.15.17:0/2639647277 shutdown_connections 2024-09-10T23:16:21.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 -- 172.21.15.17:0/2639647277 >> 172.21.15.17:0/2639647277 conn(0x7f82200d1d10 msgr2=0x7f82200d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:21.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 -- 172.21.15.17:0/2639647277 shutdown_connections 2024-09-10T23:16:21.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 -- 172.21.15.17:0/2639647277 wait complete. 2024-09-10T23:16:21.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 Processor -- start 2024-09-10T23:16:21.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 -- start start 2024-09-10T23:16:21.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8204004d50 0x7f8220152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:21.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82200b7400 0x7f82201f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:21.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82201f3ff0 0x7f82200ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:21.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f82200cfc70 con 0x7f8204004d50 2024-09-10T23:16:21.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82200cfaf0 con 0x7f82201f3ff0 2024-09-10T23:16:21.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8225400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82200cfdf0 con 0x7f82200b7400 2024-09-10T23:16:21.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8204004d50 0x7f8220152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:21.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8204004d50 0x7f8220152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37690/0 (socket says 172.21.15.17:37690) 2024-09-10T23:16:21.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821e800640 1 -- 172.21.15.17:0/2424813914 learned_addr learned my addr 172.21.15.17:0/2424813914 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:21.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821e800640 1 -- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82200b7400 msgr2=0x7f82201f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821e800640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82200b7400 0x7f82201f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821e800640 1 -- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82201f3ff0 msgr2=0x7f82200ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:21.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821e800640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82201f3ff0 0x7f82200ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:21.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821e800640 1 -- 172.21.15.17:0/2424813914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8220153090 con 0x7f8204004d50 2024-09-10T23:16:21.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f821e800640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8204004d50 0x7f8220152b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f821000e970 tx=0x7f821000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:21.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.415+0000 7f8216a00640 1 -- 172.21.15.17:0/2424813914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821000ccc0 con 0x7f8204004d50 2024-09-10T23:16:21.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.419+0000 7f8216a00640 1 -- 172.21.15.17:0/2424813914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f821000ce60 con 0x7f8204004d50 2024-09-10T23:16:21.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.419+0000 7f8216a00640 1 -- 172.21.15.17:0/2424813914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210005260 con 0x7f8204004d50 2024-09-10T23:16:21.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.419+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82200b79a0 con 0x7f8204004d50 2024-09-10T23:16:21.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.419+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82200b5f60 con 0x7f8204004d50 2024-09-10T23:16:21.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.419+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82200cffd0 con 0x7f8204004d50 2024-09-10T23:16:21.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.419+0000 7f8216a00640 1 -- 172.21.15.17:0/2424813914 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8210005400 con 0x7f8204004d50 2024-09-10T23:16:21.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.419+0000 7f8216a00640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81fc072610 0x7f81fc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:21.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.419+0000 7f8216a00640 1 -- 172.21.15.17:0/2424813914 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7f8210094040 con 0x7f8204004d50 2024-09-10T23:16:21.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.419+0000 7f8217e00640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81fc072610 0x7f81fc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:21.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.423+0000 7f8217e00640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81fc072610 0x7f81fc074ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f822015e260 tx=0x7f8208007940 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:21.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.423+0000 7f8216a00640 1 -- 172.21.15.17:0/2424813914 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8220153090 con 0x7f8204004d50 2024-09-10T23:16:21.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:21.659+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f8220070a90 con 0x7f8204004d50 2024-09-10T23:16:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.483+0000 7f8216a00640 1 -- 172.21.15.17:0/2424813914 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v66) ==== 151+0+0 (secure 0 0 0) 0x7f821005f310 con 0x7f8204004d50 2024-09-10T23:16:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81fc072610 msgr2=0x7f81fc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81fc072610 0x7f81fc074ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f822015e260 tx=0x7f8208007940 comp rx=0 tx=0).stop 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8204004d50 msgr2=0x7f8220152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8204004d50 0x7f8220152b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f821000e970 tx=0x7f821000ee30 comp rx=0 tx=0).stop 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 shutdown_connections 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81fc072610 0x7f81fc074ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82201f3ff0 0x7f82200ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82200b7400 0x7f82201f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 --2- 172.21.15.17:0/2424813914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8204004d50 0x7f8220152b50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 >> 172.21.15.17:0/2424813914 conn(0x7f82200d1d10 msgr2=0x7f822006e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 shutdown_connections 2024-09-10T23:16:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.487+0000 7f8225400640 1 -- 172.21.15.17:0/2424813914 wait complete. 2024-09-10T23:16:22.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:16:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.659+0000 7fedf5e00640 1 -- 172.21.15.17:0/3434091776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00cf340 msgr2=0x7fedf00d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.659+0000 7fedf5e00640 1 --2- 172.21.15.17:0/3434091776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00cf340 0x7fedf00d02d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fedf00cfb50 tx=0x7fede801cd80 comp rx=0 tx=0).stop 2024-09-10T23:16:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.659+0000 7fedf5e00640 1 -- 172.21.15.17:0/3434091776 shutdown_connections 2024-09-10T23:16:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.659+0000 7fedf5e00640 1 --2- 172.21.15.17:0/3434091776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00cf340 0x7fedf00d02d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.659+0000 7fedf5e00640 1 --2- 172.21.15.17:0/3434091776 >> v2:172.21.15.77:3300/0 conn(0x7fedf00cef60 0x7fedf00cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.659+0000 7fedf5e00640 1 -- 172.21.15.17:0/3434091776 >> 172.21.15.17:0/3434091776 conn(0x7fedf00b3870 msgr2=0x7fedf00b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.659+0000 7fedf5e00640 1 -- 172.21.15.17:0/3434091776 shutdown_connections 2024-09-10T23:16:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.659+0000 7fedf5e00640 1 -- 172.21.15.17:0/3434091776 wait complete. 2024-09-10T23:16:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 Processor -- start 2024-09-10T23:16:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 -- start start 2024-09-10T23:16:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00b4390 0x7fedf006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedf00cef60 0x7fedf00cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedf00cf340 0x7fedf01fbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fedf0169530 con 0x7fedf00b4390 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fedf01693b0 con 0x7fedf00cf340 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fedf01696b0 con 0x7fedf00cef60 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedeea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00b4390 0x7fedf006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedeea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00b4390 0x7fedf006e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37704/0 (socket says 172.21.15.17:37704) 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedeea00640 1 -- 172.21.15.17:0/1256230503 learned_addr learned my addr 172.21.15.17:0/1256230503 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fede7e00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedf00cef60 0x7fedf00cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedef400640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedf00cf340 0x7fedf01fbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedeea00640 1 -- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedf00cef60 msgr2=0x7fedf00cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedeea00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedf00cef60 0x7fedf00cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedeea00640 1 -- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedf00cf340 msgr2=0x7fedf01fbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedeea00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedf00cf340 0x7fedf01fbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedeea00640 1 -- 172.21.15.17:0/1256230503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf00b2690 con 0x7fedf00b4390 2024-09-10T23:16:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedeea00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00b4390 0x7fedf006e1f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fede000d9b0 tx=0x7fede000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fede7400640 1 -- 172.21.15.17:0/1256230503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0017070 con 0x7fedf00b4390 2024-09-10T23:16:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fede7400640 1 -- 172.21.15.17:0/1256230503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fede0004310 con 0x7fedf00b4390 2024-09-10T23:16:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf00b2970 con 0x7fedf00b4390 2024-09-10T23:16:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fede7400640 1 -- 172.21.15.17:0/1256230503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0009c30 con 0x7fedf00b4390 2024-09-10T23:16:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.663+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf01fb9c0 con 0x7fedf00b4390 2024-09-10T23:16:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.667+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf00b2e90 con 0x7fedf00b4390 2024-09-10T23:16:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.667+0000 7fede7400640 1 -- 172.21.15.17:0/1256230503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fede0023060 con 0x7fedf00b4390 2024-09-10T23:16:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.667+0000 7fede7400640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fedcc0725e0 0x7fedcc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.667+0000 7fede7400640 1 -- 172.21.15.17:0/1256230503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fede0093140 con 0x7fedf00b4390 2024-09-10T23:16:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.667+0000 7fede7e00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fedcc0725e0 0x7fedcc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.671+0000 7fede7e00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fedcc0725e0 0x7fedcc074aa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fedf01664e0 tx=0x7fedd8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.671+0000 7fede7400640 1 -- 172.21.15.17:0/1256230503 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fede005ddc0 con 0x7fedf00b4390 2024-09-10T23:16:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.847+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fedf015fb90 con 0x7fedf00b4390 2024-09-10T23:16:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.847+0000 7fede7400640 1 -- 172.21.15.17:0/1256230503 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7fede00627f0 con 0x7fedf00b4390 2024-09-10T23:16:22.851 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:16:22.851 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:16:22.852 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:16:22.852 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:16:22.852 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:16:22.852 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:16:22.852 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:16:22.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:16:22.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:16:22.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:16:22.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:16:22.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:16:22.854 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:16:22.854 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:16:22.854 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:16:22.855 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:16:22.855 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:16:22.855 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:16:22.855 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:16:22.855 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:16:22.855 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:16:22.856 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:16:22.856 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:16:22.856 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:16:22.856 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:16:22.856 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:16:22.857 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:16:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fedcc0725e0 msgr2=0x7fedcc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fedcc0725e0 0x7fedcc074aa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fedf01664e0 tx=0x7fedd8009040 comp rx=0 tx=0).stop 2024-09-10T23:16:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00b4390 msgr2=0x7fedf006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00b4390 0x7fedf006e1f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fede000d9b0 tx=0x7fede000de70 comp rx=0 tx=0).stop 2024-09-10T23:16:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 shutdown_connections 2024-09-10T23:16:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fedcc0725e0 0x7fedcc074aa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedf00cf340 0x7fedf01fbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedf00cef60 0x7fedf00cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 --2- 172.21.15.17:0/1256230503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedf00b4390 0x7fedf006e1f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 >> 172.21.15.17:0/1256230503 conn(0x7fedf00b3870 msgr2=0x7fedf015d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 shutdown_connections 2024-09-10T23:16:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:22.851+0000 7fedf5e00640 1 -- 172.21.15.17:0/1256230503 wait complete. 2024-09-10T23:16:22.873 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:16:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.019+0000 7fd0ece00640 1 -- 172.21.15.17:0/1082900139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 msgr2=0x7fd0cc003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.019+0000 7fd0ece00640 1 --2- 172.21.15.17:0/1082900139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 0x7fd0cc003ed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80016c0 tx=0x7fd0d801c750 comp rx=0 tx=0).stop 2024-09-10T23:16:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.019+0000 7fd0ece00640 1 -- 172.21.15.17:0/1082900139 shutdown_connections 2024-09-10T23:16:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.019+0000 7fd0ece00640 1 --2- 172.21.15.17:0/1082900139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 0x7fd0cc003ed0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.019+0000 7fd0ece00640 1 -- 172.21.15.17:0/1082900139 >> 172.21.15.17:0/1082900139 conn(0x7fd0e80d1da0 msgr2=0x7fd0e80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.019+0000 7fd0ece00640 1 -- 172.21.15.17:0/1082900139 shutdown_connections 2024-09-10T23:16:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.019+0000 7fd0ece00640 1 -- 172.21.15.17:0/1082900139 wait complete. 2024-09-10T23:16:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 Processor -- start 2024-09-10T23:16:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 -- start start 2024-09-10T23:16:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 0x7fd0e81f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815c6a0 0x7fd0e81face0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e81f41b0 0x7fd0e80b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80d0120 con 0x7fd0cc003ab0 2024-09-10T23:16:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80cffa0 con 0x7fd0e815c6a0 2024-09-10T23:16:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e80d02a0 con 0x7fd0e81f41b0 2024-09-10T23:16:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 0x7fd0e81f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 0x7fd0e81f6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37716/0 (socket says 172.21.15.17:37716) 2024-09-10T23:16:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e5e00640 1 -- 172.21.15.17:0/3508329792 learned_addr learned my addr 172.21.15.17:0/3508329792 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0dfe00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815c6a0 0x7fd0e81face0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e6800640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e81f41b0 0x7fd0e80b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e5e00640 1 -- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e81f41b0 msgr2=0x7fd0e80b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e5e00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e81f41b0 0x7fd0e80b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e5e00640 1 -- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815c6a0 msgr2=0x7fd0e81face0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e5e00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815c6a0 0x7fd0e81face0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e5e00640 1 -- 172.21.15.17:0/3508329792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e81fb220 con 0x7fd0cc003ab0 2024-09-10T23:16:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0e5e00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 0x7fd0e81f6ce0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0d801b020 tx=0x7fd0d8006930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0de000640 1 -- 172.21.15.17:0/3508329792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8003740 con 0x7fd0cc003ab0 2024-09-10T23:16:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0de000640 1 -- 172.21.15.17:0/3508329792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0d80039d0 con 0x7fd0cc003ab0 2024-09-10T23:16:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0de000640 1 -- 172.21.15.17:0/3508329792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8003dc0 con 0x7fd0cc003ab0 2024-09-10T23:16:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e80c8e70 con 0x7fd0cc003ab0 2024-09-10T23:16:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.023+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e81f75a0 con 0x7fd0cc003ab0 2024-09-10T23:16:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.027+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e80d0800 con 0x7fd0cc003ab0 2024-09-10T23:16:23.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.027+0000 7fd0de000640 1 -- 172.21.15.17:0/3508329792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd0d80a5530 con 0x7fd0cc003ab0 2024-09-10T23:16:23.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.027+0000 7fd0de000640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0c4072610 0x7fd0c4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.027+0000 7fd0de000640 1 -- 172.21.15.17:0/3508329792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fd0d812d2c0 con 0x7fd0cc003ab0 2024-09-10T23:16:23.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.027+0000 7fd0dfe00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0c4072610 0x7fd0c4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.027+0000 7fd0dfe00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0c4072610 0x7fd0c4074ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8052940 tx=0x7fd0d00091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.031+0000 7fd0de000640 1 -- 172.21.15.17:0/3508329792 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd0e81fb220 con 0x7fd0cc003ab0 2024-09-10T23:16:23.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.207+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd0e80cdf30 con 0x7fd0cc003ab0 2024-09-10T23:16:23.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0de000640 1 -- 172.21.15.17:0/3508329792 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fd0d80164b0 con 0x7fd0cc003ab0 2024-09-10T23:16:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0c4072610 msgr2=0x7fd0c4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0c4072610 0x7fd0c4074ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8052940 tx=0x7fd0d00091e0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 msgr2=0x7fd0e81f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 0x7fd0e81f6ce0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0d801b020 tx=0x7fd0d8006930 comp rx=0 tx=0).stop 2024-09-10T23:16:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 shutdown_connections 2024-09-10T23:16:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0c4072610 0x7fd0c4074ad0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0e81f41b0 0x7fd0e80b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0e815c6a0 0x7fd0e81face0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 --2- 172.21.15.17:0/3508329792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0cc003ab0 0x7fd0e81f6ce0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 >> 172.21.15.17:0/3508329792 conn(0x7fd0e80d1da0 msgr2=0x7fd0e80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 shutdown_connections 2024-09-10T23:16:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.211+0000 7fd0ece00640 1 -- 172.21.15.17:0/3508329792 wait complete. 2024-09-10T23:16:23.235 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:16:23.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:16:23.339 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:16:23.438 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:16:23.438 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:16:23.438 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:23.448 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:16:23.448 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:23.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:23.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 -- 172.21.15.17:0/4079287637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f619c003cc0 msgr2=0x7f619c0040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 --2- 172.21.15.17:0/4079287637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f619c003cc0 0x7f619c0040c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f61a8001800 tx=0x7f61a801c8d0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61b7e00640 1 -- 172.21.15.17:0/4079287637 reap_dead start 2024-09-10T23:16:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 -- 172.21.15.17:0/4079287637 shutdown_connections 2024-09-10T23:16:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 -- 172.21.15.17:0/4079287637 >> 172.21.15.17:0/4079287637 conn(0x7f61b80b1730 msgr2=0x7f61b80b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 -- 172.21.15.17:0/4079287637 shutdown_connections 2024-09-10T23:16:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 -- 172.21.15.17:0/4079287637 wait complete. 2024-09-10T23:16:23.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 Processor -- start 2024-09-10T23:16:23.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 -- start start 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619c003cc0 0x7f61b8151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b8156de0 0x7f61b8148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61b80ccc80 0x7f61b80cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f61b806fca0 con 0x7f61b8156de0 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61b806fb20 con 0x7f61b80ccc80 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.691+0000 7f61be200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61b806fe20 con 0x7f619c003cc0 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b8156de0 0x7f61b8148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b8156de0 0x7f61b8148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37732/0 (socket says 172.21.15.17:37732) 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61afe00640 1 -- 172.21.15.17:0/2613646003 learned_addr learned my addr 172.21.15.17:0/2613646003 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61b7400640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619c003cc0 0x7f61b8151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61b7e00640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61b80ccc80 0x7f61b80cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61afe00640 1 -- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619c003cc0 msgr2=0x7f61b8151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61afe00640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619c003cc0 0x7f61b8151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61afe00640 1 -- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61b80ccc80 msgr2=0x7f61b80cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61afe00640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61b80ccc80 0x7f61b80cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61afe00640 1 -- 172.21.15.17:0/2613646003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b81f55c0 con 0x7f61b8156de0 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61afe00640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b8156de0 0x7f61b8148530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f61a000ed90 tx=0x7f61a000d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61af400640 1 -- 172.21.15.17:0/2613646003 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a001c070 con 0x7f61b8156de0 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61af400640 1 -- 172.21.15.17:0/2613646003 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61a000c5e0 con 0x7f61b8156de0 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61af400640 1 -- 172.21.15.17:0/2613646003 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a000ca10 con 0x7f61b8156de0 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b8157470 con 0x7f61b8156de0 2024-09-10T23:16:23.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b81f5b60 con 0x7f61b8156de0 2024-09-10T23:16:23.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b806f410 con 0x7f61b8156de0 2024-09-10T23:16:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61af400640 1 -- 172.21.15.17:0/2613646003 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f61a000b040 con 0x7f61b8156de0 2024-09-10T23:16:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.695+0000 7f61af400640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61940725e0 0x7f6194074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.699+0000 7f61af400640 1 -- 172.21.15.17:0/2613646003 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7f61a0093eb0 con 0x7f61b8156de0 2024-09-10T23:16:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.699+0000 7f61b7400640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61940725e0 0x7f6194074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:23.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.699+0000 7f61b7400640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61940725e0 0x7f6194074aa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f61a80017d0 tx=0x7f61a80196c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:23.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.699+0000 7f61af400640 1 -- 172.21.15.17:0/2613646003 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f61a005eaa0 con 0x7f61b8156de0 2024-09-10T23:16:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.887+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61b80cc3d0 con 0x7f61b8156de0 2024-09-10T23:16:23.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.887+0000 7f61af400640 1 -- 172.21.15.17:0/2613646003 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f61a00634d0 con 0x7f61b8156de0 2024-09-10T23:16:23.891 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:16:23.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61940725e0 msgr2=0x7f6194074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61940725e0 0x7f6194074aa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f61a80017d0 tx=0x7f61a80196c0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b8156de0 msgr2=0x7f61b8148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:23.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b8156de0 0x7f61b8148530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f61a000ed90 tx=0x7f61a000d7b0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 shutdown_connections 2024-09-10T23:16:23.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61940725e0 0x7f6194074aa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61b80ccc80 0x7f61b80cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b8156de0 0x7f61b8148530 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 --2- 172.21.15.17:0/2613646003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619c003cc0 0x7f61b8151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:23.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 >> 172.21.15.17:0/2613646003 conn(0x7f61b80b1730 msgr2=0x7f61b815f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:23.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 shutdown_connections 2024-09-10T23:16:23.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:23.891+0000 7f61be200640 1 -- 172.21.15.17:0/2613646003 wait complete. 2024-09-10T23:16:23.912 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:16:23.912 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:23.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.107+0000 7fe272000640 1 -- 172.21.15.17:0/994676359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c15bd60 msgr2=0x7fe26c0cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.107+0000 7fe272000640 1 --2- 172.21.15.17:0/994676359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c15bd60 0x7fe26c0cc570 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0cf620 tx=0x7fe25801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.107+0000 7fe272000640 1 -- 172.21.15.17:0/994676359 shutdown_connections 2024-09-10T23:16:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.107+0000 7fe272000640 1 --2- 172.21.15.17:0/994676359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c15bd60 0x7fe26c0cc570 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.107+0000 7fe272000640 1 --2- 172.21.15.17:0/994676359 >> v2:172.21.15.77:3300/0 conn(0x7fe26c15b980 0x7fe26c0cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.107+0000 7fe272000640 1 -- 172.21.15.17:0/994676359 >> 172.21.15.17:0/994676359 conn(0x7fe26c09a9f0 msgr2=0x7fe26c09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.107+0000 7fe272000640 1 -- 172.21.15.17:0/994676359 shutdown_connections 2024-09-10T23:16:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.107+0000 7fe272000640 1 -- 172.21.15.17:0/994676359 wait complete. 2024-09-10T23:16:24.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 Processor -- start 2024-09-10T23:16:24.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 -- start start 2024-09-10T23:16:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c0d1990 0x7fe26c14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe26c15b980 0x7fe26c0c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15bd60 0x7fe26c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c168930 con 0x7fe26c0d1990 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c0b1f00 con 0x7fe26c15bd60 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe26c168ab0 con 0x7fe26c15b980 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe270c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c0d1990 0x7fe26c14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe270c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c0d1990 0x7fe26c14b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37742/0 (socket says 172.21.15.17:37742) 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe270c00640 1 -- 172.21.15.17:0/3076786334 learned_addr learned my addr 172.21.15.17:0/3076786334 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe271600640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15bd60 0x7fe26c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe26be00640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe26c15b980 0x7fe26c0c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe270c00640 1 -- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe26c15b980 msgr2=0x7fe26c0c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe270c00640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe26c15b980 0x7fe26c0c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe270c00640 1 -- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15bd60 msgr2=0x7fe26c0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe270c00640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15bd60 0x7fe26c0b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe270c00640 1 -- 172.21.15.17:0/3076786334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c14c730 con 0x7fe26c0d1990 2024-09-10T23:16:24.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe26be00640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe26c15b980 0x7fe26c0c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe271600640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15bd60 0x7fe26c0b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe270c00640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c0d1990 0x7fe26c14b600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe26000d950 tx=0x7fe26000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe268c00640 1 -- 172.21.15.17:0/3076786334 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260017070 con 0x7fe26c0d1990 2024-09-10T23:16:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe268c00640 1 -- 172.21.15.17:0/3076786334 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe260009cc0 con 0x7fe26c0d1990 2024-09-10T23:16:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26c14ca10 con 0x7fe26c0d1990 2024-09-10T23:16:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe268c00640 1 -- 172.21.15.17:0/3076786334 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2600106c0 con 0x7fe26c0d1990 2024-09-10T23:16:24.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.111+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26c14cfd0 con 0x7fe26c0d1990 2024-09-10T23:16:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.115+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26c0cf940 con 0x7fe26c0d1990 2024-09-10T23:16:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.115+0000 7fe268c00640 1 -- 172.21.15.17:0/3076786334 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe260010860 con 0x7fe26c0d1990 2024-09-10T23:16:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.115+0000 7fe268c00640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe24c0725e0 0x7fe24c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.115+0000 7fe268c00640 1 -- 172.21.15.17:0/3076786334 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fe2600939e0 con 0x7fe26c0d1990 2024-09-10T23:16:24.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.115+0000 7fe26be00640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe24c0725e0 0x7fe24c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.115+0000 7fe26be00640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe24c0725e0 0x7fe24c074aa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2580af000 tx=0x7fe25801b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:24.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.119+0000 7fe268c00640 1 -- 172.21.15.17:0/3076786334 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe26005ecb0 con 0x7fe26c0d1990 2024-09-10T23:16:24.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.307+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe26c0c5c20 con 0x7fe26c0d1990 2024-09-10T23:16:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.307+0000 7fe268c00640 1 -- 172.21.15.17:0/3076786334 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fe26005e5b0 con 0x7fe26c0d1990 2024-09-10T23:16:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:16:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.307+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe24c0725e0 msgr2=0x7fe24c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.307+0000 7fe272000640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe24c0725e0 0x7fe24c074aa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2580af000 tx=0x7fe25801b100 comp rx=0 tx=0).stop 2024-09-10T23:16:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.307+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c0d1990 msgr2=0x7fe26c14b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.307+0000 7fe272000640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c0d1990 0x7fe26c14b600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe26000d950 tx=0x7fe26000de10 comp rx=0 tx=0).stop 2024-09-10T23:16:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.311+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 shutdown_connections 2024-09-10T23:16:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.311+0000 7fe272000640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe24c0725e0 0x7fe24c074aa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.311+0000 7fe272000640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15bd60 0x7fe26c0b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.311+0000 7fe272000640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe26c15b980 0x7fe26c0c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.311+0000 7fe272000640 1 --2- 172.21.15.17:0/3076786334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe26c0d1990 0x7fe26c14b600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.311+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 >> 172.21.15.17:0/3076786334 conn(0x7fe26c09a9f0 msgr2=0x7fe26c0af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:24.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.311+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 shutdown_connections 2024-09-10T23:16:24.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.311+0000 7fe272000640 1 -- 172.21.15.17:0/3076786334 wait complete. 2024-09-10T23:16:24.333 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:16:24.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:24.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:24.354 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:24.354 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:16:24.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:24.354 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:16:24.409 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:16:24.409 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:24.419 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:16:24.419 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:24.472 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.615+0000 7fd52c000640 1 -- 172.21.15.17:0/1746178315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5240cedf0 msgr2=0x7fd5240b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.615+0000 7fd52c000640 1 --2- 172.21.15.17:0/1746178315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5240cedf0 0x7fd5240b4bf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd524073640 tx=0x7fd51001c830 comp rx=0 tx=0).stop 2024-09-10T23:16:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.615+0000 7fd52c000640 1 -- 172.21.15.17:0/1746178315 shutdown_connections 2024-09-10T23:16:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.615+0000 7fd52c000640 1 --2- 172.21.15.17:0/1746178315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5240cedf0 0x7fd5240b4bf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.615+0000 7fd52c000640 1 --2- 172.21.15.17:0/1746178315 >> v2:172.21.15.77:3300/0 conn(0x7fd52415be80 0x7fd5240d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.615+0000 7fd52c000640 1 -- 172.21.15.17:0/1746178315 >> 172.21.15.17:0/1746178315 conn(0x7fd5240d1da0 msgr2=0x7fd5240d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.615+0000 7fd52c000640 1 -- 172.21.15.17:0/1746178315 shutdown_connections 2024-09-10T23:16:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.615+0000 7fd52c000640 1 -- 172.21.15.17:0/1746178315 wait complete. 2024-09-10T23:16:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 Processor -- start 2024-09-10T23:16:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 -- start start 2024-09-10T23:16:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5240b5130 0x7fd52414e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd52415be80 0x7fd52415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52415dcb0 0x7fd5240b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd524168d40 con 0x7fd52415dcb0 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd524160320 con 0x7fd52415be80 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd524168ec0 con 0x7fd5240b5130 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52415dcb0 0x7fd5240b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52415dcb0 0x7fd5240b66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37760/0 (socket says 172.21.15.17:37760) 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52a000640 1 -- 172.21.15.17:0/4255185998 learned_addr learned my addr 172.21.15.17:0/4255185998 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd528c00640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd52415be80 0x7fd52415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd529600640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5240b5130 0x7fd52414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52a000640 1 -- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5240b5130 msgr2=0x7fd52414e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52a000640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5240b5130 0x7fd52414e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52a000640 1 -- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd52415be80 msgr2=0x7fd52415e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52a000640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd52415be80 0x7fd52415e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52a000640 1 -- 172.21.15.17:0/4255185998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52415ebd0 con 0x7fd52415dcb0 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd529600640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5240b5130 0x7fd52414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52a000640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52415dcb0 0x7fd5240b66d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c780 tx=0x7fd51c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd521600640 1 -- 172.21.15.17:0/4255185998 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c004b70 con 0x7fd52415dcb0 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd521600640 1 -- 172.21.15.17:0/4255185998 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd51c004e00 con 0x7fd52415dcb0 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd521600640 1 -- 172.21.15.17:0/4255185998 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00aab0 con 0x7fd52415dcb0 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5241fb280 con 0x7fd52415dcb0 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.619+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5241fb840 con 0x7fd52415dcb0 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.623+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5240b4bf0 con 0x7fd52415dcb0 2024-09-10T23:16:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.623+0000 7fd521600640 1 -- 172.21.15.17:0/4255185998 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd51c00ac50 con 0x7fd52415dcb0 2024-09-10T23:16:24.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.623+0000 7fd521600640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd504072610 0x7fd504074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.623+0000 7fd521600640 1 -- 172.21.15.17:0/4255185998 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fd51c093860 con 0x7fd52415dcb0 2024-09-10T23:16:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.623+0000 7fd529600640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd504072610 0x7fd504074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.623+0000 7fd529600640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd504072610 0x7fd504074ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd51800bbd0 tx=0x7fd51800b5b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.627+0000 7fd521600640 1 -- 172.21.15.17:0/4255185998 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd51c020070 con 0x7fd52415dcb0 2024-09-10T23:16:24.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.811+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd5240c8be0 con 0x7fd52415dcb0 2024-09-10T23:16:24.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.811+0000 7fd521600640 1 -- 172.21.15.17:0/4255185998 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fd51c05eb40 con 0x7fd52415dcb0 2024-09-10T23:16:24.817 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:16:24.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd504072610 msgr2=0x7fd504074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd504072610 0x7fd504074ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd51800bbd0 tx=0x7fd51800b5b0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52415dcb0 msgr2=0x7fd5240b66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52415dcb0 0x7fd5240b66d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c780 tx=0x7fd51c00cc40 comp rx=0 tx=0).stop 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 shutdown_connections 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd504072610 0x7fd504074ad0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52415dcb0 0x7fd5240b66d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd52415be80 0x7fd52415e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 --2- 172.21.15.17:0/4255185998 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5240b5130 0x7fd52414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 >> 172.21.15.17:0/4255185998 conn(0x7fd5240d1da0 msgr2=0x7fd5240d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 shutdown_connections 2024-09-10T23:16:24.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.815+0000 7fd52c000640 1 -- 172.21.15.17:0/4255185998 wait complete. 2024-09-10T23:16:24.840 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:16:24.840 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:24.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:25.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.999+0000 7fac4f200640 1 -- 172.21.15.17:0/2297526224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 msgr2=0x7fac480cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.999+0000 7fac4f200640 1 --2- 172.21.15.17:0/2297526224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 0x7fac480cf310 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fac4000acd0 tx=0x7fac4001def0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.999+0000 7fac4f200640 1 -- 172.21.15.17:0/2297526224 shutdown_connections 2024-09-10T23:16:25.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.999+0000 7fac4f200640 1 --2- 172.21.15.17:0/2297526224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 0x7fac480cf310 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.999+0000 7fac4f200640 1 --2- 172.21.15.17:0/2297526224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac481513b0 0x7fac4806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:24.999+0000 7fac4f200640 1 -- 172.21.15.17:0/2297526224 >> 172.21.15.17:0/2297526224 conn(0x7fac480b1730 msgr2=0x7fac480b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 -- 172.21.15.17:0/2297526224 shutdown_connections 2024-09-10T23:16:25.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 -- 172.21.15.17:0/2297526224 wait complete. 2024-09-10T23:16:25.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 Processor -- start 2024-09-10T23:16:25.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 -- start start 2024-09-10T23:16:25.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 0x7fac48145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac480ceed0 0x7fac481489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac481513b0 0x7fac4814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac481672a0 con 0x7fac48072f50 2024-09-10T23:16:25.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac480b4d00 con 0x7fac481513b0 2024-09-10T23:16:25.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fac48167420 con 0x7fac480ceed0 2024-09-10T23:16:25.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac47e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 0x7fac48145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac47e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 0x7fac48145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37772/0 (socket says 172.21.15.17:37772) 2024-09-10T23:16:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac47e00640 1 -- 172.21.15.17:0/913538565 learned_addr learned my addr 172.21.15.17:0/913538565 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac3fe00640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac480ceed0 0x7fac481489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4d200640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac481513b0 0x7fac4814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac47e00640 1 -- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac480ceed0 msgr2=0x7fac481489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac47e00640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac480ceed0 0x7fac481489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac47e00640 1 -- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac481513b0 msgr2=0x7fac4814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac47e00640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac481513b0 0x7fac4814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac47e00640 1 -- 172.21.15.17:0/913538565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48146120 con 0x7fac48072f50 2024-09-10T23:16:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac3fe00640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac480ceed0 0x7fac481489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac4d200640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac481513b0 0x7fac4814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.003+0000 7fac47e00640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 0x7fac48145be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac3800e7a0 tx=0x7fac3800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac44c00640 1 -- 172.21.15.17:0/913538565 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3800cc60 con 0x7fac48072f50 2024-09-10T23:16:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac44c00640 1 -- 172.21.15.17:0/913538565 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac38010430 con 0x7fac48072f50 2024-09-10T23:16:25.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac44c00640 1 -- 172.21.15.17:0/913538565 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38010860 con 0x7fac48072f50 2024-09-10T23:16:25.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac48146d80 con 0x7fac48072f50 2024-09-10T23:16:25.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac48147340 con 0x7fac48072f50 2024-09-10T23:16:25.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac480cf310 con 0x7fac48072f50 2024-09-10T23:16:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac44c00640 1 -- 172.21.15.17:0/913538565 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fac38010a00 con 0x7fac48072f50 2024-09-10T23:16:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac44c00640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac24072610 0x7fac24074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac44c00640 1 -- 172.21.15.17:0/913538565 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fac38093fe0 con 0x7fac48072f50 2024-09-10T23:16:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.007+0000 7fac3fe00640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac24072610 0x7fac24074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.011+0000 7fac3fe00640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac24072610 0x7fac24074ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac30007a60 tx=0x7fac30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.011+0000 7fac44c00640 1 -- 172.21.15.17:0/913538565 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fac3805f2f0 con 0x7fac48072f50 2024-09-10T23:16:25.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.199+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fac4815a370 con 0x7fac48072f50 2024-09-10T23:16:25.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.199+0000 7fac44c00640 1 -- 172.21.15.17:0/913538565 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fac3805ebf0 con 0x7fac48072f50 2024-09-10T23:16:25.204 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:16:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac24072610 msgr2=0x7fac24074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac24072610 0x7fac24074ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac30007a60 tx=0x7fac30009040 comp rx=0 tx=0).stop 2024-09-10T23:16:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 msgr2=0x7fac48145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 0x7fac48145be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac3800e7a0 tx=0x7fac3800ec60 comp rx=0 tx=0).stop 2024-09-10T23:16:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 shutdown_connections 2024-09-10T23:16:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac24072610 0x7fac24074ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac481513b0 0x7fac4814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac480ceed0 0x7fac481489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 --2- 172.21.15.17:0/913538565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac48072f50 0x7fac48145be0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 >> 172.21.15.17:0/913538565 conn(0x7fac480b1730 msgr2=0x7fac48158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 shutdown_connections 2024-09-10T23:16:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.203+0000 7fac4f200640 1 -- 172.21.15.17:0/913538565 wait complete. 2024-09-10T23:16:25.225 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2024-09-10T23:16:25.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:25.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-10T23:16:25.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:25.267 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:16:25.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:25.267 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T23:16:25.333 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:16:25.333 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:25.342 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:16:25.342 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:25.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 -- 172.21.15.17:0/2923814271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33cc003c20 msgr2=0x7f33cc004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 --2- 172.21.15.17:0/2923814271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33cc003c20 0x7f33cc004020 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f33d8006fd0 tx=0x7f33d801cf00 comp rx=0 tx=0).stop 2024-09-10T23:16:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33e7e00640 1 -- 172.21.15.17:0/2923814271 reap_dead start 2024-09-10T23:16:25.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 -- 172.21.15.17:0/2923814271 shutdown_connections 2024-09-10T23:16:25.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 -- 172.21.15.17:0/2923814271 >> 172.21.15.17:0/2923814271 conn(0x7f33e80d1d60 msgr2=0x7f33e80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 -- 172.21.15.17:0/2923814271 shutdown_connections 2024-09-10T23:16:25.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 -- 172.21.15.17:0/2923814271 wait complete. 2024-09-10T23:16:25.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 Processor -- start 2024-09-10T23:16:25.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 -- start start 2024-09-10T23:16:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33cc003c20 0x7f33e8163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8164310 0x7f33e806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e806e210 0x7f33e806e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33e81676c0 con 0x7f33e806e210 2024-09-10T23:16:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f33e8167540 con 0x7f33e8164310 2024-09-10T23:16:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33ee200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f33e8167840 con 0x7f33cc003c20 2024-09-10T23:16:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e806e210 0x7f33e806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e806e210 0x7f33e806e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37792/0 (socket says 172.21.15.17:37792) 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33e7e00640 1 -- 172.21.15.17:0/2695027362 learned_addr learned my addr 172.21.15.17:0/2695027362 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33e7400640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33cc003c20 0x7f33e8163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.583+0000 7f33dfe00640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8164310 0x7f33e806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33e7e00640 1 -- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33cc003c20 msgr2=0x7f33e8163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33e7e00640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33cc003c20 0x7f33e8163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33e7e00640 1 -- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8164310 msgr2=0x7f33e806dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33e7e00640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8164310 0x7f33e806dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33e7e00640 1 -- 172.21.15.17:0/2695027362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e80b6b80 con 0x7f33e806e210 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33dfe00640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8164310 0x7f33e806dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33e7e00640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e806e210 0x7f33e806e690 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f33e8074760 tx=0x7f33e000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33df400640 1 -- 172.21.15.17:0/2695027362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0004b30 con 0x7f33e806e210 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33df400640 1 -- 172.21.15.17:0/2695027362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33e0004cd0 con 0x7f33e806e210 2024-09-10T23:16:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33df400640 1 -- 172.21.15.17:0/2695027362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0003be0 con 0x7f33e806e210 2024-09-10T23:16:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e80b7be0 con 0x7f33e806e210 2024-09-10T23:16:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e80b7100 con 0x7f33e806e210 2024-09-10T23:16:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e80cfe70 con 0x7f33e806e210 2024-09-10T23:16:25.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33df400640 1 -- 172.21.15.17:0/2695027362 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f33e0021060 con 0x7f33e806e210 2024-09-10T23:16:25.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.587+0000 7f33df400640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33c4072610 0x7f33c4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:25.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.591+0000 7f33df400640 1 -- 172.21.15.17:0/2695027362 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7f33e0093720 con 0x7f33e806e210 2024-09-10T23:16:25.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.591+0000 7f33e7400640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33c4072610 0x7f33c4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:25.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.591+0000 7f33e7400640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33c4072610 0x7f33c4074ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33d80ac000 tx=0x7f33d8019d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:25.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.595+0000 7f33df400640 1 -- 172.21.15.17:0/2695027362 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f33e005e310 con 0x7f33e806e210 2024-09-10T23:16:25.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f33e81646f0 con 0x7f33e806e210 2024-09-10T23:16:25.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33df400640 1 -- 172.21.15.17:0/2695027362 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f33e0062d40 con 0x7f33e806e210 2024-09-10T23:16:25.782 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:16:25.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33c4072610 msgr2=0x7f33c4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33c4072610 0x7f33c4074ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33d80ac000 tx=0x7f33d8019d40 comp rx=0 tx=0).stop 2024-09-10T23:16:25.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e806e210 msgr2=0x7f33e806e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:25.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e806e210 0x7f33e806e690 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f33e8074760 tx=0x7f33e000f3c0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 shutdown_connections 2024-09-10T23:16:25.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33c4072610 0x7f33c4074ad0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e806e210 0x7f33e806e690 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e8164310 0x7f33e806dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 --2- 172.21.15.17:0/2695027362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33cc003c20 0x7f33e8163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:25.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 >> 172.21.15.17:0/2695027362 conn(0x7f33e80d1d60 msgr2=0x7f33e80720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:25.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 shutdown_connections 2024-09-10T23:16:25.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.779+0000 7f33ee200640 1 -- 172.21.15.17:0/2695027362 wait complete. 2024-09-10T23:16:25.804 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:16:25.804 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:25.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:26.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.999+0000 7f8982c00640 1 -- 172.21.15.17:0/4221106657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8960004810 msgr2=0x7f8960004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.999+0000 7f8982c00640 1 --2- 172.21.15.17:0/4221106657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8960004810 0x7f8960004c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8964006f90 tx=0x7f896401f630 comp rx=0 tx=0).stop 2024-09-10T23:16:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.999+0000 7f8980c00640 1 -- 172.21.15.17:0/4221106657 reap_dead start 2024-09-10T23:16:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.999+0000 7f8982c00640 1 -- 172.21.15.17:0/4221106657 shutdown_connections 2024-09-10T23:16:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.999+0000 7f8982c00640 1 -- 172.21.15.17:0/4221106657 >> 172.21.15.17:0/4221106657 conn(0x7f897c0d1d60 msgr2=0x7f897c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.999+0000 7f8982c00640 1 -- 172.21.15.17:0/4221106657 shutdown_connections 2024-09-10T23:16:26.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:25.999+0000 7f8982c00640 1 -- 172.21.15.17:0/4221106657 wait complete. 2024-09-10T23:16:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 Processor -- start 2024-09-10T23:16:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 -- start start 2024-09-10T23:16:26.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8960004810 0x7f897c06f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f897c0d09d0 0x7f897c163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f897c0c9e80 0x7f897c164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f897c164be0 con 0x7f897c0d09d0 2024-09-10T23:16:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f897c164a60 con 0x7f8960004810 2024-09-10T23:16:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f897c164d60 con 0x7f897c0c9e80 2024-09-10T23:16:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8973e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f897c0d09d0 0x7f897c163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8973e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f897c0d09d0 0x7f897c163dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37810/0 (socket says 172.21.15.17:37810) 2024-09-10T23:16:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8973e00640 1 -- 172.21.15.17:0/532586199 learned_addr learned my addr 172.21.15.17:0/532586199 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f897be00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8960004810 0x7f897c06f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8980c00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f897c0c9e80 0x7f897c164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8973e00640 1 -- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f897c0c9e80 msgr2=0x7f897c164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8973e00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f897c0c9e80 0x7f897c164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8973e00640 1 -- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8960004810 msgr2=0x7f897c06f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8973e00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8960004810 0x7f897c06f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8973e00640 1 -- 172.21.15.17:0/532586199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c06fa90 con 0x7f897c0d09d0 2024-09-10T23:16:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8980c00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f897c0c9e80 0x7f897c164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8973e00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f897c0d09d0 0x7f897c163dd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f896401dd30 tx=0x7f8964006c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8978c00640 1 -- 172.21.15.17:0/532586199 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89640bf020 con 0x7f897c0d09d0 2024-09-10T23:16:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8978c00640 1 -- 172.21.15.17:0/532586199 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8964003600 con 0x7f897c0d09d0 2024-09-10T23:16:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8978c00640 1 -- 172.21.15.17:0/532586199 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964003a30 con 0x7f897c0d09d0 2024-09-10T23:16:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897c0cafc0 con 0x7f897c0d09d0 2024-09-10T23:16:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.003+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897c0ca720 con 0x7f897c0d09d0 2024-09-10T23:16:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.007+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897c0cfe70 con 0x7f897c0d09d0 2024-09-10T23:16:26.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.007+0000 7f8978c00640 1 -- 172.21.15.17:0/532586199 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8964003bd0 con 0x7f897c0d09d0 2024-09-10T23:16:26.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.007+0000 7f8978c00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f89580725e0 0x7f8958074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.007+0000 7f8978c00640 1 -- 172.21.15.17:0/532586199 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7f8964131c70 con 0x7f897c0d09d0 2024-09-10T23:16:26.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.007+0000 7f897be00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f89580725e0 0x7f8958074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.011+0000 7f897be00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f89580725e0 0x7f8958074aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f896c000c10 tx=0x7f896c006b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:26.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.011+0000 7f8978c00640 1 -- 172.21.15.17:0/532586199 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f89640c9030 con 0x7f897c0d09d0 2024-09-10T23:16:26.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f897c159db0 con 0x7f897c0d09d0 2024-09-10T23:16:26.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8978c00640 1 -- 172.21.15.17:0/532586199 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f89640193e0 con 0x7f897c0d09d0 2024-09-10T23:16:26.201 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:16:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f89580725e0 msgr2=0x7f8958074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f89580725e0 0x7f8958074aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f896c000c10 tx=0x7f896c006b80 comp rx=0 tx=0).stop 2024-09-10T23:16:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f897c0d09d0 msgr2=0x7f897c163dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f897c0d09d0 0x7f897c163dd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f896401dd30 tx=0x7f8964006c40 comp rx=0 tx=0).stop 2024-09-10T23:16:26.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 shutdown_connections 2024-09-10T23:16:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f89580725e0 0x7f8958074aa0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f897c0c9e80 0x7f897c164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f897c0d09d0 0x7f897c163dd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 --2- 172.21.15.17:0/532586199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8960004810 0x7f897c06f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 >> 172.21.15.17:0/532586199 conn(0x7f897c0d1d60 msgr2=0x7f897c15a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 shutdown_connections 2024-09-10T23:16:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.199+0000 7f8982c00640 1 -- 172.21.15.17:0/532586199 wait complete. 2024-09-10T23:16:26.223 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:16:26.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.223 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-10T23:16:26.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:26.243 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:16:26.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:26.244 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T23:16:26.297 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:16:26.297 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:26.307 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:16:26.307 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:26.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:26.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.503+0000 7fbb19000640 1 -- 172.21.15.17:0/880124003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb140b08e0 msgr2=0x7fbb14166a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.503+0000 7fbb19000640 1 --2- 172.21.15.17:0/880124003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb140b08e0 0x7fbb14166a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009bc0 tx=0x7fbb0c01cba0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.503+0000 7fbb19000640 1 -- 172.21.15.17:0/880124003 shutdown_connections 2024-09-10T23:16:26.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.503+0000 7fbb19000640 1 --2- 172.21.15.17:0/880124003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb140b08e0 0x7fbb14166a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.503+0000 7fbb19000640 1 -- 172.21.15.17:0/880124003 >> 172.21.15.17:0/880124003 conn(0x7fbb140d1d60 msgr2=0x7fbb140d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:26.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.503+0000 7fbb19000640 1 -- 172.21.15.17:0/880124003 shutdown_connections 2024-09-10T23:16:26.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.503+0000 7fbb19000640 1 -- 172.21.15.17:0/880124003 wait complete. 2024-09-10T23:16:26.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 Processor -- start 2024-09-10T23:16:26.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 -- start start 2024-09-10T23:16:26.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb140b08e0 0x7fbb141664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb140b3360 0x7fbb1406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb1415be40 0x7fbb140b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb14169cd0 con 0x7fbb140b08e0 2024-09-10T23:16:26.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb14169b50 con 0x7fbb140b3360 2024-09-10T23:16:26.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbb14169e50 con 0x7fbb1415be40 2024-09-10T23:16:26.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb140b08e0 0x7fbb141664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb140b08e0 0x7fbb141664e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37816/0 (socket says 172.21.15.17:37816) 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11e00640 1 -- 172.21.15.17:0/2748613460 learned_addr learned my addr 172.21.15.17:0/2748613460 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11400640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb140b3360 0x7fbb1406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb12800640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb1415be40 0x7fbb140b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11e00640 1 -- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb1415be40 msgr2=0x7fbb140b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11e00640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb1415be40 0x7fbb140b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11e00640 1 -- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb140b3360 msgr2=0x7fbb1406ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11e00640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb140b3360 0x7fbb1406ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11e00640 1 -- 172.21.15.17:0/2748613460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1414b580 con 0x7fbb140b08e0 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb12800640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb1415be40 0x7fbb140b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb11e00640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb140b08e0 0x7fbb141664e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c3c0 tx=0x7fbb0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:26.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb0a000640 1 -- 172.21.15.17:0/2748613460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04017070 con 0x7fbb140b08e0 2024-09-10T23:16:26.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb0a000640 1 -- 172.21.15.17:0/2748613460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb040053c0 con 0x7fbb140b08e0 2024-09-10T23:16:26.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb0a000640 1 -- 172.21.15.17:0/2748613460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04003860 con 0x7fbb140b08e0 2024-09-10T23:16:26.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb14164260 con 0x7fbb140b08e0 2024-09-10T23:16:26.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.507+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb14164c60 con 0x7fbb140b08e0 2024-09-10T23:16:26.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.511+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb140cfe70 con 0x7fbb140b08e0 2024-09-10T23:16:26.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.511+0000 7fbb0a000640 1 -- 172.21.15.17:0/2748613460 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbb04003a00 con 0x7fbb140b08e0 2024-09-10T23:16:26.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.511+0000 7fbb0a000640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbaf40725e0 0x7fbaf4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.511+0000 7fbb0a000640 1 -- 172.21.15.17:0/2748613460 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fbb04092c60 con 0x7fbb140b08e0 2024-09-10T23:16:26.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.511+0000 7fbb11400640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbaf40725e0 0x7fbaf4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.511+0000 7fbb11400640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbaf40725e0 0x7fbaf4074aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbb140c5300 tx=0x7fbb00007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:26.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.515+0000 7fbb0a000640 1 -- 172.21.15.17:0/2748613460 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbb0405d850 con 0x7fbb140b08e0 2024-09-10T23:16:26.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbb1414b790 con 0x7fbb140b08e0 2024-09-10T23:16:26.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb0a000640 1 -- 172.21.15.17:0/2748613460 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fbb04062280 con 0x7fbb140b08e0 2024-09-10T23:16:26.709 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:16:26.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbaf40725e0 msgr2=0x7fbaf4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbaf40725e0 0x7fbaf4074aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbb140c5300 tx=0x7fbb00007ea0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb140b08e0 msgr2=0x7fbb141664e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb140b08e0 0x7fbb141664e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400c3c0 tx=0x7fbb0400c880 comp rx=0 tx=0).stop 2024-09-10T23:16:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 shutdown_connections 2024-09-10T23:16:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbaf40725e0 0x7fbaf4074aa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb1415be40 0x7fbb140b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb140b3360 0x7fbb1406ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 --2- 172.21.15.17:0/2748613460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb140b08e0 0x7fbb141664e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 >> 172.21.15.17:0/2748613460 conn(0x7fbb140d1d60 msgr2=0x7fbb140d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 shutdown_connections 2024-09-10T23:16:26.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.707+0000 7fbb19000640 1 -- 172.21.15.17:0/2748613460 wait complete. 2024-09-10T23:16:26.732 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:16:26.732 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:26.742 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:16:26.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.887+0000 7fb806a00640 1 -- 172.21.15.17:0/3570662929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e4003a90 msgr2=0x7fb7e4003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.887+0000 7fb806a00640 1 --2- 172.21.15.17:0/3570662929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e4003a90 0x7fb7e4003ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009b30 tx=0x7fb7f001d230 comp rx=0 tx=0).stop 2024-09-10T23:16:26.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.887+0000 7fb804a00640 1 -- 172.21.15.17:0/3570662929 reap_dead start 2024-09-10T23:16:26.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.887+0000 7fb806a00640 1 -- 172.21.15.17:0/3570662929 shutdown_connections 2024-09-10T23:16:26.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.887+0000 7fb806a00640 1 -- 172.21.15.17:0/3570662929 >> 172.21.15.17:0/3570662929 conn(0x7fb8000b1730 msgr2=0x7fb8000b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:26.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.887+0000 7fb806a00640 1 -- 172.21.15.17:0/3570662929 shutdown_connections 2024-09-10T23:16:26.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.887+0000 7fb806a00640 1 -- 172.21.15.17:0/3570662929 wait complete. 2024-09-10T23:16:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.887+0000 7fb806a00640 1 Processor -- start 2024-09-10T23:16:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.887+0000 7fb806a00640 1 -- start start 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb806a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e4003a90 0x7fb800152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb806a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8001e7a30 0x7fb8001e7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb806a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8001e9a50 0x7fb8001e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb806a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb800072fb0 con 0x7fb7e4003a90 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb806a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb8000ce570 con 0x7fb8001e9a50 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb806a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb800073130 con 0x7fb8001e7a30 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e4003a90 0x7fb800152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e4003a90 0x7fb800152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44532/0 (socket says 172.21.15.17:44532) 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7ffe00640 1 -- 172.21.15.17:0/606246619 learned_addr learned my addr 172.21.15.17:0/606246619 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb804a00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8001e9a50 0x7fb8001e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7f7e00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8001e7a30 0x7fb8001e7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7ffe00640 1 -- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8001e7a30 msgr2=0x7fb8001e7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7ffe00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8001e7a30 0x7fb8001e7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7ffe00640 1 -- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8001e9a50 msgr2=0x7fb8001e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7ffe00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8001e9a50 0x7fb8001e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7ffe00640 1 -- 172.21.15.17:0/606246619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8001ea880 con 0x7fb7e4003a90 2024-09-10T23:16:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7ffe00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e4003a90 0x7fb800152240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009a80 tx=0x7fb7f0005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7fcc00640 1 -- 172.21.15.17:0/606246619 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00ba020 con 0x7fb7e4003a90 2024-09-10T23:16:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7fcc00640 1 -- 172.21.15.17:0/606246619 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7f00ac8a0 con 0x7fb7e4003a90 2024-09-10T23:16:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb7fcc00640 1 -- 172.21.15.17:0/606246619 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00b1040 con 0x7fb7e4003a90 2024-09-10T23:16:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8001eab60 con 0x7fb7e4003a90 2024-09-10T23:16:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb800152780 con 0x7fb7e4003a90 2024-09-10T23:16:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.891+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8000736c0 con 0x7fb7e4003a90 2024-09-10T23:16:26.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.895+0000 7fb7fcc00640 1 -- 172.21.15.17:0/606246619 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb7f00046d0 con 0x7fb7e4003a90 2024-09-10T23:16:26.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.895+0000 7fb7fcc00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7dc0725e0 0x7fb7dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:26.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.895+0000 7fb7fcc00640 1 -- 172.21.15.17:0/606246619 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fb7f012e690 con 0x7fb7e4003a90 2024-09-10T23:16:26.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.895+0000 7fb7f7e00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7dc0725e0 0x7fb7dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:26.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.895+0000 7fb7f7e00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7dc0725e0 0x7fb7dc074aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8001ec0 tx=0x7fb7e8001500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:26.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:26.899+0000 7fb7fcc00640 1 -- 172.21.15.17:0/606246619 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb7f00c4030 con 0x7fb7e4003a90 2024-09-10T23:16:27.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb8000b2030 con 0x7fb7e4003a90 2024-09-10T23:16:27.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb7fcc00640 1 -- 172.21.15.17:0/606246619 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fb7f0016f40 con 0x7fb7e4003a90 2024-09-10T23:16:27.086 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:16:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7dc0725e0 msgr2=0x7fb7dc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7dc0725e0 0x7fb7dc074aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8001ec0 tx=0x7fb7e8001500 comp rx=0 tx=0).stop 2024-09-10T23:16:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e4003a90 msgr2=0x7fb800152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e4003a90 0x7fb800152240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009a80 tx=0x7fb7f0005620 comp rx=0 tx=0).stop 2024-09-10T23:16:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 shutdown_connections 2024-09-10T23:16:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7dc0725e0 0x7fb7dc074aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8001e9a50 0x7fb8001e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8001e7a30 0x7fb8001e7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 --2- 172.21.15.17:0/606246619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7e4003a90 0x7fb800152240 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 >> 172.21.15.17:0/606246619 conn(0x7fb8000b1730 msgr2=0x7fb8000b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 shutdown_connections 2024-09-10T23:16:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.083+0000 7fb806a00640 1 -- 172.21.15.17:0/606246619 wait complete. 2024-09-10T23:16:27.108 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2024-09-10T23:16:27.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:27.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-10T23:16:27.130 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:27.130 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:16:27.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:27.130 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T23:16:27.180 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:16:27.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.323+0000 7f5c9ac00640 1 -- 172.21.15.17:0/3605841950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 msgr2=0x7f5c9415e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.323+0000 7f5c9ac00640 1 --2- 172.21.15.17:0/3605841950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 0x7f5c9415e040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5c940b1780 tx=0x7f5c8c01cd80 comp rx=0 tx=0).stop 2024-09-10T23:16:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.323+0000 7f5c9ac00640 1 -- 172.21.15.17:0/3605841950 shutdown_connections 2024-09-10T23:16:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.323+0000 7f5c9ac00640 1 --2- 172.21.15.17:0/3605841950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 0x7f5c9415e040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.323+0000 7f5c9ac00640 1 --2- 172.21.15.17:0/3605841950 >> v2:172.21.15.77:3300/0 conn(0x7f5c940b4390 0x7f5c9415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.323+0000 7f5c9ac00640 1 -- 172.21.15.17:0/3605841950 >> 172.21.15.17:0/3605841950 conn(0x7f5c940b3870 msgr2=0x7f5c940b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.323+0000 7f5c9ac00640 1 -- 172.21.15.17:0/3605841950 shutdown_connections 2024-09-10T23:16:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.323+0000 7f5c9ac00640 1 -- 172.21.15.17:0/3605841950 wait complete. 2024-09-10T23:16:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 Processor -- start 2024-09-10T23:16:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 -- start start 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c940b4390 0x7f5c941fab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940cef60 0x7f5c940cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 0x7f5c941fb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94168ed0 con 0x7f5c940cf340 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c94071ce0 con 0x7f5c940cef60 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5c94169050 con 0x7f5c940b4390 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c98c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 0x7f5c941fb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c98c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 0x7f5c941fb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44546/0 (socket says 172.21.15.17:44546) 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c98c00640 1 -- 172.21.15.17:0/2367511289 learned_addr learned my addr 172.21.15.17:0/2367511289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c8be00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940cef60 0x7f5c940cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c93e00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c940b4390 0x7f5c941fab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c98c00640 1 -- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c940b4390 msgr2=0x7f5c941fab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c98c00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c940b4390 0x7f5c941fab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c98c00640 1 -- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940cef60 msgr2=0x7f5c940cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c98c00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940cef60 0x7f5c940cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c98c00640 1 -- 172.21.15.17:0/2367511289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c940cbc40 con 0x7f5c940cf340 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c98c00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 0x7f5c941fb320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c019990 tx=0x7f5c8c005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c90c00640 1 -- 172.21.15.17:0/2367511289 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c0bb070 con 0x7f5c940cf340 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c90c00640 1 -- 172.21.15.17:0/2367511289 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c8c004d40 con 0x7f5c940cf340 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c940cbf20 con 0x7f5c940cf340 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c90c00640 1 -- 172.21.15.17:0/2367511289 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c0b2040 con 0x7f5c940cf340 2024-09-10T23:16:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.327+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c940aee30 con 0x7f5c940cf340 2024-09-10T23:16:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.331+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c940cfd90 con 0x7f5c940cf340 2024-09-10T23:16:27.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.331+0000 7f5c90c00640 1 -- 172.21.15.17:0/2367511289 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5c8c0b5030 con 0x7f5c940cf340 2024-09-10T23:16:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.331+0000 7f5c90c00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c700725e0 0x7f5c70074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.331+0000 7f5c90c00640 1 -- 172.21.15.17:0/2367511289 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7f5c8c12d1a0 con 0x7f5c940cf340 2024-09-10T23:16:27.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.331+0000 7f5c93e00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c700725e0 0x7f5c70074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:27.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.331+0000 7f5c93e00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c700725e0 0x7f5c70074aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5c840016f0 tx=0x7f5c84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:27.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.335+0000 7f5c90c00640 1 -- 172.21.15.17:0/2367511289 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5c8c016970 con 0x7f5c940cf340 2024-09-10T23:16:27.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.543+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c940b1030 con 0x7f5c940cf340 2024-09-10T23:16:27.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.543+0000 7f5c90c00640 1 -- 172.21.15.17:0/2367511289 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5210 (secure 0 0 0) 0x7f5c8c0f7d90 con 0x7f5c940cf340 2024-09-10T23:16:27.548 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:27.548 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-10T23:15:57:364737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:56.758895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:16:27.548 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c700725e0 msgr2=0x7f5c70074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c700725e0 0x7f5c70074aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5c840016f0 tx=0x7f5c84009040 comp rx=0 tx=0).stop 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 msgr2=0x7f5c941fb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 0x7f5c941fb320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c019990 tx=0x7f5c8c005ae0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 shutdown_connections 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c700725e0 0x7f5c70074aa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c940cf340 0x7f5c941fb320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c940cef60 0x7f5c940cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 --2- 172.21.15.17:0/2367511289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c940b4390 0x7f5c941fab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 >> 172.21.15.17:0/2367511289 conn(0x7f5c940b3870 msgr2=0x7f5c940cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 shutdown_connections 2024-09-10T23:16:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.547+0000 7f5c9ac00640 1 -- 172.21.15.17:0/2367511289 wait complete. 2024-09-10T23:16:27.570 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:27.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.711+0000 7f56d9200640 1 -- 172.21.15.17:0/2264579080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d40cf340 msgr2=0x7f56d415e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.711+0000 7f56d9200640 1 --2- 172.21.15.17:0/2264579080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d40cf340 0x7f56d415e210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009bc0 tx=0x7f56cc01cba0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 -- 172.21.15.17:0/2264579080 shutdown_connections 2024-09-10T23:16:27.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 --2- 172.21.15.17:0/2264579080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d40cf340 0x7f56d415e210 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 -- 172.21.15.17:0/2264579080 >> 172.21.15.17:0/2264579080 conn(0x7f56d40b3870 msgr2=0x7f56d40b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:27.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 -- 172.21.15.17:0/2264579080 shutdown_connections 2024-09-10T23:16:27.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 -- 172.21.15.17:0/2264579080 wait complete. 2024-09-10T23:16:27.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 Processor -- start 2024-09-10T23:16:27.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 -- start start 2024-09-10T23:16:27.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d40b4390 0x7f56d41668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:27.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d40cef60 0x7f56d40b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:27.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40cf340 0x7f56d41fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:27.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f56d416a060 con 0x7f56d40cef60 2024-09-10T23:16:27.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56d4169ee0 con 0x7f56d40b4390 2024-09-10T23:16:27.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d9200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56d416a1e0 con 0x7f56d40cf340 2024-09-10T23:16:27.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d40cef60 0x7f56d40b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:27.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d40cef60 0x7f56d40b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44548/0 (socket says 172.21.15.17:44548) 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56cbe00640 1 -- 172.21.15.17:0/97607633 learned_addr learned my addr 172.21.15.17:0/97607633 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d1e00640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d40b4390 0x7f56d41668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d2800640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40cf340 0x7f56d41fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56cbe00640 1 -- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40cf340 msgr2=0x7f56d41fb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56cbe00640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40cf340 0x7f56d41fb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56cbe00640 1 -- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d40b4390 msgr2=0x7f56d41668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56cbe00640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d40b4390 0x7f56d41668b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56cbe00640 1 -- 172.21.15.17:0/97607633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d415c760 con 0x7f56d40cef60 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56d2800640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40cf340 0x7f56d41fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56cbe00640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d40cef60 0x7f56d40b6420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00c730 tx=0x7f56bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:27.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.715+0000 7f56ca000640 1 -- 172.21.15.17:0/97607633 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc017070 con 0x7f56d40cef60 2024-09-10T23:16:27.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.719+0000 7f56ca000640 1 -- 172.21.15.17:0/97607633 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56bc006b90 con 0x7f56d40cef60 2024-09-10T23:16:27.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.719+0000 7f56ca000640 1 -- 172.21.15.17:0/97607633 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc007030 con 0x7f56d40cef60 2024-09-10T23:16:27.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.719+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d415ca40 con 0x7f56d40cef60 2024-09-10T23:16:27.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.719+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d4166df0 con 0x7f56d40cef60 2024-09-10T23:16:27.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.719+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d40cfd90 con 0x7f56d40cef60 2024-09-10T23:16:27.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.719+0000 7f56ca000640 1 -- 172.21.15.17:0/97607633 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f56bc0071d0 con 0x7f56d40cef60 2024-09-10T23:16:27.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.719+0000 7f56ca000640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56b00725e0 0x7f56b0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:27.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.719+0000 7f56ca000640 1 -- 172.21.15.17:0/97607633 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7f56bc092d50 con 0x7f56d40cef60 2024-09-10T23:16:27.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.719+0000 7f56d1e00640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56b00725e0 0x7f56b0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:27.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.723+0000 7f56d1e00640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56b00725e0 0x7f56b0074aa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f56c4000c10 tx=0x7f56c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:27.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.723+0000 7f56ca000640 1 -- 172.21.15.17:0/97607633 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f56bc096030 con 0x7f56d40cef60 2024-09-10T23:16:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56d40b1030 con 0x7f56d40cef60 2024-09-10T23:16:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56ca000640 1 -- 172.21.15.17:0/97607633 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5210 (secure 0 0 0) 0x7f56d40712d0 con 0x7f56d40cef60 2024-09-10T23:16:27.938 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:27.938 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-10T23:15:57:364737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:56.758895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:16:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-10T23:16:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56b00725e0 msgr2=0x7f56b0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56b00725e0 0x7f56b0074aa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f56c4000c10 tx=0x7f56c4009040 comp rx=0 tx=0).stop 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d40cef60 msgr2=0x7f56d40b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d40cef60 0x7f56d40b6420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00c730 tx=0x7f56bc00cbf0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 shutdown_connections 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56b00725e0 0x7f56b0074aa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56d40cf340 0x7f56d41fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d40cef60 0x7f56d40b6420 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.935+0000 7f56d9200640 1 --2- 172.21.15.17:0/97607633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56d40b4390 0x7f56d41668b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.939+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 >> 172.21.15.17:0/97607633 conn(0x7f56d40b3870 msgr2=0x7f56d40b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.939+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 shutdown_connections 2024-09-10T23:16:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:27.939+0000 7f56d9200640 1 -- 172.21.15.17:0/97607633 wait complete. 2024-09-10T23:16:27.960 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 -- 172.21.15.17:0/899387763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d40d0650 msgr2=0x7f22d4073730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 --2- 172.21.15.17:0/899387763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d40d0650 0x7f22d4073730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f22d4074fc0 tx=0x7f22c001c600 comp rx=0 tx=0).stop 2024-09-10T23:16:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 -- 172.21.15.17:0/899387763 shutdown_connections 2024-09-10T23:16:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 --2- 172.21.15.17:0/899387763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22d4073c70 0x7f22d415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 --2- 172.21.15.17:0/899387763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d40d0650 0x7f22d4073730 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 --2- 172.21.15.17:0/899387763 >> v2:172.21.15.77:3300/0 conn(0x7f22d4158470 0x7f22d40d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 -- 172.21.15.17:0/899387763 >> 172.21.15.17:0/899387763 conn(0x7f22d40d0c50 msgr2=0x7f22d40d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 -- 172.21.15.17:0/899387763 shutdown_connections 2024-09-10T23:16:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 -- 172.21.15.17:0/899387763 wait complete. 2024-09-10T23:16:28.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 Processor -- start 2024-09-10T23:16:28.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.103+0000 7f22d9e00640 1 -- start start 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d9e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22d4073c70 0x7f22d41652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d9e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22d40d0650 0x7f22d4153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d4158470 0x7f22d40c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d9e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40ceef0 con 0x7f22d4158470 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d9e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40ced70 con 0x7f22d4073c70 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d9e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f22d40cf070 con 0x7f22d40d0650 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d4158470 0x7f22d40c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d4158470 0x7f22d40c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44576/0 (socket says 172.21.15.17:44576) 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d3400640 1 -- 172.21.15.17:0/1946164043 learned_addr learned my addr 172.21.15.17:0/1946164043 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d2a00640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22d4073c70 0x7f22d41652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d2000640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22d40d0650 0x7f22d4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d3400640 1 -- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22d40d0650 msgr2=0x7f22d4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d3400640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22d40d0650 0x7f22d4153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d3400640 1 -- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22d4073c70 msgr2=0x7f22d41652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d3400640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22d4073c70 0x7f22d41652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d3400640 1 -- 172.21.15.17:0/1946164043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d40c4b80 con 0x7f22d4158470 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d3400640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d4158470 0x7f22d40c5c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00ea20 tx=0x7f22cc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22cb400640 1 -- 172.21.15.17:0/1946164043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00cde0 con 0x7f22d4158470 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22cb400640 1 -- 172.21.15.17:0/1946164043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22cc004c40 con 0x7f22d4158470 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22cb400640 1 -- 172.21.15.17:0/1946164043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc005280 con 0x7f22d4158470 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d40c4e60 con 0x7f22d4158470 2024-09-10T23:16:28.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d40c5420 con 0x7f22d4158470 2024-09-10T23:16:28.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.107+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d40747f0 con 0x7f22d4158470 2024-09-10T23:16:28.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.111+0000 7f22cb400640 1 -- 172.21.15.17:0/1946164043 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f22cc00f040 con 0x7f22d4158470 2024-09-10T23:16:28.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.111+0000 7f22cb400640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22b40725e0 0x7f22b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.111+0000 7f22cb400640 1 -- 172.21.15.17:0/1946164043 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7f22cc093d20 con 0x7f22d4158470 2024-09-10T23:16:28.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.111+0000 7f22d2a00640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22b40725e0 0x7f22b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.111+0000 7f22d2a00640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22b40725e0 0x7f22b4074aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f22c400bad0 tx=0x7f22c400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:28.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.115+0000 7f22cb400640 1 -- 172.21.15.17:0/1946164043 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f22cc016030 con 0x7f22d4158470 2024-09-10T23:16:28.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.287+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22d40d1440 con 0x7f22d4158470 2024-09-10T23:16:28.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.287+0000 7f22cb400640 1 -- 172.21.15.17:0/1946164043 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18917 (secure 0 0 0) 0x7f22cc05e920 con 0x7f22d4158470 2024-09-10T23:16:28.292 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:28.292 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":29,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:16:17.457339+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1},{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:28.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22b40725e0 msgr2=0x7f22b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22b40725e0 0x7f22b4074aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f22c400bad0 tx=0x7f22c400b2e0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d4158470 msgr2=0x7f22d40c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d4158470 0x7f22d40c5c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00ea20 tx=0x7f22cc00eee0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 shutdown_connections 2024-09-10T23:16:28.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22b40725e0 0x7f22b4074aa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22d4158470 0x7f22d40c5c20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22d40d0650 0x7f22d4153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 --2- 172.21.15.17:0/1946164043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22d4073c70 0x7f22d41652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 >> 172.21.15.17:0/1946164043 conn(0x7f22d40d0c50 msgr2=0x7f22d41552c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 shutdown_connections 2024-09-10T23:16:28.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.291+0000 7f22d9e00640 1 -- 172.21.15.17:0/1946164043 wait complete. 2024-09-10T23:16:28.314 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:16:28.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.455+0000 7ff0cb800640 1 -- 172.21.15.17:0/2535991092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c415f130 msgr2=0x7ff0c40b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.455+0000 7ff0cb800640 1 --2- 172.21.15.17:0/2535991092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c415f130 0x7ff0c40b21d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009900 tx=0x7ff0b801c8b0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.455+0000 7ff0cb800640 1 -- 172.21.15.17:0/2535991092 shutdown_connections 2024-09-10T23:16:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.455+0000 7ff0cb800640 1 --2- 172.21.15.17:0/2535991092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0c40d02e0 0x7ff0c40b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.455+0000 7ff0cb800640 1 --2- 172.21.15.17:0/2535991092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c415f130 0x7ff0c40b21d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.455+0000 7ff0cb800640 1 -- 172.21.15.17:0/2535991092 >> 172.21.15.17:0/2535991092 conn(0x7ff0c40b3870 msgr2=0x7ff0c40b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.455+0000 7ff0cb800640 1 -- 172.21.15.17:0/2535991092 shutdown_connections 2024-09-10T23:16:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.455+0000 7ff0cb800640 1 -- 172.21.15.17:0/2535991092 wait complete. 2024-09-10T23:16:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 Processor -- start 2024-09-10T23:16:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 -- start start 2024-09-10T23:16:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c40d02e0 0x7ff0c414d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0c415f130 0x7ff0c4164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c415f510 0x7ff0c40c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c4169110 con 0x7ff0c40d02e0 2024-09-10T23:16:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c4168f90 con 0x7ff0c415f510 2024-09-10T23:16:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c4169290 con 0x7ff0c415f130 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c40d02e0 0x7ff0c414d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c40d02e0 0x7ff0c414d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44594/0 (socket says 172.21.15.17:44594) 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c8e00640 1 -- 172.21.15.17:0/3432411009 learned_addr learned my addr 172.21.15.17:0/3432411009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c3e00640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0c415f130 0x7ff0c4164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c9800640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c415f510 0x7ff0c40c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c8e00640 1 -- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0c415f130 msgr2=0x7ff0c4164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c8e00640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0c415f130 0x7ff0c4164770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c8e00640 1 -- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c415f510 msgr2=0x7ff0c40c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c8e00640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c415f510 0x7ff0c40c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c8e00640 1 -- 172.21.15.17:0/3432411009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c40af150 con 0x7ff0c40d02e0 2024-09-10T23:16:28.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c8e00640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c40d02e0 0x7ff0c414d010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff0b801cd90 tx=0x7ff0b8005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:28.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c0c00640 1 -- 172.21.15.17:0/3432411009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80b2040 con 0x7ff0c40d02e0 2024-09-10T23:16:28.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c0c00640 1 -- 172.21.15.17:0/3432411009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0b8003600 con 0x7ff0c40d02e0 2024-09-10T23:16:28.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0c0c00640 1 -- 172.21.15.17:0/3432411009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80039f0 con 0x7ff0c40d02e0 2024-09-10T23:16:28.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c4165200 con 0x7ff0c40d02e0 2024-09-10T23:16:28.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.459+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c414d550 con 0x7ff0c40d02e0 2024-09-10T23:16:28.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.463+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c40b2a00 con 0x7ff0c40d02e0 2024-09-10T23:16:28.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.463+0000 7ff0c0c00640 1 -- 172.21.15.17:0/3432411009 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff0b8003b90 con 0x7ff0c40d02e0 2024-09-10T23:16:28.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.463+0000 7ff0c0c00640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a40725e0 0x7ff0a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.463+0000 7ff0c0c00640 1 -- 172.21.15.17:0/3432411009 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7ff0b812e140 con 0x7ff0c40d02e0 2024-09-10T23:16:28.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.463+0000 7ff0c3e00640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a40725e0 0x7ff0a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.463+0000 7ff0c3e00640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a40725e0 0x7ff0a4074aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00058d0 tx=0x7ff0b0005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:28.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.467+0000 7ff0c0c00640 1 -- 172.21.15.17:0/3432411009 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff0b80c6020 con 0x7ff0c40d02e0 2024-09-10T23:16:28.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.675+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0c406f730 con 0x7ff0c40d02e0 2024-09-10T23:16:28.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.675+0000 7ff0c0c00640 1 -- 172.21.15.17:0/3432411009 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5210 (secure 0 0 0) 0x7ff0b80164d0 con 0x7ff0c40d02e0 2024-09-10T23:16:28.679 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:28.680 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-10T23:15:57:364737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:56.758895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:16:28.680 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-10T23:16:28.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a40725e0 msgr2=0x7ff0a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a40725e0 0x7ff0a4074aa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00058d0 tx=0x7ff0b0005860 comp rx=0 tx=0).stop 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c40d02e0 msgr2=0x7ff0c414d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c40d02e0 0x7ff0c414d010 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff0b801cd90 tx=0x7ff0b8005de0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 shutdown_connections 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a40725e0 0x7ff0a4074aa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c415f510 0x7ff0c40c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0c415f130 0x7ff0c4164770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 --2- 172.21.15.17:0/3432411009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c40d02e0 0x7ff0c414d010 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 >> 172.21.15.17:0/3432411009 conn(0x7ff0c40b3870 msgr2=0x7ff0c406df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 shutdown_connections 2024-09-10T23:16:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.679+0000 7ff0cb800640 1 -- 172.21.15.17:0/3432411009 wait complete. 2024-09-10T23:16:28.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:28.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.847+0000 7fcd25400640 1 -- 172.21.15.17:0/625252153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f770 msgr2=0x7fcd200cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.847+0000 7fcd25400640 1 --2- 172.21.15.17:0/625252153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f770 0x7fcd200cc870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009900 tx=0x7fcd0c01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 -- 172.21.15.17:0/625252153 shutdown_connections 2024-09-10T23:16:28.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 --2- 172.21.15.17:0/625252153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f770 0x7fcd200cc870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 -- 172.21.15.17:0/625252153 >> 172.21.15.17:0/625252153 conn(0x7fcd200d1d60 msgr2=0x7fcd200d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:28.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 -- 172.21.15.17:0/625252153 shutdown_connections 2024-09-10T23:16:28.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 -- 172.21.15.17:0/625252153 wait complete. 2024-09-10T23:16:28.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 Processor -- start 2024-09-10T23:16:28.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 -- start start 2024-09-10T23:16:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20070ad0 0x7fcd20158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd200d1830 0x7fcd200cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd2015f770 0x7fcd200ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2016a490 con 0x7fcd200d1830 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2016a310 con 0x7fcd20070ad0 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd25400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcd2016a610 con 0x7fcd2015f770 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd200d1830 0x7fcd200cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd200d1830 0x7fcd200cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44624/0 (socket says 172.21.15.17:44624) 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1de00640 1 -- 172.21.15.17:0/4267203091 learned_addr learned my addr 172.21.15.17:0/4267203091 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1e800640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20070ad0 0x7fcd20158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1f200640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd2015f770 0x7fcd200ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1de00640 1 -- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd2015f770 msgr2=0x7fcd200ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1de00640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd2015f770 0x7fcd200ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1de00640 1 -- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20070ad0 msgr2=0x7fcd20158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1de00640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20070ad0 0x7fcd20158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:28.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.851+0000 7fcd1de00640 1 -- 172.21.15.17:0/4267203091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd20158770 con 0x7fcd200d1830 2024-09-10T23:16:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd1f200640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd2015f770 0x7fcd200ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd1de00640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd200d1830 0x7fcd200cc830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009850 tx=0x7fcd0c005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd16a00640 1 -- 172.21.15.17:0/4267203091 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0b2040 con 0x7fcd200d1830 2024-09-10T23:16:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd16a00640 1 -- 172.21.15.17:0/4267203091 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd0c003600 con 0x7fcd200d1830 2024-09-10T23:16:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd16a00640 1 -- 172.21.15.17:0/4267203091 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c003a50 con 0x7fcd200d1830 2024-09-10T23:16:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd200c6290 con 0x7fcd200d1830 2024-09-10T23:16:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2015d780 con 0x7fcd200d1830 2024-09-10T23:16:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2015f060 con 0x7fcd200d1830 2024-09-10T23:16:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd16a00640 1 -- 172.21.15.17:0/4267203091 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcd0c003bf0 con 0x7fcd200d1830 2024-09-10T23:16:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd16a00640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.855+0000 7fcd16a00640 1 -- 172.21.15.17:0/4267203091 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fcd0c12df00 con 0x7fcd200d1830 2024-09-10T23:16:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.859+0000 7fcd1e800640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.859+0000 7fcd1e800640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd200c54f0 tx=0x7fcd10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:28.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:28.859+0000 7fcd16a00640 1 -- 172.21.15.17:0/4267203091 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcd0c0c6020 con 0x7fcd200d1830 2024-09-10T23:16:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.067+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd200c67b0 con 0x7fcd200d1830 2024-09-10T23:16:29.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd16a00640 1 -- 172.21.15.17:0/4267203091 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5210 (secure 0 0 0) 0x7fcd0c0164d0 con 0x7fcd200d1830 2024-09-10T23:16:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:29.073 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"btime":"2024-09-10T23:15:57:364737+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/168200776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":168200776},{"type":"v1","addr":"172.21.15.77:6837","nonce":168200776}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/2285565723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2285565723},{"type":"v1","addr":"172.21.15.17:6833","nonce":2285565723}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/797731881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":797731881},{"type":"v1","addr":"172.21.15.17:6835","nonce":797731881}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:15:36.206224+0000","modified":"2024-09-10T23:15:56.758895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/913768740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":913768740},{"type":"v1","addr":"172.21.15.77:6836","nonce":913768740}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-10T23:16:29.073 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 msgr2=0x7fcd00074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd200c54f0 tx=0x7fcd10009040 comp rx=0 tx=0).stop 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd200d1830 msgr2=0x7fcd200cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd200d1830 0x7fcd200cc830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009850 tx=0x7fcd0c005d60 comp rx=0 tx=0).stop 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 shutdown_connections 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd2015f770 0x7fcd200ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd200d1830 0x7fcd200cc830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 --2- 172.21.15.17:0/4267203091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20070ad0 0x7fcd20158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 >> 172.21.15.17:0/4267203091 conn(0x7fcd200d1d60 msgr2=0x7fcd200cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 shutdown_connections 2024-09-10T23:16:29.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.071+0000 7fcd25400640 1 -- 172.21.15.17:0/4267203091 wait complete. 2024-09-10T23:16:29.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.235+0000 7fa8bf000640 1 -- 172.21.15.17:0/1941687117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 msgr2=0x7fa8b815b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.235+0000 7fa8bf000640 1 --2- 172.21.15.17:0/1941687117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 0x7fa8b815b240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80cc5a0 tx=0x7fa8a801f090 comp rx=0 tx=0).stop 2024-09-10T23:16:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.235+0000 7fa8bf000640 1 -- 172.21.15.17:0/1941687117 shutdown_connections 2024-09-10T23:16:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.235+0000 7fa8bf000640 1 --2- 172.21.15.17:0/1941687117 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b80cf230 0x7fa8b8150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.235+0000 7fa8bf000640 1 --2- 172.21.15.17:0/1941687117 >> v2:172.21.15.77:3300/0 conn(0x7fa8b80b32d0 0x7fa8b80cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.235+0000 7fa8bf000640 1 --2- 172.21.15.17:0/1941687117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 0x7fa8b815b240 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.235+0000 7fa8bf000640 1 -- 172.21.15.17:0/1941687117 >> 172.21.15.17:0/1941687117 conn(0x7fa8b806cfc0 msgr2=0x7fa8b806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:29.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.235+0000 7fa8bf000640 1 -- 172.21.15.17:0/1941687117 shutdown_connections 2024-09-10T23:16:29.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.235+0000 7fa8bf000640 1 -- 172.21.15.17:0/1941687117 wait complete. 2024-09-10T23:16:29.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 Processor -- start 2024-09-10T23:16:29.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 -- start start 2024-09-10T23:16:29.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 0x7fa8b8154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b80b32d0 0x7fa8b81474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80cf230 0x7fa8b81393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b80d0680 con 0x7fa8b806e750 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b80cf8d0 con 0x7fa8b80cf230 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b81512b0 con 0x7fa8b80b32d0 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 0x7fa8b8154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 0x7fa8b8154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44652/0 (socket says 172.21.15.17:44652) 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b7e00640 1 -- 172.21.15.17:0/807269638 learned_addr learned my addr 172.21.15.17:0/807269638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8afe00640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b80b32d0 0x7fa8b81474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bd000640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80cf230 0x7fa8b81393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b7e00640 1 -- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b80b32d0 msgr2=0x7fa8b81474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b7e00640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b80b32d0 0x7fa8b81474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b7e00640 1 -- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80cf230 msgr2=0x7fa8b81393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b7e00640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80cf230 0x7fa8b81393a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b7e00640 1 -- 172.21.15.17:0/807269638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b80b2bb0 con 0x7fa8b806e750 2024-09-10T23:16:29.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b7e00640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 0x7fa8b8154460 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80b3040 tx=0x7fa8a8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b4c00640 1 -- 172.21.15.17:0/807269638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80b5040 con 0x7fa8b806e750 2024-09-10T23:16:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b4c00640 1 -- 172.21.15.17:0/807269638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8a8005340 con 0x7fa8b806e750 2024-09-10T23:16:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b8147ba0 con 0x7fa8b806e750 2024-09-10T23:16:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8b4c00640 1 -- 172.21.15.17:0/807269638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8003700 con 0x7fa8b806e750 2024-09-10T23:16:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.239+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b8148160 con 0x7fa8b806e750 2024-09-10T23:16:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.243+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b80cffa0 con 0x7fa8b806e750 2024-09-10T23:16:29.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.243+0000 7fa8b4c00640 1 -- 172.21.15.17:0/807269638 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa8a80038a0 con 0x7fa8b806e750 2024-09-10T23:16:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.243+0000 7fa8b4c00640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa894072600 0x7fa894074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.243+0000 7fa8b4c00640 1 -- 172.21.15.17:0/807269638 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7fa8a81308e0 con 0x7fa8b806e750 2024-09-10T23:16:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.243+0000 7fa8afe00640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa894072600 0x7fa894074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.243+0000 7fa8afe00640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa894072600 0x7fa894074ac0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8b81549a0 tx=0x7fa8a000a4e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:29.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.247+0000 7fa8b4c00640 1 -- 172.21.15.17:0/807269638 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa8a80bf060 con 0x7fa8b806e750 2024-09-10T23:16:29.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.423+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8b806fb90 con 0x7fa8b806e750 2024-09-10T23:16:29.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.423+0000 7fa8b4c00640 1 -- 172.21.15.17:0/807269638 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18917 (secure 0 0 0) 0x7fa8a8018bf0 con 0x7fa8b806e750 2024-09-10T23:16:29.427 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:29.427 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":29,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:16:17.457339+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:15:33.979589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T23:15:35.167051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T23:15:38.827993+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1},{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2},{"from":3,"to":1}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:29.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa894072600 msgr2=0x7fa894074ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa894072600 0x7fa894074ac0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa8b81549a0 tx=0x7fa8a000a4e0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 msgr2=0x7fa8b8154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 0x7fa8b8154460 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80b3040 tx=0x7fa8a8005760 comp rx=0 tx=0).stop 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 shutdown_connections 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa894072600 0x7fa894074ac0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80cf230 0x7fa8b81393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b80b32d0 0x7fa8b81474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 --2- 172.21.15.17:0/807269638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b806e750 0x7fa8b8154460 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 >> 172.21.15.17:0/807269638 conn(0x7fa8b806cfc0 msgr2=0x7fa8b8150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 shutdown_connections 2024-09-10T23:16:29.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.427+0000 7fa8bf000640 1 -- 172.21.15.17:0/807269638 wait complete. 2024-09-10T23:16:29.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 -- 172.21.15.17:0/1983590975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d400cedf0 msgr2=0x7f4d400d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 --2- 172.21.15.17:0/1983590975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d400cedf0 0x7f4d400d28c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009900 tx=0x7f4d3001c850 comp rx=0 tx=0).stop 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 -- 172.21.15.17:0/1983590975 shutdown_connections 2024-09-10T23:16:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 --2- 172.21.15.17:0/1983590975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4015fa00 0x7f4d4015fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 --2- 172.21.15.17:0/1983590975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d400cedf0 0x7f4d400d28c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 -- 172.21.15.17:0/1983590975 >> 172.21.15.17:0/1983590975 conn(0x7f4d400d1da0 msgr2=0x7f4d400d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 -- 172.21.15.17:0/1983590975 shutdown_connections 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 -- 172.21.15.17:0/1983590975 wait complete. 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 Processor -- start 2024-09-10T23:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.595+0000 7f4d48800640 1 -- start start 2024-09-10T23:16:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d48800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4015be80 0x7f4d40154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d48800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4015fa00 0x7f4d4014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d48800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4014e1a0 0x7f4d401f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d48800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40168f50 con 0x7f4d4015be80 2024-09-10T23:16:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d48800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d400b5490 con 0x7f4d4014e1a0 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d48800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d401690d0 con 0x7f4d4015fa00 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4015be80 0x7f4d40154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4015be80 0x7f4d40154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44670/0 (socket says 172.21.15.17:44670) 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45e00640 1 -- 172.21.15.17:0/1076359905 learned_addr learned my addr 172.21.15.17:0/1076359905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d46800640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4014e1a0 0x7f4d401f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45400640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4015fa00 0x7f4d4014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45e00640 1 -- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4015fa00 msgr2=0x7f4d4014dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45e00640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4015fa00 0x7f4d4014dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45e00640 1 -- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4014e1a0 msgr2=0x7f4d401f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45e00640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4014e1a0 0x7f4d401f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45e00640 1 -- 172.21.15.17:0/1076359905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4014e650 con 0x7f4d4015be80 2024-09-10T23:16:29.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45400640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4015fa00 0x7f4d4014dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:29.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d45e00640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4015be80 0x7f4d40154f00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c530 tx=0x7f4d3400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:29.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d3a000640 1 -- 172.21.15.17:0/1076359905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34017070 con 0x7f4d4015be80 2024-09-10T23:16:29.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d3a000640 1 -- 172.21.15.17:0/1076359905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d340053c0 con 0x7f4d4015be80 2024-09-10T23:16:29.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d3a000640 1 -- 172.21.15.17:0/1076359905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34012890 con 0x7f4d4015be80 2024-09-10T23:16:29.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d40154090 con 0x7f4d4015be80 2024-09-10T23:16:29.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d40154650 con 0x7f4d4015be80 2024-09-10T23:16:29.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d400d28c0 con 0x7f4d4015be80 2024-09-10T23:16:29.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.599+0000 7f4d3a000640 1 -- 172.21.15.17:0/1076359905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4d34003600 con 0x7f4d4015be80 2024-09-10T23:16:29.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.603+0000 7f4d3a000640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d240725e0 0x7f4d24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:29.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.603+0000 7f4d3a000640 1 -- 172.21.15.17:0/1076359905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6722+0+0 (secure 0 0 0) 0x7f4d34092ae0 con 0x7f4d4015be80 2024-09-10T23:16:29.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.603+0000 7f4d45400640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d240725e0 0x7f4d24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:29.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.603+0000 7f4d45400640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d240725e0 0x7f4d24074aa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4d300af000 tx=0x7f4d3001b090 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:29.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.607+0000 7f4d3a000640 1 -- 172.21.15.17:0/1076359905 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4d3405d800 con 0x7f4d4015be80 2024-09-10T23:16:29.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.819+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4d400c8be0 con 0x7f4d4015be80 2024-09-10T23:16:29.822 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:16:29.819+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:16:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.819+0000 7f4d3a000640 1 -- 172.21.15.17:0/1076359905 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f4d34062230 con 0x7f4d4015be80 2024-09-10T23:16:29.824 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:16:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d240725e0 msgr2=0x7f4d24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d240725e0 0x7f4d24074aa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4d300af000 tx=0x7f4d3001b090 comp rx=0 tx=0).stop 2024-09-10T23:16:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4015be80 msgr2=0x7f4d40154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:29.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4015be80 0x7f4d40154f00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400c530 tx=0x7f4d3400c9f0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 shutdown_connections 2024-09-10T23:16:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d240725e0 0x7f4d24074aa0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d4014e1a0 0x7f4d401f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d4015fa00 0x7f4d4014dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 --2- 172.21.15.17:0/1076359905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d4015be80 0x7f4d40154f00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 >> 172.21.15.17:0/1076359905 conn(0x7f4d400d1da0 msgr2=0x7f4d400709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 shutdown_connections 2024-09-10T23:16:29.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.823+0000 7f4d48800640 1 -- 172.21.15.17:0/1076359905 wait complete. 2024-09-10T23:16:29.837 INFO:tasks.ceph.mds.d.smithi077.stderr: -3831> 2024-09-10T23:15:41.590+0000 7f4bc2a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:16:29.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:16:29.888 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:16:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 -- 172.21.15.17:0/2581860584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f2415be00 msgr2=0x7f5f2415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 --2- 172.21.15.17:0/2581860584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f2415be00 0x7f5f2415d4f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f14009870 tx=0x7f5f1401c830 comp rx=0 tx=0).stop 2024-09-10T23:16:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 -- 172.21.15.17:0/2581860584 shutdown_connections 2024-09-10T23:16:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 --2- 172.21.15.17:0/2581860584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f2415be00 0x7f5f2415d4f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 -- 172.21.15.17:0/2581860584 >> 172.21.15.17:0/2581860584 conn(0x7f5f2409a9f0 msgr2=0x7f5f2409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 -- 172.21.15.17:0/2581860584 shutdown_connections 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 -- 172.21.15.17:0/2581860584 wait complete. 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 Processor -- start 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 -- start start 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f240b12e0 0x7f5f24166410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f240d04f0 0x7f5f241f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f2415be00 0x7f5f241fba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2416a660 con 0x7f5f240b12e0 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2416a4e0 con 0x7f5f240d04f0 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f28e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2416a7e0 con 0x7f5f2415be00 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f21e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f240b12e0 0x7f5f24166410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:30.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f21e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f240b12e0 0x7f5f24166410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44686/0 (socket says 172.21.15.17:44686) 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f21e00640 1 -- 172.21.15.17:0/1126240186 learned_addr learned my addr 172.21.15.17:0/1126240186 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f22800640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f2415be00 0x7f5f241fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.995+0000 7f5f1be00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f240d04f0 0x7f5f241f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f21e00640 1 -- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f2415be00 msgr2=0x7f5f241fba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f21e00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f2415be00 0x7f5f241fba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f21e00640 1 -- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f240d04f0 msgr2=0x7f5f241f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f21e00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f240d04f0 0x7f5f241f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f21e00640 1 -- 172.21.15.17:0/1126240186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f241559c0 con 0x7f5f240b12e0 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f21e00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f240b12e0 0x7f5f24166410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f14000c10 tx=0x7f5f14005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f1a000640 1 -- 172.21.15.17:0/1126240186 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f140b2040 con 0x7f5f240b12e0 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f24166950 con 0x7f5f240b12e0 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f1a000640 1 -- 172.21.15.17:0/1126240186 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f14004330 con 0x7f5f240b12e0 2024-09-10T23:16:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f1a000640 1 -- 172.21.15.17:0/1126240186 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14003800 con 0x7f5f240b12e0 2024-09-10T23:16:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f24166f00 con 0x7f5f240b12e0 2024-09-10T23:16:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2415d4f0 con 0x7f5f240b12e0 2024-09-10T23:16:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f1a000640 1 -- 172.21.15.17:0/1126240186 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5f140b5070 con 0x7f5f240b12e0 2024-09-10T23:16:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:29.999+0000 7f5f1a000640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f000725e0 0x7f5f00074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.003+0000 7f5f1a000640 1 -- 172.21.15.17:0/1126240186 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6808+0+0 (secure 0 0 0) 0x7f5f1412ce50 con 0x7f5f240b12e0 2024-09-10T23:16:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.003+0000 7f5f1be00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f000725e0 0x7f5f00074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.003+0000 7f5f1be00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f000725e0 0x7f5f00074aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f240c8a40 tx=0x7f5f0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.007+0000 7f5f1a000640 1 -- 172.21.15.17:0/1126240186 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5f14016450 con 0x7f5f240b12e0 2024-09-10T23:16:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.215+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5f241670d0 con 0x7f5f240b12e0 2024-09-10T23:16:30.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.827+0000 7f5f1a000640 1 -- 172.21.15.17:0/1126240186 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f5f140f7a00 con 0x7f5f240b12e0 2024-09-10T23:16:30.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f000725e0 msgr2=0x7f5f00074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f000725e0 0x7f5f00074aa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f240c8a40 tx=0x7f5f0c009040 comp rx=0 tx=0).stop 2024-09-10T23:16:30.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f240b12e0 msgr2=0x7f5f24166410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:30.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f240b12e0 0x7f5f24166410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f14000c10 tx=0x7f5f14005d20 comp rx=0 tx=0).stop 2024-09-10T23:16:30.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 shutdown_connections 2024-09-10T23:16:30.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f000725e0 0x7f5f00074aa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f2415be00 0x7f5f241fba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f240d04f0 0x7f5f241f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 --2- 172.21.15.17:0/1126240186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f240b12e0 0x7f5f24166410 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:30.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 >> 172.21.15.17:0/1126240186 conn(0x7f5f2409a9f0 msgr2=0x7f5f240cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:30.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 shutdown_connections 2024-09-10T23:16:30.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:30.831+0000 7f5f28e00640 1 -- 172.21.15.17:0/1126240186 wait complete. 2024-09-10T23:16:30.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:16:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 -- 172.21.15.17:0/893788477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc160460 msgr2=0x7fc3cc15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 --2- 172.21.15.17:0/893788477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc160460 0x7fc3cc15f770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0708a0 tx=0x7fc3b401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 -- 172.21.15.17:0/893788477 shutdown_connections 2024-09-10T23:16:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 --2- 172.21.15.17:0/893788477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc160460 0x7fc3cc15f770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 --2- 172.21.15.17:0/893788477 >> v2:172.21.15.77:3300/0 conn(0x7fc3cc145800 0x7fc3cc0741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 -- 172.21.15.17:0/893788477 >> 172.21.15.17:0/893788477 conn(0x7fc3cc0b17a0 msgr2=0x7fc3cc0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 -- 172.21.15.17:0/893788477 shutdown_connections 2024-09-10T23:16:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 -- 172.21.15.17:0/893788477 wait complete. 2024-09-10T23:16:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 Processor -- start 2024-09-10T23:16:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 -- start start 2024-09-10T23:16:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3cc06e6f0 0x7fc3cc155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc145800 0x7fc3cc0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3cc160460 0x7fc3cc15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1690c0 con 0x7fc3cc145800 2024-09-10T23:16:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc168f40 con 0x7fc3cc160460 2024-09-10T23:16:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d2c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc169240 con 0x7fc3cc06e6f0 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc145800 0x7fc3cc0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc145800 0x7fc3cc0b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44714/0 (socket says 172.21.15.17:44714) 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3c3e00640 1 -- 172.21.15.17:0/3348611057 learned_addr learned my addr 172.21.15.17:0/3348611057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3d0c00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3cc160460 0x7fc3cc15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3cbe00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3cc06e6f0 0x7fc3cc155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3c3e00640 1 -- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3cc06e6f0 msgr2=0x7fc3cc155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3c3e00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3cc06e6f0 0x7fc3cc155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3c3e00640 1 -- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3cc160460 msgr2=0x7fc3cc15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3c3e00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3cc160460 0x7fc3cc15ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.007+0000 7fc3c3e00640 1 -- 172.21.15.17:0/3348611057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc0b3400 con 0x7fc3cc145800 2024-09-10T23:16:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3c3e00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc145800 0x7fc3cc0b0300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40b0040 tx=0x7fc3b40a56a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3c8c00640 1 -- 172.21.15.17:0/3348611057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40b2040 con 0x7fc3cc145800 2024-09-10T23:16:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3c8c00640 1 -- 172.21.15.17:0/3348611057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3b40044d0 con 0x7fc3cc145800 2024-09-10T23:16:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc0b36e0 con 0x7fc3cc145800 2024-09-10T23:16:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3c8c00640 1 -- 172.21.15.17:0/3348611057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4005280 con 0x7fc3cc145800 2024-09-10T23:16:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc0b3ca0 con 0x7fc3cc145800 2024-09-10T23:16:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3cc0741d0 con 0x7fc3cc145800 2024-09-10T23:16:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3c8c00640 1 -- 172.21.15.17:0/3348611057 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc3b4005420 con 0x7fc3cc145800 2024-09-10T23:16:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3c8c00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3a8072610 0x7fc3a8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.011+0000 7fc3c8c00640 1 -- 172.21.15.17:0/3348611057 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6808+0+0 (secure 0 0 0) 0x7fc3b412cea0 con 0x7fc3cc145800 2024-09-10T23:16:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.015+0000 7fc3cbe00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3a8072610 0x7fc3a8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.015+0000 7fc3cbe00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3a8072610 0x7fc3a8074ad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00abe0 tx=0x7fc3bc00a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:31.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.015+0000 7fc3c8c00640 1 -- 172.21.15.17:0/3348611057 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc3b40164b0 con 0x7fc3cc145800 2024-09-10T23:16:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.191+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc3cc15bdd0 con 0x7fc3cc145800 2024-09-10T23:16:31.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.827+0000 7fc3c8c00640 1 -- 172.21.15.17:0/3348611057 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7fc3b40f79c0 con 0x7fc3cc145800 2024-09-10T23:16:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3a8072610 msgr2=0x7fc3a8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3a8072610 0x7fc3a8074ad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00abe0 tx=0x7fc3bc00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc145800 msgr2=0x7fc3cc0b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc145800 0x7fc3cc0b0300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40b0040 tx=0x7fc3b40a56a0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 shutdown_connections 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3a8072610 0x7fc3a8074ad0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3cc160460 0x7fc3cc15ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3cc145800 0x7fc3cc0b0300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 --2- 172.21.15.17:0/3348611057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3cc06e6f0 0x7fc3cc155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 >> 172.21.15.17:0/3348611057 conn(0x7fc3cc0b17a0 msgr2=0x7fc3cc0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:31.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 shutdown_connections 2024-09-10T23:16:31.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:31.831+0000 7fc3d2c00640 1 -- 172.21.15.17:0/3348611057 wait complete. 2024-09-10T23:16:31.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:16:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.007+0000 7f55e7800640 1 -- 172.21.15.17:0/2328525474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 msgr2=0x7f55e00aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.007+0000 7f55e7800640 1 --2- 172.21.15.17:0/2328525474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 0x7f55e00aef60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f55e0074bf0 tx=0x7f55d801cb80 comp rx=0 tx=0).stop 2024-09-10T23:16:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.007+0000 7f55e7800640 1 -- 172.21.15.17:0/2328525474 shutdown_connections 2024-09-10T23:16:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.007+0000 7f55e7800640 1 --2- 172.21.15.17:0/2328525474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 0x7f55e00aef60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.007+0000 7f55e7800640 1 --2- 172.21.15.17:0/2328525474 >> v2:172.21.15.77:3300/0 conn(0x7f55e00cec60 0x7f55e00d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.007+0000 7f55e7800640 1 -- 172.21.15.17:0/2328525474 >> 172.21.15.17:0/2328525474 conn(0x7f55e009b040 msgr2=0x7f55e00d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.007+0000 7f55e7800640 1 -- 172.21.15.17:0/2328525474 shutdown_connections 2024-09-10T23:16:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.007+0000 7f55e7800640 1 -- 172.21.15.17:0/2328525474 wait complete. 2024-09-10T23:16:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.007+0000 7f55e7800640 1 Processor -- start 2024-09-10T23:16:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 -- start start 2024-09-10T23:16:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55e00cec60 0x7f55e00b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55e015f1c0 0x7f55e01f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 0x7f55e00c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0168e40 con 0x7f55e015f5a0 2024-09-10T23:16:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0168cc0 con 0x7f55e00cec60 2024-09-10T23:16:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f55e0168fc0 con 0x7f55e015f1c0 2024-09-10T23:16:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 0x7f55e00c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 0x7f55e00c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44732/0 (socket says 172.21.15.17:44732) 2024-09-10T23:16:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e5800640 1 -- 172.21.15.17:0/3767323051 learned_addr learned my addr 172.21.15.17:0/3767323051 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55dfe00640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55e015f1c0 0x7f55e01f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e4e00640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55e00cec60 0x7f55e00b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e5800640 1 -- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55e015f1c0 msgr2=0x7f55e01f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e5800640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55e015f1c0 0x7f55e01f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e5800640 1 -- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55e00cec60 msgr2=0x7f55e00b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e5800640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55e00cec60 0x7f55e00b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e5800640 1 -- 172.21.15.17:0/3767323051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e00c9b70 con 0x7f55e015f5a0 2024-09-10T23:16:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55dfe00640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55e015f1c0 0x7f55e01f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e4e00640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55e00cec60 0x7f55e00b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e5800640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 0x7f55e00c8dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55d80b0040 tx=0x7f55d8005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55dcc00640 1 -- 172.21.15.17:0/3767323051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d80b2040 con 0x7f55e015f5a0 2024-09-10T23:16:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55dcc00640 1 -- 172.21.15.17:0/3767323051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d80bb070 con 0x7f55e015f5a0 2024-09-10T23:16:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55dcc00640 1 -- 172.21.15.17:0/3767323051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d80045b0 con 0x7f55e015f5a0 2024-09-10T23:16:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e00c9e50 con 0x7f55e015f5a0 2024-09-10T23:16:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e01f75f0 con 0x7f55e015f5a0 2024-09-10T23:16:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.011+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e00d2610 con 0x7f55e015f5a0 2024-09-10T23:16:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.015+0000 7f55dcc00640 1 -- 172.21.15.17:0/3767323051 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f55d80b5070 con 0x7f55e015f5a0 2024-09-10T23:16:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.015+0000 7f55dcc00640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55c00725e0 0x7f55c0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.015+0000 7f55dcc00640 1 -- 172.21.15.17:0/3767323051 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6370+0+0 (secure 0 0 0) 0x7f55d812dbd0 con 0x7f55e015f5a0 2024-09-10T23:16:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.015+0000 7f55e4e00640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55c00725e0 0x7f55c0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.015+0000 7f55e4e00640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55c00725e0 0x7f55c0074aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f55d4007fd0 tx=0x7f55d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.019+0000 7f55dcc00640 1 -- 172.21.15.17:0/3767323051 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f55d8016770 con 0x7f55e015f5a0 2024-09-10T23:16:32.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.191+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f55e00754e0 con 0x7f55e015f5a0 2024-09-10T23:16:32.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.831+0000 7f55dcc00640 1 -- 172.21.15.17:0/3767323051 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f55d80f8f70 con 0x7f55e015f5a0 2024-09-10T23:16:32.837 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:16:32.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55c00725e0 msgr2=0x7f55c0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55c00725e0 0x7f55c0074aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f55d4007fd0 tx=0x7f55d4009040 comp rx=0 tx=0).stop 2024-09-10T23:16:32.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 msgr2=0x7f55e00c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 0x7f55e00c8dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55d80b0040 tx=0x7f55d8005a60 comp rx=0 tx=0).stop 2024-09-10T23:16:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 shutdown_connections 2024-09-10T23:16:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f55c00725e0 0x7f55c0074aa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55e015f5a0 0x7f55e00c8dc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55e015f1c0 0x7f55e01f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 --2- 172.21.15.17:0/3767323051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55e00cec60 0x7f55e00b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 >> 172.21.15.17:0/3767323051 conn(0x7f55e009b040 msgr2=0x7f55e00b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 shutdown_connections 2024-09-10T23:16:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:32.839+0000 7f55e7800640 1 -- 172.21.15.17:0/3767323051 wait complete. 2024-09-10T23:16:32.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-10T23:16:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 -- 172.21.15.17:0/2715605470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e2015f390 msgr2=0x7f2e200d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 --2- 172.21.15.17:0/2715605470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e2015f390 0x7f2e200d02f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009900 tx=0x7f2e1001c850 comp rx=0 tx=0).stop 2024-09-10T23:16:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 -- 172.21.15.17:0/2715605470 shutdown_connections 2024-09-10T23:16:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 --2- 172.21.15.17:0/2715605470 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e200d2250 0x7f2e200aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 --2- 172.21.15.17:0/2715605470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e2015f390 0x7f2e200d02f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 -- 172.21.15.17:0/2715605470 >> 172.21.15.17:0/2715605470 conn(0x7f2e2009a9f0 msgr2=0x7f2e2009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 -- 172.21.15.17:0/2715605470 shutdown_connections 2024-09-10T23:16:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 -- 172.21.15.17:0/2715605470 wait complete. 2024-09-10T23:16:33.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 Processor -- start 2024-09-10T23:16:33.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 -- start start 2024-09-10T23:16:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e200b1220 0x7f2e200c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e200d2250 0x7f2e201fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2015f390 0x7f2e201fbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2e20168ed0 con 0x7f2e200b1220 2024-09-10T23:16:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e20168d50 con 0x7f2e2015f390 2024-09-10T23:16:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e24a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e20169050 con 0x7f2e200d2250 2024-09-10T23:16:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e200b1220 0x7f2e200c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e200b1220 0x7f2e200c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44742/0 (socket says 172.21.15.17:44742) 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1de00640 1 -- 172.21.15.17:0/1408025694 learned_addr learned my addr 172.21.15.17:0/1408025694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1e800640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2015f390 0x7f2e201fbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e17e00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e200d2250 0x7f2e201fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1de00640 1 -- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e200d2250 msgr2=0x7f2e201fb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1de00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e200d2250 0x7f2e201fb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1de00640 1 -- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2015f390 msgr2=0x7f2e201fbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1de00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2015f390 0x7f2e201fbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1de00640 1 -- 172.21.15.17:0/1408025694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2015b370 con 0x7f2e200b1220 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.023+0000 7f2e1e800640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2015f390 0x7f2e201fbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e1de00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e200b1220 0x7f2e200c4af0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009850 tx=0x7f2e100a5510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e16000640 1 -- 172.21.15.17:0/1408025694 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e100b2040 con 0x7f2e200b1220 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e16000640 1 -- 172.21.15.17:0/1408025694 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e100042c0 con 0x7f2e200b1220 2024-09-10T23:16:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e16000640 1 -- 172.21.15.17:0/1408025694 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10005020 con 0x7f2e200b1220 2024-09-10T23:16:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2015b650 con 0x7f2e200b1220 2024-09-10T23:16:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2015bc10 con 0x7f2e200b1220 2024-09-10T23:16:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e200aea00 con 0x7f2e200b1220 2024-09-10T23:16:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e16000640 1 -- 172.21.15.17:0/1408025694 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2e100051e0 con 0x7f2e200b1220 2024-09-10T23:16:33.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e16000640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2dfc0725e0 0x7f2dfc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:33.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.027+0000 7f2e16000640 1 -- 172.21.15.17:0/1408025694 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5853+0+0 (secure 0 0 0) 0x7f2e1012cd00 con 0x7f2e200b1220 2024-09-10T23:16:33.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.031+0000 7f2e17e00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2dfc0725e0 0x7f2dfc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:33.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.031+0000 7f2e17e00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2dfc0725e0 0x7f2dfc074aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e20151ac0 tx=0x7f2e08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.031+0000 7f2e16000640 1 -- 172.21.15.17:0/1408025694 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2e100164d0 con 0x7f2e200b1220 2024-09-10T23:16:33.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.203+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2e200b0c40 con 0x7f2e200b1220 2024-09-10T23:16:33.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.839+0000 7f2e16000640 1 -- 172.21.15.17:0/1408025694 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f2e100f8340 con 0x7f2e200b1220 2024-09-10T23:16:33.843 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data_ec' removed 2024-09-10T23:16:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2dfc0725e0 msgr2=0x7f2dfc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2dfc0725e0 0x7f2dfc074aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e20151ac0 tx=0x7f2e08009040 comp rx=0 tx=0).stop 2024-09-10T23:16:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e200b1220 msgr2=0x7f2e200c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e200b1220 0x7f2e200c4af0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009850 tx=0x7f2e100a5510 comp rx=0 tx=0).stop 2024-09-10T23:16:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 shutdown_connections 2024-09-10T23:16:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2dfc0725e0 0x7f2dfc074aa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e2015f390 0x7f2e201fbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e200d2250 0x7f2e201fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 --2- 172.21.15.17:0/1408025694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e200b1220 0x7f2e200c4af0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 >> 172.21.15.17:0/1408025694 conn(0x7f2e2009a9f0 msgr2=0x7f2e2009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 shutdown_connections 2024-09-10T23:16:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:33.843+0000 7f2e24a00640 1 -- 172.21.15.17:0/1408025694 wait complete. 2024-09-10T23:16:33.870 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:16:33.871 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:16:33.871 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:16:33.871 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:33.871 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:16:33.871 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:16:33.872 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:16:33.872 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:33.872 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:16:33.872 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:16:33.872 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:16:33.872 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:33.873 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:16:33.873 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:16:33.873 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:16:33.873 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:16:33.883 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:16:33.883 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:16:33.884 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:16:33.884 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:16:33.886 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:16:33.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:16:33.933 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:16:33.933 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:33.934 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:16:33.935 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:33.936 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:16:33.937 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:34.021 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:16:34.021 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:16:34.021 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:16:34.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-10T23:16:34.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:16:34.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:16:39.887 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:16:39.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:16:39.891 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:16:39.891 DEBUG:teuthology.parallel:result is None 2024-09-10T23:16:39.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:16:39.978 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:16:40.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.047+0000 7f8f1f200640 1 -- 172.21.15.17:0/544460679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 msgr2=0x7f8f200cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.047+0000 7f8f1f200640 1 --2- 172.21.15.17:0/544460679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 0x7f8f200cf940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009840 tx=0x7f8f0801c820 comp rx=0 tx=0).stop 2024-09-10T23:16:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.047+0000 7f8f1f200640 1 -- 172.21.15.17:0/544460679 shutdown_connections 2024-09-10T23:16:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.047+0000 7f8f1f200640 1 --2- 172.21.15.17:0/544460679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 0x7f8f200cf940 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.047+0000 7f8f1f200640 1 -- 172.21.15.17:0/544460679 >> 172.21.15.17:0/544460679 conn(0x7f8f2009a9f0 msgr2=0x7f8f2009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.047+0000 7f8f1f200640 1 -- 172.21.15.17:0/544460679 shutdown_connections 2024-09-10T23:16:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.047+0000 7f8f1f200640 1 -- 172.21.15.17:0/544460679 wait complete. 2024-09-10T23:16:40.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 Processor -- start 2024-09-10T23:16:40.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 -- start start 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f200d1990 0x7f8f201553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f2015b980 0x7f8f2015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 0x7f8f2015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20169a60 con 0x7f8f2015bd60 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f201698e0 con 0x7f8f200d1990 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8f20169be0 con 0x7f8f2015b980 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 0x7f8f2015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f17e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f2015b980 0x7f8f2015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 0x7f8f2015ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38016/0 (socket says 172.21.15.17:38016) 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1e800640 1 -- 172.21.15.17:0/2196266402 learned_addr learned my addr 172.21.15.17:0/2196266402 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f17e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f2015b980 0x7f8f2015a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:43238/0 (socket says 172.21.15.17:43238) 2024-09-10T23:16:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1de00640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f200d1990 0x7f8f201553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f17e00640 1 -- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f200d1990 msgr2=0x7f8f201553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f17e00640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f200d1990 0x7f8f201553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f17e00640 1 -- 172.21.15.17:0/2196266402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 msgr2=0x7f8f2015ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f17e00640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 0x7f8f2015ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f17e00640 1 -- 172.21.15.17:0/2196266402 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200af500 con 0x7f8f2015b980 2024-09-10T23:16:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1e800640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 0x7f8f2015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f17e00640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f2015b980 0x7f8f2015a850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8f080ac000 tx=0x7f8f08005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f16000640 1 -- 172.21.15.17:0/2196266402 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f080b2040 con 0x7f8f2015b980 2024-09-10T23:16:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f16000640 1 -- 172.21.15.17:0/2196266402 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f08004330 con 0x7f8f2015b980 2024-09-10T23:16:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f16000640 1 -- 172.21.15.17:0/2196266402 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08005260 con 0x7f8f2015b980 2024-09-10T23:16:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2015b3a0 con 0x7f8f2015b980 2024-09-10T23:16:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.051+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f200c7520 con 0x7f8f2015b980 2024-09-10T23:16:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.055+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f200c7030 con 0x7f8f2015b980 2024-09-10T23:16:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.055+0000 7f8f16000640 1 -- 172.21.15.17:0/2196266402 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8f080b5070 con 0x7f8f2015b980 2024-09-10T23:16:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.055+0000 7f8f16000640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8efc0725e0 0x7f8efc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.055+0000 7f8f16000640 1 -- 172.21.15.17:0/2196266402 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 5335+0+0 (secure 0 0 0) 0x7f8f0812c5a0 con 0x7f8f2015b980 2024-09-10T23:16:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.055+0000 7f8f1de00640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8efc0725e0 0x7f8efc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.055+0000 7f8f1de00640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8efc0725e0 0x7f8efc074aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8f10007fd0 tx=0x7f8f10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.059+0000 7f8f16000640 1 -- 172.21.15.17:0/2196266402 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8f08016410 con 0x7f8f2015b980 2024-09-10T23:16:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:40.243+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8f200cf940 con 0x7f8f2015b980 2024-09-10T23:16:40.802 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-10T23:16:41.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.875+0000 7f8f16000640 1 -- 172.21.15.17:0/2196266402 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) ==== 97+0+0 (secure 0 0 0) 0x7f8f080f76f0 con 0x7f8f2015b980 2024-09-10T23:16:41.880 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:16:41.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8efc0725e0 msgr2=0x7f8efc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:41.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8efc0725e0 0x7f8efc074aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8f10007fd0 tx=0x7f8f10009040 comp rx=0 tx=0).stop 2024-09-10T23:16:41.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f2015b980 msgr2=0x7f8f2015a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:41.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f2015b980 0x7f8f2015a850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8f080ac000 tx=0x7f8f08005d30 comp rx=0 tx=0).stop 2024-09-10T23:16:41.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 shutdown_connections 2024-09-10T23:16:41.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8efc0725e0 0x7f8efc074aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:41.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f2015bd60 0x7f8f2015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:41.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8f2015b980 0x7f8f2015a850 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:41.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 --2- 172.21.15.17:0/2196266402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f200d1990 0x7f8f201553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:41.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 >> 172.21.15.17:0/2196266402 conn(0x7f8f2009a9f0 msgr2=0x7f8f2009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:41.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 shutdown_connections 2024-09-10T23:16:41.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:41.879+0000 7f8f1f200640 1 -- 172.21.15.17:0/2196266402 wait complete. 2024-09-10T23:16:41.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:16:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.055+0000 7f5510200640 1 -- 172.21.15.17:0/3850163864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 msgr2=0x7f55080b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.055+0000 7f5510200640 1 --2- 172.21.15.17:0/3850163864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 0x7f55080b37f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009900 tx=0x7f54f401c850 comp rx=0 tx=0).stop 2024-09-10T23:16:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.055+0000 7f5510200640 1 -- 172.21.15.17:0/3850163864 shutdown_connections 2024-09-10T23:16:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.055+0000 7f5510200640 1 --2- 172.21.15.17:0/3850163864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 0x7f55080b37f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.055+0000 7f5510200640 1 -- 172.21.15.17:0/3850163864 >> 172.21.15.17:0/3850163864 conn(0x7f550806cfc0 msgr2=0x7f550806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.055+0000 7f5510200640 1 -- 172.21.15.17:0/3850163864 shutdown_connections 2024-09-10T23:16:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.055+0000 7f5510200640 1 -- 172.21.15.17:0/3850163864 wait complete. 2024-09-10T23:16:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 Processor -- start 2024-09-10T23:16:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 -- start start 2024-09-10T23:16:42.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 0x7f5508142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080cf4f0 0x7f55081536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55080cff20 0x7f5508147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f550816a0f0 con 0x7f55080b48f0 2024-09-10T23:16:42.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5508169f70 con 0x7f55080cf4f0 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f550816a270 con 0x7f55080cff20 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 0x7f5508142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 0x7f5508142c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38026/0 (socket says 172.21.15.17:38026) 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550d800640 1 -- 172.21.15.17:0/1491595175 learned_addr learned my addr 172.21.15.17:0/1491595175 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550ce00640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080cf4f0 0x7f55081536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550d800640 1 -- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55080cff20 msgr2=0x7f5508147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550d800640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55080cff20 0x7f5508147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550d800640 1 -- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080cf4f0 msgr2=0x7f55081536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550d800640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080cf4f0 0x7f55081536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550d800640 1 -- 172.21.15.17:0/1491595175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5508143180 con 0x7f55080b48f0 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550ce00640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080cf4f0 0x7f55081536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f550d800640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 0x7f5508142c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00c4e0 tx=0x7f54fc00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5505600640 1 -- 172.21.15.17:0/1491595175 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0052d0 con 0x7f55080b48f0 2024-09-10T23:16:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5505600640 1 -- 172.21.15.17:0/1491595175 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54fc005470 con 0x7f55080b48f0 2024-09-10T23:16:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5505600640 1 -- 172.21.15.17:0/1491595175 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc012890 con 0x7f55080b48f0 2024-09-10T23:16:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5508154920 con 0x7f55080b48f0 2024-09-10T23:16:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.059+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5508154360 con 0x7f55080b48f0 2024-09-10T23:16:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.063+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55080b37f0 con 0x7f55080b48f0 2024-09-10T23:16:42.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.063+0000 7f5505600640 1 -- 172.21.15.17:0/1491595175 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f54fc003600 con 0x7f55080b48f0 2024-09-10T23:16:42.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.063+0000 7f5505600640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54e8072610 0x7f54e8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.063+0000 7f5505600640 1 -- 172.21.15.17:0/1491595175 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5249+0+0 (secure 0 0 0) 0x7f54fc092c90 con 0x7f55080b48f0 2024-09-10T23:16:42.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.063+0000 7f550ce00640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54e8072610 0x7f54e8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.063+0000 7f550ce00640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54e8072610 0x7f54e8074ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f54f40af000 tx=0x7f54f401b090 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.067+0000 7f5505600640 1 -- 172.21.15.17:0/1491595175 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f54fc05e520 con 0x7f55080b48f0 2024-09-10T23:16:42.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.303+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5508167570 con 0x7f55080b48f0 2024-09-10T23:16:42.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.303+0000 7f5505600640 1 -- 172.21.15.17:0/1491595175 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f54fc05de20 con 0x7f55080b48f0 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:16:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:16:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:16:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:16:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:16:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:16:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:16:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:16:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-mds", 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD+0uBmxcUVMhAAO0eCQ5IYLSrQqMD8NxA53Q==", 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD+0uBmtdcVMhAAh69dxSEHr+1NKBGDBUdZTw==", 2024-09-10T23:16:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-osd", 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD+0uBmXOYVMhAAECeyS8GBt2VAmKGy1bxFXQ==", 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD+0uBmAvUVMhAAdLXErHopJaP+7f1r4ZpFng==", 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD+0uBmtgIWMhAAkO/5HfiMjd/hOmC9EgDlNg==", 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD+0uBmdhEWMhAA8spZuMYO0U5f9O2H/SwKxA==", 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:16:42.324 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:16:42.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.303+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54e8072610 msgr2=0x7f54e8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.303+0000 7f5510200640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54e8072610 0x7f54e8074ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f54f40af000 tx=0x7f54f401b090 comp rx=0 tx=0).stop 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.303+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 msgr2=0x7f5508142c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.303+0000 7f5510200640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 0x7f5508142c40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00c4e0 tx=0x7f54fc00c9a0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.307+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 shutdown_connections 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.307+0000 7f5510200640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54e8072610 0x7f54e8074ad0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.307+0000 7f5510200640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55080cff20 0x7f5508147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.307+0000 7f5510200640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080cf4f0 0x7f55081536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.307+0000 7f5510200640 1 --2- 172.21.15.17:0/1491595175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55080b48f0 0x7f5508142c40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.307+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 >> 172.21.15.17:0/1491595175 conn(0x7f550806cfc0 msgr2=0x7f550815c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.307+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 shutdown_connections 2024-09-10T23:16:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.307+0000 7f5510200640 1 -- 172.21.15.17:0/1491595175 wait complete. 2024-09-10T23:16:42.328 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T23:16:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.471+0000 7f712e200640 1 -- 172.21.15.17:0/412310923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128072900 msgr2=0x7f7128072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.471+0000 7f712e200640 1 --2- 172.21.15.17:0/412310923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128072900 0x7f7128072d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7120009c80 tx=0x7f712001f5a0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.471+0000 7f712e200640 1 -- 172.21.15.17:0/412310923 shutdown_connections 2024-09-10T23:16:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.471+0000 7f712e200640 1 --2- 172.21.15.17:0/412310923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7128072900 0x7f7128072d70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.471+0000 7f712e200640 1 --2- 172.21.15.17:0/412310923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71280707e0 0x7f712815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.471+0000 7f712e200640 1 -- 172.21.15.17:0/412310923 >> 172.21.15.17:0/412310923 conn(0x7f71280b1730 msgr2=0x7f71280b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.471+0000 7f712e200640 1 -- 172.21.15.17:0/412310923 shutdown_connections 2024-09-10T23:16:42.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.471+0000 7f712e200640 1 -- 172.21.15.17:0/412310923 wait complete. 2024-09-10T23:16:42.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 Processor -- start 2024-09-10T23:16:42.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 -- start start 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71280707e0 0x7f71281594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7128072900 0x7f71280cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71280b2ef0 0x7f712815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7128164cc0 con 0x7f71280b2ef0 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7128164b40 con 0x7f71280707e0 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7128164e40 con 0x7f7128072900 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71280b2ef0 0x7f712815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71280b2ef0 0x7f712815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38040/0 (socket says 172.21.15.17:38040) 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127e00640 1 -- 172.21.15.17:0/3234728833 learned_addr learned my addr 172.21.15.17:0/3234728833 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127400640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71280707e0 0x7f71281594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f711fe00640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7128072900 0x7f71280cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127e00640 1 -- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7128072900 msgr2=0x7f71280cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127e00640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7128072900 0x7f71280cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127e00640 1 -- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71280707e0 msgr2=0x7f71281594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127e00640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71280707e0 0x7f71281594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127e00640 1 -- 172.21.15.17:0/3234728833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712815adb0 con 0x7f71280b2ef0 2024-09-10T23:16:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f7127e00640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71280b2ef0 0x7f712815a870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7120009bd0 tx=0x7f71200af410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f711f400640 1 -- 172.21.15.17:0/3234728833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120004e60 con 0x7f71280b2ef0 2024-09-10T23:16:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f711f400640 1 -- 172.21.15.17:0/3234728833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71200be030 con 0x7f71280b2ef0 2024-09-10T23:16:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71280cc780 con 0x7f71280b2ef0 2024-09-10T23:16:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f711f400640 1 -- 172.21.15.17:0/3234728833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71200afae0 con 0x7f71280b2ef0 2024-09-10T23:16:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.475+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71280ccd40 con 0x7f71280b2ef0 2024-09-10T23:16:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.479+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7128072d70 con 0x7f71280b2ef0 2024-09-10T23:16:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.479+0000 7f711f400640 1 -- 172.21.15.17:0/3234728833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f71200afc80 con 0x7f71280b2ef0 2024-09-10T23:16:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.479+0000 7f711f400640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71040725e0 0x7f7104074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.479+0000 7f711f400640 1 -- 172.21.15.17:0/3234728833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5249+0+0 (secure 0 0 0) 0x7f7120131bc0 con 0x7f71280b2ef0 2024-09-10T23:16:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.479+0000 7f7127400640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71040725e0 0x7f7104074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.479+0000 7f7127400640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71040725e0 0x7f7104074aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f71280ce000 tx=0x7f711800b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.483+0000 7f711f400640 1 -- 172.21.15.17:0/3234728833 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f712815adb0 con 0x7f71280b2ef0 2024-09-10T23:16:42.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.719+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f7128139c70 con 0x7f71280b2ef0 2024-09-10T23:16:42.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f711f400640 1 -- 172.21.15.17:0/3234728833 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f71200ac050 con 0x7f71280b2ef0 2024-09-10T23:16:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71040725e0 msgr2=0x7f7104074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71040725e0 0x7f7104074aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f71280ce000 tx=0x7f711800b390 comp rx=0 tx=0).stop 2024-09-10T23:16:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71280b2ef0 msgr2=0x7f712815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71280b2ef0 0x7f712815a870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7120009bd0 tx=0x7f71200af410 comp rx=0 tx=0).stop 2024-09-10T23:16:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 shutdown_connections 2024-09-10T23:16:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71040725e0 0x7f7104074aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71280b2ef0 0x7f712815a870 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7128072900 0x7f71280cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 --2- 172.21.15.17:0/3234728833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71280707e0 0x7f71281594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 >> 172.21.15.17:0/3234728833 conn(0x7f71280b1730 msgr2=0x7f71280d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 shutdown_connections 2024-09-10T23:16:42.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.723+0000 7f712e200640 1 -- 172.21.15.17:0/3234728833 wait complete. 2024-09-10T23:16:42.746 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T23:16:42.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 -- 172.21.15.17:0/3842846918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9340d08f0 msgr2=0x7fc9340b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 --2- 172.21.15.17:0/3842846918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9340d08f0 0x7fc9340b13f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc934073e30 tx=0x7fc92c01cd80 comp rx=0 tx=0).stop 2024-09-10T23:16:42.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 -- 172.21.15.17:0/3842846918 shutdown_connections 2024-09-10T23:16:42.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 --2- 172.21.15.17:0/3842846918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9340d08f0 0x7fc9340b13f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 --2- 172.21.15.17:0/3842846918 >> v2:172.21.15.77:3300/0 conn(0x7fc9340b3360 0x7fc9340d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 --2- 172.21.15.17:0/3842846918 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc93415be40 0x7fc9340cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 -- 172.21.15.17:0/3842846918 >> 172.21.15.17:0/3842846918 conn(0x7fc9340d1d60 msgr2=0x7fc9340d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:42.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 -- 172.21.15.17:0/3842846918 shutdown_connections 2024-09-10T23:16:42.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 -- 172.21.15.17:0/3842846918 wait complete. 2024-09-10T23:16:42.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 Processor -- start 2024-09-10T23:16:42.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.891+0000 7fc93b000640 1 -- start start 2024-09-10T23:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc93b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9340b3360 0x7fc934156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc93b000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9340d08f0 0x7fc934156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc93b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415be40 0x7fc9341fb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc93b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340afc60 con 0x7fc93415be40 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc93b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340afae0 con 0x7fc9340b3360 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc93b000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc9340afde0 con 0x7fc9340d08f0 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc939000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415be40 0x7fc9341fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc933e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9340b3360 0x7fc934156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc939000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415be40 0x7fc9341fb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38050/0 (socket says 172.21.15.17:38050) 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc939000640 1 -- 172.21.15.17:0/1667420106 learned_addr learned my addr 172.21.15.17:0/1667420106 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc92be00640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9340d08f0 0x7fc934156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc939000640 1 -- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9340d08f0 msgr2=0x7fc934156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc939000640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9340d08f0 0x7fc934156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc939000640 1 -- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9340b3360 msgr2=0x7fc934156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc939000640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9340b3360 0x7fc934156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc939000640 1 -- 172.21.15.17:0/1667420106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9340c5e30 con 0x7fc93415be40 2024-09-10T23:16:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc939000640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415be40 0x7fc9341fb270 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009bd0 tx=0x7fc92c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc930c00640 1 -- 172.21.15.17:0/1667420106 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0bb070 con 0x7fc93415be40 2024-09-10T23:16:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc930c00640 1 -- 172.21.15.17:0/1667420106 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc92c004d40 con 0x7fc93415be40 2024-09-10T23:16:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93406f1a0 con 0x7fc93415be40 2024-09-10T23:16:42.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc930c00640 1 -- 172.21.15.17:0/1667420106 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0b2040 con 0x7fc93415be40 2024-09-10T23:16:42.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93406f760 con 0x7fc93415be40 2024-09-10T23:16:42.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9340b13f0 con 0x7fc93415be40 2024-09-10T23:16:42.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.895+0000 7fc930c00640 1 -- 172.21.15.17:0/1667420106 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc92c0b5030 con 0x7fc93415be40 2024-09-10T23:16:42.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.899+0000 7fc930c00640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc910072610 0x7fc910074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:42.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.899+0000 7fc930c00640 1 -- 172.21.15.17:0/1667420106 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5249+0+0 (secure 0 0 0) 0x7fc92c12ca60 con 0x7fc93415be40 2024-09-10T23:16:42.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.899+0000 7fc933e00640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc910072610 0x7fc910074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:42.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.899+0000 7fc933e00640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc910072610 0x7fc910074ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc92400bb50 tx=0x7fc92400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:42.903+0000 7fc930c00640 1 -- 172.21.15.17:0/1667420106 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc9340c5e30 con 0x7fc93415be40 2024-09-10T23:16:43.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.139+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fc9340c53f0 con 0x7fc93415be40 2024-09-10T23:16:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc930c00640 1 -- 172.21.15.17:0/1667420106 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fc92c016970 con 0x7fc93415be40 2024-09-10T23:16:43.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc910072610 msgr2=0x7fc910074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc910072610 0x7fc910074ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc92400bb50 tx=0x7fc92400b2e0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415be40 msgr2=0x7fc9341fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415be40 0x7fc9341fb270 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009bd0 tx=0x7fc92c003f60 comp rx=0 tx=0).stop 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 shutdown_connections 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc910072610 0x7fc910074ad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc93415be40 0x7fc9341fb270 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9340d08f0 0x7fc934156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 --2- 172.21.15.17:0/1667420106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9340b3360 0x7fc934156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 >> 172.21.15.17:0/1667420106 conn(0x7fc9340d1d60 msgr2=0x7fc93415b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 shutdown_connections 2024-09-10T23:16:43.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.143+0000 7fc93b000640 1 -- 172.21.15.17:0/1667420106 wait complete. 2024-09-10T23:16:43.167 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T23:16:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 -- 172.21.15.17:0/369628444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba20073b80 msgr2=0x7fba2015af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 --2- 172.21.15.17:0/369628444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba20073b80 0x7fba2015af80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fba200518e0 tx=0x7fba1001c570 comp rx=0 tx=0).stop 2024-09-10T23:16:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 -- 172.21.15.17:0/369628444 shutdown_connections 2024-09-10T23:16:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 --2- 172.21.15.17:0/369628444 >> v2:172.21.15.77:3300/0 conn(0x7fba200705d0 0x7fba2015e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 --2- 172.21.15.17:0/369628444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba2006e910 0x7fba20070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 --2- 172.21.15.17:0/369628444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba20073b80 0x7fba2015af80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 -- 172.21.15.17:0/369628444 >> 172.21.15.17:0/369628444 conn(0x7fba200b1730 msgr2=0x7fba200b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 -- 172.21.15.17:0/369628444 shutdown_connections 2024-09-10T23:16:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 -- 172.21.15.17:0/369628444 wait complete. 2024-09-10T23:16:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 Processor -- start 2024-09-10T23:16:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 -- start start 2024-09-10T23:16:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2006e910 0x7fba201f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba200705d0 0x7fba20149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba20073b80 0x7fba20139040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba200b3b40 con 0x7fba2006e910 2024-09-10T23:16:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba200b39c0 con 0x7fba20073b80 2024-09-10T23:16:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba25400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fba200b3cc0 con 0x7fba200705d0 2024-09-10T23:16:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba1e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2006e910 0x7fba201f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba1e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2006e910 0x7fba201f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38058/0 (socket says 172.21.15.17:38058) 2024-09-10T23:16:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba1e800640 1 -- 172.21.15.17:0/21170233 learned_addr learned my addr 172.21.15.17:0/21170233 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba1f200640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba20073b80 0x7fba20139040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.311+0000 7fba17e00640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba200705d0 0x7fba20149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba1e800640 1 -- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba200705d0 msgr2=0x7fba20149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba1e800640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba200705d0 0x7fba20149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba1e800640 1 -- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba20073b80 msgr2=0x7fba20139040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba1e800640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba20073b80 0x7fba20139040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba1e800640 1 -- 172.21.15.17:0/21170233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2014a890 con 0x7fba2006e910 2024-09-10T23:16:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba17e00640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba200705d0 0x7fba20149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba1e800640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2006e910 0x7fba201f8a30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fba1001ca50 tx=0x7fba100a9490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba16a00640 1 -- 172.21.15.17:0/21170233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba100ad070 con 0x7fba2006e910 2024-09-10T23:16:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba16a00640 1 -- 172.21.15.17:0/21170233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba100a9ce0 con 0x7fba2006e910 2024-09-10T23:16:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba201f9010 con 0x7fba2006e910 2024-09-10T23:16:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba16a00640 1 -- 172.21.15.17:0/21170233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10005290 con 0x7fba2006e910 2024-09-10T23:16:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba201f95d0 con 0x7fba2006e910 2024-09-10T23:16:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba2015e570 con 0x7fba2006e910 2024-09-10T23:16:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba16a00640 1 -- 172.21.15.17:0/21170233 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fba100a8050 con 0x7fba2006e910 2024-09-10T23:16:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba16a00640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9fc0725e0 0x7fb9fc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.315+0000 7fba16a00640 1 -- 172.21.15.17:0/21170233 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5249+0+0 (secure 0 0 0) 0x7fba1012d320 con 0x7fba2006e910 2024-09-10T23:16:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.319+0000 7fba17e00640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9fc0725e0 0x7fb9fc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.319+0000 7fba17e00640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9fc0725e0 0x7fb9fc074aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba08005fd0 tx=0x7fba08005f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.319+0000 7fba16a00640 1 -- 172.21.15.17:0/21170233 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fba100164b0 con 0x7fba2006e910 2024-09-10T23:16:43.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.555+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fba200b0da0 con 0x7fba2006e910 2024-09-10T23:16:43.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba16a00640 1 -- 172.21.15.17:0/21170233 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7fba100f84e0 con 0x7fba2006e910 2024-09-10T23:16:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9fc0725e0 msgr2=0x7fb9fc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9fc0725e0 0x7fb9fc074aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba08005fd0 tx=0x7fba08005f20 comp rx=0 tx=0).stop 2024-09-10T23:16:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2006e910 msgr2=0x7fba201f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2006e910 0x7fba201f8a30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fba1001ca50 tx=0x7fba100a9490 comp rx=0 tx=0).stop 2024-09-10T23:16:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 shutdown_connections 2024-09-10T23:16:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9fc0725e0 0x7fb9fc074aa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba20073b80 0x7fba20139040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba200705d0 0x7fba20149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 --2- 172.21.15.17:0/21170233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba2006e910 0x7fba201f8a30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 >> 172.21.15.17:0/21170233 conn(0x7fba200b1730 msgr2=0x7fba200b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 shutdown_connections 2024-09-10T23:16:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.559+0000 7fba25400640 1 -- 172.21.15.17:0/21170233 wait complete. 2024-09-10T23:16:43.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T23:16:43.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 -- 172.21.15.17:0/28138156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 msgr2=0x7fe9440d23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 --2- 172.21.15.17:0/28138156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 0x7fe9440d23b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe9440c5850 tx=0x7fe92c01c5d0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 -- 172.21.15.17:0/28138156 shutdown_connections 2024-09-10T23:16:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 --2- 172.21.15.17:0/28138156 >> v2:172.21.15.77:3300/0 conn(0x7fe9440d1990 0x7fe9440d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 --2- 172.21.15.17:0/28138156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 0x7fe9440d23b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 --2- 172.21.15.17:0/28138156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe94415be40 0x7fe9440d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 -- 172.21.15.17:0/28138156 >> 172.21.15.17:0/28138156 conn(0x7fe94409b2a0 msgr2=0x7fe94408bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 -- 172.21.15.17:0/28138156 shutdown_connections 2024-09-10T23:16:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 -- 172.21.15.17:0/28138156 wait complete. 2024-09-10T23:16:43.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 Processor -- start 2024-09-10T23:16:43.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 -- start start 2024-09-10T23:16:43.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 0x7fe9440b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9440d1990 0x7fe94415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe94415be40 0x7fe94415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9440aef90 con 0x7fe9440cfe10 2024-09-10T23:16:43.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9440aee10 con 0x7fe94415be40 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe94b000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe9440af110 con 0x7fe9440d1990 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe943e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 0x7fe9440b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe943e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 0x7fe9440b7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38082/0 (socket says 172.21.15.17:38082) 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe943e00640 1 -- 172.21.15.17:0/1304563931 learned_addr learned my addr 172.21.15.17:0/1304563931 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe93b400640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9440d1990 0x7fe94415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe949000640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe94415be40 0x7fe94415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe943e00640 1 -- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9440d1990 msgr2=0x7fe94415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe943e00640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9440d1990 0x7fe94415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe943e00640 1 -- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe94415be40 msgr2=0x7fe94415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe943e00640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe94415be40 0x7fe94415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.727+0000 7fe943e00640 1 -- 172.21.15.17:0/1304563931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9440b7af0 con 0x7fe9440cfe10 2024-09-10T23:16:43.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.731+0000 7fe943e00640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 0x7fe9440b7430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c9f0 tx=0x7fe93400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.731+0000 7fe940c00640 1 -- 172.21.15.17:0/1304563931 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe934007bb0 con 0x7fe9440cfe10 2024-09-10T23:16:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.731+0000 7fe940c00640 1 -- 172.21.15.17:0/1304563931 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe934007e40 con 0x7fe9440cfe10 2024-09-10T23:16:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.731+0000 7fe940c00640 1 -- 172.21.15.17:0/1304563931 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93400f690 con 0x7fe9440cfe10 2024-09-10T23:16:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.731+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94415dd90 con 0x7fe9440cfe10 2024-09-10T23:16:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.731+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe94415b130 con 0x7fe9440cfe10 2024-09-10T23:16:43.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.731+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9440d2c60 con 0x7fe9440cfe10 2024-09-10T23:16:43.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.731+0000 7fe940c00640 1 -- 172.21.15.17:0/1304563931 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe934020030 con 0x7fe9440cfe10 2024-09-10T23:16:43.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.735+0000 7fe940c00640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe920072610 0x7fe920074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:43.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.735+0000 7fe940c00640 1 -- 172.21.15.17:0/1304563931 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5249+0+0 (secure 0 0 0) 0x7fe934093570 con 0x7fe9440cfe10 2024-09-10T23:16:43.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.735+0000 7fe93b400640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe920072610 0x7fe920074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:43.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.735+0000 7fe93b400640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe920072610 0x7fe920074ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0ae000 tx=0x7fe92c0b3040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:43.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.739+0000 7fe940c00640 1 -- 172.21.15.17:0/1304563931 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe934014030 con 0x7fe9440cfe10 2024-09-10T23:16:43.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.975+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fe94415db40 con 0x7fe9440cfe10 2024-09-10T23:16:43.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.979+0000 7fe940c00640 1 -- 172.21.15.17:0/1304563931 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fe93405ed70 con 0x7fe9440cfe10 2024-09-10T23:16:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.979+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe920072610 msgr2=0x7fe920074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.979+0000 7fe94b000640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe920072610 0x7fe920074ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0ae000 tx=0x7fe92c0b3040 comp rx=0 tx=0).stop 2024-09-10T23:16:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.979+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 msgr2=0x7fe9440b7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.979+0000 7fe94b000640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 0x7fe9440b7430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c9f0 tx=0x7fe93400ceb0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.983+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 shutdown_connections 2024-09-10T23:16:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.983+0000 7fe94b000640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe920072610 0x7fe920074ad0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.983+0000 7fe94b000640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe94415be40 0x7fe94415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.983+0000 7fe94b000640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9440d1990 0x7fe94415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.983+0000 7fe94b000640 1 --2- 172.21.15.17:0/1304563931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9440cfe10 0x7fe9440b7430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:43.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.983+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 >> 172.21.15.17:0/1304563931 conn(0x7fe94409b2a0 msgr2=0x7fe944159870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:43.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.983+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 shutdown_connections 2024-09-10T23:16:43.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:43.983+0000 7fe94b000640 1 -- 172.21.15.17:0/1304563931 wait complete. 2024-09-10T23:16:44.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T23:16:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 -- 172.21.15.17:0/2873608450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 msgr2=0x7f913806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 --2- 172.21.15.17:0/2873608450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 0x7f913806d070 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f91380d0aa0 tx=0x7f913001cd80 comp rx=0 tx=0).stop 2024-09-10T23:16:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 -- 172.21.15.17:0/2873608450 shutdown_connections 2024-09-10T23:16:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 --2- 172.21.15.17:0/2873608450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 0x7f913806d070 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 --2- 172.21.15.17:0/2873608450 >> v2:172.21.15.77:3300/0 conn(0x7f9138160010 0x7f913815ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 --2- 172.21.15.17:0/2873608450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9138071db0 0x7f91380cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 -- 172.21.15.17:0/2873608450 >> 172.21.15.17:0/2873608450 conn(0x7f91380d0bd0 msgr2=0x7f91380d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 -- 172.21.15.17:0/2873608450 shutdown_connections 2024-09-10T23:16:44.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 -- 172.21.15.17:0/2873608450 wait complete. 2024-09-10T23:16:44.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 Processor -- start 2024-09-10T23:16:44.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.147+0000 7f913fc00640 1 -- start start 2024-09-10T23:16:44.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913fc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 0x7f913814d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913fc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138071db0 0x7f91380713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913fc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9138160010 0x7f913815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913fc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9138073b90 con 0x7f913806cbc0 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913fc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9138073a10 con 0x7f9138071db0 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913fc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9138073d10 con 0x7f9138160010 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 0x7f913814d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 0x7f913814d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38110/0 (socket says 172.21.15.17:38110) 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913d200640 1 -- 172.21.15.17:0/3130610394 learned_addr learned my addr 172.21.15.17:0/3130610394 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f9137e00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138071db0 0x7f91380713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913dc00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9138160010 0x7f913815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913d200640 1 -- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9138160010 msgr2=0x7f913815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913d200640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9138160010 0x7f913815d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913d200640 1 -- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138071db0 msgr2=0x7f91380713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913d200640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138071db0 0x7f91380713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913d200640 1 -- 172.21.15.17:0/3130610394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913814fc50 con 0x7f913806cbc0 2024-09-10T23:16:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913d200640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 0x7f913814d8d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f912c00e9f0 tx=0x7f912c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f9134c00640 1 -- 172.21.15.17:0/3130610394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c00ccc0 con 0x7f913806cbc0 2024-09-10T23:16:44.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f9134c00640 1 -- 172.21.15.17:0/3130610394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912c00ce60 con 0x7f913806cbc0 2024-09-10T23:16:44.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f9134c00640 1 -- 172.21.15.17:0/3130610394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c005280 con 0x7f913806cbc0 2024-09-10T23:16:44.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913815d230 con 0x7f913806cbc0 2024-09-10T23:16:44.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913814fec0 con 0x7f913806cbc0 2024-09-10T23:16:44.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91380cb220 con 0x7f913806cbc0 2024-09-10T23:16:44.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.151+0000 7f9134c00640 1 -- 172.21.15.17:0/3130610394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f912c005420 con 0x7f913806cbc0 2024-09-10T23:16:44.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.155+0000 7f9134c00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91180725e0 0x7f9118074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.155+0000 7f9134c00640 1 -- 172.21.15.17:0/3130610394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5249+0+0 (secure 0 0 0) 0x7f912c093ab0 con 0x7f913806cbc0 2024-09-10T23:16:44.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.155+0000 7f9137e00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91180725e0 0x7f9118074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.155+0000 7f9137e00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91180725e0 0x7f9118074aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f91381fb780 tx=0x7f91240091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.159+0000 7f9134c00640 1 -- 172.21.15.17:0/3130610394 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f912c05ed90 con 0x7f913806cbc0 2024-09-10T23:16:44.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.391+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f91380718e0 con 0x7f913806cbc0 2024-09-10T23:16:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f9134c00640 1 -- 172.21.15.17:0/3130610394 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f912c0637c0 con 0x7f913806cbc0 2024-09-10T23:16:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91180725e0 msgr2=0x7f9118074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91180725e0 0x7f9118074aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f91381fb780 tx=0x7f91240091e0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 msgr2=0x7f913814d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 0x7f913814d8d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f912c00e9f0 tx=0x7f912c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 shutdown_connections 2024-09-10T23:16:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91180725e0 0x7f9118074aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9138160010 0x7f913815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138071db0 0x7f91380713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 --2- 172.21.15.17:0/3130610394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913806cbc0 0x7f913814d8d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 >> 172.21.15.17:0/3130610394 conn(0x7f91380d0bd0 msgr2=0x7f913815aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 shutdown_connections 2024-09-10T23:16:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.395+0000 7f913fc00640 1 -- 172.21.15.17:0/3130610394 wait complete. 2024-09-10T23:16:44.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T23:16:44.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 -- 172.21.15.17:0/3190342000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 msgr2=0x7ff1a4165d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 --2- 172.21.15.17:0/3190342000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 0x7ff1a4165d30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009cb0 tx=0x7ff19c01cd10 comp rx=0 tx=0).stop 2024-09-10T23:16:44.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 -- 172.21.15.17:0/3190342000 shutdown_connections 2024-09-10T23:16:44.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 --2- 172.21.15.17:0/3190342000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 0x7ff1a4165d30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 -- 172.21.15.17:0/3190342000 >> 172.21.15.17:0/3190342000 conn(0x7ff1a40b1730 msgr2=0x7ff1a40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:44.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 -- 172.21.15.17:0/3190342000 shutdown_connections 2024-09-10T23:16:44.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 -- 172.21.15.17:0/3190342000 wait complete. 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 Processor -- start 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 -- start start 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1a4070090 0x7ff1a4149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a4073610 0x7ff1a4145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 0x7ff1a4159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4168f30 con 0x7ff1a4163940 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4168db0 con 0x7ff1a4073610 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1ac400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a41690b0 con 0x7ff1a4070090 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1aa400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 0x7ff1a4159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1a9a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1a4070090 0x7ff1a4149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1aa400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 0x7ff1a4159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38138/0 (socket says 172.21.15.17:38138) 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1aa400640 1 -- 172.21.15.17:0/1048545118 learned_addr learned my addr 172.21.15.17:0/1048545118 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.563+0000 7ff1a9000640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a4073610 0x7ff1a4145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1aa400640 1 -- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1a4070090 msgr2=0x7ff1a4149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1aa400640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1a4070090 0x7ff1a4149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1aa400640 1 -- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a4073610 msgr2=0x7ff1a4145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1aa400640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a4073610 0x7ff1a4145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1aa400640 1 -- 172.21.15.17:0/1048545118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a41f7ed0 con 0x7ff1a4163940 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1aa400640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 0x7ff1a4159b30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff19c01b3c0 tx=0x7ff19c0093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1a1600640 1 -- 172.21.15.17:0/1048545118 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0b2040 con 0x7ff1a4163940 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1a1600640 1 -- 172.21.15.17:0/1048545118 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff19c004d40 con 0x7ff1a4163940 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1a1600640 1 -- 172.21.15.17:0/1048545118 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c004200 con 0x7ff1a4163940 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a41f8460 con 0x7ff1a4163940 2024-09-10T23:16:44.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a41f8a20 con 0x7ff1a4163940 2024-09-10T23:16:44.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a4070470 con 0x7ff1a4163940 2024-09-10T23:16:44.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1a1600640 1 -- 172.21.15.17:0/1048545118 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff19c0b5070 con 0x7ff1a4163940 2024-09-10T23:16:44.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.567+0000 7ff1a1600640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1840725e0 0x7ff184074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.571+0000 7ff1a1600640 1 -- 172.21.15.17:0/1048545118 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5249+0+0 (secure 0 0 0) 0x7ff19c12cc90 con 0x7ff1a4163940 2024-09-10T23:16:44.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.571+0000 7ff1a9a00640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1840725e0 0x7ff184074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.571+0000 7ff1a9a00640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1840725e0 0x7ff184074aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1a414cb80 tx=0x7ff198007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.571+0000 7ff1a1600640 1 -- 172.21.15.17:0/1048545118 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff19c016990 con 0x7ff1a4163940 2024-09-10T23:16:44.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.807+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7ff1a415adb0 con 0x7ff1a4163940 2024-09-10T23:16:44.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.807+0000 7ff1a1600640 1 -- 172.21.15.17:0/1048545118 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7ff19c0f7e40 con 0x7ff1a4163940 2024-09-10T23:16:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1840725e0 msgr2=0x7ff184074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1840725e0 0x7ff184074aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1a414cb80 tx=0x7ff198007e40 comp rx=0 tx=0).stop 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 msgr2=0x7ff1a4159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 0x7ff1a4159b30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff19c01b3c0 tx=0x7ff19c0093f0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 shutdown_connections 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1840725e0 0x7ff184074aa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1a4163940 0x7ff1a4159b30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1a4073610 0x7ff1a4145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 --2- 172.21.15.17:0/1048545118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1a4070090 0x7ff1a4149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 >> 172.21.15.17:0/1048545118 conn(0x7ff1a40b1730 msgr2=0x7ff1a40ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 shutdown_connections 2024-09-10T23:16:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.811+0000 7ff1ac400640 1 -- 172.21.15.17:0/1048545118 wait complete. 2024-09-10T23:16:44.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:16:44.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 -- 172.21.15.17:0/1870646273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d180cf320 msgr2=0x7f7d180cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 --2- 172.21.15.17:0/1870646273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d180cf320 0x7f7d180cd880 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7d180d2e60 tx=0x7f7d1001cd80 comp rx=0 tx=0).stop 2024-09-10T23:16:44.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 -- 172.21.15.17:0/1870646273 shutdown_connections 2024-09-10T23:16:44.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 --2- 172.21.15.17:0/1870646273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d180cf320 0x7f7d180cd880 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 --2- 172.21.15.17:0/1870646273 >> v2:172.21.15.77:3300/0 conn(0x7f7d18070ad0 0x7f7d1815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 -- 172.21.15.17:0/1870646273 >> 172.21.15.17:0/1870646273 conn(0x7f7d180d1d60 msgr2=0x7f7d180d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:44.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 -- 172.21.15.17:0/1870646273 shutdown_connections 2024-09-10T23:16:44.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 -- 172.21.15.17:0/1870646273 wait complete. 2024-09-10T23:16:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 Processor -- start 2024-09-10T23:16:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.979+0000 7f7d1d000640 1 -- start start 2024-09-10T23:16:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d1d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d18070ad0 0x7f7d18157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d1d000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d180cf320 0x7f7d1815d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d1d000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d180d1830 0x7f7d1806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d1d000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18169320 con 0x7f7d18070ad0 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d1d000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181691a0 con 0x7f7d180cf320 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d1d000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7d181694a0 con 0x7f7d180d1830 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d18070ad0 0x7f7d18157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d18070ad0 0x7f7d18157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38154/0 (socket says 172.21.15.17:38154) 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15e00640 1 -- 172.21.15.17:0/3342101142 learned_addr learned my addr 172.21.15.17:0/3342101142 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15400640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d180cf320 0x7f7d1815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d16800640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d180d1830 0x7f7d1806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15e00640 1 -- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d180d1830 msgr2=0x7f7d1806ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15e00640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d180d1830 0x7f7d1806ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15e00640 1 -- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d180cf320 msgr2=0x7f7d1815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15e00640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d180cf320 0x7f7d1815d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15e00640 1 -- 172.21.15.17:0/3342101142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1815dfd0 con 0x7f7d18070ad0 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d15e00640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d18070ad0 0x7f7d18157bd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800e970 tx=0x7f7d0800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d0e000640 1 -- 172.21.15.17:0/3342101142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800cd80 con 0x7f7d18070ad0 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d0e000640 1 -- 172.21.15.17:0/3342101142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d08005020 con 0x7f7d18070ad0 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d180c7020 con 0x7f7d18070ad0 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d0e000640 1 -- 172.21.15.17:0/3342101142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08005450 con 0x7f7d18070ad0 2024-09-10T23:16:44.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d180c75e0 con 0x7f7d18070ad0 2024-09-10T23:16:44.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.983+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1815f060 con 0x7f7d18070ad0 2024-09-10T23:16:44.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.987+0000 7f7d0e000640 1 -- 172.21.15.17:0/3342101142 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7d080047b0 con 0x7f7d18070ad0 2024-09-10T23:16:44.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.987+0000 7f7d0e000640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cf80725e0 0x7f7cf8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:44.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.987+0000 7f7d0e000640 1 -- 172.21.15.17:0/3342101142 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5249+0+0 (secure 0 0 0) 0x7f7d08093aa0 con 0x7f7d18070ad0 2024-09-10T23:16:44.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.987+0000 7f7d15400640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cf80725e0 0x7f7cf8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:44.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.987+0000 7f7d15400640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cf80725e0 0x7f7cf8074aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7d180c69c0 tx=0x7f7d04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:44.991+0000 7f7d0e000640 1 -- 172.21.15.17:0/3342101142 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7d0805ece0 con 0x7f7d18070ad0 2024-09-10T23:16:45.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7d180b6970 con 0x7f7d18070ad0 2024-09-10T23:16:45.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d0e000640 1 -- 172.21.15.17:0/3342101142 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) ==== 84+0+65 (secure 0 0 0) 0x7f7d08063710 con 0x7f7d18070ad0 2024-09-10T23:16:45.170 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:45.170 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:16:45.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:16:45.170 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:16:45.170 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:16:45.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:45.171 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:16:45.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cf80725e0 msgr2=0x7f7cf8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cf80725e0 0x7f7cf8074aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7d180c69c0 tx=0x7f7d04009040 comp rx=0 tx=0).stop 2024-09-10T23:16:45.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d18070ad0 msgr2=0x7f7d18157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d18070ad0 0x7f7d18157bd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800e970 tx=0x7f7d0800ee30 comp rx=0 tx=0).stop 2024-09-10T23:16:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 shutdown_connections 2024-09-10T23:16:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cf80725e0 0x7f7cf8074aa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d180d1830 0x7f7d1806ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d180cf320 0x7f7d1815d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 --2- 172.21.15.17:0/3342101142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d18070ad0 0x7f7d18157bd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 >> 172.21.15.17:0/3342101142 conn(0x7f7d180d1d60 msgr2=0x7f7d180b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 shutdown_connections 2024-09-10T23:16:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.167+0000 7f7d1d000640 1 -- 172.21.15.17:0/3342101142 wait complete. 2024-09-10T23:16:45.192 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:16:45.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:16:45.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.339+0000 7f1957000640 1 -- 172.21.15.17:0/1853692112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1938004810 msgr2=0x7f1938004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.339+0000 7f1957000640 1 --2- 172.21.15.17:0/1853692112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1938004810 0x7f1938004c90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f195015f750 tx=0x7f193c01ce70 comp rx=0 tx=0).stop 2024-09-10T23:16:45.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.339+0000 7f1957000640 1 -- 172.21.15.17:0/1853692112 shutdown_connections 2024-09-10T23:16:45.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.339+0000 7f1957000640 1 --2- 172.21.15.17:0/1853692112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1938004810 0x7f1938004c90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.339+0000 7f1957000640 1 -- 172.21.15.17:0/1853692112 >> 172.21.15.17:0/1853692112 conn(0x7f195009a9f0 msgr2=0x7f195009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:45.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.339+0000 7f1957000640 1 -- 172.21.15.17:0/1853692112 shutdown_connections 2024-09-10T23:16:45.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.339+0000 7f1957000640 1 -- 172.21.15.17:0/1853692112 wait complete. 2024-09-10T23:16:45.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 Processor -- start 2024-09-10T23:16:45.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 -- start start 2024-09-10T23:16:45.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1938004810 0x7f19501fb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19501f78b0 0x7f19501f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f195015dbd0 0x7f195015e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19500cf260 con 0x7f195015dbd0 2024-09-10T23:16:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f19500cf0e0 con 0x7f1938004810 2024-09-10T23:16:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f19500cf3e0 con 0x7f19501f78b0 2024-09-10T23:16:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1956600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f195015dbd0 0x7f195015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1956600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f195015dbd0 0x7f195015e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38174/0 (socket says 172.21.15.17:38174) 2024-09-10T23:16:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1956600640 1 -- 172.21.15.17:0/2682023183 learned_addr learned my addr 172.21.15.17:0/2682023183 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1955c00640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1938004810 0x7f19501fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1955200640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19501f78b0 0x7f19501f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1956600640 1 -- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19501f78b0 msgr2=0x7f19501f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1956600640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19501f78b0 0x7f19501f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1956600640 1 -- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1938004810 msgr2=0x7f19501fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1956600640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1938004810 0x7f19501fb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1956600640 1 -- 172.21.15.17:0/2682023183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19501fbe40 con 0x7f195015dbd0 2024-09-10T23:16:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1956600640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f195015dbd0 0x7f195015e050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f19500d10d0 tx=0x7f1948010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f194d600640 1 -- 172.21.15.17:0/2682023183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194800ee70 con 0x7f195015dbd0 2024-09-10T23:16:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f194d600640 1 -- 172.21.15.17:0/2682023183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1948015070 con 0x7f195015dbd0 2024-09-10T23:16:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f194d600640 1 -- 172.21.15.17:0/2682023183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948003d50 con 0x7f195015dbd0 2024-09-10T23:16:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1950160050 con 0x7f195015dbd0 2024-09-10T23:16:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.343+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19501f8110 con 0x7f195015dbd0 2024-09-10T23:16:45.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.347+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19500b15c0 con 0x7f195015dbd0 2024-09-10T23:16:45.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.347+0000 7f194d600640 1 -- 172.21.15.17:0/2682023183 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1948004030 con 0x7f195015dbd0 2024-09-10T23:16:45.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.347+0000 7f194d600640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1930072610 0x7f1930074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:45.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.347+0000 7f194d600640 1 -- 172.21.15.17:0/2682023183 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5249+0+0 (secure 0 0 0) 0x7f1948093a00 con 0x7f195015dbd0 2024-09-10T23:16:45.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.347+0000 7f1955c00640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1930072610 0x7f1930074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:45.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.347+0000 7f1955c00640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1930072610 0x7f1930074ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19500b6c10 tx=0x7f1944006b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:45.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.351+0000 7f194d600640 1 -- 172.21.15.17:0/2682023183 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f19501fbe40 con 0x7f195015dbd0 2024-09-10T23:16:45.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.527+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1950070a60 con 0x7f195015dbd0 2024-09-10T23:16:45.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.983+0000 7f194d600640 1 -- 172.21.15.17:0/2682023183 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v39) ==== 138+0+0 (secure 0 0 0) 0x7f194805ece0 con 0x7f195015dbd0 2024-09-10T23:16:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:16:45.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1930072610 msgr2=0x7f1930074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1930072610 0x7f1930074ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f19500b6c10 tx=0x7f1944006b20 comp rx=0 tx=0).stop 2024-09-10T23:16:45.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f195015dbd0 msgr2=0x7f195015e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f195015dbd0 0x7f195015e050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f19500d10d0 tx=0x7f1948010e80 comp rx=0 tx=0).stop 2024-09-10T23:16:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 shutdown_connections 2024-09-10T23:16:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1930072610 0x7f1930074ad0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f195015dbd0 0x7f195015e050 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19501f78b0 0x7f19501f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 --2- 172.21.15.17:0/2682023183 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1938004810 0x7f19501fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 >> 172.21.15.17:0/2682023183 conn(0x7f195009a9f0 msgr2=0x7f195009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 shutdown_connections 2024-09-10T23:16:45.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:45.987+0000 7f1957000640 1 -- 172.21.15.17:0/2682023183 wait complete. 2024-09-10T23:16:46.016 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:16:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 -- 172.21.15.17:0/1609107989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f177c003a40 msgr2=0x7f177c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 --2- 172.21.15.17:0/1609107989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f177c003a40 0x7f177c003e20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1788006fa0 tx=0x7f178801cea0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f1796800640 1 -- 172.21.15.17:0/1609107989 reap_dead start 2024-09-10T23:16:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 -- 172.21.15.17:0/1609107989 shutdown_connections 2024-09-10T23:16:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 -- 172.21.15.17:0/1609107989 >> 172.21.15.17:0/1609107989 conn(0x7f17980d0360 msgr2=0x7f17980d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 -- 172.21.15.17:0/1609107989 shutdown_connections 2024-09-10T23:16:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 -- 172.21.15.17:0/1609107989 wait complete. 2024-09-10T23:16:46.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 Processor -- start 2024-09-10T23:16:46.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 -- start start 2024-09-10T23:16:46.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177c003a40 0x7f179814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17981f9db0 0x7f17980cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17980cb1b0 0x7f179814a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f17981670c0 con 0x7f17980cb1b0 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1798166f40 con 0x7f17981f9db0 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f179d000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1798167240 con 0x7f177c003a40 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f1796800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17980cb1b0 0x7f179814a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f1796800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17980cb1b0 0x7f179814a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38192/0 (socket says 172.21.15.17:38192) 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.171+0000 7f1796800640 1 -- 172.21.15.17:0/4120792986 learned_addr learned my addr 172.21.15.17:0/4120792986 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f178fe00640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17981f9db0 0x7f17980cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f1795e00640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177c003a40 0x7f179814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f1796800640 1 -- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177c003a40 msgr2=0x7f179814e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f1796800640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177c003a40 0x7f179814e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f1796800640 1 -- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17981f9db0 msgr2=0x7f17980cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f1796800640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17981f9db0 0x7f17980cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f1796800640 1 -- 172.21.15.17:0/4120792986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17980ce1f0 con 0x7f17980cb1b0 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f178fe00640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17981f9db0 0x7f17980cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f1795e00640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177c003a40 0x7f179814e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f1796800640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17980cb1b0 0x7f179814a9b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1798069970 tx=0x7f179000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f178e000640 1 -- 172.21.15.17:0/4120792986 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1790017070 con 0x7f17980cb1b0 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f178e000640 1 -- 172.21.15.17:0/4120792986 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1790015070 con 0x7f17980cb1b0 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17980ce4d0 con 0x7f17980cb1b0 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f178e000640 1 -- 172.21.15.17:0/4120792986 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780001390 con 0x7f17980cb1b0 2024-09-10T23:16:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17980cea90 con 0x7f17980cb1b0 2024-09-10T23:16:46.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179815ea60 con 0x7f17980cb1b0 2024-09-10T23:16:46.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.175+0000 7f178e000640 1 -- 172.21.15.17:0/4120792986 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1790005280 con 0x7f17980cb1b0 2024-09-10T23:16:46.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.179+0000 7f178e000640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1774072610 0x7f1774074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:46.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.179+0000 7f178e000640 1 -- 172.21.15.17:0/4120792986 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5619+0+0 (secure 0 0 0) 0x7f1790093d20 con 0x7f17980cb1b0 2024-09-10T23:16:46.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.179+0000 7f1795e00640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1774072610 0x7f1774074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:46.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.179+0000 7f1795e00640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1774072610 0x7f1774074ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17880ab000 tx=0x7f17880a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:46.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.183+0000 7f178e000640 1 -- 172.21.15.17:0/4120792986 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1790004e40 con 0x7f17980cb1b0 2024-09-10T23:16:46.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.355+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f179809e460 con 0x7f17980cb1b0 2024-09-10T23:16:46.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.991+0000 7f178e000640 1 -- 172.21.15.17:0/4120792986 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v40) ==== 170+0+0 (secure 0 0 0) 0x7f179005f4c0 con 0x7f17980cb1b0 2024-09-10T23:16:46.994 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1774072610 msgr2=0x7f1774074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1774072610 0x7f1774074ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17880ab000 tx=0x7f17880a7040 comp rx=0 tx=0).stop 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17980cb1b0 msgr2=0x7f179814a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17980cb1b0 0x7f179814a9b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1798069970 tx=0x7f179000e720 comp rx=0 tx=0).stop 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 shutdown_connections 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1774072610 0x7f1774074ad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17980cb1b0 0x7f179814a9b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17981f9db0 0x7f17980cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 --2- 172.21.15.17:0/4120792986 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177c003a40 0x7f179814e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 >> 172.21.15.17:0/4120792986 conn(0x7f17980d0360 msgr2=0x7f1798070860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:46.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 shutdown_connections 2024-09-10T23:16:47.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:46.995+0000 7f179d000640 1 -- 172.21.15.17:0/4120792986 wait complete. 2024-09-10T23:16:47.042 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:16:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.191+0000 7fac37a00640 1 -- 172.21.15.17:0/3335683547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac30074d80 msgr2=0x7fac300cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.191+0000 7fac37a00640 1 --2- 172.21.15.17:0/3335683547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac30074d80 0x7fac300cdf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fac28009c80 tx=0x7fac2801cda0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.191+0000 7fac37a00640 1 -- 172.21.15.17:0/3335683547 shutdown_connections 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.191+0000 7fac37a00640 1 --2- 172.21.15.17:0/3335683547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac30074d80 0x7fac300cdf30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.191+0000 7fac37a00640 1 -- 172.21.15.17:0/3335683547 >> 172.21.15.17:0/3335683547 conn(0x7fac300d0360 msgr2=0x7fac300d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.191+0000 7fac37a00640 1 -- 172.21.15.17:0/3335683547 shutdown_connections 2024-09-10T23:16:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.191+0000 7fac37a00640 1 -- 172.21.15.17:0/3335683547 wait complete. 2024-09-10T23:16:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 Processor -- start 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 -- start start 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac30074290 0x7fac30153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac30074d80 0x7fac3015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac300b1870 0x7fac3015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac3016c1e0 con 0x7fac300b1870 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac3016c060 con 0x7fac30074d80 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fac3016c360 con 0x7fac30074290 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac300b1870 0x7fac3015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac300b1870 0x7fac3015caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51834/0 (socket says 172.21.15.17:51834) 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35a00640 1 -- 172.21.15.17:0/4192486125 learned_addr learned my addr 172.21.15.17:0/4192486125 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:47.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35000640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac30074290 0x7fac30153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac27e00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac30074d80 0x7fac3015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35a00640 1 -- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac30074290 msgr2=0x7fac30153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35a00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac30074290 0x7fac30153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35a00640 1 -- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac30074d80 msgr2=0x7fac3015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35a00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac30074d80 0x7fac3015b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35a00640 1 -- 172.21.15.17:0/4192486125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3015d180 con 0x7fac300b1870 2024-09-10T23:16:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac35a00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac300b1870 0x7fac3015caa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fac2801a9d0 tx=0x7fac280a5ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:47.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac2d600640 1 -- 172.21.15.17:0/4192486125 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac280b2040 con 0x7fac300b1870 2024-09-10T23:16:47.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac2d600640 1 -- 172.21.15.17:0/4192486125 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac28004c50 con 0x7fac300b1870 2024-09-10T23:16:47.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac2d600640 1 -- 172.21.15.17:0/4192486125 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28004320 con 0x7fac300b1870 2024-09-10T23:16:47.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3015d460 con 0x7fac300b1870 2024-09-10T23:16:47.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac30153cb0 con 0x7fac300b1870 2024-09-10T23:16:47.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.195+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac300cdf30 con 0x7fac300b1870 2024-09-10T23:16:47.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.199+0000 7fac2d600640 1 -- 172.21.15.17:0/4192486125 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fac280b5070 con 0x7fac300b1870 2024-09-10T23:16:47.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.199+0000 7fac2d600640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac0c072610 0x7fac0c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:47.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.199+0000 7fac2d600640 1 -- 172.21.15.17:0/4192486125 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6001+0+0 (secure 0 0 0) 0x7fac2812d8f0 con 0x7fac300b1870 2024-09-10T23:16:47.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.199+0000 7fac35000640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac0c072610 0x7fac0c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:47.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.199+0000 7fac35000640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac0c072610 0x7fac0c074ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac20000f70 tx=0x7fac20009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.203+0000 7fac2d600640 1 -- 172.21.15.17:0/4192486125 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fac28016990 con 0x7fac300b1870 2024-09-10T23:16:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.411+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fac3006cc60 con 0x7fac300b1870 2024-09-10T23:16:47.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.995+0000 7fac2d600640 1 -- 172.21.15.17:0/4192486125 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v15) ==== 172+0+0 (secure 0 0 0) 0x7fac280f8e90 con 0x7fac300b1870 2024-09-10T23:16:47.997 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 5 and data pool 6 2024-09-10T23:16:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.995+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac0c072610 msgr2=0x7fac0c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.995+0000 7fac37a00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac0c072610 0x7fac0c074ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac20000f70 tx=0x7fac20009040 comp rx=0 tx=0).stop 2024-09-10T23:16:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.999+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac300b1870 msgr2=0x7fac3015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.999+0000 7fac37a00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac300b1870 0x7fac3015caa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fac2801a9d0 tx=0x7fac280a5ba0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.999+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 shutdown_connections 2024-09-10T23:16:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.999+0000 7fac37a00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac0c072610 0x7fac0c074ad0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.999+0000 7fac37a00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac300b1870 0x7fac3015caa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.999+0000 7fac37a00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac30074d80 0x7fac3015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.999+0000 7fac37a00640 1 --2- 172.21.15.17:0/4192486125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac30074290 0x7fac30153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.999+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 >> 172.21.15.17:0/4192486125 conn(0x7fac300d0360 msgr2=0x7fac30156100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:47.999+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 shutdown_connections 2024-09-10T23:16:48.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.003+0000 7fac37a00640 1 -- 172.21.15.17:0/4192486125 wait complete. 2024-09-10T23:16:48.050 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 -- 172.21.15.17:0/516111367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0b48f0 msgr2=0x7fbb0c0b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 --2- 172.21.15.17:0/516111367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0b48f0 0x7fbb0c0b37f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009900 tx=0x7fbaf401c850 comp rx=0 tx=0).stop 2024-09-10T23:16:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 -- 172.21.15.17:0/516111367 shutdown_connections 2024-09-10T23:16:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 --2- 172.21.15.17:0/516111367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0b48f0 0x7fbb0c0b37f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 -- 172.21.15.17:0/516111367 >> 172.21.15.17:0/516111367 conn(0x7fbb0c06cfc0 msgr2=0x7fbb0c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 -- 172.21.15.17:0/516111367 shutdown_connections 2024-09-10T23:16:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 -- 172.21.15.17:0/516111367 wait complete. 2024-09-10T23:16:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 Processor -- start 2024-09-10T23:16:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 -- start start 2024-09-10T23:16:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb0c0b48f0 0x7fbb0c146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0c0cf4f0 0x7fbb0c1493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0cff20 0x7fbb0c148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c16a140 con 0x7fbb0c0cff20 2024-09-10T23:16:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c169fc0 con 0x7fbb0c0cf4f0 2024-09-10T23:16:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb12200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbb0c16a2c0 con 0x7fbb0c0b48f0 2024-09-10T23:16:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb0be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0cff20 0x7fbb0c148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb0be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0cff20 0x7fbb0c148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51852/0 (socket says 172.21.15.17:51852) 2024-09-10T23:16:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb0be00640 1 -- 172.21.15.17:0/2565170978 learned_addr learned my addr 172.21.15.17:0/2565170978 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:48.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb0b400640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb0c0b48f0 0x7fbb0c146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb03e00640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0c0cf4f0 0x7fbb0c1493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb0be00640 1 -- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb0c0b48f0 msgr2=0x7fbb0c146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb0be00640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb0c0b48f0 0x7fbb0c146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb0be00640 1 -- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0c0cf4f0 msgr2=0x7fbb0c1493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb0be00640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0c0cf4f0 0x7fbb0c1493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.195+0000 7fbb0be00640 1 -- 172.21.15.17:0/2565170978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0c149c20 con 0x7fbb0c0cff20 2024-09-10T23:16:48.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb0be00640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0cff20 0x7fbb0c148a60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400b970 tx=0x7fbb0400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb03400640 1 -- 172.21.15.17:0/2565170978 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04019070 con 0x7fbb0c0cff20 2024-09-10T23:16:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb03400640 1 -- 172.21.15.17:0/2565170978 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb0400cc30 con 0x7fbb0c0cff20 2024-09-10T23:16:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb03400640 1 -- 172.21.15.17:0/2565170978 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400ce60 con 0x7fbb0c0cff20 2024-09-10T23:16:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0c147f80 con 0x7fbb0c0cff20 2024-09-10T23:16:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0c149f00 con 0x7fbb0c0cff20 2024-09-10T23:16:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0c0b37f0 con 0x7fbb0c0cff20 2024-09-10T23:16:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb03400640 1 -- 172.21.15.17:0/2565170978 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbb0401e440 con 0x7fbb0c0cff20 2024-09-10T23:16:48.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb03400640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbae80725e0 0x7fbae8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.199+0000 7fbb03400640 1 -- 172.21.15.17:0/2565170978 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fbb04093320 con 0x7fbb0c0cff20 2024-09-10T23:16:48.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.203+0000 7fbb0b400640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbae80725e0 0x7fbae8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.203+0000 7fbb0b400640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbae80725e0 0x7fbae8074aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbafc007fd0 tx=0x7fbafc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.203+0000 7fbb03400640 1 -- 172.21.15.17:0/2565170978 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbb0405e180 con 0x7fbb0c0cff20 2024-09-10T23:16:48.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.383+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb0c152a90 con 0x7fbb0c0cff20 2024-09-10T23:16:48.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.383+0000 7fbb03400640 1 -- 172.21.15.17:0/2565170978 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16955 (secure 0 0 0) 0x7fbb04062bb0 con 0x7fbb0c0cff20 2024-09-10T23:16:48.388 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:48.388 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":41,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:16:47.415536+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:45.541598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:46.368253+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbae80725e0 msgr2=0x7fbae8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbae80725e0 0x7fbae8074aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbafc007fd0 tx=0x7fbafc009040 comp rx=0 tx=0).stop 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0cff20 msgr2=0x7fbb0c148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0cff20 0x7fbb0c148a60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400b970 tx=0x7fbb0400be30 comp rx=0 tx=0).stop 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 shutdown_connections 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbae80725e0 0x7fbae8074aa0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb0c0cff20 0x7fbb0c148a60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb0c0cf4f0 0x7fbb0c1493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 --2- 172.21.15.17:0/2565170978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb0c0b48f0 0x7fbb0c146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 >> 172.21.15.17:0/2565170978 conn(0x7fbb0c06cfc0 msgr2=0x7fbb0c068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 shutdown_connections 2024-09-10T23:16:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.387+0000 7fbb12200640 1 -- 172.21.15.17:0/2565170978 wait complete. 2024-09-10T23:16:48.410 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.551+0000 7f3bfcc00640 1 -- 172.21.15.17:0/3509683405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80cf230 msgr2=0x7f3bf806e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.551+0000 7f3bfcc00640 1 --2- 172.21.15.17:0/3509683405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80cf230 0x7f3bf806e750 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009840 tx=0x7f3be801f010 comp rx=0 tx=0).stop 2024-09-10T23:16:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.551+0000 7f3bfcc00640 1 -- 172.21.15.17:0/3509683405 shutdown_connections 2024-09-10T23:16:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.551+0000 7f3bfcc00640 1 --2- 172.21.15.17:0/3509683405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf80b32d0 0x7f3bf8150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.551+0000 7f3bfcc00640 1 --2- 172.21.15.17:0/3509683405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80cf230 0x7f3bf806e750 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.551+0000 7f3bfcc00640 1 -- 172.21.15.17:0/3509683405 >> 172.21.15.17:0/3509683405 conn(0x7f3bf806cfc0 msgr2=0x7f3bf806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.551+0000 7f3bfcc00640 1 -- 172.21.15.17:0/3509683405 shutdown_connections 2024-09-10T23:16:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.551+0000 7f3bfcc00640 1 -- 172.21.15.17:0/3509683405 wait complete. 2024-09-10T23:16:48.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 Processor -- start 2024-09-10T23:16:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 -- start start 2024-09-10T23:16:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80b32d0 0x7f3bf8144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf80cf230 0x7f3bf8153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80cf610 0x7f3bf8159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf80d0330 con 0x7f3bf80b32d0 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf80d01b0 con 0x7f3bf80cf610 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf80d04b0 con 0x7f3bf80cf230 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80b32d0 0x7f3bf8144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80b32d0 0x7f3bf8144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51864/0 (socket says 172.21.15.17:51864) 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5e00640 1 -- 172.21.15.17:0/1607067323 learned_addr learned my addr 172.21.15.17:0/1607067323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf6800640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80cf610 0x7f3bf8159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5e00640 1 -- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf80cf230 msgr2=0x7f3bf8153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5400640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf80cf230 0x7f3bf8153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5e00640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf80cf230 0x7f3bf8153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5e00640 1 -- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80cf610 msgr2=0x7f3bf8159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5e00640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80cf610 0x7f3bf8159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5e00640 1 -- 172.21.15.17:0/1607067323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf8152250 con 0x7f3bf80b32d0 2024-09-10T23:16:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf6800640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80cf610 0x7f3bf8159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5400640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf80cf230 0x7f3bf8153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bf5e00640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80b32d0 0x7f3bf8144a60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009790 tx=0x7f3be80a8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bee000640 1 -- 172.21.15.17:0/1607067323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be80be020 con 0x7f3bf80b32d0 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bee000640 1 -- 172.21.15.17:0/1607067323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3be8005220 con 0x7f3bf80b32d0 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf8152530 con 0x7f3bf80b32d0 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bee000640 1 -- 172.21.15.17:0/1607067323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be80b5040 con 0x7f3bf80b32d0 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.555+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf815b470 con 0x7f3bf80b32d0 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.559+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf8150d70 con 0x7f3bf80b32d0 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.559+0000 7f3bee000640 1 -- 172.21.15.17:0/1607067323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3be80b8050 con 0x7f3bf80b32d0 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.559+0000 7f3bee000640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3bd8072610 0x7f3bd8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.559+0000 7f3bee000640 1 -- 172.21.15.17:0/1607067323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f3be8130430 con 0x7f3bf80b32d0 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.559+0000 7f3bf5400640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3bd8072610 0x7f3bd8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.563+0000 7f3bf5400640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3bd8072610 0x7f3bd8074ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8145d00 tx=0x7f3be4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.563+0000 7f3bee000640 1 -- 172.21.15.17:0/1607067323 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3be8018b70 con 0x7f3bf80b32d0 2024-09-10T23:16:48.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.743+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bf8152a50 con 0x7f3bf80b32d0 2024-09-10T23:16:48.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.743+0000 7f3bee000640 1 -- 172.21.15.17:0/1607067323 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16955 (secure 0 0 0) 0x7f3be80fb8f0 con 0x7f3bf80b32d0 2024-09-10T23:16:48.748 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":41,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:16:47.415536+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:45.541598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:46.368253+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3bd8072610 msgr2=0x7f3bd8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3bd8072610 0x7f3bd8074ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8145d00 tx=0x7f3be4009040 comp rx=0 tx=0).stop 2024-09-10T23:16:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80b32d0 msgr2=0x7f3bf8144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80b32d0 0x7f3bf8144a60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009790 tx=0x7f3be80a8ca0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 shutdown_connections 2024-09-10T23:16:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3bd8072610 0x7f3bd8074ad0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80cf610 0x7f3bf8159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3bf80cf230 0x7f3bf8153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 --2- 172.21.15.17:0/1607067323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf80b32d0 0x7f3bf8144a60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 >> 172.21.15.17:0/1607067323 conn(0x7f3bf806cfc0 msgr2=0x7f3bf80cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 shutdown_connections 2024-09-10T23:16:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.747+0000 7f3bfcc00640 1 -- 172.21.15.17:0/1607067323 wait complete. 2024-09-10T23:16:48.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:16:48.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.915+0000 7f38e3800640 1 -- 172.21.15.17:0/105872085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0b19e0 msgr2=0x7f38dc0b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.915+0000 7f38e3800640 1 --2- 172.21.15.17:0/105872085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0b19e0 0x7f38dc0b1e70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f38dc08d370 tx=0x7f38d401cda0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.915+0000 7f38e3800640 1 -- 172.21.15.17:0/105872085 shutdown_connections 2024-09-10T23:16:48.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.915+0000 7f38e3800640 1 --2- 172.21.15.17:0/105872085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0b19e0 0x7f38dc0b1e70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.915+0000 7f38e3800640 1 --2- 172.21.15.17:0/105872085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38dc161530 0x7f38dc0b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.915+0000 7f38e3800640 1 -- 172.21.15.17:0/105872085 >> 172.21.15.17:0/105872085 conn(0x7f38dc0d3ed0 msgr2=0x7f38dc0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:48.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.915+0000 7f38e3800640 1 -- 172.21.15.17:0/105872085 shutdown_connections 2024-09-10T23:16:48.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.915+0000 7f38e3800640 1 -- 172.21.15.17:0/105872085 wait complete. 2024-09-10T23:16:48.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 Processor -- start 2024-09-10T23:16:48.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 -- start start 2024-09-10T23:16:48.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38dc0b19e0 0x7f38dc150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0d49f0 0x7f38dc1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38dc161530 0x7f38dc1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc16b130 con 0x7f38dc0d49f0 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc16afb0 con 0x7f38dc161530 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f38dc16b2b0 con 0x7f38dc0b19e0 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0d49f0 0x7f38dc1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0d49f0 0x7f38dc1514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51870/0 (socket says 172.21.15.17:51870) 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38dbe00640 1 -- 172.21.15.17:0/102892246 learned_addr learned my addr 172.21.15.17:0/102892246 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e0e00640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38dc0b19e0 0x7f38dc150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e1800640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38dc161530 0x7f38dc1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38dbe00640 1 -- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38dc0b19e0 msgr2=0x7f38dc150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38dbe00640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38dc0b19e0 0x7f38dc150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38dbe00640 1 -- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38dc161530 msgr2=0x7f38dc1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38dbe00640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38dc161530 0x7f38dc1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38dbe00640 1 -- 172.21.15.17:0/102892246 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc151f20 con 0x7f38dc0d49f0 2024-09-10T23:16:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38dbe00640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0d49f0 0x7f38dc1514d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f38c800c3c0 tx=0x7f38c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38d8c00640 1 -- 172.21.15.17:0/102892246 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8007020 con 0x7f38dc0d49f0 2024-09-10T23:16:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38d8c00640 1 -- 172.21.15.17:0/102892246 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38c80072b0 con 0x7f38dc0d49f0 2024-09-10T23:16:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38d8c00640 1 -- 172.21.15.17:0/102892246 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c80067e0 con 0x7f38dc0d49f0 2024-09-10T23:16:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38dc152200 con 0x7f38dc0d49f0 2024-09-10T23:16:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.919+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38dc1511c0 con 0x7f38dc0d49f0 2024-09-10T23:16:48.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.923+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38dc1525f0 con 0x7f38dc0d49f0 2024-09-10T23:16:48.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.923+0000 7f38d8c00640 1 -- 172.21.15.17:0/102892246 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f38c8006980 con 0x7f38dc0d49f0 2024-09-10T23:16:48.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.923+0000 7f38d8c00640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38bc0725e0 0x7f38bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:48.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.923+0000 7f38d8c00640 1 -- 172.21.15.17:0/102892246 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f38c8092db0 con 0x7f38dc0d49f0 2024-09-10T23:16:48.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.923+0000 7f38e0e00640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38bc0725e0 0x7f38bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:48.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.923+0000 7f38e0e00640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38bc0725e0 0x7f38bc074aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f38d000ab40 tx=0x7f38d000a250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:48.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:48.927+0000 7f38d8c00640 1 -- 172.21.15.17:0/102892246 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f38c8097070 con 0x7f38dc0d49f0 2024-09-10T23:16:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:49.139+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f38dc0b1e70 con 0x7f38dc0d49f0 2024-09-10T23:16:49.858 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:16:49.855+0000 7fc181600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:16:50.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.019+0000 7f38d8c00640 1 -- 172.21.15.17:0/102892246 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f38c805dc10 con 0x7f38dc0d49f0 2024-09-10T23:16:50.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38bc0725e0 msgr2=0x7f38bc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38bc0725e0 0x7f38bc074aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f38d000ab40 tx=0x7f38d000a250 comp rx=0 tx=0).stop 2024-09-10T23:16:50.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0d49f0 msgr2=0x7f38dc1514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0d49f0 0x7f38dc1514d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f38c800c3c0 tx=0x7f38c800c880 comp rx=0 tx=0).stop 2024-09-10T23:16:50.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 shutdown_connections 2024-09-10T23:16:50.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38bc0725e0 0x7f38bc074aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38dc161530 0x7f38dc1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38dc0d49f0 0x7f38dc1514d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 --2- 172.21.15.17:0/102892246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38dc0b19e0 0x7f38dc150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 >> 172.21.15.17:0/102892246 conn(0x7f38dc0d3ed0 msgr2=0x7f38dc0b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 shutdown_connections 2024-09-10T23:16:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.023+0000 7f38e3800640 1 -- 172.21.15.17:0/102892246 wait complete. 2024-09-10T23:16:50.059 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:16:50.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:16:50.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 -- 172.21.15.17:0/1023800630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2840b2540 msgr2=0x7fb2840d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 --2- 172.21.15.17:0/1023800630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2840b2540 0x7fb2840d03b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb2840cec20 tx=0x7fb26c01c880 comp rx=0 tx=0).stop 2024-09-10T23:16:50.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 -- 172.21.15.17:0/1023800630 shutdown_connections 2024-09-10T23:16:50.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 --2- 172.21.15.17:0/1023800630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2840b31b0 0x7fb2840cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 --2- 172.21.15.17:0/1023800630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2840b2540 0x7fb2840d03b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 -- 172.21.15.17:0/1023800630 >> 172.21.15.17:0/1023800630 conn(0x7fb2840d1da0 msgr2=0x7fb2840d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:50.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 -- 172.21.15.17:0/1023800630 shutdown_connections 2024-09-10T23:16:50.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 -- 172.21.15.17:0/1023800630 wait complete. 2024-09-10T23:16:50.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 Processor -- start 2024-09-10T23:16:50.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 -- start start 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2840b2540 0x7fb2840ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2840b31b0 0x7fb284150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb28415f400 0x7fb284165000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb284168c60 con 0x7fb28415f400 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840cdbd0 con 0x7fb2840b31b0 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb28ae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb284168de0 con 0x7fb2840b2540 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb288e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb28415f400 0x7fb284165000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb283e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2840b2540 0x7fb2840ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb27be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2840b31b0 0x7fb284150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb288e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb28415f400 0x7fb284165000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51892/0 (socket says 172.21.15.17:51892) 2024-09-10T23:16:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.211+0000 7fb288e00640 1 -- 172.21.15.17:0/2970866165 learned_addr learned my addr 172.21.15.17:0/2970866165 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb27be00640 1 -- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2840b2540 msgr2=0x7fb2840ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb27be00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2840b2540 0x7fb2840ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb27be00640 1 -- 172.21.15.17:0/2970866165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb28415f400 msgr2=0x7fb284165000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb27be00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb28415f400 0x7fb284165000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb27be00640 1 -- 172.21.15.17:0/2970866165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2840b5160 con 0x7fb2840b31b0 2024-09-10T23:16:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb283e00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2840b2540 0x7fb2840ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb27be00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2840b31b0 0x7fb284150380 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0ac000 tx=0x7fb26c0a56d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb280c00640 1 -- 172.21.15.17:0/2970866165 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0b2040 con 0x7fb2840b31b0 2024-09-10T23:16:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb280c00640 1 -- 172.21.15.17:0/2970866165 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb26c0bd070 con 0x7fb2840b31b0 2024-09-10T23:16:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2840b5440 con 0x7fb2840b31b0 2024-09-10T23:16:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb280c00640 1 -- 172.21.15.17:0/2970866165 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c003860 con 0x7fb2840b31b0 2024-09-10T23:16:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2840b5a00 con 0x7fb2840b31b0 2024-09-10T23:16:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2840cc8b0 con 0x7fb2840b31b0 2024-09-10T23:16:50.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.215+0000 7fb280c00640 1 -- 172.21.15.17:0/2970866165 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb26c003a00 con 0x7fb2840b31b0 2024-09-10T23:16:50.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.219+0000 7fb280c00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2600725e0 0x7fb260074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:50.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.219+0000 7fb280c00640 1 -- 172.21.15.17:0/2970866165 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7fb26c12e7c0 con 0x7fb2840b31b0 2024-09-10T23:16:50.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.219+0000 7fb283e00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2600725e0 0x7fb260074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:50.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.219+0000 7fb283e00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2600725e0 0x7fb260074aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb274007fd0 tx=0x7fb274009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:50.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.219+0000 7fb280c00640 1 -- 172.21.15.17:0/2970866165 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb26c0164d0 con 0x7fb2840b31b0 2024-09-10T23:16:50.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:50.430+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb2840709a0 con 0x7fb2840b31b0 2024-09-10T23:16:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.030+0000 7fb280c00640 1 -- 172.21.15.17:0/2970866165 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) ==== 122+0+0 (secure 0 0 0) 0x7fb26c0044b0 con 0x7fb2840b31b0 2024-09-10T23:16:51.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2600725e0 msgr2=0x7fb260074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2600725e0 0x7fb260074aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb274007fd0 tx=0x7fb274009040 comp rx=0 tx=0).stop 2024-09-10T23:16:51.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2840b31b0 msgr2=0x7fb284150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2840b31b0 0x7fb284150380 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0ac000 tx=0x7fb26c0a56d0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 shutdown_connections 2024-09-10T23:16:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2600725e0 0x7fb260074aa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb28415f400 0x7fb284165000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2840b31b0 0x7fb284150380 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 --2- 172.21.15.17:0/2970866165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2840b2540 0x7fb2840ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 >> 172.21.15.17:0/2970866165 conn(0x7fb2840d1da0 msgr2=0x7fb28406ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 shutdown_connections 2024-09-10T23:16:51.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.034+0000 7fb28ae00640 1 -- 172.21.15.17:0/2970866165 wait complete. 2024-09-10T23:16:51.060 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:16:51.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.206+0000 7f19c8600640 1 -- 172.21.15.17:0/1031533606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a8003a10 msgr2=0x7f19a8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.206+0000 7f19c8600640 1 --2- 172.21.15.17:0/1031533606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a8003a10 0x7f19a8003e30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f19b400c2e0 tx=0x7f19b401cde0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.206+0000 7f19c6600640 1 -- 172.21.15.17:0/1031533606 reap_dead start 2024-09-10T23:16:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.206+0000 7f19c8600640 1 -- 172.21.15.17:0/1031533606 shutdown_connections 2024-09-10T23:16:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.206+0000 7f19c8600640 1 -- 172.21.15.17:0/1031533606 >> 172.21.15.17:0/1031533606 conn(0x7f19c00d1d10 msgr2=0x7f19c00d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.206+0000 7f19c8600640 1 -- 172.21.15.17:0/1031533606 shutdown_connections 2024-09-10T23:16:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.206+0000 7f19c8600640 1 -- 172.21.15.17:0/1031533606 wait complete. 2024-09-10T23:16:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.206+0000 7f19c8600640 1 Processor -- start 2024-09-10T23:16:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.206+0000 7f19c8600640 1 -- start start 2024-09-10T23:16:51.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c8600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a8003a10 0x7f19c01facd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c8600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19c01fb210 0x7f19c00c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c8600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19c00c7360 0x7f19c015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c8600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19c00b1fd0 con 0x7f19a8003a10 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c8600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f19c00b1e50 con 0x7f19c00c7360 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c8600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f19c00b2150 con 0x7f19c01fb210 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a8003a10 0x7f19c01facd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a8003a10 0x7f19c01facd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51922/0 (socket says 172.21.15.17:51922) 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5c00640 1 -- 172.21.15.17:0/231266179 learned_addr learned my addr 172.21.15.17:0/231266179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5200640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19c01fb210 0x7f19c00c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c6600640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19c00c7360 0x7f19c015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5c00640 1 -- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19c01fb210 msgr2=0x7f19c00c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5c00640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19c01fb210 0x7f19c00c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5c00640 1 -- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19c00c7360 msgr2=0x7f19c015a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5c00640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19c00c7360 0x7f19c015a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5c00640 1 -- 172.21.15.17:0/231266179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c00c7810 con 0x7f19a8003a10 2024-09-10T23:16:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c5c00640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a8003a10 0x7f19c01facd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f19b401c8a0 tx=0x7f19b4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19bd600640 1 -- 172.21.15.17:0/231266179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b40a5ac0 con 0x7f19a8003a10 2024-09-10T23:16:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19bd600640 1 -- 172.21.15.17:0/231266179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19b40a5c60 con 0x7f19a8003a10 2024-09-10T23:16:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19bd600640 1 -- 172.21.15.17:0/231266179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b40062b0 con 0x7f19a8003a10 2024-09-10T23:16:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c00c7a90 con 0x7f19a8003a10 2024-09-10T23:16:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c00c8050 con 0x7f19a8003a10 2024-09-10T23:16:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c00b3130 con 0x7f19a8003a10 2024-09-10T23:16:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.210+0000 7f19bd600640 1 -- 172.21.15.17:0/231266179 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f19b4006450 con 0x7f19a8003a10 2024-09-10T23:16:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.214+0000 7f19bd600640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f19a0072610 0x7f19a0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.214+0000 7f19bd600640 1 -- 172.21.15.17:0/231266179 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7f19b412d1c0 con 0x7f19a8003a10 2024-09-10T23:16:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.214+0000 7f19c5200640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f19a0072610 0x7f19a0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.214+0000 7f19c5200640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f19a0072610 0x7f19a0074ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19c01569e0 tx=0x7f19ac0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.218+0000 7f19bd600640 1 -- 172.21.15.17:0/231266179 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f19c00c7810 con 0x7f19a8003a10 2024-09-10T23:16:51.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19c00d2250 con 0x7f19a8003a10 2024-09-10T23:16:51.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19bd600640 1 -- 172.21.15.17:0/231266179 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5220 (secure 0 0 0) 0x7f19c00b2440 con 0x7f19a8003a10 2024-09-10T23:16:51.434 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:51.434 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"btime":"2024-09-10T23:16:51:022729+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1906911663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1906911663},{"type":"v1","addr":"172.21.15.77:6835","nonce":1906911663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/650482314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":650482314},{"type":"v1","addr":"172.21.15.77:6837","nonce":650482314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":5013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1923332906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1923332906},{"type":"v1","addr":"172.21.15.17:6834","nonce":1923332906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:47.415488+0000","modified":"2024-09-10T23:16:50.434181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5016":{"gid":5016,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/3608620403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3608620403},{"type":"v1","addr":"172.21.15.17:6835","nonce":3608620403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5016,"qdb_cluster":[5016]},"id":2}]} 2024-09-10T23:16:51.434 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 19 2024-09-10T23:16:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f19a0072610 msgr2=0x7f19a0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f19a0072610 0x7f19a0074ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19c01569e0 tx=0x7f19ac0091e0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a8003a10 msgr2=0x7f19c01facd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a8003a10 0x7f19c01facd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f19b401c8a0 tx=0x7f19b4001d80 comp rx=0 tx=0).stop 2024-09-10T23:16:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 shutdown_connections 2024-09-10T23:16:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f19a0072610 0x7f19a0074ad0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19c00c7360 0x7f19c015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19c01fb210 0x7f19c00c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 --2- 172.21.15.17:0/231266179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19a8003a10 0x7f19c01facd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 >> 172.21.15.17:0/231266179 conn(0x7f19c00d1d10 msgr2=0x7f19c0071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 shutdown_connections 2024-09-10T23:16:51.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.430+0000 7f19c8600640 1 -- 172.21.15.17:0/231266179 wait complete. 2024-09-10T23:16:51.456 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:16:51.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 -- 172.21.15.17:0/3592748807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f3c15fd90 msgr2=0x7f0f3c160170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 --2- 172.21.15.17:0/3592748807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f3c15fd90 0x7f0f3c160170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009900 tx=0x7f0f2c01c850 comp rx=0 tx=0).stop 2024-09-10T23:16:51.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 -- 172.21.15.17:0/3592748807 shutdown_connections 2024-09-10T23:16:51.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 --2- 172.21.15.17:0/3592748807 >> v2:172.21.15.77:3300/0 conn(0x7f0f3c0cffc0 0x7f0f3c0d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 --2- 172.21.15.17:0/3592748807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f3c15fd90 0x7f0f3c160170 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 -- 172.21.15.17:0/3592748807 >> 172.21.15.17:0/3592748807 conn(0x7f0f3c06cfc0 msgr2=0x7f0f3c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 -- 172.21.15.17:0/3592748807 shutdown_connections 2024-09-10T23:16:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 -- 172.21.15.17:0/3592748807 wait complete. 2024-09-10T23:16:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 Processor -- start 2024-09-10T23:16:51.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.598+0000 7f0f42400640 1 -- start start 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f42400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f3c0cffc0 0x7f0f3c145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f42400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f3c15cb00 0x7f0f3c146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f42400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3c15fd90 0x7f0f3c135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f42400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c168870 con 0x7f0f3c15cb00 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f42400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c1689f0 con 0x7f0f3c15fd90 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f42400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c168b70 con 0x7f0f3c0cffc0 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f32a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f3c15cb00 0x7f0f3c146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f3b400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f3c0cffc0 0x7f0f3c145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f32a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f3c15cb00 0x7f0f3c146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51926/0 (socket says 172.21.15.17:51926) 2024-09-10T23:16:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f32a00640 1 -- 172.21.15.17:0/2889276718 learned_addr learned my addr 172.21.15.17:0/2889276718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:51.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f3be00640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3c15fd90 0x7f0f3c135040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f32a00640 1 -- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f3c0cffc0 msgr2=0x7f0f3c145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f32a00640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f3c0cffc0 0x7f0f3c145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f32a00640 1 -- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3c15fd90 msgr2=0x7f0f3c135040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f32a00640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3c15fd90 0x7f0f3c135040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f32a00640 1 -- 172.21.15.17:0/2889276718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c1fb360 con 0x7f0f3c15cb00 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f3b400640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f3c0cffc0 0x7f0f3c145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f32a00640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f3c15cb00 0x7f0f3c146490 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400c400 tx=0x7f0f2400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f33e00640 1 -- 172.21.15.17:0/2889276718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24017070 con 0x7f0f3c15cb00 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f33e00640 1 -- 172.21.15.17:0/2889276718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f240053e0 con 0x7f0f3c15cb00 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f33e00640 1 -- 172.21.15.17:0/2889276718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24003860 con 0x7f0f3c15cb00 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c1fb640 con 0x7f0f3c15cb00 2024-09-10T23:16:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c1fbc00 con 0x7f0f3c15cb00 2024-09-10T23:16:51.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3c0d0450 con 0x7f0f3c15cb00 2024-09-10T23:16:51.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.602+0000 7f0f33e00640 1 -- 172.21.15.17:0/2889276718 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0f24003a00 con 0x7f0f3c15cb00 2024-09-10T23:16:51.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.606+0000 7f0f33e00640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f180725e0 0x7f0f18074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.606+0000 7f0f33e00640 1 -- 172.21.15.17:0/2889276718 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7f0f24092950 con 0x7f0f3c15cb00 2024-09-10T23:16:51.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.606+0000 7f0f3b400640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f180725e0 0x7f0f18074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.606+0000 7f0f3b400640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f180725e0 0x7f0f18074aa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0af000 tx=0x7f0f2c01b090 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.610+0000 7f0f33e00640 1 -- 172.21.15.17:0/2889276718 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0f24001130 con 0x7f0f3c15cb00 2024-09-10T23:16:51.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f3c1603b0 con 0x7f0f3c15cb00 2024-09-10T23:16:51.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f33e00640 1 -- 172.21.15.17:0/2889276718 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+16942 (secure 0 0 0) 0x7f0f2405d850 con 0x7f0f3c15cb00 2024-09-10T23:16:51.790 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:51.791 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":42,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:16:49.009103+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:45.541598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:46.368253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f180725e0 msgr2=0x7f0f18074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f180725e0 0x7f0f18074aa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0af000 tx=0x7f0f2c01b090 comp rx=0 tx=0).stop 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f3c15cb00 msgr2=0x7f0f3c146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f3c15cb00 0x7f0f3c146490 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400c400 tx=0x7f0f2400c800 comp rx=0 tx=0).stop 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 shutdown_connections 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f180725e0 0x7f0f18074aa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f3c15fd90 0x7f0f3c135040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f3c15cb00 0x7f0f3c146490 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 --2- 172.21.15.17:0/2889276718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f3c0cffc0 0x7f0f3c145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.786+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 >> 172.21.15.17:0/2889276718 conn(0x7f0f3c06cfc0 msgr2=0x7f0f3c070360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.790+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 shutdown_connections 2024-09-10T23:16:51.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.790+0000 7f0f42400640 1 -- 172.21.15.17:0/2889276718 wait complete. 2024-09-10T23:16:51.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:16:51.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:16:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.954+0000 7f9bc5a00640 1 -- 172.21.15.17:0/693582702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc015f770 msgr2=0x7f9bc00cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.954+0000 7f9bc5a00640 1 --2- 172.21.15.17:0/693582702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc015f770 0x7f9bc00cc870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00d0c70 tx=0x7f9ba801c880 comp rx=0 tx=0).stop 2024-09-10T23:16:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.954+0000 7f9bc5a00640 1 -- 172.21.15.17:0/693582702 shutdown_connections 2024-09-10T23:16:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.954+0000 7f9bc5a00640 1 --2- 172.21.15.17:0/693582702 >> v2:172.21.15.77:3300/0 conn(0x7f9bc00d1830 0x7f9bc00ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.954+0000 7f9bc5a00640 1 --2- 172.21.15.17:0/693582702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc015f770 0x7f9bc00cc870 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.954+0000 7f9bc5a00640 1 -- 172.21.15.17:0/693582702 >> 172.21.15.17:0/693582702 conn(0x7f9bc00d1d60 msgr2=0x7f9bc00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.954+0000 7f9bc5a00640 1 -- 172.21.15.17:0/693582702 shutdown_connections 2024-09-10T23:16:51.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.954+0000 7f9bc5a00640 1 -- 172.21.15.17:0/693582702 wait complete. 2024-09-10T23:16:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 Processor -- start 2024-09-10T23:16:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 -- start start 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bc0070ad0 0x7f9bc00b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc00d1830 0x7f9bc00b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bc015f770 0x7f9bc00b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0169330 con 0x7f9bc00d1830 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc01691b0 con 0x7f9bc015f770 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc01694b0 con 0x7f9bc0070ad0 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc00d1830 0x7f9bc00b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc00d1830 0x7f9bc00b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51952/0 (socket says 172.21.15.17:51952) 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb7e00640 1 -- 172.21.15.17:0/2653398823 learned_addr learned my addr 172.21.15.17:0/2653398823 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bbea00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bc0070ad0 0x7f9bc00b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bbf400640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bc015f770 0x7f9bc00b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb7e00640 1 -- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bc0070ad0 msgr2=0x7f9bc00b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb7e00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bc0070ad0 0x7f9bc00b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb7e00640 1 -- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bc015f770 msgr2=0x7f9bc00b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:51.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb7e00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bc015f770 0x7f9bc00b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:51.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb7e00640 1 -- 172.21.15.17:0/2653398823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc00c8e30 con 0x7f9bc00d1830 2024-09-10T23:16:51.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bbea00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bc0070ad0 0x7f9bc00b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:51.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb7e00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc00d1830 0x7f9bc00b26e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80b0040 tx=0x7f9ba80a5880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb6a00640 1 -- 172.21.15.17:0/2653398823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80b2040 con 0x7f9bc00d1830 2024-09-10T23:16:51.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb6a00640 1 -- 172.21.15.17:0/2653398823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ba80044b0 con 0x7f9bc00d1830 2024-09-10T23:16:51.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bb6a00640 1 -- 172.21.15.17:0/2653398823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8005290 con 0x7f9bc00d1830 2024-09-10T23:16:51.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc00cbbc0 con 0x7f9bc00d1830 2024-09-10T23:16:51.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.958+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc00c93b0 con 0x7f9bc00d1830 2024-09-10T23:16:51.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.962+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc015f060 con 0x7f9bc00d1830 2024-09-10T23:16:51.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.962+0000 7f9bb6a00640 1 -- 172.21.15.17:0/2653398823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9ba8005430 con 0x7f9bc00d1830 2024-09-10T23:16:51.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.962+0000 7f9bb6a00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b9c0725e0 0x7f9b9c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:51.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.962+0000 7f9bb6a00640 1 -- 172.21.15.17:0/2653398823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7f9ba812cd80 con 0x7f9bc00d1830 2024-09-10T23:16:51.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.962+0000 7f9bbea00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b9c0725e0 0x7f9b9c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:51.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.962+0000 7f9bbea00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b9c0725e0 0x7f9b9c074aa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0003ec0 tx=0x7f9bb0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:51.966+0000 7f9bb6a00640 1 -- 172.21.15.17:0/2653398823 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9bc00cbbc0 con 0x7f9bc00d1830 2024-09-10T23:16:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.142+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9bc00b6920 con 0x7f9b9c0725e0 2024-09-10T23:16:52.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.146+0000 7f9bb6a00640 1 -- 172.21.15.17:0/2653398823 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239611 (secure 0 0 0) 0x7f9bb0053810 con 0x7f9b9c0725e0 2024-09-10T23:16:52.153 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:52.154 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:16:52.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b9c0725e0 msgr2=0x7f9b9c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b9c0725e0 0x7f9b9c074aa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0003ec0 tx=0x7f9bb0009040 comp rx=0 tx=0).stop 2024-09-10T23:16:52.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc00d1830 msgr2=0x7f9bc00b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc00d1830 0x7f9bc00b26e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80b0040 tx=0x7f9ba80a5880 comp rx=0 tx=0).stop 2024-09-10T23:16:52.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 shutdown_connections 2024-09-10T23:16:52.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b9c0725e0 0x7f9b9c074aa0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bc015f770 0x7f9bc00b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bc00d1830 0x7f9bc00b26e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 --2- 172.21.15.17:0/2653398823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bc0070ad0 0x7f9bc00b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 >> 172.21.15.17:0/2653398823 conn(0x7f9bc00d1d60 msgr2=0x7f9bc00b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:52.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 shutdown_connections 2024-09-10T23:16:52.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.150+0000 7f9bc5a00640 1 -- 172.21.15.17:0/2653398823 wait complete. 2024-09-10T23:16:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-10T23:16:50.309675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592014,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":237420,"kb_used_data":4544,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737300,"statfs":{"total":773094113280,"available":772850995200,"internally_reserved":0,"allocated":4653056,"data_stored":2625060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.322361"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.030008+0000","last_change":"2024-09-10T23:16:48.021447+0000","last_active":"2024-09-10T23:16:48.030008+0000","last_peered":"2024-09-10T23:16:48.030008+0000","last_clean":"2024-09-10T23:16:48.030008+0000","last_became_active":"2024-09-10T23:16:48.021172+0000","last_became_peered":"2024-09-10T23:16:48.021172+0000","last_unstale":"2024-09-10T23:16:48.030008+0000","last_undegraded":"2024-09-10T23:16:48.030008+0000","last_fullsized":"2024-09-10T23:16:48.030008+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:42.269668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.033888+0000","last_change":"2024-09-10T23:16:48.026962+0000","last_active":"2024-09-10T23:16:48.033888+0000","last_peered":"2024-09-10T23:16:48.033888+0000","last_clean":"2024-09-10T23:16:48.033888+0000","last_became_active":"2024-09-10T23:16:48.026671+0000","last_became_peered":"2024-09-10T23:16:48.026671+0000","last_unstale":"2024-09-10T23:16:48.033888+0000","last_undegraded":"2024-09-10T23:16:48.033888+0000","last_fullsized":"2024-09-10T23:16:48.033888+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:27.580510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.020553+0000","last_change":"2024-09-10T23:16:48.015268+0000","last_active":"2024-09-10T23:16:48.020553+0000","last_peered":"2024-09-10T23:16:48.020553+0000","last_clean":"2024-09-10T23:16:48.020553+0000","last_became_active":"2024-09-10T23:16:48.014989+0000","last_became_peered":"2024-09-10T23:16:48.014989+0000","last_unstale":"2024-09-10T23:16:48.020553+0000","last_undegraded":"2024-09-10T23:16:48.020553+0000","last_fullsized":"2024-09-10T23:16:48.020553+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:45.577598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-10T23:16:45.995899+0000","last_change":"2024-09-10T23:16:45.995899+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.995899+0000","last_undegraded":"2024-09-10T23:16:45.995899+0000","last_fullsized":"2024-09-10T23:16:45.995899+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.029981+0000","last_change":"2024-09-10T23:16:48.019831+0000","last_active":"2024-09-10T23:16:48.029981+0000","last_peered":"2024-09-10T23:16:48.029981+0000","last_clean":"2024-09-10T23:16:48.029981+0000","last_became_active":"2024-09-10T23:16:48.019576+0000","last_became_peered":"2024-09-10T23:16:48.019576+0000","last_unstale":"2024-09-10T23:16:48.029981+0000","last_undegraded":"2024-09-10T23:16:48.029981+0000","last_fullsized":"2024-09-10T23:16:48.029981+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:09.128695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.021827+0000","last_change":"2024-09-10T23:16:48.016572+0000","last_active":"2024-09-10T23:16:48.021827+0000","last_peered":"2024-09-10T23:16:48.021827+0000","last_clean":"2024-09-10T23:16:48.021827+0000","last_became_active":"2024-09-10T23:16:48.015617+0000","last_became_peered":"2024-09-10T23:16:48.015617+0000","last_unstale":"2024-09-10T23:16:48.021827+0000","last_undegraded":"2024-09-10T23:16:48.021827+0000","last_fullsized":"2024-09-10T23:16:48.021827+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:50.266043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.002000+0000","last_change":"2024-09-10T23:16:47.016870+0000","last_active":"2024-09-10T23:16:48.002000+0000","last_peered":"2024-09-10T23:16:48.002000+0000","last_clean":"2024-09-10T23:16:48.002000+0000","last_became_active":"2024-09-10T23:16:47.015572+0000","last_became_peered":"2024-09-10T23:16:47.015572+0000","last_unstale":"2024-09-10T23:16:48.002000+0000","last_undegraded":"2024-09-10T23:16:48.002000+0000","last_fullsized":"2024-09-10T23:16:48.002000+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:10.705583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"41'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.041489+0000","last_change":"2024-09-10T23:16:47.015607+0000","last_active":"2024-09-10T23:16:48.041489+0000","last_peered":"2024-09-10T23:16:48.041489+0000","last_clean":"2024-09-10T23:16:48.041489+0000","last_became_active":"2024-09-10T23:16:47.015289+0000","last_became_peered":"2024-09-10T23:16:47.015289+0000","last_unstale":"2024-09-10T23:16:48.041489+0000","last_undegraded":"2024-09-10T23:16:48.041489+0000","last_fullsized":"2024-09-10T23:16:48.041489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:18.566173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"41'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.031106+0000","last_change":"2024-09-10T23:16:47.015854+0000","last_active":"2024-09-10T23:16:48.031106+0000","last_peered":"2024-09-10T23:16:48.031106+0000","last_clean":"2024-09-10T23:16:48.031106+0000","last_became_active":"2024-09-10T23:16:47.015517+0000","last_became_peered":"2024-09-10T23:16:47.015517+0000","last_unstale":"2024-09-10T23:16:48.031106+0000","last_undegraded":"2024-09-10T23:16:48.031106+0000","last_fullsized":"2024-09-10T23:16:48.031106+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:19.682811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.033181+0000","last_change":"2024-09-10T23:16:48.021737+0000","last_active":"2024-09-10T23:16:48.033181+0000","last_peered":"2024-09-10T23:16:48.033181+0000","last_clean":"2024-09-10T23:16:48.033181+0000","last_became_active":"2024-09-10T23:16:48.021476+0000","last_became_peered":"2024-09-10T23:16:48.021476+0000","last_unstale":"2024-09-10T23:16:48.033181+0000","last_undegraded":"2024-09-10T23:16:48.033181+0000","last_fullsized":"2024-09-10T23:16:48.033181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:23.271836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-10T23:16:45.995879+0000","last_change":"2024-09-10T23:16:45.995879+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.995879+0000","last_undegraded":"2024-09-10T23:16:45.995879+0000","last_fullsized":"2024-09-10T23:16:45.995879+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.021848+0000","last_change":"2024-09-10T23:16:48.016877+0000","last_active":"2024-09-10T23:16:48.021848+0000","last_peered":"2024-09-10T23:16:48.021848+0000","last_clean":"2024-09-10T23:16:48.021848+0000","last_became_active":"2024-09-10T23:16:48.015970+0000","last_became_peered":"2024-09-10T23:16:48.015970+0000","last_unstale":"2024-09-10T23:16:48.021848+0000","last_undegraded":"2024-09-10T23:16:48.021848+0000","last_fullsized":"2024-09-10T23:16:48.021848+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:31.175193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.028744+0000","last_change":"2024-09-10T23:16:48.021361+0000","last_active":"2024-09-10T23:16:48.028744+0000","last_peered":"2024-09-10T23:16:48.028744+0000","last_clean":"2024-09-10T23:16:48.028744+0000","last_became_active":"2024-09-10T23:16:48.020917+0000","last_became_peered":"2024-09-10T23:16:48.020917+0000","last_unstale":"2024-09-10T23:16:48.028744+0000","last_undegraded":"2024-09-10T23:16:48.028744+0000","last_fullsized":"2024-09-10T23:16:48.028744+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:35.182647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.021798+0000","last_change":"2024-09-10T23:16:48.016266+0000","last_active":"2024-09-10T23:16:48.021798+0000","last_peered":"2024-09-10T23:16:48.021798+0000","last_clean":"2024-09-10T23:16:48.021798+0000","last_became_active":"2024-09-10T23:16:48.015260+0000","last_became_peered":"2024-09-10T23:16:48.015260+0000","last_unstale":"2024-09-10T23:16:48.021798+0000","last_undegraded":"2024-09-10T23:16:48.021798+0000","last_fullsized":"2024-09-10T23:16:48.021798+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.044939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.026860+0000","last_change":"2024-09-10T23:16:48.017442+0000","last_active":"2024-09-10T23:16:48.026860+0000","last_peered":"2024-09-10T23:16:48.026860+0000","last_clean":"2024-09-10T23:16:48.026860+0000","last_became_active":"2024-09-10T23:16:48.017170+0000","last_became_peered":"2024-09-10T23:16:48.017170+0000","last_unstale":"2024-09-10T23:16:48.026860+0000","last_undegraded":"2024-09-10T23:16:48.026860+0000","last_fullsized":"2024-09-10T23:16:48.026860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:01.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2024-09-10T23:16:45.996250+0000","last_change":"2024-09-10T23:16:45.996250+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.996250+0000","last_undegraded":"2024-09-10T23:16:45.996250+0000","last_fullsized":"2024-09-10T23:16:45.996250+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:47.999493+0000","last_change":"2024-09-10T23:16:47.011389+0000","last_active":"2024-09-10T23:16:47.999493+0000","last_peered":"2024-09-10T23:16:47.999493+0000","last_clean":"2024-09-10T23:16:47.999493+0000","last_became_active":"2024-09-10T23:16:47.011099+0000","last_became_peered":"2024-09-10T23:16:47.011099+0000","last_unstale":"2024-09-10T23:16:47.999493+0000","last_undegraded":"2024-09-10T23:16:47.999493+0000","last_fullsized":"2024-09-10T23:16:47.999493+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:39.754755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:46.986942+0000","last_change":"2024-09-10T23:16:46.986942+0000","last_active":"2024-09-10T23:16:46.986942+0000","last_peered":"2024-09-10T23:16:46.986942+0000","last_clean":"2024-09-10T23:16:46.986942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:46.986942+0000","last_undegraded":"2024-09-10T23:16:46.986942+0000","last_fullsized":"2024-09-10T23:16:46.986942+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:16:45.984119+0000","last_change":"2024-09-10T23:16:45.984119+0000","last_active":"2024-09-10T23:16:45.984119+0000","last_peered":"2024-09-10T23:16:45.984119+0000","last_clean":"2024-09-10T23:16:45.984119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:16:45.984119+0000","last_undegraded":"2024-09-10T23:16:45.984119+0000","last_fullsized":"2024-09-10T23:16:45.984119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":139,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-10T23:16:42.288696+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:16:42.288696+0000","last_peered":"2024-09-10T23:16:42.288696+0000","last_clean":"2024-09-10T23:16:42.288696+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:16:42.288696+0000","last_undegraded":"2024-09-10T23:16:42.288696+0000","last_fullsized":"2024-09-10T23:16:42.288696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1646,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":14,"acting":14,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":178931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":769299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":178931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":178931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":178931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":178931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":769299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":191807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:16:52.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:16:52.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.358+0000 7f115ec00640 1 -- 172.21.15.17:0/1450701421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f113c004d50 msgr2=0x7f113c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.358+0000 7f115ec00640 1 --2- 172.21.15.17:0/1450701421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f113c004d50 0x7f113c0051d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1150009eb0 tx=0x7f115001d5f0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.358+0000 7f115cc00640 1 -- 172.21.15.17:0/1450701421 reap_dead start 2024-09-10T23:16:52.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.358+0000 7f115ec00640 1 -- 172.21.15.17:0/1450701421 shutdown_connections 2024-09-10T23:16:52.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.358+0000 7f115ec00640 1 -- 172.21.15.17:0/1450701421 >> 172.21.15.17:0/1450701421 conn(0x7f11580d1d60 msgr2=0x7f11580d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:52.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.358+0000 7f115ec00640 1 -- 172.21.15.17:0/1450701421 shutdown_connections 2024-09-10T23:16:52.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.358+0000 7f115ec00640 1 -- 172.21.15.17:0/1450701421 wait complete. 2024-09-10T23:16:52.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 Processor -- start 2024-09-10T23:16:52.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 -- start start 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f113c004d50 0x7f115815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11581f3e90 0x7f115806ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115806f450 0x7f11580c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1158071030 con 0x7f113c004d50 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1158070eb0 con 0x7f115806f450 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f11580711b0 con 0x7f11581f3e90 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f113c004d50 0x7f115815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f113c004d50 0x7f115815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51964/0 (socket says 172.21.15.17:51964) 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157e00640 1 -- 172.21.15.17:0/144835584 learned_addr learned my addr 172.21.15.17:0/144835584 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:52.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157400640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11581f3e90 0x7f115806ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115cc00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115806f450 0x7f11580c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157e00640 1 -- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11581f3e90 msgr2=0x7f115806ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157e00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11581f3e90 0x7f115806ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157e00640 1 -- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115806f450 msgr2=0x7f11580c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157e00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115806f450 0x7f11580c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157e00640 1 -- 172.21.15.17:0/144835584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11581595f0 con 0x7f113c004d50 2024-09-10T23:16:52.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157400640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11581f3e90 0x7f115806ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:52.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f1157e00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f113c004d50 0x7f115815bee0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1148001790 tx=0x7f114800e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f114fe00640 1 -- 172.21.15.17:0/144835584 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148012850 con 0x7f113c004d50 2024-09-10T23:16:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f114fe00640 1 -- 172.21.15.17:0/144835584 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1148012ae0 con 0x7f113c004d50 2024-09-10T23:16:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1158159890 con 0x7f113c004d50 2024-09-10T23:16:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f114fe00640 1 -- 172.21.15.17:0/144835584 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114801a400 con 0x7f113c004d50 2024-09-10T23:16:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115806e710 con 0x7f113c004d50 2024-09-10T23:16:52.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.362+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115815f060 con 0x7f113c004d50 2024-09-10T23:16:52.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.366+0000 7f114fe00640 1 -- 172.21.15.17:0/144835584 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1148022030 con 0x7f113c004d50 2024-09-10T23:16:52.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.366+0000 7f114fe00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1138072610 0x7f1138074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.366+0000 7f114fe00640 1 -- 172.21.15.17:0/144835584 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7f11480964f0 con 0x7f113c004d50 2024-09-10T23:16:52.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.366+0000 7f1157400640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1138072610 0x7f1138074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.366+0000 7f1157400640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1138072610 0x7f1138074ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11580b2b30 tx=0x7f11440091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.370+0000 7f114fe00640 1 -- 172.21.15.17:0/144835584 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1148016030 con 0x7f113c004d50 2024-09-10T23:16:52.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.538+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f115815cf20 con 0x7f1138072610 2024-09-10T23:16:52.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.542+0000 7f114fe00640 1 -- 172.21.15.17:0/144835584 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f115815cf20 con 0x7f1138072610 2024-09-10T23:16:52.550 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1138072610 msgr2=0x7f1138074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1138072610 0x7f1138074ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11580b2b30 tx=0x7f11440091e0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f113c004d50 msgr2=0x7f115815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f113c004d50 0x7f115815bee0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1148001790 tx=0x7f114800e6b0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 shutdown_connections 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1138072610 0x7f1138074ad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f115806f450 0x7f11580c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11581f3e90 0x7f115806ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 --2- 172.21.15.17:0/144835584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f113c004d50 0x7f115815bee0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 >> 172.21.15.17:0/144835584 conn(0x7f11580d1d60 msgr2=0x7f11580b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 shutdown_connections 2024-09-10T23:16:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.546+0000 7f115ec00640 1 -- 172.21.15.17:0/144835584 wait complete. 2024-09-10T23:16:52.571 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-09-10T23:16:52.309976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237816,"kb_used_data":4928,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736904,"statfs":{"total":773094113280,"available":772850589696,"internally_reserved":0,"allocated":5046272,"data_stored":2815379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001056"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.030008+0000","last_change":"2024-09-10T23:16:48.021447+0000","last_active":"2024-09-10T23:16:48.030008+0000","last_peered":"2024-09-10T23:16:48.030008+0000","last_clean":"2024-09-10T23:16:48.030008+0000","last_became_active":"2024-09-10T23:16:48.021172+0000","last_became_peered":"2024-09-10T23:16:48.021172+0000","last_unstale":"2024-09-10T23:16:48.030008+0000","last_undegraded":"2024-09-10T23:16:48.030008+0000","last_fullsized":"2024-09-10T23:16:48.030008+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:42.269668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.033888+0000","last_change":"2024-09-10T23:16:48.026962+0000","last_active":"2024-09-10T23:16:48.033888+0000","last_peered":"2024-09-10T23:16:48.033888+0000","last_clean":"2024-09-10T23:16:48.033888+0000","last_became_active":"2024-09-10T23:16:48.026671+0000","last_became_peered":"2024-09-10T23:16:48.026671+0000","last_unstale":"2024-09-10T23:16:48.033888+0000","last_undegraded":"2024-09-10T23:16:48.033888+0000","last_fullsized":"2024-09-10T23:16:48.033888+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:27.580510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162329+0000","last_change":"2024-09-10T23:16:48.014816+0000","last_active":"2024-09-10T23:16:49.162329+0000","last_peered":"2024-09-10T23:16:49.162329+0000","last_clean":"2024-09-10T23:16:49.162329+0000","last_became_active":"2024-09-10T23:16:48.014540+0000","last_became_peered":"2024-09-10T23:16:48.014540+0000","last_unstale":"2024-09-10T23:16:49.162329+0000","last_undegraded":"2024-09-10T23:16:49.162329+0000","last_fullsized":"2024-09-10T23:16:49.162329+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:10.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162866+0000","last_change":"2024-09-10T23:16:48.023138+0000","last_active":"2024-09-10T23:16:49.162866+0000","last_peered":"2024-09-10T23:16:49.162866+0000","last_clean":"2024-09-10T23:16:49.162866+0000","last_became_active":"2024-09-10T23:16:48.022858+0000","last_became_peered":"2024-09-10T23:16:48.022858+0000","last_unstale":"2024-09-10T23:16:49.162866+0000","last_undegraded":"2024-09-10T23:16:49.162866+0000","last_fullsized":"2024-09-10T23:16:49.162866+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:00.304986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162755+0000","last_change":"2024-09-10T23:16:48.024542+0000","last_active":"2024-09-10T23:16:49.162755+0000","last_peered":"2024-09-10T23:16:49.162755+0000","last_clean":"2024-09-10T23:16:49.162755+0000","last_became_active":"2024-09-10T23:16:48.024293+0000","last_became_peered":"2024-09-10T23:16:48.024293+0000","last_unstale":"2024-09-10T23:16:49.162755+0000","last_undegraded":"2024-09-10T23:16:49.162755+0000","last_fullsized":"2024-09-10T23:16:49.162755+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:23.172180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017196+0000","last_change":"2024-09-10T23:16:48.022698+0000","last_active":"2024-09-10T23:16:49.017196+0000","last_peered":"2024-09-10T23:16:49.017196+0000","last_clean":"2024-09-10T23:16:49.017196+0000","last_became_active":"2024-09-10T23:16:48.022248+0000","last_became_peered":"2024-09-10T23:16:48.022248+0000","last_unstale":"2024-09-10T23:16:49.017196+0000","last_undegraded":"2024-09-10T23:16:49.017196+0000","last_fullsized":"2024-09-10T23:16:49.017196+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:42.042454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164326+0000","last_change":"2024-09-10T23:16:48.022346+0000","last_active":"2024-09-10T23:16:49.164326+0000","last_peered":"2024-09-10T23:16:49.164326+0000","last_clean":"2024-09-10T23:16:49.164326+0000","last_became_active":"2024-09-10T23:16:48.022023+0000","last_became_peered":"2024-09-10T23:16:48.022023+0000","last_unstale":"2024-09-10T23:16:49.164326+0000","last_undegraded":"2024-09-10T23:16:49.164326+0000","last_fullsized":"2024-09-10T23:16:49.164326+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:24.366848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.020553+0000","last_change":"2024-09-10T23:16:48.015268+0000","last_active":"2024-09-10T23:16:48.020553+0000","last_peered":"2024-09-10T23:16:48.020553+0000","last_clean":"2024-09-10T23:16:48.020553+0000","last_became_active":"2024-09-10T23:16:48.014989+0000","last_became_peered":"2024-09-10T23:16:48.014989+0000","last_unstale":"2024-09-10T23:16:48.020553+0000","last_undegraded":"2024-09-10T23:16:48.020553+0000","last_fullsized":"2024-09-10T23:16:48.020553+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:45.577598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163459+0000","last_change":"2024-09-10T23:16:48.020083+0000","last_active":"2024-09-10T23:16:49.163459+0000","last_peered":"2024-09-10T23:16:49.163459+0000","last_clean":"2024-09-10T23:16:49.163459+0000","last_became_active":"2024-09-10T23:16:48.018093+0000","last_became_peered":"2024-09-10T23:16:48.018093+0000","last_unstale":"2024-09-10T23:16:49.163459+0000","last_undegraded":"2024-09-10T23:16:49.163459+0000","last_fullsized":"2024-09-10T23:16:49.163459+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:19.471531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163757+0000","last_change":"2024-09-10T23:16:48.030653+0000","last_active":"2024-09-10T23:16:49.163757+0000","last_peered":"2024-09-10T23:16:49.163757+0000","last_clean":"2024-09-10T23:16:49.163757+0000","last_became_active":"2024-09-10T23:16:48.024601+0000","last_became_peered":"2024-09-10T23:16:48.024601+0000","last_unstale":"2024-09-10T23:16:49.163757+0000","last_undegraded":"2024-09-10T23:16:49.163757+0000","last_fullsized":"2024-09-10T23:16:49.163757+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:20.176508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163770+0000","last_change":"2024-09-10T23:16:48.028785+0000","last_active":"2024-09-10T23:16:49.163770+0000","last_peered":"2024-09-10T23:16:49.163770+0000","last_clean":"2024-09-10T23:16:49.163770+0000","last_became_active":"2024-09-10T23:16:48.028525+0000","last_became_peered":"2024-09-10T23:16:48.028525+0000","last_unstale":"2024-09-10T23:16:49.163770+0000","last_undegraded":"2024-09-10T23:16:49.163770+0000","last_fullsized":"2024-09-10T23:16:49.163770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:39.717119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162499+0000","last_change":"2024-09-10T23:16:48.035483+0000","last_active":"2024-09-10T23:16:49.162499+0000","last_peered":"2024-09-10T23:16:49.162499+0000","last_clean":"2024-09-10T23:16:49.162499+0000","last_became_active":"2024-09-10T23:16:48.035201+0000","last_became_peered":"2024-09-10T23:16:48.035201+0000","last_unstale":"2024-09-10T23:16:49.162499+0000","last_undegraded":"2024-09-10T23:16:49.162499+0000","last_fullsized":"2024-09-10T23:16:49.162499+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:59.199666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162715+0000","last_change":"2024-09-10T23:16:48.017944+0000","last_active":"2024-09-10T23:16:49.162715+0000","last_peered":"2024-09-10T23:16:49.162715+0000","last_clean":"2024-09-10T23:16:49.162715+0000","last_became_active":"2024-09-10T23:16:48.017400+0000","last_became_peered":"2024-09-10T23:16:48.017400+0000","last_unstale":"2024-09-10T23:16:49.162715+0000","last_undegraded":"2024-09-10T23:16:49.162715+0000","last_fullsized":"2024-09-10T23:16:49.162715+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:44.817795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.018004+0000","last_change":"2024-09-10T23:16:48.025348+0000","last_active":"2024-09-10T23:16:49.018004+0000","last_peered":"2024-09-10T23:16:49.018004+0000","last_clean":"2024-09-10T23:16:49.018004+0000","last_became_active":"2024-09-10T23:16:48.025087+0000","last_became_peered":"2024-09-10T23:16:48.025087+0000","last_unstale":"2024-09-10T23:16:49.018004+0000","last_undegraded":"2024-09-10T23:16:49.018004+0000","last_fullsized":"2024-09-10T23:16:49.018004+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:00.258019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164567+0000","last_change":"2024-09-10T23:16:48.034778+0000","last_active":"2024-09-10T23:16:49.164567+0000","last_peered":"2024-09-10T23:16:49.164567+0000","last_clean":"2024-09-10T23:16:49.164567+0000","last_became_active":"2024-09-10T23:16:48.034485+0000","last_became_peered":"2024-09-10T23:16:48.034485+0000","last_unstale":"2024-09-10T23:16:49.164567+0000","last_undegraded":"2024-09-10T23:16:49.164567+0000","last_fullsized":"2024-09-10T23:16:49.164567+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:23.847070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163508+0000","last_change":"2024-09-10T23:16:48.018574+0000","last_active":"2024-09-10T23:16:49.163508+0000","last_peered":"2024-09-10T23:16:49.163508+0000","last_clean":"2024-09-10T23:16:49.163508+0000","last_became_active":"2024-09-10T23:16:48.018254+0000","last_became_peered":"2024-09-10T23:16:48.018254+0000","last_unstale":"2024-09-10T23:16:49.163508+0000","last_undegraded":"2024-09-10T23:16:49.163508+0000","last_fullsized":"2024-09-10T23:16:49.163508+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:45.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163506+0000","last_change":"2024-09-10T23:16:48.018743+0000","last_active":"2024-09-10T23:16:49.163506+0000","last_peered":"2024-09-10T23:16:49.163506+0000","last_clean":"2024-09-10T23:16:49.163506+0000","last_became_active":"2024-09-10T23:16:48.018472+0000","last_became_peered":"2024-09-10T23:16:48.018472+0000","last_unstale":"2024-09-10T23:16:49.163506+0000","last_undegraded":"2024-09-10T23:16:49.163506+0000","last_fullsized":"2024-09-10T23:16:49.163506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:30.629812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164817+0000","last_change":"2024-09-10T23:16:48.024288+0000","last_active":"2024-09-10T23:16:49.164817+0000","last_peered":"2024-09-10T23:16:49.164817+0000","last_clean":"2024-09-10T23:16:49.164817+0000","last_became_active":"2024-09-10T23:16:48.023482+0000","last_became_peered":"2024-09-10T23:16:48.023482+0000","last_unstale":"2024-09-10T23:16:49.164817+0000","last_undegraded":"2024-09-10T23:16:49.164817+0000","last_fullsized":"2024-09-10T23:16:49.164817+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:56.074249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163102+0000","last_change":"2024-09-10T23:16:48.029702+0000","last_active":"2024-09-10T23:16:49.163102+0000","last_peered":"2024-09-10T23:16:49.163102+0000","last_clean":"2024-09-10T23:16:49.163102+0000","last_became_active":"2024-09-10T23:16:48.027493+0000","last_became_peered":"2024-09-10T23:16:48.027493+0000","last_unstale":"2024-09-10T23:16:49.163102+0000","last_undegraded":"2024-09-10T23:16:49.163102+0000","last_fullsized":"2024-09-10T23:16:49.163102+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:23.930181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164604+0000","last_change":"2024-09-10T23:16:48.024667+0000","last_active":"2024-09-10T23:16:49.164604+0000","last_peered":"2024-09-10T23:16:49.164604+0000","last_clean":"2024-09-10T23:16:49.164604+0000","last_became_active":"2024-09-10T23:16:48.024256+0000","last_became_peered":"2024-09-10T23:16:48.024256+0000","last_unstale":"2024-09-10T23:16:49.164604+0000","last_undegraded":"2024-09-10T23:16:49.164604+0000","last_fullsized":"2024-09-10T23:16:49.164604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:34.122607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162913+0000","last_change":"2024-09-10T23:16:48.027592+0000","last_active":"2024-09-10T23:16:49.162913+0000","last_peered":"2024-09-10T23:16:49.162913+0000","last_clean":"2024-09-10T23:16:49.162913+0000","last_became_active":"2024-09-10T23:16:48.027216+0000","last_became_peered":"2024-09-10T23:16:48.027216+0000","last_unstale":"2024-09-10T23:16:49.162913+0000","last_undegraded":"2024-09-10T23:16:49.162913+0000","last_fullsized":"2024-09-10T23:16:49.162913+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:51.770366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.018299+0000","last_change":"2024-09-10T23:16:48.024017+0000","last_active":"2024-09-10T23:16:49.018299+0000","last_peered":"2024-09-10T23:16:49.018299+0000","last_clean":"2024-09-10T23:16:49.018299+0000","last_became_active":"2024-09-10T23:16:48.023641+0000","last_became_peered":"2024-09-10T23:16:48.023641+0000","last_unstale":"2024-09-10T23:16:49.018299+0000","last_undegraded":"2024-09-10T23:16:49.018299+0000","last_fullsized":"2024-09-10T23:16:49.018299+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:55.114890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162563+0000","last_change":"2024-09-10T23:16:48.026682+0000","last_active":"2024-09-10T23:16:49.162563+0000","last_peered":"2024-09-10T23:16:49.162563+0000","last_clean":"2024-09-10T23:16:49.162563+0000","last_became_active":"2024-09-10T23:16:48.025354+0000","last_became_peered":"2024-09-10T23:16:48.025354+0000","last_unstale":"2024-09-10T23:16:49.162563+0000","last_undegraded":"2024-09-10T23:16:49.162563+0000","last_fullsized":"2024-09-10T23:16:49.162563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:32.030976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162833+0000","last_change":"2024-09-10T23:16:48.023922+0000","last_active":"2024-09-10T23:16:49.162833+0000","last_peered":"2024-09-10T23:16:49.162833+0000","last_clean":"2024-09-10T23:16:49.162833+0000","last_became_active":"2024-09-10T23:16:48.023356+0000","last_became_peered":"2024-09-10T23:16:48.023356+0000","last_unstale":"2024-09-10T23:16:49.162833+0000","last_undegraded":"2024-09-10T23:16:49.162833+0000","last_fullsized":"2024-09-10T23:16:49.162833+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:03.111751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164924+0000","last_change":"2024-09-10T23:16:48.025589+0000","last_active":"2024-09-10T23:16:49.164924+0000","last_peered":"2024-09-10T23:16:49.164924+0000","last_clean":"2024-09-10T23:16:49.164924+0000","last_became_active":"2024-09-10T23:16:48.025272+0000","last_became_peered":"2024-09-10T23:16:48.025272+0000","last_unstale":"2024-09-10T23:16:49.164924+0000","last_undegraded":"2024-09-10T23:16:49.164924+0000","last_fullsized":"2024-09-10T23:16:49.164924+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:18.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017587+0000","last_change":"2024-09-10T23:16:48.024235+0000","last_active":"2024-09-10T23:16:49.017587+0000","last_peered":"2024-09-10T23:16:49.017587+0000","last_clean":"2024-09-10T23:16:49.017587+0000","last_became_active":"2024-09-10T23:16:48.023940+0000","last_became_peered":"2024-09-10T23:16:48.023940+0000","last_unstale":"2024-09-10T23:16:49.017587+0000","last_undegraded":"2024-09-10T23:16:49.017587+0000","last_fullsized":"2024-09-10T23:16:49.017587+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:10.994782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164682+0000","last_change":"2024-09-10T23:16:48.035186+0000","last_active":"2024-09-10T23:16:49.164682+0000","last_peered":"2024-09-10T23:16:49.164682+0000","last_clean":"2024-09-10T23:16:49.164682+0000","last_became_active":"2024-09-10T23:16:48.034957+0000","last_became_peered":"2024-09-10T23:16:48.034957+0000","last_unstale":"2024-09-10T23:16:49.164682+0000","last_undegraded":"2024-09-10T23:16:49.164682+0000","last_fullsized":"2024-09-10T23:16:49.164682+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:09.840084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163590+0000","last_change":"2024-09-10T23:16:48.031205+0000","last_active":"2024-09-10T23:16:49.163590+0000","last_peered":"2024-09-10T23:16:49.163590+0000","last_clean":"2024-09-10T23:16:49.163590+0000","last_became_active":"2024-09-10T23:16:48.030934+0000","last_became_peered":"2024-09-10T23:16:48.030934+0000","last_unstale":"2024-09-10T23:16:49.163590+0000","last_undegraded":"2024-09-10T23:16:49.163590+0000","last_fullsized":"2024-09-10T23:16:49.163590+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:45.316680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164563+0000","last_change":"2024-09-10T23:16:48.021791+0000","last_active":"2024-09-10T23:16:49.164563+0000","last_peered":"2024-09-10T23:16:49.164563+0000","last_clean":"2024-09-10T23:16:49.164563+0000","last_became_active":"2024-09-10T23:16:48.021519+0000","last_became_peered":"2024-09-10T23:16:48.021519+0000","last_unstale":"2024-09-10T23:16:49.164563+0000","last_undegraded":"2024-09-10T23:16:49.164563+0000","last_fullsized":"2024-09-10T23:16:49.164563+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:13.910469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164037+0000","last_change":"2024-09-10T23:16:48.016810+0000","last_active":"2024-09-10T23:16:49.164037+0000","last_peered":"2024-09-10T23:16:49.164037+0000","last_clean":"2024-09-10T23:16:49.164037+0000","last_became_active":"2024-09-10T23:16:48.016550+0000","last_became_peered":"2024-09-10T23:16:48.016550+0000","last_unstale":"2024-09-10T23:16:49.164037+0000","last_undegraded":"2024-09-10T23:16:49.164037+0000","last_fullsized":"2024-09-10T23:16:49.164037+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:06.179292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162624+0000","last_change":"2024-09-10T23:16:48.025427+0000","last_active":"2024-09-10T23:16:49.162624+0000","last_peered":"2024-09-10T23:16:49.162624+0000","last_clean":"2024-09-10T23:16:49.162624+0000","last_became_active":"2024-09-10T23:16:48.025126+0000","last_became_peered":"2024-09-10T23:16:48.025126+0000","last_unstale":"2024-09-10T23:16:49.162624+0000","last_undegraded":"2024-09-10T23:16:49.162624+0000","last_fullsized":"2024-09-10T23:16:49.162624+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:19.471531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017131+0000","last_change":"2024-09-10T23:16:48.034065+0000","last_active":"2024-09-10T23:16:49.017131+0000","last_peered":"2024-09-10T23:16:49.017131+0000","last_clean":"2024-09-10T23:16:49.017131+0000","last_became_active":"2024-09-10T23:16:48.033295+0000","last_became_peered":"2024-09-10T23:16:48.033295+0000","last_unstale":"2024-09-10T23:16:49.017131+0000","last_undegraded":"2024-09-10T23:16:49.017131+0000","last_fullsized":"2024-09-10T23:16:49.017131+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:36.581159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162911+0000","last_change":"2024-09-10T23:16:48.018061+0000","last_active":"2024-09-10T23:16:49.162911+0000","last_peered":"2024-09-10T23:16:49.162911+0000","last_clean":"2024-09-10T23:16:49.162911+0000","last_became_active":"2024-09-10T23:16:48.017768+0000","last_became_peered":"2024-09-10T23:16:48.017768+0000","last_unstale":"2024-09-10T23:16:49.162911+0000","last_undegraded":"2024-09-10T23:16:49.162911+0000","last_fullsized":"2024-09-10T23:16:49.162911+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:35.876689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"41'4","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164827+0000","last_change":"2024-09-10T23:16:47.018241+0000","last_active":"2024-09-10T23:16:49.164827+0000","last_peered":"2024-09-10T23:16:49.164827+0000","last_clean":"2024-09-10T23:16:49.164827+0000","last_became_active":"2024-09-10T23:16:47.017993+0000","last_became_peered":"2024-09-10T23:16:47.017993+0000","last_unstale":"2024-09-10T23:16:49.164827+0000","last_undegraded":"2024-09-10T23:16:49.164827+0000","last_fullsized":"2024-09-10T23:16:49.164827+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:46.780787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017686+0000","last_change":"2024-09-10T23:16:48.021715+0000","last_active":"2024-09-10T23:16:49.017686+0000","last_peered":"2024-09-10T23:16:49.017686+0000","last_clean":"2024-09-10T23:16:49.017686+0000","last_became_active":"2024-09-10T23:16:48.021113+0000","last_became_peered":"2024-09-10T23:16:48.021113+0000","last_unstale":"2024-09-10T23:16:49.017686+0000","last_undegraded":"2024-09-10T23:16:49.017686+0000","last_fullsized":"2024-09-10T23:16:49.017686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:55:10.659159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"41'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162995+0000","last_change":"2024-09-10T23:16:47.022975+0000","last_active":"2024-09-10T23:16:49.162995+0000","last_peered":"2024-09-10T23:16:49.162995+0000","last_clean":"2024-09-10T23:16:49.162995+0000","last_became_active":"2024-09-10T23:16:47.022712+0000","last_became_peered":"2024-09-10T23:16:47.022712+0000","last_unstale":"2024-09-10T23:16:49.162995+0000","last_undegraded":"2024-09-10T23:16:49.162995+0000","last_fullsized":"2024-09-10T23:16:49.162995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:52.802631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.018936+0000","last_change":"2024-09-10T23:16:48.034923+0000","last_active":"2024-09-10T23:16:49.018936+0000","last_peered":"2024-09-10T23:16:49.018936+0000","last_clean":"2024-09-10T23:16:49.018936+0000","last_became_active":"2024-09-10T23:16:48.033978+0000","last_became_peered":"2024-09-10T23:16:48.033978+0000","last_unstale":"2024-09-10T23:16:49.018936+0000","last_undegraded":"2024-09-10T23:16:49.018936+0000","last_fullsized":"2024-09-10T23:16:49.018936+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:59.199666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"41'2","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017645+0000","last_change":"2024-09-10T23:16:47.020248+0000","last_active":"2024-09-10T23:16:49.017645+0000","last_peered":"2024-09-10T23:16:49.017645+0000","last_clean":"2024-09-10T23:16:49.017645+0000","last_became_active":"2024-09-10T23:16:47.019980+0000","last_became_peered":"2024-09-10T23:16:47.019980+0000","last_unstale":"2024-09-10T23:16:49.017645+0000","last_undegraded":"2024-09-10T23:16:49.017645+0000","last_fullsized":"2024-09-10T23:16:49.017645+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.547597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.029981+0000","last_change":"2024-09-10T23:16:48.019831+0000","last_active":"2024-09-10T23:16:48.029981+0000","last_peered":"2024-09-10T23:16:48.029981+0000","last_clean":"2024-09-10T23:16:48.029981+0000","last_became_active":"2024-09-10T23:16:48.019576+0000","last_became_peered":"2024-09-10T23:16:48.019576+0000","last_unstale":"2024-09-10T23:16:48.029981+0000","last_undegraded":"2024-09-10T23:16:48.029981+0000","last_fullsized":"2024-09-10T23:16:48.029981+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:09.128695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"41'2","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.018739+0000","last_change":"2024-09-10T23:16:47.009451+0000","last_active":"2024-09-10T23:16:49.018739+0000","last_peered":"2024-09-10T23:16:49.018739+0000","last_clean":"2024-09-10T23:16:49.018739+0000","last_became_active":"2024-09-10T23:16:47.007750+0000","last_became_peered":"2024-09-10T23:16:47.007750+0000","last_unstale":"2024-09-10T23:16:49.018739+0000","last_undegraded":"2024-09-10T23:16:49.018739+0000","last_fullsized":"2024-09-10T23:16:49.018739+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:11.839857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163167+0000","last_change":"2024-09-10T23:16:48.026380+0000","last_active":"2024-09-10T23:16:49.163167+0000","last_peered":"2024-09-10T23:16:49.163167+0000","last_clean":"2024-09-10T23:16:49.163167+0000","last_became_active":"2024-09-10T23:16:48.026104+0000","last_became_peered":"2024-09-10T23:16:48.026104+0000","last_unstale":"2024-09-10T23:16:49.163167+0000","last_undegraded":"2024-09-10T23:16:49.163167+0000","last_fullsized":"2024-09-10T23:16:49.163167+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:32.030976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"41'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163022+0000","last_change":"2024-09-10T23:16:47.015750+0000","last_active":"2024-09-10T23:16:49.163022+0000","last_peered":"2024-09-10T23:16:49.163022+0000","last_clean":"2024-09-10T23:16:49.163022+0000","last_became_active":"2024-09-10T23:16:47.015456+0000","last_became_peered":"2024-09-10T23:16:47.015456+0000","last_unstale":"2024-09-10T23:16:49.163022+0000","last_undegraded":"2024-09-10T23:16:49.163022+0000","last_fullsized":"2024-09-10T23:16:49.163022+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:12.907645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164733+0000","last_change":"2024-09-10T23:16:48.027610+0000","last_active":"2024-09-10T23:16:49.164733+0000","last_peered":"2024-09-10T23:16:49.164733+0000","last_clean":"2024-09-10T23:16:49.164733+0000","last_became_active":"2024-09-10T23:16:48.027338+0000","last_became_peered":"2024-09-10T23:16:48.027338+0000","last_unstale":"2024-09-10T23:16:49.164733+0000","last_undegraded":"2024-09-10T23:16:49.164733+0000","last_fullsized":"2024-09-10T23:16:49.164733+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:27.752957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"41'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162685+0000","last_change":"2024-09-10T23:16:47.023715+0000","last_active":"2024-09-10T23:16:49.162685+0000","last_peered":"2024-09-10T23:16:49.162685+0000","last_clean":"2024-09-10T23:16:49.162685+0000","last_became_active":"2024-09-10T23:16:47.023443+0000","last_became_peered":"2024-09-10T23:16:47.023443+0000","last_unstale":"2024-09-10T23:16:49.162685+0000","last_undegraded":"2024-09-10T23:16:49.162685+0000","last_fullsized":"2024-09-10T23:16:49.162685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:19:33.755733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.018353+0000","last_change":"2024-09-10T23:16:48.017976+0000","last_active":"2024-09-10T23:16:49.018353+0000","last_peered":"2024-09-10T23:16:49.018353+0000","last_clean":"2024-09-10T23:16:49.018353+0000","last_became_active":"2024-09-10T23:16:48.017733+0000","last_became_peered":"2024-09-10T23:16:48.017733+0000","last_unstale":"2024-09-10T23:16:49.018353+0000","last_undegraded":"2024-09-10T23:16:49.018353+0000","last_fullsized":"2024-09-10T23:16:49.018353+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:10.198113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017090+0000","last_change":"2024-09-10T23:16:47.022527+0000","last_active":"2024-09-10T23:16:49.017090+0000","last_peered":"2024-09-10T23:16:49.017090+0000","last_clean":"2024-09-10T23:16:49.017090+0000","last_became_active":"2024-09-10T23:16:47.022259+0000","last_became_peered":"2024-09-10T23:16:47.022259+0000","last_unstale":"2024-09-10T23:16:49.017090+0000","last_undegraded":"2024-09-10T23:16:49.017090+0000","last_fullsized":"2024-09-10T23:16:49.017090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:22.927358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.021827+0000","last_change":"2024-09-10T23:16:48.016572+0000","last_active":"2024-09-10T23:16:48.021827+0000","last_peered":"2024-09-10T23:16:48.021827+0000","last_clean":"2024-09-10T23:16:48.021827+0000","last_became_active":"2024-09-10T23:16:48.015617+0000","last_became_peered":"2024-09-10T23:16:48.015617+0000","last_unstale":"2024-09-10T23:16:48.021827+0000","last_undegraded":"2024-09-10T23:16:48.021827+0000","last_fullsized":"2024-09-10T23:16:48.021827+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:50.266043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017830+0000","last_change":"2024-09-10T23:16:47.022794+0000","last_active":"2024-09-10T23:16:49.017830+0000","last_peered":"2024-09-10T23:16:49.017830+0000","last_clean":"2024-09-10T23:16:49.017830+0000","last_became_active":"2024-09-10T23:16:47.022541+0000","last_became_peered":"2024-09-10T23:16:47.022541+0000","last_unstale":"2024-09-10T23:16:49.017830+0000","last_undegraded":"2024-09-10T23:16:49.017830+0000","last_fullsized":"2024-09-10T23:16:49.017830+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:46.780787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162852+0000","last_change":"2024-09-10T23:16:48.027021+0000","last_active":"2024-09-10T23:16:49.162852+0000","last_peered":"2024-09-10T23:16:49.162852+0000","last_clean":"2024-09-10T23:16:49.162852+0000","last_became_active":"2024-09-10T23:16:48.022973+0000","last_became_peered":"2024-09-10T23:16:48.022973+0000","last_unstale":"2024-09-10T23:16:49.162852+0000","last_undegraded":"2024-09-10T23:16:49.162852+0000","last_fullsized":"2024-09-10T23:16:49.162852+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:14.267841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.002000+0000","last_change":"2024-09-10T23:16:47.016870+0000","last_active":"2024-09-10T23:16:48.002000+0000","last_peered":"2024-09-10T23:16:48.002000+0000","last_clean":"2024-09-10T23:16:48.002000+0000","last_became_active":"2024-09-10T23:16:47.015572+0000","last_became_peered":"2024-09-10T23:16:47.015572+0000","last_unstale":"2024-09-10T23:16:48.002000+0000","last_undegraded":"2024-09-10T23:16:48.002000+0000","last_fullsized":"2024-09-10T23:16:48.002000+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:10.705583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163081+0000","last_change":"2024-09-10T23:16:48.021810+0000","last_active":"2024-09-10T23:16:49.163081+0000","last_peered":"2024-09-10T23:16:49.163081+0000","last_clean":"2024-09-10T23:16:49.163081+0000","last_became_active":"2024-09-10T23:16:48.021561+0000","last_became_peered":"2024-09-10T23:16:48.021561+0000","last_unstale":"2024-09-10T23:16:49.163081+0000","last_undegraded":"2024-09-10T23:16:49.163081+0000","last_fullsized":"2024-09-10T23:16:49.163081+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:56.366068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163984+0000","last_change":"2024-09-10T23:16:47.017213+0000","last_active":"2024-09-10T23:16:49.163984+0000","last_peered":"2024-09-10T23:16:49.163984+0000","last_clean":"2024-09-10T23:16:49.163984+0000","last_became_active":"2024-09-10T23:16:47.016956+0000","last_became_peered":"2024-09-10T23:16:47.016956+0000","last_unstale":"2024-09-10T23:16:49.163984+0000","last_undegraded":"2024-09-10T23:16:49.163984+0000","last_fullsized":"2024-09-10T23:16:49.163984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:05.176468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162582+0000","last_change":"2024-09-10T23:16:48.021667+0000","last_active":"2024-09-10T23:16:49.162582+0000","last_peered":"2024-09-10T23:16:49.162582+0000","last_clean":"2024-09-10T23:16:49.162582+0000","last_became_active":"2024-09-10T23:16:48.021406+0000","last_became_peered":"2024-09-10T23:16:48.021406+0000","last_unstale":"2024-09-10T23:16:49.162582+0000","last_undegraded":"2024-09-10T23:16:49.162582+0000","last_fullsized":"2024-09-10T23:16:49.162582+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:47.938021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"41'3","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164086+0000","last_change":"2024-09-10T23:16:47.018889+0000","last_active":"2024-09-10T23:16:49.164086+0000","last_peered":"2024-09-10T23:16:49.164086+0000","last_clean":"2024-09-10T23:16:49.164086+0000","last_became_active":"2024-09-10T23:16:47.018619+0000","last_became_peered":"2024-09-10T23:16:47.018619+0000","last_unstale":"2024-09-10T23:16:49.164086+0000","last_undegraded":"2024-09-10T23:16:49.164086+0000","last_fullsized":"2024-09-10T23:16:49.164086+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:52.802631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.018935+0000","last_change":"2024-09-10T23:16:48.034261+0000","last_active":"2024-09-10T23:16:49.018935+0000","last_peered":"2024-09-10T23:16:49.018935+0000","last_clean":"2024-09-10T23:16:49.018935+0000","last_became_active":"2024-09-10T23:16:48.033918+0000","last_became_peered":"2024-09-10T23:16:48.033918+0000","last_unstale":"2024-09-10T23:16:49.018935+0000","last_undegraded":"2024-09-10T23:16:49.018935+0000","last_fullsized":"2024-09-10T23:16:49.018935+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:09.323354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"41'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.041489+0000","last_change":"2024-09-10T23:16:47.015607+0000","last_active":"2024-09-10T23:16:48.041489+0000","last_peered":"2024-09-10T23:16:48.041489+0000","last_clean":"2024-09-10T23:16:48.041489+0000","last_became_active":"2024-09-10T23:16:47.015289+0000","last_became_peered":"2024-09-10T23:16:47.015289+0000","last_unstale":"2024-09-10T23:16:48.041489+0000","last_undegraded":"2024-09-10T23:16:48.041489+0000","last_fullsized":"2024-09-10T23:16:48.041489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:18.566173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162169+0000","last_change":"2024-09-10T23:16:48.020900+0000","last_active":"2024-09-10T23:16:49.162169+0000","last_peered":"2024-09-10T23:16:49.162169+0000","last_clean":"2024-09-10T23:16:49.162169+0000","last_became_active":"2024-09-10T23:16:48.020576+0000","last_became_peered":"2024-09-10T23:16:48.020576+0000","last_unstale":"2024-09-10T23:16:49.162169+0000","last_undegraded":"2024-09-10T23:16:49.162169+0000","last_fullsized":"2024-09-10T23:16:49.162169+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:36.581159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"41'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.031106+0000","last_change":"2024-09-10T23:16:47.015854+0000","last_active":"2024-09-10T23:16:48.031106+0000","last_peered":"2024-09-10T23:16:48.031106+0000","last_clean":"2024-09-10T23:16:48.031106+0000","last_became_active":"2024-09-10T23:16:47.015517+0000","last_became_peered":"2024-09-10T23:16:47.015517+0000","last_unstale":"2024-09-10T23:16:48.031106+0000","last_undegraded":"2024-09-10T23:16:48.031106+0000","last_fullsized":"2024-09-10T23:16:48.031106+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:19.682811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.033181+0000","last_change":"2024-09-10T23:16:48.021737+0000","last_active":"2024-09-10T23:16:48.033181+0000","last_peered":"2024-09-10T23:16:48.033181+0000","last_clean":"2024-09-10T23:16:48.033181+0000","last_became_active":"2024-09-10T23:16:48.021476+0000","last_became_peered":"2024-09-10T23:16:48.021476+0000","last_unstale":"2024-09-10T23:16:48.033181+0000","last_undegraded":"2024-09-10T23:16:48.033181+0000","last_fullsized":"2024-09-10T23:16:48.033181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:23.271836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017340+0000","last_change":"2024-09-10T23:16:47.023282+0000","last_active":"2024-09-10T23:16:49.017340+0000","last_peered":"2024-09-10T23:16:49.017340+0000","last_clean":"2024-09-10T23:16:49.017340+0000","last_became_active":"2024-09-10T23:16:47.023036+0000","last_became_peered":"2024-09-10T23:16:47.023036+0000","last_unstale":"2024-09-10T23:16:49.017340+0000","last_undegraded":"2024-09-10T23:16:49.017340+0000","last_fullsized":"2024-09-10T23:16:49.017340+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:40.400265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162528+0000","last_change":"2024-09-10T23:16:48.026118+0000","last_active":"2024-09-10T23:16:49.162528+0000","last_peered":"2024-09-10T23:16:49.162528+0000","last_clean":"2024-09-10T23:16:49.162528+0000","last_became_active":"2024-09-10T23:16:48.025841+0000","last_became_peered":"2024-09-10T23:16:48.025841+0000","last_unstale":"2024-09-10T23:16:49.162528+0000","last_undegraded":"2024-09-10T23:16:49.162528+0000","last_fullsized":"2024-09-10T23:16:49.162528+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:47.938021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163849+0000","last_change":"2024-09-10T23:16:47.016573+0000","last_active":"2024-09-10T23:16:49.163849+0000","last_peered":"2024-09-10T23:16:49.163849+0000","last_clean":"2024-09-10T23:16:49.163849+0000","last_became_active":"2024-09-10T23:16:47.016314+0000","last_became_peered":"2024-09-10T23:16:47.016314+0000","last_unstale":"2024-09-10T23:16:49.163849+0000","last_undegraded":"2024-09-10T23:16:49.163849+0000","last_fullsized":"2024-09-10T23:16:49.163849+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:51.445414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.021848+0000","last_change":"2024-09-10T23:16:48.016877+0000","last_active":"2024-09-10T23:16:48.021848+0000","last_peered":"2024-09-10T23:16:48.021848+0000","last_clean":"2024-09-10T23:16:48.021848+0000","last_became_active":"2024-09-10T23:16:48.015970+0000","last_became_peered":"2024-09-10T23:16:48.015970+0000","last_unstale":"2024-09-10T23:16:48.021848+0000","last_undegraded":"2024-09-10T23:16:48.021848+0000","last_fullsized":"2024-09-10T23:16:48.021848+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:31.175193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"41'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162973+0000","last_change":"2024-09-10T23:16:47.018191+0000","last_active":"2024-09-10T23:16:49.162973+0000","last_peered":"2024-09-10T23:16:49.162973+0000","last_clean":"2024-09-10T23:16:49.162973+0000","last_became_active":"2024-09-10T23:16:47.017793+0000","last_became_peered":"2024-09-10T23:16:47.017793+0000","last_unstale":"2024-09-10T23:16:49.162973+0000","last_undegraded":"2024-09-10T23:16:49.162973+0000","last_fullsized":"2024-09-10T23:16:49.162973+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:52.138033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.028744+0000","last_change":"2024-09-10T23:16:48.021361+0000","last_active":"2024-09-10T23:16:48.028744+0000","last_peered":"2024-09-10T23:16:48.028744+0000","last_clean":"2024-09-10T23:16:48.028744+0000","last_became_active":"2024-09-10T23:16:48.020917+0000","last_became_peered":"2024-09-10T23:16:48.020917+0000","last_unstale":"2024-09-10T23:16:48.028744+0000","last_undegraded":"2024-09-10T23:16:48.028744+0000","last_fullsized":"2024-09-10T23:16:48.028744+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:35.182647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"41'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164291+0000","last_change":"2024-09-10T23:16:47.018008+0000","last_active":"2024-09-10T23:16:49.164291+0000","last_peered":"2024-09-10T23:16:49.164291+0000","last_clean":"2024-09-10T23:16:49.164291+0000","last_became_active":"2024-09-10T23:16:47.017652+0000","last_became_peered":"2024-09-10T23:16:47.017652+0000","last_unstale":"2024-09-10T23:16:49.164291+0000","last_undegraded":"2024-09-10T23:16:49.164291+0000","last_fullsized":"2024-09-10T23:16:49.164291+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:22.547597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164041+0000","last_change":"2024-09-10T23:16:48.031544+0000","last_active":"2024-09-10T23:16:49.164041+0000","last_peered":"2024-09-10T23:16:49.164041+0000","last_clean":"2024-09-10T23:16:49.164041+0000","last_became_active":"2024-09-10T23:16:48.031270+0000","last_became_peered":"2024-09-10T23:16:48.031270+0000","last_unstale":"2024-09-10T23:16:49.164041+0000","last_undegraded":"2024-09-10T23:16:49.164041+0000","last_fullsized":"2024-09-10T23:16:49.164041+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:40.533946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"41'2","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.019013+0000","last_change":"2024-09-10T23:16:47.019413+0000","last_active":"2024-09-10T23:16:49.019013+0000","last_peered":"2024-09-10T23:16:49.019013+0000","last_clean":"2024-09-10T23:16:49.019013+0000","last_became_active":"2024-09-10T23:16:47.019172+0000","last_became_peered":"2024-09-10T23:16:47.019172+0000","last_unstale":"2024-09-10T23:16:49.019013+0000","last_undegraded":"2024-09-10T23:16:49.019013+0000","last_fullsized":"2024-09-10T23:16:49.019013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:27.104274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.018972+0000","last_change":"2024-09-10T23:16:48.035443+0000","last_active":"2024-09-10T23:16:49.018972+0000","last_peered":"2024-09-10T23:16:49.018972+0000","last_clean":"2024-09-10T23:16:49.018972+0000","last_became_active":"2024-09-10T23:16:48.034629+0000","last_became_peered":"2024-09-10T23:16:48.034629+0000","last_unstale":"2024-09-10T23:16:49.018972+0000","last_undegraded":"2024-09-10T23:16:49.018972+0000","last_fullsized":"2024-09-10T23:16:49.018972+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:47.938021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"41'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163075+0000","last_change":"2024-09-10T23:16:47.019317+0000","last_active":"2024-09-10T23:16:49.163075+0000","last_peered":"2024-09-10T23:16:49.163075+0000","last_clean":"2024-09-10T23:16:49.163075+0000","last_became_active":"2024-09-10T23:16:47.018985+0000","last_became_peered":"2024-09-10T23:16:47.018985+0000","last_unstale":"2024-09-10T23:16:49.163075+0000","last_undegraded":"2024-09-10T23:16:49.163075+0000","last_fullsized":"2024-09-10T23:16:49.163075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:23.937495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164093+0000","last_change":"2024-09-10T23:16:48.031819+0000","last_active":"2024-09-10T23:16:49.164093+0000","last_peered":"2024-09-10T23:16:49.164093+0000","last_clean":"2024-09-10T23:16:49.164093+0000","last_became_active":"2024-09-10T23:16:48.031556+0000","last_became_peered":"2024-09-10T23:16:48.031556+0000","last_unstale":"2024-09-10T23:16:49.164093+0000","last_undegraded":"2024-09-10T23:16:49.164093+0000","last_fullsized":"2024-09-10T23:16:49.164093+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:08.358759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017435+0000","last_change":"2024-09-10T23:16:47.021512+0000","last_active":"2024-09-10T23:16:49.017435+0000","last_peered":"2024-09-10T23:16:49.017435+0000","last_clean":"2024-09-10T23:16:49.017435+0000","last_became_active":"2024-09-10T23:16:47.019719+0000","last_became_peered":"2024-09-10T23:16:47.019719+0000","last_unstale":"2024-09-10T23:16:49.017435+0000","last_undegraded":"2024-09-10T23:16:49.017435+0000","last_fullsized":"2024-09-10T23:16:49.017435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:07.355936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164146+0000","last_change":"2024-09-10T23:16:48.030604+0000","last_active":"2024-09-10T23:16:49.164146+0000","last_peered":"2024-09-10T23:16:49.164146+0000","last_clean":"2024-09-10T23:16:49.164146+0000","last_became_active":"2024-09-10T23:16:48.025135+0000","last_became_peered":"2024-09-10T23:16:48.025135+0000","last_unstale":"2024-09-10T23:16:49.164146+0000","last_undegraded":"2024-09-10T23:16:49.164146+0000","last_fullsized":"2024-09-10T23:16:49.164146+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:39.717119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"41'2","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162900+0000","last_change":"2024-09-10T23:16:47.016027+0000","last_active":"2024-09-10T23:16:49.162900+0000","last_peered":"2024-09-10T23:16:49.162900+0000","last_clean":"2024-09-10T23:16:49.162900+0000","last_became_active":"2024-09-10T23:16:47.015734+0000","last_became_peered":"2024-09-10T23:16:47.015734+0000","last_unstale":"2024-09-10T23:16:49.162900+0000","last_undegraded":"2024-09-10T23:16:49.162900+0000","last_fullsized":"2024-09-10T23:16:49.162900+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:14.544507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162295+0000","last_change":"2024-09-10T23:16:48.015817+0000","last_active":"2024-09-10T23:16:49.162295+0000","last_peered":"2024-09-10T23:16:49.162295+0000","last_clean":"2024-09-10T23:16:49.162295+0000","last_became_active":"2024-09-10T23:16:48.015517+0000","last_became_peered":"2024-09-10T23:16:48.015517+0000","last_unstale":"2024-09-10T23:16:49.162295+0000","last_undegraded":"2024-09-10T23:16:49.162295+0000","last_fullsized":"2024-09-10T23:16:49.162295+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:55.114890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162597+0000","last_change":"2024-09-10T23:16:47.016235+0000","last_active":"2024-09-10T23:16:49.162597+0000","last_peered":"2024-09-10T23:16:49.162597+0000","last_clean":"2024-09-10T23:16:49.162597+0000","last_became_active":"2024-09-10T23:16:47.015978+0000","last_became_peered":"2024-09-10T23:16:47.015978+0000","last_unstale":"2024-09-10T23:16:49.162597+0000","last_undegraded":"2024-09-10T23:16:49.162597+0000","last_fullsized":"2024-09-10T23:16:49.162597+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:22.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162652+0000","last_change":"2024-09-10T23:16:48.035534+0000","last_active":"2024-09-10T23:16:49.162652+0000","last_peered":"2024-09-10T23:16:49.162652+0000","last_clean":"2024-09-10T23:16:49.162652+0000","last_became_active":"2024-09-10T23:16:48.035256+0000","last_became_peered":"2024-09-10T23:16:48.035256+0000","last_unstale":"2024-09-10T23:16:49.162652+0000","last_undegraded":"2024-09-10T23:16:49.162652+0000","last_fullsized":"2024-09-10T23:16:49.162652+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:56.366068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162686+0000","last_change":"2024-09-10T23:16:47.023936+0000","last_active":"2024-09-10T23:16:49.162686+0000","last_peered":"2024-09-10T23:16:49.162686+0000","last_clean":"2024-09-10T23:16:49.162686+0000","last_became_active":"2024-09-10T23:16:47.023433+0000","last_became_peered":"2024-09-10T23:16:47.023433+0000","last_unstale":"2024-09-10T23:16:49.162686+0000","last_undegraded":"2024-09-10T23:16:49.162686+0000","last_fullsized":"2024-09-10T23:16:49.162686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:34.954269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.021798+0000","last_change":"2024-09-10T23:16:48.016266+0000","last_active":"2024-09-10T23:16:48.021798+0000","last_peered":"2024-09-10T23:16:48.021798+0000","last_clean":"2024-09-10T23:16:48.021798+0000","last_became_active":"2024-09-10T23:16:48.015260+0000","last_became_peered":"2024-09-10T23:16:48.015260+0000","last_unstale":"2024-09-10T23:16:48.021798+0000","last_undegraded":"2024-09-10T23:16:48.021798+0000","last_fullsized":"2024-09-10T23:16:48.021798+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:38.044939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162890+0000","last_change":"2024-09-10T23:16:47.022495+0000","last_active":"2024-09-10T23:16:49.162890+0000","last_peered":"2024-09-10T23:16:49.162890+0000","last_clean":"2024-09-10T23:16:49.162890+0000","last_became_active":"2024-09-10T23:16:47.021162+0000","last_became_peered":"2024-09-10T23:16:47.021162+0000","last_unstale":"2024-09-10T23:16:49.162890+0000","last_undegraded":"2024-09-10T23:16:49.162890+0000","last_fullsized":"2024-09-10T23:16:49.162890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:06.020130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017549+0000","last_change":"2024-09-10T23:16:48.023901+0000","last_active":"2024-09-10T23:16:49.017549+0000","last_peered":"2024-09-10T23:16:49.017549+0000","last_clean":"2024-09-10T23:16:49.017549+0000","last_became_active":"2024-09-10T23:16:48.023627+0000","last_became_peered":"2024-09-10T23:16:48.023627+0000","last_unstale":"2024-09-10T23:16:49.017549+0000","last_undegraded":"2024-09-10T23:16:49.017549+0000","last_fullsized":"2024-09-10T23:16:49.017549+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:45.881621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"41'2","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.164461+0000","last_change":"2024-09-10T23:16:47.024620+0000","last_active":"2024-09-10T23:16:49.164461+0000","last_peered":"2024-09-10T23:16:49.164461+0000","last_clean":"2024-09-10T23:16:49.164461+0000","last_became_active":"2024-09-10T23:16:47.024291+0000","last_became_peered":"2024-09-10T23:16:47.024291+0000","last_unstale":"2024-09-10T23:16:49.164461+0000","last_undegraded":"2024-09-10T23:16:49.164461+0000","last_fullsized":"2024-09-10T23:16:49.164461+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:33.119783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163300+0000","last_change":"2024-09-10T23:16:48.019559+0000","last_active":"2024-09-10T23:16:49.163300+0000","last_peered":"2024-09-10T23:16:49.163300+0000","last_clean":"2024-09-10T23:16:49.163300+0000","last_became_active":"2024-09-10T23:16:48.019278+0000","last_became_peered":"2024-09-10T23:16:48.019278+0000","last_unstale":"2024-09-10T23:16:49.163300+0000","last_undegraded":"2024-09-10T23:16:49.163300+0000","last_fullsized":"2024-09-10T23:16:49.163300+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:51.770366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"42'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:50.011544+0000","last_change":"2024-09-10T23:16:47.020368+0000","last_active":"2024-09-10T23:16:50.011544+0000","last_peered":"2024-09-10T23:16:50.011544+0000","last_clean":"2024-09-10T23:16:50.011544+0000","last_became_active":"2024-09-10T23:16:47.020097+0000","last_became_peered":"2024-09-10T23:16:47.020097+0000","last_unstale":"2024-09-10T23:16:50.011544+0000","last_undegraded":"2024-09-10T23:16:50.011544+0000","last_fullsized":"2024-09-10T23:16:50.011544+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:11.682495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:48.026860+0000","last_change":"2024-09-10T23:16:48.017442+0000","last_active":"2024-09-10T23:16:48.026860+0000","last_peered":"2024-09-10T23:16:48.026860+0000","last_clean":"2024-09-10T23:16:48.026860+0000","last_became_active":"2024-09-10T23:16:48.017170+0000","last_became_peered":"2024-09-10T23:16:48.017170+0000","last_unstale":"2024-09-10T23:16:48.026860+0000","last_undegraded":"2024-09-10T23:16:48.026860+0000","last_fullsized":"2024-09-10T23:16:48.026860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:01.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162433+0000","last_change":"2024-09-10T23:16:47.021448+0000","last_active":"2024-09-10T23:16:49.162433+0000","last_peered":"2024-09-10T23:16:49.162433+0000","last_clean":"2024-09-10T23:16:49.162433+0000","last_became_active":"2024-09-10T23:16:47.020806+0000","last_became_peered":"2024-09-10T23:16:47.020806+0000","last_unstale":"2024-09-10T23:16:49.162433+0000","last_undegraded":"2024-09-10T23:16:49.162433+0000","last_fullsized":"2024-09-10T23:16:49.162433+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:22.927358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162381+0000","last_change":"2024-09-10T23:16:48.024894+0000","last_active":"2024-09-10T23:16:49.162381+0000","last_peered":"2024-09-10T23:16:49.162381+0000","last_clean":"2024-09-10T23:16:49.162381+0000","last_became_active":"2024-09-10T23:16:48.024613+0000","last_became_peered":"2024-09-10T23:16:48.024613+0000","last_unstale":"2024-09-10T23:16:49.162381+0000","last_undegraded":"2024-09-10T23:16:49.162381+0000","last_fullsized":"2024-09-10T23:16:49.162381+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:09.323354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.162296+0000","last_change":"2024-09-10T23:16:47.023900+0000","last_active":"2024-09-10T23:16:49.162296+0000","last_peered":"2024-09-10T23:16:49.162296+0000","last_clean":"2024-09-10T23:16:49.162296+0000","last_became_active":"2024-09-10T23:16:47.023607+0000","last_became_peered":"2024-09-10T23:16:47.023607+0000","last_unstale":"2024-09-10T23:16:49.162296+0000","last_undegraded":"2024-09-10T23:16:49.162296+0000","last_fullsized":"2024-09-10T23:16:49.162296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:59.302163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017128+0000","last_change":"2024-09-10T23:16:48.018713+0000","last_active":"2024-09-10T23:16:49.017128+0000","last_peered":"2024-09-10T23:16:49.017128+0000","last_clean":"2024-09-10T23:16:49.017128+0000","last_became_active":"2024-09-10T23:16:48.018414+0000","last_became_peered":"2024-09-10T23:16:48.018414+0000","last_unstale":"2024-09-10T23:16:49.017128+0000","last_undegraded":"2024-09-10T23:16:49.017128+0000","last_fullsized":"2024-09-10T23:16:49.017128+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:18.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163929+0000","last_change":"2024-09-10T23:16:47.017238+0000","last_active":"2024-09-10T23:16:49.163929+0000","last_peered":"2024-09-10T23:16:49.163929+0000","last_clean":"2024-09-10T23:16:49.163929+0000","last_became_active":"2024-09-10T23:16:47.016998+0000","last_became_peered":"2024-09-10T23:16:47.016998+0000","last_unstale":"2024-09-10T23:16:49.163929+0000","last_undegraded":"2024-09-10T23:16:49.163929+0000","last_fullsized":"2024-09-10T23:16:49.163929+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:39.799424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.018051+0000","last_change":"2024-09-10T23:16:48.017352+0000","last_active":"2024-09-10T23:16:49.018051+0000","last_peered":"2024-09-10T23:16:49.018051+0000","last_clean":"2024-09-10T23:16:49.018051+0000","last_became_active":"2024-09-10T23:16:48.017041+0000","last_became_peered":"2024-09-10T23:16:48.017041+0000","last_unstale":"2024-09-10T23:16:49.018051+0000","last_undegraded":"2024-09-10T23:16:49.018051+0000","last_fullsized":"2024-09-10T23:16:49.018051+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:36.581159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.017902+0000","last_change":"2024-09-10T23:16:47.007381+0000","last_active":"2024-09-10T23:16:49.017902+0000","last_peered":"2024-09-10T23:16:49.017902+0000","last_clean":"2024-09-10T23:16:49.017902+0000","last_became_active":"2024-09-10T23:16:47.007156+0000","last_became_peered":"2024-09-10T23:16:47.007156+0000","last_unstale":"2024-09-10T23:16:49.017902+0000","last_undegraded":"2024-09-10T23:16:49.017902+0000","last_fullsized":"2024-09-10T23:16:49.017902+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:47.319924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163191+0000","last_change":"2024-09-10T23:16:48.015407+0000","last_active":"2024-09-10T23:16:49.163191+0000","last_peered":"2024-09-10T23:16:49.163191+0000","last_clean":"2024-09-10T23:16:49.163191+0000","last_became_active":"2024-09-10T23:16:48.015119+0000","last_became_peered":"2024-09-10T23:16:48.015119+0000","last_unstale":"2024-09-10T23:16:49.163191+0000","last_undegraded":"2024-09-10T23:16:49.163191+0000","last_fullsized":"2024-09-10T23:16:49.163191+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:44.817795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T23:16:47.999493+0000","last_change":"2024-09-10T23:16:47.011389+0000","last_active":"2024-09-10T23:16:47.999493+0000","last_peered":"2024-09-10T23:16:47.999493+0000","last_clean":"2024-09-10T23:16:47.999493+0000","last_became_active":"2024-09-10T23:16:47.011099+0000","last_became_peered":"2024-09-10T23:16:47.011099+0000","last_unstale":"2024-09-10T23:16:47.999493+0000","last_undegraded":"2024-09-10T23:16:47.999493+0000","last_fullsized":"2024-09-10T23:16:47.999493+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:39.754755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163824+0000","last_change":"2024-09-10T23:16:48.022459+0000","last_active":"2024-09-10T23:16:49.163824+0000","last_peered":"2024-09-10T23:16:49.163824+0000","last_clean":"2024-09-10T23:16:49.163824+0000","last_became_active":"2024-09-10T23:16:48.022127+0000","last_became_peered":"2024-09-10T23:16:48.022127+0000","last_unstale":"2024-09-10T23:16:49.163824+0000","last_undegraded":"2024-09-10T23:16:49.163824+0000","last_fullsized":"2024-09-10T23:16:49.163824+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:46.986942+0000","last_clean_scrub_stamp":"2024-09-10T23:16:46.986942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:16.824442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163023+0000","last_change":"2024-09-10T23:16:47.025740+0000","last_active":"2024-09-10T23:16:49.163023+0000","last_peered":"2024-09-10T23:16:49.163023+0000","last_clean":"2024-09-10T23:16:49.163023+0000","last_became_active":"2024-09-10T23:16:47.025476+0000","last_became_peered":"2024-09-10T23:16:47.025476+0000","last_unstale":"2024-09-10T23:16:49.163023+0000","last_undegraded":"2024-09-10T23:16:49.163023+0000","last_fullsized":"2024-09-10T23:16:49.163023+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:16:45.984119+0000","last_clean_scrub_stamp":"2024-09-10T23:16:45.984119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:27.104274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":147,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T23:16:49.163577+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:16:49.163577+0000","last_peered":"2024-09-10T23:16:49.163577+0000","last_clean":"2024-09-10T23:16:49.163577+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:16:49.163577+0000","last_undegraded":"2024-09-10T23:16:49.163577+0000","last_fullsized":"2024-09-10T23:16:49.163577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476756,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":206248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":797716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":205778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":206270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":483328,"data_stored":205736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":483328,"data_stored":205756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1077248,"data_stored":796068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":191807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:16:52.575 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:16:52.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:16:52.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.762+0000 7f60b6400640 1 -- 172.21.15.17:0/489966598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b2540 msgr2=0x7f60b00cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.762+0000 7f60b6400640 1 --2- 172.21.15.17:0/489966598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b2540 0x7f60b00cc8b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009c80 tx=0x7f60a801cda0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.762+0000 7f60b6400640 1 -- 172.21.15.17:0/489966598 shutdown_connections 2024-09-10T23:16:52.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.762+0000 7f60b6400640 1 --2- 172.21.15.17:0/489966598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b2540 0x7f60b00cc8b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.762+0000 7f60b6400640 1 --2- 172.21.15.17:0/489966598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60b015f400 0x7f60b00cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.762+0000 7f60b6400640 1 -- 172.21.15.17:0/489966598 >> 172.21.15.17:0/489966598 conn(0x7f60b00d1da0 msgr2=0x7f60b00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:52.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.762+0000 7f60b6400640 1 -- 172.21.15.17:0/489966598 shutdown_connections 2024-09-10T23:16:52.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.762+0000 7f60b6400640 1 -- 172.21.15.17:0/489966598 wait complete. 2024-09-10T23:16:52.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60b6400640 1 Processor -- start 2024-09-10T23:16:52.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60b6400640 1 -- start start 2024-09-10T23:16:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60b6400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60b00b2540 0x7f60b014f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60b6400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b31b0 0x7f60b0159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60b6400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60b015f400 0x7f60b0156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60b6400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f60b0168de0 con 0x7f60b00b31b0 2024-09-10T23:16:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60b6400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f60b0168c60 con 0x7f60b00b2540 2024-09-10T23:16:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60b6400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f60b0168f60 con 0x7f60b015f400 2024-09-10T23:16:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b31b0 0x7f60b0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b31b0 0x7f60b0159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51972/0 (socket says 172.21.15.17:51972) 2024-09-10T23:16:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7e00640 1 -- 172.21.15.17:0/2105090748 learned_addr learned my addr 172.21.15.17:0/2105090748 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60af400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60b00b2540 0x7f60b014f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60afe00640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60b015f400 0x7f60b0156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7e00640 1 -- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60b015f400 msgr2=0x7f60b0156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7e00640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60b015f400 0x7f60b0156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7e00640 1 -- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60b00b2540 msgr2=0x7f60b014f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7e00640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60b00b2540 0x7f60b014f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7e00640 1 -- 172.21.15.17:0/2105090748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b015b590 con 0x7f60b00b31b0 2024-09-10T23:16:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7e00640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b31b0 0x7f60b0159600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f609800c450 tx=0x7f609800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7400640 1 -- 172.21.15.17:0/2105090748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60980052d0 con 0x7f60b00b31b0 2024-09-10T23:16:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7400640 1 -- 172.21.15.17:0/2105090748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6098005470 con 0x7f60b00b31b0 2024-09-10T23:16:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60a7400640 1 -- 172.21.15.17:0/2105090748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6098012890 con 0x7f60b00b31b0 2024-09-10T23:16:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.766+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b015b870 con 0x7f60b00b31b0 2024-09-10T23:16:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.770+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b006dd70 con 0x7f60b00b31b0 2024-09-10T23:16:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.770+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b00cc8b0 con 0x7f60b00b31b0 2024-09-10T23:16:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.770+0000 7f60a7400640 1 -- 172.21.15.17:0/2105090748 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6098003620 con 0x7f60b00b31b0 2024-09-10T23:16:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.770+0000 7f60a7400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f608c0725e0 0x7f608c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.770+0000 7f60a7400640 1 -- 172.21.15.17:0/2105090748 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7f6098092e50 con 0x7f60b00b31b0 2024-09-10T23:16:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.770+0000 7f60af400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f608c0725e0 0x7f608c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.774+0000 7f60af400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f608c0725e0 0x7f608c074aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009b40 tx=0x7f60a00091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:52.774+0000 7f60a7400640 1 -- 172.21.15.17:0/2105090748 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f609805dcb0 con 0x7f60b00b31b0 2024-09-10T23:16:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.010+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f60b006df40 con 0x7f60b00b31b0 2024-09-10T23:16:53.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.010+0000 7f60a7400640 1 -- 172.21.15.17:0/2105090748 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f60980626e0 con 0x7f60b00b31b0 2024-09-10T23:16:53.016 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:16:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:16:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:16:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:16:53.016 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:16:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:16:53.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f608c0725e0 msgr2=0x7f608c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f608c0725e0 0x7f608c074aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009b40 tx=0x7f60a00091e0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b31b0 msgr2=0x7f60b0159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b31b0 0x7f60b0159600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f609800c450 tx=0x7f609800c910 comp rx=0 tx=0).stop 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 shutdown_connections 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f608c0725e0 0x7f608c074aa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60b015f400 0x7f60b0156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60b00b31b0 0x7f60b0159600 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 --2- 172.21.15.17:0/2105090748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60b00b2540 0x7f60b014f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 >> 172.21.15.17:0/2105090748 conn(0x7f60b00d1da0 msgr2=0x7f60b00cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 shutdown_connections 2024-09-10T23:16:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.014+0000 7f60b6400640 1 -- 172.21.15.17:0/2105090748 wait complete. 2024-09-10T23:16:53.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:16:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.178+0000 7fedac800640 1 -- 172.21.15.17:0/2423046194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40cf230 msgr2=0x7feda406e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.178+0000 7fedac800640 1 --2- 172.21.15.17:0/2423046194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40cf230 0x7feda406e750 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7feda40cc5a0 tx=0x7fed9801eff0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.178+0000 7fedac800640 1 -- 172.21.15.17:0/2423046194 shutdown_connections 2024-09-10T23:16:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.178+0000 7fedac800640 1 --2- 172.21.15.17:0/2423046194 >> v2:172.21.15.77:3300/0 conn(0x7feda40cf610 0x7feda415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.178+0000 7fedac800640 1 --2- 172.21.15.17:0/2423046194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40cf230 0x7feda406e750 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.178+0000 7fedac800640 1 -- 172.21.15.17:0/2423046194 >> 172.21.15.17:0/2423046194 conn(0x7feda406cfc0 msgr2=0x7feda406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.178+0000 7fedac800640 1 -- 172.21.15.17:0/2423046194 shutdown_connections 2024-09-10T23:16:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.178+0000 7fedac800640 1 -- 172.21.15.17:0/2423046194 wait complete. 2024-09-10T23:16:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 Processor -- start 2024-09-10T23:16:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 -- start start 2024-09-10T23:16:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40b32d0 0x7feda40cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40cf230 0x7feda41e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feda40cf610 0x7feda414da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7feda40d0330 con 0x7feda40b32d0 2024-09-10T23:16:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feda40d01b0 con 0x7feda40cf230 2024-09-10T23:16:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7feda40d04b0 con 0x7feda40cf610 2024-09-10T23:16:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40b32d0 0x7feda40cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40b32d0 0x7feda40cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51986/0 (socket says 172.21.15.17:51986) 2024-09-10T23:16:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9e00640 1 -- 172.21.15.17:0/3815518290 learned_addr learned my addr 172.21.15.17:0/3815518290 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9e00640 1 -- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feda40cf610 msgr2=0x7feda414da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9e00640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feda40cf610 0x7feda414da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9e00640 1 -- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40cf230 msgr2=0x7feda41e3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9400640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40cf230 0x7feda41e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9e00640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40cf230 0x7feda41e3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9e00640 1 -- 172.21.15.17:0/3815518290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda40ce360 con 0x7feda40b32d0 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9400640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40cf230 0x7feda41e3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7feda9e00640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40b32d0 0x7feda40cd1b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fed98000c10 tx=0x7fed980a8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fed9e000640 1 -- 172.21.15.17:0/3815518290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed980b5040 con 0x7feda40b32d0 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fed9e000640 1 -- 172.21.15.17:0/3815518290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed980bf070 con 0x7feda40b32d0 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fed9e000640 1 -- 172.21.15.17:0/3815518290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed980b1c50 con 0x7feda40b32d0 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda40cc6f0 con 0x7feda40b32d0 2024-09-10T23:16:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.182+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda40ce600 con 0x7feda40b32d0 2024-09-10T23:16:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.186+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda406e750 con 0x7feda40b32d0 2024-09-10T23:16:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.186+0000 7fed9e000640 1 -- 172.21.15.17:0/3815518290 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fed980b8030 con 0x7feda40b32d0 2024-09-10T23:16:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.186+0000 7fed9e000640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed880725e0 0x7fed88074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.186+0000 7fed9e000640 1 -- 172.21.15.17:0/3815518290 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7fed98130b90 con 0x7feda40b32d0 2024-09-10T23:16:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.186+0000 7feda9400640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed880725e0 0x7fed88074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.186+0000 7feda9400640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed880725e0 0x7fed88074aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed94005fd0 tx=0x7fed94005dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.190+0000 7fed9e000640 1 -- 172.21.15.17:0/3815518290 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fed980c9020 con 0x7feda40b32d0 2024-09-10T23:16:53.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.402+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feda4153c90 con 0x7feda40b32d0 2024-09-10T23:16:53.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fed9e000640 1 -- 172.21.15.17:0/3815518290 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5220 (secure 0 0 0) 0x7fed98018b50 con 0x7feda40b32d0 2024-09-10T23:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:16:53.409 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"btime":"2024-09-10T23:16:51:022729+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1906911663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1906911663},{"type":"v1","addr":"172.21.15.77:6835","nonce":1906911663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/650482314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":650482314},{"type":"v1","addr":"172.21.15.77:6837","nonce":650482314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":5013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1923332906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1923332906},{"type":"v1","addr":"172.21.15.17:6834","nonce":1923332906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:16:47.415488+0000","modified":"2024-09-10T23:16:50.434181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5016":{"gid":5016,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/3608620403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3608620403},{"type":"v1","addr":"172.21.15.17:6835","nonce":3608620403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5016,"qdb_cluster":[5016]},"id":2}]} 2024-09-10T23:16:53.410 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 19 2024-09-10T23:16:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed880725e0 msgr2=0x7fed88074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed880725e0 0x7fed88074aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed94005fd0 tx=0x7fed94005dc0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40b32d0 msgr2=0x7feda40cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40b32d0 0x7feda40cd1b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fed98000c10 tx=0x7fed980a8ca0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 shutdown_connections 2024-09-10T23:16:53.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed880725e0 0x7fed88074aa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feda40cf610 0x7feda414da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40cf230 0x7feda41e3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 --2- 172.21.15.17:0/3815518290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feda40b32d0 0x7feda40cd1b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 >> 172.21.15.17:0/3815518290 conn(0x7feda406cfc0 msgr2=0x7feda4150320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:53.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 shutdown_connections 2024-09-10T23:16:53.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.406+0000 7fedac800640 1 -- 172.21.15.17:0/3815518290 wait complete. 2024-09-10T23:16:53.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:16:47.415488+0000', 'modified': '2024-09-10T23:16:50.434181+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5016}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5016': {'gid': 5016, 'name': 'c', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.17:6835/3608620403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 3608620403}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 3608620403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5016, 'qdb_cluster': [5016]} 2024-09-10T23:16:53.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:16:53.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:16:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 -- 172.21.15.17:0/2039920726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff93815f120 msgr2=0x7ff93806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 --2- 172.21.15.17:0/2039920726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff93815f120 0x7ff93806dbd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff93806c6c0 tx=0x7ff92c01d2f0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 -- 172.21.15.17:0/2039920726 shutdown_connections 2024-09-10T23:16:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 --2- 172.21.15.17:0/2039920726 >> v2:172.21.15.77:3300/0 conn(0x7ff9380691b0 0x7ff93806e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 --2- 172.21.15.17:0/2039920726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff93815f120 0x7ff93806dbd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 -- 172.21.15.17:0/2039920726 >> 172.21.15.17:0/2039920726 conn(0x7ff938072f80 msgr2=0x7ff938073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 -- 172.21.15.17:0/2039920726 shutdown_connections 2024-09-10T23:16:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 -- 172.21.15.17:0/2039920726 wait complete. 2024-09-10T23:16:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 Processor -- start 2024-09-10T23:16:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 -- start start 2024-09-10T23:16:53.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380691b0 0x7ff9380cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9380af7e0 0x7ff93814a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93815f120 0x7ff938151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff938168ec0 con 0x7ff9380af7e0 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff938168d40 con 0x7ff9380691b0 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff940800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff938169040 con 0x7ff93815f120 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9380af7e0 0x7ff93814a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9380af7e0 0x7ff93814a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52010/0 (socket says 172.21.15.17:52010) 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93d400640 1 -- 172.21.15.17:0/2383486845 learned_addr learned my addr 172.21.15.17:0/2383486845 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93de00640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380691b0 0x7ff9380cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93e800640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93815f120 0x7ff938151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93d400640 1 -- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93815f120 msgr2=0x7ff938151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93d400640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93815f120 0x7ff938151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93d400640 1 -- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380691b0 msgr2=0x7ff9380cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93d400640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380691b0 0x7ff9380cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.978+0000 7ff93d400640 1 -- 172.21.15.17:0/2383486845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff938150890 con 0x7ff9380af7e0 2024-09-10T23:16:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff93d400640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9380af7e0 0x7ff93814a990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff92800c970 tx=0x7ff92800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff932000640 1 -- 172.21.15.17:0/2383486845 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928007c70 con 0x7ff9380af7e0 2024-09-10T23:16:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff932000640 1 -- 172.21.15.17:0/2383486845 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff92800f450 con 0x7ff9380af7e0 2024-09-10T23:16:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff932000640 1 -- 172.21.15.17:0/2383486845 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92800f8a0 con 0x7ff9380af7e0 2024-09-10T23:16:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff940800640 1 -- 172.21.15.17:0/2383486845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93814b2b0 con 0x7ff9380af7e0 2024-09-10T23:16:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff940800640 1 -- 172.21.15.17:0/2383486845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9381fb620 con 0x7ff9380af7e0 2024-09-10T23:16:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff932000640 1 -- 172.21.15.17:0/2383486845 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff928020030 con 0x7ff9380af7e0 2024-09-10T23:16:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff943c82000 1 Processor -- start 2024-09-10T23:16:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff932000640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff91c072610 0x7ff91c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.982+0000 7ff943c82000 1 -- start start 2024-09-10T23:16:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff932000640 1 -- 172.21.15.17:0/2383486845 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7ff928093850 con 0x7ff9380af7e0 2024-09-10T23:16:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93e800640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff91c072610 0x7ff91c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11de9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 0x556e11d9d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11d9de10 0x556e11d9e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e11cbe3f0 con 0x556e11de99d0 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556e11bfbb20 con 0x556e11dea2f0 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556e11beaf50 con 0x556e11d9de10 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11de9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11de9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52016/0 (socket says 172.21.15.17:52016) 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93de00640 1 -- 172.21.15.17:0/528328358 learned_addr learned my addr 172.21.15.17:0/528328358 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93d400640 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 0x556e11d9d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93e800640 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11d9de10 0x556e11d9e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93de00640 1 -- 172.21.15.17:0/528328358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11d9de10 msgr2=0x556e11d9e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93de00640 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11d9de10 0x556e11d9e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93de00640 1 -- 172.21.15.17:0/528328358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 msgr2=0x556e11d9d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93de00640 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 0x556e11d9d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93de00640 1 -- 172.21.15.17:0/528328358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e11bb2590 con 0x556e11de99d0 2024-09-10T23:16:53.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93d400640 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 0x556e11d9d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93e800640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff91c072610 0x7ff91c074ad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff9340012f0 tx=0x7ff934002120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff93de00640 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11de9db0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0b0040 tx=0x7ff92c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629af7024d3319f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff926a00640 1 -- 172.21.15.17:0/528328358 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0bb020 con 0x556e11de99d0 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff926a00640 1 -- 172.21.15.17:0/528328358 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff92c0b3040 con 0x556e11de99d0 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff926a00640 1 -- 172.21.15.17:0/528328358 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0b2050 con 0x556e11de99d0 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 -- 172.21.15.17:0/528328358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 msgr2=0x556e11de9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11de9db0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0b0040 tx=0x7ff92c019630 comp rx=0 tx=0).stop 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 -- 172.21.15.17:0/528328358 shutdown_connections 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11d9de10 0x556e11d9e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 0x556e11d9d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 --2- 172.21.15.17:0/528328358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11de9db0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 -- 172.21.15.17:0/528328358 >> 172.21.15.17:0/528328358 conn(0x556e11c87130 msgr2=0x556e11dcce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 -- 172.21.15.17:0/528328358 shutdown_connections 2024-09-10T23:16:53.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 -- 172.21.15.17:0/528328358 wait complete. 2024-09-10T23:16:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 -- start start 2024-09-10T23:16:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.986+0000 7ff943c82000 1 Processor -- start 2024-09-10T23:16:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 0x556e11dca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11dcae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 0x556e11dcb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e11b855d0 con 0x556e11de99d0 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556e11beed60 con 0x556e11d9de10 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556e11b91500 con 0x556e11dea2f0 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 10 client.0 _ll_register_callbacks cb 0x556e11b95810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11dcae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11dcae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52024/0 (socket says 172.21.15.17:52024) 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93d400640 1 -- 172.21.15.17:0/748384476 learned_addr learned my addr 172.21.15.17:0/748384476 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93e800640 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 0x556e11dcb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93de00640 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 0x556e11dca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93d400640 1 -- 172.21.15.17:0/748384476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 msgr2=0x556e11dcb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93d400640 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 0x556e11dcb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93d400640 1 -- 172.21.15.17:0/748384476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 msgr2=0x556e11dca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93d400640 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 0x556e11dca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:53.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93d400640 1 -- 172.21.15.17:0/748384476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e11b89170 con 0x556e11de99d0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93d400640 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11dcae70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff92800c940 tx=0x7ff92805ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e50228104ec646 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff91b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff91b400640 1 -- 172.21.15.17:0/748384476 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928083070 con 0x556e11de99d0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff91b400640 1 -- 172.21.15.17:0/748384476 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7ff92807fd60 con 0x556e11de99d0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 -- 172.21.15.17:0/748384476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556e11b830f0 con 0x556e11de99d0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff91b400640 1 -- 172.21.15.17:0/748384476 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff92808f050 con 0x556e11de99d0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 10 client.5202 fetch_fsmap learned FSMap version 19 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 -- 172.21.15.17:0/748384476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556e11c6fef0 con 0x556e11de99d0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff91b400640 1 -- 172.21.15.17:0/748384476 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556e11b830f0 con 0x556e11de99d0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff91b400640 1 -- 172.21.15.17:0/748384476 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7ff928065380 con 0x556e11de99d0 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 10 client.5202 fetch_fsmap finished waiting for FSMap version 19 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 10 client.5202 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:16:53.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 20 client.5202 populate_metadata read hostname 'smithi017' 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x556e11dcc0f0 0x556e11dfbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 4 client.5202 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 -- 172.21.15.17:0/748384476 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e11bfda70 con 0x556e11dcc0f0 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93de00640 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x556e11dcc0f0 0x556e11dfbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff93de00640 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x556e11dcc0f0 0x556e11dfbc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20ba0c88aa35735 server_cookie=23c99a5c82449c3f in_seq=0 out_seq=0 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff91b400640 10 client.5202 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff91b400640 1 -- 172.21.15.17:0/748384476 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556e11bfda70 con 0x556e11dcc0f0 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff91b400640 10 client.5202 handle_command_reply: tid=0 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.990+0000 7ff943c82000 1 client.5202 shutdown 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 -- 172.21.15.17:0/748384476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 msgr2=0x556e11dcae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11dcae70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff92800c940 tx=0x7ff92805ebe0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 -- 172.21.15.17:0/748384476 shutdown_connections 2024-09-10T23:16:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x556e11dcc0f0 0x556e11dfbc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 0x556e11dcb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11dcae70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 --2- 172.21.15.17:0/748384476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 0x556e11dca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff91b400640 0 client.5202 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:16:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 -- 172.21.15.17:0/748384476 >> 172.21.15.17:0/748384476 conn(0x556e11c87130 msgr2=0x556e11d9cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 -- 172.21.15.17:0/748384476 shutdown_connections 2024-09-10T23:16:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 1 -- 172.21.15.17:0/748384476 wait complete. 2024-09-10T23:16:54.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:53.994+0000 7ff943c82000 20 client.5202 trim_cache size 0 max 16384 2024-09-10T23:16:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.010+0000 7ff943c82000 1 Processor -- start 2024-09-10T23:16:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.010+0000 7ff943c82000 1 -- start start 2024-09-10T23:16:54.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11d9de10 0x556e11e5bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e5c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 0x556e11e5ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff938204640 con 0x556e11de99d0 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff938203650 con 0x556e11dea2f0 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff938154120 con 0x556e11d9de10 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e5c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e5c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52032/0 (socket says 172.21.15.17:52032) 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 -- 172.21.15.17:0/3296959933 learned_addr learned my addr 172.21.15.17:0/3296959933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 -- 172.21.15.17:0/3296959933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11d9de10 msgr2=0x556e11e5bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 --2- 172.21.15.17:0/3296959933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11d9de10 0x556e11e5bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 -- 172.21.15.17:0/3296959933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 msgr2=0x556e11e5ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:54.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 --2- 172.21.15.17:0/3296959933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 0x556e11e5ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 -- 172.21.15.17:0/3296959933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e11c46d90 con 0x556e11de99d0 2024-09-10T23:16:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 --2- 172.21.15.17:0/3296959933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e5c520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff928078490 tx=0x7ff928078390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a05424df68a22d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff926000640 1 -- 172.21.15.17:0/3296959933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928083040 con 0x556e11de99d0 2024-09-10T23:16:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff926000640 1 -- 172.21.15.17:0/3296959933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff928075020 con 0x556e11de99d0 2024-09-10T23:16:54.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff926000640 1 -- 172.21.15.17:0/3296959933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92805ed90 con 0x556e11de99d0 2024-09-10T23:16:54.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- 172.21.15.17:0/3296959933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 msgr2=0x556e11e5c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- 172.21.15.17:0/3296959933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e5c520 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff928078490 tx=0x7ff928078390 comp rx=0 tx=0).stop 2024-09-10T23:16:54.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- 172.21.15.17:0/3296959933 shutdown_connections 2024-09-10T23:16:54.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- 172.21.15.17:0/3296959933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11dea2f0 0x556e11e5ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- 172.21.15.17:0/3296959933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e5c520 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- 172.21.15.17:0/3296959933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11d9de10 0x556e11e5bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- 172.21.15.17:0/3296959933 >> 172.21.15.17:0/3296959933 conn(0x556e11c87130 msgr2=0x556e11da5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:54.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- 172.21.15.17:0/3296959933 shutdown_connections 2024-09-10T23:16:54.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- 172.21.15.17:0/3296959933 wait complete. 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- start start 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 Processor -- start 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 0x556e11e60230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e60770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 0x556e11e60cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556e11b855d0 con 0x556e11de99d0 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556e11e00ce0 con 0x556e11d9de10 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556e11bf3390 con 0x556e11dea2f0 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff943c82000 10 client.0 _ll_register_callbacks cb 0x7ff92800a570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.014+0000 7ff93d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e60770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e60770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52044/0 (socket says 172.21.15.17:52044) 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93d400640 1 -- 172.21.15.17:0/3994546482 learned_addr learned my addr 172.21.15.17:0/3994546482 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93e800640 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 0x556e11e60cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93de00640 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 0x556e11e60230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93d400640 1 -- 172.21.15.17:0/3994546482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 msgr2=0x556e11e60cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93d400640 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 0x556e11e60cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93d400640 1 -- 172.21.15.17:0/3994546482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 msgr2=0x556e11e60230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93d400640 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 0x556e11e60230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93d400640 1 -- 172.21.15.17:0/3994546482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e11bb1a90 con 0x556e11de99d0 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93de00640 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 0x556e11e60230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93d400640 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e60770 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff92805ac10 tx=0x7ff92807ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04b82a2d9b0925 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 1 -- 172.21.15.17:0/3994546482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928083040 con 0x556e11de99d0 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 1 -- 172.21.15.17:0/3994546482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7ff92805d360 con 0x556e11de99d0 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 -- 172.21.15.17:0/3994546482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff928075020 con 0x556e11de99d0 2024-09-10T23:16:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 1 -- 172.21.15.17:0/3994546482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff928067b90 con 0x556e11de99d0 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 10 client.5208 fetch_fsmap learned FSMap version 19 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 -- 172.21.15.17:0/3994546482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556e11b90050 con 0x556e11de99d0 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 1 -- 172.21.15.17:0/3994546482 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff928075020 con 0x556e11de99d0 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 1 -- 172.21.15.17:0/3994546482 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 19) ==== 3502+0+0 (secure 0 0 0) 0x7ff92805d560 con 0x556e11de99d0 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 10 client.5208 fetch_fsmap finished waiting for FSMap version 19 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 10 client.5208 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 20 client.5208 populate_metadata read hostname 'smithi017' 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x556e11dfe3c0 0x556e11dfe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 4 client.5208 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 -- 172.21.15.17:0/3994546482 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "status"}) -- 0x556e11bf9520 con 0x556e11dfe3c0 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93de00640 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x556e11dfe3c0 0x556e11dfe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff93de00640 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x556e11dfe3c0 0x556e11dfe7a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d1cfe59c089f388 server_cookie=d7bb995b5bb7532 in_seq=0 out_seq=0 2024-09-10T23:16:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 10 client.5208 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 1 -- 172.21.15.17:0/3994546482 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556e11bf9520 con 0x556e11dfe3c0 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 10 client.5208 handle_command_reply: tid=0 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 client.5208 shutdown 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 -- 172.21.15.17:0/3994546482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 msgr2=0x556e11e60770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e60770 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff92805ac10 tx=0x7ff92807ff90 comp rx=0 tx=0).stop 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 -- 172.21.15.17:0/3994546482 shutdown_connections 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x556e11dfe3c0 0x556e11dfe7a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556e11dea2f0 0x556e11e60cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e11de99d0 0x556e11e60770 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 --2- 172.21.15.17:0/3994546482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556e11d9de10 0x556e11e60230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff91b400640 0 client.5208 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:16:54.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 -- 172.21.15.17:0/3994546482 >> 172.21.15.17:0/3994546482 conn(0x556e11c87130 msgr2=0x556e11da5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:54.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 -- 172.21.15.17:0/3994546482 shutdown_connections 2024-09-10T23:16:54.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 1 -- 172.21.15.17:0/3994546482 wait complete. 2024-09-10T23:16:54.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff943c82000 20 client.5208 trim_cache size 0 max 16384 2024-09-10T23:16:54.029 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:16:54.029 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:16:54.029 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:16:54.029 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 5016, 2024-09-10T23:16:54.030 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:16:54.030 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:16:54.030 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:16:54.030 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.0255389499999996, 2024-09-10T23:16:54.030 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 19, 2024-09-10T23:16:54.030 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 42, 2024-09-10T23:16:54.030 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 42, 2024-09-10T23:16:54.030 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 19.998834044999999 2024-09-10T23:16:54.030 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:16:54.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff940800640 1 -- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff91c072610 msgr2=0x7ff91c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff940800640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff91c072610 0x7ff91c074ad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff9340012f0 tx=0x7ff934002120 comp rx=0 tx=0).stop 2024-09-10T23:16:54.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff940800640 1 -- 172.21.15.17:0/2383486845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9380af7e0 msgr2=0x7ff93814a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.018+0000 7ff940800640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9380af7e0 0x7ff93814a990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff92800c970 tx=0x7ff92800ce30 comp rx=0 tx=0).stop 2024-09-10T23:16:54.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.022+0000 7ff940800640 1 -- 172.21.15.17:0/2383486845 shutdown_connections 2024-09-10T23:16:54.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.022+0000 7ff940800640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff91c072610 0x7ff91c074ad0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.022+0000 7ff940800640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff93815f120 0x7ff938151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.022+0000 7ff940800640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9380af7e0 0x7ff93814a990 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.022+0000 7ff940800640 1 --2- 172.21.15.17:0/2383486845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9380691b0 0x7ff9380cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.022+0000 7ff940800640 1 -- 172.21.15.17:0/2383486845 >> 172.21.15.17:0/2383486845 conn(0x7ff938072f80 msgr2=0x7ff93814b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:54.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.022+0000 7ff940800640 1 -- 172.21.15.17:0/2383486845 shutdown_connections 2024-09-10T23:16:54.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.022+0000 7ff940800640 1 -- 172.21.15.17:0/2383486845 wait complete. 2024-09-10T23:16:54.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:16:54.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.186+0000 7f5a23800640 1 -- 172.21.15.17:0/2019518658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a1c06cbc0 msgr2=0x7f5a1c06cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.186+0000 7f5a23800640 1 --2- 172.21.15.17:0/2019518658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a1c06cbc0 0x7f5a1c06cfa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009870 tx=0x7f5a0c01c7a0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.186+0000 7f5a23800640 1 -- 172.21.15.17:0/2019518658 shutdown_connections 2024-09-10T23:16:54.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.186+0000 7f5a23800640 1 --2- 172.21.15.17:0/2019518658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a1c06cbc0 0x7f5a1c06cfa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.186+0000 7f5a23800640 1 -- 172.21.15.17:0/2019518658 >> 172.21.15.17:0/2019518658 conn(0x7f5a1c0d0c50 msgr2=0x7f5a1c0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:54.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.186+0000 7f5a23800640 1 -- 172.21.15.17:0/2019518658 shutdown_connections 2024-09-10T23:16:54.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.186+0000 7f5a23800640 1 -- 172.21.15.17:0/2019518658 wait complete. 2024-09-10T23:16:54.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 Processor -- start 2024-09-10T23:16:54.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 -- start start 2024-09-10T23:16:54.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a1c06cbc0 0x7f5a1c1f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a1c06f790 0x7f5a1c1fbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a1c152f30 0x7f5a1c0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c16a5f0 con 0x7f5a1c06f790 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1c0ccdf0 con 0x7f5a1c152f30 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1c16a770 con 0x7f5a1c06cbc0 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a1c06f790 0x7f5a1c1fbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a1c06f790 0x7f5a1c1fbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52050/0 (socket says 172.21.15.17:52050) 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a13e00640 1 -- 172.21.15.17:0/997617333 learned_addr learned my addr 172.21.15.17:0/997617333 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a20e00640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a1c06cbc0 0x7f5a1c1f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a21800640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a1c152f30 0x7f5a1c0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a13e00640 1 -- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a1c06cbc0 msgr2=0x7f5a1c1f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a13e00640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a1c06cbc0 0x7f5a1c1f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a13e00640 1 -- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a1c152f30 msgr2=0x7f5a1c0cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a13e00640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a1c152f30 0x7f5a1c0cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a13e00640 1 -- 172.21.15.17:0/997617333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1c1fc1f0 con 0x7f5a1c06f790 2024-09-10T23:16:54.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a21800640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a1c152f30 0x7f5a1c0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:16:54.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a13e00640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a1c06f790 0x7f5a1c1fbcb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400c760 tx=0x7f5a0400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:54.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a19600640 1 -- 172.21.15.17:0/997617333 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04016020 con 0x7f5a1c06f790 2024-09-10T23:16:54.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a19600640 1 -- 172.21.15.17:0/997617333 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a0400a930 con 0x7f5a1c06f790 2024-09-10T23:16:54.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a1c156440 con 0x7f5a1c06f790 2024-09-10T23:16:54.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a19600640 1 -- 172.21.15.17:0/997617333 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0400ad80 con 0x7f5a1c06f790 2024-09-10T23:16:54.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.190+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1c1f7dc0 con 0x7f5a1c06f790 2024-09-10T23:16:54.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.194+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1c152820 con 0x7f5a1c06f790 2024-09-10T23:16:54.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.194+0000 7f5a19600640 1 -- 172.21.15.17:0/997617333 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5a0401b400 con 0x7f5a1c06f790 2024-09-10T23:16:54.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.194+0000 7f5a19600640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59f80725e0 0x7f59f8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:54.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.194+0000 7f5a19600640 1 -- 172.21.15.17:0/997617333 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7f5a04093810 con 0x7f5a1c06f790 2024-09-10T23:16:54.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.194+0000 7f5a20e00640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59f80725e0 0x7f59f8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:54.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.194+0000 7f5a20e00640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59f80725e0 0x7f59f8074aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0af000 tx=0x7f5a0c01afe0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.198+0000 7f5a19600640 1 -- 172.21.15.17:0/997617333 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5a04020020 con 0x7f5a1c06f790 2024-09-10T23:16:54.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.410+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5a1c0cb2a0 con 0x7f5a1c06f790 2024-09-10T23:16:54.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.410+0000 7f5a19600640 1 -- 172.21.15.17:0/997617333 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+73 (secure 0 0 0) 0x7f5a1c1fc1f0 con 0x7f5a1c06f790 2024-09-10T23:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:16:54.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59f80725e0 msgr2=0x7f59f8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59f80725e0 0x7f59f8074aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0af000 tx=0x7f5a0c01afe0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a1c06f790 msgr2=0x7f5a1c1fbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a1c06f790 0x7f5a1c1fbcb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400c760 tx=0x7f5a0400cc20 comp rx=0 tx=0).stop 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 shutdown_connections 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59f80725e0 0x7f59f8074aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a1c152f30 0x7f5a1c0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a1c06f790 0x7f5a1c1fbcb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 --2- 172.21.15.17:0/997617333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a1c06cbc0 0x7f5a1c1f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 >> 172.21.15.17:0/997617333 conn(0x7f5a1c0d0c50 msgr2=0x7f5a1c15e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 shutdown_connections 2024-09-10T23:16:54.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54.414+0000 7f5a23800640 1 -- 172.21.15.17:0/997617333 wait complete. 2024-09-10T23:16:54.436 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:16:54.436 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:16:54.436 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:16:54.436 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:16:54.436 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:54.436 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:16:54.436 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:16:54.436 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:16:54.436 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:54.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:54.437 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:16:54.446 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42357sec preferred_lft 42357sec 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:16:54.447 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:16:54.448 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:16:54.449 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:16:54.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:54.450 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:16:54.510 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:16:54.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:54.512 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:16:54.561 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:16:54.561 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:16:54.561 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:16:54.561 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:16:54.561 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:16:54.561 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:16:54.562 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:16:54.562 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:16:54.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:16:54.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:16:54.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:16:54.562 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:16:54.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:16:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:54.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:54.700 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:16:54.709 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:16:54.709 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:16:54.710 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:54.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:54.710 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:16:54.773 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:16:54.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:54.773 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:54.828 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:16:54.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:16:54.829 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:54.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:16:54.945 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:54.997 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:54.998 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:16:54.999 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:16:55.000 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:16:55.000 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:16:55.000 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:55.000 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:55.000 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:55.000 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:55.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:55.001 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:16:55.053 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:16:55.053 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:16:55.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:16:55.119 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:16:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:16:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:16:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:16:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:16:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:16:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:16:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:16:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:16:55.170 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:16:55.171 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:16:55.172 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:16:55.172 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:16:55.172 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:16:55.172 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:16:55.172 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:16:55.172 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:16:55.172 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:16:55.172 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:16:55.173 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:55.173 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:16:55.173 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:55.173 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:16:55.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:55.174 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:16:55.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:16:55.190+0000 7f6f19c16580 -1 init, newargv = 0x55f212ee2e40 newargc=15 2024-09-10T23:16:55.195 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[37023]: starting ceph client 2024-09-10T23:16:55.202 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[37023]: starting fuse 2024-09-10T23:16:55.204 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:16:55.205 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:16:55.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:16:55.205 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:16:55.205 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:16:55.205 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:16:55.205 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:16:55.205 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:55.205 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:16:55.205 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:16:55.206 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:16:55.207 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:16:55.207 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:16:55.207 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:16:55.207 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:55.207 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:16:55.207 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:16:55.334 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.37023.asok 2024-09-10T23:16:55.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:16:55.345 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37023.asok 2024-09-10T23:16:55.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:55.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37023.asok status 2024-09-10T23:16:55.520 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:16:55.520 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:16:55.520 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "37023", 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 5223, 2024-09-10T23:16:55.521 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 5223 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3863286157 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:16:55.522 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3863286157 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.5223 192.168.0.1:0/3863286157", 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/3863286157", 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 19, 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 42, 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:16:55.523 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:16:55.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:55.535 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:16:55.535 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:55.544 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:16:55.544 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:55.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:55.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:16:55.608 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-10T23:16:55.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 -- 172.21.15.17:0/1449227878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 msgr2=0x7fa164072c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 --2- 172.21.15.17:0/1449227878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 0x7fa164072c50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009c80 tx=0x7fa15c01cda0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 -- 172.21.15.17:0/1449227878 shutdown_connections 2024-09-10T23:16:55.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 --2- 172.21.15.17:0/1449227878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 0x7fa164072c50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 -- 172.21.15.17:0/1449227878 >> 172.21.15.17:0/1449227878 conn(0x7fa1640b17a0 msgr2=0x7fa1640b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:55.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 -- 172.21.15.17:0/1449227878 shutdown_connections 2024-09-10T23:16:55.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 -- 172.21.15.17:0/1449227878 wait complete. 2024-09-10T23:16:55.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 Processor -- start 2024-09-10T23:16:55.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 -- start start 2024-09-10T23:16:55.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa164145800 0x7fa164143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 0x7fa16415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa164160460 0x7fa164144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa16416a3f0 con 0x7fa16415fe80 2024-09-10T23:16:55.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa16416a270 con 0x7fa164145800 2024-09-10T23:16:55.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.794+0000 7fa16ae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa16416a570 con 0x7fa164160460 2024-09-10T23:16:55.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa15be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 0x7fa16415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa15be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 0x7fa16415aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52066/0 (socket says 172.21.15.17:52066) 2024-09-10T23:16:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa15be00640 1 -- 172.21.15.17:0/880453207 learned_addr learned my addr 172.21.15.17:0/880453207 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:16:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa163e00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa164145800 0x7fa164143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa168e00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa164160460 0x7fa164144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa15be00640 1 -- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa164160460 msgr2=0x7fa164144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa15be00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa164160460 0x7fa164144710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa15be00640 1 -- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa164145800 msgr2=0x7fa164143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa15be00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa164145800 0x7fa164143d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa15be00640 1 -- 172.21.15.17:0/880453207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa164142fa0 con 0x7fa16415fe80 2024-09-10T23:16:55.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa15be00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 0x7fa16415aeb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b3e0 tx=0x7fa14c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:55.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa160c00640 1 -- 172.21.15.17:0/880453207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c015020 con 0x7fa16415fe80 2024-09-10T23:16:55.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa160c00640 1 -- 172.21.15.17:0/880453207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa14c011920 con 0x7fa16415fe80 2024-09-10T23:16:55.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa160c00640 1 -- 172.21.15.17:0/880453207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c011db0 con 0x7fa16415fe80 2024-09-10T23:16:55.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa164143280 con 0x7fa16415fe80 2024-09-10T23:16:55.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa164143840 con 0x7fa16415fe80 2024-09-10T23:16:55.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa164143a40 con 0x7fa16415fe80 2024-09-10T23:16:55.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.798+0000 7fa160c00640 1 -- 172.21.15.17:0/880453207 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa14c01a400 con 0x7fa16415fe80 2024-09-10T23:16:55.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.802+0000 7fa160c00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1400725e0 0x7fa140074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:16:55.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.802+0000 7fa160c00640 1 -- 172.21.15.17:0/880453207 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6101+0+0 (secure 0 0 0) 0x7fa14c093200 con 0x7fa16415fe80 2024-09-10T23:16:55.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.802+0000 7fa163e00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1400725e0 0x7fa140074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:16:55.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.802+0000 7fa163e00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1400725e0 0x7fa140074aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa154007fd0 tx=0x7fa154009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:16:55.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:55.806+0000 7fa160c00640 1 -- 172.21.15.17:0/880453207 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa164143a40 con 0x7fa16415fe80 2024-09-10T23:16:56.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.018+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fa16413dfc0 con 0x7fa16415fe80 2024-09-10T23:16:56.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.050+0000 7fa160c00640 1 -- 172.21.15.17:0/880453207 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v20) ==== 167+0+0 (secure 0 0 0) 0x7fa14c01f030 con 0x7fa16415fe80 2024-09-10T23:16:56.055 INFO:teuthology.orchestra.run.smithi017.stderr:enabled new snapshots 2024-09-10T23:16:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1400725e0 msgr2=0x7fa140074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1400725e0 0x7fa140074aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa154007fd0 tx=0x7fa154009040 comp rx=0 tx=0).stop 2024-09-10T23:16:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 msgr2=0x7fa16415aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:16:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 0x7fa16415aeb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b3e0 tx=0x7fa14c00b8a0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 shutdown_connections 2024-09-10T23:16:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1400725e0 0x7fa140074aa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa164160460 0x7fa164144710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa16415fe80 0x7fa16415aeb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 --2- 172.21.15.17:0/880453207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa164145800 0x7fa164143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:16:56.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 >> 172.21.15.17:0/880453207 conn(0x7fa1640b17a0 msgr2=0x7fa164142540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:16:56.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 shutdown_connections 2024-09-10T23:16:56.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:16:56.054+0000 7fa16ae00640 1 -- 172.21.15.17:0/880453207 wait complete. 2024-09-10T23:16:56.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:16:56.077 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-10T23:16:56.093 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:16:56.093 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:16:56.147 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:16:56.147 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:16:56.147 DEBUG:teuthology.orchestra.run.smithi017:> import uuid 2024-09-10T23:16:56.147 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:56.147 DEBUG:teuthology.orchestra.run.smithi017:> n = 2000 2024-09-10T23:16:56.147 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = False 2024-09-10T23:16:56.147 DEBUG:teuthology.orchestra.run.smithi017:> if 3 > 0: 2024-09-10T23:16:56.148 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = True 2024-09-10T23:16:56.148 DEBUG:teuthology.orchestra.run.smithi017:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-10T23:16:56.148 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:56.148 DEBUG:teuthology.orchestra.run.smithi017:> dpath = os.path.dirname(path) 2024-09-10T23:16:56.148 DEBUG:teuthology.orchestra.run.smithi017:> fnameprefix = os.path.basename(path) 2024-09-10T23:16:56.148 DEBUG:teuthology.orchestra.run.smithi017:> os.makedirs(dpath, exist_ok=True) 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> try: 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> for i in range(n): 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> with open(fpath, '"'"'w'"'"') as f: 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> f.write(f"{i}") 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> f.flush() 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f.fileno()) 2024-09-10T23:16:56.149 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> os.unlink(fpath) 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> if create_hard_links: 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> for j in range(3): 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> finally: 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> os.close(dirfd) 2024-09-10T23:16:56.150 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:17:04.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:17:04.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:17:33.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:17:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:17:33.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:33.736 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-10T23:17:33.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:17:33.782 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-10T23:17:34.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:17:34.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:18:04.402 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:18:04.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:18:09.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:09.090 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-10T23:18:09.137 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-10T23:18:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 -- 172.21.15.17:0/623946077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c0d23e0 msgr2=0x7fa59c071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 --2- 172.21.15.17:0/623946077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c0d23e0 0x7fa59c071060 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0cf800 tx=0x7fa59401cd80 comp rx=0 tx=0).stop 2024-09-10T23:18:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 -- 172.21.15.17:0/623946077 shutdown_connections 2024-09-10T23:18:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 --2- 172.21.15.17:0/623946077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c0d23e0 0x7fa59c071060 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 --2- 172.21.15.17:0/623946077 >> v2:172.21.15.77:3300/0 conn(0x7fa59c15f210 0x7fa59c0cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 -- 172.21.15.17:0/623946077 >> 172.21.15.17:0/623946077 conn(0x7fa59c09a9f0 msgr2=0x7fa59c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 -- 172.21.15.17:0/623946077 shutdown_connections 2024-09-10T23:18:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 -- 172.21.15.17:0/623946077 wait complete. 2024-09-10T23:18:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 Processor -- start 2024-09-10T23:18:09.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 -- start start 2024-09-10T23:18:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa59c0d0320 0x7fa59c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa59c0d23e0 0x7fa59c0b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c15f210 0x7fa59c164530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c168a70 con 0x7fa59c15f210 2024-09-10T23:18:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c1688f0 con 0x7fa59c0d23e0 2024-09-10T23:18:09.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a4600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa59c168bf0 con 0x7fa59c0d0320 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c15f210 0x7fa59c164530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c15f210 0x7fa59c164530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36374/0 (socket says 172.21.15.17:36374) 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a2600640 1 -- 172.21.15.17:0/3744060674 learned_addr learned my addr 172.21.15.17:0/3744060674 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a1200640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa59c0d23e0 0x7fa59c0b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a1c00640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa59c0d0320 0x7fa59c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a2600640 1 -- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa59c0d0320 msgr2=0x7fa59c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa59c0d0320 0x7fa59c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a2600640 1 -- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa59c0d23e0 msgr2=0x7fa59c0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa59c0d23e0 0x7fa59c0b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.326+0000 7fa5a2600640 1 -- 172.21.15.17:0/3744060674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c0af5d0 con 0x7fa59c15f210 2024-09-10T23:18:09.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.330+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c15f210 0x7fa59c164530 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa594019990 tx=0x7fa5940092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.330+0000 7fa599600640 1 -- 172.21.15.17:0/3744060674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940bb070 con 0x7fa59c15f210 2024-09-10T23:18:09.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.330+0000 7fa599600640 1 -- 172.21.15.17:0/3744060674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa594004d40 con 0x7fa59c15f210 2024-09-10T23:18:09.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.330+0000 7fa599600640 1 -- 172.21.15.17:0/3744060674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940b2040 con 0x7fa59c15f210 2024-09-10T23:18:09.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.330+0000 7fa5a4600640 1 -- 172.21.15.17:0/3744060674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59c0af8b0 con 0x7fa59c15f210 2024-09-10T23:18:09.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.330+0000 7fa5a4600640 1 -- 172.21.15.17:0/3744060674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59c0b0150 con 0x7fa59c15f210 2024-09-10T23:18:09.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.330+0000 7fa599600640 1 -- 172.21.15.17:0/3744060674 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa5940b5030 con 0x7fa59c15f210 2024-09-10T23:18:09.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa599600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa57c0725e0 0x7fa57c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 Processor -- start 2024-09-10T23:18:09.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa599600640 1 -- 172.21.15.17:0/3744060674 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6130+0+0 (secure 0 0 0) 0x7fa59412ce70 con 0x7fa59c15f210 2024-09-10T23:18:09.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 -- start start 2024-09-10T23:18:09.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a1c00640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa57c0725e0 0x7fa57c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d500e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a1c00640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa57c0725e0 0x7fa57c074aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa59c163f40 tx=0x7fa5900091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d5013d0 0x55658d5017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d4b75a0 0x55658d4b7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55658d2b52c0 con 0x55658d4b75a0 2024-09-10T23:18:09.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55658d312b90 con 0x55658d5013d0 2024-09-10T23:18:09.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55658d301fc0 con 0x55658d39f1d0 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d4b75a0 0x55658d4b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a1c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d500e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d4b75a0 0x55658d4b7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36376/0 (socket says 172.21.15.17:36376) 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a2600640 1 -- 172.21.15.17:0/3207748196 learned_addr learned my addr 172.21.15.17:0/3207748196 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a1200640 1 --2- 172.21.15.17:0/3207748196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d5013d0 0x55658d5017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a2600640 1 -- 172.21.15.17:0/3207748196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 msgr2=0x55658d500e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3207748196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d500e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a2600640 1 -- 172.21.15.17:0/3207748196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d5013d0 msgr2=0x55658d5017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3207748196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d5013d0 0x55658d5017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a2600640 1 -- 172.21.15.17:0/3207748196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658d2a01a0 con 0x55658d4b75a0 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3207748196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d4b75a0 0x55658d4b7980 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa59401a9b0 tx=0x7fa5940f4440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e468f49fbe2c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa58e000640 1 -- 172.21.15.17:0/3207748196 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940f7430 con 0x55658d4b75a0 2024-09-10T23:18:09.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa58e000640 1 -- 172.21.15.17:0/3207748196 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5940f77d0 con 0x55658d4b75a0 2024-09-10T23:18:09.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa58e000640 1 -- 172.21.15.17:0/3207748196 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940f7cc0 con 0x55658d4b75a0 2024-09-10T23:18:09.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 -- 172.21.15.17:0/3207748196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d4b75a0 msgr2=0x55658d4b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3207748196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d4b75a0 0x55658d4b7980 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa59401a9b0 tx=0x7fa5940f4440 comp rx=0 tx=0).stop 2024-09-10T23:18:09.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 -- 172.21.15.17:0/3207748196 shutdown_connections 2024-09-10T23:18:09.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3207748196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d4b75a0 0x55658d4b7980 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3207748196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d5013d0 0x55658d5017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3207748196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d500e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 -- 172.21.15.17:0/3207748196 >> 172.21.15.17:0/3207748196 conn(0x55658cfc0880 msgr2=0x55658d4b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 -- 172.21.15.17:0/3207748196 shutdown_connections 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.334+0000 7fa5a7918000 1 -- 172.21.15.17:0/3207748196 wait complete. 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 -- start start 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 Processor -- start 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d507a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d507f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55658d2a74d0 con 0x55658d5013d0 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55658d305dd0 con 0x55658d4b75a0 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55658cfc7620 con 0x55658d39f1d0 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 10 client.0 _ll_register_callbacks cb 0x55658d2d8cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a1200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d507f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36390/0 (socket says 172.21.15.17:36390) 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a2600640 1 -- 172.21.15.17:0/4015535307 learned_addr learned my addr 172.21.15.17:0/4015535307 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a1c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d507a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a2600640 1 -- 172.21.15.17:0/4015535307 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 msgr2=0x55658d507a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a2600640 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d507a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a2600640 1 -- 172.21.15.17:0/4015535307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 msgr2=0x55658d507f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a2600640 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d507f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a2600640 1 -- 172.21.15.17:0/4015535307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55658d3d1720 con 0x55658d5013d0 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a1200640 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d507f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a2600640 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5084a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa5940f7c50 tx=0x7fa5940a5eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e77b3a96fc57a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa582a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa582a00640 1 -- 172.21.15.17:0/4015535307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940f77d0 con 0x55658d5013d0 2024-09-10T23:18:09.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 -- 172.21.15.17:0/4015535307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55658d29a2e0 con 0x55658d5013d0 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa582a00640 1 -- 172.21.15.17:0/4015535307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6130+0+0 (secure 0 0 0) 0x7fa5940c0c50 con 0x55658d5013d0 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa582a00640 1 -- 172.21.15.17:0/4015535307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa5940c0e90 con 0x55658d5013d0 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 10 client.5244 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 -- 172.21.15.17:0/4015535307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55658d387420 con 0x55658d5013d0 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa582a00640 1 -- 172.21.15.17:0/4015535307 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55658d29a2e0 con 0x55658d5013d0 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa582a00640 1 -- 172.21.15.17:0/4015535307 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fa5940f6f20 con 0x55658d5013d0 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 10 client.5244 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 10 client.5244 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 20 client.5244 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55658d50fdf0 0x55658d5121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 4 client.5244 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:09.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a7918000 1 -- 172.21.15.17:0/4015535307 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55658d314ae0 con 0x55658d50fdf0 2024-09-10T23:18:09.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.338+0000 7fa5a1c00640 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55658d50fdf0 0x55658d5121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a1c00640 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55658d50fdf0 0x55658d5121e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afd3aad1239b14f5 server_cookie=2cbe260d3c7057f3 in_seq=0 out_seq=0 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa582a00640 10 client.5244 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa582a00640 1 -- 172.21.15.17:0/4015535307 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55658d314ae0 con 0x55658d50fdf0 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa582a00640 10 client.5244 handle_command_reply: tid=0 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 client.5244 shutdown 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 -- 172.21.15.17:0/4015535307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 msgr2=0x55658d5084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5084a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa5940f7c50 tx=0x7fa5940a5eb0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 -- 172.21.15.17:0/4015535307 shutdown_connections 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55658d50fdf0 0x55658d5121e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5084a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d507f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 --2- 172.21.15.17:0/4015535307 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d507a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa582a00640 0 client.5244 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 -- 172.21.15.17:0/4015535307 >> 172.21.15.17:0/4015535307 conn(0x55658cfc0880 msgr2=0x55658d4b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 -- 172.21.15.17:0/4015535307 shutdown_connections 2024-09-10T23:18:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 1 -- 172.21.15.17:0/4015535307 wait complete. 2024-09-10T23:18:09.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.342+0000 7fa5a7918000 20 client.5244 trim_cache size 0 max 16384 2024-09-10T23:18:09.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a7918000 1 Processor -- start 2024-09-10T23:18:09.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a7918000 1 -- start start 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d573540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d573a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d573fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a7918000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c2044b0 con 0x55658d5013d0 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a7918000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c2034f0 con 0x55658d4b75a0 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a7918000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa59c06ea40 con 0x55658d39f1d0 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d573fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d573fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36392/0 (socket says 172.21.15.17:36392) 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a2600640 1 -- 172.21.15.17:0/3025472414 learned_addr learned my addr 172.21.15.17:0/3025472414 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a1200640 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d573a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a1c00640 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d573540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a2600640 1 -- 172.21.15.17:0/3025472414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 msgr2=0x55658d573540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d573540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a2600640 1 -- 172.21.15.17:0/3025472414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 msgr2=0x55658d573a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d573a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a2600640 1 -- 172.21.15.17:0/3025472414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658d35eae0 con 0x55658d5013d0 2024-09-10T23:18:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.358+0000 7fa5a1200640 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d573a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:09.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d573fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa59401c7f0 tx=0x7fa5940095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0c538d8a544d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa58d600640 1 -- 172.21.15.17:0/3025472414 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940f77d0 con 0x55658d5013d0 2024-09-10T23:18:09.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa58d600640 1 -- 172.21.15.17:0/3025472414 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa594101110 con 0x55658d5013d0 2024-09-10T23:18:09.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa58d600640 1 -- 172.21.15.17:0/3025472414 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940fc6f0 con 0x55658d5013d0 2024-09-10T23:18:09.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 -- 172.21.15.17:0/3025472414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 msgr2=0x55658d573fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d573fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa59401c7f0 tx=0x7fa5940095c0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 -- 172.21.15.17:0/3025472414 shutdown_connections 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d573fc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d573a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3025472414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d573540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 -- 172.21.15.17:0/3025472414 >> 172.21.15.17:0/3025472414 conn(0x55658cfc0880 msgr2=0x55658d4bd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 -- 172.21.15.17:0/3025472414 shutdown_connections 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 -- 172.21.15.17:0/3025472414 wait complete. 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 -- start start 2024-09-10T23:18:09.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 Processor -- start 2024-09-10T23:18:09.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d576f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d577490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5779d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55658d301fc0 con 0x55658d5013d0 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55658d312b90 con 0x55658d4b75a0 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55658d305dd0 con 0x55658d39f1d0 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a7918000 10 client.0 _ll_register_callbacks cb 0x7fa5940faf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5779d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5779d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36404/0 (socket says 172.21.15.17:36404) 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 -- 172.21.15.17:0/3471625801 learned_addr learned my addr 172.21.15.17:0/3471625801 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a1200640 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d577490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a1c00640 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d576f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 -- 172.21.15.17:0/3471625801 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 msgr2=0x55658d576f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d576f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 -- 172.21.15.17:0/3471625801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 msgr2=0x55658d577490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d577490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 -- 172.21.15.17:0/3471625801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55658d2cc040 con 0x55658d5013d0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa5a2600640 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5779d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa59401cbb0 tx=0x7fa594003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede019926fe121fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa582a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.362+0000 7fa582a00640 1 -- 172.21.15.17:0/3471625801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940f7cc0 con 0x55658d5013d0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa582a00640 1 -- 172.21.15.17:0/3471625801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6130+0+0 (secure 0 0 0) 0x7fa59410d1b0 con 0x55658d5013d0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 -- 172.21.15.17:0/3471625801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa594101110 con 0x55658d5013d0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa582a00640 1 -- 172.21.15.17:0/3471625801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa5940fc6f0 con 0x55658d5013d0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 10 client.5250 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 -- 172.21.15.17:0/3471625801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55658d298620 con 0x55658d5013d0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa582a00640 1 -- 172.21.15.17:0/3471625801 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa594101110 con 0x55658d5013d0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa582a00640 1 -- 172.21.15.17:0/3471625801 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fa5940f6990 con 0x55658d5013d0 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 10 client.5250 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 10 client.5250 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 20 client.5250 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55658d516320 0x55658d516730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 4 client.5250 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-10T23:18:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 -- 172.21.15.17:0/3471625801 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55658d310590 con 0x55658d516320 2024-09-10T23:18:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a1c00640 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55658d516320 0x55658d516730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a1c00640 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55658d516320 0x55658d516730 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baead181b118e280 server_cookie=c4907aa8408ac6ad in_seq=0 out_seq=0 2024-09-10T23:18:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa582a00640 10 client.5250 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa582a00640 1 -- 172.21.15.17:0/3471625801 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18094 (crc 0 0 0) 0x55658d310590 con 0x55658d516320 2024-09-10T23:18:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa582a00640 10 client.5250 handle_command_reply: tid=0 2024-09-10T23:18:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 client.5250 shutdown 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 -- 172.21.15.17:0/3471625801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 msgr2=0x55658d5779d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5779d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa59401cbb0 tx=0x7fa594003d30 comp rx=0 tx=0).stop 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 -- 172.21.15.17:0/3471625801 shutdown_connections 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55658d516320 0x55658d516730 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55658d5013d0 0x55658d5779d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55658d4b75a0 0x55658d577490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 --2- 172.21.15.17:0/3471625801 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55658d39f1d0 0x55658d576f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa582a00640 0 client.5250 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 -- 172.21.15.17:0/3471625801 >> 172.21.15.17:0/3471625801 conn(0x55658cfc0880 msgr2=0x55658d4b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 -- 172.21.15.17:0/3471625801 shutdown_connections 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 1 -- 172.21.15.17:0/3471625801 wait complete. 2024-09-10T23:18:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a7918000 20 client.5250 trim_cache size 0 max 16384 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4260, 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 4259, 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1056790, 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 39154564, 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 9, 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 3, 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.510691127, 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.279129414, 2024-09-10T23:18:09.375 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.088665533, 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.109083722, 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 4258, 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.488992462, 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000114840 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2, 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000157, 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000078 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-09-10T23:18:09.376 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 2401, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2396, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 704674, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 17555643, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.292809484, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.154934983, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.059245384, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.058543190, 2024-09-10T23:18:09.377 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2396, 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.496985640, 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000207423 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 126288, 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 23280 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:18:09.378 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 34202, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 60143, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 12297179, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 52104434, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 8, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 6.420164010, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 3.687155054, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 2.863559688, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.451797881, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 60141, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.702490115, 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000028308 2024-09-10T23:18:09.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 88554, 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.017721899, 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000200 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 85952 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.380 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 9445, 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 14.689503775, 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001555267 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1755, 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.443535511, 2024-09-10T23:18:09.381 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000252726 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 28269, 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 28269, 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 28269, 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 270.073703071, 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.009553705 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 0, 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-09-10T23:18:09.382 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 12, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 19888, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 19888, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 0, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 19888, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 0, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 379, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 379, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 2, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 46030, 2024-09-10T23:18:09.383 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 45455, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 118, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:18:09.384 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 6157, 2024-09-10T23:18:09.385 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 6018, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 6157, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 2000, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 30, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 17843 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2024-09-10T23:18:09.386 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 2000, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 1, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 4192, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 1623, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 2250, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:18:09.387 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_succeeded": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_write_failed": 0 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-09-10T23:18:09.388 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 21885, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 21885, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 29, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 29, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 3, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-09-10T23:18:09.389 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 81794683, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 0, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6609, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 81.907770489, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.012393368 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 0 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 2014, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 2014, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 0, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 13, 2024-09-10T23:18:09.390 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 13, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 0, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 19888, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 19888, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 0, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 379, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 2002, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 1623, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 110684, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 322846720 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 37307, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 28269, 2024-09-10T23:18:09.391 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 6, 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 0, 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2000, 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.654427759, 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000827213 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1999, 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.601509299, 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000300905 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-09-10T23:18:09.392 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6000, 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 10.419111576, 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001736518 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8007, 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 5.279149780, 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000659316 2024-09-10T23:18:09.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.394 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.020169414, 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.006723138 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-09-10T23:18:09.395 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.002959964, 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002959964 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.396 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.005944958, 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.005944958 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6, 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.090302563, 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.015050427 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2250, 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 231.824953332, 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.103033312 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.004597527, 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.004597527 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:18:09.400 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000270131, 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000270131 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.401 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.402 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8000, 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 20.170306768, 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002521288 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 18453, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 18453, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 73, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:18:09.404 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:18:09.405 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:18:09.406 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 17091196, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 4320, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-10T23:18:09.407 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 5520, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 78, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 20898303, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 816248, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-10T23:18:09.408 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 8497, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 77797669, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 31, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 8497, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8497, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 30.215751037, 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003556049 2024-09-10T23:18:09.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8497, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 8575 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 8497, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 61, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 8436, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 0, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 11, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 61, 2024-09-10T23:18:09.410 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 6670, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 40, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 1623, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 30, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 0, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 22, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:18:09.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-09-10T23:18:09.412 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 44, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 3, 2024-09-10T23:18:09.413 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 8, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 8, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 99, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 0, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 19 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 1, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 32, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 32, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 1623, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 1623, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 40859, 2024-09-10T23:18:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 10375967, 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 40859, 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 40859, 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 10375967, 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 8497, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 77974576, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 8497, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 77974576, 2024-09-10T23:18:09.417 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T23:18:09.418 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 8497, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 8497, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 8497, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 8497, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:09.419 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 1623, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 176907, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 1623, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 61, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 176907, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.420 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x5572e5b7a500": { 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 84, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 21885, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 77600379, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 21885, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 6609, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 77600295, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:09.421 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:09.422 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:09.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.422 INFO:teuthology.orchestra.run.smithi017.stdout: "trackedop": { 2024-09-10T23:18:09.422 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-09-10T23:18:09.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.422 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:18:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 -- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa57c0725e0 msgr2=0x7fa57c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa57c0725e0 0x7fa57c074aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa59c163f40 tx=0x7fa5900091e0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 -- 172.21.15.17:0/3744060674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c15f210 msgr2=0x7fa59c164530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c15f210 0x7fa59c164530 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa594019990 tx=0x7fa5940092e0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 -- 172.21.15.17:0/3744060674 shutdown_connections 2024-09-10T23:18:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa57c0725e0 0x7fa57c074aa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c15f210 0x7fa59c164530 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa59c0d23e0 0x7fa59c0b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 --2- 172.21.15.17:0/3744060674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa59c0d0320 0x7fa59c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 -- 172.21.15.17:0/3744060674 >> 172.21.15.17:0/3744060674 conn(0x7fa59c09a9f0 msgr2=0x7fa59c15e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 -- 172.21.15.17:0/3744060674 shutdown_connections 2024-09-10T23:18:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.366+0000 7fa5a4600640 1 -- 172.21.15.17:0/3744060674 wait complete. 2024-09-10T23:18:09.425 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-10T23:18:09.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:09.425 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-09-10T23:18:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.570+0000 7ff11ec00640 1 -- 172.21.15.17:0/187526059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 msgr2=0x7ff1180ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.570+0000 7ff11ec00640 1 --2- 172.21.15.17:0/187526059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 0x7ff1180ce3b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff1180cf800 tx=0x7ff11001cac0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.570+0000 7ff11ec00640 1 -- 172.21.15.17:0/187526059 shutdown_connections 2024-09-10T23:18:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.570+0000 7ff11ec00640 1 --2- 172.21.15.17:0/187526059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 0x7ff1180ce3b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.570+0000 7ff11ec00640 1 --2- 172.21.15.17:0/187526059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1180d0320 0x7ff1180d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.570+0000 7ff11ec00640 1 --2- 172.21.15.17:0/187526059 >> v2:172.21.15.77:3300/0 conn(0x7ff11815f210 0x7ff1180cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.570+0000 7ff11ec00640 1 -- 172.21.15.17:0/187526059 >> 172.21.15.17:0/187526059 conn(0x7ff11809a9f0 msgr2=0x7ff11809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.570+0000 7ff11ec00640 1 -- 172.21.15.17:0/187526059 shutdown_connections 2024-09-10T23:18:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.570+0000 7ff11ec00640 1 -- 172.21.15.17:0/187526059 wait complete. 2024-09-10T23:18:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 Processor -- start 2024-09-10T23:18:09.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 -- start start 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180d0320 0x7ff118154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 0x7ff1180c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815f210 0x7ff1180b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1180718a0 con 0x7ff1180d2210 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff118071720 con 0x7ff1180d0320 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff118071a20 con 0x7ff11815f210 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff10f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 0x7ff1180c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff10f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 0x7ff1180c4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36430/0 (socket says 172.21.15.17:36430) 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff10f400640 1 -- 172.21.15.17:0/1545005322 learned_addr learned my addr 172.21.15.17:0/1545005322 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff117e00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180d0320 0x7ff118154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11cc00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815f210 0x7ff1180b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff10f400640 1 -- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815f210 msgr2=0x7ff1180b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff10f400640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815f210 0x7ff1180b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff10f400640 1 -- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180d0320 msgr2=0x7ff118154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff10f400640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180d0320 0x7ff118154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff10f400640 1 -- 172.21.15.17:0/1545005322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1180b3ff0 con 0x7ff1180d2210 2024-09-10T23:18:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff117e00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180d0320 0x7ff118154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:09.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff10f400640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 0x7ff1180c4b00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c970 tx=0x7ff10000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff114c00640 1 -- 172.21.15.17:0/1545005322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100007c70 con 0x7ff1180d2210 2024-09-10T23:18:09.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff114c00640 1 -- 172.21.15.17:0/1545005322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff10000f450 con 0x7ff1180d2210 2024-09-10T23:18:09.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff114c00640 1 -- 172.21.15.17:0/1545005322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10000f8a0 con 0x7ff1180d2210 2024-09-10T23:18:09.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 -- 172.21.15.17:0/1545005322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1180b34b0 con 0x7ff1180d2210 2024-09-10T23:18:09.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.574+0000 7ff11ec00640 1 -- 172.21.15.17:0/1545005322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1180b3a30 con 0x7ff1180d2210 2024-09-10T23:18:09.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.578+0000 7ff114c00640 1 -- 172.21.15.17:0/1545005322 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff10000fa40 con 0x7ff1180d2210 2024-09-10T23:18:09.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.578+0000 7ff121f7f000 1 Processor -- start 2024-09-10T23:18:09.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.578+0000 7ff121f7f000 1 -- start start 2024-09-10T23:18:09.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.578+0000 7ff114c00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0f40725e0 0x7ff0f4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.578+0000 7ff114c00640 1 -- 172.21.15.17:0/1545005322 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6130+0+0 (secure 0 0 0) 0x7ff100093d00 con 0x7ff1180d2210 2024-09-10T23:18:09.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.578+0000 7ff11cc00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0f40725e0 0x7ff0f4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 0x559f50481030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 0x559f50481950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559f502d8890 con 0x559f504ca6d0 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559f502c7cc0 con 0x559f50481570 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559f502cbad0 con 0x559f504caff0 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff117e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff117e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36440/0 (socket says 172.21.15.17:36440) 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff117e00640 1 -- 172.21.15.17:0/1439700337 learned_addr learned my addr 172.21.15.17:0/1439700337 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff11cc00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0f40725e0 0x7ff0f4074aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1100af000 tx=0x7ff11001b300 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff10f400640 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 0x559f50481030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff11cc00640 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 0x559f50481950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff117e00640 1 -- 172.21.15.17:0/1439700337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 msgr2=0x559f50481030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff117e00640 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 0x559f50481030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff117e00640 1 -- 172.21.15.17:0/1439700337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 msgr2=0x559f50481950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff117e00640 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 0x559f50481950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff117e00640 1 -- 172.21.15.17:0/1439700337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f5027b4c0 con 0x559f504ca6d0 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff11cc00640 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 0x559f50481950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff117e00640 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504caab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff10800cc50 tx=0x7ff10800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a4058efe471b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff10cc00640 1 -- 172.21.15.17:0/1439700337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108014070 con 0x559f504ca6d0 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff10cc00640 1 -- 172.21.15.17:0/1439700337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff108005310 con 0x559f504ca6d0 2024-09-10T23:18:09.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff10cc00640 1 -- 172.21.15.17:0/1439700337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1080047b0 con 0x559f504ca6d0 2024-09-10T23:18:09.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 -- 172.21.15.17:0/1439700337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 msgr2=0x559f504caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504caab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff10800cc50 tx=0x7ff10800e720 comp rx=0 tx=0).stop 2024-09-10T23:18:09.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 -- 172.21.15.17:0/1439700337 shutdown_connections 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 0x559f50481950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 0x559f50481030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1439700337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504caab0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 -- 172.21.15.17:0/1439700337 >> 172.21.15.17:0/1439700337 conn(0x559f50479110 msgr2=0x559f5047b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 -- 172.21.15.17:0/1439700337 shutdown_connections 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 -- 172.21.15.17:0/1439700337 wait complete. 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 -- start start 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.582+0000 7ff121f7f000 1 Processor -- start 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 0x559f504d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 0x559f504d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559f50287a00 con 0x559f504ca6d0 2024-09-10T23:18:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559f50271ca0 con 0x559f50481570 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559f5027ff50 con 0x559f504caff0 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 10 client.0 _ll_register_callbacks cb 0x559f50467b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff10f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff10f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36446/0 (socket says 172.21.15.17:36446) 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff10f400640 1 -- 172.21.15.17:0/3107687358 learned_addr learned my addr 172.21.15.17:0/3107687358 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff117e00640 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 0x559f504d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff11cc00640 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 0x559f504d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff10f400640 1 -- 172.21.15.17:0/3107687358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 msgr2=0x559f504d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff10f400640 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 0x559f504d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff10f400640 1 -- 172.21.15.17:0/3107687358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 msgr2=0x559f504d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff10f400640 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 0x559f504d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff10f400640 1 -- 172.21.15.17:0/3107687358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f50270e80 con 0x559f504ca6d0 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff11cc00640 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 0x559f504d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff10f400640 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504d1b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff100091fe0 tx=0x7ff10000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1037ec734ef1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 1 -- 172.21.15.17:0/3107687358 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10001d070 con 0x559f504ca6d0 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 1 -- 172.21.15.17:0/3107687358 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6130+0+0 (secure 0 0 0) 0x7ff100067d00 con 0x559f504ca6d0 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- 172.21.15.17:0/3107687358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f502603b0 con 0x559f504ca6d0 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 1 -- 172.21.15.17:0/3107687358 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff100063340 con 0x559f504ca6d0 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 10 client.5262 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- 172.21.15.17:0/3107687358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x559f5026d4e0 con 0x559f504ca6d0 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 1 -- 172.21.15.17:0/3107687358 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff10008c070 con 0x559f504ca6d0 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 1 -- 172.21.15.17:0/3107687358 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7ff10005dcf0 con 0x559f504ca6d0 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 10 client.5262 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 10 client.5262 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 20 client.5262 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x559f504d9a10 0x559f504dbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 4 client.5262 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:09.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- 172.21.15.17:0/3107687358 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f502da7e0 con 0x559f504d9a10 2024-09-10T23:18:09.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff117e00640 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x559f504d9a10 0x559f504dbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 10 client.5262 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff117e00640 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x559f504d9a10 0x559f504dbe00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2952525811ef831f server_cookie=70e611205d4650f2 in_seq=0 out_seq=0 2024-09-10T23:18:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 1 -- 172.21.15.17:0/3107687358 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f502da7e0 con 0x559f504d9a10 2024-09-10T23:18:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 10 client.5262 handle_command_reply: tid=0 2024-09-10T23:18:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 client.5262 shutdown 2024-09-10T23:18:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- 172.21.15.17:0/3107687358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 msgr2=0x559f504d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504d1b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff100091fe0 tx=0x7ff10000ff90 comp rx=0 tx=0).stop 2024-09-10T23:18:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- 172.21.15.17:0/3107687358 shutdown_connections 2024-09-10T23:18:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x559f504d9a10 0x559f504dbe00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f504caff0 0x559f504d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504d1b80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 --2- 172.21.15.17:0/3107687358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f50481570 0x559f504d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff105600640 0 client.5262 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- 172.21.15.17:0/3107687358 >> 172.21.15.17:0/3107687358 conn(0x559f50479110 msgr2=0x559f50482380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- 172.21.15.17:0/3107687358 shutdown_connections 2024-09-10T23:18:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.586+0000 7ff121f7f000 1 -- 172.21.15.17:0/3107687358 wait complete. 2024-09-10T23:18:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.590+0000 7ff121f7f000 20 client.5262 trim_cache size 0 max 16384 2024-09-10T23:18:09.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff121f7f000 1 Processor -- start 2024-09-10T23:18:09.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff121f7f000 1 -- start start 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 0x559f504c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 0x559f504794f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff121f7f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff11806f930 con 0x559f504ca6d0 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff121f7f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff11815cd80 con 0x559f504caff0 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff121f7f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff11806f2e0 con 0x559f50481570 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff10f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff10f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36450/0 (socket says 172.21.15.17:36450) 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff10f400640 1 -- 172.21.15.17:0/335448993 learned_addr learned my addr 172.21.15.17:0/335448993 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff117e00640 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 0x559f504c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff11cc00640 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 0x559f504794f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff10f400640 1 -- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 msgr2=0x559f504c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff10f400640 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 0x559f504c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff10f400640 1 -- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 msgr2=0x559f504794f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff10f400640 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 0x559f504794f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff10f400640 1 -- 172.21.15.17:0/335448993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f50295dd0 con 0x559f504ca6d0 2024-09-10T23:18:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff117e00640 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 0x559f504c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.606+0000 7ff11cc00640 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 0x559f504794f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:09.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504c9a00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff100063590 tx=0x7ff100063680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3bc1e8f380a5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff107e00640 1 -- 172.21.15.17:0/335448993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10001d070 con 0x559f504ca6d0 2024-09-10T23:18:09.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff107e00640 1 -- 172.21.15.17:0/335448993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff10008c070 con 0x559f504ca6d0 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff107e00640 1 -- 172.21.15.17:0/335448993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100067b00 con 0x559f504ca6d0 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 -- 172.21.15.17:0/335448993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 msgr2=0x559f504c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504c9a00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff100063590 tx=0x7ff100063680 comp rx=0 tx=0).stop 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 -- 172.21.15.17:0/335448993 shutdown_connections 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 0x559f504794f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f504c9a00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 --2- 172.21.15.17:0/335448993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 0x559f504c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 -- 172.21.15.17:0/335448993 >> 172.21.15.17:0/335448993 conn(0x559f50479110 msgr2=0x559f5048b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 -- 172.21.15.17:0/335448993 shutdown_connections 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 -- 172.21.15.17:0/335448993 wait complete. 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 -- start start 2024-09-10T23:18:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 Processor -- start 2024-09-10T23:18:09.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 0x559f50540b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f505410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 0x559f505415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559f50294e80 con 0x559f504ca6d0 2024-09-10T23:18:09.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559f502d7660 con 0x559f504caff0 2024-09-10T23:18:09.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559f502cade0 con 0x559f50481570 2024-09-10T23:18:09.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff121f7f000 10 client.0 _ll_register_callbacks cb 0x7ff10005b0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:09.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f505410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f505410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36458/0 (socket says 172.21.15.17:36458) 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 -- 172.21.15.17:0/1316182553 learned_addr learned my addr 172.21.15.17:0/1316182553 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff117e00640 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 0x559f50540b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff11cc00640 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 0x559f505415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 -- 172.21.15.17:0/1316182553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 msgr2=0x559f50540b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 0x559f50540b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 -- 172.21.15.17:0/1316182553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 msgr2=0x559f505415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 0x559f505415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 -- 172.21.15.17:0/1316182553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f50266270 con 0x559f504ca6d0 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff10f400640 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f505410b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff10005ea20 tx=0x7ff10005f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9877fc7a78e412d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff105600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.610+0000 7ff105600640 1 -- 172.21.15.17:0/1316182553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10001d070 con 0x559f504ca6d0 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff105600640 1 -- 172.21.15.17:0/1316182553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6130+0+0 (secure 0 0 0) 0x7ff100067d10 con 0x559f504ca6d0 2024-09-10T23:18:09.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff121f7f000 1 -- 172.21.15.17:0/1316182553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff10008c070 con 0x559f504ca6d0 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff105600640 1 -- 172.21.15.17:0/1316182553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff10005a3e0 con 0x559f504ca6d0 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff121f7f000 10 client.5268 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff121f7f000 1 -- 172.21.15.17:0/1316182553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x559f4ff7e150 con 0x559f504ca6d0 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff105600640 1 -- 172.21.15.17:0/1316182553 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff100083e50 con 0x559f504ca6d0 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff105600640 1 -- 172.21.15.17:0/1316182553 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7ff10005a580 con 0x559f504ca6d0 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff121f7f000 10 client.5268 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff121f7f000 10 client.5268 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff121f7f000 20 client.5268 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x559f504d6df0 0x559f504d7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff121f7f000 4 client.5268 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff121f7f000 1 -- 172.21.15.17:0/1316182553 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x559f502d6290 con 0x559f504d6df0 2024-09-10T23:18:09.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff117e00640 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x559f504d6df0 0x559f504d7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff117e00640 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x559f504d6df0 0x559f504d7200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdafa42b35ca86d6 server_cookie=5aedcbcc7807f27b in_seq=0 out_seq=0 2024-09-10T23:18:09.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.614+0000 7ff105600640 10 client.5268 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff105600640 1 -- 172.21.15.17:0/1316182553 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559f502d6290 con 0x559f504d6df0 2024-09-10T23:18:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff105600640 10 client.5268 handle_command_reply: tid=0 2024-09-10T23:18:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 client.5268 shutdown 2024-09-10T23:18:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 -- 172.21.15.17:0/1316182553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 msgr2=0x559f505410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f505410b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff10005ea20 tx=0x7ff10005f2f0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 -- 172.21.15.17:0/1316182553 shutdown_connections 2024-09-10T23:18:09.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x559f504d6df0 0x559f504d7200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559f504caff0 0x559f505415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f504ca6d0 0x559f505410b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 --2- 172.21.15.17:0/1316182553 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559f50481570 0x559f50540b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 -- 172.21.15.17:0/1316182553 >> 172.21.15.17:0/1316182553 conn(0x559f50479110 msgr2=0x559f504c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff105600640 0 client.5268 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 -- 172.21.15.17:0/1316182553 shutdown_connections 2024-09-10T23:18:09.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 1 -- 172.21.15.17:0/1316182553 wait complete. 2024-09-10T23:18:09.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff121f7f000 20 client.5268 trim_cache size 0 max 16384 2024-09-10T23:18:09.627 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:18:09.627 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:18:09.627 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "253c4081-7cac-4b76-8938-a6488f037761", 2024-09-10T23:18:09.627 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:18:09.627 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:18:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 -- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0f40725e0 msgr2=0x7ff0f4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0f40725e0 0x7ff0f4074aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1100af000 tx=0x7ff11001b300 comp rx=0 tx=0).stop 2024-09-10T23:18:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 -- 172.21.15.17:0/1545005322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 msgr2=0x7ff1180c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 0x7ff1180c4b00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c970 tx=0x7ff10000ce30 comp rx=0 tx=0).stop 2024-09-10T23:18:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 -- 172.21.15.17:0/1545005322 shutdown_connections 2024-09-10T23:18:09.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0f40725e0 0x7ff0f4074aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff11815f210 0x7ff1180b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1180d2210 0x7ff1180c4b00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 --2- 172.21.15.17:0/1545005322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1180d0320 0x7ff118154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 -- 172.21.15.17:0/1545005322 >> 172.21.15.17:0/1545005322 conn(0x7ff11809a9f0 msgr2=0x7ff118158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 -- 172.21.15.17:0/1545005322 shutdown_connections 2024-09-10T23:18:09.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.622+0000 7ff11ec00640 1 -- 172.21.15.17:0/1545005322 wait complete. 2024-09-10T23:18:09.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:09.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-10T23:18:09.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 -- 172.21.15.17:0/2267911732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40074b90 msgr2=0x7f8a400ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 --2- 172.21.15.17:0/2267911732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40074b90 0x7f8a400ca7f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a400717e0 tx=0x7f8a3001dbf0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 -- 172.21.15.17:0/2267911732 shutdown_connections 2024-09-10T23:18:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 --2- 172.21.15.17:0/2267911732 >> v2:172.21.15.17:3300/0 conn(0x7f8a4006d940 0x7f8a400cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 --2- 172.21.15.17:0/2267911732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40074b90 0x7f8a400ca7f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 -- 172.21.15.17:0/2267911732 >> 172.21.15.17:0/2267911732 conn(0x7f8a400d0230 msgr2=0x7f8a400d0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 -- 172.21.15.17:0/2267911732 shutdown_connections 2024-09-10T23:18:09.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 -- 172.21.15.17:0/2267911732 wait complete. 2024-09-10T23:18:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 Processor -- start 2024-09-10T23:18:09.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 -- start start 2024-09-10T23:18:09.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a4006d560 0x7f8a40154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.854+0000 7f8a47200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a4006d940 0x7f8a40154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a47200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40074b90 0x7f8a40155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a47200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4015e870 con 0x7f8a4006d940 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a47200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4015e6f0 con 0x7f8a40074b90 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a47200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4015e9f0 con 0x7f8a4006d560 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a4006d940 0x7f8a40154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a4006d940 0x7f8a40154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36480/0 (socket says 172.21.15.17:36480) 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45400640 1 -- 172.21.15.17:0/835975320 learned_addr learned my addr 172.21.15.17:0/835975320 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45e00640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a4006d560 0x7f8a40154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a46800640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40074b90 0x7f8a40155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45400640 1 -- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a4006d560 msgr2=0x7f8a40154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45400640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a4006d560 0x7f8a40154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45400640 1 -- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40074b90 msgr2=0x7f8a40155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45400640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40074b90 0x7f8a40155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45400640 1 -- 172.21.15.17:0/835975320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a40157250 con 0x7f8a4006d940 2024-09-10T23:18:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a45400640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a4006d940 0x7f8a40154b50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8a300b1040 tx=0x7f8a30005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a3a000640 1 -- 172.21.15.17:0/835975320 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a300b3070 con 0x7f8a4006d940 2024-09-10T23:18:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a3a000640 1 -- 172.21.15.17:0/835975320 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a30005530 con 0x7f8a4006d940 2024-09-10T23:18:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a3a000640 1 -- 172.21.15.17:0/835975320 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004930 con 0x7f8a4006d940 2024-09-10T23:18:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a47200640 1 -- 172.21.15.17:0/835975320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a40155ed0 con 0x7f8a4006d940 2024-09-10T23:18:09.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.858+0000 7f8a47200640 1 -- 172.21.15.17:0/835975320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a40156490 con 0x7f8a4006d940 2024-09-10T23:18:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a3a000640 1 -- 172.21.15.17:0/835975320 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8a3000b040 con 0x7f8a4006d940 2024-09-10T23:18:09.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a4bc3e000 1 Processor -- start 2024-09-10T23:18:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a4bc3e000 1 -- start start 2024-09-10T23:18:09.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a3a000640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a240725e0 0x7f8a24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a3a000640 1 -- 172.21.15.17:0/835975320 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6130+0+0 (secure 0 0 0) 0x7f8a3012d3a0 con 0x7f8a4006d940 2024-09-10T23:18:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a27580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 0x55e2339dd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a46800640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a240725e0 0x7f8a24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e2339ddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e2338c5cb0 con 0x55e233a271a0 2024-09-10T23:18:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e2337db310 con 0x55e233a27ac0 2024-09-10T23:18:09.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e233838b90 con 0x55e2339ddbc0 2024-09-10T23:18:09.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a45e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a27580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a45e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a27580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36494/0 (socket says 172.21.15.17:36494) 2024-09-10T23:18:09.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a45e00640 1 -- 172.21.15.17:0/3613049036 learned_addr learned my addr 172.21.15.17:0/3613049036 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a45400640 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 0x55e2339dd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.862+0000 7f8a46800640 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e2339ddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a45e00640 1 -- 172.21.15.17:0/3613049036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 msgr2=0x55e2339ddfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a46800640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a240725e0 0x7f8a24074aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a401f79a0 tx=0x7f8a3c011810 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a45e00640 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e2339ddfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a45e00640 1 -- 172.21.15.17:0/3613049036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 msgr2=0x55e2339dd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a45e00640 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 0x55e2339dd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a45e00640 1 -- 172.21.15.17:0/3613049036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2337dcc60 con 0x55e233a271a0 2024-09-10T23:18:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a45400640 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 0x55e2339dd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:09.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a45e00640 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a27580 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8a34001880 tx=0x7f8a34007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb08fbdce9b2a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a2ea00640 1 -- 172.21.15.17:0/3613049036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340052e0 con 0x55e233a271a0 2024-09-10T23:18:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a2ea00640 1 -- 172.21.15.17:0/3613049036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a34018070 con 0x55e233a271a0 2024-09-10T23:18:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a2ea00640 1 -- 172.21.15.17:0/3613049036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400fa10 con 0x55e233a271a0 2024-09-10T23:18:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3613049036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 msgr2=0x55e233a27580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a27580 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8a34001880 tx=0x7f8a34007e60 comp rx=0 tx=0).stop 2024-09-10T23:18:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3613049036 shutdown_connections 2024-09-10T23:18:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e2339ddfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 0x55e2339dd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3613049036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a27580 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3613049036 >> 172.21.15.17:0/3613049036 conn(0x55e2339e3d20 msgr2=0x55e2339dbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3613049036 shutdown_connections 2024-09-10T23:18:09.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3613049036 wait complete. 2024-09-10T23:18:09.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 -- start start 2024-09-10T23:18:09.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.866+0000 7f8a4bc3e000 1 Processor -- start 2024-09-10T23:18:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2339ddbc0 0x55e233a2e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e233a271a0 0x55e233a2ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 0x55e233a2efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e23382bdd0 con 0x55e233a27ac0 2024-09-10T23:18:09.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e233827fc0 con 0x55e2339ddbc0 2024-09-10T23:18:09.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e2337cd4b0 con 0x55e233a271a0 2024-09-10T23:18:09.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 10 client.0 _ll_register_callbacks cb 0x55e2337ab7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:09.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2339ddbc0 0x55e233a2e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e233a271a0 0x55e233a2ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2339ddbc0 0x55e233a2e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:48532/0 (socket says 172.21.15.17:48532) 2024-09-10T23:18:09.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45e00640 1 -- 172.21.15.17:0/3573406246 learned_addr learned my addr 172.21.15.17:0/3573406246 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a46800640 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 0x55e233a2efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45e00640 1 -- 172.21.15.17:0/3573406246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e233a271a0 msgr2=0x55e233a2ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45e00640 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e233a271a0 0x55e233a2ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45e00640 1 -- 172.21.15.17:0/3573406246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 msgr2=0x55e233a2efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45e00640 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 0x55e233a2efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45e00640 1 -- 172.21.15.17:0/3573406246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2337c61f0 con 0x55e2339ddbc0 2024-09-10T23:18:09.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a46800640 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 0x55e233a2efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45e00640 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2339ddbc0 0x55e233a2e530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8a34015040 tx=0x7f8a3400fde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebf8019c9e8750eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a23400640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a23400640 1 -- 172.21.15.17:0/3573406246 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34021070 con 0x55e2339ddbc0 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a23400640 1 -- 172.21.15.17:0/3573406246 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6130+0+0 (secure 0 0 0) 0x7f8a34003820 con 0x55e2339ddbc0 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3573406246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e2337c0330 con 0x55e2339ddbc0 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a23400640 1 -- 172.21.15.17:0/3573406246 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8a3402c050 con 0x55e2339ddbc0 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 10 client.5128 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3573406246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55e2337acfa0 con 0x55e2339ddbc0 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a23400640 1 -- 172.21.15.17:0/3573406246 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e2337c0330 con 0x55e2339ddbc0 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a23400640 1 -- 172.21.15.17:0/3573406246 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f8a3402f020 con 0x55e2339ddbc0 2024-09-10T23:18:09.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 10 client.5128 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 10 client.5128 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 20 client.5128 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55e233a36900 0x55e233a38cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 4 client.5128 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3573406246 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e23383aae0 con 0x55e233a36900 2024-09-10T23:18:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.870+0000 7f8a45400640 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55e233a36900 0x55e233a38cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a45400640 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55e233a36900 0x55e233a38cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bffd51e0204603b server_cookie=3dd2d3a74140a7a2 in_seq=0 out_seq=0 2024-09-10T23:18:09.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a23400640 10 client.5128 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a23400640 1 -- 172.21.15.17:0/3573406246 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e23383aae0 con 0x55e233a36900 2024-09-10T23:18:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a23400640 10 client.5128 handle_command_reply: tid=0 2024-09-10T23:18:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 client.5128 shutdown 2024-09-10T23:18:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3573406246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2339ddbc0 msgr2=0x55e233a2e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2339ddbc0 0x55e233a2e530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8a34015040 tx=0x7f8a3400fde0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3573406246 shutdown_connections 2024-09-10T23:18:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55e233a36900 0x55e233a38cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 0x55e233a2efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e233a271a0 0x55e233a2ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/3573406246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e2339ddbc0 0x55e233a2e530 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3573406246 >> 172.21.15.17:0/3573406246 conn(0x55e2339e3d20 msgr2=0x55e2339dbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a23400640 0 client.5128 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3573406246 shutdown_connections 2024-09-10T23:18:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/3573406246 wait complete. 2024-09-10T23:18:09.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.874+0000 7f8a4bc3e000 20 client.5128 trim_cache size 0 max 16384 2024-09-10T23:18:09.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.894+0000 7f8a4bc3e000 1 Processor -- start 2024-09-10T23:18:09.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.894+0000 7f8a4bc3e000 1 -- start start 2024-09-10T23:18:09.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a34dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a271a0 0x55e2339dd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 0x55e2339dd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40204670 con 0x55e233a27ac0 2024-09-10T23:18:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40203670 con 0x55e233a271a0 2024-09-10T23:18:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a400add50 con 0x55e2339ddbc0 2024-09-10T23:18:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a34dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a271a0 0x55e2339dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a34dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56032/0 (socket says 172.21.15.17:56032) 2024-09-10T23:18:09.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a271a0 0x55e2339dd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:48544/0 (socket says 172.21.15.17:48544) 2024-09-10T23:18:09.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45e00640 1 -- 172.21.15.17:0/2345493003 learned_addr learned my addr 172.21.15.17:0/2345493003 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a46800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 0x55e2339dd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45400640 1 -- 172.21.15.17:0/2345493003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 msgr2=0x55e233a34dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45400640 1 --2- 172.21.15.17:0/2345493003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a34dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45400640 1 -- 172.21.15.17:0/2345493003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 msgr2=0x55e2339dd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45400640 1 --2- 172.21.15.17:0/2345493003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 0x55e2339dd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45400640 1 -- 172.21.15.17:0/2345493003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e233885660 con 0x55e233a271a0 2024-09-10T23:18:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45e00640 1 --2- 172.21.15.17:0/2345493003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a34dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a45400640 1 --2- 172.21.15.17:0/2345493003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a271a0 0x55e2339dd070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005ed0 tx=0x7f8a300ff040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=864e5a686aebf104 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a2e000640 1 -- 172.21.15.17:0/2345493003 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a300fcc10 con 0x55e233a271a0 2024-09-10T23:18:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a2e000640 1 -- 172.21.15.17:0/2345493003 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a30101630 con 0x55e233a271a0 2024-09-10T23:18:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a2e000640 1 -- 172.21.15.17:0/2345493003 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3012d0b0 con 0x55e233a271a0 2024-09-10T23:18:09.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/2345493003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a271a0 msgr2=0x55e2339dd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/2345493003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a271a0 0x55e2339dd070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005ed0 tx=0x7f8a300ff040 comp rx=0 tx=0).stop 2024-09-10T23:18:09.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/2345493003 shutdown_connections 2024-09-10T23:18:09.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/2345493003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a27ac0 0x55e2339dd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/2345493003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a271a0 0x55e2339dd070 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/2345493003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a34dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/2345493003 >> 172.21.15.17:0/2345493003 conn(0x55e2339e3d20 msgr2=0x55e2339dc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/2345493003 shutdown_connections 2024-09-10T23:18:09.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/2345493003 wait complete. 2024-09-10T23:18:09.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 -- start start 2024-09-10T23:18:09.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.898+0000 7f8a4bc3e000 1 Processor -- start 2024-09-10T23:18:09.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a33fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a34500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 0x55e233a59210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e2339e6d40 con 0x55e233a271a0 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e2339e4100 con 0x55e233a27ac0 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e233822ec0 con 0x55e2339ddbc0 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 10 client.0 _ll_register_callbacks cb 0x7f8a3c009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a34500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a34500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36522/0 (socket says 172.21.15.17:36522) 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45400640 1 -- 172.21.15.17:0/4088661138 learned_addr learned my addr 172.21.15.17:0/4088661138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45e00640 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a33fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a46800640 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 0x55e233a59210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45400640 1 -- 172.21.15.17:0/4088661138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 msgr2=0x55e233a33fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45400640 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a33fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45400640 1 -- 172.21.15.17:0/4088661138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 msgr2=0x55e233a59210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45400640 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 0x55e233a59210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45400640 1 -- 172.21.15.17:0/4088661138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2337f2090 con 0x55e233a271a0 2024-09-10T23:18:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45400640 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a34500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8a3001f2d0 tx=0x7f8a300bd000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b47a8e5ee4b076 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a23400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:18:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a23400640 1 -- 172.21.15.17:0/4088661138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3012b790 con 0x55e233a271a0 2024-09-10T23:18:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a23400640 1 -- 172.21.15.17:0/4088661138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6130+0+0 (secure 0 0 0) 0x7f8a300f4450 con 0x55e233a271a0 2024-09-10T23:18:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/4088661138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a30101630 con 0x55e233a271a0 2024-09-10T23:18:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a23400640 1 -- 172.21.15.17:0/4088661138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8a3012b300 con 0x55e233a271a0 2024-09-10T23:18:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 10 client.5286 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/4088661138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55e2337be5f0 con 0x55e233a271a0 2024-09-10T23:18:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a23400640 1 -- 172.21.15.17:0/4088661138 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a30101630 con 0x55e233a271a0 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a23400640 1 -- 172.21.15.17:0/4088661138 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f8a300a6930 con 0x55e233a271a0 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 10 client.5286 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 10 client.5286 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 20 client.5286 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55e233a59bd0 0x55e233a9c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 4 client.5286 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/4088661138 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e233836590 con 0x55e233a59bd0 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45e00640 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55e233a59bd0 0x55e233a9c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a23400640 10 client.5286 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.902+0000 7f8a45e00640 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55e233a59bd0 0x55e233a9c850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3461c6e92d3781c server_cookie=337d1e50e8aeee87 in_seq=0 out_seq=0 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a23400640 1 -- 172.21.15.17:0/4088661138 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55e233836590 con 0x55e233a59bd0 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a23400640 10 client.5286 handle_command_reply: tid=0 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 client.5286 shutdown 2024-09-10T23:18:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/4088661138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 msgr2=0x55e233a34500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a34500 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8a3001f2d0 tx=0x7f8a300bd000 comp rx=0 tx=0).stop 2024-09-10T23:18:09.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/4088661138 shutdown_connections 2024-09-10T23:18:09.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55e233a59bd0 0x55e233a9c850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e233a27ac0 0x55e233a59210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e233a271a0 0x55e233a34500 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 --2- 172.21.15.17:0/4088661138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e2339ddbc0 0x55e233a33fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a23400640 0 client.5286 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/4088661138 >> 172.21.15.17:0/4088661138 conn(0x55e2339e3d20 msgr2=0x55e2339dd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/4088661138 shutdown_connections 2024-09-10T23:18:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 1 -- 172.21.15.17:0/4088661138 wait complete. 2024-09-10T23:18:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a4bc3e000 20 client.5286 trim_cache size 0 max 16384 2024-09-10T23:18:09.912 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:18:09.912 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1555 inodes in the stack)", 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "253c4081-7cac-4b76-8938-a6488f037761": { 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "253c4081-7cac-4b76-8938-a6488f037761", 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,scrub_mdsdir" 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "253c4081-7cac-4b76-8938-a6488f037761": { 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:18:09.614325+0000", 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:18:09.913 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:18:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:18:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:09.914 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:18:09.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 -- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a240725e0 msgr2=0x7f8a24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a240725e0 0x7f8a24074aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a401f79a0 tx=0x7f8a3c011810 comp rx=0 tx=0).stop 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 -- 172.21.15.17:0/835975320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a4006d940 msgr2=0x7f8a40154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a4006d940 0x7f8a40154b50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8a300b1040 tx=0x7f8a30005de0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 -- 172.21.15.17:0/835975320 shutdown_connections 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a240725e0 0x7f8a24074aa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40074b90 0x7f8a40155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a4006d940 0x7f8a40154b50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 --2- 172.21.15.17:0/835975320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a4006d560 0x7f8a40154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 -- 172.21.15.17:0/835975320 >> 172.21.15.17:0/835975320 conn(0x7f8a400d0230 msgr2=0x7f8a40074180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 -- 172.21.15.17:0/835975320 shutdown_connections 2024-09-10T23:18:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:09.906+0000 7f8a47200640 1 -- 172.21.15.17:0/835975320 wait complete. 2024-09-10T23:18:09.932 INFO:tasks.cephfs.filesystem:scrub status for tag:253c4081-7cac-4b76-8938-a6488f037761 - {'path': '/', 'tag': '253c4081-7cac-4b76-8938-a6488f037761', 'options': 'recursive,scrub_mdsdir'} 2024-09-10T23:18:36.585 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:18:36.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:18:39.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:39.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-10T23:18:40.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 -- 172.21.15.17:0/2059830773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 msgr2=0x7f7bdc15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 --2- 172.21.15.17:0/2059830773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 0x7f7bdc15f770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc06c8a0 tx=0x7f7bc401c7a0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 -- 172.21.15.17:0/2059830773 shutdown_connections 2024-09-10T23:18:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 --2- 172.21.15.17:0/2059830773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 0x7f7bdc15f770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 --2- 172.21.15.17:0/2059830773 >> v2:172.21.15.77:3300/0 conn(0x7f7bdc1457c0 0x7f7bdc06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 -- 172.21.15.17:0/2059830773 >> 172.21.15.17:0/2059830773 conn(0x7f7bdc0b17a0 msgr2=0x7f7bdc0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 -- 172.21.15.17:0/2059830773 shutdown_connections 2024-09-10T23:18:40.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 -- 172.21.15.17:0/2059830773 wait complete. 2024-09-10T23:18:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 Processor -- start 2024-09-10T23:18:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 -- start start 2024-09-10T23:18:40.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 0x7f7bdc1f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc074660 0x7f7bdc144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bdc1457c0 0x7f7bdc13ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc1694a0 con 0x7f7bdc0741d0 2024-09-10T23:18:40.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc169320 con 0x7f7bdc074660 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7be2e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc169620 con 0x7f7bdc1457c0 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 0x7f7bdc1f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 0x7f7bdc1f8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39010/0 (socket says 172.21.15.17:39010) 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.094+0000 7f7bdbe00640 1 -- 172.21.15.17:0/2982207774 learned_addr learned my addr 172.21.15.17:0/2982207774 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc074660 0x7f7bdc144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7be0e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bdc1457c0 0x7f7bdc13ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bdbe00640 1 -- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bdc1457c0 msgr2=0x7f7bdc13ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bdc1457c0 0x7f7bdc13ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bdbe00640 1 -- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc074660 msgr2=0x7f7bdc144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc074660 0x7f7bdc144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bdbe00640 1 -- 172.21.15.17:0/2982207774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc144c70 con 0x7f7bdc0741d0 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 0x7f7bdc1f8680 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00d950 tx=0x7f7bcc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bd8c00640 1 -- 172.21.15.17:0/2982207774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc017070 con 0x7f7bdc0741d0 2024-09-10T23:18:40.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bd8c00640 1 -- 172.21.15.17:0/2982207774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bcc009d20 con 0x7f7bdc0741d0 2024-09-10T23:18:40.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7be2e00640 1 -- 172.21.15.17:0/2982207774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc144f50 con 0x7f7bdc0741d0 2024-09-10T23:18:40.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bd8c00640 1 -- 172.21.15.17:0/2982207774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0106c0 con 0x7f7bdc0741d0 2024-09-10T23:18:40.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7be2e00640 1 -- 172.21.15.17:0/2982207774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc13db40 con 0x7f7bdc0741d0 2024-09-10T23:18:40.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.098+0000 7f7bd8c00640 1 -- 172.21.15.17:0/2982207774 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7bcc010860 con 0x7f7bdc0741d0 2024-09-10T23:18:40.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bd8c00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7bb80725e0 0x7f7bb8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 Processor -- start 2024-09-10T23:18:40.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bd8c00640 1 -- 172.21.15.17:0/2982207774 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f7bcc093880 con 0x7f7bdc0741d0 2024-09-10T23:18:40.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7bb80725e0 0x7f7bb8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 -- start start 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7bb80725e0 0x7f7bb8074aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40af000 tx=0x7f7bc40b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf23861a0 0x55ddf2386580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 0x55ddf233c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf233cbc0 0x55ddf233cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ddf2224cb0 con 0x55ddf23861a0 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ddf213a310 con 0x55ddf233cbc0 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ddf2197b90 con 0x55ddf2386ac0 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf23861a0 0x55ddf2386580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf23861a0 0x55ddf2386580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39012/0 (socket says 172.21.15.17:39012) 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bdbe00640 1 -- 172.21.15.17:0/1233502669 learned_addr learned my addr 172.21.15.17:0/1233502669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 0x55ddf233c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be0e00640 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf233cbc0 0x55ddf233cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bdbe00640 1 -- 172.21.15.17:0/1233502669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 msgr2=0x55ddf233c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 0x55ddf233c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bdbe00640 1 -- 172.21.15.17:0/1233502669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf233cbc0 msgr2=0x55ddf233cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf233cbc0 0x55ddf233cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bdbe00640 1 -- 172.21.15.17:0/1233502669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf213bc60 con 0x55ddf23861a0 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 0x55ddf233c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf23861a0 0x55ddf2386580 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc05e640 tx=0x7f7bcc05e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef7a1ab6b5355be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bd0c00640 1 -- 172.21.15.17:0/1233502669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc021070 con 0x55ddf23861a0 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bd0c00640 1 -- 172.21.15.17:0/1233502669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bcc05e1c0 con 0x55ddf23861a0 2024-09-10T23:18:40.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7bd0c00640 1 -- 172.21.15.17:0/1233502669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc010d80 con 0x55ddf23861a0 2024-09-10T23:18:40.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 -- 172.21.15.17:0/1233502669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf23861a0 msgr2=0x55ddf2386580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf23861a0 0x55ddf2386580 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc05e640 tx=0x7f7bcc05e000 comp rx=0 tx=0).stop 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 -- 172.21.15.17:0/1233502669 shutdown_connections 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf233cbc0 0x55ddf233cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 0x55ddf233c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 --2- 172.21.15.17:0/1233502669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf23861a0 0x55ddf2386580 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 -- 172.21.15.17:0/1233502669 >> 172.21.15.17:0/1233502669 conn(0x55ddf2342d20 msgr2=0x55ddf233af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 -- 172.21.15.17:0/1233502669 shutdown_connections 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.102+0000 7f7be6200000 1 -- 172.21.15.17:0/1233502669 wait complete. 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 -- start start 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 Processor -- start 2024-09-10T23:18:40.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 0x55ddf238d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf238da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf238dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ddf218add0 con 0x55ddf2386ac0 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ddf2186fc0 con 0x55ddf23861a0 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ddf212c4b0 con 0x55ddf233cbc0 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 10 client.0 _ll_register_callbacks cb 0x55ddf210a7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf238dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf238dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39026/0 (socket says 172.21.15.17:39026) 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be0e00640 1 -- 172.21.15.17:0/224511891 learned_addr learned my addr 172.21.15.17:0/224511891 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 0x55ddf238d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf238da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be0e00640 1 -- 172.21.15.17:0/224511891 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 msgr2=0x55ddf238d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be0e00640 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 0x55ddf238d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be0e00640 1 -- 172.21.15.17:0/224511891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 msgr2=0x55ddf238da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be0e00640 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf238da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be0e00640 1 -- 172.21.15.17:0/224511891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf21251f0 con 0x55ddf2386ac0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be0e00640 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf238dfb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40125b0 tx=0x7f7bd40129b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83f5dc18f4dd834 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7bc9600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7bc9600640 1 -- 172.21.15.17:0/224511891 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4019020 con 0x55ddf2386ac0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7bc9600640 1 -- 172.21.15.17:0/224511891 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f7bd4003b90 con 0x55ddf2386ac0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 -- 172.21.15.17:0/224511891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ddf211f330 con 0x55ddf2386ac0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7bc9600640 1 -- 172.21.15.17:0/224511891 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7bd4023050 con 0x55ddf2386ac0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 10 client.5301 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 -- 172.21.15.17:0/224511891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55ddf210bfa0 con 0x55ddf2386ac0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7bc9600640 1 -- 172.21.15.17:0/224511891 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ddf211f330 con 0x55ddf2386ac0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7bc9600640 1 -- 172.21.15.17:0/224511891 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f7bd4026020 con 0x55ddf2386ac0 2024-09-10T23:18:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 10 client.5301 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 10 client.5301 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 20 client.5301 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55ddf2395900 0x55ddf2397cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 4 client.5301 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7be6200000 1 -- 172.21.15.17:0/224511891 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddf2199ae0 con 0x55ddf2395900 2024-09-10T23:18:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.106+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55ddf2395900 0x55ddf2397cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55ddf2395900 0x55ddf2397cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74cd422d4c3429b5 server_cookie=48f384a633469b69 in_seq=0 out_seq=0 2024-09-10T23:18:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7bc9600640 10 client.5301 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7bc9600640 1 -- 172.21.15.17:0/224511891 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ddf2199ae0 con 0x55ddf2395900 2024-09-10T23:18:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7bc9600640 10 client.5301 handle_command_reply: tid=0 2024-09-10T23:18:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 client.5301 shutdown 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 -- 172.21.15.17:0/224511891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 msgr2=0x55ddf238dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf238dfb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40125b0 tx=0x7f7bd40129b0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 -- 172.21.15.17:0/224511891 shutdown_connections 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55ddf2395900 0x55ddf2397cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf238dfb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf238da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7bc9600640 0 client.5301 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 --2- 172.21.15.17:0/224511891 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 0x55ddf238d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 -- 172.21.15.17:0/224511891 >> 172.21.15.17:0/224511891 conn(0x55ddf2342d20 msgr2=0x55ddf233af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 -- 172.21.15.17:0/224511891 shutdown_connections 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 1 -- 172.21.15.17:0/224511891 wait complete. 2024-09-10T23:18:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.110+0000 7f7be6200000 20 client.5301 trim_cache size 0 max 16384 2024-09-10T23:18:40.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.126+0000 7f7be6200000 1 Processor -- start 2024-09-10T23:18:40.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.126+0000 7f7be6200000 1 -- start start 2024-09-10T23:18:40.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 0x55ddf23f7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf23f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf23f8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc1641e0 con 0x55ddf2386ac0 2024-09-10T23:18:40.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc163200 con 0x55ddf23861a0 2024-09-10T23:18:40.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc1fbd20 con 0x55ddf233cbc0 2024-09-10T23:18:40.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf23f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf23f8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39032/0 (socket says 172.21.15.17:39032) 2024-09-10T23:18:40.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be0e00640 1 -- 172.21.15.17:0/910560209 learned_addr learned my addr 172.21.15.17:0/910560209 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/910560209 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 0x55ddf23f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/910560209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf23f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be0e00640 1 -- 172.21.15.17:0/910560209 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 msgr2=0x55ddf23f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be0e00640 1 --2- 172.21.15.17:0/910560209 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 0x55ddf23f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be0e00640 1 -- 172.21.15.17:0/910560209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 msgr2=0x55ddf23f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be0e00640 1 --2- 172.21.15.17:0/910560209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf23f7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be0e00640 1 -- 172.21.15.17:0/910560209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf21e4660 con 0x55ddf2386ac0 2024-09-10T23:18:40.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be0e00640 1 --2- 172.21.15.17:0/910560209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf23f8080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4007c80 tx=0x7f7bd4001ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560e1cf418e69966 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7bcbe00640 1 -- 172.21.15.17:0/910560209 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4019050 con 0x55ddf2386ac0 2024-09-10T23:18:40.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7bcbe00640 1 -- 172.21.15.17:0/910560209 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bd401e3f0 con 0x55ddf2386ac0 2024-09-10T23:18:40.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7bcbe00640 1 -- 172.21.15.17:0/910560209 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd401ea70 con 0x55ddf2386ac0 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 -- 172.21.15.17:0/910560209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 msgr2=0x55ddf23f8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 --2- 172.21.15.17:0/910560209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf23f8080 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4007c80 tx=0x7f7bd4001ea0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 -- 172.21.15.17:0/910560209 shutdown_connections 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 --2- 172.21.15.17:0/910560209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf2386ac0 0x55ddf23f8080 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 --2- 172.21.15.17:0/910560209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf23f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 --2- 172.21.15.17:0/910560209 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf233cbc0 0x55ddf23f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 -- 172.21.15.17:0/910560209 >> 172.21.15.17:0/910560209 conn(0x55ddf2342d20 msgr2=0x55ddf233e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 -- 172.21.15.17:0/910560209 shutdown_connections 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 -- 172.21.15.17:0/910560209 wait complete. 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 -- start start 2024-09-10T23:18:40.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 Processor -- start 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf233cbc0 0x55ddf239c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.130+0000 7f7be6200000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf239cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 0x55ddf23b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ddf2345d40 con 0x55ddf233cbc0 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ddf2343100 con 0x55ddf23861a0 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ddf2181ec0 con 0x55ddf2386ac0 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 10 client.0 _ll_register_callbacks cb 0x7f7bd4007e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf233cbc0 0x55ddf239c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf233cbc0 0x55ddf239c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39034/0 (socket says 172.21.15.17:39034) 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bdbe00640 1 -- 172.21.15.17:0/3362508136 learned_addr learned my addr 172.21.15.17:0/3362508136 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf239cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be0e00640 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 0x55ddf23b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bdbe00640 1 -- 172.21.15.17:0/3362508136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 msgr2=0x55ddf23b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 0x55ddf23b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bdbe00640 1 -- 172.21.15.17:0/3362508136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 msgr2=0x55ddf239cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf239cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bdbe00640 1 -- 172.21.15.17:0/3362508136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf2151090 con 0x55ddf233cbc0 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf239cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bdbe00640 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf233cbc0 0x55ddf239c660 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc091a90 tx=0x7f7bcc05a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b667b1c5ca09017 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 1 -- 172.21.15.17:0/3362508136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc08f060 con 0x55ddf233cbc0 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 1 -- 172.21.15.17:0/3362508136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f7bcc010b80 con 0x55ddf233cbc0 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- 172.21.15.17:0/3362508136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bd401e3f0 con 0x55ddf233cbc0 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 1 -- 172.21.15.17:0/3362508136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7bcc088050 con 0x55ddf233cbc0 2024-09-10T23:18:40.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 10 client.5307 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- 172.21.15.17:0/3362508136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55ddf211d5f0 con 0x55ddf233cbc0 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 1 -- 172.21.15.17:0/3362508136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bd401e3f0 con 0x55ddf233cbc0 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 1 -- 172.21.15.17:0/3362508136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7f7bcc05d910 con 0x55ddf233cbc0 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 10 client.5307 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 10 client.5307 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 20 client.5307 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55ddf23b8750 0x55ddf23b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 4 client.5307 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- 172.21.15.17:0/3362508136 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ddf2195590 con 0x55ddf23b8750 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55ddf23b8750 0x55ddf23b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bd3e00640 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55ddf23b8750 0x55ddf23b8b60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=510e9166629ed4df server_cookie=3ec3a48f41c3c3a9 in_seq=0 out_seq=0 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 10 client.5307 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 1 -- 172.21.15.17:0/3362508136 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55ddf2195590 con 0x55ddf23b8750 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 10 client.5307 handle_command_reply: tid=0 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 client.5307 shutdown 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- 172.21.15.17:0/3362508136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf233cbc0 msgr2=0x55ddf239c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf233cbc0 0x55ddf239c660 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc091a90 tx=0x7f7bcc05a710 comp rx=0 tx=0).stop 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- 172.21.15.17:0/3362508136 shutdown_connections 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55ddf23b8750 0x55ddf23b8b60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ddf2386ac0 0x55ddf23b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ddf23861a0 0x55ddf239cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 --2- 172.21.15.17:0/3362508136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddf233cbc0 0x55ddf239c660 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7bc9600640 0 client.5307 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- 172.21.15.17:0/3362508136 >> 172.21.15.17:0/3362508136 conn(0x55ddf2342d20 msgr2=0x55ddf2397cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- 172.21.15.17:0/3362508136 shutdown_connections 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 1 -- 172.21.15.17:0/3362508136 wait complete. 2024-09-10T23:18:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be6200000 20 client.5307 trim_cache size 0 max 16384 2024-09-10T23:18:40.144 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:18:40.144 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:18:40.144 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:18:40.144 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:18:40.144 INFO:teuthology.orchestra.run.smithi017.stdout: "253c4081-7cac-4b76-8938-a6488f037761": { 2024-09-10T23:18:40.144 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:18:09.614325+0000", 2024-09-10T23:18:40.144 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:18:40.144 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:18:40.145 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:18:40.145 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:18:40.145 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:18:40.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.145 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:18:40.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 -- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7bb80725e0 msgr2=0x7f7bb8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7bb80725e0 0x7f7bb8074aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40af000 tx=0x7f7bc40b2040 comp rx=0 tx=0).stop 2024-09-10T23:18:40.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 -- 172.21.15.17:0/2982207774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 msgr2=0x7f7bdc1f8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 0x7f7bdc1f8680 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00d950 tx=0x7f7bcc00de10 comp rx=0 tx=0).stop 2024-09-10T23:18:40.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 -- 172.21.15.17:0/2982207774 shutdown_connections 2024-09-10T23:18:40.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7bb80725e0 0x7f7bb8074aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bdc1457c0 0x7f7bdc13ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bdc074660 0x7f7bdc144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 --2- 172.21.15.17:0/2982207774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bdc0741d0 0x7f7bdc1f8680 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 -- 172.21.15.17:0/2982207774 >> 172.21.15.17:0/2982207774 conn(0x7f7bdc0b17a0 msgr2=0x7f7bdc15dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 -- 172.21.15.17:0/2982207774 shutdown_connections 2024-09-10T23:18:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.134+0000 7f7be2e00640 1 -- 172.21.15.17:0/2982207774 wait complete. 2024-09-10T23:18:40.159 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:18:40.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-10T23:18:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 -- 172.21.15.17:0/698091598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd40b12e0 msgr2=0x7ffbd40cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 --2- 172.21.15.17:0/698091598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd40b12e0 0x7ffbd40cfde0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009900 tx=0x7ffbc001c8b0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 -- 172.21.15.17:0/698091598 shutdown_connections 2024-09-10T23:18:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 --2- 172.21.15.17:0/698091598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd40b12e0 0x7ffbd40cfde0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 --2- 172.21.15.17:0/698091598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffbd415be00 0x7ffbd415d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 -- 172.21.15.17:0/698091598 >> 172.21.15.17:0/698091598 conn(0x7ffbd409a9f0 msgr2=0x7ffbd409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 -- 172.21.15.17:0/698091598 shutdown_connections 2024-09-10T23:18:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 -- 172.21.15.17:0/698091598 wait complete. 2024-09-10T23:18:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 Processor -- start 2024-09-10T23:18:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 -- start start 2024-09-10T23:18:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffbd40b12e0 0x7ffbd414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbd40b1740 0x7ffbd40b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd415be00 0x7ffbd40b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd41694d0 con 0x7ffbd415be00 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd415d2e0 con 0x7ffbd40b1740 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbdb800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd4169650 con 0x7ffbd40b12e0 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd415be00 0x7ffbd40b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd415be00 0x7ffbd40b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39058/0 (socket says 172.21.15.17:39058) 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd9800640 1 -- 172.21.15.17:0/536787381 learned_addr learned my addr 172.21.15.17:0/536787381 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffbd40b12e0 0x7ffbd414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd3e00640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbd40b1740 0x7ffbd40b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd9800640 1 -- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffbd40b12e0 msgr2=0x7ffbd414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd9800640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffbd40b12e0 0x7ffbd414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd9800640 1 -- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbd40b1740 msgr2=0x7ffbd40b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd9800640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbd40b1740 0x7ffbd40b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd9800640 1 -- 172.21.15.17:0/536787381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd414bff0 con 0x7ffbd415be00 2024-09-10T23:18:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.306+0000 7ffbd3e00640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbd40b1740 0x7ffbd40b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbd9800640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd415be00 0x7ffbd40b0590 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c770 tx=0x7ffbcc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbd0c00640 1 -- 172.21.15.17:0/536787381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc017070 con 0x7ffbd415be00 2024-09-10T23:18:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbd0c00640 1 -- 172.21.15.17:0/536787381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbcc005070 con 0x7ffbd415be00 2024-09-10T23:18:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbd0c00640 1 -- 172.21.15.17:0/536787381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0054c0 con 0x7ffbd415be00 2024-09-10T23:18:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbdb800640 1 -- 172.21.15.17:0/536787381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd40cda50 con 0x7ffbd415be00 2024-09-10T23:18:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbdb800640 1 -- 172.21.15.17:0/536787381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd40cdf90 con 0x7ffbd415be00 2024-09-10T23:18:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbd0c00640 1 -- 172.21.15.17:0/536787381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffbcc005660 con 0x7ffbd415be00 2024-09-10T23:18:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbd0c00640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffbb40725e0 0x7ffbb4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbdeb9b000 1 Processor -- start 2024-09-10T23:18:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbd0c00640 1 -- 172.21.15.17:0/536787381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7ffbcc092d10 con 0x7ffbd415be00 2024-09-10T23:18:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.310+0000 7ffbdeb9b000 1 -- start start 2024-09-10T23:18:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffbb40725e0 0x7ffbb4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc063432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc06343830 0x55cc06343c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc062f99b0 0x55cc062f9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55cc060f32c0 con 0x55cc061dd1d0 2024-09-10T23:18:40.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc06150b90 con 0x55cc062f99b0 2024-09-10T23:18:40.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cc0613ffc0 con 0x55cc06343830 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffbb40725e0 0x7ffbb4074aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800bb50 tx=0x7ffbc800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc063432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc063432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39060/0 (socket says 172.21.15.17:39060) 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 -- 172.21.15.17:0/2878847874 learned_addr learned my addr 172.21.15.17:0/2878847874 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd9800640 1 --2- 172.21.15.17:0/2878847874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc062f99b0 0x55cc062f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd3e00640 1 --2- 172.21.15.17:0/2878847874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc06343830 0x55cc06343c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 -- 172.21.15.17:0/2878847874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc06343830 msgr2=0x55cc06343c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/2878847874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc06343830 0x55cc06343c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 -- 172.21.15.17:0/2878847874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc062f99b0 msgr2=0x55cc062f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/2878847874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc062f99b0 0x55cc062f9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 -- 172.21.15.17:0/2878847874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc060de1a0 con 0x55cc061dd1d0 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/2878847874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc063432f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8010fb0 tx=0x7ffbc8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2e5c6232aee5a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbc5600640 1 -- 172.21.15.17:0/2878847874 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8024070 con 0x55cc061dd1d0 2024-09-10T23:18:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbc5600640 1 -- 172.21.15.17:0/2878847874 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbc8015070 con 0x55cc061dd1d0 2024-09-10T23:18:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbc5600640 1 -- 172.21.15.17:0/2878847874 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc80116a0 con 0x55cc061dd1d0 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/2878847874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 msgr2=0x55cc063432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/2878847874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc063432f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8010fb0 tx=0x7ffbc8013000 comp rx=0 tx=0).stop 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/2878847874 shutdown_connections 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/2878847874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc062f99b0 0x55cc062f9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/2878847874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc06343830 0x55cc06343c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/2878847874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc063432f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/2878847874 >> 172.21.15.17:0/2878847874 conn(0x55cc05dfe880 msgr2=0x55cc062f3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/2878847874 shutdown_connections 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/2878847874 wait complete. 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 -- start start 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.314+0000 7ffbdeb9b000 1 Processor -- start 2024-09-10T23:18:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc06331860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc06331da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc06343830 0x55cc063322e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55cc060e54d0 con 0x55cc061dd1d0 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc06143dd0 con 0x55cc06343830 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cc05e05620 con 0x55cc062f99b0 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 10 client.0 _ll_register_callbacks cb 0x55cc06116cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc06331860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc06331860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39066/0 (socket says 172.21.15.17:39066) 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd8e00640 1 -- 172.21.15.17:0/204052107 learned_addr learned my addr 172.21.15.17:0/204052107 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd3e00640 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc06331da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd9800640 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc06343830 0x55cc063322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd8e00640 1 -- 172.21.15.17:0/204052107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 msgr2=0x55cc06331da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc06331da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd8e00640 1 -- 172.21.15.17:0/204052107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc06343830 msgr2=0x55cc063322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc06343830 0x55cc063322e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd8e00640 1 -- 172.21.15.17:0/204052107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0620f720 con 0x55cc061dd1d0 2024-09-10T23:18:40.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc06331860 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8022040 tx=0x7ffbc8003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd41280f8c5893f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbba000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:18:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbba000640 1 -- 172.21.15.17:0/204052107 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc802e020 con 0x55cc061dd1d0 2024-09-10T23:18:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbba000640 1 -- 172.21.15.17:0/204052107 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7ffbc8011850 con 0x55cc061dd1d0 2024-09-10T23:18:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/204052107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc060d82e0 con 0x55cc061dd1d0 2024-09-10T23:18:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbba000640 1 -- 172.21.15.17:0/204052107 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffbc8038050 con 0x55cc061dd1d0 2024-09-10T23:18:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 10 client.5322 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/204052107 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55cc061c5420 con 0x55cc061dd1d0 2024-09-10T23:18:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbba000640 1 -- 172.21.15.17:0/204052107 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cc060d82e0 con 0x55cc061dd1d0 2024-09-10T23:18:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbba000640 1 -- 172.21.15.17:0/204052107 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7ffbc803b020 con 0x55cc061dd1d0 2024-09-10T23:18:40.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 10 client.5322 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 10 client.5322 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 20 client.5322 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55cc06332cf0 0x55cc06354fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 4 client.5322 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/204052107 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc06152ae0 con 0x55cc06332cf0 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd3e00640 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55cc06332cf0 0x55cc06354fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbd3e00640 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55cc06332cf0 0x55cc06354fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f546e52a2dd7351 server_cookie=291fe05eb307e44c in_seq=0 out_seq=0 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.318+0000 7ffbba000640 10 client.5322 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbba000640 1 -- 172.21.15.17:0/204052107 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc06152ae0 con 0x55cc06332cf0 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbba000640 10 client.5322 handle_command_reply: tid=0 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 client.5322 shutdown 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/204052107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 msgr2=0x55cc06331860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc06331860 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8022040 tx=0x7ffbc8003e30 comp rx=0 tx=0).stop 2024-09-10T23:18:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/204052107 shutdown_connections 2024-09-10T23:18:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55cc06332cf0 0x55cc06354fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc06343830 0x55cc063322e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc06331da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/204052107 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc061dd1d0 0x55cc06331860 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbba000640 0 client.5322 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/204052107 >> 172.21.15.17:0/204052107 conn(0x55cc05dfe880 msgr2=0x55cc062facc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/204052107 shutdown_connections 2024-09-10T23:18:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/204052107 wait complete. 2024-09-10T23:18:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.322+0000 7ffbdeb9b000 20 client.5322 trim_cache size 0 max 16384 2024-09-10T23:18:40.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbdeb9b000 1 Processor -- start 2024-09-10T23:18:40.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbdeb9b000 1 -- start start 2024-09-10T23:18:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 0x55cc062fb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc062f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc062f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd42007b0 con 0x55cc06343830 2024-09-10T23:18:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd406fb80 con 0x55cc061dd1d0 2024-09-10T23:18:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd406eee0 con 0x55cc062f99b0 2024-09-10T23:18:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc062f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc062f42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39076/0 (socket says 172.21.15.17:39076) 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd9800640 1 -- 172.21.15.17:0/3265632136 learned_addr learned my addr 172.21.15.17:0/3265632136 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd3e00640 1 --2- 172.21.15.17:0/3265632136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc062f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/3265632136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 0x55cc062fb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd9800640 1 -- 172.21.15.17:0/3265632136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 msgr2=0x55cc062f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd9800640 1 --2- 172.21.15.17:0/3265632136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc062f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd9800640 1 -- 172.21.15.17:0/3265632136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 msgr2=0x55cc062fb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd9800640 1 --2- 172.21.15.17:0/3265632136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 0x55cc062fb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd9800640 1 -- 172.21.15.17:0/3265632136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0619cae0 con 0x55cc06343830 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.338+0000 7ffbd9800640 1 --2- 172.21.15.17:0/3265632136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc062f42b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc002240 tx=0x7ffbcc004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0989a69034aced server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbc4c00640 1 -- 172.21.15.17:0/3265632136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc05fe60 con 0x55cc06343830 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbc4c00640 1 -- 172.21.15.17:0/3265632136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbcc062600 con 0x55cc06343830 2024-09-10T23:18:40.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbc4c00640 1 -- 172.21.15.17:0/3265632136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc067020 con 0x55cc06343830 2024-09-10T23:18:40.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3265632136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 msgr2=0x55cc062f42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3265632136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc062f42b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc002240 tx=0x7ffbcc004f90 comp rx=0 tx=0).stop 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3265632136 shutdown_connections 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3265632136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc062f42b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3265632136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc062f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3265632136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 0x55cc062fb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3265632136 >> 172.21.15.17:0/3265632136 conn(0x55cc05dfe880 msgr2=0x55cc062f3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3265632136 shutdown_connections 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3265632136 wait complete. 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- start start 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 Processor -- start 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 0x55cc063b9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc063b9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc063b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55cc05e05620 con 0x55cc06343830 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc06143dd0 con 0x55cc061dd1d0 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cc060eb020 con 0x55cc062f99b0 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 10 client.0 _ll_register_callbacks cb 0x7ffbc8022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc063b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc063b9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39092/0 (socket says 172.21.15.17:39092) 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd9800640 1 -- 172.21.15.17:0/3804805495 learned_addr learned my addr 172.21.15.17:0/3804805495 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 0x55cc063b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd3e00640 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc063b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd9800640 1 -- 172.21.15.17:0/3804805495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 msgr2=0x55cc063b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd9800640 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc063b9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd9800640 1 -- 172.21.15.17:0/3804805495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 msgr2=0x55cc063b9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd9800640 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 0x55cc063b9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd9800640 1 -- 172.21.15.17:0/3804805495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0610a040 con 0x55cc06343830 2024-09-10T23:18:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbd9800640 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc063b9bc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00a430 tx=0x7ffbcc091300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19484ae24d37e88f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbba000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:18:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbba000640 1 -- 172.21.15.17:0/3804805495 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc04f160 con 0x55cc06343830 2024-09-10T23:18:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbba000640 1 -- 172.21.15.17:0/3804805495 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7ffbcc062150 con 0x55cc06343830 2024-09-10T23:18:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.342+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3804805495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbcc062600 con 0x55cc06343830 2024-09-10T23:18:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbba000640 1 -- 172.21.15.17:0/3804805495 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ffbcc062350 con 0x55cc06343830 2024-09-10T23:18:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 10 client.5328 fetch_fsmap learned FSMap version 20 2024-09-10T23:18:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3804805495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55cc060d6620 con 0x55cc06343830 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbba000640 1 -- 172.21.15.17:0/3804805495 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbcc062600 con 0x55cc06343830 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbba000640 1 -- 172.21.15.17:0/3804805495 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7ffbcc05ce30 con 0x55cc06343830 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 10 client.5328 fetch_fsmap finished waiting for FSMap version 20 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 10 client.5328 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 20 client.5328 populate_metadata read hostname 'smithi017' 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55cc06356490 0x55cc063568a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 4 client.5328 mds_command: new command op to 5016 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3804805495 --> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55cc0614e590 con 0x55cc06356490 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55cc06356490 0x55cc063568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbd8e00640 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55cc06356490 0x55cc063568a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60f0baea353d7152 server_cookie=51c49d583f5b1f8e in_seq=0 out_seq=0 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbba000640 10 client.5328 ms_handle_connect on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbba000640 1 -- 172.21.15.17:0/3804805495 <== mds.0 v2:172.21.15.17:6833/3608620403 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18120 (crc 0 0 0) 0x55cc0614e590 con 0x55cc06356490 2024-09-10T23:18:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbba000640 10 client.5328 handle_command_reply: tid=0 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 client.5328 shutdown 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3804805495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 msgr2=0x55cc063b9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc063b9bc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00a430 tx=0x7ffbcc091300 comp rx=0 tx=0).stop 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3804805495 shutdown_connections 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.17:6833/3608620403,v1:172.21.15.17:6835/3608620403] conn(0x55cc06356490 0x55cc063568a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc06343830 0x55cc063b9bc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc062f99b0 0x55cc063b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 --2- 172.21.15.17:0/3804805495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc061dd1d0 0x55cc063b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbba000640 0 client.5328 ms_handle_reset on v2:172.21.15.17:6833/3608620403 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3804805495 >> 172.21.15.17:0/3804805495 conn(0x55cc05dfe880 msgr2=0x55cc062f3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3804805495 shutdown_connections 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 1 -- 172.21.15.17:0/3804805495 wait complete. 2024-09-10T23:18:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdeb9b000 20 client.5328 trim_cache size 0 max 16384 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 5878, 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 5877, 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1467926, 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 39802532, 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 17, 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 6, 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.667103683, 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.356965052, 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.121749384, 2024-09-10T23:18:40.355 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.144914205, 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 5876, 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.782064748, 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000133094 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 10, 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000910, 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000091 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T23:18:40.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4020, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 4015, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1116532, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 18090717, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.436121867, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.229807349, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.088878075, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.088484212, 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:18:40.357 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 4015, 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.828445825, 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000206337 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 130592, 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 30416 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 35064, 2024-09-10T23:18:40.358 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 60981, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 12732293, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 52936573, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 8, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 6.505344636, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 3.729367658, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 2.880835917, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.472081667, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 60979, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.833631434, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000030069 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:18:40.359 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 88593, 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.017727906, 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000200 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 98832 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T23:18:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 10049, 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 15.593417828, 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001551738 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3427, 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.687003786, 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000200467 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 28269, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 28269, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 28269, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 270.073703071, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.009553705 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 0, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 12, 2024-09-10T23:18:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 17888, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 17888, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 0, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 17888, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 0, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 2, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 2, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 2, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 48031, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 47456, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 0, 2024-09-10T23:18:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 118, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 2013, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 0, 2024-09-10T23:18:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 0, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 2013, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 13, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 2, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 11, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 2000, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 6159, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 6018, 2024-09-10T23:18:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 6157, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 2000, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 32, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 17843 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 0, 2024-09-10T23:18:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 4192, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 3623, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 2250, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:18:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 1, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_succeeded": 0, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_write_failed": 0 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-09-10T23:18:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 23892, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 23892, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 31, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 31, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 3, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-09-10T23:18:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 82997239, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 0, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6613, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 81.941719015, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.012391005 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 0 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 14, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 2016, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 2002, 2024-09-10T23:18:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 13, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 13, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 0, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 17888, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 19888, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 2000, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 2, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 2002, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 2000, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 98940, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 336478208 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-09-10T23:18:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 37307, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 28269, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 8, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 0, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2000, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.654427759, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000827213 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1999, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.601509299, 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000300905 2024-09-10T23:18:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6000, 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 10.419111576, 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001736518 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8007, 2024-09-10T23:18:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 5.279149780, 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000659316 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-09-10T23:18:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.020169414, 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.006723138 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.002959964, 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002959964 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.005944958, 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.005944958 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-09-10T23:18:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6, 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.090302563, 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.015050427 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2250, 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 231.824953332, 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.103033312 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.004597527, 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.004597527 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-09-10T23:18:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000270131, 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000270131 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-09-10T23:18:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8000, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 20.170306768, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002521288 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-09-10T23:18:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-09-10T23:18:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2024-09-10T23:18:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2024-09-10T23:18:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 18453, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 18453, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 103, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:18:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-10T23:18:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:18:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 251527, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 86, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 5624, 2024-09-10T23:18:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 80, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 13044524, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 661712, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-09-10T23:18:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 12538, 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 79215148, 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 31, 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 12538, 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 12538, 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 44.095640713, 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003516959 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 12538, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 12620 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 12538, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 2084, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 10454, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 0, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 11, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 69, 2024-09-10T23:18:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 6680, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 44, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 1623, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 2030, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 2015, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 22, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-09-10T23:18:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-09-10T23:18:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 46, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 5, 2024-09-10T23:18:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 8, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 8, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 104, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 0, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 22 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 1, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-09-10T23:18:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 32, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 32, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 3623, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 3623, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 44958, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 11264450, 2024-09-10T23:18:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 44958, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 44958, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 11264450, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:18:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 12538, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 79594055, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 12538, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 79594055, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 12538, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 12538, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 12538, 2024-09-10T23:18:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 12538, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 3623, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 378907, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 3623, 2024-09-10T23:18:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 67, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 378907, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x5572e5b7a500": { 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 23892, 2024-09-10T23:18:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 78802935, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 23892, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 6613, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 78802935, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "trackedop": { 2024-09-10T23:18:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-09-10T23:18:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:40.402 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:18:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 -- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffbb40725e0 msgr2=0x7ffbb4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffbb40725e0 0x7ffbb4074aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800bb50 tx=0x7ffbc800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 -- 172.21.15.17:0/536787381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd415be00 msgr2=0x7ffbd40b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd415be00 0x7ffbd40b0590 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c770 tx=0x7ffbcc00cc30 comp rx=0 tx=0).stop 2024-09-10T23:18:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 -- 172.21.15.17:0/536787381 shutdown_connections 2024-09-10T23:18:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffbb40725e0 0x7ffbb4074aa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbd415be00 0x7ffbd40b0590 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbd40b1740 0x7ffbd40b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 --2- 172.21.15.17:0/536787381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffbd40b12e0 0x7ffbd414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 -- 172.21.15.17:0/536787381 >> 172.21.15.17:0/536787381 conn(0x7ffbd409a9f0 msgr2=0x7ffbd4155840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 -- 172.21.15.17:0/536787381 shutdown_connections 2024-09-10T23:18:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.346+0000 7ffbdb800640 1 -- 172.21.15.17:0/536787381 wait complete. 2024-09-10T23:18:40.404 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:18:40.405 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:40.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:40.593 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:18:40.593 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:40.593 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:18:40.593 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:40.602 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:18:40.602 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:40.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:18:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.834+0000 7fc2c9800640 1 -- 172.21.15.17:0/2556029829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 msgr2=0x7fc2c40728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.834+0000 7fc2c9800640 1 --2- 172.21.15.17:0/2556029829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 0x7fc2c40728a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009c80 tx=0x7fc2bc01f5a0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.834+0000 7fc2c9800640 1 -- 172.21.15.17:0/2556029829 shutdown_connections 2024-09-10T23:18:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.834+0000 7fc2c9800640 1 --2- 172.21.15.17:0/2556029829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 0x7fc2c40728a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.834+0000 7fc2c9800640 1 --2- 172.21.15.17:0/2556029829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2c41416c0 0x7fc2c40ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.834+0000 7fc2c9800640 1 -- 172.21.15.17:0/2556029829 >> 172.21.15.17:0/2556029829 conn(0x7fc2c40b1730 msgr2=0x7fc2c40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.834+0000 7fc2c9800640 1 -- 172.21.15.17:0/2556029829 shutdown_connections 2024-09-10T23:18:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.834+0000 7fc2c9800640 1 -- 172.21.15.17:0/2556029829 wait complete. 2024-09-10T23:18:40.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 Processor -- start 2024-09-10T23:18:40.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 -- start start 2024-09-10T23:18:40.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c41416c0 0x7fc2c4151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2c4141aa0 0x7fc2c413f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 0x7fc2c413fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c4073280 con 0x7fc2c4141e80 2024-09-10T23:18:40.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c4073100 con 0x7fc2c41416c0 2024-09-10T23:18:40.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c4073400 con 0x7fc2c4141aa0 2024-09-10T23:18:40.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 0x7fc2c413fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 0x7fc2c413fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39102/0 (socket says 172.21.15.17:39102) 2024-09-10T23:18:40.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c3400640 1 -- 172.21.15.17:0/1887615979 learned_addr learned my addr 172.21.15.17:0/1887615979 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:40.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c2a00640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c41416c0 0x7fc2c4151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2ba000640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2c4141aa0 0x7fc2c413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c3400640 1 -- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2c4141aa0 msgr2=0x7fc2c413f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c3400640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2c4141aa0 0x7fc2c413f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c3400640 1 -- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c41416c0 msgr2=0x7fc2c4151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:40.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c3400640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c41416c0 0x7fc2c4151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:40.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c3400640 1 -- 172.21.15.17:0/1887615979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c406e790 con 0x7fc2c4141e80 2024-09-10T23:18:40.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c3400640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 0x7fc2c413fdd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009bd0 tx=0x7fc2bc009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2bb400640 1 -- 172.21.15.17:0/1887615979 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc004a50 con 0x7fc2c4141e80 2024-09-10T23:18:40.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2bb400640 1 -- 172.21.15.17:0/1887615979 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2bc004ce0 con 0x7fc2c4141e80 2024-09-10T23:18:40.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2bb400640 1 -- 172.21.15.17:0/1887615979 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0afb00 con 0x7fc2c4141e80 2024-09-10T23:18:40.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c406ea70 con 0x7fc2c4141e80 2024-09-10T23:18:40.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.838+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c406f030 con 0x7fc2c4141e80 2024-09-10T23:18:40.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.842+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c4073990 con 0x7fc2c4141e80 2024-09-10T23:18:40.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.842+0000 7fc2bb400640 1 -- 172.21.15.17:0/1887615979 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc2bc0afca0 con 0x7fc2c4141e80 2024-09-10T23:18:40.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.842+0000 7fc2bb400640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2a00725e0 0x7fc2a0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:40.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.842+0000 7fc2bb400640 1 -- 172.21.15.17:0/1887615979 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fc2bc131dd0 con 0x7fc2c4141e80 2024-09-10T23:18:40.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.842+0000 7fc2c2a00640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2a00725e0 0x7fc2a0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:40.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.842+0000 7fc2c2a00640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2a00725e0 0x7fc2a0074aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40af3d0 tx=0x7fc2b400b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:40.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:40.846+0000 7fc2bb400640 1 -- 172.21.15.17:0/1887615979 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc2bc0ca030 con 0x7fc2c4141e80 2024-09-10T23:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2c40af400 con 0x7fc2c4141e80 2024-09-10T23:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2bb400640 1 -- 172.21.15.17:0/1887615979 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7fc2bc0ac050 con 0x7fc2c4141e80 2024-09-10T23:18:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:18:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2a00725e0 msgr2=0x7fc2a0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2a00725e0 0x7fc2a0074aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40af3d0 tx=0x7fc2b400b390 comp rx=0 tx=0).stop 2024-09-10T23:18:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 msgr2=0x7fc2c413fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 0x7fc2c413fdd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009bd0 tx=0x7fc2bc009350 comp rx=0 tx=0).stop 2024-09-10T23:18:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 shutdown_connections 2024-09-10T23:18:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2a00725e0 0x7fc2a0074aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2c4141e80 0x7fc2c413fdd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2c4141aa0 0x7fc2c413f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 --2- 172.21.15.17:0/1887615979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c41416c0 0x7fc2c4151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 >> 172.21.15.17:0/1887615979 conn(0x7fc2c40b1730 msgr2=0x7fc2c40cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 shutdown_connections 2024-09-10T23:18:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.034+0000 7fc2c9800640 1 -- 172.21.15.17:0/1887615979 wait complete. 2024-09-10T23:18:41.059 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:18:41.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:41.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:18:41.078 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[37023]: fuse finished with error 0 and tester_r 0 2024-09-10T23:18:41.094 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:18:41.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:18:41.095 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:18:41.263 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:41.264 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:18:41.264 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:41.273 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:41.273 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:41.273 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:18:41.273 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:41.312 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:18:41.312 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:18:41.313 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:18:41.313 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:41.326 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:41.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 -- 172.21.15.17:0/1509607974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500cee30 msgr2=0x7fa7500b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 --2- 172.21.15.17:0/1509607974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500cee30 0x7fa7500b1430 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa750073bd0 tx=0x7fa74801ccf0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 -- 172.21.15.17:0/1509607974 shutdown_connections 2024-09-10T23:18:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 --2- 172.21.15.17:0/1509607974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7500cee30 0x7fa7500b1430 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 --2- 172.21.15.17:0/1509607974 >> v2:172.21.15.77:3300/0 conn(0x7fa75015f350 0x7fa7500b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 -- 172.21.15.17:0/1509607974 >> 172.21.15.17:0/1509607974 conn(0x7fa7500d1d10 msgr2=0x7fa7500d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 -- 172.21.15.17:0/1509607974 shutdown_connections 2024-09-10T23:18:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 -- 172.21.15.17:0/1509607974 wait complete. 2024-09-10T23:18:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 Processor -- start 2024-09-10T23:18:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 -- start start 2024-09-10T23:18:41.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.498+0000 7fa757600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7500cee30 0x7fa750159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:41.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa757600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa75015f350 0x7fa7500c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:41.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa757600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa75015f730 0x7fa7500c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa757600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa750168bd0 con 0x7fa75015f730 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa757600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa7500b2440 con 0x7fa7500cee30 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa757600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa750168d50 con 0x7fa75015f350 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa755600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa75015f730 0x7fa7500c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa755600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa75015f730 0x7fa7500c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39128/0 (socket says 172.21.15.17:39128) 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa755600640 1 -- 172.21.15.17:0/2252344020 learned_addr learned my addr 172.21.15.17:0/2252344020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa754c00640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7500cee30 0x7fa750159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa747e00640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa75015f350 0x7fa7500c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa755600640 1 -- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa75015f350 msgr2=0x7fa7500c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa755600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa75015f350 0x7fa7500c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa755600640 1 -- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7500cee30 msgr2=0x7fa750159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa755600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7500cee30 0x7fa750159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa755600640 1 -- 172.21.15.17:0/2252344020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75015a1b0 con 0x7fa75015f730 2024-09-10T23:18:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa755600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa75015f730 0x7fa7500c7da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa748009bd0 tx=0x7fa748003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa74d600640 1 -- 172.21.15.17:0/2252344020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480bb070 con 0x7fa75015f730 2024-09-10T23:18:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa74d600640 1 -- 172.21.15.17:0/2252344020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa748004e00 con 0x7fa75015f730 2024-09-10T23:18:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa74d600640 1 -- 172.21.15.17:0/2252344020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480b2040 con 0x7fa75015f730 2024-09-10T23:18:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7500c82e0 con 0x7fa75015f730 2024-09-10T23:18:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75015c5f0 con 0x7fa75015f730 2024-09-10T23:18:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7500b1430 con 0x7fa75015f730 2024-09-10T23:18:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.502+0000 7fa74d600640 1 -- 172.21.15.17:0/2252344020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa7480b5030 con 0x7fa75015f730 2024-09-10T23:18:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.506+0000 7fa74d600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa72c0725e0 0x7fa72c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.506+0000 7fa74d600640 1 -- 172.21.15.17:0/2252344020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fa74812cf90 con 0x7fa75015f730 2024-09-10T23:18:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.506+0000 7fa754c00640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa72c0725e0 0x7fa72c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.506+0000 7fa754c00640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa72c0725e0 0x7fa72c074aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa74000bc00 tx=0x7fa74000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:41.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.510+0000 7fa74d600640 1 -- 172.21.15.17:0/2252344020 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa748016970 con 0x7fa75015f730 2024-09-10T23:18:41.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7500cc1d0 con 0x7fa75015f730 2024-09-10T23:18:41.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa74d600640 1 -- 172.21.15.17:0/2252344020 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5220 (secure 0 0 0) 0x7fa7480f7e50 con 0x7fa75015f730 2024-09-10T23:18:41.721 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:41.722 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"btime":"2024-09-10T23:16:56:047738+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1906911663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1906911663},{"type":"v1","addr":"172.21.15.77:6835","nonce":1906911663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/650482314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":650482314},{"type":"v1","addr":"172.21.15.77:6837","nonce":650482314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":5013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1923332906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1923332906},{"type":"v1","addr":"172.21.15.17:6834","nonce":1923332906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T23:16:47.415488+0000","modified":"2024-09-10T23:16:56.021066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5016":{"gid":5016,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/3608620403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3608620403},{"type":"v1","addr":"172.21.15.17:6835","nonce":3608620403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5016,"qdb_cluster":[5016]},"id":2}]} 2024-09-10T23:18:41.722 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-09-10T23:18:41.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa72c0725e0 msgr2=0x7fa72c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa72c0725e0 0x7fa72c074aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa74000bc00 tx=0x7fa74000b390 comp rx=0 tx=0).stop 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa75015f730 msgr2=0x7fa7500c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa75015f730 0x7fa7500c7da0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa748009bd0 tx=0x7fa748003f60 comp rx=0 tx=0).stop 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 shutdown_connections 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa72c0725e0 0x7fa72c074aa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa75015f730 0x7fa7500c7da0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa75015f350 0x7fa7500c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 --2- 172.21.15.17:0/2252344020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7500cee30 0x7fa750159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 >> 172.21.15.17:0/2252344020 conn(0x7fa7500d1d10 msgr2=0x7fa7500ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 shutdown_connections 2024-09-10T23:18:41.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.718+0000 7fa757600640 1 -- 172.21.15.17:0/2252344020 wait complete. 2024-09-10T23:18:41.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:41.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 -- 172.21.15.17:0/2916526602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1415bc70 msgr2=0x7f9f140cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 --2- 172.21.15.17:0/2916526602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1415bc70 0x7f9f140cfa20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9f140c5560 tx=0x7f9f0401c7d0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 -- 172.21.15.17:0/2916526602 shutdown_connections 2024-09-10T23:18:41.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 --2- 172.21.15.17:0/2916526602 >> v2:172.21.15.77:3300/0 conn(0x7f9f140cc570 0x7f9f140d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 --2- 172.21.15.17:0/2916526602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f1415bc70 0x7f9f140cfa20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 -- 172.21.15.17:0/2916526602 >> 172.21.15.17:0/2916526602 conn(0x7f9f1409a9f0 msgr2=0x7f9f1409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:41.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 -- 172.21.15.17:0/2916526602 shutdown_connections 2024-09-10T23:18:41.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 -- 172.21.15.17:0/2916526602 wait complete. 2024-09-10T23:18:41.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 Processor -- start 2024-09-10T23:18:41.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.886+0000 7f9f13e00640 1 -- start start 2024-09-10T23:18:41.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f140cc570 0x7f9f1406f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:41.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f140d1ed0 0x7f9f1415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:41.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f1415bc70 0x7f9f1415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:41.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14168930 con 0x7f9f140d1ed0 2024-09-10T23:18:41.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9f140ccbd0 con 0x7f9f140cc570 2024-09-10T23:18:41.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9f14168ab0 con 0x7f9f1415bc70 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f140d1ed0 0x7f9f1415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f140d1ed0 0x7f9f1415e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39138/0 (socket says 172.21.15.17:39138) 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12000640 1 -- 172.21.15.17:0/608564219 learned_addr learned my addr 172.21.15.17:0/608564219 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13400640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f1415bc70 0x7f9f1415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12a00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f140cc570 0x7f9f1406f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12000640 1 -- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f1415bc70 msgr2=0x7f9f1415a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12000640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f1415bc70 0x7f9f1415a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12000640 1 -- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f140cc570 msgr2=0x7f9f1406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12000640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f140cc570 0x7f9f1406f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:41.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12000640 1 -- 172.21.15.17:0/608564219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1406dcd0 con 0x7f9f140d1ed0 2024-09-10T23:18:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f12000640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f140d1ed0 0x7f9f1415e600 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c970 tx=0x7f9f0000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f0aa00640 1 -- 172.21.15.17:0/608564219 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00007c70 con 0x7f9f140d1ed0 2024-09-10T23:18:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f0aa00640 1 -- 172.21.15.17:0/608564219 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f0000f450 con 0x7f9f140d1ed0 2024-09-10T23:18:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1406fbe0 con 0x7f9f140d1ed0 2024-09-10T23:18:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f0aa00640 1 -- 172.21.15.17:0/608564219 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0000f8a0 con 0x7f9f140d1ed0 2024-09-10T23:18:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1406e550 con 0x7f9f140d1ed0 2024-09-10T23:18:41.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.890+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f1406e750 con 0x7f9f140d1ed0 2024-09-10T23:18:41.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.894+0000 7f9f0aa00640 1 -- 172.21.15.17:0/608564219 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9f00020030 con 0x7f9f140d1ed0 2024-09-10T23:18:41.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.894+0000 7f9f0aa00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ef40725e0 0x7f9ef4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:41.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.894+0000 7f9f0aa00640 1 -- 172.21.15.17:0/608564219 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f9f000939b0 con 0x7f9f140d1ed0 2024-09-10T23:18:41.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.894+0000 7f9f12a00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ef40725e0 0x7f9ef4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.894+0000 7f9f12a00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ef40725e0 0x7f9ef4074aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f040af000 tx=0x7f9f0401b010 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:41.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:41.898+0000 7f9f0aa00640 1 -- 172.21.15.17:0/608564219 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9f1406e750 con 0x7f9f140d1ed0 2024-09-10T23:18:42.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f140d1990 con 0x7f9f140d1ed0 2024-09-10T23:18:42.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f0aa00640 1 -- 172.21.15.17:0/608564219 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5220 (secure 0 0 0) 0x7f9f00014030 con 0x7f9f140d1ed0 2024-09-10T23:18:42.110 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:42.110 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"btime":"2024-09-10T23:16:56:047738+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1906911663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1906911663},{"type":"v1","addr":"172.21.15.77:6835","nonce":1906911663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/650482314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":650482314},{"type":"v1","addr":"172.21.15.77:6837","nonce":650482314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":5013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1923332906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1923332906},{"type":"v1","addr":"172.21.15.17:6834","nonce":1923332906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T23:16:47.415488+0000","modified":"2024-09-10T23:16:56.021066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5016":{"gid":5016,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/3608620403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3608620403},{"type":"v1","addr":"172.21.15.17:6835","nonce":3608620403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5016,"qdb_cluster":[5016]},"id":2}]} 2024-09-10T23:18:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-09-10T23:18:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ef40725e0 msgr2=0x7f9ef4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ef40725e0 0x7f9ef4074aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f040af000 tx=0x7f9f0401b010 comp rx=0 tx=0).stop 2024-09-10T23:18:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f140d1ed0 msgr2=0x7f9f1415e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f140d1ed0 0x7f9f1415e600 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c970 tx=0x7f9f0000ce30 comp rx=0 tx=0).stop 2024-09-10T23:18:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 shutdown_connections 2024-09-10T23:18:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ef40725e0 0x7f9ef4074aa0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f1415bc70 0x7f9f1415a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f140d1ed0 0x7f9f1415e600 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 --2- 172.21.15.17:0/608564219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f140cc570 0x7f9f1406f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 >> 172.21.15.17:0/608564219 conn(0x7f9f1409a9f0 msgr2=0x7f9f1409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 shutdown_connections 2024-09-10T23:18:42.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.106+0000 7f9f13e00640 1 -- 172.21.15.17:0/608564219 wait complete. 2024-09-10T23:18:42.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.274+0000 7f3e78000640 1 -- 172.21.15.17:0/4064096221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 msgr2=0x7f3e700ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.274+0000 7f3e78000640 1 --2- 172.21.15.17:0/4064096221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 0x7f3e700ccf80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009c80 tx=0x7f3e6801cda0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.274+0000 7f3e78000640 1 -- 172.21.15.17:0/4064096221 shutdown_connections 2024-09-10T23:18:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.274+0000 7f3e78000640 1 --2- 172.21.15.17:0/4064096221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 0x7f3e700ccf80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.274+0000 7f3e78000640 1 -- 172.21.15.17:0/4064096221 >> 172.21.15.17:0/4064096221 conn(0x7f3e700d1d60 msgr2=0x7f3e700d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.274+0000 7f3e78000640 1 -- 172.21.15.17:0/4064096221 shutdown_connections 2024-09-10T23:18:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.274+0000 7f3e78000640 1 -- 172.21.15.17:0/4064096221 wait complete. 2024-09-10T23:18:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 Processor -- start 2024-09-10T23:18:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 -- start start 2024-09-10T23:18:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e70070ad0 0x7f3e70144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 0x7f3e701f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7015f770 0x7f3e70155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7016a550 con 0x7f3e700d1830 2024-09-10T23:18:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7016a3d0 con 0x7f3e7015f770 2024-09-10T23:18:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7016a6d0 con 0x7f3e70070ad0 2024-09-10T23:18:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e74c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 0x7f3e701f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e74c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 0x7f3e701f7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39152/0 (socket says 172.21.15.17:39152) 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e74c00640 1 -- 172.21.15.17:0/813825741 learned_addr learned my addr 172.21.15.17:0/813825741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e75600640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e70070ad0 0x7f3e70144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e76000640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7015f770 0x7f3e70155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e74c00640 1 -- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e70070ad0 msgr2=0x7f3e70144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e74c00640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e70070ad0 0x7f3e70144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e74c00640 1 -- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7015f770 msgr2=0x7f3e70155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e74c00640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7015f770 0x7f3e70155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e74c00640 1 -- 172.21.15.17:0/813825741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e70144f50 con 0x7f3e700d1830 2024-09-10T23:18:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e74c00640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 0x7f3e701f7f00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00c390 tx=0x7f3e5c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e6d600640 1 -- 172.21.15.17:0/813825741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c017070 con 0x7f3e700d1830 2024-09-10T23:18:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e6d600640 1 -- 172.21.15.17:0/813825741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e5c0053e0 con 0x7f3e700d1830 2024-09-10T23:18:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e6d600640 1 -- 172.21.15.17:0/813825741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c003860 con 0x7f3e700d1830 2024-09-10T23:18:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e701f8950 con 0x7f3e700d1830 2024-09-10T23:18:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e70144210 con 0x7f3e700d1830 2024-09-10T23:18:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.278+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e701f8e50 con 0x7f3e700d1830 2024-09-10T23:18:42.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.282+0000 7f3e6d600640 1 -- 172.21.15.17:0/813825741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3e5c003a00 con 0x7f3e700d1830 2024-09-10T23:18:42.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.282+0000 7f3e6d600640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e50072610 0x7f3e50074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.282+0000 7f3e6d600640 1 -- 172.21.15.17:0/813825741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f3e5c092a60 con 0x7f3e700d1830 2024-09-10T23:18:42.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.282+0000 7f3e75600640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e50072610 0x7f3e50074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.282+0000 7f3e75600640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e50072610 0x7f3e50074ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e64000f70 tx=0x7f3e64009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.286+0000 7f3e6d600640 1 -- 172.21.15.17:0/813825741 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3e701f8e50 con 0x7f3e700d1830 2024-09-10T23:18:42.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.462+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e7015f060 con 0x7f3e700d1830 2024-09-10T23:18:42.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.462+0000 7f3e6d600640 1 -- 172.21.15.17:0/813825741 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+17056 (secure 0 0 0) 0x7f3e5c001070 con 0x7f3e700d1830 2024-09-10T23:18:42.468 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:42.468 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":46,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:18:20.716484+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:45.541598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:46.368253+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":45,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.38","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e50072610 msgr2=0x7f3e50074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e50072610 0x7f3e50074ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e64000f70 tx=0x7f3e64009040 comp rx=0 tx=0).stop 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 msgr2=0x7f3e701f7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 0x7f3e701f7f00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00c390 tx=0x7f3e5c00c850 comp rx=0 tx=0).stop 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 shutdown_connections 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e50072610 0x7f3e50074ad0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e7015f770 0x7f3e70155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e700d1830 0x7f3e701f7f00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 --2- 172.21.15.17:0/813825741 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e70070ad0 0x7f3e70144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 >> 172.21.15.17:0/813825741 conn(0x7f3e700d1d60 msgr2=0x7f3e700b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 shutdown_connections 2024-09-10T23:18:42.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.466+0000 7f3e78000640 1 -- 172.21.15.17:0/813825741 wait complete. 2024-09-10T23:18:42.490 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:18:42.490 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.630+0000 7f9447000640 1 -- 172.21.15.17:0/4266821077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015e5d0 msgr2=0x7f94400b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.630+0000 7f9447000640 1 --2- 172.21.15.17:0/4266821077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015e5d0 0x7f94400b3e30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9440072880 tx=0x7f942801c890 comp rx=0 tx=0).stop 2024-09-10T23:18:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 -- 172.21.15.17:0/4266821077 shutdown_connections 2024-09-10T23:18:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 --2- 172.21.15.17:0/4266821077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94400b4370 0x7f94400d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 --2- 172.21.15.17:0/4266821077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015e5d0 0x7f94400b3e30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 --2- 172.21.15.17:0/4266821077 >> v2:172.21.15.77:3300/0 conn(0x7f944015ef40 0x7f944015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 -- 172.21.15.17:0/4266821077 >> 172.21.15.17:0/4266821077 conn(0x7f944006cfc0 msgr2=0x7f944006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 -- 172.21.15.17:0/4266821077 shutdown_connections 2024-09-10T23:18:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 -- 172.21.15.17:0/4266821077 wait complete. 2024-09-10T23:18:42.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 Processor -- start 2024-09-10T23:18:42.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 -- start start 2024-09-10T23:18:42.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94400b4370 0x7f9440146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f944015e5d0 0x7f94401f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015ef40 0x7f944014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9440168120 con 0x7f944015ef40 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9440167fa0 con 0x7f944015e5d0 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f94401682a0 con 0x7f94400b4370 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9445000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015ef40 0x7f944014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9445000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015ef40 0x7f944014dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39174/0 (socket says 172.21.15.17:39174) 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9445000640 1 -- 172.21.15.17:0/694679043 learned_addr learned my addr 172.21.15.17:0/694679043 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f943fe00640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94400b4370 0x7f9440146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9445000640 1 -- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94400b4370 msgr2=0x7f9440146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9445000640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94400b4370 0x7f9440146330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9437e00640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f944015e5d0 0x7f94401f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9445000640 1 -- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f944015e5d0 msgr2=0x7f94401f7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9445000640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f944015e5d0 0x7f94401f7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9445000640 1 -- 172.21.15.17:0/694679043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9440146870 con 0x7f944015ef40 2024-09-10T23:18:42.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9437e00640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f944015e5d0 0x7f94401f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:42.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9445000640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015ef40 0x7f944014dd40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f943800e990 tx=0x7f943800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f943cc00640 1 -- 172.21.15.17:0/694679043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438004d30 con 0x7f944015ef40 2024-09-10T23:18:42.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f943cc00640 1 -- 172.21.15.17:0/694679043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f943800caa0 con 0x7f944015ef40 2024-09-10T23:18:42.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f943cc00640 1 -- 172.21.15.17:0/694679043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438005020 con 0x7f944015ef40 2024-09-10T23:18:42.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.634+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94401f8700 con 0x7f944015ef40 2024-09-10T23:18:42.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.638+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944014aa50 con 0x7f944015ef40 2024-09-10T23:18:42.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.638+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94400b3e30 con 0x7f944015ef40 2024-09-10T23:18:42.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.638+0000 7f943cc00640 1 -- 172.21.15.17:0/694679043 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f943800f040 con 0x7f944015ef40 2024-09-10T23:18:42.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.638+0000 7f943cc00640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f941c0725e0 0x7f941c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:42.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.638+0000 7f943cc00640 1 -- 172.21.15.17:0/694679043 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f9438093880 con 0x7f944015ef40 2024-09-10T23:18:42.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.638+0000 7f943fe00640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f941c0725e0 0x7f941c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:42.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.642+0000 7f943fe00640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f941c0725e0 0x7f941c074aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9430009a70 tx=0x7f9430005ee0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:42.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.642+0000 7f943cc00640 1 -- 172.21.15.17:0/694679043 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9438016030 con 0x7f944015ef40 2024-09-10T23:18:42.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.854+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f944014ce20 con 0x7f944015ef40 2024-09-10T23:18:42.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.854+0000 7f943cc00640 1 -- 172.21.15.17:0/694679043 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5220 (secure 0 0 0) 0x7f943805ee30 con 0x7f944015ef40 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"btime":"2024-09-10T23:16:56:047738+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1906911663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1906911663},{"type":"v1","addr":"172.21.15.77:6835","nonce":1906911663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/650482314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":650482314},{"type":"v1","addr":"172.21.15.77:6837","nonce":650482314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":5013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1923332906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1923332906},{"type":"v1","addr":"172.21.15.17:6834","nonce":1923332906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T23:16:47.415488+0000","modified":"2024-09-10T23:16:56.021066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5016":{"gid":5016,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/3608620403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3608620403},{"type":"v1","addr":"172.21.15.17:6835","nonce":3608620403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5016,"qdb_cluster":[5016]},"id":2}]} 2024-09-10T23:18:42.860 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f941c0725e0 msgr2=0x7f941c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f941c0725e0 0x7f941c074aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9430009a70 tx=0x7f9430005ee0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015ef40 msgr2=0x7f944014dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015ef40 0x7f944014dd40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f943800e990 tx=0x7f943800ee50 comp rx=0 tx=0).stop 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 shutdown_connections 2024-09-10T23:18:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f941c0725e0 0x7f941c074aa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f944015ef40 0x7f944014dd40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f944015e5d0 0x7f94401f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 --2- 172.21.15.17:0/694679043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94400b4370 0x7f9440146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 >> 172.21.15.17:0/694679043 conn(0x7f944006cfc0 msgr2=0x7f94400b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 shutdown_connections 2024-09-10T23:18:42.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:42.858+0000 7f9447000640 1 -- 172.21.15.17:0/694679043 wait complete. 2024-09-10T23:18:42.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 -- 172.21.15.17:0/1989141053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 msgr2=0x7fe6a80cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 --2- 172.21.15.17:0/1989141053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 0x7fe6a80cd880 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80cf010 tx=0x7fe6a001cda0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 -- 172.21.15.17:0/1989141053 shutdown_connections 2024-09-10T23:18:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 --2- 172.21.15.17:0/1989141053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 0x7fe6a80cd880 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 --2- 172.21.15.17:0/1989141053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a8070ad0 0x7fe6a815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 -- 172.21.15.17:0/1989141053 >> 172.21.15.17:0/1989141053 conn(0x7fe6a80d1d60 msgr2=0x7fe6a80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 -- 172.21.15.17:0/1989141053 shutdown_connections 2024-09-10T23:18:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 -- 172.21.15.17:0/1989141053 wait complete. 2024-09-10T23:18:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 Processor -- start 2024-09-10T23:18:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 -- start start 2024-09-10T23:18:43.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a8070ad0 0x7fe6a8164a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 0x7fe6a80b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a80d1830 0x7fe6a80b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a8169460 con 0x7fe6a80cf320 2024-09-10T23:18:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81692e0 con 0x7fe6a80d1830 2024-09-10T23:18:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6b0200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a81695e0 con 0x7fe6a8070ad0 2024-09-10T23:18:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ace00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 0x7fe6a80b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ace00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 0x7fe6a80b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39190/0 (socket says 172.21.15.17:39190) 2024-09-10T23:18:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ace00640 1 -- 172.21.15.17:0/2097268391 learned_addr learned my addr 172.21.15.17:0/2097268391 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ad800640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a8070ad0 0x7fe6a8164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ae200640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a80d1830 0x7fe6a80b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ace00640 1 -- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a8070ad0 msgr2=0x7fe6a8164a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ace00640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a8070ad0 0x7fe6a8164a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ace00640 1 -- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a80d1830 msgr2=0x7fe6a80b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ace00640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a80d1830 0x7fe6a80b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ace00640 1 -- 172.21.15.17:0/2097268391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a80b1c50 con 0x7fe6a80cf320 2024-09-10T23:18:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ad800640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a8070ad0 0x7fe6a8164a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.026+0000 7fe6ae200640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a80d1830 0x7fe6a80b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:43.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6ace00640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 0x7fe6a80b6b30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c3c0 tx=0x7fe69400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:43.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6a5600640 1 -- 172.21.15.17:0/2097268391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694017070 con 0x7fe6a80cf320 2024-09-10T23:18:43.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6a5600640 1 -- 172.21.15.17:0/2097268391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6940053c0 con 0x7fe6a80cf320 2024-09-10T23:18:43.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a80b1f30 con 0x7fe6a80cf320 2024-09-10T23:18:43.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6a5600640 1 -- 172.21.15.17:0/2097268391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694003860 con 0x7fe6a80cf320 2024-09-10T23:18:43.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a80b24f0 con 0x7fe6a80cf320 2024-09-10T23:18:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a815f060 con 0x7fe6a80cf320 2024-09-10T23:18:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6a5600640 1 -- 172.21.15.17:0/2097268391 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe694003a00 con 0x7fe6a80cf320 2024-09-10T23:18:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6a5600640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6880725e0 0x7fe688074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6a5600640 1 -- 172.21.15.17:0/2097268391 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fe694092a40 con 0x7fe6a80cf320 2024-09-10T23:18:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.030+0000 7fe6ad800640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6880725e0 0x7fe688074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.034+0000 7fe6ad800640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6880725e0 0x7fe688074aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe69c005fd0 tx=0x7fe69c005e60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:43.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.034+0000 7fe6a5600640 1 -- 172.21.15.17:0/2097268391 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe69405df50 con 0x7fe6a80cf320 2024-09-10T23:18:43.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6a8165f60 con 0x7fe6a80cf320 2024-09-10T23:18:43.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6a5600640 1 -- 172.21.15.17:0/2097268391 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5220 (secure 0 0 0) 0x7fe69405d850 con 0x7fe6a80cf320 2024-09-10T23:18:43.250 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:43.250 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"btime":"2024-09-10T23:16:56:047738+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1906911663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1906911663},{"type":"v1","addr":"172.21.15.77:6835","nonce":1906911663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/650482314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":650482314},{"type":"v1","addr":"172.21.15.77:6837","nonce":650482314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":5013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1923332906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1923332906},{"type":"v1","addr":"172.21.15.17:6834","nonce":1923332906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T23:16:47.415488+0000","modified":"2024-09-10T23:16:56.021066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5016},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5016":{"gid":5016,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6835/3608620403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3608620403},{"type":"v1","addr":"172.21.15.17:6835","nonce":3608620403}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5016,"qdb_cluster":[5016]},"id":2}]} 2024-09-10T23:18:43.250 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-09-10T23:18:43.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6880725e0 msgr2=0x7fe688074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6880725e0 0x7fe688074aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe69c005fd0 tx=0x7fe69c005e60 comp rx=0 tx=0).stop 2024-09-10T23:18:43.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 msgr2=0x7fe6a80b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 0x7fe6a80b6b30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c3c0 tx=0x7fe69400c880 comp rx=0 tx=0).stop 2024-09-10T23:18:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 shutdown_connections 2024-09-10T23:18:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6880725e0 0x7fe688074aa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a80d1830 0x7fe6a80b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a80cf320 0x7fe6a80b6b30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 --2- 172.21.15.17:0/2097268391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a8070ad0 0x7fe6a8164a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 >> 172.21.15.17:0/2097268391 conn(0x7fe6a80d1d60 msgr2=0x7fe6a8158300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.246+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 shutdown_connections 2024-09-10T23:18:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.250+0000 7fe6b0200640 1 -- 172.21.15.17:0/2097268391 wait complete. 2024-09-10T23:18:43.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 -- 172.21.15.17:0/3468735851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068073610 msgr2=0x7f90680739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 --2- 172.21.15.17:0/3468735851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068073610 0x7f90680739f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9068072df0 tx=0x7f905801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 -- 172.21.15.17:0/3468735851 shutdown_connections 2024-09-10T23:18:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 --2- 172.21.15.17:0/3468735851 >> v2:172.21.15.77:3300/0 conn(0x7f9068070fa0 0x7f906815ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 --2- 172.21.15.17:0/3468735851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068073610 0x7f90680739f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 -- 172.21.15.17:0/3468735851 >> 172.21.15.17:0/3468735851 conn(0x7f90680cfd30 msgr2=0x7f90680d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 -- 172.21.15.17:0/3468735851 shutdown_connections 2024-09-10T23:18:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 -- 172.21.15.17:0/3468735851 wait complete. 2024-09-10T23:18:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 Processor -- start 2024-09-10T23:18:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.414+0000 7f9067200640 1 -- start start 2024-09-10T23:18:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9067200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068070a70 0x7f90680c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9067200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068070fa0 0x7f90680c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9067200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9068073610 0x7f90680c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9067200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f906806f580 con 0x7f9068070fa0 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9067200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f906806f400 con 0x7f9068070a70 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9067200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f906806f700 con 0x7f9068073610 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068070fa0 0x7f90680c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068070fa0 0x7f90680c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39218/0 (socket says 172.21.15.17:39218) 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905fe00640 1 -- 172.21.15.17:0/460920031 learned_addr learned my addr 172.21.15.17:0/460920031 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9065e00640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068070a70 0x7f90680c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9066800640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9068073610 0x7f90680c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905fe00640 1 -- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9068073610 msgr2=0x7f90680c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905fe00640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9068073610 0x7f90680c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905fe00640 1 -- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068070a70 msgr2=0x7f90680c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905fe00640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068070a70 0x7f90680c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905fe00640 1 -- 172.21.15.17:0/460920031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9068073f30 con 0x7f9068070fa0 2024-09-10T23:18:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9066800640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9068073610 0x7f90680c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905fe00640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068070fa0 0x7f90680c4fc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f905000d950 tx=0x7f905000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905e000640 1 -- 172.21.15.17:0/460920031 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050017070 con 0x7f9068070fa0 2024-09-10T23:18:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905e000640 1 -- 172.21.15.17:0/460920031 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9050009d20 con 0x7f9068070fa0 2024-09-10T23:18:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9068142230 con 0x7f9068070fa0 2024-09-10T23:18:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905e000640 1 -- 172.21.15.17:0/460920031 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500106c0 con 0x7f9068070fa0 2024-09-10T23:18:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90681f8fd0 con 0x7f9068070fa0 2024-09-10T23:18:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90680739f0 con 0x7f9068070fa0 2024-09-10T23:18:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.418+0000 7f905e000640 1 -- 172.21.15.17:0/460920031 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9050010860 con 0x7f9068070fa0 2024-09-10T23:18:43.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.422+0000 7f905e000640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.422+0000 7f905e000640 1 -- 172.21.15.17:0/460920031 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f9050093860 con 0x7f9068070fa0 2024-09-10T23:18:43.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.422+0000 7f9065e00640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.422+0000 7f9065e00640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90580af000 tx=0x7f905801b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.426+0000 7f905e000640 1 -- 172.21.15.17:0/460920031 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f905005ed90 con 0x7f9068070fa0 2024-09-10T23:18:43.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.598+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90680ced40 con 0x7f9068070fa0 2024-09-10T23:18:43.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.598+0000 7f905e000640 1 -- 172.21.15.17:0/460920031 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+17056 (secure 0 0 0) 0x7f905005e690 con 0x7f9068070fa0 2024-09-10T23:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:43.604 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":46,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:18:20.716484+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:16:45.541598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T23:16:46.368253+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":45,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.38","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 msgr2=0x7f9044074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90580af000 tx=0x7f905801b100 comp rx=0 tx=0).stop 2024-09-10T23:18:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068070fa0 msgr2=0x7f90680c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068070fa0 0x7f90680c4fc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f905000d950 tx=0x7f905000de10 comp rx=0 tx=0).stop 2024-09-10T23:18:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 shutdown_connections 2024-09-10T23:18:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9068073610 0x7f90680c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068070fa0 0x7f90680c4fc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 --2- 172.21.15.17:0/460920031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068070a70 0x7f90680c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 >> 172.21.15.17:0/460920031 conn(0x7f90680cfd30 msgr2=0x7f9068156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:43.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 shutdown_connections 2024-09-10T23:18:43.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.602+0000 7f9067200640 1 -- 172.21.15.17:0/460920031 wait complete. 2024-09-10T23:18:43.626 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:18:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.770+0000 7f3f0fc00640 1 -- 172.21.15.17:0/625613492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 msgr2=0x7f3f080cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.770+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/625613492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 0x7f3f080cdf50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3f080cc3b0 tx=0x7f3ef401f0b0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.770+0000 7f3f0fc00640 1 -- 172.21.15.17:0/625613492 shutdown_connections 2024-09-10T23:18:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.770+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/625613492 >> v2:172.21.15.77:3300/0 conn(0x7f3f080ce490 0x7f3f080ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.770+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/625613492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 0x7f3f080cdf50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.770+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/625613492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f080c70e0 0x7f3f080c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.770+0000 7f3f0fc00640 1 -- 172.21.15.17:0/625613492 >> 172.21.15.17:0/625613492 conn(0x7f3f080b39c0 msgr2=0x7f3f080b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.770+0000 7f3f0fc00640 1 -- 172.21.15.17:0/625613492 shutdown_connections 2024-09-10T23:18:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.770+0000 7f3f0fc00640 1 -- 172.21.15.17:0/625613492 wait complete. 2024-09-10T23:18:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 Processor -- start 2024-09-10T23:18:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 -- start start 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 0x7f3f0814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f080c70e0 0x7f3f08071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f080ce490 0x7f3f08071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3f080cf210 con 0x7f3f080b44e0 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f080cf090 con 0x7f3f080c70e0 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f080cfeb0 con 0x7f3f080ce490 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 0x7f3f0814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 0x7f3f0814e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39246/0 (socket says 172.21.15.17:39246) 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0d200640 1 -- 172.21.15.17:0/1414306767 learned_addr learned my addr 172.21.15.17:0/1414306767 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f07e00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f080c70e0 0x7f3f08071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f080ce490 0x7f3f08071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0d200640 1 -- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f080ce490 msgr2=0x7f3f08071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0d200640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f080ce490 0x7f3f08071fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0d200640 1 -- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f080c70e0 msgr2=0x7f3f08071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0d200640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f080c70e0 0x7f3f08071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:43.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0d200640 1 -- 172.21.15.17:0/1414306767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f08151270 con 0x7f3f080b44e0 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0d200640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 0x7f3f0814e880 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e9f0 tx=0x7f3efc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f04c00640 1 -- 172.21.15.17:0/1414306767 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00ccc0 con 0x7f3f080b44e0 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f04c00640 1 -- 172.21.15.17:0/1414306767 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3efc00ce60 con 0x7f3f080b44e0 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f04c00640 1 -- 172.21.15.17:0/1414306767 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc005280 con 0x7f3f080b44e0 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f08151550 con 0x7f3f080b44e0 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.774+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f08151b10 con 0x7f3f080b44e0 2024-09-10T23:18:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.778+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f080c74c0 con 0x7f3f080b44e0 2024-09-10T23:18:43.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.778+0000 7f3f04c00640 1 -- 172.21.15.17:0/1414306767 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3efc005420 con 0x7f3f080b44e0 2024-09-10T23:18:43.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.778+0000 7f3f04c00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ee80725e0 0x7f3ee8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:43.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.778+0000 7f3f04c00640 1 -- 172.21.15.17:0/1414306767 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f3efc093de0 con 0x7f3f080b44e0 2024-09-10T23:18:43.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.778+0000 7f3f07e00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ee80725e0 0x7f3ee8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:43.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.778+0000 7f3f07e00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ee80725e0 0x7f3ee8074aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40b2000 tx=0x7f3ef401d8f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.782+0000 7f3f04c00640 1 -- 172.21.15.17:0/1414306767 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3efc05ed40 con 0x7f3f080b44e0 2024-09-10T23:18:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.994+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3f080b4e40 con 0x7f3f080b44e0 2024-09-10T23:18:43.998 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:18:43.994+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:18:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.994+0000 7f3f04c00640 1 -- 172.21.15.17:0/1414306767 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7f3efc063770 con 0x7f3f080b44e0 2024-09-10T23:18:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:18:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ee80725e0 msgr2=0x7f3ee8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ee80725e0 0x7f3ee8074aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40b2000 tx=0x7f3ef401d8f0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 msgr2=0x7f3f0814e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 0x7f3f0814e880 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e9f0 tx=0x7f3efc00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 shutdown_connections 2024-09-10T23:18:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ee80725e0 0x7f3ee8074aa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f080ce490 0x7f3f08071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f080c70e0 0x7f3f08071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 --2- 172.21.15.17:0/1414306767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080b44e0 0x7f3f0814e880 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 >> 172.21.15.17:0/1414306767 conn(0x7f3f080b39c0 msgr2=0x7f3f080b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 shutdown_connections 2024-09-10T23:18:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:43.998+0000 7f3f0fc00640 1 -- 172.21.15.17:0/1414306767 wait complete. 2024-09-10T23:18:44.025 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:18:44.076 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:18:44.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.170+0000 7f072f200640 1 -- 172.21.15.17:0/3834078340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280cff00 msgr2=0x7f07280d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.170+0000 7f072f200640 1 --2- 172.21.15.17:0/3834078340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280cff00 0x7f07280d02e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0718009840 tx=0x7f071801c680 comp rx=0 tx=0).stop 2024-09-10T23:18:44.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.170+0000 7f072f200640 1 -- 172.21.15.17:0/3834078340 shutdown_connections 2024-09-10T23:18:44.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.170+0000 7f072f200640 1 --2- 172.21.15.17:0/3834078340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07280b0b00 0x7f07280b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.170+0000 7f072f200640 1 --2- 172.21.15.17:0/3834078340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280cff00 0x7f07280d02e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.170+0000 7f072f200640 1 -- 172.21.15.17:0/3834078340 >> 172.21.15.17:0/3834078340 conn(0x7f07280d1da0 msgr2=0x7f07280d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:44.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.170+0000 7f072f200640 1 -- 172.21.15.17:0/3834078340 shutdown_connections 2024-09-10T23:18:44.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.170+0000 7f072f200640 1 -- 172.21.15.17:0/3834078340 wait complete. 2024-09-10T23:18:44.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 Processor -- start 2024-09-10T23:18:44.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 -- start start 2024-09-10T23:18:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aea70 0x7f07281513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07280b0b00 0x7f072815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07280cff00 0x7f072815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f072806f750 con 0x7f07280b0b00 2024-09-10T23:18:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f072806f5d0 con 0x7f07280aea70 2024-09-10T23:18:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f072806f8d0 con 0x7f07280cff00 2024-09-10T23:18:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f071fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07280b0b00 0x7f072815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f071fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07280b0b00 0x7f072815dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39268/0 (socket says 172.21.15.17:39268) 2024-09-10T23:18:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f071fe00640 1 -- 172.21.15.17:0/3171916368 learned_addr learned my addr 172.21.15.17:0/3171916368 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f0727e00640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aea70 0x7f07281513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072d200640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07280cff00 0x7f072815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f071fe00640 1 -- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07280cff00 msgr2=0x7f072815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f071fe00640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07280cff00 0x7f072815e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f071fe00640 1 -- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aea70 msgr2=0x7f07281513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f071fe00640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aea70 0x7f07281513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f071fe00640 1 -- 172.21.15.17:0/3171916368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0728161750 con 0x7f07280b0b00 2024-09-10T23:18:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f0727e00640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aea70 0x7f07281513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f071fe00640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07280b0b00 0x7f072815dce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f071000c700 tx=0x7f071000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f0724c00640 1 -- 172.21.15.17:0/3171916368 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710005270 con 0x7f07280b0b00 2024-09-10T23:18:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f0724c00640 1 -- 172.21.15.17:0/3171916368 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0710005410 con 0x7f07280b0b00 2024-09-10T23:18:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f0724c00640 1 -- 172.21.15.17:0/3171916368 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071000a880 con 0x7f07280b0b00 2024-09-10T23:18:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07280b79b0 con 0x7f07280b0b00 2024-09-10T23:18:44.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.174+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07281518f0 con 0x7f07280b0b00 2024-09-10T23:18:44.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.178+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07280b30b0 con 0x7f07280b0b00 2024-09-10T23:18:44.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.178+0000 7f0724c00640 1 -- 172.21.15.17:0/3171916368 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f071000aa20 con 0x7f07280b0b00 2024-09-10T23:18:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.178+0000 7f0724c00640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07040725e0 0x7f0704074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.178+0000 7f0724c00640 1 -- 172.21.15.17:0/3171916368 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6216+0+0 (secure 0 0 0) 0x7f0710093210 con 0x7f07280b0b00 2024-09-10T23:18:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.178+0000 7f0727e00640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07040725e0 0x7f0704074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:44.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.182+0000 7f0727e00640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07040725e0 0x7f0704074aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07180af000 tx=0x7f07180b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:44.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.182+0000 7f0724c00640 1 -- 172.21.15.17:0/3171916368 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f071005e650 con 0x7f07280b0b00 2024-09-10T23:18:44.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.394+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f07280b08e0 con 0x7f07280b0b00 2024-09-10T23:18:45.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:44.998+0000 7f0724c00640 1 -- 172.21.15.17:0/3171916368 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7f071005df50 con 0x7f07280b0b00 2024-09-10T23:18:45.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07040725e0 msgr2=0x7f0704074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07040725e0 0x7f0704074aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07180af000 tx=0x7f07180b2040 comp rx=0 tx=0).stop 2024-09-10T23:18:45.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07280b0b00 msgr2=0x7f072815dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07280b0b00 0x7f072815dce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f071000c700 tx=0x7f071000cbc0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 shutdown_connections 2024-09-10T23:18:45.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07040725e0 0x7f0704074aa0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07180af000 tx=0x7f07180b2040 comp rx=0 tx=0).stop 2024-09-10T23:18:45.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07280cff00 0x7f072815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07280b0b00 0x7f072815dce0 secure :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f071000c700 tx=0x7f071000cbc0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 --2- 172.21.15.17:0/3171916368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07280aea70 0x7f07281513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 >> 172.21.15.17:0/3171916368 conn(0x7f07280d1da0 msgr2=0x7f07280d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:45.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 shutdown_connections 2024-09-10T23:18:45.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.002+0000 7f072f200640 1 -- 172.21.15.17:0/3171916368 wait complete. 2024-09-10T23:18:45.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:18:45.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.182+0000 7fddef400640 1 -- 172.21.15.17:0/604903311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde8072b40 msgr2=0x7fdde8073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.182+0000 7fddef400640 1 --2- 172.21.15.17:0/604903311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde8072b40 0x7fdde8073710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009870 tx=0x7fddd401c840 comp rx=0 tx=0).stop 2024-09-10T23:18:45.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.182+0000 7fddef400640 1 -- 172.21.15.17:0/604903311 shutdown_connections 2024-09-10T23:18:45.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.182+0000 7fddef400640 1 --2- 172.21.15.17:0/604903311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde8072b40 0x7fdde8073710 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.182+0000 7fddef400640 1 -- 172.21.15.17:0/604903311 >> 172.21.15.17:0/604903311 conn(0x7fdde80b17a0 msgr2=0x7fdde80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:45.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.182+0000 7fddef400640 1 -- 172.21.15.17:0/604903311 shutdown_connections 2024-09-10T23:18:45.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.182+0000 7fddef400640 1 -- 172.21.15.17:0/604903311 wait complete. 2024-09-10T23:18:45.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.182+0000 7fddef400640 1 Processor -- start 2024-09-10T23:18:45.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.182+0000 7fddef400640 1 -- start start 2024-09-10T23:18:45.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde8072b40 0x7fdde814cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddef400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80b3940 0x7fdde80cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddef400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde815ab30 0x7fdde80cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddef400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdde8168c50 con 0x7fdde8072b40 2024-09-10T23:18:45.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddef400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdde8168ad0 con 0x7fdde80b3940 2024-09-10T23:18:45.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddef400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdde8168dd0 con 0x7fdde815ab30 2024-09-10T23:18:45.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddeca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde8072b40 0x7fdde814cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddeca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde8072b40 0x7fdde814cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39284/0 (socket says 172.21.15.17:39284) 2024-09-10T23:18:45.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddeca00640 1 -- 172.21.15.17:0/3016247066 learned_addr learned my addr 172.21.15.17:0/3016247066 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddeca00640 1 -- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde815ab30 msgr2=0x7fdde80cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fdde7e00640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80b3940 0x7fdde80cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fdded400640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde815ab30 0x7fdde80cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddeca00640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde815ab30 0x7fdde80cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddeca00640 1 -- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80b3940 msgr2=0x7fdde80cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddeca00640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80b3940 0x7fdde80cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddeca00640 1 -- 172.21.15.17:0/3016247066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde815c9b0 con 0x7fdde8072b40 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fdde7e00640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80b3940 0x7fdde80cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fdded400640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde815ab30 0x7fdde80cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:45.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddeca00640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde8072b40 0x7fdde814cfb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00c760 tx=0x7fdddc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:45.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fdde4c00640 1 -- 172.21.15.17:0/3016247066 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc016020 con 0x7fdde8072b40 2024-09-10T23:18:45.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fdde4c00640 1 -- 172.21.15.17:0/3016247066 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdddc00a8d0 con 0x7fdde8072b40 2024-09-10T23:18:45.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fdde4c00640 1 -- 172.21.15.17:0/3016247066 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc00ad60 con 0x7fdde8072b40 2024-09-10T23:18:45.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde815cc90 con 0x7fdde8072b40 2024-09-10T23:18:45.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde814d4f0 con 0x7fdde8072b40 2024-09-10T23:18:45.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde8073990 con 0x7fdde8072b40 2024-09-10T23:18:45.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.186+0000 7fdde4c00640 1 -- 172.21.15.17:0/3016247066 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdddc01b400 con 0x7fdde8072b40 2024-09-10T23:18:45.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.190+0000 7fdde4c00640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fddc80725e0 0x7fddc8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:45.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.190+0000 7fdde4c00640 1 -- 172.21.15.17:0/3016247066 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6216+0+0 (secure 0 0 0) 0x7fdddc0938f0 con 0x7fdde8072b40 2024-09-10T23:18:45.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.190+0000 7fdde7e00640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fddc80725e0 0x7fddc8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:45.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.190+0000 7fdde7e00640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fddc80725e0 0x7fddc8074aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fddd40af000 tx=0x7fddd401b080 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.194+0000 7fdde4c00640 1 -- 172.21.15.17:0/3016247066 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdddc020020 con 0x7fdde8072b40 2024-09-10T23:18:45.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:45.366+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdde80cfde0 con 0x7fdde8072b40 2024-09-10T23:18:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.006+0000 7fdde4c00640 1 -- 172.21.15.17:0/3016247066 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) ==== 181+0+0 (secure 0 0 0) 0x7fdde80cd030 con 0x7fdde8072b40 2024-09-10T23:18:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:18:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fddc80725e0 msgr2=0x7fddc8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fddc80725e0 0x7fddc8074aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fddd40af000 tx=0x7fddd401b080 comp rx=0 tx=0).stop 2024-09-10T23:18:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde8072b40 msgr2=0x7fdde814cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde8072b40 0x7fdde814cfb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00c760 tx=0x7fdddc00cc20 comp rx=0 tx=0).stop 2024-09-10T23:18:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 shutdown_connections 2024-09-10T23:18:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fddc80725e0 0x7fddc8074aa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdde815ab30 0x7fdde80cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdde80b3940 0x7fdde80cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 --2- 172.21.15.17:0/3016247066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde8072b40 0x7fdde814cfb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 >> 172.21.15.17:0/3016247066 conn(0x7fdde80b17a0 msgr2=0x7fdde80d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 shutdown_connections 2024-09-10T23:18:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.010+0000 7fddef400640 1 -- 172.21.15.17:0/3016247066 wait complete. 2024-09-10T23:18:46.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:18:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.190+0000 7f45d0400640 1 -- 172.21.15.17:0/3081212746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c80d0320 msgr2=0x7f45c815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.190+0000 7f45d0400640 1 --2- 172.21.15.17:0/3081212746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c80d0320 0x7f45c815c680 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f45c815f880 tx=0x7f45c001cd80 comp rx=0 tx=0).stop 2024-09-10T23:18:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.190+0000 7f45d0400640 1 -- 172.21.15.17:0/3081212746 shutdown_connections 2024-09-10T23:18:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.190+0000 7f45d0400640 1 --2- 172.21.15.17:0/3081212746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c80d0320 0x7f45c815c680 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.190+0000 7f45d0400640 1 --2- 172.21.15.17:0/3081212746 >> v2:172.21.15.77:3300/0 conn(0x7f45c815d4f0 0x7f45c80cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.190+0000 7f45d0400640 1 -- 172.21.15.17:0/3081212746 >> 172.21.15.17:0/3081212746 conn(0x7f45c809a9f0 msgr2=0x7f45c809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.190+0000 7f45d0400640 1 -- 172.21.15.17:0/3081212746 shutdown_connections 2024-09-10T23:18:46.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.190+0000 7f45d0400640 1 -- 172.21.15.17:0/3081212746 wait complete. 2024-09-10T23:18:46.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 Processor -- start 2024-09-10T23:18:46.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 -- start start 2024-09-10T23:18:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45c80d0320 0x7f45c80b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c815be00 0x7f45c80b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c815d4f0 0x7f45c8152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45c8168cc0 con 0x7f45c815d4f0 2024-09-10T23:18:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45c80d2c00 con 0x7f45c815be00 2024-09-10T23:18:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f45c8168e40 con 0x7f45c80d0320 2024-09-10T23:18:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45ce400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c815d4f0 0x7f45c8152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45ce400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c815d4f0 0x7f45c8152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39310/0 (socket says 172.21.15.17:39310) 2024-09-10T23:18:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45ce400640 1 -- 172.21.15.17:0/914735939 learned_addr learned my addr 172.21.15.17:0/914735939 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45cd000640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c815be00 0x7f45c80b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45cda00640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45c80d0320 0x7f45c80b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45ce400640 1 -- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45c80d0320 msgr2=0x7f45c80b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45ce400640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45c80d0320 0x7f45c80b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45ce400640 1 -- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c815be00 msgr2=0x7f45c80b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45ce400640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c815be00 0x7f45c80b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45ce400640 1 -- 172.21.15.17:0/914735939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c80cc930 con 0x7f45c815d4f0 2024-09-10T23:18:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45ce400640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c815d4f0 0x7f45c8152e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f45c001b430 tx=0x7f45c00a5b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45c5600640 1 -- 172.21.15.17:0/914735939 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00bb070 con 0x7f45c815d4f0 2024-09-10T23:18:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45c5600640 1 -- 172.21.15.17:0/914735939 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45c0004d40 con 0x7f45c815d4f0 2024-09-10T23:18:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c80b7410 con 0x7f45c815d4f0 2024-09-10T23:18:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45c5600640 1 -- 172.21.15.17:0/914735939 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b2040 con 0x7f45c815d4f0 2024-09-10T23:18:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.194+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c80ccbd0 con 0x7f45c815d4f0 2024-09-10T23:18:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.198+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c80b7a30 con 0x7f45c815d4f0 2024-09-10T23:18:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.198+0000 7f45c5600640 1 -- 172.21.15.17:0/914735939 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f45c00b5030 con 0x7f45c815d4f0 2024-09-10T23:18:46.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.198+0000 7f45c5600640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45a80725e0 0x7f45a8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:46.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.198+0000 7f45c5600640 1 -- 172.21.15.17:0/914735939 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5778+0+0 (secure 0 0 0) 0x7f45c012d020 con 0x7f45c815d4f0 2024-09-10T23:18:46.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.198+0000 7f45cda00640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45a80725e0 0x7f45a8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:46.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.198+0000 7f45cda00640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45a80725e0 0x7f45a8074aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45bc007fd0 tx=0x7f45bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:46.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.202+0000 7f45c5600640 1 -- 172.21.15.17:0/914735939 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f45c80b19f0 con 0x7f45c815d4f0 2024-09-10T23:18:46.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:46.378+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45c815c660 con 0x7f45c815d4f0 2024-09-10T23:18:47.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.010+0000 7f45c5600640 1 -- 172.21.15.17:0/914735939 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) ==== 169+0+0 (secure 0 0 0) 0x7f45c0016970 con 0x7f45c815d4f0 2024-09-10T23:18:47.016 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:18:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45a80725e0 msgr2=0x7f45a8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45a80725e0 0x7f45a8074aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45bc007fd0 tx=0x7f45bc009040 comp rx=0 tx=0).stop 2024-09-10T23:18:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c815d4f0 msgr2=0x7f45c8152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c815d4f0 0x7f45c8152e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f45c001b430 tx=0x7f45c00a5b60 comp rx=0 tx=0).stop 2024-09-10T23:18:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 shutdown_connections 2024-09-10T23:18:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45a80725e0 0x7f45a8074aa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45c815d4f0 0x7f45c8152e50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45c815be00 0x7f45c80b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 --2- 172.21.15.17:0/914735939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f45c80d0320 0x7f45c80b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 >> 172.21.15.17:0/914735939 conn(0x7f45c809a9f0 msgr2=0x7f45c815e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 shutdown_connections 2024-09-10T23:18:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.018+0000 7f45d0400640 1 -- 172.21.15.17:0/914735939 wait complete. 2024-09-10T23:18:47.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:18:47.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.214+0000 7fa58f400640 1 -- 172.21.15.17:0/2417657982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5880707a0 msgr2=0x7fa5880b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.214+0000 7fa58f400640 1 --2- 172.21.15.17:0/2417657982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5880707a0 0x7fa5880b32d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa580009bc0 tx=0x7fa58001ca30 comp rx=0 tx=0).stop 2024-09-10T23:18:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.214+0000 7fa58f400640 1 -- 172.21.15.17:0/2417657982 shutdown_connections 2024-09-10T23:18:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.214+0000 7fa58f400640 1 --2- 172.21.15.17:0/2417657982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5880707a0 0x7fa5880b32d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.214+0000 7fa58f400640 1 --2- 172.21.15.17:0/2417657982 >> v2:172.21.15.77:3300/0 conn(0x7fa588073b80 0x7fa58815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.214+0000 7fa58f400640 1 -- 172.21.15.17:0/2417657982 >> 172.21.15.17:0/2417657982 conn(0x7fa5880b1730 msgr2=0x7fa5880b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.214+0000 7fa58f400640 1 -- 172.21.15.17:0/2417657982 shutdown_connections 2024-09-10T23:18:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.214+0000 7fa58f400640 1 -- 172.21.15.17:0/2417657982 wait complete. 2024-09-10T23:18:47.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 Processor -- start 2024-09-10T23:18:47.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 -- start start 2024-09-10T23:18:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa58806e910 0x7fa5880ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5880707a0 0x7fa5881fb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa588073b80 0x7fa5881434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa588167a70 con 0x7fa58806e910 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa5881678f0 con 0x7fa5880707a0 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa588167bf0 con 0x7fa588073b80 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa58806e910 0x7fa5880ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa58806e910 0x7fa5880ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49308/0 (socket says 172.21.15.17:49308) 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58ca00640 1 -- 172.21.15.17:0/2008526858 learned_addr learned my addr 172.21.15.17:0/2008526858 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa587e00640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5880707a0 0x7fa5881fb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58d400640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa588073b80 0x7fa5881434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58ca00640 1 -- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa588073b80 msgr2=0x7fa5881434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58ca00640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa588073b80 0x7fa5881434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58ca00640 1 -- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5880707a0 msgr2=0x7fa5881fb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58ca00640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5880707a0 0x7fa5881fb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58ca00640 1 -- 172.21.15.17:0/2008526858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5881fb8e0 con 0x7fa58806e910 2024-09-10T23:18:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa587e00640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5880707a0 0x7fa5881fb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58d400640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa588073b80 0x7fa5881434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58ca00640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa58806e910 0x7fa5880ac880 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00e970 tx=0x7fa57c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa584c00640 1 -- 172.21.15.17:0/2008526858 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00cd20 con 0x7fa58806e910 2024-09-10T23:18:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa584c00640 1 -- 172.21.15.17:0/2008526858 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa57c004020 con 0x7fa58806e910 2024-09-10T23:18:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa584c00640 1 -- 172.21.15.17:0/2008526858 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c004470 con 0x7fa58806e910 2024-09-10T23:18:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5880a94f0 con 0x7fa58806e910 2024-09-10T23:18:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.218+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5880a9ab0 con 0x7fa58806e910 2024-09-10T23:18:47.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.222+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5880b32d0 con 0x7fa58806e910 2024-09-10T23:18:47.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.222+0000 7fa584c00640 1 -- 172.21.15.17:0/2008526858 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa57c003600 con 0x7fa58806e910 2024-09-10T23:18:47.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.222+0000 7fa584c00640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5680725e0 0x7fa568074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:47.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.222+0000 7fa584c00640 1 -- 172.21.15.17:0/2008526858 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fa57c093ac0 con 0x7fa58806e910 2024-09-10T23:18:47.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.222+0000 7fa587e00640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5680725e0 0x7fa568074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:47.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.226+0000 7fa587e00640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5680725e0 0x7fa568074aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa574001230 tx=0x7fa574009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:47.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.226+0000 7fa584c00640 1 -- 172.21.15.17:0/2008526858 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa5881fb8e0 con 0x7fa58806e910 2024-09-10T23:18:47.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.402+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fa58815e2c0 con 0x7fa58806e910 2024-09-10T23:18:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.406+0000 7fa584c00640 1 -- 172.21.15.17:0/2008526858 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7fa57c05f270 con 0x7fa58806e910 2024-09-10T23:18:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5680725e0 msgr2=0x7fa568074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5680725e0 0x7fa568074aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa574001230 tx=0x7fa574009040 comp rx=0 tx=0).stop 2024-09-10T23:18:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa58806e910 msgr2=0x7fa5880ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa58806e910 0x7fa5880ac880 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00e970 tx=0x7fa57c00ee30 comp rx=0 tx=0).stop 2024-09-10T23:18:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 shutdown_connections 2024-09-10T23:18:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5680725e0 0x7fa568074aa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa588073b80 0x7fa5881434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5880707a0 0x7fa5881fb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 --2- 172.21.15.17:0/2008526858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa58806e910 0x7fa5880ac880 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 >> 172.21.15.17:0/2008526858 conn(0x7fa5880b1730 msgr2=0x7fa58815c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 shutdown_connections 2024-09-10T23:18:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.410+0000 7fa58f400640 1 -- 172.21.15.17:0/2008526858 wait complete. 2024-09-10T23:18:47.433 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-10T23:18:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.574+0000 7f4e38a00640 1 -- 172.21.15.17:0/5307040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e18004810 msgr2=0x7f4e18004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.574+0000 7f4e38a00640 1 --2- 172.21.15.17:0/5307040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e18004810 0x7f4e18004c90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c006f90 tx=0x7f4e1c01ceb0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 -- 172.21.15.17:0/5307040 shutdown_connections 2024-09-10T23:18:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 --2- 172.21.15.17:0/5307040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e18004810 0x7f4e18004c90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 -- 172.21.15.17:0/5307040 >> 172.21.15.17:0/5307040 conn(0x7f4e340d1d60 msgr2=0x7f4e340d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 -- 172.21.15.17:0/5307040 shutdown_connections 2024-09-10T23:18:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 -- 172.21.15.17:0/5307040 wait complete. 2024-09-10T23:18:47.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 Processor -- start 2024-09-10T23:18:47.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 -- start start 2024-09-10T23:18:47.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e18004810 0x7f4e340b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:47.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e340c6f00 0x7f4e340c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:47.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e34157ef0 0x7f4e341583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:47.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4e340d0350 con 0x7f4e340c6f00 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e340d01d0 con 0x7f4e34157ef0 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e38a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e340d04d0 con 0x7f4e18004810 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e340c6f00 0x7f4e340c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e340c6f00 0x7f4e340c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49330/0 (socket says 172.21.15.17:49330) 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2be00640 1 -- 172.21.15.17:0/2342104561 learned_addr learned my addr 172.21.15.17:0/2342104561 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e31e00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e18004810 0x7f4e340b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e32800640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e34157ef0 0x7f4e341583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2be00640 1 -- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e18004810 msgr2=0x7f4e340b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2be00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e18004810 0x7f4e340b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2be00640 1 -- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e34157ef0 msgr2=0x7f4e341583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2be00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e34157ef0 0x7f4e341583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2be00640 1 -- 172.21.15.17:0/2342104561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e340c79c0 con 0x7f4e340c6f00 2024-09-10T23:18:47.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2be00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e340c6f00 0x7f4e340c7380 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c01b5b0 tx=0x7f4e1c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:47.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2a000640 1 -- 172.21.15.17:0/2342104561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c006290 con 0x7f4e340c6f00 2024-09-10T23:18:47.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.578+0000 7f4e2a000640 1 -- 172.21.15.17:0/2342104561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e1c006540 con 0x7f4e340c6f00 2024-09-10T23:18:47.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.582+0000 7f4e2a000640 1 -- 172.21.15.17:0/2342104561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c003860 con 0x7f4e340c6f00 2024-09-10T23:18:47.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.582+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e340c7ca0 con 0x7f4e340c6f00 2024-09-10T23:18:47.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.582+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e340b1be0 con 0x7f4e340c6f00 2024-09-10T23:18:47.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.582+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e340c7ee0 con 0x7f4e340c6f00 2024-09-10T23:18:47.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.582+0000 7f4e2a000640 1 -- 172.21.15.17:0/2342104561 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4e1c003a00 con 0x7f4e340c6f00 2024-09-10T23:18:47.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.582+0000 7f4e2a000640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e100725e0 0x7f4e10074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:47.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.582+0000 7f4e2a000640 1 -- 172.21.15.17:0/2342104561 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f4e1c12cdc0 con 0x7f4e340c6f00 2024-09-10T23:18:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.582+0000 7f4e31e00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e100725e0 0x7f4e10074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.586+0000 7f4e31e00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e100725e0 0x7f4e10074aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4e340b39b0 tx=0x7f4e240091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:47.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.586+0000 7f4e2a000640 1 -- 172.21.15.17:0/2342104561 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4e1c016c90 con 0x7f4e340c6f00 2024-09-10T23:18:47.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:47.822+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f4e340b0870 con 0x7f4e340c6f00 2024-09-10T23:18:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.014+0000 7f4e2a000640 1 -- 172.21.15.17:0/2342104561 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v160) ==== 148+0+0 (secure 0 0 0) 0x7f4e1c0016c0 con 0x7f4e340c6f00 2024-09-10T23:18:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e100725e0 msgr2=0x7f4e10074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e100725e0 0x7f4e10074aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4e340b39b0 tx=0x7f4e240091e0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e340c6f00 msgr2=0x7f4e340c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e340c6f00 0x7f4e340c7380 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c01b5b0 tx=0x7f4e1c001cb0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 shutdown_connections 2024-09-10T23:18:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4e100725e0 0x7f4e10074aa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e34157ef0 0x7f4e341583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e340c6f00 0x7f4e340c7380 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 --2- 172.21.15.17:0/2342104561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e18004810 0x7f4e340b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 >> 172.21.15.17:0/2342104561 conn(0x7f4e340d1d60 msgr2=0x7f4e340d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 shutdown_connections 2024-09-10T23:18:48.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.018+0000 7f4e38a00640 1 -- 172.21.15.17:0/2342104561 wait complete. 2024-09-10T23:18:48.042 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-09-10T23:18:48.042 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T23:18:48.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:48.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.186+0000 7f3e35c00640 1 -- 172.21.15.17:0/3880538591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e14003c70 msgr2=0x7f3e14004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.186+0000 7f3e35c00640 1 --2- 172.21.15.17:0/3880538591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e14003c70 0x7f3e14004070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3e20001860 tx=0x7f3e2001c8e0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.186+0000 7f3e2f400640 1 -- 172.21.15.17:0/3880538591 reap_dead start 2024-09-10T23:18:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.186+0000 7f3e35c00640 1 -- 172.21.15.17:0/3880538591 shutdown_connections 2024-09-10T23:18:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.186+0000 7f3e35c00640 1 -- 172.21.15.17:0/3880538591 >> 172.21.15.17:0/3880538591 conn(0x7f3e300b3870 msgr2=0x7f3e300b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.186+0000 7f3e35c00640 1 -- 172.21.15.17:0/3880538591 shutdown_connections 2024-09-10T23:18:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.186+0000 7f3e35c00640 1 -- 172.21.15.17:0/3880538591 wait complete. 2024-09-10T23:18:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.186+0000 7f3e35c00640 1 Processor -- start 2024-09-10T23:18:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.186+0000 7f3e35c00640 1 -- start start 2024-09-10T23:18:48.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e35c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e14003c70 0x7f3e3014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e35c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e300c5400 0x7f3e300c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e35c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e30158100 0x7f3e300c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e35c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3015eba0 con 0x7f3e14003c70 2024-09-10T23:18:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e35c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3015ea20 con 0x7f3e300c5400 2024-09-10T23:18:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e35c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3015ed20 con 0x7f3e30158100 2024-09-10T23:18:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e14003c70 0x7f3e3014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e14003c70 0x7f3e3014a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49354/0 (socket says 172.21.15.17:49354) 2024-09-10T23:18:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2ea00640 1 -- 172.21.15.17:0/66908566 learned_addr learned my addr 172.21.15.17:0/66908566 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2e000640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e300c5400 0x7f3e300c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2f400640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e30158100 0x7f3e300c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2ea00640 1 -- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e30158100 msgr2=0x7f3e300c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2ea00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e30158100 0x7f3e300c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2ea00640 1 -- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e300c5400 msgr2=0x7f3e300c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2ea00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e300c5400 0x7f3e300c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2ea00640 1 -- 172.21.15.17:0/66908566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3015c540 con 0x7f3e14003c70 2024-09-10T23:18:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2f400640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e30158100 0x7f3e300c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2e000640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e300c5400 0x7f3e300c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e2ea00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e14003c70 0x7f3e3014a0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3e2001afe0 tx=0x7f3e200a6ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e26a00640 1 -- 172.21.15.17:0/66908566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e20001480 con 0x7f3e14003c70 2024-09-10T23:18:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e26a00640 1 -- 172.21.15.17:0/66908566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e200b5030 con 0x7f3e14003c70 2024-09-10T23:18:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e26a00640 1 -- 172.21.15.17:0/66908566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e200068d0 con 0x7f3e14003c70 2024-09-10T23:18:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3015c820 con 0x7f3e14003c70 2024-09-10T23:18:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e300b5b40 con 0x7f3e14003c70 2024-09-10T23:18:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.190+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3015db00 con 0x7f3e14003c70 2024-09-10T23:18:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.194+0000 7f3e26a00640 1 -- 172.21.15.17:0/66908566 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3e20003860 con 0x7f3e14003c70 2024-09-10T23:18:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.194+0000 7f3e26a00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e100725e0 0x7f3e10074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.194+0000 7f3e26a00640 1 -- 172.21.15.17:0/66908566 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f3e2012d720 con 0x7f3e14003c70 2024-09-10T23:18:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.194+0000 7f3e2e000640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e100725e0 0x7f3e10074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.194+0000 7f3e2e000640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e100725e0 0x7f3e10074aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3e300ccbe0 tx=0x7f3e1c000ee0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:48.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.198+0000 7f3e26a00640 1 -- 172.21.15.17:0/66908566 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3e20016690 con 0x7f3e14003c70 2024-09-10T23:18:48.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e300b1030 con 0x7f3e14003c70 2024-09-10T23:18:48.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e26a00640 1 -- 172.21.15.17:0/66908566 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+13245 (secure 0 0 0) 0x7f3e200f8fe0 con 0x7f3e14003c70 2024-09-10T23:18:48.378 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:48.378 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":49,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:18:47.010692+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/3608620403":"2024-09-11T23:18:43.998376+0000","172.21.15.17:6833/3608620403":"2024-09-11T23:18:43.998376+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e100725e0 msgr2=0x7f3e10074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e100725e0 0x7f3e10074aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3e300ccbe0 tx=0x7f3e1c000ee0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e14003c70 msgr2=0x7f3e3014a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e14003c70 0x7f3e3014a0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3e2001afe0 tx=0x7f3e200a6ce0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 shutdown_connections 2024-09-10T23:18:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e100725e0 0x7f3e10074aa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e30158100 0x7f3e300c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e300c5400 0x7f3e300c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 --2- 172.21.15.17:0/66908566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e14003c70 0x7f3e3014a0c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 >> 172.21.15.17:0/66908566 conn(0x7f3e300b3870 msgr2=0x7f3e3015d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 shutdown_connections 2024-09-10T23:18:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.374+0000 7f3e35c00640 1 -- 172.21.15.17:0/66908566 wait complete. 2024-09-10T23:18:48.399 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:18:48.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:18:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 -- 172.21.15.17:0/909130349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40b30e0 msgr2=0x7f3ce41654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 --2- 172.21.15.17:0/909130349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40b30e0 0x7f3ce41654c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009c80 tx=0x7f3cdc01cd70 comp rx=0 tx=0).stop 2024-09-10T23:18:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 -- 172.21.15.17:0/909130349 shutdown_connections 2024-09-10T23:18:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 --2- 172.21.15.17:0/909130349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40b30e0 0x7f3ce41654c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 --2- 172.21.15.17:0/909130349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce415b8c0 0x7f3ce40d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 -- 172.21.15.17:0/909130349 >> 172.21.15.17:0/909130349 conn(0x7f3ce409a9f0 msgr2=0x7f3ce409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 -- 172.21.15.17:0/909130349 shutdown_connections 2024-09-10T23:18:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 -- 172.21.15.17:0/909130349 wait complete. 2024-09-10T23:18:48.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 Processor -- start 2024-09-10T23:18:48.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 -- start start 2024-09-10T23:18:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce40b30e0 0x7f3ce4150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d06b0 0x7f3ce4157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce415b8c0 0x7f3ce4071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4168c90 con 0x7f3ce40b30e0 2024-09-10T23:18:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4168b10 con 0x7f3ce415b8c0 2024-09-10T23:18:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.546+0000 7f3ce3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce4168e10 con 0x7f3ce40d06b0 2024-09-10T23:18:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce40b30e0 0x7f3ce4150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce40b30e0 0x7f3ce4150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49370/0 (socket says 172.21.15.17:49370) 2024-09-10T23:18:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3cdbe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d06b0 0x7f3ce4157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce1e00640 1 -- 172.21.15.17:0/1761913855 learned_addr learned my addr 172.21.15.17:0/1761913855 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:48.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce2800640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce415b8c0 0x7f3ce4071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce1e00640 1 -- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d06b0 msgr2=0x7f3ce4157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce1e00640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d06b0 0x7f3ce4157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce1e00640 1 -- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce415b8c0 msgr2=0x7f3ce4071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce1e00640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce415b8c0 0x7f3ce4071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce1e00640 1 -- 172.21.15.17:0/1761913855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce41511a0 con 0x7f3ce40b30e0 2024-09-10T23:18:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3cdbe00640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d06b0 0x7f3ce4157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce1e00640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce40b30e0 0x7f3ce4150c60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400e7a0 tx=0x7f3cd400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3cda000640 1 -- 172.21.15.17:0/1761913855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400ccc0 con 0x7f3ce40b30e0 2024-09-10T23:18:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3cda000640 1 -- 172.21.15.17:0/1761913855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cd4010430 con 0x7f3ce40b30e0 2024-09-10T23:18:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3cda000640 1 -- 172.21.15.17:0/1761913855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4010860 con 0x7f3ce40b30e0 2024-09-10T23:18:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce4159eb0 con 0x7f3ce40b30e0 2024-09-10T23:18:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce41593f0 con 0x7f3ce40b30e0 2024-09-10T23:18:48.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce40d0170 con 0x7f3ce40b30e0 2024-09-10T23:18:48.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.550+0000 7f3cda000640 1 -- 172.21.15.17:0/1761913855 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3cd4010a00 con 0x7f3ce40b30e0 2024-09-10T23:18:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.554+0000 7f3cda000640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc0072610 0x7f3cc0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.554+0000 7f3cda000640 1 -- 172.21.15.17:0/1761913855 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f3cd4093ac0 con 0x7f3ce40b30e0 2024-09-10T23:18:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.554+0000 7f3cdbe00640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc0072610 0x7f3cc0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.554+0000 7f3cdbe00640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc0072610 0x7f3cc0074ad0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc007fd0 tx=0x7f3ccc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.558+0000 7f3cda000640 1 -- 172.21.15.17:0/1761913855 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3cd405ecb0 con 0x7f3ce40b30e0 2024-09-10T23:18:48.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3ce4154dd0 con 0x7f3ce40b30e0 2024-09-10T23:18:48.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3cda000640 1 -- 172.21.15.17:0/1761913855 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7f3cd40636e0 con 0x7f3ce40b30e0 2024-09-10T23:18:48.734 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:18:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc0072610 msgr2=0x7f3cc0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc0072610 0x7f3cc0074ad0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc007fd0 tx=0x7f3ccc009040 comp rx=0 tx=0).stop 2024-09-10T23:18:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce40b30e0 msgr2=0x7f3ce4150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce40b30e0 0x7f3ce4150c60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400e7a0 tx=0x7f3cd400ec60 comp rx=0 tx=0).stop 2024-09-10T23:18:48.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 shutdown_connections 2024-09-10T23:18:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc0072610 0x7f3cc0074ad0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce415b8c0 0x7f3ce4071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d06b0 0x7f3ce4157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 --2- 172.21.15.17:0/1761913855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce40b30e0 0x7f3ce4150c60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 >> 172.21.15.17:0/1761913855 conn(0x7f3ce409a9f0 msgr2=0x7f3ce4070710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 shutdown_connections 2024-09-10T23:18:48.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.730+0000 7f3ce3200640 1 -- 172.21.15.17:0/1761913855 wait complete. 2024-09-10T23:18:48.755 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-10T23:18:48.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.898+0000 7f4f89e00640 1 -- 172.21.15.17:0/1698041532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cef60 msgr2=0x7f4f840cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.898+0000 7f4f89e00640 1 --2- 172.21.15.17:0/1698041532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cef60 0x7f4f840cfd90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009840 tx=0x7f4f7401c820 comp rx=0 tx=0).stop 2024-09-10T23:18:48.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.898+0000 7f4f89e00640 1 -- 172.21.15.17:0/1698041532 shutdown_connections 2024-09-10T23:18:48.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.898+0000 7f4f89e00640 1 --2- 172.21.15.17:0/1698041532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cef60 0x7f4f840cfd90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.898+0000 7f4f89e00640 1 -- 172.21.15.17:0/1698041532 >> 172.21.15.17:0/1698041532 conn(0x7f4f840b3870 msgr2=0x7f4f840b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:48.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.898+0000 7f4f89e00640 1 -- 172.21.15.17:0/1698041532 shutdown_connections 2024-09-10T23:18:48.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.898+0000 7f4f89e00640 1 -- 172.21.15.17:0/1698041532 wait complete. 2024-09-10T23:18:48.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.898+0000 7f4f89e00640 1 Processor -- start 2024-09-10T23:18:48.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.898+0000 7f4f89e00640 1 -- start start 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f89e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f840b4390 0x7f4f84167840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f89e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f840cef60 0x7f4f841f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f89e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cf340 0x7f4f840afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f89e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8416a870 con 0x7f4f840cf340 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f89e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8416a6f0 con 0x7f4f840b4390 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f89e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4f8416a9f0 con 0x7f4f840cef60 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cf340 0x7f4f840afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cf340 0x7f4f840afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49392/0 (socket says 172.21.15.17:49392) 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f83400640 1 -- 172.21.15.17:0/1236412164 learned_addr learned my addr 172.21.15.17:0/1236412164 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f82a00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f840b4390 0x7f4f84167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f7be00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f840cef60 0x7f4f841f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f83400640 1 -- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f840cef60 msgr2=0x7f4f841f9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f83400640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f840cef60 0x7f4f841f9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f83400640 1 -- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f840b4390 msgr2=0x7f4f84167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f83400640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f840b4390 0x7f4f84167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f83400640 1 -- 172.21.15.17:0/1236412164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f841f9740 con 0x7f4f840cf340 2024-09-10T23:18:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f83400640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cf340 0x7f4f840afba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00ba10 tx=0x7f4f7c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f7b400640 1 -- 172.21.15.17:0/1236412164 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c019070 con 0x7f4f840cf340 2024-09-10T23:18:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f7b400640 1 -- 172.21.15.17:0/1236412164 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f7c00cc30 con 0x7f4f840cf340 2024-09-10T23:18:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f8406de50 con 0x7f4f840cf340 2024-09-10T23:18:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f7b400640 1 -- 172.21.15.17:0/1236412164 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00ce60 con 0x7f4f840cf340 2024-09-10T23:18:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f8406e410 con 0x7f4f840cf340 2024-09-10T23:18:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.902+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f840b1030 con 0x7f4f840cf340 2024-09-10T23:18:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.906+0000 7f4f7b400640 1 -- 172.21.15.17:0/1236412164 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4f7c01e440 con 0x7f4f840cf340 2024-09-10T23:18:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.906+0000 7f4f7b400640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f60072610 0x7f4f60074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.906+0000 7f4f7b400640 1 -- 172.21.15.17:0/1236412164 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f4f7c092fd0 con 0x7f4f840cf340 2024-09-10T23:18:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.906+0000 7f4f82a00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f60072610 0x7f4f60074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:48.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.906+0000 7f4f82a00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f60072610 0x7f4f60074ad0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f740af000 tx=0x7f4f7401b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:48.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:48.910+0000 7f4f7b400640 1 -- 172.21.15.17:0/1236412164 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4f841f9740 con 0x7f4f840cf340 2024-09-10T23:18:49.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:49.146+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f4f840b7ca0 con 0x7f4f840cf340 2024-09-10T23:18:50.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.018+0000 7f4f7b400640 1 -- 172.21.15.17:0/1236412164 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v162) ==== 146+0+0 (secure 0 0 0) 0x7f4f7c05e130 con 0x7f4f840cf340 2024-09-10T23:18:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.022+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f60072610 msgr2=0x7f4f60074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.022+0000 7f4f89e00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f60072610 0x7f4f60074ad0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f740af000 tx=0x7f4f7401b060 comp rx=0 tx=0).stop 2024-09-10T23:18:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.022+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cf340 msgr2=0x7f4f840afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.022+0000 7f4f89e00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cf340 0x7f4f840afba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00ba10 tx=0x7f4f7c00bed0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.026+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 shutdown_connections 2024-09-10T23:18:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.026+0000 7f4f89e00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f60072610 0x7f4f60074ad0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.026+0000 7f4f89e00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840cf340 0x7f4f840afba0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.026+0000 7f4f89e00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f840cef60 0x7f4f841f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.026+0000 7f4f89e00640 1 --2- 172.21.15.17:0/1236412164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f840b4390 0x7f4f84167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.026+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 >> 172.21.15.17:0/1236412164 conn(0x7f4f840b3870 msgr2=0x7f4f840b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.026+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 shutdown_connections 2024-09-10T23:18:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.026+0000 7f4f89e00640 1 -- 172.21.15.17:0/1236412164 wait complete. 2024-09-10T23:18:50.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:18:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.202+0000 7fc5c5400640 1 -- 172.21.15.17:0/4139679281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5c0070ad0 msgr2=0x7fc5c015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.202+0000 7fc5c5400640 1 --2- 172.21.15.17:0/4139679281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5c0070ad0 0x7fc5c015f060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009870 tx=0x7fc5b001c830 comp rx=0 tx=0).stop 2024-09-10T23:18:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.202+0000 7fc5c5400640 1 -- 172.21.15.17:0/4139679281 shutdown_connections 2024-09-10T23:18:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.202+0000 7fc5c5400640 1 --2- 172.21.15.17:0/4139679281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5c0070ad0 0x7fc5c015f060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.202+0000 7fc5c5400640 1 -- 172.21.15.17:0/4139679281 >> 172.21.15.17:0/4139679281 conn(0x7fc5c00d1d60 msgr2=0x7fc5c00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.202+0000 7fc5c5400640 1 -- 172.21.15.17:0/4139679281 shutdown_connections 2024-09-10T23:18:50.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.202+0000 7fc5c5400640 1 -- 172.21.15.17:0/4139679281 wait complete. 2024-09-10T23:18:50.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.202+0000 7fc5c5400640 1 Processor -- start 2024-09-10T23:18:50.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.202+0000 7fc5c5400640 1 -- start start 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5c5400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5c0070ad0 0x7fc5c00afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5c5400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5c00cf320 0x7fc5c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5c5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c00d1830 0x7fc5c006e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5c5400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c016a660 con 0x7fc5c00d1830 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5c5400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c016a4e0 con 0x7fc5c00cf320 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5c5400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c016a7e0 con 0x7fc5c0070ad0 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5bf200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c00d1830 0x7fc5c006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5be800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5c0070ad0 0x7fc5c00afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5bf200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c00d1830 0x7fc5c006e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49406/0 (socket says 172.21.15.17:49406) 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5bf200640 1 -- 172.21.15.17:0/1248534804 learned_addr learned my addr 172.21.15.17:0/1248534804 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5b7e00640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5c00cf320 0x7fc5c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5be800640 1 -- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5c00cf320 msgr2=0x7fc5c006dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5be800640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5c00cf320 0x7fc5c006dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5be800640 1 -- 172.21.15.17:0/1248534804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c00d1830 msgr2=0x7fc5c006e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5be800640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c00d1830 0x7fc5c006e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5be800640 1 -- 172.21.15.17:0/1248534804 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c00b7140 con 0x7fc5c0070ad0 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5bf200640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c00d1830 0x7fc5c006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5be800640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5c0070ad0 0x7fc5c00afd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00ac000 tx=0x7fc5b00a5790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5b6a00640 1 -- 172.21.15.17:0/1248534804 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00b2040 con 0x7fc5c0070ad0 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5b6a00640 1 -- 172.21.15.17:0/1248534804 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5b0004470 con 0x7fc5c0070ad0 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c00b7420 con 0x7fc5c0070ad0 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5b6a00640 1 -- 172.21.15.17:0/1248534804 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0003860 con 0x7fc5c0070ad0 2024-09-10T23:18:50.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c0151be0 con 0x7fc5c0070ad0 2024-09-10T23:18:50.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c015f060 con 0x7fc5c0070ad0 2024-09-10T23:18:50.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.206+0000 7fc5b6a00640 1 -- 172.21.15.17:0/1248534804 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc5b00b5070 con 0x7fc5c0070ad0 2024-09-10T23:18:50.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.210+0000 7fc5b6a00640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc59c0725e0 0x7fc59c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.210+0000 7fc5b6a00640 1 -- 172.21.15.17:0/1248534804 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fc5b012c3d0 con 0x7fc5c0070ad0 2024-09-10T23:18:50.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.210+0000 7fc5b7e00640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc59c0725e0 0x7fc59c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.210+0000 7fc5b7e00640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc59c0725e0 0x7fc59c074aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8007f30 tx=0x7fc5a8007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.214+0000 7fc5b6a00640 1 -- 172.21.15.17:0/1248534804 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc5b0016450 con 0x7fc5c0070ad0 2024-09-10T23:18:50.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.390+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc5c00b69d0 con 0x7fc5c0070ad0 2024-09-10T23:18:50.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.390+0000 7fc5b6a00640 1 -- 172.21.15.17:0/1248534804 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v29) ==== 59+0+1998 (secure 0 0 0) 0x7fc5b01002b0 con 0x7fc5c0070ad0 2024-09-10T23:18:50.395 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:18:50.395 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:18:50.395 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:18:50.395 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:18:50.395 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:18:50.396 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:18:50.397 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:18:50.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc59c0725e0 msgr2=0x7fc59c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc59c0725e0 0x7fc59c074aa0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8007f30 tx=0x7fc5a8007ec0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5c0070ad0 msgr2=0x7fc5c00afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5c0070ad0 0x7fc5c00afd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00ac000 tx=0x7fc5b00a5790 comp rx=0 tx=0).stop 2024-09-10T23:18:50.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 shutdown_connections 2024-09-10T23:18:50.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc59c0725e0 0x7fc59c074aa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5c00d1830 0x7fc5c006e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5c00cf320 0x7fc5c006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 --2- 172.21.15.17:0/1248534804 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc5c0070ad0 0x7fc5c00afd20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 >> 172.21.15.17:0/1248534804 conn(0x7fc5c00d1d60 msgr2=0x7fc5c00d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:50.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 shutdown_connections 2024-09-10T23:18:50.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.394+0000 7fc5c5400640 1 -- 172.21.15.17:0/1248534804 wait complete. 2024-09-10T23:18:50.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.562+0000 7fd8a4200640 1 -- 172.21.15.17:0/3977410551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 msgr2=0x7fd884004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.562+0000 7fd8a4200640 1 --2- 172.21.15.17:0/3977410551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 0x7fd884004040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd890009b60 tx=0x7fd89001d240 comp rx=0 tx=0).stop 2024-09-10T23:18:50.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.562+0000 7fd8a4200640 1 -- 172.21.15.17:0/3977410551 shutdown_connections 2024-09-10T23:18:50.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.562+0000 7fd8a4200640 1 --2- 172.21.15.17:0/3977410551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 0x7fd884004040 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.562+0000 7fd8a4200640 1 -- 172.21.15.17:0/3977410551 >> 172.21.15.17:0/3977410551 conn(0x7fd89c09a9f0 msgr2=0x7fd89c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:50.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.562+0000 7fd8a4200640 1 -- 172.21.15.17:0/3977410551 shutdown_connections 2024-09-10T23:18:50.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.562+0000 7fd8a4200640 1 -- 172.21.15.17:0/3977410551 wait complete. 2024-09-10T23:18:50.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 Processor -- start 2024-09-10T23:18:50.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 -- start start 2024-09-10T23:18:50.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 0x7fd89c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c1f7f70 0x7fd89c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0b4b70 0x7fd89c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c15d200 con 0x7fd884003c40 2024-09-10T23:18:50.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c15d080 con 0x7fd89c1f7f70 2024-09-10T23:18:50.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c0cfde0 con 0x7fd89c0b4b70 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 0x7fd89c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 0x7fd89c1585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49424/0 (socket says 172.21.15.17:49424) 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a1800640 1 -- 172.21.15.17:0/1194429987 learned_addr learned my addr 172.21.15.17:0/1194429987 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c1f7f70 0x7fd89c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a2200640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0b4b70 0x7fd89c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a1800640 1 -- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0b4b70 msgr2=0x7fd89c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a1800640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0b4b70 0x7fd89c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a1800640 1 -- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c1f7f70 msgr2=0x7fd89c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a1800640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c1f7f70 0x7fd89c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a1800640 1 -- 172.21.15.17:0/1194429987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c1f8f40 con 0x7fd884003c40 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a1800640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 0x7fd89c1585c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd8900af040 tx=0x7fd890005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd899600640 1 -- 172.21.15.17:0/1194429987 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8900bd070 con 0x7fd884003c40 2024-09-10T23:18:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd899600640 1 -- 172.21.15.17:0/1194429987 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd890004120 con 0x7fd884003c40 2024-09-10T23:18:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd899600640 1 -- 172.21.15.17:0/1194429987 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8900b1040 con 0x7fd884003c40 2024-09-10T23:18:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c0cc150 con 0x7fd884003c40 2024-09-10T23:18:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.566+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c1f86a0 con 0x7fd884003c40 2024-09-10T23:18:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.570+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89c0b1c50 con 0x7fd884003c40 2024-09-10T23:18:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.570+0000 7fd899600640 1 -- 172.21.15.17:0/1194429987 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd8900046d0 con 0x7fd884003c40 2024-09-10T23:18:50.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.570+0000 7fd899600640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd87c072610 0x7fd87c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:50.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.570+0000 7fd899600640 1 -- 172.21.15.17:0/1194429987 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fd89012d4c0 con 0x7fd884003c40 2024-09-10T23:18:50.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.570+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd87c072610 0x7fd87c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:50.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.570+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd87c072610 0x7fd87c074ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0c8d20 tx=0x7fd888006730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:50.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.574+0000 7fd899600640 1 -- 172.21.15.17:0/1194429987 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd890016f80 con 0x7fd884003c40 2024-09-10T23:18:50.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.750+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd89c071af0 con 0x7fd884003c40 2024-09-10T23:18:50.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd899600640 1 -- 172.21.15.17:0/1194429987 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fd890101410 con 0x7fd884003c40 2024-09-10T23:18:50.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd87c072610 msgr2=0x7fd87c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd87c072610 0x7fd87c074ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0c8d20 tx=0x7fd888006730 comp rx=0 tx=0).stop 2024-09-10T23:18:50.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 msgr2=0x7fd89c1585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:50.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 0x7fd89c1585c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd8900af040 tx=0x7fd890005520 comp rx=0 tx=0).stop 2024-09-10T23:18:50.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 shutdown_connections 2024-09-10T23:18:50.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd87c072610 0x7fd87c074ad0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0b4b70 0x7fd89c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c1f7f70 0x7fd89c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 --2- 172.21.15.17:0/1194429987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd884003c40 0x7fd89c1585c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:50.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 >> 172.21.15.17:0/1194429987 conn(0x7fd89c09a9f0 msgr2=0x7fd89c15e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:50.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 shutdown_connections 2024-09-10T23:18:50.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:50.754+0000 7fd8a4200640 1 -- 172.21.15.17:0/1194429987 wait complete. 2024-09-10T23:18:50.779 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:18:50.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:50.851 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:18:50.953 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:18:50.953 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:18:50.953 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:50.962 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:18:50.962 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:18:50.962 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:50.970 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:50.970 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:18:50.970 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:51.016 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:18:51.016 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:18:51.016 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:18:51.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:18:51.026 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:18:51.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:51.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.202+0000 7fbb5b600640 1 -- 172.21.15.17:0/3657895686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb54160280 msgr2=0x7fbb540cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:51.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.202+0000 7fbb5b600640 1 --2- 172.21.15.17:0/3657895686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb54160280 0x7fbb540cfaf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009870 tx=0x7fbb4801ef70 comp rx=0 tx=0).stop 2024-09-10T23:18:51.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.202+0000 7fbb5b600640 1 -- 172.21.15.17:0/3657895686 shutdown_connections 2024-09-10T23:18:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.202+0000 7fbb5b600640 1 --2- 172.21.15.17:0/3657895686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb54160280 0x7fbb540cfaf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.202+0000 7fbb5b600640 1 -- 172.21.15.17:0/3657895686 >> 172.21.15.17:0/3657895686 conn(0x7fbb540d1d10 msgr2=0x7fbb540d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.202+0000 7fbb5b600640 1 -- 172.21.15.17:0/3657895686 shutdown_connections 2024-09-10T23:18:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.202+0000 7fbb5b600640 1 -- 172.21.15.17:0/3657895686 wait complete. 2024-09-10T23:18:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.202+0000 7fbb5b600640 1 Processor -- start 2024-09-10T23:18:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.202+0000 7fbb5b600640 1 -- start start 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb5b600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb540d2830 0x7fbb540c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb5b600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb54160280 0x7fbb541f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb5b600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb54160660 0x7fbb541f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb5b600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb540d03c0 con 0x7fbb54160280 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb5b600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb540d0240 con 0x7fbb54160660 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb5b600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbb540b03c0 con 0x7fbb540d2830 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb54160280 0x7fbb541f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb54160280 0x7fbb541f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49438/0 (socket says 172.21.15.17:49438) 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb53e00640 1 -- 172.21.15.17:0/2805853016 learned_addr learned my addr 172.21.15.17:0/2805853016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb58c00640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb540d2830 0x7fbb540c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb59600640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb54160660 0x7fbb541f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb53e00640 1 -- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb540d2830 msgr2=0x7fbb540c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb53e00640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb540d2830 0x7fbb540c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb53e00640 1 -- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb54160660 msgr2=0x7fbb541f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb53e00640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb54160660 0x7fbb541f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb53e00640 1 -- 172.21.15.17:0/2805853016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb540aef50 con 0x7fbb54160280 2024-09-10T23:18:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb53e00640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb54160280 0x7fbb541f3fd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000c650 tx=0x7fbb4000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb50c00640 1 -- 172.21.15.17:0/2805853016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40016020 con 0x7fbb54160280 2024-09-10T23:18:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb50c00640 1 -- 172.21.15.17:0/2805853016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb4000a840 con 0x7fbb54160280 2024-09-10T23:18:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb541f5510 con 0x7fbb54160280 2024-09-10T23:18:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb50c00640 1 -- 172.21.15.17:0/2805853016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4000ac90 con 0x7fbb54160280 2024-09-10T23:18:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb540c8f60 con 0x7fbb54160280 2024-09-10T23:18:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.206+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb540cfaf0 con 0x7fbb54160280 2024-09-10T23:18:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.210+0000 7fbb50c00640 1 -- 172.21.15.17:0/2805853016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbb4001b400 con 0x7fbb54160280 2024-09-10T23:18:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.210+0000 7fbb50c00640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb340725e0 0x7fbb34074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.210+0000 7fbb50c00640 1 -- 172.21.15.17:0/2805853016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fbb400934c0 con 0x7fbb54160280 2024-09-10T23:18:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.210+0000 7fbb58c00640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb340725e0 0x7fbb34074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:51.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.210+0000 7fbb58c00640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb340725e0 0x7fbb34074aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbb480b2000 tx=0x7fbb4801d7b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:51.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.214+0000 7fbb50c00640 1 -- 172.21.15.17:0/2805853016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbb40020020 con 0x7fbb54160280 2024-09-10T23:18:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb54074af0 con 0x7fbb54160280 2024-09-10T23:18:51.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb50c00640 1 -- 172.21.15.17:0/2805853016 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+3908 (secure 0 0 0) 0x7fbb541f5510 con 0x7fbb54160280 2024-09-10T23:18:51.426 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"btime":"2024-09-10T23:18:45:000422+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4945,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1906911663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1906911663},{"type":"v1","addr":"172.21.15.77:6835","nonce":1906911663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4954,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/650482314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":650482314},{"type":"v1","addr":"172.21.15.77:6837","nonce":650482314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":5013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1923332906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1923332906},{"type":"v1","addr":"172.21.15.17:6834","nonce":1923332906}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5394,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2923887174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2923887174},{"type":"v1","addr":"172.21.15.17:6835","nonce":2923887174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[]} 2024-09-10T23:18:51.426 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb340725e0 msgr2=0x7fbb34074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb340725e0 0x7fbb34074aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbb480b2000 tx=0x7fbb4801d7b0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb54160280 msgr2=0x7fbb541f3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb54160280 0x7fbb541f3fd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000c650 tx=0x7fbb4000cb10 comp rx=0 tx=0).stop 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 shutdown_connections 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb340725e0 0x7fbb34074aa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb54160660 0x7fbb541f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb54160280 0x7fbb541f3fd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 --2- 172.21.15.17:0/2805853016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb540d2830 0x7fbb540c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 >> 172.21.15.17:0/2805853016 conn(0x7fbb540d1d10 msgr2=0x7fbb540af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:51.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 shutdown_connections 2024-09-10T23:18:51.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.422+0000 7fbb5b600640 1 -- 172.21.15.17:0/2805853016 wait complete. 2024-09-10T23:18:51.448 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:18:51.448 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:18:51.448 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:18:51.448 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:51.448 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:18:51.448 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:18:51.449 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:18:51.449 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:51.449 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:18:51.449 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:18:51.449 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:18:51.449 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:51.449 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:18:51.449 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:18:51.450 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:18:51.450 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:18:51.459 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:18:51.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:18:51.462 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:18:51.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:18:51.462 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:18:51.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:18:51.463 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:18:51.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:18:51.506 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:18:51.507 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:51.508 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:18:51.509 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:51.509 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:18:51.509 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:51.511 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:18:51.511 DEBUG:teuthology.parallel:result is None 2024-09-10T23:18:51.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:18:51.592 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:18:51.593 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:18:51.593 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:18:51.594 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:18:51.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.658+0000 7f7448200640 1 -- 172.21.15.17:0/2872774022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 msgr2=0x7f74400cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:51.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.658+0000 7f7448200640 1 --2- 172.21.15.17:0/2872774022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 0x7f74400cfe70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7434009840 tx=0x7f743401c820 comp rx=0 tx=0).stop 2024-09-10T23:18:51.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.658+0000 7f7448200640 1 -- 172.21.15.17:0/2872774022 shutdown_connections 2024-09-10T23:18:51.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.658+0000 7f7448200640 1 --2- 172.21.15.17:0/2872774022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 0x7f74400cfe70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.658+0000 7f7448200640 1 -- 172.21.15.17:0/2872774022 >> 172.21.15.17:0/2872774022 conn(0x7f74400d1d60 msgr2=0x7f74400d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:51.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.658+0000 7f7448200640 1 -- 172.21.15.17:0/2872774022 shutdown_connections 2024-09-10T23:18:51.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.658+0000 7f7448200640 1 -- 172.21.15.17:0/2872774022 wait complete. 2024-09-10T23:18:51.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 Processor -- start 2024-09-10T23:18:51.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 -- start start 2024-09-10T23:18:51.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74400af8d0 0x7f7440155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:51.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400b3360 0x7f744015ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:51.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 0x7f74400ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7440169e20 con 0x7f744015be40 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7440169ca0 con 0x7f74400b3360 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7440169fa0 con 0x7f74400af8d0 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7446200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 0x7f74400ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7446200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 0x7f74400ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49484/0 (socket says 172.21.15.17:49484) 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7446200640 1 -- 172.21.15.17:0/472479711 learned_addr learned my addr 172.21.15.17:0/472479711 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7445800640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74400af8d0 0x7f7440155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7444e00640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400b3360 0x7f744015ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7446200640 1 -- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74400af8d0 msgr2=0x7f7440155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7446200640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74400af8d0 0x7f7440155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7446200640 1 -- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400b3360 msgr2=0x7f744015ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:51.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7446200640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400b3360 0x7f744015ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:51.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7446200640 1 -- 172.21.15.17:0/472479711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744015d9a0 con 0x7f744015be40 2024-09-10T23:18:51.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7446200640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 0x7f74400ca890 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f743800c780 tx=0x7f743800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:51.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f743d600640 1 -- 172.21.15.17:0/472479711 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7438004b70 con 0x7f744015be40 2024-09-10T23:18:51.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f743d600640 1 -- 172.21.15.17:0/472479711 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7438004e00 con 0x7f744015be40 2024-09-10T23:18:51.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744015dc80 con 0x7f744015be40 2024-09-10T23:18:51.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f743d600640 1 -- 172.21.15.17:0/472479711 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743800aa90 con 0x7f744015be40 2024-09-10T23:18:51.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744015e240 con 0x7f744015be40 2024-09-10T23:18:51.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.662+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74400afce0 con 0x7f744015be40 2024-09-10T23:18:51.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.666+0000 7f743d600640 1 -- 172.21.15.17:0/472479711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f743800ac30 con 0x7f744015be40 2024-09-10T23:18:51.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.666+0000 7f743d600640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74200725e0 0x7f7420074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:51.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.666+0000 7f743d600640 1 -- 172.21.15.17:0/472479711 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f7438093350 con 0x7f744015be40 2024-09-10T23:18:51.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.666+0000 7f7445800640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74200725e0 0x7f7420074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:51.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.666+0000 7f7445800640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74200725e0 0x7f7420074aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74340af000 tx=0x7f743401b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:51.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.670+0000 7f743d600640 1 -- 172.21.15.17:0/472479711 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7438020070 con 0x7f744015be40 2024-09-10T23:18:51.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:51.854+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f744015b550 con 0x7f744015be40 2024-09-10T23:18:52.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f743d600640 1 -- 172.21.15.17:0/472479711 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7f743805e4b0 con 0x7f744015be40 2024-09-10T23:18:52.038 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:18:52.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74200725e0 msgr2=0x7f7420074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74200725e0 0x7f7420074aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74340af000 tx=0x7f743401b060 comp rx=0 tx=0).stop 2024-09-10T23:18:52.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 msgr2=0x7f74400ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 0x7f74400ca890 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f743800c780 tx=0x7f743800cc40 comp rx=0 tx=0).stop 2024-09-10T23:18:52.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 shutdown_connections 2024-09-10T23:18:52.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74200725e0 0x7f7420074aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f744015be40 0x7f74400ca890 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74400b3360 0x7f744015ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 --2- 172.21.15.17:0/472479711 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74400af8d0 0x7f7440155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 >> 172.21.15.17:0/472479711 conn(0x7f74400d1d60 msgr2=0x7f74401591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.034+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 shutdown_connections 2024-09-10T23:18:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.038+0000 7f7448200640 1 -- 172.21.15.17:0/472479711 wait complete. 2024-09-10T23:18:52.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:18:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 -- 172.21.15.17:0/3571436049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160280 msgr2=0x7f19840cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 --2- 172.21.15.17:0/3571436049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160280 0x7f19840cfaf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1974009840 tx=0x7f197401f010 comp rx=0 tx=0).stop 2024-09-10T23:18:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 -- 172.21.15.17:0/3571436049 shutdown_connections 2024-09-10T23:18:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 --2- 172.21.15.17:0/3571436049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160280 0x7f19840cfaf0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 -- 172.21.15.17:0/3571436049 >> 172.21.15.17:0/3571436049 conn(0x7f19840d1d10 msgr2=0x7f19840d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 -- 172.21.15.17:0/3571436049 shutdown_connections 2024-09-10T23:18:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 -- 172.21.15.17:0/3571436049 wait complete. 2024-09-10T23:18:52.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 Processor -- start 2024-09-10T23:18:52.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 -- start start 2024-09-10T23:18:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19840d2830 0x7f19841f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1984160280 0x7f19840cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160660 0x7f19840c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f19840d01b0 con 0x7f1984160660 2024-09-10T23:18:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f19840d0030 con 0x7f1984160280 2024-09-10T23:18:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1989a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f19840d0330 con 0x7f19840d2830 2024-09-10T23:18:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1983400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160660 0x7f19840c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f197be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1984160280 0x7f19840cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1983400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160660 0x7f19840c4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49514/0 (socket says 172.21.15.17:49514) 2024-09-10T23:18:52.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1983400640 1 -- 172.21.15.17:0/3640522243 learned_addr learned my addr 172.21.15.17:0/3640522243 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:52.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.206+0000 7f1982a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19840d2830 0x7f19841f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197be00640 1 -- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19840d2830 msgr2=0x7f19841f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197be00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19840d2830 0x7f19841f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197be00640 1 -- 172.21.15.17:0/3640522243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160660 msgr2=0x7f19840c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197be00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160660 0x7f19840c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197be00640 1 -- 172.21.15.17:0/3640522243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19840c6850 con 0x7f1984160280 2024-09-10T23:18:52.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f1983400640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160660 0x7f19840c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:52.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f1982a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19840d2830 0x7f19841f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:52.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197be00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1984160280 0x7f19840cee10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f196c00c410 tx=0x7f196c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197aa00640 1 -- 172.21.15.17:0/3640522243 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c017070 con 0x7f1984160280 2024-09-10T23:18:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197aa00640 1 -- 172.21.15.17:0/3640522243 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f196c006ad0 con 0x7f1984160280 2024-09-10T23:18:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19840c6b30 con 0x7f1984160280 2024-09-10T23:18:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197aa00640 1 -- 172.21.15.17:0/3640522243 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c007030 con 0x7f1984160280 2024-09-10T23:18:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19840c70f0 con 0x7f1984160280 2024-09-10T23:18:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19840b05c0 con 0x7f1984160280 2024-09-10T23:18:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.210+0000 7f197aa00640 1 -- 172.21.15.17:0/3640522243 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f196c0071d0 con 0x7f1984160280 2024-09-10T23:18:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.214+0000 7f197aa00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1960072610 0x7f1960074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.214+0000 7f197aa00640 1 -- 172.21.15.17:0/3640522243 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5249+0+0 (secure 0 0 0) 0x7f196c0926e0 con 0x7f1984160280 2024-09-10T23:18:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.214+0000 7f1982a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1960072610 0x7f1960074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.214+0000 7f1982a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1960072610 0x7f1960074ad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f19740b2000 tx=0x7f197401d850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:52.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.218+0000 7f197aa00640 1 -- 172.21.15.17:0/3640522243 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f196c05d890 con 0x7f1984160280 2024-09-10T23:18:52.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.450+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f1984070bb0 con 0x7f1984160280 2024-09-10T23:18:52.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.450+0000 7f197aa00640 1 -- 172.21.15.17:0/3640522243 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f196c0622c0 con 0x7f1984160280 2024-09-10T23:18:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:52.456 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:18:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:18:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:18:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:18:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:18:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:18:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:18:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:18:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:18:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:18:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:18:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:18:52.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1960072610 msgr2=0x7f1960074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1960072610 0x7f1960074ad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f19740b2000 tx=0x7f197401d850 comp rx=0 tx=0).stop 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1984160280 msgr2=0x7f19840cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1984160280 0x7f19840cee10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f196c00c410 tx=0x7f196c00c8d0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 shutdown_connections 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1960072610 0x7f1960074ad0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1984160660 0x7f19840c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1984160280 0x7f19840cee10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 --2- 172.21.15.17:0/3640522243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f19840d2830 0x7f19841f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 >> 172.21.15.17:0/3640522243 conn(0x7f19840d1d10 msgr2=0x7f19840b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 shutdown_connections 2024-09-10T23:18:52.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.454+0000 7f1989a00640 1 -- 172.21.15.17:0/3640522243 wait complete. 2024-09-10T23:18:52.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:18:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.617+0000 7f717b000640 1 -- 172.21.15.17:0/2149255596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f717415f770 msgr2=0x7f71740cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.617+0000 7f717b000640 1 --2- 172.21.15.17:0/2149255596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f717415f770 0x7f71740cc870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f715c009840 tx=0x7f715c01c820 comp rx=0 tx=0).stop 2024-09-10T23:18:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.617+0000 7f717b000640 1 -- 172.21.15.17:0/2149255596 shutdown_connections 2024-09-10T23:18:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.617+0000 7f717b000640 1 --2- 172.21.15.17:0/2149255596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f717415f770 0x7f71740cc870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.617+0000 7f717b000640 1 -- 172.21.15.17:0/2149255596 >> 172.21.15.17:0/2149255596 conn(0x7f71740d1d60 msgr2=0x7f71740d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.617+0000 7f717b000640 1 -- 172.21.15.17:0/2149255596 shutdown_connections 2024-09-10T23:18:52.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.617+0000 7f717b000640 1 -- 172.21.15.17:0/2149255596 wait complete. 2024-09-10T23:18:52.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 Processor -- start 2024-09-10T23:18:52.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 -- start start 2024-09-10T23:18:52.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7174070ad0 0x7f71740b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71740d1830 0x7f71740b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f717415f770 0x7f71740b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f717416a520 con 0x7f71740d1830 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f717416a3a0 con 0x7f7174070ad0 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f717416a6a0 con 0x7f717415f770 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f716b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71740d1830 0x7f71740b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f716b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71740d1830 0x7f71740b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49518/0 (socket says 172.21.15.17:49518) 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f716b400640 1 -- 172.21.15.17:0/1730487240 learned_addr learned my addr 172.21.15.17:0/1730487240 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f7173e00640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7174070ad0 0x7f71740b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f7179000640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f717415f770 0x7f71740b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f716b400640 1 -- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f717415f770 msgr2=0x7f71740b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f716b400640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f717415f770 0x7f71740b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f716b400640 1 -- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7174070ad0 msgr2=0x7f71740b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f716b400640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7174070ad0 0x7f71740b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f716b400640 1 -- 172.21.15.17:0/1730487240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71740b52c0 con 0x7f71740d1830 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f7179000640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f717415f770 0x7f71740b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f716b400640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71740d1830 0x7f71740b4b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f715c019430 tx=0x7f715c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f7170c00640 1 -- 172.21.15.17:0/1730487240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c0b2040 con 0x7f71740d1830 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f7170c00640 1 -- 172.21.15.17:0/1730487240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f715c0043f0 con 0x7f71740d1830 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71740b55a0 con 0x7f71740d1830 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f7170c00640 1 -- 172.21.15.17:0/1730487240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c003820 con 0x7f71740d1830 2024-09-10T23:18:52.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.621+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71740b5b60 con 0x7f71740d1830 2024-09-10T23:18:52.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.625+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717415f060 con 0x7f71740d1830 2024-09-10T23:18:52.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.625+0000 7f7170c00640 1 -- 172.21.15.17:0/1730487240 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f715c0b5070 con 0x7f71740d1830 2024-09-10T23:18:52.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.625+0000 7f7170c00640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71500725e0 0x7f7150074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.625+0000 7f7170c00640 1 -- 172.21.15.17:0/1730487240 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5249+0+0 (secure 0 0 0) 0x7f715c12c430 con 0x7f71740d1830 2024-09-10T23:18:52.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.625+0000 7f7173e00640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71500725e0 0x7f7150074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.625+0000 7f7173e00640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71500725e0 0x7f7150074aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f70 tx=0x7f7164009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:52.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.629+0000 7f7170c00640 1 -- 172.21.15.17:0/1730487240 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f715c016410 con 0x7f71740d1830 2024-09-10T23:18:52.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.805+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7174159530 con 0x7f71740d1830 2024-09-10T23:18:52.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.805+0000 7f7170c00640 1 -- 172.21.15.17:0/1730487240 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7f715c0f7cc0 con 0x7f71740d1830 2024-09-10T23:18:52.811 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:18:52.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:18:52.811 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:18:52.811 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:18:52.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:18:52.812 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71500725e0 msgr2=0x7f7150074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71500725e0 0x7f7150074aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f70 tx=0x7f7164009040 comp rx=0 tx=0).stop 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71740d1830 msgr2=0x7f71740b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71740d1830 0x7f71740b4b90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f715c019430 tx=0x7f715c005dd0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 shutdown_connections 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71500725e0 0x7f7150074aa0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f717415f770 0x7f71740b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71740d1830 0x7f71740b4b90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 --2- 172.21.15.17:0/1730487240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7174070ad0 0x7f71740b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 >> 172.21.15.17:0/1730487240 conn(0x7f71740d1d60 msgr2=0x7f71740afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:52.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 shutdown_connections 2024-09-10T23:18:52.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.809+0000 7f717b000640 1 -- 172.21.15.17:0/1730487240 wait complete. 2024-09-10T23:18:52.833 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:18:52.833 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:18:52.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.977+0000 7fc12ce00640 1 -- 172.21.15.17:0/723640200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 msgr2=0x7fc128071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.977+0000 7fc12ce00640 1 --2- 172.21.15.17:0/723640200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 0x7fc128071060 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc1280d1c50 tx=0x7fc12001cb80 comp rx=0 tx=0).stop 2024-09-10T23:18:52.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.977+0000 7fc12ce00640 1 -- 172.21.15.17:0/723640200 shutdown_connections 2024-09-10T23:18:52.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.977+0000 7fc12ce00640 1 --2- 172.21.15.17:0/723640200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 0x7fc128071060 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.977+0000 7fc12ce00640 1 --2- 172.21.15.17:0/723640200 >> v2:172.21.15.77:3300/0 conn(0x7fc1280d23e0 0x7fc1280cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.977+0000 7fc12ce00640 1 -- 172.21.15.17:0/723640200 >> 172.21.15.17:0/723640200 conn(0x7fc12809a9f0 msgr2=0x7fc12809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:52.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.977+0000 7fc12ce00640 1 -- 172.21.15.17:0/723640200 shutdown_connections 2024-09-10T23:18:52.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.977+0000 7fc12ce00640 1 -- 172.21.15.17:0/723640200 wait complete. 2024-09-10T23:18:52.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 Processor -- start 2024-09-10T23:18:52.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 -- start start 2024-09-10T23:18:52.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 0x7fc128154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1280d23e0 0x7fc12815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12815f210 0x7fc12815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc128168a70 con 0x7fc1280d0320 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1281688f0 con 0x7fc12815f210 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc128168bf0 con 0x7fc1280d23e0 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc125e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 0x7fc128154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc125e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 0x7fc128154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49548/0 (socket says 172.21.15.17:49548) 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc125e00640 1 -- 172.21.15.17:0/2448557542 learned_addr learned my addr 172.21.15.17:0/2448557542 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc126800640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12815f210 0x7fc12815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc11fe00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1280d23e0 0x7fc12815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc125e00640 1 -- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1280d23e0 msgr2=0x7fc12815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc125e00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1280d23e0 0x7fc12815dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc125e00640 1 -- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12815f210 msgr2=0x7fc12815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc125e00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12815f210 0x7fc12815e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc125e00640 1 -- 172.21.15.17:0/2448557542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1280b3950 con 0x7fc1280d0320 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc126800640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12815f210 0x7fc12815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc125e00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 0x7fc128154ff0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc118001ec0 tx=0x7fc11800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc11e000640 1 -- 172.21.15.17:0/2448557542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118017070 con 0x7fc1280d0320 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc11e000640 1 -- 172.21.15.17:0/2448557542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc118003600 con 0x7fc1280d0320 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc11e000640 1 -- 172.21.15.17:0/2448557542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118003a50 con 0x7fc1280d0320 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1280b3c30 con 0x7fc1280d0320 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.981+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1280b4c10 con 0x7fc1280d0320 2024-09-10T23:18:52.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.985+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc128071060 con 0x7fc1280d0320 2024-09-10T23:18:52.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.985+0000 7fc11e000640 1 -- 172.21.15.17:0/2448557542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc118003bf0 con 0x7fc1280d0320 2024-09-10T23:18:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.985+0000 7fc11e000640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc104072610 0x7fc104074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.985+0000 7fc11e000640 1 -- 172.21.15.17:0/2448557542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5249+0+0 (secure 0 0 0) 0x7fc1180925a0 con 0x7fc1280d0320 2024-09-10T23:18:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.985+0000 7fc11fe00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc104072610 0x7fc104074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:52.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.989+0000 7fc11fe00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc104072610 0x7fc104074ad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc12806e8b0 tx=0x7fc1100091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:52.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:52.989+0000 7fc11e000640 1 -- 172.21.15.17:0/2448557542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc11805d7e0 con 0x7fc1280d0320 2024-09-10T23:18:53.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:53.173+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc1280d2c00 con 0x7fc1280d0320 2024-09-10T23:18:54.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.049+0000 7fc11e000640 1 -- 172.21.15.17:0/2448557542 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7fc118062210 con 0x7fc1280d0320 2024-09-10T23:18:54.170 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:18:54.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc104072610 msgr2=0x7fc104074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:54.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc104072610 0x7fc104074ad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc12806e8b0 tx=0x7fc1100091e0 comp rx=0 tx=0).stop 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 msgr2=0x7fc128154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 0x7fc128154ff0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc118001ec0 tx=0x7fc11800c890 comp rx=0 tx=0).stop 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 shutdown_connections 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc104072610 0x7fc104074ad0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12815f210 0x7fc12815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1280d23e0 0x7fc12815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 --2- 172.21.15.17:0/2448557542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1280d0320 0x7fc128154ff0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 >> 172.21.15.17:0/2448557542 conn(0x7fc12809a9f0 msgr2=0x7fc1280d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 shutdown_connections 2024-09-10T23:18:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.053+0000 7fc12ce00640 1 -- 172.21.15.17:0/2448557542 wait complete. 2024-09-10T23:18:54.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:18:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.325+0000 7fbe2c200640 1 -- 172.21.15.17:0/1093720299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe240b31b0 msgr2=0x7fbe240d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.325+0000 7fbe2c200640 1 --2- 172.21.15.17:0/1093720299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe240b31b0 0x7fbe240d03b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009bf0 tx=0x7fbe1c01cbe0 comp rx=0 tx=0).stop 2024-09-10T23:18:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.325+0000 7fbe2c200640 1 -- 172.21.15.17:0/1093720299 shutdown_connections 2024-09-10T23:18:54.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.325+0000 7fbe2c200640 1 --2- 172.21.15.17:0/1093720299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe240b31b0 0x7fbe240d03b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.325+0000 7fbe2c200640 1 -- 172.21.15.17:0/1093720299 >> 172.21.15.17:0/1093720299 conn(0x7fbe240d1da0 msgr2=0x7fbe240d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.325+0000 7fbe2c200640 1 -- 172.21.15.17:0/1093720299 shutdown_connections 2024-09-10T23:18:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.325+0000 7fbe2c200640 1 -- 172.21.15.17:0/1093720299 wait complete. 2024-09-10T23:18:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 Processor -- start 2024-09-10T23:18:54.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 -- start start 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240b2540 0x7fbe2415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe240b31b0 0x7fbe240afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe2415f400 0x7fbe240b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2416a000 con 0x7fbe240b2540 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24169e80 con 0x7fbe2415f400 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2416a180 con 0x7fbe240b31b0 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe29800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240b2540 0x7fbe2415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe29800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240b2540 0x7fbe2415c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49556/0 (socket says 172.21.15.17:49556) 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe29800640 1 -- 172.21.15.17:0/202451649 learned_addr learned my addr 172.21.15.17:0/202451649 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe28e00640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe240b31b0 0x7fbe240afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:54.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2a200640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe2415f400 0x7fbe240b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe29800640 1 -- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe240b31b0 msgr2=0x7fbe240afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe29800640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe240b31b0 0x7fbe240afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe29800640 1 -- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe2415f400 msgr2=0x7fbe240b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe29800640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe2415f400 0x7fbe240b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe29800640 1 -- 172.21.15.17:0/202451649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe241f9a40 con 0x7fbe240b2540 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe29800640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240b2540 0x7fbe2415c230 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c390 tx=0x7fbe1800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe21600640 1 -- 172.21.15.17:0/202451649 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18011790 con 0x7fbe240b2540 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe21600640 1 -- 172.21.15.17:0/202451649 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe18017070 con 0x7fbe240b2540 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe21600640 1 -- 172.21.15.17:0/202451649 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18011ca0 con 0x7fbe240b2540 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2415df10 con 0x7fbe240b2540 2024-09-10T23:18:54.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.329+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2415db70 con 0x7fbe240b2540 2024-09-10T23:18:54.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.333+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe240cc8b0 con 0x7fbe240b2540 2024-09-10T23:18:54.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.333+0000 7fbe21600640 1 -- 172.21.15.17:0/202451649 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbe1801c460 con 0x7fbe240b2540 2024-09-10T23:18:54.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.333+0000 7fbe21600640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe040725e0 0x7fbe04074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:54.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.333+0000 7fbe21600640 1 -- 172.21.15.17:0/202451649 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5619+0+0 (secure 0 0 0) 0x7fbe18093910 con 0x7fbe240b2540 2024-09-10T23:18:54.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.333+0000 7fbe28e00640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe040725e0 0x7fbe04074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:54.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.337+0000 7fbe28e00640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe040725e0 0x7fbe04074aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbe10000c10 tx=0x7fbe10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.337+0000 7fbe21600640 1 -- 172.21.15.17:0/202451649 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbe1805e9d0 con 0x7fbe240b2540 2024-09-10T23:18:54.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:54.513+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbe24069580 con 0x7fbe240b2540 2024-09-10T23:18:55.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.057+0000 7fbe21600640 1 -- 172.21.15.17:0/202451649 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7fbe18063400 con 0x7fbe240b2540 2024-09-10T23:18:55.062 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:18:55.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe040725e0 msgr2=0x7fbe04074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe040725e0 0x7fbe04074aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbe10000c10 tx=0x7fbe10009040 comp rx=0 tx=0).stop 2024-09-10T23:18:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240b2540 msgr2=0x7fbe2415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240b2540 0x7fbe2415c230 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c390 tx=0x7fbe1800c850 comp rx=0 tx=0).stop 2024-09-10T23:18:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 shutdown_connections 2024-09-10T23:18:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe040725e0 0x7fbe04074aa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe2415f400 0x7fbe240b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe240b31b0 0x7fbe240afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 --2- 172.21.15.17:0/202451649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe240b2540 0x7fbe2415c230 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 >> 172.21.15.17:0/202451649 conn(0x7fbe240d1da0 msgr2=0x7fbe240b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 shutdown_connections 2024-09-10T23:18:55.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.061+0000 7fbe2c200640 1 -- 172.21.15.17:0/202451649 wait complete. 2024-09-10T23:18:55.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:18:55.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.253+0000 7f4474200640 1 -- 172.21.15.17:0/4242241816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c0d04f0 msgr2=0x7f446c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.253+0000 7f4474200640 1 --2- 172.21.15.17:0/4242241816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c0d04f0 0x7f446c15c680 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4464009bc0 tx=0x7f446401c9c0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.253+0000 7f4474200640 1 -- 172.21.15.17:0/4242241816 shutdown_connections 2024-09-10T23:18:55.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.253+0000 7f4474200640 1 --2- 172.21.15.17:0/4242241816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c0d04f0 0x7f446c15c680 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.253+0000 7f4474200640 1 -- 172.21.15.17:0/4242241816 >> 172.21.15.17:0/4242241816 conn(0x7f446c09a9f0 msgr2=0x7f446c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.253+0000 7f4474200640 1 -- 172.21.15.17:0/4242241816 shutdown_connections 2024-09-10T23:18:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.253+0000 7f4474200640 1 -- 172.21.15.17:0/4242241816 wait complete. 2024-09-10T23:18:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 Processor -- start 2024-09-10T23:18:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 -- start start 2024-09-10T23:18:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f446c0d04f0 0x7f446c14a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c15be00 0x7f446c0ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f446c15d4f0 0x7f446c0cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f446c169e50 con 0x7f446c15be00 2024-09-10T23:18:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f446c169cd0 con 0x7f446c0d04f0 2024-09-10T23:18:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f446c169fd0 con 0x7f446c15d4f0 2024-09-10T23:18:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4470e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c15be00 0x7f446c0ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4470e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c15be00 0x7f446c0ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49580/0 (socket says 172.21.15.17:49580) 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4470e00640 1 -- 172.21.15.17:0/350212257 learned_addr learned my addr 172.21.15.17:0/350212257 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4472200640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f446c15d4f0 0x7f446c0cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4471800640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f446c0d04f0 0x7f446c14a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4470e00640 1 -- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f446c15d4f0 msgr2=0x7f446c0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4470e00640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f446c15d4f0 0x7f446c0cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4470e00640 1 -- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f446c0d04f0 msgr2=0x7f446c14a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4470e00640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f446c0d04f0 0x7f446c14a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4470e00640 1 -- 172.21.15.17:0/350212257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c0cef80 con 0x7f446c15be00 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4470e00640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c15be00 0x7f446c0ce710 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f445800b440 tx=0x7f445800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4469600640 1 -- 172.21.15.17:0/350212257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458015020 con 0x7f446c15be00 2024-09-10T23:18:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4469600640 1 -- 172.21.15.17:0/350212257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4458011980 con 0x7f446c15be00 2024-09-10T23:18:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4469600640 1 -- 172.21.15.17:0/350212257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458011dd0 con 0x7f446c15be00 2024-09-10T23:18:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c0cf260 con 0x7f446c15be00 2024-09-10T23:18:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c0c8e90 con 0x7f446c15be00 2024-09-10T23:18:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.257+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446c15c680 con 0x7f446c15be00 2024-09-10T23:18:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.261+0000 7f4469600640 1 -- 172.21.15.17:0/350212257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4458004020 con 0x7f446c15be00 2024-09-10T23:18:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.261+0000 7f4469600640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f444c0725e0 0x7f444c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.261+0000 7f4469600640 1 -- 172.21.15.17:0/350212257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6001+0+0 (secure 0 0 0) 0x7f4458093a70 con 0x7f446c15be00 2024-09-10T23:18:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.261+0000 7f4471800640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f444c0725e0 0x7f444c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.261+0000 7f4471800640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f444c0725e0 0x7f444c074aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4460000f70 tx=0x7f4460009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:55.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.265+0000 7f4469600640 1 -- 172.21.15.17:0/350212257 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f445801f030 con 0x7f446c15be00 2024-09-10T23:18:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:55.485+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f446c0cfed0 con 0x7f446c15be00 2024-09-10T23:18:56.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.069+0000 7f4469600640 1 -- 172.21.15.17:0/350212257 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v25) ==== 172+0+0 (secure 0 0 0) 0x7f445800d040 con 0x7f446c15be00 2024-09-10T23:18:56.081 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 7 and data pool 8 2024-09-10T23:18:56.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.089+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f444c0725e0 msgr2=0x7f444c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.089+0000 7f4474200640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f444c0725e0 0x7f444c074aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4460000f70 tx=0x7f4460009040 comp rx=0 tx=0).stop 2024-09-10T23:18:56.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.089+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c15be00 msgr2=0x7f446c0ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.089+0000 7f4474200640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c15be00 0x7f446c0ce710 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f445800b440 tx=0x7f445800b900 comp rx=0 tx=0).stop 2024-09-10T23:18:56.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.097+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 shutdown_connections 2024-09-10T23:18:56.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.097+0000 7f4474200640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f444c0725e0 0x7f444c074aa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.097+0000 7f4474200640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f446c15d4f0 0x7f446c0cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.097+0000 7f4474200640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f446c15be00 0x7f446c0ce710 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.097+0000 7f4474200640 1 --2- 172.21.15.17:0/350212257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f446c0d04f0 0x7f446c14a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.097+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 >> 172.21.15.17:0/350212257 conn(0x7f446c09a9f0 msgr2=0x7f446c1545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.097+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 shutdown_connections 2024-09-10T23:18:56.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.097+0000 7f4474200640 1 -- 172.21.15.17:0/350212257 wait complete. 2024-09-10T23:18:56.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.269+0000 7efd84000640 1 -- 172.21.15.17:0/3587468764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 msgr2=0x7efd7c0cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.269+0000 7efd84000640 1 --2- 172.21.15.17:0/3587468764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 0x7efd7c0cfaf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efd70009840 tx=0x7efd7001f010 comp rx=0 tx=0).stop 2024-09-10T23:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.269+0000 7efd84000640 1 -- 172.21.15.17:0/3587468764 shutdown_connections 2024-09-10T23:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.269+0000 7efd84000640 1 --2- 172.21.15.17:0/3587468764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd7c160660 0x7efd7c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.269+0000 7efd84000640 1 --2- 172.21.15.17:0/3587468764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 0x7efd7c0cfaf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.269+0000 7efd84000640 1 -- 172.21.15.17:0/3587468764 >> 172.21.15.17:0/3587468764 conn(0x7efd7c0d1d10 msgr2=0x7efd7c0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.269+0000 7efd84000640 1 -- 172.21.15.17:0/3587468764 shutdown_connections 2024-09-10T23:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.269+0000 7efd84000640 1 -- 172.21.15.17:0/3587468764 wait complete. 2024-09-10T23:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 Processor -- start 2024-09-10T23:18:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 -- start start 2024-09-10T23:18:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd7c0d2830 0x7efd7c0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 0x7efd7c0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c160660 0x7efd7c158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c0afe30 con 0x7efd7c160280 2024-09-10T23:18:56.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c0afcb0 con 0x7efd7c160660 2024-09-10T23:18:56.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c0affb0 con 0x7efd7c0d2830 2024-09-10T23:18:56.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd80c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 0x7efd7c0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd80c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 0x7efd7c0ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49598/0 (socket says 172.21.15.17:49598) 2024-09-10T23:18:56.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd80c00640 1 -- 172.21.15.17:0/471531044 learned_addr learned my addr 172.21.15.17:0/471531044 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:56.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd81600640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd7c0d2830 0x7efd7c0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd82000640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c160660 0x7efd7c158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd80c00640 1 -- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd7c0d2830 msgr2=0x7efd7c0c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd80c00640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd7c0d2830 0x7efd7c0c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd80c00640 1 -- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c160660 msgr2=0x7efd7c158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd80c00640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c160660 0x7efd7c158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd80c00640 1 -- 172.21.15.17:0/471531044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c0ceae0 con 0x7efd7c160280 2024-09-10T23:18:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd81600640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd7c0d2830 0x7efd7c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd82000640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c160660 0x7efd7c158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:18:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd80c00640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 0x7efd7c0ce2b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c4c0 tx=0x7efd6800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd79600640 1 -- 172.21.15.17:0/471531044 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68016020 con 0x7efd7c160280 2024-09-10T23:18:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd79600640 1 -- 172.21.15.17:0/471531044 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd68012940 con 0x7efd7c160280 2024-09-10T23:18:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd79600640 1 -- 172.21.15.17:0/471531044 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68012d90 con 0x7efd7c160280 2024-09-10T23:18:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7c0cedc0 con 0x7efd7c160280 2024-09-10T23:18:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.273+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7c0c5a50 con 0x7efd7c160280 2024-09-10T23:18:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.277+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7c0b04d0 con 0x7efd7c160280 2024-09-10T23:18:56.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.277+0000 7efd79600640 1 -- 172.21.15.17:0/471531044 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efd6801b400 con 0x7efd7c160280 2024-09-10T23:18:56.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.277+0000 7efd79600640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd5c0725e0 0x7efd5c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.277+0000 7efd79600640 1 -- 172.21.15.17:0/471531044 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7efd68093760 con 0x7efd7c160280 2024-09-10T23:18:56.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.277+0000 7efd81600640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd5c0725e0 0x7efd5c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.281+0000 7efd81600640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd5c0725e0 0x7efd5c074aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efd700b2000 tx=0x7efd7001d850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.281+0000 7efd79600640 1 -- 172.21.15.17:0/471531044 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efd68020020 con 0x7efd7c160280 2024-09-10T23:18:56.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.457+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd7c074af0 con 0x7efd7c160280 2024-09-10T23:18:56.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.457+0000 7efd79600640 1 -- 172.21.15.17:0/471531044 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16955 (secure 0 0 0) 0x7efd6805ecd0 con 0x7efd7c160280 2024-09-10T23:18:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":56,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:18:55.490296+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:53.186691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:54.526406+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:56.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd5c0725e0 msgr2=0x7efd5c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd5c0725e0 0x7efd5c074aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efd700b2000 tx=0x7efd7001d850 comp rx=0 tx=0).stop 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 msgr2=0x7efd7c0ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 0x7efd7c0ce2b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c4c0 tx=0x7efd6800c980 comp rx=0 tx=0).stop 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 shutdown_connections 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd5c0725e0 0x7efd5c074aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7c160660 0x7efd7c158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd7c160280 0x7efd7c0ce2b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 --2- 172.21.15.17:0/471531044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd7c0d2830 0x7efd7c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 >> 172.21.15.17:0/471531044 conn(0x7efd7c0d1d10 msgr2=0x7efd7c0b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 shutdown_connections 2024-09-10T23:18:56.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.461+0000 7efd84000640 1 -- 172.21.15.17:0/471531044 wait complete. 2024-09-10T23:18:56.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:56.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.625+0000 7f7b86200640 1 -- 172.21.15.17:0/228874175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b800d0200 msgr2=0x7f7b800b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.625+0000 7f7b86200640 1 --2- 172.21.15.17:0/228874175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b800d0200 0x7f7b800b1b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009bc0 tx=0x7f7b7801f3b0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.625+0000 7f7b86200640 1 -- 172.21.15.17:0/228874175 shutdown_connections 2024-09-10T23:18:56.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.625+0000 7f7b86200640 1 --2- 172.21.15.17:0/228874175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b800d0200 0x7f7b800b1b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.625+0000 7f7b86200640 1 --2- 172.21.15.17:0/228874175 >> v2:172.21.15.77:3300/0 conn(0x7f7b800d2830 0x7f7b800b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.625+0000 7f7b86200640 1 -- 172.21.15.17:0/228874175 >> 172.21.15.17:0/228874175 conn(0x7f7b800d1d10 msgr2=0x7f7b800d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.625+0000 7f7b86200640 1 -- 172.21.15.17:0/228874175 shutdown_connections 2024-09-10T23:18:56.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.625+0000 7f7b86200640 1 -- 172.21.15.17:0/228874175 wait complete. 2024-09-10T23:18:56.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 Processor -- start 2024-09-10T23:18:56.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 -- start start 2024-09-10T23:18:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b800d0200 0x7f7b8015ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b800d2830 0x7f7b801f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b80160280 0x7f7b8015bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7b800b2090 con 0x7f7b800d2830 2024-09-10T23:18:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b800b07c0 con 0x7f7b80160280 2024-09-10T23:18:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7b800b2210 con 0x7f7b800d0200 2024-09-10T23:18:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b76a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b800d2830 0x7f7b801f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b76a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b800d2830 0x7f7b801f8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49600/0 (socket says 172.21.15.17:49600) 2024-09-10T23:18:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b76a00640 1 -- 172.21.15.17:0/2500793917 learned_addr learned my addr 172.21.15.17:0/2500793917 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b7fe00640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b80160280 0x7f7b8015bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b7f400640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b800d0200 0x7f7b8015ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b76a00640 1 -- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b800d0200 msgr2=0x7f7b8015ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b76a00640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b800d0200 0x7f7b8015ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b76a00640 1 -- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b80160280 msgr2=0x7f7b8015bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b76a00640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b80160280 0x7f7b8015bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b76a00640 1 -- 172.21.15.17:0/2500793917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b800cdea0 con 0x7f7b800d2830 2024-09-10T23:18:56.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b76a00640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b800d2830 0x7f7b801f8140 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800ea00 tx=0x7f7b6800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b77e00640 1 -- 172.21.15.17:0/2500793917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6800cde0 con 0x7f7b800d2830 2024-09-10T23:18:56.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b77e00640 1 -- 172.21.15.17:0/2500793917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b68004020 con 0x7f7b800d2830 2024-09-10T23:18:56.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b800ce180 con 0x7f7b800d2830 2024-09-10T23:18:56.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b77e00640 1 -- 172.21.15.17:0/2500793917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b68004450 con 0x7f7b800d2830 2024-09-10T23:18:56.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.629+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b800ce740 con 0x7f7b800d2830 2024-09-10T23:18:56.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.633+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b800b2700 con 0x7f7b800d2830 2024-09-10T23:18:56.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.633+0000 7f7b77e00640 1 -- 172.21.15.17:0/2500793917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7b68003600 con 0x7f7b800d2830 2024-09-10T23:18:56.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.633+0000 7f7b77e00640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b5c072610 0x7f7b5c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.633+0000 7f7b77e00640 1 -- 172.21.15.17:0/2500793917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f7b68093c90 con 0x7f7b800d2830 2024-09-10T23:18:56.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.633+0000 7f7b7f400640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b5c072610 0x7f7b5c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.633+0000 7f7b7f400640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b5c072610 0x7f7b5c074ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b70007fd0 tx=0x7f7b70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.637+0000 7f7b77e00640 1 -- 172.21.15.17:0/2500793917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7b6805eb80 con 0x7f7b800d2830 2024-09-10T23:18:56.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b800705c0 con 0x7f7b800d2830 2024-09-10T23:18:56.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b77e00640 1 -- 172.21.15.17:0/2500793917 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16955 (secure 0 0 0) 0x7f7b680635b0 con 0x7f7b800d2830 2024-09-10T23:18:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:56.818 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":56,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:18:55.490296+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:53.186691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:54.526406+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:56.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b5c072610 msgr2=0x7f7b5c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b5c072610 0x7f7b5c074ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b70007fd0 tx=0x7f7b70009040 comp rx=0 tx=0).stop 2024-09-10T23:18:56.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b800d2830 msgr2=0x7f7b801f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b800d2830 0x7f7b801f8140 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800ea00 tx=0x7f7b6800eec0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 shutdown_connections 2024-09-10T23:18:56.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b5c072610 0x7f7b5c074ad0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b80160280 0x7f7b8015bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b800d2830 0x7f7b801f8140 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 --2- 172.21.15.17:0/2500793917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b800d0200 0x7f7b8015ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 >> 172.21.15.17:0/2500793917 conn(0x7f7b800d1d10 msgr2=0x7f7b800d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 shutdown_connections 2024-09-10T23:18:56.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.813+0000 7f7b86200640 1 -- 172.21.15.17:0/2500793917 wait complete. 2024-09-10T23:18:56.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:18:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.985+0000 7f83e1400640 1 -- 172.21.15.17:0/745223399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc160460 msgr2=0x7f83dc15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.985+0000 7f83e1400640 1 --2- 172.21.15.17:0/745223399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc160460 0x7f83dc15f770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0708a0 tx=0x7f83c401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.985+0000 7f83e1400640 1 -- 172.21.15.17:0/745223399 shutdown_connections 2024-09-10T23:18:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.985+0000 7f83e1400640 1 --2- 172.21.15.17:0/745223399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83dc06e6f0 0x7f83dc15fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.985+0000 7f83e1400640 1 --2- 172.21.15.17:0/745223399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc160460 0x7f83dc15f770 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.985+0000 7f83e1400640 1 --2- 172.21.15.17:0/745223399 >> v2:172.21.15.77:3300/0 conn(0x7f83dc145800 0x7f83dc0741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.985+0000 7f83e1400640 1 -- 172.21.15.17:0/745223399 >> 172.21.15.17:0/745223399 conn(0x7f83dc0b17a0 msgr2=0x7f83dc0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:56.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.985+0000 7f83e1400640 1 -- 172.21.15.17:0/745223399 shutdown_connections 2024-09-10T23:18:56.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.985+0000 7f83e1400640 1 -- 172.21.15.17:0/745223399 wait complete. 2024-09-10T23:18:56.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 Processor -- start 2024-09-10T23:18:56.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 -- start start 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc06e6f0 0x7f83dc138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83dc145800 0x7f83dc142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83dc160460 0x7f83dc142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc15c4c0 con 0x7f83dc06e6f0 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc15c340 con 0x7f83dc145800 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f83dc15c640 con 0x7f83dc160460 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83da800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc06e6f0 0x7f83dc138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83da800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc06e6f0 0x7f83dc138fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39318/0 (socket says 172.21.15.17:39318) 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83da800640 1 -- 172.21.15.17:0/4289517328 learned_addr learned my addr 172.21.15.17:0/4289517328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:56.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83db200640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83dc160460 0x7f83dc142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83d3e00640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83dc145800 0x7f83dc142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83da800640 1 -- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83dc160460 msgr2=0x7f83dc142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83da800640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83dc160460 0x7f83dc142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83da800640 1 -- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83dc145800 msgr2=0x7f83dc142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83da800640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83dc145800 0x7f83dc142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83da800640 1 -- 172.21.15.17:0/4289517328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc143210 con 0x7f83dc06e6f0 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83da800640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc06e6f0 0x7f83dc138fb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00d950 tx=0x7f83cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83d2a00640 1 -- 172.21.15.17:0/4289517328 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc017070 con 0x7f83dc06e6f0 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83d2a00640 1 -- 172.21.15.17:0/4289517328 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83cc009d20 con 0x7f83dc06e6f0 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83d2a00640 1 -- 172.21.15.17:0/4289517328 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0106c0 con 0x7f83dc06e6f0 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc1434f0 con 0x7f83dc06e6f0 2024-09-10T23:18:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc139a30 con 0x7f83dc06e6f0 2024-09-10T23:18:56.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.989+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc0741d0 con 0x7f83dc06e6f0 2024-09-10T23:18:56.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.993+0000 7f83d2a00640 1 -- 172.21.15.17:0/4289517328 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f83cc010860 con 0x7f83dc06e6f0 2024-09-10T23:18:56.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.993+0000 7f83d2a00640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83b80725e0 0x7f83b8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:56.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.993+0000 7f83d2a00640 1 -- 172.21.15.17:0/4289517328 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f83cc093810 con 0x7f83dc06e6f0 2024-09-10T23:18:56.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.993+0000 7f83d3e00640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83b80725e0 0x7f83b8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:56.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.993+0000 7f83d3e00640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83b80725e0 0x7f83b8074aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f83c40af000 tx=0x7f83c401b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:56.997+0000 7f83d2a00640 1 -- 172.21.15.17:0/4289517328 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f83cc05ed50 con 0x7f83dc06e6f0 2024-09-10T23:18:57.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:57.213+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f83dc0ce4e0 con 0x7f83dc06e6f0 2024-09-10T23:18:58.050 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:18:58.045+0000 7f1e95c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:18:58.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.077+0000 7f83d2a00640 1 -- 172.21.15.17:0/4289517328 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f83cc05e650 con 0x7f83dc06e6f0 2024-09-10T23:18:58.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83b80725e0 msgr2=0x7f83b8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83b80725e0 0x7f83b8074aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f83c40af000 tx=0x7f83c401b100 comp rx=0 tx=0).stop 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc06e6f0 msgr2=0x7f83dc138fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc06e6f0 0x7f83dc138fb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00d950 tx=0x7f83cc00de10 comp rx=0 tx=0).stop 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 shutdown_connections 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83b80725e0 0x7f83b8074aa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83dc160460 0x7f83dc142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83dc145800 0x7f83dc142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 --2- 172.21.15.17:0/4289517328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83dc06e6f0 0x7f83dc138fb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 >> 172.21.15.17:0/4289517328 conn(0x7f83dc0b17a0 msgr2=0x7f83dc15e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 shutdown_connections 2024-09-10T23:18:58.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.081+0000 7f83e1400640 1 -- 172.21.15.17:0/4289517328 wait complete. 2024-09-10T23:18:58.110 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:18:58.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:18:58.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 -- 172.21.15.17:0/3687181737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22480d06b0 msgr2=0x7f22480b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 --2- 172.21.15.17:0/3687181737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22480d06b0 0x7f22480b29d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f22480b4770 tx=0x7f223001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 -- 172.21.15.17:0/3687181737 shutdown_connections 2024-09-10T23:18:58.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 --2- 172.21.15.17:0/3687181737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224815bca0 0x7f22480b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 --2- 172.21.15.17:0/3687181737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22480d06b0 0x7f22480b29d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 --2- 172.21.15.17:0/3687181737 >> v2:172.21.15.77:3300/0 conn(0x7f224815b8c0 0x7f22480d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 -- 172.21.15.17:0/3687181737 >> 172.21.15.17:0/3687181737 conn(0x7f224809a9f0 msgr2=0x7f224809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:58.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 -- 172.21.15.17:0/3687181737 shutdown_connections 2024-09-10T23:18:58.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 -- 172.21.15.17:0/3687181737 wait complete. 2024-09-10T23:18:58.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 Processor -- start 2024-09-10T23:18:58.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 -- start start 2024-09-10T23:18:58.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22480d06b0 0x7f22480cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224815b8c0 0x7f22481f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224815bca0 0x7f22480b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2248167860 con 0x7f224815b8c0 2024-09-10T23:18:58.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22481676e0 con 0x7f22480d06b0 2024-09-10T23:18:58.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f2247e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f22481679e0 con 0x7f224815bca0 2024-09-10T23:18:58.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f223fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224815b8c0 0x7f22481f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f223fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224815b8c0 0x7f22481f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39342/0 (socket says 172.21.15.17:39342) 2024-09-10T23:18:58.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.261+0000 7f223fe00640 1 -- 172.21.15.17:0/141452008 learned_addr learned my addr 172.21.15.17:0/141452008 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:58.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f2246a00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22480d06b0 0x7f22480cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f2247400640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224815bca0 0x7f22480b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223fe00640 1 -- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224815bca0 msgr2=0x7f22480b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223fe00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224815bca0 0x7f22480b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223fe00640 1 -- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22480d06b0 msgr2=0x7f22480cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223fe00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22480d06b0 0x7f22480cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223fe00640 1 -- 172.21.15.17:0/141452008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22480b6a00 con 0x7f224815b8c0 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f2247400640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224815bca0 0x7f22480b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223fe00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224815b8c0 0x7f22481f7e30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f22300b0040 tx=0x7f22300a5720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223ea00640 1 -- 172.21.15.17:0/141452008 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300b2040 con 0x7f224815b8c0 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223ea00640 1 -- 172.21.15.17:0/141452008 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2230004400 con 0x7f224815b8c0 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223ea00640 1 -- 172.21.15.17:0/141452008 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230005290 con 0x7f224815b8c0 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22480b6c80 con 0x7f224815b8c0 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22481f7630 con 0x7f224815b8c0 2024-09-10T23:18:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22480d0170 con 0x7f224815b8c0 2024-09-10T23:18:58.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223ea00640 1 -- 172.21.15.17:0/141452008 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2230005430 con 0x7f224815b8c0 2024-09-10T23:18:58.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.265+0000 7f223ea00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22240725e0 0x7f2224074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:58.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.269+0000 7f223ea00640 1 -- 172.21.15.17:0/141452008 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f223012cef0 con 0x7f224815b8c0 2024-09-10T23:18:58.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.269+0000 7f2246a00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22240725e0 0x7f2224074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:58.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.269+0000 7f2246a00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22240725e0 0x7f2224074aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f224806fe80 tx=0x7f223800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:58.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.269+0000 7f223ea00640 1 -- 172.21.15.17:0/141452008 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f22480b6a00 con 0x7f224815b8c0 2024-09-10T23:18:58.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:58.481+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f22480b71a0 con 0x7f224815b8c0 2024-09-10T23:18:59.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f223ea00640 1 -- 172.21.15.17:0/141452008 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) ==== 122+0+0 (secure 0 0 0) 0x7f22300164b0 con 0x7f224815b8c0 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22240725e0 msgr2=0x7f2224074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22240725e0 0x7f2224074aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f224806fe80 tx=0x7f223800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224815b8c0 msgr2=0x7f22481f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224815b8c0 0x7f22481f7e30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f22300b0040 tx=0x7f22300a5720 comp rx=0 tx=0).stop 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 shutdown_connections 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22240725e0 0x7f2224074aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f224815bca0 0x7f22480b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f224815b8c0 0x7f22481f7e30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 --2- 172.21.15.17:0/141452008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22480d06b0 0x7f22480cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 >> 172.21.15.17:0/141452008 conn(0x7f224809a9f0 msgr2=0x7f22480b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:59.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 shutdown_connections 2024-09-10T23:18:59.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.085+0000 7f2247e00640 1 -- 172.21.15.17:0/141452008 wait complete. 2024-09-10T23:18:59.116 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:18:59.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:18:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 -- 172.21.15.17:0/380967154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 msgr2=0x7f46040b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 --2- 172.21.15.17:0/380967154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 0x7f46040b3e10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009900 tx=0x7f45f401c820 comp rx=0 tx=0).stop 2024-09-10T23:18:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 -- 172.21.15.17:0/380967154 shutdown_connections 2024-09-10T23:18:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 --2- 172.21.15.17:0/380967154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46040b4350 0x7f460415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 --2- 172.21.15.17:0/380967154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 0x7f46040b3e10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 -- 172.21.15.17:0/380967154 >> 172.21.15.17:0/380967154 conn(0x7f460406cfc0 msgr2=0x7f460406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 -- 172.21.15.17:0/380967154 shutdown_connections 2024-09-10T23:18:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 -- 172.21.15.17:0/380967154 wait complete. 2024-09-10T23:18:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 Processor -- start 2024-09-10T23:18:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 -- start start 2024-09-10T23:18:59.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46040b3870 0x7f460414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46040b4350 0x7f46040cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 0x7f460414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4604167860 con 0x7f46041550b0 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46041679e0 con 0x7f46040b3870 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4608e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4604167b60 con 0x7f46040b4350 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4602800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 0x7f460414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4602800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 0x7f460414aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39364/0 (socket says 172.21.15.17:39364) 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4602800640 1 -- 172.21.15.17:0/1833272567 learned_addr learned my addr 172.21.15.17:0/1833272567 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f4601e00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46040b3870 0x7f460414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.265+0000 7f45f9400640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46040b4350 0x7f46040cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f4602800640 1 -- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46040b4350 msgr2=0x7f46040cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f4602800640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46040b4350 0x7f46040cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f4602800640 1 -- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46040b3870 msgr2=0x7f460414c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f4602800640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46040b3870 0x7f460414c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f4602800640 1 -- 172.21.15.17:0/1833272567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460415f850 con 0x7f46041550b0 2024-09-10T23:18:59.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f4602800640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 0x7f460414aff0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00b970 tx=0x7f45fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:59.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f45faa00640 1 -- 172.21.15.17:0/1833272567 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc019070 con 0x7f46041550b0 2024-09-10T23:18:59.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f45faa00640 1 -- 172.21.15.17:0/1833272567 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45fc00cc50 con 0x7f46041550b0 2024-09-10T23:18:59.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460414c610 con 0x7f46041550b0 2024-09-10T23:18:59.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f45faa00640 1 -- 172.21.15.17:0/1833272567 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0146a0 con 0x7f46041550b0 2024-09-10T23:18:59.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4604160240 con 0x7f46041550b0 2024-09-10T23:18:59.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f460415c1d0 con 0x7f46041550b0 2024-09-10T23:18:59.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f45faa00640 1 -- 172.21.15.17:0/1833272567 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f45fc01d3b0 con 0x7f46041550b0 2024-09-10T23:18:59.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f45faa00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45e00725e0 0x7f45e0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.269+0000 7f45faa00640 1 -- 172.21.15.17:0/1833272567 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f45fc093360 con 0x7f46041550b0 2024-09-10T23:18:59.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.273+0000 7f4601e00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45e00725e0 0x7f45e0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.273+0000 7f4601e00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45e00725e0 0x7f45e0074aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f45f40af000 tx=0x7f45f401b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:59.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.273+0000 7f45faa00640 1 -- 172.21.15.17:0/1833272567 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f45fc05e250 con 0x7f46041550b0 2024-09-10T23:18:59.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f460414cb80 con 0x7f46041550b0 2024-09-10T23:18:59.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f45faa00640 1 -- 172.21.15.17:0/1833272567 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f45fc062c80 con 0x7f46041550b0 2024-09-10T23:18:59.490 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:59.490 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":29,"btime":"2024-09-10T23:18:59:082892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1801943144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1801943144},{"type":"v1","addr":"172.21.15.77:6837","nonce":1801943144}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2387800472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2387800472},{"type":"v1","addr":"172.21.15.77:6835","nonce":2387800472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1881542084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1881542084},{"type":"v1","addr":"172.21.15.17:6835","nonce":1881542084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:55.490263+0000","modified":"2024-09-10T23:18:58.486065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5475},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5475":{"gid":5475,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/1323392007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1323392007},{"type":"v1","addr":"172.21.15.17:6834","nonce":1323392007}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5475,"qdb_cluster":[5475]},"id":3}]} 2024-09-10T23:18:59.490 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 29 2024-09-10T23:18:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45e00725e0 msgr2=0x7f45e0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45e00725e0 0x7f45e0074aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f45f40af000 tx=0x7f45f401b060 comp rx=0 tx=0).stop 2024-09-10T23:18:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 msgr2=0x7f460414aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 0x7f460414aff0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00b970 tx=0x7f45fc00be30 comp rx=0 tx=0).stop 2024-09-10T23:18:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 shutdown_connections 2024-09-10T23:18:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45e00725e0 0x7f45e0074aa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46041550b0 0x7f460414aff0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46040b4350 0x7f46040cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 --2- 172.21.15.17:0/1833272567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46040b3870 0x7f460414c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 >> 172.21.15.17:0/1833272567 conn(0x7f460406cfc0 msgr2=0x7f4604154270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 shutdown_connections 2024-09-10T23:18:59.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.485+0000 7f4608e00640 1 -- 172.21.15.17:0/1833272567 wait complete. 2024-09-10T23:18:59.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:18:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.653+0000 7fb846600640 1 -- 172.21.15.17:0/3319757053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb824003a40 msgr2=0x7fb824003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.653+0000 7fb846600640 1 --2- 172.21.15.17:0/3319757053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb824003a40 0x7fb824003e60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb830009b60 tx=0x7fb83001d270 comp rx=0 tx=0).stop 2024-09-10T23:18:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.653+0000 7fb83fe00640 1 -- 172.21.15.17:0/3319757053 reap_dead start 2024-09-10T23:18:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.653+0000 7fb846600640 1 -- 172.21.15.17:0/3319757053 shutdown_connections 2024-09-10T23:18:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.653+0000 7fb846600640 1 -- 172.21.15.17:0/3319757053 >> 172.21.15.17:0/3319757053 conn(0x7fb8400b3870 msgr2=0x7fb8400b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.653+0000 7fb846600640 1 -- 172.21.15.17:0/3319757053 shutdown_connections 2024-09-10T23:18:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.653+0000 7fb846600640 1 -- 172.21.15.17:0/3319757053 wait complete. 2024-09-10T23:18:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 Processor -- start 2024-09-10T23:18:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 -- start start 2024-09-10T23:18:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb824003a40 0x7fb84009f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb84009f640 0x7fb8400c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8400c77c0 0x7fb8400cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb840168260 con 0x7fb824003a40 2024-09-10T23:18:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb8401680e0 con 0x7fb84009f640 2024-09-10T23:18:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb8401683e0 con 0x7fb8400c77c0 2024-09-10T23:18:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb824003a40 0x7fb84009f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb824003a40 0x7fb84009f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39380/0 (socket says 172.21.15.17:39380) 2024-09-10T23:18:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83f400640 1 -- 172.21.15.17:0/707897485 learned_addr learned my addr 172.21.15.17:0/707897485 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:18:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83ea00640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb84009f640 0x7fb8400c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83fe00640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8400c77c0 0x7fb8400cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83f400640 1 -- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8400c77c0 msgr2=0x7fb8400cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83f400640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8400c77c0 0x7fb8400cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83f400640 1 -- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb84009f640 msgr2=0x7fb8400c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83f400640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb84009f640 0x7fb8400c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83f400640 1 -- 172.21.15.17:0/707897485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8400c7d00 con 0x7fb824003a40 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb83f400640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb824003a40 0x7fb84009f100 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb83001d0a0 tx=0x7fb830005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb837400640 1 -- 172.21.15.17:0/707897485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300b1040 con 0x7fb824003a40 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb837400640 1 -- 172.21.15.17:0/707897485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8300ac400 con 0x7fb824003a40 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb837400640 1 -- 172.21.15.17:0/707897485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830004290 con 0x7fb824003a40 2024-09-10T23:18:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8400c8040 con 0x7fb824003a40 2024-09-10T23:18:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.657+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8400b5ba0 con 0x7fb824003a40 2024-09-10T23:18:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.661+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb84015fb90 con 0x7fb824003a40 2024-09-10T23:18:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.661+0000 7fb837400640 1 -- 172.21.15.17:0/707897485 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb8300046d0 con 0x7fb824003a40 2024-09-10T23:18:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.661+0000 7fb837400640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb820072610 0x7fb820074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:18:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.661+0000 7fb837400640 1 -- 172.21.15.17:0/707897485 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7fb83012dd90 con 0x7fb824003a40 2024-09-10T23:18:59.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.661+0000 7fb83ea00640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb820072610 0x7fb820074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:18:59.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.661+0000 7fb83ea00640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb820072610 0x7fb820074ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb82c006fd0 tx=0x7fb82c006b30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:18:59.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.665+0000 7fb837400640 1 -- 172.21.15.17:0/707897485 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb8300c4020 con 0x7fb824003a40 2024-09-10T23:18:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.841+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8400b1030 con 0x7fb824003a40 2024-09-10T23:18:59.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.841+0000 7fb837400640 1 -- 172.21.15.17:0/707897485 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16942 (secure 0 0 0) 0x7fb8400c8040 con 0x7fb824003a40 2024-09-10T23:18:59.848 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:18:59.848 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":57,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:18:57.071969+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:53.186691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:54.526406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:18:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb820072610 msgr2=0x7fb820074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb820072610 0x7fb820074ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb82c006fd0 tx=0x7fb82c006b30 comp rx=0 tx=0).stop 2024-09-10T23:18:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb824003a40 msgr2=0x7fb84009f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:18:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb824003a40 0x7fb84009f100 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb83001d0a0 tx=0x7fb830005590 comp rx=0 tx=0).stop 2024-09-10T23:18:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 shutdown_connections 2024-09-10T23:18:59.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb820072610 0x7fb820074ad0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8400c77c0 0x7fb8400cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb84009f640 0x7fb8400c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 --2- 172.21.15.17:0/707897485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb824003a40 0x7fb84009f100 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:18:59.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 >> 172.21.15.17:0/707897485 conn(0x7fb8400b3870 msgr2=0x7fb8400cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:18:59.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 shutdown_connections 2024-09-10T23:18:59.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:18:59.845+0000 7fb846600640 1 -- 172.21.15.17:0/707897485 wait complete. 2024-09-10T23:18:59.868 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:18:59.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:00.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.009+0000 7fb746c00640 1 -- 172.21.15.17:0/3126065300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400d1830 msgr2=0x7fb74015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.009+0000 7fb746c00640 1 --2- 172.21.15.17:0/3126065300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400d1830 0x7fb74015f5a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb7400cf010 tx=0x7fb72801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.009+0000 7fb746c00640 1 -- 172.21.15.17:0/3126065300 shutdown_connections 2024-09-10T23:19:00.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.009+0000 7fb746c00640 1 --2- 172.21.15.17:0/3126065300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400d1830 0x7fb74015f5a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.009+0000 7fb746c00640 1 --2- 172.21.15.17:0/3126065300 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb740070ad0 0x7fb74015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.009+0000 7fb746c00640 1 -- 172.21.15.17:0/3126065300 >> 172.21.15.17:0/3126065300 conn(0x7fb7400d1d60 msgr2=0x7fb7400d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:00.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.009+0000 7fb746c00640 1 -- 172.21.15.17:0/3126065300 shutdown_connections 2024-09-10T23:19:00.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.009+0000 7fb746c00640 1 -- 172.21.15.17:0/3126065300 wait complete. 2024-09-10T23:19:00.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 Processor -- start 2024-09-10T23:19:00.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 -- start start 2024-09-10T23:19:00.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb740070ad0 0x7fb74014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400cf320 0x7fb74015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d1830 0x7fb74014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb7401693e0 con 0x7fb7400cf320 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb740169260 con 0x7fb7400d1830 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb740169560 con 0x7fb740070ad0 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb737e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400cf320 0x7fb74015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb737e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400cf320 0x7fb74015c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39404/0 (socket says 172.21.15.17:39404) 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb737e00640 1 -- 172.21.15.17:0/2488479547 learned_addr learned my addr 172.21.15.17:0/2488479547 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb73fe00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb740070ad0 0x7fb74014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb744c00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d1830 0x7fb74014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb737e00640 1 -- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb740070ad0 msgr2=0x7fb74014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb737e00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb740070ad0 0x7fb74014cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb737e00640 1 -- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d1830 msgr2=0x7fb74014dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb737e00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d1830 0x7fb74014dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb737e00640 1 -- 172.21.15.17:0/2488479547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74015a710 con 0x7fb7400cf320 2024-09-10T23:19:00.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb737e00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400cf320 0x7fb74015c1a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb7280b0040 tx=0x7fb728005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:00.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb73cc00640 1 -- 172.21.15.17:0/2488479547 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7280b2040 con 0x7fb7400cf320 2024-09-10T23:19:00.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb73cc00640 1 -- 172.21.15.17:0/2488479547 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb728005320 con 0x7fb7400cf320 2024-09-10T23:19:00.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb73cc00640 1 -- 172.21.15.17:0/2488479547 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7280046d0 con 0x7fb7400cf320 2024-09-10T23:19:00.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74015a9f0 con 0x7fb7400cf320 2024-09-10T23:19:00.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.013+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb74014d570 con 0x7fb7400cf320 2024-09-10T23:19:00.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.017+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7400cfc60 con 0x7fb7400cf320 2024-09-10T23:19:00.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.017+0000 7fb73cc00640 1 -- 172.21.15.17:0/2488479547 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb728004870 con 0x7fb7400cf320 2024-09-10T23:19:00.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.017+0000 7fb73cc00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb71c0725e0 0x7fb71c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.017+0000 7fb73cc00640 1 -- 172.21.15.17:0/2488479547 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7fb72812d470 con 0x7fb7400cf320 2024-09-10T23:19:00.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.017+0000 7fb73fe00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb71c0725e0 0x7fb71c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.021+0000 7fb73fe00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb71c0725e0 0x7fb71c074aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb730004630 tx=0x7fb73000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:00.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.021+0000 7fb73cc00640 1 -- 172.21.15.17:0/2488479547 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb7280164d0 con 0x7fb7400cf320 2024-09-10T23:19:00.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.193+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb740069e10 con 0x7fb71c0725e0 2024-09-10T23:19:00.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.197+0000 7fb73cc00640 1 -- 172.21.15.17:0/2488479547 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245761 (secure 0 0 0) 0x7fb7300038a0 con 0x7fb71c0725e0 2024-09-10T23:19:00.207 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:00.208 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:19:00.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb71c0725e0 msgr2=0x7fb71c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb71c0725e0 0x7fb71c074aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb730004630 tx=0x7fb73000b390 comp rx=0 tx=0).stop 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400cf320 msgr2=0x7fb74015c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400cf320 0x7fb74015c1a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb7280b0040 tx=0x7fb728005e00 comp rx=0 tx=0).stop 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 shutdown_connections 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb71c0725e0 0x7fb71c074aa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d1830 0x7fb74014dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7400cf320 0x7fb74015c1a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 --2- 172.21.15.17:0/2488479547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb740070ad0 0x7fb74014cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 >> 172.21.15.17:0/2488479547 conn(0x7fb7400d1d60 msgr2=0x7fb7400b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 shutdown_connections 2024-09-10T23:19:00.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.201+0000 7fb746c00640 1 -- 172.21.15.17:0/2488479547 wait complete. 2024-09-10T23:19:00.228 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-10T23:18:58.339638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591020,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":347308,"kb_used_data":6188,"kb_used_omap":12,"kb_used_meta":340915,"kb_avail":754627412,"statfs":{"total":773094113280,"available":772738469888,"internally_reserved":0,"allocated":6336512,"data_stored":3444601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":349097521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.282244"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.070436+0000","last_change":"2024-09-10T23:18:55.070436+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.070436+0000","last_undegraded":"2024-09-10T23:18:55.070436+0000","last_fullsized":"2024-09-10T23:18:55.070436+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.069301+0000","last_change":"2024-09-10T23:18:55.069301+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.069301+0000","last_undegraded":"2024-09-10T23:18:55.069301+0000","last_fullsized":"2024-09-10T23:18:55.069301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.079405+0000","last_change":"2024-09-10T23:18:55.079405+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.079405+0000","last_undegraded":"2024-09-10T23:18:55.079405+0000","last_fullsized":"2024-09-10T23:18:55.079405+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068548+0000","last_change":"2024-09-10T23:18:55.068548+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068548+0000","last_undegraded":"2024-09-10T23:18:55.068548+0000","last_fullsized":"2024-09-10T23:18:55.068548+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073139+0000","last_change":"2024-09-10T23:18:55.073139+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073139+0000","last_undegraded":"2024-09-10T23:18:55.073139+0000","last_fullsized":"2024-09-10T23:18:55.073139+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.070330+0000","last_change":"2024-09-10T23:18:55.070330+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.070330+0000","last_undegraded":"2024-09-10T23:18:55.070330+0000","last_fullsized":"2024-09-10T23:18:55.070330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.079321+0000","last_change":"2024-09-10T23:18:55.079321+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.079321+0000","last_undegraded":"2024-09-10T23:18:55.079321+0000","last_fullsized":"2024-09-10T23:18:55.079321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.071366+0000","last_change":"2024-09-10T23:18:55.071366+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.071366+0000","last_undegraded":"2024-09-10T23:18:55.071366+0000","last_fullsized":"2024-09-10T23:18:55.071366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072680+0000","last_change":"2024-09-10T23:18:55.072680+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072680+0000","last_undegraded":"2024-09-10T23:18:55.072680+0000","last_fullsized":"2024-09-10T23:18:55.072680+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.069706+0000","last_change":"2024-09-10T23:18:55.069706+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.069706+0000","last_undegraded":"2024-09-10T23:18:55.069706+0000","last_fullsized":"2024-09-10T23:18:55.069706+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.080824+0000","last_change":"2024-09-10T23:18:55.080824+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.080824+0000","last_undegraded":"2024-09-10T23:18:55.080824+0000","last_fullsized":"2024-09-10T23:18:55.080824+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068498+0000","last_change":"2024-09-10T23:18:55.068498+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068498+0000","last_undegraded":"2024-09-10T23:18:55.068498+0000","last_fullsized":"2024-09-10T23:18:55.068498+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068655+0000","last_change":"2024-09-10T23:18:55.068655+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068655+0000","last_undegraded":"2024-09-10T23:18:55.068655+0000","last_fullsized":"2024-09-10T23:18:55.068655+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.080807+0000","last_change":"2024-09-10T23:18:55.080807+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.080807+0000","last_undegraded":"2024-09-10T23:18:55.080807+0000","last_fullsized":"2024-09-10T23:18:55.080807+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068869+0000","last_change":"2024-09-10T23:18:55.068869+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068869+0000","last_undegraded":"2024-09-10T23:18:55.068869+0000","last_fullsized":"2024-09-10T23:18:55.068869+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.079004+0000","last_change":"2024-09-10T23:18:55.079004+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.079004+0000","last_undegraded":"2024-09-10T23:18:55.079004+0000","last_fullsized":"2024-09-10T23:18:55.079004+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.083743+0000","last_change":"2024-09-10T23:18:56.081732+0000","last_active":"2024-09-10T23:18:56.083743+0000","last_peered":"2024-09-10T23:18:56.083743+0000","last_clean":"2024-09-10T23:18:56.083743+0000","last_became_active":"2024-09-10T23:18:56.081395+0000","last_became_peered":"2024-09-10T23:18:56.081395+0000","last_unstale":"2024-09-10T23:18:56.083743+0000","last_undegraded":"2024-09-10T23:18:56.083743+0000","last_fullsized":"2024-09-10T23:18:56.083743+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:10.392764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.094299+0000","last_change":"2024-09-10T23:18:56.092352+0000","last_active":"2024-09-10T23:18:56.094299+0000","last_peered":"2024-09-10T23:18:56.094299+0000","last_clean":"2024-09-10T23:18:56.094299+0000","last_became_active":"2024-09-10T23:18:56.092077+0000","last_became_peered":"2024-09-10T23:18:56.092077+0000","last_unstale":"2024-09-10T23:18:56.094299+0000","last_undegraded":"2024-09-10T23:18:56.094299+0000","last_fullsized":"2024-09-10T23:18:56.094299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:51.840316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073444+0000","last_change":"2024-09-10T23:18:55.073444+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073444+0000","last_undegraded":"2024-09-10T23:18:55.073444+0000","last_fullsized":"2024-09-10T23:18:55.073444+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.078610+0000","last_change":"2024-09-10T23:18:55.078610+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.078610+0000","last_undegraded":"2024-09-10T23:18:55.078610+0000","last_fullsized":"2024-09-10T23:18:55.078610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.079872+0000","last_change":"2024-09-10T23:18:55.079872+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.079872+0000","last_undegraded":"2024-09-10T23:18:55.079872+0000","last_fullsized":"2024-09-10T23:18:55.079872+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.070664+0000","last_change":"2024-09-10T23:18:55.070664+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.070664+0000","last_undegraded":"2024-09-10T23:18:55.070664+0000","last_fullsized":"2024-09-10T23:18:55.070664+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.100383+0000","last_change":"2024-09-10T23:18:56.098682+0000","last_active":"2024-09-10T23:18:56.100383+0000","last_peered":"2024-09-10T23:18:56.100383+0000","last_clean":"2024-09-10T23:18:56.100383+0000","last_became_active":"2024-09-10T23:18:56.098439+0000","last_became_peered":"2024-09-10T23:18:56.098439+0000","last_unstale":"2024-09-10T23:18:56.100383+0000","last_undegraded":"2024-09-10T23:18:56.100383+0000","last_fullsized":"2024-09-10T23:18:56.100383+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:14.017730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.076756+0000","last_change":"2024-09-10T23:18:55.076756+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.076756+0000","last_undegraded":"2024-09-10T23:18:55.076756+0000","last_fullsized":"2024-09-10T23:18:55.076756+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068588+0000","last_change":"2024-09-10T23:18:55.068588+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068588+0000","last_undegraded":"2024-09-10T23:18:55.068588+0000","last_fullsized":"2024-09-10T23:18:55.068588+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.076877+0000","last_change":"2024-09-10T23:18:55.076877+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.076877+0000","last_undegraded":"2024-09-10T23:18:55.076877+0000","last_fullsized":"2024-09-10T23:18:55.076877+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.074139+0000","last_change":"2024-09-10T23:18:55.074139+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.074139+0000","last_undegraded":"2024-09-10T23:18:55.074139+0000","last_fullsized":"2024-09-10T23:18:55.074139+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068498+0000","last_change":"2024-09-10T23:18:55.068498+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068498+0000","last_undegraded":"2024-09-10T23:18:55.068498+0000","last_fullsized":"2024-09-10T23:18:55.068498+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.101813+0000","last_change":"2024-09-10T23:18:55.084728+0000","last_active":"2024-09-10T23:18:56.101813+0000","last_peered":"2024-09-10T23:18:56.101813+0000","last_clean":"2024-09-10T23:18:56.101813+0000","last_became_active":"2024-09-10T23:18:55.083761+0000","last_became_peered":"2024-09-10T23:18:55.083761+0000","last_unstale":"2024-09-10T23:18:56.101813+0000","last_undegraded":"2024-09-10T23:18:56.101813+0000","last_fullsized":"2024-09-10T23:18:56.101813+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:10.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072790+0000","last_change":"2024-09-10T23:18:55.072790+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072790+0000","last_undegraded":"2024-09-10T23:18:55.072790+0000","last_fullsized":"2024-09-10T23:18:55.072790+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087696+0000","last_change":"2024-09-10T23:18:55.086808+0000","last_active":"2024-09-10T23:18:55.087696+0000","last_peered":"2024-09-10T23:18:55.087696+0000","last_clean":"2024-09-10T23:18:55.087696+0000","last_became_active":"2024-09-10T23:18:55.086532+0000","last_became_peered":"2024-09-10T23:18:55.086532+0000","last_unstale":"2024-09-10T23:18:55.087696+0000","last_undegraded":"2024-09-10T23:18:55.087696+0000","last_fullsized":"2024-09-10T23:18:55.087696+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:08.556811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.093849+0000","last_change":"2024-09-10T23:18:56.092067+0000","last_active":"2024-09-10T23:18:56.093849+0000","last_peered":"2024-09-10T23:18:56.093849+0000","last_clean":"2024-09-10T23:18:56.093849+0000","last_became_active":"2024-09-10T23:18:56.091772+0000","last_became_peered":"2024-09-10T23:18:56.091772+0000","last_unstale":"2024-09-10T23:18:56.093849+0000","last_undegraded":"2024-09-10T23:18:56.093849+0000","last_fullsized":"2024-09-10T23:18:56.093849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:56.252112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083702+0000","last_change":"2024-09-10T23:18:55.078770+0000","last_active":"2024-09-10T23:18:55.083702+0000","last_peered":"2024-09-10T23:18:55.083702+0000","last_clean":"2024-09-10T23:18:55.083702+0000","last_became_active":"2024-09-10T23:18:55.078521+0000","last_became_peered":"2024-09-10T23:18:55.078521+0000","last_unstale":"2024-09-10T23:18:55.083702+0000","last_undegraded":"2024-09-10T23:18:55.083702+0000","last_fullsized":"2024-09-10T23:18:55.083702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:36.762199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.090170+0000","last_change":"2024-09-10T23:18:55.089746+0000","last_active":"2024-09-10T23:18:55.090170+0000","last_peered":"2024-09-10T23:18:55.090170+0000","last_clean":"2024-09-10T23:18:55.090170+0000","last_became_active":"2024-09-10T23:18:55.089507+0000","last_became_peered":"2024-09-10T23:18:55.089507+0000","last_unstale":"2024-09-10T23:18:55.090170+0000","last_undegraded":"2024-09-10T23:18:55.090170+0000","last_fullsized":"2024-09-10T23:18:55.090170+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:39.880189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073013+0000","last_change":"2024-09-10T23:18:55.073013+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073013+0000","last_undegraded":"2024-09-10T23:18:55.073013+0000","last_fullsized":"2024-09-10T23:18:55.073013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.091210+0000","last_change":"2024-09-10T23:18:55.088922+0000","last_active":"2024-09-10T23:18:55.091210+0000","last_peered":"2024-09-10T23:18:55.091210+0000","last_clean":"2024-09-10T23:18:55.091210+0000","last_became_active":"2024-09-10T23:18:55.088591+0000","last_became_peered":"2024-09-10T23:18:55.088591+0000","last_unstale":"2024-09-10T23:18:55.091210+0000","last_undegraded":"2024-09-10T23:18:55.091210+0000","last_fullsized":"2024-09-10T23:18:55.091210+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:55.249106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068842+0000","last_change":"2024-09-10T23:18:55.068842+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068842+0000","last_undegraded":"2024-09-10T23:18:55.068842+0000","last_fullsized":"2024-09-10T23:18:55.068842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.084422+0000","last_change":"2024-09-10T23:18:55.081624+0000","last_active":"2024-09-10T23:18:55.084422+0000","last_peered":"2024-09-10T23:18:55.084422+0000","last_clean":"2024-09-10T23:18:55.084422+0000","last_became_active":"2024-09-10T23:18:55.080250+0000","last_became_peered":"2024-09-10T23:18:55.080250+0000","last_unstale":"2024-09-10T23:18:55.084422+0000","last_undegraded":"2024-09-10T23:18:55.084422+0000","last_fullsized":"2024-09-10T23:18:55.084422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:08.556811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.078689+0000","last_change":"2024-09-10T23:18:55.080384+0000","last_active":"2024-09-10T23:18:56.078689+0000","last_peered":"2024-09-10T23:18:56.078689+0000","last_clean":"2024-09-10T23:18:56.078689+0000","last_became_active":"2024-09-10T23:18:55.080119+0000","last_became_peered":"2024-09-10T23:18:55.080119+0000","last_unstale":"2024-09-10T23:18:56.078689+0000","last_undegraded":"2024-09-10T23:18:56.078689+0000","last_fullsized":"2024-09-10T23:18:56.078689+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:32.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068578+0000","last_change":"2024-09-10T23:18:55.068578+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068578+0000","last_undegraded":"2024-09-10T23:18:55.068578+0000","last_fullsized":"2024-09-10T23:18:55.068578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.086118+0000","last_change":"2024-09-10T23:18:55.081272+0000","last_active":"2024-09-10T23:18:55.086118+0000","last_peered":"2024-09-10T23:18:55.086118+0000","last_clean":"2024-09-10T23:18:55.086118+0000","last_became_active":"2024-09-10T23:18:55.080496+0000","last_became_peered":"2024-09-10T23:18:55.080496+0000","last_unstale":"2024-09-10T23:18:55.086118+0000","last_undegraded":"2024-09-10T23:18:55.086118+0000","last_fullsized":"2024-09-10T23:18:55.086118+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072158+0000","last_change":"2024-09-10T23:18:55.072158+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072158+0000","last_undegraded":"2024-09-10T23:18:55.072158+0000","last_fullsized":"2024-09-10T23:18:55.072158+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.086326+0000","last_change":"2024-09-10T23:18:55.084970+0000","last_active":"2024-09-10T23:18:55.086326+0000","last_peered":"2024-09-10T23:18:55.086326+0000","last_clean":"2024-09-10T23:18:55.086326+0000","last_became_active":"2024-09-10T23:18:55.084721+0000","last_became_peered":"2024-09-10T23:18:55.084721+0000","last_unstale":"2024-09-10T23:18:55.086326+0000","last_undegraded":"2024-09-10T23:18:55.086326+0000","last_fullsized":"2024-09-10T23:18:55.086326+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.907855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073322+0000","last_change":"2024-09-10T23:18:55.073322+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073322+0000","last_undegraded":"2024-09-10T23:18:55.073322+0000","last_fullsized":"2024-09-10T23:18:55.073322+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087234+0000","last_change":"2024-09-10T23:18:55.086081+0000","last_active":"2024-09-10T23:18:55.087234+0000","last_peered":"2024-09-10T23:18:55.087234+0000","last_clean":"2024-09-10T23:18:55.087234+0000","last_became_active":"2024-09-10T23:18:55.085795+0000","last_became_peered":"2024-09-10T23:18:55.085795+0000","last_unstale":"2024-09-10T23:18:55.087234+0000","last_undegraded":"2024-09-10T23:18:55.087234+0000","last_fullsized":"2024-09-10T23:18:55.087234+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:52.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072139+0000","last_change":"2024-09-10T23:18:55.072139+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072139+0000","last_undegraded":"2024-09-10T23:18:55.072139+0000","last_fullsized":"2024-09-10T23:18:55.072139+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083086+0000","last_change":"2024-09-10T23:18:55.079369+0000","last_active":"2024-09-10T23:18:55.083086+0000","last_peered":"2024-09-10T23:18:55.083086+0000","last_clean":"2024-09-10T23:18:55.083086+0000","last_became_active":"2024-09-10T23:18:55.079064+0000","last_became_peered":"2024-09-10T23:18:55.079064+0000","last_unstale":"2024-09-10T23:18:55.083086+0000","last_undegraded":"2024-09-10T23:18:55.083086+0000","last_fullsized":"2024-09-10T23:18:55.083086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:50.837310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072678+0000","last_change":"2024-09-10T23:18:55.072678+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072678+0000","last_undegraded":"2024-09-10T23:18:55.072678+0000","last_fullsized":"2024-09-10T23:18:55.072678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:54.053237+0000","last_change":"2024-09-10T23:18:54.053237+0000","last_active":"2024-09-10T23:18:54.053237+0000","last_peered":"2024-09-10T23:18:54.053237+0000","last_clean":"2024-09-10T23:18:54.053237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:54.053237+0000","last_undegraded":"2024-09-10T23:18:54.053237+0000","last_fullsized":"2024-09-10T23:18:54.053237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073583+0000","last_change":"2024-09-10T23:18:55.073583+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073583+0000","last_undegraded":"2024-09-10T23:18:55.073583+0000","last_fullsized":"2024-09-10T23:18:55.073583+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087020+0000","last_change":"2024-09-10T23:18:55.081652+0000","last_active":"2024-09-10T23:18:55.087020+0000","last_peered":"2024-09-10T23:18:55.087020+0000","last_clean":"2024-09-10T23:18:55.087020+0000","last_became_active":"2024-09-10T23:18:55.081354+0000","last_became_peered":"2024-09-10T23:18:55.081354+0000","last_unstale":"2024-09-10T23:18:55.087020+0000","last_undegraded":"2024-09-10T23:18:55.087020+0000","last_fullsized":"2024-09-10T23:18:55.087020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:09.389758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073080+0000","last_change":"2024-09-10T23:18:55.073080+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073080+0000","last_undegraded":"2024-09-10T23:18:55.073080+0000","last_fullsized":"2024-09-10T23:18:55.073080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.079089+0000","last_change":"2024-09-10T23:18:55.091463+0000","last_active":"2024-09-10T23:18:56.079089+0000","last_peered":"2024-09-10T23:18:56.079089+0000","last_clean":"2024-09-10T23:18:56.079089+0000","last_became_active":"2024-09-10T23:18:55.091157+0000","last_became_peered":"2024-09-10T23:18:55.091157+0000","last_unstale":"2024-09-10T23:18:56.079089+0000","last_undegraded":"2024-09-10T23:18:56.079089+0000","last_fullsized":"2024-09-10T23:18:56.079089+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083179+0000","last_change":"2024-09-10T23:18:55.079923+0000","last_active":"2024-09-10T23:18:55.083179+0000","last_peered":"2024-09-10T23:18:55.083179+0000","last_clean":"2024-09-10T23:18:55.083179+0000","last_became_active":"2024-09-10T23:18:55.079648+0000","last_became_peered":"2024-09-10T23:18:55.079648+0000","last_unstale":"2024-09-10T23:18:55.083179+0000","last_undegraded":"2024-09-10T23:18:55.083179+0000","last_fullsized":"2024-09-10T23:18:55.083179+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.014724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.076098+0000","last_change":"2024-09-10T23:18:55.076098+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.076098+0000","last_undegraded":"2024-09-10T23:18:55.076098+0000","last_fullsized":"2024-09-10T23:18:55.076098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:54.053237+0000","last_change":"2024-09-10T23:18:54.053237+0000","last_active":"2024-09-10T23:18:54.053237+0000","last_peered":"2024-09-10T23:18:54.053237+0000","last_clean":"2024-09-10T23:18:54.053237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:54.053237+0000","last_undegraded":"2024-09-10T23:18:54.053237+0000","last_fullsized":"2024-09-10T23:18:54.053237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.091968+0000","last_change":"2024-09-10T23:18:55.091422+0000","last_active":"2024-09-10T23:18:55.091968+0000","last_peered":"2024-09-10T23:18:55.091968+0000","last_clean":"2024-09-10T23:18:55.091968+0000","last_became_active":"2024-09-10T23:18:55.091111+0000","last_became_peered":"2024-09-10T23:18:55.091111+0000","last_unstale":"2024-09-10T23:18:55.091968+0000","last_undegraded":"2024-09-10T23:18:55.091968+0000","last_fullsized":"2024-09-10T23:18:55.091968+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:50.837310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068741+0000","last_change":"2024-09-10T23:18:55.068741+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068741+0000","last_undegraded":"2024-09-10T23:18:55.068741+0000","last_fullsized":"2024-09-10T23:18:55.068741+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.082029+0000","last_change":"2024-09-10T23:18:55.080290+0000","last_active":"2024-09-10T23:18:55.082029+0000","last_peered":"2024-09-10T23:18:55.082029+0000","last_clean":"2024-09-10T23:18:55.082029+0000","last_became_active":"2024-09-10T23:18:55.080019+0000","last_became_peered":"2024-09-10T23:18:55.080019+0000","last_unstale":"2024-09-10T23:18:55.082029+0000","last_undegraded":"2024-09-10T23:18:55.082029+0000","last_fullsized":"2024-09-10T23:18:55.082029+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:36.377631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072563+0000","last_change":"2024-09-10T23:18:55.072563+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072563+0000","last_undegraded":"2024-09-10T23:18:55.072563+0000","last_fullsized":"2024-09-10T23:18:55.072563+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.107369+0000","last_change":"2024-09-10T23:18:55.082244+0000","last_active":"2024-09-10T23:18:56.107369+0000","last_peered":"2024-09-10T23:18:56.107369+0000","last_clean":"2024-09-10T23:18:56.107369+0000","last_became_active":"2024-09-10T23:18:55.081844+0000","last_became_peered":"2024-09-10T23:18:55.081844+0000","last_unstale":"2024-09-10T23:18:56.107369+0000","last_undegraded":"2024-09-10T23:18:56.107369+0000","last_fullsized":"2024-09-10T23:18:56.107369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:25.835051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068603+0000","last_change":"2024-09-10T23:18:55.068603+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068603+0000","last_undegraded":"2024-09-10T23:18:55.068603+0000","last_fullsized":"2024-09-10T23:18:55.068603+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.078959+0000","last_change":"2024-09-10T23:18:55.091669+0000","last_active":"2024-09-10T23:18:56.078959+0000","last_peered":"2024-09-10T23:18:56.078959+0000","last_clean":"2024-09-10T23:18:56.078959+0000","last_became_active":"2024-09-10T23:18:55.091385+0000","last_became_peered":"2024-09-10T23:18:55.091385+0000","last_unstale":"2024-09-10T23:18:56.078959+0000","last_undegraded":"2024-09-10T23:18:56.078959+0000","last_fullsized":"2024-09-10T23:18:56.078959+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073155+0000","last_change":"2024-09-10T23:18:55.073155+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073155+0000","last_undegraded":"2024-09-10T23:18:55.073155+0000","last_fullsized":"2024-09-10T23:18:55.073155+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083341+0000","last_change":"2024-09-10T23:18:55.079031+0000","last_active":"2024-09-10T23:18:55.083341+0000","last_peered":"2024-09-10T23:18:55.083341+0000","last_clean":"2024-09-10T23:18:55.083341+0000","last_became_active":"2024-09-10T23:18:55.078641+0000","last_became_peered":"2024-09-10T23:18:55.078641+0000","last_unstale":"2024-09-10T23:18:55.083341+0000","last_undegraded":"2024-09-10T23:18:55.083341+0000","last_fullsized":"2024-09-10T23:18:55.083341+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:51.206282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.083932+0000","last_change":"2024-09-10T23:18:56.081745+0000","last_active":"2024-09-10T23:18:56.083932+0000","last_peered":"2024-09-10T23:18:56.083932+0000","last_clean":"2024-09-10T23:18:56.083932+0000","last_became_active":"2024-09-10T23:18:56.081423+0000","last_became_peered":"2024-09-10T23:18:56.081423+0000","last_unstale":"2024-09-10T23:18:56.083932+0000","last_undegraded":"2024-09-10T23:18:56.083932+0000","last_fullsized":"2024-09-10T23:18:56.083932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:31.869620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:54.053237+0000","last_change":"2024-09-10T23:18:54.053237+0000","last_active":"2024-09-10T23:18:54.053237+0000","last_peered":"2024-09-10T23:18:54.053237+0000","last_clean":"2024-09-10T23:18:54.053237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:54.053237+0000","last_undegraded":"2024-09-10T23:18:54.053237+0000","last_fullsized":"2024-09-10T23:18:54.053237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.070473+0000","last_change":"2024-09-10T23:18:55.070473+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.070473+0000","last_undegraded":"2024-09-10T23:18:55.070473+0000","last_fullsized":"2024-09-10T23:18:55.070473+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.089816+0000","last_change":"2024-09-10T23:18:55.084173+0000","last_active":"2024-09-10T23:18:55.089816+0000","last_peered":"2024-09-10T23:18:55.089816+0000","last_clean":"2024-09-10T23:18:55.089816+0000","last_became_active":"2024-09-10T23:18:55.083904+0000","last_became_peered":"2024-09-10T23:18:55.083904+0000","last_unstale":"2024-09-10T23:18:55.089816+0000","last_undegraded":"2024-09-10T23:18:55.089816+0000","last_fullsized":"2024-09-10T23:18:55.089816+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:48.864860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.069979+0000","last_change":"2024-09-10T23:18:55.069979+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.069979+0000","last_undegraded":"2024-09-10T23:18:55.069979+0000","last_fullsized":"2024-09-10T23:18:55.069979+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.089311+0000","last_change":"2024-09-10T23:18:55.086839+0000","last_active":"2024-09-10T23:18:55.089311+0000","last_peered":"2024-09-10T23:18:55.089311+0000","last_clean":"2024-09-10T23:18:55.089311+0000","last_became_active":"2024-09-10T23:18:55.086582+0000","last_became_peered":"2024-09-10T23:18:55.086582+0000","last_unstale":"2024-09-10T23:18:55.089311+0000","last_undegraded":"2024-09-10T23:18:55.089311+0000","last_fullsized":"2024-09-10T23:18:55.089311+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:33:32.018706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073726+0000","last_change":"2024-09-10T23:18:55.073726+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073726+0000","last_undegraded":"2024-09-10T23:18:55.073726+0000","last_fullsized":"2024-09-10T23:18:55.073726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.103955+0000","last_change":"2024-09-10T23:18:55.088646+0000","last_active":"2024-09-10T23:18:56.103955+0000","last_peered":"2024-09-10T23:18:56.103955+0000","last_clean":"2024-09-10T23:18:56.103955+0000","last_became_active":"2024-09-10T23:18:55.088302+0000","last_became_peered":"2024-09-10T23:18:55.088302+0000","last_unstale":"2024-09-10T23:18:56.103955+0000","last_undegraded":"2024-09-10T23:18:56.103955+0000","last_fullsized":"2024-09-10T23:18:56.103955+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:45.168297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.069137+0000","last_change":"2024-09-10T23:18:55.069137+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.069137+0000","last_undegraded":"2024-09-10T23:18:55.069137+0000","last_fullsized":"2024-09-10T23:18:55.069137+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087193+0000","last_change":"2024-09-10T23:18:55.086447+0000","last_active":"2024-09-10T23:18:55.087193+0000","last_peered":"2024-09-10T23:18:55.087193+0000","last_clean":"2024-09-10T23:18:55.087193+0000","last_became_active":"2024-09-10T23:18:55.086061+0000","last_became_peered":"2024-09-10T23:18:55.086061+0000","last_unstale":"2024-09-10T23:18:55.087193+0000","last_undegraded":"2024-09-10T23:18:55.087193+0000","last_fullsized":"2024-09-10T23:18:55.087193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:16.766558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.091006+0000","last_change":"2024-09-10T23:18:55.087429+0000","last_active":"2024-09-10T23:18:55.091006+0000","last_peered":"2024-09-10T23:18:55.091006+0000","last_clean":"2024-09-10T23:18:55.091006+0000","last_became_active":"2024-09-10T23:18:55.084677+0000","last_became_peered":"2024-09-10T23:18:55.084677+0000","last_unstale":"2024-09-10T23:18:55.091006+0000","last_undegraded":"2024-09-10T23:18:55.091006+0000","last_fullsized":"2024-09-10T23:18:55.091006+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:06.961852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.071525+0000","last_change":"2024-09-10T23:18:55.071525+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.071525+0000","last_undegraded":"2024-09-10T23:18:55.071525+0000","last_fullsized":"2024-09-10T23:18:55.071525+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:54.053237+0000","last_change":"2024-09-10T23:18:54.053237+0000","last_active":"2024-09-10T23:18:54.053237+0000","last_peered":"2024-09-10T23:18:54.053237+0000","last_clean":"2024-09-10T23:18:54.053237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:54.053237+0000","last_undegraded":"2024-09-10T23:18:54.053237+0000","last_fullsized":"2024-09-10T23:18:54.053237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.074071+0000","last_change":"2024-09-10T23:18:55.074071+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.074071+0000","last_undegraded":"2024-09-10T23:18:55.074071+0000","last_fullsized":"2024-09-10T23:18:55.074071+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:54.053237+0000","last_change":"2024-09-10T23:18:54.053237+0000","last_active":"2024-09-10T23:18:54.053237+0000","last_peered":"2024-09-10T23:18:54.053237+0000","last_clean":"2024-09-10T23:18:54.053237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:54.053237+0000","last_undegraded":"2024-09-10T23:18:54.053237+0000","last_fullsized":"2024-09-10T23:18:54.053237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.075464+0000","last_change":"2024-09-10T23:18:55.075464+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.075464+0000","last_undegraded":"2024-09-10T23:18:55.075464+0000","last_fullsized":"2024-09-10T23:18:55.075464+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.092837+0000","last_change":"2024-09-10T23:18:55.092277+0000","last_active":"2024-09-10T23:18:55.092837+0000","last_peered":"2024-09-10T23:18:55.092837+0000","last_clean":"2024-09-10T23:18:55.092837+0000","last_became_active":"2024-09-10T23:18:55.092026+0000","last_became_peered":"2024-09-10T23:18:55.092026+0000","last_unstale":"2024-09-10T23:18:55.092837+0000","last_undegraded":"2024-09-10T23:18:55.092837+0000","last_fullsized":"2024-09-10T23:18:55.092837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:56.711683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:18:55.056243+0000","last_change":"2024-09-10T23:18:55.056243+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.056243+0000","last_undegraded":"2024-09-10T23:18:55.056243+0000","last_fullsized":"2024-09-10T23:18:55.056243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.084268+0000","last_change":"2024-09-10T23:18:55.083197+0000","last_active":"2024-09-10T23:18:55.084268+0000","last_peered":"2024-09-10T23:18:55.084268+0000","last_clean":"2024-09-10T23:18:55.084268+0000","last_became_active":"2024-09-10T23:18:55.082785+0000","last_became_peered":"2024-09-10T23:18:55.082785+0000","last_unstale":"2024-09-10T23:18:55.084268+0000","last_undegraded":"2024-09-10T23:18:55.084268+0000","last_fullsized":"2024-09-10T23:18:55.084268+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:11.135623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.089696+0000","last_change":"2024-09-10T23:18:56.085814+0000","last_active":"2024-09-10T23:18:56.089696+0000","last_peered":"2024-09-10T23:18:56.089696+0000","last_clean":"2024-09-10T23:18:56.089696+0000","last_became_active":"2024-09-10T23:18:56.085558+0000","last_became_peered":"2024-09-10T23:18:56.085558+0000","last_unstale":"2024-09-10T23:18:56.089696+0000","last_undegraded":"2024-09-10T23:18:56.089696+0000","last_fullsized":"2024-09-10T23:18:56.089696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:07.964858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.085643+0000","last_change":"2024-09-10T23:18:55.079748+0000","last_active":"2024-09-10T23:18:55.085643+0000","last_peered":"2024-09-10T23:18:55.085643+0000","last_clean":"2024-09-10T23:18:55.085643+0000","last_became_active":"2024-09-10T23:18:55.079369+0000","last_became_peered":"2024-09-10T23:18:55.079369+0000","last_unstale":"2024-09-10T23:18:55.085643+0000","last_undegraded":"2024-09-10T23:18:55.085643+0000","last_fullsized":"2024-09-10T23:18:55.085643+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":171,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.069675+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:18:55.069675+0000","last_peered":"2024-09-10T23:18:55.069675+0000","last_clean":"2024-09-10T23:18:55.069675+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:18:55.069675+0000","last_undegraded":"2024-09-10T23:18:55.069675+0000","last_fullsized":"2024-09-10T23:18:55.069675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476781,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40168,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331672,"statfs":{"total":96636764160,"available":96595632128,"internally_reserved":0,"allocated":667648,"data_stored":293101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46292,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325548,"statfs":{"total":96636764160,"available":96589361152,"internally_reserved":0,"allocated":1241088,"data_stored":875650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40136,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331704,"statfs":{"total":96636764160,"available":96595664896,"internally_reserved":0,"allocated":634880,"data_stored":278615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62352,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309488,"statfs":{"total":96636764160,"available":96572915712,"internally_reserved":0,"allocated":647168,"data_stored":285282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40144,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331696,"statfs":{"total":96636764160,"available":96595656704,"internally_reserved":0,"allocated":647168,"data_stored":285282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40140,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331700,"statfs":{"total":96636764160,"available":96595660800,"internally_reserved":0,"allocated":647168,"data_stored":285282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509485,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50436,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321404,"statfs":{"total":96636764160,"available":96585117696,"internally_reserved":0,"allocated":1228800,"data_stored":868983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":622592,"data_stored":272406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:00.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 -- 172.21.15.17:0/1957442987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160660 msgr2=0x7f94ec0d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 --2- 172.21.15.17:0/1957442987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160660 0x7f94ec0d0030 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f94e4009c80 tx=0x7f94e401f5a0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 -- 172.21.15.17:0/1957442987 shutdown_connections 2024-09-10T23:19:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 --2- 172.21.15.17:0/1957442987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160660 0x7f94ec0d0030 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 --2- 172.21.15.17:0/1957442987 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94ec160280 0x7f94ec0cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 -- 172.21.15.17:0/1957442987 >> 172.21.15.17:0/1957442987 conn(0x7f94ec0d1d10 msgr2=0x7f94ec0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 -- 172.21.15.17:0/1957442987 shutdown_connections 2024-09-10T23:19:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 -- 172.21.15.17:0/1957442987 wait complete. 2024-09-10T23:19:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 Processor -- start 2024-09-10T23:19:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 -- start start 2024-09-10T23:19:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94ec0d2830 0x7f94ec155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160280 0x7f94ec159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec160660 0x7f94ec0ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec0afe30 con 0x7f94ec160280 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec0afcb0 con 0x7f94ec160660 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f4600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec0affb0 con 0x7f94ec0d2830 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160280 0x7f94ec159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160280 0x7f94ec159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39432/0 (socket says 172.21.15.17:39432) 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f1200640 1 -- 172.21.15.17:0/3443978098 learned_addr learned my addr 172.21.15.17:0/3443978098 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f2600640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec160660 0x7f94ec0ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.409+0000 7f94f1c00640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94ec0d2830 0x7f94ec155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94f1200640 1 -- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94ec0d2830 msgr2=0x7f94ec155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94f1200640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94ec0d2830 0x7f94ec155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94f1200640 1 -- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec160660 msgr2=0x7f94ec0ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94f1200640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec160660 0x7f94ec0ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94f1200640 1 -- 172.21.15.17:0/3443978098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec15a7f0 con 0x7f94ec160280 2024-09-10T23:19:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94f1200640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160280 0x7f94ec159d50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f94d800c440 tx=0x7f94d800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94e9600640 1 -- 172.21.15.17:0/3443978098 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011790 con 0x7f94ec160280 2024-09-10T23:19:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94e9600640 1 -- 172.21.15.17:0/3443978098 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94d8017070 con 0x7f94ec160280 2024-09-10T23:19:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94e9600640 1 -- 172.21.15.17:0/3443978098 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011cc0 con 0x7f94ec160280 2024-09-10T23:19:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec15bc50 con 0x7f94ec160280 2024-09-10T23:19:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec15c1d0 con 0x7f94ec160280 2024-09-10T23:19:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ec0b04a0 con 0x7f94ec160280 2024-09-10T23:19:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.413+0000 7f94e9600640 1 -- 172.21.15.17:0/3443978098 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f94d801c460 con 0x7f94ec160280 2024-09-10T23:19:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.417+0000 7f94e9600640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94cc0725e0 0x7f94cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.417+0000 7f94e9600640 1 -- 172.21.15.17:0/3443978098 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f94d8093180 con 0x7f94ec160280 2024-09-10T23:19:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.417+0000 7f94f1c00640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94cc0725e0 0x7f94cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.417+0000 7f94f1c00640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94cc0725e0 0x7f94cc074aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94e000bc00 tx=0x7f94e000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:00.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.417+0000 7f94e9600640 1 -- 172.21.15.17:0/3443978098 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f94ec15a7f0 con 0x7f94ec160280 2024-09-10T23:19:00.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.589+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94ec074af0 con 0x7f94cc0725e0 2024-09-10T23:19:00.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.593+0000 7f94e9600640 1 -- 172.21.15.17:0/3443978098 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250878 (secure 0 0 0) 0x7f94ec074af0 con 0x7f94cc0725e0 2024-09-10T23:19:00.602 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:00.603 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:19:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94cc0725e0 msgr2=0x7f94cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94cc0725e0 0x7f94cc074aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94e000bc00 tx=0x7f94e000b390 comp rx=0 tx=0).stop 2024-09-10T23:19:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160280 msgr2=0x7f94ec159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160280 0x7f94ec159d50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f94d800c440 tx=0x7f94d800c900 comp rx=0 tx=0).stop 2024-09-10T23:19:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 shutdown_connections 2024-09-10T23:19:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94cc0725e0 0x7f94cc074aa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94ec160660 0x7f94ec0ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94ec160280 0x7f94ec159d50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 --2- 172.21.15.17:0/3443978098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94ec0d2830 0x7f94ec155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 >> 172.21.15.17:0/3443978098 conn(0x7f94ec0d1d10 msgr2=0x7f94ec0b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:00.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 shutdown_connections 2024-09-10T23:19:00.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.597+0000 7f94f4600640 1 -- 172.21.15.17:0/3443978098 wait complete. 2024-09-10T23:19:00.622 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-10T23:19:00.340135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347512,"kb_used_data":6388,"kb_used_omap":12,"kb_used_meta":340915,"kb_avail":754627208,"statfs":{"total":773094113280,"available":772738260992,"internally_reserved":0,"allocated":6541312,"data_stored":3536876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":349097521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001489"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078714+0000","last_change":"2024-09-10T23:18:56.090512+0000","last_active":"2024-09-10T23:18:57.078714+0000","last_peered":"2024-09-10T23:18:57.078714+0000","last_clean":"2024-09-10T23:18:57.078714+0000","last_became_active":"2024-09-10T23:18:56.089868+0000","last_became_peered":"2024-09-10T23:18:56.089868+0000","last_unstale":"2024-09-10T23:18:57.078714+0000","last_undegraded":"2024-09-10T23:18:57.078714+0000","last_fullsized":"2024-09-10T23:18:57.078714+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.364072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.069301+0000","last_change":"2024-09-10T23:18:55.069301+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.069301+0000","last_undegraded":"2024-09-10T23:18:55.069301+0000","last_fullsized":"2024-09-10T23:18:55.069301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082065+0000","last_change":"2024-09-10T23:18:56.104813+0000","last_active":"2024-09-10T23:18:57.082065+0000","last_peered":"2024-09-10T23:18:57.082065+0000","last_clean":"2024-09-10T23:18:57.082065+0000","last_became_active":"2024-09-10T23:18:56.103322+0000","last_became_peered":"2024-09-10T23:18:56.103322+0000","last_unstale":"2024-09-10T23:18:57.082065+0000","last_undegraded":"2024-09-10T23:18:57.082065+0000","last_fullsized":"2024-09-10T23:18:57.082065+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:27.592000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068548+0000","last_change":"2024-09-10T23:18:55.068548+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068548+0000","last_undegraded":"2024-09-10T23:18:55.068548+0000","last_fullsized":"2024-09-10T23:18:55.068548+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073139+0000","last_change":"2024-09-10T23:18:55.073139+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073139+0000","last_undegraded":"2024-09-10T23:18:55.073139+0000","last_fullsized":"2024-09-10T23:18:55.073139+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078393+0000","last_change":"2024-09-10T23:18:56.089275+0000","last_active":"2024-09-10T23:18:57.078393+0000","last_peered":"2024-09-10T23:18:57.078393+0000","last_clean":"2024-09-10T23:18:57.078393+0000","last_became_active":"2024-09-10T23:18:56.089026+0000","last_became_peered":"2024-09-10T23:18:56.089026+0000","last_unstale":"2024-09-10T23:18:57.078393+0000","last_undegraded":"2024-09-10T23:18:57.078393+0000","last_fullsized":"2024-09-10T23:18:57.078393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:45.067514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081381+0000","last_change":"2024-09-10T23:18:56.102567+0000","last_active":"2024-09-10T23:18:57.081381+0000","last_peered":"2024-09-10T23:18:57.081381+0000","last_clean":"2024-09-10T23:18:57.081381+0000","last_became_active":"2024-09-10T23:18:56.102253+0000","last_became_peered":"2024-09-10T23:18:56.102253+0000","last_unstale":"2024-09-10T23:18:57.081381+0000","last_undegraded":"2024-09-10T23:18:57.081381+0000","last_fullsized":"2024-09-10T23:18:57.081381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:09.674355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304376+0000","last_change":"2024-09-10T23:18:56.082157+0000","last_active":"2024-09-10T23:18:58.304376+0000","last_peered":"2024-09-10T23:18:58.304376+0000","last_clean":"2024-09-10T23:18:58.304376+0000","last_became_active":"2024-09-10T23:18:56.081716+0000","last_became_peered":"2024-09-10T23:18:56.081716+0000","last_unstale":"2024-09-10T23:18:58.304376+0000","last_undegraded":"2024-09-10T23:18:58.304376+0000","last_fullsized":"2024-09-10T23:18:58.304376+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:53.382284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303880+0000","last_change":"2024-09-10T23:18:56.089945+0000","last_active":"2024-09-10T23:18:58.303880+0000","last_peered":"2024-09-10T23:18:58.303880+0000","last_clean":"2024-09-10T23:18:58.303880+0000","last_became_active":"2024-09-10T23:18:56.089450+0000","last_became_peered":"2024-09-10T23:18:56.089450+0000","last_unstale":"2024-09-10T23:18:58.303880+0000","last_undegraded":"2024-09-10T23:18:58.303880+0000","last_fullsized":"2024-09-10T23:18:58.303880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:55.404482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078682+0000","last_change":"2024-09-10T23:18:56.087156+0000","last_active":"2024-09-10T23:18:57.078682+0000","last_peered":"2024-09-10T23:18:57.078682+0000","last_clean":"2024-09-10T23:18:57.078682+0000","last_became_active":"2024-09-10T23:18:56.086901+0000","last_became_peered":"2024-09-10T23:18:56.086901+0000","last_unstale":"2024-09-10T23:18:57.078682+0000","last_undegraded":"2024-09-10T23:18:57.078682+0000","last_fullsized":"2024-09-10T23:18:57.078682+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:24.643459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303591+0000","last_change":"2024-09-10T23:18:56.097512+0000","last_active":"2024-09-10T23:18:58.303591+0000","last_peered":"2024-09-10T23:18:58.303591+0000","last_clean":"2024-09-10T23:18:58.303591+0000","last_became_active":"2024-09-10T23:18:56.097259+0000","last_became_peered":"2024-09-10T23:18:56.097259+0000","last_unstale":"2024-09-10T23:18:58.303591+0000","last_undegraded":"2024-09-10T23:18:58.303591+0000","last_fullsized":"2024-09-10T23:18:58.303591+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:54.682126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304143+0000","last_change":"2024-09-10T23:18:56.092902+0000","last_active":"2024-09-10T23:18:58.304143+0000","last_peered":"2024-09-10T23:18:58.304143+0000","last_clean":"2024-09-10T23:18:58.304143+0000","last_became_active":"2024-09-10T23:18:56.092627+0000","last_became_peered":"2024-09-10T23:18:56.092627+0000","last_unstale":"2024-09-10T23:18:58.304143+0000","last_undegraded":"2024-09-10T23:18:58.304143+0000","last_fullsized":"2024-09-10T23:18:58.304143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:24.288734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078475+0000","last_change":"2024-09-10T23:18:56.091763+0000","last_active":"2024-09-10T23:18:57.078475+0000","last_peered":"2024-09-10T23:18:57.078475+0000","last_clean":"2024-09-10T23:18:57.078475+0000","last_became_active":"2024-09-10T23:18:56.091453+0000","last_became_peered":"2024-09-10T23:18:56.091453+0000","last_unstale":"2024-09-10T23:18:57.078475+0000","last_undegraded":"2024-09-10T23:18:57.078475+0000","last_fullsized":"2024-09-10T23:18:57.078475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:12.394587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081507+0000","last_change":"2024-09-10T23:18:56.098733+0000","last_active":"2024-09-10T23:18:57.081507+0000","last_peered":"2024-09-10T23:18:57.081507+0000","last_clean":"2024-09-10T23:18:57.081507+0000","last_became_active":"2024-09-10T23:18:56.095590+0000","last_became_peered":"2024-09-10T23:18:56.095590+0000","last_unstale":"2024-09-10T23:18:57.081507+0000","last_undegraded":"2024-09-10T23:18:57.081507+0000","last_fullsized":"2024-09-10T23:18:57.081507+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:36.226548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068498+0000","last_change":"2024-09-10T23:18:55.068498+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068498+0000","last_undegraded":"2024-09-10T23:18:55.068498+0000","last_fullsized":"2024-09-10T23:18:55.068498+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078185+0000","last_change":"2024-09-10T23:18:56.086441+0000","last_active":"2024-09-10T23:18:57.078185+0000","last_peered":"2024-09-10T23:18:57.078185+0000","last_clean":"2024-09-10T23:18:57.078185+0000","last_became_active":"2024-09-10T23:18:56.086241+0000","last_became_peered":"2024-09-10T23:18:56.086241+0000","last_unstale":"2024-09-10T23:18:57.078185+0000","last_undegraded":"2024-09-10T23:18:57.078185+0000","last_fullsized":"2024-09-10T23:18:57.078185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.947052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082783+0000","last_change":"2024-09-10T23:18:56.085163+0000","last_active":"2024-09-10T23:18:57.082783+0000","last_peered":"2024-09-10T23:18:57.082783+0000","last_clean":"2024-09-10T23:18:57.082783+0000","last_became_active":"2024-09-10T23:18:56.084615+0000","last_became_peered":"2024-09-10T23:18:56.084615+0000","last_unstale":"2024-09-10T23:18:57.082783+0000","last_undegraded":"2024-09-10T23:18:57.082783+0000","last_fullsized":"2024-09-10T23:18:57.082783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:33.804083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068869+0000","last_change":"2024-09-10T23:18:55.068869+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068869+0000","last_undegraded":"2024-09-10T23:18:55.068869+0000","last_fullsized":"2024-09-10T23:18:55.068869+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082097+0000","last_change":"2024-09-10T23:18:56.071603+0000","last_active":"2024-09-10T23:18:57.082097+0000","last_peered":"2024-09-10T23:18:57.082097+0000","last_clean":"2024-09-10T23:18:57.082097+0000","last_became_active":"2024-09-10T23:18:56.071266+0000","last_became_peered":"2024-09-10T23:18:56.071266+0000","last_unstale":"2024-09-10T23:18:57.082097+0000","last_undegraded":"2024-09-10T23:18:57.082097+0000","last_fullsized":"2024-09-10T23:18:57.082097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:23.999216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.083743+0000","last_change":"2024-09-10T23:18:56.081732+0000","last_active":"2024-09-10T23:18:56.083743+0000","last_peered":"2024-09-10T23:18:56.083743+0000","last_clean":"2024-09-10T23:18:56.083743+0000","last_became_active":"2024-09-10T23:18:56.081395+0000","last_became_peered":"2024-09-10T23:18:56.081395+0000","last_unstale":"2024-09-10T23:18:56.083743+0000","last_undegraded":"2024-09-10T23:18:56.083743+0000","last_fullsized":"2024-09-10T23:18:56.083743+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:10.392764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.094299+0000","last_change":"2024-09-10T23:18:56.092352+0000","last_active":"2024-09-10T23:18:56.094299+0000","last_peered":"2024-09-10T23:18:56.094299+0000","last_clean":"2024-09-10T23:18:56.094299+0000","last_became_active":"2024-09-10T23:18:56.092077+0000","last_became_peered":"2024-09-10T23:18:56.092077+0000","last_unstale":"2024-09-10T23:18:56.094299+0000","last_undegraded":"2024-09-10T23:18:56.094299+0000","last_fullsized":"2024-09-10T23:18:56.094299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:51.840316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303137+0000","last_change":"2024-09-10T23:18:56.088908+0000","last_active":"2024-09-10T23:18:58.303137+0000","last_peered":"2024-09-10T23:18:58.303137+0000","last_clean":"2024-09-10T23:18:58.303137+0000","last_became_active":"2024-09-10T23:18:56.088628+0000","last_became_peered":"2024-09-10T23:18:56.088628+0000","last_unstale":"2024-09-10T23:18:58.303137+0000","last_undegraded":"2024-09-10T23:18:58.303137+0000","last_fullsized":"2024-09-10T23:18:58.303137+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:32.936954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303115+0000","last_change":"2024-09-10T23:18:56.097569+0000","last_active":"2024-09-10T23:18:58.303115+0000","last_peered":"2024-09-10T23:18:58.303115+0000","last_clean":"2024-09-10T23:18:58.303115+0000","last_became_active":"2024-09-10T23:18:56.097237+0000","last_became_peered":"2024-09-10T23:18:56.097237+0000","last_unstale":"2024-09-10T23:18:58.303115+0000","last_undegraded":"2024-09-10T23:18:58.303115+0000","last_fullsized":"2024-09-10T23:18:58.303115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:03.488812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081320+0000","last_change":"2024-09-10T23:18:56.088747+0000","last_active":"2024-09-10T23:18:57.081320+0000","last_peered":"2024-09-10T23:18:57.081320+0000","last_clean":"2024-09-10T23:18:57.081320+0000","last_became_active":"2024-09-10T23:18:56.088010+0000","last_became_peered":"2024-09-10T23:18:56.088010+0000","last_unstale":"2024-09-10T23:18:57.081320+0000","last_undegraded":"2024-09-10T23:18:57.081320+0000","last_fullsized":"2024-09-10T23:18:57.081320+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:13.725585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082898+0000","last_change":"2024-09-10T23:18:56.092590+0000","last_active":"2024-09-10T23:18:57.082898+0000","last_peered":"2024-09-10T23:18:57.082898+0000","last_clean":"2024-09-10T23:18:57.082898+0000","last_became_active":"2024-09-10T23:18:56.092231+0000","last_became_peered":"2024-09-10T23:18:56.092231+0000","last_unstale":"2024-09-10T23:18:57.082898+0000","last_undegraded":"2024-09-10T23:18:57.082898+0000","last_fullsized":"2024-09-10T23:18:57.082898+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:52.814090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303636+0000","last_change":"2024-09-10T23:18:56.099351+0000","last_active":"2024-09-10T23:18:58.303636+0000","last_peered":"2024-09-10T23:18:58.303636+0000","last_clean":"2024-09-10T23:18:58.303636+0000","last_became_active":"2024-09-10T23:18:56.099073+0000","last_became_peered":"2024-09-10T23:18:56.099073+0000","last_unstale":"2024-09-10T23:18:58.303636+0000","last_undegraded":"2024-09-10T23:18:58.303636+0000","last_fullsized":"2024-09-10T23:18:58.303636+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:28.433276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078463+0000","last_change":"2024-09-10T23:18:56.084874+0000","last_active":"2024-09-10T23:18:57.078463+0000","last_peered":"2024-09-10T23:18:57.078463+0000","last_clean":"2024-09-10T23:18:57.078463+0000","last_became_active":"2024-09-10T23:18:56.084613+0000","last_became_peered":"2024-09-10T23:18:56.084613+0000","last_unstale":"2024-09-10T23:18:57.078463+0000","last_undegraded":"2024-09-10T23:18:57.078463+0000","last_fullsized":"2024-09-10T23:18:57.078463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:36.008049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.100383+0000","last_change":"2024-09-10T23:18:56.098682+0000","last_active":"2024-09-10T23:18:56.100383+0000","last_peered":"2024-09-10T23:18:56.100383+0000","last_clean":"2024-09-10T23:18:56.100383+0000","last_became_active":"2024-09-10T23:18:56.098439+0000","last_became_peered":"2024-09-10T23:18:56.098439+0000","last_unstale":"2024-09-10T23:18:56.100383+0000","last_undegraded":"2024-09-10T23:18:56.100383+0000","last_fullsized":"2024-09-10T23:18:56.100383+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:14.017730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081881+0000","last_change":"2024-09-10T23:18:56.082038+0000","last_active":"2024-09-10T23:18:57.081881+0000","last_peered":"2024-09-10T23:18:57.081881+0000","last_clean":"2024-09-10T23:18:57.081881+0000","last_became_active":"2024-09-10T23:18:56.081318+0000","last_became_peered":"2024-09-10T23:18:56.081318+0000","last_unstale":"2024-09-10T23:18:57.081881+0000","last_undegraded":"2024-09-10T23:18:57.081881+0000","last_fullsized":"2024-09-10T23:18:57.081881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:04.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068588+0000","last_change":"2024-09-10T23:18:55.068588+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068588+0000","last_undegraded":"2024-09-10T23:18:55.068588+0000","last_fullsized":"2024-09-10T23:18:55.068588+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081432+0000","last_change":"2024-09-10T23:18:56.095428+0000","last_active":"2024-09-10T23:18:57.081432+0000","last_peered":"2024-09-10T23:18:57.081432+0000","last_clean":"2024-09-10T23:18:57.081432+0000","last_became_active":"2024-09-10T23:18:56.095142+0000","last_became_peered":"2024-09-10T23:18:56.095142+0000","last_unstale":"2024-09-10T23:18:57.081432+0000","last_undegraded":"2024-09-10T23:18:57.081432+0000","last_fullsized":"2024-09-10T23:18:57.081432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:29.469274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304783+0000","last_change":"2024-09-10T23:18:56.094564+0000","last_active":"2024-09-10T23:18:58.304783+0000","last_peered":"2024-09-10T23:18:58.304783+0000","last_clean":"2024-09-10T23:18:58.304783+0000","last_became_active":"2024-09-10T23:18:56.093925+0000","last_became_peered":"2024-09-10T23:18:56.093925+0000","last_unstale":"2024-09-10T23:18:58.304783+0000","last_undegraded":"2024-09-10T23:18:58.304783+0000","last_fullsized":"2024-09-10T23:18:58.304783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:19.401580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068498+0000","last_change":"2024-09-10T23:18:55.068498+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068498+0000","last_undegraded":"2024-09-10T23:18:55.068498+0000","last_fullsized":"2024-09-10T23:18:55.068498+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.101813+0000","last_change":"2024-09-10T23:18:55.084728+0000","last_active":"2024-09-10T23:18:56.101813+0000","last_peered":"2024-09-10T23:18:56.101813+0000","last_clean":"2024-09-10T23:18:56.101813+0000","last_became_active":"2024-09-10T23:18:55.083761+0000","last_became_peered":"2024-09-10T23:18:55.083761+0000","last_unstale":"2024-09-10T23:18:56.101813+0000","last_undegraded":"2024-09-10T23:18:56.101813+0000","last_fullsized":"2024-09-10T23:18:56.101813+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:10.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305509+0000","last_change":"2024-09-10T23:18:56.095498+0000","last_active":"2024-09-10T23:18:58.305509+0000","last_peered":"2024-09-10T23:18:58.305509+0000","last_clean":"2024-09-10T23:18:58.305509+0000","last_became_active":"2024-09-10T23:18:56.093254+0000","last_became_peered":"2024-09-10T23:18:56.093254+0000","last_unstale":"2024-09-10T23:18:58.305509+0000","last_undegraded":"2024-09-10T23:18:58.305509+0000","last_fullsized":"2024-09-10T23:18:58.305509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:29.469274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078629+0000","last_change":"2024-09-10T23:18:55.086808+0000","last_active":"2024-09-10T23:18:57.078629+0000","last_peered":"2024-09-10T23:18:57.078629+0000","last_clean":"2024-09-10T23:18:57.078629+0000","last_became_active":"2024-09-10T23:18:55.086532+0000","last_became_peered":"2024-09-10T23:18:55.086532+0000","last_unstale":"2024-09-10T23:18:57.078629+0000","last_undegraded":"2024-09-10T23:18:57.078629+0000","last_fullsized":"2024-09-10T23:18:57.078629+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.093849+0000","last_change":"2024-09-10T23:18:56.092067+0000","last_active":"2024-09-10T23:18:56.093849+0000","last_peered":"2024-09-10T23:18:56.093849+0000","last_clean":"2024-09-10T23:18:56.093849+0000","last_became_active":"2024-09-10T23:18:56.091772+0000","last_became_peered":"2024-09-10T23:18:56.091772+0000","last_unstale":"2024-09-10T23:18:56.093849+0000","last_undegraded":"2024-09-10T23:18:56.093849+0000","last_fullsized":"2024-09-10T23:18:56.093849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:56.252112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078517+0000","last_change":"2024-09-10T23:18:55.078770+0000","last_active":"2024-09-10T23:18:57.078517+0000","last_peered":"2024-09-10T23:18:57.078517+0000","last_clean":"2024-09-10T23:18:57.078517+0000","last_became_active":"2024-09-10T23:18:55.078521+0000","last_became_peered":"2024-09-10T23:18:55.078521+0000","last_unstale":"2024-09-10T23:18:57.078517+0000","last_undegraded":"2024-09-10T23:18:57.078517+0000","last_fullsized":"2024-09-10T23:18:57.078517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:09.389758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303590+0000","last_change":"2024-09-10T23:18:56.100648+0000","last_active":"2024-09-10T23:18:58.303590+0000","last_peered":"2024-09-10T23:18:58.303590+0000","last_clean":"2024-09-10T23:18:58.303590+0000","last_became_active":"2024-09-10T23:18:56.098241+0000","last_became_peered":"2024-09-10T23:18:56.098241+0000","last_unstale":"2024-09-10T23:18:58.303590+0000","last_undegraded":"2024-09-10T23:18:58.303590+0000","last_fullsized":"2024-09-10T23:18:58.303590+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:30.964405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305291+0000","last_change":"2024-09-10T23:18:55.089746+0000","last_active":"2024-09-10T23:18:58.305291+0000","last_peered":"2024-09-10T23:18:58.305291+0000","last_clean":"2024-09-10T23:18:58.305291+0000","last_became_active":"2024-09-10T23:18:55.089507+0000","last_became_peered":"2024-09-10T23:18:55.089507+0000","last_unstale":"2024-09-10T23:18:58.305291+0000","last_undegraded":"2024-09-10T23:18:58.305291+0000","last_fullsized":"2024-09-10T23:18:58.305291+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:44.064508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073013+0000","last_change":"2024-09-10T23:18:55.073013+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073013+0000","last_undegraded":"2024-09-10T23:18:55.073013+0000","last_fullsized":"2024-09-10T23:18:55.073013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081829+0000","last_change":"2024-09-10T23:18:55.088922+0000","last_active":"2024-09-10T23:18:57.081829+0000","last_peered":"2024-09-10T23:18:57.081829+0000","last_clean":"2024-09-10T23:18:57.081829+0000","last_became_active":"2024-09-10T23:18:55.088591+0000","last_became_peered":"2024-09-10T23:18:55.088591+0000","last_unstale":"2024-09-10T23:18:57.081829+0000","last_undegraded":"2024-09-10T23:18:57.081829+0000","last_fullsized":"2024-09-10T23:18:57.081829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.907855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068842+0000","last_change":"2024-09-10T23:18:55.068842+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068842+0000","last_undegraded":"2024-09-10T23:18:55.068842+0000","last_fullsized":"2024-09-10T23:18:55.068842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.084422+0000","last_change":"2024-09-10T23:18:55.081624+0000","last_active":"2024-09-10T23:18:55.084422+0000","last_peered":"2024-09-10T23:18:55.084422+0000","last_clean":"2024-09-10T23:18:55.084422+0000","last_became_active":"2024-09-10T23:18:55.080250+0000","last_became_peered":"2024-09-10T23:18:55.080250+0000","last_unstale":"2024-09-10T23:18:55.084422+0000","last_undegraded":"2024-09-10T23:18:55.084422+0000","last_fullsized":"2024-09-10T23:18:55.084422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:08.556811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303988+0000","last_change":"2024-09-10T23:18:56.099137+0000","last_active":"2024-09-10T23:18:58.303988+0000","last_peered":"2024-09-10T23:18:58.303988+0000","last_clean":"2024-09-10T23:18:58.303988+0000","last_became_active":"2024-09-10T23:18:56.098260+0000","last_became_peered":"2024-09-10T23:18:56.098260+0000","last_unstale":"2024-09-10T23:18:58.303988+0000","last_undegraded":"2024-09-10T23:18:58.303988+0000","last_fullsized":"2024-09-10T23:18:58.303988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:40.800736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.078689+0000","last_change":"2024-09-10T23:18:55.080384+0000","last_active":"2024-09-10T23:18:56.078689+0000","last_peered":"2024-09-10T23:18:56.078689+0000","last_clean":"2024-09-10T23:18:56.078689+0000","last_became_active":"2024-09-10T23:18:55.080119+0000","last_became_peered":"2024-09-10T23:18:55.080119+0000","last_unstale":"2024-09-10T23:18:56.078689+0000","last_undegraded":"2024-09-10T23:18:56.078689+0000","last_fullsized":"2024-09-10T23:18:56.078689+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:32.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068578+0000","last_change":"2024-09-10T23:18:55.068578+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068578+0000","last_undegraded":"2024-09-10T23:18:55.068578+0000","last_fullsized":"2024-09-10T23:18:55.068578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081305+0000","last_change":"2024-09-10T23:18:55.081272+0000","last_active":"2024-09-10T23:18:57.081305+0000","last_peered":"2024-09-10T23:18:57.081305+0000","last_clean":"2024-09-10T23:18:57.081305+0000","last_became_active":"2024-09-10T23:18:55.080496+0000","last_became_peered":"2024-09-10T23:18:55.080496+0000","last_unstale":"2024-09-10T23:18:57.081305+0000","last_undegraded":"2024-09-10T23:18:57.081305+0000","last_fullsized":"2024-09-10T23:18:57.081305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.014724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072158+0000","last_change":"2024-09-10T23:18:55.072158+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072158+0000","last_undegraded":"2024-09-10T23:18:55.072158+0000","last_fullsized":"2024-09-10T23:18:55.072158+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.086326+0000","last_change":"2024-09-10T23:18:55.084970+0000","last_active":"2024-09-10T23:18:55.086326+0000","last_peered":"2024-09-10T23:18:55.086326+0000","last_clean":"2024-09-10T23:18:55.086326+0000","last_became_active":"2024-09-10T23:18:55.084721+0000","last_became_peered":"2024-09-10T23:18:55.084721+0000","last_unstale":"2024-09-10T23:18:55.086326+0000","last_undegraded":"2024-09-10T23:18:55.086326+0000","last_fullsized":"2024-09-10T23:18:55.086326+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.907855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305564+0000","last_change":"2024-09-10T23:18:56.086003+0000","last_active":"2024-09-10T23:18:58.305564+0000","last_peered":"2024-09-10T23:18:58.305564+0000","last_clean":"2024-09-10T23:18:58.305564+0000","last_became_active":"2024-09-10T23:18:56.085726+0000","last_became_peered":"2024-09-10T23:18:56.085726+0000","last_unstale":"2024-09-10T23:18:58.305564+0000","last_undegraded":"2024-09-10T23:18:58.305564+0000","last_fullsized":"2024-09-10T23:18:58.305564+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:36.226548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087234+0000","last_change":"2024-09-10T23:18:55.086081+0000","last_active":"2024-09-10T23:18:55.087234+0000","last_peered":"2024-09-10T23:18:55.087234+0000","last_clean":"2024-09-10T23:18:55.087234+0000","last_became_active":"2024-09-10T23:18:55.085795+0000","last_became_peered":"2024-09-10T23:18:55.085795+0000","last_unstale":"2024-09-10T23:18:55.087234+0000","last_undegraded":"2024-09-10T23:18:55.087234+0000","last_fullsized":"2024-09-10T23:18:55.087234+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:52.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081695+0000","last_change":"2024-09-10T23:18:56.084383+0000","last_active":"2024-09-10T23:18:57.081695+0000","last_peered":"2024-09-10T23:18:57.081695+0000","last_clean":"2024-09-10T23:18:57.081695+0000","last_became_active":"2024-09-10T23:18:56.084106+0000","last_became_peered":"2024-09-10T23:18:56.084106+0000","last_unstale":"2024-09-10T23:18:57.081695+0000","last_undegraded":"2024-09-10T23:18:57.081695+0000","last_fullsized":"2024-09-10T23:18:57.081695+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:04.492500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083086+0000","last_change":"2024-09-10T23:18:55.079369+0000","last_active":"2024-09-10T23:18:55.083086+0000","last_peered":"2024-09-10T23:18:55.083086+0000","last_clean":"2024-09-10T23:18:55.083086+0000","last_became_active":"2024-09-10T23:18:55.079064+0000","last_became_peered":"2024-09-10T23:18:55.079064+0000","last_unstale":"2024-09-10T23:18:55.083086+0000","last_undegraded":"2024-09-10T23:18:55.083086+0000","last_fullsized":"2024-09-10T23:18:55.083086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:50.837310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072678+0000","last_change":"2024-09-10T23:18:55.072678+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072678+0000","last_undegraded":"2024-09-10T23:18:55.072678+0000","last_fullsized":"2024-09-10T23:18:55.072678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304196+0000","last_change":"2024-09-10T23:18:55.082941+0000","last_active":"2024-09-10T23:18:58.304196+0000","last_peered":"2024-09-10T23:18:58.304196+0000","last_clean":"2024-09-10T23:18:58.304196+0000","last_became_active":"2024-09-10T23:18:55.082676+0000","last_became_peered":"2024-09-10T23:18:55.082676+0000","last_unstale":"2024-09-10T23:18:58.304196+0000","last_undegraded":"2024-09-10T23:18:58.304196+0000","last_fullsized":"2024-09-10T23:18:58.304196+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:13.177241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305036+0000","last_change":"2024-09-10T23:18:56.089047+0000","last_active":"2024-09-10T23:18:58.305036+0000","last_peered":"2024-09-10T23:18:58.305036+0000","last_clean":"2024-09-10T23:18:58.305036+0000","last_became_active":"2024-09-10T23:18:56.088792+0000","last_became_peered":"2024-09-10T23:18:56.088792+0000","last_unstale":"2024-09-10T23:18:58.305036+0000","last_undegraded":"2024-09-10T23:18:58.305036+0000","last_fullsized":"2024-09-10T23:18:58.305036+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:13.725585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081952+0000","last_change":"2024-09-10T23:18:55.081652+0000","last_active":"2024-09-10T23:18:57.081952+0000","last_peered":"2024-09-10T23:18:57.081952+0000","last_clean":"2024-09-10T23:18:57.081952+0000","last_became_active":"2024-09-10T23:18:55.081354+0000","last_became_peered":"2024-09-10T23:18:55.081354+0000","last_unstale":"2024-09-10T23:18:57.081952+0000","last_undegraded":"2024-09-10T23:18:57.081952+0000","last_fullsized":"2024-09-10T23:18:57.081952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:16.766558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082208+0000","last_change":"2024-09-10T23:18:56.091901+0000","last_active":"2024-09-10T23:18:57.082208+0000","last_peered":"2024-09-10T23:18:57.082208+0000","last_clean":"2024-09-10T23:18:57.082208+0000","last_became_active":"2024-09-10T23:18:56.091593+0000","last_became_peered":"2024-09-10T23:18:56.091593+0000","last_unstale":"2024-09-10T23:18:57.082208+0000","last_undegraded":"2024-09-10T23:18:57.082208+0000","last_fullsized":"2024-09-10T23:18:57.082208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:41.947788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.079089+0000","last_change":"2024-09-10T23:18:55.091463+0000","last_active":"2024-09-10T23:18:56.079089+0000","last_peered":"2024-09-10T23:18:56.079089+0000","last_clean":"2024-09-10T23:18:56.079089+0000","last_became_active":"2024-09-10T23:18:55.091157+0000","last_became_peered":"2024-09-10T23:18:55.091157+0000","last_unstale":"2024-09-10T23:18:56.079089+0000","last_undegraded":"2024-09-10T23:18:56.079089+0000","last_fullsized":"2024-09-10T23:18:56.079089+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303835+0000","last_change":"2024-09-10T23:18:56.090018+0000","last_active":"2024-09-10T23:18:58.303835+0000","last_peered":"2024-09-10T23:18:58.303835+0000","last_clean":"2024-09-10T23:18:58.303835+0000","last_became_active":"2024-09-10T23:18:56.089757+0000","last_became_peered":"2024-09-10T23:18:56.089757+0000","last_unstale":"2024-09-10T23:18:58.303835+0000","last_undegraded":"2024-09-10T23:18:58.303835+0000","last_fullsized":"2024-09-10T23:18:58.303835+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:25.270349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083179+0000","last_change":"2024-09-10T23:18:55.079923+0000","last_active":"2024-09-10T23:18:55.083179+0000","last_peered":"2024-09-10T23:18:55.083179+0000","last_clean":"2024-09-10T23:18:55.083179+0000","last_became_active":"2024-09-10T23:18:55.079648+0000","last_became_peered":"2024-09-10T23:18:55.079648+0000","last_unstale":"2024-09-10T23:18:55.083179+0000","last_undegraded":"2024-09-10T23:18:55.083179+0000","last_fullsized":"2024-09-10T23:18:55.083179+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.014724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082858+0000","last_change":"2024-09-10T23:18:56.085249+0000","last_active":"2024-09-10T23:18:57.082858+0000","last_peered":"2024-09-10T23:18:57.082858+0000","last_clean":"2024-09-10T23:18:57.082858+0000","last_became_active":"2024-09-10T23:18:56.084985+0000","last_became_peered":"2024-09-10T23:18:56.084985+0000","last_unstale":"2024-09-10T23:18:57.082858+0000","last_undegraded":"2024-09-10T23:18:57.082858+0000","last_fullsized":"2024-09-10T23:18:57.082858+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:41.406210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304434+0000","last_change":"2024-09-10T23:18:55.079172+0000","last_active":"2024-09-10T23:18:58.304434+0000","last_peered":"2024-09-10T23:18:58.304434+0000","last_clean":"2024-09-10T23:18:58.304434+0000","last_became_active":"2024-09-10T23:18:55.078915+0000","last_became_peered":"2024-09-10T23:18:55.078915+0000","last_unstale":"2024-09-10T23:18:58.304434+0000","last_undegraded":"2024-09-10T23:18:58.304434+0000","last_fullsized":"2024-09-10T23:18:58.304434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:25.929119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304506+0000","last_change":"2024-09-10T23:18:56.086456+0000","last_active":"2024-09-10T23:18:58.304506+0000","last_peered":"2024-09-10T23:18:58.304506+0000","last_clean":"2024-09-10T23:18:58.304506+0000","last_became_active":"2024-09-10T23:18:56.086195+0000","last_became_peered":"2024-09-10T23:18:56.086195+0000","last_unstale":"2024-09-10T23:18:58.304506+0000","last_undegraded":"2024-09-10T23:18:58.304506+0000","last_fullsized":"2024-09-10T23:18:58.304506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:21.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.083015+0000","last_change":"2024-09-10T23:18:55.091422+0000","last_active":"2024-09-10T23:18:57.083015+0000","last_peered":"2024-09-10T23:18:57.083015+0000","last_clean":"2024-09-10T23:18:57.083015+0000","last_became_active":"2024-09-10T23:18:55.091111+0000","last_became_peered":"2024-09-10T23:18:55.091111+0000","last_unstale":"2024-09-10T23:18:57.083015+0000","last_undegraded":"2024-09-10T23:18:57.083015+0000","last_fullsized":"2024-09-10T23:18:57.083015+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:32.265505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078201+0000","last_change":"2024-09-10T23:18:56.085889+0000","last_active":"2024-09-10T23:18:57.078201+0000","last_peered":"2024-09-10T23:18:57.078201+0000","last_clean":"2024-09-10T23:18:57.078201+0000","last_became_active":"2024-09-10T23:18:56.085620+0000","last_became_peered":"2024-09-10T23:18:56.085620+0000","last_unstale":"2024-09-10T23:18:57.078201+0000","last_undegraded":"2024-09-10T23:18:57.078201+0000","last_fullsized":"2024-09-10T23:18:57.078201+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:33.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303476+0000","last_change":"2024-09-10T23:18:55.080290+0000","last_active":"2024-09-10T23:18:58.303476+0000","last_peered":"2024-09-10T23:18:58.303476+0000","last_clean":"2024-09-10T23:18:58.303476+0000","last_became_active":"2024-09-10T23:18:55.080019+0000","last_became_peered":"2024-09-10T23:18:55.080019+0000","last_unstale":"2024-09-10T23:18:58.303476+0000","last_undegraded":"2024-09-10T23:18:58.303476+0000","last_fullsized":"2024-09-10T23:18:58.303476+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:10.811412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072563+0000","last_change":"2024-09-10T23:18:55.072563+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072563+0000","last_undegraded":"2024-09-10T23:18:55.072563+0000","last_fullsized":"2024-09-10T23:18:55.072563+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.107369+0000","last_change":"2024-09-10T23:18:55.082244+0000","last_active":"2024-09-10T23:18:56.107369+0000","last_peered":"2024-09-10T23:18:56.107369+0000","last_clean":"2024-09-10T23:18:56.107369+0000","last_became_active":"2024-09-10T23:18:55.081844+0000","last_became_peered":"2024-09-10T23:18:55.081844+0000","last_unstale":"2024-09-10T23:18:56.107369+0000","last_undegraded":"2024-09-10T23:18:56.107369+0000","last_fullsized":"2024-09-10T23:18:56.107369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:25.835051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078302+0000","last_change":"2024-09-10T23:18:56.089097+0000","last_active":"2024-09-10T23:18:57.078302+0000","last_peered":"2024-09-10T23:18:57.078302+0000","last_clean":"2024-09-10T23:18:57.078302+0000","last_became_active":"2024-09-10T23:18:56.088788+0000","last_became_peered":"2024-09-10T23:18:56.088788+0000","last_unstale":"2024-09-10T23:18:57.078302+0000","last_undegraded":"2024-09-10T23:18:57.078302+0000","last_fullsized":"2024-09-10T23:18:57.078302+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:14.797076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.078959+0000","last_change":"2024-09-10T23:18:55.091669+0000","last_active":"2024-09-10T23:18:56.078959+0000","last_peered":"2024-09-10T23:18:56.078959+0000","last_clean":"2024-09-10T23:18:56.078959+0000","last_became_active":"2024-09-10T23:18:55.091385+0000","last_became_peered":"2024-09-10T23:18:55.091385+0000","last_unstale":"2024-09-10T23:18:56.078959+0000","last_undegraded":"2024-09-10T23:18:56.078959+0000","last_fullsized":"2024-09-10T23:18:56.078959+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305475+0000","last_change":"2024-09-10T23:18:56.086556+0000","last_active":"2024-09-10T23:18:58.305475+0000","last_peered":"2024-09-10T23:18:58.305475+0000","last_clean":"2024-09-10T23:18:58.305475+0000","last_became_active":"2024-09-10T23:18:56.085413+0000","last_became_peered":"2024-09-10T23:18:56.085413+0000","last_unstale":"2024-09-10T23:18:58.305475+0000","last_undegraded":"2024-09-10T23:18:58.305475+0000","last_fullsized":"2024-09-10T23:18:58.305475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:09.674355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078493+0000","last_change":"2024-09-10T23:18:55.079031+0000","last_active":"2024-09-10T23:18:57.078493+0000","last_peered":"2024-09-10T23:18:57.078493+0000","last_clean":"2024-09-10T23:18:57.078493+0000","last_became_active":"2024-09-10T23:18:55.078641+0000","last_became_peered":"2024-09-10T23:18:55.078641+0000","last_unstale":"2024-09-10T23:18:57.078493+0000","last_undegraded":"2024-09-10T23:18:57.078493+0000","last_fullsized":"2024-09-10T23:18:57.078493+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.083932+0000","last_change":"2024-09-10T23:18:56.081745+0000","last_active":"2024-09-10T23:18:56.083932+0000","last_peered":"2024-09-10T23:18:56.083932+0000","last_clean":"2024-09-10T23:18:56.083932+0000","last_became_active":"2024-09-10T23:18:56.081423+0000","last_became_peered":"2024-09-10T23:18:56.081423+0000","last_unstale":"2024-09-10T23:18:56.083932+0000","last_undegraded":"2024-09-10T23:18:56.083932+0000","last_fullsized":"2024-09-10T23:18:56.083932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:31.869620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303236+0000","last_change":"2024-09-10T23:18:55.078083+0000","last_active":"2024-09-10T23:18:58.303236+0000","last_peered":"2024-09-10T23:18:58.303236+0000","last_clean":"2024-09-10T23:18:58.303236+0000","last_became_active":"2024-09-10T23:18:55.077157+0000","last_became_peered":"2024-09-10T23:18:55.077157+0000","last_unstale":"2024-09-10T23:18:58.303236+0000","last_undegraded":"2024-09-10T23:18:58.303236+0000","last_fullsized":"2024-09-10T23:18:58.303236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:03.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082419+0000","last_change":"2024-09-10T23:18:56.087759+0000","last_active":"2024-09-10T23:18:57.082419+0000","last_peered":"2024-09-10T23:18:57.082419+0000","last_clean":"2024-09-10T23:18:57.082419+0000","last_became_active":"2024-09-10T23:18:56.087498+0000","last_became_peered":"2024-09-10T23:18:56.087498+0000","last_unstale":"2024-09-10T23:18:57.082419+0000","last_undegraded":"2024-09-10T23:18:57.082419+0000","last_fullsized":"2024-09-10T23:18:57.082419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:52.852300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081512+0000","last_change":"2024-09-10T23:18:55.084173+0000","last_active":"2024-09-10T23:18:57.081512+0000","last_peered":"2024-09-10T23:18:57.081512+0000","last_clean":"2024-09-10T23:18:57.081512+0000","last_became_active":"2024-09-10T23:18:55.083904+0000","last_became_peered":"2024-09-10T23:18:55.083904+0000","last_unstale":"2024-09-10T23:18:57.081512+0000","last_undegraded":"2024-09-10T23:18:57.081512+0000","last_fullsized":"2024-09-10T23:18:57.081512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:11.325433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078698+0000","last_change":"2024-09-10T23:18:56.090774+0000","last_active":"2024-09-10T23:18:57.078698+0000","last_peered":"2024-09-10T23:18:57.078698+0000","last_clean":"2024-09-10T23:18:57.078698+0000","last_became_active":"2024-09-10T23:18:56.090248+0000","last_became_peered":"2024-09-10T23:18:56.090248+0000","last_unstale":"2024-09-10T23:18:57.078698+0000","last_undegraded":"2024-09-10T23:18:57.078698+0000","last_fullsized":"2024-09-10T23:18:57.078698+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:36.512116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.302991+0000","last_change":"2024-09-10T23:18:55.086839+0000","last_active":"2024-09-10T23:18:58.302991+0000","last_peered":"2024-09-10T23:18:58.302991+0000","last_clean":"2024-09-10T23:18:58.302991+0000","last_became_active":"2024-09-10T23:18:55.086582+0000","last_became_peered":"2024-09-10T23:18:55.086582+0000","last_unstale":"2024-09-10T23:18:58.302991+0000","last_undegraded":"2024-09-10T23:18:58.302991+0000","last_fullsized":"2024-09-10T23:18:58.302991+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:53.769535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304921+0000","last_change":"2024-09-10T23:18:56.094826+0000","last_active":"2024-09-10T23:18:58.304921+0000","last_peered":"2024-09-10T23:18:58.304921+0000","last_clean":"2024-09-10T23:18:58.304921+0000","last_became_active":"2024-09-10T23:18:56.094309+0000","last_became_peered":"2024-09-10T23:18:56.094309+0000","last_unstale":"2024-09-10T23:18:58.304921+0000","last_undegraded":"2024-09-10T23:18:58.304921+0000","last_fullsized":"2024-09-10T23:18:58.304921+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:14.379720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.103955+0000","last_change":"2024-09-10T23:18:55.088646+0000","last_active":"2024-09-10T23:18:56.103955+0000","last_peered":"2024-09-10T23:18:56.103955+0000","last_clean":"2024-09-10T23:18:56.103955+0000","last_became_active":"2024-09-10T23:18:55.088302+0000","last_became_peered":"2024-09-10T23:18:55.088302+0000","last_unstale":"2024-09-10T23:18:56.103955+0000","last_undegraded":"2024-09-10T23:18:56.103955+0000","last_fullsized":"2024-09-10T23:18:56.103955+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:45.168297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078265+0000","last_change":"2024-09-10T23:18:56.098890+0000","last_active":"2024-09-10T23:18:57.078265+0000","last_peered":"2024-09-10T23:18:57.078265+0000","last_clean":"2024-09-10T23:18:57.078265+0000","last_became_active":"2024-09-10T23:18:56.098619+0000","last_became_peered":"2024-09-10T23:18:56.098619+0000","last_unstale":"2024-09-10T23:18:57.078265+0000","last_undegraded":"2024-09-10T23:18:57.078265+0000","last_fullsized":"2024-09-10T23:18:57.078265+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:37.032240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087193+0000","last_change":"2024-09-10T23:18:55.086447+0000","last_active":"2024-09-10T23:18:55.087193+0000","last_peered":"2024-09-10T23:18:55.087193+0000","last_clean":"2024-09-10T23:18:55.087193+0000","last_became_active":"2024-09-10T23:18:55.086061+0000","last_became_peered":"2024-09-10T23:18:55.086061+0000","last_unstale":"2024-09-10T23:18:55.087193+0000","last_undegraded":"2024-09-10T23:18:55.087193+0000","last_fullsized":"2024-09-10T23:18:55.087193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:16.766558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303709+0000","last_change":"2024-09-10T23:18:56.089012+0000","last_active":"2024-09-10T23:18:58.303709+0000","last_peered":"2024-09-10T23:18:58.303709+0000","last_clean":"2024-09-10T23:18:58.303709+0000","last_became_active":"2024-09-10T23:18:56.088690+0000","last_became_peered":"2024-09-10T23:18:56.088690+0000","last_unstale":"2024-09-10T23:18:58.303709+0000","last_undegraded":"2024-09-10T23:18:58.303709+0000","last_fullsized":"2024-09-10T23:18:58.303709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:04.831502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081921+0000","last_change":"2024-09-10T23:18:55.087429+0000","last_active":"2024-09-10T23:18:57.081921+0000","last_peered":"2024-09-10T23:18:57.081921+0000","last_clean":"2024-09-10T23:18:57.081921+0000","last_became_active":"2024-09-10T23:18:55.084677+0000","last_became_peered":"2024-09-10T23:18:55.084677+0000","last_unstale":"2024-09-10T23:18:57.081921+0000","last_undegraded":"2024-09-10T23:18:57.081921+0000","last_fullsized":"2024-09-10T23:18:57.081921+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:18.725430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081923+0000","last_change":"2024-09-10T23:18:56.092467+0000","last_active":"2024-09-10T23:18:57.081923+0000","last_peered":"2024-09-10T23:18:57.081923+0000","last_clean":"2024-09-10T23:18:57.081923+0000","last_became_active":"2024-09-10T23:18:56.092160+0000","last_became_peered":"2024-09-10T23:18:56.092160+0000","last_unstale":"2024-09-10T23:18:57.081923+0000","last_undegraded":"2024-09-10T23:18:57.081923+0000","last_fullsized":"2024-09-10T23:18:57.081923+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.811870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303766+0000","last_change":"2024-09-10T23:18:55.082798+0000","last_active":"2024-09-10T23:18:58.303766+0000","last_peered":"2024-09-10T23:18:58.303766+0000","last_clean":"2024-09-10T23:18:58.303766+0000","last_became_active":"2024-09-10T23:18:55.082490+0000","last_became_peered":"2024-09-10T23:18:55.082490+0000","last_unstale":"2024-09-10T23:18:58.303766+0000","last_undegraded":"2024-09-10T23:18:58.303766+0000","last_fullsized":"2024-09-10T23:18:58.303766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:33.785544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305017+0000","last_change":"2024-09-10T23:18:56.090316+0000","last_active":"2024-09-10T23:18:58.305017+0000","last_peered":"2024-09-10T23:18:58.305017+0000","last_clean":"2024-09-10T23:18:58.305017+0000","last_became_active":"2024-09-10T23:18:56.090052+0000","last_became_peered":"2024-09-10T23:18:56.090052+0000","last_unstale":"2024-09-10T23:18:58.305017+0000","last_undegraded":"2024-09-10T23:18:58.305017+0000","last_fullsized":"2024-09-10T23:18:58.305017+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:20.751553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303364+0000","last_change":"2024-09-10T23:18:55.081060+0000","last_active":"2024-09-10T23:18:58.303364+0000","last_peered":"2024-09-10T23:18:58.303364+0000","last_clean":"2024-09-10T23:18:58.303364+0000","last_became_active":"2024-09-10T23:18:55.076346+0000","last_became_peered":"2024-09-10T23:18:55.076346+0000","last_unstale":"2024-09-10T23:18:58.303364+0000","last_undegraded":"2024-09-10T23:18:58.303364+0000","last_fullsized":"2024-09-10T23:18:58.303364+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:15.292325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082386+0000","last_change":"2024-09-10T23:18:56.102976+0000","last_active":"2024-09-10T23:18:57.082386+0000","last_peered":"2024-09-10T23:18:57.082386+0000","last_clean":"2024-09-10T23:18:57.082386+0000","last_became_active":"2024-09-10T23:18:56.101235+0000","last_became_peered":"2024-09-10T23:18:56.101235+0000","last_unstale":"2024-09-10T23:18:57.082386+0000","last_undegraded":"2024-09-10T23:18:57.082386+0000","last_fullsized":"2024-09-10T23:18:57.082386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:24.062275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.092837+0000","last_change":"2024-09-10T23:18:55.092277+0000","last_active":"2024-09-10T23:18:55.092837+0000","last_peered":"2024-09-10T23:18:55.092837+0000","last_clean":"2024-09-10T23:18:55.092837+0000","last_became_active":"2024-09-10T23:18:55.092026+0000","last_became_peered":"2024-09-10T23:18:55.092026+0000","last_unstale":"2024-09-10T23:18:55.092837+0000","last_undegraded":"2024-09-10T23:18:55.092837+0000","last_fullsized":"2024-09-10T23:18:55.092837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:56.711683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303882+0000","last_change":"2024-09-10T23:18:56.099522+0000","last_active":"2024-09-10T23:18:58.303882+0000","last_peered":"2024-09-10T23:18:58.303882+0000","last_clean":"2024-09-10T23:18:58.303882+0000","last_became_active":"2024-09-10T23:18:56.099241+0000","last_became_peered":"2024-09-10T23:18:56.099241+0000","last_unstale":"2024-09-10T23:18:58.303882+0000","last_undegraded":"2024-09-10T23:18:58.303882+0000","last_fullsized":"2024-09-10T23:18:58.303882+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:58.597638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305155+0000","last_change":"2024-09-10T23:18:55.083197+0000","last_active":"2024-09-10T23:18:58.305155+0000","last_peered":"2024-09-10T23:18:58.305155+0000","last_clean":"2024-09-10T23:18:58.305155+0000","last_became_active":"2024-09-10T23:18:55.082785+0000","last_became_peered":"2024-09-10T23:18:55.082785+0000","last_unstale":"2024-09-10T23:18:58.305155+0000","last_undegraded":"2024-09-10T23:18:58.305155+0000","last_fullsized":"2024-09-10T23:18:58.305155+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:11.391580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.089696+0000","last_change":"2024-09-10T23:18:56.085814+0000","last_active":"2024-09-10T23:18:56.089696+0000","last_peered":"2024-09-10T23:18:56.089696+0000","last_clean":"2024-09-10T23:18:56.089696+0000","last_became_active":"2024-09-10T23:18:56.085558+0000","last_became_peered":"2024-09-10T23:18:56.085558+0000","last_unstale":"2024-09-10T23:18:56.089696+0000","last_undegraded":"2024-09-10T23:18:56.089696+0000","last_fullsized":"2024-09-10T23:18:56.089696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:07.964858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"57'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082548+0000","last_change":"2024-09-10T23:18:55.079748+0000","last_active":"2024-09-10T23:18:57.082548+0000","last_peered":"2024-09-10T23:18:57.082548+0000","last_clean":"2024-09-10T23:18:57.082548+0000","last_became_active":"2024-09-10T23:18:55.079369+0000","last_became_peered":"2024-09-10T23:18:55.079369+0000","last_unstale":"2024-09-10T23:18:57.082548+0000","last_undegraded":"2024-09-10T23:18:57.082548+0000","last_fullsized":"2024-09-10T23:18:57.082548+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:05.324333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":171,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.069675+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:18:55.069675+0000","last_peered":"2024-09-10T23:18:55.069675+0000","last_clean":"2024-09-10T23:18:55.069675+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:18:55.069675+0000","last_undegraded":"2024-09-10T23:18:55.069675+0000","last_fullsized":"2024-09-10T23:18:55.069675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476781,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40168,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331672,"statfs":{"total":96636764160,"available":96595632128,"internally_reserved":0,"allocated":667648,"data_stored":293101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46292,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325548,"statfs":{"total":96636764160,"available":96589361152,"internally_reserved":0,"allocated":1241088,"data_stored":875650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40164,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331676,"statfs":{"total":96636764160,"available":96595636224,"internally_reserved":0,"allocated":671744,"data_stored":299141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62352,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309488,"statfs":{"total":96636764160,"available":96572915712,"internally_reserved":0,"allocated":647168,"data_stored":285282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40176,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":684032,"data_stored":300753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":679936,"data_stored":299301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":1273856,"data_stored":889565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":294083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:00.626 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:00.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.805+0000 7fbcdbc00640 1 -- 172.21.15.17:0/2361189574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 msgr2=0x7fbcbc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.805+0000 7fbcdbc00640 1 --2- 172.21.15.17:0/2361189574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 0x7fbcbc004c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009b30 tx=0x7fbcc001d230 comp rx=0 tx=0).stop 2024-09-10T23:19:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.805+0000 7fbcdbc00640 1 -- 172.21.15.17:0/2361189574 shutdown_connections 2024-09-10T23:19:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.805+0000 7fbcdbc00640 1 --2- 172.21.15.17:0/2361189574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 0x7fbcbc004c90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.805+0000 7fbcdbc00640 1 -- 172.21.15.17:0/2361189574 >> 172.21.15.17:0/2361189574 conn(0x7fbcd40d1d30 msgr2=0x7fbcd40d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.805+0000 7fbcdbc00640 1 -- 172.21.15.17:0/2361189574 shutdown_connections 2024-09-10T23:19:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.805+0000 7fbcdbc00640 1 -- 172.21.15.17:0/2361189574 wait complete. 2024-09-10T23:19:00.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 Processor -- start 2024-09-10T23:19:00.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 -- start start 2024-09-10T23:19:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 0x7fbcd41f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd40b0d70 0x7fbcd40afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd40cb9b0 0x7fbcd40b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40d00e0 con 0x7fbcbc004810 2024-09-10T23:19:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40cff60 con 0x7fbcd40cb9b0 2024-09-10T23:19:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd406e1b0 con 0x7fbcd40b0d70 2024-09-10T23:19:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 0x7fbcd41f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 0x7fbcd41f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39454/0 (socket says 172.21.15.17:39454) 2024-09-10T23:19:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9200640 1 -- 172.21.15.17:0/675625440 learned_addr learned my addr 172.21.15.17:0/675625440 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd3e00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd40b0d70 0x7fbcd40afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9200640 1 -- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd40b0d70 msgr2=0x7fbcd40afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9c00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd40cb9b0 0x7fbcd40b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9200640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd40b0d70 0x7fbcd40afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9200640 1 -- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd40cb9b0 msgr2=0x7fbcd40b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9200640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd40cb9b0 0x7fbcd40b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9200640 1 -- 172.21.15.17:0/675625440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd41f48f0 con 0x7fbcbc004810 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9c00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd40cb9b0 0x7fbcd40b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd9200640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 0x7fbcd41f57f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8005f00 tx=0x7fbcc8011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd0c00640 1 -- 172.21.15.17:0/675625440 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8005320 con 0x7fbcbc004810 2024-09-10T23:19:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd0c00640 1 -- 172.21.15.17:0/675625440 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcc8018020 con 0x7fbcbc004810 2024-09-10T23:19:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcd0c00640 1 -- 172.21.15.17:0/675625440 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8003860 con 0x7fbcbc004810 2024-09-10T23:19:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd41f4bd0 con 0x7fbcbc004810 2024-09-10T23:19:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.809+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd41f5190 con 0x7fbcbc004810 2024-09-10T23:19:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.813+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd40b2df0 con 0x7fbcbc004810 2024-09-10T23:19:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.813+0000 7fbcd0c00640 1 -- 172.21.15.17:0/675625440 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbcc8010040 con 0x7fbcbc004810 2024-09-10T23:19:00.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.813+0000 7fbcd0c00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb40725e0 0x7fbcb4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:00.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.813+0000 7fbcd0c00640 1 -- 172.21.15.17:0/675625440 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7fbcc8096920 con 0x7fbcbc004810 2024-09-10T23:19:00.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.813+0000 7fbcd3e00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb40725e0 0x7fbcb4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:00.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.817+0000 7fbcd3e00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb40725e0 0x7fbcb4074aa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00ae000 tx=0x7fbcc0019fd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:00.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.817+0000 7fbcd0c00640 1 -- 172.21.15.17:0/675625440 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbcc8022020 con 0x7fbcbc004810 2024-09-10T23:19:00.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.989+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcd40008e0 con 0x7fbcb40725e0 2024-09-10T23:19:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.993+0000 7fbcd0c00640 1 -- 172.21.15.17:0/675625440 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250878 (secure 0 0 0) 0x7fbcd40008e0 con 0x7fbcb40725e0 2024-09-10T23:19:01.001 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:01.003 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:19:01.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb40725e0 msgr2=0x7fbcb4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb40725e0 0x7fbcb4074aa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00ae000 tx=0x7fbcc0019fd0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 msgr2=0x7fbcd41f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 0x7fbcd41f57f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8005f00 tx=0x7fbcc8011740 comp rx=0 tx=0).stop 2024-09-10T23:19:01.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 shutdown_connections 2024-09-10T23:19:01.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb40725e0 0x7fbcb4074aa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd40cb9b0 0x7fbcd40b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd40b0d70 0x7fbcd40afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 --2- 172.21.15.17:0/675625440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcbc004810 0x7fbcd41f57f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 >> 172.21.15.17:0/675625440 conn(0x7fbcd40d1d30 msgr2=0x7fbcd40cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:01.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 shutdown_connections 2024-09-10T23:19:01.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:00.997+0000 7fbcdbc00640 1 -- 172.21.15.17:0/675625440 wait complete. 2024-09-10T23:19:01.020 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-10T23:19:00.340135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347512,"kb_used_data":6388,"kb_used_omap":12,"kb_used_meta":340915,"kb_avail":754627208,"statfs":{"total":773094113280,"available":772738260992,"internally_reserved":0,"allocated":6541312,"data_stored":3536876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":349097521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001489"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078714+0000","last_change":"2024-09-10T23:18:56.090512+0000","last_active":"2024-09-10T23:18:57.078714+0000","last_peered":"2024-09-10T23:18:57.078714+0000","last_clean":"2024-09-10T23:18:57.078714+0000","last_became_active":"2024-09-10T23:18:56.089868+0000","last_became_peered":"2024-09-10T23:18:56.089868+0000","last_unstale":"2024-09-10T23:18:57.078714+0000","last_undegraded":"2024-09-10T23:18:57.078714+0000","last_fullsized":"2024-09-10T23:18:57.078714+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.364072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.069301+0000","last_change":"2024-09-10T23:18:55.069301+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.069301+0000","last_undegraded":"2024-09-10T23:18:55.069301+0000","last_fullsized":"2024-09-10T23:18:55.069301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082065+0000","last_change":"2024-09-10T23:18:56.104813+0000","last_active":"2024-09-10T23:18:57.082065+0000","last_peered":"2024-09-10T23:18:57.082065+0000","last_clean":"2024-09-10T23:18:57.082065+0000","last_became_active":"2024-09-10T23:18:56.103322+0000","last_became_peered":"2024-09-10T23:18:56.103322+0000","last_unstale":"2024-09-10T23:18:57.082065+0000","last_undegraded":"2024-09-10T23:18:57.082065+0000","last_fullsized":"2024-09-10T23:18:57.082065+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:27.592000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068548+0000","last_change":"2024-09-10T23:18:55.068548+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068548+0000","last_undegraded":"2024-09-10T23:18:55.068548+0000","last_fullsized":"2024-09-10T23:18:55.068548+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073139+0000","last_change":"2024-09-10T23:18:55.073139+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073139+0000","last_undegraded":"2024-09-10T23:18:55.073139+0000","last_fullsized":"2024-09-10T23:18:55.073139+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078393+0000","last_change":"2024-09-10T23:18:56.089275+0000","last_active":"2024-09-10T23:18:57.078393+0000","last_peered":"2024-09-10T23:18:57.078393+0000","last_clean":"2024-09-10T23:18:57.078393+0000","last_became_active":"2024-09-10T23:18:56.089026+0000","last_became_peered":"2024-09-10T23:18:56.089026+0000","last_unstale":"2024-09-10T23:18:57.078393+0000","last_undegraded":"2024-09-10T23:18:57.078393+0000","last_fullsized":"2024-09-10T23:18:57.078393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:45.067514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081381+0000","last_change":"2024-09-10T23:18:56.102567+0000","last_active":"2024-09-10T23:18:57.081381+0000","last_peered":"2024-09-10T23:18:57.081381+0000","last_clean":"2024-09-10T23:18:57.081381+0000","last_became_active":"2024-09-10T23:18:56.102253+0000","last_became_peered":"2024-09-10T23:18:56.102253+0000","last_unstale":"2024-09-10T23:18:57.081381+0000","last_undegraded":"2024-09-10T23:18:57.081381+0000","last_fullsized":"2024-09-10T23:18:57.081381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:09.674355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304376+0000","last_change":"2024-09-10T23:18:56.082157+0000","last_active":"2024-09-10T23:18:58.304376+0000","last_peered":"2024-09-10T23:18:58.304376+0000","last_clean":"2024-09-10T23:18:58.304376+0000","last_became_active":"2024-09-10T23:18:56.081716+0000","last_became_peered":"2024-09-10T23:18:56.081716+0000","last_unstale":"2024-09-10T23:18:58.304376+0000","last_undegraded":"2024-09-10T23:18:58.304376+0000","last_fullsized":"2024-09-10T23:18:58.304376+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:53.382284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303880+0000","last_change":"2024-09-10T23:18:56.089945+0000","last_active":"2024-09-10T23:18:58.303880+0000","last_peered":"2024-09-10T23:18:58.303880+0000","last_clean":"2024-09-10T23:18:58.303880+0000","last_became_active":"2024-09-10T23:18:56.089450+0000","last_became_peered":"2024-09-10T23:18:56.089450+0000","last_unstale":"2024-09-10T23:18:58.303880+0000","last_undegraded":"2024-09-10T23:18:58.303880+0000","last_fullsized":"2024-09-10T23:18:58.303880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:55.404482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078682+0000","last_change":"2024-09-10T23:18:56.087156+0000","last_active":"2024-09-10T23:18:57.078682+0000","last_peered":"2024-09-10T23:18:57.078682+0000","last_clean":"2024-09-10T23:18:57.078682+0000","last_became_active":"2024-09-10T23:18:56.086901+0000","last_became_peered":"2024-09-10T23:18:56.086901+0000","last_unstale":"2024-09-10T23:18:57.078682+0000","last_undegraded":"2024-09-10T23:18:57.078682+0000","last_fullsized":"2024-09-10T23:18:57.078682+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:24.643459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303591+0000","last_change":"2024-09-10T23:18:56.097512+0000","last_active":"2024-09-10T23:18:58.303591+0000","last_peered":"2024-09-10T23:18:58.303591+0000","last_clean":"2024-09-10T23:18:58.303591+0000","last_became_active":"2024-09-10T23:18:56.097259+0000","last_became_peered":"2024-09-10T23:18:56.097259+0000","last_unstale":"2024-09-10T23:18:58.303591+0000","last_undegraded":"2024-09-10T23:18:58.303591+0000","last_fullsized":"2024-09-10T23:18:58.303591+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:54.682126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304143+0000","last_change":"2024-09-10T23:18:56.092902+0000","last_active":"2024-09-10T23:18:58.304143+0000","last_peered":"2024-09-10T23:18:58.304143+0000","last_clean":"2024-09-10T23:18:58.304143+0000","last_became_active":"2024-09-10T23:18:56.092627+0000","last_became_peered":"2024-09-10T23:18:56.092627+0000","last_unstale":"2024-09-10T23:18:58.304143+0000","last_undegraded":"2024-09-10T23:18:58.304143+0000","last_fullsized":"2024-09-10T23:18:58.304143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:24.288734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078475+0000","last_change":"2024-09-10T23:18:56.091763+0000","last_active":"2024-09-10T23:18:57.078475+0000","last_peered":"2024-09-10T23:18:57.078475+0000","last_clean":"2024-09-10T23:18:57.078475+0000","last_became_active":"2024-09-10T23:18:56.091453+0000","last_became_peered":"2024-09-10T23:18:56.091453+0000","last_unstale":"2024-09-10T23:18:57.078475+0000","last_undegraded":"2024-09-10T23:18:57.078475+0000","last_fullsized":"2024-09-10T23:18:57.078475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:12.394587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081507+0000","last_change":"2024-09-10T23:18:56.098733+0000","last_active":"2024-09-10T23:18:57.081507+0000","last_peered":"2024-09-10T23:18:57.081507+0000","last_clean":"2024-09-10T23:18:57.081507+0000","last_became_active":"2024-09-10T23:18:56.095590+0000","last_became_peered":"2024-09-10T23:18:56.095590+0000","last_unstale":"2024-09-10T23:18:57.081507+0000","last_undegraded":"2024-09-10T23:18:57.081507+0000","last_fullsized":"2024-09-10T23:18:57.081507+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:36.226548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068498+0000","last_change":"2024-09-10T23:18:55.068498+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068498+0000","last_undegraded":"2024-09-10T23:18:55.068498+0000","last_fullsized":"2024-09-10T23:18:55.068498+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078185+0000","last_change":"2024-09-10T23:18:56.086441+0000","last_active":"2024-09-10T23:18:57.078185+0000","last_peered":"2024-09-10T23:18:57.078185+0000","last_clean":"2024-09-10T23:18:57.078185+0000","last_became_active":"2024-09-10T23:18:56.086241+0000","last_became_peered":"2024-09-10T23:18:56.086241+0000","last_unstale":"2024-09-10T23:18:57.078185+0000","last_undegraded":"2024-09-10T23:18:57.078185+0000","last_fullsized":"2024-09-10T23:18:57.078185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.947052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082783+0000","last_change":"2024-09-10T23:18:56.085163+0000","last_active":"2024-09-10T23:18:57.082783+0000","last_peered":"2024-09-10T23:18:57.082783+0000","last_clean":"2024-09-10T23:18:57.082783+0000","last_became_active":"2024-09-10T23:18:56.084615+0000","last_became_peered":"2024-09-10T23:18:56.084615+0000","last_unstale":"2024-09-10T23:18:57.082783+0000","last_undegraded":"2024-09-10T23:18:57.082783+0000","last_fullsized":"2024-09-10T23:18:57.082783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:33.804083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068869+0000","last_change":"2024-09-10T23:18:55.068869+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068869+0000","last_undegraded":"2024-09-10T23:18:55.068869+0000","last_fullsized":"2024-09-10T23:18:55.068869+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082097+0000","last_change":"2024-09-10T23:18:56.071603+0000","last_active":"2024-09-10T23:18:57.082097+0000","last_peered":"2024-09-10T23:18:57.082097+0000","last_clean":"2024-09-10T23:18:57.082097+0000","last_became_active":"2024-09-10T23:18:56.071266+0000","last_became_peered":"2024-09-10T23:18:56.071266+0000","last_unstale":"2024-09-10T23:18:57.082097+0000","last_undegraded":"2024-09-10T23:18:57.082097+0000","last_fullsized":"2024-09-10T23:18:57.082097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:23.999216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.083743+0000","last_change":"2024-09-10T23:18:56.081732+0000","last_active":"2024-09-10T23:18:56.083743+0000","last_peered":"2024-09-10T23:18:56.083743+0000","last_clean":"2024-09-10T23:18:56.083743+0000","last_became_active":"2024-09-10T23:18:56.081395+0000","last_became_peered":"2024-09-10T23:18:56.081395+0000","last_unstale":"2024-09-10T23:18:56.083743+0000","last_undegraded":"2024-09-10T23:18:56.083743+0000","last_fullsized":"2024-09-10T23:18:56.083743+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:10.392764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.094299+0000","last_change":"2024-09-10T23:18:56.092352+0000","last_active":"2024-09-10T23:18:56.094299+0000","last_peered":"2024-09-10T23:18:56.094299+0000","last_clean":"2024-09-10T23:18:56.094299+0000","last_became_active":"2024-09-10T23:18:56.092077+0000","last_became_peered":"2024-09-10T23:18:56.092077+0000","last_unstale":"2024-09-10T23:18:56.094299+0000","last_undegraded":"2024-09-10T23:18:56.094299+0000","last_fullsized":"2024-09-10T23:18:56.094299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:51.840316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303137+0000","last_change":"2024-09-10T23:18:56.088908+0000","last_active":"2024-09-10T23:18:58.303137+0000","last_peered":"2024-09-10T23:18:58.303137+0000","last_clean":"2024-09-10T23:18:58.303137+0000","last_became_active":"2024-09-10T23:18:56.088628+0000","last_became_peered":"2024-09-10T23:18:56.088628+0000","last_unstale":"2024-09-10T23:18:58.303137+0000","last_undegraded":"2024-09-10T23:18:58.303137+0000","last_fullsized":"2024-09-10T23:18:58.303137+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:32.936954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303115+0000","last_change":"2024-09-10T23:18:56.097569+0000","last_active":"2024-09-10T23:18:58.303115+0000","last_peered":"2024-09-10T23:18:58.303115+0000","last_clean":"2024-09-10T23:18:58.303115+0000","last_became_active":"2024-09-10T23:18:56.097237+0000","last_became_peered":"2024-09-10T23:18:56.097237+0000","last_unstale":"2024-09-10T23:18:58.303115+0000","last_undegraded":"2024-09-10T23:18:58.303115+0000","last_fullsized":"2024-09-10T23:18:58.303115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:03.488812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081320+0000","last_change":"2024-09-10T23:18:56.088747+0000","last_active":"2024-09-10T23:18:57.081320+0000","last_peered":"2024-09-10T23:18:57.081320+0000","last_clean":"2024-09-10T23:18:57.081320+0000","last_became_active":"2024-09-10T23:18:56.088010+0000","last_became_peered":"2024-09-10T23:18:56.088010+0000","last_unstale":"2024-09-10T23:18:57.081320+0000","last_undegraded":"2024-09-10T23:18:57.081320+0000","last_fullsized":"2024-09-10T23:18:57.081320+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:13.725585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082898+0000","last_change":"2024-09-10T23:18:56.092590+0000","last_active":"2024-09-10T23:18:57.082898+0000","last_peered":"2024-09-10T23:18:57.082898+0000","last_clean":"2024-09-10T23:18:57.082898+0000","last_became_active":"2024-09-10T23:18:56.092231+0000","last_became_peered":"2024-09-10T23:18:56.092231+0000","last_unstale":"2024-09-10T23:18:57.082898+0000","last_undegraded":"2024-09-10T23:18:57.082898+0000","last_fullsized":"2024-09-10T23:18:57.082898+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:52.814090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303636+0000","last_change":"2024-09-10T23:18:56.099351+0000","last_active":"2024-09-10T23:18:58.303636+0000","last_peered":"2024-09-10T23:18:58.303636+0000","last_clean":"2024-09-10T23:18:58.303636+0000","last_became_active":"2024-09-10T23:18:56.099073+0000","last_became_peered":"2024-09-10T23:18:56.099073+0000","last_unstale":"2024-09-10T23:18:58.303636+0000","last_undegraded":"2024-09-10T23:18:58.303636+0000","last_fullsized":"2024-09-10T23:18:58.303636+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:28.433276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078463+0000","last_change":"2024-09-10T23:18:56.084874+0000","last_active":"2024-09-10T23:18:57.078463+0000","last_peered":"2024-09-10T23:18:57.078463+0000","last_clean":"2024-09-10T23:18:57.078463+0000","last_became_active":"2024-09-10T23:18:56.084613+0000","last_became_peered":"2024-09-10T23:18:56.084613+0000","last_unstale":"2024-09-10T23:18:57.078463+0000","last_undegraded":"2024-09-10T23:18:57.078463+0000","last_fullsized":"2024-09-10T23:18:57.078463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:36.008049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.100383+0000","last_change":"2024-09-10T23:18:56.098682+0000","last_active":"2024-09-10T23:18:56.100383+0000","last_peered":"2024-09-10T23:18:56.100383+0000","last_clean":"2024-09-10T23:18:56.100383+0000","last_became_active":"2024-09-10T23:18:56.098439+0000","last_became_peered":"2024-09-10T23:18:56.098439+0000","last_unstale":"2024-09-10T23:18:56.100383+0000","last_undegraded":"2024-09-10T23:18:56.100383+0000","last_fullsized":"2024-09-10T23:18:56.100383+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:14.017730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081881+0000","last_change":"2024-09-10T23:18:56.082038+0000","last_active":"2024-09-10T23:18:57.081881+0000","last_peered":"2024-09-10T23:18:57.081881+0000","last_clean":"2024-09-10T23:18:57.081881+0000","last_became_active":"2024-09-10T23:18:56.081318+0000","last_became_peered":"2024-09-10T23:18:56.081318+0000","last_unstale":"2024-09-10T23:18:57.081881+0000","last_undegraded":"2024-09-10T23:18:57.081881+0000","last_fullsized":"2024-09-10T23:18:57.081881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:04.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068588+0000","last_change":"2024-09-10T23:18:55.068588+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068588+0000","last_undegraded":"2024-09-10T23:18:55.068588+0000","last_fullsized":"2024-09-10T23:18:55.068588+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081432+0000","last_change":"2024-09-10T23:18:56.095428+0000","last_active":"2024-09-10T23:18:57.081432+0000","last_peered":"2024-09-10T23:18:57.081432+0000","last_clean":"2024-09-10T23:18:57.081432+0000","last_became_active":"2024-09-10T23:18:56.095142+0000","last_became_peered":"2024-09-10T23:18:56.095142+0000","last_unstale":"2024-09-10T23:18:57.081432+0000","last_undegraded":"2024-09-10T23:18:57.081432+0000","last_fullsized":"2024-09-10T23:18:57.081432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:29.469274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304783+0000","last_change":"2024-09-10T23:18:56.094564+0000","last_active":"2024-09-10T23:18:58.304783+0000","last_peered":"2024-09-10T23:18:58.304783+0000","last_clean":"2024-09-10T23:18:58.304783+0000","last_became_active":"2024-09-10T23:18:56.093925+0000","last_became_peered":"2024-09-10T23:18:56.093925+0000","last_unstale":"2024-09-10T23:18:58.304783+0000","last_undegraded":"2024-09-10T23:18:58.304783+0000","last_fullsized":"2024-09-10T23:18:58.304783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:19.401580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068498+0000","last_change":"2024-09-10T23:18:55.068498+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068498+0000","last_undegraded":"2024-09-10T23:18:55.068498+0000","last_fullsized":"2024-09-10T23:18:55.068498+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.101813+0000","last_change":"2024-09-10T23:18:55.084728+0000","last_active":"2024-09-10T23:18:56.101813+0000","last_peered":"2024-09-10T23:18:56.101813+0000","last_clean":"2024-09-10T23:18:56.101813+0000","last_became_active":"2024-09-10T23:18:55.083761+0000","last_became_peered":"2024-09-10T23:18:55.083761+0000","last_unstale":"2024-09-10T23:18:56.101813+0000","last_undegraded":"2024-09-10T23:18:56.101813+0000","last_fullsized":"2024-09-10T23:18:56.101813+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:10.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305509+0000","last_change":"2024-09-10T23:18:56.095498+0000","last_active":"2024-09-10T23:18:58.305509+0000","last_peered":"2024-09-10T23:18:58.305509+0000","last_clean":"2024-09-10T23:18:58.305509+0000","last_became_active":"2024-09-10T23:18:56.093254+0000","last_became_peered":"2024-09-10T23:18:56.093254+0000","last_unstale":"2024-09-10T23:18:58.305509+0000","last_undegraded":"2024-09-10T23:18:58.305509+0000","last_fullsized":"2024-09-10T23:18:58.305509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:29.469274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078629+0000","last_change":"2024-09-10T23:18:55.086808+0000","last_active":"2024-09-10T23:18:57.078629+0000","last_peered":"2024-09-10T23:18:57.078629+0000","last_clean":"2024-09-10T23:18:57.078629+0000","last_became_active":"2024-09-10T23:18:55.086532+0000","last_became_peered":"2024-09-10T23:18:55.086532+0000","last_unstale":"2024-09-10T23:18:57.078629+0000","last_undegraded":"2024-09-10T23:18:57.078629+0000","last_fullsized":"2024-09-10T23:18:57.078629+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.093849+0000","last_change":"2024-09-10T23:18:56.092067+0000","last_active":"2024-09-10T23:18:56.093849+0000","last_peered":"2024-09-10T23:18:56.093849+0000","last_clean":"2024-09-10T23:18:56.093849+0000","last_became_active":"2024-09-10T23:18:56.091772+0000","last_became_peered":"2024-09-10T23:18:56.091772+0000","last_unstale":"2024-09-10T23:18:56.093849+0000","last_undegraded":"2024-09-10T23:18:56.093849+0000","last_fullsized":"2024-09-10T23:18:56.093849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:56.252112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078517+0000","last_change":"2024-09-10T23:18:55.078770+0000","last_active":"2024-09-10T23:18:57.078517+0000","last_peered":"2024-09-10T23:18:57.078517+0000","last_clean":"2024-09-10T23:18:57.078517+0000","last_became_active":"2024-09-10T23:18:55.078521+0000","last_became_peered":"2024-09-10T23:18:55.078521+0000","last_unstale":"2024-09-10T23:18:57.078517+0000","last_undegraded":"2024-09-10T23:18:57.078517+0000","last_fullsized":"2024-09-10T23:18:57.078517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:09.389758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303590+0000","last_change":"2024-09-10T23:18:56.100648+0000","last_active":"2024-09-10T23:18:58.303590+0000","last_peered":"2024-09-10T23:18:58.303590+0000","last_clean":"2024-09-10T23:18:58.303590+0000","last_became_active":"2024-09-10T23:18:56.098241+0000","last_became_peered":"2024-09-10T23:18:56.098241+0000","last_unstale":"2024-09-10T23:18:58.303590+0000","last_undegraded":"2024-09-10T23:18:58.303590+0000","last_fullsized":"2024-09-10T23:18:58.303590+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:30.964405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305291+0000","last_change":"2024-09-10T23:18:55.089746+0000","last_active":"2024-09-10T23:18:58.305291+0000","last_peered":"2024-09-10T23:18:58.305291+0000","last_clean":"2024-09-10T23:18:58.305291+0000","last_became_active":"2024-09-10T23:18:55.089507+0000","last_became_peered":"2024-09-10T23:18:55.089507+0000","last_unstale":"2024-09-10T23:18:58.305291+0000","last_undegraded":"2024-09-10T23:18:58.305291+0000","last_fullsized":"2024-09-10T23:18:58.305291+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:44.064508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073013+0000","last_change":"2024-09-10T23:18:55.073013+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073013+0000","last_undegraded":"2024-09-10T23:18:55.073013+0000","last_fullsized":"2024-09-10T23:18:55.073013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081829+0000","last_change":"2024-09-10T23:18:55.088922+0000","last_active":"2024-09-10T23:18:57.081829+0000","last_peered":"2024-09-10T23:18:57.081829+0000","last_clean":"2024-09-10T23:18:57.081829+0000","last_became_active":"2024-09-10T23:18:55.088591+0000","last_became_peered":"2024-09-10T23:18:55.088591+0000","last_unstale":"2024-09-10T23:18:57.081829+0000","last_undegraded":"2024-09-10T23:18:57.081829+0000","last_fullsized":"2024-09-10T23:18:57.081829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.907855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068842+0000","last_change":"2024-09-10T23:18:55.068842+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068842+0000","last_undegraded":"2024-09-10T23:18:55.068842+0000","last_fullsized":"2024-09-10T23:18:55.068842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.084422+0000","last_change":"2024-09-10T23:18:55.081624+0000","last_active":"2024-09-10T23:18:55.084422+0000","last_peered":"2024-09-10T23:18:55.084422+0000","last_clean":"2024-09-10T23:18:55.084422+0000","last_became_active":"2024-09-10T23:18:55.080250+0000","last_became_peered":"2024-09-10T23:18:55.080250+0000","last_unstale":"2024-09-10T23:18:55.084422+0000","last_undegraded":"2024-09-10T23:18:55.084422+0000","last_fullsized":"2024-09-10T23:18:55.084422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:08.556811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303988+0000","last_change":"2024-09-10T23:18:56.099137+0000","last_active":"2024-09-10T23:18:58.303988+0000","last_peered":"2024-09-10T23:18:58.303988+0000","last_clean":"2024-09-10T23:18:58.303988+0000","last_became_active":"2024-09-10T23:18:56.098260+0000","last_became_peered":"2024-09-10T23:18:56.098260+0000","last_unstale":"2024-09-10T23:18:58.303988+0000","last_undegraded":"2024-09-10T23:18:58.303988+0000","last_fullsized":"2024-09-10T23:18:58.303988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:40.800736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.078689+0000","last_change":"2024-09-10T23:18:55.080384+0000","last_active":"2024-09-10T23:18:56.078689+0000","last_peered":"2024-09-10T23:18:56.078689+0000","last_clean":"2024-09-10T23:18:56.078689+0000","last_became_active":"2024-09-10T23:18:55.080119+0000","last_became_peered":"2024-09-10T23:18:55.080119+0000","last_unstale":"2024-09-10T23:18:56.078689+0000","last_undegraded":"2024-09-10T23:18:56.078689+0000","last_fullsized":"2024-09-10T23:18:56.078689+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:32.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068578+0000","last_change":"2024-09-10T23:18:55.068578+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068578+0000","last_undegraded":"2024-09-10T23:18:55.068578+0000","last_fullsized":"2024-09-10T23:18:55.068578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081305+0000","last_change":"2024-09-10T23:18:55.081272+0000","last_active":"2024-09-10T23:18:57.081305+0000","last_peered":"2024-09-10T23:18:57.081305+0000","last_clean":"2024-09-10T23:18:57.081305+0000","last_became_active":"2024-09-10T23:18:55.080496+0000","last_became_peered":"2024-09-10T23:18:55.080496+0000","last_unstale":"2024-09-10T23:18:57.081305+0000","last_undegraded":"2024-09-10T23:18:57.081305+0000","last_fullsized":"2024-09-10T23:18:57.081305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.014724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072158+0000","last_change":"2024-09-10T23:18:55.072158+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072158+0000","last_undegraded":"2024-09-10T23:18:55.072158+0000","last_fullsized":"2024-09-10T23:18:55.072158+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.086326+0000","last_change":"2024-09-10T23:18:55.084970+0000","last_active":"2024-09-10T23:18:55.086326+0000","last_peered":"2024-09-10T23:18:55.086326+0000","last_clean":"2024-09-10T23:18:55.086326+0000","last_became_active":"2024-09-10T23:18:55.084721+0000","last_became_peered":"2024-09-10T23:18:55.084721+0000","last_unstale":"2024-09-10T23:18:55.086326+0000","last_undegraded":"2024-09-10T23:18:55.086326+0000","last_fullsized":"2024-09-10T23:18:55.086326+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.907855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305564+0000","last_change":"2024-09-10T23:18:56.086003+0000","last_active":"2024-09-10T23:18:58.305564+0000","last_peered":"2024-09-10T23:18:58.305564+0000","last_clean":"2024-09-10T23:18:58.305564+0000","last_became_active":"2024-09-10T23:18:56.085726+0000","last_became_peered":"2024-09-10T23:18:56.085726+0000","last_unstale":"2024-09-10T23:18:58.305564+0000","last_undegraded":"2024-09-10T23:18:58.305564+0000","last_fullsized":"2024-09-10T23:18:58.305564+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:36.226548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087234+0000","last_change":"2024-09-10T23:18:55.086081+0000","last_active":"2024-09-10T23:18:55.087234+0000","last_peered":"2024-09-10T23:18:55.087234+0000","last_clean":"2024-09-10T23:18:55.087234+0000","last_became_active":"2024-09-10T23:18:55.085795+0000","last_became_peered":"2024-09-10T23:18:55.085795+0000","last_unstale":"2024-09-10T23:18:55.087234+0000","last_undegraded":"2024-09-10T23:18:55.087234+0000","last_fullsized":"2024-09-10T23:18:55.087234+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:52.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081695+0000","last_change":"2024-09-10T23:18:56.084383+0000","last_active":"2024-09-10T23:18:57.081695+0000","last_peered":"2024-09-10T23:18:57.081695+0000","last_clean":"2024-09-10T23:18:57.081695+0000","last_became_active":"2024-09-10T23:18:56.084106+0000","last_became_peered":"2024-09-10T23:18:56.084106+0000","last_unstale":"2024-09-10T23:18:57.081695+0000","last_undegraded":"2024-09-10T23:18:57.081695+0000","last_fullsized":"2024-09-10T23:18:57.081695+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:04.492500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083086+0000","last_change":"2024-09-10T23:18:55.079369+0000","last_active":"2024-09-10T23:18:55.083086+0000","last_peered":"2024-09-10T23:18:55.083086+0000","last_clean":"2024-09-10T23:18:55.083086+0000","last_became_active":"2024-09-10T23:18:55.079064+0000","last_became_peered":"2024-09-10T23:18:55.079064+0000","last_unstale":"2024-09-10T23:18:55.083086+0000","last_undegraded":"2024-09-10T23:18:55.083086+0000","last_fullsized":"2024-09-10T23:18:55.083086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:50.837310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072678+0000","last_change":"2024-09-10T23:18:55.072678+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072678+0000","last_undegraded":"2024-09-10T23:18:55.072678+0000","last_fullsized":"2024-09-10T23:18:55.072678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304196+0000","last_change":"2024-09-10T23:18:55.082941+0000","last_active":"2024-09-10T23:18:58.304196+0000","last_peered":"2024-09-10T23:18:58.304196+0000","last_clean":"2024-09-10T23:18:58.304196+0000","last_became_active":"2024-09-10T23:18:55.082676+0000","last_became_peered":"2024-09-10T23:18:55.082676+0000","last_unstale":"2024-09-10T23:18:58.304196+0000","last_undegraded":"2024-09-10T23:18:58.304196+0000","last_fullsized":"2024-09-10T23:18:58.304196+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:13.177241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305036+0000","last_change":"2024-09-10T23:18:56.089047+0000","last_active":"2024-09-10T23:18:58.305036+0000","last_peered":"2024-09-10T23:18:58.305036+0000","last_clean":"2024-09-10T23:18:58.305036+0000","last_became_active":"2024-09-10T23:18:56.088792+0000","last_became_peered":"2024-09-10T23:18:56.088792+0000","last_unstale":"2024-09-10T23:18:58.305036+0000","last_undegraded":"2024-09-10T23:18:58.305036+0000","last_fullsized":"2024-09-10T23:18:58.305036+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:13.725585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081952+0000","last_change":"2024-09-10T23:18:55.081652+0000","last_active":"2024-09-10T23:18:57.081952+0000","last_peered":"2024-09-10T23:18:57.081952+0000","last_clean":"2024-09-10T23:18:57.081952+0000","last_became_active":"2024-09-10T23:18:55.081354+0000","last_became_peered":"2024-09-10T23:18:55.081354+0000","last_unstale":"2024-09-10T23:18:57.081952+0000","last_undegraded":"2024-09-10T23:18:57.081952+0000","last_fullsized":"2024-09-10T23:18:57.081952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:16.766558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082208+0000","last_change":"2024-09-10T23:18:56.091901+0000","last_active":"2024-09-10T23:18:57.082208+0000","last_peered":"2024-09-10T23:18:57.082208+0000","last_clean":"2024-09-10T23:18:57.082208+0000","last_became_active":"2024-09-10T23:18:56.091593+0000","last_became_peered":"2024-09-10T23:18:56.091593+0000","last_unstale":"2024-09-10T23:18:57.082208+0000","last_undegraded":"2024-09-10T23:18:57.082208+0000","last_fullsized":"2024-09-10T23:18:57.082208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:41.947788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.079089+0000","last_change":"2024-09-10T23:18:55.091463+0000","last_active":"2024-09-10T23:18:56.079089+0000","last_peered":"2024-09-10T23:18:56.079089+0000","last_clean":"2024-09-10T23:18:56.079089+0000","last_became_active":"2024-09-10T23:18:55.091157+0000","last_became_peered":"2024-09-10T23:18:55.091157+0000","last_unstale":"2024-09-10T23:18:56.079089+0000","last_undegraded":"2024-09-10T23:18:56.079089+0000","last_fullsized":"2024-09-10T23:18:56.079089+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303835+0000","last_change":"2024-09-10T23:18:56.090018+0000","last_active":"2024-09-10T23:18:58.303835+0000","last_peered":"2024-09-10T23:18:58.303835+0000","last_clean":"2024-09-10T23:18:58.303835+0000","last_became_active":"2024-09-10T23:18:56.089757+0000","last_became_peered":"2024-09-10T23:18:56.089757+0000","last_unstale":"2024-09-10T23:18:58.303835+0000","last_undegraded":"2024-09-10T23:18:58.303835+0000","last_fullsized":"2024-09-10T23:18:58.303835+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:25.270349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083179+0000","last_change":"2024-09-10T23:18:55.079923+0000","last_active":"2024-09-10T23:18:55.083179+0000","last_peered":"2024-09-10T23:18:55.083179+0000","last_clean":"2024-09-10T23:18:55.083179+0000","last_became_active":"2024-09-10T23:18:55.079648+0000","last_became_peered":"2024-09-10T23:18:55.079648+0000","last_unstale":"2024-09-10T23:18:55.083179+0000","last_undegraded":"2024-09-10T23:18:55.083179+0000","last_fullsized":"2024-09-10T23:18:55.083179+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.014724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082858+0000","last_change":"2024-09-10T23:18:56.085249+0000","last_active":"2024-09-10T23:18:57.082858+0000","last_peered":"2024-09-10T23:18:57.082858+0000","last_clean":"2024-09-10T23:18:57.082858+0000","last_became_active":"2024-09-10T23:18:56.084985+0000","last_became_peered":"2024-09-10T23:18:56.084985+0000","last_unstale":"2024-09-10T23:18:57.082858+0000","last_undegraded":"2024-09-10T23:18:57.082858+0000","last_fullsized":"2024-09-10T23:18:57.082858+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:41.406210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304434+0000","last_change":"2024-09-10T23:18:55.079172+0000","last_active":"2024-09-10T23:18:58.304434+0000","last_peered":"2024-09-10T23:18:58.304434+0000","last_clean":"2024-09-10T23:18:58.304434+0000","last_became_active":"2024-09-10T23:18:55.078915+0000","last_became_peered":"2024-09-10T23:18:55.078915+0000","last_unstale":"2024-09-10T23:18:58.304434+0000","last_undegraded":"2024-09-10T23:18:58.304434+0000","last_fullsized":"2024-09-10T23:18:58.304434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:25.929119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304506+0000","last_change":"2024-09-10T23:18:56.086456+0000","last_active":"2024-09-10T23:18:58.304506+0000","last_peered":"2024-09-10T23:18:58.304506+0000","last_clean":"2024-09-10T23:18:58.304506+0000","last_became_active":"2024-09-10T23:18:56.086195+0000","last_became_peered":"2024-09-10T23:18:56.086195+0000","last_unstale":"2024-09-10T23:18:58.304506+0000","last_undegraded":"2024-09-10T23:18:58.304506+0000","last_fullsized":"2024-09-10T23:18:58.304506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:21.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.083015+0000","last_change":"2024-09-10T23:18:55.091422+0000","last_active":"2024-09-10T23:18:57.083015+0000","last_peered":"2024-09-10T23:18:57.083015+0000","last_clean":"2024-09-10T23:18:57.083015+0000","last_became_active":"2024-09-10T23:18:55.091111+0000","last_became_peered":"2024-09-10T23:18:55.091111+0000","last_unstale":"2024-09-10T23:18:57.083015+0000","last_undegraded":"2024-09-10T23:18:57.083015+0000","last_fullsized":"2024-09-10T23:18:57.083015+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:32.265505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078201+0000","last_change":"2024-09-10T23:18:56.085889+0000","last_active":"2024-09-10T23:18:57.078201+0000","last_peered":"2024-09-10T23:18:57.078201+0000","last_clean":"2024-09-10T23:18:57.078201+0000","last_became_active":"2024-09-10T23:18:56.085620+0000","last_became_peered":"2024-09-10T23:18:56.085620+0000","last_unstale":"2024-09-10T23:18:57.078201+0000","last_undegraded":"2024-09-10T23:18:57.078201+0000","last_fullsized":"2024-09-10T23:18:57.078201+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:33.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303476+0000","last_change":"2024-09-10T23:18:55.080290+0000","last_active":"2024-09-10T23:18:58.303476+0000","last_peered":"2024-09-10T23:18:58.303476+0000","last_clean":"2024-09-10T23:18:58.303476+0000","last_became_active":"2024-09-10T23:18:55.080019+0000","last_became_peered":"2024-09-10T23:18:55.080019+0000","last_unstale":"2024-09-10T23:18:58.303476+0000","last_undegraded":"2024-09-10T23:18:58.303476+0000","last_fullsized":"2024-09-10T23:18:58.303476+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:10.811412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072563+0000","last_change":"2024-09-10T23:18:55.072563+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072563+0000","last_undegraded":"2024-09-10T23:18:55.072563+0000","last_fullsized":"2024-09-10T23:18:55.072563+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.107369+0000","last_change":"2024-09-10T23:18:55.082244+0000","last_active":"2024-09-10T23:18:56.107369+0000","last_peered":"2024-09-10T23:18:56.107369+0000","last_clean":"2024-09-10T23:18:56.107369+0000","last_became_active":"2024-09-10T23:18:55.081844+0000","last_became_peered":"2024-09-10T23:18:55.081844+0000","last_unstale":"2024-09-10T23:18:56.107369+0000","last_undegraded":"2024-09-10T23:18:56.107369+0000","last_fullsized":"2024-09-10T23:18:56.107369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:25.835051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078302+0000","last_change":"2024-09-10T23:18:56.089097+0000","last_active":"2024-09-10T23:18:57.078302+0000","last_peered":"2024-09-10T23:18:57.078302+0000","last_clean":"2024-09-10T23:18:57.078302+0000","last_became_active":"2024-09-10T23:18:56.088788+0000","last_became_peered":"2024-09-10T23:18:56.088788+0000","last_unstale":"2024-09-10T23:18:57.078302+0000","last_undegraded":"2024-09-10T23:18:57.078302+0000","last_fullsized":"2024-09-10T23:18:57.078302+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:14.797076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.078959+0000","last_change":"2024-09-10T23:18:55.091669+0000","last_active":"2024-09-10T23:18:56.078959+0000","last_peered":"2024-09-10T23:18:56.078959+0000","last_clean":"2024-09-10T23:18:56.078959+0000","last_became_active":"2024-09-10T23:18:55.091385+0000","last_became_peered":"2024-09-10T23:18:55.091385+0000","last_unstale":"2024-09-10T23:18:56.078959+0000","last_undegraded":"2024-09-10T23:18:56.078959+0000","last_fullsized":"2024-09-10T23:18:56.078959+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305475+0000","last_change":"2024-09-10T23:18:56.086556+0000","last_active":"2024-09-10T23:18:58.305475+0000","last_peered":"2024-09-10T23:18:58.305475+0000","last_clean":"2024-09-10T23:18:58.305475+0000","last_became_active":"2024-09-10T23:18:56.085413+0000","last_became_peered":"2024-09-10T23:18:56.085413+0000","last_unstale":"2024-09-10T23:18:58.305475+0000","last_undegraded":"2024-09-10T23:18:58.305475+0000","last_fullsized":"2024-09-10T23:18:58.305475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:09.674355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078493+0000","last_change":"2024-09-10T23:18:55.079031+0000","last_active":"2024-09-10T23:18:57.078493+0000","last_peered":"2024-09-10T23:18:57.078493+0000","last_clean":"2024-09-10T23:18:57.078493+0000","last_became_active":"2024-09-10T23:18:55.078641+0000","last_became_peered":"2024-09-10T23:18:55.078641+0000","last_unstale":"2024-09-10T23:18:57.078493+0000","last_undegraded":"2024-09-10T23:18:57.078493+0000","last_fullsized":"2024-09-10T23:18:57.078493+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.083932+0000","last_change":"2024-09-10T23:18:56.081745+0000","last_active":"2024-09-10T23:18:56.083932+0000","last_peered":"2024-09-10T23:18:56.083932+0000","last_clean":"2024-09-10T23:18:56.083932+0000","last_became_active":"2024-09-10T23:18:56.081423+0000","last_became_peered":"2024-09-10T23:18:56.081423+0000","last_unstale":"2024-09-10T23:18:56.083932+0000","last_undegraded":"2024-09-10T23:18:56.083932+0000","last_fullsized":"2024-09-10T23:18:56.083932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:31.869620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303236+0000","last_change":"2024-09-10T23:18:55.078083+0000","last_active":"2024-09-10T23:18:58.303236+0000","last_peered":"2024-09-10T23:18:58.303236+0000","last_clean":"2024-09-10T23:18:58.303236+0000","last_became_active":"2024-09-10T23:18:55.077157+0000","last_became_peered":"2024-09-10T23:18:55.077157+0000","last_unstale":"2024-09-10T23:18:58.303236+0000","last_undegraded":"2024-09-10T23:18:58.303236+0000","last_fullsized":"2024-09-10T23:18:58.303236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:03.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082419+0000","last_change":"2024-09-10T23:18:56.087759+0000","last_active":"2024-09-10T23:18:57.082419+0000","last_peered":"2024-09-10T23:18:57.082419+0000","last_clean":"2024-09-10T23:18:57.082419+0000","last_became_active":"2024-09-10T23:18:56.087498+0000","last_became_peered":"2024-09-10T23:18:56.087498+0000","last_unstale":"2024-09-10T23:18:57.082419+0000","last_undegraded":"2024-09-10T23:18:57.082419+0000","last_fullsized":"2024-09-10T23:18:57.082419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:52.852300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081512+0000","last_change":"2024-09-10T23:18:55.084173+0000","last_active":"2024-09-10T23:18:57.081512+0000","last_peered":"2024-09-10T23:18:57.081512+0000","last_clean":"2024-09-10T23:18:57.081512+0000","last_became_active":"2024-09-10T23:18:55.083904+0000","last_became_peered":"2024-09-10T23:18:55.083904+0000","last_unstale":"2024-09-10T23:18:57.081512+0000","last_undegraded":"2024-09-10T23:18:57.081512+0000","last_fullsized":"2024-09-10T23:18:57.081512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:11.325433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078698+0000","last_change":"2024-09-10T23:18:56.090774+0000","last_active":"2024-09-10T23:18:57.078698+0000","last_peered":"2024-09-10T23:18:57.078698+0000","last_clean":"2024-09-10T23:18:57.078698+0000","last_became_active":"2024-09-10T23:18:56.090248+0000","last_became_peered":"2024-09-10T23:18:56.090248+0000","last_unstale":"2024-09-10T23:18:57.078698+0000","last_undegraded":"2024-09-10T23:18:57.078698+0000","last_fullsized":"2024-09-10T23:18:57.078698+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:36.512116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.302991+0000","last_change":"2024-09-10T23:18:55.086839+0000","last_active":"2024-09-10T23:18:58.302991+0000","last_peered":"2024-09-10T23:18:58.302991+0000","last_clean":"2024-09-10T23:18:58.302991+0000","last_became_active":"2024-09-10T23:18:55.086582+0000","last_became_peered":"2024-09-10T23:18:55.086582+0000","last_unstale":"2024-09-10T23:18:58.302991+0000","last_undegraded":"2024-09-10T23:18:58.302991+0000","last_fullsized":"2024-09-10T23:18:58.302991+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:53.769535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304921+0000","last_change":"2024-09-10T23:18:56.094826+0000","last_active":"2024-09-10T23:18:58.304921+0000","last_peered":"2024-09-10T23:18:58.304921+0000","last_clean":"2024-09-10T23:18:58.304921+0000","last_became_active":"2024-09-10T23:18:56.094309+0000","last_became_peered":"2024-09-10T23:18:56.094309+0000","last_unstale":"2024-09-10T23:18:58.304921+0000","last_undegraded":"2024-09-10T23:18:58.304921+0000","last_fullsized":"2024-09-10T23:18:58.304921+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:14.379720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.103955+0000","last_change":"2024-09-10T23:18:55.088646+0000","last_active":"2024-09-10T23:18:56.103955+0000","last_peered":"2024-09-10T23:18:56.103955+0000","last_clean":"2024-09-10T23:18:56.103955+0000","last_became_active":"2024-09-10T23:18:55.088302+0000","last_became_peered":"2024-09-10T23:18:55.088302+0000","last_unstale":"2024-09-10T23:18:56.103955+0000","last_undegraded":"2024-09-10T23:18:56.103955+0000","last_fullsized":"2024-09-10T23:18:56.103955+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:45.168297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078265+0000","last_change":"2024-09-10T23:18:56.098890+0000","last_active":"2024-09-10T23:18:57.078265+0000","last_peered":"2024-09-10T23:18:57.078265+0000","last_clean":"2024-09-10T23:18:57.078265+0000","last_became_active":"2024-09-10T23:18:56.098619+0000","last_became_peered":"2024-09-10T23:18:56.098619+0000","last_unstale":"2024-09-10T23:18:57.078265+0000","last_undegraded":"2024-09-10T23:18:57.078265+0000","last_fullsized":"2024-09-10T23:18:57.078265+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:37.032240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087193+0000","last_change":"2024-09-10T23:18:55.086447+0000","last_active":"2024-09-10T23:18:55.087193+0000","last_peered":"2024-09-10T23:18:55.087193+0000","last_clean":"2024-09-10T23:18:55.087193+0000","last_became_active":"2024-09-10T23:18:55.086061+0000","last_became_peered":"2024-09-10T23:18:55.086061+0000","last_unstale":"2024-09-10T23:18:55.087193+0000","last_undegraded":"2024-09-10T23:18:55.087193+0000","last_fullsized":"2024-09-10T23:18:55.087193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:16.766558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303709+0000","last_change":"2024-09-10T23:18:56.089012+0000","last_active":"2024-09-10T23:18:58.303709+0000","last_peered":"2024-09-10T23:18:58.303709+0000","last_clean":"2024-09-10T23:18:58.303709+0000","last_became_active":"2024-09-10T23:18:56.088690+0000","last_became_peered":"2024-09-10T23:18:56.088690+0000","last_unstale":"2024-09-10T23:18:58.303709+0000","last_undegraded":"2024-09-10T23:18:58.303709+0000","last_fullsized":"2024-09-10T23:18:58.303709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:04.831502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081921+0000","last_change":"2024-09-10T23:18:55.087429+0000","last_active":"2024-09-10T23:18:57.081921+0000","last_peered":"2024-09-10T23:18:57.081921+0000","last_clean":"2024-09-10T23:18:57.081921+0000","last_became_active":"2024-09-10T23:18:55.084677+0000","last_became_peered":"2024-09-10T23:18:55.084677+0000","last_unstale":"2024-09-10T23:18:57.081921+0000","last_undegraded":"2024-09-10T23:18:57.081921+0000","last_fullsized":"2024-09-10T23:18:57.081921+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:18.725430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081923+0000","last_change":"2024-09-10T23:18:56.092467+0000","last_active":"2024-09-10T23:18:57.081923+0000","last_peered":"2024-09-10T23:18:57.081923+0000","last_clean":"2024-09-10T23:18:57.081923+0000","last_became_active":"2024-09-10T23:18:56.092160+0000","last_became_peered":"2024-09-10T23:18:56.092160+0000","last_unstale":"2024-09-10T23:18:57.081923+0000","last_undegraded":"2024-09-10T23:18:57.081923+0000","last_fullsized":"2024-09-10T23:18:57.081923+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.811870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303766+0000","last_change":"2024-09-10T23:18:55.082798+0000","last_active":"2024-09-10T23:18:58.303766+0000","last_peered":"2024-09-10T23:18:58.303766+0000","last_clean":"2024-09-10T23:18:58.303766+0000","last_became_active":"2024-09-10T23:18:55.082490+0000","last_became_peered":"2024-09-10T23:18:55.082490+0000","last_unstale":"2024-09-10T23:18:58.303766+0000","last_undegraded":"2024-09-10T23:18:58.303766+0000","last_fullsized":"2024-09-10T23:18:58.303766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:33.785544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305017+0000","last_change":"2024-09-10T23:18:56.090316+0000","last_active":"2024-09-10T23:18:58.305017+0000","last_peered":"2024-09-10T23:18:58.305017+0000","last_clean":"2024-09-10T23:18:58.305017+0000","last_became_active":"2024-09-10T23:18:56.090052+0000","last_became_peered":"2024-09-10T23:18:56.090052+0000","last_unstale":"2024-09-10T23:18:58.305017+0000","last_undegraded":"2024-09-10T23:18:58.305017+0000","last_fullsized":"2024-09-10T23:18:58.305017+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:20.751553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303364+0000","last_change":"2024-09-10T23:18:55.081060+0000","last_active":"2024-09-10T23:18:58.303364+0000","last_peered":"2024-09-10T23:18:58.303364+0000","last_clean":"2024-09-10T23:18:58.303364+0000","last_became_active":"2024-09-10T23:18:55.076346+0000","last_became_peered":"2024-09-10T23:18:55.076346+0000","last_unstale":"2024-09-10T23:18:58.303364+0000","last_undegraded":"2024-09-10T23:18:58.303364+0000","last_fullsized":"2024-09-10T23:18:58.303364+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:15.292325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082386+0000","last_change":"2024-09-10T23:18:56.102976+0000","last_active":"2024-09-10T23:18:57.082386+0000","last_peered":"2024-09-10T23:18:57.082386+0000","last_clean":"2024-09-10T23:18:57.082386+0000","last_became_active":"2024-09-10T23:18:56.101235+0000","last_became_peered":"2024-09-10T23:18:56.101235+0000","last_unstale":"2024-09-10T23:18:57.082386+0000","last_undegraded":"2024-09-10T23:18:57.082386+0000","last_fullsized":"2024-09-10T23:18:57.082386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:24.062275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.092837+0000","last_change":"2024-09-10T23:18:55.092277+0000","last_active":"2024-09-10T23:18:55.092837+0000","last_peered":"2024-09-10T23:18:55.092837+0000","last_clean":"2024-09-10T23:18:55.092837+0000","last_became_active":"2024-09-10T23:18:55.092026+0000","last_became_peered":"2024-09-10T23:18:55.092026+0000","last_unstale":"2024-09-10T23:18:55.092837+0000","last_undegraded":"2024-09-10T23:18:55.092837+0000","last_fullsized":"2024-09-10T23:18:55.092837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:56.711683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303882+0000","last_change":"2024-09-10T23:18:56.099522+0000","last_active":"2024-09-10T23:18:58.303882+0000","last_peered":"2024-09-10T23:18:58.303882+0000","last_clean":"2024-09-10T23:18:58.303882+0000","last_became_active":"2024-09-10T23:18:56.099241+0000","last_became_peered":"2024-09-10T23:18:56.099241+0000","last_unstale":"2024-09-10T23:18:58.303882+0000","last_undegraded":"2024-09-10T23:18:58.303882+0000","last_fullsized":"2024-09-10T23:18:58.303882+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:58.597638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305155+0000","last_change":"2024-09-10T23:18:55.083197+0000","last_active":"2024-09-10T23:18:58.305155+0000","last_peered":"2024-09-10T23:18:58.305155+0000","last_clean":"2024-09-10T23:18:58.305155+0000","last_became_active":"2024-09-10T23:18:55.082785+0000","last_became_peered":"2024-09-10T23:18:55.082785+0000","last_unstale":"2024-09-10T23:18:58.305155+0000","last_undegraded":"2024-09-10T23:18:58.305155+0000","last_fullsized":"2024-09-10T23:18:58.305155+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:11.391580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.089696+0000","last_change":"2024-09-10T23:18:56.085814+0000","last_active":"2024-09-10T23:18:56.089696+0000","last_peered":"2024-09-10T23:18:56.089696+0000","last_clean":"2024-09-10T23:18:56.089696+0000","last_became_active":"2024-09-10T23:18:56.085558+0000","last_became_peered":"2024-09-10T23:18:56.085558+0000","last_unstale":"2024-09-10T23:18:56.089696+0000","last_undegraded":"2024-09-10T23:18:56.089696+0000","last_fullsized":"2024-09-10T23:18:56.089696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:07.964858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"57'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082548+0000","last_change":"2024-09-10T23:18:55.079748+0000","last_active":"2024-09-10T23:18:57.082548+0000","last_peered":"2024-09-10T23:18:57.082548+0000","last_clean":"2024-09-10T23:18:57.082548+0000","last_became_active":"2024-09-10T23:18:55.079369+0000","last_became_peered":"2024-09-10T23:18:55.079369+0000","last_unstale":"2024-09-10T23:18:57.082548+0000","last_undegraded":"2024-09-10T23:18:57.082548+0000","last_fullsized":"2024-09-10T23:18:57.082548+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:05.324333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":171,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.069675+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:18:55.069675+0000","last_peered":"2024-09-10T23:18:55.069675+0000","last_clean":"2024-09-10T23:18:55.069675+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:18:55.069675+0000","last_undegraded":"2024-09-10T23:18:55.069675+0000","last_fullsized":"2024-09-10T23:18:55.069675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476781,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40168,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331672,"statfs":{"total":96636764160,"available":96595632128,"internally_reserved":0,"allocated":667648,"data_stored":293101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46292,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325548,"statfs":{"total":96636764160,"available":96589361152,"internally_reserved":0,"allocated":1241088,"data_stored":875650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40164,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331676,"statfs":{"total":96636764160,"available":96595636224,"internally_reserved":0,"allocated":671744,"data_stored":299141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62352,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309488,"statfs":{"total":96636764160,"available":96572915712,"internally_reserved":0,"allocated":647168,"data_stored":285282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40176,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":684032,"data_stored":300753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":679936,"data_stored":299301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":1273856,"data_stored":889565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":294083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:01.024 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.069301+0000', 'last_change': '2024-09-10T23:18:55.069301+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.069301+0000', 'last_undegraded': '2024-09-10T23:18:55.069301+0000', 'last_fullsized': '2024-09-10T23:18:55.069301+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.068548+0000', 'last_change': '2024-09-10T23:18:55.068548+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.068548+0000', 'last_undegraded': '2024-09-10T23:18:55.068548+0000', 'last_fullsized': '2024-09-10T23:18:55.068548+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.073139+0000', 'last_change': '2024-09-10T23:18:55.073139+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.073139+0000', 'last_undegraded': '2024-09-10T23:18:55.073139+0000', 'last_fullsized': '2024-09-10T23:18:55.073139+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.068498+0000', 'last_change': '2024-09-10T23:18:55.068498+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.068498+0000', 'last_undegraded': '2024-09-10T23:18:55.068498+0000', 'last_fullsized': '2024-09-10T23:18:55.068498+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.068869+0000', 'last_change': '2024-09-10T23:18:55.068869+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.068869+0000', 'last_undegraded': '2024-09-10T23:18:55.068869+0000', 'last_fullsized': '2024-09-10T23:18:55.068869+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-09-10T23:19:01.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.068588+0000', 'last_change': '2024-09-10T23:18:55.068588+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.068588+0000', 'last_undegraded': '2024-09-10T23:18:55.068588+0000', 'last_fullsized': '2024-09-10T23:18:55.068588+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.068498+0000', 'last_change': '2024-09-10T23:18:55.068498+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.068498+0000', 'last_undegraded': '2024-09-10T23:18:55.068498+0000', 'last_fullsized': '2024-09-10T23:18:55.068498+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.073013+0000', 'last_change': '2024-09-10T23:18:55.073013+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.073013+0000', 'last_undegraded': '2024-09-10T23:18:55.073013+0000', 'last_fullsized': '2024-09-10T23:18:55.073013+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.068842+0000', 'last_change': '2024-09-10T23:18:55.068842+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.068842+0000', 'last_undegraded': '2024-09-10T23:18:55.068842+0000', 'last_fullsized': '2024-09-10T23:18:55.068842+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.068578+0000', 'last_change': '2024-09-10T23:18:55.068578+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.068578+0000', 'last_undegraded': '2024-09-10T23:18:55.068578+0000', 'last_fullsized': '2024-09-10T23:18:55.068578+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.072158+0000', 'last_change': '2024-09-10T23:18:55.072158+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.072158+0000', 'last_undegraded': '2024-09-10T23:18:55.072158+0000', 'last_fullsized': '2024-09-10T23:18:55.072158+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:19:01.026 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-10T23:19:01.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.072678+0000', 'last_change': '2024-09-10T23:18:55.072678+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.072678+0000', 'last_undegraded': '2024-09-10T23:18:55.072678+0000', 'last_fullsized': '2024-09-10T23:18:55.072678+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:19:01.027 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-10T23:19:01.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:18:55.072563+0000', 'last_change': '2024-09-10T23:18:55.072563+0000', 'last_active': '2024-09-10T23:18:55.056243+0000', 'last_peered': '2024-09-10T23:18:55.056243+0000', 'last_clean': '2024-09-10T23:18:55.056243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:18:55.072563+0000', 'last_undegraded': '2024-09-10T23:18:55.072563+0000', 'last_fullsized': '2024-09-10T23:18:55.072563+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:18:55.056243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:19:01.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:19:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.209+0000 7eff84000640 1 -- 172.21.15.17:0/3572863175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c06df30 msgr2=0x7eff7c0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.209+0000 7eff84000640 1 --2- 172.21.15.17:0/3572863175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c06df30 0x7eff7c0cfc60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7eff70009840 tx=0x7eff7001c760 comp rx=0 tx=0).stop 2024-09-10T23:19:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.209+0000 7eff84000640 1 -- 172.21.15.17:0/3572863175 shutdown_connections 2024-09-10T23:19:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.209+0000 7eff84000640 1 --2- 172.21.15.17:0/3572863175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c06df30 0x7eff7c0cfc60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.209+0000 7eff84000640 1 -- 172.21.15.17:0/3572863175 >> 172.21.15.17:0/3572863175 conn(0x7eff7c0d1d60 msgr2=0x7eff7c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.209+0000 7eff84000640 1 -- 172.21.15.17:0/3572863175 shutdown_connections 2024-09-10T23:19:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.209+0000 7eff84000640 1 -- 172.21.15.17:0/3572863175 wait complete. 2024-09-10T23:19:01.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 Processor -- start 2024-09-10T23:19:01.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 -- start start 2024-09-10T23:19:01.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff7c06df30 0x7eff7c0c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7c15f060 0x7eff7c0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c161040 0x7eff7c1fae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c16bfe0 con 0x7eff7c161040 2024-09-10T23:19:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c16be60 con 0x7eff7c15f060 2024-09-10T23:19:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff7c16c160 con 0x7eff7c06df30 2024-09-10T23:19:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff82000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c161040 0x7eff7c1fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff82000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c161040 0x7eff7c1fae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39468/0 (socket says 172.21.15.17:39468) 2024-09-10T23:19:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff82000640 1 -- 172.21.15.17:0/891118166 learned_addr learned my addr 172.21.15.17:0/891118166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff80c00640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7c15f060 0x7eff7c0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff81600640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff7c06df30 0x7eff7c0c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff82000640 1 -- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff7c06df30 msgr2=0x7eff7c0c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff82000640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff7c06df30 0x7eff7c0c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff82000640 1 -- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7c15f060 msgr2=0x7eff7c0b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff82000640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7c15f060 0x7eff7c0b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff82000640 1 -- 172.21.15.17:0/891118166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c0c8b70 con 0x7eff7c161040 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff80c00640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7c15f060 0x7eff7c0b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff82000640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c161040 0x7eff7c1fae30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c730 tx=0x7eff7400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff79600640 1 -- 172.21.15.17:0/891118166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74003b80 con 0x7eff7c161040 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff79600640 1 -- 172.21.15.17:0/891118166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff74003d40 con 0x7eff7c161040 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7c15c6e0 con 0x7eff7c161040 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff79600640 1 -- 172.21.15.17:0/891118166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740052d0 con 0x7eff7c161040 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff7c15c280 con 0x7eff7c161040 2024-09-10T23:19:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.213+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7c0cfc60 con 0x7eff7c161040 2024-09-10T23:19:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.217+0000 7eff79600640 1 -- 172.21.15.17:0/891118166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7eff74005680 con 0x7eff7c161040 2024-09-10T23:19:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.217+0000 7eff79600640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff5c072610 0x7eff5c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.217+0000 7eff79600640 1 -- 172.21.15.17:0/891118166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7eff74093420 con 0x7eff7c161040 2024-09-10T23:19:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.217+0000 7eff81600640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff5c072610 0x7eff5c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.217+0000 7eff81600640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff5c072610 0x7eff5c074ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff700af000 tx=0x7eff7001afa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.221+0000 7eff79600640 1 -- 172.21.15.17:0/891118166 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7eff7405e8e0 con 0x7eff7c161040 2024-09-10T23:19:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7eff7c074ab0 con 0x7eff7c161040 2024-09-10T23:19:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff79600640 1 -- 172.21.15.17:0/891118166 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1141 (secure 0 0 0) 0x7eff7405e1e0 con 0x7eff7c161040 2024-09-10T23:19:01.465 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:01.465 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":230,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":84},{"state_name":"creating+peering","count":13}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592688,"bytes_used":355852288,"bytes_avail":772738260992,"bytes_total":773094113280,"inactive_pgs_ratio":0.1340206116437912,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":29,"btime":"2024-09-10T23:18:59:082892+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5475}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-10T23:18:44.336683+0000","services":{}},"progress_events":{}} 2024-09-10T23:19:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff5c072610 msgr2=0x7eff5c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff5c072610 0x7eff5c074ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff700af000 tx=0x7eff7001afa0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c161040 msgr2=0x7eff7c1fae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c161040 0x7eff7c1fae30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c730 tx=0x7eff7400cbf0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 shutdown_connections 2024-09-10T23:19:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff5c072610 0x7eff5c074ad0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff7c161040 0x7eff7c1fae30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff7c15f060 0x7eff7c0b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 --2- 172.21.15.17:0/891118166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff7c06df30 0x7eff7c0c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 >> 172.21.15.17:0/891118166 conn(0x7eff7c0d1d60 msgr2=0x7eff7c15a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 shutdown_connections 2024-09-10T23:19:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.461+0000 7eff84000640 1 -- 172.21.15.17:0/891118166 wait complete. 2024-09-10T23:19:01.487 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:19:01.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 -- 172.21.15.17:0/1563339643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 msgr2=0x7f0d8015fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 --2- 172.21.15.17:0/1563339643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 0x7f0d8015fb90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0d80073c70 tx=0x7f0d7801cd80 comp rx=0 tx=0).stop 2024-09-10T23:19:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 -- 172.21.15.17:0/1563339643 shutdown_connections 2024-09-10T23:19:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 --2- 172.21.15.17:0/1563339643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 0x7f0d8015fb90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 --2- 172.21.15.17:0/1563339643 >> v2:172.21.15.77:3300/0 conn(0x7f0d800b4390 0x7f0d800d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 --2- 172.21.15.17:0/1563339643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d800cef60 0x7f0d800cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 -- 172.21.15.17:0/1563339643 >> 172.21.15.17:0/1563339643 conn(0x7f0d800b3870 msgr2=0x7f0d800b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 -- 172.21.15.17:0/1563339643 shutdown_connections 2024-09-10T23:19:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 -- 172.21.15.17:0/1563339643 wait complete. 2024-09-10T23:19:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 Processor -- start 2024-09-10T23:19:01.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.629+0000 7f0d87400640 1 -- start start 2024-09-10T23:19:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d87400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d800b4390 0x7f0d80157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d87400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d800cef60 0x7f0d801538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d87400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 0x7f0d80158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d87400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8015e3c0 con 0x7f0d800cf340 2024-09-10T23:19:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d87400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8015e240 con 0x7f0d800b4390 2024-09-10T23:19:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d87400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8015e540 con 0x7f0d800cef60 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d85400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 0x7f0d80158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d85400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 0x7f0d80158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39488/0 (socket says 172.21.15.17:39488) 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d85400640 1 -- 172.21.15.17:0/296508615 learned_addr learned my addr 172.21.15.17:0/296508615 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d7fe00640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d800cef60 0x7f0d801538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d84a00640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d800b4390 0x7f0d80157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d85400640 1 -- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d800cef60 msgr2=0x7f0d801538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d85400640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d800cef60 0x7f0d801538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d85400640 1 -- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d800b4390 msgr2=0x7f0d80157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d85400640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d800b4390 0x7f0d80157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d85400640 1 -- 172.21.15.17:0/296508615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d800b4d80 con 0x7f0d800cf340 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d84a00640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d800b4390 0x7f0d80157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d85400640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 0x7f0d80158520 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0d7801b430 tx=0x7f0d78005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d7cc00640 1 -- 172.21.15.17:0/296508615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d780bb070 con 0x7f0d800cf340 2024-09-10T23:19:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d7cc00640 1 -- 172.21.15.17:0/296508615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d78004d40 con 0x7f0d800cf340 2024-09-10T23:19:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d7cc00640 1 -- 172.21.15.17:0/296508615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d780b2040 con 0x7f0d800cf340 2024-09-10T23:19:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d800b5060 con 0x7f0d800cf340 2024-09-10T23:19:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d800b79a0 con 0x7f0d800cf340 2024-09-10T23:19:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8015fb90 con 0x7f0d800cf340 2024-09-10T23:19:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.633+0000 7f0d7cc00640 1 -- 172.21.15.17:0/296508615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0d780b5030 con 0x7f0d800cf340 2024-09-10T23:19:01.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.637+0000 7f0d7cc00640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0d600725e0 0x7f0d60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:01.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.637+0000 7f0d7cc00640 1 -- 172.21.15.17:0/296508615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f0d7812cd70 con 0x7f0d800cf340 2024-09-10T23:19:01.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.637+0000 7f0d84a00640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0d600725e0 0x7f0d60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:01.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.637+0000 7f0d84a00640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0d600725e0 0x7f0d60074aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d74005fd0 tx=0x7f0d74005e80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:01.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.641+0000 7f0d7cc00640 1 -- 172.21.15.17:0/296508615 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0d780f1de0 con 0x7f0d800cf340 2024-09-10T23:19:01.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.813+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d800b1030 con 0x7f0d600725e0 2024-09-10T23:19:01.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.817+0000 7f0d7cc00640 1 -- 172.21.15.17:0/296508615 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250878 (secure 0 0 0) 0x7f0d800b1030 con 0x7f0d600725e0 2024-09-10T23:19:01.825 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:01.826 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:19:01.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0d600725e0 msgr2=0x7f0d60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0d600725e0 0x7f0d60074aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d74005fd0 tx=0x7f0d74005e80 comp rx=0 tx=0).stop 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 msgr2=0x7f0d80158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 0x7f0d80158520 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0d7801b430 tx=0x7f0d78005b00 comp rx=0 tx=0).stop 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 shutdown_connections 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0d600725e0 0x7f0d60074aa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d800cf340 0x7f0d80158520 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0d800cef60 0x7f0d801538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 --2- 172.21.15.17:0/296508615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d800b4390 0x7f0d80157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 >> 172.21.15.17:0/296508615 conn(0x7f0d800b3870 msgr2=0x7f0d800b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 shutdown_connections 2024-09-10T23:19:01.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:01.821+0000 7f0d87400640 1 -- 172.21.15.17:0/296508615 wait complete. 2024-09-10T23:19:01.846 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-10T23:19:00.340135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347512,"kb_used_data":6388,"kb_used_omap":12,"kb_used_meta":340915,"kb_avail":754627208,"statfs":{"total":773094113280,"available":772738260992,"internally_reserved":0,"allocated":6541312,"data_stored":3536876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":349097521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001489"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078714+0000","last_change":"2024-09-10T23:18:56.090512+0000","last_active":"2024-09-10T23:18:57.078714+0000","last_peered":"2024-09-10T23:18:57.078714+0000","last_clean":"2024-09-10T23:18:57.078714+0000","last_became_active":"2024-09-10T23:18:56.089868+0000","last_became_peered":"2024-09-10T23:18:56.089868+0000","last_unstale":"2024-09-10T23:18:57.078714+0000","last_undegraded":"2024-09-10T23:18:57.078714+0000","last_fullsized":"2024-09-10T23:18:57.078714+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.364072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.069301+0000","last_change":"2024-09-10T23:18:55.069301+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.069301+0000","last_undegraded":"2024-09-10T23:18:55.069301+0000","last_fullsized":"2024-09-10T23:18:55.069301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082065+0000","last_change":"2024-09-10T23:18:56.104813+0000","last_active":"2024-09-10T23:18:57.082065+0000","last_peered":"2024-09-10T23:18:57.082065+0000","last_clean":"2024-09-10T23:18:57.082065+0000","last_became_active":"2024-09-10T23:18:56.103322+0000","last_became_peered":"2024-09-10T23:18:56.103322+0000","last_unstale":"2024-09-10T23:18:57.082065+0000","last_undegraded":"2024-09-10T23:18:57.082065+0000","last_fullsized":"2024-09-10T23:18:57.082065+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:27.592000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068548+0000","last_change":"2024-09-10T23:18:55.068548+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068548+0000","last_undegraded":"2024-09-10T23:18:55.068548+0000","last_fullsized":"2024-09-10T23:18:55.068548+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073139+0000","last_change":"2024-09-10T23:18:55.073139+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073139+0000","last_undegraded":"2024-09-10T23:18:55.073139+0000","last_fullsized":"2024-09-10T23:18:55.073139+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078393+0000","last_change":"2024-09-10T23:18:56.089275+0000","last_active":"2024-09-10T23:18:57.078393+0000","last_peered":"2024-09-10T23:18:57.078393+0000","last_clean":"2024-09-10T23:18:57.078393+0000","last_became_active":"2024-09-10T23:18:56.089026+0000","last_became_peered":"2024-09-10T23:18:56.089026+0000","last_unstale":"2024-09-10T23:18:57.078393+0000","last_undegraded":"2024-09-10T23:18:57.078393+0000","last_fullsized":"2024-09-10T23:18:57.078393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:45.067514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081381+0000","last_change":"2024-09-10T23:18:56.102567+0000","last_active":"2024-09-10T23:18:57.081381+0000","last_peered":"2024-09-10T23:18:57.081381+0000","last_clean":"2024-09-10T23:18:57.081381+0000","last_became_active":"2024-09-10T23:18:56.102253+0000","last_became_peered":"2024-09-10T23:18:56.102253+0000","last_unstale":"2024-09-10T23:18:57.081381+0000","last_undegraded":"2024-09-10T23:18:57.081381+0000","last_fullsized":"2024-09-10T23:18:57.081381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:09.674355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304376+0000","last_change":"2024-09-10T23:18:56.082157+0000","last_active":"2024-09-10T23:18:58.304376+0000","last_peered":"2024-09-10T23:18:58.304376+0000","last_clean":"2024-09-10T23:18:58.304376+0000","last_became_active":"2024-09-10T23:18:56.081716+0000","last_became_peered":"2024-09-10T23:18:56.081716+0000","last_unstale":"2024-09-10T23:18:58.304376+0000","last_undegraded":"2024-09-10T23:18:58.304376+0000","last_fullsized":"2024-09-10T23:18:58.304376+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:53.382284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303880+0000","last_change":"2024-09-10T23:18:56.089945+0000","last_active":"2024-09-10T23:18:58.303880+0000","last_peered":"2024-09-10T23:18:58.303880+0000","last_clean":"2024-09-10T23:18:58.303880+0000","last_became_active":"2024-09-10T23:18:56.089450+0000","last_became_peered":"2024-09-10T23:18:56.089450+0000","last_unstale":"2024-09-10T23:18:58.303880+0000","last_undegraded":"2024-09-10T23:18:58.303880+0000","last_fullsized":"2024-09-10T23:18:58.303880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:55.404482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078682+0000","last_change":"2024-09-10T23:18:56.087156+0000","last_active":"2024-09-10T23:18:57.078682+0000","last_peered":"2024-09-10T23:18:57.078682+0000","last_clean":"2024-09-10T23:18:57.078682+0000","last_became_active":"2024-09-10T23:18:56.086901+0000","last_became_peered":"2024-09-10T23:18:56.086901+0000","last_unstale":"2024-09-10T23:18:57.078682+0000","last_undegraded":"2024-09-10T23:18:57.078682+0000","last_fullsized":"2024-09-10T23:18:57.078682+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:24.643459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303591+0000","last_change":"2024-09-10T23:18:56.097512+0000","last_active":"2024-09-10T23:18:58.303591+0000","last_peered":"2024-09-10T23:18:58.303591+0000","last_clean":"2024-09-10T23:18:58.303591+0000","last_became_active":"2024-09-10T23:18:56.097259+0000","last_became_peered":"2024-09-10T23:18:56.097259+0000","last_unstale":"2024-09-10T23:18:58.303591+0000","last_undegraded":"2024-09-10T23:18:58.303591+0000","last_fullsized":"2024-09-10T23:18:58.303591+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:54.682126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304143+0000","last_change":"2024-09-10T23:18:56.092902+0000","last_active":"2024-09-10T23:18:58.304143+0000","last_peered":"2024-09-10T23:18:58.304143+0000","last_clean":"2024-09-10T23:18:58.304143+0000","last_became_active":"2024-09-10T23:18:56.092627+0000","last_became_peered":"2024-09-10T23:18:56.092627+0000","last_unstale":"2024-09-10T23:18:58.304143+0000","last_undegraded":"2024-09-10T23:18:58.304143+0000","last_fullsized":"2024-09-10T23:18:58.304143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:24.288734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078475+0000","last_change":"2024-09-10T23:18:56.091763+0000","last_active":"2024-09-10T23:18:57.078475+0000","last_peered":"2024-09-10T23:18:57.078475+0000","last_clean":"2024-09-10T23:18:57.078475+0000","last_became_active":"2024-09-10T23:18:56.091453+0000","last_became_peered":"2024-09-10T23:18:56.091453+0000","last_unstale":"2024-09-10T23:18:57.078475+0000","last_undegraded":"2024-09-10T23:18:57.078475+0000","last_fullsized":"2024-09-10T23:18:57.078475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:12.394587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081507+0000","last_change":"2024-09-10T23:18:56.098733+0000","last_active":"2024-09-10T23:18:57.081507+0000","last_peered":"2024-09-10T23:18:57.081507+0000","last_clean":"2024-09-10T23:18:57.081507+0000","last_became_active":"2024-09-10T23:18:56.095590+0000","last_became_peered":"2024-09-10T23:18:56.095590+0000","last_unstale":"2024-09-10T23:18:57.081507+0000","last_undegraded":"2024-09-10T23:18:57.081507+0000","last_fullsized":"2024-09-10T23:18:57.081507+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:36.226548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068498+0000","last_change":"2024-09-10T23:18:55.068498+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068498+0000","last_undegraded":"2024-09-10T23:18:55.068498+0000","last_fullsized":"2024-09-10T23:18:55.068498+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078185+0000","last_change":"2024-09-10T23:18:56.086441+0000","last_active":"2024-09-10T23:18:57.078185+0000","last_peered":"2024-09-10T23:18:57.078185+0000","last_clean":"2024-09-10T23:18:57.078185+0000","last_became_active":"2024-09-10T23:18:56.086241+0000","last_became_peered":"2024-09-10T23:18:56.086241+0000","last_unstale":"2024-09-10T23:18:57.078185+0000","last_undegraded":"2024-09-10T23:18:57.078185+0000","last_fullsized":"2024-09-10T23:18:57.078185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.947052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082783+0000","last_change":"2024-09-10T23:18:56.085163+0000","last_active":"2024-09-10T23:18:57.082783+0000","last_peered":"2024-09-10T23:18:57.082783+0000","last_clean":"2024-09-10T23:18:57.082783+0000","last_became_active":"2024-09-10T23:18:56.084615+0000","last_became_peered":"2024-09-10T23:18:56.084615+0000","last_unstale":"2024-09-10T23:18:57.082783+0000","last_undegraded":"2024-09-10T23:18:57.082783+0000","last_fullsized":"2024-09-10T23:18:57.082783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:33.804083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068869+0000","last_change":"2024-09-10T23:18:55.068869+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068869+0000","last_undegraded":"2024-09-10T23:18:55.068869+0000","last_fullsized":"2024-09-10T23:18:55.068869+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082097+0000","last_change":"2024-09-10T23:18:56.071603+0000","last_active":"2024-09-10T23:18:57.082097+0000","last_peered":"2024-09-10T23:18:57.082097+0000","last_clean":"2024-09-10T23:18:57.082097+0000","last_became_active":"2024-09-10T23:18:56.071266+0000","last_became_peered":"2024-09-10T23:18:56.071266+0000","last_unstale":"2024-09-10T23:18:57.082097+0000","last_undegraded":"2024-09-10T23:18:57.082097+0000","last_fullsized":"2024-09-10T23:18:57.082097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:23.999216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.083743+0000","last_change":"2024-09-10T23:18:56.081732+0000","last_active":"2024-09-10T23:18:56.083743+0000","last_peered":"2024-09-10T23:18:56.083743+0000","last_clean":"2024-09-10T23:18:56.083743+0000","last_became_active":"2024-09-10T23:18:56.081395+0000","last_became_peered":"2024-09-10T23:18:56.081395+0000","last_unstale":"2024-09-10T23:18:56.083743+0000","last_undegraded":"2024-09-10T23:18:56.083743+0000","last_fullsized":"2024-09-10T23:18:56.083743+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:10.392764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.094299+0000","last_change":"2024-09-10T23:18:56.092352+0000","last_active":"2024-09-10T23:18:56.094299+0000","last_peered":"2024-09-10T23:18:56.094299+0000","last_clean":"2024-09-10T23:18:56.094299+0000","last_became_active":"2024-09-10T23:18:56.092077+0000","last_became_peered":"2024-09-10T23:18:56.092077+0000","last_unstale":"2024-09-10T23:18:56.094299+0000","last_undegraded":"2024-09-10T23:18:56.094299+0000","last_fullsized":"2024-09-10T23:18:56.094299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:51.840316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303137+0000","last_change":"2024-09-10T23:18:56.088908+0000","last_active":"2024-09-10T23:18:58.303137+0000","last_peered":"2024-09-10T23:18:58.303137+0000","last_clean":"2024-09-10T23:18:58.303137+0000","last_became_active":"2024-09-10T23:18:56.088628+0000","last_became_peered":"2024-09-10T23:18:56.088628+0000","last_unstale":"2024-09-10T23:18:58.303137+0000","last_undegraded":"2024-09-10T23:18:58.303137+0000","last_fullsized":"2024-09-10T23:18:58.303137+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:32.936954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303115+0000","last_change":"2024-09-10T23:18:56.097569+0000","last_active":"2024-09-10T23:18:58.303115+0000","last_peered":"2024-09-10T23:18:58.303115+0000","last_clean":"2024-09-10T23:18:58.303115+0000","last_became_active":"2024-09-10T23:18:56.097237+0000","last_became_peered":"2024-09-10T23:18:56.097237+0000","last_unstale":"2024-09-10T23:18:58.303115+0000","last_undegraded":"2024-09-10T23:18:58.303115+0000","last_fullsized":"2024-09-10T23:18:58.303115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:03.488812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081320+0000","last_change":"2024-09-10T23:18:56.088747+0000","last_active":"2024-09-10T23:18:57.081320+0000","last_peered":"2024-09-10T23:18:57.081320+0000","last_clean":"2024-09-10T23:18:57.081320+0000","last_became_active":"2024-09-10T23:18:56.088010+0000","last_became_peered":"2024-09-10T23:18:56.088010+0000","last_unstale":"2024-09-10T23:18:57.081320+0000","last_undegraded":"2024-09-10T23:18:57.081320+0000","last_fullsized":"2024-09-10T23:18:57.081320+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:13.725585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082898+0000","last_change":"2024-09-10T23:18:56.092590+0000","last_active":"2024-09-10T23:18:57.082898+0000","last_peered":"2024-09-10T23:18:57.082898+0000","last_clean":"2024-09-10T23:18:57.082898+0000","last_became_active":"2024-09-10T23:18:56.092231+0000","last_became_peered":"2024-09-10T23:18:56.092231+0000","last_unstale":"2024-09-10T23:18:57.082898+0000","last_undegraded":"2024-09-10T23:18:57.082898+0000","last_fullsized":"2024-09-10T23:18:57.082898+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:52.814090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303636+0000","last_change":"2024-09-10T23:18:56.099351+0000","last_active":"2024-09-10T23:18:58.303636+0000","last_peered":"2024-09-10T23:18:58.303636+0000","last_clean":"2024-09-10T23:18:58.303636+0000","last_became_active":"2024-09-10T23:18:56.099073+0000","last_became_peered":"2024-09-10T23:18:56.099073+0000","last_unstale":"2024-09-10T23:18:58.303636+0000","last_undegraded":"2024-09-10T23:18:58.303636+0000","last_fullsized":"2024-09-10T23:18:58.303636+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:28.433276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078463+0000","last_change":"2024-09-10T23:18:56.084874+0000","last_active":"2024-09-10T23:18:57.078463+0000","last_peered":"2024-09-10T23:18:57.078463+0000","last_clean":"2024-09-10T23:18:57.078463+0000","last_became_active":"2024-09-10T23:18:56.084613+0000","last_became_peered":"2024-09-10T23:18:56.084613+0000","last_unstale":"2024-09-10T23:18:57.078463+0000","last_undegraded":"2024-09-10T23:18:57.078463+0000","last_fullsized":"2024-09-10T23:18:57.078463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:36.008049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.100383+0000","last_change":"2024-09-10T23:18:56.098682+0000","last_active":"2024-09-10T23:18:56.100383+0000","last_peered":"2024-09-10T23:18:56.100383+0000","last_clean":"2024-09-10T23:18:56.100383+0000","last_became_active":"2024-09-10T23:18:56.098439+0000","last_became_peered":"2024-09-10T23:18:56.098439+0000","last_unstale":"2024-09-10T23:18:56.100383+0000","last_undegraded":"2024-09-10T23:18:56.100383+0000","last_fullsized":"2024-09-10T23:18:56.100383+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:14.017730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081881+0000","last_change":"2024-09-10T23:18:56.082038+0000","last_active":"2024-09-10T23:18:57.081881+0000","last_peered":"2024-09-10T23:18:57.081881+0000","last_clean":"2024-09-10T23:18:57.081881+0000","last_became_active":"2024-09-10T23:18:56.081318+0000","last_became_peered":"2024-09-10T23:18:56.081318+0000","last_unstale":"2024-09-10T23:18:57.081881+0000","last_undegraded":"2024-09-10T23:18:57.081881+0000","last_fullsized":"2024-09-10T23:18:57.081881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:04.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068588+0000","last_change":"2024-09-10T23:18:55.068588+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068588+0000","last_undegraded":"2024-09-10T23:18:55.068588+0000","last_fullsized":"2024-09-10T23:18:55.068588+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081432+0000","last_change":"2024-09-10T23:18:56.095428+0000","last_active":"2024-09-10T23:18:57.081432+0000","last_peered":"2024-09-10T23:18:57.081432+0000","last_clean":"2024-09-10T23:18:57.081432+0000","last_became_active":"2024-09-10T23:18:56.095142+0000","last_became_peered":"2024-09-10T23:18:56.095142+0000","last_unstale":"2024-09-10T23:18:57.081432+0000","last_undegraded":"2024-09-10T23:18:57.081432+0000","last_fullsized":"2024-09-10T23:18:57.081432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:29.469274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304783+0000","last_change":"2024-09-10T23:18:56.094564+0000","last_active":"2024-09-10T23:18:58.304783+0000","last_peered":"2024-09-10T23:18:58.304783+0000","last_clean":"2024-09-10T23:18:58.304783+0000","last_became_active":"2024-09-10T23:18:56.093925+0000","last_became_peered":"2024-09-10T23:18:56.093925+0000","last_unstale":"2024-09-10T23:18:58.304783+0000","last_undegraded":"2024-09-10T23:18:58.304783+0000","last_fullsized":"2024-09-10T23:18:58.304783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:19.401580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068498+0000","last_change":"2024-09-10T23:18:55.068498+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068498+0000","last_undegraded":"2024-09-10T23:18:55.068498+0000","last_fullsized":"2024-09-10T23:18:55.068498+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.101813+0000","last_change":"2024-09-10T23:18:55.084728+0000","last_active":"2024-09-10T23:18:56.101813+0000","last_peered":"2024-09-10T23:18:56.101813+0000","last_clean":"2024-09-10T23:18:56.101813+0000","last_became_active":"2024-09-10T23:18:55.083761+0000","last_became_peered":"2024-09-10T23:18:55.083761+0000","last_unstale":"2024-09-10T23:18:56.101813+0000","last_undegraded":"2024-09-10T23:18:56.101813+0000","last_fullsized":"2024-09-10T23:18:56.101813+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:10.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305509+0000","last_change":"2024-09-10T23:18:56.095498+0000","last_active":"2024-09-10T23:18:58.305509+0000","last_peered":"2024-09-10T23:18:58.305509+0000","last_clean":"2024-09-10T23:18:58.305509+0000","last_became_active":"2024-09-10T23:18:56.093254+0000","last_became_peered":"2024-09-10T23:18:56.093254+0000","last_unstale":"2024-09-10T23:18:58.305509+0000","last_undegraded":"2024-09-10T23:18:58.305509+0000","last_fullsized":"2024-09-10T23:18:58.305509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:29.469274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078629+0000","last_change":"2024-09-10T23:18:55.086808+0000","last_active":"2024-09-10T23:18:57.078629+0000","last_peered":"2024-09-10T23:18:57.078629+0000","last_clean":"2024-09-10T23:18:57.078629+0000","last_became_active":"2024-09-10T23:18:55.086532+0000","last_became_peered":"2024-09-10T23:18:55.086532+0000","last_unstale":"2024-09-10T23:18:57.078629+0000","last_undegraded":"2024-09-10T23:18:57.078629+0000","last_fullsized":"2024-09-10T23:18:57.078629+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.093849+0000","last_change":"2024-09-10T23:18:56.092067+0000","last_active":"2024-09-10T23:18:56.093849+0000","last_peered":"2024-09-10T23:18:56.093849+0000","last_clean":"2024-09-10T23:18:56.093849+0000","last_became_active":"2024-09-10T23:18:56.091772+0000","last_became_peered":"2024-09-10T23:18:56.091772+0000","last_unstale":"2024-09-10T23:18:56.093849+0000","last_undegraded":"2024-09-10T23:18:56.093849+0000","last_fullsized":"2024-09-10T23:18:56.093849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:56.252112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078517+0000","last_change":"2024-09-10T23:18:55.078770+0000","last_active":"2024-09-10T23:18:57.078517+0000","last_peered":"2024-09-10T23:18:57.078517+0000","last_clean":"2024-09-10T23:18:57.078517+0000","last_became_active":"2024-09-10T23:18:55.078521+0000","last_became_peered":"2024-09-10T23:18:55.078521+0000","last_unstale":"2024-09-10T23:18:57.078517+0000","last_undegraded":"2024-09-10T23:18:57.078517+0000","last_fullsized":"2024-09-10T23:18:57.078517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:09.389758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303590+0000","last_change":"2024-09-10T23:18:56.100648+0000","last_active":"2024-09-10T23:18:58.303590+0000","last_peered":"2024-09-10T23:18:58.303590+0000","last_clean":"2024-09-10T23:18:58.303590+0000","last_became_active":"2024-09-10T23:18:56.098241+0000","last_became_peered":"2024-09-10T23:18:56.098241+0000","last_unstale":"2024-09-10T23:18:58.303590+0000","last_undegraded":"2024-09-10T23:18:58.303590+0000","last_fullsized":"2024-09-10T23:18:58.303590+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:30.964405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305291+0000","last_change":"2024-09-10T23:18:55.089746+0000","last_active":"2024-09-10T23:18:58.305291+0000","last_peered":"2024-09-10T23:18:58.305291+0000","last_clean":"2024-09-10T23:18:58.305291+0000","last_became_active":"2024-09-10T23:18:55.089507+0000","last_became_peered":"2024-09-10T23:18:55.089507+0000","last_unstale":"2024-09-10T23:18:58.305291+0000","last_undegraded":"2024-09-10T23:18:58.305291+0000","last_fullsized":"2024-09-10T23:18:58.305291+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:44.064508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.073013+0000","last_change":"2024-09-10T23:18:55.073013+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.073013+0000","last_undegraded":"2024-09-10T23:18:55.073013+0000","last_fullsized":"2024-09-10T23:18:55.073013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081829+0000","last_change":"2024-09-10T23:18:55.088922+0000","last_active":"2024-09-10T23:18:57.081829+0000","last_peered":"2024-09-10T23:18:57.081829+0000","last_clean":"2024-09-10T23:18:57.081829+0000","last_became_active":"2024-09-10T23:18:55.088591+0000","last_became_peered":"2024-09-10T23:18:55.088591+0000","last_unstale":"2024-09-10T23:18:57.081829+0000","last_undegraded":"2024-09-10T23:18:57.081829+0000","last_fullsized":"2024-09-10T23:18:57.081829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.907855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068842+0000","last_change":"2024-09-10T23:18:55.068842+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068842+0000","last_undegraded":"2024-09-10T23:18:55.068842+0000","last_fullsized":"2024-09-10T23:18:55.068842+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.084422+0000","last_change":"2024-09-10T23:18:55.081624+0000","last_active":"2024-09-10T23:18:55.084422+0000","last_peered":"2024-09-10T23:18:55.084422+0000","last_clean":"2024-09-10T23:18:55.084422+0000","last_became_active":"2024-09-10T23:18:55.080250+0000","last_became_peered":"2024-09-10T23:18:55.080250+0000","last_unstale":"2024-09-10T23:18:55.084422+0000","last_undegraded":"2024-09-10T23:18:55.084422+0000","last_fullsized":"2024-09-10T23:18:55.084422+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:08.556811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303988+0000","last_change":"2024-09-10T23:18:56.099137+0000","last_active":"2024-09-10T23:18:58.303988+0000","last_peered":"2024-09-10T23:18:58.303988+0000","last_clean":"2024-09-10T23:18:58.303988+0000","last_became_active":"2024-09-10T23:18:56.098260+0000","last_became_peered":"2024-09-10T23:18:56.098260+0000","last_unstale":"2024-09-10T23:18:58.303988+0000","last_undegraded":"2024-09-10T23:18:58.303988+0000","last_fullsized":"2024-09-10T23:18:58.303988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:40.800736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.078689+0000","last_change":"2024-09-10T23:18:55.080384+0000","last_active":"2024-09-10T23:18:56.078689+0000","last_peered":"2024-09-10T23:18:56.078689+0000","last_clean":"2024-09-10T23:18:56.078689+0000","last_became_active":"2024-09-10T23:18:55.080119+0000","last_became_peered":"2024-09-10T23:18:55.080119+0000","last_unstale":"2024-09-10T23:18:56.078689+0000","last_undegraded":"2024-09-10T23:18:56.078689+0000","last_fullsized":"2024-09-10T23:18:56.078689+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:32.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.068578+0000","last_change":"2024-09-10T23:18:55.068578+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.068578+0000","last_undegraded":"2024-09-10T23:18:55.068578+0000","last_fullsized":"2024-09-10T23:18:55.068578+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081305+0000","last_change":"2024-09-10T23:18:55.081272+0000","last_active":"2024-09-10T23:18:57.081305+0000","last_peered":"2024-09-10T23:18:57.081305+0000","last_clean":"2024-09-10T23:18:57.081305+0000","last_became_active":"2024-09-10T23:18:55.080496+0000","last_became_peered":"2024-09-10T23:18:55.080496+0000","last_unstale":"2024-09-10T23:18:57.081305+0000","last_undegraded":"2024-09-10T23:18:57.081305+0000","last_fullsized":"2024-09-10T23:18:57.081305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.014724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072158+0000","last_change":"2024-09-10T23:18:55.072158+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072158+0000","last_undegraded":"2024-09-10T23:18:55.072158+0000","last_fullsized":"2024-09-10T23:18:55.072158+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.086326+0000","last_change":"2024-09-10T23:18:55.084970+0000","last_active":"2024-09-10T23:18:55.086326+0000","last_peered":"2024-09-10T23:18:55.086326+0000","last_clean":"2024-09-10T23:18:55.086326+0000","last_became_active":"2024-09-10T23:18:55.084721+0000","last_became_peered":"2024-09-10T23:18:55.084721+0000","last_unstale":"2024-09-10T23:18:55.086326+0000","last_undegraded":"2024-09-10T23:18:55.086326+0000","last_fullsized":"2024-09-10T23:18:55.086326+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.907855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305564+0000","last_change":"2024-09-10T23:18:56.086003+0000","last_active":"2024-09-10T23:18:58.305564+0000","last_peered":"2024-09-10T23:18:58.305564+0000","last_clean":"2024-09-10T23:18:58.305564+0000","last_became_active":"2024-09-10T23:18:56.085726+0000","last_became_peered":"2024-09-10T23:18:56.085726+0000","last_unstale":"2024-09-10T23:18:58.305564+0000","last_undegraded":"2024-09-10T23:18:58.305564+0000","last_fullsized":"2024-09-10T23:18:58.305564+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:36.226548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087234+0000","last_change":"2024-09-10T23:18:55.086081+0000","last_active":"2024-09-10T23:18:55.087234+0000","last_peered":"2024-09-10T23:18:55.087234+0000","last_clean":"2024-09-10T23:18:55.087234+0000","last_became_active":"2024-09-10T23:18:55.085795+0000","last_became_peered":"2024-09-10T23:18:55.085795+0000","last_unstale":"2024-09-10T23:18:55.087234+0000","last_undegraded":"2024-09-10T23:18:55.087234+0000","last_fullsized":"2024-09-10T23:18:55.087234+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:52.976345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081695+0000","last_change":"2024-09-10T23:18:56.084383+0000","last_active":"2024-09-10T23:18:57.081695+0000","last_peered":"2024-09-10T23:18:57.081695+0000","last_clean":"2024-09-10T23:18:57.081695+0000","last_became_active":"2024-09-10T23:18:56.084106+0000","last_became_peered":"2024-09-10T23:18:56.084106+0000","last_unstale":"2024-09-10T23:18:57.081695+0000","last_undegraded":"2024-09-10T23:18:57.081695+0000","last_fullsized":"2024-09-10T23:18:57.081695+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:04.492500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083086+0000","last_change":"2024-09-10T23:18:55.079369+0000","last_active":"2024-09-10T23:18:55.083086+0000","last_peered":"2024-09-10T23:18:55.083086+0000","last_clean":"2024-09-10T23:18:55.083086+0000","last_became_active":"2024-09-10T23:18:55.079064+0000","last_became_peered":"2024-09-10T23:18:55.079064+0000","last_unstale":"2024-09-10T23:18:55.083086+0000","last_undegraded":"2024-09-10T23:18:55.083086+0000","last_fullsized":"2024-09-10T23:18:55.083086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:50.837310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072678+0000","last_change":"2024-09-10T23:18:55.072678+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072678+0000","last_undegraded":"2024-09-10T23:18:55.072678+0000","last_fullsized":"2024-09-10T23:18:55.072678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304196+0000","last_change":"2024-09-10T23:18:55.082941+0000","last_active":"2024-09-10T23:18:58.304196+0000","last_peered":"2024-09-10T23:18:58.304196+0000","last_clean":"2024-09-10T23:18:58.304196+0000","last_became_active":"2024-09-10T23:18:55.082676+0000","last_became_peered":"2024-09-10T23:18:55.082676+0000","last_unstale":"2024-09-10T23:18:58.304196+0000","last_undegraded":"2024-09-10T23:18:58.304196+0000","last_fullsized":"2024-09-10T23:18:58.304196+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:13.177241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305036+0000","last_change":"2024-09-10T23:18:56.089047+0000","last_active":"2024-09-10T23:18:58.305036+0000","last_peered":"2024-09-10T23:18:58.305036+0000","last_clean":"2024-09-10T23:18:58.305036+0000","last_became_active":"2024-09-10T23:18:56.088792+0000","last_became_peered":"2024-09-10T23:18:56.088792+0000","last_unstale":"2024-09-10T23:18:58.305036+0000","last_undegraded":"2024-09-10T23:18:58.305036+0000","last_fullsized":"2024-09-10T23:18:58.305036+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:13.725585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081952+0000","last_change":"2024-09-10T23:18:55.081652+0000","last_active":"2024-09-10T23:18:57.081952+0000","last_peered":"2024-09-10T23:18:57.081952+0000","last_clean":"2024-09-10T23:18:57.081952+0000","last_became_active":"2024-09-10T23:18:55.081354+0000","last_became_peered":"2024-09-10T23:18:55.081354+0000","last_unstale":"2024-09-10T23:18:57.081952+0000","last_undegraded":"2024-09-10T23:18:57.081952+0000","last_fullsized":"2024-09-10T23:18:57.081952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:16.766558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082208+0000","last_change":"2024-09-10T23:18:56.091901+0000","last_active":"2024-09-10T23:18:57.082208+0000","last_peered":"2024-09-10T23:18:57.082208+0000","last_clean":"2024-09-10T23:18:57.082208+0000","last_became_active":"2024-09-10T23:18:56.091593+0000","last_became_peered":"2024-09-10T23:18:56.091593+0000","last_unstale":"2024-09-10T23:18:57.082208+0000","last_undegraded":"2024-09-10T23:18:57.082208+0000","last_fullsized":"2024-09-10T23:18:57.082208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:41.947788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.079089+0000","last_change":"2024-09-10T23:18:55.091463+0000","last_active":"2024-09-10T23:18:56.079089+0000","last_peered":"2024-09-10T23:18:56.079089+0000","last_clean":"2024-09-10T23:18:56.079089+0000","last_became_active":"2024-09-10T23:18:55.091157+0000","last_became_peered":"2024-09-10T23:18:55.091157+0000","last_unstale":"2024-09-10T23:18:56.079089+0000","last_undegraded":"2024-09-10T23:18:56.079089+0000","last_fullsized":"2024-09-10T23:18:56.079089+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303835+0000","last_change":"2024-09-10T23:18:56.090018+0000","last_active":"2024-09-10T23:18:58.303835+0000","last_peered":"2024-09-10T23:18:58.303835+0000","last_clean":"2024-09-10T23:18:58.303835+0000","last_became_active":"2024-09-10T23:18:56.089757+0000","last_became_peered":"2024-09-10T23:18:56.089757+0000","last_unstale":"2024-09-10T23:18:58.303835+0000","last_undegraded":"2024-09-10T23:18:58.303835+0000","last_fullsized":"2024-09-10T23:18:58.303835+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:25.270349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.083179+0000","last_change":"2024-09-10T23:18:55.079923+0000","last_active":"2024-09-10T23:18:55.083179+0000","last_peered":"2024-09-10T23:18:55.083179+0000","last_clean":"2024-09-10T23:18:55.083179+0000","last_became_active":"2024-09-10T23:18:55.079648+0000","last_became_peered":"2024-09-10T23:18:55.079648+0000","last_unstale":"2024-09-10T23:18:55.083179+0000","last_undegraded":"2024-09-10T23:18:55.083179+0000","last_fullsized":"2024-09-10T23:18:55.083179+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.014724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082858+0000","last_change":"2024-09-10T23:18:56.085249+0000","last_active":"2024-09-10T23:18:57.082858+0000","last_peered":"2024-09-10T23:18:57.082858+0000","last_clean":"2024-09-10T23:18:57.082858+0000","last_became_active":"2024-09-10T23:18:56.084985+0000","last_became_peered":"2024-09-10T23:18:56.084985+0000","last_unstale":"2024-09-10T23:18:57.082858+0000","last_undegraded":"2024-09-10T23:18:57.082858+0000","last_fullsized":"2024-09-10T23:18:57.082858+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:41.406210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304434+0000","last_change":"2024-09-10T23:18:55.079172+0000","last_active":"2024-09-10T23:18:58.304434+0000","last_peered":"2024-09-10T23:18:58.304434+0000","last_clean":"2024-09-10T23:18:58.304434+0000","last_became_active":"2024-09-10T23:18:55.078915+0000","last_became_peered":"2024-09-10T23:18:55.078915+0000","last_unstale":"2024-09-10T23:18:58.304434+0000","last_undegraded":"2024-09-10T23:18:58.304434+0000","last_fullsized":"2024-09-10T23:18:58.304434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:25.929119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304506+0000","last_change":"2024-09-10T23:18:56.086456+0000","last_active":"2024-09-10T23:18:58.304506+0000","last_peered":"2024-09-10T23:18:58.304506+0000","last_clean":"2024-09-10T23:18:58.304506+0000","last_became_active":"2024-09-10T23:18:56.086195+0000","last_became_peered":"2024-09-10T23:18:56.086195+0000","last_unstale":"2024-09-10T23:18:58.304506+0000","last_undegraded":"2024-09-10T23:18:58.304506+0000","last_fullsized":"2024-09-10T23:18:58.304506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:21.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.083015+0000","last_change":"2024-09-10T23:18:55.091422+0000","last_active":"2024-09-10T23:18:57.083015+0000","last_peered":"2024-09-10T23:18:57.083015+0000","last_clean":"2024-09-10T23:18:57.083015+0000","last_became_active":"2024-09-10T23:18:55.091111+0000","last_became_peered":"2024-09-10T23:18:55.091111+0000","last_unstale":"2024-09-10T23:18:57.083015+0000","last_undegraded":"2024-09-10T23:18:57.083015+0000","last_fullsized":"2024-09-10T23:18:57.083015+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:32.265505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078201+0000","last_change":"2024-09-10T23:18:56.085889+0000","last_active":"2024-09-10T23:18:57.078201+0000","last_peered":"2024-09-10T23:18:57.078201+0000","last_clean":"2024-09-10T23:18:57.078201+0000","last_became_active":"2024-09-10T23:18:56.085620+0000","last_became_peered":"2024-09-10T23:18:56.085620+0000","last_unstale":"2024-09-10T23:18:57.078201+0000","last_undegraded":"2024-09-10T23:18:57.078201+0000","last_fullsized":"2024-09-10T23:18:57.078201+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:33.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303476+0000","last_change":"2024-09-10T23:18:55.080290+0000","last_active":"2024-09-10T23:18:58.303476+0000","last_peered":"2024-09-10T23:18:58.303476+0000","last_clean":"2024-09-10T23:18:58.303476+0000","last_became_active":"2024-09-10T23:18:55.080019+0000","last_became_peered":"2024-09-10T23:18:55.080019+0000","last_unstale":"2024-09-10T23:18:58.303476+0000","last_undegraded":"2024-09-10T23:18:58.303476+0000","last_fullsized":"2024-09-10T23:18:58.303476+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:10.811412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-10T23:18:55.072563+0000","last_change":"2024-09-10T23:18:55.072563+0000","last_active":"2024-09-10T23:18:55.056243+0000","last_peered":"2024-09-10T23:18:55.056243+0000","last_clean":"2024-09-10T23:18:55.056243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:18:55.072563+0000","last_undegraded":"2024-09-10T23:18:55.072563+0000","last_fullsized":"2024-09-10T23:18:55.072563+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.107369+0000","last_change":"2024-09-10T23:18:55.082244+0000","last_active":"2024-09-10T23:18:56.107369+0000","last_peered":"2024-09-10T23:18:56.107369+0000","last_clean":"2024-09-10T23:18:56.107369+0000","last_became_active":"2024-09-10T23:18:55.081844+0000","last_became_peered":"2024-09-10T23:18:55.081844+0000","last_unstale":"2024-09-10T23:18:56.107369+0000","last_undegraded":"2024-09-10T23:18:56.107369+0000","last_fullsized":"2024-09-10T23:18:56.107369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:25.835051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078302+0000","last_change":"2024-09-10T23:18:56.089097+0000","last_active":"2024-09-10T23:18:57.078302+0000","last_peered":"2024-09-10T23:18:57.078302+0000","last_clean":"2024-09-10T23:18:57.078302+0000","last_became_active":"2024-09-10T23:18:56.088788+0000","last_became_peered":"2024-09-10T23:18:56.088788+0000","last_unstale":"2024-09-10T23:18:57.078302+0000","last_undegraded":"2024-09-10T23:18:57.078302+0000","last_fullsized":"2024-09-10T23:18:57.078302+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:14.797076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.078959+0000","last_change":"2024-09-10T23:18:55.091669+0000","last_active":"2024-09-10T23:18:56.078959+0000","last_peered":"2024-09-10T23:18:56.078959+0000","last_clean":"2024-09-10T23:18:56.078959+0000","last_became_active":"2024-09-10T23:18:55.091385+0000","last_became_peered":"2024-09-10T23:18:55.091385+0000","last_unstale":"2024-09-10T23:18:56.078959+0000","last_undegraded":"2024-09-10T23:18:56.078959+0000","last_fullsized":"2024-09-10T23:18:56.078959+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305475+0000","last_change":"2024-09-10T23:18:56.086556+0000","last_active":"2024-09-10T23:18:58.305475+0000","last_peered":"2024-09-10T23:18:58.305475+0000","last_clean":"2024-09-10T23:18:58.305475+0000","last_became_active":"2024-09-10T23:18:56.085413+0000","last_became_peered":"2024-09-10T23:18:56.085413+0000","last_unstale":"2024-09-10T23:18:58.305475+0000","last_undegraded":"2024-09-10T23:18:58.305475+0000","last_fullsized":"2024-09-10T23:18:58.305475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:09.674355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078493+0000","last_change":"2024-09-10T23:18:55.079031+0000","last_active":"2024-09-10T23:18:57.078493+0000","last_peered":"2024-09-10T23:18:57.078493+0000","last_clean":"2024-09-10T23:18:57.078493+0000","last_became_active":"2024-09-10T23:18:55.078641+0000","last_became_peered":"2024-09-10T23:18:55.078641+0000","last_unstale":"2024-09-10T23:18:57.078493+0000","last_undegraded":"2024-09-10T23:18:57.078493+0000","last_fullsized":"2024-09-10T23:18:57.078493+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.083932+0000","last_change":"2024-09-10T23:18:56.081745+0000","last_active":"2024-09-10T23:18:56.083932+0000","last_peered":"2024-09-10T23:18:56.083932+0000","last_clean":"2024-09-10T23:18:56.083932+0000","last_became_active":"2024-09-10T23:18:56.081423+0000","last_became_peered":"2024-09-10T23:18:56.081423+0000","last_unstale":"2024-09-10T23:18:56.083932+0000","last_undegraded":"2024-09-10T23:18:56.083932+0000","last_fullsized":"2024-09-10T23:18:56.083932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:31.869620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303236+0000","last_change":"2024-09-10T23:18:55.078083+0000","last_active":"2024-09-10T23:18:58.303236+0000","last_peered":"2024-09-10T23:18:58.303236+0000","last_clean":"2024-09-10T23:18:58.303236+0000","last_became_active":"2024-09-10T23:18:55.077157+0000","last_became_peered":"2024-09-10T23:18:55.077157+0000","last_unstale":"2024-09-10T23:18:58.303236+0000","last_undegraded":"2024-09-10T23:18:58.303236+0000","last_fullsized":"2024-09-10T23:18:58.303236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:03.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082419+0000","last_change":"2024-09-10T23:18:56.087759+0000","last_active":"2024-09-10T23:18:57.082419+0000","last_peered":"2024-09-10T23:18:57.082419+0000","last_clean":"2024-09-10T23:18:57.082419+0000","last_became_active":"2024-09-10T23:18:56.087498+0000","last_became_peered":"2024-09-10T23:18:56.087498+0000","last_unstale":"2024-09-10T23:18:57.082419+0000","last_undegraded":"2024-09-10T23:18:57.082419+0000","last_fullsized":"2024-09-10T23:18:57.082419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:52.852300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081512+0000","last_change":"2024-09-10T23:18:55.084173+0000","last_active":"2024-09-10T23:18:57.081512+0000","last_peered":"2024-09-10T23:18:57.081512+0000","last_clean":"2024-09-10T23:18:57.081512+0000","last_became_active":"2024-09-10T23:18:55.083904+0000","last_became_peered":"2024-09-10T23:18:55.083904+0000","last_unstale":"2024-09-10T23:18:57.081512+0000","last_undegraded":"2024-09-10T23:18:57.081512+0000","last_fullsized":"2024-09-10T23:18:57.081512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:11.325433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078698+0000","last_change":"2024-09-10T23:18:56.090774+0000","last_active":"2024-09-10T23:18:57.078698+0000","last_peered":"2024-09-10T23:18:57.078698+0000","last_clean":"2024-09-10T23:18:57.078698+0000","last_became_active":"2024-09-10T23:18:56.090248+0000","last_became_peered":"2024-09-10T23:18:56.090248+0000","last_unstale":"2024-09-10T23:18:57.078698+0000","last_undegraded":"2024-09-10T23:18:57.078698+0000","last_fullsized":"2024-09-10T23:18:57.078698+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:36.512116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.302991+0000","last_change":"2024-09-10T23:18:55.086839+0000","last_active":"2024-09-10T23:18:58.302991+0000","last_peered":"2024-09-10T23:18:58.302991+0000","last_clean":"2024-09-10T23:18:58.302991+0000","last_became_active":"2024-09-10T23:18:55.086582+0000","last_became_peered":"2024-09-10T23:18:55.086582+0000","last_unstale":"2024-09-10T23:18:58.302991+0000","last_undegraded":"2024-09-10T23:18:58.302991+0000","last_fullsized":"2024-09-10T23:18:58.302991+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:53.769535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304921+0000","last_change":"2024-09-10T23:18:56.094826+0000","last_active":"2024-09-10T23:18:58.304921+0000","last_peered":"2024-09-10T23:18:58.304921+0000","last_clean":"2024-09-10T23:18:58.304921+0000","last_became_active":"2024-09-10T23:18:56.094309+0000","last_became_peered":"2024-09-10T23:18:56.094309+0000","last_unstale":"2024-09-10T23:18:58.304921+0000","last_undegraded":"2024-09-10T23:18:58.304921+0000","last_fullsized":"2024-09-10T23:18:58.304921+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:14.379720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.103955+0000","last_change":"2024-09-10T23:18:55.088646+0000","last_active":"2024-09-10T23:18:56.103955+0000","last_peered":"2024-09-10T23:18:56.103955+0000","last_clean":"2024-09-10T23:18:56.103955+0000","last_became_active":"2024-09-10T23:18:55.088302+0000","last_became_peered":"2024-09-10T23:18:55.088302+0000","last_unstale":"2024-09-10T23:18:56.103955+0000","last_undegraded":"2024-09-10T23:18:56.103955+0000","last_fullsized":"2024-09-10T23:18:56.103955+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:45.168297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078265+0000","last_change":"2024-09-10T23:18:56.098890+0000","last_active":"2024-09-10T23:18:57.078265+0000","last_peered":"2024-09-10T23:18:57.078265+0000","last_clean":"2024-09-10T23:18:57.078265+0000","last_became_active":"2024-09-10T23:18:56.098619+0000","last_became_peered":"2024-09-10T23:18:56.098619+0000","last_unstale":"2024-09-10T23:18:57.078265+0000","last_undegraded":"2024-09-10T23:18:57.078265+0000","last_fullsized":"2024-09-10T23:18:57.078265+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:37.032240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.087193+0000","last_change":"2024-09-10T23:18:55.086447+0000","last_active":"2024-09-10T23:18:55.087193+0000","last_peered":"2024-09-10T23:18:55.087193+0000","last_clean":"2024-09-10T23:18:55.087193+0000","last_became_active":"2024-09-10T23:18:55.086061+0000","last_became_peered":"2024-09-10T23:18:55.086061+0000","last_unstale":"2024-09-10T23:18:55.087193+0000","last_undegraded":"2024-09-10T23:18:55.087193+0000","last_fullsized":"2024-09-10T23:18:55.087193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:16.766558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303709+0000","last_change":"2024-09-10T23:18:56.089012+0000","last_active":"2024-09-10T23:18:58.303709+0000","last_peered":"2024-09-10T23:18:58.303709+0000","last_clean":"2024-09-10T23:18:58.303709+0000","last_became_active":"2024-09-10T23:18:56.088690+0000","last_became_peered":"2024-09-10T23:18:56.088690+0000","last_unstale":"2024-09-10T23:18:58.303709+0000","last_undegraded":"2024-09-10T23:18:58.303709+0000","last_fullsized":"2024-09-10T23:18:58.303709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:04.831502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081921+0000","last_change":"2024-09-10T23:18:55.087429+0000","last_active":"2024-09-10T23:18:57.081921+0000","last_peered":"2024-09-10T23:18:57.081921+0000","last_clean":"2024-09-10T23:18:57.081921+0000","last_became_active":"2024-09-10T23:18:55.084677+0000","last_became_peered":"2024-09-10T23:18:55.084677+0000","last_unstale":"2024-09-10T23:18:57.081921+0000","last_undegraded":"2024-09-10T23:18:57.081921+0000","last_fullsized":"2024-09-10T23:18:57.081921+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:18.725430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081923+0000","last_change":"2024-09-10T23:18:56.092467+0000","last_active":"2024-09-10T23:18:57.081923+0000","last_peered":"2024-09-10T23:18:57.081923+0000","last_clean":"2024-09-10T23:18:57.081923+0000","last_became_active":"2024-09-10T23:18:56.092160+0000","last_became_peered":"2024-09-10T23:18:56.092160+0000","last_unstale":"2024-09-10T23:18:57.081923+0000","last_undegraded":"2024-09-10T23:18:57.081923+0000","last_fullsized":"2024-09-10T23:18:57.081923+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.811870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303766+0000","last_change":"2024-09-10T23:18:55.082798+0000","last_active":"2024-09-10T23:18:58.303766+0000","last_peered":"2024-09-10T23:18:58.303766+0000","last_clean":"2024-09-10T23:18:58.303766+0000","last_became_active":"2024-09-10T23:18:55.082490+0000","last_became_peered":"2024-09-10T23:18:55.082490+0000","last_unstale":"2024-09-10T23:18:58.303766+0000","last_undegraded":"2024-09-10T23:18:58.303766+0000","last_fullsized":"2024-09-10T23:18:58.303766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:33.785544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305017+0000","last_change":"2024-09-10T23:18:56.090316+0000","last_active":"2024-09-10T23:18:58.305017+0000","last_peered":"2024-09-10T23:18:58.305017+0000","last_clean":"2024-09-10T23:18:58.305017+0000","last_became_active":"2024-09-10T23:18:56.090052+0000","last_became_peered":"2024-09-10T23:18:56.090052+0000","last_unstale":"2024-09-10T23:18:58.305017+0000","last_undegraded":"2024-09-10T23:18:58.305017+0000","last_fullsized":"2024-09-10T23:18:58.305017+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:20.751553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303364+0000","last_change":"2024-09-10T23:18:55.081060+0000","last_active":"2024-09-10T23:18:58.303364+0000","last_peered":"2024-09-10T23:18:58.303364+0000","last_clean":"2024-09-10T23:18:58.303364+0000","last_became_active":"2024-09-10T23:18:55.076346+0000","last_became_peered":"2024-09-10T23:18:55.076346+0000","last_unstale":"2024-09-10T23:18:58.303364+0000","last_undegraded":"2024-09-10T23:18:58.303364+0000","last_fullsized":"2024-09-10T23:18:58.303364+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:15.292325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082386+0000","last_change":"2024-09-10T23:18:56.102976+0000","last_active":"2024-09-10T23:18:57.082386+0000","last_peered":"2024-09-10T23:18:57.082386+0000","last_clean":"2024-09-10T23:18:57.082386+0000","last_became_active":"2024-09-10T23:18:56.101235+0000","last_became_peered":"2024-09-10T23:18:56.101235+0000","last_unstale":"2024-09-10T23:18:57.082386+0000","last_undegraded":"2024-09-10T23:18:57.082386+0000","last_fullsized":"2024-09-10T23:18:57.082386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:24.062275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.092837+0000","last_change":"2024-09-10T23:18:55.092277+0000","last_active":"2024-09-10T23:18:55.092837+0000","last_peered":"2024-09-10T23:18:55.092837+0000","last_clean":"2024-09-10T23:18:55.092837+0000","last_became_active":"2024-09-10T23:18:55.092026+0000","last_became_peered":"2024-09-10T23:18:55.092026+0000","last_unstale":"2024-09-10T23:18:55.092837+0000","last_undegraded":"2024-09-10T23:18:55.092837+0000","last_fullsized":"2024-09-10T23:18:55.092837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:56.711683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303882+0000","last_change":"2024-09-10T23:18:56.099522+0000","last_active":"2024-09-10T23:18:58.303882+0000","last_peered":"2024-09-10T23:18:58.303882+0000","last_clean":"2024-09-10T23:18:58.303882+0000","last_became_active":"2024-09-10T23:18:56.099241+0000","last_became_peered":"2024-09-10T23:18:56.099241+0000","last_unstale":"2024-09-10T23:18:58.303882+0000","last_undegraded":"2024-09-10T23:18:58.303882+0000","last_fullsized":"2024-09-10T23:18:58.303882+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:58.597638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305155+0000","last_change":"2024-09-10T23:18:55.083197+0000","last_active":"2024-09-10T23:18:58.305155+0000","last_peered":"2024-09-10T23:18:58.305155+0000","last_clean":"2024-09-10T23:18:58.305155+0000","last_became_active":"2024-09-10T23:18:55.082785+0000","last_became_peered":"2024-09-10T23:18:55.082785+0000","last_unstale":"2024-09-10T23:18:58.305155+0000","last_undegraded":"2024-09-10T23:18:58.305155+0000","last_fullsized":"2024-09-10T23:18:58.305155+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:11.391580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-10T23:18:56.089696+0000","last_change":"2024-09-10T23:18:56.085814+0000","last_active":"2024-09-10T23:18:56.089696+0000","last_peered":"2024-09-10T23:18:56.089696+0000","last_clean":"2024-09-10T23:18:56.089696+0000","last_became_active":"2024-09-10T23:18:56.085558+0000","last_became_peered":"2024-09-10T23:18:56.085558+0000","last_unstale":"2024-09-10T23:18:56.089696+0000","last_undegraded":"2024-09-10T23:18:56.089696+0000","last_fullsized":"2024-09-10T23:18:56.089696+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:07.964858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"57'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082548+0000","last_change":"2024-09-10T23:18:55.079748+0000","last_active":"2024-09-10T23:18:57.082548+0000","last_peered":"2024-09-10T23:18:57.082548+0000","last_clean":"2024-09-10T23:18:57.082548+0000","last_became_active":"2024-09-10T23:18:55.079369+0000","last_became_peered":"2024-09-10T23:18:55.079369+0000","last_unstale":"2024-09-10T23:18:57.082548+0000","last_undegraded":"2024-09-10T23:18:57.082548+0000","last_fullsized":"2024-09-10T23:18:57.082548+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:05.324333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":171,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-10T23:18:55.069675+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:18:55.069675+0000","last_peered":"2024-09-10T23:18:55.069675+0000","last_clean":"2024-09-10T23:18:55.069675+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:18:55.069675+0000","last_undegraded":"2024-09-10T23:18:55.069675+0000","last_fullsized":"2024-09-10T23:18:55.069675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476781,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40168,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331672,"statfs":{"total":96636764160,"available":96595632128,"internally_reserved":0,"allocated":667648,"data_stored":293101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46292,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325548,"statfs":{"total":96636764160,"available":96589361152,"internally_reserved":0,"allocated":1241088,"data_stored":875650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40164,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331676,"statfs":{"total":96636764160,"available":96595636224,"internally_reserved":0,"allocated":671744,"data_stored":299141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62352,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309488,"statfs":{"total":96636764160,"available":96572915712,"internally_reserved":0,"allocated":647168,"data_stored":285282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40176,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":684032,"data_stored":300753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":679936,"data_stored":299301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":1273856,"data_stored":889565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":294083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:04.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 -- 172.21.15.17:0/3612061398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad0073a60 msgr2=0x7f9ad00b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 --2- 172.21.15.17:0/3612061398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad0073a60 0x7f9ad00b4a00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009840 tx=0x7f9ab801c820 comp rx=0 tx=0).stop 2024-09-10T23:19:05.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 -- 172.21.15.17:0/3612061398 shutdown_connections 2024-09-10T23:19:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 --2- 172.21.15.17:0/3612061398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad0073a60 0x7f9ad00b4a00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 --2- 172.21.15.17:0/3612061398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ad00b4620 0x7f9ad0073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 -- 172.21.15.17:0/3612061398 >> 172.21.15.17:0/3612061398 conn(0x7f9ad00b2740 msgr2=0x7f9ad00b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 -- 172.21.15.17:0/3612061398 shutdown_connections 2024-09-10T23:19:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 -- 172.21.15.17:0/3612061398 wait complete. 2024-09-10T23:19:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 Processor -- start 2024-09-10T23:19:05.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.005+0000 7f9ad5c00640 1 -- start start 2024-09-10T23:19:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ad0073a60 0x7f9ad013d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ad00b4620 0x7f9ad0155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad00b4f40 0x7f9ad014c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad0167870 con 0x7f9ad00b4f40 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01676f0 con 0x7f9ad0073a60 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad01679f0 con 0x7f9ad00b4620 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad00b4f40 0x7f9ad014c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad00b4f40 0x7f9ad014c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39494/0 (socket says 172.21.15.17:39494) 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5200640 1 -- 172.21.15.17:0/2340654773 learned_addr learned my addr 172.21.15.17:0/2340654773 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9acfe00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ad0073a60 0x7f9ad013d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ac7e00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ad00b4620 0x7f9ad0155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5200640 1 -- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ad00b4620 msgr2=0x7f9ad0155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5200640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ad00b4620 0x7f9ad0155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5200640 1 -- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ad0073a60 msgr2=0x7f9ad013d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5200640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ad0073a60 0x7f9ad013d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5200640 1 -- 172.21.15.17:0/2340654773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad0155ce0 con 0x7f9ad00b4f40 2024-09-10T23:19:05.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5200640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad00b4f40 0x7f9ad014c4f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c730 tx=0x7f9ac800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:05.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9accc00640 1 -- 172.21.15.17:0/2340654773 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8003b80 con 0x7f9ad00b4f40 2024-09-10T23:19:05.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9accc00640 1 -- 172.21.15.17:0/2340654773 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ac8003d40 con 0x7f9ad00b4f40 2024-09-10T23:19:05.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad0155fc0 con 0x7f9ad00b4f40 2024-09-10T23:19:05.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9accc00640 1 -- 172.21.15.17:0/2340654773 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80052d0 con 0x7f9ad00b4f40 2024-09-10T23:19:05.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad0156580 con 0x7f9ad00b4f40 2024-09-10T23:19:05.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad00b4a00 con 0x7f9ad00b4f40 2024-09-10T23:19:05.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.009+0000 7f9accc00640 1 -- 172.21.15.17:0/2340654773 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9ac8005680 con 0x7f9ad00b4f40 2024-09-10T23:19:05.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.013+0000 7f9accc00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aac072610 0x7f9aac074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.013+0000 7f9accc00640 1 -- 172.21.15.17:0/2340654773 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f9ac80933a0 con 0x7f9ad00b4f40 2024-09-10T23:19:05.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.013+0000 7f9acfe00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aac072610 0x7f9aac074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.013+0000 7f9acfe00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aac072610 0x7f9aac074ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00058d0 tx=0x7f9ac0005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:05.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.017+0000 7f9accc00640 1 -- 172.21.15.17:0/2340654773 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9ac805e8e0 con 0x7f9ad00b4f40 2024-09-10T23:19:05.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.185+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ad0070f70 con 0x7f9aac072610 2024-09-10T23:19:05.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.193+0000 7f9accc00640 1 -- 172.21.15.17:0/2340654773 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251934 (secure 0 0 0) 0x7f9ad0070f70 con 0x7f9aac072610 2024-09-10T23:19:05.199 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:05.201 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:19:05.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aac072610 msgr2=0x7f9aac074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aac072610 0x7f9aac074ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00058d0 tx=0x7f9ac0005860 comp rx=0 tx=0).stop 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad00b4f40 msgr2=0x7f9ad014c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad00b4f40 0x7f9ad014c4f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c730 tx=0x7f9ac800cbf0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 shutdown_connections 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aac072610 0x7f9aac074ad0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ad00b4f40 0x7f9ad014c4f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ad00b4620 0x7f9ad0155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 --2- 172.21.15.17:0/2340654773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ad0073a60 0x7f9ad013d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 >> 172.21.15.17:0/2340654773 conn(0x7f9ad00b2740 msgr2=0x7f9ad015a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 shutdown_connections 2024-09-10T23:19:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.197+0000 7f9ad5c00640 1 -- 172.21.15.17:0/2340654773 wait complete. 2024-09-10T23:19:05.221 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-10T23:19:04.341268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":330936,"kb_used_data":6472,"kb_used_omap":12,"kb_used_meta":324275,"kb_avail":754643784,"statfs":{"total":773094113280,"available":772755234816,"internally_reserved":0,"allocated":6627328,"data_stored":3578684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":332058161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.275433"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078714+0000","last_change":"2024-09-10T23:18:56.090512+0000","last_active":"2024-09-10T23:18:57.078714+0000","last_peered":"2024-09-10T23:18:57.078714+0000","last_clean":"2024-09-10T23:18:57.078714+0000","last_became_active":"2024-09-10T23:18:56.089868+0000","last_became_peered":"2024-09-10T23:18:56.089868+0000","last_unstale":"2024-09-10T23:18:57.078714+0000","last_undegraded":"2024-09-10T23:18:57.078714+0000","last_fullsized":"2024-09-10T23:18:57.078714+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:17.364072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.086025+0000","last_change":"2024-09-10T23:18:56.088493+0000","last_active":"2024-09-10T23:18:57.086025+0000","last_peered":"2024-09-10T23:18:57.086025+0000","last_clean":"2024-09-10T23:18:57.086025+0000","last_became_active":"2024-09-10T23:18:56.087646+0000","last_became_peered":"2024-09-10T23:18:56.087646+0000","last_unstale":"2024-09-10T23:18:57.086025+0000","last_undegraded":"2024-09-10T23:18:57.086025+0000","last_fullsized":"2024-09-10T23:18:57.086025+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:30.672696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082065+0000","last_change":"2024-09-10T23:18:56.104813+0000","last_active":"2024-09-10T23:18:57.082065+0000","last_peered":"2024-09-10T23:18:57.082065+0000","last_clean":"2024-09-10T23:18:57.082065+0000","last_became_active":"2024-09-10T23:18:56.103322+0000","last_became_peered":"2024-09-10T23:18:56.103322+0000","last_unstale":"2024-09-10T23:18:57.082065+0000","last_undegraded":"2024-09-10T23:18:57.082065+0000","last_fullsized":"2024-09-10T23:18:57.082065+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:27.592000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.085812+0000","last_change":"2024-09-10T23:18:56.095415+0000","last_active":"2024-09-10T23:18:57.085812+0000","last_peered":"2024-09-10T23:18:57.085812+0000","last_clean":"2024-09-10T23:18:57.085812+0000","last_became_active":"2024-09-10T23:18:56.095108+0000","last_became_peered":"2024-09-10T23:18:56.095108+0000","last_unstale":"2024-09-10T23:18:57.085812+0000","last_undegraded":"2024-09-10T23:18:57.085812+0000","last_fullsized":"2024-09-10T23:18:57.085812+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:33.320497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.080259+0000","last_change":"2024-09-10T23:18:56.084505+0000","last_active":"2024-09-10T23:18:57.080259+0000","last_peered":"2024-09-10T23:18:57.080259+0000","last_clean":"2024-09-10T23:18:57.080259+0000","last_became_active":"2024-09-10T23:18:56.084050+0000","last_became_peered":"2024-09-10T23:18:56.084050+0000","last_unstale":"2024-09-10T23:18:57.080259+0000","last_undegraded":"2024-09-10T23:18:57.080259+0000","last_fullsized":"2024-09-10T23:18:57.080259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:33.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078393+0000","last_change":"2024-09-10T23:18:56.089275+0000","last_active":"2024-09-10T23:18:57.078393+0000","last_peered":"2024-09-10T23:18:57.078393+0000","last_clean":"2024-09-10T23:18:57.078393+0000","last_became_active":"2024-09-10T23:18:56.089026+0000","last_became_peered":"2024-09-10T23:18:56.089026+0000","last_unstale":"2024-09-10T23:18:57.078393+0000","last_undegraded":"2024-09-10T23:18:57.078393+0000","last_fullsized":"2024-09-10T23:18:57.078393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:45.067514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081381+0000","last_change":"2024-09-10T23:18:56.102567+0000","last_active":"2024-09-10T23:18:57.081381+0000","last_peered":"2024-09-10T23:18:57.081381+0000","last_clean":"2024-09-10T23:18:57.081381+0000","last_became_active":"2024-09-10T23:18:56.102253+0000","last_became_peered":"2024-09-10T23:18:56.102253+0000","last_unstale":"2024-09-10T23:18:57.081381+0000","last_undegraded":"2024-09-10T23:18:57.081381+0000","last_fullsized":"2024-09-10T23:18:57.081381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:09.674355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304376+0000","last_change":"2024-09-10T23:18:56.082157+0000","last_active":"2024-09-10T23:18:58.304376+0000","last_peered":"2024-09-10T23:18:58.304376+0000","last_clean":"2024-09-10T23:18:58.304376+0000","last_became_active":"2024-09-10T23:18:56.081716+0000","last_became_peered":"2024-09-10T23:18:56.081716+0000","last_unstale":"2024-09-10T23:18:58.304376+0000","last_undegraded":"2024-09-10T23:18:58.304376+0000","last_fullsized":"2024-09-10T23:18:58.304376+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:53.382284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303880+0000","last_change":"2024-09-10T23:18:56.089945+0000","last_active":"2024-09-10T23:18:58.303880+0000","last_peered":"2024-09-10T23:18:58.303880+0000","last_clean":"2024-09-10T23:18:58.303880+0000","last_became_active":"2024-09-10T23:18:56.089450+0000","last_became_peered":"2024-09-10T23:18:56.089450+0000","last_unstale":"2024-09-10T23:18:58.303880+0000","last_undegraded":"2024-09-10T23:18:58.303880+0000","last_fullsized":"2024-09-10T23:18:58.303880+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:55.404482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078682+0000","last_change":"2024-09-10T23:18:56.087156+0000","last_active":"2024-09-10T23:18:57.078682+0000","last_peered":"2024-09-10T23:18:57.078682+0000","last_clean":"2024-09-10T23:18:57.078682+0000","last_became_active":"2024-09-10T23:18:56.086901+0000","last_became_peered":"2024-09-10T23:18:56.086901+0000","last_unstale":"2024-09-10T23:18:57.078682+0000","last_undegraded":"2024-09-10T23:18:57.078682+0000","last_fullsized":"2024-09-10T23:18:57.078682+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:24.643459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303591+0000","last_change":"2024-09-10T23:18:56.097512+0000","last_active":"2024-09-10T23:18:58.303591+0000","last_peered":"2024-09-10T23:18:58.303591+0000","last_clean":"2024-09-10T23:18:58.303591+0000","last_became_active":"2024-09-10T23:18:56.097259+0000","last_became_peered":"2024-09-10T23:18:56.097259+0000","last_unstale":"2024-09-10T23:18:58.303591+0000","last_undegraded":"2024-09-10T23:18:58.303591+0000","last_fullsized":"2024-09-10T23:18:58.303591+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:54.682126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304143+0000","last_change":"2024-09-10T23:18:56.092902+0000","last_active":"2024-09-10T23:18:58.304143+0000","last_peered":"2024-09-10T23:18:58.304143+0000","last_clean":"2024-09-10T23:18:58.304143+0000","last_became_active":"2024-09-10T23:18:56.092627+0000","last_became_peered":"2024-09-10T23:18:56.092627+0000","last_unstale":"2024-09-10T23:18:58.304143+0000","last_undegraded":"2024-09-10T23:18:58.304143+0000","last_fullsized":"2024-09-10T23:18:58.304143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:24.288734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078475+0000","last_change":"2024-09-10T23:18:56.091763+0000","last_active":"2024-09-10T23:18:57.078475+0000","last_peered":"2024-09-10T23:18:57.078475+0000","last_clean":"2024-09-10T23:18:57.078475+0000","last_became_active":"2024-09-10T23:18:56.091453+0000","last_became_peered":"2024-09-10T23:18:56.091453+0000","last_unstale":"2024-09-10T23:18:57.078475+0000","last_undegraded":"2024-09-10T23:18:57.078475+0000","last_fullsized":"2024-09-10T23:18:57.078475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:12.394587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081507+0000","last_change":"2024-09-10T23:18:56.098733+0000","last_active":"2024-09-10T23:18:57.081507+0000","last_peered":"2024-09-10T23:18:57.081507+0000","last_clean":"2024-09-10T23:18:57.081507+0000","last_became_active":"2024-09-10T23:18:56.095590+0000","last_became_peered":"2024-09-10T23:18:56.095590+0000","last_unstale":"2024-09-10T23:18:57.081507+0000","last_undegraded":"2024-09-10T23:18:57.081507+0000","last_fullsized":"2024-09-10T23:18:57.081507+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:36.226548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.085744+0000","last_change":"2024-09-10T23:18:56.088978+0000","last_active":"2024-09-10T23:18:57.085744+0000","last_peered":"2024-09-10T23:18:57.085744+0000","last_clean":"2024-09-10T23:18:57.085744+0000","last_became_active":"2024-09-10T23:18:56.088652+0000","last_became_peered":"2024-09-10T23:18:56.088652+0000","last_unstale":"2024-09-10T23:18:57.085744+0000","last_undegraded":"2024-09-10T23:18:57.085744+0000","last_fullsized":"2024-09-10T23:18:57.085744+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:08.648284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078185+0000","last_change":"2024-09-10T23:18:56.086441+0000","last_active":"2024-09-10T23:18:57.078185+0000","last_peered":"2024-09-10T23:18:57.078185+0000","last_clean":"2024-09-10T23:18:57.078185+0000","last_became_active":"2024-09-10T23:18:56.086241+0000","last_became_peered":"2024-09-10T23:18:56.086241+0000","last_unstale":"2024-09-10T23:18:57.078185+0000","last_undegraded":"2024-09-10T23:18:57.078185+0000","last_fullsized":"2024-09-10T23:18:57.078185+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.947052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082783+0000","last_change":"2024-09-10T23:18:56.085163+0000","last_active":"2024-09-10T23:18:57.082783+0000","last_peered":"2024-09-10T23:18:57.082783+0000","last_clean":"2024-09-10T23:18:57.082783+0000","last_became_active":"2024-09-10T23:18:56.084615+0000","last_became_peered":"2024-09-10T23:18:56.084615+0000","last_unstale":"2024-09-10T23:18:57.082783+0000","last_undegraded":"2024-09-10T23:18:57.082783+0000","last_fullsized":"2024-09-10T23:18:57.082783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:33.804083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.086067+0000","last_change":"2024-09-10T23:18:56.088287+0000","last_active":"2024-09-10T23:18:57.086067+0000","last_peered":"2024-09-10T23:18:57.086067+0000","last_clean":"2024-09-10T23:18:57.086067+0000","last_became_active":"2024-09-10T23:18:56.087851+0000","last_became_peered":"2024-09-10T23:18:56.087851+0000","last_unstale":"2024-09-10T23:18:57.086067+0000","last_undegraded":"2024-09-10T23:18:57.086067+0000","last_fullsized":"2024-09-10T23:18:57.086067+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:43.642342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082097+0000","last_change":"2024-09-10T23:18:56.071603+0000","last_active":"2024-09-10T23:18:57.082097+0000","last_peered":"2024-09-10T23:18:57.082097+0000","last_clean":"2024-09-10T23:18:57.082097+0000","last_became_active":"2024-09-10T23:18:56.071266+0000","last_became_peered":"2024-09-10T23:18:56.071266+0000","last_unstale":"2024-09-10T23:18:57.082097+0000","last_undegraded":"2024-09-10T23:18:57.082097+0000","last_fullsized":"2024-09-10T23:18:57.082097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:23.999216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305280+0000","last_change":"2024-09-10T23:18:56.081732+0000","last_active":"2024-09-10T23:18:58.305280+0000","last_peered":"2024-09-10T23:18:58.305280+0000","last_clean":"2024-09-10T23:18:58.305280+0000","last_became_active":"2024-09-10T23:18:56.081395+0000","last_became_peered":"2024-09-10T23:18:56.081395+0000","last_unstale":"2024-09-10T23:18:58.305280+0000","last_undegraded":"2024-09-10T23:18:58.305280+0000","last_fullsized":"2024-09-10T23:18:58.305280+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:19.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305193+0000","last_change":"2024-09-10T23:18:56.092352+0000","last_active":"2024-09-10T23:18:58.305193+0000","last_peered":"2024-09-10T23:18:58.305193+0000","last_clean":"2024-09-10T23:18:58.305193+0000","last_became_active":"2024-09-10T23:18:56.092077+0000","last_became_peered":"2024-09-10T23:18:56.092077+0000","last_unstale":"2024-09-10T23:18:58.305193+0000","last_undegraded":"2024-09-10T23:18:58.305193+0000","last_fullsized":"2024-09-10T23:18:58.305193+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:17.769564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303137+0000","last_change":"2024-09-10T23:18:56.088908+0000","last_active":"2024-09-10T23:18:58.303137+0000","last_peered":"2024-09-10T23:18:58.303137+0000","last_clean":"2024-09-10T23:18:58.303137+0000","last_became_active":"2024-09-10T23:18:56.088628+0000","last_became_peered":"2024-09-10T23:18:56.088628+0000","last_unstale":"2024-09-10T23:18:58.303137+0000","last_undegraded":"2024-09-10T23:18:58.303137+0000","last_fullsized":"2024-09-10T23:18:58.303137+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:32.936954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303115+0000","last_change":"2024-09-10T23:18:56.097569+0000","last_active":"2024-09-10T23:18:58.303115+0000","last_peered":"2024-09-10T23:18:58.303115+0000","last_clean":"2024-09-10T23:18:58.303115+0000","last_became_active":"2024-09-10T23:18:56.097237+0000","last_became_peered":"2024-09-10T23:18:56.097237+0000","last_unstale":"2024-09-10T23:18:58.303115+0000","last_undegraded":"2024-09-10T23:18:58.303115+0000","last_fullsized":"2024-09-10T23:18:58.303115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:03.488812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081320+0000","last_change":"2024-09-10T23:18:56.088747+0000","last_active":"2024-09-10T23:18:57.081320+0000","last_peered":"2024-09-10T23:18:57.081320+0000","last_clean":"2024-09-10T23:18:57.081320+0000","last_became_active":"2024-09-10T23:18:56.088010+0000","last_became_peered":"2024-09-10T23:18:56.088010+0000","last_unstale":"2024-09-10T23:18:57.081320+0000","last_undegraded":"2024-09-10T23:18:57.081320+0000","last_fullsized":"2024-09-10T23:18:57.081320+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:13.725585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082898+0000","last_change":"2024-09-10T23:18:56.092590+0000","last_active":"2024-09-10T23:18:57.082898+0000","last_peered":"2024-09-10T23:18:57.082898+0000","last_clean":"2024-09-10T23:18:57.082898+0000","last_became_active":"2024-09-10T23:18:56.092231+0000","last_became_peered":"2024-09-10T23:18:56.092231+0000","last_unstale":"2024-09-10T23:18:57.082898+0000","last_undegraded":"2024-09-10T23:18:57.082898+0000","last_fullsized":"2024-09-10T23:18:57.082898+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:52.814090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303636+0000","last_change":"2024-09-10T23:18:56.099351+0000","last_active":"2024-09-10T23:18:58.303636+0000","last_peered":"2024-09-10T23:18:58.303636+0000","last_clean":"2024-09-10T23:18:58.303636+0000","last_became_active":"2024-09-10T23:18:56.099073+0000","last_became_peered":"2024-09-10T23:18:56.099073+0000","last_unstale":"2024-09-10T23:18:58.303636+0000","last_undegraded":"2024-09-10T23:18:58.303636+0000","last_fullsized":"2024-09-10T23:18:58.303636+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:28.433276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078463+0000","last_change":"2024-09-10T23:18:56.084874+0000","last_active":"2024-09-10T23:18:57.078463+0000","last_peered":"2024-09-10T23:18:57.078463+0000","last_clean":"2024-09-10T23:18:57.078463+0000","last_became_active":"2024-09-10T23:18:56.084613+0000","last_became_peered":"2024-09-10T23:18:56.084613+0000","last_unstale":"2024-09-10T23:18:57.078463+0000","last_undegraded":"2024-09-10T23:18:57.078463+0000","last_fullsized":"2024-09-10T23:18:57.078463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:36.008049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305479+0000","last_change":"2024-09-10T23:18:56.098682+0000","last_active":"2024-09-10T23:18:58.305479+0000","last_peered":"2024-09-10T23:18:58.305479+0000","last_clean":"2024-09-10T23:18:58.305479+0000","last_became_active":"2024-09-10T23:18:56.098439+0000","last_became_peered":"2024-09-10T23:18:56.098439+0000","last_unstale":"2024-09-10T23:18:58.305479+0000","last_undegraded":"2024-09-10T23:18:58.305479+0000","last_fullsized":"2024-09-10T23:18:58.305479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:06.327339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081881+0000","last_change":"2024-09-10T23:18:56.082038+0000","last_active":"2024-09-10T23:18:57.081881+0000","last_peered":"2024-09-10T23:18:57.081881+0000","last_clean":"2024-09-10T23:18:57.081881+0000","last_became_active":"2024-09-10T23:18:56.081318+0000","last_became_peered":"2024-09-10T23:18:56.081318+0000","last_unstale":"2024-09-10T23:18:57.081881+0000","last_undegraded":"2024-09-10T23:18:57.081881+0000","last_fullsized":"2024-09-10T23:18:57.081881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:04.303418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.085710+0000","last_change":"2024-09-10T23:18:56.094359+0000","last_active":"2024-09-10T23:18:57.085710+0000","last_peered":"2024-09-10T23:18:57.085710+0000","last_clean":"2024-09-10T23:18:57.085710+0000","last_became_active":"2024-09-10T23:18:56.093925+0000","last_became_peered":"2024-09-10T23:18:56.093925+0000","last_unstale":"2024-09-10T23:18:57.085710+0000","last_undegraded":"2024-09-10T23:18:57.085710+0000","last_fullsized":"2024-09-10T23:18:57.085710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:29.218669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081432+0000","last_change":"2024-09-10T23:18:56.095428+0000","last_active":"2024-09-10T23:18:57.081432+0000","last_peered":"2024-09-10T23:18:57.081432+0000","last_clean":"2024-09-10T23:18:57.081432+0000","last_became_active":"2024-09-10T23:18:56.095142+0000","last_became_peered":"2024-09-10T23:18:56.095142+0000","last_unstale":"2024-09-10T23:18:57.081432+0000","last_undegraded":"2024-09-10T23:18:57.081432+0000","last_fullsized":"2024-09-10T23:18:57.081432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:29.469274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304783+0000","last_change":"2024-09-10T23:18:56.094564+0000","last_active":"2024-09-10T23:18:58.304783+0000","last_peered":"2024-09-10T23:18:58.304783+0000","last_clean":"2024-09-10T23:18:58.304783+0000","last_became_active":"2024-09-10T23:18:56.093925+0000","last_became_peered":"2024-09-10T23:18:56.093925+0000","last_unstale":"2024-09-10T23:18:58.304783+0000","last_undegraded":"2024-09-10T23:18:58.304783+0000","last_fullsized":"2024-09-10T23:18:58.304783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:19.401580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.085518+0000","last_change":"2024-09-10T23:18:56.086774+0000","last_active":"2024-09-10T23:18:57.085518+0000","last_peered":"2024-09-10T23:18:57.085518+0000","last_clean":"2024-09-10T23:18:57.085518+0000","last_became_active":"2024-09-10T23:18:56.086492+0000","last_became_peered":"2024-09-10T23:18:56.086492+0000","last_unstale":"2024-09-10T23:18:57.085518+0000","last_undegraded":"2024-09-10T23:18:57.085518+0000","last_fullsized":"2024-09-10T23:18:57.085518+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:43.604966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"56'4","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305386+0000","last_change":"2024-09-10T23:18:55.084728+0000","last_active":"2024-09-10T23:18:58.305386+0000","last_peered":"2024-09-10T23:18:58.305386+0000","last_clean":"2024-09-10T23:18:58.305386+0000","last_became_active":"2024-09-10T23:18:55.083761+0000","last_became_peered":"2024-09-10T23:18:55.083761+0000","last_unstale":"2024-09-10T23:18:58.305386+0000","last_undegraded":"2024-09-10T23:18:58.305386+0000","last_fullsized":"2024-09-10T23:18:58.305386+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:51:10.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305509+0000","last_change":"2024-09-10T23:18:56.095498+0000","last_active":"2024-09-10T23:18:58.305509+0000","last_peered":"2024-09-10T23:18:58.305509+0000","last_clean":"2024-09-10T23:18:58.305509+0000","last_became_active":"2024-09-10T23:18:56.093254+0000","last_became_peered":"2024-09-10T23:18:56.093254+0000","last_unstale":"2024-09-10T23:18:58.305509+0000","last_undegraded":"2024-09-10T23:18:58.305509+0000","last_fullsized":"2024-09-10T23:18:58.305509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:29.469274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078629+0000","last_change":"2024-09-10T23:18:55.086808+0000","last_active":"2024-09-10T23:18:57.078629+0000","last_peered":"2024-09-10T23:18:57.078629+0000","last_clean":"2024-09-10T23:18:57.078629+0000","last_became_active":"2024-09-10T23:18:55.086532+0000","last_became_peered":"2024-09-10T23:18:55.086532+0000","last_unstale":"2024-09-10T23:18:57.078629+0000","last_undegraded":"2024-09-10T23:18:57.078629+0000","last_fullsized":"2024-09-10T23:18:57.078629+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305394+0000","last_change":"2024-09-10T23:18:56.092067+0000","last_active":"2024-09-10T23:18:58.305394+0000","last_peered":"2024-09-10T23:18:58.305394+0000","last_clean":"2024-09-10T23:18:58.305394+0000","last_became_active":"2024-09-10T23:18:56.091772+0000","last_became_peered":"2024-09-10T23:18:56.091772+0000","last_unstale":"2024-09-10T23:18:58.305394+0000","last_undegraded":"2024-09-10T23:18:58.305394+0000","last_fullsized":"2024-09-10T23:18:58.305394+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:33.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078517+0000","last_change":"2024-09-10T23:18:55.078770+0000","last_active":"2024-09-10T23:18:57.078517+0000","last_peered":"2024-09-10T23:18:57.078517+0000","last_clean":"2024-09-10T23:18:57.078517+0000","last_became_active":"2024-09-10T23:18:55.078521+0000","last_became_peered":"2024-09-10T23:18:55.078521+0000","last_unstale":"2024-09-10T23:18:57.078517+0000","last_undegraded":"2024-09-10T23:18:57.078517+0000","last_fullsized":"2024-09-10T23:18:57.078517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:09.389758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303590+0000","last_change":"2024-09-10T23:18:56.100648+0000","last_active":"2024-09-10T23:18:58.303590+0000","last_peered":"2024-09-10T23:18:58.303590+0000","last_clean":"2024-09-10T23:18:58.303590+0000","last_became_active":"2024-09-10T23:18:56.098241+0000","last_became_peered":"2024-09-10T23:18:56.098241+0000","last_unstale":"2024-09-10T23:18:58.303590+0000","last_undegraded":"2024-09-10T23:18:58.303590+0000","last_fullsized":"2024-09-10T23:18:58.303590+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:37:30.964405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305291+0000","last_change":"2024-09-10T23:18:55.089746+0000","last_active":"2024-09-10T23:18:58.305291+0000","last_peered":"2024-09-10T23:18:58.305291+0000","last_clean":"2024-09-10T23:18:58.305291+0000","last_became_active":"2024-09-10T23:18:55.089507+0000","last_became_peered":"2024-09-10T23:18:55.089507+0000","last_unstale":"2024-09-10T23:18:58.305291+0000","last_undegraded":"2024-09-10T23:18:58.305291+0000","last_fullsized":"2024-09-10T23:18:58.305291+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:44.064508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.080564+0000","last_change":"2024-09-10T23:18:56.072470+0000","last_active":"2024-09-10T23:18:57.080564+0000","last_peered":"2024-09-10T23:18:57.080564+0000","last_clean":"2024-09-10T23:18:57.080564+0000","last_became_active":"2024-09-10T23:18:56.072147+0000","last_became_peered":"2024-09-10T23:18:56.072147+0000","last_unstale":"2024-09-10T23:18:57.080564+0000","last_undegraded":"2024-09-10T23:18:57.080564+0000","last_fullsized":"2024-09-10T23:18:57.080564+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.947052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081829+0000","last_change":"2024-09-10T23:18:55.088922+0000","last_active":"2024-09-10T23:18:57.081829+0000","last_peered":"2024-09-10T23:18:57.081829+0000","last_clean":"2024-09-10T23:18:57.081829+0000","last_became_active":"2024-09-10T23:18:55.088591+0000","last_became_peered":"2024-09-10T23:18:55.088591+0000","last_unstale":"2024-09-10T23:18:57.081829+0000","last_undegraded":"2024-09-10T23:18:57.081829+0000","last_fullsized":"2024-09-10T23:18:57.081829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:05.907855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.085834+0000","last_change":"2024-09-10T23:18:56.093902+0000","last_active":"2024-09-10T23:18:57.085834+0000","last_peered":"2024-09-10T23:18:57.085834+0000","last_clean":"2024-09-10T23:18:57.085834+0000","last_became_active":"2024-09-10T23:18:56.093612+0000","last_became_peered":"2024-09-10T23:18:56.093612+0000","last_unstale":"2024-09-10T23:18:57.085834+0000","last_undegraded":"2024-09-10T23:18:57.085834+0000","last_fullsized":"2024-09-10T23:18:57.085834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:12.364319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.079866+0000","last_change":"2024-09-10T23:18:55.081624+0000","last_active":"2024-09-10T23:18:57.079866+0000","last_peered":"2024-09-10T23:18:57.079866+0000","last_clean":"2024-09-10T23:18:57.079866+0000","last_became_active":"2024-09-10T23:18:55.080250+0000","last_became_peered":"2024-09-10T23:18:55.080250+0000","last_unstale":"2024-09-10T23:18:57.079866+0000","last_undegraded":"2024-09-10T23:18:57.079866+0000","last_fullsized":"2024-09-10T23:18:57.079866+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:59.927730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303988+0000","last_change":"2024-09-10T23:18:56.099137+0000","last_active":"2024-09-10T23:18:58.303988+0000","last_peered":"2024-09-10T23:18:58.303988+0000","last_clean":"2024-09-10T23:18:58.303988+0000","last_became_active":"2024-09-10T23:18:56.098260+0000","last_became_peered":"2024-09-10T23:18:56.098260+0000","last_unstale":"2024-09-10T23:18:58.303988+0000","last_undegraded":"2024-09-10T23:18:58.303988+0000","last_fullsized":"2024-09-10T23:18:58.303988+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:40.800736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304683+0000","last_change":"2024-09-10T23:18:55.080384+0000","last_active":"2024-09-10T23:18:58.304683+0000","last_peered":"2024-09-10T23:18:58.304683+0000","last_clean":"2024-09-10T23:18:58.304683+0000","last_became_active":"2024-09-10T23:18:55.080119+0000","last_became_peered":"2024-09-10T23:18:55.080119+0000","last_unstale":"2024-09-10T23:18:58.304683+0000","last_undegraded":"2024-09-10T23:18:58.304683+0000","last_fullsized":"2024-09-10T23:18:58.304683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:32.923376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.086047+0000","last_change":"2024-09-10T23:18:56.087841+0000","last_active":"2024-09-10T23:18:57.086047+0000","last_peered":"2024-09-10T23:18:57.086047+0000","last_clean":"2024-09-10T23:18:57.086047+0000","last_became_active":"2024-09-10T23:18:56.087527+0000","last_became_peered":"2024-09-10T23:18:56.087527+0000","last_unstale":"2024-09-10T23:18:57.086047+0000","last_undegraded":"2024-09-10T23:18:57.086047+0000","last_fullsized":"2024-09-10T23:18:57.086047+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:52.591988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081305+0000","last_change":"2024-09-10T23:18:55.081272+0000","last_active":"2024-09-10T23:18:57.081305+0000","last_peered":"2024-09-10T23:18:57.081305+0000","last_clean":"2024-09-10T23:18:57.081305+0000","last_became_active":"2024-09-10T23:18:55.080496+0000","last_became_peered":"2024-09-10T23:18:55.080496+0000","last_unstale":"2024-09-10T23:18:57.081305+0000","last_undegraded":"2024-09-10T23:18:57.081305+0000","last_fullsized":"2024-09-10T23:18:57.081305+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:13.014724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.079830+0000","last_change":"2024-09-10T23:18:56.084478+0000","last_active":"2024-09-10T23:18:57.079830+0000","last_peered":"2024-09-10T23:18:57.079830+0000","last_clean":"2024-09-10T23:18:57.079830+0000","last_became_active":"2024-09-10T23:18:56.084077+0000","last_became_peered":"2024-09-10T23:18:56.084077+0000","last_unstale":"2024-09-10T23:18:57.079830+0000","last_undegraded":"2024-09-10T23:18:57.079830+0000","last_fullsized":"2024-09-10T23:18:57.079830+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:19.728436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.086182+0000","last_change":"2024-09-10T23:18:55.084970+0000","last_active":"2024-09-10T23:18:57.086182+0000","last_peered":"2024-09-10T23:18:57.086182+0000","last_clean":"2024-09-10T23:18:57.086182+0000","last_became_active":"2024-09-10T23:18:55.084721+0000","last_became_peered":"2024-09-10T23:18:55.084721+0000","last_unstale":"2024-09-10T23:18:57.086182+0000","last_undegraded":"2024-09-10T23:18:57.086182+0000","last_fullsized":"2024-09-10T23:18:57.086182+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:22.615391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305564+0000","last_change":"2024-09-10T23:18:56.086003+0000","last_active":"2024-09-10T23:18:58.305564+0000","last_peered":"2024-09-10T23:18:58.305564+0000","last_clean":"2024-09-10T23:18:58.305564+0000","last_became_active":"2024-09-10T23:18:56.085726+0000","last_became_peered":"2024-09-10T23:18:56.085726+0000","last_unstale":"2024-09-10T23:18:58.305564+0000","last_undegraded":"2024-09-10T23:18:58.305564+0000","last_fullsized":"2024-09-10T23:18:58.305564+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:59:36.226548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.080426+0000","last_change":"2024-09-10T23:18:55.086081+0000","last_active":"2024-09-10T23:18:57.080426+0000","last_peered":"2024-09-10T23:18:57.080426+0000","last_clean":"2024-09-10T23:18:57.080426+0000","last_became_active":"2024-09-10T23:18:55.085795+0000","last_became_peered":"2024-09-10T23:18:55.085795+0000","last_unstale":"2024-09-10T23:18:57.080426+0000","last_undegraded":"2024-09-10T23:18:57.080426+0000","last_fullsized":"2024-09-10T23:18:57.080426+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:30.866614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081695+0000","last_change":"2024-09-10T23:18:56.084383+0000","last_active":"2024-09-10T23:18:57.081695+0000","last_peered":"2024-09-10T23:18:57.081695+0000","last_clean":"2024-09-10T23:18:57.081695+0000","last_became_active":"2024-09-10T23:18:56.084106+0000","last_became_peered":"2024-09-10T23:18:56.084106+0000","last_unstale":"2024-09-10T23:18:57.081695+0000","last_undegraded":"2024-09-10T23:18:57.081695+0000","last_fullsized":"2024-09-10T23:18:57.081695+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:04.492500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"56'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.085967+0000","last_change":"2024-09-10T23:18:55.079369+0000","last_active":"2024-09-10T23:18:57.085967+0000","last_peered":"2024-09-10T23:18:57.085967+0000","last_clean":"2024-09-10T23:18:57.085967+0000","last_became_active":"2024-09-10T23:18:55.079064+0000","last_became_peered":"2024-09-10T23:18:55.079064+0000","last_unstale":"2024-09-10T23:18:57.085967+0000","last_undegraded":"2024-09-10T23:18:57.085967+0000","last_fullsized":"2024-09-10T23:18:57.085967+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:02.440472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.080392+0000","last_change":"2024-09-10T23:18:56.096829+0000","last_active":"2024-09-10T23:18:57.080392+0000","last_peered":"2024-09-10T23:18:57.080392+0000","last_clean":"2024-09-10T23:18:57.080392+0000","last_became_active":"2024-09-10T23:18:56.096339+0000","last_became_peered":"2024-09-10T23:18:56.096339+0000","last_unstale":"2024-09-10T23:18:57.080392+0000","last_undegraded":"2024-09-10T23:18:57.080392+0000","last_fullsized":"2024-09-10T23:18:57.080392+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:06.327339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304196+0000","last_change":"2024-09-10T23:18:55.082941+0000","last_active":"2024-09-10T23:18:58.304196+0000","last_peered":"2024-09-10T23:18:58.304196+0000","last_clean":"2024-09-10T23:18:58.304196+0000","last_became_active":"2024-09-10T23:18:55.082676+0000","last_became_peered":"2024-09-10T23:18:55.082676+0000","last_unstale":"2024-09-10T23:18:58.304196+0000","last_undegraded":"2024-09-10T23:18:58.304196+0000","last_fullsized":"2024-09-10T23:18:58.304196+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:13.177241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305036+0000","last_change":"2024-09-10T23:18:56.089047+0000","last_active":"2024-09-10T23:18:58.305036+0000","last_peered":"2024-09-10T23:18:58.305036+0000","last_clean":"2024-09-10T23:18:58.305036+0000","last_became_active":"2024-09-10T23:18:56.088792+0000","last_became_peered":"2024-09-10T23:18:56.088792+0000","last_unstale":"2024-09-10T23:18:58.305036+0000","last_undegraded":"2024-09-10T23:18:58.305036+0000","last_fullsized":"2024-09-10T23:18:58.305036+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:13.725585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081952+0000","last_change":"2024-09-10T23:18:55.081652+0000","last_active":"2024-09-10T23:18:57.081952+0000","last_peered":"2024-09-10T23:18:57.081952+0000","last_clean":"2024-09-10T23:18:57.081952+0000","last_became_active":"2024-09-10T23:18:55.081354+0000","last_became_peered":"2024-09-10T23:18:55.081354+0000","last_unstale":"2024-09-10T23:18:57.081952+0000","last_undegraded":"2024-09-10T23:18:57.081952+0000","last_fullsized":"2024-09-10T23:18:57.081952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:16.766558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082208+0000","last_change":"2024-09-10T23:18:56.091901+0000","last_active":"2024-09-10T23:18:57.082208+0000","last_peered":"2024-09-10T23:18:57.082208+0000","last_clean":"2024-09-10T23:18:57.082208+0000","last_became_active":"2024-09-10T23:18:56.091593+0000","last_became_peered":"2024-09-10T23:18:56.091593+0000","last_unstale":"2024-09-10T23:18:57.082208+0000","last_undegraded":"2024-09-10T23:18:57.082208+0000","last_fullsized":"2024-09-10T23:18:57.082208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:41.947788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305389+0000","last_change":"2024-09-10T23:18:55.091463+0000","last_active":"2024-09-10T23:18:58.305389+0000","last_peered":"2024-09-10T23:18:58.305389+0000","last_clean":"2024-09-10T23:18:58.305389+0000","last_became_active":"2024-09-10T23:18:55.091157+0000","last_became_peered":"2024-09-10T23:18:55.091157+0000","last_unstale":"2024-09-10T23:18:58.305389+0000","last_undegraded":"2024-09-10T23:18:58.305389+0000","last_fullsized":"2024-09-10T23:18:58.305389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:52.602228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303835+0000","last_change":"2024-09-10T23:18:56.090018+0000","last_active":"2024-09-10T23:18:58.303835+0000","last_peered":"2024-09-10T23:18:58.303835+0000","last_clean":"2024-09-10T23:18:58.303835+0000","last_became_active":"2024-09-10T23:18:56.089757+0000","last_became_peered":"2024-09-10T23:18:56.089757+0000","last_unstale":"2024-09-10T23:18:58.303835+0000","last_undegraded":"2024-09-10T23:18:58.303835+0000","last_fullsized":"2024-09-10T23:18:58.303835+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:25.270349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.085606+0000","last_change":"2024-09-10T23:18:55.079923+0000","last_active":"2024-09-10T23:18:57.085606+0000","last_peered":"2024-09-10T23:18:57.085606+0000","last_clean":"2024-09-10T23:18:57.085606+0000","last_became_active":"2024-09-10T23:18:55.079648+0000","last_became_peered":"2024-09-10T23:18:55.079648+0000","last_unstale":"2024-09-10T23:18:57.085606+0000","last_undegraded":"2024-09-10T23:18:57.085606+0000","last_fullsized":"2024-09-10T23:18:57.085606+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:35.112461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082858+0000","last_change":"2024-09-10T23:18:56.085249+0000","last_active":"2024-09-10T23:18:57.082858+0000","last_peered":"2024-09-10T23:18:57.082858+0000","last_clean":"2024-09-10T23:18:57.082858+0000","last_became_active":"2024-09-10T23:18:56.084985+0000","last_became_peered":"2024-09-10T23:18:56.084985+0000","last_unstale":"2024-09-10T23:18:57.082858+0000","last_undegraded":"2024-09-10T23:18:57.082858+0000","last_fullsized":"2024-09-10T23:18:57.082858+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:41.406210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304434+0000","last_change":"2024-09-10T23:18:55.079172+0000","last_active":"2024-09-10T23:18:58.304434+0000","last_peered":"2024-09-10T23:18:58.304434+0000","last_clean":"2024-09-10T23:18:58.304434+0000","last_became_active":"2024-09-10T23:18:55.078915+0000","last_became_peered":"2024-09-10T23:18:55.078915+0000","last_unstale":"2024-09-10T23:18:58.304434+0000","last_undegraded":"2024-09-10T23:18:58.304434+0000","last_fullsized":"2024-09-10T23:18:58.304434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:25.929119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304506+0000","last_change":"2024-09-10T23:18:56.086456+0000","last_active":"2024-09-10T23:18:58.304506+0000","last_peered":"2024-09-10T23:18:58.304506+0000","last_clean":"2024-09-10T23:18:58.304506+0000","last_became_active":"2024-09-10T23:18:56.086195+0000","last_became_peered":"2024-09-10T23:18:56.086195+0000","last_unstale":"2024-09-10T23:18:58.304506+0000","last_undegraded":"2024-09-10T23:18:58.304506+0000","last_fullsized":"2024-09-10T23:18:58.304506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:21.417735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.083015+0000","last_change":"2024-09-10T23:18:55.091422+0000","last_active":"2024-09-10T23:18:57.083015+0000","last_peered":"2024-09-10T23:18:57.083015+0000","last_clean":"2024-09-10T23:18:57.083015+0000","last_became_active":"2024-09-10T23:18:55.091111+0000","last_became_peered":"2024-09-10T23:18:55.091111+0000","last_unstale":"2024-09-10T23:18:57.083015+0000","last_undegraded":"2024-09-10T23:18:57.083015+0000","last_fullsized":"2024-09-10T23:18:57.083015+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:32.265505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078201+0000","last_change":"2024-09-10T23:18:56.085889+0000","last_active":"2024-09-10T23:18:57.078201+0000","last_peered":"2024-09-10T23:18:57.078201+0000","last_clean":"2024-09-10T23:18:57.078201+0000","last_became_active":"2024-09-10T23:18:56.085620+0000","last_became_peered":"2024-09-10T23:18:56.085620+0000","last_unstale":"2024-09-10T23:18:57.078201+0000","last_undegraded":"2024-09-10T23:18:57.078201+0000","last_fullsized":"2024-09-10T23:18:57.078201+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:33.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303476+0000","last_change":"2024-09-10T23:18:55.080290+0000","last_active":"2024-09-10T23:18:58.303476+0000","last_peered":"2024-09-10T23:18:58.303476+0000","last_clean":"2024-09-10T23:18:58.303476+0000","last_became_active":"2024-09-10T23:18:55.080019+0000","last_became_peered":"2024-09-10T23:18:55.080019+0000","last_unstale":"2024-09-10T23:18:58.303476+0000","last_undegraded":"2024-09-10T23:18:58.303476+0000","last_fullsized":"2024-09-10T23:18:58.303476+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:10.811412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.079875+0000","last_change":"2024-09-10T23:18:56.072235+0000","last_active":"2024-09-10T23:18:57.079875+0000","last_peered":"2024-09-10T23:18:57.079875+0000","last_clean":"2024-09-10T23:18:57.079875+0000","last_became_active":"2024-09-10T23:18:56.071701+0000","last_became_peered":"2024-09-10T23:18:56.071701+0000","last_unstale":"2024-09-10T23:18:57.079875+0000","last_undegraded":"2024-09-10T23:18:57.079875+0000","last_fullsized":"2024-09-10T23:18:57.079875+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:12.328439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305768+0000","last_change":"2024-09-10T23:18:55.082244+0000","last_active":"2024-09-10T23:18:58.305768+0000","last_peered":"2024-09-10T23:18:58.305768+0000","last_clean":"2024-09-10T23:18:58.305768+0000","last_became_active":"2024-09-10T23:18:55.081844+0000","last_became_peered":"2024-09-10T23:18:55.081844+0000","last_unstale":"2024-09-10T23:18:58.305768+0000","last_undegraded":"2024-09-10T23:18:58.305768+0000","last_fullsized":"2024-09-10T23:18:58.305768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:25.835051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078302+0000","last_change":"2024-09-10T23:18:56.089097+0000","last_active":"2024-09-10T23:18:57.078302+0000","last_peered":"2024-09-10T23:18:57.078302+0000","last_clean":"2024-09-10T23:18:57.078302+0000","last_became_active":"2024-09-10T23:18:56.088788+0000","last_became_peered":"2024-09-10T23:18:56.088788+0000","last_unstale":"2024-09-10T23:18:57.078302+0000","last_undegraded":"2024-09-10T23:18:57.078302+0000","last_fullsized":"2024-09-10T23:18:57.078302+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:14.797076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305468+0000","last_change":"2024-09-10T23:18:55.091669+0000","last_active":"2024-09-10T23:18:58.305468+0000","last_peered":"2024-09-10T23:18:58.305468+0000","last_clean":"2024-09-10T23:18:58.305468+0000","last_became_active":"2024-09-10T23:18:55.091385+0000","last_became_peered":"2024-09-10T23:18:55.091385+0000","last_unstale":"2024-09-10T23:18:58.305468+0000","last_undegraded":"2024-09-10T23:18:58.305468+0000","last_fullsized":"2024-09-10T23:18:58.305468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305475+0000","last_change":"2024-09-10T23:18:56.086556+0000","last_active":"2024-09-10T23:18:58.305475+0000","last_peered":"2024-09-10T23:18:58.305475+0000","last_clean":"2024-09-10T23:18:58.305475+0000","last_became_active":"2024-09-10T23:18:56.085413+0000","last_became_peered":"2024-09-10T23:18:56.085413+0000","last_unstale":"2024-09-10T23:18:58.305475+0000","last_undegraded":"2024-09-10T23:18:58.305475+0000","last_fullsized":"2024-09-10T23:18:58.305475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:09.674355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078493+0000","last_change":"2024-09-10T23:18:55.079031+0000","last_active":"2024-09-10T23:18:57.078493+0000","last_peered":"2024-09-10T23:18:57.078493+0000","last_clean":"2024-09-10T23:18:57.078493+0000","last_became_active":"2024-09-10T23:18:55.078641+0000","last_became_peered":"2024-09-10T23:18:55.078641+0000","last_unstale":"2024-09-10T23:18:57.078493+0000","last_undegraded":"2024-09-10T23:18:57.078493+0000","last_fullsized":"2024-09-10T23:18:57.078493+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:16.989360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305304+0000","last_change":"2024-09-10T23:18:56.081745+0000","last_active":"2024-09-10T23:18:58.305304+0000","last_peered":"2024-09-10T23:18:58.305304+0000","last_clean":"2024-09-10T23:18:58.305304+0000","last_became_active":"2024-09-10T23:18:56.081423+0000","last_became_peered":"2024-09-10T23:18:56.081423+0000","last_unstale":"2024-09-10T23:18:58.305304+0000","last_undegraded":"2024-09-10T23:18:58.305304+0000","last_fullsized":"2024-09-10T23:18:58.305304+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:12.328439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303236+0000","last_change":"2024-09-10T23:18:55.078083+0000","last_active":"2024-09-10T23:18:58.303236+0000","last_peered":"2024-09-10T23:18:58.303236+0000","last_clean":"2024-09-10T23:18:58.303236+0000","last_became_active":"2024-09-10T23:18:55.077157+0000","last_became_peered":"2024-09-10T23:18:55.077157+0000","last_unstale":"2024-09-10T23:18:58.303236+0000","last_undegraded":"2024-09-10T23:18:58.303236+0000","last_fullsized":"2024-09-10T23:18:58.303236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:03.608625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082419+0000","last_change":"2024-09-10T23:18:56.087759+0000","last_active":"2024-09-10T23:18:57.082419+0000","last_peered":"2024-09-10T23:18:57.082419+0000","last_clean":"2024-09-10T23:18:57.082419+0000","last_became_active":"2024-09-10T23:18:56.087498+0000","last_became_peered":"2024-09-10T23:18:56.087498+0000","last_unstale":"2024-09-10T23:18:57.082419+0000","last_undegraded":"2024-09-10T23:18:57.082419+0000","last_fullsized":"2024-09-10T23:18:57.082419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:52.852300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081512+0000","last_change":"2024-09-10T23:18:55.084173+0000","last_active":"2024-09-10T23:18:57.081512+0000","last_peered":"2024-09-10T23:18:57.081512+0000","last_clean":"2024-09-10T23:18:57.081512+0000","last_became_active":"2024-09-10T23:18:55.083904+0000","last_became_peered":"2024-09-10T23:18:55.083904+0000","last_unstale":"2024-09-10T23:18:57.081512+0000","last_undegraded":"2024-09-10T23:18:57.081512+0000","last_fullsized":"2024-09-10T23:18:57.081512+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:11.325433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078698+0000","last_change":"2024-09-10T23:18:56.090774+0000","last_active":"2024-09-10T23:18:57.078698+0000","last_peered":"2024-09-10T23:18:57.078698+0000","last_clean":"2024-09-10T23:18:57.078698+0000","last_became_active":"2024-09-10T23:18:56.090248+0000","last_became_peered":"2024-09-10T23:18:56.090248+0000","last_unstale":"2024-09-10T23:18:57.078698+0000","last_undegraded":"2024-09-10T23:18:57.078698+0000","last_fullsized":"2024-09-10T23:18:57.078698+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:36.512116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.302991+0000","last_change":"2024-09-10T23:18:55.086839+0000","last_active":"2024-09-10T23:18:58.302991+0000","last_peered":"2024-09-10T23:18:58.302991+0000","last_clean":"2024-09-10T23:18:58.302991+0000","last_became_active":"2024-09-10T23:18:55.086582+0000","last_became_peered":"2024-09-10T23:18:55.086582+0000","last_unstale":"2024-09-10T23:18:58.302991+0000","last_undegraded":"2024-09-10T23:18:58.302991+0000","last_fullsized":"2024-09-10T23:18:58.302991+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:53.769535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304921+0000","last_change":"2024-09-10T23:18:56.094826+0000","last_active":"2024-09-10T23:18:58.304921+0000","last_peered":"2024-09-10T23:18:58.304921+0000","last_clean":"2024-09-10T23:18:58.304921+0000","last_became_active":"2024-09-10T23:18:56.094309+0000","last_became_peered":"2024-09-10T23:18:56.094309+0000","last_unstale":"2024-09-10T23:18:58.304921+0000","last_undegraded":"2024-09-10T23:18:58.304921+0000","last_fullsized":"2024-09-10T23:18:58.304921+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:14.379720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305516+0000","last_change":"2024-09-10T23:18:55.088646+0000","last_active":"2024-09-10T23:18:58.305516+0000","last_peered":"2024-09-10T23:18:58.305516+0000","last_clean":"2024-09-10T23:18:58.305516+0000","last_became_active":"2024-09-10T23:18:55.088302+0000","last_became_peered":"2024-09-10T23:18:55.088302+0000","last_unstale":"2024-09-10T23:18:58.305516+0000","last_undegraded":"2024-09-10T23:18:58.305516+0000","last_fullsized":"2024-09-10T23:18:58.305516+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:45.168297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.078265+0000","last_change":"2024-09-10T23:18:56.098890+0000","last_active":"2024-09-10T23:18:57.078265+0000","last_peered":"2024-09-10T23:18:57.078265+0000","last_clean":"2024-09-10T23:18:57.078265+0000","last_became_active":"2024-09-10T23:18:56.098619+0000","last_became_peered":"2024-09-10T23:18:56.098619+0000","last_unstale":"2024-09-10T23:18:57.078265+0000","last_undegraded":"2024-09-10T23:18:57.078265+0000","last_fullsized":"2024-09-10T23:18:57.078265+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:37.032240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.086019+0000","last_change":"2024-09-10T23:18:55.086447+0000","last_active":"2024-09-10T23:18:57.086019+0000","last_peered":"2024-09-10T23:18:57.086019+0000","last_clean":"2024-09-10T23:18:57.086019+0000","last_became_active":"2024-09-10T23:18:55.086061+0000","last_became_peered":"2024-09-10T23:18:55.086061+0000","last_unstale":"2024-09-10T23:18:57.086019+0000","last_undegraded":"2024-09-10T23:18:57.086019+0000","last_fullsized":"2024-09-10T23:18:57.086019+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:37.106126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303709+0000","last_change":"2024-09-10T23:18:56.089012+0000","last_active":"2024-09-10T23:18:58.303709+0000","last_peered":"2024-09-10T23:18:58.303709+0000","last_clean":"2024-09-10T23:18:58.303709+0000","last_became_active":"2024-09-10T23:18:56.088690+0000","last_became_peered":"2024-09-10T23:18:56.088690+0000","last_unstale":"2024-09-10T23:18:58.303709+0000","last_undegraded":"2024-09-10T23:18:58.303709+0000","last_fullsized":"2024-09-10T23:18:58.303709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:04.831502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081921+0000","last_change":"2024-09-10T23:18:55.087429+0000","last_active":"2024-09-10T23:18:57.081921+0000","last_peered":"2024-09-10T23:18:57.081921+0000","last_clean":"2024-09-10T23:18:57.081921+0000","last_became_active":"2024-09-10T23:18:55.084677+0000","last_became_peered":"2024-09-10T23:18:55.084677+0000","last_unstale":"2024-09-10T23:18:57.081921+0000","last_undegraded":"2024-09-10T23:18:57.081921+0000","last_fullsized":"2024-09-10T23:18:57.081921+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:18.725430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.081923+0000","last_change":"2024-09-10T23:18:56.092467+0000","last_active":"2024-09-10T23:18:57.081923+0000","last_peered":"2024-09-10T23:18:57.081923+0000","last_clean":"2024-09-10T23:18:57.081923+0000","last_became_active":"2024-09-10T23:18:56.092160+0000","last_became_peered":"2024-09-10T23:18:56.092160+0000","last_unstale":"2024-09-10T23:18:57.081923+0000","last_undegraded":"2024-09-10T23:18:57.081923+0000","last_fullsized":"2024-09-10T23:18:57.081923+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.811870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303766+0000","last_change":"2024-09-10T23:18:55.082798+0000","last_active":"2024-09-10T23:18:58.303766+0000","last_peered":"2024-09-10T23:18:58.303766+0000","last_clean":"2024-09-10T23:18:58.303766+0000","last_became_active":"2024-09-10T23:18:55.082490+0000","last_became_peered":"2024-09-10T23:18:55.082490+0000","last_unstale":"2024-09-10T23:18:58.303766+0000","last_undegraded":"2024-09-10T23:18:58.303766+0000","last_fullsized":"2024-09-10T23:18:58.303766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:33.785544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305017+0000","last_change":"2024-09-10T23:18:56.090316+0000","last_active":"2024-09-10T23:18:58.305017+0000","last_peered":"2024-09-10T23:18:58.305017+0000","last_clean":"2024-09-10T23:18:58.305017+0000","last_became_active":"2024-09-10T23:18:56.090052+0000","last_became_peered":"2024-09-10T23:18:56.090052+0000","last_unstale":"2024-09-10T23:18:58.305017+0000","last_undegraded":"2024-09-10T23:18:58.305017+0000","last_fullsized":"2024-09-10T23:18:58.305017+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:20.751553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303364+0000","last_change":"2024-09-10T23:18:55.081060+0000","last_active":"2024-09-10T23:18:58.303364+0000","last_peered":"2024-09-10T23:18:58.303364+0000","last_clean":"2024-09-10T23:18:58.303364+0000","last_became_active":"2024-09-10T23:18:55.076346+0000","last_became_peered":"2024-09-10T23:18:55.076346+0000","last_unstale":"2024-09-10T23:18:58.303364+0000","last_undegraded":"2024-09-10T23:18:58.303364+0000","last_fullsized":"2024-09-10T23:18:58.303364+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:15.292325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082386+0000","last_change":"2024-09-10T23:18:56.102976+0000","last_active":"2024-09-10T23:18:57.082386+0000","last_peered":"2024-09-10T23:18:57.082386+0000","last_clean":"2024-09-10T23:18:57.082386+0000","last_became_active":"2024-09-10T23:18:56.101235+0000","last_became_peered":"2024-09-10T23:18:56.101235+0000","last_unstale":"2024-09-10T23:18:57.082386+0000","last_undegraded":"2024-09-10T23:18:57.082386+0000","last_fullsized":"2024-09-10T23:18:57.082386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:24.062275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.079920+0000","last_change":"2024-09-10T23:18:55.092277+0000","last_active":"2024-09-10T23:18:57.079920+0000","last_peered":"2024-09-10T23:18:57.079920+0000","last_clean":"2024-09-10T23:18:57.079920+0000","last_became_active":"2024-09-10T23:18:55.092026+0000","last_became_peered":"2024-09-10T23:18:55.092026+0000","last_unstale":"2024-09-10T23:18:57.079920+0000","last_undegraded":"2024-09-10T23:18:57.079920+0000","last_fullsized":"2024-09-10T23:18:57.079920+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:58.237557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.303882+0000","last_change":"2024-09-10T23:18:56.099522+0000","last_active":"2024-09-10T23:18:58.303882+0000","last_peered":"2024-09-10T23:18:58.303882+0000","last_clean":"2024-09-10T23:18:58.303882+0000","last_became_active":"2024-09-10T23:18:56.099241+0000","last_became_peered":"2024-09-10T23:18:56.099241+0000","last_unstale":"2024-09-10T23:18:58.303882+0000","last_undegraded":"2024-09-10T23:18:58.303882+0000","last_fullsized":"2024-09-10T23:18:58.303882+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:58.597638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.305155+0000","last_change":"2024-09-10T23:18:55.083197+0000","last_active":"2024-09-10T23:18:58.305155+0000","last_peered":"2024-09-10T23:18:58.305155+0000","last_clean":"2024-09-10T23:18:58.305155+0000","last_became_active":"2024-09-10T23:18:55.082785+0000","last_became_peered":"2024-09-10T23:18:55.082785+0000","last_unstale":"2024-09-10T23:18:58.305155+0000","last_undegraded":"2024-09-10T23:18:58.305155+0000","last_fullsized":"2024-09-10T23:18:58.305155+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:11.391580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:58.304626+0000","last_change":"2024-09-10T23:18:56.085814+0000","last_active":"2024-09-10T23:18:58.304626+0000","last_peered":"2024-09-10T23:18:58.304626+0000","last_clean":"2024-09-10T23:18:58.304626+0000","last_became_active":"2024-09-10T23:18:56.085558+0000","last_became_peered":"2024-09-10T23:18:56.085558+0000","last_unstale":"2024-09-10T23:18:58.304626+0000","last_undegraded":"2024-09-10T23:18:58.304626+0000","last_fullsized":"2024-09-10T23:18:58.304626+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:55.056243+0000","last_clean_scrub_stamp":"2024-09-10T23:18:55.056243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:06.910861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"57'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.082548+0000","last_change":"2024-09-10T23:18:55.079748+0000","last_active":"2024-09-10T23:18:57.082548+0000","last_peered":"2024-09-10T23:18:57.082548+0000","last_clean":"2024-09-10T23:18:57.082548+0000","last_became_active":"2024-09-10T23:18:55.079369+0000","last_became_peered":"2024-09-10T23:18:55.079369+0000","last_unstale":"2024-09-10T23:18:57.082548+0000","last_undegraded":"2024-09-10T23:18:57.082548+0000","last_fullsized":"2024-09-10T23:18:57.082548+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:18:54.053237+0000","last_clean_scrub_stamp":"2024-09-10T23:18:54.053237+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:05.324333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":175,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-10T23:18:57.085525+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:18:57.085525+0000","last_peered":"2024-09-10T23:18:57.085525+0000","last_clean":"2024-09-10T23:18:57.085525+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:18:57.085525+0000","last_undegraded":"2024-09-10T23:18:57.085525+0000","last_fullsized":"2024-09-10T23:18:57.085525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476782,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40172,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331668,"statfs":{"total":96636764160,"available":96595628032,"internally_reserved":0,"allocated":679936,"data_stored":299793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46320,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325520,"statfs":{"total":96636764160,"available":96589332480,"internally_reserved":0,"allocated":1273856,"data_stored":889633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40164,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331676,"statfs":{"total":96636764160,"available":96595636224,"internally_reserved":0,"allocated":671744,"data_stored":299141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45740,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326100,"statfs":{"total":96636764160,"available":96589926400,"internally_reserved":0,"allocated":675840,"data_stored":299723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40176,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331664,"statfs":{"total":96636764160,"available":96595623936,"internally_reserved":0,"allocated":684032,"data_stored":300753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40180,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331660,"statfs":{"total":96636764160,"available":96595619840,"internally_reserved":0,"allocated":679936,"data_stored":299301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":1273856,"data_stored":889565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":300775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:05.282 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:19:05.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:19:05.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 -- 172.21.15.17:0/1683609971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14400cc730 msgr2=0x7f14400ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 --2- 172.21.15.17:0/1683609971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14400cc730 0x7f14400ccb60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f143800ad90 tx=0x7f143801dcb0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 -- 172.21.15.17:0/1683609971 shutdown_connections 2024-09-10T23:19:05.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 --2- 172.21.15.17:0/1683609971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14400cc730 0x7f14400ccb60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 --2- 172.21.15.17:0/1683609971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f14400cf040 0x7f14400cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 -- 172.21.15.17:0/1683609971 >> 172.21.15.17:0/1683609971 conn(0x7f14400b17a0 msgr2=0x7f14400b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:05.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 -- 172.21.15.17:0/1683609971 shutdown_connections 2024-09-10T23:19:05.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 -- 172.21.15.17:0/1683609971 wait complete. 2024-09-10T23:19:05.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 Processor -- start 2024-09-10T23:19:05.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.433+0000 7f1447000640 1 -- start start 2024-09-10T23:19:05.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1447000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14400cc730 0x7f1440156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1447000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14400cf040 0x7f1440141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1447000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f144015a2a0 0x7f1440155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1447000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f14400cd510 con 0x7f14400cc730 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1447000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f14400cd390 con 0x7f14400cf040 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1447000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f14400cd690 con 0x7f144015a2a0 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14400cc730 0x7f1440156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14400cc730 0x7f1440156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39508/0 (socket says 172.21.15.17:39508) 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143fe00640 1 -- 172.21.15.17:0/2789556127 learned_addr learned my addr 172.21.15.17:0/2789556127 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1445000640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f144015a2a0 0x7f1440155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1437e00640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14400cf040 0x7f1440141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143fe00640 1 -- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f144015a2a0 msgr2=0x7f1440155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143fe00640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f144015a2a0 0x7f1440155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143fe00640 1 -- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14400cf040 msgr2=0x7f1440141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143fe00640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14400cf040 0x7f1440141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143fe00640 1 -- 172.21.15.17:0/2789556127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144015df00 con 0x7f14400cc730 2024-09-10T23:19:05.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143fe00640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14400cc730 0x7f1440156470 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f143000c3c0 tx=0x7f143000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:05.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143cc00640 1 -- 172.21.15.17:0/2789556127 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430017070 con 0x7f14400cc730 2024-09-10T23:19:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143cc00640 1 -- 172.21.15.17:0/2789556127 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14300053c0 con 0x7f14400cc730 2024-09-10T23:19:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f143cc00640 1 -- 172.21.15.17:0/2789556127 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1430003860 con 0x7f14400cc730 2024-09-10T23:19:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14401569b0 con 0x7f14400cc730 2024-09-10T23:19:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f144015e1a0 con 0x7f14400cc730 2024-09-10T23:19:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.437+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14400ccb60 con 0x7f14400cc730 2024-09-10T23:19:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.441+0000 7f143cc00640 1 -- 172.21.15.17:0/2789556127 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1430003a00 con 0x7f14400cc730 2024-09-10T23:19:05.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.441+0000 7f143cc00640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f141c0725e0 0x7f141c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.441+0000 7f143cc00640 1 -- 172.21.15.17:0/2789556127 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f1430092a30 con 0x7f14400cc730 2024-09-10T23:19:05.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.441+0000 7f1437e00640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f141c0725e0 0x7f141c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.441+0000 7f1437e00640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f141c0725e0 0x7f141c074aa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1428009600 tx=0x7f14280091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.445+0000 7f143cc00640 1 -- 172.21.15.17:0/2789556127 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f143005d890 con 0x7f14400cc730 2024-09-10T23:19:05.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.677+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f14401419b0 con 0x7f14400cc730 2024-09-10T23:19:05.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.681+0000 7f143cc00640 1 -- 172.21.15.17:0/2789556127 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f14300622c0 con 0x7f14400cc730 2024-09-10T23:19:05.686 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:19:05.686 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:19:05.686 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:19:05.687 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:19:05.687 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:19:05.687 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:19:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f141c0725e0 msgr2=0x7f141c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f141c0725e0 0x7f141c074aa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1428009600 tx=0x7f14280091e0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14400cc730 msgr2=0x7f1440156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14400cc730 0x7f1440156470 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f143000c3c0 tx=0x7f143000c880 comp rx=0 tx=0).stop 2024-09-10T23:19:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 shutdown_connections 2024-09-10T23:19:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f141c0725e0 0x7f141c074aa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f144015a2a0 0x7f1440155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14400cf040 0x7f1440141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 --2- 172.21.15.17:0/2789556127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14400cc730 0x7f1440156470 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 >> 172.21.15.17:0/2789556127 conn(0x7f14400b17a0 msgr2=0x7f1440157780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 shutdown_connections 2024-09-10T23:19:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.685+0000 7f1447000640 1 -- 172.21.15.17:0/2789556127 wait complete. 2024-09-10T23:19:05.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:05.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.849+0000 7f5d44400640 1 -- 172.21.15.17:0/1552365617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0cf320 msgr2=0x7f5d3c0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.849+0000 7f5d44400640 1 --2- 172.21.15.17:0/1552365617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0cf320 0x7f5d3c0cfc60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0d2e60 tx=0x7f5d3401cd80 comp rx=0 tx=0).stop 2024-09-10T23:19:05.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.849+0000 7f5d44400640 1 -- 172.21.15.17:0/1552365617 shutdown_connections 2024-09-10T23:19:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.849+0000 7f5d44400640 1 --2- 172.21.15.17:0/1552365617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0cf320 0x7f5d3c0cfc60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.849+0000 7f5d44400640 1 --2- 172.21.15.17:0/1552365617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d3c0d1830 0x7f5d3c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.849+0000 7f5d44400640 1 --2- 172.21.15.17:0/1552365617 >> v2:172.21.15.77:3300/0 conn(0x7f5d3c070ad0 0x7f5d3c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.849+0000 7f5d44400640 1 -- 172.21.15.17:0/1552365617 >> 172.21.15.17:0/1552365617 conn(0x7f5d3c0d1d60 msgr2=0x7f5d3c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.849+0000 7f5d44400640 1 -- 172.21.15.17:0/1552365617 shutdown_connections 2024-09-10T23:19:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.849+0000 7f5d44400640 1 -- 172.21.15.17:0/1552365617 wait complete. 2024-09-10T23:19:05.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 Processor -- start 2024-09-10T23:19:05.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 -- start start 2024-09-10T23:19:05.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c070ad0 0x7f5d3c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d3c0cf320 0x7f5d3c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0d1830 0x7f5d3c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0cd250 con 0x7f5d3c0d1830 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0cd0d0 con 0x7f5d3c070ad0 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c0cd3d0 con 0x7f5d3c0cf320 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d42400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0d1830 0x7f5d3c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d42400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0d1830 0x7f5d3c157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39522/0 (socket says 172.21.15.17:39522) 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d42400640 1 -- 172.21.15.17:0/4050407589 learned_addr learned my addr 172.21.15.17:0/4050407589 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d41a00640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c070ad0 0x7f5d3c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d41000640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d3c0cf320 0x7f5d3c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d42400640 1 -- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d3c0cf320 msgr2=0x7f5d3c0af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d42400640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d3c0cf320 0x7f5d3c0af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d42400640 1 -- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c070ad0 msgr2=0x7f5d3c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d42400640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c070ad0 0x7f5d3c0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d42400640 1 -- 172.21.15.17:0/4050407589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c0b0d40 con 0x7f5d3c0d1830 2024-09-10T23:19:05.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d42400640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0d1830 0x7f5d3c157cb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5d3401b430 tx=0x7f5d34003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d39600640 1 -- 172.21.15.17:0/4050407589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340bb070 con 0x7f5d3c0d1830 2024-09-10T23:19:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d39600640 1 -- 172.21.15.17:0/4050407589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d34004d40 con 0x7f5d3c0d1830 2024-09-10T23:19:05.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d39600640 1 -- 172.21.15.17:0/4050407589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340b2040 con 0x7f5d3c0d1830 2024-09-10T23:19:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c0b0a60 con 0x7f5d3c0d1830 2024-09-10T23:19:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c0aee80 con 0x7f5d3c0d1830 2024-09-10T23:19:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.853+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c0cfc60 con 0x7f5d3c0d1830 2024-09-10T23:19:05.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.857+0000 7f5d39600640 1 -- 172.21.15.17:0/4050407589 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5d340b5030 con 0x7f5d3c0d1830 2024-09-10T23:19:05.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.857+0000 7f5d39600640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d1c0725e0 0x7f5d1c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:05.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.857+0000 7f5d39600640 1 -- 172.21.15.17:0/4050407589 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f5d3412cff0 con 0x7f5d3c0d1830 2024-09-10T23:19:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.857+0000 7f5d41a00640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d1c0725e0 0x7f5d1c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:05.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.857+0000 7f5d41a00640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d1c0725e0 0x7f5d1c074aa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000bb70 tx=0x7f5d3000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:05.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:05.861+0000 7f5d39600640 1 -- 172.21.15.17:0/4050407589 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5d340f1de0 con 0x7f5d3c0d1830 2024-09-10T23:19:06.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.073+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d3c159430 con 0x7f5d3c0d1830 2024-09-10T23:19:06.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d39600640 1 -- 172.21.15.17:0/4050407589 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f5d34016970 con 0x7f5d3c0d1830 2024-09-10T23:19:06.081 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:06.081 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":29,"btime":"2024-09-10T23:18:59:082892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1801943144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1801943144},{"type":"v1","addr":"172.21.15.77:6837","nonce":1801943144}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2387800472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2387800472},{"type":"v1","addr":"172.21.15.77:6835","nonce":2387800472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1881542084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1881542084},{"type":"v1","addr":"172.21.15.17:6835","nonce":1881542084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:55.490263+0000","modified":"2024-09-10T23:18:58.486065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5475},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5475":{"gid":5475,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/1323392007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1323392007},{"type":"v1","addr":"172.21.15.17:6834","nonce":1323392007}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5475,"qdb_cluster":[5475]},"id":3}]} 2024-09-10T23:19:06.081 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 29 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d1c0725e0 msgr2=0x7f5d1c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d1c0725e0 0x7f5d1c074aa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000bb70 tx=0x7f5d3000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0d1830 msgr2=0x7f5d3c157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0d1830 0x7f5d3c157cb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5d3401b430 tx=0x7f5d34003f60 comp rx=0 tx=0).stop 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 shutdown_connections 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d1c0725e0 0x7f5d1c074aa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d3c0d1830 0x7f5d3c157cb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d3c0cf320 0x7f5d3c0af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 --2- 172.21.15.17:0/4050407589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d3c070ad0 0x7f5d3c0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 >> 172.21.15.17:0/4050407589 conn(0x7f5d3c0d1d60 msgr2=0x7f5d3c0b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 shutdown_connections 2024-09-10T23:19:06.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.077+0000 7f5d44400640 1 -- 172.21.15.17:0/4050407589 wait complete. 2024-09-10T23:19:06.504 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:18:55.490263+0000', 'modified': '2024-09-10T23:18:58.486065+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5475}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5475': {'gid': 5475, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6834/1323392007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6832', 'nonce': 1323392007}, {'type': 'v1', 'addr': '172.21.15.17:6834', 'nonce': 1323392007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5475, 'qdb_cluster': [5475]} 2024-09-10T23:19:06.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:19:06.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:19:06.640 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:06.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.649+0000 7f1648600640 1 -- 172.21.15.17:0/2118751479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16400b3360 msgr2=0x7f16400d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.649+0000 7f1648600640 1 --2- 172.21.15.17:0/2118751479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16400b3360 0x7f16400d0580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f162c009840 tx=0x7f162c01c820 comp rx=0 tx=0).stop 2024-09-10T23:19:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.649+0000 7f1648600640 1 -- 172.21.15.17:0/2118751479 shutdown_connections 2024-09-10T23:19:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.649+0000 7f1648600640 1 --2- 172.21.15.17:0/2118751479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16400b3360 0x7f16400d0580 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.649+0000 7f1648600640 1 -- 172.21.15.17:0/2118751479 >> 172.21.15.17:0/2118751479 conn(0x7f16400d1d60 msgr2=0x7f16400d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.649+0000 7f1648600640 1 -- 172.21.15.17:0/2118751479 shutdown_connections 2024-09-10T23:19:06.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.649+0000 7f1648600640 1 -- 172.21.15.17:0/2118751479 wait complete. 2024-09-10T23:19:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1648600640 1 Processor -- start 2024-09-10T23:19:06.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1648600640 1 -- start start 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1648600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16400af8d0 0x7f164015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1648600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16400b3360 0x7f1640159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1648600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164015be40 0x7f16400b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1648600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1640169e20 con 0x7f16400af8d0 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1648600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1640169ca0 con 0x7f16400b3360 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1648600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1640169fa0 con 0x7f164015be40 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16400af8d0 0x7f164015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16400af8d0 0x7f164015a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39536/0 (socket says 172.21.15.17:39536) 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645c00640 1 -- 172.21.15.17:0/3450830868 learned_addr learned my addr 172.21.15.17:0/3450830868 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645200640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16400b3360 0x7f1640159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1646600640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164015be40 0x7f16400b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645c00640 1 -- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164015be40 msgr2=0x7f16400b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645c00640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164015be40 0x7f16400b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645c00640 1 -- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16400b3360 msgr2=0x7f1640159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645c00640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16400b3360 0x7f1640159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645c00640 1 -- 172.21.15.17:0/3450830868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16400b1b10 con 0x7f16400af8d0 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645200640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16400b3360 0x7f1640159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1645c00640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16400af8d0 0x7f164015a200 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f163400c420 tx=0x7f163400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f163d600640 1 -- 172.21.15.17:0/3450830868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634017070 con 0x7f16400af8d0 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f163d600640 1 -- 172.21.15.17:0/3450830868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16340053c0 con 0x7f16400af8d0 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f163d600640 1 -- 172.21.15.17:0/3450830868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634003860 con 0x7f16400af8d0 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.653+0000 7f1648600640 1 -- 172.21.15.17:0/3450830868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16400c6c10 con 0x7f16400af8d0 2024-09-10T23:19:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.657+0000 7f1648600640 1 -- 172.21.15.17:0/3450830868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16401f7430 con 0x7f16400af8d0 2024-09-10T23:19:06.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.657+0000 7f163d600640 1 -- 172.21.15.17:0/3450830868 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1634003a00 con 0x7f16400af8d0 2024-09-10T23:19:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.657+0000 7f163d600640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16200725e0 0x7f1620074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.657+0000 7f163d600640 1 -- 172.21.15.17:0/3450830868 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f1634092aa0 con 0x7f16400af8d0 2024-09-10T23:19:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.657+0000 7f164b9d6000 1 Processor -- start 2024-09-10T23:19:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.657+0000 7f164b9d6000 1 -- start start 2024-09-10T23:19:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.657+0000 7f1645200640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16200725e0 0x7f1620074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 0x555c9a809db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a80a2f0 0x555c9a7bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a7bde10 0x555c9a7be1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555c9a6de3f0 con 0x555c9a7bde10 2024-09-10T23:19:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555c9a61bb20 con 0x555c9a80a2f0 2024-09-10T23:19:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555c9a60af50 con 0x555c9a8099d0 2024-09-10T23:19:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1645200640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16200725e0 0x7f1620074aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f162c0af000 tx=0x7f162c01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1646600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a7bde10 0x555c9a7be1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1646600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a7bde10 0x555c9a7be1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39550/0 (socket says 172.21.15.17:39550) 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1646600640 1 -- 172.21.15.17:0/517200446 learned_addr learned my addr 172.21.15.17:0/517200446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1645200640 1 --2- 172.21.15.17:0/517200446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a80a2f0 0x555c9a7bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1645c00640 1 --2- 172.21.15.17:0/517200446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 0x555c9a809db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1646600640 1 -- 172.21.15.17:0/517200446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 msgr2=0x555c9a809db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1646600640 1 --2- 172.21.15.17:0/517200446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 0x555c9a809db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1646600640 1 -- 172.21.15.17:0/517200446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a80a2f0 msgr2=0x555c9a7bd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1646600640 1 --2- 172.21.15.17:0/517200446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a80a2f0 0x555c9a7bd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1646600640 1 -- 172.21.15.17:0/517200446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9a5d2590 con 0x555c9a7bde10 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1646600640 1 --2- 172.21.15.17:0/517200446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a7bde10 0x555c9a7be1f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f163800f300 tx=0x7f163800f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fc0b6cd2b586cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1632000640 1 -- 172.21.15.17:0/517200446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638018020 con 0x555c9a7bde10 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1632000640 1 -- 172.21.15.17:0/517200446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f163800fe30 con 0x555c9a7bde10 2024-09-10T23:19:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f1632000640 1 -- 172.21.15.17:0/517200446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380146b0 con 0x555c9a7bde10 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 -- 172.21.15.17:0/517200446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a7bde10 msgr2=0x555c9a7be1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 --2- 172.21.15.17:0/517200446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a7bde10 0x555c9a7be1f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f163800f300 tx=0x7f163800f3f0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 -- 172.21.15.17:0/517200446 shutdown_connections 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 --2- 172.21.15.17:0/517200446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a7bde10 0x555c9a7be1f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 --2- 172.21.15.17:0/517200446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a80a2f0 0x555c9a7bd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 --2- 172.21.15.17:0/517200446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 0x555c9a809db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 -- 172.21.15.17:0/517200446 >> 172.21.15.17:0/517200446 conn(0x555c9a6a7130 msgr2=0x555c9a7ece80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 -- 172.21.15.17:0/517200446 shutdown_connections 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 -- 172.21.15.17:0/517200446 wait complete. 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 -- start start 2024-09-10T23:19:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.661+0000 7f164b9d6000 1 Processor -- start 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a7ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a7eae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 0x555c9a7eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555c9a5a55d0 con 0x555c9a8099d0 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555c9a60ed60 con 0x555c9a7bde10 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555c9a5b1500 con 0x555c9a80a2f0 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 10 client.0 _ll_register_callbacks cb 0x555c9a5b5810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a7eae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a7eae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39562/0 (socket says 172.21.15.17:39562) 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645200640 1 -- 172.21.15.17:0/1801302818 learned_addr learned my addr 172.21.15.17:0/1801302818 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645c00640 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a7ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1646600640 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 0x555c9a7eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645200640 1 -- 172.21.15.17:0/1801302818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 msgr2=0x555c9a7eb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645200640 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 0x555c9a7eb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645200640 1 -- 172.21.15.17:0/1801302818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 msgr2=0x555c9a7ea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645200640 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a7ea6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645200640 1 -- 172.21.15.17:0/1801302818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c9a5a9170 con 0x555c9a8099d0 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645c00640 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a7ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645200640 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a7eae70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f162c000c10 tx=0x7f162c0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8b8b5cd2a93c9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1626a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1626a00640 1 -- 172.21.15.17:0/1801302818 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c0b2040 con 0x555c9a8099d0 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1626a00640 1 -- 172.21.15.17:0/1801302818 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f162c005400 con 0x555c9a8099d0 2024-09-10T23:19:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 -- 172.21.15.17:0/1801302818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c9a5a30f0 con 0x555c9a8099d0 2024-09-10T23:19:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1626a00640 1 -- 172.21.15.17:0/1801302818 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f162c0d2050 con 0x555c9a8099d0 2024-09-10T23:19:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 10 client.5628 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 -- 172.21.15.17:0/1801302818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x555c9a68fef0 con 0x555c9a8099d0 2024-09-10T23:19:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1626a00640 1 -- 172.21.15.17:0/1801302818 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x555c9a5a30f0 con 0x555c9a8099d0 2024-09-10T23:19:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1626a00640 1 -- 172.21.15.17:0/1801302818 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f162c0d5020 con 0x555c9a8099d0 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 10 client.5628 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 10 client.5628 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 20 client.5628 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x555c9a7ec0f0 0x555c9a81bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 4 client.5628 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f164b9d6000 1 -- 172.21.15.17:0/1801302818 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c9a61da70 con 0x555c9a7ec0f0 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645c00640 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x555c9a7ec0f0 0x555c9a81bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1645c00640 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x555c9a7ec0f0 0x555c9a81bc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd610687a466eee2 server_cookie=a0f7b71aca502f76 in_seq=0 out_seq=0 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.665+0000 7f1626a00640 10 client.5628 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f1626a00640 1 -- 172.21.15.17:0/1801302818 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c9a61da70 con 0x555c9a7ec0f0 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f1626a00640 10 client.5628 handle_command_reply: tid=0 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 client.5628 shutdown 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 -- 172.21.15.17:0/1801302818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 msgr2=0x555c9a7eae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a7eae70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f162c000c10 tx=0x7f162c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 -- 172.21.15.17:0/1801302818 shutdown_connections 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x555c9a7ec0f0 0x555c9a81bc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 0x555c9a7eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a7eae70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f1626a00640 0 client.5628 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1801302818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a7ea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 -- 172.21.15.17:0/1801302818 >> 172.21.15.17:0/1801302818 conn(0x555c9a6a7130 msgr2=0x555c9a7bcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 -- 172.21.15.17:0/1801302818 shutdown_connections 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 1 -- 172.21.15.17:0/1801302818 wait complete. 2024-09-10T23:19:06.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.669+0000 7f164b9d6000 20 client.5628 trim_cache size 0 max 16384 2024-09-10T23:19:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 Processor -- start 2024-09-10T23:19:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- start start 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a87bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 0x555c9a87c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a80a2f0 0x555c9a87c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f16402041b0 con 0x555c9a80a2f0 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1640203210 con 0x555c9a7bde10 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f16400c82b0 con 0x555c9a8099d0 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1646600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a80a2f0 0x555c9a87c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1646600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a80a2f0 0x555c9a87c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39578/0 (socket says 172.21.15.17:39578) 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1646600640 1 -- 172.21.15.17:0/1834064324 learned_addr learned my addr 172.21.15.17:0/1834064324 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1645c00640 1 --2- 172.21.15.17:0/1834064324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a87bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1645200640 1 --2- 172.21.15.17:0/1834064324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 0x555c9a87c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1646600640 1 -- 172.21.15.17:0/1834064324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 msgr2=0x555c9a87c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1646600640 1 --2- 172.21.15.17:0/1834064324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 0x555c9a87c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1646600640 1 -- 172.21.15.17:0/1834064324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 msgr2=0x555c9a87bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1646600640 1 --2- 172.21.15.17:0/1834064324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a87bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1646600640 1 -- 172.21.15.17:0/1834064324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9a666d90 con 0x555c9a80a2f0 2024-09-10T23:19:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1646600640 1 --2- 172.21.15.17:0/1834064324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a80a2f0 0x555c9a87c850 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1638017040 tx=0x7f16380049b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23a0573f59357a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1631600640 1 -- 172.21.15.17:0/1834064324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638018050 con 0x555c9a80a2f0 2024-09-10T23:19:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1631600640 1 -- 172.21.15.17:0/1834064324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1638021070 con 0x555c9a80a2f0 2024-09-10T23:19:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f1631600640 1 -- 172.21.15.17:0/1834064324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16380052a0 con 0x555c9a80a2f0 2024-09-10T23:19:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- 172.21.15.17:0/1834064324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a80a2f0 msgr2=0x555c9a87c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1834064324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a80a2f0 0x555c9a87c850 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1638017040 tx=0x7f16380049b0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- 172.21.15.17:0/1834064324 shutdown_connections 2024-09-10T23:19:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1834064324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a80a2f0 0x555c9a87c850 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1834064324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a8099d0 0x555c9a87c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 --2- 172.21.15.17:0/1834064324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a87bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- 172.21.15.17:0/1834064324 >> 172.21.15.17:0/1834064324 conn(0x555c9a6a7130 msgr2=0x555c9a7c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- 172.21.15.17:0/1834064324 shutdown_connections 2024-09-10T23:19:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- 172.21.15.17:0/1834064324 wait complete. 2024-09-10T23:19:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.689+0000 7f164b9d6000 1 -- start start 2024-09-10T23:19:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 Processor -- start 2024-09-10T23:19:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a87fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a880350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 0x555c9a880890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x555c9a6ca730 con 0x555c9a8099d0 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555c9a613390 con 0x555c9a7bde10 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555c9a61a8f0 con 0x555c9a80a2f0 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 10 client.0 _ll_register_callbacks cb 0x7f1628003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a880350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a880350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39590/0 (socket says 172.21.15.17:39590) 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645200640 1 -- 172.21.15.17:0/4190224147 learned_addr learned my addr 172.21.15.17:0/4190224147 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645c00640 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a87fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1646600640 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 0x555c9a880890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645200640 1 -- 172.21.15.17:0/4190224147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 msgr2=0x555c9a880890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645200640 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 0x555c9a880890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645200640 1 -- 172.21.15.17:0/4190224147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 msgr2=0x555c9a87fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645200640 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a87fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645200640 1 -- 172.21.15.17:0/4190224147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c9a5d1a90 con 0x555c9a8099d0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645200640 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a880350 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f162c098400 tx=0x7f162c009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaf755a87c8a028 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1626a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1626a00640 1 -- 172.21.15.17:0/4190224147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c0b2040 con 0x555c9a8099d0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1626a00640 1 -- 172.21.15.17:0/4190224147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f162c004d60 con 0x555c9a8099d0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 -- 172.21.15.17:0/4190224147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1638021070 con 0x555c9a8099d0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1626a00640 1 -- 172.21.15.17:0/4190224147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f162c0e5050 con 0x555c9a8099d0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 10 client.5634 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 -- 172.21.15.17:0/4190224147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x555c9a5b0050 con 0x555c9a8099d0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1626a00640 1 -- 172.21.15.17:0/4190224147 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1638021070 con 0x555c9a8099d0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1626a00640 1 -- 172.21.15.17:0/4190224147 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f162c0e8020 con 0x555c9a8099d0 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 10 client.5634 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:06.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 10 client.5634 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:19:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 20 client.5634 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x555c9a81eed0 0x555c9a81dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 4 client.5634 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:19:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 -- 172.21.15.17:0/4190224147 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "status"}) -- 0x555c9a619520 con 0x555c9a81eed0 2024-09-10T23:19:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645c00640 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x555c9a81eed0 0x555c9a81dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1645c00640 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x555c9a81eed0 0x555c9a81dff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acd1623999cc8f94 server_cookie=ce4a69d935b007d1 in_seq=0 out_seq=0 2024-09-10T23:19:06.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1626a00640 10 client.5634 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1626a00640 1 -- 172.21.15.17:0/4190224147 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x555c9a619520 con 0x555c9a81eed0 2024-09-10T23:19:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f1626a00640 10 client.5634 handle_command_reply: tid=0 2024-09-10T23:19:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.693+0000 7f164b9d6000 1 client.5634 shutdown 2024-09-10T23:19:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 -- 172.21.15.17:0/4190224147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 msgr2=0x555c9a880350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a880350 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f162c098400 tx=0x7f162c009790 comp rx=0 tx=0).stop 2024-09-10T23:19:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 -- 172.21.15.17:0/4190224147 shutdown_connections 2024-09-10T23:19:06.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x555c9a81eed0 0x555c9a81dff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555c9a80a2f0 0x555c9a880890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555c9a8099d0 0x555c9a880350 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1626a00640 0 client.5634 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 --2- 172.21.15.17:0/4190224147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555c9a7bde10 0x555c9a87fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 -- 172.21.15.17:0/4190224147 >> 172.21.15.17:0/4190224147 conn(0x555c9a6a7130 msgr2=0x555c9a7c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 -- 172.21.15.17:0/4190224147 shutdown_connections 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 1 -- 172.21.15.17:0/4190224147 wait complete. 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f164b9d6000 20 client.5634 trim_cache size 0 max 16384 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 5475, 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 10.627449331999999, 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 29, 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 57, 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 57, 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 15.102972984000001 2024-09-10T23:19:06.705 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:06.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 -- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16200725e0 msgr2=0x7f1620074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16200725e0 0x7f1620074aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f162c0af000 tx=0x7f162c01b060 comp rx=0 tx=0).stop 2024-09-10T23:19:06.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 -- 172.21.15.17:0/3450830868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16400af8d0 msgr2=0x7f164015a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16400af8d0 0x7f164015a200 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f163400c420 tx=0x7f163400c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 -- 172.21.15.17:0/3450830868 shutdown_connections 2024-09-10T23:19:06.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16200725e0 0x7f1620074aa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f164015be40 0x7f16400b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16400b3360 0x7f1640159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 --2- 172.21.15.17:0/3450830868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16400af8d0 0x7f164015a200 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 -- 172.21.15.17:0/3450830868 >> 172.21.15.17:0/3450830868 conn(0x7f16400d1d60 msgr2=0x7f16400b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 -- 172.21.15.17:0/3450830868 shutdown_connections 2024-09-10T23:19:06.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.697+0000 7f1648600640 1 -- 172.21.15.17:0/3450830868 wait complete. 2024-09-10T23:19:06.720 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:19:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 -- 172.21.15.17:0/2047742623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc153030 msgr2=0x7f79cc0b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 --2- 172.21.15.17:0/2047742623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc153030 0x7f79cc0b3e30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f79cc076380 tx=0x7f79c401cd50 comp rx=0 tx=0).stop 2024-09-10T23:19:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 -- 172.21.15.17:0/2047742623 shutdown_connections 2024-09-10T23:19:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 --2- 172.21.15.17:0/2047742623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc153030 0x7f79cc0b3e30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 --2- 172.21.15.17:0/2047742623 >> v2:172.21.15.77:3300/0 conn(0x7f79cc152c50 0x7f79cc070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 -- 172.21.15.17:0/2047742623 >> 172.21.15.17:0/2047742623 conn(0x7f79cc0d03d0 msgr2=0x7f79cc0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 -- 172.21.15.17:0/2047742623 shutdown_connections 2024-09-10T23:19:06.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 -- 172.21.15.17:0/2047742623 wait complete. 2024-09-10T23:19:06.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 Processor -- start 2024-09-10T23:19:06.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.909+0000 7f79d3a00640 1 -- start start 2024-09-10T23:19:06.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d3a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc0d1120 0x7f79cc150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d3a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79cc152c50 0x7f79cc14d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d3a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79cc153030 0x7f79cc14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d3a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc0716c0 con 0x7f79cc0d1120 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d3a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc071540 con 0x7f79cc152c50 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d3a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f79cc0b4a20 con 0x7f79cc153030 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc0d1120 0x7f79cc150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc0d1120 0x7f79cc150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41248/0 (socket says 172.21.15.17:41248) 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1000640 1 -- 172.21.15.17:0/419512170 learned_addr learned my addr 172.21.15.17:0/419512170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79cbe00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79cc152c50 0x7f79cc14d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1a00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79cc153030 0x7f79cc14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1000640 1 -- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79cc153030 msgr2=0x7f79cc14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1000640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79cc153030 0x7f79cc14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1000640 1 -- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79cc152c50 msgr2=0x7f79cc14d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1000640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79cc152c50 0x7f79cc14d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1000640 1 -- 172.21.15.17:0/419512170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc152210 con 0x7f79cc0d1120 2024-09-10T23:19:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d1000640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc0d1120 0x7f79cc150ec0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f79c000d980 tx=0x7f79c000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79c8c00640 1 -- 172.21.15.17:0/419512170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0017070 con 0x7f79cc0d1120 2024-09-10T23:19:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79c8c00640 1 -- 172.21.15.17:0/419512170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79c0009d60 con 0x7f79cc0d1120 2024-09-10T23:19:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79c8c00640 1 -- 172.21.15.17:0/419512170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0005280 con 0x7f79cc0d1120 2024-09-10T23:19:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79cc14fb10 con 0x7f79cc0d1120 2024-09-10T23:19:06.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79cc1500d0 con 0x7f79cc0d1120 2024-09-10T23:19:06.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79cc070350 con 0x7f79cc0d1120 2024-09-10T23:19:06.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.913+0000 7f79c8c00640 1 -- 172.21.15.17:0/419512170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f79c0005420 con 0x7f79cc0d1120 2024-09-10T23:19:06.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.917+0000 7f79c8c00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f79ac0725e0 0x7f79ac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:06.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.917+0000 7f79c8c00640 1 -- 172.21.15.17:0/419512170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f79c00935c0 con 0x7f79cc0d1120 2024-09-10T23:19:06.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.917+0000 7f79cbe00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f79ac0725e0 0x7f79ac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:06.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.917+0000 7f79cbe00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f79ac0725e0 0x7f79ac074aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79cc154490 tx=0x7f79b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:06.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:06.921+0000 7f79c8c00640 1 -- 172.21.15.17:0/419512170 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f79c005eb00 con 0x7f79cc0d1120 2024-09-10T23:19:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.129+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f79cc14f560 con 0x7f79cc0d1120 2024-09-10T23:19:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.129+0000 7f79c8c00640 1 -- 172.21.15.17:0/419512170 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7f79c0067220 con 0x7f79cc0d1120 2024-09-10T23:19:07.135 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f79ac0725e0 msgr2=0x7f79ac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f79ac0725e0 0x7f79ac074aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79cc154490 tx=0x7f79b8009040 comp rx=0 tx=0).stop 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc0d1120 msgr2=0x7f79cc150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc0d1120 0x7f79cc150ec0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f79c000d980 tx=0x7f79c000de40 comp rx=0 tx=0).stop 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 shutdown_connections 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f79ac0725e0 0x7f79ac074aa0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79cc153030 0x7f79cc14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79cc152c50 0x7f79cc14d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 --2- 172.21.15.17:0/419512170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79cc0d1120 0x7f79cc150ec0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:07.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 >> 172.21.15.17:0/419512170 conn(0x7f79cc0d03d0 msgr2=0x7f79cc15ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:07.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 shutdown_connections 2024-09-10T23:19:07.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07.133+0000 7f79d3a00640 1 -- 172.21.15.17:0/419512170 wait complete. 2024-09-10T23:19:07.157 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:19:07.158 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:19:07.158 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:19:07.158 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:19:07.158 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:19:07.158 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:19:07.158 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:19:07.158 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:19:07.158 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:19:07.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:07.158 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:19:07.168 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42224sec preferred_lft 42224sec 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:19:07.169 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:19:07.170 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:19:07.171 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:19:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:19:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:19:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:19:07.171 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:19:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:19:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:19:07.171 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:19:07.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:07.171 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:19:07.233 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:19:07.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:07.235 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:19:07.289 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:19:07.289 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:19:07.289 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:19:07.290 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:19:07.290 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:19:07.290 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:19:07.290 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:19:07.290 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:19:07.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:19:07.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:19:07.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:19:07.290 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:19:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:19:07.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:19:07.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:07.431 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:19:07.440 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:19:07.440 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:19:07.441 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:19:07.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:07.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:19:07.504 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:19:07.504 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:19:07.504 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:19:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:19:07.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:19:07.560 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:19:07.612 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:19:07.676 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:19:07.730 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:19:07.730 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:19:07.730 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:19:07.730 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:19:07.730 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:19:07.730 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:19:07.730 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:19:07.730 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:19:07.730 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:19:07.731 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:19:07.732 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:19:07.732 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:19:07.732 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:19:07.732 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:19:07.732 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:19:07.732 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:19:07.732 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:19:07.732 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:19:07.732 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:19:07.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:07.733 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:19:07.784 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:19:07.785 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:19:07.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:19:07.851 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:19:07.901 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:19:07.902 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:19:07.903 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:19:07.904 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:19:07.904 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:19:07.904 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:19:07.904 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:19:07.904 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:19:07.904 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:19:07.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:07.905 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:19:07.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:19:07.921+0000 7ff98c014580 -1 init, newargv = 0x55ee7ebbd9d0 newargc=15 2024-09-10T23:19:07.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[50601]: starting ceph client 2024-09-10T23:19:07.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[50601]: starting fuse 2024-09-10T23:19:07.936 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:19:07.936 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:19:07.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:19:07.937 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:19:07.938 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:19:08.065 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.50601.asok 2024-09-10T23:19:08.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:19:08.077 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50601.asok 2024-09-10T23:19:08.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:08.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50601.asok status 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "50601", 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:08.252 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 5649, 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 5649 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:19:08.253 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3699398963 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3699398963 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.5649 192.168.0.1:0/3699398963", 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/3699398963", 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:19:08.254 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 29, 2024-09-10T23:19:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 57, 2024-09-10T23:19:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:19:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:19:08.255 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:19:08.255 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:08.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:08.268 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:19:08.268 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:19:08.277 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:19:08.278 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:19:08.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:08.278 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:19:08.339 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-10T23:19:08.339 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-10T23:19:08.339 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-10T23:19:08.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:08.340 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> import json 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> import sys 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> try: 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> except OSError as e: 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> sys.exit(e.errno) 2024-09-10T23:19:08.395 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:08.396 DEBUG:teuthology.orchestra.run.smithi017:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T23:19:08.396 DEBUG:teuthology.orchestra.run.smithi017:> print(json.dumps( 2024-09-10T23:19:08.396 DEBUG:teuthology.orchestra.run.smithi017:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T23:19:08.396 DEBUG:teuthology.orchestra.run.smithi017:> indent=2)) 2024-09-10T23:19:08.396 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:19:08.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:08 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-10T23:19:08.516 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T23:19:08.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:08.517 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-09-10T23:19:08.578 INFO:teuthology.orchestra.run.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-09-10T23:19:08.903 INFO:teuthology.orchestra.run.smithi017.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-10T23:19:20.662 INFO:teuthology.orchestra.run.smithi017.stderr:Updating files: 15% (216/1398) Updating files: 16% (224/1398) Updating files: 17% (238/1398) Updating files: 18% (252/1398) Updating files: 19% (266/1398) Updating files: 20% (280/1398) Updating files: 21% (294/1398) Updating files: 22% (308/1398) Updating files: 23% (322/1398) Updating files: 24% (336/1398) Updating files: 25% (350/1398) Updating files: 26% (364/1398) Updating files: 27% (378/1398) Updating files: 28% (392/1398) Updating files: 29% (406/1398) Updating files: 29% (418/1398) Updating files: 30% (420/1398) Updating files: 31% (434/1398) Updating files: 32% (448/1398) Updating files: 33% (462/1398) Updating files: 34% (476/1398) Updating files: 35% (490/1398) Updating files: 36% (504/1398) Updating files: 37% (518/1398) Updating files: 38% (532/1398) Updating files: 39% (546/1398) Updating files: 40% (560/1398) Updating files: 41% (574/1398) Updating files: 42% (588/1398) Updating files: 43% (602/1398) Updating files: 44% (616/1398) Updating files: 45% (630/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 53% (751/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 66% (930/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 79% (1113/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 88% (1235/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-10T23:19:20.674 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-09-10T23:19:20.674 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-10T23:19:20.674 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-10T23:19:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 -- 172.21.15.17:0/4056360409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f661415be00 msgr2=0x7f661415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 --2- 172.21.15.17:0/4056360409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f661415be00 0x7f661415d4f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6604009900 tx=0x7f660401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 -- 172.21.15.17:0/4056360409 shutdown_connections 2024-09-10T23:19:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 --2- 172.21.15.17:0/4056360409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66140d04f0 0x7f661415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 --2- 172.21.15.17:0/4056360409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f661415be00 0x7f661415d4f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 -- 172.21.15.17:0/4056360409 >> 172.21.15.17:0/4056360409 conn(0x7f661409a9f0 msgr2=0x7f661409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 -- 172.21.15.17:0/4056360409 shutdown_connections 2024-09-10T23:19:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 -- 172.21.15.17:0/4056360409 wait complete. 2024-09-10T23:19:20.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 Processor -- start 2024-09-10T23:19:20.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.861+0000 7f661a000640 1 -- start start 2024-09-10T23:19:20.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f661a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66140b12e0 0x7f66141661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f661a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66140d04f0 0x7f661415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f661a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f661415be00 0x7f661415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f661a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6614168f20 con 0x7f661415be00 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f661a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6614168da0 con 0x7f66140d04f0 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f661a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f66141690a0 con 0x7f66140b12e0 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f661415be00 0x7f661415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f660be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66140d04f0 0x7f661415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f661415be00 0x7f661415b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37168/0 (socket says 172.21.15.17:37168) 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613e00640 1 -- 172.21.15.17:0/1485922543 learned_addr learned my addr 172.21.15.17:0/1485922543 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613400640 1 --2- 172.21.15.17:0/1485922543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66140b12e0 0x7f66141661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613e00640 1 -- 172.21.15.17:0/1485922543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66140b12e0 msgr2=0x7f66141661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613e00640 1 --2- 172.21.15.17:0/1485922543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66140b12e0 0x7f66141661e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613e00640 1 -- 172.21.15.17:0/1485922543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66140d04f0 msgr2=0x7f661415ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613e00640 1 --2- 172.21.15.17:0/1485922543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66140d04f0 0x7f661415ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613e00640 1 -- 172.21.15.17:0/1485922543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66140cc880 con 0x7f661415be00 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f6613e00640 1 --2- 172.21.15.17:0/1485922543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f661415be00 0x7f661415b2a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f660c00eaf0 tx=0x7f660c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f660b400640 1 -- 172.21.15.17:0/1485922543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c004b30 con 0x7f661415be00 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f660b400640 1 -- 172.21.15.17:0/1485922543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f660c004cf0 con 0x7f661415be00 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f661a000640 1 -- 172.21.15.17:0/1485922543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66141f9ba0 con 0x7f661415be00 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f660b400640 1 -- 172.21.15.17:0/1485922543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c005280 con 0x7f661415be00 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f661a000640 1 -- 172.21.15.17:0/1485922543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661415e4c0 con 0x7f661415be00 2024-09-10T23:19:20.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.865+0000 7f660b400640 1 -- 172.21.15.17:0/1485922543 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f660c005420 con 0x7f661415be00 2024-09-10T23:19:20.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f660b400640 1 --2- 172.21.15.17:0/1485922543 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65f00725e0 0x7f65f0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 Processor -- start 2024-09-10T23:19:20.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f660b400640 1 -- 172.21.15.17:0/1485922543 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f660c0940c0 con 0x7f661415be00 2024-09-10T23:19:20.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 -- start start 2024-09-10T23:19:20.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f6613400640 1 --2- 172.21.15.17:0/1485922543 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65f00725e0 0x7f65f0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079c3ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3b350 0x565079c3b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 0x565079c7f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x565079b0dbd0 con 0x565079c3aa30 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x565079a82d40 con 0x565079c3bc70 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x565079a72170 con 0x565079c3b350 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f6613400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079c3ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f6613400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079c3ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37184/0 (socket says 172.21.15.17:37184) 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f6613400640 1 -- 172.21.15.17:0/3727413146 learned_addr learned my addr 172.21.15.17:0/3727413146 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f660be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3b350 0x565079c3b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f6613e00640 1 --2- 172.21.15.17:0/3727413146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 0x565079c7f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f6613400640 1 --2- 172.21.15.17:0/1485922543 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65f00725e0 0x7f65f0074aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f66040af000 tx=0x7f660401b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f660be00640 1 -- 172.21.15.17:0/3727413146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 msgr2=0x565079c7f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f660be00640 1 --2- 172.21.15.17:0/3727413146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 0x565079c7f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f660be00640 1 -- 172.21.15.17:0/3727413146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 msgr2=0x565079c3ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f660be00640 1 --2- 172.21.15.17:0/3727413146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079c3ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f660be00640 1 -- 172.21.15.17:0/3727413146 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565079a25420 con 0x565079c3b350 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f660be00640 1 --2- 172.21.15.17:0/3727413146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3b350 0x565079c3b730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66140d2770 tx=0x7f65fc007e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea6e10ce1686e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f6603e00640 1 -- 172.21.15.17:0/3727413146 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0052e0 con 0x565079c3b350 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f6603e00640 1 -- 172.21.15.17:0/3727413146 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65fc018070 con 0x565079c3b350 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f6603e00640 1 -- 172.21.15.17:0/3727413146 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00f9e0 con 0x565079c3b350 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 -- 172.21.15.17:0/3727413146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3b350 msgr2=0x565079c3b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 --2- 172.21.15.17:0/3727413146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3b350 0x565079c3b730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66140d2770 tx=0x7f65fc007e40 comp rx=0 tx=0).stop 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 -- 172.21.15.17:0/3727413146 shutdown_connections 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 --2- 172.21.15.17:0/3727413146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 0x565079c7f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 --2- 172.21.15.17:0/3727413146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3b350 0x565079c3b730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 --2- 172.21.15.17:0/3727413146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079c3ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 -- 172.21.15.17:0/3727413146 >> 172.21.15.17:0/3727413146 conn(0x565079c517f0 msgr2=0x565079c53be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:20.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 -- 172.21.15.17:0/3727413146 shutdown_connections 2024-09-10T23:19:20.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.869+0000 7f661d349000 1 -- 172.21.15.17:0/3727413146 wait complete. 2024-09-10T23:19:20.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 -- start start 2024-09-10T23:19:20.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 Processor -- start 2024-09-10T23:19:20.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3aa30 0x565079c800c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c80600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 0x565079c80b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x565079a176f0 con 0x565079c3b350 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x565079a75f80 con 0x565079c3bc70 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x565079737920 con 0x565079c3aa30 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 10 client.0 _ll_register_callbacks cb 0x565079af9d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f660be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c80600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f660be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c80600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37190/0 (socket says 172.21.15.17:37190) 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f660be00640 1 -- 172.21.15.17:0/1724971816 learned_addr learned my addr 172.21.15.17:0/1724971816 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f6613e00640 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 0x565079c80b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f6613400640 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3aa30 0x565079c800c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f660be00640 1 -- 172.21.15.17:0/1724971816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3aa30 msgr2=0x565079c800c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:20.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f660be00640 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3aa30 0x565079c800c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f660be00640 1 -- 172.21.15.17:0/1724971816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 msgr2=0x565079c80b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:20.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f660be00640 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 0x565079c80b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f660be00640 1 -- 172.21.15.17:0/1724971816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565079a40590 con 0x565079c3b350 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f660be00640 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c80600 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f65fc001ec0 tx=0x7f65fc00fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9e75446fd36824 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f6600c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f6600c00640 1 -- 172.21.15.17:0/1724971816 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc003800 con 0x565079c3b350 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 -- 172.21.15.17:0/1724971816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565079a0a490 con 0x565079c3b350 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f6600c00640 1 -- 172.21.15.17:0/1724971816 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f65fc0039a0 con 0x565079c3b350 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f6600c00640 1 -- 172.21.15.17:0/1724971816 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65fc02c050 con 0x565079c3b350 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 10 client.5661 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 -- 172.21.15.17:0/1724971816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x565079a10350 con 0x565079c3b350 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f6600c00640 1 -- 172.21.15.17:0/1724971816 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x565079a0a490 con 0x565079c3b350 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f6600c00640 1 -- 172.21.15.17:0/1724971816 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f65fc02f020 con 0x565079c3b350 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 10 client.5661 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 10 client.5661 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 20 client.5661 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x565079c88490 0x565079c8a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 4 client.5661 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.873+0000 7f661d349000 1 -- 172.21.15.17:0/1724971816 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565079a84c90 con 0x565079c88490 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f6613400640 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x565079c88490 0x565079c8a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f6613400640 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x565079c88490 0x565079c8a880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a445a964a1d41a3e server_cookie=d3037371c3161de4 in_seq=0 out_seq=0 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f6600c00640 10 client.5661 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f6600c00640 1 -- 172.21.15.17:0/1724971816 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565079a84c90 con 0x565079c88490 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f6600c00640 10 client.5661 handle_command_reply: tid=0 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 client.5661 shutdown 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 -- 172.21.15.17:0/1724971816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 msgr2=0x565079c80600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c80600 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f65fc001ec0 tx=0x7f65fc00fd90 comp rx=0 tx=0).stop 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 -- 172.21.15.17:0/1724971816 shutdown_connections 2024-09-10T23:19:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x565079c88490 0x565079c8a880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3bc70 0x565079c80b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c80600 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f6600c00640 0 client.5661 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 --2- 172.21.15.17:0/1724971816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3aa30 0x565079c800c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 -- 172.21.15.17:0/1724971816 >> 172.21.15.17:0/1724971816 conn(0x565079c517f0 msgr2=0x565079c3c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 -- 172.21.15.17:0/1724971816 shutdown_connections 2024-09-10T23:19:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 1 -- 172.21.15.17:0/1724971816 wait complete. 2024-09-10T23:19:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.877+0000 7f661d349000 20 client.5661 trim_cache size 0 max 16384 2024-09-10T23:19:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f661d349000 1 Processor -- start 2024-09-10T23:19:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f661d349000 1 -- start start 2024-09-10T23:19:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f661d349000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3aa30 0x565079c86110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f661d349000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c86650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f661d349000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 0x565079c4fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f661d349000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6614200590 con 0x565079c3b350 2024-09-10T23:19:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f661d349000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f661406f500 con 0x565079c3aa30 2024-09-10T23:19:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f661d349000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f66141f6300 con 0x565079c3bc70 2024-09-10T23:19:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f660be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c86650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f660be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c86650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37198/0 (socket says 172.21.15.17:37198) 2024-09-10T23:19:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f660be00640 1 -- 172.21.15.17:0/584973775 learned_addr learned my addr 172.21.15.17:0/584973775 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f6613400640 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3aa30 0x565079c86110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f6613e00640 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 0x565079c4fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f660be00640 1 -- 172.21.15.17:0/584973775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 msgr2=0x565079c4fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f660be00640 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 0x565079c4fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f660be00640 1 -- 172.21.15.17:0/584973775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3aa30 msgr2=0x565079c86110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f660be00640 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3aa30 0x565079c86110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f660be00640 1 -- 172.21.15.17:0/584973775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565079c3baa0 con 0x565079c3b350 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f6613400640 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3aa30 0x565079c86110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f660be00640 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c86650 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f65fc001740 tx=0x7f65fc001000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26384419571d24ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f6603400640 1 -- 172.21.15.17:0/584973775 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc003800 con 0x565079c3b350 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f6603400640 1 -- 172.21.15.17:0/584973775 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65fc018070 con 0x565079c3b350 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.893+0000 7f6603400640 1 -- 172.21.15.17:0/584973775 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc007280 con 0x565079c3b350 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- 172.21.15.17:0/584973775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 msgr2=0x565079c86650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c86650 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f65fc001740 tx=0x7f65fc001000 comp rx=0 tx=0).stop 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- 172.21.15.17:0/584973775 shutdown_connections 2024-09-10T23:19:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 0x565079c4fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3b350 0x565079c86650 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 --2- 172.21.15.17:0/584973775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3aa30 0x565079c86110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- 172.21.15.17:0/584973775 >> 172.21.15.17:0/584973775 conn(0x565079c517f0 msgr2=0x565079c3c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:20.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- 172.21.15.17:0/584973775 shutdown_connections 2024-09-10T23:19:20.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- 172.21.15.17:0/584973775 wait complete. 2024-09-10T23:19:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- start start 2024-09-10T23:19:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 Processor -- start 2024-09-10T23:19:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079cefc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3b350 0x565079cf0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 0x565079cf0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x565079a30db0 con 0x565079c3aa30 2024-09-10T23:19:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x565079a34c40 con 0x565079c3b350 2024-09-10T23:19:20.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x565079a75290 con 0x565079c3bc70 2024-09-10T23:19:20.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 10 client.0 _ll_register_callbacks cb 0x7f660c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:20.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079cefc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079cefc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37202/0 (socket says 172.21.15.17:37202) 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613400640 1 -- 172.21.15.17:0/4201537301 learned_addr learned my addr 172.21.15.17:0/4201537301 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f660be00640 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3b350 0x565079cf0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613e00640 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 0x565079cf0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613400640 1 -- 172.21.15.17:0/4201537301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 msgr2=0x565079cf0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613400640 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 0x565079cf0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613400640 1 -- 172.21.15.17:0/4201537301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3b350 msgr2=0x565079cf0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613400640 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3b350 0x565079cf0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613400640 1 -- 172.21.15.17:0/4201537301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565079acd860 con 0x565079c3aa30 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6613400640 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079cefc10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6604098490 tx=0x7f6604009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6ec6e607cfee8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6600c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6600c00640 1 -- 172.21.15.17:0/4201537301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66040d3060 con 0x565079c3aa30 2024-09-10T23:19:20.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6600c00640 1 -- 172.21.15.17:0/4201537301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f66040053f0 con 0x565079c3aa30 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- 172.21.15.17:0/4201537301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65fc018070 con 0x565079c3aa30 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6600c00640 1 -- 172.21.15.17:0/4201537301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66040d9050 con 0x565079c3aa30 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 10 client.5667 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 -- 172.21.15.17:0/4201537301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5650799fe5e0 con 0x565079c3aa30 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6600c00640 1 -- 172.21.15.17:0/4201537301 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65fc018070 con 0x565079c3aa30 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f6600c00640 1 -- 172.21.15.17:0/4201537301 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f66040dc020 con 0x565079c3aa30 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 10 client.5667 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 10 client.5667 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 20 client.5667 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x565079c83670 0x565079c83a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.897+0000 7f661d349000 4 client.5667 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 -- 172.21.15.17:0/4201537301 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x565079a80740 con 0x565079c83670 2024-09-10T23:19:20.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f660be00640 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x565079c83670 0x565079c83a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f660be00640 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x565079c83670 0x565079c83a80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feedb324d3658f53 server_cookie=57d7e9d4e1137aa in_seq=0 out_seq=0 2024-09-10T23:19:20.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f6600c00640 10 client.5667 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f6600c00640 1 -- 172.21.15.17:0/4201537301 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x565079a80740 con 0x565079c83670 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f6600c00640 10 client.5667 handle_command_reply: tid=0 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 client.5667 shutdown 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 -- 172.21.15.17:0/4201537301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 msgr2=0x565079cefc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079cefc10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6604098490 tx=0x7f6604009260 comp rx=0 tx=0).stop 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 -- 172.21.15.17:0/4201537301 shutdown_connections 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x565079c83670 0x565079c83a80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565079c3bc70 0x565079cf0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565079c3b350 0x565079cf0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 --2- 172.21.15.17:0/4201537301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565079c3aa30 0x565079cefc10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:20.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f6600c00640 0 client.5667 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:20.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 -- 172.21.15.17:0/4201537301 >> 172.21.15.17:0/4201537301 conn(0x565079c517f0 msgr2=0x565079c37e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:20.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 -- 172.21.15.17:0/4201537301 shutdown_connections 2024-09-10T23:19:20.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 1 -- 172.21.15.17:0/4201537301 wait complete. 2024-09-10T23:19:20.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:20.901+0000 7f661d349000 20 client.5667 trim_cache size 0 max 16384 2024-09-10T23:19:20.912 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": -2 2024-09-10T23:19:20.912 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:20.913 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T23:19:20.913 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENOENT: 2024-09-10T23:19:20.914 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-10T23:19:20.914 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-10T23:19:20.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-10T23:19:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.061+0000 7f7e9a800640 1 -- 172.21.15.17:0/2686956890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9415be00 msgr2=0x7f7e9415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.061+0000 7f7e9a800640 1 --2- 172.21.15.17:0/2686956890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9415be00 0x7f7e9415d4f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009870 tx=0x7f7e8401c830 comp rx=0 tx=0).stop 2024-09-10T23:19:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.061+0000 7f7e9a800640 1 -- 172.21.15.17:0/2686956890 shutdown_connections 2024-09-10T23:19:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.061+0000 7f7e9a800640 1 --2- 172.21.15.17:0/2686956890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9415be00 0x7f7e9415d4f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.061+0000 7f7e9a800640 1 -- 172.21.15.17:0/2686956890 >> 172.21.15.17:0/2686956890 conn(0x7f7e9409a9f0 msgr2=0x7f7e9409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.061+0000 7f7e9a800640 1 -- 172.21.15.17:0/2686956890 shutdown_connections 2024-09-10T23:19:21.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.061+0000 7f7e9a800640 1 -- 172.21.15.17:0/2686956890 wait complete. 2024-09-10T23:19:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.061+0000 7f7e9a800640 1 Processor -- start 2024-09-10T23:19:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e9a800640 1 -- start start 2024-09-10T23:19:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e9a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e940b12e0 0x7f7e940b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e9a800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e940d04f0 0x7f7e9406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e9a800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9415be00 0x7f7e9414a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e9a800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9416a660 con 0x7f7e940b12e0 2024-09-10T23:19:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e9a800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9416a4e0 con 0x7f7e940d04f0 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e9a800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9416a7e0 con 0x7f7e9415be00 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e940b12e0 0x7f7e940b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e940b12e0 0x7f7e940b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37212/0 (socket says 172.21.15.17:37212) 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93400640 1 -- 172.21.15.17:0/1128181800 learned_addr learned my addr 172.21.15.17:0/1128181800 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93e00640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9415be00 0x7f7e9414a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e92a00640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e940d04f0 0x7f7e9406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93400640 1 -- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9415be00 msgr2=0x7f7e9414a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93400640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9415be00 0x7f7e9414a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93400640 1 -- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e940d04f0 msgr2=0x7f7e9406e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93400640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e940d04f0 0x7f7e9406e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93400640 1 -- 172.21.15.17:0/1128181800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9414aa20 con 0x7f7e940b12e0 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93e00640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9415be00 0x7f7e9414a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e92a00640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e940d04f0 0x7f7e9406e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e93400640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e940b12e0 0x7f7e940b0cc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e8401a460 tx=0x7f7e840040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e8b400640 1 -- 172.21.15.17:0/1128181800 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840bc070 con 0x7f7e940b12e0 2024-09-10T23:19:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e8b400640 1 -- 172.21.15.17:0/1128181800 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e84003600 con 0x7f7e940b12e0 2024-09-10T23:19:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e9a800640 1 -- 172.21.15.17:0/1128181800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e94164d80 con 0x7f7e940b12e0 2024-09-10T23:19:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e8b400640 1 -- 172.21.15.17:0/1128181800 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840b2040 con 0x7f7e940b12e0 2024-09-10T23:19:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.065+0000 7f7e9a800640 1 -- 172.21.15.17:0/1128181800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e940cef50 con 0x7f7e940b12e0 2024-09-10T23:19:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e8b400640 1 -- 172.21.15.17:0/1128181800 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7e840b5070 con 0x7f7e940b12e0 2024-09-10T23:19:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e8b400640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e740725e0 0x7f7e74074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e9dbd8000 1 Processor -- start 2024-09-10T23:19:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e8b400640 1 -- 172.21.15.17:0/1128181800 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f7e8412cdb0 con 0x7f7e940b12e0 2024-09-10T23:19:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e9dbd8000 1 -- start start 2024-09-10T23:19:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e92a00640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e740725e0 0x7f7e74074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be68e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 0x5642be641b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be642070 0x5642be642450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5642be49f960 con 0x5642be68e010 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5642be48ed90 con 0x5642be642070 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5642be492ba0 con 0x5642be68e930 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e92a00640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e740725e0 0x7f7e74074aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7e9414e6c0 tx=0x7f7e80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be68e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be68e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37214/0 (socket says 172.21.15.17:37214) 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e93400640 1 -- 172.21.15.17:0/213232351 learned_addr learned my addr 172.21.15.17:0/213232351 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e92a00640 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 0x5642be641b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.069+0000 7f7e93e00640 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be642070 0x5642be642450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 -- 172.21.15.17:0/213232351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 msgr2=0x5642be641b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 0x5642be641b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 -- 172.21.15.17:0/213232351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be642070 msgr2=0x5642be642450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be642070 0x5642be642450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 -- 172.21.15.17:0/213232351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642be443ca0 con 0x5642be68e010 2024-09-10T23:19:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e92a00640 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 0x5642be641b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be68e3f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e840f7830 tx=0x7f7e840f3b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac238b04726c3a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e7fe00640 1 -- 172.21.15.17:0/213232351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840f8e60 con 0x5642be68e010 2024-09-10T23:19:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e7fe00640 1 -- 172.21.15.17:0/213232351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e840f7b30 con 0x5642be68e010 2024-09-10T23:19:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e7fe00640 1 -- 172.21.15.17:0/213232351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840fc610 con 0x5642be68e010 2024-09-10T23:19:21.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/213232351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 msgr2=0x5642be68e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be68e3f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e840f7830 tx=0x7f7e840f3b00 comp rx=0 tx=0).stop 2024-09-10T23:19:21.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/213232351 shutdown_connections 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be642070 0x5642be642450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 0x5642be641b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/213232351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be68e3f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/213232351 >> 172.21.15.17:0/213232351 conn(0x5642be66f0d0 msgr2=0x5642be6714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/213232351 shutdown_connections 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/213232351 wait complete. 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 -- start start 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 Processor -- start 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be642070 0x5642be68d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 0x5642be68d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 0x5642be66f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5642be432f50 con 0x5642be642070 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5642be43a0b0 con 0x5642be68e010 2024-09-10T23:19:21.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5642be43bb30 con 0x5642be68e930 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e9dbd8000 10 client.0 _ll_register_callbacks cb 0x5642be439750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be642070 0x5642be68d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be642070 0x5642be68d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37230/0 (socket says 172.21.15.17:37230) 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 -- 172.21.15.17:0/1029313644 learned_addr learned my addr 172.21.15.17:0/1029313644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 -- 172.21.15.17:0/1029313644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 msgr2=0x5642be66f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 0x5642be66f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 -- 172.21.15.17:0/1029313644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 msgr2=0x5642be68d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e92a00640 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 0x5642be68d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 0x5642be68d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 -- 172.21.15.17:0/1029313644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642be42d0b0 con 0x5642be642070 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e92a00640 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 0x5642be68d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e93400640 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be642070 0x5642be68d3c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7e840f42f0 tx=0x7f7e840a5570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160dd9f17687ec95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.073+0000 7f7e7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e7cc00640 1 -- 172.21.15.17:0/1029313644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840f8e60 con 0x5642be642070 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e7cc00640 1 -- 172.21.15.17:0/1029313644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f7e84100ba0 con 0x5642be642070 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/1029313644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642be4271f0 con 0x5642be642070 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e7cc00640 1 -- 172.21.15.17:0/1029313644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7e840fc3d0 con 0x5642be642070 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 10 client.5679 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/1029313644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5642be453680 con 0x5642be642070 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e7cc00640 1 -- 172.21.15.17:0/1029313644 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5642be4271f0 con 0x5642be642070 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e7cc00640 1 -- 172.21.15.17:0/1029313644 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f7e840f6d90 con 0x5642be642070 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 10 client.5679 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 10 client.5679 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 20 client.5679 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5642be695190 0x5642be6955a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 4 client.5679 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/1029313644 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642be4a18b0 con 0x5642be695190 2024-09-10T23:19:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e92a00640 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5642be695190 0x5642be6955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e92a00640 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5642be695190 0x5642be6955a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41096a481e1cda1f server_cookie=f2ea54c4211fd31 in_seq=0 out_seq=0 2024-09-10T23:19:21.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e7cc00640 10 client.5679 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e7cc00640 1 -- 172.21.15.17:0/1029313644 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642be4a18b0 con 0x5642be695190 2024-09-10T23:19:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e7cc00640 10 client.5679 handle_command_reply: tid=0 2024-09-10T23:19:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 client.5679 shutdown 2024-09-10T23:19:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/1029313644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be642070 msgr2=0x5642be68d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be642070 0x5642be68d3c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7e840f42f0 tx=0x7f7e840a5570 comp rx=0 tx=0).stop 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/1029313644 shutdown_connections 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5642be695190 0x5642be6955a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be68e930 0x5642be66f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 0x5642be68d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/1029313644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be642070 0x5642be68d3c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e7cc00640 0 client.5679 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/1029313644 >> 172.21.15.17:0/1029313644 conn(0x5642be66f0d0 msgr2=0x5642be641230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/1029313644 shutdown_connections 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/1029313644 wait complete. 2024-09-10T23:19:21.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.077+0000 7f7e9dbd8000 20 client.5679 trim_cache size 0 max 16384 2024-09-10T23:19:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e9dbd8000 1 Processor -- start 2024-09-10T23:19:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e9dbd8000 1 -- start start 2024-09-10T23:19:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be66f0d0 0x5642be6a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 0x5642be641520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be641a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e94203de0 con 0x5642be68e010 2024-09-10T23:19:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e940af970 con 0x5642be66f0d0 2024-09-10T23:19:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e94203790 con 0x5642be642070 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be641a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be641a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37244/0 (socket says 172.21.15.17:37244) 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93e00640 1 -- 172.21.15.17:0/2369003217 learned_addr learned my addr 172.21.15.17:0/2369003217 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e92a00640 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 0x5642be641520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93400640 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be66f0d0 0x5642be6a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93e00640 1 -- 172.21.15.17:0/2369003217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 msgr2=0x5642be641520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93e00640 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 0x5642be641520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93e00640 1 -- 172.21.15.17:0/2369003217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be66f0d0 msgr2=0x5642be6a5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93e00640 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be66f0d0 0x5642be6a5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93e00640 1 -- 172.21.15.17:0/2369003217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642be515bc0 con 0x5642be68e010 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e92a00640 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 0x5642be641520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:21.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e93e00640 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be641a60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c001e30 tx=0x7f7e8c010610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a8b352d4896511 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e7f400640 1 -- 172.21.15.17:0/2369003217 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c003980 con 0x5642be68e010 2024-09-10T23:19:21.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e7f400640 1 -- 172.21.15.17:0/2369003217 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e8c019070 con 0x5642be68e010 2024-09-10T23:19:21.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.097+0000 7f7e7f400640 1 -- 172.21.15.17:0/2369003217 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0050d0 con 0x5642be68e010 2024-09-10T23:19:21.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/2369003217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 msgr2=0x5642be641a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be641a60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c001e30 tx=0x7f7e8c010610 comp rx=0 tx=0).stop 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/2369003217 shutdown_connections 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be68e010 0x5642be641a60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 0x5642be641520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/2369003217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be66f0d0 0x5642be6a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/2369003217 >> 172.21.15.17:0/2369003217 conn(0x5642be69bee0 msgr2=0x5642be645680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/2369003217 shutdown_connections 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/2369003217 wait complete. 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- start start 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 Processor -- start 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 0x5642be694380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be66f0d0 0x5642be6a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 0x5642be6a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5642be44e7c0 con 0x5642be66f0d0 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5642be49e730 con 0x5642be68e010 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5642be491eb0 con 0x5642be642070 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 10 client.0 _ll_register_callbacks cb 0x7f7e8c0016b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e92a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be66f0d0 0x5642be6a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e93400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 0x5642be694380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e92a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be66f0d0 0x5642be6a5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37256/0 (socket says 172.21.15.17:37256) 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e92a00640 1 -- 172.21.15.17:0/3282908268 learned_addr learned my addr 172.21.15.17:0/3282908268 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e93e00640 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 0x5642be6a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e92a00640 1 -- 172.21.15.17:0/3282908268 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 msgr2=0x5642be694380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e92a00640 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 0x5642be694380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e92a00640 1 -- 172.21.15.17:0/3282908268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 msgr2=0x5642be6a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e92a00640 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 0x5642be6a5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e92a00640 1 -- 172.21.15.17:0/3282908268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642be4ebef0 con 0x5642be66f0d0 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e92a00640 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be66f0d0 0x5642be6a5760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e80000f70 tx=0x7f7e800077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0021c09552b33f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e7cc00640 1 -- 172.21.15.17:0/3282908268 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80003a10 con 0x5642be66f0d0 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e7cc00640 1 -- 172.21.15.17:0/3282908268 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f7e80003bb0 con 0x5642be66f0d0 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/3282908268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e8c019070 con 0x5642be66f0d0 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e7cc00640 1 -- 172.21.15.17:0/3282908268 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7e80003db0 con 0x5642be66f0d0 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 10 client.5685 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/3282908268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5642be458eb0 con 0x5642be66f0d0 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e7cc00640 1 -- 172.21.15.17:0/3282908268 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e8c019070 con 0x5642be66f0d0 2024-09-10T23:19:21.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e7cc00640 1 -- 172.21.15.17:0/3282908268 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f7e80028070 con 0x5642be66f0d0 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 10 client.5685 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 10 client.5685 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 20 client.5685 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5642be68e930 0x5642be690d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 4 client.5685 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.101+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/3282908268 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5642be49d360 con 0x5642be68e930 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e93400640 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5642be68e930 0x5642be690d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e93400640 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5642be68e930 0x5642be690d20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c23b613288063b8 server_cookie=5ac1c8ffe5e07db1 in_seq=0 out_seq=0 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e7cc00640 10 client.5685 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e7cc00640 1 -- 172.21.15.17:0/3282908268 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x5642be49d360 con 0x5642be68e930 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e7cc00640 10 client.5685 handle_command_reply: tid=0 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 client.5685 shutdown 2024-09-10T23:19:21.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/3282908268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be66f0d0 msgr2=0x5642be6a5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be66f0d0 0x5642be6a5760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7e80000f70 tx=0x7f7e800077d0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/3282908268 shutdown_connections 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5642be68e930 0x5642be690d20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5642be68e010 0x5642be6a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5642be66f0d0 0x5642be6a5760 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 --2- 172.21.15.17:0/3282908268 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5642be642070 0x5642be694380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/3282908268 >> 172.21.15.17:0/3282908268 conn(0x5642be69bee0 msgr2=0x5642be645ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e7cc00640 0 client.5685 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/3282908268 shutdown_connections 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 1 -- 172.21.15.17:0/3282908268 wait complete. 2024-09-10T23:19:21.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9dbd8000 20 client.5685 trim_cache size 0 max 16384 2024-09-10T23:19:21.115 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:21.115 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": -2 2024-09-10T23:19:21.115 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:21.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 -- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e740725e0 msgr2=0x7f7e74074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e740725e0 0x7f7e74074aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7e9414e6c0 tx=0x7f7e80009040 comp rx=0 tx=0).stop 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 -- 172.21.15.17:0/1128181800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e940b12e0 msgr2=0x7f7e940b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e940b12e0 0x7f7e940b0cc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7e8401a460 tx=0x7f7e840040c0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 -- 172.21.15.17:0/1128181800 shutdown_connections 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e740725e0 0x7f7e74074aa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9415be00 0x7f7e9414a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e940d04f0 0x7f7e9406e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 --2- 172.21.15.17:0/1128181800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e940b12e0 0x7f7e940b0cc0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 -- 172.21.15.17:0/1128181800 >> 172.21.15.17:0/1128181800 conn(0x7f7e9409a9f0 msgr2=0x7f7e94071620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 -- 172.21.15.17:0/1128181800 shutdown_connections 2024-09-10T23:19:21.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.105+0000 7f7e9a800640 1 -- 172.21.15.17:0/1128181800 wait complete. 2024-09-10T23:19:21.128 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-10T23:19:21.128 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-09-10T23:19:21.128 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-09-10T23:19:21.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-09-10T23:19:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 -- 172.21.15.17:0/1280864582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 msgr2=0x7faf5c0d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 --2- 172.21.15.17:0/1280864582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 0x7faf5c0d1cd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7faf5c06db60 tx=0x7faf4c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 -- 172.21.15.17:0/1280864582 shutdown_connections 2024-09-10T23:19:21.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 --2- 172.21.15.17:0/1280864582 >> v2:172.21.15.77:3300/0 conn(0x7faf5c0d2210 0x7faf5c071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 --2- 172.21.15.17:0/1280864582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 0x7faf5c0d1cd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 -- 172.21.15.17:0/1280864582 >> 172.21.15.17:0/1280864582 conn(0x7faf5c09a9f0 msgr2=0x7faf5c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 -- 172.21.15.17:0/1280864582 shutdown_connections 2024-09-10T23:19:21.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 -- 172.21.15.17:0/1280864582 wait complete. 2024-09-10T23:19:21.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 Processor -- start 2024-09-10T23:19:21.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 -- start start 2024-09-10T23:19:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c071bb0 0x7faf5c1fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2210 0x7faf5c0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 0x7faf5c0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c168f30 con 0x7faf5c15be20 2024-09-10T23:19:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c168db0 con 0x7faf5c071bb0 2024-09-10T23:19:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf61200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c1690b0 con 0x7faf5c0d2210 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.273+0000 7faf5a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 0x7faf5c0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf5a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 0x7faf5c0b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37278/0 (socket says 172.21.15.17:37278) 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf5a800640 1 -- 172.21.15.17:0/402431370 learned_addr learned my addr 172.21.15.17:0/402431370 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf53e00640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2210 0x7faf5c0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf59e00640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c071bb0 0x7faf5c1fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf5a800640 1 -- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2210 msgr2=0x7faf5c0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf5a800640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2210 0x7faf5c0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf5a800640 1 -- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c071bb0 msgr2=0x7faf5c1fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf5a800640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c071bb0 0x7faf5c1fc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf5a800640 1 -- 172.21.15.17:0/402431370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c15dd50 con 0x7faf5c15be20 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf5a800640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 0x7faf5c0b06e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c780 tx=0x7faf5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf52000640 1 -- 172.21.15.17:0/402431370 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54004b70 con 0x7faf5c15be20 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf52000640 1 -- 172.21.15.17:0/402431370 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf54004e00 con 0x7faf5c15be20 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf52000640 1 -- 172.21.15.17:0/402431370 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5400aa90 con 0x7faf5c15be20 2024-09-10T23:19:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf61200640 1 -- 172.21.15.17:0/402431370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c15e030 con 0x7faf5c15be20 2024-09-10T23:19:21.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf61200640 1 -- 172.21.15.17:0/402431370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c15e5f0 con 0x7faf5c15be20 2024-09-10T23:19:21.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.277+0000 7faf52000640 1 -- 172.21.15.17:0/402431370 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faf5400ac30 con 0x7faf5c15be20 2024-09-10T23:19:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf52000640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf380725e0 0x7faf38074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf52000640 1 -- 172.21.15.17:0/402431370 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7faf540936a0 con 0x7faf5c15be20 2024-09-10T23:19:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 Processor -- start 2024-09-10T23:19:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf59e00640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf380725e0 0x7faf38074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 -- start start 2024-09-10T23:19:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf59e00640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf380725e0 0x7faf38074aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0af000 tx=0x7faf4c0a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd73ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 0x55fdfd6f1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd6f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fdfd5d8070 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fdfd54edf0 con 0x55fdfd73b620 2024-09-10T23:19:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fdfd53e220 con 0x55fdfd73bf40 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf5a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd6f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf59e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd73ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf59e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd73ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:44836/0 (socket says 172.21.15.17:44836) 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf5a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd6f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37290/0 (socket says 172.21.15.17:37290) 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf59e00640 1 -- 172.21.15.17:0/3900798875 learned_addr learned my addr 172.21.15.17:0/3900798875 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf53e00640 1 --2- 172.21.15.17:0/3900798875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 0x55fdfd6f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf5a800640 1 -- 172.21.15.17:0/3900798875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 msgr2=0x55fdfd6f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf5a800640 1 --2- 172.21.15.17:0/3900798875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 0x55fdfd6f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf5a800640 1 -- 172.21.15.17:0/3900798875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 msgr2=0x55fdfd73ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf5a800640 1 --2- 172.21.15.17:0/3900798875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd73ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf5a800640 1 -- 172.21.15.17:0/3900798875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdfd585c10 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf5a800640 1 --2- 172.21.15.17:0/3900798875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd6f1fa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faf5405e1d0 tx=0x7faf5405dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df3457c24e3390d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf4aa00640 1 -- 172.21.15.17:0/3900798875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54083030 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf4aa00640 1 -- 172.21.15.17:0/3900798875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf5405e4d0 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf4aa00640 1 -- 172.21.15.17:0/3900798875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540676f0 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 -- 172.21.15.17:0/3900798875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 msgr2=0x55fdfd6f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 --2- 172.21.15.17:0/3900798875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd6f1fa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faf5405e1d0 tx=0x7faf5405dd00 comp rx=0 tx=0).stop 2024-09-10T23:19:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 -- 172.21.15.17:0/3900798875 shutdown_connections 2024-09-10T23:19:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 --2- 172.21.15.17:0/3900798875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd6f1fa0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 --2- 172.21.15.17:0/3900798875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 0x55fdfd6f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 --2- 172.21.15.17:0/3900798875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd73ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 -- 172.21.15.17:0/3900798875 >> 172.21.15.17:0/3900798875 conn(0x55fdfd6e8fb0 msgr2=0x55fdfd6eff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 -- 172.21.15.17:0/3900798875 shutdown_connections 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.281+0000 7faf6454f000 1 -- 172.21.15.17:0/3900798875 wait complete. 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 -- start start 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 Processor -- start 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd725660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73b620 0x55fdfd725ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73bf40 0x55fdfd7263a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fdfd4e3750 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fdfd542030 con 0x55fdfd73bf40 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fdfd2039e0 con 0x55fdfd73b620 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 10 client.0 _ll_register_callbacks cb 0x55fdfd5f2fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd725660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd725660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37294/0 (socket says 172.21.15.17:37294) 2024-09-10T23:19:21.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf59e00640 1 -- 172.21.15.17:0/3640273155 learned_addr learned my addr 172.21.15.17:0/3640273155 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf53e00640 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73b620 0x55fdfd725ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf5a800640 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73bf40 0x55fdfd7263a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf59e00640 1 -- 172.21.15.17:0/3640273155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73b620 msgr2=0x55fdfd725ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf59e00640 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73b620 0x55fdfd725ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf59e00640 1 -- 172.21.15.17:0/3640273155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73bf40 msgr2=0x55fdfd7263a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf59e00640 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73bf40 0x55fdfd7263a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf59e00640 1 -- 172.21.15.17:0/3640273155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdfd4f2e50 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf59e00640 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd725660 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009230 tx=0x7faf4c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55b4f0fc5dd23e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf3f400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf3f400640 1 -- 172.21.15.17:0/3640273155 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0ca060 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf3f400640 1 -- 172.21.15.17:0/3640273155 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7faf4c004ad0 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 -- 172.21.15.17:0/3640273155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fdfd4d6520 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf3f400640 1 -- 172.21.15.17:0/3640273155 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf4c0d0050 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 10 client.5697 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 -- 172.21.15.17:0/3640273155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55fdfd4fd350 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf3f400640 1 -- 172.21.15.17:0/3640273155 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55fdfd4d6520 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf3f400640 1 -- 172.21.15.17:0/3640273155 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7faf4c0d3020 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 10 client.5697 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 10 client.5697 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 20 client.5697 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fdfd727140 0x55fdfd727520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 4 client.5697 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf6454f000 1 -- 172.21.15.17:0/3640273155 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdfd550d40 con 0x55fdfd727140 2024-09-10T23:19:21.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.285+0000 7faf53e00640 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fdfd727140 0x55fdfd727520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf53e00640 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fdfd727140 0x55fdfd727520 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac694d3a38f7bece server_cookie=16524d0f11394be2 in_seq=0 out_seq=0 2024-09-10T23:19:21.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf3f400640 10 client.5697 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf3f400640 1 -- 172.21.15.17:0/3640273155 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fdfd550d40 con 0x55fdfd727140 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf3f400640 10 client.5697 handle_command_reply: tid=0 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 client.5697 shutdown 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 -- 172.21.15.17:0/3640273155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 msgr2=0x55fdfd725660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd725660 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009230 tx=0x7faf4c009260 comp rx=0 tx=0).stop 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 -- 172.21.15.17:0/3640273155 shutdown_connections 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fdfd727140 0x55fdfd727520 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73bf40 0x55fdfd7263a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73b620 0x55fdfd725ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 --2- 172.21.15.17:0/3640273155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd725660 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf3f400640 0 client.5697 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 -- 172.21.15.17:0/3640273155 >> 172.21.15.17:0/3640273155 conn(0x55fdfd6e8fb0 msgr2=0x55fdfd6f0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 -- 172.21.15.17:0/3640273155 shutdown_connections 2024-09-10T23:19:21.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 1 -- 172.21.15.17:0/3640273155 wait complete. 2024-09-10T23:19:21.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.289+0000 7faf6454f000 20 client.5697 trim_cache size 0 max 16384 2024-09-10T23:19:21.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 Processor -- start 2024-09-10T23:19:21.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 -- start start 2024-09-10T23:19:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd7ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73b620 0x55fdfd7adc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd73bf40 0x55fdfd7ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c2048f0 con 0x55fdfd73bf40 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c203910 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c0b5510 con 0x55fdfd73b620 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf5a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd73bf40 0x55fdfd7ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf5a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd73bf40 0x55fdfd7ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37308/0 (socket says 172.21.15.17:37308) 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf5a800640 1 -- 172.21.15.17:0/2302145383 learned_addr learned my addr 172.21.15.17:0/2302145383 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf59e00640 1 --2- 172.21.15.17:0/2302145383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd7ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf5a800640 1 -- 172.21.15.17:0/2302145383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73b620 msgr2=0x55fdfd7adc40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T23:19:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf5a800640 1 --2- 172.21.15.17:0/2302145383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73b620 0x55fdfd7adc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf5a800640 1 -- 172.21.15.17:0/2302145383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd6f1bc0 msgr2=0x55fdfd7ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf5a800640 1 --2- 172.21.15.17:0/2302145383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd7ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf5a800640 1 -- 172.21.15.17:0/2302145383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdfd73bd70 con 0x55fdfd73bf40 2024-09-10T23:19:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf59e00640 1 --2- 172.21.15.17:0/2302145383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd7ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf5a800640 1 --2- 172.21.15.17:0/2302145383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd73bf40 0x55fdfd7ae180 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faf5405e460 tx=0x7faf54091840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fead512acea64ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf4a000640 1 -- 172.21.15.17:0/2302145383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54083040 con 0x55fdfd73bf40 2024-09-10T23:19:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf4a000640 1 -- 172.21.15.17:0/2302145383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf54067920 con 0x55fdfd73bf40 2024-09-10T23:19:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf4a000640 1 -- 172.21.15.17:0/2302145383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5405e4d0 con 0x55fdfd73bf40 2024-09-10T23:19:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 -- 172.21.15.17:0/2302145383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd73bf40 msgr2=0x55fdfd7ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 --2- 172.21.15.17:0/2302145383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd73bf40 0x55fdfd7ae180 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faf5405e460 tx=0x7faf54091840 comp rx=0 tx=0).stop 2024-09-10T23:19:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 -- 172.21.15.17:0/2302145383 shutdown_connections 2024-09-10T23:19:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 --2- 172.21.15.17:0/2302145383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd73bf40 0x55fdfd7ae180 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 --2- 172.21.15.17:0/2302145383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73b620 0x55fdfd7adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 --2- 172.21.15.17:0/2302145383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd7ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 -- 172.21.15.17:0/2302145383 >> 172.21.15.17:0/2302145383 conn(0x55fdfd6e8fb0 msgr2=0x55fdfd6f2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 -- 172.21.15.17:0/2302145383 shutdown_connections 2024-09-10T23:19:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.305+0000 7faf6454f000 1 -- 172.21.15.17:0/2302145383 wait complete. 2024-09-10T23:19:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 -- start start 2024-09-10T23:19:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 Processor -- start 2024-09-10T23:19:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd752800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd752d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 0x55fdfd76d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fdfd6f1750 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fdfd546660 con 0x55fdfd73b620 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fdfd5c1290 con 0x55fdfd73bf40 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 10 client.0 _ll_register_callbacks cb 0x7faf4c004220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd752800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd752800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37312/0 (socket says 172.21.15.17:37312) 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf59e00640 1 -- 172.21.15.17:0/1132675950 learned_addr learned my addr 172.21.15.17:0/1132675950 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf5a800640 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 0x55fdfd76d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf53e00640 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd752d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf59e00640 1 -- 172.21.15.17:0/1132675950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 msgr2=0x55fdfd76d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf59e00640 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 0x55fdfd76d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf59e00640 1 -- 172.21.15.17:0/1132675950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 msgr2=0x55fdfd752d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf59e00640 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd752d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf59e00640 1 -- 172.21.15.17:0/1132675950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdfd4dc3e0 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf53e00640 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd752d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf59e00640 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd752800 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faf4c004e90 tx=0x7faf4c005860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cce24a87084da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf3f400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf3f400640 1 -- 172.21.15.17:0/1132675950 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0d8070 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf3f400640 1 -- 172.21.15.17:0/1132675950 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7faf4c004ad0 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 -- 172.21.15.17:0/1132675950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf54067920 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf3f400640 1 -- 172.21.15.17:0/1132675950 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf4c0050d0 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 10 client.5703 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 -- 172.21.15.17:0/1132675950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55fdfd5c1720 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf3f400640 1 -- 172.21.15.17:0/1132675950 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf54067920 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf3f400640 1 -- 172.21.15.17:0/1132675950 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7faf4c0db020 con 0x55fdfd6f1bc0 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 10 client.5703 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 10 client.5703 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 20 client.5703 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fdfd76e3a0 0x55fdfd7b1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 4 client.5703 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf6454f000 1 -- 172.21.15.17:0/1132675950 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55fdfd54c7f0 con 0x55fdfd76e3a0 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.309+0000 7faf53e00640 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fdfd76e3a0 0x55fdfd7b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf3f400640 10 client.5703 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf53e00640 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fdfd76e3a0 0x55fdfd7b1740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dec082d4e69c458c server_cookie=6e7bfdba62af80fc in_seq=0 out_seq=0 2024-09-10T23:19:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf3f400640 1 -- 172.21.15.17:0/1132675950 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdfd54c7f0 con 0x55fdfd76e3a0 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf3f400640 10 client.5703 handle_command_reply: tid=0 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 client.5703 shutdown 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 -- 172.21.15.17:0/1132675950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 msgr2=0x55fdfd752800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd752800 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faf4c004e90 tx=0x7faf4c005860 comp rx=0 tx=0).stop 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 -- 172.21.15.17:0/1132675950 shutdown_connections 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fdfd76e3a0 0x55fdfd7b1740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fdfd73bf40 0x55fdfd76d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fdfd73b620 0x55fdfd752d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 --2- 172.21.15.17:0/1132675950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdfd6f1bc0 0x55fdfd752800 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 -- 172.21.15.17:0/1132675950 >> 172.21.15.17:0/1132675950 conn(0x55fdfd6e8fb0 msgr2=0x55fdfd74d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf3f400640 0 client.5703 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 -- 172.21.15.17:0/1132675950 shutdown_connections 2024-09-10T23:19:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 1 -- 172.21.15.17:0/1132675950 wait complete. 2024-09-10T23:19:21.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.313+0000 7faf6454f000 20 client.5703 trim_cache size 0 max 16384 2024-09-10T23:19:21.323 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:19:21.323 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 -- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf380725e0 msgr2=0x7faf38074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf380725e0 0x7faf38074aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0af000 tx=0x7faf4c0a7040 comp rx=0 tx=0).stop 2024-09-10T23:19:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 -- 172.21.15.17:0/402431370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 msgr2=0x7faf5c0b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 0x7faf5c0b06e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c780 tx=0x7faf5400cc40 comp rx=0 tx=0).stop 2024-09-10T23:19:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 -- 172.21.15.17:0/402431370 shutdown_connections 2024-09-10T23:19:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf380725e0 0x7faf38074aa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c15be20 0x7faf5c0b06e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2210 0x7faf5c0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 --2- 172.21.15.17:0/402431370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c071bb0 0x7faf5c1fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 -- 172.21.15.17:0/402431370 >> 172.21.15.17:0/402431370 conn(0x7faf5c09a9f0 msgr2=0x7faf5c15adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 -- 172.21.15.17:0/402431370 shutdown_connections 2024-09-10T23:19:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.317+0000 7faf61200640 1 -- 172.21.15.17:0/402431370 wait complete. 2024-09-10T23:19:21.338 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-09-10T23:19:21.338 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-10T23:19:21.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-10T23:19:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.481+0000 7f3ceb200640 1 -- 172.21.15.17:0/1525179283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40d23e0 msgr2=0x7f3ce4071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.481+0000 7f3ceb200640 1 --2- 172.21.15.17:0/1525179283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40d23e0 0x7f3ce4071060 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009bc0 tx=0x7f3cdc01cba0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.481+0000 7f3ceb200640 1 -- 172.21.15.17:0/1525179283 shutdown_connections 2024-09-10T23:19:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.481+0000 7f3ceb200640 1 --2- 172.21.15.17:0/1525179283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40d23e0 0x7f3ce4071060 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.481+0000 7f3ceb200640 1 --2- 172.21.15.17:0/1525179283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce415f210 0x7f3ce40cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.481+0000 7f3ceb200640 1 -- 172.21.15.17:0/1525179283 >> 172.21.15.17:0/1525179283 conn(0x7f3ce409a9f0 msgr2=0x7f3ce409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.481+0000 7f3ceb200640 1 -- 172.21.15.17:0/1525179283 shutdown_connections 2024-09-10T23:19:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.481+0000 7f3ceb200640 1 -- 172.21.15.17:0/1525179283 wait complete. 2024-09-10T23:19:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 Processor -- start 2024-09-10T23:19:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 -- start start 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d0320 0x7f3ce41545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40d23e0 0x7f3ce40b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce415f210 0x7f3ce4154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4168c80 con 0x7f3ce415f210 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4168b00 con 0x7f3ce40d23e0 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce4168e00 con 0x7f3ce40d0320 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce415f210 0x7f3ce4154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce415f210 0x7f3ce4154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37314/0 (socket says 172.21.15.17:37314) 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce9200640 1 -- 172.21.15.17:0/2726421187 learned_addr learned my addr 172.21.15.17:0/2726421187 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d0320 0x7f3ce41545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce3400640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40d23e0 0x7f3ce40b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce9200640 1 -- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d0320 msgr2=0x7f3ce41545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce9200640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d0320 0x7f3ce41545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce9200640 1 -- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40d23e0 msgr2=0x7f3ce40b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce9200640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40d23e0 0x7f3ce40b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce9200640 1 -- 172.21.15.17:0/2726421187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce40c99c0 con 0x7f3ce415f210 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ce9200640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce415f210 0x7f3ce4154c20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc01a7d0 tx=0x7f3cdc003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3cdbe00640 1 -- 172.21.15.17:0/2726421187 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc0b2040 con 0x7f3ce415f210 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3cdbe00640 1 -- 172.21.15.17:0/2726421187 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cdc004a50 con 0x7f3ce415f210 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 -- 172.21.15.17:0/2726421187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce406f050 con 0x7f3ce415f210 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3cdbe00640 1 -- 172.21.15.17:0/2726421187 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc004e40 con 0x7f3ce415f210 2024-09-10T23:19:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.485+0000 7f3ceb200640 1 -- 172.21.15.17:0/2726421187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce40b2110 con 0x7f3ce415f210 2024-09-10T23:19:21.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.489+0000 7f3cdbe00640 1 -- 172.21.15.17:0/2726421187 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3cdc0b5070 con 0x7f3ce415f210 2024-09-10T23:19:21.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.489+0000 7f3cee56a000 1 Processor -- start 2024-09-10T23:19:21.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cdbe00640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc40725e0 0x7f3cc4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- start start 2024-09-10T23:19:21.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cdbe00640 1 -- 172.21.15.17:0/2726421187 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f3cdc12cdd0 con 0x7f3ce415f210 2024-09-10T23:19:21.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3400640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc40725e0 0x7f3cc4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3400640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc40725e0 0x7f3cc4074aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b16c0 tx=0x7f3cd0001420 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad89772e0 0x55dad89776c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad8977c00 0x55dad892b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 0x55dad892bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dad8788a50 con 0x55dad89772e0 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dad8777e80 con 0x55dad892b8f0 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dad877bc90 con 0x55dad8977c00 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad89772e0 0x55dad89776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad89772e0 0x55dad89776c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37324/0 (socket says 172.21.15.17:37324) 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3e00640 1 -- 172.21.15.17:0/2749633931 learned_addr learned my addr 172.21.15.17:0/2749633931 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce9200640 1 --2- 172.21.15.17:0/2749633931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 0x55dad892bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3400640 1 --2- 172.21.15.17:0/2749633931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad8977c00 0x55dad892b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3e00640 1 -- 172.21.15.17:0/2749633931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad8977c00 msgr2=0x55dad892b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/2749633931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad8977c00 0x55dad892b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3e00640 1 -- 172.21.15.17:0/2749633931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 msgr2=0x55dad892bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/2749633931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 0x55dad892bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3e00640 1 -- 172.21.15.17:0/2749633931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad8824690 con 0x55dad89772e0 2024-09-10T23:19:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/2749633931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad89772e0 0x55dad89776c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009c00 tx=0x7f3cd4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99ef3837e917a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cd8c00640 1 -- 172.21.15.17:0/2749633931 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4004030 con 0x55dad89772e0 2024-09-10T23:19:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cd8c00640 1 -- 172.21.15.17:0/2749633931 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cd40041d0 con 0x55dad89772e0 2024-09-10T23:19:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cd8c00640 1 -- 172.21.15.17:0/2749633931 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4003600 con 0x55dad89772e0 2024-09-10T23:19:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- 172.21.15.17:0/2749633931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad89772e0 msgr2=0x55dad89776c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 --2- 172.21.15.17:0/2749633931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad89772e0 0x55dad89776c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009c00 tx=0x7f3cd4011810 comp rx=0 tx=0).stop 2024-09-10T23:19:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- 172.21.15.17:0/2749633931 shutdown_connections 2024-09-10T23:19:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 --2- 172.21.15.17:0/2749633931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 0x55dad892bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 --2- 172.21.15.17:0/2749633931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad8977c00 0x55dad892b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 --2- 172.21.15.17:0/2749633931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad89772e0 0x55dad89776c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- 172.21.15.17:0/2749633931 >> 172.21.15.17:0/2749633931 conn(0x55dad8815b30 msgr2=0x55dad895a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- 172.21.15.17:0/2749633931 shutdown_connections 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- 172.21.15.17:0/2749633931 wait complete. 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.493+0000 7f3cee56a000 1 -- start start 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 Processor -- start 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 0x55dad8957fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad8958780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad8977c00 0x55dad8958cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dad873f5e0 con 0x55dad8977c00 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dad8737840 con 0x55dad892b8f0 2024-09-10T23:19:21.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dad8744130 con 0x55dad89772e0 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 10 client.0 _ll_register_callbacks cb 0x55dad87227d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad8977c00 0x55dad8958cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad8977c00 0x55dad8958cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37336/0 (socket says 172.21.15.17:37336) 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce9200640 1 -- 172.21.15.17:0/3952315065 learned_addr learned my addr 172.21.15.17:0/3952315065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce3400640 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad8958780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 0x55dad8957fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce9200640 1 -- 172.21.15.17:0/3952315065 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 msgr2=0x55dad8958780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce9200640 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad8958780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce9200640 1 -- 172.21.15.17:0/3952315065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 msgr2=0x55dad8957fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce9200640 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 0x55dad8957fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce9200640 1 -- 172.21.15.17:0/3952315065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad87c2570 con 0x55dad8977c00 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce9200640 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad8977c00 0x55dad8958cc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009b10 tx=0x7f3cdc0f76f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72a115d390f4ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ccd600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ccd600640 1 -- 172.21.15.17:0/3952315065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc100e50 con 0x55dad8977c00 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ccd600640 1 -- 172.21.15.17:0/3952315065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f3cdc0f6ef0 con 0x55dad8977c00 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 -- 172.21.15.17:0/3952315065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dad8710270 con 0x55dad8977c00 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ccd600640 1 -- 172.21.15.17:0/3952315065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3cdc0fc6c0 con 0x55dad8977c00 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 10 client.5712 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 -- 172.21.15.17:0/3952315065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55dad872b380 con 0x55dad8977c00 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ccd600640 1 -- 172.21.15.17:0/3952315065 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55dad8710270 con 0x55dad8977c00 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ccd600640 1 -- 172.21.15.17:0/3952315065 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f3cdc0f35e0 con 0x55dad8977c00 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 10 client.5712 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 10 client.5712 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 20 client.5712 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55dad8959a00 0x55dad8989390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 4 client.5712 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3cee56a000 1 -- 172.21.15.17:0/3952315065 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dad878a9a0 con 0x55dad8959a00 2024-09-10T23:19:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55dad8959a00 0x55dad8989390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55dad8959a00 0x55dad8989390 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f615ad543a1e0d5 server_cookie=4b2b99f78a657bbf in_seq=0 out_seq=0 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.497+0000 7f3ccd600640 10 client.5712 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3ccd600640 1 -- 172.21.15.17:0/3952315065 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dad878a9a0 con 0x55dad8959a00 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3ccd600640 10 client.5712 handle_command_reply: tid=0 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 client.5712 shutdown 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 -- 172.21.15.17:0/3952315065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad8977c00 msgr2=0x55dad8958cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad8977c00 0x55dad8958cc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009b10 tx=0x7f3cdc0f76f0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 -- 172.21.15.17:0/3952315065 shutdown_connections 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55dad8959a00 0x55dad8989390 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad8977c00 0x55dad8958cc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad8958780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 --2- 172.21.15.17:0/3952315065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad892b8f0 0x55dad8957fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3ccd600640 0 client.5712 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 -- 172.21.15.17:0/3952315065 >> 172.21.15.17:0/3952315065 conn(0x55dad8815b30 msgr2=0x55dad892aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 -- 172.21.15.17:0/3952315065 shutdown_connections 2024-09-10T23:19:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 1 -- 172.21.15.17:0/3952315065 wait complete. 2024-09-10T23:19:21.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.501+0000 7f3cee56a000 20 client.5712 trim_cache size 0 max 16384 2024-09-10T23:19:21.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.517+0000 7f3cee56a000 1 Processor -- start 2024-09-10T23:19:21.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.517+0000 7f3cee56a000 1 -- start start 2024-09-10T23:19:21.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89765d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad8976b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 0x55dad8989390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce42033c0 con 0x55dad892b8f0 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce42027a0 con 0x55dad8977c00 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce4202da0 con 0x55dad89772e0 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89765d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37346/0 (socket says 172.21.15.17:37346) 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3e00640 1 -- 172.21.15.17:0/1507766337 learned_addr learned my addr 172.21.15.17:0/1507766337 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3400640 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad8976b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce9200640 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 0x55dad8989390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3e00640 1 -- 172.21.15.17:0/1507766337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 msgr2=0x55dad8976b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad8976b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3e00640 1 -- 172.21.15.17:0/1507766337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 msgr2=0x55dad8989390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 0x55dad8989390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3e00640 1 -- 172.21.15.17:0/1507766337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad87fe020 con 0x55dad892b8f0 2024-09-10T23:19:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3400640 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad8976b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89765d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009600 tx=0x7f3cd4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3cbcb0ea1fea63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ccfe00640 1 -- 172.21.15.17:0/1507766337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd402a070 con 0x55dad892b8f0 2024-09-10T23:19:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ccfe00640 1 -- 172.21.15.17:0/1507766337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cd4004240 con 0x55dad892b8f0 2024-09-10T23:19:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3ccfe00640 1 -- 172.21.15.17:0/1507766337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4009db0 con 0x55dad892b8f0 2024-09-10T23:19:21.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 -- 172.21.15.17:0/1507766337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 msgr2=0x55dad89765d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89765d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009600 tx=0x7f3cd4004740 comp rx=0 tx=0).stop 2024-09-10T23:19:21.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 -- 172.21.15.17:0/1507766337 shutdown_connections 2024-09-10T23:19:21.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 0x55dad8989390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad8976b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 --2- 172.21.15.17:0/1507766337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89765d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 -- 172.21.15.17:0/1507766337 >> 172.21.15.17:0/1507766337 conn(0x55dad8815b30 msgr2=0x55dad8975ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 -- 172.21.15.17:0/1507766337 shutdown_connections 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 -- 172.21.15.17:0/1507766337 wait complete. 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 -- start start 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.521+0000 7f3cee56a000 1 Processor -- start 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89edce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad89ee220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 0x55dad89ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dad87802c0 con 0x55dad892b8f0 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dad877afa0 con 0x55dad8977c00 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dad872da60 con 0x55dad89772e0 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 10 client.0 _ll_register_callbacks cb 0x7f3cdc0f4320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89edce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37352/0 (socket says 172.21.15.17:37352) 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3e00640 1 -- 172.21.15.17:0/232153133 learned_addr learned my addr 172.21.15.17:0/232153133 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3400640 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad89ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce9200640 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 0x55dad89ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3e00640 1 -- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 msgr2=0x55dad89ee220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad89ee220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3e00640 1 -- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 msgr2=0x55dad89ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 0x55dad89ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3e00640 1 -- 172.21.15.17:0/232153133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad87d52d0 con 0x55dad892b8f0 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3400640 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad89ee220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce9200640 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 0x55dad89ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3e00640 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89edce0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4011850 tx=0x7f3cd4009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ca6938cc5e829 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 1 -- 172.21.15.17:0/232153133 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd402a070 con 0x55dad892b8f0 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 1 -- 172.21.15.17:0/232153133 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f3cd401a850 con 0x55dad892b8f0 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- 172.21.15.17:0/232153133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd4004240 con 0x55dad892b8f0 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 1 -- 172.21.15.17:0/232153133 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3cd403a050 con 0x55dad892b8f0 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 10 client.5718 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- 172.21.15.17:0/232153133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55dad873ea50 con 0x55dad892b8f0 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 1 -- 172.21.15.17:0/232153133 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cd4004240 con 0x55dad892b8f0 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 1 -- 172.21.15.17:0/232153133 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f3cd403d020 con 0x55dad892b8f0 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 10 client.5718 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 10 client.5718 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 20 client.5718 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55dad898c0c0 0x55dad898c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 4 client.5718 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-10T23:19:21.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- 172.21.15.17:0/232153133 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55dad8786450 con 0x55dad898c0c0 2024-09-10T23:19:21.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3400640 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55dad898c0c0 0x55dad898c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ce3400640 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55dad898c0c0 0x55dad898c4d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae16552d400d65c4 server_cookie=fe03676daaed067d in_seq=0 out_seq=0 2024-09-10T23:19:21.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 10 client.5718 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 1 -- 172.21.15.17:0/232153133 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dad8786450 con 0x55dad898c0c0 2024-09-10T23:19:21.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 10 client.5718 handle_command_reply: tid=0 2024-09-10T23:19:21.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 client.5718 shutdown 2024-09-10T23:19:21.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- 172.21.15.17:0/232153133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 msgr2=0x55dad89edce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89edce0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4011850 tx=0x7f3cd4009e40 comp rx=0 tx=0).stop 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- 172.21.15.17:0/232153133 shutdown_connections 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55dad898c0c0 0x55dad898c4d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dad8977c00 0x55dad89ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dad89772e0 0x55dad89ee220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3ccd600640 0 client.5718 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 --2- 172.21.15.17:0/232153133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dad892b8f0 0x55dad89edce0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- 172.21.15.17:0/232153133 >> 172.21.15.17:0/232153133 conn(0x55dad8815b30 msgr2=0x55dad89766e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- 172.21.15.17:0/232153133 shutdown_connections 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.525+0000 7f3cee56a000 1 -- 172.21.15.17:0/232153133 wait complete. 2024-09-10T23:19:21.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3cee56a000 20 client.5718 trim_cache size 0 max 16384 2024-09-10T23:19:21.538 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:19:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "6585d22e-42c6-4013-856e-9e3cea69c110", 2024-09-10T23:19:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:19:21.538 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 -- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc40725e0 msgr2=0x7f3cc4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc40725e0 0x7f3cc4074aa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b16c0 tx=0x7f3cd0001420 comp rx=0 tx=0).stop 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 -- 172.21.15.17:0/2726421187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce415f210 msgr2=0x7f3ce4154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce415f210 0x7f3ce4154c20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc01a7d0 tx=0x7f3cdc003f60 comp rx=0 tx=0).stop 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 -- 172.21.15.17:0/2726421187 shutdown_connections 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cc40725e0 0x7f3cc4074aa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ce415f210 0x7f3ce4154c20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ce40d23e0 0x7f3ce40b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 --2- 172.21.15.17:0/2726421187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ce40d0320 0x7f3ce41545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 -- 172.21.15.17:0/2726421187 >> 172.21.15.17:0/2726421187 conn(0x7f3ce409a9f0 msgr2=0x7f3ce40af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 -- 172.21.15.17:0/2726421187 shutdown_connections 2024-09-10T23:19:21.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.529+0000 7f3ceb200640 1 -- 172.21.15.17:0/2726421187 wait complete. 2024-09-10T23:19:21.550 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '6585d22e-42c6-4013-856e-9e3cea69c110', 'mode': 'asynchronous'}' 2024-09-10T23:19:21.551 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-10T23:19:21.551 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-10T23:19:21.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-10T23:19:21.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.745+0000 7fe4adc00640 1 -- 172.21.15.17:0/3414155707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a80b2540 msgr2=0x7fe4a80d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.745+0000 7fe4adc00640 1 --2- 172.21.15.17:0/3414155707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a80b2540 0x7fe4a80d03b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe490009840 tx=0x7fe49001c820 comp rx=0 tx=0).stop 2024-09-10T23:19:21.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.745+0000 7fe4adc00640 1 -- 172.21.15.17:0/3414155707 shutdown_connections 2024-09-10T23:19:21.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.745+0000 7fe4adc00640 1 --2- 172.21.15.17:0/3414155707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a80b2540 0x7fe4a80d03b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.745+0000 7fe4adc00640 1 -- 172.21.15.17:0/3414155707 >> 172.21.15.17:0/3414155707 conn(0x7fe4a80d1da0 msgr2=0x7fe4a80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.745+0000 7fe4adc00640 1 -- 172.21.15.17:0/3414155707 shutdown_connections 2024-09-10T23:19:21.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.745+0000 7fe4adc00640 1 -- 172.21.15.17:0/3414155707 wait complete. 2024-09-10T23:19:21.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4adc00640 1 Processor -- start 2024-09-10T23:19:21.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4adc00640 1 -- start start 2024-09-10T23:19:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4adc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a80b2540 0x7fe4a815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4adc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a80b31b0 0x7fe4a81fc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4adc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815f400 0x7fe4a815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4adc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a8169e80 con 0x7fe4a80b31b0 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4adc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80cdc80 con 0x7fe4a80b2540 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4adc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a816a000 con 0x7fe4a815f400 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe49fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a80b31b0 0x7fe4a81fc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe49fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a80b31b0 0x7fe4a81fc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37366/0 (socket says 172.21.15.17:37366) 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe49fe00640 1 -- 172.21.15.17:0/1980111583 learned_addr learned my addr 172.21.15.17:0/1980111583 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a80b2540 0x7fe4a815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.749+0000 7fe4a7400640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815f400 0x7fe4a815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe49fe00640 1 -- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815f400 msgr2=0x7fe4a815bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe49fe00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815f400 0x7fe4a815bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe49fe00640 1 -- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a80b2540 msgr2=0x7fe4a815c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe49fe00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a80b2540 0x7fe4a815c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe49fe00640 1 -- 172.21.15.17:0/1980111583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a80b0390 con 0x7fe4a80b31b0 2024-09-10T23:19:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe4a7400640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815f400 0x7fe4a815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe49fe00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a80b31b0 0x7fe4a81fc870 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe490000c10 tx=0x7fe4900051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe49ea00640 1 -- 172.21.15.17:0/1980111583 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4900bd070 con 0x7fe4a80b31b0 2024-09-10T23:19:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe49ea00640 1 -- 172.21.15.17:0/1980111583 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4900b3040 con 0x7fe4a80b31b0 2024-09-10T23:19:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe49ea00640 1 -- 172.21.15.17:0/1980111583 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4900b2070 con 0x7fe4a80b31b0 2024-09-10T23:19:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe4adc00640 1 -- 172.21.15.17:0/1980111583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a81fb910 con 0x7fe4a80b31b0 2024-09-10T23:19:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.753+0000 7fe4adc00640 1 -- 172.21.15.17:0/1980111583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a81fbed0 con 0x7fe4a80b31b0 2024-09-10T23:19:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe49ea00640 1 -- 172.21.15.17:0/1980111583 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe490004250 con 0x7fe4a80b31b0 2024-09-10T23:19:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4b10a4000 1 Processor -- start 2024-09-10T23:19:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4b10a4000 1 -- start start 2024-09-10T23:19:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe49ea00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4840725e0 0x7fe484074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe49ea00640 1 -- 172.21.15.17:0/1980111583 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fe49012cc20 con 0x7fe4a80b31b0 2024-09-10T23:19:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a7400640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4840725e0 0x7fe484074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa6bc30 0x55a23fa6c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa1f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa1f610 0x55a23fa1f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a23f87ef10 con 0x55a23fa1f610 2024-09-10T23:19:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a23f86e340 con 0x55a23fa6c550 2024-09-10T23:19:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a23f872150 con 0x55a23fa6bc30 2024-09-10T23:19:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa6bc30 0x55a23fa6c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa6bc30 0x55a23fa6c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:39210/0 (socket says 172.21.15.17:39210) 2024-09-10T23:19:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a6a00640 1 -- 172.21.15.17:0/2063245385 learned_addr learned my addr 172.21.15.17:0/2063245385 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe49fe00640 1 --2- 172.21.15.17:0/2063245385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa1f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a7400640 1 --2- 172.21.15.17:0/2063245385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa1f610 0x55a23fa1f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a7400640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4840725e0 0x7fe484074aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0004a40 tx=0x7fe4a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a6a00640 1 -- 172.21.15.17:0/2063245385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 msgr2=0x55a23fa1f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/2063245385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa1f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a6a00640 1 -- 172.21.15.17:0/2063245385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa1f610 msgr2=0x55a23fa1f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/2063245385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa1f610 0x55a23fa1f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a6a00640 1 -- 172.21.15.17:0/2063245385 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a23f8b62d0 con 0x55a23fa6bc30 2024-09-10T23:19:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.757+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/2063245385 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa6bc30 0x55a23fa6c010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe498001830 tx=0x7fe498007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8444d7bdf64eea24 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe497400640 1 -- 172.21.15.17:0/2063245385 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4980052e0 con 0x55a23fa6bc30 2024-09-10T23:19:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe497400640 1 -- 172.21.15.17:0/2063245385 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe498018070 con 0x55a23fa6bc30 2024-09-10T23:19:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe497400640 1 -- 172.21.15.17:0/2063245385 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49800f950 con 0x55a23fa6bc30 2024-09-10T23:19:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 -- 172.21.15.17:0/2063245385 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa6bc30 msgr2=0x55a23fa6c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/2063245385 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa6bc30 0x55a23fa6c010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe498001830 tx=0x7fe498007e00 comp rx=0 tx=0).stop 2024-09-10T23:19:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 -- 172.21.15.17:0/2063245385 shutdown_connections 2024-09-10T23:19:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/2063245385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa1f610 0x55a23fa1f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/2063245385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa1f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/2063245385 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa6bc30 0x55a23fa6c010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 -- 172.21.15.17:0/2063245385 >> 172.21.15.17:0/2063245385 conn(0x55a23fa4ccf0 msgr2=0x55a23fa4f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 -- 172.21.15.17:0/2063245385 shutdown_connections 2024-09-10T23:19:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 -- 172.21.15.17:0/2063245385 wait complete. 2024-09-10T23:19:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 -- start start 2024-09-10T23:19:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 Processor -- start 2024-09-10T23:19:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa26da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6bc30 0x55a23fa272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6c550 0x55a23fa4d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a23f8276d0 con 0x55a23fa6c550 2024-09-10T23:19:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a23f92c410 con 0x55a23fa6bc30 2024-09-10T23:19:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a23f819660 con 0x55a23fa1f610 2024-09-10T23:19:21.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4b10a4000 10 client.0 _ll_register_callbacks cb 0x55a23fa0d040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa26da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe49fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6bc30 0x55a23fa272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa26da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:39220/0 (socket says 172.21.15.17:39220) 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4a6a00640 1 -- 172.21.15.17:0/3459817621 learned_addr learned my addr 172.21.15.17:0/3459817621 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.761+0000 7fe4a7400640 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6c550 0x55a23fa4d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4a6a00640 1 -- 172.21.15.17:0/3459817621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6bc30 msgr2=0x55a23fa272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6bc30 0x55a23fa272e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4a6a00640 1 -- 172.21.15.17:0/3459817621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6c550 msgr2=0x55a23fa4d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6c550 0x55a23fa4d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4a6a00640 1 -- 172.21.15.17:0/3459817621 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55a23f827ab0 con 0x55a23fa1f610 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe49fe00640 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6bc30 0x55a23fa272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:21.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4a7400640 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6c550 0x55a23fa4d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa26da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe498010990 tx=0x7fe4980109c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b027aa7f37dc6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe48be00640 10 client.0 ms_handle_connect on v2:172.21.15.77:3301/0 2024-09-10T23:19:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe48be00640 1 -- 172.21.15.17:0/3459817621 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498021070 con 0x55a23fa1f610 2024-09-10T23:19:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4b10a4000 1 -- 172.21.15.17:0/3459817621 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a23f806710 con 0x55a23fa1f610 2024-09-10T23:19:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe48be00640 1 -- 172.21.15.17:0/3459817621 <== mon.2 v2:172.21.15.77:3301/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fe498003600 con 0x55a23fa1f610 2024-09-10T23:19:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe48be00640 1 -- 172.21.15.17:0/3459817621 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe49802e050 con 0x55a23fa1f610 2024-09-10T23:19:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4b10a4000 10 client.5201 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4b10a4000 1 -- 172.21.15.17:0/3459817621 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55a23f80c790 con 0x55a23fa1f610 2024-09-10T23:19:21.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe48be00640 1 -- 172.21.15.17:0/3459817621 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a23f806710 con 0x55a23fa1f610 2024-09-10T23:19:21.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe48be00640 1 -- 172.21.15.17:0/3459817621 <== mon.2 v2:172.21.15.77:3301/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fe498031020 con 0x55a23fa1f610 2024-09-10T23:19:21.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4b10a4000 10 client.5201 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4b10a4000 10 client.5201 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4b10a4000 20 client.5201 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55a23fa71da0 0x55a23fa721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4b10a4000 4 client.5201 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe4b10a4000 1 -- 172.21.15.17:0/3459817621 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a23f880e60 con 0x55a23fa71da0 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.765+0000 7fe49fe00640 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55a23fa71da0 0x55a23fa721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe49fe00640 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55a23fa71da0 0x55a23fa721b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ae8163d0ab610d server_cookie=6f1e119281b0c612 in_seq=0 out_seq=0 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe48be00640 10 client.5201 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe48be00640 1 -- 172.21.15.17:0/3459817621 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a23f880e60 con 0x55a23fa71da0 2024-09-10T23:19:21.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe48be00640 10 client.5201 handle_command_reply: tid=0 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 client.5201 shutdown 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 -- 172.21.15.17:0/3459817621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 msgr2=0x55a23fa26da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa26da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe498010990 tx=0x7fe4980109c0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 -- 172.21.15.17:0/3459817621 shutdown_connections 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55a23fa71da0 0x55a23fa721b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6c550 0x55a23fa4d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6bc30 0x55a23fa272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/3459817621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa26da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe48be00640 0 client.5201 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 -- 172.21.15.17:0/3459817621 >> 172.21.15.17:0/3459817621 conn(0x55a23fa4ccf0 msgr2=0x55a23fa1e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 -- 172.21.15.17:0/3459817621 shutdown_connections 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 1 -- 172.21.15.17:0/3459817621 wait complete. 2024-09-10T23:19:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.769+0000 7fe4b10a4000 20 client.5201 trim_cache size 0 max 16384 2024-09-10T23:19:21.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.789+0000 7fe4b10a4000 1 Processor -- start 2024-09-10T23:19:21.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.789+0000 7fe4b10a4000 1 -- start start 2024-09-10T23:19:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.789+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa82960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.789+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa69f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.789+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa6a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.789+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a8207a60 con 0x55a23fa6bc30 2024-09-10T23:19:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.789+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a8071590 con 0x55a23fa6c550 2024-09-10T23:19:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.789+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a8207410 con 0x55a23fa1f610 2024-09-10T23:19:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe49fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa69f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa82960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe49fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa69f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37396/0 (socket says 172.21.15.17:37396) 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe49fe00640 1 -- 172.21.15.17:0/348049562 learned_addr learned my addr 172.21.15.17:0/348049562 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4a7400640 1 --2- 172.21.15.17:0/348049562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa6a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4a6a00640 1 -- 172.21.15.17:0/348049562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 msgr2=0x55a23fa6a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/348049562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa6a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4a6a00640 1 -- 172.21.15.17:0/348049562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 msgr2=0x55a23fa69f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/348049562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa69f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4a6a00640 1 -- 172.21.15.17:0/348049562 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a23f87e7e0 con 0x55a23fa1f610 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/348049562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa82960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe498005630 tx=0x7fe498007ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6dadd815aa11b48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe496a00640 1 -- 172.21.15.17:0/348049562 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498021040 con 0x55a23fa1f610 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe496a00640 1 -- 172.21.15.17:0/348049562 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe498018040 con 0x55a23fa1f610 2024-09-10T23:19:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe496a00640 1 -- 172.21.15.17:0/348049562 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498003e30 con 0x55a23fa1f610 2024-09-10T23:19:21.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 -- 172.21.15.17:0/348049562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 msgr2=0x55a23fa82960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/348049562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa82960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe498005630 tx=0x7fe498007ac0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 -- 172.21.15.17:0/348049562 shutdown_connections 2024-09-10T23:19:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/348049562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa6a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/348049562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa69f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/348049562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa82960 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 -- 172.21.15.17:0/348049562 >> 172.21.15.17:0/348049562 conn(0x55a23fa4ccf0 msgr2=0x55a23fa25d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 -- 172.21.15.17:0/348049562 shutdown_connections 2024-09-10T23:19:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 -- 172.21.15.17:0/348049562 wait complete. 2024-09-10T23:19:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 -- start start 2024-09-10T23:19:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.793+0000 7fe4b10a4000 1 Processor -- start 2024-09-10T23:19:21.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa6af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa6b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa751e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a23f82de30 con 0x55a23fa6bc30 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a23f87dce0 con 0x55a23fa6c550 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a23f871460 con 0x55a23fa1f610 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 10 client.0 _ll_register_callbacks cb 0x7fe4a0001e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe49fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa6b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa6af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe49fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa6b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37412/0 (socket says 172.21.15.17:37412) 2024-09-10T23:19:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa6af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:39230/0 (socket says 172.21.15.17:39230) 2024-09-10T23:19:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe49fe00640 1 -- 172.21.15.17:0/1362368561 learned_addr learned my addr 172.21.15.17:0/1362368561 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4a7400640 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa751e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe49fe00640 1 -- 172.21.15.17:0/1362368561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 msgr2=0x55a23fa6af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe49fe00640 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa6af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe49fe00640 1 -- 172.21.15.17:0/1362368561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 msgr2=0x55a23fa751e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe49fe00640 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa751e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe49fe00640 1 -- 172.21.15.17:0/1362368561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a23f8c9490 con 0x55a23fa6bc30 2024-09-10T23:19:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe49fe00640 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa6b4a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe49001cd00 tx=0x7fe4900fb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f02d83d6b7c68ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe48be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:21.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe48be00640 1 -- 172.21.15.17:0/1362368561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490118e60 con 0x55a23fa6bc30 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe48be00640 1 -- 172.21.15.17:0/1362368561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fe4900f7eb0 con 0x55a23fa6bc30 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 -- 172.21.15.17:0/1362368561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe498018040 con 0x55a23fa6bc30 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe48be00640 1 -- 172.21.15.17:0/1362368561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe4900f7a50 con 0x55a23fa6bc30 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 10 client.5736 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 -- 172.21.15.17:0/1362368561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55a23f8136c0 con 0x55a23fa6bc30 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe48be00640 1 -- 172.21.15.17:0/1362368561 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe498018040 con 0x55a23fa6bc30 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe48be00640 1 -- 172.21.15.17:0/1362368561 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fe4900f9ce0 con 0x55a23fa6bc30 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 10 client.5736 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 10 client.5736 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 20 client.5736 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55a23fae1b20 0x55a23fae1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:21.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 4 client.5736 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-10T23:19:21.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4b10a4000 1 -- 172.21.15.17:0/1362368561 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55a23f87c910 con 0x55a23fae1b20 2024-09-10T23:19:21.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.797+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55a23fae1b20 0x55a23fae1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:21.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.801+0000 7fe4a6a00640 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55a23fae1b20 0x55a23fae1f30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d8288439377f8a5 server_cookie=188e92d18e57ffe6 in_seq=0 out_seq=0 2024-09-10T23:19:21.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.801+0000 7fe48be00640 10 client.5736 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe48be00640 1 -- 172.21.15.17:0/1362368561 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a23f87c910 con 0x55a23fae1b20 2024-09-10T23:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe48be00640 10 client.5736 handle_command_reply: tid=0 2024-09-10T23:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 client.5736 shutdown 2024-09-10T23:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 -- 172.21.15.17:0/1362368561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 msgr2=0x55a23fa6b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa6b4a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe49001cd00 tx=0x7fe4900fb040 comp rx=0 tx=0).stop 2024-09-10T23:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 -- 172.21.15.17:0/1362368561 shutdown_connections 2024-09-10T23:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55a23fae1b20 0x55a23fae1f30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a23fa6c550 0x55a23fa751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a23fa6bc30 0x55a23fa6b4a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 --2- 172.21.15.17:0/1362368561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a23fa1f610 0x55a23fa6af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe48be00640 0 client.5736 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 -- 172.21.15.17:0/1362368561 >> 172.21.15.17:0/1362368561 conn(0x55a23fa4ccf0 msgr2=0x55a23fa26570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 -- 172.21.15.17:0/1362368561 shutdown_connections 2024-09-10T23:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 1 -- 172.21.15.17:0/1362368561 wait complete. 2024-09-10T23:19:21.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4b10a4000 20 client.5736 trim_cache size 0 max 16384 2024-09-10T23:19:21.924 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:21.924 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:19:21.924 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 -- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4840725e0 msgr2=0x7fe484074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4840725e0 0x7fe484074aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0004a40 tx=0x7fe4a0009040 comp rx=0 tx=0).stop 2024-09-10T23:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 -- 172.21.15.17:0/1980111583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a80b31b0 msgr2=0x7fe4a81fc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a80b31b0 0x7fe4a81fc870 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe490000c10 tx=0x7fe4900051c0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 -- 172.21.15.17:0/1980111583 shutdown_connections 2024-09-10T23:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4840725e0 0x7fe484074aa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4a815f400 0x7fe4a815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4a80b31b0 0x7fe4a81fc870 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 --2- 172.21.15.17:0/1980111583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4a80b2540 0x7fe4a815c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 -- 172.21.15.17:0/1980111583 >> 172.21.15.17:0/1980111583 conn(0x7fe4a80d1da0 msgr2=0x7fe4a80b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 -- 172.21.15.17:0/1980111583 shutdown_connections 2024-09-10T23:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:21.917+0000 7fe4adc00640 1 -- 172.21.15.17:0/1980111583 wait complete. 2024-09-10T23:19:21.943 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-09-10T23:19:21.943 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-10T23:19:21.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-10T23:19:22.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.089+0000 7f0f00200640 1 -- 172.21.15.17:0/2784001713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b6120 msgr2=0x7f0ef806d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.089+0000 7f0f00200640 1 --2- 172.21.15.17:0/2784001713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b6120 0x7f0ef806d2d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80b3740 tx=0x7f0ef001cb30 comp rx=0 tx=0).stop 2024-09-10T23:19:22.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.089+0000 7f0f00200640 1 -- 172.21.15.17:0/2784001713 shutdown_connections 2024-09-10T23:19:22.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.089+0000 7f0f00200640 1 --2- 172.21.15.17:0/2784001713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b6120 0x7f0ef806d2d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.089+0000 7f0f00200640 1 --2- 172.21.15.17:0/2784001713 >> v2:172.21.15.77:3300/0 conn(0x7f0ef815bee0 0x7f0ef80cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.089+0000 7f0f00200640 1 -- 172.21.15.17:0/2784001713 >> 172.21.15.17:0/2784001713 conn(0x7f0ef80d0b80 msgr2=0x7f0ef80d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.089+0000 7f0f00200640 1 -- 172.21.15.17:0/2784001713 shutdown_connections 2024-09-10T23:19:22.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.089+0000 7f0f00200640 1 -- 172.21.15.17:0/2784001713 wait complete. 2024-09-10T23:19:22.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 Processor -- start 2024-09-10T23:19:22.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 -- start start 2024-09-10T23:19:22.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b5ce0 0x7f0ef815e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ef80b6120 0x7f0ef814abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ef815bee0 0x7f0ef80b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef815fb10 con 0x7f0ef80b5ce0 2024-09-10T23:19:22.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef80d0710 con 0x7f0ef815bee0 2024-09-10T23:19:22.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef80d0890 con 0x7f0ef80b6120 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efd800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b5ce0 0x7f0ef815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efd800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b5ce0 0x7f0ef815e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37428/0 (socket says 172.21.15.17:37428) 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efd800640 1 -- 172.21.15.17:0/591901393 learned_addr learned my addr 172.21.15.17:0/591901393 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efe200640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ef815bee0 0x7f0ef80b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efce00640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ef80b6120 0x7f0ef814abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efd800640 1 -- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ef80b6120 msgr2=0x7f0ef814abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efd800640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ef80b6120 0x7f0ef814abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efd800640 1 -- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ef815bee0 msgr2=0x7f0ef80b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efd800640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ef815bee0 0x7f0ef80b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efd800640 1 -- 172.21.15.17:0/591901393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef81f9570 con 0x7f0ef80b5ce0 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0efd800640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b5ce0 0x7f0ef815e860 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00e7a0 tx=0x7f0eec00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0ef5600640 1 -- 172.21.15.17:0/591901393 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00ccc0 con 0x7f0ef80b5ce0 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0ef5600640 1 -- 172.21.15.17:0/591901393 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eec010430 con 0x7f0ef80b5ce0 2024-09-10T23:19:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0ef5600640 1 -- 172.21.15.17:0/591901393 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec010860 con 0x7f0ef80b5ce0 2024-09-10T23:19:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 -- 172.21.15.17:0/591901393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef80b1930 con 0x7f0ef80b5ce0 2024-09-10T23:19:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.093+0000 7f0f00200640 1 -- 172.21.15.17:0/591901393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef814cb90 con 0x7f0ef80b5ce0 2024-09-10T23:19:22.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.097+0000 7f0ef5600640 1 -- 172.21.15.17:0/591901393 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0eec010a00 con 0x7f0ef80b5ce0 2024-09-10T23:19:22.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.097+0000 7f0ef5600640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ed8072610 0x7f0ed8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.097+0000 7f0f0353e000 1 Processor -- start 2024-09-10T23:19:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.097+0000 7f0ef5600640 1 -- 172.21.15.17:0/591901393 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f0eec093d30 con 0x7f0ef80b5ce0 2024-09-10T23:19:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.097+0000 7f0f0353e000 1 -- start start 2024-09-10T23:19:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.097+0000 7f0efce00640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ed8072610 0x7f0ed8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dbad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84dbadf10 0x55b84db60ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84db61020 0x55b84db61400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b84d9bffa0 con 0x55b84dbad5f0 2024-09-10T23:19:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b84d9af3d0 con 0x55b84db61020 2024-09-10T23:19:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b84d9b31e0 con 0x55b84dbadf10 2024-09-10T23:19:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efd800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dbad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efce00640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ed8072610 0x7f0ed8074ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ef815e150 tx=0x7f0ee4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efd800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dbad9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37436/0 (socket says 172.21.15.17:37436) 2024-09-10T23:19:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efd800640 1 -- 172.21.15.17:0/295010322 learned_addr learned my addr 172.21.15.17:0/295010322 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efce00640 1 --2- 172.21.15.17:0/295010322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84dbadf10 0x55b84db60ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efe200640 1 --2- 172.21.15.17:0/295010322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84db61020 0x55b84db61400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efd800640 1 -- 172.21.15.17:0/295010322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84dbadf10 msgr2=0x55b84db60ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efd800640 1 --2- 172.21.15.17:0/295010322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84dbadf10 0x55b84db60ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efd800640 1 -- 172.21.15.17:0/295010322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84db61020 msgr2=0x55b84db61400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efd800640 1 --2- 172.21.15.17:0/295010322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84db61020 0x55b84db61400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efd800640 1 -- 172.21.15.17:0/295010322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84d96f620 con 0x55b84dbad5f0 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0efd800640 1 --2- 172.21.15.17:0/295010322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dbad9d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0eec05e8f0 tx=0x7f0eec05e360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc44a6898d2b27e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0eea000640 1 -- 172.21.15.17:0/295010322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec063070 con 0x55b84dbad5f0 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0eea000640 1 -- 172.21.15.17:0/295010322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eec068040 con 0x55b84dbad5f0 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0eea000640 1 -- 172.21.15.17:0/295010322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec063210 con 0x55b84dbad5f0 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- 172.21.15.17:0/295010322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 msgr2=0x55b84dbad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- 172.21.15.17:0/295010322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dbad9d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0eec05e8f0 tx=0x7f0eec05e360 comp rx=0 tx=0).stop 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- 172.21.15.17:0/295010322 shutdown_connections 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- 172.21.15.17:0/295010322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84db61020 0x55b84db61400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- 172.21.15.17:0/295010322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84dbadf10 0x55b84db60ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- 172.21.15.17:0/295010322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dbad9d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- 172.21.15.17:0/295010322 >> 172.21.15.17:0/295010322 conn(0x55b84db8e8c0 msgr2=0x55b84db90cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- 172.21.15.17:0/295010322 shutdown_connections 2024-09-10T23:19:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- 172.21.15.17:0/295010322 wait complete. 2024-09-10T23:19:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- start start 2024-09-10T23:19:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 Processor -- start 2024-09-10T23:19:22.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84dbacef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbad5f0 0x55b84db71e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbadf10 0x55b84db723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b84d954ab0 con 0x55b84dbadf10 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b84d96be60 con 0x55b84dbad5f0 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.101+0000 7f0f0353e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b84d95a500 con 0x55b84db61020 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 10 client.0 _ll_register_callbacks cb 0x55b84db4e590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efe200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbadf10 0x55b84db723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efe200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbadf10 0x55b84db723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37438/0 (socket says 172.21.15.17:37438) 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efe200640 1 -- 172.21.15.17:0/1920837918 learned_addr learned my addr 172.21.15.17:0/1920837918 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efd800640 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84dbacef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efce00640 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbad5f0 0x55b84db71e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efe200640 1 -- 172.21.15.17:0/1920837918 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 msgr2=0x55b84dbacef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efe200640 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84dbacef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efe200640 1 -- 172.21.15.17:0/1920837918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbad5f0 msgr2=0x55b84db71e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efe200640 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbad5f0 0x55b84db71e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efe200640 1 -- 172.21.15.17:0/1920837918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84d944d50 con 0x55b84dbadf10 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efe200640 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbadf10 0x55b84db723b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00b0040 tx=0x7f0ef00097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1c1a7c3faf7a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 1 -- 172.21.15.17:0/1920837918 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00bd070 con 0x55b84dbadf10 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 1 -- 172.21.15.17:0/1920837918 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f0ef0004a50 con 0x55b84dbadf10 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 -- 172.21.15.17:0/1920837918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b84d9478f0 con 0x55b84dbadf10 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 1 -- 172.21.15.17:0/1920837918 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ef00c8050 con 0x55b84dbadf10 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 10 client.5751 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 -- 172.21.15.17:0/1920837918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55b84d94d7b0 con 0x55b84dbadf10 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 1 -- 172.21.15.17:0/1920837918 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b84d9478f0 con 0x55b84dbadf10 2024-09-10T23:19:22.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 1 -- 172.21.15.17:0/1920837918 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f0ef00cb020 con 0x55b84dbadf10 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 10 client.5751 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 10 client.5751 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 20 client.5751 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b84db73120 0x55b84dbc38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 4 client.5751 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 -- 172.21.15.17:0/1920837918 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b84d9c1ef0 con 0x55b84db73120 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efd800640 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b84db73120 0x55b84dbc38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 10 client.5751 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0efd800640 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b84db73120 0x55b84dbc38f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2d3f73e88ce2e5f server_cookie=222bb71dbf57ad60 in_seq=0 out_seq=0 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 1 -- 172.21.15.17:0/1920837918 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b84d9c1ef0 con 0x55b84db73120 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 10 client.5751 handle_command_reply: tid=0 2024-09-10T23:19:22.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 client.5751 shutdown 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 -- 172.21.15.17:0/1920837918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbadf10 msgr2=0x55b84db723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbadf10 0x55b84db723b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00b0040 tx=0x7f0ef00097e0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 -- 172.21.15.17:0/1920837918 shutdown_connections 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b84db73120 0x55b84dbc38f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbadf10 0x55b84db723b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbad5f0 0x55b84db71e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 --2- 172.21.15.17:0/1920837918 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84dbacef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0edea00640 0 client.5751 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 -- 172.21.15.17:0/1920837918 >> 172.21.15.17:0/1920837918 conn(0x55b84db8e8c0 msgr2=0x55b84db601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 -- 172.21.15.17:0/1920837918 shutdown_connections 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 1 -- 172.21.15.17:0/1920837918 wait complete. 2024-09-10T23:19:22.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.105+0000 7f0f0353e000 20 client.5751 trim_cache size 0 max 16384 2024-09-10T23:19:22.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0f0353e000 1 Processor -- start 2024-09-10T23:19:22.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0f0353e000 1 -- start start 2024-09-10T23:19:22.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84db681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84db686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 0x55b84dbc38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0f0353e000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef80b5330 con 0x55b84dbad5f0 2024-09-10T23:19:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0f0353e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef814c1c0 con 0x55b84dbadf10 2024-09-10T23:19:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0f0353e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef80b4ce0 con 0x55b84db61020 2024-09-10T23:19:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84db686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84db686e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37442/0 (socket says 172.21.15.17:37442) 2024-09-10T23:19:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efce00640 1 -- 172.21.15.17:0/3490927004 learned_addr learned my addr 172.21.15.17:0/3490927004 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efd800640 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84db681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efce00640 1 -- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 msgr2=0x55b84db681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efce00640 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84db681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efe200640 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 0x55b84dbc38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efce00640 1 -- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 msgr2=0x55b84dbc38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efce00640 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 0x55b84dbc38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efce00640 1 -- 172.21.15.17:0/3490927004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b84da0b0b0 con 0x55b84dbad5f0 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efd800640 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84db681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.125+0000 7f0efe200640 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 0x55b84dbc38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efce00640 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84db686e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400e900 tx=0x7f0ee4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9793945755940ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0ee9600640 1 -- 172.21.15.17:0/3490927004 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400ee80 con 0x55b84dbad5f0 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0ee9600640 1 -- 172.21.15.17:0/3490927004 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ee4028070 con 0x55b84dbad5f0 2024-09-10T23:19:22.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0ee9600640 1 -- 172.21.15.17:0/3490927004 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4015cf0 con 0x55b84dbad5f0 2024-09-10T23:19:22.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 -- 172.21.15.17:0/3490927004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 msgr2=0x55b84db686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84db686e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400e900 tx=0x7f0ee4014000 comp rx=0 tx=0).stop 2024-09-10T23:19:22.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 -- 172.21.15.17:0/3490927004 shutdown_connections 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 0x55b84dbc38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84db686e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3490927004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84db681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 -- 172.21.15.17:0/3490927004 >> 172.21.15.17:0/3490927004 conn(0x55b84db8e8c0 msgr2=0x55b84db606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 -- 172.21.15.17:0/3490927004 shutdown_connections 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 -- 172.21.15.17:0/3490927004 wait complete. 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 -- start start 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 Processor -- start 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84dc27e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dc283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 0x55b84dc28910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b84d97bfe0 con 0x55b84dbad5f0 2024-09-10T23:19:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b84d9bed70 con 0x55b84dbadf10 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b84d9b24f0 con 0x55b84db61020 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0f0353e000 10 client.0 _ll_register_callbacks cb 0x7f0ee0003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dc283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efd800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84dc27e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dc283d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37456/0 (socket says 172.21.15.17:37456) 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efd800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84dc27e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:39260/0 (socket says 172.21.15.17:39260) 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efce00640 1 -- 172.21.15.17:0/3438010172 learned_addr learned my addr 172.21.15.17:0/3438010172 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efe200640 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 0x55b84dc28910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efce00640 1 -- 172.21.15.17:0/3438010172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 msgr2=0x55b84dc27e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efce00640 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84dc27e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efce00640 1 -- 172.21.15.17:0/3438010172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 msgr2=0x55b84dc28910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efce00640 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 0x55b84dc28910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.129+0000 7f0efce00640 1 -- 172.21.15.17:0/3438010172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b84d975420 con 0x55b84dbad5f0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0efce00640 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dc283d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4017010 tx=0x7f0ee40234f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f3cb8603a11f2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 1 -- 172.21.15.17:0/3438010172 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4030030 con 0x55b84dbad5f0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 1 -- 172.21.15.17:0/3438010172 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f0ee4010050 con 0x55b84dbad5f0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 -- 172.21.15.17:0/3438010172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee4028070 con 0x55b84dbad5f0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 1 -- 172.21.15.17:0/3438010172 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ee403c050 con 0x55b84dbad5f0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 10 client.5757 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 -- 172.21.15.17:0/3438010172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55b84d945f40 con 0x55b84dbad5f0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 1 -- 172.21.15.17:0/3438010172 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ee4028070 con 0x55b84dbad5f0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 1 -- 172.21.15.17:0/3438010172 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f0ee403f020 con 0x55b84dbad5f0 2024-09-10T23:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 10 client.5757 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 10 client.5757 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 20 client.5757 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b84dbc6560 0x55b84dbc6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 4 client.5757 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 -- 172.21.15.17:0/3438010172 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55b84d9bd9a0 con 0x55b84dbc6560 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0efd800640 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b84dbc6560 0x55b84dbc6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 10 client.5757 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0efd800640 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b84dbc6560 0x55b84dbc6970 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=636b98d74c51e15f server_cookie=46b608d3972416c4 in_seq=0 out_seq=0 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 1 -- 172.21.15.17:0/3438010172 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b84d9bd9a0 con 0x55b84dbc6560 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 10 client.5757 handle_command_reply: tid=0 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 client.5757 shutdown 2024-09-10T23:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 -- 172.21.15.17:0/3438010172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 msgr2=0x55b84dc283d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dc283d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4017010 tx=0x7f0ee40234f0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 -- 172.21.15.17:0/3438010172 shutdown_connections 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b84dbc6560 0x55b84dbc6970 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b84dbadf10 0x55b84dc28910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b84dbad5f0 0x55b84dc283d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 --2- 172.21.15.17:0/3438010172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b84db61020 0x55b84dc27e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0edea00640 0 client.5757 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 -- 172.21.15.17:0/3438010172 >> 172.21.15.17:0/3438010172 conn(0x55b84db8e8c0 msgr2=0x55b84dbbeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 -- 172.21.15.17:0/3438010172 shutdown_connections 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 1 -- 172.21.15.17:0/3438010172 wait complete. 2024-09-10T23:19:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.133+0000 7f0f0353e000 20 client.5757 trim_cache size 0 max 16384 2024-09-10T23:19:22.147 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:22.147 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:19:22.147 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "db1624da-5cab-4b28-a529-f4f91b115d8e", 2024-09-10T23:19:22.147 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:19:22.147 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 -- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ed8072610 msgr2=0x7f0ed8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ed8072610 0x7f0ed8074ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0ef815e150 tx=0x7f0ee4009040 comp rx=0 tx=0).stop 2024-09-10T23:19:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 -- 172.21.15.17:0/591901393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b5ce0 msgr2=0x7f0ef815e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b5ce0 0x7f0ef815e860 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00e7a0 tx=0x7f0eec00ec60 comp rx=0 tx=0).stop 2024-09-10T23:19:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 -- 172.21.15.17:0/591901393 shutdown_connections 2024-09-10T23:19:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ed8072610 0x7f0ed8074ad0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ef815bee0 0x7f0ef80b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0ef80b6120 0x7f0ef814abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 --2- 172.21.15.17:0/591901393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef80b5ce0 0x7f0ef815e860 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 -- 172.21.15.17:0/591901393 >> 172.21.15.17:0/591901393 conn(0x7f0ef80d0b80 msgr2=0x7f0ef815a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 -- 172.21.15.17:0/591901393 shutdown_connections 2024-09-10T23:19:22.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.137+0000 7f0f00200640 1 -- 172.21.15.17:0/591901393 wait complete. 2024-09-10T23:19:22.158 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': 'db1624da-5cab-4b28-a529-f4f91b115d8e', 'mode': 'asynchronous'}' 2024-09-10T23:19:22.159 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-09-10T23:19:22.159 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-10T23:19:22.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-10T23:19:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.301+0000 7f653d600640 1 -- 172.21.15.17:0/2389119366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815aa80 msgr2=0x7f653806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.301+0000 7f653d600640 1 --2- 172.21.15.17:0/2389119366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815aa80 0x7f653806e6f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6528009900 tx=0x7f652801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.301+0000 7f653d600640 1 -- 172.21.15.17:0/2389119366 shutdown_connections 2024-09-10T23:19:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.301+0000 7f653d600640 1 --2- 172.21.15.17:0/2389119366 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f653815e6d0 0x7f653815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.301+0000 7f653d600640 1 --2- 172.21.15.17:0/2389119366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815aa80 0x7f653806e6f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.301+0000 7f653d600640 1 -- 172.21.15.17:0/2389119366 >> 172.21.15.17:0/2389119366 conn(0x7f65380b17a0 msgr2=0x7f65380b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.301+0000 7f653d600640 1 -- 172.21.15.17:0/2389119366 shutdown_connections 2024-09-10T23:19:22.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.301+0000 7f653d600640 1 -- 172.21.15.17:0/2389119366 wait complete. 2024-09-10T23:19:22.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f653d600640 1 Processor -- start 2024-09-10T23:19:22.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f653d600640 1 -- start start 2024-09-10T23:19:22.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f653d600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f653815aa80 0x7f653813deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f653d600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f653815e6d0 0x7f6538160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f653d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815f050 0x7f6538162a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f653d600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6538167bf0 con 0x7f653815f050 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f653d600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6538167a70 con 0x7f653815e6d0 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f653d600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6538167d70 con 0x7f653815aa80 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6536a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f653815aa80 0x7f653813deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6537400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815f050 0x7f6538162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6537400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815f050 0x7f6538162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37474/0 (socket says 172.21.15.17:37474) 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6537400640 1 -- 172.21.15.17:0/2237694170 learned_addr learned my addr 172.21.15.17:0/2237694170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6536a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f653815aa80 0x7f653813deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:39284/0 (socket says 172.21.15.17:39284) 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f652fe00640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f653815e6d0 0x7f6538160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6537400640 1 -- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f653815aa80 msgr2=0x7f653813deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6537400640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f653815aa80 0x7f653813deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6537400640 1 -- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f653815e6d0 msgr2=0x7f6538160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6537400640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f653815e6d0 0x7f6538160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6537400640 1 -- 172.21.15.17:0/2237694170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6538155170 con 0x7f653815f050 2024-09-10T23:19:22.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.305+0000 7f6537400640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815f050 0x7f6538162a50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f653000c730 tx=0x7f653000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.309+0000 7f652ea00640 1 -- 172.21.15.17:0/2237694170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530003b80 con 0x7f653815f050 2024-09-10T23:19:22.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.309+0000 7f653d600640 1 -- 172.21.15.17:0/2237694170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6538155450 con 0x7f653815f050 2024-09-10T23:19:22.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.309+0000 7f653d600640 1 -- 172.21.15.17:0/2237694170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6538154e80 con 0x7f653815f050 2024-09-10T23:19:22.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.309+0000 7f652ea00640 1 -- 172.21.15.17:0/2237694170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6530005070 con 0x7f653815f050 2024-09-10T23:19:22.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.309+0000 7f652ea00640 1 -- 172.21.15.17:0/2237694170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530005440 con 0x7f653815f050 2024-09-10T23:19:22.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.309+0000 7f652ea00640 1 -- 172.21.15.17:0/2237694170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f65300055e0 con 0x7f653815f050 2024-09-10T23:19:22.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 Processor -- start 2024-09-10T23:19:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 -- start start 2024-09-10T23:19:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652ea00640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65140725e0 0x7f6514074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652ea00640 1 -- 172.21.15.17:0/2237694170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f6530093300 con 0x7f653815f050 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65140725e0 0x7f6514074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6a0f0 0x562aefc6a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc204b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 0x562aefc20dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562aefa7bc20 con 0x562aefc6aa10 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562aefa6b050 con 0x562aefc209f0 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562aefa6ee60 con 0x562aefc6a0f0 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc204b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc204b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37476/0 (socket says 172.21.15.17:37476) 2024-09-10T23:19:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 -- 172.21.15.17:0/2957011817 learned_addr learned my addr 172.21.15.17:0/2957011817 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6537400640 1 --2- 172.21.15.17:0/2957011817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 0x562aefc20dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6536a00640 1 --2- 172.21.15.17:0/2957011817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6a0f0 0x562aefc6a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65140725e0 0x7f6514074aa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6538144d90 tx=0x7f6520011440 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 -- 172.21.15.17:0/2957011817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6a0f0 msgr2=0x562aefc6a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 --2- 172.21.15.17:0/2957011817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6a0f0 0x562aefc6a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 -- 172.21.15.17:0/2957011817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 msgr2=0x562aefc20dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 --2- 172.21.15.17:0/2957011817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 0x562aefc20dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 -- 172.21.15.17:0/2957011817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aef9eb770 con 0x562aefc6aa10 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f652fe00640 1 --2- 172.21.15.17:0/2957011817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc204b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f652001d470 tx=0x7f652001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900a5bc5eff73887 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6527400640 1 -- 172.21.15.17:0/2957011817 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520017040 con 0x562aefc6aa10 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6527400640 1 -- 172.21.15.17:0/2957011817 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6520019050 con 0x562aefc6aa10 2024-09-10T23:19:22.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6527400640 1 -- 172.21.15.17:0/2957011817 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520004220 con 0x562aefc6aa10 2024-09-10T23:19:22.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 -- 172.21.15.17:0/2957011817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 msgr2=0x562aefc204b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 --2- 172.21.15.17:0/2957011817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc204b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f652001d470 tx=0x7f652001c000 comp rx=0 tx=0).stop 2024-09-10T23:19:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 -- 172.21.15.17:0/2957011817 shutdown_connections 2024-09-10T23:19:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 --2- 172.21.15.17:0/2957011817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 0x562aefc20dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 --2- 172.21.15.17:0/2957011817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc204b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 --2- 172.21.15.17:0/2957011817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6a0f0 0x562aefc6a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 -- 172.21.15.17:0/2957011817 >> 172.21.15.17:0/2957011817 conn(0x562aefb08630 msgr2=0x562aefc27470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 -- 172.21.15.17:0/2957011817 shutdown_connections 2024-09-10T23:19:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.313+0000 7f6540930000 1 -- 172.21.15.17:0/2957011817 wait complete. 2024-09-10T23:19:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 -- start start 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 Processor -- start 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 0x562aefc69ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6a0f0 0x562aefc25bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc26130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562aefa10560 con 0x562aefc6aa10 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562aefa209e0 con 0x562aefc6a0f0 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562aefb25a00 con 0x562aefc209f0 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 10 client.0 _ll_register_callbacks cb 0x562aefc0ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6537400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc26130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6536a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 0x562aefc69ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f652fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6a0f0 0x562aefc25bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6537400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc26130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37480/0 (socket says 172.21.15.17:37480) 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6537400640 1 -- 172.21.15.17:0/3118124067 learned_addr learned my addr 172.21.15.17:0/3118124067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6537400640 1 -- 172.21.15.17:0/3118124067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 msgr2=0x562aefc69ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6537400640 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 0x562aefc69ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6537400640 1 -- 172.21.15.17:0/3118124067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6a0f0 msgr2=0x562aefc25bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6537400640 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6a0f0 0x562aefc25bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6537400640 1 -- 172.21.15.17:0/3118124067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aefa26f40 con 0x562aefc6aa10 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6537400640 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc26130 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f653000a430 tx=0x7f653005dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83bf4664f67913d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f651be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f651be00640 1 -- 172.21.15.17:0/3118124067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530062b80 con 0x562aefc6aa10 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f651be00640 1 -- 172.21.15.17:0/3118124067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f653001cc70 con 0x562aefc6aa10 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 -- 172.21.15.17:0/3118124067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562aefa03370 con 0x562aefc6aa10 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f651be00640 1 -- 172.21.15.17:0/3118124067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f653001ce70 con 0x562aefc6aa10 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 10 client.5772 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 -- 172.21.15.17:0/3118124067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x562aefa09230 con 0x562aefc6aa10 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f651be00640 1 -- 172.21.15.17:0/3118124067 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562aefa03370 con 0x562aefc6aa10 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f651be00640 1 -- 172.21.15.17:0/3118124067 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f653007f0d0 con 0x562aefc6aa10 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 10 client.5772 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 10 client.5772 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 20 client.5772 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562aefc6b860 0x562aefc7fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 4 client.5772 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6540930000 1 -- 172.21.15.17:0/3118124067 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aefa7db70 con 0x562aefc6b860 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6536a00640 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562aefc6b860 0x562aefc7fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f6536a00640 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562aefc6b860 0x562aefc7fa90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b08939d74060a79 server_cookie=54496d54702d34fb in_seq=0 out_seq=0 2024-09-10T23:19:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.317+0000 7f651be00640 10 client.5772 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f651be00640 1 -- 172.21.15.17:0/3118124067 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562aefa7db70 con 0x562aefc6b860 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f651be00640 10 client.5772 handle_command_reply: tid=0 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 client.5772 shutdown 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 -- 172.21.15.17:0/3118124067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 msgr2=0x562aefc26130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc26130 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f653000a430 tx=0x7f653005dc60 comp rx=0 tx=0).stop 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 -- 172.21.15.17:0/3118124067 shutdown_connections 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562aefc6b860 0x562aefc7fa90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6aa10 0x562aefc26130 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6a0f0 0x562aefc25bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 --2- 172.21.15.17:0/3118124067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 0x562aefc69ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f651be00640 0 client.5772 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 -- 172.21.15.17:0/3118124067 >> 172.21.15.17:0/3118124067 conn(0x562aefb08630 msgr2=0x562aefc1f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 -- 172.21.15.17:0/3118124067 shutdown_connections 2024-09-10T23:19:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 1 -- 172.21.15.17:0/3118124067 wait complete. 2024-09-10T23:19:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.321+0000 7f6540930000 20 client.5772 trim_cache size 0 max 16384 2024-09-10T23:19:22.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 Processor -- start 2024-09-10T23:19:22.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 -- start start 2024-09-10T23:19:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 0x562aefce0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6aa10 0x562aefce1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f651000bf40 con 0x562aefc6a0f0 2024-09-10T23:19:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f651000b200 con 0x562aefc6aa10 2024-09-10T23:19:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f651000b870 con 0x562aefc209f0 2024-09-10T23:19:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f652fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f652fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37492/0 (socket says 172.21.15.17:37492) 2024-09-10T23:19:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f652fe00640 1 -- 172.21.15.17:0/1623477122 learned_addr learned my addr 172.21.15.17:0/1623477122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6536a00640 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 0x562aefce0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6537400640 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6aa10 0x562aefce1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f652fe00640 1 -- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 msgr2=0x562aefce0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f652fe00640 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 0x562aefce0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f652fe00640 1 -- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6aa10 msgr2=0x562aefce1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f652fe00640 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6aa10 0x562aefce1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f652fe00640 1 -- 172.21.15.17:0/1623477122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aefa21430 con 0x562aefc6a0f0 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6536a00640 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 0x562aefce0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6537400640 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6aa10 0x562aefce1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f652fe00640 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce1330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x562aefa24840 tx=0x7f65200046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22ee8ebe2c390b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6526a00640 1 -- 172.21.15.17:0/1623477122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520017040 con 0x562aefc6a0f0 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6526a00640 1 -- 172.21.15.17:0/1623477122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f652001ddb0 con 0x562aefc6a0f0 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6526a00640 1 -- 172.21.15.17:0/1623477122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520004020 con 0x562aefc6a0f0 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 -- 172.21.15.17:0/1623477122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 msgr2=0x562aefce1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce1330 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x562aefa24840 tx=0x7f65200046d0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 -- 172.21.15.17:0/1623477122 shutdown_connections 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc6aa10 0x562aefce1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce1330 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 --2- 172.21.15.17:0/1623477122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc209f0 0x562aefce0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 -- 172.21.15.17:0/1623477122 >> 172.21.15.17:0/1623477122 conn(0x562aefb08630 msgr2=0x562aefc24f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 -- 172.21.15.17:0/1623477122 shutdown_connections 2024-09-10T23:19:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.337+0000 7f6540930000 1 -- 172.21.15.17:0/1623477122 wait complete. 2024-09-10T23:19:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 -- start start 2024-09-10T23:19:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 Processor -- start 2024-09-10T23:19:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 0x562aefce4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6aa10 0x562aefce58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562aefa1fcf0 con 0x562aefc6a0f0 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562aefa160b0 con 0x562aefc209f0 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562aefa6e170 con 0x562aefc6aa10 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 10 client.0 _ll_register_callbacks cb 0x7f653005a0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f652fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f652fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37494/0 (socket says 172.21.15.17:37494) 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f652fe00640 1 -- 172.21.15.17:0/572520769 learned_addr learned my addr 172.21.15.17:0/572520769 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6537400640 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6aa10 0x562aefce58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6536a00640 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 0x562aefce4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f652fe00640 1 -- 172.21.15.17:0/572520769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6aa10 msgr2=0x562aefce58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f652fe00640 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6aa10 0x562aefce58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f652fe00640 1 -- 172.21.15.17:0/572520769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 msgr2=0x562aefce4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f652fe00640 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 0x562aefce4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f652fe00640 1 -- 172.21.15.17:0/572520769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aefaf0e40 con 0x562aefc6a0f0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f652fe00640 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce5370 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x562aefa4aff0 tx=0x7f65200309e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdcd63077738d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f651be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f651be00640 1 -- 172.21.15.17:0/572520769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520015070 con 0x562aefc6a0f0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f651be00640 1 -- 172.21.15.17:0/572520769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f6520009040 con 0x562aefc6a0f0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 -- 172.21.15.17:0/572520769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f652001ddb0 con 0x562aefc6a0f0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f651be00640 1 -- 172.21.15.17:0/572520769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f652003f050 con 0x562aefc6a0f0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 10 client.5778 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 -- 172.21.15.17:0/572520769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x562aefac82b0 con 0x562aefc6a0f0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f651be00640 1 -- 172.21.15.17:0/572520769 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f652001ddb0 con 0x562aefc6a0f0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f651be00640 1 -- 172.21.15.17:0/572520769 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f6520042020 con 0x562aefc6a0f0 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 10 client.5778 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 10 client.5778 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 20 client.5778 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562aefc79a00 0x562aefc79e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 4 client.5778 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6540930000 1 -- 172.21.15.17:0/572520769 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x562aefa79620 con 0x562aefc79a00 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6536a00640 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562aefc79a00 0x562aefc79e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f6536a00640 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562aefc79a00 0x562aefc79e10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df0eaf527df95aa3 server_cookie=6039511ca514b2af in_seq=0 out_seq=0 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.341+0000 7f651be00640 10 client.5778 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f651be00640 1 -- 172.21.15.17:0/572520769 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562aefa79620 con 0x562aefc79a00 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f651be00640 10 client.5778 handle_command_reply: tid=0 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 client.5778 shutdown 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 -- 172.21.15.17:0/572520769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 msgr2=0x562aefce5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce5370 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x562aefa4aff0 tx=0x7f65200309e0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 -- 172.21.15.17:0/572520769 shutdown_connections 2024-09-10T23:19:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562aefc79a00 0x562aefc79e10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562aefc6aa10 0x562aefce58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562aefc6a0f0 0x562aefce5370 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 --2- 172.21.15.17:0/572520769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562aefc209f0 0x562aefce4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f651be00640 0 client.5778 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 -- 172.21.15.17:0/572520769 >> 172.21.15.17:0/572520769 conn(0x562aefb08630 msgr2=0x562aefc25690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 -- 172.21.15.17:0/572520769 shutdown_connections 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 1 -- 172.21.15.17:0/572520769 wait complete. 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f6540930000 20 client.5778 trim_cache size 0 max 16384 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:22.358 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:22.359 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:19:22.359 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 -- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65140725e0 msgr2=0x7f6514074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65140725e0 0x7f6514074aa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6538144d90 tx=0x7f6520011440 comp rx=0 tx=0).stop 2024-09-10T23:19:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 -- 172.21.15.17:0/2237694170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815f050 msgr2=0x7f6538162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815f050 0x7f6538162a50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f653000c730 tx=0x7f653000cbf0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 -- 172.21.15.17:0/2237694170 shutdown_connections 2024-09-10T23:19:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65140725e0 0x7f6514074aa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f653815f050 0x7f6538162a50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f653815e6d0 0x7f6538160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 --2- 172.21.15.17:0/2237694170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f653815aa80 0x7f653813deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 -- 172.21.15.17:0/2237694170 >> 172.21.15.17:0/2237694170 conn(0x7f65380b17a0 msgr2=0x7f653815dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 -- 172.21.15.17:0/2237694170 shutdown_connections 2024-09-10T23:19:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.345+0000 7f653d600640 1 -- 172.21.15.17:0/2237694170 wait complete. 2024-09-10T23:19:22.370 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-10T23:19:22.370 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-10T23:19:22.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-10T23:19:22.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.513+0000 7f4f21e00640 1 -- 172.21.15.17:0/1587915709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1c0b2540 msgr2=0x7f4f1c0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.513+0000 7f4f21e00640 1 --2- 172.21.15.17:0/1587915709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1c0b2540 0x7f4f1c0cc8b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009c80 tx=0x7f4f1401cda0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.513+0000 7f4f21e00640 1 -- 172.21.15.17:0/1587915709 shutdown_connections 2024-09-10T23:19:22.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.513+0000 7f4f21e00640 1 --2- 172.21.15.17:0/1587915709 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1c0b2540 0x7f4f1c0cc8b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.513+0000 7f4f21e00640 1 --2- 172.21.15.17:0/1587915709 >> v2:172.21.15.77:3300/0 conn(0x7f4f1c15f400 0x7f4f1c0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.513+0000 7f4f21e00640 1 -- 172.21.15.17:0/1587915709 >> 172.21.15.17:0/1587915709 conn(0x7f4f1c0d1da0 msgr2=0x7f4f1c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.513+0000 7f4f21e00640 1 -- 172.21.15.17:0/1587915709 shutdown_connections 2024-09-10T23:19:22.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.513+0000 7f4f21e00640 1 -- 172.21.15.17:0/1587915709 wait complete. 2024-09-10T23:19:22.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f21e00640 1 Processor -- start 2024-09-10T23:19:22.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f21e00640 1 -- start start 2024-09-10T23:19:22.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f21e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f1c0b2540 0x7f4f1c14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f21e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1c0b31b0 0x7f4f1c0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f21e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1c15f400 0x7f4f1c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f21e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c168c60 con 0x7f4f1c0b31b0 2024-09-10T23:19:22.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f21e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c0cdbc0 con 0x7f4f1c0b2540 2024-09-10T23:19:22.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f21e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1c168de0 con 0x7f4f1c15f400 2024-09-10T23:19:22.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1c0b31b0 0x7f4f1c0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f1aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f1c0b2540 0x7f4f1c14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1c0b31b0 0x7f4f1c0afc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37502/0 (socket says 172.21.15.17:37502) 2024-09-10T23:19:22.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13e00640 1 -- 172.21.15.17:0/2923683889 learned_addr learned my addr 172.21.15.17:0/2923683889 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f1b400640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1c15f400 0x7f4f1c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13e00640 1 -- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1c15f400 msgr2=0x7f4f1c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13e00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1c15f400 0x7f4f1c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13e00640 1 -- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f1c0b2540 msgr2=0x7f4f1c14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13e00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f1c0b2540 0x7f4f1c14d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13e00640 1 -- 172.21.15.17:0/2923683889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1c14d770 con 0x7f4f1c0b31b0 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13e00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1c0b31b0 0x7f4f1c0afc30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400c4d0 tx=0x7f4f0400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.517+0000 7f4f13400640 1 -- 172.21.15.17:0/2923683889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f040052d0 con 0x7f4f1c0b31b0 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f13400640 1 -- 172.21.15.17:0/2923683889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f04005470 con 0x7f4f1c0b31b0 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f21e00640 1 -- 172.21.15.17:0/2923683889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1c0c80c0 con 0x7f4f1c0b31b0 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f13400640 1 -- 172.21.15.17:0/2923683889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04012890 con 0x7f4f1c0b31b0 2024-09-10T23:19:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f21e00640 1 -- 172.21.15.17:0/2923683889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1c0c8680 con 0x7f4f1c0b31b0 2024-09-10T23:19:22.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f13400640 1 -- 172.21.15.17:0/2923683889 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4f04003600 con 0x7f4f1c0b31b0 2024-09-10T23:19:22.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f13400640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef80725e0 0x7f4ef8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f13400640 1 -- 172.21.15.17:0/2923683889 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f4f04092e10 con 0x7f4f1c0b31b0 2024-09-10T23:19:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f25157000 1 Processor -- start 2024-09-10T23:19:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f25157000 1 -- start start 2024-09-10T23:19:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.521+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef80725e0 0x7f4ef8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 0x55bfea69d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d9f0 0x55bfea653490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea6539d0 0x55bfea653db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bfea4aec00 con 0x55bfea6539d0 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bfea49e030 con 0x55bfea69d0d0 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55bfea4a1e40 con 0x55bfea69d9f0 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef80725e0 0x7f4ef8074aa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c15d870 tx=0x7f4f0c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea6539d0 0x55bfea653db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea6539d0 0x55bfea653db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37506/0 (socket says 172.21.15.17:37506) 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1b400640 1 -- 172.21.15.17:0/1939162211 learned_addr learned my addr 172.21.15.17:0/1939162211 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/1939162211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 0x55bfea69d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f13e00640 1 --2- 172.21.15.17:0/1939162211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d9f0 0x55bfea653490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1b400640 1 -- 172.21.15.17:0/1939162211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d9f0 msgr2=0x55bfea653490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1b400640 1 --2- 172.21.15.17:0/1939162211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d9f0 0x55bfea653490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1b400640 1 -- 172.21.15.17:0/1939162211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 msgr2=0x55bfea69d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1b400640 1 --2- 172.21.15.17:0/1939162211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 0x55bfea69d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1b400640 1 -- 172.21.15.17:0/1939162211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfea41e750 con 0x55bfea6539d0 2024-09-10T23:19:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f1b400640 1 --2- 172.21.15.17:0/1939162211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea6539d0 0x55bfea653db0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009bd0 tx=0x7f4f14019b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ab0d9f196c08c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f0be00640 1 -- 172.21.15.17:0/1939162211 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f140b2040 con 0x55bfea6539d0 2024-09-10T23:19:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f0be00640 1 -- 172.21.15.17:0/1939162211 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f14004a50 con 0x55bfea6539d0 2024-09-10T23:19:22.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f0be00640 1 -- 172.21.15.17:0/1939162211 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14003980 con 0x55bfea6539d0 2024-09-10T23:19:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 -- 172.21.15.17:0/1939162211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea6539d0 msgr2=0x55bfea653db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 --2- 172.21.15.17:0/1939162211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea6539d0 0x55bfea653db0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009bd0 tx=0x7f4f14019b40 comp rx=0 tx=0).stop 2024-09-10T23:19:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 -- 172.21.15.17:0/1939162211 shutdown_connections 2024-09-10T23:19:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 --2- 172.21.15.17:0/1939162211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea6539d0 0x55bfea653db0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 --2- 172.21.15.17:0/1939162211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d9f0 0x55bfea653490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 --2- 172.21.15.17:0/1939162211 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 0x55bfea69d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 -- 172.21.15.17:0/1939162211 >> 172.21.15.17:0/1939162211 conn(0x55bfea53b610 msgr2=0x55bfea65a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 -- 172.21.15.17:0/1939162211 shutdown_connections 2024-09-10T23:19:22.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 -- 172.21.15.17:0/1939162211 wait complete. 2024-09-10T23:19:22.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 -- start start 2024-09-10T23:19:22.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.525+0000 7f4f25157000 1 Processor -- start 2024-09-10T23:19:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 0x55bfea69c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d0d0 0x55bfea658560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d9f0 0x55bfea658aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bfea443540 con 0x55bfea69d0d0 2024-09-10T23:19:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bfea4539c0 con 0x55bfea69d9f0 2024-09-10T23:19:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55bfea5589e0 con 0x55bfea6539d0 2024-09-10T23:19:22.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 10 client.0 _ll_register_callbacks cb 0x55bfea63fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d0d0 0x55bfea658560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d0d0 0x55bfea658560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37522/0 (socket says 172.21.15.17:37522) 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f13e00640 1 -- 172.21.15.17:0/4073794045 learned_addr learned my addr 172.21.15.17:0/4073794045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 0x55bfea69c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f1b400640 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d9f0 0x55bfea658aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f13e00640 1 -- 172.21.15.17:0/4073794045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 msgr2=0x55bfea69c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f13e00640 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 0x55bfea69c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f13e00640 1 -- 172.21.15.17:0/4073794045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d9f0 msgr2=0x55bfea658aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f13e00640 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d9f0 0x55bfea658aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f13e00640 1 -- 172.21.15.17:0/4073794045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfea459f20 con 0x55bfea69d0d0 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f1b400640 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d9f0 0x55bfea658aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f13e00640 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d0d0 0x55bfea658560 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007fd0 tx=0x7f4f0405dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c44900da1b6801 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 1 -- 172.21.15.17:0/4073794045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0405d130 con 0x55bfea69d0d0 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 1 -- 172.21.15.17:0/4073794045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f4f04059620 con 0x55bfea69d0d0 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- 172.21.15.17:0/4073794045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bfea436350 con 0x55bfea69d0d0 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 1 -- 172.21.15.17:0/4073794045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f04090050 con 0x55bfea69d0d0 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 10 client.5787 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- 172.21.15.17:0/4073794045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55bfea43c210 con 0x55bfea69d0d0 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 1 -- 172.21.15.17:0/4073794045 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55bfea436350 con 0x55bfea69d0d0 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 1 -- 172.21.15.17:0/4073794045 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f4f04059820 con 0x55bfea69d0d0 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 10 client.5787 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 10 client.5787 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:22.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 20 client.5787 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55bfea65f150 0x55bfea65f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 4 client.5787 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- 172.21.15.17:0/4073794045 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfea4b0b50 con 0x55bfea65f150 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55bfea65f150 0x55bfea65f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 10 client.5787 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55bfea65f150 0x55bfea65f530 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b2232bed7dcd2e2 server_cookie=b8f4a7fb28b10c1c in_seq=0 out_seq=0 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 1 -- 172.21.15.17:0/4073794045 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfea4b0b50 con 0x55bfea65f150 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 10 client.5787 handle_command_reply: tid=0 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 client.5787 shutdown 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- 172.21.15.17:0/4073794045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d0d0 msgr2=0x55bfea658560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d0d0 0x55bfea658560 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007fd0 tx=0x7f4f0405dcd0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- 172.21.15.17:0/4073794045 shutdown_connections 2024-09-10T23:19:22.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55bfea65f150 0x55bfea65f530 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d9f0 0x55bfea658aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d0d0 0x55bfea658560 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 --2- 172.21.15.17:0/4073794045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 0x55bfea69c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f08c00640 0 client.5787 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- 172.21.15.17:0/4073794045 >> 172.21.15.17:0/4073794045 conn(0x55bfea53b610 msgr2=0x55bfea652480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- 172.21.15.17:0/4073794045 shutdown_connections 2024-09-10T23:19:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.529+0000 7f4f25157000 1 -- 172.21.15.17:0/4073794045 wait complete. 2024-09-10T23:19:22.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.533+0000 7f4f25157000 20 client.5787 trim_cache size 0 max 16384 2024-09-10T23:19:22.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f25157000 1 Processor -- start 2024-09-10T23:19:22.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f25157000 1 -- start start 2024-09-10T23:19:22.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f25157000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea53b610 0x55bfea70fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f25157000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea6539d0 0x55bfea7102d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f25157000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d0d0 0x55bfea710810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f25157000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c203560 con 0x55bfea53b610 2024-09-10T23:19:22.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f25157000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c0b5d50 con 0x55bfea6539d0 2024-09-10T23:19:22.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f25157000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1c0b6370 con 0x55bfea69d0d0 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea53b610 0x55bfea70fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea53b610 0x55bfea70fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37536/0 (socket says 172.21.15.17:37536) 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1aa00640 1 -- 172.21.15.17:0/3423846695 learned_addr learned my addr 172.21.15.17:0/3423846695 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1b400640 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d0d0 0x55bfea710810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f13e00640 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea6539d0 0x55bfea7102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1aa00640 1 -- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d0d0 msgr2=0x55bfea710810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d0d0 0x55bfea710810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1aa00640 1 -- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea6539d0 msgr2=0x55bfea7102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea6539d0 0x55bfea7102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1aa00640 1 -- 172.21.15.17:0/3423846695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfea454410 con 0x55bfea53b610 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f1b400640 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d0d0 0x55bfea710810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.549+0000 7f4f13e00640 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea6539d0 0x55bfea7102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:22.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea53b610 0x55bfea70fd90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009fd0 tx=0x7f4f0c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80444db007b55f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f0b400640 1 -- 172.21.15.17:0/3423846695 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c035070 con 0x55bfea53b610 2024-09-10T23:19:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f0b400640 1 -- 172.21.15.17:0/3423846695 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f0c003980 con 0x55bfea53b610 2024-09-10T23:19:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f0b400640 1 -- 172.21.15.17:0/3423846695 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c003db0 con 0x55bfea53b610 2024-09-10T23:19:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 -- 172.21.15.17:0/3423846695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea53b610 msgr2=0x55bfea70fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea53b610 0x55bfea70fd90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009fd0 tx=0x7f4f0c014000 comp rx=0 tx=0).stop 2024-09-10T23:19:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 -- 172.21.15.17:0/3423846695 shutdown_connections 2024-09-10T23:19:22.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea69d0d0 0x55bfea710810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea6539d0 0x55bfea7102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 --2- 172.21.15.17:0/3423846695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea53b610 0x55bfea70fd90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 -- 172.21.15.17:0/3423846695 >> 172.21.15.17:0/3423846695 conn(0x55bfea6530d0 msgr2=0x55bfea657f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 -- 172.21.15.17:0/3423846695 shutdown_connections 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 -- 172.21.15.17:0/3423846695 wait complete. 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 -- start start 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 Processor -- start 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 0x55bfea6b2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 0x55bfea6b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d9f0 0x55bfea6d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bfea452cd0 con 0x55bfea69d9f0 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bfea449090 con 0x55bfea69d0d0 2024-09-10T23:19:22.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55bfea4a1150 con 0x55bfea6539d0 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f25157000 10 client.0 _ll_register_callbacks cb 0x7f4f0405ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d9f0 0x55bfea6d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d9f0 0x55bfea6d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37550/0 (socket says 172.21.15.17:37550) 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1b400640 1 -- 172.21.15.17:0/2935942598 learned_addr learned my addr 172.21.15.17:0/2935942598 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f13e00640 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 0x55bfea6b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 0x55bfea6b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1b400640 1 -- 172.21.15.17:0/2935942598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 msgr2=0x55bfea6b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1b400640 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 0x55bfea6b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1b400640 1 -- 172.21.15.17:0/2935942598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 msgr2=0x55bfea6b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1b400640 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 0x55bfea6b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1b400640 1 -- 172.21.15.17:0/2935942598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfea523e20 con 0x55bfea69d9f0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f1b400640 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d9f0 0x55bfea6d0160 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4f1401c810 tx=0x7f4f14004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c263bb7939c77a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.553+0000 7f4f08c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f08c00640 1 -- 172.21.15.17:0/2935942598 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f140b2070 con 0x55bfea69d9f0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f08c00640 1 -- 172.21.15.17:0/2935942598 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f4f140a5b80 con 0x55bfea69d9f0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 -- 172.21.15.17:0/2935942598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f0c003980 con 0x55bfea69d9f0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f08c00640 1 -- 172.21.15.17:0/2935942598 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f140c8050 con 0x55bfea69d9f0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 10 client.5793 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 -- 172.21.15.17:0/2935942598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55bfea4fb290 con 0x55bfea69d9f0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f08c00640 1 -- 172.21.15.17:0/2935942598 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f0c003980 con 0x55bfea69d9f0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f08c00640 1 -- 172.21.15.17:0/2935942598 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f4f140cb020 con 0x55bfea69d9f0 2024-09-10T23:19:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 10 client.5793 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 10 client.5793 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 20 client.5793 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55bfea6d0b50 0x55bfea713bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 4 client.5793 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-10T23:19:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 -- 172.21.15.17:0/2935942598 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x55bfea4ac600 con 0x55bfea6d0b50 2024-09-10T23:19:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55bfea6d0b50 0x55bfea713bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f1aa00640 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55bfea6d0b50 0x55bfea713bc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed0fbc619401e9d server_cookie=1ba7771db05d26b1 in_seq=0 out_seq=0 2024-09-10T23:19:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f08c00640 10 client.5793 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f08c00640 1 -- 172.21.15.17:0/2935942598 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bfea4ac600 con 0x55bfea6d0b50 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f08c00640 10 client.5793 handle_command_reply: tid=0 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 client.5793 shutdown 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 -- 172.21.15.17:0/2935942598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d9f0 msgr2=0x55bfea6d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d9f0 0x55bfea6d0160 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4f1401c810 tx=0x7f4f14004e30 comp rx=0 tx=0).stop 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 -- 172.21.15.17:0/2935942598 shutdown_connections 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55bfea6d0b50 0x55bfea713bc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfea69d9f0 0x55bfea6d0160 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bfea69d0d0 0x55bfea6b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 --2- 172.21.15.17:0/2935942598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bfea6539d0 0x55bfea6b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 -- 172.21.15.17:0/2935942598 >> 172.21.15.17:0/2935942598 conn(0x55bfea6530d0 msgr2=0x55bfea658650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f08c00640 0 client.5793 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 -- 172.21.15.17:0/2935942598 shutdown_connections 2024-09-10T23:19:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 1 -- 172.21.15.17:0/2935942598 wait complete. 2024-09-10T23:19:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f25157000 20 client.5793 trim_cache size 0 max 16384 2024-09-10T23:19:22.568 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:22.568 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:19:22.568 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "e44aa676-1420-4803-a2af-66c72fe9179e", 2024-09-10T23:19:22.568 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:19:22.569 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 -- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef80725e0 msgr2=0x7f4ef8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef80725e0 0x7f4ef8074aa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c15d870 tx=0x7f4f0c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 -- 172.21.15.17:0/2923683889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1c0b31b0 msgr2=0x7f4f1c0afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1c0b31b0 0x7f4f1c0afc30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400c4d0 tx=0x7f4f0400c990 comp rx=0 tx=0).stop 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 -- 172.21.15.17:0/2923683889 shutdown_connections 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef80725e0 0x7f4ef8074aa0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1c15f400 0x7f4f1c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1c0b31b0 0x7f4f1c0afc30 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 --2- 172.21.15.17:0/2923683889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f1c0b2540 0x7f4f1c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 -- 172.21.15.17:0/2923683889 >> 172.21.15.17:0/2923683889 conn(0x7f4f1c0d1da0 msgr2=0x7f4f1c165fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 -- 172.21.15.17:0/2923683889 shutdown_connections 2024-09-10T23:19:22.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.557+0000 7f4f21e00640 1 -- 172.21.15.17:0/2923683889 wait complete. 2024-09-10T23:19:22.592 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'e44aa676-1420-4803-a2af-66c72fe9179e', 'mode': 'asynchronous'}' 2024-09-10T23:19:22.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:22.592 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-09-10T23:19:22.604 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-09-10T23:19:22.604 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-09-10T23:19:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 -- 172.21.15.17:0/2717303625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e5415bca0 msgr2=0x7f1e540b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 --2- 172.21.15.17:0/2717303625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e5415bca0 0x7f1e540b29d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009840 tx=0x7f1e3c01c7f0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 -- 172.21.15.17:0/2717303625 shutdown_connections 2024-09-10T23:19:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 --2- 172.21.15.17:0/2717303625 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e540b2f10 0x7f1e541654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 --2- 172.21.15.17:0/2717303625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e5415bca0 0x7f1e540b29d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 -- 172.21.15.17:0/2717303625 >> 172.21.15.17:0/2717303625 conn(0x7f1e5409a9f0 msgr2=0x7f1e5409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 -- 172.21.15.17:0/2717303625 shutdown_connections 2024-09-10T23:19:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 -- 172.21.15.17:0/2717303625 wait complete. 2024-09-10T23:19:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 Processor -- start 2024-09-10T23:19:22.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 -- start start 2024-09-10T23:19:22.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e540b2f10 0x7f1e541f7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5415b8c0 0x7f1e540cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e5415bca0 0x7f1e5415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1e54168710 con 0x7f1e5415b8c0 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e54168590 con 0x7f1e540b2f10 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e53200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e54168890 con 0x7f1e5415bca0 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5415b8c0 0x7f1e540cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5415b8c0 0x7f1e540cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37566/0 (socket says 172.21.15.17:37566) 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e49400640 1 -- 172.21.15.17:0/1676367595 learned_addr learned my addr 172.21.15.17:0/1676367595 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e52800640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e5415bca0 0x7f1e5415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e51e00640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e540b2f10 0x7f1e541f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e49400640 1 -- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e5415bca0 msgr2=0x7f1e5415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e49400640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e5415bca0 0x7f1e5415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e49400640 1 -- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e540b2f10 msgr2=0x7f1e541f7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e49400640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e540b2f10 0x7f1e541f7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e49400640 1 -- 172.21.15.17:0/1676367595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e541f7ed0 con 0x7f1e5415b8c0 2024-09-10T23:19:22.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e52800640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e5415bca0 0x7f1e5415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:22.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.793+0000 7f1e51e00640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e540b2f10 0x7f1e541f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:22.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.797+0000 7f1e49400640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5415b8c0 0x7f1e540cb7f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009790 tx=0x7f1e3c0a57a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.797+0000 7f1e4aa00640 1 -- 172.21.15.17:0/1676367595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0b2040 con 0x7f1e5415b8c0 2024-09-10T23:19:22.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.797+0000 7f1e4aa00640 1 -- 172.21.15.17:0/1676367595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3c005020 con 0x7f1e5415b8c0 2024-09-10T23:19:22.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.797+0000 7f1e53200640 1 -- 172.21.15.17:0/1676367595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e541f81b0 con 0x7f1e5415b8c0 2024-09-10T23:19:22.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.797+0000 7f1e4aa00640 1 -- 172.21.15.17:0/1676367595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0044f0 con 0x7f1e5415b8c0 2024-09-10T23:19:22.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.797+0000 7f1e53200640 1 -- 172.21.15.17:0/1676367595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e541f8770 con 0x7f1e5415b8c0 2024-09-10T23:19:22.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.797+0000 7f1e4aa00640 1 -- 172.21.15.17:0/1676367595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1e3c0b5070 con 0x7f1e5415b8c0 2024-09-10T23:19:22.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e4aa00640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e300725e0 0x7f1e30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 Processor -- start 2024-09-10T23:19:22.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e4aa00640 1 -- 172.21.15.17:0/1676367595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f1e3c12cbc0 con 0x7f1e5415b8c0 2024-09-10T23:19:22.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 -- start start 2024-09-10T23:19:22.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e51e00640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e300725e0 0x7f1e30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 0x55ea42c2cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42be3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea42a3ed90 con 0x55ea42c2d4d0 2024-09-10T23:19:22.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ea42a2e1c0 con 0x55ea42be3af0 2024-09-10T23:19:22.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ea42a31fd0 con 0x55ea42c2cbb0 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e51e00640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e300725e0 0x7f1e30074aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1e440016d0 tx=0x7f1e44009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37570/0 (socket says 172.21.15.17:37570) 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e49400640 1 -- 172.21.15.17:0/2793117475 learned_addr learned my addr 172.21.15.17:0/2793117475 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e51e00640 1 --2- 172.21.15.17:0/2793117475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 0x55ea42c2cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e52800640 1 --2- 172.21.15.17:0/2793117475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42be3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e49400640 1 -- 172.21.15.17:0/2793117475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 msgr2=0x55ea42c2cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e49400640 1 --2- 172.21.15.17:0/2793117475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 0x55ea42c2cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e49400640 1 -- 172.21.15.17:0/2793117475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 msgr2=0x55ea42be3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e49400640 1 --2- 172.21.15.17:0/2793117475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42be3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e49400640 1 -- 172.21.15.17:0/2793117475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea429e14c0 con 0x55ea42c2d4d0 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e49400640 1 --2- 172.21.15.17:0/2793117475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be35b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0b0040 tx=0x7f1e3c0f7170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cb12a6d7414ee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e42a00640 1 -- 172.21.15.17:0/2793117475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0f7940 con 0x55ea42c2d4d0 2024-09-10T23:19:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e42a00640 1 -- 172.21.15.17:0/2793117475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3c0fc070 con 0x55ea42c2d4d0 2024-09-10T23:19:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e42a00640 1 -- 172.21.15.17:0/2793117475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0fc420 con 0x55ea42c2d4d0 2024-09-10T23:19:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 -- 172.21.15.17:0/2793117475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 msgr2=0x55ea42be35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 --2- 172.21.15.17:0/2793117475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be35b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0b0040 tx=0x7f1e3c0f7170 comp rx=0 tx=0).stop 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 -- 172.21.15.17:0/2793117475 shutdown_connections 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 --2- 172.21.15.17:0/2793117475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42be3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 --2- 172.21.15.17:0/2793117475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be35b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 --2- 172.21.15.17:0/2793117475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 0x55ea42c2cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 -- 172.21.15.17:0/2793117475 >> 172.21.15.17:0/2793117475 conn(0x55ea42bdfaa0 msgr2=0x55ea42be1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 -- 172.21.15.17:0/2793117475 shutdown_connections 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.801+0000 7f1e5c180000 1 -- 172.21.15.17:0/2793117475 wait complete. 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 -- start start 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 Processor -- start 2024-09-10T23:19:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42c17680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 0x55ea42be8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea429d2290 con 0x55ea42c2d4d0 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ea429f7ca0 con 0x55ea42be3af0 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ea42a3db60 con 0x55ea42c2cbb0 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 10 client.0 _ll_register_callbacks cb 0x55ea42bce4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e52800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e52800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37574/0 (socket says 172.21.15.17:37574) 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e52800640 1 -- 172.21.15.17:0/626792145 learned_addr learned my addr 172.21.15.17:0/626792145 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e51e00640 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42c17680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e49400640 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 0x55ea42be8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e52800640 1 -- 172.21.15.17:0/626792145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 msgr2=0x55ea42be8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e52800640 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 0x55ea42be8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e52800640 1 -- 172.21.15.17:0/626792145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 msgr2=0x55ea42c17680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e52800640 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42c17680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e52800640 1 -- 172.21.15.17:0/626792145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea429aeae0 con 0x55ea42c2d4d0 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e52800640 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be8fa0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c010ec0 tx=0x7f1e4c00e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97f8982623e52b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e37400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e37400640 1 -- 172.21.15.17:0/626792145 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c009df0 con 0x55ea42c2d4d0 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e37400640 1 -- 172.21.15.17:0/626792145 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f1e4c0193f0 con 0x55ea42c2d4d0 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 -- 172.21.15.17:0/626792145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ea429c6530 con 0x55ea42c2d4d0 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e37400640 1 -- 172.21.15.17:0/626792145 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1e4c025050 con 0x55ea42c2d4d0 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 10 client.5802 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 -- 172.21.15.17:0/626792145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55ea429ea100 con 0x55ea42c2d4d0 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e37400640 1 -- 172.21.15.17:0/626792145 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ea429c6530 con 0x55ea42c2d4d0 2024-09-10T23:19:22.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e37400640 1 -- 172.21.15.17:0/626792145 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f1e4c028020 con 0x55ea42c2d4d0 2024-09-10T23:19:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 10 client.5802 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 10 client.5802 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 20 client.5802 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ea42c18650 0x55ea42c3ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 4 client.5802 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.805+0000 7f1e5c180000 1 -- 172.21.15.17:0/626792145 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea42a40ce0 con 0x55ea42c18650 2024-09-10T23:19:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e51e00640 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ea42c18650 0x55ea42c3ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e51e00640 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ea42c18650 0x55ea42c3ee70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=935f961603710712 server_cookie=76c38002df064bef in_seq=0 out_seq=0 2024-09-10T23:19:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e37400640 10 client.5802 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e37400640 1 -- 172.21.15.17:0/626792145 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea42a40ce0 con 0x55ea42c18650 2024-09-10T23:19:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e37400640 10 client.5802 handle_command_reply: tid=0 2024-09-10T23:19:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 client.5802 shutdown 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 -- 172.21.15.17:0/626792145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 msgr2=0x55ea42be8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be8fa0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c010ec0 tx=0x7f1e4c00e7c0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 -- 172.21.15.17:0/626792145 shutdown_connections 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ea42c18650 0x55ea42c3ee70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2d4d0 0x55ea42be8fa0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2cbb0 0x55ea42be8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 --2- 172.21.15.17:0/626792145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42c17680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 -- 172.21.15.17:0/626792145 >> 172.21.15.17:0/626792145 conn(0x55ea42bdfaa0 msgr2=0x55ea42be26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e37400640 0 client.5802 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 -- 172.21.15.17:0/626792145 shutdown_connections 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 1 -- 172.21.15.17:0/626792145 wait complete. 2024-09-10T23:19:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.809+0000 7f1e5c180000 20 client.5802 trim_cache size 0 max 16384 2024-09-10T23:19:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 Processor -- start 2024-09-10T23:19:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 -- start start 2024-09-10T23:19:22.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42c9f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2cbb0 0x55ea42c9fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 0x55ea42ca0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1e542032f0 con 0x55ea42c2cbb0 2024-09-10T23:19:22.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e540caf90 con 0x55ea42be3af0 2024-09-10T23:19:22.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e541fbb30 con 0x55ea42c2d4d0 2024-09-10T23:19:22.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2cbb0 0x55ea42c9fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2cbb0 0x55ea42c9fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37588/0 (socket says 172.21.15.17:37588) 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e49400640 1 -- 172.21.15.17:0/773915412 learned_addr learned my addr 172.21.15.17:0/773915412 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e52800640 1 --2- 172.21.15.17:0/773915412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 0x55ea42ca0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e51e00640 1 --2- 172.21.15.17:0/773915412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42c9f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e49400640 1 -- 172.21.15.17:0/773915412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 msgr2=0x55ea42ca0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e49400640 1 --2- 172.21.15.17:0/773915412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 0x55ea42ca0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e49400640 1 -- 172.21.15.17:0/773915412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 msgr2=0x55ea42c9f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e49400640 1 --2- 172.21.15.17:0/773915412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42c9f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e49400640 1 -- 172.21.15.17:0/773915412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea429cc3f0 con 0x55ea42c2cbb0 2024-09-10T23:19:22.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e49400640 1 --2- 172.21.15.17:0/773915412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2cbb0 0x55ea42c9fee0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009840 tx=0x7f1e3c12ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0a1d64c7f89334 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e42000640 1 -- 172.21.15.17:0/773915412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0f3f90 con 0x55ea42c2cbb0 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e42000640 1 -- 172.21.15.17:0/773915412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3c0fc040 con 0x55ea42c2cbb0 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e42000640 1 -- 172.21.15.17:0/773915412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0fc420 con 0x55ea42c2cbb0 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 -- 172.21.15.17:0/773915412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2cbb0 msgr2=0x55ea42c9fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 --2- 172.21.15.17:0/773915412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2cbb0 0x55ea42c9fee0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009840 tx=0x7f1e3c12ad60 comp rx=0 tx=0).stop 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 -- 172.21.15.17:0/773915412 shutdown_connections 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 --2- 172.21.15.17:0/773915412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 0x55ea42ca0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 --2- 172.21.15.17:0/773915412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42c2cbb0 0x55ea42c9fee0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 --2- 172.21.15.17:0/773915412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42be3af0 0x55ea42c9f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 -- 172.21.15.17:0/773915412 >> 172.21.15.17:0/773915412 conn(0x55ea42bdfaa0 msgr2=0x55ea42be2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 -- 172.21.15.17:0/773915412 shutdown_connections 2024-09-10T23:19:22.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.825+0000 7f1e5c180000 1 -- 172.21.15.17:0/773915412 wait complete. 2024-09-10T23:19:22.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 -- start start 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 Processor -- start 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42be3af0 0x55ea42ca01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42c2cbb0 0x55ea42c43240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 0x55ea42c43780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ea429fa270 con 0x55ea42be3af0 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ea429ed980 con 0x55ea42c2cbb0 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ea42a312e0 con 0x55ea42c2d4d0 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 10 client.0 _ll_register_callbacks cb 0x7f1e4c0099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e51e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42be3af0 0x55ea42ca01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e51e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42be3af0 0x55ea42ca01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37596/0 (socket says 172.21.15.17:37596) 2024-09-10T23:19:22.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e51e00640 1 -- 172.21.15.17:0/1411943389 learned_addr learned my addr 172.21.15.17:0/1411943389 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e52800640 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 0x55ea42c43780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e49400640 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42c2cbb0 0x55ea42c43240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e51e00640 1 -- 172.21.15.17:0/1411943389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 msgr2=0x55ea42c43780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e51e00640 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 0x55ea42c43780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e51e00640 1 -- 172.21.15.17:0/1411943389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42c2cbb0 msgr2=0x55ea42c43240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e51e00640 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42c2cbb0 0x55ea42c43240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e51e00640 1 -- 172.21.15.17:0/1411943389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea42a8b070 con 0x55ea42be3af0 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e49400640 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42c2cbb0 0x55ea42c43240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e51e00640 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42be3af0 0x55ea42ca01e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400de00 tx=0x7f1e44000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef94023dfe25b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e37400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e37400640 1 -- 172.21.15.17:0/1411943389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44007040 con 0x55ea42be3af0 2024-09-10T23:19:22.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e37400640 1 -- 172.21.15.17:0/1411943389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f1e44030c70 con 0x55ea42be3af0 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 -- 172.21.15.17:0/1411943389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3c0fc040 con 0x55ea42be3af0 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e37400640 1 -- 172.21.15.17:0/1411943389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1e440071e0 con 0x55ea42be3af0 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 10 client.5808 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 -- 172.21.15.17:0/1411943389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55ea429c47b0 con 0x55ea42be3af0 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e37400640 1 -- 172.21.15.17:0/1411943389 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3c0fc040 con 0x55ea42be3af0 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e37400640 1 -- 172.21.15.17:0/1411943389 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f1e44007380 con 0x55ea42be3af0 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 10 client.5808 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 10 client.5808 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 20 client.5808 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ea42c5f390 0x55ea42c5f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 4 client.5808 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-09-10T23:19:22.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e5c180000 1 -- 172.21.15.17:0/1411943389 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x55ea42a3c790 con 0x55ea42c5f390 2024-09-10T23:19:22.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.829+0000 7f1e49400640 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ea42c5f390 0x55ea42c5f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:22.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.833+0000 7f1e49400640 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ea42c5f390 0x55ea42c5f7a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a80c91ad023b21d server_cookie=3366c28df1439f12 in_seq=0 out_seq=0 2024-09-10T23:19:22.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.833+0000 7f1e37400640 10 client.5808 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e37400640 1 -- 172.21.15.17:0/1411943389 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ea42a3c790 con 0x55ea42c5f390 2024-09-10T23:19:22.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e37400640 10 client.5808 handle_command_reply: tid=0 2024-09-10T23:19:22.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 client.5808 shutdown 2024-09-10T23:19:22.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 -- 172.21.15.17:0/1411943389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42be3af0 msgr2=0x55ea42ca01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42be3af0 0x55ea42ca01e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400de00 tx=0x7f1e44000bd0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 -- 172.21.15.17:0/1411943389 shutdown_connections 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ea42c5f390 0x55ea42c5f7a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ea42c2d4d0 0x55ea42c43780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ea42c2cbb0 0x55ea42c43240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 --2- 172.21.15.17:0/1411943389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ea42be3af0 0x55ea42ca01e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e37400640 0 client.5808 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 -- 172.21.15.17:0/1411943389 >> 172.21.15.17:0/1411943389 conn(0x55ea42bdfaa0 msgr2=0x55ea42c3ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 -- 172.21.15.17:0/1411943389 shutdown_connections 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 1 -- 172.21.15.17:0/1411943389 wait complete. 2024-09-10T23:19:22.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e5c180000 20 client.5808 trim_cache size 0 max 16384 2024-09-10T23:19:22.844 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:22.844 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:22.844 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:19:22.844 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 -- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e300725e0 msgr2=0x7f1e30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e300725e0 0x7f1e30074aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1e440016d0 tx=0x7f1e44009040 comp rx=0 tx=0).stop 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 -- 172.21.15.17:0/1676367595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5415b8c0 msgr2=0x7f1e540cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5415b8c0 0x7f1e540cb7f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009790 tx=0x7f1e3c0a57a0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 -- 172.21.15.17:0/1676367595 shutdown_connections 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e300725e0 0x7f1e30074aa0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e5415bca0 0x7f1e5415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5415b8c0 0x7f1e540cb7f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 --2- 172.21.15.17:0/1676367595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e540b2f10 0x7f1e541f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:22.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 -- 172.21.15.17:0/1676367595 >> 172.21.15.17:0/1676367595 conn(0x7f1e5409a9f0 msgr2=0x7f1e540707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 -- 172.21.15.17:0/1676367595 shutdown_connections 2024-09-10T23:19:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:22.837+0000 7f1e53200640 1 -- 172.21.15.17:0/1676367595 wait complete. 2024-09-10T23:19:22.861 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-09-10T23:19:22.861 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:19:22.861 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:22.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:22.870 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-10T23:19:22.942 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:19:22.942 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:19:22.942 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163574 s, 64.1 MB/s 2024-09-10T23:19:22.943 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-10T23:19:22.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-10T23:19:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.129+0000 7f2161600640 1 -- 172.21.15.17:0/1597177237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215c072690 msgr2=0x7f215c072b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.129+0000 7f2161600640 1 --2- 172.21.15.17:0/1597177237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215c072690 0x7f215c072b00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2144009900 tx=0x7f214401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.129+0000 7f2161600640 1 -- 172.21.15.17:0/1597177237 shutdown_connections 2024-09-10T23:19:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.129+0000 7f2161600640 1 --2- 172.21.15.17:0/1597177237 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f215c073040 0x7f215c0b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.129+0000 7f2161600640 1 --2- 172.21.15.17:0/1597177237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215c072690 0x7f215c072b00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.129+0000 7f2161600640 1 -- 172.21.15.17:0/1597177237 >> 172.21.15.17:0/1597177237 conn(0x7f215c0b17a0 msgr2=0x7f215c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.129+0000 7f2161600640 1 -- 172.21.15.17:0/1597177237 shutdown_connections 2024-09-10T23:19:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.129+0000 7f2161600640 1 -- 172.21.15.17:0/1597177237 wait complete. 2024-09-10T23:19:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 Processor -- start 2024-09-10T23:19:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 -- start start 2024-09-10T23:19:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f215c072690 0x7f215c146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215c073040 0x7f215c0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215c15aa80 0x7f215c1434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f215c167a70 con 0x7f215c073040 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f215c0b4b60 con 0x7f215c15aa80 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f215c167bf0 con 0x7f215c072690 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2153e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215c073040 0x7f215c0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f215aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f215c072690 0x7f215c146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f215aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f215c072690 0x7f215c146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:39456/0 (socket says 172.21.15.17:39456) 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f215aa00640 1 -- 172.21.15.17:0/22232090 learned_addr learned my addr 172.21.15.17:0/22232090 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f215b400640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215c15aa80 0x7f215c1434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2153e00640 1 -- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f215c072690 msgr2=0x7f215c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2153e00640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f215c072690 0x7f215c146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2153e00640 1 -- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215c15aa80 msgr2=0x7f215c1434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2153e00640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215c15aa80 0x7f215c1434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2153e00640 1 -- 172.21.15.17:0/22232090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c145480 con 0x7f215c073040 2024-09-10T23:19:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2153e00640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215c073040 0x7f215c0cecc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f21440ac000 tx=0x7f2144004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2152a00640 1 -- 172.21.15.17:0/22232090 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440b2040 con 0x7f215c073040 2024-09-10T23:19:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2152a00640 1 -- 172.21.15.17:0/22232090 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2144005030 con 0x7f215c073040 2024-09-10T23:19:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2152a00640 1 -- 172.21.15.17:0/22232090 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144005480 con 0x7f215c073040 2024-09-10T23:19:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 -- 172.21.15.17:0/22232090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c145760 con 0x7f215c073040 2024-09-10T23:19:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.133+0000 7f2161600640 1 -- 172.21.15.17:0/22232090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c145d20 con 0x7f215c073040 2024-09-10T23:19:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2152a00640 1 -- 172.21.15.17:0/22232090 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f21440046d0 con 0x7f215c073040 2024-09-10T23:19:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2152a00640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2138072610 0x7f2138074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2152a00640 1 -- 172.21.15.17:0/22232090 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f214412cb10 con 0x7f215c073040 2024-09-10T23:19:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2164933000 1 Processor -- start 2024-09-10T23:19:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f215aa00640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2138072610 0x7f2138074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2164933000 1 -- start start 2024-09-10T23:19:23.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f215aa00640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2138072610 0x7f2138074ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f214c001870 tx=0x7f214c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2164933000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8ccdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2164933000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 0x563cd8c845b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2164933000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8c84ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2164933000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563cd8adfd90 con 0x563cd8c84af0 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2164933000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563cd8acf1c0 con 0x563cd8cce4d0 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2164933000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563cd8ad2fd0 con 0x563cd8ccdbb0 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f215b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8c84ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f215b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8c84ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37636/0 (socket says 172.21.15.17:37636) 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f215b400640 1 -- 172.21.15.17:0/2740312217 learned_addr learned my addr 172.21.15.17:0/2740312217 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f215aa00640 1 --2- 172.21.15.17:0/2740312217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8ccdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.137+0000 7f2153e00640 1 --2- 172.21.15.17:0/2740312217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 0x563cd8c845b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f215b400640 1 -- 172.21.15.17:0/2740312217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 msgr2=0x563cd8ccdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f215b400640 1 --2- 172.21.15.17:0/2740312217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8ccdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f215b400640 1 -- 172.21.15.17:0/2740312217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 msgr2=0x563cd8c845b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f215b400640 1 --2- 172.21.15.17:0/2740312217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 0x563cd8c845b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f215b400640 1 -- 172.21.15.17:0/2740312217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cd8a824c0 con 0x563cd8c84af0 2024-09-10T23:19:23.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f215b400640 1 --2- 172.21.15.17:0/2740312217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8c84ed0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2154009f30 tx=0x7f2154011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7e86f25ba47bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f214b400640 1 -- 172.21.15.17:0/2740312217 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154004d30 con 0x563cd8c84af0 2024-09-10T23:19:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f214b400640 1 -- 172.21.15.17:0/2740312217 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2154003980 con 0x563cd8c84af0 2024-09-10T23:19:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f214b400640 1 -- 172.21.15.17:0/2740312217 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154003db0 con 0x563cd8c84af0 2024-09-10T23:19:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 -- 172.21.15.17:0/2740312217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 msgr2=0x563cd8c84ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 --2- 172.21.15.17:0/2740312217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8c84ed0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2154009f30 tx=0x7f2154011870 comp rx=0 tx=0).stop 2024-09-10T23:19:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 -- 172.21.15.17:0/2740312217 shutdown_connections 2024-09-10T23:19:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 --2- 172.21.15.17:0/2740312217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8c84ed0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 --2- 172.21.15.17:0/2740312217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 0x563cd8c845b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 --2- 172.21.15.17:0/2740312217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8ccdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 -- 172.21.15.17:0/2740312217 >> 172.21.15.17:0/2740312217 conn(0x563cd8c80aa0 msgr2=0x563cd8c82e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 -- 172.21.15.17:0/2740312217 shutdown_connections 2024-09-10T23:19:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 -- 172.21.15.17:0/2740312217 wait complete. 2024-09-10T23:19:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 -- start start 2024-09-10T23:19:23.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 Processor -- start 2024-09-10T23:19:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 0x563cd8cb8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8ccdbb0 0x563cd8c89a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8cce4d0 0x563cd8c89f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a73290 con 0x563cd8ccdbb0 2024-09-10T23:19:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a98ca0 con 0x563cd8c84af0 2024-09-10T23:19:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563cd8adeb60 con 0x563cd8cce4d0 2024-09-10T23:19:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2164933000 10 client.0 _ll_register_callbacks cb 0x563cd8c6f4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2153e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8ccdbb0 0x563cd8c89a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2153e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8ccdbb0 0x563cd8c89a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37648/0 (socket says 172.21.15.17:37648) 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2153e00640 1 -- 172.21.15.17:0/3476452880 learned_addr learned my addr 172.21.15.17:0/3476452880 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f215aa00640 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 0x563cd8cb8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f215b400640 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8cce4d0 0x563cd8c89f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2153e00640 1 -- 172.21.15.17:0/3476452880 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8cce4d0 msgr2=0x563cd8c89f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2153e00640 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8cce4d0 0x563cd8c89f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2153e00640 1 -- 172.21.15.17:0/3476452880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 msgr2=0x563cd8cb8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2153e00640 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 0x563cd8cb8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.141+0000 7f2153e00640 1 -- 172.21.15.17:0/3476452880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cd8a4fae0 con 0x563cd8ccdbb0 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2153e00640 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8ccdbb0 0x563cd8c89a20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f21440983d0 tx=0x7f21440f3850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3142a2cd5692edbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 1 -- 172.21.15.17:0/3476452880 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440bc070 con 0x563cd8ccdbb0 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 1 -- 172.21.15.17:0/3476452880 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f21440f8bc0 con 0x563cd8ccdbb0 2024-09-10T23:19:23.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 -- 172.21.15.17:0/3476452880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563cd8a67530 con 0x563cd8ccdbb0 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 1 -- 172.21.15.17:0/3476452880 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2144128050 con 0x563cd8ccdbb0 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 10 client.5820 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 -- 172.21.15.17:0/3476452880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x563cd8a8b100 con 0x563cd8ccdbb0 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 1 -- 172.21.15.17:0/3476452880 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563cd8a67530 con 0x563cd8ccdbb0 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 1 -- 172.21.15.17:0/3476452880 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f21440f6ba0 con 0x563cd8ccdbb0 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 10 client.5820 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 10 client.5820 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 20 client.5820 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563cd8cb9320 0x563cd8cb9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 4 client.5820 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 -- 172.21.15.17:0/3476452880 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cd8ae1ce0 con 0x563cd8cb9320 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f215aa00640 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563cd8cb9320 0x563cd8cb9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 10 client.5820 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f215aa00640 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563cd8cb9320 0x563cd8cb9700 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5708a44894bcc9a server_cookie=37e2d37439c679cd in_seq=0 out_seq=0 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 1 -- 172.21.15.17:0/3476452880 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563cd8ae1ce0 con 0x563cd8cb9320 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 10 client.5820 handle_command_reply: tid=0 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 client.5820 shutdown 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 -- 172.21.15.17:0/3476452880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8ccdbb0 msgr2=0x563cd8c89a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8ccdbb0 0x563cd8c89a20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f21440983d0 tx=0x7f21440f3850 comp rx=0 tx=0).stop 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 -- 172.21.15.17:0/3476452880 shutdown_connections 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563cd8cb9320 0x563cd8cb9700 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8cce4d0 0x563cd8c89f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8ccdbb0 0x563cd8c89a20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 --2- 172.21.15.17:0/3476452880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 0x563cd8cb8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f213fe00640 0 client.5820 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 -- 172.21.15.17:0/3476452880 >> 172.21.15.17:0/3476452880 conn(0x563cd8c80aa0 msgr2=0x563cd8c836b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 -- 172.21.15.17:0/3476452880 shutdown_connections 2024-09-10T23:19:23.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 1 -- 172.21.15.17:0/3476452880 wait complete. 2024-09-10T23:19:23.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.145+0000 7f2164933000 20 client.5820 trim_cache size 0 max 16384 2024-09-10T23:19:23.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2164933000 1 Processor -- start 2024-09-10T23:19:23.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2164933000 1 -- start start 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2164933000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 0x563cd8d40870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2164933000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d40db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2164933000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8cce4d0 0x563cd8d412f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2164933000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f215c203440 con 0x563cd8cce4d0 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2164933000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f215c144a90 con 0x563cd8c84af0 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2164933000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f215c1450e0 con 0x563cd8ccdbb0 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8cce4d0 0x563cd8d412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8cce4d0 0x563cd8d412f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37652/0 (socket says 172.21.15.17:37652) 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215b400640 1 -- 172.21.15.17:0/952212739 learned_addr learned my addr 172.21.15.17:0/952212739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215aa00640 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 0x563cd8d40870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215b400640 1 -- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 msgr2=0x563cd8d40db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2153e00640 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d40db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215b400640 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d40db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215b400640 1 -- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 msgr2=0x563cd8d40870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215b400640 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 0x563cd8d40870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215b400640 1 -- 172.21.15.17:0/952212739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cd8a6d3f0 con 0x563cd8cce4d0 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f215aa00640 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 0x563cd8d40870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.161+0000 7f2153e00640 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d40db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215b400640 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8cce4d0 0x563cd8d412f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2154011d70 tx=0x7f2154004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcc9ab49c51b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f214aa00640 1 -- 172.21.15.17:0/952212739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154004d30 con 0x563cd8cce4d0 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f214aa00640 1 -- 172.21.15.17:0/952212739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2154003a40 con 0x563cd8cce4d0 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f214aa00640 1 -- 172.21.15.17:0/952212739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154004040 con 0x563cd8cce4d0 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 -- 172.21.15.17:0/952212739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8cce4d0 msgr2=0x563cd8d412f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8cce4d0 0x563cd8d412f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2154011d70 tx=0x7f2154004ac0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 -- 172.21.15.17:0/952212739 shutdown_connections 2024-09-10T23:19:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8cce4d0 0x563cd8d412f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d40db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 --2- 172.21.15.17:0/952212739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8c84af0 0x563cd8d40870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 -- 172.21.15.17:0/952212739 >> 172.21.15.17:0/952212739 conn(0x563cd8c80aa0 msgr2=0x563cd8cdde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 -- 172.21.15.17:0/952212739 shutdown_connections 2024-09-10T23:19:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 -- 172.21.15.17:0/952212739 wait complete. 2024-09-10T23:19:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 -- start start 2024-09-10T23:19:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 Processor -- start 2024-09-10T23:19:23.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8d446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d44be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 0x563cd8d45120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a9b270 con 0x563cd8c84af0 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563cd8a8e980 con 0x563cd8cce4d0 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563cd8ad22e0 con 0x563cd8ccdbb0 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2164933000 10 client.0 _ll_register_callbacks cb 0x7f21440f4020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8d446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8d446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37662/0 (socket says 172.21.15.17:37662) 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215aa00640 1 -- 172.21.15.17:0/2493384921 learned_addr learned my addr 172.21.15.17:0/2493384921 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2153e00640 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d44be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215aa00640 1 -- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 msgr2=0x563cd8d44be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215b400640 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 0x563cd8d45120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215aa00640 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d44be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215aa00640 1 -- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 msgr2=0x563cd8d45120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215aa00640 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 0x563cd8d45120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215aa00640 1 -- 172.21.15.17:0/2493384921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cd8b2c070 con 0x563cd8c84af0 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f2153e00640 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d44be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215b400640 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 0x563cd8d45120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f215aa00640 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8d446a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f214c00fbb0 tx=0x7f214c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91b1b42c0cca9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.165+0000 7f213fe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f213fe00640 1 -- 172.21.15.17:0/2493384921 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c015b40 con 0x563cd8c84af0 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f213fe00640 1 -- 172.21.15.17:0/2493384921 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f214c010040 con 0x563cd8c84af0 2024-09-10T23:19:23.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2164933000 1 -- 172.21.15.17:0/2493384921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2154003a40 con 0x563cd8c84af0 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f213fe00640 1 -- 172.21.15.17:0/2493384921 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f214c038050 con 0x563cd8c84af0 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2164933000 10 client.5826 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2164933000 1 -- 172.21.15.17:0/2493384921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x563cd8a657b0 con 0x563cd8c84af0 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f213fe00640 1 -- 172.21.15.17:0/2493384921 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2154003a40 con 0x563cd8c84af0 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f213fe00640 1 -- 172.21.15.17:0/2493384921 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f214c03b020 con 0x563cd8c84af0 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2164933000 10 client.5826 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2164933000 10 client.5826 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2164933000 20 client.5826 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2164933000 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563cd8ce4010 0x563cd8ce4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2164933000 4 client.5826 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2164933000 1 -- 172.21.15.17:0/2493384921 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x563cd8add790 con 0x563cd8ce4010 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2153e00640 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563cd8ce4010 0x563cd8ce4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f213fe00640 10 client.5826 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.169+0000 7f2153e00640 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563cd8ce4010 0x563cd8ce4420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3fd52f648b136a2 server_cookie=a89100ee6d670a8a in_seq=0 out_seq=0 2024-09-10T23:19:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.197+0000 7f213fe00640 1 -- 172.21.15.17:0/2493384921 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563cd8add790 con 0x563cd8ce4010 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.197+0000 7f213fe00640 10 client.5826 handle_command_reply: tid=0 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.197+0000 7f2164933000 1 client.5826 shutdown 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.197+0000 7f2164933000 1 -- 172.21.15.17:0/2493384921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 msgr2=0x563cd8d446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.197+0000 7f2164933000 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8d446a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f214c00fbb0 tx=0x7f214c007f90 comp rx=0 tx=0).stop 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2164933000 1 -- 172.21.15.17:0/2493384921 shutdown_connections 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2164933000 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563cd8ce4010 0x563cd8ce4420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2164933000 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563cd8cce4d0 0x563cd8d45120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2164933000 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563cd8ccdbb0 0x563cd8d44be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2164933000 1 --2- 172.21.15.17:0/2493384921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cd8c84af0 0x563cd8d446a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f213fe00640 0 client.5826 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2164933000 1 -- 172.21.15.17:0/2493384921 >> 172.21.15.17:0/2493384921 conn(0x563cd8c80aa0 msgr2=0x563cd8c856f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2164933000 1 -- 172.21.15.17:0/2493384921 shutdown_connections 2024-09-10T23:19:23.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2164933000 1 -- 172.21.15.17:0/2493384921 wait complete. 2024-09-10T23:19:23.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2164933000 20 client.5826 trim_cache size 0 max 16384 2024-09-10T23:19:23.206 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:23.206 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:23.206 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:19:23.206 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 -- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2138072610 msgr2=0x7f2138074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2138072610 0x7f2138074ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f214c001870 tx=0x7f214c009040 comp rx=0 tx=0).stop 2024-09-10T23:19:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 -- 172.21.15.17:0/22232090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215c073040 msgr2=0x7f215c0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215c073040 0x7f215c0cecc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f21440ac000 tx=0x7f2144004040 comp rx=0 tx=0).stop 2024-09-10T23:19:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 -- 172.21.15.17:0/22232090 shutdown_connections 2024-09-10T23:19:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2138072610 0x7f2138074ad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215c15aa80 0x7f215c1434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215c073040 0x7f215c0cecc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 --2- 172.21.15.17:0/22232090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f215c072690 0x7f215c146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 -- 172.21.15.17:0/22232090 >> 172.21.15.17:0/22232090 conn(0x7f215c0b17a0 msgr2=0x7f215c154520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 -- 172.21.15.17:0/22232090 shutdown_connections 2024-09-10T23:19:23.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.201+0000 7f2161600640 1 -- 172.21.15.17:0/22232090 wait complete. 2024-09-10T23:19:23.223 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-09-10T23:19:23.224 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:19:23.224 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:19:23.224 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-09-10T23:19:23.224 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:23.224 DEBUG:teuthology.orchestra.run.smithi017:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-09-10T23:19:23.224 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:19:23.291 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630409 2024-09-10T23:19:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:19:23.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-10T23:19:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.485+0000 7f8296200640 1 -- 172.21.15.17:0/722186035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f829015bca0 msgr2=0x7f82900b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.485+0000 7f8296200640 1 --2- 172.21.15.17:0/722186035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f829015bca0 0x7f82900b29d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f827c009840 tx=0x7f827c01c820 comp rx=0 tx=0).stop 2024-09-10T23:19:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 -- 172.21.15.17:0/722186035 shutdown_connections 2024-09-10T23:19:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 --2- 172.21.15.17:0/722186035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f829015bca0 0x7f82900b29d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 -- 172.21.15.17:0/722186035 >> 172.21.15.17:0/722186035 conn(0x7f829009a9f0 msgr2=0x7f829009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 -- 172.21.15.17:0/722186035 shutdown_connections 2024-09-10T23:19:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 -- 172.21.15.17:0/722186035 wait complete. 2024-09-10T23:19:23.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 Processor -- start 2024-09-10T23:19:23.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 -- start start 2024-09-10T23:19:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82900b2f10 0x7f82901490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f829015b8c0 0x7f82900aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829015bca0 0x7f82900af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f82901699a0 con 0x7f82900b2f10 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8290169820 con 0x7f829015b8c0 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8296200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8290169b20 con 0x7f829015bca0 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8294e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82900b2f10 0x7f82901490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8294e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82900b2f10 0x7f82901490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37664/0 (socket says 172.21.15.17:37664) 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8294e00640 1 -- 172.21.15.17:0/216384674 learned_addr learned my addr 172.21.15.17:0/216384674 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8295800640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829015bca0 0x7f82900af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f828fe00640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f829015b8c0 0x7f82900aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8294e00640 1 -- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829015bca0 msgr2=0x7f82900af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8294e00640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829015bca0 0x7f82900af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8294e00640 1 -- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f829015b8c0 msgr2=0x7f82900aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8294e00640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f829015b8c0 0x7f82900aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8294e00640 1 -- 172.21.15.17:0/216384674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8290149600 con 0x7f82900b2f10 2024-09-10T23:19:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f828fe00640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f829015b8c0 0x7f82900aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8295800640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829015bca0 0x7f82900af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.489+0000 7f8294e00640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82900b2f10 0x7f82901490c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f828400c4d0 tx=0x7f828400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.493+0000 7f828cc00640 1 -- 172.21.15.17:0/216384674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284016020 con 0x7f82900b2f10 2024-09-10T23:19:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.493+0000 7f828cc00640 1 -- 172.21.15.17:0/216384674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8284012920 con 0x7f82900b2f10 2024-09-10T23:19:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.493+0000 7f828cc00640 1 -- 172.21.15.17:0/216384674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284012d50 con 0x7f82900b2f10 2024-09-10T23:19:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.493+0000 7f8296200640 1 -- 172.21.15.17:0/216384674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829006f190 con 0x7f82900b2f10 2024-09-10T23:19:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.493+0000 7f8296200640 1 -- 172.21.15.17:0/216384674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829006f710 con 0x7f82900b2f10 2024-09-10T23:19:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.493+0000 7f828cc00640 1 -- 172.21.15.17:0/216384674 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f828401a3b0 con 0x7f82900b2f10 2024-09-10T23:19:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.493+0000 7f828cc00640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82700725e0 0x7f8270074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.493+0000 7f828cc00640 1 -- 172.21.15.17:0/216384674 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f8284093570 con 0x7f82900b2f10 2024-09-10T23:19:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f828fe00640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82700725e0 0x7f8270074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 Processor -- start 2024-09-10T23:19:23.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- start start 2024-09-10T23:19:23.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f828fe00640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82700725e0 0x7f8270074aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f827c0af000 tx=0x7f827c01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564dddeaa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564ddde5d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 0x564ddde5dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564dddd47d30 con 0x564dddea9f30 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564dddcbbaf0 con 0x564ddde5d920 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564dddcaaf20 con 0x564dddeaa850 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8294e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564dddeaa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8294e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564dddeaa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37666/0 (socket says 172.21.15.17:37666) 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8294e00640 1 -- 172.21.15.17:0/259028905 learned_addr learned my addr 172.21.15.17:0/259028905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f828fe00640 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564ddde5d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8295800640 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 0x564ddde5dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8294e00640 1 -- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 msgr2=0x564ddde5d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8294e00640 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564ddde5d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8294e00640 1 -- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 msgr2=0x564ddde5dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8294e00640 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 0x564ddde5dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8294e00640 1 -- 172.21.15.17:0/259028905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dddc2c100 con 0x564dddea9f30 2024-09-10T23:19:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f828fe00640 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564ddde5d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8295800640 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 0x564ddde5dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8294e00640 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564dddeaa310 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f82840056f0 tx=0x7f828405de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4168b129faecfdd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8281600640 1 -- 172.21.15.17:0/259028905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284062d50 con 0x564dddea9f30 2024-09-10T23:19:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8281600640 1 -- 172.21.15.17:0/259028905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8284067770 con 0x564dddea9f30 2024-09-10T23:19:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f8281600640 1 -- 172.21.15.17:0/259028905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840833c0 con 0x564dddea9f30 2024-09-10T23:19:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- 172.21.15.17:0/259028905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 msgr2=0x564dddeaa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564dddeaa310 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f82840056f0 tx=0x7f828405de40 comp rx=0 tx=0).stop 2024-09-10T23:19:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- 172.21.15.17:0/259028905 shutdown_connections 2024-09-10T23:19:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 0x564ddde5dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564ddde5d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 --2- 172.21.15.17:0/259028905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564dddeaa310 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- 172.21.15.17:0/259028905 >> 172.21.15.17:0/259028905 conn(0x564ddde8aff0 msgr2=0x564ddde8d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- 172.21.15.17:0/259028905 shutdown_connections 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- 172.21.15.17:0/259028905 wait complete. 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.497+0000 7f829ab97000 1 -- start start 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 Processor -- start 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564ddde5d920 0x564ddde8c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 0x564ddde8c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddeaa850 0x564ddde8cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564dddc504e0 con 0x564dddeaa850 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564dddcaed30 con 0x564dddea9f30 2024-09-10T23:19:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564ddd970680 con 0x564ddde5d920 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 10 client.0 _ll_register_callbacks cb 0x564ddde4b0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8295800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddeaa850 0x564ddde8cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8294e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564ddde5d920 0x564ddde8c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f828fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 0x564ddde8c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8295800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddeaa850 0x564ddde8cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37668/0 (socket says 172.21.15.17:37668) 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8295800640 1 -- 172.21.15.17:0/3525904325 learned_addr learned my addr 172.21.15.17:0/3525904325 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8295800640 1 -- 172.21.15.17:0/3525904325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564ddde5d920 msgr2=0x564ddde8c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8295800640 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564ddde5d920 0x564ddde8c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8295800640 1 -- 172.21.15.17:0/3525904325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 msgr2=0x564ddde8c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8295800640 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 0x564ddde8c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8295800640 1 -- 172.21.15.17:0/3525904325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dddc5fc40 con 0x564dddeaa850 2024-09-10T23:19:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8295800640 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddeaa850 0x564ddde8cea0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f828800f5e0 tx=0x7f828800faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e89678903b7f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8276000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8276000640 1 -- 172.21.15.17:0/3525904325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288017030 con 0x564dddeaa850 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8276000640 1 -- 172.21.15.17:0/3525904325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f8288010040 con 0x564dddeaa850 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 -- 172.21.15.17:0/3525904325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564dddc43310 con 0x564dddeaa850 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8276000640 1 -- 172.21.15.17:0/3525904325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8288020050 con 0x564dddeaa850 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 10 client.5838 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 -- 172.21.15.17:0/3525904325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x564dddca9bc0 con 0x564dddeaa850 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8276000640 1 -- 172.21.15.17:0/3525904325 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564dddc43310 con 0x564dddeaa850 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8276000640 1 -- 172.21.15.17:0/3525904325 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f8288023020 con 0x564dddeaa850 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 10 client.5838 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 10 client.5838 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 20 client.5838 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:23.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x564ddde8d8b0 0x564dddebc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 4 client.5838 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:23.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f829ab97000 1 -- 172.21.15.17:0/3525904325 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dddcbda40 con 0x564ddde8d8b0 2024-09-10T23:19:23.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8294e00640 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x564ddde8d8b0 0x564dddebc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8294e00640 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x564ddde8d8b0 0x564dddebc1f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60449d5ef0621af server_cookie=6c44df320a20d1c1 in_seq=0 out_seq=0 2024-09-10T23:19:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.501+0000 7f8276000640 10 client.5838 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f8276000640 1 -- 172.21.15.17:0/3525904325 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564dddcbda40 con 0x564ddde8d8b0 2024-09-10T23:19:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f8276000640 10 client.5838 handle_command_reply: tid=0 2024-09-10T23:19:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 client.5838 shutdown 2024-09-10T23:19:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 -- 172.21.15.17:0/3525904325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddeaa850 msgr2=0x564ddde8cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddeaa850 0x564ddde8cea0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f828800f5e0 tx=0x7f828800faa0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 -- 172.21.15.17:0/3525904325 shutdown_connections 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x564ddde8d8b0 0x564dddebc1f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddeaa850 0x564ddde8cea0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 0x564ddde8c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 --2- 172.21.15.17:0/3525904325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564ddde5d920 0x564ddde8c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f8276000640 0 client.5838 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 -- 172.21.15.17:0/3525904325 >> 172.21.15.17:0/3525904325 conn(0x564ddde8aff0 msgr2=0x564ddde5cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 -- 172.21.15.17:0/3525904325 shutdown_connections 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 1 -- 172.21.15.17:0/3525904325 wait complete. 2024-09-10T23:19:23.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.505+0000 7f829ab97000 20 client.5838 trim_cache size 0 max 16384 2024-09-10T23:19:23.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.517+0000 7f829ab97000 1 Processor -- start 2024-09-10T23:19:23.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.517+0000 7f829ab97000 1 -- start start 2024-09-10T23:19:23.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 0x564dddebfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564ddde8c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564ddde8c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8290204160 con 0x564dddea9f30 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8290203180 con 0x564ddde5d920 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f829014ec30 con 0x564dddeaa850 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f828fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564ddde8c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f828fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564ddde8c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37678/0 (socket says 172.21.15.17:37678) 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f828fe00640 1 -- 172.21.15.17:0/3756871574 learned_addr learned my addr 172.21.15.17:0/3756871574 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f8294e00640 1 --2- 172.21.15.17:0/3756871574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 0x564dddebfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f8295800640 1 --2- 172.21.15.17:0/3756871574 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564ddde8c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f828fe00640 1 -- 172.21.15.17:0/3756871574 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 msgr2=0x564ddde8c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f828fe00640 1 --2- 172.21.15.17:0/3756871574 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564ddde8c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f828fe00640 1 -- 172.21.15.17:0/3756871574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 msgr2=0x564dddebfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f828fe00640 1 --2- 172.21.15.17:0/3756871574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 0x564dddebfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f828fe00640 1 -- 172.21.15.17:0/3756871574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dddc491d0 con 0x564dddea9f30 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f828fe00640 1 --2- 172.21.15.17:0/3756871574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564ddde8c3e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f827c019430 tx=0x7f827c0a7050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e25ab65dd9a143e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f8280c00640 1 -- 172.21.15.17:0/3756871574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c0b2040 con 0x564dddea9f30 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f8280c00640 1 -- 172.21.15.17:0/3756871574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f827c0ca070 con 0x564dddea9f30 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f8280c00640 1 -- 172.21.15.17:0/3756871574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c0048d0 con 0x564dddea9f30 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 -- 172.21.15.17:0/3756871574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 msgr2=0x564ddde8c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 --2- 172.21.15.17:0/3756871574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564ddde8c3e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f827c019430 tx=0x7f827c0a7050 comp rx=0 tx=0).stop 2024-09-10T23:19:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 -- 172.21.15.17:0/3756871574 shutdown_connections 2024-09-10T23:19:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 --2- 172.21.15.17:0/3756871574 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564ddde8c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 --2- 172.21.15.17:0/3756871574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564dddea9f30 0x564ddde8c3e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 --2- 172.21.15.17:0/3756871574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564ddde5d920 0x564dddebfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 -- 172.21.15.17:0/3756871574 >> 172.21.15.17:0/3756871574 conn(0x564ddde8aff0 msgr2=0x564dddeb6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 -- 172.21.15.17:0/3756871574 shutdown_connections 2024-09-10T23:19:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 -- 172.21.15.17:0/3756871574 wait complete. 2024-09-10T23:19:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 -- start start 2024-09-10T23:19:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.521+0000 7f829ab97000 1 Processor -- start 2024-09-10T23:19:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ddde5d920 0x564dddf1ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 0x564dddf20490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564dddf209d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564dddc76890 con 0x564ddde5d920 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564dddcba8c0 con 0x564dddea9f30 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564dddc6d690 con 0x564dddeaa850 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 10 client.0 _ll_register_callbacks cb 0x7f8288001750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8294e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ddde5d920 0x564dddf1ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8294e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ddde5d920 0x564dddf1ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37684/0 (socket says 172.21.15.17:37684) 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8294e00640 1 -- 172.21.15.17:0/3926446991 learned_addr learned my addr 172.21.15.17:0/3926446991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f828fe00640 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 0x564dddf20490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8295800640 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564dddf209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8294e00640 1 -- 172.21.15.17:0/3926446991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 msgr2=0x564dddf209d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8294e00640 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564dddf209d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8294e00640 1 -- 172.21.15.17:0/3926446991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 msgr2=0x564dddf20490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8294e00640 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 0x564dddf20490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8294e00640 1 -- 172.21.15.17:0/3926446991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dddc71970 con 0x564ddde5d920 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8294e00640 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ddde5d920 0x564dddf1ff50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f828405a9c0 tx=0x7f8284000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a0e7828afe107b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 1 -- 172.21.15.17:0/3926446991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840833c0 con 0x564ddde5d920 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 1 -- 172.21.15.17:0/3926446991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f82840672e0 con 0x564ddde5d920 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- 172.21.15.17:0/3926446991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f827c0ca070 con 0x564ddde5d920 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 1 -- 172.21.15.17:0/3926446991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f82840674e0 con 0x564ddde5d920 2024-09-10T23:19:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 10 client.5844 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- 172.21.15.17:0/3926446991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x564dddc41560 con 0x564ddde5d920 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 1 -- 172.21.15.17:0/3926446991 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f827c0ca070 con 0x564ddde5d920 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 1 -- 172.21.15.17:0/3926446991 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f828407d060 con 0x564ddde5d920 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 10 client.5844 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 10 client.5844 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 20 client.5844 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x564dddebcf10 0x564dddebd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 4 client.5844 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- 172.21.15.17:0/3926446991 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564dddcb94f0 con 0x564dddebcf10 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f828fe00640 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x564dddebcf10 0x564dddebd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f828fe00640 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x564dddebcf10 0x564dddebd2f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=957bddd418540028 server_cookie=9b43044e2c95d4ff in_seq=0 out_seq=0 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 10 client.5844 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 1 -- 172.21.15.17:0/3926446991 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564dddcb94f0 con 0x564dddebcf10 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 10 client.5844 handle_command_reply: tid=0 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 client.5844 shutdown 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- 172.21.15.17:0/3926446991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ddde5d920 msgr2=0x564dddf1ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ddde5d920 0x564dddf1ff50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f828405a9c0 tx=0x7f8284000ee0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- 172.21.15.17:0/3926446991 shutdown_connections 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x564dddebcf10 0x564dddebd2f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564dddeaa850 0x564dddf209d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564dddea9f30 0x564dddf20490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f8276000640 0 client.5844 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 --2- 172.21.15.17:0/3926446991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ddde5d920 0x564dddf1ff50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- 172.21.15.17:0/3926446991 >> 172.21.15.17:0/3926446991 conn(0x564ddde8aff0 msgr2=0x564dddea7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- 172.21.15.17:0/3926446991 shutdown_connections 2024-09-10T23:19:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 1 -- 172.21.15.17:0/3926446991 wait complete. 2024-09-10T23:19:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.525+0000 7f829ab97000 20 client.5844 trim_cache size 0 max 16384 2024-09-10T23:19:23.536 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 -- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82700725e0 msgr2=0x7f8270074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82700725e0 0x7f8270074aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f827c0af000 tx=0x7f827c01b060 comp rx=0 tx=0).stop 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 -- 172.21.15.17:0/216384674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82900b2f10 msgr2=0x7f82901490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82900b2f10 0x7f82901490c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f828400c4d0 tx=0x7f828400c990 comp rx=0 tx=0).stop 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 -- 172.21.15.17:0/216384674 shutdown_connections 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82700725e0 0x7f8270074aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829015bca0 0x7f82900af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f829015b8c0 0x7f82900aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 --2- 172.21.15.17:0/216384674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82900b2f10 0x7f82901490c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 -- 172.21.15.17:0/216384674 >> 172.21.15.17:0/216384674 conn(0x7f829009a9f0 msgr2=0x7f82900b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 -- 172.21.15.17:0/216384674 shutdown_connections 2024-09-10T23:19:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.529+0000 7f8296200640 1 -- 172.21.15.17:0/216384674 wait complete. 2024-09-10T23:19:23.550 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a49.00000000 parent 2024-09-10T23:19:23.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179f931080 1 Processor -- start 2024-09-10T23:19:23.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179f931080 1 -- start start 2024-09-10T23:19:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179f931080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559a0d344780 0x559a0d41c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179f931080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d401010 0x559a0d41cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179f931080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a0d4013f0 0x559a0d3751a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179f931080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559a0d292a00 con 0x559a0d401010 2024-09-10T23:19:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179f931080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559a0d2f0f40 con 0x559a0d4013f0 2024-09-10T23:19:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179f931080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559a0d427670 con 0x559a0d344780 2024-09-10T23:19:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1797e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d401010 0x559a0d41cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1797e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d401010 0x559a0d41cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37710/0 (socket says 172.21.15.17:37710) 2024-09-10T23:19:23.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1797e00640 1 -- 172.21.15.17:0/318312324 learned_addr learned my addr 172.21.15.17:0/318312324 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179d600640 1 --2- 172.21.15.17:0/318312324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a0d4013f0 0x559a0d3751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179cc00640 1 --2- 172.21.15.17:0/318312324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559a0d344780 0x559a0d41c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1797e00640 1 -- 172.21.15.17:0/318312324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559a0d344780 msgr2=0x559a0d41c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1797e00640 1 --2- 172.21.15.17:0/318312324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559a0d344780 0x559a0d41c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1797e00640 1 -- 172.21.15.17:0/318312324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a0d4013f0 msgr2=0x559a0d3751a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1797e00640 1 --2- 172.21.15.17:0/318312324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a0d4013f0 0x559a0d3751a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1797e00640 1 -- 172.21.15.17:0/318312324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0d26bc10 con 0x559a0d401010 2024-09-10T23:19:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1797e00640 1 --2- 172.21.15.17:0/318312324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d401010 0x559a0d41cc70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f178800c610 tx=0x7f178800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bd78d25db0e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1796a00640 1 -- 172.21.15.17:0/318312324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178800aa90 con 0x559a0d401010 2024-09-10T23:19:23.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1796a00640 1 -- 172.21.15.17:0/318312324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f178800ac30 con 0x559a0d401010 2024-09-10T23:19:23.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f1796a00640 1 -- 172.21.15.17:0/318312324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788015440 con 0x559a0d401010 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.593+0000 7f179f931080 1 -- 172.21.15.17:0/318312324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d401010 msgr2=0x559a0d41cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 --2- 172.21.15.17:0/318312324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d401010 0x559a0d41cc70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f178800c610 tx=0x7f178800cad0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- 172.21.15.17:0/318312324 shutdown_connections 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 --2- 172.21.15.17:0/318312324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a0d4013f0 0x559a0d3751a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 --2- 172.21.15.17:0/318312324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d401010 0x559a0d41cc70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 --2- 172.21.15.17:0/318312324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559a0d344780 0x559a0d41c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- 172.21.15.17:0/318312324 >> 172.21.15.17:0/318312324 conn(0x559a0d3733e0 msgr2=0x559a0d377280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- 172.21.15.17:0/318312324 shutdown_connections 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- 172.21.15.17:0/318312324 wait complete. 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 Processor -- start 2024-09-10T23:19:23.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- start start 2024-09-10T23:19:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d344780 0x559a0d41f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a0d401010 0x559a0d3762b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559a0d4013f0 0x559a0d3767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559a0d38ef10 con 0x559a0d344780 2024-09-10T23:19:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559a0d41af10 con 0x559a0d401010 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559a0d41a730 con 0x559a0d4013f0 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d344780 0x559a0d41f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d344780 0x559a0d41f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37718/0 (socket says 172.21.15.17:37718) 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179cc00640 1 -- 172.21.15.17:0/1777882706 learned_addr learned my addr 172.21.15.17:0/1777882706 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f1797e00640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a0d401010 0x559a0d3762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179d600640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559a0d4013f0 0x559a0d3767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179cc00640 1 -- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559a0d4013f0 msgr2=0x559a0d3767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179cc00640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559a0d4013f0 0x559a0d3767f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179cc00640 1 -- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a0d401010 msgr2=0x559a0d3762b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179cc00640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559a0d401010 0x559a0d3762b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179cc00640 1 -- 172.21.15.17:0/1777882706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0d4b76e0 con 0x559a0d344780 2024-09-10T23:19:23.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179cc00640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d344780 0x559a0d41f210 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f179000ef60 tx=0x7f179000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f1795600640 1 -- 172.21.15.17:0/1777882706 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179000ce90 con 0x559a0d344780 2024-09-10T23:19:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a0d4b7980 con 0x559a0d344780 2024-09-10T23:19:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f1795600640 1 -- 172.21.15.17:0/1777882706 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1790001c90 con 0x559a0d344780 2024-09-10T23:19:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f1795600640 1 -- 172.21.15.17:0/1777882706 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1790002050 con 0x559a0d344780 2024-09-10T23:19:23.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.597+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a0d4b7ec0 con 0x559a0d344780 2024-09-10T23:19:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.601+0000 7f1795600640 1 -- 172.21.15.17:0/1777882706 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f17900021f0 con 0x559a0d344780 2024-09-10T23:19:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.601+0000 7f1795600640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f177c071190 0x7f177c073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.601+0000 7f1795600640 1 -- 172.21.15.17:0/1777882706 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f17900920f0 con 0x559a0d344780 2024-09-10T23:19:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.601+0000 7f1797e00640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f177c071190 0x7f177c073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.601+0000 7f179f931080 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x559a0d4b50f0 0x559a0d4b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.601+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 --> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] -- osd_op(unknown.0.0:1 8.1f 8:f95eeb57:::10000000a49.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59) -- 0x559a0d4b5a10 con 0x559a0d4b50f0 2024-09-10T23:19:23.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.601+0000 7f179d600640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x559a0d4b50f0 0x559a0d4b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.601+0000 7f1797e00640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f177c071190 0x7f177c073650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1788004240 tx=0x7f1788017040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.601+0000 7f179d600640 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x559a0d4b50f0 0x559a0d4b54d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179d600640 1 -- 172.21.15.17:0/1777882706 <== osd.0 v2:172.21.15.17:6824/2280070654 1 ==== osd_op_reply(1 10000000a49.00000000 [rmxattr] v59'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1798002050 con 0x559a0d4b50f0 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x559a0d4b50f0 msgr2=0x559a0d4b54d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x559a0d4b50f0 0x559a0d4b54d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f177c071190 msgr2=0x7f177c073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f177c071190 0x7f177c073650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1788004240 tx=0x7f1788017040 comp rx=0 tx=0).stop 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d344780 msgr2=0x559a0d41f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 --2- 172.21.15.17:0/1777882706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a0d344780 0x559a0d41f210 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f179000ef60 tx=0x7f179000ef90 comp rx=0 tx=0).stop 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179d600640 1 -- 172.21.15.17:0/1777882706 reap_dead start 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 shutdown_connections 2024-09-10T23:19:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 >> 172.21.15.17:0/1777882706 conn(0x559a0d3733e0 msgr2=0x559a0d417f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 shutdown_connections 2024-09-10T23:19:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.605+0000 7f179f931080 1 -- 172.21.15.17:0/1777882706 wait complete. 2024-09-10T23:19:23.614 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-10T23:19:23.614 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-10T23:19:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 -- 172.21.15.17:0/906521669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d46d0 msgr2=0x7f4ff40b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 --2- 172.21.15.17:0/906521669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d46d0 0x7f4ff40b36c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009900 tx=0x7f4fdc01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 -- 172.21.15.17:0/906521669 shutdown_connections 2024-09-10T23:19:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 --2- 172.21.15.17:0/906521669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d46d0 0x7f4ff40b36c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 --2- 172.21.15.17:0/906521669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ff40d2260 0x7f4ff40b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 -- 172.21.15.17:0/906521669 >> 172.21.15.17:0/906521669 conn(0x7f4ff409d0f0 msgr2=0x7f4ff40d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 -- 172.21.15.17:0/906521669 shutdown_connections 2024-09-10T23:19:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 -- 172.21.15.17:0/906521669 wait complete. 2024-09-10T23:19:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 Processor -- start 2024-09-10T23:19:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 -- start start 2024-09-10T23:19:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d2260 0x7f4ff4154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff40d2640 0x7f4ff40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ff40d46d0 0x7f4ff40b9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff40b2ab0 con 0x7f4ff40d2260 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff40b2930 con 0x7f4ff40d2640 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.801+0000 7f4ff3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff40b2c30 con 0x7f4ff40d46d0 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d2260 0x7f4ff4154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d2260 0x7f4ff4154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37746/0 (socket says 172.21.15.17:37746) 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff1e00640 1 -- 172.21.15.17:0/2058696105 learned_addr learned my addr 172.21.15.17:0/2058696105 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4febe00640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff40d2640 0x7f4ff40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff2800640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ff40d46d0 0x7f4ff40b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff1e00640 1 -- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ff40d46d0 msgr2=0x7f4ff40b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ff40d46d0 0x7f4ff40b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff1e00640 1 -- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff40d2640 msgr2=0x7f4ff40b8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff40d2640 0x7f4ff40b8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff1e00640 1 -- 172.21.15.17:0/2058696105 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff41545a0 con 0x7f4ff40d2260 2024-09-10T23:19:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d2260 0x7f4ff4154060 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400d980 tx=0x7f4fe400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4fea000640 1 -- 172.21.15.17:0/2058696105 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4017070 con 0x7f4ff40d2260 2024-09-10T23:19:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4fea000640 1 -- 172.21.15.17:0/2058696105 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fe4009d60 con 0x7f4ff40d2260 2024-09-10T23:19:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4fea000640 1 -- 172.21.15.17:0/2058696105 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4005280 con 0x7f4ff40d2260 2024-09-10T23:19:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff3200640 1 -- 172.21.15.17:0/2058696105 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff415ef30 con 0x7f4ff40d2260 2024-09-10T23:19:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4ff3200640 1 -- 172.21.15.17:0/2058696105 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff415e3e0 con 0x7f4ff40d2260 2024-09-10T23:19:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.805+0000 7f4fea000640 1 -- 172.21.15.17:0/2058696105 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4fe4005420 con 0x7f4ff40d2260 2024-09-10T23:19:23.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4fea000640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4fd00725e0 0x7f4fd0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4fea000640 1 -- 172.21.15.17:0/2058696105 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f4fe4093620 con 0x7f4ff40d2260 2024-09-10T23:19:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ffbf34000 1 Processor -- start 2024-09-10T23:19:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4febe00640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4fd00725e0 0x7f4fd0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ffbf34000 1 -- start start 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4febe00640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4fd00725e0 0x7f4fd0074aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0af000 tx=0x7f4fdc01b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839a8d0 0x56292839acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839b1f0 0x56292834e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292834e930 0x56292834ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5629281aca40 con 0x56292834e930 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56292819be70 con 0x56292839b1f0 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56292819fc80 con 0x56292839a8d0 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292834e930 0x56292834ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff1e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839a8d0 0x56292839acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292834e930 0x56292834ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37758/0 (socket says 172.21.15.17:37758) 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff2800640 1 -- 172.21.15.17:0/1573765564 learned_addr learned my addr 172.21.15.17:0/1573765564 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4febe00640 1 --2- 172.21.15.17:0/1573765564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839b1f0 0x56292834e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff2800640 1 -- 172.21.15.17:0/1573765564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839a8d0 msgr2=0x56292839acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff2800640 1 --2- 172.21.15.17:0/1573765564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839a8d0 0x56292839acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff2800640 1 -- 172.21.15.17:0/1573765564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839b1f0 msgr2=0x56292834e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff2800640 1 --2- 172.21.15.17:0/1573765564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839b1f0 0x56292834e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff2800640 1 -- 172.21.15.17:0/1573765564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629281413b0 con 0x56292834e930 2024-09-10T23:19:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4ff2800640 1 --2- 172.21.15.17:0/1573765564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292834e930 0x56292834ed10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005420 tx=0x7f4fec0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f036c1d175060398 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4fe2a00640 1 -- 172.21.15.17:0/1573765564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec006d70 con 0x56292834e930 2024-09-10T23:19:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4fe2a00640 1 -- 172.21.15.17:0/1573765564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fec018070 con 0x56292834e930 2024-09-10T23:19:23.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.809+0000 7f4fe2a00640 1 -- 172.21.15.17:0/1573765564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00eb00 con 0x56292834e930 2024-09-10T23:19:23.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- 172.21.15.17:0/1573765564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292834e930 msgr2=0x56292834ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/1573765564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292834e930 0x56292834ed10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005420 tx=0x7f4fec0058e0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- 172.21.15.17:0/1573765564 shutdown_connections 2024-09-10T23:19:23.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/1573765564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292834e930 0x56292834ed10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/1573765564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839b1f0 0x56292834e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/1573765564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839a8d0 0x56292839acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- 172.21.15.17:0/1573765564 >> 172.21.15.17:0/1573765564 conn(0x56292837b990 msgr2=0x56292837dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- 172.21.15.17:0/1573765564 shutdown_connections 2024-09-10T23:19:23.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- 172.21.15.17:0/1573765564 wait complete. 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- start start 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 Processor -- start 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 0x562928350f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x562928351490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 0x5629283519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562928141160 con 0x56292839a8d0 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5629281a42b0 con 0x56292834e930 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562928147120 con 0x56292839b1f0 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 10 client.0 _ll_register_callbacks cb 0x56292833c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4febe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x562928351490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4febe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x562928351490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37766/0 (socket says 172.21.15.17:37766) 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4febe00640 1 -- 172.21.15.17:0/3198923788 learned_addr learned my addr 172.21.15.17:0/3198923788 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ff2800640 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 0x5629283519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 0x562928350f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4febe00640 1 -- 172.21.15.17:0/3198923788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 msgr2=0x5629283519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4febe00640 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 0x5629283519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4febe00640 1 -- 172.21.15.17:0/3198923788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 msgr2=0x562928350f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4febe00640 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 0x562928350f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4febe00640 1 -- 172.21.15.17:0/3198923788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56292813a120 con 0x56292839a8d0 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 0x562928350f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4febe00640 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x562928351490 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009850 tx=0x7f4fdc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95d653edfd25322 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4fd7400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4fd7400640 1 -- 172.21.15.17:0/3198923788 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0b2040 con 0x56292839a8d0 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4fd7400640 1 -- 172.21.15.17:0/3198923788 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f4fdc0046d0 con 0x56292839a8d0 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3198923788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56292817bdf0 con 0x56292839a8d0 2024-09-10T23:19:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4fd7400640 1 -- 172.21.15.17:0/3198923788 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4fdc0d1050 con 0x56292839a8d0 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 10 client.5868 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.813+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3198923788 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x562928159090 con 0x56292839a8d0 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4fd7400640 1 -- 172.21.15.17:0/3198923788 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56292817bdf0 con 0x56292839a8d0 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4fd7400640 1 -- 172.21.15.17:0/3198923788 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f4fdc0d4020 con 0x56292839a8d0 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 10 client.5868 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 10 client.5868 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 20 client.5868 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5629283523e0 0x5629283acb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 4 client.5868 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3198923788 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629281ae990 con 0x5629283523e0 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5629283523e0 0x5629283acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5629283523e0 0x5629283acb90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a09337f6c03402a7 server_cookie=eea4d0325231cd06 in_seq=0 out_seq=0 2024-09-10T23:19:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4fd7400640 10 client.5868 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4fd7400640 1 -- 172.21.15.17:0/3198923788 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629281ae990 con 0x5629283523e0 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4fd7400640 10 client.5868 handle_command_reply: tid=0 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 client.5868 shutdown 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3198923788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 msgr2=0x562928351490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x562928351490 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009850 tx=0x7f4fdc01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3198923788 shutdown_connections 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5629283523e0 0x5629283acb90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 0x5629283519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x562928351490 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3198923788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 0x562928350f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4fd7400640 0 client.5868 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3198923788 >> 172.21.15.17:0/3198923788 conn(0x56292837b990 msgr2=0x56292834daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3198923788 shutdown_connections 2024-09-10T23:19:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3198923788 wait complete. 2024-09-10T23:19:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.817+0000 7f4ffbf34000 20 client.5868 trim_cache size 0 max 16384 2024-09-10T23:19:23.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 Processor -- start 2024-09-10T23:19:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 -- start start 2024-09-10T23:19:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292834e930 0x56292840d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839a8d0 0x56292840d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839b1f0 0x56292840dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4203380 con 0x56292839b1f0 2024-09-10T23:19:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff40cb770 con 0x56292839a8d0 2024-09-10T23:19:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff40cbdc0 con 0x56292834e930 2024-09-10T23:19:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839b1f0 0x56292840dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839b1f0 0x56292840dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37772/0 (socket says 172.21.15.17:37772) 2024-09-10T23:19:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff2800640 1 -- 172.21.15.17:0/375844718 learned_addr learned my addr 172.21.15.17:0/375844718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff2800640 1 -- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292834e930 msgr2=0x56292840d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4febe00640 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839a8d0 0x56292840d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292834e930 0x56292840d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff2800640 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292834e930 0x56292840d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff2800640 1 -- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839a8d0 msgr2=0x56292840d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff2800640 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839a8d0 0x56292840d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff2800640 1 -- 172.21.15.17:0/375844718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562928121180 con 0x56292839b1f0 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4febe00640 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839a8d0 0x56292840d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292834e930 0x56292840d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ff2800640 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839b1f0 0x56292840dd80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4fec015040 tx=0x7f4fec003af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d5f2814cf439a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4fe2000640 1 -- 172.21.15.17:0/375844718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00e8c0 con 0x56292839b1f0 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4fe2000640 1 -- 172.21.15.17:0/375844718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fec018050 con 0x56292839b1f0 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4fe2000640 1 -- 172.21.15.17:0/375844718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00ee50 con 0x56292839b1f0 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 -- 172.21.15.17:0/375844718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839b1f0 msgr2=0x56292840dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839b1f0 0x56292840dd80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4fec015040 tx=0x7f4fec003af0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 -- 172.21.15.17:0/375844718 shutdown_connections 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839b1f0 0x56292840dd80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292839a8d0 0x56292840d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/375844718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292834e930 0x56292840d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 -- 172.21.15.17:0/375844718 >> 172.21.15.17:0/375844718 conn(0x56292837b990 msgr2=0x562928379e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 -- 172.21.15.17:0/375844718 shutdown_connections 2024-09-10T23:19:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.837+0000 7f4ffbf34000 1 -- 172.21.15.17:0/375844718 wait complete. 2024-09-10T23:19:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 -- start start 2024-09-10T23:19:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 Processor -- start 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 0x5629283af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x5629283af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 0x5629283afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56292815f140 con 0x56292839a8d0 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5629281ab810 con 0x56292834e930 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56292815b6c0 con 0x56292839b1f0 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 10 client.0 _ll_register_callbacks cb 0x7f4fdc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4febe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x5629283af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4febe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x5629283af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37782/0 (socket says 172.21.15.17:37782) 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4febe00640 1 -- 172.21.15.17:0/3138901247 learned_addr learned my addr 172.21.15.17:0/3138901247 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ff2800640 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 0x5629283afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 0x5629283af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4febe00640 1 -- 172.21.15.17:0/3138901247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 msgr2=0x5629283afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4febe00640 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 0x5629283afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4febe00640 1 -- 172.21.15.17:0/3138901247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 msgr2=0x5629283af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4febe00640 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 0x5629283af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4febe00640 1 -- 172.21.15.17:0/3138901247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629281f8ed0 con 0x56292839a8d0 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4febe00640 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x5629283af920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc004660 tx=0x7f4fdc005080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c9570d93c0d377 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4fd7400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4fd7400640 1 -- 172.21.15.17:0/3138901247 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0b2070 con 0x56292839a8d0 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4fd7400640 1 -- 172.21.15.17:0/3138901247 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f4fdc0046d0 con 0x56292839a8d0 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3138901247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fec018050 con 0x56292839a8d0 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4fd7400640 1 -- 172.21.15.17:0/3138901247 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4fdc005d60 con 0x56292839a8d0 2024-09-10T23:19:23.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 10 client.5874 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3138901247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x562927e52600 con 0x56292839a8d0 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4fd7400640 1 -- 172.21.15.17:0/3138901247 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fec018050 con 0x56292839a8d0 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4fd7400640 1 -- 172.21.15.17:0/3138901247 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f4fdc0dd030 con 0x56292839a8d0 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 10 client.5874 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 10 client.5874 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 20 client.5874 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562928417510 0x562928419900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 4 client.5874 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3138901247 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x5629281aa440 con 0x562928417510 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562928417510 0x562928419900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4fd7400640 10 client.5874 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.841+0000 7f4ff1e00640 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562928417510 0x562928419900 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9b6da4a2091b2aa server_cookie=d1f42d80a3e1507e in_seq=0 out_seq=0 2024-09-10T23:19:23.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4fd7400640 1 -- 172.21.15.17:0/3138901247 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5629281aa440 con 0x562928417510 2024-09-10T23:19:23.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4fd7400640 10 client.5874 handle_command_reply: tid=0 2024-09-10T23:19:23.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 client.5874 shutdown 2024-09-10T23:19:23.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3138901247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 msgr2=0x5629283af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x5629283af920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc004660 tx=0x7f4fdc005080 comp rx=0 tx=0).stop 2024-09-10T23:19:23.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3138901247 shutdown_connections 2024-09-10T23:19:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x562928417510 0x562928419900 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56292839b1f0 0x5629283afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56292839a8d0 0x5629283af920 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 --2- 172.21.15.17:0/3138901247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56292834e930 0x5629283af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3138901247 >> 172.21.15.17:0/3138901247 conn(0x56292837b990 msgr2=0x56292834daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4fd7400640 0 client.5874 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3138901247 shutdown_connections 2024-09-10T23:19:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 1 -- 172.21.15.17:0/3138901247 wait complete. 2024-09-10T23:19:23.854 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f1e90c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a49 [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v550 pv554 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-10T23:19:22.935355+0000 b1048576 1=1+0) (ifile lock->xlock w=1) (iquiesce lock w=1) cr={5649=0-4194304@1} caps={5649=pAsLsXsFc/-@3} | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x557dbb61db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a49:[<0x10000000001/new_file_0 v550>,<0x10000000000/ceph-qa-suite v67>,<0x1/scrub_test_path v30>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-10T23:19:23.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ffbf34000 20 client.5874 trim_cache size 0 max 16384 2024-09-10T23:19:23.854 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:23.854 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:19:23.855 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "85ad6256-e1ae-4353-8cb6-fd6f0bc2008a", 2024-09-10T23:19:23.855 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:19:23.855 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:23.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 -- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4fd00725e0 msgr2=0x7f4fd0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4fd00725e0 0x7f4fd0074aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0af000 tx=0x7f4fdc01b120 comp rx=0 tx=0).stop 2024-09-10T23:19:23.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 -- 172.21.15.17:0/2058696105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d2260 msgr2=0x7f4ff4154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d2260 0x7f4ff4154060 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400d980 tx=0x7f4fe400de40 comp rx=0 tx=0).stop 2024-09-10T23:19:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 -- 172.21.15.17:0/2058696105 shutdown_connections 2024-09-10T23:19:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4fd00725e0 0x7f4fd0074aa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ff40d46d0 0x7f4ff40b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ff40d2640 0x7f4ff40b8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 --2- 172.21.15.17:0/2058696105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff40d2260 0x7f4ff4154060 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 -- 172.21.15.17:0/2058696105 >> 172.21.15.17:0/2058696105 conn(0x7f4ff409d0f0 msgr2=0x7f4ff406eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 -- 172.21.15.17:0/2058696105 shutdown_connections 2024-09-10T23:19:23.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:23.845+0000 7f4ff3200640 1 -- 172.21.15.17:0/2058696105 wait complete. 2024-09-10T23:19:23.870 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': '85ad6256-e1ae-4353-8cb6-fd6f0bc2008a', 'mode': 'asynchronous'}' 2024-09-10T23:19:23.870 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T23:19:23.870 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-10T23:19:24.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 -- 172.21.15.17:0/2392162269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840b19e0 msgr2=0x7f0b840b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 --2- 172.21.15.17:0/2392162269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840b19e0 0x7f0b840b1e50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0b8408e420 tx=0x7f0b7c01cd80 comp rx=0 tx=0).stop 2024-09-10T23:19:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 -- 172.21.15.17:0/2392162269 shutdown_connections 2024-09-10T23:19:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 --2- 172.21.15.17:0/2392162269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840b19e0 0x7f0b840b1e50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 --2- 172.21.15.17:0/2392162269 >> v2:172.21.15.77:3300/0 conn(0x7f0b840d49f0 0x7f0b840b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 -- 172.21.15.17:0/2392162269 >> 172.21.15.17:0/2392162269 conn(0x7f0b840d3ed0 msgr2=0x7f0b840d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 -- 172.21.15.17:0/2392162269 shutdown_connections 2024-09-10T23:19:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 -- 172.21.15.17:0/2392162269 wait complete. 2024-09-10T23:19:24.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 Processor -- start 2024-09-10T23:19:24.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 -- start start 2024-09-10T23:19:24.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b840b19e0 0x7f0b841535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840d49f0 0x7f0b840d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.017+0000 7f0b89e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b84161530 0x7f0b840d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b89e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8416b070 con 0x7f0b840d49f0 2024-09-10T23:19:24.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b89e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8416aef0 con 0x7f0b84161530 2024-09-10T23:19:24.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b89e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8416b1f0 con 0x7f0b840b19e0 2024-09-10T23:19:24.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840d49f0 0x7f0b840d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840d49f0 0x7f0b840d1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37790/0 (socket says 172.21.15.17:37790) 2024-09-10T23:19:24.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7be00640 1 -- 172.21.15.17:0/1452701638 learned_addr learned my addr 172.21.15.17:0/1452701638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:24.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b82a00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b840b19e0 0x7f0b841535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b83400640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b84161530 0x7f0b840d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7be00640 1 -- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b840b19e0 msgr2=0x7f0b841535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:24.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7be00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b840b19e0 0x7f0b841535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7be00640 1 -- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b84161530 msgr2=0x7f0b840d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:24.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7be00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b84161530 0x7f0b840d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7be00640 1 -- 172.21.15.17:0/1452701638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8415a340 con 0x7f0b840d49f0 2024-09-10T23:19:24.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b82a00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b840b19e0 0x7f0b841535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:24.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7be00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840d49f0 0x7f0b840d1d80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00d980 tx=0x7f0b6c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:24.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7b400640 1 -- 172.21.15.17:0/1452701638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c017070 con 0x7f0b840d49f0 2024-09-10T23:19:24.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7b400640 1 -- 172.21.15.17:0/1452701638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b6c009d20 con 0x7f0b840d49f0 2024-09-10T23:19:24.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7b400640 1 -- 172.21.15.17:0/1452701638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c004280 con 0x7f0b840d49f0 2024-09-10T23:19:24.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b89e00640 1 -- 172.21.15.17:0/1452701638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8415a5e0 con 0x7f0b840d49f0 2024-09-10T23:19:24.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b89e00640 1 -- 172.21.15.17:0/1452701638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b84153b20 con 0x7f0b840d49f0 2024-09-10T23:19:24.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.021+0000 7f0b7b400640 1 -- 172.21.15.17:0/1452701638 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0b6c003600 con 0x7f0b840d49f0 2024-09-10T23:19:24.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b7b400640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b60072610 0x7f0b60074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b7b400640 1 -- 172.21.15.17:0/1452701638 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f0b6c093510 con 0x7f0b840d49f0 2024-09-10T23:19:24.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 Processor -- start 2024-09-10T23:19:24.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 -- start start 2024-09-10T23:19:24.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b82a00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b60072610 0x7f0b60074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b82a00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b60072610 0x7f0b60074ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0b74007fd0 tx=0x7f0b74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c777780580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 0x55c777736680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777736fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c77761ecb0 con 0x55c777736bc0 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c777534310 con 0x55c777780ac0 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c777591b90 con 0x55c7777801a0 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777736fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777736fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37792/0 (socket says 172.21.15.17:37792) 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b83400640 1 -- 172.21.15.17:0/1593118242 learned_addr learned my addr 172.21.15.17:0/1593118242 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b82a00640 1 --2- 172.21.15.17:0/1593118242 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c777780580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b7be00640 1 --2- 172.21.15.17:0/1593118242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 0x55c777736680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b83400640 1 -- 172.21.15.17:0/1593118242 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 msgr2=0x55c777780580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b83400640 1 --2- 172.21.15.17:0/1593118242 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c777780580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b83400640 1 -- 172.21.15.17:0/1593118242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 msgr2=0x55c777736680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b83400640 1 --2- 172.21.15.17:0/1593118242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 0x55c777736680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b83400640 1 -- 172.21.15.17:0/1593118242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c777535c60 con 0x55c777736bc0 2024-09-10T23:19:24.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b83400640 1 --2- 172.21.15.17:0/1593118242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777736fa0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009bd0 tx=0x7f0b7c019b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8575ddf764a9e2d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b73e00640 1 -- 172.21.15.17:0/1593118242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0b2040 con 0x55c777736bc0 2024-09-10T23:19:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b73e00640 1 -- 172.21.15.17:0/1593118242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b7c0a5c50 con 0x55c777736bc0 2024-09-10T23:19:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b73e00640 1 -- 172.21.15.17:0/1593118242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c004c90 con 0x55c777736bc0 2024-09-10T23:19:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 -- 172.21.15.17:0/1593118242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 msgr2=0x55c777736fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.025+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1593118242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777736fa0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009bd0 tx=0x7f0b7c019b20 comp rx=0 tx=0).stop 2024-09-10T23:19:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 -- 172.21.15.17:0/1593118242 shutdown_connections 2024-09-10T23:19:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1593118242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777736fa0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1593118242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 0x55c777736680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1593118242 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c777780580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 -- 172.21.15.17:0/1593118242 >> 172.21.15.17:0/1593118242 conn(0x55c77773cd20 msgr2=0x55c777734f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 -- 172.21.15.17:0/1593118242 shutdown_connections 2024-09-10T23:19:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 -- 172.21.15.17:0/1593118242 wait complete. 2024-09-10T23:19:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 -- start start 2024-09-10T23:19:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 Processor -- start 2024-09-10T23:19:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777787530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7777801a0 0x55c777787a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c777780ac0 0x55c777787fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c777584dd0 con 0x55c777736bc0 2024-09-10T23:19:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c777580fc0 con 0x55c7777801a0 2024-09-10T23:19:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c7775264b0 con 0x55c777780ac0 2024-09-10T23:19:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 10 client.0 _ll_register_callbacks cb 0x55c7775047d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b82a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777787530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b82a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777787530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37802/0 (socket says 172.21.15.17:37802) 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b82a00640 1 -- 172.21.15.17:0/2736707965 learned_addr learned my addr 172.21.15.17:0/2736707965 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b7be00640 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7777801a0 0x55c777787a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b83400640 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c777780ac0 0x55c777787fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b82a00640 1 -- 172.21.15.17:0/2736707965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c777780ac0 msgr2=0x55c777787fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b82a00640 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c777780ac0 0x55c777787fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b82a00640 1 -- 172.21.15.17:0/2736707965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7777801a0 msgr2=0x55c777787a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b82a00640 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7777801a0 0x55c777787a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b82a00640 1 -- 172.21.15.17:0/2736707965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c77751f1f0 con 0x55c777736bc0 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b82a00640 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777787530 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0b74014950 tx=0x7f0b74000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80eb6584b9007595 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b70c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b70c00640 1 -- 172.21.15.17:0/2736707965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74025020 con 0x55c777736bc0 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b70c00640 1 -- 172.21.15.17:0/2736707965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f0b74013ac0 con 0x55c777736bc0 2024-09-10T23:19:24.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.029+0000 7f0b8d247000 1 -- 172.21.15.17:0/2736707965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c777519330 con 0x55c777736bc0 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b70c00640 1 -- 172.21.15.17:0/2736707965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0b7402f050 con 0x55c777736bc0 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 10 client.5886 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 -- 172.21.15.17:0/2736707965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55c777505fa0 con 0x55c777736bc0 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b70c00640 1 -- 172.21.15.17:0/2736707965 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c777519330 con 0x55c777736bc0 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b70c00640 1 -- 172.21.15.17:0/2736707965 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f0b74032020 con 0x55c777736bc0 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 10 client.5886 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 10 client.5886 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 20 client.5886 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c77778f900 0x55c777791cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 4 client.5886 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 -- 172.21.15.17:0/2736707965 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c777593ae0 con 0x55c77778f900 2024-09-10T23:19:24.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b7be00640 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c77778f900 0x55c777791cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b70c00640 10 client.5886 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b7be00640 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c77778f900 0x55c777791cf0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=948dcb02ffe19bca server_cookie=c6f250ee01788b5b in_seq=0 out_seq=0 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b70c00640 1 -- 172.21.15.17:0/2736707965 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c777593ae0 con 0x55c77778f900 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b70c00640 10 client.5886 handle_command_reply: tid=0 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 client.5886 shutdown 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 -- 172.21.15.17:0/2736707965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 msgr2=0x55c777787530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777787530 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0b74014950 tx=0x7f0b74000ee0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 -- 172.21.15.17:0/2736707965 shutdown_connections 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c77778f900 0x55c777791cf0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c777780ac0 0x55c777787fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7777801a0 0x55c777787a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b70c00640 0 client.5886 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 --2- 172.21.15.17:0/2736707965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c777787530 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 -- 172.21.15.17:0/2736707965 >> 172.21.15.17:0/2736707965 conn(0x55c77773cd20 msgr2=0x55c777734f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 -- 172.21.15.17:0/2736707965 shutdown_connections 2024-09-10T23:19:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 1 -- 172.21.15.17:0/2736707965 wait complete. 2024-09-10T23:19:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.033+0000 7f0b8d247000 20 client.5886 trim_cache size 0 max 16384 2024-09-10T23:19:24.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b8d247000 1 Processor -- start 2024-09-10T23:19:24.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b8d247000 1 -- start start 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c77778ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c777736070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 0x55c7777365b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b8d247000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0b842049a0 con 0x55c777736bc0 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b8d247000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b84203a40 con 0x55c777780ac0 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b8d247000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b84159260 con 0x55c7777801a0 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b82a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c77778ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b82a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c77778ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37806/0 (socket says 172.21.15.17:37806) 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b82a00640 1 -- 172.21.15.17:0/831208365 learned_addr learned my addr 172.21.15.17:0/831208365 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:24.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b7be00640 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c777736070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b83400640 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 0x55c7777365b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b82a00640 1 -- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 msgr2=0x55c777736070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b82a00640 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c777736070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b82a00640 1 -- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 msgr2=0x55c7777365b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b82a00640 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 0x55c7777365b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b82a00640 1 -- 172.21.15.17:0/831208365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7775de660 con 0x55c777736bc0 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b7be00640 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c777736070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b83400640 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 0x55c7777365b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b82a00640 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c77778ddc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0b74013d00 tx=0x7f0b74007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c787d66e3159c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.053+0000 7f0b73400640 1 -- 172.21.15.17:0/831208365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74025070 con 0x55c777736bc0 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b73400640 1 -- 172.21.15.17:0/831208365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b7401b070 con 0x55c777736bc0 2024-09-10T23:19:24.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b73400640 1 -- 172.21.15.17:0/831208365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7402a940 con 0x55c777736bc0 2024-09-10T23:19:24.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 -- 172.21.15.17:0/831208365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 msgr2=0x55c77778ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:24.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c77778ddc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0b74013d00 tx=0x7f0b74007e40 comp rx=0 tx=0).stop 2024-09-10T23:19:24.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 -- 172.21.15.17:0/831208365 shutdown_connections 2024-09-10T23:19:24.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777780ac0 0x55c7777365b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c777736070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 --2- 172.21.15.17:0/831208365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777736bc0 0x55c77778ddc0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 -- 172.21.15.17:0/831208365 >> 172.21.15.17:0/831208365 conn(0x55c77773cd20 msgr2=0x55c777735960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:24.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 -- 172.21.15.17:0/831208365 shutdown_connections 2024-09-10T23:19:24.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 -- 172.21.15.17:0/831208365 wait complete. 2024-09-10T23:19:24.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 -- start start 2024-09-10T23:19:24.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 Processor -- start 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777736bc0 0x55c77778cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c77778d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777780ac0 0x55c7777b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c777584dd0 con 0x55c777780ac0 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c77773fd40 con 0x55c777736bc0 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c77773d100 con 0x55c7777801a0 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b8d247000 10 client.0 _ll_register_callbacks cb 0x7f0b74001840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777780ac0 0x55c7777b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777780ac0 0x55c7777b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37812/0 (socket says 172.21.15.17:37812) 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b82a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777736bc0 0x55c77778cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b83400640 1 -- 172.21.15.17:0/1881613761 learned_addr learned my addr 172.21.15.17:0/1881613761 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b7be00640 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c77778d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b83400640 1 -- 172.21.15.17:0/1881613761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 msgr2=0x55c77778d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b83400640 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c77778d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b83400640 1 -- 172.21.15.17:0/1881613761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777736bc0 msgr2=0x55c77778cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b83400640 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777736bc0 0x55c77778cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b83400640 1 -- 172.21.15.17:0/1881613761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c77754b090 con 0x55c777780ac0 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b82a00640 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777736bc0 0x55c77778cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b83400640 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777780ac0 0x55c7777b2210 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c01c7f0 tx=0x7f0b7c0a5a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880a563a9d1f337f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.057+0000 7f0b70c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b70c00640 1 -- 172.21.15.17:0/1881613761 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0c7060 con 0x55c777780ac0 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b70c00640 1 -- 172.21.15.17:0/1881613761 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f0b7c004a50 con 0x55c777780ac0 2024-09-10T23:19:24.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 -- 172.21.15.17:0/1881613761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b7401b070 con 0x55c777780ac0 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b70c00640 1 -- 172.21.15.17:0/1881613761 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0b7c0b2050 con 0x55c777780ac0 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 10 client.5892 fetch_fsmap learned FSMap version 29 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 -- 172.21.15.17:0/1881613761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55c7775175f0 con 0x55c777780ac0 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b70c00640 1 -- 172.21.15.17:0/1881613761 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b7401b070 con 0x55c777780ac0 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b70c00640 1 -- 172.21.15.17:0/1881613761 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f0b7c004c50 con 0x55c777780ac0 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 10 client.5892 fetch_fsmap finished waiting for FSMap version 29 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 10 client.5892 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 20 client.5892 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c7777b2c00 0x55c7777f5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 4 client.5892 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 -- 172.21.15.17:0/1881613761 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c77758f590 con 0x55c7777b2c00 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b82a00640 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c7777b2c00 0x55c7777f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b82a00640 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c7777b2c00 0x55c7777f5640 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3acb174f6ba32b16 server_cookie=85d219c4b1ed551c in_seq=0 out_seq=0 2024-09-10T23:19:24.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b70c00640 10 client.5892 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b70c00640 1 -- 172.21.15.17:0/1881613761 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2005 (crc 0 0 0) 0x55c77758f590 con 0x55c7777b2c00 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b70c00640 10 client.5892 handle_command_reply: tid=0 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 client.5892 shutdown 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 -- 172.21.15.17:0/1881613761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777780ac0 msgr2=0x55c7777b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777780ac0 0x55c7777b2210 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c01c7f0 tx=0x7f0b7c0a5a50 comp rx=0 tx=0).stop 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 -- 172.21.15.17:0/1881613761 shutdown_connections 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c7777b2c00 0x55c7777f5640 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c777780ac0 0x55c7777b2210 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c7777801a0 0x55c77778d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 --2- 172.21.15.17:0/1881613761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c777736bc0 0x55c77778cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b70c00640 0 client.5892 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 -- 172.21.15.17:0/1881613761 >> 172.21.15.17:0/1881613761 conn(0x55c77773cd20 msgr2=0x55c777736180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:24.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 -- 172.21.15.17:0/1881613761 shutdown_connections 2024-09-10T23:19:24.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 1 -- 172.21.15.17:0/1881613761 wait complete. 2024-09-10T23:19:24.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b8d247000 20 client.5892 trim_cache size 0 max 16384 2024-09-10T23:19:24.071 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:19:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:19:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "85ad6256-e1ae-4353-8cb6-fd6f0bc2008a": { 2024-09-10T23:19:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-10T23:19:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "85ad6256-e1ae-4353-8cb6-fd6f0bc2008a", 2024-09-10T23:19:24.071 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "" 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "db1624da-5cab-4b28-a529-f4f91b115d8e": { 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "db1624da-5cab-4b28-a529-f4f91b115d8e", 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "" 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "e44aa676-1420-4803-a2af-66c72fe9179e": { 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "e44aa676-1420-4803-a2af-66c72fe9179e", 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "" 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:24.072 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "85ad6256-e1ae-4353-8cb6-fd6f0bc2008a": { 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:23.845761+0000", 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "e44aa676-1420-4803-a2af-66c72fe9179e": { 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:22.557771+0000", 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:24.073 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "db1624da-5cab-4b28-a529-f4f91b115d8e": { 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:22.133774+0000", 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "6585d22e-42c6-4013-856e-9e3cea69c110": { 2024-09-10T23:19:24.074 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:21.525779+0000", 2024-09-10T23:19:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-10T23:19:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:24.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:24.075 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 -- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b60072610 msgr2=0x7f0b60074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b60072610 0x7f0b60074ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0b74007fd0 tx=0x7f0b74009040 comp rx=0 tx=0).stop 2024-09-10T23:19:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 -- 172.21.15.17:0/1452701638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840d49f0 msgr2=0x7f0b840d1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840d49f0 0x7f0b840d1d80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00d980 tx=0x7f0b6c00de40 comp rx=0 tx=0).stop 2024-09-10T23:19:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 -- 172.21.15.17:0/1452701638 shutdown_connections 2024-09-10T23:19:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b60072610 0x7f0b60074ad0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b84161530 0x7f0b840d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b840d49f0 0x7f0b840d1d80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 --2- 172.21.15.17:0/1452701638 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b840b19e0 0x7f0b841535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 -- 172.21.15.17:0/1452701638 >> 172.21.15.17:0/1452701638 conn(0x7f0b840d3ed0 msgr2=0x7f0b840d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 -- 172.21.15.17:0/1452701638 shutdown_connections 2024-09-10T23:19:24.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:24.061+0000 7f0b89e00640 1 -- 172.21.15.17:0/1452701638 wait complete. 2024-09-10T23:19:28.741 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:19:28.737+0000 7f03a1800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T23:19:29.087 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T23:19:29.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-10T23:19:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.241+0000 7f652d800640 1 -- 172.21.15.17:0/2186656289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b1400 msgr2=0x7f6528074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.241+0000 7f652d800640 1 --2- 172.21.15.17:0/2186656289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b1400 0x7f6528074290 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f652809e3f0 tx=0x7f651801c830 comp rx=0 tx=0).stop 2024-09-10T23:19:29.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.241+0000 7f652d800640 1 -- 172.21.15.17:0/2186656289 shutdown_connections 2024-09-10T23:19:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.241+0000 7f652d800640 1 --2- 172.21.15.17:0/2186656289 >> v2:172.21.15.77:3300/0 conn(0x7f65280b5040 0x7f65280b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.241+0000 7f652d800640 1 --2- 172.21.15.17:0/2186656289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65280b17e0 0x7f65280747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.241+0000 7f652d800640 1 --2- 172.21.15.17:0/2186656289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b1400 0x7f6528074290 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.241+0000 7f652d800640 1 -- 172.21.15.17:0/2186656289 >> 172.21.15.17:0/2186656289 conn(0x7f65280d0320 msgr2=0x7f65280d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.241+0000 7f652d800640 1 -- 172.21.15.17:0/2186656289 shutdown_connections 2024-09-10T23:19:29.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.241+0000 7f652d800640 1 -- 172.21.15.17:0/2186656289 wait complete. 2024-09-10T23:19:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 Processor -- start 2024-09-10T23:19:29.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 -- start start 2024-09-10T23:19:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65280b1400 0x7f65281f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65280b17e0 0x7f65280c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b5040 0x7f65280cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f652806d170 con 0x7f65280b5040 2024-09-10T23:19:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f652806d6e0 con 0x7f65280b1400 2024-09-10T23:19:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f652806cbc0 con 0x7f65280b17e0 2024-09-10T23:19:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6527400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b5040 0x7f65280cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6527400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b5040 0x7f65280cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48506/0 (socket says 172.21.15.17:48506) 2024-09-10T23:19:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6527400640 1 -- 172.21.15.17:0/3869195566 learned_addr learned my addr 172.21.15.17:0/3869195566 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f651e000640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65280b17e0 0x7f65280c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6526a00640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65280b1400 0x7f65281f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6527400640 1 -- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65280b17e0 msgr2=0x7f65280c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6527400640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65280b17e0 0x7f65280c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6527400640 1 -- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65280b1400 msgr2=0x7f65281f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6527400640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65280b1400 0x7f65281f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6527400640 1 -- 172.21.15.17:0/3869195566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65280c9910 con 0x7f65280b5040 2024-09-10T23:19:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f6527400640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b5040 0x7f65280cbd30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f652000e970 tx=0x7f652000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f651f400640 1 -- 172.21.15.17:0/3869195566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520004d30 con 0x7f65280b5040 2024-09-10T23:19:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f651f400640 1 -- 172.21.15.17:0/3869195566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f652000cb20 con 0x7f65280b5040 2024-09-10T23:19:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f651f400640 1 -- 172.21.15.17:0/3869195566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520005020 con 0x7f65280b5040 2024-09-10T23:19:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 -- 172.21.15.17:0/3869195566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6528152de0 con 0x7f65280b5040 2024-09-10T23:19:29.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.245+0000 7f652d800640 1 -- 172.21.15.17:0/3869195566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65281f79f0 con 0x7f65280b5040 2024-09-10T23:19:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f651f400640 1 -- 172.21.15.17:0/3869195566 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f652000f040 con 0x7f65280b5040 2024-09-10T23:19:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f651f400640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65040725e0 0x7f6504074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f651f400640 1 -- 172.21.15.17:0/3869195566 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f6520093980 con 0x7f65280b5040 2024-09-10T23:19:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6530cc6000 1 Processor -- start 2024-09-10T23:19:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6526a00640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65040725e0 0x7f6504074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6530cc6000 1 -- start start 2024-09-10T23:19:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6526a00640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65040725e0 0x7f6504074aa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f65180af000 tx=0x7f651801b070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b07215a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b072110680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6530cc6000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b071ff8cb0 con 0x55b072110bc0 2024-09-10T23:19:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6530cc6000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b071f0e310 con 0x55b07215aac0 2024-09-10T23:19:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.249+0000 7f6530cc6000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b071f6bb90 con 0x55b07215a1a0 2024-09-10T23:19:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6527400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6527400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48514/0 (socket says 172.21.15.17:48514) 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6527400640 1 -- 172.21.15.17:0/3733775120 learned_addr learned my addr 172.21.15.17:0/3733775120 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6526a00640 1 --2- 172.21.15.17:0/3733775120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b07215a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f651e000640 1 --2- 172.21.15.17:0/3733775120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b072110680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6527400640 1 -- 172.21.15.17:0/3733775120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 msgr2=0x55b07215a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6527400640 1 --2- 172.21.15.17:0/3733775120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b07215a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6527400640 1 -- 172.21.15.17:0/3733775120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 msgr2=0x55b072110680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6527400640 1 --2- 172.21.15.17:0/3733775120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b072110680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6527400640 1 -- 172.21.15.17:0/3733775120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b071f0fc60 con 0x55b072110bc0 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6527400640 1 --2- 172.21.15.17:0/3733775120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110fa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f652000c640 tx=0x7f652005dfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f996ff626a6e96a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6517400640 1 -- 172.21.15.17:0/3733775120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652001f040 con 0x55b072110bc0 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6517400640 1 -- 172.21.15.17:0/3733775120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6520063030 con 0x55b072110bc0 2024-09-10T23:19:29.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6517400640 1 -- 172.21.15.17:0/3733775120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652005dce0 con 0x55b072110bc0 2024-09-10T23:19:29.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 -- 172.21.15.17:0/3733775120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 msgr2=0x55b072110fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 --2- 172.21.15.17:0/3733775120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110fa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f652000c640 tx=0x7f652005dfb0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 -- 172.21.15.17:0/3733775120 shutdown_connections 2024-09-10T23:19:29.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 --2- 172.21.15.17:0/3733775120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110fa0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 --2- 172.21.15.17:0/3733775120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b072110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 --2- 172.21.15.17:0/3733775120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b07215a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 -- 172.21.15.17:0/3733775120 >> 172.21.15.17:0/3733775120 conn(0x55b072116d20 msgr2=0x55b07210ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 -- 172.21.15.17:0/3733775120 shutdown_connections 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 -- 172.21.15.17:0/3733775120 wait complete. 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 -- start start 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 Processor -- start 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b072161a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b072161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b071f5edd0 con 0x55b072110bc0 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b071f5afc0 con 0x55b07215aac0 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b071f004b0 con 0x55b07215a1a0 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.253+0000 7f6530cc6000 10 client.0 _ll_register_callbacks cb 0x55b071ede7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072161530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48520/0 (socket says 172.21.15.17:48520) 2024-09-10T23:19:29.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6526a00640 1 -- 172.21.15.17:0/734330525 learned_addr learned my addr 172.21.15.17:0/734330525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f651e000640 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b072161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6527400640 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b072161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6526a00640 1 -- 172.21.15.17:0/734330525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 msgr2=0x55b072161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6526a00640 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b072161a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6526a00640 1 -- 172.21.15.17:0/734330525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 msgr2=0x55b072161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6526a00640 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b072161fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6526a00640 1 -- 172.21.15.17:0/734330525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b071ef91f0 con 0x55b072110bc0 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6526a00640 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072161530 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f651801cd10 tx=0x7f6518009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c619226a21ac86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 1 -- 172.21.15.17:0/734330525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65180a66c0 con 0x55b072110bc0 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 -- 172.21.15.17:0/734330525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b071ef3330 con 0x55b072110bc0 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 1 -- 172.21.15.17:0/734330525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f65180a6860 con 0x55b072110bc0 2024-09-10T23:19:29.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 1 -- 172.21.15.17:0/734330525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f65180a6a60 con 0x55b072110bc0 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 10 client.5904 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 -- 172.21.15.17:0/734330525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55b071edffa0 con 0x55b072110bc0 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 1 -- 172.21.15.17:0/734330525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b071ef3330 con 0x55b072110bc0 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 1 -- 172.21.15.17:0/734330525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f65180c4070 con 0x55b072110bc0 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 10 client.5904 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 10 client.5904 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 20 client.5904 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b072169900 0x55b07216bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 4 client.5904 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 -- 172.21.15.17:0/734330525 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b071f6dae0 con 0x55b072169900 2024-09-10T23:19:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f651e000640 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b072169900 0x55b07216bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f651e000640 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b072169900 0x55b07216bcf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4b46c408f901949 server_cookie=7bb2a7872d608acc in_seq=0 out_seq=0 2024-09-10T23:19:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 10 client.5904 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 1 -- 172.21.15.17:0/734330525 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b071f6dae0 con 0x55b072169900 2024-09-10T23:19:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 10 client.5904 handle_command_reply: tid=0 2024-09-10T23:19:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 client.5904 shutdown 2024-09-10T23:19:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 -- 172.21.15.17:0/734330525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 msgr2=0x55b072161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072161530 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f651801cd10 tx=0x7f6518009260 comp rx=0 tx=0).stop 2024-09-10T23:19:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 -- 172.21.15.17:0/734330525 shutdown_connections 2024-09-10T23:19:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b072169900 0x55b07216bcf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b072161fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b072161a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f650be00640 0 client.5904 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 --2- 172.21.15.17:0/734330525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072161530 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 -- 172.21.15.17:0/734330525 >> 172.21.15.17:0/734330525 conn(0x55b072116d20 msgr2=0x55b07210ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 -- 172.21.15.17:0/734330525 shutdown_connections 2024-09-10T23:19:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.257+0000 7f6530cc6000 1 -- 172.21.15.17:0/734330525 wait complete. 2024-09-10T23:19:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.261+0000 7f6530cc6000 20 client.5904 trim_cache size 0 max 16384 2024-09-10T23:19:29.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6530cc6000 1 Processor -- start 2024-09-10T23:19:29.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6530cc6000 1 -- start start 2024-09-10T23:19:29.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215a1a0 0x55b0721105b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215aac0 0x55b072164310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6530cc6000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6528204aa0 con 0x55b072110bc0 2024-09-10T23:19:29.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6530cc6000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6528203b00 con 0x55b07215a1a0 2024-09-10T23:19:29.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6530cc6000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6528154810 con 0x55b07215aac0 2024-09-10T23:19:29.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48530/0 (socket says 172.21.15.17:48530) 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6526a00640 1 -- 172.21.15.17:0/2544054265 learned_addr learned my addr 172.21.15.17:0/2544054265 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f651e000640 1 --2- 172.21.15.17:0/2544054265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215a1a0 0x55b0721105b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6527400640 1 --2- 172.21.15.17:0/2544054265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215aac0 0x55b072164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6526a00640 1 -- 172.21.15.17:0/2544054265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215aac0 msgr2=0x55b072164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6526a00640 1 --2- 172.21.15.17:0/2544054265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215aac0 0x55b072164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6526a00640 1 -- 172.21.15.17:0/2544054265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215a1a0 msgr2=0x55b0721105b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6526a00640 1 --2- 172.21.15.17:0/2544054265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215a1a0 0x55b0721105b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6526a00640 1 -- 172.21.15.17:0/2544054265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b071fb8660 con 0x55b072110bc0 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6526a00640 1 --2- 172.21.15.17:0/2544054265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110070 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f65180b0040 tx=0x7f65180a6c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d4cafb81631b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.277+0000 7f6516a00640 1 -- 172.21.15.17:0/2544054265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65180a66c0 con 0x55b072110bc0 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6516a00640 1 -- 172.21.15.17:0/2544054265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65180c7560 con 0x55b072110bc0 2024-09-10T23:19:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6516a00640 1 -- 172.21.15.17:0/2544054265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65180c79b0 con 0x55b072110bc0 2024-09-10T23:19:29.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- 172.21.15.17:0/2544054265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 msgr2=0x55b072110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 --2- 172.21.15.17:0/2544054265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110070 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f65180b0040 tx=0x7f65180a6c00 comp rx=0 tx=0).stop 2024-09-10T23:19:29.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- 172.21.15.17:0/2544054265 shutdown_connections 2024-09-10T23:19:29.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 --2- 172.21.15.17:0/2544054265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215aac0 0x55b072164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 --2- 172.21.15.17:0/2544054265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215a1a0 0x55b0721105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 --2- 172.21.15.17:0/2544054265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072110070 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- 172.21.15.17:0/2544054265 >> 172.21.15.17:0/2544054265 conn(0x55b072116d20 msgr2=0x55b07210f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- 172.21.15.17:0/2544054265 shutdown_connections 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- 172.21.15.17:0/2544054265 wait complete. 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- start start 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 Processor -- start 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072166fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b072167500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b07218c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b071f5edd0 con 0x55b072110bc0 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b071f55ec0 con 0x55b07215aac0 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b072119d40 con 0x55b07215a1a0 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 10 client.0 _ll_register_callbacks cb 0x7f6518003600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072166fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072166fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48538/0 (socket says 172.21.15.17:48538) 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6526a00640 1 -- 172.21.15.17:0/66400675 learned_addr learned my addr 172.21.15.17:0/66400675 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6527400640 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b07218c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f651e000640 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b072167500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6526a00640 1 -- 172.21.15.17:0/66400675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 msgr2=0x55b072167500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6526a00640 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b072167500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6526a00640 1 -- 172.21.15.17:0/66400675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 msgr2=0x55b07218c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6526a00640 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b07218c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6526a00640 1 -- 172.21.15.17:0/66400675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b071f25090 con 0x55b072110bc0 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6527400640 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b07218c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6526a00640 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072166fc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f65180981d0 tx=0x7f65180a6ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41333e2411d6169 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f650be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f650be00640 1 -- 172.21.15.17:0/66400675 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65180dc060 con 0x55b072110bc0 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f650be00640 1 -- 172.21.15.17:0/66400675 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f65180c7960 con 0x55b072110bc0 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- 172.21.15.17:0/66400675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65180c7560 con 0x55b072110bc0 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f650be00640 1 -- 172.21.15.17:0/66400675 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f65180e2050 con 0x55b072110bc0 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 10 client.5910 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.281+0000 7f6530cc6000 1 -- 172.21.15.17:0/66400675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55b071ef15f0 con 0x55b072110bc0 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f650be00640 1 -- 172.21.15.17:0/66400675 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65180c7560 con 0x55b072110bc0 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f650be00640 1 -- 172.21.15.17:0/66400675 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f65180e5020 con 0x55b072110bc0 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 10 client.5910 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 10 client.5910 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:29.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 20 client.5910 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b07218cc00 0x55b0721cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 4 client.5910 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 -- 172.21.15.17:0/66400675 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b071f69590 con 0x55b07218cc00 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f651e000640 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b07218cc00 0x55b0721cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f651e000640 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b07218cc00 0x55b0721cf640 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7860c512d0d37437 server_cookie=c41e3a112876d592 in_seq=0 out_seq=0 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f650be00640 10 client.5910 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f650be00640 1 -- 172.21.15.17:0/66400675 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1372 (crc 0 0 0) 0x55b071f69590 con 0x55b07218cc00 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f650be00640 10 client.5910 handle_command_reply: tid=0 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 client.5910 shutdown 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 -- 172.21.15.17:0/66400675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 msgr2=0x55b072166fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072166fc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f65180981d0 tx=0x7f65180a6ed0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 -- 172.21.15.17:0/66400675 shutdown_connections 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55b07218cc00 0x55b0721cf640 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b07215aac0 0x55b07218c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b07215a1a0 0x55b072167500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f650be00640 0 client.5910 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 --2- 172.21.15.17:0/66400675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b072110bc0 0x55b072166fc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 -- 172.21.15.17:0/66400675 >> 172.21.15.17:0/66400675 conn(0x55b072116d20 msgr2=0x55b072110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 -- 172.21.15.17:0/66400675 shutdown_connections 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 1 -- 172.21.15.17:0/66400675 wait complete. 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f6530cc6000 20 client.5910 trim_cache size 0 max 16384 2024-09-10T23:19:29.295 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "85ad6256-e1ae-4353-8cb6-fd6f0bc2008a": { 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:23.845761+0000", 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:29.296 INFO:teuthology.orchestra.run.smithi017.stdout: "e44aa676-1420-4803-a2af-66c72fe9179e": { 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:22.557771+0000", 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "db1624da-5cab-4b28-a529-f4f91b115d8e": { 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:22.133774+0000", 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:29.297 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: "6585d22e-42c6-4013-856e-9e3cea69c110": { 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:21.525779+0000", 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:29.298 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 -- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65040725e0 msgr2=0x7f6504074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65040725e0 0x7f6504074aa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f65180af000 tx=0x7f651801b070 comp rx=0 tx=0).stop 2024-09-10T23:19:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 -- 172.21.15.17:0/3869195566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b5040 msgr2=0x7f65280cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b5040 0x7f65280cbd30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f652000e970 tx=0x7f652000ee30 comp rx=0 tx=0).stop 2024-09-10T23:19:29.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 -- 172.21.15.17:0/3869195566 shutdown_connections 2024-09-10T23:19:29.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65040725e0 0x7f6504074aa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65280b5040 0x7f65280cbd30 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65280b17e0 0x7f65280c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 --2- 172.21.15.17:0/3869195566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65280b1400 0x7f65281f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 -- 172.21.15.17:0/3869195566 >> 172.21.15.17:0/3869195566 conn(0x7f65280d0320 msgr2=0x7f65280ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 -- 172.21.15.17:0/3869195566 shutdown_connections 2024-09-10T23:19:29.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.285+0000 7f652d800640 1 -- 172.21.15.17:0/3869195566 wait complete. 2024-09-10T23:19:29.309 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:19:29.309 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-10T23:19:29.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.453+0000 7f5d93400640 1 -- 172.21.15.17:0/2257384264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d8c0b1400 msgr2=0x7f5d8c074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.453+0000 7f5d93400640 1 --2- 172.21.15.17:0/2257384264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d8c0b1400 0x7f5d8c074290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009870 tx=0x7f5d8001c5a0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.453+0000 7f5d93400640 1 -- 172.21.15.17:0/2257384264 shutdown_connections 2024-09-10T23:19:29.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.453+0000 7f5d93400640 1 --2- 172.21.15.17:0/2257384264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d8c0b1400 0x7f5d8c074290 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.453+0000 7f5d93400640 1 -- 172.21.15.17:0/2257384264 >> 172.21.15.17:0/2257384264 conn(0x7f5d8c0d0320 msgr2=0x7f5d8c0d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.453+0000 7f5d93400640 1 -- 172.21.15.17:0/2257384264 shutdown_connections 2024-09-10T23:19:29.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.453+0000 7f5d93400640 1 -- 172.21.15.17:0/2257384264 wait complete. 2024-09-10T23:19:29.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.453+0000 7f5d93400640 1 Processor -- start 2024-09-10T23:19:29.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d93400640 1 -- start start 2024-09-10T23:19:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d93400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d8c0b1400 0x7f5d8c151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d93400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d8c0b17e0 0x7f5d8c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8c15ee80 0x7f5d8c157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d93400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c06cd40 con 0x7f5d8c15ee80 2024-09-10T23:19:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d93400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c06cbc0 con 0x7f5d8c0b17e0 2024-09-10T23:19:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d93400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8c0ca970 con 0x7f5d8c0b1400 2024-09-10T23:19:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d91400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8c15ee80 0x7f5d8c157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d90a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d8c0b1400 0x7f5d8c151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d90a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d8c0b1400 0x7f5d8c151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:60626/0 (socket says 172.21.15.17:60626) 2024-09-10T23:19:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d8be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d8c0b17e0 0x7f5d8c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d91400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8c15ee80 0x7f5d8c157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48544/0 (socket says 172.21.15.17:48544) 2024-09-10T23:19:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d90a00640 1 -- 172.21.15.17:0/1254315163 learned_addr learned my addr 172.21.15.17:0/1254315163 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d91400640 1 -- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d8c0b1400 msgr2=0x7f5d8c151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d91400640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d8c0b1400 0x7f5d8c151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d91400640 1 -- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d8c0b17e0 msgr2=0x7f5d8c156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d91400640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d8c0b17e0 0x7f5d8c156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d91400640 1 -- 172.21.15.17:0/1254315163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c0cbfd0 con 0x7f5d8c15ee80 2024-09-10T23:19:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d91400640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8c15ee80 0x7f5d8c157400 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5d840015b0 tx=0x7f5d8400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d88c00640 1 -- 172.21.15.17:0/1254315163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84017070 con 0x7f5d8c15ee80 2024-09-10T23:19:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d88c00640 1 -- 172.21.15.17:0/1254315163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d84005070 con 0x7f5d8c15ee80 2024-09-10T23:19:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d88c00640 1 -- 172.21.15.17:0/1254315163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d840054c0 con 0x7f5d8c15ee80 2024-09-10T23:19:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d93400640 1 -- 172.21.15.17:0/1254315163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c0af100 con 0x7f5d8c15ee80 2024-09-10T23:19:29.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.457+0000 7f5d93400640 1 -- 172.21.15.17:0/1254315163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8c157f60 con 0x7f5d8c15ee80 2024-09-10T23:19:29.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d88c00640 1 -- 172.21.15.17:0/1254315163 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5d84005660 con 0x7f5d8c15ee80 2024-09-10T23:19:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d88c00640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d6c0725e0 0x7f5d6c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d96800000 1 Processor -- start 2024-09-10T23:19:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d88c00640 1 -- 172.21.15.17:0/1254315163 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f5d84092ca0 con 0x7f5d8c15ee80 2024-09-10T23:19:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d90a00640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d6c0725e0 0x7f5d6c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d96800000 1 -- start start 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d90a00640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d6c0725e0 0x7f5d6c074aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001ac50 tx=0x7f5d8001ade0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d96800000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0e1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d96800000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0943e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d96800000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d094920 0x55c87d094d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d96800000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c87cf7ed30 con 0x55c87d0e0f30 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d96800000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c87cef2af0 con 0x55c87d0e1850 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d96800000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c87cee1f20 con 0x55c87d094920 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d90a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d90a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0e1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48560/0 (socket says 172.21.15.17:48560) 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d90a00640 1 -- 172.21.15.17:0/3488361038 learned_addr learned my addr 172.21.15.17:0/3488361038 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d8be00640 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d91400640 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d094920 0x55c87d094d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.461+0000 7f5d90a00640 1 -- 172.21.15.17:0/3488361038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d094920 msgr2=0x55c87d094d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d90a00640 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d094920 0x55c87d094d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d90a00640 1 -- 172.21.15.17:0/3488361038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 msgr2=0x55c87d0943e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d90a00640 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0943e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d90a00640 1 -- 172.21.15.17:0/3488361038 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87ce63100 con 0x55c87d0e0f30 2024-09-10T23:19:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d8be00640 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0943e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d90a00640 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0e1310 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5d800ad040 tx=0x7f5d800b7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecb216258ce75ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d7d600640 1 -- 172.21.15.17:0/3488361038 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80005ca0 con 0x55c87d0e0f30 2024-09-10T23:19:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d7d600640 1 -- 172.21.15.17:0/3488361038 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d800b0040 con 0x55c87d0e0f30 2024-09-10T23:19:29.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d7d600640 1 -- 172.21.15.17:0/3488361038 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80003600 con 0x55c87d0e0f30 2024-09-10T23:19:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 -- 172.21.15.17:0/3488361038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 msgr2=0x55c87d0e1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0e1310 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5d800ad040 tx=0x7f5d800b7040 comp rx=0 tx=0).stop 2024-09-10T23:19:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 -- 172.21.15.17:0/3488361038 shutdown_connections 2024-09-10T23:19:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d094920 0x55c87d094d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0943e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 --2- 172.21.15.17:0/3488361038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0e1310 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 -- 172.21.15.17:0/3488361038 >> 172.21.15.17:0/3488361038 conn(0x55c87d0c1ff0 msgr2=0x55c87d0c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 -- 172.21.15.17:0/3488361038 shutdown_connections 2024-09-10T23:19:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 -- 172.21.15.17:0/3488361038 wait complete. 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 -- start start 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 Processor -- start 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 0x55c87d0c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e1850 0x55c87d0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c87ce874e0 con 0x55c87d0e0f30 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c87cee5d30 con 0x55c87d094920 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c87cba7680 con 0x55c87d0e1850 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d96800000 10 client.0 _ll_register_callbacks cb 0x55c87d0820e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48576/0 (socket says 172.21.15.17:48576) 2024-09-10T23:19:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d8be00640 1 -- 172.21.15.17:0/3305793181 learned_addr learned my addr 172.21.15.17:0/3305793181 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d90a00640 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 0x55c87d0c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d91400640 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e1850 0x55c87d0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d8be00640 1 -- 172.21.15.17:0/3305793181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e1850 msgr2=0x55c87d0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d8be00640 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e1850 0x55c87d0c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d8be00640 1 -- 172.21.15.17:0/3305793181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 msgr2=0x55c87d0c3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d8be00640 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 0x55c87d0c3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.465+0000 7f5d8be00640 1 -- 172.21.15.17:0/3305793181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c87ce96c40 con 0x55c87d0e0f30 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d8be00640 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0c3960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5d78003e30 tx=0x7f5d78001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279396f776eaf5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 1 -- 172.21.15.17:0/3305793181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d780145e0 con 0x55c87d0e0f30 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 1 -- 172.21.15.17:0/3305793181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f5d78014780 con 0x55c87d0e0f30 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 -- 172.21.15.17:0/3305793181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c87ce7a310 con 0x55c87d0e0f30 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 1 -- 172.21.15.17:0/3305793181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5d78022050 con 0x55c87d0e0f30 2024-09-10T23:19:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 10 client.5922 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:29.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 -- 172.21.15.17:0/3305793181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55c87cee0bc0 con 0x55c87d0e0f30 2024-09-10T23:19:29.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 1 -- 172.21.15.17:0/3305793181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c87ce7a310 con 0x55c87d0e0f30 2024-09-10T23:19:29.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 1 -- 172.21.15.17:0/3305793181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f5d78025020 con 0x55c87d0e0f30 2024-09-10T23:19:29.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 10 client.5922 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:29.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 10 client.5922 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:29.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 20 client.5922 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:29.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c87d0c48b0 0x55c87d0f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 4 client.5922 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:29.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 -- 172.21.15.17:0/3305793181 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c87cef4a40 con 0x55c87d0c48b0 2024-09-10T23:19:29.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d90a00640 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c87d0c48b0 0x55c87d0f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d90a00640 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c87d0c48b0 0x55c87d0f31f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a43e2e58cbb364be server_cookie=26901c42e41edd93 in_seq=0 out_seq=0 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 10 client.5922 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 1 -- 172.21.15.17:0/3305793181 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c87cef4a40 con 0x55c87d0c48b0 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 10 client.5922 handle_command_reply: tid=0 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 client.5922 shutdown 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 -- 172.21.15.17:0/3305793181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 msgr2=0x55c87d0c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0c3960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5d78003e30 tx=0x7f5d78001770 comp rx=0 tx=0).stop 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 -- 172.21.15.17:0/3305793181 shutdown_connections 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c87d0c48b0 0x55c87d0f31f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e1850 0x55c87d0c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e0f30 0x55c87d0c3960 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 --2- 172.21.15.17:0/3305793181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 0x55c87d0c3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d72000640 0 client.5922 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 -- 172.21.15.17:0/3305793181 >> 172.21.15.17:0/3305793181 conn(0x55c87d0c1ff0 msgr2=0x55c87d093ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 -- 172.21.15.17:0/3305793181 shutdown_connections 2024-09-10T23:19:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 1 -- 172.21.15.17:0/3305793181 wait complete. 2024-09-10T23:19:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.469+0000 7f5d96800000 20 client.5922 trim_cache size 0 max 16384 2024-09-10T23:19:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 Processor -- start 2024-09-10T23:19:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 -- start start 2024-09-10T23:19:29.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d094920 0x55c87d0f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e0f30 0x55c87d0dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0e02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c204900 con 0x55c87d094920 2024-09-10T23:19:29.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c2039a0 con 0x55c87d0e1850 2024-09-10T23:19:29.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8c202d50 con 0x55c87d0e0f30 2024-09-10T23:19:29.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d90a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d094920 0x55c87d0f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d90a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d094920 0x55c87d0f6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48578/0 (socket says 172.21.15.17:48578) 2024-09-10T23:19:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d90a00640 1 -- 172.21.15.17:0/131370780 learned_addr learned my addr 172.21.15.17:0/131370780 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d8be00640 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e0f30 0x55c87d0dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d91400640 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0e02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d90a00640 1 -- 172.21.15.17:0/131370780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e0f30 msgr2=0x55c87d0dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d90a00640 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e0f30 0x55c87d0dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d90a00640 1 -- 172.21.15.17:0/131370780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 msgr2=0x55c87d0e02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d90a00640 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0e02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d90a00640 1 -- 172.21.15.17:0/131370780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87ce801d0 con 0x55c87d094920 2024-09-10T23:19:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d91400640 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0e02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d90a00640 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d094920 0x55c87d0f6a70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001c3d0 tx=0x7f5d800091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c30630868ac65b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d7cc00640 1 -- 172.21.15.17:0/131370780 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80004e20 con 0x55c87d094920 2024-09-10T23:19:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d7cc00640 1 -- 172.21.15.17:0/131370780 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d800b0050 con 0x55c87d094920 2024-09-10T23:19:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d7cc00640 1 -- 172.21.15.17:0/131370780 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80003860 con 0x55c87d094920 2024-09-10T23:19:29.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 -- 172.21.15.17:0/131370780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d094920 msgr2=0x55c87d0f6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d094920 0x55c87d0f6a70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001c3d0 tx=0x7f5d800091e0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 -- 172.21.15.17:0/131370780 shutdown_connections 2024-09-10T23:19:29.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d0e1850 0x55c87d0e02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e0f30 0x55c87d0dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 --2- 172.21.15.17:0/131370780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d094920 0x55c87d0f6a70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 -- 172.21.15.17:0/131370780 >> 172.21.15.17:0/131370780 conn(0x55c87d0c1ff0 msgr2=0x55c87d0edea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 -- 172.21.15.17:0/131370780 shutdown_connections 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.485+0000 7f5d96800000 1 -- 172.21.15.17:0/131370780 wait complete. 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 -- start start 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 Processor -- start 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 0x55c87d157160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e0f30 0x55c87d1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e1850 0x55c87d157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c87cead890 con 0x55c87d0e1850 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c87cef18c0 con 0x55c87d094920 2024-09-10T23:19:29.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c87cea4690 con 0x55c87d0e0f30 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 10 client.0 _ll_register_callbacks cb 0x7f5d78005050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d91400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e1850 0x55c87d157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d91400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e1850 0x55c87d157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48586/0 (socket says 172.21.15.17:48586) 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d91400640 1 -- 172.21.15.17:0/32815471 learned_addr learned my addr 172.21.15.17:0/32815471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d90a00640 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 0x55c87d157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d91400640 1 -- 172.21.15.17:0/32815471 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e0f30 msgr2=0x55c87d1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d91400640 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e0f30 0x55c87d1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d91400640 1 -- 172.21.15.17:0/32815471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 msgr2=0x55c87d157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d91400640 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 0x55c87d157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d91400640 1 -- 172.21.15.17:0/32815471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c87cea8970 con 0x55c87d0e1850 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d90a00640 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 0x55c87d157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d91400640 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e1850 0x55c87d157be0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5d84001750 tx=0x7f5d8405e110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0467d0506880cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d72000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:29.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d72000640 1 -- 172.21.15.17:0/32815471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8405dc00 con 0x55c87d0e1850 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d72000640 1 -- 172.21.15.17:0/32815471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f5d8405ce60 con 0x55c87d0e1850 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 -- 172.21.15.17:0/32815471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d800b0050 con 0x55c87d0e1850 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d72000640 1 -- 172.21.15.17:0/32815471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5d84062630 con 0x55c87d0e1850 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 10 client.5928 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 -- 172.21.15.17:0/32815471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55c87ce78560 con 0x55c87d0e1850 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d72000640 1 -- 172.21.15.17:0/32815471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d800b0050 con 0x55c87d0e1850 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d72000640 1 -- 172.21.15.17:0/32815471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f5d84006b20 con 0x55c87d0e1850 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 10 client.5928 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 10 client.5928 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 20 client.5928 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c87d0f3e80 0x55c87d0f4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 4 client.5928 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d96800000 1 -- 172.21.15.17:0/32815471 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c87cef04f0 con 0x55c87d0f3e80 2024-09-10T23:19:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.489+0000 7f5d90a00640 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c87d0f3e80 0x55c87d0f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d72000640 10 client.5928 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d90a00640 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c87d0f3e80 0x55c87d0f4290 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab286f882ac59211 server_cookie=64893a82c89d6097 in_seq=0 out_seq=0 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d72000640 1 -- 172.21.15.17:0/32815471 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x55c87cef04f0 con 0x55c87d0f3e80 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d72000640 10 client.5928 handle_command_reply: tid=0 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 client.5928 shutdown 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 -- 172.21.15.17:0/32815471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e1850 msgr2=0x55c87d157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e1850 0x55c87d157be0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5d84001750 tx=0x7f5d8405e110 comp rx=0 tx=0).stop 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 -- 172.21.15.17:0/32815471 shutdown_connections 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55c87d0f3e80 0x55c87d0f4290 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c87d0e1850 0x55c87d157be0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c87d0e0f30 0x55c87d1576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 --2- 172.21.15.17:0/32815471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c87d094920 0x55c87d157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d72000640 0 client.5928 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:29.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 -- 172.21.15.17:0/32815471 >> 172.21.15.17:0/32815471 conn(0x55c87d0c1ff0 msgr2=0x55c87d0c23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 -- 172.21.15.17:0/32815471 shutdown_connections 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 1 -- 172.21.15.17:0/32815471 wait complete. 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d96800000 20 client.5928 trim_cache size 0 max 16384 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 1524439952, 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511630409, 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:29.502 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:19:29.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 -- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d6c0725e0 msgr2=0x7f5d6c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d6c0725e0 0x7f5d6c074aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001ac50 tx=0x7f5d8001ade0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 -- 172.21.15.17:0/1254315163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8c15ee80 msgr2=0x7f5d8c157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8c15ee80 0x7f5d8c157400 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5d840015b0 tx=0x7f5d8400cc20 comp rx=0 tx=0).stop 2024-09-10T23:19:29.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 -- 172.21.15.17:0/1254315163 shutdown_connections 2024-09-10T23:19:29.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d6c0725e0 0x7f5d6c074aa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8c15ee80 0x7f5d8c157400 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d8c0b17e0 0x7f5d8c156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 --2- 172.21.15.17:0/1254315163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d8c0b1400 0x7f5d8c151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 -- 172.21.15.17:0/1254315163 >> 172.21.15.17:0/1254315163 conn(0x7f5d8c0d0320 msgr2=0x7f5d8c1582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 -- 172.21.15.17:0/1254315163 shutdown_connections 2024-09-10T23:19:29.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.493+0000 7f5d93400640 1 -- 172.21.15.17:0/1254315163 wait complete. 2024-09-10T23:19:29.516 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:29.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.657+0000 7fb0c4200640 1 -- 172.21.15.17:0/566296858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc15f770 msgr2=0x7fb0bc0cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.657+0000 7fb0c4200640 1 --2- 172.21.15.17:0/566296858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc15f770 0x7fb0bc0cc870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009840 tx=0x7fb0a801c820 comp rx=0 tx=0).stop 2024-09-10T23:19:29.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.657+0000 7fb0c4200640 1 -- 172.21.15.17:0/566296858 shutdown_connections 2024-09-10T23:19:29.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.657+0000 7fb0c4200640 1 --2- 172.21.15.17:0/566296858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc15f770 0x7fb0bc0cc870 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.657+0000 7fb0c4200640 1 -- 172.21.15.17:0/566296858 >> 172.21.15.17:0/566296858 conn(0x7fb0bc0d1d60 msgr2=0x7fb0bc0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.657+0000 7fb0c4200640 1 -- 172.21.15.17:0/566296858 shutdown_connections 2024-09-10T23:19:29.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.657+0000 7fb0c4200640 1 -- 172.21.15.17:0/566296858 wait complete. 2024-09-10T23:19:29.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 Processor -- start 2024-09-10T23:19:29.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 -- start start 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc070ad0 0x7fb0bc0b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0d1830 0x7fb0bc0c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc15f770 0x7fb0bc0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc16a4d0 con 0x7fb0bc15f770 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc16a350 con 0x7fb0bc070ad0 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb0bc16a650 con 0x7fb0bc0d1830 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc15f770 0x7fb0bc0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc15f770 0x7fb0bc0b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48588/0 (socket says 172.21.15.17:48588) 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c2200640 1 -- 172.21.15.17:0/148387622 learned_addr learned my addr 172.21.15.17:0/148387622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c1800640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc070ad0 0x7fb0bc0b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c0e00640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0d1830 0x7fb0bc0c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c2200640 1 -- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0d1830 msgr2=0x7fb0bc0c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c2200640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0d1830 0x7fb0bc0c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c2200640 1 -- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc070ad0 msgr2=0x7fb0bc0b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c2200640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc070ad0 0x7fb0bc0b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c2200640 1 -- 172.21.15.17:0/148387622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc0c6b40 con 0x7fb0bc15f770 2024-09-10T23:19:29.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c2200640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc15f770 0x7fb0bc0b3f60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400cbf0 tx=0x7fb0b400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0b9600640 1 -- 172.21.15.17:0/148387622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4016020 con 0x7fb0bc15f770 2024-09-10T23:19:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0b9600640 1 -- 172.21.15.17:0/148387622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0b400ab40 con 0x7fb0bc15f770 2024-09-10T23:19:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0bc0c6e20 con 0x7fb0bc15f770 2024-09-10T23:19:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0b9600640 1 -- 172.21.15.17:0/148387622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4012420 con 0x7fb0bc15f770 2024-09-10T23:19:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.661+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0bc0b44a0 con 0x7fb0bc15f770 2024-09-10T23:19:29.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.665+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0bc15f060 con 0x7fb0bc15f770 2024-09-10T23:19:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.665+0000 7fb0b9600640 1 -- 172.21.15.17:0/148387622 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb0b401a3b0 con 0x7fb0bc15f770 2024-09-10T23:19:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.665+0000 7fb0b9600640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb09c0725e0 0x7fb09c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:29.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.665+0000 7fb0b9600640 1 -- 172.21.15.17:0/148387622 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fb0b4093710 con 0x7fb0bc15f770 2024-09-10T23:19:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.665+0000 7fb0c1800640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb09c0725e0 0x7fb09c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.665+0000 7fb0c1800640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb09c0725e0 0x7fb09c074aa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0000c10 tx=0x7fb0b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:29.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.669+0000 7fb0b9600640 1 -- 172.21.15.17:0/148387622 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb0b4020030 con 0x7fb0bc15f770 2024-09-10T23:19:29.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0bc0c8650 con 0x7fb0bc15f770 2024-09-10T23:19:29.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0b9600640 1 -- 172.21.15.17:0/148387622 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5224 (secure 0 0 0) 0x7fb0b405eb90 con 0x7fb0bc15f770 2024-09-10T23:19:29.885 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:29.885 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":30,"btime":"2024-09-10T23:19:28:741239+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1801943144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1801943144},{"type":"v1","addr":"172.21.15.77:6837","nonce":1801943144}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2387800472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2387800472},{"type":"v1","addr":"172.21.15.77:6835","nonce":2387800472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1881542084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1881542084},{"type":"v1","addr":"172.21.15.17:6835","nonce":1881542084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:55.490263+0000","modified":"2024-09-10T23:19:28.119463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5475},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5475":{"gid":5475,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6834/1323392007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1323392007},{"type":"v1","addr":"172.21.15.17:6834","nonce":1323392007}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5475,"qdb_cluster":[5475]},"id":3}]} 2024-09-10T23:19:29.886 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-09-10T23:19:29.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb09c0725e0 msgr2=0x7fb09c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb09c0725e0 0x7fb09c074aa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0000c10 tx=0x7fb0b0009040 comp rx=0 tx=0).stop 2024-09-10T23:19:29.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc15f770 msgr2=0x7fb0bc0b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:29.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc15f770 0x7fb0bc0b3f60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400cbf0 tx=0x7fb0b400cc20 comp rx=0 tx=0).stop 2024-09-10T23:19:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 shutdown_connections 2024-09-10T23:19:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb09c0725e0 0x7fb09c074aa0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc15f770 0x7fb0bc0b3f60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0d1830 0x7fb0bc0c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 --2- 172.21.15.17:0/148387622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc070ad0 0x7fb0bc0b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 >> 172.21.15.17:0/148387622 conn(0x7fb0bc0d1d60 msgr2=0x7fb0bc157250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 shutdown_connections 2024-09-10T23:19:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:29.881+0000 7fb0c4200640 1 -- 172.21.15.17:0/148387622 wait complete. 2024-09-10T23:19:29.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 1524439952 2024-09-10T23:19:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 -- 172.21.15.17:0/1670536379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec15fe80 msgr2=0x7fd7ec072c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 --2- 172.21.15.17:0/1670536379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec15fe80 0x7fd7ec072c50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0708a0 tx=0x7fd7e401cd80 comp rx=0 tx=0).stop 2024-09-10T23:19:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 -- 172.21.15.17:0/1670536379 shutdown_connections 2024-09-10T23:19:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 --2- 172.21.15.17:0/1670536379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec15fe80 0x7fd7ec072c50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 --2- 172.21.15.17:0/1670536379 >> v2:172.21.15.77:3300/0 conn(0x7fd7ec145800 0x7fd7ec0741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 -- 172.21.15.17:0/1670536379 >> 172.21.15.17:0/1670536379 conn(0x7fd7ec0b17a0 msgr2=0x7fd7ec0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 -- 172.21.15.17:0/1670536379 shutdown_connections 2024-09-10T23:19:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 -- 172.21.15.17:0/1670536379 wait complete. 2024-09-10T23:19:30.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 Processor -- start 2024-09-10T23:19:30.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 -- start start 2024-09-10T23:19:30.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ec145800 0x7fd7ec140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ec15fe80 0x7fd7ec13f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec160460 0x7fd7ec0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec169330 con 0x7fd7ec160460 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec1691b0 con 0x7fd7ec145800 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7f1400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ec1694b0 con 0x7fd7ec15fe80 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec160460 0x7fd7ec0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec160460 0x7fd7ec0b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48604/0 (socket says 172.21.15.17:48604) 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7eb200640 1 -- 172.21.15.17:0/1344331582 learned_addr learned my addr 172.21.15.17:0/1344331582 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7ea800640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ec145800 0x7fd7ec140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7e9e00640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ec15fe80 0x7fd7ec13f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7eb200640 1 -- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ec15fe80 msgr2=0x7fd7ec13f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7eb200640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ec15fe80 0x7fd7ec13f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7eb200640 1 -- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ec145800 msgr2=0x7fd7ec140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7eb200640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ec145800 0x7fd7ec140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.053+0000 7fd7eb200640 1 -- 172.21.15.17:0/1344331582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ec140320 con 0x7fd7ec160460 2024-09-10T23:19:30.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.057+0000 7fd7eb200640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec160460 0x7fd7ec0b4320 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd7e401b430 tx=0x7fd7e40a5c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.057+0000 7fd7e2a00640 1 -- 172.21.15.17:0/1344331582 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40bb070 con 0x7fd7ec160460 2024-09-10T23:19:30.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.057+0000 7fd7e2a00640 1 -- 172.21.15.17:0/1344331582 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e4004d40 con 0x7fd7ec160460 2024-09-10T23:19:30.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.057+0000 7fd7f1400640 1 -- 172.21.15.17:0/1344331582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ec140040 con 0x7fd7ec160460 2024-09-10T23:19:30.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.057+0000 7fd7e2a00640 1 -- 172.21.15.17:0/1344331582 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40b2040 con 0x7fd7ec160460 2024-09-10T23:19:30.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.057+0000 7fd7f1400640 1 -- 172.21.15.17:0/1344331582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ec165400 con 0x7fd7ec160460 2024-09-10T23:19:30.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.057+0000 7fd7e2a00640 1 -- 172.21.15.17:0/1344331582 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd7e40b5030 con 0x7fd7ec160460 2024-09-10T23:19:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7e2a00640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7cc072610 0x7fd7cc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 Processor -- start 2024-09-10T23:19:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7e2a00640 1 -- 172.21.15.17:0/1344331582 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fd7e412d010 con 0x7fd7ec160460 2024-09-10T23:19:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 -- start start 2024-09-10T23:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7ea800640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7cc072610 0x7fd7cc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944ed9dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9e290 0x55944ed50da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed512e0 0x55944ed516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55944ec3aa80 con 0x55944ed512e0 2024-09-10T23:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55944ebafc90 con 0x55944ed9d970 2024-09-10T23:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55944eb9f0c0 con 0x55944ed9e290 2024-09-10T23:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7ea800640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7cc072610 0x7fd7cc074ad0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00abe0 tx=0x7fd7dc00a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed512e0 0x55944ed516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7e9e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9e290 0x55944ed50da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed512e0 0x55944ed516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48608/0 (socket says 172.21.15.17:48608) 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7ea800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944ed9dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7eb200640 1 -- 172.21.15.17:0/3829313442 learned_addr learned my addr 172.21.15.17:0/3829313442 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7eb200640 1 -- 172.21.15.17:0/3829313442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9e290 msgr2=0x55944ed50da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7eb200640 1 --2- 172.21.15.17:0/3829313442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9e290 0x55944ed50da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7eb200640 1 -- 172.21.15.17:0/3829313442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 msgr2=0x55944ed9dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7eb200640 1 --2- 172.21.15.17:0/3829313442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944ed9dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7eb200640 1 -- 172.21.15.17:0/3829313442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944eb43350 con 0x55944ed512e0 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7eb200640 1 --2- 172.21.15.17:0/3829313442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed512e0 0x55944ed516c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd7e401cbb0 tx=0x7fd7e40f46f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff73490bd5bc75b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7d7400640 1 -- 172.21.15.17:0/3829313442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40f76e0 con 0x55944ed512e0 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7d7400640 1 -- 172.21.15.17:0/3829313442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e40f7a80 con 0x55944ed512e0 2024-09-10T23:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7d7400640 1 -- 172.21.15.17:0/3829313442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40f7f70 con 0x55944ed512e0 2024-09-10T23:19:30.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 -- 172.21.15.17:0/3829313442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed512e0 msgr2=0x55944ed516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 --2- 172.21.15.17:0/3829313442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed512e0 0x55944ed516c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd7e401cbb0 tx=0x7fd7e40f46f0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 -- 172.21.15.17:0/3829313442 shutdown_connections 2024-09-10T23:19:30.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 --2- 172.21.15.17:0/3829313442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed512e0 0x55944ed516c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 --2- 172.21.15.17:0/3829313442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9e290 0x55944ed50da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 --2- 172.21.15.17:0/3829313442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944ed9dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 -- 172.21.15.17:0/3829313442 >> 172.21.15.17:0/3829313442 conn(0x55944ed7e780 msgr2=0x55944ed80ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 -- 172.21.15.17:0/3829313442 shutdown_connections 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.061+0000 7fd7f481a000 1 -- 172.21.15.17:0/3829313442 wait complete. 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 -- start start 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 Processor -- start 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 0x55944eda48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944eda4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944eda5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55944ec23600 con 0x55944ed9e290 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55944ec5e1e0 con 0x55944ed9d970 2024-09-10T23:19:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55944eb48b10 con 0x55944ed512e0 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 10 client.0 _ll_register_callbacks cb 0x55944ed3ec90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944eda5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944eda5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48610/0 (socket says 172.21.15.17:48610) 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7eb200640 1 -- 172.21.15.17:0/227118729 learned_addr learned my addr 172.21.15.17:0/227118729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7ea800640 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 0x55944eda48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7e9e00640 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944eda4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7eb200640 1 -- 172.21.15.17:0/227118729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 msgr2=0x55944eda48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7eb200640 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 0x55944eda48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7eb200640 1 -- 172.21.15.17:0/227118729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 msgr2=0x55944eda4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7eb200640 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944eda4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7eb200640 1 -- 172.21.15.17:0/227118729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944eb3d260 con 0x55944ed9e290 2024-09-10T23:19:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7eb200640 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944eda5360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4098840 tx=0x7fd7e40a59a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fa0ff0a671563f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7cbe00640 1 -- 172.21.15.17:0/227118729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40f7a80 con 0x55944ed9e290 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7cbe00640 1 -- 172.21.15.17:0/227118729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fd7e40f71d0 con 0x55944ed9e290 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 -- 172.21.15.17:0/227118729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55944eb371e0 con 0x55944ed9e290 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7cbe00640 1 -- 172.21.15.17:0/227118729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd7e40fc9a0 con 0x55944ed9e290 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 10 client.5946 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 -- 172.21.15.17:0/227118729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55944eb68ac0 con 0x55944ed9e290 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7cbe00640 1 -- 172.21.15.17:0/227118729 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55944eb371e0 con 0x55944ed9e290 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7cbe00640 1 -- 172.21.15.17:0/227118729 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fd7e40fdb30 con 0x55944ed9e290 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 10 client.5946 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 10 client.5946 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 20 client.5946 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:30.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55944edaccb0 0x55944edaf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 4 client.5946 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7f481a000 1 -- 172.21.15.17:0/227118729 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55944ebb1be0 con 0x55944edaccb0 2024-09-10T23:19:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7ea800640 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55944edaccb0 0x55944edaf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7ea800640 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55944edaccb0 0x55944edaf0a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fcf8d5307510755 server_cookie=2cae26948815d58e in_seq=0 out_seq=0 2024-09-10T23:19:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.065+0000 7fd7cbe00640 10 client.5946 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7cbe00640 1 -- 172.21.15.17:0/227118729 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55944ebb1be0 con 0x55944edaccb0 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7cbe00640 10 client.5946 handle_command_reply: tid=0 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 client.5946 shutdown 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 -- 172.21.15.17:0/227118729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 msgr2=0x55944eda5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944eda5360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4098840 tx=0x7fd7e40a59a0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 -- 172.21.15.17:0/227118729 shutdown_connections 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55944edaccb0 0x55944edaf0a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944eda5360 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944eda4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7cbe00640 0 client.5946 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 --2- 172.21.15.17:0/227118729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 0x55944eda48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 -- 172.21.15.17:0/227118729 >> 172.21.15.17:0/227118729 conn(0x55944ed7e780 msgr2=0x55944ed80b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 -- 172.21.15.17:0/227118729 shutdown_connections 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 1 -- 172.21.15.17:0/227118729 wait complete. 2024-09-10T23:19:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.069+0000 7fd7f481a000 20 client.5946 trim_cache size 0 max 16384 2024-09-10T23:19:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.081+0000 7fd7f481a000 1 Processor -- start 2024-09-10T23:19:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.081+0000 7fd7f481a000 1 -- start start 2024-09-10T23:19:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed512e0 0x55944ee0f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9d970 0x55944ee0fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee10430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec2038b0 con 0x55944ed9e290 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec0b3c20 con 0x55944ed512e0 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ec203260 con 0x55944ed9d970 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee10430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee10430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48616/0 (socket says 172.21.15.17:48616) 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7eb200640 1 -- 172.21.15.17:0/3392384751 learned_addr learned my addr 172.21.15.17:0/3392384751 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7ea800640 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed512e0 0x55944ee0f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7e9e00640 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9d970 0x55944ee0fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7eb200640 1 -- 172.21.15.17:0/3392384751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9d970 msgr2=0x55944ee0fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7eb200640 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9d970 0x55944ee0fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7eb200640 1 -- 172.21.15.17:0/3392384751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed512e0 msgr2=0x55944ee0f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7eb200640 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed512e0 0x55944ee0f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7eb200640 1 -- 172.21.15.17:0/3392384751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944ed56bf0 con 0x55944ed9e290 2024-09-10T23:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7e9e00640 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9d970 0x55944ee0fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7eb200640 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee10430 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd7e412b460 tx=0x7fd7e40ff030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b1ca1229cd50c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7d6a00640 1 -- 172.21.15.17:0/3392384751 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40f7a80 con 0x55944ed9e290 2024-09-10T23:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7d6a00640 1 -- 172.21.15.17:0/3392384751 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e40f7f70 con 0x55944ed9e290 2024-09-10T23:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7d6a00640 1 -- 172.21.15.17:0/3392384751 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e41013c0 con 0x55944ed9e290 2024-09-10T23:19:30.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 -- 172.21.15.17:0/3392384751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 msgr2=0x55944ee10430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee10430 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd7e412b460 tx=0x7fd7e40ff030 comp rx=0 tx=0).stop 2024-09-10T23:19:30.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 -- 172.21.15.17:0/3392384751 shutdown_connections 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee10430 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed9d970 0x55944ee0fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 --2- 172.21.15.17:0/3392384751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed512e0 0x55944ee0f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 -- 172.21.15.17:0/3392384751 >> 172.21.15.17:0/3392384751 conn(0x55944ed7e780 msgr2=0x55944ed50330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 -- 172.21.15.17:0/3392384751 shutdown_connections 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 -- 172.21.15.17:0/3392384751 wait complete. 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 -- start start 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.085+0000 7fd7f481a000 1 Processor -- start 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 0x55944ee139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944ee13f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee14470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55944ebaea60 con 0x55944ed9e290 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55944eb43b10 con 0x55944ed9d970 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55944eba21e0 con 0x55944ed512e0 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 10 client.0 _ll_register_callbacks cb 0x7fd7dc00a830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee14470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee14470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48630/0 (socket says 172.21.15.17:48630) 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7eb200640 1 -- 172.21.15.17:0/2695608747 learned_addr learned my addr 172.21.15.17:0/2695608747 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7ea800640 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 0x55944ee139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7e9e00640 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944ee13f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7eb200640 1 -- 172.21.15.17:0/2695608747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 msgr2=0x55944ee139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7eb200640 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 0x55944ee139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7eb200640 1 -- 172.21.15.17:0/2695608747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 msgr2=0x55944ee13f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7eb200640 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944ee13f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7eb200640 1 -- 172.21.15.17:0/2695608747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944ed9e0c0 con 0x55944ed9e290 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7e9e00640 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944ee13f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7eb200640 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee14470 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40f44f0 tx=0x7fd7e412b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9706d450a6a138e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 1 -- 172.21.15.17:0/2695608747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40f7a80 con 0x55944ed9e290 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 1 -- 172.21.15.17:0/2695608747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fd7e40f38c0 con 0x55944ed9e290 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- 172.21.15.17:0/2695608747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7e40f7f70 con 0x55944ed9e290 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 1 -- 172.21.15.17:0/2695608747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd7e41013c0 con 0x55944ed9e290 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 10 client.5952 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- 172.21.15.17:0/2695608747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55944ec23a90 con 0x55944ed9e290 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 1 -- 172.21.15.17:0/2695608747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e40f7f70 con 0x55944ed9e290 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 1 -- 172.21.15.17:0/2695608747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fd7e41241d0 con 0x55944ed9e290 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 10 client.5952 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 10 client.5952 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 20 client.5952 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55944edb3180 0x55944edb3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 4 client.5952 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 1524439952}] 2024-09-10T23:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- 172.21.15.17:0/2695608747 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "damage rm", "damage_id": 1524439952}) -- 0x55944ebad690 con 0x55944edb3180 2024-09-10T23:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7ea800640 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55944edb3180 0x55944edb3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 10 client.5952 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7ea800640 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55944edb3180 0x55944edb3560 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2efe7f85d0faa02 server_cookie=a82c60f5d2746128 in_seq=0 out_seq=0 2024-09-10T23:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 1 -- 172.21.15.17:0/2695608747 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55944ebad690 con 0x55944edb3180 2024-09-10T23:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 10 client.5952 handle_command_reply: tid=0 2024-09-10T23:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 client.5952 shutdown 2024-09-10T23:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- 172.21.15.17:0/2695608747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 msgr2=0x55944ee14470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee14470 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40f44f0 tx=0x7fd7e412b2e0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- 172.21.15.17:0/2695608747 shutdown_connections 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55944edb3180 0x55944edb3560 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55944ed9e290 0x55944ee14470 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55944ed9d970 0x55944ee13f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 --2- 172.21.15.17:0/2695608747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55944ed512e0 0x55944ee139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7cbe00640 0 client.5952 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- 172.21.15.17:0/2695608747 >> 172.21.15.17:0/2695608747 conn(0x55944ed7e780 msgr2=0x55944ed587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- 172.21.15.17:0/2695608747 shutdown_connections 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 1 -- 172.21.15.17:0/2695608747 wait complete. 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.089+0000 7fd7f481a000 20 client.5952 trim_cache size 0 max 16384 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 -- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7cc072610 msgr2=0x7fd7cc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7cc072610 0x7fd7cc074ad0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00abe0 tx=0x7fd7dc00a2d0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 -- 172.21.15.17:0/1344331582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec160460 msgr2=0x7fd7ec0b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec160460 0x7fd7ec0b4320 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd7e401b430 tx=0x7fd7e40a5c80 comp rx=0 tx=0).stop 2024-09-10T23:19:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 -- 172.21.15.17:0/1344331582 shutdown_connections 2024-09-10T23:19:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7cc072610 0x7fd7cc074ad0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ec160460 0x7fd7ec0b4320 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ec15fe80 0x7fd7ec13f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 --2- 172.21.15.17:0/1344331582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ec145800 0x7fd7ec140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 -- 172.21.15.17:0/1344331582 >> 172.21.15.17:0/1344331582 conn(0x7fd7ec0b17a0 msgr2=0x7fd7ec15e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 -- 172.21.15.17:0/1344331582 shutdown_connections 2024-09-10T23:19:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.093+0000 7fd7f1400640 1 -- 172.21.15.17:0/1344331582 wait complete. 2024-09-10T23:19:30.116 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-10T23:19:30.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 -- 172.21.15.17:0/374942761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9040b2540 msgr2=0x7ff9040d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 --2- 172.21.15.17:0/374942761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9040b2540 0x7ff9040d03b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009840 tx=0x7ff8f001c820 comp rx=0 tx=0).stop 2024-09-10T23:19:30.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 -- 172.21.15.17:0/374942761 shutdown_connections 2024-09-10T23:19:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 --2- 172.21.15.17:0/374942761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9040b2540 0x7ff9040d03b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 -- 172.21.15.17:0/374942761 >> 172.21.15.17:0/374942761 conn(0x7ff9040d1da0 msgr2=0x7ff9040d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 -- 172.21.15.17:0/374942761 shutdown_connections 2024-09-10T23:19:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 -- 172.21.15.17:0/374942761 wait complete. 2024-09-10T23:19:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 Processor -- start 2024-09-10T23:19:30.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 -- start start 2024-09-10T23:19:30.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9040b2540 0x7ff90414a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9040b31b0 0x7ff9040cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90415f400 0x7ff9040d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff90416a000 con 0x7ff90415f400 2024-09-10T23:19:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff904169e80 con 0x7ff9040b2540 2024-09-10T23:19:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90c600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff90416a180 con 0x7ff9040b31b0 2024-09-10T23:19:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90a600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90415f400 0x7ff9040d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90a600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90415f400 0x7ff9040d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48646/0 (socket says 172.21.15.17:48646) 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff90a600640 1 -- 172.21.15.17:0/4095747721 learned_addr learned my addr 172.21.15.17:0/4095747721 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff909200640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9040b31b0 0x7ff9040cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.261+0000 7ff909c00640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9040b2540 0x7ff90414a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff90a600640 1 -- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9040b31b0 msgr2=0x7ff9040cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff90a600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9040b31b0 0x7ff9040cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff90a600640 1 -- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9040b2540 msgr2=0x7ff90414a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff90a600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9040b2540 0x7ff90414a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff90a600640 1 -- 172.21.15.17:0/4095747721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90414ae20 con 0x7ff90415f400 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff909c00640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9040b2540 0x7ff90414a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff90a600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90415f400 0x7ff9040d01e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c730 tx=0x7ff8fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff901600640 1 -- 172.21.15.17:0/4095747721 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc003db0 con 0x7ff90415f400 2024-09-10T23:19:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff901600640 1 -- 172.21.15.17:0/4095747721 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8fc00ce40 con 0x7ff90415f400 2024-09-10T23:19:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff901600640 1 -- 172.21.15.17:0/4095747721 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0052d0 con 0x7ff90415f400 2024-09-10T23:19:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff90c600640 1 -- 172.21.15.17:0/4095747721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90414e390 con 0x7ff90415f400 2024-09-10T23:19:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.265+0000 7ff90c600640 1 -- 172.21.15.17:0/4095747721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff904150a70 con 0x7ff90415f400 2024-09-10T23:19:30.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff901600640 1 -- 172.21.15.17:0/4095747721 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff8fc005470 con 0x7ff90415f400 2024-09-10T23:19:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 Processor -- start 2024-09-10T23:19:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff901600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8e40725e0 0x7ff8e4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 -- start start 2024-09-10T23:19:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff901600640 1 -- 172.21.15.17:0/4095747721 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7ff8fc093120 con 0x7ff90415f400 2024-09-10T23:19:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909200640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8e40725e0 0x7ff8e4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ac6f0 0x5557483acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ad010 0x555748362fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 0x5557483638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5557481b9c20 con 0x5557483ad010 2024-09-10T23:19:30.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5557481a9050 con 0x555748363510 2024-09-10T23:19:30.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5557481ace60 con 0x5557483ac6f0 2024-09-10T23:19:30.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ad010 0x555748362fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ac6f0 0x5557483acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ac6f0 0x5557483acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:60716/0 (socket says 172.21.15.17:60716) 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909c00640 1 -- 172.21.15.17:0/2263951705 learned_addr learned my addr 172.21.15.17:0/2263951705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90a600640 1 --2- 172.21.15.17:0/2263951705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 0x5557483638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909200640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8e40725e0 0x7ff8e4074aa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00af000 tx=0x7ff8f001b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909200640 1 -- 172.21.15.17:0/2263951705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ac6f0 msgr2=0x5557483acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909200640 1 --2- 172.21.15.17:0/2263951705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ac6f0 0x5557483acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909200640 1 -- 172.21.15.17:0/2263951705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 msgr2=0x5557483638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909200640 1 --2- 172.21.15.17:0/2263951705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 0x5557483638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909200640 1 -- 172.21.15.17:0/2263951705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555748129770 con 0x5557483ad010 2024-09-10T23:19:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff909200640 1 --2- 172.21.15.17:0/2263951705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ad010 0x555748362fd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00ac000 tx=0x7ff8f00b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5776329cc55807 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff8f6000640 1 -- 172.21.15.17:0/2263951705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00b2040 con 0x5557483ad010 2024-09-10T23:19:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff8f6000640 1 -- 172.21.15.17:0/2263951705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8f00c7070 con 0x5557483ad010 2024-09-10T23:19:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff8f6000640 1 -- 172.21.15.17:0/2263951705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00a55f0 con 0x5557483ad010 2024-09-10T23:19:30.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 -- 172.21.15.17:0/2263951705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ad010 msgr2=0x555748362fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 --2- 172.21.15.17:0/2263951705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ad010 0x555748362fd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00ac000 tx=0x7ff8f00b6000 comp rx=0 tx=0).stop 2024-09-10T23:19:30.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 -- 172.21.15.17:0/2263951705 shutdown_connections 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 --2- 172.21.15.17:0/2263951705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 0x5557483638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 --2- 172.21.15.17:0/2263951705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ad010 0x555748362fd0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 --2- 172.21.15.17:0/2263951705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ac6f0 0x5557483acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 -- 172.21.15.17:0/2263951705 >> 172.21.15.17:0/2263951705 conn(0x555748246630 msgr2=0x5557483618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 -- 172.21.15.17:0/2263951705 shutdown_connections 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.269+0000 7ff90fac1000 1 -- 172.21.15.17:0/2263951705 wait complete. 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 -- start start 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 Processor -- start 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 0x5557483b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x5557483b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ad010 0x5557483b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55574814e560 con 0x5557483ac6f0 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55574815e9e0 con 0x555748363510 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x555748263a00 con 0x5557483ad010 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 10 client.0 _ll_register_callbacks cb 0x55574834aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x5557483b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x5557483b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48662/0 (socket says 172.21.15.17:48662) 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909200640 1 -- 172.21.15.17:0/4250534088 learned_addr learned my addr 172.21.15.17:0/4250534088 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90a600640 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ad010 0x5557483b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909c00640 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 0x5557483b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909200640 1 -- 172.21.15.17:0/4250534088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ad010 msgr2=0x5557483b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909200640 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ad010 0x5557483b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909200640 1 -- 172.21.15.17:0/4250534088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 msgr2=0x5557483b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909200640 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 0x5557483b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909200640 1 -- 172.21.15.17:0/4250534088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555748164f40 con 0x5557483ac6f0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff909200640 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x5557483b2da0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0019430 tx=0x7ff8f0004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b27542939705079 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff8eaa00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff8eaa00640 1 -- 172.21.15.17:0/4250534088 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00d5060 con 0x5557483ac6f0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 -- 172.21.15.17:0/4250534088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555748141370 con 0x5557483ac6f0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff8eaa00640 1 -- 172.21.15.17:0/4250534088 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7ff8f00a58b0 con 0x5557483ac6f0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff8eaa00640 1 -- 172.21.15.17:0/4250534088 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff8f00db050 con 0x5557483ac6f0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 10 client.5967 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 -- 172.21.15.17:0/4250534088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x555748147230 con 0x5557483ac6f0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff8eaa00640 1 -- 172.21.15.17:0/4250534088 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x555748141370 con 0x5557483ac6f0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff8eaa00640 1 -- 172.21.15.17:0/4250534088 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7ff8f00a5bc0 con 0x5557483ac6f0 2024-09-10T23:19:30.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 10 client.5967 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 10 client.5967 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 20 client.5967 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5557483bac30 0x5557483bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 4 client.5967 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.273+0000 7ff90fac1000 1 -- 172.21.15.17:0/4250534088 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557481bbb70 con 0x5557483bac30 2024-09-10T23:19:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff909c00640 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5557483bac30 0x5557483bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff909c00640 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5557483bac30 0x5557483bd020 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bc6ef9c741f08f1 server_cookie=8032f0c09fee6830 in_seq=0 out_seq=0 2024-09-10T23:19:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff8eaa00640 10 client.5967 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff8eaa00640 1 -- 172.21.15.17:0/4250534088 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557481bbb70 con 0x5557483bac30 2024-09-10T23:19:30.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff8eaa00640 10 client.5967 handle_command_reply: tid=0 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 client.5967 shutdown 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 -- 172.21.15.17:0/4250534088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 msgr2=0x5557483b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x5557483b2da0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0019430 tx=0x7ff8f0004420 comp rx=0 tx=0).stop 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 -- 172.21.15.17:0/4250534088 shutdown_connections 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5557483bac30 0x5557483bd020 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5557483ad010 0x5557483b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x5557483b2da0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff8eaa00640 0 client.5967 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 --2- 172.21.15.17:0/4250534088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555748363510 0x5557483b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 -- 172.21.15.17:0/4250534088 >> 172.21.15.17:0/4250534088 conn(0x555748246630 msgr2=0x555748364110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 -- 172.21.15.17:0/4250534088 shutdown_connections 2024-09-10T23:19:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 1 -- 172.21.15.17:0/4250534088 wait complete. 2024-09-10T23:19:30.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.277+0000 7ff90fac1000 20 client.5967 trim_cache size 0 max 16384 2024-09-10T23:19:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 Processor -- start 2024-09-10T23:19:30.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 -- start start 2024-09-10T23:19:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 0x55574841eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x55574841f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 0x55574841f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff90406f500 con 0x5557483ac6f0 2024-09-10T23:19:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff9041f7950 con 0x5557483ad010 2024-09-10T23:19:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff90406eee0 con 0x555748363510 2024-09-10T23:19:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x55574841f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x55574841f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48676/0 (socket says 172.21.15.17:48676) 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909200640 1 -- 172.21.15.17:0/3322669358 learned_addr learned my addr 172.21.15.17:0/3322669358 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909c00640 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 0x55574841eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90a600640 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 0x55574841f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909200640 1 -- 172.21.15.17:0/3322669358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 msgr2=0x55574841eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909200640 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 0x55574841eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909200640 1 -- 172.21.15.17:0/3322669358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 msgr2=0x55574841f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909200640 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 0x55574841f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909200640 1 -- 172.21.15.17:0/3322669358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557483ace40 con 0x5557483ac6f0 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90a600640 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 0x55574841f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff909200640 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x55574841f090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0004660 tx=0x7ff8f00ad4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e058b789bf942281 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff8f5600640 1 -- 172.21.15.17:0/3322669358 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00b2040 con 0x5557483ac6f0 2024-09-10T23:19:30.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff8f5600640 1 -- 172.21.15.17:0/3322669358 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8f00c7040 con 0x5557483ac6f0 2024-09-10T23:19:30.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff8f5600640 1 -- 172.21.15.17:0/3322669358 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00a56b0 con 0x5557483ac6f0 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 -- 172.21.15.17:0/3322669358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 msgr2=0x55574841f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.293+0000 7ff90fac1000 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x55574841f090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0004660 tx=0x7ff8f00ad4c0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- 172.21.15.17:0/3322669358 shutdown_connections 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 0x55574841f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x55574841f090 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 --2- 172.21.15.17:0/3322669358 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 0x55574841eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- 172.21.15.17:0/3322669358 >> 172.21.15.17:0/3322669358 conn(0x555748246630 msgr2=0x5557483ab7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- 172.21.15.17:0/3322669358 shutdown_connections 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- 172.21.15.17:0/3322669358 wait complete. 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- start start 2024-09-10T23:19:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 Processor -- start 2024-09-10T23:19:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 0x5557484227e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x555748422d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 0x555748423260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55574815dcf0 con 0x5557483ac6f0 2024-09-10T23:19:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5557481540b0 con 0x5557483ad010 2024-09-10T23:19:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5557481ac170 con 0x555748363510 2024-09-10T23:19:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 10 client.0 _ll_register_callbacks cb 0x7ff8fc001810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x555748422d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x555748422d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48684/0 (socket says 172.21.15.17:48684) 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909200640 1 -- 172.21.15.17:0/998739607 learned_addr learned my addr 172.21.15.17:0/998739607 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909c00640 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 0x5557484227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90a600640 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 0x555748423260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909200640 1 -- 172.21.15.17:0/998739607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 msgr2=0x5557484227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909200640 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 0x5557484227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909200640 1 -- 172.21.15.17:0/998739607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 msgr2=0x555748423260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909200640 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 0x555748423260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909200640 1 -- 172.21.15.17:0/998739607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55574815f430 con 0x5557483ac6f0 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff909200640 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x555748422d20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff8f001c650 tx=0x7ff8f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4189976a5a7cc45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff8eaa00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff8eaa00640 1 -- 172.21.15.17:0/998739607 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00e4060 con 0x5557483ac6f0 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff8eaa00640 1 -- 172.21.15.17:0/998739607 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7ff8f00d59e0 con 0x5557483ac6f0 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- 172.21.15.17:0/998739607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8f00c7040 con 0x5557483ac6f0 2024-09-10T23:19:30.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff8eaa00640 1 -- 172.21.15.17:0/998739607 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff8f00b2040 con 0x5557483ac6f0 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 10 client.5973 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- 172.21.15.17:0/998739607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55574822ee40 con 0x5557483ac6f0 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff8eaa00640 1 -- 172.21.15.17:0/998739607 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8f00c7040 con 0x5557483ac6f0 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff8eaa00640 1 -- 172.21.15.17:0/998739607 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7ff8f00d5c00 con 0x5557483ac6f0 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 10 client.5973 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 10 client.5973 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 20 client.5973 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5557483b1e60 0x5557483b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 4 client.5973 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.297+0000 7ff90fac1000 1 -- 172.21.15.17:0/998739607 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x5557481b7620 con 0x5557483b1e60 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff909c00640 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5557483b1e60 0x5557483b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff909c00640 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5557483b1e60 0x5557483b2270 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea36ab98ada065f6 server_cookie=61ebf0a68a5a7051 in_seq=0 out_seq=0 2024-09-10T23:19:30.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff8eaa00640 10 client.5973 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff8eaa00640 1 -- 172.21.15.17:0/998739607 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5557481b7620 con 0x5557483b1e60 2024-09-10T23:19:30.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff8eaa00640 10 client.5973 handle_command_reply: tid=0 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 client.5973 shutdown 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 -- 172.21.15.17:0/998739607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 msgr2=0x555748422d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x555748422d20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff8f001c650 tx=0x7ff8f0009250 comp rx=0 tx=0).stop 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 -- 172.21.15.17:0/998739607 shutdown_connections 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5557483b1e60 0x5557483b2270 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5557483ad010 0x555748423260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483ac6f0 0x555748422d20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff8eaa00640 0 client.5973 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 --2- 172.21.15.17:0/998739607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x555748363510 0x5557484227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 -- 172.21.15.17:0/998739607 >> 172.21.15.17:0/998739607 conn(0x555748246630 msgr2=0x5557483abee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 -- 172.21.15.17:0/998739607 shutdown_connections 2024-09-10T23:19:30.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 1 -- 172.21.15.17:0/998739607 wait complete. 2024-09-10T23:19:30.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90fac1000 20 client.5973 trim_cache size 0 max 16384 2024-09-10T23:19:30.310 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:19:30.310 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90c600640 1 -- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8e40725e0 msgr2=0x7ff8e4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90c600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8e40725e0 0x7ff8e4074aa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00af000 tx=0x7ff8f001b060 comp rx=0 tx=0).stop 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90c600640 1 -- 172.21.15.17:0/4095747721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90415f400 msgr2=0x7ff9040d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.301+0000 7ff90c600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90415f400 0x7ff9040d01e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c730 tx=0x7ff8fc00cbf0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.305+0000 7ff90c600640 1 -- 172.21.15.17:0/4095747721 shutdown_connections 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.305+0000 7ff90c600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8e40725e0 0x7ff8e4074aa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.305+0000 7ff90c600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff90415f400 0x7ff9040d01e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.305+0000 7ff90c600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9040b31b0 0x7ff9040cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.305+0000 7ff90c600640 1 --2- 172.21.15.17:0/4095747721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9040b2540 0x7ff90414a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.305+0000 7ff90c600640 1 -- 172.21.15.17:0/4095747721 >> 172.21.15.17:0/4095747721 conn(0x7ff9040d1da0 msgr2=0x7ff9040d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.305+0000 7ff90c600640 1 -- 172.21.15.17:0/4095747721 shutdown_connections 2024-09-10T23:19:30.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.305+0000 7ff90c600640 1 -- 172.21.15.17:0/4095747721 wait complete. 2024-09-10T23:19:30.327 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-10T23:19:30.327 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-10T23:19:30.327 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-10T23:19:30.327 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-10T23:19:30.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:30.327 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> import json 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> import sys 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> try: 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> except OSError as e: 2024-09-10T23:19:30.338 DEBUG:teuthology.orchestra.run.smithi017:> sys.exit(e.errno) 2024-09-10T23:19:30.339 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:30.339 DEBUG:teuthology.orchestra.run.smithi017:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T23:19:30.339 DEBUG:teuthology.orchestra.run.smithi017:> print(json.dumps( 2024-09-10T23:19:30.339 DEBUG:teuthology.orchestra.run.smithi017:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T23:19:30.339 DEBUG:teuthology.orchestra.run.smithi017:> indent=2)) 2024-09-10T23:19:30.339 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout: "st_mode": 16893, 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout: "st_ino": 1099511627777, 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout: "st_dev": 44, 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout: "st_nlink": 16, 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout: "st_uid": 1000, 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout: "st_gid": 1271, 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout: "st_size": 9248261, 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout: "st_atime": 1726010348.5750124, 2024-09-10T23:19:30.455 INFO:teuthology.orchestra.run.smithi017.stdout: "st_mtime": 1726010362.9253166, 2024-09-10T23:19:30.456 INFO:teuthology.orchestra.run.smithi017.stdout: "st_ctime": 1726010362.9253166 2024-09-10T23:19:30.456 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:30.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:19:30.464 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-09-10T23:19:30.464 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-10T23:19:30.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-10T23:19:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.653+0000 7f3794a00640 1 -- 172.21.15.17:0/1338978993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37900d2640 msgr2=0x7f37900b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.653+0000 7f3794a00640 1 --2- 172.21.15.17:0/1338978993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37900d2640 0x7f37900b3dd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3788009c80 tx=0x7f378801cda0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.653+0000 7f3794a00640 1 -- 172.21.15.17:0/1338978993 shutdown_connections 2024-09-10T23:19:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.653+0000 7f3794a00640 1 --2- 172.21.15.17:0/1338978993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37900d2640 0x7f37900b3dd0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 --2- 172.21.15.17:0/1338978993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37900d46d0 0x7f37900b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 -- 172.21.15.17:0/1338978993 >> 172.21.15.17:0/1338978993 conn(0x7f379009d0f0 msgr2=0x7f37900d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 -- 172.21.15.17:0/1338978993 shutdown_connections 2024-09-10T23:19:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 -- 172.21.15.17:0/1338978993 wait complete. 2024-09-10T23:19:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 Processor -- start 2024-09-10T23:19:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 -- start start 2024-09-10T23:19:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37900d2260 0x7f3790155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37900d2640 0x7f37901f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37900d46d0 0x7f37900b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f37900b2aa0 con 0x7f37900d2640 2024-09-10T23:19:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f37900b2920 con 0x7f37900d2260 2024-09-10T23:19:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f37900b2c20 con 0x7f37900d46d0 2024-09-10T23:19:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37900d2640 0x7f37901f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37900d2640 0x7f37901f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48710/0 (socket says 172.21.15.17:48710) 2024-09-10T23:19:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787e00640 1 -- 172.21.15.17:0/1803181095 learned_addr learned my addr 172.21.15.17:0/1803181095 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787e00640 1 -- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37900d46d0 msgr2=0x7f37900b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f378fe00640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37900d46d0 0x7f37900b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f378f400640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37900d2260 0x7f3790155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787e00640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37900d46d0 0x7f37900b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787e00640 1 -- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37900d2260 msgr2=0x7f3790155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787e00640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37900d2260 0x7f3790155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787e00640 1 -- 172.21.15.17:0/1803181095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37901f8370 con 0x7f37900d2640 2024-09-10T23:19:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f378fe00640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37900d46d0 0x7f37900b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f378f400640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37900d2260 0x7f3790155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787e00640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37900d2640 0x7f37901f7e30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f37780058d0 tx=0x7f377800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787400640 1 -- 172.21.15.17:0/1803181095 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778017070 con 0x7f37900d2640 2024-09-10T23:19:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787400640 1 -- 172.21.15.17:0/1803181095 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3778009cc0 con 0x7f37900d2640 2024-09-10T23:19:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3787400640 1 -- 172.21.15.17:0/1803181095 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37780106c0 con 0x7f37900d2640 2024-09-10T23:19:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.657+0000 7f3794a00640 1 -- 172.21.15.17:0/1803181095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37900cd750 con 0x7f37900d2640 2024-09-10T23:19:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.661+0000 7f3794a00640 1 -- 172.21.15.17:0/1803181095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37900c7980 con 0x7f37900d2640 2024-09-10T23:19:30.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.661+0000 7f3787400640 1 -- 172.21.15.17:0/1803181095 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3778010860 con 0x7f37900d2640 2024-09-10T23:19:30.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 Processor -- start 2024-09-10T23:19:30.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3787400640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f376c0725e0 0x7f376c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- start start 2024-09-10T23:19:30.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3787400640 1 -- 172.21.15.17:0/1803181095 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f3778093840 con 0x7f37900d2640 2024-09-10T23:19:30.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378fe00640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f376c0725e0 0x7f376c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c5488d0 0x55ff4c548cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5491f0 0x55ff4c512a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c512f70 0x55ff4c513350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ff4c3e5bd0 con 0x55ff4c5488d0 2024-09-10T23:19:30.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ff4c35ad40 con 0x55ff4c512f70 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ff4c34a170 con 0x55ff4c5491f0 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c5488d0 0x55ff4c548cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c5488d0 0x55ff4c548cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48722/0 (socket says 172.21.15.17:48722) 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378f400640 1 -- 172.21.15.17:0/3152174045 learned_addr learned my addr 172.21.15.17:0/3152174045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3787e00640 1 --2- 172.21.15.17:0/3152174045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5491f0 0x55ff4c512a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378fe00640 1 --2- 172.21.15.17:0/1803181095 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f376c0725e0 0x7f376c074aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f37880af000 tx=0x7f378801b5e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378fe00640 1 --2- 172.21.15.17:0/3152174045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c512f70 0x55ff4c513350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378f400640 1 -- 172.21.15.17:0/3152174045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5491f0 msgr2=0x55ff4c512a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378f400640 1 --2- 172.21.15.17:0/3152174045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5491f0 0x55ff4c512a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378f400640 1 -- 172.21.15.17:0/3152174045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c512f70 msgr2=0x55ff4c513350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378f400640 1 --2- 172.21.15.17:0/3152174045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c512f70 0x55ff4c513350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378f400640 1 -- 172.21.15.17:0/3152174045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4c2fd420 con 0x55ff4c5488d0 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f378f400640 1 --2- 172.21.15.17:0/3152174045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c5488d0 0x55ff4c548cb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f37800017c0 tx=0x7f3780001c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35b056a2c1837ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f377fe00640 1 -- 172.21.15.17:0/3152174045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780016020 con 0x55ff4c5488d0 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f377fe00640 1 -- 172.21.15.17:0/3152174045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f378000dc30 con 0x55ff4c5488d0 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f377fe00640 1 -- 172.21.15.17:0/3152174045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780012650 con 0x55ff4c5488d0 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- 172.21.15.17:0/3152174045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c5488d0 msgr2=0x55ff4c548cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 --2- 172.21.15.17:0/3152174045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c5488d0 0x55ff4c548cb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f37800017c0 tx=0x7f3780001c80 comp rx=0 tx=0).stop 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- 172.21.15.17:0/3152174045 shutdown_connections 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 --2- 172.21.15.17:0/3152174045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c512f70 0x55ff4c513350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 --2- 172.21.15.17:0/3152174045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5491f0 0x55ff4c512a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 --2- 172.21.15.17:0/3152174045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c5488d0 0x55ff4c548cb0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- 172.21.15.17:0/3152174045 >> 172.21.15.17:0/3152174045 conn(0x55ff4c5297f0 msgr2=0x55ff4c52bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- 172.21.15.17:0/3152174045 shutdown_connections 2024-09-10T23:19:30.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- 172.21.15.17:0/3152174045 wait complete. 2024-09-10T23:19:30.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 -- start start 2024-09-10T23:19:30.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.665+0000 7f3799331000 1 Processor -- start 2024-09-10T23:19:30.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5053d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c505910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c505e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ff4c2ef6f0 con 0x55ff4c512f70 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ff4c34df80 con 0x55ff4c5491f0 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ff4c00f920 con 0x55ff4c5488d0 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 10 client.0 _ll_register_callbacks cb 0x55ff4c3d1d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5053d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5053d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48730/0 (socket says 172.21.15.17:48730) 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378f400640 1 -- 172.21.15.17:0/2954584296 learned_addr learned my addr 172.21.15.17:0/2954584296 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378fe00640 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c505e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3787e00640 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c505910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378f400640 1 -- 172.21.15.17:0/2954584296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 msgr2=0x55ff4c505910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378f400640 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c505910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378f400640 1 -- 172.21.15.17:0/2954584296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 msgr2=0x55ff4c505e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378f400640 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c505e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378f400640 1 -- 172.21.15.17:0/2954584296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff4c318590 con 0x55ff4c512f70 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f378f400640 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5053d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x55ff4c3e9b60 tx=0x7f3780007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949dff694f6134fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f377cc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f377cc00640 1 -- 172.21.15.17:0/2954584296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780016030 con 0x55ff4c512f70 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f377cc00640 1 -- 172.21.15.17:0/2954584296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f3780003600 con 0x55ff4c512f70 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 -- 172.21.15.17:0/2954584296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff4c2e2490 con 0x55ff4c512f70 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f377cc00640 1 -- 172.21.15.17:0/2954584296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3780003880 con 0x55ff4c512f70 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 10 client.5988 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 -- 172.21.15.17:0/2954584296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55ff4c2e8350 con 0x55ff4c512f70 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f377cc00640 1 -- 172.21.15.17:0/2954584296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ff4c2e2490 con 0x55ff4c512f70 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f377cc00640 1 -- 172.21.15.17:0/2954584296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f3780003a20 con 0x55ff4c512f70 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 10 client.5988 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 10 client.5988 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 20 client.5988 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ff4c506860 0x55ff4c55a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 4 client.5988 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3799331000 1 -- 172.21.15.17:0/2954584296 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff4c35cc90 con 0x55ff4c506860 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3787e00640 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ff4c506860 0x55ff4c55a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f3787e00640 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ff4c506860 0x55ff4c55a980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=952505960e91c3e3 server_cookie=f97d034616d39648 in_seq=0 out_seq=0 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.669+0000 7f377cc00640 10 client.5988 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f377cc00640 1 -- 172.21.15.17:0/2954584296 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff4c35cc90 con 0x55ff4c506860 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f377cc00640 10 client.5988 handle_command_reply: tid=0 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 client.5988 shutdown 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 -- 172.21.15.17:0/2954584296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 msgr2=0x55ff4c5053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5053d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x55ff4c3e9b60 tx=0x7f3780007ec0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 -- 172.21.15.17:0/2954584296 shutdown_connections 2024-09-10T23:19:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ff4c506860 0x55ff4c55a980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c505e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c505910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 --2- 172.21.15.17:0/2954584296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5053d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 -- 172.21.15.17:0/2954584296 >> 172.21.15.17:0/2954584296 conn(0x55ff4c5297f0 msgr2=0x55ff4c4fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f377cc00640 0 client.5988 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 -- 172.21.15.17:0/2954584296 shutdown_connections 2024-09-10T23:19:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 1 -- 172.21.15.17:0/2954584296 wait complete. 2024-09-10T23:19:30.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.673+0000 7f3799331000 20 client.5988 trim_cache size 0 max 16384 2024-09-10T23:19:30.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 Processor -- start 2024-09-10T23:19:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- start start 2024-09-10T23:19:30.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c528a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c528f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c558970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f37902043f0 con 0x55ff4c512f70 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3790203450 con 0x55ff4c5491f0 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f37900c9240 con 0x55ff4c5488d0 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c528a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c528a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48746/0 (socket says 172.21.15.17:48746) 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378f400640 1 -- 172.21.15.17:0/1331025149 learned_addr learned my addr 172.21.15.17:0/1331025149 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3787e00640 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c528f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378fe00640 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c558970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378f400640 1 -- 172.21.15.17:0/1331025149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 msgr2=0x55ff4c528f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378f400640 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c528f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378f400640 1 -- 172.21.15.17:0/1331025149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 msgr2=0x55ff4c558970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378f400640 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c558970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378f400640 1 -- 172.21.15.17:0/1331025149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4c3a5860 con 0x55ff4c512f70 2024-09-10T23:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378fe00640 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c558970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f378f400640 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c528a40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3780001410 tx=0x7f378000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700ae471f60e1a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f377f400640 1 -- 172.21.15.17:0/1331025149 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780016070 con 0x55ff4c512f70 2024-09-10T23:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f377f400640 1 -- 172.21.15.17:0/1331025149 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f378001f070 con 0x55ff4c512f70 2024-09-10T23:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f377f400640 1 -- 172.21.15.17:0/1331025149 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780007980 con 0x55ff4c512f70 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- 172.21.15.17:0/1331025149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 msgr2=0x55ff4c528a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c528a40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3780001410 tx=0x7f378000d560 comp rx=0 tx=0).stop 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- 172.21.15.17:0/1331025149 shutdown_connections 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c558970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c528f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 --2- 172.21.15.17:0/1331025149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c528a40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- 172.21.15.17:0/1331025149 >> 172.21.15.17:0/1331025149 conn(0x55ff4c5297f0 msgr2=0x55ff4c511f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- 172.21.15.17:0/1331025149 shutdown_connections 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- 172.21.15.17:0/1331025149 wait complete. 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.689+0000 7f3799331000 1 -- start start 2024-09-10T23:19:30.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 Processor -- start 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5bf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c5bf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c5bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ff4c2edb20 con 0x55ff4c512f70 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ff4c308db0 con 0x55ff4c5491f0 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ff4c00f920 con 0x55ff4c5488d0 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 10 client.0 _ll_register_callbacks cb 0x7f377800b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48754/0 (socket says 172.21.15.17:48754) 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378f400640 1 -- 172.21.15.17:0/2107460137 learned_addr learned my addr 172.21.15.17:0/2107460137 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3787e00640 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c5bf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378fe00640 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c5bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378f400640 1 -- 172.21.15.17:0/2107460137 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 msgr2=0x55ff4c5bf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378f400640 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c5bf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378f400640 1 -- 172.21.15.17:0/2107460137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 msgr2=0x55ff4c5bfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378f400640 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c5bfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378f400640 1 -- 172.21.15.17:0/2107460137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff4c2d65e0 con 0x55ff4c512f70 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378fe00640 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c5bfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f378f400640 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5bf130 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3780001020 tx=0x7f37800012c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405111ff93a63aed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f377cc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f377cc00640 1 -- 172.21.15.17:0/2107460137 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780036060 con 0x55ff4c512f70 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f377cc00640 1 -- 172.21.15.17:0/2107460137 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f3780007a80 con 0x55ff4c512f70 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 -- 172.21.15.17:0/2107460137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f378001f070 con 0x55ff4c512f70 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f377cc00640 1 -- 172.21.15.17:0/2107460137 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f378003c050 con 0x55ff4c512f70 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 10 client.5994 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 -- 172.21.15.17:0/2107460137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55ff4c2e07c0 con 0x55ff4c512f70 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f377cc00640 1 -- 172.21.15.17:0/2107460137 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f378001f070 con 0x55ff4c512f70 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f377cc00640 1 -- 172.21.15.17:0/2107460137 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f378003f020 con 0x55ff4c512f70 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 10 client.5994 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 10 client.5994 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 20 client.5994 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ff4c55bbe0 0x55ff4c55bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 4 client.5994 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3799331000 1 -- 172.21.15.17:0/2107460137 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55ff4c358740 con 0x55ff4c55bbe0 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3787e00640 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ff4c55bbe0 0x55ff4c55bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f377cc00640 10 client.5994 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f3787e00640 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ff4c55bbe0 0x55ff4c55bfc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97f22cc958ee7626 server_cookie=20aac91a56471452 in_seq=0 out_seq=0 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.693+0000 7f377cc00640 1 -- 172.21.15.17:0/2107460137 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x55ff4c358740 con 0x55ff4c55bbe0 2024-09-10T23:19:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f377cc00640 10 client.5994 handle_command_reply: tid=0 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 client.5994 shutdown 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 -- 172.21.15.17:0/2107460137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 msgr2=0x55ff4c5bf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5bf130 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3780001020 tx=0x7f37800012c0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 -- 172.21.15.17:0/2107460137 shutdown_connections 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55ff4c55bbe0 0x55ff4c55bfc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ff4c5491f0 0x55ff4c5bfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ff4c5488d0 0x55ff4c5bf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 --2- 172.21.15.17:0/2107460137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ff4c512f70 0x55ff4c5bf130 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f377cc00640 0 client.5994 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 -- 172.21.15.17:0/2107460137 >> 172.21.15.17:0/2107460137 conn(0x55ff4c5297f0 msgr2=0x55ff4c527a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 -- 172.21.15.17:0/2107460137 shutdown_connections 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 1 -- 172.21.15.17:0/2107460137 wait complete. 2024-09-10T23:19:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.697+0000 7f3799331000 20 client.5994 trim_cache size 0 max 16384 2024-09-10T23:19:30.706 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:30.706 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:30.706 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": -2 2024-09-10T23:19:30.706 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:30.706 INFO:teuthology.orchestra.run.smithi017.stderr:Error ENOENT: 2024-09-10T23:19:30.707 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T23:19:30.708 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-10T23:19:30.708 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-10T23:19:30.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-10T23:19:30.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.853+0000 7f59cca00640 1 -- 172.21.15.17:0/2988614088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c815a2a0 msgr2=0x7f59c80b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.853+0000 7f59cca00640 1 --2- 172.21.15.17:0/2988614088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c815a2a0 0x7f59c80b2aa0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f59c80cc500 tx=0x7f59b801c5d0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.853+0000 7f59cca00640 1 -- 172.21.15.17:0/2988614088 shutdown_connections 2024-09-10T23:19:30.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.853+0000 7f59cca00640 1 --2- 172.21.15.17:0/2988614088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59c80cf580 0x7f59c806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.853+0000 7f59cca00640 1 --2- 172.21.15.17:0/2988614088 >> v2:172.21.15.77:3300/0 conn(0x7f59c80b2fe0 0x7f59c80cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.853+0000 7f59cca00640 1 --2- 172.21.15.17:0/2988614088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c815a2a0 0x7f59c80b2aa0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.853+0000 7f59cca00640 1 -- 172.21.15.17:0/2988614088 >> 172.21.15.17:0/2988614088 conn(0x7f59c80b17a0 msgr2=0x7f59c80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.853+0000 7f59cca00640 1 -- 172.21.15.17:0/2988614088 shutdown_connections 2024-09-10T23:19:30.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.853+0000 7f59cca00640 1 -- 172.21.15.17:0/2988614088 wait complete. 2024-09-10T23:19:30.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 Processor -- start 2024-09-10T23:19:30.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 -- start start 2024-09-10T23:19:30.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c80b2fe0 0x7f59c815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59c80cf580 0x7f59c80cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59c815a2a0 0x7f59c8143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f59c80ccd10 con 0x7f59c80b2fe0 2024-09-10T23:19:30.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f59c80ccb90 con 0x7f59c80cf580 2024-09-10T23:19:30.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f59c80cce90 con 0x7f59c815a2a0 2024-09-10T23:19:30.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c80b2fe0 0x7f59c815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c80b2fe0 0x7f59c815d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48778/0 (socket says 172.21.15.17:48778) 2024-09-10T23:19:30.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c5e00640 1 -- 172.21.15.17:0/2842843503 learned_addr learned my addr 172.21.15.17:0/2842843503 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59bd400640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59c80cf580 0x7f59c80cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c6800640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59c815a2a0 0x7f59c8143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c5e00640 1 -- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59c815a2a0 msgr2=0x7f59c8143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c5e00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59c815a2a0 0x7f59c8143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c5e00640 1 -- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59c80cf580 msgr2=0x7f59c80cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c5e00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59c80cf580 0x7f59c80cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c5e00640 1 -- 172.21.15.17:0/2842843503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c8154b20 con 0x7f59c80b2fe0 2024-09-10T23:19:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59c5e00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c80b2fe0 0x7f59c815d550 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f59b801ac80 tx=0x7f59b80a6590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59bea00640 1 -- 172.21.15.17:0/2842843503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80ac070 con 0x7f59c80b2fe0 2024-09-10T23:19:30.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59bea00640 1 -- 172.21.15.17:0/2842843503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59b80054b0 con 0x7f59c80b2fe0 2024-09-10T23:19:30.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 -- 172.21.15.17:0/2842843503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c8153d60 con 0x7f59c80b2fe0 2024-09-10T23:19:30.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59bea00640 1 -- 172.21.15.17:0/2842843503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8004290 con 0x7f59c80b2fe0 2024-09-10T23:19:30.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.857+0000 7f59cca00640 1 -- 172.21.15.17:0/2842843503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c8154320 con 0x7f59c80b2fe0 2024-09-10T23:19:30.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59bea00640 1 -- 172.21.15.17:0/2842843503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f59b80b9070 con 0x7f59c80b2fe0 2024-09-10T23:19:30.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59bea00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59a40725e0 0x7f59a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59bea00640 1 -- 172.21.15.17:0/2842843503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f59b812cdb0 con 0x7f59c80b2fe0 2024-09-10T23:19:30.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59cfe7c000 1 Processor -- start 2024-09-10T23:19:30.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59bd400640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59a40725e0 0x7f59a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59cfe7c000 1 -- start start 2024-09-10T23:19:30.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59bd400640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59a40725e0 0x7f59a4074aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f59c8140ec0 tx=0x7f59b0009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919010 0x5566b99193f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 0x5566b98ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 0x5566b98cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5566b972a960 con 0x5566b9919010 2024-09-10T23:19:30.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5566b9719d90 con 0x5566b98cd070 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5566b971dba0 con 0x5566b9919930 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919010 0x5566b99193f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919010 0x5566b99193f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48784/0 (socket says 172.21.15.17:48784) 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c5e00640 1 -- 172.21.15.17:0/1978927770 learned_addr learned my addr 172.21.15.17:0/1978927770 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59bd400640 1 --2- 172.21.15.17:0/1978927770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 0x5566b98ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c6800640 1 --2- 172.21.15.17:0/1978927770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 0x5566b98cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c5e00640 1 -- 172.21.15.17:0/1978927770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 msgr2=0x5566b98ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c5e00640 1 --2- 172.21.15.17:0/1978927770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 0x5566b98ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c5e00640 1 -- 172.21.15.17:0/1978927770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 msgr2=0x5566b98cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c5e00640 1 --2- 172.21.15.17:0/1978927770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 0x5566b98cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c5e00640 1 -- 172.21.15.17:0/1978927770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566b96ceca0 con 0x5566b9919010 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.861+0000 7f59c5e00640 1 --2- 172.21.15.17:0/1978927770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919010 0x5566b99193f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f59b80f7970 tx=0x7f59b80f74a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8006cd567d38025 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59b6a00640 1 -- 172.21.15.17:0/1978927770 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80fc6a0 con 0x5566b9919010 2024-09-10T23:19:30.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59b6a00640 1 -- 172.21.15.17:0/1978927770 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59b81010c0 con 0x5566b9919010 2024-09-10T23:19:30.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59b6a00640 1 -- 172.21.15.17:0/1978927770 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80f3ee0 con 0x5566b9919010 2024-09-10T23:19:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- 172.21.15.17:0/1978927770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919010 msgr2=0x5566b99193f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/1978927770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919010 0x5566b99193f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f59b80f7970 tx=0x7f59b80f74a0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- 172.21.15.17:0/1978927770 shutdown_connections 2024-09-10T23:19:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/1978927770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 0x5566b98cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/1978927770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 0x5566b98ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/1978927770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919010 0x5566b99193f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- 172.21.15.17:0/1978927770 >> 172.21.15.17:0/1978927770 conn(0x5566b98fa0d0 msgr2=0x5566b98fc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- 172.21.15.17:0/1978927770 shutdown_connections 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- 172.21.15.17:0/1978927770 wait complete. 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- start start 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 Processor -- start 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 0x5566b99183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919010 0x5566b9918900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b98fa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5566b96bdf50 con 0x5566b9919930 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5566b96c50b0 con 0x5566b98cd070 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5566b96c6b30 con 0x5566b9919010 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 10 client.0 _ll_register_callbacks cb 0x5566b96c4750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b98fa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b98fa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48788/0 (socket says 172.21.15.17:48788) 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c6800640 1 -- 172.21.15.17:0/3737347323 learned_addr learned my addr 172.21.15.17:0/3737347323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c5e00640 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 0x5566b99183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59bd400640 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919010 0x5566b9918900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c6800640 1 -- 172.21.15.17:0/3737347323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919010 msgr2=0x5566b9918900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c6800640 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919010 0x5566b9918900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c6800640 1 -- 172.21.15.17:0/3737347323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 msgr2=0x5566b99183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c6800640 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 0x5566b99183c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c6800640 1 -- 172.21.15.17:0/3737347323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566b96b80b0 con 0x5566b9919930 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59c6800640 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b98fa4b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f59c000abc0 tx=0x7f59c0007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57884fc00e61bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59ab400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59ab400640 1 -- 172.21.15.17:0/3737347323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c001b060 con 0x5566b9919930 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59ab400640 1 -- 172.21.15.17:0/3737347323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f59c0016640 con 0x5566b9919930 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.865+0000 7f59cfe7c000 1 -- 172.21.15.17:0/3737347323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566b96b21f0 con 0x5566b9919930 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59ab400640 1 -- 172.21.15.17:0/3737347323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f59c0021050 con 0x5566b9919930 2024-09-10T23:19:30.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 10 client.6006 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 -- 172.21.15.17:0/3737347323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5566b96de680 con 0x5566b9919930 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59ab400640 1 -- 172.21.15.17:0/3737347323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5566b96b21f0 con 0x5566b9919930 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59ab400640 1 -- 172.21.15.17:0/3737347323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f59c0024020 con 0x5566b9919930 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 10 client.6006 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 10 client.6006 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 20 client.6006 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5566b9920190 0x5566b99205a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 4 client.6006 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 -- 172.21.15.17:0/3737347323 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566b972c8b0 con 0x5566b9920190 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59c5e00640 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5566b9920190 0x5566b99205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59c5e00640 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5566b9920190 0x5566b99205a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ba64f5418ad9721 server_cookie=2ade92fec98f6856 in_seq=0 out_seq=0 2024-09-10T23:19:30.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59ab400640 10 client.6006 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59ab400640 1 -- 172.21.15.17:0/3737347323 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5566b972c8b0 con 0x5566b9920190 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59ab400640 10 client.6006 handle_command_reply: tid=0 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 client.6006 shutdown 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 -- 172.21.15.17:0/3737347323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 msgr2=0x5566b98fa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b98fa4b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f59c000abc0 tx=0x7f59c0007680 comp rx=0 tx=0).stop 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 -- 172.21.15.17:0/3737347323 shutdown_connections 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5566b9920190 0x5566b99205a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b98fa4b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919010 0x5566b9918900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/3737347323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b98cd070 0x5566b99183c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59ab400640 0 client.6006 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 -- 172.21.15.17:0/3737347323 >> 172.21.15.17:0/3737347323 conn(0x5566b98fa0d0 msgr2=0x5566b98cc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 -- 172.21.15.17:0/3737347323 shutdown_connections 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 1 -- 172.21.15.17:0/3737347323 wait complete. 2024-09-10T23:19:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.869+0000 7f59cfe7c000 20 client.6006 trim_cache size 0 max 16384 2024-09-10T23:19:30.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 Processor -- start 2024-09-10T23:19:30.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 -- start start 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b98cd070 0x5566b9930d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 0x5566b99182e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 0x5566b9918820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f59c82035f0 con 0x5566b98cd070 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f59c8202980 con 0x5566b9919010 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f59c8202fd0 con 0x5566b9919930 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b98cd070 0x5566b9930d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b98cd070 0x5566b9930d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48802/0 (socket says 172.21.15.17:48802) 2024-09-10T23:19:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c5e00640 1 -- 172.21.15.17:0/4044450347 learned_addr learned my addr 172.21.15.17:0/4044450347 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59bd400640 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 0x5566b99182e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c6800640 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 0x5566b9918820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c5e00640 1 -- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 msgr2=0x5566b9918820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c5e00640 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 0x5566b9918820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c5e00640 1 -- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 msgr2=0x5566b99182e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c5e00640 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 0x5566b99182e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c5e00640 1 -- 172.21.15.17:0/4044450347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566b97a0bc0 con 0x5566b98cd070 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59bd400640 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 0x5566b99182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c6800640 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 0x5566b9918820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59c5e00640 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b98cd070 0x5566b9930d50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f59b80a7040 tx=0x7f59b8124040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a3a3ef12321094 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59b6000640 1 -- 172.21.15.17:0/4044450347 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b811c040 con 0x5566b98cd070 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59b6000640 1 -- 172.21.15.17:0/4044450347 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59b81010c0 con 0x5566b98cd070 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59b6000640 1 -- 172.21.15.17:0/4044450347 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80f3ee0 con 0x5566b98cd070 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 -- 172.21.15.17:0/4044450347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b98cd070 msgr2=0x5566b9930d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b98cd070 0x5566b9930d50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f59b80a7040 tx=0x7f59b8124040 comp rx=0 tx=0).stop 2024-09-10T23:19:30.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 -- 172.21.15.17:0/4044450347 shutdown_connections 2024-09-10T23:19:30.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b9919930 0x5566b9918820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 0x5566b99182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/4044450347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b98cd070 0x5566b9930d50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 -- 172.21.15.17:0/4044450347 >> 172.21.15.17:0/4044450347 conn(0x5566b98fa0d0 msgr2=0x5566b98d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 -- 172.21.15.17:0/4044450347 shutdown_connections 2024-09-10T23:19:30.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.889+0000 7f59cfe7c000 1 -- 172.21.15.17:0/4044450347 wait complete. 2024-09-10T23:19:30.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 -- start start 2024-09-10T23:19:30.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 Processor -- start 2024-09-10T23:19:30.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b98cd070 0x5566b991f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 0x5566b9930760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b9930ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5566b96d97c0 con 0x5566b9919930 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5566b9729730 con 0x5566b9919010 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5566b971ceb0 con 0x5566b98cd070 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 10 client.0 _ll_register_callbacks cb 0x7f59c00097d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b9930ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b9930ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48814/0 (socket says 172.21.15.17:48814) 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c6800640 1 -- 172.21.15.17:0/2604187075 learned_addr learned my addr 172.21.15.17:0/2604187075 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c5e00640 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b98cd070 0x5566b991f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59bd400640 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 0x5566b9930760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c6800640 1 -- 172.21.15.17:0/2604187075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b98cd070 msgr2=0x5566b991f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c6800640 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b98cd070 0x5566b991f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c6800640 1 -- 172.21.15.17:0/2604187075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 msgr2=0x5566b9930760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c6800640 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 0x5566b9930760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c6800640 1 -- 172.21.15.17:0/2604187075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566b9776ef0 con 0x5566b9919930 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c6800640 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b9930ca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f59c0002240 tx=0x7f59c0017cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539605e2ee6238f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59ab400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59ab400640 1 -- 172.21.15.17:0/2604187075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0029020 con 0x5566b9919930 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59ab400640 1 -- 172.21.15.17:0/2604187075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f59c0025800 con 0x5566b9919930 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 -- 172.21.15.17:0/2604187075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b81010c0 con 0x5566b9919930 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59ab400640 1 -- 172.21.15.17:0/2604187075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f59c0007b80 con 0x5566b9919930 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 10 client.6012 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 -- 172.21.15.17:0/2604187075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5566b96e3eb0 con 0x5566b9919930 2024-09-10T23:19:30.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59ab400640 1 -- 172.21.15.17:0/2604187075 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59b81010c0 con 0x5566b9919930 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59ab400640 1 -- 172.21.15.17:0/2604187075 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f59c0024040 con 0x5566b9919930 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 10 client.6012 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 10 client.6012 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 20 client.6012 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5566b991bd20 0x5566b991c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 4 client.6012 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59cfe7c000 1 -- 172.21.15.17:0/2604187075 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5566b9728360 con 0x5566b991bd20 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.893+0000 7f59c5e00640 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5566b991bd20 0x5566b991c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59ab400640 10 client.6012 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59c5e00640 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5566b991bd20 0x5566b991c130 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a168282ef4b0ede server_cookie=e67736e61f914f05 in_seq=0 out_seq=0 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59ab400640 1 -- 172.21.15.17:0/2604187075 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x5566b9728360 con 0x5566b991bd20 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59ab400640 10 client.6012 handle_command_reply: tid=0 2024-09-10T23:19:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 client.6012 shutdown 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 -- 172.21.15.17:0/2604187075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 msgr2=0x5566b9930ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b9930ca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f59c0002240 tx=0x7f59c0017cb0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 -- 172.21.15.17:0/2604187075 shutdown_connections 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5566b991bd20 0x5566b991c130 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5566b9919930 0x5566b9930ca0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5566b9919010 0x5566b9930760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59ab400640 0 client.6012 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 --2- 172.21.15.17:0/2604187075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5566b98cd070 0x5566b991f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 -- 172.21.15.17:0/2604187075 >> 172.21.15.17:0/2604187075 conn(0x5566b98fa0d0 msgr2=0x5566b98d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 -- 172.21.15.17:0/2604187075 shutdown_connections 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 1 -- 172.21.15.17:0/2604187075 wait complete. 2024-09-10T23:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cfe7c000 20 client.6012 trim_cache size 0 max 16384 2024-09-10T23:19:30.906 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:30.906 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": -2 2024-09-10T23:19:30.906 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:30.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 -- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59a40725e0 msgr2=0x7f59a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59a40725e0 0x7f59a4074aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f59c8140ec0 tx=0x7f59b0009110 comp rx=0 tx=0).stop 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 -- 172.21.15.17:0/2842843503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c80b2fe0 msgr2=0x7f59c815d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c80b2fe0 0x7f59c815d550 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f59b801ac80 tx=0x7f59b80a6590 comp rx=0 tx=0).stop 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 -- 172.21.15.17:0/2842843503 shutdown_connections 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59a40725e0 0x7f59a4074aa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f59c815a2a0 0x7f59c8143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59c80cf580 0x7f59c80cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 --2- 172.21.15.17:0/2842843503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59c80b2fe0 0x7f59c815d550 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 -- 172.21.15.17:0/2842843503 >> 172.21.15.17:0/2842843503 conn(0x7f59c80b17a0 msgr2=0x7f59c80cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 -- 172.21.15.17:0/2842843503 shutdown_connections 2024-09-10T23:19:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:30.897+0000 7f59cca00640 1 -- 172.21.15.17:0/2842843503 wait complete. 2024-09-10T23:19:30.920 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-10T23:19:30.920 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-10T23:19:30.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-10T23:19:31.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 -- 172.21.15.17:0/963649950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 msgr2=0x7fd7ac0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 --2- 172.21.15.17:0/963649950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 0x7fd7ac0af110 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009c80 tx=0x7fd7a401cda0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 -- 172.21.15.17:0/963649950 shutdown_connections 2024-09-10T23:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 --2- 172.21.15.17:0/963649950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 0x7fd7ac0af110 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 --2- 172.21.15.17:0/963649950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ac0b2620 0x7fd7ac0b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 -- 172.21.15.17:0/963649950 >> 172.21.15.17:0/963649950 conn(0x7fd7ac0d1d10 msgr2=0x7fd7ac0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 -- 172.21.15.17:0/963649950 shutdown_connections 2024-09-10T23:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 -- 172.21.15.17:0/963649950 wait complete. 2024-09-10T23:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 Processor -- start 2024-09-10T23:19:31.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.065+0000 7fd7b3200640 1 -- start start 2024-09-10T23:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ac0b2620 0x7fd7ac14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 0x7fd7ac156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b3200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ac160510 0x7fd7ac1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac0af650 con 0x7fd7ac0d02f0 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b3200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac0b13a0 con 0x7fd7ac160510 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ac0af7d0 con 0x7fd7ac0b2620 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 0x7fd7ac156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 0x7fd7ac156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48834/0 (socket says 172.21.15.17:48834) 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a3400640 1 -- 172.21.15.17:0/3496834659 learned_addr learned my addr 172.21.15.17:0/3496834659 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b1200640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ac160510 0x7fd7ac1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7abe00640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ac0b2620 0x7fd7ac14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a3400640 1 -- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ac0b2620 msgr2=0x7fd7ac14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a3400640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ac0b2620 0x7fd7ac14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a3400640 1 -- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ac160510 msgr2=0x7fd7ac1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a3400640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ac160510 0x7fd7ac1565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a3400640 1 -- 172.21.15.17:0/3496834659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac0cc860 con 0x7fd7ac0d02f0 2024-09-10T23:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b1200640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ac160510 0x7fd7ac1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a3400640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 0x7fd7ac156080 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd79400ea20 tx=0x7fd79400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a8c00640 1 -- 172.21.15.17:0/3496834659 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79400cd80 con 0x7fd7ac0d02f0 2024-09-10T23:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a8c00640 1 -- 172.21.15.17:0/3496834659 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd794010430 con 0x7fd7ac0d02f0 2024-09-10T23:19:31.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b3200640 1 -- 172.21.15.17:0/3496834659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ac147240 con 0x7fd7ac0d02f0 2024-09-10T23:19:31.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7a8c00640 1 -- 172.21.15.17:0/3496834659 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794010860 con 0x7fd7ac0d02f0 2024-09-10T23:19:31.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.069+0000 7fd7b3200640 1 -- 172.21.15.17:0/3496834659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ac14efb0 con 0x7fd7ac0d02f0 2024-09-10T23:19:31.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7a8c00640 1 -- 172.21.15.17:0/3496834659 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd794010a00 con 0x7fd7ac0d02f0 2024-09-10T23:19:31.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7a8c00640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd788072610 0x7fd788074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7b66eb000 1 Processor -- start 2024-09-10T23:19:31.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7a8c00640 1 -- 172.21.15.17:0/3496834659 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fd794093ef0 con 0x7fd7ac0d02f0 2024-09-10T23:19:31.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7b66eb000 1 -- start start 2024-09-10T23:19:31.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd788072610 0x7fd788074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebdd92e0 0x55fbebdd96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebd8d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebd8d8f0 0x55fbebd8dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fbebbeaa50 con 0x55fbebd8d8f0 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fbebbd9e80 con 0x55fbebdd92e0 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fbebbddc90 con 0x55fbebdd9c00 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd788072610 0x7fd788074ad0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd79c007fd0 tx=0x7fd79c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebdd92e0 0x55fbebdd96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7b1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebd8d8f0 0x55fbebd8dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebdd92e0 0x55fbebdd96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:51962/0 (socket says 172.21.15.17:51962) 2024-09-10T23:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 -- 172.21.15.17:0/164382261 learned_addr learned my addr 172.21.15.17:0/164382261 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7a3400640 1 --2- 172.21.15.17:0/164382261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebd8d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 -- 172.21.15.17:0/164382261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 msgr2=0x55fbebd8d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 --2- 172.21.15.17:0/164382261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebd8d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 -- 172.21.15.17:0/164382261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebd8d8f0 msgr2=0x55fbebd8dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 --2- 172.21.15.17:0/164382261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebd8d8f0 0x55fbebd8dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 -- 172.21.15.17:0/164382261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbebc86690 con 0x55fbebdd92e0 2024-09-10T23:19:31.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7abe00640 1 --2- 172.21.15.17:0/164382261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebdd92e0 0x55fbebdd96c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00f9c0 tx=0x7fd79c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d40ad012d3b3d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7a0c00640 1 -- 172.21.15.17:0/164382261 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c025070 con 0x55fbebdd92e0 2024-09-10T23:19:31.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7a0c00640 1 -- 172.21.15.17:0/164382261 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd79c01b050 con 0x55fbebdd92e0 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.073+0000 7fd7a0c00640 1 -- 172.21.15.17:0/164382261 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c014e20 con 0x55fbebdd92e0 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- 172.21.15.17:0/164382261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebdd92e0 msgr2=0x55fbebdd96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/164382261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebdd92e0 0x55fbebdd96c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd79c00f9c0 tx=0x7fd79c012000 comp rx=0 tx=0).stop 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- 172.21.15.17:0/164382261 shutdown_connections 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/164382261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebd8d8f0 0x55fbebd8dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/164382261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebd8d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/164382261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebdd92e0 0x55fbebdd96c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- 172.21.15.17:0/164382261 >> 172.21.15.17:0/164382261 conn(0x55fbebc77b30 msgr2=0x55fbebdbc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- 172.21.15.17:0/164382261 shutdown_connections 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- 172.21.15.17:0/164382261 wait complete. 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- start start 2024-09-10T23:19:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 Processor -- start 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebdb9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebdbacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fbebba15e0 con 0x55fbebdd92e0 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fbebb99840 con 0x55fbebd8d8f0 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fbebba6130 con 0x55fbebdd9c00 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 10 client.0 _ll_register_callbacks cb 0x55fbebb847d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdba780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48840/0 (socket says 172.21.15.17:48840) 2024-09-10T23:19:31.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7a3400640 1 -- 172.21.15.17:0/3715146333 learned_addr learned my addr 172.21.15.17:0/3715146333 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7abe00640 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebdb9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b1200640 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebdbacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7a3400640 1 -- 172.21.15.17:0/3715146333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 msgr2=0x55fbebdbacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7a3400640 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebdbacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7a3400640 1 -- 172.21.15.17:0/3715146333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 msgr2=0x55fbebdb9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7a3400640 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebdb9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7a3400640 1 -- 172.21.15.17:0/3715146333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbebc24570 con 0x55fbebdd92e0 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7a3400640 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdba780 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd79400d010 tx=0x7fd79405e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7e4e64aaa376bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd799600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd799600640 1 -- 172.21.15.17:0/3715146333 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794068200 con 0x55fbebdd92e0 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- 172.21.15.17:0/3715146333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fbebb72270 con 0x55fbebdd92e0 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd799600640 1 -- 172.21.15.17:0/3715146333 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fd79405a700 con 0x55fbebdd92e0 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd799600640 1 -- 172.21.15.17:0/3715146333 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd79405a900 con 0x55fbebdd92e0 2024-09-10T23:19:31.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 10 client.6024 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 1 -- 172.21.15.17:0/3715146333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55fbebb8d380 con 0x55fbebdd92e0 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd799600640 1 -- 172.21.15.17:0/3715146333 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55fbebb72270 con 0x55fbebdd92e0 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd799600640 1 -- 172.21.15.17:0/3715146333 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fd794066ad0 con 0x55fbebdd92e0 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 10 client.6024 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.077+0000 7fd7b66eb000 10 client.6024 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 20 client.6024 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fbebdbba00 0x55fbebdeb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 4 client.6024 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 -- 172.21.15.17:0/3715146333 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbebbec9a0 con 0x55fbebdbba00 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7abe00640 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fbebdbba00 0x55fbebdeb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7abe00640 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fbebdbba00 0x55fbebdeb390 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=278d3b73b43ff5c1 server_cookie=777e101d0cb14232 in_seq=0 out_seq=0 2024-09-10T23:19:31.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd799600640 10 client.6024 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd799600640 1 -- 172.21.15.17:0/3715146333 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fbebbec9a0 con 0x55fbebdbba00 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd799600640 10 client.6024 handle_command_reply: tid=0 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 client.6024 shutdown 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 -- 172.21.15.17:0/3715146333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 msgr2=0x55fbebdba780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdba780 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd79400d010 tx=0x7fd79405e650 comp rx=0 tx=0).stop 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 -- 172.21.15.17:0/3715146333 shutdown_connections 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fbebdbba00 0x55fbebdeb390 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebdbacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdba780 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/3715146333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebdb9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 -- 172.21.15.17:0/3715146333 >> 172.21.15.17:0/3715146333 conn(0x55fbebc77b30 msgr2=0x55fbebd8cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd799600640 0 client.6024 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 -- 172.21.15.17:0/3715146333 shutdown_connections 2024-09-10T23:19:31.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 1 -- 172.21.15.17:0/3715146333 wait complete. 2024-09-10T23:19:31.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.081+0000 7fd7b66eb000 20 client.6024 trim_cache size 0 max 16384 2024-09-10T23:19:31.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 Processor -- start 2024-09-10T23:19:31.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 -- start start 2024-09-10T23:19:31.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebdeb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdeb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebdebe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac2038a0 con 0x55fbebdd92e0 2024-09-10T23:19:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac153880 con 0x55fbebd8d8f0 2024-09-10T23:19:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ac06f7d0 con 0x55fbebdd9c00 2024-09-10T23:19:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdeb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdeb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48844/0 (socket says 172.21.15.17:48844) 2024-09-10T23:19:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7a3400640 1 -- 172.21.15.17:0/1988011334 learned_addr learned my addr 172.21.15.17:0/1988011334 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7a3400640 1 -- 172.21.15.17:0/1988011334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 msgr2=0x55fbebdebe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7a3400640 1 --2- 172.21.15.17:0/1988011334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebdebe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7abe00640 1 --2- 172.21.15.17:0/1988011334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebdeb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7a3400640 1 -- 172.21.15.17:0/1988011334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 msgr2=0x55fbebdeb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7a3400640 1 --2- 172.21.15.17:0/1988011334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebdeb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7a3400640 1 -- 172.21.15.17:0/1988011334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbebc60020 con 0x55fbebdd92e0 2024-09-10T23:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7abe00640 1 --2- 172.21.15.17:0/1988011334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebdeb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7a3400640 1 --2- 172.21.15.17:0/1988011334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdeb8d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd79405adc0 tx=0x7fd79405ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649221425944127b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd79be00640 1 -- 172.21.15.17:0/1988011334 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79405e220 con 0x55fbebdd92e0 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd79be00640 1 -- 172.21.15.17:0/1988011334 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd794066ad0 con 0x55fbebdd92e0 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd79be00640 1 -- 172.21.15.17:0/1988011334 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79405dce0 con 0x55fbebdd92e0 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 -- 172.21.15.17:0/1988011334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 msgr2=0x55fbebdeb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/1988011334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdeb8d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd79405adc0 tx=0x7fd79405ac50 comp rx=0 tx=0).stop 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 -- 172.21.15.17:0/1988011334 shutdown_connections 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/1988011334 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebdebe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/1988011334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebdeb8d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/1988011334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebdeb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 -- 172.21.15.17:0/1988011334 >> 172.21.15.17:0/1988011334 conn(0x55fbebc77b30 msgr2=0x55fbebd8bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 -- 172.21.15.17:0/1988011334 shutdown_connections 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.101+0000 7fd7b66eb000 1 -- 172.21.15.17:0/1988011334 wait complete. 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 -- start start 2024-09-10T23:19:31.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 Processor -- start 2024-09-10T23:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebe4f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebe4fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebe503b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fbebbe22c0 con 0x55fbebdd92e0 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fbebbdcfa0 con 0x55fbebd8d8f0 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fbebb8fa60 con 0x55fbebdd9c00 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 10 client.0 _ll_register_callbacks cb 0x7fd79400ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebe4fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebe4fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48856/0 (socket says 172.21.15.17:48856) 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7a3400640 1 -- 172.21.15.17:0/617684698 learned_addr learned my addr 172.21.15.17:0/617684698 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b1200640 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebe503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7abe00640 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebe4f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7a3400640 1 -- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 msgr2=0x55fbebe503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7a3400640 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebe503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7a3400640 1 -- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 msgr2=0x55fbebe4f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7a3400640 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebe4f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7a3400640 1 -- 172.21.15.17:0/617684698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbebc372d0 con 0x55fbebdd92e0 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7abe00640 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebe4f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b1200640 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebe503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7a3400640 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebe4fe70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd79405acc0 tx=0x7fd79405ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1eac87e728de74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd799600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd799600640 1 -- 172.21.15.17:0/617684698 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79405de10 con 0x55fbebdd92e0 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd799600640 1 -- 172.21.15.17:0/617684698 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fd794019c90 con 0x55fbebdd92e0 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 -- 172.21.15.17:0/617684698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd794066ad0 con 0x55fbebdd92e0 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd799600640 1 -- 172.21.15.17:0/617684698 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd7940633c0 con 0x55fbebdd92e0 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 10 client.6030 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 -- 172.21.15.17:0/617684698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55fbebba0a50 con 0x55fbebdd92e0 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd799600640 1 -- 172.21.15.17:0/617684698 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd794066ad0 con 0x55fbebdd92e0 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd799600640 1 -- 172.21.15.17:0/617684698 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fd794078b90 con 0x55fbebdd92e0 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 10 client.6030 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 10 client.6030 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 20 client.6030 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fbebdeeff0 0x55fbebdef400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 4 client.6030 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7b66eb000 1 -- 172.21.15.17:0/617684698 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55fbebbe8450 con 0x55fbebdeeff0 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7abe00640 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fbebdeeff0 0x55fbebdef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd7abe00640 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fbebdeeff0 0x55fbebdef400 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3975cfe5e59e279 server_cookie=6d7f585f510a22ab in_seq=0 out_seq=0 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.105+0000 7fd799600640 10 client.6030 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd799600640 1 -- 172.21.15.17:0/617684698 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fbebbe8450 con 0x55fbebdeeff0 2024-09-10T23:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd799600640 10 client.6030 handle_command_reply: tid=0 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 client.6030 shutdown 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 -- 172.21.15.17:0/617684698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 msgr2=0x55fbebe4fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebe4fe70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd79405acc0 tx=0x7fd79405ad80 comp rx=0 tx=0).stop 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 -- 172.21.15.17:0/617684698 shutdown_connections 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55fbebdeeff0 0x55fbebdef400 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fbebdd9c00 0x55fbebe503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbebdd92e0 0x55fbebe4fe70 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd799600640 0 client.6030 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 --2- 172.21.15.17:0/617684698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fbebd8d8f0 0x55fbebe4f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 -- 172.21.15.17:0/617684698 >> 172.21.15.17:0/617684698 conn(0x55fbebc77b30 msgr2=0x55fbebd8c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 -- 172.21.15.17:0/617684698 shutdown_connections 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 1 -- 172.21.15.17:0/617684698 wait complete. 2024-09-10T23:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b66eb000 20 client.6030 trim_cache size 0 max 16384 2024-09-10T23:19:31.119 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:31.119 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:19:31.119 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "db078b5b-7ada-4cd8-a356-d7dec8db219a", 2024-09-10T23:19:31.119 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:19:31.119 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 -- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd788072610 msgr2=0x7fd788074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd788072610 0x7fd788074ad0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd79c007fd0 tx=0x7fd79c009040 comp rx=0 tx=0).stop 2024-09-10T23:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 -- 172.21.15.17:0/3496834659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 msgr2=0x7fd7ac156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 0x7fd7ac156080 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd79400ea20 tx=0x7fd79400eee0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 -- 172.21.15.17:0/3496834659 shutdown_connections 2024-09-10T23:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd788072610 0x7fd788074ad0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7ac160510 0x7fd7ac1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7ac0d02f0 0x7fd7ac156080 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 --2- 172.21.15.17:0/3496834659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7ac0b2620 0x7fd7ac14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 -- 172.21.15.17:0/3496834659 >> 172.21.15.17:0/3496834659 conn(0x7fd7ac0d1d10 msgr2=0x7fd7ac165e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 -- 172.21.15.17:0/3496834659 shutdown_connections 2024-09-10T23:19:31.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.109+0000 7fd7b3200640 1 -- 172.21.15.17:0/3496834659 wait complete. 2024-09-10T23:19:31.133 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'db078b5b-7ada-4cd8-a356-d7dec8db219a', 'mode': 'asynchronous'}' 2024-09-10T23:19:31.133 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-10T23:19:31.134 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-10T23:19:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.277+0000 7fec99400640 1 -- 172.21.15.17:0/1319342363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec940b3940 msgr2=0x7fec940b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.277+0000 7fec99400640 1 --2- 172.21.15.17:0/1319342363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec940b3940 0x7fec940b3df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009bc0 tx=0x7fec8c01ca60 comp rx=0 tx=0).stop 2024-09-10T23:19:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.277+0000 7fec99400640 1 -- 172.21.15.17:0/1319342363 shutdown_connections 2024-09-10T23:19:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.277+0000 7fec99400640 1 --2- 172.21.15.17:0/1319342363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec940b3940 0x7fec940b3df0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.277+0000 7fec99400640 1 --2- 172.21.15.17:0/1319342363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec9415ab30 0x7fec94073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.277+0000 7fec99400640 1 -- 172.21.15.17:0/1319342363 >> 172.21.15.17:0/1319342363 conn(0x7fec940b17a0 msgr2=0x7fec940b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.277+0000 7fec99400640 1 -- 172.21.15.17:0/1319342363 shutdown_connections 2024-09-10T23:19:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.277+0000 7fec99400640 1 -- 172.21.15.17:0/1319342363 wait complete. 2024-09-10T23:19:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 Processor -- start 2024-09-10T23:19:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 -- start start 2024-09-10T23:19:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec94072b40 0x7fec941fb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec940b3940 0x7fec94153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9415ab30 0x7fec9415db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fec94167bf0 con 0x7fec94072b40 2024-09-10T23:19:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec94167a70 con 0x7fec9415ab30 2024-09-10T23:19:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fec94167d70 con 0x7fec940b3940 2024-09-10T23:19:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec92800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec94072b40 0x7fec941fb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec92800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec94072b40 0x7fec941fb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48872/0 (socket says 172.21.15.17:48872) 2024-09-10T23:19:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec92800640 1 -- 172.21.15.17:0/2128015056 learned_addr learned my addr 172.21.15.17:0/2128015056 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec93200640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9415ab30 0x7fec9415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec8be00640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec940b3940 0x7fec94153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec92800640 1 -- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec940b3940 msgr2=0x7fec94153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec92800640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec940b3940 0x7fec94153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec92800640 1 -- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9415ab30 msgr2=0x7fec9415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec92800640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9415ab30 0x7fec9415db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec92800640 1 -- 172.21.15.17:0/2128015056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec941fbc90 con 0x7fec94072b40 2024-09-10T23:19:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec8be00640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec940b3940 0x7fec94153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec92800640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec94072b40 0x7fec941fb750 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fec8400e7a0 tx=0x7fec8400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec8aa00640 1 -- 172.21.15.17:0/2128015056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8400ccc0 con 0x7fec94072b40 2024-09-10T23:19:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec8aa00640 1 -- 172.21.15.17:0/2128015056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec84010430 con 0x7fec94072b40 2024-09-10T23:19:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec8aa00640 1 -- 172.21.15.17:0/2128015056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84010860 con 0x7fec94072b40 2024-09-10T23:19:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 -- 172.21.15.17:0/2128015056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec940aed80 con 0x7fec94072b40 2024-09-10T23:19:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.281+0000 7fec99400640 1 -- 172.21.15.17:0/2128015056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec941faf50 con 0x7fec94072b40 2024-09-10T23:19:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.285+0000 7fec8aa00640 1 -- 172.21.15.17:0/2128015056 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fec84010a00 con 0x7fec94072b40 2024-09-10T23:19:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.285+0000 7fec8aa00640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fec700725e0 0x7fec70074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.285+0000 7fec9c863000 1 Processor -- start 2024-09-10T23:19:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.285+0000 7fec8aa00640 1 -- 172.21.15.17:0/2128015056 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fec84093de0 con 0x7fec94072b40 2024-09-10T23:19:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.285+0000 7fec9c863000 1 -- start start 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.285+0000 7fec8be00640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fec700725e0 0x7fec70074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c929d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477c45ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c46400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f477aa4fa0 con 0x55f477c46020 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f477a943d0 con 0x55f477c925f0 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f477a981e0 con 0x55f477c92f10 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec8be00640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fec700725e0 0x7fec70074aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fec940cc370 tx=0x7fec7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec93200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c46400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec93200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c46400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48888/0 (socket says 172.21.15.17:48888) 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec93200640 1 -- 172.21.15.17:0/1083692132 learned_addr learned my addr 172.21.15.17:0/1083692132 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec92800640 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c929d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec8be00640 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477c45ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec93200640 1 -- 172.21.15.17:0/1083692132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 msgr2=0x55f477c45ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec93200640 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477c45ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec93200640 1 -- 172.21.15.17:0/1083692132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 msgr2=0x55f477c929d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec93200640 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c929d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec93200640 1 -- 172.21.15.17:0/1083692132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f477a54620 con 0x55f477c46020 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec92800640 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c929d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec93200640 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c46400 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009bc0 tx=0x7fec8c019860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79a066d43d25b9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec83400640 1 -- 172.21.15.17:0/1083692132 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0b2040 con 0x55f477c46020 2024-09-10T23:19:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec83400640 1 -- 172.21.15.17:0/1083692132 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec8c004b40 con 0x55f477c46020 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec83400640 1 -- 172.21.15.17:0/1083692132 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c003980 con 0x55f477c46020 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 -- 172.21.15.17:0/1083692132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 msgr2=0x55f477c46400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c46400 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009bc0 tx=0x7fec8c019860 comp rx=0 tx=0).stop 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 -- 172.21.15.17:0/1083692132 shutdown_connections 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c46400 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477c45ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 --2- 172.21.15.17:0/1083692132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c929d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 -- 172.21.15.17:0/1083692132 >> 172.21.15.17:0/1083692132 conn(0x55f477c738c0 msgr2=0x55f477c75cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 -- 172.21.15.17:0/1083692132 shutdown_connections 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 -- 172.21.15.17:0/1083692132 wait complete. 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 -- start start 2024-09-10T23:19:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.289+0000 7fec9c863000 1 Processor -- start 2024-09-10T23:19:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c46020 0x55f477c5f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c925f0 0x55f477c4d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477c4dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f477a39ab0 con 0x55f477c925f0 2024-09-10T23:19:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f477a50e60 con 0x55f477c46020 2024-09-10T23:19:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f477a3f500 con 0x55f477c92f10 2024-09-10T23:19:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 10 client.0 _ll_register_callbacks cb 0x55f477c33590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c925f0 0x55f477c4d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c925f0 0x55f477c4d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48898/0 (socket says 172.21.15.17:48898) 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec8be00640 1 -- 172.21.15.17:0/2252435116 learned_addr learned my addr 172.21.15.17:0/2252435116 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec92800640 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c46020 0x55f477c5f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec93200640 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477c4dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec8be00640 1 -- 172.21.15.17:0/2252435116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 msgr2=0x55f477c4dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec8be00640 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477c4dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec8be00640 1 -- 172.21.15.17:0/2252435116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c46020 msgr2=0x55f477c5f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec8be00640 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c46020 0x55f477c5f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec8be00640 1 -- 172.21.15.17:0/2252435116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f477a29d50 con 0x55f477c925f0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec8be00640 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c925f0 0x55f477c4d5a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fec940b27e0 tx=0x7fec7c001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5311ce511fba7238 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 1 -- 172.21.15.17:0/2252435116 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c024020 con 0x55f477c925f0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- 172.21.15.17:0/2252435116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f477a2c8f0 con 0x55f477c925f0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 1 -- 172.21.15.17:0/2252435116 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fec7c020600 con 0x55f477c925f0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 1 -- 172.21.15.17:0/2252435116 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fec7c02e050 con 0x55f477c925f0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 10 client.6042 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- 172.21.15.17:0/2252435116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55f477a327b0 con 0x55f477c925f0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 1 -- 172.21.15.17:0/2252435116 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f477a2c8f0 con 0x55f477c925f0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 1 -- 172.21.15.17:0/2252435116 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fec7c031020 con 0x55f477c925f0 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 10 client.6042 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 10 client.6042 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 20 client.6042 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55f477c53f80 0x55f477c54390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 4 client.6042 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- 172.21.15.17:0/2252435116 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f477aa6ef0 con 0x55f477c53f80 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec92800640 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55f477c53f80 0x55f477c54390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 10 client.6042 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec92800640 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55f477c53f80 0x55f477c54390 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6679530db4c4d85 server_cookie=4ff11e70fe47f843 in_seq=0 out_seq=0 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 1 -- 172.21.15.17:0/2252435116 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f477aa6ef0 con 0x55f477c53f80 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 10 client.6042 handle_command_reply: tid=0 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 client.6042 shutdown 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- 172.21.15.17:0/2252435116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c925f0 msgr2=0x55f477c4d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c925f0 0x55f477c4d5a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fec940b27e0 tx=0x7fec7c001c50 comp rx=0 tx=0).stop 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- 172.21.15.17:0/2252435116 shutdown_connections 2024-09-10T23:19:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55f477c53f80 0x55f477c54390 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477c4dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c925f0 0x55f477c4d5a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 --2- 172.21.15.17:0/2252435116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c46020 0x55f477c5f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec77e00640 0 client.6042 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- 172.21.15.17:0/2252435116 >> 172.21.15.17:0/2252435116 conn(0x55f477c738c0 msgr2=0x55f477c451e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- 172.21.15.17:0/2252435116 shutdown_connections 2024-09-10T23:19:31.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.293+0000 7fec9c863000 1 -- 172.21.15.17:0/2252435116 wait complete. 2024-09-10T23:19:31.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.297+0000 7fec9c863000 20 client.6042 trim_cache size 0 max 16384 2024-09-10T23:19:31.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec9c863000 1 Processor -- start 2024-09-10T23:19:31.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec9c863000 1 -- start start 2024-09-10T23:19:31.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec9c863000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c71b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec9c863000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec9c863000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477ca96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec9c863000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fec94203850 con 0x55f477c46020 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec9c863000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fec9415c740 con 0x55f477c925f0 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec9c863000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fec94203200 con 0x55f477c92f10 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec92800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c71b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec92800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c71b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48906/0 (socket says 172.21.15.17:48906) 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec92800640 1 -- 172.21.15.17:0/10470052 learned_addr learned my addr 172.21.15.17:0/10470052 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec8be00640 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec93200640 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477ca96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec92800640 1 -- 172.21.15.17:0/10470052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 msgr2=0x55f477ca96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec92800640 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477ca96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec92800640 1 -- 172.21.15.17:0/10470052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 msgr2=0x55f477c720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec92800640 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec92800640 1 -- 172.21.15.17:0/10470052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f477af00b0 con 0x55f477c46020 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.313+0000 7fec8be00640 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:31.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c71b80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fec84061010 tx=0x7fec84061040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779109a047dbacc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec82a00640 1 -- 172.21.15.17:0/10470052 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84063770 con 0x55f477c46020 2024-09-10T23:19:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec82a00640 1 -- 172.21.15.17:0/10470052 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec84068190 con 0x55f477c46020 2024-09-10T23:19:31.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec82a00640 1 -- 172.21.15.17:0/10470052 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84010d20 con 0x55f477c46020 2024-09-10T23:19:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- 172.21.15.17:0/10470052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 msgr2=0x55f477c71b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c71b80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fec84061010 tx=0x7fec84061040 comp rx=0 tx=0).stop 2024-09-10T23:19:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- 172.21.15.17:0/10470052 shutdown_connections 2024-09-10T23:19:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c92f10 0x55f477ca96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c925f0 0x55f477c720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 --2- 172.21.15.17:0/10470052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477c71b80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- 172.21.15.17:0/10470052 >> 172.21.15.17:0/10470052 conn(0x55f477c738c0 msgr2=0x55f477c53280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- 172.21.15.17:0/10470052 shutdown_connections 2024-09-10T23:19:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- 172.21.15.17:0/10470052 wait complete. 2024-09-10T23:19:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- start start 2024-09-10T23:19:31.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 Processor -- start 2024-09-10T23:19:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477d082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c925f0 0x55f477d08810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c92f10 0x55f477d08d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f477a60fe0 con 0x55f477c46020 2024-09-10T23:19:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f477aa3d70 con 0x55f477c92f10 2024-09-10T23:19:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f477a974f0 con 0x55f477c925f0 2024-09-10T23:19:31.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 10 client.0 _ll_register_callbacks cb 0x7fec7c00ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477d082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477d082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48916/0 (socket says 172.21.15.17:48916) 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 -- 172.21.15.17:0/460443813 learned_addr learned my addr 172.21.15.17:0/460443813 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec8be00640 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c925f0 0x55f477d08810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec93200640 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c92f10 0x55f477d08d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 -- 172.21.15.17:0/460443813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c925f0 msgr2=0x55f477d08810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c925f0 0x55f477d08810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 -- 172.21.15.17:0/460443813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c92f10 msgr2=0x55f477d08d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c92f10 0x55f477d08d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 -- 172.21.15.17:0/460443813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f477a5a420 con 0x55f477c46020 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec93200640 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c92f10 0x55f477d08d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec92800640 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477d082d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c6a0 tx=0x7fec8405ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad38afff94755d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec77e00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:31.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec77e00640 1 -- 172.21.15.17:0/460443813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8405af00 con 0x55f477c46020 2024-09-10T23:19:31.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec77e00640 1 -- 172.21.15.17:0/460443813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fec8405def0 con 0x55f477c46020 2024-09-10T23:19:31.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.317+0000 7fec9c863000 1 -- 172.21.15.17:0/460443813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec84068190 con 0x55f477c46020 2024-09-10T23:19:31.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec77e00640 1 -- 172.21.15.17:0/460443813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fec8405b0a0 con 0x55f477c46020 2024-09-10T23:19:31.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 10 client.6048 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:31.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 -- 172.21.15.17:0/460443813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55f477a2af40 con 0x55f477c46020 2024-09-10T23:19:31.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec77e00640 1 -- 172.21.15.17:0/460443813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec84068190 con 0x55f477c46020 2024-09-10T23:19:31.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec77e00640 1 -- 172.21.15.17:0/460443813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fec84078b20 con 0x55f477c46020 2024-09-10T23:19:31.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 10 client.6048 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:31.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 10 client.6048 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:31.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 20 client.6048 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:31.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55f477ca5b10 0x55f477ca5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 4 client.6048 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-10T23:19:31.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 -- 172.21.15.17:0/460443813 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55f477aa29a0 con 0x55f477ca5b10 2024-09-10T23:19:31.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec8be00640 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55f477ca5b10 0x55f477ca5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec8be00640 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55f477ca5b10 0x55f477ca5ef0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bbe36c7bb06470d server_cookie=6474a0fbb818ea7c in_seq=0 out_seq=0 2024-09-10T23:19:31.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec77e00640 10 client.6048 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec77e00640 1 -- 172.21.15.17:0/460443813 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f477aa29a0 con 0x55f477ca5b10 2024-09-10T23:19:31.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec77e00640 10 client.6048 handle_command_reply: tid=0 2024-09-10T23:19:31.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 client.6048 shutdown 2024-09-10T23:19:31.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 -- 172.21.15.17:0/460443813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 msgr2=0x55f477d082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477d082d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c6a0 tx=0x7fec8405ed50 comp rx=0 tx=0).stop 2024-09-10T23:19:31.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 -- 172.21.15.17:0/460443813 shutdown_connections 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55f477ca5b10 0x55f477ca5ef0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f477c92f10 0x55f477d08d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f477c925f0 0x55f477d08810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec77e00640 0 client.6048 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 --2- 172.21.15.17:0/460443813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f477c46020 0x55f477d082d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 -- 172.21.15.17:0/460443813 >> 172.21.15.17:0/460443813 conn(0x55f477c738c0 msgr2=0x55f477c4d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 -- 172.21.15.17:0/460443813 shutdown_connections 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 1 -- 172.21.15.17:0/460443813 wait complete. 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec9c863000 20 client.6048 trim_cache size 0 max 16384 2024-09-10T23:19:31.334 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:19:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "0aeec676-af76-4e16-86d1-82298f9906a5", 2024-09-10T23:19:31.335 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:19:31.335 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:31.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 -- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fec700725e0 msgr2=0x7fec70074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fec700725e0 0x7fec70074aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fec940cc370 tx=0x7fec7c009040 comp rx=0 tx=0).stop 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 -- 172.21.15.17:0/2128015056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec94072b40 msgr2=0x7fec941fb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec94072b40 0x7fec941fb750 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fec8400e7a0 tx=0x7fec8400ec60 comp rx=0 tx=0).stop 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 -- 172.21.15.17:0/2128015056 shutdown_connections 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fec700725e0 0x7fec70074aa0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec9415ab30 0x7fec9415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fec940b3940 0x7fec94153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 --2- 172.21.15.17:0/2128015056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec94072b40 0x7fec941fb750 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 -- 172.21.15.17:0/2128015056 >> 172.21.15.17:0/2128015056 conn(0x7fec940b17a0 msgr2=0x7fec941561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 -- 172.21.15.17:0/2128015056 shutdown_connections 2024-09-10T23:19:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.321+0000 7fec99400640 1 -- 172.21.15.17:0/2128015056 wait complete. 2024-09-10T23:19:31.346 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '0aeec676-af76-4e16-86d1-82298f9906a5', 'mode': 'asynchronous'}' 2024-09-10T23:19:31.346 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-10T23:19:31.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-10T23:19:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.489+0000 7fd2a1c00640 1 -- 172.21.15.17:0/393115093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c15a390 msgr2=0x7fd29c06f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.489+0000 7fd2a1c00640 1 --2- 172.21.15.17:0/393115093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c15a390 0x7fd29c06f270 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0720a0 tx=0x7fd29401cd50 comp rx=0 tx=0).stop 2024-09-10T23:19:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.489+0000 7fd2a1c00640 1 -- 172.21.15.17:0/393115093 shutdown_connections 2024-09-10T23:19:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.489+0000 7fd2a1c00640 1 --2- 172.21.15.17:0/393115093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c15a390 0x7fd29c06f270 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.489+0000 7fd2a1c00640 1 --2- 172.21.15.17:0/393115093 >> v2:172.21.15.77:3300/0 conn(0x7fd29c072da0 0x7fd29c1430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.489+0000 7fd2a1c00640 1 -- 172.21.15.17:0/393115093 >> 172.21.15.17:0/393115093 conn(0x7fd29c0b17a0 msgr2=0x7fd29c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.489+0000 7fd2a1c00640 1 -- 172.21.15.17:0/393115093 shutdown_connections 2024-09-10T23:19:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.489+0000 7fd2a1c00640 1 -- 172.21.15.17:0/393115093 wait complete. 2024-09-10T23:19:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 Processor -- start 2024-09-10T23:19:31.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 -- start start 2024-09-10T23:19:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd29c070780 0x7fd29c0c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c072da0 0x7fd29c156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15a390 0x7fd29c0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c070000 con 0x7fd29c072da0 2024-09-10T23:19:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c166d30 con 0x7fd29c15a390 2024-09-10T23:19:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd29c0c7760 con 0x7fd29c070780 2024-09-10T23:19:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd292000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c072da0 0x7fd29c156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd292000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c072da0 0x7fd29c156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48930/0 (socket says 172.21.15.17:48930) 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd292000640 1 -- 172.21.15.17:0/3487291526 learned_addr learned my addr 172.21.15.17:0/3487291526 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd29b400640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15a390 0x7fd29c0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd29aa00640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd29c070780 0x7fd29c0c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd292000640 1 -- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd29c070780 msgr2=0x7fd29c0c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd292000640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd29c070780 0x7fd29c0c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd292000640 1 -- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15a390 msgr2=0x7fd29c0c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd292000640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15a390 0x7fd29c0c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd292000640 1 -- 172.21.15.17:0/3487291526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c0c7990 con 0x7fd29c072da0 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd29b400640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15a390 0x7fd29c0c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd292000640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c072da0 0x7fd29c156610 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd28400eac0 tx=0x7fd28400ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd293400640 1 -- 172.21.15.17:0/3487291526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28401b070 con 0x7fd29c072da0 2024-09-10T23:19:31.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd293400640 1 -- 172.21.15.17:0/3487291526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd28400ce30 con 0x7fd29c072da0 2024-09-10T23:19:31.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 -- 172.21.15.17:0/3487291526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd29c0c7c70 con 0x7fd29c072da0 2024-09-10T23:19:31.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd293400640 1 -- 172.21.15.17:0/3487291526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284016650 con 0x7fd29c072da0 2024-09-10T23:19:31.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.493+0000 7fd2a1c00640 1 -- 172.21.15.17:0/3487291526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd29c0c8230 con 0x7fd29c072da0 2024-09-10T23:19:31.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd293400640 1 -- 172.21.15.17:0/3487291526 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd28400b040 con 0x7fd29c072da0 2024-09-10T23:19:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd293400640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2780725e0 0x7fd278074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd293400640 1 -- 172.21.15.17:0/3487291526 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fd284093770 con 0x7fd29c072da0 2024-09-10T23:19:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd2a4f54000 1 Processor -- start 2024-09-10T23:19:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd29aa00640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2780725e0 0x7fd278074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd2a4f54000 1 -- start start 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd29aa00640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2780725e0 0x7fd278074aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0016f0 tx=0x7fd28c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 0x560468f884b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468f3e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468f3edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560468d99c00 con 0x560468f3e9d0 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560468d89030 con 0x560468f880d0 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560468d8ce40 con 0x560468f889f0 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd29aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 0x560468f884b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd29b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468f3edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd292000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468f3e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd29aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 0x560468f884b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:52074/0 (socket says 172.21.15.17:52074) 2024-09-10T23:19:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd29aa00640 1 -- 172.21.15.17:0/4075428501 learned_addr learned my addr 172.21.15.17:0/4075428501 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.497+0000 7fd29b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468f3edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48938/0 (socket says 172.21.15.17:48938) 2024-09-10T23:19:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd29b400640 1 -- 172.21.15.17:0/4075428501 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 msgr2=0x560468f3e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd29b400640 1 --2- 172.21.15.17:0/4075428501 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468f3e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd29b400640 1 -- 172.21.15.17:0/4075428501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 msgr2=0x560468f884b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd29b400640 1 --2- 172.21.15.17:0/4075428501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 0x560468f884b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd29b400640 1 -- 172.21.15.17:0/4075428501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560468d09750 con 0x560468f3e9d0 2024-09-10T23:19:31.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd29b400640 1 --2- 172.21.15.17:0/4075428501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468f3edb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd2940ac000 tx=0x7fd294019af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3804fc6fbe9f0523 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd28b400640 1 -- 172.21.15.17:0/4075428501 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2940b2040 con 0x560468f3e9d0 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd28b400640 1 -- 172.21.15.17:0/4075428501 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd294004a50 con 0x560468f3e9d0 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd28b400640 1 -- 172.21.15.17:0/4075428501 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294004e40 con 0x560468f3e9d0 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4075428501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 msgr2=0x560468f3edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4075428501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468f3edb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd2940ac000 tx=0x7fd294019af0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4075428501 shutdown_connections 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4075428501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468f3edb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4075428501 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468f3e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4075428501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 0x560468f884b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4075428501 >> 172.21.15.17:0/4075428501 conn(0x560468e26610 msgr2=0x560468f45450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4075428501 shutdown_connections 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4075428501 wait complete. 2024-09-10T23:19:31.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 -- start start 2024-09-10T23:19:31.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 Processor -- start 2024-09-10T23:19:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f3e9d0 0x560468f87890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468f435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468f43b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560468d2e540 con 0x560468f880d0 2024-09-10T23:19:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560468d3e9c0 con 0x560468f3e9d0 2024-09-10T23:19:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560468e439e0 con 0x560468f889f0 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd2a4f54000 10 client.0 _ll_register_callbacks cb 0x560468f2aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd292000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468f435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd292000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468f435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48946/0 (socket says 172.21.15.17:48946) 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd292000640 1 -- 172.21.15.17:0/674546795 learned_addr learned my addr 172.21.15.17:0/674546795 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd29aa00640 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f3e9d0 0x560468f87890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd29b400640 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468f43b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd292000640 1 -- 172.21.15.17:0/674546795 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 msgr2=0x560468f43b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd292000640 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468f43b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd292000640 1 -- 172.21.15.17:0/674546795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f3e9d0 msgr2=0x560468f87890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd292000640 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f3e9d0 0x560468f87890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.501+0000 7fd292000640 1 -- 172.21.15.17:0/674546795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560468d44f20 con 0x560468f880d0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd292000640 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468f435c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd2840919e0 tx=0x7fd28405e1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4d2cc9ac3dc2db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 1 -- 172.21.15.17:0/674546795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840679f0 con 0x560468f880d0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 1 -- 172.21.15.17:0/674546795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fd2840653f0 con 0x560468f880d0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 -- 172.21.15.17:0/674546795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560468d21350 con 0x560468f880d0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 1 -- 172.21.15.17:0/674546795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd284078050 con 0x560468f880d0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 10 client.6060 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 -- 172.21.15.17:0/674546795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x560468d27210 con 0x560468f880d0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 1 -- 172.21.15.17:0/674546795 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560468d21350 con 0x560468f880d0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 1 -- 172.21.15.17:0/674546795 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fd284059ef0 con 0x560468f880d0 2024-09-10T23:19:31.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 10 client.6060 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 10 client.6060 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 20 client.6060 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x560468f4a150 0x560468f4a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 4 client.6060 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 -- 172.21.15.17:0/674546795 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560468d9bb50 con 0x560468f4a150 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd29aa00640 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x560468f4a150 0x560468f4a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd29aa00640 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x560468f4a150 0x560468f4a560 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17596f3e83c77d2b server_cookie=20724d2cde88b8f1 in_seq=0 out_seq=0 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 10 client.6060 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 1 -- 172.21.15.17:0/674546795 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560468d9bb50 con 0x560468f4a150 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 10 client.6060 handle_command_reply: tid=0 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 client.6060 shutdown 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 -- 172.21.15.17:0/674546795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 msgr2=0x560468f435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468f435c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd2840919e0 tx=0x7fd28405e1f0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 -- 172.21.15.17:0/674546795 shutdown_connections 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x560468f4a150 0x560468f4a560 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468f43b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468f435c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/674546795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f3e9d0 0x560468f87890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd27fe00640 0 client.6060 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 -- 172.21.15.17:0/674546795 >> 172.21.15.17:0/674546795 conn(0x560468e26610 msgr2=0x560468f3d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 -- 172.21.15.17:0/674546795 shutdown_connections 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 1 -- 172.21.15.17:0/674546795 wait complete. 2024-09-10T23:19:31.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.505+0000 7fd2a4f54000 20 client.6060 trim_cache size 0 max 16384 2024-09-10T23:19:31.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 Processor -- start 2024-09-10T23:19:31.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 -- start start 2024-09-10T23:19:31.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468ff9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 0x560468ffa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468ffa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c203610 con 0x560468f3e9d0 2024-09-10T23:19:31.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c0c9d90 con 0x560468f880d0 2024-09-10T23:19:31.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd29c0ca3e0 con 0x560468f889f0 2024-09-10T23:19:31.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468ff9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468ff9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48950/0 (socket says 172.21.15.17:48950) 2024-09-10T23:19:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29aa00640 1 -- 172.21.15.17:0/3995160086 learned_addr learned my addr 172.21.15.17:0/3995160086 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29b400640 1 --2- 172.21.15.17:0/3995160086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468ffa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd292000640 1 --2- 172.21.15.17:0/3995160086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 0x560468ffa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29aa00640 1 -- 172.21.15.17:0/3995160086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 msgr2=0x560468ffa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29aa00640 1 --2- 172.21.15.17:0/3995160086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468ffa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29aa00640 1 -- 172.21.15.17:0/3995160086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 msgr2=0x560468ffa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29aa00640 1 --2- 172.21.15.17:0/3995160086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 0x560468ffa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29aa00640 1 -- 172.21.15.17:0/3995160086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560468d3f410 con 0x560468f3e9d0 2024-09-10T23:19:31.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd29aa00640 1 --2- 172.21.15.17:0/3995160086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468ff9d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd28c005260 tx=0x7fd28c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab315fa2c0388943 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd28aa00640 1 -- 172.21.15.17:0/3995160086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c003bc0 con 0x560468f3e9d0 2024-09-10T23:19:31.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd28aa00640 1 -- 172.21.15.17:0/3995160086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd28c003e50 con 0x560468f3e9d0 2024-09-10T23:19:31.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd28aa00640 1 -- 172.21.15.17:0/3995160086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28c00e630 con 0x560468f3e9d0 2024-09-10T23:19:31.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 -- 172.21.15.17:0/3995160086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 msgr2=0x560468ff9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.525+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/3995160086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468ff9d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd28c005260 tx=0x7fd28c012000 comp rx=0 tx=0).stop 2024-09-10T23:19:31.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- 172.21.15.17:0/3995160086 shutdown_connections 2024-09-10T23:19:31.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/3995160086 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f889f0 0x560468ffa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/3995160086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f880d0 0x560468ffa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/3995160086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f3e9d0 0x560468ff9d80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- 172.21.15.17:0/3995160086 >> 172.21.15.17:0/3995160086 conn(0x560468e26610 msgr2=0x560468f42110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- 172.21.15.17:0/3995160086 shutdown_connections 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- 172.21.15.17:0/3995160086 wait complete. 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- start start 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 Processor -- start 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f3e9d0 0x560468ffd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468ffdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f889f0 0x560468ffe210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560468d3dcd0 con 0x560468f880d0 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560468d34090 con 0x560468f889f0 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560468d8c150 con 0x560468f3e9d0 2024-09-10T23:19:31.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 10 client.0 _ll_register_callbacks cb 0x7fd28405df50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd292000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468ffdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd292000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468ffdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48966/0 (socket says 172.21.15.17:48966) 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd292000640 1 -- 172.21.15.17:0/4156460597 learned_addr learned my addr 172.21.15.17:0/4156460597 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd29aa00640 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f3e9d0 0x560468ffd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd29b400640 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f889f0 0x560468ffe210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd292000640 1 -- 172.21.15.17:0/4156460597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f3e9d0 msgr2=0x560468ffd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd292000640 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f3e9d0 0x560468ffd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd292000640 1 -- 172.21.15.17:0/4156460597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f889f0 msgr2=0x560468ffe210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd292000640 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f889f0 0x560468ffe210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd292000640 1 -- 172.21.15.17:0/4156460597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560468e0ee20 con 0x560468f880d0 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd292000640 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468ffdcd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd28405e2a0 tx=0x7fd28400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7589f5ac1299c887 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd27fe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:31.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd27fe00640 1 -- 172.21.15.17:0/4156460597 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840679f0 con 0x560468f880d0 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4156460597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd28c003e50 con 0x560468f880d0 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd27fe00640 1 -- 172.21.15.17:0/4156460597 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fd2840653f0 con 0x560468f880d0 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd27fe00640 1 -- 172.21.15.17:0/4156460597 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd28408adf0 con 0x560468f880d0 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 10 client.6066 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4156460597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x560468de6290 con 0x560468f880d0 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd27fe00640 1 -- 172.21.15.17:0/4156460597 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd28c003e50 con 0x560468f880d0 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd27fe00640 1 -- 172.21.15.17:0/4156460597 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fd28405d270 con 0x560468f880d0 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 10 client.6066 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 10 client.6066 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 20 client.6066 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x560468f9cdc0 0x560468f9d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 4 client.6066 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-10T23:19:31.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4156460597 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x560468d97600 con 0x560468f9cdc0 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.529+0000 7fd29aa00640 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x560468f9cdc0 0x560468f9d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd29aa00640 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x560468f9cdc0 0x560468f9d1d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3697ae7b664b23a server_cookie=60c8c6abb7b4db98 in_seq=0 out_seq=0 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd27fe00640 10 client.6066 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd27fe00640 1 -- 172.21.15.17:0/4156460597 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560468d97600 con 0x560468f9cdc0 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd27fe00640 10 client.6066 handle_command_reply: tid=0 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 client.6066 shutdown 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4156460597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 msgr2=0x560468ffdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468ffdcd0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd28405e2a0 tx=0x7fd28400c990 comp rx=0 tx=0).stop 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4156460597 shutdown_connections 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x560468f9cdc0 0x560468f9d1d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560468f889f0 0x560468ffe210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560468f880d0 0x560468ffdcd0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 --2- 172.21.15.17:0/4156460597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560468f3e9d0 0x560468ffd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd27fe00640 0 client.6066 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4156460597 >> 172.21.15.17:0/4156460597 conn(0x560468e26610 msgr2=0x560468f42110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4156460597 shutdown_connections 2024-09-10T23:19:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 1 -- 172.21.15.17:0/4156460597 wait complete. 2024-09-10T23:19:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a4f54000 20 client.6066 trim_cache size 0 max 16384 2024-09-10T23:19:31.545 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:31.545 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:19:31.546 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "a224d665-9c3a-45d5-a0a2-58ec71f923af", 2024-09-10T23:19:31.546 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:19:31.546 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:31.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 -- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2780725e0 msgr2=0x7fd278074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2780725e0 0x7fd278074aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0016f0 tx=0x7fd28c009040 comp rx=0 tx=0).stop 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 -- 172.21.15.17:0/3487291526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c072da0 msgr2=0x7fd29c156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c072da0 0x7fd29c156610 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd28400eac0 tx=0x7fd28400ef80 comp rx=0 tx=0).stop 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 -- 172.21.15.17:0/3487291526 shutdown_connections 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2780725e0 0x7fd278074aa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c15a390 0x7fd29c0c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd29c072da0 0x7fd29c156610 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 --2- 172.21.15.17:0/3487291526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd29c070780 0x7fd29c0c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 -- 172.21.15.17:0/3487291526 >> 172.21.15.17:0/3487291526 conn(0x7fd29c0b17a0 msgr2=0x7fd29c13e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 -- 172.21.15.17:0/3487291526 shutdown_connections 2024-09-10T23:19:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.533+0000 7fd2a1c00640 1 -- 172.21.15.17:0/3487291526 wait complete. 2024-09-10T23:19:31.558 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'a224d665-9c3a-45d5-a0a2-58ec71f923af', 'mode': 'asynchronous'}' 2024-09-10T23:19:31.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:31.559 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-09-10T23:19:31.570 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-09-10T23:19:31.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-09-10T23:19:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.757+0000 7ff073600640 1 -- 172.21.15.17:0/2371397232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 msgr2=0x7ff06c0b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.757+0000 7ff073600640 1 --2- 172.21.15.17:0/2371397232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 0x7ff06c0b19e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0702b0 tx=0x7ff06401cd50 comp rx=0 tx=0).stop 2024-09-10T23:19:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.757+0000 7ff073600640 1 -- 172.21.15.17:0/2371397232 shutdown_connections 2024-09-10T23:19:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.757+0000 7ff073600640 1 --2- 172.21.15.17:0/2371397232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 0x7ff06c0b19e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.757+0000 7ff073600640 1 --2- 172.21.15.17:0/2371397232 >> v2:172.21.15.77:3300/0 conn(0x7ff06c0b31b0 0x7ff06c0d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.757+0000 7ff073600640 1 --2- 172.21.15.17:0/2371397232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff06c15f400 0x7ff06c0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.757+0000 7ff073600640 1 -- 172.21.15.17:0/2371397232 >> 172.21.15.17:0/2371397232 conn(0x7ff06c0d1da0 msgr2=0x7ff06c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.757+0000 7ff073600640 1 -- 172.21.15.17:0/2371397232 shutdown_connections 2024-09-10T23:19:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.757+0000 7ff073600640 1 -- 172.21.15.17:0/2371397232 wait complete. 2024-09-10T23:19:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 Processor -- start 2024-09-10T23:19:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 -- start start 2024-09-10T23:19:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 0x7ff06c156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff06c0b31b0 0x7ff06c0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff06c15f400 0x7ff06c0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c0cccc0 con 0x7ff06c0b1530 2024-09-10T23:19:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c0ccb40 con 0x7ff06c0b31b0 2024-09-10T23:19:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff06c0cce40 con 0x7ff06c15f400 2024-09-10T23:19:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff070c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 0x7ff06c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff070c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 0x7ff06c156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48978/0 (socket says 172.21.15.17:48978) 2024-09-10T23:19:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff070c00640 1 -- 172.21.15.17:0/437421218 learned_addr learned my addr 172.21.15.17:0/437421218 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff06be00640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff06c0b31b0 0x7ff06c0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff071600640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff06c15f400 0x7ff06c0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff070c00640 1 -- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff06c15f400 msgr2=0x7ff06c0c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff070c00640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff06c15f400 0x7ff06c0c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff070c00640 1 -- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff06c0b31b0 msgr2=0x7ff06c0c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff070c00640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff06c0b31b0 0x7ff06c0c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff070c00640 1 -- 172.21.15.17:0/437421218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c13ed20 con 0x7ff06c0b1530 2024-09-10T23:19:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff070c00640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 0x7ff06c156570 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff06000d720 tx=0x7ff06000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff068c00640 1 -- 172.21.15.17:0/437421218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060017070 con 0x7ff06c0b1530 2024-09-10T23:19:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff068c00640 1 -- 172.21.15.17:0/437421218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff060009d20 con 0x7ff06c0b1530 2024-09-10T23:19:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff068c00640 1 -- 172.21.15.17:0/437421218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060005280 con 0x7ff06c0b1530 2024-09-10T23:19:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 -- 172.21.15.17:0/437421218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06c06eaa0 con 0x7ff06c0b1530 2024-09-10T23:19:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.761+0000 7ff073600640 1 -- 172.21.15.17:0/437421218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c06f500 con 0x7ff06c0b1530 2024-09-10T23:19:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.765+0000 7ff068c00640 1 -- 172.21.15.17:0/437421218 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff060005420 con 0x7ff06c0b1530 2024-09-10T23:19:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.765+0000 7ff068c00640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff04c0725e0 0x7ff04c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.765+0000 7ff068c00640 1 -- 172.21.15.17:0/437421218 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7ff060093500 con 0x7ff06c0b1530 2024-09-10T23:19:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.765+0000 7ff07692d000 1 Processor -- start 2024-09-10T23:19:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.765+0000 7ff06be00640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff04c0725e0 0x7ff04c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.765+0000 7ff07692d000 1 -- start start 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff06be00640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff04c0725e0 0x7ff04c074aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff06c1fafe0 tx=0x7ff05800a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644808faf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fb4d0 0x5644808b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808b1af0 0x5644808b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56448070cd90 con 0x5644808fabb0 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5644806fc1c0 con 0x5644808fb4d0 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5644806fffd0 con 0x5644808b1af0 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff070c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644808faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff070c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644808faf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48980/0 (socket says 172.21.15.17:48980) 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff070c00640 1 -- 172.21.15.17:0/3086205644 learned_addr learned my addr 172.21.15.17:0/3086205644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff06be00640 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fb4d0 0x5644808b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff071600640 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808b1af0 0x5644808b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff070c00640 1 -- 172.21.15.17:0/3086205644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808b1af0 msgr2=0x5644808b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff070c00640 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808b1af0 0x5644808b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff070c00640 1 -- 172.21.15.17:0/3086205644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fb4d0 msgr2=0x5644808b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff070c00640 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fb4d0 0x5644808b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff070c00640 1 -- 172.21.15.17:0/3086205644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644806af4c0 con 0x5644808fabb0 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff06be00640 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fb4d0 0x5644808b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff070c00640 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644808faf90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff06005e2c0 tx=0x7ff06005db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d1778c56bacea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff05d600640 1 -- 172.21.15.17:0/3086205644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060020070 con 0x5644808fabb0 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff05d600640 1 -- 172.21.15.17:0/3086205644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff06005e330 con 0x5644808fabb0 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff05d600640 1 -- 172.21.15.17:0/3086205644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060062d60 con 0x5644808fabb0 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 -- 172.21.15.17:0/3086205644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 msgr2=0x5644808faf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644808faf90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff06005e2c0 tx=0x7ff06005db60 comp rx=0 tx=0).stop 2024-09-10T23:19:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 -- 172.21.15.17:0/3086205644 shutdown_connections 2024-09-10T23:19:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808b1af0 0x5644808b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fb4d0 0x5644808b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 --2- 172.21.15.17:0/3086205644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644808faf90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 -- 172.21.15.17:0/3086205644 >> 172.21.15.17:0/3086205644 conn(0x5644808adaa0 msgr2=0x5644808afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 -- 172.21.15.17:0/3086205644 shutdown_connections 2024-09-10T23:19:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 -- 172.21.15.17:0/3086205644 wait complete. 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 -- start start 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.769+0000 7ff07692d000 1 Processor -- start 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x5644808e5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 0x5644808b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808fb4d0 0x5644808b7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5644806a0290 con 0x5644808b1af0 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5644806c5ca0 con 0x5644808fabb0 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56448070bb60 con 0x5644808fb4d0 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 10 client.0 _ll_register_callbacks cb 0x56448089c4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff070c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x5644808e5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff070c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x5644808e5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48990/0 (socket says 172.21.15.17:48990) 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff070c00640 1 -- 172.21.15.17:0/1563226478 learned_addr learned my addr 172.21.15.17:0/1563226478 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff06be00640 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 0x5644808b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff071600640 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808fb4d0 0x5644808b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff070c00640 1 -- 172.21.15.17:0/1563226478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808fb4d0 msgr2=0x5644808b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff070c00640 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808fb4d0 0x5644808b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff070c00640 1 -- 172.21.15.17:0/1563226478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 msgr2=0x5644808b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff070c00640 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 0x5644808b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff070c00640 1 -- 172.21.15.17:0/1563226478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56448067cae0 con 0x5644808b1af0 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff070c00640 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x5644808e5680 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff06005e2c0 tx=0x7ff06005a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b5f41f5087c41f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 1 -- 172.21.15.17:0/1563226478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06004b030 con 0x5644808b1af0 2024-09-10T23:19:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 1 -- 172.21.15.17:0/1563226478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7ff06005e590 con 0x5644808b1af0 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- 172.21.15.17:0/1563226478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564480694530 con 0x5644808b1af0 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 1 -- 172.21.15.17:0/1563226478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff060020040 con 0x5644808b1af0 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 10 client.6078 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- 172.21.15.17:0/1563226478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5644806b8100 con 0x5644808b1af0 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 1 -- 172.21.15.17:0/1563226478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564480694530 con 0x5644808b1af0 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 1 -- 172.21.15.17:0/1563226478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7ff0600672f0 con 0x5644808b1af0 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 10 client.6078 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 10 client.6078 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 20 client.6078 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5644808e66b0 0x56448090ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 4 client.6078 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:31.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- 172.21.15.17:0/1563226478 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56448070ece0 con 0x5644808e66b0 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff06be00640 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5644808e66b0 0x56448090ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff06be00640 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5644808e66b0 0x56448090ce70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1940c7d7732460f server_cookie=bf30c8393a921e6d in_seq=0 out_seq=0 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 10 client.6078 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 1 -- 172.21.15.17:0/1563226478 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56448070ece0 con 0x5644808e66b0 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 10 client.6078 handle_command_reply: tid=0 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 client.6078 shutdown 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- 172.21.15.17:0/1563226478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 msgr2=0x5644808e5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x5644808e5680 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff06005e2c0 tx=0x7ff06005a7d0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- 172.21.15.17:0/1563226478 shutdown_connections 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5644808e66b0 0x56448090ce70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808fb4d0 0x5644808b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 0x5644808b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff052000640 0 client.6078 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 --2- 172.21.15.17:0/1563226478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x5644808e5680 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- 172.21.15.17:0/1563226478 >> 172.21.15.17:0/1563226478 conn(0x5644808adaa0 msgr2=0x5644808b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.773+0000 7ff07692d000 1 -- 172.21.15.17:0/1563226478 shutdown_connections 2024-09-10T23:19:31.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.777+0000 7ff07692d000 1 -- 172.21.15.17:0/1563226478 wait complete. 2024-09-10T23:19:31.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.777+0000 7ff07692d000 20 client.6078 trim_cache size 0 max 16384 2024-09-10T23:19:31.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.789+0000 7ff07692d000 1 Processor -- start 2024-09-10T23:19:31.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.789+0000 7ff07692d000 1 -- start start 2024-09-10T23:19:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x56448096ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x56448096e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 0x56448096e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c203700 con 0x5644808b1af0 2024-09-10T23:19:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c141530 con 0x5644808fabb0 2024-09-10T23:19:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff06c141b80 con 0x5644808adaa0 2024-09-10T23:19:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff06be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x56448096e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff06be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x56448096e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49006/0 (socket says 172.21.15.17:49006) 2024-09-10T23:19:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff06be00640 1 -- 172.21.15.17:0/4283204477 learned_addr learned my addr 172.21.15.17:0/4283204477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff071600640 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 0x56448096e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff070c00640 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x56448096ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff06be00640 1 -- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 msgr2=0x56448096ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff06be00640 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x56448096ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff06be00640 1 -- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 msgr2=0x56448096e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff06be00640 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 0x56448096e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff06be00640 1 -- 172.21.15.17:0/4283204477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56448069a3f0 con 0x5644808b1af0 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff071600640 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 0x56448096e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff070c00640 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x56448096ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff06be00640 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x56448096e300 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff05800fe80 tx=0x7ff058012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b6a89d1d177c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff05cc00640 1 -- 172.21.15.17:0/4283204477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058016070 con 0x5644808b1af0 2024-09-10T23:19:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff05cc00640 1 -- 172.21.15.17:0/4283204477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0580109b0 con 0x5644808b1af0 2024-09-10T23:19:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff05cc00640 1 -- 172.21.15.17:0/4283204477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058010e00 con 0x5644808b1af0 2024-09-10T23:19:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 -- 172.21.15.17:0/4283204477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 msgr2=0x56448096e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x56448096e300 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff05800fe80 tx=0x7ff058012000 comp rx=0 tx=0).stop 2024-09-10T23:19:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 -- 172.21.15.17:0/4283204477 shutdown_connections 2024-09-10T23:19:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808fabb0 0x56448096e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808b1af0 0x56448096e300 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 --2- 172.21.15.17:0/4283204477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x56448096ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 -- 172.21.15.17:0/4283204477 >> 172.21.15.17:0/4283204477 conn(0x564480908430 msgr2=0x5644808b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 -- 172.21.15.17:0/4283204477 shutdown_connections 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 -- 172.21.15.17:0/4283204477 wait complete. 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 -- start start 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.793+0000 7ff07692d000 1 Processor -- start 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x564480971d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808b1af0 0x564480972280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644809727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5644806c8270 con 0x5644808fabb0 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5644806bb980 con 0x5644808b1af0 2024-09-10T23:19:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5644806ff2e0 con 0x5644808adaa0 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 10 client.0 _ll_register_callbacks cb 0x7ff06005a250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff071600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644809727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff071600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644809727c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49016/0 (socket says 172.21.15.17:49016) 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff071600640 1 -- 172.21.15.17:0/3444516151 learned_addr learned my addr 172.21.15.17:0/3444516151 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff070c00640 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x564480971d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff071600640 1 -- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 msgr2=0x564480971d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff06be00640 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808b1af0 0x564480972280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff071600640 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x564480971d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff071600640 1 -- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808b1af0 msgr2=0x564480972280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff071600640 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808b1af0 0x564480972280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff071600640 1 -- 172.21.15.17:0/3444516151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564480759070 con 0x5644808fabb0 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff070c00640 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x564480971d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff06be00640 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808b1af0 0x564480972280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff071600640 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644809727c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff064009bd0 tx=0x7ff0640093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5ae116df759b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff052000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff052000640 1 -- 172.21.15.17:0/3444516151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0640b2040 con 0x5644808fabb0 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff052000640 1 -- 172.21.15.17:0/3444516151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7ff064003b80 con 0x5644808fabb0 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 -- 172.21.15.17:0/3444516151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0580109b0 con 0x5644808fabb0 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff052000640 1 -- 172.21.15.17:0/3444516151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff0640c4050 con 0x5644808fabb0 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 10 client.6084 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 -- 172.21.15.17:0/3444516151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5644806927b0 con 0x5644808fabb0 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff052000640 1 -- 172.21.15.17:0/3444516151 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0580109b0 con 0x5644808fabb0 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff052000640 1 -- 172.21.15.17:0/3444516151 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7ff0640c7020 con 0x5644808fabb0 2024-09-10T23:19:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 10 client.6084 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 10 client.6084 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 20 client.6084 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5644808fb4d0 0x56448092dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 4 client.6084 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-09-10T23:19:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff07692d000 1 -- 172.21.15.17:0/3444516151 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x56448070a790 con 0x5644808fb4d0 2024-09-10T23:19:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff070c00640 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5644808fb4d0 0x56448092dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff070c00640 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5644808fb4d0 0x56448092dda0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=719d21fabfd10057 server_cookie=9b507e3795dd8f0c in_seq=0 out_seq=0 2024-09-10T23:19:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.797+0000 7ff052000640 10 client.6084 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff052000640 1 -- 172.21.15.17:0/3444516151 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56448070a790 con 0x5644808fb4d0 2024-09-10T23:19:31.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff052000640 10 client.6084 handle_command_reply: tid=0 2024-09-10T23:19:31.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 client.6084 shutdown 2024-09-10T23:19:31.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 -- 172.21.15.17:0/3444516151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 msgr2=0x5644809727c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644809727c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff064009bd0 tx=0x7ff0640093a0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 -- 172.21.15.17:0/3444516151 shutdown_connections 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5644808fb4d0 0x56448092dda0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5644808fabb0 0x5644809727c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5644808b1af0 0x564480972280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 --2- 172.21.15.17:0/3444516151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5644808adaa0 0x564480971d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff052000640 0 client.6084 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 -- 172.21.15.17:0/3444516151 >> 172.21.15.17:0/3444516151 conn(0x564480908430 msgr2=0x56448090ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 -- 172.21.15.17:0/3444516151 shutdown_connections 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 1 -- 172.21.15.17:0/3444516151 wait complete. 2024-09-10T23:19:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff07692d000 20 client.6084 trim_cache size 0 max 16384 2024-09-10T23:19:31.810 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:31.810 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:31.810 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:19:31.810 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 -- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff04c0725e0 msgr2=0x7ff04c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff04c0725e0 0x7ff04c074aa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff06c1fafe0 tx=0x7ff05800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 -- 172.21.15.17:0/437421218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 msgr2=0x7ff06c156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 0x7ff06c156570 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff06000d720 tx=0x7ff06000dbe0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 -- 172.21.15.17:0/437421218 shutdown_connections 2024-09-10T23:19:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff04c0725e0 0x7ff04c074aa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff06c15f400 0x7ff06c0c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff06c0b31b0 0x7ff06c0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 --2- 172.21.15.17:0/437421218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff06c0b1530 0x7ff06c156570 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 -- 172.21.15.17:0/437421218 >> 172.21.15.17:0/437421218 conn(0x7ff06c0d1da0 msgr2=0x7ff06c15e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 -- 172.21.15.17:0/437421218 shutdown_connections 2024-09-10T23:19:31.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:31.801+0000 7ff073600640 1 -- 172.21.15.17:0/437421218 wait complete. 2024-09-10T23:19:31.827 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-09-10T23:19:31.827 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:19:31.828 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:31.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:31.837 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-10T23:19:31.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:19:31.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:19:31.906 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160625 s, 65.3 MB/s 2024-09-10T23:19:31.907 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-10T23:19:31.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-10T23:19:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.097+0000 7fccdae00640 1 -- 172.21.15.17:0/2702596596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccb8005710 msgr2=0x7fccb800a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.097+0000 7fccdae00640 1 --2- 172.21.15.17:0/2702596596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccb8005710 0x7fccb800a030 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fccc0001890 tx=0x7fccc001c910 comp rx=0 tx=0).stop 2024-09-10T23:19:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.097+0000 7fccd8e00640 1 -- 172.21.15.17:0/2702596596 reap_dead start 2024-09-10T23:19:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.097+0000 7fccdae00640 1 -- 172.21.15.17:0/2702596596 shutdown_connections 2024-09-10T23:19:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.097+0000 7fccdae00640 1 -- 172.21.15.17:0/2702596596 >> 172.21.15.17:0/2702596596 conn(0x7fccd40b17a0 msgr2=0x7fccd40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.097+0000 7fccdae00640 1 -- 172.21.15.17:0/2702596596 shutdown_connections 2024-09-10T23:19:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.097+0000 7fccdae00640 1 -- 172.21.15.17:0/2702596596 wait complete. 2024-09-10T23:19:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.097+0000 7fccdae00640 1 Processor -- start 2024-09-10T23:19:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.097+0000 7fccdae00640 1 -- start start 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccdae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccb8005710 0x7fccd41f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccdae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd41edfd0 0x7fccd41ec830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccdae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd4138c00 0x7fccd40ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccdae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccd4165eb0 con 0x7fccd41edfd0 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccdae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccd4165d30 con 0x7fccb8005710 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccdae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fccd4166030 con 0x7fccd4138c00 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd41edfd0 0x7fccd41ec830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd41edfd0 0x7fccd41ec830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49032/0 (socket says 172.21.15.17:49032) 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3400640 1 -- 172.21.15.17:0/3352397483 learned_addr learned my addr 172.21.15.17:0/3352397483 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3e00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccb8005710 0x7fccd41f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd8e00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd4138c00 0x7fccd40ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3400640 1 -- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd4138c00 msgr2=0x7fccd40ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3400640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd4138c00 0x7fccd40ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3400640 1 -- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccb8005710 msgr2=0x7fccd41f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3400640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccb8005710 0x7fccd41f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3400640 1 -- 172.21.15.17:0/3352397483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd4142020 con 0x7fccd41edfd0 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccd3400640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd41edfd0 0x7fccd41ec830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fccc0006040 tx=0x7fccc0006930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fcccbe00640 1 -- 172.21.15.17:0/3352397483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0006190 con 0x7fccd41edfd0 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fcccbe00640 1 -- 172.21.15.17:0/3352397483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccc00a56f0 con 0x7fccd41edfd0 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccdae00640 1 -- 172.21.15.17:0/3352397483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd41ecf30 con 0x7fccd41edfd0 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fcccbe00640 1 -- 172.21.15.17:0/3352397483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc00a5b40 con 0x7fccd41edfd0 2024-09-10T23:19:32.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fccdae00640 1 -- 172.21.15.17:0/3352397483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd41ed4f0 con 0x7fccd41edfd0 2024-09-10T23:19:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.101+0000 7fcccbe00640 1 -- 172.21.15.17:0/3352397483 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fccc00a5ce0 con 0x7fccd41edfd0 2024-09-10T23:19:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fcccbe00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fccb40725e0 0x7fccb4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 Processor -- start 2024-09-10T23:19:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fcccbe00640 1 -- 172.21.15.17:0/3352397483 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fccc012cb80 con 0x7fccd41edfd0 2024-09-10T23:19:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 -- start start 2024-09-10T23:19:32.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd3e00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fccb40725e0 0x7fccb4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e5895657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 0x55e5895135b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e589513ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e58936ed90 con 0x55e589513af0 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e58935e1c0 con 0x55e589565ce0 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e589361fd0 con 0x55e5895653c0 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd3e00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fccb40725e0 0x7fccb4074aa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fccd41596c0 tx=0x7fccc4001050 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e589513ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e589513ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49044/0 (socket says 172.21.15.17:49044) 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd8e00640 1 -- 172.21.15.17:0/228873373 learned_addr learned my addr 172.21.15.17:0/228873373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd3400640 1 --2- 172.21.15.17:0/228873373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 0x55e5895135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd3e00640 1 --2- 172.21.15.17:0/228873373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e5895657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd8e00640 1 -- 172.21.15.17:0/228873373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 msgr2=0x55e5895657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd8e00640 1 --2- 172.21.15.17:0/228873373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e5895657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd8e00640 1 -- 172.21.15.17:0/228873373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 msgr2=0x55e5895135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd8e00640 1 --2- 172.21.15.17:0/228873373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 0x55e5895135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd8e00640 1 -- 172.21.15.17:0/228873373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5893114c0 con 0x55e589513af0 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccd8e00640 1 --2- 172.21.15.17:0/228873373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e589513ed0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fccd4070720 tx=0x7fcccc012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e18d7514987923 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccc8c00640 1 -- 172.21.15.17:0/228873373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc012030 con 0x55e589513af0 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccc8c00640 1 -- 172.21.15.17:0/228873373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcccc0121d0 con 0x55e589513af0 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccc8c00640 1 -- 172.21.15.17:0/228873373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc003a40 con 0x55e589513af0 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 -- 172.21.15.17:0/228873373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 msgr2=0x55e589513ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 --2- 172.21.15.17:0/228873373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e589513ed0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fccd4070720 tx=0x7fcccc012820 comp rx=0 tx=0).stop 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 -- 172.21.15.17:0/228873373 shutdown_connections 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 --2- 172.21.15.17:0/228873373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e589513ed0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 --2- 172.21.15.17:0/228873373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 0x55e5895135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 --2- 172.21.15.17:0/228873373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e5895657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 -- 172.21.15.17:0/228873373 >> 172.21.15.17:0/228873373 conn(0x55e58950faa0 msgr2=0x55e589511e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 -- 172.21.15.17:0/228873373 shutdown_connections 2024-09-10T23:19:32.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.105+0000 7fccde202000 1 -- 172.21.15.17:0/228873373 wait complete. 2024-09-10T23:19:32.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 -- start start 2024-09-10T23:19:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 Processor -- start 2024-09-10T23:19:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e58954fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e589518b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 0x55e589519060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e589302290 con 0x55e589513af0 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e589327ca0 con 0x55e589565ce0 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e58936db60 con 0x55e5895653c0 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 10 client.0 _ll_register_callbacks cb 0x55e5894fe4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e58954fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e58954fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49052/0 (socket says 172.21.15.17:49052) 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3e00640 1 -- 172.21.15.17:0/363041797 learned_addr learned my addr 172.21.15.17:0/363041797 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3400640 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e589518b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd8e00640 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 0x55e589519060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3e00640 1 -- 172.21.15.17:0/363041797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 msgr2=0x55e589518b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3e00640 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e589518b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3e00640 1 -- 172.21.15.17:0/363041797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 msgr2=0x55e589519060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3e00640 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 0x55e589519060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3e00640 1 -- 172.21.15.17:0/363041797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5892deae0 con 0x55e589513af0 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3e00640 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e58954fe90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fccc4004f10 tx=0x7fccd40b4230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48044020fe0cbd02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccbd600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccbd600640 1 -- 172.21.15.17:0/363041797 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc401e600 con 0x55e589513af0 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccbd600640 1 -- 172.21.15.17:0/363041797 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fccc4024a60 con 0x55e589513af0 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 -- 172.21.15.17:0/363041797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e5892f6530 con 0x55e589513af0 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccbd600640 1 -- 172.21.15.17:0/363041797 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fccc402e050 con 0x55e589513af0 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 10 client.6096 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:32.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 -- 172.21.15.17:0/363041797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55e58931a100 con 0x55e589513af0 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccbd600640 1 -- 172.21.15.17:0/363041797 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e5892f6530 con 0x55e589513af0 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccbd600640 1 -- 172.21.15.17:0/363041797 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fccc4031020 con 0x55e589513af0 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 10 client.6096 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 10 client.6096 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 20 client.6096 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55e589550e90 0x55e589577680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 4 client.6096 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccde202000 1 -- 172.21.15.17:0/363041797 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e589370ce0 con 0x55e589550e90 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.109+0000 7fccd3400640 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55e589550e90 0x55e589577680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccbd600640 10 client.6096 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccd3400640 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55e589550e90 0x55e589577680 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70afdcee91209f7 server_cookie=3deeb7eb0f1f6f67 in_seq=0 out_seq=0 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccbd600640 1 -- 172.21.15.17:0/363041797 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e589370ce0 con 0x55e589550e90 2024-09-10T23:19:32.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccbd600640 10 client.6096 handle_command_reply: tid=0 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 client.6096 shutdown 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 -- 172.21.15.17:0/363041797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 msgr2=0x55e58954fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e58954fe90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fccc4004f10 tx=0x7fccd40b4230 comp rx=0 tx=0).stop 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 -- 172.21.15.17:0/363041797 shutdown_connections 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55e589550e90 0x55e589577680 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589565ce0 0x55e589519060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e589518b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 --2- 172.21.15.17:0/363041797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589513af0 0x55e58954fe90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 -- 172.21.15.17:0/363041797 >> 172.21.15.17:0/363041797 conn(0x55e58950faa0 msgr2=0x55e5895126b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccbd600640 0 client.6096 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 -- 172.21.15.17:0/363041797 shutdown_connections 2024-09-10T23:19:32.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 1 -- 172.21.15.17:0/363041797 wait complete. 2024-09-10T23:19:32.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.113+0000 7fccde202000 20 client.6096 trim_cache size 0 max 16384 2024-09-10T23:19:32.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 Processor -- start 2024-09-10T23:19:32.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 -- start start 2024-09-10T23:19:32.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589513af0 0x55e5895d77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e5895d7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e5895d8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fccd413b5e0 con 0x55e589565ce0 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccd413a940 con 0x55e589513af0 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fccd413af90 con 0x55e5895653c0 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e5895d8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e5895d8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49056/0 (socket says 172.21.15.17:49056) 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd8e00640 1 -- 172.21.15.17:0/2268249803 learned_addr learned my addr 172.21.15.17:0/2268249803 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd3e00640 1 --2- 172.21.15.17:0/2268249803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589513af0 0x55e5895d77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd3400640 1 --2- 172.21.15.17:0/2268249803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e5895d7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd8e00640 1 -- 172.21.15.17:0/2268249803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 msgr2=0x55e5895d7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd8e00640 1 --2- 172.21.15.17:0/2268249803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e5895d7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd8e00640 1 -- 172.21.15.17:0/2268249803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589513af0 msgr2=0x55e5895d77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd8e00640 1 --2- 172.21.15.17:0/2268249803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589513af0 0x55e5895d77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd8e00640 1 -- 172.21.15.17:0/2268249803 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5892fc3f0 con 0x55e589565ce0 2024-09-10T23:19:32.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccd8e00640 1 --2- 172.21.15.17:0/2268249803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e5895d8250 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55e58931b060 tx=0x7fcccc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628d4b51ca642764 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccbfe00640 1 -- 172.21.15.17:0/2268249803 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc026460 con 0x55e589565ce0 2024-09-10T23:19:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccbfe00640 1 -- 172.21.15.17:0/2268249803 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcccc026600 con 0x55e589565ce0 2024-09-10T23:19:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccbfe00640 1 -- 172.21.15.17:0/2268249803 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc026810 con 0x55e589565ce0 2024-09-10T23:19:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 -- 172.21.15.17:0/2268249803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 msgr2=0x55e5895d8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 --2- 172.21.15.17:0/2268249803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e5895d8250 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55e58931b060 tx=0x7fcccc004ac0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 -- 172.21.15.17:0/2268249803 shutdown_connections 2024-09-10T23:19:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 --2- 172.21.15.17:0/2268249803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e5895d8250 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 --2- 172.21.15.17:0/2268249803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e5895653c0 0x55e5895d7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 --2- 172.21.15.17:0/2268249803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e589513af0 0x55e5895d77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 -- 172.21.15.17:0/2268249803 >> 172.21.15.17:0/2268249803 conn(0x55e58950faa0 msgr2=0x55e589511e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 -- 172.21.15.17:0/2268249803 shutdown_connections 2024-09-10T23:19:32.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.129+0000 7fccde202000 1 -- 172.21.15.17:0/2268249803 wait complete. 2024-09-10T23:19:32.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 -- start start 2024-09-10T23:19:32.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 Processor -- start 2024-09-10T23:19:32.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e589513af0 0x55e58957b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5895653c0 0x55e58957b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e589597ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55e58932a270 con 0x55e589565ce0 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55e58931d980 con 0x55e5895653c0 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55e5893612e0 con 0x55e589513af0 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 10 client.0 _ll_register_callbacks cb 0x7fccc4004610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e589597ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e589597ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49068/0 (socket says 172.21.15.17:49068) 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5895653c0 0x55e58957b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd8e00640 1 -- 172.21.15.17:0/4246293916 learned_addr learned my addr 172.21.15.17:0/4246293916 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd3e00640 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e589513af0 0x55e58957b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd8e00640 1 -- 172.21.15.17:0/4246293916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e589513af0 msgr2=0x55e58957b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd8e00640 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e589513af0 0x55e58957b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd8e00640 1 -- 172.21.15.17:0/4246293916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5895653c0 msgr2=0x55e58957b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd8e00640 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5895653c0 0x55e58957b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd8e00640 1 -- 172.21.15.17:0/4246293916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5893bb070 con 0x55e589565ce0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd8e00640 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e589597ba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fcccc010b40 tx=0x7fcccc009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae72350ade2ab64f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccbd600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccbd600640 1 -- 172.21.15.17:0/4246293916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc02d060 con 0x55e589565ce0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccbd600640 1 -- 172.21.15.17:0/4246293916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fcccc018040 con 0x55e589565ce0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 -- 172.21.15.17:0/4246293916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcccc026600 con 0x55e589565ce0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccbd600640 1 -- 172.21.15.17:0/4246293916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcccc033050 con 0x55e589565ce0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 10 client.6102 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 -- 172.21.15.17:0/4246293916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55e5892f47b0 con 0x55e589565ce0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccbd600640 1 -- 172.21.15.17:0/4246293916 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcccc026600 con 0x55e589565ce0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccbd600640 1 -- 172.21.15.17:0/4246293916 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fcccc036020 con 0x55e589565ce0 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 10 client.6102 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:32.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 10 client.6102 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 20 client.6102 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55e589598590 0x55e5895db600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 4 client.6102 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-10T23:19:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccde202000 1 -- 172.21.15.17:0/4246293916 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x55e58936c790 con 0x55e589598590 2024-09-10T23:19:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.133+0000 7fccd3e00640 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55e589598590 0x55e5895db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.137+0000 7fccd3e00640 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55e589598590 0x55e5895db600 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4686b2a8505ceb80 server_cookie=7ff6d577cc97e831 in_seq=0 out_seq=0 2024-09-10T23:19:32.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.137+0000 7fccbd600640 10 client.6102 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccbd600640 1 -- 172.21.15.17:0/4246293916 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e58936c790 con 0x55e589598590 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccbd600640 10 client.6102 handle_command_reply: tid=0 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 client.6102 shutdown 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 -- 172.21.15.17:0/4246293916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 msgr2=0x55e589597ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e589597ba0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fcccc010b40 tx=0x7fcccc009ae0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 -- 172.21.15.17:0/4246293916 shutdown_connections 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55e589598590 0x55e5895db600 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e589565ce0 0x55e589597ba0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e5895653c0 0x55e58957b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 --2- 172.21.15.17:0/4246293916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e589513af0 0x55e58957b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccbd600640 0 client.6102 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 -- 172.21.15.17:0/4246293916 >> 172.21.15.17:0/4246293916 conn(0x55e58950faa0 msgr2=0x55e5895126b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 -- 172.21.15.17:0/4246293916 shutdown_connections 2024-09-10T23:19:32.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 1 -- 172.21.15.17:0/4246293916 wait complete. 2024-09-10T23:19:32.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccde202000 20 client.6102 trim_cache size 0 max 16384 2024-09-10T23:19:32.147 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:32.147 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:32.148 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:19:32.148 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:32.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 -- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fccb40725e0 msgr2=0x7fccb4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fccb40725e0 0x7fccb4074aa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fccd41596c0 tx=0x7fccc4001050 comp rx=0 tx=0).stop 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 -- 172.21.15.17:0/3352397483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd41edfd0 msgr2=0x7fccd41ec830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd41edfd0 0x7fccd41ec830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fccc0006040 tx=0x7fccc0006930 comp rx=0 tx=0).stop 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 -- 172.21.15.17:0/3352397483 shutdown_connections 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fccb40725e0 0x7fccb4074aa0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fccd4138c00 0x7fccd40ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd41edfd0 0x7fccd41ec830 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 --2- 172.21.15.17:0/3352397483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccb8005710 0x7fccd41f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 -- 172.21.15.17:0/3352397483 >> 172.21.15.17:0/3352397483 conn(0x7fccd40b17a0 msgr2=0x7fccd4159810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 -- 172.21.15.17:0/3352397483 shutdown_connections 2024-09-10T23:19:32.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.141+0000 7fccdae00640 1 -- 172.21.15.17:0/3352397483 wait complete. 2024-09-10T23:19:32.165 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-09-10T23:19:32.166 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:19:32.166 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:19:32.166 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-09-10T23:19:32.166 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:19:32.166 DEBUG:teuthology.orchestra.run.smithi017:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-09-10T23:19:32.166 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:19:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630411 2024-09-10T23:19:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:19:32.242 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-10T23:19:32.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 -- 172.21.15.17:0/3359577636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c15be20 msgr2=0x7f9a3c0d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 --2- 172.21.15.17:0/3359577636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c15be20 0x7f9a3c0d1cd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c06db60 tx=0x7f9a3001c570 comp rx=0 tx=0).stop 2024-09-10T23:19:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 -- 172.21.15.17:0/3359577636 shutdown_connections 2024-09-10T23:19:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 --2- 172.21.15.17:0/3359577636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a3c071bb0 0x7f9a3c0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 --2- 172.21.15.17:0/3359577636 >> v2:172.21.15.77:3300/0 conn(0x7f9a3c0d2210 0x7f9a3c071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 --2- 172.21.15.17:0/3359577636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c15be20 0x7f9a3c0d1cd0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 -- 172.21.15.17:0/3359577636 >> 172.21.15.17:0/3359577636 conn(0x7f9a3c09a9f0 msgr2=0x7f9a3c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 -- 172.21.15.17:0/3359577636 shutdown_connections 2024-09-10T23:19:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 -- 172.21.15.17:0/3359577636 wait complete. 2024-09-10T23:19:32.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 Processor -- start 2024-09-10T23:19:32.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.429+0000 7f9a44600640 1 -- start start 2024-09-10T23:19:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a44600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3c071bb0 0x7f9a3c166120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a44600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c0d2210 0x7f9a3c1fa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a44600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a3c15be20 0x7f9a3c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a44600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c0cd420 con 0x7f9a3c0d2210 2024-09-10T23:19:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a44600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c0cd2a0 con 0x7f9a3c071bb0 2024-09-10T23:19:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a44600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3c0cd5a0 con 0x7f9a3c15be20 2024-09-10T23:19:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c0d2210 0x7f9a3c1fa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c0d2210 0x7f9a3c1fa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49094/0 (socket says 172.21.15.17:49094) 2024-09-10T23:19:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41200640 1 -- 172.21.15.17:0/3913127738 learned_addr learned my addr 172.21.15.17:0/3913127738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41c00640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3c071bb0 0x7f9a3c166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a42600640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a3c15be20 0x7f9a3c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41200640 1 -- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a3c15be20 msgr2=0x7f9a3c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41200640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a3c15be20 0x7f9a3c1596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41200640 1 -- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3c071bb0 msgr2=0x7f9a3c166120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41200640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3c071bb0 0x7f9a3c166120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41200640 1 -- 172.21.15.17:0/3913127738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c166660 con 0x7f9a3c0d2210 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a42600640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a3c15be20 0x7f9a3c1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41c00640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3c071bb0 0x7f9a3c166120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a41200640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c0d2210 0x7f9a3c1fa8d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d9b0 tx=0x7f9a2800de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a39600640 1 -- 172.21.15.17:0/3913127738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28017070 con 0x7f9a3c0d2210 2024-09-10T23:19:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a39600640 1 -- 172.21.15.17:0/3913127738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a28004310 con 0x7f9a3c0d2210 2024-09-10T23:19:32.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a39600640 1 -- 172.21.15.17:0/3913127738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28009c30 con 0x7f9a3c0d2210 2024-09-10T23:19:32.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a44600640 1 -- 172.21.15.17:0/3913127738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3c1fb370 con 0x7f9a3c0d2210 2024-09-10T23:19:32.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.433+0000 7f9a44600640 1 -- 172.21.15.17:0/3913127738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a3c165920 con 0x7f9a3c0d2210 2024-09-10T23:19:32.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a39600640 1 -- 172.21.15.17:0/3913127738 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9a28023060 con 0x7f9a3c0d2210 2024-09-10T23:19:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a39600640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a1c072610 0x7f9a1c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a39600640 1 -- 172.21.15.17:0/3913127738 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f9a28092f20 con 0x7f9a3c0d2210 2024-09-10T23:19:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a1c072610 0x7f9a1c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a47ac2000 1 Processor -- start 2024-09-10T23:19:32.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a47ac2000 1 -- start start 2024-09-10T23:19:32.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a1c072610 0x7f9a1c074ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a300ae000 tx=0x7f9a3001ae10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156faa8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa5b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 0x56156fa5bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56156f945d30 con 0x56156faa7f30 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56156f8b9af0 con 0x56156faa8850 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56156f8a8f20 con 0x56156fa5b920 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156faa8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156faa8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49100/0 (socket says 172.21.15.17:49100) 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 -- 172.21.15.17:0/588390971 learned_addr learned my addr 172.21.15.17:0/588390971 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41200640 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa5b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a42600640 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 0x56156fa5bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 -- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 msgr2=0x56156fa5bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 0x56156fa5bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 -- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 msgr2=0x56156fa5b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa5b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 -- 172.21.15.17:0/588390971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56156f82a100 con 0x56156faa7f30 2024-09-10T23:19:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41200640 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa5b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a42600640 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 0x56156fa5bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a41c00640 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156faa8310 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9a3001cae0 tx=0x7f9a300aa050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4a447a4e84f72e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a2e000640 1 -- 172.21.15.17:0/588390971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30005580 con 0x56156faa7f30 2024-09-10T23:19:32.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a2e000640 1 -- 172.21.15.17:0/588390971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a300c3070 con 0x56156faa7f30 2024-09-10T23:19:32.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.437+0000 7f9a2e000640 1 -- 172.21.15.17:0/588390971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a300c8670 con 0x56156faa7f30 2024-09-10T23:19:32.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- 172.21.15.17:0/588390971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 msgr2=0x56156faa8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156faa8310 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9a3001cae0 tx=0x7f9a300aa050 comp rx=0 tx=0).stop 2024-09-10T23:19:32.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- 172.21.15.17:0/588390971 shutdown_connections 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 0x56156fa5bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa5b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/588390971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156faa8310 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- 172.21.15.17:0/588390971 >> 172.21.15.17:0/588390971 conn(0x56156fa88ff0 msgr2=0x56156fa8b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- 172.21.15.17:0/588390971 shutdown_connections 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- 172.21.15.17:0/588390971 wait complete. 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- start start 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 Processor -- start 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 0x56156fa8a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fa8a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa8aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56156f84e4e0 con 0x56156faa7f30 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56156f8acd30 con 0x56156faa8850 2024-09-10T23:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56156f56e680 con 0x56156fa5b920 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 10 client.0 _ll_register_callbacks cb 0x56156fa490e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fa8a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fa8a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49112/0 (socket says 172.21.15.17:49112) 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41200640 1 -- 172.21.15.17:0/2302959966 learned_addr learned my addr 172.21.15.17:0/2302959966 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a42600640 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa8aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41c00640 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 0x56156fa8a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41200640 1 -- 172.21.15.17:0/2302959966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 msgr2=0x56156fa8a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41200640 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 0x56156fa8a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41200640 1 -- 172.21.15.17:0/2302959966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 msgr2=0x56156fa8aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41200640 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa8aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41200640 1 -- 172.21.15.17:0/2302959966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56156f85dc40 con 0x56156faa7f30 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a42600640 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa8aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a41200640 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fa8a960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9a280911f0 tx=0x7f9a2805d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa2296ace122750 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a22a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a22a00640 1 -- 172.21.15.17:0/2302959966 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28020040 con 0x56156faa7f30 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a22a00640 1 -- 172.21.15.17:0/2302959966 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f9a2805cf00 con 0x56156faa7f30 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- 172.21.15.17:0/2302959966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56156f841310 con 0x56156faa7f30 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a22a00640 1 -- 172.21.15.17:0/2302959966 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9a28062780 con 0x56156faa7f30 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 10 client.6114 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.441+0000 7f9a47ac2000 1 -- 172.21.15.17:0/2302959966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x56156f8a7bc0 con 0x56156faa7f30 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a22a00640 1 -- 172.21.15.17:0/2302959966 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56156f841310 con 0x56156faa7f30 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a22a00640 1 -- 172.21.15.17:0/2302959966 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f9a280595f0 con 0x56156faa7f30 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 10 client.6114 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 10 client.6114 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 20 client.6114 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:32.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x56156fa8b8b0 0x56156faba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 4 client.6114 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:32.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 -- 172.21.15.17:0/2302959966 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56156f8bba40 con 0x56156fa8b8b0 2024-09-10T23:19:32.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a41c00640 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x56156fa8b8b0 0x56156faba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a41c00640 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x56156fa8b8b0 0x56156faba1f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49539ceafb7a78b server_cookie=7aeb82a18bee2d83 in_seq=0 out_seq=0 2024-09-10T23:19:32.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a22a00640 10 client.6114 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a22a00640 1 -- 172.21.15.17:0/2302959966 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56156f8bba40 con 0x56156fa8b8b0 2024-09-10T23:19:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a22a00640 10 client.6114 handle_command_reply: tid=0 2024-09-10T23:19:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 client.6114 shutdown 2024-09-10T23:19:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 -- 172.21.15.17:0/2302959966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 msgr2=0x56156fa8a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fa8a960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9a280911f0 tx=0x7f9a2805d870 comp rx=0 tx=0).stop 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 -- 172.21.15.17:0/2302959966 shutdown_connections 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x56156fa8b8b0 0x56156faba1f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156faa8850 0x56156fa8aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fa8a960 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a22a00640 0 client.6114 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/2302959966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156fa5b920 0x56156fa8a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 -- 172.21.15.17:0/2302959966 >> 172.21.15.17:0/2302959966 conn(0x56156fa88ff0 msgr2=0x56156fa5aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 -- 172.21.15.17:0/2302959966 shutdown_connections 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 1 -- 172.21.15.17:0/2302959966 wait complete. 2024-09-10T23:19:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.445+0000 7f9a47ac2000 20 client.6114 trim_cache size 0 max 16384 2024-09-10T23:19:32.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 Processor -- start 2024-09-10T23:19:32.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- start start 2024-09-10T23:19:32.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 0x56156fabda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa7f30 0x56156faa6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa8850 0x56156faa72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c204680 con 0x56156faa8850 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c2036a0 con 0x56156fa5b920 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3c06eae0 con 0x56156faa7f30 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a42600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa8850 0x56156faa72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a42600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa8850 0x56156faa72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49124/0 (socket says 172.21.15.17:49124) 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a42600640 1 -- 172.21.15.17:0/3388859836 learned_addr learned my addr 172.21.15.17:0/3388859836 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a41c00640 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 0x56156fabda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a41200640 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa7f30 0x56156faa6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a42600640 1 -- 172.21.15.17:0/3388859836 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa7f30 msgr2=0x56156faa6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a42600640 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa7f30 0x56156faa6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a42600640 1 -- 172.21.15.17:0/3388859836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 msgr2=0x56156fabda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a42600640 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 0x56156fabda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a42600640 1 -- 172.21.15.17:0/3388859836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56156fa640b0 con 0x56156faa8850 2024-09-10T23:19:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a41c00640 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 0x56156fabda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a42600640 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa8850 0x56156faa72e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9a340099f0 tx=0x7f9a34009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841220fb7421119 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a2d600640 1 -- 172.21.15.17:0/3388859836 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34012450 con 0x56156faa8850 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a2d600640 1 -- 172.21.15.17:0/3388859836 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a340126e0 con 0x56156faa8850 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a2d600640 1 -- 172.21.15.17:0/3388859836 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34012af0 con 0x56156faa8850 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- 172.21.15.17:0/3388859836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa8850 msgr2=0x56156faa72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa8850 0x56156faa72e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9a340099f0 tx=0x7f9a34009eb0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- 172.21.15.17:0/3388859836 shutdown_connections 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa8850 0x56156faa72e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa7f30 0x56156faa6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/3388859836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 0x56156fabda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- 172.21.15.17:0/3388859836 >> 172.21.15.17:0/3388859836 conn(0x56156fa88ff0 msgr2=0x56156fab4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- 172.21.15.17:0/3388859836 shutdown_connections 2024-09-10T23:19:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- 172.21.15.17:0/3388859836 wait complete. 2024-09-10T23:19:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 -- start start 2024-09-10T23:19:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.461+0000 7f9a47ac2000 1 Processor -- start 2024-09-10T23:19:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 0x56156fb1df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fb1e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa8850 0x56156fb1e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56156f874890 con 0x56156faa7f30 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56156f8b88c0 con 0x56156fa5b920 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56156f86b690 con 0x56156faa8850 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 10 client.0 _ll_register_callbacks cb 0x7f9a2800b620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fb1e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fb1e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49138/0 (socket says 172.21.15.17:49138) 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41200640 1 -- 172.21.15.17:0/439107020 learned_addr learned my addr 172.21.15.17:0/439107020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41c00640 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 0x56156fb1df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a42600640 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa8850 0x56156fb1e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41200640 1 -- 172.21.15.17:0/439107020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa8850 msgr2=0x56156fb1e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41200640 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa8850 0x56156fb1e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41200640 1 -- 172.21.15.17:0/439107020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 msgr2=0x56156fb1df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41200640 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 0x56156fb1df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41200640 1 -- 172.21.15.17:0/439107020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56156f8471d0 con 0x56156faa7f30 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a42600640 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa8850 0x56156fb1e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41200640 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fb1e490 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9a28000c10 tx=0x7f9a2805d1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7749d6f54459862 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 1 -- 172.21.15.17:0/439107020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28020030 con 0x56156faa7f30 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 1 -- 172.21.15.17:0/439107020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f9a280623f0 con 0x56156faa7f30 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- 172.21.15.17:0/439107020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a340126e0 con 0x56156faa7f30 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 1 -- 172.21.15.17:0/439107020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9a2805d5f0 con 0x56156faa7f30 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 10 client.6120 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- 172.21.15.17:0/439107020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x56156f86f970 con 0x56156faa7f30 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 1 -- 172.21.15.17:0/439107020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a340126e0 con 0x56156faa7f30 2024-09-10T23:19:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 1 -- 172.21.15.17:0/439107020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f9a2805c970 con 0x56156faa7f30 2024-09-10T23:19:32.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 10 client.6120 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:32.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 10 client.6120 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:32.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 20 client.6120 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:32.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x56156fabb000 0x56156fabb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 4 client.6120 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:19:32.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- 172.21.15.17:0/439107020 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56156f8b74f0 con 0x56156fabb000 2024-09-10T23:19:32.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41c00640 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x56156fabb000 0x56156fabb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 10 client.6120 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a41c00640 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x56156fabb000 0x56156fabb410 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67aa532e1fce47e0 server_cookie=6d84f1ae301b9ee1 in_seq=0 out_seq=0 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 1 -- 172.21.15.17:0/439107020 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56156f8b74f0 con 0x56156fabb000 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 10 client.6120 handle_command_reply: tid=0 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 client.6120 shutdown 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- 172.21.15.17:0/439107020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 msgr2=0x56156fb1e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fb1e490 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9a28000c10 tx=0x7f9a2805d1b0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- 172.21.15.17:0/439107020 shutdown_connections 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x56156fabb000 0x56156fabb410 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56156faa8850 0x56156fb1e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56156faa7f30 0x56156fb1e490 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 --2- 172.21.15.17:0/439107020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56156fa5b920 0x56156fb1df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a22a00640 0 client.6120 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- 172.21.15.17:0/439107020 >> 172.21.15.17:0/439107020 conn(0x56156fa88ff0 msgr2=0x56156fa893d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.465+0000 7f9a47ac2000 1 -- 172.21.15.17:0/439107020 shutdown_connections 2024-09-10T23:19:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a47ac2000 1 -- 172.21.15.17:0/439107020 wait complete. 2024-09-10T23:19:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a47ac2000 20 client.6120 trim_cache size 0 max 16384 2024-09-10T23:19:32.478 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T23:19:32.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 -- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a1c072610 msgr2=0x7f9a1c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a1c072610 0x7f9a1c074ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a300ae000 tx=0x7f9a3001ae10 comp rx=0 tx=0).stop 2024-09-10T23:19:32.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 -- 172.21.15.17:0/3913127738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c0d2210 msgr2=0x7f9a3c1fa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c0d2210 0x7f9a3c1fa8d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800d9b0 tx=0x7f9a2800de70 comp rx=0 tx=0).stop 2024-09-10T23:19:32.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 -- 172.21.15.17:0/3913127738 shutdown_connections 2024-09-10T23:19:32.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a1c072610 0x7f9a1c074ad0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a3c15be20 0x7f9a3c1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a3c0d2210 0x7f9a3c1fa8d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 --2- 172.21.15.17:0/3913127738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a3c071bb0 0x7f9a3c166120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 -- 172.21.15.17:0/3913127738 >> 172.21.15.17:0/3913127738 conn(0x7f9a3c09a9f0 msgr2=0x7f9a3c155d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 -- 172.21.15.17:0/3913127738 shutdown_connections 2024-09-10T23:19:32.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.469+0000 7f9a44600640 1 -- 172.21.15.17:0/3913127738 wait complete. 2024-09-10T23:19:32.491 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4b.00000000 parent 2024-09-10T23:19:32.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17e13e4080 1 Processor -- start 2024-09-10T23:19:32.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17e13e4080 1 -- start start 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17e13e4080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55faeed90780 0x55faeee69020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17e13e4080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeee4d010 0x55faeee6ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17e13e4080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55faeee4d3f0 0x55faeee6cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17e13e4080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55faeed8ea60 con 0x55faeee4d010 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17e13e4080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55faeecdea00 con 0x55faeee4d3f0 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17e13e4080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55faeed8ebe0 con 0x55faeed90780 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17ddc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeee4d010 0x55faeee6ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17ddc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeee4d010 0x55faeee6ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49166/0 (socket says 172.21.15.17:49166) 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17ddc00640 1 -- 172.21.15.17:0/3988730240 learned_addr learned my addr 172.21.15.17:0/3988730240 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17df000640 1 --2- 172.21.15.17:0/3988730240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55faeee4d3f0 0x55faeee6cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17de600640 1 --2- 172.21.15.17:0/3988730240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55faeed90780 0x55faeee69020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17ddc00640 1 -- 172.21.15.17:0/3988730240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55faeed90780 msgr2=0x55faeee69020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17ddc00640 1 --2- 172.21.15.17:0/3988730240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55faeed90780 0x55faeee69020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17ddc00640 1 -- 172.21.15.17:0/3988730240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55faeee4d3f0 msgr2=0x55faeee6cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17ddc00640 1 --2- 172.21.15.17:0/3988730240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55faeee4d3f0 0x55faeee6cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.533+0000 7f17ddc00640 1 -- 172.21.15.17:0/3988730240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faeecdda20 con 0x55faeee4d010 2024-09-10T23:19:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17ddc00640 1 --2- 172.21.15.17:0/3988730240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeee4d010 0x55faeee6ae10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f17cc01ba20 tx=0x7f17cc017f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb8e5560acf04a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17d7e00640 1 -- 172.21.15.17:0/3988730240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0b0040 con 0x55faeee4d010 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17d7e00640 1 -- 172.21.15.17:0/3988730240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17cc0ba070 con 0x55faeee4d010 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17d7e00640 1 -- 172.21.15.17:0/3988730240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0b5410 con 0x55faeee4d010 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 -- 172.21.15.17:0/3988730240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeee4d010 msgr2=0x55faeee6ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 --2- 172.21.15.17:0/3988730240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeee4d010 0x55faeee6ae10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f17cc01ba20 tx=0x7f17cc017f20 comp rx=0 tx=0).stop 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 -- 172.21.15.17:0/3988730240 shutdown_connections 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 --2- 172.21.15.17:0/3988730240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55faeee4d3f0 0x55faeee6cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 --2- 172.21.15.17:0/3988730240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeee4d010 0x55faeee6ae10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 --2- 172.21.15.17:0/3988730240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55faeed90780 0x55faeee69020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 -- 172.21.15.17:0/3988730240 >> 172.21.15.17:0/3988730240 conn(0x55faeedbf3e0 msgr2=0x55faeee665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 -- 172.21.15.17:0/3988730240 shutdown_connections 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 -- 172.21.15.17:0/3988730240 wait complete. 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 Processor -- start 2024-09-10T23:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 -- start start 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeed90780 0x55faeee4b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55faeee4d010 0x55faeedd32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55faeee4d3f0 0x55faeee6ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55faeee6a6d0 con 0x55faeed90780 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55faeedc20d0 con 0x55faeee4d010 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17e13e4080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55faeee6a970 con 0x55faeee4d3f0 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17de600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeed90780 0x55faeee4b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17de600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeed90780 0x55faeee4b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49172/0 (socket says 172.21.15.17:49172) 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17de600640 1 -- 172.21.15.17:0/165374171 learned_addr learned my addr 172.21.15.17:0/165374171 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17df000640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55faeee4d3f0 0x55faeee6ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17ddc00640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55faeee4d010 0x55faeedd32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17de600640 1 -- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55faeee4d3f0 msgr2=0x55faeee6ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17de600640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55faeee4d3f0 0x55faeee6ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17de600640 1 -- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55faeee4d010 msgr2=0x55faeedd32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17de600640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55faeee4d010 0x55faeedd32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17de600640 1 -- 172.21.15.17:0/165374171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faeecb7c10 con 0x55faeed90780 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.537+0000 7f17de600640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeed90780 0x55faeee4b990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f17d000a860 tx=0x7f17d000ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17d6a00640 1 -- 172.21.15.17:0/165374171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0009d60 con 0x55faeed90780 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17d6a00640 1 -- 172.21.15.17:0/165374171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17d0008440 con 0x55faeed90780 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55faeee6ef40 con 0x55faeed90780 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17d6a00640 1 -- 172.21.15.17:0/165374171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0008830 con 0x55faeed90780 2024-09-10T23:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faeee6f480 con 0x55faeed90780 2024-09-10T23:19:32.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17d6a00640 1 -- 172.21.15.17:0/165374171 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f17d00089d0 con 0x55faeed90780 2024-09-10T23:19:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17d6a00640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c0070ff0 0x7f17c00734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17d6a00640 1 -- 172.21.15.17:0/165374171 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f17d0092db0 con 0x55faeed90780 2024-09-10T23:19:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17ddc00640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c0070ff0 0x7f17c00734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17e13e4080 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x55faeee6fe60 0x55faeee70240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.541+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 --> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] -- osd_op(unknown.0.0:1 8.24 8:256cebcc:::10000000a4b.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59) -- 0x55faeee70780 con 0x55faeee6fe60 2024-09-10T23:19:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17df000640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x55faeee6fe60 0x55faeee70240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17ddc00640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c0070ff0 0x7f17c00734b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f17cc004f60 tx=0x7f17cc004950 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17df000640 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x55faeee6fe60 0x55faeee70240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17df000640 1 -- 172.21.15.17:0/165374171 <== osd.6 v2:172.21.15.77:6818/1112476977 1 ==== osd_op_reply(1 10000000a4b.00000000 [rmxattr] v59'21 uv21 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f17d8002040 con 0x55faeee6fe60 2024-09-10T23:19:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x55faeee6fe60 msgr2=0x55faeee70240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x55faeee6fe60 0x55faeee70240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c0070ff0 msgr2=0x7f17c00734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c0070ff0 0x7f17c00734b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f17cc004f60 tx=0x7f17cc004950 comp rx=0 tx=0).stop 2024-09-10T23:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeed90780 msgr2=0x55faeee4b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 --2- 172.21.15.17:0/165374171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55faeed90780 0x55faeee4b990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f17d000a860 tx=0x7f17d000ad20 comp rx=0 tx=0).stop 2024-09-10T23:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17df000640 1 -- 172.21.15.17:0/165374171 reap_dead start 2024-09-10T23:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 shutdown_connections 2024-09-10T23:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 >> 172.21.15.17:0/165374171 conn(0x55faeedbf3e0 msgr2=0x55faeed8efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 shutdown_connections 2024-09-10T23:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.545+0000 7f17e13e4080 1 -- 172.21.15.17:0/165374171 wait complete. 2024-09-10T23:19:32.555 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-10T23:19:32.555 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-10T23:19:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 -- 172.21.15.17:0/3065342295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 msgr2=0x7f1d080cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 --2- 172.21.15.17:0/3065342295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 0x7f1d080cf040 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1d080b4f70 tx=0x7f1cf401c890 comp rx=0 tx=0).stop 2024-09-10T23:19:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 -- 172.21.15.17:0/3065342295 shutdown_connections 2024-09-10T23:19:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 --2- 172.21.15.17:0/3065342295 >> v2:172.21.15.77:3300/0 conn(0x7f1d0806fb90 0x7f1d080cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 --2- 172.21.15.17:0/3065342295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 0x7f1d080cf040 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 -- 172.21.15.17:0/3065342295 >> 172.21.15.17:0/3065342295 conn(0x7f1d080b17a0 msgr2=0x7f1d080b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 -- 172.21.15.17:0/3065342295 shutdown_connections 2024-09-10T23:19:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 -- 172.21.15.17:0/3065342295 wait complete. 2024-09-10T23:19:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 Processor -- start 2024-09-10T23:19:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 -- start start 2024-09-10T23:19:32.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 0x7f1d080cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d0806fb90 0x7f1d08157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d0815a2a0 0x7f1d080b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08167ac0 con 0x7f1d0806f700 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08167940 con 0x7f1d0815a2a0 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d10200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1d08167c40 con 0x7f1d0806fb90 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 0x7f1d080cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 0x7f1d080cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49192/0 (socket says 172.21.15.17:49192) 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0d800640 1 -- 172.21.15.17:0/825221549 learned_addr learned my addr 172.21.15.17:0/825221549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0e200640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d0815a2a0 0x7f1d080b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d0806fb90 0x7f1d08157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0d800640 1 -- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d0806fb90 msgr2=0x7f1d08157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0d800640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d0806fb90 0x7f1d08157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0d800640 1 -- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d0815a2a0 msgr2=0x7f1d080b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0d800640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d0815a2a0 0x7f1d080b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.745+0000 7f1d0d800640 1 -- 172.21.15.17:0/825221549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d080b08b0 con 0x7f1d0806f700 2024-09-10T23:19:32.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.749+0000 7f1d0d800640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 0x7f1d080cd160 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00c500 tx=0x7f1cfc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.749+0000 7f1d05600640 1 -- 172.21.15.17:0/825221549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc017070 con 0x7f1d0806f700 2024-09-10T23:19:32.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.749+0000 7f1d05600640 1 -- 172.21.15.17:0/825221549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cfc0053c0 con 0x7f1d0806f700 2024-09-10T23:19:32.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.749+0000 7f1d10200640 1 -- 172.21.15.17:0/825221549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d081565f0 con 0x7f1d0806f700 2024-09-10T23:19:32.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.749+0000 7f1d05600640 1 -- 172.21.15.17:0/825221549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc012890 con 0x7f1d0806f700 2024-09-10T23:19:32.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.749+0000 7f1d10200640 1 -- 172.21.15.17:0/825221549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d080afb70 con 0x7f1d0806f700 2024-09-10T23:19:32.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.749+0000 7f1d05600640 1 -- 172.21.15.17:0/825221549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1cfc003600 con 0x7f1d0806f700 2024-09-10T23:19:32.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.749+0000 7f1d05600640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ce80725e0 0x7f1ce8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.749+0000 7f1d05600640 1 -- 172.21.15.17:0/825221549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f1cfc092b10 con 0x7f1d0806f700 2024-09-10T23:19:32.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 Processor -- start 2024-09-10T23:19:32.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ce80725e0 0x7f1ce8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- start start 2024-09-10T23:19:32.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ce80725e0 0x7f1ce8074aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40af000 tx=0x7f1cf401b0d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841d98d0 0x561e841d9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e8418d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8418d930 0x561e8418dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561e83feba40 con 0x561e841da1f0 2024-09-10T23:19:32.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e83fdae70 con 0x561e8418d930 2024-09-10T23:19:32.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e83fdec80 con 0x561e841d98d0 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e8418d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e8418d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49206/0 (socket says 172.21.15.17:49206) 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 -- 172.21.15.17:0/2331463930 learned_addr learned my addr 172.21.15.17:0/2331463930 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0e200640 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8418d930 0x561e8418dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0d800640 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841d98d0 0x561e841d9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 -- 172.21.15.17:0/2331463930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841d98d0 msgr2=0x561e841d9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841d98d0 0x561e841d9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 -- 172.21.15.17:0/2331463930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8418d930 msgr2=0x561e8418dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8418d930 0x561e8418dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 -- 172.21.15.17:0/2331463930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e83f803b0 con 0x561e841da1f0 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0e200640 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8418d930 0x561e8418dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e8418d3f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40b0040 tx=0x7f1cf40b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93919d842c01a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1cfa000640 1 -- 172.21.15.17:0/2331463930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40c6070 con 0x561e841da1f0 2024-09-10T23:19:32.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1cfa000640 1 -- 172.21.15.17:0/2331463930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cf40b3040 con 0x561e841da1f0 2024-09-10T23:19:32.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1cfa000640 1 -- 172.21.15.17:0/2331463930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40bd040 con 0x561e841da1f0 2024-09-10T23:19:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- 172.21.15.17:0/2331463930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 msgr2=0x561e8418d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e8418d3f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40b0040 tx=0x7f1cf40b5000 comp rx=0 tx=0).stop 2024-09-10T23:19:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- 172.21.15.17:0/2331463930 shutdown_connections 2024-09-10T23:19:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8418d930 0x561e8418dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e8418d3f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2331463930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841d98d0 0x561e841d9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- 172.21.15.17:0/2331463930 >> 172.21.15.17:0/2331463930 conn(0x561e841ba990 msgr2=0x561e841bcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- 172.21.15.17:0/2331463930 shutdown_connections 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- 172.21.15.17:0/2331463930 wait complete. 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 -- start start 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.753+0000 7f1d135d1000 1 Processor -- start 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8418d930 0x561e8418ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e84190480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841da1f0 0x561e841909c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561e83f80160 con 0x561e8418d930 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e83fe32b0 con 0x561e841d98d0 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e83f86120 con 0x561e841da1f0 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 10 client.0 _ll_register_callbacks cb 0x561e8417b100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8418d930 0x561e8418ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8418d930 0x561e8418ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49212/0 (socket says 172.21.15.17:49212) 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0d800640 1 -- 172.21.15.17:0/1604025181 learned_addr learned my addr 172.21.15.17:0/1604025181 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0e200640 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841da1f0 0x561e841909c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e84190480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0d800640 1 -- 172.21.15.17:0/1604025181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841da1f0 msgr2=0x561e841909c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0d800640 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841da1f0 0x561e841909c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0d800640 1 -- 172.21.15.17:0/1604025181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 msgr2=0x561e84190480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0d800640 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e84190480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0d800640 1 -- 172.21.15.17:0/1604025181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e83f79120 con 0x561e8418d930 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0d800640 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8418d930 0x561e8418ff40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00cec0 tx=0x7f1cfc000fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e944bbb219ee18dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1ceea00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:32.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1ceea00640 1 -- 172.21.15.17:0/1604025181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc062380 con 0x561e8418d930 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1ceea00640 1 -- 172.21.15.17:0/1604025181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f1cfc0829c0 con 0x561e8418d930 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 -- 172.21.15.17:0/1604025181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561e83fbadf0 con 0x561e8418d930 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1ceea00640 1 -- 172.21.15.17:0/1604025181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1cfc066da0 con 0x561e8418d930 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 10 client.6144 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 -- 172.21.15.17:0/1604025181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x561e83f98090 con 0x561e8418d930 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1ceea00640 1 -- 172.21.15.17:0/1604025181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561e83fbadf0 con 0x561e8418d930 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1ceea00640 1 -- 172.21.15.17:0/1604025181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f1cfc05ebd0 con 0x561e8418d930 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 10 client.6144 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 10 client.6144 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 20 client.6144 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:32.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x561e841913d0 0x561e841ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 4 client.6144 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d135d1000 1 -- 172.21.15.17:0/1604025181 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e83fed990 con 0x561e841913d0 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x561e841913d0 0x561e841ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x561e841913d0 0x561e841ebb90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5720dd3700b80e0 server_cookie=6fffd1d3c853de69 in_seq=0 out_seq=0 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.757+0000 7f1ceea00640 10 client.6144 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1ceea00640 1 -- 172.21.15.17:0/1604025181 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e83fed990 con 0x561e841913d0 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1ceea00640 10 client.6144 handle_command_reply: tid=0 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 client.6144 shutdown 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 -- 172.21.15.17:0/1604025181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8418d930 msgr2=0x561e8418ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8418d930 0x561e8418ff40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00cec0 tx=0x7f1cfc000fa0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 -- 172.21.15.17:0/1604025181 shutdown_connections 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x561e841913d0 0x561e841ebb90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e841da1f0 0x561e841909c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e84190480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 --2- 172.21.15.17:0/1604025181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8418d930 0x561e8418ff40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1ceea00640 0 client.6144 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 -- 172.21.15.17:0/1604025181 >> 172.21.15.17:0/1604025181 conn(0x561e841ba990 msgr2=0x561e8418caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 -- 172.21.15.17:0/1604025181 shutdown_connections 2024-09-10T23:19:32.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 1 -- 172.21.15.17:0/1604025181 wait complete. 2024-09-10T23:19:32.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.761+0000 7f1d135d1000 20 client.6144 trim_cache size 0 max 16384 2024-09-10T23:19:32.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.777+0000 7f1d135d1000 1 Processor -- start 2024-09-10T23:19:32.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.777+0000 7f1d135d1000 1 -- start start 2024-09-10T23:19:32.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.777+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 0x561e8418cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.777+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e8418d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.777+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e841ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.777+0000 7f1d135d1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08201090 con 0x561e841da1f0 2024-09-10T23:19:32.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.777+0000 7f1d135d1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08159460 con 0x561e841d98d0 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.777+0000 7f1d135d1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1d08200a70 con 0x561e8418d930 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e841ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e841ebb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49220/0 (socket says 172.21.15.17:49220) 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 -- 172.21.15.17:0/3026264529 learned_addr learned my addr 172.21.15.17:0/3026264529 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0d800640 1 --2- 172.21.15.17:0/3026264529 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 0x561e8418cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/3026264529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e8418d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 -- 172.21.15.17:0/3026264529 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 msgr2=0x561e8418cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 --2- 172.21.15.17:0/3026264529 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 0x561e8418cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 -- 172.21.15.17:0/3026264529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 msgr2=0x561e8418d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 --2- 172.21.15.17:0/3026264529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e8418d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 -- 172.21.15.17:0/3026264529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e83f60180 con 0x561e841da1f0 2024-09-10T23:19:32.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 --2- 172.21.15.17:0/3026264529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e841ebb90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009f00 tx=0x7f1d00012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a569027c8ca2e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1cf9600640 1 -- 172.21.15.17:0/3026264529 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00003980 con 0x561e841da1f0 2024-09-10T23:19:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1cf9600640 1 -- 172.21.15.17:0/3026264529 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d00003b20 con 0x561e841da1f0 2024-09-10T23:19:32.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1cf9600640 1 -- 172.21.15.17:0/3026264529 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004020 con 0x561e841da1f0 2024-09-10T23:19:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 -- 172.21.15.17:0/3026264529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 msgr2=0x561e841ebb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 --2- 172.21.15.17:0/3026264529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e841ebb90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009f00 tx=0x7f1d00012820 comp rx=0 tx=0).stop 2024-09-10T23:19:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 -- 172.21.15.17:0/3026264529 shutdown_connections 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 --2- 172.21.15.17:0/3026264529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e841ebb90 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 --2- 172.21.15.17:0/3026264529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e8418d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 --2- 172.21.15.17:0/3026264529 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 0x561e8418cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 -- 172.21.15.17:0/3026264529 >> 172.21.15.17:0/3026264529 conn(0x561e841ba990 msgr2=0x561e841b8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 -- 172.21.15.17:0/3026264529 shutdown_connections 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 -- 172.21.15.17:0/3026264529 wait complete. 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 -- start start 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 Processor -- start 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 0x561e842504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e84250a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e84250f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561e83f9e140 con 0x561e841da1f0 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e83fea810 con 0x561e841d98d0 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e83f9a6c0 con 0x561e8418d930 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d135d1000 10 client.0 _ll_register_callbacks cb 0x7f1cfc059740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e84250f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e84250f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49232/0 (socket says 172.21.15.17:49232) 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0e200640 1 -- 172.21.15.17:0/2037561577 learned_addr learned my addr 172.21.15.17:0/2037561577 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0ce00640 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e84250a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.781+0000 7f1d0d800640 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 0x561e842504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d0e200640 1 -- 172.21.15.17:0/2037561577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 msgr2=0x561e842504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d0e200640 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 0x561e842504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d0e200640 1 -- 172.21.15.17:0/2037561577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 msgr2=0x561e84250a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d0e200640 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e84250a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d0e200640 1 -- 172.21.15.17:0/2037561577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e84037ed0 con 0x561e841da1f0 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d0e200640 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e84250f60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1d00012fd0 tx=0x7f1d00003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d962c7ec62ff4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 1 -- 172.21.15.17:0/2037561577 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000042f0 con 0x561e841da1f0 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 1 -- 172.21.15.17:0/2037561577 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f1d00004490 con 0x561e841da1f0 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 -- 172.21.15.17:0/2037561577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d00003b20 con 0x561e841da1f0 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 1 -- 172.21.15.17:0/2037561577 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1d0002e050 con 0x561e841da1f0 2024-09-10T23:19:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 10 client.6150 fetch_fsmap learned FSMap version 30 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 -- 172.21.15.17:0/2037561577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x561e83c91600 con 0x561e841da1f0 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 1 -- 172.21.15.17:0/2037561577 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d00003b20 con 0x561e841da1f0 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 1 -- 172.21.15.17:0/2037561577 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f1d00031020 con 0x561e841da1f0 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 10 client.6150 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 10 client.6150 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 20 client.6150 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x561e841eed60 0x561e841ef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 4 client.6150 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 -- 172.21.15.17:0/2037561577 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x561e83fe9440 con 0x561e841eed60 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d0d800640 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x561e841eed60 0x561e841ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d0d800640 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x561e841eed60 0x561e841ef170 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1549988bd05613f5 server_cookie=15cb112eb67e5c98 in_seq=0 out_seq=0 2024-09-10T23:19:32.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 10 client.6150 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 1 -- 172.21.15.17:0/2037561577 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561e83fe9440 con 0x561e841eed60 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 10 client.6150 handle_command_reply: tid=0 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 client.6150 shutdown 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 -- 172.21.15.17:0/2037561577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 msgr2=0x561e84250f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e84250f60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1d00012fd0 tx=0x7f1d00003f80 comp rx=0 tx=0).stop 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 -- 172.21.15.17:0/2037561577 shutdown_connections 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x561e841eed60 0x561e841ef170 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e841da1f0 0x561e84250f60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e841d98d0 0x561e84250a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 --2- 172.21.15.17:0/2037561577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8418d930 0x561e842504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1ceea00640 0 client.6150 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 -- 172.21.15.17:0/2037561577 >> 172.21.15.17:0/2037561577 conn(0x561e841ba990 msgr2=0x561e841b95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 -- 172.21.15.17:0/2037561577 shutdown_connections 2024-09-10T23:19:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 1 -- 172.21.15.17:0/2037561577 wait complete. 2024-09-10T23:19:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1d135d1000 20 client.6150 trim_cache size 0 max 16384 2024-09-10T23:19:32.797 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:19:32.785+0000 7f1e90c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4b [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v729 pv731 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-10T23:19:31.899247+0000 b1048576 1=1+0) (ifile lock->xlock w=1) (iquiesce lock w=1) cr={5649=0-4194304@1} caps={5649=pAsLsXsFc/-@3} | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x557db9914b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a4b:[<0x10000000001/new_file_1 v729>,<0x10000000000/ceph-qa-suite v88>,<0x1/scrub_test_path v38>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-10T23:19:32.798 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:32.798 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:19:32.798 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "54e89c59-49ce-4a47-948b-f8fd941bd45e", 2024-09-10T23:19:32.798 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:19:32.798 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 -- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ce80725e0 msgr2=0x7f1ce8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ce80725e0 0x7f1ce8074aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40af000 tx=0x7f1cf401b0d0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 -- 172.21.15.17:0/825221549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 msgr2=0x7f1d080cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 0x7f1d080cd160 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00c500 tx=0x7f1cfc00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 -- 172.21.15.17:0/825221549 shutdown_connections 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ce80725e0 0x7f1ce8074aa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d0815a2a0 0x7f1d080b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d0806fb90 0x7f1d08157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 --2- 172.21.15.17:0/825221549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d0806f700 0x7f1d080cd160 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 -- 172.21.15.17:0/825221549 >> 172.21.15.17:0/825221549 conn(0x7f1d080b17a0 msgr2=0x7f1d080d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 -- 172.21.15.17:0/825221549 shutdown_connections 2024-09-10T23:19:32.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.789+0000 7f1d10200640 1 -- 172.21.15.17:0/825221549 wait complete. 2024-09-10T23:19:32.812 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '54e89c59-49ce-4a47-948b-f8fd941bd45e', 'mode': 'asynchronous'}' 2024-09-10T23:19:32.812 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T23:19:32.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-10T23:19:32.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.957+0000 7f4576400640 1 -- 172.21.15.17:0/2918218412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4558004d50 msgr2=0x7f45580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.957+0000 7f4576400640 1 --2- 172.21.15.17:0/2918218412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4558004d50 0x7f45580051d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4568009ee0 tx=0x7f456801d5f0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.957+0000 7f4575a00640 1 -- 172.21.15.17:0/2918218412 reap_dead start 2024-09-10T23:19:32.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.957+0000 7f4576400640 1 -- 172.21.15.17:0/2918218412 shutdown_connections 2024-09-10T23:19:32.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.957+0000 7f4576400640 1 -- 172.21.15.17:0/2918218412 >> 172.21.15.17:0/2918218412 conn(0x7f457009a9f0 msgr2=0x7f457009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.957+0000 7f4576400640 1 -- 172.21.15.17:0/2918218412 shutdown_connections 2024-09-10T23:19:32.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.957+0000 7f4576400640 1 -- 172.21.15.17:0/2918218412 wait complete. 2024-09-10T23:19:32.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.957+0000 7f4576400640 1 Processor -- start 2024-09-10T23:19:32.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.957+0000 7f4576400640 1 -- start start 2024-09-10T23:19:32.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4576400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4558004d50 0x7f45701491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4576400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4570162bd0 0x7f45700b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4576400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4570163050 0x7f45700b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4576400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45701634b0 con 0x7f4570163050 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4576400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f457015c040 con 0x7f4570162bd0 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4576400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4570163630 con 0x7f4558004d50 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4570163050 0x7f45700b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4570163050 0x7f45700b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49242/0 (socket says 172.21.15.17:49242) 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575a00640 1 -- 172.21.15.17:0/4034445320 learned_addr learned my addr 172.21.15.17:0/4034445320 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f456fe00640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4570162bd0 0x7f45700b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575000640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4558004d50 0x7f45701491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575a00640 1 -- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4558004d50 msgr2=0x7f45701491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575a00640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4558004d50 0x7f45701491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575a00640 1 -- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4570162bd0 msgr2=0x7f45700b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575a00640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4570162bd0 0x7f45700b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575a00640 1 -- 172.21.15.17:0/4034445320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45700cca20 con 0x7f4570163050 2024-09-10T23:19:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4575a00640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4570163050 0x7f45700b2230 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4568009ee0 tx=0x7f4568004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f456cc00640 1 -- 172.21.15.17:0/4034445320 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45680ad050 con 0x7f4570163050 2024-09-10T23:19:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f456cc00640 1 -- 172.21.15.17:0/4034445320 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45680a7a90 con 0x7f4570163050 2024-09-10T23:19:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f456cc00640 1 -- 172.21.15.17:0/4034445320 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568009200 con 0x7f4570163050 2024-09-10T23:19:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4576400640 1 -- 172.21.15.17:0/4034445320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45700ccd00 con 0x7f4570163050 2024-09-10T23:19:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.961+0000 7f4576400640 1 -- 172.21.15.17:0/4034445320 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45700cd2c0 con 0x7f4570163050 2024-09-10T23:19:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456cc00640 1 -- 172.21.15.17:0/4034445320 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4568003980 con 0x7f4570163050 2024-09-10T23:19:32.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456cc00640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45500725e0 0x7f4550074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456cc00640 1 -- 172.21.15.17:0/4034445320 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f456812e740 con 0x7f4570163050 2024-09-10T23:19:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f457ad56000 1 Processor -- start 2024-09-10T23:19:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f4575000640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45500725e0 0x7f4550074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f457ad56000 1 -- start start 2024-09-10T23:19:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f4575000640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45500725e0 0x7f4550074aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4564009ce0 tx=0x7f45640091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f457ad56000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbdf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f457ad56000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659db95680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f457ad56000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db95fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f457ad56000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55659da7dcb0 con 0x55659dbdfac0 2024-09-10T23:19:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f457ad56000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55659d993310 con 0x55659db95bc0 2024-09-10T23:19:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f457ad56000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55659d9f0b90 con 0x55659dbdf1a0 2024-09-10T23:19:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659db95680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659db95680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49254/0 (socket says 172.21.15.17:49254) 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456fe00640 1 -- 172.21.15.17:0/636261233 learned_addr learned my addr 172.21.15.17:0/636261233 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f4575a00640 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db95fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f4575000640 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbdf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456fe00640 1 -- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 msgr2=0x55659dbdf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456fe00640 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbdf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456fe00640 1 -- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 msgr2=0x55659db95fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456fe00640 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db95fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456fe00640 1 -- 172.21.15.17:0/636261233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659d994c60 con 0x55659dbdfac0 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f4575000640 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbdf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f4575a00640 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db95fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f456fe00640 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659db95680 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f455c004b30 tx=0x7f455c001500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5afd4c17eb54bfd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f4561600640 1 -- 172.21.15.17:0/636261233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c011e50 con 0x55659dbdfac0 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f4561600640 1 -- 172.21.15.17:0/636261233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f455c016030 con 0x55659dbdfac0 2024-09-10T23:19:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.965+0000 7f4561600640 1 -- 172.21.15.17:0/636261233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0127d0 con 0x55659dbdfac0 2024-09-10T23:19:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- 172.21.15.17:0/636261233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 msgr2=0x55659db95680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659db95680 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f455c004b30 tx=0x7f455c001500 comp rx=0 tx=0).stop 2024-09-10T23:19:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- 172.21.15.17:0/636261233 shutdown_connections 2024-09-10T23:19:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db95fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659db95680 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 --2- 172.21.15.17:0/636261233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbdf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- 172.21.15.17:0/636261233 >> 172.21.15.17:0/636261233 conn(0x55659db9bd20 msgr2=0x55659db93f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- 172.21.15.17:0/636261233 shutdown_connections 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- 172.21.15.17:0/636261233 wait complete. 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- start start 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 Processor -- start 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659db95bc0 0x55659dbe6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbe6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659dbdfac0 0x55659dbe6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55659d9e3dd0 con 0x55659db95bc0 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55659d9dffc0 con 0x55659dbdfac0 2024-09-10T23:19:32.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55659d9854b0 con 0x55659dbdf1a0 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 10 client.0 _ll_register_callbacks cb 0x55659d9637d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659db95bc0 0x55659dbe6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659db95bc0 0x55659dbe6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49262/0 (socket says 172.21.15.17:49262) 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575000640 1 -- 172.21.15.17:0/670736547 learned_addr learned my addr 172.21.15.17:0/670736547 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f456fe00640 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbe6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575a00640 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659dbdfac0 0x55659dbe6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575000640 1 -- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 msgr2=0x55659dbe6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575000640 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbe6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575000640 1 -- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659dbdfac0 msgr2=0x55659dbe6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575000640 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659dbdfac0 0x55659dbe6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575000640 1 -- 172.21.15.17:0/670736547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659d97e1f0 con 0x55659db95bc0 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f456fe00640 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbe6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575a00640 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659dbdfac0 0x55659dbe6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4575000640 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659db95bc0 0x55659dbe6530 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4564005bd0 tx=0x7f4564004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8ed67b790ce9cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4556000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4556000640 1 -- 172.21.15.17:0/670736547 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456402d060 con 0x55659db95bc0 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4556000640 1 -- 172.21.15.17:0/670736547 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f4564018030 con 0x55659db95bc0 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- 172.21.15.17:0/670736547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55659d978330 con 0x55659db95bc0 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f4556000640 1 -- 172.21.15.17:0/670736547 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4564033050 con 0x55659db95bc0 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 10 client.6162 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.969+0000 7f457ad56000 1 -- 172.21.15.17:0/670736547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x55659d964fa0 con 0x55659db95bc0 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f4556000640 1 -- 172.21.15.17:0/670736547 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55659d978330 con 0x55659db95bc0 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f4556000640 1 -- 172.21.15.17:0/670736547 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f4564036020 con 0x55659db95bc0 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 10 client.6162 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 10 client.6162 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:32.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 20 client.6162 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:32.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55659dbee900 0x55659dbf0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 4 client.6162 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:32.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 -- 172.21.15.17:0/670736547 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55659d9f2ae0 con 0x55659dbee900 2024-09-10T23:19:32.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f456fe00640 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55659dbee900 0x55659dbf0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f456fe00640 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55659dbee900 0x55659dbf0cf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d77723b23fb8169a server_cookie=92198de2cf008e06 in_seq=0 out_seq=0 2024-09-10T23:19:32.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f4556000640 10 client.6162 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f4556000640 1 -- 172.21.15.17:0/670736547 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55659d9f2ae0 con 0x55659dbee900 2024-09-10T23:19:32.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f4556000640 10 client.6162 handle_command_reply: tid=0 2024-09-10T23:19:32.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 client.6162 shutdown 2024-09-10T23:19:32.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 -- 172.21.15.17:0/670736547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659db95bc0 msgr2=0x55659dbe6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:32.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659db95bc0 0x55659dbe6530 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4564005bd0 tx=0x7f4564004740 comp rx=0 tx=0).stop 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 -- 172.21.15.17:0/670736547 shutdown_connections 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55659dbee900 0x55659dbf0cf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659dbdfac0 0x55659dbe6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659dbe6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f4556000640 0 client.6162 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 --2- 172.21.15.17:0/670736547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659db95bc0 0x55659dbe6530 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 -- 172.21.15.17:0/670736547 >> 172.21.15.17:0/670736547 conn(0x55659db9bd20 msgr2=0x55659db93f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 -- 172.21.15.17:0/670736547 shutdown_connections 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 1 -- 172.21.15.17:0/670736547 wait complete. 2024-09-10T23:19:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.973+0000 7f457ad56000 20 client.6162 trim_cache size 0 max 16384 2024-09-10T23:19:32.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 Processor -- start 2024-09-10T23:19:32.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 -- start start 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db96fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659db974f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659dbe9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4570201780 con 0x55659dbdfac0 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45702007c0 con 0x55659db95bc0 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f45701ffb50 con 0x55659dbdf1a0 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659dbe9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659dbe9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49274/0 (socket says 172.21.15.17:49274) 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575a00640 1 -- 172.21.15.17:0/938671728 learned_addr learned my addr 172.21.15.17:0/938671728 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575000640 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db96fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f456fe00640 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659db974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575a00640 1 -- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 msgr2=0x55659db974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575a00640 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659db974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575a00640 1 -- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 msgr2=0x55659db96fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575a00640 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db96fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575a00640 1 -- 172.21.15.17:0/938671728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659da3d660 con 0x55659dbdfac0 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575000640 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db96fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f456fe00640 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659db974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4575a00640 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659dbe9310 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4568099120 tx=0x7f456801d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdabf07c6ffc358 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4560c00640 1 -- 172.21.15.17:0/938671728 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45680c1070 con 0x55659dbdfac0 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4560c00640 1 -- 172.21.15.17:0/938671728 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f456811e070 con 0x55659dbdfac0 2024-09-10T23:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f4560c00640 1 -- 172.21.15.17:0/938671728 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568102790 con 0x55659dbdfac0 2024-09-10T23:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 -- 172.21.15.17:0/938671728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 msgr2=0x55659dbe9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659dbe9310 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4568099120 tx=0x7f456801d5f0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 -- 172.21.15.17:0/938671728 shutdown_connections 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdfac0 0x55659dbe9310 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdf1a0 0x55659db974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 --2- 172.21.15.17:0/938671728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659db96fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 -- 172.21.15.17:0/938671728 >> 172.21.15.17:0/938671728 conn(0x55659db9bd20 msgr2=0x55659db95180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 -- 172.21.15.17:0/938671728 shutdown_connections 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.993+0000 7f457ad56000 1 -- 172.21.15.17:0/938671728 wait complete. 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 -- start start 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 Processor -- start 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659dbec560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdf1a0 0x55659dbecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdfac0 0x55659dc11210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55659d9e3dd0 con 0x55659dbdf1a0 2024-09-10T23:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55659db9ed40 con 0x55659db95bc0 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55659db9c100 con 0x55659dbdfac0 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 10 client.0 _ll_register_callbacks cb 0x7f45640099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f456fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdf1a0 0x55659dbecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f456fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdf1a0 0x55659dbecaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49288/0 (socket says 172.21.15.17:49288) 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f456fe00640 1 -- 172.21.15.17:0/1964422205 learned_addr learned my addr 172.21.15.17:0/1964422205 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4575a00640 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdfac0 0x55659dc11210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4575000640 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659dbec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f456fe00640 1 -- 172.21.15.17:0/1964422205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdfac0 msgr2=0x55659dc11210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f456fe00640 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdfac0 0x55659dc11210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f456fe00640 1 -- 172.21.15.17:0/1964422205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 msgr2=0x55659dbec560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f456fe00640 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659dbec560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f456fe00640 1 -- 172.21.15.17:0/1964422205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659d9aa090 con 0x55659dbdf1a0 2024-09-10T23:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f456fe00640 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdf1a0 0x55659dbecaa0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f455c001d00 tx=0x7f455c001570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f8c404d439a91b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4556000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4556000640 1 -- 172.21.15.17:0/1964422205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c003800 con 0x55659dbdf1a0 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4556000640 1 -- 172.21.15.17:0/1964422205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f455c0039a0 con 0x55659dbdf1a0 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 -- 172.21.15.17:0/1964422205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f456811e070 con 0x55659dbdf1a0 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4556000640 1 -- 172.21.15.17:0/1964422205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f455c035050 con 0x55659dbdf1a0 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 10 client.6168 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 -- 172.21.15.17:0/1964422205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x55659d9765f0 con 0x55659dbdf1a0 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4556000640 1 -- 172.21.15.17:0/1964422205 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f456811e070 con 0x55659dbdf1a0 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4556000640 1 -- 172.21.15.17:0/1964422205 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f455c038020 con 0x55659dbdf1a0 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 10 client.6168 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 10 client.6168 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 20 client.6168 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55659dc54c70 0x55659dc55080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 4 client.6168 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:19:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f457ad56000 1 -- 172.21.15.17:0/1964422205 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55659d9ee590 con 0x55659dc54c70 2024-09-10T23:19:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4575000640 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55659dc54c70 0x55659dc55080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4556000640 10 client.6168 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:32.997+0000 7f4575000640 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55659dc54c70 0x55659dc55080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=828061f46b3e7def server_cookie=d12a769cb0fbc5c7 in_seq=0 out_seq=0 2024-09-10T23:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4556000640 1 -- 172.21.15.17:0/1964422205 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2875 (crc 0 0 0) 0x55659d9ee590 con 0x55659dc54c70 2024-09-10T23:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4556000640 10 client.6168 handle_command_reply: tid=0 2024-09-10T23:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 client.6168 shutdown 2024-09-10T23:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 -- 172.21.15.17:0/1964422205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdf1a0 msgr2=0x55659dbecaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdf1a0 0x55659dbecaa0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f455c001d00 tx=0x7f455c001570 comp rx=0 tx=0).stop 2024-09-10T23:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 -- 172.21.15.17:0/1964422205 shutdown_connections 2024-09-10T23:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x55659dc54c70 0x55659dc55080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55659dbdfac0 0x55659dc11210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55659dbdf1a0 0x55659dbecaa0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 --2- 172.21.15.17:0/1964422205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55659db95bc0 0x55659dbec560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4556000640 0 client.6168 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 -- 172.21.15.17:0/1964422205 >> 172.21.15.17:0/1964422205 conn(0x55659db9bd20 msgr2=0x55659db95fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 -- 172.21.15.17:0/1964422205 shutdown_connections 2024-09-10T23:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 1 -- 172.21.15.17:0/1964422205 wait complete. 2024-09-10T23:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f457ad56000 20 client.6168 trim_cache size 0 max 16384 2024-09-10T23:19:33.009 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "54e89c59-49ce-4a47-948b-f8fd941bd45e": { 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "54e89c59-49ce-4a47-948b-f8fd941bd45e", 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "" 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "0aeec676-af76-4e16-86d1-82298f9906a5": { 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:31.321703+0000", 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-10T23:19:33.010 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "a224d665-9c3a-45d5-a0a2-58ec71f923af": { 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:31.533701+0000", 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:33.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "db078b5b-7ada-4cd8-a356-d7dec8db219a": { 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:31.105705+0000", 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "54e89c59-49ce-4a47-948b-f8fd941bd45e": { 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:32.785692+0000", 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:33.012 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "85ad6256-e1ae-4353-8cb6-fd6f0bc2008a": { 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:23.845761+0000", 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "e44aa676-1420-4803-a2af-66c72fe9179e": { 2024-09-10T23:19:33.013 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:22.557771+0000", 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "db1624da-5cab-4b28-a529-f4f91b115d8e": { 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:22.133774+0000", 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:33.014 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: "6585d22e-42c6-4013-856e-9e3cea69c110": { 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:21.525779+0000", 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:33.015 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 -- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45500725e0 msgr2=0x7f4550074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45500725e0 0x7f4550074aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4564009ce0 tx=0x7f45640091e0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 -- 172.21.15.17:0/4034445320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4570163050 msgr2=0x7f45700b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4570163050 0x7f45700b2230 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4568009ee0 tx=0x7f4568004f30 comp rx=0 tx=0).stop 2024-09-10T23:19:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 -- 172.21.15.17:0/4034445320 shutdown_connections 2024-09-10T23:19:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f45500725e0 0x7f4550074aa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4570163050 0x7f45700b2230 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4570162bd0 0x7f45700b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 --2- 172.21.15.17:0/4034445320 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4558004d50 0x7f45701491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 -- 172.21.15.17:0/4034445320 >> 172.21.15.17:0/4034445320 conn(0x7f457009a9f0 msgr2=0x7f45700d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 -- 172.21.15.17:0/4034445320 shutdown_connections 2024-09-10T23:19:33.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:33.001+0000 7f4576400640 1 -- 172.21.15.17:0/4034445320 wait complete. 2024-09-10T23:19:36.713 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:36.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:19:38.025 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T23:19:38.025 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-10T23:19:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.181+0000 7ff85fc00640 1 -- 172.21.15.17:0/2789289372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580d0320 msgr2=0x7ff858071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.181+0000 7ff85fc00640 1 --2- 172.21.15.17:0/2789289372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580d0320 0x7ff858071060 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff8580d1c50 tx=0x7ff85001cd80 comp rx=0 tx=0).stop 2024-09-10T23:19:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.181+0000 7ff85fc00640 1 -- 172.21.15.17:0/2789289372 shutdown_connections 2024-09-10T23:19:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.181+0000 7ff85fc00640 1 --2- 172.21.15.17:0/2789289372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580d0320 0x7ff858071060 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.181+0000 7ff85fc00640 1 --2- 172.21.15.17:0/2789289372 >> v2:172.21.15.77:3300/0 conn(0x7ff8580d23e0 0x7ff8580cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.181+0000 7ff85fc00640 1 -- 172.21.15.17:0/2789289372 >> 172.21.15.17:0/2789289372 conn(0x7ff85809a9f0 msgr2=0x7ff85809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.181+0000 7ff85fc00640 1 -- 172.21.15.17:0/2789289372 shutdown_connections 2024-09-10T23:19:38.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.181+0000 7ff85fc00640 1 -- 172.21.15.17:0/2789289372 wait complete. 2024-09-10T23:19:38.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 Processor -- start 2024-09-10T23:19:38.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 -- start start 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8580d0320 0x7ff85814fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8580d23e0 0x7ff8580b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85815f210 0x7ff8580b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff858168a70 con 0x7ff85815f210 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8581688f0 con 0x7ff8580d0320 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff858168bf0 con 0x7ff8580d23e0 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85815f210 0x7ff8580b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85815f210 0x7ff8580b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34054/0 (socket says 172.21.15.17:34054) 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85dc00640 1 -- 172.21.15.17:0/2820898773 learned_addr learned my addr 172.21.15.17:0/2820898773 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff857e00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8580d23e0 0x7ff8580b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85d200640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8580d0320 0x7ff85814fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85dc00640 1 -- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8580d23e0 msgr2=0x7ff8580b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85dc00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8580d23e0 0x7ff8580b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85dc00640 1 -- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8580d0320 msgr2=0x7ff85814fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85dc00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8580d0320 0x7ff85814fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85dc00640 1 -- 172.21.15.17:0/2820898773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85815b600 con 0x7ff85815f210 2024-09-10T23:19:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85dc00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85815f210 0x7ff8580b50b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff850019990 tx=0x7ff850003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff854c00640 1 -- 172.21.15.17:0/2820898773 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8500bb070 con 0x7ff85815f210 2024-09-10T23:19:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff854c00640 1 -- 172.21.15.17:0/2820898773 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff850004e00 con 0x7ff85815f210 2024-09-10T23:19:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff854c00640 1 -- 172.21.15.17:0/2820898773 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8500b2040 con 0x7ff85815f210 2024-09-10T23:19:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 -- 172.21.15.17:0/2820898773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8581faab0 con 0x7ff85815f210 2024-09-10T23:19:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.185+0000 7ff85fc00640 1 -- 172.21.15.17:0/2820898773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8581fb070 con 0x7ff85815f210 2024-09-10T23:19:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff854c00640 1 -- 172.21.15.17:0/2820898773 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff8500b5030 con 0x7ff85815f210 2024-09-10T23:19:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff854c00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8380725e0 0x7ff838074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff854c00640 1 -- 172.21.15.17:0/2820898773 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7ff85012ceb0 con 0x7ff85815f210 2024-09-10T23:19:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff862f32000 1 Processor -- start 2024-09-10T23:19:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff85d200640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8380725e0 0x7ff838074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff862f32000 1 -- start start 2024-09-10T23:19:38.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff85d200640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8380725e0 0x7ff838074aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff84c007fd0 tx=0x7ff84c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff862f32000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad574a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff862f32000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 0x556ad5700680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff862f32000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 0x556ad5700fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.189+0000 7ff862f32000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556ad55e8cb0 con 0x556ad574a1a0 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556ad54fe310 con 0x556ad574aac0 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556ad555bb90 con 0x556ad5700bc0 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad574a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad574a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34064/0 (socket says 172.21.15.17:34064) 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85d200640 1 -- 172.21.15.17:0/631549897 learned_addr learned my addr 172.21.15.17:0/631549897 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff857e00640 1 --2- 172.21.15.17:0/631549897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 0x556ad5700680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85dc00640 1 --2- 172.21.15.17:0/631549897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 0x556ad5700fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85d200640 1 -- 172.21.15.17:0/631549897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 msgr2=0x556ad5700fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85d200640 1 --2- 172.21.15.17:0/631549897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 0x556ad5700fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85d200640 1 -- 172.21.15.17:0/631549897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 msgr2=0x556ad5700680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85d200640 1 --2- 172.21.15.17:0/631549897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 0x556ad5700680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85d200640 1 -- 172.21.15.17:0/631549897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ad54ffc60 con 0x556ad574a1a0 2024-09-10T23:19:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff85d200640 1 --2- 172.21.15.17:0/631549897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad574a580 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00f990 tx=0x7ff84c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a309a0638dddfbb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff849600640 1 -- 172.21.15.17:0/631549897 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c025070 con 0x556ad574a1a0 2024-09-10T23:19:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff849600640 1 -- 172.21.15.17:0/631549897 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff84c01b050 con 0x556ad574a1a0 2024-09-10T23:19:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff849600640 1 -- 172.21.15.17:0/631549897 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c014e40 con 0x556ad574a1a0 2024-09-10T23:19:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- 172.21.15.17:0/631549897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 msgr2=0x556ad574a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 --2- 172.21.15.17:0/631549897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad574a580 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00f990 tx=0x7ff84c012000 comp rx=0 tx=0).stop 2024-09-10T23:19:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- 172.21.15.17:0/631549897 shutdown_connections 2024-09-10T23:19:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 --2- 172.21.15.17:0/631549897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 0x556ad5700fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 --2- 172.21.15.17:0/631549897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 0x556ad5700680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 --2- 172.21.15.17:0/631549897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad574a580 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- 172.21.15.17:0/631549897 >> 172.21.15.17:0/631549897 conn(0x556ad5706d20 msgr2=0x556ad56fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- 172.21.15.17:0/631549897 shutdown_connections 2024-09-10T23:19:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- 172.21.15.17:0/631549897 wait complete. 2024-09-10T23:19:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- start start 2024-09-10T23:19:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 Processor -- start 2024-09-10T23:19:38.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad5700bc0 0x556ad5751530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574a1a0 0x556ad5751a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad574aac0 0x556ad5751fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556ad554edd0 con 0x556ad5700bc0 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556ad554afc0 con 0x556ad574a1a0 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556ad54f04b0 con 0x556ad574aac0 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.193+0000 7ff862f32000 10 client.0 _ll_register_callbacks cb 0x556ad54ce7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff85d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad5700bc0 0x556ad5751530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff85d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad5700bc0 0x556ad5751530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34072/0 (socket says 172.21.15.17:34072) 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff85d200640 1 -- 172.21.15.17:0/296587001 learned_addr learned my addr 172.21.15.17:0/296587001 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff85d200640 1 -- 172.21.15.17:0/296587001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad574aac0 msgr2=0x556ad5751fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff85d200640 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad574aac0 0x556ad5751fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff85d200640 1 -- 172.21.15.17:0/296587001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574a1a0 msgr2=0x556ad5751a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff85d200640 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574a1a0 0x556ad5751a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff85d200640 1 -- 172.21.15.17:0/296587001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ad54e91f0 con 0x556ad5700bc0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff85d200640 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad5700bc0 0x556ad5751530 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff84c023040 tx=0x7ff84c020a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a798ba0d995d6981 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 1 -- 172.21.15.17:0/296587001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c030060 con 0x556ad5700bc0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 1 -- 172.21.15.17:0/296587001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7ff84c02b440 con 0x556ad5700bc0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 -- 172.21.15.17:0/296587001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ad54e3330 con 0x556ad5700bc0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 1 -- 172.21.15.17:0/296587001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff84c036050 con 0x556ad5700bc0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 10 client.6180 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 -- 172.21.15.17:0/296587001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x556ad54cffa0 con 0x556ad5700bc0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 1 -- 172.21.15.17:0/296587001 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556ad54e3330 con 0x556ad5700bc0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 1 -- 172.21.15.17:0/296587001 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7ff84c039020 con 0x556ad5700bc0 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 10 client.6180 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 10 client.6180 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 20 client.6180 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x556ad5759900 0x556ad575bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 4 client.6180 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 -- 172.21.15.17:0/296587001 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ad555dae0 con 0x556ad5759900 2024-09-10T23:19:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff857e00640 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x556ad5759900 0x556ad575bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 10 client.6180 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff857e00640 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x556ad5759900 0x556ad575bcf0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dd98bc3b3697bfe server_cookie=90318f048a850440 in_seq=0 out_seq=0 2024-09-10T23:19:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 1 -- 172.21.15.17:0/296587001 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ad555dae0 con 0x556ad5759900 2024-09-10T23:19:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 10 client.6180 handle_command_reply: tid=0 2024-09-10T23:19:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 client.6180 shutdown 2024-09-10T23:19:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 -- 172.21.15.17:0/296587001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad5700bc0 msgr2=0x556ad5751530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad5700bc0 0x556ad5751530 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff84c023040 tx=0x7ff84c020a20 comp rx=0 tx=0).stop 2024-09-10T23:19:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 -- 172.21.15.17:0/296587001 shutdown_connections 2024-09-10T23:19:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x556ad5759900 0x556ad575bcf0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad574aac0 0x556ad5751fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574a1a0 0x556ad5751a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff83e000640 0 client.6180 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 --2- 172.21.15.17:0/296587001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad5700bc0 0x556ad5751530 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 -- 172.21.15.17:0/296587001 >> 172.21.15.17:0/296587001 conn(0x556ad5706d20 msgr2=0x556ad56fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 -- 172.21.15.17:0/296587001 shutdown_connections 2024-09-10T23:19:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 1 -- 172.21.15.17:0/296587001 wait complete. 2024-09-10T23:19:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.197+0000 7ff862f32000 20 client.6180 trim_cache size 0 max 16384 2024-09-10T23:19:38.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff862f32000 1 Processor -- start 2024-09-10T23:19:38.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff862f32000 1 -- start start 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff862f32000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 0x556ad5754310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff862f32000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5754850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff862f32000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 0x556ad5754d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff862f32000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff8582044e0 con 0x556ad574a1a0 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff862f32000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8582034c0 con 0x556ad574aac0 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff862f32000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff85806e6b0 con 0x556ad5700bc0 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff857e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5754850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff857e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5754850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34080/0 (socket says 172.21.15.17:34080) 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff857e00640 1 -- 172.21.15.17:0/4114217273 learned_addr learned my addr 172.21.15.17:0/4114217273 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff85dc00640 1 --2- 172.21.15.17:0/4114217273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 0x556ad5754d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff85d200640 1 --2- 172.21.15.17:0/4114217273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 0x556ad5754310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff857e00640 1 -- 172.21.15.17:0/4114217273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 msgr2=0x556ad5754310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff857e00640 1 --2- 172.21.15.17:0/4114217273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 0x556ad5754310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff857e00640 1 -- 172.21.15.17:0/4114217273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 msgr2=0x556ad5754d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff857e00640 1 --2- 172.21.15.17:0/4114217273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 0x556ad5754d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff857e00640 1 -- 172.21.15.17:0/4114217273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ad55a8660 con 0x556ad574a1a0 2024-09-10T23:19:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff857e00640 1 --2- 172.21.15.17:0/4114217273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5754850 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff844004120 tx=0x7ff84400bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb318fedd8fe282f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff848c00640 1 -- 172.21.15.17:0/4114217273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84400bdf0 con 0x556ad574a1a0 2024-09-10T23:19:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff848c00640 1 -- 172.21.15.17:0/4114217273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff844003a80 con 0x556ad574a1a0 2024-09-10T23:19:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.217+0000 7ff848c00640 1 -- 172.21.15.17:0/4114217273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84401c420 con 0x556ad574a1a0 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- 172.21.15.17:0/4114217273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 msgr2=0x556ad5754850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 --2- 172.21.15.17:0/4114217273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5754850 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff844004120 tx=0x7ff84400bc00 comp rx=0 tx=0).stop 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- 172.21.15.17:0/4114217273 shutdown_connections 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 --2- 172.21.15.17:0/4114217273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad574aac0 0x556ad5754d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 --2- 172.21.15.17:0/4114217273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5754850 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 --2- 172.21.15.17:0/4114217273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad5700bc0 0x556ad5754310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- 172.21.15.17:0/4114217273 >> 172.21.15.17:0/4114217273 conn(0x556ad5706d20 msgr2=0x556ad5700fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- 172.21.15.17:0/4114217273 shutdown_connections 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- 172.21.15.17:0/4114217273 wait complete. 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- start start 2024-09-10T23:19:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 Processor -- start 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad5700bc0 0x556ad5757100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5757640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad574aac0 0x556ad577c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556ad554edd0 con 0x556ad574a1a0 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556ad5709d40 con 0x556ad5700bc0 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556ad5707100 con 0x556ad574aac0 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 10 client.0 _ll_register_callbacks cb 0x7ff84c023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff857e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5757640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff857e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5757640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34090/0 (socket says 172.21.15.17:34090) 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff857e00640 1 -- 172.21.15.17:0/216237434 learned_addr learned my addr 172.21.15.17:0/216237434 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff85d200640 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad5700bc0 0x556ad5757100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff85dc00640 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad574aac0 0x556ad577c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff857e00640 1 -- 172.21.15.17:0/216237434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad574aac0 msgr2=0x556ad577c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff857e00640 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad574aac0 0x556ad577c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff857e00640 1 -- 172.21.15.17:0/216237434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad5700bc0 msgr2=0x556ad5757100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff857e00640 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad5700bc0 0x556ad5757100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff857e00640 1 -- 172.21.15.17:0/216237434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ad5515090 con 0x556ad574a1a0 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff857e00640 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5757640 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff84400b7a0 tx=0x7ff84400b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688241095cf01b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff83e000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff83e000640 1 -- 172.21.15.17:0/216237434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844003c70 con 0x556ad574a1a0 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff83e000640 1 -- 172.21.15.17:0/216237434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7ff84401f070 con 0x556ad574a1a0 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- 172.21.15.17:0/216237434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff844003a80 con 0x556ad574a1a0 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff83e000640 1 -- 172.21.15.17:0/216237434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff844035050 con 0x556ad574a1a0 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 10 client.6186 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.221+0000 7ff862f32000 1 -- 172.21.15.17:0/216237434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x556ad54e15f0 con 0x556ad574a1a0 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff83e000640 1 -- 172.21.15.17:0/216237434 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff844003a80 con 0x556ad574a1a0 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff83e000640 1 -- 172.21.15.17:0/216237434 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7ff844038020 con 0x556ad574a1a0 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 10 client.6186 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 10 client.6186 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 20 client.6186 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x556ad577ce40 0x556ad57bf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 4 client.6186 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 -- 172.21.15.17:0/216237434 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556ad5559590 con 0x556ad577ce40 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85d200640 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x556ad577ce40 0x556ad57bf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85d200640 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x556ad577ce40 0x556ad57bf850 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8976fe59a0c377f server_cookie=b1c7b29b1421b55a in_seq=0 out_seq=0 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff83e000640 10 client.6186 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff83e000640 1 -- 172.21.15.17:0/216237434 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2654 (crc 0 0 0) 0x556ad5559590 con 0x556ad577ce40 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff83e000640 10 client.6186 handle_command_reply: tid=0 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 client.6186 shutdown 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 -- 172.21.15.17:0/216237434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 msgr2=0x556ad5757640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5757640 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff84400b7a0 tx=0x7ff84400b550 comp rx=0 tx=0).stop 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 -- 172.21.15.17:0/216237434 shutdown_connections 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x556ad577ce40 0x556ad57bf850 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556ad574aac0 0x556ad577c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ad574a1a0 0x556ad5757640 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 --2- 172.21.15.17:0/216237434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ad5700bc0 0x556ad5757100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff83e000640 0 client.6186 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 -- 172.21.15.17:0/216237434 >> 172.21.15.17:0/216237434 conn(0x556ad5706d20 msgr2=0x556ad5700070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 -- 172.21.15.17:0/216237434 shutdown_connections 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 1 -- 172.21.15.17:0/216237434 wait complete. 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff862f32000 20 client.6186 trim_cache size 0 max 16384 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stdout: "0aeec676-af76-4e16-86d1-82298f9906a5": { 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:31.321703+0000", 2024-09-10T23:19:38.234 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "a224d665-9c3a-45d5-a0a2-58ec71f923af": { 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:31.533701+0000", 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:38.235 INFO:teuthology.orchestra.run.smithi017.stdout: "db078b5b-7ada-4cd8-a356-d7dec8db219a": { 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:31.105705+0000", 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "54e89c59-49ce-4a47-948b-f8fd941bd45e": { 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:32.785692+0000", 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:38.236 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "85ad6256-e1ae-4353-8cb6-fd6f0bc2008a": { 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:23.845761+0000", 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "e44aa676-1420-4803-a2af-66c72fe9179e": { 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:22.557771+0000", 2024-09-10T23:19:38.237 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "db1624da-5cab-4b28-a529-f4f91b115d8e": { 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:22.133774+0000", 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:38.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "6585d22e-42c6-4013-856e-9e3cea69c110": { 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:19:21.525779+0000", 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:38.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 -- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8380725e0 msgr2=0x7ff838074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8380725e0 0x7ff838074aa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff84c007fd0 tx=0x7ff84c009040 comp rx=0 tx=0).stop 2024-09-10T23:19:38.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 -- 172.21.15.17:0/2820898773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85815f210 msgr2=0x7ff8580b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85815f210 0x7ff8580b50b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff850019990 tx=0x7ff850003f60 comp rx=0 tx=0).stop 2024-09-10T23:19:38.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 -- 172.21.15.17:0/2820898773 shutdown_connections 2024-09-10T23:19:38.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8380725e0 0x7ff838074aa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85815f210 0x7ff8580b50b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8580d23e0 0x7ff8580b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 --2- 172.21.15.17:0/2820898773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8580d0320 0x7ff85814fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 -- 172.21.15.17:0/2820898773 >> 172.21.15.17:0/2820898773 conn(0x7ff85809a9f0 msgr2=0x7ff858151cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 -- 172.21.15.17:0/2820898773 shutdown_connections 2024-09-10T23:19:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.225+0000 7ff85fc00640 1 -- 172.21.15.17:0/2820898773 wait complete. 2024-09-10T23:19:38.249 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:19:38.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-10T23:19:38.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.393+0000 7f10bde00640 1 -- 172.21.15.17:0/1899243485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10b80d2260 msgr2=0x7f10b80b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.393+0000 7f10bde00640 1 --2- 172.21.15.17:0/1899243485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10b80d2260 0x7f10b80b50e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009900 tx=0x7f10a801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.393+0000 7f10bde00640 1 -- 172.21.15.17:0/1899243485 shutdown_connections 2024-09-10T23:19:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.393+0000 7f10bde00640 1 --2- 172.21.15.17:0/1899243485 >> v2:172.21.15.77:3300/0 conn(0x7f10b80d46d0 0x7f10b80b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.393+0000 7f10bde00640 1 --2- 172.21.15.17:0/1899243485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10b80d2260 0x7f10b80b50e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.393+0000 7f10bde00640 1 -- 172.21.15.17:0/1899243485 >> 172.21.15.17:0/1899243485 conn(0x7f10b809d0f0 msgr2=0x7f10b80d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.393+0000 7f10bde00640 1 -- 172.21.15.17:0/1899243485 shutdown_connections 2024-09-10T23:19:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.393+0000 7f10bde00640 1 -- 172.21.15.17:0/1899243485 wait complete. 2024-09-10T23:19:38.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 Processor -- start 2024-09-10T23:19:38.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 -- start start 2024-09-10T23:19:38.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b80d2260 0x7f10b8158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10b80d2640 0x7f10b81f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10b80d46d0 0x7f10b815c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f10b80b2a60 con 0x7f10b80d46d0 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10b80b28e0 con 0x7f10b80d2260 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f10b80b2be0 con 0x7f10b80d2640 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10b80d46d0 0x7f10b815c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b80d2260 0x7f10b8158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10b80d46d0 0x7f10b815c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34102/0 (socket says 172.21.15.17:34102) 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bd400640 1 -- 172.21.15.17:0/2311042289 learned_addr learned my addr 172.21.15.17:0/2311042289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10afe00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10b80d2640 0x7f10b81f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bd400640 1 -- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10b80d2640 msgr2=0x7f10b81f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bd400640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10b80d2640 0x7f10b81f8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bd400640 1 -- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b80d2260 msgr2=0x7f10b8158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bd400640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b80d2260 0x7f10b8158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bd400640 1 -- 172.21.15.17:0/2311042289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b815d060 con 0x7f10b80d46d0 2024-09-10T23:19:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bca00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b80d2260 0x7f10b8158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bd400640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10b80d46d0 0x7f10b815c6a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f10b000c7d0 tx=0x7f10b000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10b5600640 1 -- 172.21.15.17:0/2311042289 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0003b80 con 0x7f10b80d46d0 2024-09-10T23:19:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10b5600640 1 -- 172.21.15.17:0/2311042289 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10b0003d40 con 0x7f10b80d46d0 2024-09-10T23:19:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 -- 172.21.15.17:0/2311042289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b815d340 con 0x7f10b80d46d0 2024-09-10T23:19:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10b5600640 1 -- 172.21.15.17:0/2311042289 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b000aab0 con 0x7f10b80d46d0 2024-09-10T23:19:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.397+0000 7f10bde00640 1 -- 172.21.15.17:0/2311042289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b80cae80 con 0x7f10b80d46d0 2024-09-10T23:19:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10b5600640 1 -- 172.21.15.17:0/2311042289 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f10b000ac50 con 0x7f10b80d46d0 2024-09-10T23:19:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10b5600640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10940725e0 0x7f1094074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10c287a000 1 Processor -- start 2024-09-10T23:19:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10b5600640 1 -- 172.21.15.17:0/2311042289 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f10b0093170 con 0x7f10b80d46d0 2024-09-10T23:19:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10c287a000 1 -- start start 2024-09-10T23:19:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10bca00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10940725e0 0x7f1094074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10c287a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b79d5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10c287a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b79883e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10c287a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b7988d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10c287a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5588b7872d30 con 0x5588b79d5850 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10c287a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5588b77e6af0 con 0x5588b79d4f30 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10c287a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5588b77d5f20 con 0x5588b7988920 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b79883e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b79883e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34110/0 (socket says 172.21.15.17:34110) 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10afe00640 1 -- 172.21.15.17:0/1736301681 learned_addr learned my addr 172.21.15.17:0/1736301681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10bca00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10940725e0 0x7f1094074aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f10a80af000 tx=0x7f10a801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10bd400640 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b7988d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.401+0000 7f10bca00640 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b79d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10afe00640 1 -- 172.21.15.17:0/1736301681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 msgr2=0x5588b7988d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10afe00640 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b7988d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10afe00640 1 -- 172.21.15.17:0/1736301681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 msgr2=0x5588b79d5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10afe00640 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b79d5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10afe00640 1 -- 172.21.15.17:0/1736301681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b7757100 con 0x5588b79d5850 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10bd400640 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b7988d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10afe00640 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b79883e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009b90 tx=0x7f10a0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e628dbe57062772 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10ad600640 1 -- 172.21.15.17:0/1736301681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0004030 con 0x5588b79d5850 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10ad600640 1 -- 172.21.15.17:0/1736301681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10a00041d0 con 0x5588b79d5850 2024-09-10T23:19:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10ad600640 1 -- 172.21.15.17:0/1736301681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0005020 con 0x5588b79d5850 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 -- 172.21.15.17:0/1736301681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 msgr2=0x5588b79883e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b79883e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009b90 tx=0x7f10a0011810 comp rx=0 tx=0).stop 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 -- 172.21.15.17:0/1736301681 shutdown_connections 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b7988d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b79883e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 --2- 172.21.15.17:0/1736301681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b79d5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 -- 172.21.15.17:0/1736301681 >> 172.21.15.17:0/1736301681 conn(0x5588b79b5ff0 msgr2=0x5588b79b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 -- 172.21.15.17:0/1736301681 shutdown_connections 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 -- 172.21.15.17:0/1736301681 wait complete. 2024-09-10T23:19:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 -- start start 2024-09-10T23:19:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 Processor -- start 2024-09-10T23:19:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b7988920 0x5588b79b7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b79b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b79d5850 0x5588b79b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5588b777b4e0 con 0x5588b7988920 2024-09-10T23:19:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5588b77d9d30 con 0x5588b79d4f30 2024-09-10T23:19:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5588b749b680 con 0x5588b79d5850 2024-09-10T23:19:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10c287a000 10 client.0 _ll_register_callbacks cb 0x5588b79760e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10bca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b7988920 0x5588b79b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10bca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b7988920 0x5588b79b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34116/0 (socket says 172.21.15.17:34116) 2024-09-10T23:19:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10bca00640 1 -- 172.21.15.17:0/1119501040 learned_addr learned my addr 172.21.15.17:0/1119501040 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10afe00640 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b79b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10bca00640 1 -- 172.21.15.17:0/1119501040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b79d5850 msgr2=0x5588b79b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10bca00640 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b79d5850 0x5588b79b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10bca00640 1 -- 172.21.15.17:0/1119501040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 msgr2=0x5588b79b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10bca00640 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b79b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10bca00640 1 -- 172.21.15.17:0/1119501040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b778ac40 con 0x5588b7988920 2024-09-10T23:19:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.405+0000 7f10afe00640 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b79b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10bca00640 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b7988920 0x5588b79b7420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f10a801a510 tx=0x7f10a801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da878fb209bb1019 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 1 -- 172.21.15.17:0/1119501040 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8005510 con 0x5588b7988920 2024-09-10T23:19:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 -- 172.21.15.17:0/1119501040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588b776e310 con 0x5588b7988920 2024-09-10T23:19:38.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 1 -- 172.21.15.17:0/1119501040 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f10a80046d0 con 0x5588b7988920 2024-09-10T23:19:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 1 -- 172.21.15.17:0/1119501040 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10a80d0050 con 0x5588b7988920 2024-09-10T23:19:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 10 client.6195 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 -- 172.21.15.17:0/1119501040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5588b77d4bc0 con 0x5588b7988920 2024-09-10T23:19:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 1 -- 172.21.15.17:0/1119501040 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5588b776e310 con 0x5588b7988920 2024-09-10T23:19:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 1 -- 172.21.15.17:0/1119501040 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f10a80d3020 con 0x5588b7988920 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 10 client.6195 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 10 client.6195 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 20 client.6195 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5588b79b88b0 0x5588b79e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 4 client.6195 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 -- 172.21.15.17:0/1119501040 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588b77e8a40 con 0x5588b79b88b0 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10afe00640 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5588b79b88b0 0x5588b79e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10afe00640 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5588b79b88b0 0x5588b79e71f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9bdbf4089bab9fb server_cookie=d33e81ef0c924542 in_seq=0 out_seq=0 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 10 client.6195 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 1 -- 172.21.15.17:0/1119501040 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588b77e8a40 con 0x5588b79b88b0 2024-09-10T23:19:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 10 client.6195 handle_command_reply: tid=0 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 client.6195 shutdown 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 -- 172.21.15.17:0/1119501040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b7988920 msgr2=0x5588b79b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b7988920 0x5588b79b7420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f10a801a510 tx=0x7f10a801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 -- 172.21.15.17:0/1119501040 shutdown_connections 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5588b79b88b0 0x5588b79e71f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b79d5850 0x5588b79b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b79b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 --2- 172.21.15.17:0/1119501040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b7988920 0x5588b79b7420 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 -- 172.21.15.17:0/1119501040 >> 172.21.15.17:0/1119501040 conn(0x5588b79b5ff0 msgr2=0x5588b7987ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10a6000640 0 client.6195 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 -- 172.21.15.17:0/1119501040 shutdown_connections 2024-09-10T23:19:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 1 -- 172.21.15.17:0/1119501040 wait complete. 2024-09-10T23:19:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.409+0000 7f10c287a000 20 client.6195 trim_cache size 0 max 16384 2024-09-10T23:19:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 Processor -- start 2024-09-10T23:19:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 -- start start 2024-09-10T23:19:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b79eaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d4f30 0x5588b79b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d5850 0x5588b79b7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8204400 con 0x5588b79d4f30 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8203400 con 0x5588b79d5850 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f10b81fb480 con 0x5588b7988920 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d4f30 0x5588b79b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d4f30 0x5588b79b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34128/0 (socket says 172.21.15.17:34128) 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10afe00640 1 -- 172.21.15.17:0/486248039 learned_addr learned my addr 172.21.15.17:0/486248039 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10bd400640 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d5850 0x5588b79b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10bca00640 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b79eaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10afe00640 1 -- 172.21.15.17:0/486248039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 msgr2=0x5588b79eaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10afe00640 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b79eaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10afe00640 1 -- 172.21.15.17:0/486248039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d5850 msgr2=0x5588b79b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10afe00640 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d5850 0x5588b79b7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10afe00640 1 -- 172.21.15.17:0/486248039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588b77741d0 con 0x5588b79d4f30 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10bd400640 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d5850 0x5588b79b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10afe00640 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d4f30 0x5588b79b73e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f10a0017000 tx=0x7f10a0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf9d36aad69abf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10acc00640 1 -- 172.21.15.17:0/486248039 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0005220 con 0x5588b79d4f30 2024-09-10T23:19:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10acc00640 1 -- 172.21.15.17:0/486248039 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10a00053c0 con 0x5588b79d4f30 2024-09-10T23:19:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10acc00640 1 -- 172.21.15.17:0/486248039 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00047b0 con 0x5588b79d4f30 2024-09-10T23:19:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 -- 172.21.15.17:0/486248039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d4f30 msgr2=0x5588b79b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d4f30 0x5588b79b73e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f10a0017000 tx=0x7f10a0004740 comp rx=0 tx=0).stop 2024-09-10T23:19:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 -- 172.21.15.17:0/486248039 shutdown_connections 2024-09-10T23:19:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d5850 0x5588b79b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d4f30 0x5588b79b73e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 --2- 172.21.15.17:0/486248039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b79eaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 -- 172.21.15.17:0/486248039 >> 172.21.15.17:0/486248039 conn(0x5588b79b5ff0 msgr2=0x5588b79e1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.425+0000 7f10c287a000 1 -- 172.21.15.17:0/486248039 shutdown_connections 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 -- 172.21.15.17:0/486248039 wait complete. 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 -- start start 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 Processor -- start 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b7a4af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b7a4b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b7a4b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5588b7993d70 con 0x5588b79d5850 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5588b77d9040 con 0x5588b79d4f30 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5588b77a1890 con 0x5588b7988920 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 10 client.0 _ll_register_callbacks cb 0x7f10a0005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b7a4b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b7a4b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34134/0 (socket says 172.21.15.17:34134) 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bd400640 1 -- 172.21.15.17:0/3100120623 learned_addr learned my addr 172.21.15.17:0/3100120623 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10afe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b7a4b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bca00640 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b7a4af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bd400640 1 -- 172.21.15.17:0/3100120623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 msgr2=0x5588b7a4af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bd400640 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b7a4af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bd400640 1 -- 172.21.15.17:0/3100120623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 msgr2=0x5588b7a4b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bd400640 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b7a4b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bd400640 1 -- 172.21.15.17:0/3100120623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588b779c970 con 0x5588b79d5850 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bd400640 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b7a4b9d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f10b005b230 tx=0x7f10b005d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4ccd6c1155063e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10a6000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10a6000640 1 -- 172.21.15.17:0/3100120623 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0063d80 con 0x5588b79d5850 2024-09-10T23:19:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10a6000640 1 -- 172.21.15.17:0/3100120623 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f10b0080cc0 con 0x5588b79d5850 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 -- 172.21.15.17:0/3100120623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a00053c0 con 0x5588b79d5850 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10a6000640 1 -- 172.21.15.17:0/3100120623 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10b005dfc0 con 0x5588b79d5850 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 10 client.6201 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 -- 172.21.15.17:0/3100120623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5588b776c560 con 0x5588b79d5850 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10a6000640 1 -- 172.21.15.17:0/3100120623 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10a00053c0 con 0x5588b79d5850 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10a6000640 1 -- 172.21.15.17:0/3100120623 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f10b0065ce0 con 0x5588b79d5850 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 10 client.6201 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 10 client.6201 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 20 client.6201 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5588b79e8470 0x5588b79e8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 4 client.6201 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10c287a000 1 -- 172.21.15.17:0/3100120623 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588b77e44f0 con 0x5588b79e8470 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.429+0000 7f10bca00640 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5588b79e8470 0x5588b79e8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bca00640 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5588b79e8470 0x5588b79e8880 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc6d783ffc315790 server_cookie=145619eb70275716 in_seq=0 out_seq=0 2024-09-10T23:19:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10a6000640 10 client.6201 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10a6000640 1 -- 172.21.15.17:0/3100120623 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x5588b77e44f0 con 0x5588b79e8470 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10a6000640 10 client.6201 handle_command_reply: tid=0 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 client.6201 shutdown 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 -- 172.21.15.17:0/3100120623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 msgr2=0x5588b7a4b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b7a4b9d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f10b005b230 tx=0x7f10b005d910 comp rx=0 tx=0).stop 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 -- 172.21.15.17:0/3100120623 shutdown_connections 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5588b79e8470 0x5588b79e8880 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588b79d5850 0x5588b7a4b9d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5588b79d4f30 0x5588b7a4b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10a6000640 0 client.6201 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:38.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 --2- 172.21.15.17:0/3100120623 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5588b7988920 0x5588b7a4af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 -- 172.21.15.17:0/3100120623 >> 172.21.15.17:0/3100120623 conn(0x5588b79b5ff0 msgr2=0x5588b79d2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 -- 172.21.15.17:0/3100120623 shutdown_connections 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 1 -- 172.21.15.17:0/3100120623 wait complete. 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10c287a000 20 client.6201 trim_cache size 0 max 16384 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 3682746104, 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511630411, 2024-09-10T23:19:38.442 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-09-10T23:19:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:38.443 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:19:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 -- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10940725e0 msgr2=0x7f1094074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10940725e0 0x7f1094074aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f10a80af000 tx=0x7f10a801b120 comp rx=0 tx=0).stop 2024-09-10T23:19:38.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 -- 172.21.15.17:0/2311042289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10b80d46d0 msgr2=0x7f10b815c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10b80d46d0 0x7f10b815c6a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f10b000c7d0 tx=0x7f10b000cc90 comp rx=0 tx=0).stop 2024-09-10T23:19:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 -- 172.21.15.17:0/2311042289 shutdown_connections 2024-09-10T23:19:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10940725e0 0x7f1094074aa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10b80d46d0 0x7f10b815c6a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10b80d2640 0x7f10b81f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 --2- 172.21.15.17:0/2311042289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10b80d2260 0x7f10b8158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 -- 172.21.15.17:0/2311042289 >> 172.21.15.17:0/2311042289 conn(0x7f10b809d0f0 msgr2=0x7f10b806ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 -- 172.21.15.17:0/2311042289 shutdown_connections 2024-09-10T23:19:38.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.433+0000 7f10bde00640 1 -- 172.21.15.17:0/2311042289 wait complete. 2024-09-10T23:19:38.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:38.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.597+0000 7f7c2f600640 1 -- 172.21.15.17:0/4108849873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280b48f0 msgr2=0x7f7c2815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.597+0000 7f7c2f600640 1 --2- 172.21.15.17:0/4108849873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280b48f0 0x7f7c2815cbd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009900 tx=0x7f7c1401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.597+0000 7f7c2f600640 1 -- 172.21.15.17:0/4108849873 shutdown_connections 2024-09-10T23:19:38.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.597+0000 7f7c2f600640 1 --2- 172.21.15.17:0/4108849873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280b48f0 0x7f7c2815cbd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.597+0000 7f7c2f600640 1 --2- 172.21.15.17:0/4108849873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280cf4f0 0x7f7c280b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.597+0000 7f7c2f600640 1 -- 172.21.15.17:0/4108849873 >> 172.21.15.17:0/4108849873 conn(0x7f7c2806cfc0 msgr2=0x7f7c2806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.597+0000 7f7c2f600640 1 -- 172.21.15.17:0/4108849873 shutdown_connections 2024-09-10T23:19:38.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.597+0000 7f7c2f600640 1 -- 172.21.15.17:0/4108849873 wait complete. 2024-09-10T23:19:38.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 Processor -- start 2024-09-10T23:19:38.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 -- start start 2024-09-10T23:19:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c280b48f0 0x7f7c28153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280cf4f0 0x7f7c281497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280cff20 0x7f7c28145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28168b20 con 0x7f7c280cf4f0 2024-09-10T23:19:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281689a0 con 0x7f7c280b48f0 2024-09-10T23:19:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c28168ca0 con 0x7f7c280cff20 2024-09-10T23:19:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c27e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280cf4f0 0x7f7c281497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c27e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280cf4f0 0x7f7c281497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34146/0 (socket says 172.21.15.17:34146) 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c27e00640 1 -- 172.21.15.17:0/1825251806 learned_addr learned my addr 172.21.15.17:0/1825251806 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2cc00640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c280b48f0 0x7f7c28153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2d600640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280cff20 0x7f7c28145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c27e00640 1 -- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280cff20 msgr2=0x7f7c28145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c27e00640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280cff20 0x7f7c28145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c27e00640 1 -- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c280b48f0 msgr2=0x7f7c28153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c27e00640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c280b48f0 0x7f7c28153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c27e00640 1 -- 172.21.15.17:0/1825251806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c28149e80 con 0x7f7c280cf4f0 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c27e00640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280cf4f0 0x7f7c281497a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009850 tx=0x7f7c14004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c24c00640 1 -- 172.21.15.17:0/1825251806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140b2040 con 0x7f7c280cf4f0 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c24c00640 1 -- 172.21.15.17:0/1825251806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c14005070 con 0x7f7c280cf4f0 2024-09-10T23:19:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c24c00640 1 -- 172.21.15.17:0/1825251806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140044f0 con 0x7f7c280cf4f0 2024-09-10T23:19:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c28151a10 con 0x7f7c280cf4f0 2024-09-10T23:19:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.601+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c28073230 con 0x7f7c280cf4f0 2024-09-10T23:19:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.605+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2815cbd0 con 0x7f7c280cf4f0 2024-09-10T23:19:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.605+0000 7f7c24c00640 1 -- 172.21.15.17:0/1825251806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7c14005480 con 0x7f7c280cf4f0 2024-09-10T23:19:38.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.605+0000 7f7c24c00640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c080725e0 0x7f7c08074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:38.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.605+0000 7f7c24c00640 1 -- 172.21.15.17:0/1825251806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f7c1412cf20 con 0x7f7c280cf4f0 2024-09-10T23:19:38.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.605+0000 7f7c2cc00640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c080725e0 0x7f7c08074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:38.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.605+0000 7f7c2cc00640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c080725e0 0x7f7c08074aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00bc00 tx=0x7f7c1c00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:38.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.609+0000 7f7c24c00640 1 -- 172.21.15.17:0/1825251806 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7c140164d0 con 0x7f7c280cf4f0 2024-09-10T23:19:38.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.821+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c2815bb60 con 0x7f7c280cf4f0 2024-09-10T23:19:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.821+0000 7f7c24c00640 1 -- 172.21.15.17:0/1825251806 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5224 (secure 0 0 0) 0x7f7c140f8430 con 0x7f7c280cf4f0 2024-09-10T23:19:38.826 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:38.826 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-10T23:19:32:803927+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1801943144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1801943144},{"type":"v1","addr":"172.21.15.77:6837","nonce":1801943144}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2387800472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2387800472},{"type":"v1","addr":"172.21.15.77:6835","nonce":2387800472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1881542084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1881542084},{"type":"v1","addr":"172.21.15.17:6835","nonce":1881542084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:55.490263+0000","modified":"2024-09-10T23:19:32.118506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5475},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5475":{"gid":5475,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.17:6834/1323392007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1323392007},{"type":"v1","addr":"172.21.15.17:6834","nonce":1323392007}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5475,"qdb_cluster":[5475]},"id":3}]} 2024-09-10T23:19:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-10T23:19:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c080725e0 msgr2=0x7f7c08074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c080725e0 0x7f7c08074aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00bc00 tx=0x7f7c1c00b390 comp rx=0 tx=0).stop 2024-09-10T23:19:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280cf4f0 msgr2=0x7f7c281497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280cf4f0 0x7f7c281497a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009850 tx=0x7f7c14004040 comp rx=0 tx=0).stop 2024-09-10T23:19:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 shutdown_connections 2024-09-10T23:19:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c080725e0 0x7f7c08074aa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c280cff20 0x7f7c28145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c280cf4f0 0x7f7c281497a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 --2- 172.21.15.17:0/1825251806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c280b48f0 0x7f7c28153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:38.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 >> 172.21.15.17:0/1825251806 conn(0x7f7c2806cfc0 msgr2=0x7f7c280afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:38.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 shutdown_connections 2024-09-10T23:19:38.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.825+0000 7f7c2f600640 1 -- 172.21.15.17:0/1825251806 wait complete. 2024-09-10T23:19:38.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 3682746104 2024-09-10T23:19:38.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.993+0000 7f7c5c400640 1 -- 172.21.15.17:0/1613440912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c540d23e0 msgr2=0x7f7c54071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.993+0000 7f7c5c400640 1 --2- 172.21.15.17:0/1613440912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c540d23e0 0x7f7c54071670 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009870 tx=0x7f7c4001c780 comp rx=0 tx=0).stop 2024-09-10T23:19:39.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.993+0000 7f7c5c400640 1 -- 172.21.15.17:0/1613440912 shutdown_connections 2024-09-10T23:19:39.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.993+0000 7f7c5c400640 1 --2- 172.21.15.17:0/1613440912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c540d23e0 0x7f7c54071670 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.993+0000 7f7c5c400640 1 -- 172.21.15.17:0/1613440912 >> 172.21.15.17:0/1613440912 conn(0x7f7c5409a9f0 msgr2=0x7f7c5409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.993+0000 7f7c5c400640 1 -- 172.21.15.17:0/1613440912 shutdown_connections 2024-09-10T23:19:39.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.993+0000 7f7c5c400640 1 -- 172.21.15.17:0/1613440912 wait complete. 2024-09-10T23:19:39.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 Processor -- start 2024-09-10T23:19:39.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 -- start start 2024-09-10T23:19:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54071bb0 0x7f7c541672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c540d23e0 0x7f7c5415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5415be20 0x7f7c54151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c54169e30 con 0x7f7c54071bb0 2024-09-10T23:19:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c54169cb0 con 0x7f7c540d23e0 2024-09-10T23:19:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c54169fb0 con 0x7f7c5415be20 2024-09-10T23:19:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54071bb0 0x7f7c541672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54071bb0 0x7f7c541672d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34150/0 (socket says 172.21.15.17:34150) 2024-09-10T23:19:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59a00640 1 -- 172.21.15.17:0/3480590655 learned_addr learned my addr 172.21.15.17:0/3480590655 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5a400640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5415be20 0x7f7c54151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59a00640 1 -- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5415be20 msgr2=0x7f7c54151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59a00640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5415be20 0x7f7c54151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59a00640 1 -- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c540d23e0 msgr2=0x7f7c5415cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59000640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c540d23e0 0x7f7c5415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59a00640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c540d23e0 0x7f7c5415cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59a00640 1 -- 172.21.15.17:0/3480590655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c54151b50 con 0x7f7c54071bb0 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59000640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c540d23e0 0x7f7c5415cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c59a00640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54071bb0 0x7f7c541672d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c400 tx=0x7f7c4800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c51600640 1 -- 172.21.15.17:0/3480590655 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48017070 con 0x7f7c54071bb0 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c51600640 1 -- 172.21.15.17:0/3480590655 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c48005400 con 0x7f7c54071bb0 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 -- 172.21.15.17:0/3480590655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5406e4e0 con 0x7f7c54071bb0 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c51600640 1 -- 172.21.15.17:0/3480590655 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48003860 con 0x7f7c54071bb0 2024-09-10T23:19:39.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:38.997+0000 7f7c5c400640 1 -- 172.21.15.17:0/3480590655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5406e780 con 0x7f7c54071bb0 2024-09-10T23:19:39.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c51600640 1 -- 172.21.15.17:0/3480590655 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7c48003a00 con 0x7f7c54071bb0 2024-09-10T23:19:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c51600640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c340725e0 0x7f7c34074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c51600640 1 -- 172.21.15.17:0/3480590655 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f7c48092b60 con 0x7f7c54071bb0 2024-09-10T23:19:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c5f812000 1 Processor -- start 2024-09-10T23:19:39.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c5f812000 1 -- start start 2024-09-10T23:19:39.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c59000640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c340725e0 0x7f7c34074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c59000640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c340725e0 0x7f7c34074aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7c400af000 tx=0x7f7c4001afc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f55464d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f55417da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f554186c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c5f812000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563f55301a80 con 0x563f55464970 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c5f812000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563f55276c90 con 0x563f55465290 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c5f812000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563f552660c0 con 0x563f554182e0 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c59a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f55464d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c59a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f55464d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34154/0 (socket says 172.21.15.17:34154) 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c59a00640 1 -- 172.21.15.17:0/1735830587 learned_addr learned my addr 172.21.15.17:0/1735830587 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c59000640 1 --2- 172.21.15.17:0/1735830587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f55417da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.001+0000 7f7c5a400640 1 --2- 172.21.15.17:0/1735830587 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f554186c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 -- 172.21.15.17:0/1735830587 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 msgr2=0x563f554186c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 --2- 172.21.15.17:0/1735830587 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f554186c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 -- 172.21.15.17:0/1735830587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 msgr2=0x563f55417da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 --2- 172.21.15.17:0/1735830587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f55417da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 -- 172.21.15.17:0/1735830587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f5520a350 con 0x563f55464970 2024-09-10T23:19:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 --2- 172.21.15.17:0/1735830587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f55464d50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7c4805d690 tx=0x7f7c4805d230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5dc0c2f6bee7bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c46000640 1 -- 172.21.15.17:0/1735830587 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48066de0 con 0x563f55464970 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c46000640 1 -- 172.21.15.17:0/1735830587 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c48062070 con 0x563f55464970 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c46000640 1 -- 172.21.15.17:0/1735830587 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4805cdf0 con 0x563f55464970 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 -- 172.21.15.17:0/1735830587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 msgr2=0x563f55464d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1735830587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f55464d50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7c4805d690 tx=0x7f7c4805d230 comp rx=0 tx=0).stop 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 -- 172.21.15.17:0/1735830587 shutdown_connections 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1735830587 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f554186c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1735830587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f55417da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1735830587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f55464d50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 -- 172.21.15.17:0/1735830587 >> 172.21.15.17:0/1735830587 conn(0x563f55445780 msgr2=0x563f55447ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 -- 172.21.15.17:0/1735830587 shutdown_connections 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 -- 172.21.15.17:0/1735830587 wait complete. 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 -- start start 2024-09-10T23:19:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 Processor -- start 2024-09-10T23:19:39.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f554182e0 0x563f5546b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f55464970 0x563f5546be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563f552ea600 con 0x563f554182e0 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563f553251e0 con 0x563f55465290 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563f5520fb10 con 0x563f55464970 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5f812000 10 client.0 _ll_register_callbacks cb 0x563f55405c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f554182e0 0x563f5546b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f554182e0 0x563f5546b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34156/0 (socket says 172.21.15.17:34156) 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 -- 172.21.15.17:0/1501762573 learned_addr learned my addr 172.21.15.17:0/1501762573 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59000640 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f55464970 0x563f5546be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c5a400640 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 -- 172.21.15.17:0/1501762573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f55464970 msgr2=0x563f5546be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.005+0000 7f7c59a00640 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f55464970 0x563f5546be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c59a00640 1 -- 172.21.15.17:0/1501762573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 msgr2=0x563f5546c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c59a00640 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c59a00640 1 -- 172.21.15.17:0/1501762573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f55204260 con 0x563f554182e0 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5a400640 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c59a00640 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f554182e0 0x563f5546b8e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800cdc0 tx=0x7f7c480624f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac75de08aab3460c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 1 -- 172.21.15.17:0/1501762573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4808e060 con 0x563f554182e0 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 -- 172.21.15.17:0/1501762573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f551fe1e0 con 0x563f554182e0 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 1 -- 172.21.15.17:0/1501762573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f7c4805cdf0 con 0x563f554182e0 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 1 -- 172.21.15.17:0/1501762573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7c48066de0 con 0x563f554182e0 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 10 client.6222 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 -- 172.21.15.17:0/1501762573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x563f5522fac0 con 0x563f554182e0 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 1 -- 172.21.15.17:0/1501762573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563f551fe1e0 con 0x563f554182e0 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 1 -- 172.21.15.17:0/1501762573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f7c480592e0 con 0x563f554182e0 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 10 client.6222 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 10 client.6222 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 20 client.6222 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563f55473cb0 0x563f554760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 4 client.6222 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 -- 172.21.15.17:0/1501762573 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f55278be0 con 0x563f55473cb0 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c59000640 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563f55473cb0 0x563f554760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c59000640 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563f55473cb0 0x563f554760a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d0e244a62abef8 server_cookie=6d784b09332d0422 in_seq=0 out_seq=0 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 10 client.6222 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 1 -- 172.21.15.17:0/1501762573 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f55278be0 con 0x563f55473cb0 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 10 client.6222 handle_command_reply: tid=0 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 client.6222 shutdown 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 -- 172.21.15.17:0/1501762573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f554182e0 msgr2=0x563f5546b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f554182e0 0x563f5546b8e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800cdc0 tx=0x7f7c480624f0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 -- 172.21.15.17:0/1501762573 shutdown_connections 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563f55473cb0 0x563f554760a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f55464970 0x563f5546be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 --2- 172.21.15.17:0/1501762573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f554182e0 0x563f5546b8e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 -- 172.21.15.17:0/1501762573 >> 172.21.15.17:0/1501762573 conn(0x563f55445780 msgr2=0x563f554174a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c3aa00640 0 client.6222 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:39.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 -- 172.21.15.17:0/1501762573 shutdown_connections 2024-09-10T23:19:39.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 1 -- 172.21.15.17:0/1501762573 wait complete. 2024-09-10T23:19:39.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.009+0000 7f7c5f812000 20 client.6222 trim_cache size 0 max 16384 2024-09-10T23:19:39.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5f812000 1 Processor -- start 2024-09-10T23:19:39.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5f812000 1 -- start start 2024-09-10T23:19:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f55416c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554171c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5f812000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c54203440 con 0x563f55464970 2024-09-10T23:19:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5f812000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5406fbb0 con 0x563f55465290 2024-09-10T23:19:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5f812000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c54153a00 con 0x563f554182e0 2024-09-10T23:19:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554171c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34162/0 (socket says 172.21.15.17:34162) 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59000640 1 -- 172.21.15.17:0/592821205 learned_addr learned my addr 172.21.15.17:0/592821205 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59a00640 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f55416c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5a400640 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59000640 1 -- 172.21.15.17:0/592821205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 msgr2=0x563f55416c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59000640 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f55416c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59000640 1 -- 172.21.15.17:0/592821205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 msgr2=0x563f5546d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59000640 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59000640 1 -- 172.21.15.17:0/592821205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f552eaa90 con 0x563f55464970 2024-09-10T23:19:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c5a400640 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c59000640 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554171c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009870 tx=0x7f7c400bb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d733a48722221141 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c45600640 1 -- 172.21.15.17:0/592821205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c400c1040 con 0x563f55464970 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c45600640 1 -- 172.21.15.17:0/592821205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c400d5070 con 0x563f55464970 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.025+0000 7f7c45600640 1 -- 172.21.15.17:0/592821205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40004b20 con 0x563f55464970 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- 172.21.15.17:0/592821205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 msgr2=0x563f554171c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554171c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009870 tx=0x7f7c400bb000 comp rx=0 tx=0).stop 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- 172.21.15.17:0/592821205 shutdown_connections 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f5546d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554171c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 --2- 172.21.15.17:0/592821205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f55416c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- 172.21.15.17:0/592821205 >> 172.21.15.17:0/592821205 conn(0x563f55445780 msgr2=0x563f55416570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- 172.21.15.17:0/592821205 shutdown_connections 2024-09-10T23:19:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- 172.21.15.17:0/592821205 wait complete. 2024-09-10T23:19:39.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- start start 2024-09-10T23:19:39.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 Processor -- start 2024-09-10T23:19:39.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f554db020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554db560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f554dbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563f55275a60 con 0x563f55464970 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563f5520ab10 con 0x563f55465290 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563f552691e0 con 0x563f554182e0 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 10 client.0 _ll_register_callbacks cb 0x7f7c48081070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554db560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554db560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34178/0 (socket says 172.21.15.17:34178) 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59000640 1 -- 172.21.15.17:0/2436182768 learned_addr learned my addr 172.21.15.17:0/2436182768 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59a00640 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f554db020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5a400640 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f554dbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59000640 1 -- 172.21.15.17:0/2436182768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 msgr2=0x563f554db020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59000640 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f554db020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59000640 1 -- 172.21.15.17:0/2436182768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 msgr2=0x563f554dbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59000640 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f554dbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59000640 1 -- 172.21.15.17:0/2436182768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f5520b330 con 0x563f55464970 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5a400640 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f554dbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c59000640 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554db560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7c400d2040 tx=0x7f7c400045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2159f4a72c32d2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c3aa00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c3aa00640 1 -- 172.21.15.17:0/2436182768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c400c1050 con 0x563f55464970 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c3aa00640 1 -- 172.21.15.17:0/2436182768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f7c40004b20 con 0x563f55464970 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- 172.21.15.17:0/2436182768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c400d5070 con 0x563f55464970 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c3aa00640 1 -- 172.21.15.17:0/2436182768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7c40004d60 con 0x563f55464970 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 10 client.6228 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.029+0000 7f7c5f812000 1 -- 172.21.15.17:0/2436182768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x563f5522ecb0 con 0x563f55464970 2024-09-10T23:19:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c3aa00640 1 -- 172.21.15.17:0/2436182768 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c400d5070 con 0x563f55464970 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c3aa00640 1 -- 172.21.15.17:0/2436182768 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f7c400c7040 con 0x563f55464970 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 10 client.6228 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 10 client.6228 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 20 client.6228 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563f55470f40 0x563f55471320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 4 client.6228 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3682746104}] 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 -- 172.21.15.17:0/2436182768 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3682746104}) -- 0x563f5547c3c0 con 0x563f55470f40 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c59a00640 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563f55470f40 0x563f55471320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c59a00640 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563f55470f40 0x563f55471320 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34a1c1667cba146a server_cookie=655324d455e2d175 in_seq=0 out_seq=0 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c3aa00640 10 client.6228 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c3aa00640 1 -- 172.21.15.17:0/2436182768 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x563f5547c3c0 con 0x563f55470f40 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c3aa00640 10 client.6228 handle_command_reply: tid=0 2024-09-10T23:19:39.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 client.6228 shutdown 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 -- 172.21.15.17:0/2436182768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 msgr2=0x563f554db560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554db560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7c400d2040 tx=0x7f7c400045d0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 -- 172.21.15.17:0/2436182768 shutdown_connections 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x563f55470f40 0x563f55471320 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563f55465290 0x563f554dbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563f55464970 0x563f554db560 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 --2- 172.21.15.17:0/2436182768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563f554182e0 0x563f554db020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c3aa00640 0 client.6228 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 -- 172.21.15.17:0/2436182768 >> 172.21.15.17:0/2436182768 conn(0x563f55445780 msgr2=0x563f55416d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 -- 172.21.15.17:0/2436182768 shutdown_connections 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 1 -- 172.21.15.17:0/2436182768 wait complete. 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5f812000 20 client.6228 trim_cache size 0 max 16384 2024-09-10T23:19:39.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 -- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c340725e0 msgr2=0x7f7c34074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c340725e0 0x7f7c34074aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7c400af000 tx=0x7f7c4001afc0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 -- 172.21.15.17:0/3480590655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54071bb0 msgr2=0x7f7c541672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54071bb0 0x7f7c541672d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c400 tx=0x7f7c4800c8c0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 -- 172.21.15.17:0/3480590655 shutdown_connections 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c340725e0 0x7f7c34074aa0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c5415be20 0x7f7c54151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c540d23e0 0x7f7c5415cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 --2- 172.21.15.17:0/3480590655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c54071bb0 0x7f7c541672d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 -- 172.21.15.17:0/3480590655 >> 172.21.15.17:0/3480590655 conn(0x7f7c5409a9f0 msgr2=0x7f7c540af290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 -- 172.21.15.17:0/3480590655 shutdown_connections 2024-09-10T23:19:39.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.033+0000 7f7c5c400640 1 -- 172.21.15.17:0/3480590655 wait complete. 2024-09-10T23:19:39.057 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-10T23:19:39.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-10T23:19:39.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 -- 172.21.15.17:0/2264339701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d8073b30 msgr2=0x7fa8d80b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 --2- 172.21.15.17:0/2264339701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d8073b30 0x7fa8d80b48a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009840 tx=0x7fa8c001c6b0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 -- 172.21.15.17:0/2264339701 shutdown_connections 2024-09-10T23:19:39.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 --2- 172.21.15.17:0/2264339701 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d80b4de0 0x7fa8d806ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 --2- 172.21.15.17:0/2264339701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d8073b30 0x7fa8d80b48a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 -- 172.21.15.17:0/2264339701 >> 172.21.15.17:0/2264339701 conn(0x7fa8d80b1b00 msgr2=0x7fa8d80b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 -- 172.21.15.17:0/2264339701 shutdown_connections 2024-09-10T23:19:39.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 -- 172.21.15.17:0/2264339701 wait complete. 2024-09-10T23:19:39.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 Processor -- start 2024-09-10T23:19:39.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.201+0000 7fa8dd400640 1 -- start start 2024-09-10T23:19:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8dd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8d8073b30 0x7fa8d8160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8dd400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d80b4de0 0x7fa8d8159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8dd400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d815eb90 0x7fa8d815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8dd400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8167b20 con 0x7fa8d8073b30 2024-09-10T23:19:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8dd400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d81679a0 con 0x7fa8d80b4de0 2024-09-10T23:19:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8dd400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d8167ca0 con 0x7fa8d815eb90 2024-09-10T23:19:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8d8073b30 0x7fa8d8160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8d8073b30 0x7fa8d8160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34180/0 (socket says 172.21.15.17:34180) 2024-09-10T23:19:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d6800640 1 -- 172.21.15.17:0/2289849438 learned_addr learned my addr 172.21.15.17:0/2289849438 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d7200640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d815eb90 0x7fa8d815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d80b4de0 0x7fa8d8159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d6800640 1 -- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d815eb90 msgr2=0x7fa8d815a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d6800640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d815eb90 0x7fa8d815a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d6800640 1 -- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d80b4de0 msgr2=0x7fa8d8159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d6800640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d80b4de0 0x7fa8d8159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d6800640 1 -- 172.21.15.17:0/2289849438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d8153720 con 0x7fa8d8073b30 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8d6800640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8d8073b30 0x7fa8d8160140 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c6e0 tx=0x7fa8c800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8cea00640 1 -- 172.21.15.17:0/2289849438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8016020 con 0x7fa8d8073b30 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8cea00640 1 -- 172.21.15.17:0/2289849438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8c800a930 con 0x7fa8d8073b30 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8dd400640 1 -- 172.21.15.17:0/2289849438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d8153a00 con 0x7fa8d8073b30 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8cea00640 1 -- 172.21.15.17:0/2289849438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800ad80 con 0x7fa8d8073b30 2024-09-10T23:19:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.205+0000 7fa8dd400640 1 -- 172.21.15.17:0/2289849438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d8153fc0 con 0x7fa8d8073b30 2024-09-10T23:19:39.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8cea00640 1 -- 172.21.15.17:0/2289849438 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa8c8012420 con 0x7fa8d8073b30 2024-09-10T23:19:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8cea00640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8b40725e0 0x7fa8b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8cea00640 1 -- 172.21.15.17:0/2289849438 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fa8c80937e0 con 0x7fa8d8073b30 2024-09-10T23:19:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8e08cf000 1 Processor -- start 2024-09-10T23:19:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8e08cf000 1 -- start start 2024-09-10T23:19:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8b40725e0 0x7fa8b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee6e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 0x5568ee6e7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5568ee542c20 con 0x5568ee731a10 2024-09-10T23:19:39.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5568ee532050 con 0x5568ee7310f0 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5568ee535e60 con 0x5568ee6e79f0 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee6e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d6800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 0x5568ee6e7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee6e74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34196/0 (socket says 172.21.15.17:34196) 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8cfe00640 1 -- 172.21.15.17:0/3332797427 learned_addr learned my addr 172.21.15.17:0/3332797427 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d6800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7314d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:60474/0 (socket says 172.21.15.17:60474) 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 0x5568ee6e7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:48408/0 (socket says 172.21.15.17:48408) 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8b40725e0 0x7fa8b4074aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00af000 tx=0x7fa8c001aef0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d6800640 1 -- 172.21.15.17:0/3332797427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 msgr2=0x5568ee6e7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d6800640 1 --2- 172.21.15.17:0/3332797427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 0x5568ee6e7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d6800640 1 -- 172.21.15.17:0/3332797427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 msgr2=0x5568ee6e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d6800640 1 --2- 172.21.15.17:0/3332797427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee6e74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d6800640 1 -- 172.21.15.17:0/3332797427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ee4b2770 con 0x5568ee7310f0 2024-09-10T23:19:39.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/3332797427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee6e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:39.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8d6800640 1 --2- 172.21.15.17:0/3332797427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7314d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8091c30 tx=0x7fa8c805e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2b3770fddd00d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8c7400640 1 -- 172.21.15.17:0/3332797427 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c805e690 con 0x5568ee7310f0 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8c7400640 1 -- 172.21.15.17:0/3332797427 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8c8075070 con 0x5568ee7310f0 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.209+0000 7fa8c7400640 1 -- 172.21.15.17:0/3332797427 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c807fdb0 con 0x5568ee7310f0 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3332797427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 msgr2=0x5568ee7314d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/3332797427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7314d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8091c30 tx=0x7fa8c805e0e0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3332797427 shutdown_connections 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/3332797427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 0x5568ee6e7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/3332797427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee6e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/3332797427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7314d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3332797427 >> 172.21.15.17:0/3332797427 conn(0x5568ee5cf630 msgr2=0x5568ee6ee470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3332797427 shutdown_connections 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3332797427 wait complete. 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- start start 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 Processor -- start 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee6e79f0 0x5568ee6ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee6ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee731a10 0x5568ee6f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5568ee4d7560 con 0x5568ee6e79f0 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5568ee4e79e0 con 0x5568ee7310f0 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5568ee5eca00 con 0x5568ee731a10 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 10 client.0 _ll_register_callbacks cb 0x5568ee6d3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee6e79f0 0x5568ee6ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee6e79f0 0x5568ee6ecb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34212/0 (socket says 172.21.15.17:34212) 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d6800640 1 -- 172.21.15.17:0/655053175 learned_addr learned my addr 172.21.15.17:0/655053175 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee6ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d7200640 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee731a10 0x5568ee6f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d6800640 1 -- 172.21.15.17:0/655053175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee731a10 msgr2=0x5568ee6f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d6800640 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee731a10 0x5568ee6f2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d6800640 1 -- 172.21.15.17:0/655053175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 msgr2=0x5568ee6ed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d6800640 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee6ed0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d6800640 1 -- 172.21.15.17:0/655053175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ee4edf40 con 0x5568ee6e79f0 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d7200640 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee731a10 0x5568ee6f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8d6800640 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee6e79f0 0x5568ee6ecb90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8091be0 tx=0x7fa8c805eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd250a9ba125b44d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8bbe00640 1 -- 172.21.15.17:0/655053175 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c807fd50 con 0x5568ee6e79f0 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- 172.21.15.17:0/655053175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5568ee4ca370 con 0x5568ee6e79f0 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8bbe00640 1 -- 172.21.15.17:0/655053175 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fa8c805d8f0 con 0x5568ee6e79f0 2024-09-10T23:19:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8bbe00640 1 -- 172.21.15.17:0/655053175 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa8c8067b90 con 0x5568ee6e79f0 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 10 client.6240 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8e08cf000 1 -- 172.21.15.17:0/655053175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5568ee4d0230 con 0x5568ee6e79f0 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.213+0000 7fa8bbe00640 1 -- 172.21.15.17:0/655053175 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5568ee4ca370 con 0x5568ee6e79f0 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8bbe00640 1 -- 172.21.15.17:0/655053175 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7fa8c8065360 con 0x5568ee6e79f0 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 10 client.6240 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 10 client.6240 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 20 client.6240 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5568ee6f36b0 0x5568ee7423a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 4 client.6240 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 -- 172.21.15.17:0/655053175 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568ee544b70 con 0x5568ee6f36b0 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5568ee6f36b0 0x5568ee7423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5568ee6f36b0 0x5568ee7423a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45f36f0eca33d40a server_cookie=609811143cb3d71b in_seq=0 out_seq=0 2024-09-10T23:19:39.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8bbe00640 10 client.6240 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8bbe00640 1 -- 172.21.15.17:0/655053175 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568ee544b70 con 0x5568ee6f36b0 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8bbe00640 10 client.6240 handle_command_reply: tid=0 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 client.6240 shutdown 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 -- 172.21.15.17:0/655053175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee6e79f0 msgr2=0x5568ee6ecb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee6e79f0 0x5568ee6ecb90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8091be0 tx=0x7fa8c805eed0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 -- 172.21.15.17:0/655053175 shutdown_connections 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5568ee6f36b0 0x5568ee7423a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee731a10 0x5568ee6f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee6ed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8bbe00640 0 client.6240 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/655053175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee6e79f0 0x5568ee6ecb90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 -- 172.21.15.17:0/655053175 >> 172.21.15.17:0/655053175 conn(0x5568ee5cf630 msgr2=0x5568ee6e64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 -- 172.21.15.17:0/655053175 shutdown_connections 2024-09-10T23:19:39.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 1 -- 172.21.15.17:0/655053175 wait complete. 2024-09-10T23:19:39.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.217+0000 7fa8e08cf000 20 client.6240 trim_cache size 0 max 16384 2024-09-10T23:19:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8e08cf000 1 Processor -- start 2024-09-10T23:19:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8e08cf000 1 -- start start 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee6e79f0 0x5568ee6ec630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee7310f0 0x5568ee6ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7433b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d82033e0 con 0x5568ee731a10 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8202740 con 0x5568ee6e79f0 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d8202d90 con 0x5568ee7310f0 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34228/0 (socket says 172.21.15.17:34228) 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d7200640 1 -- 172.21.15.17:0/3281108690 learned_addr learned my addr 172.21.15.17:0/3281108690 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d6800640 1 --2- 172.21.15.17:0/3281108690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee6e79f0 0x5568ee6ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/3281108690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee7310f0 0x5568ee6ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d7200640 1 -- 172.21.15.17:0/3281108690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee7310f0 msgr2=0x5568ee6ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d7200640 1 --2- 172.21.15.17:0/3281108690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee7310f0 0x5568ee6ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d7200640 1 -- 172.21.15.17:0/3281108690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee6e79f0 msgr2=0x5568ee6ec630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d7200640 1 --2- 172.21.15.17:0/3281108690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee6e79f0 0x5568ee6ec630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d7200640 1 -- 172.21.15.17:0/3281108690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ee731840 con 0x5568ee731a10 2024-09-10T23:19:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8d7200640 1 --2- 172.21.15.17:0/3281108690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7433b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00114c0 tx=0x7fa8d0011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5ad4298ad6897 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8c6a00640 1 -- 172.21.15.17:0/3281108690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0020070 con 0x5568ee731a10 2024-09-10T23:19:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8c6a00640 1 -- 172.21.15.17:0/3281108690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8d00106f0 con 0x5568ee731a10 2024-09-10T23:19:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.233+0000 7fa8c6a00640 1 -- 172.21.15.17:0/3281108690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0010b40 con 0x5568ee731a10 2024-09-10T23:19:39.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3281108690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 msgr2=0x5568ee7433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/3281108690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7433b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00114c0 tx=0x7fa8d0011980 comp rx=0 tx=0).stop 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3281108690 shutdown_connections 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/3281108690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7433b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/3281108690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee7310f0 0x5568ee6ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/3281108690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee6e79f0 0x5568ee6ec630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3281108690 >> 172.21.15.17:0/3281108690 conn(0x5568ee5cf630 msgr2=0x5568ee6ebf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3281108690 shutdown_connections 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- 172.21.15.17:0/3281108690 wait complete. 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- start start 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 Processor -- start 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 0x5568ee7a7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7a7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5568ee4e6cf0 con 0x5568ee731a10 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5568ee4dd0b0 con 0x5568ee7310f0 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5568ee535170 con 0x5568ee6e79f0 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 10 client.0 _ll_register_callbacks cb 0x7fa8c8082070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7a7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34242/0 (socket says 172.21.15.17:34242) 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d7200640 1 -- 172.21.15.17:0/761985338 learned_addr learned my addr 172.21.15.17:0/761985338 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d6800640 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 0x5568ee7a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7a7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d7200640 1 -- 172.21.15.17:0/761985338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 msgr2=0x5568ee7a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d7200640 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 0x5568ee7a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d7200640 1 -- 172.21.15.17:0/761985338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 msgr2=0x5568ee7a7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d7200640 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7a7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d7200640 1 -- 172.21.15.17:0/761985338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ee4e8430 con 0x5568ee731a10 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8cfe00640 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7a7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8d7200640 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7a7da0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0010e90 tx=0x7fa8d0010ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33ab0c1b76dd7a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8bbe00640 1 -- 172.21.15.17:0/761985338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0029070 con 0x5568ee731a10 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8bbe00640 1 -- 172.21.15.17:0/761985338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fa8d0003980 con 0x5568ee731a10 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- 172.21.15.17:0/761985338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8d00106f0 con 0x5568ee731a10 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8bbe00640 1 -- 172.21.15.17:0/761985338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa8d0031050 con 0x5568ee731a10 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 10 client.6246 fetch_fsmap learned FSMap version 31 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.237+0000 7fa8e08cf000 1 -- 172.21.15.17:0/761985338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5568ee5b7e40 con 0x5568ee731a10 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8bbe00640 1 -- 172.21.15.17:0/761985338 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8d00106f0 con 0x5568ee731a10 2024-09-10T23:19:39.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8bbe00640 1 -- 172.21.15.17:0/761985338 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7fa8d002c030 con 0x5568ee731a10 2024-09-10T23:19:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 10 client.6246 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T23:19:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 10 client.6246 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T23:19:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 20 client.6246 populate_metadata read hostname 'smithi017' 2024-09-10T23:19:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5568ee746410 0x5568ee746820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 4 client.6246 mds_command: new command op to 5475 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-10T23:19:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 -- 172.21.15.17:0/761985338 --> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x5568ee540620 con 0x5568ee746410 2024-09-10T23:19:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8d6800640 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5568ee746410 0x5568ee746820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8d6800640 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5568ee746410 0x5568ee746820 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e96e0e90cb5e79f server_cookie=bc73c2b6b61cbc65 in_seq=0 out_seq=0 2024-09-10T23:19:39.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8bbe00640 10 client.6246 ms_handle_connect on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8bbe00640 1 -- 172.21.15.17:0/761985338 <== mds.0 v2:172.21.15.17:6832/1323392007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568ee540620 con 0x5568ee746410 2024-09-10T23:19:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8bbe00640 10 client.6246 handle_command_reply: tid=0 2024-09-10T23:19:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 client.6246 shutdown 2024-09-10T23:19:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 -- 172.21.15.17:0/761985338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 msgr2=0x5568ee7a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7a7da0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0010e90 tx=0x7fa8d0010ec0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 -- 172.21.15.17:0/761985338 shutdown_connections 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.17:6832/1323392007,v1:172.21.15.17:6834/1323392007] conn(0x5568ee746410 0x5568ee746820 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568ee731a10 0x5568ee7a7da0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5568ee7310f0 0x5568ee7a7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8bbe00640 0 client.6246 ms_handle_reset on v2:172.21.15.17:6832/1323392007 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 --2- 172.21.15.17:0/761985338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5568ee6e79f0 0x5568ee7a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 -- 172.21.15.17:0/761985338 >> 172.21.15.17:0/761985338 conn(0x5568ee5cf630 msgr2=0x5568ee6ec630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 -- 172.21.15.17:0/761985338 shutdown_connections 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 1 -- 172.21.15.17:0/761985338 wait complete. 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8e08cf000 20 client.6246 trim_cache size 0 max 16384 2024-09-10T23:19:39.250 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:19:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:19:39.251 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8dd400640 1 -- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8b40725e0 msgr2=0x7fa8b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8dd400640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8b40725e0 0x7fa8b4074aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00af000 tx=0x7fa8c001aef0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.241+0000 7fa8dd400640 1 -- 172.21.15.17:0/2289849438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8d8073b30 msgr2=0x7fa8d8160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.245+0000 7fa8dd400640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8d8073b30 0x7fa8d8160140 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c6e0 tx=0x7fa8c800cba0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.245+0000 7fa8dd400640 1 -- 172.21.15.17:0/2289849438 shutdown_connections 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.245+0000 7fa8dd400640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8b40725e0 0x7fa8b4074aa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.245+0000 7fa8dd400640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8d815eb90 0x7fa8d815a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.245+0000 7fa8dd400640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8d80b4de0 0x7fa8d8159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.245+0000 7fa8dd400640 1 --2- 172.21.15.17:0/2289849438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8d8073b30 0x7fa8d8160140 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.245+0000 7fa8dd400640 1 -- 172.21.15.17:0/2289849438 >> 172.21.15.17:0/2289849438 conn(0x7fa8d80b1b00 msgr2=0x7fa8d8074bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.245+0000 7fa8dd400640 1 -- 172.21.15.17:0/2289849438 shutdown_connections 2024-09-10T23:19:39.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.245+0000 7fa8dd400640 1 -- 172.21.15.17:0/2289849438 wait complete. 2024-09-10T23:19:39.266 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-10T23:19:39.267 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:19:39.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:19:39.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:19:39.432 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:19:39.433 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:19:39.433 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:19:39.433 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:39.442 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:19:39.442 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:39.496 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:19:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.685+0000 7fea86800640 1 -- 172.21.15.17:0/3682410636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800cf000 msgr2=0x7fea8006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.685+0000 7fea86800640 1 --2- 172.21.15.17:0/3682410636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800cf000 0x7fea8006dbd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fea68009840 tx=0x7fea6801c6b0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.685+0000 7fea86800640 1 -- 172.21.15.17:0/3682410636 shutdown_connections 2024-09-10T23:19:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.685+0000 7fea86800640 1 --2- 172.21.15.17:0/3682410636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800cf000 0x7fea8006dbd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.685+0000 7fea86800640 1 -- 172.21.15.17:0/3682410636 >> 172.21.15.17:0/3682410636 conn(0x7fea80072f80 msgr2=0x7fea80073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 -- 172.21.15.17:0/3682410636 shutdown_connections 2024-09-10T23:19:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 -- 172.21.15.17:0/3682410636 wait complete. 2024-09-10T23:19:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 Processor -- start 2024-09-10T23:19:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 -- start start 2024-09-10T23:19:39.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea8006e110 0x7fea8014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800cf000 0x7fea80149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea8015ab90 0x7fea800ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fea801688f0 con 0x7fea8015ab90 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea800714f0 con 0x7fea800cf000 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea86800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea80168a70 con 0x7fea8006e110 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea8015ab90 0x7fea800ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea8015ab90 0x7fea800ade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34244/0 (socket says 172.21.15.17:34244) 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7fe00640 1 -- 172.21.15.17:0/3726136222 learned_addr learned my addr 172.21.15.17:0/3726136222 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea77e00640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800cf000 0x7fea80149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7f400640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea8006e110 0x7fea8014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7fe00640 1 -- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea8006e110 msgr2=0x7fea8014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7fe00640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea8006e110 0x7fea8014b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7fe00640 1 -- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800cf000 msgr2=0x7fea80149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7fe00640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800cf000 0x7fea80149960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7fe00640 1 -- 172.21.15.17:0/3726136222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8014b830 con 0x7fea8015ab90 2024-09-10T23:19:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea7fe00640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea8015ab90 0x7fea800ade20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fea7800cfd0 tx=0x7fea78002000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.689+0000 7fea77400640 1 -- 172.21.15.17:0/3726136222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78016020 con 0x7fea8015ab90 2024-09-10T23:19:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.693+0000 7fea77400640 1 -- 172.21.15.17:0/3726136222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea7800ab40 con 0x7fea8015ab90 2024-09-10T23:19:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.693+0000 7fea77400640 1 -- 172.21.15.17:0/3726136222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78012420 con 0x7fea8015ab90 2024-09-10T23:19:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.693+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea80149ea0 con 0x7fea8015ab90 2024-09-10T23:19:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.693+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea800b4c60 con 0x7fea8015ab90 2024-09-10T23:19:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.693+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea80071820 con 0x7fea8015ab90 2024-09-10T23:19:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.693+0000 7fea77400640 1 -- 172.21.15.17:0/3726136222 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fea7801b400 con 0x7fea8015ab90 2024-09-10T23:19:39.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.693+0000 7fea77400640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fea5c0725e0 0x7fea5c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:39.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.693+0000 7fea77400640 1 -- 172.21.15.17:0/3726136222 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fea78093b40 con 0x7fea8015ab90 2024-09-10T23:19:39.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.693+0000 7fea7f400640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fea5c0725e0 0x7fea5c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:39.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.697+0000 7fea7f400640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fea5c0725e0 0x7fea5c074aa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fea70007fd0 tx=0x7fea70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:39.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.697+0000 7fea77400640 1 -- 172.21.15.17:0/3726136222 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fea78020020 con 0x7fea8015ab90 2024-09-10T23:19:39.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea800ad900 con 0x7fea8015ab90 2024-09-10T23:19:39.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea77400640 1 -- 172.21.15.17:0/3726136222 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) ==== 80+0+0 (secure 0 0 0) 0x7fea8014b830 con 0x7fea8015ab90 2024-09-10T23:19:39.890 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fea5c0725e0 msgr2=0x7fea5c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fea5c0725e0 0x7fea5c074aa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fea70007fd0 tx=0x7fea70009040 comp rx=0 tx=0).stop 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea8015ab90 msgr2=0x7fea800ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea8015ab90 0x7fea800ade20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fea7800cfd0 tx=0x7fea78002000 comp rx=0 tx=0).stop 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 shutdown_connections 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fea5c0725e0 0x7fea5c074aa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea8015ab90 0x7fea800ade20 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea800cf000 0x7fea80149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 --2- 172.21.15.17:0/3726136222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea8006e110 0x7fea8014b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:39.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 >> 172.21.15.17:0/3726136222 conn(0x7fea80072f80 msgr2=0x7fea800701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:39.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 shutdown_connections 2024-09-10T23:19:39.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:39.885+0000 7fea86800640 1 -- 172.21.15.17:0/3726136222 wait complete. 2024-09-10T23:19:39.912 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:19:39.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:39.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:19:39.930 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[50601]: fuse finished with error 0 and tester_r 0 2024-09-10T23:19:39.961 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:19:39.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:19:39.961 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:19:40.142 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:19:40.143 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:19:40.143 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:40.153 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:19:40.154 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:19:40.154 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:19:40.154 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:40.196 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:19:40.197 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:19:40.197 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:19:40.197 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:40.205 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:19:40.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:40.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 -- 172.21.15.17:0/1902548170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cff20 msgr2=0x7f04400d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:40.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 --2- 172.21.15.17:0/1902548170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cff20 0x7f04400d0340 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0438009c80 tx=0x7f043801cda0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 -- 172.21.15.17:0/1902548170 shutdown_connections 2024-09-10T23:19:40.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 --2- 172.21.15.17:0/1902548170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cff20 0x7f04400d0340 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 --2- 172.21.15.17:0/1902548170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04400cf4f0 0x7f04400b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 -- 172.21.15.17:0/1902548170 >> 172.21.15.17:0/1902548170 conn(0x7f044006cfc0 msgr2=0x7f044006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:40.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 -- 172.21.15.17:0/1902548170 shutdown_connections 2024-09-10T23:19:40.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 -- 172.21.15.17:0/1902548170 wait complete. 2024-09-10T23:19:40.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 Processor -- start 2024-09-10T23:19:40.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 -- start start 2024-09-10T23:19:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04400b48f0 0x7f04400aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cf4f0 0x7f04401540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04400cff20 0x7f0440139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0440168b20 con 0x7f04400cf4f0 2024-09-10T23:19:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04401689a0 con 0x7f04400b48f0 2024-09-10T23:19:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0447000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0440168ca0 con 0x7f04400cff20 2024-09-10T23:19:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0437e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cf4f0 0x7f04401540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0437e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cf4f0 0x7f04401540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34264/0 (socket says 172.21.15.17:34264) 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0437e00640 1 -- 172.21.15.17:0/1092948092 learned_addr learned my addr 172.21.15.17:0/1092948092 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f043fe00640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04400b48f0 0x7f04400aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.385+0000 7f0445000640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04400cff20 0x7f0440139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f0437e00640 1 -- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04400cff20 msgr2=0x7f0440139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f0437e00640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04400cff20 0x7f0440139db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f0437e00640 1 -- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04400b48f0 msgr2=0x7f04400aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f0437e00640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04400b48f0 0x7f04400aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f0437e00640 1 -- 172.21.15.17:0/1092948092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04401549c0 con 0x7f04400cf4f0 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f0437e00640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cf4f0 0x7f04401540c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f042800c500 tx=0x7f042800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f043cc00640 1 -- 172.21.15.17:0/1092948092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428017070 con 0x7f04400cf4f0 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f043cc00640 1 -- 172.21.15.17:0/1092948092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04280053c0 con 0x7f04400cf4f0 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0440154ca0 con 0x7f04400cf4f0 2024-09-10T23:19:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f043cc00640 1 -- 172.21.15.17:0/1092948092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428012890 con 0x7f04400cf4f0 2024-09-10T23:19:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044013b550 con 0x7f04400cf4f0 2024-09-10T23:19:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044013b750 con 0x7f04400cf4f0 2024-09-10T23:19:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f043cc00640 1 -- 172.21.15.17:0/1092948092 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0428003600 con 0x7f04400cf4f0 2024-09-10T23:19:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f043cc00640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f041c0725e0 0x7f041c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.389+0000 7f043cc00640 1 -- 172.21.15.17:0/1092948092 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f0428092910 con 0x7f04400cf4f0 2024-09-10T23:19:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.393+0000 7f043fe00640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f041c0725e0 0x7f041c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.393+0000 7f043fe00640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f041c0725e0 0x7f041c074aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0430004630 tx=0x7f043000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:40.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.393+0000 7f043cc00640 1 -- 172.21.15.17:0/1092948092 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f044013b750 con 0x7f04400cf4f0 2024-09-10T23:19:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.601+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f044013b360 con 0x7f04400cf4f0 2024-09-10T23:19:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f043cc00640 1 -- 172.21.15.17:0/1092948092 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5224 (secure 0 0 0) 0x7f042805d7f0 con 0x7f04400cf4f0 2024-09-10T23:19:40.609 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:40.609 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-09-10T23:19:32:803927+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1801943144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1801943144},{"type":"v1","addr":"172.21.15.77:6837","nonce":1801943144}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2387800472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2387800472},{"type":"v1","addr":"172.21.15.77:6835","nonce":2387800472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1881542084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1881542084},{"type":"v1","addr":"172.21.15.17:6835","nonce":1881542084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:55.490263+0000","modified":"2024-09-10T23:19:32.118506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5475},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5475":{"gid":5475,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.17:6834/1323392007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1323392007},{"type":"v1","addr":"172.21.15.17:6834","nonce":1323392007}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5475,"qdb_cluster":[5475]},"id":3}]} 2024-09-10T23:19:40.609 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-09-10T23:19:40.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f041c0725e0 msgr2=0x7f041c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f041c0725e0 0x7f041c074aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0430004630 tx=0x7f043000b390 comp rx=0 tx=0).stop 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cf4f0 msgr2=0x7f04401540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cf4f0 0x7f04401540c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f042800c500 tx=0x7f042800c9c0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 shutdown_connections 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f041c0725e0 0x7f041c074aa0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04400cff20 0x7f0440139db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04400cf4f0 0x7f04401540c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 --2- 172.21.15.17:0/1092948092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04400b48f0 0x7f04400aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 >> 172.21.15.17:0/1092948092 conn(0x7f044006cfc0 msgr2=0x7f044014dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 shutdown_connections 2024-09-10T23:19:40.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.605+0000 7f0447000640 1 -- 172.21.15.17:0/1092948092 wait complete. 2024-09-10T23:19:40.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:40.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 -- 172.21.15.17:0/282133963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb604004da0 msgr2=0x7fb604005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 --2- 172.21.15.17:0/282133963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb604004da0 0x7fb604005200 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb618009ee0 tx=0x7fb61801d5f0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb61f400640 1 -- 172.21.15.17:0/282133963 reap_dead start 2024-09-10T23:19:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 -- 172.21.15.17:0/282133963 shutdown_connections 2024-09-10T23:19:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 -- 172.21.15.17:0/282133963 >> 172.21.15.17:0/282133963 conn(0x7fb6200d0c40 msgr2=0x7fb6200d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 -- 172.21.15.17:0/282133963 shutdown_connections 2024-09-10T23:19:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 -- 172.21.15.17:0/282133963 wait complete. 2024-09-10T23:19:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 Processor -- start 2024-09-10T23:19:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 -- start start 2024-09-10T23:19:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb604004da0 0x7fb6201f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6200cb6f0 0x7fb6200c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb620158a20 0x7fb620158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb620167930 con 0x7fb604004da0 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6200cf800 con 0x7fb6200cb6f0 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.773+0000 7fb625600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb620167ab0 con 0x7fb620158a20 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb604004da0 0x7fb6201f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb604004da0 0x7fb6201f7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34276/0 (socket says 172.21.15.17:34276) 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61ea00640 1 -- 172.21.15.17:0/460267352 learned_addr learned my addr 172.21.15.17:0/460267352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61f400640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb620158a20 0x7fb620158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb616000640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6200cb6f0 0x7fb6200c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61ea00640 1 -- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb620158a20 msgr2=0x7fb620158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61ea00640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb620158a20 0x7fb620158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61ea00640 1 -- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6200cb6f0 msgr2=0x7fb6200c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61ea00640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6200cb6f0 0x7fb6200c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61ea00640 1 -- 172.21.15.17:0/460267352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6200cbed0 con 0x7fb604004da0 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb61ea00640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb604004da0 0x7fb6201f7b10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb610004ee0 tx=0x7fb610001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb617400640 1 -- 172.21.15.17:0/460267352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610015020 con 0x7fb604004da0 2024-09-10T23:19:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb617400640 1 -- 172.21.15.17:0/460267352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb610011960 con 0x7fb604004da0 2024-09-10T23:19:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb617400640 1 -- 172.21.15.17:0/460267352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610011d90 con 0x7fb604004da0 2024-09-10T23:19:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6200cc1b0 con 0x7fb604004da0 2024-09-10T23:19:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6200cc770 con 0x7fb604004da0 2024-09-10T23:19:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62006cbc0 con 0x7fb604004da0 2024-09-10T23:19:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.777+0000 7fb617400640 1 -- 172.21.15.17:0/460267352 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb61001a400 con 0x7fb604004da0 2024-09-10T23:19:40.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.781+0000 7fb617400640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5fc072610 0x7fb5fc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:40.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.781+0000 7fb617400640 1 -- 172.21.15.17:0/460267352 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fb610094130 con 0x7fb604004da0 2024-09-10T23:19:40.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.781+0000 7fb616000640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5fc072610 0x7fb5fc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:40.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.781+0000 7fb616000640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5fc072610 0x7fb5fc074ad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb6080019a0 tx=0x7fb608006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:40.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.785+0000 7fb617400640 1 -- 172.21.15.17:0/460267352 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb61001f020 con 0x7fb604004da0 2024-09-10T23:19:40.826 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:19:40.821+0000 7f03a1800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T23:19:41.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.997+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb620144c10 con 0x7fb604004da0 2024-09-10T23:19:41.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:40.997+0000 7fb617400640 1 -- 172.21.15.17:0/460267352 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5224 (secure 0 0 0) 0x7fb61005ef60 con 0x7fb604004da0 2024-09-10T23:19:41.003 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:41.003 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"btime":"2024-09-10T23:19:40:826637+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1801943144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1801943144},{"type":"v1","addr":"172.21.15.77:6837","nonce":1801943144}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2387800472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2387800472},{"type":"v1","addr":"172.21.15.77:6835","nonce":2387800472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1881542084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1881542084},{"type":"v1","addr":"172.21.15.17:6835","nonce":1881542084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:55.490263+0000","modified":"2024-09-10T23:19:40.122457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5475},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5475":{"gid":5475,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.17:6834/1323392007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1323392007},{"type":"v1","addr":"172.21.15.17:6834","nonce":1323392007}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5475,"qdb_cluster":[5475]},"id":3}]} 2024-09-10T23:19:41.004 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-09-10T23:19:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5fc072610 msgr2=0x7fb5fc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5fc072610 0x7fb5fc074ad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb6080019a0 tx=0x7fb608006040 comp rx=0 tx=0).stop 2024-09-10T23:19:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb604004da0 msgr2=0x7fb6201f7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb604004da0 0x7fb6201f7b10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb610004ee0 tx=0x7fb610001640 comp rx=0 tx=0).stop 2024-09-10T23:19:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 shutdown_connections 2024-09-10T23:19:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5fc072610 0x7fb5fc074ad0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb620158a20 0x7fb620158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6200cb6f0 0x7fb6200c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 --2- 172.21.15.17:0/460267352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb604004da0 0x7fb6201f7b10 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 >> 172.21.15.17:0/460267352 conn(0x7fb6200d0c40 msgr2=0x7fb62015c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 shutdown_connections 2024-09-10T23:19:41.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.001+0000 7fb625600640 1 -- 172.21.15.17:0/460267352 wait complete. 2024-09-10T23:19:41.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:19:41.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.165+0000 7f445b000640 1 -- 172.21.15.17:0/15209437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 msgr2=0x7f445415f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.165+0000 7f445b000640 1 --2- 172.21.15.17:0/15209437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 0x7f445415f5a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f44540d2e60 tx=0x7f443c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.165+0000 7f445b000640 1 -- 172.21.15.17:0/15209437 shutdown_connections 2024-09-10T23:19:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.165+0000 7f445b000640 1 --2- 172.21.15.17:0/15209437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44540cf320 0x7f44540cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.165+0000 7f445b000640 1 --2- 172.21.15.17:0/15209437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 0x7f445415f5a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.165+0000 7f445b000640 1 --2- 172.21.15.17:0/15209437 >> v2:172.21.15.77:3300/0 conn(0x7f4454070ad0 0x7f445415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.165+0000 7f445b000640 1 -- 172.21.15.17:0/15209437 >> 172.21.15.17:0/15209437 conn(0x7f44540d1d60 msgr2=0x7f44540d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.165+0000 7f445b000640 1 -- 172.21.15.17:0/15209437 shutdown_connections 2024-09-10T23:19:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.165+0000 7f445b000640 1 -- 172.21.15.17:0/15209437 wait complete. 2024-09-10T23:19:41.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 Processor -- start 2024-09-10T23:19:41.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 -- start start 2024-09-10T23:19:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4454070ad0 0x7f44540cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44540cf320 0x7f44540b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 0x7f44540b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f44540cd2c0 con 0x7f44540d1830 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f44540cd140 con 0x7f44540cf320 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f44540cd440 con 0x7f4454070ad0 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4459000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 0x7f44540b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4459000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 0x7f44540b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34298/0 (socket says 172.21.15.17:34298) 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4459000640 1 -- 172.21.15.17:0/1550313271 learned_addr learned my addr 172.21.15.17:0/1550313271 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4453e00640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4454070ad0 0x7f44540cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f444b400640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44540cf320 0x7f44540b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4459000640 1 -- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4454070ad0 msgr2=0x7f44540cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4459000640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4454070ad0 0x7f44540cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4459000640 1 -- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44540cf320 msgr2=0x7f44540b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4459000640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44540cf320 0x7f44540b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4459000640 1 -- 172.21.15.17:0/1550313271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44540b3970 con 0x7f44540d1830 2024-09-10T23:19:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f444b400640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44540cf320 0x7f44540b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4459000640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 0x7f44540b4100 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f444c00cce0 tx=0x7f444c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4450c00640 1 -- 172.21.15.17:0/1550313271 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c00f450 con 0x7f44540d1830 2024-09-10T23:19:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4450c00640 1 -- 172.21.15.17:0/1550313271 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f444c00f700 con 0x7f44540d1830 2024-09-10T23:19:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f4450c00640 1 -- 172.21.15.17:0/1550313271 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c00fb50 con 0x7f44540d1830 2024-09-10T23:19:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44540b5400 con 0x7f44540d1830 2024-09-10T23:19:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.169+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44540b59c0 con 0x7f44540d1830 2024-09-10T23:19:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.173+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44540cfc60 con 0x7f44540d1830 2024-09-10T23:19:41.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.173+0000 7f4450c00640 1 -- 172.21.15.17:0/1550313271 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f444c0213f0 con 0x7f44540d1830 2024-09-10T23:19:41.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.173+0000 7f4450c00640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4430072610 0x7f4430074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:41.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.173+0000 7f4450c00640 1 -- 172.21.15.17:0/1550313271 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f444c093ff0 con 0x7f44540d1830 2024-09-10T23:19:41.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.173+0000 7f4453e00640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4430072610 0x7f4430074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:41.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.173+0000 7f4453e00640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4430072610 0x7f4430074ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4454155690 tx=0x7f444400a4e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:41.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.177+0000 7f4450c00640 1 -- 172.21.15.17:0/1550313271 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f444c014030 con 0x7f44540d1830 2024-09-10T23:19:41.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.369+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44540cc170 con 0x7f44540d1830 2024-09-10T23:19:41.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f4450c00640 1 -- 172.21.15.17:0/1550313271 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16982 (secure 0 0 0) 0x7f444c05f520 con 0x7f44540d1830 2024-09-10T23:19:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:41.377 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:19:18.710722+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:53.186691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:54.526406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.17","mappings":[{"from":0,"to":6}]},{"pgid":"8.32","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:19:41.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4430072610 msgr2=0x7f4430074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4430072610 0x7f4430074ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4454155690 tx=0x7f444400a4e0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 msgr2=0x7f44540b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 0x7f44540b4100 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f444c00cce0 tx=0x7f444c00a620 comp rx=0 tx=0).stop 2024-09-10T23:19:41.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 shutdown_connections 2024-09-10T23:19:41.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4430072610 0x7f4430074ad0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44540d1830 0x7f44540b4100 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44540cf320 0x7f44540b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 --2- 172.21.15.17:0/1550313271 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4454070ad0 0x7f44540cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 >> 172.21.15.17:0/1550313271 conn(0x7f44540d1d60 msgr2=0x7f44540b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:41.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 shutdown_connections 2024-09-10T23:19:41.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.373+0000 7f445b000640 1 -- 172.21.15.17:0/1550313271 wait complete. 2024-09-10T23:19:41.399 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:19:41.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:41.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 -- 172.21.15.17:0/2138300818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e40070ad0 msgr2=0x7f2e4015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 --2- 172.21.15.17:0/2138300818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e40070ad0 0x7f2e4015f060 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2e400cf010 tx=0x7f2e3001c7f0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 -- 172.21.15.17:0/2138300818 shutdown_connections 2024-09-10T23:19:41.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 --2- 172.21.15.17:0/2138300818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e40070ad0 0x7f2e4015f060 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 -- 172.21.15.17:0/2138300818 >> 172.21.15.17:0/2138300818 conn(0x7f2e400d1d60 msgr2=0x7f2e400d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:41.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 -- 172.21.15.17:0/2138300818 shutdown_connections 2024-09-10T23:19:41.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 -- 172.21.15.17:0/2138300818 wait complete. 2024-09-10T23:19:41.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 Processor -- start 2024-09-10T23:19:41.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 -- start start 2024-09-10T23:19:41.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e40070ad0 0x7f2e400c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:41.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e400cf320 0x7f2e400c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:41.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e400d1830 0x7f2e401fbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4016a660 con 0x7f2e400cf320 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4016a4e0 con 0x7f2e400d1830 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e46600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4016a7e0 con 0x7f2e40070ad0 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e400cf320 0x7f2e400c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e400cf320 0x7f2e400c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34312/0 (socket says 172.21.15.17:34312) 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e37e00640 1 -- 172.21.15.17:0/2493612 learned_addr learned my addr 172.21.15.17:0/2493612 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e3f400640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e40070ad0 0x7f2e400c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e3fe00640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e400d1830 0x7f2e401fbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e37e00640 1 -- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e40070ad0 msgr2=0x7f2e400c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e37e00640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e40070ad0 0x7f2e400c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e37e00640 1 -- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e400d1830 msgr2=0x7f2e401fbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:41.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e37e00640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e400d1830 0x7f2e401fbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e37e00640 1 -- 172.21.15.17:0/2493612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e400c7140 con 0x7f2e400cf320 2024-09-10T23:19:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.545+0000 7f2e3fe00640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e400d1830 0x7f2e401fbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e37e00640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e400cf320 0x7f2e400c6b60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c3c0 tx=0x7f2e2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e37400640 1 -- 172.21.15.17:0/2493612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28017070 con 0x7f2e400cf320 2024-09-10T23:19:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e37400640 1 -- 172.21.15.17:0/2493612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e280053c0 con 0x7f2e400cf320 2024-09-10T23:19:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e400c5890 con 0x7f2e400cf320 2024-09-10T23:19:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e37400640 1 -- 172.21.15.17:0/2493612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28003860 con 0x7f2e400cf320 2024-09-10T23:19:41.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e40157040 con 0x7f2e400cf320 2024-09-10T23:19:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e4015f060 con 0x7f2e400cf320 2024-09-10T23:19:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e37400640 1 -- 172.21.15.17:0/2493612 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2e28003a00 con 0x7f2e400cf320 2024-09-10T23:19:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e37400640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2e1c072610 0x7f2e1c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.549+0000 7f2e37400640 1 -- 172.21.15.17:0/2493612 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f2e28092a70 con 0x7f2e400cf320 2024-09-10T23:19:41.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.553+0000 7f2e3f400640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2e1c072610 0x7f2e1c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:41.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.553+0000 7f2e3f400640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2e1c072610 0x7f2e1c074ad0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2e300af000 tx=0x7f2e3001b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:41.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.553+0000 7f2e37400640 1 -- 172.21.15.17:0/2493612 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2e2805d8a0 con 0x7f2e400cf320 2024-09-10T23:19:41.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.777+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e400b6760 con 0x7f2e400cf320 2024-09-10T23:19:41.784 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:41.784 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"btime":"2024-09-10T23:19:40:826637+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1801943144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1801943144},{"type":"v1","addr":"172.21.15.77:6837","nonce":1801943144}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2387800472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2387800472},{"type":"v1","addr":"172.21.15.77:6835","nonce":2387800472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1881542084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1881542084},{"type":"v1","addr":"172.21.15.17:6835","nonce":1881542084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:55.490263+0000","modified":"2024-09-10T23:19:40.122457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5475},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5475":{"gid":5475,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.17:6834/1323392007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1323392007},{"type":"v1","addr":"172.21.15.17:6834","nonce":1323392007}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5475,"qdb_cluster":[5475]},"id":3}]} 2024-09-10T23:19:41.784 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-09-10T23:19:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.777+0000 7f2e37400640 1 -- 172.21.15.17:0/2493612 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5224 (secure 0 0 0) 0x7f2e280622d0 con 0x7f2e400cf320 2024-09-10T23:19:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2e1c072610 msgr2=0x7f2e1c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2e1c072610 0x7f2e1c074ad0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2e300af000 tx=0x7f2e3001b030 comp rx=0 tx=0).stop 2024-09-10T23:19:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e400cf320 msgr2=0x7f2e400c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e400cf320 0x7f2e400c6b60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c3c0 tx=0x7f2e2800c880 comp rx=0 tx=0).stop 2024-09-10T23:19:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 shutdown_connections 2024-09-10T23:19:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2e1c072610 0x7f2e1c074ad0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e400d1830 0x7f2e401fbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e400cf320 0x7f2e400c6b60 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 --2- 172.21.15.17:0/2493612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2e40070ad0 0x7f2e400c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 >> 172.21.15.17:0/2493612 conn(0x7f2e400d1d60 msgr2=0x7f2e40157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 shutdown_connections 2024-09-10T23:19:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:41.781+0000 7f2e46600640 1 -- 172.21.15.17:0/2493612 wait complete. 2024-09-10T23:19:42.060 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:42.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.205+0000 7f7422800640 1 -- 172.21.15.17:0/1417717126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400003c20 msgr2=0x7f7400004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.205+0000 7f7422800640 1 --2- 172.21.15.17:0/1417717126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7400003c20 0x7f7400004020 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f740c009b90 tx=0x7f740c01d240 comp rx=0 tx=0).stop 2024-09-10T23:19:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.205+0000 7f741be00640 1 -- 172.21.15.17:0/1417717126 reap_dead start 2024-09-10T23:19:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.205+0000 7f7422800640 1 -- 172.21.15.17:0/1417717126 shutdown_connections 2024-09-10T23:19:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.205+0000 7f7422800640 1 -- 172.21.15.17:0/1417717126 >> 172.21.15.17:0/1417717126 conn(0x7f741c0d1d60 msgr2=0x7f741c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 -- 172.21.15.17:0/1417717126 shutdown_connections 2024-09-10T23:19:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 -- 172.21.15.17:0/1417717126 wait complete. 2024-09-10T23:19:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 Processor -- start 2024-09-10T23:19:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 -- start start 2024-09-10T23:19:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7400003c20 0x7f741c1f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f741c0c9820 0x7f741c158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f741c0b6c70 0x7f741c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f741c168050 con 0x7f741c0c9820 2024-09-10T23:19:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f741c167ed0 con 0x7f7400003c20 2024-09-10T23:19:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f741c1681d0 con 0x7f741c0b6c70 2024-09-10T23:19:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f741c0c9820 0x7f741c158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f741c0c9820 0x7f741c158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34326/0 (socket says 172.21.15.17:34326) 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413e00640 1 -- 172.21.15.17:0/2564464865 learned_addr learned my addr 172.21.15.17:0/2564464865 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f741be00640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f741c0b6c70 0x7f741c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f741b400640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7400003c20 0x7f741c1f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413e00640 1 -- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f741c0b6c70 msgr2=0x7f741c0b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413e00640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f741c0b6c70 0x7f741c0b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413e00640 1 -- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7400003c20 msgr2=0x7f741c1f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413e00640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7400003c20 0x7f741c1f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413e00640 1 -- 172.21.15.17:0/2564464865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c1f6ca0 con 0x7f741c0c9820 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f741be00640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f741c0b6c70 0x7f741c0b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413e00640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f741c0c9820 0x7f741c158e80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7404003ed0 tx=0x7f7404001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413400640 1 -- 172.21.15.17:0/2564464865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404015070 con 0x7f741c0c9820 2024-09-10T23:19:42.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413400640 1 -- 172.21.15.17:0/2564464865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7404011920 con 0x7f741c0c9820 2024-09-10T23:19:42.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c1f6f80 con 0x7f741c0c9820 2024-09-10T23:19:42.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7413400640 1 -- 172.21.15.17:0/2564464865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404011d70 con 0x7f741c0c9820 2024-09-10T23:19:42.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.209+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c1f7540 con 0x7f741c0c9820 2024-09-10T23:19:42.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.213+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f741c0cfc60 con 0x7f741c0c9820 2024-09-10T23:19:42.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.213+0000 7f7413400640 1 -- 172.21.15.17:0/2564464865 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7404010420 con 0x7f741c0c9820 2024-09-10T23:19:42.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.213+0000 7f7413400640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73f80725e0 0x7f73f8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.213+0000 7f7413400640 1 -- 172.21.15.17:0/2564464865 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f7404094530 con 0x7f741c0c9820 2024-09-10T23:19:42.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.213+0000 7f741b400640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73f80725e0 0x7f73f8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.217+0000 7f741b400640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73f80725e0 0x7f73f8074aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f740c0ae000 tx=0x7f740c019fe0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:42.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.217+0000 7f7413400640 1 -- 172.21.15.17:0/2564464865 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f740405f9b0 con 0x7f741c0c9820 2024-09-10T23:19:42.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.445+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f741c1f7710 con 0x7f741c0c9820 2024-09-10T23:19:42.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.445+0000 7f7413400640 1 -- 172.21.15.17:0/2564464865 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5224 (secure 0 0 0) 0x7f740405f2b0 con 0x7f741c0c9820 2024-09-10T23:19:42.451 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:42.451 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"btime":"2024-09-10T23:19:40:826637+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1801943144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1801943144},{"type":"v1","addr":"172.21.15.77:6837","nonce":1801943144}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2387800472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2387800472},{"type":"v1","addr":"172.21.15.77:6835","nonce":2387800472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1881542084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1881542084},{"type":"v1","addr":"172.21.15.17:6835","nonce":1881542084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:18:55.490263+0000","modified":"2024-09-10T23:19:40.122457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5475},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5475":{"gid":5475,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.17:6834/1323392007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1323392007},{"type":"v1","addr":"172.21.15.17:6834","nonce":1323392007}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5475,"qdb_cluster":[5475]},"id":3}]} 2024-09-10T23:19:42.451 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-09-10T23:19:42.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73f80725e0 msgr2=0x7f73f8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73f80725e0 0x7f73f8074aa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f740c0ae000 tx=0x7f740c019fe0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f741c0c9820 msgr2=0x7f741c158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f741c0c9820 0x7f741c158e80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7404003ed0 tx=0x7f7404001810 comp rx=0 tx=0).stop 2024-09-10T23:19:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 shutdown_connections 2024-09-10T23:19:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73f80725e0 0x7f73f8074aa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f741c0b6c70 0x7f741c0b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f741c0c9820 0x7f741c158e80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 --2- 172.21.15.17:0/2564464865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7400003c20 0x7f741c1f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 >> 172.21.15.17:0/2564464865 conn(0x7f741c0d1d60 msgr2=0x7f741c0b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 shutdown_connections 2024-09-10T23:19:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.449+0000 7f7422800640 1 -- 172.21.15.17:0/2564464865 wait complete. 2024-09-10T23:19:42.473 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:19:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267584785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb840d2830 msgr2=0x7fcb840b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 --2- 172.21.15.17:0/1267584785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb840d2830 0x7fcb840b1610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009900 tx=0x7fcb7001f0d0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267584785 shutdown_connections 2024-09-10T23:19:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 --2- 172.21.15.17:0/1267584785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb840d0200 0x7fcb840b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 --2- 172.21.15.17:0/1267584785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb840d2830 0x7fcb840b1610 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267584785 >> 172.21.15.17:0/1267584785 conn(0x7fcb840d1d10 msgr2=0x7fcb840d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267584785 shutdown_connections 2024-09-10T23:19:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267584785 wait complete. 2024-09-10T23:19:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 Processor -- start 2024-09-10T23:19:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 -- start start 2024-09-10T23:19:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb840d0200 0x7fcb840c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb840d2830 0x7fcb841f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb84160280 0x7fcb841f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb840b2090 con 0x7fcb840d2830 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb840b07c0 con 0x7fcb84160280 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.621+0000 7fcb8b400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb840b2210 con 0x7fcb840d0200 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb83e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb840d2830 0x7fcb841f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb83e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb840d2830 0x7fcb841f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34336/0 (socket says 172.21.15.17:34336) 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb83e00640 1 -- 172.21.15.17:0/1267465612 learned_addr learned my addr 172.21.15.17:0/1267465612 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb88a00640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb840d0200 0x7fcb840c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb89400640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb84160280 0x7fcb841f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb83e00640 1 -- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb840d0200 msgr2=0x7fcb840c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb83e00640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb840d0200 0x7fcb840c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb83e00640 1 -- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb84160280 msgr2=0x7fcb841f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb83e00640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb84160280 0x7fcb841f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb83e00640 1 -- 172.21.15.17:0/1267465612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb840caf90 con 0x7fcb840d2830 2024-09-10T23:19:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb83e00640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb840d2830 0x7fcb841f30c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009850 tx=0x7fcb70005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb80c00640 1 -- 172.21.15.17:0/1267465612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb700be070 con 0x7fcb840d2830 2024-09-10T23:19:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb80c00640 1 -- 172.21.15.17:0/1267465612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb700053e0 con 0x7fcb840d2830 2024-09-10T23:19:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb840cb270 con 0x7fcb840d2830 2024-09-10T23:19:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb80c00640 1 -- 172.21.15.17:0/1267465612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb700b5040 con 0x7fcb840d2830 2024-09-10T23:19:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb840cb830 con 0x7fcb840d2830 2024-09-10T23:19:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb840b2700 con 0x7fcb840d2830 2024-09-10T23:19:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.625+0000 7fcb80c00640 1 -- 172.21.15.17:0/1267465612 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcb700b8030 con 0x7fcb840d2830 2024-09-10T23:19:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.629+0000 7fcb80c00640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb640725d0 0x7fcb64074a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.629+0000 7fcb80c00640 1 -- 172.21.15.17:0/1267465612 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7fcb70130110 con 0x7fcb840d2830 2024-09-10T23:19:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.629+0000 7fcb88a00640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb640725d0 0x7fcb64074a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.629+0000 7fcb88a00640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb640725d0 0x7fcb64074a90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcb78000f70 tx=0x7fcb78009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.633+0000 7fcb80c00640 1 -- 172.21.15.17:0/1267465612 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcb70018c30 con 0x7fcb840d2830 2024-09-10T23:19:42.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.817+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb840d2340 con 0x7fcb840d2830 2024-09-10T23:19:42.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.817+0000 7fcb80c00640 1 -- 172.21.15.17:0/1267465612 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16982 (secure 0 0 0) 0x7fcb700fb510 con 0x7fcb840d2830 2024-09-10T23:19:42.823 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:42.823 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":59,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:19:18.710722+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:18:53.186691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-10T23:18:54.526406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.17","mappings":[{"from":0,"to":6}]},{"pgid":"8.32","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:19:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb640725d0 msgr2=0x7fcb64074a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb640725d0 0x7fcb64074a90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcb78000f70 tx=0x7fcb78009040 comp rx=0 tx=0).stop 2024-09-10T23:19:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb840d2830 msgr2=0x7fcb841f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb840d2830 0x7fcb841f30c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009850 tx=0x7fcb70005e70 comp rx=0 tx=0).stop 2024-09-10T23:19:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 shutdown_connections 2024-09-10T23:19:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb640725d0 0x7fcb64074a90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb84160280 0x7fcb841f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb840d2830 0x7fcb841f30c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 --2- 172.21.15.17:0/1267465612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb840d0200 0x7fcb840c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 >> 172.21.15.17:0/1267465612 conn(0x7fcb840d1d10 msgr2=0x7fcb840b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:42.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 shutdown_connections 2024-09-10T23:19:42.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.821+0000 7fcb8b400640 1 -- 172.21.15.17:0/1267465612 wait complete. 2024-09-10T23:19:42.844 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:19:42.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.985+0000 7f844cc00640 1 -- 172.21.15.17:0/1015409600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 msgr2=0x7f844806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.985+0000 7f844cc00640 1 --2- 172.21.15.17:0/1015409600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 0x7f844806dbd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f84480b3090 tx=0x7f843001c570 comp rx=0 tx=0).stop 2024-09-10T23:19:42.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 -- 172.21.15.17:0/1015409600 shutdown_connections 2024-09-10T23:19:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 --2- 172.21.15.17:0/1015409600 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f844806e110 0x7f84480ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 --2- 172.21.15.17:0/1015409600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 0x7f844806dbd0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 --2- 172.21.15.17:0/1015409600 >> v2:172.21.15.77:3300/0 conn(0x7f844815ab90 0x7f84480691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 -- 172.21.15.17:0/1015409600 >> 172.21.15.17:0/1015409600 conn(0x7f8448072f80 msgr2=0x7f8448073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 -- 172.21.15.17:0/1015409600 shutdown_connections 2024-09-10T23:19:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 -- 172.21.15.17:0/1015409600 wait complete. 2024-09-10T23:19:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 Processor -- start 2024-09-10T23:19:42.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 -- start start 2024-09-10T23:19:42.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f844806e110 0x7f84480b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 0x7f844814be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f844815ab90 0x7f84480c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8448070840 con 0x7f84480cf000 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f84480706c0 con 0x7f844806e110 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f844cc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f84480709c0 con 0x7f844815ab90 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f843fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 0x7f844814be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f843fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 0x7f844814be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34366/0 (socket says 172.21.15.17:34366) 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f843fe00640 1 -- 172.21.15.17:0/3653114179 learned_addr learned my addr 172.21.15.17:0/3653114179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f8445e00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f844806e110 0x7f84480b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f8446800640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f844815ab90 0x7f84480c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f843fe00640 1 -- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f844815ab90 msgr2=0x7f84480c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f843fe00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f844815ab90 0x7f84480c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f843fe00640 1 -- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f844806e110 msgr2=0x7f84480b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:42.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f843fe00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f844806e110 0x7f84480b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:42.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f843fe00640 1 -- 172.21.15.17:0/3653114179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844814c3c0 con 0x7f84480cf000 2024-09-10T23:19:42.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.989+0000 7f843fe00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 0x7f844814be80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f843001ac20 tx=0x7f84300ab4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:42.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f843e000640 1 -- 172.21.15.17:0/3653114179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84300abad0 con 0x7f84480cf000 2024-09-10T23:19:42.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f843e000640 1 -- 172.21.15.17:0/3653114179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84300b9070 con 0x7f84480cf000 2024-09-10T23:19:42.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f843e000640 1 -- 172.21.15.17:0/3653114179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8430005030 con 0x7f84480cf000 2024-09-10T23:19:42.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84480b4690 con 0x7f84480cf000 2024-09-10T23:19:42.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84480b1960 con 0x7f84480cf000 2024-09-10T23:19:42.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844806dbd0 con 0x7f84480cf000 2024-09-10T23:19:42.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f843e000640 1 -- 172.21.15.17:0/3653114179 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f84300051d0 con 0x7f84480cf000 2024-09-10T23:19:42.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f843e000640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8424072610 0x7f8424074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:42.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f843e000640 1 -- 172.21.15.17:0/3653114179 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6159+0+0 (secure 0 0 0) 0x7f843012dee0 con 0x7f84480cf000 2024-09-10T23:19:42.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.993+0000 7f8445e00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8424072610 0x7f8424074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.997+0000 7f8445e00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8424072610 0x7f8424074ad0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f843800bb50 tx=0x7f843800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:43.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:42.997+0000 7f843e000640 1 -- 172.21.15.17:0/3653114179 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f84300164b0 con 0x7f84480cf000 2024-09-10T23:19:43.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.209+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8448152cf0 con 0x7f84480cf000 2024-09-10T23:19:43.216 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:19:43.213+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:19:43.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.213+0000 7f843e000640 1 -- 172.21.15.17:0/3653114179 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7f84300f8d10 con 0x7f84480cf000 2024-09-10T23:19:43.220 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:19:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8424072610 msgr2=0x7f8424074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8424072610 0x7f8424074ad0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f843800bb50 tx=0x7f843800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 msgr2=0x7f844814be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 0x7f844814be80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f843001ac20 tx=0x7f84300ab4c0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 shutdown_connections 2024-09-10T23:19:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8424072610 0x7f8424074ad0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f844815ab90 0x7f84480c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84480cf000 0x7f844814be80 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 --2- 172.21.15.17:0/3653114179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f844806e110 0x7f84480b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 >> 172.21.15.17:0/3653114179 conn(0x7f8448072f80 msgr2=0x7f84480cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:43.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 shutdown_connections 2024-09-10T23:19:43.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.217+0000 7f844cc00640 1 -- 172.21.15.17:0/3653114179 wait complete. 2024-09-10T23:19:43.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:19:43.290 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:19:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 -- 172.21.15.17:0/1474825835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 msgr2=0x7f2ee4151600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 --2- 172.21.15.17:0/1474825835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 0x7f2ee4151600 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2ee415c100 tx=0x7f2edc01ccf0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 -- 172.21.15.17:0/1474825835 shutdown_connections 2024-09-10T23:19:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 --2- 172.21.15.17:0/1474825835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 0x7f2ee4151600 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 --2- 172.21.15.17:0/1474825835 >> v2:172.21.15.77:3300/0 conn(0x7f2ee415ed20 0x7f2ee40b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 -- 172.21.15.17:0/1474825835 >> 172.21.15.17:0/1474825835 conn(0x7f2ee40b1d50 msgr2=0x7f2ee40b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 -- 172.21.15.17:0/1474825835 shutdown_connections 2024-09-10T23:19:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 -- 172.21.15.17:0/1474825835 wait complete. 2024-09-10T23:19:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 Processor -- start 2024-09-10T23:19:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 -- start start 2024-09-10T23:19:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 0x7f2ee4142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee415e940 0x7f2ee40cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee415ed20 0x7f2ee40cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee4167d10 con 0x7f2ee40b3590 2024-09-10T23:19:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee4167b90 con 0x7f2ee415ed20 2024-09-10T23:19:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2eeac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee4167e90 con 0x7f2ee415e940 2024-09-10T23:19:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2ee3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 0x7f2ee4142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2ee3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 0x7f2ee4142910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34394/0 (socket says 172.21.15.17:34394) 2024-09-10T23:19:43.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2ee3e00640 1 -- 172.21.15.17:0/1461750657 learned_addr learned my addr 172.21.15.17:0/1461750657 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.393+0000 7f2edbe00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee415e940 0x7f2ee40cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee8c00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee415ed20 0x7f2ee40cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee3e00640 1 -- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee415e940 msgr2=0x7f2ee40cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee3e00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee415e940 0x7f2ee40cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee3e00640 1 -- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee415ed20 msgr2=0x7f2ee40cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee3e00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee415ed20 0x7f2ee40cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee3e00640 1 -- 172.21.15.17:0/1461750657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee4152430 con 0x7f2ee40b3590 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2edbe00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee415e940 0x7f2ee40cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee8c00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee415ed20 0x7f2ee40cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee3e00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 0x7f2ee4142910 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400c500 tx=0x7f2ed400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee0c00640 1 -- 172.21.15.17:0/1461750657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4017070 con 0x7f2ee40b3590 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee0c00640 1 -- 172.21.15.17:0/1461750657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ed40053c0 con 0x7f2ee40b3590 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee0c00640 1 -- 172.21.15.17:0/1461750657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4012890 con 0x7f2ee40b3590 2024-09-10T23:19:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee415f7c0 con 0x7f2ee40b3590 2024-09-10T23:19:43.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee4142e50 con 0x7f2ee40b3590 2024-09-10T23:19:43.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee4151600 con 0x7f2ee40b3590 2024-09-10T23:19:43.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee0c00640 1 -- 172.21.15.17:0/1461750657 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2ed4003600 con 0x7f2ee40b3590 2024-09-10T23:19:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.397+0000 7f2ee0c00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ec00725e0 0x7f2ec0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.401+0000 7f2ee0c00640 1 -- 172.21.15.17:0/1461750657 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6245+0+0 (secure 0 0 0) 0x7f2ed4092af0 con 0x7f2ee40b3590 2024-09-10T23:19:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.401+0000 7f2edbe00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ec00725e0 0x7f2ec0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:43.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.401+0000 7f2edbe00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ec00725e0 0x7f2ec0074aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4164ff0 tx=0x7f2ecc00b5b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:43.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.401+0000 7f2ee0c00640 1 -- 172.21.15.17:0/1461750657 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2ed405df20 con 0x7f2ee40b3590 2024-09-10T23:19:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:43.613+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2ee406dbd0 con 0x7f2ee40b3590 2024-09-10T23:19:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2ee0c00640 1 -- 172.21.15.17:0/1461750657 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f2ed405d820 con 0x7f2ee40b3590 2024-09-10T23:19:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ec00725e0 msgr2=0x7f2ec0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2eeac00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ec00725e0 0x7f2ec0074aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4164ff0 tx=0x7f2ecc00b5b0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 msgr2=0x7f2ee4142910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2eeac00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 0x7f2ee4142910 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400c500 tx=0x7f2ed400c9c0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 shutdown_connections 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2eeac00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ec00725e0 0x7f2ec0074aa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2eeac00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ee415ed20 0x7f2ee40cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2eeac00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ee415e940 0x7f2ee40cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.217+0000 7f2eeac00640 1 --2- 172.21.15.17:0/1461750657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ee40b3590 0x7f2ee4142910 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.221+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 >> 172.21.15.17:0/1461750657 conn(0x7f2ee40b1d50 msgr2=0x7f2ee415a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.221+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 shutdown_connections 2024-09-10T23:19:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.221+0000 7f2eeac00640 1 -- 172.21.15.17:0/1461750657 wait complete. 2024-09-10T23:19:44.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:19:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.397+0000 7f08a1200640 1 -- 172.21.15.17:0/2577802815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 msgr2=0x7f089c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.397+0000 7f08a1200640 1 --2- 172.21.15.17:0/2577802815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 0x7f089c0694e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f088c009840 tx=0x7f088c01c7c0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.397+0000 7f08a1200640 1 -- 172.21.15.17:0/2577802815 shutdown_connections 2024-09-10T23:19:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.397+0000 7f08a1200640 1 --2- 172.21.15.17:0/2577802815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f089c0b50c0 0x7f089c0b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.397+0000 7f08a1200640 1 --2- 172.21.15.17:0/2577802815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 0x7f089c0694e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.397+0000 7f08a1200640 1 -- 172.21.15.17:0/2577802815 >> 172.21.15.17:0/2577802815 conn(0x7f089c0d0360 msgr2=0x7f089c0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.397+0000 7f08a1200640 1 -- 172.21.15.17:0/2577802815 shutdown_connections 2024-09-10T23:19:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.397+0000 7f08a1200640 1 -- 172.21.15.17:0/2577802815 wait complete. 2024-09-10T23:19:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 Processor -- start 2024-09-10T23:19:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 -- start start 2024-09-10T23:19:44.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f089c0b50c0 0x7f089c099ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f089c0b60a0 0x7f089c0c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 0x7f089c0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f089c168fa0 con 0x7f089c15f360 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f089c168e20 con 0x7f089c0b50c0 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f089c169120 con 0x7f089c0b60a0 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f089a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 0x7f089c0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f089a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 0x7f089c0ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34402/0 (socket says 172.21.15.17:34402) 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f089a800640 1 -- 172.21.15.17:0/154893688 learned_addr learned my addr 172.21.15.17:0/154893688 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f0893e00640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f089c0b60a0 0x7f089c0c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f0899e00640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f089c0b50c0 0x7f089c099ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f089a800640 1 -- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f089c0b60a0 msgr2=0x7f089c0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:44.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f089a800640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f089c0b60a0 0x7f089c0c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f089a800640 1 -- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f089c0b50c0 msgr2=0x7f089c099ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f089a800640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f089c0b50c0 0x7f089c099ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f089a800640 1 -- 172.21.15.17:0/154893688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c0c4cf0 con 0x7f089c15f360 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f0893e00640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f089c0b60a0 0x7f089c0c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f089a800640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 0x7f089c0ccc70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f089400cb20 tx=0x7f089400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f0892000640 1 -- 172.21.15.17:0/154893688 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894016020 con 0x7f089c15f360 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f0892000640 1 -- 172.21.15.17:0/154893688 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f089400ab40 con 0x7f089c15f360 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089c0c4450 con 0x7f089c15f360 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f0892000640 1 -- 172.21.15.17:0/154893688 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089400ce60 con 0x7f089c15f360 2024-09-10T23:19:44.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089c0c4a10 con 0x7f089c15f360 2024-09-10T23:19:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.401+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089c0b5b60 con 0x7f089c15f360 2024-09-10T23:19:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.405+0000 7f0892000640 1 -- 172.21.15.17:0/154893688 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f089401b400 con 0x7f089c15f360 2024-09-10T23:19:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.405+0000 7f0892000640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08780725e0 0x7f0878074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.405+0000 7f0892000640 1 -- 172.21.15.17:0/154893688 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6245+0+0 (secure 0 0 0) 0x7f0894093890 con 0x7f089c15f360 2024-09-10T23:19:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.405+0000 7f0899e00640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08780725e0 0x7f0878074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:44.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.405+0000 7f0899e00640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08780725e0 0x7f0878074aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f088c0af000 tx=0x7f088c01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:44.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.409+0000 7f0892000640 1 -- 172.21.15.17:0/154893688 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0894020020 con 0x7f089c15f360 2024-09-10T23:19:44.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:44.585+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f089c0b1770 con 0x7f089c15f360 2024-09-10T23:19:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.225+0000 7f0892000640 1 -- 172.21.15.17:0/154893688 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) ==== 181+0+0 (secure 0 0 0) 0x7f089405ed40 con 0x7f089c15f360 2024-09-10T23:19:45.302 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:19:45.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08780725e0 msgr2=0x7f0878074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08780725e0 0x7f0878074aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f088c0af000 tx=0x7f088c01b060 comp rx=0 tx=0).stop 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 msgr2=0x7f089c0ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 0x7f089c0ccc70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f089400cb20 tx=0x7f089400cc10 comp rx=0 tx=0).stop 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 shutdown_connections 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08780725e0 0x7f0878074aa0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f089c15f360 0x7f089c0ccc70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f089c0b60a0 0x7f089c0c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 --2- 172.21.15.17:0/154893688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f089c0b50c0 0x7f089c099ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 >> 172.21.15.17:0/154893688 conn(0x7f089c0d0360 msgr2=0x7f089c159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:45.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 shutdown_connections 2024-09-10T23:19:45.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.229+0000 7f08a1200640 1 -- 172.21.15.17:0/154893688 wait complete. 2024-09-10T23:19:45.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:19:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 -- 172.21.15.17:0/4229570312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d8004d50 msgr2=0x7f63d80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 --2- 172.21.15.17:0/4229570312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63d8004d50 0x7f63d80051d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00c5c0 tx=0x7f63ec01fa40 comp rx=0 tx=0).stop 2024-09-10T23:19:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63f9400640 1 -- 172.21.15.17:0/4229570312 reap_dead start 2024-09-10T23:19:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 -- 172.21.15.17:0/4229570312 shutdown_connections 2024-09-10T23:19:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 -- 172.21.15.17:0/4229570312 >> 172.21.15.17:0/4229570312 conn(0x7f63f409a9f0 msgr2=0x7f63f409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 -- 172.21.15.17:0/4229570312 shutdown_connections 2024-09-10T23:19:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 -- 172.21.15.17:0/4229570312 wait complete. 2024-09-10T23:19:45.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 Processor -- start 2024-09-10T23:19:45.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 -- start start 2024-09-10T23:19:45.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d8004d50 0x7f63f415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63f40b6e40 0x7f63f415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63f40cdbc0 0x7f63f40ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f63f40d0470 con 0x7f63f40cdbc0 2024-09-10T23:19:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63f40d02f0 con 0x7f63d8004d50 2024-09-10T23:19:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63fb400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f63f40d05f0 con 0x7f63f40b6e40 2024-09-10T23:19:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63f9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63f40cdbc0 0x7f63f40ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63f9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63f40cdbc0 0x7f63f40ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34420/0 (socket says 172.21.15.17:34420) 2024-09-10T23:19:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.457+0000 7f63f9400640 1 -- 172.21.15.17:0/24110617 learned_addr learned my addr 172.21.15.17:0/24110617 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63ebe00640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63f40b6e40 0x7f63f415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f8a00640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d8004d50 0x7f63f415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f9400640 1 -- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63f40b6e40 msgr2=0x7f63f415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f9400640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63f40b6e40 0x7f63f415e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f9400640 1 -- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d8004d50 msgr2=0x7f63f415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f9400640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d8004d50 0x7f63f415deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f9400640 1 -- 172.21.15.17:0/24110617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f41f4720 con 0x7f63f40cdbc0 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63ebe00640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63f40b6e40 0x7f63f415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f8a00640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d8004d50 0x7f63f415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f9400640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63f40cdbc0 0x7f63f40ce050 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f63ec09c440 tx=0x7f63ec001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f1600640 1 -- 172.21.15.17:0/24110617 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec004e60 con 0x7f63f40cdbc0 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f1600640 1 -- 172.21.15.17:0/24110617 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63ec0019c0 con 0x7f63f40cdbc0 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f1600640 1 -- 172.21.15.17:0/24110617 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec002000 con 0x7f63f40cdbc0 2024-09-10T23:19:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f41f4a00 con 0x7f63f40cdbc0 2024-09-10T23:19:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f41f4fc0 con 0x7f63f40cdbc0 2024-09-10T23:19:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f40d1b40 con 0x7f63f40cdbc0 2024-09-10T23:19:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f1600640 1 -- 172.21.15.17:0/24110617 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f63ec003be0 con 0x7f63f40cdbc0 2024-09-10T23:19:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.461+0000 7f63f1600640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63d00725e0 0x7f63d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.465+0000 7f63f1600640 1 -- 172.21.15.17:0/24110617 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5807+0+0 (secure 0 0 0) 0x7f63ec0b9020 con 0x7f63f40cdbc0 2024-09-10T23:19:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.465+0000 7f63f8a00640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63d00725e0 0x7f63d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.465+0000 7f63f8a00640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63d00725e0 0x7f63d0074aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f63f40c4d20 tx=0x7f63e40091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.465+0000 7f63f1600640 1 -- 172.21.15.17:0/24110617 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f63ec0197f0 con 0x7f63f40cdbc0 2024-09-10T23:19:45.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:45.641+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f63f40d2b50 con 0x7f63f40cdbc0 2024-09-10T23:19:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.225+0000 7f63f1600640 1 -- 172.21.15.17:0/24110617 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) ==== 169+0+0 (secure 0 0 0) 0x7f63ec0fba50 con 0x7f63f40cdbc0 2024-09-10T23:19:46.231 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:19:46.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63d00725e0 msgr2=0x7f63d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63d00725e0 0x7f63d0074aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f63f40c4d20 tx=0x7f63e40091e0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63f40cdbc0 msgr2=0x7f63f40ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63f40cdbc0 0x7f63f40ce050 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f63ec09c440 tx=0x7f63ec001cc0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 shutdown_connections 2024-09-10T23:19:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63d00725e0 0x7f63d0074aa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63f40cdbc0 0x7f63f40ce050 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63f40b6e40 0x7f63f415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 --2- 172.21.15.17:0/24110617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63d8004d50 0x7f63f415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 >> 172.21.15.17:0/24110617 conn(0x7f63f409a9f0 msgr2=0x7f63f40719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 shutdown_connections 2024-09-10T23:19:46.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.229+0000 7f63fb400640 1 -- 172.21.15.17:0/24110617 wait complete. 2024-09-10T23:19:46.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:19:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 -- 172.21.15.17:0/2463843713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 msgr2=0x7f90cc0ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 --2- 172.21.15.17:0/2463843713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 0x7f90cc0ca970 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0743a0 tx=0x7f90c401ca30 comp rx=0 tx=0).stop 2024-09-10T23:19:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 -- 172.21.15.17:0/2463843713 shutdown_connections 2024-09-10T23:19:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 --2- 172.21.15.17:0/2463843713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 0x7f90cc0ca970 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 --2- 172.21.15.17:0/2463843713 >> v2:172.21.15.77:3300/0 conn(0x7f90cc0cf000 0x7f90cc06dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 --2- 172.21.15.17:0/2463843713 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90cc15ab90 0x7f90cc0691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 -- 172.21.15.17:0/2463843713 >> 172.21.15.17:0/2463843713 conn(0x7f90cc072f80 msgr2=0x7f90cc073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 -- 172.21.15.17:0/2463843713 shutdown_connections 2024-09-10T23:19:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 -- 172.21.15.17:0/2463843713 wait complete. 2024-09-10T23:19:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 Processor -- start 2024-09-10T23:19:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 -- start start 2024-09-10T23:19:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 0x7f90cc0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90cc0cf000 0x7f90cc0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90cc15ab90 0x7f90cc0b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc070990 con 0x7f90cc06e110 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc070810 con 0x7f90cc15ab90 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90d1400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90cc070b10 con 0x7f90cc0cf000 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90ca800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 0x7f90cc0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90ca800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 0x7f90cc0aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34428/0 (socket says 172.21.15.17:34428) 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90ca800640 1 -- 172.21.15.17:0/2765773042 learned_addr learned my addr 172.21.15.17:0/2765773042 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90cb200640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90cc15ab90 0x7f90cc0b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90c3e00640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90cc0cf000 0x7f90cc0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90ca800640 1 -- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90cc0cf000 msgr2=0x7f90cc0b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90ca800640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90cc0cf000 0x7f90cc0b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90ca800640 1 -- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90cc15ab90 msgr2=0x7f90cc0b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90ca800640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90cc15ab90 0x7f90cc0b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90ca800640 1 -- 172.21.15.17:0/2765773042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90cc1425a0 con 0x7f90cc06e110 2024-09-10T23:19:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90c3e00640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90cc0cf000 0x7f90cc0b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90cb200640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90cc15ab90 0x7f90cc0b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.413+0000 7f90ca800640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 0x7f90cc0aefc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00d950 tx=0x7f90bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:46.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90c2a00640 1 -- 172.21.15.17:0/2765773042 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc017070 con 0x7f90cc06e110 2024-09-10T23:19:46.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90c2a00640 1 -- 172.21.15.17:0/2765773042 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90bc009cc0 con 0x7f90cc06e110 2024-09-10T23:19:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90c2a00640 1 -- 172.21.15.17:0/2765773042 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0106c0 con 0x7f90cc06e110 2024-09-10T23:19:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90cc142880 con 0x7f90cc06e110 2024-09-10T23:19:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90cc13fcb0 con 0x7f90cc06e110 2024-09-10T23:19:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90cc06dbd0 con 0x7f90cc06e110 2024-09-10T23:19:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90c2a00640 1 -- 172.21.15.17:0/2765773042 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f90bc010860 con 0x7f90cc06e110 2024-09-10T23:19:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90c2a00640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90a80725e0 0x7f90a8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90c2a00640 1 -- 172.21.15.17:0/2765773042 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5335+0+0 (secure 0 0 0) 0x7f90bc0935e0 con 0x7f90cc06e110 2024-09-10T23:19:46.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.417+0000 7f90c3e00640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90a80725e0 0x7f90a8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:46.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.421+0000 7f90c3e00640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90a80725e0 0x7f90a8074aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90b4005fd0 tx=0x7f90b4005f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:46.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.421+0000 7f90c2a00640 1 -- 172.21.15.17:0/2765773042 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f90bc05ed90 con 0x7f90cc06e110 2024-09-10T23:19:46.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.617+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f90cc0b6230 con 0x7f90cc06e110 2024-09-10T23:19:46.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.625+0000 7f90c2a00640 1 -- 172.21.15.17:0/2765773042 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v31) ==== 71+0+0 (secure 0 0 0) 0x7f90bc05e690 con 0x7f90cc06e110 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90a80725e0 msgr2=0x7f90a8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90a80725e0 0x7f90a8074aa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90b4005fd0 tx=0x7f90b4005f20 comp rx=0 tx=0).stop 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 msgr2=0x7f90cc0aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 0x7f90cc0aefc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00d950 tx=0x7f90bc00de10 comp rx=0 tx=0).stop 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 shutdown_connections 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90a80725e0 0x7f90a8074aa0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90cc15ab90 0x7f90cc0b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90cc0cf000 0x7f90cc0b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 --2- 172.21.15.17:0/2765773042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90cc06e110 0x7f90cc0aefc0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 >> 172.21.15.17:0/2765773042 conn(0x7f90cc072f80 msgr2=0x7f90cc071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:46.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 shutdown_connections 2024-09-10T23:19:46.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.629+0000 7f90d1400640 1 -- 172.21.15.17:0/2765773042 wait complete. 2024-09-10T23:19:46.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-10T23:19:46.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 -- 172.21.15.17:0/2586508433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c0d1830 msgr2=0x7fd12c0ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 --2- 172.21.15.17:0/2586508433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c0d1830 0x7fd12c0ccdb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0d0c70 tx=0x7fd12401cb80 comp rx=0 tx=0).stop 2024-09-10T23:19:46.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 -- 172.21.15.17:0/2586508433 shutdown_connections 2024-09-10T23:19:46.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 --2- 172.21.15.17:0/2586508433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c0d1830 0x7fd12c0ccdb0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 --2- 172.21.15.17:0/2586508433 >> v2:172.21.15.77:3300/0 conn(0x7fd12c15f770 0x7fd12c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 -- 172.21.15.17:0/2586508433 >> 172.21.15.17:0/2586508433 conn(0x7fd12c0d1d60 msgr2=0x7fd12c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:46.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 -- 172.21.15.17:0/2586508433 shutdown_connections 2024-09-10T23:19:46.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 -- 172.21.15.17:0/2586508433 wait complete. 2024-09-10T23:19:46.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 Processor -- start 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.793+0000 7fd134200640 1 -- start start 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd134200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd12c070ad0 0x7fd12c14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd134200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd12c0d1830 0x7fd12c157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd134200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c15f770 0x7fd12c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd134200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c1693c0 con 0x7fd12c15f770 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd134200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c169240 con 0x7fd12c0d1830 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd134200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd12c169540 con 0x7fd12c070ad0 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd132200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c15f770 0x7fd12c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd132200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c15f770 0x7fd12c0af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33254/0 (socket says 172.21.15.17:33254) 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd132200640 1 -- 172.21.15.17:0/3409985557 learned_addr learned my addr 172.21.15.17:0/3409985557 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd130e00640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd12c0d1830 0x7fd12c157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd131800640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd12c070ad0 0x7fd12c14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd132200640 1 -- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd12c070ad0 msgr2=0x7fd12c14fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd132200640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd12c070ad0 0x7fd12c14fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd132200640 1 -- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd12c0d1830 msgr2=0x7fd12c157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd132200640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd12c0d1830 0x7fd12c157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd132200640 1 -- 172.21.15.17:0/3409985557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c150390 con 0x7fd12c15f770 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd130e00640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd12c0d1830 0x7fd12c157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd132200640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c15f770 0x7fd12c0af720 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd124009b10 tx=0x7fd124009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd129600640 1 -- 172.21.15.17:0/3409985557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1240bb070 con 0x7fd12c15f770 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd129600640 1 -- 172.21.15.17:0/3409985557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd124004c50 con 0x7fd12c15f770 2024-09-10T23:19:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd129600640 1 -- 172.21.15.17:0/3409985557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1240b2040 con 0x7fd12c15f770 2024-09-10T23:19:46.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd12c150670 con 0x7fd12c15f770 2024-09-10T23:19:46.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd12c150c30 con 0x7fd12c15f770 2024-09-10T23:19:46.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12c15f060 con 0x7fd12c15f770 2024-09-10T23:19:46.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.797+0000 7fd129600640 1 -- 172.21.15.17:0/3409985557 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd1240b5030 con 0x7fd12c15f770 2024-09-10T23:19:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.801+0000 7fd129600640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd10c0725e0 0x7fd10c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.801+0000 7fd129600640 1 -- 172.21.15.17:0/3409985557 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5335+0+0 (secure 0 0 0) 0x7fd12412cb70 con 0x7fd12c15f770 2024-09-10T23:19:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.801+0000 7fd131800640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd10c0725e0 0x7fd10c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:46.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.801+0000 7fd131800640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd10c0725e0 0x7fd10c074aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd12c072ac0 tx=0x7fd120009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:46.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:46.805+0000 7fd129600640 1 -- 172.21.15.17:0/3409985557 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd124016770 con 0x7fd12c15f770 2024-09-10T23:19:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.037+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7fd12c15be00 con 0x7fd12c15f770 2024-09-10T23:19:47.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.229+0000 7fd129600640 1 -- 172.21.15.17:0/3409985557 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v208) ==== 143+0+0 (secure 0 0 0) 0x7fd124004e20 con 0x7fd12c15f770 2024-09-10T23:19:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd10c0725e0 msgr2=0x7fd10c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd10c0725e0 0x7fd10c074aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd12c072ac0 tx=0x7fd120009040 comp rx=0 tx=0).stop 2024-09-10T23:19:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c15f770 msgr2=0x7fd12c0af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c15f770 0x7fd12c0af720 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd124009b10 tx=0x7fd124009300 comp rx=0 tx=0).stop 2024-09-10T23:19:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 shutdown_connections 2024-09-10T23:19:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd10c0725e0 0x7fd10c074aa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd12c15f770 0x7fd12c0af720 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd12c0d1830 0x7fd12c157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 --2- 172.21.15.17:0/3409985557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd12c070ad0 0x7fd12c14fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 >> 172.21.15.17:0/3409985557 conn(0x7fd12c0d1d60 msgr2=0x7fd12c0cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:47.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 shutdown_connections 2024-09-10T23:19:47.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.233+0000 7fd134200640 1 -- 172.21.15.17:0/3409985557 wait complete. 2024-09-10T23:19:47.259 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-10T23:19:47.259 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-09-10T23:19:47.259 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T23:19:47.260 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:19:47.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.401+0000 7ff209a00640 1 -- 172.21.15.17:0/1764417899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2040d2830 msgr2=0x7ff2040b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.401+0000 7ff209a00640 1 --2- 172.21.15.17:0/1764417899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2040d2830 0x7ff2040b1610 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009840 tx=0x7ff1ec01f010 comp rx=0 tx=0).stop 2024-09-10T23:19:47.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.401+0000 7ff209a00640 1 -- 172.21.15.17:0/1764417899 shutdown_connections 2024-09-10T23:19:47.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.401+0000 7ff209a00640 1 --2- 172.21.15.17:0/1764417899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2040d2830 0x7ff2040b1610 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.401+0000 7ff209a00640 1 -- 172.21.15.17:0/1764417899 >> 172.21.15.17:0/1764417899 conn(0x7ff2040d1d10 msgr2=0x7ff2040d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:47.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.401+0000 7ff209a00640 1 -- 172.21.15.17:0/1764417899 shutdown_connections 2024-09-10T23:19:47.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.401+0000 7ff209a00640 1 -- 172.21.15.17:0/1764417899 wait complete. 2024-09-10T23:19:47.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 Processor -- start 2024-09-10T23:19:47.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 -- start start 2024-09-10T23:19:47.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2040d0200 0x7ff2040cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:47.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2040d2830 0x7ff2040cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204160280 0x7ff2040c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff2040b2260 con 0x7ff204160280 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff2040b07c0 con 0x7ff2040d2830 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff2040b23e0 con 0x7ff2040d0200 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff203400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204160280 0x7ff2040c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff203400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204160280 0x7ff2040c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33284/0 (socket says 172.21.15.17:33284) 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff203400640 1 -- 172.21.15.17:0/3707627873 learned_addr learned my addr 172.21.15.17:0/3707627873 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff1fbe00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2040d2830 0x7ff2040cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff202a00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2040d0200 0x7ff2040cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff203400640 1 -- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2040d0200 msgr2=0x7ff2040cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff203400640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2040d0200 0x7ff2040cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff203400640 1 -- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2040d2830 msgr2=0x7ff2040cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff203400640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2040d2830 0x7ff2040cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff203400640 1 -- 172.21.15.17:0/3707627873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff204156b10 con 0x7ff204160280 2024-09-10T23:19:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff203400640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204160280 0x7ff2040c7af0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00c780 tx=0x7ff1fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff1faa00640 1 -- 172.21.15.17:0/3707627873 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc003b80 con 0x7ff204160280 2024-09-10T23:19:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff1faa00640 1 -- 172.21.15.17:0/3707627873 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1fc003d20 con 0x7ff204160280 2024-09-10T23:19:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff1faa00640 1 -- 172.21.15.17:0/3707627873 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc00aab0 con 0x7ff204160280 2024-09-10T23:19:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff204156df0 con 0x7ff204160280 2024-09-10T23:19:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.405+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff204153d50 con 0x7ff204160280 2024-09-10T23:19:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.409+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2040b28d0 con 0x7ff204160280 2024-09-10T23:19:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.409+0000 7ff1faa00640 1 -- 172.21.15.17:0/3707627873 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff1fc00ac50 con 0x7ff204160280 2024-09-10T23:19:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.409+0000 7ff1faa00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1e00725e0 0x7ff1e0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.409+0000 7ff1faa00640 1 -- 172.21.15.17:0/3707627873 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5335+0+0 (secure 0 0 0) 0x7ff1fc092e90 con 0x7ff204160280 2024-09-10T23:19:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.409+0000 7ff202a00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1e00725e0 0x7ff1e0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.409+0000 7ff202a00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1e00725e0 0x7ff1e0074aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4001870 tx=0x7ff1f4001380 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.413+0000 7ff1faa00640 1 -- 172.21.15.17:0/3707627873 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff1fc05dff0 con 0x7ff204160280 2024-09-10T23:19:47.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff204156fc0 con 0x7ff204160280 2024-09-10T23:19:47.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff1faa00640 1 -- 172.21.15.17:0/3707627873 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+13245 (secure 0 0 0) 0x7ff1fc062a20 con 0x7ff204160280 2024-09-10T23:19:47.597 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:47.598 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":62,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:19:46.228800+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6834/1323392007":"2024-09-11T23:19:43.216986+0000","172.21.15.17:6832/1323392007":"2024-09-11T23:19:43.216986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:19:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1e00725e0 msgr2=0x7ff1e0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1e00725e0 0x7ff1e0074aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4001870 tx=0x7ff1f4001380 comp rx=0 tx=0).stop 2024-09-10T23:19:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204160280 msgr2=0x7ff2040c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204160280 0x7ff2040c7af0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00c780 tx=0x7ff1fc00cc40 comp rx=0 tx=0).stop 2024-09-10T23:19:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 shutdown_connections 2024-09-10T23:19:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1e00725e0 0x7ff1e0074aa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff204160280 0x7ff2040c7af0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2040d2830 0x7ff2040cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 --2- 172.21.15.17:0/3707627873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2040d0200 0x7ff2040cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 >> 172.21.15.17:0/3707627873 conn(0x7ff2040d1d10 msgr2=0x7ff2040b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 shutdown_connections 2024-09-10T23:19:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.593+0000 7ff209a00640 1 -- 172.21.15.17:0/3707627873 wait complete. 2024-09-10T23:19:47.621 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:19:47.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:19:47.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.765+0000 7f00c8e00640 1 -- 172.21.15.17:0/1746692275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8003a40 msgr2=0x7f00a8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.765+0000 7f00c8e00640 1 --2- 172.21.15.17:0/1746692275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00a8003a40 0x7f00a8003e60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f00b400c610 tx=0x7f00b401cf60 comp rx=0 tx=0).stop 2024-09-10T23:19:47.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.765+0000 7f00c2800640 1 -- 172.21.15.17:0/1746692275 reap_dead start 2024-09-10T23:19:47.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.765+0000 7f00c8e00640 1 -- 172.21.15.17:0/1746692275 shutdown_connections 2024-09-10T23:19:47.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.765+0000 7f00c8e00640 1 -- 172.21.15.17:0/1746692275 >> 172.21.15.17:0/1746692275 conn(0x7f00c40b17a0 msgr2=0x7f00c40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:47.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.765+0000 7f00c8e00640 1 -- 172.21.15.17:0/1746692275 shutdown_connections 2024-09-10T23:19:47.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.765+0000 7f00c8e00640 1 -- 172.21.15.17:0/1746692275 wait complete. 2024-09-10T23:19:47.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c8e00640 1 Processor -- start 2024-09-10T23:19:47.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c8e00640 1 -- start start 2024-09-10T23:19:47.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c8e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00a8003a40 0x7f00c41398b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c8e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00c41551c0 0x7f00c415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00c413d550 0x7f00c415e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c8e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4167c90 con 0x7f00c413d550 2024-09-10T23:19:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c8e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4167b10 con 0x7f00a8003a40 2024-09-10T23:19:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c8e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f00c4167e10 con 0x7f00c41551c0 2024-09-10T23:19:47.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00c413d550 0x7f00c415e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:47.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c1e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00a8003a40 0x7f00c41398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:47.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00c413d550 0x7f00c415e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33300/0 (socket says 172.21.15.17:33300) 2024-09-10T23:19:47.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c2800640 1 -- 172.21.15.17:0/1537039820 learned_addr learned my addr 172.21.15.17:0/1537039820 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:47.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00bbe00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00c41551c0 0x7f00c415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:47.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c2800640 1 -- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00c41551c0 msgr2=0x7f00c415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c2800640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00c41551c0 0x7f00c415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c2800640 1 -- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00a8003a40 msgr2=0x7f00c41398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c2800640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00a8003a40 0x7f00c41398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c2800640 1 -- 172.21.15.17:0/1537039820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c41559d0 con 0x7f00c413d550 2024-09-10T23:19:47.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c1e00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00a8003a40 0x7f00c41398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:47.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c2800640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00c413d550 0x7f00c415e200 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f00c4072640 tx=0x7f00bc00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00ba000640 1 -- 172.21.15.17:0/1537039820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc003980 con 0x7f00c413d550 2024-09-10T23:19:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00ba000640 1 -- 172.21.15.17:0/1537039820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00bc003b20 con 0x7f00c413d550 2024-09-10T23:19:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00ba000640 1 -- 172.21.15.17:0/1537039820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc004030 con 0x7f00c413d550 2024-09-10T23:19:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.769+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c4139f20 con 0x7f00c413d550 2024-09-10T23:19:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.773+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c413a4e0 con 0x7f00c413d550 2024-09-10T23:19:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.773+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c40741d0 con 0x7f00c413d550 2024-09-10T23:19:47.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.773+0000 7f00ba000640 1 -- 172.21.15.17:0/1537039820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f00bc018070 con 0x7f00c413d550 2024-09-10T23:19:47.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.773+0000 7f00ba000640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00a0072610 0x7f00a0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:47.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.773+0000 7f00ba000640 1 -- 172.21.15.17:0/1537039820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5335+0+0 (secure 0 0 0) 0x7f00bc093930 con 0x7f00c413d550 2024-09-10T23:19:47.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.773+0000 7f00c1e00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00a0072610 0x7f00a0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:47.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.777+0000 7f00c1e00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00a0072610 0x7f00a0074ad0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f00b40aa000 tx=0x7f00b4019da0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:47.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.777+0000 7f00ba000640 1 -- 172.21.15.17:0/1537039820 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f00bc05eb20 con 0x7f00c413d550 2024-09-10T23:19:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.953+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f00c40cfb80 con 0x7f00c413d550 2024-09-10T23:19:47.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.953+0000 7f00ba000640 1 -- 172.21.15.17:0/1537039820 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) ==== 93+0+10 (secure 0 0 0) 0x7f00bc063550 con 0x7f00c413d550 2024-09-10T23:19:47.959 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:19:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00a0072610 msgr2=0x7f00a0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00a0072610 0x7f00a0074ad0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f00b40aa000 tx=0x7f00b4019da0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00c413d550 msgr2=0x7f00c415e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00c413d550 0x7f00c415e200 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f00c4072640 tx=0x7f00bc00f3c0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 shutdown_connections 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00a0072610 0x7f00a0074ad0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00c413d550 0x7f00c415e200 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00c41551c0 0x7f00c415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 --2- 172.21.15.17:0/1537039820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00a8003a40 0x7f00c41398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 >> 172.21.15.17:0/1537039820 conn(0x7f00c40b17a0 msgr2=0x7f00c4155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 shutdown_connections 2024-09-10T23:19:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:47.957+0000 7f00c8e00640 1 -- 172.21.15.17:0/1537039820 wait complete. 2024-09-10T23:19:47.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-10T23:19:48.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 -- 172.21.15.17:0/2223175067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ca8004810 msgr2=0x7f3ca8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 --2- 172.21.15.17:0/2223175067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ca8004810 0x7f3ca8004c90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0016f0 tx=0x7f3cac01c7b0 comp rx=0 tx=0).stop 2024-09-10T23:19:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc5c00640 1 -- 172.21.15.17:0/2223175067 reap_dead start 2024-09-10T23:19:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 -- 172.21.15.17:0/2223175067 shutdown_connections 2024-09-10T23:19:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 -- 172.21.15.17:0/2223175067 >> 172.21.15.17:0/2223175067 conn(0x7f3cc00d3ce0 msgr2=0x7f3cc00d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 -- 172.21.15.17:0/2223175067 shutdown_connections 2024-09-10T23:19:48.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 -- 172.21.15.17:0/2223175067 wait complete. 2024-09-10T23:19:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 Processor -- start 2024-09-10T23:19:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 -- start start 2024-09-10T23:19:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca8004810 0x7f3cc014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cc015b350 0x7f3cc0152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3cc00c9870 0x7f3cc00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc00cfbb0 con 0x7f3cc015b350 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc015e1f0 con 0x7f3ca8004810 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc00b7dc0 con 0x7f3cc00c9870 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cbfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cc015b350 0x7f3cc0152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cbfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cc015b350 0x7f3cc0152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33324/0 (socket says 172.21.15.17:33324) 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cbfe00640 1 -- 172.21.15.17:0/2711987634 learned_addr learned my addr 172.21.15.17:0/2711987634 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc5c00640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3cc00c9870 0x7f3cc00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc5200640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca8004810 0x7f3cc014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cbfe00640 1 -- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3cc00c9870 msgr2=0x7f3cc00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:48.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cbfe00640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3cc00c9870 0x7f3cc00c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cbfe00640 1 -- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca8004810 msgr2=0x7f3cc014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cbfe00640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca8004810 0x7f3cc014fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cbfe00640 1 -- 172.21.15.17:0/2711987634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc0150300 con 0x7f3cc015b350 2024-09-10T23:19:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc5c00640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3cc00c9870 0x7f3cc00c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cc5200640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca8004810 0x7f3cc014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.125+0000 7f3cbfe00640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cc015b350 0x7f3cc0152290 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3cac01b080 tx=0x7f3cac0013a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.129+0000 7f3cbcc00640 1 -- 172.21.15.17:0/2711987634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0a5820 con 0x7f3cc015b350 2024-09-10T23:19:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.129+0000 7f3cbcc00640 1 -- 172.21.15.17:0/2711987634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cac0a5ab0 con 0x7f3cc015b350 2024-09-10T23:19:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.129+0000 7f3cbcc00640 1 -- 172.21.15.17:0/2711987634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac003600 con 0x7f3cc015b350 2024-09-10T23:19:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.129+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc0152bb0 con 0x7f3cc015b350 2024-09-10T23:19:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.129+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc0153170 con 0x7f3cc015b350 2024-09-10T23:19:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.129+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc00d0830 con 0x7f3cc015b350 2024-09-10T23:19:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.129+0000 7f3cbcc00640 1 -- 172.21.15.17:0/2711987634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3cac0b6020 con 0x7f3cc015b350 2024-09-10T23:19:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.129+0000 7f3cbcc00640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ca00725e0 0x7f3ca0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.129+0000 7f3cbcc00640 1 -- 172.21.15.17:0/2711987634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5335+0+0 (secure 0 0 0) 0x7f3cac12cb10 con 0x7f3cc015b350 2024-09-10T23:19:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.133+0000 7f3cc5200640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ca00725e0 0x7f3ca0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:48.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.133+0000 7f3cc5200640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ca00725e0 0x7f3ca0074aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4000fc0 tx=0x7f3cb4001e60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:48.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.133+0000 7f3cbcc00640 1 -- 172.21.15.17:0/2711987634 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3cac016510 con 0x7f3cc015b350 2024-09-10T23:19:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:48.373+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f3cc00b77e0 con 0x7f3cc015b350 2024-09-10T23:19:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.237+0000 7f3cbcc00640 1 -- 172.21.15.17:0/2711987634 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v210) ==== 154+0+0 (secure 0 0 0) 0x7f3cac0f83d0 con 0x7f3cc015b350 2024-09-10T23:19:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ca00725e0 msgr2=0x7f3ca0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ca00725e0 0x7f3ca0074aa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4000fc0 tx=0x7f3cb4001e60 comp rx=0 tx=0).stop 2024-09-10T23:19:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cc015b350 msgr2=0x7f3cc0152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cc015b350 0x7f3cc0152290 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3cac01b080 tx=0x7f3cac0013a0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 shutdown_connections 2024-09-10T23:19:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ca00725e0 0x7f3ca0074aa0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3cc00c9870 0x7f3cc00c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cc015b350 0x7f3cc0152290 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 --2- 172.21.15.17:0/2711987634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ca8004810 0x7f3cc014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 >> 172.21.15.17:0/2711987634 conn(0x7f3cc00d3ce0 msgr2=0x7f3cc00cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 shutdown_connections 2024-09-10T23:19:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.241+0000 7f3cc6600640 1 -- 172.21.15.17:0/2711987634 wait complete. 2024-09-10T23:19:49.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:19:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 -- 172.21.15.17:0/2717207705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 msgr2=0x7f4ec80b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 --2- 172.21.15.17:0/2717207705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 0x7f4ec80b1430 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009840 tx=0x7f4ec001c790 comp rx=0 tx=0).stop 2024-09-10T23:19:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 -- 172.21.15.17:0/2717207705 shutdown_connections 2024-09-10T23:19:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 --2- 172.21.15.17:0/2717207705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 0x7f4ec80b1430 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 --2- 172.21.15.17:0/2717207705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ec815f730 0x7f4ec80b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 -- 172.21.15.17:0/2717207705 >> 172.21.15.17:0/2717207705 conn(0x7f4ec80d1d10 msgr2=0x7f4ec80d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 -- 172.21.15.17:0/2717207705 shutdown_connections 2024-09-10T23:19:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 -- 172.21.15.17:0/2717207705 wait complete. 2024-09-10T23:19:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 Processor -- start 2024-09-10T23:19:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.417+0000 7f4ecd200640 1 -- start start 2024-09-10T23:19:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ecd200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 0x7f4ec80c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ecd200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ec815f350 0x7f4ec8159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ecd200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ec815f730 0x7f4ec81f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ecd200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec8168bd0 con 0x7f4ec80cee30 2024-09-10T23:19:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ecd200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec80b2440 con 0x7f4ec815f730 2024-09-10T23:19:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ecd200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec8168d50 con 0x7f4ec815f350 2024-09-10T23:19:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 0x7f4ec80c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 0x7f4ec80c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33338/0 (socket says 172.21.15.17:33338) 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec5e00640 1 -- 172.21.15.17:0/1304533742 learned_addr learned my addr 172.21.15.17:0/1304533742 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec6800640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ec815f730 0x7f4ec81f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ebd400640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ec815f350 0x7f4ec8159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec5e00640 1 -- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ec815f350 msgr2=0x7f4ec8159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec5e00640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ec815f350 0x7f4ec8159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec5e00640 1 -- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ec815f730 msgr2=0x7f4ec81f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec5e00640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ec815f730 0x7f4ec81f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec5e00640 1 -- 172.21.15.17:0/1304533742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec80c6700 con 0x7f4ec80cee30 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec6800640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ec815f730 0x7f4ec81f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:49.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ec5e00640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 0x7f4ec80c61c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800cbd0 tx=0x7f4eb800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ebea00640 1 -- 172.21.15.17:0/1304533742 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8016020 con 0x7f4ec80cee30 2024-09-10T23:19:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ebea00640 1 -- 172.21.15.17:0/1304533742 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4eb800aa50 con 0x7f4ec80cee30 2024-09-10T23:19:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ebea00640 1 -- 172.21.15.17:0/1304533742 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8012420 con 0x7f4ec80cee30 2024-09-10T23:19:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec80b4eb0 con 0x7f4ec80cee30 2024-09-10T23:19:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec80b5750 con 0x7f4ec80cee30 2024-09-10T23:19:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec80b1430 con 0x7f4ec80cee30 2024-09-10T23:19:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.421+0000 7f4ebea00640 1 -- 172.21.15.17:0/1304533742 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4eb801b400 con 0x7f4ec80cee30 2024-09-10T23:19:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.425+0000 7f4ebea00640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ea40725e0 0x7f4ea4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.425+0000 7f4ebea00640 1 -- 172.21.15.17:0/1304533742 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5335+0+0 (secure 0 0 0) 0x7f4eb8093610 con 0x7f4ec80cee30 2024-09-10T23:19:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.425+0000 7f4ebd400640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ea40725e0 0x7f4ea4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:49.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.425+0000 7f4ebd400640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ea40725e0 0x7f4ea4074aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4ec815ed30 tx=0x7f4eb000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.429+0000 7f4ebea00640 1 -- 172.21.15.17:0/1304533742 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4eb8020020 con 0x7f4ec80cee30 2024-09-10T23:19:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.601+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4ec80d2500 con 0x7f4ec80cee30 2024-09-10T23:19:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.601+0000 7f4ebea00640 1 -- 172.21.15.17:0/1304533742 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+1998 (secure 0 0 0) 0x7f4ec80c6700 con 0x7f4ec80cee30 2024-09-10T23:19:49.607 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:19:49.607 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:19:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:19:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:19:49.610 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:19:49.610 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ea40725e0 msgr2=0x7f4ea4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ea40725e0 0x7f4ea4074aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4ec815ed30 tx=0x7f4eb000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 msgr2=0x7f4ec80c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 0x7f4ec80c61c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800cbd0 tx=0x7f4eb800ccc0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 shutdown_connections 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ea40725e0 0x7f4ea4074aa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ec815f730 0x7f4ec81f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ec815f350 0x7f4ec8159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 --2- 172.21.15.17:0/1304533742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ec80cee30 0x7f4ec80c61c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 >> 172.21.15.17:0/1304533742 conn(0x7f4ec80d1d10 msgr2=0x7f4ec80afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:49.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 shutdown_connections 2024-09-10T23:19:49.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.605+0000 7f4ecd200640 1 -- 172.21.15.17:0/1304533742 wait complete. 2024-09-10T23:19:49.629 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:19:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.773+0000 7ff5c5400640 1 -- 172.21.15.17:0/837524496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 msgr2=0x7ff5a4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.773+0000 7ff5c5400640 1 --2- 172.21.15.17:0/837524496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 0x7ff5a4003e80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009b60 tx=0x7ff5b001d270 comp rx=0 tx=0).stop 2024-09-10T23:19:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.773+0000 7ff5c5400640 1 -- 172.21.15.17:0/837524496 shutdown_connections 2024-09-10T23:19:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.773+0000 7ff5c5400640 1 --2- 172.21.15.17:0/837524496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 0x7ff5a4003e80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.773+0000 7ff5c5400640 1 -- 172.21.15.17:0/837524496 >> 172.21.15.17:0/837524496 conn(0x7ff5c00b17a0 msgr2=0x7ff5c00b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.773+0000 7ff5c5400640 1 -- 172.21.15.17:0/837524496 shutdown_connections 2024-09-10T23:19:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.773+0000 7ff5c5400640 1 -- 172.21.15.17:0/837524496 wait complete. 2024-09-10T23:19:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 Processor -- start 2024-09-10T23:19:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 -- start start 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 0x7ff5c013ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5c0140cd0 0x7ff5c013d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5c015a5b0 0x7ff5c015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0073620 con 0x7ff5a4003a60 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c00734a0 con 0x7ff5c0140cd0 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff5c00737a0 con 0x7ff5c015a5b0 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5be800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 0x7ff5c013ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5be800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 0x7ff5c013ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33364/0 (socket says 172.21.15.17:33364) 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5be800640 1 -- 172.21.15.17:0/2341314667 learned_addr learned my addr 172.21.15.17:0/2341314667 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5bde00640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5c0140cd0 0x7ff5c013d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5bf200640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5c015a5b0 0x7ff5c015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5be800640 1 -- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5c015a5b0 msgr2=0x7ff5c015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5be800640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5c015a5b0 0x7ff5c015aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5be800640 1 -- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5c0140cd0 msgr2=0x7ff5c013d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5be800640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5c0140cd0 0x7ff5c013d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5be800640 1 -- 172.21.15.17:0/2341314667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c013f6e0 con 0x7ff5a4003a60 2024-09-10T23:19:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5be800640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 0x7ff5c013ef70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00af040 tx=0x7ff5b0005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5b6a00640 1 -- 172.21.15.17:0/2341314667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b00b1040 con 0x7ff5a4003a60 2024-09-10T23:19:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5b6a00640 1 -- 172.21.15.17:0/2341314667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5b0004120 con 0x7ff5a4003a60 2024-09-10T23:19:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5b6a00640 1 -- 172.21.15.17:0/2341314667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b00ac7b0 con 0x7ff5a4003a60 2024-09-10T23:19:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c013f9c0 con 0x7ff5a4003a60 2024-09-10T23:19:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.777+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c013d970 con 0x7ff5a4003a60 2024-09-10T23:19:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.781+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c013fe70 con 0x7ff5a4003a60 2024-09-10T23:19:49.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.781+0000 7ff5b6a00640 1 -- 172.21.15.17:0/2341314667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff5b00ac950 con 0x7ff5a4003a60 2024-09-10T23:19:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.781+0000 7ff5b6a00640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5a00725e0 0x7ff5a0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.781+0000 7ff5b6a00640 1 -- 172.21.15.17:0/2341314667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5335+0+0 (secure 0 0 0) 0x7ff5b012df60 con 0x7ff5a4003a60 2024-09-10T23:19:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.781+0000 7ff5bde00640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5a00725e0 0x7ff5a0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:49.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.785+0000 7ff5bde00640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5a00725e0 0x7ff5a0074aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0052940 tx=0x7ff5ac006730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:49.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.785+0000 7ff5b6a00640 1 -- 172.21.15.17:0/2341314667 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff5b0016f80 con 0x7ff5a4003a60 2024-09-10T23:19:49.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.961+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff5c015c2a0 con 0x7ff5a4003a60 2024-09-10T23:19:49.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.965+0000 7ff5b6a00640 1 -- 172.21.15.17:0/2341314667 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7ff5b00f9150 con 0x7ff5a4003a60 2024-09-10T23:19:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5a00725e0 msgr2=0x7ff5a0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5a00725e0 0x7ff5a0074aa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0052940 tx=0x7ff5ac006730 comp rx=0 tx=0).stop 2024-09-10T23:19:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 msgr2=0x7ff5c013ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 0x7ff5c013ef70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00af040 tx=0x7ff5b0005520 comp rx=0 tx=0).stop 2024-09-10T23:19:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 shutdown_connections 2024-09-10T23:19:49.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5a00725e0 0x7ff5a0074aa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5c015a5b0 0x7ff5c015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5c0140cd0 0x7ff5c013d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 --2- 172.21.15.17:0/2341314667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5a4003a60 0x7ff5c013ef70 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:49.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 >> 172.21.15.17:0/2341314667 conn(0x7ff5c00b17a0 msgr2=0x7ff5c006fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:49.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 shutdown_connections 2024-09-10T23:19:49.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:49.969+0000 7ff5c5400640 1 -- 172.21.15.17:0/2341314667 wait complete. 2024-09-10T23:19:49.993 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:19:49.994 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:19:50.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:19:50.168 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:19:50.168 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:19:50.168 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:50.177 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:19:50.177 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:19:50.177 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:50.185 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:19:50.185 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:19:50.185 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:50.231 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:19:50.231 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:19:50.231 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:19:50.239 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:19:50.239 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:19:50.240 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 -- 172.21.15.17:0/2729986150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 msgr2=0x7fe8b80cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 --2- 172.21.15.17:0/2729986150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 0x7fe8b80cfa20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80cf530 tx=0x7fe8a801c890 comp rx=0 tx=0).stop 2024-09-10T23:19:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 -- 172.21.15.17:0/2729986150 shutdown_connections 2024-09-10T23:19:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 --2- 172.21.15.17:0/2729986150 >> v2:172.21.15.77:3300/0 conn(0x7fe8b80d20a0 0x7fe8b80b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 --2- 172.21.15.17:0/2729986150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 0x7fe8b80cfa20 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 -- 172.21.15.17:0/2729986150 >> 172.21.15.17:0/2729986150 conn(0x7fe8b809a9f0 msgr2=0x7fe8b809add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:50.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 -- 172.21.15.17:0/2729986150 shutdown_connections 2024-09-10T23:19:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 -- 172.21.15.17:0/2729986150 wait complete. 2024-09-10T23:19:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 Processor -- start 2024-09-10T23:19:50.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.417+0000 7fe8bd000640 1 -- start start 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8bd000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8b80cc570 0x7fe8b815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8bd000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8b80d20a0 0x7fe8b8156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8bd000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 0x7fe8b80aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8bd000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b81688a0 con 0x7fe8b815bc70 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8bd000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b8168720 con 0x7fe8b80d20a0 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8bd000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe8b8168a20 con 0x7fe8b80cc570 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 0x7fe8b80aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 0x7fe8b80aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33376/0 (socket says 172.21.15.17:33376) 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7e00640 1 -- 172.21.15.17:0/4182262349 learned_addr learned my addr 172.21.15.17:0/4182262349 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8afe00640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8b80d20a0 0x7fe8b8156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:50.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7400640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8b80cc570 0x7fe8b815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:50.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7e00640 1 -- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8b80cc570 msgr2=0x7fe8b815ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:50.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7e00640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8b80cc570 0x7fe8b815ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7e00640 1 -- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8b80d20a0 msgr2=0x7fe8b8156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7e00640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8b80d20a0 0x7fe8b8156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7e00640 1 -- 172.21.15.17:0/4182262349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b806dcd0 con 0x7fe8b815bc70 2024-09-10T23:19:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8b7e00640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 0x7fe8b80aeb40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000eb20 tx=0x7fe8b000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8af400640 1 -- 172.21.15.17:0/4182262349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0004b30 con 0x7fe8b815bc70 2024-09-10T23:19:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8af400640 1 -- 172.21.15.17:0/4182262349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8b0004cf0 con 0x7fe8b815bc70 2024-09-10T23:19:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8af400640 1 -- 172.21.15.17:0/4182262349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0005280 con 0x7fe8b815bc70 2024-09-10T23:19:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b815b110 con 0x7fe8b815bc70 2024-09-10T23:19:50.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b8164640 con 0x7fe8b815bc70 2024-09-10T23:19:50.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8b815a390 con 0x7fe8b815bc70 2024-09-10T23:19:50.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.421+0000 7fe8af400640 1 -- 172.21.15.17:0/4182262349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe8b0005420 con 0x7fe8b815bc70 2024-09-10T23:19:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.425+0000 7fe8af400640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8940725e0 0x7fe894074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.425+0000 7fe8af400640 1 -- 172.21.15.17:0/4182262349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5335+0+0 (secure 0 0 0) 0x7fe8b0093d60 con 0x7fe8b815bc70 2024-09-10T23:19:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.425+0000 7fe8b7400640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8940725e0 0x7fe894074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:50.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.425+0000 7fe8b7400640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8940725e0 0x7fe894074aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80af000 tx=0x7fe8a801b0d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:50.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.429+0000 7fe8af400640 1 -- 172.21.15.17:0/4182262349 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe8b005eec0 con 0x7fe8b815bc70 2024-09-10T23:19:50.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.637+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8b80b2cf0 con 0x7fe8b815bc70 2024-09-10T23:19:50.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.637+0000 7fe8af400640 1 -- 172.21.15.17:0/4182262349 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+3911 (secure 0 0 0) 0x7fe8b00638f0 con 0x7fe8b815bc70 2024-09-10T23:19:50.644 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:50.644 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":34,"btime":"2024-09-10T23:19:44:219221+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1801943144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1801943144},{"type":"v1","addr":"172.21.15.77:6837","nonce":1801943144}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2387800472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2387800472},{"type":"v1","addr":"172.21.15.77:6835","nonce":2387800472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1881542084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1881542084},{"type":"v1","addr":"172.21.15.17:6835","nonce":1881542084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":6303,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2128405930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2128405930},{"type":"v1","addr":"172.21.15.17:6834","nonce":2128405930}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[]} 2024-09-10T23:19:50.644 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 34 2024-09-10T23:19:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8940725e0 msgr2=0x7fe894074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8940725e0 0x7fe894074aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80af000 tx=0x7fe8a801b0d0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 msgr2=0x7fe8b80aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 0x7fe8b80aeb40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000eb20 tx=0x7fe8b000c2d0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 shutdown_connections 2024-09-10T23:19:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8940725e0 0x7fe894074aa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8b815bc70 0x7fe8b80aeb40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8b80d20a0 0x7fe8b8156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 --2- 172.21.15.17:0/4182262349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8b80cc570 0x7fe8b815ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 >> 172.21.15.17:0/4182262349 conn(0x7fe8b809a9f0 msgr2=0x7fe8b8159850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 shutdown_connections 2024-09-10T23:19:50.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.641+0000 7fe8bd000640 1 -- 172.21.15.17:0/4182262349 wait complete. 2024-09-10T23:19:50.667 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:19:50.667 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:19:50.667 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:19:50.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:50.667 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:19:50.667 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:19:50.668 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:19:50.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:50.668 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:19:50.668 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:19:50.668 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:19:50.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:50.669 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:19:50.669 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:19:50.669 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:19:50.669 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:19:50.680 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:19:50.680 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:19:50.681 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:19:50.681 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:19:50.683 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:19:50.683 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:19:50.684 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:19:50.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:19:50.726 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:19:50.727 DEBUG:teuthology.parallel:result is None 2024-09-10T23:19:50.728 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:19:50.729 DEBUG:teuthology.parallel:result is None 2024-09-10T23:19:50.732 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:19:50.732 DEBUG:teuthology.parallel:result is None 2024-09-10T23:19:50.734 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:19:50.734 DEBUG:teuthology.parallel:result is None 2024-09-10T23:19:50.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:19:50.815 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:19:50.815 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:19:50.816 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:19:50.816 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:19:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.881+0000 7f9867200640 1 -- 172.21.15.17:0/1754994002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98600af8d0 msgr2=0x7f98600afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.881+0000 7f9867200640 1 --2- 172.21.15.17:0/1754994002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98600af8d0 0x7f98600afd20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9858009bc0 tx=0x7f985801cba0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.881+0000 7f9867200640 1 -- 172.21.15.17:0/1754994002 shutdown_connections 2024-09-10T23:19:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.881+0000 7f9867200640 1 --2- 172.21.15.17:0/1754994002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98600af8d0 0x7f98600afd20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.881+0000 7f9867200640 1 --2- 172.21.15.17:0/1754994002 >> v2:172.21.15.77:3300/0 conn(0x7f986015be40 0x7f98600cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.881+0000 7f9867200640 1 -- 172.21.15.17:0/1754994002 >> 172.21.15.17:0/1754994002 conn(0x7f98600d1d60 msgr2=0x7f98600d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.881+0000 7f9867200640 1 -- 172.21.15.17:0/1754994002 shutdown_connections 2024-09-10T23:19:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.881+0000 7f9867200640 1 -- 172.21.15.17:0/1754994002 wait complete. 2024-09-10T23:19:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 Processor -- start 2024-09-10T23:19:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 -- start start 2024-09-10T23:19:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98600af8d0 0x7f986006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98600b3360 0x7f98600b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986015be40 0x7f98600b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9860168e10 con 0x7f986015be40 2024-09-10T23:19:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9860168c90 con 0x7f98600b3360 2024-09-10T23:19:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9860168f90 con 0x7f98600af8d0 2024-09-10T23:19:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9865200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986015be40 0x7f98600b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9865200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986015be40 0x7f98600b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33410/0 (socket says 172.21.15.17:33410) 2024-09-10T23:19:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f985fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98600af8d0 0x7f986006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9865200640 1 -- 172.21.15.17:0/1761688525 learned_addr learned my addr 172.21.15.17:0/1761688525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f985f400640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98600b3360 0x7f98600b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9865200640 1 -- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98600af8d0 msgr2=0x7f986006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9865200640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98600af8d0 0x7f986006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9865200640 1 -- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98600b3360 msgr2=0x7f98600b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9865200640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98600b3360 0x7f98600b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9865200640 1 -- 172.21.15.17:0/1761688525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98600c7610 con 0x7f986015be40 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f985fe00640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98600af8d0 0x7f986006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9865200640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986015be40 0x7f98600b6410 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f985801a7d0 tx=0x7f9858003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9857e00640 1 -- 172.21.15.17:0/1761688525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98580b2040 con 0x7f986015be40 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9857e00640 1 -- 172.21.15.17:0/1761688525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9858004c50 con 0x7f986015be40 2024-09-10T23:19:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9857e00640 1 -- 172.21.15.17:0/1761688525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858003fd0 con 0x7f986015be40 2024-09-10T23:19:50.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98600c78f0 con 0x7f986015be40 2024-09-10T23:19:50.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986006f6f0 con 0x7f986015be40 2024-09-10T23:19:50.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.885+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98600c7fb0 con 0x7f986015be40 2024-09-10T23:19:50.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.889+0000 7f9857e00640 1 -- 172.21.15.17:0/1761688525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f98580b5070 con 0x7f986015be40 2024-09-10T23:19:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.889+0000 7f9857e00640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98400725e0 0x7f9840074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.889+0000 7f9857e00640 1 -- 172.21.15.17:0/1761688525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5335+0+0 (secure 0 0 0) 0x7f985812ca20 con 0x7f986015be40 2024-09-10T23:19:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.889+0000 7f985fe00640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98400725e0 0x7f9840074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.889+0000 7f985fe00640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98400725e0 0x7f9840074aa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9850009f30 tx=0x7f98500091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:50.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:50.893+0000 7f9857e00640 1 -- 172.21.15.17:0/1761688525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f98600c7fb0 con 0x7f986015be40 2024-09-10T23:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.077+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f98600afd20 con 0x7f986015be40 2024-09-10T23:19:51.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.249+0000 7f9857e00640 1 -- 172.21.15.17:0/1761688525 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) ==== 97+0+0 (secure 0 0 0) 0x7f9858016790 con 0x7f986015be40 2024-09-10T23:19:51.254 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:19:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98400725e0 msgr2=0x7f9840074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98400725e0 0x7f9840074aa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9850009f30 tx=0x7f98500091e0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986015be40 msgr2=0x7f98600b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986015be40 0x7f98600b6410 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f985801a7d0 tx=0x7f9858003f60 comp rx=0 tx=0).stop 2024-09-10T23:19:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 shutdown_connections 2024-09-10T23:19:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98400725e0 0x7f9840074aa0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986015be40 0x7f98600b6410 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98600b3360 0x7f98600b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 --2- 172.21.15.17:0/1761688525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98600af8d0 0x7f986006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 >> 172.21.15.17:0/1761688525 conn(0x7f98600d1d60 msgr2=0x7f98600cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 shutdown_connections 2024-09-10T23:19:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.253+0000 7f9867200640 1 -- 172.21.15.17:0/1761688525 wait complete. 2024-09-10T23:19:51.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:19:51.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.421+0000 7f83c0800640 1 -- 172.21.15.17:0/3964419151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b8070ad0 msgr2=0x7f83b815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.421+0000 7f83c0800640 1 --2- 172.21.15.17:0/3964419151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b8070ad0 0x7f83b815f060 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f83b80cf010 tx=0x7f83ac01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.421+0000 7f83c0800640 1 -- 172.21.15.17:0/3964419151 shutdown_connections 2024-09-10T23:19:51.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.421+0000 7f83c0800640 1 --2- 172.21.15.17:0/3964419151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83b80d1830 0x7f83b815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.421+0000 7f83c0800640 1 --2- 172.21.15.17:0/3964419151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b8070ad0 0x7f83b815f060 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.421+0000 7f83c0800640 1 -- 172.21.15.17:0/3964419151 >> 172.21.15.17:0/3964419151 conn(0x7f83b80d1d60 msgr2=0x7f83b80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.421+0000 7f83c0800640 1 -- 172.21.15.17:0/3964419151 shutdown_connections 2024-09-10T23:19:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.421+0000 7f83c0800640 1 -- 172.21.15.17:0/3964419151 wait complete. 2024-09-10T23:19:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 Processor -- start 2024-09-10T23:19:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 -- start start 2024-09-10T23:19:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b8070ad0 0x7f83b806e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b80cf320 0x7f83b80b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83b80d1830 0x7f83b80b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81693d0 con 0x7f83b80cf320 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8169250 con 0x7f83b8070ad0 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f83b8169550 con 0x7f83b80d1830 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b80cf320 0x7f83b80b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bde00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b8070ad0 0x7f83b806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b80cf320 0x7f83b80b71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33426/0 (socket says 172.21.15.17:33426) 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bd400640 1 -- 172.21.15.17:0/1756276406 learned_addr learned my addr 172.21.15.17:0/1756276406 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bde00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b8070ad0 0x7f83b806e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:52894/0 (socket says 172.21.15.17:52894) 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83be800640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83b80d1830 0x7f83b80b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bd400640 1 -- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83b80d1830 msgr2=0x7f83b80b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bd400640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83b80d1830 0x7f83b80b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bd400640 1 -- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b8070ad0 msgr2=0x7f83b806e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bd400640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b8070ad0 0x7f83b806e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bd400640 1 -- 172.21.15.17:0/1756276406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b806eff0 con 0x7f83b80cf320 2024-09-10T23:19:51.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83bd400640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b80cf320 0x7f83b80b71d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f83a800c9f0 tx=0x7f83a800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:51.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83b2000640 1 -- 172.21.15.17:0/1756276406 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8007bb0 con 0x7f83b80cf320 2024-09-10T23:19:51.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83b2000640 1 -- 172.21.15.17:0/1756276406 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83a8007e40 con 0x7f83b80cf320 2024-09-10T23:19:51.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83b2000640 1 -- 172.21.15.17:0/1756276406 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a800f690 con 0x7f83b80cf320 2024-09-10T23:19:51.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b806f2d0 con 0x7f83b80cf320 2024-09-10T23:19:51.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b806f890 con 0x7f83b80cf320 2024-09-10T23:19:51.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.425+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b80cfc60 con 0x7f83b80cf320 2024-09-10T23:19:51.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.429+0000 7f83b2000640 1 -- 172.21.15.17:0/1756276406 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f83a8020030 con 0x7f83b80cf320 2024-09-10T23:19:51.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.429+0000 7f83b2000640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f839c0725e0 0x7f839c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:51.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.429+0000 7f83b2000640 1 -- 172.21.15.17:0/1756276406 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5249+0+0 (secure 0 0 0) 0x7f83a8093450 con 0x7f83b80cf320 2024-09-10T23:19:51.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.429+0000 7f83bde00640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f839c0725e0 0x7f839c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:51.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.429+0000 7f83bde00640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f839c0725e0 0x7f839c074aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0af000 tx=0x7f83ac01b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:51.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.433+0000 7f83b2000640 1 -- 172.21.15.17:0/1756276406 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f83a8014030 con 0x7f83b80cf320 2024-09-10T23:19:51.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.665+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f83b8159070 con 0x7f83b80cf320 2024-09-10T23:19:51.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.665+0000 7f83b2000640 1 -- 172.21.15.17:0/1756276406 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f83a805e690 con 0x7f83b80cf320 2024-09-10T23:19:51.671 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:51.671 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:19:51.671 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:19:51.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.671 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:19:51.671 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:19:51.671 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:19:51.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.674 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:19:51.675 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.676 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:19:51.677 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.679 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:19:51.681 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:19:51.682 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:19:51.685 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:19:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f839c0725e0 msgr2=0x7f839c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f839c0725e0 0x7f839c074aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0af000 tx=0x7f83ac01b120 comp rx=0 tx=0).stop 2024-09-10T23:19:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b80cf320 msgr2=0x7f83b80b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b80cf320 0x7f83b80b71d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f83a800c9f0 tx=0x7f83a800ceb0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 shutdown_connections 2024-09-10T23:19:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f839c0725e0 0x7f839c074aa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83b80d1830 0x7f83b80b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83b80cf320 0x7f83b80b71d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 --2- 172.21.15.17:0/1756276406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83b8070ad0 0x7f83b806e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 >> 172.21.15.17:0/1756276406 conn(0x7f83b80d1d60 msgr2=0x7f83b80d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 shutdown_connections 2024-09-10T23:19:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.669+0000 7f83c0800640 1 -- 172.21.15.17:0/1756276406 wait complete. 2024-09-10T23:19:51.693 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:19:51.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.833+0000 7f7ff4e00640 1 -- 172.21.15.17:0/3105083962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00cf320 msgr2=0x7f7ff00cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.833+0000 7f7ff4e00640 1 --2- 172.21.15.17:0/3105083962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00cf320 0x7f7ff00cd880 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00cf010 tx=0x7f7fe801cda0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.833+0000 7f7ff4e00640 1 -- 172.21.15.17:0/3105083962 shutdown_connections 2024-09-10T23:19:51.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.833+0000 7f7ff4e00640 1 --2- 172.21.15.17:0/3105083962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00cf320 0x7f7ff00cd880 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.833+0000 7f7ff4e00640 1 --2- 172.21.15.17:0/3105083962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ff0070ad0 0x7f7ff015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.833+0000 7f7ff4e00640 1 -- 172.21.15.17:0/3105083962 >> 172.21.15.17:0/3105083962 conn(0x7f7ff00d1d60 msgr2=0x7f7ff00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:51.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.833+0000 7f7ff4e00640 1 -- 172.21.15.17:0/3105083962 shutdown_connections 2024-09-10T23:19:51.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.833+0000 7f7ff4e00640 1 -- 172.21.15.17:0/3105083962 wait complete. 2024-09-10T23:19:51.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 Processor -- start 2024-09-10T23:19:51.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 -- start start 2024-09-10T23:19:51.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ff0070ad0 0x7f7ff0154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:51.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ff00cf320 0x7f7ff0166130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:51.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00d1830 0x7f7ff0166670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff0169460 con 0x7f7ff00d1830 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff01692e0 con 0x7f7ff00cf320 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff01695e0 con 0x7f7ff0070ad0 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fee800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00d1830 0x7f7ff0166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fee800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00d1830 0x7f7ff0166670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33444/0 (socket says 172.21.15.17:33444) 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fee800640 1 -- 172.21.15.17:0/4099184886 learned_addr learned my addr 172.21.15.17:0/4099184886 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fede00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ff0070ad0 0x7f7ff0154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fe7e00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ff00cf320 0x7f7ff0166130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fee800640 1 -- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ff0070ad0 msgr2=0x7f7ff0154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fee800640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ff0070ad0 0x7f7ff0154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fee800640 1 -- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ff00cf320 msgr2=0x7f7ff0166130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fee800640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ff00cf320 0x7f7ff0166130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fee800640 1 -- 172.21.15.17:0/4099184886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff0155310 con 0x7f7ff00d1830 2024-09-10T23:19:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fe7e00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ff00cf320 0x7f7ff0166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fee800640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00d1830 0x7f7ff0166670 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7fe801a9d0 tx=0x7f7fe8003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fe6000640 1 -- 172.21.15.17:0/4099184886 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80bb070 con 0x7f7ff00d1830 2024-09-10T23:19:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fe6000640 1 -- 172.21.15.17:0/4099184886 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fe8004e00 con 0x7f7ff00d1830 2024-09-10T23:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7fe6000640 1 -- 172.21.15.17:0/4099184886 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80b2040 con 0x7f7ff00d1830 2024-09-10T23:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff0155830 con 0x7f7ff00d1830 2024-09-10T23:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.837+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff006f0a0 con 0x7f7ff00d1830 2024-09-10T23:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.841+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff015f060 con 0x7f7ff00d1830 2024-09-10T23:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.841+0000 7f7fe6000640 1 -- 172.21.15.17:0/4099184886 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7fe80b5030 con 0x7f7ff00d1830 2024-09-10T23:19:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.841+0000 7f7fe6000640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fcc072610 0x7f7fcc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.841+0000 7f7fe6000640 1 -- 172.21.15.17:0/4099184886 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5249+0+0 (secure 0 0 0) 0x7f7fe812ce30 con 0x7f7ff00d1830 2024-09-10T23:19:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.841+0000 7f7fede00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fcc072610 0x7f7fcc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.841+0000 7f7fede00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fcc072610 0x7f7fcc074ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0005d90 tx=0x7f7fe000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:51.845+0000 7f7fe6000640 1 -- 172.21.15.17:0/4099184886 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7ff0155830 con 0x7f7ff00d1830 2024-09-10T23:19:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.021+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7ff00b6ab0 con 0x7f7ff00d1830 2024-09-10T23:19:52.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.021+0000 7f7fe6000640 1 -- 172.21.15.17:0/4099184886 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) ==== 84+0+65 (secure 0 0 0) 0x7f7fe8016990 con 0x7f7ff00d1830 2024-09-10T23:19:52.026 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:52.026 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:19:52.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:19:52.026 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:19:52.027 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:19:52.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:19:52.027 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:19:52.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.021+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fcc072610 msgr2=0x7f7fcc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:52.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fcc072610 0x7f7fcc074ad0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0005d90 tx=0x7f7fe000b390 comp rx=0 tx=0).stop 2024-09-10T23:19:52.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00d1830 msgr2=0x7f7ff0166670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00d1830 0x7f7ff0166670 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7fe801a9d0 tx=0x7f7fe8003f60 comp rx=0 tx=0).stop 2024-09-10T23:19:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 shutdown_connections 2024-09-10T23:19:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7fcc072610 0x7f7fcc074ad0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ff00d1830 0x7f7ff0166670 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ff00cf320 0x7f7ff0166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 --2- 172.21.15.17:0/4099184886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ff0070ad0 0x7f7ff0154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 >> 172.21.15.17:0/4099184886 conn(0x7f7ff00d1d60 msgr2=0x7f7ff00cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 shutdown_connections 2024-09-10T23:19:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.025+0000 7f7ff4e00640 1 -- 172.21.15.17:0/4099184886 wait complete. 2024-09-10T23:19:52.048 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:19:52.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:19:52.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.193+0000 7f3c8b800640 1 -- 172.21.15.17:0/411655451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c840cec60 msgr2=0x7f3c840d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:52.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.193+0000 7f3c8b800640 1 --2- 172.21.15.17:0/411655451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c840cec60 0x7f3c840d2610 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009840 tx=0x7f3c6c01c820 comp rx=0 tx=0).stop 2024-09-10T23:19:52.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.193+0000 7f3c8b800640 1 -- 172.21.15.17:0/411655451 shutdown_connections 2024-09-10T23:19:52.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.193+0000 7f3c8b800640 1 --2- 172.21.15.17:0/411655451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c840cec60 0x7f3c840d2610 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:52.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.193+0000 7f3c8b800640 1 -- 172.21.15.17:0/411655451 >> 172.21.15.17:0/411655451 conn(0x7f3c8409b040 msgr2=0x7f3c840d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:52.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.193+0000 7f3c8b800640 1 -- 172.21.15.17:0/411655451 shutdown_connections 2024-09-10T23:19:52.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.193+0000 7f3c8b800640 1 -- 172.21.15.17:0/411655451 wait complete. 2024-09-10T23:19:52.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.193+0000 7f3c8b800640 1 Processor -- start 2024-09-10T23:19:52.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 -- start start 2024-09-10T23:19:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c840cec60 0x7f3c840b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c8415f1c0 0x7f3c840b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c8415f5a0 0x7f3c84165f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8416a120 con 0x7f3c8415f1c0 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3c84169fa0 con 0x7f3c8415f5a0 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3c8416a2a0 con 0x7f3c840cec60 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c8415f1c0 0x7f3c840b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c8415f1c0 0x7f3c840b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33452/0 (socket says 172.21.15.17:33452) 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c7be00640 1 -- 172.21.15.17:0/327630376 learned_addr learned my addr 172.21.15.17:0/327630376 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c88e00640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c840cec60 0x7f3c840b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c89800640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c8415f5a0 0x7f3c84165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c7be00640 1 -- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c840cec60 msgr2=0x7f3c840b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c7be00640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c840cec60 0x7f3c840b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c7be00640 1 -- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c8415f5a0 msgr2=0x7f3c84165f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c7be00640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c8415f5a0 0x7f3c84165f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c7be00640 1 -- 172.21.15.17:0/327630376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c84165800 con 0x7f3c8415f1c0 2024-09-10T23:19:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c7be00640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c8415f1c0 0x7f3c840b4b40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0b0040 tx=0x7f3c6c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c81600640 1 -- 172.21.15.17:0/327630376 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0bc070 con 0x7f3c8415f1c0 2024-09-10T23:19:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c81600640 1 -- 172.21.15.17:0/327630376 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c6c003600 con 0x7f3c8415f1c0 2024-09-10T23:19:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c840cb290 con 0x7f3c8415f1c0 2024-09-10T23:19:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c81600640 1 -- 172.21.15.17:0/327630376 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0b2040 con 0x7f3c8415f1c0 2024-09-10T23:19:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c84165a70 con 0x7f3c8415f1c0 2024-09-10T23:19:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.197+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c840d2610 con 0x7f3c8415f1c0 2024-09-10T23:19:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.201+0000 7f3c81600640 1 -- 172.21.15.17:0/327630376 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3c6c0b5070 con 0x7f3c8415f1c0 2024-09-10T23:19:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.201+0000 7f3c81600640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c600725e0 0x7f3c60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.201+0000 7f3c81600640 1 -- 172.21.15.17:0/327630376 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5249+0+0 (secure 0 0 0) 0x7f3c6c12c940 con 0x7f3c8415f1c0 2024-09-10T23:19:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.201+0000 7f3c88e00640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c600725e0 0x7f3c60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:52.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.201+0000 7f3c88e00640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c600725e0 0x7f3c60074aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3c840723d0 tx=0x7f3c74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:52.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.205+0000 7f3c81600640 1 -- 172.21.15.17:0/327630376 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3c6c016410 con 0x7f3c8415f1c0 2024-09-10T23:19:52.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:52.385+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3c840754e0 con 0x7f3c8415f1c0 2024-09-10T23:19:53.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.261+0000 7f3c81600640 1 -- 172.21.15.17:0/327630376 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) ==== 138+0+0 (secure 0 0 0) 0x7f3c6c0f8140 con 0x7f3c8415f1c0 2024-09-10T23:19:53.266 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c600725e0 msgr2=0x7f3c60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c600725e0 0x7f3c60074aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3c840723d0 tx=0x7f3c74009040 comp rx=0 tx=0).stop 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c8415f1c0 msgr2=0x7f3c840b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c8415f1c0 0x7f3c840b4b40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0b0040 tx=0x7f3c6c004040 comp rx=0 tx=0).stop 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 shutdown_connections 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c600725e0 0x7f3c60074aa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c8415f5a0 0x7f3c84165f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c8415f1c0 0x7f3c840b4b40 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 --2- 172.21.15.17:0/327630376 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c840cec60 0x7f3c840b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:53.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 >> 172.21.15.17:0/327630376 conn(0x7f3c8409b040 msgr2=0x7f3c840b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:53.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 shutdown_connections 2024-09-10T23:19:53.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.265+0000 7f3c8b800640 1 -- 172.21.15.17:0/327630376 wait complete. 2024-09-10T23:19:53.297 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:19:53.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.449+0000 7f9b03400640 1 -- 172.21.15.17:0/2713280530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 msgr2=0x7f9afc071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:53.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.449+0000 7f9b03400640 1 --2- 172.21.15.17:0/2713280530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 0x7f9afc071670 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9afc09b8a0 tx=0x7f9ae801c570 comp rx=0 tx=0).stop 2024-09-10T23:19:53.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.449+0000 7f9b03400640 1 -- 172.21.15.17:0/2713280530 shutdown_connections 2024-09-10T23:19:53.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.449+0000 7f9b03400640 1 --2- 172.21.15.17:0/2713280530 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9afc071bb0 0x7f9afc0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:53.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.449+0000 7f9b03400640 1 --2- 172.21.15.17:0/2713280530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 0x7f9afc071670 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:53.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.449+0000 7f9b03400640 1 --2- 172.21.15.17:0/2713280530 >> v2:172.21.15.77:3300/0 conn(0x7f9afc15be20 0x7f9afc0d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:53.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.449+0000 7f9b03400640 1 -- 172.21.15.17:0/2713280530 >> 172.21.15.17:0/2713280530 conn(0x7f9afc09a9f0 msgr2=0x7f9afc09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:53.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.449+0000 7f9b03400640 1 -- 172.21.15.17:0/2713280530 shutdown_connections 2024-09-10T23:19:53.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.449+0000 7f9b03400640 1 -- 172.21.15.17:0/2713280530 wait complete. 2024-09-10T23:19:53.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b03400640 1 Processor -- start 2024-09-10T23:19:53.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b03400640 1 -- start start 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b03400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9afc071bb0 0x7f9afc0b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b03400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 0x7f9afc0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b03400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9afc15be20 0x7f9afc0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b03400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc0cd450 con 0x7f9afc0d2210 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b03400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc0cd2d0 con 0x7f9afc15be20 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b03400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9afc0cd5d0 con 0x7f9afc071bb0 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9afbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 0x7f9afc0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9afbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 0x7f9afc0c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33468/0 (socket says 172.21.15.17:33468) 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9afbe00640 1 -- 172.21.15.17:0/1593606138 learned_addr learned my addr 172.21.15.17:0/1593606138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b00a00640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9afc071bb0 0x7f9afc0b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:53.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b01400640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9afc15be20 0x7f9afc0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9afbe00640 1 -- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9afc071bb0 msgr2=0x7f9afc0b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9afbe00640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9afc071bb0 0x7f9afc0b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9afbe00640 1 -- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9afc15be20 msgr2=0x7f9afc0c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9afbe00640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9afc15be20 0x7f9afc0c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9afbe00640 1 -- 172.21.15.17:0/1593606138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9afc0b5270 con 0x7f9afc0d2210 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b01400640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9afc15be20 0x7f9afc0c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9afbe00640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 0x7f9afc0c5850 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009850 tx=0x7f9ae80a6ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9af8c00640 1 -- 172.21.15.17:0/1593606138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80ac070 con 0x7f9afc0d2210 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9af8c00640 1 -- 172.21.15.17:0/1593606138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ae8004030 con 0x7f9afc0d2210 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9af8c00640 1 -- 172.21.15.17:0/1593606138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8004480 con 0x7f9afc0d2210 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.453+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9afc0b5550 con 0x7f9afc0d2210 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.457+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9afc0b5b10 con 0x7f9afc0d2210 2024-09-10T23:19:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.457+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9afc071670 con 0x7f9afc0d2210 2024-09-10T23:19:53.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.457+0000 7f9af8c00640 1 -- 172.21.15.17:0/1593606138 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9ae80a65a0 con 0x7f9afc0d2210 2024-09-10T23:19:53.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.461+0000 7f9af8c00640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9adc0725e0 0x7f9adc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:53.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.461+0000 7f9af8c00640 1 -- 172.21.15.17:0/1593606138 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5619+0+0 (secure 0 0 0) 0x7f9ae812d260 con 0x7f9afc0d2210 2024-09-10T23:19:53.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.461+0000 7f9b00a00640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9adc0725e0 0x7f9adc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.461+0000 7f9b00a00640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9adc0725e0 0x7f9adc074aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9af000bb50 tx=0x7f9af000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:53.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.461+0000 7f9af8c00640 1 -- 172.21.15.17:0/1593606138 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9ae80164b0 con 0x7f9afc0d2210 2024-09-10T23:19:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:53.637+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9afc0b1210 con 0x7f9afc0d2210 2024-09-10T23:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9af8c00640 1 -- 172.21.15.17:0/1593606138 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) ==== 170+0+0 (secure 0 0 0) 0x7f9ae80f84b0 con 0x7f9afc0d2210 2024-09-10T23:19:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9adc0725e0 msgr2=0x7f9adc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9adc0725e0 0x7f9adc074aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9af000bb50 tx=0x7f9af000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 msgr2=0x7f9afc0c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 0x7f9afc0c5850 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009850 tx=0x7f9ae80a6ac0 comp rx=0 tx=0).stop 2024-09-10T23:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 shutdown_connections 2024-09-10T23:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9adc0725e0 0x7f9adc074aa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9afc15be20 0x7f9afc0c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9afc0d2210 0x7f9afc0c5850 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 --2- 172.21.15.17:0/1593606138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9afc071bb0 0x7f9afc0b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 >> 172.21.15.17:0/1593606138 conn(0x7f9afc09a9f0 msgr2=0x7f9afc0b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 shutdown_connections 2024-09-10T23:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.265+0000 7f9b03400640 1 -- 172.21.15.17:0/1593606138 wait complete. 2024-09-10T23:19:54.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:19:54.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 -- 172.21.15.17:0/3560332381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f347c003a90 msgr2=0x7f347c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:54.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 --2- 172.21.15.17:0/3560332381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f347c003a90 0x7f347c003eb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f348800c660 tx=0x7f348801d2b0 comp rx=0 tx=0).stop 2024-09-10T23:19:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ce00640 1 -- 172.21.15.17:0/3560332381 reap_dead start 2024-09-10T23:19:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 -- 172.21.15.17:0/3560332381 shutdown_connections 2024-09-10T23:19:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 -- 172.21.15.17:0/3560332381 >> 172.21.15.17:0/3560332381 conn(0x7f34980d0b80 msgr2=0x7f34980d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 -- 172.21.15.17:0/3560332381 shutdown_connections 2024-09-10T23:19:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 -- 172.21.15.17:0/3560332381 wait complete. 2024-09-10T23:19:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 Processor -- start 2024-09-10T23:19:54.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 -- start start 2024-09-10T23:19:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f347c003a90 0x7f3498151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34980b5840 0x7f34980b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34980b1c70 0x7f34981fb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3498167da0 con 0x7f34980b5840 2024-09-10T23:19:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f34980d0920 con 0x7f34980b1c70 2024-09-10T23:19:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f349ee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3498167f20 con 0x7f347c003a90 2024-09-10T23:19:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f348fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34980b5840 0x7f34980b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f348fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34980b5840 0x7f34980b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33480/0 (socket says 172.21.15.17:33480) 2024-09-10T23:19:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.461+0000 7f348fe00640 1 -- 172.21.15.17:0/1717237298 learned_addr learned my addr 172.21.15.17:0/1717237298 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f3497e00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f347c003a90 0x7f3498151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f349ce00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34980b1c70 0x7f34981fb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f348fe00640 1 -- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f347c003a90 msgr2=0x7f3498151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f348fe00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f347c003a90 0x7f3498151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f348fe00640 1 -- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34980b1c70 msgr2=0x7f34981fb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f348fe00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34980b1c70 0x7f34981fb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f348fe00640 1 -- 172.21.15.17:0/1717237298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34980b0a50 con 0x7f34980b5840 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f3497e00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f347c003a90 0x7f3498151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f349ce00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34980b1c70 0x7f34981fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f348fe00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34980b5840 0x7f34980b1730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3480003f60 tx=0x7f3480003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f3494c00640 1 -- 172.21.15.17:0/1717237298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480011640 con 0x7f34980b5840 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f3494c00640 1 -- 172.21.15.17:0/1717237298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3480016020 con 0x7f34980b5840 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34980b0d30 con 0x7f34980b5840 2024-09-10T23:19:54.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f3494c00640 1 -- 172.21.15.17:0/1717237298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480011a60 con 0x7f34980b5840 2024-09-10T23:19:54.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34980b12f0 con 0x7f34980b5840 2024-09-10T23:19:54.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3498073960 con 0x7f34980b5840 2024-09-10T23:19:54.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.465+0000 7f3494c00640 1 -- 172.21.15.17:0/1717237298 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3480011c00 con 0x7f34980b5840 2024-09-10T23:19:54.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.469+0000 7f3494c00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3474072610 0x7f3474074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.469+0000 7f3494c00640 1 -- 172.21.15.17:0/1717237298 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6001+0+0 (secure 0 0 0) 0x7f34800946b0 con 0x7f34980b5840 2024-09-10T23:19:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.469+0000 7f3497e00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3474072610 0x7f3474074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.469+0000 7f3497e00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3474072610 0x7f3474074ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34880ac000 tx=0x7f348801a0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.469+0000 7f3494c00640 1 -- 172.21.15.17:0/1717237298 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3480020020 con 0x7f34980b5840 2024-09-10T23:19:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:54.681+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f349806f230 con 0x7f34980b5840 2024-09-10T23:19:55.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.293+0000 7f3494c00640 1 -- 172.21.15.17:0/1717237298 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v37) ==== 173+0+0 (secure 0 0 0) 0x7f348005fcd0 con 0x7f34980b5840 2024-09-10T23:19:55.300 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 9 and data pool 10 2024-09-10T23:19:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.301+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3474072610 msgr2=0x7f3474074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.301+0000 7f349ee00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3474072610 0x7f3474074ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f34880ac000 tx=0x7f348801a0f0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.301+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34980b5840 msgr2=0x7f34980b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.301+0000 7f349ee00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34980b5840 0x7f34980b1730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3480003f60 tx=0x7f3480003f90 comp rx=0 tx=0).stop 2024-09-10T23:19:55.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.305+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 shutdown_connections 2024-09-10T23:19:55.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.305+0000 7f349ee00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3474072610 0x7f3474074ad0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.305+0000 7f349ee00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34980b1c70 0x7f34981fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.305+0000 7f349ee00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34980b5840 0x7f34980b1730 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.305+0000 7f349ee00640 1 --2- 172.21.15.17:0/1717237298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f347c003a90 0x7f3498151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.305+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 >> 172.21.15.17:0/1717237298 conn(0x7f34980d0b80 msgr2=0x7f349815b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.305+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 shutdown_connections 2024-09-10T23:19:55.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.305+0000 7f349ee00640 1 -- 172.21.15.17:0/1717237298 wait complete. 2024-09-10T23:19:55.344 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:19:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.489+0000 7f5e16600640 1 -- 172.21.15.17:0/1463458350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e10160280 msgr2=0x7f5e100cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.489+0000 7f5e16600640 1 --2- 172.21.15.17:0/1463458350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e10160280 0x7f5e100cfaf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009870 tx=0x7f5e0001ef70 comp rx=0 tx=0).stop 2024-09-10T23:19:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.489+0000 7f5e16600640 1 -- 172.21.15.17:0/1463458350 shutdown_connections 2024-09-10T23:19:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.489+0000 7f5e16600640 1 --2- 172.21.15.17:0/1463458350 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e10160280 0x7f5e100cfaf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.489+0000 7f5e16600640 1 -- 172.21.15.17:0/1463458350 >> 172.21.15.17:0/1463458350 conn(0x7f5e100d1d10 msgr2=0x7f5e100d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.489+0000 7f5e16600640 1 -- 172.21.15.17:0/1463458350 shutdown_connections 2024-09-10T23:19:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.489+0000 7f5e16600640 1 -- 172.21.15.17:0/1463458350 wait complete. 2024-09-10T23:19:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.489+0000 7f5e16600640 1 Processor -- start 2024-09-10T23:19:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 -- start start 2024-09-10T23:19:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e100d2830 0x7f5e10155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e10160280 0x7f5e100c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e10160660 0x7f5e100cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5e100d03c0 con 0x7f5e100d2830 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5e100d0240 con 0x7f5e10160280 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5e100b03c0 con 0x7f5e10160660 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e100d2830 0x7f5e10155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e100d2830 0x7f5e10155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33486/0 (socket says 172.21.15.17:33486) 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0f400640 1 -- 172.21.15.17:0/580494478 learned_addr learned my addr 172.21.15.17:0/580494478 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0fe00640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e10160660 0x7f5e100cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e07e00640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e10160280 0x7f5e100c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0f400640 1 -- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e10160660 msgr2=0x7f5e100cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0f400640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e10160660 0x7f5e100cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0f400640 1 -- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e10160280 msgr2=0x7f5e100c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0f400640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e10160280 0x7f5e100c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0f400640 1 -- 172.21.15.17:0/580494478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e100c5800 con 0x7f5e100d2830 2024-09-10T23:19:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0fe00640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e10160660 0x7f5e100cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e07e00640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e10160280 0x7f5e100c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e0f400640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e100d2830 0x7f5e10155360 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5e00000c10 tx=0x7f5e00005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e07400640 1 -- 172.21.15.17:0/580494478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e000bf070 con 0x7f5e100d2830 2024-09-10T23:19:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e07400640 1 -- 172.21.15.17:0/580494478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e000039f0 con 0x7f5e100d2830 2024-09-10T23:19:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e100c5ac0 con 0x7f5e100d2830 2024-09-10T23:19:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e07400640 1 -- 172.21.15.17:0/580494478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e000b5040 con 0x7f5e100d2830 2024-09-10T23:19:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e100c6080 con 0x7f5e100d2830 2024-09-10T23:19:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.493+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e100cfaf0 con 0x7f5e100d2830 2024-09-10T23:19:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.497+0000 7f5e07400640 1 -- 172.21.15.17:0/580494478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5e000b8070 con 0x7f5e100d2830 2024-09-10T23:19:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.497+0000 7f5e07400640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dec0725e0 0x7f5dec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.497+0000 7f5e07400640 1 -- 172.21.15.17:0/580494478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6101+0+0 (secure 0 0 0) 0x7f5e00130200 con 0x7f5e100d2830 2024-09-10T23:19:55.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.497+0000 7f5e07e00640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dec0725e0 0x7f5dec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:55.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.497+0000 7f5e07e00640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dec0725e0 0x7f5dec074aa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5df8001230 tx=0x7f5df8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:55.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.501+0000 7f5e07400640 1 -- 172.21.15.17:0/580494478 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5e00018ad0 con 0x7f5e100d2830 2024-09-10T23:19:55.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.673+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e100b7700 con 0x7f5e100d2830 2024-09-10T23:19:55.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e07400640 1 -- 172.21.15.17:0/580494478 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16897 (secure 0 0 0) 0x7f5e000fb620 con 0x7f5e100d2830 2024-09-10T23:19:55.684 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:55.684 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":69,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:19:54.687233+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:19:52.398174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T23:19:53.652193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:19:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dec0725e0 msgr2=0x7f5dec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dec0725e0 0x7f5dec074aa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5df8001230 tx=0x7f5df8009040 comp rx=0 tx=0).stop 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e100d2830 msgr2=0x7f5e10155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e100d2830 0x7f5e10155360 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5e00000c10 tx=0x7f5e00005d00 comp rx=0 tx=0).stop 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 shutdown_connections 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dec0725e0 0x7f5dec074aa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e10160660 0x7f5e100cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e10160280 0x7f5e100c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 --2- 172.21.15.17:0/580494478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e100d2830 0x7f5e10155360 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 >> 172.21.15.17:0/580494478 conn(0x7f5e100d1d10 msgr2=0x7f5e100b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 shutdown_connections 2024-09-10T23:19:55.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.677+0000 7f5e16600640 1 -- 172.21.15.17:0/580494478 wait complete. 2024-09-10T23:19:55.702 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:19:55.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 -- 172.21.15.17:0/142302113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faae00d1830 msgr2=0x7faae015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 --2- 172.21.15.17:0/142302113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faae00d1830 0x7faae015f5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faae00cf010 tx=0x7faacc01c820 comp rx=0 tx=0).stop 2024-09-10T23:19:55.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 -- 172.21.15.17:0/142302113 shutdown_connections 2024-09-10T23:19:55.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 --2- 172.21.15.17:0/142302113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faae00d1830 0x7faae015f5a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 --2- 172.21.15.17:0/142302113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faae0070ad0 0x7faae015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 -- 172.21.15.17:0/142302113 >> 172.21.15.17:0/142302113 conn(0x7faae00d1d60 msgr2=0x7faae00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:55.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 -- 172.21.15.17:0/142302113 shutdown_connections 2024-09-10T23:19:55.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 -- 172.21.15.17:0/142302113 wait complete. 2024-09-10T23:19:55.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 Processor -- start 2024-09-10T23:19:55.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 -- start start 2024-09-10T23:19:55.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faae0070ad0 0x7faae00b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faae00cf320 0x7faae0164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faae00d1830 0x7faae0151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faae0169430 con 0x7faae0070ad0 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faae01692b0 con 0x7faae00d1830 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.845+0000 7faae7a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faae01695b0 con 0x7faae00cf320 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faae0070ad0 0x7faae00b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faae0070ad0 0x7faae00b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33490/0 (socket says 172.21.15.17:33490) 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5000640 1 -- 172.21.15.17:0/348285363 learned_addr learned my addr 172.21.15.17:0/348285363 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faadfe00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faae00cf320 0x7faae0164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5a00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faae00d1830 0x7faae0151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5000640 1 -- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faae00cf320 msgr2=0x7faae0164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5000640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faae00cf320 0x7faae0164ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5000640 1 -- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faae00d1830 msgr2=0x7faae0151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:55.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5000640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faae00d1830 0x7faae0151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:55.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5000640 1 -- 172.21.15.17:0/348285363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae0157270 con 0x7faae0070ad0 2024-09-10T23:19:55.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae5000640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faae0070ad0 0x7faae00b2660 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7faad400ea10 tx=0x7faad400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faadcc00640 1 -- 172.21.15.17:0/348285363 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad400cde0 con 0x7faae0070ad0 2024-09-10T23:19:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faadcc00640 1 -- 172.21.15.17:0/348285363 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faad4004020 con 0x7faae0070ad0 2024-09-10T23:19:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faadcc00640 1 -- 172.21.15.17:0/348285363 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4004470 con 0x7faae0070ad0 2024-09-10T23:19:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae0157550 con 0x7faae0070ad0 2024-09-10T23:19:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae00b3e40 con 0x7faae0070ad0 2024-09-10T23:19:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae0157790 con 0x7faae0070ad0 2024-09-10T23:19:55.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.849+0000 7faadcc00640 1 -- 172.21.15.17:0/348285363 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faad4003600 con 0x7faae0070ad0 2024-09-10T23:19:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.853+0000 7faadcc00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faac00725e0 0x7faac0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.853+0000 7faadcc00640 1 -- 172.21.15.17:0/348285363 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6101+0+0 (secure 0 0 0) 0x7faad4093eb0 con 0x7faae0070ad0 2024-09-10T23:19:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.853+0000 7faadfe00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faac00725e0 0x7faac0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.853+0000 7faadfe00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faac00725e0 0x7faac0074aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faacc0af000 tx=0x7faacc01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:55.857+0000 7faadcc00640 1 -- 172.21.15.17:0/348285363 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faae0157790 con 0x7faae0070ad0 2024-09-10T23:19:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faae00cfc60 con 0x7faae0070ad0 2024-09-10T23:19:56.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faadcc00640 1 -- 172.21.15.17:0/348285363 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16897 (secure 0 0 0) 0x7faad405f360 con 0x7faae0070ad0 2024-09-10T23:19:56.038 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:56.038 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":69,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:19:54.687233+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:19:52.398174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T23:19:53.652193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:19:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faac00725e0 msgr2=0x7faac0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faac00725e0 0x7faac0074aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faacc0af000 tx=0x7faacc01b060 comp rx=0 tx=0).stop 2024-09-10T23:19:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faae0070ad0 msgr2=0x7faae00b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faae0070ad0 0x7faae00b2660 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7faad400ea10 tx=0x7faad400eed0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 shutdown_connections 2024-09-10T23:19:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faac00725e0 0x7faac0074aa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faae00d1830 0x7faae0151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faae00cf320 0x7faae0164ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 --2- 172.21.15.17:0/348285363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faae0070ad0 0x7faae00b2660 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 >> 172.21.15.17:0/348285363 conn(0x7faae00d1d60 msgr2=0x7faae00cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 shutdown_connections 2024-09-10T23:19:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.033+0000 7faae7a00640 1 -- 172.21.15.17:0/348285363 wait complete. 2024-09-10T23:19:56.060 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.205+0000 7f86c5800640 1 -- 172.21.15.17:0/934367452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c015a2a0 msgr2=0x7f86c00b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.205+0000 7f86c5800640 1 --2- 172.21.15.17:0/934367452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c015a2a0 0x7f86c00b2aa0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f86c00cc500 tx=0x7f86b001c890 comp rx=0 tx=0).stop 2024-09-10T23:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.205+0000 7f86c5800640 1 -- 172.21.15.17:0/934367452 shutdown_connections 2024-09-10T23:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.205+0000 7f86c5800640 1 --2- 172.21.15.17:0/934367452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86c00cf580 0x7f86c006ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.205+0000 7f86c5800640 1 --2- 172.21.15.17:0/934367452 >> v2:172.21.15.77:3300/0 conn(0x7f86c00b2fe0 0x7f86c00cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.205+0000 7f86c5800640 1 --2- 172.21.15.17:0/934367452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c015a2a0 0x7f86c00b2aa0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.205+0000 7f86c5800640 1 -- 172.21.15.17:0/934367452 >> 172.21.15.17:0/934367452 conn(0x7f86c00b17a0 msgr2=0x7f86c00b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.205+0000 7f86c5800640 1 -- 172.21.15.17:0/934367452 shutdown_connections 2024-09-10T23:19:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.205+0000 7f86c5800640 1 -- 172.21.15.17:0/934367452 wait complete. 2024-09-10T23:19:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 Processor -- start 2024-09-10T23:19:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 -- start start 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86c00b2fe0 0x7f86c01f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00cf580 0x7f86c01fb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c015a2a0 0x7f86c015d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f86c006f9f0 con 0x7f86c00cf580 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f86c006f870 con 0x7f86c015a2a0 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f86c006fb70 con 0x7f86c00b2fe0 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00cf580 0x7f86c01fb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00cf580 0x7f86c01fb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33500/0 (socket says 172.21.15.17:33500) 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b6000640 1 -- 172.21.15.17:0/2230242800 learned_addr learned my addr 172.21.15.17:0/2230242800 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86bea00640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86c00b2fe0 0x7f86c01f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86bf400640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c015a2a0 0x7f86c015d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b6000640 1 -- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86c00b2fe0 msgr2=0x7f86c01f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b6000640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86c00b2fe0 0x7f86c01f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b6000640 1 -- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c015a2a0 msgr2=0x7f86c015d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b6000640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c015a2a0 0x7f86c015d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b6000640 1 -- 172.21.15.17:0/2230242800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c01f8500 con 0x7f86c00cf580 2024-09-10T23:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86bf400640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c015a2a0 0x7f86c015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b6000640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00cf580 0x7f86c01fb5a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f86a800d750 tx=0x7f86a800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b7400640 1 -- 172.21.15.17:0/2230242800 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8017070 con 0x7f86c00cf580 2024-09-10T23:19:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b7400640 1 -- 172.21.15.17:0/2230242800 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86a8009d20 con 0x7f86c00cf580 2024-09-10T23:19:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86b7400640 1 -- 172.21.15.17:0/2230242800 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a800de60 con 0x7f86c00cf580 2024-09-10T23:19:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c015dc10 con 0x7f86c00cf580 2024-09-10T23:19:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c01f7f40 con 0x7f86c00cf580 2024-09-10T23:19:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.209+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c006ef80 con 0x7f86c00cf580 2024-09-10T23:19:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.213+0000 7f86b7400640 1 -- 172.21.15.17:0/2230242800 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f86a80106c0 con 0x7f86c00cf580 2024-09-10T23:19:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.213+0000 7f86b7400640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f869c0725e0 0x7f869c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.213+0000 7f86b7400640 1 -- 172.21.15.17:0/2230242800 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6101+0+0 (secure 0 0 0) 0x7f86a8093880 con 0x7f86c00cf580 2024-09-10T23:19:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.213+0000 7f86bea00640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f869c0725e0 0x7f869c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.213+0000 7f86bea00640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f869c0725e0 0x7f869c074aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f86b00af000 tx=0x7f86b001b0d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:56.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.217+0000 7f86b7400640 1 -- 172.21.15.17:0/2230242800 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f86a805e6e0 con 0x7f86c00cf580 2024-09-10T23:19:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:56.429+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f86c00ccaa0 con 0x7f86c00cf580 2024-09-10T23:19:57.261 INFO:tasks.ceph.mds.a.smithi017.stderr:2024-09-10T23:19:57.257+0000 7f7fe1e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:19:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.301+0000 7f86b7400640 1 -- 172.21.15.17:0/2230242800 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) ==== 118+0+0 (secure 0 0 0) 0x7f86a8063110 con 0x7f86c00cf580 2024-09-10T23:19:57.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f869c0725e0 msgr2=0x7f869c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:57.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f869c0725e0 0x7f869c074aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f86b00af000 tx=0x7f86b001b0d0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00cf580 msgr2=0x7f86c01fb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00cf580 0x7f86c01fb5a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f86a800d750 tx=0x7f86a800dc10 comp rx=0 tx=0).stop 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 shutdown_connections 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f869c0725e0 0x7f869c074aa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c015a2a0 0x7f86c015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c00cf580 0x7f86c01fb5a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 --2- 172.21.15.17:0/2230242800 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86c00b2fe0 0x7f86c01f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 >> 172.21.15.17:0/2230242800 conn(0x7f86c00b17a0 msgr2=0x7f86c0072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 shutdown_connections 2024-09-10T23:19:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.305+0000 7f86c5800640 1 -- 172.21.15.17:0/2230242800 wait complete. 2024-09-10T23:19:57.335 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:19:57.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:19:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 -- 172.21.15.17:0/2794479148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 msgr2=0x7fc4840ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 --2- 172.21.15.17:0/2794479148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 0x7fc4840ccb60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009c80 tx=0x7fc47c01cda0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 -- 172.21.15.17:0/2794479148 shutdown_connections 2024-09-10T23:19:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 --2- 172.21.15.17:0/2794479148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 0x7fc4840ccb60 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 --2- 172.21.15.17:0/2794479148 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4840cf040 0x7fc4840cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 -- 172.21.15.17:0/2794479148 >> 172.21.15.17:0/2794479148 conn(0x7fc4840b17a0 msgr2=0x7fc4840b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 -- 172.21.15.17:0/2794479148 shutdown_connections 2024-09-10T23:19:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 -- 172.21.15.17:0/2794479148 wait complete. 2024-09-10T23:19:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 Processor -- start 2024-09-10T23:19:57.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.485+0000 7fc48c200640 1 -- start start 2024-09-10T23:19:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 0x7fc4841f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4840cf040 0x7fc484163580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc48415a2a0 0x7fc4841f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840cd430 con 0x7fc4840cc730 2024-09-10T23:19:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840cd2b0 con 0x7fc48415a2a0 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc4840cd5b0 con 0x7fc4840cf040 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc489800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 0x7fc4841f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc489800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 0x7fc4841f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40410/0 (socket says 172.21.15.17:40410) 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc489800640 1 -- 172.21.15.17:0/983998512 learned_addr learned my addr 172.21.15.17:0/983998512 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc488e00640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4840cf040 0x7fc484163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48a200640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc48415a2a0 0x7fc4841f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc489800640 1 -- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4840cf040 msgr2=0x7fc484163580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc489800640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4840cf040 0x7fc484163580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc489800640 1 -- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc48415a2a0 msgr2=0x7fc4841f8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc489800640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc48415a2a0 0x7fc4841f8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc489800640 1 -- 172.21.15.17:0/983998512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc484075130 con 0x7fc4840cc730 2024-09-10T23:19:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48a200640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc48415a2a0 0x7fc4841f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:19:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc489800640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 0x7fc4841f5f60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c3c0 tx=0x7fc47800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc481600640 1 -- 172.21.15.17:0/983998512 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478017070 con 0x7fc4840cc730 2024-09-10T23:19:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc481600640 1 -- 172.21.15.17:0/983998512 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4780053c0 con 0x7fc4840cc730 2024-09-10T23:19:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc481600640 1 -- 172.21.15.17:0/983998512 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478003860 con 0x7fc4840cc730 2024-09-10T23:19:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4841f64a0 con 0x7fc4840cc730 2024-09-10T23:19:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4841f9850 con 0x7fc4840cc730 2024-09-10T23:19:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4840ccb60 con 0x7fc4840cc730 2024-09-10T23:19:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.489+0000 7fc481600640 1 -- 172.21.15.17:0/983998512 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc478003a00 con 0x7fc4840cc730 2024-09-10T23:19:57.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.493+0000 7fc481600640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4640725e0 0x7fc464074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:57.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.493+0000 7fc481600640 1 -- 172.21.15.17:0/983998512 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fc4780929a0 con 0x7fc4840cc730 2024-09-10T23:19:57.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.493+0000 7fc488e00640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4640725e0 0x7fc464074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:57.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.493+0000 7fc488e00640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4640725e0 0x7fc464074aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc484153c10 tx=0x7fc47000b490 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:57.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.497+0000 7fc481600640 1 -- 172.21.15.17:0/983998512 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc47805d890 con 0x7fc4840cc730 2024-09-10T23:19:57.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:57.705+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc484158670 con 0x7fc4840cc730 2024-09-10T23:19:58.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc481600640 1 -- 172.21.15.17:0/983998512 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7fc4780622c0 con 0x7fc4840cc730 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4640725e0 msgr2=0x7fc464074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4640725e0 0x7fc464074aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc484153c10 tx=0x7fc47000b490 comp rx=0 tx=0).stop 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 msgr2=0x7fc4841f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 0x7fc4841f5f60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c3c0 tx=0x7fc47800c880 comp rx=0 tx=0).stop 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 shutdown_connections 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4640725e0 0x7fc464074aa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc48415a2a0 0x7fc4841f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4840cf040 0x7fc484163580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 --2- 172.21.15.17:0/983998512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4840cc730 0x7fc4841f5f60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 >> 172.21.15.17:0/983998512 conn(0x7fc4840b17a0 msgr2=0x7fc48406f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 shutdown_connections 2024-09-10T23:19:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.305+0000 7fc48c200640 1 -- 172.21.15.17:0/983998512 wait complete. 2024-09-10T23:19:58.335 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:19:58.336 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:19:58.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.481+0000 7f1ff6a00640 1 -- 172.21.15.17:0/666042392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff00d1830 msgr2=0x7f1ff015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.481+0000 7f1ff6a00640 1 --2- 172.21.15.17:0/666042392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff00d1830 0x7f1ff015f5a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00cf010 tx=0x7f1fd801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.481+0000 7f1ff6a00640 1 -- 172.21.15.17:0/666042392 shutdown_connections 2024-09-10T23:19:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.481+0000 7f1ff6a00640 1 --2- 172.21.15.17:0/666042392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff00d1830 0x7f1ff015f5a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.481+0000 7f1ff6a00640 1 --2- 172.21.15.17:0/666042392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ff0070ad0 0x7f1ff015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.481+0000 7f1ff6a00640 1 -- 172.21.15.17:0/666042392 >> 172.21.15.17:0/666042392 conn(0x7f1ff00d1d60 msgr2=0x7f1ff00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.481+0000 7f1ff6a00640 1 -- 172.21.15.17:0/666042392 shutdown_connections 2024-09-10T23:19:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.481+0000 7f1ff6a00640 1 -- 172.21.15.17:0/666042392 wait complete. 2024-09-10T23:19:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 Processor -- start 2024-09-10T23:19:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 -- start start 2024-09-10T23:19:58.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff0070ad0 0x7f1ff01f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ff00cf320 0x7f1ff01fba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00d1830 0x7f1ff015ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff0169430 con 0x7f1ff0070ad0 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff01692b0 con 0x7f1ff00d1830 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff01695b0 con 0x7f1ff00cf320 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fefe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff0070ad0 0x7f1ff01f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fefe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff0070ad0 0x7f1ff01f8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40426/0 (socket says 172.21.15.17:40426) 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fefe00640 1 -- 172.21.15.17:0/1260425512 learned_addr learned my addr 172.21.15.17:0/1260425512 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff4a00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00d1830 0x7f1ff015ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fe7400640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ff00cf320 0x7f1ff01fba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fefe00640 1 -- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ff00cf320 msgr2=0x7f1ff01fba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fefe00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ff00cf320 0x7f1ff01fba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fefe00640 1 -- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00d1830 msgr2=0x7f1ff015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fefe00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00d1830 0x7f1ff015ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fefe00640 1 -- 172.21.15.17:0/1260425512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff01663e0 con 0x7f1ff0070ad0 2024-09-10T23:19:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fefe00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff0070ad0 0x7f1ff01f8c60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000d950 tx=0x7f1fe000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fecc00640 1 -- 172.21.15.17:0/1260425512 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0017070 con 0x7f1ff0070ad0 2024-09-10T23:19:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fecc00640 1 -- 172.21.15.17:0/1260425512 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fe0009d20 con 0x7f1ff0070ad0 2024-09-10T23:19:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1fecc00640 1 -- 172.21.15.17:0/1260425512 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00106c0 con 0x7f1ff0070ad0 2024-09-10T23:19:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff0165a10 con 0x7f1ff0070ad0 2024-09-10T23:19:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.485+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff0165cb0 con 0x7f1ff0070ad0 2024-09-10T23:19:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.489+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff00cfc60 con 0x7f1ff0070ad0 2024-09-10T23:19:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.489+0000 7f1fecc00640 1 -- 172.21.15.17:0/1260425512 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1fe0010860 con 0x7f1ff0070ad0 2024-09-10T23:19:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.489+0000 7f1fecc00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fcc0725e0 0x7f1fcc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.489+0000 7f1fecc00640 1 -- 172.21.15.17:0/1260425512 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f1fe00936a0 con 0x7f1ff0070ad0 2024-09-10T23:19:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.489+0000 7f1fe7400640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fcc0725e0 0x7f1fcc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:58.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.489+0000 7f1fe7400640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fcc0725e0 0x7f1fcc074aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80af000 tx=0x7f1fd801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.493+0000 7f1fecc00640 1 -- 172.21.15.17:0/1260425512 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1fe005e610 con 0x7f1ff0070ad0 2024-09-10T23:19:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.701+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ff00af340 con 0x7f1ff0070ad0 2024-09-10T23:19:58.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.701+0000 7f1fecc00640 1 -- 172.21.15.17:0/1260425512 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5218 (secure 0 0 0) 0x7f1fe0063040 con 0x7f1ff0070ad0 2024-09-10T23:19:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:58.707 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"btime":"2024-09-10T23:19:58:307532+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5717,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/171584879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":171584879},{"type":"v1","addr":"172.21.15.77:6837","nonce":171584879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6100,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/452390579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":452390579},{"type":"v1","addr":"172.21.15.77:6836","nonce":452390579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3726644366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3726644366},{"type":"v1","addr":"172.21.15.17:6834","nonce":3726644366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:19:57.712307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3704108078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3704108078},{"type":"v1","addr":"172.21.15.17:6835","nonce":3704108078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6399,"qdb_cluster":[6399]},"id":4}]} 2024-09-10T23:19:58.707 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 40 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fcc0725e0 msgr2=0x7f1fcc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fcc0725e0 0x7f1fcc074aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80af000 tx=0x7f1fd801b120 comp rx=0 tx=0).stop 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff0070ad0 msgr2=0x7f1ff01f8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff0070ad0 0x7f1ff01f8c60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000d950 tx=0x7f1fe000de10 comp rx=0 tx=0).stop 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 shutdown_connections 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fcc0725e0 0x7f1fcc074aa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ff00d1830 0x7f1ff015ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ff00cf320 0x7f1ff01fba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 --2- 172.21.15.17:0/1260425512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff0070ad0 0x7f1ff01f8c60 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 >> 172.21.15.17:0/1260425512 conn(0x7f1ff00d1d60 msgr2=0x7f1ff00cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:58.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 shutdown_connections 2024-09-10T23:19:58.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.705+0000 7f1ff6a00640 1 -- 172.21.15.17:0/1260425512 wait complete. 2024-09-10T23:19:58.728 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:19:58.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.869+0000 7fb238a00640 1 -- 172.21.15.17:0/3722826756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb234070730 msgr2=0x7fb23415ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.869+0000 7fb238a00640 1 --2- 172.21.15.17:0/3722826756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb234070730 0x7fb23415ffe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb224009870 tx=0x7fb22401c780 comp rx=0 tx=0).stop 2024-09-10T23:19:58.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.869+0000 7fb238a00640 1 -- 172.21.15.17:0/3722826756 shutdown_connections 2024-09-10T23:19:58.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.869+0000 7fb238a00640 1 --2- 172.21.15.17:0/3722826756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb234070730 0x7fb23415ffe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.869+0000 7fb238a00640 1 -- 172.21.15.17:0/3722826756 >> 172.21.15.17:0/3722826756 conn(0x7fb2340b2740 msgr2=0x7fb2340b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:58.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.869+0000 7fb238a00640 1 -- 172.21.15.17:0/3722826756 shutdown_connections 2024-09-10T23:19:58.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.869+0000 7fb238a00640 1 -- 172.21.15.17:0/3722826756 wait complete. 2024-09-10T23:19:58.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 Processor -- start 2024-09-10T23:19:58.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 -- start start 2024-09-10T23:19:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb234070730 0x7fb234153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb234073520 0x7fb2341f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2340cd4c0 0x7fb2341492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb23416a520 con 0x7fb2340cd4c0 2024-09-10T23:19:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb23416a3a0 con 0x7fb234073520 2024-09-10T23:19:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb23416a6a0 con 0x7fb234070730 2024-09-10T23:19:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2340cd4c0 0x7fb2341492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:58.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2340cd4c0 0x7fb2341492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40436/0 (socket says 172.21.15.17:40436) 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233e00640 1 -- 172.21.15.17:0/760177425 learned_addr learned my addr 172.21.15.17:0/760177425 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233400640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb234070730 0x7fb234153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb22aa00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb234073520 0x7fb2341f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233e00640 1 -- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb234070730 msgr2=0x7fb234153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233e00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb234070730 0x7fb234153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233e00640 1 -- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb234073520 msgr2=0x7fb2341f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233e00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb234073520 0x7fb2341f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233e00640 1 -- 172.21.15.17:0/760177425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb234153830 con 0x7fb2340cd4c0 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb233e00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2340cd4c0 0x7fb2341492c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c790 tx=0x7fb22c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb22be00640 1 -- 172.21.15.17:0/760177425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c003b80 con 0x7fb2340cd4c0 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb22be00640 1 -- 172.21.15.17:0/760177425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb22c003d20 con 0x7fb2340cd4c0 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb22be00640 1 -- 172.21.15.17:0/760177425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00aab0 con 0x7fb2340cd4c0 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb234153b10 con 0x7fb2340cd4c0 2024-09-10T23:19:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.873+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2341f6bf0 con 0x7fb2340cd4c0 2024-09-10T23:19:58.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.877+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2341f5cc0 con 0x7fb2340cd4c0 2024-09-10T23:19:58.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.877+0000 7fb22be00640 1 -- 172.21.15.17:0/760177425 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb22c00ac50 con 0x7fb2340cd4c0 2024-09-10T23:19:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.877+0000 7fb22be00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2100725e0 0x7fb210074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.877+0000 7fb22be00640 1 -- 172.21.15.17:0/760177425 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fb22c0932a0 con 0x7fb2340cd4c0 2024-09-10T23:19:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.877+0000 7fb233400640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2100725e0 0x7fb210074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.877+0000 7fb233400640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2100725e0 0x7fb210074aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb2240af000 tx=0x7fb22401afc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:58.881+0000 7fb22be00640 1 -- 172.21.15.17:0/760177425 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb22c05e880 con 0x7fb2340cd4c0 2024-09-10T23:19:59.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.057+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb23415ffe0 con 0x7fb2340cd4c0 2024-09-10T23:19:59.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.057+0000 7fb22be00640 1 -- 172.21.15.17:0/760177425 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16884 (secure 0 0 0) 0x7fb22c05e180 con 0x7fb2340cd4c0 2024-09-10T23:19:59.064 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:59.064 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":70,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:19:56.292703+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:19:52.398174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T23:19:53.652193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2100725e0 msgr2=0x7fb210074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2100725e0 0x7fb210074aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb2240af000 tx=0x7fb22401afc0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2340cd4c0 msgr2=0x7fb2341492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2340cd4c0 0x7fb2341492c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c790 tx=0x7fb22c00cc50 comp rx=0 tx=0).stop 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 shutdown_connections 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2100725e0 0x7fb210074aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2340cd4c0 0x7fb2341492c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb234073520 0x7fb2341f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 --2- 172.21.15.17:0/760177425 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb234070730 0x7fb234153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 >> 172.21.15.17:0/760177425 conn(0x7fb2340b2740 msgr2=0x7fb2340b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 shutdown_connections 2024-09-10T23:19:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.061+0000 7fb238a00640 1 -- 172.21.15.17:0/760177425 wait complete. 2024-09-10T23:19:59.086 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:19:59.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 -- 172.21.15.17:0/1549823321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf415b720 msgr2=0x7f8cf40b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 --2- 172.21.15.17:0/1549823321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf415b720 0x7f8cf40b1c50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40b2d30 tx=0x7f8cec01c9a0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 -- 172.21.15.17:0/1549823321 shutdown_connections 2024-09-10T23:19:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 --2- 172.21.15.17:0/1549823321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf415b720 0x7f8cf40b1c50 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 --2- 172.21.15.17:0/1549823321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cf4074100 0x7f8cf415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 --2- 172.21.15.17:0/1549823321 >> v2:172.21.15.77:3300/0 conn(0x7f8cf413dae0 0x7f8cf4073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 -- 172.21.15.17:0/1549823321 >> 172.21.15.17:0/1549823321 conn(0x7f8cf40691b0 msgr2=0x7f8cf40695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 -- 172.21.15.17:0/1549823321 shutdown_connections 2024-09-10T23:19:59.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 -- 172.21.15.17:0/1549823321 wait complete. 2024-09-10T23:19:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 Processor -- start 2024-09-10T23:19:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 -- start start 2024-09-10T23:19:59.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf4074100 0x7f8cf4135f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:59.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cf413dae0 0x7f8cf40cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:59.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cf415b720 0x7f8cf40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:59.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4073150 con 0x7f8cf4074100 2024-09-10T23:19:59.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4072fd0 con 0x7f8cf415b720 2024-09-10T23:19:59.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cfb000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf40732d0 con 0x7f8cf413dae0 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cf3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf4074100 0x7f8cf4135f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cf3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf4074100 0x7f8cf4135f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40440/0 (socket says 172.21.15.17:40440) 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.229+0000 7f8cf3e00640 1 -- 172.21.15.17:0/20444318 learned_addr learned my addr 172.21.15.17:0/20444318 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cebe00640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cf413dae0 0x7f8cf40cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf3e00640 1 -- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cf413dae0 msgr2=0x7f8cf40cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf9000640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cf415b720 0x7f8cf40cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf3e00640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cf413dae0 0x7f8cf40cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf3e00640 1 -- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cf415b720 msgr2=0x7f8cf40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf3e00640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cf415b720 0x7f8cf40cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf3e00640 1 -- 172.21.15.17:0/20444318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf4137860 con 0x7f8cf4074100 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cebe00640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cf413dae0 0x7f8cf40cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf9000640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cf415b720 0x7f8cf40cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:59.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf3e00640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf4074100 0x7f8cf4135f20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400d980 tx=0x7f8ce400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:59.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf0c00640 1 -- 172.21.15.17:0/20444318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4017070 con 0x7f8cf4074100 2024-09-10T23:19:59.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf0c00640 1 -- 172.21.15.17:0/20444318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce4009d20 con 0x7f8cf4074100 2024-09-10T23:19:59.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf0c00640 1 -- 172.21.15.17:0/20444318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4004280 con 0x7f8cf4074100 2024-09-10T23:19:59.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf41385d0 con 0x7f8cf4074100 2024-09-10T23:19:59.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf4138b90 con 0x7f8cf4074100 2024-09-10T23:19:59.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf415b1e0 con 0x7f8cf4074100 2024-09-10T23:19:59.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf0c00640 1 -- 172.21.15.17:0/20444318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8ce4003600 con 0x7f8cf4074100 2024-09-10T23:19:59.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.233+0000 7f8cf0c00640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd00725e0 0x7f8cd0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:59.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.237+0000 7f8cf0c00640 1 -- 172.21.15.17:0/20444318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f8ce4093930 con 0x7f8cf4074100 2024-09-10T23:19:59.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.237+0000 7f8cebe00640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd00725e0 0x7f8cd0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:59.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.237+0000 7f8cebe00640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd00725e0 0x7f8cd0074aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8cf415b0b0 tx=0x7f8cdc0094d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.241+0000 7f8cf0c00640 1 -- 172.21.15.17:0/20444318 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8ce405ee70 con 0x7f8cf4074100 2024-09-10T23:19:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.413+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cf4137610 con 0x7f8cd00725e0 2024-09-10T23:19:59.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.417+0000 7f8cf0c00640 1 -- 172.21.15.17:0/20444318 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252001 (secure 0 0 0) 0x7f8cf4137610 con 0x7f8cd00725e0 2024-09-10T23:19:59.425 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:59.426 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd00725e0 msgr2=0x7f8cd0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd00725e0 0x7f8cd0074aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8cf415b0b0 tx=0x7f8cdc0094d0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf4074100 msgr2=0x7f8cf4135f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf4074100 0x7f8cf4135f20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400d980 tx=0x7f8ce400de40 comp rx=0 tx=0).stop 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 shutdown_connections 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd00725e0 0x7f8cd0074aa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cf415b720 0x7f8cf40cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cf413dae0 0x7f8cf40cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 --2- 172.21.15.17:0/20444318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cf4074100 0x7f8cf4135f20 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 >> 172.21.15.17:0/20444318 conn(0x7f8cf40691b0 msgr2=0x7f8cf40af900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:59.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 shutdown_connections 2024-09-10T23:19:59.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.421+0000 7f8cfb000640 1 -- 172.21.15.17:0/20444318 wait complete. 2024-09-10T23:19:59.446 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-10T23:19:58.354308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":341772,"kb_used_data":7568,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754632948,"statfs":{"total":773094113280,"available":772744138752,"internally_reserved":0,"allocated":7749632,"data_stored":4127620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.086473"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314113+0000","last_change":"2024-09-10T23:19:55.311205+0000","last_active":"2024-09-10T23:19:55.314113+0000","last_peered":"2024-09-10T23:19:55.314113+0000","last_clean":"2024-09-10T23:19:55.314113+0000","last_became_active":"2024-09-10T23:19:55.310914+0000","last_became_peered":"2024-09-10T23:19:55.310914+0000","last_unstale":"2024-09-10T23:19:55.314113+0000","last_undegraded":"2024-09-10T23:19:55.314113+0000","last_fullsized":"2024-09-10T23:19:55.314113+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:16.406984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.315316+0000","last_change":"2024-09-10T23:19:55.311637+0000","last_active":"2024-09-10T23:19:55.315316+0000","last_peered":"2024-09-10T23:19:55.315316+0000","last_clean":"2024-09-10T23:19:55.315316+0000","last_became_active":"2024-09-10T23:19:55.310147+0000","last_became_peered":"2024-09-10T23:19:55.310147+0000","last_unstale":"2024-09-10T23:19:55.315316+0000","last_undegraded":"2024-09-10T23:19:55.315316+0000","last_fullsized":"2024-09-10T23:19:55.315316+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:06.310867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.303199+0000","last_change":"2024-09-10T23:19:55.300975+0000","last_active":"2024-09-10T23:19:55.303199+0000","last_peered":"2024-09-10T23:19:55.303199+0000","last_clean":"2024-09-10T23:19:55.303199+0000","last_became_active":"2024-09-10T23:19:55.300666+0000","last_became_peered":"2024-09-10T23:19:55.300666+0000","last_unstale":"2024-09-10T23:19:55.303199+0000","last_undegraded":"2024-09-10T23:19:55.303199+0000","last_fullsized":"2024-09-10T23:19:55.303199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:22.436383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313040+0000","last_change":"2024-09-10T23:19:55.298861+0000","last_active":"2024-09-10T23:19:55.313040+0000","last_peered":"2024-09-10T23:19:55.313040+0000","last_clean":"2024-09-10T23:19:55.313040+0000","last_became_active":"2024-09-10T23:19:55.298396+0000","last_became_peered":"2024-09-10T23:19:55.298396+0000","last_unstale":"2024-09-10T23:19:55.313040+0000","last_undegraded":"2024-09-10T23:19:55.313040+0000","last_fullsized":"2024-09-10T23:19:55.313040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:03.701847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.305450+0000","last_change":"2024-09-10T23:19:55.301787+0000","last_active":"2024-09-10T23:19:55.305450+0000","last_peered":"2024-09-10T23:19:55.305450+0000","last_clean":"2024-09-10T23:19:55.305450+0000","last_became_active":"2024-09-10T23:19:55.300627+0000","last_became_peered":"2024-09-10T23:19:55.300627+0000","last_unstale":"2024-09-10T23:19:55.305450+0000","last_undegraded":"2024-09-10T23:19:55.305450+0000","last_fullsized":"2024-09-10T23:19:55.305450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:19.960900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.305208+0000","last_change":"2024-09-10T23:19:55.300167+0000","last_active":"2024-09-10T23:19:55.305208+0000","last_peered":"2024-09-10T23:19:55.305208+0000","last_clean":"2024-09-10T23:19:55.305208+0000","last_became_active":"2024-09-10T23:19:55.299859+0000","last_became_peered":"2024-09-10T23:19:55.299859+0000","last_unstale":"2024-09-10T23:19:55.305208+0000","last_undegraded":"2024-09-10T23:19:55.305208+0000","last_fullsized":"2024-09-10T23:19:55.305208+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:14.137579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.303628+0000","last_change":"2024-09-10T23:19:55.299676+0000","last_active":"2024-09-10T23:19:55.303628+0000","last_peered":"2024-09-10T23:19:55.303628+0000","last_clean":"2024-09-10T23:19:55.303628+0000","last_became_active":"2024-09-10T23:19:55.299192+0000","last_became_peered":"2024-09-10T23:19:55.299192+0000","last_unstale":"2024-09-10T23:19:55.303628+0000","last_undegraded":"2024-09-10T23:19:55.303628+0000","last_fullsized":"2024-09-10T23:19:55.303628+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:45.380649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.309701+0000","last_change":"2024-09-10T23:19:55.304612+0000","last_active":"2024-09-10T23:19:55.309701+0000","last_peered":"2024-09-10T23:19:55.309701+0000","last_clean":"2024-09-10T23:19:55.309701+0000","last_became_active":"2024-09-10T23:19:55.304273+0000","last_became_peered":"2024-09-10T23:19:55.304273+0000","last_unstale":"2024-09-10T23:19:55.309701+0000","last_undegraded":"2024-09-10T23:19:55.309701+0000","last_fullsized":"2024-09-10T23:19:55.309701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:06.053309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.319778+0000","last_change":"2024-09-10T23:19:55.318302+0000","last_active":"2024-09-10T23:19:55.319778+0000","last_peered":"2024-09-10T23:19:55.319778+0000","last_clean":"2024-09-10T23:19:55.319778+0000","last_became_active":"2024-09-10T23:19:55.317583+0000","last_became_peered":"2024-09-10T23:19:55.317583+0000","last_unstale":"2024-09-10T23:19:55.319778+0000","last_undegraded":"2024-09-10T23:19:55.319778+0000","last_fullsized":"2024-09-10T23:19:55.319778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:32.725973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.318438+0000","last_change":"2024-09-10T23:19:55.316458+0000","last_active":"2024-09-10T23:19:55.318438+0000","last_peered":"2024-09-10T23:19:55.318438+0000","last_clean":"2024-09-10T23:19:55.318438+0000","last_became_active":"2024-09-10T23:19:55.315631+0000","last_became_peered":"2024-09-10T23:19:55.315631+0000","last_unstale":"2024-09-10T23:19:55.318438+0000","last_undegraded":"2024-09-10T23:19:55.318438+0000","last_fullsized":"2024-09-10T23:19:55.318438+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:03.127813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316090+0000","last_change":"2024-09-10T23:19:55.312045+0000","last_active":"2024-09-10T23:19:55.316090+0000","last_peered":"2024-09-10T23:19:55.316090+0000","last_clean":"2024-09-10T23:19:55.316090+0000","last_became_active":"2024-09-10T23:19:55.311687+0000","last_became_peered":"2024-09-10T23:19:55.311687+0000","last_unstale":"2024-09-10T23:19:55.316090+0000","last_undegraded":"2024-09-10T23:19:55.316090+0000","last_fullsized":"2024-09-10T23:19:55.316090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:41.157135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.309738+0000","last_change":"2024-09-10T23:19:55.306279+0000","last_active":"2024-09-10T23:19:55.309738+0000","last_peered":"2024-09-10T23:19:55.309738+0000","last_clean":"2024-09-10T23:19:55.309738+0000","last_became_active":"2024-09-10T23:19:55.305943+0000","last_became_peered":"2024-09-10T23:19:55.305943+0000","last_unstale":"2024-09-10T23:19:55.309738+0000","last_undegraded":"2024-09-10T23:19:55.309738+0000","last_fullsized":"2024-09-10T23:19:55.309738+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.490607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.317039+0000","last_change":"2024-09-10T23:19:55.315055+0000","last_active":"2024-09-10T23:19:55.317039+0000","last_peered":"2024-09-10T23:19:55.317039+0000","last_clean":"2024-09-10T23:19:55.317039+0000","last_became_active":"2024-09-10T23:19:55.314750+0000","last_became_peered":"2024-09-10T23:19:55.314750+0000","last_unstale":"2024-09-10T23:19:55.317039+0000","last_undegraded":"2024-09-10T23:19:55.317039+0000","last_fullsized":"2024-09-10T23:19:55.317039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:58.762771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.309576+0000","last_change":"2024-09-10T23:19:55.304597+0000","last_active":"2024-09-10T23:19:55.309576+0000","last_peered":"2024-09-10T23:19:55.309576+0000","last_clean":"2024-09-10T23:19:55.309576+0000","last_became_active":"2024-09-10T23:19:55.303793+0000","last_became_peered":"2024-09-10T23:19:55.303793+0000","last_unstale":"2024-09-10T23:19:55.309576+0000","last_undegraded":"2024-09-10T23:19:55.309576+0000","last_fullsized":"2024-09-10T23:19:55.309576+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:44.238446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.315275+0000","last_change":"2024-09-10T23:19:55.313112+0000","last_active":"2024-09-10T23:19:55.315275+0000","last_peered":"2024-09-10T23:19:55.315275+0000","last_clean":"2024-09-10T23:19:55.315275+0000","last_became_active":"2024-09-10T23:19:55.312728+0000","last_became_peered":"2024-09-10T23:19:55.312728+0000","last_unstale":"2024-09-10T23:19:55.315275+0000","last_undegraded":"2024-09-10T23:19:55.315275+0000","last_fullsized":"2024-09-10T23:19:55.315275+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:42.335583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311695+0000","last_change":"2024-09-10T23:19:55.307993+0000","last_active":"2024-09-10T23:19:55.311695+0000","last_peered":"2024-09-10T23:19:55.311695+0000","last_clean":"2024-09-10T23:19:55.311695+0000","last_became_active":"2024-09-10T23:19:55.307653+0000","last_became_peered":"2024-09-10T23:19:55.307653+0000","last_unstale":"2024-09-10T23:19:55.311695+0000","last_undegraded":"2024-09-10T23:19:55.311695+0000","last_fullsized":"2024-09-10T23:19:55.311695+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:17.201713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316439+0000","last_change":"2024-09-10T23:19:55.313896+0000","last_active":"2024-09-10T23:19:55.316439+0000","last_peered":"2024-09-10T23:19:55.316439+0000","last_clean":"2024-09-10T23:19:55.316439+0000","last_became_active":"2024-09-10T23:19:55.313624+0000","last_became_peered":"2024-09-10T23:19:55.313624+0000","last_unstale":"2024-09-10T23:19:55.316439+0000","last_undegraded":"2024-09-10T23:19:55.316439+0000","last_fullsized":"2024-09-10T23:19:55.316439+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:04.490743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.312964+0000","last_change":"2024-09-10T23:19:55.297793+0000","last_active":"2024-09-10T23:19:55.312964+0000","last_peered":"2024-09-10T23:19:55.312964+0000","last_clean":"2024-09-10T23:19:55.312964+0000","last_became_active":"2024-09-10T23:19:55.297512+0000","last_became_peered":"2024-09-10T23:19:55.297512+0000","last_unstale":"2024-09-10T23:19:55.312964+0000","last_undegraded":"2024-09-10T23:19:55.312964+0000","last_fullsized":"2024-09-10T23:19:55.312964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:28.678620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311391+0000","last_change":"2024-09-10T23:19:55.304906+0000","last_active":"2024-09-10T23:19:55.311391+0000","last_peered":"2024-09-10T23:19:55.311391+0000","last_clean":"2024-09-10T23:19:55.311391+0000","last_became_active":"2024-09-10T23:19:55.304534+0000","last_became_peered":"2024-09-10T23:19:55.304534+0000","last_unstale":"2024-09-10T23:19:55.311391+0000","last_undegraded":"2024-09-10T23:19:55.311391+0000","last_fullsized":"2024-09-10T23:19:55.311391+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:08.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110369+0000","last_change":"2024-09-10T23:19:55.306571+0000","last_active":"2024-09-10T23:19:57.110369+0000","last_peered":"2024-09-10T23:19:57.110369+0000","last_clean":"2024-09-10T23:19:57.110369+0000","last_became_active":"2024-09-10T23:19:55.306414+0000","last_became_peered":"2024-09-10T23:19:55.306414+0000","last_unstale":"2024-09-10T23:19:57.110369+0000","last_undegraded":"2024-09-10T23:19:57.110369+0000","last_fullsized":"2024-09-10T23:19:57.110369+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:50.701331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.317839+0000","last_change":"2024-09-10T23:19:55.316835+0000","last_active":"2024-09-10T23:19:55.317839+0000","last_peered":"2024-09-10T23:19:55.317839+0000","last_clean":"2024-09-10T23:19:55.317839+0000","last_became_active":"2024-09-10T23:19:55.316395+0000","last_became_peered":"2024-09-10T23:19:55.316395+0000","last_unstale":"2024-09-10T23:19:55.317839+0000","last_undegraded":"2024-09-10T23:19:55.317839+0000","last_fullsized":"2024-09-10T23:19:55.317839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:48.141917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110054+0000","last_change":"2024-09-10T23:19:55.303248+0000","last_active":"2024-09-10T23:19:57.110054+0000","last_peered":"2024-09-10T23:19:57.110054+0000","last_clean":"2024-09-10T23:19:57.110054+0000","last_became_active":"2024-09-10T23:19:55.302957+0000","last_became_peered":"2024-09-10T23:19:55.302957+0000","last_unstale":"2024-09-10T23:19:57.110054+0000","last_undegraded":"2024-09-10T23:19:57.110054+0000","last_fullsized":"2024-09-10T23:19:57.110054+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:35.712565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110007+0000","last_change":"2024-09-10T23:19:55.302456+0000","last_active":"2024-09-10T23:19:57.110007+0000","last_peered":"2024-09-10T23:19:57.110007+0000","last_clean":"2024-09-10T23:19:57.110007+0000","last_became_active":"2024-09-10T23:19:55.302117+0000","last_became_peered":"2024-09-10T23:19:55.302117+0000","last_unstale":"2024-09-10T23:19:57.110007+0000","last_undegraded":"2024-09-10T23:19:57.110007+0000","last_fullsized":"2024-09-10T23:19:57.110007+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:17.810771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314856+0000","last_change":"2024-09-10T23:19:55.308587+0000","last_active":"2024-09-10T23:19:55.314856+0000","last_peered":"2024-09-10T23:19:55.314856+0000","last_clean":"2024-09-10T23:19:55.314856+0000","last_became_active":"2024-09-10T23:19:55.308286+0000","last_became_peered":"2024-09-10T23:19:55.308286+0000","last_unstale":"2024-09-10T23:19:55.314856+0000","last_undegraded":"2024-09-10T23:19:55.314856+0000","last_fullsized":"2024-09-10T23:19:55.314856+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:50.451200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314843+0000","last_change":"2024-09-10T23:19:55.309546+0000","last_active":"2024-09-10T23:19:55.314843+0000","last_peered":"2024-09-10T23:19:55.314843+0000","last_clean":"2024-09-10T23:19:55.314843+0000","last_became_active":"2024-09-10T23:19:55.309212+0000","last_became_peered":"2024-09-10T23:19:55.309212+0000","last_unstale":"2024-09-10T23:19:55.314843+0000","last_undegraded":"2024-09-10T23:19:55.314843+0000","last_fullsized":"2024-09-10T23:19:55.314843+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:44.577757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314952+0000","last_change":"2024-09-10T23:19:55.309994+0000","last_active":"2024-09-10T23:19:55.314952+0000","last_peered":"2024-09-10T23:19:55.314952+0000","last_clean":"2024-09-10T23:19:55.314952+0000","last_became_active":"2024-09-10T23:19:55.309534+0000","last_became_peered":"2024-09-10T23:19:55.309534+0000","last_unstale":"2024-09-10T23:19:55.314952+0000","last_undegraded":"2024-09-10T23:19:55.314952+0000","last_fullsized":"2024-09-10T23:19:55.314952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:42.309743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313332+0000","last_change":"2024-09-10T23:19:55.299863+0000","last_active":"2024-09-10T23:19:55.313332+0000","last_peered":"2024-09-10T23:19:55.313332+0000","last_clean":"2024-09-10T23:19:55.313332+0000","last_became_active":"2024-09-10T23:19:55.298861+0000","last_became_peered":"2024-09-10T23:19:55.298861+0000","last_unstale":"2024-09-10T23:19:55.313332+0000","last_undegraded":"2024-09-10T23:19:55.313332+0000","last_fullsized":"2024-09-10T23:19:55.313332+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:03.512765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314457+0000","last_change":"2024-09-10T23:19:55.312027+0000","last_active":"2024-09-10T23:19:55.314457+0000","last_peered":"2024-09-10T23:19:55.314457+0000","last_clean":"2024-09-10T23:19:55.314457+0000","last_became_active":"2024-09-10T23:19:55.309013+0000","last_became_peered":"2024-09-10T23:19:55.309013+0000","last_unstale":"2024-09-10T23:19:55.314457+0000","last_undegraded":"2024-09-10T23:19:55.314457+0000","last_fullsized":"2024-09-10T23:19:55.314457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:10.692758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.304876+0000","last_change":"2024-09-10T23:19:55.297944+0000","last_active":"2024-09-10T23:19:55.304876+0000","last_peered":"2024-09-10T23:19:55.304876+0000","last_clean":"2024-09-10T23:19:55.304876+0000","last_became_active":"2024-09-10T23:19:55.297680+0000","last_became_peered":"2024-09-10T23:19:55.297680+0000","last_unstale":"2024-09-10T23:19:55.304876+0000","last_undegraded":"2024-09-10T23:19:55.304876+0000","last_fullsized":"2024-09-10T23:19:55.304876+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:35.059341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.310545+0000","last_change":"2024-09-10T23:19:55.307935+0000","last_active":"2024-09-10T23:19:55.310545+0000","last_peered":"2024-09-10T23:19:55.310545+0000","last_clean":"2024-09-10T23:19:55.310545+0000","last_became_active":"2024-09-10T23:19:55.306265+0000","last_became_peered":"2024-09-10T23:19:55.306265+0000","last_unstale":"2024-09-10T23:19:55.310545+0000","last_undegraded":"2024-09-10T23:19:55.310545+0000","last_fullsized":"2024-09-10T23:19:55.310545+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:04.101233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.312211+0000","last_change":"2024-09-10T23:19:55.296974+0000","last_active":"2024-09-10T23:19:55.312211+0000","last_peered":"2024-09-10T23:19:55.312211+0000","last_clean":"2024-09-10T23:19:55.312211+0000","last_became_active":"2024-09-10T23:19:55.296712+0000","last_became_peered":"2024-09-10T23:19:55.296712+0000","last_unstale":"2024-09-10T23:19:55.312211+0000","last_undegraded":"2024-09-10T23:19:55.312211+0000","last_fullsized":"2024-09-10T23:19:55.312211+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:12.934931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.301336+0000","last_change":"2024-09-10T23:19:55.294059+0000","last_active":"2024-09-10T23:19:55.301336+0000","last_peered":"2024-09-10T23:19:55.301336+0000","last_clean":"2024-09-10T23:19:55.301336+0000","last_became_active":"2024-09-10T23:19:55.293542+0000","last_became_peered":"2024-09-10T23:19:55.293542+0000","last_unstale":"2024-09-10T23:19:55.301336+0000","last_undegraded":"2024-09-10T23:19:55.301336+0000","last_fullsized":"2024-09-10T23:19:55.301336+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:46.356788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.319522+0000","last_change":"2024-09-10T23:19:55.317819+0000","last_active":"2024-09-10T23:19:55.319522+0000","last_peered":"2024-09-10T23:19:55.319522+0000","last_clean":"2024-09-10T23:19:55.319522+0000","last_became_active":"2024-09-10T23:19:55.317545+0000","last_became_peered":"2024-09-10T23:19:55.317545+0000","last_unstale":"2024-09-10T23:19:55.319522+0000","last_undegraded":"2024-09-10T23:19:55.319522+0000","last_fullsized":"2024-09-10T23:19:55.319522+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:41.157135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"69'4","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.325285+0000","last_change":"2024-09-10T23:19:54.295275+0000","last_active":"2024-09-10T23:19:55.325285+0000","last_peered":"2024-09-10T23:19:55.325285+0000","last_clean":"2024-09-10T23:19:55.325285+0000","last_became_active":"2024-09-10T23:19:54.294980+0000","last_became_peered":"2024-09-10T23:19:54.294980+0000","last_unstale":"2024-09-10T23:19:55.325285+0000","last_undegraded":"2024-09-10T23:19:55.325285+0000","last_fullsized":"2024-09-10T23:19:55.325285+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:55.271033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316066+0000","last_change":"2024-09-10T23:19:55.306186+0000","last_active":"2024-09-10T23:19:55.316066+0000","last_peered":"2024-09-10T23:19:55.316066+0000","last_clean":"2024-09-10T23:19:55.316066+0000","last_became_active":"2024-09-10T23:19:55.305778+0000","last_became_peered":"2024-09-10T23:19:55.305778+0000","last_unstale":"2024-09-10T23:19:55.316066+0000","last_undegraded":"2024-09-10T23:19:55.316066+0000","last_fullsized":"2024-09-10T23:19:55.316066+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:26.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"69'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.322103+0000","last_change":"2024-09-10T23:19:54.296763+0000","last_active":"2024-09-10T23:19:55.322103+0000","last_peered":"2024-09-10T23:19:55.322103+0000","last_clean":"2024-09-10T23:19:55.322103+0000","last_became_active":"2024-09-10T23:19:54.295510+0000","last_became_peered":"2024-09-10T23:19:54.295510+0000","last_unstale":"2024-09-10T23:19:55.322103+0000","last_undegraded":"2024-09-10T23:19:55.322103+0000","last_fullsized":"2024-09-10T23:19:55.322103+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:13.070615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.298322+0000","last_change":"2024-09-10T23:19:55.294415+0000","last_active":"2024-09-10T23:19:55.298322+0000","last_peered":"2024-09-10T23:19:55.298322+0000","last_clean":"2024-09-10T23:19:55.298322+0000","last_became_active":"2024-09-10T23:19:55.294106+0000","last_became_peered":"2024-09-10T23:19:55.294106+0000","last_unstale":"2024-09-10T23:19:55.298322+0000","last_undegraded":"2024-09-10T23:19:55.298322+0000","last_fullsized":"2024-09-10T23:19:55.298322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:36.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.324975+0000","last_change":"2024-09-10T23:19:54.296934+0000","last_active":"2024-09-10T23:19:55.324975+0000","last_peered":"2024-09-10T23:19:55.324975+0000","last_clean":"2024-09-10T23:19:55.324975+0000","last_became_active":"2024-09-10T23:19:54.296228+0000","last_became_peered":"2024-09-10T23:19:54.296228+0000","last_unstale":"2024-09-10T23:19:55.324975+0000","last_undegraded":"2024-09-10T23:19:55.324975+0000","last_fullsized":"2024-09-10T23:19:55.324975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:47.134486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.318876+0000","last_change":"2024-09-10T23:19:55.316955+0000","last_active":"2024-09-10T23:19:55.318876+0000","last_peered":"2024-09-10T23:19:55.318876+0000","last_clean":"2024-09-10T23:19:55.318876+0000","last_became_active":"2024-09-10T23:19:55.315614+0000","last_became_peered":"2024-09-10T23:19:55.315614+0000","last_unstale":"2024-09-10T23:19:55.318876+0000","last_undegraded":"2024-09-10T23:19:55.318876+0000","last_fullsized":"2024-09-10T23:19:55.318876+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:15.835236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.324130+0000","last_change":"2024-09-10T23:19:54.291836+0000","last_active":"2024-09-10T23:19:55.324130+0000","last_peered":"2024-09-10T23:19:55.324130+0000","last_clean":"2024-09-10T23:19:55.324130+0000","last_became_active":"2024-09-10T23:19:54.291552+0000","last_became_peered":"2024-09-10T23:19:54.291552+0000","last_unstale":"2024-09-10T23:19:55.324130+0000","last_undegraded":"2024-09-10T23:19:55.324130+0000","last_fullsized":"2024-09-10T23:19:55.324130+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:25.738835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.305392+0000","last_change":"2024-09-10T23:19:55.302686+0000","last_active":"2024-09-10T23:19:55.305392+0000","last_peered":"2024-09-10T23:19:55.305392+0000","last_clean":"2024-09-10T23:19:55.305392+0000","last_became_active":"2024-09-10T23:19:55.302401+0000","last_became_peered":"2024-09-10T23:19:55.302401+0000","last_unstale":"2024-09-10T23:19:55.305392+0000","last_undegraded":"2024-09-10T23:19:55.305392+0000","last_fullsized":"2024-09-10T23:19:55.305392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:26.047403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"69'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.109998+0000","last_change":"2024-09-10T23:19:54.285382+0000","last_active":"2024-09-10T23:19:57.109998+0000","last_peered":"2024-09-10T23:19:57.109998+0000","last_clean":"2024-09-10T23:19:57.109998+0000","last_became_active":"2024-09-10T23:19:54.285111+0000","last_became_peered":"2024-09-10T23:19:54.285111+0000","last_unstale":"2024-09-10T23:19:57.109998+0000","last_undegraded":"2024-09-10T23:19:57.109998+0000","last_fullsized":"2024-09-10T23:19:57.109998+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:23.389250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313334+0000","last_change":"2024-09-10T23:19:55.301676+0000","last_active":"2024-09-10T23:19:55.313334+0000","last_peered":"2024-09-10T23:19:55.313334+0000","last_clean":"2024-09-10T23:19:55.313334+0000","last_became_active":"2024-09-10T23:19:55.301409+0000","last_became_peered":"2024-09-10T23:19:55.301409+0000","last_unstale":"2024-09-10T23:19:55.313334+0000","last_undegraded":"2024-09-10T23:19:55.313334+0000","last_fullsized":"2024-09-10T23:19:55.313334+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:54.749196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"69'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.109888+0000","last_change":"2024-09-10T23:19:54.288076+0000","last_active":"2024-09-10T23:19:57.109888+0000","last_peered":"2024-09-10T23:19:57.109888+0000","last_clean":"2024-09-10T23:19:57.109888+0000","last_became_active":"2024-09-10T23:19:54.287744+0000","last_became_peered":"2024-09-10T23:19:54.287744+0000","last_unstale":"2024-09-10T23:19:57.109888+0000","last_undegraded":"2024-09-10T23:19:57.109888+0000","last_fullsized":"2024-09-10T23:19:57.109888+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:22.117353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311565+0000","last_change":"2024-09-10T23:19:55.307445+0000","last_active":"2024-09-10T23:19:55.311565+0000","last_peered":"2024-09-10T23:19:55.311565+0000","last_clean":"2024-09-10T23:19:55.311565+0000","last_became_active":"2024-09-10T23:19:55.307139+0000","last_became_peered":"2024-09-10T23:19:55.307139+0000","last_unstale":"2024-09-10T23:19:55.311565+0000","last_undegraded":"2024-09-10T23:19:55.311565+0000","last_fullsized":"2024-09-10T23:19:55.311565+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:03.512765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.109838+0000","last_change":"2024-09-10T23:19:54.288346+0000","last_active":"2024-09-10T23:19:57.109838+0000","last_peered":"2024-09-10T23:19:57.109838+0000","last_clean":"2024-09-10T23:19:57.109838+0000","last_became_active":"2024-09-10T23:19:54.288081+0000","last_became_peered":"2024-09-10T23:19:54.288081+0000","last_unstale":"2024-09-10T23:19:57.109838+0000","last_undegraded":"2024-09-10T23:19:57.109838+0000","last_fullsized":"2024-09-10T23:19:57.109838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:43.347553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110219+0000","last_change":"2024-09-10T23:19:55.313606+0000","last_active":"2024-09-10T23:19:57.110219+0000","last_peered":"2024-09-10T23:19:57.110219+0000","last_clean":"2024-09-10T23:19:57.110219+0000","last_became_active":"2024-09-10T23:19:55.313321+0000","last_became_peered":"2024-09-10T23:19:55.313321+0000","last_unstale":"2024-09-10T23:19:57.110219+0000","last_undegraded":"2024-09-10T23:19:57.110219+0000","last_fullsized":"2024-09-10T23:19:57.110219+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:02.520014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.292815+0000","last_change":"2024-09-10T23:19:54.296649+0000","last_active":"2024-09-10T23:19:55.292815+0000","last_peered":"2024-09-10T23:19:55.292815+0000","last_clean":"2024-09-10T23:19:55.292815+0000","last_became_active":"2024-09-10T23:19:54.295854+0000","last_became_peered":"2024-09-10T23:19:54.295854+0000","last_unstale":"2024-09-10T23:19:55.292815+0000","last_undegraded":"2024-09-10T23:19:55.292815+0000","last_fullsized":"2024-09-10T23:19:55.292815+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:17.603496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314432+0000","last_change":"2024-09-10T23:19:55.306003+0000","last_active":"2024-09-10T23:19:55.314432+0000","last_peered":"2024-09-10T23:19:55.314432+0000","last_clean":"2024-09-10T23:19:55.314432+0000","last_became_active":"2024-09-10T23:19:55.305714+0000","last_became_peered":"2024-09-10T23:19:55.305714+0000","last_unstale":"2024-09-10T23:19:55.314432+0000","last_undegraded":"2024-09-10T23:19:55.314432+0000","last_fullsized":"2024-09-10T23:19:55.314432+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:23.307502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.293987+0000","last_change":"2024-09-10T23:19:54.303273+0000","last_active":"2024-09-10T23:19:55.293987+0000","last_peered":"2024-09-10T23:19:55.293987+0000","last_clean":"2024-09-10T23:19:55.293987+0000","last_became_active":"2024-09-10T23:19:54.302658+0000","last_became_peered":"2024-09-10T23:19:54.302658+0000","last_unstale":"2024-09-10T23:19:55.293987+0000","last_undegraded":"2024-09-10T23:19:55.293987+0000","last_fullsized":"2024-09-10T23:19:55.293987+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:03.999590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110251+0000","last_change":"2024-09-10T23:19:55.305383+0000","last_active":"2024-09-10T23:19:57.110251+0000","last_peered":"2024-09-10T23:19:57.110251+0000","last_clean":"2024-09-10T23:19:57.110251+0000","last_became_active":"2024-09-10T23:19:55.305092+0000","last_became_peered":"2024-09-10T23:19:55.305092+0000","last_unstale":"2024-09-10T23:19:57.110251+0000","last_undegraded":"2024-09-10T23:19:57.110251+0000","last_fullsized":"2024-09-10T23:19:57.110251+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:42.005788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.288378+0000","last_change":"2024-09-10T23:19:54.294270+0000","last_active":"2024-09-10T23:19:55.288378+0000","last_peered":"2024-09-10T23:19:55.288378+0000","last_clean":"2024-09-10T23:19:55.288378+0000","last_became_active":"2024-09-10T23:19:54.294007+0000","last_became_peered":"2024-09-10T23:19:54.294007+0000","last_unstale":"2024-09-10T23:19:55.288378+0000","last_undegraded":"2024-09-10T23:19:55.288378+0000","last_fullsized":"2024-09-10T23:19:55.288378+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:18.953469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311892+0000","last_change":"2024-09-10T23:19:55.306758+0000","last_active":"2024-09-10T23:19:55.311892+0000","last_peered":"2024-09-10T23:19:55.311892+0000","last_clean":"2024-09-10T23:19:55.311892+0000","last_became_active":"2024-09-10T23:19:55.306493+0000","last_became_peered":"2024-09-10T23:19:55.306493+0000","last_unstale":"2024-09-10T23:19:55.311892+0000","last_undegraded":"2024-09-10T23:19:55.311892+0000","last_fullsized":"2024-09-10T23:19:55.311892+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:03.701847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"69'3","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.325915+0000","last_change":"2024-09-10T23:19:54.302809+0000","last_active":"2024-09-10T23:19:55.325915+0000","last_peered":"2024-09-10T23:19:55.325915+0000","last_clean":"2024-09-10T23:19:55.325915+0000","last_became_active":"2024-09-10T23:19:54.301856+0000","last_became_peered":"2024-09-10T23:19:54.301856+0000","last_unstale":"2024-09-10T23:19:55.325915+0000","last_undegraded":"2024-09-10T23:19:55.325915+0000","last_fullsized":"2024-09-10T23:19:55.325915+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:18.765223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313473+0000","last_change":"2024-09-10T23:19:55.300418+0000","last_active":"2024-09-10T23:19:55.313473+0000","last_peered":"2024-09-10T23:19:55.313473+0000","last_clean":"2024-09-10T23:19:55.313473+0000","last_became_active":"2024-09-10T23:19:55.298580+0000","last_became_peered":"2024-09-10T23:19:55.298580+0000","last_unstale":"2024-09-10T23:19:55.313473+0000","last_undegraded":"2024-09-10T23:19:55.313473+0000","last_fullsized":"2024-09-10T23:19:55.313473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:23.021216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"69'6","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.327652+0000","last_change":"2024-09-10T23:19:54.293010+0000","last_active":"2024-09-10T23:19:55.327652+0000","last_peered":"2024-09-10T23:19:55.327652+0000","last_clean":"2024-09-10T23:19:55.327652+0000","last_became_active":"2024-09-10T23:19:54.292719+0000","last_became_peered":"2024-09-10T23:19:54.292719+0000","last_unstale":"2024-09-10T23:19:55.327652+0000","last_undegraded":"2024-09-10T23:19:55.327652+0000","last_fullsized":"2024-09-10T23:19:55.327652+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:51.600981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313153+0000","last_change":"2024-09-10T23:19:55.298452+0000","last_active":"2024-09-10T23:19:55.313153+0000","last_peered":"2024-09-10T23:19:55.313153+0000","last_clean":"2024-09-10T23:19:55.313153+0000","last_became_active":"2024-09-10T23:19:55.298132+0000","last_became_peered":"2024-09-10T23:19:55.298132+0000","last_unstale":"2024-09-10T23:19:55.313153+0000","last_undegraded":"2024-09-10T23:19:55.313153+0000","last_fullsized":"2024-09-10T23:19:55.313153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:35.435895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.327238+0000","last_change":"2024-09-10T23:19:54.300169+0000","last_active":"2024-09-10T23:19:55.327238+0000","last_peered":"2024-09-10T23:19:55.327238+0000","last_clean":"2024-09-10T23:19:55.327238+0000","last_became_active":"2024-09-10T23:19:54.299887+0000","last_became_peered":"2024-09-10T23:19:54.299887+0000","last_unstale":"2024-09-10T23:19:55.327238+0000","last_undegraded":"2024-09-10T23:19:55.327238+0000","last_fullsized":"2024-09-10T23:19:55.327238+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:47.278472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.310528+0000","last_change":"2024-09-10T23:19:55.305466+0000","last_active":"2024-09-10T23:19:55.310528+0000","last_peered":"2024-09-10T23:19:55.310528+0000","last_clean":"2024-09-10T23:19:55.310528+0000","last_became_active":"2024-09-10T23:19:55.305179+0000","last_became_peered":"2024-09-10T23:19:55.305179+0000","last_unstale":"2024-09-10T23:19:55.310528+0000","last_undegraded":"2024-09-10T23:19:55.310528+0000","last_fullsized":"2024-09-10T23:19:55.310528+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:24.640326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.295232+0000","last_change":"2024-09-10T23:19:54.295818+0000","last_active":"2024-09-10T23:19:55.295232+0000","last_peered":"2024-09-10T23:19:55.295232+0000","last_clean":"2024-09-10T23:19:55.295232+0000","last_became_active":"2024-09-10T23:19:54.295565+0000","last_became_peered":"2024-09-10T23:19:54.295565+0000","last_unstale":"2024-09-10T23:19:55.295232+0000","last_undegraded":"2024-09-10T23:19:55.295232+0000","last_fullsized":"2024-09-10T23:19:55.295232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:37.842236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311397+0000","last_change":"2024-09-10T23:19:55.306483+0000","last_active":"2024-09-10T23:19:55.311397+0000","last_peered":"2024-09-10T23:19:55.311397+0000","last_clean":"2024-09-10T23:19:55.311397+0000","last_became_active":"2024-09-10T23:19:55.306179+0000","last_became_peered":"2024-09-10T23:19:55.306179+0000","last_unstale":"2024-09-10T23:19:55.311397+0000","last_undegraded":"2024-09-10T23:19:55.311397+0000","last_fullsized":"2024-09-10T23:19:55.311397+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:35.435895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.292739+0000","last_change":"2024-09-10T23:19:54.298564+0000","last_active":"2024-09-10T23:19:55.292739+0000","last_peered":"2024-09-10T23:19:55.292739+0000","last_clean":"2024-09-10T23:19:55.292739+0000","last_became_active":"2024-09-10T23:19:54.298300+0000","last_became_peered":"2024-09-10T23:19:54.298300+0000","last_unstale":"2024-09-10T23:19:55.292739+0000","last_undegraded":"2024-09-10T23:19:55.292739+0000","last_fullsized":"2024-09-10T23:19:55.292739+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:51.500949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313966+0000","last_change":"2024-09-10T23:19:55.311276+0000","last_active":"2024-09-10T23:19:55.313966+0000","last_peered":"2024-09-10T23:19:55.313966+0000","last_clean":"2024-09-10T23:19:55.313966+0000","last_became_active":"2024-09-10T23:19:55.310987+0000","last_became_peered":"2024-09-10T23:19:55.310987+0000","last_unstale":"2024-09-10T23:19:55.313966+0000","last_undegraded":"2024-09-10T23:19:55.313966+0000","last_fullsized":"2024-09-10T23:19:55.313966+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:52.336906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"69'8","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.326782+0000","last_change":"2024-09-10T23:19:54.295260+0000","last_active":"2024-09-10T23:19:55.326782+0000","last_peered":"2024-09-10T23:19:55.326782+0000","last_clean":"2024-09-10T23:19:55.326782+0000","last_became_active":"2024-09-10T23:19:54.295012+0000","last_became_peered":"2024-09-10T23:19:54.295012+0000","last_unstale":"2024-09-10T23:19:55.326782+0000","last_undegraded":"2024-09-10T23:19:55.326782+0000","last_fullsized":"2024-09-10T23:19:55.326782+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:12.581636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.317104+0000","last_change":"2024-09-10T23:19:55.314224+0000","last_active":"2024-09-10T23:19:55.317104+0000","last_peered":"2024-09-10T23:19:55.317104+0000","last_clean":"2024-09-10T23:19:55.317104+0000","last_became_active":"2024-09-10T23:19:55.313467+0000","last_became_peered":"2024-09-10T23:19:55.313467+0000","last_unstale":"2024-09-10T23:19:55.317104+0000","last_undegraded":"2024-09-10T23:19:55.317104+0000","last_fullsized":"2024-09-10T23:19:55.317104+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:37.916784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"69'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.326194+0000","last_change":"2024-09-10T23:19:54.297216+0000","last_active":"2024-09-10T23:19:55.326194+0000","last_peered":"2024-09-10T23:19:55.326194+0000","last_clean":"2024-09-10T23:19:55.326194+0000","last_became_active":"2024-09-10T23:19:54.296929+0000","last_became_peered":"2024-09-10T23:19:54.296929+0000","last_unstale":"2024-09-10T23:19:55.326194+0000","last_undegraded":"2024-09-10T23:19:55.326194+0000","last_fullsized":"2024-09-10T23:19:55.326194+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:37.666535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311582+0000","last_change":"2024-09-10T23:19:55.303723+0000","last_active":"2024-09-10T23:19:55.311582+0000","last_peered":"2024-09-10T23:19:55.311582+0000","last_clean":"2024-09-10T23:19:55.311582+0000","last_became_active":"2024-09-10T23:19:55.303451+0000","last_became_peered":"2024-09-10T23:19:55.303451+0000","last_unstale":"2024-09-10T23:19:55.311582+0000","last_undegraded":"2024-09-10T23:19:55.311582+0000","last_fullsized":"2024-09-10T23:19:55.311582+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:12.934931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.326766+0000","last_change":"2024-09-10T23:19:54.300990+0000","last_active":"2024-09-10T23:19:55.326766+0000","last_peered":"2024-09-10T23:19:55.326766+0000","last_clean":"2024-09-10T23:19:55.326766+0000","last_became_active":"2024-09-10T23:19:54.300656+0000","last_became_peered":"2024-09-10T23:19:54.300656+0000","last_unstale":"2024-09-10T23:19:55.326766+0000","last_undegraded":"2024-09-10T23:19:55.326766+0000","last_fullsized":"2024-09-10T23:19:55.326766+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:01.974021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316210+0000","last_change":"2024-09-10T23:19:55.306880+0000","last_active":"2024-09-10T23:19:55.316210+0000","last_peered":"2024-09-10T23:19:55.316210+0000","last_clean":"2024-09-10T23:19:55.316210+0000","last_became_active":"2024-09-10T23:19:55.306570+0000","last_became_peered":"2024-09-10T23:19:55.306570+0000","last_unstale":"2024-09-10T23:19:55.316210+0000","last_undegraded":"2024-09-10T23:19:55.316210+0000","last_fullsized":"2024-09-10T23:19:55.316210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:23.208562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"69'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.325800+0000","last_change":"2024-09-10T23:19:54.302905+0000","last_active":"2024-09-10T23:19:55.325800+0000","last_peered":"2024-09-10T23:19:55.325800+0000","last_clean":"2024-09-10T23:19:55.325800+0000","last_became_active":"2024-09-10T23:19:54.301870+0000","last_became_peered":"2024-09-10T23:19:54.301870+0000","last_unstale":"2024-09-10T23:19:55.325800+0000","last_undegraded":"2024-09-10T23:19:55.325800+0000","last_fullsized":"2024-09-10T23:19:55.325800+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:10.202292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311598+0000","last_change":"2024-09-10T23:19:55.307575+0000","last_active":"2024-09-10T23:19:55.311598+0000","last_peered":"2024-09-10T23:19:55.311598+0000","last_clean":"2024-09-10T23:19:55.311598+0000","last_became_active":"2024-09-10T23:19:55.307272+0000","last_became_peered":"2024-09-10T23:19:55.307272+0000","last_unstale":"2024-09-10T23:19:55.311598+0000","last_undegraded":"2024-09-10T23:19:55.311598+0000","last_fullsized":"2024-09-10T23:19:55.311598+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:23.021216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110276+0000","last_change":"2024-09-10T23:19:54.289984+0000","last_active":"2024-09-10T23:19:57.110276+0000","last_peered":"2024-09-10T23:19:57.110276+0000","last_clean":"2024-09-10T23:19:57.110276+0000","last_became_active":"2024-09-10T23:19:54.289682+0000","last_became_peered":"2024-09-10T23:19:54.289682+0000","last_unstale":"2024-09-10T23:19:57.110276+0000","last_undegraded":"2024-09-10T23:19:57.110276+0000","last_fullsized":"2024-09-10T23:19:57.110276+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:35.363721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.301363+0000","last_change":"2024-09-10T23:19:55.294417+0000","last_active":"2024-09-10T23:19:55.301363+0000","last_peered":"2024-09-10T23:19:55.301363+0000","last_clean":"2024-09-10T23:19:55.301363+0000","last_became_active":"2024-09-10T23:19:55.294058+0000","last_became_peered":"2024-09-10T23:19:55.294058+0000","last_unstale":"2024-09-10T23:19:55.301363+0000","last_undegraded":"2024-09-10T23:19:55.301363+0000","last_fullsized":"2024-09-10T23:19:55.301363+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:45.775697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.325256+0000","last_change":"2024-09-10T23:19:54.288051+0000","last_active":"2024-09-10T23:19:55.325256+0000","last_peered":"2024-09-10T23:19:55.325256+0000","last_clean":"2024-09-10T23:19:55.325256+0000","last_became_active":"2024-09-10T23:19:54.287769+0000","last_became_peered":"2024-09-10T23:19:54.287769+0000","last_unstale":"2024-09-10T23:19:55.325256+0000","last_undegraded":"2024-09-10T23:19:55.325256+0000","last_fullsized":"2024-09-10T23:19:55.325256+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:57.755340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316360+0000","last_change":"2024-09-10T23:19:55.310646+0000","last_active":"2024-09-10T23:19:55.316360+0000","last_peered":"2024-09-10T23:19:55.316360+0000","last_clean":"2024-09-10T23:19:55.316360+0000","last_became_active":"2024-09-10T23:19:55.310337+0000","last_became_peered":"2024-09-10T23:19:55.310337+0000","last_unstale":"2024-09-10T23:19:55.316360+0000","last_undegraded":"2024-09-10T23:19:55.316360+0000","last_fullsized":"2024-09-10T23:19:55.316360+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:02.496457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.295443+0000","last_change":"2024-09-10T23:19:54.295953+0000","last_active":"2024-09-10T23:19:55.295443+0000","last_peered":"2024-09-10T23:19:55.295443+0000","last_clean":"2024-09-10T23:19:55.295443+0000","last_became_active":"2024-09-10T23:19:54.295675+0000","last_became_peered":"2024-09-10T23:19:54.295675+0000","last_unstale":"2024-09-10T23:19:55.295443+0000","last_undegraded":"2024-09-10T23:19:55.295443+0000","last_fullsized":"2024-09-10T23:19:55.295443+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.726846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.305246+0000","last_change":"2024-09-10T23:19:55.301209+0000","last_active":"2024-09-10T23:19:55.305246+0000","last_peered":"2024-09-10T23:19:55.305246+0000","last_clean":"2024-09-10T23:19:55.305246+0000","last_became_active":"2024-09-10T23:19:55.300961+0000","last_became_peered":"2024-09-10T23:19:55.300961+0000","last_unstale":"2024-09-10T23:19:55.305246+0000","last_undegraded":"2024-09-10T23:19:55.305246+0000","last_fullsized":"2024-09-10T23:19:55.305246+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:13.589067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.289980+0000","last_change":"2024-09-10T23:19:54.298442+0000","last_active":"2024-09-10T23:19:55.289980+0000","last_peered":"2024-09-10T23:19:55.289980+0000","last_clean":"2024-09-10T23:19:55.289980+0000","last_became_active":"2024-09-10T23:19:54.298122+0000","last_became_peered":"2024-09-10T23:19:54.298122+0000","last_unstale":"2024-09-10T23:19:55.289980+0000","last_undegraded":"2024-09-10T23:19:55.289980+0000","last_fullsized":"2024-09-10T23:19:55.289980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:01.489026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.315214+0000","last_change":"2024-09-10T23:19:55.308995+0000","last_active":"2024-09-10T23:19:55.315214+0000","last_peered":"2024-09-10T23:19:55.315214+0000","last_clean":"2024-09-10T23:19:55.315214+0000","last_became_active":"2024-09-10T23:19:55.308467+0000","last_became_peered":"2024-09-10T23:19:55.308467+0000","last_unstale":"2024-09-10T23:19:55.315214+0000","last_undegraded":"2024-09-10T23:19:55.315214+0000","last_fullsized":"2024-09-10T23:19:55.315214+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:10.927825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.327077+0000","last_change":"2024-09-10T23:19:54.302359+0000","last_active":"2024-09-10T23:19:55.327077+0000","last_peered":"2024-09-10T23:19:55.327077+0000","last_clean":"2024-09-10T23:19:55.327077+0000","last_became_active":"2024-09-10T23:19:54.302073+0000","last_became_peered":"2024-09-10T23:19:54.302073+0000","last_unstale":"2024-09-10T23:19:55.327077+0000","last_undegraded":"2024-09-10T23:19:55.327077+0000","last_fullsized":"2024-09-10T23:19:55.327077+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:52.677068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.310771+0000","last_change":"2024-09-10T23:19:55.306046+0000","last_active":"2024-09-10T23:19:55.310771+0000","last_peered":"2024-09-10T23:19:55.310771+0000","last_clean":"2024-09-10T23:19:55.310771+0000","last_became_active":"2024-09-10T23:19:55.305775+0000","last_became_peered":"2024-09-10T23:19:55.305775+0000","last_unstale":"2024-09-10T23:19:55.310771+0000","last_undegraded":"2024-09-10T23:19:55.310771+0000","last_fullsized":"2024-09-10T23:19:55.310771+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:33.135728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.299407+0000","last_change":"2024-09-10T23:19:54.297280+0000","last_active":"2024-09-10T23:19:55.299407+0000","last_peered":"2024-09-10T23:19:55.299407+0000","last_clean":"2024-09-10T23:19:55.299407+0000","last_became_active":"2024-09-10T23:19:54.295240+0000","last_became_peered":"2024-09-10T23:19:54.295240+0000","last_unstale":"2024-09-10T23:19:55.299407+0000","last_undegraded":"2024-09-10T23:19:55.299407+0000","last_fullsized":"2024-09-10T23:19:55.299407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:50.009617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.310184+0000","last_change":"2024-09-10T23:19:55.303676+0000","last_active":"2024-09-10T23:19:55.310184+0000","last_peered":"2024-09-10T23:19:55.310184+0000","last_clean":"2024-09-10T23:19:55.310184+0000","last_became_active":"2024-09-10T23:19:55.303293+0000","last_became_peered":"2024-09-10T23:19:55.303293+0000","last_unstale":"2024-09-10T23:19:55.310184+0000","last_undegraded":"2024-09-10T23:19:55.310184+0000","last_fullsized":"2024-09-10T23:19:55.310184+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:18.115476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.291528+0000","last_change":"2024-09-10T23:19:54.296141+0000","last_active":"2024-09-10T23:19:55.291528+0000","last_peered":"2024-09-10T23:19:55.291528+0000","last_clean":"2024-09-10T23:19:55.291528+0000","last_became_active":"2024-09-10T23:19:54.295817+0000","last_became_peered":"2024-09-10T23:19:54.295817+0000","last_unstale":"2024-09-10T23:19:55.291528+0000","last_undegraded":"2024-09-10T23:19:55.291528+0000","last_fullsized":"2024-09-10T23:19:55.291528+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:37.164788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311312+0000","last_change":"2024-09-10T23:19:55.305146+0000","last_active":"2024-09-10T23:19:55.311312+0000","last_peered":"2024-09-10T23:19:55.311312+0000","last_clean":"2024-09-10T23:19:55.311312+0000","last_became_active":"2024-09-10T23:19:55.304750+0000","last_became_peered":"2024-09-10T23:19:55.304750+0000","last_unstale":"2024-09-10T23:19:55.311312+0000","last_undegraded":"2024-09-10T23:19:55.311312+0000","last_fullsized":"2024-09-10T23:19:55.311312+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:28.678620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.292324+0000","last_change":"2024-09-10T23:19:54.293367+0000","last_active":"2024-09-10T23:19:55.292324+0000","last_peered":"2024-09-10T23:19:55.292324+0000","last_clean":"2024-09-10T23:19:55.292324+0000","last_became_active":"2024-09-10T23:19:54.293083+0000","last_became_peered":"2024-09-10T23:19:54.293083+0000","last_unstale":"2024-09-10T23:19:55.292324+0000","last_undegraded":"2024-09-10T23:19:55.292324+0000","last_fullsized":"2024-09-10T23:19:55.292324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:48.101745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316798+0000","last_change":"2024-09-10T23:19:55.314218+0000","last_active":"2024-09-10T23:19:55.316798+0000","last_peered":"2024-09-10T23:19:55.316798+0000","last_clean":"2024-09-10T23:19:55.316798+0000","last_became_active":"2024-09-10T23:19:55.313921+0000","last_became_peered":"2024-09-10T23:19:55.313921+0000","last_unstale":"2024-09-10T23:19:55.316798+0000","last_undegraded":"2024-09-10T23:19:55.316798+0000","last_fullsized":"2024-09-10T23:19:55.316798+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:26.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.293833+0000","last_change":"2024-09-10T23:19:54.300508+0000","last_active":"2024-09-10T23:19:55.293833+0000","last_peered":"2024-09-10T23:19:55.293833+0000","last_clean":"2024-09-10T23:19:55.293833+0000","last_became_active":"2024-09-10T23:19:54.299543+0000","last_became_peered":"2024-09-10T23:19:54.299543+0000","last_unstale":"2024-09-10T23:19:55.293833+0000","last_undegraded":"2024-09-10T23:19:55.293833+0000","last_fullsized":"2024-09-10T23:19:55.293833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:21.620041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.312271+0000","last_change":"2024-09-10T23:19:55.297628+0000","last_active":"2024-09-10T23:19:55.312271+0000","last_peered":"2024-09-10T23:19:55.312271+0000","last_clean":"2024-09-10T23:19:55.312271+0000","last_became_active":"2024-09-10T23:19:55.297346+0000","last_became_peered":"2024-09-10T23:19:55.297346+0000","last_unstale":"2024-09-10T23:19:55.312271+0000","last_undegraded":"2024-09-10T23:19:55.312271+0000","last_fullsized":"2024-09-10T23:19:55.312271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:08.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110139+0000","last_change":"2024-09-10T23:19:54.292538+0000","last_active":"2024-09-10T23:19:57.110139+0000","last_peered":"2024-09-10T23:19:57.110139+0000","last_clean":"2024-09-10T23:19:57.110139+0000","last_became_active":"2024-09-10T23:19:54.292079+0000","last_became_peered":"2024-09-10T23:19:54.292079+0000","last_unstale":"2024-09-10T23:19:57.110139+0000","last_undegraded":"2024-09-10T23:19:57.110139+0000","last_fullsized":"2024-09-10T23:19:57.110139+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:22.029907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.317310+0000","last_change":"2024-09-10T23:19:55.314663+0000","last_active":"2024-09-10T23:19:55.317310+0000","last_peered":"2024-09-10T23:19:55.317310+0000","last_clean":"2024-09-10T23:19:55.317310+0000","last_became_active":"2024-09-10T23:19:55.314361+0000","last_became_peered":"2024-09-10T23:19:55.314361+0000","last_unstale":"2024-09-10T23:19:55.317310+0000","last_undegraded":"2024-09-10T23:19:55.317310+0000","last_fullsized":"2024-09-10T23:19:55.317310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:29.310016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110096+0000","last_change":"2024-09-10T23:19:54.292025+0000","last_active":"2024-09-10T23:19:57.110096+0000","last_peered":"2024-09-10T23:19:57.110096+0000","last_clean":"2024-09-10T23:19:57.110096+0000","last_became_active":"2024-09-10T23:19:54.291067+0000","last_became_peered":"2024-09-10T23:19:54.291067+0000","last_unstale":"2024-09-10T23:19:57.110096+0000","last_undegraded":"2024-09-10T23:19:57.110096+0000","last_fullsized":"2024-09-10T23:19:57.110096+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:00.122618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.315908+0000","last_change":"2024-09-10T23:19:55.309430+0000","last_active":"2024-09-10T23:19:55.315908+0000","last_peered":"2024-09-10T23:19:55.315908+0000","last_clean":"2024-09-10T23:19:55.315908+0000","last_became_active":"2024-09-10T23:19:55.308780+0000","last_became_peered":"2024-09-10T23:19:55.308780+0000","last_unstale":"2024-09-10T23:19:55.315908+0000","last_undegraded":"2024-09-10T23:19:55.315908+0000","last_fullsized":"2024-09-10T23:19:55.315908+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:52.814580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.291900+0000","last_change":"2024-09-10T23:19:54.290841+0000","last_active":"2024-09-10T23:19:55.291900+0000","last_peered":"2024-09-10T23:19:55.291900+0000","last_clean":"2024-09-10T23:19:55.291900+0000","last_became_active":"2024-09-10T23:19:54.290552+0000","last_became_peered":"2024-09-10T23:19:54.290552+0000","last_unstale":"2024-09-10T23:19:55.291900+0000","last_undegraded":"2024-09-10T23:19:55.291900+0000","last_fullsized":"2024-09-10T23:19:55.291900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:05:43.961206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316833+0000","last_change":"2024-09-10T23:19:55.314289+0000","last_active":"2024-09-10T23:19:55.316833+0000","last_peered":"2024-09-10T23:19:55.316833+0000","last_clean":"2024-09-10T23:19:55.316833+0000","last_became_active":"2024-09-10T23:19:55.314017+0000","last_became_peered":"2024-09-10T23:19:55.314017+0000","last_unstale":"2024-09-10T23:19:55.316833+0000","last_undegraded":"2024-09-10T23:19:55.316833+0000","last_fullsized":"2024-09-10T23:19:55.316833+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:23.208562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.109755+0000","last_change":"2024-09-10T23:19:54.284489+0000","last_active":"2024-09-10T23:19:57.109755+0000","last_peered":"2024-09-10T23:19:57.109755+0000","last_clean":"2024-09-10T23:19:57.109755+0000","last_became_active":"2024-09-10T23:19:54.284232+0000","last_became_peered":"2024-09-10T23:19:54.284232+0000","last_unstale":"2024-09-10T23:19:57.109755+0000","last_undegraded":"2024-09-10T23:19:57.109755+0000","last_fullsized":"2024-09-10T23:19:57.109755+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:18.675132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":197,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.294626+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:19:55.294626+0000","last_peered":"2024-09-10T23:19:55.294626+0000","last_clean":"2024-09-10T23:19:55.294626+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:19:55.294626+0000","last_undegraded":"2024-09-10T23:19:55.294626+0000","last_fullsized":"2024-09-10T23:19:55.294626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476793,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40324,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331516,"statfs":{"total":96636764160,"available":96595472384,"internally_reserved":0,"allocated":831488,"data_stored":372929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46452,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325388,"statfs":{"total":96636764160,"available":96589197312,"internally_reserved":0,"allocated":1409024,"data_stored":956096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509497,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331528,"statfs":{"total":96636764160,"available":96595484672,"internally_reserved":0,"allocated":815104,"data_stored":365728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45876,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325964,"statfs":{"total":96636764160,"available":96589787136,"internally_reserved":0,"allocated":815104,"data_stored":365728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":365728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331528,"statfs":{"total":96636764160,"available":96595484672,"internally_reserved":0,"allocated":815104,"data_stored":365728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54776,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317064,"statfs":{"total":96636764160,"available":96580673536,"internally_reserved":0,"allocated":1409024,"data_stored":956096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45896,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325944,"statfs":{"total":96636764160,"available":96589766656,"internally_reserved":0,"allocated":839680,"data_stored":379587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:59.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:19:59.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.629+0000 7fb99ac00640 1 -- 172.21.15.17:0/18222429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99415e840 msgr2=0x7fb9940691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.629+0000 7fb99ac00640 1 --2- 172.21.15.17:0/18222429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99415e840 0x7fb9940691b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb984009840 tx=0x7fb98401c820 comp rx=0 tx=0).stop 2024-09-10T23:19:59.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.629+0000 7fb99ac00640 1 -- 172.21.15.17:0/18222429 shutdown_connections 2024-09-10T23:19:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.629+0000 7fb99ac00640 1 --2- 172.21.15.17:0/18222429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb99415e840 0x7fb9940691b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.629+0000 7fb99ac00640 1 -- 172.21.15.17:0/18222429 >> 172.21.15.17:0/18222429 conn(0x7fb9940d03d0 msgr2=0x7fb9940d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.629+0000 7fb99ac00640 1 -- 172.21.15.17:0/18222429 shutdown_connections 2024-09-10T23:19:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.629+0000 7fb99ac00640 1 -- 172.21.15.17:0/18222429 wait complete. 2024-09-10T23:19:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.629+0000 7fb99ac00640 1 Processor -- start 2024-09-10T23:19:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.629+0000 7fb99ac00640 1 -- start start 2024-09-10T23:19:59.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb99ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9940cf9c0 0x7fb99415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:59.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb99ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9940d0ef0 0x7fb99413fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:59.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb99ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb99415e840 0x7fb9940ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:59.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb99ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb994169740 con 0x7fb9940cf9c0 2024-09-10T23:19:59.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb99ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9941695c0 con 0x7fb9940d0ef0 2024-09-10T23:19:59.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb99ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb9941698c0 con 0x7fb99415e840 2024-09-10T23:19:59.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb993e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9940cf9c0 0x7fb99415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:59.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb993e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9940cf9c0 0x7fb99415d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40456/0 (socket says 172.21.15.17:40456) 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb993e00640 1 -- 172.21.15.17:0/3773658367 learned_addr learned my addr 172.21.15.17:0/3773658367 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb993e00640 1 -- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb99415e840 msgr2=0x7fb9940ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb993e00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb99415e840 0x7fb9940ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb993e00640 1 -- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9940d0ef0 msgr2=0x7fb99413fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb98b400640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9940d0ef0 0x7fb99413fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb993e00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9940d0ef0 0x7fb99413fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb993e00640 1 -- 172.21.15.17:0/3773658367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9940ad860 con 0x7fb9940cf9c0 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb98b400640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9940d0ef0 0x7fb99413fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb993e00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9940cf9c0 0x7fb99415d070 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb984009790 tx=0x7fb9840a64f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb990c00640 1 -- 172.21.15.17:0/3773658367 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9840a66e0 con 0x7fb9940cf9c0 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb990c00640 1 -- 172.21.15.17:0/3773658367 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb984004130 con 0x7fb9940cf9c0 2024-09-10T23:19:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb990c00640 1 -- 172.21.15.17:0/3773658367 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984004360 con 0x7fb9940cf9c0 2024-09-10T23:19:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9941fbd60 con 0x7fb9940cf9c0 2024-09-10T23:19:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941fc320 con 0x7fb9940cf9c0 2024-09-10T23:19:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.633+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9940ada30 con 0x7fb9940cf9c0 2024-09-10T23:19:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.637+0000 7fb990c00640 1 -- 172.21.15.17:0/3773658367 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb984003600 con 0x7fb9940cf9c0 2024-09-10T23:19:59.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.637+0000 7fb990c00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9700727b0 0x7fb970074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:19:59.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.637+0000 7fb990c00640 1 -- 172.21.15.17:0/3773658367 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fb98412dc80 con 0x7fb9940cf9c0 2024-09-10T23:19:59.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.637+0000 7fb98b400640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9700727b0 0x7fb970074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:19:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.637+0000 7fb98b400640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9700727b0 0x7fb970074c70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb99414f240 tx=0x7fb97c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:19:59.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.641+0000 7fb990c00640 1 -- 172.21.15.17:0/3773658367 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb9840c8060 con 0x7fb9940cf9c0 2024-09-10T23:19:59.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.809+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9940ccae0 con 0x7fb9700727b0 2024-09-10T23:19:59.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.817+0000 7fb990c00640 1 -- 172.21.15.17:0/3773658367 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252001 (secure 0 0 0) 0x7fb9940ccae0 con 0x7fb9700727b0 2024-09-10T23:19:59.823 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:19:59.825 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:19:59.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9700727b0 msgr2=0x7fb970074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9700727b0 0x7fb970074c70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb99414f240 tx=0x7fb97c009040 comp rx=0 tx=0).stop 2024-09-10T23:19:59.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9940cf9c0 msgr2=0x7fb99415d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:19:59.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9940cf9c0 0x7fb99415d070 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb984009790 tx=0x7fb9840a64f0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 shutdown_connections 2024-09-10T23:19:59.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9700727b0 0x7fb970074c70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb99415e840 0x7fb9940ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9940d0ef0 0x7fb99413fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 --2- 172.21.15.17:0/3773658367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9940cf9c0 0x7fb99415d070 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:19:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 >> 172.21.15.17:0/3773658367 conn(0x7fb9940d03d0 msgr2=0x7fb9940b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:19:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 shutdown_connections 2024-09-10T23:19:59.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:19:59.821+0000 7fb99ac00640 1 -- 172.21.15.17:0/3773658367 wait complete. 2024-09-10T23:19:59.843 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-10T23:19:58.354308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":341772,"kb_used_data":7568,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754632948,"statfs":{"total":773094113280,"available":772744138752,"internally_reserved":0,"allocated":7749632,"data_stored":4127620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.086473"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314113+0000","last_change":"2024-09-10T23:19:55.311205+0000","last_active":"2024-09-10T23:19:55.314113+0000","last_peered":"2024-09-10T23:19:55.314113+0000","last_clean":"2024-09-10T23:19:55.314113+0000","last_became_active":"2024-09-10T23:19:55.310914+0000","last_became_peered":"2024-09-10T23:19:55.310914+0000","last_unstale":"2024-09-10T23:19:55.314113+0000","last_undegraded":"2024-09-10T23:19:55.314113+0000","last_fullsized":"2024-09-10T23:19:55.314113+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:16.406984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.315316+0000","last_change":"2024-09-10T23:19:55.311637+0000","last_active":"2024-09-10T23:19:55.315316+0000","last_peered":"2024-09-10T23:19:55.315316+0000","last_clean":"2024-09-10T23:19:55.315316+0000","last_became_active":"2024-09-10T23:19:55.310147+0000","last_became_peered":"2024-09-10T23:19:55.310147+0000","last_unstale":"2024-09-10T23:19:55.315316+0000","last_undegraded":"2024-09-10T23:19:55.315316+0000","last_fullsized":"2024-09-10T23:19:55.315316+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:06.310867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.303199+0000","last_change":"2024-09-10T23:19:55.300975+0000","last_active":"2024-09-10T23:19:55.303199+0000","last_peered":"2024-09-10T23:19:55.303199+0000","last_clean":"2024-09-10T23:19:55.303199+0000","last_became_active":"2024-09-10T23:19:55.300666+0000","last_became_peered":"2024-09-10T23:19:55.300666+0000","last_unstale":"2024-09-10T23:19:55.303199+0000","last_undegraded":"2024-09-10T23:19:55.303199+0000","last_fullsized":"2024-09-10T23:19:55.303199+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:22.436383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313040+0000","last_change":"2024-09-10T23:19:55.298861+0000","last_active":"2024-09-10T23:19:55.313040+0000","last_peered":"2024-09-10T23:19:55.313040+0000","last_clean":"2024-09-10T23:19:55.313040+0000","last_became_active":"2024-09-10T23:19:55.298396+0000","last_became_peered":"2024-09-10T23:19:55.298396+0000","last_unstale":"2024-09-10T23:19:55.313040+0000","last_undegraded":"2024-09-10T23:19:55.313040+0000","last_fullsized":"2024-09-10T23:19:55.313040+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:03.701847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.305450+0000","last_change":"2024-09-10T23:19:55.301787+0000","last_active":"2024-09-10T23:19:55.305450+0000","last_peered":"2024-09-10T23:19:55.305450+0000","last_clean":"2024-09-10T23:19:55.305450+0000","last_became_active":"2024-09-10T23:19:55.300627+0000","last_became_peered":"2024-09-10T23:19:55.300627+0000","last_unstale":"2024-09-10T23:19:55.305450+0000","last_undegraded":"2024-09-10T23:19:55.305450+0000","last_fullsized":"2024-09-10T23:19:55.305450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:19.960900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.305208+0000","last_change":"2024-09-10T23:19:55.300167+0000","last_active":"2024-09-10T23:19:55.305208+0000","last_peered":"2024-09-10T23:19:55.305208+0000","last_clean":"2024-09-10T23:19:55.305208+0000","last_became_active":"2024-09-10T23:19:55.299859+0000","last_became_peered":"2024-09-10T23:19:55.299859+0000","last_unstale":"2024-09-10T23:19:55.305208+0000","last_undegraded":"2024-09-10T23:19:55.305208+0000","last_fullsized":"2024-09-10T23:19:55.305208+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:14.137579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.303628+0000","last_change":"2024-09-10T23:19:55.299676+0000","last_active":"2024-09-10T23:19:55.303628+0000","last_peered":"2024-09-10T23:19:55.303628+0000","last_clean":"2024-09-10T23:19:55.303628+0000","last_became_active":"2024-09-10T23:19:55.299192+0000","last_became_peered":"2024-09-10T23:19:55.299192+0000","last_unstale":"2024-09-10T23:19:55.303628+0000","last_undegraded":"2024-09-10T23:19:55.303628+0000","last_fullsized":"2024-09-10T23:19:55.303628+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:45.380649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.309701+0000","last_change":"2024-09-10T23:19:55.304612+0000","last_active":"2024-09-10T23:19:55.309701+0000","last_peered":"2024-09-10T23:19:55.309701+0000","last_clean":"2024-09-10T23:19:55.309701+0000","last_became_active":"2024-09-10T23:19:55.304273+0000","last_became_peered":"2024-09-10T23:19:55.304273+0000","last_unstale":"2024-09-10T23:19:55.309701+0000","last_undegraded":"2024-09-10T23:19:55.309701+0000","last_fullsized":"2024-09-10T23:19:55.309701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:06.053309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.319778+0000","last_change":"2024-09-10T23:19:55.318302+0000","last_active":"2024-09-10T23:19:55.319778+0000","last_peered":"2024-09-10T23:19:55.319778+0000","last_clean":"2024-09-10T23:19:55.319778+0000","last_became_active":"2024-09-10T23:19:55.317583+0000","last_became_peered":"2024-09-10T23:19:55.317583+0000","last_unstale":"2024-09-10T23:19:55.319778+0000","last_undegraded":"2024-09-10T23:19:55.319778+0000","last_fullsized":"2024-09-10T23:19:55.319778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:32.725973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.318438+0000","last_change":"2024-09-10T23:19:55.316458+0000","last_active":"2024-09-10T23:19:55.318438+0000","last_peered":"2024-09-10T23:19:55.318438+0000","last_clean":"2024-09-10T23:19:55.318438+0000","last_became_active":"2024-09-10T23:19:55.315631+0000","last_became_peered":"2024-09-10T23:19:55.315631+0000","last_unstale":"2024-09-10T23:19:55.318438+0000","last_undegraded":"2024-09-10T23:19:55.318438+0000","last_fullsized":"2024-09-10T23:19:55.318438+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:03.127813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316090+0000","last_change":"2024-09-10T23:19:55.312045+0000","last_active":"2024-09-10T23:19:55.316090+0000","last_peered":"2024-09-10T23:19:55.316090+0000","last_clean":"2024-09-10T23:19:55.316090+0000","last_became_active":"2024-09-10T23:19:55.311687+0000","last_became_peered":"2024-09-10T23:19:55.311687+0000","last_unstale":"2024-09-10T23:19:55.316090+0000","last_undegraded":"2024-09-10T23:19:55.316090+0000","last_fullsized":"2024-09-10T23:19:55.316090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:41.157135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.309738+0000","last_change":"2024-09-10T23:19:55.306279+0000","last_active":"2024-09-10T23:19:55.309738+0000","last_peered":"2024-09-10T23:19:55.309738+0000","last_clean":"2024-09-10T23:19:55.309738+0000","last_became_active":"2024-09-10T23:19:55.305943+0000","last_became_peered":"2024-09-10T23:19:55.305943+0000","last_unstale":"2024-09-10T23:19:55.309738+0000","last_undegraded":"2024-09-10T23:19:55.309738+0000","last_fullsized":"2024-09-10T23:19:55.309738+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.490607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.317039+0000","last_change":"2024-09-10T23:19:55.315055+0000","last_active":"2024-09-10T23:19:55.317039+0000","last_peered":"2024-09-10T23:19:55.317039+0000","last_clean":"2024-09-10T23:19:55.317039+0000","last_became_active":"2024-09-10T23:19:55.314750+0000","last_became_peered":"2024-09-10T23:19:55.314750+0000","last_unstale":"2024-09-10T23:19:55.317039+0000","last_undegraded":"2024-09-10T23:19:55.317039+0000","last_fullsized":"2024-09-10T23:19:55.317039+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:58.762771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.309576+0000","last_change":"2024-09-10T23:19:55.304597+0000","last_active":"2024-09-10T23:19:55.309576+0000","last_peered":"2024-09-10T23:19:55.309576+0000","last_clean":"2024-09-10T23:19:55.309576+0000","last_became_active":"2024-09-10T23:19:55.303793+0000","last_became_peered":"2024-09-10T23:19:55.303793+0000","last_unstale":"2024-09-10T23:19:55.309576+0000","last_undegraded":"2024-09-10T23:19:55.309576+0000","last_fullsized":"2024-09-10T23:19:55.309576+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:44.238446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.315275+0000","last_change":"2024-09-10T23:19:55.313112+0000","last_active":"2024-09-10T23:19:55.315275+0000","last_peered":"2024-09-10T23:19:55.315275+0000","last_clean":"2024-09-10T23:19:55.315275+0000","last_became_active":"2024-09-10T23:19:55.312728+0000","last_became_peered":"2024-09-10T23:19:55.312728+0000","last_unstale":"2024-09-10T23:19:55.315275+0000","last_undegraded":"2024-09-10T23:19:55.315275+0000","last_fullsized":"2024-09-10T23:19:55.315275+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:42.335583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311695+0000","last_change":"2024-09-10T23:19:55.307993+0000","last_active":"2024-09-10T23:19:55.311695+0000","last_peered":"2024-09-10T23:19:55.311695+0000","last_clean":"2024-09-10T23:19:55.311695+0000","last_became_active":"2024-09-10T23:19:55.307653+0000","last_became_peered":"2024-09-10T23:19:55.307653+0000","last_unstale":"2024-09-10T23:19:55.311695+0000","last_undegraded":"2024-09-10T23:19:55.311695+0000","last_fullsized":"2024-09-10T23:19:55.311695+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:17.201713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316439+0000","last_change":"2024-09-10T23:19:55.313896+0000","last_active":"2024-09-10T23:19:55.316439+0000","last_peered":"2024-09-10T23:19:55.316439+0000","last_clean":"2024-09-10T23:19:55.316439+0000","last_became_active":"2024-09-10T23:19:55.313624+0000","last_became_peered":"2024-09-10T23:19:55.313624+0000","last_unstale":"2024-09-10T23:19:55.316439+0000","last_undegraded":"2024-09-10T23:19:55.316439+0000","last_fullsized":"2024-09-10T23:19:55.316439+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:04.490743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.312964+0000","last_change":"2024-09-10T23:19:55.297793+0000","last_active":"2024-09-10T23:19:55.312964+0000","last_peered":"2024-09-10T23:19:55.312964+0000","last_clean":"2024-09-10T23:19:55.312964+0000","last_became_active":"2024-09-10T23:19:55.297512+0000","last_became_peered":"2024-09-10T23:19:55.297512+0000","last_unstale":"2024-09-10T23:19:55.312964+0000","last_undegraded":"2024-09-10T23:19:55.312964+0000","last_fullsized":"2024-09-10T23:19:55.312964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:28.678620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311391+0000","last_change":"2024-09-10T23:19:55.304906+0000","last_active":"2024-09-10T23:19:55.311391+0000","last_peered":"2024-09-10T23:19:55.311391+0000","last_clean":"2024-09-10T23:19:55.311391+0000","last_became_active":"2024-09-10T23:19:55.304534+0000","last_became_peered":"2024-09-10T23:19:55.304534+0000","last_unstale":"2024-09-10T23:19:55.311391+0000","last_undegraded":"2024-09-10T23:19:55.311391+0000","last_fullsized":"2024-09-10T23:19:55.311391+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:08.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110369+0000","last_change":"2024-09-10T23:19:55.306571+0000","last_active":"2024-09-10T23:19:57.110369+0000","last_peered":"2024-09-10T23:19:57.110369+0000","last_clean":"2024-09-10T23:19:57.110369+0000","last_became_active":"2024-09-10T23:19:55.306414+0000","last_became_peered":"2024-09-10T23:19:55.306414+0000","last_unstale":"2024-09-10T23:19:57.110369+0000","last_undegraded":"2024-09-10T23:19:57.110369+0000","last_fullsized":"2024-09-10T23:19:57.110369+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:20:50.701331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.317839+0000","last_change":"2024-09-10T23:19:55.316835+0000","last_active":"2024-09-10T23:19:55.317839+0000","last_peered":"2024-09-10T23:19:55.317839+0000","last_clean":"2024-09-10T23:19:55.317839+0000","last_became_active":"2024-09-10T23:19:55.316395+0000","last_became_peered":"2024-09-10T23:19:55.316395+0000","last_unstale":"2024-09-10T23:19:55.317839+0000","last_undegraded":"2024-09-10T23:19:55.317839+0000","last_fullsized":"2024-09-10T23:19:55.317839+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:48.141917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110054+0000","last_change":"2024-09-10T23:19:55.303248+0000","last_active":"2024-09-10T23:19:57.110054+0000","last_peered":"2024-09-10T23:19:57.110054+0000","last_clean":"2024-09-10T23:19:57.110054+0000","last_became_active":"2024-09-10T23:19:55.302957+0000","last_became_peered":"2024-09-10T23:19:55.302957+0000","last_unstale":"2024-09-10T23:19:57.110054+0000","last_undegraded":"2024-09-10T23:19:57.110054+0000","last_fullsized":"2024-09-10T23:19:57.110054+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:35.712565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110007+0000","last_change":"2024-09-10T23:19:55.302456+0000","last_active":"2024-09-10T23:19:57.110007+0000","last_peered":"2024-09-10T23:19:57.110007+0000","last_clean":"2024-09-10T23:19:57.110007+0000","last_became_active":"2024-09-10T23:19:55.302117+0000","last_became_peered":"2024-09-10T23:19:55.302117+0000","last_unstale":"2024-09-10T23:19:57.110007+0000","last_undegraded":"2024-09-10T23:19:57.110007+0000","last_fullsized":"2024-09-10T23:19:57.110007+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:17.810771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314856+0000","last_change":"2024-09-10T23:19:55.308587+0000","last_active":"2024-09-10T23:19:55.314856+0000","last_peered":"2024-09-10T23:19:55.314856+0000","last_clean":"2024-09-10T23:19:55.314856+0000","last_became_active":"2024-09-10T23:19:55.308286+0000","last_became_peered":"2024-09-10T23:19:55.308286+0000","last_unstale":"2024-09-10T23:19:55.314856+0000","last_undegraded":"2024-09-10T23:19:55.314856+0000","last_fullsized":"2024-09-10T23:19:55.314856+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:50.451200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314843+0000","last_change":"2024-09-10T23:19:55.309546+0000","last_active":"2024-09-10T23:19:55.314843+0000","last_peered":"2024-09-10T23:19:55.314843+0000","last_clean":"2024-09-10T23:19:55.314843+0000","last_became_active":"2024-09-10T23:19:55.309212+0000","last_became_peered":"2024-09-10T23:19:55.309212+0000","last_unstale":"2024-09-10T23:19:55.314843+0000","last_undegraded":"2024-09-10T23:19:55.314843+0000","last_fullsized":"2024-09-10T23:19:55.314843+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:44.577757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314952+0000","last_change":"2024-09-10T23:19:55.309994+0000","last_active":"2024-09-10T23:19:55.314952+0000","last_peered":"2024-09-10T23:19:55.314952+0000","last_clean":"2024-09-10T23:19:55.314952+0000","last_became_active":"2024-09-10T23:19:55.309534+0000","last_became_peered":"2024-09-10T23:19:55.309534+0000","last_unstale":"2024-09-10T23:19:55.314952+0000","last_undegraded":"2024-09-10T23:19:55.314952+0000","last_fullsized":"2024-09-10T23:19:55.314952+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:42.309743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313332+0000","last_change":"2024-09-10T23:19:55.299863+0000","last_active":"2024-09-10T23:19:55.313332+0000","last_peered":"2024-09-10T23:19:55.313332+0000","last_clean":"2024-09-10T23:19:55.313332+0000","last_became_active":"2024-09-10T23:19:55.298861+0000","last_became_peered":"2024-09-10T23:19:55.298861+0000","last_unstale":"2024-09-10T23:19:55.313332+0000","last_undegraded":"2024-09-10T23:19:55.313332+0000","last_fullsized":"2024-09-10T23:19:55.313332+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:03.512765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314457+0000","last_change":"2024-09-10T23:19:55.312027+0000","last_active":"2024-09-10T23:19:55.314457+0000","last_peered":"2024-09-10T23:19:55.314457+0000","last_clean":"2024-09-10T23:19:55.314457+0000","last_became_active":"2024-09-10T23:19:55.309013+0000","last_became_peered":"2024-09-10T23:19:55.309013+0000","last_unstale":"2024-09-10T23:19:55.314457+0000","last_undegraded":"2024-09-10T23:19:55.314457+0000","last_fullsized":"2024-09-10T23:19:55.314457+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:10.692758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.304876+0000","last_change":"2024-09-10T23:19:55.297944+0000","last_active":"2024-09-10T23:19:55.304876+0000","last_peered":"2024-09-10T23:19:55.304876+0000","last_clean":"2024-09-10T23:19:55.304876+0000","last_became_active":"2024-09-10T23:19:55.297680+0000","last_became_peered":"2024-09-10T23:19:55.297680+0000","last_unstale":"2024-09-10T23:19:55.304876+0000","last_undegraded":"2024-09-10T23:19:55.304876+0000","last_fullsized":"2024-09-10T23:19:55.304876+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:35.059341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.310545+0000","last_change":"2024-09-10T23:19:55.307935+0000","last_active":"2024-09-10T23:19:55.310545+0000","last_peered":"2024-09-10T23:19:55.310545+0000","last_clean":"2024-09-10T23:19:55.310545+0000","last_became_active":"2024-09-10T23:19:55.306265+0000","last_became_peered":"2024-09-10T23:19:55.306265+0000","last_unstale":"2024-09-10T23:19:55.310545+0000","last_undegraded":"2024-09-10T23:19:55.310545+0000","last_fullsized":"2024-09-10T23:19:55.310545+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:04.101233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.312211+0000","last_change":"2024-09-10T23:19:55.296974+0000","last_active":"2024-09-10T23:19:55.312211+0000","last_peered":"2024-09-10T23:19:55.312211+0000","last_clean":"2024-09-10T23:19:55.312211+0000","last_became_active":"2024-09-10T23:19:55.296712+0000","last_became_peered":"2024-09-10T23:19:55.296712+0000","last_unstale":"2024-09-10T23:19:55.312211+0000","last_undegraded":"2024-09-10T23:19:55.312211+0000","last_fullsized":"2024-09-10T23:19:55.312211+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:12.934931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.301336+0000","last_change":"2024-09-10T23:19:55.294059+0000","last_active":"2024-09-10T23:19:55.301336+0000","last_peered":"2024-09-10T23:19:55.301336+0000","last_clean":"2024-09-10T23:19:55.301336+0000","last_became_active":"2024-09-10T23:19:55.293542+0000","last_became_peered":"2024-09-10T23:19:55.293542+0000","last_unstale":"2024-09-10T23:19:55.301336+0000","last_undegraded":"2024-09-10T23:19:55.301336+0000","last_fullsized":"2024-09-10T23:19:55.301336+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:46.356788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.319522+0000","last_change":"2024-09-10T23:19:55.317819+0000","last_active":"2024-09-10T23:19:55.319522+0000","last_peered":"2024-09-10T23:19:55.319522+0000","last_clean":"2024-09-10T23:19:55.319522+0000","last_became_active":"2024-09-10T23:19:55.317545+0000","last_became_peered":"2024-09-10T23:19:55.317545+0000","last_unstale":"2024-09-10T23:19:55.319522+0000","last_undegraded":"2024-09-10T23:19:55.319522+0000","last_fullsized":"2024-09-10T23:19:55.319522+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:41.157135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"69'4","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.325285+0000","last_change":"2024-09-10T23:19:54.295275+0000","last_active":"2024-09-10T23:19:55.325285+0000","last_peered":"2024-09-10T23:19:55.325285+0000","last_clean":"2024-09-10T23:19:55.325285+0000","last_became_active":"2024-09-10T23:19:54.294980+0000","last_became_peered":"2024-09-10T23:19:54.294980+0000","last_unstale":"2024-09-10T23:19:55.325285+0000","last_undegraded":"2024-09-10T23:19:55.325285+0000","last_fullsized":"2024-09-10T23:19:55.325285+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:55.271033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316066+0000","last_change":"2024-09-10T23:19:55.306186+0000","last_active":"2024-09-10T23:19:55.316066+0000","last_peered":"2024-09-10T23:19:55.316066+0000","last_clean":"2024-09-10T23:19:55.316066+0000","last_became_active":"2024-09-10T23:19:55.305778+0000","last_became_peered":"2024-09-10T23:19:55.305778+0000","last_unstale":"2024-09-10T23:19:55.316066+0000","last_undegraded":"2024-09-10T23:19:55.316066+0000","last_fullsized":"2024-09-10T23:19:55.316066+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:26.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"69'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.322103+0000","last_change":"2024-09-10T23:19:54.296763+0000","last_active":"2024-09-10T23:19:55.322103+0000","last_peered":"2024-09-10T23:19:55.322103+0000","last_clean":"2024-09-10T23:19:55.322103+0000","last_became_active":"2024-09-10T23:19:54.295510+0000","last_became_peered":"2024-09-10T23:19:54.295510+0000","last_unstale":"2024-09-10T23:19:55.322103+0000","last_undegraded":"2024-09-10T23:19:55.322103+0000","last_fullsized":"2024-09-10T23:19:55.322103+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:13.070615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.298322+0000","last_change":"2024-09-10T23:19:55.294415+0000","last_active":"2024-09-10T23:19:55.298322+0000","last_peered":"2024-09-10T23:19:55.298322+0000","last_clean":"2024-09-10T23:19:55.298322+0000","last_became_active":"2024-09-10T23:19:55.294106+0000","last_became_peered":"2024-09-10T23:19:55.294106+0000","last_unstale":"2024-09-10T23:19:55.298322+0000","last_undegraded":"2024-09-10T23:19:55.298322+0000","last_fullsized":"2024-09-10T23:19:55.298322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:36.336528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.324975+0000","last_change":"2024-09-10T23:19:54.296934+0000","last_active":"2024-09-10T23:19:55.324975+0000","last_peered":"2024-09-10T23:19:55.324975+0000","last_clean":"2024-09-10T23:19:55.324975+0000","last_became_active":"2024-09-10T23:19:54.296228+0000","last_became_peered":"2024-09-10T23:19:54.296228+0000","last_unstale":"2024-09-10T23:19:55.324975+0000","last_undegraded":"2024-09-10T23:19:55.324975+0000","last_fullsized":"2024-09-10T23:19:55.324975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:55:47.134486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.318876+0000","last_change":"2024-09-10T23:19:55.316955+0000","last_active":"2024-09-10T23:19:55.318876+0000","last_peered":"2024-09-10T23:19:55.318876+0000","last_clean":"2024-09-10T23:19:55.318876+0000","last_became_active":"2024-09-10T23:19:55.315614+0000","last_became_peered":"2024-09-10T23:19:55.315614+0000","last_unstale":"2024-09-10T23:19:55.318876+0000","last_undegraded":"2024-09-10T23:19:55.318876+0000","last_fullsized":"2024-09-10T23:19:55.318876+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:15.835236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.324130+0000","last_change":"2024-09-10T23:19:54.291836+0000","last_active":"2024-09-10T23:19:55.324130+0000","last_peered":"2024-09-10T23:19:55.324130+0000","last_clean":"2024-09-10T23:19:55.324130+0000","last_became_active":"2024-09-10T23:19:54.291552+0000","last_became_peered":"2024-09-10T23:19:54.291552+0000","last_unstale":"2024-09-10T23:19:55.324130+0000","last_undegraded":"2024-09-10T23:19:55.324130+0000","last_fullsized":"2024-09-10T23:19:55.324130+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:53:25.738835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.305392+0000","last_change":"2024-09-10T23:19:55.302686+0000","last_active":"2024-09-10T23:19:55.305392+0000","last_peered":"2024-09-10T23:19:55.305392+0000","last_clean":"2024-09-10T23:19:55.305392+0000","last_became_active":"2024-09-10T23:19:55.302401+0000","last_became_peered":"2024-09-10T23:19:55.302401+0000","last_unstale":"2024-09-10T23:19:55.305392+0000","last_undegraded":"2024-09-10T23:19:55.305392+0000","last_fullsized":"2024-09-10T23:19:55.305392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:26.047403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"69'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.109998+0000","last_change":"2024-09-10T23:19:54.285382+0000","last_active":"2024-09-10T23:19:57.109998+0000","last_peered":"2024-09-10T23:19:57.109998+0000","last_clean":"2024-09-10T23:19:57.109998+0000","last_became_active":"2024-09-10T23:19:54.285111+0000","last_became_peered":"2024-09-10T23:19:54.285111+0000","last_unstale":"2024-09-10T23:19:57.109998+0000","last_undegraded":"2024-09-10T23:19:57.109998+0000","last_fullsized":"2024-09-10T23:19:57.109998+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:23.389250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313334+0000","last_change":"2024-09-10T23:19:55.301676+0000","last_active":"2024-09-10T23:19:55.313334+0000","last_peered":"2024-09-10T23:19:55.313334+0000","last_clean":"2024-09-10T23:19:55.313334+0000","last_became_active":"2024-09-10T23:19:55.301409+0000","last_became_peered":"2024-09-10T23:19:55.301409+0000","last_unstale":"2024-09-10T23:19:55.313334+0000","last_undegraded":"2024-09-10T23:19:55.313334+0000","last_fullsized":"2024-09-10T23:19:55.313334+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:27:54.749196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"69'1","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.109888+0000","last_change":"2024-09-10T23:19:54.288076+0000","last_active":"2024-09-10T23:19:57.109888+0000","last_peered":"2024-09-10T23:19:57.109888+0000","last_clean":"2024-09-10T23:19:57.109888+0000","last_became_active":"2024-09-10T23:19:54.287744+0000","last_became_peered":"2024-09-10T23:19:54.287744+0000","last_unstale":"2024-09-10T23:19:57.109888+0000","last_undegraded":"2024-09-10T23:19:57.109888+0000","last_fullsized":"2024-09-10T23:19:57.109888+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:22.117353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311565+0000","last_change":"2024-09-10T23:19:55.307445+0000","last_active":"2024-09-10T23:19:55.311565+0000","last_peered":"2024-09-10T23:19:55.311565+0000","last_clean":"2024-09-10T23:19:55.311565+0000","last_became_active":"2024-09-10T23:19:55.307139+0000","last_became_peered":"2024-09-10T23:19:55.307139+0000","last_unstale":"2024-09-10T23:19:55.311565+0000","last_undegraded":"2024-09-10T23:19:55.311565+0000","last_fullsized":"2024-09-10T23:19:55.311565+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:03.512765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.109838+0000","last_change":"2024-09-10T23:19:54.288346+0000","last_active":"2024-09-10T23:19:57.109838+0000","last_peered":"2024-09-10T23:19:57.109838+0000","last_clean":"2024-09-10T23:19:57.109838+0000","last_became_active":"2024-09-10T23:19:54.288081+0000","last_became_peered":"2024-09-10T23:19:54.288081+0000","last_unstale":"2024-09-10T23:19:57.109838+0000","last_undegraded":"2024-09-10T23:19:57.109838+0000","last_fullsized":"2024-09-10T23:19:57.109838+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:43.347553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110219+0000","last_change":"2024-09-10T23:19:55.313606+0000","last_active":"2024-09-10T23:19:57.110219+0000","last_peered":"2024-09-10T23:19:57.110219+0000","last_clean":"2024-09-10T23:19:57.110219+0000","last_became_active":"2024-09-10T23:19:55.313321+0000","last_became_peered":"2024-09-10T23:19:55.313321+0000","last_unstale":"2024-09-10T23:19:57.110219+0000","last_undegraded":"2024-09-10T23:19:57.110219+0000","last_fullsized":"2024-09-10T23:19:57.110219+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:02.520014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.292815+0000","last_change":"2024-09-10T23:19:54.296649+0000","last_active":"2024-09-10T23:19:55.292815+0000","last_peered":"2024-09-10T23:19:55.292815+0000","last_clean":"2024-09-10T23:19:55.292815+0000","last_became_active":"2024-09-10T23:19:54.295854+0000","last_became_peered":"2024-09-10T23:19:54.295854+0000","last_unstale":"2024-09-10T23:19:55.292815+0000","last_undegraded":"2024-09-10T23:19:55.292815+0000","last_fullsized":"2024-09-10T23:19:55.292815+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:36:17.603496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.314432+0000","last_change":"2024-09-10T23:19:55.306003+0000","last_active":"2024-09-10T23:19:55.314432+0000","last_peered":"2024-09-10T23:19:55.314432+0000","last_clean":"2024-09-10T23:19:55.314432+0000","last_became_active":"2024-09-10T23:19:55.305714+0000","last_became_peered":"2024-09-10T23:19:55.305714+0000","last_unstale":"2024-09-10T23:19:55.314432+0000","last_undegraded":"2024-09-10T23:19:55.314432+0000","last_fullsized":"2024-09-10T23:19:55.314432+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:23.307502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.293987+0000","last_change":"2024-09-10T23:19:54.303273+0000","last_active":"2024-09-10T23:19:55.293987+0000","last_peered":"2024-09-10T23:19:55.293987+0000","last_clean":"2024-09-10T23:19:55.293987+0000","last_became_active":"2024-09-10T23:19:54.302658+0000","last_became_peered":"2024-09-10T23:19:54.302658+0000","last_unstale":"2024-09-10T23:19:55.293987+0000","last_undegraded":"2024-09-10T23:19:55.293987+0000","last_fullsized":"2024-09-10T23:19:55.293987+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:03.999590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110251+0000","last_change":"2024-09-10T23:19:55.305383+0000","last_active":"2024-09-10T23:19:57.110251+0000","last_peered":"2024-09-10T23:19:57.110251+0000","last_clean":"2024-09-10T23:19:57.110251+0000","last_became_active":"2024-09-10T23:19:55.305092+0000","last_became_peered":"2024-09-10T23:19:55.305092+0000","last_unstale":"2024-09-10T23:19:57.110251+0000","last_undegraded":"2024-09-10T23:19:57.110251+0000","last_fullsized":"2024-09-10T23:19:57.110251+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:42.005788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.288378+0000","last_change":"2024-09-10T23:19:54.294270+0000","last_active":"2024-09-10T23:19:55.288378+0000","last_peered":"2024-09-10T23:19:55.288378+0000","last_clean":"2024-09-10T23:19:55.288378+0000","last_became_active":"2024-09-10T23:19:54.294007+0000","last_became_peered":"2024-09-10T23:19:54.294007+0000","last_unstale":"2024-09-10T23:19:55.288378+0000","last_undegraded":"2024-09-10T23:19:55.288378+0000","last_fullsized":"2024-09-10T23:19:55.288378+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:18.953469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311892+0000","last_change":"2024-09-10T23:19:55.306758+0000","last_active":"2024-09-10T23:19:55.311892+0000","last_peered":"2024-09-10T23:19:55.311892+0000","last_clean":"2024-09-10T23:19:55.311892+0000","last_became_active":"2024-09-10T23:19:55.306493+0000","last_became_peered":"2024-09-10T23:19:55.306493+0000","last_unstale":"2024-09-10T23:19:55.311892+0000","last_undegraded":"2024-09-10T23:19:55.311892+0000","last_fullsized":"2024-09-10T23:19:55.311892+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:03.701847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"69'3","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.325915+0000","last_change":"2024-09-10T23:19:54.302809+0000","last_active":"2024-09-10T23:19:55.325915+0000","last_peered":"2024-09-10T23:19:55.325915+0000","last_clean":"2024-09-10T23:19:55.325915+0000","last_became_active":"2024-09-10T23:19:54.301856+0000","last_became_peered":"2024-09-10T23:19:54.301856+0000","last_unstale":"2024-09-10T23:19:55.325915+0000","last_undegraded":"2024-09-10T23:19:55.325915+0000","last_fullsized":"2024-09-10T23:19:55.325915+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:18.765223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313473+0000","last_change":"2024-09-10T23:19:55.300418+0000","last_active":"2024-09-10T23:19:55.313473+0000","last_peered":"2024-09-10T23:19:55.313473+0000","last_clean":"2024-09-10T23:19:55.313473+0000","last_became_active":"2024-09-10T23:19:55.298580+0000","last_became_peered":"2024-09-10T23:19:55.298580+0000","last_unstale":"2024-09-10T23:19:55.313473+0000","last_undegraded":"2024-09-10T23:19:55.313473+0000","last_fullsized":"2024-09-10T23:19:55.313473+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:23.021216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"69'6","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.327652+0000","last_change":"2024-09-10T23:19:54.293010+0000","last_active":"2024-09-10T23:19:55.327652+0000","last_peered":"2024-09-10T23:19:55.327652+0000","last_clean":"2024-09-10T23:19:55.327652+0000","last_became_active":"2024-09-10T23:19:54.292719+0000","last_became_peered":"2024-09-10T23:19:54.292719+0000","last_unstale":"2024-09-10T23:19:55.327652+0000","last_undegraded":"2024-09-10T23:19:55.327652+0000","last_fullsized":"2024-09-10T23:19:55.327652+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:51.600981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313153+0000","last_change":"2024-09-10T23:19:55.298452+0000","last_active":"2024-09-10T23:19:55.313153+0000","last_peered":"2024-09-10T23:19:55.313153+0000","last_clean":"2024-09-10T23:19:55.313153+0000","last_became_active":"2024-09-10T23:19:55.298132+0000","last_became_peered":"2024-09-10T23:19:55.298132+0000","last_unstale":"2024-09-10T23:19:55.313153+0000","last_undegraded":"2024-09-10T23:19:55.313153+0000","last_fullsized":"2024-09-10T23:19:55.313153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:35.435895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.327238+0000","last_change":"2024-09-10T23:19:54.300169+0000","last_active":"2024-09-10T23:19:55.327238+0000","last_peered":"2024-09-10T23:19:55.327238+0000","last_clean":"2024-09-10T23:19:55.327238+0000","last_became_active":"2024-09-10T23:19:54.299887+0000","last_became_peered":"2024-09-10T23:19:54.299887+0000","last_unstale":"2024-09-10T23:19:55.327238+0000","last_undegraded":"2024-09-10T23:19:55.327238+0000","last_fullsized":"2024-09-10T23:19:55.327238+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:47.278472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.310528+0000","last_change":"2024-09-10T23:19:55.305466+0000","last_active":"2024-09-10T23:19:55.310528+0000","last_peered":"2024-09-10T23:19:55.310528+0000","last_clean":"2024-09-10T23:19:55.310528+0000","last_became_active":"2024-09-10T23:19:55.305179+0000","last_became_peered":"2024-09-10T23:19:55.305179+0000","last_unstale":"2024-09-10T23:19:55.310528+0000","last_undegraded":"2024-09-10T23:19:55.310528+0000","last_fullsized":"2024-09-10T23:19:55.310528+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:24.640326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.295232+0000","last_change":"2024-09-10T23:19:54.295818+0000","last_active":"2024-09-10T23:19:55.295232+0000","last_peered":"2024-09-10T23:19:55.295232+0000","last_clean":"2024-09-10T23:19:55.295232+0000","last_became_active":"2024-09-10T23:19:54.295565+0000","last_became_peered":"2024-09-10T23:19:54.295565+0000","last_unstale":"2024-09-10T23:19:55.295232+0000","last_undegraded":"2024-09-10T23:19:55.295232+0000","last_fullsized":"2024-09-10T23:19:55.295232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:37.842236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311397+0000","last_change":"2024-09-10T23:19:55.306483+0000","last_active":"2024-09-10T23:19:55.311397+0000","last_peered":"2024-09-10T23:19:55.311397+0000","last_clean":"2024-09-10T23:19:55.311397+0000","last_became_active":"2024-09-10T23:19:55.306179+0000","last_became_peered":"2024-09-10T23:19:55.306179+0000","last_unstale":"2024-09-10T23:19:55.311397+0000","last_undegraded":"2024-09-10T23:19:55.311397+0000","last_fullsized":"2024-09-10T23:19:55.311397+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:35.435895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.292739+0000","last_change":"2024-09-10T23:19:54.298564+0000","last_active":"2024-09-10T23:19:55.292739+0000","last_peered":"2024-09-10T23:19:55.292739+0000","last_clean":"2024-09-10T23:19:55.292739+0000","last_became_active":"2024-09-10T23:19:54.298300+0000","last_became_peered":"2024-09-10T23:19:54.298300+0000","last_unstale":"2024-09-10T23:19:55.292739+0000","last_undegraded":"2024-09-10T23:19:55.292739+0000","last_fullsized":"2024-09-10T23:19:55.292739+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:51.500949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.313966+0000","last_change":"2024-09-10T23:19:55.311276+0000","last_active":"2024-09-10T23:19:55.313966+0000","last_peered":"2024-09-10T23:19:55.313966+0000","last_clean":"2024-09-10T23:19:55.313966+0000","last_became_active":"2024-09-10T23:19:55.310987+0000","last_became_peered":"2024-09-10T23:19:55.310987+0000","last_unstale":"2024-09-10T23:19:55.313966+0000","last_undegraded":"2024-09-10T23:19:55.313966+0000","last_fullsized":"2024-09-10T23:19:55.313966+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:52.336906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"69'8","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.326782+0000","last_change":"2024-09-10T23:19:54.295260+0000","last_active":"2024-09-10T23:19:55.326782+0000","last_peered":"2024-09-10T23:19:55.326782+0000","last_clean":"2024-09-10T23:19:55.326782+0000","last_became_active":"2024-09-10T23:19:54.295012+0000","last_became_peered":"2024-09-10T23:19:54.295012+0000","last_unstale":"2024-09-10T23:19:55.326782+0000","last_undegraded":"2024-09-10T23:19:55.326782+0000","last_fullsized":"2024-09-10T23:19:55.326782+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:12.581636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.317104+0000","last_change":"2024-09-10T23:19:55.314224+0000","last_active":"2024-09-10T23:19:55.317104+0000","last_peered":"2024-09-10T23:19:55.317104+0000","last_clean":"2024-09-10T23:19:55.317104+0000","last_became_active":"2024-09-10T23:19:55.313467+0000","last_became_peered":"2024-09-10T23:19:55.313467+0000","last_unstale":"2024-09-10T23:19:55.317104+0000","last_undegraded":"2024-09-10T23:19:55.317104+0000","last_fullsized":"2024-09-10T23:19:55.317104+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:37.916784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"69'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.326194+0000","last_change":"2024-09-10T23:19:54.297216+0000","last_active":"2024-09-10T23:19:55.326194+0000","last_peered":"2024-09-10T23:19:55.326194+0000","last_clean":"2024-09-10T23:19:55.326194+0000","last_became_active":"2024-09-10T23:19:54.296929+0000","last_became_peered":"2024-09-10T23:19:54.296929+0000","last_unstale":"2024-09-10T23:19:55.326194+0000","last_undegraded":"2024-09-10T23:19:55.326194+0000","last_fullsized":"2024-09-10T23:19:55.326194+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:37.666535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311582+0000","last_change":"2024-09-10T23:19:55.303723+0000","last_active":"2024-09-10T23:19:55.311582+0000","last_peered":"2024-09-10T23:19:55.311582+0000","last_clean":"2024-09-10T23:19:55.311582+0000","last_became_active":"2024-09-10T23:19:55.303451+0000","last_became_peered":"2024-09-10T23:19:55.303451+0000","last_unstale":"2024-09-10T23:19:55.311582+0000","last_undegraded":"2024-09-10T23:19:55.311582+0000","last_fullsized":"2024-09-10T23:19:55.311582+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:12.934931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.326766+0000","last_change":"2024-09-10T23:19:54.300990+0000","last_active":"2024-09-10T23:19:55.326766+0000","last_peered":"2024-09-10T23:19:55.326766+0000","last_clean":"2024-09-10T23:19:55.326766+0000","last_became_active":"2024-09-10T23:19:54.300656+0000","last_became_peered":"2024-09-10T23:19:54.300656+0000","last_unstale":"2024-09-10T23:19:55.326766+0000","last_undegraded":"2024-09-10T23:19:55.326766+0000","last_fullsized":"2024-09-10T23:19:55.326766+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:01.974021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316210+0000","last_change":"2024-09-10T23:19:55.306880+0000","last_active":"2024-09-10T23:19:55.316210+0000","last_peered":"2024-09-10T23:19:55.316210+0000","last_clean":"2024-09-10T23:19:55.316210+0000","last_became_active":"2024-09-10T23:19:55.306570+0000","last_became_peered":"2024-09-10T23:19:55.306570+0000","last_unstale":"2024-09-10T23:19:55.316210+0000","last_undegraded":"2024-09-10T23:19:55.316210+0000","last_fullsized":"2024-09-10T23:19:55.316210+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:23.208562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"69'1","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.325800+0000","last_change":"2024-09-10T23:19:54.302905+0000","last_active":"2024-09-10T23:19:55.325800+0000","last_peered":"2024-09-10T23:19:55.325800+0000","last_clean":"2024-09-10T23:19:55.325800+0000","last_became_active":"2024-09-10T23:19:54.301870+0000","last_became_peered":"2024-09-10T23:19:54.301870+0000","last_unstale":"2024-09-10T23:19:55.325800+0000","last_undegraded":"2024-09-10T23:19:55.325800+0000","last_fullsized":"2024-09-10T23:19:55.325800+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:10.202292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311598+0000","last_change":"2024-09-10T23:19:55.307575+0000","last_active":"2024-09-10T23:19:55.311598+0000","last_peered":"2024-09-10T23:19:55.311598+0000","last_clean":"2024-09-10T23:19:55.311598+0000","last_became_active":"2024-09-10T23:19:55.307272+0000","last_became_peered":"2024-09-10T23:19:55.307272+0000","last_unstale":"2024-09-10T23:19:55.311598+0000","last_undegraded":"2024-09-10T23:19:55.311598+0000","last_fullsized":"2024-09-10T23:19:55.311598+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:23.021216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110276+0000","last_change":"2024-09-10T23:19:54.289984+0000","last_active":"2024-09-10T23:19:57.110276+0000","last_peered":"2024-09-10T23:19:57.110276+0000","last_clean":"2024-09-10T23:19:57.110276+0000","last_became_active":"2024-09-10T23:19:54.289682+0000","last_became_peered":"2024-09-10T23:19:54.289682+0000","last_unstale":"2024-09-10T23:19:57.110276+0000","last_undegraded":"2024-09-10T23:19:57.110276+0000","last_fullsized":"2024-09-10T23:19:57.110276+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:35.363721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.301363+0000","last_change":"2024-09-10T23:19:55.294417+0000","last_active":"2024-09-10T23:19:55.301363+0000","last_peered":"2024-09-10T23:19:55.301363+0000","last_clean":"2024-09-10T23:19:55.301363+0000","last_became_active":"2024-09-10T23:19:55.294058+0000","last_became_peered":"2024-09-10T23:19:55.294058+0000","last_unstale":"2024-09-10T23:19:55.301363+0000","last_undegraded":"2024-09-10T23:19:55.301363+0000","last_fullsized":"2024-09-10T23:19:55.301363+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:45.775697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.325256+0000","last_change":"2024-09-10T23:19:54.288051+0000","last_active":"2024-09-10T23:19:55.325256+0000","last_peered":"2024-09-10T23:19:55.325256+0000","last_clean":"2024-09-10T23:19:55.325256+0000","last_became_active":"2024-09-10T23:19:54.287769+0000","last_became_peered":"2024-09-10T23:19:54.287769+0000","last_unstale":"2024-09-10T23:19:55.325256+0000","last_undegraded":"2024-09-10T23:19:55.325256+0000","last_fullsized":"2024-09-10T23:19:55.325256+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:57.755340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316360+0000","last_change":"2024-09-10T23:19:55.310646+0000","last_active":"2024-09-10T23:19:55.316360+0000","last_peered":"2024-09-10T23:19:55.316360+0000","last_clean":"2024-09-10T23:19:55.316360+0000","last_became_active":"2024-09-10T23:19:55.310337+0000","last_became_peered":"2024-09-10T23:19:55.310337+0000","last_unstale":"2024-09-10T23:19:55.316360+0000","last_undegraded":"2024-09-10T23:19:55.316360+0000","last_fullsized":"2024-09-10T23:19:55.316360+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:02.496457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.295443+0000","last_change":"2024-09-10T23:19:54.295953+0000","last_active":"2024-09-10T23:19:55.295443+0000","last_peered":"2024-09-10T23:19:55.295443+0000","last_clean":"2024-09-10T23:19:55.295443+0000","last_became_active":"2024-09-10T23:19:54.295675+0000","last_became_peered":"2024-09-10T23:19:54.295675+0000","last_unstale":"2024-09-10T23:19:55.295443+0000","last_undegraded":"2024-09-10T23:19:55.295443+0000","last_fullsized":"2024-09-10T23:19:55.295443+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:52.726846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.305246+0000","last_change":"2024-09-10T23:19:55.301209+0000","last_active":"2024-09-10T23:19:55.305246+0000","last_peered":"2024-09-10T23:19:55.305246+0000","last_clean":"2024-09-10T23:19:55.305246+0000","last_became_active":"2024-09-10T23:19:55.300961+0000","last_became_peered":"2024-09-10T23:19:55.300961+0000","last_unstale":"2024-09-10T23:19:55.305246+0000","last_undegraded":"2024-09-10T23:19:55.305246+0000","last_fullsized":"2024-09-10T23:19:55.305246+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:13.589067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.289980+0000","last_change":"2024-09-10T23:19:54.298442+0000","last_active":"2024-09-10T23:19:55.289980+0000","last_peered":"2024-09-10T23:19:55.289980+0000","last_clean":"2024-09-10T23:19:55.289980+0000","last_became_active":"2024-09-10T23:19:54.298122+0000","last_became_peered":"2024-09-10T23:19:54.298122+0000","last_unstale":"2024-09-10T23:19:55.289980+0000","last_undegraded":"2024-09-10T23:19:55.289980+0000","last_fullsized":"2024-09-10T23:19:55.289980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:01.489026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.315214+0000","last_change":"2024-09-10T23:19:55.308995+0000","last_active":"2024-09-10T23:19:55.315214+0000","last_peered":"2024-09-10T23:19:55.315214+0000","last_clean":"2024-09-10T23:19:55.315214+0000","last_became_active":"2024-09-10T23:19:55.308467+0000","last_became_peered":"2024-09-10T23:19:55.308467+0000","last_unstale":"2024-09-10T23:19:55.315214+0000","last_undegraded":"2024-09-10T23:19:55.315214+0000","last_fullsized":"2024-09-10T23:19:55.315214+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:10.927825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"69'2","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.327077+0000","last_change":"2024-09-10T23:19:54.302359+0000","last_active":"2024-09-10T23:19:55.327077+0000","last_peered":"2024-09-10T23:19:55.327077+0000","last_clean":"2024-09-10T23:19:55.327077+0000","last_became_active":"2024-09-10T23:19:54.302073+0000","last_became_peered":"2024-09-10T23:19:54.302073+0000","last_unstale":"2024-09-10T23:19:55.327077+0000","last_undegraded":"2024-09-10T23:19:55.327077+0000","last_fullsized":"2024-09-10T23:19:55.327077+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:52.677068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.310771+0000","last_change":"2024-09-10T23:19:55.306046+0000","last_active":"2024-09-10T23:19:55.310771+0000","last_peered":"2024-09-10T23:19:55.310771+0000","last_clean":"2024-09-10T23:19:55.310771+0000","last_became_active":"2024-09-10T23:19:55.305775+0000","last_became_peered":"2024-09-10T23:19:55.305775+0000","last_unstale":"2024-09-10T23:19:55.310771+0000","last_undegraded":"2024-09-10T23:19:55.310771+0000","last_fullsized":"2024-09-10T23:19:55.310771+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:33.135728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.299407+0000","last_change":"2024-09-10T23:19:54.297280+0000","last_active":"2024-09-10T23:19:55.299407+0000","last_peered":"2024-09-10T23:19:55.299407+0000","last_clean":"2024-09-10T23:19:55.299407+0000","last_became_active":"2024-09-10T23:19:54.295240+0000","last_became_peered":"2024-09-10T23:19:54.295240+0000","last_unstale":"2024-09-10T23:19:55.299407+0000","last_undegraded":"2024-09-10T23:19:55.299407+0000","last_fullsized":"2024-09-10T23:19:55.299407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:50.009617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.310184+0000","last_change":"2024-09-10T23:19:55.303676+0000","last_active":"2024-09-10T23:19:55.310184+0000","last_peered":"2024-09-10T23:19:55.310184+0000","last_clean":"2024-09-10T23:19:55.310184+0000","last_became_active":"2024-09-10T23:19:55.303293+0000","last_became_peered":"2024-09-10T23:19:55.303293+0000","last_unstale":"2024-09-10T23:19:55.310184+0000","last_undegraded":"2024-09-10T23:19:55.310184+0000","last_fullsized":"2024-09-10T23:19:55.310184+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:18.115476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.291528+0000","last_change":"2024-09-10T23:19:54.296141+0000","last_active":"2024-09-10T23:19:55.291528+0000","last_peered":"2024-09-10T23:19:55.291528+0000","last_clean":"2024-09-10T23:19:55.291528+0000","last_became_active":"2024-09-10T23:19:54.295817+0000","last_became_peered":"2024-09-10T23:19:54.295817+0000","last_unstale":"2024-09-10T23:19:55.291528+0000","last_undegraded":"2024-09-10T23:19:55.291528+0000","last_fullsized":"2024-09-10T23:19:55.291528+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:37.164788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.311312+0000","last_change":"2024-09-10T23:19:55.305146+0000","last_active":"2024-09-10T23:19:55.311312+0000","last_peered":"2024-09-10T23:19:55.311312+0000","last_clean":"2024-09-10T23:19:55.311312+0000","last_became_active":"2024-09-10T23:19:55.304750+0000","last_became_peered":"2024-09-10T23:19:55.304750+0000","last_unstale":"2024-09-10T23:19:55.311312+0000","last_undegraded":"2024-09-10T23:19:55.311312+0000","last_fullsized":"2024-09-10T23:19:55.311312+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:28.678620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.292324+0000","last_change":"2024-09-10T23:19:54.293367+0000","last_active":"2024-09-10T23:19:55.292324+0000","last_peered":"2024-09-10T23:19:55.292324+0000","last_clean":"2024-09-10T23:19:55.292324+0000","last_became_active":"2024-09-10T23:19:54.293083+0000","last_became_peered":"2024-09-10T23:19:54.293083+0000","last_unstale":"2024-09-10T23:19:55.292324+0000","last_undegraded":"2024-09-10T23:19:55.292324+0000","last_fullsized":"2024-09-10T23:19:55.292324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:48.101745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316798+0000","last_change":"2024-09-10T23:19:55.314218+0000","last_active":"2024-09-10T23:19:55.316798+0000","last_peered":"2024-09-10T23:19:55.316798+0000","last_clean":"2024-09-10T23:19:55.316798+0000","last_became_active":"2024-09-10T23:19:55.313921+0000","last_became_peered":"2024-09-10T23:19:55.313921+0000","last_unstale":"2024-09-10T23:19:55.316798+0000","last_undegraded":"2024-09-10T23:19:55.316798+0000","last_fullsized":"2024-09-10T23:19:55.316798+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:26.801347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.293833+0000","last_change":"2024-09-10T23:19:54.300508+0000","last_active":"2024-09-10T23:19:55.293833+0000","last_peered":"2024-09-10T23:19:55.293833+0000","last_clean":"2024-09-10T23:19:55.293833+0000","last_became_active":"2024-09-10T23:19:54.299543+0000","last_became_peered":"2024-09-10T23:19:54.299543+0000","last_unstale":"2024-09-10T23:19:55.293833+0000","last_undegraded":"2024-09-10T23:19:55.293833+0000","last_fullsized":"2024-09-10T23:19:55.293833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:21.620041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.312271+0000","last_change":"2024-09-10T23:19:55.297628+0000","last_active":"2024-09-10T23:19:55.312271+0000","last_peered":"2024-09-10T23:19:55.312271+0000","last_clean":"2024-09-10T23:19:55.312271+0000","last_became_active":"2024-09-10T23:19:55.297346+0000","last_became_peered":"2024-09-10T23:19:55.297346+0000","last_unstale":"2024-09-10T23:19:55.312271+0000","last_undegraded":"2024-09-10T23:19:55.312271+0000","last_fullsized":"2024-09-10T23:19:55.312271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:08.883701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110139+0000","last_change":"2024-09-10T23:19:54.292538+0000","last_active":"2024-09-10T23:19:57.110139+0000","last_peered":"2024-09-10T23:19:57.110139+0000","last_clean":"2024-09-10T23:19:57.110139+0000","last_became_active":"2024-09-10T23:19:54.292079+0000","last_became_peered":"2024-09-10T23:19:54.292079+0000","last_unstale":"2024-09-10T23:19:57.110139+0000","last_undegraded":"2024-09-10T23:19:57.110139+0000","last_fullsized":"2024-09-10T23:19:57.110139+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:22.029907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.317310+0000","last_change":"2024-09-10T23:19:55.314663+0000","last_active":"2024-09-10T23:19:55.317310+0000","last_peered":"2024-09-10T23:19:55.317310+0000","last_clean":"2024-09-10T23:19:55.317310+0000","last_became_active":"2024-09-10T23:19:55.314361+0000","last_became_peered":"2024-09-10T23:19:55.314361+0000","last_unstale":"2024-09-10T23:19:55.317310+0000","last_undegraded":"2024-09-10T23:19:55.317310+0000","last_fullsized":"2024-09-10T23:19:55.317310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:29.310016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.110096+0000","last_change":"2024-09-10T23:19:54.292025+0000","last_active":"2024-09-10T23:19:57.110096+0000","last_peered":"2024-09-10T23:19:57.110096+0000","last_clean":"2024-09-10T23:19:57.110096+0000","last_became_active":"2024-09-10T23:19:54.291067+0000","last_became_peered":"2024-09-10T23:19:54.291067+0000","last_unstale":"2024-09-10T23:19:57.110096+0000","last_undegraded":"2024-09-10T23:19:57.110096+0000","last_fullsized":"2024-09-10T23:19:57.110096+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:51:00.122618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.315908+0000","last_change":"2024-09-10T23:19:55.309430+0000","last_active":"2024-09-10T23:19:55.315908+0000","last_peered":"2024-09-10T23:19:55.315908+0000","last_clean":"2024-09-10T23:19:55.315908+0000","last_became_active":"2024-09-10T23:19:55.308780+0000","last_became_peered":"2024-09-10T23:19:55.308780+0000","last_unstale":"2024-09-10T23:19:55.315908+0000","last_undegraded":"2024-09-10T23:19:55.315908+0000","last_fullsized":"2024-09-10T23:19:55.315908+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:52.814580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.291900+0000","last_change":"2024-09-10T23:19:54.290841+0000","last_active":"2024-09-10T23:19:55.291900+0000","last_peered":"2024-09-10T23:19:55.291900+0000","last_clean":"2024-09-10T23:19:55.291900+0000","last_became_active":"2024-09-10T23:19:54.290552+0000","last_became_peered":"2024-09-10T23:19:54.290552+0000","last_unstale":"2024-09-10T23:19:55.291900+0000","last_undegraded":"2024-09-10T23:19:55.291900+0000","last_fullsized":"2024-09-10T23:19:55.291900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:05:43.961206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.316833+0000","last_change":"2024-09-10T23:19:55.314289+0000","last_active":"2024-09-10T23:19:55.316833+0000","last_peered":"2024-09-10T23:19:55.316833+0000","last_clean":"2024-09-10T23:19:55.316833+0000","last_became_active":"2024-09-10T23:19:55.314017+0000","last_became_peered":"2024-09-10T23:19:55.314017+0000","last_unstale":"2024-09-10T23:19:55.316833+0000","last_undegraded":"2024-09-10T23:19:55.316833+0000","last_fullsized":"2024-09-10T23:19:55.316833+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:54.265590+0000","last_clean_scrub_stamp":"2024-09-10T23:19:54.265590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:23.208562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-10T23:19:57.109755+0000","last_change":"2024-09-10T23:19:54.284489+0000","last_active":"2024-09-10T23:19:57.109755+0000","last_peered":"2024-09-10T23:19:57.109755+0000","last_clean":"2024-09-10T23:19:57.109755+0000","last_became_active":"2024-09-10T23:19:54.284232+0000","last_became_peered":"2024-09-10T23:19:54.284232+0000","last_unstale":"2024-09-10T23:19:57.109755+0000","last_undegraded":"2024-09-10T23:19:57.109755+0000","last_fullsized":"2024-09-10T23:19:57.109755+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:19:53.258159+0000","last_clean_scrub_stamp":"2024-09-10T23:19:53.258159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:18.675132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":197,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-10T23:19:55.294626+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:19:55.294626+0000","last_peered":"2024-09-10T23:19:55.294626+0000","last_clean":"2024-09-10T23:19:55.294626+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:19:55.294626+0000","last_undegraded":"2024-09-10T23:19:55.294626+0000","last_fullsized":"2024-09-10T23:19:55.294626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476793,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40324,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331516,"statfs":{"total":96636764160,"available":96595472384,"internally_reserved":0,"allocated":831488,"data_stored":372929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46452,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325388,"statfs":{"total":96636764160,"available":96589197312,"internally_reserved":0,"allocated":1409024,"data_stored":956096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509497,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331528,"statfs":{"total":96636764160,"available":96595484672,"internally_reserved":0,"allocated":815104,"data_stored":365728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45876,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325964,"statfs":{"total":96636764160,"available":96589787136,"internally_reserved":0,"allocated":815104,"data_stored":365728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":365728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40312,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331528,"statfs":{"total":96636764160,"available":96595484672,"internally_reserved":0,"allocated":815104,"data_stored":365728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54776,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317064,"statfs":{"total":96636764160,"available":96580673536,"internally_reserved":0,"allocated":1409024,"data_stored":956096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45896,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325944,"statfs":{"total":96636764160,"available":96589766656,"internally_reserved":0,"allocated":839680,"data_stored":379587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:19:59.847 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:19:59.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:20:00.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 -- 172.21.15.17:0/4157556575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445c15f360 msgr2=0x7f445c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 --2- 172.21.15.17:0/4157556575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445c15f360 0x7f445c0694e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f444c009840 tx=0x7f444c01c820 comp rx=0 tx=0).stop 2024-09-10T23:20:00.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 -- 172.21.15.17:0/4157556575 shutdown_connections 2024-09-10T23:20:00.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 --2- 172.21.15.17:0/4157556575 >> v2:172.21.15.77:3300/0 conn(0x7f445c0b50c0 0x7f445c0b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 --2- 172.21.15.17:0/4157556575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445c15f360 0x7f445c0694e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 -- 172.21.15.17:0/4157556575 >> 172.21.15.17:0/4157556575 conn(0x7f445c0d0360 msgr2=0x7f445c0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:00.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 -- 172.21.15.17:0/4157556575 shutdown_connections 2024-09-10T23:20:00.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 -- 172.21.15.17:0/4157556575 wait complete. 2024-09-10T23:20:00.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 Processor -- start 2024-09-10T23:20:00.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.033+0000 7f4462e00640 1 -- start start 2024-09-10T23:20:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4462e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445c0b50c0 0x7f445c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4462e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0b60a0 0x7f445c1541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4462e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f445c15f360 0x7f445c0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4462e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f445c168ef0 con 0x7f445c0b60a0 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4462e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f445c168d70 con 0x7f445c15f360 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4462e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f445c169070 con 0x7f445c0b50c0 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4453e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0b60a0 0x7f445c1541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4453e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0b60a0 0x7f445c1541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40458/0 (socket says 172.21.15.17:40458) 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4453e00640 1 -- 172.21.15.17:0/2282504521 learned_addr learned my addr 172.21.15.17:0/2282504521 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4460e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f445c15f360 0x7f445c0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f445be00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445c0b50c0 0x7f445c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4453e00640 1 -- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445c0b50c0 msgr2=0x7f445c159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4453e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445c0b50c0 0x7f445c159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4453e00640 1 -- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f445c15f360 msgr2=0x7f445c0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4453e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f445c15f360 0x7f445c0c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4453e00640 1 -- 172.21.15.17:0/2282504521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c0c44b0 con 0x7f445c0b60a0 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4453e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0b60a0 0x7f445c1541b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f444400e9c0 tx=0x7f444400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4458c00640 1 -- 172.21.15.17:0/2282504521 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444400cd80 con 0x7f445c0b60a0 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4458c00640 1 -- 172.21.15.17:0/2282504521 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4444004020 con 0x7f445c0b60a0 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4458c00640 1 -- 172.21.15.17:0/2282504521 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444004450 con 0x7f445c0b60a0 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c0c4790 con 0x7f445c0b60a0 2024-09-10T23:20:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c0c4d50 con 0x7f445c0b60a0 2024-09-10T23:20:00.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c0b5b60 con 0x7f445c0b60a0 2024-09-10T23:20:00.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.037+0000 7f4458c00640 1 -- 172.21.15.17:0/2282504521 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4444003600 con 0x7f445c0b60a0 2024-09-10T23:20:00.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.041+0000 7f4458c00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44380725e0 0x7f4438074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:00.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.041+0000 7f4458c00640 1 -- 172.21.15.17:0/2282504521 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f4444093e00 con 0x7f445c0b60a0 2024-09-10T23:20:00.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.041+0000 7f445be00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44380725e0 0x7f4438074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:00.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.041+0000 7f445be00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44380725e0 0x7f4438074aa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f444c0af000 tx=0x7f444c01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:00.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.045+0000 7f4458c00640 1 -- 172.21.15.17:0/2282504521 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f444405ec80 con 0x7f445c0b60a0 2024-09-10T23:20:00.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.285+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f445c0cc840 con 0x7f445c0b60a0 2024-09-10T23:20:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4458c00640 1 -- 172.21.15.17:0/2282504521 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f44440636b0 con 0x7f445c0b60a0 2024-09-10T23:20:00.293 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:20:00.293 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:20:00.293 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:20:00.293 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:20:00.293 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:20:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:20:00.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44380725e0 msgr2=0x7f4438074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44380725e0 0x7f4438074aa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f444c0af000 tx=0x7f444c01b060 comp rx=0 tx=0).stop 2024-09-10T23:20:00.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0b60a0 msgr2=0x7f445c1541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0b60a0 0x7f445c1541b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f444400e9c0 tx=0x7f444400ee80 comp rx=0 tx=0).stop 2024-09-10T23:20:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 shutdown_connections 2024-09-10T23:20:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44380725e0 0x7f4438074aa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f445c15f360 0x7f445c0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f445c0b60a0 0x7f445c1541b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 --2- 172.21.15.17:0/2282504521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f445c0b50c0 0x7f445c159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 >> 172.21.15.17:0/2282504521 conn(0x7f445c0d0360 msgr2=0x7f445c0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 shutdown_connections 2024-09-10T23:20:00.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.289+0000 7f4462e00640 1 -- 172.21.15.17:0/2282504521 wait complete. 2024-09-10T23:20:00.315 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:00.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.457+0000 7fada7800640 1 -- 172.21.15.17:0/1105372622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada00d2830 msgr2=0x7fada00d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.457+0000 7fada7800640 1 --2- 172.21.15.17:0/1105372622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada00d2830 0x7fada00d0030 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009900 tx=0x7fad8c01f0d0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.457+0000 7fada7800640 1 -- 172.21.15.17:0/1105372622 shutdown_connections 2024-09-10T23:20:00.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.457+0000 7fada7800640 1 --2- 172.21.15.17:0/1105372622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada00d2830 0x7fada00d0030 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.457+0000 7fada7800640 1 --2- 172.21.15.17:0/1105372622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fada0160280 0x7fada00cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.457+0000 7fada7800640 1 -- 172.21.15.17:0/1105372622 >> 172.21.15.17:0/1105372622 conn(0x7fada00d1d10 msgr2=0x7fada00d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:00.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.457+0000 7fada7800640 1 -- 172.21.15.17:0/1105372622 shutdown_connections 2024-09-10T23:20:00.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.457+0000 7fada7800640 1 -- 172.21.15.17:0/1105372622 wait complete. 2024-09-10T23:20:00.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.457+0000 7fada7800640 1 Processor -- start 2024-09-10T23:20:00.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 -- start start 2024-09-10T23:20:00.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fada00d2830 0x7fada00cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:00.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fada0160280 0x7fada009f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:00.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada0160660 0x7fada00c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:00.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fada00afe30 con 0x7fada0160660 2024-09-10T23:20:00.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fada00afcb0 con 0x7fada00d2830 2024-09-10T23:20:00.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fada00affb0 con 0x7fada0160280 2024-09-10T23:20:00.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada0160660 0x7fada00c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:00.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada0160660 0x7fada00c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40466/0 (socket says 172.21.15.17:40466) 2024-09-10T23:20:00.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada4e00640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fada00d2830 0x7fada00cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:00.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada5800640 1 -- 172.21.15.17:0/3512908418 learned_addr learned my addr 172.21.15.17:0/3512908418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:00.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fad9fe00640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fada0160280 0x7fada009f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:00.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada5800640 1 -- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fada0160280 msgr2=0x7fada009f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada5800640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fada0160280 0x7fada009f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada5800640 1 -- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fada00d2830 msgr2=0x7fada00cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada5800640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fada00d2830 0x7fada00cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada5800640 1 -- 172.21.15.17:0/3512908418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada01f5f70 con 0x7fada0160660 2024-09-10T23:20:00.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada5800640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada0160660 0x7fada00c7f20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fad9800c730 tx=0x7fad9800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:00.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fad9cc00640 1 -- 172.21.15.17:0/3512908418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98003b80 con 0x7fada0160660 2024-09-10T23:20:00.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fad9cc00640 1 -- 172.21.15.17:0/3512908418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad98003d20 con 0x7fada0160660 2024-09-10T23:20:00.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada00c6220 con 0x7fada0160660 2024-09-10T23:20:00.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fad9cc00640 1 -- 172.21.15.17:0/3512908418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98005330 con 0x7fada0160660 2024-09-10T23:20:00.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada00c9d20 con 0x7fada0160660 2024-09-10T23:20:00.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.461+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada00b04a0 con 0x7fada0160660 2024-09-10T23:20:00.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.465+0000 7fad9cc00640 1 -- 172.21.15.17:0/3512908418 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fad9800a640 con 0x7fada0160660 2024-09-10T23:20:00.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.465+0000 7fad9cc00640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad800725e0 0x7fad80074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:00.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.465+0000 7fad9cc00640 1 -- 172.21.15.17:0/3512908418 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fad98093210 con 0x7fada0160660 2024-09-10T23:20:00.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.465+0000 7fada4e00640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad800725e0 0x7fad80074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:00.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.465+0000 7fada4e00640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad800725e0 0x7fad80074aa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fada00c9a60 tx=0x7fad9400b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:00.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.469+0000 7fad9cc00640 1 -- 172.21.15.17:0/3512908418 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fad9805e100 con 0x7fada0160660 2024-09-10T23:20:00.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fada0074af0 con 0x7fada0160660 2024-09-10T23:20:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fad9cc00640 1 -- 172.21.15.17:0/3512908418 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5218 (secure 0 0 0) 0x7fad98065e20 con 0x7fada0160660 2024-09-10T23:20:00.686 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:00.686 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"btime":"2024-09-10T23:19:58:307532+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5717,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/171584879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":171584879},{"type":"v1","addr":"172.21.15.77:6837","nonce":171584879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6100,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/452390579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":452390579},{"type":"v1","addr":"172.21.15.77:6836","nonce":452390579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3726644366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3726644366},{"type":"v1","addr":"172.21.15.17:6834","nonce":3726644366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:19:57.712307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3704108078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3704108078},{"type":"v1","addr":"172.21.15.17:6835","nonce":3704108078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6399,"qdb_cluster":[6399]},"id":4}]} 2024-09-10T23:20:00.686 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 40 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad800725e0 msgr2=0x7fad80074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad800725e0 0x7fad80074aa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fada00c9a60 tx=0x7fad9400b390 comp rx=0 tx=0).stop 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada0160660 msgr2=0x7fada00c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada0160660 0x7fada00c7f20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fad9800c730 tx=0x7fad9800cbf0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 shutdown_connections 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad800725e0 0x7fad80074aa0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fada0160660 0x7fada00c7f20 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fada0160280 0x7fada009f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 --2- 172.21.15.17:0/3512908418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fada00d2830 0x7fada00cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 >> 172.21.15.17:0/3512908418 conn(0x7fada00d1d10 msgr2=0x7fada00712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 shutdown_connections 2024-09-10T23:20:00.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:00.681+0000 7fada7800640 1 -- 172.21.15.17:0/3512908418 wait complete. 2024-09-10T23:20:01.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:19:54.687197+0000', 'modified': '2024-09-10T23:19:57.712307+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6399}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6399': {'gid': 6399, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/3704108078', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 3704108078}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 3704108078}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6399, 'qdb_cluster': [6399]} 2024-09-10T23:20:01.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:20:01.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:20:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 -- 172.21.15.17:0/4012597739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f00d1990 msgr2=0x7fa0f00d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 --2- 172.21.15.17:0/4012597739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f00d1990 0x7fa0f00d1dc0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009bc0 tx=0x7fa0e801cba0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 -- 172.21.15.17:0/4012597739 shutdown_connections 2024-09-10T23:20:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 --2- 172.21.15.17:0/4012597739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f00d1990 0x7fa0f00d1dc0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 --2- 172.21.15.17:0/4012597739 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0f015bd60 0x7fa0f00cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 -- 172.21.15.17:0/4012597739 >> 172.21.15.17:0/4012597739 conn(0x7fa0f009a9f0 msgr2=0x7fa0f009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 -- 172.21.15.17:0/4012597739 shutdown_connections 2024-09-10T23:20:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 -- 172.21.15.17:0/4012597739 wait complete. 2024-09-10T23:20:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 Processor -- start 2024-09-10T23:20:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 -- start start 2024-09-10T23:20:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0f00d1990 0x7fa0f00c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f015b980 0x7fa0f013dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f015bd60 0x7fa0f014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f0168ab0 con 0x7fa0f015b980 2024-09-10T23:20:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f0168930 con 0x7fa0f015bd60 2024-09-10T23:20:01.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f6200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f0168c30 con 0x7fa0f00d1990 2024-09-10T23:20:01.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f015b980 0x7fa0f013dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f015b980 0x7fa0f013dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40486/0 (socket says 172.21.15.17:40486) 2024-09-10T23:20:01.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0efe00640 1 -- 172.21.15.17:0/2371892044 learned_addr learned my addr 172.21.15.17:0/2371892044 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:01.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0f00d1990 0x7fa0f00c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0f5800640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f015bd60 0x7fa0f014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0efe00640 1 -- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0f00d1990 msgr2=0x7fa0f00c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0efe00640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0f00d1990 0x7fa0f00c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0efe00640 1 -- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f015bd60 msgr2=0x7fa0f014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0efe00640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f015bd60 0x7fa0f014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0efe00640 1 -- 172.21.15.17:0/2371892044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f0071910 con 0x7fa0f015b980 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0efe00640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f015b980 0x7fa0f013dbe0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0058d0 tx=0x7fa0dc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.261+0000 7fa0ecc00640 1 -- 172.21.15.17:0/2371892044 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc017070 con 0x7fa0f015b980 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0ecc00640 1 -- 172.21.15.17:0/2371892044 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0dc009d20 con 0x7fa0f015b980 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0ecc00640 1 -- 172.21.15.17:0/2371892044 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc0106c0 con 0x7fa0f015b980 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0f6200640 1 -- 172.21.15.17:0/2371892044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f00c6a50 con 0x7fa0f015b980 2024-09-10T23:20:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0f6200640 1 -- 172.21.15.17:0/2371892044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f00c7010 con 0x7fa0f015b980 2024-09-10T23:20:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0ecc00640 1 -- 172.21.15.17:0/2371892044 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa0dc010860 con 0x7fa0f015b980 2024-09-10T23:20:01.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0ecc00640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0d00725e0 0x7fa0d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0ecc00640 1 -- 172.21.15.17:0/2371892044 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fa0dc093890 con 0x7fa0f015b980 2024-09-10T23:20:01.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0fac6d000 1 Processor -- start 2024-09-10T23:20:01.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0fac6d000 1 -- start start 2024-09-10T23:20:01.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.265+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0d00725e0 0x7fa0d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0d00725e0 0x7fa0d0074aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00cc130 tx=0x7fa0e4007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:01.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d23e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d1f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d1f2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561e8d10e3f0 con 0x561e8d23ddc0 2024-09-10T23:20:01.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e8d04bb20 con 0x561e8d23e6e0 2024-09-10T23:20:01.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e8d03af50 con 0x561e8d1f2220 2024-09-10T23:20:01.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d23e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d23e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40500/0 (socket says 172.21.15.17:40500) 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 -- 172.21.15.17:0/4177665594 learned_addr learned my addr 172.21.15.17:0/4177665594 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0efe00640 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d1f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f5800640 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d1f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 -- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 msgr2=0x561e8d1f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d1f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 -- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 msgr2=0x561e8d1f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d1f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 -- 172.21.15.17:0/4177665594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e8d002590 con 0x561e8d23ddc0 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0efe00640 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d1f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f5800640 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d1f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:01.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d23e1a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4001220 tx=0x7fa0e4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0a7764c0219ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0e1600640 1 -- 172.21.15.17:0/4177665594 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e401b050 con 0x561e8d23ddc0 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0e1600640 1 -- 172.21.15.17:0/4177665594 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0e4025070 con 0x561e8d23ddc0 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0e1600640 1 -- 172.21.15.17:0/4177665594 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4020440 con 0x561e8d23ddc0 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 -- 172.21.15.17:0/4177665594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 msgr2=0x561e8d23e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d23e1a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4001220 tx=0x7fa0e4012000 comp rx=0 tx=0).stop 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 -- 172.21.15.17:0/4177665594 shutdown_connections 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d1f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d1f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/4177665594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d23e1a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 -- 172.21.15.17:0/4177665594 >> 172.21.15.17:0/4177665594 conn(0x561e8d0d7130 msgr2=0x561e8d21ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 -- 172.21.15.17:0/4177665594 shutdown_connections 2024-09-10T23:20:01.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 -- 172.21.15.17:0/4177665594 wait complete. 2024-09-10T23:20:01.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 -- start start 2024-09-10T23:20:01.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.269+0000 7fa0fac6d000 1 Processor -- start 2024-09-10T23:20:01.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d228360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23ddc0 0x561e8d2288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23e6e0 0x561e8d228de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561e8cfd55d0 con 0x561e8d23e6e0 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e8d03ed60 con 0x561e8d23ddc0 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e8cfe1500 con 0x561e8d1f2220 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 10 client.0 _ll_register_callbacks cb 0x561e8cfe5810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23e6e0 0x561e8d228de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23e6e0 0x561e8d228de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40508/0 (socket says 172.21.15.17:40508) 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f5800640 1 -- 172.21.15.17:0/1859326409 learned_addr learned my addr 172.21.15.17:0/1859326409 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0efe00640 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23ddc0 0x561e8d2288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d228360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f5800640 1 -- 172.21.15.17:0/1859326409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 msgr2=0x561e8d228360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f5800640 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d228360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f5800640 1 -- 172.21.15.17:0/1859326409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23ddc0 msgr2=0x561e8d2288a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f5800640 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23ddc0 0x561e8d2288a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f5800640 1 -- 172.21.15.17:0/1859326409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e8cfd9170 con 0x561e8d23e6e0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d228360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f5800640 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23e6e0 0x561e8d228de0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009bc0 tx=0x7fa0e8004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfe2cb9285e45ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0d6000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0d6000640 1 -- 172.21.15.17:0/1859326409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80bf060 con 0x561e8d23e6e0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0d6000640 1 -- 172.21.15.17:0/1859326409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fa0e8004c10 con 0x561e8d23e6e0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 -- 172.21.15.17:0/1859326409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561e8cfd30f0 con 0x561e8d23e6e0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0d6000640 1 -- 172.21.15.17:0/1859326409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa0e80b2040 con 0x561e8d23e6e0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 10 client.6519 fetch_fsmap learned FSMap version 40 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 -- 172.21.15.17:0/1859326409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x561e8d0bfef0 con 0x561e8d23e6e0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0d6000640 1 -- 172.21.15.17:0/1859326409 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561e8cfd30f0 con 0x561e8d23e6e0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0d6000640 1 -- 172.21.15.17:0/1859326409 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7fa0e8005040 con 0x561e8d23e6e0 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 10 client.6519 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T23:20:01.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 10 client.6519 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 20 client.6519 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x561e8d2297f0 0x561e8d24f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 4 client.6519 mds_command: new command op to 6399 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0fac6d000 1 -- 172.21.15.17:0/1859326409 --> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e8d04da70 con 0x561e8d2297f0 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x561e8d2297f0 0x561e8d24f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x561e8d2297f0 0x561e8d24f070 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8762025a49b3554 server_cookie=ce772c57aa26fc10 in_seq=0 out_seq=0 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.273+0000 7fa0d6000640 10 client.6519 ms_handle_connect on v2:172.21.15.17:6833/3704108078 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0d6000640 1 -- 172.21.15.17:0/1859326409 <== mds.0 v2:172.21.15.17:6833/3704108078 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e8d04da70 con 0x561e8d2297f0 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0d6000640 10 client.6519 handle_command_reply: tid=0 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 client.6519 shutdown 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 -- 172.21.15.17:0/1859326409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23e6e0 msgr2=0x561e8d228de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23e6e0 0x561e8d228de0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009bc0 tx=0x7fa0e8004990 comp rx=0 tx=0).stop 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 -- 172.21.15.17:0/1859326409 shutdown_connections 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x561e8d2297f0 0x561e8d24f070 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23e6e0 0x561e8d228de0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23ddc0 0x561e8d2288a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/1859326409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d228360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0d6000640 0 client.6519 ms_handle_reset on v2:172.21.15.17:6833/3704108078 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 -- 172.21.15.17:0/1859326409 >> 172.21.15.17:0/1859326409 conn(0x561e8d0d7130 msgr2=0x561e8d1ec8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 -- 172.21.15.17:0/1859326409 shutdown_connections 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 1 -- 172.21.15.17:0/1859326409 wait complete. 2024-09-10T23:20:01.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.277+0000 7fa0fac6d000 20 client.6519 trim_cache size 0 max 16384 2024-09-10T23:20:01.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.293+0000 7fa0fac6d000 1 Processor -- start 2024-09-10T23:20:01.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.293+0000 7fa0fac6d000 1 -- start start 2024-09-10T23:20:01.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d1f2220 0x561e8d219f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d21a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d23e6e0 0x561e8d24f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f006ef60 con 0x561e8d23ddc0 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e8d043390 con 0x561e8d1f2220 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e8d0bfa60 con 0x561e8d23e6e0 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d21a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d21a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40524/0 (socket says 172.21.15.17:40524) 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0efe00640 1 -- 172.21.15.17:0/2520749875 learned_addr learned my addr 172.21.15.17:0/2520749875 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/2520749875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d1f2220 0x561e8d219f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0f5800640 1 --2- 172.21.15.17:0/2520749875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d23e6e0 0x561e8d24f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0efe00640 1 -- 172.21.15.17:0/2520749875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d23e6e0 msgr2=0x561e8d24f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0efe00640 1 --2- 172.21.15.17:0/2520749875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d23e6e0 0x561e8d24f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0efe00640 1 -- 172.21.15.17:0/2520749875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d1f2220 msgr2=0x561e8d219f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0efe00640 1 --2- 172.21.15.17:0/2520749875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d1f2220 0x561e8d219f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0efe00640 1 -- 172.21.15.17:0/2520749875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e8d096d90 con 0x561e8d23ddc0 2024-09-10T23:20:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0efe00640 1 --2- 172.21.15.17:0/2520749875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d21a4b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc05b960 tx=0x7fa0dc05e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddaff48b1f18cf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0e0c00640 1 -- 172.21.15.17:0/2520749875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc021040 con 0x561e8d23ddc0 2024-09-10T23:20:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0e0c00640 1 -- 172.21.15.17:0/2520749875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0dc05e6f0 con 0x561e8d23ddc0 2024-09-10T23:20:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0e0c00640 1 -- 172.21.15.17:0/2520749875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc010de0 con 0x561e8d23ddc0 2024-09-10T23:20:01.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2520749875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 msgr2=0x561e8d21a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2520749875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d21a4b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc05b960 tx=0x7fa0dc05e5e0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2520749875 shutdown_connections 2024-09-10T23:20:01.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2520749875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d23e6e0 0x561e8d24f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2520749875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d21a4b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2520749875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d1f2220 0x561e8d219f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2520749875 >> 172.21.15.17:0/2520749875 conn(0x561e8d0d7130 msgr2=0x561e8d1fb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2520749875 shutdown_connections 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2520749875 wait complete. 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 -- start start 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 Processor -- start 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.297+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d2b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d2b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d2b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x561e8d0fa730 con 0x561e8d23ddc0 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561e8d03e070 con 0x561e8d23e6e0 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x561e8d006ec0 con 0x561e8d1f2220 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 10 client.0 _ll_register_callbacks cb 0x7fa0e8009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d2b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d2b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40526/0 (socket says 172.21.15.17:40526) 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0efe00640 1 -- 172.21.15.17:0/2444662967 learned_addr learned my addr 172.21.15.17:0/2444662967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d2b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f5800640 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d2b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0efe00640 1 -- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 msgr2=0x561e8d2b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0efe00640 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d2b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0efe00640 1 -- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 msgr2=0x561e8d2b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0efe00640 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d2b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0efe00640 1 -- 172.21.15.17:0/2444662967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e8d001a90 con 0x561e8d23ddc0 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d2b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f5800640 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d2b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0efe00640 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d2b4950 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc05e680 tx=0x7fa0dc05ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cc3f198757b4a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 1 -- 172.21.15.17:0/2444662967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc021070 con 0x561e8d23ddc0 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 1 -- 172.21.15.17:0/2444662967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fa0dc05d950 con 0x561e8d23ddc0 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2444662967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0dc05e6f0 con 0x561e8d23ddc0 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 1 -- 172.21.15.17:0/2444662967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa0dc063120 con 0x561e8d23ddc0 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 10 client.6525 fetch_fsmap learned FSMap version 40 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2444662967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x561e8cfe0050 con 0x561e8d23ddc0 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 1 -- 172.21.15.17:0/2444662967 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0dc05e6f0 con 0x561e8d23ddc0 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 1 -- 172.21.15.17:0/2444662967 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7fa0dc07fb00 con 0x561e8d23ddc0 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 10 client.6525 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 10 client.6525 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 20 client.6525 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x561e8d252890 0x561e8d252c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 4 client.6525 mds_command: new command op to 6399 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:20:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2444662967 --> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] -- command(tid 0: {"prefix": "status"}) -- 0x561e8d049520 con 0x561e8d252890 2024-09-10T23:20:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x561e8d252890 0x561e8d252c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f4e00640 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x561e8d252890 0x561e8d252c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=238853ee085bb48b server_cookie=56f3e6dbf1a4af62 in_seq=0 out_seq=0 2024-09-10T23:20:01.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 10 client.6525 ms_handle_connect on v2:172.21.15.17:6833/3704108078 2024-09-10T23:20:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 1 -- 172.21.15.17:0/2444662967 <== mds.0 v2:172.21.15.17:6833/3704108078 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x561e8d049520 con 0x561e8d252890 2024-09-10T23:20:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 10 client.6525 handle_command_reply: tid=0 2024-09-10T23:20:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 client.6525 shutdown 2024-09-10T23:20:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2444662967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 msgr2=0x561e8d2b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d2b4950 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc05e680 tx=0x7fa0dc05ab90 comp rx=0 tx=0).stop 2024-09-10T23:20:01.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2444662967 shutdown_connections 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x561e8d252890 0x561e8d252c70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561e8d23e6e0 0x561e8d2b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8d23ddc0 0x561e8d2b4950 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0d6000640 0 client.6525 ms_handle_reset on v2:172.21.15.17:6833/3704108078 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 --2- 172.21.15.17:0/2444662967 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x561e8d1f2220 0x561e8d2b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2444662967 >> 172.21.15.17:0/2444662967 conn(0x561e8d0d7130 msgr2=0x561e8d218f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2444662967 shutdown_connections 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 1 -- 172.21.15.17:0/2444662967 wait complete. 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0fac6d000 20 client.6525 trim_cache size 0 max 16384 2024-09-10T23:20:01.312 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 6399, 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.0079632649999999, 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 40, 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 70, 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 70, 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 10.487817449 2024-09-10T23:20:01.313 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:20:01.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 -- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0d00725e0 msgr2=0x7fa0d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0d00725e0 0x7fa0d0074aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00cc130 tx=0x7fa0e4007ea0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 -- 172.21.15.17:0/2371892044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f015b980 msgr2=0x7fa0f013dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f015b980 0x7fa0f013dbe0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0058d0 tx=0x7fa0dc00dde0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 -- 172.21.15.17:0/2371892044 shutdown_connections 2024-09-10T23:20:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0d00725e0 0x7fa0d0074aa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0f015bd60 0x7fa0f014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0f015b980 0x7fa0f013dbe0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 --2- 172.21.15.17:0/2371892044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0f00d1990 0x7fa0f00c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.301+0000 7fa0f6200640 1 -- 172.21.15.17:0/2371892044 >> 172.21.15.17:0/2371892044 conn(0x7fa0f009a9f0 msgr2=0x7fa0f00aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.305+0000 7fa0f6200640 1 -- 172.21.15.17:0/2371892044 shutdown_connections 2024-09-10T23:20:01.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.305+0000 7fa0f6200640 1 -- 172.21.15.17:0/2371892044 wait complete. 2024-09-10T23:20:01.328 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:20:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.469+0000 7f4965c00640 1 -- 172.21.15.17:0/177647500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4944004810 msgr2=0x7f4944004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.469+0000 7f4965c00640 1 --2- 172.21.15.17:0/177647500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4944004810 0x7f4944004c90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4948006f20 tx=0x7f494801ce80 comp rx=0 tx=0).stop 2024-09-10T23:20:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.469+0000 7f4965c00640 1 -- 172.21.15.17:0/177647500 shutdown_connections 2024-09-10T23:20:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.469+0000 7f4965c00640 1 --2- 172.21.15.17:0/177647500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4944004810 0x7f4944004c90 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.469+0000 7f4965c00640 1 -- 172.21.15.17:0/177647500 >> 172.21.15.17:0/177647500 conn(0x7f49600d1d60 msgr2=0x7f49600d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.469+0000 7f4965c00640 1 -- 172.21.15.17:0/177647500 shutdown_connections 2024-09-10T23:20:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.469+0000 7f4965c00640 1 -- 172.21.15.17:0/177647500 wait complete. 2024-09-10T23:20:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 Processor -- start 2024-09-10T23:20:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 -- start start 2024-09-10T23:20:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4944004810 0x7f4960157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49601f53f0 0x7f49600b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49600b2ab0 0x7f496006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f496015f060 con 0x7f49601f53f0 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49600710c0 con 0x7f49600b2ab0 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f496015f1e0 con 0x7f4944004810 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4957e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49601f53f0 0x7f49600b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4957e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49601f53f0 0x7f49600b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40554/0 (socket says 172.21.15.17:40554) 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4957e00640 1 -- 172.21.15.17:0/1544119864 learned_addr learned my addr 172.21.15.17:0/1544119864 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f495ea00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4944004810 0x7f4960157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f495f400640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49600b2ab0 0x7f496006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4957e00640 1 -- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4944004810 msgr2=0x7f4960157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4957e00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4944004810 0x7f4960157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4957e00640 1 -- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49600b2ab0 msgr2=0x7f496006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4957e00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49600b2ab0 0x7f496006ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4957e00640 1 -- 172.21.15.17:0/1544119864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49600b2f30 con 0x7f49601f53f0 2024-09-10T23:20:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4957e00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49601f53f0 0x7f49600b2570 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f494801b750 tx=0x7f4948006640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4956a00640 1 -- 172.21.15.17:0/1544119864 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948006b50 con 0x7f49601f53f0 2024-09-10T23:20:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4956a00640 1 -- 172.21.15.17:0/1544119864 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4948001500 con 0x7f49601f53f0 2024-09-10T23:20:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4956a00640 1 -- 172.21.15.17:0/1544119864 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948003860 con 0x7f49601f53f0 2024-09-10T23:20:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49601f4910 con 0x7f49601f53f0 2024-09-10T23:20:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.473+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49601f4ed0 con 0x7f49601f53f0 2024-09-10T23:20:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.477+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f496015f740 con 0x7f49601f53f0 2024-09-10T23:20:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.477+0000 7f4956a00640 1 -- 172.21.15.17:0/1544119864 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4948003a00 con 0x7f49601f53f0 2024-09-10T23:20:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.477+0000 7f4956a00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f493c0725e0 0x7f493c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.477+0000 7f4956a00640 1 -- 172.21.15.17:0/1544119864 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f494812d060 con 0x7f49601f53f0 2024-09-10T23:20:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.477+0000 7f495ea00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f493c0725e0 0x7f493c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:01.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.477+0000 7f495ea00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f493c0725e0 0x7f493c074aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f49600b60c0 tx=0x7f49500091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.481+0000 7f4956a00640 1 -- 172.21.15.17:0/1544119864 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f49480c0030 con 0x7f49601f53f0 2024-09-10T23:20:01.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.693+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f496006ea60 con 0x7f49601f53f0 2024-09-10T23:20:01.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.693+0000 7f4956a00640 1 -- 172.21.15.17:0/1544119864 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) ==== 53+0+73 (secure 0 0 0) 0x7f4948016c30 con 0x7f49601f53f0 2024-09-10T23:20:01.699 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f493c0725e0 msgr2=0x7f493c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f493c0725e0 0x7f493c074aa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f49600b60c0 tx=0x7f49500091e0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49601f53f0 msgr2=0x7f49600b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49601f53f0 0x7f49600b2570 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f494801b750 tx=0x7f4948006640 comp rx=0 tx=0).stop 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 shutdown_connections 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f493c0725e0 0x7f493c074aa0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49600b2ab0 0x7f496006ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49601f53f0 0x7f49600b2570 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 --2- 172.21.15.17:0/1544119864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4944004810 0x7f4960157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:01.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 >> 172.21.15.17:0/1544119864 conn(0x7f49600d1d60 msgr2=0x7f49600afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:01.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 shutdown_connections 2024-09-10T23:20:01.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01.697+0000 7f4965c00640 1 -- 172.21.15.17:0/1544119864 wait complete. 2024-09-10T23:20:01.721 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:20:01.721 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:20:01.721 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:20:01.721 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:20:01.721 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:01.721 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:20:01.722 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:20:01.722 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:20:01.722 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:20:01.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:01.722 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:20:01.731 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:20:01.731 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:20:01.732 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42169sec preferred_lft 42169sec 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:01.733 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:20:01.734 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:01.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:01.735 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:20:01.793 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:20:01.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:01.795 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:20:01.845 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:20:01.845 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:20:01.845 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:20:01.845 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:20:01.845 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:20:01.845 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:20:01.845 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:20:01.846 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:20:01.846 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:20:01.846 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:20:01.846 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:20:01.846 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:20:01.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:20:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:20:01.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:01.983 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:20:02.032 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:20:02.032 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:20:02.033 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:20:02.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:02.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:20:02.095 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:20:02.096 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:20:02.096 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:02.148 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:20:02.148 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:20:02.148 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:02.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:20:02.264 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:20:02.321 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:20:02.321 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:20:02.321 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:20:02.321 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:20:02.322 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:02.323 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:02.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:02.324 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:20:02.376 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:20:02.376 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:20:02.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:20:02.443 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:20:02.493 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:20:02.493 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:20:02.493 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:20:02.493 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:20:02.494 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:02.495 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:02.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:02.497 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:20:02.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:20:02.513+0000 7fb754e33580 -1 init, newargv = 0x55c60ad6ebc0 newargc=15 2024-09-10T23:20:02.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[53451]: starting ceph client 2024-09-10T23:20:02.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[53451]: starting fuse 2024-09-10T23:20:02.526 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:20:02.526 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:20:02.527 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:20:02.528 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:20:02.650 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.53451.asok 2024-09-10T23:20:02.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:20:02.661 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53451.asok 2024-09-10T23:20:02.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:02.661 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53451.asok status 2024-09-10T23:20:02.840 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:20:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:20:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:20:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:20:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:20:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "53451", 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 6537, 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 6537 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 613302863 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 613302863 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.6537 192.168.0.1:0/613302863", 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/613302863", 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 40, 2024-09-10T23:20:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 70, 2024-09-10T23:20:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:20:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:20:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:20:02.843 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:20:02.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:02.855 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:20:02.855 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:02.864 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:20:02.864 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:02.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:02.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:02.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-10T23:20:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.113+0000 7f8317200640 1 -- 172.21.15.17:0/3575382449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83100b12e0 msgr2=0x7f83100cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.113+0000 7f8317200640 1 --2- 172.21.15.17:0/3575382449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83100b12e0 0x7f83100cfde0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f83100c8da0 tx=0x7f82f801c890 comp rx=0 tx=0).stop 2024-09-10T23:20:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.113+0000 7f8317200640 1 -- 172.21.15.17:0/3575382449 shutdown_connections 2024-09-10T23:20:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.113+0000 7f8317200640 1 --2- 172.21.15.17:0/3575382449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83100b12e0 0x7f83100cfde0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.113+0000 7f8317200640 1 --2- 172.21.15.17:0/3575382449 >> v2:172.21.15.77:3300/0 conn(0x7f831015be00 0x7f831015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.113+0000 7f8317200640 1 -- 172.21.15.17:0/3575382449 >> 172.21.15.17:0/3575382449 conn(0x7f831009a9f0 msgr2=0x7f831009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.113+0000 7f8317200640 1 -- 172.21.15.17:0/3575382449 shutdown_connections 2024-09-10T23:20:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.113+0000 7f8317200640 1 -- 172.21.15.17:0/3575382449 wait complete. 2024-09-10T23:20:03.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 Processor -- start 2024-09-10T23:20:03.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 -- start start 2024-09-10T23:20:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83100b12e0 0x7f83100afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83100b1740 0x7f831014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831015be00 0x7f831015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8310169440 con 0x7f831015be00 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f83101692c0 con 0x7f83100b1740 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f83101695c0 con 0x7f83100b12e0 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8315200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831015be00 0x7f831015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8315200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831015be00 0x7f831015a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40560/0 (socket says 172.21.15.17:40560) 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8315200640 1 -- 172.21.15.17:0/2175469924 learned_addr learned my addr 172.21.15.17:0/2175469924 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f830fe00640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83100b12e0 0x7f83100afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8307e00640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83100b1740 0x7f831014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8315200640 1 -- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83100b12e0 msgr2=0x7f83100afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8315200640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83100b12e0 0x7f83100afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8315200640 1 -- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83100b1740 msgr2=0x7f831014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8315200640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83100b1740 0x7f831014ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8315200640 1 -- 172.21.15.17:0/2175469924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83100b02a0 con 0x7f831015be00 2024-09-10T23:20:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8315200640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831015be00 0x7f831015a7d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f830800c780 tx=0x7f830800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f830cc00640 1 -- 172.21.15.17:0/2175469924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308017070 con 0x7f831015be00 2024-09-10T23:20:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f830cc00640 1 -- 172.21.15.17:0/2175469924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8308005070 con 0x7f831015be00 2024-09-10T23:20:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83100b0550 con 0x7f831015be00 2024-09-10T23:20:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f830cc00640 1 -- 172.21.15.17:0/2175469924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308005500 con 0x7f831015be00 2024-09-10T23:20:03.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.117+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8310159cf0 con 0x7f831015be00 2024-09-10T23:20:03.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.121+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83100cfde0 con 0x7f831015be00 2024-09-10T23:20:03.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.121+0000 7f830cc00640 1 -- 172.21.15.17:0/2175469924 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f830800a5e0 con 0x7f831015be00 2024-09-10T23:20:03.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.121+0000 7f830cc00640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82ec0725e0 0x7f82ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.121+0000 7f830cc00640 1 -- 172.21.15.17:0/2175469924 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f8308092d10 con 0x7f831015be00 2024-09-10T23:20:03.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.121+0000 7f830fe00640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82ec0725e0 0x7f82ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.121+0000 7f830fe00640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82ec0725e0 0x7f82ec074aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f83000098f0 tx=0x7f8300006f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:03.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.125+0000 7f830cc00640 1 -- 172.21.15.17:0/2175469924 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8308098020 con 0x7f831015be00 2024-09-10T23:20:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.301+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f8310155ad0 con 0x7f831015be00 2024-09-10T23:20:03.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.305+0000 7f830cc00640 1 -- 172.21.15.17:0/2175469924 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v33)=0 v33) ==== 117+0+0 (secure 0 0 0) 0x7f830805db70 con 0x7f831015be00 2024-09-10T23:20:03.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82ec0725e0 msgr2=0x7f82ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82ec0725e0 0x7f82ec074aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f83000098f0 tx=0x7f8300006f90 comp rx=0 tx=0).stop 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831015be00 msgr2=0x7f831015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831015be00 0x7f831015a7d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f830800c780 tx=0x7f830800cc40 comp rx=0 tx=0).stop 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 shutdown_connections 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82ec0725e0 0x7f82ec074aa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831015be00 0x7f831015a7d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83100b1740 0x7f831014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 --2- 172.21.15.17:0/2175469924 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83100b12e0 0x7f83100afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 >> 172.21.15.17:0/2175469924 conn(0x7f831009a9f0 msgr2=0x7f8310071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 shutdown_connections 2024-09-10T23:20:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.309+0000 7f8317200640 1 -- 172.21.15.17:0/2175469924 wait complete. 2024-09-10T23:20:03.333 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-10T23:20:03.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.477+0000 7fce9e800640 1 -- 172.21.15.17:0/2174865820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce7c004810 msgr2=0x7fce7c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.477+0000 7fce9e800640 1 --2- 172.21.15.17:0/2174865820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce7c004810 0x7fce7c004c90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fce800016c0 tx=0x7fce8001c730 comp rx=0 tx=0).stop 2024-09-10T23:20:03.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.477+0000 7fce9e800640 1 -- 172.21.15.17:0/2174865820 shutdown_connections 2024-09-10T23:20:03.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.477+0000 7fce9e800640 1 --2- 172.21.15.17:0/2174865820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce7c004810 0x7fce7c004c90 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.477+0000 7fce9e800640 1 -- 172.21.15.17:0/2174865820 >> 172.21.15.17:0/2174865820 conn(0x7fce980b1d50 msgr2=0x7fce980b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.477+0000 7fce9e800640 1 -- 172.21.15.17:0/2174865820 shutdown_connections 2024-09-10T23:20:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.477+0000 7fce9e800640 1 -- 172.21.15.17:0/2174865820 wait complete. 2024-09-10T23:20:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce9e800640 1 Processor -- start 2024-09-10T23:20:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce9e800640 1 -- start start 2024-09-10T23:20:03.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce9e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce7c004810 0x7fce98154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce9e800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce98147c80 0x7fce980ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce9e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce981f8610 0x7fce980aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce9e800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce980707c0 con 0x7fce981f8610 2024-09-10T23:20:03.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce9e800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce98070640 con 0x7fce7c004810 2024-09-10T23:20:03.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce9e800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce980ccb90 con 0x7fce98147c80 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce981f8610 0x7fce980aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce981f8610 0x7fce980aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40582/0 (socket says 172.21.15.17:40582) 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97e00640 1 -- 172.21.15.17:0/1284233051 learned_addr learned my addr 172.21.15.17:0/1284233051 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97400640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce7c004810 0x7fce98154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce8fe00640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce98147c80 0x7fce980ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97e00640 1 -- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce98147c80 msgr2=0x7fce980ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97e00640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce98147c80 0x7fce980ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97e00640 1 -- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce7c004810 msgr2=0x7fce98154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97e00640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce7c004810 0x7fce98154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97e00640 1 -- 172.21.15.17:0/1284233051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce981564d0 con 0x7fce981f8610 2024-09-10T23:20:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce97e00640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce981f8610 0x7fce980aeff0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce9815c4c0 tx=0x7fce90011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce8f400640 1 -- 172.21.15.17:0/1284233051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90013920 con 0x7fce981f8610 2024-09-10T23:20:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce8f400640 1 -- 172.21.15.17:0/1284233051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce90019070 con 0x7fce981f8610 2024-09-10T23:20:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce8f400640 1 -- 172.21.15.17:0/1284233051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90012440 con 0x7fce981f8610 2024-09-10T23:20:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.481+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce98156750 con 0x7fce981f8610 2024-09-10T23:20:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.485+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce98156d10 con 0x7fce981f8610 2024-09-10T23:20:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.485+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce980730e0 con 0x7fce981f8610 2024-09-10T23:20:03.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.485+0000 7fce8f400640 1 -- 172.21.15.17:0/1284233051 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fce90010040 con 0x7fce981f8610 2024-09-10T23:20:03.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.485+0000 7fce8f400640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce74072660 0x7fce74074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.485+0000 7fce8f400640 1 -- 172.21.15.17:0/1284233051 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fce90096940 con 0x7fce981f8610 2024-09-10T23:20:03.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.485+0000 7fce97400640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce74072660 0x7fce74074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.489+0000 7fce97400640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce74072660 0x7fce74074b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fce88009ce0 tx=0x7fce880091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:03.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.489+0000 7fce8f400640 1 -- 172.21.15.17:0/1284233051 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fce981564d0 con 0x7fce981f8610 2024-09-10T23:20:03.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.661+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fce980b2bd0 con 0x7fce981f8610 2024-09-10T23:20:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.665+0000 7fce8f400640 1 -- 172.21.15.17:0/1284233051 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v34)=0 v34) ==== 116+0+0 (secure 0 0 0) 0x7fce90062000 con 0x7fce981f8610 2024-09-10T23:20:03.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce74072660 msgr2=0x7fce74074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce74072660 0x7fce74074b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fce88009ce0 tx=0x7fce880091e0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce981f8610 msgr2=0x7fce980aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce981f8610 0x7fce980aeff0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fce9815c4c0 tx=0x7fce90011970 comp rx=0 tx=0).stop 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 shutdown_connections 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce74072660 0x7fce74074b20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce981f8610 0x7fce980aeff0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce98147c80 0x7fce980ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 --2- 172.21.15.17:0/1284233051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce7c004810 0x7fce98154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 >> 172.21.15.17:0/1284233051 conn(0x7fce980b1d50 msgr2=0x7fce9815a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 shutdown_connections 2024-09-10T23:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.669+0000 7fce9e800640 1 -- 172.21.15.17:0/1284233051 wait complete. 2024-09-10T23:20:03.693 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-10T23:20:03.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.837+0000 7f1c3b000640 1 -- 172.21.15.17:0/3836557719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2260 msgr2=0x7f1c340b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.837+0000 7f1c3b000640 1 --2- 172.21.15.17:0/3836557719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2260 0x7f1c340b50e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1c340d1570 tx=0x7f1c2801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.837+0000 7f1c3b000640 1 -- 172.21.15.17:0/3836557719 shutdown_connections 2024-09-10T23:20:03.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.837+0000 7f1c3b000640 1 --2- 172.21.15.17:0/3836557719 >> v2:172.21.15.77:3300/0 conn(0x7f1c340d2640 0x7f1c340b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.837+0000 7f1c3b000640 1 --2- 172.21.15.17:0/3836557719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2260 0x7f1c340b50e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.837+0000 7f1c3b000640 1 -- 172.21.15.17:0/3836557719 >> 172.21.15.17:0/3836557719 conn(0x7f1c3409d0f0 msgr2=0x7f1c340d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:03.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.837+0000 7f1c3b000640 1 -- 172.21.15.17:0/3836557719 shutdown_connections 2024-09-10T23:20:03.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.837+0000 7f1c3b000640 1 -- 172.21.15.17:0/3836557719 wait complete. 2024-09-10T23:20:03.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 Processor -- start 2024-09-10T23:20:03.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 -- start start 2024-09-10T23:20:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c340d2260 0x7f1c3415f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2640 0x7f1c3415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c340d46d0 0x7f1c340cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340b2a10 con 0x7f1c340d2640 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1c340b2890 con 0x7f1c340d46d0 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1c340b2b90 con 0x7f1c340d2260 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2640 0x7f1c3415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2640 0x7f1c3415c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40604/0 (socket says 172.21.15.17:40604) 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39200640 1 -- 172.21.15.17:0/108999654 learned_addr learned my addr 172.21.15.17:0/108999654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3a600640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c340d46d0 0x7f1c340cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39c00640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c340d2260 0x7f1c3415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39200640 1 -- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c340d2260 msgr2=0x7f1c3415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39200640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c340d2260 0x7f1c3415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39200640 1 -- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c340d46d0 msgr2=0x7f1c340cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:03.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39200640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c340d46d0 0x7f1c340cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:03.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39200640 1 -- 172.21.15.17:0/108999654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c340b7ef0 con 0x7f1c340d2640 2024-09-10T23:20:03.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c39200640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2640 0x7f1c3415c6a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000c420 tx=0x7f1c2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:03.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c31600640 1 -- 172.21.15.17:0/108999654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c20017070 con 0x7f1c340d2640 2024-09-10T23:20:03.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c31600640 1 -- 172.21.15.17:0/108999654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c200053c0 con 0x7f1c340d2640 2024-09-10T23:20:03.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c31600640 1 -- 172.21.15.17:0/108999654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c20003860 con 0x7f1c340d2640 2024-09-10T23:20:03.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c340b81d0 con 0x7f1c340d2640 2024-09-10T23:20:03.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.841+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c340b8790 con 0x7f1c340d2640 2024-09-10T23:20:03.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.845+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c340b50e0 con 0x7f1c340d2640 2024-09-10T23:20:03.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.845+0000 7f1c31600640 1 -- 172.21.15.17:0/108999654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1c20003a00 con 0x7f1c340d2640 2024-09-10T23:20:03.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.845+0000 7f1c31600640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c140725e0 0x7f1c14074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:03.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.845+0000 7f1c31600640 1 -- 172.21.15.17:0/108999654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f1c200929a0 con 0x7f1c340d2640 2024-09-10T23:20:03.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.845+0000 7f1c39c00640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c140725e0 0x7f1c14074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:03.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.845+0000 7f1c39c00640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c140725e0 0x7f1c14074aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1c280af000 tx=0x7f1c2801b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:03.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:03.849+0000 7f1c31600640 1 -- 172.21.15.17:0/108999654 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1c2005d890 con 0x7f1c340d2640 2024-09-10T23:20:04.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.025+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f1c3406d660 con 0x7f1c340d2640 2024-09-10T23:20:04.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.029+0000 7f1c31600640 1 -- 172.21.15.17:0/108999654 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v35)=0 v35) ==== 116+0+0 (secure 0 0 0) 0x7f1c200622c0 con 0x7f1c340d2640 2024-09-10T23:20:04.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c140725e0 msgr2=0x7f1c14074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:04.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c140725e0 0x7f1c14074aa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1c280af000 tx=0x7f1c2801b100 comp rx=0 tx=0).stop 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2640 msgr2=0x7f1c3415c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2640 0x7f1c3415c6a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000c420 tx=0x7f1c2000c8e0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 shutdown_connections 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c140725e0 0x7f1c14074aa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c340d46d0 0x7f1c340cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c340d2640 0x7f1c3415c6a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 --2- 172.21.15.17:0/108999654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c340d2260 0x7f1c3415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 >> 172.21.15.17:0/108999654 conn(0x7f1c3409d0f0 msgr2=0x7f1c3415b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 shutdown_connections 2024-09-10T23:20:04.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.033+0000 7f1c3b000640 1 -- 172.21.15.17:0/108999654 wait complete. 2024-09-10T23:20:04.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:04.058 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-10T23:20:04.074 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:20:04.074 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:20:04.074 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-09-10T23:20:04.074 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:04.074 DEBUG:teuthology.orchestra.run.smithi017:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-10T23:20:04.074 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:20:04.182 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627776 2024-09-10T23:20:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:20:04.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 -- 172.21.15.17:0/751395966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4f40 msgr2=0x7f4e08164460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 --2- 172.21.15.17:0/751395966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4f40 0x7f4e08164460 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4e0806f790 tx=0x7f4e0001cb60 comp rx=0 tx=0).stop 2024-09-10T23:20:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 -- 172.21.15.17:0/751395966 shutdown_connections 2024-09-10T23:20:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 --2- 172.21.15.17:0/751395966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4f40 0x7f4e08164460 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 --2- 172.21.15.17:0/751395966 >> v2:172.21.15.77:3300/0 conn(0x7f4e08070ab0 0x7f4e080b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 -- 172.21.15.17:0/751395966 >> 172.21.15.17:0/751395966 conn(0x7f4e080b2740 msgr2=0x7f4e080b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 -- 172.21.15.17:0/751395966 shutdown_connections 2024-09-10T23:20:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 -- 172.21.15.17:0/751395966 wait complete. 2024-09-10T23:20:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 Processor -- start 2024-09-10T23:20:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.377+0000 7f4e07e00640 1 -- start start 2024-09-10T23:20:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e08070ab0 0x7f4e08152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4620 0x7f4e08147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e080b4f40 0x7f4e0806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4e08167760 con 0x7f4e080b4620 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e081675e0 con 0x7f4e08070ab0 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e081678e0 con 0x7f4e080b4f40 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4620 0x7f4e08147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4620 0x7f4e08147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40628/0 (socket says 172.21.15.17:40628) 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dffe00640 1 -- 172.21.15.17:0/970332540 learned_addr learned my addr 172.21.15.17:0/970332540 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e06a00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e08070ab0 0x7f4e08152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07400640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e080b4f40 0x7f4e0806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dffe00640 1 -- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e080b4f40 msgr2=0x7f4e0806cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dffe00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e080b4f40 0x7f4e0806cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dffe00640 1 -- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e08070ab0 msgr2=0x7f4e08152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dffe00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e08070ab0 0x7f4e08152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dffe00640 1 -- 172.21.15.17:0/970332540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e08152900 con 0x7f4e080b4620 2024-09-10T23:20:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dffe00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4620 0x7f4e08147ec0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4df000d950 tx=0x7f4df000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dfea00640 1 -- 172.21.15.17:0/970332540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0017070 con 0x7f4e080b4620 2024-09-10T23:20:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dfea00640 1 -- 172.21.15.17:0/970332540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4df0009d20 con 0x7f4e080b4620 2024-09-10T23:20:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4dfea00640 1 -- 172.21.15.17:0/970332540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df00106c0 con 0x7f4e080b4620 2024-09-10T23:20:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e08152c40 con 0x7f4e080b4620 2024-09-10T23:20:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e081fb150 con 0x7f4e080b4620 2024-09-10T23:20:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.381+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e080b4a00 con 0x7f4e080b4620 2024-09-10T23:20:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.385+0000 7f4dfea00640 1 -- 172.21.15.17:0/970332540 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4df0010860 con 0x7f4e080b4620 2024-09-10T23:20:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.385+0000 7f4dfea00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4de40725e0 0x7f4de4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.385+0000 7f4dfea00640 1 -- 172.21.15.17:0/970332540 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f4df0093830 con 0x7f4e080b4620 2024-09-10T23:20:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.385+0000 7f4e06a00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4de40725e0 0x7f4de4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.385+0000 7f4e06a00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4de40725e0 0x7f4de4074aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4df8000f70 tx=0x7f4df8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.389+0000 7f4dfea00640 1 -- 172.21.15.17:0/970332540 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4e08152c40 con 0x7f4e080b4620 2024-09-10T23:20:04.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.597+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e08071220 con 0x7f4e080b4620 2024-09-10T23:20:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.597+0000 7f4dfea00640 1 -- 172.21.15.17:0/970332540 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5218 (secure 0 0 0) 0x7f4df005e690 con 0x7f4e080b4620 2024-09-10T23:20:04.602 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:04.602 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"btime":"2024-09-10T23:19:58:307532+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5717,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/171584879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":171584879},{"type":"v1","addr":"172.21.15.77:6837","nonce":171584879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6100,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/452390579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":452390579},{"type":"v1","addr":"172.21.15.77:6836","nonce":452390579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6396,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3726644366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3726644366},{"type":"v1","addr":"172.21.15.17:6834","nonce":3726644366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:19:57.712307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6399},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6399":{"gid":6399,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3704108078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3704108078},{"type":"v1","addr":"172.21.15.17:6835","nonce":3704108078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6399,"qdb_cluster":[6399]},"id":4}]} 2024-09-10T23:20:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 40 2024-09-10T23:20:04.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.597+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4de40725e0 msgr2=0x7f4de4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:04.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4de40725e0 0x7f4de4074aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4df8000f70 tx=0x7f4df8009040 comp rx=0 tx=0).stop 2024-09-10T23:20:04.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4620 msgr2=0x7f4e08147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:04.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4620 0x7f4e08147ec0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4df000d950 tx=0x7f4df000de10 comp rx=0 tx=0).stop 2024-09-10T23:20:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 shutdown_connections 2024-09-10T23:20:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4de40725e0 0x7f4de4074aa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e080b4f40 0x7f4e0806cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e080b4620 0x7f4e08147ec0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 --2- 172.21.15.17:0/970332540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e08070ab0 0x7f4e08152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 >> 172.21.15.17:0/970332540 conn(0x7f4e080b2740 msgr2=0x7f4e080b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 shutdown_connections 2024-09-10T23:20:04.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:04.601+0000 7f4e07e00640 1 -- 172.21.15.17:0/970332540 wait complete. 2024-09-10T23:20:04.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-10T23:20:04.785 INFO:teuthology.orchestra.run.smithi017.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T23:20:04.070092+0000","btime":"2024-09-10T23:20:04.070092+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T23:20:04.070092+0000","atime":"2024-09-10T23:20:04.070092+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6537,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6537,"want_loner":6537,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T23:20:04.786 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T23:20:04.070092+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-10T23:20:04.070092+0000", "change_attr": 0, "client_caps": [ { "client_id": 6537, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-10T23:20:04.070092+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6537, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-10T23:20:04.070092+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6537, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-09-10T23:20:04.786 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:20:04.786 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:04.795 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:20:04.795 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:20:04.795 DEBUG:teuthology.orchestra.run.smithi017:> import uuid 2024-09-10T23:20:04.795 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:04.795 DEBUG:teuthology.orchestra.run.smithi017:> n = 40 2024-09-10T23:20:04.795 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = False 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> if 0 > 0: 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = True 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> dpath = os.path.dirname(path) 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> fnameprefix = os.path.basename(path) 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> os.makedirs(dpath, exist_ok=True) 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> try: 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-10T23:20:04.796 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> for i in range(n): 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> with open(fpath, '"'"'w'"'"') as f: 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> f.write(f"{i}") 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> f.flush() 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f.fileno()) 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> os.unlink(fpath) 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> if create_hard_links: 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> for j in range(0): 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:20:04.797 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:20:04.798 DEBUG:teuthology.orchestra.run.smithi017:> finally: 2024-09-10T23:20:04.798 DEBUG:teuthology.orchestra.run.smithi017:> os.close(dirfd) 2024-09-10T23:20:04.798 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:20:05.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:20:05.035 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:20:05.035 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:05.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:20:05.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.269+0000 7fe292200640 1 -- 172.21.15.17:0/1232882276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c15ab90 msgr2=0x7fe28c0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.269+0000 7fe292200640 1 --2- 172.21.15.17:0/1232882276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c15ab90 0x7fe28c0691b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009840 tx=0x7fe27c01c6b0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.269+0000 7fe292200640 1 -- 172.21.15.17:0/1232882276 shutdown_connections 2024-09-10T23:20:05.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.269+0000 7fe292200640 1 --2- 172.21.15.17:0/1232882276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c15ab90 0x7fe28c0691b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.269+0000 7fe292200640 1 -- 172.21.15.17:0/1232882276 >> 172.21.15.17:0/1232882276 conn(0x7fe28c072f80 msgr2=0x7fe28c073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:05.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.269+0000 7fe292200640 1 -- 172.21.15.17:0/1232882276 shutdown_connections 2024-09-10T23:20:05.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.269+0000 7fe292200640 1 -- 172.21.15.17:0/1232882276 wait complete. 2024-09-10T23:20:05.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.269+0000 7fe292200640 1 Processor -- start 2024-09-10T23:20:05.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 -- start start 2024-09-10T23:20:05.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c06e2e0 0x7fe28c152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:05.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28c0cf000 0x7fe28c148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:05.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe28c15ab90 0x7fe28c1494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:05.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c168a70 con 0x7fe28c0cf000 2024-09-10T23:20:05.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c1688f0 con 0x7fe28c06e2e0 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe28c168bf0 con 0x7fe28c15ab90 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28c0cf000 0x7fe28c148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28c0cf000 0x7fe28c148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40632/0 (socket says 172.21.15.17:40632) 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283e00640 1 -- 172.21.15.17:0/1352744104 learned_addr learned my addr 172.21.15.17:0/1352744104 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe28b400640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c06e2e0 0x7fe28c152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe28be00640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe28c15ab90 0x7fe28c1494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283e00640 1 -- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe28c15ab90 msgr2=0x7fe28c1494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283e00640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe28c15ab90 0x7fe28c1494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283e00640 1 -- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c06e2e0 msgr2=0x7fe28c152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283e00640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c06e2e0 0x7fe28c152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283e00640 1 -- 172.21.15.17:0/1352744104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c075180 con 0x7fe28c0cf000 2024-09-10T23:20:05.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283e00640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28c0cf000 0x7fe28c148400 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe27400c660 tx=0x7fe27400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:05.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283400640 1 -- 172.21.15.17:0/1352744104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274016020 con 0x7fe28c0cf000 2024-09-10T23:20:05.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283400640 1 -- 172.21.15.17:0/1352744104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe27400a930 con 0x7fe28c0cf000 2024-09-10T23:20:05.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe283400640 1 -- 172.21.15.17:0/1352744104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27400ad80 con 0x7fe28c0cf000 2024-09-10T23:20:05.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c148b60 con 0x7fe28c0cf000 2024-09-10T23:20:05.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c149120 con 0x7fe28c0cf000 2024-09-10T23:20:05.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.273+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28c0691b0 con 0x7fe28c0cf000 2024-09-10T23:20:05.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.277+0000 7fe283400640 1 -- 172.21.15.17:0/1352744104 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe274012420 con 0x7fe28c0cf000 2024-09-10T23:20:05.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.277+0000 7fe283400640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe268072610 0x7fe268074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:05.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.277+0000 7fe283400640 1 -- 172.21.15.17:0/1352744104 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fe274093820 con 0x7fe28c0cf000 2024-09-10T23:20:05.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.277+0000 7fe28b400640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe268072610 0x7fe268074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:05.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.277+0000 7fe28b400640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe268072610 0x7fe268074ad0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0af000 tx=0x7fe27c0b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:05.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.281+0000 7fe283400640 1 -- 172.21.15.17:0/1352744104 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe274020020 con 0x7fe28c0cf000 2024-09-10T23:20:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.469+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe28c0b3810 con 0x7fe28c0cf000 2024-09-10T23:20:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.469+0000 7fe283400640 1 -- 172.21.15.17:0/1352744104 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v70) ==== 80+0+0 (secure 0 0 0) 0x7fe27405ed60 con 0x7fe28c0cf000 2024-09-10T23:20:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:20:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.469+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe268072610 msgr2=0x7fe268074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.469+0000 7fe292200640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe268072610 0x7fe268074ad0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0af000 tx=0x7fe27c0b2040 comp rx=0 tx=0).stop 2024-09-10T23:20:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.469+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28c0cf000 msgr2=0x7fe28c148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.469+0000 7fe292200640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28c0cf000 0x7fe28c148400 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe27400c660 tx=0x7fe27400cb20 comp rx=0 tx=0).stop 2024-09-10T23:20:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.473+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 shutdown_connections 2024-09-10T23:20:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.473+0000 7fe292200640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe268072610 0x7fe268074ad0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.473+0000 7fe292200640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe28c15ab90 0x7fe28c1494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.473+0000 7fe292200640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28c0cf000 0x7fe28c148400 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.473+0000 7fe292200640 1 --2- 172.21.15.17:0/1352744104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c06e2e0 0x7fe28c152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.473+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 >> 172.21.15.17:0/1352744104 conn(0x7fe28c072f80 msgr2=0x7fe28c06dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.473+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 shutdown_connections 2024-09-10T23:20:05.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.473+0000 7fe292200640 1 -- 172.21.15.17:0/1352744104 wait complete. 2024-09-10T23:20:05.496 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:20:05.497 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:05.506 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:20:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.689+0000 7f6310400640 1 -- 172.21.15.17:0/4088338832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f630815d7d0 msgr2=0x7f630815dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.689+0000 7f6310400640 1 --2- 172.21.15.17:0/4088338832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f630815d7d0 0x7f630815dde0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009900 tx=0x7f62f401c850 comp rx=0 tx=0).stop 2024-09-10T23:20:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.689+0000 7f6310400640 1 -- 172.21.15.17:0/4088338832 shutdown_connections 2024-09-10T23:20:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.689+0000 7f6310400640 1 --2- 172.21.15.17:0/4088338832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f630815d7d0 0x7f630815dde0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.689+0000 7f6310400640 1 -- 172.21.15.17:0/4088338832 >> 172.21.15.17:0/4088338832 conn(0x7f63080b1730 msgr2=0x7f63080b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.689+0000 7f6310400640 1 -- 172.21.15.17:0/4088338832 shutdown_connections 2024-09-10T23:20:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.689+0000 7f6310400640 1 -- 172.21.15.17:0/4088338832 wait complete. 2024-09-10T23:20:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.689+0000 7f6310400640 1 Processor -- start 2024-09-10T23:20:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.689+0000 7f6310400640 1 -- start start 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6310400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63080cf090 0x7f6308153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6310400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f630815d7d0 0x7f63081392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6310400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f630815e320 0x7f6308152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6310400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6308169850 con 0x7f63080cf090 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6310400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63081696d0 con 0x7f630815d7d0 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6310400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f63081699d0 con 0x7f630815e320 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63080cf090 0x7f6308153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63080cf090 0x7f6308153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40652/0 (socket says 172.21.15.17:40652) 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630da00640 1 -- 172.21.15.17:0/2328231510 learned_addr learned my addr 172.21.15.17:0/2328231510 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630d000640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f630815d7d0 0x7f63081392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630e400640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f630815e320 0x7f6308152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630da00640 1 -- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f630815e320 msgr2=0x7f6308152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630da00640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f630815e320 0x7f6308152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630da00640 1 -- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f630815d7d0 msgr2=0x7f63081392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630da00640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f630815d7d0 0x7f63081392d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630da00640 1 -- 172.21.15.17:0/2328231510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6308153190 con 0x7f63080cf090 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f630da00640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63080cf090 0x7f6308153c90 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00c4b0 tx=0x7f62fc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6305600640 1 -- 172.21.15.17:0/2328231510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0052d0 con 0x7f63080cf090 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6305600640 1 -- 172.21.15.17:0/2328231510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62fc005470 con 0x7f63080cf090 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6305600640 1 -- 172.21.15.17:0/2328231510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc012870 con 0x7f63080cf090 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6308157850 con 0x7f63080cf090 2024-09-10T23:20:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6308157df0 con 0x7f63080cf090 2024-09-10T23:20:05.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630815dde0 con 0x7f63080cf090 2024-09-10T23:20:05.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.693+0000 7f6305600640 1 -- 172.21.15.17:0/2328231510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f62fc003600 con 0x7f63080cf090 2024-09-10T23:20:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.697+0000 7f6305600640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62e80725e0 0x7f62e8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.697+0000 7f6305600640 1 -- 172.21.15.17:0/2328231510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f62fc092f30 con 0x7f63080cf090 2024-09-10T23:20:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.697+0000 7f630d000640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62e80725e0 0x7f62e8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.697+0000 7f630d000640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62e80725e0 0x7f62e8074aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f62f40af000 tx=0x7f62f401b090 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.701+0000 7f6305600640 1 -- 172.21.15.17:0/2328231510 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f62fc05e480 con 0x7f63080cf090 2024-09-10T23:20:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f63080b2eb0 con 0x7f63080cf090 2024-09-10T23:20:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6305600640 1 -- 172.21.15.17:0/2328231510 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v70) ==== 80+0+0 (secure 0 0 0) 0x7f62fc05dd80 con 0x7f63080cf090 2024-09-10T23:20:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:20:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62e80725e0 msgr2=0x7f62e8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62e80725e0 0x7f62e8074aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f62f40af000 tx=0x7f62f401b090 comp rx=0 tx=0).stop 2024-09-10T23:20:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63080cf090 msgr2=0x7f6308153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63080cf090 0x7f6308153c90 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00c4b0 tx=0x7f62fc00c970 comp rx=0 tx=0).stop 2024-09-10T23:20:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 shutdown_connections 2024-09-10T23:20:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62e80725e0 0x7f62e8074aa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f630815e320 0x7f6308152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f630815d7d0 0x7f63081392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 --2- 172.21.15.17:0/2328231510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63080cf090 0x7f6308153c90 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 >> 172.21.15.17:0/2328231510 conn(0x7f63080b1730 msgr2=0x7f630806e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 shutdown_connections 2024-09-10T23:20:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:05.889+0000 7f6310400640 1 -- 172.21.15.17:0/2328231510 wait complete. 2024-09-10T23:20:05.913 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:20:05.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:05.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:05.932 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[53451]: fuse finished with error 0 and tester_r 0 2024-09-10T23:20:05.935 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:20:06.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:20:06.783 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:20:12.037 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:20:12.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:12.038 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:20:12.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-10T23:20:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.245+0000 7f034cc00640 1 -- 172.21.15.17:0/3933641891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0348072b70 msgr2=0x7f0348072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.245+0000 7f034cc00640 1 --2- 172.21.15.17:0/3933641891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0348072b70 0x7f0348072fa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f03480af6e0 tx=0x7f033001dbc0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.245+0000 7f034cc00640 1 -- 172.21.15.17:0/3933641891 shutdown_connections 2024-09-10T23:20:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.245+0000 7f034cc00640 1 --2- 172.21.15.17:0/3933641891 >> v2:172.21.15.77:3300/0 conn(0x7f03480cc6f0 0x7f03480ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.245+0000 7f034cc00640 1 --2- 172.21.15.17:0/3933641891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0348072b70 0x7f0348072fa0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.245+0000 7f034cc00640 1 -- 172.21.15.17:0/3933641891 >> 172.21.15.17:0/3933641891 conn(0x7f03480b17a0 msgr2=0x7f03480b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.245+0000 7f034cc00640 1 -- 172.21.15.17:0/3933641891 shutdown_connections 2024-09-10T23:20:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.245+0000 7f034cc00640 1 -- 172.21.15.17:0/3933641891 wait complete. 2024-09-10T23:20:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 Processor -- start 2024-09-10T23:20:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 -- start start 2024-09-10T23:20:12.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0348072b70 0x7f03481f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03480cc6f0 0x7f0348150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034815a3a0 0x7f0348139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f03480cd410 con 0x7f03480cc6f0 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f03480cd290 con 0x7f034815a3a0 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03480cd590 con 0x7f0348072b70 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03480cc6f0 0x7f0348150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03480cc6f0 0x7f0348150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42184/0 (socket says 172.21.15.17:42184) 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033fe00640 1 -- 172.21.15.17:0/2490431465 learned_addr learned my addr 172.21.15.17:0/2490431465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f0346800640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034815a3a0 0x7f0348139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f0345e00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0348072b70 0x7f03481f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033fe00640 1 -- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0348072b70 msgr2=0x7f03481f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033fe00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0348072b70 0x7f03481f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033fe00640 1 -- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034815a3a0 msgr2=0x7f0348139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033fe00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034815a3a0 0x7f0348139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033fe00640 1 -- 172.21.15.17:0/2490431465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03481f8ff0 con 0x7f03480cc6f0 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f0346800640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034815a3a0 0x7f0348139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f0345e00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0348072b70 0x7f03481f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033fe00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03480cc6f0 0x7f0348150db0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f03300b1040 tx=0x7f0330005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033e000640 1 -- 172.21.15.17:0/2490431465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03300b3070 con 0x7f03480cc6f0 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033e000640 1 -- 172.21.15.17:0/2490431465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0330005610 con 0x7f03480cc6f0 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f033e000640 1 -- 172.21.15.17:0/2490431465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330004910 con 0x7f03480cc6f0 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 -- 172.21.15.17:0/2490431465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03481f92d0 con 0x7f03480cc6f0 2024-09-10T23:20:12.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.249+0000 7f034cc00640 1 -- 172.21.15.17:0/2490431465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0348147e60 con 0x7f03480cc6f0 2024-09-10T23:20:12.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.253+0000 7f033e000640 1 -- 172.21.15.17:0/2490431465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f033000b040 con 0x7f03480cc6f0 2024-09-10T23:20:12.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.253+0000 7f033e000640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03240725e0 0x7f0324074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.253+0000 7f033e000640 1 -- 172.21.15.17:0/2490431465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f033012d4b0 con 0x7f03480cc6f0 2024-09-10T23:20:12.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.253+0000 7f03500f5000 1 Processor -- start 2024-09-10T23:20:12.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.253+0000 7f03500f5000 1 -- start start 2024-09-10T23:20:12.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.253+0000 7f0345e00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03240725e0 0x7f0324074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee984580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee93a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee93afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563fee822cb0 con 0x563fee9841a0 2024-09-10T23:20:12.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563fee738310 con 0x563fee93abc0 2024-09-10T23:20:12.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563fee795b90 con 0x563fee984ac0 2024-09-10T23:20:12.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03240725e0 0x7f0324074aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0338001630 tx=0x7f0338009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee984580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee984580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42190/0 (socket says 172.21.15.17:42190) 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 -- 172.21.15.17:0/3842384769 learned_addr learned my addr 172.21.15.17:0/3842384769 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f033fe00640 1 --2- 172.21.15.17:0/3842384769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee93a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0346800640 1 --2- 172.21.15.17:0/3842384769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee93afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 -- 172.21.15.17:0/3842384769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 msgr2=0x563fee93a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 --2- 172.21.15.17:0/3842384769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee93a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 -- 172.21.15.17:0/3842384769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 msgr2=0x563fee93afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 --2- 172.21.15.17:0/3842384769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee93afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 -- 172.21.15.17:0/3842384769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fee739c60 con 0x563fee9841a0 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0345e00640 1 --2- 172.21.15.17:0/3842384769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee984580 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f033800d850 tx=0x7f0338010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226bc69419c5c963 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0336a00640 1 -- 172.21.15.17:0/3842384769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338024070 con 0x563fee9841a0 2024-09-10T23:20:12.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0336a00640 1 -- 172.21.15.17:0/3842384769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0338014ba0 con 0x563fee9841a0 2024-09-10T23:20:12.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f0336a00640 1 -- 172.21.15.17:0/3842384769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033801f400 con 0x563fee9841a0 2024-09-10T23:20:12.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 -- 172.21.15.17:0/3842384769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 msgr2=0x563fee984580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 --2- 172.21.15.17:0/3842384769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee984580 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f033800d850 tx=0x7f0338010000 comp rx=0 tx=0).stop 2024-09-10T23:20:12.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 -- 172.21.15.17:0/3842384769 shutdown_connections 2024-09-10T23:20:12.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 --2- 172.21.15.17:0/3842384769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee93afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 --2- 172.21.15.17:0/3842384769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee93a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 --2- 172.21.15.17:0/3842384769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee984580 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 -- 172.21.15.17:0/3842384769 >> 172.21.15.17:0/3842384769 conn(0x563fee940d20 msgr2=0x563fee938f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 -- 172.21.15.17:0/3842384769 shutdown_connections 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 -- 172.21.15.17:0/3842384769 wait complete. 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 -- start start 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.257+0000 7f03500f5000 1 Processor -- start 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee98b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee98ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee98bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563fee788dd0 con 0x563fee9841a0 2024-09-10T23:20:12.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563fee784fc0 con 0x563fee93abc0 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563fee72a4b0 con 0x563fee984ac0 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 10 client.0 _ll_register_callbacks cb 0x563fee7087d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f033fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee98ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f033fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee98ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42196/0 (socket says 172.21.15.17:42196) 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f033fe00640 1 -- 172.21.15.17:0/237763719 learned_addr learned my addr 172.21.15.17:0/237763719 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f0345e00640 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee98b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f0346800640 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee98bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f033fe00640 1 -- 172.21.15.17:0/237763719 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 msgr2=0x563fee98bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f033fe00640 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee98bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f033fe00640 1 -- 172.21.15.17:0/237763719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 msgr2=0x563fee98b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f033fe00640 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee98b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f033fe00640 1 -- 172.21.15.17:0/237763719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fee7231f0 con 0x563fee9841a0 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f0345e00640 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee98b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f033fe00640 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee98ba70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f033001a7d0 tx=0x7f03300f7df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e77be767530bae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f032b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f032b400640 1 -- 172.21.15.17:0/237763719 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03300f87f0 con 0x563fee9841a0 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f032b400640 1 -- 172.21.15.17:0/237763719 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f0330101400 con 0x563fee9841a0 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 -- 172.21.15.17:0/237763719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563fee71d330 con 0x563fee9841a0 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f032b400640 1 -- 172.21.15.17:0/237763719 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f033012d2d0 con 0x563fee9841a0 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 10 client.6594 fetch_fsmap learned FSMap version 40 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 -- 172.21.15.17:0/237763719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x563fee709fa0 con 0x563fee9841a0 2024-09-10T23:20:12.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f032b400640 1 -- 172.21.15.17:0/237763719 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563fee71d330 con 0x563fee9841a0 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f032b400640 1 -- 172.21.15.17:0/237763719 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f03300ff0d0 con 0x563fee9841a0 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 10 client.6594 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 10 client.6594 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 20 client.6594 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x563fee993900 0x563fee995cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 4 client.6594 mds_command: new command op to 6399 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 -- 172.21.15.17:0/237763719 --> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fee797ae0 con 0x563fee993900 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f0345e00640 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x563fee993900 0x563fee995cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f0345e00640 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x563fee993900 0x563fee995cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e65571b44de5b86e server_cookie=65636bfbaf009971 in_seq=0 out_seq=0 2024-09-10T23:20:12.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f032b400640 10 client.6594 ms_handle_connect on v2:172.21.15.17:6833/3704108078 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f032b400640 1 -- 172.21.15.17:0/237763719 <== mds.0 v2:172.21.15.17:6833/3704108078 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fee797ae0 con 0x563fee993900 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f032b400640 10 client.6594 handle_command_reply: tid=0 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 client.6594 shutdown 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 -- 172.21.15.17:0/237763719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 msgr2=0x563fee98ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.261+0000 7f03500f5000 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee98ba70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f033001a7d0 tx=0x7f03300f7df0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f03500f5000 1 -- 172.21.15.17:0/237763719 shutdown_connections 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f03500f5000 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x563fee993900 0x563fee995cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f03500f5000 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee98bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f03500f5000 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee98ba70 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f03500f5000 1 --2- 172.21.15.17:0/237763719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee98b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f032b400640 0 client.6594 ms_handle_reset on v2:172.21.15.17:6833/3704108078 2024-09-10T23:20:12.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f03500f5000 1 -- 172.21.15.17:0/237763719 >> 172.21.15.17:0/237763719 conn(0x563fee940d20 msgr2=0x563fee938f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f03500f5000 1 -- 172.21.15.17:0/237763719 shutdown_connections 2024-09-10T23:20:12.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f03500f5000 1 -- 172.21.15.17:0/237763719 wait complete. 2024-09-10T23:20:12.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.265+0000 7f03500f5000 20 client.6594 trim_cache size 0 max 16384 2024-09-10T23:20:12.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.277+0000 7f03500f5000 1 Processor -- start 2024-09-10T23:20:12.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.277+0000 7f03500f5000 1 -- start start 2024-09-10T23:20:12.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee9f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee9f6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee9f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0348204390 con 0x563fee9841a0 2024-09-10T23:20:12.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0348156c90 con 0x563fee93abc0 2024-09-10T23:20:12.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03481490c0 con 0x563fee984ac0 2024-09-10T23:20:12.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f033fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee9f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f033fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee9f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42206/0 (socket says 172.21.15.17:42206) 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f033fe00640 1 -- 172.21.15.17:0/2726728644 learned_addr learned my addr 172.21.15.17:0/2726728644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f0345e00640 1 --2- 172.21.15.17:0/2726728644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee9f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f0346800640 1 --2- 172.21.15.17:0/2726728644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee9f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f033fe00640 1 -- 172.21.15.17:0/2726728644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 msgr2=0x563fee9f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f033fe00640 1 --2- 172.21.15.17:0/2726728644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee9f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f033fe00640 1 -- 172.21.15.17:0/2726728644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 msgr2=0x563fee9f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f033fe00640 1 --2- 172.21.15.17:0/2726728644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee9f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f033fe00640 1 -- 172.21.15.17:0/2726728644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fee7e2660 con 0x563fee9841a0 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f033fe00640 1 --2- 172.21.15.17:0/2726728644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee9f6170 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f033001e460 tx=0x7f03300f7b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6e0afee5711332 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f0336000640 1 -- 172.21.15.17:0/2726728644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03300fce70 con 0x563fee9841a0 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f0336000640 1 -- 172.21.15.17:0/2726728644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0330101890 con 0x563fee9841a0 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f0336000640 1 -- 172.21.15.17:0/2726728644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03300f8390 con 0x563fee9841a0 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- 172.21.15.17:0/2726728644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 msgr2=0x563fee9f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- 172.21.15.17:0/2726728644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee9f6170 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f033001e460 tx=0x7f03300f7b00 comp rx=0 tx=0).stop 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- 172.21.15.17:0/2726728644 shutdown_connections 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- 172.21.15.17:0/2726728644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee984ac0 0x563fee9f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- 172.21.15.17:0/2726728644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee9841a0 0x563fee9f6170 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- 172.21.15.17:0/2726728644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee93abc0 0x563fee9f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- 172.21.15.17:0/2726728644 >> 172.21.15.17:0/2726728644 conn(0x563fee940d20 msgr2=0x563fee93c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- 172.21.15.17:0/2726728644 shutdown_connections 2024-09-10T23:20:12.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- 172.21.15.17:0/2726728644 wait complete. 2024-09-10T23:20:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- start start 2024-09-10T23:20:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 Processor -- start 2024-09-10T23:20:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee93abc0 0x563fee99ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee9841a0 0x563fee99b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee984ac0 0x563fee9b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563fee788dd0 con 0x563fee984ac0 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563fee943d40 con 0x563fee9841a0 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563fee941100 con 0x563fee93abc0 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.281+0000 7f03500f5000 10 client.0 _ll_register_callbacks cb 0x7f03300f8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0346800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee984ac0 0x563fee9b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0345e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee93abc0 0x563fee99ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f033fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee9841a0 0x563fee99b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0346800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee984ac0 0x563fee9b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42212/0 (socket says 172.21.15.17:42212) 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0346800640 1 -- 172.21.15.17:0/593537669 learned_addr learned my addr 172.21.15.17:0/593537669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0346800640 1 -- 172.21.15.17:0/593537669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee93abc0 msgr2=0x563fee99ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0346800640 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee93abc0 0x563fee99ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0346800640 1 -- 172.21.15.17:0/593537669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee9841a0 msgr2=0x563fee99b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0346800640 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee9841a0 0x563fee99b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0346800640 1 -- 172.21.15.17:0/593537669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fee74f090 con 0x563fee984ac0 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0346800640 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee984ac0 0x563fee9b6210 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0340011840 tx=0x7f0340011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4016b7d42a2ead server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f032b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f032b400640 1 -- 172.21.15.17:0/593537669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340010c60 con 0x563fee984ac0 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f032b400640 1 -- 172.21.15.17:0/593537669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f0340010e00 con 0x563fee984ac0 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f03500f5000 1 -- 172.21.15.17:0/593537669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0330101890 con 0x563fee984ac0 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f032b400640 1 -- 172.21.15.17:0/593537669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0340026050 con 0x563fee984ac0 2024-09-10T23:20:12.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f03500f5000 10 client.6600 fetch_fsmap learned FSMap version 40 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f03500f5000 1 -- 172.21.15.17:0/593537669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x563fee71b5f0 con 0x563fee984ac0 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f032b400640 1 -- 172.21.15.17:0/593537669 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0330101890 con 0x563fee984ac0 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f032b400640 1 -- 172.21.15.17:0/593537669 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f0340029020 con 0x563fee984ac0 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f03500f5000 10 client.6600 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f03500f5000 10 client.6600 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f03500f5000 20 client.6600 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f03500f5000 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x563fee9f9850 0x563fee9f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f03500f5000 4 client.6600 mds_command: new command op to 6399 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f03500f5000 1 -- 172.21.15.17:0/593537669 --> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563fee793590 con 0x563fee9f9850 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0345e00640 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x563fee9f9850 0x563fee9f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f0345e00640 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x563fee9f9850 0x563fee9f9c60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2136ac9e945003e server_cookie=fd0340534cdf284d in_seq=0 out_seq=0 2024-09-10T23:20:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.285+0000 7f032b400640 10 client.6600 ms_handle_connect on v2:172.21.15.17:6833/3704108078 2024-09-10T23:20:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f032b400640 1 -- 172.21.15.17:0/593537669 <== mds.0 v2:172.21.15.17:6833/3704108078 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563fee793590 con 0x563fee9f9850 2024-09-10T23:20:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f032b400640 10 client.6600 handle_command_reply: tid=0 2024-09-10T23:20:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 client.6600 shutdown 2024-09-10T23:20:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 -- 172.21.15.17:0/593537669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee984ac0 msgr2=0x563fee9b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee984ac0 0x563fee9b6210 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0340011840 tx=0x7f0340011d00 comp rx=0 tx=0).stop 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 -- 172.21.15.17:0/593537669 shutdown_connections 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.17:6833/3704108078,v1:172.21.15.17:6835/3704108078] conn(0x563fee9f9850 0x563fee9f9c60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563fee984ac0 0x563fee9b6210 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563fee9841a0 0x563fee99b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 --2- 172.21.15.17:0/593537669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563fee93abc0 0x563fee99ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f032b400640 0 client.6600 ms_handle_reset on v2:172.21.15.17:6833/3704108078 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 -- 172.21.15.17:0/593537669 >> 172.21.15.17:0/593537669 conn(0x563fee940d20 msgr2=0x563fee995cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 -- 172.21.15.17:0/593537669 shutdown_connections 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 1 -- 172.21.15.17:0/593537669 wait complete. 2024-09-10T23:20:12.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.301+0000 7f03500f5000 20 client.6600 trim_cache size 0 max 16384 2024-09-10T23:20:12.309 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:20:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:20:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:20:12.309 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:20:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 -- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03240725e0 msgr2=0x7f0324074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03240725e0 0x7f0324074aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0338001630 tx=0x7f0338009040 comp rx=0 tx=0).stop 2024-09-10T23:20:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 -- 172.21.15.17:0/2490431465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03480cc6f0 msgr2=0x7f0348150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03480cc6f0 0x7f0348150db0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f03300b1040 tx=0x7f0330005e20 comp rx=0 tx=0).stop 2024-09-10T23:20:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 -- 172.21.15.17:0/2490431465 shutdown_connections 2024-09-10T23:20:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03240725e0 0x7f0324074aa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f034815a3a0 0x7f0348139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03480cc6f0 0x7f0348150db0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 --2- 172.21.15.17:0/2490431465 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0348072b70 0x7f03481f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 -- 172.21.15.17:0/2490431465 >> 172.21.15.17:0/2490431465 conn(0x7f03480b17a0 msgr2=0x7f034814e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 -- 172.21.15.17:0/2490431465 shutdown_connections 2024-09-10T23:20:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.305+0000 7f034cc00640 1 -- 172.21.15.17:0/2490431465 wait complete. 2024-09-10T23:20:12.328 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:20:12.328 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:20:12.328 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:20:12.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:20:12.329 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:20:12.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:20:12.329 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:20:12.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:20:12.341 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:20:12.341 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-10T23:20:12.344 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:20:12.344 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-10T23:20:12.345 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:20:12.345 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-10T23:20:12.347 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:20:12.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-10T23:20:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.533+0000 7f450de00640 1 -- 172.21.15.17:0/767916620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450815b890 msgr2=0x7f4508073f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.533+0000 7f450de00640 1 --2- 172.21.15.17:0/767916620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450815b890 0x7f4508073f30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009900 tx=0x7f44fc01c7c0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.533+0000 7f450de00640 1 -- 172.21.15.17:0/767916620 shutdown_connections 2024-09-10T23:20:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.533+0000 7f450de00640 1 --2- 172.21.15.17:0/767916620 >> v2:172.21.15.77:3300/0 conn(0x7f450815bc70 0x7f45080cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.533+0000 7f450de00640 1 --2- 172.21.15.17:0/767916620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450815b890 0x7f4508073f30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.533+0000 7f450de00640 1 -- 172.21.15.17:0/767916620 >> 172.21.15.17:0/767916620 conn(0x7f45080b2740 msgr2=0x7f45080b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.533+0000 7f450de00640 1 -- 172.21.15.17:0/767916620 shutdown_connections 2024-09-10T23:20:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.533+0000 7f450de00640 1 -- 172.21.15.17:0/767916620 wait complete. 2024-09-10T23:20:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 -- 172.21.15.17:0/4277099266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25c8073860 msgr2=0x7f25c815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 --2- 172.21.15.17:0/4277099266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25c8073860 0x7f25c815ead0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009900 tx=0x7f25b401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 -- 172.21.15.17:0/4277099266 shutdown_connections 2024-09-10T23:20:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 --2- 172.21.15.17:0/4277099266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25c8073860 0x7f25c815ead0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 --2- 172.21.15.17:0/4277099266 >> v2:172.21.15.77:3300/0 conn(0x7f25c8073480 0x7f25c8072b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 -- 172.21.15.17:0/4277099266 >> 172.21.15.17:0/4277099266 conn(0x7f25c80cfd50 msgr2=0x7f25c80d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 -- 172.21.15.17:0/4277099266 shutdown_connections 2024-09-10T23:20:12.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 -- 172.21.15.17:0/4277099266 wait complete. 2024-09-10T23:20:12.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450de00640 1 Processor -- start 2024-09-10T23:20:12.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450de00640 1 -- start start 2024-09-10T23:20:12.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f218e800640 1 -- 172.21.15.17:0/832955775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880c70e0 msgr2=0x7f21880c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f218e800640 1 --2- 172.21.15.17:0/832955775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880c70e0 0x7f21880c74c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f2178009900 tx=0x7f217801c870 comp rx=0 tx=0).stop 2024-09-10T23:20:12.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f218e800640 1 -- 172.21.15.17:0/832955775 shutdown_connections 2024-09-10T23:20:12.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f218e800640 1 --2- 172.21.15.17:0/832955775 >> v2:172.21.15.77:3300/0 conn(0x7f21880d0ec0 0x7f21880ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f218e800640 1 --2- 172.21.15.17:0/832955775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880c70e0 0x7f21880c74c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f218e800640 1 -- 172.21.15.17:0/832955775 >> 172.21.15.17:0/832955775 conn(0x7f21880b39c0 msgr2=0x7f21880b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f218e800640 1 -- 172.21.15.17:0/832955775 shutdown_connections 2024-09-10T23:20:12.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f218e800640 1 -- 172.21.15.17:0/832955775 wait complete. 2024-09-10T23:20:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45080ceeb0 0x7f450813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450815b890 0x7f45080b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450de00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450815bc70 0x7f45080aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450de00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f45081689c0 con 0x7f45080ceeb0 2024-09-10T23:20:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450de00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4508070940 con 0x7f450815bc70 2024-09-10T23:20:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450de00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4508168b40 con 0x7f450815b890 2024-09-10T23:20:12.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 Processor -- start 2024-09-10T23:20:12.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45080ceeb0 0x7f450813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45080ceeb0 0x7f450813f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42224/0 (socket says 172.21.15.17:42224) 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450ca00640 1 -- 172.21.15.17:0/4020993611 learned_addr learned my addr 172.21.15.17:0/4020993611 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f4507e00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450815b890 0x7f45080b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450d400640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450815bc70 0x7f45080aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450ca00640 1 -- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450815b890 msgr2=0x7f45080b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450ca00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450815b890 0x7f45080b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450ca00640 1 -- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450815bc70 msgr2=0x7f45080aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450ca00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450815bc70 0x7f45080aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450ca00640 1 -- 172.21.15.17:0/4020993611 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45081fb220 con 0x7f45080ceeb0 2024-09-10T23:20:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f450ca00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45080ceeb0 0x7f450813f5d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f44fc01a3f0 tx=0x7f44fc0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 -- start start 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25c8073480 0x7f25c80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c8073860 0x7f25c81fb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f25c7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25c80af0f0 0x7f25c80af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25c80ae390 con 0x7f25c8073860 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f25c80ae210 con 0x7f25c80af0f0 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f25c80ae510 con 0x7f25c8073480 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f4504c00640 1 -- 172.21.15.17:0/4020993611 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0ac070 con 0x7f45080ceeb0 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.537+0000 7f4504c00640 1 -- 172.21.15.17:0/4020993611 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44fc004020 con 0x7f45080ceeb0 2024-09-10T23:20:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f4504c00640 1 -- 172.21.15.17:0/4020993611 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc005d60 con 0x7f45080ceeb0 2024-09-10T23:20:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45081fb500 con 0x7f45080ceeb0 2024-09-10T23:20:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c6800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25c80af0f0 0x7f25c80af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f218e800640 1 Processor -- start 2024-09-10T23:20:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c6800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25c80af0f0 0x7f25c80af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:42524/0 (socket says 172.21.15.17:42524) 2024-09-10T23:20:12.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c6800640 1 -- 172.21.15.17:0/3509872156 learned_addr learned my addr 172.21.15.17:0/3509872156 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f218e800640 1 -- start start 2024-09-10T23:20:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c6800640 1 -- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25c8073480 msgr2=0x7f25c80c9740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T23:20:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c5400640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c8073860 0x7f25c81fb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450815ea90 con 0x7f45080ceeb0 2024-09-10T23:20:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c5e00640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25c8073480 0x7f25c80c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c6800640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25c8073480 0x7f25c80c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c6800640 1 -- 172.21.15.17:0/3509872156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c8073860 msgr2=0x7f25c81fb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c6800640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c8073860 0x7f25c81fb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c6800640 1 -- 172.21.15.17:0/3509872156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c80c9c80 con 0x7f25c80af0f0 2024-09-10T23:20:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c5400640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c8073860 0x7f25c81fb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45080ccf70 con 0x7f45080ceeb0 2024-09-10T23:20:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f218e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880b44e0 0x7f21881438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f218e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21880c70e0 0x7f2188071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f218e800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21880d0ec0 0x7f218815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f218e800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2188168b90 con 0x7f21880b44e0 2024-09-10T23:20:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f218e800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2188168a10 con 0x7f21880c70e0 2024-09-10T23:20:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f218e800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2188168d10 con 0x7f21880d0ec0 2024-09-10T23:20:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880b44e0 0x7f21881438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880b44e0 0x7f21881438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42246/0 (socket says 172.21.15.17:42246) 2024-09-10T23:20:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187400640 1 -- 172.21.15.17:0/1729991433 learned_addr learned my addr 172.21.15.17:0/1729991433 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c6800640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25c80af0f0 0x7f25c80af7d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c730 tx=0x7f25c000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187e00640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21880d0ec0 0x7f218815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187400640 1 -- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21880d0ec0 msgr2=0x7f218815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187400640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21880d0ec0 0x7f218815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187400640 1 -- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21880c70e0 msgr2=0x7f2188071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187400640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21880c70e0 0x7f2188071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187400640 1 -- 172.21.15.17:0/1729991433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21880ca130 con 0x7f21880b44e0 2024-09-10T23:20:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187e00640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21880d0ec0 0x7f218815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25be000640 1 -- 172.21.15.17:0/3509872156 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0016020 con 0x7f25c80af0f0 2024-09-10T23:20:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25be000640 1 -- 172.21.15.17:0/3509872156 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25c00039a0 con 0x7f25c80af0f0 2024-09-10T23:20:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25be000640 1 -- 172.21.15.17:0/3509872156 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0003df0 con 0x7f25c80af0f0 2024-09-10T23:20:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c81fb710 con 0x7f25c80af0f0 2024-09-10T23:20:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c80c7350 con 0x7f25c80af0f0 2024-09-10T23:20:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f2187400640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880b44e0 0x7f21881438d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f21780b0040 tx=0x7f21780a5840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.541+0000 7f4504c00640 1 -- 172.21.15.17:0/4020993611 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f44fc0046d0 con 0x7f45080ceeb0 2024-09-10T23:20:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c8072b40 con 0x7f25c80af0f0 2024-09-10T23:20:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f4504c00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44e80725e0 0x7f44e8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f4504c00640 1 -- 172.21.15.17:0/4020993611 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f44fc12ded0 con 0x7f45080ceeb0 2024-09-10T23:20:12.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f4507e00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44e80725e0 0x7f44e8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f25be000640 1 -- 172.21.15.17:0/3509872156 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f25c00052e0 con 0x7f25c80af0f0 2024-09-10T23:20:12.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f4507e00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44e80725e0 0x7f44e8074aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f45080b5cd0 tx=0x7f44f40091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f25be000640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25a8072660 0x7f25a8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f25be000640 1 -- 172.21.15.17:0/3509872156 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f25c00931e0 con 0x7f25c80af0f0 2024-09-10T23:20:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f25c5e00640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25a8072660 0x7f25a8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f217f400640 1 -- 172.21.15.17:0/1729991433 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21780b2040 con 0x7f21880b44e0 2024-09-10T23:20:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f217f400640 1 -- 172.21.15.17:0/1729991433 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2178004360 con 0x7f21880b44e0 2024-09-10T23:20:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f217f400640 1 -- 172.21.15.17:0/1729991433 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178005290 con 0x7f21880b44e0 2024-09-10T23:20:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.545+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2188071bb0 con 0x7f21880b44e0 2024-09-10T23:20:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.549+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21880ca6b0 con 0x7f21880b44e0 2024-09-10T23:20:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.549+0000 7f4504c00640 1 -- 172.21.15.17:0/4020993611 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f44fc0b6070 con 0x7f45080ceeb0 2024-09-10T23:20:12.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.549+0000 7f25c5e00640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25a8072660 0x7f25a8074b20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009ab0 tx=0x7f25b80091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.549+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21880c74c0 con 0x7f21880b44e0 2024-09-10T23:20:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.549+0000 7f217f400640 1 -- 172.21.15.17:0/1729991433 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2178005430 con 0x7f21880b44e0 2024-09-10T23:20:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.549+0000 7f25be000640 1 -- 172.21.15.17:0/3509872156 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f25c0020020 con 0x7f25c80af0f0 2024-09-10T23:20:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.553+0000 7f217f400640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2168072630 0x7f2168074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.553+0000 7f217f400640 1 -- 172.21.15.17:0/1729991433 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f217812d5d0 con 0x7f21880b44e0 2024-09-10T23:20:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.553+0000 7f2186a00640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2168072630 0x7f2168074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.553+0000 7f2186a00640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2168072630 0x7f2168074af0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2174007fd0 tx=0x7f21740078e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.557+0000 7f217f400640 1 -- 172.21.15.17:0/1729991433 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2178016490 con 0x7f21880b44e0 2024-09-10T23:20:12.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.593+0000 7f304e400640 1 -- 172.21.15.17:0/859696100 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f304815a9a0 msgr2=0x7f304815ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.593+0000 7f304e400640 1 --2- 172.21.15.17:0/859696100 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f304815a9a0 0x7f304815ad80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f303c0097f0 tx=0x7f303c01c690 comp rx=0 tx=0).stop 2024-09-10T23:20:12.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.593+0000 7f304e400640 1 -- 172.21.15.17:0/859696100 shutdown_connections 2024-09-10T23:20:12.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.593+0000 7f304e400640 1 --2- 172.21.15.17:0/859696100 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f304815a9a0 0x7f304815ad80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.593+0000 7f304e400640 1 -- 172.21.15.17:0/859696100 >> 172.21.15.17:0/859696100 conn(0x7f30480b2740 msgr2=0x7f30480b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:12.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.593+0000 7f304e400640 1 -- 172.21.15.17:0/859696100 shutdown_connections 2024-09-10T23:20:12.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.593+0000 7f304e400640 1 -- 172.21.15.17:0/859696100 wait complete. 2024-09-10T23:20:12.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.593+0000 7f304e400640 1 Processor -- start 2024-09-10T23:20:12.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304e400640 1 -- start start 2024-09-10T23:20:12.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304e400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3048073c30 0x7f30480afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304e400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f304815a9a0 0x7f3048155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304e400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f304815b2c0 0x7f30481f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304e400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3048165dd0 con 0x7f3048073c30 2024-09-10T23:20:12.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304e400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3048165c50 con 0x7f304815a9a0 2024-09-10T23:20:12.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304e400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3048165f50 con 0x7f304815b2c0 2024-09-10T23:20:12.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3048073c30 0x7f30480afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3048073c30 0x7f30480afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42254/0 (socket says 172.21.15.17:42254) 2024-09-10T23:20:12.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304d000640 1 -- 172.21.15.17:0/1175059646 learned_addr learned my addr 172.21.15.17:0/1175059646 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:12.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f3047e00640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f304815a9a0 0x7f3048155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304da00640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f304815b2c0 0x7f30481f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304d000640 1 -- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f304815b2c0 msgr2=0x7f30481f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304d000640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f304815b2c0 0x7f30481f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304d000640 1 -- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f304815a9a0 msgr2=0x7f3048155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304d000640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f304815a9a0 0x7f3048155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304d000640 1 -- 172.21.15.17:0/1175059646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3048158760 con 0x7f3048073c30 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f3047e00640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f304815a9a0 0x7f3048155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304d000640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3048073c30 0x7f30480afcf0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b0040 tx=0x7f303c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f3044c00640 1 -- 172.21.15.17:0/1175059646 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c0b2040 con 0x7f3048073c30 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f3044c00640 1 -- 172.21.15.17:0/1175059646 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f303c0a5570 con 0x7f3048073c30 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30481f4830 con 0x7f3048073c30 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f3044c00640 1 -- 172.21.15.17:0/1175059646 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c003600 con 0x7f3048073c30 2024-09-10T23:20:12.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.597+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30480a9980 con 0x7f3048073c30 2024-09-10T23:20:12.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.601+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f304815ad80 con 0x7f3048073c30 2024-09-10T23:20:12.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.601+0000 7f3044c00640 1 -- 172.21.15.17:0/1175059646 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f303c0b5070 con 0x7f3048073c30 2024-09-10T23:20:12.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.605+0000 7f3044c00640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30280725d0 0x7f3028074a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:12.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.605+0000 7f3044c00640 1 -- 172.21.15.17:0/1175059646 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f303c12d820 con 0x7f3048073c30 2024-09-10T23:20:12.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.605+0000 7f3047e00640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30280725d0 0x7f3028074a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:12.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.605+0000 7f3047e00640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30280725d0 0x7f3028074a90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3048070bb0 tx=0x7f3034009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:12.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.605+0000 7f3044c00640 1 -- 172.21.15.17:0/1175059646 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f303c0c4060 con 0x7f3048073c30 2024-09-10T23:20:12.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.793+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f4508073ee0 con 0x7f45080ceeb0 2024-09-10T23:20:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.793+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f25c8075950 con 0x7f25c80af0f0 2024-09-10T23:20:12.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.801+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f21880d1b20 con 0x7f21880b44e0 2024-09-10T23:20:12.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:12.853+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f30480b4000 con 0x7f3048073c30 2024-09-10T23:20:13.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.693+0000 7f4504c00640 1 -- 172.21.15.17:0/4020993611 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5717 v41) ==== 95+0+0 (secure 0 0 0) 0x7f44fc0164d0 con 0x7f45080ceeb0 2024-09-10T23:20:13.699 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 5717 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44e80725e0 msgr2=0x7f44e8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44e80725e0 0x7f44e8074aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f45080b5cd0 tx=0x7f44f40091e0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45080ceeb0 msgr2=0x7f450813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45080ceeb0 0x7f450813f5d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f44fc01a3f0 tx=0x7f44fc0052f0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 shutdown_connections 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44e80725e0 0x7f44e8074aa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f450815bc70 0x7f45080aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f450815b890 0x7f45080b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 --2- 172.21.15.17:0/4020993611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45080ceeb0 0x7f450813f5d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 >> 172.21.15.17:0/4020993611 conn(0x7f45080b2740 msgr2=0x7f450814f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 shutdown_connections 2024-09-10T23:20:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.697+0000 7f450de00640 1 -- 172.21.15.17:0/4020993611 wait complete. 2024-09-10T23:20:13.712 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:20:13.709+0000 7f039b400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:20:13.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.709+0000 7f217f400640 1 -- 172.21.15.17:0/1729991433 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6100 v42) ==== 95+0+0 (secure 0 0 0) 0x7f21780f8b90 con 0x7f21880b44e0 2024-09-10T23:20:13.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.709+0000 7f3044c00640 1 -- 172.21.15.17:0/1175059646 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6399 v42) ==== 95+0+0 (secure 0 0 0) 0x7f303c016310 con 0x7f3048073c30 2024-09-10T23:20:13.715 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 6100 2024-09-10T23:20:13.715 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 6399 2024-09-10T23:20:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30280725d0 msgr2=0x7f3028074a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30280725d0 0x7f3028074a90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3048070bb0 tx=0x7f3034009040 comp rx=0 tx=0).stop 2024-09-10T23:20:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2168072630 msgr2=0x7f2168074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2168072630 0x7f2168074af0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2174007fd0 tx=0x7f21740078e0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880b44e0 msgr2=0x7f21881438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3048073c30 msgr2=0x7f30480afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3048073c30 0x7f30480afcf0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f303c0b0040 tx=0x7f303c004270 comp rx=0 tx=0).stop 2024-09-10T23:20:13.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880b44e0 0x7f21881438d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f21780b0040 tx=0x7f21780a5840 comp rx=0 tx=0).stop 2024-09-10T23:20:13.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 shutdown_connections 2024-09-10T23:20:13.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30280725d0 0x7f3028074a90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f304815b2c0 0x7f30481f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f304815a9a0 0x7f3048155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 --2- 172.21.15.17:0/1175059646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3048073c30 0x7f30480afcf0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 >> 172.21.15.17:0/1175059646 conn(0x7f30480b2740 msgr2=0x7f30481563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 shutdown_connections 2024-09-10T23:20:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2168072630 0x7f2168074af0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21880d0ec0 0x7f218815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21880c70e0 0x7f2188071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 --2- 172.21.15.17:0/1729991433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21880b44e0 0x7f21881438d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 >> 172.21.15.17:0/1729991433 conn(0x7f21880b39c0 msgr2=0x7f21880b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:13.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 shutdown_connections 2024-09-10T23:20:13.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f304e400640 1 -- 172.21.15.17:0/1175059646 wait complete. 2024-09-10T23:20:13.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 shutdown_connections 2024-09-10T23:20:13.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f218e800640 1 -- 172.21.15.17:0/1729991433 wait complete. 2024-09-10T23:20:13.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.713+0000 7f25be000640 1 -- 172.21.15.17:0/3509872156 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6396 v42) ==== 95+0+0 (secure 0 0 0) 0x7f25c81fb710 con 0x7f25c80af0f0 2024-09-10T23:20:13.721 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 6396 2024-09-10T23:20:13.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25a8072660 msgr2=0x7f25a8074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25a8072660 0x7f25a8074b20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009ab0 tx=0x7f25b80091e0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25c80af0f0 msgr2=0x7f25c80af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25c80af0f0 0x7f25c80af7d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c730 tx=0x7f25c000cbf0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 shutdown_connections 2024-09-10T23:20:13.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25a8072660 0x7f25a8074b20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25c80af0f0 0x7f25c80af7d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c8073860 0x7f25c81fb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 --2- 172.21.15.17:0/3509872156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25c8073480 0x7f25c80c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 >> 172.21.15.17:0/3509872156 conn(0x7f25c80cfd50 msgr2=0x7f25c815d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:13.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 shutdown_connections 2024-09-10T23:20:13.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.717+0000 7f25c7200640 1 -- 172.21.15.17:0/3509872156 wait complete. 2024-09-10T23:20:13.743 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:20:13.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:20:13.747 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:20:13.747 DEBUG:teuthology.parallel:result is None 2024-09-10T23:20:13.748 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:20:13.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:20:13.751 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:20:13.751 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:20:13.752 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:20:13.752 DEBUG:teuthology.parallel:result is None 2024-09-10T23:20:13.753 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:20:13.753 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:20:13.802 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:20:13.802 DEBUG:teuthology.parallel:result is None 2024-09-10T23:20:13.804 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:20:13.804 DEBUG:teuthology.parallel:result is None 2024-09-10T23:20:13.805 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:13.837 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:20:13.841 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:20:13.892 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:20:13.892 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:20:13.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.949+0000 7ff315200640 1 -- 172.21.15.17:0/3103293251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31015bc70 msgr2=0x7ff3100cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.949+0000 7ff315200640 1 --2- 172.21.15.17:0/3103293251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31015bc70 0x7ff3100cfa20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff300009840 tx=0x7ff30001c820 comp rx=0 tx=0).stop 2024-09-10T23:20:13.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.949+0000 7ff315200640 1 -- 172.21.15.17:0/3103293251 shutdown_connections 2024-09-10T23:20:13.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.949+0000 7ff315200640 1 --2- 172.21.15.17:0/3103293251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31015bc70 0x7ff3100cfa20 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.949+0000 7ff315200640 1 -- 172.21.15.17:0/3103293251 >> 172.21.15.17:0/3103293251 conn(0x7ff31009a9f0 msgr2=0x7ff31009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:13.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.949+0000 7ff315200640 1 -- 172.21.15.17:0/3103293251 shutdown_connections 2024-09-10T23:20:13.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.949+0000 7ff315200640 1 -- 172.21.15.17:0/3103293251 wait complete. 2024-09-10T23:20:13.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 Processor -- start 2024-09-10T23:20:13.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 -- start start 2024-09-10T23:20:13.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100cc570 0x7ff3100b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3100d20a0 0x7ff3100af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff31015bc70 0x7ff3101f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff310169ef0 con 0x7ff3100d20a0 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff310169d70 con 0x7ff3100cc570 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff31016a070 con 0x7ff31015bc70 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff306a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3100d20a0 0x7ff3100af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff306a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3100d20a0 0x7ff3100af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42282/0 (socket says 172.21.15.17:42282) 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff306a00640 1 -- 172.21.15.17:0/1023939942 learned_addr learned my addr 172.21.15.17:0/1023939942 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff30f400640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100cc570 0x7ff3100b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff30fe00640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff31015bc70 0x7ff3101f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff306a00640 1 -- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff31015bc70 msgr2=0x7ff3101f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff306a00640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff31015bc70 0x7ff3101f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff306a00640 1 -- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100cc570 msgr2=0x7ff3100b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:13.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff306a00640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100cc570 0x7ff3100b70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:13.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff306a00640 1 -- 172.21.15.17:0/1023939942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3100af750 con 0x7ff3100d20a0 2024-09-10T23:20:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff306a00640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3100d20a0 0x7ff3100af210 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800c4d0 tx=0x7ff2f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff307e00640 1 -- 172.21.15.17:0/1023939942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8016020 con 0x7ff3100d20a0 2024-09-10T23:20:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff307e00640 1 -- 172.21.15.17:0/1023939942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2f8012920 con 0x7ff3100d20a0 2024-09-10T23:20:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff307e00640 1 -- 172.21.15.17:0/1023939942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8012d30 con 0x7ff3100d20a0 2024-09-10T23:20:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3101f6210 con 0x7ff3100d20a0 2024-09-10T23:20:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.953+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3100ae730 con 0x7ff3100d20a0 2024-09-10T23:20:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.957+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3100cfa20 con 0x7ff3100d20a0 2024-09-10T23:20:13.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.957+0000 7ff307e00640 1 -- 172.21.15.17:0/1023939942 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff2f801b400 con 0x7ff3100d20a0 2024-09-10T23:20:13.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.957+0000 7ff307e00640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2ec0725e0 0x7ff2ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:13.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.957+0000 7ff307e00640 1 -- 172.21.15.17:0/1023939942 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6187+0+0 (secure 0 0 0) 0x7ff2f80935e0 con 0x7ff3100d20a0 2024-09-10T23:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.957+0000 7ff30f400640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2ec0725e0 0x7ff2ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.957+0000 7ff30f400640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2ec0725e0 0x7ff2ec074aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3000af000 tx=0x7ff30001b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:13.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:13.961+0000 7ff307e00640 1 -- 172.21.15.17:0/1023939942 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff2f8020020 con 0x7ff3100d20a0 2024-09-10T23:20:14.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.169+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff31015b510 con 0x7ff3100d20a0 2024-09-10T23:20:14.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.169+0000 7ff307e00640 1 -- 172.21.15.17:0/1023939942 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+1910 (secure 0 0 0) 0x7ff2f805e3f0 con 0x7ff3100d20a0 2024-09-10T23:20:14.176 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:14.176 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":42,"btime":"2024-09-10T23:20:13:713032+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:13.713027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-10T23:20:14.176 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 42 2024-09-10T23:20:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2ec0725e0 msgr2=0x7ff2ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2ec0725e0 0x7ff2ec074aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff3000af000 tx=0x7ff30001b060 comp rx=0 tx=0).stop 2024-09-10T23:20:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3100d20a0 msgr2=0x7ff3100af210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3100d20a0 0x7ff3100af210 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800c4d0 tx=0x7ff2f800c990 comp rx=0 tx=0).stop 2024-09-10T23:20:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 shutdown_connections 2024-09-10T23:20:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2ec0725e0 0x7ff2ec074aa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff31015bc70 0x7ff3101f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3100d20a0 0x7ff3100af210 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 --2- 172.21.15.17:0/1023939942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100cc570 0x7ff3100b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 >> 172.21.15.17:0/1023939942 conn(0x7ff31009a9f0 msgr2=0x7ff310157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 shutdown_connections 2024-09-10T23:20:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:14.173+0000 7ff315200640 1 -- 172.21.15.17:0/1023939942 wait complete. 2024-09-10T23:20:14.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:19:54.687197+0000', 'modified': '2024-09-10T23:20:13.713027+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:20:14.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-10T23:20:15.601 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 -- 172.21.15.17:0/3945822264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4160280 msgr2=0x7fcbd40cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 --2- 172.21.15.17:0/3945822264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4160280 0x7fcbd40cfaf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009840 tx=0x7fcbc401f010 comp rx=0 tx=0).stop 2024-09-10T23:20:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 -- 172.21.15.17:0/3945822264 shutdown_connections 2024-09-10T23:20:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 --2- 172.21.15.17:0/3945822264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbd4160660 0x7fcbd40d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:15.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 --2- 172.21.15.17:0/3945822264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4160280 0x7fcbd40cfaf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:15.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 -- 172.21.15.17:0/3945822264 >> 172.21.15.17:0/3945822264 conn(0x7fcbd40d1d10 msgr2=0x7fcbd40d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:15.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 -- 172.21.15.17:0/3945822264 shutdown_connections 2024-09-10T23:20:15.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 -- 172.21.15.17:0/3945822264 wait complete. 2024-09-10T23:20:15.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 Processor -- start 2024-09-10T23:20:15.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.757+0000 7fcbdb200640 1 -- start start 2024-09-10T23:20:15.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbdb200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd40d2830 0x7fcbd4158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:15.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbdb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4160280 0x7fcbd40c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:15.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbdb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbd4160660 0x7fcbd415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbdb200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd40afe30 con 0x7fcbd4160280 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbdb200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd40afcb0 con 0x7fcbd40d2830 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbdb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd40affb0 con 0x7fcbd4160660 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbcbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4160280 0x7fcbd40c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbcbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4160280 0x7fcbd40c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42296/0 (socket says 172.21.15.17:42296) 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbcbe00640 1 -- 172.21.15.17:0/3822468562 learned_addr learned my addr 172.21.15.17:0/3822468562 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbd3e00640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd40d2830 0x7fcbd4158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbd9200640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbd4160660 0x7fcbd415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbcbe00640 1 -- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbd4160660 msgr2=0x7fcbd415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbcbe00640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbd4160660 0x7fcbd415dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbcbe00640 1 -- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd40d2830 msgr2=0x7fcbd4158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbcbe00640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd40d2830 0x7fcbd4158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:15.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbcbe00640 1 -- 172.21.15.17:0/3822468562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd40ce470 con 0x7fcbd4160280 2024-09-10T23:20:15.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbd3e00640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd40d2830 0x7fcbd4158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:15.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbcbe00640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4160280 0x7fcbd40c7260 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00c500 tx=0x7fcbbc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:15.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbd0c00640 1 -- 172.21.15.17:0/3822468562 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc017070 con 0x7fcbd4160280 2024-09-10T23:20:15.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbd0c00640 1 -- 172.21.15.17:0/3822468562 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbbc0053c0 con 0x7fcbd4160280 2024-09-10T23:20:15.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbd0c00640 1 -- 172.21.15.17:0/3822468562 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc012890 con 0x7fcbd4160280 2024-09-10T23:20:15.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd41f84c0 con 0x7fcbd4160280 2024-09-10T23:20:15.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd41f8a80 con 0x7fcbd4160280 2024-09-10T23:20:15.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.761+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd40b04d0 con 0x7fcbd4160280 2024-09-10T23:20:15.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.765+0000 7fcbd0c00640 1 -- 172.21.15.17:0/3822468562 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcbbc003600 con 0x7fcbd4160280 2024-09-10T23:20:15.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.765+0000 7fcbd0c00640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcbb00725e0 0x7fcbb0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:15.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.765+0000 7fcbd0c00640 1 -- 172.21.15.17:0/3822468562 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6187+0+0 (secure 0 0 0) 0x7fcbbc092960 con 0x7fcbd4160280 2024-09-10T23:20:15.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.765+0000 7fcbd3e00640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcbb00725e0 0x7fcbb0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:15.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.765+0000 7fcbd3e00640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcbb00725e0 0x7fcbb0074aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40b2000 tx=0x7fcbc401d850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:15.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.769+0000 7fcbd0c00640 1 -- 172.21.15.17:0/3822468562 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcbbc05d820 con 0x7fcbd4160280 2024-09-10T23:20:15.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbd4074af0 con 0x7fcbd4160280 2024-09-10T23:20:15.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbd0c00640 1 -- 172.21.15.17:0/3822468562 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5218 (secure 0 0 0) 0x7fcbbc062250 con 0x7fcbd4160280 2024-09-10T23:20:15.981 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:15.981 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":45,"btime":"2024-09-10T23:20:15:723254+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:14.736357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"a","rank":0,"incarnation":44,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.17:6835/2034416577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2034416577},{"type":"v1","addr":"172.21.15.17:6835","nonce":2034416577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-10T23:20:15.981 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 45 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcbb00725e0 msgr2=0x7fcbb0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcbb00725e0 0x7fcbb0074aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40b2000 tx=0x7fcbc401d850 comp rx=0 tx=0).stop 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4160280 msgr2=0x7fcbd40c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4160280 0x7fcbd40c7260 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00c500 tx=0x7fcbbc00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 shutdown_connections 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcbb00725e0 0x7fcbb0074aa0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcbd4160660 0x7fcbd415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4160280 0x7fcbd40c7260 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 --2- 172.21.15.17:0/3822468562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd40d2830 0x7fcbd4158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:15.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 >> 172.21.15.17:0/3822468562 conn(0x7fcbd40d1d10 msgr2=0x7fcbd40b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:15.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 shutdown_connections 2024-09-10T23:20:15.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:15.977+0000 7fcbdb200640 1 -- 172.21.15.17:0/3822468562 wait complete. 2024-09-10T23:20:16.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:19:54.687197+0000', 'modified': '2024-09-10T23:20:14.736357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6322': {'gid': 6322, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.17:6835/2034416577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 2034416577}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2034416577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:20:16.405 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6322:up:reconnect 2024-09-10T23:20:17.406 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:17.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 -- 172.21.15.17:0/3441562549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 msgr2=0x7f85a4166800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:17.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 --2- 172.21.15.17:0/3441562549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 0x7f85a4166800 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f859c009c80 tx=0x7f859c01cd10 comp rx=0 tx=0).stop 2024-09-10T23:20:17.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 -- 172.21.15.17:0/3441562549 shutdown_connections 2024-09-10T23:20:17.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 --2- 172.21.15.17:0/3441562549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 0x7f85a4166800 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:17.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 -- 172.21.15.17:0/3441562549 >> 172.21.15.17:0/3441562549 conn(0x7f85a409a9f0 msgr2=0x7f85a409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:17.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 -- 172.21.15.17:0/3441562549 shutdown_connections 2024-09-10T23:20:17.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 -- 172.21.15.17:0/3441562549 wait complete. 2024-09-10T23:20:17.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 Processor -- start 2024-09-10T23:20:17.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 -- start start 2024-09-10T23:20:17.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 0x7f85a4151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85a415ee30 0x7f85a415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85a415f210 0x7f85a4155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4169f80 con 0x7f85a40b14f0 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4169e00 con 0x7f85a415f210 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a8e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f85a416a100 con 0x7f85a415ee30 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 0x7f85a4151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 0x7f85a4151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43026/0 (socket says 172.21.15.17:43026) 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a3400640 1 -- 172.21.15.17:0/1340547272 learned_addr learned my addr 172.21.15.17:0/1340547272 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f859be00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85a415ee30 0x7f85a415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.561+0000 7f85a3e00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85a415f210 0x7f85a4155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f85a3400640 1 -- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85a415ee30 msgr2=0x7f85a415a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f85a3400640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85a415ee30 0x7f85a415a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f85a3400640 1 -- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85a415f210 msgr2=0x7f85a4155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f85a3400640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85a415f210 0x7f85a4155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f85a3400640 1 -- 172.21.15.17:0/1340547272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a4164c60 con 0x7f85a40b14f0 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f85a3400640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 0x7f85a4151080 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f859400c4e0 tx=0x7f859400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f859b400640 1 -- 172.21.15.17:0/1340547272 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940052d0 con 0x7f85a40b14f0 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a4164f40 con 0x7f85a40b14f0 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f859b400640 1 -- 172.21.15.17:0/1340547272 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8594005470 con 0x7f85a40b14f0 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f859b400640 1 -- 172.21.15.17:0/1340547272 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594012890 con 0x7f85a40b14f0 2024-09-10T23:20:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a4165500 con 0x7f85a40b14f0 2024-09-10T23:20:17.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a415f680 con 0x7f85a40b14f0 2024-09-10T23:20:17.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f859b400640 1 -- 172.21.15.17:0/1340547272 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8594003600 con 0x7f85a40b14f0 2024-09-10T23:20:17.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f859b400640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8580072610 0x7f8580074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:17.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.565+0000 7f859b400640 1 -- 172.21.15.17:0/1340547272 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6187+0+0 (secure 0 0 0) 0x7f8594092e50 con 0x7f85a40b14f0 2024-09-10T23:20:17.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.569+0000 7f859be00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8580072610 0x7f8580074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:17.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.569+0000 7f859be00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8580072610 0x7f8580074ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f85a4165b30 tx=0x7f858c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:17.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.569+0000 7f859b400640 1 -- 172.21.15.17:0/1340547272 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f859405dcf0 con 0x7f85a40b14f0 2024-09-10T23:20:17.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85a40b33b0 con 0x7f85a40b14f0 2024-09-10T23:20:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f859b400640 1 -- 172.21.15.17:0/1340547272 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f8594062720 con 0x7f85a40b14f0 2024-09-10T23:20:17.801 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:17.801 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"btime":"2024-09-10T23:20:17:731093+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:17.731089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2034416577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2034416577},{"type":"v1","addr":"172.21.15.17:6835","nonce":2034416577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6322,"qdb_cluster":[6322]},"id":4}]} 2024-09-10T23:20:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 47 2024-09-10T23:20:17.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8580072610 msgr2=0x7f8580074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:17.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8580072610 0x7f8580074ad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f85a4165b30 tx=0x7f858c009040 comp rx=0 tx=0).stop 2024-09-10T23:20:17.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 msgr2=0x7f85a4151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 0x7f85a4151080 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f859400c4e0 tx=0x7f859400c9a0 comp rx=0 tx=0).stop 2024-09-10T23:20:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 shutdown_connections 2024-09-10T23:20:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8580072610 0x7f8580074ad0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85a415f210 0x7f85a4155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85a415ee30 0x7f85a415a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 --2- 172.21.15.17:0/1340547272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85a40b14f0 0x7f85a4151080 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 >> 172.21.15.17:0/1340547272 conn(0x7f85a409a9f0 msgr2=0x7f85a4070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 shutdown_connections 2024-09-10T23:20:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:17.797+0000 7f85a8e00640 1 -- 172.21.15.17:0/1340547272 wait complete. 2024-09-10T23:20:18.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:19:54.687197+0000', 'modified': '2024-09-10T23:20:17.731089+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 74, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6322': {'gid': 6322, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.17:6835/2034416577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 2034416577}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2034416577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6322, 'qdb_cluster': [6322]} 2024-09-10T23:20:18.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:20:18.227 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:20:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.373+0000 7f5c8d200640 1 -- 172.21.15.17:0/662708974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c8815d7d0 msgr2=0x7f5c8815dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.373+0000 7f5c8d200640 1 --2- 172.21.15.17:0/662708974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c8815d7d0 0x7f5c8815dde0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009840 tx=0x7f5c7801c760 comp rx=0 tx=0).stop 2024-09-10T23:20:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.373+0000 7f5c8d200640 1 -- 172.21.15.17:0/662708974 shutdown_connections 2024-09-10T23:20:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.373+0000 7f5c8d200640 1 --2- 172.21.15.17:0/662708974 >> v2:172.21.15.77:3300/0 conn(0x7f5c880cf090 0x7f5c8815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.373+0000 7f5c8d200640 1 --2- 172.21.15.17:0/662708974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c8815d7d0 0x7f5c8815dde0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.373+0000 7f5c8d200640 1 -- 172.21.15.17:0/662708974 >> 172.21.15.17:0/662708974 conn(0x7f5c880b1730 msgr2=0x7f5c880b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.373+0000 7f5c8d200640 1 -- 172.21.15.17:0/662708974 shutdown_connections 2024-09-10T23:20:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.373+0000 7f5c8d200640 1 -- 172.21.15.17:0/662708974 wait complete. 2024-09-10T23:20:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c8d200640 1 Processor -- start 2024-09-10T23:20:18.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c8d200640 1 -- start start 2024-09-10T23:20:18.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c8d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c880cf090 0x7f5c880afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c8d200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c8815d7d0 0x7f5c881f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c8d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c8815e860 0x7f5c881f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c8d200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c88073560 con 0x7f5c8815e860 2024-09-10T23:20:18.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c8d200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c880733e0 con 0x7f5c8815d7d0 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c8d200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5c88165170 con 0x7f5c880cf090 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c86800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c8815e860 0x7f5c881f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c86800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c8815e860 0x7f5c881f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43038/0 (socket says 172.21.15.17:43038) 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c86800640 1 -- 172.21.15.17:0/43727067 learned_addr learned my addr 172.21.15.17:0/43727067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c85e00640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c880cf090 0x7f5c880afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c8815d7d0 0x7f5c881f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c86800640 1 -- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c880cf090 msgr2=0x7f5c880afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c86800640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c880cf090 0x7f5c880afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c86800640 1 -- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c8815d7d0 msgr2=0x7f5c881f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c86800640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c8815d7d0 0x7f5c881f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c86800640 1 -- 172.21.15.17:0/43727067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c881f6350 con 0x7f5c8815e860 2024-09-10T23:20:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c86800640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c8815e860 0x7f5c881f5d20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000cb10 tx=0x7f5c8000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.377+0000 7f5c7e000640 1 -- 172.21.15.17:0/43727067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c80016020 con 0x7f5c8815e860 2024-09-10T23:20:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c7e000640 1 -- 172.21.15.17:0/43727067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c8000ce50 con 0x7f5c8815e860 2024-09-10T23:20:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c8d200640 1 -- 172.21.15.17:0/43727067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c881f6630 con 0x7f5c8815e860 2024-09-10T23:20:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c7e000640 1 -- 172.21.15.17:0/43727067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000ae00 con 0x7f5c8815e860 2024-09-10T23:20:18.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c8d200640 1 -- 172.21.15.17:0/43727067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c8814be50 con 0x7f5c8815e860 2024-09-10T23:20:18.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c7e000640 1 -- 172.21.15.17:0/43727067 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5c80012420 con 0x7f5c8815e860 2024-09-10T23:20:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c7e000640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c640725e0 0x7f5c64074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c7e000640 1 -- 172.21.15.17:0/43727067 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6332+0+0 (secure 0 0 0) 0x7f5c80093a30 con 0x7f5c8815e860 2024-09-10T23:20:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c90699000 1 Processor -- start 2024-09-10T23:20:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c85e00640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c640725e0 0x7f5c64074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.381+0000 7f5c90699000 1 -- start start 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c85e00640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c640725e0 0x7f5c64074aa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5c780af000 tx=0x7f5c7801afa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572a9d0 0x557d0572adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572b2f0 0x557d056de8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d056df1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557d055ff3f0 con 0x557d0572b2f0 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557d0553cb20 con 0x557d056dee10 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557d0552bf50 con 0x557d0572a9d0 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572b2f0 0x557d056de8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572b2f0 0x557d056de8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43046/0 (socket says 172.21.15.17:43046) 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c7fe00640 1 -- 172.21.15.17:0/3410281721 learned_addr learned my addr 172.21.15.17:0/3410281721 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c86800640 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d056df1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c85e00640 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572a9d0 0x557d0572adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c7fe00640 1 -- 172.21.15.17:0/3410281721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572a9d0 msgr2=0x557d0572adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572a9d0 0x557d0572adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c7fe00640 1 -- 172.21.15.17:0/3410281721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 msgr2=0x557d056df1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d056df1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c7fe00640 1 -- 172.21.15.17:0/3410281721 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d054f3590 con 0x557d0572b2f0 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c85e00640 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572a9d0 0x557d0572adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572b2f0 0x557d056de8d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009c30 tx=0x7f5c70011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d74b4203beb1ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c76a00640 1 -- 172.21.15.17:0/3410281721 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70004230 con 0x557d0572b2f0 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c76a00640 1 -- 172.21.15.17:0/3410281721 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c700043d0 con 0x557d0572b2f0 2024-09-10T23:20:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c76a00640 1 -- 172.21.15.17:0/3410281721 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70003860 con 0x557d0572b2f0 2024-09-10T23:20:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 -- 172.21.15.17:0/3410281721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572b2f0 msgr2=0x557d056de8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572b2f0 0x557d056de8d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009c30 tx=0x7f5c70011810 comp rx=0 tx=0).stop 2024-09-10T23:20:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 -- 172.21.15.17:0/3410281721 shutdown_connections 2024-09-10T23:20:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d056df1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572b2f0 0x557d056de8d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 --2- 172.21.15.17:0/3410281721 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572a9d0 0x557d0572adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 -- 172.21.15.17:0/3410281721 >> 172.21.15.17:0/3410281721 conn(0x557d055c8130 msgr2=0x557d0570de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 -- 172.21.15.17:0/3410281721 shutdown_connections 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 -- 172.21.15.17:0/3410281721 wait complete. 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 -- start start 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.385+0000 7f5c90699000 1 Processor -- start 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d056e0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d056e0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d056e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557d054c65d0 con 0x557d0572a9d0 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557d0552fd60 con 0x557d056dee10 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557d054d2500 con 0x557d0572b2f0 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 10 client.0 _ll_register_callbacks cb 0x557d054d6810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d056e0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d056e0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43050/0 (socket says 172.21.15.17:43050) 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c7fe00640 1 -- 172.21.15.17:0/3279625943 learned_addr learned my addr 172.21.15.17:0/3279625943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c86800640 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d056e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c85e00640 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d056e0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c7fe00640 1 -- 172.21.15.17:0/3279625943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 msgr2=0x557d056e0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d056e0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c7fe00640 1 -- 172.21.15.17:0/3279625943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 msgr2=0x557d056e0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d056e0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c7fe00640 1 -- 172.21.15.17:0/3279625943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d054ca170 con 0x557d0572a9d0 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d056e0780 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x557d054dd130 tx=0x7f5c70003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe55a20356b21ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c6b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c6b400640 1 -- 172.21.15.17:0/3279625943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70009ea0 con 0x557d0572a9d0 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c6b400640 1 -- 172.21.15.17:0/3279625943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6332+0+0 (secure 0 0 0) 0x7f5c70003db0 con 0x557d0572a9d0 2024-09-10T23:20:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 -- 172.21.15.17:0/3279625943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d054c40f0 con 0x557d0572a9d0 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c6b400640 1 -- 172.21.15.17:0/3279625943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f5c70031050 con 0x557d0572a9d0 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 10 client.6675 fetch_fsmap learned FSMap version 47 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 -- 172.21.15.17:0/3279625943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x557d055b0ef0 con 0x557d0572a9d0 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c6b400640 1 -- 172.21.15.17:0/3279625943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557d054c40f0 con 0x557d0572a9d0 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c6b400640 1 -- 172.21.15.17:0/3279625943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f5c70034020 con 0x557d0572a9d0 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 10 client.6675 fetch_fsmap finished waiting for FSMap version 47 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 10 client.6675 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 20 client.6675 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x557d05739c70 0x557d0573c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 4 client.6675 mds_command: new command op to 6322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c90699000 1 -- 172.21.15.17:0/3279625943 --> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d0553ea70 con 0x557d05739c70 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c85e00640 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x557d05739c70 0x557d0573c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c85e00640 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x557d05739c70 0x557d0573c060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a904e58c5ce3faad server_cookie=13a0a64fe18b58e9 in_seq=0 out_seq=0 2024-09-10T23:20:18.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.389+0000 7f5c6b400640 10 client.6675 ms_handle_connect on v2:172.21.15.17:6833/2034416577 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c6b400640 1 -- 172.21.15.17:0/3279625943 <== mds.0 v2:172.21.15.17:6833/2034416577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d0553ea70 con 0x557d05739c70 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c6b400640 10 client.6675 handle_command_reply: tid=0 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 client.6675 shutdown 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 -- 172.21.15.17:0/3279625943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 msgr2=0x557d056e0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d056e0780 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x557d054dd130 tx=0x7f5c70003830 comp rx=0 tx=0).stop 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 -- 172.21.15.17:0/3279625943 shutdown_connections 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d056e0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x557d05739c70 0x557d0573c060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c6b400640 0 client.6675 ms_handle_reset on v2:172.21.15.17:6833/2034416577 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d056e0780 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 --2- 172.21.15.17:0/3279625943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d056e0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 -- 172.21.15.17:0/3279625943 >> 172.21.15.17:0/3279625943 conn(0x557d055c8130 msgr2=0x557d056ddfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 -- 172.21.15.17:0/3279625943 shutdown_connections 2024-09-10T23:20:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 1 -- 172.21.15.17:0/3279625943 wait complete. 2024-09-10T23:20:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.393+0000 7f5c90699000 20 client.6675 trim_cache size 0 max 16384 2024-09-10T23:20:18.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.409+0000 7f5c90699000 1 Processor -- start 2024-09-10T23:20:18.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.409+0000 7f5c90699000 1 -- start start 2024-09-10T23:20:18.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d057a0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d057a1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c88202900 con 0x557d0572a9d0 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c882018e0 con 0x557d056dee10 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8815c8b0 con 0x557d0572b2f0 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43060/0 (socket says 172.21.15.17:43060) 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c7fe00640 1 -- 172.21.15.17:0/2207712267 learned_addr learned my addr 172.21.15.17:0/2207712267 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c86800640 1 --2- 172.21.15.17:0/2207712267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d057a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c85e00640 1 --2- 172.21.15.17:0/2207712267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d057a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c7fe00640 1 -- 172.21.15.17:0/2207712267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 msgr2=0x557d057a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/2207712267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d057a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c7fe00640 1 -- 172.21.15.17:0/2207712267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 msgr2=0x557d057a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:18.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/2207712267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d057a0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c7fe00640 1 -- 172.21.15.17:0/2207712267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d05587d90 con 0x557d0572a9d0 2024-09-10T23:20:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/2207712267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a0e40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5c700046d0 tx=0x7f5c700092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc36255a1cff12f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c76000640 1 -- 172.21.15.17:0/2207712267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7003a070 con 0x557d0572a9d0 2024-09-10T23:20:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c76000640 1 -- 172.21.15.17:0/2207712267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c70000e50 con 0x557d0572a9d0 2024-09-10T23:20:18.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c76000640 1 -- 172.21.15.17:0/2207712267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7001e070 con 0x557d0572a9d0 2024-09-10T23:20:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 -- 172.21.15.17:0/2207712267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 msgr2=0x557d057a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 --2- 172.21.15.17:0/2207712267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a0e40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5c700046d0 tx=0x7f5c700092d0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 -- 172.21.15.17:0/2207712267 shutdown_connections 2024-09-10T23:20:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 --2- 172.21.15.17:0/2207712267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d057a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 --2- 172.21.15.17:0/2207712267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a0e40 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 --2- 172.21.15.17:0/2207712267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d057a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 -- 172.21.15.17:0/2207712267 >> 172.21.15.17:0/2207712267 conn(0x557d055c8130 msgr2=0x557d05741e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 -- 172.21.15.17:0/2207712267 shutdown_connections 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 -- 172.21.15.17:0/2207712267 wait complete. 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 -- start start 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.413+0000 7f5c90699000 1 Processor -- start 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d057a4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d0575f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557d054f7ec0 con 0x557d0572a9d0 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c88201230 con 0x557d056dee10 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557d0553b8f0 con 0x557d0572b2f0 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 10 client.0 _ll_register_callbacks cb 0x7f5c70009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43068/0 (socket says 172.21.15.17:43068) 2024-09-10T23:20:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c7fe00640 1 -- 172.21.15.17:0/1140796942 learned_addr learned my addr 172.21.15.17:0/1140796942 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c85e00640 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d057a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c86800640 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d0575f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c7fe00640 1 -- 172.21.15.17:0/1140796942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 msgr2=0x557d0575f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d0575f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c7fe00640 1 -- 172.21.15.17:0/1140796942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 msgr2=0x557d057a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d057a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c7fe00640 1 -- 172.21.15.17:0/1140796942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d054f2a90 con 0x557d0572a9d0 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c85e00640 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d057a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c7fe00640 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a4d60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009390 tx=0x7f5c70003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c4ed50645f9476 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 1 -- 172.21.15.17:0/1140796942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7003a070 con 0x557d0572a9d0 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 1 -- 172.21.15.17:0/1140796942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6332+0+0 (secure 0 0 0) 0x7f5c7002c8f0 con 0x557d0572a9d0 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- 172.21.15.17:0/1140796942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c70000e50 con 0x557d0572a9d0 2024-09-10T23:20:18.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 1 -- 172.21.15.17:0/1140796942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f5c70042050 con 0x557d0572a9d0 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 10 client.6681 fetch_fsmap learned FSMap version 47 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- 172.21.15.17:0/1140796942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x557d054d1050 con 0x557d0572a9d0 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 1 -- 172.21.15.17:0/1140796942 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c70000e50 con 0x557d0572a9d0 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 1 -- 172.21.15.17:0/1140796942 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f5c70045020 con 0x557d0572a9d0 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 10 client.6681 fetch_fsmap finished waiting for FSMap version 47 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 10 client.6681 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 20 client.6681 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x557d0575fdb0 0x557d05760190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 4 client.6681 mds_command: new command op to 6322 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- 172.21.15.17:0/1140796942 --> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] -- command(tid 0: {"prefix": "status"}) -- 0x557d0553a520 con 0x557d0575fdb0 2024-09-10T23:20:18.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c85e00640 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x557d0575fdb0 0x557d05760190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c85e00640 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x557d0575fdb0 0x557d05760190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41c6fd7bd73e0a9 server_cookie=f54b372064f75ea4 in_seq=0 out_seq=0 2024-09-10T23:20:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 10 client.6681 ms_handle_connect on v2:172.21.15.17:6833/2034416577 2024-09-10T23:20:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 1 -- 172.21.15.17:0/1140796942 <== mds.0 v2:172.21.15.17:6833/2034416577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x557d0553a520 con 0x557d0575fdb0 2024-09-10T23:20:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 10 client.6681 handle_command_reply: tid=0 2024-09-10T23:20:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 client.6681 shutdown 2024-09-10T23:20:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- 172.21.15.17:0/1140796942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 msgr2=0x557d057a4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a4d60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009390 tx=0x7f5c70003f90 comp rx=0 tx=0).stop 2024-09-10T23:20:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- 172.21.15.17:0/1140796942 shutdown_connections 2024-09-10T23:20:18.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557d0572b2f0 0x557d0575f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x557d0575fdb0 0x557d05760190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d0572a9d0 0x557d057a4d60 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 --2- 172.21.15.17:0/1140796942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557d056dee10 0x557d057a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c6b400640 0 client.6681 ms_handle_reset on v2:172.21.15.17:6833/2034416577 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- 172.21.15.17:0/1140796942 >> 172.21.15.17:0/1140796942 conn(0x557d055c8130 msgr2=0x557d056de470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- 172.21.15.17:0/1140796942 shutdown_connections 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 1 -- 172.21.15.17:0/1140796942 wait complete. 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.417+0000 7f5c90699000 20 client.6681 trim_cache size 0 max 16384 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:20:18.428 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 6322, 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 3.695953936, 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 47, 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 75, 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 74, 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 4.5270764650000004 2024-09-10T23:20:18.429 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:20:18.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 -- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c640725e0 msgr2=0x7f5c64074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c640725e0 0x7f5c64074aa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5c780af000 tx=0x7f5c7801afa0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 -- 172.21.15.17:0/43727067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c8815e860 msgr2=0x7f5c881f5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c8815e860 0x7f5c881f5d20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000cb10 tx=0x7f5c8000cc00 comp rx=0 tx=0).stop 2024-09-10T23:20:18.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 -- 172.21.15.17:0/43727067 shutdown_connections 2024-09-10T23:20:18.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c640725e0 0x7f5c64074aa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c8815e860 0x7f5c881f5d20 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c8815d7d0 0x7f5c881f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 --2- 172.21.15.17:0/43727067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c880cf090 0x7f5c880afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 -- 172.21.15.17:0/43727067 >> 172.21.15.17:0/43727067 conn(0x7f5c880b1730 msgr2=0x7f5c880b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:18.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 -- 172.21.15.17:0/43727067 shutdown_connections 2024-09-10T23:20:18.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.421+0000 7f5c8d200640 1 -- 172.21.15.17:0/43727067 wait complete. 2024-09-10T23:20:18.442 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-10T23:20:18.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 -- 172.21.15.17:0/1090373025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb570004d50 msgr2=0x7fb5700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 --2- 172.21.15.17:0/1090373025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb570004d50 0x7fb5700051d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fb58400e3d0 tx=0x7fb58401d750 comp rx=0 tx=0).stop 2024-09-10T23:20:18.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb58a800640 1 -- 172.21.15.17:0/1090373025 reap_dead start 2024-09-10T23:20:18.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 -- 172.21.15.17:0/1090373025 shutdown_connections 2024-09-10T23:20:18.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 -- 172.21.15.17:0/1090373025 >> 172.21.15.17:0/1090373025 conn(0x7fb58c09a9f0 msgr2=0x7fb58c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:18.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 -- 172.21.15.17:0/1090373025 shutdown_connections 2024-09-10T23:20:18.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 -- 172.21.15.17:0/1090373025 wait complete. 2024-09-10T23:20:18.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 Processor -- start 2024-09-10T23:20:18.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 -- start start 2024-09-10T23:20:18.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb570004d50 0x7fb58c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb58c0ce6d0 0x7fb58c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb58c0cc6e0 0x7fb58c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c0d2bf0 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c0d2a70 con 0x7fb570004d50 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb591200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb58c15c680 con 0x7fb58c0ce6d0 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb58a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb58c0cc6e0 0x7fb58c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb58a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb58c0cc6e0 0x7fb58c0ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43090/0 (socket says 172.21.15.17:43090) 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb58a800640 1 -- 172.21.15.17:0/2244182341 learned_addr learned my addr 172.21.15.17:0/2244182341 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb589e00640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb570004d50 0x7fb58c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.589+0000 7fb581400640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb58c0ce6d0 0x7fb58c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb58a800640 1 -- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb58c0ce6d0 msgr2=0x7fb58c0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb58a800640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb58c0ce6d0 0x7fb58c0ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb58a800640 1 -- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb570004d50 msgr2=0x7fb58c1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb58a800640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb570004d50 0x7fb58c1584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb58a800640 1 -- 172.21.15.17:0/2244182341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58c0c5f50 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb58a800640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb58c0cc6e0 0x7fb58c0ccb60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb5840b0040 tx=0x7fb5840a8c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb582a00640 1 -- 172.21.15.17:0/2244182341 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5840b2040 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb582a00640 1 -- 172.21.15.17:0/2244182341 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb584009800 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb582a00640 1 -- 172.21.15.17:0/2244182341 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584009c80 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58c0cf220 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58c0c64d0 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb58c0b12e0 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb582a00640 1 -- 172.21.15.17:0/2244182341 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb5840a8cd0 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.593+0000 7fb582a00640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5680725e0 0x7fb568074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.597+0000 7fb582a00640 1 -- 172.21.15.17:0/2244182341 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6332+0+0 (secure 0 0 0) 0x7fb58412dba0 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.597+0000 7fb589e00640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5680725e0 0x7fb568074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.597+0000 7fb589e00640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5680725e0 0x7fb568074aa0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb57c001060 tx=0x7fb57c0011f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.601+0000 7fb582a00640 1 -- 172.21.15.17:0/2244182341 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb5840c6020 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.781+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fb58c0b7b60 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.785+0000 7fb582a00640 1 -- 172.21.15.17:0/2244182341 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v36)=0 v36) ==== 118+0+0 (secure 0 0 0) 0x7fb584017460 con 0x7fb58c0cc6e0 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5680725e0 msgr2=0x7fb568074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5680725e0 0x7fb568074aa0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb57c001060 tx=0x7fb57c0011f0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb58c0cc6e0 msgr2=0x7fb58c0ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb58c0cc6e0 0x7fb58c0ccb60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb5840b0040 tx=0x7fb5840a8c60 comp rx=0 tx=0).stop 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 shutdown_connections 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5680725e0 0x7fb568074aa0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb58c0cc6e0 0x7fb58c0ccb60 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb58c0ce6d0 0x7fb58c0ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 --2- 172.21.15.17:0/2244182341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb570004d50 0x7fb58c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 >> 172.21.15.17:0/2244182341 conn(0x7fb58c09a9f0 msgr2=0x7fb58c15df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 shutdown_connections 2024-09-10T23:20:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.789+0000 7fb591200640 1 -- 172.21.15.17:0/2244182341 wait complete. 2024-09-10T23:20:18.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-09-10T23:20:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.957+0000 7fd6f0800640 1 -- 172.21.15.17:0/2433521642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e815be00 msgr2=0x7fd6e815d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.957+0000 7fd6f0800640 1 --2- 172.21.15.17:0/2433521642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e815be00 0x7fd6e815d4f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009900 tx=0x7fd6dc01c8b0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.957+0000 7fd6f0800640 1 -- 172.21.15.17:0/2433521642 shutdown_connections 2024-09-10T23:20:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.957+0000 7fd6f0800640 1 --2- 172.21.15.17:0/2433521642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6e80b12e0 0x7fd6e80cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.957+0000 7fd6f0800640 1 --2- 172.21.15.17:0/2433521642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e815be00 0x7fd6e815d4f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.957+0000 7fd6f0800640 1 -- 172.21.15.17:0/2433521642 >> 172.21.15.17:0/2433521642 conn(0x7fd6e809a9f0 msgr2=0x7fd6e809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.957+0000 7fd6f0800640 1 -- 172.21.15.17:0/2433521642 shutdown_connections 2024-09-10T23:20:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.957+0000 7fd6f0800640 1 -- 172.21.15.17:0/2433521642 wait complete. 2024-09-10T23:20:18.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.957+0000 7fd6f0800640 1 Processor -- start 2024-09-10T23:20:18.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 -- start start 2024-09-10T23:20:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6e80b12e0 0x7fd6e813fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e80b1740 0x7fd6e814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6e815be00 0x7fd6e814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e81694d0 con 0x7fd6e80b1740 2024-09-10T23:20:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e815d2e0 con 0x7fd6e815be00 2024-09-10T23:20:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e8169650 con 0x7fd6e80b12e0 2024-09-10T23:20:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ed400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e80b1740 0x7fd6e814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ed400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e80b1740 0x7fd6e814def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43100/0 (socket says 172.21.15.17:43100) 2024-09-10T23:20:18.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ed400640 1 -- 172.21.15.17:0/177723704 learned_addr learned my addr 172.21.15.17:0/177723704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ede00640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6e80b12e0 0x7fd6e813fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ed400640 1 -- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6e80b12e0 msgr2=0x7fd6e813fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ed400640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6e80b12e0 0x7fd6e813fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ee800640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6e815be00 0x7fd6e814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ed400640 1 -- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6e815be00 msgr2=0x7fd6e814e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ed400640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6e815be00 0x7fd6e814e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ed400640 1 -- 172.21.15.17:0/177723704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e80cf410 con 0x7fd6e80b1740 2024-09-10T23:20:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ee800640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6e815be00 0x7fd6e814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:18.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6ed400640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e80b1740 0x7fd6e814def0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c970 tx=0x7fd6d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6e2000640 1 -- 172.21.15.17:0/177723704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8007c10 con 0x7fd6e80b1740 2024-09-10T23:20:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6e2000640 1 -- 172.21.15.17:0/177723704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6d800f450 con 0x7fd6e80b1740 2024-09-10T23:20:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e80cb730 con 0x7fd6e80b1740 2024-09-10T23:20:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6e2000640 1 -- 172.21.15.17:0/177723704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800f8a0 con 0x7fd6e80b1740 2024-09-10T23:20:18.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e814f650 con 0x7fd6e80b1740 2024-09-10T23:20:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.961+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e80cfde0 con 0x7fd6e80b1740 2024-09-10T23:20:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.965+0000 7fd6e2000640 1 -- 172.21.15.17:0/177723704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd6d800fa40 con 0x7fd6e80b1740 2024-09-10T23:20:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.965+0000 7fd6e2000640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6cc0725e0 0x7fd6cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.965+0000 7fd6e2000640 1 -- 172.21.15.17:0/177723704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7fd6d8093db0 con 0x7fd6e80b1740 2024-09-10T23:20:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.965+0000 7fd6ede00640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6cc0725e0 0x7fd6cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:18.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.965+0000 7fd6ede00640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6cc0725e0 0x7fd6cc074aa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0af000 tx=0x7fd6dc01b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:18.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:18.969+0000 7fd6e2000640 1 -- 172.21.15.17:0/177723704 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd6d8098070 con 0x7fd6e80b1740 2024-09-10T23:20:19.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.145+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fd6e81560a0 con 0x7fd6e80b1740 2024-09-10T23:20:19.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.149+0000 7fd6e2000640 1 -- 172.21.15.17:0/177723704 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v37)=0 v37) ==== 117+0+0 (secure 0 0 0) 0x7fd6d8014030 con 0x7fd6e80b1740 2024-09-10T23:20:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6cc0725e0 msgr2=0x7fd6cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6cc0725e0 0x7fd6cc074aa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0af000 tx=0x7fd6dc01b0f0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e80b1740 msgr2=0x7fd6e814def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e80b1740 0x7fd6e814def0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c970 tx=0x7fd6d800ce30 comp rx=0 tx=0).stop 2024-09-10T23:20:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 shutdown_connections 2024-09-10T23:20:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6cc0725e0 0x7fd6cc074aa0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6e815be00 0x7fd6e814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6e80b1740 0x7fd6e814def0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 --2- 172.21.15.17:0/177723704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6e80b12e0 0x7fd6e813fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 >> 172.21.15.17:0/177723704 conn(0x7fd6e809a9f0 msgr2=0x7fd6e8070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 shutdown_connections 2024-09-10T23:20:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.153+0000 7fd6f0800640 1 -- 172.21.15.17:0/177723704 wait complete. 2024-09-10T23:20:19.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.321+0000 7f90afe00640 1 -- 172.21.15.17:0/1273633398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9094004810 msgr2=0x7f9094004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.321+0000 7f90afe00640 1 --2- 172.21.15.17:0/1273633398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9094004810 0x7f9094004c90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9098009b60 tx=0x7f909801d270 comp rx=0 tx=0).stop 2024-09-10T23:20:19.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.321+0000 7f90af400640 1 -- 172.21.15.17:0/1273633398 reap_dead start 2024-09-10T23:20:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.321+0000 7f90afe00640 1 -- 172.21.15.17:0/1273633398 shutdown_connections 2024-09-10T23:20:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.321+0000 7f90afe00640 1 -- 172.21.15.17:0/1273633398 >> 172.21.15.17:0/1273633398 conn(0x7f90b009a9f0 msgr2=0x7f90b009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.321+0000 7f90afe00640 1 -- 172.21.15.17:0/1273633398 shutdown_connections 2024-09-10T23:20:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.321+0000 7f90afe00640 1 -- 172.21.15.17:0/1273633398 wait complete. 2024-09-10T23:20:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.321+0000 7f90afe00640 1 Processor -- start 2024-09-10T23:20:19.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.321+0000 7f90afe00640 1 -- start start 2024-09-10T23:20:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90afe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9094004810 0x7f90b01f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b00ca0d0 0x7f90b00c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90afe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90b014fb50 0x7f90b014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90afe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00d1d20 con 0x7f90b00ca0d0 2024-09-10T23:20:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90afe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00d1ba0 con 0x7f90b014fb50 2024-09-10T23:20:19.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90afe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90b00b1800 con 0x7f9094004810 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b00ca0d0 0x7f90b00c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b00ca0d0 0x7f90b00c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43118/0 (socket says 172.21.15.17:43118) 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a7e00640 1 -- 172.21.15.17:0/1594477502 learned_addr learned my addr 172.21.15.17:0/1594477502 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90aea00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9094004810 0x7f90b01f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90af400640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90b014fb50 0x7f90b014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a7e00640 1 -- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9094004810 msgr2=0x7f90b01f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a7e00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9094004810 0x7f90b01f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a7e00640 1 -- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90b014fb50 msgr2=0x7f90b014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a7e00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90b014fb50 0x7f90b014ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a7e00640 1 -- 172.21.15.17:0/1594477502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b015a340 con 0x7f90b00ca0d0 2024-09-10T23:20:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a7e00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b00ca0d0 0x7f90b00c96b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f909801d0a0 tx=0x7f9098005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a6a00640 1 -- 172.21.15.17:0/1594477502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90980b1040 con 0x7f90b00ca0d0 2024-09-10T23:20:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a6a00640 1 -- 172.21.15.17:0/1594477502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90980bc070 con 0x7f90b00ca0d0 2024-09-10T23:20:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b01f30f0 con 0x7f90b00ca0d0 2024-09-10T23:20:19.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90a6a00640 1 -- 172.21.15.17:0/1594477502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098004c60 con 0x7f90b00ca0d0 2024-09-10T23:20:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b01f33e0 con 0x7f90b00ca0d0 2024-09-10T23:20:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.325+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b00b1d60 con 0x7f90b00ca0d0 2024-09-10T23:20:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.329+0000 7f90a6a00640 1 -- 172.21.15.17:0/1594477502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f90980c1460 con 0x7f90b00ca0d0 2024-09-10T23:20:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.329+0000 7f90a6a00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f908c0725e0 0x7f908c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.329+0000 7f90a6a00640 1 -- 172.21.15.17:0/1594477502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7f909812e230 con 0x7f90b00ca0d0 2024-09-10T23:20:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.329+0000 7f90aea00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f908c0725e0 0x7f908c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.329+0000 7f90aea00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f908c0725e0 0x7f908c074aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f90a0001ec0 tx=0x7f90a0001540 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:19.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.333+0000 7f90a6a00640 1 -- 172.21.15.17:0/1594477502 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9098016f80 con 0x7f90b00ca0d0 2024-09-10T23:20:19.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.541+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90b00c57d0 con 0x7f90b00ca0d0 2024-09-10T23:20:19.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90a6a00640 1 -- 172.21.15.17:0/1594477502 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f90980f9050 con 0x7f90b00ca0d0 2024-09-10T23:20:19.548 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:19.548 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"btime":"2024-09-10T23:20:17:731093+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:17.731089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2034416577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2034416577},{"type":"v1","addr":"172.21.15.17:6835","nonce":2034416577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6322,"qdb_cluster":[6322]},"id":4}]} 2024-09-10T23:20:19.549 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 47 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f908c0725e0 msgr2=0x7f908c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f908c0725e0 0x7f908c074aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f90a0001ec0 tx=0x7f90a0001540 comp rx=0 tx=0).stop 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b00ca0d0 msgr2=0x7f90b00c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b00ca0d0 0x7f90b00c96b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f909801d0a0 tx=0x7f9098005620 comp rx=0 tx=0).stop 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 shutdown_connections 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f908c0725e0 0x7f908c074aa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90b014fb50 0x7f90b014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90b00ca0d0 0x7f90b00c96b0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 --2- 172.21.15.17:0/1594477502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9094004810 0x7f90b01f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 >> 172.21.15.17:0/1594477502 conn(0x7f90b009a9f0 msgr2=0x7f90b00c5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:19.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 shutdown_connections 2024-09-10T23:20:19.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.545+0000 7f90afe00640 1 -- 172.21.15.17:0/1594477502 wait complete. 2024-09-10T23:20:19.570 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-10T23:20:19.729 INFO:tasks.ceph.mds.a.smithi017.stderr:2024-09-10T23:20:19.725+0000 7f1390400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:20:19.731 INFO:teuthology.orchestra.run.smithi017.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T23:20:05.022679+0000","btime":"2024-09-10T23:20:04.070092+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T23:20:05.022679+0000","atime":"2024-09-10T23:20:04.070092+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T23:20:05.022679+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:20:05.024199+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:20:05.024199+0000"},"version":166,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1},{"frag":"1*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T23:20:19.732 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-10T23:20:05.024199+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T23:20:04.070092+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T23:20:04.070092+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T23:20:05.022679+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" }, { "children": 1, "frag": "1*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-10T23:20:05.022679+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-10T23:20:05.022679+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-10T23:20:05.024199+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 166, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-10T23:20:19.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:19.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-09-10T23:20:19.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.877+0000 7fe9e5c00640 1 -- 172.21.15.17:0/2784566572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00b2fe0 msgr2=0x7fe9e00cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.877+0000 7fe9e5c00640 1 --2- 172.21.15.17:0/2784566572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00b2fe0 0x7fe9e00cf040 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe9e006c870 tx=0x7fe9c801c890 comp rx=0 tx=0).stop 2024-09-10T23:20:19.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.877+0000 7fe9e5c00640 1 -- 172.21.15.17:0/2784566572 shutdown_connections 2024-09-10T23:20:19.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.877+0000 7fe9e5c00640 1 --2- 172.21.15.17:0/2784566572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00b2fe0 0x7fe9e00cf040 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.877+0000 7fe9e5c00640 1 --2- 172.21.15.17:0/2784566572 >> v2:172.21.15.77:3300/0 conn(0x7fe9e015a2a0 0x7fe9e00b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.877+0000 7fe9e5c00640 1 -- 172.21.15.17:0/2784566572 >> 172.21.15.17:0/2784566572 conn(0x7fe9e00b17a0 msgr2=0x7fe9e00b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:19.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.877+0000 7fe9e5c00640 1 -- 172.21.15.17:0/2784566572 shutdown_connections 2024-09-10T23:20:19.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.877+0000 7fe9e5c00640 1 -- 172.21.15.17:0/2784566572 wait complete. 2024-09-10T23:20:19.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 Processor -- start 2024-09-10T23:20:19.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 -- start start 2024-09-10T23:20:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9e00b2fe0 0x7fe9e0150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00cf580 0x7fe9e014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9e015a2a0 0x7fe9e0158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e006f8a0 con 0x7fe9e00cf580 2024-09-10T23:20:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e00cd930 con 0x7fe9e00b2fe0 2024-09-10T23:20:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e006fa20 con 0x7fe9e015a2a0 2024-09-10T23:20:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00cf580 0x7fe9e014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00cf580 0x7fe9e014ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43136/0 (socket says 172.21.15.17:43136) 2024-09-10T23:20:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1747586002 learned_addr learned my addr 172.21.15.17:0/1747586002 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9e015a2a0 msgr2=0x7fe9e0158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9e015a2a0 0x7fe9e0158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9e00b2fe0 msgr2=0x7fe9e0150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9e00b2fe0 0x7fe9e0150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1747586002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e0150050 con 0x7fe9e00cf580 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00cf580 0x7fe9e014ed50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80b0040 tx=0x7fe9c80a57c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d6a00640 1 -- 172.21.15.17:0/1747586002 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80b2040 con 0x7fe9e00cf580 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d6a00640 1 -- 172.21.15.17:0/1747586002 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9c8005020 con 0x7fe9e00cf580 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 -- 172.21.15.17:0/1747586002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e0150330 con 0x7fe9e00cf580 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9d6a00640 1 -- 172.21.15.17:0/1747586002 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80044f0 con 0x7fe9e00cf580 2024-09-10T23:20:19.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.881+0000 7fe9e5c00640 1 -- 172.21.15.17:0/1747586002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e01522a0 con 0x7fe9e00cf580 2024-09-10T23:20:19.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9d6a00640 1 -- 172.21.15.17:0/1747586002 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe9c8005470 con 0x7fe9e00cf580 2024-09-10T23:20:19.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9e90dc000 1 Processor -- start 2024-09-10T23:20:19.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9d6a00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9bc0725e0 0x7fe9bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9e90dc000 1 -- start start 2024-09-10T23:20:19.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9d6a00640 1 -- 172.21.15.17:0/1747586002 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7fe9c812d0f0 con 0x7fe9e00cf580 2024-09-10T23:20:19.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9dea00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9bc0725e0 0x7fe9bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 0x55a725333260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7253337a0 0x55a7252e9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 0x55a7252ea070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a725140a40 con 0x55a7253337a0 2024-09-10T23:20:19.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a72512fe70 con 0x55a725332e80 2024-09-10T23:20:19.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.885+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a725133c80 con 0x55a7252e9c90 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9dea00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9bc0725e0 0x7fe9bc074aa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00058d0 tx=0x7fe9d0005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7253337a0 0x55a7252e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9df400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 0x55a7252ea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9dea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 0x55a725333260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7253337a0 0x55a7252e9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43150/0 (socket says 172.21.15.17:43150) 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1457535994 learned_addr learned my addr 172.21.15.17:0/1457535994 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1457535994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 msgr2=0x55a7252ea070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1457535994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 0x55a7252ea070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1457535994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 msgr2=0x55a725333260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1457535994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 0x55a725333260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1457535994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a725179040 con 0x55a7253337a0 2024-09-10T23:20:19.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1457535994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7253337a0 0x55a7252e9750 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80f5030 tx=0x7fe9c80f7710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a5a76b1e91efef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:19.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9cf400640 1 -- 172.21.15.17:0/1457535994 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80f84c0 con 0x55a7253337a0 2024-09-10T23:20:19.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9cf400640 1 -- 172.21.15.17:0/1457535994 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9c80fc8a0 con 0x55a7253337a0 2024-09-10T23:20:19.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9cf400640 1 -- 172.21.15.17:0/1457535994 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c81012c0 con 0x55a7253337a0 2024-09-10T23:20:19.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1457535994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7253337a0 msgr2=0x55a7252e9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1457535994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7253337a0 0x55a7252e9750 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80f5030 tx=0x7fe9c80f7710 comp rx=0 tx=0).stop 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1457535994 shutdown_connections 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1457535994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 0x55a7252ea070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1457535994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7253337a0 0x55a7252e9750 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1457535994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 0x55a725333260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1457535994 >> 172.21.15.17:0/1457535994 conn(0x55a7252e1800 msgr2=0x55a7252e3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1457535994 shutdown_connections 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1457535994 wait complete. 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 -- start start 2024-09-10T23:20:19.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 Processor -- start 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e9c90 0x55a72531d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a725332e80 0x55a72531da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7253337a0 0x55a72531df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a725173b60 con 0x55a725332e80 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a7250d9950 con 0x55a7252e9c90 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a7250e5bb0 con 0x55a7253337a0 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.889+0000 7fe9e90dc000 10 client.0 _ll_register_callbacks cb 0x55a7250d63f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a725332e80 0x55a72531da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a725332e80 0x55a72531da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43156/0 (socket says 172.21.15.17:43156) 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1291974911 learned_addr learned my addr 172.21.15.17:0/1291974911 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:19.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9dea00640 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e9c90 0x55a72531d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9df400640 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7253337a0 0x55a72531df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1291974911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7253337a0 msgr2=0x55a72531df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7253337a0 0x55a72531df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1291974911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e9c90 msgr2=0x55a72531d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e9c90 0x55a72531d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1291974911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7250d8b30 con 0x55a725332e80 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a725332e80 0x55a72531da50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009850 tx=0x7fe9c80f44a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498cca4e4e39b696 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 1 -- 172.21.15.17:0/1291974911 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8101030 con 0x55a725332e80 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 1 -- 172.21.15.17:0/1291974911 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7fe9c80ffb90 con 0x55a725332e80 2024-09-10T23:20:19.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1291974911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a7250c81e0 con 0x55a725332e80 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 1 -- 172.21.15.17:0/1291974911 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fe9c812a050 con 0x55a725332e80 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 10 client.6714 fetch_fsmap learned FSMap version 47 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1291974911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55a7250ce0a0 con 0x55a725332e80 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 1 -- 172.21.15.17:0/1291974911 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9c811e070 con 0x55a725332e80 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 1 -- 172.21.15.17:0/1291974911 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7fe9c80f7020 con 0x55a725332e80 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 10 client.6714 fetch_fsmap finished waiting for FSMap version 47 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 10 client.6714 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 20 client.6714 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x55a725342120 0x55a725344510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 4 client.6714 mds_command: new command op to 6322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:20:19.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1291974911 --> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a725142990 con 0x55a725342120 2024-09-10T23:20:19.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9dea00640 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x55a725342120 0x55a725344510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9dea00640 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x55a725342120 0x55a725344510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=599855b859e79355 server_cookie=5b51ad56b151046b in_seq=0 out_seq=0 2024-09-10T23:20:19.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 10 client.6714 ms_handle_connect on v2:172.21.15.17:6833/2034416577 2024-09-10T23:20:19.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 1 -- 172.21.15.17:0/1291974911 <== mds.0 v2:172.21.15.17:6833/2034416577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a725142990 con 0x55a725342120 2024-09-10T23:20:19.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 10 client.6714 handle_command_reply: tid=0 2024-09-10T23:20:19.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 client.6714 shutdown 2024-09-10T23:20:19.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1291974911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a725332e80 msgr2=0x55a72531da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a725332e80 0x55a72531da50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009850 tx=0x7fe9c80f44a0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1291974911 shutdown_connections 2024-09-10T23:20:19.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7253337a0 0x55a72531df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x55a725342120 0x55a725344510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a725332e80 0x55a72531da50 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9c3e00640 0 client.6714 ms_handle_reset on v2:172.21.15.17:6833/2034416577 2024-09-10T23:20:19.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/1291974911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e9c90 0x55a72531d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1291974911 >> 172.21.15.17:0/1291974911 conn(0x55a7252e1800 msgr2=0x55a7252ea890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:19.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1291974911 shutdown_connections 2024-09-10T23:20:19.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 1 -- 172.21.15.17:0/1291974911 wait complete. 2024-09-10T23:20:19.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.893+0000 7fe9e90dc000 20 client.6714 trim_cache size 0 max 16384 2024-09-10T23:20:19.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9e90dc000 1 Processor -- start 2024-09-10T23:20:19.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9e90dc000 1 -- start start 2024-09-10T23:20:19.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e1800 0x55a7253a6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e9c90 0x55a7253a6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a725332e80 0x55a7253a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e015c640 con 0x55a7252e9c90 2024-09-10T23:20:19.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e015f0a0 con 0x55a7252e1800 2024-09-10T23:20:19.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e015bf90 con 0x55a725332e80 2024-09-10T23:20:19.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e9c90 0x55a7253a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e9c90 0x55a7253a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43160/0 (socket says 172.21.15.17:43160) 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9d7e00640 1 -- 172.21.15.17:0/152869037 learned_addr learned my addr 172.21.15.17:0/152869037 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9df400640 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a725332e80 0x55a7253a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9dea00640 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e1800 0x55a7253a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9d7e00640 1 -- 172.21.15.17:0/152869037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a725332e80 msgr2=0x55a7253a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a725332e80 0x55a7253a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9d7e00640 1 -- 172.21.15.17:0/152869037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e1800 msgr2=0x55a7253a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e1800 0x55a7253a6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9d7e00640 1 -- 172.21.15.17:0/152869037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7252f1ea0 con 0x55a7252e9c90 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9df400640 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a725332e80 0x55a7253a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.913+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e9c90 0x55a7253a6580 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80f5030 tx=0x7fe9c8005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a840eb0cdb0e10e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9cea00640 1 -- 172.21.15.17:0/152869037 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c81012c0 con 0x55a7252e9c90 2024-09-10T23:20:19.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9cea00640 1 -- 172.21.15.17:0/152869037 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9c811e040 con 0x55a7252e9c90 2024-09-10T23:20:19.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9cea00640 1 -- 172.21.15.17:0/152869037 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80ffb90 con 0x55a7252e9c90 2024-09-10T23:20:19.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- 172.21.15.17:0/152869037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e9c90 msgr2=0x55a7253a6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e9c90 0x55a7253a6580 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80f5030 tx=0x7fe9c8005a10 comp rx=0 tx=0).stop 2024-09-10T23:20:19.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- 172.21.15.17:0/152869037 shutdown_connections 2024-09-10T23:20:19.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a725332e80 0x55a7253a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e9c90 0x55a7253a6580 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/152869037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a7252e1800 0x55a7253a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- 172.21.15.17:0/152869037 >> 172.21.15.17:0/152869037 conn(0x55a72531dea0 msgr2=0x55a7252efbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- 172.21.15.17:0/152869037 shutdown_connections 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- 172.21.15.17:0/152869037 wait complete. 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- start start 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 Processor -- start 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e1800 0x55a7253a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 0x55a7253aa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 0x55a7253aa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a7250fbf40 con 0x55a7252e1800 2024-09-10T23:20:19.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a7250fb760 con 0x55a725332e80 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a725132f90 con 0x55a7252e9c90 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 10 client.0 _ll_register_callbacks cb 0x7fe9d000a730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9dea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e1800 0x55a7253a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9dea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e1800 0x55a7253a9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43166/0 (socket says 172.21.15.17:43166) 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9dea00640 1 -- 172.21.15.17:0/3054575426 learned_addr learned my addr 172.21.15.17:0/3054575426 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 0x55a7253aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9df400640 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 0x55a7253aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9dea00640 1 -- 172.21.15.17:0/3054575426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 msgr2=0x55a7253aa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9dea00640 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 0x55a7253aa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9dea00640 1 -- 172.21.15.17:0/3054575426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 msgr2=0x55a7253aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9dea00640 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 0x55a7253aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9dea00640 1 -- 172.21.15.17:0/3054575426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7251b4dc0 con 0x55a7252e1800 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9dea00640 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e1800 0x55a7253a9cd0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000ee90 tx=0x7fe9d000a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183cc48b1a244bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9c3e00640 1 -- 172.21.15.17:0/3054575426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0025600 con 0x55a7252e1800 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9e90dc000 1 -- 172.21.15.17:0/3054575426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9c811e040 con 0x55a7252e1800 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.917+0000 7fe9c3e00640 1 -- 172.21.15.17:0/3054575426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7fe9d00257a0 con 0x55a7252e1800 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9c3e00640 1 -- 172.21.15.17:0/3054575426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fe9d0039050 con 0x55a7252e1800 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 10 client.6720 fetch_fsmap learned FSMap version 47 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 -- 172.21.15.17:0/3054575426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55a7250c6620 con 0x55a7252e1800 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9c3e00640 1 -- 172.21.15.17:0/3054575426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9c811e040 con 0x55a7252e1800 2024-09-10T23:20:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9c3e00640 1 -- 172.21.15.17:0/3054575426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7fe9d003c020 con 0x55a7252e1800 2024-09-10T23:20:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 10 client.6720 fetch_fsmap finished waiting for FSMap version 47 2024-09-10T23:20:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 10 client.6720 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-10T23:20:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 20 client.6720 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x55a7253337a0 0x55a7253480b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 4 client.6720 mds_command: new command op to 6322 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-10T23:20:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 -- 172.21.15.17:0/3054575426 --> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x55a72513e440 con 0x55a7253337a0 2024-09-10T23:20:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x55a7253337a0 0x55a7253480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9c3e00640 10 client.6720 ms_handle_connect on v2:172.21.15.17:6833/2034416577 2024-09-10T23:20:19.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x55a7253337a0 0x55a7253480b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e88e951a2fa31be server_cookie=181a6c50fd111cca in_seq=0 out_seq=0 2024-09-10T23:20:19.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9c3e00640 1 -- 172.21.15.17:0/3054575426 <== mds.0 v2:172.21.15.17:6833/2034416577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a72513e440 con 0x55a7253337a0 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9c3e00640 10 client.6720 handle_command_reply: tid=0 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 client.6720 shutdown 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 -- 172.21.15.17:0/3054575426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e1800 msgr2=0x55a7253a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e1800 0x55a7253a9cd0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000ee90 tx=0x7fe9d000a2f0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 -- 172.21.15.17:0/3054575426 shutdown_connections 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a725332e80 0x55a7253aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a7252e9c90 0x55a7253aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.17:6833/2034416577,v1:172.21.15.17:6835/2034416577] conn(0x55a7253337a0 0x55a7253480b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 --2- 172.21.15.17:0/3054575426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7252e1800 0x55a7253a9cd0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9c3e00640 0 client.6720 ms_handle_reset on v2:172.21.15.17:6833/2034416577 2024-09-10T23:20:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 -- 172.21.15.17:0/3054575426 >> 172.21.15.17:0/3054575426 conn(0x55a72531dea0 msgr2=0x55a7252e4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 -- 172.21.15.17:0/3054575426 shutdown_connections 2024-09-10T23:20:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 1 -- 172.21.15.17:0/3054575426 wait complete. 2024-09-10T23:20:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e90dc000 20 client.6720 trim_cache size 0 max 16384 2024-09-10T23:20:19.932 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:20:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:20:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "a7738657-9f75-411b-b758-b27c2a06e76c", 2024-09-10T23:20:19.932 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:20:19.933 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:20:19.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 -- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9bc0725e0 msgr2=0x7fe9bc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9bc0725e0 0x7fe9bc074aa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00058d0 tx=0x7fe9d0005860 comp rx=0 tx=0).stop 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 -- 172.21.15.17:0/1747586002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00cf580 msgr2=0x7fe9e014ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00cf580 0x7fe9e014ed50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80b0040 tx=0x7fe9c80a57c0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 -- 172.21.15.17:0/1747586002 shutdown_connections 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9bc0725e0 0x7fe9bc074aa0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9e015a2a0 0x7fe9e0158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e00cf580 0x7fe9e014ed50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 --2- 172.21.15.17:0/1747586002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9e00b2fe0 0x7fe9e0150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.921+0000 7fe9e5c00640 1 -- 172.21.15.17:0/1747586002 >> 172.21.15.17:0/1747586002 conn(0x7fe9e00b17a0 msgr2=0x7fe9e0157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.925+0000 7fe9e5c00640 1 -- 172.21.15.17:0/1747586002 shutdown_connections 2024-09-10T23:20:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:19.925+0000 7fe9e5c00640 1 -- 172.21.15.17:0/1747586002 wait complete. 2024-09-10T23:20:19.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:20.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.089+0000 7f314a200640 1 -- 172.21.15.17:0/1743688614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31440cf340 msgr2=0x7f314415e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:20.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.089+0000 7f314a200640 1 --2- 172.21.15.17:0/1743688614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31440cf340 0x7f314415e040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f313c009c80 tx=0x7f313c01cda0 comp rx=0 tx=0).stop 2024-09-10T23:20:20.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.089+0000 7f314a200640 1 -- 172.21.15.17:0/1743688614 shutdown_connections 2024-09-10T23:20:20.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.089+0000 7f314a200640 1 --2- 172.21.15.17:0/1743688614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31440cf340 0x7f314415e040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:20.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.089+0000 7f314a200640 1 --2- 172.21.15.17:0/1743688614 >> v2:172.21.15.77:3300/0 conn(0x7f31440b4390 0x7f314415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:20.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.089+0000 7f314a200640 1 -- 172.21.15.17:0/1743688614 >> 172.21.15.17:0/1743688614 conn(0x7f31440b3870 msgr2=0x7f31440b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:20.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.089+0000 7f314a200640 1 -- 172.21.15.17:0/1743688614 shutdown_connections 2024-09-10T23:20:20.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.089+0000 7f314a200640 1 -- 172.21.15.17:0/1743688614 wait complete. 2024-09-10T23:20:20.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f314a200640 1 Processor -- start 2024-09-10T23:20:20.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f314a200640 1 -- start start 2024-09-10T23:20:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f314a200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31440b4390 0x7f3144158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f314a200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31440cef60 0x7f31441554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f314a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31440cf340 0x7f31441559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f314a200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3144168ed0 con 0x7f31440cf340 2024-09-10T23:20:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f314a200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3144071ce0 con 0x7f31440b4390 2024-09-10T23:20:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f314a200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3144169050 con 0x7f31440cef60 2024-09-10T23:20:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31440cf340 0x7f31441559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31440b4390 0x7f3144158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:20.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31440cf340 0x7f31441559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43178/0 (socket says 172.21.15.17:43178) 2024-09-10T23:20:20.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143e00640 1 -- 172.21.15.17:0/3650815984 learned_addr learned my addr 172.21.15.17:0/3650815984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:20.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f313be00640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31440cef60 0x7f31441554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:20.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143e00640 1 -- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31440cef60 msgr2=0x7f31441554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:20.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143e00640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31440cef60 0x7f31441554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:20.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143e00640 1 -- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31440b4390 msgr2=0x7f3144158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:20.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143e00640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31440b4390 0x7f3144158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:20.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143e00640 1 -- 172.21.15.17:0/3650815984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31440b7900 con 0x7f31440cf340 2024-09-10T23:20:20.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f3143e00640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31440cf340 0x7f31441559f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f313c009bd0 tx=0x7f313c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:20.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f313b400640 1 -- 172.21.15.17:0/3650815984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c0bb070 con 0x7f31440cf340 2024-09-10T23:20:20.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f313b400640 1 -- 172.21.15.17:0/3650815984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f313c004b40 con 0x7f31440cf340 2024-09-10T23:20:20.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.093+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31440cb2f0 con 0x7f31440cf340 2024-09-10T23:20:20.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.097+0000 7f313b400640 1 -- 172.21.15.17:0/3650815984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c0b2040 con 0x7f31440cf340 2024-09-10T23:20:20.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.097+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31441589a0 con 0x7f31440cf340 2024-09-10T23:20:20.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.097+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31440cfd90 con 0x7f31440cf340 2024-09-10T23:20:20.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.097+0000 7f313b400640 1 -- 172.21.15.17:0/3650815984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f313c0b5030 con 0x7f31440cf340 2024-09-10T23:20:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.097+0000 7f313b400640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3120072610 0x7f3120074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.097+0000 7f313b400640 1 -- 172.21.15.17:0/3650815984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7f313c12d070 con 0x7f31440cf340 2024-09-10T23:20:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.097+0000 7f3143400640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3120072610 0x7f3120074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.101+0000 7f3143400640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3120072610 0x7f3120074ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3134007fd0 tx=0x7f3134009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.101+0000 7f313b400640 1 -- 172.21.15.17:0/3650815984 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f313c016990 con 0x7f31440cf340 2024-09-10T23:20:20.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.309+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31440c8bb0 con 0x7f31440cf340 2024-09-10T23:20:20.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.309+0000 7f313b400640 1 -- 172.21.15.17:0/3650815984 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f313c0f7e80 con 0x7f31440cf340 2024-09-10T23:20:20.315 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:20.315 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"btime":"2024-09-10T23:20:17:731093+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:17.731089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2034416577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2034416577},{"type":"v1","addr":"172.21.15.17:6835","nonce":2034416577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6322,"qdb_cluster":[6322]},"id":4}]} 2024-09-10T23:20:20.316 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 47 2024-09-10T23:20:20.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3120072610 msgr2=0x7f3120074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:20.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3120072610 0x7f3120074ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3134007fd0 tx=0x7f3134009040 comp rx=0 tx=0).stop 2024-09-10T23:20:20.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31440cf340 msgr2=0x7f31441559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:20.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31440cf340 0x7f31441559f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f313c009bd0 tx=0x7f313c005b00 comp rx=0 tx=0).stop 2024-09-10T23:20:20.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 shutdown_connections 2024-09-10T23:20:20.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3120072610 0x7f3120074ad0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:20.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31440cf340 0x7f31441559f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:20.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31440cef60 0x7f31441554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:20.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 --2- 172.21.15.17:0/3650815984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31440b4390 0x7f3144158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:20.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 >> 172.21.15.17:0/3650815984 conn(0x7f31440b3870 msgr2=0x7f31440cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:20.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 shutdown_connections 2024-09-10T23:20:20.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:20.313+0000 7f314a200640 1 -- 172.21.15.17:0/3650815984 wait complete. 2024-09-10T23:20:20.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-10T23:20:20.498 INFO:teuthology.orchestra.run.smithi017.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T23:20:05.022679+0000","btime":"2024-09-10T23:20:04.070092+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T23:20:05.022679+0000","atime":"2024-09-10T23:20:04.070092+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T23:20:05.022679+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:20:05.024199+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:20:05.024199+0000"},"version":166,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1},{"frag":"1*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":3,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T23:20:20.499 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-10T23:20:05.024199+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T23:20:04.070092+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T23:20:04.070092+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T23:20:05.022679+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" }, { "children": 1, "frag": "1*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-10T23:20:05.022679+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-10T23:20:05.022679+0000", "nestlock": {}, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 3, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-10T23:20:05.024199+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 166, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-10T23:20:20.499 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-10T23:20:25.500 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:25.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.653+0000 7f3eeae00640 1 -- 172.21.15.17:0/2043080009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 msgr2=0x7f3ee40ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.653+0000 7f3eeae00640 1 --2- 172.21.15.17:0/2043080009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 0x7f3ee40ccdb0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40d0c70 tx=0x7f3edc01cd80 comp rx=0 tx=0).stop 2024-09-10T23:20:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.653+0000 7f3eeae00640 1 -- 172.21.15.17:0/2043080009 shutdown_connections 2024-09-10T23:20:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.653+0000 7f3eeae00640 1 --2- 172.21.15.17:0/2043080009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 0x7f3ee40ccdb0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.653+0000 7f3eeae00640 1 --2- 172.21.15.17:0/2043080009 >> v2:172.21.15.77:3300/0 conn(0x7f3ee415f770 0x7f3ee40cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.653+0000 7f3eeae00640 1 -- 172.21.15.17:0/2043080009 >> 172.21.15.17:0/2043080009 conn(0x7f3ee40d1d60 msgr2=0x7f3ee40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.653+0000 7f3eeae00640 1 -- 172.21.15.17:0/2043080009 shutdown_connections 2024-09-10T23:20:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.653+0000 7f3eeae00640 1 -- 172.21.15.17:0/2043080009 wait complete. 2024-09-10T23:20:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.653+0000 7f3eeae00640 1 Processor -- start 2024-09-10T23:20:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 -- start start 2024-09-10T23:20:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ee4070ad0 0x7f3ee40c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 0x7f3ee40c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee415f770 0x7f3ee40b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee41693c0 con 0x7f3ee40d1830 2024-09-10T23:20:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee4169240 con 0x7f3ee415f770 2024-09-10T23:20:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee4169540 con 0x7f3ee4070ad0 2024-09-10T23:20:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3edb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 0x7f3ee40c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3edb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 0x7f3ee40c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43188/0 (socket says 172.21.15.17:43188) 2024-09-10T23:20:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3edb400640 1 -- 172.21.15.17:0/2488971863 learned_addr learned my addr 172.21.15.17:0/2488971863 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3ee8e00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee415f770 0x7f3ee40b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3ee3e00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ee4070ad0 0x7f3ee40c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3edb400640 1 -- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ee4070ad0 msgr2=0x7f3ee40c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3edb400640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ee4070ad0 0x7f3ee40c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3edb400640 1 -- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee415f770 msgr2=0x7f3ee40b69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3edb400640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee415f770 0x7f3ee40b69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3edb400640 1 -- 172.21.15.17:0/2488971863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee40b0fe0 con 0x7f3ee40d1830 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3edb400640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 0x7f3ee40c66d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00d720 tx=0x7f3ecc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3ee0c00640 1 -- 172.21.15.17:0/2488971863 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc017070 con 0x7f3ee40d1830 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3ee0c00640 1 -- 172.21.15.17:0/2488971863 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ecc009cc0 con 0x7f3ee40d1830 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3ee0c00640 1 -- 172.21.15.17:0/2488971863 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc005280 con 0x7f3ee40d1830 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee40b42b0 con 0x7f3ee40d1830 2024-09-10T23:20:25.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee40b3cf0 con 0x7f3ee40d1830 2024-09-10T23:20:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.657+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee415f060 con 0x7f3ee40d1830 2024-09-10T23:20:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.661+0000 7f3ee0c00640 1 -- 172.21.15.17:0/2488971863 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3ecc005420 con 0x7f3ee40d1830 2024-09-10T23:20:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.661+0000 7f3ee0c00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ec0072610 0x7f3ec0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.661+0000 7f3ee0c00640 1 -- 172.21.15.17:0/2488971863 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7f3ecc0935b0 con 0x7f3ee40d1830 2024-09-10T23:20:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.661+0000 7f3ee3e00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ec0072610 0x7f3ec0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.661+0000 7f3ee3e00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ec0072610 0x7f3ec0074ad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4158910 tx=0x7f3ed4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.665+0000 7f3ee0c00640 1 -- 172.21.15.17:0/2488971863 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3ecc05e330 con 0x7f3ee40d1830 2024-09-10T23:20:25.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.877+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ee40b79c0 con 0x7f3ee40d1830 2024-09-10T23:20:25.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.877+0000 7f3ee0c00640 1 -- 172.21.15.17:0/2488971863 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f3ecc0670a0 con 0x7f3ee40d1830 2024-09-10T23:20:25.882 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:25.882 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"btime":"2024-09-10T23:20:17:731093+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:17.731089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2034416577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2034416577},{"type":"v1","addr":"172.21.15.17:6835","nonce":2034416577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6322,"qdb_cluster":[6322]},"id":4}]} 2024-09-10T23:20:25.882 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 47 2024-09-10T23:20:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ec0072610 msgr2=0x7f3ec0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ec0072610 0x7f3ec0074ad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4158910 tx=0x7f3ed4009040 comp rx=0 tx=0).stop 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 msgr2=0x7f3ee40c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 0x7f3ee40c66d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00d720 tx=0x7f3ecc00dbe0 comp rx=0 tx=0).stop 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 shutdown_connections 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ec0072610 0x7f3ec0074ad0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ee415f770 0x7f3ee40b69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee40d1830 0x7f3ee40c66d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 --2- 172.21.15.17:0/2488971863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ee4070ad0 0x7f3ee40c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 >> 172.21.15.17:0/2488971863 conn(0x7f3ee40d1d60 msgr2=0x7f3ee40b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 shutdown_connections 2024-09-10T23:20:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:25.881+0000 7f3eeae00640 1 -- 172.21.15.17:0/2488971863 wait complete. 2024-09-10T23:20:25.905 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-10T23:20:26.068 INFO:teuthology.orchestra.run.smithi017.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T23:20:05.022679+0000","btime":"2024-09-10T23:20:04.070092+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T23:20:05.022679+0000","atime":"2024-09-10T23:20:04.070092+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T23:20:05.022679+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:20:05.024199+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:20:05.024199+0000"},"version":170,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-10T23:20:19.927815+0000","last_scrub_version":166,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T23:20:26.069 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-10T23:20:05.024199+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T23:20:04.070092+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T23:20:04.070092+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T23:20:05.022679+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-10T23:20:05.022679+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-10T23:20:19.927815+0000", "last_scrub_version": 166, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-10T23:20:05.022679+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-10T23:20:05.024199+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 170, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-10T23:20:26.069 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-10T23:20:26.069 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:20:26.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:20:26.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:20:26.280 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:20:26.280 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:20:26.280 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:20:26.280 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:26.290 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:20:26.290 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:20:26.290 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:20:26.290 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:26.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:20:26.300 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:20:26.301 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:20:26.301 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:26.340 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:20:26.340 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:20:26.341 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:20:26.341 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:26.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:20:26.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:26.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.525+0000 7fb69de00640 1 -- 172.21.15.17:0/3989230429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980b48f0 msgr2=0x7fb6980b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:26.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.525+0000 7fb69de00640 1 --2- 172.21.15.17:0/3989230429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980b48f0 0x7fb6980b37f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb680009840 tx=0x7fb68001c790 comp rx=0 tx=0).stop 2024-09-10T23:20:26.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.525+0000 7fb69de00640 1 -- 172.21.15.17:0/3989230429 shutdown_connections 2024-09-10T23:20:26.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.525+0000 7fb69de00640 1 --2- 172.21.15.17:0/3989230429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980b48f0 0x7fb6980b37f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.525+0000 7fb69de00640 1 -- 172.21.15.17:0/3989230429 >> 172.21.15.17:0/3989230429 conn(0x7fb69806cfc0 msgr2=0x7fb69806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:26.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.525+0000 7fb69de00640 1 -- 172.21.15.17:0/3989230429 shutdown_connections 2024-09-10T23:20:26.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.525+0000 7fb69de00640 1 -- 172.21.15.17:0/3989230429 wait complete. 2024-09-10T23:20:26.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 Processor -- start 2024-09-10T23:20:26.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 -- start start 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6980b48f0 0x7fb698143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6980cf4f0 0x7fb6981546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980cff20 0x7fb69814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb69816a0f0 con 0x7fb6980cff20 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb698169f70 con 0x7fb6980cf4f0 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb69816a270 con 0x7fb6980b48f0 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb697400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980cff20 0x7fb69814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb697400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980cff20 0x7fb69814cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43216/0 (socket says 172.21.15.17:43216) 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb697400640 1 -- 172.21.15.17:0/3323256201 learned_addr learned my addr 172.21.15.17:0/3323256201 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:26.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb68e000640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6980cf4f0 0x7fb6981546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:26.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb696a00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6980b48f0 0x7fb698143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:26.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb697400640 1 -- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6980b48f0 msgr2=0x7fb698143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:26.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb697400640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6980b48f0 0x7fb698143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb697400640 1 -- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6980cf4f0 msgr2=0x7fb6981546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:26.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb697400640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6980cf4f0 0x7fb6981546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb697400640 1 -- 172.21.15.17:0/3323256201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb698150fd0 con 0x7fb6980cff20 2024-09-10T23:20:26.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb697400640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980cff20 0x7fb69814cf10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb69000c710 tx=0x7fb69000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:26.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb68fe00640 1 -- 172.21.15.17:0/3323256201 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690003b80 con 0x7fb6980cff20 2024-09-10T23:20:26.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb68fe00640 1 -- 172.21.15.17:0/3323256201 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb690003d20 con 0x7fb6980cff20 2024-09-10T23:20:26.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb68fe00640 1 -- 172.21.15.17:0/3323256201 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69000aab0 con 0x7fb6980cff20 2024-09-10T23:20:26.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb698155010 con 0x7fb6980cff20 2024-09-10T23:20:26.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.529+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb698151550 con 0x7fb6980cff20 2024-09-10T23:20:26.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.533+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6980b37f0 con 0x7fb6980cff20 2024-09-10T23:20:26.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.533+0000 7fb68fe00640 1 -- 172.21.15.17:0/3323256201 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb69000ac50 con 0x7fb6980cff20 2024-09-10T23:20:26.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.533+0000 7fb68fe00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6740725e0 0x7fb674074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:26.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.533+0000 7fb68fe00640 1 -- 172.21.15.17:0/3323256201 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7fb6900931f0 con 0x7fb6980cff20 2024-09-10T23:20:26.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.533+0000 7fb696a00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6740725e0 0x7fb674074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:26.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.533+0000 7fb696a00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6740725e0 0x7fb674074aa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb688000f70 tx=0x7fb688009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:26.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.537+0000 7fb68fe00640 1 -- 172.21.15.17:0/3323256201 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb69000ce20 con 0x7fb6980cff20 2024-09-10T23:20:26.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.745+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb69815c8b0 con 0x7fb6980cff20 2024-09-10T23:20:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.745+0000 7fb68fe00640 1 -- 172.21.15.17:0/3323256201 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7fb69005df70 con 0x7fb6980cff20 2024-09-10T23:20:26.751 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:26.751 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"btime":"2024-09-10T23:20:17:731093+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:17.731089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2034416577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2034416577},{"type":"v1","addr":"172.21.15.17:6835","nonce":2034416577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6322,"qdb_cluster":[6322]},"id":4}]} 2024-09-10T23:20:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 47 2024-09-10T23:20:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6740725e0 msgr2=0x7fb674074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6740725e0 0x7fb674074aa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb688000f70 tx=0x7fb688009040 comp rx=0 tx=0).stop 2024-09-10T23:20:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980cff20 msgr2=0x7fb69814cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980cff20 0x7fb69814cf10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb69000c710 tx=0x7fb69000cbd0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 shutdown_connections 2024-09-10T23:20:26.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6740725e0 0x7fb674074aa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6980cff20 0x7fb69814cf10 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6980cf4f0 0x7fb6981546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 --2- 172.21.15.17:0/3323256201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6980b48f0 0x7fb698143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 >> 172.21.15.17:0/3323256201 conn(0x7fb69806cfc0 msgr2=0x7fb69814b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 shutdown_connections 2024-09-10T23:20:26.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.749+0000 7fb69de00640 1 -- 172.21.15.17:0/3323256201 wait complete. 2024-09-10T23:20:26.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:26.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 -- 172.21.15.17:0/117917610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415b890 msgr2=0x7fab54072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 --2- 172.21.15.17:0/117917610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415b890 0x7fab54072320 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fab540b0d60 tx=0x7fab4401c7a0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 -- 172.21.15.17:0/117917610 shutdown_connections 2024-09-10T23:20:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 --2- 172.21.15.17:0/117917610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab540d19b0 0x7fab540d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 --2- 172.21.15.17:0/117917610 >> v2:172.21.15.77:3300/0 conn(0x7fab5415bc70 0x7fab540d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 --2- 172.21.15.17:0/117917610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415b890 0x7fab54072320 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 -- 172.21.15.17:0/117917610 >> 172.21.15.17:0/117917610 conn(0x7fab5409a9f0 msgr2=0x7fab5409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 -- 172.21.15.17:0/117917610 shutdown_connections 2024-09-10T23:20:26.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 -- 172.21.15.17:0/117917610 wait complete. 2024-09-10T23:20:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 Processor -- start 2024-09-10T23:20:26.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.917+0000 7fab53200640 1 -- start start 2024-09-10T23:20:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab53200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab540d19b0 0x7fab54156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab53200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab5415b890 0x7fab5414bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab53200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415bc70 0x7fab5414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab53200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fab54071070 con 0x7fab5415bc70 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab53200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab54070ef0 con 0x7fab5415b890 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab53200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fab540711f0 con 0x7fab540d19b0 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab52800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415bc70 0x7fab5414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab52800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415bc70 0x7fab5414c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49820/0 (socket says 172.21.15.17:49820) 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab52800640 1 -- 172.21.15.17:0/1413279169 learned_addr learned my addr 172.21.15.17:0/1413279169 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab51e00640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab540d19b0 0x7fab54156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab4be00640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab5415b890 0x7fab5414bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab52800640 1 -- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab540d19b0 msgr2=0x7fab54156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab52800640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab540d19b0 0x7fab54156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab52800640 1 -- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab5415b890 msgr2=0x7fab5414bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:26.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab52800640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab5415b890 0x7fab5414bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:26.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab52800640 1 -- 172.21.15.17:0/1413279169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5414ed80 con 0x7fab5415bc70 2024-09-10T23:20:26.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab52800640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415bc70 0x7fab5414c170 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00e990 tx=0x7fab4c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab4a000640 1 -- 172.21.15.17:0/1413279169 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c004d30 con 0x7fab5415bc70 2024-09-10T23:20:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab4a000640 1 -- 172.21.15.17:0/1413279169 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab4c00cb00 con 0x7fab5415bc70 2024-09-10T23:20:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab4a000640 1 -- 172.21.15.17:0/1413279169 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c005020 con 0x7fab5415bc70 2024-09-10T23:20:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab540b6af0 con 0x7fab5415bc70 2024-09-10T23:20:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab541589e0 con 0x7fab5415bc70 2024-09-10T23:20:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.921+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab54072320 con 0x7fab5415bc70 2024-09-10T23:20:26.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.925+0000 7fab4a000640 1 -- 172.21.15.17:0/1413279169 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fab4c00f040 con 0x7fab5415bc70 2024-09-10T23:20:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.925+0000 7fab4a000640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fab300725e0 0x7fab30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.925+0000 7fab4a000640 1 -- 172.21.15.17:0/1413279169 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7fab4c093970 con 0x7fab5415bc70 2024-09-10T23:20:26.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.925+0000 7fab51e00640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fab300725e0 0x7fab30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:26.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.925+0000 7fab51e00640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fab300725e0 0x7fab30074aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fab440ae000 tx=0x7fab4401afe0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:26.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:26.929+0000 7fab4a000640 1 -- 172.21.15.17:0/1413279169 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fab4c016030 con 0x7fab5415bc70 2024-09-10T23:20:27.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab540cbe20 con 0x7fab5415bc70 2024-09-10T23:20:27.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab4a000640 1 -- 172.21.15.17:0/1413279169 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7fab4c05e780 con 0x7fab5415bc70 2024-09-10T23:20:27.142 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:27.142 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"btime":"2024-09-10T23:20:17:731093+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:17.731089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2034416577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2034416577},{"type":"v1","addr":"172.21.15.17:6835","nonce":2034416577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6322,"qdb_cluster":[6322]},"id":4}]} 2024-09-10T23:20:27.142 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 47 2024-09-10T23:20:27.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fab300725e0 msgr2=0x7fab30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fab300725e0 0x7fab30074aa0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fab440ae000 tx=0x7fab4401afe0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415bc70 msgr2=0x7fab5414c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415bc70 0x7fab5414c170 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00e990 tx=0x7fab4c00ee50 comp rx=0 tx=0).stop 2024-09-10T23:20:27.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 shutdown_connections 2024-09-10T23:20:27.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fab300725e0 0x7fab30074aa0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab5415bc70 0x7fab5414c170 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab5415b890 0x7fab5414bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 --2- 172.21.15.17:0/1413279169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab540d19b0 0x7fab54156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 >> 172.21.15.17:0/1413279169 conn(0x7fab5409a9f0 msgr2=0x7fab54157b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:27.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 shutdown_connections 2024-09-10T23:20:27.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.137+0000 7fab53200640 1 -- 172.21.15.17:0/1413279169 wait complete. 2024-09-10T23:20:27.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:20:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 -- 172.21.15.17:0/3395322783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe98c0d1410 msgr2=0x7fe98c06df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 --2- 172.21.15.17:0/3395322783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe98c0d1410 0x7fe98c06df00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe978009840 tx=0x7fe97801c7f0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 -- 172.21.15.17:0/3395322783 shutdown_connections 2024-09-10T23:20:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 --2- 172.21.15.17:0/3395322783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe98c0d1410 0x7fe98c06df00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 --2- 172.21.15.17:0/3395322783 >> v2:172.21.15.77:3300/0 conn(0x7fe98c15deb0 0x7fe98c0cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 -- 172.21.15.17:0/3395322783 >> 172.21.15.17:0/3395322783 conn(0x7fe98c09a9f0 msgr2=0x7fe98c09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 -- 172.21.15.17:0/3395322783 shutdown_connections 2024-09-10T23:20:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 -- 172.21.15.17:0/3395322783 wait complete. 2024-09-10T23:20:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 Processor -- start 2024-09-10T23:20:27.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 -- start start 2024-09-10T23:20:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe98c0d1410 0x7fe98c0c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:27.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98c0d1a00 0x7fe98c152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe98c15deb0 0x7fe98c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c16aeb0 con 0x7fe98c15deb0 2024-09-10T23:20:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c16ad30 con 0x7fe98c0d1a00 2024-09-10T23:20:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe98c16b030 con 0x7fe98c0d1410 2024-09-10T23:20:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe98c15deb0 0x7fe98c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe990c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98c0d1a00 0x7fe98c152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe991600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe98c0d1410 0x7fe98c0c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe98c15deb0 0x7fe98c15a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49834/0 (socket says 172.21.15.17:49834) 2024-09-10T23:20:27.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.309+0000 7fe992000640 1 -- 172.21.15.17:0/2922872372 learned_addr learned my addr 172.21.15.17:0/2922872372 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:27.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe992000640 1 -- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe98c0d1410 msgr2=0x7fe98c0c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe992000640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe98c0d1410 0x7fe98c0c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe992000640 1 -- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98c0d1a00 msgr2=0x7fe98c152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe992000640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98c0d1a00 0x7fe98c152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe992000640 1 -- 172.21.15.17:0/2922872372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c0c8440 con 0x7fe98c15deb0 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe990c00640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98c0d1a00 0x7fe98c152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe992000640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe98c15deb0 0x7fe98c15a520 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe98400cbc0 tx=0x7fe98400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe989600640 1 -- 172.21.15.17:0/2922872372 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984016020 con 0x7fe98c15deb0 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe989600640 1 -- 172.21.15.17:0/2922872372 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe98400ab40 con 0x7fe98c15deb0 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c15ca90 con 0x7fe98c15deb0 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe989600640 1 -- 172.21.15.17:0/2922872372 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984012420 con 0x7fe98c15deb0 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c1538b0 con 0x7fe98c15deb0 2024-09-10T23:20:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98c06df00 con 0x7fe98c15deb0 2024-09-10T23:20:27.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.313+0000 7fe989600640 1 -- 172.21.15.17:0/2922872372 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe98401b400 con 0x7fe98c15deb0 2024-09-10T23:20:27.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.317+0000 7fe989600640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe96c0725e0 0x7fe96c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:27.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.317+0000 7fe989600640 1 -- 172.21.15.17:0/2922872372 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7fe984093960 con 0x7fe98c15deb0 2024-09-10T23:20:27.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.317+0000 7fe991600640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe96c0725e0 0x7fe96c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:27.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.317+0000 7fe991600640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe96c0725e0 0x7fe96c074aa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe980009b40 tx=0x7fe9800091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:27.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.321+0000 7fe989600640 1 -- 172.21.15.17:0/2922872372 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe984020020 con 0x7fe98c15deb0 2024-09-10T23:20:27.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.497+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe98c15b1f0 con 0x7fe98c15deb0 2024-09-10T23:20:27.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.497+0000 7fe989600640 1 -- 172.21.15.17:0/2922872372 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17252 (secure 0 0 0) 0x7fe98c0c8440 con 0x7fe98c15deb0 2024-09-10T23:20:27.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:27.503 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:20:18.737836+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:19:52.398174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T23:19:53.652193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":4,"to":5}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/3704108078":"2024-09-11T23:20:13.712789+0000","172.21.15.17:6833/3704108078":"2024-09-11T23:20:13.712789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:20:27.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe96c0725e0 msgr2=0x7fe96c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe96c0725e0 0x7fe96c074aa0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe980009b40 tx=0x7fe9800091e0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe98c15deb0 msgr2=0x7fe98c15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe98c15deb0 0x7fe98c15a520 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe98400cbc0 tx=0x7fe98400ccb0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 shutdown_connections 2024-09-10T23:20:27.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe96c0725e0 0x7fe96c074aa0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe98c15deb0 0x7fe98c15a520 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe98c0d1a00 0x7fe98c152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 --2- 172.21.15.17:0/2922872372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe98c0d1410 0x7fe98c0c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 >> 172.21.15.17:0/2922872372 conn(0x7fe98c09a9f0 msgr2=0x7fe98c15d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:27.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 shutdown_connections 2024-09-10T23:20:27.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.501+0000 7fe992a00640 1 -- 172.21.15.17:0/2922872372 wait complete. 2024-09-10T23:20:27.524 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:20:27.524 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.665+0000 7f0861c00640 1 -- 172.21.15.17:0/343602439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0840003ab0 msgr2=0x7f0840003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.665+0000 7f0861c00640 1 --2- 172.21.15.17:0/343602439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0840003ab0 0x7f0840003ef0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f084c009b60 tx=0x7f084c01d180 comp rx=0 tx=0).stop 2024-09-10T23:20:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.665+0000 7f0861c00640 1 -- 172.21.15.17:0/343602439 shutdown_connections 2024-09-10T23:20:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.665+0000 7f0861c00640 1 --2- 172.21.15.17:0/343602439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0840003ab0 0x7f0840003ef0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.665+0000 7f0861c00640 1 -- 172.21.15.17:0/343602439 >> 172.21.15.17:0/343602439 conn(0x7f085c0d1d60 msgr2=0x7f085c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.665+0000 7f0861c00640 1 -- 172.21.15.17:0/343602439 shutdown_connections 2024-09-10T23:20:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.665+0000 7f0861c00640 1 -- 172.21.15.17:0/343602439 wait complete. 2024-09-10T23:20:27.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 Processor -- start 2024-09-10T23:20:27.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 -- start start 2024-09-10T23:20:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840003ab0 0x7f085c150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0c65a0 0x7f085c0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f085c0cbe30 0x7f085c0c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f085c15f470 con 0x7f085c0cbe30 2024-09-10T23:20:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f085c15f2f0 con 0x7f0840003ab0 2024-09-10T23:20:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f085c15f5f0 con 0x7f085c0c65a0 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f085c0cbe30 0x7f085c0c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f085c0cbe30 0x7f085c0c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49854/0 (socket says 172.21.15.17:49854) 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085b400640 1 -- 172.21.15.17:0/1138761630 learned_addr learned my addr 172.21.15.17:0/1138761630 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0853e00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0c65a0 0x7f085c0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085aa00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840003ab0 0x7f085c150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085b400640 1 -- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0c65a0 msgr2=0x7f085c0cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085b400640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0c65a0 0x7f085c0cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085b400640 1 -- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840003ab0 msgr2=0x7f085c150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085b400640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840003ab0 0x7f085c150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085b400640 1 -- 172.21.15.17:0/1138761630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085c0b2a80 con 0x7f085c0cbe30 2024-09-10T23:20:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f085b400640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f085c0cbe30 0x7f085c0c8e30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f085c0d1c10 tx=0x7f085400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:27.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0852a00640 1 -- 172.21.15.17:0/1138761630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0854015020 con 0x7f085c0cbe30 2024-09-10T23:20:27.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0852a00640 1 -- 172.21.15.17:0/1138761630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f085400cd30 con 0x7f085c0cbe30 2024-09-10T23:20:27.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085c0b2d60 con 0x7f085c0cbe30 2024-09-10T23:20:27.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0852a00640 1 -- 172.21.15.17:0/1138761630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08540116c0 con 0x7f085c0cbe30 2024-09-10T23:20:27.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.669+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085c0b3320 con 0x7f085c0cbe30 2024-09-10T23:20:27.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.673+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085c0d0420 con 0x7f085c0cbe30 2024-09-10T23:20:27.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.673+0000 7f0852a00640 1 -- 172.21.15.17:0/1138761630 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0854011860 con 0x7f085c0cbe30 2024-09-10T23:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.673+0000 7f0852a00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0838072610 0x7f0838074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.673+0000 7f0852a00640 1 -- 172.21.15.17:0/1138761630 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7f0854093d50 con 0x7f085c0cbe30 2024-09-10T23:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.673+0000 7f085aa00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0838072610 0x7f0838074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:27.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.677+0000 7f085aa00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0838072610 0x7f0838074ad0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f084c0ae000 tx=0x7f084c019f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.677+0000 7f0852a00640 1 -- 172.21.15.17:0/1138761630 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0854097030 con 0x7f085c0cbe30 2024-09-10T23:20:27.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.889+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f085c0b04c0 con 0x7f085c0cbe30 2024-09-10T23:20:27.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.889+0000 7f0852a00640 1 -- 172.21.15.17:0/1138761630 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f085401f020 con 0x7f085c0cbe30 2024-09-10T23:20:27.895 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:27.895 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"btime":"2024-09-10T23:20:17:731093+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:17.731089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2034416577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2034416577},{"type":"v1","addr":"172.21.15.17:6835","nonce":2034416577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6322,"qdb_cluster":[6322]},"id":4}]} 2024-09-10T23:20:27.895 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 47 2024-09-10T23:20:27.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0838072610 msgr2=0x7f0838074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0838072610 0x7f0838074ad0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f084c0ae000 tx=0x7f084c019f20 comp rx=0 tx=0).stop 2024-09-10T23:20:27.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f085c0cbe30 msgr2=0x7f085c0c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:27.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f085c0cbe30 0x7f085c0c8e30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f085c0d1c10 tx=0x7f085400ed70 comp rx=0 tx=0).stop 2024-09-10T23:20:27.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 shutdown_connections 2024-09-10T23:20:27.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0838072610 0x7f0838074ad0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f085c0cbe30 0x7f085c0c8e30 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f085c0c65a0 0x7f085c0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 --2- 172.21.15.17:0/1138761630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840003ab0 0x7f085c150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 >> 172.21.15.17:0/1138761630 conn(0x7f085c0d1d60 msgr2=0x7f085c1ed5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 shutdown_connections 2024-09-10T23:20:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:27.893+0000 7f0861c00640 1 -- 172.21.15.17:0/1138761630 wait complete. 2024-09-10T23:20:27.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:28.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.057+0000 7f8d99600640 1 -- 172.21.15.17:0/2757510619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160660 msgr2=0x7f8d940d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.057+0000 7f8d99600640 1 --2- 172.21.15.17:0/2757510619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160660 0x7f8d940d0030 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8d94073bd0 tx=0x7f8d8c01f580 comp rx=0 tx=0).stop 2024-09-10T23:20:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.057+0000 7f8d99600640 1 -- 172.21.15.17:0/2757510619 shutdown_connections 2024-09-10T23:20:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.057+0000 7f8d99600640 1 --2- 172.21.15.17:0/2757510619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160660 0x7f8d940d0030 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.057+0000 7f8d99600640 1 --2- 172.21.15.17:0/2757510619 >> v2:172.21.15.77:3300/0 conn(0x7f8d94160280 0x7f8d940cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.057+0000 7f8d99600640 1 -- 172.21.15.17:0/2757510619 >> 172.21.15.17:0/2757510619 conn(0x7f8d940d1d10 msgr2=0x7f8d940d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.057+0000 7f8d99600640 1 -- 172.21.15.17:0/2757510619 shutdown_connections 2024-09-10T23:20:28.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.057+0000 7f8d99600640 1 -- 172.21.15.17:0/2757510619 wait complete. 2024-09-10T23:20:28.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 Processor -- start 2024-09-10T23:20:28.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 -- start start 2024-09-10T23:20:28.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d940d2830 0x7f8d940b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160280 0x7f8d941f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d94160660 0x7f8d940c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d940afcb0 con 0x7f8d94160280 2024-09-10T23:20:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d940b2970 con 0x7f8d940d2830 2024-09-10T23:20:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8d940afe30 con 0x7f8d94160660 2024-09-10T23:20:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160280 0x7f8d941f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160280 0x7f8d941f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49882/0 (socket says 172.21.15.17:49882) 2024-09-10T23:20:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8be00640 1 -- 172.21.15.17:0/412507097 learned_addr learned my addr 172.21.15.17:0/412507097 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d93400640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d94160660 0x7f8d940c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d92a00640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d940d2830 0x7f8d940b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8be00640 1 -- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d94160660 msgr2=0x7f8d940c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8be00640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d94160660 0x7f8d940c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8be00640 1 -- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d940d2830 msgr2=0x7f8d940b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8be00640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d940d2830 0x7f8d940b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8be00640 1 -- 172.21.15.17:0/412507097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d941f8aa0 con 0x7f8d94160280 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d92a00640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d940d2830 0x7f8d940b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8be00640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160280 0x7f8d941f8560 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00c480 tx=0x7f8d7c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8aa00640 1 -- 172.21.15.17:0/412507097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c012830 con 0x7f8d94160280 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8aa00640 1 -- 172.21.15.17:0/412507097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d7c017070 con 0x7f8d94160280 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d8aa00640 1 -- 172.21.15.17:0/412507097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c012d80 con 0x7f8d94160280 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d940cf140 con 0x7f8d94160280 2024-09-10T23:20:28.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.061+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d940c7740 con 0x7f8d94160280 2024-09-10T23:20:28.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.065+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d940c7910 con 0x7f8d94160280 2024-09-10T23:20:28.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.065+0000 7f8d8aa00640 1 -- 172.21.15.17:0/412507097 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8d7c01c460 con 0x7f8d94160280 2024-09-10T23:20:28.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.065+0000 7f8d8aa00640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d700725e0 0x7f8d70074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.065+0000 7f8d8aa00640 1 -- 172.21.15.17:0/412507097 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7f8d7c0931f0 con 0x7f8d94160280 2024-09-10T23:20:28.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.065+0000 7f8d92a00640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d700725e0 0x7f8d70074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.065+0000 7f8d92a00640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d700725e0 0x7f8d70074aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d840058d0 tx=0x7f8d84005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.069+0000 7f8d8aa00640 1 -- 172.21.15.17:0/412507097 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8d941f8aa0 con 0x7f8d94160280 2024-09-10T23:20:28.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.277+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d940cf310 con 0x7f8d94160280 2024-09-10T23:20:28.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.277+0000 7f8d8aa00640 1 -- 172.21.15.17:0/412507097 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5222 (secure 0 0 0) 0x7f8d7c05e6f0 con 0x7f8d94160280 2024-09-10T23:20:28.285 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:28.285 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"btime":"2024-09-10T23:20:17:731093+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:19:54.687197+0000","modified":"2024-09-10T23:20:17.731089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":74,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2034416577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2034416577},{"type":"v1","addr":"172.21.15.17:6835","nonce":2034416577}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6322,"qdb_cluster":[6322]},"id":4}]} 2024-09-10T23:20:28.285 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 47 2024-09-10T23:20:28.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d700725e0 msgr2=0x7f8d70074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d700725e0 0x7f8d70074aa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d840058d0 tx=0x7f8d84005860 comp rx=0 tx=0).stop 2024-09-10T23:20:28.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160280 msgr2=0x7f8d941f8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160280 0x7f8d941f8560 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00c480 tx=0x7f8d7c00c940 comp rx=0 tx=0).stop 2024-09-10T23:20:28.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 shutdown_connections 2024-09-10T23:20:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d700725e0 0x7f8d70074aa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d94160660 0x7f8d940c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94160280 0x7f8d941f8560 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 --2- 172.21.15.17:0/412507097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d940d2830 0x7f8d940b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 >> 172.21.15.17:0/412507097 conn(0x7f8d940d1d10 msgr2=0x7f8d940d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 shutdown_connections 2024-09-10T23:20:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.281+0000 7f8d99600640 1 -- 172.21.15.17:0/412507097 wait complete. 2024-09-10T23:20:28.307 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:20:28.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.449+0000 7f68dbe00640 1 -- 172.21.15.17:0/846575546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68dc073610 msgr2=0x7f68dc0739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.449+0000 7f68dbe00640 1 --2- 172.21.15.17:0/846575546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68dc073610 0x7f68dc0739f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009900 tx=0x7f68cc01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.449+0000 7f68dbe00640 1 -- 172.21.15.17:0/846575546 shutdown_connections 2024-09-10T23:20:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.449+0000 7f68dbe00640 1 --2- 172.21.15.17:0/846575546 >> v2:172.21.15.77:3300/0 conn(0x7f68dc070fa0 0x7f68dc15ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.449+0000 7f68dbe00640 1 --2- 172.21.15.17:0/846575546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68dc073610 0x7f68dc0739f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.449+0000 7f68dbe00640 1 -- 172.21.15.17:0/846575546 >> 172.21.15.17:0/846575546 conn(0x7f68dc0cfd30 msgr2=0x7f68dc0d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.449+0000 7f68dbe00640 1 -- 172.21.15.17:0/846575546 shutdown_connections 2024-09-10T23:20:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.449+0000 7f68dbe00640 1 -- 172.21.15.17:0/846575546 wait complete. 2024-09-10T23:20:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.449+0000 7f68dbe00640 1 Processor -- start 2024-09-10T23:20:28.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 -- start start 2024-09-10T23:20:28.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68dc070a70 0x7f68dc14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68dc070fa0 0x7f68dc1f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68dc073610 0x7f68dc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc06f550 con 0x7f68dc073610 2024-09-10T23:20:28.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc06f3d0 con 0x7f68dc070fa0 2024-09-10T23:20:28.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f68dc06f6d0 con 0x7f68dc070a70 2024-09-10T23:20:28.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68db400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68dc073610 0x7f68dc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68da000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68dc070fa0 0x7f68dc1f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68daa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68dc070a70 0x7f68dc14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68db400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68dc073610 0x7f68dc0b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49888/0 (socket says 172.21.15.17:49888) 2024-09-10T23:20:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68db400640 1 -- 172.21.15.17:0/1474366775 learned_addr learned my addr 172.21.15.17:0/1474366775 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68db400640 1 -- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68dc070a70 msgr2=0x7f68dc14f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68db400640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68dc070a70 0x7f68dc14f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68db400640 1 -- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68dc070fa0 msgr2=0x7f68dc1f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68db400640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68dc070fa0 0x7f68dc1f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68db400640 1 -- 172.21.15.17:0/1474366775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc14f6f0 con 0x7f68dc073610 2024-09-10T23:20:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68daa00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68dc070a70 0x7f68dc14f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68db400640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68dc073610 0x7f68dc0b32e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f68d400c7a0 tx=0x7f68d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68d2a00640 1 -- 172.21.15.17:0/1474366775 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4003b80 con 0x7f68dc073610 2024-09-10T23:20:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68d2a00640 1 -- 172.21.15.17:0/1474366775 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68d4003d40 con 0x7f68dc073610 2024-09-10T23:20:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68dc1f80f0 con 0x7f68dc073610 2024-09-10T23:20:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68d2a00640 1 -- 172.21.15.17:0/1474366775 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d400aab0 con 0x7f68dc073610 2024-09-10T23:20:28.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68dc15c510 con 0x7f68dc073610 2024-09-10T23:20:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.453+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68dc0739f0 con 0x7f68dc073610 2024-09-10T23:20:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.457+0000 7f68d2a00640 1 -- 172.21.15.17:0/1474366775 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f68d400ac50 con 0x7f68dc073610 2024-09-10T23:20:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.457+0000 7f68d2a00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68bc0725e0 0x7f68bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.457+0000 7f68d2a00640 1 -- 172.21.15.17:0/1474366775 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7f68d4093190 con 0x7f68dc073610 2024-09-10T23:20:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.457+0000 7f68daa00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68bc0725e0 0x7f68bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.457+0000 7f68daa00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68bc0725e0 0x7f68bc074aa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0af000 tx=0x7f68cc01b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:28.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.461+0000 7f68d2a00640 1 -- 172.21.15.17:0/1474366775 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f68d405dfa0 con 0x7f68dc073610 2024-09-10T23:20:28.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.637+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68dc09de60 con 0x7f68dc073610 2024-09-10T23:20:28.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68d2a00640 1 -- 172.21.15.17:0/1474366775 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+17252 (secure 0 0 0) 0x7f68d40629d0 con 0x7f68dc073610 2024-09-10T23:20:28.645 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:28.645 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":76,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:20:18.737836+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:19:52.398174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-10T23:19:53.652193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":4,"to":5}]},{"pgid":"10.3d","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/3704108078":"2024-09-11T23:20:13.712789+0000","172.21.15.17:6833/3704108078":"2024-09-11T23:20:13.712789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:20:28.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68bc0725e0 msgr2=0x7f68bc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68bc0725e0 0x7f68bc074aa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0af000 tx=0x7f68cc01b120 comp rx=0 tx=0).stop 2024-09-10T23:20:28.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68dc073610 msgr2=0x7f68dc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68dc073610 0x7f68dc0b32e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f68d400c7a0 tx=0x7f68d400cc60 comp rx=0 tx=0).stop 2024-09-10T23:20:28.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 shutdown_connections 2024-09-10T23:20:28.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68bc0725e0 0x7f68bc074aa0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68dc073610 0x7f68dc0b32e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68dc070fa0 0x7f68dc1f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 --2- 172.21.15.17:0/1474366775 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68dc070a70 0x7f68dc14f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 >> 172.21.15.17:0/1474366775 conn(0x7f68dc0cfd30 msgr2=0x7f68dc15b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:28.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 shutdown_connections 2024-09-10T23:20:28.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.641+0000 7f68dbe00640 1 -- 172.21.15.17:0/1474366775 wait complete. 2024-09-10T23:20:28.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:20:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.809+0000 7f3f95000640 1 -- 172.21.15.17:0/1733587374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f90157e70 msgr2=0x7f3f9015a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.809+0000 7f3f95000640 1 --2- 172.21.15.17:0/1733587374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f90157e70 0x7f3f9015a780 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3f90072430 tx=0x7f3f8001c7a0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.809+0000 7f3f95000640 1 -- 172.21.15.17:0/1733587374 shutdown_connections 2024-09-10T23:20:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.809+0000 7f3f95000640 1 --2- 172.21.15.17:0/1733587374 >> v2:172.21.15.77:3300/0 conn(0x7f3f9015b200 0x7f3f9015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.809+0000 7f3f95000640 1 --2- 172.21.15.17:0/1733587374 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f900c6430 0x7f3f9015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.809+0000 7f3f95000640 1 --2- 172.21.15.17:0/1733587374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f90157e70 0x7f3f9015a780 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.809+0000 7f3f95000640 1 -- 172.21.15.17:0/1733587374 >> 172.21.15.17:0/1733587374 conn(0x7f3f900cfa00 msgr2=0x7f3f900cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:28.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.809+0000 7f3f95000640 1 -- 172.21.15.17:0/1733587374 shutdown_connections 2024-09-10T23:20:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.809+0000 7f3f95000640 1 -- 172.21.15.17:0/1733587374 wait complete. 2024-09-10T23:20:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 Processor -- start 2024-09-10T23:20:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 -- start start 2024-09-10T23:20:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f900c6430 0x7f3f90142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f90157e70 0x7f3f90152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9015b200 0x7f3f90152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9015e800 con 0x7f3f900c6430 2024-09-10T23:20:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9015e680 con 0x7f3f90157e70 2024-09-10T23:20:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9015e980 con 0x7f3f9015b200 2024-09-10T23:20:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f900c6430 0x7f3f90142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f900c6430 0x7f3f90142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49904/0 (socket says 172.21.15.17:49904) 2024-09-10T23:20:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8f400640 1 -- 172.21.15.17:0/988476607 learned_addr learned my addr 172.21.15.17:0/988476607 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f86a00640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f90157e70 0x7f3f90152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8fe00640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9015b200 0x7f3f90152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8f400640 1 -- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9015b200 msgr2=0x7f3f90152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8f400640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9015b200 0x7f3f90152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8f400640 1 -- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f90157e70 msgr2=0x7f3f90152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:28.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8f400640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f90157e70 0x7f3f90152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:28.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8f400640 1 -- 172.21.15.17:0/988476607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f901f5870 con 0x7f3f900c6430 2024-09-10T23:20:28.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f8f400640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f900c6430 0x7f3f90142310 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009850 tx=0x7f3f800a84a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:28.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f87e00640 1 -- 172.21.15.17:0/988476607 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80004040 con 0x7f3f900c6430 2024-09-10T23:20:28.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f87e00640 1 -- 172.21.15.17:0/988476607 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f800041e0 con 0x7f3f900c6430 2024-09-10T23:20:28.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f87e00640 1 -- 172.21.15.17:0/988476607 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80005020 con 0x7f3f900c6430 2024-09-10T23:20:28.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f901f5b50 con 0x7f3f900c6430 2024-09-10T23:20:28.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.813+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f900b2950 con 0x7f3f900c6430 2024-09-10T23:20:28.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.817+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f9015ddd0 con 0x7f3f900c6430 2024-09-10T23:20:28.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.817+0000 7f3f87e00640 1 -- 172.21.15.17:0/988476607 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3f800c1030 con 0x7f3f900c6430 2024-09-10T23:20:28.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.817+0000 7f3f87e00640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f6c072610 0x7f3f6c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:28.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.817+0000 7f3f87e00640 1 -- 172.21.15.17:0/988476607 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6332+0+0 (secure 0 0 0) 0x7f3f8012d170 con 0x7f3f900c6430 2024-09-10T23:20:28.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.817+0000 7f3f86a00640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f6c072610 0x7f3f6c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:28.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.821+0000 7f3f86a00640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f6c072610 0x7f3f6c074ad0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b4220 tx=0x7f3f7800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:28.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:28.821+0000 7f3f87e00640 1 -- 172.21.15.17:0/988476607 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3f800ac030 con 0x7f3f900c6430 2024-09-10T23:20:29.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.037+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3f900d0620 con 0x7f3f900c6430 2024-09-10T23:20:29.041 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:20:29.037+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:20:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.037+0000 7f3f87e00640 1 -- 172.21.15.17:0/988476607 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) ==== 161+0+0 (secure 0 0 0) 0x7f3f800164b0 con 0x7f3f900c6430 2024-09-10T23:20:29.043 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:20:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f6c072610 msgr2=0x7f3f6c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f6c072610 0x7f3f6c074ad0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b4220 tx=0x7f3f7800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f900c6430 msgr2=0x7f3f90142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f900c6430 0x7f3f90142310 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009850 tx=0x7f3f800a84a0 comp rx=0 tx=0).stop 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 shutdown_connections 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f6c072610 0x7f3f6c074ad0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f9015b200 0x7f3f90152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f90157e70 0x7f3f90152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 --2- 172.21.15.17:0/988476607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f900c6430 0x7f3f90142310 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 >> 172.21.15.17:0/988476607 conn(0x7f3f900cfa00 msgr2=0x7f3f9014fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 shutdown_connections 2024-09-10T23:20:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.041+0000 7f3f95000640 1 -- 172.21.15.17:0/988476607 wait complete. 2024-09-10T23:20:29.057 INFO:tasks.ceph.mds.a.smithi017.stderr: -5355> 2024-09-10T23:20:19.725+0000 7f1390400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:20:29.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:20:29.107 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:20:29.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.213+0000 7f809f600640 1 -- 172.21.15.17:0/3347454448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8080003c70 msgr2=0x7f8080004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:29.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.213+0000 7f809f600640 1 --2- 172.21.15.17:0/3347454448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8080003c70 0x7f8080004070 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8098070780 tx=0x7f808c01ce60 comp rx=0 tx=0).stop 2024-09-10T23:20:29.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.213+0000 7f809d600640 1 -- 172.21.15.17:0/3347454448 reap_dead start 2024-09-10T23:20:29.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 -- 172.21.15.17:0/3347454448 shutdown_connections 2024-09-10T23:20:29.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 -- 172.21.15.17:0/3347454448 >> 172.21.15.17:0/3347454448 conn(0x7f80980d1da0 msgr2=0x7f80980d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:29.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 -- 172.21.15.17:0/3347454448 shutdown_connections 2024-09-10T23:20:29.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 -- 172.21.15.17:0/3347454448 wait complete. 2024-09-10T23:20:29.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 Processor -- start 2024-09-10T23:20:29.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 -- start start 2024-09-10T23:20:29.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8080003c70 0x7f80980b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:29.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80981592c0 0x7f809814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:29.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80980710a0 0x7f8098071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:29.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8098167de0 con 0x7f80980710a0 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8098167c60 con 0x7f80981592c0 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809f600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8098167f60 con 0x7f8080003c70 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80980710a0 0x7f8098071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80980710a0 0x7f8098071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49952/0 (socket says 172.21.15.17:49952) 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809d600640 1 -- 172.21.15.17:0/3108313228 learned_addr learned my addr 172.21.15.17:0/3108313228 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f8097e00640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80981592c0 0x7f809814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809cc00640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8080003c70 0x7f80980b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809d600640 1 -- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8080003c70 msgr2=0x7f80980b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809d600640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8080003c70 0x7f80980b7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809d600640 1 -- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80981592c0 msgr2=0x7f809814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809d600640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80981592c0 0x7f809814d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.217+0000 7f809d600640 1 -- 172.21.15.17:0/3108313228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80980cc220 con 0x7f80980710a0 2024-09-10T23:20:29.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.221+0000 7f809d600640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80980710a0 0x7f8098071520 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f80980b7e50 tx=0x7f8090011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.221+0000 7f8094c00640 1 -- 172.21.15.17:0/3108313228 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090003e50 con 0x7f80980710a0 2024-09-10T23:20:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.221+0000 7f8094c00640 1 -- 172.21.15.17:0/3108313228 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8090004b30 con 0x7f80980710a0 2024-09-10T23:20:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.221+0000 7f8094c00640 1 -- 172.21.15.17:0/3108313228 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809000f990 con 0x7f80980710a0 2024-09-10T23:20:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.221+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80981597f0 con 0x7f80980710a0 2024-09-10T23:20:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.221+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8098159d40 con 0x7f80980710a0 2024-09-10T23:20:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.221+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80980cc8b0 con 0x7f80980710a0 2024-09-10T23:20:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.221+0000 7f8094c00640 1 -- 172.21.15.17:0/3108313228 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8090018030 con 0x7f80980710a0 2024-09-10T23:20:29.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.221+0000 7f8094c00640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80780727b0 0x7f8078074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:29.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.225+0000 7f8094c00640 1 -- 172.21.15.17:0/3108313228 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6418+0+0 (secure 0 0 0) 0x7f8090093bb0 con 0x7f80980710a0 2024-09-10T23:20:29.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.225+0000 7f809cc00640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80780727b0 0x7f8078074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:29.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.225+0000 7f809cc00640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80780727b0 0x7f8078074c70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f808c0ac000 tx=0x7f808c019ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:29.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.225+0000 7f8094c00640 1 -- 172.21.15.17:0/3108313228 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f809005efb0 con 0x7f80980710a0 2024-09-10T23:20:29.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:29.441+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f80980723b0 con 0x7f80980710a0 2024-09-10T23:20:30.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.041+0000 7f8094c00640 1 -- 172.21.15.17:0/3108313228 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f809005e8b0 con 0x7f80980710a0 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80780727b0 msgr2=0x7f8078074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80780727b0 0x7f8078074c70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f808c0ac000 tx=0x7f808c019ca0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80980710a0 msgr2=0x7f8098071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80980710a0 0x7f8098071520 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f80980b7e50 tx=0x7f8090011ef0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 shutdown_connections 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80780727b0 0x7f8078074c70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80980710a0 0x7f8098071520 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80981592c0 0x7f809814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 --2- 172.21.15.17:0/3108313228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8080003c70 0x7f80980b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 >> 172.21.15.17:0/3108313228 conn(0x7f80980d1da0 msgr2=0x7f80980d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:30.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 shutdown_connections 2024-09-10T23:20:30.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.045+0000 7f809f600640 1 -- 172.21.15.17:0/3108313228 wait complete. 2024-09-10T23:20:30.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:20:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 -- 172.21.15.17:0/399587586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9e8069590 msgr2=0x7fd9e815ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 --2- 172.21.15.17:0/399587586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9e8069590 0x7fd9e815ea60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80cac40 tx=0x7fd9e001c8e0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 -- 172.21.15.17:0/399587586 shutdown_connections 2024-09-10T23:20:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 --2- 172.21.15.17:0/399587586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9e8069590 0x7fd9e815ea60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 --2- 172.21.15.17:0/399587586 >> v2:172.21.15.77:3300/0 conn(0x7fd9e80b14d0 0x7fd9e8074290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 -- 172.21.15.17:0/399587586 >> 172.21.15.17:0/399587586 conn(0x7fd9e80d0360 msgr2=0x7fd9e80d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 -- 172.21.15.17:0/399587586 shutdown_connections 2024-09-10T23:20:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 -- 172.21.15.17:0/399587586 wait complete. 2024-09-10T23:20:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 Processor -- start 2024-09-10T23:20:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 -- start start 2024-09-10T23:20:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9e8069590 0x7fd9e81fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:30.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9e80afa90 0x7fd9e815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9e80b14d0 0x7fd9e80ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8168170 con 0x7fd9e80b14d0 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8167ff0 con 0x7fd9e80afa90 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.269+0000 7fd9f0000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e81682f0 con 0x7fd9e8069590 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ee000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9e80b14d0 0x7fd9e80ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ee000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9e80b14d0 0x7fd9e80ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49964/0 (socket says 172.21.15.17:49964) 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ee000640 1 -- 172.21.15.17:0/2989769449 learned_addr learned my addr 172.21.15.17:0/2989769449 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ed600640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9e8069590 0x7fd9e81fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ecc00640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9e80afa90 0x7fd9e815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:30.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ee000640 1 -- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9e8069590 msgr2=0x7fd9e81fbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ee000640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9e8069590 0x7fd9e81fbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ee000640 1 -- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9e80afa90 msgr2=0x7fd9e815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ee000640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9e80afa90 0x7fd9e815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ee000640 1 -- 172.21.15.17:0/2989769449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e80c7180 con 0x7fd9e80b14d0 2024-09-10T23:20:30.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9ee000640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9e80b14d0 0x7fd9e80ce7e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009850 tx=0x7fd9e00a55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9e5600640 1 -- 172.21.15.17:0/2989769449 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00bc070 con 0x7fd9e80b14d0 2024-09-10T23:20:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9e5600640 1 -- 172.21.15.17:0/2989769449 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9e00043b0 con 0x7fd9e80b14d0 2024-09-10T23:20:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e80cdeb0 con 0x7fd9e80b14d0 2024-09-10T23:20:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9e5600640 1 -- 172.21.15.17:0/2989769449 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00b2040 con 0x7fd9e80b14d0 2024-09-10T23:20:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e80ce470 con 0x7fd9e80b14d0 2024-09-10T23:20:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e815ea60 con 0x7fd9e80b14d0 2024-09-10T23:20:30.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.273+0000 7fd9e5600640 1 -- 172.21.15.17:0/2989769449 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd9e0003860 con 0x7fd9e80b14d0 2024-09-10T23:20:30.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.277+0000 7fd9e5600640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9c80725e0 0x7fd9c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:30.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.277+0000 7fd9e5600640 1 -- 172.21.15.17:0/2989769449 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6418+0+0 (secure 0 0 0) 0x7fd9e012cfc0 con 0x7fd9e80b14d0 2024-09-10T23:20:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.277+0000 7fd9ed600640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9c80725e0 0x7fd9c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:30.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.277+0000 7fd9ed600640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9c80725e0 0x7fd9c8074aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009980 tx=0x7fd9dc009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:30.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.281+0000 7fd9e5600640 1 -- 172.21.15.17:0/2989769449 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd9e00164d0 con 0x7fd9e80b14d0 2024-09-10T23:20:30.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:30.457+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd9e815e7d0 con 0x7fd9e80b14d0 2024-09-10T23:20:31.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.041+0000 7fd9e5600640 1 -- 172.21.15.17:0/2989769449 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) ==== 181+0+0 (secure 0 0 0) 0x7fd9e00f7d70 con 0x7fd9e80b14d0 2024-09-10T23:20:31.047 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:20:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9c80725e0 msgr2=0x7fd9c8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9c80725e0 0x7fd9c8074aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009980 tx=0x7fd9dc009500 comp rx=0 tx=0).stop 2024-09-10T23:20:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9e80b14d0 msgr2=0x7fd9e80ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9e80b14d0 0x7fd9e80ce7e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009850 tx=0x7fd9e00a55a0 comp rx=0 tx=0).stop 2024-09-10T23:20:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 shutdown_connections 2024-09-10T23:20:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd9c80725e0 0x7fd9c8074aa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9e80b14d0 0x7fd9e80ce7e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9e80afa90 0x7fd9e815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 --2- 172.21.15.17:0/2989769449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9e8069590 0x7fd9e81fbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 >> 172.21.15.17:0/2989769449 conn(0x7fd9e80d0360 msgr2=0x7fd9e80c9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 shutdown_connections 2024-09-10T23:20:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.045+0000 7fd9f0000640 1 -- 172.21.15.17:0/2989769449 wait complete. 2024-09-10T23:20:31.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:20:31.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.221+0000 7fabca600640 1 -- 172.21.15.17:0/3465216202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc415bb40 msgr2=0x7fabc40cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:31.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.221+0000 7fabca600640 1 --2- 172.21.15.17:0/3465216202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc415bb40 0x7fabc40cc7a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009870 tx=0x7fabb401c820 comp rx=0 tx=0).stop 2024-09-10T23:20:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.221+0000 7fabca600640 1 -- 172.21.15.17:0/3465216202 shutdown_connections 2024-09-10T23:20:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.221+0000 7fabca600640 1 --2- 172.21.15.17:0/3465216202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabc40d0980 0x7fabc40b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 --2- 172.21.15.17:0/3465216202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc415bb40 0x7fabc40cc7a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 -- 172.21.15.17:0/3465216202 >> 172.21.15.17:0/3465216202 conn(0x7fabc409a9f0 msgr2=0x7fabc409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 -- 172.21.15.17:0/3465216202 shutdown_connections 2024-09-10T23:20:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 -- 172.21.15.17:0/3465216202 wait complete. 2024-09-10T23:20:31.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 Processor -- start 2024-09-10T23:20:31.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 -- start start 2024-09-10T23:20:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc40ccce0 0x7fabc4158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc40d0980 0x7fabc4153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabc415bb40 0x7fabc41541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fabc41689c0 con 0x7fabc40d0980 2024-09-10T23:20:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4168840 con 0x7fabc40ccce0 2024-09-10T23:20:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabca600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fabc4168b40 con 0x7fabc415bb40 2024-09-10T23:20:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc40d0980 0x7fabc4153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc40d0980 0x7fabc4153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49980/0 (socket says 172.21.15.17:49980) 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc3e00640 1 -- 172.21.15.17:0/1022203937 learned_addr learned my addr 172.21.15.17:0/1022203937 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc9200640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc40ccce0 0x7fabc4158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc9c00640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabc415bb40 0x7fabc41541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc3e00640 1 -- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabc415bb40 msgr2=0x7fabc41541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc3e00640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabc415bb40 0x7fabc41541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc3e00640 1 -- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc40ccce0 msgr2=0x7fabc4158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc3e00640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc40ccce0 0x7fabc4158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc3e00640 1 -- 172.21.15.17:0/1022203937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc41594c0 con 0x7fabc40d0980 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.225+0000 7fabc3e00640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc40d0980 0x7fabc4153c60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c4c0 tx=0x7fabb000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:31.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.229+0000 7fabc0c00640 1 -- 172.21.15.17:0/1022203937 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0016020 con 0x7fabc40d0980 2024-09-10T23:20:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.229+0000 7fabc0c00640 1 -- 172.21.15.17:0/1022203937 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabb0012940 con 0x7fabc40d0980 2024-09-10T23:20:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.229+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc41597a0 con 0x7fabc40d0980 2024-09-10T23:20:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.229+0000 7fabc0c00640 1 -- 172.21.15.17:0/1022203937 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0012d90 con 0x7fabc40d0980 2024-09-10T23:20:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.229+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc41556c0 con 0x7fabc40d0980 2024-09-10T23:20:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.229+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc40b12d0 con 0x7fabc40d0980 2024-09-10T23:20:31.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.229+0000 7fabc0c00640 1 -- 172.21.15.17:0/1022203937 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fabb001b400 con 0x7fabc40d0980 2024-09-10T23:20:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.229+0000 7fabc0c00640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faba40725e0 0x7faba4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.233+0000 7fabc0c00640 1 -- 172.21.15.17:0/1022203937 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5951+0+0 (secure 0 0 0) 0x7fabb00934c0 con 0x7fabc40d0980 2024-09-10T23:20:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.233+0000 7fabc9200640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faba40725e0 0x7faba4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.233+0000 7fabc9200640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faba40725e0 0x7faba4074aa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fabb40af000 tx=0x7fabb401b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.237+0000 7fabc0c00640 1 -- 172.21.15.17:0/1022203937 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fabb0020020 con 0x7fabc40d0980 2024-09-10T23:20:31.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:31.409+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fabc4157ee0 con 0x7fabc40d0980 2024-09-10T23:20:32.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.057+0000 7fabc0c00640 1 -- 172.21.15.17:0/1022203937 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) ==== 169+0+0 (secure 0 0 0) 0x7fabb005e510 con 0x7fabc40d0980 2024-09-10T23:20:32.061 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:20:32.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faba40725e0 msgr2=0x7faba4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faba40725e0 0x7faba4074aa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fabb40af000 tx=0x7fabb401b060 comp rx=0 tx=0).stop 2024-09-10T23:20:32.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc40d0980 msgr2=0x7fabc4153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc40d0980 0x7fabc4153c60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c4c0 tx=0x7fabb000c980 comp rx=0 tx=0).stop 2024-09-10T23:20:32.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 shutdown_connections 2024-09-10T23:20:32.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faba40725e0 0x7faba4074aa0 secure :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fabb40af000 tx=0x7fabb401b060 comp rx=0 tx=0).stop 2024-09-10T23:20:32.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fabc415bb40 0x7fabc41541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc40d0980 0x7fabc4153c60 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 --2- 172.21.15.17:0/1022203937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabc40ccce0 0x7fabc4158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 >> 172.21.15.17:0/1022203937 conn(0x7fabc409a9f0 msgr2=0x7fabc40d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:32.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 shutdown_connections 2024-09-10T23:20:32.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.061+0000 7fabca600640 1 -- 172.21.15.17:0/1022203937 wait complete. 2024-09-10T23:20:32.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:20:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.241+0000 7f9b12400640 1 -- 172.21.15.17:0/2100936300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af0003a10 msgr2=0x7f9af0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.241+0000 7f9b12400640 1 --2- 172.21.15.17:0/2100936300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af0003a10 0x7f9af0003df0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00c260 tx=0x7f9afc01cf60 comp rx=0 tx=0).stop 2024-09-10T23:20:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.241+0000 7f9b12400640 1 -- 172.21.15.17:0/2100936300 shutdown_connections 2024-09-10T23:20:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.241+0000 7f9b12400640 1 --2- 172.21.15.17:0/2100936300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af0003a10 0x7f9af0003df0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.241+0000 7f9b12400640 1 -- 172.21.15.17:0/2100936300 >> 172.21.15.17:0/2100936300 conn(0x7f9b0c0d1d60 msgr2=0x7f9b0c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.241+0000 7f9b12400640 1 -- 172.21.15.17:0/2100936300 shutdown_connections 2024-09-10T23:20:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.241+0000 7f9b12400640 1 -- 172.21.15.17:0/2100936300 wait complete. 2024-09-10T23:20:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.241+0000 7f9b12400640 1 Processor -- start 2024-09-10T23:20:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.241+0000 7f9b12400640 1 -- start start 2024-09-10T23:20:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b12400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af0003a10 0x7f9b0c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b0c0cbbb0 0x7f9b0c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b12400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b0c0c8e30 0x7f9b0c14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b12400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0afe30 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b12400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0afcb0 con 0x7f9af0003a10 2024-09-10T23:20:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b12400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c0affb0 con 0x7f9b0c0c8e30 2024-09-10T23:20:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b0c0cbbb0 0x7f9b0c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b0c0cbbb0 0x7f9b0c0b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50012/0 (socket says 172.21.15.17:50012) 2024-09-10T23:20:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03e00640 1 -- 172.21.15.17:0/3304249673 learned_addr learned my addr 172.21.15.17:0/3304249673 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b0b400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af0003a10 0x7f9b0c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b0be00640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b0c0c8e30 0x7f9b0c14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03e00640 1 -- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b0c0c8e30 msgr2=0x7f9b0c14fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03e00640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b0c0c8e30 0x7f9b0c14fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03e00640 1 -- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af0003a10 msgr2=0x7f9b0c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03e00640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af0003a10 0x7f9b0c0ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03e00640 1 -- 172.21.15.17:0/3304249673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c15f700 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03e00640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b0c0cbbb0 0x7f9b0c0b6e00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9af4011a40 tx=0x7f9af4011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03400640 1 -- 172.21.15.17:0/3304249673 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af401e070 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03400640 1 -- 172.21.15.17:0/3304249673 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9af400fe70 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c0cab10 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03400640 1 -- 172.21.15.17:0/3304249673 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af40042b0 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c0cb0d0 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c0b0510 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.245+0000 7f9b03400640 1 -- 172.21.15.17:0/3304249673 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9af4003600 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.249+0000 7f9b03400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ae8072610 0x7f9ae8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:32.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.249+0000 7f9b03400640 1 -- 172.21.15.17:0/3304249673 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f9af4093cd0 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.249+0000 7f9b0b400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ae8072610 0x7f9ae8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:32.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.249+0000 7f9b0b400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ae8072610 0x7f9ae8074ad0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0ab000 tx=0x7f9afc019da0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:32.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.253+0000 7f9b03400640 1 -- 172.21.15.17:0/3304249673 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9af405ee70 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.433+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f9b0c0ce4d0 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.437+0000 7f9b03400640 1 -- 172.21.15.17:0/3304249673 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v38) ==== 71+0+0 (secure 0 0 0) 0x7f9af40638a0 con 0x7f9b0c0cbbb0 2024-09-10T23:20:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ae8072610 msgr2=0x7f9ae8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ae8072610 0x7f9ae8074ad0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0ab000 tx=0x7f9afc019da0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b0c0cbbb0 msgr2=0x7f9b0c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b0c0cbbb0 0x7f9b0c0b6e00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9af4011a40 tx=0x7f9af4011f00 comp rx=0 tx=0).stop 2024-09-10T23:20:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 shutdown_connections 2024-09-10T23:20:32.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ae8072610 0x7f9ae8074ad0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b0c0c8e30 0x7f9b0c14fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b0c0cbbb0 0x7f9b0c0b6e00 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 --2- 172.21.15.17:0/3304249673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af0003a10 0x7f9b0c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 >> 172.21.15.17:0/3304249673 conn(0x7f9b0c0d1d60 msgr2=0x7f9b0c0d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:32.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 shutdown_connections 2024-09-10T23:20:32.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.441+0000 7f9b12400640 1 -- 172.21.15.17:0/3304249673 wait complete. 2024-09-10T23:20:32.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-10T23:20:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.605+0000 7f5c31a00640 1 -- 172.21.15.17:0/2513069386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf230 msgr2=0x7f5c2c06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.605+0000 7f5c31a00640 1 --2- 172.21.15.17:0/2513069386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf230 0x7f5c2c06e750 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00a950 tx=0x7f5c1c020360 comp rx=0 tx=0).stop 2024-09-10T23:20:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.605+0000 7f5c31a00640 1 -- 172.21.15.17:0/2513069386 shutdown_connections 2024-09-10T23:20:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.605+0000 7f5c31a00640 1 --2- 172.21.15.17:0/2513069386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf230 0x7f5c2c06e750 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.605+0000 7f5c31a00640 1 -- 172.21.15.17:0/2513069386 >> 172.21.15.17:0/2513069386 conn(0x7f5c2c06cfc0 msgr2=0x7f5c2c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.605+0000 7f5c31a00640 1 -- 172.21.15.17:0/2513069386 shutdown_connections 2024-09-10T23:20:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.605+0000 7f5c31a00640 1 -- 172.21.15.17:0/2513069386 wait complete. 2024-09-10T23:20:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 Processor -- start 2024-09-10T23:20:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 -- start start 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c2c0b32d0 0x7f5c2c1f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c2c0cf230 0x7f5c2c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf610 0x7f5c2c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c0d0360 con 0x7f5c2c0cf610 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c0d01e0 con 0x7f5c2c0cf230 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2c0d04e0 con 0x7f5c2c0b32d0 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf610 0x7f5c2c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf610 0x7f5c2c1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50032/0 (socket says 172.21.15.17:50032) 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2b400640 1 -- 172.21.15.17:0/3282492786 learned_addr learned my addr 172.21.15.17:0/3282492786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2aa00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c2c0b32d0 0x7f5c2c1f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c23e00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c2c0cf230 0x7f5c2c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2b400640 1 -- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c2c0b32d0 msgr2=0x7f5c2c1f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2b400640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c2c0b32d0 0x7f5c2c1f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2b400640 1 -- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c2c0cf230 msgr2=0x7f5c2c0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2b400640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c2c0cf230 0x7f5c2c0b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2b400640 1 -- 172.21.15.17:0/3282492786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2c0af840 con 0x7f5c2c0cf610 2024-09-10T23:20:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c2b400640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf610 0x7f5c2c1594c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400c770 tx=0x7f5c2400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c22a00640 1 -- 172.21.15.17:0/3282492786 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24017070 con 0x7f5c2c0cf610 2024-09-10T23:20:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c22a00640 1 -- 172.21.15.17:0/3282492786 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c24005070 con 0x7f5c2c0cf610 2024-09-10T23:20:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c22a00640 1 -- 172.21.15.17:0/3282492786 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c240054c0 con 0x7f5c2c0cf610 2024-09-10T23:20:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2c0afb20 con 0x7f5c2c0cf610 2024-09-10T23:20:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.609+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c2c1f7e10 con 0x7f5c2c0cf610 2024-09-10T23:20:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.613+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c2c06e750 con 0x7f5c2c0cf610 2024-09-10T23:20:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.613+0000 7f5c22a00640 1 -- 172.21.15.17:0/3282492786 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5c24005660 con 0x7f5c2c0cf610 2024-09-10T23:20:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.613+0000 7f5c22a00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c08072610 0x7f5c08074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.613+0000 7f5c22a00640 1 -- 172.21.15.17:0/3282492786 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f5c24092a70 con 0x7f5c2c0cf610 2024-09-10T23:20:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.613+0000 7f5c2aa00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c08072610 0x7f5c08074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.617+0000 7f5c2aa00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c08072610 0x7f5c08074ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c0b2000 tx=0x7f5c1c01eba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.617+0000 7f5c22a00640 1 -- 172.21.15.17:0/3282492786 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5c2405e260 con 0x7f5c2c0cf610 2024-09-10T23:20:32.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:32.849+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f5c2c15b470 con 0x7f5c2c0cf610 2024-09-10T23:20:33.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.061+0000 7f5c22a00640 1 -- 172.21.15.17:0/3282492786 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v248) ==== 151+0+0 (secure 0 0 0) 0x7f5c2405db60 con 0x7f5c2c0cf610 2024-09-10T23:20:33.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c08072610 msgr2=0x7f5c08074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c08072610 0x7f5c08074ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c0b2000 tx=0x7f5c1c01eba0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf610 msgr2=0x7f5c2c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf610 0x7f5c2c1594c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400c770 tx=0x7f5c2400cc30 comp rx=0 tx=0).stop 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 shutdown_connections 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c08072610 0x7f5c08074ad0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c0cf610 0x7f5c2c1594c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c2c0cf230 0x7f5c2c0b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 --2- 172.21.15.17:0/3282492786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c2c0b32d0 0x7f5c2c1f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 >> 172.21.15.17:0/3282492786 conn(0x7f5c2c06cfc0 msgr2=0x7f5c2c150520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 shutdown_connections 2024-09-10T23:20:33.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.065+0000 7f5c31a00640 1 -- 172.21.15.17:0/3282492786 wait complete. 2024-09-10T23:20:33.088 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-09-10T23:20:33.088 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T23:20:33.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:20:33.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.229+0000 7f06f3600640 1 -- 172.21.15.17:0/2244215070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ec15f730 msgr2=0x7f06ec0ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.229+0000 7f06f3600640 1 --2- 172.21.15.17:0/2244215070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ec15f730 0x7f06ec0ce720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009840 tx=0x7f06d401c790 comp rx=0 tx=0).stop 2024-09-10T23:20:33.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.229+0000 7f06f3600640 1 -- 172.21.15.17:0/2244215070 shutdown_connections 2024-09-10T23:20:33.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.229+0000 7f06f3600640 1 --2- 172.21.15.17:0/2244215070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ec15f730 0x7f06ec0ce720 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.229+0000 7f06f3600640 1 --2- 172.21.15.17:0/2244215070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06ec15f350 0x7f06ec0b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.229+0000 7f06f3600640 1 -- 172.21.15.17:0/2244215070 >> 172.21.15.17:0/2244215070 conn(0x7f06ec0d1d10 msgr2=0x7f06ec0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:33.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.229+0000 7f06f3600640 1 -- 172.21.15.17:0/2244215070 shutdown_connections 2024-09-10T23:20:33.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.229+0000 7f06f3600640 1 -- 172.21.15.17:0/2244215070 wait complete. 2024-09-10T23:20:33.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 Processor -- start 2024-09-10T23:20:33.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 -- start start 2024-09-10T23:20:33.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06ec0cec60 0x7f06ec1fb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ec15f350 0x7f06ec0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06ec15f730 0x7f06ec166130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec168f60 con 0x7f06ec0cec60 2024-09-10T23:20:33.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec168de0 con 0x7f06ec15f350 2024-09-10T23:20:33.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f06ec1690e0 con 0x7f06ec15f730 2024-09-10T23:20:33.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06ec0cec60 0x7f06ec1fb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06ec0cec60 0x7f06ec1fb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50048/0 (socket says 172.21.15.17:50048) 2024-09-10T23:20:33.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f0c00640 1 -- 172.21.15.17:0/3143539259 learned_addr learned my addr 172.21.15.17:0/3143539259 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:33.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f0c00640 1 -- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06ec15f730 msgr2=0x7f06ec166130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f0c00640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06ec15f730 0x7f06ec166130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f0c00640 1 -- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ec15f350 msgr2=0x7f06ec0cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f0c00640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ec15f350 0x7f06ec0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f0c00640 1 -- 172.21.15.17:0/3143539259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec1f82e0 con 0x7f06ec0cec60 2024-09-10T23:20:33.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f0c00640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06ec0cec60 0x7f06ec1fb7c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00ea20 tx=0x7f06dc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:33.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06e9600640 1 -- 172.21.15.17:0/3143539259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00cd80 con 0x7f06ec0cec60 2024-09-10T23:20:33.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec0cbab0 con 0x7f06ec0cec60 2024-09-10T23:20:33.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06e9600640 1 -- 172.21.15.17:0/3143539259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06dc010430 con 0x7f06ec0cec60 2024-09-10T23:20:33.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06e9600640 1 -- 172.21.15.17:0/3143539259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc010860 con 0x7f06ec0cec60 2024-09-10T23:20:33.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.233+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec1fc080 con 0x7f06ec0cec60 2024-09-10T23:20:33.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.237+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec0b3130 con 0x7f06ec0cec60 2024-09-10T23:20:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.237+0000 7f06e9600640 1 -- 172.21.15.17:0/3143539259 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f06dc010a00 con 0x7f06ec0cec60 2024-09-10T23:20:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.237+0000 7f06e9600640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c80725e0 0x7f06c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.237+0000 7f06e9600640 1 -- 172.21.15.17:0/3143539259 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f06dc093e80 con 0x7f06ec0cec60 2024-09-10T23:20:33.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.237+0000 7f06e3e00640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c80725e0 0x7f06c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.237+0000 7f06e3e00640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c80725e0 0x7f06c8074aa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06d40af000 tx=0x7f06d4019530 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:33.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.241+0000 7f06e9600640 1 -- 172.21.15.17:0/3143539259 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f06ec0cbab0 con 0x7f06ec0cec60 2024-09-10T23:20:33.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.417+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06ec0d2190 con 0x7f06ec0cec60 2024-09-10T23:20:33.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.417+0000 7f06e9600640 1 -- 172.21.15.17:0/3143539259 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+13376 (secure 0 0 0) 0x7f06dc05f560 con 0x7f06ec0cec60 2024-09-10T23:20:33.422 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:33.422 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":79,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:20:32.058767+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/2034416577":"2024-09-11T23:20:29.041674+0000","172.21.15.17:6833/2034416577":"2024-09-11T23:20:29.041674+0000","172.21.15.17:6835/3704108078":"2024-09-11T23:20:13.712789+0000","172.21.15.17:6833/3704108078":"2024-09-11T23:20:13.712789+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:20:33.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c80725e0 msgr2=0x7f06c8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c80725e0 0x7f06c8074aa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06d40af000 tx=0x7f06d4019530 comp rx=0 tx=0).stop 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06ec0cec60 msgr2=0x7f06ec1fb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06ec0cec60 0x7f06ec1fb7c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00ea20 tx=0x7f06dc00eee0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 shutdown_connections 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06c80725e0 0x7f06c8074aa0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06ec15f730 0x7f06ec166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ec15f350 0x7f06ec0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 --2- 172.21.15.17:0/3143539259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06ec0cec60 0x7f06ec1fb7c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 >> 172.21.15.17:0/3143539259 conn(0x7f06ec0d1d10 msgr2=0x7f06ec15c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 shutdown_connections 2024-09-10T23:20:33.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.421+0000 7f06f3600640 1 -- 172.21.15.17:0/3143539259 wait complete. 2024-09-10T23:20:33.445 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:20:33.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:20:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.589+0000 7f3c84400640 1 -- 172.21.15.17:0/1470512121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c0d1cb0 msgr2=0x7f3c7c0d20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.589+0000 7f3c84400640 1 --2- 172.21.15.17:0/1470512121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c0d1cb0 0x7f3c7c0d20b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c15bfe0 tx=0x7f3c7401cb80 comp rx=0 tx=0).stop 2024-09-10T23:20:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.589+0000 7f3c84400640 1 -- 172.21.15.17:0/1470512121 shutdown_connections 2024-09-10T23:20:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.589+0000 7f3c84400640 1 --2- 172.21.15.17:0/1470512121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c0d1cb0 0x7f3c7c0d20b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.589+0000 7f3c84400640 1 --2- 172.21.15.17:0/1470512121 >> v2:172.21.15.77:3300/0 conn(0x7f3c7c0cfde0 0x7f3c7c0d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.589+0000 7f3c84400640 1 -- 172.21.15.17:0/1470512121 >> 172.21.15.17:0/1470512121 conn(0x7f3c7c09a9f0 msgr2=0x7f3c7c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.589+0000 7f3c84400640 1 -- 172.21.15.17:0/1470512121 shutdown_connections 2024-09-10T23:20:33.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.589+0000 7f3c84400640 1 -- 172.21.15.17:0/1470512121 wait complete. 2024-09-10T23:20:33.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 Processor -- start 2024-09-10T23:20:33.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 -- start start 2024-09-10T23:20:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c7c0cfde0 0x7f3c7c09d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c7c0d1cb0 0x7f3c7c09f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c15eef0 0x7f3c7c0b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c16af90 con 0x7f3c7c15eef0 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7c16ae10 con 0x7f3c7c0cfde0 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3c7c16b110 con 0x7f3c7c0d1cb0 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c82400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c15eef0 0x7f3c7c0b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c82400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c15eef0 0x7f3c7c0b1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50076/0 (socket says 172.21.15.17:50076) 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c82400640 1 -- 172.21.15.17:0/481683525 learned_addr learned my addr 172.21.15.17:0/481683525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c81a00640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c7c0cfde0 0x7f3c7c09d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c81000640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c7c0d1cb0 0x7f3c7c09f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c82400640 1 -- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c7c0d1cb0 msgr2=0x7f3c7c09f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c82400640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c7c0d1cb0 0x7f3c7c09f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c82400640 1 -- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c7c0cfde0 msgr2=0x7f3c7c09d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c82400640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c7c0cfde0 0x7f3c7c09d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c82400640 1 -- 172.21.15.17:0/481683525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7c0c5af0 con 0x7f3c7c15eef0 2024-09-10T23:20:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c81000640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c7c0d1cb0 0x7f3c7c09f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c81a00640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c7c0cfde0 0x7f3c7c09d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c82400640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c15eef0 0x7f3c7c0b1960 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009b10 tx=0x7f3c74009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c79600640 1 -- 172.21.15.17:0/481683525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c740bb070 con 0x7f3c7c15eef0 2024-09-10T23:20:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c79600640 1 -- 172.21.15.17:0/481683525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c74004d40 con 0x7f3c7c15eef0 2024-09-10T23:20:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c79600640 1 -- 172.21.15.17:0/481683525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c740b2040 con 0x7f3c7c15eef0 2024-09-10T23:20:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7c0c5dd0 con 0x7f3c7c15eef0 2024-09-10T23:20:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7c0c6390 con 0x7f3c7c15eef0 2024-09-10T23:20:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.593+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c7c0d0230 con 0x7f3c7c15eef0 2024-09-10T23:20:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.597+0000 7f3c79600640 1 -- 172.21.15.17:0/481683525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3c740b5030 con 0x7f3c7c15eef0 2024-09-10T23:20:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.597+0000 7f3c79600640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c5c0725e0 0x7f3c5c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.597+0000 7f3c79600640 1 -- 172.21.15.17:0/481683525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f3c7412ce00 con 0x7f3c7c15eef0 2024-09-10T23:20:33.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.597+0000 7f3c81a00640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c5c0725e0 0x7f3c5c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.597+0000 7f3c81a00640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c5c0725e0 0x7f3c5c074aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0c71d0 tx=0x7f3c70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:33.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.601+0000 7f3c79600640 1 -- 172.21.15.17:0/481683525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3c74016770 con 0x7f3c7c15eef0 2024-09-10T23:20:33.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.773+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3c7c0cf5c0 con 0x7f3c7c15eef0 2024-09-10T23:20:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.773+0000 7f3c79600640 1 -- 172.21.15.17:0/481683525 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f3c740f85f0 con 0x7f3c7c15eef0 2024-09-10T23:20:33.779 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:20:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c5c0725e0 msgr2=0x7f3c5c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c5c0725e0 0x7f3c5c074aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0c71d0 tx=0x7f3c70009040 comp rx=0 tx=0).stop 2024-09-10T23:20:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c15eef0 msgr2=0x7f3c7c0b1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c15eef0 0x7f3c7c0b1960 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009b10 tx=0x7f3c74009300 comp rx=0 tx=0).stop 2024-09-10T23:20:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 shutdown_connections 2024-09-10T23:20:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3c5c0725e0 0x7f3c5c074aa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c7c15eef0 0x7f3c7c0b1960 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c7c0d1cb0 0x7f3c7c09f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 --2- 172.21.15.17:0/481683525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c7c0cfde0 0x7f3c7c09d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 >> 172.21.15.17:0/481683525 conn(0x7f3c7c09a9f0 msgr2=0x7f3c7c072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 shutdown_connections 2024-09-10T23:20:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.777+0000 7f3c84400640 1 -- 172.21.15.17:0/481683525 wait complete. 2024-09-10T23:20:33.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-10T23:20:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 -- 172.21.15.17:0/1449521120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0cf610 msgr2=0x7f0cec06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 --2- 172.21.15.17:0/1449521120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0cf610 0x7f0cec06e750 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800a950 tx=0x7f0cd8020360 comp rx=0 tx=0).stop 2024-09-10T23:20:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 -- 172.21.15.17:0/1449521120 shutdown_connections 2024-09-10T23:20:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 --2- 172.21.15.17:0/1449521120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0cf610 0x7f0cec06e750 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 -- 172.21.15.17:0/1449521120 >> 172.21.15.17:0/1449521120 conn(0x7f0cec06cfc0 msgr2=0x7f0cec06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 -- 172.21.15.17:0/1449521120 shutdown_connections 2024-09-10T23:20:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 -- 172.21.15.17:0/1449521120 wait complete. 2024-09-10T23:20:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 Processor -- start 2024-09-10T23:20:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 -- start start 2024-09-10T23:20:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0b32d0 0x7f0cec0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cec0cf230 0x7f0cec14f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cec0cf610 0x7f0cec138450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec0d04a0 con 0x7f0cec0b32d0 2024-09-10T23:20:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec0d0320 con 0x7f0cec0cf610 2024-09-10T23:20:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf4400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0cec0d0620 con 0x7f0cec0cf230 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0b32d0 0x7f0cec0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0b32d0 0x7f0cec0ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50102/0 (socket says 172.21.15.17:50102) 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf1a00640 1 -- 172.21.15.17:0/1324714309 learned_addr learned my addr 172.21.15.17:0/1324714309 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf2400640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cec0cf610 0x7f0cec138450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf1000640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cec0cf230 0x7f0cec14f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf1a00640 1 -- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cec0cf230 msgr2=0x7f0cec14f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf1a00640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cec0cf230 0x7f0cec14f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf1a00640 1 -- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cec0cf610 msgr2=0x7f0cec138450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf1a00640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cec0cf610 0x7f0cec138450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.945+0000 7f0cf1a00640 1 -- 172.21.15.17:0/1324714309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec150040 con 0x7f0cec0b32d0 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0cf1a00640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0b32d0 0x7f0cec0ce320 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000c500 tx=0x7f0ce000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0ce9600640 1 -- 172.21.15.17:0/1324714309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0017070 con 0x7f0cec0b32d0 2024-09-10T23:20:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0ce9600640 1 -- 172.21.15.17:0/1324714309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ce00053c0 con 0x7f0cec0b32d0 2024-09-10T23:20:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0ce9600640 1 -- 172.21.15.17:0/1324714309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0012890 con 0x7f0cec0b32d0 2024-09-10T23:20:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cec150320 con 0x7f0cec0b32d0 2024-09-10T23:20:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cec1508e0 con 0x7f0cec0b32d0 2024-09-10T23:20:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cec06e750 con 0x7f0cec0b32d0 2024-09-10T23:20:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0ce9600640 1 -- 172.21.15.17:0/1324714309 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0ce0003600 con 0x7f0cec0b32d0 2024-09-10T23:20:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0ce9600640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ccc0725e0 0x7f0ccc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0ce9600640 1 -- 172.21.15.17:0/1324714309 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f0ce00927b0 con 0x7f0cec0b32d0 2024-09-10T23:20:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.949+0000 7f0cf1000640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ccc0725e0 0x7f0ccc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.953+0000 7f0cf1000640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ccc0725e0 0x7f0ccc074aa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80b2000 tx=0x7f0cd801eba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:33.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:33.953+0000 7f0ce9600640 1 -- 172.21.15.17:0/1324714309 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0ce005df20 con 0x7f0cec0b32d0 2024-09-10T23:20:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:34.189+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f0cec072900 con 0x7f0cec0b32d0 2024-09-10T23:20:35.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.069+0000 7f0ce9600640 1 -- 172.21.15.17:0/1324714309 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v250) ==== 146+0+0 (secure 0 0 0) 0x7f0ce005d820 con 0x7f0cec0b32d0 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ccc0725e0 msgr2=0x7f0ccc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ccc0725e0 0x7f0ccc074aa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80b2000 tx=0x7f0cd801eba0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0b32d0 msgr2=0x7f0cec0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0b32d0 0x7f0cec0ce320 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000c500 tx=0x7f0ce000c9c0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 shutdown_connections 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0ccc0725e0 0x7f0ccc074aa0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0cec0cf610 0x7f0cec138450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0cec0cf230 0x7f0cec14f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 --2- 172.21.15.17:0/1324714309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cec0b32d0 0x7f0cec0ce320 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 >> 172.21.15.17:0/1324714309 conn(0x7f0cec06cfc0 msgr2=0x7f0cec1523d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 shutdown_connections 2024-09-10T23:20:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.073+0000 7f0cf4400640 1 -- 172.21.15.17:0/1324714309 wait complete. 2024-09-10T23:20:35.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:20:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.245+0000 7f4a7be00640 1 -- 172.21.15.17:0/1595835111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c0ccff0 msgr2=0x7f4a7c06e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.245+0000 7f4a7be00640 1 --2- 172.21.15.17:0/1595835111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c0ccff0 0x7f4a7c06e070 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009840 tx=0x7f4a6c01f010 comp rx=0 tx=0).stop 2024-09-10T23:20:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.245+0000 7f4a7be00640 1 -- 172.21.15.17:0/1595835111 shutdown_connections 2024-09-10T23:20:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.245+0000 7f4a7be00640 1 --2- 172.21.15.17:0/1595835111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c0ccff0 0x7f4a7c06e070 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.245+0000 7f4a7be00640 1 -- 172.21.15.17:0/1595835111 >> 172.21.15.17:0/1595835111 conn(0x7f4a7c0d0380 msgr2=0x7f4a7c0d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.245+0000 7f4a7be00640 1 -- 172.21.15.17:0/1595835111 shutdown_connections 2024-09-10T23:20:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.245+0000 7f4a7be00640 1 -- 172.21.15.17:0/1595835111 wait complete. 2024-09-10T23:20:35.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 Processor -- start 2024-09-10T23:20:35.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 -- start start 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c06d0f0 0x7f4a7c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7c0ccff0 0x7f4a7c1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a7c0cd3d0 0x7f4a7c156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c0b09a0 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c0b5e00 con 0x7f4a7c0ccff0 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4a7c0b0b20 con 0x7f4a7c0cd3d0 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c06d0f0 0x7f4a7c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c06d0f0 0x7f4a7c15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50114/0 (socket says 172.21.15.17:50114) 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7aa00640 1 -- 172.21.15.17:0/525076160 learned_addr learned my addr 172.21.15.17:0/525076160 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a72000640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7c0ccff0 0x7f4a7c1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7b400640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a7c0cd3d0 0x7f4a7c156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:35.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7aa00640 1 -- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a7c0cd3d0 msgr2=0x7f4a7c156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7aa00640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a7c0cd3d0 0x7f4a7c156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7aa00640 1 -- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7c0ccff0 msgr2=0x7f4a7c1f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7aa00640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7c0ccff0 0x7f4a7c1f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7aa00640 1 -- 172.21.15.17:0/525076160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c15dd10 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7aa00640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c06d0f0 0x7f4a7c15d7d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c01cc40 tx=0x7f4a6c0a8d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a73400640 1 -- 172.21.15.17:0/525076160 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0bf070 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a73400640 1 -- 172.21.15.17:0/525076160 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a6c0052f0 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c1f6b90 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a73400640 1 -- 172.21.15.17:0/525076160 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0b5040 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c1f2df0 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.249+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7c06e070 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.253+0000 7f4a73400640 1 -- 172.21.15.17:0/525076160 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4a6c0b8070 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.253+0000 7f4a73400640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a580725e0 0x7f4a58074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:35.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.253+0000 7f4a73400640 1 -- 172.21.15.17:0/525076160 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f4a6c12fff0 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.253+0000 7f4a72000640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a580725e0 0x7f4a58074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.253+0000 7f4a72000640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a580725e0 0x7f4a58074aa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c15c4a0 tx=0x7f4a64009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:35.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.257+0000 7f4a73400640 1 -- 172.21.15.17:0/525076160 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4a7c1f6b90 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.433+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4a7c0704f0 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.433+0000 7f4a73400640 1 -- 172.21.15.17:0/525076160 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v38) ==== 59+0+1998 (secure 0 0 0) 0x7f4a6c018b70 con 0x7f4a7c06d0f0 2024-09-10T23:20:35.438 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:20:35.438 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:20:35.439 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:20:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:20:35.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a580725e0 msgr2=0x7f4a58074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a580725e0 0x7f4a58074aa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c15c4a0 tx=0x7f4a64009040 comp rx=0 tx=0).stop 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c06d0f0 msgr2=0x7f4a7c15d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c06d0f0 0x7f4a7c15d7d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c01cc40 tx=0x7f4a6c0a8d80 comp rx=0 tx=0).stop 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 shutdown_connections 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a580725e0 0x7f4a58074aa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a7c0cd3d0 0x7f4a7c156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a7c0ccff0 0x7f4a7c1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 --2- 172.21.15.17:0/525076160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a7c06d0f0 0x7f4a7c15d7d0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 >> 172.21.15.17:0/525076160 conn(0x7f4a7c0d0380 msgr2=0x7f4a7c0d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 shutdown_connections 2024-09-10T23:20:35.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.437+0000 7f4a7be00640 1 -- 172.21.15.17:0/525076160 wait complete. 2024-09-10T23:20:35.460 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:20:35.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 -- 172.21.15.17:0/492840422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f600b4db0 msgr2=0x7f5f600b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 --2- 172.21.15.17:0/492840422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f600b4db0 0x7f5f600b1910 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009c80 tx=0x7f5f5801cc80 comp rx=0 tx=0).stop 2024-09-10T23:20:35.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 -- 172.21.15.17:0/492840422 shutdown_connections 2024-09-10T23:20:35.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 --2- 172.21.15.17:0/492840422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f600b4db0 0x7f5f600b1910 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 --2- 172.21.15.17:0/492840422 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f600b47f0 0x7f5f600d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 -- 172.21.15.17:0/492840422 >> 172.21.15.17:0/492840422 conn(0x7f5f600d3ef0 msgr2=0x7f5f600d42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:35.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 -- 172.21.15.17:0/492840422 shutdown_connections 2024-09-10T23:20:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 -- 172.21.15.17:0/492840422 wait complete. 2024-09-10T23:20:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 Processor -- start 2024-09-10T23:20:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.605+0000 7f5f66400640 1 -- start start 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f66400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f600b47f0 0x7f5f601491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f66400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f600b4db0 0x7f5f600b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f66400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f601624d0 0x7f5f6015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f66400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6016b1e0 con 0x7f5f601624d0 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f66400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6016b060 con 0x7f5f600b4db0 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f66400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5f6016b360 con 0x7f5f600b47f0 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f601624d0 0x7f5f6015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f601624d0 0x7f5f6015b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50120/0 (socket says 172.21.15.17:50120) 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5fe00640 1 -- 172.21.15.17:0/966692956 learned_addr learned my addr 172.21.15.17:0/966692956 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:35.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f57e00640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f600b4db0 0x7f5f600b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:35.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5f400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f600b47f0 0x7f5f601491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5fe00640 1 -- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f600b47f0 msgr2=0x7f5f601491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5fe00640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f600b47f0 0x7f5f601491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5fe00640 1 -- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f600b4db0 msgr2=0x7f5f600b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5fe00640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f600b4db0 0x7f5f600b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5fe00640 1 -- 172.21.15.17:0/966692956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f600d1830 con 0x7f5f601624d0 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f5fe00640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f601624d0 0x7f5f6015b5d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f5f5801b330 tx=0x7f5f580092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f57400640 1 -- 172.21.15.17:0/966692956 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580bb070 con 0x7f5f601624d0 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f57400640 1 -- 172.21.15.17:0/966692956 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f58004d40 con 0x7f5f601624d0 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f600b86c0 con 0x7f5f601624d0 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f57400640 1 -- 172.21.15.17:0/966692956 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580b2040 con 0x7f5f601624d0 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f600b8c60 con 0x7f5f601624d0 2024-09-10T23:20:35.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.609+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f600b1910 con 0x7f5f601624d0 2024-09-10T23:20:35.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.613+0000 7f5f57400640 1 -- 172.21.15.17:0/966692956 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5f580b5030 con 0x7f5f601624d0 2024-09-10T23:20:35.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.613+0000 7f5f57400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f3c072610 0x7f5f3c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:35.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.613+0000 7f5f57400640 1 -- 172.21.15.17:0/966692956 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f5f5812cc90 con 0x7f5f601624d0 2024-09-10T23:20:35.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.613+0000 7f5f5f400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f3c072610 0x7f5f3c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:35.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.613+0000 7f5f5f400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f3c072610 0x7f5f3c074ad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5f50007fd0 tx=0x7f5f50009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.617+0000 7f5f57400640 1 -- 172.21.15.17:0/966692956 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5f58016990 con 0x7f5f601624d0 2024-09-10T23:20:35.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.793+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5f60074fe0 con 0x7f5f601624d0 2024-09-10T23:20:35.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f57400640 1 -- 172.21.15.17:0/966692956 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v39)=0 v39) ==== 122+0+0 (secure 0 0 0) 0x7f5f580f7db0 con 0x7f5f601624d0 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f3c072610 msgr2=0x7f5f3c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f3c072610 0x7f5f3c074ad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5f50007fd0 tx=0x7f5f50009040 comp rx=0 tx=0).stop 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f601624d0 msgr2=0x7f5f6015b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f601624d0 0x7f5f6015b5d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f5f5801b330 tx=0x7f5f580092e0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 shutdown_connections 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f3c072610 0x7f5f3c074ad0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f601624d0 0x7f5f6015b5d0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f600b4db0 0x7f5f600b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 --2- 172.21.15.17:0/966692956 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f600b47f0 0x7f5f601491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 >> 172.21.15.17:0/966692956 conn(0x7f5f600d3ef0 msgr2=0x7f5f601527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:35.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 shutdown_connections 2024-09-10T23:20:35.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:35.797+0000 7f5f66400640 1 -- 172.21.15.17:0/966692956 wait complete. 2024-09-10T23:20:35.823 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:20:35.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:20:35.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:20:36.008 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:20:36.008 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:20:36.008 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:36.017 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:20:36.017 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:20:36.017 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:36.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:20:36.027 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:20:36.027 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:36.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:20:36.068 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:20:36.068 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:36.082 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:20:36.082 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:20:36.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.253+0000 7f87b3400640 1 -- 172.21.15.17:0/4242525136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15ef40 msgr2=0x7f87ac15afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.253+0000 7f87b3400640 1 --2- 172.21.15.17:0/4242525136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15ef40 0x7f87ac15afe0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f87a0009840 tx=0x7f87a001c7f0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.253+0000 7f87b3400640 1 -- 172.21.15.17:0/4242525136 shutdown_connections 2024-09-10T23:20:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.253+0000 7f87b3400640 1 --2- 172.21.15.17:0/4242525136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15ef40 0x7f87ac15afe0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.253+0000 7f87b3400640 1 -- 172.21.15.17:0/4242525136 >> 172.21.15.17:0/4242525136 conn(0x7f87ac06cfc0 msgr2=0x7f87ac06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.253+0000 7f87b3400640 1 -- 172.21.15.17:0/4242525136 shutdown_connections 2024-09-10T23:20:36.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.253+0000 7f87b3400640 1 -- 172.21.15.17:0/4242525136 wait complete. 2024-09-10T23:20:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.253+0000 7f87b3400640 1 Processor -- start 2024-09-10T23:20:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.253+0000 7f87b3400640 1 -- start start 2024-09-10T23:20:36.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b3400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87ac0d0030 0x7f87ac1fbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:36.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15e5d0 0x7f87ac146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:36.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87ac15ef40 0x7f87ac0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:36.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b3400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac169360 con 0x7f87ac15e5d0 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b3400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac1691e0 con 0x7f87ac15ef40 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b3400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f87ac1694e0 con 0x7f87ac0d0030 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15e5d0 0x7f87ac146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15e5d0 0x7f87ac146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50134/0 (socket says 172.21.15.17:50134) 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87abe00640 1 -- 172.21.15.17:0/2139212870 learned_addr learned my addr 172.21.15.17:0/2139212870 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b1400640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87ac15ef40 0x7f87ac0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b0a00640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87ac0d0030 0x7f87ac1fbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87abe00640 1 -- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87ac0d0030 msgr2=0x7f87ac1fbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87abe00640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87ac0d0030 0x7f87ac1fbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87abe00640 1 -- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87ac15ef40 msgr2=0x7f87ac0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87abe00640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87ac15ef40 0x7f87ac0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87abe00640 1 -- 172.21.15.17:0/2139212870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ac0ceb90 con 0x7f87ac15e5d0 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87abe00640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15e5d0 0x7f87ac146850 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f879800c450 tx=0x7f879800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87a8c00640 1 -- 172.21.15.17:0/2139212870 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798012830 con 0x7f87ac15e5d0 2024-09-10T23:20:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87a8c00640 1 -- 172.21.15.17:0/2139212870 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8798017070 con 0x7f87ac15e5d0 2024-09-10T23:20:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87a8c00640 1 -- 172.21.15.17:0/2139212870 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798012d80 con 0x7f87ac15e5d0 2024-09-10T23:20:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ac0cee70 con 0x7f87ac15e5d0 2024-09-10T23:20:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ac0cd2b0 con 0x7f87ac15e5d0 2024-09-10T23:20:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ac15afe0 con 0x7f87ac15e5d0 2024-09-10T23:20:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.257+0000 7f87a8c00640 1 -- 172.21.15.17:0/2139212870 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f879801c460 con 0x7f87ac15e5d0 2024-09-10T23:20:36.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.261+0000 7f87a8c00640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f878c0725e0 0x7f878c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:36.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.261+0000 7f87a8c00640 1 -- 172.21.15.17:0/2139212870 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f8798092f80 con 0x7f87ac15e5d0 2024-09-10T23:20:36.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.261+0000 7f87b0a00640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f878c0725e0 0x7f878c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.261+0000 7f87b0a00640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f878c0725e0 0x7f878c074aa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f87a00af000 tx=0x7f87a001b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.265+0000 7f87a8c00640 1 -- 172.21.15.17:0/2139212870 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f879805e6e0 con 0x7f87ac15e5d0 2024-09-10T23:20:36.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87ac146d90 con 0x7f87ac15e5d0 2024-09-10T23:20:36.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87a8c00640 1 -- 172.21.15.17:0/2139212870 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3905 (secure 0 0 0) 0x7f879805dfe0 con 0x7f87ac15e5d0 2024-09-10T23:20:36.482 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:36.482 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":49,"btime":"2024-09-10T23:20:30:043869+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2841967275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":2841967275},{"type":"v1","addr":"172.21.15.77:6837","nonce":2841967275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":5873,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/576348006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":576348006},{"type":"v1","addr":"172.21.15.17:6834","nonce":576348006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2690288078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2690288078},{"type":"v1","addr":"172.21.15.77:6835","nonce":2690288078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6777,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/210551383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":210551383},{"type":"v1","addr":"172.21.15.17:6835","nonce":210551383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[]} 2024-09-10T23:20:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 49 2024-09-10T23:20:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f878c0725e0 msgr2=0x7f878c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f878c0725e0 0x7f878c074aa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f87a00af000 tx=0x7f87a001b030 comp rx=0 tx=0).stop 2024-09-10T23:20:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15e5d0 msgr2=0x7f87ac146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15e5d0 0x7f87ac146850 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f879800c450 tx=0x7f879800c910 comp rx=0 tx=0).stop 2024-09-10T23:20:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 shutdown_connections 2024-09-10T23:20:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f878c0725e0 0x7f878c074aa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87ac15ef40 0x7f87ac0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87ac15e5d0 0x7f87ac146850 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 --2- 172.21.15.17:0/2139212870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f87ac0d0030 0x7f87ac1fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 >> 172.21.15.17:0/2139212870 conn(0x7f87ac06cfc0 msgr2=0x7f87ac06ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:36.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 shutdown_connections 2024-09-10T23:20:36.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.477+0000 7f87b3400640 1 -- 172.21.15.17:0/2139212870 wait complete. 2024-09-10T23:20:36.503 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:20:36.503 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:20:36.504 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:20:36.504 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:20:36.504 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:20:36.504 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:20:36.504 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:20:36.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:20:36.505 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:20:36.505 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:20:36.505 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:20:36.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:20:36.505 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:20:36.506 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:20:36.506 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:20:36.506 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:20:36.518 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:20:36.518 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:20:36.519 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:20:36.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:20:36.520 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:20:36.520 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:20:36.521 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:20:36.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:20:36.564 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:20:36.564 DEBUG:teuthology.parallel:result is None 2024-09-10T23:20:36.565 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:20:36.565 DEBUG:teuthology.parallel:result is None 2024-09-10T23:20:36.567 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:20:36.567 DEBUG:teuthology.parallel:result is None 2024-09-10T23:20:36.568 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:20:36.569 DEBUG:teuthology.parallel:result is None 2024-09-10T23:20:36.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:20:36.654 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:20:36.655 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:20:36.656 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:20:36.657 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:20:36.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 -- 172.21.15.17:0/1742603321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f632415dff0 msgr2=0x7f63240cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:36.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 --2- 172.21.15.17:0/1742603321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f632415dff0 0x7f63240cfe70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6318009bf0 tx=0x7f631801c9e0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 -- 172.21.15.17:0/1742603321 shutdown_connections 2024-09-10T23:20:36.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 --2- 172.21.15.17:0/1742603321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f632415dff0 0x7f63240cfe70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 -- 172.21.15.17:0/1742603321 >> 172.21.15.17:0/1742603321 conn(0x7f63240d1d60 msgr2=0x7f63240d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:36.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 -- 172.21.15.17:0/1742603321 shutdown_connections 2024-09-10T23:20:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 -- 172.21.15.17:0/1742603321 wait complete. 2024-09-10T23:20:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 Processor -- start 2024-09-10T23:20:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 -- start start 2024-09-10T23:20:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63240af830 0x7f63241f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63240b10e0 0x7f6324146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632415dff0 0x7f63240b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f632416c5e0 con 0x7f63240b10e0 2024-09-10T23:20:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f632416c460 con 0x7f632415dff0 2024-09-10T23:20:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.717+0000 7f632c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f632416c760 con 0x7f63240af830 2024-09-10T23:20:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6328e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63240b10e0 0x7f6324146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6329800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63240af830 0x7f63241f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6328e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63240b10e0 0x7f6324146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50162/0 (socket says 172.21.15.17:50162) 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6328e00640 1 -- 172.21.15.17:0/2815628670 learned_addr learned my addr 172.21.15.17:0/2815628670 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f632a200640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632415dff0 0x7f63240b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6329800640 1 -- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632415dff0 msgr2=0x7f63240b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6329800640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632415dff0 0x7f63240b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6329800640 1 -- 172.21.15.17:0/2815628670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63240b10e0 msgr2=0x7f6324146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6329800640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63240b10e0 0x7f6324146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6329800640 1 -- 172.21.15.17:0/2815628670 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63241fbaa0 con 0x7f63240af830 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6328e00640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63240b10e0 0x7f6324146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f632a200640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632415dff0 0x7f63240b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6329800640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63240af830 0x7f63241f8ae0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63180ac000 tx=0x7f6318003f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6321600640 1 -- 172.21.15.17:0/2815628670 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180b2040 con 0x7f63240af830 2024-09-10T23:20:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6321600640 1 -- 172.21.15.17:0/2815628670 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63180a5bc0 con 0x7f63240af830 2024-09-10T23:20:36.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6321600640 1 -- 172.21.15.17:0/2815628670 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318004040 con 0x7f63240af830 2024-09-10T23:20:36.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63241fbd80 con 0x7f63240af830 2024-09-10T23:20:36.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63241fc340 con 0x7f63240af830 2024-09-10T23:20:36.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63241fc580 con 0x7f63240af830 2024-09-10T23:20:36.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.721+0000 7f6321600640 1 -- 172.21.15.17:0/2815628670 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f63180b5070 con 0x7f63240af830 2024-09-10T23:20:36.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.725+0000 7f6321600640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63040725e0 0x7f6304074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:36.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.725+0000 7f6321600640 1 -- 172.21.15.17:0/2815628670 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 5421+0+0 (secure 0 0 0) 0x7f631812c800 con 0x7f63240af830 2024-09-10T23:20:36.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.725+0000 7f6328e00640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63040725e0 0x7f6304074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:36.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.725+0000 7f6328e00640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63040725e0 0x7f6304074aa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6324156df0 tx=0x7f6310009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:36.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.729+0000 7f6321600640 1 -- 172.21.15.17:0/2815628670 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f63241fc580 con 0x7f63240af830 2024-09-10T23:20:36.844 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:20:36.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:20:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:36.913+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f63240afc80 con 0x7f63240af830 2024-09-10T23:20:37.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.081+0000 7f6321600640 1 -- 172.21.15.17:0/2815628670 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) ==== 97+0+0 (secure 0 0 0) 0x7f63180166f0 con 0x7f63240af830 2024-09-10T23:20:37.088 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:20:37.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63040725e0 msgr2=0x7f6304074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63040725e0 0x7f6304074aa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6324156df0 tx=0x7f6310009040 comp rx=0 tx=0).stop 2024-09-10T23:20:37.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63240af830 msgr2=0x7f63241f8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63240af830 0x7f63241f8ae0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f63180ac000 tx=0x7f6318003f60 comp rx=0 tx=0).stop 2024-09-10T23:20:37.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 shutdown_connections 2024-09-10T23:20:37.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63040725e0 0x7f6304074aa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632415dff0 0x7f63240b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63240b10e0 0x7f6324146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 --2- 172.21.15.17:0/2815628670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63240af830 0x7f63241f8ae0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 >> 172.21.15.17:0/2815628670 conn(0x7f63240d1d60 msgr2=0x7f63240cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:37.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 shutdown_connections 2024-09-10T23:20:37.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.085+0000 7f632c200640 1 -- 172.21.15.17:0/2815628670 wait complete. 2024-09-10T23:20:37.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:20:37.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.301+0000 7f3238400640 1 -- 172.21.15.17:0/184539683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32300d1830 msgr2=0x7f32300ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.301+0000 7f3238400640 1 --2- 172.21.15.17:0/184539683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32300d1830 0x7f32300ccf80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3228009bc0 tx=0x7f322801cba0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.301+0000 7f3238400640 1 -- 172.21.15.17:0/184539683 shutdown_connections 2024-09-10T23:20:37.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.301+0000 7f3238400640 1 --2- 172.21.15.17:0/184539683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32300d1830 0x7f32300ccf80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.301+0000 7f3238400640 1 -- 172.21.15.17:0/184539683 >> 172.21.15.17:0/184539683 conn(0x7f32300d1d60 msgr2=0x7f32300d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:37.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.301+0000 7f3238400640 1 -- 172.21.15.17:0/184539683 shutdown_connections 2024-09-10T23:20:37.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.301+0000 7f3238400640 1 -- 172.21.15.17:0/184539683 wait complete. 2024-09-10T23:20:37.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 Processor -- start 2024-09-10T23:20:37.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 -- start start 2024-09-10T23:20:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3230070ad0 0x7f323015c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32300d1830 0x7f3230165d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f323015f770 0x7f323014e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f323016a550 con 0x7f3230070ad0 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f323016a3d0 con 0x7f323015f770 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f323016a6d0 con 0x7f32300d1830 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3230070ad0 0x7f323015c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3230070ad0 0x7f323015c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58138/0 (socket says 172.21.15.17:58138) 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235a00640 1 -- 172.21.15.17:0/112763906 learned_addr learned my addr 172.21.15.17:0/112763906 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235000640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32300d1830 0x7f3230165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235a00640 1 -- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32300d1830 msgr2=0x7f3230165d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235a00640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32300d1830 0x7f3230165d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235a00640 1 -- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f323015f770 msgr2=0x7f323014e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235a00640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f323015f770 0x7f323014e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235a00640 1 -- 172.21.15.17:0/112763906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32301664c0 con 0x7f3230070ad0 2024-09-10T23:20:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3235a00640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3230070ad0 0x7f323015c0f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f322400c430 tx=0x7f322400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f322d600640 1 -- 172.21.15.17:0/112763906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3224011790 con 0x7f3230070ad0 2024-09-10T23:20:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f322d600640 1 -- 172.21.15.17:0/112763906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3224017070 con 0x7f3230070ad0 2024-09-10T23:20:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f322d600640 1 -- 172.21.15.17:0/112763906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3224011ce0 con 0x7f3230070ad0 2024-09-10T23:20:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3230164090 con 0x7f3230070ad0 2024-09-10T23:20:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3230164650 con 0x7f3230070ad0 2024-09-10T23:20:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.305+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f323015f060 con 0x7f3230070ad0 2024-09-10T23:20:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.309+0000 7f322d600640 1 -- 172.21.15.17:0/112763906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f322401c460 con 0x7f3230070ad0 2024-09-10T23:20:37.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.309+0000 7f322d600640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32100725e0 0x7f3210074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:37.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.309+0000 7f322d600640 1 -- 172.21.15.17:0/112763906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f3224092f50 con 0x7f3230070ad0 2024-09-10T23:20:37.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.309+0000 7f3235000640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32100725e0 0x7f3210074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:37.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.309+0000 7f3235000640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32100725e0 0x7f3210074aa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f321c000c10 tx=0x7f321c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:37.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.313+0000 7f322d600640 1 -- 172.21.15.17:0/112763906 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f322405e750 con 0x7f3230070ad0 2024-09-10T23:20:37.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f32300ccd20 con 0x7f3230070ad0 2024-09-10T23:20:37.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f322d600640 1 -- 172.21.15.17:0/112763906 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f3224065e20 con 0x7f3230070ad0 2024-09-10T23:20:37.549 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:37.549 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:20:37.550 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:20:37.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:20:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.554 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.555 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.556 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:20:37.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:20:37.558 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:20:37.559 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.561 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.562 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:20:37.563 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:20:37.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32100725e0 msgr2=0x7f3210074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32100725e0 0x7f3210074aa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f321c000c10 tx=0x7f321c009040 comp rx=0 tx=0).stop 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3230070ad0 msgr2=0x7f323015c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3230070ad0 0x7f323015c0f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f322400c430 tx=0x7f322400c8f0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 shutdown_connections 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32100725e0 0x7f3210074aa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f323015f770 0x7f323014e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32300d1830 0x7f3230165d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 --2- 172.21.15.17:0/112763906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3230070ad0 0x7f323015c0f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 >> 172.21.15.17:0/112763906 conn(0x7f32300d1d60 msgr2=0x7f32300b74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 shutdown_connections 2024-09-10T23:20:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.545+0000 7f3238400640 1 -- 172.21.15.17:0/112763906 wait complete. 2024-09-10T23:20:37.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:20:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 -- 172.21.15.17:0/2077025135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483806d2d0 msgr2=0x7f48380737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 --2- 172.21.15.17:0/2077025135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483806d2d0 0x7f48380737a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f48380756e0 tx=0x7f483001caf0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 -- 172.21.15.17:0/2077025135 shutdown_connections 2024-09-10T23:20:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 --2- 172.21.15.17:0/2077025135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483806d2d0 0x7f48380737a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 --2- 172.21.15.17:0/2077025135 >> v2:172.21.15.77:3300/0 conn(0x7f483815bce0 0x7f4838070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 -- 172.21.15.17:0/2077025135 >> 172.21.15.17:0/2077025135 conn(0x7f48380d0c60 msgr2=0x7f48380d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 -- 172.21.15.17:0/2077025135 shutdown_connections 2024-09-10T23:20:37.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 -- 172.21.15.17:0/2077025135 wait complete. 2024-09-10T23:20:37.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 Processor -- start 2024-09-10T23:20:37.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.713+0000 7f4840600640 1 -- start start 2024-09-10T23:20:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4840600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483806d2d0 0x7f483814ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4840600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483806d810 0x7f4838153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4840600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483815bce0 0x7f4838153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4840600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4838169640 con 0x7f483815bce0 2024-09-10T23:20:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4840600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48381694c0 con 0x7f483806d2d0 2024-09-10T23:20:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4840600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48381697c0 con 0x7f483806d810 2024-09-10T23:20:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483815bce0 0x7f4838153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483815bce0 0x7f4838153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58160/0 (socket says 172.21.15.17:58160) 2024-09-10T23:20:37.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483dc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483806d2d0 0x7f483814ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483e600640 1 -- 172.21.15.17:0/1777357852 learned_addr learned my addr 172.21.15.17:0/1777357852 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483d200640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483806d810 0x7f4838153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483e600640 1 -- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483806d810 msgr2=0x7f4838153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483e600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483806d810 0x7f4838153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483e600640 1 -- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483806d2d0 msgr2=0x7f483814ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483e600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483806d2d0 0x7f483814ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483e600640 1 -- 172.21.15.17:0/1777357852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483814f490 con 0x7f483815bce0 2024-09-10T23:20:37.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f483e600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483815bce0 0x7f4838153a70 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4830009b10 tx=0x7f48300a5a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4835600640 1 -- 172.21.15.17:0/1777357852 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48300bb070 con 0x7f483815bce0 2024-09-10T23:20:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4835600640 1 -- 172.21.15.17:0/1777357852 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4830004d40 con 0x7f483815bce0 2024-09-10T23:20:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4835600640 1 -- 172.21.15.17:0/1777357852 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48300b2040 con 0x7f483815bce0 2024-09-10T23:20:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4838150100 con 0x7f483815bce0 2024-09-10T23:20:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48381506c0 con 0x7f483815bce0 2024-09-10T23:20:37.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48380737a0 con 0x7f483815bce0 2024-09-10T23:20:37.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.717+0000 7f4835600640 1 -- 172.21.15.17:0/1777357852 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f48300b5030 con 0x7f483815bce0 2024-09-10T23:20:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.721+0000 7f4835600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48180725e0 0x7f4818074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.721+0000 7f4835600640 1 -- 172.21.15.17:0/1777357852 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f483012cbf0 con 0x7f483815bce0 2024-09-10T23:20:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.721+0000 7f483dc00640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48180725e0 0x7f4818074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.721+0000 7f483dc00640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48180725e0 0x7f4818074aa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f48381f5b20 tx=0x7f482c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.725+0000 7f4835600640 1 -- 172.21.15.17:0/1777357852 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4830016770 con 0x7f483815bce0 2024-09-10T23:20:37.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.901+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f48380748f0 con 0x7f483815bce0 2024-09-10T23:20:37.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.901+0000 7f4835600640 1 -- 172.21.15.17:0/1777357852 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) ==== 84+0+65 (secure 0 0 0) 0x7f48300f7da0 con 0x7f483815bce0 2024-09-10T23:20:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:37.907 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:20:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:20:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:20:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:20:37.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:37.907 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48180725e0 msgr2=0x7f4818074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48180725e0 0x7f4818074aa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f48381f5b20 tx=0x7f482c00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483815bce0 msgr2=0x7f4838153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483815bce0 0x7f4838153a70 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4830009b10 tx=0x7f48300a5a00 comp rx=0 tx=0).stop 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 shutdown_connections 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48180725e0 0x7f4818074aa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f483815bce0 0x7f4838153a70 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f483806d810 0x7f4838153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 --2- 172.21.15.17:0/1777357852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f483806d2d0 0x7f483814ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 >> 172.21.15.17:0/1777357852 conn(0x7f48380d0c60 msgr2=0x7f48380cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:37.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 shutdown_connections 2024-09-10T23:20:37.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:37.905+0000 7f4840600640 1 -- 172.21.15.17:0/1777357852 wait complete. 2024-09-10T23:20:37.928 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:20:37.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:20:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.073+0000 7fde58800640 1 -- 172.21.15.17:0/908657624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 msgr2=0x7fde500b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.073+0000 7fde58800640 1 --2- 172.21.15.17:0/908657624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 0x7fde500b3df0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009bc0 tx=0x7fde4c01cb40 comp rx=0 tx=0).stop 2024-09-10T23:20:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.073+0000 7fde58800640 1 -- 172.21.15.17:0/908657624 shutdown_connections 2024-09-10T23:20:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.073+0000 7fde58800640 1 --2- 172.21.15.17:0/908657624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 0x7fde500b3df0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.073+0000 7fde58800640 1 --2- 172.21.15.17:0/908657624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde5015ab30 0x7fde50073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.073+0000 7fde58800640 1 -- 172.21.15.17:0/908657624 >> 172.21.15.17:0/908657624 conn(0x7fde500b17a0 msgr2=0x7fde500b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.073+0000 7fde58800640 1 -- 172.21.15.17:0/908657624 shutdown_connections 2024-09-10T23:20:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.073+0000 7fde58800640 1 -- 172.21.15.17:0/908657624 wait complete. 2024-09-10T23:20:38.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde58800640 1 Processor -- start 2024-09-10T23:20:38.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde58800640 1 -- start start 2024-09-10T23:20:38.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde58800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde50072b40 0x7fde5013e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde58800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 0x7fde5014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde58800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde5015ab30 0x7fde50153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde58800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fde50167bf0 con 0x7fde500b3940 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde58800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fde50167a70 con 0x7fde50072b40 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde58800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fde50167d70 con 0x7fde5015ab30 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 0x7fde5014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde50072b40 0x7fde5013e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 0x7fde5014e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58178/0 (socket says 172.21.15.17:58178) 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55400640 1 -- 172.21.15.17:0/215772784 learned_addr learned my addr 172.21.15.17:0/215772784 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde56800640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde5015ab30 0x7fde50153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:38.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55400640 1 -- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde5015ab30 msgr2=0x7fde50153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:38.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55400640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde5015ab30 0x7fde50153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:38.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55400640 1 -- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde50072b40 msgr2=0x7fde5013e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:38.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55400640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde50072b40 0x7fde5013e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:38.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55400640 1 -- 172.21.15.17:0/215772784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5014df00 con 0x7fde500b3940 2024-09-10T23:20:38.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.077+0000 7fde55400640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 0x7fde5014e1e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fde4000c700 tx=0x7fde4000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:38.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.081+0000 7fde4a000640 1 -- 172.21.15.17:0/215772784 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40017070 con 0x7fde500b3940 2024-09-10T23:20:38.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.081+0000 7fde4a000640 1 -- 172.21.15.17:0/215772784 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde40005070 con 0x7fde500b3940 2024-09-10T23:20:38.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.081+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5014e720 con 0x7fde500b3940 2024-09-10T23:20:38.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.081+0000 7fde4a000640 1 -- 172.21.15.17:0/215772784 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4000a640 con 0x7fde500b3940 2024-09-10T23:20:38.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.081+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde50150e20 con 0x7fde500b3940 2024-09-10T23:20:38.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.081+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde500b3df0 con 0x7fde500b3940 2024-09-10T23:20:38.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.081+0000 7fde4a000640 1 -- 172.21.15.17:0/215772784 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fde4000a9f0 con 0x7fde500b3940 2024-09-10T23:20:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.085+0000 7fde4a000640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde34072610 0x7fde34074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.085+0000 7fde4a000640 1 -- 172.21.15.17:0/215772784 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7fde400929a0 con 0x7fde500b3940 2024-09-10T23:20:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.085+0000 7fde55e00640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde34072610 0x7fde34074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:38.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.085+0000 7fde55e00640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde34072610 0x7fde34074ad0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fde44009b40 tx=0x7fde440091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.089+0000 7fde4a000640 1 -- 172.21.15.17:0/215772784 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fde500cd030 con 0x7fde500b3940 2024-09-10T23:20:38.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:38.265+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fde500b1160 con 0x7fde500b3940 2024-09-10T23:20:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.089+0000 7fde4a000640 1 -- 172.21.15.17:0/215772784 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) ==== 138+0+0 (secure 0 0 0) 0x7fde4005db50 con 0x7fde500b3940 2024-09-10T23:20:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:20:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde34072610 msgr2=0x7fde34074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde34072610 0x7fde34074ad0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fde44009b40 tx=0x7fde440091e0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 msgr2=0x7fde5014e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 0x7fde5014e1e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fde4000c700 tx=0x7fde4000cbc0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 shutdown_connections 2024-09-10T23:20:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde34072610 0x7fde34074ad0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fde5015ab30 0x7fde50153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde500b3940 0x7fde5014e1e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 --2- 172.21.15.17:0/215772784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde50072b40 0x7fde5013e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 >> 172.21.15.17:0/215772784 conn(0x7fde500b17a0 msgr2=0x7fde501640a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 shutdown_connections 2024-09-10T23:20:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.093+0000 7fde58800640 1 -- 172.21.15.17:0/215772784 wait complete. 2024-09-10T23:20:39.126 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:20:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 -- 172.21.15.17:0/1508582867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1340b4950 msgr2=0x7ff134165850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 --2- 172.21.15.17:0/1508582867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1340b4950 0x7ff134165850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009bf0 tx=0x7ff12c01cbe0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 -- 172.21.15.17:0/1508582867 shutdown_connections 2024-09-10T23:20:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 --2- 172.21.15.17:0/1508582867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1340b4950 0x7ff134165850 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 -- 172.21.15.17:0/1508582867 >> 172.21.15.17:0/1508582867 conn(0x7ff1340b17a0 msgr2=0x7ff1340b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 -- 172.21.15.17:0/1508582867 shutdown_connections 2024-09-10T23:20:39.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 -- 172.21.15.17:0/1508582867 wait complete. 2024-09-10T23:20:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 Processor -- start 2024-09-10T23:20:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 -- start start 2024-09-10T23:20:39.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff134072b40 0x7ff13415dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1340b4950 0x7ff134135fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13415ab30 0x7ff134159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff13406f880 con 0x7ff13415ab30 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff13406f700 con 0x7ff1340b4950 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff139800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff13406fa00 con 0x7ff134072b40 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff133400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13415ab30 0x7ff134159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff133400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13415ab30 0x7ff134159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58184/0 (socket says 172.21.15.17:58184) 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff133400640 1 -- 172.21.15.17:0/1645469220 learned_addr learned my addr 172.21.15.17:0/1645469220 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff12be00640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1340b4950 0x7ff134135fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:39.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.281+0000 7ff132a00640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff134072b40 0x7ff13415dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:39.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff132a00640 1 -- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1340b4950 msgr2=0x7ff134135fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:39.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff132a00640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1340b4950 0x7ff134135fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff132a00640 1 -- 172.21.15.17:0/1645469220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13415ab30 msgr2=0x7ff134159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff132a00640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13415ab30 0x7ff134159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff132a00640 1 -- 172.21.15.17:0/1645469220 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13415a240 con 0x7ff134072b40 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff133400640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13415ab30 0x7ff134159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff12be00640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1340b4950 0x7ff134135fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff132a00640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff134072b40 0x7ff13415dad0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff12400c3c0 tx=0x7ff124001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff12aa00640 1 -- 172.21.15.17:0/1645469220 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124017070 con 0x7ff134072b40 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff12aa00640 1 -- 172.21.15.17:0/1645469220 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1240053c0 con 0x7ff134072b40 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff12aa00640 1 -- 172.21.15.17:0/1645469220 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124003860 con 0x7ff134072b40 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1341580f0 con 0x7ff134072b40 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff134158670 con 0x7ff134072b40 2024-09-10T23:20:39.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13406ff90 con 0x7ff134072b40 2024-09-10T23:20:39.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.285+0000 7ff12aa00640 1 -- 172.21.15.17:0/1645469220 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff124003a00 con 0x7ff134072b40 2024-09-10T23:20:39.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.289+0000 7ff12aa00640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1100725e0 0x7ff110074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:39.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.289+0000 7ff12aa00640 1 -- 172.21.15.17:0/1645469220 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(84..84 src has 1..84) ==== 5619+0+0 (secure 0 0 0) 0x7ff124092d40 con 0x7ff134072b40 2024-09-10T23:20:39.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.289+0000 7ff12be00640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1100725e0 0x7ff110074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:39.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.289+0000 7ff12be00640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1100725e0 0x7ff110074aa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff1341fae10 tx=0x7ff11c007f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:39.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.289+0000 7ff12aa00640 1 -- 172.21.15.17:0/1645469220 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff124021020 con 0x7ff134072b40 2024-09-10T23:20:39.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:39.465+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff1340d04f0 con 0x7ff134072b40 2024-09-10T23:20:40.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.109+0000 7ff12aa00640 1 -- 172.21.15.17:0/1645469220 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7ff12405de30 con 0x7ff134072b40 2024-09-10T23:20:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:20:40.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.113+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1100725e0 msgr2=0x7ff110074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:40.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.113+0000 7ff139800640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1100725e0 0x7ff110074aa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff1341fae10 tx=0x7ff11c007f10 comp rx=0 tx=0).stop 2024-09-10T23:20:40.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.117+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff134072b40 msgr2=0x7ff13415dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:40.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.117+0000 7ff139800640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff134072b40 0x7ff13415dad0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff12400c3c0 tx=0x7ff124001e80 comp rx=0 tx=0).stop 2024-09-10T23:20:40.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.117+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 shutdown_connections 2024-09-10T23:20:40.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.117+0000 7ff139800640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1100725e0 0x7ff110074aa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:40.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.117+0000 7ff139800640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff13415ab30 0x7ff134159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:40.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.117+0000 7ff139800640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1340b4950 0x7ff134135fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:40.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.117+0000 7ff139800640 1 --2- 172.21.15.17:0/1645469220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff134072b40 0x7ff13415dad0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff12400c3c0 tx=0x7ff124001e80 comp rx=0 tx=0).stop 2024-09-10T23:20:40.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.117+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 >> 172.21.15.17:0/1645469220 conn(0x7ff1340b17a0 msgr2=0x7ff1340cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.121+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 shutdown_connections 2024-09-10T23:20:40.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.121+0000 7ff139800640 1 -- 172.21.15.17:0/1645469220 wait complete. 2024-09-10T23:20:40.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:20:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 -- 172.21.15.17:0/1301880148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 msgr2=0x7f9ca00b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 --2- 172.21.15.17:0/1301880148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 0x7f9ca00b29d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009840 tx=0x7f9c8801c820 comp rx=0 tx=0).stop 2024-09-10T23:20:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 -- 172.21.15.17:0/1301880148 shutdown_connections 2024-09-10T23:20:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 --2- 172.21.15.17:0/1301880148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 0x7f9ca00b29d0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 -- 172.21.15.17:0/1301880148 >> 172.21.15.17:0/1301880148 conn(0x7f9ca009a9f0 msgr2=0x7f9ca009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 -- 172.21.15.17:0/1301880148 shutdown_connections 2024-09-10T23:20:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 -- 172.21.15.17:0/1301880148 wait complete. 2024-09-10T23:20:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 Processor -- start 2024-09-10T23:20:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 -- start start 2024-09-10T23:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca00b2f10 0x7f9ca00c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ca015b8c0 0x7f9ca006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 0x7f9ca00711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca0169a60 con 0x7f9ca015bca0 2024-09-10T23:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca01698e0 con 0x7f9ca00b2f10 2024-09-10T23:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.301+0000 7f9c9fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca0169be0 con 0x7f9ca015b8c0 2024-09-10T23:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 0x7f9ca00711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca00b2f10 0x7f9ca00c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 0x7f9ca00711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58208/0 (socket says 172.21.15.17:58208) 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9f400640 1 -- 172.21.15.17:0/858178046 learned_addr learned my addr 172.21.15.17:0/858178046 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c97e00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ca015b8c0 0x7f9ca006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9f400640 1 -- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ca015b8c0 msgr2=0x7f9ca006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9f400640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ca015b8c0 0x7f9ca006e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9f400640 1 -- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca00b2f10 msgr2=0x7f9ca00c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9f400640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca00b2f10 0x7f9ca00c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9f400640 1 -- 172.21.15.17:0/858178046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca0156d90 con 0x7f9ca015bca0 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9f400640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 0x7f9ca00711f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800c7c0 tx=0x7f9c9800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c96a00640 1 -- 172.21.15.17:0/858178046 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98003b80 con 0x7f9ca015bca0 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c96a00640 1 -- 172.21.15.17:0/858178046 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c98003d20 con 0x7f9ca015bca0 2024-09-10T23:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca0157070 con 0x7f9ca015bca0 2024-09-10T23:20:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c96a00640 1 -- 172.21.15.17:0/858178046 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9800aab0 con 0x7f9ca015bca0 2024-09-10T23:20:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca006ec00 con 0x7f9ca015bca0 2024-09-10T23:20:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca00b29d0 con 0x7f9ca015bca0 2024-09-10T23:20:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.305+0000 7f9c96a00640 1 -- 172.21.15.17:0/858178046 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9c9800ac50 con 0x7f9ca015bca0 2024-09-10T23:20:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.309+0000 7f9c96a00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c7c0725e0 0x7f9c7c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.309+0000 7f9c96a00640 1 -- 172.21.15.17:0/858178046 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6001+0+0 (secure 0 0 0) 0x7f9c98093bb0 con 0x7f9ca015bca0 2024-09-10T23:20:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.309+0000 7f9c9ea00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c7c0725e0 0x7f9c7c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.309+0000 7f9c9ea00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c7c0725e0 0x7f9c7c074aa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9c90000f70 tx=0x7f9c90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.313+0000 7f9c96a00640 1 -- 172.21.15.17:0/858178046 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9c9805eb80 con 0x7f9ca015bca0 2024-09-10T23:20:40.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:40.521+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9ca006fc10 con 0x7f9ca015bca0 2024-09-10T23:20:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.113+0000 7f9c96a00640 1 -- 172.21.15.17:0/858178046 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v52) ==== 174+0+0 (secure 0 0 0) 0x7f9c980635b0 con 0x7f9ca015bca0 2024-09-10T23:20:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 11 and data pool 12 2024-09-10T23:20:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.121+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c7c0725e0 msgr2=0x7f9c7c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.121+0000 7f9c9fe00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c7c0725e0 0x7f9c7c074aa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9c90000f70 tx=0x7f9c90009040 comp rx=0 tx=0).stop 2024-09-10T23:20:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.121+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 msgr2=0x7f9ca00711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.121+0000 7f9c9fe00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 0x7f9ca00711f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800c7c0 tx=0x7f9c9800cc80 comp rx=0 tx=0).stop 2024-09-10T23:20:41.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.125+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 shutdown_connections 2024-09-10T23:20:41.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.125+0000 7f9c9fe00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c7c0725e0 0x7f9c7c074aa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.125+0000 7f9c9fe00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca015bca0 0x7f9ca00711f0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.125+0000 7f9c9fe00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ca015b8c0 0x7f9ca006e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.125+0000 7f9c9fe00640 1 --2- 172.21.15.17:0/858178046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ca00b2f10 0x7f9ca00c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.125+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 >> 172.21.15.17:0/858178046 conn(0x7f9ca009a9f0 msgr2=0x7f9ca009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:41.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.129+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 shutdown_connections 2024-09-10T23:20:41.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.129+0000 7f9c9fe00640 1 -- 172.21.15.17:0/858178046 wait complete. 2024-09-10T23:20:41.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:20:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 -- 172.21.15.17:0/1979925649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15b890 msgr2=0x7f14bc072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 --2- 172.21.15.17:0/1979925649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15b890 0x7f14bc072320 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0b0d60 tx=0x7f14ac01c7a0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 -- 172.21.15.17:0/1979925649 shutdown_connections 2024-09-10T23:20:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 --2- 172.21.15.17:0/1979925649 >> v2:172.21.15.77:3300/0 conn(0x7f14bc15bc70 0x7f14bc0d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 --2- 172.21.15.17:0/1979925649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15b890 0x7f14bc072320 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 -- 172.21.15.17:0/1979925649 >> 172.21.15.17:0/1979925649 conn(0x7f14bc09a9f0 msgr2=0x7f14bc09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 -- 172.21.15.17:0/1979925649 shutdown_connections 2024-09-10T23:20:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 -- 172.21.15.17:0/1979925649 wait complete. 2024-09-10T23:20:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 Processor -- start 2024-09-10T23:20:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.313+0000 7f14c0c00640 1 -- start start 2024-09-10T23:20:41.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14c0c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14bc0d19b0 0x7f14bc1f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:41.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14c0c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f14bc15b890 0x7f14bc13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:41.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14c0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15bc70 0x7f14bc150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:41.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14c0c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc071ed0 con 0x7f14bc15bc70 2024-09-10T23:20:41.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14c0c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc071d50 con 0x7f14bc0d19b0 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14c0c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f14bc1686f0 con 0x7f14bc15b890 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15bc70 0x7f14bc150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15bc70 0x7f14bc150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58222/0 (socket says 172.21.15.17:58222) 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bbe00640 1 -- 172.21.15.17:0/3582087128 learned_addr learned my addr 172.21.15.17:0/3582087128 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bb400640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14bc0d19b0 0x7f14bc1f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14baa00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f14bc15b890 0x7f14bc13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bbe00640 1 -- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f14bc15b890 msgr2=0x7f14bc13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bbe00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f14bc15b890 0x7f14bc13fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bbe00640 1 -- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14bc0d19b0 msgr2=0x7f14bc1f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bbe00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14bc0d19b0 0x7f14bc1f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bbe00640 1 -- 172.21.15.17:0/3582087128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14bc14f840 con 0x7f14bc15bc70 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bb400640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14bc0d19b0 0x7f14bc1f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14baa00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f14bc15b890 0x7f14bc13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:41.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14bbe00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15bc70 0x7f14bc150c10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c7a0 tx=0x7f14b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:41.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14b3400640 1 -- 172.21.15.17:0/3582087128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4003b80 con 0x7f14bc15bc70 2024-09-10T23:20:41.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14b3400640 1 -- 172.21.15.17:0/3582087128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14b4003d40 con 0x7f14bc15bc70 2024-09-10T23:20:41.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14b3400640 1 -- 172.21.15.17:0/3582087128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b400aab0 con 0x7f14bc15bc70 2024-09-10T23:20:41.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14bc1f8ff0 con 0x7f14bc15bc70 2024-09-10T23:20:41.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14bc14e790 con 0x7f14bc15bc70 2024-09-10T23:20:41.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.317+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc072320 con 0x7f14bc15bc70 2024-09-10T23:20:41.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.321+0000 7f14b3400640 1 -- 172.21.15.17:0/3582087128 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f14b400ac50 con 0x7f14bc15bc70 2024-09-10T23:20:41.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.321+0000 7f14b3400640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f149c0725e0 0x7f149c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:41.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.321+0000 7f14b3400640 1 -- 172.21.15.17:0/3582087128 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f14b4093310 con 0x7f14bc15bc70 2024-09-10T23:20:41.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.321+0000 7f14bb400640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f149c0725e0 0x7f149c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:41.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.321+0000 7f14bb400640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f149c0725e0 0x7f149c074aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0af000 tx=0x7f14ac0b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.325+0000 7f14b3400640 1 -- 172.21.15.17:0/3582087128 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f14bc14f840 con 0x7f14bc15bc70 2024-09-10T23:20:41.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.501+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14bc068aa0 con 0x7f14bc15bc70 2024-09-10T23:20:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.501+0000 7f14b3400640 1 -- 172.21.15.17:0/3582087128 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16958 (secure 0 0 0) 0x7f14b405e7c0 con 0x7f14bc15bc70 2024-09-10T23:20:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:41.506 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:20:40.525421+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:20:38.279133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T23:20:39.480040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:20:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f149c0725e0 msgr2=0x7f149c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f149c0725e0 0x7f149c074aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0af000 tx=0x7f14ac0b2040 comp rx=0 tx=0).stop 2024-09-10T23:20:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15bc70 msgr2=0x7f14bc150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15bc70 0x7f14bc150c10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c7a0 tx=0x7f14b400cc60 comp rx=0 tx=0).stop 2024-09-10T23:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 shutdown_connections 2024-09-10T23:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f149c0725e0 0x7f149c074aa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14bc15bc70 0x7f14bc150c10 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f14bc15b890 0x7f14bc13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 --2- 172.21.15.17:0/3582087128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14bc0d19b0 0x7f14bc1f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 >> 172.21.15.17:0/3582087128 conn(0x7f14bc09a9f0 msgr2=0x7f14bc0cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 shutdown_connections 2024-09-10T23:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.505+0000 7f14c0c00640 1 -- 172.21.15.17:0/3582087128 wait complete. 2024-09-10T23:20:41.528 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:20:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.669+0000 7f06bf000640 1 -- 172.21.15.17:0/4111013670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06b8070ad0 msgr2=0x7f06b815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.669+0000 7f06bf000640 1 --2- 172.21.15.17:0/4111013670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06b8070ad0 0x7f06b815f060 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f06b80cf010 tx=0x7f06a801c820 comp rx=0 tx=0).stop 2024-09-10T23:20:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.669+0000 7f06bf000640 1 -- 172.21.15.17:0/4111013670 shutdown_connections 2024-09-10T23:20:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.669+0000 7f06bf000640 1 --2- 172.21.15.17:0/4111013670 >> v2:172.21.15.77:3300/0 conn(0x7f06b80cf320 0x7f06b80cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.669+0000 7f06bf000640 1 --2- 172.21.15.17:0/4111013670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06b8070ad0 0x7f06b815f060 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.669+0000 7f06bf000640 1 -- 172.21.15.17:0/4111013670 >> 172.21.15.17:0/4111013670 conn(0x7f06b80d1d60 msgr2=0x7f06b80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.669+0000 7f06bf000640 1 -- 172.21.15.17:0/4111013670 shutdown_connections 2024-09-10T23:20:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.669+0000 7f06bf000640 1 -- 172.21.15.17:0/4111013670 wait complete. 2024-09-10T23:20:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 Processor -- start 2024-09-10T23:20:41.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 -- start start 2024-09-10T23:20:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06b8070ad0 0x7f06b81f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06b80cf320 0x7f06b80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06b80d1830 0x7f06b80b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f06b81693d0 con 0x7f06b80d1830 2024-09-10T23:20:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06b8169250 con 0x7f06b80cf320 2024-09-10T23:20:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f06b8169550 con 0x7f06b8070ad0 2024-09-10T23:20:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bd000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06b80d1830 0x7f06b80b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:41.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06af400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06b80cf320 0x7f06b80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:41.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06b8070ad0 0x7f06b81f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:41.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bd000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06b80d1830 0x7f06b80b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58238/0 (socket says 172.21.15.17:58238) 2024-09-10T23:20:41.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bd000640 1 -- 172.21.15.17:0/2913872161 learned_addr learned my addr 172.21.15.17:0/2913872161 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b7e00640 1 -- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06b80cf320 msgr2=0x7f06b80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b7e00640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06b80cf320 0x7f06b80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b7e00640 1 -- 172.21.15.17:0/2913872161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06b80d1830 msgr2=0x7f06b80b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b7e00640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06b80d1830 0x7f06b80b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b7e00640 1 -- 172.21.15.17:0/2913872161 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b81640b0 con 0x7f06b8070ad0 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06af400640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06b80cf320 0x7f06b80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b7e00640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06b8070ad0 0x7f06b81f81b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f06a80ac000 tx=0x7f06a80a5690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b4c00640 1 -- 172.21.15.17:0/2913872161 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a80bb070 con 0x7f06b8070ad0 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b4c00640 1 -- 172.21.15.17:0/2913872161 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06a8005030 con 0x7f06b8070ad0 2024-09-10T23:20:41.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06b4c00640 1 -- 172.21.15.17:0/2913872161 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a80b2040 con 0x7f06b8070ad0 2024-09-10T23:20:41.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b81f8800 con 0x7f06b8070ad0 2024-09-10T23:20:41.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.673+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b81f8dc0 con 0x7f06b8070ad0 2024-09-10T23:20:41.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.677+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b8165dc0 con 0x7f06b8070ad0 2024-09-10T23:20:41.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.677+0000 7f06b4c00640 1 -- 172.21.15.17:0/2913872161 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f06a80b5070 con 0x7f06b8070ad0 2024-09-10T23:20:41.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.677+0000 7f06b4c00640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06940725e0 0x7f0694074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.677+0000 7f06b4c00640 1 -- 172.21.15.17:0/2913872161 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f06a812cca0 con 0x7f06b8070ad0 2024-09-10T23:20:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.677+0000 7f06af400640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06940725e0 0x7f0694074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.677+0000 7f06af400640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06940725e0 0x7f0694074aa0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f06b80b4770 tx=0x7f06a0007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.681+0000 7f06b4c00640 1 -- 172.21.15.17:0/2913872161 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f06a80c4020 con 0x7f06b8070ad0 2024-09-10T23:20:41.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.853+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06b815f060 con 0x7f06b8070ad0 2024-09-10T23:20:41.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06b4c00640 1 -- 172.21.15.17:0/2913872161 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16958 (secure 0 0 0) 0x7f06a812c020 con 0x7f06b8070ad0 2024-09-10T23:20:41.861 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:41.861 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:20:40.525421+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:20:38.279133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T23:20:39.480040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:20:41.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06940725e0 msgr2=0x7f0694074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06940725e0 0x7f0694074aa0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f06b80b4770 tx=0x7f06a0007ea0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06b8070ad0 msgr2=0x7f06b81f81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06b8070ad0 0x7f06b81f81b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f06a80ac000 tx=0x7f06a80a5690 comp rx=0 tx=0).stop 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 shutdown_connections 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06940725e0 0x7f0694074aa0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06b80d1830 0x7f06b80b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06b80cf320 0x7f06b80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 --2- 172.21.15.17:0/2913872161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06b8070ad0 0x7f06b81f81b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 >> 172.21.15.17:0/2913872161 conn(0x7f06b80d1d60 msgr2=0x7f06b80af370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 shutdown_connections 2024-09-10T23:20:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:41.857+0000 7f06bf000640 1 -- 172.21.15.17:0/2913872161 wait complete. 2024-09-10T23:20:41.883 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:20:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 -- 172.21.15.17:0/4153002913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf68071bb0 msgr2=0x7fdf680cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 --2- 172.21.15.17:0/4153002913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf68071bb0 0x7fdf680cce70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fdf6806db60 tx=0x7fdf6001cd50 comp rx=0 tx=0).stop 2024-09-10T23:20:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 -- 172.21.15.17:0/4153002913 shutdown_connections 2024-09-10T23:20:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 --2- 172.21.15.17:0/4153002913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf68071bb0 0x7fdf680cce70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 --2- 172.21.15.17:0/4153002913 >> v2:172.21.15.77:3300/0 conn(0x7fdf680d23e0 0x7fdf68071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 -- 172.21.15.17:0/4153002913 >> 172.21.15.17:0/4153002913 conn(0x7fdf6809a9f0 msgr2=0x7fdf6809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 -- 172.21.15.17:0/4153002913 shutdown_connections 2024-09-10T23:20:42.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 -- 172.21.15.17:0/4153002913 wait complete. 2024-09-10T23:20:42.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 Processor -- start 2024-09-10T23:20:42.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.029+0000 7fdf6cc00640 1 -- start start 2024-09-10T23:20:42.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf6cc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf68071bb0 0x7fdf680b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:42.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf6cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf680d23e0 0x7fdf680b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf6cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf6815be20 0x7fdf68156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf6cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf68168a70 con 0x7fdf6815be20 2024-09-10T23:20:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf6cc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf681688f0 con 0x7fdf680d23e0 2024-09-10T23:20:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf6cc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf68168bf0 con 0x7fdf68071bb0 2024-09-10T23:20:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf66800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf6815be20 0x7fdf68156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf66800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf6815be20 0x7fdf68156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58260/0 (socket says 172.21.15.17:58260) 2024-09-10T23:20:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf66800640 1 -- 172.21.15.17:0/1905807097 learned_addr learned my addr 172.21.15.17:0/1905807097 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf5fe00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf680d23e0 0x7fdf680b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf65e00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf68071bb0 0x7fdf680b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf66800640 1 -- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf68071bb0 msgr2=0x7fdf680b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf66800640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf68071bb0 0x7fdf680b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf66800640 1 -- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf680d23e0 msgr2=0x7fdf680b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf66800640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf680d23e0 0x7fdf680b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf66800640 1 -- 172.21.15.17:0/1905807097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf680ce340 con 0x7fdf6815be20 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf66800640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf6815be20 0x7fdf68156670 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009bd0 tx=0x7fdf60003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf5e000640 1 -- 172.21.15.17:0/1905807097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf600bb070 con 0x7fdf6815be20 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf5e000640 1 -- 172.21.15.17:0/1905807097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf60004d10 con 0x7fdf6815be20 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf5e000640 1 -- 172.21.15.17:0/1905807097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf600b2040 con 0x7fdf6815be20 2024-09-10T23:20:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf680b5450 con 0x7fdf6815be20 2024-09-10T23:20:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf680b5a10 con 0x7fdf6815be20 2024-09-10T23:20:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.033+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf680b61b0 con 0x7fdf6815be20 2024-09-10T23:20:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.037+0000 7fdf5e000640 1 -- 172.21.15.17:0/1905807097 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdf600b5030 con 0x7fdf6815be20 2024-09-10T23:20:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.037+0000 7fdf5e000640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf440725e0 0x7fdf44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.037+0000 7fdf5e000640 1 -- 172.21.15.17:0/1905807097 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fdf6012cf20 con 0x7fdf6815be20 2024-09-10T23:20:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.037+0000 7fdf65e00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf440725e0 0x7fdf44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.037+0000 7fdf65e00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf440725e0 0x7fdf44074aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdf58007fd0 tx=0x7fdf58009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.041+0000 7fdf5e000640 1 -- 172.21.15.17:0/1905807097 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdf60016970 con 0x7fdf6815be20 2024-09-10T23:20:42.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:42.253+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdf6806e150 con 0x7fdf6815be20 2024-09-10T23:20:43.094 INFO:tasks.ceph.mds.a.smithi017.stderr:2024-09-10T23:20:43.089+0000 7f52fea00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:20:43.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.133+0000 7fdf5e000640 1 -- 172.21.15.17:0/1905807097 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) ==== 118+0+0 (secure 0 0 0) 0x7fdf600f7e10 con 0x7fdf6815be20 2024-09-10T23:20:43.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf440725e0 msgr2=0x7fdf44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:43.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf440725e0 0x7fdf44074aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdf58007fd0 tx=0x7fdf58009040 comp rx=0 tx=0).stop 2024-09-10T23:20:43.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf6815be20 msgr2=0x7fdf68156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:43.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf6815be20 0x7fdf68156670 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009bd0 tx=0x7fdf60003f60 comp rx=0 tx=0).stop 2024-09-10T23:20:43.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 shutdown_connections 2024-09-10T23:20:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf440725e0 0x7fdf44074aa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf6815be20 0x7fdf68156670 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf680d23e0 0x7fdf680b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 --2- 172.21.15.17:0/1905807097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf68071bb0 0x7fdf680b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 >> 172.21.15.17:0/1905807097 conn(0x7fdf6809a9f0 msgr2=0x7fdf680d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 shutdown_connections 2024-09-10T23:20:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.137+0000 7fdf6cc00640 1 -- 172.21.15.17:0/1905807097 wait complete. 2024-09-10T23:20:43.164 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:20:43.164 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:20:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.313+0000 7f03f9e00640 1 -- 172.21.15.17:0/1272650629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b12e0 msgr2=0x7f03f40cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.313+0000 7f03f9e00640 1 --2- 172.21.15.17:0/1272650629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b12e0 0x7f03f40cfde0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f03f40c8da0 tx=0x7f03dc01c890 comp rx=0 tx=0).stop 2024-09-10T23:20:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.313+0000 7f03f9e00640 1 -- 172.21.15.17:0/1272650629 shutdown_connections 2024-09-10T23:20:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.313+0000 7f03f9e00640 1 --2- 172.21.15.17:0/1272650629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b12e0 0x7f03f40cfde0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.313+0000 7f03f9e00640 1 --2- 172.21.15.17:0/1272650629 >> v2:172.21.15.77:3300/0 conn(0x7f03f415be00 0x7f03f415d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:43.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.313+0000 7f03f9e00640 1 -- 172.21.15.17:0/1272650629 >> 172.21.15.17:0/1272650629 conn(0x7f03f409a9f0 msgr2=0x7f03f409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.313+0000 7f03f9e00640 1 -- 172.21.15.17:0/1272650629 shutdown_connections 2024-09-10T23:20:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.313+0000 7f03f9e00640 1 -- 172.21.15.17:0/1272650629 wait complete. 2024-09-10T23:20:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 Processor -- start 2024-09-10T23:20:43.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 -- start start 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f40b12e0 0x7f03f4154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b1740 0x7f03f40afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f415be00 0x7f03f40b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f03f4169440 con 0x7f03f40b1740 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f03f41692c0 con 0x7f03f415be00 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03f41695c0 con 0x7f03f40b12e0 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03ebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b1740 0x7f03f40afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03ebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b1740 0x7f03f40afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58272/0 (socket says 172.21.15.17:58272) 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03ebe00640 1 -- 172.21.15.17:0/2696376511 learned_addr learned my addr 172.21.15.17:0/2696376511 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:43.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03ebe00640 1 -- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f40b12e0 msgr2=0x7f03f4154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03ebe00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f40b12e0 0x7f03f4154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03ebe00640 1 -- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f415be00 msgr2=0x7f03f40b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f3400640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f415be00 0x7f03f40b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03ebe00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f415be00 0x7f03f40b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03ebe00640 1 -- 172.21.15.17:0/2696376511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f406df00 con 0x7f03f40b1740 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f3400640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f415be00 0x7f03f40b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03ebe00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b1740 0x7f03f40afbf0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0b0040 tx=0x7f03dc0a6f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03eb400640 1 -- 172.21.15.17:0/2696376511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc0b2040 con 0x7f03f40b1740 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03eb400640 1 -- 172.21.15.17:0/2696376511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03dc005020 con 0x7f03f40b1740 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03eb400640 1 -- 172.21.15.17:0/2696376511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc005470 con 0x7f03f40b1740 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f406e1e0 con 0x7f03f40b1740 2024-09-10T23:20:43.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.317+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f406e7a0 con 0x7f03f40b1740 2024-09-10T23:20:43.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.321+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f40cfde0 con 0x7f03f40b1740 2024-09-10T23:20:43.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.321+0000 7f03eb400640 1 -- 172.21.15.17:0/2696376511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f03dc0046d0 con 0x7f03f40b1740 2024-09-10T23:20:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.321+0000 7f03eb400640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03d0072610 0x7f03d0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.321+0000 7f03eb400640 1 -- 172.21.15.17:0/2696376511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f03dc12cff0 con 0x7f03f40b1740 2024-09-10T23:20:43.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.321+0000 7f03f2a00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03d0072610 0x7f03d0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:43.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.325+0000 7f03f2a00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03d0072610 0x7f03d0074ad0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f03e40058d0 tx=0x7f03e4005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.325+0000 7f03eb400640 1 -- 172.21.15.17:0/2696376511 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f03dc0164b0 con 0x7f03f40b1740 2024-09-10T23:20:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:43.537+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f03f414f820 con 0x7f03f40b1740 2024-09-10T23:20:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.133+0000 7f03eb400640 1 -- 172.21.15.17:0/2696376511 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7f03dc0f84e0 con 0x7f03f40b1740 2024-09-10T23:20:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03d0072610 msgr2=0x7f03d0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03d0072610 0x7f03d0074ad0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f03e40058d0 tx=0x7f03e4005860 comp rx=0 tx=0).stop 2024-09-10T23:20:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b1740 msgr2=0x7f03f40afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b1740 0x7f03f40afbf0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0b0040 tx=0x7f03dc0a6f70 comp rx=0 tx=0).stop 2024-09-10T23:20:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 shutdown_connections 2024-09-10T23:20:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03d0072610 0x7f03d0074ad0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f415be00 0x7f03f40b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f40b1740 0x7f03f40afbf0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 --2- 172.21.15.17:0/2696376511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f40b12e0 0x7f03f4154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 >> 172.21.15.17:0/2696376511 conn(0x7f03f409a9f0 msgr2=0x7f03f40719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 shutdown_connections 2024-09-10T23:20:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.137+0000 7f03f9e00640 1 -- 172.21.15.17:0/2696376511 wait complete. 2024-09-10T23:20:44.165 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:20:44.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:44.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.313+0000 7ff0ca000640 1 -- 172.21.15.17:0/471185210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a8003a60 msgr2=0x7ff0a8003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.313+0000 7ff0ca000640 1 --2- 172.21.15.17:0/471185210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a8003a60 0x7ff0a8003e80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4009b60 tx=0x7ff0b401d270 comp rx=0 tx=0).stop 2024-09-10T23:20:44.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.313+0000 7ff0ca000640 1 -- 172.21.15.17:0/471185210 shutdown_connections 2024-09-10T23:20:44.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.313+0000 7ff0ca000640 1 --2- 172.21.15.17:0/471185210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a8003a60 0x7ff0a8003e80 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.313+0000 7ff0ca000640 1 -- 172.21.15.17:0/471185210 >> 172.21.15.17:0/471185210 conn(0x7ff0c40d1d10 msgr2=0x7ff0c40d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:44.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.313+0000 7ff0ca000640 1 -- 172.21.15.17:0/471185210 shutdown_connections 2024-09-10T23:20:44.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.313+0000 7ff0ca000640 1 -- 172.21.15.17:0/471185210 wait complete. 2024-09-10T23:20:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.313+0000 7ff0ca000640 1 Processor -- start 2024-09-10T23:20:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 -- start start 2024-09-10T23:20:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a8003a60 0x7ff0c4071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c40c6210 0x7ff0c40c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c41f3c40 0x7ff0c41f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c40d00f0 con 0x7ff0c41f3c40 2024-09-10T23:20:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c40cff70 con 0x7ff0c40c6210 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c40d0270 con 0x7ff0a8003a60 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c41f3c40 0x7ff0c41f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a8003a60 0x7ff0c4071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c41f3c40 0x7ff0c41f40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58290/0 (socket says 172.21.15.17:58290) 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3e00640 1 -- 172.21.15.17:0/3564777910 learned_addr learned my addr 172.21.15.17:0/3564777910 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0bbe00640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c40c6210 0x7ff0c40c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3e00640 1 -- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a8003a60 msgr2=0x7ff0c4071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3e00640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a8003a60 0x7ff0c4071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3e00640 1 -- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c40c6210 msgr2=0x7ff0c40c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3e00640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c40c6210 0x7ff0c40c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3e00640 1 -- 172.21.15.17:0/3564777910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c40b0e40 con 0x7ff0c41f3c40 2024-09-10T23:20:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3400640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a8003a60 0x7ff0c4071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0c3e00640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c41f3c40 0x7ff0c41f40c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40d2e10 tx=0x7ff0bc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0bb400640 1 -- 172.21.15.17:0/3564777910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc013920 con 0x7ff0c41f3c40 2024-09-10T23:20:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0bb400640 1 -- 172.21.15.17:0/3564777910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0bc013bb0 con 0x7ff0c41f3c40 2024-09-10T23:20:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c40c6df0 con 0x7ff0c41f3c40 2024-09-10T23:20:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0bb400640 1 -- 172.21.15.17:0/3564777910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0123e0 con 0x7ff0c41f3c40 2024-09-10T23:20:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c40c73b0 con 0x7ff0c41f3c40 2024-09-10T23:20:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.317+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c40af7b0 con 0x7ff0c41f3c40 2024-09-10T23:20:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.321+0000 7ff0bb400640 1 -- 172.21.15.17:0/3564777910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff0bc010040 con 0x7ff0c41f3c40 2024-09-10T23:20:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.321+0000 7ff0bb400640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a0072610 0x7ff0a0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.321+0000 7ff0bb400640 1 -- 172.21.15.17:0/3564777910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7ff0bc096c10 con 0x7ff0c41f3c40 2024-09-10T23:20:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.321+0000 7ff0c3400640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a0072610 0x7ff0a0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.321+0000 7ff0c3400640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a0072610 0x7ff0a0074ad0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40ae000 tx=0x7ff0b401a010 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.325+0000 7ff0bb400640 1 -- 172.21.15.17:0/3564777910 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff0bc061a70 con 0x7ff0c41f3c40 2024-09-10T23:20:44.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0c4074af0 con 0x7ff0c41f3c40 2024-09-10T23:20:44.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0bb400640 1 -- 172.21.15.17:0/3564777910 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5219 (secure 0 0 0) 0x7ff0bc0664a0 con 0x7ff0c41f3c40 2024-09-10T23:20:44.538 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:44.538 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":56,"btime":"2024-09-10T23:20:44:138459+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/817445499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":817445499},{"type":"v1","addr":"172.21.15.77:6836","nonce":817445499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/829655954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":829655954},{"type":"v1","addr":"172.21.15.77:6837","nonce":829655954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/4123296985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4123296985},{"type":"v1","addr":"172.21.15.17:6835","nonce":4123296985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:20:40.525388+0000","modified":"2024-09-10T23:20:43.542749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6879},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6879":{"gid":6879,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/4060324884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4060324884},{"type":"v1","addr":"172.21.15.17:6834","nonce":4060324884}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6879,"qdb_cluster":[6879]},"id":5}]} 2024-09-10T23:20:44.538 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 56 2024-09-10T23:20:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a0072610 msgr2=0x7ff0a0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a0072610 0x7ff0a0074ad0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40ae000 tx=0x7ff0b401a010 comp rx=0 tx=0).stop 2024-09-10T23:20:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c41f3c40 msgr2=0x7ff0c41f40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c41f3c40 0x7ff0c41f40c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40d2e10 tx=0x7ff0bc011a30 comp rx=0 tx=0).stop 2024-09-10T23:20:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 shutdown_connections 2024-09-10T23:20:44.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0a0072610 0x7ff0a0074ad0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0c41f3c40 0x7ff0c41f40c0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0c40c6210 0x7ff0c40c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 --2- 172.21.15.17:0/3564777910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a8003a60 0x7ff0c4071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 >> 172.21.15.17:0/3564777910 conn(0x7ff0c40d1d10 msgr2=0x7ff0c40af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 shutdown_connections 2024-09-10T23:20:44.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.533+0000 7ff0ca000640 1 -- 172.21.15.17:0/3564777910 wait complete. 2024-09-10T23:20:44.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:20:44.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 -- 172.21.15.17:0/660078655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 msgr2=0x7f07b80d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 --2- 172.21.15.17:0/660078655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 0x7f07b80d05a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f07b8075130 tx=0x7f07a401c7a0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 -- 172.21.15.17:0/660078655 shutdown_connections 2024-09-10T23:20:44.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 --2- 172.21.15.17:0/660078655 >> v2:172.21.15.77:3300/0 conn(0x7f07b80d19b0 0x7f07b80d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 --2- 172.21.15.17:0/660078655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 0x7f07b80d05a0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 --2- 172.21.15.17:0/660078655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07b815b890 0x7f07b8072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 -- 172.21.15.17:0/660078655 >> 172.21.15.17:0/660078655 conn(0x7f07b809a9f0 msgr2=0x7f07b809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 -- 172.21.15.17:0/660078655 shutdown_connections 2024-09-10T23:20:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 -- 172.21.15.17:0/660078655 wait complete. 2024-09-10T23:20:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 Processor -- start 2024-09-10T23:20:44.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.701+0000 7f07be600640 1 -- start start 2024-09-10T23:20:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07be600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b80d19b0 0x7f07b806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07be600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07b815b890 0x7f07b80c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07be600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 0x7f07b815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07be600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f07b8071070 con 0x7f07b815bc70 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07be600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07b8070ef0 con 0x7f07b80d19b0 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07be600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f07b80711f0 con 0x7f07b815b890 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bdc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 0x7f07b815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bdc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 0x7f07b815a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58318/0 (socket says 172.21.15.17:58318) 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bdc00640 1 -- 172.21.15.17:0/2736170205 learned_addr learned my addr 172.21.15.17:0/2736170205 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bd200640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b80d19b0 0x7f07b806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07b7e00640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07b815b890 0x7f07b80c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bdc00640 1 -- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07b815b890 msgr2=0x7f07b80c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bdc00640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07b815b890 0x7f07b80c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bdc00640 1 -- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b80d19b0 msgr2=0x7f07b806dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bdc00640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b80d19b0 0x7f07b806dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bdc00640 1 -- 172.21.15.17:0/2736170205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b806e360 con 0x7f07b815bc70 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07bdc00640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 0x7f07b815a010 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f07b000e990 tx=0x7f07b000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07b4c00640 1 -- 172.21.15.17:0/2736170205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0004d30 con 0x7f07b815bc70 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07b4c00640 1 -- 172.21.15.17:0/2736170205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07b000cb00 con 0x7f07b815bc70 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07b4c00640 1 -- 172.21.15.17:0/2736170205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0005020 con 0x7f07b815bc70 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b80b5ac0 con 0x7f07b815bc70 2024-09-10T23:20:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b80b6080 con 0x7f07b815bc70 2024-09-10T23:20:44.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.705+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b8072320 con 0x7f07b815bc70 2024-09-10T23:20:44.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.709+0000 7f07b4c00640 1 -- 172.21.15.17:0/2736170205 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f07b000f040 con 0x7f07b815bc70 2024-09-10T23:20:44.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.709+0000 7f07b4c00640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07980725e0 0x7f0798074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:44.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.709+0000 7f07b4c00640 1 -- 172.21.15.17:0/2736170205 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f07b0093a20 con 0x7f07b815bc70 2024-09-10T23:20:44.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.709+0000 7f07bd200640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07980725e0 0x7f0798074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:44.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.709+0000 7f07bd200640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07980725e0 0x7f0798074aa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f07ac004630 tx=0x7f07ac00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:44.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.713+0000 7f07b4c00640 1 -- 172.21.15.17:0/2736170205 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f07b0016030 con 0x7f07b815bc70 2024-09-10T23:20:44.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07b80aff40 con 0x7f07b815bc70 2024-09-10T23:20:44.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07b4c00640 1 -- 172.21.15.17:0/2736170205 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16945 (secure 0 0 0) 0x7f07b005e880 con 0x7f07b815bc70 2024-09-10T23:20:44.893 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:44.893 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:20:42.114533+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:20:38.279133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T23:20:39.480040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:20:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07980725e0 msgr2=0x7f0798074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07980725e0 0x7f0798074aa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f07ac004630 tx=0x7f07ac00b390 comp rx=0 tx=0).stop 2024-09-10T23:20:44.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 msgr2=0x7f07b815a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 0x7f07b815a010 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f07b000e990 tx=0x7f07b000ee50 comp rx=0 tx=0).stop 2024-09-10T23:20:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 shutdown_connections 2024-09-10T23:20:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07980725e0 0x7f0798074aa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07b815bc70 0x7f07b815a010 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07b815b890 0x7f07b80c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 --2- 172.21.15.17:0/2736170205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07b80d19b0 0x7f07b806dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 >> 172.21.15.17:0/2736170205 conn(0x7f07b809a9f0 msgr2=0x7f07b814f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 shutdown_connections 2024-09-10T23:20:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:44.889+0000 7f07be600640 1 -- 172.21.15.17:0/2736170205 wait complete. 2024-09-10T23:20:44.915 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:20:44.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:20:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.057+0000 7f8248200640 1 -- 172.21.15.17:0/1129889371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8240070ad0 msgr2=0x7f824015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.057+0000 7f8248200640 1 --2- 172.21.15.17:0/1129889371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8240070ad0 0x7f824015f060 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8234009900 tx=0x7f823401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.057+0000 7f8248200640 1 -- 172.21.15.17:0/1129889371 shutdown_connections 2024-09-10T23:20:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.057+0000 7f8248200640 1 --2- 172.21.15.17:0/1129889371 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82400cf320 0x7f82400cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.057+0000 7f8248200640 1 --2- 172.21.15.17:0/1129889371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8240070ad0 0x7f824015f060 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.057+0000 7f8248200640 1 -- 172.21.15.17:0/1129889371 >> 172.21.15.17:0/1129889371 conn(0x7f82400d1d60 msgr2=0x7f82400d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.057+0000 7f8248200640 1 -- 172.21.15.17:0/1129889371 shutdown_connections 2024-09-10T23:20:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.057+0000 7f8248200640 1 -- 172.21.15.17:0/1129889371 wait complete. 2024-09-10T23:20:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 Processor -- start 2024-09-10T23:20:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 -- start start 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8240070ad0 0x7f82401f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82400cf320 0x7f82400b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82400d1830 0x7f82400b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8240169430 con 0x7f82400d1830 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82401692b0 con 0x7f82400cf320 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82401695b0 con 0x7f8240070ad0 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8246200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82400d1830 0x7f82400b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8246200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82400d1830 0x7f82400b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58328/0 (socket says 172.21.15.17:58328) 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8246200640 1 -- 172.21.15.17:0/882041630 learned_addr learned my addr 172.21.15.17:0/882041630 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8245800640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8240070ad0 0x7f82401f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8244e00640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82400cf320 0x7f82400b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8246200640 1 -- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8240070ad0 msgr2=0x7f82401f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8246200640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8240070ad0 0x7f82401f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8246200640 1 -- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82400cf320 msgr2=0x7f82400b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8246200640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82400cf320 0x7f82400b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8246200640 1 -- 172.21.15.17:0/882041630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82400b1c90 con 0x7f82400d1830 2024-09-10T23:20:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8246200640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82400d1830 0x7f82400b1750 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f823800eb20 tx=0x7f823800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f823d600640 1 -- 172.21.15.17:0/882041630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238004b30 con 0x7f82400d1830 2024-09-10T23:20:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f823d600640 1 -- 172.21.15.17:0/882041630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8238004cf0 con 0x7f82400d1830 2024-09-10T23:20:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f823d600640 1 -- 172.21.15.17:0/882041630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238005280 con 0x7f82400d1830 2024-09-10T23:20:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82400b1f40 con 0x7f82400d1830 2024-09-10T23:20:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82400b2500 con 0x7f82400d1830 2024-09-10T23:20:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.061+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f824015f060 con 0x7f82400d1830 2024-09-10T23:20:45.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.065+0000 7f823d600640 1 -- 172.21.15.17:0/882041630 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8238005420 con 0x7f82400d1830 2024-09-10T23:20:45.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.065+0000 7f823d600640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.065+0000 7f823d600640 1 -- 172.21.15.17:0/882041630 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f82380941b0 con 0x7f82400d1830 2024-09-10T23:20:45.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.065+0000 7f8245800640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.065+0000 7f8245800640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82340af000 tx=0x7f823401b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:45.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.069+0000 7f823d600640 1 -- 172.21.15.17:0/882041630 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f823805f5e0 con 0x7f82400d1830 2024-09-10T23:20:45.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.241+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8240069e10 con 0x7f82200725e0 2024-09-10T23:20:45.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.245+0000 7f823d600640 1 -- 172.21.15.17:0/882041630 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248038 (secure 0 0 0) 0x7f82340041c0 con 0x7f82200725e0 2024-09-10T23:20:45.254 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:20:45.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 msgr2=0x7f8220074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82340af000 tx=0x7f823401b120 comp rx=0 tx=0).stop 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82400d1830 msgr2=0x7f82400b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82400d1830 0x7f82400b1750 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f823800eb20 tx=0x7f823800c2d0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 shutdown_connections 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82200725e0 0x7f8220074aa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82400d1830 0x7f82400b1750 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82400cf320 0x7f82400b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 --2- 172.21.15.17:0/882041630 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8240070ad0 0x7f82401f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.249+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 >> 172.21.15.17:0/882041630 conn(0x7f82400d1d60 msgr2=0x7f82400cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.253+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 shutdown_connections 2024-09-10T23:20:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.253+0000 7f8248200640 1 -- 172.21.15.17:0/882041630 wait complete. 2024-09-10T23:20:45.276 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-09-10T23:20:44.366868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":111,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":351736,"kb_used_data":9228,"kb_used_omap":12,"kb_used_meta":342323,"kb_avail":754622984,"statfs":{"total":773094113280,"available":772733935616,"internally_reserved":0,"allocated":9449472,"data_stored":4962779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":350539313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.270624"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.115761+0000","last_change":"2024-09-10T23:20:40.115761+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.115761+0000","last_undegraded":"2024-09-10T23:20:40.115761+0000","last_fullsized":"2024-09-10T23:20:40.115761+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114463+0000","last_change":"2024-09-10T23:20:40.114463+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114463+0000","last_undegraded":"2024-09-10T23:20:40.114463+0000","last_fullsized":"2024-09-10T23:20:40.114463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109112+0000","last_change":"2024-09-10T23:20:40.109112+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109112+0000","last_undegraded":"2024-09-10T23:20:40.109112+0000","last_fullsized":"2024-09-10T23:20:40.109112+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.120488+0000","last_change":"2024-09-10T23:20:40.120488+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.120488+0000","last_undegraded":"2024-09-10T23:20:40.120488+0000","last_fullsized":"2024-09-10T23:20:40.120488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.117421+0000","last_change":"2024-09-10T23:20:40.117421+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.117421+0000","last_undegraded":"2024-09-10T23:20:40.117421+0000","last_fullsized":"2024-09-10T23:20:40.117421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118568+0000","last_change":"2024-09-10T23:20:41.127078+0000","last_active":"2024-09-10T23:20:42.118568+0000","last_peered":"2024-09-10T23:20:42.118568+0000","last_clean":"2024-09-10T23:20:42.118568+0000","last_became_active":"2024-09-10T23:20:41.126523+0000","last_became_peered":"2024-09-10T23:20:41.126523+0000","last_unstale":"2024-09-10T23:20:42.118568+0000","last_undegraded":"2024-09-10T23:20:42.118568+0000","last_fullsized":"2024-09-10T23:20:42.118568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:13.361890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134703+0000","last_change":"2024-09-10T23:20:41.131788+0000","last_active":"2024-09-10T23:20:41.134703+0000","last_peered":"2024-09-10T23:20:41.134703+0000","last_clean":"2024-09-10T23:20:41.134703+0000","last_became_active":"2024-09-10T23:20:41.131510+0000","last_became_peered":"2024-09-10T23:20:41.131510+0000","last_unstale":"2024-09-10T23:20:41.134703+0000","last_undegraded":"2024-09-10T23:20:41.134703+0000","last_fullsized":"2024-09-10T23:20:41.134703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:29.649638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112450+0000","last_change":"2024-09-10T23:20:40.112450+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112450+0000","last_undegraded":"2024-09-10T23:20:40.112450+0000","last_fullsized":"2024-09-10T23:20:40.112450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113588+0000","last_change":"2024-09-10T23:20:40.113588+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113588+0000","last_undegraded":"2024-09-10T23:20:40.113588+0000","last_fullsized":"2024-09-10T23:20:40.113588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.122203+0000","last_change":"2024-09-10T23:20:40.122203+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.122203+0000","last_undegraded":"2024-09-10T23:20:40.122203+0000","last_fullsized":"2024-09-10T23:20:40.122203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114478+0000","last_change":"2024-09-10T23:20:40.114478+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114478+0000","last_undegraded":"2024-09-10T23:20:40.114478+0000","last_fullsized":"2024-09-10T23:20:40.114478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.120047+0000","last_change":"2024-09-10T23:20:40.120047+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.120047+0000","last_undegraded":"2024-09-10T23:20:40.120047+0000","last_fullsized":"2024-09-10T23:20:40.120047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112063+0000","last_change":"2024-09-10T23:20:40.112063+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112063+0000","last_undegraded":"2024-09-10T23:20:40.112063+0000","last_fullsized":"2024-09-10T23:20:40.112063+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118828+0000","last_change":"2024-09-10T23:20:41.127354+0000","last_active":"2024-09-10T23:20:42.118828+0000","last_peered":"2024-09-10T23:20:42.118828+0000","last_clean":"2024-09-10T23:20:42.118828+0000","last_became_active":"2024-09-10T23:20:41.126817+0000","last_became_peered":"2024-09-10T23:20:41.126817+0000","last_unstale":"2024-09-10T23:20:42.118828+0000","last_undegraded":"2024-09-10T23:20:42.118828+0000","last_fullsized":"2024-09-10T23:20:42.118828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:29.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.115788+0000","last_change":"2024-09-10T23:20:40.115788+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.115788+0000","last_undegraded":"2024-09-10T23:20:40.115788+0000","last_fullsized":"2024-09-10T23:20:40.115788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114922+0000","last_change":"2024-09-10T23:20:40.114922+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114922+0000","last_undegraded":"2024-09-10T23:20:40.114922+0000","last_fullsized":"2024-09-10T23:20:40.114922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112627+0000","last_change":"2024-09-10T23:20:40.112627+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112627+0000","last_undegraded":"2024-09-10T23:20:40.112627+0000","last_fullsized":"2024-09-10T23:20:40.112627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.108314+0000","last_change":"2024-09-10T23:20:40.108314+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.108314+0000","last_undegraded":"2024-09-10T23:20:40.108314+0000","last_fullsized":"2024-09-10T23:20:40.108314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118830+0000","last_change":"2024-09-10T23:20:41.124255+0000","last_active":"2024-09-10T23:20:42.118830+0000","last_peered":"2024-09-10T23:20:42.118830+0000","last_clean":"2024-09-10T23:20:42.118830+0000","last_became_active":"2024-09-10T23:20:41.123986+0000","last_became_peered":"2024-09-10T23:20:41.123986+0000","last_unstale":"2024-09-10T23:20:42.118830+0000","last_undegraded":"2024-09-10T23:20:42.118830+0000","last_fullsized":"2024-09-10T23:20:42.118830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:28.015170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.117132+0000","last_change":"2024-09-10T23:20:40.117132+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.117132+0000","last_undegraded":"2024-09-10T23:20:40.117132+0000","last_fullsized":"2024-09-10T23:20:40.117132+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113117+0000","last_change":"2024-09-10T23:20:40.113117+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113117+0000","last_undegraded":"2024-09-10T23:20:40.113117+0000","last_fullsized":"2024-09-10T23:20:40.113117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112405+0000","last_change":"2024-09-10T23:20:40.112405+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112405+0000","last_undegraded":"2024-09-10T23:20:40.112405+0000","last_fullsized":"2024-09-10T23:20:40.112405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112344+0000","last_change":"2024-09-10T23:20:40.112344+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112344+0000","last_undegraded":"2024-09-10T23:20:40.112344+0000","last_fullsized":"2024-09-10T23:20:40.112344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114450+0000","last_change":"2024-09-10T23:20:40.114450+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114450+0000","last_undegraded":"2024-09-10T23:20:40.114450+0000","last_fullsized":"2024-09-10T23:20:40.114450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111727+0000","last_change":"2024-09-10T23:20:40.111727+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111727+0000","last_undegraded":"2024-09-10T23:20:40.111727+0000","last_fullsized":"2024-09-10T23:20:40.111727+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.119651+0000","last_change":"2024-09-10T23:20:40.119651+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.119651+0000","last_undegraded":"2024-09-10T23:20:40.119651+0000","last_fullsized":"2024-09-10T23:20:40.119651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.117313+0000","last_change":"2024-09-10T23:20:40.117313+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.117313+0000","last_undegraded":"2024-09-10T23:20:40.117313+0000","last_fullsized":"2024-09-10T23:20:40.117313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116481+0000","last_change":"2024-09-10T23:20:40.116481+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116481+0000","last_undegraded":"2024-09-10T23:20:40.116481+0000","last_fullsized":"2024-09-10T23:20:40.116481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111740+0000","last_change":"2024-09-10T23:20:40.111740+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111740+0000","last_undegraded":"2024-09-10T23:20:40.111740+0000","last_fullsized":"2024-09-10T23:20:40.111740+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116288+0000","last_change":"2024-09-10T23:20:40.116288+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116288+0000","last_undegraded":"2024-09-10T23:20:40.116288+0000","last_fullsized":"2024-09-10T23:20:40.116288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.108231+0000","last_change":"2024-09-10T23:20:40.108231+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.108231+0000","last_undegraded":"2024-09-10T23:20:40.108231+0000","last_fullsized":"2024-09-10T23:20:40.108231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114407+0000","last_change":"2024-09-10T23:20:40.114407+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114407+0000","last_undegraded":"2024-09-10T23:20:40.114407+0000","last_fullsized":"2024-09-10T23:20:40.114407+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109454+0000","last_change":"2024-09-10T23:20:40.109454+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109454+0000","last_undegraded":"2024-09-10T23:20:40.109454+0000","last_fullsized":"2024-09-10T23:20:40.109454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130690+0000","last_change":"2024-09-10T23:20:40.128521+0000","last_active":"2024-09-10T23:20:40.130690+0000","last_peered":"2024-09-10T23:20:40.130690+0000","last_clean":"2024-09-10T23:20:40.130690+0000","last_became_active":"2024-09-10T23:20:40.128196+0000","last_became_peered":"2024-09-10T23:20:40.128196+0000","last_unstale":"2024-09-10T23:20:40.130690+0000","last_undegraded":"2024-09-10T23:20:40.130690+0000","last_fullsized":"2024-09-10T23:20:40.130690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.910404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111190+0000","last_change":"2024-09-10T23:20:40.111190+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111190+0000","last_undegraded":"2024-09-10T23:20:40.111190+0000","last_fullsized":"2024-09-10T23:20:40.111190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130785+0000","last_change":"2024-09-10T23:20:40.129893+0000","last_active":"2024-09-10T23:20:40.130785+0000","last_peered":"2024-09-10T23:20:40.130785+0000","last_clean":"2024-09-10T23:20:40.130785+0000","last_became_active":"2024-09-10T23:20:40.129646+0000","last_became_peered":"2024-09-10T23:20:40.129646+0000","last_unstale":"2024-09-10T23:20:40.130785+0000","last_undegraded":"2024-09-10T23:20:40.130785+0000","last_fullsized":"2024-09-10T23:20:40.130785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:39.499737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114180+0000","last_change":"2024-09-10T23:20:40.114180+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114180+0000","last_undegraded":"2024-09-10T23:20:40.114180+0000","last_fullsized":"2024-09-10T23:20:40.114180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.135854+0000","last_change":"2024-09-10T23:20:40.135323+0000","last_active":"2024-09-10T23:20:40.135854+0000","last_peered":"2024-09-10T23:20:40.135854+0000","last_clean":"2024-09-10T23:20:40.135854+0000","last_became_active":"2024-09-10T23:20:40.135063+0000","last_became_peered":"2024-09-10T23:20:40.135063+0000","last_unstale":"2024-09-10T23:20:40.135854+0000","last_undegraded":"2024-09-10T23:20:40.135854+0000","last_fullsized":"2024-09-10T23:20:40.135854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:12.468324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112662+0000","last_change":"2024-09-10T23:20:40.112662+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112662+0000","last_undegraded":"2024-09-10T23:20:40.112662+0000","last_fullsized":"2024-09-10T23:20:40.112662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.141611+0000","last_change":"2024-09-10T23:20:40.123991+0000","last_active":"2024-09-10T23:20:41.141611+0000","last_peered":"2024-09-10T23:20:41.141611+0000","last_clean":"2024-09-10T23:20:41.141611+0000","last_became_active":"2024-09-10T23:20:40.123692+0000","last_became_peered":"2024-09-10T23:20:40.123692+0000","last_unstale":"2024-09-10T23:20:41.141611+0000","last_undegraded":"2024-09-10T23:20:41.141611+0000","last_fullsized":"2024-09-10T23:20:41.141611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:11.568207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111753+0000","last_change":"2024-09-10T23:20:40.111753+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111753+0000","last_undegraded":"2024-09-10T23:20:40.111753+0000","last_fullsized":"2024-09-10T23:20:40.111753+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.126864+0000","last_change":"2024-09-10T23:20:40.123371+0000","last_active":"2024-09-10T23:20:40.126864+0000","last_peered":"2024-09-10T23:20:40.126864+0000","last_clean":"2024-09-10T23:20:40.126864+0000","last_became_active":"2024-09-10T23:20:40.123098+0000","last_became_peered":"2024-09-10T23:20:40.123098+0000","last_unstale":"2024-09-10T23:20:40.126864+0000","last_undegraded":"2024-09-10T23:20:40.126864+0000","last_fullsized":"2024-09-10T23:20:40.126864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:07.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111262+0000","last_change":"2024-09-10T23:20:40.111262+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111262+0000","last_undegraded":"2024-09-10T23:20:40.111262+0000","last_fullsized":"2024-09-10T23:20:40.111262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.131874+0000","last_change":"2024-09-10T23:20:40.127892+0000","last_active":"2024-09-10T23:20:40.131874+0000","last_peered":"2024-09-10T23:20:40.131874+0000","last_clean":"2024-09-10T23:20:40.131874+0000","last_became_active":"2024-09-10T23:20:40.127610+0000","last_became_peered":"2024-09-10T23:20:40.127610+0000","last_unstale":"2024-09-10T23:20:40.131874+0000","last_undegraded":"2024-09-10T23:20:40.131874+0000","last_fullsized":"2024-09-10T23:20:40.131874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:50.349385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113501+0000","last_change":"2024-09-10T23:20:40.113501+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113501+0000","last_undegraded":"2024-09-10T23:20:40.113501+0000","last_fullsized":"2024-09-10T23:20:40.113501+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.127249+0000","last_change":"2024-09-10T23:20:40.119841+0000","last_active":"2024-09-10T23:20:40.127249+0000","last_peered":"2024-09-10T23:20:40.127249+0000","last_clean":"2024-09-10T23:20:40.127249+0000","last_became_active":"2024-09-10T23:20:40.119554+0000","last_became_peered":"2024-09-10T23:20:40.119554+0000","last_unstale":"2024-09-10T23:20:40.127249+0000","last_undegraded":"2024-09-10T23:20:40.127249+0000","last_fullsized":"2024-09-10T23:20:40.127249+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:36.218067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134568+0000","last_change":"2024-09-10T23:20:41.131356+0000","last_active":"2024-09-10T23:20:41.134568+0000","last_peered":"2024-09-10T23:20:41.134568+0000","last_clean":"2024-09-10T23:20:41.134568+0000","last_became_active":"2024-09-10T23:20:41.131112+0000","last_became_peered":"2024-09-10T23:20:41.131112+0000","last_unstale":"2024-09-10T23:20:41.134568+0000","last_undegraded":"2024-09-10T23:20:41.134568+0000","last_fullsized":"2024-09-10T23:20:41.134568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130320+0000","last_change":"2024-09-10T23:20:40.124214+0000","last_active":"2024-09-10T23:20:40.130320+0000","last_peered":"2024-09-10T23:20:40.130320+0000","last_clean":"2024-09-10T23:20:40.130320+0000","last_became_active":"2024-09-10T23:20:40.120446+0000","last_became_peered":"2024-09-10T23:20:40.120446+0000","last_unstale":"2024-09-10T23:20:40.130320+0000","last_undegraded":"2024-09-10T23:20:40.130320+0000","last_fullsized":"2024-09-10T23:20:40.130320+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:24.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109294+0000","last_change":"2024-09-10T23:20:40.109294+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109294+0000","last_undegraded":"2024-09-10T23:20:40.109294+0000","last_fullsized":"2024-09-10T23:20:40.109294+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132935+0000","last_change":"2024-09-10T23:20:40.131592+0000","last_active":"2024-09-10T23:20:40.132935+0000","last_peered":"2024-09-10T23:20:40.132935+0000","last_clean":"2024-09-10T23:20:40.132935+0000","last_became_active":"2024-09-10T23:20:40.131327+0000","last_became_peered":"2024-09-10T23:20:40.131327+0000","last_unstale":"2024-09-10T23:20:40.132935+0000","last_undegraded":"2024-09-10T23:20:40.132935+0000","last_fullsized":"2024-09-10T23:20:40.132935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:49.618430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.119113+0000","last_change":"2024-09-10T23:20:40.119113+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.119113+0000","last_undegraded":"2024-09-10T23:20:40.119113+0000","last_fullsized":"2024-09-10T23:20:40.119113+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.131779+0000","last_change":"2024-09-10T23:20:40.128083+0000","last_active":"2024-09-10T23:20:40.131779+0000","last_peered":"2024-09-10T23:20:40.131779+0000","last_clean":"2024-09-10T23:20:40.131779+0000","last_became_active":"2024-09-10T23:20:40.127555+0000","last_became_peered":"2024-09-10T23:20:40.127555+0000","last_unstale":"2024-09-10T23:20:40.131779+0000","last_undegraded":"2024-09-10T23:20:40.131779+0000","last_fullsized":"2024-09-10T23:20:40.131779+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:39.499737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118875+0000","last_change":"2024-09-10T23:20:41.122664+0000","last_active":"2024-09-10T23:20:42.118875+0000","last_peered":"2024-09-10T23:20:42.118875+0000","last_clean":"2024-09-10T23:20:42.118875+0000","last_became_active":"2024-09-10T23:20:41.122359+0000","last_became_peered":"2024-09-10T23:20:41.122359+0000","last_unstale":"2024-09-10T23:20:42.118875+0000","last_undegraded":"2024-09-10T23:20:42.118875+0000","last_fullsized":"2024-09-10T23:20:42.118875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:04.020060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130936+0000","last_change":"2024-09-10T23:20:40.129170+0000","last_active":"2024-09-10T23:20:40.130936+0000","last_peered":"2024-09-10T23:20:40.130936+0000","last_clean":"2024-09-10T23:20:40.130936+0000","last_became_active":"2024-09-10T23:20:40.128901+0000","last_became_peered":"2024-09-10T23:20:40.128901+0000","last_unstale":"2024-09-10T23:20:40.130936+0000","last_undegraded":"2024-09-10T23:20:40.130936+0000","last_fullsized":"2024-09-10T23:20:40.130936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:09.334489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107684+0000","last_change":"2024-09-10T23:20:40.107684+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107684+0000","last_undegraded":"2024-09-10T23:20:40.107684+0000","last_fullsized":"2024-09-10T23:20:40.107684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.148019+0000","last_change":"2024-09-10T23:20:40.129709+0000","last_active":"2024-09-10T23:20:41.148019+0000","last_peered":"2024-09-10T23:20:41.148019+0000","last_clean":"2024-09-10T23:20:41.148019+0000","last_became_active":"2024-09-10T23:20:40.128128+0000","last_became_peered":"2024-09-10T23:20:40.128128+0000","last_unstale":"2024-09-10T23:20:41.148019+0000","last_undegraded":"2024-09-10T23:20:41.148019+0000","last_fullsized":"2024-09-10T23:20:41.148019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:31.178729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.119572+0000","last_change":"2024-09-10T23:20:40.119572+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.119572+0000","last_undegraded":"2024-09-10T23:20:40.119572+0000","last_fullsized":"2024-09-10T23:20:40.119572+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.131898+0000","last_change":"2024-09-10T23:20:40.128787+0000","last_active":"2024-09-10T23:20:40.131898+0000","last_peered":"2024-09-10T23:20:40.131898+0000","last_clean":"2024-09-10T23:20:40.131898+0000","last_became_active":"2024-09-10T23:20:40.128517+0000","last_became_peered":"2024-09-10T23:20:40.128517+0000","last_unstale":"2024-09-10T23:20:40.131898+0000","last_undegraded":"2024-09-10T23:20:40.131898+0000","last_fullsized":"2024-09-10T23:20:40.131898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:26.322064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.130610+0000","last_change":"2024-09-10T23:20:41.125926+0000","last_active":"2024-09-10T23:20:41.130610+0000","last_peered":"2024-09-10T23:20:41.130610+0000","last_clean":"2024-09-10T23:20:41.130610+0000","last_became_active":"2024-09-10T23:20:41.125634+0000","last_became_peered":"2024-09-10T23:20:41.125634+0000","last_unstale":"2024-09-10T23:20:41.130610+0000","last_undegraded":"2024-09-10T23:20:41.130610+0000","last_fullsized":"2024-09-10T23:20:41.130610+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:06.508857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132811+0000","last_change":"2024-09-10T23:20:40.131376+0000","last_active":"2024-09-10T23:20:40.132811+0000","last_peered":"2024-09-10T23:20:40.132811+0000","last_clean":"2024-09-10T23:20:40.132811+0000","last_became_active":"2024-09-10T23:20:40.131048+0000","last_became_peered":"2024-09-10T23:20:40.131048+0000","last_unstale":"2024-09-10T23:20:40.132811+0000","last_undegraded":"2024-09-10T23:20:40.132811+0000","last_fullsized":"2024-09-10T23:20:40.132811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:26.322064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.124528+0000","last_change":"2024-09-10T23:20:41.120364+0000","last_active":"2024-09-10T23:20:41.124528+0000","last_peered":"2024-09-10T23:20:41.124528+0000","last_clean":"2024-09-10T23:20:41.124528+0000","last_became_active":"2024-09-10T23:20:41.120112+0000","last_became_peered":"2024-09-10T23:20:41.120112+0000","last_unstale":"2024-09-10T23:20:41.124528+0000","last_undegraded":"2024-09-10T23:20:41.124528+0000","last_fullsized":"2024-09-10T23:20:41.124528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:59.966232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132045+0000","last_change":"2024-09-10T23:20:40.130101+0000","last_active":"2024-09-10T23:20:40.132045+0000","last_peered":"2024-09-10T23:20:40.132045+0000","last_clean":"2024-09-10T23:20:40.132045+0000","last_became_active":"2024-09-10T23:20:40.129612+0000","last_became_peered":"2024-09-10T23:20:40.129612+0000","last_unstale":"2024-09-10T23:20:40.132045+0000","last_undegraded":"2024-09-10T23:20:40.132045+0000","last_fullsized":"2024-09-10T23:20:40.132045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:21.235225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134109+0000","last_change":"2024-09-10T23:20:41.128895+0000","last_active":"2024-09-10T23:20:41.134109+0000","last_peered":"2024-09-10T23:20:41.134109+0000","last_clean":"2024-09-10T23:20:41.134109+0000","last_became_active":"2024-09-10T23:20:41.126170+0000","last_became_peered":"2024-09-10T23:20:41.126170+0000","last_unstale":"2024-09-10T23:20:41.134109+0000","last_undegraded":"2024-09-10T23:20:41.134109+0000","last_fullsized":"2024-09-10T23:20:41.134109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:57.954331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132432+0000","last_change":"2024-09-10T23:20:40.124184+0000","last_active":"2024-09-10T23:20:40.132432+0000","last_peered":"2024-09-10T23:20:40.132432+0000","last_clean":"2024-09-10T23:20:40.132432+0000","last_became_active":"2024-09-10T23:20:40.123915+0000","last_became_peered":"2024-09-10T23:20:40.123915+0000","last_unstale":"2024-09-10T23:20:40.132432+0000","last_undegraded":"2024-09-10T23:20:40.132432+0000","last_fullsized":"2024-09-10T23:20:40.132432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:08.035908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118297+0000","last_change":"2024-09-10T23:20:41.115069+0000","last_active":"2024-09-10T23:20:42.118297+0000","last_peered":"2024-09-10T23:20:42.118297+0000","last_clean":"2024-09-10T23:20:42.118297+0000","last_became_active":"2024-09-10T23:20:41.114657+0000","last_became_peered":"2024-09-10T23:20:41.114657+0000","last_unstale":"2024-09-10T23:20:42.118297+0000","last_undegraded":"2024-09-10T23:20:42.118297+0000","last_fullsized":"2024-09-10T23:20:42.118297+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:21.933582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132999+0000","last_change":"2024-09-10T23:20:40.131437+0000","last_active":"2024-09-10T23:20:40.132999+0000","last_peered":"2024-09-10T23:20:40.132999+0000","last_clean":"2024-09-10T23:20:40.132999+0000","last_became_active":"2024-09-10T23:20:40.131158+0000","last_became_peered":"2024-09-10T23:20:40.131158+0000","last_unstale":"2024-09-10T23:20:40.132999+0000","last_undegraded":"2024-09-10T23:20:40.132999+0000","last_fullsized":"2024-09-10T23:20:40.132999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:09.803453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116080+0000","last_change":"2024-09-10T23:20:40.116080+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116080+0000","last_undegraded":"2024-09-10T23:20:40.116080+0000","last_fullsized":"2024-09-10T23:20:40.116080+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.126787+0000","last_change":"2024-09-10T23:20:40.124220+0000","last_active":"2024-09-10T23:20:40.126787+0000","last_peered":"2024-09-10T23:20:40.126787+0000","last_clean":"2024-09-10T23:20:40.126787+0000","last_became_active":"2024-09-10T23:20:40.123970+0000","last_became_peered":"2024-09-10T23:20:40.123970+0000","last_unstale":"2024-09-10T23:20:40.126787+0000","last_undegraded":"2024-09-10T23:20:40.126787+0000","last_fullsized":"2024-09-10T23:20:40.126787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:29.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116528+0000","last_change":"2024-09-10T23:20:40.116528+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116528+0000","last_undegraded":"2024-09-10T23:20:40.116528+0000","last_fullsized":"2024-09-10T23:20:40.116528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130911+0000","last_change":"2024-09-10T23:20:40.125679+0000","last_active":"2024-09-10T23:20:40.130911+0000","last_peered":"2024-09-10T23:20:40.130911+0000","last_clean":"2024-09-10T23:20:40.130911+0000","last_became_active":"2024-09-10T23:20:40.125337+0000","last_became_peered":"2024-09-10T23:20:40.125337+0000","last_unstale":"2024-09-10T23:20:40.130911+0000","last_undegraded":"2024-09-10T23:20:40.130911+0000","last_fullsized":"2024-09-10T23:20:40.130911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:19.612517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118656+0000","last_change":"2024-09-10T23:20:41.123472+0000","last_active":"2024-09-10T23:20:42.118656+0000","last_peered":"2024-09-10T23:20:42.118656+0000","last_clean":"2024-09-10T23:20:42.118656+0000","last_became_active":"2024-09-10T23:20:41.123196+0000","last_became_peered":"2024-09-10T23:20:41.123196+0000","last_unstale":"2024-09-10T23:20:42.118656+0000","last_undegraded":"2024-09-10T23:20:42.118656+0000","last_fullsized":"2024-09-10T23:20:42.118656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:39.750457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130856+0000","last_change":"2024-09-10T23:20:40.128380+0000","last_active":"2024-09-10T23:20:40.130856+0000","last_peered":"2024-09-10T23:20:40.130856+0000","last_clean":"2024-09-10T23:20:40.130856+0000","last_became_active":"2024-09-10T23:20:40.128069+0000","last_became_peered":"2024-09-10T23:20:40.128069+0000","last_unstale":"2024-09-10T23:20:40.130856+0000","last_undegraded":"2024-09-10T23:20:40.130856+0000","last_fullsized":"2024-09-10T23:20:40.130856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:55.651424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109972+0000","last_change":"2024-09-10T23:20:40.109972+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109972+0000","last_undegraded":"2024-09-10T23:20:40.109972+0000","last_fullsized":"2024-09-10T23:20:40.109972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118643+0000","last_change":"2024-09-10T23:20:40.122770+0000","last_active":"2024-09-10T23:20:42.118643+0000","last_peered":"2024-09-10T23:20:42.118643+0000","last_clean":"2024-09-10T23:20:42.118643+0000","last_became_active":"2024-09-10T23:20:40.122501+0000","last_became_peered":"2024-09-10T23:20:40.122501+0000","last_unstale":"2024-09-10T23:20:42.118643+0000","last_undegraded":"2024-09-10T23:20:42.118643+0000","last_fullsized":"2024-09-10T23:20:42.118643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:01.567448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.110761+0000","last_change":"2024-09-10T23:20:40.110761+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.110761+0000","last_undegraded":"2024-09-10T23:20:40.110761+0000","last_fullsized":"2024-09-10T23:20:40.110761+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118288+0000","last_change":"2024-09-10T23:20:40.120678+0000","last_active":"2024-09-10T23:20:42.118288+0000","last_peered":"2024-09-10T23:20:42.118288+0000","last_clean":"2024-09-10T23:20:42.118288+0000","last_became_active":"2024-09-10T23:20:40.120368+0000","last_became_peered":"2024-09-10T23:20:40.120368+0000","last_unstale":"2024-09-10T23:20:42.118288+0000","last_undegraded":"2024-09-10T23:20:42.118288+0000","last_fullsized":"2024-09-10T23:20:42.118288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:15.092441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134137+0000","last_change":"2024-09-10T23:20:41.129524+0000","last_active":"2024-09-10T23:20:41.134137+0000","last_peered":"2024-09-10T23:20:41.134137+0000","last_clean":"2024-09-10T23:20:41.134137+0000","last_became_active":"2024-09-10T23:20:41.126551+0000","last_became_peered":"2024-09-10T23:20:41.126551+0000","last_unstale":"2024-09-10T23:20:41.134137+0000","last_undegraded":"2024-09-10T23:20:41.134137+0000","last_fullsized":"2024-09-10T23:20:41.134137+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:12.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118292+0000","last_change":"2024-09-10T23:20:40.126347+0000","last_active":"2024-09-10T23:20:42.118292+0000","last_peered":"2024-09-10T23:20:42.118292+0000","last_clean":"2024-09-10T23:20:42.118292+0000","last_became_active":"2024-09-10T23:20:40.126068+0000","last_became_peered":"2024-09-10T23:20:40.126068+0000","last_unstale":"2024-09-10T23:20:42.118292+0000","last_undegraded":"2024-09-10T23:20:42.118292+0000","last_fullsized":"2024-09-10T23:20:42.118292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:41.654200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112309+0000","last_change":"2024-09-10T23:20:40.112309+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112309+0000","last_undegraded":"2024-09-10T23:20:40.112309+0000","last_fullsized":"2024-09-10T23:20:40.112309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132729+0000","last_change":"2024-09-10T23:20:40.129652+0000","last_active":"2024-09-10T23:20:40.132729+0000","last_peered":"2024-09-10T23:20:40.132729+0000","last_clean":"2024-09-10T23:20:40.132729+0000","last_became_active":"2024-09-10T23:20:40.129397+0000","last_became_peered":"2024-09-10T23:20:40.129397+0000","last_unstale":"2024-09-10T23:20:40.132729+0000","last_undegraded":"2024-09-10T23:20:40.132729+0000","last_fullsized":"2024-09-10T23:20:40.132729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:09.803453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.123453+0000","last_change":"2024-09-10T23:20:41.117473+0000","last_active":"2024-09-10T23:20:41.123453+0000","last_peered":"2024-09-10T23:20:41.123453+0000","last_clean":"2024-09-10T23:20:41.123453+0000","last_became_active":"2024-09-10T23:20:41.117123+0000","last_became_peered":"2024-09-10T23:20:41.117123+0000","last_unstale":"2024-09-10T23:20:41.123453+0000","last_undegraded":"2024-09-10T23:20:41.123453+0000","last_fullsized":"2024-09-10T23:20:41.123453+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:13.927428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132116+0000","last_change":"2024-09-10T23:20:40.131528+0000","last_active":"2024-09-10T23:20:40.132116+0000","last_peered":"2024-09-10T23:20:40.132116+0000","last_clean":"2024-09-10T23:20:40.132116+0000","last_became_active":"2024-09-10T23:20:40.131200+0000","last_became_peered":"2024-09-10T23:20:40.131200+0000","last_unstale":"2024-09-10T23:20:40.132116+0000","last_undegraded":"2024-09-10T23:20:40.132116+0000","last_fullsized":"2024-09-10T23:20:40.132116+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:28.731640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113783+0000","last_change":"2024-09-10T23:20:40.113783+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113783+0000","last_undegraded":"2024-09-10T23:20:40.113783+0000","last_fullsized":"2024-09-10T23:20:40.113783+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130368+0000","last_change":"2024-09-10T23:20:40.128507+0000","last_active":"2024-09-10T23:20:40.130368+0000","last_peered":"2024-09-10T23:20:40.130368+0000","last_clean":"2024-09-10T23:20:40.130368+0000","last_became_active":"2024-09-10T23:20:40.128235+0000","last_became_peered":"2024-09-10T23:20:40.128235+0000","last_unstale":"2024-09-10T23:20:40.130368+0000","last_undegraded":"2024-09-10T23:20:40.130368+0000","last_fullsized":"2024-09-10T23:20:40.130368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:50.349385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107985+0000","last_change":"2024-09-10T23:20:40.107985+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107985+0000","last_undegraded":"2024-09-10T23:20:40.107985+0000","last_fullsized":"2024-09-10T23:20:40.107985+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.133105+0000","last_change":"2024-09-10T23:20:40.132298+0000","last_active":"2024-09-10T23:20:40.133105+0000","last_peered":"2024-09-10T23:20:40.133105+0000","last_clean":"2024-09-10T23:20:40.133105+0000","last_became_active":"2024-09-10T23:20:40.132054+0000","last_became_peered":"2024-09-10T23:20:40.132054+0000","last_unstale":"2024-09-10T23:20:40.133105+0000","last_undegraded":"2024-09-10T23:20:40.133105+0000","last_fullsized":"2024-09-10T23:20:40.133105+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:10.871552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.133553+0000","last_change":"2024-09-10T23:20:41.128546+0000","last_active":"2024-09-10T23:20:41.133553+0000","last_peered":"2024-09-10T23:20:41.133553+0000","last_clean":"2024-09-10T23:20:41.133553+0000","last_became_active":"2024-09-10T23:20:41.126264+0000","last_became_peered":"2024-09-10T23:20:41.126264+0000","last_unstale":"2024-09-10T23:20:41.133553+0000","last_undegraded":"2024-09-10T23:20:41.133553+0000","last_fullsized":"2024-09-10T23:20:41.133553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:02:58.511740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.111179+0000","last_change":"2024-09-10T23:20:40.124599+0000","last_active":"2024-09-10T23:20:41.111179+0000","last_peered":"2024-09-10T23:20:41.111179+0000","last_clean":"2024-09-10T23:20:41.111179+0000","last_became_active":"2024-09-10T23:20:40.124357+0000","last_became_peered":"2024-09-10T23:20:40.124357+0000","last_unstale":"2024-09-10T23:20:41.111179+0000","last_undegraded":"2024-09-10T23:20:41.111179+0000","last_fullsized":"2024-09-10T23:20:41.111179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:58.899986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.130583+0000","last_change":"2024-09-10T23:20:41.125253+0000","last_active":"2024-09-10T23:20:41.130583+0000","last_peered":"2024-09-10T23:20:41.130583+0000","last_clean":"2024-09-10T23:20:41.130583+0000","last_became_active":"2024-09-10T23:20:41.124980+0000","last_became_peered":"2024-09-10T23:20:41.124980+0000","last_unstale":"2024-09-10T23:20:41.130583+0000","last_undegraded":"2024-09-10T23:20:41.130583+0000","last_fullsized":"2024-09-10T23:20:41.130583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:56.756478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130350+0000","last_change":"2024-09-10T23:20:40.127513+0000","last_active":"2024-09-10T23:20:40.130350+0000","last_peered":"2024-09-10T23:20:40.130350+0000","last_clean":"2024-09-10T23:20:40.130350+0000","last_became_active":"2024-09-10T23:20:40.127217+0000","last_became_peered":"2024-09-10T23:20:40.127217+0000","last_unstale":"2024-09-10T23:20:40.130350+0000","last_undegraded":"2024-09-10T23:20:40.130350+0000","last_fullsized":"2024-09-10T23:20:40.130350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:14.164864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107507+0000","last_change":"2024-09-10T23:20:40.107507+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107507+0000","last_undegraded":"2024-09-10T23:20:40.107507+0000","last_fullsized":"2024-09-10T23:20:40.107507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.113311+0000","last_change":"2024-09-10T23:20:40.127031+0000","last_active":"2024-09-10T23:20:41.113311+0000","last_peered":"2024-09-10T23:20:41.113311+0000","last_clean":"2024-09-10T23:20:41.113311+0000","last_became_active":"2024-09-10T23:20:40.126712+0000","last_became_peered":"2024-09-10T23:20:40.126712+0000","last_unstale":"2024-09-10T23:20:41.113311+0000","last_undegraded":"2024-09-10T23:20:41.113311+0000","last_fullsized":"2024-09-10T23:20:41.113311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:21.158468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107502+0000","last_change":"2024-09-10T23:20:40.107502+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107502+0000","last_undegraded":"2024-09-10T23:20:40.107502+0000","last_fullsized":"2024-09-10T23:20:40.107502+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.126357+0000","last_change":"2024-09-10T23:20:40.120127+0000","last_active":"2024-09-10T23:20:40.126357+0000","last_peered":"2024-09-10T23:20:40.126357+0000","last_clean":"2024-09-10T23:20:40.126357+0000","last_became_active":"2024-09-10T23:20:40.117614+0000","last_became_peered":"2024-09-10T23:20:40.117614+0000","last_unstale":"2024-09-10T23:20:40.126357+0000","last_undegraded":"2024-09-10T23:20:40.126357+0000","last_fullsized":"2024-09-10T23:20:40.126357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:22.462867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116101+0000","last_change":"2024-09-10T23:20:40.116101+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116101+0000","last_undegraded":"2024-09-10T23:20:40.116101+0000","last_fullsized":"2024-09-10T23:20:40.116101+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118969+0000","last_change":"2024-09-10T23:20:40.118820+0000","last_active":"2024-09-10T23:20:42.118969+0000","last_peered":"2024-09-10T23:20:42.118969+0000","last_clean":"2024-09-10T23:20:42.118969+0000","last_became_active":"2024-09-10T23:20:40.118517+0000","last_became_peered":"2024-09-10T23:20:40.118517+0000","last_unstale":"2024-09-10T23:20:42.118969+0000","last_undegraded":"2024-09-10T23:20:42.118969+0000","last_fullsized":"2024-09-10T23:20:42.118969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:36.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":223,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.117765+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:20:40.117765+0000","last_peered":"2024-09-10T23:20:40.117765+0000","last_clean":"2024-09-10T23:20:40.117765+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:20:40.117765+0000","last_undegraded":"2024-09-10T23:20:40.117765+0000","last_fullsized":"2024-09-10T23:20:40.117765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476802,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50812,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321028,"statfs":{"total":96636764160,"available":96584732672,"internally_reserved":0,"allocated":1613824,"data_stored":1056318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509506,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46072,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325768,"statfs":{"total":96636764160,"available":96589586432,"internally_reserved":0,"allocated":1019904,"data_stored":465950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54988,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316852,"statfs":{"total":96636764160,"available":96580456448,"internally_reserved":0,"allocated":1626112,"data_stored":1062985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50272,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321568,"statfs":{"total":96636764160,"available":96585285632,"internally_reserved":0,"allocated":1060864,"data_stored":487058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:20:45.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:20:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.465+0000 7f083ac00640 1 -- 172.21.15.17:0/2058798369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0818003a10 msgr2=0x7f0818003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.465+0000 7f083ac00640 1 --2- 172.21.15.17:0/2058798369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0818003a10 0x7f0818003e30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f082400c470 tx=0x7f082401cfa0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.465+0000 7f0838c00640 1 -- 172.21.15.17:0/2058798369 reap_dead start 2024-09-10T23:20:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.465+0000 7f083ac00640 1 -- 172.21.15.17:0/2058798369 shutdown_connections 2024-09-10T23:20:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.465+0000 7f083ac00640 1 -- 172.21.15.17:0/2058798369 >> 172.21.15.17:0/2058798369 conn(0x7f08340b3870 msgr2=0x7f08340b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.465+0000 7f083ac00640 1 -- 172.21.15.17:0/2058798369 shutdown_connections 2024-09-10T23:20:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.465+0000 7f083ac00640 1 -- 172.21.15.17:0/2058798369 wait complete. 2024-09-10T23:20:45.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.465+0000 7f083ac00640 1 Processor -- start 2024-09-10T23:20:45.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 -- start start 2024-09-10T23:20:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0818003a10 0x7f0834148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08340cb9a0 0x7f08340b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0834145df0 0x7f08340b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f083415e9d0 con 0x7f08340cb9a0 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f083415e850 con 0x7f0818003a10 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f083415eb50 con 0x7f0834145df0 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f082be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08340cb9a0 0x7f08340b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f082be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08340cb9a0 0x7f08340b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58344/0 (socket says 172.21.15.17:58344) 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f082be00640 1 -- 172.21.15.17:0/830648162 learned_addr learned my addr 172.21.15.17:0/830648162 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f0833e00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0818003a10 0x7f0834148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f0838c00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0834145df0 0x7f08340b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f082be00640 1 -- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0834145df0 msgr2=0x7f08340b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f082be00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0834145df0 0x7f08340b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f082be00640 1 -- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0818003a10 msgr2=0x7f0834148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f082be00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0818003a10 0x7f0834148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f082be00640 1 -- 172.21.15.17:0/830648162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0834148d90 con 0x7f08340cb9a0 2024-09-10T23:20:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f0833e00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0818003a10 0x7f0834148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f082be00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08340cb9a0 0x7f08340b2650 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f081c011a50 tx=0x7f081c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f0830c00640 1 -- 172.21.15.17:0/830648162 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c01f070 con 0x7f08340cb9a0 2024-09-10T23:20:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f0830c00640 1 -- 172.21.15.17:0/830648162 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f081c00fe80 con 0x7f08340cb9a0 2024-09-10T23:20:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f0830c00640 1 -- 172.21.15.17:0/830648162 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081c012690 con 0x7f08340cb9a0 2024-09-10T23:20:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08340b4c80 con 0x7f08340cb9a0 2024-09-10T23:20:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08340b6940 con 0x7f08340cb9a0 2024-09-10T23:20:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.469+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08340b51a0 con 0x7f08340cb9a0 2024-09-10T23:20:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.473+0000 7f0830c00640 1 -- 172.21.15.17:0/830648162 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f081c012830 con 0x7f08340cb9a0 2024-09-10T23:20:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.473+0000 7f0830c00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08100725e0 0x7f0810074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.473+0000 7f0830c00640 1 -- 172.21.15.17:0/830648162 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f081c094110 con 0x7f08340cb9a0 2024-09-10T23:20:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.473+0000 7f0833e00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08100725e0 0x7f0810074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.473+0000 7f0833e00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08100725e0 0x7f0810074aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f08240ac000 tx=0x7f08240b0040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.477+0000 7f0830c00640 1 -- 172.21.15.17:0/830648162 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f081c05ef70 con 0x7f08340cb9a0 2024-09-10T23:20:45.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.645+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f083415db00 con 0x7f08100725e0 2024-09-10T23:20:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f0830c00640 1 -- 172.21.15.17:0/830648162 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248038 (secure 0 0 0) 0x7f08240fa900 con 0x7f08100725e0 2024-09-10T23:20:45.661 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:45.662 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:20:45.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08100725e0 msgr2=0x7f0810074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08100725e0 0x7f0810074aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f08240ac000 tx=0x7f08240b0040 comp rx=0 tx=0).stop 2024-09-10T23:20:45.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08340cb9a0 msgr2=0x7f08340b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08340cb9a0 0x7f08340b2650 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f081c011a50 tx=0x7f081c011f10 comp rx=0 tx=0).stop 2024-09-10T23:20:45.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 shutdown_connections 2024-09-10T23:20:45.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08100725e0 0x7f0810074aa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0834145df0 0x7f08340b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08340cb9a0 0x7f08340b2650 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 --2- 172.21.15.17:0/830648162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0818003a10 0x7f0834148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.653+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 >> 172.21.15.17:0/830648162 conn(0x7f08340b3870 msgr2=0x7f08340cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:45.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.657+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 shutdown_connections 2024-09-10T23:20:45.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.657+0000 7f083ac00640 1 -- 172.21.15.17:0/830648162 wait complete. 2024-09-10T23:20:45.679 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-09-10T23:20:44.366868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":111,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":351736,"kb_used_data":9228,"kb_used_omap":12,"kb_used_meta":342323,"kb_avail":754622984,"statfs":{"total":773094113280,"available":772733935616,"internally_reserved":0,"allocated":9449472,"data_stored":4962779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":350539313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.270624"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.115761+0000","last_change":"2024-09-10T23:20:40.115761+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.115761+0000","last_undegraded":"2024-09-10T23:20:40.115761+0000","last_fullsized":"2024-09-10T23:20:40.115761+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114463+0000","last_change":"2024-09-10T23:20:40.114463+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114463+0000","last_undegraded":"2024-09-10T23:20:40.114463+0000","last_fullsized":"2024-09-10T23:20:40.114463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109112+0000","last_change":"2024-09-10T23:20:40.109112+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109112+0000","last_undegraded":"2024-09-10T23:20:40.109112+0000","last_fullsized":"2024-09-10T23:20:40.109112+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.120488+0000","last_change":"2024-09-10T23:20:40.120488+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.120488+0000","last_undegraded":"2024-09-10T23:20:40.120488+0000","last_fullsized":"2024-09-10T23:20:40.120488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.117421+0000","last_change":"2024-09-10T23:20:40.117421+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.117421+0000","last_undegraded":"2024-09-10T23:20:40.117421+0000","last_fullsized":"2024-09-10T23:20:40.117421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118568+0000","last_change":"2024-09-10T23:20:41.127078+0000","last_active":"2024-09-10T23:20:42.118568+0000","last_peered":"2024-09-10T23:20:42.118568+0000","last_clean":"2024-09-10T23:20:42.118568+0000","last_became_active":"2024-09-10T23:20:41.126523+0000","last_became_peered":"2024-09-10T23:20:41.126523+0000","last_unstale":"2024-09-10T23:20:42.118568+0000","last_undegraded":"2024-09-10T23:20:42.118568+0000","last_fullsized":"2024-09-10T23:20:42.118568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:13.361890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134703+0000","last_change":"2024-09-10T23:20:41.131788+0000","last_active":"2024-09-10T23:20:41.134703+0000","last_peered":"2024-09-10T23:20:41.134703+0000","last_clean":"2024-09-10T23:20:41.134703+0000","last_became_active":"2024-09-10T23:20:41.131510+0000","last_became_peered":"2024-09-10T23:20:41.131510+0000","last_unstale":"2024-09-10T23:20:41.134703+0000","last_undegraded":"2024-09-10T23:20:41.134703+0000","last_fullsized":"2024-09-10T23:20:41.134703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:29.649638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112450+0000","last_change":"2024-09-10T23:20:40.112450+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112450+0000","last_undegraded":"2024-09-10T23:20:40.112450+0000","last_fullsized":"2024-09-10T23:20:40.112450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113588+0000","last_change":"2024-09-10T23:20:40.113588+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113588+0000","last_undegraded":"2024-09-10T23:20:40.113588+0000","last_fullsized":"2024-09-10T23:20:40.113588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.122203+0000","last_change":"2024-09-10T23:20:40.122203+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.122203+0000","last_undegraded":"2024-09-10T23:20:40.122203+0000","last_fullsized":"2024-09-10T23:20:40.122203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114478+0000","last_change":"2024-09-10T23:20:40.114478+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114478+0000","last_undegraded":"2024-09-10T23:20:40.114478+0000","last_fullsized":"2024-09-10T23:20:40.114478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.120047+0000","last_change":"2024-09-10T23:20:40.120047+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.120047+0000","last_undegraded":"2024-09-10T23:20:40.120047+0000","last_fullsized":"2024-09-10T23:20:40.120047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112063+0000","last_change":"2024-09-10T23:20:40.112063+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112063+0000","last_undegraded":"2024-09-10T23:20:40.112063+0000","last_fullsized":"2024-09-10T23:20:40.112063+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118828+0000","last_change":"2024-09-10T23:20:41.127354+0000","last_active":"2024-09-10T23:20:42.118828+0000","last_peered":"2024-09-10T23:20:42.118828+0000","last_clean":"2024-09-10T23:20:42.118828+0000","last_became_active":"2024-09-10T23:20:41.126817+0000","last_became_peered":"2024-09-10T23:20:41.126817+0000","last_unstale":"2024-09-10T23:20:42.118828+0000","last_undegraded":"2024-09-10T23:20:42.118828+0000","last_fullsized":"2024-09-10T23:20:42.118828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:29.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.115788+0000","last_change":"2024-09-10T23:20:40.115788+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.115788+0000","last_undegraded":"2024-09-10T23:20:40.115788+0000","last_fullsized":"2024-09-10T23:20:40.115788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114922+0000","last_change":"2024-09-10T23:20:40.114922+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114922+0000","last_undegraded":"2024-09-10T23:20:40.114922+0000","last_fullsized":"2024-09-10T23:20:40.114922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112627+0000","last_change":"2024-09-10T23:20:40.112627+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112627+0000","last_undegraded":"2024-09-10T23:20:40.112627+0000","last_fullsized":"2024-09-10T23:20:40.112627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.108314+0000","last_change":"2024-09-10T23:20:40.108314+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.108314+0000","last_undegraded":"2024-09-10T23:20:40.108314+0000","last_fullsized":"2024-09-10T23:20:40.108314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118830+0000","last_change":"2024-09-10T23:20:41.124255+0000","last_active":"2024-09-10T23:20:42.118830+0000","last_peered":"2024-09-10T23:20:42.118830+0000","last_clean":"2024-09-10T23:20:42.118830+0000","last_became_active":"2024-09-10T23:20:41.123986+0000","last_became_peered":"2024-09-10T23:20:41.123986+0000","last_unstale":"2024-09-10T23:20:42.118830+0000","last_undegraded":"2024-09-10T23:20:42.118830+0000","last_fullsized":"2024-09-10T23:20:42.118830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:28.015170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.117132+0000","last_change":"2024-09-10T23:20:40.117132+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.117132+0000","last_undegraded":"2024-09-10T23:20:40.117132+0000","last_fullsized":"2024-09-10T23:20:40.117132+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113117+0000","last_change":"2024-09-10T23:20:40.113117+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113117+0000","last_undegraded":"2024-09-10T23:20:40.113117+0000","last_fullsized":"2024-09-10T23:20:40.113117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112405+0000","last_change":"2024-09-10T23:20:40.112405+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112405+0000","last_undegraded":"2024-09-10T23:20:40.112405+0000","last_fullsized":"2024-09-10T23:20:40.112405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112344+0000","last_change":"2024-09-10T23:20:40.112344+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112344+0000","last_undegraded":"2024-09-10T23:20:40.112344+0000","last_fullsized":"2024-09-10T23:20:40.112344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114450+0000","last_change":"2024-09-10T23:20:40.114450+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114450+0000","last_undegraded":"2024-09-10T23:20:40.114450+0000","last_fullsized":"2024-09-10T23:20:40.114450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111727+0000","last_change":"2024-09-10T23:20:40.111727+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111727+0000","last_undegraded":"2024-09-10T23:20:40.111727+0000","last_fullsized":"2024-09-10T23:20:40.111727+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.119651+0000","last_change":"2024-09-10T23:20:40.119651+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.119651+0000","last_undegraded":"2024-09-10T23:20:40.119651+0000","last_fullsized":"2024-09-10T23:20:40.119651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.117313+0000","last_change":"2024-09-10T23:20:40.117313+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.117313+0000","last_undegraded":"2024-09-10T23:20:40.117313+0000","last_fullsized":"2024-09-10T23:20:40.117313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116481+0000","last_change":"2024-09-10T23:20:40.116481+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116481+0000","last_undegraded":"2024-09-10T23:20:40.116481+0000","last_fullsized":"2024-09-10T23:20:40.116481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111740+0000","last_change":"2024-09-10T23:20:40.111740+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111740+0000","last_undegraded":"2024-09-10T23:20:40.111740+0000","last_fullsized":"2024-09-10T23:20:40.111740+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116288+0000","last_change":"2024-09-10T23:20:40.116288+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116288+0000","last_undegraded":"2024-09-10T23:20:40.116288+0000","last_fullsized":"2024-09-10T23:20:40.116288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.108231+0000","last_change":"2024-09-10T23:20:40.108231+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.108231+0000","last_undegraded":"2024-09-10T23:20:40.108231+0000","last_fullsized":"2024-09-10T23:20:40.108231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114407+0000","last_change":"2024-09-10T23:20:40.114407+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114407+0000","last_undegraded":"2024-09-10T23:20:40.114407+0000","last_fullsized":"2024-09-10T23:20:40.114407+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109454+0000","last_change":"2024-09-10T23:20:40.109454+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109454+0000","last_undegraded":"2024-09-10T23:20:40.109454+0000","last_fullsized":"2024-09-10T23:20:40.109454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130690+0000","last_change":"2024-09-10T23:20:40.128521+0000","last_active":"2024-09-10T23:20:40.130690+0000","last_peered":"2024-09-10T23:20:40.130690+0000","last_clean":"2024-09-10T23:20:40.130690+0000","last_became_active":"2024-09-10T23:20:40.128196+0000","last_became_peered":"2024-09-10T23:20:40.128196+0000","last_unstale":"2024-09-10T23:20:40.130690+0000","last_undegraded":"2024-09-10T23:20:40.130690+0000","last_fullsized":"2024-09-10T23:20:40.130690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.910404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111190+0000","last_change":"2024-09-10T23:20:40.111190+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111190+0000","last_undegraded":"2024-09-10T23:20:40.111190+0000","last_fullsized":"2024-09-10T23:20:40.111190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130785+0000","last_change":"2024-09-10T23:20:40.129893+0000","last_active":"2024-09-10T23:20:40.130785+0000","last_peered":"2024-09-10T23:20:40.130785+0000","last_clean":"2024-09-10T23:20:40.130785+0000","last_became_active":"2024-09-10T23:20:40.129646+0000","last_became_peered":"2024-09-10T23:20:40.129646+0000","last_unstale":"2024-09-10T23:20:40.130785+0000","last_undegraded":"2024-09-10T23:20:40.130785+0000","last_fullsized":"2024-09-10T23:20:40.130785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:39.499737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114180+0000","last_change":"2024-09-10T23:20:40.114180+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114180+0000","last_undegraded":"2024-09-10T23:20:40.114180+0000","last_fullsized":"2024-09-10T23:20:40.114180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.135854+0000","last_change":"2024-09-10T23:20:40.135323+0000","last_active":"2024-09-10T23:20:40.135854+0000","last_peered":"2024-09-10T23:20:40.135854+0000","last_clean":"2024-09-10T23:20:40.135854+0000","last_became_active":"2024-09-10T23:20:40.135063+0000","last_became_peered":"2024-09-10T23:20:40.135063+0000","last_unstale":"2024-09-10T23:20:40.135854+0000","last_undegraded":"2024-09-10T23:20:40.135854+0000","last_fullsized":"2024-09-10T23:20:40.135854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:12.468324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112662+0000","last_change":"2024-09-10T23:20:40.112662+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112662+0000","last_undegraded":"2024-09-10T23:20:40.112662+0000","last_fullsized":"2024-09-10T23:20:40.112662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.141611+0000","last_change":"2024-09-10T23:20:40.123991+0000","last_active":"2024-09-10T23:20:41.141611+0000","last_peered":"2024-09-10T23:20:41.141611+0000","last_clean":"2024-09-10T23:20:41.141611+0000","last_became_active":"2024-09-10T23:20:40.123692+0000","last_became_peered":"2024-09-10T23:20:40.123692+0000","last_unstale":"2024-09-10T23:20:41.141611+0000","last_undegraded":"2024-09-10T23:20:41.141611+0000","last_fullsized":"2024-09-10T23:20:41.141611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:11.568207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111753+0000","last_change":"2024-09-10T23:20:40.111753+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111753+0000","last_undegraded":"2024-09-10T23:20:40.111753+0000","last_fullsized":"2024-09-10T23:20:40.111753+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.126864+0000","last_change":"2024-09-10T23:20:40.123371+0000","last_active":"2024-09-10T23:20:40.126864+0000","last_peered":"2024-09-10T23:20:40.126864+0000","last_clean":"2024-09-10T23:20:40.126864+0000","last_became_active":"2024-09-10T23:20:40.123098+0000","last_became_peered":"2024-09-10T23:20:40.123098+0000","last_unstale":"2024-09-10T23:20:40.126864+0000","last_undegraded":"2024-09-10T23:20:40.126864+0000","last_fullsized":"2024-09-10T23:20:40.126864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:07.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111262+0000","last_change":"2024-09-10T23:20:40.111262+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111262+0000","last_undegraded":"2024-09-10T23:20:40.111262+0000","last_fullsized":"2024-09-10T23:20:40.111262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.131874+0000","last_change":"2024-09-10T23:20:40.127892+0000","last_active":"2024-09-10T23:20:40.131874+0000","last_peered":"2024-09-10T23:20:40.131874+0000","last_clean":"2024-09-10T23:20:40.131874+0000","last_became_active":"2024-09-10T23:20:40.127610+0000","last_became_peered":"2024-09-10T23:20:40.127610+0000","last_unstale":"2024-09-10T23:20:40.131874+0000","last_undegraded":"2024-09-10T23:20:40.131874+0000","last_fullsized":"2024-09-10T23:20:40.131874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:50.349385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113501+0000","last_change":"2024-09-10T23:20:40.113501+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113501+0000","last_undegraded":"2024-09-10T23:20:40.113501+0000","last_fullsized":"2024-09-10T23:20:40.113501+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.127249+0000","last_change":"2024-09-10T23:20:40.119841+0000","last_active":"2024-09-10T23:20:40.127249+0000","last_peered":"2024-09-10T23:20:40.127249+0000","last_clean":"2024-09-10T23:20:40.127249+0000","last_became_active":"2024-09-10T23:20:40.119554+0000","last_became_peered":"2024-09-10T23:20:40.119554+0000","last_unstale":"2024-09-10T23:20:40.127249+0000","last_undegraded":"2024-09-10T23:20:40.127249+0000","last_fullsized":"2024-09-10T23:20:40.127249+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:36.218067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134568+0000","last_change":"2024-09-10T23:20:41.131356+0000","last_active":"2024-09-10T23:20:41.134568+0000","last_peered":"2024-09-10T23:20:41.134568+0000","last_clean":"2024-09-10T23:20:41.134568+0000","last_became_active":"2024-09-10T23:20:41.131112+0000","last_became_peered":"2024-09-10T23:20:41.131112+0000","last_unstale":"2024-09-10T23:20:41.134568+0000","last_undegraded":"2024-09-10T23:20:41.134568+0000","last_fullsized":"2024-09-10T23:20:41.134568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130320+0000","last_change":"2024-09-10T23:20:40.124214+0000","last_active":"2024-09-10T23:20:40.130320+0000","last_peered":"2024-09-10T23:20:40.130320+0000","last_clean":"2024-09-10T23:20:40.130320+0000","last_became_active":"2024-09-10T23:20:40.120446+0000","last_became_peered":"2024-09-10T23:20:40.120446+0000","last_unstale":"2024-09-10T23:20:40.130320+0000","last_undegraded":"2024-09-10T23:20:40.130320+0000","last_fullsized":"2024-09-10T23:20:40.130320+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:24.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109294+0000","last_change":"2024-09-10T23:20:40.109294+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109294+0000","last_undegraded":"2024-09-10T23:20:40.109294+0000","last_fullsized":"2024-09-10T23:20:40.109294+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132935+0000","last_change":"2024-09-10T23:20:40.131592+0000","last_active":"2024-09-10T23:20:40.132935+0000","last_peered":"2024-09-10T23:20:40.132935+0000","last_clean":"2024-09-10T23:20:40.132935+0000","last_became_active":"2024-09-10T23:20:40.131327+0000","last_became_peered":"2024-09-10T23:20:40.131327+0000","last_unstale":"2024-09-10T23:20:40.132935+0000","last_undegraded":"2024-09-10T23:20:40.132935+0000","last_fullsized":"2024-09-10T23:20:40.132935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:49.618430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.119113+0000","last_change":"2024-09-10T23:20:40.119113+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.119113+0000","last_undegraded":"2024-09-10T23:20:40.119113+0000","last_fullsized":"2024-09-10T23:20:40.119113+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.131779+0000","last_change":"2024-09-10T23:20:40.128083+0000","last_active":"2024-09-10T23:20:40.131779+0000","last_peered":"2024-09-10T23:20:40.131779+0000","last_clean":"2024-09-10T23:20:40.131779+0000","last_became_active":"2024-09-10T23:20:40.127555+0000","last_became_peered":"2024-09-10T23:20:40.127555+0000","last_unstale":"2024-09-10T23:20:40.131779+0000","last_undegraded":"2024-09-10T23:20:40.131779+0000","last_fullsized":"2024-09-10T23:20:40.131779+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:39.499737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118875+0000","last_change":"2024-09-10T23:20:41.122664+0000","last_active":"2024-09-10T23:20:42.118875+0000","last_peered":"2024-09-10T23:20:42.118875+0000","last_clean":"2024-09-10T23:20:42.118875+0000","last_became_active":"2024-09-10T23:20:41.122359+0000","last_became_peered":"2024-09-10T23:20:41.122359+0000","last_unstale":"2024-09-10T23:20:42.118875+0000","last_undegraded":"2024-09-10T23:20:42.118875+0000","last_fullsized":"2024-09-10T23:20:42.118875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:04.020060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130936+0000","last_change":"2024-09-10T23:20:40.129170+0000","last_active":"2024-09-10T23:20:40.130936+0000","last_peered":"2024-09-10T23:20:40.130936+0000","last_clean":"2024-09-10T23:20:40.130936+0000","last_became_active":"2024-09-10T23:20:40.128901+0000","last_became_peered":"2024-09-10T23:20:40.128901+0000","last_unstale":"2024-09-10T23:20:40.130936+0000","last_undegraded":"2024-09-10T23:20:40.130936+0000","last_fullsized":"2024-09-10T23:20:40.130936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:09.334489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107684+0000","last_change":"2024-09-10T23:20:40.107684+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107684+0000","last_undegraded":"2024-09-10T23:20:40.107684+0000","last_fullsized":"2024-09-10T23:20:40.107684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.148019+0000","last_change":"2024-09-10T23:20:40.129709+0000","last_active":"2024-09-10T23:20:41.148019+0000","last_peered":"2024-09-10T23:20:41.148019+0000","last_clean":"2024-09-10T23:20:41.148019+0000","last_became_active":"2024-09-10T23:20:40.128128+0000","last_became_peered":"2024-09-10T23:20:40.128128+0000","last_unstale":"2024-09-10T23:20:41.148019+0000","last_undegraded":"2024-09-10T23:20:41.148019+0000","last_fullsized":"2024-09-10T23:20:41.148019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:31.178729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.119572+0000","last_change":"2024-09-10T23:20:40.119572+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.119572+0000","last_undegraded":"2024-09-10T23:20:40.119572+0000","last_fullsized":"2024-09-10T23:20:40.119572+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.131898+0000","last_change":"2024-09-10T23:20:40.128787+0000","last_active":"2024-09-10T23:20:40.131898+0000","last_peered":"2024-09-10T23:20:40.131898+0000","last_clean":"2024-09-10T23:20:40.131898+0000","last_became_active":"2024-09-10T23:20:40.128517+0000","last_became_peered":"2024-09-10T23:20:40.128517+0000","last_unstale":"2024-09-10T23:20:40.131898+0000","last_undegraded":"2024-09-10T23:20:40.131898+0000","last_fullsized":"2024-09-10T23:20:40.131898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:26.322064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.130610+0000","last_change":"2024-09-10T23:20:41.125926+0000","last_active":"2024-09-10T23:20:41.130610+0000","last_peered":"2024-09-10T23:20:41.130610+0000","last_clean":"2024-09-10T23:20:41.130610+0000","last_became_active":"2024-09-10T23:20:41.125634+0000","last_became_peered":"2024-09-10T23:20:41.125634+0000","last_unstale":"2024-09-10T23:20:41.130610+0000","last_undegraded":"2024-09-10T23:20:41.130610+0000","last_fullsized":"2024-09-10T23:20:41.130610+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:06.508857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132811+0000","last_change":"2024-09-10T23:20:40.131376+0000","last_active":"2024-09-10T23:20:40.132811+0000","last_peered":"2024-09-10T23:20:40.132811+0000","last_clean":"2024-09-10T23:20:40.132811+0000","last_became_active":"2024-09-10T23:20:40.131048+0000","last_became_peered":"2024-09-10T23:20:40.131048+0000","last_unstale":"2024-09-10T23:20:40.132811+0000","last_undegraded":"2024-09-10T23:20:40.132811+0000","last_fullsized":"2024-09-10T23:20:40.132811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:26.322064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.124528+0000","last_change":"2024-09-10T23:20:41.120364+0000","last_active":"2024-09-10T23:20:41.124528+0000","last_peered":"2024-09-10T23:20:41.124528+0000","last_clean":"2024-09-10T23:20:41.124528+0000","last_became_active":"2024-09-10T23:20:41.120112+0000","last_became_peered":"2024-09-10T23:20:41.120112+0000","last_unstale":"2024-09-10T23:20:41.124528+0000","last_undegraded":"2024-09-10T23:20:41.124528+0000","last_fullsized":"2024-09-10T23:20:41.124528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:59.966232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132045+0000","last_change":"2024-09-10T23:20:40.130101+0000","last_active":"2024-09-10T23:20:40.132045+0000","last_peered":"2024-09-10T23:20:40.132045+0000","last_clean":"2024-09-10T23:20:40.132045+0000","last_became_active":"2024-09-10T23:20:40.129612+0000","last_became_peered":"2024-09-10T23:20:40.129612+0000","last_unstale":"2024-09-10T23:20:40.132045+0000","last_undegraded":"2024-09-10T23:20:40.132045+0000","last_fullsized":"2024-09-10T23:20:40.132045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:21.235225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134109+0000","last_change":"2024-09-10T23:20:41.128895+0000","last_active":"2024-09-10T23:20:41.134109+0000","last_peered":"2024-09-10T23:20:41.134109+0000","last_clean":"2024-09-10T23:20:41.134109+0000","last_became_active":"2024-09-10T23:20:41.126170+0000","last_became_peered":"2024-09-10T23:20:41.126170+0000","last_unstale":"2024-09-10T23:20:41.134109+0000","last_undegraded":"2024-09-10T23:20:41.134109+0000","last_fullsized":"2024-09-10T23:20:41.134109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:57.954331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132432+0000","last_change":"2024-09-10T23:20:40.124184+0000","last_active":"2024-09-10T23:20:40.132432+0000","last_peered":"2024-09-10T23:20:40.132432+0000","last_clean":"2024-09-10T23:20:40.132432+0000","last_became_active":"2024-09-10T23:20:40.123915+0000","last_became_peered":"2024-09-10T23:20:40.123915+0000","last_unstale":"2024-09-10T23:20:40.132432+0000","last_undegraded":"2024-09-10T23:20:40.132432+0000","last_fullsized":"2024-09-10T23:20:40.132432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:08.035908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118297+0000","last_change":"2024-09-10T23:20:41.115069+0000","last_active":"2024-09-10T23:20:42.118297+0000","last_peered":"2024-09-10T23:20:42.118297+0000","last_clean":"2024-09-10T23:20:42.118297+0000","last_became_active":"2024-09-10T23:20:41.114657+0000","last_became_peered":"2024-09-10T23:20:41.114657+0000","last_unstale":"2024-09-10T23:20:42.118297+0000","last_undegraded":"2024-09-10T23:20:42.118297+0000","last_fullsized":"2024-09-10T23:20:42.118297+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:21.933582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132999+0000","last_change":"2024-09-10T23:20:40.131437+0000","last_active":"2024-09-10T23:20:40.132999+0000","last_peered":"2024-09-10T23:20:40.132999+0000","last_clean":"2024-09-10T23:20:40.132999+0000","last_became_active":"2024-09-10T23:20:40.131158+0000","last_became_peered":"2024-09-10T23:20:40.131158+0000","last_unstale":"2024-09-10T23:20:40.132999+0000","last_undegraded":"2024-09-10T23:20:40.132999+0000","last_fullsized":"2024-09-10T23:20:40.132999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:09.803453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116080+0000","last_change":"2024-09-10T23:20:40.116080+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116080+0000","last_undegraded":"2024-09-10T23:20:40.116080+0000","last_fullsized":"2024-09-10T23:20:40.116080+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.126787+0000","last_change":"2024-09-10T23:20:40.124220+0000","last_active":"2024-09-10T23:20:40.126787+0000","last_peered":"2024-09-10T23:20:40.126787+0000","last_clean":"2024-09-10T23:20:40.126787+0000","last_became_active":"2024-09-10T23:20:40.123970+0000","last_became_peered":"2024-09-10T23:20:40.123970+0000","last_unstale":"2024-09-10T23:20:40.126787+0000","last_undegraded":"2024-09-10T23:20:40.126787+0000","last_fullsized":"2024-09-10T23:20:40.126787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:29.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116528+0000","last_change":"2024-09-10T23:20:40.116528+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116528+0000","last_undegraded":"2024-09-10T23:20:40.116528+0000","last_fullsized":"2024-09-10T23:20:40.116528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130911+0000","last_change":"2024-09-10T23:20:40.125679+0000","last_active":"2024-09-10T23:20:40.130911+0000","last_peered":"2024-09-10T23:20:40.130911+0000","last_clean":"2024-09-10T23:20:40.130911+0000","last_became_active":"2024-09-10T23:20:40.125337+0000","last_became_peered":"2024-09-10T23:20:40.125337+0000","last_unstale":"2024-09-10T23:20:40.130911+0000","last_undegraded":"2024-09-10T23:20:40.130911+0000","last_fullsized":"2024-09-10T23:20:40.130911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:19.612517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118656+0000","last_change":"2024-09-10T23:20:41.123472+0000","last_active":"2024-09-10T23:20:42.118656+0000","last_peered":"2024-09-10T23:20:42.118656+0000","last_clean":"2024-09-10T23:20:42.118656+0000","last_became_active":"2024-09-10T23:20:41.123196+0000","last_became_peered":"2024-09-10T23:20:41.123196+0000","last_unstale":"2024-09-10T23:20:42.118656+0000","last_undegraded":"2024-09-10T23:20:42.118656+0000","last_fullsized":"2024-09-10T23:20:42.118656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:39.750457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130856+0000","last_change":"2024-09-10T23:20:40.128380+0000","last_active":"2024-09-10T23:20:40.130856+0000","last_peered":"2024-09-10T23:20:40.130856+0000","last_clean":"2024-09-10T23:20:40.130856+0000","last_became_active":"2024-09-10T23:20:40.128069+0000","last_became_peered":"2024-09-10T23:20:40.128069+0000","last_unstale":"2024-09-10T23:20:40.130856+0000","last_undegraded":"2024-09-10T23:20:40.130856+0000","last_fullsized":"2024-09-10T23:20:40.130856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:55.651424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109972+0000","last_change":"2024-09-10T23:20:40.109972+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109972+0000","last_undegraded":"2024-09-10T23:20:40.109972+0000","last_fullsized":"2024-09-10T23:20:40.109972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118643+0000","last_change":"2024-09-10T23:20:40.122770+0000","last_active":"2024-09-10T23:20:42.118643+0000","last_peered":"2024-09-10T23:20:42.118643+0000","last_clean":"2024-09-10T23:20:42.118643+0000","last_became_active":"2024-09-10T23:20:40.122501+0000","last_became_peered":"2024-09-10T23:20:40.122501+0000","last_unstale":"2024-09-10T23:20:42.118643+0000","last_undegraded":"2024-09-10T23:20:42.118643+0000","last_fullsized":"2024-09-10T23:20:42.118643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:01.567448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.110761+0000","last_change":"2024-09-10T23:20:40.110761+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.110761+0000","last_undegraded":"2024-09-10T23:20:40.110761+0000","last_fullsized":"2024-09-10T23:20:40.110761+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118288+0000","last_change":"2024-09-10T23:20:40.120678+0000","last_active":"2024-09-10T23:20:42.118288+0000","last_peered":"2024-09-10T23:20:42.118288+0000","last_clean":"2024-09-10T23:20:42.118288+0000","last_became_active":"2024-09-10T23:20:40.120368+0000","last_became_peered":"2024-09-10T23:20:40.120368+0000","last_unstale":"2024-09-10T23:20:42.118288+0000","last_undegraded":"2024-09-10T23:20:42.118288+0000","last_fullsized":"2024-09-10T23:20:42.118288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:15.092441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134137+0000","last_change":"2024-09-10T23:20:41.129524+0000","last_active":"2024-09-10T23:20:41.134137+0000","last_peered":"2024-09-10T23:20:41.134137+0000","last_clean":"2024-09-10T23:20:41.134137+0000","last_became_active":"2024-09-10T23:20:41.126551+0000","last_became_peered":"2024-09-10T23:20:41.126551+0000","last_unstale":"2024-09-10T23:20:41.134137+0000","last_undegraded":"2024-09-10T23:20:41.134137+0000","last_fullsized":"2024-09-10T23:20:41.134137+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:12.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118292+0000","last_change":"2024-09-10T23:20:40.126347+0000","last_active":"2024-09-10T23:20:42.118292+0000","last_peered":"2024-09-10T23:20:42.118292+0000","last_clean":"2024-09-10T23:20:42.118292+0000","last_became_active":"2024-09-10T23:20:40.126068+0000","last_became_peered":"2024-09-10T23:20:40.126068+0000","last_unstale":"2024-09-10T23:20:42.118292+0000","last_undegraded":"2024-09-10T23:20:42.118292+0000","last_fullsized":"2024-09-10T23:20:42.118292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:41.654200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112309+0000","last_change":"2024-09-10T23:20:40.112309+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112309+0000","last_undegraded":"2024-09-10T23:20:40.112309+0000","last_fullsized":"2024-09-10T23:20:40.112309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132729+0000","last_change":"2024-09-10T23:20:40.129652+0000","last_active":"2024-09-10T23:20:40.132729+0000","last_peered":"2024-09-10T23:20:40.132729+0000","last_clean":"2024-09-10T23:20:40.132729+0000","last_became_active":"2024-09-10T23:20:40.129397+0000","last_became_peered":"2024-09-10T23:20:40.129397+0000","last_unstale":"2024-09-10T23:20:40.132729+0000","last_undegraded":"2024-09-10T23:20:40.132729+0000","last_fullsized":"2024-09-10T23:20:40.132729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:09.803453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.123453+0000","last_change":"2024-09-10T23:20:41.117473+0000","last_active":"2024-09-10T23:20:41.123453+0000","last_peered":"2024-09-10T23:20:41.123453+0000","last_clean":"2024-09-10T23:20:41.123453+0000","last_became_active":"2024-09-10T23:20:41.117123+0000","last_became_peered":"2024-09-10T23:20:41.117123+0000","last_unstale":"2024-09-10T23:20:41.123453+0000","last_undegraded":"2024-09-10T23:20:41.123453+0000","last_fullsized":"2024-09-10T23:20:41.123453+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:13.927428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132116+0000","last_change":"2024-09-10T23:20:40.131528+0000","last_active":"2024-09-10T23:20:40.132116+0000","last_peered":"2024-09-10T23:20:40.132116+0000","last_clean":"2024-09-10T23:20:40.132116+0000","last_became_active":"2024-09-10T23:20:40.131200+0000","last_became_peered":"2024-09-10T23:20:40.131200+0000","last_unstale":"2024-09-10T23:20:40.132116+0000","last_undegraded":"2024-09-10T23:20:40.132116+0000","last_fullsized":"2024-09-10T23:20:40.132116+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:28.731640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113783+0000","last_change":"2024-09-10T23:20:40.113783+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113783+0000","last_undegraded":"2024-09-10T23:20:40.113783+0000","last_fullsized":"2024-09-10T23:20:40.113783+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130368+0000","last_change":"2024-09-10T23:20:40.128507+0000","last_active":"2024-09-10T23:20:40.130368+0000","last_peered":"2024-09-10T23:20:40.130368+0000","last_clean":"2024-09-10T23:20:40.130368+0000","last_became_active":"2024-09-10T23:20:40.128235+0000","last_became_peered":"2024-09-10T23:20:40.128235+0000","last_unstale":"2024-09-10T23:20:40.130368+0000","last_undegraded":"2024-09-10T23:20:40.130368+0000","last_fullsized":"2024-09-10T23:20:40.130368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:50.349385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107985+0000","last_change":"2024-09-10T23:20:40.107985+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107985+0000","last_undegraded":"2024-09-10T23:20:40.107985+0000","last_fullsized":"2024-09-10T23:20:40.107985+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.133105+0000","last_change":"2024-09-10T23:20:40.132298+0000","last_active":"2024-09-10T23:20:40.133105+0000","last_peered":"2024-09-10T23:20:40.133105+0000","last_clean":"2024-09-10T23:20:40.133105+0000","last_became_active":"2024-09-10T23:20:40.132054+0000","last_became_peered":"2024-09-10T23:20:40.132054+0000","last_unstale":"2024-09-10T23:20:40.133105+0000","last_undegraded":"2024-09-10T23:20:40.133105+0000","last_fullsized":"2024-09-10T23:20:40.133105+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:10.871552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.133553+0000","last_change":"2024-09-10T23:20:41.128546+0000","last_active":"2024-09-10T23:20:41.133553+0000","last_peered":"2024-09-10T23:20:41.133553+0000","last_clean":"2024-09-10T23:20:41.133553+0000","last_became_active":"2024-09-10T23:20:41.126264+0000","last_became_peered":"2024-09-10T23:20:41.126264+0000","last_unstale":"2024-09-10T23:20:41.133553+0000","last_undegraded":"2024-09-10T23:20:41.133553+0000","last_fullsized":"2024-09-10T23:20:41.133553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:02:58.511740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.111179+0000","last_change":"2024-09-10T23:20:40.124599+0000","last_active":"2024-09-10T23:20:41.111179+0000","last_peered":"2024-09-10T23:20:41.111179+0000","last_clean":"2024-09-10T23:20:41.111179+0000","last_became_active":"2024-09-10T23:20:40.124357+0000","last_became_peered":"2024-09-10T23:20:40.124357+0000","last_unstale":"2024-09-10T23:20:41.111179+0000","last_undegraded":"2024-09-10T23:20:41.111179+0000","last_fullsized":"2024-09-10T23:20:41.111179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:58.899986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.130583+0000","last_change":"2024-09-10T23:20:41.125253+0000","last_active":"2024-09-10T23:20:41.130583+0000","last_peered":"2024-09-10T23:20:41.130583+0000","last_clean":"2024-09-10T23:20:41.130583+0000","last_became_active":"2024-09-10T23:20:41.124980+0000","last_became_peered":"2024-09-10T23:20:41.124980+0000","last_unstale":"2024-09-10T23:20:41.130583+0000","last_undegraded":"2024-09-10T23:20:41.130583+0000","last_fullsized":"2024-09-10T23:20:41.130583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:56.756478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130350+0000","last_change":"2024-09-10T23:20:40.127513+0000","last_active":"2024-09-10T23:20:40.130350+0000","last_peered":"2024-09-10T23:20:40.130350+0000","last_clean":"2024-09-10T23:20:40.130350+0000","last_became_active":"2024-09-10T23:20:40.127217+0000","last_became_peered":"2024-09-10T23:20:40.127217+0000","last_unstale":"2024-09-10T23:20:40.130350+0000","last_undegraded":"2024-09-10T23:20:40.130350+0000","last_fullsized":"2024-09-10T23:20:40.130350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:14.164864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107507+0000","last_change":"2024-09-10T23:20:40.107507+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107507+0000","last_undegraded":"2024-09-10T23:20:40.107507+0000","last_fullsized":"2024-09-10T23:20:40.107507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.113311+0000","last_change":"2024-09-10T23:20:40.127031+0000","last_active":"2024-09-10T23:20:41.113311+0000","last_peered":"2024-09-10T23:20:41.113311+0000","last_clean":"2024-09-10T23:20:41.113311+0000","last_became_active":"2024-09-10T23:20:40.126712+0000","last_became_peered":"2024-09-10T23:20:40.126712+0000","last_unstale":"2024-09-10T23:20:41.113311+0000","last_undegraded":"2024-09-10T23:20:41.113311+0000","last_fullsized":"2024-09-10T23:20:41.113311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:21.158468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107502+0000","last_change":"2024-09-10T23:20:40.107502+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107502+0000","last_undegraded":"2024-09-10T23:20:40.107502+0000","last_fullsized":"2024-09-10T23:20:40.107502+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.126357+0000","last_change":"2024-09-10T23:20:40.120127+0000","last_active":"2024-09-10T23:20:40.126357+0000","last_peered":"2024-09-10T23:20:40.126357+0000","last_clean":"2024-09-10T23:20:40.126357+0000","last_became_active":"2024-09-10T23:20:40.117614+0000","last_became_peered":"2024-09-10T23:20:40.117614+0000","last_unstale":"2024-09-10T23:20:40.126357+0000","last_undegraded":"2024-09-10T23:20:40.126357+0000","last_fullsized":"2024-09-10T23:20:40.126357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:22.462867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116101+0000","last_change":"2024-09-10T23:20:40.116101+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116101+0000","last_undegraded":"2024-09-10T23:20:40.116101+0000","last_fullsized":"2024-09-10T23:20:40.116101+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118969+0000","last_change":"2024-09-10T23:20:40.118820+0000","last_active":"2024-09-10T23:20:42.118969+0000","last_peered":"2024-09-10T23:20:42.118969+0000","last_clean":"2024-09-10T23:20:42.118969+0000","last_became_active":"2024-09-10T23:20:40.118517+0000","last_became_peered":"2024-09-10T23:20:40.118517+0000","last_unstale":"2024-09-10T23:20:42.118969+0000","last_undegraded":"2024-09-10T23:20:42.118969+0000","last_fullsized":"2024-09-10T23:20:42.118969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:36.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":223,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.117765+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:20:40.117765+0000","last_peered":"2024-09-10T23:20:40.117765+0000","last_clean":"2024-09-10T23:20:40.117765+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:20:40.117765+0000","last_undegraded":"2024-09-10T23:20:40.117765+0000","last_fullsized":"2024-09-10T23:20:40.117765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476802,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50812,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321028,"statfs":{"total":96636764160,"available":96584732672,"internally_reserved":0,"allocated":1613824,"data_stored":1056318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509506,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46072,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325768,"statfs":{"total":96636764160,"available":96589586432,"internally_reserved":0,"allocated":1019904,"data_stored":465950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54988,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316852,"statfs":{"total":96636764160,"available":96580456448,"internally_reserved":0,"allocated":1626112,"data_stored":1062985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50272,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321568,"statfs":{"total":96636764160,"available":96585285632,"internally_reserved":0,"allocated":1060864,"data_stored":487058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:20:45.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:20:45.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 -- 172.21.15.17:0/3765308658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b015f350 msgr2=0x7f15b00b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 --2- 172.21.15.17:0/3765308658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b015f350 0x7f15b00b3130 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f15b0073990 tx=0x7f15a001c770 comp rx=0 tx=0).stop 2024-09-10T23:20:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 -- 172.21.15.17:0/3765308658 shutdown_connections 2024-09-10T23:20:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 --2- 172.21.15.17:0/3765308658 >> v2:172.21.15.77:3300/0 conn(0x7f15b00cee30 0x7f15b00b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 --2- 172.21.15.17:0/3765308658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b015f350 0x7f15b00b3130 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 -- 172.21.15.17:0/3765308658 >> 172.21.15.17:0/3765308658 conn(0x7f15b00d1d10 msgr2=0x7f15b00d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 -- 172.21.15.17:0/3765308658 shutdown_connections 2024-09-10T23:20:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 -- 172.21.15.17:0/3765308658 wait complete. 2024-09-10T23:20:45.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 Processor -- start 2024-09-10T23:20:45.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 -- start start 2024-09-10T23:20:45.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b00cee30 0x7f15b00b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.865+0000 7f15b5a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15b015f350 0x7f15b01f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15b5a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15b015f730 0x7f15b006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15b5a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f15b0168bd0 con 0x7f15b00cee30 2024-09-10T23:20:45.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15b5a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f15b00b2390 con 0x7f15b015f730 2024-09-10T23:20:45.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15b5a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f15b0168d50 con 0x7f15b015f350 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15aea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b00cee30 0x7f15b00b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15aea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b00cee30 0x7f15b00b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58370/0 (socket says 172.21.15.17:58370) 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15aea00640 1 -- 172.21.15.17:0/2963913202 learned_addr learned my addr 172.21.15.17:0/2963913202 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15a7e00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15b015f350 0x7f15b01f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15af400640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15b015f730 0x7f15b006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15aea00640 1 -- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15b015f350 msgr2=0x7f15b01f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15aea00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15b015f350 0x7f15b01f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15aea00640 1 -- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15b015f730 msgr2=0x7f15b006dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15aea00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15b015f730 0x7f15b006dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15aea00640 1 -- 172.21.15.17:0/2963913202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b00b4b40 con 0x7f15b00cee30 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15aea00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b00cee30 0x7f15b00b3ef0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f15a0000c10 tx=0x7f15a00a65f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15a6a00640 1 -- 172.21.15.17:0/2963913202 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0004030 con 0x7f15b00cee30 2024-09-10T23:20:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15a6a00640 1 -- 172.21.15.17:0/2963913202 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15a00041d0 con 0x7f15b00cee30 2024-09-10T23:20:45.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15a6a00640 1 -- 172.21.15.17:0/2963913202 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0005070 con 0x7f15b00cee30 2024-09-10T23:20:45.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b01f7e10 con 0x7f15b00cee30 2024-09-10T23:20:45.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b01f83d0 con 0x7f15b00cee30 2024-09-10T23:20:45.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b00b1430 con 0x7f15b00cee30 2024-09-10T23:20:45.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.869+0000 7f15a6a00640 1 -- 172.21.15.17:0/2963913202 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f15a0005210 con 0x7f15b00cee30 2024-09-10T23:20:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.873+0000 7f15a6a00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f158c0725e0 0x7f158c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.873+0000 7f15a6a00640 1 -- 172.21.15.17:0/2963913202 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f15a012d130 con 0x7f15b00cee30 2024-09-10T23:20:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.873+0000 7f15a7e00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f158c0725e0 0x7f158c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:45.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.873+0000 7f15a7e00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f158c0725e0 0x7f158c074aa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15b00c54b0 tx=0x7f1598009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:45.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:45.877+0000 7f15a6a00640 1 -- 172.21.15.17:0/2963913202 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f15a00bf070 con 0x7f15b00cee30 2024-09-10T23:20:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.049+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15b01547d0 con 0x7f158c0725e0 2024-09-10T23:20:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.053+0000 7f15a6a00640 1 -- 172.21.15.17:0/2963913202 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248038 (secure 0 0 0) 0x7f15b01547d0 con 0x7f158c0725e0 2024-09-10T23:20:46.061 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f158c0725e0 msgr2=0x7f158c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f158c0725e0 0x7f158c074aa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15b00c54b0 tx=0x7f1598009040 comp rx=0 tx=0).stop 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b00cee30 msgr2=0x7f15b00b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b00cee30 0x7f15b00b3ef0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f15a0000c10 tx=0x7f15a00a65f0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 shutdown_connections 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f158c0725e0 0x7f158c074aa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15b015f730 0x7f15b006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15b015f350 0x7f15b01f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 --2- 172.21.15.17:0/2963913202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15b00cee30 0x7f15b00b3ef0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 >> 172.21.15.17:0/2963913202 conn(0x7f15b00d1d10 msgr2=0x7f15b00cc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 shutdown_connections 2024-09-10T23:20:46.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.057+0000 7f15b5a00640 1 -- 172.21.15.17:0/2963913202 wait complete. 2024-09-10T23:20:46.081 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-09-10T23:20:44.366868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":111,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":351736,"kb_used_data":9228,"kb_used_omap":12,"kb_used_meta":342323,"kb_avail":754622984,"statfs":{"total":773094113280,"available":772733935616,"internally_reserved":0,"allocated":9449472,"data_stored":4962779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":350539313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.270624"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.115761+0000","last_change":"2024-09-10T23:20:40.115761+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.115761+0000","last_undegraded":"2024-09-10T23:20:40.115761+0000","last_fullsized":"2024-09-10T23:20:40.115761+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114463+0000","last_change":"2024-09-10T23:20:40.114463+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114463+0000","last_undegraded":"2024-09-10T23:20:40.114463+0000","last_fullsized":"2024-09-10T23:20:40.114463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109112+0000","last_change":"2024-09-10T23:20:40.109112+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109112+0000","last_undegraded":"2024-09-10T23:20:40.109112+0000","last_fullsized":"2024-09-10T23:20:40.109112+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.120488+0000","last_change":"2024-09-10T23:20:40.120488+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.120488+0000","last_undegraded":"2024-09-10T23:20:40.120488+0000","last_fullsized":"2024-09-10T23:20:40.120488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.117421+0000","last_change":"2024-09-10T23:20:40.117421+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.117421+0000","last_undegraded":"2024-09-10T23:20:40.117421+0000","last_fullsized":"2024-09-10T23:20:40.117421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118568+0000","last_change":"2024-09-10T23:20:41.127078+0000","last_active":"2024-09-10T23:20:42.118568+0000","last_peered":"2024-09-10T23:20:42.118568+0000","last_clean":"2024-09-10T23:20:42.118568+0000","last_became_active":"2024-09-10T23:20:41.126523+0000","last_became_peered":"2024-09-10T23:20:41.126523+0000","last_unstale":"2024-09-10T23:20:42.118568+0000","last_undegraded":"2024-09-10T23:20:42.118568+0000","last_fullsized":"2024-09-10T23:20:42.118568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:13.361890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134703+0000","last_change":"2024-09-10T23:20:41.131788+0000","last_active":"2024-09-10T23:20:41.134703+0000","last_peered":"2024-09-10T23:20:41.134703+0000","last_clean":"2024-09-10T23:20:41.134703+0000","last_became_active":"2024-09-10T23:20:41.131510+0000","last_became_peered":"2024-09-10T23:20:41.131510+0000","last_unstale":"2024-09-10T23:20:41.134703+0000","last_undegraded":"2024-09-10T23:20:41.134703+0000","last_fullsized":"2024-09-10T23:20:41.134703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:29.649638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112450+0000","last_change":"2024-09-10T23:20:40.112450+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112450+0000","last_undegraded":"2024-09-10T23:20:40.112450+0000","last_fullsized":"2024-09-10T23:20:40.112450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113588+0000","last_change":"2024-09-10T23:20:40.113588+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113588+0000","last_undegraded":"2024-09-10T23:20:40.113588+0000","last_fullsized":"2024-09-10T23:20:40.113588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.122203+0000","last_change":"2024-09-10T23:20:40.122203+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.122203+0000","last_undegraded":"2024-09-10T23:20:40.122203+0000","last_fullsized":"2024-09-10T23:20:40.122203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114478+0000","last_change":"2024-09-10T23:20:40.114478+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114478+0000","last_undegraded":"2024-09-10T23:20:40.114478+0000","last_fullsized":"2024-09-10T23:20:40.114478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.120047+0000","last_change":"2024-09-10T23:20:40.120047+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.120047+0000","last_undegraded":"2024-09-10T23:20:40.120047+0000","last_fullsized":"2024-09-10T23:20:40.120047+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112063+0000","last_change":"2024-09-10T23:20:40.112063+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112063+0000","last_undegraded":"2024-09-10T23:20:40.112063+0000","last_fullsized":"2024-09-10T23:20:40.112063+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118828+0000","last_change":"2024-09-10T23:20:41.127354+0000","last_active":"2024-09-10T23:20:42.118828+0000","last_peered":"2024-09-10T23:20:42.118828+0000","last_clean":"2024-09-10T23:20:42.118828+0000","last_became_active":"2024-09-10T23:20:41.126817+0000","last_became_peered":"2024-09-10T23:20:41.126817+0000","last_unstale":"2024-09-10T23:20:42.118828+0000","last_undegraded":"2024-09-10T23:20:42.118828+0000","last_fullsized":"2024-09-10T23:20:42.118828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:29.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.115788+0000","last_change":"2024-09-10T23:20:40.115788+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.115788+0000","last_undegraded":"2024-09-10T23:20:40.115788+0000","last_fullsized":"2024-09-10T23:20:40.115788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114922+0000","last_change":"2024-09-10T23:20:40.114922+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114922+0000","last_undegraded":"2024-09-10T23:20:40.114922+0000","last_fullsized":"2024-09-10T23:20:40.114922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112627+0000","last_change":"2024-09-10T23:20:40.112627+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112627+0000","last_undegraded":"2024-09-10T23:20:40.112627+0000","last_fullsized":"2024-09-10T23:20:40.112627+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.108314+0000","last_change":"2024-09-10T23:20:40.108314+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.108314+0000","last_undegraded":"2024-09-10T23:20:40.108314+0000","last_fullsized":"2024-09-10T23:20:40.108314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118830+0000","last_change":"2024-09-10T23:20:41.124255+0000","last_active":"2024-09-10T23:20:42.118830+0000","last_peered":"2024-09-10T23:20:42.118830+0000","last_clean":"2024-09-10T23:20:42.118830+0000","last_became_active":"2024-09-10T23:20:41.123986+0000","last_became_peered":"2024-09-10T23:20:41.123986+0000","last_unstale":"2024-09-10T23:20:42.118830+0000","last_undegraded":"2024-09-10T23:20:42.118830+0000","last_fullsized":"2024-09-10T23:20:42.118830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:28.015170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.117132+0000","last_change":"2024-09-10T23:20:40.117132+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.117132+0000","last_undegraded":"2024-09-10T23:20:40.117132+0000","last_fullsized":"2024-09-10T23:20:40.117132+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113117+0000","last_change":"2024-09-10T23:20:40.113117+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113117+0000","last_undegraded":"2024-09-10T23:20:40.113117+0000","last_fullsized":"2024-09-10T23:20:40.113117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112405+0000","last_change":"2024-09-10T23:20:40.112405+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112405+0000","last_undegraded":"2024-09-10T23:20:40.112405+0000","last_fullsized":"2024-09-10T23:20:40.112405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112344+0000","last_change":"2024-09-10T23:20:40.112344+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112344+0000","last_undegraded":"2024-09-10T23:20:40.112344+0000","last_fullsized":"2024-09-10T23:20:40.112344+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114450+0000","last_change":"2024-09-10T23:20:40.114450+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114450+0000","last_undegraded":"2024-09-10T23:20:40.114450+0000","last_fullsized":"2024-09-10T23:20:40.114450+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111727+0000","last_change":"2024-09-10T23:20:40.111727+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111727+0000","last_undegraded":"2024-09-10T23:20:40.111727+0000","last_fullsized":"2024-09-10T23:20:40.111727+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.119651+0000","last_change":"2024-09-10T23:20:40.119651+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.119651+0000","last_undegraded":"2024-09-10T23:20:40.119651+0000","last_fullsized":"2024-09-10T23:20:40.119651+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.117313+0000","last_change":"2024-09-10T23:20:40.117313+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.117313+0000","last_undegraded":"2024-09-10T23:20:40.117313+0000","last_fullsized":"2024-09-10T23:20:40.117313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116481+0000","last_change":"2024-09-10T23:20:40.116481+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116481+0000","last_undegraded":"2024-09-10T23:20:40.116481+0000","last_fullsized":"2024-09-10T23:20:40.116481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111740+0000","last_change":"2024-09-10T23:20:40.111740+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111740+0000","last_undegraded":"2024-09-10T23:20:40.111740+0000","last_fullsized":"2024-09-10T23:20:40.111740+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116288+0000","last_change":"2024-09-10T23:20:40.116288+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116288+0000","last_undegraded":"2024-09-10T23:20:40.116288+0000","last_fullsized":"2024-09-10T23:20:40.116288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.108231+0000","last_change":"2024-09-10T23:20:40.108231+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.108231+0000","last_undegraded":"2024-09-10T23:20:40.108231+0000","last_fullsized":"2024-09-10T23:20:40.108231+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114407+0000","last_change":"2024-09-10T23:20:40.114407+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114407+0000","last_undegraded":"2024-09-10T23:20:40.114407+0000","last_fullsized":"2024-09-10T23:20:40.114407+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109454+0000","last_change":"2024-09-10T23:20:40.109454+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109454+0000","last_undegraded":"2024-09-10T23:20:40.109454+0000","last_fullsized":"2024-09-10T23:20:40.109454+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130690+0000","last_change":"2024-09-10T23:20:40.128521+0000","last_active":"2024-09-10T23:20:40.130690+0000","last_peered":"2024-09-10T23:20:40.130690+0000","last_clean":"2024-09-10T23:20:40.130690+0000","last_became_active":"2024-09-10T23:20:40.128196+0000","last_became_peered":"2024-09-10T23:20:40.128196+0000","last_unstale":"2024-09-10T23:20:40.130690+0000","last_undegraded":"2024-09-10T23:20:40.130690+0000","last_fullsized":"2024-09-10T23:20:40.130690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:23.910404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111190+0000","last_change":"2024-09-10T23:20:40.111190+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111190+0000","last_undegraded":"2024-09-10T23:20:40.111190+0000","last_fullsized":"2024-09-10T23:20:40.111190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130785+0000","last_change":"2024-09-10T23:20:40.129893+0000","last_active":"2024-09-10T23:20:40.130785+0000","last_peered":"2024-09-10T23:20:40.130785+0000","last_clean":"2024-09-10T23:20:40.130785+0000","last_became_active":"2024-09-10T23:20:40.129646+0000","last_became_peered":"2024-09-10T23:20:40.129646+0000","last_unstale":"2024-09-10T23:20:40.130785+0000","last_undegraded":"2024-09-10T23:20:40.130785+0000","last_fullsized":"2024-09-10T23:20:40.130785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:39.499737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.114180+0000","last_change":"2024-09-10T23:20:40.114180+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.114180+0000","last_undegraded":"2024-09-10T23:20:40.114180+0000","last_fullsized":"2024-09-10T23:20:40.114180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.135854+0000","last_change":"2024-09-10T23:20:40.135323+0000","last_active":"2024-09-10T23:20:40.135854+0000","last_peered":"2024-09-10T23:20:40.135854+0000","last_clean":"2024-09-10T23:20:40.135854+0000","last_became_active":"2024-09-10T23:20:40.135063+0000","last_became_peered":"2024-09-10T23:20:40.135063+0000","last_unstale":"2024-09-10T23:20:40.135854+0000","last_undegraded":"2024-09-10T23:20:40.135854+0000","last_fullsized":"2024-09-10T23:20:40.135854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:12.468324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112662+0000","last_change":"2024-09-10T23:20:40.112662+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112662+0000","last_undegraded":"2024-09-10T23:20:40.112662+0000","last_fullsized":"2024-09-10T23:20:40.112662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.141611+0000","last_change":"2024-09-10T23:20:40.123991+0000","last_active":"2024-09-10T23:20:41.141611+0000","last_peered":"2024-09-10T23:20:41.141611+0000","last_clean":"2024-09-10T23:20:41.141611+0000","last_became_active":"2024-09-10T23:20:40.123692+0000","last_became_peered":"2024-09-10T23:20:40.123692+0000","last_unstale":"2024-09-10T23:20:41.141611+0000","last_undegraded":"2024-09-10T23:20:41.141611+0000","last_fullsized":"2024-09-10T23:20:41.141611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:11.568207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111753+0000","last_change":"2024-09-10T23:20:40.111753+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111753+0000","last_undegraded":"2024-09-10T23:20:40.111753+0000","last_fullsized":"2024-09-10T23:20:40.111753+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.126864+0000","last_change":"2024-09-10T23:20:40.123371+0000","last_active":"2024-09-10T23:20:40.126864+0000","last_peered":"2024-09-10T23:20:40.126864+0000","last_clean":"2024-09-10T23:20:40.126864+0000","last_became_active":"2024-09-10T23:20:40.123098+0000","last_became_peered":"2024-09-10T23:20:40.123098+0000","last_unstale":"2024-09-10T23:20:40.126864+0000","last_undegraded":"2024-09-10T23:20:40.126864+0000","last_fullsized":"2024-09-10T23:20:40.126864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:07.258323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.111262+0000","last_change":"2024-09-10T23:20:40.111262+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.111262+0000","last_undegraded":"2024-09-10T23:20:40.111262+0000","last_fullsized":"2024-09-10T23:20:40.111262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.131874+0000","last_change":"2024-09-10T23:20:40.127892+0000","last_active":"2024-09-10T23:20:40.131874+0000","last_peered":"2024-09-10T23:20:40.131874+0000","last_clean":"2024-09-10T23:20:40.131874+0000","last_became_active":"2024-09-10T23:20:40.127610+0000","last_became_peered":"2024-09-10T23:20:40.127610+0000","last_unstale":"2024-09-10T23:20:40.131874+0000","last_undegraded":"2024-09-10T23:20:40.131874+0000","last_fullsized":"2024-09-10T23:20:40.131874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:50.349385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113501+0000","last_change":"2024-09-10T23:20:40.113501+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113501+0000","last_undegraded":"2024-09-10T23:20:40.113501+0000","last_fullsized":"2024-09-10T23:20:40.113501+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.127249+0000","last_change":"2024-09-10T23:20:40.119841+0000","last_active":"2024-09-10T23:20:40.127249+0000","last_peered":"2024-09-10T23:20:40.127249+0000","last_clean":"2024-09-10T23:20:40.127249+0000","last_became_active":"2024-09-10T23:20:40.119554+0000","last_became_peered":"2024-09-10T23:20:40.119554+0000","last_unstale":"2024-09-10T23:20:40.127249+0000","last_undegraded":"2024-09-10T23:20:40.127249+0000","last_fullsized":"2024-09-10T23:20:40.127249+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:36.218067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134568+0000","last_change":"2024-09-10T23:20:41.131356+0000","last_active":"2024-09-10T23:20:41.134568+0000","last_peered":"2024-09-10T23:20:41.134568+0000","last_clean":"2024-09-10T23:20:41.134568+0000","last_became_active":"2024-09-10T23:20:41.131112+0000","last_became_peered":"2024-09-10T23:20:41.131112+0000","last_unstale":"2024-09-10T23:20:41.134568+0000","last_undegraded":"2024-09-10T23:20:41.134568+0000","last_fullsized":"2024-09-10T23:20:41.134568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130320+0000","last_change":"2024-09-10T23:20:40.124214+0000","last_active":"2024-09-10T23:20:40.130320+0000","last_peered":"2024-09-10T23:20:40.130320+0000","last_clean":"2024-09-10T23:20:40.130320+0000","last_became_active":"2024-09-10T23:20:40.120446+0000","last_became_peered":"2024-09-10T23:20:40.120446+0000","last_unstale":"2024-09-10T23:20:40.130320+0000","last_undegraded":"2024-09-10T23:20:40.130320+0000","last_fullsized":"2024-09-10T23:20:40.130320+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:24.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109294+0000","last_change":"2024-09-10T23:20:40.109294+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109294+0000","last_undegraded":"2024-09-10T23:20:40.109294+0000","last_fullsized":"2024-09-10T23:20:40.109294+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132935+0000","last_change":"2024-09-10T23:20:40.131592+0000","last_active":"2024-09-10T23:20:40.132935+0000","last_peered":"2024-09-10T23:20:40.132935+0000","last_clean":"2024-09-10T23:20:40.132935+0000","last_became_active":"2024-09-10T23:20:40.131327+0000","last_became_peered":"2024-09-10T23:20:40.131327+0000","last_unstale":"2024-09-10T23:20:40.132935+0000","last_undegraded":"2024-09-10T23:20:40.132935+0000","last_fullsized":"2024-09-10T23:20:40.132935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:49.618430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.119113+0000","last_change":"2024-09-10T23:20:40.119113+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.119113+0000","last_undegraded":"2024-09-10T23:20:40.119113+0000","last_fullsized":"2024-09-10T23:20:40.119113+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.131779+0000","last_change":"2024-09-10T23:20:40.128083+0000","last_active":"2024-09-10T23:20:40.131779+0000","last_peered":"2024-09-10T23:20:40.131779+0000","last_clean":"2024-09-10T23:20:40.131779+0000","last_became_active":"2024-09-10T23:20:40.127555+0000","last_became_peered":"2024-09-10T23:20:40.127555+0000","last_unstale":"2024-09-10T23:20:40.131779+0000","last_undegraded":"2024-09-10T23:20:40.131779+0000","last_fullsized":"2024-09-10T23:20:40.131779+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:39.499737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118875+0000","last_change":"2024-09-10T23:20:41.122664+0000","last_active":"2024-09-10T23:20:42.118875+0000","last_peered":"2024-09-10T23:20:42.118875+0000","last_clean":"2024-09-10T23:20:42.118875+0000","last_became_active":"2024-09-10T23:20:41.122359+0000","last_became_peered":"2024-09-10T23:20:41.122359+0000","last_unstale":"2024-09-10T23:20:42.118875+0000","last_undegraded":"2024-09-10T23:20:42.118875+0000","last_fullsized":"2024-09-10T23:20:42.118875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:04.020060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130936+0000","last_change":"2024-09-10T23:20:40.129170+0000","last_active":"2024-09-10T23:20:40.130936+0000","last_peered":"2024-09-10T23:20:40.130936+0000","last_clean":"2024-09-10T23:20:40.130936+0000","last_became_active":"2024-09-10T23:20:40.128901+0000","last_became_peered":"2024-09-10T23:20:40.128901+0000","last_unstale":"2024-09-10T23:20:40.130936+0000","last_undegraded":"2024-09-10T23:20:40.130936+0000","last_fullsized":"2024-09-10T23:20:40.130936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:09.334489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107684+0000","last_change":"2024-09-10T23:20:40.107684+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107684+0000","last_undegraded":"2024-09-10T23:20:40.107684+0000","last_fullsized":"2024-09-10T23:20:40.107684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.148019+0000","last_change":"2024-09-10T23:20:40.129709+0000","last_active":"2024-09-10T23:20:41.148019+0000","last_peered":"2024-09-10T23:20:41.148019+0000","last_clean":"2024-09-10T23:20:41.148019+0000","last_became_active":"2024-09-10T23:20:40.128128+0000","last_became_peered":"2024-09-10T23:20:40.128128+0000","last_unstale":"2024-09-10T23:20:41.148019+0000","last_undegraded":"2024-09-10T23:20:41.148019+0000","last_fullsized":"2024-09-10T23:20:41.148019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:31.178729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.119572+0000","last_change":"2024-09-10T23:20:40.119572+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.119572+0000","last_undegraded":"2024-09-10T23:20:40.119572+0000","last_fullsized":"2024-09-10T23:20:40.119572+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.131898+0000","last_change":"2024-09-10T23:20:40.128787+0000","last_active":"2024-09-10T23:20:40.131898+0000","last_peered":"2024-09-10T23:20:40.131898+0000","last_clean":"2024-09-10T23:20:40.131898+0000","last_became_active":"2024-09-10T23:20:40.128517+0000","last_became_peered":"2024-09-10T23:20:40.128517+0000","last_unstale":"2024-09-10T23:20:40.131898+0000","last_undegraded":"2024-09-10T23:20:40.131898+0000","last_fullsized":"2024-09-10T23:20:40.131898+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:26.322064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.130610+0000","last_change":"2024-09-10T23:20:41.125926+0000","last_active":"2024-09-10T23:20:41.130610+0000","last_peered":"2024-09-10T23:20:41.130610+0000","last_clean":"2024-09-10T23:20:41.130610+0000","last_became_active":"2024-09-10T23:20:41.125634+0000","last_became_peered":"2024-09-10T23:20:41.125634+0000","last_unstale":"2024-09-10T23:20:41.130610+0000","last_undegraded":"2024-09-10T23:20:41.130610+0000","last_fullsized":"2024-09-10T23:20:41.130610+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:06.508857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132811+0000","last_change":"2024-09-10T23:20:40.131376+0000","last_active":"2024-09-10T23:20:40.132811+0000","last_peered":"2024-09-10T23:20:40.132811+0000","last_clean":"2024-09-10T23:20:40.132811+0000","last_became_active":"2024-09-10T23:20:40.131048+0000","last_became_peered":"2024-09-10T23:20:40.131048+0000","last_unstale":"2024-09-10T23:20:40.132811+0000","last_undegraded":"2024-09-10T23:20:40.132811+0000","last_fullsized":"2024-09-10T23:20:40.132811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:38:26.322064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.124528+0000","last_change":"2024-09-10T23:20:41.120364+0000","last_active":"2024-09-10T23:20:41.124528+0000","last_peered":"2024-09-10T23:20:41.124528+0000","last_clean":"2024-09-10T23:20:41.124528+0000","last_became_active":"2024-09-10T23:20:41.120112+0000","last_became_peered":"2024-09-10T23:20:41.120112+0000","last_unstale":"2024-09-10T23:20:41.124528+0000","last_undegraded":"2024-09-10T23:20:41.124528+0000","last_fullsized":"2024-09-10T23:20:41.124528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:59.966232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132045+0000","last_change":"2024-09-10T23:20:40.130101+0000","last_active":"2024-09-10T23:20:40.132045+0000","last_peered":"2024-09-10T23:20:40.132045+0000","last_clean":"2024-09-10T23:20:40.132045+0000","last_became_active":"2024-09-10T23:20:40.129612+0000","last_became_peered":"2024-09-10T23:20:40.129612+0000","last_unstale":"2024-09-10T23:20:40.132045+0000","last_undegraded":"2024-09-10T23:20:40.132045+0000","last_fullsized":"2024-09-10T23:20:40.132045+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:21.235225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134109+0000","last_change":"2024-09-10T23:20:41.128895+0000","last_active":"2024-09-10T23:20:41.134109+0000","last_peered":"2024-09-10T23:20:41.134109+0000","last_clean":"2024-09-10T23:20:41.134109+0000","last_became_active":"2024-09-10T23:20:41.126170+0000","last_became_peered":"2024-09-10T23:20:41.126170+0000","last_unstale":"2024-09-10T23:20:41.134109+0000","last_undegraded":"2024-09-10T23:20:41.134109+0000","last_fullsized":"2024-09-10T23:20:41.134109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:57.954331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132432+0000","last_change":"2024-09-10T23:20:40.124184+0000","last_active":"2024-09-10T23:20:40.132432+0000","last_peered":"2024-09-10T23:20:40.132432+0000","last_clean":"2024-09-10T23:20:40.132432+0000","last_became_active":"2024-09-10T23:20:40.123915+0000","last_became_peered":"2024-09-10T23:20:40.123915+0000","last_unstale":"2024-09-10T23:20:40.132432+0000","last_undegraded":"2024-09-10T23:20:40.132432+0000","last_fullsized":"2024-09-10T23:20:40.132432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:08.035908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118297+0000","last_change":"2024-09-10T23:20:41.115069+0000","last_active":"2024-09-10T23:20:42.118297+0000","last_peered":"2024-09-10T23:20:42.118297+0000","last_clean":"2024-09-10T23:20:42.118297+0000","last_became_active":"2024-09-10T23:20:41.114657+0000","last_became_peered":"2024-09-10T23:20:41.114657+0000","last_unstale":"2024-09-10T23:20:42.118297+0000","last_undegraded":"2024-09-10T23:20:42.118297+0000","last_fullsized":"2024-09-10T23:20:42.118297+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:21.933582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132999+0000","last_change":"2024-09-10T23:20:40.131437+0000","last_active":"2024-09-10T23:20:40.132999+0000","last_peered":"2024-09-10T23:20:40.132999+0000","last_clean":"2024-09-10T23:20:40.132999+0000","last_became_active":"2024-09-10T23:20:40.131158+0000","last_became_peered":"2024-09-10T23:20:40.131158+0000","last_unstale":"2024-09-10T23:20:40.132999+0000","last_undegraded":"2024-09-10T23:20:40.132999+0000","last_fullsized":"2024-09-10T23:20:40.132999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:09.803453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116080+0000","last_change":"2024-09-10T23:20:40.116080+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116080+0000","last_undegraded":"2024-09-10T23:20:40.116080+0000","last_fullsized":"2024-09-10T23:20:40.116080+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.126787+0000","last_change":"2024-09-10T23:20:40.124220+0000","last_active":"2024-09-10T23:20:40.126787+0000","last_peered":"2024-09-10T23:20:40.126787+0000","last_clean":"2024-09-10T23:20:40.126787+0000","last_became_active":"2024-09-10T23:20:40.123970+0000","last_became_peered":"2024-09-10T23:20:40.123970+0000","last_unstale":"2024-09-10T23:20:40.126787+0000","last_undegraded":"2024-09-10T23:20:40.126787+0000","last_fullsized":"2024-09-10T23:20:40.126787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:29.060387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116528+0000","last_change":"2024-09-10T23:20:40.116528+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116528+0000","last_undegraded":"2024-09-10T23:20:40.116528+0000","last_fullsized":"2024-09-10T23:20:40.116528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130911+0000","last_change":"2024-09-10T23:20:40.125679+0000","last_active":"2024-09-10T23:20:40.130911+0000","last_peered":"2024-09-10T23:20:40.130911+0000","last_clean":"2024-09-10T23:20:40.130911+0000","last_became_active":"2024-09-10T23:20:40.125337+0000","last_became_peered":"2024-09-10T23:20:40.125337+0000","last_unstale":"2024-09-10T23:20:40.130911+0000","last_undegraded":"2024-09-10T23:20:40.130911+0000","last_fullsized":"2024-09-10T23:20:40.130911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:19.612517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118656+0000","last_change":"2024-09-10T23:20:41.123472+0000","last_active":"2024-09-10T23:20:42.118656+0000","last_peered":"2024-09-10T23:20:42.118656+0000","last_clean":"2024-09-10T23:20:42.118656+0000","last_became_active":"2024-09-10T23:20:41.123196+0000","last_became_peered":"2024-09-10T23:20:41.123196+0000","last_unstale":"2024-09-10T23:20:42.118656+0000","last_undegraded":"2024-09-10T23:20:42.118656+0000","last_fullsized":"2024-09-10T23:20:42.118656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:39.750457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130856+0000","last_change":"2024-09-10T23:20:40.128380+0000","last_active":"2024-09-10T23:20:40.130856+0000","last_peered":"2024-09-10T23:20:40.130856+0000","last_clean":"2024-09-10T23:20:40.130856+0000","last_became_active":"2024-09-10T23:20:40.128069+0000","last_became_peered":"2024-09-10T23:20:40.128069+0000","last_unstale":"2024-09-10T23:20:40.130856+0000","last_undegraded":"2024-09-10T23:20:40.130856+0000","last_fullsized":"2024-09-10T23:20:40.130856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:55.651424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.109972+0000","last_change":"2024-09-10T23:20:40.109972+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.109972+0000","last_undegraded":"2024-09-10T23:20:40.109972+0000","last_fullsized":"2024-09-10T23:20:40.109972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118643+0000","last_change":"2024-09-10T23:20:40.122770+0000","last_active":"2024-09-10T23:20:42.118643+0000","last_peered":"2024-09-10T23:20:42.118643+0000","last_clean":"2024-09-10T23:20:42.118643+0000","last_became_active":"2024-09-10T23:20:40.122501+0000","last_became_peered":"2024-09-10T23:20:40.122501+0000","last_unstale":"2024-09-10T23:20:42.118643+0000","last_undegraded":"2024-09-10T23:20:42.118643+0000","last_fullsized":"2024-09-10T23:20:42.118643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:01.567448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.110761+0000","last_change":"2024-09-10T23:20:40.110761+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.110761+0000","last_undegraded":"2024-09-10T23:20:40.110761+0000","last_fullsized":"2024-09-10T23:20:40.110761+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118288+0000","last_change":"2024-09-10T23:20:40.120678+0000","last_active":"2024-09-10T23:20:42.118288+0000","last_peered":"2024-09-10T23:20:42.118288+0000","last_clean":"2024-09-10T23:20:42.118288+0000","last_became_active":"2024-09-10T23:20:40.120368+0000","last_became_peered":"2024-09-10T23:20:40.120368+0000","last_unstale":"2024-09-10T23:20:42.118288+0000","last_undegraded":"2024-09-10T23:20:42.118288+0000","last_fullsized":"2024-09-10T23:20:42.118288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:15.092441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.134137+0000","last_change":"2024-09-10T23:20:41.129524+0000","last_active":"2024-09-10T23:20:41.134137+0000","last_peered":"2024-09-10T23:20:41.134137+0000","last_clean":"2024-09-10T23:20:41.134137+0000","last_became_active":"2024-09-10T23:20:41.126551+0000","last_became_peered":"2024-09-10T23:20:41.126551+0000","last_unstale":"2024-09-10T23:20:41.134137+0000","last_undegraded":"2024-09-10T23:20:41.134137+0000","last_fullsized":"2024-09-10T23:20:41.134137+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:12.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118292+0000","last_change":"2024-09-10T23:20:40.126347+0000","last_active":"2024-09-10T23:20:42.118292+0000","last_peered":"2024-09-10T23:20:42.118292+0000","last_clean":"2024-09-10T23:20:42.118292+0000","last_became_active":"2024-09-10T23:20:40.126068+0000","last_became_peered":"2024-09-10T23:20:40.126068+0000","last_unstale":"2024-09-10T23:20:42.118292+0000","last_undegraded":"2024-09-10T23:20:42.118292+0000","last_fullsized":"2024-09-10T23:20:42.118292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:41.654200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.112309+0000","last_change":"2024-09-10T23:20:40.112309+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.112309+0000","last_undegraded":"2024-09-10T23:20:40.112309+0000","last_fullsized":"2024-09-10T23:20:40.112309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132729+0000","last_change":"2024-09-10T23:20:40.129652+0000","last_active":"2024-09-10T23:20:40.132729+0000","last_peered":"2024-09-10T23:20:40.132729+0000","last_clean":"2024-09-10T23:20:40.132729+0000","last_became_active":"2024-09-10T23:20:40.129397+0000","last_became_peered":"2024-09-10T23:20:40.129397+0000","last_unstale":"2024-09-10T23:20:40.132729+0000","last_undegraded":"2024-09-10T23:20:40.132729+0000","last_fullsized":"2024-09-10T23:20:40.132729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:09.803453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.123453+0000","last_change":"2024-09-10T23:20:41.117473+0000","last_active":"2024-09-10T23:20:41.123453+0000","last_peered":"2024-09-10T23:20:41.123453+0000","last_clean":"2024-09-10T23:20:41.123453+0000","last_became_active":"2024-09-10T23:20:41.117123+0000","last_became_peered":"2024-09-10T23:20:41.117123+0000","last_unstale":"2024-09-10T23:20:41.123453+0000","last_undegraded":"2024-09-10T23:20:41.123453+0000","last_fullsized":"2024-09-10T23:20:41.123453+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:13.927428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.132116+0000","last_change":"2024-09-10T23:20:40.131528+0000","last_active":"2024-09-10T23:20:40.132116+0000","last_peered":"2024-09-10T23:20:40.132116+0000","last_clean":"2024-09-10T23:20:40.132116+0000","last_became_active":"2024-09-10T23:20:40.131200+0000","last_became_peered":"2024-09-10T23:20:40.131200+0000","last_unstale":"2024-09-10T23:20:40.132116+0000","last_undegraded":"2024-09-10T23:20:40.132116+0000","last_fullsized":"2024-09-10T23:20:40.132116+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:28.731640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.113783+0000","last_change":"2024-09-10T23:20:40.113783+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.113783+0000","last_undegraded":"2024-09-10T23:20:40.113783+0000","last_fullsized":"2024-09-10T23:20:40.113783+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130368+0000","last_change":"2024-09-10T23:20:40.128507+0000","last_active":"2024-09-10T23:20:40.130368+0000","last_peered":"2024-09-10T23:20:40.130368+0000","last_clean":"2024-09-10T23:20:40.130368+0000","last_became_active":"2024-09-10T23:20:40.128235+0000","last_became_peered":"2024-09-10T23:20:40.128235+0000","last_unstale":"2024-09-10T23:20:40.130368+0000","last_undegraded":"2024-09-10T23:20:40.130368+0000","last_fullsized":"2024-09-10T23:20:40.130368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:50.349385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107985+0000","last_change":"2024-09-10T23:20:40.107985+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107985+0000","last_undegraded":"2024-09-10T23:20:40.107985+0000","last_fullsized":"2024-09-10T23:20:40.107985+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.133105+0000","last_change":"2024-09-10T23:20:40.132298+0000","last_active":"2024-09-10T23:20:40.133105+0000","last_peered":"2024-09-10T23:20:40.133105+0000","last_clean":"2024-09-10T23:20:40.133105+0000","last_became_active":"2024-09-10T23:20:40.132054+0000","last_became_peered":"2024-09-10T23:20:40.132054+0000","last_unstale":"2024-09-10T23:20:40.133105+0000","last_undegraded":"2024-09-10T23:20:40.133105+0000","last_fullsized":"2024-09-10T23:20:40.133105+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:10.871552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.133553+0000","last_change":"2024-09-10T23:20:41.128546+0000","last_active":"2024-09-10T23:20:41.133553+0000","last_peered":"2024-09-10T23:20:41.133553+0000","last_clean":"2024-09-10T23:20:41.133553+0000","last_became_active":"2024-09-10T23:20:41.126264+0000","last_became_peered":"2024-09-10T23:20:41.126264+0000","last_unstale":"2024-09-10T23:20:41.133553+0000","last_undegraded":"2024-09-10T23:20:41.133553+0000","last_fullsized":"2024-09-10T23:20:41.133553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:02:58.511740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.111179+0000","last_change":"2024-09-10T23:20:40.124599+0000","last_active":"2024-09-10T23:20:41.111179+0000","last_peered":"2024-09-10T23:20:41.111179+0000","last_clean":"2024-09-10T23:20:41.111179+0000","last_became_active":"2024-09-10T23:20:40.124357+0000","last_became_peered":"2024-09-10T23:20:40.124357+0000","last_unstale":"2024-09-10T23:20:41.111179+0000","last_undegraded":"2024-09-10T23:20:41.111179+0000","last_fullsized":"2024-09-10T23:20:41.111179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:58.899986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.130583+0000","last_change":"2024-09-10T23:20:41.125253+0000","last_active":"2024-09-10T23:20:41.130583+0000","last_peered":"2024-09-10T23:20:41.130583+0000","last_clean":"2024-09-10T23:20:41.130583+0000","last_became_active":"2024-09-10T23:20:41.124980+0000","last_became_peered":"2024-09-10T23:20:41.124980+0000","last_unstale":"2024-09-10T23:20:41.130583+0000","last_undegraded":"2024-09-10T23:20:41.130583+0000","last_fullsized":"2024-09-10T23:20:41.130583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:56.756478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.130350+0000","last_change":"2024-09-10T23:20:40.127513+0000","last_active":"2024-09-10T23:20:40.130350+0000","last_peered":"2024-09-10T23:20:40.130350+0000","last_clean":"2024-09-10T23:20:40.130350+0000","last_became_active":"2024-09-10T23:20:40.127217+0000","last_became_peered":"2024-09-10T23:20:40.127217+0000","last_unstale":"2024-09-10T23:20:40.130350+0000","last_undegraded":"2024-09-10T23:20:40.130350+0000","last_fullsized":"2024-09-10T23:20:40.130350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:14.164864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107507+0000","last_change":"2024-09-10T23:20:40.107507+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107507+0000","last_undegraded":"2024-09-10T23:20:40.107507+0000","last_fullsized":"2024-09-10T23:20:40.107507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-10T23:20:41.113311+0000","last_change":"2024-09-10T23:20:40.127031+0000","last_active":"2024-09-10T23:20:41.113311+0000","last_peered":"2024-09-10T23:20:41.113311+0000","last_clean":"2024-09-10T23:20:41.113311+0000","last_became_active":"2024-09-10T23:20:40.126712+0000","last_became_peered":"2024-09-10T23:20:40.126712+0000","last_unstale":"2024-09-10T23:20:41.113311+0000","last_undegraded":"2024-09-10T23:20:41.113311+0000","last_fullsized":"2024-09-10T23:20:41.113311+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:21.158468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.107502+0000","last_change":"2024-09-10T23:20:40.107502+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.107502+0000","last_undegraded":"2024-09-10T23:20:40.107502+0000","last_fullsized":"2024-09-10T23:20:40.107502+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.126357+0000","last_change":"2024-09-10T23:20:40.120127+0000","last_active":"2024-09-10T23:20:40.126357+0000","last_peered":"2024-09-10T23:20:40.126357+0000","last_clean":"2024-09-10T23:20:40.126357+0000","last_became_active":"2024-09-10T23:20:40.117614+0000","last_became_peered":"2024-09-10T23:20:40.117614+0000","last_unstale":"2024-09-10T23:20:40.126357+0000","last_undegraded":"2024-09-10T23:20:40.126357+0000","last_fullsized":"2024-09-10T23:20:40.126357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:22.462867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-09-10T23:20:40.116101+0000","last_change":"2024-09-10T23:20:40.116101+0000","last_active":"2024-09-10T23:20:40.094243+0000","last_peered":"2024-09-10T23:20:40.094243+0000","last_clean":"2024-09-10T23:20:40.094243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:20:40.116101+0000","last_undegraded":"2024-09-10T23:20:40.116101+0000","last_fullsized":"2024-09-10T23:20:40.116101+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118969+0000","last_change":"2024-09-10T23:20:40.118820+0000","last_active":"2024-09-10T23:20:42.118969+0000","last_peered":"2024-09-10T23:20:42.118969+0000","last_clean":"2024-09-10T23:20:42.118969+0000","last_became_active":"2024-09-10T23:20:40.118517+0000","last_became_peered":"2024-09-10T23:20:40.118517+0000","last_unstale":"2024-09-10T23:20:42.118969+0000","last_undegraded":"2024-09-10T23:20:42.118969+0000","last_fullsized":"2024-09-10T23:20:42.118969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:36.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":223,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-10T23:20:40.117765+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:20:40.117765+0000","last_peered":"2024-09-10T23:20:40.117765+0000","last_clean":"2024-09-10T23:20:40.117765+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:20:40.117765+0000","last_undegraded":"2024-09-10T23:20:40.117765+0000","last_fullsized":"2024-09-10T23:20:40.117765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476802,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40520,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331320,"statfs":{"total":96636764160,"available":96595271680,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50812,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321028,"statfs":{"total":96636764160,"available":96584732672,"internally_reserved":0,"allocated":1613824,"data_stored":1056318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509506,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46072,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325768,"statfs":{"total":96636764160,"available":96589586432,"internally_reserved":0,"allocated":1019904,"data_stored":465950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1032192,"data_stored":472617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54988,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316852,"statfs":{"total":96636764160,"available":96580456448,"internally_reserved":0,"allocated":1626112,"data_stored":1062985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50272,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321568,"statfs":{"total":96636764160,"available":96585285632,"internally_reserved":0,"allocated":1060864,"data_stored":487058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:20:46.085 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3f is not active+clean 2024-09-10T23:20:46.085 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.115761+0000', 'last_change': '2024-09-10T23:20:40.115761+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.115761+0000', 'last_undegraded': '2024-09-10T23:20:40.115761+0000', 'last_fullsized': '2024-09-10T23:20:40.115761+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:20:46.085 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3e is not active+clean 2024-09-10T23:20:46.085 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.114463+0000', 'last_change': '2024-09-10T23:20:40.114463+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.114463+0000', 'last_undegraded': '2024-09-10T23:20:40.114463+0000', 'last_fullsized': '2024-09-10T23:20:40.114463+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.085 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3d is not active+clean 2024-09-10T23:20:46.085 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.109112+0000', 'last_change': '2024-09-10T23:20:40.109112+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.109112+0000', 'last_undegraded': '2024-09-10T23:20:40.109112+0000', 'last_fullsized': '2024-09-10T23:20:40.109112+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:20:46.085 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3c is not active+clean 2024-09-10T23:20:46.085 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.120488+0000', 'last_change': '2024-09-10T23:20:40.120488+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.120488+0000', 'last_undegraded': '2024-09-10T23:20:40.120488+0000', 'last_fullsized': '2024-09-10T23:20:40.120488+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3b is not active+clean 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.117421+0000', 'last_change': '2024-09-10T23:20:40.117421+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.117421+0000', 'last_undegraded': '2024-09-10T23:20:40.117421+0000', 'last_fullsized': '2024-09-10T23:20:40.117421+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:PG 12.38 is not active+clean 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.112450+0000', 'last_change': '2024-09-10T23:20:40.112450+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.112450+0000', 'last_undegraded': '2024-09-10T23:20:40.112450+0000', 'last_fullsized': '2024-09-10T23:20:40.112450+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:PG 12.37 is not active+clean 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.113588+0000', 'last_change': '2024-09-10T23:20:40.113588+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.113588+0000', 'last_undegraded': '2024-09-10T23:20:40.113588+0000', 'last_fullsized': '2024-09-10T23:20:40.113588+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:PG 12.36 is not active+clean 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.122203+0000', 'last_change': '2024-09-10T23:20:40.122203+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.122203+0000', 'last_undegraded': '2024-09-10T23:20:40.122203+0000', 'last_fullsized': '2024-09-10T23:20:40.122203+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:PG 12.35 is not active+clean 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.114478+0000', 'last_change': '2024-09-10T23:20:40.114478+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.114478+0000', 'last_undegraded': '2024-09-10T23:20:40.114478+0000', 'last_fullsized': '2024-09-10T23:20:40.114478+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.086 INFO:tasks.ceph.ceph_manager.ceph:PG 12.34 is not active+clean 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.120047+0000', 'last_change': '2024-09-10T23:20:40.120047+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.120047+0000', 'last_undegraded': '2024-09-10T23:20:40.120047+0000', 'last_fullsized': '2024-09-10T23:20:40.120047+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:PG 12.33 is not active+clean 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.112063+0000', 'last_change': '2024-09-10T23:20:40.112063+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.112063+0000', 'last_undegraded': '2024-09-10T23:20:40.112063+0000', 'last_fullsized': '2024-09-10T23:20:40.112063+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:PG 12.31 is not active+clean 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.115788+0000', 'last_change': '2024-09-10T23:20:40.115788+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.115788+0000', 'last_undegraded': '2024-09-10T23:20:40.115788+0000', 'last_fullsized': '2024-09-10T23:20:40.115788+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:PG 12.30 is not active+clean 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.114922+0000', 'last_change': '2024-09-10T23:20:40.114922+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.114922+0000', 'last_undegraded': '2024-09-10T23:20:40.114922+0000', 'last_fullsized': '2024-09-10T23:20:40.114922+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2f is not active+clean 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.112627+0000', 'last_change': '2024-09-10T23:20:40.112627+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.112627+0000', 'last_undegraded': '2024-09-10T23:20:40.112627+0000', 'last_fullsized': '2024-09-10T23:20:40.112627+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2e is not active+clean 2024-09-10T23:20:46.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.108314+0000', 'last_change': '2024-09-10T23:20:40.108314+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.108314+0000', 'last_undegraded': '2024-09-10T23:20:40.108314+0000', 'last_fullsized': '2024-09-10T23:20:40.108314+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2c is not active+clean 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.117132+0000', 'last_change': '2024-09-10T23:20:40.117132+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.117132+0000', 'last_undegraded': '2024-09-10T23:20:40.117132+0000', 'last_fullsized': '2024-09-10T23:20:40.117132+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2b is not active+clean 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.113117+0000', 'last_change': '2024-09-10T23:20:40.113117+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.113117+0000', 'last_undegraded': '2024-09-10T23:20:40.113117+0000', 'last_fullsized': '2024-09-10T23:20:40.113117+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2a is not active+clean 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.112405+0000', 'last_change': '2024-09-10T23:20:40.112405+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.112405+0000', 'last_undegraded': '2024-09-10T23:20:40.112405+0000', 'last_fullsized': '2024-09-10T23:20:40.112405+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:PG 12.29 is not active+clean 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.112344+0000', 'last_change': '2024-09-10T23:20:40.112344+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.112344+0000', 'last_undegraded': '2024-09-10T23:20:40.112344+0000', 'last_fullsized': '2024-09-10T23:20:40.112344+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:PG 12.28 is not active+clean 2024-09-10T23:20:46.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.114450+0000', 'last_change': '2024-09-10T23:20:40.114450+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.114450+0000', 'last_undegraded': '2024-09-10T23:20:40.114450+0000', 'last_fullsized': '2024-09-10T23:20:40.114450+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:PG 12.27 is not active+clean 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.111727+0000', 'last_change': '2024-09-10T23:20:40.111727+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.111727+0000', 'last_undegraded': '2024-09-10T23:20:40.111727+0000', 'last_fullsized': '2024-09-10T23:20:40.111727+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:PG 12.26 is not active+clean 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.119651+0000', 'last_change': '2024-09-10T23:20:40.119651+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.119651+0000', 'last_undegraded': '2024-09-10T23:20:40.119651+0000', 'last_fullsized': '2024-09-10T23:20:40.119651+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:PG 12.25 is not active+clean 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.117313+0000', 'last_change': '2024-09-10T23:20:40.117313+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.117313+0000', 'last_undegraded': '2024-09-10T23:20:40.117313+0000', 'last_fullsized': '2024-09-10T23:20:40.117313+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:PG 12.24 is not active+clean 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.116481+0000', 'last_change': '2024-09-10T23:20:40.116481+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.116481+0000', 'last_undegraded': '2024-09-10T23:20:40.116481+0000', 'last_fullsized': '2024-09-10T23:20:40.116481+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:PG 12.23 is not active+clean 2024-09-10T23:20:46.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.111740+0000', 'last_change': '2024-09-10T23:20:40.111740+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.111740+0000', 'last_undegraded': '2024-09-10T23:20:40.111740+0000', 'last_fullsized': '2024-09-10T23:20:40.111740+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:PG 12.22 is not active+clean 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.116288+0000', 'last_change': '2024-09-10T23:20:40.116288+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.116288+0000', 'last_undegraded': '2024-09-10T23:20:40.116288+0000', 'last_fullsized': '2024-09-10T23:20:40.116288+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:PG 12.21 is not active+clean 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.108231+0000', 'last_change': '2024-09-10T23:20:40.108231+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.108231+0000', 'last_undegraded': '2024-09-10T23:20:40.108231+0000', 'last_fullsized': '2024-09-10T23:20:40.108231+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:PG 12.20 is not active+clean 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.114407+0000', 'last_change': '2024-09-10T23:20:40.114407+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.114407+0000', 'last_undegraded': '2024-09-10T23:20:40.114407+0000', 'last_fullsized': '2024-09-10T23:20:40.114407+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:PG 12.18 is not active+clean 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.109454+0000', 'last_change': '2024-09-10T23:20:40.109454+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.109454+0000', 'last_undegraded': '2024-09-10T23:20:40.109454+0000', 'last_fullsized': '2024-09-10T23:20:40.109454+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:PG 12.19 is not active+clean 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.111190+0000', 'last_change': '2024-09-10T23:20:40.111190+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.111190+0000', 'last_undegraded': '2024-09-10T23:20:40.111190+0000', 'last_fullsized': '2024-09-10T23:20:40.111190+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.090 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.114180+0000', 'last_change': '2024-09-10T23:20:40.114180+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.114180+0000', 'last_undegraded': '2024-09-10T23:20:40.114180+0000', 'last_fullsized': '2024-09-10T23:20:40.114180+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.112662+0000', 'last_change': '2024-09-10T23:20:40.112662+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.112662+0000', 'last_undegraded': '2024-09-10T23:20:40.112662+0000', 'last_fullsized': '2024-09-10T23:20:40.112662+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1c is not active+clean 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.111753+0000', 'last_change': '2024-09-10T23:20:40.111753+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.111753+0000', 'last_undegraded': '2024-09-10T23:20:40.111753+0000', 'last_fullsized': '2024-09-10T23:20:40.111753+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1d is not active+clean 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.111262+0000', 'last_change': '2024-09-10T23:20:40.111262+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.111262+0000', 'last_undegraded': '2024-09-10T23:20:40.111262+0000', 'last_fullsized': '2024-09-10T23:20:40.111262+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.113501+0000', 'last_change': '2024-09-10T23:20:40.113501+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.113501+0000', 'last_undegraded': '2024-09-10T23:20:40.113501+0000', 'last_fullsized': '2024-09-10T23:20:40.113501+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:20:46.091 INFO:tasks.ceph.ceph_manager.ceph:PG 12.10 is not active+clean 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.109294+0000', 'last_change': '2024-09-10T23:20:40.109294+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.109294+0000', 'last_undegraded': '2024-09-10T23:20:40.109294+0000', 'last_fullsized': '2024-09-10T23:20:40.109294+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.119113+0000', 'last_change': '2024-09-10T23:20:40.119113+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.119113+0000', 'last_undegraded': '2024-09-10T23:20:40.119113+0000', 'last_fullsized': '2024-09-10T23:20:40.119113+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:PG 12.13 is not active+clean 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.107684+0000', 'last_change': '2024-09-10T23:20:40.107684+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.107684+0000', 'last_undegraded': '2024-09-10T23:20:40.107684+0000', 'last_fullsized': '2024-09-10T23:20:40.107684+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.119572+0000', 'last_change': '2024-09-10T23:20:40.119572+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.119572+0000', 'last_undegraded': '2024-09-10T23:20:40.119572+0000', 'last_fullsized': '2024-09-10T23:20:40.119572+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:PG 12.9 is not active+clean 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.116080+0000', 'last_change': '2024-09-10T23:20:40.116080+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.116080+0000', 'last_undegraded': '2024-09-10T23:20:40.116080+0000', 'last_fullsized': '2024-09-10T23:20:40.116080+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:20:46.092 INFO:tasks.ceph.ceph_manager.ceph:PG 12.a is not active+clean 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.116528+0000', 'last_change': '2024-09-10T23:20:40.116528+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.116528+0000', 'last_undegraded': '2024-09-10T23:20:40.116528+0000', 'last_fullsized': '2024-09-10T23:20:40.116528+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:PG 12.c is not active+clean 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.109972+0000', 'last_change': '2024-09-10T23:20:40.109972+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.109972+0000', 'last_undegraded': '2024-09-10T23:20:40.109972+0000', 'last_fullsized': '2024-09-10T23:20:40.109972+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:PG 12.e is not active+clean 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.110761+0000', 'last_change': '2024-09-10T23:20:40.110761+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.110761+0000', 'last_undegraded': '2024-09-10T23:20:40.110761+0000', 'last_fullsized': '2024-09-10T23:20:40.110761+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.112309+0000', 'last_change': '2024-09-10T23:20:40.112309+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.112309+0000', 'last_undegraded': '2024-09-10T23:20:40.112309+0000', 'last_fullsized': '2024-09-10T23:20:40.112309+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.113783+0000', 'last_change': '2024-09-10T23:20:40.113783+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.113783+0000', 'last_undegraded': '2024-09-10T23:20:40.113783+0000', 'last_fullsized': '2024-09-10T23:20:40.113783+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T23:20:46.093 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3 is not active+clean 2024-09-10T23:20:46.094 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.107985+0000', 'last_change': '2024-09-10T23:20:40.107985+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.107985+0000', 'last_undegraded': '2024-09-10T23:20:40.107985+0000', 'last_fullsized': '2024-09-10T23:20:40.107985+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T23:20:46.094 INFO:tasks.ceph.ceph_manager.ceph:PG 12.6 is not active+clean 2024-09-10T23:20:46.094 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.107507+0000', 'last_change': '2024-09-10T23:20:40.107507+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.107507+0000', 'last_undegraded': '2024-09-10T23:20:40.107507+0000', 'last_fullsized': '2024-09-10T23:20:40.107507+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:20:46.094 INFO:tasks.ceph.ceph_manager.ceph:PG 12.7 is not active+clean 2024-09-10T23:20:46.094 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.107502+0000', 'last_change': '2024-09-10T23:20:40.107502+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.107502+0000', 'last_undegraded': '2024-09-10T23:20:40.107502+0000', 'last_fullsized': '2024-09-10T23:20:40.107502+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T23:20:46.094 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-10T23:20:46.094 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:20:40.116101+0000', 'last_change': '2024-09-10T23:20:40.116101+0000', 'last_active': '2024-09-10T23:20:40.094243+0000', 'last_peered': '2024-09-10T23:20:40.094243+0000', 'last_clean': '2024-09-10T23:20:40.094243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:20:40.116101+0000', 'last_undegraded': '2024-09-10T23:20:40.116101+0000', 'last_fullsized': '2024-09-10T23:20:40.116101+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'last_clean_scrub_stamp': '2024-09-10T23:20:40.094243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T23:20:46.095 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:20:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.265+0000 7fb89b800640 1 -- 172.21.15.17:0/3142227048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 msgr2=0x7fb87c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.265+0000 7fb89b800640 1 --2- 172.21.15.17:0/3142227048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 0x7fb87c004c90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb880009b30 tx=0x7fb88001d230 comp rx=0 tx=0).stop 2024-09-10T23:20:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.265+0000 7fb89b800640 1 -- 172.21.15.17:0/3142227048 shutdown_connections 2024-09-10T23:20:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.265+0000 7fb89b800640 1 --2- 172.21.15.17:0/3142227048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 0x7fb87c004c90 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.265+0000 7fb89b800640 1 -- 172.21.15.17:0/3142227048 >> 172.21.15.17:0/3142227048 conn(0x7fb8940d1d30 msgr2=0x7fb8940d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.265+0000 7fb89b800640 1 -- 172.21.15.17:0/3142227048 shutdown_connections 2024-09-10T23:20:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.265+0000 7fb89b800640 1 -- 172.21.15.17:0/3142227048 wait complete. 2024-09-10T23:20:46.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.265+0000 7fb89b800640 1 Processor -- start 2024-09-10T23:20:46.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.265+0000 7fb89b800640 1 -- start start 2024-09-10T23:20:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb89b800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 0x7fb8940c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb89b800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8941f5be0 0x7fb89415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb89b800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8940c4a90 0x7fb8941e5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb89b800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8940cff30 con 0x7fb87c004810 2024-09-10T23:20:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb89b800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb8940cfdb0 con 0x7fb8940c4a90 2024-09-10T23:20:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb89b800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb8940d00b0 con 0x7fb8941f5be0 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb898e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 0x7fb8940c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb898e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 0x7fb8940c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58386/0 (socket says 172.21.15.17:58386) 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb898e00640 1 -- 172.21.15.17:0/485362078 learned_addr learned my addr 172.21.15.17:0/485362078 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb899800640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8940c4a90 0x7fb8941e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb893e00640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8941f5be0 0x7fb89415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb898e00640 1 -- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8941f5be0 msgr2=0x7fb89415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb898e00640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8941f5be0 0x7fb89415d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb898e00640 1 -- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8940c4a90 msgr2=0x7fb8941e5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb898e00640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8940c4a90 0x7fb8941e5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb898e00640 1 -- 172.21.15.17:0/485362078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8941f6070 con 0x7fb87c004810 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb898e00640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 0x7fb8940c5860 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb888004c60 tx=0x7fb888001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb890c00640 1 -- 172.21.15.17:0/485362078 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888015020 con 0x7fb87c004810 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb890c00640 1 -- 172.21.15.17:0/485362078 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb888011960 con 0x7fb87c004810 2024-09-10T23:20:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8941f6350 con 0x7fb87c004810 2024-09-10T23:20:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb890c00640 1 -- 172.21.15.17:0/485362078 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888011db0 con 0x7fb87c004810 2024-09-10T23:20:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8941f6910 con 0x7fb87c004810 2024-09-10T23:20:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.269+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8940d05b0 con 0x7fb87c004810 2024-09-10T23:20:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.273+0000 7fb890c00640 1 -- 172.21.15.17:0/485362078 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb88801a400 con 0x7fb87c004810 2024-09-10T23:20:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.273+0000 7fb890c00640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8740725e0 0x7fb874074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.273+0000 7fb890c00640 1 -- 172.21.15.17:0/485362078 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fb888094210 con 0x7fb87c004810 2024-09-10T23:20:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.273+0000 7fb893e00640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8740725e0 0x7fb874074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.273+0000 7fb893e00640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8740725e0 0x7fb874074aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb8800ae000 tx=0x7fb880019fd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:46.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.277+0000 7fb890c00640 1 -- 172.21.15.17:0/485362078 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb88801f020 con 0x7fb87c004810 2024-09-10T23:20:46.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.509+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb89406f440 con 0x7fb87c004810 2024-09-10T23:20:46.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb890c00640 1 -- 172.21.15.17:0/485362078 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1140 (secure 0 0 0) 0x7fb88805f6c0 con 0x7fb87c004810 2024-09-10T23:20:46.516 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:46.516 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":335,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":87,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":49},{"state_name":"active+clean","count":48}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":591980,"bytes_used":360177664,"bytes_avail":772733935616,"bytes_total":773094113280,"inactive_pgs_ratio":0.50515460968017578,"write_bytes_sec":582,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":56,"btime":"2024-09-10T23:20:44:138459+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6879}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-09-10T23:20:14.359093+0000","services":{}},"progress_events":{}} 2024-09-10T23:20:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8740725e0 msgr2=0x7fb874074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8740725e0 0x7fb874074aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb8800ae000 tx=0x7fb880019fd0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 msgr2=0x7fb8940c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 0x7fb8940c5860 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb888004c60 tx=0x7fb888001810 comp rx=0 tx=0).stop 2024-09-10T23:20:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 shutdown_connections 2024-09-10T23:20:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8740725e0 0x7fb874074aa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8940c4a90 0x7fb8941e5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8941f5be0 0x7fb89415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 --2- 172.21.15.17:0/485362078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb87c004810 0x7fb8940c5860 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 >> 172.21.15.17:0/485362078 conn(0x7fb8940d1d30 msgr2=0x7fb8940b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 shutdown_connections 2024-09-10T23:20:46.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.513+0000 7fb89b800640 1 -- 172.21.15.17:0/485362078 wait complete. 2024-09-10T23:20:46.537 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:20:46.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:20:46.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.681+0000 7f7d59c00640 1 -- 172.21.15.17:0/2664602283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d38004810 msgr2=0x7f7d38004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.681+0000 7f7d59c00640 1 --2- 172.21.15.17:0/2664602283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d38004810 0x7f7d38004c90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009b30 tx=0x7f7d3c01d230 comp rx=0 tx=0).stop 2024-09-10T23:20:46.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.681+0000 7f7d59c00640 1 -- 172.21.15.17:0/2664602283 shutdown_connections 2024-09-10T23:20:46.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.681+0000 7f7d59c00640 1 --2- 172.21.15.17:0/2664602283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d38004810 0x7f7d38004c90 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.681+0000 7f7d59c00640 1 -- 172.21.15.17:0/2664602283 >> 172.21.15.17:0/2664602283 conn(0x7f7d540d1d10 msgr2=0x7f7d540d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:46.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.681+0000 7f7d59c00640 1 -- 172.21.15.17:0/2664602283 shutdown_connections 2024-09-10T23:20:46.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.681+0000 7f7d59c00640 1 -- 172.21.15.17:0/2664602283 wait complete. 2024-09-10T23:20:46.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.681+0000 7f7d59c00640 1 Processor -- start 2024-09-10T23:20:46.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.681+0000 7f7d59c00640 1 -- start start 2024-09-10T23:20:46.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d59c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d38004810 0x7f7d540c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:46.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d59c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d540b61b0 0x7f7d540cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:46.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d59c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d540c7230 0x7f7d540c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d59c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7d540d0420 con 0x7f7d540c7230 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d59c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d540b10f0 con 0x7f7d38004810 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d59c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7d540d05a0 con 0x7f7d540b61b0 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d540c7230 0x7f7d540c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d540c7230 0x7f7d540c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58408/0 (socket says 172.21.15.17:58408) 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d53400640 1 -- 172.21.15.17:0/2649471441 learned_addr learned my addr 172.21.15.17:0/2649471441 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d52a00640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d38004810 0x7f7d540c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d4a000640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d540b61b0 0x7f7d540cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d53400640 1 -- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d540b61b0 msgr2=0x7f7d540cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d53400640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d540b61b0 0x7f7d540cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d53400640 1 -- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d38004810 msgr2=0x7f7d540c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d53400640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d38004810 0x7f7d540c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d53400640 1 -- 172.21.15.17:0/2649471441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5406dd70 con 0x7f7d540c7230 2024-09-10T23:20:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d53400640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d540c7230 0x7f7d540c76c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7d5406c470 tx=0x7f7d4c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d4b400640 1 -- 172.21.15.17:0/2649471441 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c00cc20 con 0x7f7d540c7230 2024-09-10T23:20:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d4b400640 1 -- 172.21.15.17:0/2649471441 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d4c018070 con 0x7f7d540c7230 2024-09-10T23:20:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d4b400640 1 -- 172.21.15.17:0/2649471441 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0116c0 con 0x7f7d540c7230 2024-09-10T23:20:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d540b67f0 con 0x7f7d540c7230 2024-09-10T23:20:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d540b6db0 con 0x7f7d540c7230 2024-09-10T23:20:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d540b1430 con 0x7f7d540c7230 2024-09-10T23:20:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.685+0000 7f7d4b400640 1 -- 172.21.15.17:0/2649471441 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7d4c011860 con 0x7f7d540c7230 2024-09-10T23:20:46.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.689+0000 7f7d4b400640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7d300725e0 0x7f7d30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:46.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.689+0000 7f7d4b400640 1 -- 172.21.15.17:0/2649471441 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f7d4c093870 con 0x7f7d540c7230 2024-09-10T23:20:46.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.689+0000 7f7d52a00640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7d300725e0 0x7f7d30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:46.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.689+0000 7f7d52a00640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7d300725e0 0x7f7d30074aa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7d44000c10 tx=0x7f7d44006d60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:46.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.693+0000 7f7d4b400640 1 -- 172.21.15.17:0/2649471441 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7d4c05e760 con 0x7f7d540c7230 2024-09-10T23:20:46.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.861+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d540b2650 con 0x7f7d300725e0 2024-09-10T23:20:46.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.869+0000 7f7d4b400640 1 -- 172.21.15.17:0/2649471441 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252074 (secure 0 0 0) 0x7f7d540b2650 con 0x7f7d300725e0 2024-09-10T23:20:46.875 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:46.876 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:20:46.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7d300725e0 msgr2=0x7f7d30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7d300725e0 0x7f7d30074aa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7d44000c10 tx=0x7f7d44006d60 comp rx=0 tx=0).stop 2024-09-10T23:20:46.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d540c7230 msgr2=0x7f7d540c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:46.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d540c7230 0x7f7d540c76c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7d5406c470 tx=0x7f7d4c00ed70 comp rx=0 tx=0).stop 2024-09-10T23:20:46.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 shutdown_connections 2024-09-10T23:20:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7d300725e0 0x7f7d30074aa0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d540c7230 0x7f7d540c76c0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d540b61b0 0x7f7d540cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 --2- 172.21.15.17:0/2649471441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d38004810 0x7f7d540c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 >> 172.21.15.17:0/2649471441 conn(0x7f7d540d1d10 msgr2=0x7f7d5406e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 shutdown_connections 2024-09-10T23:20:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:46.873+0000 7f7d59c00640 1 -- 172.21.15.17:0/2649471441 wait complete. 2024-09-10T23:20:46.896 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-10T23:20:46.367454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":351996,"kb_used_data":9480,"kb_used_omap":12,"kb_used_meta":342323,"kb_avail":754622724,"statfs":{"total":773094113280,"available":772733669376,"internally_reserved":0,"allocated":9707520,"data_stored":5077364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":350539313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.262057"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121784+0000","last_change":"2024-09-10T23:20:41.131521+0000","last_active":"2024-09-10T23:20:42.121784+0000","last_peered":"2024-09-10T23:20:42.121784+0000","last_clean":"2024-09-10T23:20:42.121784+0000","last_became_active":"2024-09-10T23:20:41.131186+0000","last_became_peered":"2024-09-10T23:20:41.131186+0000","last_unstale":"2024-09-10T23:20:42.121784+0000","last_undegraded":"2024-09-10T23:20:42.121784+0000","last_fullsized":"2024-09-10T23:20:42.121784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:27.586513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.130402+0000","last_change":"2024-09-10T23:20:41.143979+0000","last_active":"2024-09-10T23:20:42.130402+0000","last_peered":"2024-09-10T23:20:42.130402+0000","last_clean":"2024-09-10T23:20:42.130402+0000","last_became_active":"2024-09-10T23:20:41.143710+0000","last_became_peered":"2024-09-10T23:20:41.143710+0000","last_unstale":"2024-09-10T23:20:42.130402+0000","last_undegraded":"2024-09-10T23:20:42.130402+0000","last_fullsized":"2024-09-10T23:20:42.130402+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:14.813604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419767+0000","last_change":"2024-09-10T23:20:41.141251+0000","last_active":"2024-09-10T23:20:42.419767+0000","last_peered":"2024-09-10T23:20:42.419767+0000","last_clean":"2024-09-10T23:20:42.419767+0000","last_became_active":"2024-09-10T23:20:41.140077+0000","last_became_peered":"2024-09-10T23:20:41.140077+0000","last_unstale":"2024-09-10T23:20:42.419767+0000","last_undegraded":"2024-09-10T23:20:42.419767+0000","last_fullsized":"2024-09-10T23:20:42.419767+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:39.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422279+0000","last_change":"2024-09-10T23:20:41.131402+0000","last_active":"2024-09-10T23:20:42.422279+0000","last_peered":"2024-09-10T23:20:42.422279+0000","last_clean":"2024-09-10T23:20:42.422279+0000","last_became_active":"2024-09-10T23:20:41.130302+0000","last_became_peered":"2024-09-10T23:20:41.130302+0000","last_unstale":"2024-09-10T23:20:42.422279+0000","last_undegraded":"2024-09-10T23:20:42.422279+0000","last_fullsized":"2024-09-10T23:20:42.422279+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:20.656932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133082+0000","last_change":"2024-09-10T23:20:41.120424+0000","last_active":"2024-09-10T23:20:42.133082+0000","last_peered":"2024-09-10T23:20:42.133082+0000","last_clean":"2024-09-10T23:20:42.133082+0000","last_became_active":"2024-09-10T23:20:41.120050+0000","last_became_peered":"2024-09-10T23:20:41.120050+0000","last_unstale":"2024-09-10T23:20:42.133082+0000","last_undegraded":"2024-09-10T23:20:42.133082+0000","last_fullsized":"2024-09-10T23:20:42.133082+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118568+0000","last_change":"2024-09-10T23:20:41.127078+0000","last_active":"2024-09-10T23:20:42.118568+0000","last_peered":"2024-09-10T23:20:42.118568+0000","last_clean":"2024-09-10T23:20:42.118568+0000","last_became_active":"2024-09-10T23:20:41.126523+0000","last_became_peered":"2024-09-10T23:20:41.126523+0000","last_unstale":"2024-09-10T23:20:42.118568+0000","last_undegraded":"2024-09-10T23:20:42.118568+0000","last_fullsized":"2024-09-10T23:20:42.118568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:13.361890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422887+0000","last_change":"2024-09-10T23:20:41.131788+0000","last_active":"2024-09-10T23:20:42.422887+0000","last_peered":"2024-09-10T23:20:42.422887+0000","last_clean":"2024-09-10T23:20:42.422887+0000","last_became_active":"2024-09-10T23:20:41.131510+0000","last_became_peered":"2024-09-10T23:20:41.131510+0000","last_unstale":"2024-09-10T23:20:42.422887+0000","last_undegraded":"2024-09-10T23:20:42.422887+0000","last_fullsized":"2024-09-10T23:20:42.422887+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:00.378438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132781+0000","last_change":"2024-09-10T23:20:41.117381+0000","last_active":"2024-09-10T23:20:42.132781+0000","last_peered":"2024-09-10T23:20:42.132781+0000","last_clean":"2024-09-10T23:20:42.132781+0000","last_became_active":"2024-09-10T23:20:41.117046+0000","last_became_peered":"2024-09-10T23:20:41.117046+0000","last_unstale":"2024-09-10T23:20:42.132781+0000","last_undegraded":"2024-09-10T23:20:42.132781+0000","last_fullsized":"2024-09-10T23:20:42.132781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:38.437065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423020+0000","last_change":"2024-09-10T23:20:41.132127+0000","last_active":"2024-09-10T23:20:42.423020+0000","last_peered":"2024-09-10T23:20:42.423020+0000","last_clean":"2024-09-10T23:20:42.423020+0000","last_became_active":"2024-09-10T23:20:41.131812+0000","last_became_peered":"2024-09-10T23:20:41.131812+0000","last_unstale":"2024-09-10T23:20:42.423020+0000","last_undegraded":"2024-09-10T23:20:42.423020+0000","last_fullsized":"2024-09-10T23:20:42.423020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:12.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423124+0000","last_change":"2024-09-10T23:20:41.127531+0000","last_active":"2024-09-10T23:20:42.423124+0000","last_peered":"2024-09-10T23:20:42.423124+0000","last_clean":"2024-09-10T23:20:42.423124+0000","last_became_active":"2024-09-10T23:20:41.127249+0000","last_became_peered":"2024-09-10T23:20:41.127249+0000","last_unstale":"2024-09-10T23:20:42.423124+0000","last_undegraded":"2024-09-10T23:20:42.423124+0000","last_fullsized":"2024-09-10T23:20:42.423124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:51.967335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129367+0000","last_change":"2024-09-10T23:20:41.141413+0000","last_active":"2024-09-10T23:20:42.129367+0000","last_peered":"2024-09-10T23:20:42.129367+0000","last_clean":"2024-09-10T23:20:42.129367+0000","last_became_active":"2024-09-10T23:20:41.141066+0000","last_became_peered":"2024-09-10T23:20:41.141066+0000","last_unstale":"2024-09-10T23:20:42.129367+0000","last_undegraded":"2024-09-10T23:20:42.129367+0000","last_fullsized":"2024-09-10T23:20:42.129367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:36.164871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422492+0000","last_change":"2024-09-10T23:20:41.149001+0000","last_active":"2024-09-10T23:20:42.422492+0000","last_peered":"2024-09-10T23:20:42.422492+0000","last_clean":"2024-09-10T23:20:42.422492+0000","last_became_active":"2024-09-10T23:20:41.148785+0000","last_became_peered":"2024-09-10T23:20:41.148785+0000","last_unstale":"2024-09-10T23:20:42.422492+0000","last_undegraded":"2024-09-10T23:20:42.422492+0000","last_fullsized":"2024-09-10T23:20:42.422492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:36.156413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133092+0000","last_change":"2024-09-10T23:20:41.128905+0000","last_active":"2024-09-10T23:20:42.133092+0000","last_peered":"2024-09-10T23:20:42.133092+0000","last_clean":"2024-09-10T23:20:42.133092+0000","last_became_active":"2024-09-10T23:20:41.127689+0000","last_became_peered":"2024-09-10T23:20:41.127689+0000","last_unstale":"2024-09-10T23:20:42.133092+0000","last_undegraded":"2024-09-10T23:20:42.133092+0000","last_fullsized":"2024-09-10T23:20:42.133092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:18.842082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118828+0000","last_change":"2024-09-10T23:20:41.127354+0000","last_active":"2024-09-10T23:20:42.118828+0000","last_peered":"2024-09-10T23:20:42.118828+0000","last_clean":"2024-09-10T23:20:42.118828+0000","last_became_active":"2024-09-10T23:20:41.126817+0000","last_became_peered":"2024-09-10T23:20:41.126817+0000","last_unstale":"2024-09-10T23:20:42.118828+0000","last_undegraded":"2024-09-10T23:20:42.118828+0000","last_fullsized":"2024-09-10T23:20:42.118828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:29.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129189+0000","last_change":"2024-09-10T23:20:41.143274+0000","last_active":"2024-09-10T23:20:42.129189+0000","last_peered":"2024-09-10T23:20:42.129189+0000","last_clean":"2024-09-10T23:20:42.129189+0000","last_became_active":"2024-09-10T23:20:41.141364+0000","last_became_peered":"2024-09-10T23:20:41.141364+0000","last_unstale":"2024-09-10T23:20:42.129189+0000","last_undegraded":"2024-09-10T23:20:42.129189+0000","last_fullsized":"2024-09-10T23:20:42.129189+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:43.321922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121279+0000","last_change":"2024-09-10T23:20:41.126631+0000","last_active":"2024-09-10T23:20:42.121279+0000","last_peered":"2024-09-10T23:20:42.121279+0000","last_clean":"2024-09-10T23:20:42.121279+0000","last_became_active":"2024-09-10T23:20:41.126348+0000","last_became_peered":"2024-09-10T23:20:41.126348+0000","last_unstale":"2024-09-10T23:20:42.121279+0000","last_undegraded":"2024-09-10T23:20:42.121279+0000","last_fullsized":"2024-09-10T23:20:42.121279+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:24.886006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133521+0000","last_change":"2024-09-10T23:20:41.122602+0000","last_active":"2024-09-10T23:20:42.133521+0000","last_peered":"2024-09-10T23:20:42.133521+0000","last_clean":"2024-09-10T23:20:42.133521+0000","last_became_active":"2024-09-10T23:20:41.122309+0000","last_became_peered":"2024-09-10T23:20:41.122309+0000","last_unstale":"2024-09-10T23:20:42.133521+0000","last_undegraded":"2024-09-10T23:20:42.133521+0000","last_fullsized":"2024-09-10T23:20:42.133521+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:56.521411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419711+0000","last_change":"2024-09-10T23:20:41.131567+0000","last_active":"2024-09-10T23:20:42.419711+0000","last_peered":"2024-09-10T23:20:42.419711+0000","last_clean":"2024-09-10T23:20:42.419711+0000","last_became_active":"2024-09-10T23:20:41.131259+0000","last_became_peered":"2024-09-10T23:20:41.131259+0000","last_unstale":"2024-09-10T23:20:42.419711+0000","last_undegraded":"2024-09-10T23:20:42.419711+0000","last_fullsized":"2024-09-10T23:20:42.419711+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:01.986328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118830+0000","last_change":"2024-09-10T23:20:41.124255+0000","last_active":"2024-09-10T23:20:42.118830+0000","last_peered":"2024-09-10T23:20:42.118830+0000","last_clean":"2024-09-10T23:20:42.118830+0000","last_became_active":"2024-09-10T23:20:41.123986+0000","last_became_peered":"2024-09-10T23:20:41.123986+0000","last_unstale":"2024-09-10T23:20:42.118830+0000","last_undegraded":"2024-09-10T23:20:42.118830+0000","last_fullsized":"2024-09-10T23:20:42.118830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:28.015170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133267+0000","last_change":"2024-09-10T23:20:41.126283+0000","last_active":"2024-09-10T23:20:42.133267+0000","last_peered":"2024-09-10T23:20:42.133267+0000","last_clean":"2024-09-10T23:20:42.133267+0000","last_became_active":"2024-09-10T23:20:41.125597+0000","last_became_peered":"2024-09-10T23:20:41.125597+0000","last_unstale":"2024-09-10T23:20:42.133267+0000","last_undegraded":"2024-09-10T23:20:42.133267+0000","last_fullsized":"2024-09-10T23:20:42.133267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:38.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422205+0000","last_change":"2024-09-10T23:20:41.137511+0000","last_active":"2024-09-10T23:20:42.422205+0000","last_peered":"2024-09-10T23:20:42.422205+0000","last_clean":"2024-09-10T23:20:42.422205+0000","last_became_active":"2024-09-10T23:20:41.137040+0000","last_became_peered":"2024-09-10T23:20:41.137040+0000","last_unstale":"2024-09-10T23:20:42.422205+0000","last_undegraded":"2024-09-10T23:20:42.422205+0000","last_fullsized":"2024-09-10T23:20:42.422205+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:56.756478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132987+0000","last_change":"2024-09-10T23:20:41.128453+0000","last_active":"2024-09-10T23:20:42.132987+0000","last_peered":"2024-09-10T23:20:42.132987+0000","last_clean":"2024-09-10T23:20:42.132987+0000","last_became_active":"2024-09-10T23:20:41.127667+0000","last_became_peered":"2024-09-10T23:20:41.127667+0000","last_unstale":"2024-09-10T23:20:42.132987+0000","last_undegraded":"2024-09-10T23:20:42.132987+0000","last_fullsized":"2024-09-10T23:20:42.132987+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:40.577849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422251+0000","last_change":"2024-09-10T23:20:41.127751+0000","last_active":"2024-09-10T23:20:42.422251+0000","last_peered":"2024-09-10T23:20:42.422251+0000","last_clean":"2024-09-10T23:20:42.422251+0000","last_became_active":"2024-09-10T23:20:41.127457+0000","last_became_peered":"2024-09-10T23:20:41.127457+0000","last_unstale":"2024-09-10T23:20:42.422251+0000","last_undegraded":"2024-09-10T23:20:42.422251+0000","last_fullsized":"2024-09-10T23:20:42.422251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:07.981495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.128806+0000","last_change":"2024-09-10T23:20:41.137275+0000","last_active":"2024-09-10T23:20:42.128806+0000","last_peered":"2024-09-10T23:20:42.128806+0000","last_clean":"2024-09-10T23:20:42.128806+0000","last_became_active":"2024-09-10T23:20:41.136993+0000","last_became_peered":"2024-09-10T23:20:41.136993+0000","last_unstale":"2024-09-10T23:20:42.128806+0000","last_undegraded":"2024-09-10T23:20:42.128806+0000","last_fullsized":"2024-09-10T23:20:42.128806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:14.778658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.130149+0000","last_change":"2024-09-10T23:20:41.140913+0000","last_active":"2024-09-10T23:20:42.130149+0000","last_peered":"2024-09-10T23:20:42.130149+0000","last_clean":"2024-09-10T23:20:42.130149+0000","last_became_active":"2024-09-10T23:20:41.136763+0000","last_became_peered":"2024-09-10T23:20:41.136763+0000","last_unstale":"2024-09-10T23:20:42.130149+0000","last_undegraded":"2024-09-10T23:20:42.130149+0000","last_fullsized":"2024-09-10T23:20:42.130149+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.879705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423382+0000","last_change":"2024-09-10T23:20:41.148110+0000","last_active":"2024-09-10T23:20:42.423382+0000","last_peered":"2024-09-10T23:20:42.423382+0000","last_clean":"2024-09-10T23:20:42.423382+0000","last_became_active":"2024-09-10T23:20:41.147674+0000","last_became_peered":"2024-09-10T23:20:41.147674+0000","last_unstale":"2024-09-10T23:20:42.423382+0000","last_undegraded":"2024-09-10T23:20:42.423382+0000","last_fullsized":"2024-09-10T23:20:42.423382+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:46.482417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121785+0000","last_change":"2024-09-10T23:20:41.126508+0000","last_active":"2024-09-10T23:20:42.121785+0000","last_peered":"2024-09-10T23:20:42.121785+0000","last_clean":"2024-09-10T23:20:42.121785+0000","last_became_active":"2024-09-10T23:20:41.126042+0000","last_became_peered":"2024-09-10T23:20:41.126042+0000","last_unstale":"2024-09-10T23:20:42.121785+0000","last_undegraded":"2024-09-10T23:20:42.121785+0000","last_fullsized":"2024-09-10T23:20:42.121785+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:10.078447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133291+0000","last_change":"2024-09-10T23:20:41.126547+0000","last_active":"2024-09-10T23:20:42.133291+0000","last_peered":"2024-09-10T23:20:42.133291+0000","last_clean":"2024-09-10T23:20:42.133291+0000","last_became_active":"2024-09-10T23:20:41.125980+0000","last_became_peered":"2024-09-10T23:20:41.125980+0000","last_unstale":"2024-09-10T23:20:42.133291+0000","last_undegraded":"2024-09-10T23:20:42.133291+0000","last_fullsized":"2024-09-10T23:20:42.133291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:52.139520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129157+0000","last_change":"2024-09-10T23:20:41.129313+0000","last_active":"2024-09-10T23:20:42.129157+0000","last_peered":"2024-09-10T23:20:42.129157+0000","last_clean":"2024-09-10T23:20:42.129157+0000","last_became_active":"2024-09-10T23:20:41.128986+0000","last_became_peered":"2024-09-10T23:20:41.128986+0000","last_unstale":"2024-09-10T23:20:42.129157+0000","last_undegraded":"2024-09-10T23:20:42.129157+0000","last_fullsized":"2024-09-10T23:20:42.129157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:00.238840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121268+0000","last_change":"2024-09-10T23:20:41.130770+0000","last_active":"2024-09-10T23:20:42.121268+0000","last_peered":"2024-09-10T23:20:42.121268+0000","last_clean":"2024-09-10T23:20:42.121268+0000","last_became_active":"2024-09-10T23:20:41.130497+0000","last_became_peered":"2024-09-10T23:20:41.130497+0000","last_unstale":"2024-09-10T23:20:42.121268+0000","last_undegraded":"2024-09-10T23:20:42.121268+0000","last_fullsized":"2024-09-10T23:20:42.121268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:15.430774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419387+0000","last_change":"2024-09-10T23:20:41.124111+0000","last_active":"2024-09-10T23:20:42.419387+0000","last_peered":"2024-09-10T23:20:42.419387+0000","last_clean":"2024-09-10T23:20:42.419387+0000","last_became_active":"2024-09-10T23:20:41.123845+0000","last_became_peered":"2024-09-10T23:20:41.123845+0000","last_unstale":"2024-09-10T23:20:42.419387+0000","last_undegraded":"2024-09-10T23:20:42.419387+0000","last_fullsized":"2024-09-10T23:20:42.419387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:29.649638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121328+0000","last_change":"2024-09-10T23:20:41.128466+0000","last_active":"2024-09-10T23:20:42.121328+0000","last_peered":"2024-09-10T23:20:42.121328+0000","last_clean":"2024-09-10T23:20:42.121328+0000","last_became_active":"2024-09-10T23:20:41.128208+0000","last_became_peered":"2024-09-10T23:20:41.128208+0000","last_unstale":"2024-09-10T23:20:42.121328+0000","last_undegraded":"2024-09-10T23:20:42.121328+0000","last_fullsized":"2024-09-10T23:20:42.121328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:53.108815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419461+0000","last_change":"2024-09-10T23:20:41.137976+0000","last_active":"2024-09-10T23:20:42.419461+0000","last_peered":"2024-09-10T23:20:42.419461+0000","last_clean":"2024-09-10T23:20:42.419461+0000","last_became_active":"2024-09-10T23:20:41.135335+0000","last_became_peered":"2024-09-10T23:20:41.135335+0000","last_unstale":"2024-09-10T23:20:42.419461+0000","last_undegraded":"2024-09-10T23:20:42.419461+0000","last_fullsized":"2024-09-10T23:20:42.419461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:29.623199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133492+0000","last_change":"2024-09-10T23:20:40.128521+0000","last_active":"2024-09-10T23:20:42.133492+0000","last_peered":"2024-09-10T23:20:42.133492+0000","last_clean":"2024-09-10T23:20:42.133492+0000","last_became_active":"2024-09-10T23:20:40.128196+0000","last_became_peered":"2024-09-10T23:20:40.128196+0000","last_unstale":"2024-09-10T23:20:42.133492+0000","last_undegraded":"2024-09-10T23:20:42.133492+0000","last_fullsized":"2024-09-10T23:20:42.133492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:56.395606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.128873+0000","last_change":"2024-09-10T23:20:41.127493+0000","last_active":"2024-09-10T23:20:42.128873+0000","last_peered":"2024-09-10T23:20:42.128873+0000","last_clean":"2024-09-10T23:20:42.128873+0000","last_became_active":"2024-09-10T23:20:41.127191+0000","last_became_peered":"2024-09-10T23:20:41.127191+0000","last_unstale":"2024-09-10T23:20:42.128873+0000","last_undegraded":"2024-09-10T23:20:42.128873+0000","last_fullsized":"2024-09-10T23:20:42.128873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:23.717621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121862+0000","last_change":"2024-09-10T23:20:40.129893+0000","last_active":"2024-09-10T23:20:42.121862+0000","last_peered":"2024-09-10T23:20:42.121862+0000","last_clean":"2024-09-10T23:20:42.121862+0000","last_became_active":"2024-09-10T23:20:40.129646+0000","last_became_peered":"2024-09-10T23:20:40.129646+0000","last_unstale":"2024-09-10T23:20:42.121862+0000","last_undegraded":"2024-09-10T23:20:42.121862+0000","last_fullsized":"2024-09-10T23:20:42.121862+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:14.862045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422274+0000","last_change":"2024-09-10T23:20:41.133436+0000","last_active":"2024-09-10T23:20:42.422274+0000","last_peered":"2024-09-10T23:20:42.422274+0000","last_clean":"2024-09-10T23:20:42.422274+0000","last_became_active":"2024-09-10T23:20:41.133122+0000","last_became_peered":"2024-09-10T23:20:41.133122+0000","last_unstale":"2024-09-10T23:20:42.422274+0000","last_undegraded":"2024-09-10T23:20:42.422274+0000","last_fullsized":"2024-09-10T23:20:42.422274+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:06.508857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121956+0000","last_change":"2024-09-10T23:20:40.135323+0000","last_active":"2024-09-10T23:20:42.121956+0000","last_peered":"2024-09-10T23:20:42.121956+0000","last_clean":"2024-09-10T23:20:42.121956+0000","last_became_active":"2024-09-10T23:20:40.135063+0000","last_became_peered":"2024-09-10T23:20:40.135063+0000","last_unstale":"2024-09-10T23:20:42.121956+0000","last_undegraded":"2024-09-10T23:20:42.121956+0000","last_fullsized":"2024-09-10T23:20:42.121956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:25.570883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423018+0000","last_change":"2024-09-10T23:20:41.137303+0000","last_active":"2024-09-10T23:20:42.423018+0000","last_peered":"2024-09-10T23:20:42.423018+0000","last_clean":"2024-09-10T23:20:42.423018+0000","last_became_active":"2024-09-10T23:20:41.136896+0000","last_became_peered":"2024-09-10T23:20:41.136896+0000","last_unstale":"2024-09-10T23:20:42.423018+0000","last_undegraded":"2024-09-10T23:20:42.423018+0000","last_fullsized":"2024-09-10T23:20:42.423018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:29.649638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422339+0000","last_change":"2024-09-10T23:20:40.123991+0000","last_active":"2024-09-10T23:20:42.422339+0000","last_peered":"2024-09-10T23:20:42.422339+0000","last_clean":"2024-09-10T23:20:42.422339+0000","last_became_active":"2024-09-10T23:20:40.123692+0000","last_became_peered":"2024-09-10T23:20:40.123692+0000","last_unstale":"2024-09-10T23:20:42.422339+0000","last_undegraded":"2024-09-10T23:20:42.422339+0000","last_fullsized":"2024-09-10T23:20:42.422339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:11.568207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129288+0000","last_change":"2024-09-10T23:20:41.140072+0000","last_active":"2024-09-10T23:20:42.129288+0000","last_peered":"2024-09-10T23:20:42.129288+0000","last_clean":"2024-09-10T23:20:42.129288+0000","last_became_active":"2024-09-10T23:20:41.139825+0000","last_became_peered":"2024-09-10T23:20:41.139825+0000","last_unstale":"2024-09-10T23:20:42.129288+0000","last_undegraded":"2024-09-10T23:20:42.129288+0000","last_fullsized":"2024-09-10T23:20:42.129288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:58.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422432+0000","last_change":"2024-09-10T23:20:40.123371+0000","last_active":"2024-09-10T23:20:42.422432+0000","last_peered":"2024-09-10T23:20:42.422432+0000","last_clean":"2024-09-10T23:20:42.422432+0000","last_became_active":"2024-09-10T23:20:40.123098+0000","last_became_peered":"2024-09-10T23:20:40.123098+0000","last_unstale":"2024-09-10T23:20:42.422432+0000","last_undegraded":"2024-09-10T23:20:42.422432+0000","last_fullsized":"2024-09-10T23:20:42.422432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:27.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129562+0000","last_change":"2024-09-10T23:20:41.138064+0000","last_active":"2024-09-10T23:20:42.129562+0000","last_peered":"2024-09-10T23:20:42.129562+0000","last_clean":"2024-09-10T23:20:42.129562+0000","last_became_active":"2024-09-10T23:20:41.137800+0000","last_became_peered":"2024-09-10T23:20:41.137800+0000","last_unstale":"2024-09-10T23:20:42.129562+0000","last_undegraded":"2024-09-10T23:20:42.129562+0000","last_fullsized":"2024-09-10T23:20:42.129562+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:33.088919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422511+0000","last_change":"2024-09-10T23:20:40.127892+0000","last_active":"2024-09-10T23:20:42.422511+0000","last_peered":"2024-09-10T23:20:42.422511+0000","last_clean":"2024-09-10T23:20:42.422511+0000","last_became_active":"2024-09-10T23:20:40.127610+0000","last_became_peered":"2024-09-10T23:20:40.127610+0000","last_unstale":"2024-09-10T23:20:42.422511+0000","last_undegraded":"2024-09-10T23:20:42.422511+0000","last_fullsized":"2024-09-10T23:20:42.422511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:16.765572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423105+0000","last_change":"2024-09-10T23:20:41.134276+0000","last_active":"2024-09-10T23:20:42.423105+0000","last_peered":"2024-09-10T23:20:42.423105+0000","last_clean":"2024-09-10T23:20:42.423105+0000","last_became_active":"2024-09-10T23:20:41.133731+0000","last_became_peered":"2024-09-10T23:20:41.133731+0000","last_unstale":"2024-09-10T23:20:42.423105+0000","last_undegraded":"2024-09-10T23:20:42.423105+0000","last_fullsized":"2024-09-10T23:20:42.423105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129037+0000","last_change":"2024-09-10T23:20:40.119841+0000","last_active":"2024-09-10T23:20:42.129037+0000","last_peered":"2024-09-10T23:20:42.129037+0000","last_clean":"2024-09-10T23:20:42.129037+0000","last_became_active":"2024-09-10T23:20:40.119554+0000","last_became_peered":"2024-09-10T23:20:40.119554+0000","last_unstale":"2024-09-10T23:20:42.129037+0000","last_undegraded":"2024-09-10T23:20:42.129037+0000","last_fullsized":"2024-09-10T23:20:42.129037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:25.570883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423451+0000","last_change":"2024-09-10T23:20:41.131356+0000","last_active":"2024-09-10T23:20:42.423451+0000","last_peered":"2024-09-10T23:20:42.423451+0000","last_clean":"2024-09-10T23:20:42.423451+0000","last_became_active":"2024-09-10T23:20:41.131112+0000","last_became_peered":"2024-09-10T23:20:41.131112+0000","last_unstale":"2024-09-10T23:20:42.423451+0000","last_undegraded":"2024-09-10T23:20:42.423451+0000","last_fullsized":"2024-09-10T23:20:42.423451+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:43.991032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132801+0000","last_change":"2024-09-10T23:20:40.124214+0000","last_active":"2024-09-10T23:20:42.132801+0000","last_peered":"2024-09-10T23:20:42.132801+0000","last_clean":"2024-09-10T23:20:42.132801+0000","last_became_active":"2024-09-10T23:20:40.120446+0000","last_became_peered":"2024-09-10T23:20:40.120446+0000","last_unstale":"2024-09-10T23:20:42.132801+0000","last_undegraded":"2024-09-10T23:20:42.132801+0000","last_fullsized":"2024-09-10T23:20:42.132801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:17.327476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.128806+0000","last_change":"2024-09-10T23:20:41.129342+0000","last_active":"2024-09-10T23:20:42.128806+0000","last_peered":"2024-09-10T23:20:42.128806+0000","last_clean":"2024-09-10T23:20:42.128806+0000","last_became_active":"2024-09-10T23:20:41.122527+0000","last_became_peered":"2024-09-10T23:20:41.122527+0000","last_unstale":"2024-09-10T23:20:42.128806+0000","last_undegraded":"2024-09-10T23:20:42.128806+0000","last_fullsized":"2024-09-10T23:20:42.128806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:55.182173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121742+0000","last_change":"2024-09-10T23:20:40.131592+0000","last_active":"2024-09-10T23:20:42.121742+0000","last_peered":"2024-09-10T23:20:42.121742+0000","last_clean":"2024-09-10T23:20:42.121742+0000","last_became_active":"2024-09-10T23:20:40.131327+0000","last_became_peered":"2024-09-10T23:20:40.131327+0000","last_unstale":"2024-09-10T23:20:42.121742+0000","last_undegraded":"2024-09-10T23:20:42.121742+0000","last_fullsized":"2024-09-10T23:20:42.121742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:07.622979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422764+0000","last_change":"2024-09-10T23:20:41.131671+0000","last_active":"2024-09-10T23:20:42.422764+0000","last_peered":"2024-09-10T23:20:42.422764+0000","last_clean":"2024-09-10T23:20:42.422764+0000","last_became_active":"2024-09-10T23:20:41.131354+0000","last_became_peered":"2024-09-10T23:20:41.131354+0000","last_unstale":"2024-09-10T23:20:42.422764+0000","last_undegraded":"2024-09-10T23:20:42.422764+0000","last_fullsized":"2024-09-10T23:20:42.422764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:49.205216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423448+0000","last_change":"2024-09-10T23:20:40.128083+0000","last_active":"2024-09-10T23:20:42.423448+0000","last_peered":"2024-09-10T23:20:42.423448+0000","last_clean":"2024-09-10T23:20:42.423448+0000","last_became_active":"2024-09-10T23:20:40.127555+0000","last_became_peered":"2024-09-10T23:20:40.127555+0000","last_unstale":"2024-09-10T23:20:42.423448+0000","last_undegraded":"2024-09-10T23:20:42.423448+0000","last_fullsized":"2024-09-10T23:20:42.423448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:12.468324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118875+0000","last_change":"2024-09-10T23:20:41.122664+0000","last_active":"2024-09-10T23:20:42.118875+0000","last_peered":"2024-09-10T23:20:42.118875+0000","last_clean":"2024-09-10T23:20:42.118875+0000","last_became_active":"2024-09-10T23:20:41.122359+0000","last_became_peered":"2024-09-10T23:20:41.122359+0000","last_unstale":"2024-09-10T23:20:42.118875+0000","last_undegraded":"2024-09-10T23:20:42.118875+0000","last_fullsized":"2024-09-10T23:20:42.118875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:04.020060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133502+0000","last_change":"2024-09-10T23:20:40.129170+0000","last_active":"2024-09-10T23:20:42.133502+0000","last_peered":"2024-09-10T23:20:42.133502+0000","last_clean":"2024-09-10T23:20:42.133502+0000","last_became_active":"2024-09-10T23:20:40.128901+0000","last_became_peered":"2024-09-10T23:20:40.128901+0000","last_unstale":"2024-09-10T23:20:42.133502+0000","last_undegraded":"2024-09-10T23:20:42.133502+0000","last_fullsized":"2024-09-10T23:20:42.133502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:13.249957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419533+0000","last_change":"2024-09-10T23:20:41.145225+0000","last_active":"2024-09-10T23:20:42.419533+0000","last_peered":"2024-09-10T23:20:42.419533+0000","last_clean":"2024-09-10T23:20:42.419533+0000","last_became_active":"2024-09-10T23:20:41.142773+0000","last_became_peered":"2024-09-10T23:20:41.142773+0000","last_unstale":"2024-09-10T23:20:42.419533+0000","last_undegraded":"2024-09-10T23:20:42.419533+0000","last_fullsized":"2024-09-10T23:20:42.419533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:02.960726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"86'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422455+0000","last_change":"2024-09-10T23:20:40.129709+0000","last_active":"2024-09-10T23:20:42.422455+0000","last_peered":"2024-09-10T23:20:42.422455+0000","last_clean":"2024-09-10T23:20:42.422455+0000","last_became_active":"2024-09-10T23:20:40.128128+0000","last_became_peered":"2024-09-10T23:20:40.128128+0000","last_unstale":"2024-09-10T23:20:42.422455+0000","last_undegraded":"2024-09-10T23:20:42.422455+0000","last_fullsized":"2024-09-10T23:20:42.422455+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:31.178729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422742+0000","last_change":"2024-09-10T23:20:41.137940+0000","last_active":"2024-09-10T23:20:42.422742+0000","last_peered":"2024-09-10T23:20:42.422742+0000","last_clean":"2024-09-10T23:20:42.422742+0000","last_became_active":"2024-09-10T23:20:41.137675+0000","last_became_peered":"2024-09-10T23:20:41.137675+0000","last_unstale":"2024-09-10T23:20:42.422742+0000","last_undegraded":"2024-09-10T23:20:42.422742+0000","last_fullsized":"2024-09-10T23:20:42.422742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:15.667362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.421906+0000","last_change":"2024-09-10T23:20:40.128787+0000","last_active":"2024-09-10T23:20:42.421906+0000","last_peered":"2024-09-10T23:20:42.421906+0000","last_clean":"2024-09-10T23:20:42.421906+0000","last_became_active":"2024-09-10T23:20:40.128517+0000","last_became_peered":"2024-09-10T23:20:40.128517+0000","last_unstale":"2024-09-10T23:20:42.421906+0000","last_undegraded":"2024-09-10T23:20:42.421906+0000","last_fullsized":"2024-09-10T23:20:42.421906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:49.618430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422085+0000","last_change":"2024-09-10T23:20:41.125926+0000","last_active":"2024-09-10T23:20:42.422085+0000","last_peered":"2024-09-10T23:20:42.422085+0000","last_clean":"2024-09-10T23:20:42.422085+0000","last_became_active":"2024-09-10T23:20:41.125634+0000","last_became_peered":"2024-09-10T23:20:41.125634+0000","last_unstale":"2024-09-10T23:20:42.422085+0000","last_undegraded":"2024-09-10T23:20:42.422085+0000","last_fullsized":"2024-09-10T23:20:42.422085+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:23.525965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121520+0000","last_change":"2024-09-10T23:20:40.131376+0000","last_active":"2024-09-10T23:20:42.121520+0000","last_peered":"2024-09-10T23:20:42.121520+0000","last_clean":"2024-09-10T23:20:42.121520+0000","last_became_active":"2024-09-10T23:20:40.131048+0000","last_became_peered":"2024-09-10T23:20:40.131048+0000","last_unstale":"2024-09-10T23:20:42.121520+0000","last_undegraded":"2024-09-10T23:20:42.121520+0000","last_fullsized":"2024-09-10T23:20:42.121520+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:34.635861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422855+0000","last_change":"2024-09-10T23:20:41.120364+0000","last_active":"2024-09-10T23:20:42.422855+0000","last_peered":"2024-09-10T23:20:42.422855+0000","last_clean":"2024-09-10T23:20:42.422855+0000","last_became_active":"2024-09-10T23:20:41.120112+0000","last_became_peered":"2024-09-10T23:20:41.120112+0000","last_unstale":"2024-09-10T23:20:42.422855+0000","last_undegraded":"2024-09-10T23:20:42.422855+0000","last_fullsized":"2024-09-10T23:20:42.422855+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:34.467025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133119+0000","last_change":"2024-09-10T23:20:40.130101+0000","last_active":"2024-09-10T23:20:42.133119+0000","last_peered":"2024-09-10T23:20:42.133119+0000","last_clean":"2024-09-10T23:20:42.133119+0000","last_became_active":"2024-09-10T23:20:40.129612+0000","last_became_peered":"2024-09-10T23:20:40.129612+0000","last_unstale":"2024-09-10T23:20:42.133119+0000","last_undegraded":"2024-09-10T23:20:42.133119+0000","last_fullsized":"2024-09-10T23:20:42.133119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:27.636253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422959+0000","last_change":"2024-09-10T23:20:41.128895+0000","last_active":"2024-09-10T23:20:42.422959+0000","last_peered":"2024-09-10T23:20:42.422959+0000","last_clean":"2024-09-10T23:20:42.422959+0000","last_became_active":"2024-09-10T23:20:41.126170+0000","last_became_peered":"2024-09-10T23:20:41.126170+0000","last_unstale":"2024-09-10T23:20:42.422959+0000","last_undegraded":"2024-09-10T23:20:42.422959+0000","last_fullsized":"2024-09-10T23:20:42.422959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:48.996362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"86'8","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129003+0000","last_change":"2024-09-10T23:20:40.124184+0000","last_active":"2024-09-10T23:20:42.129003+0000","last_peered":"2024-09-10T23:20:42.129003+0000","last_clean":"2024-09-10T23:20:42.129003+0000","last_became_active":"2024-09-10T23:20:40.123915+0000","last_became_peered":"2024-09-10T23:20:40.123915+0000","last_unstale":"2024-09-10T23:20:42.129003+0000","last_undegraded":"2024-09-10T23:20:42.129003+0000","last_fullsized":"2024-09-10T23:20:42.129003+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:14.862045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118297+0000","last_change":"2024-09-10T23:20:41.115069+0000","last_active":"2024-09-10T23:20:42.118297+0000","last_peered":"2024-09-10T23:20:42.118297+0000","last_clean":"2024-09-10T23:20:42.118297+0000","last_became_active":"2024-09-10T23:20:41.114657+0000","last_became_peered":"2024-09-10T23:20:41.114657+0000","last_unstale":"2024-09-10T23:20:42.118297+0000","last_undegraded":"2024-09-10T23:20:42.118297+0000","last_fullsized":"2024-09-10T23:20:42.118297+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:21.933582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121843+0000","last_change":"2024-09-10T23:20:40.131437+0000","last_active":"2024-09-10T23:20:42.121843+0000","last_peered":"2024-09-10T23:20:42.121843+0000","last_clean":"2024-09-10T23:20:42.121843+0000","last_became_active":"2024-09-10T23:20:40.131158+0000","last_became_peered":"2024-09-10T23:20:40.131158+0000","last_unstale":"2024-09-10T23:20:42.121843+0000","last_undegraded":"2024-09-10T23:20:42.121843+0000","last_fullsized":"2024-09-10T23:20:42.121843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:48.535403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132911+0000","last_change":"2024-09-10T23:20:41.120937+0000","last_active":"2024-09-10T23:20:42.132911+0000","last_peered":"2024-09-10T23:20:42.132911+0000","last_clean":"2024-09-10T23:20:42.132911+0000","last_became_active":"2024-09-10T23:20:41.120297+0000","last_became_peered":"2024-09-10T23:20:41.120297+0000","last_unstale":"2024-09-10T23:20:42.132911+0000","last_undegraded":"2024-09-10T23:20:42.132911+0000","last_fullsized":"2024-09-10T23:20:42.132911+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:42.107117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423079+0000","last_change":"2024-09-10T23:20:40.124220+0000","last_active":"2024-09-10T23:20:42.423079+0000","last_peered":"2024-09-10T23:20:42.423079+0000","last_clean":"2024-09-10T23:20:42.423079+0000","last_became_active":"2024-09-10T23:20:40.123970+0000","last_became_peered":"2024-09-10T23:20:40.123970+0000","last_unstale":"2024-09-10T23:20:42.423079+0000","last_undegraded":"2024-09-10T23:20:42.423079+0000","last_fullsized":"2024-09-10T23:20:42.423079+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:47.318397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132922+0000","last_change":"2024-09-10T23:20:41.129093+0000","last_active":"2024-09-10T23:20:42.132922+0000","last_peered":"2024-09-10T23:20:42.132922+0000","last_clean":"2024-09-10T23:20:42.132922+0000","last_became_active":"2024-09-10T23:20:41.128838+0000","last_became_peered":"2024-09-10T23:20:41.128838+0000","last_unstale":"2024-09-10T23:20:42.132922+0000","last_undegraded":"2024-09-10T23:20:42.132922+0000","last_fullsized":"2024-09-10T23:20:42.132922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:34.937829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133551+0000","last_change":"2024-09-10T23:20:40.125679+0000","last_active":"2024-09-10T23:20:42.133551+0000","last_peered":"2024-09-10T23:20:42.133551+0000","last_clean":"2024-09-10T23:20:42.133551+0000","last_became_active":"2024-09-10T23:20:40.125337+0000","last_became_peered":"2024-09-10T23:20:40.125337+0000","last_unstale":"2024-09-10T23:20:42.133551+0000","last_undegraded":"2024-09-10T23:20:42.133551+0000","last_fullsized":"2024-09-10T23:20:42.133551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:34.870733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118656+0000","last_change":"2024-09-10T23:20:41.123472+0000","last_active":"2024-09-10T23:20:42.118656+0000","last_peered":"2024-09-10T23:20:42.118656+0000","last_clean":"2024-09-10T23:20:42.118656+0000","last_became_active":"2024-09-10T23:20:41.123196+0000","last_became_peered":"2024-09-10T23:20:41.123196+0000","last_unstale":"2024-09-10T23:20:42.118656+0000","last_undegraded":"2024-09-10T23:20:42.118656+0000","last_fullsized":"2024-09-10T23:20:42.118656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:39.750457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419452+0000","last_change":"2024-09-10T23:20:40.128380+0000","last_active":"2024-09-10T23:20:42.419452+0000","last_peered":"2024-09-10T23:20:42.419452+0000","last_clean":"2024-09-10T23:20:42.419452+0000","last_became_active":"2024-09-10T23:20:40.128069+0000","last_became_peered":"2024-09-10T23:20:40.128069+0000","last_unstale":"2024-09-10T23:20:42.419452+0000","last_undegraded":"2024-09-10T23:20:42.419452+0000","last_fullsized":"2024-09-10T23:20:42.419452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:12.920715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129313+0000","last_change":"2024-09-10T23:20:41.132909+0000","last_active":"2024-09-10T23:20:42.129313+0000","last_peered":"2024-09-10T23:20:42.129313+0000","last_clean":"2024-09-10T23:20:42.129313+0000","last_became_active":"2024-09-10T23:20:41.132599+0000","last_became_peered":"2024-09-10T23:20:41.132599+0000","last_unstale":"2024-09-10T23:20:42.129313+0000","last_undegraded":"2024-09-10T23:20:42.129313+0000","last_fullsized":"2024-09-10T23:20:42.129313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:01.658526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118643+0000","last_change":"2024-09-10T23:20:40.122770+0000","last_active":"2024-09-10T23:20:42.118643+0000","last_peered":"2024-09-10T23:20:42.118643+0000","last_clean":"2024-09-10T23:20:42.118643+0000","last_became_active":"2024-09-10T23:20:40.122501+0000","last_became_peered":"2024-09-10T23:20:40.122501+0000","last_unstale":"2024-09-10T23:20:42.118643+0000","last_undegraded":"2024-09-10T23:20:42.118643+0000","last_fullsized":"2024-09-10T23:20:42.118643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:01.567448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.130378+0000","last_change":"2024-09-10T23:20:41.138681+0000","last_active":"2024-09-10T23:20:42.130378+0000","last_peered":"2024-09-10T23:20:42.130378+0000","last_clean":"2024-09-10T23:20:42.130378+0000","last_became_active":"2024-09-10T23:20:41.137670+0000","last_became_peered":"2024-09-10T23:20:41.137670+0000","last_unstale":"2024-09-10T23:20:42.130378+0000","last_undegraded":"2024-09-10T23:20:42.130378+0000","last_fullsized":"2024-09-10T23:20:42.130378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:57.041592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118288+0000","last_change":"2024-09-10T23:20:40.120678+0000","last_active":"2024-09-10T23:20:42.118288+0000","last_peered":"2024-09-10T23:20:42.118288+0000","last_clean":"2024-09-10T23:20:42.118288+0000","last_became_active":"2024-09-10T23:20:40.120368+0000","last_became_peered":"2024-09-10T23:20:40.120368+0000","last_unstale":"2024-09-10T23:20:42.118288+0000","last_undegraded":"2024-09-10T23:20:42.118288+0000","last_fullsized":"2024-09-10T23:20:42.118288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:15.092441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423202+0000","last_change":"2024-09-10T23:20:41.129524+0000","last_active":"2024-09-10T23:20:42.423202+0000","last_peered":"2024-09-10T23:20:42.423202+0000","last_clean":"2024-09-10T23:20:42.423202+0000","last_became_active":"2024-09-10T23:20:41.126551+0000","last_became_peered":"2024-09-10T23:20:41.126551+0000","last_unstale":"2024-09-10T23:20:42.423202+0000","last_undegraded":"2024-09-10T23:20:42.423202+0000","last_fullsized":"2024-09-10T23:20:42.423202+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:25.189262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118292+0000","last_change":"2024-09-10T23:20:40.126347+0000","last_active":"2024-09-10T23:20:42.118292+0000","last_peered":"2024-09-10T23:20:42.118292+0000","last_clean":"2024-09-10T23:20:42.118292+0000","last_became_active":"2024-09-10T23:20:40.126068+0000","last_became_peered":"2024-09-10T23:20:40.126068+0000","last_unstale":"2024-09-10T23:20:42.118292+0000","last_undegraded":"2024-09-10T23:20:42.118292+0000","last_fullsized":"2024-09-10T23:20:42.118292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:41.654200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422033+0000","last_change":"2024-09-10T23:20:41.124287+0000","last_active":"2024-09-10T23:20:42.422033+0000","last_peered":"2024-09-10T23:20:42.422033+0000","last_clean":"2024-09-10T23:20:42.422033+0000","last_became_active":"2024-09-10T23:20:41.124037+0000","last_became_peered":"2024-09-10T23:20:41.124037+0000","last_unstale":"2024-09-10T23:20:42.422033+0000","last_undegraded":"2024-09-10T23:20:42.422033+0000","last_fullsized":"2024-09-10T23:20:42.422033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:59.966232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423316+0000","last_change":"2024-09-10T23:20:40.129652+0000","last_active":"2024-09-10T23:20:42.423316+0000","last_peered":"2024-09-10T23:20:42.423316+0000","last_clean":"2024-09-10T23:20:42.423316+0000","last_became_active":"2024-09-10T23:20:40.129397+0000","last_became_peered":"2024-09-10T23:20:40.129397+0000","last_unstale":"2024-09-10T23:20:42.423316+0000","last_undegraded":"2024-09-10T23:20:42.423316+0000","last_fullsized":"2024-09-10T23:20:42.423316+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:10.871552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422991+0000","last_change":"2024-09-10T23:20:41.117473+0000","last_active":"2024-09-10T23:20:42.422991+0000","last_peered":"2024-09-10T23:20:42.422991+0000","last_clean":"2024-09-10T23:20:42.422991+0000","last_became_active":"2024-09-10T23:20:41.117123+0000","last_became_peered":"2024-09-10T23:20:41.117123+0000","last_unstale":"2024-09-10T23:20:42.422991+0000","last_undegraded":"2024-09-10T23:20:42.422991+0000","last_fullsized":"2024-09-10T23:20:42.422991+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:21.407973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"87'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.130483+0000","last_change":"2024-09-10T23:20:40.131528+0000","last_active":"2024-09-10T23:20:42.130483+0000","last_peered":"2024-09-10T23:20:42.130483+0000","last_clean":"2024-09-10T23:20:42.130483+0000","last_became_active":"2024-09-10T23:20:40.131200+0000","last_became_peered":"2024-09-10T23:20:40.131200+0000","last_unstale":"2024-09-10T23:20:42.130483+0000","last_undegraded":"2024-09-10T23:20:42.130483+0000","last_fullsized":"2024-09-10T23:20:42.130483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:34.635861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422497+0000","last_change":"2024-09-10T23:20:41.133333+0000","last_active":"2024-09-10T23:20:42.422497+0000","last_peered":"2024-09-10T23:20:42.422497+0000","last_clean":"2024-09-10T23:20:42.422497+0000","last_became_active":"2024-09-10T23:20:41.132604+0000","last_became_peered":"2024-09-10T23:20:41.132604+0000","last_unstale":"2024-09-10T23:20:42.422497+0000","last_undegraded":"2024-09-10T23:20:42.422497+0000","last_fullsized":"2024-09-10T23:20:42.422497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:57.954331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.122163+0000","last_change":"2024-09-10T23:20:40.128507+0000","last_active":"2024-09-10T23:20:42.122163+0000","last_peered":"2024-09-10T23:20:42.122163+0000","last_clean":"2024-09-10T23:20:42.122163+0000","last_became_active":"2024-09-10T23:20:40.128235+0000","last_became_peered":"2024-09-10T23:20:40.128235+0000","last_unstale":"2024-09-10T23:20:42.122163+0000","last_undegraded":"2024-09-10T23:20:42.122163+0000","last_fullsized":"2024-09-10T23:20:42.122163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:20.407427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129338+0000","last_change":"2024-09-10T23:20:41.122842+0000","last_active":"2024-09-10T23:20:42.129338+0000","last_peered":"2024-09-10T23:20:42.129338+0000","last_clean":"2024-09-10T23:20:42.129338+0000","last_became_active":"2024-09-10T23:20:41.122539+0000","last_became_peered":"2024-09-10T23:20:41.122539+0000","last_unstale":"2024-09-10T23:20:42.129338+0000","last_undegraded":"2024-09-10T23:20:42.129338+0000","last_fullsized":"2024-09-10T23:20:42.129338+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:45.761030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121585+0000","last_change":"2024-09-10T23:20:40.132298+0000","last_active":"2024-09-10T23:20:42.121585+0000","last_peered":"2024-09-10T23:20:42.121585+0000","last_clean":"2024-09-10T23:20:42.121585+0000","last_became_active":"2024-09-10T23:20:40.132054+0000","last_became_peered":"2024-09-10T23:20:40.132054+0000","last_unstale":"2024-09-10T23:20:42.121585+0000","last_undegraded":"2024-09-10T23:20:42.121585+0000","last_fullsized":"2024-09-10T23:20:42.121585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:16.765572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422172+0000","last_change":"2024-09-10T23:20:41.128546+0000","last_active":"2024-09-10T23:20:42.422172+0000","last_peered":"2024-09-10T23:20:42.422172+0000","last_clean":"2024-09-10T23:20:42.422172+0000","last_became_active":"2024-09-10T23:20:41.126264+0000","last_became_peered":"2024-09-10T23:20:41.126264+0000","last_unstale":"2024-09-10T23:20:42.422172+0000","last_undegraded":"2024-09-10T23:20:42.422172+0000","last_fullsized":"2024-09-10T23:20:42.422172+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:13.529827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422562+0000","last_change":"2024-09-10T23:20:40.124599+0000","last_active":"2024-09-10T23:20:42.422562+0000","last_peered":"2024-09-10T23:20:42.422562+0000","last_clean":"2024-09-10T23:20:42.422562+0000","last_became_active":"2024-09-10T23:20:40.124357+0000","last_became_peered":"2024-09-10T23:20:40.124357+0000","last_unstale":"2024-09-10T23:20:42.422562+0000","last_undegraded":"2024-09-10T23:20:42.422562+0000","last_fullsized":"2024-09-10T23:20:42.422562+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:58.899986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422327+0000","last_change":"2024-09-10T23:20:41.125253+0000","last_active":"2024-09-10T23:20:42.422327+0000","last_peered":"2024-09-10T23:20:42.422327+0000","last_clean":"2024-09-10T23:20:42.422327+0000","last_became_active":"2024-09-10T23:20:41.124980+0000","last_became_peered":"2024-09-10T23:20:41.124980+0000","last_unstale":"2024-09-10T23:20:42.422327+0000","last_undegraded":"2024-09-10T23:20:42.422327+0000","last_fullsized":"2024-09-10T23:20:42.422327+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:22.773162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133074+0000","last_change":"2024-09-10T23:20:40.127513+0000","last_active":"2024-09-10T23:20:42.133074+0000","last_peered":"2024-09-10T23:20:42.133074+0000","last_clean":"2024-09-10T23:20:42.133074+0000","last_became_active":"2024-09-10T23:20:40.127217+0000","last_became_peered":"2024-09-10T23:20:40.127217+0000","last_unstale":"2024-09-10T23:20:42.133074+0000","last_undegraded":"2024-09-10T23:20:42.133074+0000","last_fullsized":"2024-09-10T23:20:42.133074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:17.351784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419786+0000","last_change":"2024-09-10T23:20:41.146712+0000","last_active":"2024-09-10T23:20:42.419786+0000","last_peered":"2024-09-10T23:20:42.419786+0000","last_clean":"2024-09-10T23:20:42.419786+0000","last_became_active":"2024-09-10T23:20:41.146538+0000","last_became_peered":"2024-09-10T23:20:41.146538+0000","last_unstale":"2024-09-10T23:20:42.419786+0000","last_undegraded":"2024-09-10T23:20:42.419786+0000","last_fullsized":"2024-09-10T23:20:42.419786+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:56.905164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423230+0000","last_change":"2024-09-10T23:20:40.127031+0000","last_active":"2024-09-10T23:20:42.423230+0000","last_peered":"2024-09-10T23:20:42.423230+0000","last_clean":"2024-09-10T23:20:42.423230+0000","last_became_active":"2024-09-10T23:20:40.126712+0000","last_became_peered":"2024-09-10T23:20:40.126712+0000","last_unstale":"2024-09-10T23:20:42.423230+0000","last_undegraded":"2024-09-10T23:20:42.423230+0000","last_fullsized":"2024-09-10T23:20:42.423230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:21.158468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419813+0000","last_change":"2024-09-10T23:20:41.132392+0000","last_active":"2024-09-10T23:20:42.419813+0000","last_peered":"2024-09-10T23:20:42.419813+0000","last_clean":"2024-09-10T23:20:42.419813+0000","last_became_active":"2024-09-10T23:20:41.132013+0000","last_became_peered":"2024-09-10T23:20:41.132013+0000","last_unstale":"2024-09-10T23:20:42.419813+0000","last_undegraded":"2024-09-10T23:20:42.419813+0000","last_fullsized":"2024-09-10T23:20:42.419813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:51.356097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419306+0000","last_change":"2024-09-10T23:20:40.120127+0000","last_active":"2024-09-10T23:20:42.419306+0000","last_peered":"2024-09-10T23:20:42.419306+0000","last_clean":"2024-09-10T23:20:42.419306+0000","last_became_active":"2024-09-10T23:20:40.117614+0000","last_became_peered":"2024-09-10T23:20:40.117614+0000","last_unstale":"2024-09-10T23:20:42.419306+0000","last_undegraded":"2024-09-10T23:20:42.419306+0000","last_fullsized":"2024-09-10T23:20:42.419306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:21.158468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.122103+0000","last_change":"2024-09-10T23:20:41.136706+0000","last_active":"2024-09-10T23:20:42.122103+0000","last_peered":"2024-09-10T23:20:42.122103+0000","last_clean":"2024-09-10T23:20:42.122103+0000","last_became_active":"2024-09-10T23:20:41.136400+0000","last_became_peered":"2024-09-10T23:20:41.136400+0000","last_unstale":"2024-09-10T23:20:42.122103+0000","last_undegraded":"2024-09-10T23:20:42.122103+0000","last_fullsized":"2024-09-10T23:20:42.122103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:03.361028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118969+0000","last_change":"2024-09-10T23:20:40.118820+0000","last_active":"2024-09-10T23:20:42.118969+0000","last_peered":"2024-09-10T23:20:42.118969+0000","last_clean":"2024-09-10T23:20:42.118969+0000","last_became_active":"2024-09-10T23:20:40.118517+0000","last_became_peered":"2024-09-10T23:20:40.118517+0000","last_unstale":"2024-09-10T23:20:42.118969+0000","last_undegraded":"2024-09-10T23:20:42.118969+0000","last_fullsized":"2024-09-10T23:20:42.118969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:36.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":227,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121434+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:20:42.121434+0000","last_peered":"2024-09-10T23:20:42.121434+0000","last_clean":"2024-09-10T23:20:42.121434+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:20:42.121434+0000","last_undegraded":"2024-09-10T23:20:42.121434+0000","last_fullsized":"2024-09-10T23:20:42.121434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476803,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40552,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331288,"statfs":{"total":96636764160,"available":96595238912,"internally_reserved":0,"allocated":1069056,"data_stored":488088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50852,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320988,"statfs":{"total":96636764160,"available":96584691712,"internally_reserved":0,"allocated":1654784,"data_stored":1076866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40552,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331288,"statfs":{"total":96636764160,"available":96595238912,"internally_reserved":0,"allocated":1060864,"data_stored":486510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46132,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325708,"statfs":{"total":96636764160,"available":96589524992,"internally_reserved":0,"allocated":1077248,"data_stored":488192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509507,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1069056,"data_stored":487218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40556,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331284,"statfs":{"total":96636764160,"available":96595234816,"internally_reserved":0,"allocated":1064960,"data_stored":486588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55008,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316832,"statfs":{"total":96636764160,"available":96580435968,"internally_reserved":0,"allocated":1650688,"data_stored":1076844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50272,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321568,"statfs":{"total":96636764160,"available":96585285632,"internally_reserved":0,"allocated":1060864,"data_stored":487058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:20:49.901 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:20:50.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.053+0000 7fb1b9400640 1 -- 172.21.15.17:0/1833805146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b406df30 msgr2=0x7fb1b40cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.053+0000 7fb1b9400640 1 --2- 172.21.15.17:0/1833805146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b406df30 0x7fb1b40cfc60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4070870 tx=0x7fb1a401c770 comp rx=0 tx=0).stop 2024-09-10T23:20:50.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.053+0000 7fb1b9400640 1 -- 172.21.15.17:0/1833805146 shutdown_connections 2024-09-10T23:20:50.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.053+0000 7fb1b9400640 1 --2- 172.21.15.17:0/1833805146 >> v2:172.21.15.77:3300/0 conn(0x7fb1b415f060 0x7fb1b415f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.053+0000 7fb1b9400640 1 --2- 172.21.15.17:0/1833805146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b406df30 0x7fb1b40cfc60 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.053+0000 7fb1b9400640 1 -- 172.21.15.17:0/1833805146 >> 172.21.15.17:0/1833805146 conn(0x7fb1b40d1d60 msgr2=0x7fb1b40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:50.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 -- 172.21.15.17:0/1833805146 shutdown_connections 2024-09-10T23:20:50.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 -- 172.21.15.17:0/1833805146 wait complete. 2024-09-10T23:20:50.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 Processor -- start 2024-09-10T23:20:50.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 -- start start 2024-09-10T23:20:50.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1b406df30 0x7fb1b409f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b415f060 0x7fb1b40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b4161040 0x7fb1b40c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b416ae50 con 0x7fb1b415f060 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b406ef20 con 0x7fb1b4161040 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b9400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b416afd0 con 0x7fb1b406df30 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b415f060 0x7fb1b40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b2800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1b406df30 0x7fb1b409f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b415f060 0x7fb1b40c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47296/0 (socket says 172.21.15.17:47296) 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1abe00640 1 -- 172.21.15.17:0/1840971121 learned_addr learned my addr 172.21.15.17:0/1840971121 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b3200640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b4161040 0x7fb1b40c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1abe00640 1 -- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1b406df30 msgr2=0x7fb1b409f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1abe00640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1b406df30 0x7fb1b409f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1abe00640 1 -- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b4161040 msgr2=0x7fb1b40c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1abe00640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b4161040 0x7fb1b40c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1abe00640 1 -- 172.21.15.17:0/1840971121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b409c1e0 con 0x7fb1b415f060 2024-09-10T23:20:50.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1b2800640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1b406df30 0x7fb1b409f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:50.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.057+0000 7fb1abe00640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b415f060 0x7fb1b40c6d00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00e940 tx=0x7fb19c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:50.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.061+0000 7fb1aaa00640 1 -- 172.21.15.17:0/1840971121 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00cd80 con 0x7fb1b415f060 2024-09-10T23:20:50.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.061+0000 7fb1aaa00640 1 -- 172.21.15.17:0/1840971121 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb19c005020 con 0x7fb1b415f060 2024-09-10T23:20:50.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.061+0000 7fb1aaa00640 1 -- 172.21.15.17:0/1840971121 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c005450 con 0x7fb1b415f060 2024-09-10T23:20:50.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.061+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b409e5e0 con 0x7fb1b415f060 2024-09-10T23:20:50.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.061+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b409eba0 con 0x7fb1b415f060 2024-09-10T23:20:50.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.061+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b40cfc60 con 0x7fb1b415f060 2024-09-10T23:20:50.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.061+0000 7fb1aaa00640 1 -- 172.21.15.17:0/1840971121 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb19c0047b0 con 0x7fb1b415f060 2024-09-10T23:20:50.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.061+0000 7fb1aaa00640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1900725e0 0x7fb190074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.061+0000 7fb1aaa00640 1 -- 172.21.15.17:0/1840971121 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fb19c093e00 con 0x7fb1b415f060 2024-09-10T23:20:50.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.065+0000 7fb1b2800640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1900725e0 0x7fb190074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.065+0000 7fb1b2800640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1900725e0 0x7fb190074aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40af000 tx=0x7fb1a401afb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:50.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.065+0000 7fb1aaa00640 1 -- 172.21.15.17:0/1840971121 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb19c05ecf0 con 0x7fb1b415f060 2024-09-10T23:20:50.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.237+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1b4069e10 con 0x7fb1900725e0 2024-09-10T23:20:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.241+0000 7fb1aaa00640 1 -- 172.21.15.17:0/1840971121 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252062 (secure 0 0 0) 0x7fb1a40b3040 con 0x7fb1900725e0 2024-09-10T23:20:50.249 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:50.251 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:20:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1900725e0 msgr2=0x7fb190074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1900725e0 0x7fb190074aa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40af000 tx=0x7fb1a401afb0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b415f060 msgr2=0x7fb1b40c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b415f060 0x7fb1b40c6d00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00e940 tx=0x7fb19c00ee00 comp rx=0 tx=0).stop 2024-09-10T23:20:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 shutdown_connections 2024-09-10T23:20:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1900725e0 0x7fb190074aa0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b4161040 0x7fb1b40c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1b415f060 0x7fb1b40c6d00 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 --2- 172.21.15.17:0/1840971121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1b406df30 0x7fb1b409f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 >> 172.21.15.17:0/1840971121 conn(0x7fb1b40d1d60 msgr2=0x7fb1b4068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:50.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 shutdown_connections 2024-09-10T23:20:50.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.245+0000 7fb1b9400640 1 -- 172.21.15.17:0/1840971121 wait complete. 2024-09-10T23:20:50.270 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-09-10T23:20:48.368060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":351996,"kb_used_data":9480,"kb_used_omap":12,"kb_used_meta":342323,"kb_avail":754622724,"statfs":{"total":773094113280,"available":772733669376,"internally_reserved":0,"allocated":9707520,"data_stored":5077364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":350539313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002102"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121784+0000","last_change":"2024-09-10T23:20:41.131521+0000","last_active":"2024-09-10T23:20:42.121784+0000","last_peered":"2024-09-10T23:20:42.121784+0000","last_clean":"2024-09-10T23:20:42.121784+0000","last_became_active":"2024-09-10T23:20:41.131186+0000","last_became_peered":"2024-09-10T23:20:41.131186+0000","last_unstale":"2024-09-10T23:20:42.121784+0000","last_undegraded":"2024-09-10T23:20:42.121784+0000","last_fullsized":"2024-09-10T23:20:42.121784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:27.586513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.130402+0000","last_change":"2024-09-10T23:20:41.143979+0000","last_active":"2024-09-10T23:20:42.130402+0000","last_peered":"2024-09-10T23:20:42.130402+0000","last_clean":"2024-09-10T23:20:42.130402+0000","last_became_active":"2024-09-10T23:20:41.143710+0000","last_became_peered":"2024-09-10T23:20:41.143710+0000","last_unstale":"2024-09-10T23:20:42.130402+0000","last_undegraded":"2024-09-10T23:20:42.130402+0000","last_fullsized":"2024-09-10T23:20:42.130402+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:14.813604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419767+0000","last_change":"2024-09-10T23:20:41.141251+0000","last_active":"2024-09-10T23:20:42.419767+0000","last_peered":"2024-09-10T23:20:42.419767+0000","last_clean":"2024-09-10T23:20:42.419767+0000","last_became_active":"2024-09-10T23:20:41.140077+0000","last_became_peered":"2024-09-10T23:20:41.140077+0000","last_unstale":"2024-09-10T23:20:42.419767+0000","last_undegraded":"2024-09-10T23:20:42.419767+0000","last_fullsized":"2024-09-10T23:20:42.419767+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:39.337035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422279+0000","last_change":"2024-09-10T23:20:41.131402+0000","last_active":"2024-09-10T23:20:42.422279+0000","last_peered":"2024-09-10T23:20:42.422279+0000","last_clean":"2024-09-10T23:20:42.422279+0000","last_became_active":"2024-09-10T23:20:41.130302+0000","last_became_peered":"2024-09-10T23:20:41.130302+0000","last_unstale":"2024-09-10T23:20:42.422279+0000","last_undegraded":"2024-09-10T23:20:42.422279+0000","last_fullsized":"2024-09-10T23:20:42.422279+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:20.656932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133082+0000","last_change":"2024-09-10T23:20:41.120424+0000","last_active":"2024-09-10T23:20:42.133082+0000","last_peered":"2024-09-10T23:20:42.133082+0000","last_clean":"2024-09-10T23:20:42.133082+0000","last_became_active":"2024-09-10T23:20:41.120050+0000","last_became_peered":"2024-09-10T23:20:41.120050+0000","last_unstale":"2024-09-10T23:20:42.133082+0000","last_undegraded":"2024-09-10T23:20:42.133082+0000","last_fullsized":"2024-09-10T23:20:42.133082+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:09.136155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118568+0000","last_change":"2024-09-10T23:20:41.127078+0000","last_active":"2024-09-10T23:20:42.118568+0000","last_peered":"2024-09-10T23:20:42.118568+0000","last_clean":"2024-09-10T23:20:42.118568+0000","last_became_active":"2024-09-10T23:20:41.126523+0000","last_became_peered":"2024-09-10T23:20:41.126523+0000","last_unstale":"2024-09-10T23:20:42.118568+0000","last_undegraded":"2024-09-10T23:20:42.118568+0000","last_fullsized":"2024-09-10T23:20:42.118568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:13.361890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422887+0000","last_change":"2024-09-10T23:20:41.131788+0000","last_active":"2024-09-10T23:20:42.422887+0000","last_peered":"2024-09-10T23:20:42.422887+0000","last_clean":"2024-09-10T23:20:42.422887+0000","last_became_active":"2024-09-10T23:20:41.131510+0000","last_became_peered":"2024-09-10T23:20:41.131510+0000","last_unstale":"2024-09-10T23:20:42.422887+0000","last_undegraded":"2024-09-10T23:20:42.422887+0000","last_fullsized":"2024-09-10T23:20:42.422887+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:00.378438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132781+0000","last_change":"2024-09-10T23:20:41.117381+0000","last_active":"2024-09-10T23:20:42.132781+0000","last_peered":"2024-09-10T23:20:42.132781+0000","last_clean":"2024-09-10T23:20:42.132781+0000","last_became_active":"2024-09-10T23:20:41.117046+0000","last_became_peered":"2024-09-10T23:20:41.117046+0000","last_unstale":"2024-09-10T23:20:42.132781+0000","last_undegraded":"2024-09-10T23:20:42.132781+0000","last_fullsized":"2024-09-10T23:20:42.132781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:38.437065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423020+0000","last_change":"2024-09-10T23:20:41.132127+0000","last_active":"2024-09-10T23:20:42.423020+0000","last_peered":"2024-09-10T23:20:42.423020+0000","last_clean":"2024-09-10T23:20:42.423020+0000","last_became_active":"2024-09-10T23:20:41.131812+0000","last_became_peered":"2024-09-10T23:20:41.131812+0000","last_unstale":"2024-09-10T23:20:42.423020+0000","last_undegraded":"2024-09-10T23:20:42.423020+0000","last_fullsized":"2024-09-10T23:20:42.423020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:12.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423124+0000","last_change":"2024-09-10T23:20:41.127531+0000","last_active":"2024-09-10T23:20:42.423124+0000","last_peered":"2024-09-10T23:20:42.423124+0000","last_clean":"2024-09-10T23:20:42.423124+0000","last_became_active":"2024-09-10T23:20:41.127249+0000","last_became_peered":"2024-09-10T23:20:41.127249+0000","last_unstale":"2024-09-10T23:20:42.423124+0000","last_undegraded":"2024-09-10T23:20:42.423124+0000","last_fullsized":"2024-09-10T23:20:42.423124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:51.967335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129367+0000","last_change":"2024-09-10T23:20:41.141413+0000","last_active":"2024-09-10T23:20:42.129367+0000","last_peered":"2024-09-10T23:20:42.129367+0000","last_clean":"2024-09-10T23:20:42.129367+0000","last_became_active":"2024-09-10T23:20:41.141066+0000","last_became_peered":"2024-09-10T23:20:41.141066+0000","last_unstale":"2024-09-10T23:20:42.129367+0000","last_undegraded":"2024-09-10T23:20:42.129367+0000","last_fullsized":"2024-09-10T23:20:42.129367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:36.164871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422492+0000","last_change":"2024-09-10T23:20:41.149001+0000","last_active":"2024-09-10T23:20:42.422492+0000","last_peered":"2024-09-10T23:20:42.422492+0000","last_clean":"2024-09-10T23:20:42.422492+0000","last_became_active":"2024-09-10T23:20:41.148785+0000","last_became_peered":"2024-09-10T23:20:41.148785+0000","last_unstale":"2024-09-10T23:20:42.422492+0000","last_undegraded":"2024-09-10T23:20:42.422492+0000","last_fullsized":"2024-09-10T23:20:42.422492+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:36.156413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133092+0000","last_change":"2024-09-10T23:20:41.128905+0000","last_active":"2024-09-10T23:20:42.133092+0000","last_peered":"2024-09-10T23:20:42.133092+0000","last_clean":"2024-09-10T23:20:42.133092+0000","last_became_active":"2024-09-10T23:20:41.127689+0000","last_became_peered":"2024-09-10T23:20:41.127689+0000","last_unstale":"2024-09-10T23:20:42.133092+0000","last_undegraded":"2024-09-10T23:20:42.133092+0000","last_fullsized":"2024-09-10T23:20:42.133092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:18.842082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118828+0000","last_change":"2024-09-10T23:20:41.127354+0000","last_active":"2024-09-10T23:20:42.118828+0000","last_peered":"2024-09-10T23:20:42.118828+0000","last_clean":"2024-09-10T23:20:42.118828+0000","last_became_active":"2024-09-10T23:20:41.126817+0000","last_became_peered":"2024-09-10T23:20:41.126817+0000","last_unstale":"2024-09-10T23:20:42.118828+0000","last_undegraded":"2024-09-10T23:20:42.118828+0000","last_fullsized":"2024-09-10T23:20:42.118828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:29.475625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129189+0000","last_change":"2024-09-10T23:20:41.143274+0000","last_active":"2024-09-10T23:20:42.129189+0000","last_peered":"2024-09-10T23:20:42.129189+0000","last_clean":"2024-09-10T23:20:42.129189+0000","last_became_active":"2024-09-10T23:20:41.141364+0000","last_became_peered":"2024-09-10T23:20:41.141364+0000","last_unstale":"2024-09-10T23:20:42.129189+0000","last_undegraded":"2024-09-10T23:20:42.129189+0000","last_fullsized":"2024-09-10T23:20:42.129189+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:43.321922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121279+0000","last_change":"2024-09-10T23:20:41.126631+0000","last_active":"2024-09-10T23:20:42.121279+0000","last_peered":"2024-09-10T23:20:42.121279+0000","last_clean":"2024-09-10T23:20:42.121279+0000","last_became_active":"2024-09-10T23:20:41.126348+0000","last_became_peered":"2024-09-10T23:20:41.126348+0000","last_unstale":"2024-09-10T23:20:42.121279+0000","last_undegraded":"2024-09-10T23:20:42.121279+0000","last_fullsized":"2024-09-10T23:20:42.121279+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:24.886006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133521+0000","last_change":"2024-09-10T23:20:41.122602+0000","last_active":"2024-09-10T23:20:42.133521+0000","last_peered":"2024-09-10T23:20:42.133521+0000","last_clean":"2024-09-10T23:20:42.133521+0000","last_became_active":"2024-09-10T23:20:41.122309+0000","last_became_peered":"2024-09-10T23:20:41.122309+0000","last_unstale":"2024-09-10T23:20:42.133521+0000","last_undegraded":"2024-09-10T23:20:42.133521+0000","last_fullsized":"2024-09-10T23:20:42.133521+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:56.521411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419711+0000","last_change":"2024-09-10T23:20:41.131567+0000","last_active":"2024-09-10T23:20:42.419711+0000","last_peered":"2024-09-10T23:20:42.419711+0000","last_clean":"2024-09-10T23:20:42.419711+0000","last_became_active":"2024-09-10T23:20:41.131259+0000","last_became_peered":"2024-09-10T23:20:41.131259+0000","last_unstale":"2024-09-10T23:20:42.419711+0000","last_undegraded":"2024-09-10T23:20:42.419711+0000","last_fullsized":"2024-09-10T23:20:42.419711+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:01.986328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118830+0000","last_change":"2024-09-10T23:20:41.124255+0000","last_active":"2024-09-10T23:20:42.118830+0000","last_peered":"2024-09-10T23:20:42.118830+0000","last_clean":"2024-09-10T23:20:42.118830+0000","last_became_active":"2024-09-10T23:20:41.123986+0000","last_became_peered":"2024-09-10T23:20:41.123986+0000","last_unstale":"2024-09-10T23:20:42.118830+0000","last_undegraded":"2024-09-10T23:20:42.118830+0000","last_fullsized":"2024-09-10T23:20:42.118830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:28.015170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133267+0000","last_change":"2024-09-10T23:20:41.126283+0000","last_active":"2024-09-10T23:20:42.133267+0000","last_peered":"2024-09-10T23:20:42.133267+0000","last_clean":"2024-09-10T23:20:42.133267+0000","last_became_active":"2024-09-10T23:20:41.125597+0000","last_became_peered":"2024-09-10T23:20:41.125597+0000","last_unstale":"2024-09-10T23:20:42.133267+0000","last_undegraded":"2024-09-10T23:20:42.133267+0000","last_fullsized":"2024-09-10T23:20:42.133267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:38.165559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422205+0000","last_change":"2024-09-10T23:20:41.137511+0000","last_active":"2024-09-10T23:20:42.422205+0000","last_peered":"2024-09-10T23:20:42.422205+0000","last_clean":"2024-09-10T23:20:42.422205+0000","last_became_active":"2024-09-10T23:20:41.137040+0000","last_became_peered":"2024-09-10T23:20:41.137040+0000","last_unstale":"2024-09-10T23:20:42.422205+0000","last_undegraded":"2024-09-10T23:20:42.422205+0000","last_fullsized":"2024-09-10T23:20:42.422205+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:56.756478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132987+0000","last_change":"2024-09-10T23:20:41.128453+0000","last_active":"2024-09-10T23:20:42.132987+0000","last_peered":"2024-09-10T23:20:42.132987+0000","last_clean":"2024-09-10T23:20:42.132987+0000","last_became_active":"2024-09-10T23:20:41.127667+0000","last_became_peered":"2024-09-10T23:20:41.127667+0000","last_unstale":"2024-09-10T23:20:42.132987+0000","last_undegraded":"2024-09-10T23:20:42.132987+0000","last_fullsized":"2024-09-10T23:20:42.132987+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:28:40.577849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422251+0000","last_change":"2024-09-10T23:20:41.127751+0000","last_active":"2024-09-10T23:20:42.422251+0000","last_peered":"2024-09-10T23:20:42.422251+0000","last_clean":"2024-09-10T23:20:42.422251+0000","last_became_active":"2024-09-10T23:20:41.127457+0000","last_became_peered":"2024-09-10T23:20:41.127457+0000","last_unstale":"2024-09-10T23:20:42.422251+0000","last_undegraded":"2024-09-10T23:20:42.422251+0000","last_fullsized":"2024-09-10T23:20:42.422251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:07.981495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.128806+0000","last_change":"2024-09-10T23:20:41.137275+0000","last_active":"2024-09-10T23:20:42.128806+0000","last_peered":"2024-09-10T23:20:42.128806+0000","last_clean":"2024-09-10T23:20:42.128806+0000","last_became_active":"2024-09-10T23:20:41.136993+0000","last_became_peered":"2024-09-10T23:20:41.136993+0000","last_unstale":"2024-09-10T23:20:42.128806+0000","last_undegraded":"2024-09-10T23:20:42.128806+0000","last_fullsized":"2024-09-10T23:20:42.128806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:14.778658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.130149+0000","last_change":"2024-09-10T23:20:41.140913+0000","last_active":"2024-09-10T23:20:42.130149+0000","last_peered":"2024-09-10T23:20:42.130149+0000","last_clean":"2024-09-10T23:20:42.130149+0000","last_became_active":"2024-09-10T23:20:41.136763+0000","last_became_peered":"2024-09-10T23:20:41.136763+0000","last_unstale":"2024-09-10T23:20:42.130149+0000","last_undegraded":"2024-09-10T23:20:42.130149+0000","last_fullsized":"2024-09-10T23:20:42.130149+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:07.879705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423382+0000","last_change":"2024-09-10T23:20:41.148110+0000","last_active":"2024-09-10T23:20:42.423382+0000","last_peered":"2024-09-10T23:20:42.423382+0000","last_clean":"2024-09-10T23:20:42.423382+0000","last_became_active":"2024-09-10T23:20:41.147674+0000","last_became_peered":"2024-09-10T23:20:41.147674+0000","last_unstale":"2024-09-10T23:20:42.423382+0000","last_undegraded":"2024-09-10T23:20:42.423382+0000","last_fullsized":"2024-09-10T23:20:42.423382+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:46.482417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121785+0000","last_change":"2024-09-10T23:20:41.126508+0000","last_active":"2024-09-10T23:20:42.121785+0000","last_peered":"2024-09-10T23:20:42.121785+0000","last_clean":"2024-09-10T23:20:42.121785+0000","last_became_active":"2024-09-10T23:20:41.126042+0000","last_became_peered":"2024-09-10T23:20:41.126042+0000","last_unstale":"2024-09-10T23:20:42.121785+0000","last_undegraded":"2024-09-10T23:20:42.121785+0000","last_fullsized":"2024-09-10T23:20:42.121785+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:52:10.078447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133291+0000","last_change":"2024-09-10T23:20:41.126547+0000","last_active":"2024-09-10T23:20:42.133291+0000","last_peered":"2024-09-10T23:20:42.133291+0000","last_clean":"2024-09-10T23:20:42.133291+0000","last_became_active":"2024-09-10T23:20:41.125980+0000","last_became_peered":"2024-09-10T23:20:41.125980+0000","last_unstale":"2024-09-10T23:20:42.133291+0000","last_undegraded":"2024-09-10T23:20:42.133291+0000","last_fullsized":"2024-09-10T23:20:42.133291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:52.139520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129157+0000","last_change":"2024-09-10T23:20:41.129313+0000","last_active":"2024-09-10T23:20:42.129157+0000","last_peered":"2024-09-10T23:20:42.129157+0000","last_clean":"2024-09-10T23:20:42.129157+0000","last_became_active":"2024-09-10T23:20:41.128986+0000","last_became_peered":"2024-09-10T23:20:41.128986+0000","last_unstale":"2024-09-10T23:20:42.129157+0000","last_undegraded":"2024-09-10T23:20:42.129157+0000","last_fullsized":"2024-09-10T23:20:42.129157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:00.238840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121268+0000","last_change":"2024-09-10T23:20:41.130770+0000","last_active":"2024-09-10T23:20:42.121268+0000","last_peered":"2024-09-10T23:20:42.121268+0000","last_clean":"2024-09-10T23:20:42.121268+0000","last_became_active":"2024-09-10T23:20:41.130497+0000","last_became_peered":"2024-09-10T23:20:41.130497+0000","last_unstale":"2024-09-10T23:20:42.121268+0000","last_undegraded":"2024-09-10T23:20:42.121268+0000","last_fullsized":"2024-09-10T23:20:42.121268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:15.430774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419387+0000","last_change":"2024-09-10T23:20:41.124111+0000","last_active":"2024-09-10T23:20:42.419387+0000","last_peered":"2024-09-10T23:20:42.419387+0000","last_clean":"2024-09-10T23:20:42.419387+0000","last_became_active":"2024-09-10T23:20:41.123845+0000","last_became_peered":"2024-09-10T23:20:41.123845+0000","last_unstale":"2024-09-10T23:20:42.419387+0000","last_undegraded":"2024-09-10T23:20:42.419387+0000","last_fullsized":"2024-09-10T23:20:42.419387+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:29.649638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121328+0000","last_change":"2024-09-10T23:20:41.128466+0000","last_active":"2024-09-10T23:20:42.121328+0000","last_peered":"2024-09-10T23:20:42.121328+0000","last_clean":"2024-09-10T23:20:42.121328+0000","last_became_active":"2024-09-10T23:20:41.128208+0000","last_became_peered":"2024-09-10T23:20:41.128208+0000","last_unstale":"2024-09-10T23:20:42.121328+0000","last_undegraded":"2024-09-10T23:20:42.121328+0000","last_fullsized":"2024-09-10T23:20:42.121328+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:53.108815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419461+0000","last_change":"2024-09-10T23:20:41.137976+0000","last_active":"2024-09-10T23:20:42.419461+0000","last_peered":"2024-09-10T23:20:42.419461+0000","last_clean":"2024-09-10T23:20:42.419461+0000","last_became_active":"2024-09-10T23:20:41.135335+0000","last_became_peered":"2024-09-10T23:20:41.135335+0000","last_unstale":"2024-09-10T23:20:42.419461+0000","last_undegraded":"2024-09-10T23:20:42.419461+0000","last_fullsized":"2024-09-10T23:20:42.419461+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:29.623199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133492+0000","last_change":"2024-09-10T23:20:40.128521+0000","last_active":"2024-09-10T23:20:42.133492+0000","last_peered":"2024-09-10T23:20:42.133492+0000","last_clean":"2024-09-10T23:20:42.133492+0000","last_became_active":"2024-09-10T23:20:40.128196+0000","last_became_peered":"2024-09-10T23:20:40.128196+0000","last_unstale":"2024-09-10T23:20:42.133492+0000","last_undegraded":"2024-09-10T23:20:42.133492+0000","last_fullsized":"2024-09-10T23:20:42.133492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:56.395606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.128873+0000","last_change":"2024-09-10T23:20:41.127493+0000","last_active":"2024-09-10T23:20:42.128873+0000","last_peered":"2024-09-10T23:20:42.128873+0000","last_clean":"2024-09-10T23:20:42.128873+0000","last_became_active":"2024-09-10T23:20:41.127191+0000","last_became_peered":"2024-09-10T23:20:41.127191+0000","last_unstale":"2024-09-10T23:20:42.128873+0000","last_undegraded":"2024-09-10T23:20:42.128873+0000","last_fullsized":"2024-09-10T23:20:42.128873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:23.717621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121862+0000","last_change":"2024-09-10T23:20:40.129893+0000","last_active":"2024-09-10T23:20:42.121862+0000","last_peered":"2024-09-10T23:20:42.121862+0000","last_clean":"2024-09-10T23:20:42.121862+0000","last_became_active":"2024-09-10T23:20:40.129646+0000","last_became_peered":"2024-09-10T23:20:40.129646+0000","last_unstale":"2024-09-10T23:20:42.121862+0000","last_undegraded":"2024-09-10T23:20:42.121862+0000","last_fullsized":"2024-09-10T23:20:42.121862+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:14.862045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422274+0000","last_change":"2024-09-10T23:20:41.133436+0000","last_active":"2024-09-10T23:20:42.422274+0000","last_peered":"2024-09-10T23:20:42.422274+0000","last_clean":"2024-09-10T23:20:42.422274+0000","last_became_active":"2024-09-10T23:20:41.133122+0000","last_became_peered":"2024-09-10T23:20:41.133122+0000","last_unstale":"2024-09-10T23:20:42.422274+0000","last_undegraded":"2024-09-10T23:20:42.422274+0000","last_fullsized":"2024-09-10T23:20:42.422274+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:06.508857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121956+0000","last_change":"2024-09-10T23:20:40.135323+0000","last_active":"2024-09-10T23:20:42.121956+0000","last_peered":"2024-09-10T23:20:42.121956+0000","last_clean":"2024-09-10T23:20:42.121956+0000","last_became_active":"2024-09-10T23:20:40.135063+0000","last_became_peered":"2024-09-10T23:20:40.135063+0000","last_unstale":"2024-09-10T23:20:42.121956+0000","last_undegraded":"2024-09-10T23:20:42.121956+0000","last_fullsized":"2024-09-10T23:20:42.121956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:25.570883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423018+0000","last_change":"2024-09-10T23:20:41.137303+0000","last_active":"2024-09-10T23:20:42.423018+0000","last_peered":"2024-09-10T23:20:42.423018+0000","last_clean":"2024-09-10T23:20:42.423018+0000","last_became_active":"2024-09-10T23:20:41.136896+0000","last_became_peered":"2024-09-10T23:20:41.136896+0000","last_unstale":"2024-09-10T23:20:42.423018+0000","last_undegraded":"2024-09-10T23:20:42.423018+0000","last_fullsized":"2024-09-10T23:20:42.423018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:29.649638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422339+0000","last_change":"2024-09-10T23:20:40.123991+0000","last_active":"2024-09-10T23:20:42.422339+0000","last_peered":"2024-09-10T23:20:42.422339+0000","last_clean":"2024-09-10T23:20:42.422339+0000","last_became_active":"2024-09-10T23:20:40.123692+0000","last_became_peered":"2024-09-10T23:20:40.123692+0000","last_unstale":"2024-09-10T23:20:42.422339+0000","last_undegraded":"2024-09-10T23:20:42.422339+0000","last_fullsized":"2024-09-10T23:20:42.422339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:11.568207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129288+0000","last_change":"2024-09-10T23:20:41.140072+0000","last_active":"2024-09-10T23:20:42.129288+0000","last_peered":"2024-09-10T23:20:42.129288+0000","last_clean":"2024-09-10T23:20:42.129288+0000","last_became_active":"2024-09-10T23:20:41.139825+0000","last_became_peered":"2024-09-10T23:20:41.139825+0000","last_unstale":"2024-09-10T23:20:42.129288+0000","last_undegraded":"2024-09-10T23:20:42.129288+0000","last_fullsized":"2024-09-10T23:20:42.129288+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:58.945511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422432+0000","last_change":"2024-09-10T23:20:40.123371+0000","last_active":"2024-09-10T23:20:42.422432+0000","last_peered":"2024-09-10T23:20:42.422432+0000","last_clean":"2024-09-10T23:20:42.422432+0000","last_became_active":"2024-09-10T23:20:40.123098+0000","last_became_peered":"2024-09-10T23:20:40.123098+0000","last_unstale":"2024-09-10T23:20:42.422432+0000","last_undegraded":"2024-09-10T23:20:42.422432+0000","last_fullsized":"2024-09-10T23:20:42.422432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:00:27.131683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129562+0000","last_change":"2024-09-10T23:20:41.138064+0000","last_active":"2024-09-10T23:20:42.129562+0000","last_peered":"2024-09-10T23:20:42.129562+0000","last_clean":"2024-09-10T23:20:42.129562+0000","last_became_active":"2024-09-10T23:20:41.137800+0000","last_became_peered":"2024-09-10T23:20:41.137800+0000","last_unstale":"2024-09-10T23:20:42.129562+0000","last_undegraded":"2024-09-10T23:20:42.129562+0000","last_fullsized":"2024-09-10T23:20:42.129562+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:33.088919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422511+0000","last_change":"2024-09-10T23:20:40.127892+0000","last_active":"2024-09-10T23:20:42.422511+0000","last_peered":"2024-09-10T23:20:42.422511+0000","last_clean":"2024-09-10T23:20:42.422511+0000","last_became_active":"2024-09-10T23:20:40.127610+0000","last_became_peered":"2024-09-10T23:20:40.127610+0000","last_unstale":"2024-09-10T23:20:42.422511+0000","last_undegraded":"2024-09-10T23:20:42.422511+0000","last_fullsized":"2024-09-10T23:20:42.422511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:16.765572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423105+0000","last_change":"2024-09-10T23:20:41.134276+0000","last_active":"2024-09-10T23:20:42.423105+0000","last_peered":"2024-09-10T23:20:42.423105+0000","last_clean":"2024-09-10T23:20:42.423105+0000","last_became_active":"2024-09-10T23:20:41.133731+0000","last_became_peered":"2024-09-10T23:20:41.133731+0000","last_unstale":"2024-09-10T23:20:42.423105+0000","last_undegraded":"2024-09-10T23:20:42.423105+0000","last_fullsized":"2024-09-10T23:20:42.423105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:36.893900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129037+0000","last_change":"2024-09-10T23:20:40.119841+0000","last_active":"2024-09-10T23:20:42.129037+0000","last_peered":"2024-09-10T23:20:42.129037+0000","last_clean":"2024-09-10T23:20:42.129037+0000","last_became_active":"2024-09-10T23:20:40.119554+0000","last_became_peered":"2024-09-10T23:20:40.119554+0000","last_unstale":"2024-09-10T23:20:42.129037+0000","last_undegraded":"2024-09-10T23:20:42.129037+0000","last_fullsized":"2024-09-10T23:20:42.129037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:25.570883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423451+0000","last_change":"2024-09-10T23:20:41.131356+0000","last_active":"2024-09-10T23:20:42.423451+0000","last_peered":"2024-09-10T23:20:42.423451+0000","last_clean":"2024-09-10T23:20:42.423451+0000","last_became_active":"2024-09-10T23:20:41.131112+0000","last_became_peered":"2024-09-10T23:20:41.131112+0000","last_unstale":"2024-09-10T23:20:42.423451+0000","last_undegraded":"2024-09-10T23:20:42.423451+0000","last_fullsized":"2024-09-10T23:20:42.423451+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:43.991032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132801+0000","last_change":"2024-09-10T23:20:40.124214+0000","last_active":"2024-09-10T23:20:42.132801+0000","last_peered":"2024-09-10T23:20:42.132801+0000","last_clean":"2024-09-10T23:20:42.132801+0000","last_became_active":"2024-09-10T23:20:40.120446+0000","last_became_peered":"2024-09-10T23:20:40.120446+0000","last_unstale":"2024-09-10T23:20:42.132801+0000","last_undegraded":"2024-09-10T23:20:42.132801+0000","last_fullsized":"2024-09-10T23:20:42.132801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:17.327476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.128806+0000","last_change":"2024-09-10T23:20:41.129342+0000","last_active":"2024-09-10T23:20:42.128806+0000","last_peered":"2024-09-10T23:20:42.128806+0000","last_clean":"2024-09-10T23:20:42.128806+0000","last_became_active":"2024-09-10T23:20:41.122527+0000","last_became_peered":"2024-09-10T23:20:41.122527+0000","last_unstale":"2024-09-10T23:20:42.128806+0000","last_undegraded":"2024-09-10T23:20:42.128806+0000","last_fullsized":"2024-09-10T23:20:42.128806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:55.182173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121742+0000","last_change":"2024-09-10T23:20:40.131592+0000","last_active":"2024-09-10T23:20:42.121742+0000","last_peered":"2024-09-10T23:20:42.121742+0000","last_clean":"2024-09-10T23:20:42.121742+0000","last_became_active":"2024-09-10T23:20:40.131327+0000","last_became_peered":"2024-09-10T23:20:40.131327+0000","last_unstale":"2024-09-10T23:20:42.121742+0000","last_undegraded":"2024-09-10T23:20:42.121742+0000","last_fullsized":"2024-09-10T23:20:42.121742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:07.622979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422764+0000","last_change":"2024-09-10T23:20:41.131671+0000","last_active":"2024-09-10T23:20:42.422764+0000","last_peered":"2024-09-10T23:20:42.422764+0000","last_clean":"2024-09-10T23:20:42.422764+0000","last_became_active":"2024-09-10T23:20:41.131354+0000","last_became_peered":"2024-09-10T23:20:41.131354+0000","last_unstale":"2024-09-10T23:20:42.422764+0000","last_undegraded":"2024-09-10T23:20:42.422764+0000","last_fullsized":"2024-09-10T23:20:42.422764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:49.205216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423448+0000","last_change":"2024-09-10T23:20:40.128083+0000","last_active":"2024-09-10T23:20:42.423448+0000","last_peered":"2024-09-10T23:20:42.423448+0000","last_clean":"2024-09-10T23:20:42.423448+0000","last_became_active":"2024-09-10T23:20:40.127555+0000","last_became_peered":"2024-09-10T23:20:40.127555+0000","last_unstale":"2024-09-10T23:20:42.423448+0000","last_undegraded":"2024-09-10T23:20:42.423448+0000","last_fullsized":"2024-09-10T23:20:42.423448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:12.468324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118875+0000","last_change":"2024-09-10T23:20:41.122664+0000","last_active":"2024-09-10T23:20:42.118875+0000","last_peered":"2024-09-10T23:20:42.118875+0000","last_clean":"2024-09-10T23:20:42.118875+0000","last_became_active":"2024-09-10T23:20:41.122359+0000","last_became_peered":"2024-09-10T23:20:41.122359+0000","last_unstale":"2024-09-10T23:20:42.118875+0000","last_undegraded":"2024-09-10T23:20:42.118875+0000","last_fullsized":"2024-09-10T23:20:42.118875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:04:04.020060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133502+0000","last_change":"2024-09-10T23:20:40.129170+0000","last_active":"2024-09-10T23:20:42.133502+0000","last_peered":"2024-09-10T23:20:42.133502+0000","last_clean":"2024-09-10T23:20:42.133502+0000","last_became_active":"2024-09-10T23:20:40.128901+0000","last_became_peered":"2024-09-10T23:20:40.128901+0000","last_unstale":"2024-09-10T23:20:42.133502+0000","last_undegraded":"2024-09-10T23:20:42.133502+0000","last_fullsized":"2024-09-10T23:20:42.133502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:13.249957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419533+0000","last_change":"2024-09-10T23:20:41.145225+0000","last_active":"2024-09-10T23:20:42.419533+0000","last_peered":"2024-09-10T23:20:42.419533+0000","last_clean":"2024-09-10T23:20:42.419533+0000","last_became_active":"2024-09-10T23:20:41.142773+0000","last_became_peered":"2024-09-10T23:20:41.142773+0000","last_unstale":"2024-09-10T23:20:42.419533+0000","last_undegraded":"2024-09-10T23:20:42.419533+0000","last_fullsized":"2024-09-10T23:20:42.419533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:43:02.960726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"86'6","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422455+0000","last_change":"2024-09-10T23:20:40.129709+0000","last_active":"2024-09-10T23:20:42.422455+0000","last_peered":"2024-09-10T23:20:42.422455+0000","last_clean":"2024-09-10T23:20:42.422455+0000","last_became_active":"2024-09-10T23:20:40.128128+0000","last_became_peered":"2024-09-10T23:20:40.128128+0000","last_unstale":"2024-09-10T23:20:42.422455+0000","last_undegraded":"2024-09-10T23:20:42.422455+0000","last_fullsized":"2024-09-10T23:20:42.422455+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:31.178729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422742+0000","last_change":"2024-09-10T23:20:41.137940+0000","last_active":"2024-09-10T23:20:42.422742+0000","last_peered":"2024-09-10T23:20:42.422742+0000","last_clean":"2024-09-10T23:20:42.422742+0000","last_became_active":"2024-09-10T23:20:41.137675+0000","last_became_peered":"2024-09-10T23:20:41.137675+0000","last_unstale":"2024-09-10T23:20:42.422742+0000","last_undegraded":"2024-09-10T23:20:42.422742+0000","last_fullsized":"2024-09-10T23:20:42.422742+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:15.667362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.421906+0000","last_change":"2024-09-10T23:20:40.128787+0000","last_active":"2024-09-10T23:20:42.421906+0000","last_peered":"2024-09-10T23:20:42.421906+0000","last_clean":"2024-09-10T23:20:42.421906+0000","last_became_active":"2024-09-10T23:20:40.128517+0000","last_became_peered":"2024-09-10T23:20:40.128517+0000","last_unstale":"2024-09-10T23:20:42.421906+0000","last_undegraded":"2024-09-10T23:20:42.421906+0000","last_fullsized":"2024-09-10T23:20:42.421906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:49.618430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422085+0000","last_change":"2024-09-10T23:20:41.125926+0000","last_active":"2024-09-10T23:20:42.422085+0000","last_peered":"2024-09-10T23:20:42.422085+0000","last_clean":"2024-09-10T23:20:42.422085+0000","last_became_active":"2024-09-10T23:20:41.125634+0000","last_became_peered":"2024-09-10T23:20:41.125634+0000","last_unstale":"2024-09-10T23:20:42.422085+0000","last_undegraded":"2024-09-10T23:20:42.422085+0000","last_fullsized":"2024-09-10T23:20:42.422085+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:23.525965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121520+0000","last_change":"2024-09-10T23:20:40.131376+0000","last_active":"2024-09-10T23:20:42.121520+0000","last_peered":"2024-09-10T23:20:42.121520+0000","last_clean":"2024-09-10T23:20:42.121520+0000","last_became_active":"2024-09-10T23:20:40.131048+0000","last_became_peered":"2024-09-10T23:20:40.131048+0000","last_unstale":"2024-09-10T23:20:42.121520+0000","last_undegraded":"2024-09-10T23:20:42.121520+0000","last_fullsized":"2024-09-10T23:20:42.121520+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:34.635861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422855+0000","last_change":"2024-09-10T23:20:41.120364+0000","last_active":"2024-09-10T23:20:42.422855+0000","last_peered":"2024-09-10T23:20:42.422855+0000","last_clean":"2024-09-10T23:20:42.422855+0000","last_became_active":"2024-09-10T23:20:41.120112+0000","last_became_peered":"2024-09-10T23:20:41.120112+0000","last_unstale":"2024-09-10T23:20:42.422855+0000","last_undegraded":"2024-09-10T23:20:42.422855+0000","last_fullsized":"2024-09-10T23:20:42.422855+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:34.467025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133119+0000","last_change":"2024-09-10T23:20:40.130101+0000","last_active":"2024-09-10T23:20:42.133119+0000","last_peered":"2024-09-10T23:20:42.133119+0000","last_clean":"2024-09-10T23:20:42.133119+0000","last_became_active":"2024-09-10T23:20:40.129612+0000","last_became_peered":"2024-09-10T23:20:40.129612+0000","last_unstale":"2024-09-10T23:20:42.133119+0000","last_undegraded":"2024-09-10T23:20:42.133119+0000","last_fullsized":"2024-09-10T23:20:42.133119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:27.636253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422959+0000","last_change":"2024-09-10T23:20:41.128895+0000","last_active":"2024-09-10T23:20:42.422959+0000","last_peered":"2024-09-10T23:20:42.422959+0000","last_clean":"2024-09-10T23:20:42.422959+0000","last_became_active":"2024-09-10T23:20:41.126170+0000","last_became_peered":"2024-09-10T23:20:41.126170+0000","last_unstale":"2024-09-10T23:20:42.422959+0000","last_undegraded":"2024-09-10T23:20:42.422959+0000","last_fullsized":"2024-09-10T23:20:42.422959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:48.996362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"86'8","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129003+0000","last_change":"2024-09-10T23:20:40.124184+0000","last_active":"2024-09-10T23:20:42.129003+0000","last_peered":"2024-09-10T23:20:42.129003+0000","last_clean":"2024-09-10T23:20:42.129003+0000","last_became_active":"2024-09-10T23:20:40.123915+0000","last_became_peered":"2024-09-10T23:20:40.123915+0000","last_unstale":"2024-09-10T23:20:42.129003+0000","last_undegraded":"2024-09-10T23:20:42.129003+0000","last_fullsized":"2024-09-10T23:20:42.129003+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:14.862045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118297+0000","last_change":"2024-09-10T23:20:41.115069+0000","last_active":"2024-09-10T23:20:42.118297+0000","last_peered":"2024-09-10T23:20:42.118297+0000","last_clean":"2024-09-10T23:20:42.118297+0000","last_became_active":"2024-09-10T23:20:41.114657+0000","last_became_peered":"2024-09-10T23:20:41.114657+0000","last_unstale":"2024-09-10T23:20:42.118297+0000","last_undegraded":"2024-09-10T23:20:42.118297+0000","last_fullsized":"2024-09-10T23:20:42.118297+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:21.933582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121843+0000","last_change":"2024-09-10T23:20:40.131437+0000","last_active":"2024-09-10T23:20:42.121843+0000","last_peered":"2024-09-10T23:20:42.121843+0000","last_clean":"2024-09-10T23:20:42.121843+0000","last_became_active":"2024-09-10T23:20:40.131158+0000","last_became_peered":"2024-09-10T23:20:40.131158+0000","last_unstale":"2024-09-10T23:20:42.121843+0000","last_undegraded":"2024-09-10T23:20:42.121843+0000","last_fullsized":"2024-09-10T23:20:42.121843+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:48.535403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132911+0000","last_change":"2024-09-10T23:20:41.120937+0000","last_active":"2024-09-10T23:20:42.132911+0000","last_peered":"2024-09-10T23:20:42.132911+0000","last_clean":"2024-09-10T23:20:42.132911+0000","last_became_active":"2024-09-10T23:20:41.120297+0000","last_became_peered":"2024-09-10T23:20:41.120297+0000","last_unstale":"2024-09-10T23:20:42.132911+0000","last_undegraded":"2024-09-10T23:20:42.132911+0000","last_fullsized":"2024-09-10T23:20:42.132911+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:42.107117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423079+0000","last_change":"2024-09-10T23:20:40.124220+0000","last_active":"2024-09-10T23:20:42.423079+0000","last_peered":"2024-09-10T23:20:42.423079+0000","last_clean":"2024-09-10T23:20:42.423079+0000","last_became_active":"2024-09-10T23:20:40.123970+0000","last_became_peered":"2024-09-10T23:20:40.123970+0000","last_unstale":"2024-09-10T23:20:42.423079+0000","last_undegraded":"2024-09-10T23:20:42.423079+0000","last_fullsized":"2024-09-10T23:20:42.423079+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:47.318397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.132922+0000","last_change":"2024-09-10T23:20:41.129093+0000","last_active":"2024-09-10T23:20:42.132922+0000","last_peered":"2024-09-10T23:20:42.132922+0000","last_clean":"2024-09-10T23:20:42.132922+0000","last_became_active":"2024-09-10T23:20:41.128838+0000","last_became_peered":"2024-09-10T23:20:41.128838+0000","last_unstale":"2024-09-10T23:20:42.132922+0000","last_undegraded":"2024-09-10T23:20:42.132922+0000","last_fullsized":"2024-09-10T23:20:42.132922+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:34.937829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133551+0000","last_change":"2024-09-10T23:20:40.125679+0000","last_active":"2024-09-10T23:20:42.133551+0000","last_peered":"2024-09-10T23:20:42.133551+0000","last_clean":"2024-09-10T23:20:42.133551+0000","last_became_active":"2024-09-10T23:20:40.125337+0000","last_became_peered":"2024-09-10T23:20:40.125337+0000","last_unstale":"2024-09-10T23:20:42.133551+0000","last_undegraded":"2024-09-10T23:20:42.133551+0000","last_fullsized":"2024-09-10T23:20:42.133551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:34.870733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118656+0000","last_change":"2024-09-10T23:20:41.123472+0000","last_active":"2024-09-10T23:20:42.118656+0000","last_peered":"2024-09-10T23:20:42.118656+0000","last_clean":"2024-09-10T23:20:42.118656+0000","last_became_active":"2024-09-10T23:20:41.123196+0000","last_became_peered":"2024-09-10T23:20:41.123196+0000","last_unstale":"2024-09-10T23:20:42.118656+0000","last_undegraded":"2024-09-10T23:20:42.118656+0000","last_fullsized":"2024-09-10T23:20:42.118656+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:39.750457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419452+0000","last_change":"2024-09-10T23:20:40.128380+0000","last_active":"2024-09-10T23:20:42.419452+0000","last_peered":"2024-09-10T23:20:42.419452+0000","last_clean":"2024-09-10T23:20:42.419452+0000","last_became_active":"2024-09-10T23:20:40.128069+0000","last_became_peered":"2024-09-10T23:20:40.128069+0000","last_unstale":"2024-09-10T23:20:42.419452+0000","last_undegraded":"2024-09-10T23:20:42.419452+0000","last_fullsized":"2024-09-10T23:20:42.419452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:12.920715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129313+0000","last_change":"2024-09-10T23:20:41.132909+0000","last_active":"2024-09-10T23:20:42.129313+0000","last_peered":"2024-09-10T23:20:42.129313+0000","last_clean":"2024-09-10T23:20:42.129313+0000","last_became_active":"2024-09-10T23:20:41.132599+0000","last_became_peered":"2024-09-10T23:20:41.132599+0000","last_unstale":"2024-09-10T23:20:42.129313+0000","last_undegraded":"2024-09-10T23:20:42.129313+0000","last_fullsized":"2024-09-10T23:20:42.129313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:01.658526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118643+0000","last_change":"2024-09-10T23:20:40.122770+0000","last_active":"2024-09-10T23:20:42.118643+0000","last_peered":"2024-09-10T23:20:42.118643+0000","last_clean":"2024-09-10T23:20:42.118643+0000","last_became_active":"2024-09-10T23:20:40.122501+0000","last_became_peered":"2024-09-10T23:20:40.122501+0000","last_unstale":"2024-09-10T23:20:42.118643+0000","last_undegraded":"2024-09-10T23:20:42.118643+0000","last_fullsized":"2024-09-10T23:20:42.118643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:01.567448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.130378+0000","last_change":"2024-09-10T23:20:41.138681+0000","last_active":"2024-09-10T23:20:42.130378+0000","last_peered":"2024-09-10T23:20:42.130378+0000","last_clean":"2024-09-10T23:20:42.130378+0000","last_became_active":"2024-09-10T23:20:41.137670+0000","last_became_peered":"2024-09-10T23:20:41.137670+0000","last_unstale":"2024-09-10T23:20:42.130378+0000","last_undegraded":"2024-09-10T23:20:42.130378+0000","last_fullsized":"2024-09-10T23:20:42.130378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:57.041592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118288+0000","last_change":"2024-09-10T23:20:40.120678+0000","last_active":"2024-09-10T23:20:42.118288+0000","last_peered":"2024-09-10T23:20:42.118288+0000","last_clean":"2024-09-10T23:20:42.118288+0000","last_became_active":"2024-09-10T23:20:40.120368+0000","last_became_peered":"2024-09-10T23:20:40.120368+0000","last_unstale":"2024-09-10T23:20:42.118288+0000","last_undegraded":"2024-09-10T23:20:42.118288+0000","last_fullsized":"2024-09-10T23:20:42.118288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:15.092441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423202+0000","last_change":"2024-09-10T23:20:41.129524+0000","last_active":"2024-09-10T23:20:42.423202+0000","last_peered":"2024-09-10T23:20:42.423202+0000","last_clean":"2024-09-10T23:20:42.423202+0000","last_became_active":"2024-09-10T23:20:41.126551+0000","last_became_peered":"2024-09-10T23:20:41.126551+0000","last_unstale":"2024-09-10T23:20:42.423202+0000","last_undegraded":"2024-09-10T23:20:42.423202+0000","last_fullsized":"2024-09-10T23:20:42.423202+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:25.189262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118292+0000","last_change":"2024-09-10T23:20:40.126347+0000","last_active":"2024-09-10T23:20:42.118292+0000","last_peered":"2024-09-10T23:20:42.118292+0000","last_clean":"2024-09-10T23:20:42.118292+0000","last_became_active":"2024-09-10T23:20:40.126068+0000","last_became_peered":"2024-09-10T23:20:40.126068+0000","last_unstale":"2024-09-10T23:20:42.118292+0000","last_undegraded":"2024-09-10T23:20:42.118292+0000","last_fullsized":"2024-09-10T23:20:42.118292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:41.654200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422033+0000","last_change":"2024-09-10T23:20:41.124287+0000","last_active":"2024-09-10T23:20:42.422033+0000","last_peered":"2024-09-10T23:20:42.422033+0000","last_clean":"2024-09-10T23:20:42.422033+0000","last_became_active":"2024-09-10T23:20:41.124037+0000","last_became_peered":"2024-09-10T23:20:41.124037+0000","last_unstale":"2024-09-10T23:20:42.422033+0000","last_undegraded":"2024-09-10T23:20:42.422033+0000","last_fullsized":"2024-09-10T23:20:42.422033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:27:59.966232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423316+0000","last_change":"2024-09-10T23:20:40.129652+0000","last_active":"2024-09-10T23:20:42.423316+0000","last_peered":"2024-09-10T23:20:42.423316+0000","last_clean":"2024-09-10T23:20:42.423316+0000","last_became_active":"2024-09-10T23:20:40.129397+0000","last_became_peered":"2024-09-10T23:20:40.129397+0000","last_unstale":"2024-09-10T23:20:42.423316+0000","last_undegraded":"2024-09-10T23:20:42.423316+0000","last_fullsized":"2024-09-10T23:20:42.423316+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:10.871552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422991+0000","last_change":"2024-09-10T23:20:41.117473+0000","last_active":"2024-09-10T23:20:42.422991+0000","last_peered":"2024-09-10T23:20:42.422991+0000","last_clean":"2024-09-10T23:20:42.422991+0000","last_became_active":"2024-09-10T23:20:41.117123+0000","last_became_peered":"2024-09-10T23:20:41.117123+0000","last_unstale":"2024-09-10T23:20:42.422991+0000","last_undegraded":"2024-09-10T23:20:42.422991+0000","last_fullsized":"2024-09-10T23:20:42.422991+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:21.407973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"87'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.130483+0000","last_change":"2024-09-10T23:20:40.131528+0000","last_active":"2024-09-10T23:20:42.130483+0000","last_peered":"2024-09-10T23:20:42.130483+0000","last_clean":"2024-09-10T23:20:42.130483+0000","last_became_active":"2024-09-10T23:20:40.131200+0000","last_became_peered":"2024-09-10T23:20:40.131200+0000","last_unstale":"2024-09-10T23:20:42.130483+0000","last_undegraded":"2024-09-10T23:20:42.130483+0000","last_fullsized":"2024-09-10T23:20:42.130483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:34.635861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422497+0000","last_change":"2024-09-10T23:20:41.133333+0000","last_active":"2024-09-10T23:20:42.422497+0000","last_peered":"2024-09-10T23:20:42.422497+0000","last_clean":"2024-09-10T23:20:42.422497+0000","last_became_active":"2024-09-10T23:20:41.132604+0000","last_became_peered":"2024-09-10T23:20:41.132604+0000","last_unstale":"2024-09-10T23:20:42.422497+0000","last_undegraded":"2024-09-10T23:20:42.422497+0000","last_fullsized":"2024-09-10T23:20:42.422497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:57.954331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.122163+0000","last_change":"2024-09-10T23:20:40.128507+0000","last_active":"2024-09-10T23:20:42.122163+0000","last_peered":"2024-09-10T23:20:42.122163+0000","last_clean":"2024-09-10T23:20:42.122163+0000","last_became_active":"2024-09-10T23:20:40.128235+0000","last_became_peered":"2024-09-10T23:20:40.128235+0000","last_unstale":"2024-09-10T23:20:42.122163+0000","last_undegraded":"2024-09-10T23:20:42.122163+0000","last_fullsized":"2024-09-10T23:20:42.122163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:20.407427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.129338+0000","last_change":"2024-09-10T23:20:41.122842+0000","last_active":"2024-09-10T23:20:42.129338+0000","last_peered":"2024-09-10T23:20:42.129338+0000","last_clean":"2024-09-10T23:20:42.129338+0000","last_became_active":"2024-09-10T23:20:41.122539+0000","last_became_peered":"2024-09-10T23:20:41.122539+0000","last_unstale":"2024-09-10T23:20:42.129338+0000","last_undegraded":"2024-09-10T23:20:42.129338+0000","last_fullsized":"2024-09-10T23:20:42.129338+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:45.761030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121585+0000","last_change":"2024-09-10T23:20:40.132298+0000","last_active":"2024-09-10T23:20:42.121585+0000","last_peered":"2024-09-10T23:20:42.121585+0000","last_clean":"2024-09-10T23:20:42.121585+0000","last_became_active":"2024-09-10T23:20:40.132054+0000","last_became_peered":"2024-09-10T23:20:40.132054+0000","last_unstale":"2024-09-10T23:20:42.121585+0000","last_undegraded":"2024-09-10T23:20:42.121585+0000","last_fullsized":"2024-09-10T23:20:42.121585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:16.765572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422172+0000","last_change":"2024-09-10T23:20:41.128546+0000","last_active":"2024-09-10T23:20:42.422172+0000","last_peered":"2024-09-10T23:20:42.422172+0000","last_clean":"2024-09-10T23:20:42.422172+0000","last_became_active":"2024-09-10T23:20:41.126264+0000","last_became_peered":"2024-09-10T23:20:41.126264+0000","last_unstale":"2024-09-10T23:20:42.422172+0000","last_undegraded":"2024-09-10T23:20:42.422172+0000","last_fullsized":"2024-09-10T23:20:42.422172+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:13.529827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422562+0000","last_change":"2024-09-10T23:20:40.124599+0000","last_active":"2024-09-10T23:20:42.422562+0000","last_peered":"2024-09-10T23:20:42.422562+0000","last_clean":"2024-09-10T23:20:42.422562+0000","last_became_active":"2024-09-10T23:20:40.124357+0000","last_became_peered":"2024-09-10T23:20:40.124357+0000","last_unstale":"2024-09-10T23:20:42.422562+0000","last_undegraded":"2024-09-10T23:20:42.422562+0000","last_fullsized":"2024-09-10T23:20:42.422562+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:58.899986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.422327+0000","last_change":"2024-09-10T23:20:41.125253+0000","last_active":"2024-09-10T23:20:42.422327+0000","last_peered":"2024-09-10T23:20:42.422327+0000","last_clean":"2024-09-10T23:20:42.422327+0000","last_became_active":"2024-09-10T23:20:41.124980+0000","last_became_peered":"2024-09-10T23:20:41.124980+0000","last_unstale":"2024-09-10T23:20:42.422327+0000","last_undegraded":"2024-09-10T23:20:42.422327+0000","last_fullsized":"2024-09-10T23:20:42.422327+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:22.773162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.133074+0000","last_change":"2024-09-10T23:20:40.127513+0000","last_active":"2024-09-10T23:20:42.133074+0000","last_peered":"2024-09-10T23:20:42.133074+0000","last_clean":"2024-09-10T23:20:42.133074+0000","last_became_active":"2024-09-10T23:20:40.127217+0000","last_became_peered":"2024-09-10T23:20:40.127217+0000","last_unstale":"2024-09-10T23:20:42.133074+0000","last_undegraded":"2024-09-10T23:20:42.133074+0000","last_fullsized":"2024-09-10T23:20:42.133074+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:17.351784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419786+0000","last_change":"2024-09-10T23:20:41.146712+0000","last_active":"2024-09-10T23:20:42.419786+0000","last_peered":"2024-09-10T23:20:42.419786+0000","last_clean":"2024-09-10T23:20:42.419786+0000","last_became_active":"2024-09-10T23:20:41.146538+0000","last_became_peered":"2024-09-10T23:20:41.146538+0000","last_unstale":"2024-09-10T23:20:42.419786+0000","last_undegraded":"2024-09-10T23:20:42.419786+0000","last_fullsized":"2024-09-10T23:20:42.419786+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:56.905164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.423230+0000","last_change":"2024-09-10T23:20:40.127031+0000","last_active":"2024-09-10T23:20:42.423230+0000","last_peered":"2024-09-10T23:20:42.423230+0000","last_clean":"2024-09-10T23:20:42.423230+0000","last_became_active":"2024-09-10T23:20:40.126712+0000","last_became_peered":"2024-09-10T23:20:40.126712+0000","last_unstale":"2024-09-10T23:20:42.423230+0000","last_undegraded":"2024-09-10T23:20:42.423230+0000","last_fullsized":"2024-09-10T23:20:42.423230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:21.158468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419813+0000","last_change":"2024-09-10T23:20:41.132392+0000","last_active":"2024-09-10T23:20:42.419813+0000","last_peered":"2024-09-10T23:20:42.419813+0000","last_clean":"2024-09-10T23:20:42.419813+0000","last_became_active":"2024-09-10T23:20:41.132013+0000","last_became_peered":"2024-09-10T23:20:41.132013+0000","last_unstale":"2024-09-10T23:20:42.419813+0000","last_undegraded":"2024-09-10T23:20:42.419813+0000","last_fullsized":"2024-09-10T23:20:42.419813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:51.356097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.419306+0000","last_change":"2024-09-10T23:20:40.120127+0000","last_active":"2024-09-10T23:20:42.419306+0000","last_peered":"2024-09-10T23:20:42.419306+0000","last_clean":"2024-09-10T23:20:42.419306+0000","last_became_active":"2024-09-10T23:20:40.117614+0000","last_became_peered":"2024-09-10T23:20:40.117614+0000","last_unstale":"2024-09-10T23:20:42.419306+0000","last_undegraded":"2024-09-10T23:20:42.419306+0000","last_fullsized":"2024-09-10T23:20:42.419306+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:21.158468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.122103+0000","last_change":"2024-09-10T23:20:41.136706+0000","last_active":"2024-09-10T23:20:42.122103+0000","last_peered":"2024-09-10T23:20:42.122103+0000","last_clean":"2024-09-10T23:20:42.122103+0000","last_became_active":"2024-09-10T23:20:41.136400+0000","last_became_peered":"2024-09-10T23:20:41.136400+0000","last_unstale":"2024-09-10T23:20:42.122103+0000","last_undegraded":"2024-09-10T23:20:42.122103+0000","last_fullsized":"2024-09-10T23:20:42.122103+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:40.094243+0000","last_clean_scrub_stamp":"2024-09-10T23:20:40.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:03.361028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.118969+0000","last_change":"2024-09-10T23:20:40.118820+0000","last_active":"2024-09-10T23:20:42.118969+0000","last_peered":"2024-09-10T23:20:42.118969+0000","last_clean":"2024-09-10T23:20:42.118969+0000","last_became_active":"2024-09-10T23:20:40.118517+0000","last_became_peered":"2024-09-10T23:20:40.118517+0000","last_unstale":"2024-09-10T23:20:42.118969+0000","last_undegraded":"2024-09-10T23:20:42.118969+0000","last_fullsized":"2024-09-10T23:20:42.118969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:20:39.087530+0000","last_clean_scrub_stamp":"2024-09-10T23:20:39.087530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:36.823098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":227,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-10T23:20:42.121434+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:20:42.121434+0000","last_peered":"2024-09-10T23:20:42.121434+0000","last_clean":"2024-09-10T23:20:42.121434+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:20:42.121434+0000","last_undegraded":"2024-09-10T23:20:42.121434+0000","last_fullsized":"2024-09-10T23:20:42.121434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476803,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40552,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331288,"statfs":{"total":96636764160,"available":96595238912,"internally_reserved":0,"allocated":1069056,"data_stored":488088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50852,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320988,"statfs":{"total":96636764160,"available":96584691712,"internally_reserved":0,"allocated":1654784,"data_stored":1076866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40552,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331288,"statfs":{"total":96636764160,"available":96595238912,"internally_reserved":0,"allocated":1060864,"data_stored":486510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46132,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325708,"statfs":{"total":96636764160,"available":96589524992,"internally_reserved":0,"allocated":1077248,"data_stored":488192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509507,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1069056,"data_stored":487218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40556,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331284,"statfs":{"total":96636764160,"available":96595234816,"internally_reserved":0,"allocated":1064960,"data_stored":486588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509507,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55008,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316832,"statfs":{"total":96636764160,"available":96580435968,"internally_reserved":0,"allocated":1650688,"data_stored":1076844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50272,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321568,"statfs":{"total":96636764160,"available":96585285632,"internally_reserved":0,"allocated":1060864,"data_stored":487058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:20:50.274 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:20:50.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:20:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.461+0000 7fbd3f000640 1 -- 172.21.15.17:0/2480375391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d04f0 msgr2=0x7fbd3815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.461+0000 7fbd3f000640 1 --2- 172.21.15.17:0/2480375391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d04f0 0x7fbd3815c680 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009bc0 tx=0x7fbd3001cba0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.461+0000 7fbd3f000640 1 -- 172.21.15.17:0/2480375391 shutdown_connections 2024-09-10T23:20:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.461+0000 7fbd3f000640 1 --2- 172.21.15.17:0/2480375391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d04f0 0x7fbd3815c680 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.461+0000 7fbd3f000640 1 -- 172.21.15.17:0/2480375391 >> 172.21.15.17:0/2480375391 conn(0x7fbd3809a9f0 msgr2=0x7fbd3809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.461+0000 7fbd3f000640 1 -- 172.21.15.17:0/2480375391 shutdown_connections 2024-09-10T23:20:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.461+0000 7fbd3f000640 1 -- 172.21.15.17:0/2480375391 wait complete. 2024-09-10T23:20:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.461+0000 7fbd3f000640 1 Processor -- start 2024-09-10T23:20:50.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.461+0000 7fbd3f000640 1 -- start start 2024-09-10T23:20:50.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3f000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d04f0 0x7fbd38153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3f000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3815be00 0x7fbd38151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3f000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd3815d4f0 0x7fbd380cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3f000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38169e50 con 0x7fbd3815d4f0 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3f000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38169cd0 con 0x7fbd3815be00 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3f000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbd38169fd0 con 0x7fbd380d04f0 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd3815d4f0 0x7fbd380cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd3815d4f0 0x7fbd380cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47316/0 (socket says 172.21.15.17:47316) 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3d000640 1 -- 172.21.15.17:0/4086042938 learned_addr learned my addr 172.21.15.17:0/4086042938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd37e00640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d04f0 0x7fbd38153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd37400640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3815be00 0x7fbd38151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3d000640 1 -- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d04f0 msgr2=0x7fbd38153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3d000640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d04f0 0x7fbd38153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3d000640 1 -- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3815be00 msgr2=0x7fbd38151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3d000640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3815be00 0x7fbd38151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3d000640 1 -- 172.21.15.17:0/4086042938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd38153f80 con 0x7fbd3815d4f0 2024-09-10T23:20:50.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3d000640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd3815d4f0 0x7fbd380cecb0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbd300197b0 tx=0x7fbd300a59e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:50.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd2fe00640 1 -- 172.21.15.17:0/4086042938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd300bb070 con 0x7fbd3815d4f0 2024-09-10T23:20:50.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd2fe00640 1 -- 172.21.15.17:0/4086042938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd30004e00 con 0x7fbd3815d4f0 2024-09-10T23:20:50.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd2fe00640 1 -- 172.21.15.17:0/4086042938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd300b2040 con 0x7fbd3815d4f0 2024-09-10T23:20:50.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd38158900 con 0x7fbd3815d4f0 2024-09-10T23:20:50.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd381591a0 con 0x7fbd3815d4f0 2024-09-10T23:20:50.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.465+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3815c680 con 0x7fbd3815d4f0 2024-09-10T23:20:50.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.469+0000 7fbd2fe00640 1 -- 172.21.15.17:0/4086042938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbd300b5030 con 0x7fbd3815d4f0 2024-09-10T23:20:50.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.469+0000 7fbd2fe00640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd180725e0 0x7fbd18074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.469+0000 7fbd2fe00640 1 -- 172.21.15.17:0/4086042938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fbd3012d120 con 0x7fbd3815d4f0 2024-09-10T23:20:50.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.469+0000 7fbd37e00640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd180725e0 0x7fbd18074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.469+0000 7fbd37e00640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd180725e0 0x7fbd18074aa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd380ce0a0 tx=0x7fbd28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:50.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.473+0000 7fbd2fe00640 1 -- 172.21.15.17:0/4086042938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbd38153f80 con 0x7fbd3815d4f0 2024-09-10T23:20:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.705+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fbd38152130 con 0x7fbd3815d4f0 2024-09-10T23:20:50.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.709+0000 7fbd2fe00640 1 -- 172.21.15.17:0/4086042938 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7fbd30016790 con 0x7fbd3815d4f0 2024-09-10T23:20:50.714 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:20:50.714 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:20:50.714 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:20:50.715 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:20:50.715 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:20:50.715 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:20:50.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd180725e0 msgr2=0x7fbd18074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd180725e0 0x7fbd18074aa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd380ce0a0 tx=0x7fbd28009040 comp rx=0 tx=0).stop 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd3815d4f0 msgr2=0x7fbd380cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd3815d4f0 0x7fbd380cecb0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbd300197b0 tx=0x7fbd300a59e0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 shutdown_connections 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd180725e0 0x7fbd18074aa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd3815d4f0 0x7fbd380cecb0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3815be00 0x7fbd38151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 --2- 172.21.15.17:0/4086042938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d04f0 0x7fbd38153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 >> 172.21.15.17:0/4086042938 conn(0x7fbd3809a9f0 msgr2=0x7fbd380714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 shutdown_connections 2024-09-10T23:20:50.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.713+0000 7fbd3f000640 1 -- 172.21.15.17:0/4086042938 wait complete. 2024-09-10T23:20:50.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:20:50.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.877+0000 7f47ade00640 1 -- 172.21.15.17:0/2005460304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 msgr2=0x7f47a815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.877+0000 7f47ade00640 1 --2- 172.21.15.17:0/2005460304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 0x7f47a815f060 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f47a80cf010 tx=0x7f479801c7f0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.877+0000 7f47ade00640 1 -- 172.21.15.17:0/2005460304 shutdown_connections 2024-09-10T23:20:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.877+0000 7f47ade00640 1 --2- 172.21.15.17:0/2005460304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 0x7f47a815f060 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.877+0000 7f47ade00640 1 -- 172.21.15.17:0/2005460304 >> 172.21.15.17:0/2005460304 conn(0x7f47a80d1d60 msgr2=0x7f47a80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.877+0000 7f47ade00640 1 -- 172.21.15.17:0/2005460304 shutdown_connections 2024-09-10T23:20:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.877+0000 7f47ade00640 1 -- 172.21.15.17:0/2005460304 wait complete. 2024-09-10T23:20:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 Processor -- start 2024-09-10T23:20:50.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 -- start start 2024-09-10T23:20:50.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 0x7f47a80b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47a80cf320 0x7f47a814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a80d1830 0x7f47a815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47a816a660 con 0x7f47a8070ad0 2024-09-10T23:20:50.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f47a816a4e0 con 0x7f47a80d1830 2024-09-10T23:20:50.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f47a816a7e0 con 0x7f47a80cf320 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 0x7f47a80b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 0x7f47a80b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47324/0 (socket says 172.21.15.17:47324) 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a6a00640 1 -- 172.21.15.17:0/2517878185 learned_addr learned my addr 172.21.15.17:0/2517878185 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f479e000640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47a80cf320 0x7f47a814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a7400640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a80d1830 0x7f47a815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a6a00640 1 -- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47a80cf320 msgr2=0x7f47a814fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a6a00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47a80cf320 0x7f47a814fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a6a00640 1 -- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a80d1830 msgr2=0x7f47a815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a6a00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a80d1830 0x7f47a815bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a6a00640 1 -- 172.21.15.17:0/2517878185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a80b0b60 con 0x7f47a8070ad0 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f479e000640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47a80cf320 0x7f47a814fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a7400640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a80d1830 0x7f47a815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:20:50.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47a6a00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 0x7f47a80b70e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f4798000c10 tx=0x7f4798004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f479fe00640 1 -- 172.21.15.17:0/2517878185 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47980bb070 con 0x7f47a8070ad0 2024-09-10T23:20:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f479fe00640 1 -- 172.21.15.17:0/2517878185 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4798005030 con 0x7f47a8070ad0 2024-09-10T23:20:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f479fe00640 1 -- 172.21.15.17:0/2517878185 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47980b2040 con 0x7f47a8070ad0 2024-09-10T23:20:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a80b0240 con 0x7f47a8070ad0 2024-09-10T23:20:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a814ef60 con 0x7f47a8070ad0 2024-09-10T23:20:50.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.881+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a815f060 con 0x7f47a8070ad0 2024-09-10T23:20:50.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.885+0000 7f479fe00640 1 -- 172.21.15.17:0/2517878185 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f47980b5030 con 0x7f47a8070ad0 2024-09-10T23:20:50.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.885+0000 7f479fe00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47840725e0 0x7f4784074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:50.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.885+0000 7f479fe00640 1 -- 172.21.15.17:0/2517878185 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f479812cbe0 con 0x7f47a8070ad0 2024-09-10T23:20:50.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.885+0000 7f479e000640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47840725e0 0x7f4784074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:50.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.885+0000 7f479e000640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47840725e0 0x7f4784074aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f47a806ef00 tx=0x7f4790009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:50.889+0000 7f479fe00640 1 -- 172.21.15.17:0/2517878185 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4798016410 con 0x7f47a8070ad0 2024-09-10T23:20:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47a80b6960 con 0x7f47a8070ad0 2024-09-10T23:20:51.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f479fe00640 1 -- 172.21.15.17:0/2517878185 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5219 (secure 0 0 0) 0x7f47980f8090 con 0x7f47a8070ad0 2024-09-10T23:20:51.105 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:20:51.105 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":56,"btime":"2024-09-10T23:20:44:138459+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/817445499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":817445499},{"type":"v1","addr":"172.21.15.77:6836","nonce":817445499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/829655954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":829655954},{"type":"v1","addr":"172.21.15.77:6837","nonce":829655954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/4123296985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4123296985},{"type":"v1","addr":"172.21.15.17:6835","nonce":4123296985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:20:40.525388+0000","modified":"2024-09-10T23:20:43.542749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6879},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6879":{"gid":6879,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/4060324884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4060324884},{"type":"v1","addr":"172.21.15.17:6834","nonce":4060324884}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6879,"qdb_cluster":[6879]},"id":5}]} 2024-09-10T23:20:51.106 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 56 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47840725e0 msgr2=0x7f4784074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47840725e0 0x7f4784074aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f47a806ef00 tx=0x7f4790009040 comp rx=0 tx=0).stop 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 msgr2=0x7f47a80b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 0x7f47a80b70e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f4798000c10 tx=0x7f4798004040 comp rx=0 tx=0).stop 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 shutdown_connections 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47840725e0 0x7f4784074aa0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a80d1830 0x7f47a815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47a80cf320 0x7f47a814fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 --2- 172.21.15.17:0/2517878185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47a8070ad0 0x7f47a80b70e0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 >> 172.21.15.17:0/2517878185 conn(0x7f47a80d1d60 msgr2=0x7f47a80b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 shutdown_connections 2024-09-10T23:20:51.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.101+0000 7f47ade00640 1 -- 172.21.15.17:0/2517878185 wait complete. 2024-09-10T23:20:51.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:20:40.525388+0000', 'modified': '2024-09-10T23:20:43.542749+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6879}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6879': {'gid': 6879, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6834/4060324884', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6832', 'nonce': 4060324884}, {'type': 'v1', 'addr': '172.21.15.17:6834', 'nonce': 4060324884}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6879, 'qdb_cluster': [6879]} 2024-09-10T23:20:51.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:20:51.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:20:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 -- 172.21.15.17:0/2798879555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f015dd70 msgr2=0x7f86f015e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 --2- 172.21.15.17:0/2798879555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f015dd70 0x7f86f015e200 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009bf0 tx=0x7f86e801f390 comp rx=0 tx=0).stop 2024-09-10T23:20:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 -- 172.21.15.17:0/2798879555 shutdown_connections 2024-09-10T23:20:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 --2- 172.21.15.17:0/2798879555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f015dd70 0x7f86f015e200 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 -- 172.21.15.17:0/2798879555 >> 172.21.15.17:0/2798879555 conn(0x7f86f00b1730 msgr2=0x7f86f00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 -- 172.21.15.17:0/2798879555 shutdown_connections 2024-09-10T23:20:51.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 -- 172.21.15.17:0/2798879555 wait complete. 2024-09-10T23:20:51.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 Processor -- start 2024-09-10T23:20:51.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 -- start start 2024-09-10T23:20:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f00b4a90 0x7f86f01f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86f0157c70 0x7f86f00cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86f015dd70 0x7f86f01f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f86f006ea80 con 0x7f86f00b4a90 2024-09-10T23:20:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f86f006e900 con 0x7f86f0157c70 2024-09-10T23:20:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f7800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f86f006ec00 con 0x7f86f015dd70 2024-09-10T23:20:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f00b4a90 0x7f86f01f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f00b4a90 0x7f86f01f8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47352/0 (socket says 172.21.15.17:47352) 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86f4e00640 1 -- 172.21.15.17:0/1399362561 learned_addr learned my addr 172.21.15.17:0/1399362561 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.677+0000 7f86e7e00640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86f0157c70 0x7f86f00cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f5800640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86f015dd70 0x7f86f01f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f4e00640 1 -- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86f015dd70 msgr2=0x7f86f01f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f4e00640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86f015dd70 0x7f86f01f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f4e00640 1 -- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86f0157c70 msgr2=0x7f86f00cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f4e00640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86f0157c70 0x7f86f00cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f4e00640 1 -- 172.21.15.17:0/1399362561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00517a0 con 0x7f86f00b4a90 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86e7e00640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86f0157c70 0x7f86f00cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f5800640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86f015dd70 0x7f86f01f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f4e00640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f00b4a90 0x7f86f01f8000 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f86e000c500 tx=0x7f86e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86ed600640 1 -- 172.21.15.17:0/1399362561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0017070 con 0x7f86f00b4a90 2024-09-10T23:20:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86ed600640 1 -- 172.21.15.17:0/1399362561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86e00053c0 con 0x7f86f00b4a90 2024-09-10T23:20:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f7800640 1 -- 172.21.15.17:0/1399362561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f01f4a10 con 0x7f86f00b4a90 2024-09-10T23:20:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86ed600640 1 -- 172.21.15.17:0/1399362561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0012890 con 0x7f86f00b4a90 2024-09-10T23:20:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86f7800640 1 -- 172.21.15.17:0/1399362561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f01f87c0 con 0x7f86f00b4a90 2024-09-10T23:20:51.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.681+0000 7f86ed600640 1 -- 172.21.15.17:0/1399362561 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f86e0003600 con 0x7f86f00b4a90 2024-09-10T23:20:51.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86ed600640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86cc0725e0 0x7f86cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 Processor -- start 2024-09-10T23:20:51.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86ed600640 1 -- 172.21.15.17:0/1399362561 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f86e0092ad0 con 0x7f86f00b4a90 2024-09-10T23:20:51.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 -- start start 2024-09-10T23:20:51.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86e7e00640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86cc0725e0 0x7f86cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08c34db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08c352f0 0x556f08be88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08be8e10 0x556f08be91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556f08b093f0 con 0x556f08be8e10 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556f08a46b20 con 0x556f08c349d0 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556f08a35f50 con 0x556f08c352f0 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86e7e00640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86cc0725e0 0x7f86cc074aa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f86f01f7f60 tx=0x7f86d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08be8e10 0x556f08be91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08be8e10 0x556f08be91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47368/0 (socket says 172.21.15.17:47368) 2024-09-10T23:20:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f5800640 1 -- 172.21.15.17:0/3546581020 learned_addr learned my addr 172.21.15.17:0/3546581020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86e7e00640 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08c352f0 0x556f08be88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f4e00640 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08c34db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f4e00640 1 -- 172.21.15.17:0/3546581020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08c352f0 msgr2=0x556f08be88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f4e00640 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08c352f0 0x556f08be88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f4e00640 1 -- 172.21.15.17:0/3546581020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08be8e10 msgr2=0x556f08be91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f4e00640 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08be8e10 0x556f08be91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f4e00640 1 -- 172.21.15.17:0/3546581020 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f089fd590 con 0x556f08c349d0 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f5800640 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08be8e10 0x556f08be91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86f4e00640 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08c34db0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f86e0090e60 tx=0x7f86e0000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86b9667dd10c2e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86e5600640 1 -- 172.21.15.17:0/3546581020 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0066d90 con 0x556f08c349d0 2024-09-10T23:20:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86e5600640 1 -- 172.21.15.17:0/3546581020 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86e0059bf0 con 0x556f08c349d0 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86e5600640 1 -- 172.21.15.17:0/3546581020 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e005ee20 con 0x556f08c349d0 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 -- 172.21.15.17:0/3546581020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 msgr2=0x556f08c34db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08c34db0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f86e0090e60 tx=0x7f86e0000ee0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 -- 172.21.15.17:0/3546581020 shutdown_connections 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08be8e10 0x556f08be91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08c352f0 0x556f08be88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 --2- 172.21.15.17:0/3546581020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08c34db0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.685+0000 7f86fab1d000 1 -- 172.21.15.17:0/3546581020 >> 172.21.15.17:0/3546581020 conn(0x556f08ad2130 msgr2=0x556f08c17e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 -- 172.21.15.17:0/3546581020 shutdown_connections 2024-09-10T23:20:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 -- 172.21.15.17:0/3546581020 wait complete. 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 -- start start 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 Processor -- start 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08c156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c349d0 0x556f08c15e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c352f0 0x556f08c163b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556f089d05d0 con 0x556f08c349d0 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556f08a39d60 con 0x556f08c352f0 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556f089dc500 con 0x556f08be8e10 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 10 client.0 _ll_register_callbacks cb 0x556f089e0810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c349d0 0x556f08c15e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c349d0 0x556f08c15e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47380/0 (socket says 172.21.15.17:47380) 2024-09-10T23:20:51.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86e7e00640 1 -- 172.21.15.17:0/613038500 learned_addr learned my addr 172.21.15.17:0/613038500 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86f5800640 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c352f0 0x556f08c163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86f4e00640 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08c156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86e7e00640 1 -- 172.21.15.17:0/613038500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 msgr2=0x556f08c156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86e7e00640 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08c156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86e7e00640 1 -- 172.21.15.17:0/613038500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c352f0 msgr2=0x556f08c163b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86e7e00640 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c352f0 0x556f08c163b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86e7e00640 1 -- 172.21.15.17:0/613038500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f089d4170 con 0x556f08c349d0 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86e7e00640 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c349d0 0x556f08c15e70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f86d800eec0 tx=0x7f86d8004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7096211f5e8fc44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86de000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86de000640 1 -- 172.21.15.17:0/613038500 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8025020 con 0x556f08c349d0 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 -- 172.21.15.17:0/613038500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556f089ce0f0 con 0x556f08c349d0 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86de000640 1 -- 172.21.15.17:0/613038500 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f86d8010040 con 0x556f08c349d0 2024-09-10T23:20:51.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86de000640 1 -- 172.21.15.17:0/613038500 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f86d802f050 con 0x556f08c349d0 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 10 client.7035 fetch_fsmap learned FSMap version 56 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 -- 172.21.15.17:0/613038500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x556f08abaef0 con 0x556f08c349d0 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86de000640 1 -- 172.21.15.17:0/613038500 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556f089ce0f0 con 0x556f08c349d0 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86de000640 1 -- 172.21.15.17:0/613038500 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f86d8032020 con 0x556f08c349d0 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 10 client.7035 fetch_fsmap finished waiting for FSMap version 56 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 10 client.7035 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 20 client.7035 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] conn(0x556f08c170f0 0x556f08c46c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 4 client.7035 mds_command: new command op to 6879 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.689+0000 7f86fab1d000 1 -- 172.21.15.17:0/613038500 --> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f08a48a70 con 0x556f08c170f0 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86f4e00640 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] conn(0x556f08c170f0 0x556f08c46c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86f4e00640 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] conn(0x556f08c170f0 0x556f08c46c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82a7b42715ac59d6 server_cookie=537abf6cf17178bc in_seq=0 out_seq=0 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86de000640 10 client.7035 ms_handle_connect on v2:172.21.15.17:6832/4060324884 2024-09-10T23:20:51.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86de000640 1 -- 172.21.15.17:0/613038500 <== mds.0 v2:172.21.15.17:6832/4060324884 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f08a48a70 con 0x556f08c170f0 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86de000640 10 client.7035 handle_command_reply: tid=0 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 client.7035 shutdown 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 -- 172.21.15.17:0/613038500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c349d0 msgr2=0x556f08c15e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c349d0 0x556f08c15e70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f86d800eec0 tx=0x7f86d8004630 comp rx=0 tx=0).stop 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 -- 172.21.15.17:0/613038500 shutdown_connections 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c352f0 0x556f08c163b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c349d0 0x556f08c15e70 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] conn(0x556f08c170f0 0x556f08c46c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 --2- 172.21.15.17:0/613038500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08c156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 -- 172.21.15.17:0/613038500 >> 172.21.15.17:0/613038500 conn(0x556f08ad2130 msgr2=0x556f08be7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86de000640 0 client.7035 ms_handle_reset on v2:172.21.15.17:6832/4060324884 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 -- 172.21.15.17:0/613038500 shutdown_connections 2024-09-10T23:20:51.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 1 -- 172.21.15.17:0/613038500 wait complete. 2024-09-10T23:20:51.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.693+0000 7f86fab1d000 20 client.7035 trim_cache size 0 max 16384 2024-09-10T23:20:51.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 Processor -- start 2024-09-10T23:20:51.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 -- start start 2024-09-10T23:20:51.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08ca6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08ca7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08ca7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f86f02016e0 con 0x556f08c352f0 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f86f015bc60 con 0x556f08c349d0 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00cb890 con 0x556f08be8e10 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08ca7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08ca7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47386/0 (socket says 172.21.15.17:47386) 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f5800640 1 -- 172.21.15.17:0/3242726043 learned_addr learned my addr 172.21.15.17:0/3242726043 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f4e00640 1 --2- 172.21.15.17:0/3242726043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08ca6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86e7e00640 1 --2- 172.21.15.17:0/3242726043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08ca7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f5800640 1 -- 172.21.15.17:0/3242726043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 msgr2=0x556f08ca6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:51.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f5800640 1 --2- 172.21.15.17:0/3242726043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08ca6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f5800640 1 -- 172.21.15.17:0/3242726043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 msgr2=0x556f08ca7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:51.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f5800640 1 --2- 172.21.15.17:0/3242726043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08ca7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f5800640 1 -- 172.21.15.17:0/3242726043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f08a91d90 con 0x556f08c352f0 2024-09-10T23:20:51.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86f5800640 1 --2- 172.21.15.17:0/3242726043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08ca7850 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f86e801cfc0 tx=0x7f86e801c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8feb3da07a8b5110 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:51.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86e4c00640 1 -- 172.21.15.17:0/3242726043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80b4040 con 0x556f08c352f0 2024-09-10T23:20:51.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86e4c00640 1 -- 172.21.15.17:0/3242726043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86e80c0030 con 0x556f08c352f0 2024-09-10T23:20:51.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86e4c00640 1 -- 172.21.15.17:0/3242726043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8004570 con 0x556f08c352f0 2024-09-10T23:20:51.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 -- 172.21.15.17:0/3242726043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 msgr2=0x556f08ca7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 --2- 172.21.15.17:0/3242726043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08ca7850 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f86e801cfc0 tx=0x7f86e801c130 comp rx=0 tx=0).stop 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 -- 172.21.15.17:0/3242726043 shutdown_connections 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 --2- 172.21.15.17:0/3242726043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08ca7850 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 --2- 172.21.15.17:0/3242726043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08ca7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 --2- 172.21.15.17:0/3242726043 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08ca6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 -- 172.21.15.17:0/3242726043 >> 172.21.15.17:0/3242726043 conn(0x556f08ad2130 msgr2=0x556f08bf0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 -- 172.21.15.17:0/3242726043 shutdown_connections 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.713+0000 7f86fab1d000 1 -- 172.21.15.17:0/3242726043 wait complete. 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 -- start start 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 Processor -- start 2024-09-10T23:20:51.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08caa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08caaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08cab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556f08a01ec0 con 0x556f08c352f0 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f86f014bc60 con 0x556f08c349d0 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556f089ef1c0 con 0x556f08be8e10 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 10 client.0 _ll_register_callbacks cb 0x7f86d8001e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08cab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08cab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47390/0 (socket says 172.21.15.17:47390) 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f5800640 1 -- 172.21.15.17:0/380448943 learned_addr learned my addr 172.21.15.17:0/380448943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f4e00640 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08caa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86e7e00640 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08caaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f5800640 1 -- 172.21.15.17:0/380448943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 msgr2=0x556f08caa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:51.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f5800640 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08caa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f5800640 1 -- 172.21.15.17:0/380448943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 msgr2=0x556f08caaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f5800640 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08caaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f5800640 1 -- 172.21.15.17:0/380448943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f089fca90 con 0x556f08c352f0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f5800640 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08cab470 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009b10 tx=0x7f86e8004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a0fa9a6cc897ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86de000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86de000640 1 -- 172.21.15.17:0/380448943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80b4070 con 0x556f08c352f0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86de000640 1 -- 172.21.15.17:0/380448943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f86e80044f0 con 0x556f08c352f0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 -- 172.21.15.17:0/380448943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e80c0030 con 0x556f08c352f0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86de000640 1 -- 172.21.15.17:0/380448943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f86e80d6050 con 0x556f08c352f0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 10 client.7041 fetch_fsmap learned FSMap version 56 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 -- 172.21.15.17:0/380448943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x556f089db050 con 0x556f08c352f0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86de000640 1 -- 172.21.15.17:0/380448943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86e80c0030 con 0x556f08c352f0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86de000640 1 -- 172.21.15.17:0/380448943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f86e80d9020 con 0x556f08c352f0 2024-09-10T23:20:51.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 10 client.7041 fetch_fsmap finished waiting for FSMap version 56 2024-09-10T23:20:51.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 10 client.7041 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:20:51.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 20 client.7041 populate_metadata read hostname 'smithi017' 2024-09-10T23:20:51.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] conn(0x556f08c49420 0x556f08c49800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 4 client.7041 mds_command: new command op to 6879 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:20:51.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86fab1d000 1 -- 172.21.15.17:0/380448943 --> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] -- command(tid 0: {"prefix": "status"}) -- 0x556f08a44520 con 0x556f08c49420 2024-09-10T23:20:51.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.717+0000 7f86f4e00640 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] conn(0x556f08c49420 0x556f08c49800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f4e00640 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] conn(0x556f08c49420 0x556f08c49800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60105c47a3f4edf3 server_cookie=f317b2db6563d170 in_seq=0 out_seq=0 2024-09-10T23:20:51.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86de000640 10 client.7041 ms_handle_connect on v2:172.21.15.17:6832/4060324884 2024-09-10T23:20:51.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86de000640 1 -- 172.21.15.17:0/380448943 <== mds.0 v2:172.21.15.17:6832/4060324884 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x556f08a44520 con 0x556f08c49420 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86de000640 10 client.7041 handle_command_reply: tid=0 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 client.7041 shutdown 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 -- 172.21.15.17:0/380448943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 msgr2=0x556f08cab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08cab470 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009b10 tx=0x7f86e8004300 comp rx=0 tx=0).stop 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 -- 172.21.15.17:0/380448943 shutdown_connections 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f08c352f0 0x556f08cab470 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556f08c349d0 0x556f08caaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.17:6832/4060324884,v1:172.21.15.17:6834/4060324884] conn(0x556f08c49420 0x556f08c49800 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 --2- 172.21.15.17:0/380448943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556f08be8e10 0x556f08caa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 -- 172.21.15.17:0/380448943 >> 172.21.15.17:0/380448943 conn(0x556f08ad2130 msgr2=0x556f08c335b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86de000640 0 client.7041 ms_handle_reset on v2:172.21.15.17:6832/4060324884 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 -- 172.21.15.17:0/380448943 shutdown_connections 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 1 -- 172.21.15.17:0/380448943 wait complete. 2024-09-10T23:20:51.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86fab1d000 20 client.7041 trim_cache size 0 max 16384 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 6879, 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 10.605673705999999, 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 56, 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 87, 2024-09-10T23:20:51.730 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 87, 2024-09-10T23:20:51.731 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 15.064484035 2024-09-10T23:20:51.731 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:20:51.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 -- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86cc0725e0 msgr2=0x7f86cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86cc0725e0 0x7f86cc074aa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f86f01f7f60 tx=0x7f86d8009040 comp rx=0 tx=0).stop 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 -- 172.21.15.17:0/1399362561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f00b4a90 msgr2=0x7f86f01f8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f00b4a90 0x7f86f01f8000 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f86e000c500 tx=0x7f86e000c9c0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 -- 172.21.15.17:0/1399362561 shutdown_connections 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86cc0725e0 0x7f86cc074aa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86f015dd70 0x7f86f01f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86f0157c70 0x7f86f00cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 --2- 172.21.15.17:0/1399362561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86f00b4a90 0x7f86f01f8000 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 -- 172.21.15.17:0/1399362561 >> 172.21.15.17:0/1399362561 conn(0x7f86f00b1730 msgr2=0x7f86f00700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 -- 172.21.15.17:0/1399362561 shutdown_connections 2024-09-10T23:20:51.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.721+0000 7f86f7800640 1 -- 172.21.15.17:0/1399362561 wait complete. 2024-09-10T23:20:51.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:20:51.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 -- 172.21.15.17:0/3810527589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00b4390 msgr2=0x7fd5b00d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 --2- 172.21.15.17:0/3810527589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00b4390 0x7fd5b00d02d0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd598009840 tx=0x7fd59801c820 comp rx=0 tx=0).stop 2024-09-10T23:20:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 -- 172.21.15.17:0/3810527589 shutdown_connections 2024-09-10T23:20:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 --2- 172.21.15.17:0/3810527589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00b4390 0x7fd5b00d02d0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 --2- 172.21.15.17:0/3810527589 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5b00cef60 0x7fd5b00cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 -- 172.21.15.17:0/3810527589 >> 172.21.15.17:0/3810527589 conn(0x7fd5b00b3870 msgr2=0x7fd5b00b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 -- 172.21.15.17:0/3810527589 shutdown_connections 2024-09-10T23:20:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 -- 172.21.15.17:0/3810527589 wait complete. 2024-09-10T23:20:51.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 Processor -- start 2024-09-10T23:20:51.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 -- start start 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5b00b4390 0x7fd5b01f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b00cef60 0x7fd5b01580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00cf340 0x7fd5b0166000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0169530 con 0x7fd5b00cf340 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01693b0 con 0x7fd5b00cef60 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5b5a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b01696b0 con 0x7fd5b00b4390 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5af400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00cf340 0x7fd5b0166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5af400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00cf340 0x7fd5b0166000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47410/0 (socket says 172.21.15.17:47410) 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5af400640 1 -- 172.21.15.17:0/2760221548 learned_addr learned my addr 172.21.15.17:0/2760221548 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b00cef60 0x7fd5b01580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5aea00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5b00b4390 0x7fd5b01f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5af400640 1 -- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5b00b4390 msgr2=0x7fd5b01f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5af400640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5b00b4390 0x7fd5b01f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5af400640 1 -- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b00cef60 msgr2=0x7fd5b01580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5af400640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b00cef60 0x7fd5b01580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5af400640 1 -- 172.21.15.17:0/2760221548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b01f9550 con 0x7fd5b00cf340 2024-09-10T23:20:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.889+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b00cef60 0x7fd5b01580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:20:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5af400640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00cf340 0x7fd5b0166000 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c9f0 tx=0x7fd5a800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:51.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5a6a00640 1 -- 172.21.15.17:0/2760221548 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8016020 con 0x7fd5b00cf340 2024-09-10T23:20:51.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5a6a00640 1 -- 172.21.15.17:0/2760221548 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5a8012920 con 0x7fd5b00cf340 2024-09-10T23:20:51.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5a6a00640 1 -- 172.21.15.17:0/2760221548 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8012d70 con 0x7fd5b00cf340 2024-09-10T23:20:51.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b00ce3a0 con 0x7fd5b00cf340 2024-09-10T23:20:51.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b00b7470 con 0x7fd5b00cf340 2024-09-10T23:20:51.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b015fb90 con 0x7fd5b00cf340 2024-09-10T23:20:51.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5a6a00640 1 -- 172.21.15.17:0/2760221548 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd5a801b400 con 0x7fd5b00cf340 2024-09-10T23:20:51.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5a6a00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd58c072610 0x7fd58c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:51.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.893+0000 7fd5a6a00640 1 -- 172.21.15.17:0/2760221548 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fd5a8093860 con 0x7fd5b00cf340 2024-09-10T23:20:51.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.897+0000 7fd5aea00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd58c072610 0x7fd58c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:51.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.897+0000 7fd5aea00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd58c072610 0x7fd58c074ad0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0005d90 tx=0x7fd5a0005c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:51.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:51.897+0000 7fd5a6a00640 1 -- 172.21.15.17:0/2760221548 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd5a8020020 con 0x7fd5b00cf340 2024-09-10T23:20:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.109+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd5b00b7ca0 con 0x7fd5b00cf340 2024-09-10T23:20:52.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.109+0000 7fd5a6a00640 1 -- 172.21.15.17:0/2760221548 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7fd5b01f9550 con 0x7fd5b00cf340 2024-09-10T23:20:52.114 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:20:52.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd58c072610 msgr2=0x7fd58c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:52.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd58c072610 0x7fd58c074ad0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0005d90 tx=0x7fd5a0005c60 comp rx=0 tx=0).stop 2024-09-10T23:20:52.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00cf340 msgr2=0x7fd5b0166000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00cf340 0x7fd5b0166000 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c9f0 tx=0x7fd5a800cae0 comp rx=0 tx=0).stop 2024-09-10T23:20:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 shutdown_connections 2024-09-10T23:20:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd58c072610 0x7fd58c074ad0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00cf340 0x7fd5b0166000 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b00cef60 0x7fd5b01580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 --2- 172.21.15.17:0/2760221548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5b00b4390 0x7fd5b01f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 >> 172.21.15.17:0/2760221548 conn(0x7fd5b00b3870 msgr2=0x7fd5b00ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 shutdown_connections 2024-09-10T23:20:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52.113+0000 7fd5b5a00640 1 -- 172.21.15.17:0/2760221548 wait complete. 2024-09-10T23:20:52.135 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:20:52.135 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:20:52.135 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:20:52.135 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:20:52.135 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:52.135 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:20:52.135 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:20:52.136 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:20:52.136 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:20:52.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:52.136 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:20:52.145 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:20:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:20:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:20:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:20:52.145 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:52.145 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42119sec preferred_lft 42119sec 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:20:52.146 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:52.147 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:20:52.148 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:52.148 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:20:52.148 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:52.148 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:20:52.148 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:52.148 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:20:52.148 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:20:52.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:52.149 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:20:52.213 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:20:52.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:52.216 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:20:52.269 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:20:52.269 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:20:52.269 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:20:52.269 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:20:52.269 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:20:52.269 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:20:52.270 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:20:52.270 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:20:52.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:20:52.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:20:52.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:20:52.270 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:20:52.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:20:52.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:20:52.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:52.407 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:20:52.464 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:20:52.465 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:20:52.465 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:20:52.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:52.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:20:52.527 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:20:52.528 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:20:52.528 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:20:52.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:20:52.580 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:52.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:20:52.700 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:20:52.757 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:20:52.757 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:20:52.757 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:20:52.757 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:20:52.757 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:20:52.757 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:20:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:20:52.759 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:20:52.759 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:20:52.759 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:20:52.759 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:20:52.759 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:20:52.759 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:20:52.759 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:20:52.760 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:20:52.760 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:20:52.760 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:52.760 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:52.760 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:52.760 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:52.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:52.761 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:20:52.812 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:20:52.812 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:20:52.858 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:20:52.880 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:20:52.934 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:20:52.934 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:20:52.934 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:20:52.935 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:20:52.935 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:20:52.935 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:20:52.935 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:20:52.935 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:20:52.935 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:20:52.935 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:20:52.935 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:20:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:20:52.937 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:20:52.937 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:20:52.937 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:20:52.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:20:52.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:52.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:20:52.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:52.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:20:52.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:52.938 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:20:52.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:20:52.949+0000 7fe218b09580 -1 init, newargv = 0x5606b6975e30 newargc=15 2024-09-10T23:20:52.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[55406]: starting ceph client 2024-09-10T23:20:52.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[55406]: starting fuse 2024-09-10T23:20:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:20:52.965 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:20:52.966 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:20:52.967 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:20:53.094 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.55406.asok 2024-09-10T23:20:53.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:20:53.105 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55406.asok 2024-09-10T23:20:53.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:53.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55406.asok status 2024-09-10T23:20:53.279 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "55406", 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:20:53.280 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7056, 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 7056 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1346756462 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:20:53.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1346756462 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.7056 192.168.0.1:0/1346756462", 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/1346756462", 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 56, 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 87, 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:20:53.282 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:20:53.283 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:20:53.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:53.295 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:20:53.295 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:53.304 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:20:53.304 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:53.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:53.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:53.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:53.368 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-09-10T23:20:53.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:53.427 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-09-10T23:20:53.483 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:20:53.484 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:20:53.484 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-09-10T23:20:53.484 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:20:53.484 DEBUG:teuthology.orchestra.run.smithi017:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-09-10T23:20:53.484 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:20:53.597 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627776 2024-09-10T23:20:53.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:20:53.607 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:20:53.607 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:53.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:20:53.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.841+0000 7f17f2400640 1 -- 172.21.15.17:0/552260528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 msgr2=0x7f17ec0b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:53.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.841+0000 7f17f2400640 1 --2- 172.21.15.17:0/552260528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 0x7f17ec0b13f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0738d0 tx=0x7f17e401cd80 comp rx=0 tx=0).stop 2024-09-10T23:20:53.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.841+0000 7f17f2400640 1 -- 172.21.15.17:0/552260528 shutdown_connections 2024-09-10T23:20:53.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.841+0000 7f17f2400640 1 --2- 172.21.15.17:0/552260528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 0x7f17ec0b13f0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:53.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.841+0000 7f17f2400640 1 --2- 172.21.15.17:0/552260528 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ec0b3360 0x7f17ec0d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:53.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.841+0000 7f17f2400640 1 --2- 172.21.15.17:0/552260528 >> v2:172.21.15.77:3300/0 conn(0x7f17ec15be40 0x7f17ec0cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:53.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.841+0000 7f17f2400640 1 -- 172.21.15.17:0/552260528 >> 172.21.15.17:0/552260528 conn(0x7f17ec0d1d60 msgr2=0x7f17ec0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:53.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.841+0000 7f17f2400640 1 -- 172.21.15.17:0/552260528 shutdown_connections 2024-09-10T23:20:53.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.841+0000 7f17f2400640 1 -- 172.21.15.17:0/552260528 wait complete. 2024-09-10T23:20:53.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 Processor -- start 2024-09-10T23:20:53.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 -- start start 2024-09-10T23:20:53.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec0b3360 0x7f17ec153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:53.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 0x7f17ec1f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:53.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ec15be40 0x7f17ec165e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec0afc60 con 0x7f17ec0d08f0 2024-09-10T23:20:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec0afae0 con 0x7f17ec0b3360 2024-09-10T23:20:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec0afde0 con 0x7f17ec15be40 2024-09-10T23:20:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 0x7f17ec1f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 0x7f17ec1f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47440/0 (socket says 172.21.15.17:47440) 2024-09-10T23:20:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3e00640 1 -- 172.21.15.17:0/847378304 learned_addr learned my addr 172.21.15.17:0/847378304 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:53.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17eb400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec0b3360 0x7f17ec153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:53.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17ebe00640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ec15be40 0x7f17ec165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:53.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3e00640 1 -- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ec15be40 msgr2=0x7f17ec165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:53.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3e00640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ec15be40 0x7f17ec165e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:53.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3e00640 1 -- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec0b3360 msgr2=0x7f17ec153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:53.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3e00640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec0b3360 0x7f17ec153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:53.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3e00640 1 -- 172.21.15.17:0/847378304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec0b7810 con 0x7f17ec0d08f0 2024-09-10T23:20:53.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3e00640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 0x7f17ec1f6d20 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f17d400d700 tx=0x7f17d400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:53.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3400640 1 -- 172.21.15.17:0/847378304 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4017070 con 0x7f17ec0d08f0 2024-09-10T23:20:53.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3400640 1 -- 172.21.15.17:0/847378304 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17d4009d20 con 0x7f17ec0d08f0 2024-09-10T23:20:53.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17e3400640 1 -- 172.21.15.17:0/847378304 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4004280 con 0x7f17ec0d08f0 2024-09-10T23:20:53.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec0b7af0 con 0x7f17ec0d08f0 2024-09-10T23:20:53.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.845+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec164860 con 0x7f17ec0d08f0 2024-09-10T23:20:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.849+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ec0b13f0 con 0x7f17ec0d08f0 2024-09-10T23:20:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.849+0000 7f17e3400640 1 -- 172.21.15.17:0/847378304 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f17d4003600 con 0x7f17ec0d08f0 2024-09-10T23:20:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.849+0000 7f17e3400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c80725e0 0x7f17c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.849+0000 7f17e3400640 1 -- 172.21.15.17:0/847378304 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f17d4093400 con 0x7f17ec0d08f0 2024-09-10T23:20:53.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.849+0000 7f17eb400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c80725e0 0x7f17c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:53.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.849+0000 7f17eb400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c80725e0 0x7f17c8074aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00bb50 tx=0x7f17dc00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:53.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:53.853+0000 7f17e3400640 1 -- 172.21.15.17:0/847378304 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f17d405e2f0 con 0x7f17ec0d08f0 2024-09-10T23:20:54.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f17ec164cd0 con 0x7f17ec0d08f0 2024-09-10T23:20:54.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17e3400640 1 -- 172.21.15.17:0/847378304 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) ==== 80+0+0 (secure 0 0 0) 0x7f17d4062d20 con 0x7f17ec0d08f0 2024-09-10T23:20:54.045 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:20:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c80725e0 msgr2=0x7f17c8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c80725e0 0x7f17c8074aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00bb50 tx=0x7f17dc00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 msgr2=0x7f17ec1f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 0x7f17ec1f6d20 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f17d400d700 tx=0x7f17d400dbc0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 shutdown_connections 2024-09-10T23:20:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f17c80725e0 0x7f17c8074aa0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17ec15be40 0x7f17ec165e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17ec0d08f0 0x7f17ec1f6d20 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 --2- 172.21.15.17:0/847378304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17ec0b3360 0x7f17ec153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 >> 172.21.15.17:0/847378304 conn(0x7f17ec0d1d60 msgr2=0x7f17ec0cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:54.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 shutdown_connections 2024-09-10T23:20:54.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.041+0000 7f17f2400640 1 -- 172.21.15.17:0/847378304 wait complete. 2024-09-10T23:20:54.066 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:20:54.066 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:20:54.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:20:54.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.265+0000 7f95c1600640 1 -- 172.21.15.17:0/321495698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 msgr2=0x7f95bc0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:54.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.265+0000 7f95c1600640 1 --2- 172.21.15.17:0/321495698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 0x7f95bc0d1de0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0b2b00 tx=0x7f95b401cd80 comp rx=0 tx=0).stop 2024-09-10T23:20:54.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.265+0000 7f95c1600640 1 -- 172.21.15.17:0/321495698 shutdown_connections 2024-09-10T23:20:54.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.265+0000 7f95c1600640 1 --2- 172.21.15.17:0/321495698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 0x7f95bc0d1de0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.265+0000 7f95c1600640 1 --2- 172.21.15.17:0/321495698 >> v2:172.21.15.77:3300/0 conn(0x7f95bc15bd60 0x7f95bc0cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.265+0000 7f95c1600640 1 -- 172.21.15.17:0/321495698 >> 172.21.15.17:0/321495698 conn(0x7f95bc09a9f0 msgr2=0x7f95bc09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:54.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.265+0000 7f95c1600640 1 -- 172.21.15.17:0/321495698 shutdown_connections 2024-09-10T23:20:54.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.265+0000 7f95c1600640 1 -- 172.21.15.17:0/321495698 wait complete. 2024-09-10T23:20:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 Processor -- start 2024-09-10T23:20:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 -- start start 2024-09-10T23:20:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 0x7f95bc153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95bc15b980 0x7f95bc0711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95bc15bd60 0x7f95bc0716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc168ab0 con 0x7f95bc0d1990 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc168930 con 0x7f95bc15bd60 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f95bc168c30 con 0x7f95bc15b980 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 0x7f95bc153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 0x7f95bc153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47466/0 (socket says 172.21.15.17:47466) 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bbe00640 1 -- 172.21.15.17:0/3588787067 learned_addr learned my addr 172.21.15.17:0/3588787067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c0c00640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95bc15bd60 0x7f95bc0716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bb400640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95bc15b980 0x7f95bc0711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bbe00640 1 -- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95bc15b980 msgr2=0x7f95bc0711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bbe00640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95bc15b980 0x7f95bc0711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bbe00640 1 -- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95bc15bd60 msgr2=0x7f95bc0716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bbe00640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95bc15bd60 0x7f95bc0716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bbe00640 1 -- 172.21.15.17:0/3588787067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc152ed0 con 0x7f95bc0d1990 2024-09-10T23:20:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95bbe00640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 0x7f95bc153b50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00c530 tx=0x7f95ac00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:54.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95b3e00640 1 -- 172.21.15.17:0/3588787067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac017070 con 0x7f95bc0d1990 2024-09-10T23:20:54.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95b3e00640 1 -- 172.21.15.17:0/3588787067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95ac003600 con 0x7f95bc0d1990 2024-09-10T23:20:54.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95b3e00640 1 -- 172.21.15.17:0/3588787067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac003a50 con 0x7f95bc0d1990 2024-09-10T23:20:54.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95bc0c7010 con 0x7f95bc0d1990 2024-09-10T23:20:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.269+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95bc153350 con 0x7f95bc0d1990 2024-09-10T23:20:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.273+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95bc0d1de0 con 0x7f95bc0d1990 2024-09-10T23:20:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.273+0000 7f95b3e00640 1 -- 172.21.15.17:0/3588787067 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f95ac003bf0 con 0x7f95bc0d1990 2024-09-10T23:20:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.273+0000 7f95b3e00640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f959c0725e0 0x7f959c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:20:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.273+0000 7f95b3e00640 1 -- 172.21.15.17:0/3588787067 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f95ac092e30 con 0x7f95bc0d1990 2024-09-10T23:20:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.273+0000 7f95bb400640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f959c0725e0 0x7f959c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:20:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.273+0000 7f95bb400640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f959c0725e0 0x7f959c074aa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f95bc1fa670 tx=0x7f95a80091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:20:54.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.277+0000 7f95b3e00640 1 -- 172.21.15.17:0/3588787067 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f95ac021020 con 0x7f95bc0d1990 2024-09-10T23:20:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.461+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95bc09b0b0 con 0x7f95bc0d1990 2024-09-10T23:20:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.461+0000 7f95b3e00640 1 -- 172.21.15.17:0/3588787067 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v87) ==== 80+0+0 (secure 0 0 0) 0x7f95ac05de60 con 0x7f95bc0d1990 2024-09-10T23:20:54.466 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:20:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f959c0725e0 msgr2=0x7f959c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f959c0725e0 0x7f959c074aa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f95bc1fa670 tx=0x7f95a80091e0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 msgr2=0x7f95bc153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 0x7f95bc153b50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00c530 tx=0x7f95ac00c9f0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 shutdown_connections 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f959c0725e0 0x7f959c074aa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95bc15bd60 0x7f95bc0716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95bc15b980 0x7f95bc0711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 --2- 172.21.15.17:0/3588787067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95bc0d1990 0x7f95bc153b50 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 >> 172.21.15.17:0/3588787067 conn(0x7f95bc09a9f0 msgr2=0x7f95bc0af360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 shutdown_connections 2024-09-10T23:20:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:20:54.465+0000 7f95c1600640 1 -- 172.21.15.17:0/3588787067 wait complete. 2024-09-10T23:20:54.487 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:20:54.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:20:54.487 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:20:54.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[55406]: fuse finished with error 0 and tester_r 0 2024-09-10T23:20:54.508 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:00.610 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:21:00.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:00.611 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:21:00.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:00.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.816+0000 7f528ea00640 1 -- 172.21.15.17:0/243071456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f528815ef40 msgr2=0x7f528815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:00.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.816+0000 7f528ea00640 1 --2- 172.21.15.17:0/243071456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f528815ef40 0x7f528815afe0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f52881555c0 tx=0x7f527801c890 comp rx=0 tx=0).stop 2024-09-10T23:21:00.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.816+0000 7f528ea00640 1 -- 172.21.15.17:0/243071456 shutdown_connections 2024-09-10T23:21:00.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.816+0000 7f528ea00640 1 --2- 172.21.15.17:0/243071456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52880b4370 0x7f52880d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:00.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 --2- 172.21.15.17:0/243071456 >> v2:172.21.15.77:3300/0 conn(0x7f528815e5d0 0x7f52880b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:00.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 --2- 172.21.15.17:0/243071456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f528815ef40 0x7f528815afe0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:00.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 -- 172.21.15.17:0/243071456 >> 172.21.15.17:0/243071456 conn(0x7f528806cfc0 msgr2=0x7f528806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:00.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 -- 172.21.15.17:0/243071456 shutdown_connections 2024-09-10T23:21:00.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 -- 172.21.15.17:0/243071456 wait complete. 2024-09-10T23:21:00.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 Processor -- start 2024-09-10T23:21:00.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 -- start start 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52880b4370 0x7f5288143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f528815e5d0 0x7f528814c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f528815ef40 0x7f528814cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5288070040 con 0x7f52880b4370 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f528806fec0 con 0x7f528815ef40 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52880701c0 con 0x7f528815e5d0 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5287e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52880b4370 0x7f5288143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5287e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52880b4370 0x7f5288143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55516/0 (socket says 172.21.15.17:55516) 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5287e00640 1 -- 172.21.15.17:0/153954222 learned_addr learned my addr 172.21.15.17:0/153954222 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f527fe00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f528815e5d0 0x7f528814c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ca00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f528815ef40 0x7f528814cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5287e00640 1 -- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f528815e5d0 msgr2=0x7f528814c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5287e00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f528815e5d0 0x7f528814c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5287e00640 1 -- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f528815ef40 msgr2=0x7f528814cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5287e00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f528815ef40 0x7f528814cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5287e00640 1 -- 172.21.15.17:0/153954222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52880cd030 con 0x7f52880b4370 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ca00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f528815ef40 0x7f528814cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5287e00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52880b4370 0x7f5288143d50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f52780b0040 tx=0x7f5278004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5284c00640 1 -- 172.21.15.17:0/153954222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52780b2040 con 0x7f52880b4370 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5284c00640 1 -- 172.21.15.17:0/153954222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5278005030 con 0x7f52880b4370 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f5284c00640 1 -- 172.21.15.17:0/153954222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278005480 con 0x7f52880b4370 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.820+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52880cd2d0 con 0x7f52880b4370 2024-09-10T23:21:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.824+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5288165450 con 0x7f52880b4370 2024-09-10T23:21:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.824+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52880b3e30 con 0x7f52880b4370 2024-09-10T23:21:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.824+0000 7f5284c00640 1 -- 172.21.15.17:0/153954222 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f52780046d0 con 0x7f52880b4370 2024-09-10T23:21:00.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.824+0000 7f5284c00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52640725e0 0x7f5264074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:00.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.824+0000 7f5284c00640 1 -- 172.21.15.17:0/153954222 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f527812c3a0 con 0x7f52880b4370 2024-09-10T23:21:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.824+0000 7f527fe00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52640725e0 0x7f5264074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.828+0000 7f527fe00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52640725e0 0x7f5264074aa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5270005fd0 tx=0x7f5270005db0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:00.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:00.828+0000 7f5284c00640 1 -- 172.21.15.17:0/153954222 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f52780164b0 con 0x7f52880b4370 2024-09-10T23:21:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.040+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f528806f440 con 0x7f52880b4370 2024-09-10T23:21:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.040+0000 7f5284c00640 1 -- 172.21.15.17:0/153954222 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5219 (secure 0 0 0) 0x7f52780f78d0 con 0x7f52880b4370 2024-09-10T23:21:01.047 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:01.047 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":56,"btime":"2024-09-10T23:20:44:138459+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6541,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/817445499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":817445499},{"type":"v1","addr":"172.21.15.77:6836","nonce":817445499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/829655954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":829655954},{"type":"v1","addr":"172.21.15.77:6837","nonce":829655954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6550,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/4123296985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4123296985},{"type":"v1","addr":"172.21.15.17:6835","nonce":4123296985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:20:40.525388+0000","modified":"2024-09-10T23:20:43.542749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6879},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6879":{"gid":6879,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6834/4060324884","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":4060324884},{"type":"v1","addr":"172.21.15.17:6834","nonce":4060324884}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6879,"qdb_cluster":[6879]},"id":5}]} 2024-09-10T23:21:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 56 2024-09-10T23:21:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52640725e0 msgr2=0x7f5264074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52640725e0 0x7f5264074aa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5270005fd0 tx=0x7f5270005db0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52880b4370 msgr2=0x7f5288143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52880b4370 0x7f5288143d50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f52780b0040 tx=0x7f5278004040 comp rx=0 tx=0).stop 2024-09-10T23:21:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 shutdown_connections 2024-09-10T23:21:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52640725e0 0x7f5264074aa0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f528815ef40 0x7f528814cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f528815e5d0 0x7f528814c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 --2- 172.21.15.17:0/153954222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52880b4370 0x7f5288143d50 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 >> 172.21.15.17:0/153954222 conn(0x7f528806cfc0 msgr2=0x7f52881473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 shutdown_connections 2024-09-10T23:21:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.044+0000 7f528ea00640 1 -- 172.21.15.17:0/153954222 wait complete. 2024-09-10T23:21:01.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-10T23:21:01.241 INFO:teuthology.orchestra.run.smithi017.stdout:{"message":"","return_code":0} 2024-09-10T23:21:01.241 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T23:21:01.242 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:21:01.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:01.242 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:21:01.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:01.242 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:21:01.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:01.243 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:21:01.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:01.255 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:21:01.256 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:01.256 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:21:01.256 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:01.257 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:21:01.257 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:01.258 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:21:01.258 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:01.258 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-09-10T23:21:01.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 Processor -- start 2024-09-10T23:21:01.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 -- start start 2024-09-10T23:21:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55db019a2040 0x55db019a3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019edab0 0x55db01a825e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019ede90 0x55db019e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55db01a7d010 con 0x55db019edab0 2024-09-10T23:21:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55db018f2a00 con 0x55db019ede90 2024-09-10T23:21:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55db01a7d190 con 0x55db019a2040 2024-09-10T23:21:01.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb717e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019edab0 0x55db01a825e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb717e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019edab0 0x55db01a825e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55534/0 (socket says 172.21.15.17:55534) 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb717e00640 1 -- 172.21.15.17:0/1240029174 learned_addr learned my addr 172.21.15.17:0/1240029174 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb71fa00640 1 --2- 172.21.15.17:0/1240029174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55db019a2040 0x55db019a3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb720400640 1 --2- 172.21.15.17:0/1240029174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019ede90 0x55db019e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb717e00640 1 -- 172.21.15.17:0/1240029174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55db019a2040 msgr2=0x55db019a3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb717e00640 1 --2- 172.21.15.17:0/1240029174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55db019a2040 0x55db019a3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb717e00640 1 -- 172.21.15.17:0/1240029174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019ede90 msgr2=0x55db019e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb717e00640 1 --2- 172.21.15.17:0/1240029174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019ede90 0x55db019e6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb717e00640 1 -- 172.21.15.17:0/1240029174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db018f1a20 con 0x55db019edab0 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb717e00640 1 --2- 172.21.15.17:0/1240029174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019edab0 0x55db01a825e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c680 tx=0x7fb70800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba7f6bf31d21259 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb71e600640 1 -- 172.21.15.17:0/1240029174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70800add0 con 0x55db019edab0 2024-09-10T23:21:01.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb71e600640 1 -- 172.21.15.17:0/1240029174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb708008450 con 0x55db019edab0 2024-09-10T23:21:01.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb71e600640 1 -- 172.21.15.17:0/1240029174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb708008880 con 0x55db019edab0 2024-09-10T23:21:01.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 -- 172.21.15.17:0/1240029174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019edab0 msgr2=0x55db01a825e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.336+0000 7fb722764080 1 --2- 172.21.15.17:0/1240029174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019edab0 0x55db01a825e0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb70800c680 tx=0x7fb70800cb40 comp rx=0 tx=0).stop 2024-09-10T23:21:01.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- 172.21.15.17:0/1240029174 shutdown_connections 2024-09-10T23:21:01.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 --2- 172.21.15.17:0/1240029174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019ede90 0x55db019e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 --2- 172.21.15.17:0/1240029174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019edab0 0x55db01a825e0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 --2- 172.21.15.17:0/1240029174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55db019a2040 0x55db019a3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- 172.21.15.17:0/1240029174 >> 172.21.15.17:0/1240029174 conn(0x55db019d27f0 msgr2=0x55db01a781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- 172.21.15.17:0/1240029174 shutdown_connections 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- 172.21.15.17:0/1240029174 wait complete. 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 Processor -- start 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- start start 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55db019a2040 0x55db019ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019edab0 0x55db01a77fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019ede90 0x55db019a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55db01a82b20 con 0x55db019ede90 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55db01a832a0 con 0x55db019edab0 2024-09-10T23:21:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55db01a5df40 con 0x55db019a2040 2024-09-10T23:21:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb720400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019ede90 0x55db019a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb720400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019ede90 0x55db019a3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55546/0 (socket says 172.21.15.17:55546) 2024-09-10T23:21:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb720400640 1 -- 172.21.15.17:0/2658109991 learned_addr learned my addr 172.21.15.17:0/2658109991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb717e00640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019edab0 0x55db01a77fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb71fa00640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55db019a2040 0x55db019ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb720400640 1 -- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55db019a2040 msgr2=0x55db019ecbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb720400640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55db019a2040 0x55db019ecbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb720400640 1 -- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019edab0 msgr2=0x55db01a77fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb720400640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019edab0 0x55db01a77fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb720400640 1 -- 172.21.15.17:0/2658109991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db018cbc10 con 0x55db019ede90 2024-09-10T23:21:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb717e00640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db019edab0 0x55db01a77fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:21:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb720400640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019ede90 0x55db019a3750 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb71800d620 tx=0x7fb71800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb71d200640 1 -- 172.21.15.17:0/2658109991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718004220 con 0x55db019ede90 2024-09-10T23:21:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb71d200640 1 -- 172.21.15.17:0/2658109991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb718014070 con 0x55db019ede90 2024-09-10T23:21:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db01a5e1e0 con 0x55db019ede90 2024-09-10T23:21:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb71d200640 1 -- 172.21.15.17:0/2658109991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718010bc0 con 0x55db019ede90 2024-09-10T23:21:01.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.340+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db01a5e720 con 0x55db019ede90 2024-09-10T23:21:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.344+0000 7fb71d200640 1 -- 172.21.15.17:0/2658109991 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb718018420 con 0x55db019ede90 2024-09-10T23:21:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.344+0000 7fb71d200640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6fc070ff0 0x7fb6fc0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.344+0000 7fb71d200640 1 -- 172.21.15.17:0/2658109991 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fb718092de0 con 0x55db019ede90 2024-09-10T23:21:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.344+0000 7fb722764080 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x55db01a5d800 0x55db01a5b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.344+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 --> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87) -- 0x55db01a78510 con 0x55db01a5d800 2024-09-10T23:21:01.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.344+0000 7fb71fa00640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6fc070ff0 0x7fb6fc0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.344+0000 7fb717e00640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x55db01a5d800 0x55db01a5b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.344+0000 7fb717e00640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x55db01a5d800 0x55db01a5b420 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.344+0000 7fb71fa00640 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6fc070ff0 0x7fb6fc0734b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb7100ab000 tx=0x7fb7100199c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb717e00640 1 -- 172.21.15.17:0/2658109991 <== osd.0 v2:172.21.15.17:6824/2280070654 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v87'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb708004cf0 con 0x55db01a5d800 2024-09-10T23:21:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x55db01a5d800 msgr2=0x55db01a5b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x55db01a5d800 0x55db01a5b420 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6fc070ff0 msgr2=0x7fb6fc0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6fc070ff0 0x7fb6fc0734b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb7100ab000 tx=0x7fb7100199c0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019ede90 msgr2=0x55db019a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 --2- 172.21.15.17:0/2658109991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55db019ede90 0x55db019a3750 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb71800d620 tx=0x7fb71800dae0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb720400640 1 -- 172.21.15.17:0/2658109991 reap_dead start 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 shutdown_connections 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 >> 172.21.15.17:0/2658109991 conn(0x55db019d27f0 msgr2=0x55db019e3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 shutdown_connections 2024-09-10T23:21:01.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.348+0000 7fb722764080 1 -- 172.21.15.17:0/2658109991 wait complete. 2024-09-10T23:21:01.358 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-09-10T23:21:01.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-10T23:21:01.359 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-09-10T23:21:01.359 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-10T23:21:01.359 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-09-10T23:21:01.359 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-10T23:21:01.360 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-09-10T23:21:01.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-10T23:21:01.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f51b6e00640 1 -- 172.21.15.17:0/1753652640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51b00b3360 msgr2=0x7f51b00d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f51b6e00640 1 --2- 172.21.15.17:0/1753652640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51b00b3360 0x7f51b00d0580 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f519c009840 tx=0x7f519c01c6b0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f51b6e00640 1 -- 172.21.15.17:0/1753652640 shutdown_connections 2024-09-10T23:21:01.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f51b6e00640 1 --2- 172.21.15.17:0/1753652640 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51b00b3360 0x7f51b00d0580 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f51b6e00640 1 -- 172.21.15.17:0/1753652640 >> 172.21.15.17:0/1753652640 conn(0x7f51b00d1d60 msgr2=0x7f51b00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f51b6e00640 1 -- 172.21.15.17:0/1753652640 shutdown_connections 2024-09-10T23:21:01.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f51b6e00640 1 -- 172.21.15.17:0/1753652640 wait complete. 2024-09-10T23:21:01.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f5e96800640 1 -- 172.21.15.17:0/2408337980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e900b3360 msgr2=0x7f5e900d0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f5e96800640 1 --2- 172.21.15.17:0/2408337980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e900b3360 0x7f5e900d0580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c009840 tx=0x7f5e7c01c820 comp rx=0 tx=0).stop 2024-09-10T23:21:01.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f5e96800640 1 -- 172.21.15.17:0/2408337980 shutdown_connections 2024-09-10T23:21:01.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f5e96800640 1 --2- 172.21.15.17:0/2408337980 >> v2:172.21.15.17:3300/0 conn(0x7f5e900af8d0 0x7f5e900afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f5e96800640 1 --2- 172.21.15.17:0/2408337980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e900b3360 0x7f5e900d0580 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f5e96800640 1 -- 172.21.15.17:0/2408337980 >> 172.21.15.17:0/2408337980 conn(0x7f5e900d1d60 msgr2=0x7f5e900d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f5e96800640 1 -- 172.21.15.17:0/2408337980 shutdown_connections 2024-09-10T23:21:01.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.508+0000 7f5e96800640 1 -- 172.21.15.17:0/2408337980 wait complete. 2024-09-10T23:21:01.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51b6e00640 1 Processor -- start 2024-09-10T23:21:01.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51b6e00640 1 -- start start 2024-09-10T23:21:01.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f3d7c200640 1 -- 172.21.15.17:0/1270310686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d740b53a0 msgr2=0x7f3d74070ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f3d7c200640 1 --2- 172.21.15.17:0/1270310686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d740b53a0 0x7f3d74070ef0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3d740cdfc0 tx=0x7f3d6001c600 comp rx=0 tx=0).stop 2024-09-10T23:21:01.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f3d7c200640 1 -- 172.21.15.17:0/1270310686 shutdown_connections 2024-09-10T23:21:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f3d7c200640 1 --2- 172.21.15.17:0/1270310686 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d74071430 0x7f3d7415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f3d7c200640 1 --2- 172.21.15.17:0/1270310686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d740b53a0 0x7f3d74070ef0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f3d7c200640 1 --2- 172.21.15.17:0/1270310686 >> v2:172.21.15.17:3300/0 conn(0x7f3d7415bd20 0x7f3d7415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f3d7c200640 1 -- 172.21.15.17:0/1270310686 >> 172.21.15.17:0/1270310686 conn(0x7f3d74072f60 msgr2=0x7f3d74073370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f2657c00640 1 -- 172.21.15.17:0/949676495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 msgr2=0x7f26500d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f2657c00640 1 --2- 172.21.15.17:0/949676495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 0x7f26500d03b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f263c009900 tx=0x7f263c01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f3d7c200640 1 -- 172.21.15.17:0/1270310686 shutdown_connections 2024-09-10T23:21:01.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f3d7c200640 1 -- 172.21.15.17:0/1270310686 wait complete. 2024-09-10T23:21:01.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e96800640 1 Processor -- start 2024-09-10T23:21:01.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f2657c00640 1 -- 172.21.15.17:0/949676495 shutdown_connections 2024-09-10T23:21:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f2657c00640 1 --2- 172.21.15.17:0/949676495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 0x7f26500d03b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f2657c00640 1 --2- 172.21.15.17:0/949676495 >> v2:172.21.15.17:3300/0 conn(0x7f265015be40 0x7f26500cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f2657c00640 1 -- 172.21.15.17:0/949676495 >> 172.21.15.17:0/949676495 conn(0x7f26500d1d60 msgr2=0x7f26500d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f2657c00640 1 -- 172.21.15.17:0/949676495 shutdown_connections 2024-09-10T23:21:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e96800640 1 -- start start 2024-09-10T23:21:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f2657c00640 1 -- 172.21.15.17:0/949676495 wait complete. 2024-09-10T23:21:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51b6e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b00af8d0 0x7f51b01511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51b6e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51b00b3360 0x7f51b015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51b6e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51b015be40 0x7f51b00b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51b6e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0169e20 con 0x7f51b00af8d0 2024-09-10T23:21:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51b6e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0169ca0 con 0x7f51b015be40 2024-09-10T23:21:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51b6e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f51b0169fa0 con 0x7f51b00b3360 2024-09-10T23:21:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b00af8d0 0x7f51b01511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b00af8d0 0x7f51b01511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55582/0 (socket says 172.21.15.17:55582) 2024-09-10T23:21:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51afe00640 1 -- 172.21.15.17:0/3289383782 learned_addr learned my addr 172.21.15.17:0/3289383782 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51af400640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51b00b3360 0x7f51b015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51b4e00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51b015be40 0x7f51b00b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e96800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e900af8d0 0x7f5e900b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e96800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e900b3360 0x7f5e9015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e96800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e9015be40 0x7f5e9015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e96800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5e90168e10 con 0x7f5e900af8d0 2024-09-10T23:21:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e96800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5e90168c90 con 0x7f5e900b3360 2024-09-10T23:21:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e96800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5e90168f90 con 0x7f5e9015be40 2024-09-10T23:21:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51af400640 1 -- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51b015be40 msgr2=0x7f51b00b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51af400640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51b015be40 0x7f51b00b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51af400640 1 -- 172.21.15.17:0/3289383782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b00af8d0 msgr2=0x7f51b01511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51af400640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b00af8d0 0x7f51b01511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51af400640 1 -- 172.21.15.17:0/3289383782 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b0158f70 con 0x7f51b00b3360 2024-09-10T23:21:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51afe00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b00af8d0 0x7f51b01511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:21:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e8f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e900af8d0 0x7f5e900b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e8f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e900af8d0 0x7f5e900b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55590/0 (socket says 172.21.15.17:55590) 2024-09-10T23:21:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e8f400640 1 -- 172.21.15.17:0/1667268227 learned_addr learned my addr 172.21.15.17:0/1667268227 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e8ea00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e900b3360 0x7f5e9015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f5e8fe00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e9015be40 0x7f5e9015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.512+0000 7f51af400640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51b00b3360 0x7f51b015a010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f519c0ac000 tx=0x7f519c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e8f400640 1 -- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e9015be40 msgr2=0x7f5e9015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e8f400640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e9015be40 0x7f5e9015b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e8f400640 1 -- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e900b3360 msgr2=0x7f5e9015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e8f400640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e900b3360 0x7f5e9015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e8f400640 1 -- 172.21.15.17:0/1667268227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e900b5090 con 0x7f5e900af8d0 2024-09-10T23:21:01.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f51a7e00640 1 -- 172.21.15.17:0/3289383782 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c004430 con 0x7f51b00b3360 2024-09-10T23:21:01.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f51a7e00640 1 -- 172.21.15.17:0/3289383782 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f519c005110 con 0x7f51b00b3360 2024-09-10T23:21:01.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f51a7e00640 1 -- 172.21.15.17:0/3289383782 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c005560 con 0x7f51b00b3360 2024-09-10T23:21:01.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b0159250 con 0x7f51b00b3360 2024-09-10T23:21:01.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b0159810 con 0x7f51b00b3360 2024-09-10T23:21:01.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7c200640 1 Processor -- start 2024-09-10T23:21:01.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e8f400640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e900af8d0 0x7f5e900b6130 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c460 tx=0x7f5e8000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7c200640 1 -- start start 2024-09-10T23:21:01.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2657c00640 1 Processor -- start 2024-09-10T23:21:01.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e87400640 1 -- 172.21.15.17:0/1667268227 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80011790 con 0x7f5e900af8d0 2024-09-10T23:21:01.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e87400640 1 -- 172.21.15.17:0/1667268227 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e80017070 con 0x7f5e900af8d0 2024-09-10T23:21:01.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e87400640 1 -- 172.21.15.17:0/1667268227 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80011ce0 con 0x7f5e900af8d0 2024-09-10T23:21:01.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e96800640 1 -- 172.21.15.17:0/1667268227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e900b5370 con 0x7f5e900af8d0 2024-09-10T23:21:01.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e96800640 1 -- 172.21.15.17:0/1667268227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e900b5930 con 0x7f5e900af8d0 2024-09-10T23:21:01.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2657c00640 1 -- start start 2024-09-10T23:21:01.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b00afce0 con 0x7f51b00b3360 2024-09-10T23:21:01.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d74071430 0x7f3d7414eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d740b53a0 0x7f3d7414c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7415bd20 0x7f3d7415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740cf8c0 con 0x7f3d740b53a0 2024-09-10T23:21:01.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740cf740 con 0x7f3d7415bd20 2024-09-10T23:21:01.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d740cfa40 con 0x7f3d74071430 2024-09-10T23:21:01.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7a200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7415bd20 0x7f3d7415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7a200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7415bd20 0x7f3d7415a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50910/0 (socket says 172.21.15.17:50910) 2024-09-10T23:21:01.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7a200640 1 -- 172.21.15.17:0/821145755 learned_addr learned my addr 172.21.15.17:0/821145755 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:01.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d79800640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d74071430 0x7f3d7414eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f5e84c00640 1 -- 172.21.15.17:0/1667268227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e900afd40 con 0x7f5e900af8d0 2024-09-10T23:21:01.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2657c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 0x7f26501f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2657c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26500d08f0 0x7f26501650f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2657c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265015be40 0x7f265006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2657c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2650169290 con 0x7f265015be40 2024-09-10T23:21:01.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2657c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2650169110 con 0x7f26500d08f0 2024-09-10T23:21:01.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2657c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2650169410 con 0x7f26500b3360 2024-09-10T23:21:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d78e00640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d740b53a0 0x7f3d7414c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7a200640 1 -- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d74071430 msgr2=0x7f3d7414eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7a200640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d74071430 0x7f3d7414eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7a200640 1 -- 172.21.15.17:0/821145755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d740b53a0 msgr2=0x7f3d7414c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7a200640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d740b53a0 0x7f3d7414c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7a200640 1 -- 172.21.15.17:0/821145755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7415d350 con 0x7f3d7415bd20 2024-09-10T23:21:01.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2655200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 0x7f26501f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2655200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 0x7f26501f83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56272/0 (socket says 172.21.15.17:56272) 2024-09-10T23:21:01.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2655200640 1 -- 172.21.15.17:0/2614948779 learned_addr learned my addr 172.21.15.17:0/2614948779 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:01.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f264fe00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26500d08f0 0x7f26501650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f3d7a200640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7415bd20 0x7f3d7415a740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00eab0 tx=0x7f3d6c00ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f51a7e00640 1 -- 172.21.15.17:0/3289383782 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f519c0046d0 con 0x7f51b00b3360 2024-09-10T23:21:01.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2655c00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265015be40 0x7f265006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2655200640 1 -- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26500d08f0 msgr2=0x7f26501650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2655200640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26500d08f0 0x7f26501650f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2655200640 1 -- 172.21.15.17:0/2614948779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265015be40 msgr2=0x7f265006ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.516+0000 7f2655200640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265015be40 0x7f265006ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f2655200640 1 -- 172.21.15.17:0/2614948779 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26501fb330 con 0x7f26500b3360 2024-09-10T23:21:01.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f264fe00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26500d08f0 0x7f26501650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:01.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f2655200640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 0x7f26501f83b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f264400d950 tx=0x7f264400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f3d71600640 1 -- 172.21.15.17:0/821145755 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c004b30 con 0x7f3d7415bd20 2024-09-10T23:21:01.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f3d71600640 1 -- 172.21.15.17:0/821145755 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d6c004dc0 con 0x7f3d7415bd20 2024-09-10T23:21:01.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f3d71600640 1 -- 172.21.15.17:0/821145755 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c005240 con 0x7f3d7415bd20 2024-09-10T23:21:01.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d741553d0 con 0x7f3d7415bd20 2024-09-10T23:21:01.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d74155990 con 0x7f3d7415bd20 2024-09-10T23:21:01.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f264cc00640 1 -- 172.21.15.17:0/2614948779 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644017070 con 0x7f26500b3360 2024-09-10T23:21:01.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26501fb610 con 0x7f26500b3360 2024-09-10T23:21:01.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26501fbbd0 con 0x7f26500b3360 2024-09-10T23:21:01.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f264cc00640 1 -- 172.21.15.17:0/2614948779 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2644009d20 con 0x7f26500b3360 2024-09-10T23:21:01.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f264cc00640 1 -- 172.21.15.17:0/2614948779 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644017070 con 0x7f26500b3360 2024-09-10T23:21:01.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f51a7e00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5190072610 0x7f5190074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f5e87400640 1 -- 172.21.15.17:0/1667268227 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5e8001c460 con 0x7f5e900af8d0 2024-09-10T23:21:01.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d500052a0 con 0x7f3d7415bd20 2024-09-10T23:21:01.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f51a7e00640 1 -- 172.21.15.17:0/3289383782 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f519c12d440 con 0x7f51b00b3360 2024-09-10T23:21:01.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f51afe00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5190072610 0x7f5190074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f262c0052a0 con 0x7f26500b3360 2024-09-10T23:21:01.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f51afe00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5190072610 0x7f5190074ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f51a0000f70 tx=0x7f51a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f5e87400640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e70072630 0x7f5e70074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f5e87400640 1 -- 172.21.15.17:0/1667268227 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f5e800939b0 con 0x7f5e900af8d0 2024-09-10T23:21:01.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f5e8ea00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e70072630 0x7f5e70074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.520+0000 7f3d71600640 1 -- 172.21.15.17:0/821145755 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3d6c0053e0 con 0x7f3d7415bd20 2024-09-10T23:21:01.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.524+0000 7f5e8ea00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e70072630 0x7f5e70074af0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0af000 tx=0x7f5e7c01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.524+0000 7f3d71600640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d540725e0 0x7f3d54074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.524+0000 7f3d71600640 1 -- 172.21.15.17:0/821145755 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f3d6c094190 con 0x7f3d7415bd20 2024-09-10T23:21:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.524+0000 7f5e87400640 1 -- 172.21.15.17:0/1667268227 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5e8005f130 con 0x7f5e900af8d0 2024-09-10T23:21:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.524+0000 7f3d79800640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d540725e0 0x7f3d54074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.524+0000 7f3d79800640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d540725e0 0x7f3d54074aa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009b40 tx=0x7f3d680091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.524+0000 7f51a7e00640 1 -- 172.21.15.17:0/3289383782 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f519c016330 con 0x7f51b00b3360 2024-09-10T23:21:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.524+0000 7f264cc00640 1 -- 172.21.15.17:0/2614948779 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2644010460 con 0x7f26500b3360 2024-09-10T23:21:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.528+0000 7f264cc00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26300727e0 0x7f2630074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.528+0000 7f264cc00640 1 -- 172.21.15.17:0/2614948779 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f2644093800 con 0x7f26500b3360 2024-09-10T23:21:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.528+0000 7f264fe00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26300727e0 0x7f2630074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:01.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.528+0000 7f264fe00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26300727e0 0x7f2630074ca0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f263c0af000 tx=0x7f263c01b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:01.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.528+0000 7f3d71600640 1 -- 172.21.15.17:0/821145755 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3d6c05f640 con 0x7f3d7415bd20 2024-09-10T23:21:01.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.528+0000 7f264cc00640 1 -- 172.21.15.17:0/2614948779 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f264405ed30 con 0x7f26500b3360 2024-09-10T23:21:01.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.764+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f51b00c5490 con 0x7f51b00b3360 2024-09-10T23:21:01.773 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:21:01.768+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:21:01.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.768+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f3d50005590 con 0x7f3d7415bd20 2024-09-10T23:21:01.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51a7e00640 1 -- 172.21.15.17:0/3289383782 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6879 v57) ==== 95+0+0 (secure 0 0 0) 0x7f519c1011d0 con 0x7f51b00b3360 2024-09-10T23:21:01.781 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 6879 2024-09-10T23:21:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5190072610 msgr2=0x7f5190074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5190072610 0x7f5190074ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f51a0000f70 tx=0x7f51a0009040 comp rx=0 tx=0).stop 2024-09-10T23:21:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51b00b3360 msgr2=0x7f51b015a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51b00b3360 0x7f51b015a010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f519c0ac000 tx=0x7f519c004040 comp rx=0 tx=0).stop 2024-09-10T23:21:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 shutdown_connections 2024-09-10T23:21:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5190072610 0x7f5190074ad0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51b015be40 0x7f51b00b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51b00b3360 0x7f51b015a010 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 --2- 172.21.15.17:0/3289383782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b00af8d0 0x7f51b01511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 >> 172.21.15.17:0/3289383782 conn(0x7f51b00d1d60 msgr2=0x7f51b00b7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 shutdown_connections 2024-09-10T23:21:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.776+0000 7f51b6e00640 1 -- 172.21.15.17:0/3289383782 wait complete. 2024-09-10T23:21:01.807 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:21:01.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:21:01.810 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:21:01.810 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:01.895 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:21:01.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.916+0000 7f5e84c00640 1 -- 172.21.15.17:0/1667268227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f5e90155960 con 0x7f5e900af8d0 2024-09-10T23:21:01.922 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:21:01.916+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:21:01.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.916+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f262c005860 con 0x7f26500b3360 2024-09-10T23:21:01.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e87400640 1 -- 172.21.15.17:0/1667268227 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6550 v59) ==== 95+0+0 (secure 0 0 0) 0x7f5e8005ea30 con 0x7f5e900af8d0 2024-09-10T23:21:01.924 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 6550 2024-09-10T23:21:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 -- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e70072630 msgr2=0x7f5e70074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e70072630 0x7f5e70074af0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0af000 tx=0x7f5e7c01b060 comp rx=0 tx=0).stop 2024-09-10T23:21:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 -- 172.21.15.17:0/1667268227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e900af8d0 msgr2=0x7f5e900b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e900af8d0 0x7f5e900b6130 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000c460 tx=0x7f5e8000c860 comp rx=0 tx=0).stop 2024-09-10T23:21:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 -- 172.21.15.17:0/1667268227 shutdown_connections 2024-09-10T23:21:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e70072630 0x7f5e70074af0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e9015be40 0x7f5e9015b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e900b3360 0x7f5e9015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 --2- 172.21.15.17:0/1667268227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e900af8d0 0x7f5e900b6130 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 -- 172.21.15.17:0/1667268227 >> 172.21.15.17:0/1667268227 conn(0x7f5e900d1d60 msgr2=0x7f5e90155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 -- 172.21.15.17:0/1667268227 shutdown_connections 2024-09-10T23:21:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.920+0000 7f5e84c00640 1 -- 172.21.15.17:0/1667268227 wait complete. 2024-09-10T23:21:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.924+0000 7f3d71600640 1 -- 172.21.15.17:0/821145755 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6541 v59) ==== 95+0+0 (secure 0 0 0) 0x7f3d6c05ef40 con 0x7f3d7415bd20 2024-09-10T23:21:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 6541 2024-09-10T23:21:01.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d540725e0 msgr2=0x7f3d54074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d540725e0 0x7f3d54074aa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009b40 tx=0x7f3d680091e0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7415bd20 msgr2=0x7f3d7415a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:01.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7415bd20 0x7f3d7415a740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00eab0 tx=0x7f3d6c00ef70 comp rx=0 tx=0).stop 2024-09-10T23:21:01.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 shutdown_connections 2024-09-10T23:21:01.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d540725e0 0x7f3d54074aa0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d7415bd20 0x7f3d7415a740 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d740b53a0 0x7f3d7414c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 --2- 172.21.15.17:0/821145755 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d74071430 0x7f3d7414eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:01.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 >> 172.21.15.17:0/821145755 conn(0x7f3d74072f60 msgr2=0x7f3d740b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:01.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 shutdown_connections 2024-09-10T23:21:01.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:01.928+0000 7f3d7c200640 1 -- 172.21.15.17:0/821145755 wait complete. 2024-09-10T23:21:01.957 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:21:01.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:21:01.962 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:21:01.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:21:01.965 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:21:01.965 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:02.005 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:21:02.006 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:02.050 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:21:02.129 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:21:02.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.936+0000 7f264cc00640 1 -- 172.21.15.17:0/2614948779 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6544 v61) ==== 95+0+0 (secure 0 0 0) 0x7f264405e630 con 0x7f26500b3360 2024-09-10T23:21:02.942 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 6544 2024-09-10T23:21:02.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26300727e0 msgr2=0x7f2630074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:02.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26300727e0 0x7f2630074ca0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f263c0af000 tx=0x7f263c01b120 comp rx=0 tx=0).stop 2024-09-10T23:21:02.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 msgr2=0x7f26501f83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:02.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 0x7f26501f83b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f264400d950 tx=0x7f264400de10 comp rx=0 tx=0).stop 2024-09-10T23:21:02.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 shutdown_connections 2024-09-10T23:21:02.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26300727e0 0x7f2630074ca0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:02.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265015be40 0x7f265006ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:02.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26500d08f0 0x7f26501650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:02.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 --2- 172.21.15.17:0/2614948779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26500b3360 0x7f26501f83b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:02.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 >> 172.21.15.17:0/2614948779 conn(0x7f26500d1d60 msgr2=0x7f26500cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:02.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 shutdown_connections 2024-09-10T23:21:02.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:02.940+0000 7f2657c00640 1 -- 172.21.15.17:0/2614948779 wait complete. 2024-09-10T23:21:02.970 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:21:02.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:21:02.973 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:21:02.973 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:02.973 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:03.054 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:21:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 -- 172.21.15.17:0/157368834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c4415bc70 msgr2=0x7f6c440d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 --2- 172.21.15.17:0/157368834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c4415bc70 0x7f6c440d05a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f6c440b0d60 tx=0x7f6c3c01cc60 comp rx=0 tx=0).stop 2024-09-10T23:21:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 -- 172.21.15.17:0/157368834 shutdown_connections 2024-09-10T23:21:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 --2- 172.21.15.17:0/157368834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c4415bc70 0x7f6c440d05a0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 --2- 172.21.15.17:0/157368834 >> v2:172.21.15.77:3300/0 conn(0x7f6c440d20c0 0x7f6c44072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 -- 172.21.15.17:0/157368834 >> 172.21.15.17:0/157368834 conn(0x7f6c4409a9f0 msgr2=0x7f6c4409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 -- 172.21.15.17:0/157368834 shutdown_connections 2024-09-10T23:21:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 -- 172.21.15.17:0/157368834 wait complete. 2024-09-10T23:21:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 Processor -- start 2024-09-10T23:21:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.160+0000 7f6c4b000640 1 -- start start 2024-09-10T23:21:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c440d20c0 0x7f6c4414abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4b000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4415b890 0x7f6c4414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4415bc70 0x7f6c4414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6c44071fc0 con 0x7f6c440d20c0 2024-09-10T23:21:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c44071e40 con 0x7f6c4415bc70 2024-09-10T23:21:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4b000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c441686f0 con 0x7f6c4415b890 2024-09-10T23:21:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c440d20c0 0x7f6c4414abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c440d20c0 0x7f6c4414abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55644/0 (socket says 172.21.15.17:55644) 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49c00640 1 -- 172.21.15.17:0/3738826049 learned_addr learned my addr 172.21.15.17:0/3738826049 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4a600640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4415bc70 0x7f6c4414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49200640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4415b890 0x7f6c4414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49c00640 1 -- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4415b890 msgr2=0x7f6c4414b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49c00640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4415b890 0x7f6c4414b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49c00640 1 -- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4415bc70 msgr2=0x7f6c4414b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49c00640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4415bc70 0x7f6c4414b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49c00640 1 -- 172.21.15.17:0/3738826049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c440b5800 con 0x7f6c440d20c0 2024-09-10T23:21:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c49c00640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c440d20c0 0x7f6c4414abf0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c500 tx=0x7f6c3800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c41600640 1 -- 172.21.15.17:0/3738826049 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38017070 con 0x7f6c440d20c0 2024-09-10T23:21:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c41600640 1 -- 172.21.15.17:0/3738826049 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c38003600 con 0x7f6c440d20c0 2024-09-10T23:21:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c440b5ae0 con 0x7f6c440d20c0 2024-09-10T23:21:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c41600640 1 -- 172.21.15.17:0/3738826049 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38003a50 con 0x7f6c440d20c0 2024-09-10T23:21:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c440b54b0 con 0x7f6c440d20c0 2024-09-10T23:21:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c44072320 con 0x7f6c440d20c0 2024-09-10T23:21:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.164+0000 7f6c41600640 1 -- 172.21.15.17:0/3738826049 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6c38003bf0 con 0x7f6c440d20c0 2024-09-10T23:21:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.168+0000 7f6c41600640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c240725e0 0x7f6c24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.168+0000 7f6c41600640 1 -- 172.21.15.17:0/3738826049 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f6c38092c10 con 0x7f6c440d20c0 2024-09-10T23:21:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.168+0000 7f6c49200640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c240725e0 0x7f6c24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:03.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.168+0000 7f6c49200640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c240725e0 0x7f6c24074aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6c44156900 tx=0x7f6c300091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.172+0000 7f6c41600640 1 -- 172.21.15.17:0/3738826049 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6c3805e160 con 0x7f6c440d20c0 2024-09-10T23:21:03.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.380+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c440d08c0 con 0x7f6c440d20c0 2024-09-10T23:21:03.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c41600640 1 -- 172.21.15.17:0/3738826049 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+4394 (secure 0 0 0) 0x7f6c3805da60 con 0x7f6c440d20c0 2024-09-10T23:21:03.388 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:03.389 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":61,"btime":"2024-09-10T23:21:02:935710+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1386694568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1386694568},{"type":"v1","addr":"172.21.15.77:6835","nonce":1386694568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/946073344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":946073344},{"type":"v1","addr":"172.21.15.17:6835","nonce":946073344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:20:40.525388+0000","modified":"2024-09-10T23:21:01.953060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":60,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.17:6833/1816876754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1816876754},{"type":"v1","addr":"172.21.15.17:6833","nonce":1816876754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-10T23:21:03.389 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 61 2024-09-10T23:21:03.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c240725e0 msgr2=0x7f6c24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:03.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c240725e0 0x7f6c24074aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6c44156900 tx=0x7f6c300091e0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c440d20c0 msgr2=0x7f6c4414abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c440d20c0 0x7f6c4414abf0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c500 tx=0x7f6c3800c9c0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 shutdown_connections 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c240725e0 0x7f6c24074aa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c4415bc70 0x7f6c4414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c4415b890 0x7f6c4414b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 --2- 172.21.15.17:0/3738826049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c440d20c0 0x7f6c4414abf0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 >> 172.21.15.17:0/3738826049 conn(0x7f6c4409a9f0 msgr2=0x7f6c440aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 shutdown_connections 2024-09-10T23:21:03.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:03.384+0000 7f6c4b000640 1 -- 172.21.15.17:0/3738826049 wait complete. 2024-09-10T23:21:03.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:20:40.525388+0000', 'modified': '2024-09-10T23:21:01.953060+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7116}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7116': {'gid': 7116, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.17:6833/1816876754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6832', 'nonce': 1816876754}, {'type': 'v1', 'addr': '172.21.15.17:6833', 'nonce': 1816876754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:21:03.814 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7116:up:reconnect 2024-09-10T23:21:04.815 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 -- 172.21.15.17:0/3234450888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c0d1830 msgr2=0x7f2c6c15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 --2- 172.21.15.17:0/3234450888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c0d1830 0x7f2c6c15f5a0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0d2e60 tx=0x7f2c5401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:21:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 -- 172.21.15.17:0/3234450888 shutdown_connections 2024-09-10T23:21:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 --2- 172.21.15.17:0/3234450888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c0d1830 0x7f2c6c15f5a0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 --2- 172.21.15.17:0/3234450888 >> v2:172.21.15.77:3300/0 conn(0x7f2c6c070ad0 0x7f2c6c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 -- 172.21.15.17:0/3234450888 >> 172.21.15.17:0/3234450888 conn(0x7f2c6c0d1d60 msgr2=0x7f2c6c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 -- 172.21.15.17:0/3234450888 shutdown_connections 2024-09-10T23:21:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 -- 172.21.15.17:0/3234450888 wait complete. 2024-09-10T23:21:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 Processor -- start 2024-09-10T23:21:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.972+0000 7f2c71c00640 1 -- start start 2024-09-10T23:21:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c71c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c070ad0 0x7f2c6c14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c71c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c6c0cf320 0x7f2c6c0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c71c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c6c0d1830 0x7f2c6c14fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c71c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1693d0 con 0x7f2c6c070ad0 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c71c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c169250 con 0x7f2c6c0cf320 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c71c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c169550 con 0x7f2c6c0d1830 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c070ad0 0x7f2c6c14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c070ad0 0x7f2c6c14eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55666/0 (socket says 172.21.15.17:55666) 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6aa00640 1 -- 172.21.15.17:0/2184359172 learned_addr learned my addr 172.21.15.17:0/2184359172 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c63e00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c6c0cf320 0x7f2c6c0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6b400640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c6c0d1830 0x7f2c6c14fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6aa00640 1 -- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c6c0d1830 msgr2=0x7f2c6c14fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6aa00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c6c0d1830 0x7f2c6c14fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6aa00640 1 -- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c6c0cf320 msgr2=0x7f2c6c0c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6aa00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c6c0cf320 0x7f2c6c0c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6aa00640 1 -- 172.21.15.17:0/2184359172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c150810 con 0x7f2c6c070ad0 2024-09-10T23:21:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c6aa00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c070ad0 0x7f2c6c14eda0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00d980 tx=0x7f2c5c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c62a00640 1 -- 172.21.15.17:0/2184359172 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c017070 con 0x7f2c6c070ad0 2024-09-10T23:21:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c62a00640 1 -- 172.21.15.17:0/2184359172 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c5c009d60 con 0x7f2c6c070ad0 2024-09-10T23:21:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c62a00640 1 -- 172.21.15.17:0/2184359172 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c005280 con 0x7f2c6c070ad0 2024-09-10T23:21:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c0c7230 con 0x7f2c6c070ad0 2024-09-10T23:21:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c0c77f0 con 0x7f2c6c070ad0 2024-09-10T23:21:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c0cfc60 con 0x7f2c6c070ad0 2024-09-10T23:21:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.976+0000 7f2c62a00640 1 -- 172.21.15.17:0/2184359172 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2c5c005420 con 0x7f2c6c070ad0 2024-09-10T23:21:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.980+0000 7f2c62a00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c480725e0 0x7f2c48074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.980+0000 7f2c62a00640 1 -- 172.21.15.17:0/2184359172 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f2c5c0936e0 con 0x7f2c6c070ad0 2024-09-10T23:21:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.980+0000 7f2c63e00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c480725e0 0x7f2c48074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.980+0000 7f2c63e00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c480725e0 0x7f2c48074aa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2c540af000 tx=0x7f2c5401b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:04.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:04.984+0000 7f2c62a00640 1 -- 172.21.15.17:0/2184359172 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2c6c150810 con 0x7f2c6c070ad0 2024-09-10T23:21:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c6c0b6580 con 0x7f2c6c070ad0 2024-09-10T23:21:05.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c62a00640 1 -- 172.21.15.17:0/2184359172 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7f2c5c067180 con 0x7f2c6c070ad0 2024-09-10T23:21:05.201 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:05.201 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":63,"btime":"2024-09-10T23:21:04:942490+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1386694568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1386694568},{"type":"v1","addr":"172.21.15.77:6835","nonce":1386694568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/4074525293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":4074525293},{"type":"v1","addr":"172.21.15.77:6837","nonce":4074525293}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/946073344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":946073344},{"type":"v1","addr":"172.21.15.17:6835","nonce":946073344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:20:40.525388+0000","modified":"2024-09-10T23:21:04.942484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6833/1816876754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1816876754},{"type":"v1","addr":"172.21.15.17:6833","nonce":1816876754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7116,"qdb_cluster":[7116]},"id":5}]} 2024-09-10T23:21:05.201 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 63 2024-09-10T23:21:05.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c480725e0 msgr2=0x7f2c48074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c480725e0 0x7f2c48074aa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2c540af000 tx=0x7f2c5401b100 comp rx=0 tx=0).stop 2024-09-10T23:21:05.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c070ad0 msgr2=0x7f2c6c14eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c070ad0 0x7f2c6c14eda0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00d980 tx=0x7f2c5c00de40 comp rx=0 tx=0).stop 2024-09-10T23:21:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 shutdown_connections 2024-09-10T23:21:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c480725e0 0x7f2c48074aa0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c6c0d1830 0x7f2c6c14fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c6c0cf320 0x7f2c6c0c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 --2- 172.21.15.17:0/2184359172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c6c070ad0 0x7f2c6c14eda0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 >> 172.21.15.17:0/2184359172 conn(0x7f2c6c0d1d60 msgr2=0x7f2c6c0b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 shutdown_connections 2024-09-10T23:21:05.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.196+0000 7f2c71c00640 1 -- 172.21.15.17:0/2184359172 wait complete. 2024-09-10T23:21:05.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:20:40.525388+0000', 'modified': '2024-09-10T23:21:04.942484+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7116}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7116': {'gid': 7116, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.17:6833/1816876754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6832', 'nonce': 1816876754}, {'type': 'v1', 'addr': '172.21.15.17:6833', 'nonce': 1816876754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7116, 'qdb_cluster': [7116]} 2024-09-10T23:21:05.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:21:05.626 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:21:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 -- 172.21.15.17:0/1191629805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15d7d0 msgr2=0x7f8cfc15dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 --2- 172.21.15.17:0/1191629805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15d7d0 0x7f8cfc15dde0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009900 tx=0x7f8cec01c520 comp rx=0 tx=0).stop 2024-09-10T23:21:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 -- 172.21.15.17:0/1191629805 shutdown_connections 2024-09-10T23:21:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 --2- 172.21.15.17:0/1191629805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cfc15e860 0x7f8cfc0726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 --2- 172.21.15.17:0/1191629805 >> v2:172.21.15.77:3300/0 conn(0x7f8cfc0cf090 0x7f8cfc15e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 --2- 172.21.15.17:0/1191629805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15d7d0 0x7f8cfc15dde0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 -- 172.21.15.17:0/1191629805 >> 172.21.15.17:0/1191629805 conn(0x7f8cfc0b1730 msgr2=0x7f8cfc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:05.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 -- 172.21.15.17:0/1191629805 shutdown_connections 2024-09-10T23:21:05.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 -- 172.21.15.17:0/1191629805 wait complete. 2024-09-10T23:21:05.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 Processor -- start 2024-09-10T23:21:05.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.772+0000 7f8d02200640 1 -- start start 2024-09-10T23:21:05.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8d02200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cfc0cf090 0x7f8cfc15f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8d02200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc15d7d0 0x7f8cfc1f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8d02200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15e860 0x7f8cfc1f9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8d02200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc06eee0 con 0x7f8cfc15e860 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8d02200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc06ed60 con 0x7f8cfc15d7d0 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8d02200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8cfc06f060 con 0x7f8cfc0cf090 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15e860 0x7f8cfc1f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15e860 0x7f8cfc1f9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55680/0 (socket says 172.21.15.17:55680) 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfbe00640 1 -- 172.21.15.17:0/1651652427 learned_addr learned my addr 172.21.15.17:0/1651652427 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfb400640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cfc0cf090 0x7f8cfc15f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc15d7d0 0x7f8cfc1f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfbe00640 1 -- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cfc0cf090 msgr2=0x7f8cfc15f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfbe00640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cfc0cf090 0x7f8cfc15f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfbe00640 1 -- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc15d7d0 msgr2=0x7f8cfc1f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfbe00640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc15d7d0 0x7f8cfc1f91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfbe00640 1 -- 172.21.15.17:0/1651652427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc1f8f50 con 0x7f8cfc15e860 2024-09-10T23:21:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cfbe00640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15e860 0x7f8cfc1f9700 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400e970 tx=0x7f8cf400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cf3e00640 1 -- 172.21.15.17:0/1651652427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4004d30 con 0x7f8cfc15e860 2024-09-10T23:21:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cf3e00640 1 -- 172.21.15.17:0/1651652427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cf400ca60 con 0x7f8cfc15e860 2024-09-10T23:21:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cf3e00640 1 -- 172.21.15.17:0/1651652427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4005020 con 0x7f8cfc15e860 2024-09-10T23:21:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8d02200640 1 -- 172.21.15.17:0/1651652427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cfc14f750 con 0x7f8cfc15e860 2024-09-10T23:21:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8d02200640 1 -- 172.21.15.17:0/1651652427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cfc14ff90 con 0x7f8cfc15e860 2024-09-10T23:21:05.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.776+0000 7f8cf3e00640 1 -- 172.21.15.17:0/1651652427 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8cf400f040 con 0x7f8cfc15e860 2024-09-10T23:21:05.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf3e00640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd8072610 0x7f8cd8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf3e00640 1 -- 172.21.15.17:0/1651652427 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f8cf40939d0 con 0x7f8cfc15e860 2024-09-10T23:21:05.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8d05540000 1 Processor -- start 2024-09-10T23:21:05.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cfb400640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd8072610 0x7f8cd8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8d05540000 1 -- start start 2024-09-10T23:21:05.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cfb400640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd8072610 0x7f8cd8074ad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0ae000 tx=0x7f8cec01ad60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:05.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8d05540000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761df00 0x5622e761e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8d05540000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761e820 0x5622e75d3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8d05540000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 0x5622e75d4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8d05540000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5622e74ee3f0 con 0x5622e761e820 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8d05540000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5622e742bb20 con 0x5622e761df00 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8d05540000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5622e741af50 con 0x5622e75d4230 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761e820 0x5622e75d3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761e820 0x5622e75d3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55694/0 (socket says 172.21.15.17:55694) 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf2a00640 1 -- 172.21.15.17:0/1150954377 learned_addr learned my addr 172.21.15.17:0/1150954377 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cfbe00640 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 0x5622e75d4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cfb400640 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761df00 0x5622e761e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf2a00640 1 -- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 msgr2=0x5622e75d4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 0x5622e75d4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf2a00640 1 -- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761df00 msgr2=0x5622e761e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761df00 0x5622e761e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf2a00640 1 -- 172.21.15.17:0/1150954377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e73e2590 con 0x5622e761e820 2024-09-10T23:21:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cfbe00640 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 0x5622e75d4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cfb400640 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761df00 0x5622e761e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761e820 0x5622e75d3cf0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400bc50 tx=0x7f8ce400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d333e7f09d0bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cebe00640 1 -- 172.21.15.17:0/1150954377 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4004260 con 0x5622e761e820 2024-09-10T23:21:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cebe00640 1 -- 172.21.15.17:0/1150954377 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce4004400 con 0x5622e761e820 2024-09-10T23:21:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.780+0000 7f8cebe00640 1 -- 172.21.15.17:0/1150954377 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4003840 con 0x5622e761e820 2024-09-10T23:21:05.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- 172.21.15.17:0/1150954377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761e820 msgr2=0x5622e75d3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761e820 0x5622e75d3cf0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400bc50 tx=0x7f8ce400e820 comp rx=0 tx=0).stop 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- 172.21.15.17:0/1150954377 shutdown_connections 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 0x5622e75d4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761e820 0x5622e75d3cf0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 --2- 172.21.15.17:0/1150954377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761df00 0x5622e761e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- 172.21.15.17:0/1150954377 >> 172.21.15.17:0/1150954377 conn(0x5622e74b7130 msgr2=0x5622e75d5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- 172.21.15.17:0/1150954377 shutdown_connections 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- 172.21.15.17:0/1150954377 wait complete. 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- start start 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 Processor -- start 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e75d4230 0x5622e7608230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7608d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e761e820 0x5622e76092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5622e73b55d0 con 0x5622e761df00 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5622e741ed60 con 0x5622e75d4230 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5622e73c1500 con 0x5622e761e820 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 10 client.0 _ll_register_callbacks cb 0x5622e73c5810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cf2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7608d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cf2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7608d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55696/0 (socket says 172.21.15.17:55696) 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cf2a00640 1 -- 172.21.15.17:0/2858809284 learned_addr learned my addr 172.21.15.17:0/2858809284 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cfb400640 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e75d4230 0x5622e7608230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cfbe00640 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e761e820 0x5622e76092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cf2a00640 1 -- 172.21.15.17:0/2858809284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e761e820 msgr2=0x5622e76092a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e761e820 0x5622e76092a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cf2a00640 1 -- 172.21.15.17:0/2858809284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e75d4230 msgr2=0x5622e7608230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e75d4230 0x5622e7608230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cf2a00640 1 -- 172.21.15.17:0/2858809284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622e73b9170 con 0x5622e761df00 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7608d60 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4000c10 tx=0x7f8ce4003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c72f36e4be89e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8ce8c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8ce8c00640 1 -- 172.21.15.17:0/2858809284 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4003db0 con 0x5622e761df00 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8ce8c00640 1 -- 172.21.15.17:0/2858809284 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f8ce4022ce0 con 0x5622e761df00 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- 172.21.15.17:0/2858809284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5622e73b30f0 con 0x5622e761df00 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8ce8c00640 1 -- 172.21.15.17:0/2858809284 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f8ce4029050 con 0x5622e761df00 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 10 client.7167 fetch_fsmap learned FSMap version 63 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8d05540000 1 -- 172.21.15.17:0/2858809284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x5622e749fef0 con 0x5622e761df00 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.784+0000 7f8ce8c00640 1 -- 172.21.15.17:0/2858809284 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5622e73b30f0 con 0x5622e761df00 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8ce8c00640 1 -- 172.21.15.17:0/2858809284 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f8ce402c020 con 0x5622e761df00 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 10 client.7167 fetch_fsmap finished waiting for FSMap version 63 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 10 client.7167 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 20 client.7167 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x5622e7609cb0 0x5622e760a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 4 client.7167 mds_command: new command op to 7116 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:21:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 -- 172.21.15.17:0/2858809284 --> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622e742da70 con 0x5622e7609cb0 2024-09-10T23:21:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8cfb400640 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x5622e7609cb0 0x5622e760a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8cfb400640 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x5622e7609cb0 0x5622e760a090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbe1046c34523ee5 server_cookie=63db44ce91993ddd in_seq=0 out_seq=0 2024-09-10T23:21:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8ce8c00640 10 client.7167 ms_handle_connect on v2:172.21.15.17:6832/1816876754 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8ce8c00640 1 -- 172.21.15.17:0/2858809284 <== mds.0 v2:172.21.15.17:6832/1816876754 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622e742da70 con 0x5622e7609cb0 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8ce8c00640 10 client.7167 handle_command_reply: tid=0 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 client.7167 shutdown 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 -- 172.21.15.17:0/2858809284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 msgr2=0x5622e7608d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7608d60 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4000c10 tx=0x7f8ce4003830 comp rx=0 tx=0).stop 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 -- 172.21.15.17:0/2858809284 shutdown_connections 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x5622e7609cb0 0x5622e760a090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e761e820 0x5622e76092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7608d60 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 --2- 172.21.15.17:0/2858809284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e75d4230 0x5622e7608230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8ce8c00640 0 client.7167 ms_handle_reset on v2:172.21.15.17:6832/1816876754 2024-09-10T23:21:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 -- 172.21.15.17:0/2858809284 >> 172.21.15.17:0/2858809284 conn(0x5622e74b7130 msgr2=0x5622e75d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 -- 172.21.15.17:0/2858809284 shutdown_connections 2024-09-10T23:21:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 1 -- 172.21.15.17:0/2858809284 wait complete. 2024-09-10T23:21:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.788+0000 7f8d05540000 20 client.7167 trim_cache size 0 max 16384 2024-09-10T23:21:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 Processor -- start 2024-09-10T23:21:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 -- start start 2024-09-10T23:21:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e75d4230 0x5622e7635420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e761df00 0x5622e7635960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761e820 0x5622e761c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc0cdf60 con 0x5622e75d4230 2024-09-10T23:21:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc0ccf60 con 0x5622e761e820 2024-09-10T23:21:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8cfc1f64e0 con 0x5622e761df00 2024-09-10T23:21:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8cfb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e75d4230 0x5622e7635420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8cfb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e75d4230 0x5622e7635420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55698/0 (socket says 172.21.15.17:55698) 2024-09-10T23:21:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8cfb400640 1 -- 172.21.15.17:0/3382112866 learned_addr learned my addr 172.21.15.17:0/3382112866 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8cfb400640 1 -- 172.21.15.17:0/3382112866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e761df00 msgr2=0x5622e7635960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8cfb400640 1 --2- 172.21.15.17:0/3382112866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e761df00 0x5622e7635960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8cfb400640 1 -- 172.21.15.17:0/3382112866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761e820 msgr2=0x5622e761c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8cfb400640 1 --2- 172.21.15.17:0/3382112866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761e820 0x5622e761c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8cfb400640 1 -- 172.21.15.17:0/3382112866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e7476d90 con 0x5622e75d4230 2024-09-10T23:21:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8cfb400640 1 --2- 172.21.15.17:0/3382112866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e75d4230 0x5622e7635420 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009230 tx=0x7f8cec0b7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823686d20ac2bfd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8ceb400640 1 -- 172.21.15.17:0/3382112866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0054d0 con 0x5622e75d4230 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8ceb400640 1 -- 172.21.15.17:0/3382112866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cec0af040 con 0x5622e75d4230 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8ceb400640 1 -- 172.21.15.17:0/3382112866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec004d80 con 0x5622e75d4230 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 -- 172.21.15.17:0/3382112866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e75d4230 msgr2=0x5622e7635420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 --2- 172.21.15.17:0/3382112866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e75d4230 0x5622e7635420 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009230 tx=0x7f8cec0b7040 comp rx=0 tx=0).stop 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 -- 172.21.15.17:0/3382112866 shutdown_connections 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 --2- 172.21.15.17:0/3382112866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761e820 0x5622e761c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 --2- 172.21.15.17:0/3382112866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e761df00 0x5622e7635960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 --2- 172.21.15.17:0/3382112866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e75d4230 0x5622e7635420 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 -- 172.21.15.17:0/3382112866 >> 172.21.15.17:0/3382112866 conn(0x5622e74b7130 msgr2=0x5622e762ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 -- 172.21.15.17:0/3382112866 shutdown_connections 2024-09-10T23:21:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.808+0000 7f8d05540000 1 -- 172.21.15.17:0/3382112866 wait complete. 2024-09-10T23:21:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 -- start start 2024-09-10T23:21:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 Processor -- start 2024-09-10T23:21:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 0x5622e7631670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7631bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761e820 0x5622e76320f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5622e73e6ec0 con 0x5622e761df00 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc0cc910 con 0x5622e761e820 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5622e7423390 con 0x5622e75d4230 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 10 client.0 _ll_register_callbacks cb 0x7f8ce400bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cf2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7631bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cf2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7631bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55710/0 (socket says 172.21.15.17:55710) 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cf2a00640 1 -- 172.21.15.17:0/3226033034 learned_addr learned my addr 172.21.15.17:0/3226033034 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cfbe00640 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761e820 0x5622e76320f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cfb400640 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 0x5622e7631670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cf2a00640 1 -- 172.21.15.17:0/3226033034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 msgr2=0x5622e7631670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 0x5622e7631670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cf2a00640 1 -- 172.21.15.17:0/3226033034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761e820 msgr2=0x5622e76320f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761e820 0x5622e76320f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cf2a00640 1 -- 172.21.15.17:0/3226033034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622e73e1a90 con 0x5622e761df00 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cf2a00640 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7631bb0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400b410 tx=0x7f8ce400b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5733a349a17d2fca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8ce8c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8ce8c00640 1 -- 172.21.15.17:0/3226033034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40053d0 con 0x5622e761df00 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8ce8c00640 1 -- 172.21.15.17:0/3226033034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f8ce4005570 con 0x5622e761df00 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 -- 172.21.15.17:0/3226033034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cec0af040 con 0x5622e761df00 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8ce8c00640 1 -- 172.21.15.17:0/3226033034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f8ce4018420 con 0x5622e761df00 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 10 client.7173 fetch_fsmap learned FSMap version 63 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 -- 172.21.15.17:0/3226033034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x5622e73c0050 con 0x5622e761df00 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8ce8c00640 1 -- 172.21.15.17:0/3226033034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cec0af040 con 0x5622e761df00 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8ce8c00640 1 -- 172.21.15.17:0/3226033034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f8ce402c070 con 0x5622e761df00 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 10 client.7173 fetch_fsmap finished waiting for FSMap version 63 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 10 client.7173 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:21:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 20 client.7173 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x5622e7632630 0x5622e7632a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 4 client.7173 mds_command: new command op to 7116 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8d05540000 1 -- 172.21.15.17:0/3226033034 --> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] -- command(tid 0: {"prefix": "status"}) -- 0x5622e7429520 con 0x5622e7632630 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.812+0000 7f8cfb400640 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x5622e7632630 0x5622e7632a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8ce8c00640 10 client.7173 ms_handle_connect on v2:172.21.15.17:6832/1816876754 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8cfb400640 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x5622e7632630 0x5622e7632a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88ef0c64e8739c33 server_cookie=53f47f17e1b761a7 in_seq=0 out_seq=0 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8ce8c00640 1 -- 172.21.15.17:0/3226033034 <== mds.0 v2:172.21.15.17:6832/1816876754 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5622e7429520 con 0x5622e7632630 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8ce8c00640 10 client.7173 handle_command_reply: tid=0 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 client.7173 shutdown 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 -- 172.21.15.17:0/3226033034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 msgr2=0x5622e7631bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7631bb0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400b410 tx=0x7f8ce400b440 comp rx=0 tx=0).stop 2024-09-10T23:21:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 -- 172.21.15.17:0/3226033034 shutdown_connections 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x5622e7632630 0x5622e7632a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5622e761e820 0x5622e76320f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622e761df00 0x5622e7631bb0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 --2- 172.21.15.17:0/3226033034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5622e75d4230 0x5622e7631670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8ce8c00640 0 client.7173 ms_handle_reset on v2:172.21.15.17:6832/1816876754 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 -- 172.21.15.17:0/3226033034 >> 172.21.15.17:0/3226033034 conn(0x5622e74b7130 msgr2=0x5622e762b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 -- 172.21.15.17:0/3226033034 shutdown_connections 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 1 -- 172.21.15.17:0/3226033034 wait complete. 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d05540000 20 client.7173 trim_cache size 0 max 16384 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:21:05.825 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7116, 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 3.8852396699999998, 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 63, 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 91, 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 91, 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 3.9224541849999999 2024-09-10T23:21:05.826 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:21:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 -- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd8072610 msgr2=0x7f8cd8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd8072610 0x7f8cd8074ad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0ae000 tx=0x7f8cec01ad60 comp rx=0 tx=0).stop 2024-09-10T23:21:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 -- 172.21.15.17:0/1651652427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15e860 msgr2=0x7f8cfc1f9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15e860 0x7f8cfc1f9700 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400e970 tx=0x7f8cf400ed70 comp rx=0 tx=0).stop 2024-09-10T23:21:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 -- 172.21.15.17:0/1651652427 shutdown_connections 2024-09-10T23:21:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cd8072610 0x7f8cd8074ad0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cfc15e860 0x7f8cfc1f9700 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cfc15d7d0 0x7f8cfc1f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 --2- 172.21.15.17:0/1651652427 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cfc0cf090 0x7f8cfc15f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 -- 172.21.15.17:0/1651652427 >> 172.21.15.17:0/1651652427 conn(0x7f8cfc0b1730 msgr2=0x7f8cfc0b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:05.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 -- 172.21.15.17:0/1651652427 shutdown_connections 2024-09-10T23:21:05.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.816+0000 7f8d02200640 1 -- 172.21.15.17:0/1651652427 wait complete. 2024-09-10T23:21:05.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:21:05.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 -- 172.21.15.17:0/894239200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e415f350 msgr2=0x7f43e40b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 --2- 172.21.15.17:0/894239200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e415f350 0x7f43e40b3130 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f43e40b0e70 tx=0x7f43d801c830 comp rx=0 tx=0).stop 2024-09-10T23:21:05.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 -- 172.21.15.17:0/894239200 shutdown_connections 2024-09-10T23:21:05.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 --2- 172.21.15.17:0/894239200 >> v2:172.21.15.77:3300/0 conn(0x7f43e415f730 0x7f43e40ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 --2- 172.21.15.17:0/894239200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e415f350 0x7f43e40b3130 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 -- 172.21.15.17:0/894239200 >> 172.21.15.17:0/894239200 conn(0x7f43e40d1d10 msgr2=0x7f43e40d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:05.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 -- 172.21.15.17:0/894239200 shutdown_connections 2024-09-10T23:21:05.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 -- 172.21.15.17:0/894239200 wait complete. 2024-09-10T23:21:05.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 Processor -- start 2024-09-10T23:21:05.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.984+0000 7f43ec600640 1 -- start start 2024-09-10T23:21:05.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ec600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e40cec60 0x7f43e415d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ec600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e415f350 0x7f43e4155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ec600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e415f730 0x7f43e4071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ec600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43e4168f60 con 0x7f43e40cec60 2024-09-10T23:21:05.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ec600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43e4168de0 con 0x7f43e415f730 2024-09-10T23:21:05.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ec600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43e41690e0 con 0x7f43e415f350 2024-09-10T23:21:05.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e40cec60 0x7f43e415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e40cec60 0x7f43e415d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55726/0 (socket says 172.21.15.17:55726) 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9c00640 1 -- 172.21.15.17:0/1227000351 learned_addr learned my addr 172.21.15.17:0/1227000351 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9200640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e415f350 0x7f43e4155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ea600640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e415f730 0x7f43e4071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9c00640 1 -- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e415f350 msgr2=0x7f43e4155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9c00640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e415f350 0x7f43e4155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9c00640 1 -- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e415f730 msgr2=0x7f43e4071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9c00640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e415f730 0x7f43e4071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9c00640 1 -- 172.21.15.17:0/1227000351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e40b0300 con 0x7f43e40cec60 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e9c00640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e40cec60 0x7f43e415d960 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f43d80b0040 tx=0x7f43d80a55e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e1600640 1 -- 172.21.15.17:0/1227000351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d80b2040 con 0x7f43e40cec60 2024-09-10T23:21:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e1600640 1 -- 172.21.15.17:0/1227000351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43d80a6dd0 con 0x7f43e40cec60 2024-09-10T23:21:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e40aea10 con 0x7f43e40cec60 2024-09-10T23:21:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e1600640 1 -- 172.21.15.17:0/1227000351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8005290 con 0x7f43e40cec60 2024-09-10T23:21:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e40aefd0 con 0x7f43e40cec60 2024-09-10T23:21:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e40b3130 con 0x7f43e40cec60 2024-09-10T23:21:05.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.988+0000 7f43e1600640 1 -- 172.21.15.17:0/1227000351 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f43d8005430 con 0x7f43e40cec60 2024-09-10T23:21:05.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.992+0000 7f43e1600640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c40725e0 0x7f43c4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:05.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.992+0000 7f43e1600640 1 -- 172.21.15.17:0/1227000351 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f43d812d0a0 con 0x7f43e40cec60 2024-09-10T23:21:05.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.992+0000 7f43e9200640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c40725e0 0x7f43c4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:05.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.992+0000 7f43e9200640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c40725e0 0x7f43c4074aa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f43d00058d0 tx=0x7f43d0005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:06.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:05.996+0000 7f43e1600640 1 -- 172.21.15.17:0/1227000351 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f43d80164b0 con 0x7f43e40cec60 2024-09-10T23:21:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f43e40b0570 con 0x7f43e40cec60 2024-09-10T23:21:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43e1600640 1 -- 172.21.15.17:0/1227000351 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) ==== 53+0+73 (secure 0 0 0) 0x7f43d80f84b0 con 0x7f43e40cec60 2024-09-10T23:21:06.209 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:21:06.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c40725e0 msgr2=0x7f43c4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:06.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c40725e0 0x7f43c4074aa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f43d00058d0 tx=0x7f43d0005860 comp rx=0 tx=0).stop 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e40cec60 msgr2=0x7f43e415d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e40cec60 0x7f43e415d960 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f43d80b0040 tx=0x7f43d80a55e0 comp rx=0 tx=0).stop 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 shutdown_connections 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c40725e0 0x7f43c4074aa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e415f730 0x7f43e4071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e415f350 0x7f43e4155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 --2- 172.21.15.17:0/1227000351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e40cec60 0x7f43e415d960 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 >> 172.21.15.17:0/1227000351 conn(0x7f43e40d1d10 msgr2=0x7f43e40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 shutdown_connections 2024-09-10T23:21:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06.204+0000 7f43ec600640 1 -- 172.21.15.17:0/1227000351 wait complete. 2024-09-10T23:21:06.231 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:21:06.231 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:21:06.231 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:21:06.231 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:21:06.231 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:06.231 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:21:06.232 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:21:06.232 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:21:06.232 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:21:06.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:06.232 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:21:06.242 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42105sec preferred_lft 42105sec 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:06.243 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:21:06.244 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:06.245 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:21:06.245 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:06.245 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:21:06.245 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:06.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:06.245 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:21:06.302 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:21:06.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:06.304 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:21:06.361 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:21:06.361 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:21:06.361 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:21:06.361 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:21:06.361 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:21:06.362 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:21:06.362 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:21:06.362 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:21:06.362 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:21:06.362 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:21:06.362 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:21:06.362 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:21:06.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:21:06.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:21:06.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:06.499 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:21:06.507 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:21:06.507 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:21:06.508 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:21:06.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:06.508 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:21:06.571 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:21:06.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:21:06.571 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:06.619 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:21:06.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:21:06.620 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:06.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:21:06.731 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:21:06.780 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:21:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:21:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:21:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:21:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:21:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:21:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:21:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:21:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:21:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:21:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:06.783 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:06.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:06.784 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:21:06.835 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:21:06.835 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:21:06.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:21:06.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:21:06.903 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:21:06.937 INFO:tasks.ceph.mds.a.smithi017.stderr:2024-09-10T23:21:06.932+0000 7fe45ba00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:21:06.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:21:06.950 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:21:06.950 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:21:06.950 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:21:06.951 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:21:06.952 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:21:06.953 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:06.953 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:06.953 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:06.953 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:06.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:06.954 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:21:06.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:21:06.976+0000 7f0422791580 -1 init, newargv = 0x55b4ea4dbc90 newargc=15 2024-09-10T23:21:06.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[55897]: starting ceph client 2024-09-10T23:21:06.988 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[55897]: starting fuse 2024-09-10T23:21:06.991 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:21:06.991 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:21:06.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:21:06.991 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:21:06.991 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:21:06.991 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:21:06.991 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:21:06.992 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:21:06.993 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:21:06.993 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:21:06.993 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:21:06.993 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:21:06.993 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:21:06.993 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:06.993 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:21:06.993 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:21:07.114 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.55897.asok 2024-09-10T23:21:07.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:21:07.126 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55897.asok 2024-09-10T23:21:07.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:07.126 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55897.asok status 2024-09-10T23:21:07.299 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:21:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:21:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "55897", 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7188, 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:21:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 7188 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 783793989 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 783793989 2024-09-10T23:21:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.7188 192.168.0.1:0/783793989", 2024-09-10T23:21:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/783793989", 2024-09-10T23:21:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:21:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 63, 2024-09-10T23:21:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 91, 2024-09-10T23:21:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:21:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:21:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:21:07.302 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:21:07.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:07.315 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:21:07.315 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:07.324 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:21:07.324 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:07.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:07.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:07.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:07.386 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-10T23:21:07.438 INFO:teuthology.orchestra.run.smithi017.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-09-10T23:21:07.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:21:07.439 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-09-10T23:21:07.439 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-09-10T23:21:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 -- 172.21.15.17:0/743228130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac0b14d0 msgr2=0x7f93ac074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 --2- 172.21.15.17:0/743228130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac0b14d0 0x7f93ac074290 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f939c009900 tx=0x7f939c01c900 comp rx=0 tx=0).stop 2024-09-10T23:21:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 -- 172.21.15.17:0/743228130 shutdown_connections 2024-09-10T23:21:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 --2- 172.21.15.17:0/743228130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac0afa90 0x7f93ac0747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 --2- 172.21.15.17:0/743228130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac0b14d0 0x7f93ac074290 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 -- 172.21.15.17:0/743228130 >> 172.21.15.17:0/743228130 conn(0x7f93ac0d0360 msgr2=0x7f93ac0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 -- 172.21.15.17:0/743228130 shutdown_connections 2024-09-10T23:21:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 -- 172.21.15.17:0/743228130 wait complete. 2024-09-10T23:21:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 Processor -- start 2024-09-10T23:21:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.624+0000 7f93b0a00640 1 -- start start 2024-09-10T23:21:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93b0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac069590 0x7f93ac15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93b0a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac0afa90 0x7f93ac0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93b0a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac0b14d0 0x7f93ac164e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93b0a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93ac1680c0 con 0x7f93ac069590 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93b0a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93ac167f40 con 0x7f93ac0afa90 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93b0a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f93ac168240 con 0x7f93ac0b14d0 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac069590 0x7f93ac15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac069590 0x7f93ac15b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59930/0 (socket says 172.21.15.17:59930) 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a9e00640 1 -- 172.21.15.17:0/261673887 learned_addr learned my addr 172.21.15.17:0/261673887 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a1400640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac0afa90 0x7f93ac0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93aa800640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac0b14d0 0x7f93ac164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a9e00640 1 -- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac0b14d0 msgr2=0x7f93ac164e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a9e00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac0b14d0 0x7f93ac164e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a9e00640 1 -- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac0afa90 msgr2=0x7f93ac0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a9e00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac0afa90 0x7f93ac0c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a9e00640 1 -- 172.21.15.17:0/261673887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ac0ca2d0 con 0x7f93ac069590 2024-09-10T23:21:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a1400640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac0afa90 0x7f93ac0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a9e00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac069590 0x7f93ac15b350 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f939c009850 tx=0x7f939c0a5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a2a00640 1 -- 172.21.15.17:0/261673887 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c0b2040 con 0x7f93ac069590 2024-09-10T23:21:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a2a00640 1 -- 172.21.15.17:0/261673887 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f939c0a6cf0 con 0x7f93ac069590 2024-09-10T23:21:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93b0a00640 1 -- 172.21.15.17:0/261673887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ac0ce710 con 0x7f93ac069590 2024-09-10T23:21:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a2a00640 1 -- 172.21.15.17:0/261673887 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c003840 con 0x7f93ac069590 2024-09-10T23:21:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93b0a00640 1 -- 172.21.15.17:0/261673887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ac0cecd0 con 0x7f93ac069590 2024-09-10T23:21:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.628+0000 7f93a2a00640 1 -- 172.21.15.17:0/261673887 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f939c0039e0 con 0x7f93ac069590 2024-09-10T23:21:07.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a2a00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93880725e0 0x7f9388074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a2a00640 1 -- 172.21.15.17:0/261673887 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f939c12d230 con 0x7f93ac069590 2024-09-10T23:21:07.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 Processor -- start 2024-09-10T23:21:07.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 -- start start 2024-09-10T23:21:07.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93880725e0 0x7f9388074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93880725e0 0x7f9388074aa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9394006fd0 tx=0x7f9394008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbbb60 0x560386cbbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbc480 0x560386c6f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 0x560386c70180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560386acde60 con 0x560386cbc480 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560386abd290 con 0x560386cbbb60 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560386ac10a0 con 0x560386c6fda0 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbc480 0x560386c6f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbc480 0x560386c6f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59944/0 (socket says 172.21.15.17:59944) 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 -- 172.21.15.17:0/2635385881 learned_addr learned my addr 172.21.15.17:0/2635385881 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a9e00640 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbbb60 0x560386cbbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93aa800640 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 0x560386c70180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 -- 172.21.15.17:0/2635385881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 msgr2=0x560386c70180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 0x560386c70180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 -- 172.21.15.17:0/2635385881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbbb60 msgr2=0x560386cbbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbbb60 0x560386cbbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 -- 172.21.15.17:0/2635385881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560386a65fc0 con 0x560386cbc480 2024-09-10T23:21:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93aa800640 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 0x560386c70180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93a1400640 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbc480 0x560386c6f860 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9394009310 tx=0x7f9394010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784e57e6dda2616c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f939aa00640 1 -- 172.21.15.17:0/2635385881 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394024070 con 0x560386cbc480 2024-09-10T23:21:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f939aa00640 1 -- 172.21.15.17:0/2635385881 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93940149b0 con 0x560386cbc480 2024-09-10T23:21:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f939aa00640 1 -- 172.21.15.17:0/2635385881 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394014d60 con 0x560386cbc480 2024-09-10T23:21:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2635385881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbc480 msgr2=0x560386c6f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbc480 0x560386c6f860 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9394009310 tx=0x7f9394010000 comp rx=0 tx=0).stop 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2635385881 shutdown_connections 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 0x560386c70180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbc480 0x560386c6f860 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.632+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2635385881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbbb60 0x560386cbbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2635385881 >> 172.21.15.17:0/2635385881 conn(0x560386b5a430 msgr2=0x560386c9f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2635385881 shutdown_connections 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2635385881 wait complete. 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- start start 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 Processor -- start 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 0x560386c9c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbbb60 0x560386cbaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386cbb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560386a62740 con 0x560386cbbb60 2024-09-10T23:21:07.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560386ad0a90 con 0x560386cbc480 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560386b7d2b0 con 0x560386c6fda0 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 10 client.0 _ll_register_callbacks cb 0x560386b225a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbbb60 0x560386cbaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbbb60 0x560386cbaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59952/0 (socket says 172.21.15.17:59952) 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a1400640 1 -- 172.21.15.17:0/2978917725 learned_addr learned my addr 172.21.15.17:0/2978917725 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a9e00640 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 0x560386c9c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93aa800640 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386cbb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a1400640 1 -- 172.21.15.17:0/2978917725 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 msgr2=0x560386c9c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a1400640 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 0x560386c9c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a1400640 1 -- 172.21.15.17:0/2978917725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 msgr2=0x560386cbb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a1400640 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386cbb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a1400640 1 -- 172.21.15.17:0/2978917725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560386a5b530 con 0x560386cbbb60 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93a1400640 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbbb60 0x560386cbaf10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f9394009f40 tx=0x7f9394014dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e219edbaa3c724 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f938f400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f938f400640 1 -- 172.21.15.17:0/2978917725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939402c020 con 0x560386cbbb60 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2978917725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560386a55670 con 0x560386cbbb60 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f938f400640 1 -- 172.21.15.17:0/2978917725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f9394028430 con 0x560386cbbb60 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f938f400640 1 -- 172.21.15.17:0/2978917725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f9394036050 con 0x560386cbbb60 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 10 client.7203 fetch_fsmap learned FSMap version 63 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2978917725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x560386a86d90 con 0x560386cbbb60 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f938f400640 1 -- 172.21.15.17:0/2978917725 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560386a55670 con 0x560386cbbb60 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f938f400640 1 -- 172.21.15.17:0/2978917725 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f9394039020 con 0x560386cbbb60 2024-09-10T23:21:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 10 client.7203 fetch_fsmap finished waiting for FSMap version 63 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 10 client.7203 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 20 client.7203 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x560386c9d4d0 0x560386c9d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 4 client.7203 mds_command: new command op to 7116 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.636+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2978917725 --> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560386acfdb0 con 0x560386c9d4d0 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93a9e00640 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x560386c9d4d0 0x560386c9d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93a9e00640 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x560386c9d4d0 0x560386c9d8b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a4ff5d585e9acdb server_cookie=64678c6b02cb072a in_seq=0 out_seq=0 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f938f400640 10 client.7203 ms_handle_connect on v2:172.21.15.17:6832/1816876754 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f938f400640 1 -- 172.21.15.17:0/2978917725 <== mds.0 v2:172.21.15.17:6832/1816876754 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560386acfdb0 con 0x560386c9d4d0 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f938f400640 10 client.7203 handle_command_reply: tid=0 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 client.7203 shutdown 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2978917725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbbb60 msgr2=0x560386cbaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbbb60 0x560386cbaf10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f9394009f40 tx=0x7f9394014dc0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2978917725 shutdown_connections 2024-09-10T23:21:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x560386c9d4d0 0x560386c9d8b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386cbb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386cbbb60 0x560386cbaf10 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/2978917725 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386c6fda0 0x560386c9c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f938f400640 0 client.7203 ms_handle_reset on v2:172.21.15.17:6832/1816876754 2024-09-10T23:21:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2978917725 >> 172.21.15.17:0/2978917725 conn(0x560386b5a430 msgr2=0x560386c6ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2978917725 shutdown_connections 2024-09-10T23:21:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 1 -- 172.21.15.17:0/2978917725 wait complete. 2024-09-10T23:21:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.640+0000 7f93b3ec7000 20 client.7203 trim_cache size 0 max 16384 2024-09-10T23:21:07.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 Processor -- start 2024-09-10T23:21:07.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- start start 2024-09-10T23:21:07.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386c9bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 0x560386c9c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386ccde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93ac203bb0 con 0x560386c6fda0 2024-09-10T23:21:07.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93ac1f8740 con 0x560386cbc480 2024-09-10T23:21:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f93ac1f8d90 con 0x560386cbbb60 2024-09-10T23:21:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93a9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386c9bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93a9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386c9bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59966/0 (socket says 172.21.15.17:59966) 2024-09-10T23:21:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93a9e00640 1 -- 172.21.15.17:0/3781417093 learned_addr learned my addr 172.21.15.17:0/3781417093 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93a9e00640 1 -- 172.21.15.17:0/3781417093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 msgr2=0x560386c9c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93a9e00640 1 --2- 172.21.15.17:0/3781417093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 0x560386c9c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93a9e00640 1 -- 172.21.15.17:0/3781417093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 msgr2=0x560386ccde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93a9e00640 1 --2- 172.21.15.17:0/3781417093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386ccde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93a9e00640 1 -- 172.21.15.17:0/3781417093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560386cbc2b0 con 0x560386c6fda0 2024-09-10T23:21:07.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93a9e00640 1 --2- 172.21.15.17:0/3781417093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386c9bcf0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f939c0982e0 tx=0x7f939c119040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89453e971d0db4ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:07.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f939a000640 1 -- 172.21.15.17:0/3781417093 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c0f7b10 con 0x560386c6fda0 2024-09-10T23:21:07.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f939a000640 1 -- 172.21.15.17:0/3781417093 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f939c0f8000 con 0x560386c6fda0 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f939a000640 1 -- 172.21.15.17:0/3781417093 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c0fcae0 con 0x560386c6fda0 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3781417093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 msgr2=0x560386c9bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3781417093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386c9bcf0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f939c0982e0 tx=0x7f939c119040 comp rx=0 tx=0).stop 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3781417093 shutdown_connections 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3781417093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386ccde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3781417093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 0x560386c9c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3781417093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386c9bcf0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3781417093 >> 172.21.15.17:0/3781417093 conn(0x560386b5a430 msgr2=0x560386c6f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3781417093 shutdown_connections 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3781417093 wait complete. 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 -- start start 2024-09-10T23:21:07.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.660+0000 7f93b3ec7000 1 Processor -- start 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386d32090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 0x560386d325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386d32b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560386a41aa0 con 0x560386c6fda0 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560386accc30 con 0x560386cbc480 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560386ac03b0 con 0x560386cbbb60 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 10 client.0 _ll_register_callbacks cb 0x7f9394022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386d32090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386d32090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59970/0 (socket says 172.21.15.17:59970) 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a9e00640 1 -- 172.21.15.17:0/3432564456 learned_addr learned my addr 172.21.15.17:0/3432564456 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a1400640 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 0x560386d325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93aa800640 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386d32b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a9e00640 1 -- 172.21.15.17:0/3432564456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 msgr2=0x560386d325d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a9e00640 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 0x560386d325d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a9e00640 1 -- 172.21.15.17:0/3432564456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 msgr2=0x560386d32b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a9e00640 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386d32b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a9e00640 1 -- 172.21.15.17:0/3432564456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560386a42450 con 0x560386c6fda0 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a1400640 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 0x560386d325d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a9e00640 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386d32090 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f939c005c30 tx=0x7f939c0f7c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64c326f8fd85a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f938f400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f938f400640 1 -- 172.21.15.17:0/3432564456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c101500 con 0x560386c6fda0 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f938f400640 1 -- 172.21.15.17:0/3432564456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f939c124340 con 0x560386c6fda0 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3432564456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f939c0f8000 con 0x560386c6fda0 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f938f400640 1 -- 172.21.15.17:0/3432564456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f939c0fcae0 con 0x560386c6fda0 2024-09-10T23:21:07.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 10 client.7209 fetch_fsmap learned FSMap version 63 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3432564456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x560386a81980 con 0x560386c6fda0 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f938f400640 1 -- 172.21.15.17:0/3432564456 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f939c0f8000 con 0x560386c6fda0 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f938f400640 1 -- 172.21.15.17:0/3432564456 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f939c0f4270 con 0x560386c6fda0 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 10 client.7209 fetch_fsmap finished waiting for FSMap version 63 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 10 client.7209 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 20 client.7209 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x560386cd0fb0 0x560386cd1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 4 client.7209 mds_command: new command op to 7116 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3432564456 --> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x560386acb860 con 0x560386cd0fb0 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a1400640 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x560386cd0fb0 0x560386cd1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f938f400640 10 client.7209 ms_handle_connect on v2:172.21.15.17:6832/1816876754 2024-09-10T23:21:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93a1400640 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x560386cd0fb0 0x560386cd1390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=140294d41ae7d775 server_cookie=2c43d7c30305d812 in_seq=0 out_seq=0 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f938f400640 1 -- 172.21.15.17:0/3432564456 <== mds.0 v2:172.21.15.17:6832/1816876754 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560386acb860 con 0x560386cd0fb0 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f938f400640 10 client.7209 handle_command_reply: tid=0 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 client.7209 shutdown 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3432564456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 msgr2=0x560386d32090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386d32090 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f939c005c30 tx=0x7f939c0f7c20 comp rx=0 tx=0).stop 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3432564456 shutdown_connections 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.17:6832/1816876754,v1:172.21.15.17:6833/1816876754] conn(0x560386cd0fb0 0x560386cd1390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560386cbc480 0x560386d32b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560386cbbb60 0x560386d325d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 --2- 172.21.15.17:0/3432564456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560386c6fda0 0x560386d32090 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.664+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3432564456 >> 172.21.15.17:0/3432564456 conn(0x560386b5a430 msgr2=0x560386c9ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:07.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f938f400640 0 client.7209 ms_handle_reset on v2:172.21.15.17:6832/1816876754 2024-09-10T23:21:07.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3432564456 shutdown_connections 2024-09-10T23:21:07.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b3ec7000 1 -- 172.21.15.17:0/3432564456 wait complete. 2024-09-10T23:21:07.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b3ec7000 20 client.7209 trim_cache size 0 max 16384 2024-09-10T23:21:07.676 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:21:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:21:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "2b441d62-23ef-488b-9ad7-09c01ff79a0c", 2024-09-10T23:21:07.676 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:21:07.676 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:21:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 -- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93880725e0 msgr2=0x7f9388074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93880725e0 0x7f9388074aa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9394006fd0 tx=0x7f9394008040 comp rx=0 tx=0).stop 2024-09-10T23:21:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 -- 172.21.15.17:0/261673887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac069590 msgr2=0x7f93ac15b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac069590 0x7f93ac15b350 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f939c009850 tx=0x7f939c0a5640 comp rx=0 tx=0).stop 2024-09-10T23:21:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 -- 172.21.15.17:0/261673887 shutdown_connections 2024-09-10T23:21:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93880725e0 0x7f9388074aa0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac0b14d0 0x7f93ac164e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac0afa90 0x7f93ac0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 --2- 172.21.15.17:0/261673887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93ac069590 0x7f93ac15b350 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:07.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 -- 172.21.15.17:0/261673887 >> 172.21.15.17:0/261673887 conn(0x7f93ac0d0360 msgr2=0x7f93ac15d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:07.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 -- 172.21.15.17:0/261673887 shutdown_connections 2024-09-10T23:21:07.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:07.668+0000 7f93b0a00640 1 -- 172.21.15.17:0/261673887 wait complete. 2024-09-10T23:21:07.692 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '2b441d62-23ef-488b-9ad7-09c01ff79a0c', 'mode': 'asynchronous'}' 2024-09-10T23:21:17.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:17.693 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-10T23:21:17.708 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:21:17.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:21:17.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:21:17.935 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:21:17.935 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:21:17.936 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:17.936 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:17.945 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:17.945 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:17.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:21:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1183940704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 msgr2=0x7fd2000d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 --2- 172.21.15.17:0/1183940704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 0x7fd2000d22c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009900 tx=0x7fd1f001c8b0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1183940704 shutdown_connections 2024-09-10T23:21:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 --2- 172.21.15.17:0/1183940704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2000d4800 0x7fd2000d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 --2- 172.21.15.17:0/1183940704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 0x7fd2000d22c0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1183940704 >> 172.21.15.17:0/1183940704 conn(0x7fd2000d3ce0 msgr2=0x7fd2000d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1183940704 shutdown_connections 2024-09-10T23:21:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1183940704 wait complete. 2024-09-10T23:21:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 Processor -- start 2024-09-10T23:21:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.196+0000 7fd1ffe00640 1 -- start start 2024-09-10T23:21:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ffe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2000ce7b0 0x7fd2000b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 0x7fd200160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ffe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2000d4800 0x7fd200160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ffe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd20016b320 con 0x7fd2000d0450 2024-09-10T23:21:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ffe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd20015e1d0 con 0x7fd2000d4800 2024-09-10T23:21:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ffe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd20016b4a0 con 0x7fd2000ce7b0 2024-09-10T23:21:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 0x7fd200160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 0x7fd200160830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59972/0 (socket says 172.21.15.17:59972) 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7e00640 1 -- 172.21.15.17:0/1753414407 learned_addr learned my addr 172.21.15.17:0/1753414407 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1fea00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2000ce7b0 0x7fd2000b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ff400640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2000d4800 0x7fd200160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7e00640 1 -- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2000ce7b0 msgr2=0x7fd2000b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7e00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2000ce7b0 0x7fd2000b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7e00640 1 -- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2000d4800 msgr2=0x7fd200160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7e00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2000d4800 0x7fd200160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7e00640 1 -- 172.21.15.17:0/1753414407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2000cab70 con 0x7fd2000d0450 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ff400640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2000d4800 0x7fd200160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7e00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 0x7fd200160830 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800b3f0 tx=0x7fd1e800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7400640 1 -- 172.21.15.17:0/1753414407 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8015020 con 0x7fd2000d0450 2024-09-10T23:21:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7400640 1 -- 172.21.15.17:0/1753414407 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1e8011940 con 0x7fd2000d0450 2024-09-10T23:21:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20015ec40 con 0x7fd2000d0450 2024-09-10T23:21:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1f7400640 1 -- 172.21.15.17:0/1753414407 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8011d90 con 0x7fd2000d0450 2024-09-10T23:21:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20015f200 con 0x7fd2000d0450 2024-09-10T23:21:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.200+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2000d22c0 con 0x7fd2000d0450 2024-09-10T23:21:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.204+0000 7fd1f7400640 1 -- 172.21.15.17:0/1753414407 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd1e801a400 con 0x7fd2000d0450 2024-09-10T23:21:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.204+0000 7fd1f7400640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1dc072610 0x7fd1dc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.204+0000 7fd1f7400640 1 -- 172.21.15.17:0/1753414407 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7fd1e80936d0 con 0x7fd2000d0450 2024-09-10T23:21:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.204+0000 7fd1fea00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1dc072610 0x7fd1dc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:18.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.204+0000 7fd1fea00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1dc072610 0x7fd1dc074ad0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00af000 tx=0x7fd1f001b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:18.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.208+0000 7fd1f7400640 1 -- 172.21.15.17:0/1753414407 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd1e801f020 con 0x7fd2000d0450 2024-09-10T23:21:18.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd2000754e0 con 0x7fd2000d0450 2024-09-10T23:21:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1f7400640 1 -- 172.21.15.17:0/1753414407 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v91) ==== 80+0+244 (secure 0 0 0) 0x7fd1e805ead0 con 0x7fd2000d0450 2024-09-10T23:21:18.401 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6835/4123296985 2024-09-11T23:21:01.922575+0000 2024-09-10T23:21:18.401 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6833/4123296985 2024-09-11T23:21:01.922575+0000 2024-09-10T23:21:18.401 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6834/4060324884 2024-09-11T23:21:01.773560+0000 2024-09-10T23:21:18.402 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6832/4060324884 2024-09-11T23:21:01.773560+0000 2024-09-10T23:21:18.402 INFO:teuthology.orchestra.run.smithi017.stderr:listed 4 entries 2024-09-10T23:21:18.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1dc072610 msgr2=0x7fd1dc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:18.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1dc072610 0x7fd1dc074ad0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00af000 tx=0x7fd1f001b0f0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 msgr2=0x7fd200160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:18.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 0x7fd200160830 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800b3f0 tx=0x7fd1e800b8b0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 shutdown_connections 2024-09-10T23:21:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1dc072610 0x7fd1dc074ad0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2000d4800 0x7fd200160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2000d0450 0x7fd200160830 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 --2- 172.21.15.17:0/1753414407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2000ce7b0 0x7fd2000b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 >> 172.21.15.17:0/1753414407 conn(0x7fd2000d3ce0 msgr2=0x7fd2000cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 shutdown_connections 2024-09-10T23:21:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.396+0000 7fd1ffe00640 1 -- 172.21.15.17:0/1753414407 wait complete. 2024-09-10T23:21:18.422 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:21:18.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:18.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:18.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[55897]: fuse finished with error 0 and tester_r 0 2024-09-10T23:21:18.443 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:21:18.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:18.444 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:21:18.577 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:21:18.578 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:21:18.578 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:18.587 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:21:18.587 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:21:18.588 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:18.588 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:18.596 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:21:18.596 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:21:18.596 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:21:18.597 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:18.637 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:21:18.637 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:18.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 -- 172.21.15.17:0/3735932359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829815bc70 msgr2=0x7f82980cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:18.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 --2- 172.21.15.17:0/3735932359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829815bc70 0x7f82980cfa20 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f828c009900 tx=0x7f828c01c850 comp rx=0 tx=0).stop 2024-09-10T23:21:18.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 -- 172.21.15.17:0/3735932359 shutdown_connections 2024-09-10T23:21:18.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 --2- 172.21.15.17:0/3735932359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82980cc570 0x7f82980d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 --2- 172.21.15.17:0/3735932359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829815bc70 0x7f82980cfa20 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 -- 172.21.15.17:0/3735932359 >> 172.21.15.17:0/3735932359 conn(0x7f829809a9f0 msgr2=0x7f829809add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:18.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 -- 172.21.15.17:0/3735932359 shutdown_connections 2024-09-10T23:21:18.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 -- 172.21.15.17:0/3735932359 wait complete. 2024-09-10T23:21:18.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 Processor -- start 2024-09-10T23:21:18.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.780+0000 7f829ec00640 1 -- start start 2024-09-10T23:21:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ec00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82980cc570 0x7f829815de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82980d1ed0 0x7f82981fb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829815bc70 0x7f82981f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ec00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8298168ab0 con 0x7f82980cc570 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ec00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8298168930 con 0x7f82980d1ed0 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ec00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8298168c30 con 0x7f829815bc70 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82980cc570 0x7f829815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82980cc570 0x7f829815de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59986/0 (socket says 172.21.15.17:59986) 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829d800640 1 -- 172.21.15.17:0/1093900252 learned_addr learned my addr 172.21.15.17:0/1093900252 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ce00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82980d1ed0 0x7f82981fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829e200640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829815bc70 0x7f82981f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829d800640 1 -- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829815bc70 msgr2=0x7f82981f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829d800640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829815bc70 0x7f82981f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829d800640 1 -- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82980d1ed0 msgr2=0x7f82981fb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829d800640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82980d1ed0 0x7f82981fb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:18.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829d800640 1 -- 172.21.15.17:0/1093900252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82981f7b90 con 0x7f82980cc570 2024-09-10T23:21:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ce00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82980d1ed0 0x7f82981fb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829e200640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829815bc70 0x7f82981f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829d800640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82980cc570 0x7f829815de80 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f828c009850 tx=0x7f828c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f8295600640 1 -- 172.21.15.17:0/1093900252 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c0b2040 con 0x7f82980cc570 2024-09-10T23:21:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f8295600640 1 -- 172.21.15.17:0/1093900252 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f828c0044b0 con 0x7f82980cc570 2024-09-10T23:21:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f8295600640 1 -- 172.21.15.17:0/1093900252 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c003840 con 0x7f82980cc570 2024-09-10T23:21:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82981fb6c0 con 0x7f82980cc570 2024-09-10T23:21:18.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82981fbc40 con 0x7f82980cc570 2024-09-10T23:21:18.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82980d1990 con 0x7f82980cc570 2024-09-10T23:21:18.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.784+0000 7f8295600640 1 -- 172.21.15.17:0/1093900252 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f828c0039e0 con 0x7f82980cc570 2024-09-10T23:21:18.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.788+0000 7f8295600640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82780725e0 0x7f8278074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:18.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.788+0000 7f8295600640 1 -- 172.21.15.17:0/1093900252 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f828c12d240 con 0x7f82980cc570 2024-09-10T23:21:18.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.788+0000 7f829ce00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82780725e0 0x7f8278074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:18.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.788+0000 7f829ce00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82780725e0 0x7f8278074aa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8284006fd0 tx=0x7f8284008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:18.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:18.792+0000 7f8295600640 1 -- 172.21.15.17:0/1093900252 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f82981f7b90 con 0x7f82980cc570 2024-09-10T23:21:19.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.004+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82980d0260 con 0x7f82980cc570 2024-09-10T23:21:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.004+0000 7f8295600640 1 -- 172.21.15.17:0/1093900252 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7f828c0164d0 con 0x7f82980cc570 2024-09-10T23:21:19.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:19.011 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":63,"btime":"2024-09-10T23:21:04:942490+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1386694568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1386694568},{"type":"v1","addr":"172.21.15.77:6835","nonce":1386694568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/4074525293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":4074525293},{"type":"v1","addr":"172.21.15.77:6837","nonce":4074525293}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/946073344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":946073344},{"type":"v1","addr":"172.21.15.17:6835","nonce":946073344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:20:40.525388+0000","modified":"2024-09-10T23:21:04.942484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6833/1816876754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1816876754},{"type":"v1","addr":"172.21.15.17:6833","nonce":1816876754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7116,"qdb_cluster":[7116]},"id":5}]} 2024-09-10T23:21:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 63 2024-09-10T23:21:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82780725e0 msgr2=0x7f8278074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82780725e0 0x7f8278074aa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8284006fd0 tx=0x7f8284008040 comp rx=0 tx=0).stop 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82980cc570 msgr2=0x7f829815de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82980cc570 0x7f829815de80 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f828c009850 tx=0x7f828c005770 comp rx=0 tx=0).stop 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 shutdown_connections 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82780725e0 0x7f8278074aa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f829815bc70 0x7f82981f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82980d1ed0 0x7f82981fb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 --2- 172.21.15.17:0/1093900252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82980cc570 0x7f829815de80 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 >> 172.21.15.17:0/1093900252 conn(0x7f829809a9f0 msgr2=0x7f829806f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 shutdown_connections 2024-09-10T23:21:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.008+0000 7f829ec00640 1 -- 172.21.15.17:0/1093900252 wait complete. 2024-09-10T23:21:19.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:19.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 -- 172.21.15.17:0/1181896734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c0b4370 msgr2=0x7f0b3c0d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 --2- 172.21.15.17:0/1181896734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c0b4370 0x7f0b3c0d0030 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009900 tx=0x7f0b3401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 -- 172.21.15.17:0/1181896734 shutdown_connections 2024-09-10T23:21:19.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 --2- 172.21.15.17:0/1181896734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c0b4370 0x7f0b3c0d0030 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 --2- 172.21.15.17:0/1181896734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b3c15e5d0 0x7f0b3c0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 -- 172.21.15.17:0/1181896734 >> 172.21.15.17:0/1181896734 conn(0x7f0b3c06cfc0 msgr2=0x7f0b3c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:19.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 -- 172.21.15.17:0/1181896734 shutdown_connections 2024-09-10T23:21:19.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 -- 172.21.15.17:0/1181896734 wait complete. 2024-09-10T23:21:19.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 Processor -- start 2024-09-10T23:21:19.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 -- start start 2024-09-10T23:21:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3c0b4370 0x7f0b3c14e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c15e5d0 0x7f0b3c13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b3c15ef40 0x7f0b3c1f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c168140 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c167fc0 con 0x7f0b3c0b4370 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.176+0000 7f0b42a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3c1682c0 con 0x7f0b3c15ef40 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b33400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c15e5d0 0x7f0b3c13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b33400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c15e5d0 0x7f0b3c13edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60008/0 (socket says 172.21.15.17:60008) 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b33400640 1 -- 172.21.15.17:0/3332836734 learned_addr learned my addr 172.21.15.17:0/3332836734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b40a00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b3c15ef40 0x7f0b3c1f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b3be00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3c0b4370 0x7f0b3c14e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b33400640 1 -- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b3c15ef40 msgr2=0x7f0b3c1f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b33400640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b3c15ef40 0x7f0b3c1f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b33400640 1 -- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3c0b4370 msgr2=0x7f0b3c14e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b33400640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3c0b4370 0x7f0b3c14e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b33400640 1 -- 172.21.15.17:0/3332836734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c14e830 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b33400640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c15e5d0 0x7f0b3c13edd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400d950 tx=0x7f0b2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b38c00640 1 -- 172.21.15.17:0/3332836734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24017070 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b38c00640 1 -- 172.21.15.17:0/3332836734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b24009d20 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b38c00640 1 -- 172.21.15.17:0/3332836734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b240106c0 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c1f8480 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c13e5d0 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3c0d0030 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.180+0000 7f0b38c00640 1 -- 172.21.15.17:0/3332836734 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0b24010860 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.184+0000 7f0b38c00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b18072610 0x7f0b18074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.184+0000 7f0b38c00640 1 -- 172.21.15.17:0/3332836734 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f0b240937b0 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.184+0000 7f0b3be00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b18072610 0x7f0b18074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.184+0000 7f0b3be00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b18072610 0x7f0b18074ad0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c001ee0 tx=0x7f0b2c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.188+0000 7f0b38c00640 1 -- 172.21.15.17:0/3332836734 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0b2405e5f0 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.396+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b3c15b2f0 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.396+0000 7f0b38c00640 1 -- 172.21.15.17:0/3332836734 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7f0b24091e20 con 0x7f0b3c15e5d0 2024-09-10T23:21:19.402 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:19.402 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":63,"btime":"2024-09-10T23:21:04:942490+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1386694568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1386694568},{"type":"v1","addr":"172.21.15.77:6835","nonce":1386694568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/4074525293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":4074525293},{"type":"v1","addr":"172.21.15.77:6837","nonce":4074525293}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/946073344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":946073344},{"type":"v1","addr":"172.21.15.17:6835","nonce":946073344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:20:40.525388+0000","modified":"2024-09-10T23:21:04.942484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6833/1816876754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1816876754},{"type":"v1","addr":"172.21.15.17:6833","nonce":1816876754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7116,"qdb_cluster":[7116]},"id":5}]} 2024-09-10T23:21:19.402 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 63 2024-09-10T23:21:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b18072610 msgr2=0x7f0b18074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b18072610 0x7f0b18074ad0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c001ee0 tx=0x7f0b2c009040 comp rx=0 tx=0).stop 2024-09-10T23:21:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c15e5d0 msgr2=0x7f0b3c13edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c15e5d0 0x7f0b3c13edd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400d950 tx=0x7f0b2400de10 comp rx=0 tx=0).stop 2024-09-10T23:21:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 shutdown_connections 2024-09-10T23:21:19.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b18072610 0x7f0b18074ad0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b3c15ef40 0x7f0b3c1f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b3c15e5d0 0x7f0b3c13edd0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 --2- 172.21.15.17:0/3332836734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b3c0b4370 0x7f0b3c14e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 >> 172.21.15.17:0/3332836734 conn(0x7f0b3c06cfc0 msgr2=0x7f0b3c158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:19.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 shutdown_connections 2024-09-10T23:21:19.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.400+0000 7f0b42a00640 1 -- 172.21.15.17:0/3332836734 wait complete. 2024-09-10T23:21:19.423 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:21:19.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.564+0000 7f5d52e00640 1 -- 172.21.15.17:0/1320338335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4c0d1830 msgr2=0x7f5d4c15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.564+0000 7f5d52e00640 1 --2- 172.21.15.17:0/1320338335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4c0d1830 0x7f5d4c15f5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0cf010 tx=0x7f5d3401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.564+0000 7f5d52e00640 1 -- 172.21.15.17:0/1320338335 shutdown_connections 2024-09-10T23:21:19.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.564+0000 7f5d52e00640 1 --2- 172.21.15.17:0/1320338335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4c0d1830 0x7f5d4c15f5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.564+0000 7f5d52e00640 1 --2- 172.21.15.17:0/1320338335 >> v2:172.21.15.77:3300/0 conn(0x7f5d4c070ad0 0x7f5d4c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.564+0000 7f5d52e00640 1 -- 172.21.15.17:0/1320338335 >> 172.21.15.17:0/1320338335 conn(0x7f5d4c0d1d60 msgr2=0x7f5d4c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:19.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.564+0000 7f5d52e00640 1 -- 172.21.15.17:0/1320338335 shutdown_connections 2024-09-10T23:21:19.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.564+0000 7f5d52e00640 1 -- 172.21.15.17:0/1320338335 wait complete. 2024-09-10T23:21:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 Processor -- start 2024-09-10T23:21:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 -- start start 2024-09-10T23:21:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d4c070ad0 0x7f5d4c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c0cf320 0x7f5d4c1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4c0d1830 0x7f5d4c0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c169380 con 0x7f5d4c070ad0 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c169200 con 0x7f5d4c0cf320 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c169500 con 0x7f5d4c0d1830 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d4c070ad0 0x7f5d4c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d4c070ad0 0x7f5d4c159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60012/0 (socket says 172.21.15.17:60012) 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d4be00640 1 -- 172.21.15.17:0/1481868708 learned_addr learned my addr 172.21.15.17:0/1481868708 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d50e00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4c0d1830 0x7f5d4c0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d43400640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c0cf320 0x7f5d4c1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d4be00640 1 -- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4c0d1830 msgr2=0x7f5d4c0b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d4be00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4c0d1830 0x7f5d4c0b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d4be00640 1 -- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c0cf320 msgr2=0x7f5d4c1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d4be00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c0cf320 0x7f5d4c1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d4be00640 1 -- 172.21.15.17:0/1481868708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c157040 con 0x7f5d4c070ad0 2024-09-10T23:21:19.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d43400640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c0cf320 0x7f5d4c1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:19.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d4be00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d4c070ad0 0x7f5d4c159f60 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00e9f0 tx=0x7f5d3c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:19.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d48c00640 1 -- 172.21.15.17:0/1481868708 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00cd80 con 0x7f5d4c070ad0 2024-09-10T23:21:19.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d48c00640 1 -- 172.21.15.17:0/1481868708 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d3c010430 con 0x7f5d4c070ad0 2024-09-10T23:21:19.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4c1567a0 con 0x7f5d4c070ad0 2024-09-10T23:21:19.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d48c00640 1 -- 172.21.15.17:0/1481868708 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c010860 con 0x7f5d4c070ad0 2024-09-10T23:21:19.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.568+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c156d60 con 0x7f5d4c070ad0 2024-09-10T23:21:19.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.572+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4c164e00 con 0x7f5d4c070ad0 2024-09-10T23:21:19.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.572+0000 7f5d48c00640 1 -- 172.21.15.17:0/1481868708 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5d3c010a00 con 0x7f5d4c070ad0 2024-09-10T23:21:19.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.572+0000 7f5d48c00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d280725e0 0x7f5d28074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.572+0000 7f5d48c00640 1 -- 172.21.15.17:0/1481868708 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f5d3c093fc0 con 0x7f5d4c070ad0 2024-09-10T23:21:19.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.572+0000 7f5d43400640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d280725e0 0x7f5d28074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.572+0000 7f5d43400640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d280725e0 0x7f5d28074aa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d340af000 tx=0x7f5d3401b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:19.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.576+0000 7f5d48c00640 1 -- 172.21.15.17:0/1481868708 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5d3c05eec0 con 0x7f5d4c070ad0 2024-09-10T23:21:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d4c0cfc60 con 0x7f5d4c070ad0 2024-09-10T23:21:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d48c00640 1 -- 172.21.15.17:0/1481868708 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+17204 (secure 0 0 0) 0x7f5d3c0638f0 con 0x7f5d4c070ad0 2024-09-10T23:21:19.757 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:19.757 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":91,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:21:01.939603+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:20:38.279133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T23:20:39.480040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/4123296985":"2024-09-11T23:21:01.922575+0000","172.21.15.17:6833/4123296985":"2024-09-11T23:21:01.922575+0000","172.21.15.17:6834/4060324884":"2024-09-11T23:21:01.773560+0000","172.21.15.17:6832/4060324884":"2024-09-11T23:21:01.773560+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:21:19.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d280725e0 msgr2=0x7f5d28074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d280725e0 0x7f5d28074aa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d340af000 tx=0x7f5d3401b120 comp rx=0 tx=0).stop 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d4c070ad0 msgr2=0x7f5d4c159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d4c070ad0 0x7f5d4c159f60 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00e9f0 tx=0x7f5d3c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 shutdown_connections 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d280725e0 0x7f5d28074aa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d4c0d1830 0x7f5d4c0b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c0cf320 0x7f5d4c1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 --2- 172.21.15.17:0/1481868708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d4c070ad0 0x7f5d4c159f60 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 >> 172.21.15.17:0/1481868708 conn(0x7f5d4c0d1d60 msgr2=0x7f5d4c0b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 shutdown_connections 2024-09-10T23:21:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.752+0000 7f5d52e00640 1 -- 172.21.15.17:0/1481868708 wait complete. 2024-09-10T23:21:19.779 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:21:19.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.920+0000 7f6a5dc00640 1 -- 172.21.15.17:0/3271454619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 msgr2=0x7f6a3c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.920+0000 7f6a5dc00640 1 --2- 172.21.15.17:0/3271454619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 0x7f6a3c00b9d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009eb0 tx=0x7f6a5001d5f0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.920+0000 7f6a5dc00640 1 -- 172.21.15.17:0/3271454619 shutdown_connections 2024-09-10T23:21:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.920+0000 7f6a5dc00640 1 --2- 172.21.15.17:0/3271454619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 0x7f6a3c00b9d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.920+0000 7f6a5dc00640 1 -- 172.21.15.17:0/3271454619 >> 172.21.15.17:0/3271454619 conn(0x7f6a5809a9f0 msgr2=0x7f6a5809add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.920+0000 7f6a5dc00640 1 -- 172.21.15.17:0/3271454619 shutdown_connections 2024-09-10T23:21:19.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.920+0000 7f6a5dc00640 1 -- 172.21.15.17:0/3271454619 wait complete. 2024-09-10T23:21:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 Processor -- start 2024-09-10T23:21:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 -- start start 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 0x7f6a58150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5815e290 0x7f6a580c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5815ee20 0x7f6a5815f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a580d0130 con 0x7f6a3c0051d0 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a580cffb0 con 0x7f6a5815e290 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a580d1a00 con 0x7f6a5815ee20 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 0x7f6a58150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 0x7f6a58150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60032/0 (socket says 172.21.15.17:60032) 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57e00640 1 -- 172.21.15.17:0/2331327348 learned_addr learned my addr 172.21.15.17:0/2331327348 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5d200640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5815ee20 0x7f6a5815f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57400640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5815e290 0x7f6a580c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57e00640 1 -- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5815ee20 msgr2=0x7f6a5815f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57e00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5815ee20 0x7f6a5815f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57e00640 1 -- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5815e290 msgr2=0x7f6a580c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57e00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5815e290 0x7f6a580c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57e00640 1 -- 172.21.15.17:0/2331327348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a58161250 con 0x7f6a3c0051d0 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a57e00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 0x7f6a58150000 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f6a48001170 tx=0x7f6a4800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a4fe00640 1 -- 172.21.15.17:0/2331327348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48015070 con 0x7f6a3c0051d0 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a4fe00640 1 -- 172.21.15.17:0/2331327348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a48010980 con 0x7f6a3c0051d0 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a4fe00640 1 -- 172.21.15.17:0/2331327348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48010dd0 con 0x7f6a3c0051d0 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a58161530 con 0x7f6a3c0051d0 2024-09-10T23:21:19.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a58152540 con 0x7f6a3c0051d0 2024-09-10T23:21:19.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.924+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a580d02b0 con 0x7f6a3c0051d0 2024-09-10T23:21:19.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.928+0000 7f6a4fe00640 1 -- 172.21.15.17:0/2331327348 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6a48011460 con 0x7f6a3c0051d0 2024-09-10T23:21:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.928+0000 7f6a4fe00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a38072610 0x7f6a38074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.928+0000 7f6a4fe00640 1 -- 172.21.15.17:0/2331327348 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f6a48093b00 con 0x7f6a3c0051d0 2024-09-10T23:21:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.928+0000 7f6a57400640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a38072610 0x7f6a38074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:19.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.928+0000 7f6a57400640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a38072610 0x7f6a38074ad0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6a44006660 tx=0x7f6a44004100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:19.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:19.932+0000 7f6a4fe00640 1 -- 172.21.15.17:0/2331327348 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6a4805ef90 con 0x7f6a3c0051d0 2024-09-10T23:21:20.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.144+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a580c5a20 con 0x7f6a3c0051d0 2024-09-10T23:21:20.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.144+0000 7f6a4fe00640 1 -- 172.21.15.17:0/2331327348 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7f6a48093e20 con 0x7f6a3c0051d0 2024-09-10T23:21:20.150 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:20.150 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":63,"btime":"2024-09-10T23:21:04:942490+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1386694568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1386694568},{"type":"v1","addr":"172.21.15.77:6835","nonce":1386694568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/4074525293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":4074525293},{"type":"v1","addr":"172.21.15.77:6837","nonce":4074525293}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/946073344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":946073344},{"type":"v1","addr":"172.21.15.17:6835","nonce":946073344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:20:40.525388+0000","modified":"2024-09-10T23:21:04.942484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6833/1816876754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1816876754},{"type":"v1","addr":"172.21.15.17:6833","nonce":1816876754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7116,"qdb_cluster":[7116]},"id":5}]} 2024-09-10T23:21:20.151 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 63 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a38072610 msgr2=0x7f6a38074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a38072610 0x7f6a38074ad0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6a44006660 tx=0x7f6a44004100 comp rx=0 tx=0).stop 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 msgr2=0x7f6a58150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 0x7f6a58150000 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f6a48001170 tx=0x7f6a4800ea20 comp rx=0 tx=0).stop 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 shutdown_connections 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a38072610 0x7f6a38074ad0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a5815ee20 0x7f6a5815f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a5815e290 0x7f6a580c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 --2- 172.21.15.17:0/2331327348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3c0051d0 0x7f6a58150000 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 >> 172.21.15.17:0/2331327348 conn(0x7f6a5809a9f0 msgr2=0x7f6a580cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:20.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 shutdown_connections 2024-09-10T23:21:20.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.148+0000 7f6a5dc00640 1 -- 172.21.15.17:0/2331327348 wait complete. 2024-09-10T23:21:20.172 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:20.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.312+0000 7fb9e7800640 1 -- 172.21.15.17:0/3808710538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e01618a0 msgr2=0x7fb9e006eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.312+0000 7fb9e7800640 1 --2- 172.21.15.17:0/3808710538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e01618a0 0x7fb9e006eff0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009cb0 tx=0x7fb9d801cd10 comp rx=0 tx=0).stop 2024-09-10T23:21:20.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.312+0000 7fb9e7800640 1 -- 172.21.15.17:0/3808710538 shutdown_connections 2024-09-10T23:21:20.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.312+0000 7fb9e7800640 1 --2- 172.21.15.17:0/3808710538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e01618a0 0x7fb9e006eff0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.312+0000 7fb9e7800640 1 -- 172.21.15.17:0/3808710538 >> 172.21.15.17:0/3808710538 conn(0x7fb9e00d3f20 msgr2=0x7fb9e00d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:20.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.312+0000 7fb9e7800640 1 -- 172.21.15.17:0/3808710538 shutdown_connections 2024-09-10T23:21:20.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.312+0000 7fb9e7800640 1 -- 172.21.15.17:0/3808710538 wait complete. 2024-09-10T23:21:20.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 Processor -- start 2024-09-10T23:21:20.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 -- start start 2024-09-10T23:21:20.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e00d2180 0x7fb9e00b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:20.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00d4a10 0x7fb9e00ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:20.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9e01618a0 0x7fb9e00c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:20.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e016c230 con 0x7fb9e00d4a10 2024-09-10T23:21:20.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e016c0b0 con 0x7fb9e00d2180 2024-09-10T23:21:20.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e016c3b0 con 0x7fb9e01618a0 2024-09-10T23:21:20.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00d4a10 0x7fb9e00ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:20.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00d4a10 0x7fb9e00ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60040/0 (socket says 172.21.15.17:60040) 2024-09-10T23:21:20.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dfe00640 1 -- 172.21.15.17:0/3821586997 learned_addr learned my addr 172.21.15.17:0/3821586997 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:20.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e4e00640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e00d2180 0x7fb9e00b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:20.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e5800640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9e01618a0 0x7fb9e00c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:20.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dfe00640 1 -- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9e01618a0 msgr2=0x7fb9e00c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9e01618a0 0x7fb9e00c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dfe00640 1 -- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e00d2180 msgr2=0x7fb9e00b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e00d2180 0x7fb9e00b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dfe00640 1 -- 172.21.15.17:0/3821586997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e01603d0 con 0x7fb9e00d4a10 2024-09-10T23:21:20.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dfe00640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00d4a10 0x7fb9e00ca330 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c490 tx=0x7fb9cc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:20.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dcc00640 1 -- 172.21.15.17:0/3821586997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc017070 con 0x7fb9e00d4a10 2024-09-10T23:21:20.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dcc00640 1 -- 172.21.15.17:0/3821586997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9cc003600 con 0x7fb9e00d4a10 2024-09-10T23:21:20.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9dcc00640 1 -- 172.21.15.17:0/3821586997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc003a90 con 0x7fb9e00d4a10 2024-09-10T23:21:20.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e0160650 con 0x7fb9e00d4a10 2024-09-10T23:21:20.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.316+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e0160910 con 0x7fb9e00d4a10 2024-09-10T23:21:20.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.320+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e006eff0 con 0x7fb9e00d4a10 2024-09-10T23:21:20.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.320+0000 7fb9dcc00640 1 -- 172.21.15.17:0/3821586997 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb9cc003c30 con 0x7fb9e00d4a10 2024-09-10T23:21:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.320+0000 7fb9dcc00640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9c0072610 0x7fb9c0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.320+0000 7fb9dcc00640 1 -- 172.21.15.17:0/3821586997 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7fb9cc092b50 con 0x7fb9e00d4a10 2024-09-10T23:21:20.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.320+0000 7fb9e4e00640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9c0072610 0x7fb9c0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:20.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.320+0000 7fb9e4e00640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9c0072610 0x7fb9c0074ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4007fd0 tx=0x7fb9d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:20.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.324+0000 7fb9dcc00640 1 -- 172.21.15.17:0/3821586997 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb9e01603d0 con 0x7fb9e00d4a10 2024-09-10T23:21:20.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.532+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9e00d44a0 con 0x7fb9e00d4a10 2024-09-10T23:21:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.532+0000 7fb9dcc00640 1 -- 172.21.15.17:0/3821586997 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7fb9cc05d900 con 0x7fb9e00d4a10 2024-09-10T23:21:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:20.539 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":63,"btime":"2024-09-10T23:21:04:942490+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1386694568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1386694568},{"type":"v1","addr":"172.21.15.77:6835","nonce":1386694568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/4074525293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":4074525293},{"type":"v1","addr":"172.21.15.77:6837","nonce":4074525293}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/946073344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":946073344},{"type":"v1","addr":"172.21.15.17:6835","nonce":946073344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:20:40.525388+0000","modified":"2024-09-10T23:21:04.942484+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7116":{"gid":7116,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6833/1816876754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1816876754},{"type":"v1","addr":"172.21.15.17:6833","nonce":1816876754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7116,"qdb_cluster":[7116]},"id":5}]} 2024-09-10T23:21:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 63 2024-09-10T23:21:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9c0072610 msgr2=0x7fb9c0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9c0072610 0x7fb9c0074ad0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4007fd0 tx=0x7fb9d4009040 comp rx=0 tx=0).stop 2024-09-10T23:21:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00d4a10 msgr2=0x7fb9e00ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00d4a10 0x7fb9e00ca330 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c490 tx=0x7fb9cc001e80 comp rx=0 tx=0).stop 2024-09-10T23:21:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 shutdown_connections 2024-09-10T23:21:20.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9c0072610 0x7fb9c0074ad0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9e01618a0 0x7fb9e00c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e00d4a10 0x7fb9e00ca330 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 --2- 172.21.15.17:0/3821586997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9e00d2180 0x7fb9e00b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 >> 172.21.15.17:0/3821586997 conn(0x7fb9e00d3f20 msgr2=0x7fb9e00b83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:20.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 shutdown_connections 2024-09-10T23:21:20.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.536+0000 7fb9e7800640 1 -- 172.21.15.17:0/3821586997 wait complete. 2024-09-10T23:21:20.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:21:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.700+0000 7f230ee00640 1 -- 172.21.15.17:0/1639070774 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f230815f770 msgr2=0x7f23080cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.700+0000 7f230ee00640 1 --2- 172.21.15.17:0/1639070774 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f230815f770 0x7f23080cc870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009840 tx=0x7f22f001c790 comp rx=0 tx=0).stop 2024-09-10T23:21:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.700+0000 7f230ee00640 1 -- 172.21.15.17:0/1639070774 shutdown_connections 2024-09-10T23:21:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.700+0000 7f230ee00640 1 --2- 172.21.15.17:0/1639070774 >> v2:172.21.15.77:3300/0 conn(0x7f23080d1830 0x7f23080ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.700+0000 7f230ee00640 1 --2- 172.21.15.17:0/1639070774 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f230815f770 0x7f23080cc870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.700+0000 7f230ee00640 1 -- 172.21.15.17:0/1639070774 >> 172.21.15.17:0/1639070774 conn(0x7f23080d1d60 msgr2=0x7f23080d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.700+0000 7f230ee00640 1 -- 172.21.15.17:0/1639070774 shutdown_connections 2024-09-10T23:21:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.700+0000 7f230ee00640 1 -- 172.21.15.17:0/1639070774 wait complete. 2024-09-10T23:21:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ee00640 1 Processor -- start 2024-09-10T23:21:20.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ee00640 1 -- start start 2024-09-10T23:21:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308070ad0 0x7f230814db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23080d1830 0x7f230806f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230815f770 0x7f23080b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f23081693b0 con 0x7f230815f770 2024-09-10T23:21:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2308169230 con 0x7f2308070ad0 2024-09-10T23:21:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2308169530 con 0x7f23080d1830 2024-09-10T23:21:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230815f770 0x7f23080b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:20.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230815f770 0x7f23080b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60048/0 (socket says 172.21.15.17:60048) 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ce00640 1 -- 172.21.15.17:0/2126873258 learned_addr learned my addr 172.21.15.17:0/2126873258 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f22ffe00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23080d1830 0x7f230806f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f2307e00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308070ad0 0x7f230814db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ce00640 1 -- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23080d1830 msgr2=0x7f230806f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ce00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23080d1830 0x7f230806f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ce00640 1 -- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308070ad0 msgr2=0x7f230814db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ce00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308070ad0 0x7f230814db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ce00640 1 -- 172.21.15.17:0/2126873258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23081fb670 con 0x7f230815f770 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f230ce00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230815f770 0x7f23080b4b90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2300009f90 tx=0x7f230000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.704+0000 7f2304c00640 1 -- 172.21.15.17:0/2126873258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300003980 con 0x7f230815f770 2024-09-10T23:21:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.708+0000 7f2304c00640 1 -- 172.21.15.17:0/2126873258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2300003c30 con 0x7f230815f770 2024-09-10T23:21:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.708+0000 7f2304c00640 1 -- 172.21.15.17:0/2126873258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300004280 con 0x7f230815f770 2024-09-10T23:21:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.708+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23081fb910 con 0x7f230815f770 2024-09-10T23:21:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.708+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23081fbed0 con 0x7f230815f770 2024-09-10T23:21:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.708+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f230815f060 con 0x7f230815f770 2024-09-10T23:21:20.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.708+0000 7f2304c00640 1 -- 172.21.15.17:0/2126873258 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f230000b040 con 0x7f230815f770 2024-09-10T23:21:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.708+0000 7f2304c00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22e4072610 0x7f22e4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.708+0000 7f2304c00640 1 -- 172.21.15.17:0/2126873258 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f2300093920 con 0x7f230815f770 2024-09-10T23:21:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.708+0000 7f2307e00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22e4072610 0x7f22e4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:20.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.712+0000 7f2307e00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22e4072610 0x7f22e4074ad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f22f8007fd0 tx=0x7f22f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.712+0000 7f2304c00640 1 -- 172.21.15.17:0/2126873258 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f230005e6d0 con 0x7f230815f770 2024-09-10T23:21:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.888+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23080b6890 con 0x7f230815f770 2024-09-10T23:21:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f2304c00640 1 -- 172.21.15.17:0/2126873258 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+17204 (secure 0 0 0) 0x7f2300063100 con 0x7f230815f770 2024-09-10T23:21:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:20.896 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":91,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:21:01.939603+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:20:38.279133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-10T23:20:39.480040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/4123296985":"2024-09-11T23:21:01.922575+0000","172.21.15.17:6833/4123296985":"2024-09-11T23:21:01.922575+0000","172.21.15.17:6834/4060324884":"2024-09-11T23:21:01.773560+0000","172.21.15.17:6832/4060324884":"2024-09-11T23:21:01.773560+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:21:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22e4072610 msgr2=0x7f22e4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22e4072610 0x7f22e4074ad0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f22f8007fd0 tx=0x7f22f8009040 comp rx=0 tx=0).stop 2024-09-10T23:21:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230815f770 msgr2=0x7f23080b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230815f770 0x7f23080b4b90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2300009f90 tx=0x7f230000c800 comp rx=0 tx=0).stop 2024-09-10T23:21:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 shutdown_connections 2024-09-10T23:21:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22e4072610 0x7f22e4074ad0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230815f770 0x7f23080b4b90 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23080d1830 0x7f230806f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 --2- 172.21.15.17:0/2126873258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2308070ad0 0x7f230814db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:20.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 >> 172.21.15.17:0/2126873258 conn(0x7f23080d1d60 msgr2=0x7f23080b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:20.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 shutdown_connections 2024-09-10T23:21:20.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:20.892+0000 7f230ee00640 1 -- 172.21.15.17:0/2126873258 wait complete. 2024-09-10T23:21:20.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:21:21.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 -- 172.21.15.17:0/78202509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93100cf090 msgr2=0x7f931015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 --2- 172.21.15.17:0/78202509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93100cf090 0x7f931015d7d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9300009900 tx=0x7f930001c820 comp rx=0 tx=0).stop 2024-09-10T23:21:21.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 -- 172.21.15.17:0/78202509 shutdown_connections 2024-09-10T23:21:21.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 --2- 172.21.15.17:0/78202509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f931006eb60 0x7f931015e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 --2- 172.21.15.17:0/78202509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93100cf090 0x7f931015d7d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 -- 172.21.15.17:0/78202509 >> 172.21.15.17:0/78202509 conn(0x7f93100b1730 msgr2=0x7f93100b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 -- 172.21.15.17:0/78202509 shutdown_connections 2024-09-10T23:21:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 -- 172.21.15.17:0/78202509 wait complete. 2024-09-10T23:21:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 Processor -- start 2024-09-10T23:21:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 -- start start 2024-09-10T23:21:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f931006e6f0 0x7f931014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f931006eb60 0x7f93101451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93100cf090 0x7f9310163550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9310167d20 con 0x7f93100cf090 2024-09-10T23:21:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9310167ba0 con 0x7f931006e6f0 2024-09-10T23:21:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9315400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9310167ea0 con 0x7f931006eb60 2024-09-10T23:21:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f930f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93100cf090 0x7f9310163550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f930e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f931006e6f0 0x7f931014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f930f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93100cf090 0x7f9310163550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60058/0 (socket says 172.21.15.17:60058) 2024-09-10T23:21:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f930f200640 1 -- 172.21.15.17:0/1498399076 learned_addr learned my addr 172.21.15.17:0/1498399076 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.060+0000 7f9305e00640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f931006eb60 0x7f93101451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f930e800640 1 -- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f931006eb60 msgr2=0x7f93101451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f930e800640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f931006eb60 0x7f93101451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f930e800640 1 -- 172.21.15.17:0/1498399076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93100cf090 msgr2=0x7f9310163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f930e800640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93100cf090 0x7f9310163550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f930e800640 1 -- 172.21.15.17:0/1498399076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931014e970 con 0x7f931006e6f0 2024-09-10T23:21:21.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f930f200640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93100cf090 0x7f9310163550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:21:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f930e800640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f931006e6f0 0x7f931014e430 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9310074ba0 tx=0x7f93000a5670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f9307400640 1 -- 172.21.15.17:0/1498399076 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000b2040 con 0x7f931006e6f0 2024-09-10T23:21:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f9307400640 1 -- 172.21.15.17:0/1498399076 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93000043d0 con 0x7f931006e6f0 2024-09-10T23:21:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f9307400640 1 -- 172.21.15.17:0/1498399076 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300003860 con 0x7f931006e6f0 2024-09-10T23:21:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93101fb2c0 con 0x7f931006e6f0 2024-09-10T23:21:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93101fb880 con 0x7f931006e6f0 2024-09-10T23:21:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931015d7d0 con 0x7f931006e6f0 2024-09-10T23:21:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.064+0000 7f9307400640 1 -- 172.21.15.17:0/1498399076 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9300003a00 con 0x7f931006e6f0 2024-09-10T23:21:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.068+0000 7f9307400640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92ec0725e0 0x7f92ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.068+0000 7f9307400640 1 -- 172.21.15.17:0/1498399076 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6273+0+0 (secure 0 0 0) 0x7f930012d8d0 con 0x7f931006e6f0 2024-09-10T23:21:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.068+0000 7f9305e00640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92ec0725e0 0x7f92ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.068+0000 7f9305e00640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92ec0725e0 0x7f92ec074aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f93100cbc80 tx=0x7f92f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.068+0000 7f9307400640 1 -- 172.21.15.17:0/1498399076 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f93000164d0 con 0x7f931006e6f0 2024-09-10T23:21:21.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.284+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f93100cc3d0 con 0x7f931006e6f0 2024-09-10T23:21:21.290 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:21:21.284+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:21:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9307400640 1 -- 172.21.15.17:0/1498399076 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) ==== 161+0+0 (secure 0 0 0) 0x7f93000f8790 con 0x7f931006e6f0 2024-09-10T23:21:21.297 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:21:21.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92ec0725e0 msgr2=0x7f92ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92ec0725e0 0x7f92ec074aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f93100cbc80 tx=0x7f92f8009040 comp rx=0 tx=0).stop 2024-09-10T23:21:21.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f931006e6f0 msgr2=0x7f931014e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f931006e6f0 0x7f931014e430 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9310074ba0 tx=0x7f93000a5670 comp rx=0 tx=0).stop 2024-09-10T23:21:21.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 shutdown_connections 2024-09-10T23:21:21.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92ec0725e0 0x7f92ec074aa0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93100cf090 0x7f9310163550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f931006eb60 0x7f93101451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 --2- 172.21.15.17:0/1498399076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f931006e6f0 0x7f931014e430 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 >> 172.21.15.17:0/1498399076 conn(0x7f93100b1730 msgr2=0x7f931015dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:21.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 shutdown_connections 2024-09-10T23:21:21.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.292+0000 7f9315400640 1 -- 172.21.15.17:0/1498399076 wait complete. 2024-09-10T23:21:21.302 INFO:tasks.ceph.mds.a.smithi017.stderr: -2338> 2024-09-10T23:21:06.932+0000 7fe45ba00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:21:21.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:21:21.348 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:21:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 -- 172.21.15.17:0/3761026678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f311815b8c0 msgr2=0x7f31180d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 --2- 172.21.15.17:0/3761026678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f311815b8c0 0x7f31180d0170 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3108009900 tx=0x7f310801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 -- 172.21.15.17:0/3761026678 shutdown_connections 2024-09-10T23:21:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 --2- 172.21.15.17:0/3761026678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31180d06b0 0x7f31180b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 --2- 172.21.15.17:0/3761026678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f311815b8c0 0x7f31180d0170 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 -- 172.21.15.17:0/3761026678 >> 172.21.15.17:0/3761026678 conn(0x7f311809a9f0 msgr2=0x7f311809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:21.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 -- 172.21.15.17:0/3761026678 shutdown_connections 2024-09-10T23:21:21.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 -- 172.21.15.17:0/3761026678 wait complete. 2024-09-10T23:21:21.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 Processor -- start 2024-09-10T23:21:21.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 -- start start 2024-09-10T23:21:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31180d06b0 0x7f31181490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f311815b8c0 0x7f31181fa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f311815bca0 0x7f31180707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3118168ec0 con 0x7f311815bca0 2024-09-10T23:21:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3118168d40 con 0x7f311815b8c0 2024-09-10T23:21:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.464+0000 7f311d600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3118169040 con 0x7f31180d06b0 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f311cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f311815bca0 0x7f31180707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3117e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31180d06b0 0x7f31181490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f310fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f311815b8c0 0x7f31181fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3117e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31180d06b0 0x7f31181490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:48860/0 (socket says 172.21.15.17:48860) 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3117e00640 1 -- 172.21.15.17:0/1175724805 learned_addr learned my addr 172.21.15.17:0/1175724805 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3117e00640 1 -- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f311815b8c0 msgr2=0x7f31181fa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3117e00640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f311815b8c0 0x7f31181fa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3117e00640 1 -- 172.21.15.17:0/1175724805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f311815bca0 msgr2=0x7f31180707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3117e00640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f311815bca0 0x7f31180707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3117e00640 1 -- 172.21.15.17:0/1175724805 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31181fae60 con 0x7f31180d06b0 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f311cc00640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f311815bca0 0x7f31180707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:21:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3117e00640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31180d06b0 0x7f31181490a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31080b0040 tx=0x7f31080a5780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3114c00640 1 -- 172.21.15.17:0/1175724805 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31080bb070 con 0x7f31180d06b0 2024-09-10T23:21:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3114c00640 1 -- 172.21.15.17:0/1175724805 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3108005070 con 0x7f31180d06b0 2024-09-10T23:21:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3114c00640 1 -- 172.21.15.17:0/1175724805 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31080b2040 con 0x7f31180d06b0 2024-09-10T23:21:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31181fb100 con 0x7f31180d06b0 2024-09-10T23:21:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31181fb6c0 con 0x7f31180d06b0 2024-09-10T23:21:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31180c6a80 con 0x7f31180d06b0 2024-09-10T23:21:21.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.468+0000 7f3114c00640 1 -- 172.21.15.17:0/1175724805 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f31080054a0 con 0x7f31180d06b0 2024-09-10T23:21:21.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.472+0000 7f3114c00640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30f40725e0 0x7f30f4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:21.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.472+0000 7f3114c00640 1 -- 172.21.15.17:0/1175724805 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(92..92 src has 1..92) ==== 6359+0+0 (secure 0 0 0) 0x7f310812cfb0 con 0x7f31180d06b0 2024-09-10T23:21:21.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.472+0000 7f310fe00640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30f40725e0 0x7f30f4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:21.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.472+0000 7f310fe00640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30f40725e0 0x7f30f4074aa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f31180717b0 tx=0x7f31000091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.472+0000 7f3114c00640 1 -- 172.21.15.17:0/1175724805 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f31080164d0 con 0x7f31180d06b0 2024-09-10T23:21:21.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:21.680+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f31180b29d0 con 0x7f31180d06b0 2024-09-10T23:21:22.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.292+0000 7f3114c00640 1 -- 172.21.15.17:0/1175724805 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) ==== 104+0+0 (secure 0 0 0) 0x7f31080f7d90 con 0x7f31180d06b0 2024-09-10T23:21:22.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30f40725e0 msgr2=0x7f30f4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:22.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30f40725e0 0x7f30f4074aa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f31180717b0 tx=0x7f31000091e0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31180d06b0 msgr2=0x7f31181490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:22.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31180d06b0 0x7f31181490a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31080b0040 tx=0x7f31080a5780 comp rx=0 tx=0).stop 2024-09-10T23:21:22.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 shutdown_connections 2024-09-10T23:21:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f30f40725e0 0x7f30f4074aa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f311815bca0 0x7f31180707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f311815b8c0 0x7f31181fa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 --2- 172.21.15.17:0/1175724805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31180d06b0 0x7f31181490a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 >> 172.21.15.17:0/1175724805 conn(0x7f311809a9f0 msgr2=0x7f3118071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 shutdown_connections 2024-09-10T23:21:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.296+0000 7f311d600640 1 -- 172.21.15.17:0/1175724805 wait complete. 2024-09-10T23:21:22.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:21:22.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.520+0000 7f7f2b200640 1 -- 172.21.15.17:0/825850658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f2c0b26a0 msgr2=0x7f7f2c0b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.520+0000 7f7f2b200640 1 --2- 172.21.15.17:0/825850658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f2c0b26a0 0x7f7f2c0b50f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009bf0 tx=0x7f7f2401f3d0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.520+0000 7f7f2b200640 1 -- 172.21.15.17:0/825850658 shutdown_connections 2024-09-10T23:21:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.520+0000 7f7f2b200640 1 --2- 172.21.15.17:0/825850658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f2c0b26a0 0x7f7f2c0b50f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.520+0000 7f7f2b200640 1 -- 172.21.15.17:0/825850658 >> 172.21.15.17:0/825850658 conn(0x7f7f2c09d0b0 msgr2=0x7f7f2c0d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.520+0000 7f7f2b200640 1 -- 172.21.15.17:0/825850658 shutdown_connections 2024-09-10T23:21:22.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.520+0000 7f7f2b200640 1 -- 172.21.15.17:0/825850658 wait complete. 2024-09-10T23:21:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.520+0000 7f7f2b200640 1 Processor -- start 2024-09-10T23:21:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 -- start start 2024-09-10T23:21:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f2c0b26a0 0x7f7f2c154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f2c0d2370 0x7f7f2c1f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f2c0d2750 0x7f7f2c1515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c169070 con 0x7f7f2c0d2370 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c168ef0 con 0x7f7f2c0d2750 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c1691f0 con 0x7f7f2c0b26a0 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f2c0d2370 0x7f7f2c1f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f2c0d2370 0x7f7f2c1f82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60096/0 (socket says 172.21.15.17:60096) 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29400640 1 -- 172.21.15.17:0/3247312454 learned_addr learned my addr 172.21.15.17:0/3247312454 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29e00640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f2c0b26a0 0x7f7f2c154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2a800640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f2c0d2750 0x7f7f2c1515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29400640 1 -- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f2c0b26a0 msgr2=0x7f7f2c154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29400640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f2c0b26a0 0x7f7f2c154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29400640 1 -- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f2c0d2750 msgr2=0x7f7f2c1515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:22.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29400640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f2c0d2750 0x7f7f2c1515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29400640 1 -- 172.21.15.17:0/3247312454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c151b10 con 0x7f7f2c0d2370 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f29400640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f2c0d2370 0x7f7f2c1f82d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800c430 tx=0x7f7f1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f22000640 1 -- 172.21.15.17:0/3247312454 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18017070 con 0x7f7f2c0d2370 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f22000640 1 -- 172.21.15.17:0/3247312454 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f180053c0 con 0x7f7f2c0d2370 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2c158c70 con 0x7f7f2c0d2370 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f22000640 1 -- 172.21.15.17:0/3247312454 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18003860 con 0x7f7f2c0d2370 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f2c157520 con 0x7f7f2c0d2370 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.524+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2c159290 con 0x7f7f2c0d2370 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.528+0000 7f7f22000640 1 -- 172.21.15.17:0/3247312454 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7f18003a00 con 0x7f7f2c0d2370 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.528+0000 7f7f22000640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f0c0725e0 0x7f7f0c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.528+0000 7f7f22000640 1 -- 172.21.15.17:0/3247312454 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 6359+0+0 (secure 0 0 0) 0x7f7f18092ba0 con 0x7f7f2c0d2370 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.528+0000 7f7f29e00640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f0c0725e0 0x7f7f0c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.528+0000 7f7f29e00640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f0c0725e0 0x7f7f0c074aa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c007f30 tx=0x7f7f1c007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.532+0000 7f7f22000640 1 -- 172.21.15.17:0/3247312454 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7f1805d900 con 0x7f7f2c0d2370 2024-09-10T23:21:22.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:22.708+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7f2c0b50f0 con 0x7f7f2c0d2370 2024-09-10T23:21:23.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.456+0000 7f7f22000640 1 -- 172.21.15.17:0/3247312454 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7f7f18062330 con 0x7f7f2c0d2370 2024-09-10T23:21:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:21:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f0c0725e0 msgr2=0x7f7f0c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f0c0725e0 0x7f7f0c074aa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c007f30 tx=0x7f7f1c007ec0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f2c0d2370 msgr2=0x7f7f2c1f82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f2c0d2370 0x7f7f2c1f82d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800c430 tx=0x7f7f1800c8f0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 shutdown_connections 2024-09-10T23:21:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f0c0725e0 0x7f7f0c074aa0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f2c0d2750 0x7f7f2c1515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f2c0d2370 0x7f7f2c1f82d0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 --2- 172.21.15.17:0/3247312454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f2c0b26a0 0x7f7f2c154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 >> 172.21.15.17:0/3247312454 conn(0x7f7f2c09d0b0 msgr2=0x7f7f2c0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:23.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 shutdown_connections 2024-09-10T23:21:23.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.460+0000 7f7f2b200640 1 -- 172.21.15.17:0/3247312454 wait complete. 2024-09-10T23:21:23.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:21:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.640+0000 7fa897a00640 1 -- 172.21.15.17:0/2682347119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8900b2fe0 msgr2=0x7fa8900cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.640+0000 7fa897a00640 1 --2- 172.21.15.17:0/2682347119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8900b2fe0 0x7fa8900cf040 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa87800aa10 tx=0x7fa87801dc00 comp rx=0 tx=0).stop 2024-09-10T23:21:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.640+0000 7fa897a00640 1 -- 172.21.15.17:0/2682347119 shutdown_connections 2024-09-10T23:21:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.640+0000 7fa897a00640 1 --2- 172.21.15.17:0/2682347119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8900b2fe0 0x7fa8900cf040 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.640+0000 7fa897a00640 1 --2- 172.21.15.17:0/2682347119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa89015a2a0 0x7fa8900b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.640+0000 7fa897a00640 1 -- 172.21.15.17:0/2682347119 >> 172.21.15.17:0/2682347119 conn(0x7fa8900b17a0 msgr2=0x7fa8900b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.640+0000 7fa897a00640 1 -- 172.21.15.17:0/2682347119 shutdown_connections 2024-09-10T23:21:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.640+0000 7fa897a00640 1 -- 172.21.15.17:0/2682347119 wait complete. 2024-09-10T23:21:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa897a00640 1 Processor -- start 2024-09-10T23:21:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa897a00640 1 -- start start 2024-09-10T23:21:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa897a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8900b2fe0 0x7fa8901f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa897a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8900cf580 0x7fa89014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa897a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89015a2a0 0x7fa890152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa897a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa89006fa20 con 0x7fa89015a2a0 2024-09-10T23:21:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa897a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa89006f8a0 con 0x7fa8900cf580 2024-09-10T23:21:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa897a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa89006fba0 con 0x7fa8900b2fe0 2024-09-10T23:21:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89015a2a0 0x7fa890152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89015a2a0 0x7fa890152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60110/0 (socket says 172.21.15.17:60110) 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895a00640 1 -- 172.21.15.17:0/1100455718 learned_addr learned my addr 172.21.15.17:0/1100455718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa887e00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8900cf580 0x7fa89014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895000640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8900b2fe0 0x7fa8901f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895a00640 1 -- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8900b2fe0 msgr2=0x7fa8901f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895a00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8900b2fe0 0x7fa8901f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895a00640 1 -- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8900cf580 msgr2=0x7fa89014d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895a00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8900cf580 0x7fa89014d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895a00640 1 -- 172.21.15.17:0/1100455718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89014daa0 con 0x7fa89015a2a0 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895000640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8900b2fe0 0x7fa8901f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa895a00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89015a2a0 0x7fa890152f40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c780 tx=0x7fa88800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:23.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa88d600640 1 -- 172.21.15.17:0/1100455718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888004b70 con 0x7fa89015a2a0 2024-09-10T23:21:23.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa88d600640 1 -- 172.21.15.17:0/1100455718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa888004e00 con 0x7fa89015a2a0 2024-09-10T23:21:23.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8900cbb20 con 0x7fa89015a2a0 2024-09-10T23:21:23.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.644+0000 7fa88d600640 1 -- 172.21.15.17:0/1100455718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88800aa90 con 0x7fa89015a2a0 2024-09-10T23:21:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.648+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8900afd40 con 0x7fa89015a2a0 2024-09-10T23:21:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.648+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8900cf040 con 0x7fa89015a2a0 2024-09-10T23:21:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.648+0000 7fa88d600640 1 -- 172.21.15.17:0/1100455718 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa88800ac30 con 0x7fa89015a2a0 2024-09-10T23:21:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.648+0000 7fa88d600640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa86c0725e0 0x7fa86c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.648+0000 7fa88d600640 1 -- 172.21.15.17:0/1100455718 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5921+0+0 (secure 0 0 0) 0x7fa888093550 con 0x7fa89015a2a0 2024-09-10T23:21:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.648+0000 7fa895000640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa86c0725e0 0x7fa86c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:23.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.652+0000 7fa895000640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa86c0725e0 0x7fa86c074aa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa880005fd0 tx=0x7fa880005f00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:23.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.652+0000 7fa88d600640 1 -- 172.21.15.17:0/1100455718 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa888020070 con 0x7fa89015a2a0 2024-09-10T23:21:23.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:23.832+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa8900d0060 con 0x7fa89015a2a0 2024-09-10T23:21:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.464+0000 7fa88d600640 1 -- 172.21.15.17:0/1100455718 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7fa88805eb40 con 0x7fa89015a2a0 2024-09-10T23:21:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:21:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa86c0725e0 msgr2=0x7fa86c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa86c0725e0 0x7fa86c074aa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa880005fd0 tx=0x7fa880005f00 comp rx=0 tx=0).stop 2024-09-10T23:21:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89015a2a0 msgr2=0x7fa890152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89015a2a0 0x7fa890152f40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c780 tx=0x7fa88800cc40 comp rx=0 tx=0).stop 2024-09-10T23:21:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 shutdown_connections 2024-09-10T23:21:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa86c0725e0 0x7fa86c074aa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa89015a2a0 0x7fa890152f40 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8900cf580 0x7fa89014d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 --2- 172.21.15.17:0/1100455718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8900b2fe0 0x7fa8901f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 >> 172.21.15.17:0/1100455718 conn(0x7fa8900b17a0 msgr2=0x7fa890159180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:24.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 shutdown_connections 2024-09-10T23:21:24.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.468+0000 7fa897a00640 1 -- 172.21.15.17:0/1100455718 wait complete. 2024-09-10T23:21:24.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:21:24.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.648+0000 7ff5b5600640 1 -- 172.21.15.17:0/3374677194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5b00cedf0 msgr2=0x7ff5b00d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:24.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.648+0000 7ff5b5600640 1 --2- 172.21.15.17:0/3374677194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5b00cedf0 0x7ff5b00d28c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff598009900 tx=0x7ff59801c850 comp rx=0 tx=0).stop 2024-09-10T23:21:24.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.648+0000 7ff5b5600640 1 -- 172.21.15.17:0/3374677194 shutdown_connections 2024-09-10T23:21:24.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.648+0000 7ff5b5600640 1 --2- 172.21.15.17:0/3374677194 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5b015fa00 0x7ff5b015fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.648+0000 7ff5b5600640 1 --2- 172.21.15.17:0/3374677194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5b00cedf0 0x7ff5b00d28c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.648+0000 7ff5b5600640 1 -- 172.21.15.17:0/3374677194 >> 172.21.15.17:0/3374677194 conn(0x7ff5b00d1da0 msgr2=0x7ff5b00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:24.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.648+0000 7ff5b5600640 1 -- 172.21.15.17:0/3374677194 shutdown_connections 2024-09-10T23:21:24.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.648+0000 7ff5b5600640 1 -- 172.21.15.17:0/3374677194 wait complete. 2024-09-10T23:21:24.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.648+0000 7ff5b5600640 1 Processor -- start 2024-09-10T23:21:24.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 -- start start 2024-09-10T23:21:24.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5b015be80 0x7ff5b00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:24.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b015fa00 0x7ff5b00ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:24.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5b009cbe0 0x7ff5b01f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:24.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0168f50 con 0x7ff5b015fa00 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b00b5490 con 0x7ff5b015be80 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b01690d0 con 0x7ff5b009cbe0 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b015fa00 0x7ff5b00ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5aea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5b015be80 0x7ff5b00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5aea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5b015be80 0x7ff5b00cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:44372/0 (socket says 172.21.15.17:44372) 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5aea00640 1 -- 172.21.15.17:0/3074677062 learned_addr learned my addr 172.21.15.17:0/3074677062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b015fa00 0x7ff5b00ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60112/0 (socket says 172.21.15.17:60112) 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5af400640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5b009cbe0 0x7ff5b01f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a7e00640 1 -- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5b009cbe0 msgr2=0x7ff5b01f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a7e00640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5b009cbe0 0x7ff5b01f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a7e00640 1 -- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5b015be80 msgr2=0x7ff5b00cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a7e00640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5b015be80 0x7ff5b00cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a7e00640 1 -- 172.21.15.17:0/3074677062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b01f6860 con 0x7ff5b015fa00 2024-09-10T23:21:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a7e00640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b015fa00 0x7ff5b00ca2f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff5980ac000 tx=0x7ff5980a5590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a6a00640 1 -- 172.21.15.17:0/3074677062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5980b2040 con 0x7ff5b015fa00 2024-09-10T23:21:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a6a00640 1 -- 172.21.15.17:0/3074677062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5980042e0 con 0x7ff5b015fa00 2024-09-10T23:21:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5a6a00640 1 -- 172.21.15.17:0/3074677062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5980052d0 con 0x7ff5b015fa00 2024-09-10T23:21:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b009be20 con 0x7ff5b015fa00 2024-09-10T23:21:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b009c3e0 con 0x7ff5b015fa00 2024-09-10T23:21:24.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.652+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b00d28c0 con 0x7ff5b015fa00 2024-09-10T23:21:24.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.656+0000 7ff5a6a00640 1 -- 172.21.15.17:0/3074677062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff5980046d0 con 0x7ff5b015fa00 2024-09-10T23:21:24.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.656+0000 7ff5a6a00640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff58c0725e0 0x7ff58c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:24.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.656+0000 7ff5a6a00640 1 -- 172.21.15.17:0/3074677062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7ff59812cb20 con 0x7ff5b015fa00 2024-09-10T23:21:24.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.656+0000 7ff5aea00640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff58c0725e0 0x7ff58c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:24.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.656+0000 7ff5aea00640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff58c0725e0 0x7ff58c074aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0000f70 tx=0x7ff5a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:24.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.660+0000 7ff5a6a00640 1 -- 172.21.15.17:0/3074677062 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff5b01f6860 con 0x7ff5b015fa00 2024-09-10T23:21:24.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.852+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7ff5b00ca830 con 0x7ff5b015fa00 2024-09-10T23:21:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5a6a00640 1 -- 172.21.15.17:0/3074677062 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v40) ==== 71+0+0 (secure 0 0 0) 0x7ff5980164d0 con 0x7ff5b015fa00 2024-09-10T23:21:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff58c0725e0 msgr2=0x7ff58c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff58c0725e0 0x7ff58c074aa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0000f70 tx=0x7ff5a0009040 comp rx=0 tx=0).stop 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b015fa00 msgr2=0x7ff5b00ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b015fa00 0x7ff5b00ca2f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff5980ac000 tx=0x7ff5980a5590 comp rx=0 tx=0).stop 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 shutdown_connections 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff58c0725e0 0x7ff58c074aa0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5b009cbe0 0x7ff5b01f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5b015fa00 0x7ff5b00ca2f0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 --2- 172.21.15.17:0/3074677062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5b015be80 0x7ff5b00cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 >> 172.21.15.17:0/3074677062 conn(0x7ff5b00d1da0 msgr2=0x7ff5b015b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 shutdown_connections 2024-09-10T23:21:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:24.856+0000 7ff5b5600640 1 -- 172.21.15.17:0/3074677062 wait complete. 2024-09-10T23:21:24.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-10T23:21:25.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 -- 172.21.15.17:0/2108036125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf90160280 msgr2=0x7fdf900cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 --2- 172.21.15.17:0/2108036125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf90160280 0x7fdf900cfaf0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fdf9006db00 tx=0x7fdf8001f0b0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 -- 172.21.15.17:0/2108036125 shutdown_connections 2024-09-10T23:21:25.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 --2- 172.21.15.17:0/2108036125 >> v2:172.21.15.77:3300/0 conn(0x7fdf90160660 0x7fdf900af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 --2- 172.21.15.17:0/2108036125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf900d2830 0x7fdf900d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 --2- 172.21.15.17:0/2108036125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf90160280 0x7fdf900cfaf0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 -- 172.21.15.17:0/2108036125 >> 172.21.15.17:0/2108036125 conn(0x7fdf900d1d10 msgr2=0x7fdf900d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:25.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 -- 172.21.15.17:0/2108036125 shutdown_connections 2024-09-10T23:21:25.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 -- 172.21.15.17:0/2108036125 wait complete. 2024-09-10T23:21:25.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 Processor -- start 2024-09-10T23:21:25.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 -- start start 2024-09-10T23:21:25.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf900d2830 0x7fdf90156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:25.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf90160280 0x7fdf901f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:25.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf90160660 0x7fdf90152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:25.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf900b0060 con 0x7fdf900d2830 2024-09-10T23:21:25.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf900afee0 con 0x7fdf90160660 2024-09-10T23:21:25.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf95200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf900b01e0 con 0x7fdf90160280 2024-09-10T23:21:25.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf8de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf900d2830 0x7fdf90156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:25.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf8de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf900d2830 0x7fdf90156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60132/0 (socket says 172.21.15.17:60132) 2024-09-10T23:21:25.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf8de00640 1 -- 172.21.15.17:0/1827336417 learned_addr learned my addr 172.21.15.17:0/1827336417 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:25.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf8e800640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf90160660 0x7fdf90152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:25.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.024+0000 7fdf87e00640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf90160280 0x7fdf901f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:25.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf8de00640 1 -- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf90160280 msgr2=0x7fdf901f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf8de00640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf90160280 0x7fdf901f8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf8de00640 1 -- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf90160660 msgr2=0x7fdf90152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf8de00640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf90160660 0x7fdf90152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf8de00640 1 -- 172.21.15.17:0/1827336417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf901f8c80 con 0x7fdf900d2830 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf87e00640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf90160280 0x7fdf901f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf8e800640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf90160660 0x7fdf90152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf8de00640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf900d2830 0x7fdf90156940 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fdf800b3040 tx=0x7fdf80005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf86000640 1 -- 172.21.15.17:0/1827336417 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf800be070 con 0x7fdf900d2830 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf86000640 1 -- 172.21.15.17:0/1827336417 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf800053e0 con 0x7fdf900d2830 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf901f55a0 con 0x7fdf900d2830 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf86000640 1 -- 172.21.15.17:0/1827336417 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf800b5040 con 0x7fdf900d2830 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf900c59a0 con 0x7fdf900d2830 2024-09-10T23:21:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf900b0700 con 0x7fdf900d2830 2024-09-10T23:21:25.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.028+0000 7fdf86000640 1 -- 172.21.15.17:0/1827336417 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdf800b8030 con 0x7fdf900d2830 2024-09-10T23:21:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.032+0000 7fdf86000640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf6c072610 0x7fdf6c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.032+0000 7fdf86000640 1 -- 172.21.15.17:0/1827336417 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7fdf8012ffa0 con 0x7fdf900d2830 2024-09-10T23:21:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.032+0000 7fdf87e00640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf6c072610 0x7fdf6c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.032+0000 7fdf87e00640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf6c072610 0x7fdf6c074ad0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdf78005fd0 tx=0x7fdf78005f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.036+0000 7fdf86000640 1 -- 172.21.15.17:0/1827336417 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdf901f8c80 con 0x7fdf900d2830 2024-09-10T23:21:25.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.268+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7fdf90074af0 con 0x7fdf900d2830 2024-09-10T23:21:25.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf86000640 1 -- 172.21.15.17:0/1827336417 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v290) ==== 143+0+0 (secure 0 0 0) 0x7fdf80018c10 con 0x7fdf900d2830 2024-09-10T23:21:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf6c072610 msgr2=0x7fdf6c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf6c072610 0x7fdf6c074ad0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdf78005fd0 tx=0x7fdf78005f20 comp rx=0 tx=0).stop 2024-09-10T23:21:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf900d2830 msgr2=0x7fdf90156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf900d2830 0x7fdf90156940 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fdf800b3040 tx=0x7fdf80005760 comp rx=0 tx=0).stop 2024-09-10T23:21:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 shutdown_connections 2024-09-10T23:21:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf6c072610 0x7fdf6c074ad0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf90160660 0x7fdf90152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf90160280 0x7fdf901f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 --2- 172.21.15.17:0/1827336417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf900d2830 0x7fdf90156940 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 >> 172.21.15.17:0/1827336417 conn(0x7fdf900d1d10 msgr2=0x7fdf900cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:25.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 shutdown_connections 2024-09-10T23:21:25.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.468+0000 7fdf95200640 1 -- 172.21.15.17:0/1827336417 wait complete. 2024-09-10T23:21:25.494 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-10T23:21:25.494 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-09-10T23:21:25.494 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T23:21:25.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:21:25.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.636+0000 7fdf1a000640 1 -- 172.21.15.17:0/1819257203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf140d06f0 msgr2=0x7fdf140b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.636+0000 7fdf1a000640 1 --2- 172.21.15.17:0/1819257203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf140d06f0 0x7fdf140b2ac0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009c80 tx=0x7fdf0c01cd60 comp rx=0 tx=0).stop 2024-09-10T23:21:25.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.636+0000 7fdf1a000640 1 -- 172.21.15.17:0/1819257203 shutdown_connections 2024-09-10T23:21:25.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.636+0000 7fdf1a000640 1 --2- 172.21.15.17:0/1819257203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf140d06f0 0x7fdf140b2ac0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.636+0000 7fdf1a000640 1 --2- 172.21.15.17:0/1819257203 >> v2:172.21.15.77:3300/0 conn(0x7fdf14152b40 0x7fdf140b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.636+0000 7fdf1a000640 1 -- 172.21.15.17:0/1819257203 >> 172.21.15.17:0/1819257203 conn(0x7fdf1406cfc0 msgr2=0x7fdf1406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:25.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.636+0000 7fdf1a000640 1 -- 172.21.15.17:0/1819257203 shutdown_connections 2024-09-10T23:21:25.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.636+0000 7fdf1a000640 1 -- 172.21.15.17:0/1819257203 wait complete. 2024-09-10T23:21:25.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 Processor -- start 2024-09-10T23:21:25.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 -- start start 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf140d06f0 0x7fdf14140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf14152b40 0x7fdf141552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf141602d0 0x7fdf14073740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf14168ad0 con 0x7fdf141602d0 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf140b3d70 con 0x7fdf140d06f0 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf14168c50 con 0x7fdf14152b40 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf141602d0 0x7fdf14073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf141602d0 0x7fdf14073740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60146/0 (socket says 172.21.15.17:60146) 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13e00640 1 -- 172.21.15.17:0/1062613646 learned_addr learned my addr 172.21.15.17:0/1062613646 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13400640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf140d06f0 0x7fdf14140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:25.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf0be00640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf14152b40 0x7fdf141552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13e00640 1 -- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf14152b40 msgr2=0x7fdf141552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13e00640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf14152b40 0x7fdf141552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13e00640 1 -- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf140d06f0 msgr2=0x7fdf14140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13e00640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf140d06f0 0x7fdf14140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13e00640 1 -- 172.21.15.17:0/1062613646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf14155820 con 0x7fdf141602d0 2024-09-10T23:21:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf13e00640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf141602d0 0x7fdf14073740 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c01a990 tx=0x7fdf0c0a5b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf0b400640 1 -- 172.21.15.17:0/1062613646 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0bb070 con 0x7fdf141602d0 2024-09-10T23:21:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf0b400640 1 -- 172.21.15.17:0/1062613646 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf0c004d40 con 0x7fdf141602d0 2024-09-10T23:21:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf0b400640 1 -- 172.21.15.17:0/1062613646 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0b2040 con 0x7fdf141602d0 2024-09-10T23:21:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1414ddf0 con 0x7fdf141602d0 2024-09-10T23:21:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.640+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf141faa30 con 0x7fdf141602d0 2024-09-10T23:21:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.644+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf140b2ac0 con 0x7fdf141602d0 2024-09-10T23:21:25.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.644+0000 7fdf0b400640 1 -- 172.21.15.17:0/1062613646 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdf0c0b5030 con 0x7fdf141602d0 2024-09-10T23:21:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.644+0000 7fdf0b400640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdef00725e0 0x7fdef0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.644+0000 7fdf0b400640 1 -- 172.21.15.17:0/1062613646 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7fdf0c12cd60 con 0x7fdf141602d0 2024-09-10T23:21:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.644+0000 7fdf13400640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdef00725e0 0x7fdef0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.644+0000 7fdf13400640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdef00725e0 0x7fdef0074aa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdf04006fd0 tx=0x7fdf04008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:25.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.648+0000 7fdf0b400640 1 -- 172.21.15.17:0/1062613646 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdf14155820 con 0x7fdf141602d0 2024-09-10T23:21:25.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf1415f280 con 0x7fdf141602d0 2024-09-10T23:21:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf0b400640 1 -- 172.21.15.17:0/1062613646 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+13506 (secure 0 0 0) 0x7fdf0c016950 con 0x7fdf141602d0 2024-09-10T23:21:25.833 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:25.834 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:21:24.464412+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6833/1816876754":"2024-09-11T23:21:21.291300+0000","172.21.15.17:6832/1816876754":"2024-09-11T23:21:21.291300+0000","172.21.15.17:6835/4123296985":"2024-09-11T23:21:01.922575+0000","172.21.15.17:6833/4123296985":"2024-09-11T23:21:01.922575+0000","172.21.15.17:6834/4060324884":"2024-09-11T23:21:01.773560+0000","172.21.15.17:6832/4060324884":"2024-09-11T23:21:01.773560+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:21:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdef00725e0 msgr2=0x7fdef0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdef00725e0 0x7fdef0074aa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdf04006fd0 tx=0x7fdf04008040 comp rx=0 tx=0).stop 2024-09-10T23:21:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf141602d0 msgr2=0x7fdf14073740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf141602d0 0x7fdf14073740 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c01a990 tx=0x7fdf0c0a5b40 comp rx=0 tx=0).stop 2024-09-10T23:21:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 shutdown_connections 2024-09-10T23:21:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdef00725e0 0x7fdef0074aa0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf141602d0 0x7fdf14073740 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf14152b40 0x7fdf141552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 --2- 172.21.15.17:0/1062613646 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf140d06f0 0x7fdf14140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:25.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 >> 172.21.15.17:0/1062613646 conn(0x7fdf1406cfc0 msgr2=0x7fdf141412e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:25.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 shutdown_connections 2024-09-10T23:21:25.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:25.828+0000 7fdf1a000640 1 -- 172.21.15.17:0/1062613646 wait complete. 2024-09-10T23:21:25.855 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:21:25.856 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:21:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 -- 172.21.15.17:0/1263214776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 msgr2=0x7fad9c0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 --2- 172.21.15.17:0/1263214776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 0x7fad9c0ccba0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0cc500 tx=0x7fad9401dc70 comp rx=0 tx=0).stop 2024-09-10T23:21:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 -- 172.21.15.17:0/1263214776 shutdown_connections 2024-09-10T23:21:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 --2- 172.21.15.17:0/1263214776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 0x7fad9c0ccba0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 --2- 172.21.15.17:0/1263214776 >> v2:172.21.15.77:3300/0 conn(0x7fad9c0cf040 0x7fad9c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 -- 172.21.15.17:0/1263214776 >> 172.21.15.17:0/1263214776 conn(0x7fad9c0b17a0 msgr2=0x7fad9c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:26.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 -- 172.21.15.17:0/1263214776 shutdown_connections 2024-09-10T23:21:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 -- 172.21.15.17:0/1263214776 wait complete. 2024-09-10T23:21:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 Processor -- start 2024-09-10T23:21:26.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.000+0000 7fada2e00640 1 -- start start 2024-09-10T23:21:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada2e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 0x7fad9c153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada2e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad9c0cf040 0x7fad9c1487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada2e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9c15a2a0 0x7fad9c0c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada2e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c0cd520 con 0x7fad9c0cc730 2024-09-10T23:21:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada2e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c0cd3a0 con 0x7fad9c15a2a0 2024-09-10T23:21:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada2e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fad9c0cd6a0 con 0x7fad9c0cf040 2024-09-10T23:21:26.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 0x7fad9c153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 0x7fad9c153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60152/0 (socket says 172.21.15.17:60152) 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9be00640 1 -- 172.21.15.17:0/3241300546 learned_addr learned my addr 172.21.15.17:0/3241300546 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9b400640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad9c0cf040 0x7fad9c1487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada0e00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9c15a2a0 0x7fad9c0c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9be00640 1 -- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad9c0cf040 msgr2=0x7fad9c1487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9be00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad9c0cf040 0x7fad9c1487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9be00640 1 -- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9c15a2a0 msgr2=0x7fad9c0c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9be00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9c15a2a0 0x7fad9c0c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9be00640 1 -- 172.21.15.17:0/3241300546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c0c6c80 con 0x7fad9c0cc730 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada0e00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9c15a2a0 0x7fad9c0c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad9be00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 0x7fad9c153be0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00b440 tx=0x7fad8c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad93e00640 1 -- 172.21.15.17:0/3241300546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c015020 con 0x7fad9c0cc730 2024-09-10T23:21:26.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad93e00640 1 -- 172.21.15.17:0/3241300546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad8c011920 con 0x7fad9c0cc730 2024-09-10T23:21:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c0c6f60 con 0x7fad9c0cc730 2024-09-10T23:21:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad93e00640 1 -- 172.21.15.17:0/3241300546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c011d70 con 0x7fad9c0cc730 2024-09-10T23:21:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c0c4f40 con 0x7fad9c0cc730 2024-09-10T23:21:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad9c0ccba0 con 0x7fad9c0cc730 2024-09-10T23:21:26.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.004+0000 7fad93e00640 1 -- 172.21.15.17:0/3241300546 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fad8c01a400 con 0x7fad9c0cc730 2024-09-10T23:21:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.008+0000 7fad93e00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad7c0725e0 0x7fad7c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.008+0000 7fad93e00640 1 -- 172.21.15.17:0/3241300546 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7fad8c0930d0 con 0x7fad9c0cc730 2024-09-10T23:21:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.008+0000 7fad9b400640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad7c0725e0 0x7fad7c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.008+0000 7fad9b400640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad7c0725e0 0x7fad7c074aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fad9c156c70 tx=0x7fad8800b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:26.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.012+0000 7fad93e00640 1 -- 172.21.15.17:0/3241300546 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fad8c01f030 con 0x7fad9c0cc730 2024-09-10T23:21:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.196+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fad9c0c6990 con 0x7fad9c0cc730 2024-09-10T23:21:26.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fad93e00640 1 -- 172.21.15.17:0/3241300546 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7fad8c05e7d0 con 0x7fad9c0cc730 2024-09-10T23:21:26.204 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad7c0725e0 msgr2=0x7fad7c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad7c0725e0 0x7fad7c074aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fad9c156c70 tx=0x7fad8800b390 comp rx=0 tx=0).stop 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 msgr2=0x7fad9c153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 0x7fad9c153be0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00b440 tx=0x7fad8c00b900 comp rx=0 tx=0).stop 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 shutdown_connections 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad7c0725e0 0x7fad7c074aa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad9c15a2a0 0x7fad9c0c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad9c0cf040 0x7fad9c1487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 --2- 172.21.15.17:0/3241300546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c0cc730 0x7fad9c153be0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 >> 172.21.15.17:0/3241300546 conn(0x7fad9c0b17a0 msgr2=0x7fad9c1549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 shutdown_connections 2024-09-10T23:21:26.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.200+0000 7fada2e00640 1 -- 172.21.15.17:0/3241300546 wait complete. 2024-09-10T23:21:26.226 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-10T23:21:26.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.364+0000 7f1b74c00640 1 -- 172.21.15.17:0/263696085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700cff20 msgr2=0x7f1b700d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.364+0000 7f1b74c00640 1 --2- 172.21.15.17:0/263696085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700cff20 0x7f1b700d03b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f1b7006dba0 tx=0x7f1b6801cd80 comp rx=0 tx=0).stop 2024-09-10T23:21:26.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.364+0000 7f1b74c00640 1 -- 172.21.15.17:0/263696085 shutdown_connections 2024-09-10T23:21:26.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.364+0000 7f1b74c00640 1 --2- 172.21.15.17:0/263696085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700cff20 0x7f1b700d03b0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.364+0000 7f1b74c00640 1 --2- 172.21.15.17:0/263696085 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b700b48f0 0x7f1b7015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.364+0000 7f1b74c00640 1 --2- 172.21.15.17:0/263696085 >> v2:172.21.15.77:3300/0 conn(0x7f1b700cf4f0 0x7f1b700b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.364+0000 7f1b74c00640 1 -- 172.21.15.17:0/263696085 >> 172.21.15.17:0/263696085 conn(0x7f1b7006cfc0 msgr2=0x7f1b7006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:26.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.364+0000 7f1b74c00640 1 -- 172.21.15.17:0/263696085 shutdown_connections 2024-09-10T23:21:26.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.364+0000 7f1b74c00640 1 -- 172.21.15.17:0/263696085 wait complete. 2024-09-10T23:21:26.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 Processor -- start 2024-09-10T23:21:26.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 -- start start 2024-09-10T23:21:26.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700b48f0 0x7f1b700c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b700cf4f0 0x7f1b701fb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b700cff20 0x7f1b700b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7006e960 con 0x7f1b700b48f0 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1b700cede0 con 0x7f1b700cff20 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7006eae0 con 0x7f1b700cf4f0 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700b48f0 0x7f1b700c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700b48f0 0x7f1b700c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60160/0 (socket says 172.21.15.17:60160) 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6de00640 1 -- 172.21.15.17:0/982394078 learned_addr learned my addr 172.21.15.17:0/982394078 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b67e00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b700cf4f0 0x7f1b701fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6e800640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b700cff20 0x7f1b700b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6de00640 1 -- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b700cf4f0 msgr2=0x7f1b701fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6de00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b700cf4f0 0x7f1b701fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6de00640 1 -- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b700cff20 msgr2=0x7f1b700b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6de00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b700cff20 0x7f1b700b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6de00640 1 -- 172.21.15.17:0/982394078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b700c68f0 con 0x7f1b700b48f0 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6e800640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b700cff20 0x7f1b700b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b6de00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700b48f0 0x7f1b700c63b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000e9f0 tx=0x7f1b6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b66000640 1 -- 172.21.15.17:0/982394078 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000cd80 con 0x7f1b700b48f0 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b66000640 1 -- 172.21.15.17:0/982394078 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b60010430 con 0x7f1b700b48f0 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b701fb570 con 0x7f1b700b48f0 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b66000640 1 -- 172.21.15.17:0/982394078 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60010860 con 0x7f1b700b48f0 2024-09-10T23:21:26.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.368+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b701f7470 con 0x7f1b700b48f0 2024-09-10T23:21:26.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.372+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b700b37f0 con 0x7f1b700b48f0 2024-09-10T23:21:26.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.372+0000 7f1b66000640 1 -- 172.21.15.17:0/982394078 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1b60029080 con 0x7f1b700b48f0 2024-09-10T23:21:26.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.372+0000 7f1b66000640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b4c0725e0 0x7f1b4c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:26.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.372+0000 7f1b66000640 1 -- 172.21.15.17:0/982394078 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7f1b60094200 con 0x7f1b700b48f0 2024-09-10T23:21:26.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.372+0000 7f1b67e00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b4c0725e0 0x7f1b4c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:26.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.376+0000 7f1b67e00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b4c0725e0 0x7f1b4c074aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1b58005fd0 tx=0x7f1b58005e60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:26.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.376+0000 7f1b66000640 1 -- 172.21.15.17:0/982394078 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1b700c68f0 con 0x7f1b700b48f0 2024-09-10T23:21:26.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:26.612+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f1b701504e0 con 0x7f1b700b48f0 2024-09-10T23:21:27.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.472+0000 7f1b66000640 1 -- 172.21.15.17:0/982394078 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v292) ==== 154+0+0 (secure 0 0 0) 0x7f1b6005fbd0 con 0x7f1b700b48f0 2024-09-10T23:21:27.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.476+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b4c0725e0 msgr2=0x7f1b4c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.476+0000 7f1b74c00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b4c0725e0 0x7f1b4c074aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1b58005fd0 tx=0x7f1b58005e60 comp rx=0 tx=0).stop 2024-09-10T23:21:27.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.476+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700b48f0 msgr2=0x7f1b700c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.476+0000 7f1b74c00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700b48f0 0x7f1b700c63b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000e9f0 tx=0x7f1b6000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.476+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 shutdown_connections 2024-09-10T23:21:27.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.480+0000 7f1b74c00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b4c0725e0 0x7f1b4c074aa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.480+0000 7f1b74c00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b700cff20 0x7f1b700b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.480+0000 7f1b74c00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b700cf4f0 0x7f1b701fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.480+0000 7f1b74c00640 1 --2- 172.21.15.17:0/982394078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b700b48f0 0x7f1b700c63b0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.480+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 >> 172.21.15.17:0/982394078 conn(0x7f1b7006cfc0 msgr2=0x7f1b700ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:27.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.480+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 shutdown_connections 2024-09-10T23:21:27.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.480+0000 7f1b74c00640 1 -- 172.21.15.17:0/982394078 wait complete. 2024-09-10T23:21:27.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:21:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.656+0000 7f11f6000640 1 -- 172.21.15.17:0/2454432403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 msgr2=0x7f11f0072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.656+0000 7f11f6000640 1 --2- 172.21.15.17:0/2454432403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 0x7f11f0072320 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f11f00b0d60 tx=0x7f11e001c7a0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.656+0000 7f11f6000640 1 -- 172.21.15.17:0/2454432403 shutdown_connections 2024-09-10T23:21:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.656+0000 7f11f6000640 1 --2- 172.21.15.17:0/2454432403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11f00d19b0 0x7f11f00d1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.656+0000 7f11f6000640 1 --2- 172.21.15.17:0/2454432403 >> v2:172.21.15.77:3300/0 conn(0x7f11f015bc70 0x7f11f00d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.656+0000 7f11f6000640 1 --2- 172.21.15.17:0/2454432403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 0x7f11f0072320 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.656+0000 7f11f6000640 1 -- 172.21.15.17:0/2454432403 >> 172.21.15.17:0/2454432403 conn(0x7f11f009a9f0 msgr2=0x7f11f009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:27.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.656+0000 7f11f6000640 1 -- 172.21.15.17:0/2454432403 shutdown_connections 2024-09-10T23:21:27.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.656+0000 7f11f6000640 1 -- 172.21.15.17:0/2454432403 wait complete. 2024-09-10T23:21:27.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 Processor -- start 2024-09-10T23:21:27.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 -- start start 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f00d19b0 0x7f11f0156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 0x7f11f0155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11f015bc70 0x7f11f0157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f11f0071070 con 0x7f11f015b890 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11f0070ef0 con 0x7f11f00d19b0 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f11f00711f0 con 0x7f11f015bc70 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 0x7f11f0155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 0x7f11f0155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46794/0 (socket says 172.21.15.17:46794) 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11e7e00640 1 -- 172.21.15.17:0/827870806 learned_addr learned my addr 172.21.15.17:0/827870806 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f4c00640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f00d19b0 0x7f11f0156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f5600640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11f015bc70 0x7f11f0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11e7e00640 1 -- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11f015bc70 msgr2=0x7f11f0157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11e7e00640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11f015bc70 0x7f11f0157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11e7e00640 1 -- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f00d19b0 msgr2=0x7f11f0156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11e7e00640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f00d19b0 0x7f11f0156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11e7e00640 1 -- 172.21.15.17:0/827870806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f01f7770 con 0x7f11f015b890 2024-09-10T23:21:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11e7e00640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 0x7f11f0155740 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f11d80058d0 tx=0x7f11d800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11ed600640 1 -- 172.21.15.17:0/827870806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d8017070 con 0x7f11f015b890 2024-09-10T23:21:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11ed600640 1 -- 172.21.15.17:0/827870806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11d8009d20 con 0x7f11f015b890 2024-09-10T23:21:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11ed600640 1 -- 172.21.15.17:0/827870806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d80106c0 con 0x7f11f015b890 2024-09-10T23:21:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f01f7a50 con 0x7f11f015b890 2024-09-10T23:21:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f01f8010 con 0x7f11f015b890 2024-09-10T23:21:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.660+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f0072320 con 0x7f11f015b890 2024-09-10T23:21:27.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.664+0000 7f11ed600640 1 -- 172.21.15.17:0/827870806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f11d8010860 con 0x7f11f015b890 2024-09-10T23:21:27.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.664+0000 7f11ed600640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11cc0725e0 0x7f11cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:27.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.664+0000 7f11ed600640 1 -- 172.21.15.17:0/827870806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7f11d80935b0 con 0x7f11f015b890 2024-09-10T23:21:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.664+0000 7f11f4c00640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11cc0725e0 0x7f11cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.664+0000 7f11f4c00640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11cc0725e0 0x7f11cc074aa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f11e00ae000 tx=0x7f11e00b3040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:27.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.668+0000 7f11ed600640 1 -- 172.21.15.17:0/827870806 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f11d805e670 con 0x7f11f015b890 2024-09-10T23:21:27.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.844+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f11f006f2b0 con 0x7f11f015b890 2024-09-10T23:21:27.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.844+0000 7f11ed600640 1 -- 172.21.15.17:0/827870806 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v40) ==== 59+0+1998 (secure 0 0 0) 0x7f11d80630a0 con 0x7f11f015b890 2024-09-10T23:21:27.850 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:21:27.850 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:21:27.850 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:21:27.850 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:21:27.850 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:21:27.850 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:21:27.850 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:21:27.851 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:21:27.852 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:21:27.852 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:21:27.852 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:21:27.852 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:21:27.852 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:21:27.852 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:21:27.852 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:21:27.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11cc0725e0 msgr2=0x7f11cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11cc0725e0 0x7f11cc074aa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f11e00ae000 tx=0x7f11e00b3040 comp rx=0 tx=0).stop 2024-09-10T23:21:27.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 msgr2=0x7f11f0155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:27.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 0x7f11f0155740 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f11d80058d0 tx=0x7f11d800dde0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 shutdown_connections 2024-09-10T23:21:27.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11cc0725e0 0x7f11cc074aa0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11f015bc70 0x7f11f0157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11f015b890 0x7f11f0155740 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 --2- 172.21.15.17:0/827870806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f00d19b0 0x7f11f0156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:27.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 >> 172.21.15.17:0/827870806 conn(0x7f11f009a9f0 msgr2=0x7f11f006e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:27.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 shutdown_connections 2024-09-10T23:21:27.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:27.848+0000 7f11f6000640 1 -- 172.21.15.17:0/827870806 wait complete. 2024-09-10T23:21:27.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:21:28.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.016+0000 7f699ae00640 1 -- 172.21.15.17:0/3305451746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69940b31b0 msgr2=0x7f69940cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.016+0000 7f699ae00640 1 --2- 172.21.15.17:0/3305451746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69940b31b0 0x7f69940cc8b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f69940cec20 tx=0x7f698c01c650 comp rx=0 tx=0).stop 2024-09-10T23:21:28.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.016+0000 7f699ae00640 1 -- 172.21.15.17:0/3305451746 shutdown_connections 2024-09-10T23:21:28.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.016+0000 7f699ae00640 1 --2- 172.21.15.17:0/3305451746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69940b31b0 0x7f69940cc8b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.016+0000 7f699ae00640 1 --2- 172.21.15.17:0/3305451746 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69940b2540 0x7f69940d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.016+0000 7f699ae00640 1 -- 172.21.15.17:0/3305451746 >> 172.21.15.17:0/3305451746 conn(0x7f69940d1da0 msgr2=0x7f69940d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:28.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.016+0000 7f699ae00640 1 -- 172.21.15.17:0/3305451746 shutdown_connections 2024-09-10T23:21:28.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.016+0000 7f699ae00640 1 -- 172.21.15.17:0/3305451746 wait complete. 2024-09-10T23:21:28.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 Processor -- start 2024-09-10T23:21:28.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 -- start start 2024-09-10T23:21:28.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69940b2540 0x7f6994165e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69940b31b0 0x7f6994153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f699415f400 0x7f6994070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6994168de0 con 0x7f69940b31b0 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6994168c60 con 0x7f699415f400 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6994168f60 con 0x7f69940b2540 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f698b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69940b31b0 0x7f6994153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f698b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69940b31b0 0x7f6994153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46800/0 (socket says 172.21.15.17:46800) 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f698b400640 1 -- 172.21.15.17:0/579067182 learned_addr learned my addr 172.21.15.17:0/579067182 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f6993e00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69940b2540 0x7f6994165e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f6998e00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f699415f400 0x7f6994070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f698b400640 1 -- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69940b2540 msgr2=0x7f6994165e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f698b400640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69940b2540 0x7f6994165e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f698b400640 1 -- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f699415f400 msgr2=0x7f6994070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f698b400640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f699415f400 0x7f6994070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f698b400640 1 -- 172.21.15.17:0/579067182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69941fbae0 con 0x7f69940b31b0 2024-09-10T23:21:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f698b400640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69940b31b0 0x7f6994153bd0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f697c00e9c0 tx=0x7f697c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f6990c00640 1 -- 172.21.15.17:0/579067182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c00cd80 con 0x7f69940b31b0 2024-09-10T23:21:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6994158c20 con 0x7f69940b31b0 2024-09-10T23:21:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f6990c00640 1 -- 172.21.15.17:0/579067182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f697c004020 con 0x7f69940b31b0 2024-09-10T23:21:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f6990c00640 1 -- 172.21.15.17:0/579067182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c004450 con 0x7f69940b31b0 2024-09-10T23:21:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6994154460 con 0x7f69940b31b0 2024-09-10T23:21:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.020+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69940cc8b0 con 0x7f69940b31b0 2024-09-10T23:21:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.024+0000 7f6990c00640 1 -- 172.21.15.17:0/579067182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f697c003600 con 0x7f69940b31b0 2024-09-10T23:21:28.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.024+0000 7f6990c00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69700725e0 0x7f6970074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.024+0000 7f6990c00640 1 -- 172.21.15.17:0/579067182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7f697c093b70 con 0x7f69940b31b0 2024-09-10T23:21:28.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.024+0000 7f6993e00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69700725e0 0x7f6970074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.024+0000 7f6993e00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69700725e0 0x7f6970074aa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6984002020 tx=0x7f6984009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.028+0000 7f6990c00640 1 -- 172.21.15.17:0/579067182 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f697c05ec40 con 0x7f69940b31b0 2024-09-10T23:21:28.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.204+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f69940b0a80 con 0x7f69940b31b0 2024-09-10T23:21:28.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f6990c00640 1 -- 172.21.15.17:0/579067182 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v41)=0 v41) ==== 122+0+0 (secure 0 0 0) 0x7f697c063670 con 0x7f69940b31b0 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69700725e0 msgr2=0x7f6970074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69700725e0 0x7f6970074aa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6984002020 tx=0x7f6984009040 comp rx=0 tx=0).stop 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69940b31b0 msgr2=0x7f6994153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69940b31b0 0x7f6994153bd0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f697c00e9c0 tx=0x7f697c00ee80 comp rx=0 tx=0).stop 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 shutdown_connections 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69700725e0 0x7f6970074aa0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f699415f400 0x7f6994070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69940b31b0 0x7f6994153bd0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 --2- 172.21.15.17:0/579067182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69940b2540 0x7f6994165e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 >> 172.21.15.17:0/579067182 conn(0x7f69940d1da0 msgr2=0x7f699415e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:28.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 shutdown_connections 2024-09-10T23:21:28.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.208+0000 7f699ae00640 1 -- 172.21.15.17:0/579067182 wait complete. 2024-09-10T23:21:28.234 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:21:28.234 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:21:28.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:21:28.411 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:21:28.412 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:28.412 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:28.420 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:21:28.420 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:21:28.421 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:28.430 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:21:28.430 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:28.430 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:28.471 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:21:28.472 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:21:28.472 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:28.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:21:28.481 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:21:28.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.656+0000 7faa38c00640 1 -- 172.21.15.17:0/3811000420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa18003a60 msgr2=0x7faa18003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.656+0000 7faa38c00640 1 --2- 172.21.15.17:0/3811000420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa18003a60 0x7faa18003e80 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7faa24009b60 tx=0x7faa2401d240 comp rx=0 tx=0).stop 2024-09-10T23:21:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.656+0000 7faa38c00640 1 -- 172.21.15.17:0/3811000420 shutdown_connections 2024-09-10T23:21:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.656+0000 7faa38c00640 1 --2- 172.21.15.17:0/3811000420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa18003a60 0x7faa18003e80 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.656+0000 7faa38c00640 1 -- 172.21.15.17:0/3811000420 >> 172.21.15.17:0/3811000420 conn(0x7faa3406cfc0 msgr2=0x7faa3406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.656+0000 7faa38c00640 1 -- 172.21.15.17:0/3811000420 shutdown_connections 2024-09-10T23:21:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.656+0000 7faa38c00640 1 -- 172.21.15.17:0/3811000420 wait complete. 2024-09-10T23:21:28.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 Processor -- start 2024-09-10T23:21:28.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 -- start start 2024-09-10T23:21:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa18003a60 0x7faa341e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa3414cf90 0x7faa34155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa34157aa0 0x7faa34157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faa34073cc0 con 0x7faa3414cf90 2024-09-10T23:21:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa34073b40 con 0x7faa34157aa0 2024-09-10T23:21:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faa34073e40 con 0x7faa18003a60 2024-09-10T23:21:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa3414cf90 0x7faa34155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa3414cf90 0x7faa34155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46826/0 (socket says 172.21.15.17:46826) 2024-09-10T23:21:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2be00640 1 -- 172.21.15.17:0/4188172290 learned_addr learned my addr 172.21.15.17:0/4188172290 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:28.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa31e00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa18003a60 0x7faa341e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa32800640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa34157aa0 0x7faa34157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2be00640 1 -- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa18003a60 msgr2=0x7faa341e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2be00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa18003a60 0x7faa341e9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2be00640 1 -- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa34157aa0 msgr2=0x7faa34157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2be00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa34157aa0 0x7faa34157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2be00640 1 -- 172.21.15.17:0/4188172290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa341e7ca0 con 0x7faa3414cf90 2024-09-10T23:21:28.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2be00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa3414cf90 0x7faa34155e00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7faa1c006660 tx=0x7faa1c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:28.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2a000640 1 -- 172.21.15.17:0/4188172290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c015070 con 0x7faa3414cf90 2024-09-10T23:21:28.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2a000640 1 -- 172.21.15.17:0/4188172290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa1c011920 con 0x7faa3414cf90 2024-09-10T23:21:28.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa2a000640 1 -- 172.21.15.17:0/4188172290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c011d70 con 0x7faa3414cf90 2024-09-10T23:21:28.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa341e7f80 con 0x7faa3414cf90 2024-09-10T23:21:28.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa341e8540 con 0x7faa3414cf90 2024-09-10T23:21:28.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.660+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3415f720 con 0x7faa3414cf90 2024-09-10T23:21:28.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.664+0000 7faa2a000640 1 -- 172.21.15.17:0/4188172290 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faa1c0103c0 con 0x7faa3414cf90 2024-09-10T23:21:28.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.664+0000 7faa2a000640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa100725e0 0x7faa10074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.664+0000 7faa2a000640 1 -- 172.21.15.17:0/4188172290 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7faa1c0941f0 con 0x7faa3414cf90 2024-09-10T23:21:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.664+0000 7faa31e00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa100725e0 0x7faa10074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.664+0000 7faa31e00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa100725e0 0x7faa10074aa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faa240ae000 tx=0x7faa24019fe0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:28.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.668+0000 7faa2a000640 1 -- 172.21.15.17:0/4188172290 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faa1c05f8f0 con 0x7faa3414cf90 2024-09-10T23:21:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa340b2f90 con 0x7faa3414cf90 2024-09-10T23:21:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa2a000640 1 -- 172.21.15.17:0/4188172290 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+3905 (secure 0 0 0) 0x7faa1c05f1f0 con 0x7faa3414cf90 2024-09-10T23:21:28.882 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:28.882 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":65,"btime":"2024-09-10T23:21:22:293331+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6185,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1386694568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1386694568},{"type":"v1","addr":"172.21.15.77:6835","nonce":1386694568}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/4074525293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":4074525293},{"type":"v1","addr":"172.21.15.77:6837","nonce":4074525293}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7134,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/946073344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":946073344},{"type":"v1","addr":"172.21.15.17:6835","nonce":946073344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/545870859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":545870859},{"type":"v1","addr":"172.21.15.17:6833","nonce":545870859}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[]} 2024-09-10T23:21:28.882 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 65 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa100725e0 msgr2=0x7faa10074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa100725e0 0x7faa10074aa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faa240ae000 tx=0x7faa24019fe0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa3414cf90 msgr2=0x7faa34155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa3414cf90 0x7faa34155e00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7faa1c006660 tx=0x7faa1c0039d0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 shutdown_connections 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa100725e0 0x7faa10074aa0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa34157aa0 0x7faa34157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa3414cf90 0x7faa34155e00 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 --2- 172.21.15.17:0/4188172290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa18003a60 0x7faa341e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 >> 172.21.15.17:0/4188172290 conn(0x7faa3406cfc0 msgr2=0x7faa34159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.876+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 shutdown_connections 2024-09-10T23:21:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:28.880+0000 7faa38c00640 1 -- 172.21.15.17:0/4188172290 wait complete. 2024-09-10T23:21:28.904 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:21:28.904 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:21:28.905 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:21:28.905 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:28.905 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:21:28.905 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:21:28.905 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:21:28.905 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:28.905 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:21:28.906 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:21:28.906 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:21:28.906 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:28.906 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:21:28.906 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:21:28.906 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:21:28.906 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:28.920 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:21:28.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:21:28.921 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:21:28.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:21:28.922 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:21:28.922 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:21:28.923 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:21:28.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:21:28.963 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:21:28.964 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:28.965 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:21:28.965 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:28.966 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:21:28.967 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:28.968 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:21:28.968 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:28.968 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:21:29.053 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:21:29.054 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:21:29.054 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:21:29.054 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:21:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.116+0000 7f34eb800640 1 -- 172.21.15.17:0/3755258508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 msgr2=0x7f34e40726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.116+0000 7f34eb800640 1 --2- 172.21.15.17:0/3755258508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 0x7f34e40726f0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f34e40518e0 tx=0x7f34dc01ca00 comp rx=0 tx=0).stop 2024-09-10T23:21:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.116+0000 7f34eb800640 1 -- 172.21.15.17:0/3755258508 shutdown_connections 2024-09-10T23:21:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.116+0000 7f34eb800640 1 --2- 172.21.15.17:0/3755258508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 0x7f34e40726f0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.116+0000 7f34eb800640 1 --2- 172.21.15.17:0/3755258508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34e40cf090 0x7f34e415e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.116+0000 7f34eb800640 1 --2- 172.21.15.17:0/3755258508 >> v2:172.21.15.77:3300/0 conn(0x7f34e415d7d0 0x7f34e415dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.116+0000 7f34eb800640 1 -- 172.21.15.17:0/3755258508 >> 172.21.15.17:0/3755258508 conn(0x7f34e40b1730 msgr2=0x7f34e40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.116+0000 7f34eb800640 1 -- 172.21.15.17:0/3755258508 shutdown_connections 2024-09-10T23:21:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.116+0000 7f34eb800640 1 -- 172.21.15.17:0/3755258508 wait complete. 2024-09-10T23:21:29.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-10T23:21:29.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 Processor -- start 2024-09-10T23:21:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 -- start start 2024-09-10T23:21:29.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34e40cf090 0x7f34e414cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:29.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e415d7d0 0x7f34e41f9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:29.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 0x7f34e414a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:29.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f34e406edf0 con 0x7f34e415e860 2024-09-10T23:21:29.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f34e406ec70 con 0x7f34e415d7d0 2024-09-10T23:21:29.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f34e406ef70 con 0x7f34e40cf090 2024-09-10T23:21:29.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 0x7f34e414a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:29.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 0x7f34e414a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46866/0 (socket says 172.21.15.17:46866) 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e9800640 1 -- 172.21.15.17:0/1280252016 learned_addr learned my addr 172.21.15.17:0/1280252016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e8e00640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34e40cf090 0x7f34e414cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e3e00640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e415d7d0 0x7f34e41f9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e9800640 1 -- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34e40cf090 msgr2=0x7f34e414cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e9800640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34e40cf090 0x7f34e414cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e9800640 1 -- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e415d7d0 msgr2=0x7f34e41f9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e9800640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e415d7d0 0x7f34e41f9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e9800640 1 -- 172.21.15.17:0/1280252016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e40cc110 con 0x7f34e415e860 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e3e00640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e415d7d0 0x7f34e41f9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e9800640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 0x7f34e414a800 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f34dc01b0b0 tx=0x7f34dc005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e0c00640 1 -- 172.21.15.17:0/1280252016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0b2040 con 0x7f34e415e860 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e0c00640 1 -- 172.21.15.17:0/1280252016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34dc004040 con 0x7f34e415e860 2024-09-10T23:21:29.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34e0c00640 1 -- 172.21.15.17:0/1280252016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc004470 con 0x7f34e415e860 2024-09-10T23:21:29.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e4152e20 con 0x7f34e415e860 2024-09-10T23:21:29.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.120+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e41516e0 con 0x7f34e415e860 2024-09-10T23:21:29.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.124+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e40726f0 con 0x7f34e415e860 2024-09-10T23:21:29.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.124+0000 7f34e0c00640 1 -- 172.21.15.17:0/1280252016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f34dc0b5070 con 0x7f34e415e860 2024-09-10T23:21:29.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.124+0000 7f34e0c00640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f34c40725e0 0x7f34c4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:29.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.124+0000 7f34e0c00640 1 -- 172.21.15.17:0/1280252016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5507+0+0 (secure 0 0 0) 0x7f34dc12d560 con 0x7f34e415e860 2024-09-10T23:21:29.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.124+0000 7f34e8e00640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f34c40725e0 0x7f34c4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:29.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.124+0000 7f34e8e00640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f34c40725e0 0x7f34c4074aa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f34d800a710 tx=0x7f34d800a2f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:29.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.128+0000 7f34e0c00640 1 -- 172.21.15.17:0/1280252016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f34e4152e20 con 0x7f34e415e860 2024-09-10T23:21:29.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:29.316+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f34e414cd40 con 0x7f34e415e860 2024-09-10T23:21:30.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.220+0000 7f34e0c00640 1 -- 172.21.15.17:0/1280252016 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) ==== 97+0+0 (secure 0 0 0) 0x7f34dc016970 con 0x7f34e415e860 2024-09-10T23:21:30.227 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:21:30.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f34c40725e0 msgr2=0x7f34c4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f34c40725e0 0x7f34c4074aa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f34d800a710 tx=0x7f34d800a2f0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 msgr2=0x7f34e414a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 0x7f34e414a800 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f34dc01b0b0 tx=0x7f34dc005a60 comp rx=0 tx=0).stop 2024-09-10T23:21:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 shutdown_connections 2024-09-10T23:21:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f34c40725e0 0x7f34c4074aa0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34e415e860 0x7f34e414a800 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34e415d7d0 0x7f34e41f9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 --2- 172.21.15.17:0/1280252016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34e40cf090 0x7f34e414cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 >> 172.21.15.17:0/1280252016 conn(0x7f34e40b1730 msgr2=0x7f34e40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 shutdown_connections 2024-09-10T23:21:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.224+0000 7f34eb800640 1 -- 172.21.15.17:0/1280252016 wait complete. 2024-09-10T23:21:30.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:21:30.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 -- 172.21.15.17:0/2982348963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf610 msgr2=0x7f93f815b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 --2- 172.21.15.17:0/2982348963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf610 0x7f93f815b240 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f93e4009900 tx=0x7f93e401f0d0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 -- 172.21.15.17:0/2982348963 shutdown_connections 2024-09-10T23:21:30.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 --2- 172.21.15.17:0/2982348963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf610 0x7f93f815b240 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 --2- 172.21.15.17:0/2982348963 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93f80cf230 0x7f93f806e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 -- 172.21.15.17:0/2982348963 >> 172.21.15.17:0/2982348963 conn(0x7f93f806cfc0 msgr2=0x7f93f806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:30.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 -- 172.21.15.17:0/2982348963 shutdown_connections 2024-09-10T23:21:30.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 -- 172.21.15.17:0/2982348963 wait complete. 2024-09-10T23:21:30.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 Processor -- start 2024-09-10T23:21:30.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 -- start start 2024-09-10T23:21:30.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f80b32d0 0x7f93f80ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf230 0x7f93f80b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93f80cf610 0x7f93f81502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93f80d0330 con 0x7f93f80cf230 2024-09-10T23:21:30.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93f80d01b0 con 0x7f93f80b32d0 2024-09-10T23:21:30.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f9400600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f93f80d04b0 con 0x7f93f80cf610 2024-09-10T23:21:30.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fd200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf230 0x7f93f80b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fd200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf230 0x7f93f80b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46894/0 (socket says 172.21.15.17:46894) 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fd200640 1 -- 172.21.15.17:0/3345385154 learned_addr learned my addr 172.21.15.17:0/3345385154 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fdc00640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f80b32d0 0x7f93f80ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fe600640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93f80cf610 0x7f93f81502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fd200640 1 -- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93f80cf610 msgr2=0x7f93f81502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fd200640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93f80cf610 0x7f93f81502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fd200640 1 -- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f80b32d0 msgr2=0x7f93f80ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fd200640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f80b32d0 0x7f93f80ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fd200640 1 -- 172.21.15.17:0/3345385154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f80af910 con 0x7f93f80cf230 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.404+0000 7f93fe600640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93f80cf610 0x7f93f81502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f93fd200640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf230 0x7f93f80b0580 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f93e4009850 tx=0x7f93e4005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f93f5600640 1 -- 172.21.15.17:0/3345385154 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e40be070 con 0x7f93f80cf230 2024-09-10T23:21:30.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f93f5600640 1 -- 172.21.15.17:0/3345385154 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93e40038f0 con 0x7f93f80cf230 2024-09-10T23:21:30.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f93f5600640 1 -- 172.21.15.17:0/3345385154 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e40b5040 con 0x7f93f80cf230 2024-09-10T23:21:30.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f80b1120 con 0x7f93f80cf230 2024-09-10T23:21:30.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f80afd80 con 0x7f93f80cf230 2024-09-10T23:21:30.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f806e750 con 0x7f93f80cf230 2024-09-10T23:21:30.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f93f5600640 1 -- 172.21.15.17:0/3345385154 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f93e40b8070 con 0x7f93f80cf230 2024-09-10T23:21:30.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f93f5600640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93d80725e0 0x7f93d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.408+0000 7f93f5600640 1 -- 172.21.15.17:0/3345385154 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5249+0+0 (secure 0 0 0) 0x7f93e412fbc0 con 0x7f93f80cf230 2024-09-10T23:21:30.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.412+0000 7f93fdc00640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93d80725e0 0x7f93d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.412+0000 7f93fdc00640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93d80725e0 0x7f93d8074aa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f93f81eaef0 tx=0x7f93ec010040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:30.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.412+0000 7f93f5600640 1 -- 172.21.15.17:0/3345385154 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f93e4018c30 con 0x7f93f80cf230 2024-09-10T23:21:30.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f93f806ff20 con 0x7f93f80cf230 2024-09-10T23:21:30.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f93f5600640 1 -- 172.21.15.17:0/3345385154 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f93e40fad70 con 0x7f93f80cf230 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.659 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:21:30.662 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.666 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:21:30.668 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:21:30.669 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:30.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:21:30.671 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:21:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93d80725e0 msgr2=0x7f93d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93d80725e0 0x7f93d8074aa0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f93f81eaef0 tx=0x7f93ec010040 comp rx=0 tx=0).stop 2024-09-10T23:21:30.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf230 msgr2=0x7f93f80b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf230 0x7f93f80b0580 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f93e4009850 tx=0x7f93e4005790 comp rx=0 tx=0).stop 2024-09-10T23:21:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 shutdown_connections 2024-09-10T23:21:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93d80725e0 0x7f93d8074aa0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93f80cf610 0x7f93f81502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93f80cf230 0x7f93f80b0580 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 --2- 172.21.15.17:0/3345385154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93f80b32d0 0x7f93f80ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 >> 172.21.15.17:0/3345385154 conn(0x7f93f806cfc0 msgr2=0x7f93f815a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 shutdown_connections 2024-09-10T23:21:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.652+0000 7f9400600640 1 -- 172.21.15.17:0/3345385154 wait complete. 2024-09-10T23:21:30.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:21:30.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.820+0000 7faa87200640 1 -- 172.21.15.17:0/3664473751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa880b4620 msgr2=0x7faa88073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.820+0000 7faa87200640 1 --2- 172.21.15.17:0/3664473751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa880b4620 0x7faa88073520 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7faa78009900 tx=0x7faa7801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.820+0000 7faa87200640 1 -- 172.21.15.17:0/3664473751 shutdown_connections 2024-09-10T23:21:30.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.820+0000 7faa87200640 1 --2- 172.21.15.17:0/3664473751 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa88073a60 0x7faa880b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.820+0000 7faa87200640 1 --2- 172.21.15.17:0/3664473751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa880b4620 0x7faa88073520 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.820+0000 7faa87200640 1 -- 172.21.15.17:0/3664473751 >> 172.21.15.17:0/3664473751 conn(0x7faa880b2740 msgr2=0x7faa880b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:30.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.820+0000 7faa87200640 1 -- 172.21.15.17:0/3664473751 shutdown_connections 2024-09-10T23:21:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.820+0000 7faa87200640 1 -- 172.21.15.17:0/3664473751 wait complete. 2024-09-10T23:21:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 Processor -- start 2024-09-10T23:21:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 -- start start 2024-09-10T23:21:30.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa88073a60 0x7faa8815ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa880b4620 0x7faa8813e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa880b4f40 0x7faa88164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faa88167920 con 0x7faa88073a60 2024-09-10T23:21:30.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa881677a0 con 0x7faa880b4f40 2024-09-10T23:21:30.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faa88167aa0 con 0x7faa880b4620 2024-09-10T23:21:30.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa85e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa88073a60 0x7faa8815ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa85e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa88073a60 0x7faa8815ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46910/0 (socket says 172.21.15.17:46910) 2024-09-10T23:21:30.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa85e00640 1 -- 172.21.15.17:0/2742713887 learned_addr learned my addr 172.21.15.17:0/2742713887 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa86800640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa880b4f40 0x7faa88164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa7fe00640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa880b4620 0x7faa8813e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa85e00640 1 -- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa880b4620 msgr2=0x7faa8813e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa85e00640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa880b4620 0x7faa8813e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa85e00640 1 -- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa880b4f40 msgr2=0x7faa88164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa85e00640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa880b4f40 0x7faa88164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa85e00640 1 -- 172.21.15.17:0/2742713887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8813c350 con 0x7faa88073a60 2024-09-10T23:21:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa85e00640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa88073a60 0x7faa8815ea60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7faa7801d180 tx=0x7faa780a55a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:30.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa7e000640 1 -- 172.21.15.17:0/2742713887 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa780b2040 con 0x7faa88073a60 2024-09-10T23:21:30.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa7e000640 1 -- 172.21.15.17:0/2742713887 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa78004380 con 0x7faa88073a60 2024-09-10T23:21:30.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa7e000640 1 -- 172.21.15.17:0/2742713887 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa780052d0 con 0x7faa88073a60 2024-09-10T23:21:30.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8813e9b0 con 0x7faa88073a60 2024-09-10T23:21:30.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8813ef70 con 0x7faa88073a60 2024-09-10T23:21:30.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.824+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa880b4a00 con 0x7faa88073a60 2024-09-10T23:21:30.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.828+0000 7faa7e000640 1 -- 172.21.15.17:0/2742713887 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faa78005470 con 0x7faa88073a60 2024-09-10T23:21:30.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.828+0000 7faa7e000640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa640725e0 0x7faa64074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:30.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.828+0000 7faa7e000640 1 -- 172.21.15.17:0/2742713887 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5249+0+0 (secure 0 0 0) 0x7faa7812cc30 con 0x7faa88073a60 2024-09-10T23:21:30.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.828+0000 7faa7fe00640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa640725e0 0x7faa64074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:30.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.828+0000 7faa7fe00640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa640725e0 0x7faa64074aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faa700058d0 tx=0x7faa70005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:30.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:30.832+0000 7faa7e000640 1 -- 172.21.15.17:0/2742713887 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faa780164d0 con 0x7faa88073a60 2024-09-10T23:21:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.008+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7faa8815ab70 con 0x7faa88073a60 2024-09-10T23:21:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.008+0000 7faa7e000640 1 -- 172.21.15.17:0/2742713887 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v99) ==== 84+0+65 (secure 0 0 0) 0x7faa780f8440 con 0x7faa88073a60 2024-09-10T23:21:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:31.015 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:21:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:21:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:21:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:21:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:31.015 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:21:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa640725e0 msgr2=0x7faa64074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa640725e0 0x7faa64074aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faa700058d0 tx=0x7faa70005860 comp rx=0 tx=0).stop 2024-09-10T23:21:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa88073a60 msgr2=0x7faa8815ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa88073a60 0x7faa8815ea60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7faa7801d180 tx=0x7faa780a55a0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 shutdown_connections 2024-09-10T23:21:31.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faa640725e0 0x7faa64074aa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa880b4f40 0x7faa88164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faa880b4620 0x7faa8813e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 --2- 172.21.15.17:0/2742713887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa88073a60 0x7faa8815ea60 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 >> 172.21.15.17:0/2742713887 conn(0x7faa880b2740 msgr2=0x7faa8806faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 shutdown_connections 2024-09-10T23:21:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.012+0000 7faa87200640 1 -- 172.21.15.17:0/2742713887 wait complete. 2024-09-10T23:21:31.037 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:21:31.037 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:21:31.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.180+0000 7fe34d200640 1 -- 172.21.15.17:0/4290670824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b2d40 msgr2=0x7fe3480b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.180+0000 7fe34d200640 1 --2- 172.21.15.17:0/4290670824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b2d40 0x7fe3480b2710 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe3480d1700 tx=0x7fe34001cd80 comp rx=0 tx=0).stop 2024-09-10T23:21:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.180+0000 7fe34d200640 1 -- 172.21.15.17:0/4290670824 shutdown_connections 2024-09-10T23:21:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.180+0000 7fe34d200640 1 --2- 172.21.15.17:0/4290670824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b2d40 0x7fe3480b2710 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.180+0000 7fe34d200640 1 --2- 172.21.15.17:0/4290670824 >> v2:172.21.15.77:3300/0 conn(0x7fe3480b0990 0x7fe3480b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.180+0000 7fe34d200640 1 -- 172.21.15.17:0/4290670824 >> 172.21.15.17:0/4290670824 conn(0x7fe34809b080 msgr2=0x7fe3480d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.180+0000 7fe34d200640 1 -- 172.21.15.17:0/4290670824 shutdown_connections 2024-09-10T23:21:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.180+0000 7fe34d200640 1 -- 172.21.15.17:0/4290670824 wait complete. 2024-09-10T23:21:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 Processor -- start 2024-09-10T23:21:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 -- start start 2024-09-10T23:21:31.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b0990 0x7fe348166560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:31.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3480b2d40 0x7fe348154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:31.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe34815f600 0x7fe348154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:31.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe348169160 con 0x7fe3480b0990 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe348168fe0 con 0x7fe34815f600 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3481692e0 con 0x7fe3480b2d40 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe345e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b0990 0x7fe348166560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe345e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b0990 0x7fe348166560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46932/0 (socket says 172.21.15.17:46932) 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe345e00640 1 -- 172.21.15.17:0/2913074738 learned_addr learned my addr 172.21.15.17:0/2913074738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe33fe00640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3480b2d40 0x7fe348154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe346800640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe34815f600 0x7fe348154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe345e00640 1 -- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3480b2d40 msgr2=0x7fe348154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe345e00640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3480b2d40 0x7fe348154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe345e00640 1 -- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe34815f600 msgr2=0x7fe348154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe345e00640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe34815f600 0x7fe348154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe345e00640 1 -- 172.21.15.17:0/2913074738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe348154940 con 0x7fe3480b0990 2024-09-10T23:21:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe346800640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe34815f600 0x7fe348154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe345e00640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b0990 0x7fe348166560 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe33800b440 tx=0x7fe33800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe33e000640 1 -- 172.21.15.17:0/2913074738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338015020 con 0x7fe3480b0990 2024-09-10T23:21:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe33e000640 1 -- 172.21.15.17:0/2913074738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe338011980 con 0x7fe3480b0990 2024-09-10T23:21:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe33e000640 1 -- 172.21.15.17:0/2913074738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338011dd0 con 0x7fe3480b0990 2024-09-10T23:21:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe348158e50 con 0x7fe3480b0990 2024-09-10T23:21:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.184+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe348159410 con 0x7fe3480b0990 2024-09-10T23:21:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.188+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3480cc900 con 0x7fe3480b0990 2024-09-10T23:21:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.188+0000 7fe33e000640 1 -- 172.21.15.17:0/2913074738 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe33801a400 con 0x7fe3480b0990 2024-09-10T23:21:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.188+0000 7fe33e000640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3240725e0 0x7fe324074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.188+0000 7fe33e000640 1 -- 172.21.15.17:0/2913074738 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5249+0+0 (secure 0 0 0) 0x7fe3380932b0 con 0x7fe3480b0990 2024-09-10T23:21:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.188+0000 7fe33fe00640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3240725e0 0x7fe324074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:31.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.192+0000 7fe33fe00640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3240725e0 0x7fe324074aa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe3300058d0 tx=0x7fe330005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:31.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.192+0000 7fe33e000640 1 -- 172.21.15.17:0/2913074738 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe33801f030 con 0x7fe3480b0990 2024-09-10T23:21:31.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:31.368+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe3480b1430 con 0x7fe3480b0990 2024-09-10T23:21:32.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.224+0000 7fe33e000640 1 -- 172.21.15.17:0/2913074738 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v100) ==== 138+0+0 (secure 0 0 0) 0x7fe33800d040 con 0x7fe3480b0990 2024-09-10T23:21:32.231 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:21:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3240725e0 msgr2=0x7fe324074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3240725e0 0x7fe324074aa0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe3300058d0 tx=0x7fe330005860 comp rx=0 tx=0).stop 2024-09-10T23:21:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b0990 msgr2=0x7fe348166560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b0990 0x7fe348166560 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fe33800b440 tx=0x7fe33800b900 comp rx=0 tx=0).stop 2024-09-10T23:21:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 shutdown_connections 2024-09-10T23:21:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3240725e0 0x7fe324074aa0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe34815f600 0x7fe348154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3480b2d40 0x7fe348154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 --2- 172.21.15.17:0/2913074738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3480b0990 0x7fe348166560 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 >> 172.21.15.17:0/2913074738 conn(0x7fe34809b080 msgr2=0x7fe34814c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 shutdown_connections 2024-09-10T23:21:32.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.228+0000 7fe34d200640 1 -- 172.21.15.17:0/2913074738 wait complete. 2024-09-10T23:21:32.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:21:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.416+0000 7f1b3f800640 1 -- 172.21.15.17:0/2144830368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b20003a40 msgr2=0x7f1b20003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.416+0000 7f1b3f800640 1 --2- 172.21.15.17:0/2144830368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b20003a40 0x7f1b20003e60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009b60 tx=0x7f1b2c01d180 comp rx=0 tx=0).stop 2024-09-10T23:21:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.416+0000 7f1b3d800640 1 -- 172.21.15.17:0/2144830368 reap_dead start 2024-09-10T23:21:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.416+0000 7f1b3f800640 1 -- 172.21.15.17:0/2144830368 shutdown_connections 2024-09-10T23:21:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.416+0000 7f1b3f800640 1 -- 172.21.15.17:0/2144830368 >> 172.21.15.17:0/2144830368 conn(0x7f1b380d0c10 msgr2=0x7f1b380d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.416+0000 7f1b3f800640 1 -- 172.21.15.17:0/2144830368 shutdown_connections 2024-09-10T23:21:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.416+0000 7f1b3f800640 1 -- 172.21.15.17:0/2144830368 wait complete. 2024-09-10T23:21:32.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.416+0000 7f1b3f800640 1 Processor -- start 2024-09-10T23:21:32.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.416+0000 7f1b3f800640 1 -- start start 2024-09-10T23:21:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3f800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b20003a40 0x7f1b381473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3f800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b380b0a10 0x7f1b380c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3f800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b380b0e90 0x7f1b38149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3f800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38071410 con 0x7f1b20003a40 2024-09-10T23:21:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3f800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38071290 con 0x7f1b380b0a10 2024-09-10T23:21:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3f800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1b381677b0 con 0x7f1b380b0e90 2024-09-10T23:21:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b20003a40 0x7f1b381473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b20003a40 0x7f1b381473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46948/0 (socket says 172.21.15.17:46948) 2024-09-10T23:21:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3ce00640 1 -- 172.21.15.17:0/3045872604 learned_addr learned my addr 172.21.15.17:0/3045872604 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3d800640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b380b0e90 0x7f1b38149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3ce00640 1 -- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b380b0e90 msgr2=0x7f1b38149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b37e00640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b380b0a10 0x7f1b380c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3ce00640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b380b0e90 0x7f1b38149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3ce00640 1 -- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b380b0a10 msgr2=0x7f1b380c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3ce00640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b380b0a10 0x7f1b380c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3ce00640 1 -- 172.21.15.17:0/3045872604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b38144e30 con 0x7f1b20003a40 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3d800640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b380b0e90 0x7f1b38149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b37e00640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b380b0a10 0x7f1b380c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:32.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3ce00640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b20003a40 0x7f1b381473c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c01cfb0 tx=0x7f1b2c005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:32.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b34c00640 1 -- 172.21.15.17:0/3045872604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0b1040 con 0x7f1b20003a40 2024-09-10T23:21:32.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b34c00640 1 -- 172.21.15.17:0/3045872604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b2c0bc070 con 0x7f1b20003a40 2024-09-10T23:21:32.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b34c00640 1 -- 172.21.15.17:0/3045872604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0acb40 con 0x7f1b20003a40 2024-09-10T23:21:32.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b38145110 con 0x7f1b20003a40 2024-09-10T23:21:32.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b381456d0 con 0x7f1b20003a40 2024-09-10T23:21:32.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.420+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b38070100 con 0x7f1b20003a40 2024-09-10T23:21:32.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.424+0000 7f1b34c00640 1 -- 172.21.15.17:0/3045872604 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1b2c0acce0 con 0x7f1b20003a40 2024-09-10T23:21:32.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.424+0000 7f1b34c00640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b180725e0 0x7f1b18074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:32.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.424+0000 7f1b34c00640 1 -- 172.21.15.17:0/3045872604 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5619+0+0 (secure 0 0 0) 0x7f1b2c12ed80 con 0x7f1b20003a40 2024-09-10T23:21:32.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.424+0000 7f1b37e00640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b180725e0 0x7f1b18074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:32.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.424+0000 7f1b37e00640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b180725e0 0x7f1b18074aa0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b24006c80 tx=0x7f1b240067e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:32.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.428+0000 7f1b34c00640 1 -- 172.21.15.17:0/3045872604 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1b2c016f80 con 0x7f1b20003a40 2024-09-10T23:21:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:32.604+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1b3815b050 con 0x7f1b20003a40 2024-09-10T23:21:33.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.232+0000 7f1b34c00640 1 -- 172.21.15.17:0/3045872604 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v101) ==== 170+0+0 (secure 0 0 0) 0x7f1b2c0fa520 con 0x7f1b20003a40 2024-09-10T23:21:33.238 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:21:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b180725e0 msgr2=0x7f1b18074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b180725e0 0x7f1b18074aa0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b24006c80 tx=0x7f1b240067e0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b20003a40 msgr2=0x7f1b381473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b20003a40 0x7f1b381473c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c01cfb0 tx=0x7f1b2c005620 comp rx=0 tx=0).stop 2024-09-10T23:21:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 shutdown_connections 2024-09-10T23:21:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1b180725e0 0x7f1b18074aa0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b380b0e90 0x7f1b38149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b380b0a10 0x7f1b380c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 --2- 172.21.15.17:0/3045872604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b20003a40 0x7f1b381473c0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 >> 172.21.15.17:0/3045872604 conn(0x7f1b380d0c10 msgr2=0x7f1b380718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:33.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 shutdown_connections 2024-09-10T23:21:33.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.236+0000 7f1b3f800640 1 -- 172.21.15.17:0/3045872604 wait complete. 2024-09-10T23:21:33.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:21:33.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.428+0000 7fbe17e00640 1 -- 172.21.15.17:0/389603059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 msgr2=0x7fbe100741d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:33.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.428+0000 7fbe17e00640 1 --2- 172.21.15.17:0/389603059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 0x7fbe100741d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009900 tx=0x7fbe0401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.428+0000 7fbe17e00640 1 -- 172.21.15.17:0/389603059 shutdown_connections 2024-09-10T23:21:33.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.428+0000 7fbe17e00640 1 --2- 172.21.15.17:0/389603059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 0x7fbe100741d0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.428+0000 7fbe17e00640 1 -- 172.21.15.17:0/389603059 >> 172.21.15.17:0/389603059 conn(0x7fbe100b17a0 msgr2=0x7fbe100b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:33.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.428+0000 7fbe17e00640 1 -- 172.21.15.17:0/389603059 shutdown_connections 2024-09-10T23:21:33.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.428+0000 7fbe17e00640 1 -- 172.21.15.17:0/389603059 wait complete. 2024-09-10T23:21:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.428+0000 7fbe17e00640 1 Processor -- start 2024-09-10T23:21:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 -- start start 2024-09-10T23:21:33.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 0x7fbe1013e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:33.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe1015fe80 0x7fbe1013a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:33.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe10160460 0x7fbe101f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1016a350 con 0x7fbe10145800 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1016a1d0 con 0x7fbe10160460 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe1016a4d0 con 0x7fbe1015fe80 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 0x7fbe1013e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 0x7fbe1013e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46960/0 (socket says 172.21.15.17:46960) 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15400640 1 -- 172.21.15.17:0/3033653303 learned_addr learned my addr 172.21.15.17:0/3033653303 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe14a00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe1015fe80 0x7fbe1013a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15e00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe10160460 0x7fbe101f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15400640 1 -- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe1015fe80 msgr2=0x7fbe1013a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15400640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe1015fe80 0x7fbe1013a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15400640 1 -- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe10160460 msgr2=0x7fbe101f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:33.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15400640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe10160460 0x7fbe101f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:33.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15400640 1 -- 172.21.15.17:0/3033653303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe101f8f10 con 0x7fbe10145800 2024-09-10T23:21:33.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe15400640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 0x7fbe1013e3e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009850 tx=0x7fbe040040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:33.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe0d600640 1 -- 172.21.15.17:0/3033653303 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe040b2040 con 0x7fbe10145800 2024-09-10T23:21:33.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe0d600640 1 -- 172.21.15.17:0/3033653303 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe04005020 con 0x7fbe10145800 2024-09-10T23:21:33.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe101f8950 con 0x7fbe10145800 2024-09-10T23:21:33.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe0d600640 1 -- 172.21.15.17:0/3033653303 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04005450 con 0x7fbe10145800 2024-09-10T23:21:33.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe10141a90 con 0x7fbe10145800 2024-09-10T23:21:33.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.432+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe1013a620 con 0x7fbe10145800 2024-09-10T23:21:33.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.436+0000 7fbe0d600640 1 -- 172.21.15.17:0/3033653303 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbe040046d0 con 0x7fbe10145800 2024-09-10T23:21:33.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.436+0000 7fbe0d600640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbdf0072610 0x7fbdf0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:33.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.436+0000 7fbe0d600640 1 -- 172.21.15.17:0/3033653303 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6001+0+0 (secure 0 0 0) 0x7fbe0412d650 con 0x7fbe10145800 2024-09-10T23:21:33.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.436+0000 7fbe14a00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbdf0072610 0x7fbdf0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:33.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.436+0000 7fbe14a00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbdf0072610 0x7fbdf0074ad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbe101f5b10 tx=0x7fbdfc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:33.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.440+0000 7fbe0d600640 1 -- 172.21.15.17:0/3033653303 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbe040164d0 con 0x7fbe10145800 2024-09-10T23:21:33.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:33.648+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbe10068d10 con 0x7fbe10145800 2024-09-10T23:21:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.236+0000 7fbe0d600640 1 -- 172.21.15.17:0/3033653303 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v67) ==== 174+0+0 (secure 0 0 0) 0x7fbe040f8c70 con 0x7fbe10145800 2024-09-10T23:21:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 13 and data pool 14 2024-09-10T23:21:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.240+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbdf0072610 msgr2=0x7fbdf0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.240+0000 7fbe17e00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbdf0072610 0x7fbdf0074ad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbe101f5b10 tx=0x7fbdfc009040 comp rx=0 tx=0).stop 2024-09-10T23:21:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.240+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 msgr2=0x7fbe1013e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.240+0000 7fbe17e00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 0x7fbe1013e3e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009850 tx=0x7fbe040040c0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.244+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 shutdown_connections 2024-09-10T23:21:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.244+0000 7fbe17e00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbdf0072610 0x7fbdf0074ad0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.244+0000 7fbe17e00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe10160460 0x7fbe101f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.244+0000 7fbe17e00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe1015fe80 0x7fbe1013a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.244+0000 7fbe17e00640 1 --2- 172.21.15.17:0/3033653303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe10145800 0x7fbe1013e3e0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.244+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 >> 172.21.15.17:0/3033653303 conn(0x7fbe100b17a0 msgr2=0x7fbe100b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:34.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.244+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 shutdown_connections 2024-09-10T23:21:34.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.244+0000 7fbe17e00640 1 -- 172.21.15.17:0/3033653303 wait complete. 2024-09-10T23:21:34.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:21:34.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.436+0000 7f4dcce00640 1 -- 172.21.15.17:0/3831581956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dac004030 msgr2=0x7f4dac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.436+0000 7f4dcce00640 1 --2- 172.21.15.17:0/3831581956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dac004030 0x7f4dac004810 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f4db4006f90 tx=0x7f4db401f680 comp rx=0 tx=0).stop 2024-09-10T23:21:34.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.436+0000 7f4dc6800640 1 -- 172.21.15.17:0/3831581956 reap_dead start 2024-09-10T23:21:34.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.436+0000 7f4dcce00640 1 -- 172.21.15.17:0/3831581956 shutdown_connections 2024-09-10T23:21:34.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.436+0000 7f4dcce00640 1 -- 172.21.15.17:0/3831581956 >> 172.21.15.17:0/3831581956 conn(0x7f4dc80d0cb0 msgr2=0x7f4dc80d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:34.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.436+0000 7f4dcce00640 1 -- 172.21.15.17:0/3831581956 shutdown_connections 2024-09-10T23:21:34.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.436+0000 7f4dcce00640 1 -- 172.21.15.17:0/3831581956 wait complete. 2024-09-10T23:21:34.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 Processor -- start 2024-09-10T23:21:34.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 -- start start 2024-09-10T23:21:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4dac004030 0x7f4dc80c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc814a0d0 0x7f4dc8158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dc81593c0 0x7f4dc81f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc8071d00 con 0x7f4dc814a0d0 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc8071b80 con 0x7f4dc81593c0 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc80cb300 con 0x7f4dac004030 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc814a0d0 0x7f4dc8158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc814a0d0 0x7f4dc8158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46982/0 (socket says 172.21.15.17:46982) 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5400640 1 -- 172.21.15.17:0/2246215922 learned_addr learned my addr 172.21.15.17:0/2246215922 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4dac004030 0x7f4dc80c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc6800640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dc81593c0 0x7f4dc81f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5400640 1 -- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4dac004030 msgr2=0x7f4dc80c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5400640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4dac004030 0x7f4dc80c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5400640 1 -- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dc81593c0 msgr2=0x7f4dc81f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5400640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dc81593c0 0x7f4dc81f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5400640 1 -- 172.21.15.17:0/2246215922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc80c8160 con 0x7f4dc814a0d0 2024-09-10T23:21:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dc5400640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc814a0d0 0x7f4dc8158e80 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f4db401dd80 tx=0x7f4db4001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dbe000640 1 -- 172.21.15.17:0/2246215922 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db40bf070 con 0x7f4dc814a0d0 2024-09-10T23:21:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dbe000640 1 -- 172.21.15.17:0/2246215922 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4db4006550 con 0x7f4dc814a0d0 2024-09-10T23:21:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dbe000640 1 -- 172.21.15.17:0/2246215922 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db40b3070 con 0x7f4dc814a0d0 2024-09-10T23:21:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc80c8440 con 0x7f4dc814a0d0 2024-09-10T23:21:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc80c8a00 con 0x7f4dc814a0d0 2024-09-10T23:21:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.440+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc80cfa00 con 0x7f4dc814a0d0 2024-09-10T23:21:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.444+0000 7f4dbe000640 1 -- 172.21.15.17:0/2246215922 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4db40b9070 con 0x7f4dc814a0d0 2024-09-10T23:21:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.444+0000 7f4dbe000640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4da80725e0 0x7f4da8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.444+0000 7f4dbe000640 1 -- 172.21.15.17:0/2246215922 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6101+0+0 (secure 0 0 0) 0x7f4db4130770 con 0x7f4dc814a0d0 2024-09-10T23:21:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.444+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4da80725e0 0x7f4da8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.444+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4da80725e0 0x7f4da8074aa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009b80 tx=0x7f4db80091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.448+0000 7f4dbe000640 1 -- 172.21.15.17:0/2246215922 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4db40ab070 con 0x7f4dc814a0d0 2024-09-10T23:21:34.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dc81597a0 con 0x7f4dc814a0d0 2024-09-10T23:21:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dbe000640 1 -- 172.21.15.17:0/2246215922 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16909 (secure 0 0 0) 0x7f4db4019430 con 0x7f4dc814a0d0 2024-09-10T23:21:34.629 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:34.630 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":102,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:21:33.653418+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:21:31.384816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T23:21:32.619438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:21:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4da80725e0 msgr2=0x7f4da8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4da80725e0 0x7f4da8074aa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009b80 tx=0x7f4db80091e0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc814a0d0 msgr2=0x7f4dc8158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc814a0d0 0x7f4dc8158e80 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f4db401dd80 tx=0x7f4db4001d40 comp rx=0 tx=0).stop 2024-09-10T23:21:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 shutdown_connections 2024-09-10T23:21:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4da80725e0 0x7f4da8074aa0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dc81593c0 0x7f4dc81f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc814a0d0 0x7f4dc8158e80 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 --2- 172.21.15.17:0/2246215922 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4dac004030 0x7f4dc80c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.624+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 >> 172.21.15.17:0/2246215922 conn(0x7f4dc80d0cb0 msgr2=0x7f4dc80cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.628+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 shutdown_connections 2024-09-10T23:21:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.628+0000 7f4dcce00640 1 -- 172.21.15.17:0/2246215922 wait complete. 2024-09-10T23:21:34.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:21:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.792+0000 7f3d9f200640 1 -- 172.21.15.17:0/1108095735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d22c0 msgr2=0x7f3da00b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.792+0000 7f3d9f200640 1 --2- 172.21.15.17:0/1108095735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d22c0 0x7f3da00b7dc0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009c80 tx=0x7f3d9801cd70 comp rx=0 tx=0).stop 2024-09-10T23:21:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.792+0000 7f3d9f200640 1 -- 172.21.15.17:0/1108095735 shutdown_connections 2024-09-10T23:21:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.792+0000 7f3d9f200640 1 --2- 172.21.15.17:0/1108095735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d22c0 0x7f3da00b7dc0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.792+0000 7f3d9f200640 1 -- 172.21.15.17:0/1108095735 >> 172.21.15.17:0/1108095735 conn(0x7f3da00d3ce0 msgr2=0x7f3da00d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.792+0000 7f3d9f200640 1 -- 172.21.15.17:0/1108095735 shutdown_connections 2024-09-10T23:21:34.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.792+0000 7f3d9f200640 1 -- 172.21.15.17:0/1108095735 wait complete. 2024-09-10T23:21:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 Processor -- start 2024-09-10T23:21:34.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 -- start start 2024-09-10T23:21:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d0450 0x7f3da014c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3da00d22c0 0x7f3da0150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3da00d4800 0x7f3da015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3da016bca0 con 0x7f3da00d0450 2024-09-10T23:21:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3da016bb20 con 0x7f3da00d22c0 2024-09-10T23:21:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3da016be20 con 0x7f3da00d4800 2024-09-10T23:21:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d0450 0x7f3da014c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d0450 0x7f3da014c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47008/0 (socket says 172.21.15.17:47008) 2024-09-10T23:21:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9de00640 1 -- 172.21.15.17:0/2768412759 learned_addr learned my addr 172.21.15.17:0/2768412759 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:34.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d97e00640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3da00d22c0 0x7f3da0150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9e800640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3da00d4800 0x7f3da015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9de00640 1 -- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3da00d4800 msgr2=0x7f3da015c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9de00640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3da00d4800 0x7f3da015c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9de00640 1 -- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3da00d22c0 msgr2=0x7f3da0150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9de00640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3da00d22c0 0x7f3da0150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9de00640 1 -- 172.21.15.17:0/2768412759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da01585c0 con 0x7f3da00d0450 2024-09-10T23:21:34.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9de00640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d0450 0x7f3da014c820 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000c450 tx=0x7f3d9000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d96000640 1 -- 172.21.15.17:0/2768412759 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90005480 con 0x7f3da00d0450 2024-09-10T23:21:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d96000640 1 -- 172.21.15.17:0/2768412759 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d90003600 con 0x7f3da00d0450 2024-09-10T23:21:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d96000640 1 -- 172.21.15.17:0/2768412759 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90003a30 con 0x7f3da00d0450 2024-09-10T23:21:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da0151010 con 0x7f3da00d0450 2024-09-10T23:21:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da01515d0 con 0x7f3da00d0450 2024-09-10T23:21:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.796+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da00d0830 con 0x7f3da00d0450 2024-09-10T23:21:34.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.800+0000 7f3d96000640 1 -- 172.21.15.17:0/2768412759 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3d90003bd0 con 0x7f3da00d0450 2024-09-10T23:21:34.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.800+0000 7f3d96000640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d7c072610 0x7f3d7c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:34.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.800+0000 7f3d96000640 1 -- 172.21.15.17:0/2768412759 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6101+0+0 (secure 0 0 0) 0x7f3d90092dd0 con 0x7f3da00d0450 2024-09-10T23:21:34.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.800+0000 7f3d97e00640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d7c072610 0x7f3d7c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:34.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.800+0000 7f3d97e00640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d7c072610 0x7f3d7c074ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3da006f330 tx=0x7f3d88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.804+0000 7f3d96000640 1 -- 172.21.15.17:0/2768412759 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3d9005dc30 con 0x7f3da00d0450 2024-09-10T23:21:34.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3da00d44e0 con 0x7f3da00d0450 2024-09-10T23:21:34.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d96000640 1 -- 172.21.15.17:0/2768412759 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16909 (secure 0 0 0) 0x7f3d90062660 con 0x7f3da00d0450 2024-09-10T23:21:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:34.985 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":102,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:21:33.653418+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:21:31.384816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T23:21:32.619438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:21:34.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d7c072610 msgr2=0x7f3d7c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d7c072610 0x7f3d7c074ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3da006f330 tx=0x7f3d88009040 comp rx=0 tx=0).stop 2024-09-10T23:21:34.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d0450 msgr2=0x7f3da014c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:34.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d0450 0x7f3da014c820 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000c450 tx=0x7f3d9000c910 comp rx=0 tx=0).stop 2024-09-10T23:21:34.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 shutdown_connections 2024-09-10T23:21:34.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d7c072610 0x7f3d7c074ad0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3da00d4800 0x7f3da015c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3da00d22c0 0x7f3da0150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 --2- 172.21.15.17:0/2768412759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3da00d0450 0x7f3da014c820 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 >> 172.21.15.17:0/2768412759 conn(0x7f3da00d3ce0 msgr2=0x7f3da00b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 shutdown_connections 2024-09-10T23:21:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:34.980+0000 7f3d9f200640 1 -- 172.21.15.17:0/2768412759 wait complete. 2024-09-10T23:21:35.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:21:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.152+0000 7f6448200640 1 -- 172.21.15.17:0/167271276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64400d23e0 msgr2=0x7f6440071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.152+0000 7f6448200640 1 --2- 172.21.15.17:0/167271276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64400d23e0 0x7f6440071670 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f642c009840 tx=0x7f642c01c820 comp rx=0 tx=0).stop 2024-09-10T23:21:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.152+0000 7f6448200640 1 -- 172.21.15.17:0/167271276 shutdown_connections 2024-09-10T23:21:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.152+0000 7f6448200640 1 --2- 172.21.15.17:0/167271276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64400d23e0 0x7f6440071670 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.152+0000 7f6448200640 1 -- 172.21.15.17:0/167271276 >> 172.21.15.17:0/167271276 conn(0x7f644009a9f0 msgr2=0x7f644009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.152+0000 7f6448200640 1 -- 172.21.15.17:0/167271276 shutdown_connections 2024-09-10T23:21:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.152+0000 7f6448200640 1 -- 172.21.15.17:0/167271276 wait complete. 2024-09-10T23:21:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.152+0000 7f6448200640 1 Processor -- start 2024-09-10T23:21:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.152+0000 7f6448200640 1 -- start start 2024-09-10T23:21:35.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6448200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6440071bb0 0x7f6440156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6448200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400d23e0 0x7f64401542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6448200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f644015be20 0x7f6440157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6448200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6440169de0 con 0x7f6440071bb0 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6448200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6440169c60 con 0x7f644015be20 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6448200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6440169f60 con 0x7f64400d23e0 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6445800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6440071bb0 0x7f6440156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6445800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6440071bb0 0x7f6440156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47030/0 (socket says 172.21.15.17:47030) 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6445800640 1 -- 172.21.15.17:0/3522622678 learned_addr learned my addr 172.21.15.17:0/3522622678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6444e00640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400d23e0 0x7f64401542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6446200640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f644015be20 0x7f6440157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6445800640 1 -- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400d23e0 msgr2=0x7f64401542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6445800640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400d23e0 0x7f64401542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6445800640 1 -- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f644015be20 msgr2=0x7f6440157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6445800640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f644015be20 0x7f6440157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6445800640 1 -- 172.21.15.17:0/3522622678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6440158440 con 0x7f6440071bb0 2024-09-10T23:21:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6444e00640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400d23e0 0x7f64401542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6445800640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6440071bb0 0x7f6440156b60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f643400c450 tx=0x7f643400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f643d600640 1 -- 172.21.15.17:0/3522622678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434016020 con 0x7f6440071bb0 2024-09-10T23:21:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f643d600640 1 -- 172.21.15.17:0/3522622678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6434012920 con 0x7f6440071bb0 2024-09-10T23:21:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f643d600640 1 -- 172.21.15.17:0/3522622678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434012d50 con 0x7f6440071bb0 2024-09-10T23:21:35.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6440157140 con 0x7f6440071bb0 2024-09-10T23:21:35.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6440159190 con 0x7f6440071bb0 2024-09-10T23:21:35.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6440158ca0 con 0x7f6440071bb0 2024-09-10T23:21:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.156+0000 7f643d600640 1 -- 172.21.15.17:0/3522622678 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f643401a3b0 con 0x7f6440071bb0 2024-09-10T23:21:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.160+0000 7f643d600640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f64200725e0 0x7f6420074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.160+0000 7f643d600640 1 -- 172.21.15.17:0/3522622678 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6101+0+0 (secure 0 0 0) 0x7f6434093080 con 0x7f6440071bb0 2024-09-10T23:21:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.160+0000 7f6444e00640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f64200725e0 0x7f6420074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.160+0000 7f6444e00640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f64200725e0 0x7f6420074aa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f642c0af000 tx=0x7f642c01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:35.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.164+0000 7f643d600640 1 -- 172.21.15.17:0/3522622678 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6434020070 con 0x7f6440071bb0 2024-09-10T23:21:35.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:35.376+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f64400aee40 con 0x7f6440071bb0 2024-09-10T23:21:35.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-10T23:21:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.264+0000 7f643d600640 1 -- 172.21.15.17:0/3522622678 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) ==== 118+0+0 (secure 0 0 0) 0x7f643405e5c0 con 0x7f6440071bb0 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f64200725e0 msgr2=0x7f6420074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f64200725e0 0x7f6420074aa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f642c0af000 tx=0x7f642c01b060 comp rx=0 tx=0).stop 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6440071bb0 msgr2=0x7f6440156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6440071bb0 0x7f6440156b60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f643400c450 tx=0x7f643400c910 comp rx=0 tx=0).stop 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 shutdown_connections 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f64200725e0 0x7f6420074aa0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f644015be20 0x7f6440157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400d23e0 0x7f64401542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 --2- 172.21.15.17:0/3522622678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6440071bb0 0x7f6440156b60 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 >> 172.21.15.17:0/3522622678 conn(0x7f644009a9f0 msgr2=0x7f64400b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 shutdown_connections 2024-09-10T23:21:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.268+0000 7f6448200640 1 -- 172.21.15.17:0/3522622678 wait complete. 2024-09-10T23:21:36.298 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:21:36.299 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:21:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 -- 172.21.15.17:0/1861057337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b015be20 msgr2=0x7fe4b00d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 --2- 172.21.15.17:0/1861057337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b015be20 0x7fe4b00d1cd0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00cc320 tx=0x7fe4a401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:21:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 -- 172.21.15.17:0/1861057337 shutdown_connections 2024-09-10T23:21:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 --2- 172.21.15.17:0/1861057337 >> v2:172.21.15.77:3300/0 conn(0x7fe4b0071d80 0x7fe4b00cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 --2- 172.21.15.17:0/1861057337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b015be20 0x7fe4b00d1cd0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 -- 172.21.15.17:0/1861057337 >> 172.21.15.17:0/1861057337 conn(0x7fe4b009a9f0 msgr2=0x7fe4b009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 -- 172.21.15.17:0/1861057337 shutdown_connections 2024-09-10T23:21:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 -- 172.21.15.17:0/1861057337 wait complete. 2024-09-10T23:21:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 Processor -- start 2024-09-10T23:21:36.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.448+0000 7fe4b8600640 1 -- start start 2024-09-10T23:21:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b8600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b0071d80 0x7fe4b0155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b8600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b00d2210 0x7fe4b0159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b8600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b015be20 0x7fe4b0159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b8600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b0168b00 con 0x7fe4b00d2210 2024-09-10T23:21:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b8600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b0168c80 con 0x7fe4b0071d80 2024-09-10T23:21:36.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b8600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b0168e00 con 0x7fe4b015be20 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b00d2210 0x7fe4b0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b00d2210 0x7fe4b0159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47044/0 (socket says 172.21.15.17:47044) 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b0071d80 0x7fe4b0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5200640 1 -- 172.21.15.17:0/458882048 learned_addr learned my addr 172.21.15.17:0/458882048 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b6600640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b015be20 0x7fe4b0159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5200640 1 -- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b015be20 msgr2=0x7fe4b0159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5200640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b015be20 0x7fe4b0159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5200640 1 -- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b0071d80 msgr2=0x7fe4b0155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5200640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b0071d80 0x7fe4b0155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5200640 1 -- 172.21.15.17:0/458882048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b00b35b0 con 0x7fe4b00d2210 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b6600640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b015be20 0x7fe4b0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b5200640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b00d2210 0x7fe4b0159790 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00c450 tx=0x7fe49c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4ad600640 1 -- 172.21.15.17:0/458882048 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c012830 con 0x7fe4b00d2210 2024-09-10T23:21:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4ad600640 1 -- 172.21.15.17:0/458882048 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe49c017070 con 0x7fe4b00d2210 2024-09-10T23:21:36.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b0155720 con 0x7fe4b00d2210 2024-09-10T23:21:36.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4ad600640 1 -- 172.21.15.17:0/458882048 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c012d80 con 0x7fe4b00d2210 2024-09-10T23:21:36.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b0155ce0 con 0x7fe4b00d2210 2024-09-10T23:21:36.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b00cce50 con 0x7fe4b00d2210 2024-09-10T23:21:36.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.452+0000 7fe4ad600640 1 -- 172.21.15.17:0/458882048 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe49c01c460 con 0x7fe4b00d2210 2024-09-10T23:21:36.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.456+0000 7fe4ad600640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe490072610 0x7fe490074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:36.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.456+0000 7fe4ad600640 1 -- 172.21.15.17:0/458882048 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fe49c0931e0 con 0x7fe4b00d2210 2024-09-10T23:21:36.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.456+0000 7fe4b5c00640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe490072610 0x7fe490074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:36.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.456+0000 7fe4b5c00640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe490072610 0x7fe490074ad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40af000 tx=0x7fe4a401b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:36.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.460+0000 7fe4ad600640 1 -- 172.21.15.17:0/458882048 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe49c05e610 con 0x7fe4b00d2210 2024-09-10T23:21:36.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:36.664+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe4b015b630 con 0x7fe4b00d2210 2024-09-10T23:21:37.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:21:37.037 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:21:37.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.272+0000 7fe4ad600640 1 -- 172.21.15.17:0/458882048 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v71) ==== 122+0+0 (secure 0 0 0) 0x7fe49c05df10 con 0x7fe4b00d2210 2024-09-10T23:21:37.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe490072610 msgr2=0x7fe490074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe490072610 0x7fe490074ad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40af000 tx=0x7fe4a401b100 comp rx=0 tx=0).stop 2024-09-10T23:21:37.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b00d2210 msgr2=0x7fe4b0159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b00d2210 0x7fe4b0159790 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00c450 tx=0x7fe49c00c910 comp rx=0 tx=0).stop 2024-09-10T23:21:37.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 shutdown_connections 2024-09-10T23:21:37.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe490072610 0x7fe490074ad0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4b015be20 0x7fe4b0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4b00d2210 0x7fe4b0159790 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 --2- 172.21.15.17:0/458882048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4b0071d80 0x7fe4b0155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 >> 172.21.15.17:0/458882048 conn(0x7fe4b009a9f0 msgr2=0x7fe4b00b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 shutdown_connections 2024-09-10T23:21:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.276+0000 7fe4b8600640 1 -- 172.21.15.17:0/458882048 wait complete. 2024-09-10T23:21:37.304 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:21:37.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:37.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 -- 172.21.15.17:0/1363347291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa07415bc70 msgr2=0x7fa0740cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 --2- 172.21.15.17:0/1363347291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa07415bc70 0x7fa0740cfa20 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa064009900 tx=0x7fa06401c7c0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 -- 172.21.15.17:0/1363347291 shutdown_connections 2024-09-10T23:21:37.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 --2- 172.21.15.17:0/1363347291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0740d20a0 0x7fa0740b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 --2- 172.21.15.17:0/1363347291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa07415bc70 0x7fa0740cfa20 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 -- 172.21.15.17:0/1363347291 >> 172.21.15.17:0/1363347291 conn(0x7fa07409a9f0 msgr2=0x7fa07409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:37.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 -- 172.21.15.17:0/1363347291 shutdown_connections 2024-09-10T23:21:37.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 -- 172.21.15.17:0/1363347291 wait complete. 2024-09-10T23:21:37.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 Processor -- start 2024-09-10T23:21:37.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.448+0000 7fa073e00640 1 -- start start 2024-09-10T23:21:37.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0740cc570 0x7fa07414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0740d20a0 0x7fa074155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07415bc70 0x7fa0740ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa074168930 con 0x7fa0740cc570 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0740b21a0 con 0x7fa07415bc70 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa074168ab0 con 0x7fa0740d20a0 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0740cc570 0x7fa07414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0740cc570 0x7fa07414e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60440/0 (socket says 172.21.15.17:60440) 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072a00640 1 -- 172.21.15.17:0/1649529823 learned_addr learned my addr 172.21.15.17:0/1649529823 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072000640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0740d20a0 0x7fa074155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073400640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07415bc70 0x7fa0740ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072a00640 1 -- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0740d20a0 msgr2=0x7fa074155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072a00640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0740d20a0 0x7fa074155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072a00640 1 -- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07415bc70 msgr2=0x7fa0740ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072a00640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07415bc70 0x7fa0740ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072a00640 1 -- 172.21.15.17:0/1649529823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07414feb0 con 0x7fa0740cc570 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073400640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07415bc70 0x7fa0740ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa072a00640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0740cc570 0x7fa07414e370 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa064009850 tx=0x7fa0640a57e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa06b400640 1 -- 172.21.15.17:0/1649529823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640b2040 con 0x7fa0740cc570 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa06b400640 1 -- 172.21.15.17:0/1649529823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0640043c0 con 0x7fa0740cc570 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa06b400640 1 -- 172.21.15.17:0/1649529823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064005270 con 0x7fa0740cc570 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07414f610 con 0x7fa0740cc570 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07414fbd0 con 0x7fa0740cc570 2024-09-10T23:21:37.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.452+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0740b10f0 con 0x7fa0740cc570 2024-09-10T23:21:37.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.456+0000 7fa06b400640 1 -- 172.21.15.17:0/1649529823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa064005410 con 0x7fa0740cc570 2024-09-10T23:21:37.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.456+0000 7fa06b400640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0540725e0 0x7fa054074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.456+0000 7fa06b400640 1 -- 172.21.15.17:0/1649529823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fa06412cf50 con 0x7fa0740cc570 2024-09-10T23:21:37.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.456+0000 7fa072000640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0540725e0 0x7fa054074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.456+0000 7fa072000640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0540725e0 0x7fa054074aa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa07415d370 tx=0x7fa060009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:37.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.460+0000 7fa06b400640 1 -- 172.21.15.17:0/1649529823 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa0640164d0 con 0x7fa0740cc570 2024-09-10T23:21:37.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.668+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa074071950 con 0x7fa0740cc570 2024-09-10T23:21:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa06b400640 1 -- 172.21.15.17:0/1649529823 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5216 (secure 0 0 0) 0x7fa0640f8400 con 0x7fa0740cc570 2024-09-10T23:21:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:37.676 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":71,"btime":"2024-09-10T23:21:37:272327+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/662650354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":662650354},{"type":"v1","addr":"172.21.15.77:6837","nonce":662650354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1343355687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1343355687},{"type":"v1","addr":"172.21.15.77:6836","nonce":1343355687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1438697787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1438697787},{"type":"v1","addr":"172.21.15.17:6834","nonce":1438697787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:36.672500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7350":{"gid":7350,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/70051217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":70051217},{"type":"v1","addr":"172.21.15.17:6835","nonce":70051217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7350,"qdb_cluster":[7350]},"id":6}]} 2024-09-10T23:21:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 71 2024-09-10T23:21:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0540725e0 msgr2=0x7fa054074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0540725e0 0x7fa054074aa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa07415d370 tx=0x7fa060009040 comp rx=0 tx=0).stop 2024-09-10T23:21:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0740cc570 msgr2=0x7fa07414e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0740cc570 0x7fa07414e370 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa064009850 tx=0x7fa0640a57e0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 shutdown_connections 2024-09-10T23:21:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0540725e0 0x7fa054074aa0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa07415bc70 0x7fa0740ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa0740d20a0 0x7fa074155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 --2- 172.21.15.17:0/1649529823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0740cc570 0x7fa07414e370 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 >> 172.21.15.17:0/1649529823 conn(0x7fa07409a9f0 msgr2=0x7fa0740d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 shutdown_connections 2024-09-10T23:21:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.672+0000 7fa073e00640 1 -- 172.21.15.17:0/1649529823 wait complete. 2024-09-10T23:21:37.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:21:37.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 -- 172.21.15.17:0/3638241162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f540d0030 msgr2=0x7f7f540d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 --2- 172.21.15.17:0/3638241162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f540d0030 0x7f7f540d0460 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009bc0 tx=0x7f7f4c01cb70 comp rx=0 tx=0).stop 2024-09-10T23:21:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 -- 172.21.15.17:0/3638241162 shutdown_connections 2024-09-10T23:21:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 --2- 172.21.15.17:0/3638241162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f540d0030 0x7f7f540d0460 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 -- 172.21.15.17:0/3638241162 >> 172.21.15.17:0/3638241162 conn(0x7f7f5406cfc0 msgr2=0x7f7f5406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 -- 172.21.15.17:0/3638241162 shutdown_connections 2024-09-10T23:21:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 -- 172.21.15.17:0/3638241162 wait complete. 2024-09-10T23:21:37.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 Processor -- start 2024-09-10T23:21:37.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 -- start start 2024-09-10T23:21:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f540d0030 0x7f7f541470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5415e5d0 0x7f7f541f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5415ef40 0x7f7f540b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54168d50 con 0x7f7f5415ef40 2024-09-10T23:21:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54168bd0 con 0x7f7f5415e5d0 2024-09-10T23:21:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5c000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f54168ed0 con 0x7f7f540d0030 2024-09-10T23:21:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5415ef40 0x7f7f540b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f59600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f540d0030 0x7f7f541470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f58c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5415e5d0 0x7f7f541f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f59600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f540d0030 0x7f7f541470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:48004/0 (socket says 172.21.15.17:48004) 2024-09-10T23:21:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f59600640 1 -- 172.21.15.17:0/363839812 learned_addr learned my addr 172.21.15.17:0/363839812 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:37.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.840+0000 7f7f5a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5415ef40 0x7f7f540b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60458/0 (socket says 172.21.15.17:60458) 2024-09-10T23:21:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f5a000640 1 -- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f540d0030 msgr2=0x7f7f541470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f5a000640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f540d0030 0x7f7f541470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f5a000640 1 -- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5415e5d0 msgr2=0x7f7f541f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f5a000640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5415e5d0 0x7f7f541f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f5a000640 1 -- 172.21.15.17:0/363839812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f541f8730 con 0x7f7f5415ef40 2024-09-10T23:21:37.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f5a000640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5415ef40 0x7f7f540b0610 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0ac000 tx=0x7f7f4c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:37.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f51600640 1 -- 172.21.15.17:0/363839812 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0b2040 con 0x7f7f5415ef40 2024-09-10T23:21:37.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f51600640 1 -- 172.21.15.17:0/363839812 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f4c004040 con 0x7f7f5415ef40 2024-09-10T23:21:37.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5414cb70 con 0x7f7f5415ef40 2024-09-10T23:21:37.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f51600640 1 -- 172.21.15.17:0/363839812 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c004470 con 0x7f7f5415ef40 2024-09-10T23:21:37.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5414d130 con 0x7f7f5415ef40 2024-09-10T23:21:37.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f540d0460 con 0x7f7f5415ef40 2024-09-10T23:21:37.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f51600640 1 -- 172.21.15.17:0/363839812 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7f4c0b5070 con 0x7f7f5415ef40 2024-09-10T23:21:37.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f51600640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f34072610 0x7f7f34074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:37.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.844+0000 7f7f51600640 1 -- 172.21.15.17:0/363839812 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f7f4c12d400 con 0x7f7f5415ef40 2024-09-10T23:21:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.848+0000 7f7f59600640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f34072610 0x7f7f34074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.848+0000 7f7f59600640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f34072610 0x7f7f34074ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7f48007b40 tx=0x7f7f48007a90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:37.848+0000 7f7f51600640 1 -- 172.21.15.17:0/363839812 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7f4c016790 con 0x7f7f5415ef40 2024-09-10T23:21:38.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.024+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f5415af30 con 0x7f7f5415ef40 2024-09-10T23:21:38.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.024+0000 7f7f51600640 1 -- 172.21.15.17:0/363839812 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16896 (secure 0 0 0) 0x7f7f4c101060 con 0x7f7f5415ef40 2024-09-10T23:21:38.032 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:38.032 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":103,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:21:35.240722+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:21:31.384816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T23:21:32.619438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:21:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f34072610 msgr2=0x7f7f34074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f34072610 0x7f7f34074ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7f48007b40 tx=0x7f7f48007a90 comp rx=0 tx=0).stop 2024-09-10T23:21:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5415ef40 msgr2=0x7f7f540b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5415ef40 0x7f7f540b0610 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0ac000 tx=0x7f7f4c005b00 comp rx=0 tx=0).stop 2024-09-10T23:21:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 shutdown_connections 2024-09-10T23:21:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f34072610 0x7f7f34074ad0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f5415ef40 0x7f7f540b0610 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f5415e5d0 0x7f7f541f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 --2- 172.21.15.17:0/363839812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f540d0030 0x7f7f541470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 >> 172.21.15.17:0/363839812 conn(0x7f7f5406cfc0 msgr2=0x7f7f54159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 shutdown_connections 2024-09-10T23:21:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.028+0000 7f7f5c000640 1 -- 172.21.15.17:0/363839812 wait complete. 2024-09-10T23:21:38.053 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:21:38.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:21:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.192+0000 7f5c9d200640 1 -- 172.21.15.17:0/4291656645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160280 msgr2=0x7f5c980cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.192+0000 7f5c9d200640 1 --2- 172.21.15.17:0/4291656645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160280 0x7f5c980cfaf0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009900 tx=0x7f5c8801f0d0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.192+0000 7f5c9d200640 1 -- 172.21.15.17:0/4291656645 shutdown_connections 2024-09-10T23:21:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.192+0000 7f5c9d200640 1 --2- 172.21.15.17:0/4291656645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c98160660 0x7f5c980d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.192+0000 7f5c9d200640 1 --2- 172.21.15.17:0/4291656645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160280 0x7f5c980cfaf0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.192+0000 7f5c9d200640 1 -- 172.21.15.17:0/4291656645 >> 172.21.15.17:0/4291656645 conn(0x7f5c980d1d10 msgr2=0x7f5c980d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:38.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.192+0000 7f5c9d200640 1 -- 172.21.15.17:0/4291656645 shutdown_connections 2024-09-10T23:21:38.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.192+0000 7f5c9d200640 1 -- 172.21.15.17:0/4291656645 wait complete. 2024-09-10T23:21:38.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c9d200640 1 Processor -- start 2024-09-10T23:21:38.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c9d200640 1 -- start start 2024-09-10T23:21:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c9d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c980d2830 0x7f5c980c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c9d200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c98160280 0x7f5c980cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c9d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160660 0x7f5c980c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c9d200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5c980afe30 con 0x7f5c98160660 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c9d200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c980afcb0 con 0x7f5c98160280 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c9d200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5c980affb0 con 0x7f5c980d2830 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c96800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160660 0x7f5c980c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c96800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160660 0x7f5c980c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60474/0 (socket says 172.21.15.17:60474) 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c96800640 1 -- 172.21.15.17:0/3664558624 learned_addr learned my addr 172.21.15.17:0/3664558624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c95e00640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c980d2830 0x7f5c980c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c8d400640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c98160280 0x7f5c980cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c96800640 1 -- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c980d2830 msgr2=0x7f5c980c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c96800640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c980d2830 0x7f5c980c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c96800640 1 -- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c98160280 msgr2=0x7f5c980cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c96800640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c98160280 0x7f5c980cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c96800640 1 -- 172.21.15.17:0/3664558624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c981f4b80 con 0x7f5c98160660 2024-09-10T23:21:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c8d400640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c98160280 0x7f5c980cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c96800640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160660 0x7f5c980c5800 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000caa0 tx=0x7f5c9000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c8ea00640 1 -- 172.21.15.17:0/3664558624 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000adf0 con 0x7f5c98160660 2024-09-10T23:21:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c8ea00640 1 -- 172.21.15.17:0/3664558624 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c90003a70 con 0x7f5c98160660 2024-09-10T23:21:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c8ea00640 1 -- 172.21.15.17:0/3664558624 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90004030 con 0x7f5c98160660 2024-09-10T23:21:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.196+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c981f4e60 con 0x7f5c98160660 2024-09-10T23:21:38.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.200+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c981f5420 con 0x7f5c98160660 2024-09-10T23:21:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.200+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c980b04d0 con 0x7f5c98160660 2024-09-10T23:21:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.200+0000 7f5c8ea00640 1 -- 172.21.15.17:0/3664558624 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5c900041d0 con 0x7f5c98160660 2024-09-10T23:21:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.200+0000 7f5c8ea00640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c740725e0 0x7f5c74074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:38.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.200+0000 7f5c8ea00640 1 -- 172.21.15.17:0/3664558624 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f5c90093b60 con 0x7f5c98160660 2024-09-10T23:21:38.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.200+0000 7f5c95e00640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c740725e0 0x7f5c74074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:38.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.204+0000 7f5c95e00640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c740725e0 0x7f5c74074aa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5c880b2000 tx=0x7f5c8801d910 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:38.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.204+0000 7f5c8ea00640 1 -- 172.21.15.17:0/3664558624 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5c90014070 con 0x7f5c98160660 2024-09-10T23:21:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.380+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c981f5790 con 0x7f5c740725e0 2024-09-10T23:21:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c8ea00640 1 -- 172.21.15.17:0/3664558624 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252461 (secure 0 0 0) 0x7f5c981f5790 con 0x7f5c740725e0 2024-09-10T23:21:38.391 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:38.393 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:21:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c740725e0 msgr2=0x7f5c74074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c740725e0 0x7f5c74074aa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5c880b2000 tx=0x7f5c8801d910 comp rx=0 tx=0).stop 2024-09-10T23:21:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160660 msgr2=0x7f5c980c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160660 0x7f5c980c5800 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000caa0 tx=0x7f5c9000cf60 comp rx=0 tx=0).stop 2024-09-10T23:21:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 shutdown_connections 2024-09-10T23:21:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5c740725e0 0x7f5c74074aa0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c98160660 0x7f5c980c5800 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c98160280 0x7f5c980cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 --2- 172.21.15.17:0/3664558624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c980d2830 0x7f5c980c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 >> 172.21.15.17:0/3664558624 conn(0x7f5c980d1d10 msgr2=0x7f5c980b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 shutdown_connections 2024-09-10T23:21:38.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.388+0000 7f5c9d200640 1 -- 172.21.15.17:0/3664558624 wait complete. 2024-09-10T23:21:38.413 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-10T23:21:38.381337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357716,"kb_used_data":11020,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754617004,"statfs":{"total":773094113280,"available":772727812096,"internally_reserved":0,"allocated":11284480,"data_stored":5847544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001823"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.507090+0000","last_change":"2024-09-10T23:21:34.277035+0000","last_active":"2024-09-10T23:21:35.507090+0000","last_peered":"2024-09-10T23:21:35.507090+0000","last_clean":"2024-09-10T23:21:35.507090+0000","last_became_active":"2024-09-10T23:21:34.276768+0000","last_became_peered":"2024-09-10T23:21:34.276768+0000","last_unstale":"2024-09-10T23:21:35.507090+0000","last_undegraded":"2024-09-10T23:21:35.507090+0000","last_fullsized":"2024-09-10T23:21:35.507090+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:54.669147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283159+0000","last_change":"2024-09-10T23:21:34.281071+0000","last_active":"2024-09-10T23:21:34.283159+0000","last_peered":"2024-09-10T23:21:34.283159+0000","last_clean":"2024-09-10T23:21:34.283159+0000","last_became_active":"2024-09-10T23:21:34.280742+0000","last_became_peered":"2024-09-10T23:21:34.280742+0000","last_unstale":"2024-09-10T23:21:34.283159+0000","last_undegraded":"2024-09-10T23:21:34.283159+0000","last_fullsized":"2024-09-10T23:21:34.283159+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:50.229431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506572+0000","last_change":"2024-09-10T23:21:34.272757+0000","last_active":"2024-09-10T23:21:35.506572+0000","last_peered":"2024-09-10T23:21:35.506572+0000","last_clean":"2024-09-10T23:21:35.506572+0000","last_became_active":"2024-09-10T23:21:34.272464+0000","last_became_peered":"2024-09-10T23:21:34.272464+0000","last_unstale":"2024-09-10T23:21:35.506572+0000","last_undegraded":"2024-09-10T23:21:35.506572+0000","last_fullsized":"2024-09-10T23:21:35.506572+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:11.082439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.282303+0000","last_change":"2024-09-10T23:21:34.277420+0000","last_active":"2024-09-10T23:21:34.282303+0000","last_peered":"2024-09-10T23:21:34.282303+0000","last_clean":"2024-09-10T23:21:34.282303+0000","last_became_active":"2024-09-10T23:21:34.276888+0000","last_became_peered":"2024-09-10T23:21:34.276888+0000","last_unstale":"2024-09-10T23:21:34.282303+0000","last_undegraded":"2024-09-10T23:21:34.282303+0000","last_fullsized":"2024-09-10T23:21:34.282303+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:03.216372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253160+0000","last_change":"2024-09-10T23:21:34.257649+0000","last_active":"2024-09-10T23:21:35.253160+0000","last_peered":"2024-09-10T23:21:35.253160+0000","last_clean":"2024-09-10T23:21:35.253160+0000","last_became_active":"2024-09-10T23:21:34.257329+0000","last_became_peered":"2024-09-10T23:21:34.257329+0000","last_unstale":"2024-09-10T23:21:35.253160+0000","last_undegraded":"2024-09-10T23:21:35.253160+0000","last_fullsized":"2024-09-10T23:21:35.253160+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:26.226844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244720+0000","last_change":"2024-09-10T23:21:34.286670+0000","last_active":"2024-09-10T23:21:35.244720+0000","last_peered":"2024-09-10T23:21:35.244720+0000","last_clean":"2024-09-10T23:21:35.244720+0000","last_became_active":"2024-09-10T23:21:34.286368+0000","last_became_peered":"2024-09-10T23:21:34.286368+0000","last_unstale":"2024-09-10T23:21:35.244720+0000","last_undegraded":"2024-09-10T23:21:35.244720+0000","last_fullsized":"2024-09-10T23:21:35.244720+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:56.217371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283061+0000","last_change":"2024-09-10T23:21:34.282103+0000","last_active":"2024-09-10T23:21:34.283061+0000","last_peered":"2024-09-10T23:21:34.283061+0000","last_clean":"2024-09-10T23:21:34.283061+0000","last_became_active":"2024-09-10T23:21:34.281811+0000","last_became_peered":"2024-09-10T23:21:34.281811+0000","last_unstale":"2024-09-10T23:21:34.283061+0000","last_undegraded":"2024-09-10T23:21:34.283061+0000","last_fullsized":"2024-09-10T23:21:34.283061+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:28.880956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.282241+0000","last_change":"2024-09-10T23:21:34.277383+0000","last_active":"2024-09-10T23:21:34.282241+0000","last_peered":"2024-09-10T23:21:34.282241+0000","last_clean":"2024-09-10T23:21:34.282241+0000","last_became_active":"2024-09-10T23:21:34.277123+0000","last_became_peered":"2024-09-10T23:21:34.277123+0000","last_unstale":"2024-09-10T23:21:34.282241+0000","last_undegraded":"2024-09-10T23:21:34.282241+0000","last_fullsized":"2024-09-10T23:21:34.282241+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:46.246740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253653+0000","last_change":"2024-09-10T23:21:34.261586+0000","last_active":"2024-09-10T23:21:35.253653+0000","last_peered":"2024-09-10T23:21:35.253653+0000","last_clean":"2024-09-10T23:21:35.253653+0000","last_became_active":"2024-09-10T23:21:34.261101+0000","last_became_peered":"2024-09-10T23:21:34.261101+0000","last_unstale":"2024-09-10T23:21:35.253653+0000","last_undegraded":"2024-09-10T23:21:35.253653+0000","last_fullsized":"2024-09-10T23:21:35.253653+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:08.458371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.281675+0000","last_change":"2024-09-10T23:21:34.277195+0000","last_active":"2024-09-10T23:21:34.281675+0000","last_peered":"2024-09-10T23:21:34.281675+0000","last_clean":"2024-09-10T23:21:34.281675+0000","last_became_active":"2024-09-10T23:21:34.276895+0000","last_became_peered":"2024-09-10T23:21:34.276895+0000","last_unstale":"2024-09-10T23:21:34.281675+0000","last_undegraded":"2024-09-10T23:21:34.281675+0000","last_fullsized":"2024-09-10T23:21:34.281675+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:11.692551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253442+0000","last_change":"2024-09-10T23:21:34.257422+0000","last_active":"2024-09-10T23:21:35.253442+0000","last_peered":"2024-09-10T23:21:35.253442+0000","last_clean":"2024-09-10T23:21:35.253442+0000","last_became_active":"2024-09-10T23:21:34.257137+0000","last_became_peered":"2024-09-10T23:21:34.257137+0000","last_unstale":"2024-09-10T23:21:35.253442+0000","last_undegraded":"2024-09-10T23:21:35.253442+0000","last_fullsized":"2024-09-10T23:21:35.253442+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:07.951529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.275697+0000","last_change":"2024-09-10T23:21:34.269171+0000","last_active":"2024-09-10T23:21:34.275697+0000","last_peered":"2024-09-10T23:21:34.275697+0000","last_clean":"2024-09-10T23:21:34.275697+0000","last_became_active":"2024-09-10T23:21:34.267674+0000","last_became_peered":"2024-09-10T23:21:34.267674+0000","last_unstale":"2024-09-10T23:21:34.275697+0000","last_undegraded":"2024-09-10T23:21:34.275697+0000","last_fullsized":"2024-09-10T23:21:34.275697+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:42.094391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.282837+0000","last_change":"2024-09-10T23:21:34.276131+0000","last_active":"2024-09-10T23:21:34.282837+0000","last_peered":"2024-09-10T23:21:34.282837+0000","last_clean":"2024-09-10T23:21:34.282837+0000","last_became_active":"2024-09-10T23:21:34.275802+0000","last_became_peered":"2024-09-10T23:21:34.275802+0000","last_unstale":"2024-09-10T23:21:34.282837+0000","last_undegraded":"2024-09-10T23:21:34.282837+0000","last_fullsized":"2024-09-10T23:21:34.282837+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:18.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253087+0000","last_change":"2024-09-10T23:21:34.285339+0000","last_active":"2024-09-10T23:21:35.253087+0000","last_peered":"2024-09-10T23:21:35.253087+0000","last_clean":"2024-09-10T23:21:35.253087+0000","last_became_active":"2024-09-10T23:21:34.285037+0000","last_became_peered":"2024-09-10T23:21:34.285037+0000","last_unstale":"2024-09-10T23:21:35.253087+0000","last_undegraded":"2024-09-10T23:21:35.253087+0000","last_fullsized":"2024-09-10T23:21:35.253087+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:29.302796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.289647+0000","last_change":"2024-09-10T23:21:34.287355+0000","last_active":"2024-09-10T23:21:34.289647+0000","last_peered":"2024-09-10T23:21:34.289647+0000","last_clean":"2024-09-10T23:21:34.289647+0000","last_became_active":"2024-09-10T23:21:34.287055+0000","last_became_peered":"2024-09-10T23:21:34.287055+0000","last_unstale":"2024-09-10T23:21:34.289647+0000","last_undegraded":"2024-09-10T23:21:34.289647+0000","last_fullsized":"2024-09-10T23:21:34.289647+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:53.376765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244580+0000","last_change":"2024-09-10T23:21:34.266408+0000","last_active":"2024-09-10T23:21:35.244580+0000","last_peered":"2024-09-10T23:21:35.244580+0000","last_clean":"2024-09-10T23:21:35.244580+0000","last_became_active":"2024-09-10T23:21:34.266128+0000","last_became_peered":"2024-09-10T23:21:34.266128+0000","last_unstale":"2024-09-10T23:21:35.244580+0000","last_undegraded":"2024-09-10T23:21:35.244580+0000","last_fullsized":"2024-09-10T23:21:35.244580+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:42.290136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.246022+0000","last_change":"2024-09-10T23:21:34.284022+0000","last_active":"2024-09-10T23:21:35.246022+0000","last_peered":"2024-09-10T23:21:35.246022+0000","last_clean":"2024-09-10T23:21:35.246022+0000","last_became_active":"2024-09-10T23:21:34.280655+0000","last_became_peered":"2024-09-10T23:21:34.280655+0000","last_unstale":"2024-09-10T23:21:35.246022+0000","last_undegraded":"2024-09-10T23:21:35.246022+0000","last_fullsized":"2024-09-10T23:21:35.246022+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:29:20.563708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506989+0000","last_change":"2024-09-10T23:21:34.278670+0000","last_active":"2024-09-10T23:21:35.506989+0000","last_peered":"2024-09-10T23:21:35.506989+0000","last_clean":"2024-09-10T23:21:35.506989+0000","last_became_active":"2024-09-10T23:21:34.278395+0000","last_became_peered":"2024-09-10T23:21:34.278395+0000","last_unstale":"2024-09-10T23:21:35.506989+0000","last_undegraded":"2024-09-10T23:21:35.506989+0000","last_fullsized":"2024-09-10T23:21:35.506989+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:42.610090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253692+0000","last_change":"2024-09-10T23:21:34.278352+0000","last_active":"2024-09-10T23:21:35.253692+0000","last_peered":"2024-09-10T23:21:35.253692+0000","last_clean":"2024-09-10T23:21:35.253692+0000","last_became_active":"2024-09-10T23:21:34.278052+0000","last_became_peered":"2024-09-10T23:21:34.278052+0000","last_unstale":"2024-09-10T23:21:35.253692+0000","last_undegraded":"2024-09-10T23:21:35.253692+0000","last_fullsized":"2024-09-10T23:21:35.253692+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:05.317361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.289623+0000","last_change":"2024-09-10T23:21:34.286709+0000","last_active":"2024-09-10T23:21:34.289623+0000","last_peered":"2024-09-10T23:21:34.289623+0000","last_clean":"2024-09-10T23:21:34.289623+0000","last_became_active":"2024-09-10T23:21:34.286426+0000","last_became_peered":"2024-09-10T23:21:34.286426+0000","last_unstale":"2024-09-10T23:21:34.289623+0000","last_undegraded":"2024-09-10T23:21:34.289623+0000","last_fullsized":"2024-09-10T23:21:34.289623+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:16.855546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253020+0000","last_change":"2024-09-10T23:21:34.261898+0000","last_active":"2024-09-10T23:21:35.253020+0000","last_peered":"2024-09-10T23:21:35.253020+0000","last_clean":"2024-09-10T23:21:35.253020+0000","last_became_active":"2024-09-10T23:21:34.260685+0000","last_became_peered":"2024-09-10T23:21:34.260685+0000","last_unstale":"2024-09-10T23:21:35.253020+0000","last_undegraded":"2024-09-10T23:21:35.253020+0000","last_fullsized":"2024-09-10T23:21:35.253020+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:38.898955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.252917+0000","last_change":"2024-09-10T23:21:34.278348+0000","last_active":"2024-09-10T23:21:35.252917+0000","last_peered":"2024-09-10T23:21:35.252917+0000","last_clean":"2024-09-10T23:21:35.252917+0000","last_became_active":"2024-09-10T23:21:34.277973+0000","last_became_peered":"2024-09-10T23:21:34.277973+0000","last_unstale":"2024-09-10T23:21:35.252917+0000","last_undegraded":"2024-09-10T23:21:35.252917+0000","last_fullsized":"2024-09-10T23:21:35.252917+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:54.796451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509327+0000","last_change":"2024-09-10T23:21:34.282477+0000","last_active":"2024-09-10T23:21:35.509327+0000","last_peered":"2024-09-10T23:21:35.509327+0000","last_clean":"2024-09-10T23:21:35.509327+0000","last_became_active":"2024-09-10T23:21:34.282174+0000","last_became_peered":"2024-09-10T23:21:34.282174+0000","last_unstale":"2024-09-10T23:21:35.509327+0000","last_undegraded":"2024-09-10T23:21:35.509327+0000","last_fullsized":"2024-09-10T23:21:35.509327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:36.459847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506018+0000","last_change":"2024-09-10T23:21:34.271013+0000","last_active":"2024-09-10T23:21:35.506018+0000","last_peered":"2024-09-10T23:21:35.506018+0000","last_clean":"2024-09-10T23:21:35.506018+0000","last_became_active":"2024-09-10T23:21:34.270742+0000","last_became_peered":"2024-09-10T23:21:34.270742+0000","last_unstale":"2024-09-10T23:21:35.506018+0000","last_undegraded":"2024-09-10T23:21:35.506018+0000","last_fullsized":"2024-09-10T23:21:35.506018+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:03.274111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.265258+0000","last_change":"2024-09-10T23:21:34.261677+0000","last_active":"2024-09-10T23:21:34.265258+0000","last_peered":"2024-09-10T23:21:34.265258+0000","last_clean":"2024-09-10T23:21:34.265258+0000","last_became_active":"2024-09-10T23:21:34.261406+0000","last_became_peered":"2024-09-10T23:21:34.261406+0000","last_unstale":"2024-09-10T23:21:34.265258+0000","last_undegraded":"2024-09-10T23:21:34.265258+0000","last_fullsized":"2024-09-10T23:21:34.265258+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:20.966101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253182+0000","last_change":"2024-09-10T23:21:34.269085+0000","last_active":"2024-09-10T23:21:35.253182+0000","last_peered":"2024-09-10T23:21:35.253182+0000","last_clean":"2024-09-10T23:21:35.253182+0000","last_became_active":"2024-09-10T23:21:34.268798+0000","last_became_peered":"2024-09-10T23:21:34.268798+0000","last_unstale":"2024-09-10T23:21:35.253182+0000","last_undegraded":"2024-09-10T23:21:35.253182+0000","last_fullsized":"2024-09-10T23:21:35.253182+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:01.017631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.263248+0000","last_change":"2024-09-10T23:21:34.260554+0000","last_active":"2024-09-10T23:21:34.263248+0000","last_peered":"2024-09-10T23:21:34.263248+0000","last_clean":"2024-09-10T23:21:34.263248+0000","last_became_active":"2024-09-10T23:21:34.260309+0000","last_became_peered":"2024-09-10T23:21:34.260309+0000","last_unstale":"2024-09-10T23:21:34.263248+0000","last_undegraded":"2024-09-10T23:21:34.263248+0000","last_fullsized":"2024-09-10T23:21:34.263248+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:16.883362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.282158+0000","last_change":"2024-09-10T23:21:34.277135+0000","last_active":"2024-09-10T23:21:34.282158+0000","last_peered":"2024-09-10T23:21:34.282158+0000","last_clean":"2024-09-10T23:21:34.282158+0000","last_became_active":"2024-09-10T23:21:34.276503+0000","last_became_peered":"2024-09-10T23:21:34.276503+0000","last_unstale":"2024-09-10T23:21:34.282158+0000","last_undegraded":"2024-09-10T23:21:34.282158+0000","last_fullsized":"2024-09-10T23:21:34.282158+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:15.616590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.264381+0000","last_change":"2024-09-10T23:21:34.263130+0000","last_active":"2024-09-10T23:21:34.264381+0000","last_peered":"2024-09-10T23:21:34.264381+0000","last_clean":"2024-09-10T23:21:34.264381+0000","last_became_active":"2024-09-10T23:21:34.262867+0000","last_became_peered":"2024-09-10T23:21:34.262867+0000","last_unstale":"2024-09-10T23:21:34.264381+0000","last_undegraded":"2024-09-10T23:21:34.264381+0000","last_fullsized":"2024-09-10T23:21:34.264381+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:46.317753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253327+0000","last_change":"2024-09-10T23:21:34.262572+0000","last_active":"2024-09-10T23:21:35.253327+0000","last_peered":"2024-09-10T23:21:35.253327+0000","last_clean":"2024-09-10T23:21:35.253327+0000","last_became_active":"2024-09-10T23:21:34.262292+0000","last_became_peered":"2024-09-10T23:21:34.262292+0000","last_unstale":"2024-09-10T23:21:35.253327+0000","last_undegraded":"2024-09-10T23:21:35.253327+0000","last_fullsized":"2024-09-10T23:21:35.253327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:50.179517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283809+0000","last_change":"2024-09-10T23:21:34.282812+0000","last_active":"2024-09-10T23:21:34.283809+0000","last_peered":"2024-09-10T23:21:34.283809+0000","last_clean":"2024-09-10T23:21:34.283809+0000","last_became_active":"2024-09-10T23:21:34.282549+0000","last_became_peered":"2024-09-10T23:21:34.282549+0000","last_unstale":"2024-09-10T23:21:34.283809+0000","last_undegraded":"2024-09-10T23:21:34.283809+0000","last_fullsized":"2024-09-10T23:21:34.283809+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:31.725156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244633+0000","last_change":"2024-09-10T23:21:34.267436+0000","last_active":"2024-09-10T23:21:35.244633+0000","last_peered":"2024-09-10T23:21:35.244633+0000","last_clean":"2024-09-10T23:21:35.244633+0000","last_became_active":"2024-09-10T23:21:34.265982+0000","last_became_peered":"2024-09-10T23:21:34.265982+0000","last_unstale":"2024-09-10T23:21:35.244633+0000","last_undegraded":"2024-09-10T23:21:35.244633+0000","last_fullsized":"2024-09-10T23:21:35.244633+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:13.123092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245589+0000","last_change":"2024-09-10T23:21:34.251787+0000","last_active":"2024-09-10T23:21:35.245589+0000","last_peered":"2024-09-10T23:21:35.245589+0000","last_clean":"2024-09-10T23:21:35.245589+0000","last_became_active":"2024-09-10T23:21:34.249563+0000","last_became_peered":"2024-09-10T23:21:34.249563+0000","last_unstale":"2024-09-10T23:21:35.245589+0000","last_undegraded":"2024-09-10T23:21:35.245589+0000","last_fullsized":"2024-09-10T23:21:35.245589+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:48.044512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"102'4","reported_seq":19,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509476+0000","last_change":"2024-09-10T23:21:33.266205+0000","last_active":"2024-09-10T23:21:35.509476+0000","last_peered":"2024-09-10T23:21:35.509476+0000","last_clean":"2024-09-10T23:21:35.509476+0000","last_became_active":"2024-09-10T23:21:33.265883+0000","last_became_peered":"2024-09-10T23:21:33.265883+0000","last_unstale":"2024-09-10T23:21:35.509476+0000","last_undegraded":"2024-09-10T23:21:35.509476+0000","last_fullsized":"2024-09-10T23:21:35.509476+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:41.232368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245787+0000","last_change":"2024-09-10T23:21:34.258385+0000","last_active":"2024-09-10T23:21:35.245787+0000","last_peered":"2024-09-10T23:21:35.245787+0000","last_clean":"2024-09-10T23:21:35.245787+0000","last_became_active":"2024-09-10T23:21:34.258033+0000","last_became_peered":"2024-09-10T23:21:34.258033+0000","last_unstale":"2024-09-10T23:21:35.245787+0000","last_undegraded":"2024-09-10T23:21:35.245787+0000","last_fullsized":"2024-09-10T23:21:35.245787+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:04.168750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253467+0000","last_change":"2024-09-10T23:21:33.258344+0000","last_active":"2024-09-10T23:21:35.253467+0000","last_peered":"2024-09-10T23:21:35.253467+0000","last_clean":"2024-09-10T23:21:35.253467+0000","last_became_active":"2024-09-10T23:21:33.257858+0000","last_became_peered":"2024-09-10T23:21:33.257858+0000","last_unstale":"2024-09-10T23:21:35.253467+0000","last_undegraded":"2024-09-10T23:21:35.253467+0000","last_fullsized":"2024-09-10T23:21:35.253467+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:22.656274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.281461+0000","last_change":"2024-09-10T23:21:34.280178+0000","last_active":"2024-09-10T23:21:34.281461+0000","last_peered":"2024-09-10T23:21:34.281461+0000","last_clean":"2024-09-10T23:21:34.281461+0000","last_became_active":"2024-09-10T23:21:34.279844+0000","last_became_peered":"2024-09-10T23:21:34.279844+0000","last_unstale":"2024-09-10T23:21:34.281461+0000","last_undegraded":"2024-09-10T23:21:34.281461+0000","last_fullsized":"2024-09-10T23:21:34.281461+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:24.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.278972+0000","last_change":"2024-09-10T23:21:33.263757+0000","last_active":"2024-09-10T23:21:34.278972+0000","last_peered":"2024-09-10T23:21:34.278972+0000","last_clean":"2024-09-10T23:21:34.278972+0000","last_became_active":"2024-09-10T23:21:33.263035+0000","last_became_peered":"2024-09-10T23:21:33.263035+0000","last_unstale":"2024-09-10T23:21:34.278972+0000","last_undegraded":"2024-09-10T23:21:34.278972+0000","last_fullsized":"2024-09-10T23:21:34.278972+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:33.254883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.246120+0000","last_change":"2024-09-10T23:21:34.260747+0000","last_active":"2024-09-10T23:21:35.246120+0000","last_peered":"2024-09-10T23:21:35.246120+0000","last_clean":"2024-09-10T23:21:35.246120+0000","last_became_active":"2024-09-10T23:21:34.259606+0000","last_became_peered":"2024-09-10T23:21:34.259606+0000","last_unstale":"2024-09-10T23:21:35.246120+0000","last_undegraded":"2024-09-10T23:21:35.246120+0000","last_fullsized":"2024-09-10T23:21:35.246120+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:33.577339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"102'2","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.510167+0000","last_change":"2024-09-10T23:21:33.263068+0000","last_active":"2024-09-10T23:21:35.510167+0000","last_peered":"2024-09-10T23:21:35.510167+0000","last_clean":"2024-09-10T23:21:35.510167+0000","last_became_active":"2024-09-10T23:21:33.261952+0000","last_became_peered":"2024-09-10T23:21:33.261952+0000","last_unstale":"2024-09-10T23:21:35.510167+0000","last_undegraded":"2024-09-10T23:21:35.510167+0000","last_fullsized":"2024-09-10T23:21:35.510167+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:13.385909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283626+0000","last_change":"2024-09-10T23:21:34.278791+0000","last_active":"2024-09-10T23:21:34.283626+0000","last_peered":"2024-09-10T23:21:34.283626+0000","last_clean":"2024-09-10T23:21:34.283626+0000","last_became_active":"2024-09-10T23:21:34.278519+0000","last_became_peered":"2024-09-10T23:21:34.278519+0000","last_unstale":"2024-09-10T23:21:34.283626+0000","last_undegraded":"2024-09-10T23:21:34.283626+0000","last_fullsized":"2024-09-10T23:21:34.283626+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:56.498953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253312+0000","last_change":"2024-09-10T23:21:33.263991+0000","last_active":"2024-09-10T23:21:35.253312+0000","last_peered":"2024-09-10T23:21:35.253312+0000","last_clean":"2024-09-10T23:21:35.253312+0000","last_became_active":"2024-09-10T23:21:33.263484+0000","last_became_peered":"2024-09-10T23:21:33.263484+0000","last_unstale":"2024-09-10T23:21:35.253312+0000","last_undegraded":"2024-09-10T23:21:35.253312+0000","last_fullsized":"2024-09-10T23:21:35.253312+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:58.487513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509522+0000","last_change":"2024-09-10T23:21:34.259207+0000","last_active":"2024-09-10T23:21:35.509522+0000","last_peered":"2024-09-10T23:21:35.509522+0000","last_clean":"2024-09-10T23:21:35.509522+0000","last_became_active":"2024-09-10T23:21:34.258793+0000","last_became_peered":"2024-09-10T23:21:34.258793+0000","last_unstale":"2024-09-10T23:21:35.509522+0000","last_undegraded":"2024-09-10T23:21:35.509522+0000","last_fullsized":"2024-09-10T23:21:35.509522+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:52.083436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"102'1","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.286057+0000","last_change":"2024-09-10T23:21:33.265801+0000","last_active":"2024-09-10T23:21:34.286057+0000","last_peered":"2024-09-10T23:21:34.286057+0000","last_clean":"2024-09-10T23:21:34.286057+0000","last_became_active":"2024-09-10T23:21:33.265516+0000","last_became_peered":"2024-09-10T23:21:33.265516+0000","last_unstale":"2024-09-10T23:21:34.286057+0000","last_undegraded":"2024-09-10T23:21:34.286057+0000","last_fullsized":"2024-09-10T23:21:34.286057+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:44.101811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244990+0000","last_change":"2024-09-10T23:21:34.278832+0000","last_active":"2024-09-10T23:21:35.244990+0000","last_peered":"2024-09-10T23:21:35.244990+0000","last_clean":"2024-09-10T23:21:35.244990+0000","last_became_active":"2024-09-10T23:21:34.278516+0000","last_became_peered":"2024-09-10T23:21:34.278516+0000","last_unstale":"2024-09-10T23:21:35.244990+0000","last_undegraded":"2024-09-10T23:21:35.244990+0000","last_fullsized":"2024-09-10T23:21:35.244990+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:51.377788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506521+0000","last_change":"2024-09-10T23:21:33.246332+0000","last_active":"2024-09-10T23:21:35.506521+0000","last_peered":"2024-09-10T23:21:35.506521+0000","last_clean":"2024-09-10T23:21:35.506521+0000","last_became_active":"2024-09-10T23:21:33.246067+0000","last_became_peered":"2024-09-10T23:21:33.246067+0000","last_unstale":"2024-09-10T23:21:35.506521+0000","last_undegraded":"2024-09-10T23:21:35.506521+0000","last_fullsized":"2024-09-10T23:21:35.506521+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:00.299238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.276007+0000","last_change":"2024-09-10T23:21:34.270603+0000","last_active":"2024-09-10T23:21:34.276007+0000","last_peered":"2024-09-10T23:21:34.276007+0000","last_clean":"2024-09-10T23:21:34.276007+0000","last_became_active":"2024-09-10T23:21:34.270336+0000","last_became_peered":"2024-09-10T23:21:34.270336+0000","last_unstale":"2024-09-10T23:21:34.276007+0000","last_undegraded":"2024-09-10T23:21:34.276007+0000","last_fullsized":"2024-09-10T23:21:34.276007+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:29:29.294338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.255013+0000","last_change":"2024-09-10T23:21:33.262412+0000","last_active":"2024-09-10T23:21:34.255013+0000","last_peered":"2024-09-10T23:21:34.255013+0000","last_clean":"2024-09-10T23:21:34.255013+0000","last_became_active":"2024-09-10T23:21:33.262144+0000","last_became_peered":"2024-09-10T23:21:33.262144+0000","last_unstale":"2024-09-10T23:21:34.255013+0000","last_undegraded":"2024-09-10T23:21:34.255013+0000","last_fullsized":"2024-09-10T23:21:34.255013+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:30.721707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253630+0000","last_change":"2024-09-10T23:21:34.270781+0000","last_active":"2024-09-10T23:21:35.253630+0000","last_peered":"2024-09-10T23:21:35.253630+0000","last_clean":"2024-09-10T23:21:35.253630+0000","last_became_active":"2024-09-10T23:21:34.270458+0000","last_became_peered":"2024-09-10T23:21:34.270458+0000","last_unstale":"2024-09-10T23:21:35.253630+0000","last_undegraded":"2024-09-10T23:21:35.253630+0000","last_fullsized":"2024-09-10T23:21:35.253630+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:20.765002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.253578+0000","last_change":"2024-09-10T23:21:33.261211+0000","last_active":"2024-09-10T23:21:34.253578+0000","last_peered":"2024-09-10T23:21:34.253578+0000","last_clean":"2024-09-10T23:21:34.253578+0000","last_became_active":"2024-09-10T23:21:33.260899+0000","last_became_peered":"2024-09-10T23:21:33.260899+0000","last_unstale":"2024-09-10T23:21:34.253578+0000","last_undegraded":"2024-09-10T23:21:34.253578+0000","last_fullsized":"2024-09-10T23:21:34.253578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:44.805946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.274222+0000","last_change":"2024-09-10T23:21:34.273250+0000","last_active":"2024-09-10T23:21:34.274222+0000","last_peered":"2024-09-10T23:21:34.274222+0000","last_clean":"2024-09-10T23:21:34.274222+0000","last_became_active":"2024-09-10T23:21:34.272491+0000","last_became_peered":"2024-09-10T23:21:34.272491+0000","last_unstale":"2024-09-10T23:21:34.274222+0000","last_undegraded":"2024-09-10T23:21:34.274222+0000","last_fullsized":"2024-09-10T23:21:34.274222+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:52.826987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.507339+0000","last_change":"2024-09-10T23:21:33.260264+0000","last_active":"2024-09-10T23:21:35.507339+0000","last_peered":"2024-09-10T23:21:35.507339+0000","last_clean":"2024-09-10T23:21:35.507339+0000","last_became_active":"2024-09-10T23:21:33.259963+0000","last_became_peered":"2024-09-10T23:21:33.259963+0000","last_unstale":"2024-09-10T23:21:35.507339+0000","last_undegraded":"2024-09-10T23:21:35.507339+0000","last_fullsized":"2024-09-10T23:21:35.507339+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:31.970023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.507199+0000","last_change":"2024-09-10T23:21:34.274358+0000","last_active":"2024-09-10T23:21:35.507199+0000","last_peered":"2024-09-10T23:21:35.507199+0000","last_clean":"2024-09-10T23:21:35.507199+0000","last_became_active":"2024-09-10T23:21:34.274101+0000","last_became_peered":"2024-09-10T23:21:34.274101+0000","last_unstale":"2024-09-10T23:21:35.507199+0000","last_undegraded":"2024-09-10T23:21:35.507199+0000","last_fullsized":"2024-09-10T23:21:35.507199+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:46.641458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"102'3","reported_seq":18,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253759+0000","last_change":"2024-09-10T23:21:33.270505+0000","last_active":"2024-09-10T23:21:35.253759+0000","last_peered":"2024-09-10T23:21:35.253759+0000","last_clean":"2024-09-10T23:21:35.253759+0000","last_became_active":"2024-09-10T23:21:33.270224+0000","last_became_peered":"2024-09-10T23:21:33.270224+0000","last_unstale":"2024-09-10T23:21:35.253759+0000","last_undegraded":"2024-09-10T23:21:35.253759+0000","last_fullsized":"2024-09-10T23:21:35.253759+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:12.791409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.275758+0000","last_change":"2024-09-10T23:21:34.272068+0000","last_active":"2024-09-10T23:21:34.275758+0000","last_peered":"2024-09-10T23:21:34.275758+0000","last_clean":"2024-09-10T23:21:34.275758+0000","last_became_active":"2024-09-10T23:21:34.271742+0000","last_became_peered":"2024-09-10T23:21:34.271742+0000","last_unstale":"2024-09-10T23:21:34.275758+0000","last_undegraded":"2024-09-10T23:21:34.275758+0000","last_fullsized":"2024-09-10T23:21:34.275758+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:08.805287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"102'6","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245633+0000","last_change":"2024-09-10T23:21:33.266246+0000","last_active":"2024-09-10T23:21:35.245633+0000","last_peered":"2024-09-10T23:21:35.245633+0000","last_clean":"2024-09-10T23:21:35.245633+0000","last_became_active":"2024-09-10T23:21:33.265861+0000","last_became_peered":"2024-09-10T23:21:33.265861+0000","last_unstale":"2024-09-10T23:21:35.245633+0000","last_undegraded":"2024-09-10T23:21:35.245633+0000","last_fullsized":"2024-09-10T23:21:35.245633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:51.823539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.276943+0000","last_change":"2024-09-10T23:21:34.265983+0000","last_active":"2024-09-10T23:21:34.276943+0000","last_peered":"2024-09-10T23:21:34.276943+0000","last_clean":"2024-09-10T23:21:34.276943+0000","last_became_active":"2024-09-10T23:21:34.265623+0000","last_became_peered":"2024-09-10T23:21:34.265623+0000","last_unstale":"2024-09-10T23:21:34.276943+0000","last_undegraded":"2024-09-10T23:21:34.276943+0000","last_fullsized":"2024-09-10T23:21:34.276943+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:13.794857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.276292+0000","last_change":"2024-09-10T23:21:33.270280+0000","last_active":"2024-09-10T23:21:34.276292+0000","last_peered":"2024-09-10T23:21:34.276292+0000","last_clean":"2024-09-10T23:21:34.276292+0000","last_became_active":"2024-09-10T23:21:33.269989+0000","last_became_peered":"2024-09-10T23:21:33.269989+0000","last_unstale":"2024-09-10T23:21:34.276292+0000","last_undegraded":"2024-09-10T23:21:34.276292+0000","last_fullsized":"2024-09-10T23:21:34.276292+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:55.857149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.252861+0000","last_change":"2024-09-10T23:21:34.266290+0000","last_active":"2024-09-10T23:21:35.252861+0000","last_peered":"2024-09-10T23:21:35.252861+0000","last_clean":"2024-09-10T23:21:35.252861+0000","last_became_active":"2024-09-10T23:21:34.262629+0000","last_became_peered":"2024-09-10T23:21:34.262629+0000","last_unstale":"2024-09-10T23:21:35.252861+0000","last_undegraded":"2024-09-10T23:21:35.252861+0000","last_fullsized":"2024-09-10T23:21:35.252861+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:52.083436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245136+0000","last_change":"2024-09-10T23:21:33.266362+0000","last_active":"2024-09-10T23:21:35.245136+0000","last_peered":"2024-09-10T23:21:35.245136+0000","last_clean":"2024-09-10T23:21:35.245136+0000","last_became_active":"2024-09-10T23:21:33.266100+0000","last_became_peered":"2024-09-10T23:21:33.266100+0000","last_unstale":"2024-09-10T23:21:35.245136+0000","last_undegraded":"2024-09-10T23:21:35.245136+0000","last_fullsized":"2024-09-10T23:21:35.245136+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:23.386920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.289327+0000","last_change":"2024-09-10T23:21:34.287142+0000","last_active":"2024-09-10T23:21:34.289327+0000","last_peered":"2024-09-10T23:21:34.289327+0000","last_clean":"2024-09-10T23:21:34.289327+0000","last_became_active":"2024-09-10T23:21:34.285912+0000","last_became_peered":"2024-09-10T23:21:34.285912+0000","last_unstale":"2024-09-10T23:21:34.289327+0000","last_undegraded":"2024-09-10T23:21:34.289327+0000","last_fullsized":"2024-09-10T23:21:34.289327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:16.607504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.275980+0000","last_change":"2024-09-10T23:21:33.255868+0000","last_active":"2024-09-10T23:21:34.275980+0000","last_peered":"2024-09-10T23:21:34.275980+0000","last_clean":"2024-09-10T23:21:34.275980+0000","last_became_active":"2024-09-10T23:21:33.255576+0000","last_became_peered":"2024-09-10T23:21:33.255576+0000","last_unstale":"2024-09-10T23:21:34.275980+0000","last_undegraded":"2024-09-10T23:21:34.275980+0000","last_fullsized":"2024-09-10T23:21:34.275980+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:38.616894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.258897+0000","last_change":"2024-09-10T23:21:34.255531+0000","last_active":"2024-09-10T23:21:34.258897+0000","last_peered":"2024-09-10T23:21:34.258897+0000","last_clean":"2024-09-10T23:21:34.258897+0000","last_became_active":"2024-09-10T23:21:34.255178+0000","last_became_peered":"2024-09-10T23:21:34.255178+0000","last_unstale":"2024-09-10T23:21:34.258897+0000","last_undegraded":"2024-09-10T23:21:34.258897+0000","last_fullsized":"2024-09-10T23:21:34.258897+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:21.302161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"102'8","reported_seq":21,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.289823+0000","last_change":"2024-09-10T23:21:33.268057+0000","last_active":"2024-09-10T23:21:34.289823+0000","last_peered":"2024-09-10T23:21:34.289823+0000","last_clean":"2024-09-10T23:21:34.289823+0000","last_became_active":"2024-09-10T23:21:33.267696+0000","last_became_peered":"2024-09-10T23:21:33.267696+0000","last_unstale":"2024-09-10T23:21:34.289823+0000","last_undegraded":"2024-09-10T23:21:34.289823+0000","last_fullsized":"2024-09-10T23:21:34.289823+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:41.339693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245566+0000","last_change":"2024-09-10T23:21:34.249910+0000","last_active":"2024-09-10T23:21:35.245566+0000","last_peered":"2024-09-10T23:21:35.245566+0000","last_clean":"2024-09-10T23:21:35.245566+0000","last_became_active":"2024-09-10T23:21:34.249433+0000","last_became_peered":"2024-09-10T23:21:34.249433+0000","last_unstale":"2024-09-10T23:21:35.245566+0000","last_undegraded":"2024-09-10T23:21:35.245566+0000","last_fullsized":"2024-09-10T23:21:35.245566+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:26.311810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509645+0000","last_change":"2024-09-10T23:21:33.261203+0000","last_active":"2024-09-10T23:21:35.509645+0000","last_peered":"2024-09-10T23:21:35.509645+0000","last_clean":"2024-09-10T23:21:35.509645+0000","last_became_active":"2024-09-10T23:21:33.260947+0000","last_became_peered":"2024-09-10T23:21:33.260947+0000","last_unstale":"2024-09-10T23:21:35.509645+0000","last_undegraded":"2024-09-10T23:21:35.509645+0000","last_fullsized":"2024-09-10T23:21:35.509645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:07.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.510319+0000","last_change":"2024-09-10T23:21:34.261277+0000","last_active":"2024-09-10T23:21:35.510319+0000","last_peered":"2024-09-10T23:21:35.510319+0000","last_clean":"2024-09-10T23:21:35.510319+0000","last_became_active":"2024-09-10T23:21:34.261014+0000","last_became_peered":"2024-09-10T23:21:34.261014+0000","last_unstale":"2024-09-10T23:21:35.510319+0000","last_undegraded":"2024-09-10T23:21:35.510319+0000","last_fullsized":"2024-09-10T23:21:35.510319+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:38.898955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.272347+0000","last_change":"2024-09-10T23:21:33.261566+0000","last_active":"2024-09-10T23:21:34.272347+0000","last_peered":"2024-09-10T23:21:34.272347+0000","last_clean":"2024-09-10T23:21:34.272347+0000","last_became_active":"2024-09-10T23:21:33.261275+0000","last_became_peered":"2024-09-10T23:21:33.261275+0000","last_unstale":"2024-09-10T23:21:34.272347+0000","last_undegraded":"2024-09-10T23:21:34.272347+0000","last_fullsized":"2024-09-10T23:21:34.272347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:25.287249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253466+0000","last_change":"2024-09-10T23:21:34.258340+0000","last_active":"2024-09-10T23:21:35.253466+0000","last_peered":"2024-09-10T23:21:35.253466+0000","last_clean":"2024-09-10T23:21:35.253466+0000","last_became_active":"2024-09-10T23:21:34.257642+0000","last_became_peered":"2024-09-10T23:21:34.257642+0000","last_unstale":"2024-09-10T23:21:35.253466+0000","last_undegraded":"2024-09-10T23:21:35.253466+0000","last_fullsized":"2024-09-10T23:21:35.253466+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:20.245247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253785+0000","last_change":"2024-09-10T23:21:33.261503+0000","last_active":"2024-09-10T23:21:35.253785+0000","last_peered":"2024-09-10T23:21:35.253785+0000","last_clean":"2024-09-10T23:21:35.253785+0000","last_became_active":"2024-09-10T23:21:33.261240+0000","last_became_peered":"2024-09-10T23:21:33.261240+0000","last_unstale":"2024-09-10T23:21:35.253785+0000","last_undegraded":"2024-09-10T23:21:35.253785+0000","last_fullsized":"2024-09-10T23:21:35.253785+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:29:28.290890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244752+0000","last_change":"2024-09-10T23:21:34.286635+0000","last_active":"2024-09-10T23:21:35.244752+0000","last_peered":"2024-09-10T23:21:35.244752+0000","last_clean":"2024-09-10T23:21:35.244752+0000","last_became_active":"2024-09-10T23:21:34.286341+0000","last_became_peered":"2024-09-10T23:21:34.286341+0000","last_unstale":"2024-09-10T23:21:35.244752+0000","last_undegraded":"2024-09-10T23:21:35.244752+0000","last_fullsized":"2024-09-10T23:21:35.244752+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:10.593643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.280770+0000","last_change":"2024-09-10T23:21:33.266293+0000","last_active":"2024-09-10T23:21:34.280770+0000","last_peered":"2024-09-10T23:21:34.280770+0000","last_clean":"2024-09-10T23:21:34.280770+0000","last_became_active":"2024-09-10T23:21:33.264833+0000","last_became_peered":"2024-09-10T23:21:33.264833+0000","last_unstale":"2024-09-10T23:21:34.280770+0000","last_undegraded":"2024-09-10T23:21:34.280770+0000","last_fullsized":"2024-09-10T23:21:34.280770+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:47.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283195+0000","last_change":"2024-09-10T23:21:34.281114+0000","last_active":"2024-09-10T23:21:34.283195+0000","last_peered":"2024-09-10T23:21:34.283195+0000","last_clean":"2024-09-10T23:21:34.283195+0000","last_became_active":"2024-09-10T23:21:34.280824+0000","last_became_peered":"2024-09-10T23:21:34.280824+0000","last_unstale":"2024-09-10T23:21:34.283195+0000","last_undegraded":"2024-09-10T23:21:34.283195+0000","last_fullsized":"2024-09-10T23:21:34.283195+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:55.449397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.252390+0000","last_change":"2024-09-10T23:21:33.259401+0000","last_active":"2024-09-10T23:21:34.252390+0000","last_peered":"2024-09-10T23:21:34.252390+0000","last_clean":"2024-09-10T23:21:34.252390+0000","last_became_active":"2024-09-10T23:21:33.259155+0000","last_became_peered":"2024-09-10T23:21:33.259155+0000","last_unstale":"2024-09-10T23:21:34.252390+0000","last_undegraded":"2024-09-10T23:21:34.252390+0000","last_fullsized":"2024-09-10T23:21:34.252390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:22.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.285628+0000","last_change":"2024-09-10T23:21:34.283672+0000","last_active":"2024-09-10T23:21:34.285628+0000","last_peered":"2024-09-10T23:21:34.285628+0000","last_clean":"2024-09-10T23:21:34.285628+0000","last_became_active":"2024-09-10T23:21:34.283407+0000","last_became_peered":"2024-09-10T23:21:34.283407+0000","last_unstale":"2024-09-10T23:21:34.285628+0000","last_undegraded":"2024-09-10T23:21:34.285628+0000","last_fullsized":"2024-09-10T23:21:34.285628+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:48.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.252563+0000","last_change":"2024-09-10T23:21:33.271627+0000","last_active":"2024-09-10T23:21:34.252563+0000","last_peered":"2024-09-10T23:21:34.252563+0000","last_clean":"2024-09-10T23:21:34.252563+0000","last_became_active":"2024-09-10T23:21:33.271333+0000","last_became_peered":"2024-09-10T23:21:33.271333+0000","last_unstale":"2024-09-10T23:21:34.252563+0000","last_undegraded":"2024-09-10T23:21:34.252563+0000","last_fullsized":"2024-09-10T23:21:34.252563+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:40.172440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245260+0000","last_change":"2024-09-10T23:21:34.259501+0000","last_active":"2024-09-10T23:21:35.245260+0000","last_peered":"2024-09-10T23:21:35.245260+0000","last_clean":"2024-09-10T23:21:35.245260+0000","last_became_active":"2024-09-10T23:21:34.259234+0000","last_became_peered":"2024-09-10T23:21:34.259234+0000","last_unstale":"2024-09-10T23:21:35.245260+0000","last_undegraded":"2024-09-10T23:21:35.245260+0000","last_fullsized":"2024-09-10T23:21:35.245260+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:03.692821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.252804+0000","last_change":"2024-09-10T23:21:33.256559+0000","last_active":"2024-09-10T23:21:34.252804+0000","last_peered":"2024-09-10T23:21:34.252804+0000","last_clean":"2024-09-10T23:21:34.252804+0000","last_became_active":"2024-09-10T23:21:33.256063+0000","last_became_peered":"2024-09-10T23:21:33.256063+0000","last_unstale":"2024-09-10T23:21:34.252804+0000","last_undegraded":"2024-09-10T23:21:34.252804+0000","last_fullsized":"2024-09-10T23:21:34.252804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:28.414329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.510064+0000","last_change":"2024-09-10T23:21:34.261005+0000","last_active":"2024-09-10T23:21:35.510064+0000","last_peered":"2024-09-10T23:21:35.510064+0000","last_clean":"2024-09-10T23:21:35.510064+0000","last_became_active":"2024-09-10T23:21:34.260730+0000","last_became_peered":"2024-09-10T23:21:34.260730+0000","last_unstale":"2024-09-10T23:21:35.510064+0000","last_undegraded":"2024-09-10T23:21:35.510064+0000","last_fullsized":"2024-09-10T23:21:35.510064+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:54.796451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.274609+0000","last_change":"2024-09-10T23:21:33.257985+0000","last_active":"2024-09-10T23:21:34.274609+0000","last_peered":"2024-09-10T23:21:34.274609+0000","last_clean":"2024-09-10T23:21:34.274609+0000","last_became_active":"2024-09-10T23:21:33.257645+0000","last_became_peered":"2024-09-10T23:21:33.257645+0000","last_unstale":"2024-09-10T23:21:34.274609+0000","last_undegraded":"2024-09-10T23:21:34.274609+0000","last_fullsized":"2024-09-10T23:21:34.274609+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:40.839492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245687+0000","last_change":"2024-09-10T23:21:34.250450+0000","last_active":"2024-09-10T23:21:35.245687+0000","last_peered":"2024-09-10T23:21:35.245687+0000","last_clean":"2024-09-10T23:21:35.245687+0000","last_became_active":"2024-09-10T23:21:34.250142+0000","last_became_peered":"2024-09-10T23:21:34.250142+0000","last_unstale":"2024-09-10T23:21:35.245687+0000","last_undegraded":"2024-09-10T23:21:35.245687+0000","last_fullsized":"2024-09-10T23:21:35.245687+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:21.533536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253583+0000","last_change":"2024-09-10T23:21:33.260352+0000","last_active":"2024-09-10T23:21:35.253583+0000","last_peered":"2024-09-10T23:21:35.253583+0000","last_clean":"2024-09-10T23:21:35.253583+0000","last_became_active":"2024-09-10T23:21:33.259923+0000","last_became_peered":"2024-09-10T23:21:33.259923+0000","last_unstale":"2024-09-10T23:21:35.253583+0000","last_undegraded":"2024-09-10T23:21:35.253583+0000","last_fullsized":"2024-09-10T23:21:35.253583+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:30.869717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245952+0000","last_change":"2024-09-10T23:21:34.257048+0000","last_active":"2024-09-10T23:21:35.245952+0000","last_peered":"2024-09-10T23:21:35.245952+0000","last_clean":"2024-09-10T23:21:35.245952+0000","last_became_active":"2024-09-10T23:21:34.256763+0000","last_became_peered":"2024-09-10T23:21:34.256763+0000","last_unstale":"2024-09-10T23:21:35.245952+0000","last_undegraded":"2024-09-10T23:21:35.245952+0000","last_fullsized":"2024-09-10T23:21:35.245952+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:36.234595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253830+0000","last_change":"2024-09-10T23:21:33.270472+0000","last_active":"2024-09-10T23:21:35.253830+0000","last_peered":"2024-09-10T23:21:35.253830+0000","last_clean":"2024-09-10T23:21:35.253830+0000","last_became_active":"2024-09-10T23:21:33.270105+0000","last_became_peered":"2024-09-10T23:21:33.270105+0000","last_unstale":"2024-09-10T23:21:35.253830+0000","last_undegraded":"2024-09-10T23:21:35.253830+0000","last_fullsized":"2024-09-10T23:21:35.253830+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:07.801838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.260425+0000","last_change":"2024-09-10T23:21:34.258801+0000","last_active":"2024-09-10T23:21:34.260425+0000","last_peered":"2024-09-10T23:21:34.260425+0000","last_clean":"2024-09-10T23:21:34.260425+0000","last_became_active":"2024-09-10T23:21:34.258413+0000","last_became_peered":"2024-09-10T23:21:34.258413+0000","last_unstale":"2024-09-10T23:21:34.260425+0000","last_undegraded":"2024-09-10T23:21:34.260425+0000","last_fullsized":"2024-09-10T23:21:34.260425+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:32.563939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.510168+0000","last_change":"2024-09-10T23:21:33.263766+0000","last_active":"2024-09-10T23:21:35.510168+0000","last_peered":"2024-09-10T23:21:35.510168+0000","last_clean":"2024-09-10T23:21:35.510168+0000","last_became_active":"2024-09-10T23:21:33.263481+0000","last_became_peered":"2024-09-10T23:21:33.263481+0000","last_unstale":"2024-09-10T23:21:35.510168+0000","last_undegraded":"2024-09-10T23:21:35.510168+0000","last_fullsized":"2024-09-10T23:21:35.510168+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:28.086014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.273247+0000","last_change":"2024-09-10T23:21:34.270283+0000","last_active":"2024-09-10T23:21:34.273247+0000","last_peered":"2024-09-10T23:21:34.273247+0000","last_clean":"2024-09-10T23:21:34.273247+0000","last_became_active":"2024-09-10T23:21:34.269976+0000","last_became_peered":"2024-09-10T23:21:34.269976+0000","last_unstale":"2024-09-10T23:21:34.273247+0000","last_undegraded":"2024-09-10T23:21:34.273247+0000","last_fullsized":"2024-09-10T23:21:34.273247+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:54.801814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245497+0000","last_change":"2024-09-10T23:21:33.266627+0000","last_active":"2024-09-10T23:21:35.245497+0000","last_peered":"2024-09-10T23:21:35.245497+0000","last_clean":"2024-09-10T23:21:35.245497+0000","last_became_active":"2024-09-10T23:21:33.264746+0000","last_became_peered":"2024-09-10T23:21:33.264746+0000","last_unstale":"2024-09-10T23:21:35.245497+0000","last_undegraded":"2024-09-10T23:21:35.245497+0000","last_fullsized":"2024-09-10T23:21:35.245497+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:27.877507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506492+0000","last_change":"2024-09-10T23:21:34.280608+0000","last_active":"2024-09-10T23:21:35.506492+0000","last_peered":"2024-09-10T23:21:35.506492+0000","last_clean":"2024-09-10T23:21:35.506492+0000","last_became_active":"2024-09-10T23:21:34.280333+0000","last_became_peered":"2024-09-10T23:21:34.280333+0000","last_unstale":"2024-09-10T23:21:35.506492+0000","last_undegraded":"2024-09-10T23:21:35.506492+0000","last_fullsized":"2024-09-10T23:21:35.506492+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:54.540422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.252793+0000","last_change":"2024-09-10T23:21:33.265168+0000","last_active":"2024-09-10T23:21:34.252793+0000","last_peered":"2024-09-10T23:21:34.252793+0000","last_clean":"2024-09-10T23:21:34.252793+0000","last_became_active":"2024-09-10T23:21:33.264848+0000","last_became_peered":"2024-09-10T23:21:33.264848+0000","last_unstale":"2024-09-10T23:21:34.252793+0000","last_undegraded":"2024-09-10T23:21:34.252793+0000","last_fullsized":"2024-09-10T23:21:34.252793+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:31.611549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509076+0000","last_change":"2024-09-10T23:21:34.282830+0000","last_active":"2024-09-10T23:21:35.509076+0000","last_peered":"2024-09-10T23:21:35.509076+0000","last_clean":"2024-09-10T23:21:35.509076+0000","last_became_active":"2024-09-10T23:21:34.282559+0000","last_became_peered":"2024-09-10T23:21:34.282559+0000","last_unstale":"2024-09-10T23:21:35.509076+0000","last_undegraded":"2024-09-10T23:21:35.509076+0000","last_fullsized":"2024-09-10T23:21:35.509076+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:53.376765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509638+0000","last_change":"2024-09-10T23:21:33.263189+0000","last_active":"2024-09-10T23:21:35.509638+0000","last_peered":"2024-09-10T23:21:35.509638+0000","last_clean":"2024-09-10T23:21:35.509638+0000","last_became_active":"2024-09-10T23:21:33.262903+0000","last_became_peered":"2024-09-10T23:21:33.262903+0000","last_unstale":"2024-09-10T23:21:35.509638+0000","last_undegraded":"2024-09-10T23:21:35.509638+0000","last_fullsized":"2024-09-10T23:21:35.509638+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:45.236462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245519+0000","last_change":"2024-09-10T23:21:34.280139+0000","last_active":"2024-09-10T23:21:35.245519+0000","last_peered":"2024-09-10T23:21:35.245519+0000","last_clean":"2024-09-10T23:21:35.245519+0000","last_became_active":"2024-09-10T23:21:34.279872+0000","last_became_peered":"2024-09-10T23:21:34.279872+0000","last_unstale":"2024-09-10T23:21:35.245519+0000","last_undegraded":"2024-09-10T23:21:35.245519+0000","last_fullsized":"2024-09-10T23:21:35.245519+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:35.511797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.255235+0000","last_change":"2024-09-10T23:21:33.261869+0000","last_active":"2024-09-10T23:21:34.255235+0000","last_peered":"2024-09-10T23:21:34.255235+0000","last_clean":"2024-09-10T23:21:34.255235+0000","last_became_active":"2024-09-10T23:21:33.261602+0000","last_became_peered":"2024-09-10T23:21:33.261602+0000","last_unstale":"2024-09-10T23:21:34.255235+0000","last_undegraded":"2024-09-10T23:21:34.255235+0000","last_fullsized":"2024-09-10T23:21:34.255235+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:47.937311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283064+0000","last_change":"2024-09-10T23:21:34.282155+0000","last_active":"2024-09-10T23:21:34.283064+0000","last_peered":"2024-09-10T23:21:34.283064+0000","last_clean":"2024-09-10T23:21:34.283064+0000","last_became_active":"2024-09-10T23:21:34.281902+0000","last_became_peered":"2024-09-10T23:21:34.281902+0000","last_unstale":"2024-09-10T23:21:34.283064+0000","last_undegraded":"2024-09-10T23:21:34.283064+0000","last_fullsized":"2024-09-10T23:21:34.283064+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:17.718036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.277911+0000","last_change":"2024-09-10T23:21:33.257042+0000","last_active":"2024-09-10T23:21:34.277911+0000","last_peered":"2024-09-10T23:21:34.277911+0000","last_clean":"2024-09-10T23:21:34.277911+0000","last_became_active":"2024-09-10T23:21:33.256777+0000","last_became_peered":"2024-09-10T23:21:33.256777+0000","last_unstale":"2024-09-10T23:21:34.277911+0000","last_undegraded":"2024-09-10T23:21:34.277911+0000","last_fullsized":"2024-09-10T23:21:34.277911+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:06.913135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":254,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.255317+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:21:34.255317+0000","last_peered":"2024-09-10T23:21:34.255317+0000","last_clean":"2024-09-10T23:21:34.255317+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:21:34.255317+0000","last_undegraded":"2024-09-10T23:21:34.255317+0000","last_fullsized":"2024-09-10T23:21:34.255317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476813,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44928,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326912,"statfs":{"total":96636764160,"available":96590757888,"internally_reserved":0,"allocated":1282048,"data_stored":589147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509518,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51048,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320792,"statfs":{"total":96636764160,"available":96584491008,"internally_reserved":0,"allocated":1851392,"data_stored":1170663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40728,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331112,"statfs":{"total":96636764160,"available":96595058688,"internally_reserved":0,"allocated":1249280,"data_stored":580239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509518,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46312,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325528,"statfs":{"total":96636764160,"available":96589340672,"internally_reserved":0,"allocated":1257472,"data_stored":580399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1249280,"data_stored":580239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40732,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331108,"statfs":{"total":96636764160,"available":96595054592,"internally_reserved":0,"allocated":1253376,"data_stored":580309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55240,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316600,"statfs":{"total":96636764160,"available":96580198400,"internally_reserved":0,"allocated":1880064,"data_stored":1179617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50476,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321364,"statfs":{"total":96636764160,"available":96585076736,"internally_reserved":0,"allocated":1261568,"data_stored":586931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:21:38.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:21:38.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 -- 172.21.15.17:0/1321616000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4140b4620 msgr2=0x7fc414073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 --2- 172.21.15.17:0/1321616000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4140b4620 0x7fc414073520 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fc404009900 tx=0x7fc40401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 -- 172.21.15.17:0/1321616000 shutdown_connections 2024-09-10T23:21:38.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 --2- 172.21.15.17:0/1321616000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc414070ab0 0x7fc414164460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 --2- 172.21.15.17:0/1321616000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4140b4620 0x7fc414073520 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 -- 172.21.15.17:0/1321616000 >> 172.21.15.17:0/1321616000 conn(0x7fc4140b2740 msgr2=0x7fc4140b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:38.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 -- 172.21.15.17:0/1321616000 shutdown_connections 2024-09-10T23:21:38.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 -- 172.21.15.17:0/1321616000 wait complete. 2024-09-10T23:21:38.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 Processor -- start 2024-09-10T23:21:38.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.596+0000 7fc413e00640 1 -- start start 2024-09-10T23:21:38.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc414070ab0 0x7fc41413d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:38.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc414073a60 0x7fc4140d1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4140b4620 0x7fc41406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc414167820 con 0x7fc414073a60 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4141676a0 con 0x7fc4140b4620 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc4141679a0 con 0x7fc414070ab0 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc414073a60 0x7fc4140d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc414073a60 0x7fc4140d1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60494/0 (socket says 172.21.15.17:60494) 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412000640 1 -- 172.21.15.17:0/4170537400 learned_addr learned my addr 172.21.15.17:0/4170537400 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413400640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4140b4620 0x7fc41406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412a00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc414070ab0 0x7fc41413d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412000640 1 -- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc414070ab0 msgr2=0x7fc41413d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412000640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc414070ab0 0x7fc41413d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412000640 1 -- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4140b4620 msgr2=0x7fc41406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412000640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4140b4620 0x7fc41406cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412000640 1 -- 172.21.15.17:0/4170537400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41413da60 con 0x7fc414073a60 2024-09-10T23:21:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc412000640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc414073a60 0x7fc4140d1250 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c500 tx=0x7fc40000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc40aa00640 1 -- 172.21.15.17:0/4170537400 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400017070 con 0x7fc414073a60 2024-09-10T23:21:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc40aa00640 1 -- 172.21.15.17:0/4170537400 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4000053c0 con 0x7fc414073a60 2024-09-10T23:21:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc40aa00640 1 -- 172.21.15.17:0/4170537400 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400012890 con 0x7fc414073a60 2024-09-10T23:21:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4140b0830 con 0x7fc414073a60 2024-09-10T23:21:38.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4140b0df0 con 0x7fc414073a60 2024-09-10T23:21:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc414073520 con 0x7fc414073a60 2024-09-10T23:21:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.600+0000 7fc40aa00640 1 -- 172.21.15.17:0/4170537400 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc400003600 con 0x7fc414073a60 2024-09-10T23:21:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.604+0000 7fc40aa00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3f40725e0 0x7fc3f4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.604+0000 7fc40aa00640 1 -- 172.21.15.17:0/4170537400 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fc4000929a0 con 0x7fc414073a60 2024-09-10T23:21:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.604+0000 7fc412a00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3f40725e0 0x7fc3f4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:38.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.604+0000 7fc412a00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3f40725e0 0x7fc3f4074aa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc4040af000 tx=0x7fc40401b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:38.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.608+0000 7fc40aa00640 1 -- 172.21.15.17:0/4170537400 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc40005df00 con 0x7fc414073a60 2024-09-10T23:21:38.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.776+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4140ccf10 con 0x7fc3f40725e0 2024-09-10T23:21:38.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc40aa00640 1 -- 172.21.15.17:0/4170537400 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252461 (secure 0 0 0) 0x7fc4140ccf10 con 0x7fc3f40725e0 2024-09-10T23:21:38.789 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:38.790 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:21:38.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3f40725e0 msgr2=0x7fc3f4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3f40725e0 0x7fc3f4074aa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc4040af000 tx=0x7fc40401b120 comp rx=0 tx=0).stop 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc414073a60 msgr2=0x7fc4140d1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc414073a60 0x7fc4140d1250 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c500 tx=0x7fc40000c9c0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 shutdown_connections 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3f40725e0 0x7fc3f4074aa0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4140b4620 0x7fc41406cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc414073a60 0x7fc4140d1250 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 --2- 172.21.15.17:0/4170537400 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc414070ab0 0x7fc41413d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 >> 172.21.15.17:0/4170537400 conn(0x7fc4140b2740 msgr2=0x7fc41414cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 shutdown_connections 2024-09-10T23:21:38.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:38.784+0000 7fc413e00640 1 -- 172.21.15.17:0/4170537400 wait complete. 2024-09-10T23:21:38.810 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-10T23:21:38.381337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357716,"kb_used_data":11020,"kb_used_omap":12,"kb_used_meta":346483,"kb_avail":754617004,"statfs":{"total":773094113280,"available":772727812096,"internally_reserved":0,"allocated":11284480,"data_stored":5847544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":354799153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001823"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.507090+0000","last_change":"2024-09-10T23:21:34.277035+0000","last_active":"2024-09-10T23:21:35.507090+0000","last_peered":"2024-09-10T23:21:35.507090+0000","last_clean":"2024-09-10T23:21:35.507090+0000","last_became_active":"2024-09-10T23:21:34.276768+0000","last_became_peered":"2024-09-10T23:21:34.276768+0000","last_unstale":"2024-09-10T23:21:35.507090+0000","last_undegraded":"2024-09-10T23:21:35.507090+0000","last_fullsized":"2024-09-10T23:21:35.507090+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:54.669147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283159+0000","last_change":"2024-09-10T23:21:34.281071+0000","last_active":"2024-09-10T23:21:34.283159+0000","last_peered":"2024-09-10T23:21:34.283159+0000","last_clean":"2024-09-10T23:21:34.283159+0000","last_became_active":"2024-09-10T23:21:34.280742+0000","last_became_peered":"2024-09-10T23:21:34.280742+0000","last_unstale":"2024-09-10T23:21:34.283159+0000","last_undegraded":"2024-09-10T23:21:34.283159+0000","last_fullsized":"2024-09-10T23:21:34.283159+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:50.229431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506572+0000","last_change":"2024-09-10T23:21:34.272757+0000","last_active":"2024-09-10T23:21:35.506572+0000","last_peered":"2024-09-10T23:21:35.506572+0000","last_clean":"2024-09-10T23:21:35.506572+0000","last_became_active":"2024-09-10T23:21:34.272464+0000","last_became_peered":"2024-09-10T23:21:34.272464+0000","last_unstale":"2024-09-10T23:21:35.506572+0000","last_undegraded":"2024-09-10T23:21:35.506572+0000","last_fullsized":"2024-09-10T23:21:35.506572+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:11.082439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.282303+0000","last_change":"2024-09-10T23:21:34.277420+0000","last_active":"2024-09-10T23:21:34.282303+0000","last_peered":"2024-09-10T23:21:34.282303+0000","last_clean":"2024-09-10T23:21:34.282303+0000","last_became_active":"2024-09-10T23:21:34.276888+0000","last_became_peered":"2024-09-10T23:21:34.276888+0000","last_unstale":"2024-09-10T23:21:34.282303+0000","last_undegraded":"2024-09-10T23:21:34.282303+0000","last_fullsized":"2024-09-10T23:21:34.282303+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:03.216372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253160+0000","last_change":"2024-09-10T23:21:34.257649+0000","last_active":"2024-09-10T23:21:35.253160+0000","last_peered":"2024-09-10T23:21:35.253160+0000","last_clean":"2024-09-10T23:21:35.253160+0000","last_became_active":"2024-09-10T23:21:34.257329+0000","last_became_peered":"2024-09-10T23:21:34.257329+0000","last_unstale":"2024-09-10T23:21:35.253160+0000","last_undegraded":"2024-09-10T23:21:35.253160+0000","last_fullsized":"2024-09-10T23:21:35.253160+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:26.226844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244720+0000","last_change":"2024-09-10T23:21:34.286670+0000","last_active":"2024-09-10T23:21:35.244720+0000","last_peered":"2024-09-10T23:21:35.244720+0000","last_clean":"2024-09-10T23:21:35.244720+0000","last_became_active":"2024-09-10T23:21:34.286368+0000","last_became_peered":"2024-09-10T23:21:34.286368+0000","last_unstale":"2024-09-10T23:21:35.244720+0000","last_undegraded":"2024-09-10T23:21:35.244720+0000","last_fullsized":"2024-09-10T23:21:35.244720+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:56.217371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283061+0000","last_change":"2024-09-10T23:21:34.282103+0000","last_active":"2024-09-10T23:21:34.283061+0000","last_peered":"2024-09-10T23:21:34.283061+0000","last_clean":"2024-09-10T23:21:34.283061+0000","last_became_active":"2024-09-10T23:21:34.281811+0000","last_became_peered":"2024-09-10T23:21:34.281811+0000","last_unstale":"2024-09-10T23:21:34.283061+0000","last_undegraded":"2024-09-10T23:21:34.283061+0000","last_fullsized":"2024-09-10T23:21:34.283061+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:28.880956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.282241+0000","last_change":"2024-09-10T23:21:34.277383+0000","last_active":"2024-09-10T23:21:34.282241+0000","last_peered":"2024-09-10T23:21:34.282241+0000","last_clean":"2024-09-10T23:21:34.282241+0000","last_became_active":"2024-09-10T23:21:34.277123+0000","last_became_peered":"2024-09-10T23:21:34.277123+0000","last_unstale":"2024-09-10T23:21:34.282241+0000","last_undegraded":"2024-09-10T23:21:34.282241+0000","last_fullsized":"2024-09-10T23:21:34.282241+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:46.246740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253653+0000","last_change":"2024-09-10T23:21:34.261586+0000","last_active":"2024-09-10T23:21:35.253653+0000","last_peered":"2024-09-10T23:21:35.253653+0000","last_clean":"2024-09-10T23:21:35.253653+0000","last_became_active":"2024-09-10T23:21:34.261101+0000","last_became_peered":"2024-09-10T23:21:34.261101+0000","last_unstale":"2024-09-10T23:21:35.253653+0000","last_undegraded":"2024-09-10T23:21:35.253653+0000","last_fullsized":"2024-09-10T23:21:35.253653+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:08.458371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.281675+0000","last_change":"2024-09-10T23:21:34.277195+0000","last_active":"2024-09-10T23:21:34.281675+0000","last_peered":"2024-09-10T23:21:34.281675+0000","last_clean":"2024-09-10T23:21:34.281675+0000","last_became_active":"2024-09-10T23:21:34.276895+0000","last_became_peered":"2024-09-10T23:21:34.276895+0000","last_unstale":"2024-09-10T23:21:34.281675+0000","last_undegraded":"2024-09-10T23:21:34.281675+0000","last_fullsized":"2024-09-10T23:21:34.281675+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:11.692551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253442+0000","last_change":"2024-09-10T23:21:34.257422+0000","last_active":"2024-09-10T23:21:35.253442+0000","last_peered":"2024-09-10T23:21:35.253442+0000","last_clean":"2024-09-10T23:21:35.253442+0000","last_became_active":"2024-09-10T23:21:34.257137+0000","last_became_peered":"2024-09-10T23:21:34.257137+0000","last_unstale":"2024-09-10T23:21:35.253442+0000","last_undegraded":"2024-09-10T23:21:35.253442+0000","last_fullsized":"2024-09-10T23:21:35.253442+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:07.951529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.275697+0000","last_change":"2024-09-10T23:21:34.269171+0000","last_active":"2024-09-10T23:21:34.275697+0000","last_peered":"2024-09-10T23:21:34.275697+0000","last_clean":"2024-09-10T23:21:34.275697+0000","last_became_active":"2024-09-10T23:21:34.267674+0000","last_became_peered":"2024-09-10T23:21:34.267674+0000","last_unstale":"2024-09-10T23:21:34.275697+0000","last_undegraded":"2024-09-10T23:21:34.275697+0000","last_fullsized":"2024-09-10T23:21:34.275697+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:42.094391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.282837+0000","last_change":"2024-09-10T23:21:34.276131+0000","last_active":"2024-09-10T23:21:34.282837+0000","last_peered":"2024-09-10T23:21:34.282837+0000","last_clean":"2024-09-10T23:21:34.282837+0000","last_became_active":"2024-09-10T23:21:34.275802+0000","last_became_peered":"2024-09-10T23:21:34.275802+0000","last_unstale":"2024-09-10T23:21:34.282837+0000","last_undegraded":"2024-09-10T23:21:34.282837+0000","last_fullsized":"2024-09-10T23:21:34.282837+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:18.023932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253087+0000","last_change":"2024-09-10T23:21:34.285339+0000","last_active":"2024-09-10T23:21:35.253087+0000","last_peered":"2024-09-10T23:21:35.253087+0000","last_clean":"2024-09-10T23:21:35.253087+0000","last_became_active":"2024-09-10T23:21:34.285037+0000","last_became_peered":"2024-09-10T23:21:34.285037+0000","last_unstale":"2024-09-10T23:21:35.253087+0000","last_undegraded":"2024-09-10T23:21:35.253087+0000","last_fullsized":"2024-09-10T23:21:35.253087+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:29.302796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.289647+0000","last_change":"2024-09-10T23:21:34.287355+0000","last_active":"2024-09-10T23:21:34.289647+0000","last_peered":"2024-09-10T23:21:34.289647+0000","last_clean":"2024-09-10T23:21:34.289647+0000","last_became_active":"2024-09-10T23:21:34.287055+0000","last_became_peered":"2024-09-10T23:21:34.287055+0000","last_unstale":"2024-09-10T23:21:34.289647+0000","last_undegraded":"2024-09-10T23:21:34.289647+0000","last_fullsized":"2024-09-10T23:21:34.289647+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:53.376765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244580+0000","last_change":"2024-09-10T23:21:34.266408+0000","last_active":"2024-09-10T23:21:35.244580+0000","last_peered":"2024-09-10T23:21:35.244580+0000","last_clean":"2024-09-10T23:21:35.244580+0000","last_became_active":"2024-09-10T23:21:34.266128+0000","last_became_peered":"2024-09-10T23:21:34.266128+0000","last_unstale":"2024-09-10T23:21:35.244580+0000","last_undegraded":"2024-09-10T23:21:35.244580+0000","last_fullsized":"2024-09-10T23:21:35.244580+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:42.290136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.246022+0000","last_change":"2024-09-10T23:21:34.284022+0000","last_active":"2024-09-10T23:21:35.246022+0000","last_peered":"2024-09-10T23:21:35.246022+0000","last_clean":"2024-09-10T23:21:35.246022+0000","last_became_active":"2024-09-10T23:21:34.280655+0000","last_became_peered":"2024-09-10T23:21:34.280655+0000","last_unstale":"2024-09-10T23:21:35.246022+0000","last_undegraded":"2024-09-10T23:21:35.246022+0000","last_fullsized":"2024-09-10T23:21:35.246022+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:29:20.563708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506989+0000","last_change":"2024-09-10T23:21:34.278670+0000","last_active":"2024-09-10T23:21:35.506989+0000","last_peered":"2024-09-10T23:21:35.506989+0000","last_clean":"2024-09-10T23:21:35.506989+0000","last_became_active":"2024-09-10T23:21:34.278395+0000","last_became_peered":"2024-09-10T23:21:34.278395+0000","last_unstale":"2024-09-10T23:21:35.506989+0000","last_undegraded":"2024-09-10T23:21:35.506989+0000","last_fullsized":"2024-09-10T23:21:35.506989+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:42.610090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253692+0000","last_change":"2024-09-10T23:21:34.278352+0000","last_active":"2024-09-10T23:21:35.253692+0000","last_peered":"2024-09-10T23:21:35.253692+0000","last_clean":"2024-09-10T23:21:35.253692+0000","last_became_active":"2024-09-10T23:21:34.278052+0000","last_became_peered":"2024-09-10T23:21:34.278052+0000","last_unstale":"2024-09-10T23:21:35.253692+0000","last_undegraded":"2024-09-10T23:21:35.253692+0000","last_fullsized":"2024-09-10T23:21:35.253692+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:05.317361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.289623+0000","last_change":"2024-09-10T23:21:34.286709+0000","last_active":"2024-09-10T23:21:34.289623+0000","last_peered":"2024-09-10T23:21:34.289623+0000","last_clean":"2024-09-10T23:21:34.289623+0000","last_became_active":"2024-09-10T23:21:34.286426+0000","last_became_peered":"2024-09-10T23:21:34.286426+0000","last_unstale":"2024-09-10T23:21:34.289623+0000","last_undegraded":"2024-09-10T23:21:34.289623+0000","last_fullsized":"2024-09-10T23:21:34.289623+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:16.855546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253020+0000","last_change":"2024-09-10T23:21:34.261898+0000","last_active":"2024-09-10T23:21:35.253020+0000","last_peered":"2024-09-10T23:21:35.253020+0000","last_clean":"2024-09-10T23:21:35.253020+0000","last_became_active":"2024-09-10T23:21:34.260685+0000","last_became_peered":"2024-09-10T23:21:34.260685+0000","last_unstale":"2024-09-10T23:21:35.253020+0000","last_undegraded":"2024-09-10T23:21:35.253020+0000","last_fullsized":"2024-09-10T23:21:35.253020+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:38.898955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.252917+0000","last_change":"2024-09-10T23:21:34.278348+0000","last_active":"2024-09-10T23:21:35.252917+0000","last_peered":"2024-09-10T23:21:35.252917+0000","last_clean":"2024-09-10T23:21:35.252917+0000","last_became_active":"2024-09-10T23:21:34.277973+0000","last_became_peered":"2024-09-10T23:21:34.277973+0000","last_unstale":"2024-09-10T23:21:35.252917+0000","last_undegraded":"2024-09-10T23:21:35.252917+0000","last_fullsized":"2024-09-10T23:21:35.252917+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:54.796451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509327+0000","last_change":"2024-09-10T23:21:34.282477+0000","last_active":"2024-09-10T23:21:35.509327+0000","last_peered":"2024-09-10T23:21:35.509327+0000","last_clean":"2024-09-10T23:21:35.509327+0000","last_became_active":"2024-09-10T23:21:34.282174+0000","last_became_peered":"2024-09-10T23:21:34.282174+0000","last_unstale":"2024-09-10T23:21:35.509327+0000","last_undegraded":"2024-09-10T23:21:35.509327+0000","last_fullsized":"2024-09-10T23:21:35.509327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:36.459847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506018+0000","last_change":"2024-09-10T23:21:34.271013+0000","last_active":"2024-09-10T23:21:35.506018+0000","last_peered":"2024-09-10T23:21:35.506018+0000","last_clean":"2024-09-10T23:21:35.506018+0000","last_became_active":"2024-09-10T23:21:34.270742+0000","last_became_peered":"2024-09-10T23:21:34.270742+0000","last_unstale":"2024-09-10T23:21:35.506018+0000","last_undegraded":"2024-09-10T23:21:35.506018+0000","last_fullsized":"2024-09-10T23:21:35.506018+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:03.274111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.265258+0000","last_change":"2024-09-10T23:21:34.261677+0000","last_active":"2024-09-10T23:21:34.265258+0000","last_peered":"2024-09-10T23:21:34.265258+0000","last_clean":"2024-09-10T23:21:34.265258+0000","last_became_active":"2024-09-10T23:21:34.261406+0000","last_became_peered":"2024-09-10T23:21:34.261406+0000","last_unstale":"2024-09-10T23:21:34.265258+0000","last_undegraded":"2024-09-10T23:21:34.265258+0000","last_fullsized":"2024-09-10T23:21:34.265258+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:12:20.966101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253182+0000","last_change":"2024-09-10T23:21:34.269085+0000","last_active":"2024-09-10T23:21:35.253182+0000","last_peered":"2024-09-10T23:21:35.253182+0000","last_clean":"2024-09-10T23:21:35.253182+0000","last_became_active":"2024-09-10T23:21:34.268798+0000","last_became_peered":"2024-09-10T23:21:34.268798+0000","last_unstale":"2024-09-10T23:21:35.253182+0000","last_undegraded":"2024-09-10T23:21:35.253182+0000","last_fullsized":"2024-09-10T23:21:35.253182+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:01.017631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.263248+0000","last_change":"2024-09-10T23:21:34.260554+0000","last_active":"2024-09-10T23:21:34.263248+0000","last_peered":"2024-09-10T23:21:34.263248+0000","last_clean":"2024-09-10T23:21:34.263248+0000","last_became_active":"2024-09-10T23:21:34.260309+0000","last_became_peered":"2024-09-10T23:21:34.260309+0000","last_unstale":"2024-09-10T23:21:34.263248+0000","last_undegraded":"2024-09-10T23:21:34.263248+0000","last_fullsized":"2024-09-10T23:21:34.263248+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:16.883362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.282158+0000","last_change":"2024-09-10T23:21:34.277135+0000","last_active":"2024-09-10T23:21:34.282158+0000","last_peered":"2024-09-10T23:21:34.282158+0000","last_clean":"2024-09-10T23:21:34.282158+0000","last_became_active":"2024-09-10T23:21:34.276503+0000","last_became_peered":"2024-09-10T23:21:34.276503+0000","last_unstale":"2024-09-10T23:21:34.282158+0000","last_undegraded":"2024-09-10T23:21:34.282158+0000","last_fullsized":"2024-09-10T23:21:34.282158+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:15.616590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.264381+0000","last_change":"2024-09-10T23:21:34.263130+0000","last_active":"2024-09-10T23:21:34.264381+0000","last_peered":"2024-09-10T23:21:34.264381+0000","last_clean":"2024-09-10T23:21:34.264381+0000","last_became_active":"2024-09-10T23:21:34.262867+0000","last_became_peered":"2024-09-10T23:21:34.262867+0000","last_unstale":"2024-09-10T23:21:34.264381+0000","last_undegraded":"2024-09-10T23:21:34.264381+0000","last_fullsized":"2024-09-10T23:21:34.264381+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:46.317753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253327+0000","last_change":"2024-09-10T23:21:34.262572+0000","last_active":"2024-09-10T23:21:35.253327+0000","last_peered":"2024-09-10T23:21:35.253327+0000","last_clean":"2024-09-10T23:21:35.253327+0000","last_became_active":"2024-09-10T23:21:34.262292+0000","last_became_peered":"2024-09-10T23:21:34.262292+0000","last_unstale":"2024-09-10T23:21:35.253327+0000","last_undegraded":"2024-09-10T23:21:35.253327+0000","last_fullsized":"2024-09-10T23:21:35.253327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:50.179517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283809+0000","last_change":"2024-09-10T23:21:34.282812+0000","last_active":"2024-09-10T23:21:34.283809+0000","last_peered":"2024-09-10T23:21:34.283809+0000","last_clean":"2024-09-10T23:21:34.283809+0000","last_became_active":"2024-09-10T23:21:34.282549+0000","last_became_peered":"2024-09-10T23:21:34.282549+0000","last_unstale":"2024-09-10T23:21:34.283809+0000","last_undegraded":"2024-09-10T23:21:34.283809+0000","last_fullsized":"2024-09-10T23:21:34.283809+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:31.725156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244633+0000","last_change":"2024-09-10T23:21:34.267436+0000","last_active":"2024-09-10T23:21:35.244633+0000","last_peered":"2024-09-10T23:21:35.244633+0000","last_clean":"2024-09-10T23:21:35.244633+0000","last_became_active":"2024-09-10T23:21:34.265982+0000","last_became_peered":"2024-09-10T23:21:34.265982+0000","last_unstale":"2024-09-10T23:21:35.244633+0000","last_undegraded":"2024-09-10T23:21:35.244633+0000","last_fullsized":"2024-09-10T23:21:35.244633+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:13.123092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245589+0000","last_change":"2024-09-10T23:21:34.251787+0000","last_active":"2024-09-10T23:21:35.245589+0000","last_peered":"2024-09-10T23:21:35.245589+0000","last_clean":"2024-09-10T23:21:35.245589+0000","last_became_active":"2024-09-10T23:21:34.249563+0000","last_became_peered":"2024-09-10T23:21:34.249563+0000","last_unstale":"2024-09-10T23:21:35.245589+0000","last_undegraded":"2024-09-10T23:21:35.245589+0000","last_fullsized":"2024-09-10T23:21:35.245589+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:19:48.044512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"102'4","reported_seq":19,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509476+0000","last_change":"2024-09-10T23:21:33.266205+0000","last_active":"2024-09-10T23:21:35.509476+0000","last_peered":"2024-09-10T23:21:35.509476+0000","last_clean":"2024-09-10T23:21:35.509476+0000","last_became_active":"2024-09-10T23:21:33.265883+0000","last_became_peered":"2024-09-10T23:21:33.265883+0000","last_unstale":"2024-09-10T23:21:35.509476+0000","last_undegraded":"2024-09-10T23:21:35.509476+0000","last_fullsized":"2024-09-10T23:21:35.509476+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:41.232368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245787+0000","last_change":"2024-09-10T23:21:34.258385+0000","last_active":"2024-09-10T23:21:35.245787+0000","last_peered":"2024-09-10T23:21:35.245787+0000","last_clean":"2024-09-10T23:21:35.245787+0000","last_became_active":"2024-09-10T23:21:34.258033+0000","last_became_peered":"2024-09-10T23:21:34.258033+0000","last_unstale":"2024-09-10T23:21:35.245787+0000","last_undegraded":"2024-09-10T23:21:35.245787+0000","last_fullsized":"2024-09-10T23:21:35.245787+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:04.168750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253467+0000","last_change":"2024-09-10T23:21:33.258344+0000","last_active":"2024-09-10T23:21:35.253467+0000","last_peered":"2024-09-10T23:21:35.253467+0000","last_clean":"2024-09-10T23:21:35.253467+0000","last_became_active":"2024-09-10T23:21:33.257858+0000","last_became_peered":"2024-09-10T23:21:33.257858+0000","last_unstale":"2024-09-10T23:21:35.253467+0000","last_undegraded":"2024-09-10T23:21:35.253467+0000","last_fullsized":"2024-09-10T23:21:35.253467+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:22.656274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.281461+0000","last_change":"2024-09-10T23:21:34.280178+0000","last_active":"2024-09-10T23:21:34.281461+0000","last_peered":"2024-09-10T23:21:34.281461+0000","last_clean":"2024-09-10T23:21:34.281461+0000","last_became_active":"2024-09-10T23:21:34.279844+0000","last_became_peered":"2024-09-10T23:21:34.279844+0000","last_unstale":"2024-09-10T23:21:34.281461+0000","last_undegraded":"2024-09-10T23:21:34.281461+0000","last_fullsized":"2024-09-10T23:21:34.281461+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:24.390369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.278972+0000","last_change":"2024-09-10T23:21:33.263757+0000","last_active":"2024-09-10T23:21:34.278972+0000","last_peered":"2024-09-10T23:21:34.278972+0000","last_clean":"2024-09-10T23:21:34.278972+0000","last_became_active":"2024-09-10T23:21:33.263035+0000","last_became_peered":"2024-09-10T23:21:33.263035+0000","last_unstale":"2024-09-10T23:21:34.278972+0000","last_undegraded":"2024-09-10T23:21:34.278972+0000","last_fullsized":"2024-09-10T23:21:34.278972+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:33.254883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.246120+0000","last_change":"2024-09-10T23:21:34.260747+0000","last_active":"2024-09-10T23:21:35.246120+0000","last_peered":"2024-09-10T23:21:35.246120+0000","last_clean":"2024-09-10T23:21:35.246120+0000","last_became_active":"2024-09-10T23:21:34.259606+0000","last_became_peered":"2024-09-10T23:21:34.259606+0000","last_unstale":"2024-09-10T23:21:35.246120+0000","last_undegraded":"2024-09-10T23:21:35.246120+0000","last_fullsized":"2024-09-10T23:21:35.246120+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:07:33.577339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"102'2","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.510167+0000","last_change":"2024-09-10T23:21:33.263068+0000","last_active":"2024-09-10T23:21:35.510167+0000","last_peered":"2024-09-10T23:21:35.510167+0000","last_clean":"2024-09-10T23:21:35.510167+0000","last_became_active":"2024-09-10T23:21:33.261952+0000","last_became_peered":"2024-09-10T23:21:33.261952+0000","last_unstale":"2024-09-10T23:21:35.510167+0000","last_undegraded":"2024-09-10T23:21:35.510167+0000","last_fullsized":"2024-09-10T23:21:35.510167+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:13.385909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283626+0000","last_change":"2024-09-10T23:21:34.278791+0000","last_active":"2024-09-10T23:21:34.283626+0000","last_peered":"2024-09-10T23:21:34.283626+0000","last_clean":"2024-09-10T23:21:34.283626+0000","last_became_active":"2024-09-10T23:21:34.278519+0000","last_became_peered":"2024-09-10T23:21:34.278519+0000","last_unstale":"2024-09-10T23:21:34.283626+0000","last_undegraded":"2024-09-10T23:21:34.283626+0000","last_fullsized":"2024-09-10T23:21:34.283626+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:56.498953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253312+0000","last_change":"2024-09-10T23:21:33.263991+0000","last_active":"2024-09-10T23:21:35.253312+0000","last_peered":"2024-09-10T23:21:35.253312+0000","last_clean":"2024-09-10T23:21:35.253312+0000","last_became_active":"2024-09-10T23:21:33.263484+0000","last_became_peered":"2024-09-10T23:21:33.263484+0000","last_unstale":"2024-09-10T23:21:35.253312+0000","last_undegraded":"2024-09-10T23:21:35.253312+0000","last_fullsized":"2024-09-10T23:21:35.253312+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:58.487513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509522+0000","last_change":"2024-09-10T23:21:34.259207+0000","last_active":"2024-09-10T23:21:35.509522+0000","last_peered":"2024-09-10T23:21:35.509522+0000","last_clean":"2024-09-10T23:21:35.509522+0000","last_became_active":"2024-09-10T23:21:34.258793+0000","last_became_peered":"2024-09-10T23:21:34.258793+0000","last_unstale":"2024-09-10T23:21:35.509522+0000","last_undegraded":"2024-09-10T23:21:35.509522+0000","last_fullsized":"2024-09-10T23:21:35.509522+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:52.083436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"102'1","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.286057+0000","last_change":"2024-09-10T23:21:33.265801+0000","last_active":"2024-09-10T23:21:34.286057+0000","last_peered":"2024-09-10T23:21:34.286057+0000","last_clean":"2024-09-10T23:21:34.286057+0000","last_became_active":"2024-09-10T23:21:33.265516+0000","last_became_peered":"2024-09-10T23:21:33.265516+0000","last_unstale":"2024-09-10T23:21:34.286057+0000","last_undegraded":"2024-09-10T23:21:34.286057+0000","last_fullsized":"2024-09-10T23:21:34.286057+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:44.101811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244990+0000","last_change":"2024-09-10T23:21:34.278832+0000","last_active":"2024-09-10T23:21:35.244990+0000","last_peered":"2024-09-10T23:21:35.244990+0000","last_clean":"2024-09-10T23:21:35.244990+0000","last_became_active":"2024-09-10T23:21:34.278516+0000","last_became_peered":"2024-09-10T23:21:34.278516+0000","last_unstale":"2024-09-10T23:21:35.244990+0000","last_undegraded":"2024-09-10T23:21:35.244990+0000","last_fullsized":"2024-09-10T23:21:35.244990+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:51.377788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506521+0000","last_change":"2024-09-10T23:21:33.246332+0000","last_active":"2024-09-10T23:21:35.506521+0000","last_peered":"2024-09-10T23:21:35.506521+0000","last_clean":"2024-09-10T23:21:35.506521+0000","last_became_active":"2024-09-10T23:21:33.246067+0000","last_became_peered":"2024-09-10T23:21:33.246067+0000","last_unstale":"2024-09-10T23:21:35.506521+0000","last_undegraded":"2024-09-10T23:21:35.506521+0000","last_fullsized":"2024-09-10T23:21:35.506521+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:00.299238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.276007+0000","last_change":"2024-09-10T23:21:34.270603+0000","last_active":"2024-09-10T23:21:34.276007+0000","last_peered":"2024-09-10T23:21:34.276007+0000","last_clean":"2024-09-10T23:21:34.276007+0000","last_became_active":"2024-09-10T23:21:34.270336+0000","last_became_peered":"2024-09-10T23:21:34.270336+0000","last_unstale":"2024-09-10T23:21:34.276007+0000","last_undegraded":"2024-09-10T23:21:34.276007+0000","last_fullsized":"2024-09-10T23:21:34.276007+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:29:29.294338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.255013+0000","last_change":"2024-09-10T23:21:33.262412+0000","last_active":"2024-09-10T23:21:34.255013+0000","last_peered":"2024-09-10T23:21:34.255013+0000","last_clean":"2024-09-10T23:21:34.255013+0000","last_became_active":"2024-09-10T23:21:33.262144+0000","last_became_peered":"2024-09-10T23:21:33.262144+0000","last_unstale":"2024-09-10T23:21:34.255013+0000","last_undegraded":"2024-09-10T23:21:34.255013+0000","last_fullsized":"2024-09-10T23:21:34.255013+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:30.721707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253630+0000","last_change":"2024-09-10T23:21:34.270781+0000","last_active":"2024-09-10T23:21:35.253630+0000","last_peered":"2024-09-10T23:21:35.253630+0000","last_clean":"2024-09-10T23:21:35.253630+0000","last_became_active":"2024-09-10T23:21:34.270458+0000","last_became_peered":"2024-09-10T23:21:34.270458+0000","last_unstale":"2024-09-10T23:21:35.253630+0000","last_undegraded":"2024-09-10T23:21:35.253630+0000","last_fullsized":"2024-09-10T23:21:35.253630+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:20.765002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.253578+0000","last_change":"2024-09-10T23:21:33.261211+0000","last_active":"2024-09-10T23:21:34.253578+0000","last_peered":"2024-09-10T23:21:34.253578+0000","last_clean":"2024-09-10T23:21:34.253578+0000","last_became_active":"2024-09-10T23:21:33.260899+0000","last_became_peered":"2024-09-10T23:21:33.260899+0000","last_unstale":"2024-09-10T23:21:34.253578+0000","last_undegraded":"2024-09-10T23:21:34.253578+0000","last_fullsized":"2024-09-10T23:21:34.253578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:44.805946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.274222+0000","last_change":"2024-09-10T23:21:34.273250+0000","last_active":"2024-09-10T23:21:34.274222+0000","last_peered":"2024-09-10T23:21:34.274222+0000","last_clean":"2024-09-10T23:21:34.274222+0000","last_became_active":"2024-09-10T23:21:34.272491+0000","last_became_peered":"2024-09-10T23:21:34.272491+0000","last_unstale":"2024-09-10T23:21:34.274222+0000","last_undegraded":"2024-09-10T23:21:34.274222+0000","last_fullsized":"2024-09-10T23:21:34.274222+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:52.826987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.507339+0000","last_change":"2024-09-10T23:21:33.260264+0000","last_active":"2024-09-10T23:21:35.507339+0000","last_peered":"2024-09-10T23:21:35.507339+0000","last_clean":"2024-09-10T23:21:35.507339+0000","last_became_active":"2024-09-10T23:21:33.259963+0000","last_became_peered":"2024-09-10T23:21:33.259963+0000","last_unstale":"2024-09-10T23:21:35.507339+0000","last_undegraded":"2024-09-10T23:21:35.507339+0000","last_fullsized":"2024-09-10T23:21:35.507339+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:31.970023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.507199+0000","last_change":"2024-09-10T23:21:34.274358+0000","last_active":"2024-09-10T23:21:35.507199+0000","last_peered":"2024-09-10T23:21:35.507199+0000","last_clean":"2024-09-10T23:21:35.507199+0000","last_became_active":"2024-09-10T23:21:34.274101+0000","last_became_peered":"2024-09-10T23:21:34.274101+0000","last_unstale":"2024-09-10T23:21:35.507199+0000","last_undegraded":"2024-09-10T23:21:35.507199+0000","last_fullsized":"2024-09-10T23:21:35.507199+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:46.641458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"102'3","reported_seq":18,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253759+0000","last_change":"2024-09-10T23:21:33.270505+0000","last_active":"2024-09-10T23:21:35.253759+0000","last_peered":"2024-09-10T23:21:35.253759+0000","last_clean":"2024-09-10T23:21:35.253759+0000","last_became_active":"2024-09-10T23:21:33.270224+0000","last_became_peered":"2024-09-10T23:21:33.270224+0000","last_unstale":"2024-09-10T23:21:35.253759+0000","last_undegraded":"2024-09-10T23:21:35.253759+0000","last_fullsized":"2024-09-10T23:21:35.253759+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:12.791409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.275758+0000","last_change":"2024-09-10T23:21:34.272068+0000","last_active":"2024-09-10T23:21:34.275758+0000","last_peered":"2024-09-10T23:21:34.275758+0000","last_clean":"2024-09-10T23:21:34.275758+0000","last_became_active":"2024-09-10T23:21:34.271742+0000","last_became_peered":"2024-09-10T23:21:34.271742+0000","last_unstale":"2024-09-10T23:21:34.275758+0000","last_undegraded":"2024-09-10T23:21:34.275758+0000","last_fullsized":"2024-09-10T23:21:34.275758+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:08.805287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"102'6","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245633+0000","last_change":"2024-09-10T23:21:33.266246+0000","last_active":"2024-09-10T23:21:35.245633+0000","last_peered":"2024-09-10T23:21:35.245633+0000","last_clean":"2024-09-10T23:21:35.245633+0000","last_became_active":"2024-09-10T23:21:33.265861+0000","last_became_peered":"2024-09-10T23:21:33.265861+0000","last_unstale":"2024-09-10T23:21:35.245633+0000","last_undegraded":"2024-09-10T23:21:35.245633+0000","last_fullsized":"2024-09-10T23:21:35.245633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:51.823539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.276943+0000","last_change":"2024-09-10T23:21:34.265983+0000","last_active":"2024-09-10T23:21:34.276943+0000","last_peered":"2024-09-10T23:21:34.276943+0000","last_clean":"2024-09-10T23:21:34.276943+0000","last_became_active":"2024-09-10T23:21:34.265623+0000","last_became_peered":"2024-09-10T23:21:34.265623+0000","last_unstale":"2024-09-10T23:21:34.276943+0000","last_undegraded":"2024-09-10T23:21:34.276943+0000","last_fullsized":"2024-09-10T23:21:34.276943+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:13.794857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.276292+0000","last_change":"2024-09-10T23:21:33.270280+0000","last_active":"2024-09-10T23:21:34.276292+0000","last_peered":"2024-09-10T23:21:34.276292+0000","last_clean":"2024-09-10T23:21:34.276292+0000","last_became_active":"2024-09-10T23:21:33.269989+0000","last_became_peered":"2024-09-10T23:21:33.269989+0000","last_unstale":"2024-09-10T23:21:34.276292+0000","last_undegraded":"2024-09-10T23:21:34.276292+0000","last_fullsized":"2024-09-10T23:21:34.276292+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:55.857149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.252861+0000","last_change":"2024-09-10T23:21:34.266290+0000","last_active":"2024-09-10T23:21:35.252861+0000","last_peered":"2024-09-10T23:21:35.252861+0000","last_clean":"2024-09-10T23:21:35.252861+0000","last_became_active":"2024-09-10T23:21:34.262629+0000","last_became_peered":"2024-09-10T23:21:34.262629+0000","last_unstale":"2024-09-10T23:21:35.252861+0000","last_undegraded":"2024-09-10T23:21:35.252861+0000","last_fullsized":"2024-09-10T23:21:35.252861+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:52.083436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245136+0000","last_change":"2024-09-10T23:21:33.266362+0000","last_active":"2024-09-10T23:21:35.245136+0000","last_peered":"2024-09-10T23:21:35.245136+0000","last_clean":"2024-09-10T23:21:35.245136+0000","last_became_active":"2024-09-10T23:21:33.266100+0000","last_became_peered":"2024-09-10T23:21:33.266100+0000","last_unstale":"2024-09-10T23:21:35.245136+0000","last_undegraded":"2024-09-10T23:21:35.245136+0000","last_fullsized":"2024-09-10T23:21:35.245136+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:23.386920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.289327+0000","last_change":"2024-09-10T23:21:34.287142+0000","last_active":"2024-09-10T23:21:34.289327+0000","last_peered":"2024-09-10T23:21:34.289327+0000","last_clean":"2024-09-10T23:21:34.289327+0000","last_became_active":"2024-09-10T23:21:34.285912+0000","last_became_peered":"2024-09-10T23:21:34.285912+0000","last_unstale":"2024-09-10T23:21:34.289327+0000","last_undegraded":"2024-09-10T23:21:34.289327+0000","last_fullsized":"2024-09-10T23:21:34.289327+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:16.607504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.275980+0000","last_change":"2024-09-10T23:21:33.255868+0000","last_active":"2024-09-10T23:21:34.275980+0000","last_peered":"2024-09-10T23:21:34.275980+0000","last_clean":"2024-09-10T23:21:34.275980+0000","last_became_active":"2024-09-10T23:21:33.255576+0000","last_became_peered":"2024-09-10T23:21:33.255576+0000","last_unstale":"2024-09-10T23:21:34.275980+0000","last_undegraded":"2024-09-10T23:21:34.275980+0000","last_fullsized":"2024-09-10T23:21:34.275980+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:02:38.616894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.258897+0000","last_change":"2024-09-10T23:21:34.255531+0000","last_active":"2024-09-10T23:21:34.258897+0000","last_peered":"2024-09-10T23:21:34.258897+0000","last_clean":"2024-09-10T23:21:34.258897+0000","last_became_active":"2024-09-10T23:21:34.255178+0000","last_became_peered":"2024-09-10T23:21:34.255178+0000","last_unstale":"2024-09-10T23:21:34.258897+0000","last_undegraded":"2024-09-10T23:21:34.258897+0000","last_fullsized":"2024-09-10T23:21:34.258897+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:21.302161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"102'8","reported_seq":21,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.289823+0000","last_change":"2024-09-10T23:21:33.268057+0000","last_active":"2024-09-10T23:21:34.289823+0000","last_peered":"2024-09-10T23:21:34.289823+0000","last_clean":"2024-09-10T23:21:34.289823+0000","last_became_active":"2024-09-10T23:21:33.267696+0000","last_became_peered":"2024-09-10T23:21:33.267696+0000","last_unstale":"2024-09-10T23:21:34.289823+0000","last_undegraded":"2024-09-10T23:21:34.289823+0000","last_fullsized":"2024-09-10T23:21:34.289823+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:45:41.339693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245566+0000","last_change":"2024-09-10T23:21:34.249910+0000","last_active":"2024-09-10T23:21:35.245566+0000","last_peered":"2024-09-10T23:21:35.245566+0000","last_clean":"2024-09-10T23:21:35.245566+0000","last_became_active":"2024-09-10T23:21:34.249433+0000","last_became_peered":"2024-09-10T23:21:34.249433+0000","last_unstale":"2024-09-10T23:21:35.245566+0000","last_undegraded":"2024-09-10T23:21:35.245566+0000","last_fullsized":"2024-09-10T23:21:35.245566+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:26.311810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509645+0000","last_change":"2024-09-10T23:21:33.261203+0000","last_active":"2024-09-10T23:21:35.509645+0000","last_peered":"2024-09-10T23:21:35.509645+0000","last_clean":"2024-09-10T23:21:35.509645+0000","last_became_active":"2024-09-10T23:21:33.260947+0000","last_became_peered":"2024-09-10T23:21:33.260947+0000","last_unstale":"2024-09-10T23:21:35.509645+0000","last_undegraded":"2024-09-10T23:21:35.509645+0000","last_fullsized":"2024-09-10T23:21:35.509645+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:07.565251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.510319+0000","last_change":"2024-09-10T23:21:34.261277+0000","last_active":"2024-09-10T23:21:35.510319+0000","last_peered":"2024-09-10T23:21:35.510319+0000","last_clean":"2024-09-10T23:21:35.510319+0000","last_became_active":"2024-09-10T23:21:34.261014+0000","last_became_peered":"2024-09-10T23:21:34.261014+0000","last_unstale":"2024-09-10T23:21:35.510319+0000","last_undegraded":"2024-09-10T23:21:35.510319+0000","last_fullsized":"2024-09-10T23:21:35.510319+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:38.898955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.272347+0000","last_change":"2024-09-10T23:21:33.261566+0000","last_active":"2024-09-10T23:21:34.272347+0000","last_peered":"2024-09-10T23:21:34.272347+0000","last_clean":"2024-09-10T23:21:34.272347+0000","last_became_active":"2024-09-10T23:21:33.261275+0000","last_became_peered":"2024-09-10T23:21:33.261275+0000","last_unstale":"2024-09-10T23:21:34.272347+0000","last_undegraded":"2024-09-10T23:21:34.272347+0000","last_fullsized":"2024-09-10T23:21:34.272347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:32:25.287249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253466+0000","last_change":"2024-09-10T23:21:34.258340+0000","last_active":"2024-09-10T23:21:35.253466+0000","last_peered":"2024-09-10T23:21:35.253466+0000","last_clean":"2024-09-10T23:21:35.253466+0000","last_became_active":"2024-09-10T23:21:34.257642+0000","last_became_peered":"2024-09-10T23:21:34.257642+0000","last_unstale":"2024-09-10T23:21:35.253466+0000","last_undegraded":"2024-09-10T23:21:35.253466+0000","last_fullsized":"2024-09-10T23:21:35.253466+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:20.245247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253785+0000","last_change":"2024-09-10T23:21:33.261503+0000","last_active":"2024-09-10T23:21:35.253785+0000","last_peered":"2024-09-10T23:21:35.253785+0000","last_clean":"2024-09-10T23:21:35.253785+0000","last_became_active":"2024-09-10T23:21:33.261240+0000","last_became_peered":"2024-09-10T23:21:33.261240+0000","last_unstale":"2024-09-10T23:21:35.253785+0000","last_undegraded":"2024-09-10T23:21:35.253785+0000","last_fullsized":"2024-09-10T23:21:35.253785+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:29:28.290890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.244752+0000","last_change":"2024-09-10T23:21:34.286635+0000","last_active":"2024-09-10T23:21:35.244752+0000","last_peered":"2024-09-10T23:21:35.244752+0000","last_clean":"2024-09-10T23:21:35.244752+0000","last_became_active":"2024-09-10T23:21:34.286341+0000","last_became_peered":"2024-09-10T23:21:34.286341+0000","last_unstale":"2024-09-10T23:21:35.244752+0000","last_undegraded":"2024-09-10T23:21:35.244752+0000","last_fullsized":"2024-09-10T23:21:35.244752+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:10.593643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.280770+0000","last_change":"2024-09-10T23:21:33.266293+0000","last_active":"2024-09-10T23:21:34.280770+0000","last_peered":"2024-09-10T23:21:34.280770+0000","last_clean":"2024-09-10T23:21:34.280770+0000","last_became_active":"2024-09-10T23:21:33.264833+0000","last_became_peered":"2024-09-10T23:21:33.264833+0000","last_unstale":"2024-09-10T23:21:34.280770+0000","last_undegraded":"2024-09-10T23:21:34.280770+0000","last_fullsized":"2024-09-10T23:21:34.280770+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:47.006460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283195+0000","last_change":"2024-09-10T23:21:34.281114+0000","last_active":"2024-09-10T23:21:34.283195+0000","last_peered":"2024-09-10T23:21:34.283195+0000","last_clean":"2024-09-10T23:21:34.283195+0000","last_became_active":"2024-09-10T23:21:34.280824+0000","last_became_peered":"2024-09-10T23:21:34.280824+0000","last_unstale":"2024-09-10T23:21:34.283195+0000","last_undegraded":"2024-09-10T23:21:34.283195+0000","last_fullsized":"2024-09-10T23:21:34.283195+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:27:55.449397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.252390+0000","last_change":"2024-09-10T23:21:33.259401+0000","last_active":"2024-09-10T23:21:34.252390+0000","last_peered":"2024-09-10T23:21:34.252390+0000","last_clean":"2024-09-10T23:21:34.252390+0000","last_became_active":"2024-09-10T23:21:33.259155+0000","last_became_peered":"2024-09-10T23:21:33.259155+0000","last_unstale":"2024-09-10T23:21:34.252390+0000","last_undegraded":"2024-09-10T23:21:34.252390+0000","last_fullsized":"2024-09-10T23:21:34.252390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:22.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.285628+0000","last_change":"2024-09-10T23:21:34.283672+0000","last_active":"2024-09-10T23:21:34.285628+0000","last_peered":"2024-09-10T23:21:34.285628+0000","last_clean":"2024-09-10T23:21:34.285628+0000","last_became_active":"2024-09-10T23:21:34.283407+0000","last_became_peered":"2024-09-10T23:21:34.283407+0000","last_unstale":"2024-09-10T23:21:34.285628+0000","last_undegraded":"2024-09-10T23:21:34.285628+0000","last_fullsized":"2024-09-10T23:21:34.285628+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:48.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.252563+0000","last_change":"2024-09-10T23:21:33.271627+0000","last_active":"2024-09-10T23:21:34.252563+0000","last_peered":"2024-09-10T23:21:34.252563+0000","last_clean":"2024-09-10T23:21:34.252563+0000","last_became_active":"2024-09-10T23:21:33.271333+0000","last_became_peered":"2024-09-10T23:21:33.271333+0000","last_unstale":"2024-09-10T23:21:34.252563+0000","last_undegraded":"2024-09-10T23:21:34.252563+0000","last_fullsized":"2024-09-10T23:21:34.252563+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:40.172440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245260+0000","last_change":"2024-09-10T23:21:34.259501+0000","last_active":"2024-09-10T23:21:35.245260+0000","last_peered":"2024-09-10T23:21:35.245260+0000","last_clean":"2024-09-10T23:21:35.245260+0000","last_became_active":"2024-09-10T23:21:34.259234+0000","last_became_peered":"2024-09-10T23:21:34.259234+0000","last_unstale":"2024-09-10T23:21:35.245260+0000","last_undegraded":"2024-09-10T23:21:35.245260+0000","last_fullsized":"2024-09-10T23:21:35.245260+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:03.692821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.252804+0000","last_change":"2024-09-10T23:21:33.256559+0000","last_active":"2024-09-10T23:21:34.252804+0000","last_peered":"2024-09-10T23:21:34.252804+0000","last_clean":"2024-09-10T23:21:34.252804+0000","last_became_active":"2024-09-10T23:21:33.256063+0000","last_became_peered":"2024-09-10T23:21:33.256063+0000","last_unstale":"2024-09-10T23:21:34.252804+0000","last_undegraded":"2024-09-10T23:21:34.252804+0000","last_fullsized":"2024-09-10T23:21:34.252804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:28.414329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.510064+0000","last_change":"2024-09-10T23:21:34.261005+0000","last_active":"2024-09-10T23:21:35.510064+0000","last_peered":"2024-09-10T23:21:35.510064+0000","last_clean":"2024-09-10T23:21:35.510064+0000","last_became_active":"2024-09-10T23:21:34.260730+0000","last_became_peered":"2024-09-10T23:21:34.260730+0000","last_unstale":"2024-09-10T23:21:35.510064+0000","last_undegraded":"2024-09-10T23:21:35.510064+0000","last_fullsized":"2024-09-10T23:21:35.510064+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:54.796451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"102'2","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.274609+0000","last_change":"2024-09-10T23:21:33.257985+0000","last_active":"2024-09-10T23:21:34.274609+0000","last_peered":"2024-09-10T23:21:34.274609+0000","last_clean":"2024-09-10T23:21:34.274609+0000","last_became_active":"2024-09-10T23:21:33.257645+0000","last_became_peered":"2024-09-10T23:21:33.257645+0000","last_unstale":"2024-09-10T23:21:34.274609+0000","last_undegraded":"2024-09-10T23:21:34.274609+0000","last_fullsized":"2024-09-10T23:21:34.274609+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:40.839492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245687+0000","last_change":"2024-09-10T23:21:34.250450+0000","last_active":"2024-09-10T23:21:35.245687+0000","last_peered":"2024-09-10T23:21:35.245687+0000","last_clean":"2024-09-10T23:21:35.245687+0000","last_became_active":"2024-09-10T23:21:34.250142+0000","last_became_peered":"2024-09-10T23:21:34.250142+0000","last_unstale":"2024-09-10T23:21:35.245687+0000","last_undegraded":"2024-09-10T23:21:35.245687+0000","last_fullsized":"2024-09-10T23:21:35.245687+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:21.533536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253583+0000","last_change":"2024-09-10T23:21:33.260352+0000","last_active":"2024-09-10T23:21:35.253583+0000","last_peered":"2024-09-10T23:21:35.253583+0000","last_clean":"2024-09-10T23:21:35.253583+0000","last_became_active":"2024-09-10T23:21:33.259923+0000","last_became_peered":"2024-09-10T23:21:33.259923+0000","last_unstale":"2024-09-10T23:21:35.253583+0000","last_undegraded":"2024-09-10T23:21:35.253583+0000","last_fullsized":"2024-09-10T23:21:35.253583+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:41:30.869717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245952+0000","last_change":"2024-09-10T23:21:34.257048+0000","last_active":"2024-09-10T23:21:35.245952+0000","last_peered":"2024-09-10T23:21:35.245952+0000","last_clean":"2024-09-10T23:21:35.245952+0000","last_became_active":"2024-09-10T23:21:34.256763+0000","last_became_peered":"2024-09-10T23:21:34.256763+0000","last_unstale":"2024-09-10T23:21:35.245952+0000","last_undegraded":"2024-09-10T23:21:35.245952+0000","last_fullsized":"2024-09-10T23:21:35.245952+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:36.234595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.253830+0000","last_change":"2024-09-10T23:21:33.270472+0000","last_active":"2024-09-10T23:21:35.253830+0000","last_peered":"2024-09-10T23:21:35.253830+0000","last_clean":"2024-09-10T23:21:35.253830+0000","last_became_active":"2024-09-10T23:21:33.270105+0000","last_became_peered":"2024-09-10T23:21:33.270105+0000","last_unstale":"2024-09-10T23:21:35.253830+0000","last_undegraded":"2024-09-10T23:21:35.253830+0000","last_fullsized":"2024-09-10T23:21:35.253830+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:07.801838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.260425+0000","last_change":"2024-09-10T23:21:34.258801+0000","last_active":"2024-09-10T23:21:34.260425+0000","last_peered":"2024-09-10T23:21:34.260425+0000","last_clean":"2024-09-10T23:21:34.260425+0000","last_became_active":"2024-09-10T23:21:34.258413+0000","last_became_peered":"2024-09-10T23:21:34.258413+0000","last_unstale":"2024-09-10T23:21:34.260425+0000","last_undegraded":"2024-09-10T23:21:34.260425+0000","last_fullsized":"2024-09-10T23:21:34.260425+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:32.563939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.510168+0000","last_change":"2024-09-10T23:21:33.263766+0000","last_active":"2024-09-10T23:21:35.510168+0000","last_peered":"2024-09-10T23:21:35.510168+0000","last_clean":"2024-09-10T23:21:35.510168+0000","last_became_active":"2024-09-10T23:21:33.263481+0000","last_became_peered":"2024-09-10T23:21:33.263481+0000","last_unstale":"2024-09-10T23:21:35.510168+0000","last_undegraded":"2024-09-10T23:21:35.510168+0000","last_fullsized":"2024-09-10T23:21:35.510168+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:15:28.086014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.273247+0000","last_change":"2024-09-10T23:21:34.270283+0000","last_active":"2024-09-10T23:21:34.273247+0000","last_peered":"2024-09-10T23:21:34.273247+0000","last_clean":"2024-09-10T23:21:34.273247+0000","last_became_active":"2024-09-10T23:21:34.269976+0000","last_became_peered":"2024-09-10T23:21:34.269976+0000","last_unstale":"2024-09-10T23:21:34.273247+0000","last_undegraded":"2024-09-10T23:21:34.273247+0000","last_fullsized":"2024-09-10T23:21:34.273247+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:54.801814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245497+0000","last_change":"2024-09-10T23:21:33.266627+0000","last_active":"2024-09-10T23:21:35.245497+0000","last_peered":"2024-09-10T23:21:35.245497+0000","last_clean":"2024-09-10T23:21:35.245497+0000","last_became_active":"2024-09-10T23:21:33.264746+0000","last_became_peered":"2024-09-10T23:21:33.264746+0000","last_unstale":"2024-09-10T23:21:35.245497+0000","last_undegraded":"2024-09-10T23:21:35.245497+0000","last_fullsized":"2024-09-10T23:21:35.245497+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:27.877507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.506492+0000","last_change":"2024-09-10T23:21:34.280608+0000","last_active":"2024-09-10T23:21:35.506492+0000","last_peered":"2024-09-10T23:21:35.506492+0000","last_clean":"2024-09-10T23:21:35.506492+0000","last_became_active":"2024-09-10T23:21:34.280333+0000","last_became_peered":"2024-09-10T23:21:34.280333+0000","last_unstale":"2024-09-10T23:21:35.506492+0000","last_undegraded":"2024-09-10T23:21:35.506492+0000","last_fullsized":"2024-09-10T23:21:35.506492+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:54.540422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.252793+0000","last_change":"2024-09-10T23:21:33.265168+0000","last_active":"2024-09-10T23:21:34.252793+0000","last_peered":"2024-09-10T23:21:34.252793+0000","last_clean":"2024-09-10T23:21:34.252793+0000","last_became_active":"2024-09-10T23:21:33.264848+0000","last_became_peered":"2024-09-10T23:21:33.264848+0000","last_unstale":"2024-09-10T23:21:34.252793+0000","last_undegraded":"2024-09-10T23:21:34.252793+0000","last_fullsized":"2024-09-10T23:21:34.252793+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:31.611549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509076+0000","last_change":"2024-09-10T23:21:34.282830+0000","last_active":"2024-09-10T23:21:35.509076+0000","last_peered":"2024-09-10T23:21:35.509076+0000","last_clean":"2024-09-10T23:21:35.509076+0000","last_became_active":"2024-09-10T23:21:34.282559+0000","last_became_peered":"2024-09-10T23:21:34.282559+0000","last_unstale":"2024-09-10T23:21:35.509076+0000","last_undegraded":"2024-09-10T23:21:35.509076+0000","last_fullsized":"2024-09-10T23:21:35.509076+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:53.376765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.509638+0000","last_change":"2024-09-10T23:21:33.263189+0000","last_active":"2024-09-10T23:21:35.509638+0000","last_peered":"2024-09-10T23:21:35.509638+0000","last_clean":"2024-09-10T23:21:35.509638+0000","last_became_active":"2024-09-10T23:21:33.262903+0000","last_became_peered":"2024-09-10T23:21:33.262903+0000","last_unstale":"2024-09-10T23:21:35.509638+0000","last_undegraded":"2024-09-10T23:21:35.509638+0000","last_fullsized":"2024-09-10T23:21:35.509638+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:45.236462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-10T23:21:35.245519+0000","last_change":"2024-09-10T23:21:34.280139+0000","last_active":"2024-09-10T23:21:35.245519+0000","last_peered":"2024-09-10T23:21:35.245519+0000","last_clean":"2024-09-10T23:21:35.245519+0000","last_became_active":"2024-09-10T23:21:34.279872+0000","last_became_peered":"2024-09-10T23:21:34.279872+0000","last_unstale":"2024-09-10T23:21:35.245519+0000","last_undegraded":"2024-09-10T23:21:35.245519+0000","last_fullsized":"2024-09-10T23:21:35.245519+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:35.511797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.255235+0000","last_change":"2024-09-10T23:21:33.261869+0000","last_active":"2024-09-10T23:21:34.255235+0000","last_peered":"2024-09-10T23:21:34.255235+0000","last_clean":"2024-09-10T23:21:34.255235+0000","last_became_active":"2024-09-10T23:21:33.261602+0000","last_became_peered":"2024-09-10T23:21:33.261602+0000","last_unstale":"2024-09-10T23:21:34.255235+0000","last_undegraded":"2024-09-10T23:21:34.255235+0000","last_fullsized":"2024-09-10T23:21:34.255235+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:47.937311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.283064+0000","last_change":"2024-09-10T23:21:34.282155+0000","last_active":"2024-09-10T23:21:34.283064+0000","last_peered":"2024-09-10T23:21:34.283064+0000","last_clean":"2024-09-10T23:21:34.283064+0000","last_became_active":"2024-09-10T23:21:34.281902+0000","last_became_peered":"2024-09-10T23:21:34.281902+0000","last_unstale":"2024-09-10T23:21:34.283064+0000","last_undegraded":"2024-09-10T23:21:34.283064+0000","last_fullsized":"2024-09-10T23:21:34.283064+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:33.232168+0000","last_clean_scrub_stamp":"2024-09-10T23:21:33.232168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:17.718036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.277911+0000","last_change":"2024-09-10T23:21:33.257042+0000","last_active":"2024-09-10T23:21:34.277911+0000","last_peered":"2024-09-10T23:21:34.277911+0000","last_clean":"2024-09-10T23:21:34.277911+0000","last_became_active":"2024-09-10T23:21:33.256777+0000","last_became_peered":"2024-09-10T23:21:33.256777+0000","last_unstale":"2024-09-10T23:21:34.277911+0000","last_undegraded":"2024-09-10T23:21:34.277911+0000","last_fullsized":"2024-09-10T23:21:34.277911+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:21:32.228720+0000","last_clean_scrub_stamp":"2024-09-10T23:21:32.228720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:06.913135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":254,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-10T23:21:34.255317+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:21:34.255317+0000","last_peered":"2024-09-10T23:21:34.255317+0000","last_clean":"2024-09-10T23:21:34.255317+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:21:34.255317+0000","last_undegraded":"2024-09-10T23:21:34.255317+0000","last_fullsized":"2024-09-10T23:21:34.255317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476813,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44928,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326912,"statfs":{"total":96636764160,"available":96590757888,"internally_reserved":0,"allocated":1282048,"data_stored":589147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509518,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51048,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320792,"statfs":{"total":96636764160,"available":96584491008,"internally_reserved":0,"allocated":1851392,"data_stored":1170663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509517,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40728,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331112,"statfs":{"total":96636764160,"available":96595058688,"internally_reserved":0,"allocated":1249280,"data_stored":580239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509518,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46312,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325528,"statfs":{"total":96636764160,"available":96589340672,"internally_reserved":0,"allocated":1257472,"data_stored":580399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1249280,"data_stored":580239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40732,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331108,"statfs":{"total":96636764160,"available":96595054592,"internally_reserved":0,"allocated":1253376,"data_stored":580309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55240,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316600,"statfs":{"total":96636764160,"available":96580198400,"internally_reserved":0,"allocated":1880064,"data_stored":1179617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50476,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321364,"statfs":{"total":96636764160,"available":96585076736,"internally_reserved":0,"allocated":1261568,"data_stored":586931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:21:38.814 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:21:38.814 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:21:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 -- 172.21.15.17:0/1935137848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3980d2260 msgr2=0x7fb3980b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 --2- 172.21.15.17:0/1935137848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3980d2260 0x7fb3980b50e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb388009900 tx=0x7fb38801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 -- 172.21.15.17:0/1935137848 shutdown_connections 2024-09-10T23:21:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 --2- 172.21.15.17:0/1935137848 >> v2:172.21.15.77:3300/0 conn(0x7fb3980d2640 0x7fb3980b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 --2- 172.21.15.17:0/1935137848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3980d2260 0x7fb3980b50e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 -- 172.21.15.17:0/1935137848 >> 172.21.15.17:0/1935137848 conn(0x7fb39809d0f0 msgr2=0x7fb3980d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 -- 172.21.15.17:0/1935137848 shutdown_connections 2024-09-10T23:21:39.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 -- 172.21.15.17:0/1935137848 wait complete. 2024-09-10T23:21:39.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 Processor -- start 2024-09-10T23:21:39.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.000+0000 7fb39da00640 1 -- start start 2024-09-10T23:21:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39da00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3980d2260 0x7fb3981fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39da00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3980d2640 0x7fb3981f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3980d46d0 0x7fb398154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:39.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39da00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb3980b2a60 con 0x7fb3980d46d0 2024-09-10T23:21:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39da00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb3980b28e0 con 0x7fb3980d2260 2024-09-10T23:21:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39da00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb3980b2be0 con 0x7fb3980d2640 2024-09-10T23:21:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3980d46d0 0x7fb398154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3980d46d0 0x7fb398154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60510/0 (socket says 172.21.15.17:60510) 2024-09-10T23:21:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39d000640 1 -- 172.21.15.17:0/1328503379 learned_addr learned my addr 172.21.15.17:0/1328503379 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb397e00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3980d2260 0x7fb3981fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb38f400640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3980d2640 0x7fb3981f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39d000640 1 -- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3980d2640 msgr2=0x7fb3981f7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39d000640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3980d2640 0x7fb3981f7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39d000640 1 -- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3980d2260 msgr2=0x7fb3981fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39d000640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3980d2260 0x7fb3981fa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39d000640 1 -- 172.21.15.17:0/1328503379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3981551b0 con 0x7fb3980d46d0 2024-09-10T23:21:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39d000640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3980d46d0 0x7fb398154c70 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fb39000efd0 tx=0x7fb39000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:39.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb394c00640 1 -- 172.21.15.17:0/1328503379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390003b80 con 0x7fb3980d46d0 2024-09-10T23:21:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb394c00640 1 -- 172.21.15.17:0/1328503379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb390003d20 con 0x7fb3980d46d0 2024-09-10T23:21:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb394c00640 1 -- 172.21.15.17:0/1328503379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390004280 con 0x7fb3980d46d0 2024-09-10T23:21:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3981fad40 con 0x7fb3980d46d0 2024-09-10T23:21:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3981fb300 con 0x7fb3980d46d0 2024-09-10T23:21:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3980b50e0 con 0x7fb3980d46d0 2024-09-10T23:21:39.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.004+0000 7fb394c00640 1 -- 172.21.15.17:0/1328503379 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb390004420 con 0x7fb3980d46d0 2024-09-10T23:21:39.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.008+0000 7fb394c00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3740725e0 0x7fb374074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:39.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.008+0000 7fb394c00640 1 -- 172.21.15.17:0/1328503379 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fb3900940e0 con 0x7fb3980d46d0 2024-09-10T23:21:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.008+0000 7fb397e00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3740725e0 0x7fb374074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:39.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.008+0000 7fb397e00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3740725e0 0x7fb374074aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb3880af000 tx=0x7fb38801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:39.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.012+0000 7fb394c00640 1 -- 172.21.15.17:0/1328503379 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb39005ef40 con 0x7fb3980d46d0 2024-09-10T23:21:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.248+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb3980d0f50 con 0x7fb3980d46d0 2024-09-10T23:21:39.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb394c00640 1 -- 172.21.15.17:0/1328503379 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7fb390063970 con 0x7fb3980d46d0 2024-09-10T23:21:39.257 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:21:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:21:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:21:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:21:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:21:39.257 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:21:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3740725e0 msgr2=0x7fb374074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3740725e0 0x7fb374074aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb3880af000 tx=0x7fb38801b120 comp rx=0 tx=0).stop 2024-09-10T23:21:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3980d46d0 msgr2=0x7fb398154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3980d46d0 0x7fb398154c70 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fb39000efd0 tx=0x7fb39000c6a0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 shutdown_connections 2024-09-10T23:21:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3740725e0 0x7fb374074aa0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3980d46d0 0x7fb398154c70 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3980d2640 0x7fb3981f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 --2- 172.21.15.17:0/1328503379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3980d2260 0x7fb3981fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 >> 172.21.15.17:0/1328503379 conn(0x7fb39809d0f0 msgr2=0x7fb3980cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 shutdown_connections 2024-09-10T23:21:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.252+0000 7fb39da00640 1 -- 172.21.15.17:0/1328503379 wait complete. 2024-09-10T23:21:39.278 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 -- 172.21.15.17:0/3221965618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88201550b0 msgr2=0x7f88200b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 --2- 172.21.15.17:0/3221965618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88201550b0 0x7f88200b3e10 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f8810009900 tx=0x7f881001c820 comp rx=0 tx=0).stop 2024-09-10T23:21:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 -- 172.21.15.17:0/3221965618 shutdown_connections 2024-09-10T23:21:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 --2- 172.21.15.17:0/3221965618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88201550b0 0x7f88200b3e10 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 -- 172.21.15.17:0/3221965618 >> 172.21.15.17:0/3221965618 conn(0x7f882006cfc0 msgr2=0x7f882006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 -- 172.21.15.17:0/3221965618 shutdown_connections 2024-09-10T23:21:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 -- 172.21.15.17:0/3221965618 wait complete. 2024-09-10T23:21:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 Processor -- start 2024-09-10T23:21:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 -- start start 2024-09-10T23:21:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88200b3870 0x7f882014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88200b4350 0x7f8820141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88201550b0 0x7f8820150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8820168a40 con 0x7f88200b3870 2024-09-10T23:21:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88201688c0 con 0x7f88201550b0 2024-09-10T23:21:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8826200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8820168bc0 con 0x7f88200b4350 2024-09-10T23:21:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f881f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88200b3870 0x7f882014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:39.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f881f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88200b3870 0x7f882014b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60524/0 (socket says 172.21.15.17:60524) 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f881f400640 1 -- 172.21.15.17:0/1863560682 learned_addr learned my addr 172.21.15.17:0/1863560682 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f881fe00640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88201550b0 0x7f8820150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.420+0000 7f8817e00640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88200b4350 0x7f8820141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f881f400640 1 -- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88200b4350 msgr2=0x7f8820141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f881f400640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88200b4350 0x7f8820141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f881f400640 1 -- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88201550b0 msgr2=0x7f8820150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f881f400640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88201550b0 0x7f8820150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f881f400640 1 -- 172.21.15.17:0/1863560682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88201f9360 con 0x7f88200b3870 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f8817e00640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88200b4350 0x7f8820141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f881f400640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88200b3870 0x7f882014b630 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8810009850 tx=0x7f88100040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:39.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f8817400640 1 -- 172.21.15.17:0/1863560682 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88100b2040 con 0x7f88200b3870 2024-09-10T23:21:39.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f8817400640 1 -- 172.21.15.17:0/1863560682 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8810003600 con 0x7f88200b3870 2024-09-10T23:21:39.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88201f9640 con 0x7f88200b3870 2024-09-10T23:21:39.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f8817400640 1 -- 172.21.15.17:0/1863560682 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810003a10 con 0x7f88200b3870 2024-09-10T23:21:39.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88201f9c00 con 0x7f88200b3870 2024-09-10T23:21:39.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88200b3e10 con 0x7f88200b3870 2024-09-10T23:21:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f8817400640 1 -- 172.21.15.17:0/1863560682 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8810003bb0 con 0x7f88200b3870 2024-09-10T23:21:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.424+0000 7f8817400640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87fc072610 0x7f87fc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.428+0000 7f8817400640 1 -- 172.21.15.17:0/1863560682 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f881012cfd0 con 0x7f88200b3870 2024-09-10T23:21:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.428+0000 7f8817e00640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87fc072610 0x7f87fc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:39.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.428+0000 7f8817e00640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87fc072610 0x7f87fc074ad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88200b2f10 tx=0x7f8808009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.432+0000 7f8817400640 1 -- 172.21.15.17:0/1863560682 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f88100164d0 con 0x7f88200b3870 2024-09-10T23:21:39.492 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:21:39.488+0000 7fb242600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:21:39.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.640+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f882014fdc0 con 0x7f88200b3870 2024-09-10T23:21:39.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8817400640 1 -- 172.21.15.17:0/1863560682 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5216 (secure 0 0 0) 0x7f88100f8490 con 0x7f88200b3870 2024-09-10T23:21:39.648 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:39.648 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":71,"btime":"2024-09-10T23:21:37:272327+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/662650354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":662650354},{"type":"v1","addr":"172.21.15.77:6837","nonce":662650354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1343355687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1343355687},{"type":"v1","addr":"172.21.15.77:6836","nonce":1343355687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1438697787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1438697787},{"type":"v1","addr":"172.21.15.17:6834","nonce":1438697787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:36.672500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7350":{"gid":7350,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/70051217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":70051217},{"type":"v1","addr":"172.21.15.17:6835","nonce":70051217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7350,"qdb_cluster":[7350]},"id":6}]} 2024-09-10T23:21:39.648 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 71 2024-09-10T23:21:39.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87fc072610 msgr2=0x7f87fc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87fc072610 0x7f87fc074ad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f88200b2f10 tx=0x7f8808009040 comp rx=0 tx=0).stop 2024-09-10T23:21:39.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88200b3870 msgr2=0x7f882014b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:39.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88200b3870 0x7f882014b630 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8810009850 tx=0x7f88100040c0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 shutdown_connections 2024-09-10T23:21:39.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87fc072610 0x7f87fc074ad0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88201550b0 0x7f8820150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88200b4350 0x7f8820141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 --2- 172.21.15.17:0/1863560682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88200b3870 0x7f882014b630 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:39.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 >> 172.21.15.17:0/1863560682 conn(0x7f882006cfc0 msgr2=0x7f8820151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:39.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 shutdown_connections 2024-09-10T23:21:39.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:39.644+0000 7f8826200640 1 -- 172.21.15.17:0/1863560682 wait complete. 2024-09-10T23:21:40.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:21:33.653384+0000', 'modified': '2024-09-10T23:21:36.672500+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7350}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7350': {'gid': 7350, 'name': 'c', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/70051217', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 70051217}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 70051217}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7350, 'qdb_cluster': [7350]} 2024-09-10T23:21:40.073 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:21:40.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:21:40.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 -- 172.21.15.17:0/1483762006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2bc003ba0 msgr2=0x7fa2bc003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 --2- 172.21.15.17:0/1483762006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2bc003ba0 0x7fa2bc003f80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8001860 tx=0x7fa2c801c920 comp rx=0 tx=0).stop 2024-09-10T23:21:40.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 -- 172.21.15.17:0/1483762006 shutdown_connections 2024-09-10T23:21:40.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 --2- 172.21.15.17:0/1483762006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2bc003ba0 0x7fa2bc003f80 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 -- 172.21.15.17:0/1483762006 >> 172.21.15.17:0/1483762006 conn(0x7fa2d80d1d60 msgr2=0x7fa2d80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:40.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 -- 172.21.15.17:0/1483762006 shutdown_connections 2024-09-10T23:21:40.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 -- 172.21.15.17:0/1483762006 wait complete. 2024-09-10T23:21:40.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 Processor -- start 2024-09-10T23:21:40.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 -- start start 2024-09-10T23:21:40.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2bc003ba0 0x7fa2d80c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d81e99d0 0x7fa2d80c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d80c88a0 0x7fa2d8151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d80afa50 con 0x7fa2d81e99d0 2024-09-10T23:21:40.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d80af8d0 con 0x7fa2d80c88a0 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2dd800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d80afbd0 con 0x7fa2bc003ba0 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d81e99d0 0x7fa2d80c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d81e99d0 0x7fa2d80c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60538/0 (socket says 172.21.15.17:60538) 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2cfe00640 1 -- 172.21.15.17:0/55629092 learned_addr learned my addr 172.21.15.17:0/55629092 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2bc003ba0 0x7fa2d80c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2cfe00640 1 -- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2bc003ba0 msgr2=0x7fa2d80c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2bc003ba0 0x7fa2d80c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2cfe00640 1 -- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d80c88a0 msgr2=0x7fa2d8151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2d7400640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d80c88a0 0x7fa2d8151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d80c88a0 0x7fa2d8151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2cfe00640 1 -- 172.21.15.17:0/55629092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d81f8530 con 0x7fa2d81e99d0 2024-09-10T23:21:40.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2bc003ba0 0x7fa2d80c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:40.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.220+0000 7fa2d7400640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d80c88a0 0x7fa2d8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:40.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.224+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d81e99d0 0x7fa2d80c8360 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006630 tx=0x7fa2c00039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:40.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.224+0000 7fa2cea00640 1 -- 172.21.15.17:0/55629092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0015070 con 0x7fa2d81e99d0 2024-09-10T23:21:40.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.224+0000 7fa2cea00640 1 -- 172.21.15.17:0/55629092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2c0011840 con 0x7fa2d81e99d0 2024-09-10T23:21:40.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.224+0000 7fa2cea00640 1 -- 172.21.15.17:0/55629092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0011c90 con 0x7fa2d81e99d0 2024-09-10T23:21:40.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.224+0000 7fa2dd800640 1 -- 172.21.15.17:0/55629092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d81f79b0 con 0x7fa2d81e99d0 2024-09-10T23:21:40.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.224+0000 7fa2dd800640 1 -- 172.21.15.17:0/55629092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d81f8250 con 0x7fa2d81e99d0 2024-09-10T23:21:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.224+0000 7fa2cea00640 1 -- 172.21.15.17:0/55629092 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa2c00103c0 con 0x7fa2d81e99d0 2024-09-10T23:21:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.224+0000 7fa2cea00640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2b40725e0 0x7fa2b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.224+0000 7fa2cea00640 1 -- 172.21.15.17:0/55629092 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fa2c00943d0 con 0x7fa2d81e99d0 2024-09-10T23:21:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 Processor -- start 2024-09-10T23:21:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2b40725e0 0x7fa2b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- start start 2024-09-10T23:21:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4130bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc412bf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2b40725e0 0x7fa2b4074aa0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8001830 tx=0x7fa2c80a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc412c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc411e03f0 con 0x55bc4130b9d0 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bc4111db20 con 0x55bc412bfe10 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55bc4110cf50 con 0x55bc4130c2f0 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4130bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4130bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60554/0 (socket says 172.21.15.17:60554) 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 -- 172.21.15.17:0/1388725626 learned_addr learned my addr 172.21.15.17:0/1388725626 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d7400640 1 --2- 172.21.15.17:0/1388725626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc412c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/1388725626 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc412bf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 -- 172.21.15.17:0/1388725626 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 msgr2=0x55bc412bf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/1388725626 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc412bf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 -- 172.21.15.17:0/1388725626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 msgr2=0x55bc412c01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/1388725626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc412c01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 -- 172.21.15.17:0/1388725626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc410d4590 con 0x55bc4130b9d0 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/1388725626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4130bdb0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fa2c801c750 tx=0x7fa2c801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c9c186d65c171a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2c7400640 1 -- 172.21.15.17:0/1388725626 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80bb070 con 0x55bc4130b9d0 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2c7400640 1 -- 172.21.15.17:0/1388725626 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2c80c7070 con 0x55bc4130b9d0 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2c7400640 1 -- 172.21.15.17:0/1388725626 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8004e20 con 0x55bc4130b9d0 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1388725626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 msgr2=0x55bc4130bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1388725626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4130bdb0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fa2c801c750 tx=0x7fa2c801c920 comp rx=0 tx=0).stop 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1388725626 shutdown_connections 2024-09-10T23:21:40.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1388725626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc412c01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1388725626 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc412bf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1388725626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4130bdb0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1388725626 >> 172.21.15.17:0/1388725626 conn(0x55bc411a9130 msgr2=0x55bc412eee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1388725626 shutdown_connections 2024-09-10T23:21:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1388725626 wait complete. 2024-09-10T23:21:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.228+0000 7fa2e0cf0000 1 -- start start 2024-09-10T23:21:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 Processor -- start 2024-09-10T23:21:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc412c1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc412c1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc412c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc410a75d0 con 0x55bc4130b9d0 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bc41110d60 con 0x55bc412bfe10 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55bc410b3500 con 0x55bc4130c2f0 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 10 client.0 _ll_register_callbacks cb 0x55bc410b7810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc412c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc412c1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60560/0 (socket says 172.21.15.17:60560) 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2cfe00640 1 -- 172.21.15.17:0/539791550 learned_addr learned my addr 172.21.15.17:0/539791550 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc412c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2d7400640 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc412c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2cfe00640 1 -- 172.21.15.17:0/539791550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 msgr2=0x55bc412c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc412c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2cfe00640 1 -- 172.21.15.17:0/539791550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 msgr2=0x55bc412c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:40.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc412c1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2cfe00640 1 -- 172.21.15.17:0/539791550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc410ab170 con 0x55bc4130b9d0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc412c1780 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006600 tx=0x7fa2c0006730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db43d43f173b4a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2bbe00640 1 -- 172.21.15.17:0/539791550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c001f040 con 0x55bc4130b9d0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2bbe00640 1 -- 172.21.15.17:0/539791550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fa2c00660d0 con 0x55bc4130b9d0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/539791550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc410a50f0 con 0x55bc4130b9d0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2bbe00640 1 -- 172.21.15.17:0/539791550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fa2c0063cf0 con 0x55bc4130b9d0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 10 client.7479 fetch_fsmap learned FSMap version 71 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/539791550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55bc41191ef0 con 0x55bc4130b9d0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2bbe00640 1 -- 172.21.15.17:0/539791550 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55bc410a50f0 con 0x55bc4130b9d0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2bbe00640 1 -- 172.21.15.17:0/539791550 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 71) ==== 3502+0+0 (secure 0 0 0) 0x7fa2c0068280 con 0x55bc4130b9d0 2024-09-10T23:21:40.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 10 client.7479 fetch_fsmap finished waiting for FSMap version 71 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 10 client.7479 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 20 client.7479 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x55bc4131ac70 0x55bc4131d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 4 client.7479 mds_command: new command op to 7350 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/539791550 --> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc4111fa70 con 0x55bc4131ac70 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x55bc4131ac70 0x55bc4131d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x55bc4131ac70 0x55bc4131d060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8285e8d8c0de6982 server_cookie=1842cc98b201c9c4 in_seq=0 out_seq=0 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.232+0000 7fa2bbe00640 10 client.7479 ms_handle_connect on v2:172.21.15.17:6833/70051217 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2bbe00640 1 -- 172.21.15.17:0/539791550 <== mds.0 v2:172.21.15.17:6833/70051217 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc4111fa70 con 0x55bc4131ac70 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2bbe00640 10 client.7479 handle_command_reply: tid=0 2024-09-10T23:21:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 client.7479 shutdown 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/539791550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 msgr2=0x55bc412c1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc412c1780 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006600 tx=0x7fa2c0006730 comp rx=0 tx=0).stop 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/539791550 shutdown_connections 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc412c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x55bc4131ac70 0x55bc4131d060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc412c1780 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/539791550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc412c1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2bbe00640 0 client.7479 ms_handle_reset on v2:172.21.15.17:6833/70051217 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/539791550 >> 172.21.15.17:0/539791550 conn(0x55bc411a9130 msgr2=0x55bc412befd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:40.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/539791550 shutdown_connections 2024-09-10T23:21:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/539791550 wait complete. 2024-09-10T23:21:40.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.236+0000 7fa2e0cf0000 20 client.7479 trim_cache size 0 max 16384 2024-09-10T23:21:40.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 Processor -- start 2024-09-10T23:21:40.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- start start 2024-09-10T23:21:40.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc4137d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4137d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc4137de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d8203890 con 0x55bc4130b9d0 2024-09-10T23:21:40.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d81fb8a0 con 0x55bc412bfe10 2024-09-10T23:21:40.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d8203240 con 0x55bc4130c2f0 2024-09-10T23:21:40.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4137d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4137d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60564/0 (socket says 172.21.15.17:60564) 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2cfe00640 1 -- 172.21.15.17:0/2696076584 learned_addr learned my addr 172.21.15.17:0/2696076584 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/2696076584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc4137d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2d7400640 1 --2- 172.21.15.17:0/2696076584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc4137de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2cfe00640 1 -- 172.21.15.17:0/2696076584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 msgr2=0x55bc4137de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/2696076584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc4137de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2cfe00640 1 -- 172.21.15.17:0/2696076584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 msgr2=0x55bc4137d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/2696076584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc4137d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2cfe00640 1 -- 172.21.15.17:0/2696076584 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc41168d90 con 0x55bc4130b9d0 2024-09-10T23:21:40.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/2696076584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4137d900 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00018f0 tx=0x7fa2c0001000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75dbee1f9c99c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2c6a00640 1 -- 172.21.15.17:0/2696076584 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c001f040 con 0x55bc4130b9d0 2024-09-10T23:21:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2c6a00640 1 -- 172.21.15.17:0/2696076584 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2c0068280 con 0x55bc4130b9d0 2024-09-10T23:21:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2c6a00640 1 -- 172.21.15.17:0/2696076584 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0092320 con 0x55bc4130b9d0 2024-09-10T23:21:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/2696076584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 msgr2=0x55bc4137d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/2696076584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4137d900 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00018f0 tx=0x7fa2c0001000 comp rx=0 tx=0).stop 2024-09-10T23:21:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/2696076584 shutdown_connections 2024-09-10T23:21:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/2696076584 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc4130c2f0 0x55bc4137de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/2696076584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130b9d0 0x55bc4137d900 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/2696076584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc412bfe10 0x55bc4137d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/2696076584 >> 172.21.15.17:0/2696076584 conn(0x55bc411a9130 msgr2=0x55bc41322e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/2696076584 shutdown_connections 2024-09-10T23:21:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/2696076584 wait complete. 2024-09-10T23:21:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 -- start start 2024-09-10T23:21:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.256+0000 7fa2e0cf0000 1 Processor -- start 2024-09-10T23:21:40.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc412bfe10 0x55bc41321a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc4130b9d0 0x55bc4133d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130c2f0 0x55bc4133dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55bc410a75d0 con 0x55bc4130c2f0 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55bc41115390 con 0x55bc4130b9d0 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55bc4111c8f0 con 0x55bc412bfe10 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 10 client.0 _ll_register_callbacks cb 0x7fa2c0011f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130c2f0 0x55bc4133dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130c2f0 0x55bc4133dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60568/0 (socket says 172.21.15.17:60568) 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d7400640 1 -- 172.21.15.17:0/1393456150 learned_addr learned my addr 172.21.15.17:0/1393456150 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc4130b9d0 0x55bc4133d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc412bfe10 0x55bc41321a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d7400640 1 -- 172.21.15.17:0/1393456150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc412bfe10 msgr2=0x55bc41321a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d7400640 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc412bfe10 0x55bc41321a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d7400640 1 -- 172.21.15.17:0/1393456150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc4130b9d0 msgr2=0x55bc4133d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d7400640 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc4130b9d0 0x55bc4133d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d7400640 1 -- 172.21.15.17:0/1393456150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc410d3a90 con 0x55bc4130c2f0 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2cfe00640 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc4130b9d0 0x55bc4133d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d7400640 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130c2f0 0x55bc4133dac0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8074760 tx=0x7fa2d0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced8b0f9ad363948 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 1 -- 172.21.15.17:0/1393456150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0003b80 con 0x55bc4130c2f0 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 1 -- 172.21.15.17:0/1393456150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fa2d0003d20 con 0x55bc4130c2f0 2024-09-10T23:21:40.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1393456150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c0068280 con 0x55bc4130c2f0 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 1 -- 172.21.15.17:0/1393456150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fa2d002a050 con 0x55bc4130c2f0 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 10 client.7485 fetch_fsmap learned FSMap version 71 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1393456150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55bc410b2050 con 0x55bc4130c2f0 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 1 -- 172.21.15.17:0/1393456150 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2c0068280 con 0x55bc4130c2f0 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 1 -- 172.21.15.17:0/1393456150 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 71) ==== 3502+0+0 (secure 0 0 0) 0x7fa2d002d020 con 0x55bc4130c2f0 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 10 client.7485 fetch_fsmap finished waiting for FSMap version 71 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 10 client.7485 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 20 client.7485 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x55bc4133e000 0x55bc41380fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 4 client.7485 mds_command: new command op to 7350 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1393456150 --> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] -- command(tid 0: {"prefix": "status"}) -- 0x55bc4111b520 con 0x55bc4133e000 2024-09-10T23:21:40.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x55bc4133e000 0x55bc41380fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2d6a00640 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x55bc4133e000 0x55bc41380fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84a4871688b4f77 server_cookie=9625f9cf55d1ca0a in_seq=0 out_seq=0 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 10 client.7485 ms_handle_connect on v2:172.21.15.17:6833/70051217 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 1 -- 172.21.15.17:0/1393456150 <== mds.0 v2:172.21.15.17:6833/70051217 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55bc4111b520 con 0x55bc4133e000 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 10 client.7485 handle_command_reply: tid=0 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 client.7485 shutdown 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1393456150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130c2f0 msgr2=0x55bc4133dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130c2f0 0x55bc4133dac0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8074760 tx=0x7fa2d0011810 comp rx=0 tx=0).stop 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1393456150 shutdown_connections 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x55bc4133e000 0x55bc41380fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc4130c2f0 0x55bc4133dac0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bc4130b9d0 0x55bc4133d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2bbe00640 0 client.7485 ms_handle_reset on v2:172.21.15.17:6833/70051217 2024-09-10T23:21:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 --2- 172.21.15.17:0/1393456150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55bc412bfe10 0x55bc41321a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.260+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1393456150 >> 172.21.15.17:0/1393456150 conn(0x55bc411a9130 msgr2=0x55bc412bf470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1393456150 shutdown_connections 2024-09-10T23:21:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2e0cf0000 1 -- 172.21.15.17:0/1393456150 wait complete. 2024-09-10T23:21:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2e0cf0000 20 client.7485 trim_cache size 0 max 16384 2024-09-10T23:21:40.276 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:21:40.276 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:21:40.276 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7350, 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.0263973240000004, 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 71, 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 103, 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 103, 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 11.208790756000001 2024-09-10T23:21:40.277 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:21:40.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 -- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2b40725e0 msgr2=0x7fa2b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2b40725e0 0x7fa2b4074aa0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8001830 tx=0x7fa2c80a7040 comp rx=0 tx=0).stop 2024-09-10T23:21:40.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 -- 172.21.15.17:0/55629092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d81e99d0 msgr2=0x7fa2d80c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d81e99d0 0x7fa2d80c8360 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0006630 tx=0x7fa2c00039d0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 -- 172.21.15.17:0/55629092 shutdown_connections 2024-09-10T23:21:40.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2b40725e0 0x7fa2b4074aa0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2d80c88a0 0x7fa2d8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2d81e99d0 0x7fa2d80c8360 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 --2- 172.21.15.17:0/55629092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2bc003ba0 0x7fa2d80c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 -- 172.21.15.17:0/55629092 >> 172.21.15.17:0/55629092 conn(0x7fa2d80d1d60 msgr2=0x7fa2d815ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 -- 172.21.15.17:0/55629092 shutdown_connections 2024-09-10T23:21:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.264+0000 7fa2dd800640 1 -- 172.21.15.17:0/55629092 wait complete. 2024-09-10T23:21:40.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:21:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.428+0000 7fc598c00640 1 -- 172.21.15.17:0/920035812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 msgr2=0x7fc5940ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.428+0000 7fc598c00640 1 --2- 172.21.15.17:0/920035812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 0x7fc5940ccdb0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009c80 tx=0x7fc58c01cd10 comp rx=0 tx=0).stop 2024-09-10T23:21:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.428+0000 7fc598c00640 1 -- 172.21.15.17:0/920035812 shutdown_connections 2024-09-10T23:21:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.428+0000 7fc598c00640 1 --2- 172.21.15.17:0/920035812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 0x7fc5940ccdb0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.428+0000 7fc598c00640 1 --2- 172.21.15.17:0/920035812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59415f770 0x7fc5940cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.428+0000 7fc598c00640 1 -- 172.21.15.17:0/920035812 >> 172.21.15.17:0/920035812 conn(0x7fc5940d1d60 msgr2=0x7fc5940d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.428+0000 7fc598c00640 1 -- 172.21.15.17:0/920035812 shutdown_connections 2024-09-10T23:21:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.428+0000 7fc598c00640 1 -- 172.21.15.17:0/920035812 wait complete. 2024-09-10T23:21:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 Processor -- start 2024-09-10T23:21:40.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 -- start start 2024-09-10T23:21:40.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc594070ad0 0x7fc5941664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 0x7fc594142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59415f770 0x7fc5940cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc594169410 con 0x7fc5940d1830 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc594169290 con 0x7fc594070ad0 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc594169590 con 0x7fc59415f770 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc589400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 0x7fc594142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc589400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 0x7fc594142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60586/0 (socket says 172.21.15.17:60586) 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc589400640 1 -- 172.21.15.17:0/1339164552 learned_addr learned my addr 172.21.15.17:0/1339164552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc592800640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59415f770 0x7fc5940cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc591e00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc594070ad0 0x7fc5941664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc589400640 1 -- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59415f770 msgr2=0x7fc5940cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc589400640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59415f770 0x7fc5940cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc589400640 1 -- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc594070ad0 msgr2=0x7fc5941664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc589400640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc594070ad0 0x7fc5941664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc589400640 1 -- 172.21.15.17:0/1339164552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5940ca2e0 con 0x7fc5940d1830 2024-09-10T23:21:40.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc591e00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc594070ad0 0x7fc5941664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc589400640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 0x7fc594142a30 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00d750 tx=0x7fc57c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc58aa00640 1 -- 172.21.15.17:0/1339164552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c017070 con 0x7fc5940d1830 2024-09-10T23:21:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc58aa00640 1 -- 172.21.15.17:0/1339164552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc57c004310 con 0x7fc5940d1830 2024-09-10T23:21:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc58aa00640 1 -- 172.21.15.17:0/1339164552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00de60 con 0x7fc5940d1830 2024-09-10T23:21:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc594156e20 con 0x7fc5940d1830 2024-09-10T23:21:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5940ca860 con 0x7fc5940d1830 2024-09-10T23:21:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.432+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc59415f060 con 0x7fc5940d1830 2024-09-10T23:21:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.436+0000 7fc58aa00640 1 -- 172.21.15.17:0/1339164552 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc57c009c30 con 0x7fc5940d1830 2024-09-10T23:21:40.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.436+0000 7fc58aa00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc570072610 0x7fc570074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.436+0000 7fc58aa00640 1 -- 172.21.15.17:0/1339164552 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fc57c0933e0 con 0x7fc5940d1830 2024-09-10T23:21:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.436+0000 7fc591e00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc570072610 0x7fc570074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.436+0000 7fc591e00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc570072610 0x7fc570074ad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc594158060 tx=0x7fc584009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:40.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.440+0000 7fc58aa00640 1 -- 172.21.15.17:0/1339164552 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc57c05e2d0 con 0x7fc5940d1830 2024-09-10T23:21:40.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.648+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc5940d23f0 con 0x7fc5940d1830 2024-09-10T23:21:40.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.648+0000 7fc58aa00640 1 -- 172.21.15.17:0/1339164552 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) ==== 53+0+73 (secure 0 0 0) 0x7fc57c062d00 con 0x7fc5940d1830 2024-09-10T23:21:40.656 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:21:40.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc570072610 msgr2=0x7fc570074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc570072610 0x7fc570074ad0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc594158060 tx=0x7fc584009040 comp rx=0 tx=0).stop 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 msgr2=0x7fc594142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 0x7fc594142a30 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00d750 tx=0x7fc57c00dc10 comp rx=0 tx=0).stop 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 shutdown_connections 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc570072610 0x7fc570074ad0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc59415f770 0x7fc5940cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5940d1830 0x7fc594142a30 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 --2- 172.21.15.17:0/1339164552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc594070ad0 0x7fc5941664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 >> 172.21.15.17:0/1339164552 conn(0x7fc5940d1d60 msgr2=0x7fc5940cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 shutdown_connections 2024-09-10T23:21:40.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40.652+0000 7fc598c00640 1 -- 172.21.15.17:0/1339164552 wait complete. 2024-09-10T23:21:40.677 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:21:40.677 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:21:40.677 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:21:40.677 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:21:40.677 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:40.678 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:21:40.678 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:21:40.678 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:21:40.678 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:21:40.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:40.678 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:21:40.688 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42070sec preferred_lft 42070sec 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:21:40.689 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:40.690 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:21:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:40.691 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:21:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:21:40.691 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:21:40.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:40.691 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:21:40.753 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:21:40.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:40.756 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:21:40.809 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:21:40.810 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:21:40.810 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:21:40.810 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:21:40.810 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:21:40.810 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:21:40.810 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:21:40.810 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:21:40.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:21:40.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:21:40.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:21:40.811 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:21:40.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:21:40.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:21:40.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:40.949 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:21:41.000 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:21:41.001 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:21:41.001 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:21:41.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:41.001 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:21:41.063 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:21:41.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:21:41.064 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:41.116 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:21:41.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:21:41.116 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:41.167 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:21:41.228 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:21:41.285 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:21:41.285 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:21:41.285 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:21:41.285 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:21:41.286 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:41.288 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:41.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:41.289 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:21:41.340 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:21:41.340 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:21:41.390 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:21:41.411 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:21:41.461 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:21:41.461 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:21:41.461 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:21:41.461 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:21:41.461 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:21:41.461 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:21:41.461 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:21:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:21:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:21:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:21:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:21:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:21:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:21:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:21:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:21:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:21:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:21:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:21:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:21:41.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:41.465 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:21:41.486 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:21:41.484+0000 7f0b7fa64580 -1 init, newargv = 0x56337c513ce0 newargc=15 2024-09-10T23:21:41.486 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[57121]: starting ceph client 2024-09-10T23:21:41.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[57121]: starting fuse 2024-09-10T23:21:41.495 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:21:41.495 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:21:41.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:21:41.495 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:21:41.495 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:21:41.495 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:21:41.496 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:21:41.497 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:21:41.497 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:21:41.497 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:21:41.497 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:21:41.497 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:21:41.497 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:21:41.497 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:41.497 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:21:41.497 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:21:41.620 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.57121.asok 2024-09-10T23:21:41.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:21:41.631 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57121.asok 2024-09-10T23:21:41.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:41.631 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57121.asok status 2024-09-10T23:21:41.803 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:21:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:21:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:21:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:21:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:21:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "57121", 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7500, 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 7500 2024-09-10T23:21:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 491967172 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 491967172 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.7500 192.168.0.1:0/491967172", 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/491967172", 2024-09-10T23:21:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:21:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 71, 2024-09-10T23:21:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 103, 2024-09-10T23:21:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:21:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:21:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:21:41.806 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:21:41.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:41.818 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:21:41.818 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:41.827 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:21:41.828 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:41.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:41.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:41.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:41.895 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-10T23:21:41.960 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:21:41.960 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:21:41.960 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-09-10T23:21:41.960 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:41.960 DEBUG:teuthology.orchestra.run.smithi017:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-10T23:21:41.960 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:21:42.073 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627776 2024-09-10T23:21:42.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:21:42.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 -- 172.21.15.17:0/3450528022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb4073710 msgr2=0x7f5eb4073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 --2- 172.21.15.17:0/3450528022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb4073710 0x7f5eb4073af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009900 tx=0x7f5ea401f0d0 comp rx=0 tx=0).stop 2024-09-10T23:21:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 -- 172.21.15.17:0/3450528022 shutdown_connections 2024-09-10T23:21:42.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 --2- 172.21.15.17:0/3450528022 >> v2:172.21.15.77:3300/0 conn(0x7f5eb4074030 0x7f5eb415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:42.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 --2- 172.21.15.17:0/3450528022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb4073710 0x7f5eb4073af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:42.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 -- 172.21.15.17:0/3450528022 >> 172.21.15.17:0/3450528022 conn(0x7f5eb40d0a20 msgr2=0x7f5eb40d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:42.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 -- 172.21.15.17:0/3450528022 shutdown_connections 2024-09-10T23:21:42.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 -- 172.21.15.17:0/3450528022 wait complete. 2024-09-10T23:21:42.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 Processor -- start 2024-09-10T23:21:42.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 -- start start 2024-09-10T23:21:42.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb4073710 0x7f5eb41503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:42.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb4074030 0x7f5eb40c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:42.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb40c40d0 0x7f5eb40ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:42.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb40cf8d0 con 0x7f5eb4074030 2024-09-10T23:21:42.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb40cf750 con 0x7f5eb40c40d0 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb40cfa50 con 0x7f5eb4073710 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eabe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb4074030 0x7f5eb40c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eabe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb4074030 0x7f5eb40c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60596/0 (socket says 172.21.15.17:60596) 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eabe00640 1 -- 172.21.15.17:0/633701081 learned_addr learned my addr 172.21.15.17:0/633701081 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb1e00640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb4073710 0x7f5eb41503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb2800640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb40c40d0 0x7f5eb40ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eabe00640 1 -- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb4073710 msgr2=0x7f5eb41503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eabe00640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb4073710 0x7f5eb41503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eabe00640 1 -- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb40c40d0 msgr2=0x7f5eb40ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eabe00640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb40c40d0 0x7f5eb40ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eabe00640 1 -- 172.21.15.17:0/633701081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb40c4a40 con 0x7f5eb4074030 2024-09-10T23:21:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eb1e00640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb4073710 0x7f5eb41503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.272+0000 7f5eabe00640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb4074030 0x7f5eb40c4500 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00c3a0 tx=0x7f5e9c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.276+0000 7f5eaa000640 1 -- 172.21.15.17:0/633701081 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c017070 con 0x7f5eb4074030 2024-09-10T23:21:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.276+0000 7f5eaa000640 1 -- 172.21.15.17:0/633701081 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e9c003600 con 0x7f5eb4074030 2024-09-10T23:21:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.276+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb40c6e20 con 0x7f5eb4074030 2024-09-10T23:21:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.276+0000 7f5eaa000640 1 -- 172.21.15.17:0/633701081 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c003a70 con 0x7f5eb4074030 2024-09-10T23:21:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.276+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb40c73e0 con 0x7f5eb4074030 2024-09-10T23:21:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.276+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb40cff00 con 0x7f5eb4074030 2024-09-10T23:21:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.276+0000 7f5eaa000640 1 -- 172.21.15.17:0/633701081 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5e9c003c10 con 0x7f5eb4074030 2024-09-10T23:21:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.280+0000 7f5eaa000640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e90072630 0x7f5e90074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.280+0000 7f5eaa000640 1 -- 172.21.15.17:0/633701081 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f5e9c0928f0 con 0x7f5eb4074030 2024-09-10T23:21:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.280+0000 7f5eb1e00640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e90072630 0x7f5e90074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.280+0000 7f5eb1e00640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e90072630 0x7f5e90074af0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40b2000 tx=0x7f5ea401d910 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.284+0000 7f5eaa000640 1 -- 172.21.15.17:0/633701081 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5e9c05df20 con 0x7f5eb4074030 2024-09-10T23:21:42.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5eb415e920 con 0x7f5eb4074030 2024-09-10T23:21:42.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eaa000640 1 -- 172.21.15.17:0/633701081 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5216 (secure 0 0 0) 0x7f5e9c05d820 con 0x7f5eb4074030 2024-09-10T23:21:42.496 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:42.497 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":71,"btime":"2024-09-10T23:21:37:272327+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/662650354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":662650354},{"type":"v1","addr":"172.21.15.77:6837","nonce":662650354}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6955,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1343355687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1343355687},{"type":"v1","addr":"172.21.15.77:6836","nonce":1343355687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7341,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1438697787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1438697787},{"type":"v1","addr":"172.21.15.17:6834","nonce":1438697787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:36.672500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7350":{"gid":7350,"name":"c","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/70051217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":70051217},{"type":"v1","addr":"172.21.15.17:6835","nonce":70051217}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7350,"qdb_cluster":[7350]},"id":6}]} 2024-09-10T23:21:42.497 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 71 2024-09-10T23:21:42.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e90072630 msgr2=0x7f5e90074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e90072630 0x7f5e90074af0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40b2000 tx=0x7f5ea401d910 comp rx=0 tx=0).stop 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb4074030 msgr2=0x7f5eb40c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb4074030 0x7f5eb40c4500 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00c3a0 tx=0x7f5e9c00c860 comp rx=0 tx=0).stop 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 shutdown_connections 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e90072630 0x7f5e90074af0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb40c40d0 0x7f5eb40ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb4074030 0x7f5eb40c4500 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 --2- 172.21.15.17:0/633701081 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb4073710 0x7f5eb41503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 >> 172.21.15.17:0/633701081 conn(0x7f5eb40d0a20 msgr2=0x7f5eb415de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 shutdown_connections 2024-09-10T23:21:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42.496+0000 7f5eb3200640 1 -- 172.21.15.17:0/633701081 wait complete. 2024-09-10T23:21:42.518 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-10T23:21:42.679 INFO:teuthology.orchestra.run.smithi017.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T23:21:41.956271+0000","btime":"2024-09-10T23:21:41.956271+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T23:21:41.956271+0000","atime":"2024-09-10T23:21:41.956271+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":7500,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":7500,"want_loner":7500,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T23:21:42.679 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T23:21:41.956271+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-10T23:21:41.956271+0000", "change_attr": 0, "client_caps": [ { "client_id": 7500, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-10T23:21:41.956271+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 7500, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-10T23:21:41.956271+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 7500, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-09-10T23:21:42.680 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:42.680 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:42.689 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:21:42.689 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:21:42.689 DEBUG:teuthology.orchestra.run.smithi017:> import uuid 2024-09-10T23:21:42.689 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:42.689 DEBUG:teuthology.orchestra.run.smithi017:> n = 21 2024-09-10T23:21:42.689 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = False 2024-09-10T23:21:42.689 DEBUG:teuthology.orchestra.run.smithi017:> if 0 > 0: 2024-09-10T23:21:42.689 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = True 2024-09-10T23:21:42.689 DEBUG:teuthology.orchestra.run.smithi017:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> dpath = os.path.dirname(path) 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> fnameprefix = os.path.basename(path) 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> os.makedirs(dpath, exist_ok=True) 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> try: 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> for i in range(n): 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> with open(fpath, '"'"'w'"'"') as f: 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> f.write(f"{i}") 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> f.flush() 2024-09-10T23:21:42.690 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f.fileno()) 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> os.unlink(fpath) 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> if create_hard_links: 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> for j in range(0): 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> finally: 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> os.close(dirfd) 2024-09-10T23:21:42.691 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:21:42.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:21:42.868 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:42.868 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:42.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:21:43.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.116+0000 7f2c17200640 1 -- 172.21.15.17:0/3719818805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1806d2d0 msgr2=0x7f2c18073f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.116+0000 7f2c17200640 1 --2- 172.21.15.17:0/3719818805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1806d2d0 0x7f2c18073f30 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009c80 tx=0x7f2c1001cc80 comp rx=0 tx=0).stop 2024-09-10T23:21:43.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.116+0000 7f2c17200640 1 -- 172.21.15.17:0/3719818805 shutdown_connections 2024-09-10T23:21:43.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.116+0000 7f2c17200640 1 --2- 172.21.15.17:0/3719818805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1806d2d0 0x7f2c18073f30 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.116+0000 7f2c17200640 1 -- 172.21.15.17:0/3719818805 >> 172.21.15.17:0/3719818805 conn(0x7f2c180b2740 msgr2=0x7f2c180b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:43.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.116+0000 7f2c17200640 1 -- 172.21.15.17:0/3719818805 shutdown_connections 2024-09-10T23:21:43.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.116+0000 7f2c17200640 1 -- 172.21.15.17:0/3719818805 wait complete. 2024-09-10T23:21:43.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 Processor -- start 2024-09-10T23:21:43.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 -- start start 2024-09-10T23:21:43.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c1806d2d0 0x7f2c1814f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:43.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1815b890 0x7f2c180aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:43.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c1815bc70 0x7f2c181f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:43.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2c18169df0 con 0x7f2c1815b890 2024-09-10T23:21:43.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2c18169c70 con 0x7f2c1815bc70 2024-09-10T23:21:43.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2c18169f70 con 0x7f2c1806d2d0 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1815b890 0x7f2c180aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1815b890 0x7f2c180aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60614/0 (socket says 172.21.15.17:60614) 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15400640 1 -- 172.21.15.17:0/3418589120 learned_addr learned my addr 172.21.15.17:0/3418589120 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c16800640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c1815bc70 0x7f2c181f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15e00640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c1806d2d0 0x7f2c1814f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15400640 1 -- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c1806d2d0 msgr2=0x7f2c1814f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15400640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c1806d2d0 0x7f2c1814f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15400640 1 -- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c1815bc70 msgr2=0x7f2c181f7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15400640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c1815bc70 0x7f2c181f7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15400640 1 -- 172.21.15.17:0/3418589120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c181f8680 con 0x7f2c1815b890 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c15400640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1815b890 0x7f2c180aef70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000b3e0 tx=0x7f2c0000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c0e000640 1 -- 172.21.15.17:0/3418589120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00015020 con 0x7f2c1815b890 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c0e000640 1 -- 172.21.15.17:0/3418589120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c00011920 con 0x7f2c1815b890 2024-09-10T23:21:43.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c181f8960 con 0x7f2c1815b890 2024-09-10T23:21:43.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c0e000640 1 -- 172.21.15.17:0/3418589120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00011db0 con 0x7f2c1815b890 2024-09-10T23:21:43.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1815d810 con 0x7f2c1815b890 2024-09-10T23:21:43.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.120+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c18073f30 con 0x7f2c1815b890 2024-09-10T23:21:43.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.124+0000 7f2c0e000640 1 -- 172.21.15.17:0/3418589120 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2c0001a400 con 0x7f2c1815b890 2024-09-10T23:21:43.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.124+0000 7f2c0e000640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2bf40725e0 0x7f2bf4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:43.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.124+0000 7f2c0e000640 1 -- 172.21.15.17:0/3418589120 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f2c000932b0 con 0x7f2c1815b890 2024-09-10T23:21:43.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.124+0000 7f2c15e00640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2bf40725e0 0x7f2bf4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:43.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.124+0000 7f2c15e00640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2bf40725e0 0x7f2bf4074aa0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2c080016f0 tx=0x7f2c08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:43.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.128+0000 7f2c0e000640 1 -- 172.21.15.17:0/3418589120 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2c0001f030 con 0x7f2c1815b890 2024-09-10T23:21:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.312+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2c18074790 con 0x7f2c1815b890 2024-09-10T23:21:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.312+0000 7f2c0e000640 1 -- 172.21.15.17:0/3418589120 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) ==== 80+0+0 (secure 0 0 0) 0x7f2c0005e7f0 con 0x7f2c1815b890 2024-09-10T23:21:43.316 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:21:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2bf40725e0 msgr2=0x7f2bf4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2bf40725e0 0x7f2bf4074aa0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2c080016f0 tx=0x7f2c08009040 comp rx=0 tx=0).stop 2024-09-10T23:21:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1815b890 msgr2=0x7f2c180aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1815b890 0x7f2c180aef70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000b3e0 tx=0x7f2c0000b8a0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 shutdown_connections 2024-09-10T23:21:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2bf40725e0 0x7f2bf4074aa0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c1815bc70 0x7f2c181f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c1815b890 0x7f2c180aef70 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 --2- 172.21.15.17:0/3418589120 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c1806d2d0 0x7f2c1814f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 >> 172.21.15.17:0/3418589120 conn(0x7f2c180b2740 msgr2=0x7f2c1814e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 shutdown_connections 2024-09-10T23:21:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.316+0000 7f2c17200640 1 -- 172.21.15.17:0/3418589120 wait complete. 2024-09-10T23:21:43.337 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:43.337 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:43.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:21:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.532+0000 7fb042600640 1 -- 172.21.15.17:0/1220468706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 msgr2=0x7fb03c070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.532+0000 7fb042600640 1 --2- 172.21.15.17:0/1220468706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 0x7fb03c070500 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb024009900 tx=0x7fb02401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.532+0000 7fb042600640 1 -- 172.21.15.17:0/1220468706 shutdown_connections 2024-09-10T23:21:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.532+0000 7fb042600640 1 --2- 172.21.15.17:0/1220468706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb03c0b2a30 0x7fb03c0b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.532+0000 7fb042600640 1 --2- 172.21.15.17:0/1220468706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 0x7fb03c070500 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.532+0000 7fb042600640 1 -- 172.21.15.17:0/1220468706 >> 172.21.15.17:0/1220468706 conn(0x7fb03c0b1730 msgr2=0x7fb03c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.532+0000 7fb042600640 1 -- 172.21.15.17:0/1220468706 shutdown_connections 2024-09-10T23:21:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.532+0000 7fb042600640 1 -- 172.21.15.17:0/1220468706 wait complete. 2024-09-10T23:21:43.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 Processor -- start 2024-09-10T23:21:43.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 -- start start 2024-09-10T23:21:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 0x7fb03c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb03c0b2a30 0x7fb03c0c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb03c155010 0x7fb03c157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c0b3970 con 0x7fb03c070090 2024-09-10T23:21:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c0b37f0 con 0x7fb03c155010 2024-09-10T23:21:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb03c167fc0 con 0x7fb03c0b2a30 2024-09-10T23:21:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 0x7fb03c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 0x7fb03c1537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60638/0 (socket says 172.21.15.17:60638) 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03b400640 1 -- 172.21.15.17:0/1152872365 learned_addr learned my addr 172.21.15.17:0/1152872365 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb033e00640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb03c0b2a30 0x7fb03c0c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03be00640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb03c155010 0x7fb03c157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03b400640 1 -- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb03c0b2a30 msgr2=0x7fb03c0c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03b400640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb03c0b2a30 0x7fb03c0c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03b400640 1 -- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb03c155010 msgr2=0x7fb03c157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03b400640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb03c155010 0x7fb03c157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03b400640 1 -- 172.21.15.17:0/1152872365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03c0cb5c0 con 0x7fb03c070090 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb033e00640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb03c0b2a30 0x7fb03c0c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb03b400640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 0x7fb03c1537f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00c3f0 tx=0x7fb02c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb033400640 1 -- 172.21.15.17:0/1152872365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c017070 con 0x7fb03c070090 2024-09-10T23:21:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb033400640 1 -- 172.21.15.17:0/1152872365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb02c0053c0 con 0x7fb03c070090 2024-09-10T23:21:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb033400640 1 -- 172.21.15.17:0/1152872365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c003860 con 0x7fb03c070090 2024-09-10T23:21:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03c0cb8a0 con 0x7fb03c070090 2024-09-10T23:21:43.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.536+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03c158010 con 0x7fb03c070090 2024-09-10T23:21:43.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.540+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb03c070500 con 0x7fb03c070090 2024-09-10T23:21:43.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.540+0000 7fb033400640 1 -- 172.21.15.17:0/1152872365 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb02c003a00 con 0x7fb03c070090 2024-09-10T23:21:43.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.540+0000 7fb033400640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0180725e0 0x7fb018074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:43.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.540+0000 7fb033400640 1 -- 172.21.15.17:0/1152872365 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fb02c092a80 con 0x7fb03c070090 2024-09-10T23:21:43.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.540+0000 7fb033e00640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0180725e0 0x7fb018074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:43.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.540+0000 7fb033e00640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0180725e0 0x7fb018074aa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb0240af000 tx=0x7fb02401b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:43.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.544+0000 7fb033400640 1 -- 172.21.15.17:0/1152872365 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb02c094e20 con 0x7fb03c070090 2024-09-10T23:21:43.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb03c0b4270 con 0x7fb03c070090 2024-09-10T23:21:43.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb033400640 1 -- 172.21.15.17:0/1152872365 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) ==== 80+0+0 (secure 0 0 0) 0x7fb02c05dfc0 con 0x7fb03c070090 2024-09-10T23:21:43.733 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:21:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0180725e0 msgr2=0x7fb018074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0180725e0 0x7fb018074aa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb0240af000 tx=0x7fb02401b0f0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 msgr2=0x7fb03c1537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 0x7fb03c1537f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00c3f0 tx=0x7fb02c00c8b0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 shutdown_connections 2024-09-10T23:21:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0180725e0 0x7fb018074aa0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb03c155010 0x7fb03c157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb03c0b2a30 0x7fb03c0c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 --2- 172.21.15.17:0/1152872365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb03c070090 0x7fb03c1537f0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:43.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 >> 172.21.15.17:0/1152872365 conn(0x7fb03c0b1730 msgr2=0x7fb03c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:43.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 shutdown_connections 2024-09-10T23:21:43.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:43.732+0000 7fb042600640 1 -- 172.21.15.17:0/1152872365 wait complete. 2024-09-10T23:21:43.754 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:21:43.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:43.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:21:43.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[57121]: fuse finished with error 0 and tester_r 0 2024-09-10T23:21:43.774 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:43.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:21:43.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:43.871 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:21:43.881 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-10T23:21:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.072+0000 7f46d3200640 1 -- 172.21.15.17:0/585496897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d40b30e0 msgr2=0x7f46d41664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.072+0000 7f46d3200640 1 --2- 172.21.15.17:0/585496897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d40b30e0 0x7f46d41664d0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009c80 tx=0x7f46cc01cd70 comp rx=0 tx=0).stop 2024-09-10T23:21:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 -- 172.21.15.17:0/585496897 shutdown_connections 2024-09-10T23:21:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 --2- 172.21.15.17:0/585496897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d40b30e0 0x7f46d41664d0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 -- 172.21.15.17:0/585496897 >> 172.21.15.17:0/585496897 conn(0x7f46d409a9f0 msgr2=0x7f46d409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 -- 172.21.15.17:0/585496897 shutdown_connections 2024-09-10T23:21:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 -- 172.21.15.17:0/585496897 wait complete. 2024-09-10T23:21:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 Processor -- start 2024-09-10T23:21:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 -- start start 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d40b30e0 0x7f46d4152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46d415b8c0 0x7f46d415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d415bca0 0x7f46d406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4169e40 con 0x7f46d415bca0 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4169cc0 con 0x7f46d40b30e0 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46d4169fc0 con 0x7f46d415b8c0 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d415bca0 0x7f46d406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d415bca0 0x7f46d406ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60650/0 (socket says 172.21.15.17:60650) 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d2800640 1 -- 172.21.15.17:0/1866906472 learned_addr learned my addr 172.21.15.17:0/1866906472 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d1e00640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d40b30e0 0x7f46d4152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46c9400640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46d415b8c0 0x7f46d415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d2800640 1 -- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46d415b8c0 msgr2=0x7f46d415a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d2800640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46d415b8c0 0x7f46d415a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d2800640 1 -- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d40b30e0 msgr2=0x7f46d4152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d2800640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d40b30e0 0x7f46d4152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d2800640 1 -- 172.21.15.17:0/1866906472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d41531a0 con 0x7f46d415bca0 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.076+0000 7f46d2800640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d415bca0 0x7f46d406ed20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f46cc01a9a0 tx=0x7f46cc0a5b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46caa00640 1 -- 172.21.15.17:0/1866906472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0bb070 con 0x7f46d415bca0 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46caa00640 1 -- 172.21.15.17:0/1866906472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46cc004d60 con 0x7f46d415bca0 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46caa00640 1 -- 172.21.15.17:0/1866906472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0b2040 con 0x7f46d415bca0 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46d3200640 1 -- 172.21.15.17:0/1866906472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d415aee0 con 0x7f46d415bca0 2024-09-10T23:21:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46d3200640 1 -- 172.21.15.17:0/1866906472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d4159720 con 0x7f46d415bca0 2024-09-10T23:21:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46caa00640 1 -- 172.21.15.17:0/1866906472 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f46cc0b5030 con 0x7f46d415bca0 2024-09-10T23:21:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46caa00640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46b00725e0 0x7f46b0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46caa00640 1 -- 172.21.15.17:0/1866906472 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f46cc12d090 con 0x7f46d415bca0 2024-09-10T23:21:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46dc4c5000 1 Processor -- start 2024-09-10T23:21:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46d1e00640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46b00725e0 0x7f46b0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.080+0000 7f46dc4c5000 1 -- start start 2024-09-10T23:21:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46d1e00640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46b00725e0 0x7f46b0074aa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f46c4007fd0 tx=0x7f46c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b05d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b05dbc0 0x556c8b05dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556c8af45cb0 con 0x556c8b0a7ac0 2024-09-10T23:21:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556c8ae5b310 con 0x556c8b05dbc0 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556c8aeb8b90 con 0x556c8b0a71a0 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b05d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b05d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60656/0 (socket says 172.21.15.17:60656) 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c9400640 1 -- 172.21.15.17:0/716584930 learned_addr learned my addr 172.21.15.17:0/716584930 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46d1e00640 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46d2800640 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b05dbc0 0x556c8b05dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c9400640 1 -- 172.21.15.17:0/716584930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 msgr2=0x556c8b0a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c9400640 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c9400640 1 -- 172.21.15.17:0/716584930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b05dbc0 msgr2=0x556c8b05dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c9400640 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b05dbc0 0x556c8b05dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c9400640 1 -- 172.21.15.17:0/716584930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8ae5cc60 con 0x556c8b0a7ac0 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46d2800640 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b05dbc0 0x556c8b05dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c9400640 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b05d680 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f46d4155880 tx=0x7f46bc007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b696adaf6271cbb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c2a00640 1 -- 172.21.15.17:0/716584930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0052e0 con 0x556c8b0a7ac0 2024-09-10T23:21:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c2a00640 1 -- 172.21.15.17:0/716584930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46bc018070 con 0x556c8b0a7ac0 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46c2a00640 1 -- 172.21.15.17:0/716584930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00f9e0 con 0x556c8b0a7ac0 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 -- 172.21.15.17:0/716584930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 msgr2=0x556c8b05d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b05d680 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f46d4155880 tx=0x7f46bc007e40 comp rx=0 tx=0).stop 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 -- 172.21.15.17:0/716584930 shutdown_connections 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b05dbc0 0x556c8b05dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b05d680 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/716584930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 -- 172.21.15.17:0/716584930 >> 172.21.15.17:0/716584930 conn(0x556c8b063d20 msgr2=0x556c8b05bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 -- 172.21.15.17:0/716584930 shutdown_connections 2024-09-10T23:21:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 -- 172.21.15.17:0/716584930 wait complete. 2024-09-10T23:21:44.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 -- start start 2024-09-10T23:21:44.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.084+0000 7f46dc4c5000 1 Processor -- start 2024-09-10T23:21:44.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b05dbc0 0x556c8b0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a71a0 0x556c8b0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b0aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556c8aeabdd0 con 0x556c8b0a7ac0 2024-09-10T23:21:44.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556c8aea7fc0 con 0x556c8b0a71a0 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556c8ae4d4b0 con 0x556c8b05dbc0 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 10 client.0 _ll_register_callbacks cb 0x556c8ae2b7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b0aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d1e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b05dbc0 0x556c8b0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46c9400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a71a0 0x556c8b0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b0aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60664/0 (socket says 172.21.15.17:60664) 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d2800640 1 -- 172.21.15.17:0/1338994883 learned_addr learned my addr 172.21.15.17:0/1338994883 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d2800640 1 -- 172.21.15.17:0/1338994883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b05dbc0 msgr2=0x556c8b0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d2800640 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b05dbc0 0x556c8b0ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d2800640 1 -- 172.21.15.17:0/1338994883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a71a0 msgr2=0x556c8b0aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d2800640 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a71a0 0x556c8b0aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d2800640 1 -- 172.21.15.17:0/1338994883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8ae461f0 con 0x556c8b0a7ac0 2024-09-10T23:21:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d2800640 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b0aefb0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0f51f0 tx=0x7f46cc0f7e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae53c75f4352f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 1 -- 172.21.15.17:0/1338994883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0f7f80 con 0x556c8b0a7ac0 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 1 -- 172.21.15.17:0/1338994883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f46cc0fdb40 con 0x556c8b0a7ac0 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- 172.21.15.17:0/1338994883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556c8ae40330 con 0x556c8b0a7ac0 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 1 -- 172.21.15.17:0/1338994883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f46cc0fc9b0 con 0x556c8b0a7ac0 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 10 client.7536 fetch_fsmap learned FSMap version 71 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- 172.21.15.17:0/1338994883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x556c8ae2cfa0 con 0x556c8b0a7ac0 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 1 -- 172.21.15.17:0/1338994883 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556c8ae40330 con 0x556c8b0a7ac0 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 1 -- 172.21.15.17:0/1338994883 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 71) ==== 3502+0+0 (secure 0 0 0) 0x7f46cc0f71e0 con 0x556c8b0a7ac0 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 10 client.7536 fetch_fsmap finished waiting for FSMap version 71 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 10 client.7536 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 20 client.7536 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x556c8b0b6900 0x556c8b0b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 4 client.7536 mds_command: new command op to 7350 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- 172.21.15.17:0/1338994883 --> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c8aebaae0 con 0x556c8b0b6900 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d1e00640 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x556c8b0b6900 0x556c8b0b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46d1e00640 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x556c8b0b6900 0x556c8b0b8cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec6fd96a949a1cf2 server_cookie=743b33e5e4ad71f4 in_seq=0 out_seq=0 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 10 client.7536 ms_handle_connect on v2:172.21.15.17:6833/70051217 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 1 -- 172.21.15.17:0/1338994883 <== mds.0 v2:172.21.15.17:6833/70051217 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c8aebaae0 con 0x556c8b0b6900 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 10 client.7536 handle_command_reply: tid=0 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 client.7536 shutdown 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- 172.21.15.17:0/1338994883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 msgr2=0x556c8b0aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b0aefb0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0f51f0 tx=0x7f46cc0f7e80 comp rx=0 tx=0).stop 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- 172.21.15.17:0/1338994883 shutdown_connections 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x556c8b0b6900 0x556c8b0b8cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b0a7ac0 0x556c8b0aefb0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a71a0 0x556c8b0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/1338994883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b05dbc0 0x556c8b0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- 172.21.15.17:0/1338994883 >> 172.21.15.17:0/1338994883 conn(0x556c8b063d20 msgr2=0x556c8b05bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46b7400640 0 client.7536 ms_handle_reset on v2:172.21.15.17:6833/70051217 2024-09-10T23:21:44.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- 172.21.15.17:0/1338994883 shutdown_connections 2024-09-10T23:21:44.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.088+0000 7f46dc4c5000 1 -- 172.21.15.17:0/1338994883 wait complete. 2024-09-10T23:21:44.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.092+0000 7f46dc4c5000 20 client.7536 trim_cache size 0 max 16384 2024-09-10T23:21:44.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.104+0000 7f46dc4c5000 1 Processor -- start 2024-09-10T23:21:44.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.104+0000 7f46dc4c5000 1 -- start start 2024-09-10T23:21:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 0x556c8b0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46d42047b0 con 0x556c8b05dbc0 2024-09-10T23:21:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4203830 con 0x556c8b0a7ac0 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46d4156fe0 con 0x556c8b0a71a0 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60676/0 (socket says 172.21.15.17:60676) 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d1e00640 1 -- 172.21.15.17:0/4003985715 learned_addr learned my addr 172.21.15.17:0/4003985715 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d2800640 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 0x556c8b0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46c9400640 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d1e00640 1 -- 172.21.15.17:0/4003985715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 msgr2=0x556c8b0b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d1e00640 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d1e00640 1 -- 172.21.15.17:0/4003985715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 msgr2=0x556c8b0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d1e00640 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 0x556c8b0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d1e00640 1 -- 172.21.15.17:0/4003985715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8af05660 con 0x556c8b05dbc0 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d2800640 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 0x556c8b0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46d1e00640 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b1310 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f46c4001280 tx=0x7f46c4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f0606adad4b023 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46c2000640 1 -- 172.21.15.17:0/4003985715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c400fce0 con 0x556c8b05dbc0 2024-09-10T23:21:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46c2000640 1 -- 172.21.15.17:0/4003985715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46c401b040 con 0x556c8b05dbc0 2024-09-10T23:21:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46c2000640 1 -- 172.21.15.17:0/4003985715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4016110 con 0x556c8b05dbc0 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 -- 172.21.15.17:0/4003985715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 msgr2=0x556c8b0b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b1310 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f46c4001280 tx=0x7f46c4012000 comp rx=0 tx=0).stop 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 -- 172.21.15.17:0/4003985715 shutdown_connections 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 0x556c8b0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/4003985715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b1310 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 -- 172.21.15.17:0/4003985715 >> 172.21.15.17:0/4003985715 conn(0x556c8b063d20 msgr2=0x556c8b05dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 -- 172.21.15.17:0/4003985715 shutdown_connections 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 -- 172.21.15.17:0/4003985715 wait complete. 2024-09-10T23:21:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 -- start start 2024-09-10T23:21:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.108+0000 7f46dc4c5000 1 Processor -- start 2024-09-10T23:21:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 0x556c8b0d9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556c8b066d40 con 0x556c8b05dbc0 2024-09-10T23:21:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556c8b064100 con 0x556c8b0a7ac0 2024-09-10T23:21:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556c8aea2ec0 con 0x556c8b0a71a0 2024-09-10T23:21:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 10 client.0 _ll_register_callbacks cb 0x7f46bc007ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60680/0 (socket says 172.21.15.17:60680) 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d1e00640 1 -- 172.21.15.17:0/3582885297 learned_addr learned my addr 172.21.15.17:0/3582885297 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d2800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 0x556c8b0d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46c9400640 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d1e00640 1 -- 172.21.15.17:0/3582885297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 msgr2=0x556c8b0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d1e00640 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d1e00640 1 -- 172.21.15.17:0/3582885297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 msgr2=0x556c8b0d9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d1e00640 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 0x556c8b0d9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d1e00640 1 -- 172.21.15.17:0/3582885297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8ae72090 con 0x556c8b05dbc0 2024-09-10T23:21:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46c9400640 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46d1e00640 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b4560 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f46c40016c0 tx=0x7f46c400f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25289a1984984149 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46b7400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46b7400640 1 -- 172.21.15.17:0/3582885297 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c400fc90 con 0x556c8b05dbc0 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46b7400640 1 -- 172.21.15.17:0/3582885297 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f46c4023ac0 con 0x556c8b05dbc0 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 -- 172.21.15.17:0/3582885297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46c401b040 con 0x556c8b05dbc0 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46b7400640 1 -- 172.21.15.17:0/3582885297 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f46c4040050 con 0x556c8b05dbc0 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 10 client.7542 fetch_fsmap learned FSMap version 71 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 -- 172.21.15.17:0/3582885297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x556c8ae3e5f0 con 0x556c8b05dbc0 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46b7400640 1 -- 172.21.15.17:0/3582885297 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46c401b040 con 0x556c8b05dbc0 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46b7400640 1 -- 172.21.15.17:0/3582885297 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 71) ==== 3502+0+0 (secure 0 0 0) 0x7f46c4043020 con 0x556c8b05dbc0 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 10 client.7542 fetch_fsmap finished waiting for FSMap version 71 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 10 client.7542 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T23:21:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 20 client.7542 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x556c8b0d9bd0 0x556c8b11d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 4 client.7542 mds_command: new command op to 7350 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T23:21:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46dc4c5000 1 -- 172.21.15.17:0/3582885297 --> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556c8aeb6590 con 0x556c8b0d9bd0 2024-09-10T23:21:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46c9400640 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x556c8b0d9bd0 0x556c8b11d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46b7400640 10 client.7542 ms_handle_connect on v2:172.21.15.17:6833/70051217 2024-09-10T23:21:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.112+0000 7f46c9400640 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x556c8b0d9bd0 0x556c8b11d090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20211c213af7a8cb server_cookie=7015e6991b56ae71 in_seq=0 out_seq=0 2024-09-10T23:21:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46b7400640 1 -- 172.21.15.17:0/3582885297 <== mds.0 v2:172.21.15.17:6833/70051217 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556c8aeb6590 con 0x556c8b0d9bd0 2024-09-10T23:21:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46b7400640 10 client.7542 handle_command_reply: tid=0 2024-09-10T23:21:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 client.7542 shutdown 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 -- 172.21.15.17:0/3582885297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 msgr2=0x556c8b0b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b4560 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f46c40016c0 tx=0x7f46c400f840 comp rx=0 tx=0).stop 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 -- 172.21.15.17:0/3582885297 shutdown_connections 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556c8b0a7ac0 0x556c8b0d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556c8b0a71a0 0x556c8b0b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.17:6833/70051217,v1:172.21.15.17:6835/70051217] conn(0x556c8b0d9bd0 0x556c8b11d090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 --2- 172.21.15.17:0/3582885297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556c8b05dbc0 0x556c8b0b4560 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46b7400640 0 client.7542 ms_handle_reset on v2:172.21.15.17:6833/70051217 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 -- 172.21.15.17:0/3582885297 >> 172.21.15.17:0/3582885297 conn(0x556c8b063d20 msgr2=0x556c8b05d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 -- 172.21.15.17:0/3582885297 shutdown_connections 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 1 -- 172.21.15.17:0/3582885297 wait complete. 2024-09-10T23:21:44.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46dc4c5000 20 client.7542 trim_cache size 0 max 16384 2024-09-10T23:21:44.128 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:21:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:21:44.128 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:21:44.128 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 -- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46b00725e0 msgr2=0x7f46b0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46b00725e0 0x7f46b0074aa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f46c4007fd0 tx=0x7f46c4009040 comp rx=0 tx=0).stop 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 -- 172.21.15.17:0/1866906472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d415bca0 msgr2=0x7f46d406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d415bca0 0x7f46d406ed20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f46cc01a9a0 tx=0x7f46cc0a5b70 comp rx=0 tx=0).stop 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 -- 172.21.15.17:0/1866906472 shutdown_connections 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46b00725e0 0x7f46b0074aa0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d415bca0 0x7f46d406ed20 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46d415b8c0 0x7f46d415a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 --2- 172.21.15.17:0/1866906472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d40b30e0 0x7f46d4152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 -- 172.21.15.17:0/1866906472 >> 172.21.15.17:0/1866906472 conn(0x7f46d409a9f0 msgr2=0x7f46d40b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 -- 172.21.15.17:0/1866906472 shutdown_connections 2024-09-10T23:21:44.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.124+0000 7f46d3200640 1 -- 172.21.15.17:0/1866906472 wait complete. 2024-09-10T23:21:44.146 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:21:44.146 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:44.146 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:21:44.146 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:44.147 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:21:44.147 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:44.147 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:21:44.147 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:21:44.159 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:21:44.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-10T23:21:44.160 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:21:44.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-10T23:21:44.161 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:21:44.161 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-10T23:21:44.163 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:21:44.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-10T23:21:44.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 -- 172.21.15.17:0/2079878421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580ca440 msgr2=0x7f9058073aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 --2- 172.21.15.17:0/2079878421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580ca440 0x7f9058073aa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9050009bc0 tx=0x7f905001cae0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 -- 172.21.15.17:0/2079878421 shutdown_connections 2024-09-10T23:21:44.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 --2- 172.21.15.17:0/2079878421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580ca440 0x7f9058073aa0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 -- 172.21.15.17:0/2079878421 >> 172.21.15.17:0/2079878421 conn(0x7f9058072f80 msgr2=0x7f9058073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 -- 172.21.15.17:0/2079878421 shutdown_connections 2024-09-10T23:21:44.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 -- 172.21.15.17:0/2079878421 wait complete. 2024-09-10T23:21:44.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 -- 172.21.15.17:0/1293542095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a0406e760 msgr2=0x7f5a0406ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 --2- 172.21.15.17:0/1293542095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a0406e760 0x7f5a0406ebd0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f5a040cfa20 tx=0x7f5a0001f370 comp rx=0 tx=0).stop 2024-09-10T23:21:44.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 -- 172.21.15.17:0/1293542095 shutdown_connections 2024-09-10T23:21:44.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 --2- 172.21.15.17:0/1293542095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a0406e760 0x7f5a0406ebd0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 --2- 172.21.15.17:0/1293542095 >> v2:172.21.15.77:3300/0 conn(0x7f5a0415a3d0 0x7f5a041434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 -- 172.21.15.17:0/1293542095 >> 172.21.15.17:0/1293542095 conn(0x7f5a040b1730 msgr2=0x7f5a040b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 -- 172.21.15.17:0/1293542095 shutdown_connections 2024-09-10T23:21:44.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 -- 172.21.15.17:0/1293542095 wait complete. 2024-09-10T23:21:44.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 Processor -- start 2024-09-10T23:21:44.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 -- start start 2024-09-10T23:21:44.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7fb220200640 1 -- 172.21.15.17:0/2781589334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2180ce010 msgr2=0x7fb2180cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7fb220200640 1 --2- 172.21.15.17:0/2781589334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2180ce010 0x7fb2180cd570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb2180c58a0 tx=0x7fb21001f390 comp rx=0 tx=0).stop 2024-09-10T23:21:44.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7fb220200640 1 -- 172.21.15.17:0/2781589334 shutdown_connections 2024-09-10T23:21:44.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7fb220200640 1 --2- 172.21.15.17:0/2781589334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2180ce010 0x7fb2180cd570 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7fb220200640 1 --2- 172.21.15.17:0/2781589334 >> v2:172.21.15.17:3300/0 conn(0x7fb2180cfde0 0x7fb2180d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7fb220200640 1 -- 172.21.15.17:0/2781589334 >> 172.21.15.17:0/2781589334 conn(0x7fb2180d1da0 msgr2=0x7fb2180d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7fb220200640 1 -- 172.21.15.17:0/2781589334 shutdown_connections 2024-09-10T23:21:44.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 Processor -- start 2024-09-10T23:21:44.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7fb220200640 1 -- 172.21.15.17:0/2781589334 wait complete. 2024-09-10T23:21:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f5a0c800640 1 -- start start 2024-09-10T23:21:44.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f905806e2e0 0x7f905806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.356+0000 7f905de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90580ca440 0x7f90581529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f905de00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f905815b840 0x7f9058152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f905de00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f905816c120 con 0x7f905806e2e0 2024-09-10T23:21:44.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f905de00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f905816bfa0 con 0x7f905815b840 2024-09-10T23:21:44.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f905de00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f905816c2a0 con 0x7f90580ca440 2024-09-10T23:21:44.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f905806e2e0 0x7f905806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f905806e2e0 0x7f905806efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60712/0 (socket says 172.21.15.17:60712) 2024-09-10T23:21:44.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056a00640 1 -- 172.21.15.17:0/2345314424 learned_addr learned my addr 172.21.15.17:0/2345314424 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:44.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056000640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90580ca440 0x7f90581529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a0c800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a0406e760 0x7f5a040acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a0c800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a040707e0 0x7f5a0413eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a0c800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a0415a3d0 0x7f5a04141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a0c800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0406f5e0 con 0x7f5a0406e760 2024-09-10T23:21:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a0c800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0406f460 con 0x7f5a040707e0 2024-09-10T23:21:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a0c800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0406f760 con 0x7f5a0415a3d0 2024-09-10T23:21:44.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9057400640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f905815b840 0x7f9058152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a0406e760 0x7f5a040acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056000640 1 -- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f905815b840 msgr2=0x7f9058152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056000640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f905815b840 0x7f9058152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056000640 1 -- 172.21.15.17:0/2345314424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f905806e2e0 msgr2=0x7f905806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056000640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f905806e2e0 0x7f905806efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056000640 1 -- 172.21.15.17:0/2345314424 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905806f6c0 con 0x7f90580ca440 2024-09-10T23:21:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a0406e760 0x7f5a040acf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60722/0 (socket says 172.21.15.17:60722) 2024-09-10T23:21:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09e00640 1 -- 172.21.15.17:0/4100104763 learned_addr learned my addr 172.21.15.17:0/4100104763 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09400640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a040707e0 0x7f5a0413eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a0a800640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a0415a3d0 0x7f5a04141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb220200640 1 Processor -- start 2024-09-10T23:21:44.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09400640 1 -- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a0415a3d0 msgr2=0x7f5a04141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f9056000640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90580ca440 0x7f90581529a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f904400c390 tx=0x7f904400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09400640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a0415a3d0 0x7f5a04141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09400640 1 -- 172.21.15.17:0/4100104763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a0406e760 msgr2=0x7f5a040acf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09400640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a0406e760 0x7f5a040acf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09400640 1 -- 172.21.15.17:0/4100104763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a040cc280 con 0x7f5a040707e0 2024-09-10T23:21:44.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f904f400640 1 -- 172.21.15.17:0/2345314424 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044011790 con 0x7f90580ca440 2024-09-10T23:21:44.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb220200640 1 -- start start 2024-09-10T23:21:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f904f400640 1 -- 172.21.15.17:0/2345314424 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9044017070 con 0x7f90580ca440 2024-09-10T23:21:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905806f9a0 con 0x7f90580ca440 2024-09-10T23:21:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f904f400640 1 -- 172.21.15.17:0/2345314424 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044011cc0 con 0x7f90580ca440 2024-09-10T23:21:44.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f905806ff60 con 0x7f90580ca440 2024-09-10T23:21:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a09400640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a040707e0 0x7f5a0413eeb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f59f400e860 tx=0x7f59f400ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f59fe000640 1 -- 172.21.15.17:0/4100104763 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f400cdc0 con 0x7f5a040707e0 2024-09-10T23:21:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f59fe000640 1 -- 172.21.15.17:0/4100104763 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59f4004020 con 0x7f5a040707e0 2024-09-10T23:21:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a040abea0 con 0x7f5a040707e0 2024-09-10T23:21:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f59fe000640 1 -- 172.21.15.17:0/4100104763 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4004470 con 0x7f5a040707e0 2024-09-10T23:21:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a040ac460 con 0x7f5a040707e0 2024-09-10T23:21:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9058073aa0 con 0x7f90580ca440 2024-09-10T23:21:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb220200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2180ce010 0x7fb218151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb220200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2180cfde0 0x7fb2181f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb220200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2180d0700 0x7fb2180cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb220200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180cde40 con 0x7fb2180d0700 2024-09-10T23:21:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb220200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180cdcc0 con 0x7fb2180ce010 2024-09-10T23:21:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb220200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb21815ff60 con 0x7fb2180cfde0 2024-09-10T23:21:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb21ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2180cfde0 0x7fb2181f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb21ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2180cfde0 0x7fb2181f8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:48284/0 (socket says 172.21.15.17:48284) 2024-09-10T23:21:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb21ce00640 1 -- 172.21.15.17:0/2953401347 learned_addr learned my addr 172.21.15.17:0/2953401347 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.360+0000 7fb21d800640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2180ce010 0x7fb218151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7fb21e200640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2180d0700 0x7fb2180cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a0406ebd0 con 0x7f5a040707e0 2024-09-10T23:21:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7fb21ce00640 1 -- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2180ce010 msgr2=0x7fb218151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7fb21ce00640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2180ce010 0x7fb218151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7fb21ce00640 1 -- 172.21.15.17:0/2953401347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2180d0700 msgr2=0x7fb2180cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7fb21ce00640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2180d0700 0x7fb2180cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7fb21ce00640 1 -- 172.21.15.17:0/2953401347 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2181f94f0 con 0x7fb2180cfde0 2024-09-10T23:21:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7fb21ce00640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2180cfde0 0x7fb2181f8d50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c410 tx=0x7fb20400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f904f400640 1 -- 172.21.15.17:0/2345314424 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f904403ab80 con 0x7f90580ca440 2024-09-10T23:21:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f59fe000640 1 -- 172.21.15.17:0/4100104763 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f59f4015070 con 0x7f5a040707e0 2024-09-10T23:21:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f904f400640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9038072630 0x7f9038074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f904f400640 1 -- 172.21.15.17:0/2345314424 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f9044093290 con 0x7f90580ca440 2024-09-10T23:21:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f9056a00640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9038072630 0x7f9038074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f9056a00640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9038072630 0x7f9038074af0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f90480018e0 tx=0x7f9048009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f59fe000640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59e80725e0 0x7f59e8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f59fe000640 1 -- 172.21.15.17:0/4100104763 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f59f4093220 con 0x7f5a040707e0 2024-09-10T23:21:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.364+0000 7f5a09e00640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59e80725e0 0x7f59e8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7f5a09e00640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59e80725e0 0x7f59e8074aa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f59f8000f70 tx=0x7f59f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7fb215600640 1 -- 172.21.15.17:0/2953401347 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204011790 con 0x7fb2180cfde0 2024-09-10T23:21:44.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7fb215600640 1 -- 172.21.15.17:0/2953401347 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb204017070 con 0x7fb2180cfde0 2024-09-10T23:21:44.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7fb215600640 1 -- 172.21.15.17:0/2953401347 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204011ce0 con 0x7fb2180cfde0 2024-09-10T23:21:44.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2181f97d0 con 0x7fb2180cfde0 2024-09-10T23:21:44.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2180b6200 con 0x7fb2180cfde0 2024-09-10T23:21:44.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7f904f400640 1 -- 172.21.15.17:0/2345314424 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f904405e200 con 0x7f90580ca440 2024-09-10T23:21:44.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2181f9cf0 con 0x7fb2180cfde0 2024-09-10T23:21:44.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7fb215600640 1 -- 172.21.15.17:0/2953401347 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb20401c460 con 0x7fb2180cfde0 2024-09-10T23:21:44.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.368+0000 7f59fe000640 1 -- 172.21.15.17:0/4100104763 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f59f405e080 con 0x7f5a040707e0 2024-09-10T23:21:44.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.372+0000 7fb215600640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1f80725e0 0x7fb1f8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.372+0000 7fb215600640 1 -- 172.21.15.17:0/2953401347 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7fb2040930b0 con 0x7fb2180cfde0 2024-09-10T23:21:44.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.372+0000 7fb21d800640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1f80725e0 0x7fb1f8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.372+0000 7fb21d800640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1f80725e0 0x7fb1f8074aa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009be0 tx=0x7fb20c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.376+0000 7fb215600640 1 -- 172.21.15.17:0/2953401347 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb20405e560 con 0x7fb2180cfde0 2024-09-10T23:21:44.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 -- 172.21.15.17:0/3542088052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f80b3360 msgr2=0x7f44f80d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 --2- 172.21.15.17:0/3542088052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f80b3360 0x7f44f80d03b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f44f80706e0 tx=0x7f44e401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 -- 172.21.15.17:0/3542088052 shutdown_connections 2024-09-10T23:21:44.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 --2- 172.21.15.17:0/3542088052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80d08f0 0x7f44f80b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 --2- 172.21.15.17:0/3542088052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f80b3360 0x7f44f80d03b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 --2- 172.21.15.17:0/3542088052 >> v2:172.21.15.17:3300/0 conn(0x7f44f815be40 0x7f44f80cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 -- 172.21.15.17:0/3542088052 >> 172.21.15.17:0/3542088052 conn(0x7f44f80d1d60 msgr2=0x7f44f80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:44.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 -- 172.21.15.17:0/3542088052 shutdown_connections 2024-09-10T23:21:44.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 -- 172.21.15.17:0/3542088052 wait complete. 2024-09-10T23:21:44.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 Processor -- start 2024-09-10T23:21:44.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.424+0000 7f44fee00640 1 -- start start 2024-09-10T23:21:44.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b3360 0x7f44f80b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44f80d08f0 0x7f44f81fb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f815be40 0x7f44f80b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f44f80afc60 con 0x7f44f80d08f0 2024-09-10T23:21:44.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f44f80afae0 con 0x7f44f815be40 2024-09-10T23:21:44.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f44f80afde0 con 0x7f44f80b3360 2024-09-10T23:21:44.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44f80d08f0 0x7f44f81fb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44f80d08f0 0x7f44f81fb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60748/0 (socket says 172.21.15.17:60748) 2024-09-10T23:21:44.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7400640 1 -- 172.21.15.17:0/3093574275 learned_addr learned my addr 172.21.15.17:0/3093574275 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:44.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7e00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b3360 0x7f44f80b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fce00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f815be40 0x7f44f80b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7e00640 1 -- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f815be40 msgr2=0x7f44f80b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7e00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f815be40 0x7f44f80b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7e00640 1 -- 172.21.15.17:0/3093574275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44f80d08f0 msgr2=0x7f44f81fb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7e00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44f80d08f0 0x7f44f81fb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7e00640 1 -- 172.21.15.17:0/3093574275 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f815ad20 con 0x7f44f80b3360 2024-09-10T23:21:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fce00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f815be40 0x7f44f80b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:21:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44f7e00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b3360 0x7f44f80b4bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f44e800e6f0 tx=0x7f44e800eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44efe00640 1 -- 172.21.15.17:0/3093574275 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e800ca10 con 0x7f44f80b3360 2024-09-10T23:21:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44efe00640 1 -- 172.21.15.17:0/3093574275 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44e800cca0 con 0x7f44f80b3360 2024-09-10T23:21:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44efe00640 1 -- 172.21.15.17:0/3093574275 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8010690 con 0x7f44f80b3360 2024-09-10T23:21:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f80b5190 con 0x7f44f80b3360 2024-09-10T23:21:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.428+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f815b2c0 con 0x7f44f80b3360 2024-09-10T23:21:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.432+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f80d2cb0 con 0x7f44f80b3360 2024-09-10T23:21:44.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.432+0000 7f44efe00640 1 -- 172.21.15.17:0/3093574275 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f44e8010830 con 0x7f44f80b3360 2024-09-10T23:21:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.432+0000 7f44efe00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44d80725e0 0x7f44d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.432+0000 7f44efe00640 1 -- 172.21.15.17:0/3093574275 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(103..103 src has 1..103) ==== 6101+0+0 (secure 0 0 0) 0x7f44e8093c30 con 0x7f44f80b3360 2024-09-10T23:21:44.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.432+0000 7f44f7400640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44d80725e0 0x7f44d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.436+0000 7f44f7400640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44d80725e0 0x7f44d8074aa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009230 tx=0x7f44e40a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:44.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.440+0000 7f44efe00640 1 -- 172.21.15.17:0/3093574275 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f44f80d2cb0 con 0x7f44f80b3360 2024-09-10T23:21:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.616+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f9058157ef0 con 0x7f90580ca440 2024-09-10T23:21:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.616+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fb2180d01c0 con 0x7fb2180cfde0 2024-09-10T23:21:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.644+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f5a040b4a60 con 0x7f5a040707e0 2024-09-10T23:21:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:44.688+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f44f80b13f0 con 0x7f44f80b3360 2024-09-10T23:21:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f904f400640 1 -- 172.21.15.17:0/2345314424 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7341 v72) ==== 95+0+0 (secure 0 0 0) 0x7f9044062c30 con 0x7f90580ca440 2024-09-10T23:21:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 7341 2024-09-10T23:21:45.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9038072630 msgr2=0x7f9038074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9038072630 0x7f9038074af0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f90480018e0 tx=0x7f9048009040 comp rx=0 tx=0).stop 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90580ca440 msgr2=0x7f90581529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90580ca440 0x7f90581529a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f904400c390 tx=0x7f904400c850 comp rx=0 tx=0).stop 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 shutdown_connections 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9038072630 0x7f9038074af0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f905815b840 0x7f9058152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90580ca440 0x7f90581529a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 --2- 172.21.15.17:0/2345314424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f905806e2e0 0x7f905806efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 >> 172.21.15.17:0/2345314424 conn(0x7f9058072f80 msgr2=0x7f905815d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 shutdown_connections 2024-09-10T23:21:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.456+0000 7f905de00640 1 -- 172.21.15.17:0/2345314424 wait complete. 2024-09-10T23:21:45.465 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:21:45.464+0000 7f039b400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:21:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.468+0000 7fb215600640 1 -- 172.21.15.17:0/2953401347 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6329 v73) ==== 95+0+0 (secure 0 0 0) 0x7fb20405de60 con 0x7fb2180cfde0 2024-09-10T23:21:45.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.468+0000 7f59fe000640 1 -- 172.21.15.17:0/4100104763 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6955 v73) ==== 95+0+0 (secure 0 0 0) 0x7f59f4062ab0 con 0x7f5a040707e0 2024-09-10T23:21:45.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.468+0000 7f44efe00640 1 -- 172.21.15.17:0/3093574275 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7350 v73) ==== 95+0+0 (secure 0 0 0) 0x7f44e805eb20 con 0x7f44f80b3360 2024-09-10T23:21:45.473 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 6955 2024-09-10T23:21:45.473 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 6329 2024-09-10T23:21:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:failed mds gid 7350 2024-09-10T23:21:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1f80725e0 msgr2=0x7fb1f8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1f80725e0 0x7fb1f8074aa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009be0 tx=0x7fb20c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2180cfde0 msgr2=0x7fb2181f8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2180cfde0 0x7fb2181f8d50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c410 tx=0x7fb20400c8d0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59e80725e0 msgr2=0x7f59e8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59e80725e0 0x7f59e8074aa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f59f8000f70 tx=0x7f59f8009040 comp rx=0 tx=0).stop 2024-09-10T23:21:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a040707e0 msgr2=0x7f5a0413eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a040707e0 0x7f5a0413eeb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f59f400e860 tx=0x7f59f400ed20 comp rx=0 tx=0).stop 2024-09-10T23:21:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44d80725e0 msgr2=0x7f44d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44d80725e0 0x7f44d8074aa0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009230 tx=0x7f44e40a7040 comp rx=0 tx=0).stop 2024-09-10T23:21:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b3360 msgr2=0x7f44f80b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b3360 0x7f44f80b4bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f44e800e6f0 tx=0x7f44e800eaf0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 shutdown_connections 2024-09-10T23:21:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f59e80725e0 0x7f59e8074aa0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5a0415a3d0 0x7f5a04141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a040707e0 0x7f5a0413eeb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 --2- 172.21.15.17:0/4100104763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a0406e760 0x7f5a040acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 >> 172.21.15.17:0/4100104763 conn(0x7f5a040b1730 msgr2=0x7f5a0415c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 shutdown_connections 2024-09-10T23:21:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44d80725e0 0x7f44d8074aa0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f815be40 0x7f44f80b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44f80d08f0 0x7f44f81fb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 --2- 172.21.15.17:0/3093574275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44f80b3360 0x7f44f80b4bb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 >> 172.21.15.17:0/3093574275 conn(0x7f44f80d1d60 msgr2=0x7f44f80b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 shutdown_connections 2024-09-10T23:21:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 shutdown_connections 2024-09-10T23:21:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1f80725e0 0x7fb1f8074aa0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2180d0700 0x7fb2180cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2180cfde0 0x7fb2181f8d50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 --2- 172.21.15.17:0/2953401347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2180ce010 0x7fb218151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 >> 172.21.15.17:0/2953401347 conn(0x7fb2180d1da0 msgr2=0x7fb2180ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f44fee00640 1 -- 172.21.15.17:0/3093574275 wait complete. 2024-09-10T23:21:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 shutdown_connections 2024-09-10T23:21:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7fb220200640 1 -- 172.21.15.17:0/2953401347 wait complete. 2024-09-10T23:21:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 shutdown_connections 2024-09-10T23:21:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.472+0000 7f5a0c800640 1 -- 172.21.15.17:0/4100104763 wait complete. 2024-09-10T23:21:45.493 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:21:45.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:21:45.497 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:21:45.498 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:45.503 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:21:45.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:21:45.504 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:21:45.505 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:21:45.506 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:21:45.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:21:45.509 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:21:45.509 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:45.510 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:21:45.510 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:45.553 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:21:45.554 DEBUG:teuthology.parallel:result is None 2024-09-10T23:21:45.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:45.588 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:21:45.599 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:21:45.600 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:21:45.643 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:21:45.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.704+0000 7f7829c00640 1 -- 172.21.15.17:0/116249791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f782415bc70 msgr2=0x7f78240cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.704+0000 7f7829c00640 1 --2- 172.21.15.17:0/116249791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f782415bc70 0x7f78240cfa20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f78240d2a50 tx=0x7f781401c870 comp rx=0 tx=0).stop 2024-09-10T23:21:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.704+0000 7f7829c00640 1 -- 172.21.15.17:0/116249791 shutdown_connections 2024-09-10T23:21:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.704+0000 7f7829c00640 1 --2- 172.21.15.17:0/116249791 >> v2:172.21.15.77:3300/0 conn(0x7f78240cc570 0x7f78240d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.704+0000 7f7829c00640 1 --2- 172.21.15.17:0/116249791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f782415bc70 0x7f78240cfa20 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.704+0000 7f7829c00640 1 -- 172.21.15.17:0/116249791 >> 172.21.15.17:0/116249791 conn(0x7f782409a9f0 msgr2=0x7f782409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.704+0000 7f7829c00640 1 -- 172.21.15.17:0/116249791 shutdown_connections 2024-09-10T23:21:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.704+0000 7f7829c00640 1 -- 172.21.15.17:0/116249791 wait complete. 2024-09-10T23:21:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 Processor -- start 2024-09-10T23:21:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 -- start start 2024-09-10T23:21:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78240cc570 0x7f782415cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78240d1ed0 0x7f7824159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f782415bc70 0x7f7824159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7824168ab0 con 0x7f78240cc570 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7824168930 con 0x7f782415bc70 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7824168c30 con 0x7f78240d1ed0 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7823e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78240cc570 0x7f782415cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7823e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78240cc570 0x7f782415cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60788/0 (socket says 172.21.15.17:60788) 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7823e00640 1 -- 172.21.15.17:0/60247552 learned_addr learned my addr 172.21.15.17:0/60247552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f781b400640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78240d1ed0 0x7f7824159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829200640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f782415bc70 0x7f7824159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7823e00640 1 -- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78240d1ed0 msgr2=0x7f7824159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7823e00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78240d1ed0 0x7f7824159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7823e00640 1 -- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f782415bc70 msgr2=0x7f7824159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7823e00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f782415bc70 0x7f7824159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7823e00640 1 -- 172.21.15.17:0/60247552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782414f040 con 0x7f78240cc570 2024-09-10T23:21:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7823e00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78240cc570 0x7f782415cca0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f78140b0040 tx=0x7f7814005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7820c00640 1 -- 172.21.15.17:0/60247552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78140b2040 con 0x7f78240cc570 2024-09-10T23:21:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7820c00640 1 -- 172.21.15.17:0/60247552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78140044b0 con 0x7f78240cc570 2024-09-10T23:21:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7820c00640 1 -- 172.21.15.17:0/60247552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814003860 con 0x7f78240cc570 2024-09-10T23:21:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782414f320 con 0x7f78240cc570 2024-09-10T23:21:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782414f8e0 con 0x7f78240cc570 2024-09-10T23:21:45.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.708+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78240d1990 con 0x7f78240cc570 2024-09-10T23:21:45.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.712+0000 7f7820c00640 1 -- 172.21.15.17:0/60247552 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7814003a00 con 0x7f78240cc570 2024-09-10T23:21:45.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.712+0000 7f7820c00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78000725e0 0x7f7800074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.712+0000 7f7820c00640 1 -- 172.21.15.17:0/60247552 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f781412d110 con 0x7f78240cc570 2024-09-10T23:21:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.712+0000 7f781b400640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78000725e0 0x7f7800074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.712+0000 7f781b400640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78000725e0 0x7f7800074aa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f782415a760 tx=0x7f780c009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.716+0000 7f7820c00640 1 -- 172.21.15.17:0/60247552 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f78140bd060 con 0x7f78240cc570 2024-09-10T23:21:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.932+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f782415b380 con 0x7f78240cc570 2024-09-10T23:21:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.932+0000 7f7820c00640 1 -- 172.21.15.17:0/60247552 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5217 (secure 0 0 0) 0x7f7814016490 con 0x7f78240cc570 2024-09-10T23:21:45.936 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:45.936 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":74,"btime":"2024-09-10T23:21:45:747328+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:45.747291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:replay","state_seq":1,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-10T23:21:45.936 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 74 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78000725e0 msgr2=0x7f7800074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78000725e0 0x7f7800074aa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f782415a760 tx=0x7f780c009110 comp rx=0 tx=0).stop 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78240cc570 msgr2=0x7f782415cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78240cc570 0x7f782415cca0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f78140b0040 tx=0x7f7814005770 comp rx=0 tx=0).stop 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 shutdown_connections 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78000725e0 0x7f7800074aa0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f782415bc70 0x7f7824159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78240d1ed0 0x7f7824159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 --2- 172.21.15.17:0/60247552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78240cc570 0x7f782415cca0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 >> 172.21.15.17:0/60247552 conn(0x7f782409a9f0 msgr2=0x7f782406dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 shutdown_connections 2024-09-10T23:21:45.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:45.936+0000 7f7829c00640 1 -- 172.21.15.17:0/60247552 wait complete. 2024-09-10T23:21:46.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:21:33.653384+0000', 'modified': '2024-09-10T23:21:45.747291+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7593}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7593': {'gid': 7593, 'name': 'c', 'rank': 0, 'incarnation': 74, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.17:6835/3574515762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 3574515762}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 3574515762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:21:46.360 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7593:up:replay 2024-09-10T23:21:47.361 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:47.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.516+0000 7f02a5400640 1 -- 172.21.15.17:0/4068659087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf230 msgr2=0x7f02a006e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:47.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.516+0000 7f02a5400640 1 --2- 172.21.15.17:0/4068659087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf230 0x7f02a006e750 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f029000a950 tx=0x7f0290020360 comp rx=0 tx=0).stop 2024-09-10T23:21:47.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 -- 172.21.15.17:0/4068659087 shutdown_connections 2024-09-10T23:21:47.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 --2- 172.21.15.17:0/4068659087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02a00b32d0 0x7f02a0150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:47.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 --2- 172.21.15.17:0/4068659087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf230 0x7f02a006e750 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:47.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 -- 172.21.15.17:0/4068659087 >> 172.21.15.17:0/4068659087 conn(0x7f02a006cfc0 msgr2=0x7f02a006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:47.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 -- 172.21.15.17:0/4068659087 shutdown_connections 2024-09-10T23:21:47.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 -- 172.21.15.17:0/4068659087 wait complete. 2024-09-10T23:21:47.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 Processor -- start 2024-09-10T23:21:47.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 -- start start 2024-09-10T23:21:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a00b32d0 0x7f02a0137e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02a00cf230 0x7f02a00741d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf610 0x7f02a01e8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f02a00d0330 con 0x7f02a00cf610 2024-09-10T23:21:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f02a00d01b0 con 0x7f02a00b32d0 2024-09-10T23:21:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f02a5400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f02a00d04b0 con 0x7f02a00cf230 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf610 0x7f02a01e8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf610 0x7f02a01e8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60674/0 (socket says 172.21.15.17:60674) 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029f200640 1 -- 172.21.15.17:0/669936390 learned_addr learned my addr 172.21.15.17:0/669936390 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029e800640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a00b32d0 0x7f02a0137e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f0297e00640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02a00cf230 0x7f02a00741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029f200640 1 -- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02a00cf230 msgr2=0x7f02a00741d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029f200640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02a00cf230 0x7f02a00741d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029f200640 1 -- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a00b32d0 msgr2=0x7f02a0137e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029f200640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a00b32d0 0x7f02a0137e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029f200640 1 -- 172.21.15.17:0/669936390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a0138380 con 0x7f02a00cf610 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.520+0000 7f029f200640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf610 0x7f02a01e8db0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f029800cce0 tx=0x7f029800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f0296a00640 1 -- 172.21.15.17:0/669936390 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029800f450 con 0x7f02a00cf610 2024-09-10T23:21:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f0296a00640 1 -- 172.21.15.17:0/669936390 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f029800f700 con 0x7f02a00cf610 2024-09-10T23:21:47.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f0296a00640 1 -- 172.21.15.17:0/669936390 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029800fb50 con 0x7f02a00cf610 2024-09-10T23:21:47.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a01f7a40 con 0x7f02a00cf610 2024-09-10T23:21:47.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a01f8000 con 0x7f02a00cf610 2024-09-10T23:21:47.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a0150d70 con 0x7f02a00cf610 2024-09-10T23:21:47.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f0296a00640 1 -- 172.21.15.17:0/669936390 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f029800e3b0 con 0x7f02a00cf610 2024-09-10T23:21:47.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f0296a00640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f027c0725e0 0x7f027c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:47.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f0296a00640 1 -- 172.21.15.17:0/669936390 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f0298093fd0 con 0x7f02a00cf610 2024-09-10T23:21:47.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.524+0000 7f029e800640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f027c0725e0 0x7f027c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:47.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.528+0000 7f029e800640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f027c0725e0 0x7f027c074aa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f02900b2000 tx=0x7f029001eba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.528+0000 7f0296a00640 1 -- 172.21.15.17:0/669936390 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0298014030 con 0x7f02a00cf610 2024-09-10T23:21:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.740+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02a014fcc0 con 0x7f02a00cf610 2024-09-10T23:21:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.740+0000 7f0296a00640 1 -- 172.21.15.17:0/669936390 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5220 (secure 0 0 0) 0x7f029805f430 con 0x7f02a00cf610 2024-09-10T23:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:47.744 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":75,"btime":"2024-09-10T23:21:46:749741+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:45.769900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-10T23:21:47.744 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 75 2024-09-10T23:21:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f027c0725e0 msgr2=0x7f027c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f027c0725e0 0x7f027c074aa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f02900b2000 tx=0x7f029001eba0 comp rx=0 tx=0).stop 2024-09-10T23:21:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf610 msgr2=0x7f02a01e8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf610 0x7f02a01e8db0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f029800cce0 tx=0x7f029800a620 comp rx=0 tx=0).stop 2024-09-10T23:21:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 shutdown_connections 2024-09-10T23:21:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f027c0725e0 0x7f027c074aa0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02a00cf610 0x7f02a01e8db0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02a00cf230 0x7f02a00741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 --2- 172.21.15.17:0/669936390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02a00b32d0 0x7f02a0137e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 >> 172.21.15.17:0/669936390 conn(0x7f02a006cfc0 msgr2=0x7f02a00cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 shutdown_connections 2024-09-10T23:21:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:47.744+0000 7f02a5400640 1 -- 172.21.15.17:0/669936390 wait complete. 2024-09-10T23:21:48.169 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:21:33.653384+0000', 'modified': '2024-09-10T23:21:45.769900+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7593}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7593': {'gid': 7593, 'name': 'c', 'rank': 0, 'incarnation': 74, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.17:6835/3574515762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 3574515762}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 3574515762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:21:48.169 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7593:up:reconnect 2024-09-10T23:21:49.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:49.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.328+0000 7f480b200640 1 -- 172.21.15.17:0/865807591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c0d2240 msgr2=0x7f480c0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.328+0000 7f480b200640 1 --2- 172.21.15.17:0/865807591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c0d2240 0x7f480c0cf010 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f4804009c80 tx=0x7f480401cda0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.328+0000 7f480b200640 1 -- 172.21.15.17:0/865807591 shutdown_connections 2024-09-10T23:21:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.328+0000 7f480b200640 1 --2- 172.21.15.17:0/865807591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c0d2240 0x7f480c0cf010 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.328+0000 7f480b200640 1 --2- 172.21.15.17:0/865807591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f480c15e190 0x7f480c0cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.328+0000 7f480b200640 1 -- 172.21.15.17:0/865807591 >> 172.21.15.17:0/865807591 conn(0x7f480c09a9f0 msgr2=0x7f480c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.328+0000 7f480b200640 1 -- 172.21.15.17:0/865807591 shutdown_connections 2024-09-10T23:21:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.328+0000 7f480b200640 1 -- 172.21.15.17:0/865807591 wait complete. 2024-09-10T23:21:49.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.328+0000 7f480b200640 1 Processor -- start 2024-09-10T23:21:49.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 -- start start 2024-09-10T23:21:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f480c0b1280 0x7f480c15bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f480c0d2240 0x7f480c15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c15e190 0x7f480c0b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f480c16ab60 con 0x7f480c15e190 2024-09-10T23:21:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f480c16a9e0 con 0x7f480c0d2240 2024-09-10T23:21:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f480c16ace0 con 0x7f480c0b1280 2024-09-10T23:21:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c15e190 0x7f480c0b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c15e190 0x7f480c0b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60698/0 (socket says 172.21.15.17:60698) 2024-09-10T23:21:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480a800640 1 -- 172.21.15.17:0/4152355842 learned_addr learned my addr 172.21.15.17:0/4152355842 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f4809e00640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f480c0b1280 0x7f480c15bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f4809400640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f480c0d2240 0x7f480c15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480a800640 1 -- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f480c0b1280 msgr2=0x7f480c15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480a800640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f480c0b1280 0x7f480c15bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480a800640 1 -- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f480c0d2240 msgr2=0x7f480c15d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480a800640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f480c0d2240 0x7f480c15d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480a800640 1 -- 172.21.15.17:0/4152355842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480c15c440 con 0x7f480c15e190 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480a800640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c15e190 0x7f480c0b1970 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f480401b450 tx=0x7f4804004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f4802000640 1 -- 172.21.15.17:0/4152355842 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48040bb070 con 0x7f480c15e190 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f4802000640 1 -- 172.21.15.17:0/4152355842 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4804004a50 con 0x7f480c15e190 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f4802000640 1 -- 172.21.15.17:0/4152355842 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48040b2040 con 0x7f480c15e190 2024-09-10T23:21:49.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480c15c720 con 0x7f480c15e190 2024-09-10T23:21:49.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f480c15cce0 con 0x7f480c15e190 2024-09-10T23:21:49.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.332+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f480c0cf010 con 0x7f480c15e190 2024-09-10T23:21:49.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.336+0000 7f4802000640 1 -- 172.21.15.17:0/4152355842 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f48040b5030 con 0x7f480c15e190 2024-09-10T23:21:49.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.336+0000 7f4802000640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47ec072610 0x7f47ec074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:49.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.336+0000 7f4802000640 1 -- 172.21.15.17:0/4152355842 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f480412cf20 con 0x7f480c15e190 2024-09-10T23:21:49.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.336+0000 7f4809e00640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47ec072610 0x7f47ec074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:49.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.336+0000 7f4809e00640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47ec072610 0x7f47ec074ad0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f47fc007fd0 tx=0x7f47fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:49.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.340+0000 7f4802000640 1 -- 172.21.15.17:0/4152355842 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4804016990 con 0x7f480c15e190 2024-09-10T23:21:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.548+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f480c15f750 con 0x7f480c15e190 2024-09-10T23:21:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.548+0000 7f4802000640 1 -- 172.21.15.17:0/4152355842 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5224 (secure 0 0 0) 0x7f48040f7d30 con 0x7f480c15e190 2024-09-10T23:21:49.550 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:49.550 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":77,"btime":"2024-09-10T23:21:48:762811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:48.762807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":6}]} 2024-09-10T23:21:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 77 2024-09-10T23:21:49.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47ec072610 msgr2=0x7f47ec074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47ec072610 0x7f47ec074ad0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f47fc007fd0 tx=0x7f47fc009040 comp rx=0 tx=0).stop 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c15e190 msgr2=0x7f480c0b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c15e190 0x7f480c0b1970 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f480401b450 tx=0x7f4804004270 comp rx=0 tx=0).stop 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 shutdown_connections 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47ec072610 0x7f47ec074ad0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f480c15e190 0x7f480c0b1970 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f480c0d2240 0x7f480c15d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 --2- 172.21.15.17:0/4152355842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f480c0b1280 0x7f480c15bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 >> 172.21.15.17:0/4152355842 conn(0x7f480c09a9f0 msgr2=0x7f480c155080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 shutdown_connections 2024-09-10T23:21:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:49.552+0000 7f480b200640 1 -- 172.21.15.17:0/4152355842 wait complete. 2024-09-10T23:21:49.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:21:33.653384+0000', 'modified': '2024-09-10T23:21:48.762807+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 107, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7593}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7593': {'gid': 7593, 'name': 'c', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.17:6835/3574515762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 3574515762}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 3574515762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7593, 'qdb_cluster': [7593]} 2024-09-10T23:21:49.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:21:49.974 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:21:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 -- 172.21.15.17:0/3382598452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c15a3d0 msgr2=0x7f571c1434c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 --2- 172.21.15.17:0/3382598452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c15a3d0 0x7f571c1434c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f570800a950 tx=0x7f5708020360 comp rx=0 tx=0).stop 2024-09-10T23:21:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 -- 172.21.15.17:0/3382598452 shutdown_connections 2024-09-10T23:21:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 --2- 172.21.15.17:0/3382598452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c15a3d0 0x7f571c1434c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 -- 172.21.15.17:0/3382598452 >> 172.21.15.17:0/3382598452 conn(0x7f571c0b1730 msgr2=0x7f571c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 -- 172.21.15.17:0/3382598452 shutdown_connections 2024-09-10T23:21:50.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 -- 172.21.15.17:0/3382598452 wait complete. 2024-09-10T23:21:50.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 Processor -- start 2024-09-10T23:21:50.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 -- start start 2024-09-10T23:21:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.124+0000 7f5723e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c06e760 0x7f571c1f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5723e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f571c0707e0 0x7f571c0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5723e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f571c15a3d0 0x7f571c1f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5723e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f571c06f8b0 con 0x7f571c15a3d0 2024-09-10T23:21:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5723e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f571c06f730 con 0x7f571c06e760 2024-09-10T23:21:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5723e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f571c06fa30 con 0x7f571c0707e0 2024-09-10T23:21:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f571c15a3d0 0x7f571c1f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c06e760 0x7f571c1f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5720a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f571c0707e0 0x7f571c0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c06e760 0x7f571c1f4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:51964/0 (socket says 172.21.15.17:51964) 2024-09-10T23:21:50.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f571c15a3d0 0x7f571c1f7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60700/0 (socket says 172.21.15.17:60700) 2024-09-10T23:21:50.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721400640 1 -- 172.21.15.17:0/1291509825 learned_addr learned my addr 172.21.15.17:0/1291509825 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:50.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721400640 1 -- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f571c0707e0 msgr2=0x7f571c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721400640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f571c0707e0 0x7f571c0ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721400640 1 -- 172.21.15.17:0/1291509825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f571c15a3d0 msgr2=0x7f571c1f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721400640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f571c15a3d0 0x7f571c1f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721400640 1 -- 172.21.15.17:0/1291509825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c0cd840 con 0x7f571c06e760 2024-09-10T23:21:50.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721e00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f571c15a3d0 0x7f571c1f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:21:50.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5720a00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f571c0707e0 0x7f571c0ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:21:50.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5721400640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c06e760 0x7f571c1f4080 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f571000c500 tx=0x7f571000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5719600640 1 -- 172.21.15.17:0/1291509825 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710016020 con 0x7f571c06e760 2024-09-10T23:21:50.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5719600640 1 -- 172.21.15.17:0/1291509825 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5710012940 con 0x7f571c06e760 2024-09-10T23:21:50.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5723e00640 1 -- 172.21.15.17:0/1291509825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c1e7a20 con 0x7f571c06e760 2024-09-10T23:21:50.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5719600640 1 -- 172.21.15.17:0/1291509825 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710012d90 con 0x7f571c06e760 2024-09-10T23:21:50.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5723e00640 1 -- 172.21.15.17:0/1291509825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c1e7fe0 con 0x7f571c06e760 2024-09-10T23:21:50.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.128+0000 7f5719600640 1 -- 172.21.15.17:0/1291509825 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f571001a3b0 con 0x7f571c06e760 2024-09-10T23:21:50.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5719600640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56fc072610 0x7f56fc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5719600640 1 -- 172.21.15.17:0/1291509825 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f5710093360 con 0x7f571c06e760 2024-09-10T23:21:50.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 Processor -- start 2024-09-10T23:21:50.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5720a00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56fc072610 0x7f56fc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 -- start start 2024-09-10T23:21:50.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5720a00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56fc072610 0x7f56fc074ad0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f57080b2000 tx=0x7f570801eba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dbc4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 0x562c5db788d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5db791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562c5da993f0 con 0x562c5db78e10 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c5d9d6b20 con 0x562c5dbc52f0 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562c5d9c5f50 con 0x562c5dbc49d0 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5db791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5720a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 0x562c5db788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dbc4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5db791f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60714/0 (socket says 172.21.15.17:60714) 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721e00640 1 -- 172.21.15.17:0/93119873 learned_addr learned my addr 172.21.15.17:0/93119873 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721e00640 1 -- 172.21.15.17:0/93119873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 msgr2=0x562c5dbc4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721e00640 1 --2- 172.21.15.17:0/93119873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dbc4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721e00640 1 -- 172.21.15.17:0/93119873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 msgr2=0x562c5db788d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721e00640 1 --2- 172.21.15.17:0/93119873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 0x562c5db788d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721e00640 1 -- 172.21.15.17:0/93119873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5d98d590 con 0x562c5db78e10 2024-09-10T23:21:50.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f5721e00640 1 --2- 172.21.15.17:0/93119873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5db791f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f571400f280 tx=0x7f571400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369c67fa526bf93a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f570e000640 1 -- 172.21.15.17:0/93119873 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714003b90 con 0x562c5db78e10 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f570e000640 1 -- 172.21.15.17:0/93119873 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5714018070 con 0x562c5db78e10 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f570e000640 1 -- 172.21.15.17:0/93119873 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714005330 con 0x562c5db78e10 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 -- 172.21.15.17:0/93119873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 msgr2=0x562c5db791f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 --2- 172.21.15.17:0/93119873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5db791f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f571400f280 tx=0x7f571400f740 comp rx=0 tx=0).stop 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 -- 172.21.15.17:0/93119873 shutdown_connections 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 --2- 172.21.15.17:0/93119873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5db791f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 --2- 172.21.15.17:0/93119873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 0x562c5db788d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 --2- 172.21.15.17:0/93119873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dbc4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 -- 172.21.15.17:0/93119873 >> 172.21.15.17:0/93119873 conn(0x562c5da62130 msgr2=0x562c5dba7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.132+0000 7f57272c3000 1 -- 172.21.15.17:0/93119873 shutdown_connections 2024-09-10T23:21:50.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 -- 172.21.15.17:0/93119873 wait complete. 2024-09-10T23:21:50.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 -- start start 2024-09-10T23:21:50.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 Processor -- start 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5dba56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dba5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 0x562c5dba63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562c5d9605d0 con 0x562c5db78e10 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c5d9c9d60 con 0x562c5dbc52f0 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562c5d96c500 con 0x562c5dbc49d0 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 10 client.0 _ll_register_callbacks cb 0x562c5d970810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5dba56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5dba56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60718/0 (socket says 172.21.15.17:60718) 2024-09-10T23:21:50.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721400640 1 -- 172.21.15.17:0/182262004 learned_addr learned my addr 172.21.15.17:0/182262004 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5720a00640 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dba5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721e00640 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 0x562c5dba63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721400640 1 -- 172.21.15.17:0/182262004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 msgr2=0x562c5dba5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721400640 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dba5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721400640 1 -- 172.21.15.17:0/182262004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 msgr2=0x562c5dba63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721400640 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 0x562c5dba63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721400640 1 -- 172.21.15.17:0/182262004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5d964170 con 0x562c5db78e10 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5721400640 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5dba56a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f571000c4d0 tx=0x7f5710093280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f2b0bcdc988a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5702a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5702a00640 1 -- 172.21.15.17:0/182262004 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710067650 con 0x562c5db78e10 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5702a00640 1 -- 172.21.15.17:0/182262004 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f571005a470 con 0x562c5db78e10 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 -- 172.21.15.17:0/182262004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c5d95e0f0 con 0x562c5db78e10 2024-09-10T23:21:50.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5702a00640 1 -- 172.21.15.17:0/182262004 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f571008f050 con 0x562c5db78e10 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 10 client.7626 fetch_fsmap learned FSMap version 77 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 -- 172.21.15.17:0/182262004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x562c5da4aef0 con 0x562c5db78e10 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5702a00640 1 -- 172.21.15.17:0/182262004 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562c5d95e0f0 con 0x562c5db78e10 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f5702a00640 1 -- 172.21.15.17:0/182262004 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f571005d460 con 0x562c5db78e10 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 10 client.7626 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 10 client.7626 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 20 client.7626 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x562c5dba70f0 0x562c5dbd6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 4 client.7626 mds_command: new command op to 7593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.136+0000 7f57272c3000 1 -- 172.21.15.17:0/182262004 --> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c5d9d8a70 con 0x562c5dba70f0 2024-09-10T23:21:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f5720a00640 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x562c5dba70f0 0x562c5dbd6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f5720a00640 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x562c5dba70f0 0x562c5dbd6c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aea5138074b524fa server_cookie=dbca698f1c8a63ec in_seq=0 out_seq=0 2024-09-10T23:21:50.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f5702a00640 10 client.7626 ms_handle_connect on v2:172.21.15.17:6834/3574515762 2024-09-10T23:21:50.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f5702a00640 1 -- 172.21.15.17:0/182262004 <== mds.0 v2:172.21.15.17:6834/3574515762 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c5d9d8a70 con 0x562c5dba70f0 2024-09-10T23:21:50.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f5702a00640 10 client.7626 handle_command_reply: tid=0 2024-09-10T23:21:50.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 client.7626 shutdown 2024-09-10T23:21:50.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 -- 172.21.15.17:0/182262004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 msgr2=0x562c5dba56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5dba56a0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f571000c4d0 tx=0x7f5710093280 comp rx=0 tx=0).stop 2024-09-10T23:21:50.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 -- 172.21.15.17:0/182262004 shutdown_connections 2024-09-10T23:21:50.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x562c5dba70f0 0x562c5dbd6c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5dbc52f0 0x562c5dba63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dba5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 --2- 172.21.15.17:0/182262004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5db78e10 0x562c5dba56a0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f5702a00640 0 client.7626 ms_handle_reset on v2:172.21.15.17:6834/3574515762 2024-09-10T23:21:50.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 -- 172.21.15.17:0/182262004 >> 172.21.15.17:0/182262004 conn(0x562c5da62130 msgr2=0x562c5db77fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 -- 172.21.15.17:0/182262004 shutdown_connections 2024-09-10T23:21:50.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 1 -- 172.21.15.17:0/182262004 wait complete. 2024-09-10T23:21:50.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.140+0000 7f57272c3000 20 client.7626 trim_cache size 0 max 16384 2024-09-10T23:21:50.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 Processor -- start 2024-09-10T23:21:50.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 -- start start 2024-09-10T23:21:50.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 0x562c5dc36bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dc37100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc52f0 0x562c5dc37640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f571c201490 con 0x562c5dbc52f0 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f571c2004d0 con 0x562c5db78e10 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f571c1ff960 con 0x562c5dbc49d0 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc52f0 0x562c5dc37640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc52f0 0x562c5dc37640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60730/0 (socket says 172.21.15.17:60730) 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721e00640 1 -- 172.21.15.17:0/924087233 learned_addr learned my addr 172.21.15.17:0/924087233 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5720a00640 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dc37100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721400640 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 0x562c5dc36bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721e00640 1 -- 172.21.15.17:0/924087233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 msgr2=0x562c5dc37100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:50.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721e00640 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dc37100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721e00640 1 -- 172.21.15.17:0/924087233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 msgr2=0x562c5dc36bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721e00640 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 0x562c5dc36bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721e00640 1 -- 172.21.15.17:0/924087233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5da21d90 con 0x562c5dbc52f0 2024-09-10T23:21:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721400640 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 0x562c5dc36bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f5721e00640 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc52f0 0x562c5dc37640 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5714014000 tx=0x7f5714001500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d9ba444f424603 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f570d600640 1 -- 172.21.15.17:0/924087233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57140052d0 con 0x562c5dbc52f0 2024-09-10T23:21:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f570d600640 1 -- 172.21.15.17:0/924087233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5714022070 con 0x562c5dbc52f0 2024-09-10T23:21:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f570d600640 1 -- 172.21.15.17:0/924087233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714005730 con 0x562c5dbc52f0 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 -- 172.21.15.17:0/924087233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc52f0 msgr2=0x562c5dc37640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc52f0 0x562c5dc37640 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f5714014000 tx=0x7f5714001500 comp rx=0 tx=0).stop 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 -- 172.21.15.17:0/924087233 shutdown_connections 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc52f0 0x562c5dc37640 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc49d0 0x562c5dc37100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 --2- 172.21.15.17:0/924087233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 0x562c5dc36bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 -- 172.21.15.17:0/924087233 >> 172.21.15.17:0/924087233 conn(0x562c5da62130 msgr2=0x562c5dbd1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 -- 172.21.15.17:0/924087233 shutdown_connections 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.160+0000 7f57272c3000 1 -- 172.21.15.17:0/924087233 wait complete. 2024-09-10T23:21:50.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 -- start start 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 Processor -- start 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 0x562c5dc3a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc49d0 0x562c5dc3ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc52f0 0x562c5dc3b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562c5da4aa60 con 0x562c5dbc49d0 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c5d9d58f0 con 0x562c5db78e10 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562c5da85730 con 0x562c5dbc52f0 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 10 client.0 _ll_register_callbacks cb 0x7f571005e0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5720a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc49d0 0x562c5dc3ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5720a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc49d0 0x562c5dc3ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60738/0 (socket says 172.21.15.17:60738) 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5721e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc52f0 0x562c5dc3b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5720a00640 1 -- 172.21.15.17:0/1967247710 learned_addr learned my addr 172.21.15.17:0/1967247710 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5721400640 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 0x562c5dc3a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5720a00640 1 -- 172.21.15.17:0/1967247710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc52f0 msgr2=0x562c5dc3b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5720a00640 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc52f0 0x562c5dc3b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5720a00640 1 -- 172.21.15.17:0/1967247710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 msgr2=0x562c5dc3a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5720a00640 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 0x562c5dc3a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5720a00640 1 -- 172.21.15.17:0/1967247710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5d98ca90 con 0x562c5dbc49d0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5720a00640 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc49d0 0x562c5dc3ad20 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f570800a8a0 tx=0x7f570800a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48ef00576278c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5702a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5702a00640 1 -- 172.21.15.17:0/1967247710 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57080b5050 con 0x562c5dbc49d0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5702a00640 1 -- 172.21.15.17:0/1967247710 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f5708004850 con 0x562c5dbc49d0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 -- 172.21.15.17:0/1967247710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5714022070 con 0x562c5dbc49d0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5702a00640 1 -- 172.21.15.17:0/1967247710 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f57080e0050 con 0x562c5dbc49d0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 10 client.7632 fetch_fsmap learned FSMap version 77 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 -- 172.21.15.17:0/1967247710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x562c5d96b050 con 0x562c5dbc49d0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5702a00640 1 -- 172.21.15.17:0/1967247710 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5714022070 con 0x562c5dbc49d0 2024-09-10T23:21:50.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5702a00640 1 -- 172.21.15.17:0/1967247710 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f57080e3020 con 0x562c5dbc49d0 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 10 client.7632 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 10 client.7632 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 20 client.7632 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x562c5dbd9c00 0x562c5dc43a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 4 client.7632 mds_command: new command op to 7593 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f57272c3000 1 -- 172.21.15.17:0/1967247710 --> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] -- command(tid 0: {"prefix": "status"}) -- 0x562c5d9d4520 con 0x562c5dbd9c00 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5721400640 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x562c5dbd9c00 0x562c5dc43a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5702a00640 10 client.7632 ms_handle_connect on v2:172.21.15.17:6834/3574515762 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5721400640 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x562c5dbd9c00 0x562c5dc43a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58cff618170ccca2 server_cookie=dcbdf83a04f2e1ae in_seq=0 out_seq=0 2024-09-10T23:21:50.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.164+0000 7f5702a00640 1 -- 172.21.15.17:0/1967247710 <== mds.0 v2:172.21.15.17:6834/3574515762 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x562c5d9d4520 con 0x562c5dbd9c00 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5702a00640 10 client.7632 handle_command_reply: tid=0 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 client.7632 shutdown 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 -- 172.21.15.17:0/1967247710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc49d0 msgr2=0x562c5dc3ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc49d0 0x562c5dc3ad20 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f570800a8a0 tx=0x7f570800a2f0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 -- 172.21.15.17:0/1967247710 shutdown_connections 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x562c5dbd9c00 0x562c5dc43a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c5dbc52f0 0x562c5dc3b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c5dbc49d0 0x562c5dc3ad20 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 --2- 172.21.15.17:0/1967247710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c5db78e10 0x562c5dc3a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5702a00640 0 client.7632 ms_handle_reset on v2:172.21.15.17:6834/3574515762 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 -- 172.21.15.17:0/1967247710 >> 172.21.15.17:0/1967247710 conn(0x562c5da62130 msgr2=0x562c5db80ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 -- 172.21.15.17:0/1967247710 shutdown_connections 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 1 -- 172.21.15.17:0/1967247710 wait complete. 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f57272c3000 20 client.7632 trim_cache size 0 max 16384 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7593, 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:21:50.174 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 4.4184307199999999, 2024-09-10T23:21:50.175 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 77, 2024-09-10T23:21:50.175 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 107, 2024-09-10T23:21:50.175 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 107, 2024-09-10T23:21:50.175 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 4.5213049300000003 2024-09-10T23:21:50.175 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:21:50.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 -- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56fc072610 msgr2=0x7f56fc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56fc072610 0x7f56fc074ad0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f57080b2000 tx=0x7f570801eba0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 -- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c06e760 msgr2=0x7f571c1f4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c06e760 0x7f571c1f4080 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f571000c500 tx=0x7f571000c9c0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 -- 172.21.15.17:0/1291509825 shutdown_connections 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56fc072610 0x7f56fc074ad0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f571c15a3d0 0x7f571c1f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f571c0707e0 0x7f571c0ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 --2- 172.21.15.17:0/1291509825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f571c06e760 0x7f571c1f4080 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 -- 172.21.15.17:0/1291509825 >> 172.21.15.17:0/1291509825 conn(0x7f571c0b1730 msgr2=0x7f571c0cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 -- 172.21.15.17:0/1291509825 shutdown_connections 2024-09-10T23:21:50.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.168+0000 7f5723e00640 1 -- 172.21.15.17:0/1291509825 wait complete. 2024-09-10T23:21:50.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-10T23:21:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 -- 172.21.15.17:0/1963415000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20145800 msgr2=0x7f3f200741d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 --2- 172.21.15.17:0/1963415000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20145800 0x7f3f200741d0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f3f200cf720 tx=0x7f3f1001c820 comp rx=0 tx=0).stop 2024-09-10T23:21:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 -- 172.21.15.17:0/1963415000 shutdown_connections 2024-09-10T23:21:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 --2- 172.21.15.17:0/1963415000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f2015fe80 0x7f3f20072c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 --2- 172.21.15.17:0/1963415000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20145800 0x7f3f200741d0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 -- 172.21.15.17:0/1963415000 >> 172.21.15.17:0/1963415000 conn(0x7f3f200b17a0 msgr2=0x7f3f200b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 -- 172.21.15.17:0/1963415000 shutdown_connections 2024-09-10T23:21:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 -- 172.21.15.17:0/1963415000 wait complete. 2024-09-10T23:21:50.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 Processor -- start 2024-09-10T23:21:50.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 -- start start 2024-09-10T23:21:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f20145800 0x7f3f2013d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2015fe80 0x7f3f20140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20160460 0x7f3f20141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20169330 con 0x7f3f20160460 2024-09-10T23:21:50.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f201691b0 con 0x7f3f2015fe80 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.340+0000 7f3f26600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f201694b0 con 0x7f3f20145800 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20160460 0x7f3f20141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20160460 0x7f3f20141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60754/0 (socket says 172.21.15.17:60754) 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1fe00640 1 -- 172.21.15.17:0/833919252 learned_addr learned my addr 172.21.15.17:0/833919252 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f16a00640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2015fe80 0x7f3f20140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1f400640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f20145800 0x7f3f2013d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1fe00640 1 -- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f20145800 msgr2=0x7f3f2013d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1fe00640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f20145800 0x7f3f2013d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1fe00640 1 -- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2015fe80 msgr2=0x7f3f20140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1fe00640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2015fe80 0x7f3f20140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1fe00640 1 -- 172.21.15.17:0/833919252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2013ec00 con 0x7f3f20160460 2024-09-10T23:21:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f1fe00640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20160460 0x7f3f20141420 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800ead0 tx=0x7f3f1800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f17e00640 1 -- 172.21.15.17:0/833919252 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18004b30 con 0x7f3f20160460 2024-09-10T23:21:50.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f17e00640 1 -- 172.21.15.17:0/833919252 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f18004dc0 con 0x7f3f20160460 2024-09-10T23:21:50.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f17e00640 1 -- 172.21.15.17:0/833919252 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18005280 con 0x7f3f20160460 2024-09-10T23:21:50.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2013eee0 con 0x7f3f20160460 2024-09-10T23:21:50.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2013ddc0 con 0x7f3f20160460 2024-09-10T23:21:50.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f200741d0 con 0x7f3f20160460 2024-09-10T23:21:50.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.344+0000 7f3f17e00640 1 -- 172.21.15.17:0/833919252 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3f18020030 con 0x7f3f20160460 2024-09-10T23:21:50.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.348+0000 7f3f17e00640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3efc0725e0 0x7f3efc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.348+0000 7f3f17e00640 1 -- 172.21.15.17:0/833919252 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f3f18093fe0 con 0x7f3f20160460 2024-09-10T23:21:50.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.348+0000 7f3f1f400640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3efc0725e0 0x7f3efc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.348+0000 7f3f1f400640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3efc0725e0 0x7f3efc074aa0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3f100af000 tx=0x7f3f1001b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.352+0000 7f3f17e00640 1 -- 172.21.15.17:0/833919252 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3f1805eda0 con 0x7f3f20160460 2024-09-10T23:21:50.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.524+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f3f201666b0 con 0x7f3f20160460 2024-09-10T23:21:50.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.528+0000 7f3f17e00640 1 -- 172.21.15.17:0/833919252 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v42)=0 v42) ==== 117+0+0 (secure 0 0 0) 0x7f3f180637d0 con 0x7f3f20160460 2024-09-10T23:21:50.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3efc0725e0 msgr2=0x7f3efc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3efc0725e0 0x7f3efc074aa0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3f100af000 tx=0x7f3f1001b060 comp rx=0 tx=0).stop 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20160460 msgr2=0x7f3f20141420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20160460 0x7f3f20141420 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800ead0 tx=0x7f3f1800ef90 comp rx=0 tx=0).stop 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 shutdown_connections 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3efc0725e0 0x7f3efc074aa0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f20160460 0x7f3f20141420 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f2015fe80 0x7f3f20140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 --2- 172.21.15.17:0/833919252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f20145800 0x7f3f2013d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 >> 172.21.15.17:0/833919252 conn(0x7f3f200b17a0 msgr2=0x7f3f2015e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 shutdown_connections 2024-09-10T23:21:50.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.532+0000 7f3f26600640 1 -- 172.21.15.17:0/833919252 wait complete. 2024-09-10T23:21:50.552 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-10T23:21:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.700+0000 7fa5e5200640 1 -- 172.21.15.17:0/2373085885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c4004da0 msgr2=0x7fa5c4005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.700+0000 7fa5e5200640 1 --2- 172.21.15.17:0/2373085885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c4004da0 0x7fa5c4005220 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009eb0 tx=0x7fa5d801d5b0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.700+0000 7fa5de800640 1 -- 172.21.15.17:0/2373085885 reap_dead start 2024-09-10T23:21:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.700+0000 7fa5e5200640 1 -- 172.21.15.17:0/2373085885 shutdown_connections 2024-09-10T23:21:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.700+0000 7fa5e5200640 1 -- 172.21.15.17:0/2373085885 >> 172.21.15.17:0/2373085885 conn(0x7fa5e009a9f0 msgr2=0x7fa5e009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.700+0000 7fa5e5200640 1 -- 172.21.15.17:0/2373085885 shutdown_connections 2024-09-10T23:21:50.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.700+0000 7fa5e5200640 1 -- 172.21.15.17:0/2373085885 wait complete. 2024-09-10T23:21:50.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 Processor -- start 2024-09-10T23:21:50.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 -- start start 2024-09-10T23:21:50.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c4004da0 0x7fa5e00b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5e01f7bd0 0x7fa5e01f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5e00b69b0 0x7fa5e01f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e00d2bf0 con 0x7fa5c4004da0 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e00d2a70 con 0x7fa5e01f7bd0 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e015c680 con 0x7fa5e00b69b0 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5dde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c4004da0 0x7fa5e00b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5dde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c4004da0 0x7fa5e00b6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60762/0 (socket says 172.21.15.17:60762) 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5dde00640 1 -- 172.21.15.17:0/473949492 learned_addr learned my addr 172.21.15.17:0/473949492 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5dde00640 1 -- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5e00b69b0 msgr2=0x7fa5e01f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5d7e00640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5e01f7bd0 0x7fa5e01f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5dde00640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5e00b69b0 0x7fa5e01f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5dde00640 1 -- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5e01f7bd0 msgr2=0x7fa5e01f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5dde00640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5e01f7bd0 0x7fa5e01f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5dde00640 1 -- 172.21.15.17:0/473949492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e00ceec0 con 0x7fa5c4004da0 2024-09-10T23:21:50.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5d7e00640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5e01f7bd0 0x7fa5e01f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:50.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5dde00640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c4004da0 0x7fa5e00b6470 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000e510 tx=0x7fa5d000e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5d6000640 1 -- 172.21.15.17:0/473949492 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0015070 con 0x7fa5c4004da0 2024-09-10T23:21:50.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5d6000640 1 -- 172.21.15.17:0/473949492 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5d0010980 con 0x7fa5c4004da0 2024-09-10T23:21:50.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5d6000640 1 -- 172.21.15.17:0/473949492 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0010db0 con 0x7fa5c4004da0 2024-09-10T23:21:50.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e01f8140 con 0x7fa5c4004da0 2024-09-10T23:21:50.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e01f8700 con 0x7fa5c4004da0 2024-09-10T23:21:50.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.704+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e00b12e0 con 0x7fa5c4004da0 2024-09-10T23:21:50.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.708+0000 7fa5d6000640 1 -- 172.21.15.17:0/473949492 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa5d0011460 con 0x7fa5c4004da0 2024-09-10T23:21:50.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.708+0000 7fa5d6000640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5bc072610 0x7fa5bc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:50.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.708+0000 7fa5d6000640 1 -- 172.21.15.17:0/473949492 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7fa5d0093af0 con 0x7fa5c4004da0 2024-09-10T23:21:50.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.708+0000 7fa5d7e00640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5bc072610 0x7fa5bc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:50.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.708+0000 7fa5d7e00640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5bc072610 0x7fa5bc074ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80046e0 tx=0x7fa5c8000f40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:50.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.712+0000 7fa5d6000640 1 -- 172.21.15.17:0/473949492 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa5e00b19f0 con 0x7fa5c4004da0 2024-09-10T23:21:50.758 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:21:50.756+0000 7f53fe000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:21:50.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.888+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fa5e0075670 con 0x7fa5c4004da0 2024-09-10T23:21:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5d6000640 1 -- 172.21.15.17:0/473949492 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v43)=0 v43) ==== 116+0+0 (secure 0 0 0) 0x7fa5d005efe0 con 0x7fa5c4004da0 2024-09-10T23:21:50.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5bc072610 msgr2=0x7fa5bc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5bc072610 0x7fa5bc074ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa5c80046e0 tx=0x7fa5c8000f40 comp rx=0 tx=0).stop 2024-09-10T23:21:50.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c4004da0 msgr2=0x7fa5e00b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:50.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c4004da0 0x7fa5e00b6470 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000e510 tx=0x7fa5d000e9d0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 shutdown_connections 2024-09-10T23:21:50.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa5bc072610 0x7fa5bc074ad0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5e00b69b0 0x7fa5e01f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5e01f7bd0 0x7fa5e01f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 --2- 172.21.15.17:0/473949492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c4004da0 0x7fa5e00b6470 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 >> 172.21.15.17:0/473949492 conn(0x7fa5e009a9f0 msgr2=0x7fa5e00b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 shutdown_connections 2024-09-10T23:21:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:50.892+0000 7fa5e5200640 1 -- 172.21.15.17:0/473949492 wait complete. 2024-09-10T23:21:50.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-10T23:21:51.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.060+0000 7f5ad5000640 1 -- 172.21.15.17:0/2649407230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad00af670 msgr2=0x7f5ad006d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.060+0000 7f5ad5000640 1 --2- 172.21.15.17:0/2649407230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad00af670 0x7f5ad006d5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000a980 tx=0x7f5ac001db00 comp rx=0 tx=0).stop 2024-09-10T23:21:51.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.060+0000 7f5ad5000640 1 -- 172.21.15.17:0/2649407230 shutdown_connections 2024-09-10T23:21:51.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.060+0000 7f5ad5000640 1 --2- 172.21.15.17:0/2649407230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad00af670 0x7f5ad006d5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.060+0000 7f5ad5000640 1 -- 172.21.15.17:0/2649407230 >> 172.21.15.17:0/2649407230 conn(0x7f5ad00b3e00 msgr2=0x7f5ad00b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:51.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.060+0000 7f5ad5000640 1 -- 172.21.15.17:0/2649407230 shutdown_connections 2024-09-10T23:21:51.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.060+0000 7f5ad5000640 1 -- 172.21.15.17:0/2649407230 wait complete. 2024-09-10T23:21:51.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 Processor -- start 2024-09-10T23:21:51.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 -- start start 2024-09-10T23:21:51.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad00af670 0x7f5ad00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00b6010 0x7f5ad0155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad00d03a0 0x7f5ad015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad00b1b70 con 0x7f5ad00af670 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad00b19f0 con 0x7f5ad00b6010 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad00b1cf0 con 0x7f5ad00d03a0 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5acde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad00af670 0x7f5ad00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5acde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad00af670 0x7f5ad00cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60766/0 (socket says 172.21.15.17:60766) 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5acde00640 1 -- 172.21.15.17:0/3490875403 learned_addr learned my addr 172.21.15.17:0/3490875403 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ac7e00640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00b6010 0x7f5ad0155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ace800640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad00d03a0 0x7f5ad015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5acde00640 1 -- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad00d03a0 msgr2=0x7f5ad015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5acde00640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad00d03a0 0x7f5ad015bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5acde00640 1 -- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00b6010 msgr2=0x7f5ad0155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5acde00640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00b6010 0x7f5ad0155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5acde00640 1 -- 172.21.15.17:0/3490875403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad01651d0 con 0x7f5ad00af670 2024-09-10T23:21:51.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ac7e00640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00b6010 0x7f5ad0155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:51.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ace800640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad00d03a0 0x7f5ad015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:51.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5acde00640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad00af670 0x7f5ad00cd920 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f5ac001b730 tx=0x7f5ac0005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:51.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ac6000640 1 -- 172.21.15.17:0/3490875403 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00b3040 con 0x7f5ad00af670 2024-09-10T23:21:51.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ac6000640 1 -- 172.21.15.17:0/3490875403 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ac0005230 con 0x7f5ad00af670 2024-09-10T23:21:51.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ac6000640 1 -- 172.21.15.17:0/3490875403 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00046d0 con 0x7f5ad00af670 2024-09-10T23:21:51.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad00c4af0 con 0x7f5ad00af670 2024-09-10T23:21:51.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.064+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad0164c10 con 0x7f5ad00af670 2024-09-10T23:21:51.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.068+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad00c4840 con 0x7f5ad00af670 2024-09-10T23:21:51.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.068+0000 7f5ac6000640 1 -- 172.21.15.17:0/3490875403 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5ac000b040 con 0x7f5ad00af670 2024-09-10T23:21:51.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.068+0000 7f5ac6000640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5aac0725e0 0x7f5aac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.068+0000 7f5ac6000640 1 -- 172.21.15.17:0/3490875403 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f5ac012d820 con 0x7f5ad00af670 2024-09-10T23:21:51.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.068+0000 7f5ac7e00640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5aac0725e0 0x7f5aac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.072+0000 7f5ac7e00640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5aac0725e0 0x7f5aac074aa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00b2cc0 tx=0x7f5ab8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:51.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.072+0000 7f5ac6000640 1 -- 172.21.15.17:0/3490875403 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5ac00c5020 con 0x7f5ad00af670 2024-09-10T23:21:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.248+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f5ad006d5a0 con 0x7f5ad00af670 2024-09-10T23:21:51.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.252+0000 7f5ac6000640 1 -- 172.21.15.17:0/3490875403 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v44)=0 v44) ==== 116+0+0 (secure 0 0 0) 0x7f5ac0017780 con 0x7f5ad00af670 2024-09-10T23:21:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5aac0725e0 msgr2=0x7f5aac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5aac0725e0 0x7f5aac074aa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00b2cc0 tx=0x7f5ab8009040 comp rx=0 tx=0).stop 2024-09-10T23:21:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad00af670 msgr2=0x7f5ad00cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad00af670 0x7f5ad00cd920 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f5ac001b730 tx=0x7f5ac0005d20 comp rx=0 tx=0).stop 2024-09-10T23:21:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 shutdown_connections 2024-09-10T23:21:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5aac0725e0 0x7f5aac074aa0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad00d03a0 0x7f5ad015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00b6010 0x7f5ad0155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 --2- 172.21.15.17:0/3490875403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad00af670 0x7f5ad00cd920 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 >> 172.21.15.17:0/3490875403 conn(0x7f5ad00b3e00 msgr2=0x7f5ad00ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 shutdown_connections 2024-09-10T23:21:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.256+0000 7f5ad5000640 1 -- 172.21.15.17:0/3490875403 wait complete. 2024-09-10T23:21:51.277 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:51.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 -- 172.21.15.17:0/1762647835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc15bc70 msgr2=0x7fe2bc0cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 --2- 172.21.15.17:0/1762647835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc15bc70 0x7fe2bc0cfa20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0cf530 tx=0x7fe2ac01c7d0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 -- 172.21.15.17:0/1762647835 shutdown_connections 2024-09-10T23:21:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 --2- 172.21.15.17:0/1762647835 >> v2:172.21.15.77:3300/0 conn(0x7fe2bc0d20a0 0x7fe2bc0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 --2- 172.21.15.17:0/1762647835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc15bc70 0x7fe2bc0cfa20 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 -- 172.21.15.17:0/1762647835 >> 172.21.15.17:0/1762647835 conn(0x7fe2bc09a9f0 msgr2=0x7fe2bc09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 -- 172.21.15.17:0/1762647835 shutdown_connections 2024-09-10T23:21:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 -- 172.21.15.17:0/1762647835 wait complete. 2024-09-10T23:21:51.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 Processor -- start 2024-09-10T23:21:51.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 -- start start 2024-09-10T23:21:51.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc0cc570 0x7fe2bc15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2bc0d20a0 0x7fe2bc14cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc15bc70 0x7fe2bc0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1688a0 con 0x7fe2bc0cc570 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc168720 con 0x7fe2bc15bc70 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2c1000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe2bc168a20 con 0x7fe2bc0d20a0 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc0cc570 0x7fe2bc15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc0cc570 0x7fe2bc15c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60784/0 (socket says 172.21.15.17:60784) 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2bb400640 1 -- 172.21.15.17:0/2034682632 learned_addr learned my addr 172.21.15.17:0/2034682632 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2bbe00640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc15bc70 0x7fe2bc0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2b2a00640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2bc0d20a0 0x7fe2bc14cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2bb400640 1 -- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2bc0d20a0 msgr2=0x7fe2bc14cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2bb400640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2bc0d20a0 0x7fe2bc14cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2bb400640 1 -- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc15bc70 msgr2=0x7fe2bc0b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2bb400640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc15bc70 0x7fe2bc0b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.424+0000 7fe2bb400640 1 -- 172.21.15.17:0/2034682632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc15a6a0 con 0x7fe2bc0cc570 2024-09-10T23:21:51.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2bb400640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc0cc570 0x7fe2bc15c1d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac000c10 tx=0x7fe2ac004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:51.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2b3e00640 1 -- 172.21.15.17:0/2034682632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0bb070 con 0x7fe2bc0cc570 2024-09-10T23:21:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2b3e00640 1 -- 172.21.15.17:0/2034682632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2ac005030 con 0x7fe2bc0cc570 2024-09-10T23:21:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2b3e00640 1 -- 172.21.15.17:0/2034682632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0b2040 con 0x7fe2bc0cc570 2024-09-10T23:21:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc159f10 con 0x7fe2bc0cc570 2024-09-10T23:21:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc0caa00 con 0x7fe2bc0cc570 2024-09-10T23:21:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2bc0b10f0 con 0x7fe2bc0cc570 2024-09-10T23:21:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2b3e00640 1 -- 172.21.15.17:0/2034682632 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe2ac0b5030 con 0x7fe2bc0cc570 2024-09-10T23:21:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2b3e00640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2980725e0 0x7fe298074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2b3e00640 1 -- 172.21.15.17:0/2034682632 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7fe2ac12caa0 con 0x7fe2bc0cc570 2024-09-10T23:21:51.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.428+0000 7fe2b2a00640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2980725e0 0x7fe298074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.432+0000 7fe2b2a00640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2980725e0 0x7fe298074aa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0b4c50 tx=0x7fe2a4007d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:51.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.432+0000 7fe2b3e00640 1 -- 172.21.15.17:0/2034682632 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe2ac0163f0 con 0x7fe2bc0cc570 2024-09-10T23:21:51.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.648+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2bc0718e0 con 0x7fe2bc0cc570 2024-09-10T23:21:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.648+0000 7fe2b3e00640 1 -- 172.21.15.17:0/2034682632 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5224 (secure 0 0 0) 0x7fe2ac0f7940 con 0x7fe2bc0cc570 2024-09-10T23:21:51.650 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:51.650 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":77,"btime":"2024-09-10T23:21:48:762811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:48.762807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":6}]} 2024-09-10T23:21:51.651 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 77 2024-09-10T23:21:51.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2980725e0 msgr2=0x7fe298074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2980725e0 0x7fe298074aa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0b4c50 tx=0x7fe2a4007d50 comp rx=0 tx=0).stop 2024-09-10T23:21:51.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc0cc570 msgr2=0x7fe2bc15c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc0cc570 0x7fe2bc15c1d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac000c10 tx=0x7fe2ac004040 comp rx=0 tx=0).stop 2024-09-10T23:21:51.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 shutdown_connections 2024-09-10T23:21:51.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2980725e0 0x7fe298074aa0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2bc15bc70 0x7fe2bc0b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2bc0d20a0 0x7fe2bc14cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 --2- 172.21.15.17:0/2034682632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2bc0cc570 0x7fe2bc15c1d0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 >> 172.21.15.17:0/2034682632 conn(0x7fe2bc09a9f0 msgr2=0x7fe2bc06dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:51.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 shutdown_connections 2024-09-10T23:21:51.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.652+0000 7fe2c1000640 1 -- 172.21.15.17:0/2034682632 wait complete. 2024-09-10T23:21:51.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-10T23:21:51.834 INFO:teuthology.orchestra.run.smithi017.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T23:21:42.856529+0000","btime":"2024-09-10T23:21:41.956271+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T23:21:42.856529+0000","atime":"2024-09-10T23:21:41.956271+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T23:21:42.856529+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:21:42.857791+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:21:42.857791+0000"},"version":86,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T23:21:51.834 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-10T23:21:42.857791+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T23:21:41.956271+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T23:21:41.956271+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T23:21:42.856529+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-10T23:21:42.856529+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-10T23:21:42.856529+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-10T23:21:42.857791+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 86, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-10T23:21:51.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:21:51.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-09-10T23:21:51.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.984+0000 7f5f61000640 1 -- 172.21.15.17:0/1117460399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f400039f0 msgr2=0x7f5f40003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.984+0000 7f5f61000640 1 --2- 172.21.15.17:0/1117460399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f400039f0 0x7f5f40003dd0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c001730 tx=0x7f5f4c01c800 comp rx=0 tx=0).stop 2024-09-10T23:21:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.984+0000 7f5f5a800640 1 -- 172.21.15.17:0/1117460399 reap_dead start 2024-09-10T23:21:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.984+0000 7f5f61000640 1 -- 172.21.15.17:0/1117460399 shutdown_connections 2024-09-10T23:21:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.984+0000 7f5f61000640 1 -- 172.21.15.17:0/1117460399 >> 172.21.15.17:0/1117460399 conn(0x7f5f5c0b17a0 msgr2=0x7f5f5c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.984+0000 7f5f61000640 1 -- 172.21.15.17:0/1117460399 shutdown_connections 2024-09-10T23:21:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.984+0000 7f5f61000640 1 -- 172.21.15.17:0/1117460399 wait complete. 2024-09-10T23:21:51.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 Processor -- start 2024-09-10T23:21:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 -- start start 2024-09-10T23:21:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f400039f0 0x7f5f5c165330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f5c0cdc20 0x7f5f5c15f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f5c1ed6b0 0x7f5f5c15fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c166860 con 0x7f5f400039f0 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c073d80 con 0x7f5f5c0cdc20 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5c1669e0 con 0x7f5f5c1ed6b0 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f400039f0 0x7f5f5c165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f400039f0 0x7f5f5c165330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60802/0 (socket says 172.21.15.17:60802) 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f59e00640 1 -- 172.21.15.17:0/3253280634 learned_addr learned my addr 172.21.15.17:0/3253280634 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f53e00640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f5c0cdc20 0x7f5f5c15f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f5a800640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f5c1ed6b0 0x7f5f5c15fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f59e00640 1 -- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f5c1ed6b0 msgr2=0x7f5f5c15fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f59e00640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f5c1ed6b0 0x7f5f5c15fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f59e00640 1 -- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f5c0cdc20 msgr2=0x7f5f5c15f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f59e00640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f5c0cdc20 0x7f5f5c15f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f59e00640 1 -- 172.21.15.17:0/3253280634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c1ebb10 con 0x7f5f400039f0 2024-09-10T23:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f59e00640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f400039f0 0x7f5f5c165330 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c01c630 tx=0x7f5f4c004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f52000640 1 -- 172.21.15.17:0/3253280634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c0aa040 con 0x7f5f400039f0 2024-09-10T23:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f52000640 1 -- 172.21.15.17:0/3253280634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f4c006050 con 0x7f5f400039f0 2024-09-10T23:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f52000640 1 -- 172.21.15.17:0/3253280634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c001330 con 0x7f5f400039f0 2024-09-10T23:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 -- 172.21.15.17:0/3253280634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5c1ebdf0 con 0x7f5f400039f0 2024-09-10T23:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.988+0000 7f5f61000640 1 -- 172.21.15.17:0/3253280634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5c1ec3b0 con 0x7f5f400039f0 2024-09-10T23:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f52000640 1 -- 172.21.15.17:0/3253280634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5f4c0a6500 con 0x7f5f400039f0 2024-09-10T23:21:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f52000640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f38072610 0x7f5f38074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f64318000 1 Processor -- start 2024-09-10T23:21:51.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f52000640 1 -- 172.21.15.17:0/3253280634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f5f4c12cf30 con 0x7f5f400039f0 2024-09-10T23:21:51.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f64318000 1 -- start start 2024-09-10T23:21:51.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f38072610 0x7f5f38074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f64318000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 0x55f67974b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f64318000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974b550 0x55f679701340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f64318000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 0x55f679701c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:51.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f64318000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f67955ca40 con 0x55f67974b550 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f64318000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f67954be70 con 0x55f679701880 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f64318000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f67954fc80 con 0x55f67974ac30 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f38072610 0x7f5f38074ad0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c1ed450 tx=0x7f5f440091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974b550 0x55f679701340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974b550 0x55f679701340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60814/0 (socket says 172.21.15.17:60814) 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 -- 172.21.15.17:0/2701432261 learned_addr learned my addr 172.21.15.17:0/2701432261 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f5a800640 1 --2- 172.21.15.17:0/2701432261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 0x55f679701c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f59e00640 1 --2- 172.21.15.17:0/2701432261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 0x55f67974b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 -- 172.21.15.17:0/2701432261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 msgr2=0x55f67974b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 --2- 172.21.15.17:0/2701432261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 0x55f67974b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 -- 172.21.15.17:0/2701432261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 msgr2=0x55f679701c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 --2- 172.21.15.17:0/2701432261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 0x55f679701c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 -- 172.21.15.17:0/2701432261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f679595040 con 0x55f67974b550 2024-09-10T23:21:51.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.992+0000 7f5f53e00640 1 --2- 172.21.15.17:0/2701432261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974b550 0x55f679701340 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5f44012e60 tx=0x7f5f44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6947bbe8a3e5fef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f4aa00640 1 -- 172.21.15.17:0/2701432261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4402e070 con 0x55f67974b550 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f4aa00640 1 -- 172.21.15.17:0/2701432261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f4401e920 con 0x55f67974b550 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f4aa00640 1 -- 172.21.15.17:0/2701432261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4401eb50 con 0x55f67974b550 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- 172.21.15.17:0/2701432261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974b550 msgr2=0x55f679701340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 --2- 172.21.15.17:0/2701432261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974b550 0x55f679701340 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f5f44012e60 tx=0x7f5f44017000 comp rx=0 tx=0).stop 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- 172.21.15.17:0/2701432261 shutdown_connections 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 --2- 172.21.15.17:0/2701432261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 0x55f679701c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 --2- 172.21.15.17:0/2701432261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974b550 0x55f679701340 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 --2- 172.21.15.17:0/2701432261 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 0x55f67974b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- 172.21.15.17:0/2701432261 >> 172.21.15.17:0/2701432261 conn(0x55f6796fd800 msgr2=0x55f6796ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- 172.21.15.17:0/2701432261 shutdown_connections 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- 172.21.15.17:0/2701432261 wait complete. 2024-09-10T23:21:51.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- start start 2024-09-10T23:21:51.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 Processor -- start 2024-09-10T23:21:52.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f679701880 0x55f67970bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 0x55f67970c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 0x55f67970c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f67958fb60 con 0x55f679701880 2024-09-10T23:21:52.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f6794f5950 con 0x55f67974b550 2024-09-10T23:21:52.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f679501bb0 con 0x55f67974ac30 2024-09-10T23:21:52.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 10 client.0 _ll_register_callbacks cb 0x55f6794f23f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f679701880 0x55f67970bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f679701880 0x55f67970bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60830/0 (socket says 172.21.15.17:60830) 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f59e00640 1 -- 172.21.15.17:0/1442518119 learned_addr learned my addr 172.21.15.17:0/1442518119 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f53e00640 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 0x55f67970c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f5a800640 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 0x55f67970c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f59e00640 1 -- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 msgr2=0x55f67970c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f59e00640 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 0x55f67970c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f59e00640 1 -- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 msgr2=0x55f67970c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f59e00640 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 0x55f67970c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f59e00640 1 -- 172.21.15.17:0/1442518119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6794f4b30 con 0x55f679701880 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f53e00640 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 0x55f67970c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f5a800640 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 0x55f67970c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:21:52.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f59e00640 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f679701880 0x55f67970bbf0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c01cce0 tx=0x7f5f4c0f75a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81b51e452d0b5a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f3f400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f3f400640 1 -- 172.21.15.17:0/1442518119 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c0f7d20 con 0x55f679701880 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f3f400640 1 -- 172.21.15.17:0/1442518119 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f5f4c004d50 con 0x55f679701880 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f64318000 1 -- 172.21.15.17:0/1442518119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6794e41e0 con 0x55f679701880 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:51.996+0000 7f5f3f400640 1 -- 172.21.15.17:0/1442518119 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f5f4c0fc800 con 0x55f679701880 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 10 client.7674 fetch_fsmap learned FSMap version 77 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 -- 172.21.15.17:0/1442518119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x55f6794ea0a0 con 0x55f679701880 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f3f400640 1 -- 172.21.15.17:0/1442518119 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f6794e41e0 con 0x55f679701880 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f3f400640 1 -- 172.21.15.17:0/1442518119 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f5f4c0f6f80 con 0x55f679701880 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 10 client.7674 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 10 client.7674 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 20 client.7674 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:52.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x55f679759ed0 0x55f67975c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 4 client.7674 mds_command: new command op to 7593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:21:52.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 -- 172.21.15.17:0/1442518119 --> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f67955e990 con 0x55f679759ed0 2024-09-10T23:21:52.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f53e00640 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x55f679759ed0 0x55f67975c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f3f400640 10 client.7674 ms_handle_connect on v2:172.21.15.17:6834/3574515762 2024-09-10T23:21:52.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f53e00640 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x55f679759ed0 0x55f67975c2c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f49a0dd609a04ee5 server_cookie=fba5fd3e2e9603d5 in_seq=0 out_seq=0 2024-09-10T23:21:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f3f400640 1 -- 172.21.15.17:0/1442518119 <== mds.0 v2:172.21.15.17:6834/3574515762 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f67955e990 con 0x55f679759ed0 2024-09-10T23:21:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f3f400640 10 client.7674 handle_command_reply: tid=0 2024-09-10T23:21:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 client.7674 shutdown 2024-09-10T23:21:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 -- 172.21.15.17:0/1442518119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f679701880 msgr2=0x55f67970bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f679701880 0x55f67970bbf0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c01cce0 tx=0x7f5f4c0f75a0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 -- 172.21.15.17:0/1442518119 shutdown_connections 2024-09-10T23:21:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x55f679759ed0 0x55f67975c2c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 0x55f67970c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974ac30 0x55f67970c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 --2- 172.21.15.17:0/1442518119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f679701880 0x55f67970bbf0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 -- 172.21.15.17:0/1442518119 >> 172.21.15.17:0/1442518119 conn(0x55f6796fd800 msgr2=0x55f679700410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:52.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f3f400640 0 client.7674 ms_handle_reset on v2:172.21.15.17:6834/3574515762 2024-09-10T23:21:52.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 -- 172.21.15.17:0/1442518119 shutdown_connections 2024-09-10T23:21:52.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 1 -- 172.21.15.17:0/1442518119 wait complete. 2024-09-10T23:21:52.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.000+0000 7f5f64318000 20 client.7674 trim_cache size 0 max 16384 2024-09-10T23:21:52.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 Processor -- start 2024-09-10T23:21:52.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 -- start start 2024-09-10T23:21:52.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 0x55f679700d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6796ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974b550 0x55f679700130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c203d90 con 0x55f67974ac30 2024-09-10T23:21:52.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c2030f0 con 0x55f679701880 2024-09-10T23:21:52.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5c203740 con 0x55f67974b550 2024-09-10T23:21:52.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6796ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6796ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60844/0 (socket says 172.21.15.17:60844) 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f53e00640 1 -- 172.21.15.17:0/2697881770 learned_addr learned my addr 172.21.15.17:0/2697881770 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f59e00640 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 0x55f679700d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f5a800640 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974b550 0x55f679700130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f53e00640 1 -- 172.21.15.17:0/2697881770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974b550 msgr2=0x55f679700130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f53e00640 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974b550 0x55f679700130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f53e00640 1 -- 172.21.15.17:0/2697881770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 msgr2=0x55f679700d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f53e00640 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 0x55f679700d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f53e00640 1 -- 172.21.15.17:0/2697881770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6795d0dc0 con 0x55f67974ac30 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f59e00640 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 0x55f679700d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:52.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f53e00640 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6796ffbf0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400a010 tx=0x7f5f440046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52db8acecb7f686d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:52.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f4a000640 1 -- 172.21.15.17:0/2697881770 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4402e040 con 0x55f67974ac30 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f4a000640 1 -- 172.21.15.17:0/2697881770 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f44005020 con 0x55f67974ac30 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f4a000640 1 -- 172.21.15.17:0/2697881770 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44005450 con 0x55f67974ac30 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 -- 172.21.15.17:0/2697881770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 msgr2=0x55f6796ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6796ffbf0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400a010 tx=0x7f5f440046d0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 -- 172.21.15.17:0/2697881770 shutdown_connections 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f67974b550 0x55f679700130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6796ffbf0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 --2- 172.21.15.17:0/2697881770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f679701880 0x55f679700d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 -- 172.21.15.17:0/2697881770 >> 172.21.15.17:0/2697881770 conn(0x55f6796fd800 msgr2=0x55f679706c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 -- 172.21.15.17:0/2697881770 shutdown_connections 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.020+0000 7f5f64318000 1 -- 172.21.15.17:0/2697881770 wait complete. 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 -- start start 2024-09-10T23:21:52.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 Processor -- start 2024-09-10T23:21:52.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f679701880 0x55f6797c1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6797c1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 0x55f6797c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f679517f40 con 0x55f67974ac30 2024-09-10T23:21:52.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f679517760 con 0x55f67974b550 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f67954ef90 con 0x55f679701880 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 10 client.0 _ll_register_callbacks cb 0x7f5f4c0f3bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6797c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f679701880 0x55f6797c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f679701880 0x55f6797c1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:41466/0 (socket says 172.21.15.17:41466) 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f59e00640 1 -- 172.21.15.17:0/3765178760 learned_addr learned my addr 172.21.15.17:0/3765178760 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f5a800640 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 0x55f6797c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f53e00640 1 -- 172.21.15.17:0/3765178760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f679701880 msgr2=0x55f6797c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f53e00640 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f679701880 0x55f6797c1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f53e00640 1 -- 172.21.15.17:0/3765178760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 msgr2=0x55f6797c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f53e00640 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 0x55f6797c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f53e00640 1 -- 172.21.15.17:0/3765178760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6794e2620 con 0x55f67974ac30 2024-09-10T23:21:52.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f53e00640 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6797c1990 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f5f440058a0 tx=0x7f5f44009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec4e38ea55c558d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f3f400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f3f400640 1 -- 172.21.15.17:0/3765178760 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4402e040 con 0x55f67974ac30 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f3f400640 1 -- 172.21.15.17:0/3765178760 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f5f440052b0 con 0x55f67974ac30 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 -- 172.21.15.17:0/3765178760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f44005020 con 0x55f67974ac30 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f3f400640 1 -- 172.21.15.17:0/3765178760 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f5f44048050 con 0x55f67974ac30 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 10 client.7680 fetch_fsmap learned FSMap version 77 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 -- 172.21.15.17:0/3765178760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x55f679514af0 con 0x55f67974ac30 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f3f400640 1 -- 172.21.15.17:0/3765178760 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f44005020 con 0x55f67974ac30 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f3f400640 1 -- 172.21.15.17:0/3765178760 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7f5f4404b020 con 0x55f67974ac30 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 10 client.7680 fetch_fsmap finished waiting for FSMap version 77 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 10 client.7680 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 20 client.7680 populate_metadata read hostname 'smithi017' 2024-09-10T23:21:52.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x55f67975ea20 0x55f67975ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 4 client.7680 mds_command: new command op to 7593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f64318000 1 -- 172.21.15.17:0/3765178760 --> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x55f67955a440 con 0x55f67975ea20 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f59e00640 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x55f67975ea20 0x55f67975ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f3f400640 10 client.7680 ms_handle_connect on v2:172.21.15.17:6834/3574515762 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.024+0000 7f5f59e00640 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x55f67975ea20 0x55f67975ee00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5441e1b4918bf8b3 server_cookie=9f9ef7b57cb7ea3d in_seq=0 out_seq=0 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f3f400640 1 -- 172.21.15.17:0/3765178760 <== mds.0 v2:172.21.15.17:6834/3574515762 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f67955a440 con 0x55f67975ea20 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f3f400640 10 client.7680 handle_command_reply: tid=0 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 client.7680 shutdown 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 -- 172.21.15.17:0/3765178760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 msgr2=0x55f6797c1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6797c1990 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f5f440058a0 tx=0x7f5f44009fd0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 -- 172.21.15.17:0/3765178760 shutdown_connections 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.17:6834/3574515762,v1:172.21.15.17:6835/3574515762] conn(0x55f67975ea20 0x55f67975ee00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f67974b550 0x55f6797c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f67974ac30 0x55f6797c1990 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 --2- 172.21.15.17:0/3765178760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f679701880 0x55f6797c1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 -- 172.21.15.17:0/3765178760 >> 172.21.15.17:0/3765178760 conn(0x55f6796fd800 msgr2=0x55f6797495f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:52.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f3f400640 0 client.7680 ms_handle_reset on v2:172.21.15.17:6834/3574515762 2024-09-10T23:21:52.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 -- 172.21.15.17:0/3765178760 shutdown_connections 2024-09-10T23:21:52.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 1 -- 172.21.15.17:0/3765178760 wait complete. 2024-09-10T23:21:52.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f64318000 20 client.7680 trim_cache size 0 max 16384 2024-09-10T23:21:52.033 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:21:52.033 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:21:52.033 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "d848ad18-a3a8-4dfa-92db-8fef5ab5be4d", 2024-09-10T23:21:52.033 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:21:52.033 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:21:52.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 -- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f38072610 msgr2=0x7f5f38074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f38072610 0x7f5f38074ad0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c1ed450 tx=0x7f5f440091e0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 -- 172.21.15.17:0/3253280634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f400039f0 msgr2=0x7f5f5c165330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f400039f0 0x7f5f5c165330 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c01c630 tx=0x7f5f4c004b60 comp rx=0 tx=0).stop 2024-09-10T23:21:52.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 -- 172.21.15.17:0/3253280634 shutdown_connections 2024-09-10T23:21:52.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f38072610 0x7f5f38074ad0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f5c1ed6b0 0x7f5f5c15fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f5c0cdc20 0x7f5f5c15f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 --2- 172.21.15.17:0/3253280634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f400039f0 0x7f5f5c165330 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 -- 172.21.15.17:0/3253280634 >> 172.21.15.17:0/3253280634 conn(0x7f5f5c0b17a0 msgr2=0x7f5f5c160920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 -- 172.21.15.17:0/3253280634 shutdown_connections 2024-09-10T23:21:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.028+0000 7f5f61000640 1 -- 172.21.15.17:0/3253280634 wait complete. 2024-09-10T23:21:52.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:52.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 -- 172.21.15.17:0/3272515351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 msgr2=0x7f03080b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 --2- 172.21.15.17:0/3272515351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 0x7f03080b1430 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f0300009c80 tx=0x7f030001cd10 comp rx=0 tx=0).stop 2024-09-10T23:21:52.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 -- 172.21.15.17:0/3272515351 shutdown_connections 2024-09-10T23:21:52.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 --2- 172.21.15.17:0/3272515351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 0x7f03080b1430 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 --2- 172.21.15.17:0/3272515351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f030815f730 0x7f03080b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 -- 172.21.15.17:0/3272515351 >> 172.21.15.17:0/3272515351 conn(0x7f03080d1d10 msgr2=0x7f03080d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:52.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 -- 172.21.15.17:0/3272515351 shutdown_connections 2024-09-10T23:21:52.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 -- 172.21.15.17:0/3272515351 wait complete. 2024-09-10T23:21:52.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 Processor -- start 2024-09-10T23:21:52.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.196+0000 7f030fe00640 1 -- start start 2024-09-10T23:21:52.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 0x7f03080b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f030815f350 0x7f0308159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f030815f730 0x7f03080b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0308168bd0 con 0x7f03080cee30 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f03080b2440 con 0x7f030815f730 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0308168d50 con 0x7f030815f350 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 0x7f03080b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 0x7f03080b5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60868/0 (socket says 172.21.15.17:60868) 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030d400640 1 -- 172.21.15.17:0/1458243170 learned_addr learned my addr 172.21.15.17:0/1458243170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030de00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f030815f730 0x7f03080b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030ca00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f030815f350 0x7f0308159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030d400640 1 -- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f030815f350 msgr2=0x7f0308159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030d400640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f030815f350 0x7f0308159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030d400640 1 -- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f030815f730 msgr2=0x7f03080b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030d400640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f030815f730 0x7f03080b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030d400640 1 -- 172.21.15.17:0/1458243170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030815c200 con 0x7f03080cee30 2024-09-10T23:21:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030d400640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 0x7f03080b5b30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00c560 tx=0x7f02fc00ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f0305600640 1 -- 172.21.15.17:0/1458243170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc017070 con 0x7f03080cee30 2024-09-10T23:21:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f0305600640 1 -- 172.21.15.17:0/1458243170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02fc0053c0 con 0x7f03080cee30 2024-09-10T23:21:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f0305600640 1 -- 172.21.15.17:0/1458243170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc012890 con 0x7f03080cee30 2024-09-10T23:21:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030815c4e0 con 0x7f03080cee30 2024-09-10T23:21:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030815caa0 con 0x7f03080cee30 2024-09-10T23:21:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03080b1430 con 0x7f03080cee30 2024-09-10T23:21:52.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.200+0000 7f0305600640 1 -- 172.21.15.17:0/1458243170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f02fc003600 con 0x7f03080cee30 2024-09-10T23:21:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.204+0000 7f0305600640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f02e8072610 0x7f02e8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:52.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.204+0000 7f0305600640 1 -- 172.21.15.17:0/1458243170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f02fc0929e0 con 0x7f03080cee30 2024-09-10T23:21:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.204+0000 7f030ca00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f02e8072610 0x7f02e8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:52.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.204+0000 7f030ca00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f02e8072610 0x7f02e8074ad0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f02f40058d0 tx=0x7f02f4005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:52.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.208+0000 7f0305600640 1 -- 172.21.15.17:0/1458243170 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f02fc05d7f0 con 0x7f03080cee30 2024-09-10T23:21:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f030815abf0 con 0x7f03080cee30 2024-09-10T23:21:52.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f0305600640 1 -- 172.21.15.17:0/1458243170 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5224 (secure 0 0 0) 0x7f02fc062220 con 0x7f03080cee30 2024-09-10T23:21:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:52.417 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":77,"btime":"2024-09-10T23:21:48:762811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:48.762807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":6}]} 2024-09-10T23:21:52.417 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 77 2024-09-10T23:21:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f02e8072610 msgr2=0x7f02e8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f02e8072610 0x7f02e8074ad0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f02f40058d0 tx=0x7f02f4005860 comp rx=0 tx=0).stop 2024-09-10T23:21:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 msgr2=0x7f03080b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 0x7f03080b5b30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00c560 tx=0x7f02fc00ca20 comp rx=0 tx=0).stop 2024-09-10T23:21:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 shutdown_connections 2024-09-10T23:21:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f02e8072610 0x7f02e8074ad0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f030815f730 0x7f03080b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f030815f350 0x7f0308159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 --2- 172.21.15.17:0/1458243170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080cee30 0x7f03080b5b30 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 >> 172.21.15.17:0/1458243170 conn(0x7f03080d1d10 msgr2=0x7f030815b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 shutdown_connections 2024-09-10T23:21:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:52.416+0000 7f030fe00640 1 -- 172.21.15.17:0/1458243170 wait complete. 2024-09-10T23:21:52.439 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-10T23:21:52.601 INFO:teuthology.orchestra.run.smithi017.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T23:21:42.856529+0000","btime":"2024-09-10T23:21:41.956271+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T23:21:42.856529+0000","atime":"2024-09-10T23:21:41.956271+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T23:21:42.856529+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:21:42.857791+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:21:42.857791+0000"},"version":86,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T23:21:52.602 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-10T23:21:42.857791+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T23:21:41.956271+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T23:21:41.956271+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T23:21:42.856529+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-10T23:21:42.856529+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-10T23:21:42.856529+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-10T23:21:42.857791+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 86, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-10T23:21:52.602 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-10T23:21:57.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:57.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.760+0000 7fee86c00640 1 -- 172.21.15.17:0/2896958010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8006d810 msgr2=0x7fee8006cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:57.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.760+0000 7fee86c00640 1 --2- 172.21.15.17:0/2896958010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8006d810 0x7fee8006cbc0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fee68009840 tx=0x7fee6801c760 comp rx=0 tx=0).stop 2024-09-10T23:21:57.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.760+0000 7fee86c00640 1 -- 172.21.15.17:0/2896958010 shutdown_connections 2024-09-10T23:21:57.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.760+0000 7fee86c00640 1 --2- 172.21.15.17:0/2896958010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee800d1780 0x7fee8006d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.760+0000 7fee86c00640 1 --2- 172.21.15.17:0/2896958010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8006d810 0x7fee8006cbc0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.760+0000 7fee86c00640 1 -- 172.21.15.17:0/2896958010 >> 172.21.15.17:0/2896958010 conn(0x7fee800d0c60 msgr2=0x7fee800d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:57.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.760+0000 7fee86c00640 1 -- 172.21.15.17:0/2896958010 shutdown_connections 2024-09-10T23:21:57.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.760+0000 7fee86c00640 1 -- 172.21.15.17:0/2896958010 wait complete. 2024-09-10T23:21:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 Processor -- start 2024-09-10T23:21:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 -- start start 2024-09-10T23:21:57.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee8006d810 0x7fee8015d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee800d1780 0x7fee8015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8015bce0 0x7fee800b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fee80169050 con 0x7fee8015bce0 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fee80168ed0 con 0x7fee800d1780 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fee801691d0 con 0x7fee8006d810 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee84c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8015bce0 0x7fee800b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee84c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8015bce0 0x7fee800b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59610/0 (socket says 172.21.15.17:59610) 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee84c00640 1 -- 172.21.15.17:0/4242309009 learned_addr learned my addr 172.21.15.17:0/4242309009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee77e00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee800d1780 0x7fee8015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee7fe00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee8006d810 0x7fee8015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee84c00640 1 -- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee8006d810 msgr2=0x7fee8015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee84c00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee8006d810 0x7fee8015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee84c00640 1 -- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee800d1780 msgr2=0x7fee8015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee84c00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee800d1780 0x7fee8015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee84c00640 1 -- 172.21.15.17:0/4242309009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800b3ec0 con 0x7fee8015bce0 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee7fe00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee8006d810 0x7fee8015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee84c00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8015bce0 0x7fee800b0af0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fee7800ea20 tx=0x7fee7800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee7cc00640 1 -- 172.21.15.17:0/4242309009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7800cde0 con 0x7fee8015bce0 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee7cc00640 1 -- 172.21.15.17:0/4242309009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee78004c40 con 0x7fee8015bce0 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee7cc00640 1 -- 172.21.15.17:0/4242309009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78005280 con 0x7fee8015bce0 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee801fbf10 con 0x7fee8015bce0 2024-09-10T23:21:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.764+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee800b3bb0 con 0x7fee8015bce0 2024-09-10T23:21:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.768+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee80070f70 con 0x7fee8015bce0 2024-09-10T23:21:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.768+0000 7fee7cc00640 1 -- 172.21.15.17:0/4242309009 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fee7800f040 con 0x7fee8015bce0 2024-09-10T23:21:57.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.768+0000 7fee7cc00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fee5c072610 0x7fee5c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:57.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.768+0000 7fee7cc00640 1 -- 172.21.15.17:0/4242309009 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7fee78093b20 con 0x7fee8015bce0 2024-09-10T23:21:57.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.768+0000 7fee7fe00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fee5c072610 0x7fee5c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.768+0000 7fee7fe00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fee5c072610 0x7fee5c074ad0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fee700016b0 tx=0x7fee70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.772+0000 7fee7cc00640 1 -- 172.21.15.17:0/4242309009 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fee78016030 con 0x7fee8015bce0 2024-09-10T23:21:57.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.980+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee8006fc80 con 0x7fee8015bce0 2024-09-10T23:21:57.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.980+0000 7fee7cc00640 1 -- 172.21.15.17:0/4242309009 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5224 (secure 0 0 0) 0x7fee7805e930 con 0x7fee8015bce0 2024-09-10T23:21:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:57.982 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":77,"btime":"2024-09-10T23:21:48:762811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:48.762807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":6}]} 2024-09-10T23:21:57.983 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 77 2024-09-10T23:21:57.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.980+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fee5c072610 msgr2=0x7fee5c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.980+0000 7fee86c00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fee5c072610 0x7fee5c074ad0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fee700016b0 tx=0x7fee70009040 comp rx=0 tx=0).stop 2024-09-10T23:21:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.980+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8015bce0 msgr2=0x7fee800b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.980+0000 7fee86c00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8015bce0 0x7fee800b0af0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fee7800ea20 tx=0x7fee7800eee0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.980+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 shutdown_connections 2024-09-10T23:21:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.984+0000 7fee86c00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fee5c072610 0x7fee5c074ad0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.984+0000 7fee86c00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee8015bce0 0x7fee800b0af0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.984+0000 7fee86c00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee800d1780 0x7fee8015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.984+0000 7fee86c00640 1 --2- 172.21.15.17:0/4242309009 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee8006d810 0x7fee8015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.984+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 >> 172.21.15.17:0/4242309009 conn(0x7fee800d0c60 msgr2=0x7fee800d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.984+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 shutdown_connections 2024-09-10T23:21:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:57.984+0000 7fee86c00640 1 -- 172.21.15.17:0/4242309009 wait complete. 2024-09-10T23:21:58.004 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-10T23:21:58.164 INFO:teuthology.orchestra.run.smithi017.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T23:21:42.856529+0000","btime":"2024-09-10T23:21:41.956271+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T23:21:42.856529+0000","atime":"2024-09-10T23:21:41.956271+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T23:21:42.856529+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:21:42.857791+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T23:21:42.857791+0000"},"version":89,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-10T23:21:52.030025+0000","last_scrub_version":86,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T23:21:58.165 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-10T23:21:42.857791+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T23:21:41.956271+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T23:21:41.956271+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T23:21:42.856529+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-10T23:21:42.856529+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-10T23:21:52.030025+0000", "last_scrub_version": 86, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-10T23:21:42.856529+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-10T23:21:42.857791+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 89, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-10T23:21:58.165 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-10T23:21:58.166 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:21:58.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:21:58.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:21:58.327 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:21:58.327 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:21:58.327 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:58.328 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:58.336 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:21:58.336 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:21:58.337 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:21:58.337 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:58.346 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:21:58.346 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:21:58.346 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:21:58.346 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:58.387 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:21:58.388 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:21:58.388 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:21:58.388 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:21:58.396 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:21:58.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:58.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.576+0000 7f7eb6800640 1 -- 172.21.15.17:0/1733846677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e94005e60 msgr2=0x7f7e940062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:58.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.576+0000 7f7eb6800640 1 --2- 172.21.15.17:0/1733846677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e94005e60 0x7f7e940062e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009ee0 tx=0x7f7ea801d5f0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.576+0000 7f7eafe00640 1 -- 172.21.15.17:0/1733846677 reap_dead start 2024-09-10T23:21:58.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.576+0000 7f7eb6800640 1 -- 172.21.15.17:0/1733846677 shutdown_connections 2024-09-10T23:21:58.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.576+0000 7f7eb6800640 1 -- 172.21.15.17:0/1733846677 >> 172.21.15.17:0/1733846677 conn(0x7f7eb006cfc0 msgr2=0x7f7eb006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:58.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.576+0000 7f7eb6800640 1 -- 172.21.15.17:0/1733846677 shutdown_connections 2024-09-10T23:21:58.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.576+0000 7f7eb6800640 1 -- 172.21.15.17:0/1733846677 wait complete. 2024-09-10T23:21:58.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 Processor -- start 2024-09-10T23:21:58.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 -- start start 2024-09-10T23:21:58.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e94005e60 0x7f7eb013a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:58.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7eb0149ad0 0x7f7eb01f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:58.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eb01f3c50 0x7f7eb01f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:58.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0150ef0 con 0x7f7eb01f3c50 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb0150d70 con 0x7f7e94005e60 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb0151070 con 0x7f7eb0149ad0 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eafe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eb01f3c50 0x7f7eb01f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eafe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eb01f3c50 0x7f7eb01f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59618/0 (socket says 172.21.15.17:59618) 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eafe00640 1 -- 172.21.15.17:0/292111911 learned_addr learned my addr 172.21.15.17:0/292111911 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eaf400640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e94005e60 0x7f7eb013a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7ea7e00640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7eb0149ad0 0x7f7eb01f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eafe00640 1 -- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7eb0149ad0 msgr2=0x7f7eb01f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eafe00640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7eb0149ad0 0x7f7eb01f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eafe00640 1 -- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e94005e60 msgr2=0x7f7eb013a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eafe00640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e94005e60 0x7f7eb013a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eafe00640 1 -- 172.21.15.17:0/292111911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb00a9810 con 0x7f7eb01f3c50 2024-09-10T23:21:58.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eafe00640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eb01f3c50 0x7f7eb01f40e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009ee0 tx=0x7f7ea8004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:58.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7ea7400640 1 -- 172.21.15.17:0/292111911 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80ad050 con 0x7f7eb01f3c50 2024-09-10T23:21:58.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7ea7400640 1 -- 172.21.15.17:0/292111911 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ea80a7a90 con 0x7f7eb01f3c50 2024-09-10T23:21:58.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb013d360 con 0x7f7eb01f3c50 2024-09-10T23:21:58.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7ea7400640 1 -- 172.21.15.17:0/292111911 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80a7e40 con 0x7f7eb01f3c50 2024-09-10T23:21:58.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb00a9450 con 0x7f7eb01f3c50 2024-09-10T23:21:58.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.580+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb00b3a30 con 0x7f7eb01f3c50 2024-09-10T23:21:58.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.584+0000 7f7ea7400640 1 -- 172.21.15.17:0/292111911 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7ea8003980 con 0x7f7eb01f3c50 2024-09-10T23:21:58.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.584+0000 7f7ea7400640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e8c0725e0 0x7f7e8c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:58.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.584+0000 7f7ea7400640 1 -- 172.21.15.17:0/292111911 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f7ea812e530 con 0x7f7eb01f3c50 2024-09-10T23:21:58.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.584+0000 7f7eaf400640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e8c0725e0 0x7f7e8c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:58.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.584+0000 7f7eaf400640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e8c0725e0 0x7f7e8c074aa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0001870 tx=0x7f7ea0001cf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:58.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.588+0000 7f7ea7400640 1 -- 172.21.15.17:0/292111911 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7ea8017300 con 0x7f7eb01f3c50 2024-09-10T23:21:58.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.796+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7eb015a600 con 0x7f7eb01f3c50 2024-09-10T23:21:58.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.796+0000 7f7ea7400640 1 -- 172.21.15.17:0/292111911 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5224 (secure 0 0 0) 0x7f7ea80f9990 con 0x7f7eb01f3c50 2024-09-10T23:21:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:58.799 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":77,"btime":"2024-09-10T23:21:48:762811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:48.762807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":6}]} 2024-09-10T23:21:58.800 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 77 2024-09-10T23:21:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e8c0725e0 msgr2=0x7f7e8c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e8c0725e0 0x7f7e8c074aa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0001870 tx=0x7f7ea0001cf0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eb01f3c50 msgr2=0x7f7eb01f40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eb01f3c50 0x7f7eb01f40e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8009ee0 tx=0x7f7ea8004f50 comp rx=0 tx=0).stop 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 shutdown_connections 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e8c0725e0 0x7f7e8c074aa0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eb01f3c50 0x7f7eb01f40e0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7eb0149ad0 0x7f7eb01f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 --2- 172.21.15.17:0/292111911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e94005e60 0x7f7eb013a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 >> 172.21.15.17:0/292111911 conn(0x7f7eb006cfc0 msgr2=0x7f7eb006fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 shutdown_connections 2024-09-10T23:21:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.800+0000 7f7eb6800640 1 -- 172.21.15.17:0/292111911 wait complete. 2024-09-10T23:21:58.822 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:58.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 -- 172.21.15.17:0/3728533453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c152c50 msgr2=0x7f8e6c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:58.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 --2- 172.21.15.17:0/3728533453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c152c50 0x7f8e6c070350 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c06c640 tx=0x7f8e6001c890 comp rx=0 tx=0).stop 2024-09-10T23:21:58.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 -- 172.21.15.17:0/3728533453 shutdown_connections 2024-09-10T23:21:58.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 --2- 172.21.15.17:0/3728533453 >> v2:172.21.15.77:3300/0 conn(0x7f8e6c153030 0x7f8e6c0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 --2- 172.21.15.17:0/3728533453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c152c50 0x7f8e6c070350 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 -- 172.21.15.17:0/3728533453 >> 172.21.15.17:0/3728533453 conn(0x7f8e6c0d03d0 msgr2=0x7f8e6c0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:58.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 -- 172.21.15.17:0/3728533453 shutdown_connections 2024-09-10T23:21:58.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 -- 172.21.15.17:0/3728533453 wait complete. 2024-09-10T23:21:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 Processor -- start 2024-09-10T23:21:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 -- start start 2024-09-10T23:21:58.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e6c0d1120 0x7f8e6c154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:58.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e6c152c50 0x7f8e6c15a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:58.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c153030 0x7f8e6c138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c0716c0 con 0x7f8e6c153030 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c071540 con 0x7f8e6c0d1120 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e73a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6c0b4a20 con 0x7f8e6c152c50 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e71a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c153030 0x7f8e6c138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e71a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c153030 0x7f8e6c138490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59624/0 (socket says 172.21.15.17:59624) 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e71a00640 1 -- 172.21.15.17:0/3773915264 learned_addr learned my addr 172.21.15.17:0/3773915264 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e71000640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e6c0d1120 0x7f8e6c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e6be00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e6c152c50 0x7f8e6c15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e71a00640 1 -- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e6c152c50 msgr2=0x7f8e6c15a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e71a00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e6c152c50 0x7f8e6c15a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e71a00640 1 -- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e6c0d1120 msgr2=0x7f8e6c154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e71a00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e6c0d1120 0x7f8e6c154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:58.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e71a00640 1 -- 172.21.15.17:0/3773915264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6c068bc0 con 0x7f8e6c153030 2024-09-10T23:21:58.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.968+0000 7f8e6be00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e6c152c50 0x7f8e6c15a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:58.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e71a00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c153030 0x7f8e6c138490 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400e940 tx=0x7f8e6400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:58.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e68c00640 1 -- 172.21.15.17:0/3773915264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64004d30 con 0x7f8e6c153030 2024-09-10T23:21:58.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e68c00640 1 -- 172.21.15.17:0/3773915264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e6400cb20 con 0x7f8e6c153030 2024-09-10T23:21:58.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e68c00640 1 -- 172.21.15.17:0/3773915264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64005020 con 0x7f8e6c153030 2024-09-10T23:21:58.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6c154d30 con 0x7f8e6c153030 2024-09-10T23:21:58.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6c155570 con 0x7f8e6c153030 2024-09-10T23:21:58.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6c070350 con 0x7f8e6c153030 2024-09-10T23:21:58.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e68c00640 1 -- 172.21.15.17:0/3773915264 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8e6400f040 con 0x7f8e6c153030 2024-09-10T23:21:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e68c00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e4c072610 0x7f8e4c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.972+0000 7f8e68c00640 1 -- 172.21.15.17:0/3773915264 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f8e64093a90 con 0x7f8e6c153030 2024-09-10T23:21:58.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.976+0000 7f8e71000640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e4c072610 0x7f8e4c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:58.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.976+0000 7f8e71000640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e4c072610 0x7f8e4c074ad0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8e600af000 tx=0x7f8e6001b0d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:58.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:58.976+0000 7f8e68c00640 1 -- 172.21.15.17:0/3773915264 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8e6c154d30 con 0x7f8e6c153030 2024-09-10T23:21:59.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.188+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e6c1549c0 con 0x7f8e6c153030 2024-09-10T23:21:59.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.188+0000 7f8e68c00640 1 -- 172.21.15.17:0/3773915264 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5224 (secure 0 0 0) 0x7f8e64016030 con 0x7f8e6c153030 2024-09-10T23:21:59.191 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:59.191 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":77,"btime":"2024-09-10T23:21:48:762811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:48.762807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":6}]} 2024-09-10T23:21:59.191 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 77 2024-09-10T23:21:59.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e4c072610 msgr2=0x7f8e4c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e4c072610 0x7f8e4c074ad0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8e600af000 tx=0x7f8e6001b0d0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c153030 msgr2=0x7f8e6c138490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c153030 0x7f8e6c138490 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400e940 tx=0x7f8e6400ee00 comp rx=0 tx=0).stop 2024-09-10T23:21:59.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 shutdown_connections 2024-09-10T23:21:59.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e4c072610 0x7f8e4c074ad0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e6c153030 0x7f8e6c138490 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e6c152c50 0x7f8e6c15a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 --2- 172.21.15.17:0/3773915264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e6c0d1120 0x7f8e6c154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 >> 172.21.15.17:0/3773915264 conn(0x7f8e6c0d03d0 msgr2=0x7f8e6c15e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 shutdown_connections 2024-09-10T23:21:59.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.192+0000 7f8e73a00640 1 -- 172.21.15.17:0/3773915264 wait complete. 2024-09-10T23:21:59.212 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:21:59.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.356+0000 7f7522800640 1 -- 172.21.15.17:0/4252485418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7504003a60 msgr2=0x7f7504003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.356+0000 7f7522800640 1 --2- 172.21.15.17:0/4252485418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7504003a60 0x7f7504003e80 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f751000c2e0 tx=0x7f751001cf80 comp rx=0 tx=0).stop 2024-09-10T23:21:59.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.356+0000 7f7521e00640 1 -- 172.21.15.17:0/4252485418 reap_dead start 2024-09-10T23:21:59.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.356+0000 7f7522800640 1 -- 172.21.15.17:0/4252485418 shutdown_connections 2024-09-10T23:21:59.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.356+0000 7f7522800640 1 -- 172.21.15.17:0/4252485418 >> 172.21.15.17:0/4252485418 conn(0x7f751c09a9f0 msgr2=0x7f751c09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:59.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.356+0000 7f7522800640 1 -- 172.21.15.17:0/4252485418 shutdown_connections 2024-09-10T23:21:59.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.356+0000 7f7522800640 1 -- 172.21.15.17:0/4252485418 wait complete. 2024-09-10T23:21:59.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 Processor -- start 2024-09-10T23:21:59.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 -- start start 2024-09-10T23:21:59.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7504003a60 0x7f751c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751c0b4930 0x7f751c0cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f751c159c60 0x7f751c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f751c166710 con 0x7f751c0b4930 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f751c0b1e70 con 0x7f7504003a60 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f751c166890 con 0x7f751c159c60 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7520a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751c0b4930 0x7f751c0cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7520a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751c0b4930 0x7f751c0cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59644/0 (socket says 172.21.15.17:59644) 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7520a00640 1 -- 172.21.15.17:0/232643993 learned_addr learned my addr 172.21.15.17:0/232643993 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7521400640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7504003a60 0x7f751c150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7521e00640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f751c159c60 0x7f751c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7520a00640 1 -- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f751c159c60 msgr2=0x7f751c15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7520a00640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f751c159c60 0x7f751c15a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7520a00640 1 -- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7504003a60 msgr2=0x7f751c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7520a00640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7504003a60 0x7f751c150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7520a00640 1 -- 172.21.15.17:0/232643993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c0c7a80 con 0x7f751c0b4930 2024-09-10T23:21:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7521e00640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f751c159c60 0x7f751c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:21:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7520a00640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751c0b4930 0x7f751c0cb4f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7508011ae0 tx=0x7f7508009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7519600640 1 -- 172.21.15.17:0/232643993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750801e070 con 0x7f751c0b4930 2024-09-10T23:21:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7519600640 1 -- 172.21.15.17:0/232643993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f750800fb90 con 0x7f751c0b4930 2024-09-10T23:21:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7519600640 1 -- 172.21.15.17:0/232643993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508019410 con 0x7f751c0b4930 2024-09-10T23:21:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751c0c7d60 con 0x7f751c0b4930 2024-09-10T23:21:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751c0c5a90 con 0x7f751c0b4930 2024-09-10T23:21:59.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.360+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751c15a620 con 0x7f751c0b4930 2024-09-10T23:21:59.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.364+0000 7f7519600640 1 -- 172.21.15.17:0/232643993 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f75080195b0 con 0x7f751c0b4930 2024-09-10T23:21:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.364+0000 7f7519600640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74fc0725e0 0x7f74fc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.364+0000 7f7519600640 1 -- 172.21.15.17:0/232643993 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f7508093e00 con 0x7f751c0b4930 2024-09-10T23:21:59.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.364+0000 7f7521400640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74fc0725e0 0x7f74fc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.364+0000 7f7521400640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74fc0725e0 0x7f74fc074aa0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f75100ac000 tx=0x7f7510019dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:59.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.368+0000 7f7519600640 1 -- 172.21.15.17:0/232643993 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f750805ec10 con 0x7f751c0b4930 2024-09-10T23:21:59.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.544+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f751c0c55b0 con 0x7f751c0b4930 2024-09-10T23:21:59.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.544+0000 7f7519600640 1 -- 172.21.15.17:0/232643993 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+17021 (secure 0 0 0) 0x7f7508063640 con 0x7f751c0b4930 2024-09-10T23:21:59.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:59.546 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":107,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:21:45.466119+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:21:31.384816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T23:21:32.619438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/70051217":"2024-09-11T23:21:45.466098+0000","172.21.15.17:6833/70051217":"2024-09-11T23:21:45.466098+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:21:59.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74fc0725e0 msgr2=0x7f74fc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74fc0725e0 0x7f74fc074aa0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f75100ac000 tx=0x7f7510019dc0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751c0b4930 msgr2=0x7f751c0cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751c0b4930 0x7f751c0cb4f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7508011ae0 tx=0x7f7508009ec0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 shutdown_connections 2024-09-10T23:21:59.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f74fc0725e0 0x7f74fc074aa0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f751c159c60 0x7f751c15a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f751c0b4930 0x7f751c0cb4f0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 --2- 172.21.15.17:0/232643993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7504003a60 0x7f751c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 >> 172.21.15.17:0/232643993 conn(0x7f751c09a9f0 msgr2=0x7f751c0af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:59.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 shutdown_connections 2024-09-10T23:21:59.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.548+0000 7f7522800640 1 -- 172.21.15.17:0/232643993 wait complete. 2024-09-10T23:21:59.569 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:21:59.570 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:21:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 -- 172.21.15.17:0/2281155989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 msgr2=0x7fcd2406e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 --2- 172.21.15.17:0/2281155989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 0x7fcd2406e750 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fcd240cc5a0 tx=0x7fcd140203e0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 -- 172.21.15.17:0/2281155989 shutdown_connections 2024-09-10T23:21:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 --2- 172.21.15.17:0/2281155989 >> v2:172.21.15.77:3300/0 conn(0x7fcd240cf610 0x7fcd2415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 --2- 172.21.15.17:0/2281155989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 0x7fcd2406e750 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 -- 172.21.15.17:0/2281155989 >> 172.21.15.17:0/2281155989 conn(0x7fcd2406cfc0 msgr2=0x7fcd2406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 -- 172.21.15.17:0/2281155989 shutdown_connections 2024-09-10T23:21:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 -- 172.21.15.17:0/2281155989 wait complete. 2024-09-10T23:21:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 Processor -- start 2024-09-10T23:21:59.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 -- start start 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd240b32d0 0x7fcd241e50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 0x7fcd240b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd240cf610 0x7fcd240af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240d0330 con 0x7fcd240cf230 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240d01b0 con 0x7fcd240b32d0 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd29400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcd240d04b0 con 0x7fcd240cf610 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd1be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 0x7fcd240b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd1be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 0x7fcd240b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59662/0 (socket says 172.21.15.17:59662) 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd1be00640 1 -- 172.21.15.17:0/2792201641 learned_addr learned my addr 172.21.15.17:0/2792201641 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd22800640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd240b32d0 0x7fcd241e50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd23200640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd240cf610 0x7fcd240af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd1be00640 1 -- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd240cf610 msgr2=0x7fcd240af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd1be00640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd240cf610 0x7fcd240af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd1be00640 1 -- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd240b32d0 msgr2=0x7fcd241e50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd1be00640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd240b32d0 0x7fcd241e50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd1be00640 1 -- 172.21.15.17:0/2792201641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd241f2750 con 0x7fcd240cf230 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.716+0000 7fcd1be00640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 0x7fcd240b13e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00c9f0 tx=0x7fcd0c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd1aa00640 1 -- 172.21.15.17:0/2792201641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c007bb0 con 0x7fcd240cf230 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd1aa00640 1 -- 172.21.15.17:0/2792201641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd0c007e40 con 0x7fcd240cf230 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd1aa00640 1 -- 172.21.15.17:0/2792201641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00f690 con 0x7fcd240cf230 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd241f6220 con 0x7fcd240cf230 2024-09-10T23:21:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd241f67e0 con 0x7fcd240cf230 2024-09-10T23:21:59.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2406e750 con 0x7fcd240cf230 2024-09-10T23:21:59.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd1aa00640 1 -- 172.21.15.17:0/2792201641 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcd0c00f830 con 0x7fcd240cf230 2024-09-10T23:21:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd1aa00640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd00072610 0x7fcd00074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:21:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd1aa00640 1 -- 172.21.15.17:0/2792201641 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7fcd0c093b60 con 0x7fcd240cf230 2024-09-10T23:21:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.720+0000 7fcd22800640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd00072610 0x7fcd00074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:21:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.724+0000 7fcd22800640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd00072610 0x7fcd00074ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd140b2000 tx=0x7fcd1401ec20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:21:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.724+0000 7fcd1aa00640 1 -- 172.21.15.17:0/2792201641 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcd241f2750 con 0x7fcd240cf230 2024-09-10T23:21:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.932+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd2415af20 con 0x7fcd240cf230 2024-09-10T23:21:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.932+0000 7fcd1aa00640 1 -- 172.21.15.17:0/2792201641 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5224 (secure 0 0 0) 0x7fcd0c014030 con 0x7fcd240cf230 2024-09-10T23:21:59.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:21:59.934 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":77,"btime":"2024-09-10T23:21:48:762811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:48.762807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":6}]} 2024-09-10T23:21:59.934 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 77 2024-09-10T23:21:59.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.932+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd00072610 msgr2=0x7fcd00074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.932+0000 7fcd29400640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd00072610 0x7fcd00074ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd140b2000 tx=0x7fcd1401ec20 comp rx=0 tx=0).stop 2024-09-10T23:21:59.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.932+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 msgr2=0x7fcd240b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:21:59.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.932+0000 7fcd29400640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 0x7fcd240b13e0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00c9f0 tx=0x7fcd0c00ceb0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.936+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 shutdown_connections 2024-09-10T23:21:59.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.936+0000 7fcd29400640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd00072610 0x7fcd00074ad0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.936+0000 7fcd29400640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd240cf610 0x7fcd240af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.936+0000 7fcd29400640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd240cf230 0x7fcd240b13e0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.936+0000 7fcd29400640 1 --2- 172.21.15.17:0/2792201641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd240b32d0 0x7fcd241e50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:21:59.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.936+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 >> 172.21.15.17:0/2792201641 conn(0x7fcd2406cfc0 msgr2=0x7fcd240ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:21:59.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.936+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 shutdown_connections 2024-09-10T23:21:59.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:21:59.936+0000 7fcd29400640 1 -- 172.21.15.17:0/2792201641 wait complete. 2024-09-10T23:21:59.956 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:22:00.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.100+0000 7f7b18200640 1 -- 172.21.15.17:0/640290123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b100d1830 msgr2=0x7f7b100ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.100+0000 7f7b18200640 1 --2- 172.21.15.17:0/640290123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b100d1830 0x7f7b100ccf80 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009bc0 tx=0x7f7b0801cba0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.100+0000 7f7b18200640 1 -- 172.21.15.17:0/640290123 shutdown_connections 2024-09-10T23:22:00.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.100+0000 7f7b18200640 1 --2- 172.21.15.17:0/640290123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b100d1830 0x7f7b100ccf80 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.100+0000 7f7b18200640 1 -- 172.21.15.17:0/640290123 >> 172.21.15.17:0/640290123 conn(0x7f7b100d1d60 msgr2=0x7f7b100d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:00.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.100+0000 7f7b18200640 1 -- 172.21.15.17:0/640290123 shutdown_connections 2024-09-10T23:22:00.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.100+0000 7f7b18200640 1 -- 172.21.15.17:0/640290123 wait complete. 2024-09-10T23:22:00.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 Processor -- start 2024-09-10T23:22:00.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 -- start start 2024-09-10T23:22:00.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b10070ad0 0x7f7b100c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b100d1830 0x7f7b100b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b1015f770 0x7f7b10147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1016a4d0 con 0x7f7b1015f770 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1016a350 con 0x7f7b10070ad0 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1016a650 con 0x7f7b100d1830 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b16200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b1015f770 0x7f7b10147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b16200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b1015f770 0x7f7b10147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59682/0 (socket says 172.21.15.17:59682) 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b16200640 1 -- 172.21.15.17:0/2001684840 learned_addr learned my addr 172.21.15.17:0/2001684840 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b15800640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b10070ad0 0x7f7b100c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b14e00640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b100d1830 0x7f7b100b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b16200640 1 -- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b100d1830 msgr2=0x7f7b100b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b16200640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b100d1830 0x7f7b100b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b16200640 1 -- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b10070ad0 msgr2=0x7f7b100c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b16200640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b10070ad0 0x7f7b100c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b16200640 1 -- 172.21.15.17:0/2001684840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b100ca460 con 0x7f7b1015f770 2024-09-10T23:22:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b16200640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b1015f770 0x7f7b10147870 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f7b080197b0 tx=0x7f7b080092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b0d600640 1 -- 172.21.15.17:0/2001684840 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080bb070 con 0x7f7b1015f770 2024-09-10T23:22:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b0d600640 1 -- 172.21.15.17:0/2001684840 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b08004e00 con 0x7f7b1015f770 2024-09-10T23:22:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b0d600640 1 -- 172.21.15.17:0/2001684840 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080b2040 con 0x7f7b1015f770 2024-09-10T23:22:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b100ca740 con 0x7f7b1015f770 2024-09-10T23:22:00.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.104+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b100cad00 con 0x7f7b1015f770 2024-09-10T23:22:00.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.108+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1015f060 con 0x7f7b1015f770 2024-09-10T23:22:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.108+0000 7f7b0d600640 1 -- 172.21.15.17:0/2001684840 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7b080b5030 con 0x7f7b1015f770 2024-09-10T23:22:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.108+0000 7f7b0d600640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7af00725e0 0x7f7af0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.108+0000 7f7b0d600640 1 -- 172.21.15.17:0/2001684840 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f7b0812cf90 con 0x7f7b1015f770 2024-09-10T23:22:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.108+0000 7f7b15800640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7af00725e0 0x7f7af0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.108+0000 7f7b15800640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7af00725e0 0x7f7af0074aa0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7b04000f70 tx=0x7f7b04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:00.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.112+0000 7f7b0d600640 1 -- 172.21.15.17:0/2001684840 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7b08016790 con 0x7f7b1015f770 2024-09-10T23:22:00.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b1009fdc0 con 0x7f7b1015f770 2024-09-10T23:22:00.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b0d600640 1 -- 172.21.15.17:0/2001684840 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5224 (secure 0 0 0) 0x7f7b080f83f0 con 0x7f7b1015f770 2024-09-10T23:22:00.325 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:00.326 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":77,"btime":"2024-09-10T23:21:48:762811+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:21:33.653384+0000","modified":"2024-09-10T23:21:48.762807+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":107,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/3574515762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3574515762},{"type":"v1","addr":"172.21.15.17:6835","nonce":3574515762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":6}]} 2024-09-10T23:22:00.326 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 77 2024-09-10T23:22:00.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7af00725e0 msgr2=0x7f7af0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7af00725e0 0x7f7af0074aa0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7b04000f70 tx=0x7f7b04009040 comp rx=0 tx=0).stop 2024-09-10T23:22:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b1015f770 msgr2=0x7f7b10147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b1015f770 0x7f7b10147870 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f7b080197b0 tx=0x7f7b080092c0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 shutdown_connections 2024-09-10T23:22:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7af00725e0 0x7f7af0074aa0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b1015f770 0x7f7b10147870 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b100d1830 0x7f7b100b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 --2- 172.21.15.17:0/2001684840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b10070ad0 0x7f7b100c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 >> 172.21.15.17:0/2001684840 conn(0x7f7b100d1d60 msgr2=0x7f7b100d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 shutdown_connections 2024-09-10T23:22:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.324+0000 7f7b18200640 1 -- 172.21.15.17:0/2001684840 wait complete. 2024-09-10T23:22:00.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:22:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 -- 172.21.15.17:0/2805907386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015ef40 msgr2=0x7f8d6015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 --2- 172.21.15.17:0/2805907386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015ef40 0x7f8d6015afe0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f8d601555c0 tx=0x7f8d5001c890 comp rx=0 tx=0).stop 2024-09-10T23:22:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 -- 172.21.15.17:0/2805907386 shutdown_connections 2024-09-10T23:22:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 --2- 172.21.15.17:0/2805907386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d600b4370 0x7f8d600d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 --2- 172.21.15.17:0/2805907386 >> v2:172.21.15.77:3300/0 conn(0x7f8d6015e5d0 0x7f8d600b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 --2- 172.21.15.17:0/2805907386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015ef40 0x7f8d6015afe0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 -- 172.21.15.17:0/2805907386 >> 172.21.15.17:0/2805907386 conn(0x7f8d6006cfc0 msgr2=0x7f8d6006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 -- 172.21.15.17:0/2805907386 shutdown_connections 2024-09-10T23:22:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 -- 172.21.15.17:0/2805907386 wait complete. 2024-09-10T23:22:00.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 Processor -- start 2024-09-10T23:22:00.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.492+0000 7f8d67200640 1 -- start start 2024-09-10T23:22:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d67200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d600b4370 0x7f8d6015d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d67200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015e5d0 0x7f8d600ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d67200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d6015ef40 0x7f8d60141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d67200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d60070000 con 0x7f8d6015e5d0 2024-09-10T23:22:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d67200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6006fe80 con 0x7f8d600b4370 2024-09-10T23:22:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d67200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8d60070180 con 0x7f8d6015ef40 2024-09-10T23:22:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015e5d0 0x7f8d600ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015e5d0 0x7f8d600ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59696/0 (socket says 172.21.15.17:59696) 2024-09-10T23:22:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5f400640 1 -- 172.21.15.17:0/292691114 learned_addr learned my addr 172.21.15.17:0/292691114 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5fe00640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d600b4370 0x7f8d6015d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d65200640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d6015ef40 0x7f8d60141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5f400640 1 -- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d6015ef40 msgr2=0x7f8d60141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5f400640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d6015ef40 0x7f8d60141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5f400640 1 -- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d600b4370 msgr2=0x7f8d6015d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5f400640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d600b4370 0x7f8d6015d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5f400640 1 -- 172.21.15.17:0/292691114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d600ce850 con 0x7f8d6015e5d0 2024-09-10T23:22:00.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d5f400640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015e5d0 0x7f8d600ce010 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00d950 tx=0x7f8d4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:00.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d57e00640 1 -- 172.21.15.17:0/292691114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c017070 con 0x7f8d6015e5d0 2024-09-10T23:22:00.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d57e00640 1 -- 172.21.15.17:0/292691114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d4c009d20 con 0x7f8d6015e5d0 2024-09-10T23:22:00.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d57e00640 1 -- 172.21.15.17:0/292691114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0106c0 con 0x7f8d6015e5d0 2024-09-10T23:22:00.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d600cd0c0 con 0x7f8d6015e5d0 2024-09-10T23:22:00.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d600cd680 con 0x7f8d6015e5d0 2024-09-10T23:22:00.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.496+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d600b3e30 con 0x7f8d6015e5d0 2024-09-10T23:22:00.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.500+0000 7f8d57e00640 1 -- 172.21.15.17:0/292691114 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8d4c010860 con 0x7f8d6015e5d0 2024-09-10T23:22:00.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.500+0000 7f8d57e00640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d400725e0 0x7f8d40074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.500+0000 7f8d57e00640 1 -- 172.21.15.17:0/292691114 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7f8d4c0937c0 con 0x7f8d6015e5d0 2024-09-10T23:22:00.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.500+0000 7f8d5fe00640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d400725e0 0x7f8d40074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.500+0000 7f8d5fe00640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d400725e0 0x7f8d40074aa0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8d500af000 tx=0x7f8d5001b0d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:00.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.504+0000 7f8d57e00640 1 -- 172.21.15.17:0/292691114 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8d4c05e660 con 0x7f8d6015e5d0 2024-09-10T23:22:00.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.680+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d6006f200 con 0x7f8d6015e5d0 2024-09-10T23:22:00.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.680+0000 7f8d57e00640 1 -- 172.21.15.17:0/292691114 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+17021 (secure 0 0 0) 0x7f8d4c063090 con 0x7f8d6015e5d0 2024-09-10T23:22:00.682 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:00.682 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":107,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:21:45.466119+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:21:31.384816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-10T23:21:32.619438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/70051217":"2024-09-11T23:21:45.466098+0000","172.21.15.17:6833/70051217":"2024-09-11T23:21:45.466098+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:00.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d400725e0 msgr2=0x7f8d40074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d400725e0 0x7f8d40074aa0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8d500af000 tx=0x7f8d5001b0d0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015e5d0 msgr2=0x7f8d600ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015e5d0 0x7f8d600ce010 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00d950 tx=0x7f8d4c00de10 comp rx=0 tx=0).stop 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 shutdown_connections 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d400725e0 0x7f8d40074aa0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d6015ef40 0x7f8d60141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d6015e5d0 0x7f8d600ce010 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 --2- 172.21.15.17:0/292691114 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d600b4370 0x7f8d6015d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 >> 172.21.15.17:0/292691114 conn(0x7f8d6006cfc0 msgr2=0x7f8d600b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 shutdown_connections 2024-09-10T23:22:00.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.684+0000 7f8d67200640 1 -- 172.21.15.17:0/292691114 wait complete. 2024-09-10T23:22:00.704 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:22:00.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.848+0000 7fe24c000640 1 -- 172.21.15.17:0/4136217707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 msgr2=0x7fe24415dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.848+0000 7fe24c000640 1 --2- 172.21.15.17:0/4136217707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 0x7fe24415dde0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fe238009870 tx=0x7fe23801c790 comp rx=0 tx=0).stop 2024-09-10T23:22:00.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.848+0000 7fe24c000640 1 -- 172.21.15.17:0/4136217707 shutdown_connections 2024-09-10T23:22:00.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.848+0000 7fe24c000640 1 --2- 172.21.15.17:0/4136217707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 0x7fe24415dde0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.848+0000 7fe24c000640 1 -- 172.21.15.17:0/4136217707 >> 172.21.15.17:0/4136217707 conn(0x7fe2440b1730 msgr2=0x7fe2440b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:00.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.848+0000 7fe24c000640 1 -- 172.21.15.17:0/4136217707 shutdown_connections 2024-09-10T23:22:00.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.848+0000 7fe24c000640 1 -- 172.21.15.17:0/4136217707 wait complete. 2024-09-10T23:22:00.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 Processor -- start 2024-09-10T23:22:00.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 -- start start 2024-09-10T23:22:00.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24406ef80 0x7fe24413b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2440cf090 0x7fe2441fb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 0x7fe2441fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe24406ed80 con 0x7fe24415d7d0 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe24406ec00 con 0x7fe2440cf090 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe244168190 con 0x7fe24406ef80 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 0x7fe2441fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 0x7fe2441fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59714/0 (socket says 172.21.15.17:59714) 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24a000640 1 -- 172.21.15.17:0/2067206938 learned_addr learned my addr 172.21.15.17:0/2067206938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe249600640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24406ef80 0x7fe24413b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe248c00640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2440cf090 0x7fe2441fb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24a000640 1 -- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24406ef80 msgr2=0x7fe24413b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24a000640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24406ef80 0x7fe24413b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24a000640 1 -- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2440cf090 msgr2=0x7fe2441fb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:00.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24a000640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2440cf090 0x7fe2441fb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:00.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24a000640 1 -- 172.21.15.17:0/2067206938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24415c5e0 con 0x7fe24415d7d0 2024-09-10T23:22:00.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24a000640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 0x7fe2441fb8a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00c780 tx=0x7fe23c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe241600640 1 -- 172.21.15.17:0/2067206938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c004b70 con 0x7fe24415d7d0 2024-09-10T23:22:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe241600640 1 -- 172.21.15.17:0/2067206938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe23c004e00 con 0x7fe24415d7d0 2024-09-10T23:22:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24415c8c0 con 0x7fe24415d7d0 2024-09-10T23:22:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe241600640 1 -- 172.21.15.17:0/2067206938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00aa90 con 0x7fe24415d7d0 2024-09-10T23:22:00.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.852+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24414b580 con 0x7fe24415d7d0 2024-09-10T23:22:00.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.856+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24406f3f0 con 0x7fe24415d7d0 2024-09-10T23:22:00.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.856+0000 7fe241600640 1 -- 172.21.15.17:0/2067206938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe23c00ac30 con 0x7fe24415d7d0 2024-09-10T23:22:00.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.856+0000 7fe241600640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2240725e0 0x7fe224074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:00.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.856+0000 7fe241600640 1 -- 172.21.15.17:0/2067206938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6187+0+0 (secure 0 0 0) 0x7fe23c093610 con 0x7fe24415d7d0 2024-09-10T23:22:00.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.856+0000 7fe249600640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2240725e0 0x7fe224074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.856+0000 7fe249600640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2240725e0 0x7fe224074aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe2380af000 tx=0x7fe23801afd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:00.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:00.860+0000 7fe241600640 1 -- 172.21.15.17:0/2067206938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe23c020070 con 0x7fe24415d7d0 2024-09-10T23:22:01.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.072+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe2440cc3d0 con 0x7fe24415d7d0 2024-09-10T23:22:01.074 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:22:01.072+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:22:01.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.072+0000 7fe241600640 1 -- 172.21.15.17:0/2067206938 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) ==== 161+0+0 (secure 0 0 0) 0x7fe23c05e4b0 con 0x7fe24415d7d0 2024-09-10T23:22:01.076 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:22:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2240725e0 msgr2=0x7fe224074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2240725e0 0x7fe224074aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe2380af000 tx=0x7fe23801afd0 comp rx=0 tx=0).stop 2024-09-10T23:22:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 msgr2=0x7fe2441fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 0x7fe2441fb8a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00c780 tx=0x7fe23c00cc40 comp rx=0 tx=0).stop 2024-09-10T23:22:01.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 shutdown_connections 2024-09-10T23:22:01.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2240725e0 0x7fe224074aa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:01.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24415d7d0 0x7fe2441fb8a0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:01.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2440cf090 0x7fe2441fb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:01.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 --2- 172.21.15.17:0/2067206938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24406ef80 0x7fe24413b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:01.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 >> 172.21.15.17:0/2067206938 conn(0x7fe2440b1730 msgr2=0x7fe2441657f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:01.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 shutdown_connections 2024-09-10T23:22:01.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.076+0000 7fe24c000640 1 -- 172.21.15.17:0/2067206938 wait complete. 2024-09-10T23:22:01.090 INFO:tasks.ceph.mds.c.smithi017.stderr: -3148> 2024-09-10T23:21:50.756+0000 7f53fe000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:22:01.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:22:01.145 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:22:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.256+0000 7f9531000640 1 -- 172.21.15.17:0/593799728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9510003f80 msgr2=0x7f9510004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.256+0000 7f9531000640 1 --2- 172.21.15.17:0/593799728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9510003f80 0x7f9510004810 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f9514001730 tx=0x7f951401ef90 comp rx=0 tx=0).stop 2024-09-10T23:22:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.256+0000 7f952a800640 1 -- 172.21.15.17:0/593799728 reap_dead start 2024-09-10T23:22:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.256+0000 7f9531000640 1 -- 172.21.15.17:0/593799728 shutdown_connections 2024-09-10T23:22:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.256+0000 7f9531000640 1 -- 172.21.15.17:0/593799728 >> 172.21.15.17:0/593799728 conn(0x7f952c09a9f0 msgr2=0x7f952c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.256+0000 7f9531000640 1 -- 172.21.15.17:0/593799728 shutdown_connections 2024-09-10T23:22:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.256+0000 7f9531000640 1 -- 172.21.15.17:0/593799728 wait complete. 2024-09-10T23:22:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 Processor -- start 2024-09-10T23:22:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 -- start start 2024-09-10T23:22:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9510003f80 0x7f952c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f952c1552e0 0x7f952c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f952c163c40 0x7f952c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f952c164a50 con 0x7f9510003f80 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1648d0 con 0x7f952c1552e0 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f952c164bd0 con 0x7f952c163c40 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9529e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9510003f80 0x7f952c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9529e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9510003f80 0x7f952c06f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59764/0 (socket says 172.21.15.17:59764) 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9529e00640 1 -- 172.21.15.17:0/2231574326 learned_addr learned my addr 172.21.15.17:0/2231574326 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9521400640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f952c1552e0 0x7f952c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f952a800640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f952c163c40 0x7f952c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9529e00640 1 -- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f952c163c40 msgr2=0x7f952c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9529e00640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f952c163c40 0x7f952c1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9529e00640 1 -- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f952c1552e0 msgr2=0x7f952c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9529e00640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f952c1552e0 0x7f952c15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9529e00640 1 -- 172.21.15.17:0/2231574326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c06e270 con 0x7f9510003f80 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9521400640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f952c1552e0 0x7f952c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f952a800640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f952c163c40 0x7f952c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9529e00640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9510003f80 0x7f952c06f310 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f951c0066e0 tx=0x7f951c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9522a00640 1 -- 172.21.15.17:0/2231574326 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c015070 con 0x7f9510003f80 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9522a00640 1 -- 172.21.15.17:0/2231574326 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f951c011900 con 0x7f9510003f80 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9522a00640 1 -- 172.21.15.17:0/2231574326 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c011d50 con 0x7f9510003f80 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c06e550 con 0x7f9510003f80 2024-09-10T23:22:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.260+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c06eb10 con 0x7f9510003f80 2024-09-10T23:22:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.264+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c071670 con 0x7f9510003f80 2024-09-10T23:22:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.264+0000 7f9522a00640 1 -- 172.21.15.17:0/2231574326 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f951c010420 con 0x7f9510003f80 2024-09-10T23:22:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.264+0000 7f9522a00640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95080725e0 0x7f9508074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.264+0000 7f9522a00640 1 -- 172.21.15.17:0/2231574326 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6273+0+0 (secure 0 0 0) 0x7f951c0941a0 con 0x7f9510003f80 2024-09-10T23:22:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.264+0000 7f9521400640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95080725e0 0x7f9508074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.268+0000 7f9521400640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95080725e0 0x7f9508074aa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9514005000 tx=0x7f951401bd30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.268+0000 7f9522a00640 1 -- 172.21.15.17:0/2231574326 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f951c05f630 con 0x7f9510003f80 2024-09-10T23:22:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:01.480+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f952c0b3cf0 con 0x7f9510003f80 2024-09-10T23:22:02.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.076+0000 7f9522a00640 1 -- 172.21.15.17:0/2231574326 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) ==== 104+0+0 (secure 0 0 0) 0x7f951c05ef30 con 0x7f9510003f80 2024-09-10T23:22:02.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95080725e0 msgr2=0x7f9508074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:02.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95080725e0 0x7f9508074aa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9514005000 tx=0x7f951401bd30 comp rx=0 tx=0).stop 2024-09-10T23:22:02.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9510003f80 msgr2=0x7f952c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:02.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9510003f80 0x7f952c06f310 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f951c0066e0 tx=0x7f951c0039d0 comp rx=0 tx=0).stop 2024-09-10T23:22:02.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 shutdown_connections 2024-09-10T23:22:02.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95080725e0 0x7f9508074aa0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:02.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f952c163c40 0x7f952c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:02.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f952c1552e0 0x7f952c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:02.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 --2- 172.21.15.17:0/2231574326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9510003f80 0x7f952c06f310 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:02.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 >> 172.21.15.17:0/2231574326 conn(0x7f952c09a9f0 msgr2=0x7f952c0b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:02.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 shutdown_connections 2024-09-10T23:22:02.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.080+0000 7f9531000640 1 -- 172.21.15.17:0/2231574326 wait complete. 2024-09-10T23:22:02.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:22:02.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.300+0000 7ff503c00640 1 -- 172.21.15.17:0/2131517528 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4fc15d4f0 msgr2=0x7ff4fc0cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:02.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.300+0000 7ff503c00640 1 --2- 172.21.15.17:0/2131517528 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4fc15d4f0 0x7ff4fc0cfde0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009870 tx=0x7ff4e801c780 comp rx=0 tx=0).stop 2024-09-10T23:22:02.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 -- 172.21.15.17:0/2131517528 shutdown_connections 2024-09-10T23:22:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 --2- 172.21.15.17:0/2131517528 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4fc15d4f0 0x7ff4fc0cfde0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 -- 172.21.15.17:0/2131517528 >> 172.21.15.17:0/2131517528 conn(0x7ff4fc09a9f0 msgr2=0x7ff4fc09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 -- 172.21.15.17:0/2131517528 shutdown_connections 2024-09-10T23:22:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 -- 172.21.15.17:0/2131517528 wait complete. 2024-09-10T23:22:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 Processor -- start 2024-09-10T23:22:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 -- start start 2024-09-10T23:22:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4fc0d0320 0x7ff4fc14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4fc15be00 0x7ff4fc0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4fc15d4f0 0x7ff4fc06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc16a860 con 0x7ff4fc0d0320 2024-09-10T23:22:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc16a6e0 con 0x7ff4fc15be00 2024-09-10T23:22:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff503c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc16a9e0 con 0x7ff4fc15d4f0 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4fc0d0320 0x7ff4fc14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4fc0d0320 0x7ff4fc14ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59770/0 (socket says 172.21.15.17:59770) 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501200640 1 -- 172.21.15.17:0/4193493416 learned_addr learned my addr 172.21.15.17:0/4193493416 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff4fbe00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4fc15be00 0x7ff4fc0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501c00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4fc15d4f0 0x7ff4fc06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501200640 1 -- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4fc15d4f0 msgr2=0x7ff4fc06f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501200640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4fc15d4f0 0x7ff4fc06f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501200640 1 -- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4fc15be00 msgr2=0x7ff4fc0b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501200640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4fc15be00 0x7ff4fc0b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501200640 1 -- 172.21.15.17:0/4193493416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc0c7b80 con 0x7ff4fc0d0320 2024-09-10T23:22:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff501200640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4fc0d0320 0x7ff4fc14ddb0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c700 tx=0x7ff4f000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.304+0000 7ff4f8c00640 1 -- 172.21.15.17:0/4193493416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00050d0 con 0x7ff4fc0d0320 2024-09-10T23:22:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.308+0000 7ff4f8c00640 1 -- 172.21.15.17:0/4193493416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4f0005290 con 0x7ff4fc0d0320 2024-09-10T23:22:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.308+0000 7ff4f8c00640 1 -- 172.21.15.17:0/4193493416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000a8a0 con 0x7ff4fc0d0320 2024-09-10T23:22:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.308+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4fc0c7e60 con 0x7ff4fc0d0320 2024-09-10T23:22:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.308+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4fc0c8420 con 0x7ff4fc0d0320 2024-09-10T23:22:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.308+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4fc0cfde0 con 0x7ff4fc0d0320 2024-09-10T23:22:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.308+0000 7ff4f8c00640 1 -- 172.21.15.17:0/4193493416 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff4f000aa40 con 0x7ff4fc0d0320 2024-09-10T23:22:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.308+0000 7ff4f8c00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4dc0725e0 0x7ff4dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.308+0000 7ff4f8c00640 1 -- 172.21.15.17:0/4193493416 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6273+0+0 (secure 0 0 0) 0x7ff4f0093130 con 0x7ff4fc0d0320 2024-09-10T23:22:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.308+0000 7ff4fbe00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4dc0725e0 0x7ff4dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.312+0000 7ff4fbe00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4dc0725e0 0x7ff4dc074aa0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80af000 tx=0x7ff4e80b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.312+0000 7ff4f8c00640 1 -- 172.21.15.17:0/4193493416 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff4fc0b19f0 con 0x7ff4fc0d0320 2024-09-10T23:22:02.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:02.488+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff4fc0710f0 con 0x7ff4fc0d0320 2024-09-10T23:22:03.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.084+0000 7ff4f8c00640 1 -- 172.21.15.17:0/4193493416 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) ==== 181+0+0 (secure 0 0 0) 0x7ff4f0005480 con 0x7ff4fc0d0320 2024-09-10T23:22:03.086 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:22:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4dc0725e0 msgr2=0x7ff4dc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4dc0725e0 0x7ff4dc074aa0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80af000 tx=0x7ff4e80b2040 comp rx=0 tx=0).stop 2024-09-10T23:22:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4fc0d0320 msgr2=0x7ff4fc14ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:03.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4fc0d0320 0x7ff4fc14ddb0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c700 tx=0x7ff4f000cbc0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 shutdown_connections 2024-09-10T23:22:03.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4dc0725e0 0x7ff4dc074aa0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4fc15d4f0 0x7ff4fc06f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4fc15be00 0x7ff4fc0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 --2- 172.21.15.17:0/4193493416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4fc0d0320 0x7ff4fc14ddb0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 >> 172.21.15.17:0/4193493416 conn(0x7ff4fc09a9f0 msgr2=0x7ff4fc15eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:03.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 shutdown_connections 2024-09-10T23:22:03.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.088+0000 7ff503c00640 1 -- 172.21.15.17:0/4193493416 wait complete. 2024-09-10T23:22:03.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:22:03.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 -- 172.21.15.17:0/1861337693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc1511f0 msgr2=0x7fbffc074540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:03.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 --2- 172.21.15.17:0/1861337693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc1511f0 0x7fbffc074540 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0cf450 tx=0x7fbfec01c870 comp rx=0 tx=0).stop 2024-09-10T23:22:03.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 -- 172.21.15.17:0/1861337693 shutdown_connections 2024-09-10T23:22:03.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 --2- 172.21.15.17:0/1861337693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbffc15dd70 0x7fbffc15e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 --2- 172.21.15.17:0/1861337693 >> v2:172.21.15.77:3300/0 conn(0x7fbffc0707b0 0x7fbffc070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 --2- 172.21.15.17:0/1861337693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc1511f0 0x7fbffc074540 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 -- 172.21.15.17:0/1861337693 >> 172.21.15.17:0/1861337693 conn(0x7fbffc0b1d50 msgr2=0x7fbffc0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:03.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 -- 172.21.15.17:0/1861337693 shutdown_connections 2024-09-10T23:22:03.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 -- 172.21.15.17:0/1861337693 wait complete. 2024-09-10T23:22:03.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 Processor -- start 2024-09-10T23:22:03.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.264+0000 7fc001c00640 1 -- start start 2024-09-10T23:22:03.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fc001c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc0707b0 0x7fbffc1463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fc001c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbffc1511f0 0x7fbffc153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fc001c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc15dd70 0x7fbffc0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fc001c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc074170 con 0x7fbffc15dd70 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fc001c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc073ff0 con 0x7fbffc0707b0 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fc001c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbffc166f00 con 0x7fbffc1511f0 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc15dd70 0x7fbffc0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc15dd70 0x7fbffc0cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59778/0 (socket says 172.21.15.17:59778) 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffb400640 1 -- 172.21.15.17:0/4222401413 learned_addr learned my addr 172.21.15.17:0/4222401413 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffaa00640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc0707b0 0x7fbffc1463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbff2000640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbffc1511f0 0x7fbffc153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffb400640 1 -- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbffc1511f0 msgr2=0x7fbffc153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffb400640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbffc1511f0 0x7fbffc153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffb400640 1 -- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc0707b0 msgr2=0x7fbffc1463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:03.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffb400640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc0707b0 0x7fbffc1463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:03.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffb400640 1 -- 172.21.15.17:0/4222401413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc154710 con 0x7fbffc15dd70 2024-09-10T23:22:03.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbffb400640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc15dd70 0x7fbffc0cf010 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fbff400ea50 tx=0x7fbff400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:03.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbff3400640 1 -- 172.21.15.17:0/4222401413 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff400cdc0 con 0x7fbffc15dd70 2024-09-10T23:22:03.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbff3400640 1 -- 172.21.15.17:0/4222401413 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbff4004c40 con 0x7fbffc15dd70 2024-09-10T23:22:03.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbff3400640 1 -- 172.21.15.17:0/4222401413 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4005280 con 0x7fbffc15dd70 2024-09-10T23:22:03.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbffc1f8f70 con 0x7fbffc15dd70 2024-09-10T23:22:03.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbffc1468e0 con 0x7fbffc15dd70 2024-09-10T23:22:03.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbffc14d4a0 con 0x7fbffc15dd70 2024-09-10T23:22:03.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.268+0000 7fbff3400640 1 -- 172.21.15.17:0/4222401413 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbff400f040 con 0x7fbffc15dd70 2024-09-10T23:22:03.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.272+0000 7fbff3400640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbfd80725e0 0x7fbfd8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:03.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.272+0000 7fbff3400640 1 -- 172.21.15.17:0/4222401413 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5835+0+0 (secure 0 0 0) 0x7fbff40937f0 con 0x7fbffc15dd70 2024-09-10T23:22:03.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.272+0000 7fbffaa00640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbfd80725e0 0x7fbfd8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:03.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.272+0000 7fbffaa00640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbfd80725e0 0x7fbfd8074aa0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0af000 tx=0x7fbfec01b0b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:03.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.276+0000 7fbff3400640 1 -- 172.21.15.17:0/4222401413 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbff4016030 con 0x7fbffc15dd70 2024-09-10T23:22:03.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:03.452+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbffc14cee0 con 0x7fbffc15dd70 2024-09-10T23:22:04.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.084+0000 7fbff3400640 1 -- 172.21.15.17:0/4222401413 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) ==== 169+0+0 (secure 0 0 0) 0x7fbff405e890 con 0x7fbffc15dd70 2024-09-10T23:22:04.088 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:22:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbfd80725e0 msgr2=0x7fbfd8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbfd80725e0 0x7fbfd8074aa0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0af000 tx=0x7fbfec01b0b0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc15dd70 msgr2=0x7fbffc0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc15dd70 0x7fbffc0cf010 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fbff400ea50 tx=0x7fbff400ef10 comp rx=0 tx=0).stop 2024-09-10T23:22:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 shutdown_connections 2024-09-10T23:22:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbfd80725e0 0x7fbfd8074aa0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbffc15dd70 0x7fbffc0cf010 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbffc1511f0 0x7fbffc153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 --2- 172.21.15.17:0/4222401413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbffc0707b0 0x7fbffc1463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 >> 172.21.15.17:0/4222401413 conn(0x7fbffc0b1d50 msgr2=0x7fbffc0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 shutdown_connections 2024-09-10T23:22:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.092+0000 7fc001c00640 1 -- 172.21.15.17:0/4222401413 wait complete. 2024-09-10T23:22:04.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:22:04.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.280+0000 7fae27e00640 1 -- 172.21.15.17:0/3671671254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae08004810 msgr2=0x7fae08004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.280+0000 7fae27e00640 1 --2- 172.21.15.17:0/3671671254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae08004810 0x7fae08004c90 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0016c0 tx=0x7fae0c01c730 comp rx=0 tx=0).stop 2024-09-10T23:22:04.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.280+0000 7fae27e00640 1 -- 172.21.15.17:0/3671671254 shutdown_connections 2024-09-10T23:22:04.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.280+0000 7fae27e00640 1 --2- 172.21.15.17:0/3671671254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae08004810 0x7fae08004c90 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.280+0000 7fae27e00640 1 -- 172.21.15.17:0/3671671254 >> 172.21.15.17:0/3671671254 conn(0x7fae200b1730 msgr2=0x7fae200b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.280+0000 7fae27e00640 1 -- 172.21.15.17:0/3671671254 shutdown_connections 2024-09-10T23:22:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.280+0000 7fae27e00640 1 -- 172.21.15.17:0/3671671254 wait complete. 2024-09-10T23:22:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.280+0000 7fae27e00640 1 Processor -- start 2024-09-10T23:22:04.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 -- start start 2024-09-10T23:22:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae08004810 0x7fae2014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae200ce360 0x7fae201f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae201f8150 0x7fae201f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fae2015e2a0 con 0x7fae201f8150 2024-09-10T23:22:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fae2015e120 con 0x7fae200ce360 2024-09-10T23:22:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fae200726f0 con 0x7fae08004810 2024-09-10T23:22:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae201f8150 0x7fae201f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae201f8150 0x7fae201f85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59788/0 (socket says 172.21.15.17:59788) 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25e00640 1 -- 172.21.15.17:0/3973897861 learned_addr learned my addr 172.21.15.17:0/3973897861 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25400640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae08004810 0x7fae2014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae24a00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae200ce360 0x7fae201f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25e00640 1 -- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae08004810 msgr2=0x7fae2014deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25e00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae08004810 0x7fae2014deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25e00640 1 -- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae200ce360 msgr2=0x7fae201f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25e00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae200ce360 0x7fae201f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25e00640 1 -- 172.21.15.17:0/3973897861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae201f5af0 con 0x7fae201f8150 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25400640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae08004810 0x7fae2014deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae25e00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae201f8150 0x7fae201f85d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fae200753e0 tx=0x7fae1800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae1d600640 1 -- 172.21.15.17:0/3973897861 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1800abc0 con 0x7fae201f8150 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae1d600640 1 -- 172.21.15.17:0/3973897861 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae18003980 con 0x7fae201f8150 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae1d600640 1 -- 172.21.15.17:0/3973897861 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18003d70 con 0x7fae201f8150 2024-09-10T23:22:04.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae200cd2c0 con 0x7fae201f8150 2024-09-10T23:22:04.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae200cd880 con 0x7fae201f8150 2024-09-10T23:22:04.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.284+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae200ce050 con 0x7fae201f8150 2024-09-10T23:22:04.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.288+0000 7fae1d600640 1 -- 172.21.15.17:0/3973897861 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fae18022070 con 0x7fae201f8150 2024-09-10T23:22:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.288+0000 7fae1d600640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae000725e0 0x7fae00074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.288+0000 7fae1d600640 1 -- 172.21.15.17:0/3973897861 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7fae18093e60 con 0x7fae201f8150 2024-09-10T23:22:04.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.288+0000 7fae25400640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae000725e0 0x7fae00074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.288+0000 7fae25400640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae000725e0 0x7fae00074aa0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fae14000fc0 tx=0x7fae14006730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:04.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.292+0000 7fae1d600640 1 -- 172.21.15.17:0/3973897861 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fae1801f060 con 0x7fae201f8150 2024-09-10T23:22:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.468+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fae2006e6f0 con 0x7fae201f8150 2024-09-10T23:22:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae1d600640 1 -- 172.21.15.17:0/3973897861 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v45) ==== 71+0+0 (secure 0 0 0) 0x7fae1805f5c0 con 0x7fae201f8150 2024-09-10T23:22:04.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae000725e0 msgr2=0x7fae00074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae000725e0 0x7fae00074aa0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fae14000fc0 tx=0x7fae14006730 comp rx=0 tx=0).stop 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae201f8150 msgr2=0x7fae201f85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae201f8150 0x7fae201f85d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fae200753e0 tx=0x7fae1800af90 comp rx=0 tx=0).stop 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 shutdown_connections 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae000725e0 0x7fae00074aa0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae201f8150 0x7fae201f85d0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae200ce360 0x7fae201f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 --2- 172.21.15.17:0/3973897861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae08004810 0x7fae2014deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 >> 172.21.15.17:0/3973897861 conn(0x7fae200b1730 msgr2=0x7fae2014a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 shutdown_connections 2024-09-10T23:22:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.472+0000 7fae27e00640 1 -- 172.21.15.17:0/3973897861 wait complete. 2024-09-10T23:22:04.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-10T23:22:04.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.636+0000 7f6c8ea00640 1 -- 172.21.15.17:0/983121964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c88152b40 msgr2=0x7f6c880b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.636+0000 7f6c8ea00640 1 --2- 172.21.15.17:0/983121964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c88152b40 0x7f6c880b48d0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009900 tx=0x7f6c7801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.636+0000 7f6c8ea00640 1 -- 172.21.15.17:0/983121964 shutdown_connections 2024-09-10T23:22:04.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.636+0000 7f6c8ea00640 1 --2- 172.21.15.17:0/983121964 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c881602d0 0x7f6c880cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.636+0000 7f6c8ea00640 1 --2- 172.21.15.17:0/983121964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c88152b40 0x7f6c880b48d0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.636+0000 7f6c8ea00640 1 -- 172.21.15.17:0/983121964 >> 172.21.15.17:0/983121964 conn(0x7f6c8806cfc0 msgr2=0x7f6c8806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.636+0000 7f6c8ea00640 1 -- 172.21.15.17:0/983121964 shutdown_connections 2024-09-10T23:22:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 -- 172.21.15.17:0/983121964 wait complete. 2024-09-10T23:22:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 Processor -- start 2024-09-10T23:22:04.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 -- start start 2024-09-10T23:22:04.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c880d0520 0x7f6c881fc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c88152b40 0x7f6c881f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c881602d0 0x7f6c881423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6c88169030 con 0x7f6c880d0520 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6c88168eb0 con 0x7f6c881602d0 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6c881691b0 con 0x7f6c88152b40 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c87e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c880d0520 0x7f6c881fc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c87e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c880d0520 0x7f6c881fc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59796/0 (socket says 172.21.15.17:59796) 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c87e00640 1 -- 172.21.15.17:0/1689552845 learned_addr learned my addr 172.21.15.17:0/1689552845 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c7f400640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c88152b40 0x7f6c881f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ca00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c881602d0 0x7f6c881423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c87e00640 1 -- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c88152b40 msgr2=0x7f6c881f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c87e00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c88152b40 0x7f6c881f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c87e00640 1 -- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c881602d0 msgr2=0x7f6c881423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:04.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c87e00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c881602d0 0x7f6c881423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:04.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c87e00640 1 -- 172.21.15.17:0/1689552845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c881f8710 con 0x7f6c880d0520 2024-09-10T23:22:04.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c87e00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c880d0520 0x7f6c881fc080 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6c780b0040 tx=0x7f6c78005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:04.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c84c00640 1 -- 172.21.15.17:0/1689552845 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c780b2040 con 0x7f6c880d0520 2024-09-10T23:22:04.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c84c00640 1 -- 172.21.15.17:0/1689552845 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c780a5c10 con 0x7f6c880d0520 2024-09-10T23:22:04.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c84c00640 1 -- 172.21.15.17:0/1689552845 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78005030 con 0x7f6c880d0520 2024-09-10T23:22:04.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c881f89f0 con 0x7f6c880d0520 2024-09-10T23:22:04.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.640+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c88153580 con 0x7f6c880d0520 2024-09-10T23:22:04.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.644+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c881f8f10 con 0x7f6c880d0520 2024-09-10T23:22:04.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.644+0000 7f6c84c00640 1 -- 172.21.15.17:0/1689552845 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6c780051d0 con 0x7f6c880d0520 2024-09-10T23:22:04.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.644+0000 7f6c84c00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c640725e0 0x7f6c64074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:04.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.644+0000 7f6c84c00640 1 -- 172.21.15.17:0/1689552845 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f6c7812ce10 con 0x7f6c880d0520 2024-09-10T23:22:04.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.644+0000 7f6c7f400640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c640725e0 0x7f6c64074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:04.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.648+0000 7f6c7f400640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c640725e0 0x7f6c64074aa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6c88156190 tx=0x7f6c700091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:04.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.648+0000 7f6c84c00640 1 -- 172.21.15.17:0/1689552845 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6c881f8f10 con 0x7f6c880d0520 2024-09-10T23:22:04.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:04.888+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f6c880b48d0 con 0x7f6c880d0520 2024-09-10T23:22:05.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.092+0000 7f6c84c00640 1 -- 172.21.15.17:0/1689552845 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v324) ==== 151+0+0 (secure 0 0 0) 0x7f6c78130030 con 0x7f6c880d0520 2024-09-10T23:22:05.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c640725e0 msgr2=0x7f6c64074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c640725e0 0x7f6c64074aa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6c88156190 tx=0x7f6c700091e0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c880d0520 msgr2=0x7f6c881fc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c880d0520 0x7f6c881fc080 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6c780b0040 tx=0x7f6c78005e70 comp rx=0 tx=0).stop 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 shutdown_connections 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6c640725e0 0x7f6c64074aa0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c881602d0 0x7f6c881423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c88152b40 0x7f6c881f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 --2- 172.21.15.17:0/1689552845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c880d0520 0x7f6c881fc080 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 >> 172.21.15.17:0/1689552845 conn(0x7f6c8806cfc0 msgr2=0x7f6c8806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 shutdown_connections 2024-09-10T23:22:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.096+0000 7f6c8ea00640 1 -- 172.21.15.17:0/1689552845 wait complete. 2024-09-10T23:22:05.118 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-09-10T23:22:05.118 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-09-10T23:22:05.118 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T23:22:05.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:22:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 -- 172.21.15.17:0/844252004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215415bc70 msgr2=0x7f21540cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 --2- 172.21.15.17:0/844252004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215415bc70 0x7f21540cfa20 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f21540d2a50 tx=0x7f214801c850 comp rx=0 tx=0).stop 2024-09-10T23:22:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 -- 172.21.15.17:0/844252004 shutdown_connections 2024-09-10T23:22:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 --2- 172.21.15.17:0/844252004 >> v2:172.21.15.77:3300/0 conn(0x7f21540d20a0 0x7f21540b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 --2- 172.21.15.17:0/844252004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f215415bc70 0x7f21540cfa20 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 -- 172.21.15.17:0/844252004 >> 172.21.15.17:0/844252004 conn(0x7f215409a9f0 msgr2=0x7f215409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:05.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 -- 172.21.15.17:0/844252004 shutdown_connections 2024-09-10T23:22:05.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 -- 172.21.15.17:0/844252004 wait complete. 2024-09-10T23:22:05.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 Processor -- start 2024-09-10T23:22:05.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.264+0000 7f215a000640 1 -- start start 2024-09-10T23:22:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f215a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21540cc570 0x7f2154153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f215a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540d20a0 0x7f21541f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f215a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215415bc70 0x7f21540c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f215a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f21541688a0 con 0x7f21540cc570 2024-09-10T23:22:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f215a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2154168720 con 0x7f215415bc70 2024-09-10T23:22:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f215a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2154168a20 con 0x7f21540d20a0 2024-09-10T23:22:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2158c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21540cc570 0x7f2154153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2158c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21540cc570 0x7f2154153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59816/0 (socket says 172.21.15.17:59816) 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2158c00640 1 -- 172.21.15.17:0/4166481768 learned_addr learned my addr 172.21.15.17:0/4166481768 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2153e00640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540d20a0 0x7f21541f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2159600640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215415bc70 0x7f21540c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2158c00640 1 -- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540d20a0 msgr2=0x7f21541f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2158c00640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540d20a0 0x7f21541f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2158c00640 1 -- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215415bc70 msgr2=0x7f21540c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2158c00640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215415bc70 0x7f21540c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2158c00640 1 -- 172.21.15.17:0/4166481768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21541f8310 con 0x7f21540cc570 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2153e00640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540d20a0 0x7f21541f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2158c00640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21540cc570 0x7f2154153930 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f214801af00 tx=0x7f21480a5830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2150c00640 1 -- 172.21.15.17:0/4166481768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21480ba020 con 0x7f21540cc570 2024-09-10T23:22:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2150c00640 1 -- 172.21.15.17:0/4166481768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21480044b0 con 0x7f21540cc570 2024-09-10T23:22:05.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21540c6820 con 0x7f21540cc570 2024-09-10T23:22:05.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f2150c00640 1 -- 172.21.15.17:0/4166481768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21480b2040 con 0x7f21540cc570 2024-09-10T23:22:05.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21540c6de0 con 0x7f21540cc570 2024-09-10T23:22:05.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.268+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215406f740 con 0x7f21540cc570 2024-09-10T23:22:05.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.272+0000 7f2150c00640 1 -- 172.21.15.17:0/4166481768 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2148005290 con 0x7f21540cc570 2024-09-10T23:22:05.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.272+0000 7f2150c00640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21340725e0 0x7f2134074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.272+0000 7f2150c00640 1 -- 172.21.15.17:0/4166481768 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f214812cff0 con 0x7f21540cc570 2024-09-10T23:22:05.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.272+0000 7f2153e00640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21340725e0 0x7f2134074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.272+0000 7f2153e00640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21340725e0 0x7f2134074aa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2154166690 tx=0x7f2140009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:05.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.276+0000 7f2150c00640 1 -- 172.21.15.17:0/4166481768 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f215406f740 con 0x7f21540cc570 2024-09-10T23:22:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21540b10f0 con 0x7f21540cc570 2024-09-10T23:22:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f2150c00640 1 -- 172.21.15.17:0/4166481768 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+13381 (secure 0 0 0) 0x7f21480c4060 con 0x7f21540cc570 2024-09-10T23:22:05.453 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:05.453 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":110,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:22:04.086446+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/3574515762":"2024-09-11T23:22:01.074600+0000","172.21.15.17:6834/3574515762":"2024-09-11T23:22:01.074600+0000","172.21.15.17:6835/70051217":"2024-09-11T23:21:45.466098+0000","172.21.15.17:6833/70051217":"2024-09-11T23:21:45.466098+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21340725e0 msgr2=0x7f2134074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21340725e0 0x7f2134074aa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2154166690 tx=0x7f2140009040 comp rx=0 tx=0).stop 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21540cc570 msgr2=0x7f2154153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21540cc570 0x7f2154153930 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f214801af00 tx=0x7f21480a5830 comp rx=0 tx=0).stop 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 shutdown_connections 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21340725e0 0x7f2134074aa0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f215415bc70 0x7f21540c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540d20a0 0x7f21541f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 --2- 172.21.15.17:0/4166481768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21540cc570 0x7f2154153930 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 >> 172.21.15.17:0/4166481768 conn(0x7f215409a9f0 msgr2=0x7f2154158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 shutdown_connections 2024-09-10T23:22:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.452+0000 7f215a000640 1 -- 172.21.15.17:0/4166481768 wait complete. 2024-09-10T23:22:05.474 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:22:05.474 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:22:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.624+0000 7fbb53000640 1 -- 172.21.15.17:0/4224702403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb34004810 msgr2=0x7fbb34004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.624+0000 7fbb53000640 1 --2- 172.21.15.17:0/4224702403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb34004810 0x7fbb34004c90 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009b30 tx=0x7fbb3801d250 comp rx=0 tx=0).stop 2024-09-10T23:22:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.624+0000 7fbb53000640 1 -- 172.21.15.17:0/4224702403 shutdown_connections 2024-09-10T23:22:05.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.624+0000 7fbb53000640 1 --2- 172.21.15.17:0/4224702403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb34004810 0x7fbb34004c90 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.624+0000 7fbb53000640 1 -- 172.21.15.17:0/4224702403 >> 172.21.15.17:0/4224702403 conn(0x7fbb4c09a9f0 msgr2=0x7fbb4c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:05.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.624+0000 7fbb53000640 1 -- 172.21.15.17:0/4224702403 shutdown_connections 2024-09-10T23:22:05.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.624+0000 7fbb53000640 1 -- 172.21.15.17:0/4224702403 wait complete. 2024-09-10T23:22:05.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.624+0000 7fbb53000640 1 Processor -- start 2024-09-10T23:22:05.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.624+0000 7fbb53000640 1 -- start start 2024-09-10T23:22:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb53000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb34004810 0x7fbb4c1f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb53000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4c1edee0 0x7fbb4c0b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb53000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb4c0b6a50 0x7fbb4c1f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb53000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0b2d60 con 0x7fbb4c1edee0 2024-09-10T23:22:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb53000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0b2be0 con 0x7fbb4c0b6a50 2024-09-10T23:22:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb53000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c0d0170 con 0x7fbb34004810 2024-09-10T23:22:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4c1edee0 0x7fbb4c0b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4c1edee0 0x7fbb4c0b6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59838/0 (socket says 172.21.15.17:59838) 2024-09-10T23:22:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51200640 1 -- 172.21.15.17:0/2807321526 learned_addr learned my addr 172.21.15.17:0/2807321526 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51c00640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb34004810 0x7fbb4c1f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb52600640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb4c0b6a50 0x7fbb4c1f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51200640 1 -- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb34004810 msgr2=0x7fbb4c1f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51200640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb34004810 0x7fbb4c1f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51200640 1 -- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb4c0b6a50 msgr2=0x7fbb4c1f7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51200640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb4c0b6a50 0x7fbb4c1f7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51200640 1 -- 172.21.15.17:0/2807321526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c1e6700 con 0x7fbb4c1edee0 2024-09-10T23:22:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb51200640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4c1edee0 0x7fbb4c0b6510 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbb380af040 tx=0x7fbb38005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb49600640 1 -- 172.21.15.17:0/2807321526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb380b1040 con 0x7fbb4c1edee0 2024-09-10T23:22:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb49600640 1 -- 172.21.15.17:0/2807321526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb380bb070 con 0x7fbb4c1edee0 2024-09-10T23:22:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb49600640 1 -- 172.21.15.17:0/2807321526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38004380 con 0x7fbb4c1edee0 2024-09-10T23:22:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c1e69e0 con 0x7fbb4c1edee0 2024-09-10T23:22:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c1ee340 con 0x7fbb4c1edee0 2024-09-10T23:22:05.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4c0d06d0 con 0x7fbb4c1edee0 2024-09-10T23:22:05.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.628+0000 7fbb49600640 1 -- 172.21.15.17:0/2807321526 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbb380046d0 con 0x7fbb4c1edee0 2024-09-10T23:22:05.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.632+0000 7fbb49600640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb2c0725e0 0x7fbb2c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.632+0000 7fbb49600640 1 -- 172.21.15.17:0/2807321526 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7fbb3812e1a0 con 0x7fbb4c1edee0 2024-09-10T23:22:05.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.632+0000 7fbb51c00640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb2c0725e0 0x7fbb2c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.632+0000 7fbb51c00640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb2c0725e0 0x7fbb2c074aa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbb40000c10 tx=0x7fbb40006b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:05.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.636+0000 7fbb49600640 1 -- 172.21.15.17:0/2807321526 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbb38016f60 con 0x7fbb4c1edee0 2024-09-10T23:22:05.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.808+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbb4c0b6e30 con 0x7fbb4c1edee0 2024-09-10T23:22:05.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.808+0000 7fbb49600640 1 -- 172.21.15.17:0/2807321526 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) ==== 93+0+10 (secure 0 0 0) 0x7fbb380f9910 con 0x7fbb4c1edee0 2024-09-10T23:22:05.811 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:22:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb2c0725e0 msgr2=0x7fbb2c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb2c0725e0 0x7fbb2c074aa0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbb40000c10 tx=0x7fbb40006b80 comp rx=0 tx=0).stop 2024-09-10T23:22:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4c1edee0 msgr2=0x7fbb4c0b6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4c1edee0 0x7fbb4c0b6510 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbb380af040 tx=0x7fbb38005640 comp rx=0 tx=0).stop 2024-09-10T23:22:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 shutdown_connections 2024-09-10T23:22:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbb2c0725e0 0x7fbb2c074aa0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb4c0b6a50 0x7fbb4c1f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb4c1edee0 0x7fbb4c0b6510 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 --2- 172.21.15.17:0/2807321526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbb34004810 0x7fbb4c1f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 >> 172.21.15.17:0/2807321526 conn(0x7fbb4c09a9f0 msgr2=0x7fbb4c0cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 shutdown_connections 2024-09-10T23:22:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.812+0000 7fbb53000640 1 -- 172.21.15.17:0/2807321526 wait complete. 2024-09-10T23:22:05.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-10T23:22:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.976+0000 7f8457a00640 1 -- 172.21.15.17:0/2870731407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015ef40 msgr2=0x7f845015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.976+0000 7f8457a00640 1 --2- 172.21.15.17:0/2870731407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015ef40 0x7f845015afe0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f8444009900 tx=0x7f844401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.976+0000 7f8457a00640 1 -- 172.21.15.17:0/2870731407 shutdown_connections 2024-09-10T23:22:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.976+0000 7f8457a00640 1 --2- 172.21.15.17:0/2870731407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f84500d0030 0x7f84500d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.976+0000 7f8457a00640 1 --2- 172.21.15.17:0/2870731407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015ef40 0x7f845015afe0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.976+0000 7f8457a00640 1 -- 172.21.15.17:0/2870731407 >> 172.21.15.17:0/2870731407 conn(0x7f845006cfc0 msgr2=0x7f845006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.976+0000 7f8457a00640 1 -- 172.21.15.17:0/2870731407 shutdown_connections 2024-09-10T23:22:05.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.976+0000 7f8457a00640 1 -- 172.21.15.17:0/2870731407 wait complete. 2024-09-10T23:22:05.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 Processor -- start 2024-09-10T23:22:05.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 -- start start 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f84500d0030 0x7f845014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015e5d0 0x7f845014d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015ef40 0x7f84501522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8450167c00 con 0x7f845015e5d0 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8450167a80 con 0x7f845015ef40 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8450167d80 con 0x7f84500d0030 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015e5d0 0x7f845014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015e5d0 0x7f845014d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59858/0 (socket says 172.21.15.17:59858) 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844fe00640 1 -- 172.21.15.17:0/4001054454 learned_addr learned my addr 172.21.15.17:0/4001054454 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8455000640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f84500d0030 0x7f845014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8455a00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015ef40 0x7f84501522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844fe00640 1 -- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f84500d0030 msgr2=0x7f845014cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844fe00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f84500d0030 0x7f845014cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844fe00640 1 -- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015ef40 msgr2=0x7f84501522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:05.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844fe00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015ef40 0x7f84501522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:05.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844fe00640 1 -- 172.21.15.17:0/4001054454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845014db60 con 0x7f845015e5d0 2024-09-10T23:22:05.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844fe00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015e5d0 0x7f845014d250 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c500 tx=0x7f843c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:05.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844cc00640 1 -- 172.21.15.17:0/4001054454 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c017070 con 0x7f845015e5d0 2024-09-10T23:22:05.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844cc00640 1 -- 172.21.15.17:0/4001054454 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f843c0053c0 con 0x7f845015e5d0 2024-09-10T23:22:05.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f844cc00640 1 -- 172.21.15.17:0/4001054454 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c012890 con 0x7f845015e5d0 2024-09-10T23:22:05.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8450157d50 con 0x7f845015e5d0 2024-09-10T23:22:05.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.980+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8450156f90 con 0x7f845015e5d0 2024-09-10T23:22:05.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.984+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84500d0430 con 0x7f845015e5d0 2024-09-10T23:22:05.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.984+0000 7f844cc00640 1 -- 172.21.15.17:0/4001054454 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f843c003600 con 0x7f845015e5d0 2024-09-10T23:22:05.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.984+0000 7f844cc00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f84300725e0 0x7f8430074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:05.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.984+0000 7f844cc00640 1 -- 172.21.15.17:0/4001054454 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f843c092740 con 0x7f845015e5d0 2024-09-10T23:22:05.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.984+0000 7f8455000640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f84300725e0 0x7f8430074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:05.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.984+0000 7f8455000640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f84300725e0 0x7f8430074aa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f84440af000 tx=0x7f844401b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:05.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:05.988+0000 7f844cc00640 1 -- 172.21.15.17:0/4001054454 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f843c05d860 con 0x7f845015e5d0 2024-09-10T23:22:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:06.224+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f84500b3250 con 0x7f845015e5d0 2024-09-10T23:22:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.100+0000 7f844cc00640 1 -- 172.21.15.17:0/4001054454 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v326) ==== 161+0+0 (secure 0 0 0) 0x7f843c062290 con 0x7f845015e5d0 2024-09-10T23:22:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f84300725e0 msgr2=0x7f8430074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f84300725e0 0x7f8430074aa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f84440af000 tx=0x7f844401b0f0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015e5d0 msgr2=0x7f845014d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015e5d0 0x7f845014d250 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c500 tx=0x7f843c00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 shutdown_connections 2024-09-10T23:22:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f84300725e0 0x7f8430074aa0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f845015ef40 0x7f84501522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f845015e5d0 0x7f845014d250 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 --2- 172.21.15.17:0/4001054454 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f84500d0030 0x7f845014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 >> 172.21.15.17:0/4001054454 conn(0x7f845006cfc0 msgr2=0x7f845014e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 shutdown_connections 2024-09-10T23:22:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.104+0000 7f8457a00640 1 -- 172.21.15.17:0/4001054454 wait complete. 2024-09-10T23:22:07.115 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:22:07.119 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:22:07.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:22:07.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 -- 172.21.15.17:0/534488846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47740b3110 msgr2=0x7f47740b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 --2- 172.21.15.17:0/534488846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47740b3110 0x7f47740b21d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4760009900 tx=0x7f476001c8b0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 -- 172.21.15.17:0/534488846 shutdown_connections 2024-09-10T23:22:07.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 --2- 172.21.15.17:0/534488846 >> v2:172.21.15.77:3300/0 conn(0x7f47740d02e0 0x7f47740cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 --2- 172.21.15.17:0/534488846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47740b3110 0x7f47740b21d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 -- 172.21.15.17:0/534488846 >> 172.21.15.17:0/534488846 conn(0x7f47740b3870 msgr2=0x7f47740b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:07.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 -- 172.21.15.17:0/534488846 shutdown_connections 2024-09-10T23:22:07.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 -- 172.21.15.17:0/534488846 wait complete. 2024-09-10T23:22:07.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 Processor -- start 2024-09-10T23:22:07.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.372+0000 7f477be00640 1 -- start start 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f477be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47740b3110 0x7f4774152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f477be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47740d02e0 0x7f4774164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f477be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477415f130 0x7f4774165440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f477be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47741692a0 con 0x7f477415f130 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f477be00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4774169120 con 0x7f47740b3110 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f477be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4774169420 con 0x7f47740d02e0 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4779400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47740b3110 0x7f4774152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4778a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47740d02e0 0x7f4774164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4779400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47740b3110 0x7f4774152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:52930/0 (socket says 172.21.15.17:52930) 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4779400640 1 -- 172.21.15.17:0/2115409410 learned_addr learned my addr 172.21.15.17:0/2115409410 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4779e00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477415f130 0x7f4774165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:07.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4778a00640 1 -- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47740b3110 msgr2=0x7f4774152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4778a00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47740b3110 0x7f4774152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4778a00640 1 -- 172.21.15.17:0/2115409410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477415f130 msgr2=0x7f4774165440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4778a00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477415f130 0x7f4774165440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4778a00640 1 -- 172.21.15.17:0/2115409410 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47741f83e0 con 0x7f47740d02e0 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4779400640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47740b3110 0x7f4774152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4779e00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477415f130 0x7f4774165440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4778a00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47740d02e0 0x7f4774164f00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47740b1620 tx=0x7f4760005e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4771600640 1 -- 172.21.15.17:0/2115409410 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47600b2040 con 0x7f47740d02e0 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4771600640 1 -- 172.21.15.17:0/2115409410 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4760005320 con 0x7f47740d02e0 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f4771600640 1 -- 172.21.15.17:0/2115409410 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47600046d0 con 0x7f47740d02e0 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47741f86c0 con 0x7f47740d02e0 2024-09-10T23:22:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47740b63c0 con 0x7f47740d02e0 2024-09-10T23:22:07.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.376+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47740b21d0 con 0x7f47740d02e0 2024-09-10T23:22:07.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.380+0000 7f4771600640 1 -- 172.21.15.17:0/2115409410 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4760004890 con 0x7f47740d02e0 2024-09-10T23:22:07.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.380+0000 7f4771600640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47540725e0 0x7f4754074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:07.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.380+0000 7f4771600640 1 -- 172.21.15.17:0/2115409410 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f476012d070 con 0x7f47740d02e0 2024-09-10T23:22:07.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.380+0000 7f4779400640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47540725e0 0x7f4754074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:07.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.380+0000 7f4779400640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47540725e0 0x7f4754074aa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4774152850 tx=0x7f4768009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.384+0000 7f4771600640 1 -- 172.21.15.17:0/2115409410 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f47600164d0 con 0x7f47740d02e0 2024-09-10T23:22:07.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.556+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f47740b0010 con 0x7f47740d02e0 2024-09-10T23:22:07.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.556+0000 7f4771600640 1 -- 172.21.15.17:0/2115409410 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v45) ==== 59+0+1998 (secure 0 0 0) 0x7f47600f8200 con 0x7f47740d02e0 2024-09-10T23:22:07.558 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:22:07.558 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:22:07.558 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:22:07.558 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:22:07.558 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:22:07.558 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:22:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:22:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:22:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:22:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:22:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:22:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:22:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:22:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:22:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:22:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:22:07.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47540725e0 msgr2=0x7f4754074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47540725e0 0x7f4754074aa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4774152850 tx=0x7f4768009040 comp rx=0 tx=0).stop 2024-09-10T23:22:07.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47740d02e0 msgr2=0x7f4774164f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47740d02e0 0x7f4774164f00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47740b1620 tx=0x7f4760005e70 comp rx=0 tx=0).stop 2024-09-10T23:22:07.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 shutdown_connections 2024-09-10T23:22:07.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47540725e0 0x7f4754074aa0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f477415f130 0x7f4774165440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47740d02e0 0x7f4774164f00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 --2- 172.21.15.17:0/2115409410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47740b3110 0x7f4774152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 >> 172.21.15.17:0/2115409410 conn(0x7f47740b3870 msgr2=0x7f47740aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:07.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 shutdown_connections 2024-09-10T23:22:07.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.560+0000 7f477be00640 1 -- 172.21.15.17:0/2115409410 wait complete. 2024-09-10T23:22:07.580 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:22:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 -- 172.21.15.17:0/2669575276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e806e6f0 msgr2=0x7fa6e815fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 --2- 172.21.15.17:0/2669575276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e806e6f0 0x7fa6e815fcb0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80708a0 tx=0x7fa6e001cd80 comp rx=0 tx=0).stop 2024-09-10T23:22:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 -- 172.21.15.17:0/2669575276 shutdown_connections 2024-09-10T23:22:07.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 --2- 172.21.15.17:0/2669575276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e806e6f0 0x7fa6e815fcb0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 --2- 172.21.15.17:0/2669575276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6e8160460 0x7fa6e815f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 --2- 172.21.15.17:0/2669575276 >> v2:172.21.15.77:3300/0 conn(0x7fa6e8145800 0x7fa6e80741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 -- 172.21.15.17:0/2669575276 >> 172.21.15.17:0/2669575276 conn(0x7fa6e80b17a0 msgr2=0x7fa6e80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 -- 172.21.15.17:0/2669575276 shutdown_connections 2024-09-10T23:22:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 -- 172.21.15.17:0/2669575276 wait complete. 2024-09-10T23:22:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 Processor -- start 2024-09-10T23:22:07.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.728+0000 7fa6f0600640 1 -- start start 2024-09-10T23:22:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6f0600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6e806e6f0 0x7fa6e8165490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6f0600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e8145800 0x7fa6e81f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6f0600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e8160460 0x7fa6e813c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6f0600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e815c4c0 con 0x7fa6e8145800 2024-09-10T23:22:07.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6f0600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e815c340 con 0x7fa6e8160460 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6f0600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e815c640 con 0x7fa6e806e6f0 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ed200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e8145800 0x7fa6e81f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ed200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e8145800 0x7fa6e81f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48676/0 (socket says 172.21.15.17:48676) 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ed200640 1 -- 172.21.15.17:0/858151327 learned_addr learned my addr 172.21.15.17:0/858151327 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6edc00640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6e806e6f0 0x7fa6e8165490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ee600640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e8160460 0x7fa6e813c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ed200640 1 -- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6e806e6f0 msgr2=0x7fa6e8165490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ed200640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6e806e6f0 0x7fa6e8165490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ed200640 1 -- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e8160460 msgr2=0x7fa6e813c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ed200640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e8160460 0x7fa6e813c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ed200640 1 -- 172.21.15.17:0/858151327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e813cfa0 con 0x7fa6e8145800 2024-09-10T23:22:07.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6ed200640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e8145800 0x7fa6e81f7c60 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4005d10 tx=0x7fa6d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6e5600640 1 -- 172.21.15.17:0/858151327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4017070 con 0x7fa6e8145800 2024-09-10T23:22:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6e5600640 1 -- 172.21.15.17:0/858151327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6d4009b20 con 0x7fa6e8145800 2024-09-10T23:22:07.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e813d280 con 0x7fa6e8145800 2024-09-10T23:22:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6e5600640 1 -- 172.21.15.17:0/858151327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4005020 con 0x7fa6e8145800 2024-09-10T23:22:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e813dca0 con 0x7fa6e8145800 2024-09-10T23:22:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.732+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e80741d0 con 0x7fa6e8145800 2024-09-10T23:22:07.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.736+0000 7fa6e5600640 1 -- 172.21.15.17:0/858151327 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa6d40051c0 con 0x7fa6e8145800 2024-09-10T23:22:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.736+0000 7fa6e5600640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6c80725e0 0x7fa6c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.736+0000 7fa6e5600640 1 -- 172.21.15.17:0/858151327 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7fa6d4093230 con 0x7fa6e8145800 2024-09-10T23:22:07.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.736+0000 7fa6edc00640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6c80725e0 0x7fa6c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:07.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.736+0000 7fa6edc00640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6c80725e0 0x7fa6c8074aa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa6e815e0b0 tx=0x7fa6dc00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:07.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.740+0000 7fa6e5600640 1 -- 172.21.15.17:0/858151327 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa6d405e340 con 0x7fa6e8145800 2024-09-10T23:22:07.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.916+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa6e813ca20 con 0x7fa6e8145800 2024-09-10T23:22:07.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.920+0000 7fa6e5600640 1 -- 172.21.15.17:0/858151327 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fa6d40670b0 con 0x7fa6e8145800 2024-09-10T23:22:07.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6c80725e0 msgr2=0x7fa6c8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6c80725e0 0x7fa6c8074aa0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa6e815e0b0 tx=0x7fa6dc00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e8145800 msgr2=0x7fa6e81f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e8145800 0x7fa6e81f7c60 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4005d10 tx=0x7fa6d400dbb0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 shutdown_connections 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6c80725e0 0x7fa6c8074aa0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e8160460 0x7fa6e813c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e8145800 0x7fa6e81f7c60 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 --2- 172.21.15.17:0/858151327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6e806e6f0 0x7fa6e8165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 >> 172.21.15.17:0/858151327 conn(0x7fa6e80b17a0 msgr2=0x7fa6e806ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 shutdown_connections 2024-09-10T23:22:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:07.924+0000 7fa6f0600640 1 -- 172.21.15.17:0/858151327 wait complete. 2024-09-10T23:22:07.942 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:22:07.942 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:22:08.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:22:08.131 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:22:08.131 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:22:08.131 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:22:08.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:22:08.140 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:22:08.140 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:22:08.149 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:22:08.149 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:22:08.150 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:22:08.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:22:08.192 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:22:08.192 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:22:08.204 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:22:08.205 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:22:08.205 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:22:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 -- 172.21.15.17:0/4190844753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a00d2830 msgr2=0x7f38a00d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:08.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 --2- 172.21.15.17:0/4190844753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a00d2830 0x7f38a00d0030 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f388c009840 tx=0x7f388c01f010 comp rx=0 tx=0).stop 2024-09-10T23:22:08.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 -- 172.21.15.17:0/4190844753 shutdown_connections 2024-09-10T23:22:08.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 --2- 172.21.15.17:0/4190844753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a00d2830 0x7f38a00d0030 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 --2- 172.21.15.17:0/4190844753 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38a0160280 0x7f38a00cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 -- 172.21.15.17:0/4190844753 >> 172.21.15.17:0/4190844753 conn(0x7f38a00d1d10 msgr2=0x7f38a00d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:08.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 -- 172.21.15.17:0/4190844753 shutdown_connections 2024-09-10T23:22:08.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 -- 172.21.15.17:0/4190844753 wait complete. 2024-09-10T23:22:08.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 Processor -- start 2024-09-10T23:22:08.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.380+0000 7f38a7800640 1 -- start start 2024-09-10T23:22:08.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a7800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38a00d2830 0x7f38a00c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a7800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a0160280 0x7f38a00ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a7800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a0160660 0x7f38a00ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a7800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00afe30 con 0x7f38a0160660 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a7800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00afcb0 con 0x7f38a0160280 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a7800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f38a00affb0 con 0x7f38a00d2830 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a0160660 0x7f38a00ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a0160660 0x7f38a00ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48688/0 (socket says 172.21.15.17:48688) 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a5800640 1 -- 172.21.15.17:0/3946018714 learned_addr learned my addr 172.21.15.17:0/3946018714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a4e00640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38a00d2830 0x7f38a00c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f389fe00640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a0160280 0x7f38a00ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a5800640 1 -- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38a00d2830 msgr2=0x7f38a00c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a5800640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38a00d2830 0x7f38a00c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a5800640 1 -- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a0160280 msgr2=0x7f38a00ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a5800640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a0160280 0x7f38a00ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a5800640 1 -- 172.21.15.17:0/3946018714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a00c8ac0 con 0x7f38a0160660 2024-09-10T23:22:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a4e00640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38a00d2830 0x7f38a00c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f389fe00640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a0160280 0x7f38a00ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:08.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a5800640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a0160660 0x7f38a00ced10 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f389800cae0 tx=0x7f389800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f389cc00640 1 -- 172.21.15.17:0/3946018714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898016020 con 0x7f38a0160660 2024-09-10T23:22:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f389cc00640 1 -- 172.21.15.17:0/3946018714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f389800ab40 con 0x7f38a0160660 2024-09-10T23:22:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a00c58a0 con 0x7f38a0160660 2024-09-10T23:22:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f389cc00640 1 -- 172.21.15.17:0/3946018714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389800ce20 con 0x7f38a0160660 2024-09-10T23:22:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a00c5e60 con 0x7f38a0160660 2024-09-10T23:22:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a00cbf30 con 0x7f38a0160660 2024-09-10T23:22:08.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.384+0000 7f389cc00640 1 -- 172.21.15.17:0/3946018714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3898012420 con 0x7f38a0160660 2024-09-10T23:22:08.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.388+0000 7f389cc00640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38800725e0 0x7f3880074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:08.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.388+0000 7f389cc00640 1 -- 172.21.15.17:0/3946018714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f3898093670 con 0x7f38a0160660 2024-09-10T23:22:08.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.388+0000 7f38a4e00640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38800725e0 0x7f3880074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:08.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.388+0000 7f38a4e00640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38800725e0 0x7f3880074aa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f38940058d0 tx=0x7f3894005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:08.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.392+0000 7f389cc00640 1 -- 172.21.15.17:0/3946018714 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3898020020 con 0x7f38a0160660 2024-09-10T23:22:08.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38a00b04a0 con 0x7f38a0160660 2024-09-10T23:22:08.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f389cc00640 1 -- 172.21.15.17:0/3946018714 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+3905 (secure 0 0 0) 0x7f389805ee60 con 0x7f38a0160660 2024-09-10T23:22:08.601 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:08.601 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":79,"btime":"2024-09-10T23:22:02:076691+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/116256837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":116256837},{"type":"v1","addr":"172.21.15.77:6837","nonce":116256837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/3991600260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3991600260},{"type":"v1","addr":"172.21.15.17:6833","nonce":3991600260}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2088468694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2088468694},{"type":"v1","addr":"172.21.15.77:6836","nonce":2088468694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7749,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/746013482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":746013482},{"type":"v1","addr":"172.21.15.17:6835","nonce":746013482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[]} 2024-09-10T23:22:08.601 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 79 2024-09-10T23:22:08.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38800725e0 msgr2=0x7f3880074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:08.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38800725e0 0x7f3880074aa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f38940058d0 tx=0x7f3894005860 comp rx=0 tx=0).stop 2024-09-10T23:22:08.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a0160660 msgr2=0x7f38a00ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:08.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a0160660 0x7f38a00ced10 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f389800cae0 tx=0x7f389800cbd0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 shutdown_connections 2024-09-10T23:22:08.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38800725e0 0x7f3880074aa0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a0160660 0x7f38a00ced10 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a0160280 0x7f38a00ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 --2- 172.21.15.17:0/3946018714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38a00d2830 0x7f38a00c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 >> 172.21.15.17:0/3946018714 conn(0x7f38a00d1d10 msgr2=0x7f38a006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:08.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 shutdown_connections 2024-09-10T23:22:08.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.600+0000 7f38a7800640 1 -- 172.21.15.17:0/3946018714 wait complete. 2024-09-10T23:22:08.623 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:22:08.624 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:22:08.624 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:22:08.624 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:22:08.624 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:22:08.625 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:22:08.625 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:22:08.625 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:22:08.625 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:22:08.625 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:22:08.626 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:22:08.626 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:22:08.626 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:22:08.626 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:22:08.626 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:22:08.626 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:22:08.637 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:22:08.638 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:22:08.638 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:22:08.639 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:22:08.642 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:22:08.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:22:08.643 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:22:08.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:22:08.682 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:22:08.683 DEBUG:teuthology.parallel:result is None 2024-09-10T23:22:08.684 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:22:08.684 DEBUG:teuthology.parallel:result is None 2024-09-10T23:22:08.691 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:22:08.691 DEBUG:teuthology.parallel:result is None 2024-09-10T23:22:08.693 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:22:08.693 DEBUG:teuthology.parallel:result is None 2024-09-10T23:22:08.693 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:22:08.769 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:22:08.770 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:22:08.783 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:22:08.784 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:22:08.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 -- 172.21.15.17:0/103779691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 msgr2=0x7f8c8415e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:08.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 --2- 172.21.15.17:0/103779691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 0x7f8c8415e180 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8c8406dce0 tx=0x7f8c6c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 -- 172.21.15.17:0/103779691 shutdown_connections 2024-09-10T23:22:08.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 --2- 172.21.15.17:0/103779691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 0x7f8c8415e180 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 --2- 172.21.15.17:0/103779691 >> v2:172.21.15.77:3300/0 conn(0x7f8c84151200 0x7f8c8406ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 -- 172.21.15.17:0/103779691 >> 172.21.15.17:0/103779691 conn(0x7f8c840b1730 msgr2=0x7f8c840b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:08.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 -- 172.21.15.17:0/103779691 shutdown_connections 2024-09-10T23:22:08.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 -- 172.21.15.17:0/103779691 wait complete. 2024-09-10T23:22:08.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 Processor -- start 2024-09-10T23:22:08.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.844+0000 7f8c8aa00640 1 -- start start 2024-09-10T23:22:08.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c8aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c840726f0 0x7f8c840ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:08.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c8aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c84151200 0x7f8c84146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c8aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 0x7f8c8406f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c8aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8c840b4760 con 0x7f8c8415dd50 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c8aa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8c840b45e0 con 0x7f8c84151200 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c8aa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8c840b48e0 con 0x7f8c840726f0 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c88a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 0x7f8c8406f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c88a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 0x7f8c8406f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48748/0 (socket says 172.21.15.17:48748) 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c88a00640 1 -- 172.21.15.17:0/2893915633 learned_addr learned my addr 172.21.15.17:0/2893915633 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c83e00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c840726f0 0x7f8c840ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c7b400640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c84151200 0x7f8c84146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c88a00640 1 -- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c840726f0 msgr2=0x7f8c840ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c88a00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c840726f0 0x7f8c840ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c88a00640 1 -- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c84151200 msgr2=0x7f8c84146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c88a00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c84151200 0x7f8c84146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c88a00640 1 -- 172.21.15.17:0/2893915633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c841fad50 con 0x7f8c8415dd50 2024-09-10T23:22:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c88a00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 0x7f8c8406f570 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00c7a0 tx=0x7f8c7c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c80c00640 1 -- 172.21.15.17:0/2893915633 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c003b80 con 0x7f8c8415dd50 2024-09-10T23:22:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c80c00640 1 -- 172.21.15.17:0/2893915633 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c7c003d40 con 0x7f8c8415dd50 2024-09-10T23:22:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c80c00640 1 -- 172.21.15.17:0/2893915633 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00aab0 con 0x7f8c8415dd50 2024-09-10T23:22:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c841faff0 con 0x7f8c8415dd50 2024-09-10T23:22:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c841fb5b0 con 0x7f8c8415dd50 2024-09-10T23:22:08.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8406ef80 con 0x7f8c8415dd50 2024-09-10T23:22:08.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.848+0000 7f8c80c00640 1 -- 172.21.15.17:0/2893915633 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8c7c00ac50 con 0x7f8c8415dd50 2024-09-10T23:22:08.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.852+0000 7f8c80c00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c600725e0 0x7f8c60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:08.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.852+0000 7f8c80c00640 1 -- 172.21.15.17:0/2893915633 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5421+0+0 (secure 0 0 0) 0x7f8c7c092e90 con 0x7f8c8415dd50 2024-09-10T23:22:08.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.852+0000 7f8c83e00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c600725e0 0x7f8c60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:08.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.852+0000 7f8c83e00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c600725e0 0x7f8c60074aa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8c840b0930 tx=0x7f8c7400b490 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:08.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:08.856+0000 7f8c80c00640 1 -- 172.21.15.17:0/2893915633 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8c7c05dfa0 con 0x7f8c8415dd50 2024-09-10T23:22:09.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.040+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8c840b2d70 con 0x7f8c8415dd50 2024-09-10T23:22:09.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.120+0000 7f8c80c00640 1 -- 172.21.15.17:0/2893915633 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v112) ==== 97+0+0 (secure 0 0 0) 0x7f8c7c0629d0 con 0x7f8c8415dd50 2024-09-10T23:22:09.123 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:22:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c600725e0 msgr2=0x7f8c60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c600725e0 0x7f8c60074aa0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8c840b0930 tx=0x7f8c7400b490 comp rx=0 tx=0).stop 2024-09-10T23:22:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 msgr2=0x7f8c8406f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 0x7f8c8406f570 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00c7a0 tx=0x7f8c7c00cc60 comp rx=0 tx=0).stop 2024-09-10T23:22:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 shutdown_connections 2024-09-10T23:22:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c600725e0 0x7f8c60074aa0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c8415dd50 0x7f8c8406f570 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c84151200 0x7f8c84146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 --2- 172.21.15.17:0/2893915633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c840726f0 0x7f8c840ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 >> 172.21.15.17:0/2893915633 conn(0x7f8c840b1730 msgr2=0x7f8c840b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 shutdown_connections 2024-09-10T23:22:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.124+0000 7f8c8aa00640 1 -- 172.21.15.17:0/2893915633 wait complete. 2024-09-10T23:22:09.148 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:22:09.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.292+0000 7f3f77e00640 1 -- 172.21.15.17:0/947808667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f700cff20 msgr2=0x7f3f700d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.292+0000 7f3f77e00640 1 --2- 172.21.15.17:0/947808667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f700cff20 0x7f3f700d03b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009bc0 tx=0x7f3f6801cba0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.292+0000 7f3f77e00640 1 -- 172.21.15.17:0/947808667 shutdown_connections 2024-09-10T23:22:09.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.292+0000 7f3f77e00640 1 --2- 172.21.15.17:0/947808667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f700cff20 0x7f3f700d03b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.292+0000 7f3f77e00640 1 --2- 172.21.15.17:0/947808667 >> v2:172.21.15.77:3300/0 conn(0x7f3f700cf4f0 0x7f3f700b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.292+0000 7f3f77e00640 1 -- 172.21.15.17:0/947808667 >> 172.21.15.17:0/947808667 conn(0x7f3f7006cfc0 msgr2=0x7f3f7006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:09.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.292+0000 7f3f77e00640 1 -- 172.21.15.17:0/947808667 shutdown_connections 2024-09-10T23:22:09.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.292+0000 7f3f77e00640 1 -- 172.21.15.17:0/947808667 wait complete. 2024-09-10T23:22:09.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 Processor -- start 2024-09-10T23:22:09.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 -- start start 2024-09-10T23:22:09.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f700b48f0 0x7f3f7014b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f700cf4f0 0x7f3f701525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f700cff20 0x7f3f7013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3f70168c30 con 0x7f3f700b48f0 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f70168ab0 con 0x7f3f700cff20 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f70168db0 con 0x7f3f700cf4f0 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f700b48f0 0x7f3f7014b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f700b48f0 0x7f3f7014b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48750/0 (socket says 172.21.15.17:48750) 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75400640 1 -- 172.21.15.17:0/3070371937 learned_addr learned my addr 172.21.15.17:0/3070371937 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75400640 1 -- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f700cf4f0 msgr2=0x7f3f701525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f74a00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f700cf4f0 0x7f3f701525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75e00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f700cff20 0x7f3f7013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75400640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f700cf4f0 0x7f3f701525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75400640 1 -- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f700cff20 msgr2=0x7f3f7013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75400640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f700cff20 0x7f3f7013e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75400640 1 -- 172.21.15.17:0/3070371937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7013ea60 con 0x7f3f700b48f0 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75e00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f700cff20 0x7f3f7013e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f74a00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f700cf4f0 0x7f3f701525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f75400640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f700b48f0 0x7f3f7014b4e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400ea40 tx=0x7f3f6400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f6d600640 1 -- 172.21.15.17:0/3070371937 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6400ce40 con 0x7f3f700b48f0 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f6d600640 1 -- 172.21.15.17:0/3070371937 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f64004020 con 0x7f3f700b48f0 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f6d600640 1 -- 172.21.15.17:0/3070371937 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64004470 con 0x7f3f700b48f0 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7014f920 con 0x7f3f700b48f0 2024-09-10T23:22:09.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7014fea0 con 0x7f3f700b48f0 2024-09-10T23:22:09.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.296+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f700b37f0 con 0x7f3f700b48f0 2024-09-10T23:22:09.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.300+0000 7f3f6d600640 1 -- 172.21.15.17:0/3070371937 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3f64003600 con 0x7f3f700b48f0 2024-09-10T23:22:09.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.300+0000 7f3f6d600640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f500725e0 0x7f3f50074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.300+0000 7f3f6d600640 1 -- 172.21.15.17:0/3070371937 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5249+0+0 (secure 0 0 0) 0x7f3f64093ba0 con 0x7f3f700b48f0 2024-09-10T23:22:09.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.300+0000 7f3f74a00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f500725e0 0x7f3f50074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.300+0000 7f3f74a00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f500725e0 0x7f3f50074aa0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3f7015b510 tx=0x7f3f5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:09.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.304+0000 7f3f6d600640 1 -- 172.21.15.17:0/3070371937 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3f6405f3a0 con 0x7f3f700b48f0 2024-09-10T23:22:09.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3f7014f270 con 0x7f3f700b48f0 2024-09-10T23:22:09.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f6d600640 1 -- 172.21.15.17:0/3070371937 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f3f6405eca0 con 0x7f3f700b48f0 2024-09-10T23:22:09.541 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:09.541 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:22:09.541 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:22:09.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.541 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:22:09.541 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:22:09.541 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.541 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:22:09.542 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:22:09.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.543 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:22:09.543 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:22:09.543 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.543 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:22:09.543 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:22:09.544 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:22:09.545 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:22:09.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.545 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.545 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:22:09.545 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:22:09.545 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.546 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:22:09.546 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:22:09.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.546 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:22:09.546 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:22:09.546 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.547 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:22:09.547 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:22:09.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.547 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:22:09.547 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:22:09.547 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.548 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:22:09.548 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:22:09.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.548 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.548 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:22:09.548 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:22:09.549 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:22:09.551 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.552 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.553 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:22:09.554 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:22:09.554 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:22:09.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:22:09.554 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.554 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:22:09.554 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:22:09.555 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:22:09.556 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:22:09.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.556 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:22:09.556 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:22:09.556 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:22:09.557 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:22:09.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:22:09.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.558 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:22:09.558 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f500725e0 msgr2=0x7f3f50074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f500725e0 0x7f3f50074aa0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3f7015b510 tx=0x7f3f5c009040 comp rx=0 tx=0).stop 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f700b48f0 msgr2=0x7f3f7014b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f700b48f0 0x7f3f7014b4e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400ea40 tx=0x7f3f6400ef00 comp rx=0 tx=0).stop 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 shutdown_connections 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f500725e0 0x7f3f50074aa0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f700cff20 0x7f3f7013e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f700cf4f0 0x7f3f701525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 --2- 172.21.15.17:0/3070371937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f700b48f0 0x7f3f7014b4e0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 >> 172.21.15.17:0/3070371937 conn(0x7f3f7006cfc0 msgr2=0x7f3f70068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 shutdown_connections 2024-09-10T23:22:09.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.540+0000 7f3f77e00640 1 -- 172.21.15.17:0/3070371937 wait complete. 2024-09-10T23:22:09.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:22:09.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.708+0000 7f29b5e00640 1 -- 172.21.15.17:0/2860583665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 msgr2=0x7f2994003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.708+0000 7f29b5e00640 1 --2- 172.21.15.17:0/2860583665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 0x7f2994003ed0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f29a00016c0 tx=0x7f29a001c730 comp rx=0 tx=0).stop 2024-09-10T23:22:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.708+0000 7f29b5e00640 1 -- 172.21.15.17:0/2860583665 shutdown_connections 2024-09-10T23:22:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.708+0000 7f29b5e00640 1 --2- 172.21.15.17:0/2860583665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 0x7f2994003ed0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.708+0000 7f29b5e00640 1 -- 172.21.15.17:0/2860583665 >> 172.21.15.17:0/2860583665 conn(0x7f29b00d1d10 msgr2=0x7f29b00d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.708+0000 7f29b5e00640 1 -- 172.21.15.17:0/2860583665 shutdown_connections 2024-09-10T23:22:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.708+0000 7f29b5e00640 1 -- 172.21.15.17:0/2860583665 wait complete. 2024-09-10T23:22:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.708+0000 7f29b5e00640 1 Processor -- start 2024-09-10T23:22:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.708+0000 7f29b5e00640 1 -- start start 2024-09-10T23:22:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29b5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 0x7f29b01f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29b5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0150cb0 0x7f29b01f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29b5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29b00c7fc0 0x7f29b00c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29b5e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f29b00cfe80 con 0x7f2994003ab0 2024-09-10T23:22:09.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29b5e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f29b00cfd00 con 0x7f29b0150cb0 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29b5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f29b00d0000 con 0x7f29b00c7fc0 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29aea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 0x7f29b01f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29aea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 0x7f29b01f7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48768/0 (socket says 172.21.15.17:48768) 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29aea00640 1 -- 172.21.15.17:0/1221782352 learned_addr learned my addr 172.21.15.17:0/1221782352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29af400640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29b00c7fc0 0x7f29b00c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29a6000640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0150cb0 0x7f29b01f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29aea00640 1 -- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29b00c7fc0 msgr2=0x7f29b00c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29aea00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29b00c7fc0 0x7f29b00c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29aea00640 1 -- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0150cb0 msgr2=0x7f29b01f8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29aea00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0150cb0 0x7f29b01f8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29aea00640 1 -- 172.21.15.17:0/1221782352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b00b5b90 con 0x7f2994003ab0 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29aea00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 0x7f29b01f7ef0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f29a0000c10 tx=0x7f29a0003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29a7e00640 1 -- 172.21.15.17:0/1221782352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a00b9070 con 0x7f2994003ab0 2024-09-10T23:22:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29a7e00640 1 -- 172.21.15.17:0/1221782352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29a00ae040 con 0x7f2994003ab0 2024-09-10T23:22:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29a7e00640 1 -- 172.21.15.17:0/1221782352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a00ad070 con 0x7f2994003ab0 2024-09-10T23:22:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b00cbd90 con 0x7f2994003ab0 2024-09-10T23:22:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b00b5e50 con 0x7f2994003ab0 2024-09-10T23:22:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b00af7d0 con 0x7f2994003ab0 2024-09-10T23:22:09.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.712+0000 7f29a7e00640 1 -- 172.21.15.17:0/1221782352 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f29a0006350 con 0x7f2994003ab0 2024-09-10T23:22:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.716+0000 7f29a7e00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f298c072610 0x7f298c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.716+0000 7f29a7e00640 1 -- 172.21.15.17:0/1221782352 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5249+0+0 (secure 0 0 0) 0x7f29a012c2d0 con 0x7f2994003ab0 2024-09-10T23:22:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.716+0000 7f29a6000640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f298c072610 0x7f298c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.716+0000 7f29a6000640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f298c072610 0x7f298c074ad0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f29b006a200 tx=0x7f29980091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:09.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.720+0000 7f29a7e00640 1 -- 172.21.15.17:0/1221782352 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f29a0016490 con 0x7f2994003ab0 2024-09-10T23:22:09.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.896+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f29b00b0590 con 0x7f2994003ab0 2024-09-10T23:22:09.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.896+0000 7f29a7e00640 1 -- 172.21.15.17:0/1221782352 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v114) ==== 84+0+65 (secure 0 0 0) 0x7f29a00f7510 con 0x7f2994003ab0 2024-09-10T23:22:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:09.898 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:22:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:22:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:22:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:22:09.898 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:09.899 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:22:09.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f298c072610 msgr2=0x7f298c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f298c072610 0x7f298c074ad0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f29b006a200 tx=0x7f29980091e0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 msgr2=0x7f29b01f7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:09.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 0x7f29b01f7ef0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f29a0000c10 tx=0x7f29a0003be0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 shutdown_connections 2024-09-10T23:22:09.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f298c072610 0x7f298c074ad0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29b00c7fc0 0x7f29b00c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b0150cb0 0x7f29b01f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 --2- 172.21.15.17:0/1221782352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2994003ab0 0x7f29b01f7ef0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 >> 172.21.15.17:0/1221782352 conn(0x7f29b00d1d10 msgr2=0x7f29b0071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 shutdown_connections 2024-09-10T23:22:09.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:09.900+0000 7f29b5e00640 1 -- 172.21.15.17:0/1221782352 wait complete. 2024-09-10T23:22:09.919 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:22:09.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:22:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.068+0000 7f8392e00640 1 -- 172.21.15.17:0/2554617064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c0cec60 msgr2=0x7f838c0d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.068+0000 7f8392e00640 1 --2- 172.21.15.17:0/2554617064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c0cec60 0x7f838c0d2610 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f8374009840 tx=0x7f837401c820 comp rx=0 tx=0).stop 2024-09-10T23:22:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.068+0000 7f8392e00640 1 -- 172.21.15.17:0/2554617064 shutdown_connections 2024-09-10T23:22:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.068+0000 7f8392e00640 1 --2- 172.21.15.17:0/2554617064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c0cec60 0x7f838c0d2610 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.068+0000 7f8392e00640 1 -- 172.21.15.17:0/2554617064 >> 172.21.15.17:0/2554617064 conn(0x7f838c09b040 msgr2=0x7f838c0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.068+0000 7f8392e00640 1 -- 172.21.15.17:0/2554617064 shutdown_connections 2024-09-10T23:22:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.068+0000 7f8392e00640 1 -- 172.21.15.17:0/2554617064 wait complete. 2024-09-10T23:22:10.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 Processor -- start 2024-09-10T23:22:10.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 -- start start 2024-09-10T23:22:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f838c0cec60 0x7f838c154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c15f1c0 0x7f838c1536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f838c15f5a0 0x7f838c0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f838c16a060 con 0x7f838c15f1c0 2024-09-10T23:22:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f838c169ee0 con 0x7f838c0cec60 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f838c16a1e0 con 0x7f838c15f5a0 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8383e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c15f1c0 0x7f838c1536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8383e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c15f1c0 0x7f838c1536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48788/0 (socket says 172.21.15.17:48788) 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8383e00640 1 -- 172.21.15.17:0/3514707614 learned_addr learned my addr 172.21.15.17:0/3514707614 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8390e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f838c15f5a0 0x7f838c0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f838be00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f838c0cec60 0x7f838c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8383e00640 1 -- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f838c15f5a0 msgr2=0x7f838c0cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8383e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f838c15f5a0 0x7f838c0cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8383e00640 1 -- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f838c0cec60 msgr2=0x7f838c154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8383e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f838c0cec60 0x7f838c154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8383e00640 1 -- 172.21.15.17:0/3514707614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838c0b5c80 con 0x7f838c15f1c0 2024-09-10T23:22:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8383e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c15f1c0 0x7f838c1536e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f837401cd00 tx=0x7f8374005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8388c00640 1 -- 172.21.15.17:0/3514707614 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83740bb070 con 0x7f838c15f1c0 2024-09-10T23:22:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8388c00640 1 -- 172.21.15.17:0/3514707614 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8374004330 con 0x7f838c15f1c0 2024-09-10T23:22:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8388c00640 1 -- 172.21.15.17:0/3514707614 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83740b2040 con 0x7f838c15f1c0 2024-09-10T23:22:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838c0b5f60 con 0x7f838c15f1c0 2024-09-10T23:22:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838c06dcd0 con 0x7f838c15f1c0 2024-09-10T23:22:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.072+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838c0d2610 con 0x7f838c15f1c0 2024-09-10T23:22:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.076+0000 7f8388c00640 1 -- 172.21.15.17:0/3514707614 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f83740b5070 con 0x7f838c15f1c0 2024-09-10T23:22:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.076+0000 7f8388c00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83680725e0 0x7f8368074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.076+0000 7f8388c00640 1 -- 172.21.15.17:0/3514707614 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5249+0+0 (secure 0 0 0) 0x7f837412c5e0 con 0x7f838c15f1c0 2024-09-10T23:22:10.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.076+0000 7f838be00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83680725e0 0x7f8368074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:10.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.076+0000 7f838be00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83680725e0 0x7f8368074aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f838c0cc380 tx=0x7f837c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:10.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.080+0000 7f8388c00640 1 -- 172.21.15.17:0/3514707614 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8374016410 con 0x7f838c15f1c0 2024-09-10T23:22:10.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:10.260+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f838c15b3a0 con 0x7f838c15f1c0 2024-09-10T23:22:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8388c00640 1 -- 172.21.15.17:0/3514707614 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v115) ==== 138+0+0 (secure 0 0 0) 0x7f83740f7de0 con 0x7f838c15f1c0 2024-09-10T23:22:11.132 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:22:11.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83680725e0 msgr2=0x7f8368074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83680725e0 0x7f8368074aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f838c0cc380 tx=0x7f837c009040 comp rx=0 tx=0).stop 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c15f1c0 msgr2=0x7f838c1536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c15f1c0 0x7f838c1536e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f837401cd00 tx=0x7f8374005d10 comp rx=0 tx=0).stop 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 shutdown_connections 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83680725e0 0x7f8368074aa0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f838c15f5a0 0x7f838c0cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f838c15f1c0 0x7f838c1536e0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 --2- 172.21.15.17:0/3514707614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f838c0cec60 0x7f838c154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 >> 172.21.15.17:0/3514707614 conn(0x7f838c09b040 msgr2=0x7f838c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 shutdown_connections 2024-09-10T23:22:11.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.132+0000 7f8392e00640 1 -- 172.21.15.17:0/3514707614 wait complete. 2024-09-10T23:22:11.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:22:11.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.320+0000 7fbd95800640 1 -- 172.21.15.17:0/915751208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd9015fe80 msgr2=0x7fbd90072c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:11.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.320+0000 7fbd95800640 1 --2- 172.21.15.17:0/915751208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd9015fe80 0x7fbd90072c50 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fbd900708a0 tx=0x7fbd8801cd80 comp rx=0 tx=0).stop 2024-09-10T23:22:11.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 -- 172.21.15.17:0/915751208 shutdown_connections 2024-09-10T23:22:11.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 --2- 172.21.15.17:0/915751208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd9015fe80 0x7fbd90072c50 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:11.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 --2- 172.21.15.17:0/915751208 >> v2:172.21.15.77:3300/0 conn(0x7fbd90145800 0x7fbd900741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:11.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 -- 172.21.15.17:0/915751208 >> 172.21.15.17:0/915751208 conn(0x7fbd900b17a0 msgr2=0x7fbd900b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:11.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 -- 172.21.15.17:0/915751208 shutdown_connections 2024-09-10T23:22:11.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 -- 172.21.15.17:0/915751208 wait complete. 2024-09-10T23:22:11.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 Processor -- start 2024-09-10T23:22:11.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 -- start start 2024-09-10T23:22:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd90145800 0x7fbd90141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd9015fe80 0x7fbd90160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd90160460 0x7fbd90160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbd90169330 con 0x7fbd90145800 2024-09-10T23:22:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901691b0 con 0x7fbd90160460 2024-09-10T23:22:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd95800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbd901694b0 con 0x7fbd9015fe80 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd90145800 0x7fbd90141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd90145800 0x7fbd90141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48810/0 (socket says 172.21.15.17:48810) 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8ea00640 1 -- 172.21.15.17:0/129107252 learned_addr learned my addr 172.21.15.17:0/129107252 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8f400640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd90160460 0x7fbd90160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd87e00640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd9015fe80 0x7fbd90160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8ea00640 1 -- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd9015fe80 msgr2=0x7fbd90160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8ea00640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd9015fe80 0x7fbd90160ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8ea00640 1 -- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd90160460 msgr2=0x7fbd90160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8ea00640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd90160460 0x7fbd90160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8ea00640 1 -- 172.21.15.17:0/129107252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd90143100 con 0x7fbd90145800 2024-09-10T23:22:11.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.324+0000 7fbd8ea00640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd90145800 0x7fbd90141c70 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c970 tx=0x7fbd8000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd86a00640 1 -- 172.21.15.17:0/129107252 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80007c70 con 0x7fbd90145800 2024-09-10T23:22:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd86a00640 1 -- 172.21.15.17:0/129107252 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd8000f450 con 0x7fbd90145800 2024-09-10T23:22:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9013d5b0 con 0x7fbd90145800 2024-09-10T23:22:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd86a00640 1 -- 172.21.15.17:0/129107252 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000f8a0 con 0x7fbd90145800 2024-09-10T23:22:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9013db70 con 0x7fbd90145800 2024-09-10T23:22:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd900741d0 con 0x7fbd90145800 2024-09-10T23:22:11.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd86a00640 1 -- 172.21.15.17:0/129107252 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbd8000fa40 con 0x7fbd90145800 2024-09-10T23:22:11.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd86a00640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd6c0725e0 0x7fbd6c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:11.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd86a00640 1 -- 172.21.15.17:0/129107252 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5619+0+0 (secure 0 0 0) 0x7fbd80093b70 con 0x7fbd90145800 2024-09-10T23:22:11.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.328+0000 7fbd87e00640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd6c0725e0 0x7fbd6c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:11.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.332+0000 7fbd87e00640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd6c0725e0 0x7fbd6c074aa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbd9006f3f0 tx=0x7fbd78008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:11.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.336+0000 7fbd86a00640 1 -- 172.21.15.17:0/129107252 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbd90143100 con 0x7fbd90145800 2024-09-10T23:22:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:11.508+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbd9015dcf0 con 0x7fbd90145800 2024-09-10T23:22:12.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.140+0000 7fbd86a00640 1 -- 172.21.15.17:0/129107252 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v116) ==== 170+0+0 (secure 0 0 0) 0x7fbd80014030 con 0x7fbd90145800 2024-09-10T23:22:12.141 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:22:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd6c0725e0 msgr2=0x7fbd6c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd6c0725e0 0x7fbd6c074aa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbd9006f3f0 tx=0x7fbd78008040 comp rx=0 tx=0).stop 2024-09-10T23:22:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd90145800 msgr2=0x7fbd90141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd90145800 0x7fbd90141c70 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c970 tx=0x7fbd8000ce30 comp rx=0 tx=0).stop 2024-09-10T23:22:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 shutdown_connections 2024-09-10T23:22:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd6c0725e0 0x7fbd6c074aa0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:12.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd90160460 0x7fbd90160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd9015fe80 0x7fbd90160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 --2- 172.21.15.17:0/129107252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd90145800 0x7fbd90141c70 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 >> 172.21.15.17:0/129107252 conn(0x7fbd900b17a0 msgr2=0x7fbd900d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:12.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 shutdown_connections 2024-09-10T23:22:12.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.144+0000 7fbd95800640 1 -- 172.21.15.17:0/129107252 wait complete. 2024-09-10T23:22:12.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:22:12.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 -- 172.21.15.17:0/3981234656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c0b18c0 msgr2=0x7f7f7c06dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:12.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 --2- 172.21.15.17:0/3981234656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c0b18c0 0x7f7f7c06dc50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009bc0 tx=0x7f7f7801f3b0 comp rx=0 tx=0).stop 2024-09-10T23:22:12.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 -- 172.21.15.17:0/3981234656 shutdown_connections 2024-09-10T23:22:12.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 --2- 172.21.15.17:0/3981234656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c0b18c0 0x7f7f7c06dc50 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 -- 172.21.15.17:0/3981234656 >> 172.21.15.17:0/3981234656 conn(0x7f7f7c0b3d00 msgr2=0x7f7f7c0741c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 -- 172.21.15.17:0/3981234656 shutdown_connections 2024-09-10T23:22:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 -- 172.21.15.17:0/3981234656 wait complete. 2024-09-10T23:22:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 Processor -- start 2024-09-10T23:22:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 -- start start 2024-09-10T23:22:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c074ae0 0x7f7f7c0ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f7c0b14e0 0x7f7f7c06f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7c0b18c0 0x7f7f7c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c06e520 con 0x7f7f7c074ae0 2024-09-10T23:22:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c06e3a0 con 0x7f7f7c0b18c0 2024-09-10T23:22:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f83200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7c15dda0 con 0x7f7f7c0b14e0 2024-09-10T23:22:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f81e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c074ae0 0x7f7f7c0ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:12.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.336+0000 7f7f81e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c074ae0 0x7f7f7c0ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48832/0 (socket says 172.21.15.17:48832) 2024-09-10T23:22:12.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f81e00640 1 -- 172.21.15.17:0/2058343734 learned_addr learned my addr 172.21.15.17:0/2058343734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:12.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f82800640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7c0b18c0 0x7f7f7c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:12.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f81400640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f7c0b14e0 0x7f7f7c06f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:12.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f81e00640 1 -- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f7c0b14e0 msgr2=0x7f7f7c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:12.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f81e00640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f7c0b14e0 0x7f7f7c06f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:12.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f81e00640 1 -- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7c0b18c0 msgr2=0x7f7f7c1f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:12.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f81e00640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7c0b18c0 0x7f7f7c1f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:12.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f81e00640 1 -- 172.21.15.17:0/2058343734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c0c3da0 con 0x7f7f7c074ae0 2024-09-10T23:22:12.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f81e00640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c074ae0 0x7f7f7c0ce090 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c420 tx=0x7f7f7000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:12.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f76000640 1 -- 172.21.15.17:0/2058343734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70017070 con 0x7f7f7c074ae0 2024-09-10T23:22:12.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f76000640 1 -- 172.21.15.17:0/2058343734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f70003600 con 0x7f7f7c074ae0 2024-09-10T23:22:12.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f76000640 1 -- 172.21.15.17:0/2058343734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70003a90 con 0x7f7f7c074ae0 2024-09-10T23:22:12.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c1f66e0 con 0x7f7f7c074ae0 2024-09-10T23:22:12.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c0c4060 con 0x7f7f7c074ae0 2024-09-10T23:22:12.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c06dc50 con 0x7f7f7c074ae0 2024-09-10T23:22:12.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.340+0000 7f7f76000640 1 -- 172.21.15.17:0/2058343734 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7f70003c30 con 0x7f7f7c074ae0 2024-09-10T23:22:12.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.344+0000 7f7f76000640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f600725e0 0x7f7f60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:12.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.344+0000 7f7f76000640 1 -- 172.21.15.17:0/2058343734 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6001+0+0 (secure 0 0 0) 0x7f7f70092d00 con 0x7f7f7c074ae0 2024-09-10T23:22:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.344+0000 7f7f81400640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f600725e0 0x7f7f60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.344+0000 7f7f81400640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f600725e0 0x7f7f60074aa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0ceec0 tx=0x7f7f6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:12.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.344+0000 7f7f76000640 1 -- 172.21.15.17:0/2058343734 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7f70021020 con 0x7f7f7c074ae0 2024-09-10T23:22:12.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:12.556+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7f7c0cfc30 con 0x7f7f7c074ae0 2024-09-10T23:22:13.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.156+0000 7f7f76000640 1 -- 172.21.15.17:0/2058343734 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v82) ==== 174+0+0 (secure 0 0 0) 0x7f7f7005dcd0 con 0x7f7f7c074ae0 2024-09-10T23:22:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 15 and data pool 16 2024-09-10T23:22:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f600725e0 msgr2=0x7f7f60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f600725e0 0x7f7f60074aa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0ceec0 tx=0x7f7f6c009040 comp rx=0 tx=0).stop 2024-09-10T23:22:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c074ae0 msgr2=0x7f7f7c0ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c074ae0 0x7f7f7c0ce090 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c420 tx=0x7f7f7000c8e0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 shutdown_connections 2024-09-10T23:22:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f600725e0 0x7f7f60074aa0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7c0b18c0 0x7f7f7c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f7c0b14e0 0x7f7f7c06f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 --2- 172.21.15.17:0/2058343734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c074ae0 0x7f7f7c0ce090 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 >> 172.21.15.17:0/2058343734 conn(0x7f7f7c0b3d00 msgr2=0x7f7f7c0cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:13.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 shutdown_connections 2024-09-10T23:22:13.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.172+0000 7f7f83200640 1 -- 172.21.15.17:0/2058343734 wait complete. 2024-09-10T23:22:13.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:22:13.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.352+0000 7f60cea00640 1 -- 172.21.15.17:0/2765200247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 msgr2=0x7f60c815f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.352+0000 7f60cea00640 1 --2- 172.21.15.17:0/2765200247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 0x7f60c815f5a0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f60c80d2e60 tx=0x7f60b001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.352+0000 7f60cea00640 1 -- 172.21.15.17:0/2765200247 shutdown_connections 2024-09-10T23:22:13.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.352+0000 7f60cea00640 1 --2- 172.21.15.17:0/2765200247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60c80cf320 0x7f60c80cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.352+0000 7f60cea00640 1 --2- 172.21.15.17:0/2765200247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 0x7f60c815f5a0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.352+0000 7f60cea00640 1 --2- 172.21.15.17:0/2765200247 >> v2:172.21.15.77:3300/0 conn(0x7f60c8070ad0 0x7f60c815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.352+0000 7f60cea00640 1 -- 172.21.15.17:0/2765200247 >> 172.21.15.17:0/2765200247 conn(0x7f60c80d1d60 msgr2=0x7f60c80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.352+0000 7f60cea00640 1 -- 172.21.15.17:0/2765200247 shutdown_connections 2024-09-10T23:22:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.352+0000 7f60cea00640 1 -- 172.21.15.17:0/2765200247 wait complete. 2024-09-10T23:22:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 Processor -- start 2024-09-10T23:22:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 -- start start 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c8070ad0 0x7f60c8151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60c80cf320 0x7f60c80b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 0x7f60c80b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f60c80cd2c0 con 0x7f60c80d1830 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f60c80cd140 con 0x7f60c8070ad0 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f60c80cd440 con 0x7f60c80cf320 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 0x7f60c80b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60c7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c8070ad0 0x7f60c8151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 0x7f60c80b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48854/0 (socket says 172.21.15.17:48854) 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cca00640 1 -- 172.21.15.17:0/2650296834 learned_addr learned my addr 172.21.15.17:0/2650296834 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60bf400640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60c80cf320 0x7f60c80b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cca00640 1 -- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60c80cf320 msgr2=0x7f60c80b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cca00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60c80cf320 0x7f60c80b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cca00640 1 -- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c8070ad0 msgr2=0x7f60c8151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cca00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c8070ad0 0x7f60c8151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cca00640 1 -- 172.21.15.17:0/2650296834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c815d720 con 0x7f60c80d1830 2024-09-10T23:22:13.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cca00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 0x7f60c80b3b70 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f60c000ea20 tx=0x7f60c000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:13.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60c4c00640 1 -- 172.21.15.17:0/2650296834 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c000cde0 con 0x7f60c80d1830 2024-09-10T23:22:13.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60c4c00640 1 -- 172.21.15.17:0/2650296834 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60c0004c40 con 0x7f60c80d1830 2024-09-10T23:22:13.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60c4c00640 1 -- 172.21.15.17:0/2650296834 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0005280 con 0x7f60c80d1830 2024-09-10T23:22:13.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c815da00 con 0x7f60c80d1830 2024-09-10T23:22:13.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.356+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c815dfc0 con 0x7f60c80d1830 2024-09-10T23:22:13.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.360+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c806f4b0 con 0x7f60c80d1830 2024-09-10T23:22:13.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.360+0000 7f60c4c00640 1 -- 172.21.15.17:0/2650296834 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f60c000f040 con 0x7f60c80d1830 2024-09-10T23:22:13.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.360+0000 7f60c4c00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60a40725e0 0x7f60a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.360+0000 7f60c4c00640 1 -- 172.21.15.17:0/2650296834 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f60c0093a20 con 0x7f60c80d1830 2024-09-10T23:22:13.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.360+0000 7f60c7e00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60a40725e0 0x7f60a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.360+0000 7f60c7e00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60a40725e0 0x7f60a4074aa0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f60b800bb70 tx=0x7f60b800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:13.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.364+0000 7f60c4c00640 1 -- 172.21.15.17:0/2650296834 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f60c0016030 con 0x7f60c80d1830 2024-09-10T23:22:13.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.540+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60c806f1d0 con 0x7f60c80d1830 2024-09-10T23:22:13.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.540+0000 7f60c4c00640 1 -- 172.21.15.17:0/2650296834 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16897 (secure 0 0 0) 0x7f60c005e910 con 0x7f60c80d1830 2024-09-10T23:22:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:13.543 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":117,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:22:12.557726+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:10.273423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:11.522343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:13.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60a40725e0 msgr2=0x7f60a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60a40725e0 0x7f60a4074aa0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f60b800bb70 tx=0x7f60b800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 msgr2=0x7f60c80b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 0x7f60c80b3b70 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f60c000ea20 tx=0x7f60c000eee0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 shutdown_connections 2024-09-10T23:22:13.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60a40725e0 0x7f60a4074aa0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c80d1830 0x7f60c80b3b70 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f60c80cf320 0x7f60c80b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 --2- 172.21.15.17:0/2650296834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60c8070ad0 0x7f60c8151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 >> 172.21.15.17:0/2650296834 conn(0x7f60c80d1d60 msgr2=0x7f60c815b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:13.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 shutdown_connections 2024-09-10T23:22:13.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.544+0000 7f60cea00640 1 -- 172.21.15.17:0/2650296834 wait complete. 2024-09-10T23:22:13.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:22:13.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.708+0000 7ff18d400640 1 -- 172.21.15.17:0/646263805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff188161040 msgr2=0x7ff188161470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.708+0000 7ff18d400640 1 --2- 172.21.15.17:0/646263805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff188161040 0x7ff188161470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff180009bf0 tx=0x7ff18001cb20 comp rx=0 tx=0).stop 2024-09-10T23:22:13.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.708+0000 7ff18d400640 1 -- 172.21.15.17:0/646263805 shutdown_connections 2024-09-10T23:22:13.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.708+0000 7ff18d400640 1 --2- 172.21.15.17:0/646263805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff188161040 0x7ff188161470 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.708+0000 7ff18d400640 1 -- 172.21.15.17:0/646263805 >> 172.21.15.17:0/646263805 conn(0x7ff1880d1d60 msgr2=0x7ff1880d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:13.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.708+0000 7ff18d400640 1 -- 172.21.15.17:0/646263805 shutdown_connections 2024-09-10T23:22:13.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.708+0000 7ff18d400640 1 -- 172.21.15.17:0/646263805 wait complete. 2024-09-10T23:22:13.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 Processor -- start 2024-09-10T23:22:13.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 -- start start 2024-09-10T23:22:13.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff18806df30 0x7ff1881fb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff18815f060 0x7ff188154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff188161040 0x7ff188152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff18816c070 con 0x7ff18806df30 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff18816c1f0 con 0x7ff188161040 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff18816c370 con 0x7ff18815f060 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff186800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff18806df30 0x7ff1881fb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff186800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff18806df30 0x7ff1881fb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48866/0 (socket says 172.21.15.17:48866) 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff186800640 1 -- 172.21.15.17:0/94403185 learned_addr learned my addr 172.21.15.17:0/94403185 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff17fe00640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff18815f060 0x7ff188154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff187200640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff188161040 0x7ff188152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff186800640 1 -- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff18815f060 msgr2=0x7ff188154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff186800640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff18815f060 0x7ff188154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff186800640 1 -- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff188161040 msgr2=0x7ff188152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff186800640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff188161040 0x7ff188152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff186800640 1 -- 172.21.15.17:0/94403185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1881fbe00 con 0x7ff18806df30 2024-09-10T23:22:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff186800640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff18806df30 0x7ff1881fb8c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c490 tx=0x7ff17800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff17ea00640 1 -- 172.21.15.17:0/94403185 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1780052d0 con 0x7ff18806df30 2024-09-10T23:22:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff17ea00640 1 -- 172.21.15.17:0/94403185 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff178005490 con 0x7ff18806df30 2024-09-10T23:22:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18815b670 con 0x7ff18806df30 2024-09-10T23:22:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff17ea00640 1 -- 172.21.15.17:0/94403185 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178012870 con 0x7ff18806df30 2024-09-10T23:22:13.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.712+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18815d710 con 0x7ff18806df30 2024-09-10T23:22:13.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.716+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff188161470 con 0x7ff18806df30 2024-09-10T23:22:13.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.716+0000 7ff17ea00640 1 -- 172.21.15.17:0/94403185 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff178012a10 con 0x7ff18806df30 2024-09-10T23:22:13.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.716+0000 7ff17ea00640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff164072610 0x7ff164074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:13.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.716+0000 7ff17ea00640 1 -- 172.21.15.17:0/94403185 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7ff178092eb0 con 0x7ff18806df30 2024-09-10T23:22:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.716+0000 7ff17fe00640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff164072610 0x7ff164074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:13.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.716+0000 7ff17fe00640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff164072610 0x7ff164074ad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff1881fae10 tx=0x7ff170001420 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:13.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.720+0000 7ff17ea00640 1 -- 172.21.15.17:0/94403185 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff1881fbe00 con 0x7ff18806df30 2024-09-10T23:22:13.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.896+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff188074ab0 con 0x7ff18806df30 2024-09-10T23:22:13.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.896+0000 7ff17ea00640 1 -- 172.21.15.17:0/94403185 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16897 (secure 0 0 0) 0x7ff17805dd10 con 0x7ff18806df30 2024-09-10T23:22:13.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:13.899 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":117,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:22:12.557726+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:10.273423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:11.522343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:13.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff164072610 msgr2=0x7ff164074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff164072610 0x7ff164074ad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff1881fae10 tx=0x7ff170001420 comp rx=0 tx=0).stop 2024-09-10T23:22:13.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff18806df30 msgr2=0x7ff1881fb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:13.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff18806df30 0x7ff1881fb8c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c490 tx=0x7ff17800c950 comp rx=0 tx=0).stop 2024-09-10T23:22:13.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 shutdown_connections 2024-09-10T23:22:13.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff164072610 0x7ff164074ad0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff188161040 0x7ff188152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff18815f060 0x7ff188154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 --2- 172.21.15.17:0/94403185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff18806df30 0x7ff1881fb8c0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:13.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 >> 172.21.15.17:0/94403185 conn(0x7ff1880d1d60 msgr2=0x7ff1880b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:13.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 shutdown_connections 2024-09-10T23:22:13.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:13.900+0000 7ff18d400640 1 -- 172.21.15.17:0/94403185 wait complete. 2024-09-10T23:22:13.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:22:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.068+0000 7f616a800640 1 -- 172.21.15.17:0/2730981829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6164072b40 msgr2=0x7f6164073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.068+0000 7f616a800640 1 --2- 172.21.15.17:0/2730981829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6164072b40 0x7f6164073710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6150009870 tx=0x7f615001c840 comp rx=0 tx=0).stop 2024-09-10T23:22:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.068+0000 7f616a800640 1 -- 172.21.15.17:0/2730981829 shutdown_connections 2024-09-10T23:22:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.068+0000 7f616a800640 1 --2- 172.21.15.17:0/2730981829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6164072b40 0x7f6164073710 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.068+0000 7f616a800640 1 -- 172.21.15.17:0/2730981829 >> 172.21.15.17:0/2730981829 conn(0x7f61640b17a0 msgr2=0x7f61640b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.068+0000 7f616a800640 1 -- 172.21.15.17:0/2730981829 shutdown_connections 2024-09-10T23:22:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.068+0000 7f616a800640 1 -- 172.21.15.17:0/2730981829 wait complete. 2024-09-10T23:22:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.068+0000 7f616a800640 1 Processor -- start 2024-09-10T23:22:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 -- start start 2024-09-10T23:22:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6164072b40 0x7f61641507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61640b3940 0x7f616414faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f616415ab30 0x7f6164157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6164168cc0 con 0x7f61640b3940 2024-09-10T23:22:14.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6164168b40 con 0x7f616415ab30 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6164168e40 con 0x7f6164072b40 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6162a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61640b3940 0x7f616414faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6162a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61640b3940 0x7f616414faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48868/0 (socket says 172.21.15.17:48868) 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6162a00640 1 -- 172.21.15.17:0/3791347077 learned_addr learned my addr 172.21.15.17:0/3791347077 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6163e00640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f616415ab30 0x7f6164157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6163400640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6164072b40 0x7f61641507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6162a00640 1 -- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6164072b40 msgr2=0x7f61641507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6162a00640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6164072b40 0x7f61641507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6162a00640 1 -- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f616415ab30 msgr2=0x7f6164157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6162a00640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f616415ab30 0x7f6164157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6162a00640 1 -- 172.21.15.17:0/3791347077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6164157c60 con 0x7f61640b3940 2024-09-10T23:22:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6163e00640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f616415ab30 0x7f6164157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f6162a00640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61640b3940 0x7f616414faa0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f6150019450 tx=0x7f6150005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f615b400640 1 -- 172.21.15.17:0/3791347077 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61500b2040 con 0x7f61640b3940 2024-09-10T23:22:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f615b400640 1 -- 172.21.15.17:0/3791347077 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6150004130 con 0x7f61640b3940 2024-09-10T23:22:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616415bcf0 con 0x7f61640b3940 2024-09-10T23:22:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f615b400640 1 -- 172.21.15.17:0/3791347077 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150003600 con 0x7f61640b3940 2024-09-10T23:22:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f616415c2b0 con 0x7f61640b3940 2024-09-10T23:22:14.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.072+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61640b3df0 con 0x7f61640b3940 2024-09-10T23:22:14.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.076+0000 7f615b400640 1 -- 172.21.15.17:0/3791347077 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f61500c7070 con 0x7f61640b3940 2024-09-10T23:22:14.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.076+0000 7f615b400640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6144072610 0x7f6144074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:14.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.076+0000 7f615b400640 1 -- 172.21.15.17:0/3791347077 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6101+0+0 (secure 0 0 0) 0x7f615012d5f0 con 0x7f61640b3940 2024-09-10T23:22:14.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.076+0000 7f6163400640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6144072610 0x7f6144074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:14.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.076+0000 7f6163400640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6144072610 0x7f6144074ad0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6154007fd0 tx=0x7f6154009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:14.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.080+0000 7f615b400640 1 -- 172.21.15.17:0/3791347077 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f61500c4020 con 0x7f61640b3940 2024-09-10T23:22:14.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:14.288+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f61640ad990 con 0x7f61640b3940 2024-09-10T23:22:15.133 INFO:tasks.ceph.mds.d.smithi077.stderr:2024-09-10T23:22:15.132+0000 7f03b8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:22:15.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f615b400640 1 -- 172.21.15.17:0/3791347077 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) ==== 118+0+0 (secure 0 0 0) 0x7f6150016430 con 0x7f61640b3940 2024-09-10T23:22:15.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6144072610 msgr2=0x7f6144074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:15.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6144072610 0x7f6144074ad0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6154007fd0 tx=0x7f6154009040 comp rx=0 tx=0).stop 2024-09-10T23:22:15.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61640b3940 msgr2=0x7f616414faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:15.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61640b3940 0x7f616414faa0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f6150019450 tx=0x7f6150005ca0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 shutdown_connections 2024-09-10T23:22:15.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6144072610 0x7f6144074ad0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f616415ab30 0x7f6164157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61640b3940 0x7f616414faa0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 --2- 172.21.15.17:0/3791347077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6164072b40 0x7f61641507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 >> 172.21.15.17:0/3791347077 conn(0x7f61640b17a0 msgr2=0x7f61640b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 shutdown_connections 2024-09-10T23:22:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.168+0000 7f616a800640 1 -- 172.21.15.17:0/3791347077 wait complete. 2024-09-10T23:22:15.195 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:22:15.196 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:22:15.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.348+0000 7f20b3200640 1 -- 172.21.15.17:0/2975474153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 msgr2=0x7f20ac0d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:15.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.348+0000 7f20b3200640 1 --2- 172.21.15.17:0/2975474153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 0x7f20ac0d1cd0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f20ac06db60 tx=0x7f209c01c800 comp rx=0 tx=0).stop 2024-09-10T23:22:15.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.348+0000 7f20b3200640 1 -- 172.21.15.17:0/2975474153 shutdown_connections 2024-09-10T23:22:15.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.348+0000 7f20b3200640 1 --2- 172.21.15.17:0/2975474153 >> v2:172.21.15.77:3300/0 conn(0x7f20ac0d2210 0x7f20ac071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.348+0000 7f20b3200640 1 --2- 172.21.15.17:0/2975474153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 0x7f20ac0d1cd0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.348+0000 7f20b3200640 1 -- 172.21.15.17:0/2975474153 >> 172.21.15.17:0/2975474153 conn(0x7f20ac09a9f0 msgr2=0x7f20ac09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:15.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.348+0000 7f20b3200640 1 -- 172.21.15.17:0/2975474153 shutdown_connections 2024-09-10T23:22:15.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.348+0000 7f20b3200640 1 -- 172.21.15.17:0/2975474153 wait complete. 2024-09-10T23:22:15.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 Processor -- start 2024-09-10T23:22:15.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 -- start start 2024-09-10T23:22:15.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20ac071bb0 0x7f20ac14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:15.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20ac0d2210 0x7f20ac14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:15.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 0x7f20ac0b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:15.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac168e90 con 0x7f20ac15be20 2024-09-10T23:22:15.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac168d10 con 0x7f20ac0d2210 2024-09-10T23:22:15.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac169010 con 0x7f20ac071bb0 2024-09-10T23:22:15.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 0x7f20ac0b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:15.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 0x7f20ac0b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48874/0 (socket says 172.21.15.17:48874) 2024-09-10T23:22:15.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b1200640 1 -- 172.21.15.17:0/2309516112 learned_addr learned my addr 172.21.15.17:0/2309516112 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:15.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20abe00640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20ac071bb0 0x7f20ac14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:15.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20a3e00640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20ac0d2210 0x7f20ac14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:15.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b1200640 1 -- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20ac071bb0 msgr2=0x7f20ac14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:15.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b1200640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20ac071bb0 0x7f20ac14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b1200640 1 -- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20ac0d2210 msgr2=0x7f20ac14dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b1200640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20ac0d2210 0x7f20ac14dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b1200640 1 -- 172.21.15.17:0/2309516112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac0b7120 con 0x7f20ac15be20 2024-09-10T23:22:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b1200640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 0x7f20ac0b6be0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c7a0 tx=0x7f20a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20a8c00640 1 -- 172.21.15.17:0/2309516112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4017070 con 0x7f20ac15be20 2024-09-10T23:22:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20a8c00640 1 -- 172.21.15.17:0/2309516112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20a4005070 con 0x7f20ac15be20 2024-09-10T23:22:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac14e9e0 con 0x7f20ac15be20 2024-09-10T23:22:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20a8c00640 1 -- 172.21.15.17:0/2309516112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a40054c0 con 0x7f20ac15be20 2024-09-10T23:22:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac14efa0 con 0x7f20ac15be20 2024-09-10T23:22:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.352+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ac071670 con 0x7f20ac15be20 2024-09-10T23:22:15.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.356+0000 7f20a8c00640 1 -- 172.21.15.17:0/2309516112 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f20a4005660 con 0x7f20ac15be20 2024-09-10T23:22:15.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.356+0000 7f20a8c00640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20880725e0 0x7f2088074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:15.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.356+0000 7f20a8c00640 1 -- 172.21.15.17:0/2309516112 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f20a4092d50 con 0x7f20ac15be20 2024-09-10T23:22:15.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.356+0000 7f20abe00640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20880725e0 0x7f2088074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:15.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.356+0000 7f20abe00640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20880725e0 0x7f2088074aa0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f209c0af000 tx=0x7f209c01b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.360+0000 7f20a8c00640 1 -- 172.21.15.17:0/2309516112 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f20a405dbb0 con 0x7f20ac15be20 2024-09-10T23:22:15.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:15.572+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f20ac155330 con 0x7f20ac15be20 2024-09-10T23:22:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.172+0000 7f20a8c00640 1 -- 172.21.15.17:0/2309516112 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) ==== 122+0+0 (secure 0 0 0) 0x7f20a40625e0 con 0x7f20ac15be20 2024-09-10T23:22:16.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20880725e0 msgr2=0x7f2088074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20880725e0 0x7f2088074aa0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f209c0af000 tx=0x7f209c01b040 comp rx=0 tx=0).stop 2024-09-10T23:22:16.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 msgr2=0x7f20ac0b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 0x7f20ac0b6be0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c7a0 tx=0x7f20a400cc60 comp rx=0 tx=0).stop 2024-09-10T23:22:16.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 shutdown_connections 2024-09-10T23:22:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20880725e0 0x7f2088074aa0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac15be20 0x7f20ac0b6be0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20ac0d2210 0x7f20ac14dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 --2- 172.21.15.17:0/2309516112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20ac071bb0 0x7f20ac14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 >> 172.21.15.17:0/2309516112 conn(0x7f20ac09a9f0 msgr2=0x7f20ac0c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 shutdown_connections 2024-09-10T23:22:16.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.176+0000 7f20b3200640 1 -- 172.21.15.17:0/2309516112 wait complete. 2024-09-10T23:22:16.201 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:22:16.201 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:22:16.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 -- 172.21.15.17:0/2571357276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4624004da0 msgr2=0x7f4624005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 --2- 172.21.15.17:0/2571357276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4624004da0 0x7f4624005220 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4638009ee0 tx=0x7f463801d5f0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4645000640 1 -- 172.21.15.17:0/2571357276 reap_dead start 2024-09-10T23:22:16.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 -- 172.21.15.17:0/2571357276 shutdown_connections 2024-09-10T23:22:16.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 -- 172.21.15.17:0/2571357276 >> 172.21.15.17:0/2571357276 conn(0x7f46400d0c50 msgr2=0x7f46400d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:16.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 -- 172.21.15.17:0/2571357276 shutdown_connections 2024-09-10T23:22:16.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 -- 172.21.15.17:0/2571357276 wait complete. 2024-09-10T23:22:16.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 Processor -- start 2024-09-10T23:22:16.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 -- start start 2024-09-10T23:22:16.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4624004da0 0x7f46400c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46400c5df0 0x7f46400c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46401f5780 0x7f46401f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46400d09a0 con 0x7f4624004da0 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46400d0820 con 0x7f46400c5df0 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4647000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46400cef30 con 0x7f46401f5780 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f463fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4624004da0 0x7f46400c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f463fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4624004da0 0x7f46400c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48898/0 (socket says 172.21.15.17:48898) 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f463fe00640 1 -- 172.21.15.17:0/3600134258 learned_addr learned my addr 172.21.15.17:0/3600134258 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4645000640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46401f5780 0x7f46401f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.352+0000 7f4637e00640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46400c5df0 0x7f46400c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463fe00640 1 -- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46401f5780 msgr2=0x7f46401f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463fe00640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46401f5780 0x7f46401f5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463fe00640 1 -- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46400c5df0 msgr2=0x7f46400c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463fe00640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46400c5df0 0x7f46400c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463fe00640 1 -- 172.21.15.17:0/3600134258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46401597b0 con 0x7f4624004da0 2024-09-10T23:22:16.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463fe00640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4624004da0 0x7f46400c3d70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4630003e50 tx=0x7f4630001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:16.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463cc00640 1 -- 172.21.15.17:0/3600134258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630011700 con 0x7f4624004da0 2024-09-10T23:22:16.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463cc00640 1 -- 172.21.15.17:0/3600134258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4630016020 con 0x7f4624004da0 2024-09-10T23:22:16.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463cc00640 1 -- 172.21.15.17:0/3600134258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630011b40 con 0x7f4624004da0 2024-09-10T23:22:16.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4640159a50 con 0x7f4624004da0 2024-09-10T23:22:16.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46400c4a00 con 0x7f4624004da0 2024-09-10T23:22:16.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46401f4590 con 0x7f4624004da0 2024-09-10T23:22:16.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463cc00640 1 -- 172.21.15.17:0/3600134258 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4630011ce0 con 0x7f4624004da0 2024-09-10T23:22:16.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.356+0000 7f463cc00640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f461c072610 0x7f461c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.360+0000 7f463cc00640 1 -- 172.21.15.17:0/3600134258 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f46300945b0 con 0x7f4624004da0 2024-09-10T23:22:16.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.360+0000 7f4637e00640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f461c072610 0x7f461c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.360+0000 7f4637e00640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f461c072610 0x7f461c074ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4628000c10 tx=0x7f4628001580 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:16.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.360+0000 7f463cc00640 1 -- 172.21.15.17:0/3600134258 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4630020020 con 0x7f4624004da0 2024-09-10T23:22:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.572+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4640070900 con 0x7f4624004da0 2024-09-10T23:22:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.572+0000 7f463cc00640 1 -- 172.21.15.17:0/3600134258 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5216 (secure 0 0 0) 0x7f4640070900 con 0x7f4624004da0 2024-09-10T23:22:16.575 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:16.575 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"btime":"2024-09-10T23:22:16:169092+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/151616867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":151616867},{"type":"v1","addr":"172.21.15.77:6836","nonce":151616867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7824,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/623866149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":623866149},{"type":"v1","addr":"172.21.15.17:6834","nonce":623866149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7827,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2269575278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2269575278},{"type":"v1","addr":"172.21.15.17:6835","nonce":2269575278}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:22:12.557691+0000","modified":"2024-09-10T23:22:15.576023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/258682540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":258682540},{"type":"v1","addr":"172.21.15.77:6837","nonce":258682540}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":7}]} 2024-09-10T23:22:16.575 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 86 2024-09-10T23:22:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f461c072610 msgr2=0x7f461c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f461c072610 0x7f461c074ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4628000c10 tx=0x7f4628001580 comp rx=0 tx=0).stop 2024-09-10T23:22:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4624004da0 msgr2=0x7f46400c3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4624004da0 0x7f46400c3d70 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4630003e50 tx=0x7f4630001800 comp rx=0 tx=0).stop 2024-09-10T23:22:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 shutdown_connections 2024-09-10T23:22:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f461c072610 0x7f461c074ad0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46401f5780 0x7f46401f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46400c5df0 0x7f46400c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 --2- 172.21.15.17:0/3600134258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4624004da0 0x7f46400c3d70 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 >> 172.21.15.17:0/3600134258 conn(0x7f46400d0c50 msgr2=0x7f46400b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:16.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 shutdown_connections 2024-09-10T23:22:16.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.576+0000 7f4647000640 1 -- 172.21.15.17:0/3600134258 wait complete. 2024-09-10T23:22:16.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:22:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.740+0000 7f04a7200640 1 -- 172.21.15.17:0/3979779747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a006d2d0 msgr2=0x7f04a00ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.740+0000 7f04a7200640 1 --2- 172.21.15.17:0/3979779747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a006d2d0 0x7f04a00ce260 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f04a00b38b0 tx=0x7f048801c800 comp rx=0 tx=0).stop 2024-09-10T23:22:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.740+0000 7f04a7200640 1 -- 172.21.15.17:0/3979779747 shutdown_connections 2024-09-10T23:22:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.740+0000 7f04a7200640 1 --2- 172.21.15.17:0/3979779747 >> v2:172.21.15.77:3300/0 conn(0x7f04a0162550 0x7f04a015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.740+0000 7f04a7200640 1 --2- 172.21.15.17:0/3979779747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a006d2d0 0x7f04a00ce260 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.740+0000 7f04a7200640 1 -- 172.21.15.17:0/3979779747 >> 172.21.15.17:0/3979779747 conn(0x7f04a00b28e0 msgr2=0x7f04a00b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.740+0000 7f04a7200640 1 -- 172.21.15.17:0/3979779747 shutdown_connections 2024-09-10T23:22:16.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.740+0000 7f04a7200640 1 -- 172.21.15.17:0/3979779747 wait complete. 2024-09-10T23:22:16.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 Processor -- start 2024-09-10T23:22:16.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 -- start start 2024-09-10T23:22:16.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04a006d2d0 0x7f04a015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a0162170 0x7f04a015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04a0162550 0x7f04a01412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00b5150 con 0x7f04a0162170 2024-09-10T23:22:16.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00b4fd0 con 0x7f04a0162550 2024-09-10T23:22:16.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f04a00b52d0 con 0x7f04a006d2d0 2024-09-10T23:22:16.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f0497e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a0162170 0x7f04a015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f0497e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a0162170 0x7f04a015d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48918/0 (socket says 172.21.15.17:48918) 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f0497e00640 1 -- 172.21.15.17:0/3667828131 learned_addr learned my addr 172.21.15.17:0/3667828131 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f049fe00640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04a006d2d0 0x7f04a015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a5200640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04a0162550 0x7f04a01412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f0497e00640 1 -- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04a006d2d0 msgr2=0x7f04a015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f0497e00640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04a006d2d0 0x7f04a015cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f0497e00640 1 -- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04a0162550 msgr2=0x7f04a01412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f0497e00640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04a0162550 0x7f04a01412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f0497e00640 1 -- 172.21.15.17:0/3667828131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a00afda0 con 0x7f04a0162170 2024-09-10T23:22:16.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f0497e00640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a0162170 0x7f04a015d4f0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0488000c10 tx=0x7f0488004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:16.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f049cc00640 1 -- 172.21.15.17:0/3667828131 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488004430 con 0x7f04a0162170 2024-09-10T23:22:16.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f049cc00640 1 -- 172.21.15.17:0/3667828131 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04880c0070 con 0x7f04a0162170 2024-09-10T23:22:16.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f049cc00640 1 -- 172.21.15.17:0/3667828131 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488003930 con 0x7f04a0162170 2024-09-10T23:22:16.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a00af220 con 0x7f04a0162170 2024-09-10T23:22:16.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.744+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a00af7e0 con 0x7f04a0162170 2024-09-10T23:22:16.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.748+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a00b5780 con 0x7f04a0162170 2024-09-10T23:22:16.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.748+0000 7f049cc00640 1 -- 172.21.15.17:0/3667828131 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0488003ad0 con 0x7f04a0162170 2024-09-10T23:22:16.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.748+0000 7f049cc00640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f047c0725e0 0x7f047c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:16.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.748+0000 7f049cc00640 1 -- 172.21.15.17:0/3667828131 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f048812e660 con 0x7f04a0162170 2024-09-10T23:22:16.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.748+0000 7f049fe00640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f047c0725e0 0x7f047c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:16.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.748+0000 7f049fe00640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f047c0725e0 0x7f047c074aa0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0490007fd0 tx=0x7f0490007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:16.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.752+0000 7f049cc00640 1 -- 172.21.15.17:0/3667828131 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f04880163f0 con 0x7f04a0162170 2024-09-10T23:22:16.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04a006d7c0 con 0x7f04a0162170 2024-09-10T23:22:16.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f049cc00640 1 -- 172.21.15.17:0/3667828131 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16884 (secure 0 0 0) 0x7f04881022c0 con 0x7f04a0162170 2024-09-10T23:22:16.933 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:16.933 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":118,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:22:14.154603+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:10.273423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:11.522343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:22:16.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f047c0725e0 msgr2=0x7f047c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f047c0725e0 0x7f047c074aa0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0490007fd0 tx=0x7f0490007ea0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a0162170 msgr2=0x7f04a015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:16.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a0162170 0x7f04a015d4f0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0488000c10 tx=0x7f0488004040 comp rx=0 tx=0).stop 2024-09-10T23:22:16.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 shutdown_connections 2024-09-10T23:22:16.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f047c0725e0 0x7f047c074aa0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04a0162550 0x7f04a01412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a0162170 0x7f04a015d4f0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 --2- 172.21.15.17:0/3667828131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04a006d2d0 0x7f04a015cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:16.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 >> 172.21.15.17:0/3667828131 conn(0x7f04a00b28e0 msgr2=0x7f04a00737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:16.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 shutdown_connections 2024-09-10T23:22:16.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:16.932+0000 7f04a7200640 1 -- 172.21.15.17:0/3667828131 wait complete. 2024-09-10T23:22:16.955 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:22:16.955 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:22:17.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.100+0000 7f2a5ca00640 1 -- 172.21.15.17:0/1425127035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a3c003a60 msgr2=0x7f2a3c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.100+0000 7f2a5ca00640 1 --2- 172.21.15.17:0/1425127035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a3c003a60 0x7f2a3c003e80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2a480016f0 tx=0x7f2a4801c750 comp rx=0 tx=0).stop 2024-09-10T23:22:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.100+0000 7f2a5ca00640 1 -- 172.21.15.17:0/1425127035 shutdown_connections 2024-09-10T23:22:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.100+0000 7f2a5ca00640 1 --2- 172.21.15.17:0/1425127035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a3c003a60 0x7f2a3c003e80 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.100+0000 7f2a5ca00640 1 -- 172.21.15.17:0/1425127035 >> 172.21.15.17:0/1425127035 conn(0x7f2a580742c0 msgr2=0x7f2a580746a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.100+0000 7f2a5ca00640 1 -- 172.21.15.17:0/1425127035 shutdown_connections 2024-09-10T23:22:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.100+0000 7f2a5ca00640 1 -- 172.21.15.17:0/1425127035 wait complete. 2024-09-10T23:22:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 Processor -- start 2024-09-10T23:22:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 -- start start 2024-09-10T23:22:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c003a60 0x7f2a580ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a5815dd20 0x7f2a5814ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5814d1f0 0x7f2a5814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2a580b5c80 con 0x7f2a5814d1f0 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a580b5b00 con 0x7f2a3c003a60 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2a580b5e00 con 0x7f2a5815dd20 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a56800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5814d1f0 0x7f2a5814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a56800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5814d1f0 0x7f2a5814d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53478/0 (socket says 172.21.15.17:53478) 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a56800640 1 -- 172.21.15.17:0/248995506 learned_addr learned my addr 172.21.15.17:0/248995506 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a4fe00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a5815dd20 0x7f2a5814ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a55e00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c003a60 0x7f2a580ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a56800640 1 -- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a5815dd20 msgr2=0x7f2a5814ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a56800640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a5815dd20 0x7f2a5814ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a56800640 1 -- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c003a60 msgr2=0x7f2a580ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a56800640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c003a60 0x7f2a580ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a56800640 1 -- 172.21.15.17:0/248995506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a581fbac0 con 0x7f2a5814d1f0 2024-09-10T23:22:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a4fe00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a5815dd20 0x7f2a5814ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a55e00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c003a60 0x7f2a580ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a56800640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5814d1f0 0x7f2a5814d670 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001340 tx=0x7f2a5000eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a4e000640 1 -- 172.21.15.17:0/248995506 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50015020 con 0x7f2a5814d1f0 2024-09-10T23:22:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a4e000640 1 -- 172.21.15.17:0/248995506 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a5000ca60 con 0x7f2a5814d1f0 2024-09-10T23:22:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a580c4050 con 0x7f2a5814d1f0 2024-09-10T23:22:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a4e000640 1 -- 172.21.15.17:0/248995506 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000ce90 con 0x7f2a5814d1f0 2024-09-10T23:22:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.104+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a580c42f0 con 0x7f2a5814d1f0 2024-09-10T23:22:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.108+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5815ecd0 con 0x7f2a5814d1f0 2024-09-10T23:22:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.108+0000 7f2a4e000640 1 -- 172.21.15.17:0/248995506 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2a50011460 con 0x7f2a5814d1f0 2024-09-10T23:22:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.108+0000 7f2a4e000640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2a34072780 0x7f2a34074c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.108+0000 7f2a4e000640 1 -- 172.21.15.17:0/248995506 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f2a50093a30 con 0x7f2a5814d1f0 2024-09-10T23:22:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.108+0000 7f2a55e00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2a34072780 0x7f2a34074c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.112+0000 7f2a55e00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2a34072780 0x7f2a34074c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2a480016c0 tx=0x7f2a48019540 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.112+0000 7f2a4e000640 1 -- 172.21.15.17:0/248995506 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2a5001f030 con 0x7f2a5814d1f0 2024-09-10T23:22:17.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.284+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a581fb590 con 0x7f2a34072780 2024-09-10T23:22:17.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a4e000640 1 -- 172.21.15.17:0/248995506 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7f2a581fb590 con 0x7f2a34072780 2024-09-10T23:22:17.295 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:17.297 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:22:17.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2a34072780 msgr2=0x7f2a34074c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2a34072780 0x7f2a34074c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2a480016c0 tx=0x7f2a48019540 comp rx=0 tx=0).stop 2024-09-10T23:22:17.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5814d1f0 msgr2=0x7f2a5814d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5814d1f0 0x7f2a5814d670 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001340 tx=0x7f2a5000eae0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 shutdown_connections 2024-09-10T23:22:17.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2a34072780 0x7f2a34074c40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5814d1f0 0x7f2a5814d670 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a5815dd20 0x7f2a5814ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 --2- 172.21.15.17:0/248995506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a3c003a60 0x7f2a580ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 >> 172.21.15.17:0/248995506 conn(0x7f2a580742c0 msgr2=0x7f2a580aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:17.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 shutdown_connections 2024-09-10T23:22:17.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.292+0000 7f2a5ca00640 1 -- 172.21.15.17:0/248995506 wait complete. 2024-09-10T23:22:17.315 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-09-10T23:22:16.390161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346740,"kb_used_data":12532,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754627980,"statfs":{"total":773094113280,"available":772739051520,"internally_reserved":0,"allocated":12832768,"data_stored":6599595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.253607"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173843+0000","last_change":"2024-09-10T23:22:13.166522+0000","last_active":"2024-09-10T23:22:14.173843+0000","last_peered":"2024-09-10T23:22:14.173843+0000","last_clean":"2024-09-10T23:22:14.173843+0000","last_became_active":"2024-09-10T23:22:13.166241+0000","last_became_peered":"2024-09-10T23:22:13.166241+0000","last_unstale":"2024-09-10T23:22:14.173843+0000","last_undegraded":"2024-09-10T23:22:14.173843+0000","last_fullsized":"2024-09-10T23:22:14.173843+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.568864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616565+0000","last_change":"2024-09-10T23:22:13.166964+0000","last_active":"2024-09-10T23:22:14.616565+0000","last_peered":"2024-09-10T23:22:14.616565+0000","last_clean":"2024-09-10T23:22:14.616565+0000","last_became_active":"2024-09-10T23:22:13.166260+0000","last_became_peered":"2024-09-10T23:22:13.166260+0000","last_unstale":"2024-09-10T23:22:14.616565+0000","last_undegraded":"2024-09-10T23:22:14.616565+0000","last_fullsized":"2024-09-10T23:22:14.616565+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:52.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173819+0000","last_change":"2024-09-10T23:22:13.168074+0000","last_active":"2024-09-10T23:22:14.173819+0000","last_peered":"2024-09-10T23:22:14.173819+0000","last_clean":"2024-09-10T23:22:14.173819+0000","last_became_active":"2024-09-10T23:22:13.167787+0000","last_became_peered":"2024-09-10T23:22:13.167787+0000","last_unstale":"2024-09-10T23:22:14.173819+0000","last_undegraded":"2024-09-10T23:22:14.173819+0000","last_fullsized":"2024-09-10T23:22:14.173819+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:21.705358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.166704+0000","last_change":"2024-09-10T23:22:13.160680+0000","last_active":"2024-09-10T23:22:13.166704+0000","last_peered":"2024-09-10T23:22:13.166704+0000","last_clean":"2024-09-10T23:22:13.166704+0000","last_became_active":"2024-09-10T23:22:13.160382+0000","last_became_peered":"2024-09-10T23:22:13.160382+0000","last_unstale":"2024-09-10T23:22:13.166704+0000","last_undegraded":"2024-09-10T23:22:13.166704+0000","last_fullsized":"2024-09-10T23:22:13.166704+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:11.113997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165094+0000","last_change":"2024-09-10T23:22:13.154170+0000","last_active":"2024-09-10T23:22:14.165094+0000","last_peered":"2024-09-10T23:22:14.165094+0000","last_clean":"2024-09-10T23:22:14.165094+0000","last_became_active":"2024-09-10T23:22:13.153844+0000","last_became_peered":"2024-09-10T23:22:13.153844+0000","last_unstale":"2024-09-10T23:22:14.165094+0000","last_undegraded":"2024-09-10T23:22:14.165094+0000","last_fullsized":"2024-09-10T23:22:14.165094+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:53.652966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615995+0000","last_change":"2024-09-10T23:22:13.168685+0000","last_active":"2024-09-10T23:22:14.615995+0000","last_peered":"2024-09-10T23:22:14.615995+0000","last_clean":"2024-09-10T23:22:14.615995+0000","last_became_active":"2024-09-10T23:22:13.168403+0000","last_became_peered":"2024-09-10T23:22:13.168403+0000","last_unstale":"2024-09-10T23:22:14.615995+0000","last_undegraded":"2024-09-10T23:22:14.615995+0000","last_fullsized":"2024-09-10T23:22:14.615995+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:50.295010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615563+0000","last_change":"2024-09-10T23:22:13.170755+0000","last_active":"2024-09-10T23:22:14.615563+0000","last_peered":"2024-09-10T23:22:14.615563+0000","last_clean":"2024-09-10T23:22:14.615563+0000","last_became_active":"2024-09-10T23:22:13.169968+0000","last_became_peered":"2024-09-10T23:22:13.169968+0000","last_unstale":"2024-09-10T23:22:14.615563+0000","last_undegraded":"2024-09-10T23:22:14.615563+0000","last_fullsized":"2024-09-10T23:22:14.615563+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:01.923183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612699+0000","last_change":"2024-09-10T23:22:13.172326+0000","last_active":"2024-09-10T23:22:14.612699+0000","last_peered":"2024-09-10T23:22:14.612699+0000","last_clean":"2024-09-10T23:22:14.612699+0000","last_became_active":"2024-09-10T23:22:13.172033+0000","last_became_peered":"2024-09-10T23:22:13.172033+0000","last_unstale":"2024-09-10T23:22:14.612699+0000","last_undegraded":"2024-09-10T23:22:14.612699+0000","last_fullsized":"2024-09-10T23:22:14.612699+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:42.117722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616494+0000","last_change":"2024-09-10T23:22:13.174879+0000","last_active":"2024-09-10T23:22:14.616494+0000","last_peered":"2024-09-10T23:22:14.616494+0000","last_clean":"2024-09-10T23:22:14.616494+0000","last_became_active":"2024-09-10T23:22:13.174391+0000","last_became_peered":"2024-09-10T23:22:13.174391+0000","last_unstale":"2024-09-10T23:22:14.616494+0000","last_undegraded":"2024-09-10T23:22:14.616494+0000","last_fullsized":"2024-09-10T23:22:14.616494+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:21.191486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165084+0000","last_change":"2024-09-10T23:22:13.167704+0000","last_active":"2024-09-10T23:22:14.165084+0000","last_peered":"2024-09-10T23:22:14.165084+0000","last_clean":"2024-09-10T23:22:14.165084+0000","last_became_active":"2024-09-10T23:22:13.167352+0000","last_became_peered":"2024-09-10T23:22:13.167352+0000","last_unstale":"2024-09-10T23:22:14.165084+0000","last_undegraded":"2024-09-10T23:22:14.165084+0000","last_fullsized":"2024-09-10T23:22:14.165084+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:48:03.380595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179007+0000","last_change":"2024-09-10T23:22:13.176607+0000","last_active":"2024-09-10T23:22:14.179007+0000","last_peered":"2024-09-10T23:22:14.179007+0000","last_clean":"2024-09-10T23:22:14.179007+0000","last_became_active":"2024-09-10T23:22:13.176282+0000","last_became_peered":"2024-09-10T23:22:13.176282+0000","last_unstale":"2024-09-10T23:22:14.179007+0000","last_undegraded":"2024-09-10T23:22:14.179007+0000","last_fullsized":"2024-09-10T23:22:14.179007+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:30.357815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171640+0000","last_change":"2024-09-10T23:22:13.158145+0000","last_active":"2024-09-10T23:22:14.171640+0000","last_peered":"2024-09-10T23:22:14.171640+0000","last_clean":"2024-09-10T23:22:14.171640+0000","last_became_active":"2024-09-10T23:22:13.157785+0000","last_became_peered":"2024-09-10T23:22:13.157785+0000","last_unstale":"2024-09-10T23:22:14.171640+0000","last_undegraded":"2024-09-10T23:22:14.171640+0000","last_fullsized":"2024-09-10T23:22:14.171640+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:30.279138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.179526+0000","last_change":"2024-09-10T23:22:13.171674+0000","last_active":"2024-09-10T23:22:13.179526+0000","last_peered":"2024-09-10T23:22:13.179526+0000","last_clean":"2024-09-10T23:22:13.179526+0000","last_became_active":"2024-09-10T23:22:13.170865+0000","last_became_peered":"2024-09-10T23:22:13.170865+0000","last_unstale":"2024-09-10T23:22:13.179526+0000","last_undegraded":"2024-09-10T23:22:13.179526+0000","last_fullsized":"2024-09-10T23:22:13.179526+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:37.209928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615184+0000","last_change":"2024-09-10T23:22:13.171711+0000","last_active":"2024-09-10T23:22:14.615184+0000","last_peered":"2024-09-10T23:22:14.615184+0000","last_clean":"2024-09-10T23:22:14.615184+0000","last_became_active":"2024-09-10T23:22:13.171439+0000","last_became_peered":"2024-09-10T23:22:13.171439+0000","last_unstale":"2024-09-10T23:22:14.615184+0000","last_undegraded":"2024-09-10T23:22:14.615184+0000","last_fullsized":"2024-09-10T23:22:14.615184+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:16.735527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615141+0000","last_change":"2024-09-10T23:22:13.167404+0000","last_active":"2024-09-10T23:22:14.615141+0000","last_peered":"2024-09-10T23:22:14.615141+0000","last_clean":"2024-09-10T23:22:14.615141+0000","last_became_active":"2024-09-10T23:22:13.167134+0000","last_became_peered":"2024-09-10T23:22:13.167134+0000","last_unstale":"2024-09-10T23:22:14.615141+0000","last_undegraded":"2024-09-10T23:22:14.615141+0000","last_fullsized":"2024-09-10T23:22:14.615141+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:40.894742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615140+0000","last_change":"2024-09-10T23:22:13.179513+0000","last_active":"2024-09-10T23:22:14.615140+0000","last_peered":"2024-09-10T23:22:14.615140+0000","last_clean":"2024-09-10T23:22:14.615140+0000","last_became_active":"2024-09-10T23:22:13.179223+0000","last_became_peered":"2024-09-10T23:22:13.179223+0000","last_unstale":"2024-09-10T23:22:14.615140+0000","last_undegraded":"2024-09-10T23:22:14.615140+0000","last_fullsized":"2024-09-10T23:22:14.615140+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:20:26.945862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173949+0000","last_change":"2024-09-10T23:22:13.171812+0000","last_active":"2024-09-10T23:22:14.173949+0000","last_peered":"2024-09-10T23:22:14.173949+0000","last_clean":"2024-09-10T23:22:14.173949+0000","last_became_active":"2024-09-10T23:22:13.171295+0000","last_became_peered":"2024-09-10T23:22:13.171295+0000","last_unstale":"2024-09-10T23:22:14.173949+0000","last_undegraded":"2024-09-10T23:22:14.173949+0000","last_fullsized":"2024-09-10T23:22:14.173949+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:18.456470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616559+0000","last_change":"2024-09-10T23:22:13.166676+0000","last_active":"2024-09-10T23:22:14.616559+0000","last_peered":"2024-09-10T23:22:14.616559+0000","last_clean":"2024-09-10T23:22:14.616559+0000","last_became_active":"2024-09-10T23:22:13.165883+0000","last_became_peered":"2024-09-10T23:22:13.165883+0000","last_unstale":"2024-09-10T23:22:14.616559+0000","last_undegraded":"2024-09-10T23:22:14.616559+0000","last_fullsized":"2024-09-10T23:22:14.616559+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:05.677353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.174119+0000","last_change":"2024-09-10T23:22:13.178574+0000","last_active":"2024-09-10T23:22:14.174119+0000","last_peered":"2024-09-10T23:22:14.174119+0000","last_clean":"2024-09-10T23:22:14.174119+0000","last_became_active":"2024-09-10T23:22:13.178262+0000","last_became_peered":"2024-09-10T23:22:13.178262+0000","last_unstale":"2024-09-10T23:22:14.174119+0000","last_undegraded":"2024-09-10T23:22:14.174119+0000","last_fullsized":"2024-09-10T23:22:14.174119+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:25.686057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171673+0000","last_change":"2024-09-10T23:22:13.161329+0000","last_active":"2024-09-10T23:22:14.171673+0000","last_peered":"2024-09-10T23:22:14.171673+0000","last_clean":"2024-09-10T23:22:14.171673+0000","last_became_active":"2024-09-10T23:22:13.161074+0000","last_became_peered":"2024-09-10T23:22:13.161074+0000","last_unstale":"2024-09-10T23:22:14.171673+0000","last_undegraded":"2024-09-10T23:22:14.171673+0000","last_fullsized":"2024-09-10T23:22:14.171673+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:42.594171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613220+0000","last_change":"2024-09-10T23:22:13.176754+0000","last_active":"2024-09-10T23:22:14.613220+0000","last_peered":"2024-09-10T23:22:14.613220+0000","last_clean":"2024-09-10T23:22:14.613220+0000","last_became_active":"2024-09-10T23:22:13.176423+0000","last_became_peered":"2024-09-10T23:22:13.176423+0000","last_unstale":"2024-09-10T23:22:14.613220+0000","last_undegraded":"2024-09-10T23:22:14.613220+0000","last_fullsized":"2024-09-10T23:22:14.613220+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:33.697801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164816+0000","last_change":"2024-09-10T23:22:13.171426+0000","last_active":"2024-09-10T23:22:14.164816+0000","last_peered":"2024-09-10T23:22:14.164816+0000","last_clean":"2024-09-10T23:22:14.164816+0000","last_became_active":"2024-09-10T23:22:13.170900+0000","last_became_peered":"2024-09-10T23:22:13.170900+0000","last_unstale":"2024-09-10T23:22:14.164816+0000","last_undegraded":"2024-09-10T23:22:14.164816+0000","last_fullsized":"2024-09-10T23:22:14.164816+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:10.533956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173594+0000","last_change":"2024-09-10T23:22:13.164395+0000","last_active":"2024-09-10T23:22:14.173594+0000","last_peered":"2024-09-10T23:22:14.173594+0000","last_clean":"2024-09-10T23:22:14.173594+0000","last_became_active":"2024-09-10T23:22:13.164087+0000","last_became_peered":"2024-09-10T23:22:13.164087+0000","last_unstale":"2024-09-10T23:22:14.173594+0000","last_undegraded":"2024-09-10T23:22:14.173594+0000","last_fullsized":"2024-09-10T23:22:14.173594+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:38.540028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164544+0000","last_change":"2024-09-10T23:22:13.159370+0000","last_active":"2024-09-10T23:22:14.164544+0000","last_peered":"2024-09-10T23:22:14.164544+0000","last_clean":"2024-09-10T23:22:14.164544+0000","last_became_active":"2024-09-10T23:22:13.159090+0000","last_became_peered":"2024-09-10T23:22:13.159090+0000","last_unstale":"2024-09-10T23:22:14.164544+0000","last_undegraded":"2024-09-10T23:22:14.164544+0000","last_fullsized":"2024-09-10T23:22:14.164544+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:31.673642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171251+0000","last_change":"2024-09-10T23:22:13.169361+0000","last_active":"2024-09-10T23:22:14.171251+0000","last_peered":"2024-09-10T23:22:14.171251+0000","last_clean":"2024-09-10T23:22:14.171251+0000","last_became_active":"2024-09-10T23:22:13.169090+0000","last_became_peered":"2024-09-10T23:22:13.169090+0000","last_unstale":"2024-09-10T23:22:14.171251+0000","last_undegraded":"2024-09-10T23:22:14.171251+0000","last_fullsized":"2024-09-10T23:22:14.171251+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:21.191486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171352+0000","last_change":"2024-09-10T23:22:13.169304+0000","last_active":"2024-09-10T23:22:14.171352+0000","last_peered":"2024-09-10T23:22:14.171352+0000","last_clean":"2024-09-10T23:22:14.171352+0000","last_became_active":"2024-09-10T23:22:13.169006+0000","last_became_peered":"2024-09-10T23:22:13.169006+0000","last_unstale":"2024-09-10T23:22:14.171352+0000","last_undegraded":"2024-09-10T23:22:14.171352+0000","last_fullsized":"2024-09-10T23:22:14.171352+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:52.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179071+0000","last_change":"2024-09-10T23:22:13.173437+0000","last_active":"2024-09-10T23:22:14.179071+0000","last_peered":"2024-09-10T23:22:14.179071+0000","last_clean":"2024-09-10T23:22:14.179071+0000","last_became_active":"2024-09-10T23:22:13.173160+0000","last_became_peered":"2024-09-10T23:22:13.173160+0000","last_unstale":"2024-09-10T23:22:14.179071+0000","last_undegraded":"2024-09-10T23:22:14.179071+0000","last_fullsized":"2024-09-10T23:22:14.179071+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:20.845445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616370+0000","last_change":"2024-09-10T23:22:13.175024+0000","last_active":"2024-09-10T23:22:14.616370+0000","last_peered":"2024-09-10T23:22:14.616370+0000","last_clean":"2024-09-10T23:22:14.616370+0000","last_became_active":"2024-09-10T23:22:13.173182+0000","last_became_peered":"2024-09-10T23:22:13.173182+0000","last_unstale":"2024-09-10T23:22:14.616370+0000","last_undegraded":"2024-09-10T23:22:14.616370+0000","last_fullsized":"2024-09-10T23:22:14.616370+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:10.325210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613358+0000","last_change":"2024-09-10T23:22:13.176968+0000","last_active":"2024-09-10T23:22:14.613358+0000","last_peered":"2024-09-10T23:22:14.613358+0000","last_clean":"2024-09-10T23:22:14.613358+0000","last_became_active":"2024-09-10T23:22:13.176692+0000","last_became_peered":"2024-09-10T23:22:13.176692+0000","last_unstale":"2024-09-10T23:22:14.613358+0000","last_undegraded":"2024-09-10T23:22:14.613358+0000","last_fullsized":"2024-09-10T23:22:14.613358+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:05.128194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171191+0000","last_change":"2024-09-10T23:22:13.176044+0000","last_active":"2024-09-10T23:22:14.171191+0000","last_peered":"2024-09-10T23:22:14.171191+0000","last_clean":"2024-09-10T23:22:14.171191+0000","last_became_active":"2024-09-10T23:22:13.175733+0000","last_became_peered":"2024-09-10T23:22:13.175733+0000","last_unstale":"2024-09-10T23:22:14.171191+0000","last_undegraded":"2024-09-10T23:22:14.171191+0000","last_fullsized":"2024-09-10T23:22:14.171191+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:31.243940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615676+0000","last_change":"2024-09-10T23:22:13.173787+0000","last_active":"2024-09-10T23:22:14.615676+0000","last_peered":"2024-09-10T23:22:14.615676+0000","last_clean":"2024-09-10T23:22:14.615676+0000","last_became_active":"2024-09-10T23:22:13.173417+0000","last_became_peered":"2024-09-10T23:22:13.173417+0000","last_unstale":"2024-09-10T23:22:14.615676+0000","last_undegraded":"2024-09-10T23:22:14.615676+0000","last_fullsized":"2024-09-10T23:22:14.615676+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:11.135522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612865+0000","last_change":"2024-09-10T23:22:13.175898+0000","last_active":"2024-09-10T23:22:14.612865+0000","last_peered":"2024-09-10T23:22:14.612865+0000","last_clean":"2024-09-10T23:22:14.612865+0000","last_became_active":"2024-09-10T23:22:13.175378+0000","last_became_peered":"2024-09-10T23:22:13.175378+0000","last_unstale":"2024-09-10T23:22:14.612865+0000","last_undegraded":"2024-09-10T23:22:14.612865+0000","last_fullsized":"2024-09-10T23:22:14.612865+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:55.756896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173789+0000","last_change":"2024-09-10T23:22:13.180206+0000","last_active":"2024-09-10T23:22:14.173789+0000","last_peered":"2024-09-10T23:22:14.173789+0000","last_clean":"2024-09-10T23:22:14.173789+0000","last_became_active":"2024-09-10T23:22:13.179936+0000","last_became_peered":"2024-09-10T23:22:13.179936+0000","last_unstale":"2024-09-10T23:22:14.173789+0000","last_undegraded":"2024-09-10T23:22:14.173789+0000","last_fullsized":"2024-09-10T23:22:14.173789+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:42.640723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"117'4","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.186847+0000","last_change":"2024-09-10T23:22:12.161100+0000","last_active":"2024-09-10T23:22:13.186847+0000","last_peered":"2024-09-10T23:22:13.186847+0000","last_clean":"2024-09-10T23:22:13.186847+0000","last_became_active":"2024-09-10T23:22:12.160776+0000","last_became_peered":"2024-09-10T23:22:12.160776+0000","last_unstale":"2024-09-10T23:22:13.186847+0000","last_undegraded":"2024-09-10T23:22:13.186847+0000","last_fullsized":"2024-09-10T23:22:13.186847+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:22.602652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612807+0000","last_change":"2024-09-10T23:22:13.169189+0000","last_active":"2024-09-10T23:22:14.612807+0000","last_peered":"2024-09-10T23:22:14.612807+0000","last_clean":"2024-09-10T23:22:14.612807+0000","last_became_active":"2024-09-10T23:22:13.168923+0000","last_became_peered":"2024-09-10T23:22:13.168923+0000","last_unstale":"2024-09-10T23:22:14.612807+0000","last_undegraded":"2024-09-10T23:22:14.612807+0000","last_fullsized":"2024-09-10T23:22:14.612807+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:46.817933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613319+0000","last_change":"2024-09-10T23:22:12.168233+0000","last_active":"2024-09-10T23:22:14.613319+0000","last_peered":"2024-09-10T23:22:14.613319+0000","last_clean":"2024-09-10T23:22:14.613319+0000","last_became_active":"2024-09-10T23:22:12.167590+0000","last_became_peered":"2024-09-10T23:22:12.167590+0000","last_unstale":"2024-09-10T23:22:14.613319+0000","last_undegraded":"2024-09-10T23:22:14.613319+0000","last_fullsized":"2024-09-10T23:22:14.613319+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:08.257142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171423+0000","last_change":"2024-09-10T23:22:13.157310+0000","last_active":"2024-09-10T23:22:14.171423+0000","last_peered":"2024-09-10T23:22:14.171423+0000","last_clean":"2024-09-10T23:22:14.171423+0000","last_became_active":"2024-09-10T23:22:13.157012+0000","last_became_peered":"2024-09-10T23:22:13.157012+0000","last_unstale":"2024-09-10T23:22:14.171423+0000","last_undegraded":"2024-09-10T23:22:14.171423+0000","last_fullsized":"2024-09-10T23:22:14.171423+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:35.118721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171089+0000","last_change":"2024-09-10T23:22:12.168213+0000","last_active":"2024-09-10T23:22:14.171089+0000","last_peered":"2024-09-10T23:22:14.171089+0000","last_clean":"2024-09-10T23:22:14.171089+0000","last_became_active":"2024-09-10T23:22:12.165193+0000","last_became_peered":"2024-09-10T23:22:12.165193+0000","last_unstale":"2024-09-10T23:22:14.171089+0000","last_undegraded":"2024-09-10T23:22:14.171089+0000","last_fullsized":"2024-09-10T23:22:14.171089+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:59.347112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179205+0000","last_change":"2024-09-10T23:22:13.171316+0000","last_active":"2024-09-10T23:22:14.179205+0000","last_peered":"2024-09-10T23:22:14.179205+0000","last_clean":"2024-09-10T23:22:14.179205+0000","last_became_active":"2024-09-10T23:22:13.170501+0000","last_became_peered":"2024-09-10T23:22:13.170501+0000","last_unstale":"2024-09-10T23:22:14.179205+0000","last_undegraded":"2024-09-10T23:22:14.179205+0000","last_fullsized":"2024-09-10T23:22:14.179205+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:26.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164842+0000","last_change":"2024-09-10T23:22:12.153240+0000","last_active":"2024-09-10T23:22:14.164842+0000","last_peered":"2024-09-10T23:22:14.164842+0000","last_clean":"2024-09-10T23:22:14.164842+0000","last_became_active":"2024-09-10T23:22:12.152979+0000","last_became_peered":"2024-09-10T23:22:12.152979+0000","last_unstale":"2024-09-10T23:22:14.164842+0000","last_undegraded":"2024-09-10T23:22:14.164842+0000","last_fullsized":"2024-09-10T23:22:14.164842+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:24.212190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.179616+0000","last_change":"2024-09-10T23:22:13.169388+0000","last_active":"2024-09-10T23:22:13.179616+0000","last_peered":"2024-09-10T23:22:13.179616+0000","last_clean":"2024-09-10T23:22:13.179616+0000","last_became_active":"2024-09-10T23:22:13.169115+0000","last_became_peered":"2024-09-10T23:22:13.169115+0000","last_unstale":"2024-09-10T23:22:13.179616+0000","last_undegraded":"2024-09-10T23:22:13.179616+0000","last_fullsized":"2024-09-10T23:22:13.179616+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:13.164620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615287+0000","last_change":"2024-09-10T23:22:12.168178+0000","last_active":"2024-09-10T23:22:14.615287+0000","last_peered":"2024-09-10T23:22:14.615287+0000","last_clean":"2024-09-10T23:22:14.615287+0000","last_became_active":"2024-09-10T23:22:12.165879+0000","last_became_peered":"2024-09-10T23:22:12.165879+0000","last_unstale":"2024-09-10T23:22:14.615287+0000","last_undegraded":"2024-09-10T23:22:14.615287+0000","last_fullsized":"2024-09-10T23:22:14.615287+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.885794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.174309+0000","last_change":"2024-09-10T23:22:13.173543+0000","last_active":"2024-09-10T23:22:14.174309+0000","last_peered":"2024-09-10T23:22:14.174309+0000","last_clean":"2024-09-10T23:22:14.174309+0000","last_became_active":"2024-09-10T23:22:13.173280+0000","last_became_peered":"2024-09-10T23:22:13.173280+0000","last_unstale":"2024-09-10T23:22:14.174309+0000","last_undegraded":"2024-09-10T23:22:14.174309+0000","last_fullsized":"2024-09-10T23:22:14.174309+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:07.743316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.178889+0000","last_change":"2024-09-10T23:22:12.168437+0000","last_active":"2024-09-10T23:22:14.178889+0000","last_peered":"2024-09-10T23:22:14.178889+0000","last_clean":"2024-09-10T23:22:14.178889+0000","last_became_active":"2024-09-10T23:22:12.168131+0000","last_became_peered":"2024-09-10T23:22:12.168131+0000","last_unstale":"2024-09-10T23:22:14.178889+0000","last_undegraded":"2024-09-10T23:22:14.178889+0000","last_fullsized":"2024-09-10T23:22:14.178889+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:18.240870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616704+0000","last_change":"2024-09-10T23:22:13.174443+0000","last_active":"2024-09-10T23:22:14.616704+0000","last_peered":"2024-09-10T23:22:14.616704+0000","last_clean":"2024-09-10T23:22:14.616704+0000","last_became_active":"2024-09-10T23:22:13.174181+0000","last_became_peered":"2024-09-10T23:22:13.174181+0000","last_unstale":"2024-09-10T23:22:14.616704+0000","last_undegraded":"2024-09-10T23:22:14.616704+0000","last_fullsized":"2024-09-10T23:22:14.616704+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:49.494993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.170780+0000","last_change":"2024-09-10T23:22:12.163928+0000","last_active":"2024-09-10T23:22:14.170780+0000","last_peered":"2024-09-10T23:22:14.170780+0000","last_clean":"2024-09-10T23:22:14.170780+0000","last_became_active":"2024-09-10T23:22:12.163630+0000","last_became_peered":"2024-09-10T23:22:12.163630+0000","last_unstale":"2024-09-10T23:22:14.170780+0000","last_undegraded":"2024-09-10T23:22:14.170780+0000","last_fullsized":"2024-09-10T23:22:14.170780+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:06.365698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.176120+0000","last_change":"2024-09-10T23:22:13.168564+0000","last_active":"2024-09-10T23:22:13.176120+0000","last_peered":"2024-09-10T23:22:13.176120+0000","last_clean":"2024-09-10T23:22:13.176120+0000","last_became_active":"2024-09-10T23:22:13.168058+0000","last_became_peered":"2024-09-10T23:22:13.168058+0000","last_unstale":"2024-09-10T23:22:13.176120+0000","last_undegraded":"2024-09-10T23:22:13.176120+0000","last_fullsized":"2024-09-10T23:22:13.176120+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:23.632875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.149916+0000","last_change":"2024-09-10T23:22:12.156473+0000","last_active":"2024-09-10T23:22:13.149916+0000","last_peered":"2024-09-10T23:22:13.149916+0000","last_clean":"2024-09-10T23:22:13.149916+0000","last_became_active":"2024-09-10T23:22:12.156197+0000","last_became_peered":"2024-09-10T23:22:12.156197+0000","last_unstale":"2024-09-10T23:22:13.149916+0000","last_undegraded":"2024-09-10T23:22:13.149916+0000","last_fullsized":"2024-09-10T23:22:13.149916+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:06.543541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173513+0000","last_change":"2024-09-10T23:22:13.172194+0000","last_active":"2024-09-10T23:22:14.173513+0000","last_peered":"2024-09-10T23:22:14.173513+0000","last_clean":"2024-09-10T23:22:14.173513+0000","last_became_active":"2024-09-10T23:22:13.171927+0000","last_became_peered":"2024-09-10T23:22:13.171927+0000","last_unstale":"2024-09-10T23:22:14.173513+0000","last_undegraded":"2024-09-10T23:22:14.173513+0000","last_fullsized":"2024-09-10T23:22:14.173513+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:10.076386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171453+0000","last_change":"2024-09-10T23:22:12.165788+0000","last_active":"2024-09-10T23:22:14.171453+0000","last_peered":"2024-09-10T23:22:14.171453+0000","last_clean":"2024-09-10T23:22:14.171453+0000","last_became_active":"2024-09-10T23:22:12.165403+0000","last_became_peered":"2024-09-10T23:22:12.165403+0000","last_unstale":"2024-09-10T23:22:14.171453+0000","last_undegraded":"2024-09-10T23:22:14.171453+0000","last_fullsized":"2024-09-10T23:22:14.171453+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:55.448154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164633+0000","last_change":"2024-09-10T23:22:13.177426+0000","last_active":"2024-09-10T23:22:14.164633+0000","last_peered":"2024-09-10T23:22:14.164633+0000","last_clean":"2024-09-10T23:22:14.164633+0000","last_became_active":"2024-09-10T23:22:13.177124+0000","last_became_peered":"2024-09-10T23:22:13.177124+0000","last_unstale":"2024-09-10T23:22:14.164633+0000","last_undegraded":"2024-09-10T23:22:14.164633+0000","last_fullsized":"2024-09-10T23:22:14.164633+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:42.876233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173740+0000","last_change":"2024-09-10T23:22:12.164012+0000","last_active":"2024-09-10T23:22:14.173740+0000","last_peered":"2024-09-10T23:22:14.173740+0000","last_clean":"2024-09-10T23:22:14.173740+0000","last_became_active":"2024-09-10T23:22:12.163710+0000","last_became_peered":"2024-09-10T23:22:12.163710+0000","last_unstale":"2024-09-10T23:22:14.173740+0000","last_undegraded":"2024-09-10T23:22:14.173740+0000","last_fullsized":"2024-09-10T23:22:14.173740+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:48.633338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612813+0000","last_change":"2024-09-10T23:22:13.175514+0000","last_active":"2024-09-10T23:22:14.612813+0000","last_peered":"2024-09-10T23:22:14.612813+0000","last_clean":"2024-09-10T23:22:14.612813+0000","last_became_active":"2024-09-10T23:22:13.175169+0000","last_became_peered":"2024-09-10T23:22:13.175169+0000","last_unstale":"2024-09-10T23:22:14.612813+0000","last_undegraded":"2024-09-10T23:22:14.612813+0000","last_fullsized":"2024-09-10T23:22:14.612813+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:35.400303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"117'3","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615438+0000","last_change":"2024-09-10T23:22:12.166006+0000","last_active":"2024-09-10T23:22:14.615438+0000","last_peered":"2024-09-10T23:22:14.615438+0000","last_clean":"2024-09-10T23:22:14.615438+0000","last_became_active":"2024-09-10T23:22:12.165668+0000","last_became_peered":"2024-09-10T23:22:12.165668+0000","last_unstale":"2024-09-10T23:22:14.615438+0000","last_undegraded":"2024-09-10T23:22:14.615438+0000","last_fullsized":"2024-09-10T23:22:14.615438+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:04.670440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165159+0000","last_change":"2024-09-10T23:22:13.177815+0000","last_active":"2024-09-10T23:22:14.165159+0000","last_peered":"2024-09-10T23:22:14.165159+0000","last_clean":"2024-09-10T23:22:14.165159+0000","last_became_active":"2024-09-10T23:22:13.177530+0000","last_became_peered":"2024-09-10T23:22:13.177530+0000","last_unstale":"2024-09-10T23:22:14.165159+0000","last_undegraded":"2024-09-10T23:22:14.165159+0000","last_fullsized":"2024-09-10T23:22:14.165159+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:01.483411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"117'6","reported_seq":21,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616114+0000","last_change":"2024-09-10T23:22:12.169200+0000","last_active":"2024-09-10T23:22:14.616114+0000","last_peered":"2024-09-10T23:22:14.616114+0000","last_clean":"2024-09-10T23:22:14.616114+0000","last_became_active":"2024-09-10T23:22:12.168185+0000","last_became_peered":"2024-09-10T23:22:12.168185+0000","last_unstale":"2024-09-10T23:22:14.616114+0000","last_undegraded":"2024-09-10T23:22:14.616114+0000","last_fullsized":"2024-09-10T23:22:14.616114+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:34.755034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179073+0000","last_change":"2024-09-10T23:22:13.168987+0000","last_active":"2024-09-10T23:22:14.179073+0000","last_peered":"2024-09-10T23:22:14.179073+0000","last_clean":"2024-09-10T23:22:14.179073+0000","last_became_active":"2024-09-10T23:22:13.168723+0000","last_became_peered":"2024-09-10T23:22:13.168723+0000","last_unstale":"2024-09-10T23:22:14.179073+0000","last_undegraded":"2024-09-10T23:22:14.179073+0000","last_fullsized":"2024-09-10T23:22:14.179073+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:42.594171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165208+0000","last_change":"2024-09-10T23:22:12.165712+0000","last_active":"2024-09-10T23:22:14.165208+0000","last_peered":"2024-09-10T23:22:14.165208+0000","last_clean":"2024-09-10T23:22:14.165208+0000","last_became_active":"2024-09-10T23:22:12.165048+0000","last_became_peered":"2024-09-10T23:22:12.165048+0000","last_unstale":"2024-09-10T23:22:14.165208+0000","last_undegraded":"2024-09-10T23:22:14.165208+0000","last_fullsized":"2024-09-10T23:22:14.165208+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:06.775392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616409+0000","last_change":"2024-09-10T23:22:13.167533+0000","last_active":"2024-09-10T23:22:14.616409+0000","last_peered":"2024-09-10T23:22:14.616409+0000","last_clean":"2024-09-10T23:22:14.616409+0000","last_became_active":"2024-09-10T23:22:13.167271+0000","last_became_peered":"2024-09-10T23:22:13.167271+0000","last_unstale":"2024-09-10T23:22:14.616409+0000","last_undegraded":"2024-09-10T23:22:14.616409+0000","last_fullsized":"2024-09-10T23:22:14.616409+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:31.243940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.150997+0000","last_change":"2024-09-10T23:22:12.154958+0000","last_active":"2024-09-10T23:22:13.150997+0000","last_peered":"2024-09-10T23:22:13.150997+0000","last_clean":"2024-09-10T23:22:13.150997+0000","last_became_active":"2024-09-10T23:22:12.154085+0000","last_became_peered":"2024-09-10T23:22:12.154085+0000","last_unstale":"2024-09-10T23:22:13.150997+0000","last_undegraded":"2024-09-10T23:22:13.150997+0000","last_fullsized":"2024-09-10T23:22:13.150997+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:43.358781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613171+0000","last_change":"2024-09-10T23:22:13.168741+0000","last_active":"2024-09-10T23:22:14.613171+0000","last_peered":"2024-09-10T23:22:14.613171+0000","last_clean":"2024-09-10T23:22:14.613171+0000","last_became_active":"2024-09-10T23:22:13.168423+0000","last_became_peered":"2024-09-10T23:22:13.168423+0000","last_unstale":"2024-09-10T23:22:14.613171+0000","last_undegraded":"2024-09-10T23:22:14.613171+0000","last_fullsized":"2024-09-10T23:22:14.613171+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:15.361197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612781+0000","last_change":"2024-09-10T23:22:12.164458+0000","last_active":"2024-09-10T23:22:14.612781+0000","last_peered":"2024-09-10T23:22:14.612781+0000","last_clean":"2024-09-10T23:22:14.612781+0000","last_became_active":"2024-09-10T23:22:12.161883+0000","last_became_peered":"2024-09-10T23:22:12.161883+0000","last_unstale":"2024-09-10T23:22:14.612781+0000","last_undegraded":"2024-09-10T23:22:14.612781+0000","last_fullsized":"2024-09-10T23:22:14.612781+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:16.943245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173961+0000","last_change":"2024-09-10T23:22:13.165825+0000","last_active":"2024-09-10T23:22:14.173961+0000","last_peered":"2024-09-10T23:22:14.173961+0000","last_clean":"2024-09-10T23:22:14.173961+0000","last_became_active":"2024-09-10T23:22:13.165446+0000","last_became_peered":"2024-09-10T23:22:13.165446+0000","last_unstale":"2024-09-10T23:22:14.173961+0000","last_undegraded":"2024-09-10T23:22:14.173961+0000","last_fullsized":"2024-09-10T23:22:14.173961+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:04.173691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"117'8","reported_seq":23,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.170779+0000","last_change":"2024-09-10T23:22:12.164271+0000","last_active":"2024-09-10T23:22:14.170779+0000","last_peered":"2024-09-10T23:22:14.170779+0000","last_clean":"2024-09-10T23:22:14.170779+0000","last_became_active":"2024-09-10T23:22:12.163974+0000","last_became_peered":"2024-09-10T23:22:12.163974+0000","last_unstale":"2024-09-10T23:22:14.170779+0000","last_undegraded":"2024-09-10T23:22:14.170779+0000","last_fullsized":"2024-09-10T23:22:14.170779+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:36.386996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612978+0000","last_change":"2024-09-10T23:22:13.166593+0000","last_active":"2024-09-10T23:22:14.612978+0000","last_peered":"2024-09-10T23:22:14.612978+0000","last_clean":"2024-09-10T23:22:14.612978+0000","last_became_active":"2024-09-10T23:22:13.166281+0000","last_became_peered":"2024-09-10T23:22:13.166281+0000","last_unstale":"2024-09-10T23:22:14.612978+0000","last_undegraded":"2024-09-10T23:22:14.612978+0000","last_fullsized":"2024-09-10T23:22:14.612978+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:32.278115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616410+0000","last_change":"2024-09-10T23:22:12.165289+0000","last_active":"2024-09-10T23:22:14.616410+0000","last_peered":"2024-09-10T23:22:14.616410+0000","last_clean":"2024-09-10T23:22:14.616410+0000","last_became_active":"2024-09-10T23:22:12.164814+0000","last_became_peered":"2024-09-10T23:22:12.164814+0000","last_unstale":"2024-09-10T23:22:14.616410+0000","last_undegraded":"2024-09-10T23:22:14.616410+0000","last_fullsized":"2024-09-10T23:22:14.616410+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:09.290150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616034+0000","last_change":"2024-09-10T23:22:13.170458+0000","last_active":"2024-09-10T23:22:14.616034+0000","last_peered":"2024-09-10T23:22:14.616034+0000","last_clean":"2024-09-10T23:22:14.616034+0000","last_became_active":"2024-09-10T23:22:13.170155+0000","last_became_peered":"2024-09-10T23:22:13.170155+0000","last_unstale":"2024-09-10T23:22:14.616034+0000","last_undegraded":"2024-09-10T23:22:14.616034+0000","last_fullsized":"2024-09-10T23:22:14.616034+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:34.058147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615475+0000","last_change":"2024-09-10T23:22:12.162575+0000","last_active":"2024-09-10T23:22:14.615475+0000","last_peered":"2024-09-10T23:22:14.615475+0000","last_clean":"2024-09-10T23:22:14.615475+0000","last_became_active":"2024-09-10T23:22:12.162283+0000","last_became_peered":"2024-09-10T23:22:12.162283+0000","last_unstale":"2024-09-10T23:22:14.615475+0000","last_undegraded":"2024-09-10T23:22:14.615475+0000","last_fullsized":"2024-09-10T23:22:14.615475+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:16.277920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165050+0000","last_change":"2024-09-10T23:22:13.159144+0000","last_active":"2024-09-10T23:22:14.165050+0000","last_peered":"2024-09-10T23:22:14.165050+0000","last_clean":"2024-09-10T23:22:14.165050+0000","last_became_active":"2024-09-10T23:22:13.158845+0000","last_became_peered":"2024-09-10T23:22:13.158845+0000","last_unstale":"2024-09-10T23:22:14.165050+0000","last_undegraded":"2024-09-10T23:22:14.165050+0000","last_fullsized":"2024-09-10T23:22:14.165050+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:12.161685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.178939+0000","last_change":"2024-09-10T23:22:12.167706+0000","last_active":"2024-09-10T23:22:14.178939+0000","last_peered":"2024-09-10T23:22:14.178939+0000","last_clean":"2024-09-10T23:22:14.178939+0000","last_became_active":"2024-09-10T23:22:12.167294+0000","last_became_peered":"2024-09-10T23:22:12.167294+0000","last_unstale":"2024-09-10T23:22:14.178939+0000","last_undegraded":"2024-09-10T23:22:14.178939+0000","last_fullsized":"2024-09-10T23:22:14.178939+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:00.916270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173612+0000","last_change":"2024-09-10T23:22:13.161857+0000","last_active":"2024-09-10T23:22:14.173612+0000","last_peered":"2024-09-10T23:22:14.173612+0000","last_clean":"2024-09-10T23:22:14.173612+0000","last_became_active":"2024-09-10T23:22:13.161541+0000","last_became_peered":"2024-09-10T23:22:13.161541+0000","last_unstale":"2024-09-10T23:22:14.173612+0000","last_undegraded":"2024-09-10T23:22:14.173612+0000","last_fullsized":"2024-09-10T23:22:14.173612+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:50.702819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613406+0000","last_change":"2024-09-10T23:22:12.167607+0000","last_active":"2024-09-10T23:22:14.613406+0000","last_peered":"2024-09-10T23:22:14.613406+0000","last_clean":"2024-09-10T23:22:14.613406+0000","last_became_active":"2024-09-10T23:22:12.167302+0000","last_became_peered":"2024-09-10T23:22:12.167302+0000","last_unstale":"2024-09-10T23:22:14.613406+0000","last_undegraded":"2024-09-10T23:22:14.613406+0000","last_fullsized":"2024-09-10T23:22:14.613406+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:00.770714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.174335+0000","last_change":"2024-09-10T23:22:13.163704+0000","last_active":"2024-09-10T23:22:14.174335+0000","last_peered":"2024-09-10T23:22:14.174335+0000","last_clean":"2024-09-10T23:22:14.174335+0000","last_became_active":"2024-09-10T23:22:13.163341+0000","last_became_peered":"2024-09-10T23:22:13.163341+0000","last_unstale":"2024-09-10T23:22:14.174335+0000","last_undegraded":"2024-09-10T23:22:14.174335+0000","last_fullsized":"2024-09-10T23:22:14.174335+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:33.145699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612701+0000","last_change":"2024-09-10T23:22:12.162911+0000","last_active":"2024-09-10T23:22:14.612701+0000","last_peered":"2024-09-10T23:22:14.612701+0000","last_clean":"2024-09-10T23:22:14.612701+0000","last_became_active":"2024-09-10T23:22:12.162629+0000","last_became_peered":"2024-09-10T23:22:12.162629+0000","last_unstale":"2024-09-10T23:22:14.612701+0000","last_undegraded":"2024-09-10T23:22:14.612701+0000","last_fullsized":"2024-09-10T23:22:14.612701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:45.604302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.179528+0000","last_change":"2024-09-10T23:22:13.171536+0000","last_active":"2024-09-10T23:22:13.179528+0000","last_peered":"2024-09-10T23:22:13.179528+0000","last_clean":"2024-09-10T23:22:13.179528+0000","last_became_active":"2024-09-10T23:22:13.171274+0000","last_became_peered":"2024-09-10T23:22:13.171274+0000","last_unstale":"2024-09-10T23:22:13.179528+0000","last_undegraded":"2024-09-10T23:22:13.179528+0000","last_fullsized":"2024-09-10T23:22:13.179528+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:27.120739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615625+0000","last_change":"2024-09-10T23:22:12.159424+0000","last_active":"2024-09-10T23:22:14.615625+0000","last_peered":"2024-09-10T23:22:14.615625+0000","last_clean":"2024-09-10T23:22:14.615625+0000","last_became_active":"2024-09-10T23:22:12.159109+0000","last_became_peered":"2024-09-10T23:22:12.159109+0000","last_unstale":"2024-09-10T23:22:14.615625+0000","last_undegraded":"2024-09-10T23:22:14.615625+0000","last_fullsized":"2024-09-10T23:22:14.615625+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:18.545402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613198+0000","last_change":"2024-09-10T23:22:13.172387+0000","last_active":"2024-09-10T23:22:14.613198+0000","last_peered":"2024-09-10T23:22:14.613198+0000","last_clean":"2024-09-10T23:22:14.613198+0000","last_became_active":"2024-09-10T23:22:13.172070+0000","last_became_peered":"2024-09-10T23:22:13.172070+0000","last_unstale":"2024-09-10T23:22:14.613198+0000","last_undegraded":"2024-09-10T23:22:14.613198+0000","last_fullsized":"2024-09-10T23:22:14.613198+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:30.984786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613152+0000","last_change":"2024-09-10T23:22:12.163302+0000","last_active":"2024-09-10T23:22:14.613152+0000","last_peered":"2024-09-10T23:22:14.613152+0000","last_clean":"2024-09-10T23:22:14.613152+0000","last_became_active":"2024-09-10T23:22:12.162605+0000","last_became_peered":"2024-09-10T23:22:12.162605+0000","last_unstale":"2024-09-10T23:22:14.613152+0000","last_undegraded":"2024-09-10T23:22:14.613152+0000","last_fullsized":"2024-09-10T23:22:14.613152+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:09.767603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173522+0000","last_change":"2024-09-10T23:22:13.161911+0000","last_active":"2024-09-10T23:22:14.173522+0000","last_peered":"2024-09-10T23:22:14.173522+0000","last_clean":"2024-09-10T23:22:14.173522+0000","last_became_active":"2024-09-10T23:22:13.161647+0000","last_became_peered":"2024-09-10T23:22:13.161647+0000","last_unstale":"2024-09-10T23:22:14.173522+0000","last_undegraded":"2024-09-10T23:22:14.173522+0000","last_fullsized":"2024-09-10T23:22:14.173522+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:23.060566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164990+0000","last_change":"2024-09-10T23:22:12.163925+0000","last_active":"2024-09-10T23:22:14.164990+0000","last_peered":"2024-09-10T23:22:14.164990+0000","last_clean":"2024-09-10T23:22:14.164990+0000","last_became_active":"2024-09-10T23:22:12.163669+0000","last_became_peered":"2024-09-10T23:22:12.163669+0000","last_unstale":"2024-09-10T23:22:14.164990+0000","last_undegraded":"2024-09-10T23:22:14.164990+0000","last_fullsized":"2024-09-10T23:22:14.164990+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:30.721424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171622+0000","last_change":"2024-09-10T23:22:13.158681+0000","last_active":"2024-09-10T23:22:14.171622+0000","last_peered":"2024-09-10T23:22:14.171622+0000","last_clean":"2024-09-10T23:22:14.171622+0000","last_became_active":"2024-09-10T23:22:13.158425+0000","last_became_peered":"2024-09-10T23:22:13.158425+0000","last_unstale":"2024-09-10T23:22:14.171622+0000","last_undegraded":"2024-09-10T23:22:14.171622+0000","last_fullsized":"2024-09-10T23:22:14.171622+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:49.494993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"118'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.175357+0000","last_change":"2024-09-10T23:22:12.165433+0000","last_active":"2024-09-10T23:22:14.175357+0000","last_peered":"2024-09-10T23:22:14.175357+0000","last_clean":"2024-09-10T23:22:14.175357+0000","last_became_active":"2024-09-10T23:22:12.164486+0000","last_became_peered":"2024-09-10T23:22:12.164486+0000","last_unstale":"2024-09-10T23:22:14.175357+0000","last_undegraded":"2024-09-10T23:22:14.175357+0000","last_fullsized":"2024-09-10T23:22:14.175357+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:26.606067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.170598+0000","last_change":"2024-09-10T23:22:13.166408+0000","last_active":"2024-09-10T23:22:13.170598+0000","last_peered":"2024-09-10T23:22:13.170598+0000","last_clean":"2024-09-10T23:22:13.170598+0000","last_became_active":"2024-09-10T23:22:13.166073+0000","last_became_peered":"2024-09-10T23:22:13.166073+0000","last_unstale":"2024-09-10T23:22:13.170598+0000","last_undegraded":"2024-09-10T23:22:13.170598+0000","last_fullsized":"2024-09-10T23:22:13.170598+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:18.648521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616227+0000","last_change":"2024-09-10T23:22:12.169927+0000","last_active":"2024-09-10T23:22:14.616227+0000","last_peered":"2024-09-10T23:22:14.616227+0000","last_clean":"2024-09-10T23:22:14.616227+0000","last_became_active":"2024-09-10T23:22:12.169621+0000","last_became_peered":"2024-09-10T23:22:12.169621+0000","last_unstale":"2024-09-10T23:22:14.616227+0000","last_undegraded":"2024-09-10T23:22:14.616227+0000","last_fullsized":"2024-09-10T23:22:14.616227+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:00.886109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179231+0000","last_change":"2024-09-10T23:22:13.175405+0000","last_active":"2024-09-10T23:22:14.179231+0000","last_peered":"2024-09-10T23:22:14.179231+0000","last_clean":"2024-09-10T23:22:14.179231+0000","last_became_active":"2024-09-10T23:22:13.175024+0000","last_became_peered":"2024-09-10T23:22:13.175024+0000","last_unstale":"2024-09-10T23:22:14.179231+0000","last_undegraded":"2024-09-10T23:22:14.179231+0000","last_fullsized":"2024-09-10T23:22:14.179231+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:40.894742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164943+0000","last_change":"2024-09-10T23:22:12.159734+0000","last_active":"2024-09-10T23:22:14.164943+0000","last_peered":"2024-09-10T23:22:14.164943+0000","last_clean":"2024-09-10T23:22:14.164943+0000","last_became_active":"2024-09-10T23:22:12.159462+0000","last_became_peered":"2024-09-10T23:22:12.159462+0000","last_unstale":"2024-09-10T23:22:14.164943+0000","last_undegraded":"2024-09-10T23:22:14.164943+0000","last_fullsized":"2024-09-10T23:22:14.164943+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:38.989930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613263+0000","last_change":"2024-09-10T23:22:13.169318+0000","last_active":"2024-09-10T23:22:14.613263+0000","last_peered":"2024-09-10T23:22:14.613263+0000","last_clean":"2024-09-10T23:22:14.613263+0000","last_became_active":"2024-09-10T23:22:13.168958+0000","last_became_peered":"2024-09-10T23:22:13.168958+0000","last_unstale":"2024-09-10T23:22:14.613263+0000","last_undegraded":"2024-09-10T23:22:14.613263+0000","last_fullsized":"2024-09-10T23:22:14.613263+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:09.270900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.170978+0000","last_change":"2024-09-10T23:22:12.160071+0000","last_active":"2024-09-10T23:22:14.170978+0000","last_peered":"2024-09-10T23:22:14.170978+0000","last_clean":"2024-09-10T23:22:14.170978+0000","last_became_active":"2024-09-10T23:22:12.159627+0000","last_became_peered":"2024-09-10T23:22:12.159627+0000","last_unstale":"2024-09-10T23:22:14.170978+0000","last_undegraded":"2024-09-10T23:22:14.170978+0000","last_fullsized":"2024-09-10T23:22:14.170978+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:42.477078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613253+0000","last_change":"2024-09-10T23:22:13.172239+0000","last_active":"2024-09-10T23:22:14.613253+0000","last_peered":"2024-09-10T23:22:14.613253+0000","last_clean":"2024-09-10T23:22:14.613253+0000","last_became_active":"2024-09-10T23:22:13.171942+0000","last_became_peered":"2024-09-10T23:22:13.171942+0000","last_unstale":"2024-09-10T23:22:14.613253+0000","last_undegraded":"2024-09-10T23:22:14.613253+0000","last_fullsized":"2024-09-10T23:22:14.613253+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:17.800305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612933+0000","last_change":"2024-09-10T23:22:12.164893+0000","last_active":"2024-09-10T23:22:14.612933+0000","last_peered":"2024-09-10T23:22:14.612933+0000","last_clean":"2024-09-10T23:22:14.612933+0000","last_became_active":"2024-09-10T23:22:12.164574+0000","last_became_peered":"2024-09-10T23:22:12.164574+0000","last_unstale":"2024-09-10T23:22:14.612933+0000","last_undegraded":"2024-09-10T23:22:14.612933+0000","last_fullsized":"2024-09-10T23:22:14.612933+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:56.230351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615687+0000","last_change":"2024-09-10T23:22:13.172706+0000","last_active":"2024-09-10T23:22:14.615687+0000","last_peered":"2024-09-10T23:22:14.615687+0000","last_clean":"2024-09-10T23:22:14.615687+0000","last_became_active":"2024-09-10T23:22:13.172331+0000","last_became_peered":"2024-09-10T23:22:13.172331+0000","last_unstale":"2024-09-10T23:22:14.615687+0000","last_undegraded":"2024-09-10T23:22:14.615687+0000","last_fullsized":"2024-09-10T23:22:14.615687+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:59.436890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615757+0000","last_change":"2024-09-10T23:22:12.167200+0000","last_active":"2024-09-10T23:22:14.615757+0000","last_peered":"2024-09-10T23:22:14.615757+0000","last_clean":"2024-09-10T23:22:14.615757+0000","last_became_active":"2024-09-10T23:22:12.166866+0000","last_became_peered":"2024-09-10T23:22:12.166866+0000","last_unstale":"2024-09-10T23:22:14.615757+0000","last_undegraded":"2024-09-10T23:22:14.615757+0000","last_fullsized":"2024-09-10T23:22:14.615757+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:34.650796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179464+0000","last_change":"2024-09-10T23:22:13.168017+0000","last_active":"2024-09-10T23:22:14.179464+0000","last_peered":"2024-09-10T23:22:14.179464+0000","last_clean":"2024-09-10T23:22:14.179464+0000","last_became_active":"2024-09-10T23:22:13.166031+0000","last_became_peered":"2024-09-10T23:22:13.166031+0000","last_unstale":"2024-09-10T23:22:14.179464+0000","last_undegraded":"2024-09-10T23:22:14.179464+0000","last_fullsized":"2024-09-10T23:22:14.179464+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:12.327406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613201+0000","last_change":"2024-09-10T23:22:12.164199+0000","last_active":"2024-09-10T23:22:14.613201+0000","last_peered":"2024-09-10T23:22:14.613201+0000","last_clean":"2024-09-10T23:22:14.613201+0000","last_became_active":"2024-09-10T23:22:12.161913+0000","last_became_peered":"2024-09-10T23:22:12.161913+0000","last_unstale":"2024-09-10T23:22:14.613201+0000","last_undegraded":"2024-09-10T23:22:14.613201+0000","last_fullsized":"2024-09-10T23:22:14.613201+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:47.138913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.178778+0000","last_change":"2024-09-10T23:22:13.170009+0000","last_active":"2024-09-10T23:22:14.178778+0000","last_peered":"2024-09-10T23:22:14.178778+0000","last_clean":"2024-09-10T23:22:14.178778+0000","last_became_active":"2024-09-10T23:22:13.169690+0000","last_became_peered":"2024-09-10T23:22:13.169690+0000","last_unstale":"2024-09-10T23:22:14.178778+0000","last_undegraded":"2024-09-10T23:22:14.178778+0000","last_fullsized":"2024-09-10T23:22:14.178778+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:17.284833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613435+0000","last_change":"2024-09-10T23:22:12.167895+0000","last_active":"2024-09-10T23:22:14.613435+0000","last_peered":"2024-09-10T23:22:14.613435+0000","last_clean":"2024-09-10T23:22:14.613435+0000","last_became_active":"2024-09-10T23:22:12.167173+0000","last_became_peered":"2024-09-10T23:22:12.167173+0000","last_unstale":"2024-09-10T23:22:14.613435+0000","last_undegraded":"2024-09-10T23:22:14.613435+0000","last_fullsized":"2024-09-10T23:22:14.613435+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:40.074982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":280,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.614921+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:22:14.614921+0000","last_peered":"2024-09-10T23:22:14.614921+0000","last_clean":"2024-09-10T23:22:14.614921+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:22:14.614921+0000","last_undegraded":"2024-09-10T23:22:14.614921+0000","last_fullsized":"2024-09-10T23:22:14.614921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476821,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28476,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343364,"statfs":{"total":96636764160,"available":96607604736,"internally_reserved":0,"allocated":1474560,"data_stored":682449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509526,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51232,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320608,"statfs":{"total":96636764160,"available":96584302592,"internally_reserved":0,"allocated":2043904,"data_stored":1264069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40932,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330908,"statfs":{"total":96636764160,"available":96594849792,"internally_reserved":0,"allocated":1454080,"data_stored":680233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509526,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50664,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321176,"statfs":{"total":96636764160,"available":96584884224,"internally_reserved":0,"allocated":1462272,"data_stored":680325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28444,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343396,"statfs":{"total":96636764160,"available":96607637504,"internally_reserved":0,"allocated":1445888,"data_stored":673575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40936,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330904,"statfs":{"total":96636764160,"available":96594845696,"internally_reserved":0,"allocated":1458176,"data_stored":680267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55420,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316420,"statfs":{"total":96636764160,"available":96580014080,"internally_reserved":0,"allocated":2064384,"data_stored":1272303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50636,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321204,"statfs":{"total":96636764160,"available":96584912896,"internally_reserved":0,"allocated":1429504,"data_stored":666374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:22:17.320 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:22:17.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 -- 172.21.15.17:0/38884714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f6c0cf230 msgr2=0x7f7f6c06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 --2- 172.21.15.17:0/38884714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f6c0cf230 0x7f7f6c06e750 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0cc5a0 tx=0x7f7f6001f0b0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 -- 172.21.15.17:0/38884714 shutdown_connections 2024-09-10T23:22:17.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 --2- 172.21.15.17:0/38884714 >> v2:172.21.15.77:3300/0 conn(0x7f7f6c0cf610 0x7f7f6c15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 --2- 172.21.15.17:0/38884714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f6c0cf230 0x7f7f6c06e750 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 -- 172.21.15.17:0/38884714 >> 172.21.15.17:0/38884714 conn(0x7f7f6c06cfc0 msgr2=0x7f7f6c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:17.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 -- 172.21.15.17:0/38884714 shutdown_connections 2024-09-10T23:22:17.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 -- 172.21.15.17:0/38884714 wait complete. 2024-09-10T23:22:17.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 Processor -- start 2024-09-10T23:22:17.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.504+0000 7f7f74000640 1 -- start start 2024-09-10T23:22:17.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f74000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0b32d0 0x7f7f6c14b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f74000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f6c0cf230 0x7f7f6c138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f74000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f6c0cf610 0x7f7f6c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f74000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0d0330 con 0x7f7f6c0cf610 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f74000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c0d01b0 con 0x7f7f6c0b32d0 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f74000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6c0d04b0 con 0x7f7f6c0cf230 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f72000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f6c0cf610 0x7f7f6c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f71600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0b32d0 0x7f7f6c14b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f71600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0b32d0 0x7f7f6c14b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:39580/0 (socket says 172.21.15.17:39580) 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f71600640 1 -- 172.21.15.17:0/1566306322 learned_addr learned my addr 172.21.15.17:0/1566306322 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f70c00640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f6c0cf230 0x7f7f6c138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f72000640 1 -- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f6c0cf230 msgr2=0x7f7f6c138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f72000640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f6c0cf230 0x7f7f6c138430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f72000640 1 -- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0b32d0 msgr2=0x7f7f6c14b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f72000640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0b32d0 0x7f7f6c14b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f72000640 1 -- 172.21.15.17:0/1566306322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c1f8030 con 0x7f7f6c0cf610 2024-09-10T23:22:17.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f72000640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f6c0cf610 0x7f7f6c153a80 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400c730 tx=0x7f7f6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:17.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f69600640 1 -- 172.21.15.17:0/1566306322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64003b80 con 0x7f7f6c0cf610 2024-09-10T23:22:17.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f69600640 1 -- 172.21.15.17:0/1566306322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f64003d20 con 0x7f7f6c0cf610 2024-09-10T23:22:17.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f69600640 1 -- 172.21.15.17:0/1566306322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64005330 con 0x7f7f6c0cf610 2024-09-10T23:22:17.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c1f8310 con 0x7f7f6c0cf610 2024-09-10T23:22:17.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1f88d0 con 0x7f7f6c0cf610 2024-09-10T23:22:17.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f6c06e750 con 0x7f7f6c0cf610 2024-09-10T23:22:17.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.508+0000 7f7f69600640 1 -- 172.21.15.17:0/1566306322 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7f6400a640 con 0x7f7f6c0cf610 2024-09-10T23:22:17.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.512+0000 7f7f69600640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f4c072610 0x7f7f4c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.512+0000 7f7f69600640 1 -- 172.21.15.17:0/1566306322 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f7f640931e0 con 0x7f7f6c0cf610 2024-09-10T23:22:17.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.512+0000 7f7f71600640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f4c072610 0x7f7f4c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.512+0000 7f7f71600640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f4c072610 0x7f7f4c074ad0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7f600aafd0 tx=0x7f7f600aa040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:17.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.516+0000 7f7f69600640 1 -- 172.21.15.17:0/1566306322 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7f6405e0c0 con 0x7f7f6c0cf610 2024-09-10T23:22:17.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.684+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f6c073ef0 con 0x7f7f4c072610 2024-09-10T23:22:17.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.692+0000 7f7f69600640 1 -- 172.21.15.17:0/1566306322 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7f7f6c073ef0 con 0x7f7f4c072610 2024-09-10T23:22:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:17.696 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:22:17.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.692+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f4c072610 msgr2=0x7f7f4c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.692+0000 7f7f74000640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f4c072610 0x7f7f4c074ad0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7f600aafd0 tx=0x7f7f600aa040 comp rx=0 tx=0).stop 2024-09-10T23:22:17.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.692+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f6c0cf610 msgr2=0x7f7f6c153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.692+0000 7f7f74000640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f6c0cf610 0x7f7f6c153a80 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400c730 tx=0x7f7f6400cbf0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.696+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 shutdown_connections 2024-09-10T23:22:17.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.696+0000 7f7f74000640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f4c072610 0x7f7f4c074ad0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.696+0000 7f7f74000640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f6c0cf610 0x7f7f6c153a80 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.696+0000 7f7f74000640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f6c0cf230 0x7f7f6c138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.696+0000 7f7f74000640 1 --2- 172.21.15.17:0/1566306322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f6c0b32d0 0x7f7f6c14b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.696+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 >> 172.21.15.17:0/1566306322 conn(0x7f7f6c06cfc0 msgr2=0x7f7f6c151d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:17.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.696+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 shutdown_connections 2024-09-10T23:22:17.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.696+0000 7f7f74000640 1 -- 172.21.15.17:0/1566306322 wait complete. 2024-09-10T23:22:17.714 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-09-10T23:22:16.390161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346740,"kb_used_data":12532,"kb_used_omap":12,"kb_used_meta":334003,"kb_avail":754627980,"statfs":{"total":773094113280,"available":772739051520,"internally_reserved":0,"allocated":12832768,"data_stored":6599595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":342019633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.253607"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173843+0000","last_change":"2024-09-10T23:22:13.166522+0000","last_active":"2024-09-10T23:22:14.173843+0000","last_peered":"2024-09-10T23:22:14.173843+0000","last_clean":"2024-09-10T23:22:14.173843+0000","last_became_active":"2024-09-10T23:22:13.166241+0000","last_became_peered":"2024-09-10T23:22:13.166241+0000","last_unstale":"2024-09-10T23:22:14.173843+0000","last_undegraded":"2024-09-10T23:22:14.173843+0000","last_fullsized":"2024-09-10T23:22:14.173843+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.568864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616565+0000","last_change":"2024-09-10T23:22:13.166964+0000","last_active":"2024-09-10T23:22:14.616565+0000","last_peered":"2024-09-10T23:22:14.616565+0000","last_clean":"2024-09-10T23:22:14.616565+0000","last_became_active":"2024-09-10T23:22:13.166260+0000","last_became_peered":"2024-09-10T23:22:13.166260+0000","last_unstale":"2024-09-10T23:22:14.616565+0000","last_undegraded":"2024-09-10T23:22:14.616565+0000","last_fullsized":"2024-09-10T23:22:14.616565+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:52.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173819+0000","last_change":"2024-09-10T23:22:13.168074+0000","last_active":"2024-09-10T23:22:14.173819+0000","last_peered":"2024-09-10T23:22:14.173819+0000","last_clean":"2024-09-10T23:22:14.173819+0000","last_became_active":"2024-09-10T23:22:13.167787+0000","last_became_peered":"2024-09-10T23:22:13.167787+0000","last_unstale":"2024-09-10T23:22:14.173819+0000","last_undegraded":"2024-09-10T23:22:14.173819+0000","last_fullsized":"2024-09-10T23:22:14.173819+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:21.705358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.166704+0000","last_change":"2024-09-10T23:22:13.160680+0000","last_active":"2024-09-10T23:22:13.166704+0000","last_peered":"2024-09-10T23:22:13.166704+0000","last_clean":"2024-09-10T23:22:13.166704+0000","last_became_active":"2024-09-10T23:22:13.160382+0000","last_became_peered":"2024-09-10T23:22:13.160382+0000","last_unstale":"2024-09-10T23:22:13.166704+0000","last_undegraded":"2024-09-10T23:22:13.166704+0000","last_fullsized":"2024-09-10T23:22:13.166704+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:11.113997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165094+0000","last_change":"2024-09-10T23:22:13.154170+0000","last_active":"2024-09-10T23:22:14.165094+0000","last_peered":"2024-09-10T23:22:14.165094+0000","last_clean":"2024-09-10T23:22:14.165094+0000","last_became_active":"2024-09-10T23:22:13.153844+0000","last_became_peered":"2024-09-10T23:22:13.153844+0000","last_unstale":"2024-09-10T23:22:14.165094+0000","last_undegraded":"2024-09-10T23:22:14.165094+0000","last_fullsized":"2024-09-10T23:22:14.165094+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:53.652966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615995+0000","last_change":"2024-09-10T23:22:13.168685+0000","last_active":"2024-09-10T23:22:14.615995+0000","last_peered":"2024-09-10T23:22:14.615995+0000","last_clean":"2024-09-10T23:22:14.615995+0000","last_became_active":"2024-09-10T23:22:13.168403+0000","last_became_peered":"2024-09-10T23:22:13.168403+0000","last_unstale":"2024-09-10T23:22:14.615995+0000","last_undegraded":"2024-09-10T23:22:14.615995+0000","last_fullsized":"2024-09-10T23:22:14.615995+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:50.295010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615563+0000","last_change":"2024-09-10T23:22:13.170755+0000","last_active":"2024-09-10T23:22:14.615563+0000","last_peered":"2024-09-10T23:22:14.615563+0000","last_clean":"2024-09-10T23:22:14.615563+0000","last_became_active":"2024-09-10T23:22:13.169968+0000","last_became_peered":"2024-09-10T23:22:13.169968+0000","last_unstale":"2024-09-10T23:22:14.615563+0000","last_undegraded":"2024-09-10T23:22:14.615563+0000","last_fullsized":"2024-09-10T23:22:14.615563+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:01.923183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612699+0000","last_change":"2024-09-10T23:22:13.172326+0000","last_active":"2024-09-10T23:22:14.612699+0000","last_peered":"2024-09-10T23:22:14.612699+0000","last_clean":"2024-09-10T23:22:14.612699+0000","last_became_active":"2024-09-10T23:22:13.172033+0000","last_became_peered":"2024-09-10T23:22:13.172033+0000","last_unstale":"2024-09-10T23:22:14.612699+0000","last_undegraded":"2024-09-10T23:22:14.612699+0000","last_fullsized":"2024-09-10T23:22:14.612699+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:42.117722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616494+0000","last_change":"2024-09-10T23:22:13.174879+0000","last_active":"2024-09-10T23:22:14.616494+0000","last_peered":"2024-09-10T23:22:14.616494+0000","last_clean":"2024-09-10T23:22:14.616494+0000","last_became_active":"2024-09-10T23:22:13.174391+0000","last_became_peered":"2024-09-10T23:22:13.174391+0000","last_unstale":"2024-09-10T23:22:14.616494+0000","last_undegraded":"2024-09-10T23:22:14.616494+0000","last_fullsized":"2024-09-10T23:22:14.616494+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:21.191486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165084+0000","last_change":"2024-09-10T23:22:13.167704+0000","last_active":"2024-09-10T23:22:14.165084+0000","last_peered":"2024-09-10T23:22:14.165084+0000","last_clean":"2024-09-10T23:22:14.165084+0000","last_became_active":"2024-09-10T23:22:13.167352+0000","last_became_peered":"2024-09-10T23:22:13.167352+0000","last_unstale":"2024-09-10T23:22:14.165084+0000","last_undegraded":"2024-09-10T23:22:14.165084+0000","last_fullsized":"2024-09-10T23:22:14.165084+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:48:03.380595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179007+0000","last_change":"2024-09-10T23:22:13.176607+0000","last_active":"2024-09-10T23:22:14.179007+0000","last_peered":"2024-09-10T23:22:14.179007+0000","last_clean":"2024-09-10T23:22:14.179007+0000","last_became_active":"2024-09-10T23:22:13.176282+0000","last_became_peered":"2024-09-10T23:22:13.176282+0000","last_unstale":"2024-09-10T23:22:14.179007+0000","last_undegraded":"2024-09-10T23:22:14.179007+0000","last_fullsized":"2024-09-10T23:22:14.179007+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:30.357815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171640+0000","last_change":"2024-09-10T23:22:13.158145+0000","last_active":"2024-09-10T23:22:14.171640+0000","last_peered":"2024-09-10T23:22:14.171640+0000","last_clean":"2024-09-10T23:22:14.171640+0000","last_became_active":"2024-09-10T23:22:13.157785+0000","last_became_peered":"2024-09-10T23:22:13.157785+0000","last_unstale":"2024-09-10T23:22:14.171640+0000","last_undegraded":"2024-09-10T23:22:14.171640+0000","last_fullsized":"2024-09-10T23:22:14.171640+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:06:30.279138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.179526+0000","last_change":"2024-09-10T23:22:13.171674+0000","last_active":"2024-09-10T23:22:13.179526+0000","last_peered":"2024-09-10T23:22:13.179526+0000","last_clean":"2024-09-10T23:22:13.179526+0000","last_became_active":"2024-09-10T23:22:13.170865+0000","last_became_peered":"2024-09-10T23:22:13.170865+0000","last_unstale":"2024-09-10T23:22:13.179526+0000","last_undegraded":"2024-09-10T23:22:13.179526+0000","last_fullsized":"2024-09-10T23:22:13.179526+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:37.209928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615184+0000","last_change":"2024-09-10T23:22:13.171711+0000","last_active":"2024-09-10T23:22:14.615184+0000","last_peered":"2024-09-10T23:22:14.615184+0000","last_clean":"2024-09-10T23:22:14.615184+0000","last_became_active":"2024-09-10T23:22:13.171439+0000","last_became_peered":"2024-09-10T23:22:13.171439+0000","last_unstale":"2024-09-10T23:22:14.615184+0000","last_undegraded":"2024-09-10T23:22:14.615184+0000","last_fullsized":"2024-09-10T23:22:14.615184+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:16.735527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615141+0000","last_change":"2024-09-10T23:22:13.167404+0000","last_active":"2024-09-10T23:22:14.615141+0000","last_peered":"2024-09-10T23:22:14.615141+0000","last_clean":"2024-09-10T23:22:14.615141+0000","last_became_active":"2024-09-10T23:22:13.167134+0000","last_became_peered":"2024-09-10T23:22:13.167134+0000","last_unstale":"2024-09-10T23:22:14.615141+0000","last_undegraded":"2024-09-10T23:22:14.615141+0000","last_fullsized":"2024-09-10T23:22:14.615141+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:40.894742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615140+0000","last_change":"2024-09-10T23:22:13.179513+0000","last_active":"2024-09-10T23:22:14.615140+0000","last_peered":"2024-09-10T23:22:14.615140+0000","last_clean":"2024-09-10T23:22:14.615140+0000","last_became_active":"2024-09-10T23:22:13.179223+0000","last_became_peered":"2024-09-10T23:22:13.179223+0000","last_unstale":"2024-09-10T23:22:14.615140+0000","last_undegraded":"2024-09-10T23:22:14.615140+0000","last_fullsized":"2024-09-10T23:22:14.615140+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:20:26.945862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173949+0000","last_change":"2024-09-10T23:22:13.171812+0000","last_active":"2024-09-10T23:22:14.173949+0000","last_peered":"2024-09-10T23:22:14.173949+0000","last_clean":"2024-09-10T23:22:14.173949+0000","last_became_active":"2024-09-10T23:22:13.171295+0000","last_became_peered":"2024-09-10T23:22:13.171295+0000","last_unstale":"2024-09-10T23:22:14.173949+0000","last_undegraded":"2024-09-10T23:22:14.173949+0000","last_fullsized":"2024-09-10T23:22:14.173949+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:18.456470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616559+0000","last_change":"2024-09-10T23:22:13.166676+0000","last_active":"2024-09-10T23:22:14.616559+0000","last_peered":"2024-09-10T23:22:14.616559+0000","last_clean":"2024-09-10T23:22:14.616559+0000","last_became_active":"2024-09-10T23:22:13.165883+0000","last_became_peered":"2024-09-10T23:22:13.165883+0000","last_unstale":"2024-09-10T23:22:14.616559+0000","last_undegraded":"2024-09-10T23:22:14.616559+0000","last_fullsized":"2024-09-10T23:22:14.616559+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:05.677353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.174119+0000","last_change":"2024-09-10T23:22:13.178574+0000","last_active":"2024-09-10T23:22:14.174119+0000","last_peered":"2024-09-10T23:22:14.174119+0000","last_clean":"2024-09-10T23:22:14.174119+0000","last_became_active":"2024-09-10T23:22:13.178262+0000","last_became_peered":"2024-09-10T23:22:13.178262+0000","last_unstale":"2024-09-10T23:22:14.174119+0000","last_undegraded":"2024-09-10T23:22:14.174119+0000","last_fullsized":"2024-09-10T23:22:14.174119+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:25.686057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171673+0000","last_change":"2024-09-10T23:22:13.161329+0000","last_active":"2024-09-10T23:22:14.171673+0000","last_peered":"2024-09-10T23:22:14.171673+0000","last_clean":"2024-09-10T23:22:14.171673+0000","last_became_active":"2024-09-10T23:22:13.161074+0000","last_became_peered":"2024-09-10T23:22:13.161074+0000","last_unstale":"2024-09-10T23:22:14.171673+0000","last_undegraded":"2024-09-10T23:22:14.171673+0000","last_fullsized":"2024-09-10T23:22:14.171673+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:42.594171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613220+0000","last_change":"2024-09-10T23:22:13.176754+0000","last_active":"2024-09-10T23:22:14.613220+0000","last_peered":"2024-09-10T23:22:14.613220+0000","last_clean":"2024-09-10T23:22:14.613220+0000","last_became_active":"2024-09-10T23:22:13.176423+0000","last_became_peered":"2024-09-10T23:22:13.176423+0000","last_unstale":"2024-09-10T23:22:14.613220+0000","last_undegraded":"2024-09-10T23:22:14.613220+0000","last_fullsized":"2024-09-10T23:22:14.613220+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:33.697801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164816+0000","last_change":"2024-09-10T23:22:13.171426+0000","last_active":"2024-09-10T23:22:14.164816+0000","last_peered":"2024-09-10T23:22:14.164816+0000","last_clean":"2024-09-10T23:22:14.164816+0000","last_became_active":"2024-09-10T23:22:13.170900+0000","last_became_peered":"2024-09-10T23:22:13.170900+0000","last_unstale":"2024-09-10T23:22:14.164816+0000","last_undegraded":"2024-09-10T23:22:14.164816+0000","last_fullsized":"2024-09-10T23:22:14.164816+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:10.533956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173594+0000","last_change":"2024-09-10T23:22:13.164395+0000","last_active":"2024-09-10T23:22:14.173594+0000","last_peered":"2024-09-10T23:22:14.173594+0000","last_clean":"2024-09-10T23:22:14.173594+0000","last_became_active":"2024-09-10T23:22:13.164087+0000","last_became_peered":"2024-09-10T23:22:13.164087+0000","last_unstale":"2024-09-10T23:22:14.173594+0000","last_undegraded":"2024-09-10T23:22:14.173594+0000","last_fullsized":"2024-09-10T23:22:14.173594+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:38.540028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164544+0000","last_change":"2024-09-10T23:22:13.159370+0000","last_active":"2024-09-10T23:22:14.164544+0000","last_peered":"2024-09-10T23:22:14.164544+0000","last_clean":"2024-09-10T23:22:14.164544+0000","last_became_active":"2024-09-10T23:22:13.159090+0000","last_became_peered":"2024-09-10T23:22:13.159090+0000","last_unstale":"2024-09-10T23:22:14.164544+0000","last_undegraded":"2024-09-10T23:22:14.164544+0000","last_fullsized":"2024-09-10T23:22:14.164544+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:31.673642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171251+0000","last_change":"2024-09-10T23:22:13.169361+0000","last_active":"2024-09-10T23:22:14.171251+0000","last_peered":"2024-09-10T23:22:14.171251+0000","last_clean":"2024-09-10T23:22:14.171251+0000","last_became_active":"2024-09-10T23:22:13.169090+0000","last_became_peered":"2024-09-10T23:22:13.169090+0000","last_unstale":"2024-09-10T23:22:14.171251+0000","last_undegraded":"2024-09-10T23:22:14.171251+0000","last_fullsized":"2024-09-10T23:22:14.171251+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:21.191486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171352+0000","last_change":"2024-09-10T23:22:13.169304+0000","last_active":"2024-09-10T23:22:14.171352+0000","last_peered":"2024-09-10T23:22:14.171352+0000","last_clean":"2024-09-10T23:22:14.171352+0000","last_became_active":"2024-09-10T23:22:13.169006+0000","last_became_peered":"2024-09-10T23:22:13.169006+0000","last_unstale":"2024-09-10T23:22:14.171352+0000","last_undegraded":"2024-09-10T23:22:14.171352+0000","last_fullsized":"2024-09-10T23:22:14.171352+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:52.024442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179071+0000","last_change":"2024-09-10T23:22:13.173437+0000","last_active":"2024-09-10T23:22:14.179071+0000","last_peered":"2024-09-10T23:22:14.179071+0000","last_clean":"2024-09-10T23:22:14.179071+0000","last_became_active":"2024-09-10T23:22:13.173160+0000","last_became_peered":"2024-09-10T23:22:13.173160+0000","last_unstale":"2024-09-10T23:22:14.179071+0000","last_undegraded":"2024-09-10T23:22:14.179071+0000","last_fullsized":"2024-09-10T23:22:14.179071+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:20.845445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616370+0000","last_change":"2024-09-10T23:22:13.175024+0000","last_active":"2024-09-10T23:22:14.616370+0000","last_peered":"2024-09-10T23:22:14.616370+0000","last_clean":"2024-09-10T23:22:14.616370+0000","last_became_active":"2024-09-10T23:22:13.173182+0000","last_became_peered":"2024-09-10T23:22:13.173182+0000","last_unstale":"2024-09-10T23:22:14.616370+0000","last_undegraded":"2024-09-10T23:22:14.616370+0000","last_fullsized":"2024-09-10T23:22:14.616370+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:27:10.325210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613358+0000","last_change":"2024-09-10T23:22:13.176968+0000","last_active":"2024-09-10T23:22:14.613358+0000","last_peered":"2024-09-10T23:22:14.613358+0000","last_clean":"2024-09-10T23:22:14.613358+0000","last_became_active":"2024-09-10T23:22:13.176692+0000","last_became_peered":"2024-09-10T23:22:13.176692+0000","last_unstale":"2024-09-10T23:22:14.613358+0000","last_undegraded":"2024-09-10T23:22:14.613358+0000","last_fullsized":"2024-09-10T23:22:14.613358+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:05.128194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171191+0000","last_change":"2024-09-10T23:22:13.176044+0000","last_active":"2024-09-10T23:22:14.171191+0000","last_peered":"2024-09-10T23:22:14.171191+0000","last_clean":"2024-09-10T23:22:14.171191+0000","last_became_active":"2024-09-10T23:22:13.175733+0000","last_became_peered":"2024-09-10T23:22:13.175733+0000","last_unstale":"2024-09-10T23:22:14.171191+0000","last_undegraded":"2024-09-10T23:22:14.171191+0000","last_fullsized":"2024-09-10T23:22:14.171191+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:31.243940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615676+0000","last_change":"2024-09-10T23:22:13.173787+0000","last_active":"2024-09-10T23:22:14.615676+0000","last_peered":"2024-09-10T23:22:14.615676+0000","last_clean":"2024-09-10T23:22:14.615676+0000","last_became_active":"2024-09-10T23:22:13.173417+0000","last_became_peered":"2024-09-10T23:22:13.173417+0000","last_unstale":"2024-09-10T23:22:14.615676+0000","last_undegraded":"2024-09-10T23:22:14.615676+0000","last_fullsized":"2024-09-10T23:22:14.615676+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:11.135522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612865+0000","last_change":"2024-09-10T23:22:13.175898+0000","last_active":"2024-09-10T23:22:14.612865+0000","last_peered":"2024-09-10T23:22:14.612865+0000","last_clean":"2024-09-10T23:22:14.612865+0000","last_became_active":"2024-09-10T23:22:13.175378+0000","last_became_peered":"2024-09-10T23:22:13.175378+0000","last_unstale":"2024-09-10T23:22:14.612865+0000","last_undegraded":"2024-09-10T23:22:14.612865+0000","last_fullsized":"2024-09-10T23:22:14.612865+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:55.756896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173789+0000","last_change":"2024-09-10T23:22:13.180206+0000","last_active":"2024-09-10T23:22:14.173789+0000","last_peered":"2024-09-10T23:22:14.173789+0000","last_clean":"2024-09-10T23:22:14.173789+0000","last_became_active":"2024-09-10T23:22:13.179936+0000","last_became_peered":"2024-09-10T23:22:13.179936+0000","last_unstale":"2024-09-10T23:22:14.173789+0000","last_undegraded":"2024-09-10T23:22:14.173789+0000","last_fullsized":"2024-09-10T23:22:14.173789+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:42.640723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"117'4","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.186847+0000","last_change":"2024-09-10T23:22:12.161100+0000","last_active":"2024-09-10T23:22:13.186847+0000","last_peered":"2024-09-10T23:22:13.186847+0000","last_clean":"2024-09-10T23:22:13.186847+0000","last_became_active":"2024-09-10T23:22:12.160776+0000","last_became_peered":"2024-09-10T23:22:12.160776+0000","last_unstale":"2024-09-10T23:22:13.186847+0000","last_undegraded":"2024-09-10T23:22:13.186847+0000","last_fullsized":"2024-09-10T23:22:13.186847+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:22.602652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612807+0000","last_change":"2024-09-10T23:22:13.169189+0000","last_active":"2024-09-10T23:22:14.612807+0000","last_peered":"2024-09-10T23:22:14.612807+0000","last_clean":"2024-09-10T23:22:14.612807+0000","last_became_active":"2024-09-10T23:22:13.168923+0000","last_became_peered":"2024-09-10T23:22:13.168923+0000","last_unstale":"2024-09-10T23:22:14.612807+0000","last_undegraded":"2024-09-10T23:22:14.612807+0000","last_fullsized":"2024-09-10T23:22:14.612807+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:46.817933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613319+0000","last_change":"2024-09-10T23:22:12.168233+0000","last_active":"2024-09-10T23:22:14.613319+0000","last_peered":"2024-09-10T23:22:14.613319+0000","last_clean":"2024-09-10T23:22:14.613319+0000","last_became_active":"2024-09-10T23:22:12.167590+0000","last_became_peered":"2024-09-10T23:22:12.167590+0000","last_unstale":"2024-09-10T23:22:14.613319+0000","last_undegraded":"2024-09-10T23:22:14.613319+0000","last_fullsized":"2024-09-10T23:22:14.613319+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:08.257142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171423+0000","last_change":"2024-09-10T23:22:13.157310+0000","last_active":"2024-09-10T23:22:14.171423+0000","last_peered":"2024-09-10T23:22:14.171423+0000","last_clean":"2024-09-10T23:22:14.171423+0000","last_became_active":"2024-09-10T23:22:13.157012+0000","last_became_peered":"2024-09-10T23:22:13.157012+0000","last_unstale":"2024-09-10T23:22:14.171423+0000","last_undegraded":"2024-09-10T23:22:14.171423+0000","last_fullsized":"2024-09-10T23:22:14.171423+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:35.118721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171089+0000","last_change":"2024-09-10T23:22:12.168213+0000","last_active":"2024-09-10T23:22:14.171089+0000","last_peered":"2024-09-10T23:22:14.171089+0000","last_clean":"2024-09-10T23:22:14.171089+0000","last_became_active":"2024-09-10T23:22:12.165193+0000","last_became_peered":"2024-09-10T23:22:12.165193+0000","last_unstale":"2024-09-10T23:22:14.171089+0000","last_undegraded":"2024-09-10T23:22:14.171089+0000","last_fullsized":"2024-09-10T23:22:14.171089+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:59.347112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179205+0000","last_change":"2024-09-10T23:22:13.171316+0000","last_active":"2024-09-10T23:22:14.179205+0000","last_peered":"2024-09-10T23:22:14.179205+0000","last_clean":"2024-09-10T23:22:14.179205+0000","last_became_active":"2024-09-10T23:22:13.170501+0000","last_became_peered":"2024-09-10T23:22:13.170501+0000","last_unstale":"2024-09-10T23:22:14.179205+0000","last_undegraded":"2024-09-10T23:22:14.179205+0000","last_fullsized":"2024-09-10T23:22:14.179205+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:26.915741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164842+0000","last_change":"2024-09-10T23:22:12.153240+0000","last_active":"2024-09-10T23:22:14.164842+0000","last_peered":"2024-09-10T23:22:14.164842+0000","last_clean":"2024-09-10T23:22:14.164842+0000","last_became_active":"2024-09-10T23:22:12.152979+0000","last_became_peered":"2024-09-10T23:22:12.152979+0000","last_unstale":"2024-09-10T23:22:14.164842+0000","last_undegraded":"2024-09-10T23:22:14.164842+0000","last_fullsized":"2024-09-10T23:22:14.164842+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:24.212190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.179616+0000","last_change":"2024-09-10T23:22:13.169388+0000","last_active":"2024-09-10T23:22:13.179616+0000","last_peered":"2024-09-10T23:22:13.179616+0000","last_clean":"2024-09-10T23:22:13.179616+0000","last_became_active":"2024-09-10T23:22:13.169115+0000","last_became_peered":"2024-09-10T23:22:13.169115+0000","last_unstale":"2024-09-10T23:22:13.179616+0000","last_undegraded":"2024-09-10T23:22:13.179616+0000","last_fullsized":"2024-09-10T23:22:13.179616+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:13.164620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615287+0000","last_change":"2024-09-10T23:22:12.168178+0000","last_active":"2024-09-10T23:22:14.615287+0000","last_peered":"2024-09-10T23:22:14.615287+0000","last_clean":"2024-09-10T23:22:14.615287+0000","last_became_active":"2024-09-10T23:22:12.165879+0000","last_became_peered":"2024-09-10T23:22:12.165879+0000","last_unstale":"2024-09-10T23:22:14.615287+0000","last_undegraded":"2024-09-10T23:22:14.615287+0000","last_fullsized":"2024-09-10T23:22:14.615287+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:25.885794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.174309+0000","last_change":"2024-09-10T23:22:13.173543+0000","last_active":"2024-09-10T23:22:14.174309+0000","last_peered":"2024-09-10T23:22:14.174309+0000","last_clean":"2024-09-10T23:22:14.174309+0000","last_became_active":"2024-09-10T23:22:13.173280+0000","last_became_peered":"2024-09-10T23:22:13.173280+0000","last_unstale":"2024-09-10T23:22:14.174309+0000","last_undegraded":"2024-09-10T23:22:14.174309+0000","last_fullsized":"2024-09-10T23:22:14.174309+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:07.743316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.178889+0000","last_change":"2024-09-10T23:22:12.168437+0000","last_active":"2024-09-10T23:22:14.178889+0000","last_peered":"2024-09-10T23:22:14.178889+0000","last_clean":"2024-09-10T23:22:14.178889+0000","last_became_active":"2024-09-10T23:22:12.168131+0000","last_became_peered":"2024-09-10T23:22:12.168131+0000","last_unstale":"2024-09-10T23:22:14.178889+0000","last_undegraded":"2024-09-10T23:22:14.178889+0000","last_fullsized":"2024-09-10T23:22:14.178889+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:18.240870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616704+0000","last_change":"2024-09-10T23:22:13.174443+0000","last_active":"2024-09-10T23:22:14.616704+0000","last_peered":"2024-09-10T23:22:14.616704+0000","last_clean":"2024-09-10T23:22:14.616704+0000","last_became_active":"2024-09-10T23:22:13.174181+0000","last_became_peered":"2024-09-10T23:22:13.174181+0000","last_unstale":"2024-09-10T23:22:14.616704+0000","last_undegraded":"2024-09-10T23:22:14.616704+0000","last_fullsized":"2024-09-10T23:22:14.616704+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:49.494993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.170780+0000","last_change":"2024-09-10T23:22:12.163928+0000","last_active":"2024-09-10T23:22:14.170780+0000","last_peered":"2024-09-10T23:22:14.170780+0000","last_clean":"2024-09-10T23:22:14.170780+0000","last_became_active":"2024-09-10T23:22:12.163630+0000","last_became_peered":"2024-09-10T23:22:12.163630+0000","last_unstale":"2024-09-10T23:22:14.170780+0000","last_undegraded":"2024-09-10T23:22:14.170780+0000","last_fullsized":"2024-09-10T23:22:14.170780+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:06.365698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.176120+0000","last_change":"2024-09-10T23:22:13.168564+0000","last_active":"2024-09-10T23:22:13.176120+0000","last_peered":"2024-09-10T23:22:13.176120+0000","last_clean":"2024-09-10T23:22:13.176120+0000","last_became_active":"2024-09-10T23:22:13.168058+0000","last_became_peered":"2024-09-10T23:22:13.168058+0000","last_unstale":"2024-09-10T23:22:13.176120+0000","last_undegraded":"2024-09-10T23:22:13.176120+0000","last_fullsized":"2024-09-10T23:22:13.176120+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:23.632875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.149916+0000","last_change":"2024-09-10T23:22:12.156473+0000","last_active":"2024-09-10T23:22:13.149916+0000","last_peered":"2024-09-10T23:22:13.149916+0000","last_clean":"2024-09-10T23:22:13.149916+0000","last_became_active":"2024-09-10T23:22:12.156197+0000","last_became_peered":"2024-09-10T23:22:12.156197+0000","last_unstale":"2024-09-10T23:22:13.149916+0000","last_undegraded":"2024-09-10T23:22:13.149916+0000","last_fullsized":"2024-09-10T23:22:13.149916+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:06.543541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173513+0000","last_change":"2024-09-10T23:22:13.172194+0000","last_active":"2024-09-10T23:22:14.173513+0000","last_peered":"2024-09-10T23:22:14.173513+0000","last_clean":"2024-09-10T23:22:14.173513+0000","last_became_active":"2024-09-10T23:22:13.171927+0000","last_became_peered":"2024-09-10T23:22:13.171927+0000","last_unstale":"2024-09-10T23:22:14.173513+0000","last_undegraded":"2024-09-10T23:22:14.173513+0000","last_fullsized":"2024-09-10T23:22:14.173513+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:10.076386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171453+0000","last_change":"2024-09-10T23:22:12.165788+0000","last_active":"2024-09-10T23:22:14.171453+0000","last_peered":"2024-09-10T23:22:14.171453+0000","last_clean":"2024-09-10T23:22:14.171453+0000","last_became_active":"2024-09-10T23:22:12.165403+0000","last_became_peered":"2024-09-10T23:22:12.165403+0000","last_unstale":"2024-09-10T23:22:14.171453+0000","last_undegraded":"2024-09-10T23:22:14.171453+0000","last_fullsized":"2024-09-10T23:22:14.171453+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:55.448154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164633+0000","last_change":"2024-09-10T23:22:13.177426+0000","last_active":"2024-09-10T23:22:14.164633+0000","last_peered":"2024-09-10T23:22:14.164633+0000","last_clean":"2024-09-10T23:22:14.164633+0000","last_became_active":"2024-09-10T23:22:13.177124+0000","last_became_peered":"2024-09-10T23:22:13.177124+0000","last_unstale":"2024-09-10T23:22:14.164633+0000","last_undegraded":"2024-09-10T23:22:14.164633+0000","last_fullsized":"2024-09-10T23:22:14.164633+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:42.876233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173740+0000","last_change":"2024-09-10T23:22:12.164012+0000","last_active":"2024-09-10T23:22:14.173740+0000","last_peered":"2024-09-10T23:22:14.173740+0000","last_clean":"2024-09-10T23:22:14.173740+0000","last_became_active":"2024-09-10T23:22:12.163710+0000","last_became_peered":"2024-09-10T23:22:12.163710+0000","last_unstale":"2024-09-10T23:22:14.173740+0000","last_undegraded":"2024-09-10T23:22:14.173740+0000","last_fullsized":"2024-09-10T23:22:14.173740+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:48.633338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612813+0000","last_change":"2024-09-10T23:22:13.175514+0000","last_active":"2024-09-10T23:22:14.612813+0000","last_peered":"2024-09-10T23:22:14.612813+0000","last_clean":"2024-09-10T23:22:14.612813+0000","last_became_active":"2024-09-10T23:22:13.175169+0000","last_became_peered":"2024-09-10T23:22:13.175169+0000","last_unstale":"2024-09-10T23:22:14.612813+0000","last_undegraded":"2024-09-10T23:22:14.612813+0000","last_fullsized":"2024-09-10T23:22:14.612813+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:35.400303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"117'3","reported_seq":18,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615438+0000","last_change":"2024-09-10T23:22:12.166006+0000","last_active":"2024-09-10T23:22:14.615438+0000","last_peered":"2024-09-10T23:22:14.615438+0000","last_clean":"2024-09-10T23:22:14.615438+0000","last_became_active":"2024-09-10T23:22:12.165668+0000","last_became_peered":"2024-09-10T23:22:12.165668+0000","last_unstale":"2024-09-10T23:22:14.615438+0000","last_undegraded":"2024-09-10T23:22:14.615438+0000","last_fullsized":"2024-09-10T23:22:14.615438+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:04.670440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165159+0000","last_change":"2024-09-10T23:22:13.177815+0000","last_active":"2024-09-10T23:22:14.165159+0000","last_peered":"2024-09-10T23:22:14.165159+0000","last_clean":"2024-09-10T23:22:14.165159+0000","last_became_active":"2024-09-10T23:22:13.177530+0000","last_became_peered":"2024-09-10T23:22:13.177530+0000","last_unstale":"2024-09-10T23:22:14.165159+0000","last_undegraded":"2024-09-10T23:22:14.165159+0000","last_fullsized":"2024-09-10T23:22:14.165159+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:01.483411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"117'6","reported_seq":21,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616114+0000","last_change":"2024-09-10T23:22:12.169200+0000","last_active":"2024-09-10T23:22:14.616114+0000","last_peered":"2024-09-10T23:22:14.616114+0000","last_clean":"2024-09-10T23:22:14.616114+0000","last_became_active":"2024-09-10T23:22:12.168185+0000","last_became_peered":"2024-09-10T23:22:12.168185+0000","last_unstale":"2024-09-10T23:22:14.616114+0000","last_undegraded":"2024-09-10T23:22:14.616114+0000","last_fullsized":"2024-09-10T23:22:14.616114+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:34.755034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179073+0000","last_change":"2024-09-10T23:22:13.168987+0000","last_active":"2024-09-10T23:22:14.179073+0000","last_peered":"2024-09-10T23:22:14.179073+0000","last_clean":"2024-09-10T23:22:14.179073+0000","last_became_active":"2024-09-10T23:22:13.168723+0000","last_became_peered":"2024-09-10T23:22:13.168723+0000","last_unstale":"2024-09-10T23:22:14.179073+0000","last_undegraded":"2024-09-10T23:22:14.179073+0000","last_fullsized":"2024-09-10T23:22:14.179073+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:42.594171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165208+0000","last_change":"2024-09-10T23:22:12.165712+0000","last_active":"2024-09-10T23:22:14.165208+0000","last_peered":"2024-09-10T23:22:14.165208+0000","last_clean":"2024-09-10T23:22:14.165208+0000","last_became_active":"2024-09-10T23:22:12.165048+0000","last_became_peered":"2024-09-10T23:22:12.165048+0000","last_unstale":"2024-09-10T23:22:14.165208+0000","last_undegraded":"2024-09-10T23:22:14.165208+0000","last_fullsized":"2024-09-10T23:22:14.165208+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:06.775392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616409+0000","last_change":"2024-09-10T23:22:13.167533+0000","last_active":"2024-09-10T23:22:14.616409+0000","last_peered":"2024-09-10T23:22:14.616409+0000","last_clean":"2024-09-10T23:22:14.616409+0000","last_became_active":"2024-09-10T23:22:13.167271+0000","last_became_peered":"2024-09-10T23:22:13.167271+0000","last_unstale":"2024-09-10T23:22:14.616409+0000","last_undegraded":"2024-09-10T23:22:14.616409+0000","last_fullsized":"2024-09-10T23:22:14.616409+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:15:31.243940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.150997+0000","last_change":"2024-09-10T23:22:12.154958+0000","last_active":"2024-09-10T23:22:13.150997+0000","last_peered":"2024-09-10T23:22:13.150997+0000","last_clean":"2024-09-10T23:22:13.150997+0000","last_became_active":"2024-09-10T23:22:12.154085+0000","last_became_peered":"2024-09-10T23:22:12.154085+0000","last_unstale":"2024-09-10T23:22:13.150997+0000","last_undegraded":"2024-09-10T23:22:13.150997+0000","last_fullsized":"2024-09-10T23:22:13.150997+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:43.358781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613171+0000","last_change":"2024-09-10T23:22:13.168741+0000","last_active":"2024-09-10T23:22:14.613171+0000","last_peered":"2024-09-10T23:22:14.613171+0000","last_clean":"2024-09-10T23:22:14.613171+0000","last_became_active":"2024-09-10T23:22:13.168423+0000","last_became_peered":"2024-09-10T23:22:13.168423+0000","last_unstale":"2024-09-10T23:22:14.613171+0000","last_undegraded":"2024-09-10T23:22:14.613171+0000","last_fullsized":"2024-09-10T23:22:14.613171+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:15.361197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612781+0000","last_change":"2024-09-10T23:22:12.164458+0000","last_active":"2024-09-10T23:22:14.612781+0000","last_peered":"2024-09-10T23:22:14.612781+0000","last_clean":"2024-09-10T23:22:14.612781+0000","last_became_active":"2024-09-10T23:22:12.161883+0000","last_became_peered":"2024-09-10T23:22:12.161883+0000","last_unstale":"2024-09-10T23:22:14.612781+0000","last_undegraded":"2024-09-10T23:22:14.612781+0000","last_fullsized":"2024-09-10T23:22:14.612781+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:16.943245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173961+0000","last_change":"2024-09-10T23:22:13.165825+0000","last_active":"2024-09-10T23:22:14.173961+0000","last_peered":"2024-09-10T23:22:14.173961+0000","last_clean":"2024-09-10T23:22:14.173961+0000","last_became_active":"2024-09-10T23:22:13.165446+0000","last_became_peered":"2024-09-10T23:22:13.165446+0000","last_unstale":"2024-09-10T23:22:14.173961+0000","last_undegraded":"2024-09-10T23:22:14.173961+0000","last_fullsized":"2024-09-10T23:22:14.173961+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:30:04.173691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"117'8","reported_seq":23,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.170779+0000","last_change":"2024-09-10T23:22:12.164271+0000","last_active":"2024-09-10T23:22:14.170779+0000","last_peered":"2024-09-10T23:22:14.170779+0000","last_clean":"2024-09-10T23:22:14.170779+0000","last_became_active":"2024-09-10T23:22:12.163974+0000","last_became_peered":"2024-09-10T23:22:12.163974+0000","last_unstale":"2024-09-10T23:22:14.170779+0000","last_undegraded":"2024-09-10T23:22:14.170779+0000","last_fullsized":"2024-09-10T23:22:14.170779+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:36.386996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612978+0000","last_change":"2024-09-10T23:22:13.166593+0000","last_active":"2024-09-10T23:22:14.612978+0000","last_peered":"2024-09-10T23:22:14.612978+0000","last_clean":"2024-09-10T23:22:14.612978+0000","last_became_active":"2024-09-10T23:22:13.166281+0000","last_became_peered":"2024-09-10T23:22:13.166281+0000","last_unstale":"2024-09-10T23:22:14.612978+0000","last_undegraded":"2024-09-10T23:22:14.612978+0000","last_fullsized":"2024-09-10T23:22:14.612978+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:32.278115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616410+0000","last_change":"2024-09-10T23:22:12.165289+0000","last_active":"2024-09-10T23:22:14.616410+0000","last_peered":"2024-09-10T23:22:14.616410+0000","last_clean":"2024-09-10T23:22:14.616410+0000","last_became_active":"2024-09-10T23:22:12.164814+0000","last_became_peered":"2024-09-10T23:22:12.164814+0000","last_unstale":"2024-09-10T23:22:14.616410+0000","last_undegraded":"2024-09-10T23:22:14.616410+0000","last_fullsized":"2024-09-10T23:22:14.616410+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:09.290150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616034+0000","last_change":"2024-09-10T23:22:13.170458+0000","last_active":"2024-09-10T23:22:14.616034+0000","last_peered":"2024-09-10T23:22:14.616034+0000","last_clean":"2024-09-10T23:22:14.616034+0000","last_became_active":"2024-09-10T23:22:13.170155+0000","last_became_peered":"2024-09-10T23:22:13.170155+0000","last_unstale":"2024-09-10T23:22:14.616034+0000","last_undegraded":"2024-09-10T23:22:14.616034+0000","last_fullsized":"2024-09-10T23:22:14.616034+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:34.058147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"117'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615475+0000","last_change":"2024-09-10T23:22:12.162575+0000","last_active":"2024-09-10T23:22:14.615475+0000","last_peered":"2024-09-10T23:22:14.615475+0000","last_clean":"2024-09-10T23:22:14.615475+0000","last_became_active":"2024-09-10T23:22:12.162283+0000","last_became_peered":"2024-09-10T23:22:12.162283+0000","last_unstale":"2024-09-10T23:22:14.615475+0000","last_undegraded":"2024-09-10T23:22:14.615475+0000","last_fullsized":"2024-09-10T23:22:14.615475+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:16.277920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.165050+0000","last_change":"2024-09-10T23:22:13.159144+0000","last_active":"2024-09-10T23:22:14.165050+0000","last_peered":"2024-09-10T23:22:14.165050+0000","last_clean":"2024-09-10T23:22:14.165050+0000","last_became_active":"2024-09-10T23:22:13.158845+0000","last_became_peered":"2024-09-10T23:22:13.158845+0000","last_unstale":"2024-09-10T23:22:14.165050+0000","last_undegraded":"2024-09-10T23:22:14.165050+0000","last_fullsized":"2024-09-10T23:22:14.165050+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:12.161685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.178939+0000","last_change":"2024-09-10T23:22:12.167706+0000","last_active":"2024-09-10T23:22:14.178939+0000","last_peered":"2024-09-10T23:22:14.178939+0000","last_clean":"2024-09-10T23:22:14.178939+0000","last_became_active":"2024-09-10T23:22:12.167294+0000","last_became_peered":"2024-09-10T23:22:12.167294+0000","last_unstale":"2024-09-10T23:22:14.178939+0000","last_undegraded":"2024-09-10T23:22:14.178939+0000","last_fullsized":"2024-09-10T23:22:14.178939+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:00.916270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173612+0000","last_change":"2024-09-10T23:22:13.161857+0000","last_active":"2024-09-10T23:22:14.173612+0000","last_peered":"2024-09-10T23:22:14.173612+0000","last_clean":"2024-09-10T23:22:14.173612+0000","last_became_active":"2024-09-10T23:22:13.161541+0000","last_became_peered":"2024-09-10T23:22:13.161541+0000","last_unstale":"2024-09-10T23:22:14.173612+0000","last_undegraded":"2024-09-10T23:22:14.173612+0000","last_fullsized":"2024-09-10T23:22:14.173612+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:50.702819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613406+0000","last_change":"2024-09-10T23:22:12.167607+0000","last_active":"2024-09-10T23:22:14.613406+0000","last_peered":"2024-09-10T23:22:14.613406+0000","last_clean":"2024-09-10T23:22:14.613406+0000","last_became_active":"2024-09-10T23:22:12.167302+0000","last_became_peered":"2024-09-10T23:22:12.167302+0000","last_unstale":"2024-09-10T23:22:14.613406+0000","last_undegraded":"2024-09-10T23:22:14.613406+0000","last_fullsized":"2024-09-10T23:22:14.613406+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:00.770714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.174335+0000","last_change":"2024-09-10T23:22:13.163704+0000","last_active":"2024-09-10T23:22:14.174335+0000","last_peered":"2024-09-10T23:22:14.174335+0000","last_clean":"2024-09-10T23:22:14.174335+0000","last_became_active":"2024-09-10T23:22:13.163341+0000","last_became_peered":"2024-09-10T23:22:13.163341+0000","last_unstale":"2024-09-10T23:22:14.174335+0000","last_undegraded":"2024-09-10T23:22:14.174335+0000","last_fullsized":"2024-09-10T23:22:14.174335+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:33.145699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612701+0000","last_change":"2024-09-10T23:22:12.162911+0000","last_active":"2024-09-10T23:22:14.612701+0000","last_peered":"2024-09-10T23:22:14.612701+0000","last_clean":"2024-09-10T23:22:14.612701+0000","last_became_active":"2024-09-10T23:22:12.162629+0000","last_became_peered":"2024-09-10T23:22:12.162629+0000","last_unstale":"2024-09-10T23:22:14.612701+0000","last_undegraded":"2024-09-10T23:22:14.612701+0000","last_fullsized":"2024-09-10T23:22:14.612701+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:45.604302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.179528+0000","last_change":"2024-09-10T23:22:13.171536+0000","last_active":"2024-09-10T23:22:13.179528+0000","last_peered":"2024-09-10T23:22:13.179528+0000","last_clean":"2024-09-10T23:22:13.179528+0000","last_became_active":"2024-09-10T23:22:13.171274+0000","last_became_peered":"2024-09-10T23:22:13.171274+0000","last_unstale":"2024-09-10T23:22:13.179528+0000","last_undegraded":"2024-09-10T23:22:13.179528+0000","last_fullsized":"2024-09-10T23:22:13.179528+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:27.120739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615625+0000","last_change":"2024-09-10T23:22:12.159424+0000","last_active":"2024-09-10T23:22:14.615625+0000","last_peered":"2024-09-10T23:22:14.615625+0000","last_clean":"2024-09-10T23:22:14.615625+0000","last_became_active":"2024-09-10T23:22:12.159109+0000","last_became_peered":"2024-09-10T23:22:12.159109+0000","last_unstale":"2024-09-10T23:22:14.615625+0000","last_undegraded":"2024-09-10T23:22:14.615625+0000","last_fullsized":"2024-09-10T23:22:14.615625+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:18.545402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613198+0000","last_change":"2024-09-10T23:22:13.172387+0000","last_active":"2024-09-10T23:22:14.613198+0000","last_peered":"2024-09-10T23:22:14.613198+0000","last_clean":"2024-09-10T23:22:14.613198+0000","last_became_active":"2024-09-10T23:22:13.172070+0000","last_became_peered":"2024-09-10T23:22:13.172070+0000","last_unstale":"2024-09-10T23:22:14.613198+0000","last_undegraded":"2024-09-10T23:22:14.613198+0000","last_fullsized":"2024-09-10T23:22:14.613198+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:30.984786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613152+0000","last_change":"2024-09-10T23:22:12.163302+0000","last_active":"2024-09-10T23:22:14.613152+0000","last_peered":"2024-09-10T23:22:14.613152+0000","last_clean":"2024-09-10T23:22:14.613152+0000","last_became_active":"2024-09-10T23:22:12.162605+0000","last_became_peered":"2024-09-10T23:22:12.162605+0000","last_unstale":"2024-09-10T23:22:14.613152+0000","last_undegraded":"2024-09-10T23:22:14.613152+0000","last_fullsized":"2024-09-10T23:22:14.613152+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:09.767603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.173522+0000","last_change":"2024-09-10T23:22:13.161911+0000","last_active":"2024-09-10T23:22:14.173522+0000","last_peered":"2024-09-10T23:22:14.173522+0000","last_clean":"2024-09-10T23:22:14.173522+0000","last_became_active":"2024-09-10T23:22:13.161647+0000","last_became_peered":"2024-09-10T23:22:13.161647+0000","last_unstale":"2024-09-10T23:22:14.173522+0000","last_undegraded":"2024-09-10T23:22:14.173522+0000","last_fullsized":"2024-09-10T23:22:14.173522+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:23.060566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164990+0000","last_change":"2024-09-10T23:22:12.163925+0000","last_active":"2024-09-10T23:22:14.164990+0000","last_peered":"2024-09-10T23:22:14.164990+0000","last_clean":"2024-09-10T23:22:14.164990+0000","last_became_active":"2024-09-10T23:22:12.163669+0000","last_became_peered":"2024-09-10T23:22:12.163669+0000","last_unstale":"2024-09-10T23:22:14.164990+0000","last_undegraded":"2024-09-10T23:22:14.164990+0000","last_fullsized":"2024-09-10T23:22:14.164990+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:30.721424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.171622+0000","last_change":"2024-09-10T23:22:13.158681+0000","last_active":"2024-09-10T23:22:14.171622+0000","last_peered":"2024-09-10T23:22:14.171622+0000","last_clean":"2024-09-10T23:22:14.171622+0000","last_became_active":"2024-09-10T23:22:13.158425+0000","last_became_peered":"2024-09-10T23:22:13.158425+0000","last_unstale":"2024-09-10T23:22:14.171622+0000","last_undegraded":"2024-09-10T23:22:14.171622+0000","last_fullsized":"2024-09-10T23:22:14.171622+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:49.494993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"118'1","reported_seq":16,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.175357+0000","last_change":"2024-09-10T23:22:12.165433+0000","last_active":"2024-09-10T23:22:14.175357+0000","last_peered":"2024-09-10T23:22:14.175357+0000","last_clean":"2024-09-10T23:22:14.175357+0000","last_became_active":"2024-09-10T23:22:12.164486+0000","last_became_peered":"2024-09-10T23:22:12.164486+0000","last_unstale":"2024-09-10T23:22:14.175357+0000","last_undegraded":"2024-09-10T23:22:14.175357+0000","last_fullsized":"2024-09-10T23:22:14.175357+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:26.606067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-10T23:22:13.170598+0000","last_change":"2024-09-10T23:22:13.166408+0000","last_active":"2024-09-10T23:22:13.170598+0000","last_peered":"2024-09-10T23:22:13.170598+0000","last_clean":"2024-09-10T23:22:13.170598+0000","last_became_active":"2024-09-10T23:22:13.166073+0000","last_became_peered":"2024-09-10T23:22:13.166073+0000","last_unstale":"2024-09-10T23:22:13.170598+0000","last_undegraded":"2024-09-10T23:22:13.170598+0000","last_fullsized":"2024-09-10T23:22:13.170598+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:18.648521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.616227+0000","last_change":"2024-09-10T23:22:12.169927+0000","last_active":"2024-09-10T23:22:14.616227+0000","last_peered":"2024-09-10T23:22:14.616227+0000","last_clean":"2024-09-10T23:22:14.616227+0000","last_became_active":"2024-09-10T23:22:12.169621+0000","last_became_peered":"2024-09-10T23:22:12.169621+0000","last_unstale":"2024-09-10T23:22:14.616227+0000","last_undegraded":"2024-09-10T23:22:14.616227+0000","last_fullsized":"2024-09-10T23:22:14.616227+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:00.886109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179231+0000","last_change":"2024-09-10T23:22:13.175405+0000","last_active":"2024-09-10T23:22:14.179231+0000","last_peered":"2024-09-10T23:22:14.179231+0000","last_clean":"2024-09-10T23:22:14.179231+0000","last_became_active":"2024-09-10T23:22:13.175024+0000","last_became_peered":"2024-09-10T23:22:13.175024+0000","last_unstale":"2024-09-10T23:22:14.179231+0000","last_undegraded":"2024-09-10T23:22:14.179231+0000","last_fullsized":"2024-09-10T23:22:14.179231+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:46:40.894742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.164943+0000","last_change":"2024-09-10T23:22:12.159734+0000","last_active":"2024-09-10T23:22:14.164943+0000","last_peered":"2024-09-10T23:22:14.164943+0000","last_clean":"2024-09-10T23:22:14.164943+0000","last_became_active":"2024-09-10T23:22:12.159462+0000","last_became_peered":"2024-09-10T23:22:12.159462+0000","last_unstale":"2024-09-10T23:22:14.164943+0000","last_undegraded":"2024-09-10T23:22:14.164943+0000","last_fullsized":"2024-09-10T23:22:14.164943+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:49:38.989930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613263+0000","last_change":"2024-09-10T23:22:13.169318+0000","last_active":"2024-09-10T23:22:14.613263+0000","last_peered":"2024-09-10T23:22:14.613263+0000","last_clean":"2024-09-10T23:22:14.613263+0000","last_became_active":"2024-09-10T23:22:13.168958+0000","last_became_peered":"2024-09-10T23:22:13.168958+0000","last_unstale":"2024-09-10T23:22:14.613263+0000","last_undegraded":"2024-09-10T23:22:14.613263+0000","last_fullsized":"2024-09-10T23:22:14.613263+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:09.270900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.170978+0000","last_change":"2024-09-10T23:22:12.160071+0000","last_active":"2024-09-10T23:22:14.170978+0000","last_peered":"2024-09-10T23:22:14.170978+0000","last_clean":"2024-09-10T23:22:14.170978+0000","last_became_active":"2024-09-10T23:22:12.159627+0000","last_became_peered":"2024-09-10T23:22:12.159627+0000","last_unstale":"2024-09-10T23:22:14.170978+0000","last_undegraded":"2024-09-10T23:22:14.170978+0000","last_fullsized":"2024-09-10T23:22:14.170978+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:42.477078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613253+0000","last_change":"2024-09-10T23:22:13.172239+0000","last_active":"2024-09-10T23:22:14.613253+0000","last_peered":"2024-09-10T23:22:14.613253+0000","last_clean":"2024-09-10T23:22:14.613253+0000","last_became_active":"2024-09-10T23:22:13.171942+0000","last_became_peered":"2024-09-10T23:22:13.171942+0000","last_unstale":"2024-09-10T23:22:14.613253+0000","last_undegraded":"2024-09-10T23:22:14.613253+0000","last_fullsized":"2024-09-10T23:22:14.613253+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:17.800305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.612933+0000","last_change":"2024-09-10T23:22:12.164893+0000","last_active":"2024-09-10T23:22:14.612933+0000","last_peered":"2024-09-10T23:22:14.612933+0000","last_clean":"2024-09-10T23:22:14.612933+0000","last_became_active":"2024-09-10T23:22:12.164574+0000","last_became_peered":"2024-09-10T23:22:12.164574+0000","last_unstale":"2024-09-10T23:22:14.612933+0000","last_undegraded":"2024-09-10T23:22:14.612933+0000","last_fullsized":"2024-09-10T23:22:14.612933+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:00:56.230351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615687+0000","last_change":"2024-09-10T23:22:13.172706+0000","last_active":"2024-09-10T23:22:14.615687+0000","last_peered":"2024-09-10T23:22:14.615687+0000","last_clean":"2024-09-10T23:22:14.615687+0000","last_became_active":"2024-09-10T23:22:13.172331+0000","last_became_peered":"2024-09-10T23:22:13.172331+0000","last_unstale":"2024-09-10T23:22:14.615687+0000","last_undegraded":"2024-09-10T23:22:14.615687+0000","last_fullsized":"2024-09-10T23:22:14.615687+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:59.436890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.615757+0000","last_change":"2024-09-10T23:22:12.167200+0000","last_active":"2024-09-10T23:22:14.615757+0000","last_peered":"2024-09-10T23:22:14.615757+0000","last_clean":"2024-09-10T23:22:14.615757+0000","last_became_active":"2024-09-10T23:22:12.166866+0000","last_became_peered":"2024-09-10T23:22:12.166866+0000","last_unstale":"2024-09-10T23:22:14.615757+0000","last_undegraded":"2024-09-10T23:22:14.615757+0000","last_fullsized":"2024-09-10T23:22:14.615757+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:34.650796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.179464+0000","last_change":"2024-09-10T23:22:13.168017+0000","last_active":"2024-09-10T23:22:14.179464+0000","last_peered":"2024-09-10T23:22:14.179464+0000","last_clean":"2024-09-10T23:22:14.179464+0000","last_became_active":"2024-09-10T23:22:13.166031+0000","last_became_peered":"2024-09-10T23:22:13.166031+0000","last_unstale":"2024-09-10T23:22:14.179464+0000","last_undegraded":"2024-09-10T23:22:14.179464+0000","last_fullsized":"2024-09-10T23:22:14.179464+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:44:12.327406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":15,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613201+0000","last_change":"2024-09-10T23:22:12.164199+0000","last_active":"2024-09-10T23:22:14.613201+0000","last_peered":"2024-09-10T23:22:14.613201+0000","last_clean":"2024-09-10T23:22:14.613201+0000","last_became_active":"2024-09-10T23:22:12.161913+0000","last_became_peered":"2024-09-10T23:22:12.161913+0000","last_unstale":"2024-09-10T23:22:14.613201+0000","last_undegraded":"2024-09-10T23:22:14.613201+0000","last_fullsized":"2024-09-10T23:22:14.613201+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:47.138913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.178778+0000","last_change":"2024-09-10T23:22:13.170009+0000","last_active":"2024-09-10T23:22:14.178778+0000","last_peered":"2024-09-10T23:22:14.178778+0000","last_clean":"2024-09-10T23:22:14.178778+0000","last_became_active":"2024-09-10T23:22:13.169690+0000","last_became_peered":"2024-09-10T23:22:13.169690+0000","last_unstale":"2024-09-10T23:22:14.178778+0000","last_undegraded":"2024-09-10T23:22:14.178778+0000","last_fullsized":"2024-09-10T23:22:14.178778+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:12.133518+0000","last_clean_scrub_stamp":"2024-09-10T23:22:12.133518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:17.284833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"117'2","reported_seq":17,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.613435+0000","last_change":"2024-09-10T23:22:12.167895+0000","last_active":"2024-09-10T23:22:14.613435+0000","last_peered":"2024-09-10T23:22:14.613435+0000","last_clean":"2024-09-10T23:22:14.613435+0000","last_became_active":"2024-09-10T23:22:12.167173+0000","last_became_peered":"2024-09-10T23:22:12.167173+0000","last_unstale":"2024-09-10T23:22:14.613435+0000","last_undegraded":"2024-09-10T23:22:14.613435+0000","last_fullsized":"2024-09-10T23:22:14.613435+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:22:11.126605+0000","last_clean_scrub_stamp":"2024-09-10T23:22:11.126605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:40.074982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":280,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-09-10T23:22:14.614921+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:22:14.614921+0000","last_peered":"2024-09-10T23:22:14.614921+0000","last_clean":"2024-09-10T23:22:14.614921+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:22:14.614921+0000","last_undegraded":"2024-09-10T23:22:14.614921+0000","last_fullsized":"2024-09-10T23:22:14.614921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476821,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28476,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343364,"statfs":{"total":96636764160,"available":96607604736,"internally_reserved":0,"allocated":1474560,"data_stored":682449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509526,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51232,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320608,"statfs":{"total":96636764160,"available":96584302592,"internally_reserved":0,"allocated":2043904,"data_stored":1264069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40932,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330908,"statfs":{"total":96636764160,"available":96594849792,"internally_reserved":0,"allocated":1454080,"data_stored":680233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509526,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50664,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321176,"statfs":{"total":96636764160,"available":96584884224,"internally_reserved":0,"allocated":1462272,"data_stored":680325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28444,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343396,"statfs":{"total":96636764160,"available":96607637504,"internally_reserved":0,"allocated":1445888,"data_stored":673575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40936,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330904,"statfs":{"total":96636764160,"available":96594845696,"internally_reserved":0,"allocated":1458176,"data_stored":680267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55420,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316420,"statfs":{"total":96636764160,"available":96580014080,"internally_reserved":0,"allocated":2064384,"data_stored":1272303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50636,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321204,"statfs":{"total":96636764160,"available":96584912896,"internally_reserved":0,"allocated":1429504,"data_stored":666374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:22:17.718 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:22:17.719 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:22:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.912+0000 7fbe5ee00640 1 -- 172.21.15.17:0/3898647435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 msgr2=0x7fbe3c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.912+0000 7fbe5ee00640 1 --2- 172.21.15.17:0/3898647435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 0x7fbe3c004c90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fbe40001860 tx=0x7fbe4001f030 comp rx=0 tx=0).stop 2024-09-10T23:22:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.912+0000 7fbe5ee00640 1 -- 172.21.15.17:0/3898647435 shutdown_connections 2024-09-10T23:22:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.912+0000 7fbe5ee00640 1 --2- 172.21.15.17:0/3898647435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 0x7fbe3c004c90 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.912+0000 7fbe5ee00640 1 -- 172.21.15.17:0/3898647435 >> 172.21.15.17:0/3898647435 conn(0x7fbe580d1da0 msgr2=0x7fbe580d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.912+0000 7fbe5ee00640 1 -- 172.21.15.17:0/3898647435 shutdown_connections 2024-09-10T23:22:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.912+0000 7fbe5ee00640 1 -- 172.21.15.17:0/3898647435 wait complete. 2024-09-10T23:22:17.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.912+0000 7fbe5ee00640 1 Processor -- start 2024-09-10T23:22:17.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.912+0000 7fbe5ee00640 1 -- start start 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 0x7fbe581f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe58154f30 0x7fbe58158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe5815d230 0x7fbe5815d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbe580d0030 con 0x7fbe3c004810 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe580cfeb0 con 0x7fbe58154f30 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe580d01b0 con 0x7fbe5815d230 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe57e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 0x7fbe581f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe57e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 0x7fbe581f6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53508/0 (socket says 172.21.15.17:53508) 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe57e00640 1 -- 172.21.15.17:0/484458512 learned_addr learned my addr 172.21.15.17:0/484458512 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe4f400640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe58154f30 0x7fbe58158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ce00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe5815d230 0x7fbe5815d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe57e00640 1 -- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe5815d230 msgr2=0x7fbe5815d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe57e00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe5815d230 0x7fbe5815d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe57e00640 1 -- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe58154f30 msgr2=0x7fbe58158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe57e00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe58154f30 0x7fbe58158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe57e00640 1 -- 172.21.15.17:0/484458512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe581f25f0 con 0x7fbe3c004810 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ce00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe5815d230 0x7fbe5815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe57e00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 0x7fbe581f6400 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fbe48011a70 tx=0x7fbe48011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe54c00640 1 -- 172.21.15.17:0/484458512 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4801e070 con 0x7fbe3c004810 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe54c00640 1 -- 172.21.15.17:0/484458512 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe4800f940 con 0x7fbe3c004810 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe581f28d0 con 0x7fbe3c004810 2024-09-10T23:22:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe54c00640 1 -- 172.21.15.17:0/484458512 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800fd70 con 0x7fbe3c004810 2024-09-10T23:22:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe581f2e90 con 0x7fbe3c004810 2024-09-10T23:22:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.916+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe580d0710 con 0x7fbe3c004810 2024-09-10T23:22:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.920+0000 7fbe54c00640 1 -- 172.21.15.17:0/484458512 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbe48003600 con 0x7fbe3c004810 2024-09-10T23:22:17.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.920+0000 7fbe54c00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe34072610 0x7fbe34074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.920+0000 7fbe54c00640 1 -- 172.21.15.17:0/484458512 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7fbe48094070 con 0x7fbe3c004810 2024-09-10T23:22:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.920+0000 7fbe4f400640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe34072610 0x7fbe34074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:17.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.920+0000 7fbe4f400640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe34072610 0x7fbe34074ad0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbe40001830 tx=0x7fbe4001be70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:17.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:17.924+0000 7fbe54c00640 1 -- 172.21.15.17:0/484458512 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbe4805eed0 con 0x7fbe3c004810 2024-09-10T23:22:18.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.168+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fbe580cc9e0 con 0x7fbe3c004810 2024-09-10T23:22:18.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe54c00640 1 -- 172.21.15.17:0/484458512 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7fbe48063900 con 0x7fbe3c004810 2024-09-10T23:22:18.173 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:22:18.173 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:22:18.173 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:22:18.173 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:22:18.173 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:22:18.174 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:22:18.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe34072610 msgr2=0x7fbe34074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe34072610 0x7fbe34074ad0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbe40001830 tx=0x7fbe4001be70 comp rx=0 tx=0).stop 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 msgr2=0x7fbe581f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 0x7fbe581f6400 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fbe48011a70 tx=0x7fbe48011f30 comp rx=0 tx=0).stop 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 shutdown_connections 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe34072610 0x7fbe34074ad0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe5815d230 0x7fbe5815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe58154f30 0x7fbe58158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 --2- 172.21.15.17:0/484458512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe3c004810 0x7fbe581f6400 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 >> 172.21.15.17:0/484458512 conn(0x7fbe580d1da0 msgr2=0x7fbe580b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 shutdown_connections 2024-09-10T23:22:18.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.172+0000 7fbe5ee00640 1 -- 172.21.15.17:0/484458512 wait complete. 2024-09-10T23:22:18.196 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:22:18.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.340+0000 7f2109e00640 1 -- 172.21.15.17:0/290376841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 msgr2=0x7f210415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.340+0000 7f2109e00640 1 --2- 172.21.15.17:0/290376841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 0x7f210415f060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f21040cf010 tx=0x7f20f401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.340+0000 7f2109e00640 1 -- 172.21.15.17:0/290376841 shutdown_connections 2024-09-10T23:22:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.340+0000 7f2109e00640 1 --2- 172.21.15.17:0/290376841 >> v2:172.21.15.77:3300/0 conn(0x7f21040d1830 0x7f210415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.340+0000 7f2109e00640 1 --2- 172.21.15.17:0/290376841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 0x7f210415f060 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.340+0000 7f2109e00640 1 -- 172.21.15.17:0/290376841 >> 172.21.15.17:0/290376841 conn(0x7f21040d1d60 msgr2=0x7f21040d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.340+0000 7f2109e00640 1 -- 172.21.15.17:0/290376841 shutdown_connections 2024-09-10T23:22:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.340+0000 7f2109e00640 1 -- 172.21.15.17:0/290376841 wait complete. 2024-09-10T23:22:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 Processor -- start 2024-09-10T23:22:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 -- start start 2024-09-10T23:22:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 0x7f21041fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21040cf320 0x7f21040c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:18.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21040d1830 0x7f21040afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f21041693d0 con 0x7f21040d1830 2024-09-10T23:22:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2104169250 con 0x7f21040cf320 2024-09-10T23:22:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2104169550 con 0x7f2104070ad0 2024-09-10T23:22:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2103400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21040d1830 0x7f21040afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 0x7f21041fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 0x7f21041fbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:50484/0 (socket says 172.21.15.17:50484) 2024-09-10T23:22:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102a00640 1 -- 172.21.15.17:0/4184008168 learned_addr learned my addr 172.21.15.17:0/4184008168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102000640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21040cf320 0x7f21040c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:18.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102a00640 1 -- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21040cf320 msgr2=0x7f21040c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102a00640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21040cf320 0x7f21040c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102a00640 1 -- 172.21.15.17:0/4184008168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21040d1830 msgr2=0x7f21040afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102a00640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21040d1830 0x7f21040afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102a00640 1 -- 172.21.15.17:0/4184008168 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21040c8590 con 0x7f2104070ad0 2024-09-10T23:22:18.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2102a00640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 0x7f21041fbf00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f20f40b0040 tx=0x7f20f4005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f20fb400640 1 -- 172.21.15.17:0/4184008168 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f40ba020 con 0x7f2104070ad0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f20fb400640 1 -- 172.21.15.17:0/4184008168 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20f4005400 con 0x7f2104070ad0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f20fb400640 1 -- 172.21.15.17:0/4184008168 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f40b2040 con 0x7f2104070ad0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2104165af0 con 0x7f2104070ad0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21041f8420 con 0x7f2104070ad0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.344+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21041f7f50 con 0x7f2104070ad0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.348+0000 7f20fb400640 1 -- 172.21.15.17:0/4184008168 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f20f40046d0 con 0x7f2104070ad0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.348+0000 7f20fb400640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20e40725e0 0x7f20e4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.348+0000 7f20fb400640 1 -- 172.21.15.17:0/4184008168 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(119..119 src has 1..119) ==== 6130+0+0 (secure 0 0 0) 0x7f20f412d920 con 0x7f2104070ad0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.348+0000 7f2102000640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20e40725e0 0x7f20e4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:18.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.348+0000 7f2102000640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20e40725e0 0x7f20e4074aa0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009b40 tx=0x7f20f00091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:18.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.352+0000 7f20fb400640 1 -- 172.21.15.17:0/4184008168 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f20f40c4060 con 0x7f2104070ad0 2024-09-10T23:22:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.560+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21040cfc60 con 0x7f2104070ad0 2024-09-10T23:22:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.560+0000 7f20fb400640 1 -- 172.21.15.17:0/4184008168 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5216 (secure 0 0 0) 0x7f20f40164d0 con 0x7f2104070ad0 2024-09-10T23:22:18.563 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:22:18.563 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"btime":"2024-09-10T23:22:16:169092+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/151616867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":151616867},{"type":"v1","addr":"172.21.15.77:6836","nonce":151616867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7824,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/623866149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":623866149},{"type":"v1","addr":"172.21.15.17:6834","nonce":623866149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7827,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2269575278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2269575278},{"type":"v1","addr":"172.21.15.17:6835","nonce":2269575278}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:22:12.557691+0000","modified":"2024-09-10T23:22:15.576023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/258682540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":258682540},{"type":"v1","addr":"172.21.15.77:6837","nonce":258682540}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":7}]} 2024-09-10T23:22:18.563 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 86 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20e40725e0 msgr2=0x7f20e4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20e40725e0 0x7f20e4074aa0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009b40 tx=0x7f20f00091e0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 msgr2=0x7f21041fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 0x7f21041fbf00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f20f40b0040 tx=0x7f20f4005e20 comp rx=0 tx=0).stop 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 shutdown_connections 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20e40725e0 0x7f20e4074aa0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21040d1830 0x7f21040afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21040cf320 0x7f21040c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 --2- 172.21.15.17:0/4184008168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2104070ad0 0x7f21041fbf00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:18.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 >> 172.21.15.17:0/4184008168 conn(0x7f21040d1d60 msgr2=0x7f2104158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:18.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 shutdown_connections 2024-09-10T23:22:18.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:18.564+0000 7f2109e00640 1 -- 172.21.15.17:0/4184008168 wait complete. 2024-09-10T23:22:18.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:22:12.557691+0000', 'modified': '2024-09-10T23:22:15.576023+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7845}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7845': {'gid': 7845, 'name': 'd', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/258682540', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6835', 'nonce': 258682540}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 258682540}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7845, 'qdb_cluster': [7845]} 2024-09-10T23:22:18.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:22:18.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T23:22:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 -- 172.21.15.17:0/4082984826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e3c157c70 msgr2=0x7f1e3c0730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 --2- 172.21.15.17:0/4082984826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e3c157c70 0x7f1e3c0730b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009870 tx=0x7f1e3001f010 comp rx=0 tx=0).stop 2024-09-10T23:22:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 -- 172.21.15.17:0/4082984826 shutdown_connections 2024-09-10T23:22:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 --2- 172.21.15.17:0/4082984826 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e3c15dd70 0x7f1e3c15e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 --2- 172.21.15.17:0/4082984826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e3c157c70 0x7f1e3c0730b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 -- 172.21.15.17:0/4082984826 >> 172.21.15.17:0/4082984826 conn(0x7f1e3c0b1730 msgr2=0x7f1e3c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 -- 172.21.15.17:0/4082984826 shutdown_connections 2024-09-10T23:22:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 -- 172.21.15.17:0/4082984826 wait complete. 2024-09-10T23:22:19.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 Processor -- start 2024-09-10T23:22:19.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.140+0000 7f1e43e00640 1 -- start start 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e43e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e3c0b4a90 0x7f1e3c14e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e43e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e3c157c70 0x7f1e3c1f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e43e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e3c15dd70 0x7f1e3c14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e43e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c06e870 con 0x7f1e3c15dd70 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e43e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c06e6f0 con 0x7f1e3c157c70 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e43e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3c06e9f0 con 0x7f1e3c0b4a90 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e3c15dd70 0x7f1e3c14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e3c15dd70 0x7f1e3c14a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53514/0 (socket says 172.21.15.17:53514) 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41e00640 1 -- 172.21.15.17:0/4176298190 learned_addr learned my addr 172.21.15.17:0/4176298190 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e40a00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e3c157c70 0x7f1e3c1f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41400640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e3c0b4a90 0x7f1e3c14e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41e00640 1 -- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e3c0b4a90 msgr2=0x7f1e3c14e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41e00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e3c0b4a90 0x7f1e3c14e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41e00640 1 -- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e3c157c70 msgr2=0x7f1e3c1f2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41e00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e3c157c70 0x7f1e3c1f2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41e00640 1 -- 172.21.15.17:0/4176298190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3c14f5a0 con 0x7f1e3c15dd70 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e40a00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e3c157c70 0x7f1e3c1f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e41e00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e3c15dd70 0x7f1e3c14a4e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400ea80 tx=0x7f1e3400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e39600640 1 -- 172.21.15.17:0/4176298190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400ce40 con 0x7f1e3c15dd70 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e39600640 1 -- 172.21.15.17:0/4176298190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e34004b30 con 0x7f1e3c15dd70 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e43e00640 1 -- 172.21.15.17:0/4176298190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3c1f3380 con 0x7f1e3c15dd70 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e39600640 1 -- 172.21.15.17:0/4176298190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e34005020 con 0x7f1e3c15dd70 2024-09-10T23:22:19.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.144+0000 7f1e43e00640 1 -- 172.21.15.17:0/4176298190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e3c14f2c0 con 0x7f1e3c15dd70 2024-09-10T23:22:19.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e39600640 1 -- 172.21.15.17:0/4176298190 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1e340051c0 con 0x7f1e3c15dd70 2024-09-10T23:22:19.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e39600640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e1c0725e0 0x7f1e1c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e471c5000 1 Processor -- start 2024-09-10T23:22:19.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e39600640 1 -- 172.21.15.17:0/4176298190 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6130+0+0 (secure 0 0 0) 0x7f1e34094070 con 0x7f1e3c15dd70 2024-09-10T23:22:19.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e471c5000 1 -- start start 2024-09-10T23:22:19.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41400640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e1c0725e0 0x7f1e1c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a59d0 0x5654346a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a62f0 0x5654346598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x56543465a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e471c5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56543457a3f0 con 0x5654346a59d0 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e471c5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5654344b7b20 con 0x5654346a62f0 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e471c5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5654344a6f50 con 0x565434659e10 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e40a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a62f0 0x5654346598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a59d0 0x5654346a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x56543465a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e40a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a62f0 0x5654346598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:39630/0 (socket says 172.21.15.17:39630) 2024-09-10T23:22:19.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e40a00640 1 -- 172.21.15.17:0/333988817 learned_addr learned my addr 172.21.15.17:0/333988817 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:19.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41e00640 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x56543465a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:50512/0 (socket says 172.21.15.17:50512) 2024-09-10T23:22:19.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41400640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e1c0725e0 0x7f1e1c074aa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1e300b2000 tx=0x7f1e3001bdb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:19.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41e00640 1 -- 172.21.15.17:0/333988817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a62f0 msgr2=0x5654346598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:22:19.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41e00640 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a62f0 0x5654346598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41e00640 1 -- 172.21.15.17:0/333988817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a59d0 msgr2=0x5654346a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:22:19.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41e00640 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a59d0 0x5654346a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41e00640 1 -- 172.21.15.17:0/333988817 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56543446e590 con 0x565434659e10 2024-09-10T23:22:19.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e40a00640 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a62f0 0x5654346598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:22:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.148+0000 7f1e41400640 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a59d0 0x5654346a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:22:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41e00640 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x56543465a1f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1e340923e0 tx=0x7f1e3405e860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc02b908bd7cec3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e2e000640 1 -- 172.21.15.17:0/333988817 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3405f590 con 0x565434659e10 2024-09-10T23:22:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e2e000640 1 -- 172.21.15.17:0/333988817 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3405ee90 con 0x565434659e10 2024-09-10T23:22:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e2e000640 1 -- 172.21.15.17:0/333988817 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e34063970 con 0x565434659e10 2024-09-10T23:22:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 -- 172.21.15.17:0/333988817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 msgr2=0x56543465a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x56543465a1f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1e340923e0 tx=0x7f1e3405e860 comp rx=0 tx=0).stop 2024-09-10T23:22:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 -- 172.21.15.17:0/333988817 shutdown_connections 2024-09-10T23:22:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x56543465a1f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a62f0 0x5654346598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 --2- 172.21.15.17:0/333988817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a59d0 0x5654346a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 -- 172.21.15.17:0/333988817 >> 172.21.15.17:0/333988817 conn(0x565434543130 msgr2=0x565434688e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 -- 172.21.15.17:0/333988817 shutdown_connections 2024-09-10T23:22:19.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 -- 172.21.15.17:0/333988817 wait complete. 2024-09-10T23:22:19.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 -- start start 2024-09-10T23:22:19.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 Processor -- start 2024-09-10T23:22:19.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565434659e10 0x56543465b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 0x56543465b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a62f0 0x56543465bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5654344415d0 con 0x565434659e10 2024-09-10T23:22:19.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5654344aad60 con 0x5654346a59d0 2024-09-10T23:22:19.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56543444d500 con 0x5654346a62f0 2024-09-10T23:22:19.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e471c5000 10 client.0 _ll_register_callbacks cb 0x565434451810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:22:19.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565434659e10 0x56543465b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565434659e10 0x56543465b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53534/0 (socket says 172.21.15.17:53534) 2024-09-10T23:22:19.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41400640 1 -- 172.21.15.17:0/1886296155 learned_addr learned my addr 172.21.15.17:0/1886296155 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:19.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e40a00640 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 0x56543465b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41e00640 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a62f0 0x56543465bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41400640 1 -- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a62f0 msgr2=0x56543465bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:22:19.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41400640 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a62f0 0x56543465bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41400640 1 -- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 msgr2=0x56543465b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:22:19.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41400640 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 0x56543465b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.152+0000 7f1e41400640 1 -- 172.21.15.17:0/1886296155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565434445170 con 0x565434659e10 2024-09-10T23:22:19.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e41400640 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565434659e10 0x56543465b240 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1e3001d6c0 tx=0x7f1e3001f010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b98d74c505bd694 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:19.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:22:19.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 1 -- 172.21.15.17:0/1886296155 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e300c7040 con 0x565434659e10 2024-09-10T23:22:19.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 1 -- 172.21.15.17:0/1886296155 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6130+0+0 (secure 0 0 0) 0x7f1e300cecd0 con 0x565434659e10 2024-09-10T23:22:19.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 -- 172.21.15.17:0/1886296155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56543443f0f0 con 0x565434659e10 2024-09-10T23:22:19.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 1 -- 172.21.15.17:0/1886296155 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f1e300b5040 con 0x565434659e10 2024-09-10T23:22:19.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 10 client.7962 fetch_fsmap learned FSMap version 86 2024-09-10T23:22:19.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 -- 172.21.15.17:0/1886296155 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x56543452bef0 con 0x565434659e10 2024-09-10T23:22:19.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 1 -- 172.21.15.17:0/1886296155 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56543443f0f0 con 0x565434659e10 2024-09-10T23:22:19.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 1 -- 172.21.15.17:0/1886296155 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f1e30003800 con 0x565434659e10 2024-09-10T23:22:19.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 10 client.7962 fetch_fsmap finished waiting for FSMap version 86 2024-09-10T23:22:19.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 10 client.7962 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:22:19.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 20 client.7962 populate_metadata read hostname 'smithi017' 2024-09-10T23:22:19.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5654346b4c70 0x5654346b7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 4 client.7962 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:22:19.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 -- 172.21.15.17:0/1886296155 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654344b9a70 con 0x5654346b4c70 2024-09-10T23:22:19.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e40a00640 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5654346b4c70 0x5654346b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e40a00640 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5654346b4c70 0x5654346b7060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7897cf228b1a32d server_cookie=e1317e7a6c0ab664 in_seq=0 out_seq=0 2024-09-10T23:22:19.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 10 client.7962 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:22:19.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 1 -- 172.21.15.17:0/1886296155 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654344b9a70 con 0x5654346b4c70 2024-09-10T23:22:19.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 10 client.7962 handle_command_reply: tid=0 2024-09-10T23:22:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 client.7962 shutdown 2024-09-10T23:22:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 -- 172.21.15.17:0/1886296155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565434659e10 msgr2=0x56543465b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565434659e10 0x56543465b240 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1e3001d6c0 tx=0x7f1e3001f010 comp rx=0 tx=0).stop 2024-09-10T23:22:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 -- 172.21.15.17:0/1886296155 shutdown_connections 2024-09-10T23:22:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5654346b4c70 0x5654346b7060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a62f0 0x56543465bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 0x56543465b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e22a00640 0 client.7962 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:22:19.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 --2- 172.21.15.17:0/1886296155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x565434659e10 0x56543465b240 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 -- 172.21.15.17:0/1886296155 >> 172.21.15.17:0/1886296155 conn(0x565434543130 msgr2=0x565434658fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:19.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 -- 172.21.15.17:0/1886296155 shutdown_connections 2024-09-10T23:22:19.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 1 -- 172.21.15.17:0/1886296155 wait complete. 2024-09-10T23:22:19.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.156+0000 7f1e471c5000 20 client.7962 trim_cache size 0 max 16384 2024-09-10T23:22:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e471c5000 1 Processor -- start 2024-09-10T23:22:19.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e471c5000 1 -- start start 2024-09-10T23:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x5654347173c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 0x565434717900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x565434717e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e471c5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c0cdfd0 con 0x5654346a62f0 2024-09-10T23:22:19.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e471c5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c1f6330 con 0x5654346a59d0 2024-09-10T23:22:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e471c5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3c0cd960 con 0x565434659e10 2024-09-10T23:22:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e41e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x565434717e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e41e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x565434717e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53544/0 (socket says 172.21.15.17:53544) 2024-09-10T23:22:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e41e00640 1 -- 172.21.15.17:0/3526960128 learned_addr learned my addr 172.21.15.17:0/3526960128 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e41400640 1 --2- 172.21.15.17:0/3526960128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x5654347173c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.176+0000 7f1e40a00640 1 --2- 172.21.15.17:0/3526960128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 0x565434717900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41e00640 1 -- 172.21.15.17:0/3526960128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 msgr2=0x5654347173c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41e00640 1 --2- 172.21.15.17:0/3526960128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x5654347173c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41e00640 1 -- 172.21.15.17:0/3526960128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 msgr2=0x565434717900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41e00640 1 --2- 172.21.15.17:0/3526960128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 0x565434717900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41e00640 1 -- 172.21.15.17:0/3526960128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565434502d90 con 0x5654346a62f0 2024-09-10T23:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41e00640 1 --2- 172.21.15.17:0/3526960128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x565434717e40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1e3405c100 tx=0x7f1e34062000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de304582ed99fed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e2d600640 1 -- 172.21.15.17:0/3526960128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3405ad30 con 0x5654346a62f0 2024-09-10T23:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e2d600640 1 -- 172.21.15.17:0/3526960128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e34078070 con 0x5654346a62f0 2024-09-10T23:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e2d600640 1 -- 172.21.15.17:0/3526960128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e34068390 con 0x5654346a62f0 2024-09-10T23:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 -- 172.21.15.17:0/3526960128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 msgr2=0x565434717e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 --2- 172.21.15.17:0/3526960128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x565434717e40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1e3405c100 tx=0x7f1e34062000 comp rx=0 tx=0).stop 2024-09-10T23:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 -- 172.21.15.17:0/3526960128 shutdown_connections 2024-09-10T23:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 --2- 172.21.15.17:0/3526960128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x565434717e40 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 --2- 172.21.15.17:0/3526960128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5654346a59d0 0x565434717900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 --2- 172.21.15.17:0/3526960128 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x565434659e10 0x5654347173c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 -- 172.21.15.17:0/3526960128 >> 172.21.15.17:0/3526960128 conn(0x565434543130 msgr2=0x5654346bce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 -- 172.21.15.17:0/3526960128 shutdown_connections 2024-09-10T23:22:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 -- 172.21.15.17:0/3526960128 wait complete. 2024-09-10T23:22:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 -- start start 2024-09-10T23:22:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 Processor -- start 2024-09-10T23:22:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565434659e10 0x5654346bba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a59d0 0x5654346d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x5654346d7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5654344aa070 con 0x5654346a62f0 2024-09-10T23:22:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5654344af390 con 0x565434659e10 2024-09-10T23:22:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x565434472ec0 con 0x5654346a59d0 2024-09-10T23:22:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e471c5000 10 client.0 _ll_register_callbacks cb 0x7f1e340093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:22:19.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x5654346d7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x5654346d7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53552/0 (socket says 172.21.15.17:53552) 2024-09-10T23:22:19.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41e00640 1 -- 172.21.15.17:0/4003026234 learned_addr learned my addr 172.21.15.17:0/4003026234 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:19.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e41400640 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565434659e10 0x5654346bba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.180+0000 7f1e40a00640 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a59d0 0x5654346d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e41e00640 1 -- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a59d0 msgr2=0x5654346d7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:22:19.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e41e00640 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a59d0 0x5654346d7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e41e00640 1 -- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565434659e10 msgr2=0x5654346bba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:22:19.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e41e00640 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565434659e10 0x5654346bba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e41e00640 1 -- 172.21.15.17:0/4003026234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56543446da90 con 0x5654346a62f0 2024-09-10T23:22:19.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e40a00640 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a59d0 0x5654346d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:22:19.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e41e00640 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x5654346d7ac0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f1e340923b0 tx=0x7f1e3405b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c7607065fcd2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:19.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:22:19.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 1 -- 172.21.15.17:0/4003026234 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3407d060 con 0x5654346a62f0 2024-09-10T23:22:19.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 1 -- 172.21.15.17:0/4003026234 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6130+0+0 (secure 0 0 0) 0x7f1e3408b0d0 con 0x5654346a62f0 2024-09-10T23:22:19.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 -- 172.21.15.17:0/4003026234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e34078070 con 0x5654346a62f0 2024-09-10T23:22:19.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 1 -- 172.21.15.17:0/4003026234 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f1e3405ad30 con 0x5654346a62f0 2024-09-10T23:22:19.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 10 client.7968 fetch_fsmap learned FSMap version 86 2024-09-10T23:22:19.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 -- 172.21.15.17:0/4003026234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x56543444c050 con 0x5654346a62f0 2024-09-10T23:22:19.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 1 -- 172.21.15.17:0/4003026234 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e34078070 con 0x5654346a62f0 2024-09-10T23:22:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 1 -- 172.21.15.17:0/4003026234 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f1e34086030 con 0x5654346a62f0 2024-09-10T23:22:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 10 client.7968 fetch_fsmap finished waiting for FSMap version 86 2024-09-10T23:22:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 10 client.7968 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:22:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 20 client.7968 populate_metadata read hostname 'smithi017' 2024-09-10T23:22:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5654346d8000 0x56543471b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 4 client.7968 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:22:19.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 -- 172.21.15.17:0/4003026234 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "status"}) -- 0x5654344b5520 con 0x5654346d8000 2024-09-10T23:22:19.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e41400640 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5654346d8000 0x56543471b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e41400640 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5654346d8000 0x56543471b820 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80225f93a0da6a1d server_cookie=b3ea7cf4ffbbc05 in_seq=0 out_seq=0 2024-09-10T23:22:19.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 10 client.7968 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:22:19.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 1 -- 172.21.15.17:0/4003026234 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5654344b5520 con 0x5654346d8000 2024-09-10T23:22:19.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 10 client.7968 handle_command_reply: tid=0 2024-09-10T23:22:19.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 client.7968 shutdown 2024-09-10T23:22:19.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 -- 172.21.15.17:0/4003026234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 msgr2=0x5654346d7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x5654346d7ac0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f1e340923b0 tx=0x7f1e3405b330 comp rx=0 tx=0).stop 2024-09-10T23:22:19.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 -- 172.21.15.17:0/4003026234 shutdown_connections 2024-09-10T23:22:19.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5654346d8000 0x56543471b820 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654346a62f0 0x5654346d7ac0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5654346a59d0 0x5654346d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 --2- 172.21.15.17:0/4003026234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x565434659e10 0x5654346bba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e22a00640 0 client.7968 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:22:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 -- 172.21.15.17:0/4003026234 >> 172.21.15.17:0/4003026234 conn(0x565434543130 msgr2=0x565434659470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 -- 172.21.15.17:0/4003026234 shutdown_connections 2024-09-10T23:22:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 1 -- 172.21.15.17:0/4003026234 wait complete. 2024-09-10T23:22:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.184+0000 7f1e471c5000 20 client.7968 trim_cache size 0 max 16384 2024-09-10T23:22:19.206 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:22:19.207 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:22:19.207 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:22:19.207 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7845, 2024-09-10T23:22:19.207 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:22:19.207 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:22:19.208 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:22:19.208 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.030969185, 2024-09-10T23:22:19.208 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 86, 2024-09-10T23:22:19.208 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 119, 2024-09-10T23:22:19.208 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 118, 2024-09-10T23:22:19.209 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 10.399317055999999 2024-09-10T23:22:19.209 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:22:19.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 -- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e1c0725e0 msgr2=0x7f1e1c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e1c0725e0 0x7f1e1c074aa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1e300b2000 tx=0x7f1e3001bdb0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 -- 172.21.15.17:0/4176298190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e3c15dd70 msgr2=0x7f1e3c14a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e3c15dd70 0x7f1e3c14a4e0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400ea80 tx=0x7f1e3400ef40 comp rx=0 tx=0).stop 2024-09-10T23:22:19.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 -- 172.21.15.17:0/4176298190 shutdown_connections 2024-09-10T23:22:19.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e1c0725e0 0x7f1e1c074aa0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e3c15dd70 0x7f1e3c14a4e0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e3c157c70 0x7f1e3c1f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 --2- 172.21.15.17:0/4176298190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e3c0b4a90 0x7f1e3c14e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 -- 172.21.15.17:0/4176298190 >> 172.21.15.17:0/4176298190 conn(0x7f1e3c0b1730 msgr2=0x7f1e3c15ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:19.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 -- 172.21.15.17:0/4176298190 shutdown_connections 2024-09-10T23:22:19.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.188+0000 7f1e43e00640 1 -- 172.21.15.17:0/4176298190 wait complete. 2024-09-10T23:22:19.213 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:22:19.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.360+0000 7f3a02e00640 1 -- 172.21.15.17:0/2222507306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0005920 msgr2=0x7f39e0005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.360+0000 7f3a02e00640 1 --2- 172.21.15.17:0/2222507306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0005920 0x7f39e0005da0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f39e4006f80 tx=0x7f39e401f5f0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.360+0000 7f3a02e00640 1 -- 172.21.15.17:0/2222507306 shutdown_connections 2024-09-10T23:22:19.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.360+0000 7f3a02e00640 1 --2- 172.21.15.17:0/2222507306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39e0005920 0x7f39e0005da0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.360+0000 7f3a02e00640 1 -- 172.21.15.17:0/2222507306 >> 172.21.15.17:0/2222507306 conn(0x7f39fc06cfc0 msgr2=0x7f39fc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:19.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.360+0000 7f3a02e00640 1 -- 172.21.15.17:0/2222507306 shutdown_connections 2024-09-10T23:22:19.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.360+0000 7f3a02e00640 1 -- 172.21.15.17:0/2222507306 wait complete. 2024-09-10T23:22:19.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.360+0000 7f3a02e00640 1 Processor -- start 2024-09-10T23:22:19.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 -- start start 2024-09-10T23:22:19.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39e0005920 0x7f39fc1f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39fc139e60 0x7f39fc13c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39fc13a2e0 0x7f39fc154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc15e110 con 0x7f39fc139e60 2024-09-10T23:22:19.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc15df90 con 0x7f39fc13a2e0 2024-09-10T23:22:19.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc15e290 con 0x7f39e0005920 2024-09-10T23:22:19.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39fc139e60 0x7f39fc13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39fc139e60 0x7f39fc13c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53570/0 (socket says 172.21.15.17:53570) 2024-09-10T23:22:19.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f3e00640 1 -- 172.21.15.17:0/1592805916 learned_addr learned my addr 172.21.15.17:0/1592805916 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:19.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39fbe00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39e0005920 0x7f39fc1f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a00e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39fc13a2e0 0x7f39fc154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f3e00640 1 -- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39e0005920 msgr2=0x7f39fc1f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f3e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39e0005920 0x7f39fc1f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f3e00640 1 -- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39fc13a2e0 msgr2=0x7f39fc154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f3e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39fc13a2e0 0x7f39fc154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f3e00640 1 -- 172.21.15.17:0/1592805916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc13d2f0 con 0x7f39fc139e60 2024-09-10T23:22:19.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f3e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39fc139e60 0x7f39fc13c850 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f39e4000c10 tx=0x7f39e4001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:19.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f8c00640 1 -- 172.21.15.17:0/1592805916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e40be070 con 0x7f39fc139e60 2024-09-10T23:22:19.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f8c00640 1 -- 172.21.15.17:0/1592805916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39e4006440 con 0x7f39fc139e60 2024-09-10T23:22:19.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc13d5d0 con 0x7f39fc139e60 2024-09-10T23:22:19.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f39f8c00640 1 -- 172.21.15.17:0/1592805916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4003860 con 0x7f39fc139e60 2024-09-10T23:22:19.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc14db50 con 0x7f39fc139e60 2024-09-10T23:22:19.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.364+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc1f7ec0 con 0x7f39fc139e60 2024-09-10T23:22:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.368+0000 7f39f8c00640 1 -- 172.21.15.17:0/1592805916 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f39e4003a00 con 0x7f39fc139e60 2024-09-10T23:22:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.368+0000 7f39f8c00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f39d8072610 0x7f39d8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.368+0000 7f39f8c00640 1 -- 172.21.15.17:0/1592805916 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7f39e4130680 con 0x7f39fc139e60 2024-09-10T23:22:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.368+0000 7f39fbe00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f39d8072610 0x7f39d8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:19.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.368+0000 7f39fbe00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f39d8072610 0x7f39d8074ad0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f39ec000c10 tx=0x7f39ec006b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:19.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.372+0000 7f39f8c00640 1 -- 172.21.15.17:0/1592805916 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f39e40193a0 con 0x7f39fc139e60 2024-09-10T23:22:19.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.580+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f39fc0d02f0 con 0x7f39fc139e60 2024-09-10T23:22:19.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f39f8c00640 1 -- 172.21.15.17:0/1592805916 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) ==== 53+0+73 (secure 0 0 0) 0x7f39e40fb4c0 con 0x7f39fc139e60 2024-09-10T23:22:19.584 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:22:19.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f39d8072610 msgr2=0x7f39d8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f39d8072610 0x7f39d8074ad0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f39ec000c10 tx=0x7f39ec006b20 comp rx=0 tx=0).stop 2024-09-10T23:22:19.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39fc139e60 msgr2=0x7f39fc13c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:19.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39fc139e60 0x7f39fc13c850 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f39e4000c10 tx=0x7f39e4001cb0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 shutdown_connections 2024-09-10T23:22:19.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f39d8072610 0x7f39d8074ad0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39fc13a2e0 0x7f39fc154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39fc139e60 0x7f39fc13c850 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 --2- 172.21.15.17:0/1592805916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39e0005920 0x7f39fc1f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:19.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 >> 172.21.15.17:0/1592805916 conn(0x7f39fc06cfc0 msgr2=0x7f39fc0b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:19.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 shutdown_connections 2024-09-10T23:22:19.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19.584+0000 7f3a02e00640 1 -- 172.21.15.17:0/1592805916 wait complete. 2024-09-10T23:22:19.605 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:22:19.605 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:22:19.605 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:22:19.605 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:22:19.605 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:22:19.605 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:22:19.605 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:22:19.606 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:22:19.606 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:22:19.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:19.606 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:22:19.615 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:22:19.615 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:22:19.615 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:22:19.615 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:22:19.615 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:22:19.615 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:22:19.615 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:22:19.615 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42032sec preferred_lft 42032sec 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:22:19.616 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:22:19.617 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:22:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:22:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:22:19.618 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:22:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:22:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:22:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:22:19.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:19.619 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:22:19.677 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:22:19.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:19.679 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:22:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:22:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:22:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:22:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:22:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:22:19.737 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:22:19.737 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:22:19.737 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:22:19.738 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:22:19.738 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:22:19.738 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:22:19.738 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:22:19.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:22:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:22:19.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:19.875 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:22:19.932 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:22:19.932 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:22:19.933 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:22:19.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:19.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:22:20.000 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:22:20.000 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:22:20.000 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:22:20.055 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:22:20.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:22:20.056 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:22:20.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:22:20.169 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:22:20.221 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:22:20.221 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:22:20.221 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:22:20.222 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:22:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:22:20.224 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:22:20.224 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:22:20.224 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:22:20.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:20.225 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:22:20.275 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:22:20.276 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:22:20.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:22:20.343 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:22:20.400 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:22:20.400 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:22:20.400 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:22:20.400 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:22:20.400 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:22:20.400 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:22:20.401 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:22:20.402 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:22:20.402 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:22:20.402 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:22:20.402 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:22:20.402 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:22:20.402 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:22:20.402 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:22:20.402 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:22:20.402 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:22:20.403 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:22:20.403 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:22:20.403 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:22:20.403 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:22:20.403 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:22:20.403 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:22:20.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:20.404 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:22:20.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:22:20.416+0000 7f8a9bb85580 -1 init, newargv = 0x562c3f2e7c40 newargc=15 2024-09-10T23:22:20.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[58903]: starting ceph client 2024-09-10T23:22:20.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[58903]: starting fuse 2024-09-10T23:22:20.427 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:22:20.427 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:22:20.428 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:22:20.429 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:22:20.430 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:22:20.430 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:22:20.430 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:22:20.554 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.58903.asok 2024-09-10T23:22:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:22:20.566 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58903.asok 2024-09-10T23:22:20.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:20.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58903.asok status 2024-09-10T23:22:20.739 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "58903", 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:22:20.740 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 7980, 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 7980 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 4007372063 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:22:20.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 4007372063 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.7980 192.168.0.1:0/4007372063", 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/4007372063", 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 86, 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 120, 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:22:20.742 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:22:20.743 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:22:20.743 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:22:20.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:20.754 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:22:20.754 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:22:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:22:20.764 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:22:20.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:20.764 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:22:20.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-10T23:22:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 -- 172.21.15.17:0/912109110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2370 msgr2=0x7ffb040b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 --2- 172.21.15.17:0/912109110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2370 0x7ffb040b50f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7ffb0408c6e0 tx=0x7ffaf401f0b0 comp rx=0 tx=0).stop 2024-09-10T23:22:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 -- 172.21.15.17:0/912109110 shutdown_connections 2024-09-10T23:22:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 --2- 172.21.15.17:0/912109110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb040b3c10 0x7ffb040b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 --2- 172.21.15.17:0/912109110 >> v2:172.21.15.77:3300/0 conn(0x7ffb040d2750 0x7ffb040b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 --2- 172.21.15.17:0/912109110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2370 0x7ffb040b50f0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 -- 172.21.15.17:0/912109110 >> 172.21.15.17:0/912109110 conn(0x7ffb0409d0b0 msgr2=0x7ffb040d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:21.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 -- 172.21.15.17:0/912109110 shutdown_connections 2024-09-10T23:22:21.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 -- 172.21.15.17:0/912109110 wait complete. 2024-09-10T23:22:21.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 Processor -- start 2024-09-10T23:22:21.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.020+0000 7ffb03200640 1 -- start start 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb03200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb040b3c10 0x7ffb04157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb03200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb040d2370 0x7ffb0415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb03200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2750 0x7ffb041f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb03200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb04161db0 con 0x7ffb040d2750 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb03200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb04161c30 con 0x7ffb040d2370 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb03200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffb04161f30 con 0x7ffb040b3c10 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb02800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2750 0x7ffb041f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb01e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb040b3c10 0x7ffb04157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb01e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb040b3c10 0x7ffb04157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:50564/0 (socket says 172.21.15.17:50564) 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb01e00640 1 -- 172.21.15.17:0/2620800074 learned_addr learned my addr 172.21.15.17:0/2620800074 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:22:21.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb02800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2750 0x7ffb041f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53592/0 (socket says 172.21.15.17:53592) 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb01400640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb040d2370 0x7ffb0415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb02800640 1 -- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb040b3c10 msgr2=0x7ffb04157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb02800640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb040b3c10 0x7ffb04157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb02800640 1 -- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb040d2370 msgr2=0x7ffb0415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb02800640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb040d2370 0x7ffb0415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb02800640 1 -- 172.21.15.17:0/2620800074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb040b7330 con 0x7ffb040d2750 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb02800640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2750 0x7ffb041f4660 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00ccb0 tx=0x7ffafc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffafa000640 1 -- 172.21.15.17:0/2620800074 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00f450 con 0x7ffb040d2750 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffafa000640 1 -- 172.21.15.17:0/2620800074 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffafc00f6e0 con 0x7ffb040d2750 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffafa000640 1 -- 172.21.15.17:0/2620800074 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00fb30 con 0x7ffb040d2750 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb040b7610 con 0x7ffb040d2750 2024-09-10T23:22:21.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb040b7bd0 con 0x7ffb040d2750 2024-09-10T23:22:21.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.024+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb040b2c00 con 0x7ffb040d2750 2024-09-10T23:22:21.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.028+0000 7ffafa000640 1 -- 172.21.15.17:0/2620800074 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffafc00fcd0 con 0x7ffb040d2750 2024-09-10T23:22:21.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.028+0000 7ffafa000640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffae40725e0 0x7ffae4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:22:21.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.028+0000 7ffafa000640 1 -- 172.21.15.17:0/2620800074 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7ffafc093db0 con 0x7ffb040d2750 2024-09-10T23:22:21.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.028+0000 7ffb01e00640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffae40725e0 0x7ffae4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:22:21.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.028+0000 7ffb01e00640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffae40725e0 0x7ffae4074aa0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffb040cb910 tx=0x7ffaf401d8f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:22:21.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.032+0000 7ffafa000640 1 -- 172.21.15.17:0/2620800074 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ffafc098070 con 0x7ffb040d2750 2024-09-10T23:22:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:21.248+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7ffb040d1ea0 con 0x7ffb040d2750 2024-09-10T23:22:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.204+0000 7ffafa000640 1 -- 172.21.15.17:0/2620800074 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v87) ==== 167+0+0 (secure 0 0 0) 0x7ffafc014030 con 0x7ffb040d2750 2024-09-10T23:22:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:enabled new snapshots 2024-09-10T23:22:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffae40725e0 msgr2=0x7ffae4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffae40725e0 0x7ffae4074aa0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffb040cb910 tx=0x7ffaf401d8f0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2750 msgr2=0x7ffb041f4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:22:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2750 0x7ffb041f4660 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00ccb0 tx=0x7ffafc00a620 comp rx=0 tx=0).stop 2024-09-10T23:22:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 shutdown_connections 2024-09-10T23:22:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffae40725e0 0x7ffae4074aa0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb040d2750 0x7ffb041f4660 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb040d2370 0x7ffb0415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 --2- 172.21.15.17:0/2620800074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb040b3c10 0x7ffb04157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:22:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 >> 172.21.15.17:0/2620800074 conn(0x7ffb0409d0b0 msgr2=0x7ffb040b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:22:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 shutdown_connections 2024-09-10T23:22:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:22:22.208+0000 7ffb03200640 1 -- 172.21.15.17:0/2620800074 wait complete. 2024-09-10T23:22:22.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:22:22.245 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-10T23:22:22.264 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:22:22.265 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:22:22.320 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:22:22.320 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:22:22.320 DEBUG:teuthology.orchestra.run.smithi017:> import uuid 2024-09-10T23:22:22.320 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:22:22.320 DEBUG:teuthology.orchestra.run.smithi017:> n = 2000 2024-09-10T23:22:22.320 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = False 2024-09-10T23:22:22.320 DEBUG:teuthology.orchestra.run.smithi017:> if 3 > 0: 2024-09-10T23:22:22.320 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = True 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> dpath = os.path.dirname(path) 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> fnameprefix = os.path.basename(path) 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> os.makedirs(dpath, exist_ok=True) 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> try: 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> for i in range(n): 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> with open(fpath, '"'"'w'"'"') as f: 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> f.write(f"{i}") 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:22:22.321 DEBUG:teuthology.orchestra.run.smithi017:> f.flush() 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f.fileno()) 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> os.unlink(fpath) 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> if create_hard_links: 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> for j in range(3): 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> finally: 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> os.close(dirfd) 2024-09-10T23:22:22.322 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:22:37.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:22:37.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:23:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:23:01.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:23:01.456 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-10T23:23:01.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:23:01.503 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-10T23:23:07.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:23:07.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:23:37.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:23:37.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:23:37.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:23:37.936 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-10T23:23:37.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-10T23:23:38.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 -- 172.21.15.17:0/1920685595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44072b70 msgr2=0x7f6b44072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 --2- 172.21.15.17:0/1920685595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44072b70 0x7f6b44072fa0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009900 tx=0x7f6b3401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 -- 172.21.15.17:0/1920685595 shutdown_connections 2024-09-10T23:23:38.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 --2- 172.21.15.17:0/1920685595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b440cc6f0 0x7f6b440ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 --2- 172.21.15.17:0/1920685595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44072b70 0x7f6b44072fa0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 -- 172.21.15.17:0/1920685595 >> 172.21.15.17:0/1920685595 conn(0x7f6b440b17a0 msgr2=0x7f6b440b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 -- 172.21.15.17:0/1920685595 shutdown_connections 2024-09-10T23:23:38.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 -- 172.21.15.17:0/1920685595 wait complete. 2024-09-10T23:23:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 Processor -- start 2024-09-10T23:23:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.131+0000 7f6b4c800640 1 -- start start 2024-09-10T23:23:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b4c800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b44072b70 0x7f6b44149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b4c800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b440cc6f0 0x7f6b44156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b4c800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4415a3a0 0x7f6b440cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b4c800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6b440cd410 con 0x7f6b440cc6f0 2024-09-10T23:23:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b4c800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b440cd290 con 0x7f6b4415a3a0 2024-09-10T23:23:38.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b4c800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6b440cd590 con 0x7f6b44072b70 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b440cc6f0 0x7f6b44156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b440cc6f0 0x7f6b44156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50688/0 (socket says 172.21.15.17:50688) 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49400640 1 -- 172.21.15.17:0/621225970 learned_addr learned my addr 172.21.15.17:0/621225970 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b4a800640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4415a3a0 0x7f6b440cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49e00640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b44072b70 0x7f6b44149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49400640 1 -- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b44072b70 msgr2=0x7f6b44149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49400640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b44072b70 0x7f6b44149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49400640 1 -- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4415a3a0 msgr2=0x7f6b440cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49400640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4415a3a0 0x7f6b440cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49400640 1 -- 172.21.15.17:0/621225970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b441f7380 con 0x7f6b440cc6f0 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b49400640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b440cc6f0 0x7f6b44156c40 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f6b340b0040 tx=0x7f6b34005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b3e000640 1 -- 172.21.15.17:0/621225970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340b2040 con 0x7f6b440cc6f0 2024-09-10T23:23:38.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b3e000640 1 -- 172.21.15.17:0/621225970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b34004130 con 0x7f6b440cc6f0 2024-09-10T23:23:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b3e000640 1 -- 172.21.15.17:0/621225970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34003600 con 0x7f6b440cc6f0 2024-09-10T23:23:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b4c800640 1 -- 172.21.15.17:0/621225970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b441f7640 con 0x7f6b440cc6f0 2024-09-10T23:23:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b4c800640 1 -- 172.21.15.17:0/621225970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b441f7c00 con 0x7f6b440cc6f0 2024-09-10T23:23:38.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.135+0000 7f6b3e000640 1 -- 172.21.15.17:0/621225970 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6b340037a0 con 0x7f6b440cc6f0 2024-09-10T23:23:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b3e000640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b28072610 0x7f6b28074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b3e000640 1 -- 172.21.15.17:0/621225970 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7f6b3412d6a0 con 0x7f6b440cc6f0 2024-09-10T23:23:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 Processor -- start 2024-09-10T23:23:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 -- start start 2024-09-10T23:23:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49e00640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b28072610 0x7f6b28074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49e00640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b28072610 0x7f6b28074ad0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6b38001780 tx=0x7f6b38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 0x5639183bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 0x563918376980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5639181742c0 con 0x5639183c03d0 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5639181d1b90 con 0x56391825e1d0 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5639181c0fc0 con 0x5639183765a0 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 0x5639183bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 0x563918376980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50696/0 (socket says 172.21.15.17:50696) 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49400640 1 -- 172.21.15.17:0/399902258 learned_addr learned my addr 172.21.15.17:0/399902258 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49400640 1 -- 172.21.15.17:0/399902258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 msgr2=0x563918376980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49400640 1 --2- 172.21.15.17:0/399902258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 0x563918376980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49400640 1 -- 172.21.15.17:0/399902258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 msgr2=0x5639183bfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49400640 1 --2- 172.21.15.17:0/399902258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 0x5639183bfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49400640 1 -- 172.21.15.17:0/399902258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391815f1a0 con 0x5639183c03d0 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49e00640 1 --2- 172.21.15.17:0/399902258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 0x5639183bfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b49400640 1 --2- 172.21.15.17:0/399902258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c07b0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f6b3401ce20 tx=0x7f6b34000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867ba475a4e7fff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b32a00640 1 -- 172.21.15.17:0/399902258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34101310 con 0x5639183c03d0 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b32a00640 1 -- 172.21.15.17:0/399902258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b340f8bc0 con 0x5639183c03d0 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b32a00640 1 -- 172.21.15.17:0/399902258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340f84c0 con 0x5639183c03d0 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 -- 172.21.15.17:0/399902258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 msgr2=0x5639183c07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/399902258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c07b0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f6b3401ce20 tx=0x7f6b34000bd0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 -- 172.21.15.17:0/399902258 shutdown_connections 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/399902258 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 0x563918376980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/399902258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c07b0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/399902258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 0x5639183bfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 -- 172.21.15.17:0/399902258 >> 172.21.15.17:0/399902258 conn(0x563917e7f880 msgr2=0x563918374e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 -- 172.21.15.17:0/399902258 shutdown_connections 2024-09-10T23:23:38.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.139+0000 7f6b4fbce000 1 -- 172.21.15.17:0/399902258 wait complete. 2024-09-10T23:23:38.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 -- start start 2024-09-10T23:23:38.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 Processor -- start 2024-09-10T23:23:38.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 0x5639183c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 0x5639183c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5639181664d0 con 0x5639183c03d0 2024-09-10T23:23:38.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5639181c4dd0 con 0x56391825e1d0 2024-09-10T23:23:38.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563917e86620 con 0x5639183765a0 2024-09-10T23:23:38.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 10 client.0 _ll_register_callbacks cb 0x563918197cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50706/0 (socket says 172.21.15.17:50706) 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4a800640 1 -- 172.21.15.17:0/3751666780 learned_addr learned my addr 172.21.15.17:0/3751666780 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b49400640 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 0x5639183c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b49e00640 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 0x5639183c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4a800640 1 -- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 msgr2=0x5639183c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4a800640 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 0x5639183c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4a800640 1 -- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 msgr2=0x5639183c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4a800640 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 0x5639183c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4a800640 1 -- 172.21.15.17:0/3751666780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563918290720 con 0x5639183c03d0 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4a800640 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c74a0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6b40012d20 tx=0x7f6b4000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67adb2355a6854e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b27400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b27400640 1 -- 172.21.15.17:0/3751666780 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400120d0 con 0x5639183c03d0 2024-09-10T23:23:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b27400640 1 -- 172.21.15.17:0/3751666780 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7f6b4001dc80 con 0x5639183c03d0 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3751666780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5639181592e0 con 0x5639183c03d0 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b27400640 1 -- 172.21.15.17:0/3751666780 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f6b40012270 con 0x5639183c03d0 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 10 client.7998 fetch_fsmap learned FSMap version 87 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3751666780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x563918246420 con 0x5639183c03d0 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b27400640 1 -- 172.21.15.17:0/3751666780 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5639181592e0 con 0x5639183c03d0 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b27400640 1 -- 172.21.15.17:0/3751666780 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f6b40024050 con 0x5639183c03d0 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 10 client.7998 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 10 client.7998 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 20 client.7998 populate_metadata read hostname 'smithi017' 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5639183cedf0 0x5639183d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 4 client.7998 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3751666780 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639181d3ae0 con 0x5639183cedf0 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.143+0000 7f6b49e00640 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5639183cedf0 0x5639183d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b49e00640 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5639183cedf0 0x5639183d11e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2355bfac17df1343 server_cookie=7d314aede9993b75 in_seq=0 out_seq=0 2024-09-10T23:23:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b27400640 10 client.7998 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b27400640 1 -- 172.21.15.17:0/3751666780 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639181d3ae0 con 0x5639183cedf0 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b27400640 10 client.7998 handle_command_reply: tid=0 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 client.7998 shutdown 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3751666780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 msgr2=0x5639183c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c74a0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6b40012d20 tx=0x7f6b4000f790 comp rx=0 tx=0).stop 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3751666780 shutdown_connections 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5639183cedf0 0x5639183d11e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x5639183c74a0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183765a0 0x5639183c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3751666780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56391825e1d0 0x5639183c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b27400640 0 client.7998 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3751666780 >> 172.21.15.17:0/3751666780 conn(0x563917e7f880 msgr2=0x563918375590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3751666780 shutdown_connections 2024-09-10T23:23:38.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3751666780 wait complete. 2024-09-10T23:23:38.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.147+0000 7f6b4fbce000 20 client.7998 trim_cache size 0 max 16384 2024-09-10T23:23:38.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b4fbce000 1 Processor -- start 2024-09-10T23:23:38.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b4fbce000 1 -- start start 2024-09-10T23:23:38.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56391825e1d0 0x563918374660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639183765a0 0x563918374ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183c03d0 0x5639183750e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44204290 con 0x56391825e1d0 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b442032d0 con 0x5639183765a0 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6b441fb430 con 0x5639183c03d0 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b49e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56391825e1d0 0x563918374660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b49e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56391825e1d0 0x563918374660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50718/0 (socket says 172.21.15.17:50718) 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.163+0000 7f6b49e00640 1 -- 172.21.15.17:0/3872958571 learned_addr learned my addr 172.21.15.17:0/3872958571 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b49e00640 1 -- 172.21.15.17:0/3872958571 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183c03d0 msgr2=0x5639183750e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b49e00640 1 --2- 172.21.15.17:0/3872958571 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183c03d0 0x5639183750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b49e00640 1 -- 172.21.15.17:0/3872958571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639183765a0 msgr2=0x563918374ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b49e00640 1 --2- 172.21.15.17:0/3872958571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639183765a0 0x563918374ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b49e00640 1 -- 172.21.15.17:0/3872958571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391821dae0 con 0x56391825e1d0 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b49e00640 1 --2- 172.21.15.17:0/3872958571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56391825e1d0 0x563918374660 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800fa40 tx=0x7f6b3800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8f1991cf76f174 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b32000640 1 -- 172.21.15.17:0/3872958571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38016d80 con 0x56391825e1d0 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b32000640 1 -- 172.21.15.17:0/3872958571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b3801b040 con 0x56391825e1d0 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b32000640 1 -- 172.21.15.17:0/3872958571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38016110 con 0x56391825e1d0 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3872958571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56391825e1d0 msgr2=0x563918374660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3872958571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56391825e1d0 0x563918374660 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800fa40 tx=0x7f6b3800a000 comp rx=0 tx=0).stop 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3872958571 shutdown_connections 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3872958571 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5639183c03d0 0x5639183750e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3872958571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639183765a0 0x563918374ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/3872958571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56391825e1d0 0x563918374660 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3872958571 >> 172.21.15.17:0/3872958571 conn(0x563917e7f880 msgr2=0x56391837b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3872958571 shutdown_connections 2024-09-10T23:23:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 -- 172.21.15.17:0/3872958571 wait complete. 2024-09-10T23:23:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 -- start start 2024-09-10T23:23:38.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 Processor -- start 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56391825e1d0 0x563918436790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639183765a0 0x563918436cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x563918437210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5639181872c0 con 0x5639183c03d0 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5639181c40e0 con 0x5639183765a0 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56391818cc50 con 0x56391825e1d0 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4fbce000 10 client.0 _ll_register_callbacks cb 0x7f6b40009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x563918437210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x563918437210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50722/0 (socket says 172.21.15.17:50722) 2024-09-10T23:23:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4a800640 1 -- 172.21.15.17:0/1859826471 learned_addr learned my addr 172.21.15.17:0/1859826471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b49e00640 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56391825e1d0 0x563918436790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b49400640 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639183765a0 0x563918436cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4a800640 1 -- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56391825e1d0 msgr2=0x563918436790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4a800640 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56391825e1d0 0x563918436790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4a800640 1 -- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639183765a0 msgr2=0x563918436cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4a800640 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639183765a0 0x563918436cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.167+0000 7f6b4a800640 1 -- 172.21.15.17:0/1859826471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391818b040 con 0x5639183c03d0 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4a800640 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x563918437210 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f6b40012a20 tx=0x7f6b40009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a27f22f60a0905 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 1 -- 172.21.15.17:0/1859826471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4002b060 con 0x5639183c03d0 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 1 -- 172.21.15.17:0/1859826471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7f6b40003e00 con 0x5639183c03d0 2024-09-10T23:23:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 -- 172.21.15.17:0/1859826471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b3801b040 con 0x5639183c03d0 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 1 -- 172.21.15.17:0/1859826471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f6b400120d0 con 0x5639183c03d0 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 10 client.8004 fetch_fsmap learned FSMap version 87 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 -- 172.21.15.17:0/1859826471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x563918157620 con 0x5639183c03d0 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 1 -- 172.21.15.17:0/1859826471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b3801b040 con 0x5639183c03d0 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 1 -- 172.21.15.17:0/1859826471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f6b40024040 con 0x5639183c03d0 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 10 client.8004 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 10 client.8004 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 20 client.8004 populate_metadata read hostname 'smithi017' 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5639183cc500 0x5639183cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 4 client.8004 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 -- 172.21.15.17:0/1859826471 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5639183d7500 con 0x5639183cc500 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b49e00640 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5639183cc500 0x5639183cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 10 client.8004 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b49e00640 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5639183cc500 0x5639183cc910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1036dce642e6206a server_cookie=1da6399821860fa6 in_seq=0 out_seq=0 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 1 -- 172.21.15.17:0/1859826471 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18092 (crc 0 0 0) 0x5639183d7500 con 0x5639183cc500 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 10 client.8004 handle_command_reply: tid=0 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 client.8004 shutdown 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 -- 172.21.15.17:0/1859826471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 msgr2=0x563918437210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x563918437210 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f6b40012a20 tx=0x7f6b40009570 comp rx=0 tx=0).stop 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 -- 172.21.15.17:0/1859826471 shutdown_connections 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5639183cc500 0x5639183cc910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5639183c03d0 0x563918437210 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5639183765a0 0x563918436cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b27400640 0 client.8004 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 --2- 172.21.15.17:0/1859826471 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56391825e1d0 0x563918436790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 -- 172.21.15.17:0/1859826471 >> 172.21.15.17:0/1859826471 conn(0x563917e7f880 msgr2=0x56391837b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 -- 172.21.15.17:0/1859826471 shutdown_connections 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 1 -- 172.21.15.17:0/1859826471 wait complete. 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4fbce000 20 client.8004 trim_cache size 0 max 16384 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1992, 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 1983, 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 601102, 2024-09-10T23:23:38.179 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 13245759, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 8, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 3, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.235479393, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.120585447, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.050514887, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.051274037, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1983, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.188542325, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000095079 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.180 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2, 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000106, 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000053 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 129216, 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 24048 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 2110, 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2130, 2024-09-10T23:23:38.181 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 525831, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 20617551, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 6, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.221201590, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.114157456, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.040756219, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.051054563, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2129, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.262647614, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000123366 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:23:38.182 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 121536 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 36577, 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 62488, 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 12864245, 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 77460221, 2024-09-10T23:23:38.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 8, 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 5.066321291, 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 2.782532058, 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 2.650008510, 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.101226549, 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 62487, 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.867867634, 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000029892 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:23:38.184 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 88084, 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.015043250, 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000170 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T23:23:38.185 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 9383, 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 13.024527355, 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001388098 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1485, 2024-09-10T23:23:38.186 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.406031867, 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000273422 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 28292, 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 28292, 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 28292, 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 230.112697192, 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.008133489 2024-09-10T23:23:38.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 0, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 12, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 19914, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 19914, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 0, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 19914, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 0, 2024-09-10T23:23:38.188 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 378, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 378, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 2, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 46036, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 45494, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 0, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 0, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 118, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2024-09-10T23:23:38.189 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T23:23:38.190 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 0, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 6156, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 6010, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 6156, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 2000, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 29, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 17842 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2024-09-10T23:23:38.191 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 0, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 2000, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 221, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 4187, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 1404, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 2246, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:23:38.192 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_succeeded": 0, 2024-09-10T23:23:38.193 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_write_failed": 0 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 21652, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 21652, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 28, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-09-10T23:23:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 28, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 3, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 81371358, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 0, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6598, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 67.009349377, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.010156009 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 0 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 2014, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 2014, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 0, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 13, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 13, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 0, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 19914, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 19914, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 0, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 378, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 2002, 2024-09-10T23:23:38.196 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 1624, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 106484, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 320610304 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 37293, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 28292, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 6, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 0, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2000, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.680741197, 2024-09-10T23:23:38.197 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000840370 2024-09-10T23:23:38.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.198 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-09-10T23:23:38.198 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2012, 2024-09-10T23:23:38.198 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.621495898, 2024-09-10T23:23:38.198 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000308894 2024-09-10T23:23:38.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.198 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-09-10T23:23:38.198 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.198 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6000, 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 11.391221936, 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001898536 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8021, 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 4.813104868, 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000600062 2024-09-10T23:23:38.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.200 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-09-10T23:23:38.200 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.200 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.200 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.200 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-09-10T23:23:38.200 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-09-10T23:23:38.201 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.022144866, 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.007381622 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.202 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.003296423, 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003296423 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.005847308, 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.005847308 2024-09-10T23:23:38.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6, 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.086643836, 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.014440639 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2246, 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 192.939766104, 2024-09-10T23:23:38.204 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.085903724 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-09-10T23:23:38.205 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.003678020, 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003678020 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.206 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000400600, 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000400600 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.207 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8000, 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 18.544356136, 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002318044 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:23:38.209 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2024-09-10T23:23:38.210 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 18357, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 18357, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 73, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:23:38.211 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:23:38.212 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-10T23:23:38.213 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 18072589, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 4597, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:23:38.214 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 5520, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 78, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 20365503, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 802960, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-10T23:23:38.215 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-10T23:23:38.216 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-10T23:23:38.216 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-10T23:23:38.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.216 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-09-10T23:23:38.216 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-09-10T23:23:38.217 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-09-10T23:23:38.217 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 8278, 2024-09-10T23:23:38.217 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 77349122, 2024-09-10T23:23:38.217 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 37, 2024-09-10T23:23:38.217 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 8278, 2024-09-10T23:23:38.217 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-09-10T23:23:38.217 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8278, 2024-09-10T23:23:38.217 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 21.871669871, 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002642144 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8278, 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 8351 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 8278, 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 65, 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 8213, 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-09-10T23:23:38.218 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 0, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 11, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 65, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 6663, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 41, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 1404, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 30, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-09-10T23:23:38.219 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-09-10T23:23:38.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 0, 2024-09-10T23:23:38.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 22, 2024-09-10T23:23:38.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:23:38.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-09-10T23:23:38.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:23:38.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-09-10T23:23:38.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-09-10T23:23:38.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-09-10T23:23:38.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-09-10T23:23:38.221 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 120, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 3, 2024-09-10T23:23:38.222 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 8, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 8, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 95, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 0, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 20 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 1, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-09-10T23:23:38.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 32, 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 32, 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 1404, 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 1404, 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:23:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 40675, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 10324797, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 40675, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 40675, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 10324797, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 8278, 2024-09-10T23:23:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 77502158, 2024-09-10T23:23:38.227 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 8278, 2024-09-10T23:23:38.227 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 77502158, 2024-09-10T23:23:38.227 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:23:38.227 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.227 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.227 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.227 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-09-10T23:23:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:23:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-09-10T23:23:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:23:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T23:23:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T23:23:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:23:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 8278, 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 8278, 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 8278, 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 8278, 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 1404, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 153036, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 1404, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:23:38.230 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 65, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 153036, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x55f346f88500": { 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 84, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 21652, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 77177054, 2024-09-10T23:23:38.231 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 21652, 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 6598, 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 77176970, 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "trackedop": { 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-09-10T23:23:38.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.233 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:23:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 -- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b28072610 msgr2=0x7f6b28074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b28072610 0x7f6b28074ad0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6b38001780 tx=0x7f6b38009040 comp rx=0 tx=0).stop 2024-09-10T23:23:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 -- 172.21.15.17:0/621225970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b440cc6f0 msgr2=0x7f6b44156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b440cc6f0 0x7f6b44156c40 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f6b340b0040 tx=0x7f6b34005e70 comp rx=0 tx=0).stop 2024-09-10T23:23:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 -- 172.21.15.17:0/621225970 shutdown_connections 2024-09-10T23:23:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b28072610 0x7f6b28074ad0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4415a3a0 0x7f6b440cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b440cc6f0 0x7f6b44156c40 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 --2- 172.21.15.17:0/621225970 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b44072b70 0x7f6b44149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 -- 172.21.15.17:0/621225970 >> 172.21.15.17:0/621225970 conn(0x7f6b440b17a0 msgr2=0x7f6b441589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 -- 172.21.15.17:0/621225970 shutdown_connections 2024-09-10T23:23:38.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.171+0000 7f6b4c800640 1 -- 172.21.15.17:0/621225970 wait complete. 2024-09-10T23:23:38.235 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-10T23:23:38.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:23:38.236 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-09-10T23:23:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.407+0000 7f4686600640 1 -- 172.21.15.17:0/559306471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f468015f600 msgr2=0x7f46800cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.407+0000 7f4686600640 1 --2- 172.21.15.17:0/559306471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f468015f600 0x7f46800cc900 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4670009840 tx=0x7f467001c820 comp rx=0 tx=0).stop 2024-09-10T23:23:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.407+0000 7f4686600640 1 -- 172.21.15.17:0/559306471 shutdown_connections 2024-09-10T23:23:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.407+0000 7f4686600640 1 --2- 172.21.15.17:0/559306471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f468015f600 0x7f46800cc900 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.407+0000 7f4686600640 1 -- 172.21.15.17:0/559306471 >> 172.21.15.17:0/559306471 conn(0x7f468009b080 msgr2=0x7f46800d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.407+0000 7f4686600640 1 -- 172.21.15.17:0/559306471 shutdown_connections 2024-09-10T23:23:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.407+0000 7f4686600640 1 -- 172.21.15.17:0/559306471 wait complete. 2024-09-10T23:23:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 Processor -- start 2024-09-10T23:23:38.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 -- start start 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46800b0990 0x7f46800b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46800b28e0 0x7f46800c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f468015f600 0x7f468015c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46800cd1d0 con 0x7f468015f600 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46800cd050 con 0x7f46800b28e0 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f468016a3d0 con 0x7f46800b0990 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f468015f600 0x7f468015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f468015f600 0x7f468015c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50730/0 (socket says 172.21.15.17:50730) 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467fe00640 1 -- 172.21.15.17:0/1389953426 learned_addr learned my addr 172.21.15.17:0/1389953426 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467f400640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46800b0990 0x7f46800b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4677e00640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46800b28e0 0x7f46800c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467fe00640 1 -- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46800b0990 msgr2=0x7f46800b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467fe00640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46800b0990 0x7f46800b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467fe00640 1 -- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46800b28e0 msgr2=0x7f46800c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467fe00640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46800b28e0 0x7f46800c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467fe00640 1 -- 172.21.15.17:0/1389953426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46800b07c0 con 0x7f468015f600 2024-09-10T23:23:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4677e00640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46800b28e0 0x7f46800c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:23:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f467fe00640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f468015f600 0x7f468015c160 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f467800cbf0 tx=0x7f467800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4677400640 1 -- 172.21.15.17:0/1389953426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678016020 con 0x7f468015f600 2024-09-10T23:23:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4677400640 1 -- 172.21.15.17:0/1389953426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f467800ab40 con 0x7f468015f600 2024-09-10T23:23:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4677400640 1 -- 172.21.15.17:0/1389953426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678012420 con 0x7f468015f600 2024-09-10T23:23:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 -- 172.21.15.17:0/1389953426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46800b4d90 con 0x7f468015f600 2024-09-10T23:23:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.411+0000 7f4686600640 1 -- 172.21.15.17:0/1389953426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46800b5350 con 0x7f468015f600 2024-09-10T23:23:38.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.415+0000 7f4677400640 1 -- 172.21.15.17:0/1389953426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f46780125c0 con 0x7f468015f600 2024-09-10T23:23:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.415+0000 7f4677400640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f465c0725e0 0x7f465c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.415+0000 7f4677400640 1 -- 172.21.15.17:0/1389953426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7f4678093880 con 0x7f468015f600 2024-09-10T23:23:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.415+0000 7f467f400640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f465c0725e0 0x7f465c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.415+0000 7f4689976000 1 Processor -- start 2024-09-10T23:23:38.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.415+0000 7f4689976000 1 -- start start 2024-09-10T23:23:38.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f465c0725e0 0x7f465c074aa0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f46700af000 tx=0x7f467001b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afad010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 0x56498af63340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 0x56498af63c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56498adbea40 con 0x56498afacc30 2024-09-10T23:23:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56498adade70 con 0x56498afad550 2024-09-10T23:23:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56498adb1c80 con 0x56498af63880 2024-09-10T23:23:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50736/0 (socket says 172.21.15.17:50736) 2024-09-10T23:23:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 -- 172.21.15.17:0/2837679707 learned_addr learned my addr 172.21.15.17:0/2837679707 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4677e00640 1 --2- 172.21.15.17:0/2837679707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 0x56498af63340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467fe00640 1 --2- 172.21.15.17:0/2837679707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 0x56498af63c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 -- 172.21.15.17:0/2837679707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 msgr2=0x56498af63c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 --2- 172.21.15.17:0/2837679707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 0x56498af63c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 -- 172.21.15.17:0/2837679707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 msgr2=0x56498af63340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 --2- 172.21.15.17:0/2837679707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 0x56498af63340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 -- 172.21.15.17:0/2837679707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56498adf7040 con 0x56498afacc30 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f467f400640 1 --2- 172.21.15.17:0/2837679707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afad010 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f467001a450 tx=0x7f46700b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356325822adb5949 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f466fe00640 1 -- 172.21.15.17:0/2837679707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46700bb070 con 0x56498afacc30 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f466fe00640 1 -- 172.21.15.17:0/2837679707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46700c7070 con 0x56498afacc30 2024-09-10T23:23:38.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f466fe00640 1 -- 172.21.15.17:0/2837679707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46700b2040 con 0x56498afacc30 2024-09-10T23:23:38.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 -- 172.21.15.17:0/2837679707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 msgr2=0x56498afad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 --2- 172.21.15.17:0/2837679707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afad010 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f467001a450 tx=0x7f46700b6000 comp rx=0 tx=0).stop 2024-09-10T23:23:38.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 -- 172.21.15.17:0/2837679707 shutdown_connections 2024-09-10T23:23:38.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 --2- 172.21.15.17:0/2837679707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 0x56498af63c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 --2- 172.21.15.17:0/2837679707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 0x56498af63340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 --2- 172.21.15.17:0/2837679707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afad010 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 -- 172.21.15.17:0/2837679707 >> 172.21.15.17:0/2837679707 conn(0x56498af5f800 msgr2=0x56498af61c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 -- 172.21.15.17:0/2837679707 shutdown_connections 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 -- 172.21.15.17:0/2837679707 wait complete. 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 -- start start 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.419+0000 7f4689976000 1 Processor -- start 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 0x56498afb3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 0x56498afb4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56498adf1b60 con 0x56498afacc30 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56498ad57950 con 0x56498afad550 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56498ad63bb0 con 0x56498af63880 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 10 client.0 _ll_register_callbacks cb 0x56498ad543f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4677e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4677e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50746/0 (socket says 172.21.15.17:50746) 2024-09-10T23:23:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4677e00640 1 -- 172.21.15.17:0/1584819877 learned_addr learned my addr 172.21.15.17:0/1584819877 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467fe00640 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 0x56498afb4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467f400640 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 0x56498afb3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467fe00640 1 -- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 msgr2=0x56498afb3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467fe00640 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 0x56498afb3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467fe00640 1 -- 172.21.15.17:0/1584819877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 msgr2=0x56498afb40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467fe00640 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467fe00640 1 -- 172.21.15.17:0/1584819877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56498ad56b30 con 0x56498afad550 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467fe00640 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 0x56498afb4620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f467800cbc0 tx=0x7f467805e1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=287827712eedfa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f466cc00640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f466cc00640 1 -- 172.21.15.17:0/1584819877 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467805db00 con 0x56498afad550 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f466cc00640 1 -- 172.21.15.17:0/1584819877 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7f4678065390 con 0x56498afad550 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 -- 172.21.15.17:0/1584819877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56498ad461e0 con 0x56498afad550 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f466cc00640 1 -- 172.21.15.17:0/1584819877 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f467808f050 con 0x56498afad550 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 10 client.7528 fetch_fsmap learned FSMap version 87 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 -- 172.21.15.17:0/1584819877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x56498ad4c0a0 con 0x56498afad550 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f466cc00640 1 -- 172.21.15.17:0/1584819877 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56498ad461e0 con 0x56498afad550 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f466cc00640 1 -- 172.21.15.17:0/1584819877 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f4678059ff0 con 0x56498afad550 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 10 client.7528 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 10 client.7528 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:23:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 20 client.7528 populate_metadata read hostname 'smithi017' 2024-09-10T23:23:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x56498afbbf70 0x56498afbe360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 4 client.7528 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:23:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f4689976000 1 -- 172.21.15.17:0/1584819877 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56498adc0990 con 0x56498afbbf70 2024-09-10T23:23:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467f400640 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x56498afbbf70 0x56498afbe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f467f400640 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x56498afbbf70 0x56498afbe360 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94907cb4e1970f41 server_cookie=335fd59263fe6bd8 in_seq=0 out_seq=0 2024-09-10T23:23:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.423+0000 7f466cc00640 10 client.7528 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f466cc00640 1 -- 172.21.15.17:0/1584819877 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56498adc0990 con 0x56498afbbf70 2024-09-10T23:23:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f466cc00640 10 client.7528 handle_command_reply: tid=0 2024-09-10T23:23:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 client.7528 shutdown 2024-09-10T23:23:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 -- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 msgr2=0x56498afb4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 0x56498afb4620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f467800cbc0 tx=0x7f467805e1b0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 -- 172.21.15.17:0/1584819877 shutdown_connections 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x56498afbbf70 0x56498afbe360 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498afad550 0x56498afb4620 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f466cc00640 0 client.7528 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 --2- 172.21.15.17:0/1584819877 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af63880 0x56498afb3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 -- 172.21.15.17:0/1584819877 >> 172.21.15.17:0/1584819877 conn(0x56498af5f800 msgr2=0x56498af62410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 -- 172.21.15.17:0/1584819877 shutdown_connections 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 1 -- 172.21.15.17:0/1584819877 wait complete. 2024-09-10T23:23:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.427+0000 7f4689976000 20 client.7528 trim_cache size 0 max 16384 2024-09-10T23:23:38.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.443+0000 7f4689976000 1 Processor -- start 2024-09-10T23:23:38.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.443+0000 7f4689976000 1 -- start start 2024-09-10T23:23:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 0x56498afabe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 0x56498afac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4680203450 con 0x56498afacc30 2024-09-10T23:23:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46800c6190 con 0x56498af63880 2024-09-10T23:23:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4680202e00 con 0x56498af5f800 2024-09-10T23:23:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 0x56498afabe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50758/0 (socket says 172.21.15.17:50758) 2024-09-10T23:23:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467fe00640 1 -- 172.21.15.17:0/1105657656 learned_addr learned my addr 172.21.15.17:0/1105657656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4677e00640 1 --2- 172.21.15.17:0/1105657656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 0x56498afac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467fe00640 1 -- 172.21.15.17:0/1105657656 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 msgr2=0x56498afabe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467fe00640 1 --2- 172.21.15.17:0/1105657656 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 0x56498afabe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467fe00640 1 -- 172.21.15.17:0/1105657656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 msgr2=0x56498afac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467fe00640 1 --2- 172.21.15.17:0/1105657656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 0x56498afac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467fe00640 1 -- 172.21.15.17:0/1105657656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56498ae32dc0 con 0x56498afacc30 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f467fe00640 1 --2- 172.21.15.17:0/1105657656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb9ba0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f467800a430 tx=0x7f4678001370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8052778ecb06c9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f466f400640 1 -- 172.21.15.17:0/1105657656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678078320 con 0x56498afacc30 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f466f400640 1 -- 172.21.15.17:0/1105657656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4678087020 con 0x56498afacc30 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f466f400640 1 -- 172.21.15.17:0/1105657656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678067ba0 con 0x56498afacc30 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- 172.21.15.17:0/1105657656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 msgr2=0x56498afb9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- 172.21.15.17:0/1105657656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb9ba0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f467800a430 tx=0x7f4678001370 comp rx=0 tx=0).stop 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- 172.21.15.17:0/1105657656 shutdown_connections 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- 172.21.15.17:0/1105657656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498afb9ba0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- 172.21.15.17:0/1105657656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 0x56498afac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- 172.21.15.17:0/1105657656 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 0x56498afabe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- 172.21.15.17:0/1105657656 >> 172.21.15.17:0/1105657656 conn(0x56498af65a20 msgr2=0x56498afab750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- 172.21.15.17:0/1105657656 shutdown_connections 2024-09-10T23:23:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- 172.21.15.17:0/1105657656 wait complete. 2024-09-10T23:23:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- start start 2024-09-10T23:23:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 Processor -- start 2024-09-10T23:23:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 0x56498b023b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 0x56498b024060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498b0245a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56498ad79f40 con 0x56498afacc30 2024-09-10T23:23:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56498ad79760 con 0x56498af63880 2024-09-10T23:23:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.447+0000 7f4689976000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56498adb0f90 con 0x56498af5f800 2024-09-10T23:23:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 10 client.0 _ll_register_callbacks cb 0x7f467805a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498b0245a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4677e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 0x56498b024060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 0x56498b023b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498b0245a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50760/0 (socket says 172.21.15.17:50760) 2024-09-10T23:23:38.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467fe00640 1 -- 172.21.15.17:0/2335660500 learned_addr learned my addr 172.21.15.17:0/2335660500 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4677e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 0x56498b024060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:35386/0 (socket says 172.21.15.17:35386) 2024-09-10T23:23:38.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467fe00640 1 -- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 msgr2=0x56498b023b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467fe00640 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 0x56498b023b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467fe00640 1 -- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 msgr2=0x56498b024060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467fe00640 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 0x56498b024060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467fe00640 1 -- 172.21.15.17:0/2335660500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56498ad44620 con 0x56498afacc30 2024-09-10T23:23:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467fe00640 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498b0245a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f467800afd0 tx=0x7f467805e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc4a769a88400c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f466cc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:23:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f466cc00640 1 -- 172.21.15.17:0/2335660500 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678065590 con 0x56498afacc30 2024-09-10T23:23:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f466cc00640 1 -- 172.21.15.17:0/2335660500 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7f467805d370 con 0x56498afacc30 2024-09-10T23:23:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 1 -- 172.21.15.17:0/2335660500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4678087020 con 0x56498afacc30 2024-09-10T23:23:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f466cc00640 1 -- 172.21.15.17:0/2335660500 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f467807d050 con 0x56498afacc30 2024-09-10T23:23:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 10 client.8022 fetch_fsmap learned FSMap version 87 2024-09-10T23:23:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 1 -- 172.21.15.17:0/2335660500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x56498ad76af0 con 0x56498afacc30 2024-09-10T23:23:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f466cc00640 1 -- 172.21.15.17:0/2335660500 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4678087020 con 0x56498afacc30 2024-09-10T23:23:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f466cc00640 1 -- 172.21.15.17:0/2335660500 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f467805d570 con 0x56498afacc30 2024-09-10T23:23:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 10 client.8022 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:23:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 10 client.8022 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:23:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 20 client.8022 populate_metadata read hostname 'smithi017' 2024-09-10T23:23:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x56498afad550 0x56498afb92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 4 client.8022 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-10T23:23:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f4689976000 1 -- 172.21.15.17:0/2335660500 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x56498afc4680 con 0x56498afad550 2024-09-10T23:23:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467f400640 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x56498afad550 0x56498afb92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f467f400640 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x56498afad550 0x56498afb92d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=812c23386cca263a server_cookie=92fd3c9513362463 in_seq=0 out_seq=0 2024-09-10T23:23:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.451+0000 7f466cc00640 10 client.8022 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f466cc00640 1 -- 172.21.15.17:0/2335660500 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56498afc4680 con 0x56498afad550 2024-09-10T23:23:38.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f466cc00640 10 client.8022 handle_command_reply: tid=0 2024-09-10T23:23:38.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 client.8022 shutdown 2024-09-10T23:23:38.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 -- 172.21.15.17:0/2335660500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 msgr2=0x56498b0245a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498b0245a0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f467800afd0 tx=0x7f467805e570 comp rx=0 tx=0).stop 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 -- 172.21.15.17:0/2335660500 shutdown_connections 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x56498afad550 0x56498afb92d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56498afacc30 0x56498b0245a0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56498af63880 0x56498b024060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 --2- 172.21.15.17:0/2335660500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56498af5f800 0x56498b023b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f466cc00640 0 client.8022 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 -- 172.21.15.17:0/2335660500 >> 172.21.15.17:0/2335660500 conn(0x56498af65a20 msgr2=0x56498afabf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 -- 172.21.15.17:0/2335660500 shutdown_connections 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 1 -- 172.21.15.17:0/2335660500 wait complete. 2024-09-10T23:23:38.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4689976000 20 client.8022 trim_cache size 0 max 16384 2024-09-10T23:23:38.464 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:23:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:23:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "46e95cea-3df0-48f4-9bbf-e0499f03bd15", 2024-09-10T23:23:38.464 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:23:38.464 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:23:38.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 -- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f465c0725e0 msgr2=0x7f465c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f465c0725e0 0x7f465c074aa0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f46700af000 tx=0x7f467001b060 comp rx=0 tx=0).stop 2024-09-10T23:23:38.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 -- 172.21.15.17:0/1389953426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f468015f600 msgr2=0x7f468015c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f468015f600 0x7f468015c160 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f467800cbf0 tx=0x7f467800cc20 comp rx=0 tx=0).stop 2024-09-10T23:23:38.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 -- 172.21.15.17:0/1389953426 shutdown_connections 2024-09-10T23:23:38.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f465c0725e0 0x7f465c074aa0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f468015f600 0x7f468015c160 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46800b28e0 0x7f46800c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 --2- 172.21.15.17:0/1389953426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46800b0990 0x7f46800b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 -- 172.21.15.17:0/1389953426 >> 172.21.15.17:0/1389953426 conn(0x7f468009b080 msgr2=0x7f46800ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 -- 172.21.15.17:0/1389953426 shutdown_connections 2024-09-10T23:23:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.459+0000 7f4686600640 1 -- 172.21.15.17:0/1389953426 wait complete. 2024-09-10T23:23:38.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:23:38.482 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-10T23:23:38.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.635+0000 7ff7a9200640 1 -- 172.21.15.17:0/1784611077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a40b39d0 msgr2=0x7ff7a406f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.635+0000 7ff7a9200640 1 --2- 172.21.15.17:0/1784611077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a40b39d0 0x7ff7a406f010 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff79c009bc0 tx=0x7ff79c01cb70 comp rx=0 tx=0).stop 2024-09-10T23:23:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.635+0000 7ff7a9200640 1 -- 172.21.15.17:0/1784611077 shutdown_connections 2024-09-10T23:23:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.635+0000 7ff7a9200640 1 --2- 172.21.15.17:0/1784611077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a40b39d0 0x7ff7a406f010 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.635+0000 7ff7a9200640 1 --2- 172.21.15.17:0/1784611077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7a406e3e0 0x7ff7a40b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.635+0000 7ff7a9200640 1 -- 172.21.15.17:0/1784611077 >> 172.21.15.17:0/1784611077 conn(0x7ff7a40b2720 msgr2=0x7ff7a40d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.635+0000 7ff7a9200640 1 -- 172.21.15.17:0/1784611077 shutdown_connections 2024-09-10T23:23:38.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.635+0000 7ff7a9200640 1 -- 172.21.15.17:0/1784611077 wait complete. 2024-09-10T23:23:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a9200640 1 Processor -- start 2024-09-10T23:23:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a9200640 1 -- start start 2024-09-10T23:23:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7a406e3e0 0x7ff7a4150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a9200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7a40b39d0 0x7ff7a4150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a9200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a4151b50 0x7ff7a4153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a9200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a41678f0 con 0x7ff7a406e3e0 2024-09-10T23:23:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a9200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a40702f0 con 0x7ff7a4151b50 2024-09-10T23:23:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a9200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a4167a70 con 0x7ff7a40b39d0 2024-09-10T23:23:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7a406e3e0 0x7ff7a4150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7a406e3e0 0x7ff7a4150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50764/0 (socket says 172.21.15.17:50764) 2024-09-10T23:23:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3400640 1 -- 172.21.15.17:0/2686364057 learned_addr learned my addr 172.21.15.17:0/2686364057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3e00640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a4151b50 0x7ff7a4153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff79be00640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7a40b39d0 0x7ff7a4150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3400640 1 -- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7a40b39d0 msgr2=0x7ff7a4150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3400640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7a40b39d0 0x7ff7a4150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3400640 1 -- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a4151b50 msgr2=0x7ff7a4153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3400640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a4151b50 0x7ff7a4153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3400640 1 -- 172.21.15.17:0/2686364057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a415f100 con 0x7ff7a406e3e0 2024-09-10T23:23:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a3400640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7a406e3e0 0x7ff7a4150a20 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff79400c430 tx=0x7ff79400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff79b400640 1 -- 172.21.15.17:0/2686364057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794011790 con 0x7ff7a406e3e0 2024-09-10T23:23:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff79b400640 1 -- 172.21.15.17:0/2686364057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff794017070 con 0x7ff7a406e3e0 2024-09-10T23:23:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff79b400640 1 -- 172.21.15.17:0/2686364057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794011ce0 con 0x7ff7a406e3e0 2024-09-10T23:23:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.639+0000 7ff7a9200640 1 -- 172.21.15.17:0/2686364057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a415eb40 con 0x7ff7a406e3e0 2024-09-10T23:23:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.643+0000 7ff7a9200640 1 -- 172.21.15.17:0/2686364057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a41510c0 con 0x7ff7a406e3e0 2024-09-10T23:23:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.643+0000 7ff79b400640 1 -- 172.21.15.17:0/2686364057 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff79401c460 con 0x7ff7a406e3e0 2024-09-10T23:23:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.643+0000 7ff79b400640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff780072610 0x7ff780074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.643+0000 7ff7adb52000 1 Processor -- start 2024-09-10T23:23:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.643+0000 7ff79b400640 1 -- 172.21.15.17:0/2686364057 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7ff794092ff0 con 0x7ff7a406e3e0 2024-09-10T23:23:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.643+0000 7ff7adb52000 1 -- start start 2024-09-10T23:23:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff780072610 0x7ff780074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef6d4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef68a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 0x5617ef68afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff780072610 0x7ff780074ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40b1740 tx=0x7ff78c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5617ef572cb0 con 0x5617ef6d4ac0 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5617ef488310 con 0x5617ef68abc0 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5617ef4e5b90 con 0x5617ef6d41a0 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef68a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef68a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50778/0 (socket says 172.21.15.17:50778) 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 -- 172.21.15.17:0/3377289405 learned_addr learned my addr 172.21.15.17:0/3377289405 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7a3400640 1 --2- 172.21.15.17:0/3377289405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef6d4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7a3e00640 1 --2- 172.21.15.17:0/3377289405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 0x5617ef68afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 -- 172.21.15.17:0/3377289405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 msgr2=0x5617ef6d4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 --2- 172.21.15.17:0/3377289405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef6d4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 -- 172.21.15.17:0/3377289405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 msgr2=0x5617ef68afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 --2- 172.21.15.17:0/3377289405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 0x5617ef68afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 -- 172.21.15.17:0/3377289405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ef489c60 con 0x5617ef6d4ac0 2024-09-10T23:23:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff79be00640 1 --2- 172.21.15.17:0/3377289405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef68a680 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff78c004250 tx=0x7ff78c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2322ba3c6d5730ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff793e00640 1 -- 172.21.15.17:0/3377289405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c005020 con 0x5617ef6d4ac0 2024-09-10T23:23:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff793e00640 1 -- 172.21.15.17:0/3377289405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff78c0052b0 con 0x5617ef6d4ac0 2024-09-10T23:23:38.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff793e00640 1 -- 172.21.15.17:0/3377289405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0047b0 con 0x5617ef6d4ac0 2024-09-10T23:23:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 -- 172.21.15.17:0/3377289405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 msgr2=0x5617ef68a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3377289405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef68a680 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff78c004250 tx=0x7ff78c014000 comp rx=0 tx=0).stop 2024-09-10T23:23:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 -- 172.21.15.17:0/3377289405 shutdown_connections 2024-09-10T23:23:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3377289405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 0x5617ef68afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3377289405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef68a680 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3377289405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef6d4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 -- 172.21.15.17:0/3377289405 >> 172.21.15.17:0/3377289405 conn(0x5617ef690d20 msgr2=0x5617ef688f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 -- 172.21.15.17:0/3377289405 shutdown_connections 2024-09-10T23:23:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 -- 172.21.15.17:0/3377289405 wait complete. 2024-09-10T23:23:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.647+0000 7ff7adb52000 1 -- start start 2024-09-10T23:23:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 Processor -- start 2024-09-10T23:23:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 0x5617ef6db530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef6dba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef6dbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5617ef4d8dd0 con 0x5617ef6d4ac0 2024-09-10T23:23:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5617ef4d4fc0 con 0x5617ef68abc0 2024-09-10T23:23:38.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5617ef47a4b0 con 0x5617ef6d41a0 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 10 client.0 _ll_register_callbacks cb 0x5617ef4587d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef6dbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef6dbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50782/0 (socket says 172.21.15.17:50782) 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3e00640 1 -- 172.21.15.17:0/1501603293 learned_addr learned my addr 172.21.15.17:0/1501603293 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3400640 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 0x5617ef6db530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff79be00640 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef6dba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3e00640 1 -- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 msgr2=0x5617ef6dba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3e00640 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef6dba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3e00640 1 -- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 msgr2=0x5617ef6db530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3e00640 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 0x5617ef6db530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3e00640 1 -- 172.21.15.17:0/1501603293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ef4731f0 con 0x5617ef6d4ac0 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3400640 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 0x5617ef6db530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:23:38.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3e00640 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef6dbfb0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ff79c01b220 tx=0x7ff79c0a5d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e951d246541a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff790c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff790c00640 1 -- 172.21.15.17:0/1501603293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0b2040 con 0x5617ef6d4ac0 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 -- 172.21.15.17:0/1501603293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5617ef46d330 con 0x5617ef6d4ac0 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff790c00640 1 -- 172.21.15.17:0/1501603293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7ff79c004d10 con 0x5617ef6d4ac0 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff790c00640 1 -- 172.21.15.17:0/1501603293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7ff79c0c5050 con 0x5617ef6d4ac0 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 10 client.8034 fetch_fsmap learned FSMap version 87 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 -- 172.21.15.17:0/1501603293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5617ef459fa0 con 0x5617ef6d4ac0 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff790c00640 1 -- 172.21.15.17:0/1501603293 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5617ef46d330 con 0x5617ef6d4ac0 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff790c00640 1 -- 172.21.15.17:0/1501603293 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7ff79c0c8020 con 0x5617ef6d4ac0 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 10 client.8034 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 10 client.8034 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 20 client.8034 populate_metadata read hostname 'smithi017' 2024-09-10T23:23:38.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5617ef6e3900 0x5617ef6e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 4 client.8034 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:23:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7adb52000 1 -- 172.21.15.17:0/1501603293 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617ef4e7ae0 con 0x5617ef6e3900 2024-09-10T23:23:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.651+0000 7ff7a3400640 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5617ef6e3900 0x5617ef6e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7a3400640 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5617ef6e3900 0x5617ef6e5cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf98cf09142086f8 server_cookie=2d732d409373c810 in_seq=0 out_seq=0 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff790c00640 10 client.8034 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff790c00640 1 -- 172.21.15.17:0/1501603293 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617ef4e7ae0 con 0x5617ef6e3900 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff790c00640 10 client.8034 handle_command_reply: tid=0 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 client.8034 shutdown 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 -- 172.21.15.17:0/1501603293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 msgr2=0x5617ef6dbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef6dbfb0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ff79c01b220 tx=0x7ff79c0a5d90 comp rx=0 tx=0).stop 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 -- 172.21.15.17:0/1501603293 shutdown_connections 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5617ef6e3900 0x5617ef6e5cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef6d4ac0 0x5617ef6dbfb0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef6dba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 --2- 172.21.15.17:0/1501603293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef68abc0 0x5617ef6db530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff790c00640 0 client.8034 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 -- 172.21.15.17:0/1501603293 >> 172.21.15.17:0/1501603293 conn(0x5617ef690d20 msgr2=0x5617ef688f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 -- 172.21.15.17:0/1501603293 shutdown_connections 2024-09-10T23:23:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 1 -- 172.21.15.17:0/1501603293 wait complete. 2024-09-10T23:23:38.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.655+0000 7ff7adb52000 20 client.8034 trim_cache size 0 max 16384 2024-09-10T23:23:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7adb52000 1 Processor -- start 2024-09-10T23:23:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7adb52000 1 -- start start 2024-09-10T23:23:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef6de310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d41a0 0x5617ef6de850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d4ac0 0x5617ef6ded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7adb52000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4201e00 con 0x5617ef68abc0 2024-09-10T23:23:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7adb52000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4200ea0 con 0x5617ef6d41a0 2024-09-10T23:23:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7adb52000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a4152b30 con 0x5617ef6d4ac0 2024-09-10T23:23:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef6de310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef6de310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50798/0 (socket says 172.21.15.17:50798) 2024-09-10T23:23:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7a3400640 1 -- 172.21.15.17:0/3660878384 learned_addr learned my addr 172.21.15.17:0/3660878384 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7a3e00640 1 --2- 172.21.15.17:0/3660878384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d4ac0 0x5617ef6ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff79be00640 1 --2- 172.21.15.17:0/3660878384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d41a0 0x5617ef6de850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7a3400640 1 -- 172.21.15.17:0/3660878384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d4ac0 msgr2=0x5617ef6ded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.675+0000 7ff7a3400640 1 --2- 172.21.15.17:0/3660878384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d4ac0 0x5617ef6ded90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 -- 172.21.15.17:0/3660878384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d41a0 msgr2=0x5617ef6de850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 --2- 172.21.15.17:0/3660878384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d41a0 0x5617ef6de850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 -- 172.21.15.17:0/3660878384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ef532660 con 0x5617ef68abc0 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 --2- 172.21.15.17:0/3660878384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef6de310 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff79405dc70 tx=0x7ff794059f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df7f177ea3e91db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff793400640 1 -- 172.21.15.17:0/3660878384 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794067410 con 0x5617ef68abc0 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff793400640 1 -- 172.21.15.17:0/3660878384 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff79408e070 con 0x5617ef68abc0 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff793400640 1 -- 172.21.15.17:0/3660878384 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79405a230 con 0x5617ef68abc0 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 -- 172.21.15.17:0/3660878384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 msgr2=0x5617ef6de310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3660878384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef6de310 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff79405dc70 tx=0x7ff794059f90 comp rx=0 tx=0).stop 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 -- 172.21.15.17:0/3660878384 shutdown_connections 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3660878384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d4ac0 0x5617ef6ded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3660878384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d41a0 0x5617ef6de850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3660878384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef6de310 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 -- 172.21.15.17:0/3660878384 >> 172.21.15.17:0/3660878384 conn(0x5617ef690d20 msgr2=0x5617ef68afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 -- 172.21.15.17:0/3660878384 shutdown_connections 2024-09-10T23:23:38.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 -- 172.21.15.17:0/3660878384 wait complete. 2024-09-10T23:23:38.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 -- start start 2024-09-10T23:23:38.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 Processor -- start 2024-09-10T23:23:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef74e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef74ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d4ac0 0x5617ef74efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5617ef693d40 con 0x5617ef68abc0 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5617ef691100 con 0x5617ef6d4ac0 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5617ef4cfec0 con 0x5617ef6d41a0 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7adb52000 10 client.0 _ll_register_callbacks cb 0x7ff78c005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef74e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef74e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50814/0 (socket says 172.21.15.17:50814) 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 -- 172.21.15.17:0/3896201062 learned_addr learned my addr 172.21.15.17:0/3896201062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3e00640 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d4ac0 0x5617ef74efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff79be00640 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef74ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 -- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 msgr2=0x5617ef74ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef74ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 -- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d4ac0 msgr2=0x5617ef74efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.679+0000 7ff7a3400640 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d4ac0 0x5617ef74efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7a3400640 1 -- 172.21.15.17:0/3896201062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ef49f090 con 0x5617ef68abc0 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7a3400640 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef74e550 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff79400cdf0 tx=0x7ff794065050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a9fd186ba76ae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 1 -- 172.21.15.17:0/3896201062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79407c060 con 0x5617ef68abc0 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 1 -- 172.21.15.17:0/3896201062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6130+0+0 (secure 0 0 0) 0x7ff794063b80 con 0x5617ef68abc0 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 -- 172.21.15.17:0/3896201062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff79408e070 con 0x5617ef68abc0 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 1 -- 172.21.15.17:0/3896201062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7ff794063d80 con 0x5617ef68abc0 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 10 client.8040 fetch_fsmap learned FSMap version 87 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 -- 172.21.15.17:0/3896201062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5617ef46b5f0 con 0x5617ef68abc0 2024-09-10T23:23:38.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 1 -- 172.21.15.17:0/3896201062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff79408e070 con 0x5617ef68abc0 2024-09-10T23:23:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 1 -- 172.21.15.17:0/3896201062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7ff794077ce0 con 0x5617ef68abc0 2024-09-10T23:23:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 10 client.8040 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:23:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 10 client.8040 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:23:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 20 client.8040 populate_metadata read hostname 'smithi017' 2024-09-10T23:23:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5617ef709c00 0x5617ef70a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:23:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 4 client.8040 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:23:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 -- 172.21.15.17:0/3896201062 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617ef4e3590 con 0x5617ef709c00 2024-09-10T23:23:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff79be00640 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5617ef709c00 0x5617ef70a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:23:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 10 client.8040 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff79be00640 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5617ef709c00 0x5617ef70a010 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e11a442a827d2cd2 server_cookie=7533787db78b0ee3 in_seq=0 out_seq=0 2024-09-10T23:23:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 1 -- 172.21.15.17:0/3896201062 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+583 (crc 0 0 0) 0x5617ef4e3590 con 0x5617ef709c00 2024-09-10T23:23:38.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 10 client.8040 handle_command_reply: tid=0 2024-09-10T23:23:38.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 client.8040 shutdown 2024-09-10T23:23:38.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 -- 172.21.15.17:0/3896201062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 msgr2=0x5617ef74e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef74e550 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff79400cdf0 tx=0x7ff794065050 comp rx=0 tx=0).stop 2024-09-10T23:23:38.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 -- 172.21.15.17:0/3896201062 shutdown_connections 2024-09-10T23:23:38.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5617ef709c00 0x5617ef70a010 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5617ef6d4ac0 0x5617ef74efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5617ef6d41a0 0x5617ef74ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 --2- 172.21.15.17:0/3896201062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617ef68abc0 0x5617ef74e550 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff790c00640 0 client.8040 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:23:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 -- 172.21.15.17:0/3896201062 >> 172.21.15.17:0/3896201062 conn(0x5617ef690d20 msgr2=0x5617ef68a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 -- 172.21.15.17:0/3896201062 shutdown_connections 2024-09-10T23:23:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 1 -- 172.21.15.17:0/3896201062 wait complete. 2024-09-10T23:23:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.683+0000 7ff7adb52000 20 client.8040 trim_cache size 0 max 16384 2024-09-10T23:23:38.692 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:23:38.692 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1163 inodes in the stack)", 2024-09-10T23:23:38.692 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:23:38.692 INFO:teuthology.orchestra.run.smithi017.stdout: "46e95cea-3df0-48f4-9bbf-e0499f03bd15": { 2024-09-10T23:23:38.692 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "~mds0", 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "46e95cea-3df0-48f4-9bbf-e0499f03bd15", 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive" 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "46e95cea-3df0-48f4-9bbf-e0499f03bd15": { 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:23:38.455621+0000", 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "~mdsdir", 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:23:38.694 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:23:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 -- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff780072610 msgr2=0x7ff780074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff780072610 0x7ff780074ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40b1740 tx=0x7ff78c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 -- 172.21.15.17:0/2686364057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7a406e3e0 msgr2=0x7ff7a4150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:23:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7a406e3e0 0x7ff7a4150a20 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff79400c430 tx=0x7ff79400c8f0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 -- 172.21.15.17:0/2686364057 shutdown_connections 2024-09-10T23:23:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff780072610 0x7ff780074ad0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7a4151b50 0x7ff7a4153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7a40b39d0 0x7ff7a4150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 --2- 172.21.15.17:0/2686364057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7a406e3e0 0x7ff7a4150a20 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:23:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 -- 172.21.15.17:0/2686364057 >> 172.21.15.17:0/2686364057 conn(0x7ff7a40b2720 msgr2=0x7ff7a40cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:23:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 -- 172.21.15.17:0/2686364057 shutdown_connections 2024-09-10T23:23:38.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:23:38.687+0000 7ff7a9200640 1 -- 172.21.15.17:0/2686364057 wait complete. 2024-09-10T23:23:38.708 INFO:tasks.cephfs.filesystem:scrub status for tag:46e95cea-3df0-48f4-9bbf-e0499f03bd15 - {'path': '~mds0', 'tag': '46e95cea-3df0-48f4-9bbf-e0499f03bd15', 'options': 'recursive'} 2024-09-10T23:24:07.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:24:07.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:24:08.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:08.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-10T23:24:08.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 -- 172.21.15.17:0/463624566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5140741d0 msgr2=0x7fd51415f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 --2- 172.21.15.17:0/463624566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5140741d0 0x7fd51415f770 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fd5141567f0 tx=0x7fd50001c7a0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 -- 172.21.15.17:0/463624566 shutdown_connections 2024-09-10T23:24:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 --2- 172.21.15.17:0/463624566 >> v2:172.21.15.77:3300/0 conn(0x7fd514074630 0x7fd51415fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 --2- 172.21.15.17:0/463624566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5140741d0 0x7fd51415f770 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 --2- 172.21.15.17:0/463624566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5141457c0 0x7fd51406e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 -- 172.21.15.17:0/463624566 >> 172.21.15.17:0/463624566 conn(0x7fd5140b17a0 msgr2=0x7fd5140b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 -- 172.21.15.17:0/463624566 shutdown_connections 2024-09-10T23:24:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 -- 172.21.15.17:0/463624566 wait complete. 2024-09-10T23:24:08.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.867+0000 7fd51b200640 1 Processor -- start 2024-09-10T23:24:08.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd51b200640 1 -- start start 2024-09-10T23:24:08.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd51b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140741d0 0x7fd51413d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd51b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd514074630 0x7fd5141fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd51b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5141457c0 0x7fd5141fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd51b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd51415c510 con 0x7fd5141457c0 2024-09-10T23:24:08.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd51b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd51415c390 con 0x7fd5140741d0 2024-09-10T23:24:08.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd51b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd51415c690 con 0x7fd514074630 2024-09-10T23:24:08.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd519200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5141457c0 0x7fd5141fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd519200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5141457c0 0x7fd5141fabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35228/0 (socket says 172.21.15.17:35228) 2024-09-10T23:24:08.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd519200640 1 -- 172.21.15.17:0/2177353492 learned_addr learned my addr 172.21.15.17:0/2177353492 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:08.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd513e00640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140741d0 0x7fd51413d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd513400640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd514074630 0x7fd5141fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd519200640 1 -- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd514074630 msgr2=0x7fd5141fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd519200640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd514074630 0x7fd5141fa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd519200640 1 -- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140741d0 msgr2=0x7fd51413d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd519200640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140741d0 0x7fd51413d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd519200640 1 -- 172.21.15.17:0/2177353492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd514161f40 con 0x7fd5141457c0 2024-09-10T23:24:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd519200640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5141457c0 0x7fd5141fabc0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00e990 tx=0x7fd50c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd50be00640 1 -- 172.21.15.17:0/2177353492 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c004d30 con 0x7fd5141457c0 2024-09-10T23:24:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd50be00640 1 -- 172.21.15.17:0/2177353492 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd50c00caa0 con 0x7fd5141457c0 2024-09-10T23:24:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd50be00640 1 -- 172.21.15.17:0/2177353492 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c005020 con 0x7fd5141457c0 2024-09-10T23:24:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd51b200640 1 -- 172.21.15.17:0/2177353492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd514161980 con 0x7fd5141457c0 2024-09-10T23:24:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.871+0000 7fd51b200640 1 -- 172.21.15.17:0/2177353492 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5141f8340 con 0x7fd5141457c0 2024-09-10T23:24:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd50be00640 1 -- 172.21.15.17:0/2177353492 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd50c00f040 con 0x7fd5141457c0 2024-09-10T23:24:08.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd50be00640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4f40725e0 0x7fd4f4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd50be00640 1 -- 172.21.15.17:0/2177353492 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7fd50c093930 con 0x7fd5141457c0 2024-09-10T23:24:08.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd51e6b1000 1 Processor -- start 2024-09-10T23:24:08.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd51e6b1000 1 -- start start 2024-09-10T23:24:08.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4f40725e0 0x7fd4f4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4f40725e0 0x7fd4f4074aa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b3de0 tx=0x7fd50400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb8931a0 0x5631cb893580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 0x5631cb849680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb849bc0 0x5631cb849fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5631cb731cb0 con 0x5631cb8931a0 2024-09-10T23:24:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5631cb647310 con 0x5631cb849bc0 2024-09-10T23:24:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5631cb6a4b90 con 0x5631cb893ac0 2024-09-10T23:24:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb8931a0 0x5631cb893580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb8931a0 0x5631cb893580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35240/0 (socket says 172.21.15.17:35240) 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 -- 172.21.15.17:0/116244355 learned_addr learned my addr 172.21.15.17:0/116244355 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513400640 1 --2- 172.21.15.17:0/116244355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 0x5631cb849680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd519200640 1 --2- 172.21.15.17:0/116244355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb849bc0 0x5631cb849fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 -- 172.21.15.17:0/116244355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 msgr2=0x5631cb849680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 --2- 172.21.15.17:0/116244355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 0x5631cb849680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 -- 172.21.15.17:0/116244355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb849bc0 msgr2=0x5631cb849fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 --2- 172.21.15.17:0/116244355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb849bc0 0x5631cb849fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 -- 172.21.15.17:0/116244355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631cb648c60 con 0x5631cb8931a0 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.875+0000 7fd513e00640 1 --2- 172.21.15.17:0/116244355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb8931a0 0x5631cb893580 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fd50400bb80 tx=0x7fd504013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a28db939833cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd508c00640 1 -- 172.21.15.17:0/116244355 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504011d80 con 0x5631cb8931a0 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd508c00640 1 -- 172.21.15.17:0/116244355 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd50401e510 con 0x5631cb8931a0 2024-09-10T23:24:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd508c00640 1 -- 172.21.15.17:0/116244355 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50401e8e0 con 0x5631cb8931a0 2024-09-10T23:24:08.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- 172.21.15.17:0/116244355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb8931a0 msgr2=0x5631cb893580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/116244355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb8931a0 0x5631cb893580 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fd50400bb80 tx=0x7fd504013000 comp rx=0 tx=0).stop 2024-09-10T23:24:08.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- 172.21.15.17:0/116244355 shutdown_connections 2024-09-10T23:24:08.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/116244355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb849bc0 0x5631cb849fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/116244355 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 0x5631cb849680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/116244355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb8931a0 0x5631cb893580 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- 172.21.15.17:0/116244355 >> 172.21.15.17:0/116244355 conn(0x5631cb84fd20 msgr2=0x5631cb847f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:08.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- 172.21.15.17:0/116244355 shutdown_connections 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- 172.21.15.17:0/116244355 wait complete. 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- start start 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 Processor -- start 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb89a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb8931a0 0x5631cb89aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 0x5631cb89afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5631cb697dd0 con 0x5631cb849bc0 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5631cb693fc0 con 0x5631cb8931a0 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5631cb6394b0 con 0x5631cb893ac0 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 10 client.0 _ll_register_callbacks cb 0x5631cb6177d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb89a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb89a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35242/0 (socket says 172.21.15.17:35242) 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513e00640 1 -- 172.21.15.17:0/1625807477 learned_addr learned my addr 172.21.15.17:0/1625807477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd519200640 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 0x5631cb89afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513400640 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb8931a0 0x5631cb89aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513e00640 1 -- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 msgr2=0x5631cb89afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513e00640 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 0x5631cb89afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513e00640 1 -- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb8931a0 msgr2=0x5631cb89aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513e00640 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb8931a0 0x5631cb89aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513e00640 1 -- 172.21.15.17:0/1625807477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631cb6321f0 con 0x5631cb849bc0 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513400640 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb8931a0 0x5631cb89aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd519200640 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 0x5631cb89afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd513e00640 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb89a530 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fd504004410 tx=0x7fd504011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6ba9b9ccfaf84d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd4fd600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:08.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd4fd600640 1 -- 172.21.15.17:0/1625807477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504005020 con 0x5631cb849bc0 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd4fd600640 1 -- 172.21.15.17:0/1625807477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7fd5040051c0 con 0x5631cb849bc0 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.879+0000 7fd51e6b1000 1 -- 172.21.15.17:0/1625807477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5631cb62c330 con 0x5631cb849bc0 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd4fd600640 1 -- 172.21.15.17:0/1625807477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fd504038050 con 0x5631cb849bc0 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 10 client.8052 fetch_fsmap learned FSMap version 87 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 -- 172.21.15.17:0/1625807477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5631cb618fa0 con 0x5631cb849bc0 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd4fd600640 1 -- 172.21.15.17:0/1625807477 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5631cb62c330 con 0x5631cb849bc0 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd4fd600640 1 -- 172.21.15.17:0/1625807477 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7fd50403b020 con 0x5631cb849bc0 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 10 client.8052 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 10 client.8052 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 20 client.8052 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5631cb8a2900 0x5631cb8a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 4 client.8052 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 -- 172.21.15.17:0/1625807477 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631cb6a6ae0 con 0x5631cb8a2900 2024-09-10T23:24:08.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd513400640 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5631cb8a2900 0x5631cb8a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd513400640 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5631cb8a2900 0x5631cb8a4cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8943d08a61537fe1 server_cookie=5a01c324eb5fba9e in_seq=0 out_seq=0 2024-09-10T23:24:08.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd4fd600640 10 client.8052 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:24:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd4fd600640 1 -- 172.21.15.17:0/1625807477 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631cb6a6ae0 con 0x5631cb8a2900 2024-09-10T23:24:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd4fd600640 10 client.8052 handle_command_reply: tid=0 2024-09-10T23:24:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 client.8052 shutdown 2024-09-10T23:24:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 -- 172.21.15.17:0/1625807477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 msgr2=0x5631cb89a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb89a530 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fd504004410 tx=0x7fd504011db0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 -- 172.21.15.17:0/1625807477 shutdown_connections 2024-09-10T23:24:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5631cb8a2900 0x5631cb8a4cf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb893ac0 0x5631cb89afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb8931a0 0x5631cb89aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/1625807477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb89a530 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd4fd600640 0 client.8052 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:24:08.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 -- 172.21.15.17:0/1625807477 >> 172.21.15.17:0/1625807477 conn(0x5631cb84fd20 msgr2=0x5631cb847f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:08.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 -- 172.21.15.17:0/1625807477 shutdown_connections 2024-09-10T23:24:08.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 1 -- 172.21.15.17:0/1625807477 wait complete. 2024-09-10T23:24:08.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.883+0000 7fd51e6b1000 20 client.8052 trim_cache size 0 max 16384 2024-09-10T23:24:08.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 Processor -- start 2024-09-10T23:24:08.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 -- start start 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb84fd20 0x5631cb90e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb849bc0 0x5631cb90e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb8931a0 0x5631cb90eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd5142044c0 con 0x5631cb84fd20 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5142034e0 con 0x5631cb849bc0 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd514202ec0 con 0x5631cb8931a0 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd513e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb84fd20 0x5631cb90e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd513e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb84fd20 0x5631cb90e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35246/0 (socket says 172.21.15.17:35246) 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd513e00640 1 -- 172.21.15.17:0/421855596 learned_addr learned my addr 172.21.15.17:0/421855596 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd513e00640 1 -- 172.21.15.17:0/421855596 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb8931a0 msgr2=0x5631cb90eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:08.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd513e00640 1 --2- 172.21.15.17:0/421855596 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb8931a0 0x5631cb90eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd513e00640 1 -- 172.21.15.17:0/421855596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb849bc0 msgr2=0x5631cb90e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:08.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd513e00640 1 --2- 172.21.15.17:0/421855596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb849bc0 0x5631cb90e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd513e00640 1 -- 172.21.15.17:0/421855596 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631cb6f1660 con 0x5631cb84fd20 2024-09-10T23:24:08.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd513e00640 1 --2- 172.21.15.17:0/421855596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb84fd20 0x5631cb90e030 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fd50400b3e0 tx=0x7fd504005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b77a4dfc9f5bd95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:08.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd4ffe00640 1 -- 172.21.15.17:0/421855596 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504041070 con 0x5631cb84fd20 2024-09-10T23:24:08.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd4ffe00640 1 -- 172.21.15.17:0/421855596 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd504011e20 con 0x5631cb84fd20 2024-09-10T23:24:08.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd4ffe00640 1 -- 172.21.15.17:0/421855596 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50401e890 con 0x5631cb84fd20 2024-09-10T23:24:08.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 -- 172.21.15.17:0/421855596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb84fd20 msgr2=0x5631cb90e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/421855596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb84fd20 0x5631cb90e030 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fd50400b3e0 tx=0x7fd504005550 comp rx=0 tx=0).stop 2024-09-10T23:24:08.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 -- 172.21.15.17:0/421855596 shutdown_connections 2024-09-10T23:24:08.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/421855596 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb8931a0 0x5631cb90eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/421855596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb849bc0 0x5631cb90e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/421855596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb84fd20 0x5631cb90e030 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.903+0000 7fd51e6b1000 1 -- 172.21.15.17:0/421855596 >> 172.21.15.17:0/421855596 conn(0x5631cb846270 msgr2=0x5631cb849fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 -- 172.21.15.17:0/421855596 shutdown_connections 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 -- 172.21.15.17:0/421855596 wait complete. 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 -- start start 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 Processor -- start 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb911b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb84fd20 0x5631cb9120d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb8931a0 0x5631cb912610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5631cb697dd0 con 0x5631cb849bc0 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5631cb852d40 con 0x5631cb84fd20 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5631cb850100 con 0x5631cb8931a0 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 10 client.0 _ll_register_callbacks cb 0x7fd500009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb911b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb911b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35260/0 (socket says 172.21.15.17:35260) 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513e00640 1 -- 172.21.15.17:0/3873948745 learned_addr learned my addr 172.21.15.17:0/3873948745 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd519200640 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb8931a0 0x5631cb912610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513400640 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb84fd20 0x5631cb9120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513e00640 1 -- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb8931a0 msgr2=0x5631cb912610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513e00640 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb8931a0 0x5631cb912610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513e00640 1 -- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb84fd20 msgr2=0x5631cb9120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513e00640 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb84fd20 0x5631cb9120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513e00640 1 -- 172.21.15.17:0/3873948745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631cb65e090 con 0x5631cb849bc0 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd513e00640 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb911b90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd504004410 tx=0x7fd50401fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b531e694ecba64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd4fd600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd4fd600640 1 -- 172.21.15.17:0/3873948745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504041020 con 0x5631cb849bc0 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd4fd600640 1 -- 172.21.15.17:0/3873948745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7fd504005640 con 0x5631cb849bc0 2024-09-10T23:24:08.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 -- 172.21.15.17:0/3873948745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd504011e20 con 0x5631cb849bc0 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd4fd600640 1 -- 172.21.15.17:0/3873948745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fd50404b050 con 0x5631cb849bc0 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 10 client.8058 fetch_fsmap learned FSMap version 87 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 -- 172.21.15.17:0/3873948745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5631cb62a5f0 con 0x5631cb849bc0 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd4fd600640 1 -- 172.21.15.17:0/3873948745 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd504011e20 con 0x5631cb849bc0 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd4fd600640 1 -- 172.21.15.17:0/3873948745 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7fd50404e020 con 0x5631cb849bc0 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 10 client.8058 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 10 client.8058 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 20 client.8058 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5631cb893ac0 0x5631cb8cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 4 client.8058 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.907+0000 7fd51e6b1000 1 -- 172.21.15.17:0/3873948745 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5631cb8ab010 con 0x5631cb893ac0 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd513400640 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5631cb893ac0 0x5631cb8cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd513400640 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5631cb893ac0 0x5631cb8cde10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7d50514052f6d20 server_cookie=1f801a7ba8957dcf in_seq=0 out_seq=0 2024-09-10T23:24:08.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd4fd600640 10 client.8058 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:24:08.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd4fd600640 1 -- 172.21.15.17:0/3873948745 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+380 (crc 0 0 0) 0x5631cb8ab010 con 0x5631cb893ac0 2024-09-10T23:24:08.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd4fd600640 10 client.8058 handle_command_reply: tid=0 2024-09-10T23:24:08.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 client.8058 shutdown 2024-09-10T23:24:08.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 -- 172.21.15.17:0/3873948745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 msgr2=0x5631cb911b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb911b90 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd504004410 tx=0x7fd50401fcf0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 -- 172.21.15.17:0/3873948745 shutdown_connections 2024-09-10T23:24:08.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x5631cb893ac0 0x5631cb8cde10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5631cb8931a0 0x5631cb912610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5631cb84fd20 0x5631cb9120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 --2- 172.21.15.17:0/3873948745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631cb849bc0 0x5631cb911b90 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 -- 172.21.15.17:0/3873948745 >> 172.21.15.17:0/3873948745 conn(0x5631cb846270 msgr2=0x5631cb84a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:08.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd4fd600640 0 client.8058 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:24:08.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 -- 172.21.15.17:0/3873948745 shutdown_connections 2024-09-10T23:24:08.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 1 -- 172.21.15.17:0/3873948745 wait complete. 2024-09-10T23:24:08.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51e6b1000 20 client.8058 trim_cache size 0 max 16384 2024-09-10T23:24:08.918 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:24:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:24:08.918 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "46e95cea-3df0-48f4-9bbf-e0499f03bd15": { 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:23:38.455621+0000", 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "~mdsdir", 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:08.919 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:24:08.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 -- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4f40725e0 msgr2=0x7fd4f4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4f40725e0 0x7fd4f4074aa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b3de0 tx=0x7fd50400b2e0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 -- 172.21.15.17:0/2177353492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5141457c0 msgr2=0x7fd5141fabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:08.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5141457c0 0x7fd5141fabc0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00e990 tx=0x7fd50c00ee50 comp rx=0 tx=0).stop 2024-09-10T23:24:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 -- 172.21.15.17:0/2177353492 shutdown_connections 2024-09-10T23:24:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4f40725e0 0x7fd4f4074aa0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5141457c0 0x7fd5141fabc0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd514074630 0x7fd5141fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 --2- 172.21.15.17:0/2177353492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5140741d0 0x7fd51413d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 -- 172.21.15.17:0/2177353492 >> 172.21.15.17:0/2177353492 conn(0x7fd5140b17a0 msgr2=0x7fd5140b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 -- 172.21.15.17:0/2177353492 shutdown_connections 2024-09-10T23:24:08.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:08.911+0000 7fd51b200640 1 -- 172.21.15.17:0/2177353492 wait complete. 2024-09-10T23:24:08.933 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:24:08.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-10T23:24:09.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.079+0000 7f9750800640 1 -- 172.21.15.17:0/484074219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9730003a60 msgr2=0x7f9730003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.079+0000 7f9750800640 1 --2- 172.21.15.17:0/484074219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9730003a60 0x7f9730003e80 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f973c001ec0 tx=0x7f973c01cf00 comp rx=0 tx=0).stop 2024-09-10T23:24:09.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.079+0000 7f9750800640 1 -- 172.21.15.17:0/484074219 shutdown_connections 2024-09-10T23:24:09.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.079+0000 7f9750800640 1 --2- 172.21.15.17:0/484074219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9730003a60 0x7f9730003e80 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.079+0000 7f9750800640 1 -- 172.21.15.17:0/484074219 >> 172.21.15.17:0/484074219 conn(0x7f97480d0320 msgr2=0x7f97480d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:09.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.079+0000 7f9750800640 1 -- 172.21.15.17:0/484074219 shutdown_connections 2024-09-10T23:24:09.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.079+0000 7f9750800640 1 -- 172.21.15.17:0/484074219 wait complete. 2024-09-10T23:24:09.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 Processor -- start 2024-09-10T23:24:09.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 -- start start 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9730003a60 0x7f97481fb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f974815b300 0x7f974809ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974809b0a0 0x7f974809d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9748074920 con 0x7f974815b300 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97480747a0 con 0x7f974809b0a0 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9748074aa0 con 0x7f9730003a60 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f974815b300 0x7f974809ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f974815b300 0x7f974809ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35282/0 (socket says 172.21.15.17:35282) 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974d400640 1 -- 172.21.15.17:0/2777875159 learned_addr learned my addr 172.21.15.17:0/2777875159 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974de00640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9730003a60 0x7f97481fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974e800640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974809b0a0 0x7f974809d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974d400640 1 -- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9730003a60 msgr2=0x7f97481fb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974d400640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9730003a60 0x7f97481fb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974d400640 1 -- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974809b0a0 msgr2=0x7f974809d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974d400640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974809b0a0 0x7f974809d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974d400640 1 -- 172.21.15.17:0/2777875159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97481fb850 con 0x7f974815b300 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f974d400640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f974815b300 0x7f974809ab60 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9738003eb0 tx=0x7f9738001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9742000640 1 -- 172.21.15.17:0/2777875159 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738015070 con 0x7f974815b300 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9742000640 1 -- 172.21.15.17:0/2777875159 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9738011840 con 0x7f974815b300 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9742000640 1 -- 172.21.15.17:0/2777875159 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738011c70 con 0x7f974815b300 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 -- 172.21.15.17:0/2777875159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97481fbb30 con 0x7f974815b300 2024-09-10T23:24:09.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.083+0000 7f9750800640 1 -- 172.21.15.17:0/2777875159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974815b9e0 con 0x7f974815b300 2024-09-10T23:24:09.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.087+0000 7f9742000640 1 -- 172.21.15.17:0/2777875159 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f97380233a0 con 0x7f974815b300 2024-09-10T23:24:09.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.087+0000 7f9742000640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f972c0725e0 0x7f972c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.087+0000 7f9742000640 1 -- 172.21.15.17:0/2777875159 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7f97380941a0 con 0x7f974815b300 2024-09-10T23:24:09.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.087+0000 7f9753c4f000 1 Processor -- start 2024-09-10T23:24:09.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.087+0000 7f974de00640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f972c0725e0 0x7f972c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.087+0000 7f9753c4f000 1 -- start start 2024-09-10T23:24:09.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.087+0000 7f974de00640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f972c0725e0 0x7f972c074aa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f973c0ac000 tx=0x7f973c005040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.087+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187e5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.087+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 0x55ca187e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 0x55ca1879c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca1859a2c0 con 0x55ca186841d0 2024-09-10T23:24:09.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ca185f7b90 con 0x55ca1879c5a0 2024-09-10T23:24:09.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ca185e6fc0 con 0x55ca187e63d0 2024-09-10T23:24:09.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187e5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187e5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35296/0 (socket says 172.21.15.17:35296) 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974de00640 1 -- 172.21.15.17:0/663407668 learned_addr learned my addr 172.21.15.17:0/663407668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974e800640 1 --2- 172.21.15.17:0/663407668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 0x55ca1879c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974d400640 1 --2- 172.21.15.17:0/663407668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 0x55ca187e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974de00640 1 -- 172.21.15.17:0/663407668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 msgr2=0x55ca187e67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974de00640 1 --2- 172.21.15.17:0/663407668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 0x55ca187e67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974de00640 1 -- 172.21.15.17:0/663407668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 msgr2=0x55ca1879c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974de00640 1 --2- 172.21.15.17:0/663407668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 0x55ca1879c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974de00640 1 -- 172.21.15.17:0/663407668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca185851a0 con 0x55ca186841d0 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f974de00640 1 --2- 172.21.15.17:0/663407668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187e5e90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f973c006a50 tx=0x7f973c01cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7161a859bf627490 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9736a00640 1 -- 172.21.15.17:0/663407668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c006610 con 0x55ca186841d0 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9736a00640 1 -- 172.21.15.17:0/663407668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f973c003600 con 0x55ca186841d0 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9736a00640 1 -- 172.21.15.17:0/663407668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c003a30 con 0x55ca186841d0 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- 172.21.15.17:0/663407668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 msgr2=0x55ca187e5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 --2- 172.21.15.17:0/663407668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187e5e90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f973c006a50 tx=0x7f973c01cf00 comp rx=0 tx=0).stop 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- 172.21.15.17:0/663407668 shutdown_connections 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 --2- 172.21.15.17:0/663407668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 0x55ca1879c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 --2- 172.21.15.17:0/663407668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 0x55ca187e67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 --2- 172.21.15.17:0/663407668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187e5e90 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- 172.21.15.17:0/663407668 >> 172.21.15.17:0/663407668 conn(0x55ca182a5880 msgr2=0x55ca1879ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- 172.21.15.17:0/663407668 shutdown_connections 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- 172.21.15.17:0/663407668 wait complete. 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- start start 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 Processor -- start 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187eca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 0x55ca187ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 0x55ca187ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca1858c4d0 con 0x55ca186841d0 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ca185eadd0 con 0x55ca1879c5a0 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ca182ac620 con 0x55ca187e63d0 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.091+0000 7f9753c4f000 10 client.0 _ll_register_callbacks cb 0x55ca185bdcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187eca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35302/0 (socket says 172.21.15.17:35302) 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974de00640 1 -- 172.21.15.17:0/2463853361 learned_addr learned my addr 172.21.15.17:0/2463853361 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974e800640 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 0x55ca187ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974d400640 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 0x55ca187ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974de00640 1 -- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 msgr2=0x55ca187ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974de00640 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 0x55ca187ed4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974de00640 1 -- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 msgr2=0x55ca187ecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974de00640 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 0x55ca187ecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974de00640 1 -- 172.21.15.17:0/2463853361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca186b6720 con 0x55ca186841d0 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974e800640 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 0x55ca187ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974d400640 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 0x55ca187ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974de00640 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187eca20 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f973c01b600 tx=0x7f973c003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a8bc708537c8c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 1 -- 172.21.15.17:0/2463853361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c003600 con 0x55ca186841d0 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 1 -- 172.21.15.17:0/2463853361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7f973c001770 con 0x55ca186841d0 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 -- 172.21.15.17:0/2463853361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca1857f2e0 con 0x55ca186841d0 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 1 -- 172.21.15.17:0/2463853361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f973c0d6050 con 0x55ca186841d0 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 10 client.8070 fetch_fsmap learned FSMap version 87 2024-09-10T23:24:09.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 -- 172.21.15.17:0/2463853361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x55ca1866c420 con 0x55ca186841d0 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 1 -- 172.21.15.17:0/2463853361 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ca1857f2e0 con 0x55ca186841d0 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 1 -- 172.21.15.17:0/2463853361 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f973c0d9020 con 0x55ca186841d0 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 10 client.8070 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 10 client.8070 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 20 client.8070 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x55ca187f4df0 0x55ca187f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 4 client.8070 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 -- 172.21.15.17:0/2463853361 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca185f9ae0 con 0x55ca187f4df0 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974d400640 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x55ca187f4df0 0x55ca187f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f974d400640 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x55ca187f4df0 0x55ca187f71e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bff70ec0ea0290f server_cookie=bc2ee10fe2bb0cd8 in_seq=0 out_seq=0 2024-09-10T23:24:09.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 10 client.8070 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:24:09.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 1 -- 172.21.15.17:0/2463853361 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca185f9ae0 con 0x55ca187f4df0 2024-09-10T23:24:09.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 10 client.8070 handle_command_reply: tid=0 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 client.8070 shutdown 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 -- 172.21.15.17:0/2463853361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 msgr2=0x55ca187eca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187eca20 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f973c01b600 tx=0x7f973c003c60 comp rx=0 tx=0).stop 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 -- 172.21.15.17:0/2463853361 shutdown_connections 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x55ca187f4df0 0x55ca187f71e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca187e63d0 0x55ca187ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca1879c5a0 0x55ca187ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2463853361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca186841d0 0x55ca187eca20 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f972b400640 0 client.8070 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 -- 172.21.15.17:0/2463853361 >> 172.21.15.17:0/2463853361 conn(0x55ca182a5880 msgr2=0x55ca1879b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 -- 172.21.15.17:0/2463853361 shutdown_connections 2024-09-10T23:24:09.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 1 -- 172.21.15.17:0/2463853361 wait complete. 2024-09-10T23:24:09.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.095+0000 7f9753c4f000 20 client.8070 trim_cache size 0 max 16384 2024-09-10T23:24:09.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 Processor -- start 2024-09-10T23:24:09.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- start start 2024-09-10T23:24:09.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca186841d0 0x55ca1879a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca1879c5a0 0x55ca1879aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca187e63d0 0x55ca1879b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9748205110 con 0x55ca1879c5a0 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9748204150 con 0x55ca187e63d0 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9748203600 con 0x55ca186841d0 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f974d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca1879c5a0 0x55ca1879aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f974d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca1879c5a0 0x55ca1879aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35310/0 (socket says 172.21.15.17:35310) 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f974d400640 1 -- 172.21.15.17:0/2413057142 learned_addr learned my addr 172.21.15.17:0/2413057142 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f974d400640 1 -- 172.21.15.17:0/2413057142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca186841d0 msgr2=0x55ca1879a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f974d400640 1 --2- 172.21.15.17:0/2413057142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca186841d0 0x55ca1879a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f974d400640 1 -- 172.21.15.17:0/2413057142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca187e63d0 msgr2=0x55ca1879b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f974d400640 1 --2- 172.21.15.17:0/2413057142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca187e63d0 0x55ca1879b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f974d400640 1 -- 172.21.15.17:0/2413057142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca18643ae0 con 0x55ca1879c5a0 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f974d400640 1 --2- 172.21.15.17:0/2413057142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca1879c5a0 0x55ca1879aba0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f97380068c0 tx=0x7f9738006e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b226199901ade server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9736000640 1 -- 172.21.15.17:0/2413057142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973801f040 con 0x55ca1879c5a0 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9736000640 1 -- 172.21.15.17:0/2413057142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9738063a00 con 0x55ca1879c5a0 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9736000640 1 -- 172.21.15.17:0/2413057142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738068420 con 0x55ca1879c5a0 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- 172.21.15.17:0/2413057142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca1879c5a0 msgr2=0x55ca1879aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2413057142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca1879c5a0 0x55ca1879aba0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f97380068c0 tx=0x7f9738006e50 comp rx=0 tx=0).stop 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- 172.21.15.17:0/2413057142 shutdown_connections 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2413057142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca187e63d0 0x55ca1879b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2413057142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca1879c5a0 0x55ca1879aba0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 --2- 172.21.15.17:0/2413057142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca186841d0 0x55ca1879a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- 172.21.15.17:0/2413057142 >> 172.21.15.17:0/2413057142 conn(0x55ca182a5880 msgr2=0x55ca187a1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:09.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- 172.21.15.17:0/2413057142 shutdown_connections 2024-09-10T23:24:09.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- 172.21.15.17:0/2413057142 wait complete. 2024-09-10T23:24:09.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.115+0000 7f9753c4f000 1 -- start start 2024-09-10T23:24:09.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 Processor -- start 2024-09-10T23:24:09.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca186841d0 0x55ca1879b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca1879c5a0 0x55ca1879bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca187e63d0 0x55ca187f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca185e6fc0 con 0x55ca187e63d0 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ca185f7b90 con 0x55ca186841d0 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ca1859a2c0 con 0x55ca1879c5a0 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 10 client.0 _ll_register_callbacks cb 0x7f973000c0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca187e63d0 0x55ca187f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca187e63d0 0x55ca187f1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35314/0 (socket says 172.21.15.17:35314) 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974e800640 1 -- 172.21.15.17:0/3289244599 learned_addr learned my addr 172.21.15.17:0/3289244599 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974d400640 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca1879c5a0 0x55ca1879bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974de00640 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca186841d0 0x55ca1879b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974e800640 1 -- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca1879c5a0 msgr2=0x55ca1879bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974e800640 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca1879c5a0 0x55ca1879bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974e800640 1 -- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca186841d0 msgr2=0x55ca1879b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974e800640 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca186841d0 0x55ca1879b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974e800640 1 -- 172.21.15.17:0/3289244599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca185b1040 con 0x55ca187e63d0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974e800640 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca187e63d0 0x55ca187f1d30 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f9748074180 tx=0x7f9744014c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d144169e554d82e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f972b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f972b400640 1 -- 172.21.15.17:0/3289244599 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744011810 con 0x55ca187e63d0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f972b400640 1 -- 172.21.15.17:0/3289244599 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7f974401fc90 con 0x55ca187e63d0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 -- 172.21.15.17:0/3289244599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9738063a00 con 0x55ca187e63d0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f972b400640 1 -- 172.21.15.17:0/3289244599 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f97440119b0 con 0x55ca187e63d0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 10 client.8076 fetch_fsmap learned FSMap version 87 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 -- 172.21.15.17:0/3289244599 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x55ca1857d620 con 0x55ca187e63d0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f972b400640 1 -- 172.21.15.17:0/3289244599 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9738063a00 con 0x55ca187e63d0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f972b400640 1 -- 172.21.15.17:0/3289244599 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f974400f040 con 0x55ca187e63d0 2024-09-10T23:24:09.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 10 client.8076 fetch_fsmap finished waiting for FSMap version 87 2024-09-10T23:24:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 10 client.8076 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-09-10T23:24:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 20 client.8076 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x55ca1885c160 0x55ca1885c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 4 client.8076 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f9753c4f000 1 -- 172.21.15.17:0/3289244599 --> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55ca187fd500 con 0x55ca1885c160 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974de00640 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x55ca1885c160 0x55ca1885c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f974de00640 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x55ca1885c160 0x55ca1885c570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a994fb8dc1ccda8a server_cookie=36736be64d94df48 in_seq=0 out_seq=0 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.119+0000 7f972b400640 10 client.8076 ms_handle_connect on v2:172.21.15.77:6835/258682540 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f972b400640 1 -- 172.21.15.17:0/3289244599 <== mds.0 v2:172.21.15.77:6835/258682540 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18114 (crc 0 0 0) 0x55ca187fd500 con 0x55ca1885c160 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f972b400640 10 client.8076 handle_command_reply: tid=0 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 client.8076 shutdown 2024-09-10T23:24:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 -- 172.21.15.17:0/3289244599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca187e63d0 msgr2=0x55ca187f1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca187e63d0 0x55ca187f1d30 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f9748074180 tx=0x7f9744014c70 comp rx=0 tx=0).stop 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 -- 172.21.15.17:0/3289244599 shutdown_connections 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:6835/258682540,v1:172.21.15.77:6837/258682540] conn(0x55ca1885c160 0x55ca1885c570 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca187e63d0 0x55ca187f1d30 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca1879c5a0 0x55ca1879bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 --2- 172.21.15.17:0/3289244599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca186841d0 0x55ca1879b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f972b400640 0 client.8076 ms_handle_reset on v2:172.21.15.77:6835/258682540 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 -- 172.21.15.17:0/3289244599 >> 172.21.15.17:0/3289244599 conn(0x55ca182a5880 msgr2=0x55ca187a1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 -- 172.21.15.17:0/3289244599 shutdown_connections 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 1 -- 172.21.15.17:0/3289244599 wait complete. 2024-09-10T23:24:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9753c4f000 20 client.8076 trim_cache size 0 max 16384 2024-09-10T23:24:09.136 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:24:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T23:24:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 2745, 2024-09-10T23:24:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2736, 2024-09-10T23:24:09.136 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 792130, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 13610454, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 16, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 6, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.324744798, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.166432758, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.069114739, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.069341188, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2736, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.272465916, 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000099585 2024-09-10T23:24:09.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 10, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000797, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000079 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 133584, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 30736 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 3501, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 3527, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 880011, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 21086601, 2024-09-10T23:24:09.138 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 6, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.341332347, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.167997282, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.064719199, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.083212441, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3526, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.466421647, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000132280 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 132672 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 38309, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 64189, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 13519855, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 79423705, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 8, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 5.238607286, 2024-09-10T23:24:09.140 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 2.869280438, 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 2.681820270, 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.144345880, 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 64188, 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 2.119817263, 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000033025 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 88125, 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.015049302, 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000170 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.141 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 9926, 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 13.705538801, 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001380771 2024-09-10T23:24:09.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3183, 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.641562788, 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000201559 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 28292, 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 28292, 2024-09-10T23:24:09.143 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 28292, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 230.112697192, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.008133489 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 0, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 12, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 17914, 2024-09-10T23:24:09.144 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 17914, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 0, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 17914, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 0, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 2, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 2, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 2, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 47817, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 47275, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 0, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 0, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2024-09-10T23:24:09.145 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 118, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 1791, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 0, 2024-09-10T23:24:09.146 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 1791, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 11, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 1, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 10, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 1780, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 6159, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 6010, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T23:24:09.147 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 6156, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 2000, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 32, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 17842 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 0, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2024-09-10T23:24:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 4187, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 3404, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 2246, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_path": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_quiesce_inode": 0, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 1, 2024-09-10T23:24:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_succeeded": 0, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_write_failed": 0 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 23659, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2024-09-10T23:24:09.150 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 23659, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 30, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 30, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 3, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 82573914, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 0, 2024-09-10T23:24:09.151 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6602, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 67.038618575, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.010154289 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 0 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 14, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 2015, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 2001, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 13, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 13, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 0, 2024-09-10T23:24:09.152 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 17914, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 19914, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 2000, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 2, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 2002, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 2000, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 96380, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 330047488 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 37293, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 28292, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 8, 2024-09-10T23:24:09.153 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 0, 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2000, 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.680741197, 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000840370 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2012, 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.621495898, 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000308894 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.154 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6000, 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 11.391221936, 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001898536 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8021, 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 4.813104868, 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000600062 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2024-09-10T23:24:09.155 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.156 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.022144866, 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.007381622 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.157 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.003296423, 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003296423 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:24:09.158 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.005847308, 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.005847308 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6, 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.086643836, 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.014440639 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.159 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2246, 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 192.939766104, 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.085903724 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.160 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.003678020, 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003678020 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2024-09-10T23:24:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1, 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000400600, 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000400600 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.162 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.163 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 8000, 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 18.544356136, 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002318044 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2024-09-10T23:24:09.164 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 18357, 2024-09-10T23:24:09.165 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 18357, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 108, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T23:24:09.166 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T23:24:09.167 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T23:24:09.168 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 251529, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 86, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 5624, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 80, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T23:24:09.169 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 13062908, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 661925, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2024-09-10T23:24:09.170 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 12095, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 78765258, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 37, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 12095, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 12095, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 33.815478079, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002795822 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 12095, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 12173 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.171 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 12095, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 1864, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 10231, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 0, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 11, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 72, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 6673, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 45, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 1404, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2024-09-10T23:24:09.172 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 2030, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 1792, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 22, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2024-09-10T23:24:09.173 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2024-09-10T23:24:09.174 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 122, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 5, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 8, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 8, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 101, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 0, 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 23 2024-09-10T23:24:09.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 1, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 32, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 32, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed_ops": 3404, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 3404, 2024-09-10T23:24:09.176 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 44551, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 11176060, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 44551, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 44551, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 11176060, 2024-09-10T23:24:09.177 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:24:09.178 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 12095, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 79120294, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 12095, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 79120294, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:24:09.179 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 12095, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 12095, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 12095, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 12095, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:09.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 3404, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 355036, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 3404, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 71, 2024-09-10T23:24:09.181 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 355036, 2024-09-10T23:24:09.184 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:24:09.184 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.184 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.184 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:09.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.184 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x55f346f88500": { 2024-09-10T23:24:09.184 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2024-09-10T23:24:09.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 23659, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 78379610, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 23659, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 6602, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 78379610, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2024-09-10T23:24:09.185 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2024-09-10T23:24:09.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:09.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:09.186 INFO:teuthology.orchestra.run.smithi017.stdout: "trackedop": { 2024-09-10T23:24:09.186 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2024-09-10T23:24:09.186 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:09.186 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:24:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 -- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f972c0725e0 msgr2=0x7f972c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f972c0725e0 0x7f972c074aa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f973c0ac000 tx=0x7f973c005040 comp rx=0 tx=0).stop 2024-09-10T23:24:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 -- 172.21.15.17:0/2777875159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f974815b300 msgr2=0x7f974809ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f974815b300 0x7f974809ab60 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9738003eb0 tx=0x7f9738001640 comp rx=0 tx=0).stop 2024-09-10T23:24:09.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 -- 172.21.15.17:0/2777875159 shutdown_connections 2024-09-10T23:24:09.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f972c0725e0 0x7f972c074aa0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974809b0a0 0x7f974809d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f974815b300 0x7f974809ab60 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 --2- 172.21.15.17:0/2777875159 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9730003a60 0x7f97481fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 -- 172.21.15.17:0/2777875159 >> 172.21.15.17:0/2777875159 conn(0x7f97480d0320 msgr2=0x7f97480cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:09.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 -- 172.21.15.17:0/2777875159 shutdown_connections 2024-09-10T23:24:09.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.123+0000 7f9750800640 1 -- 172.21.15.17:0/2777875159 wait complete. 2024-09-10T23:24:09.189 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:24:09.189 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:24:09.274 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:24:09.378 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:24:09.378 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:24:09.378 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:24:09.379 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:09.387 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:24:09.387 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:09.440 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:24:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.627+0000 7fcb9f000640 1 -- 172.21.15.17:0/2388711547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 msgr2=0x7fcb98159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.627+0000 7fcb9f000640 1 --2- 172.21.15.17:0/2388711547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 0x7fcb98159c80 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fcb9806b060 tx=0x7fcb9001cb80 comp rx=0 tx=0).stop 2024-09-10T23:24:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.627+0000 7fcb9f000640 1 -- 172.21.15.17:0/2388711547 shutdown_connections 2024-09-10T23:24:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.627+0000 7fcb9f000640 1 --2- 172.21.15.17:0/2388711547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 0x7fcb98159c80 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.627+0000 7fcb9f000640 1 --2- 172.21.15.17:0/2388711547 >> v2:172.21.15.77:3300/0 conn(0x7fcb98070090 0x7fcb98070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.627+0000 7fcb9f000640 1 -- 172.21.15.17:0/2388711547 >> 172.21.15.17:0/2388711547 conn(0x7fcb980b1730 msgr2=0x7fcb980b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:09.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.627+0000 7fcb9f000640 1 -- 172.21.15.17:0/2388711547 shutdown_connections 2024-09-10T23:24:09.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.627+0000 7fcb9f000640 1 -- 172.21.15.17:0/2388711547 wait complete. 2024-09-10T23:24:09.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 Processor -- start 2024-09-10T23:24:09.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 -- start start 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb98070090 0x7fcb98140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 0x7fcb98140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9815bb40 0x7fcb980b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcb98168030 con 0x7fcb981597f0 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcb98167eb0 con 0x7fcb98070090 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcb981681b0 con 0x7fcb9815bb40 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb8fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 0x7fcb98140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb8fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 0x7fcb98140fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35338/0 (socket says 172.21.15.17:35338) 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb8fe00640 1 -- 172.21.15.17:0/3940880077 learned_addr learned my addr 172.21.15.17:0/3940880077 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9d000640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9815bb40 0x7fcb980b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb97e00640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb98070090 0x7fcb98140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb8fe00640 1 -- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9815bb40 msgr2=0x7fcb980b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb8fe00640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9815bb40 0x7fcb980b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb8fe00640 1 -- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb98070090 msgr2=0x7fcb98140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb8fe00640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb98070090 0x7fcb98140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb8fe00640 1 -- 172.21.15.17:0/3940880077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb981565c0 con 0x7fcb981597f0 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9d000640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9815bb40 0x7fcb980b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb8fe00640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 0x7fcb98140fa0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c400 tx=0x7fcb8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb94c00640 1 -- 172.21.15.17:0/3940880077 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb80017070 con 0x7fcb981597f0 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb94c00640 1 -- 172.21.15.17:0/3940880077 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb80003600 con 0x7fcb981597f0 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb94c00640 1 -- 172.21.15.17:0/3940880077 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb80003a50 con 0x7fcb981597f0 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb981414e0 con 0x7fcb981597f0 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.631+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb98156b20 con 0x7fcb981597f0 2024-09-10T23:24:09.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.635+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb98070470 con 0x7fcb981597f0 2024-09-10T23:24:09.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.635+0000 7fcb94c00640 1 -- 172.21.15.17:0/3940880077 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcb80003bf0 con 0x7fcb981597f0 2024-09-10T23:24:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.635+0000 7fcb94c00640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb740725e0 0x7fcb74074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:09.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.635+0000 7fcb94c00640 1 -- 172.21.15.17:0/3940880077 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7fcb800929c0 con 0x7fcb981597f0 2024-09-10T23:24:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.635+0000 7fcb97e00640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb740725e0 0x7fcb74074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:09.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.635+0000 7fcb97e00640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb740725e0 0x7fcb74074aa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009be0 tx=0x7fcb880091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:09.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.639+0000 7fcb94c00640 1 -- 172.21.15.17:0/3940880077 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcb981565c0 con 0x7fcb981597f0 2024-09-10T23:24:09.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.823+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb980cf640 con 0x7fcb981597f0 2024-09-10T23:24:09.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.823+0000 7fcb94c00640 1 -- 172.21.15.17:0/3940880077 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v122) ==== 80+0+0 (secure 0 0 0) 0x7fcb98073e80 con 0x7fcb981597f0 2024-09-10T23:24:09.827 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:24:09.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb740725e0 msgr2=0x7fcb74074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb740725e0 0x7fcb74074aa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009be0 tx=0x7fcb880091e0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 msgr2=0x7fcb98140fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 0x7fcb98140fa0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c400 tx=0x7fcb8000c8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 shutdown_connections 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcb740725e0 0x7fcb74074aa0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcb9815bb40 0x7fcb980b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb981597f0 0x7fcb98140fa0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 --2- 172.21.15.17:0/3940880077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb98070090 0x7fcb98140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 >> 172.21.15.17:0/3940880077 conn(0x7fcb980b1730 msgr2=0x7fcb981515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 shutdown_connections 2024-09-10T23:24:09.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:09.827+0000 7fcb9f000640 1 -- 172.21.15.17:0/3940880077 wait complete. 2024-09-10T23:24:09.848 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:24:09.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:09.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:09.867 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[58903]: fuse finished with error 0 and tester_r 0 2024-09-10T23:24:09.883 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:24:09.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:09.883 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:24:10.051 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:24:10.051 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:24:10.052 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:10.061 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:24:10.061 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:24:10.061 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:24:10.062 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:10.104 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:24:10.104 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:24:10.104 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:24:10.104 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:10.113 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:24:10.113 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:10.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 -- 172.21.15.17:0/805906695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0152c50 msgr2=0x7fd5a0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 --2- 172.21.15.17:0/805906695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0152c50 0x7fd5a0070350 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fd590009900 tx=0x7fd59001c870 comp rx=0 tx=0).stop 2024-09-10T23:24:10.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 -- 172.21.15.17:0/805906695 shutdown_connections 2024-09-10T23:24:10.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 --2- 172.21.15.17:0/805906695 >> v2:172.21.15.77:3300/0 conn(0x7fd5a0153030 0x7fd5a015f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 --2- 172.21.15.17:0/805906695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a00d1120 0x7fd5a00b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 --2- 172.21.15.17:0/805906695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0152c50 0x7fd5a0070350 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 -- 172.21.15.17:0/805906695 >> 172.21.15.17:0/805906695 conn(0x7fd5a00d03d0 msgr2=0x7fd5a00d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:10.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 -- 172.21.15.17:0/805906695 shutdown_connections 2024-09-10T23:24:10.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 -- 172.21.15.17:0/805906695 wait complete. 2024-09-10T23:24:10.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 Processor -- start 2024-09-10T23:24:10.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 -- start start 2024-09-10T23:24:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a00d1120 0x7fd5a014ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a0152c50 0x7fd5a00aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0153030 0x7fd5a014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a00b4ba0 con 0x7fd5a0153030 2024-09-10T23:24:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a00b4a20 con 0x7fd5a0152c50 2024-09-10T23:24:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.291+0000 7fd5a7000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a00b4d20 con 0x7fd5a00d1120 2024-09-10T23:24:10.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0153030 0x7fd5a014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0153030 0x7fd5a014d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35350/0 (socket says 172.21.15.17:35350) 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a5000640 1 -- 172.21.15.17:0/288109572 learned_addr learned my addr 172.21.15.17:0/288109572 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd59fe00640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a00d1120 0x7fd5a014ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd597e00640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a0152c50 0x7fd5a00aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a5000640 1 -- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a00d1120 msgr2=0x7fd5a014ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a5000640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a00d1120 0x7fd5a014ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a5000640 1 -- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a0152c50 msgr2=0x7fd5a00aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a5000640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a0152c50 0x7fd5a00aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a5000640 1 -- 172.21.15.17:0/288109572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a00ce830 con 0x7fd5a0153030 2024-09-10T23:24:10.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a5000640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0153030 0x7fd5a014d170 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fd59800e970 tx=0x7fd59800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:10.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd59cc00640 1 -- 172.21.15.17:0/288109572 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598004d30 con 0x7fd5a0153030 2024-09-10T23:24:10.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd59cc00640 1 -- 172.21.15.17:0/288109572 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd59800cb20 con 0x7fd5a0153030 2024-09-10T23:24:10.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd59cc00640 1 -- 172.21.15.17:0/288109572 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598005020 con 0x7fd5a0153030 2024-09-10T23:24:10.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a00ae3a0 con 0x7fd5a0153030 2024-09-10T23:24:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a014a940 con 0x7fd5a0153030 2024-09-10T23:24:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a0070350 con 0x7fd5a0153030 2024-09-10T23:24:10.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.295+0000 7fd59cc00640 1 -- 172.21.15.17:0/288109572 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd59800f040 con 0x7fd5a0153030 2024-09-10T23:24:10.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.299+0000 7fd59cc00640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:10.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.299+0000 7fd59cc00640 1 -- 172.21.15.17:0/288109572 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7fd598093990 con 0x7fd5a0153030 2024-09-10T23:24:10.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.299+0000 7fd59fe00640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:10.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.299+0000 7fd59fe00640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd5900af000 tx=0x7fd59001b0b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:10.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.303+0000 7fd59cc00640 1 -- 172.21.15.17:0/288109572 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd598016030 con 0x7fd5a0153030 2024-09-10T23:24:10.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.515+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5a00d07b0 con 0x7fd5a0153030 2024-09-10T23:24:10.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.515+0000 7fd59cc00640 1 -- 172.21.15.17:0/288109572 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5216 (secure 0 0 0) 0x7fd59805e850 con 0x7fd5a0153030 2024-09-10T23:24:10.520 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:10.520 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"btime":"2024-09-10T23:22:22:200267+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/151616867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":151616867},{"type":"v1","addr":"172.21.15.77:6836","nonce":151616867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7824,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/623866149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":623866149},{"type":"v1","addr":"172.21.15.17:6834","nonce":623866149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7827,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2269575278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2269575278},{"type":"v1","addr":"172.21.15.17:6835","nonce":2269575278}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T23:22:12.557691+0000","modified":"2024-09-10T23:22:21.252279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/258682540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":258682540},{"type":"v1","addr":"172.21.15.77:6837","nonce":258682540}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":7}]} 2024-09-10T23:24:10.520 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 87 2024-09-10T23:24:10.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 msgr2=0x7fd57c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd5900af000 tx=0x7fd59001b0b0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0153030 msgr2=0x7fd5a014d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0153030 0x7fd5a014d170 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fd59800e970 tx=0x7fd59800ee30 comp rx=0 tx=0).stop 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 shutdown_connections 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0153030 0x7fd5a014d170 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a0152c50 0x7fd5a00aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 --2- 172.21.15.17:0/288109572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a00d1120 0x7fd5a014ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 >> 172.21.15.17:0/288109572 conn(0x7fd5a00d03d0 msgr2=0x7fd5a015dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 shutdown_connections 2024-09-10T23:24:10.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.519+0000 7fd5a7000640 1 -- 172.21.15.17:0/288109572 wait complete. 2024-09-10T23:24:10.542 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.687+0000 7f0366200640 1 -- 172.21.15.17:0/96420050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344004d50 msgr2=0x7f03440051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.687+0000 7f0366200640 1 --2- 172.21.15.17:0/96420050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344004d50 0x7f03440051b0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f0358009ee0 tx=0x7f035801d5f0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.687+0000 7f035fe00640 1 -- 172.21.15.17:0/96420050 reap_dead start 2024-09-10T23:24:10.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.687+0000 7f0366200640 1 -- 172.21.15.17:0/96420050 shutdown_connections 2024-09-10T23:24:10.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.687+0000 7f0366200640 1 -- 172.21.15.17:0/96420050 >> 172.21.15.17:0/96420050 conn(0x7f03600d1d60 msgr2=0x7f03600d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:10.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.687+0000 7f0366200640 1 -- 172.21.15.17:0/96420050 shutdown_connections 2024-09-10T23:24:10.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.687+0000 7f0366200640 1 -- 172.21.15.17:0/96420050 wait complete. 2024-09-10T23:24:10.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 Processor -- start 2024-09-10T23:24:10.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 -- start start 2024-09-10T23:24:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344004d50 0x7f03600cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03601f5360 0x7f03600c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03600b3b40 0x7f03601f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0360071030 con 0x7f0344004d50 2024-09-10T23:24:10.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0360070eb0 con 0x7f03601f5360 2024-09-10T23:24:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03600711b0 con 0x7f03600b3b40 2024-09-10T23:24:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344004d50 0x7f03600cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344004d50 0x7f03600cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35360/0 (socket says 172.21.15.17:35360) 2024-09-10T23:24:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035f400640 1 -- 172.21.15.17:0/2937406962 learned_addr learned my addr 172.21.15.17:0/2937406962 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0357e00640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03601f5360 0x7f03600c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035fe00640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03600b3b40 0x7f03601f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035f400640 1 -- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03600b3b40 msgr2=0x7f03601f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035f400640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03600b3b40 0x7f03601f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035f400640 1 -- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03601f5360 msgr2=0x7f03600c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035f400640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03601f5360 0x7f03600c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035f400640 1 -- 172.21.15.17:0/2937406962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03600caac0 con 0x7f0344004d50 2024-09-10T23:24:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0357e00640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03601f5360 0x7f03600c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f035f400640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344004d50 0x7f03600cbb20 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f0350003f00 tx=0x7f0350001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0357400640 1 -- 172.21.15.17:0/2937406962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350015070 con 0x7f0344004d50 2024-09-10T23:24:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0357400640 1 -- 172.21.15.17:0/2937406962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0350011840 con 0x7f0344004d50 2024-09-10T23:24:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0357400640 1 -- 172.21.15.17:0/2937406962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350011c70 con 0x7f0344004d50 2024-09-10T23:24:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03600cad60 con 0x7f0344004d50 2024-09-10T23:24:10.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.691+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03600cb320 con 0x7f0344004d50 2024-09-10T23:24:10.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.695+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f036015f060 con 0x7f0344004d50 2024-09-10T23:24:10.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.695+0000 7f0357400640 1 -- 172.21.15.17:0/2937406962 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f03500103c0 con 0x7f0344004d50 2024-09-10T23:24:10.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.695+0000 7f0357400640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f033c072610 0x7f033c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:10.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.695+0000 7f0357400640 1 -- 172.21.15.17:0/2937406962 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7f0350094250 con 0x7f0344004d50 2024-09-10T23:24:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.695+0000 7f0357e00640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f033c072610 0x7f033c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.695+0000 7f0357e00640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f033c072610 0x7f033c074ad0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0348000fc0 tx=0x7f03480067b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:10.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.699+0000 7f0357400640 1 -- 172.21.15.17:0/2937406962 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f035005f080 con 0x7f0344004d50 2024-09-10T23:24:10.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03600c5020 con 0x7f0344004d50 2024-09-10T23:24:10.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0357400640 1 -- 172.21.15.17:0/2937406962 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5216 (secure 0 0 0) 0x7f0350063ab0 con 0x7f0344004d50 2024-09-10T23:24:10.913 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:10.913 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"btime":"2024-09-10T23:22:22:200267+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/151616867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":151616867},{"type":"v1","addr":"172.21.15.77:6836","nonce":151616867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7824,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/623866149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":623866149},{"type":"v1","addr":"172.21.15.17:6834","nonce":623866149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7827,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2269575278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2269575278},{"type":"v1","addr":"172.21.15.17:6835","nonce":2269575278}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T23:22:12.557691+0000","modified":"2024-09-10T23:22:21.252279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/258682540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":258682540},{"type":"v1","addr":"172.21.15.77:6837","nonce":258682540}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":7}]} 2024-09-10T23:24:10.913 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 87 2024-09-10T23:24:10.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f033c072610 msgr2=0x7f033c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f033c072610 0x7f033c074ad0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0348000fc0 tx=0x7f03480067b0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344004d50 msgr2=0x7f03600cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344004d50 0x7f03600cbb20 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f0350003f00 tx=0x7f0350001640 comp rx=0 tx=0).stop 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 shutdown_connections 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f033c072610 0x7f033c074ad0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03600b3b40 0x7f03601f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03601f5360 0x7f03600c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 --2- 172.21.15.17:0/2937406962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0344004d50 0x7f03600cbb20 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 >> 172.21.15.17:0/2937406962 conn(0x7f03600d1d60 msgr2=0x7f03600b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 shutdown_connections 2024-09-10T23:24:10.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:10.911+0000 7f0366200640 1 -- 172.21.15.17:0/2937406962 wait complete. 2024-09-10T23:24:10.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:24:11.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.079+0000 7f015ca00640 1 -- 172.21.15.17:0/2717765459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 msgr2=0x7f01580d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.079+0000 7f015ca00640 1 --2- 172.21.15.17:0/2717765459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 0x7f01580d0030 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0150009c80 tx=0x7f015001f5a0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.079+0000 7f015ca00640 1 -- 172.21.15.17:0/2717765459 shutdown_connections 2024-09-10T23:24:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.079+0000 7f015ca00640 1 --2- 172.21.15.17:0/2717765459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 0x7f01580d0030 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.079+0000 7f015ca00640 1 --2- 172.21.15.17:0/2717765459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0158160280 0x7f01580cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.079+0000 7f015ca00640 1 -- 172.21.15.17:0/2717765459 >> 172.21.15.17:0/2717765459 conn(0x7f01580d1d10 msgr2=0x7f01580d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.079+0000 7f015ca00640 1 -- 172.21.15.17:0/2717765459 shutdown_connections 2024-09-10T23:24:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.079+0000 7f015ca00640 1 -- 172.21.15.17:0/2717765459 wait complete. 2024-09-10T23:24:11.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 Processor -- start 2024-09-10T23:24:11.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 -- start start 2024-09-10T23:24:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01580d2830 0x7f0158156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0158160280 0x7f01581f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 0x7f015806df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f01580afe30 con 0x7f0158160660 2024-09-10T23:24:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01580afcb0 con 0x7f01580d2830 2024-09-10T23:24:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f01580affb0 con 0x7f0158160280 2024-09-10T23:24:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0156800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 0x7f015806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0156800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 0x7f015806df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35366/0 (socket says 172.21.15.17:35366) 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0156800640 1 -- 172.21.15.17:0/495990354 learned_addr learned my addr 172.21.15.17:0/495990354 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0155e00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01580d2830 0x7f0158156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f014fe00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0158160280 0x7f01581f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0156800640 1 -- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0158160280 msgr2=0x7f01581f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0156800640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0158160280 0x7f01581f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0156800640 1 -- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01580d2830 msgr2=0x7f0158156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0156800640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01580d2830 0x7f0158156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0156800640 1 -- 172.21.15.17:0/495990354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0158153bf0 con 0x7f0158160660 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f0156800640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 0x7f015806df20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0150009bd0 tx=0x7f0150005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f014e000640 1 -- 172.21.15.17:0/495990354 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150004c50 con 0x7f0158160660 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f014e000640 1 -- 172.21.15.17:0/495990354 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01500be030 con 0x7f0158160660 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f014e000640 1 -- 172.21.15.17:0/495990354 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500afb00 con 0x7f0158160660 2024-09-10T23:24:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01581f7d20 con 0x7f0158160660 2024-09-10T23:24:11.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01581f82e0 con 0x7f0158160660 2024-09-10T23:24:11.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.083+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01580b04a0 con 0x7f0158160660 2024-09-10T23:24:11.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.087+0000 7f014e000640 1 -- 172.21.15.17:0/495990354 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f01500afca0 con 0x7f0158160660 2024-09-10T23:24:11.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.087+0000 7f014e000640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01340725e0 0x7f0134074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.087+0000 7f014e000640 1 -- 172.21.15.17:0/495990354 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7f0150131eb0 con 0x7f0158160660 2024-09-10T23:24:11.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.087+0000 7f0155e00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01340725e0 0x7f0134074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.087+0000 7f0155e00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01340725e0 0x7f0134074aa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f014800bc00 tx=0x7f014800b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:11.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.091+0000 7f014e000640 1 -- 172.21.15.17:0/495990354 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f01500ac050 con 0x7f0158160660 2024-09-10T23:24:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.263+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01580d2500 con 0x7f0158160660 2024-09-10T23:24:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f014e000640 1 -- 172.21.15.17:0/495990354 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+17001 (secure 0 0 0) 0x7f0150019100 con 0x7f0158160660 2024-09-10T23:24:11.269 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:11.269 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":122,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:23:45.768021+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:10.273423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:11.522343+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":121,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01340725e0 msgr2=0x7f0134074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01340725e0 0x7f0134074aa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f014800bc00 tx=0x7f014800b390 comp rx=0 tx=0).stop 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 msgr2=0x7f015806df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 0x7f015806df20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0150009bd0 tx=0x7f0150005b00 comp rx=0 tx=0).stop 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 shutdown_connections 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01340725e0 0x7f0134074aa0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0158160660 0x7f015806df20 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0158160280 0x7f01581f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 --2- 172.21.15.17:0/495990354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01580d2830 0x7f0158156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 >> 172.21.15.17:0/495990354 conn(0x7f01580d1d10 msgr2=0x7f01580b6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 shutdown_connections 2024-09-10T23:24:11.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.267+0000 7f015ca00640 1 -- 172.21.15.17:0/495990354 wait complete. 2024-09-10T23:24:11.290 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:24:11.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:11.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.435+0000 7fd44f400640 1 -- 172.21.15.17:0/1104544269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd430004810 msgr2=0x7fd430004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.435+0000 7fd44f400640 1 --2- 172.21.15.17:0/1104544269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd430004810 0x7fd430004c90 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fd43400bb10 tx=0x7fd43401cda0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.435+0000 7fd44f400640 1 -- 172.21.15.17:0/1104544269 shutdown_connections 2024-09-10T23:24:11.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.435+0000 7fd44f400640 1 --2- 172.21.15.17:0/1104544269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd430004810 0x7fd430004c90 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.435+0000 7fd44f400640 1 -- 172.21.15.17:0/1104544269 >> 172.21.15.17:0/1104544269 conn(0x7fd4480d1d10 msgr2=0x7fd4480d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:11.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.435+0000 7fd44f400640 1 -- 172.21.15.17:0/1104544269 shutdown_connections 2024-09-10T23:24:11.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.435+0000 7fd44f400640 1 -- 172.21.15.17:0/1104544269 wait complete. 2024-09-10T23:24:11.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.435+0000 7fd44f400640 1 Processor -- start 2024-09-10T23:24:11.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.435+0000 7fd44f400640 1 -- start start 2024-09-10T23:24:11.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd430004810 0x7fd4481ec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4480c7a10 0x7fd4481fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd448159dd0 0x7fd4480712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44f400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd4480d0420 con 0x7fd448159dd0 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44f400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4480b10f0 con 0x7fd4480c7a10 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44f400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd4480d05a0 con 0x7fd430004810 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd448159dd0 0x7fd4480712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd448159dd0 0x7fd4480712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35388/0 (socket says 172.21.15.17:35388) 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44d400640 1 -- 172.21.15.17:0/1552180820 learned_addr learned my addr 172.21.15.17:0/1552180820 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44ca00640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd430004810 0x7fd4481ec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd447e00640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4480c7a10 0x7fd4481fb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44d400640 1 -- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd430004810 msgr2=0x7fd4481ec4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44d400640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd430004810 0x7fd4481ec4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44d400640 1 -- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4480c7a10 msgr2=0x7fd4481fb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44d400640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4480c7a10 0x7fd4481fb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44d400640 1 -- 172.21.15.17:0/1552180820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4481fbd10 con 0x7fd448159dd0 2024-09-10T23:24:11.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44d400640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd448159dd0 0x7fd4480712e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fd448073220 tx=0x7fd4400019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:11.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd444c00640 1 -- 172.21.15.17:0/1552180820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440015020 con 0x7fd448159dd0 2024-09-10T23:24:11.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd444c00640 1 -- 172.21.15.17:0/1552180820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd440011960 con 0x7fd448159dd0 2024-09-10T23:24:11.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd444c00640 1 -- 172.21.15.17:0/1552180820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440011db0 con 0x7fd448159dd0 2024-09-10T23:24:11.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44815a8a0 con 0x7fd448159dd0 2024-09-10T23:24:11.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4480c9220 con 0x7fd448159dd0 2024-09-10T23:24:11.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.439+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4480c9830 con 0x7fd448159dd0 2024-09-10T23:24:11.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.443+0000 7fd444c00640 1 -- 172.21.15.17:0/1552180820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd44001a400 con 0x7fd448159dd0 2024-09-10T23:24:11.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.443+0000 7fd444c00640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd428072610 0x7fd428074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.443+0000 7fd444c00640 1 -- 172.21.15.17:0/1552180820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7fd440093f40 con 0x7fd448159dd0 2024-09-10T23:24:11.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.443+0000 7fd44ca00640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd428072610 0x7fd428074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.443+0000 7fd44ca00640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd428072610 0x7fd428074ad0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd43c001250 tx=0x7fd43c006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:11.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.447+0000 7fd444c00640 1 -- 172.21.15.17:0/1552180820 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd44001f020 con 0x7fd448159dd0 2024-09-10T23:24:11.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.655+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4480c9040 con 0x7fd448159dd0 2024-09-10T23:24:11.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.655+0000 7fd444c00640 1 -- 172.21.15.17:0/1552180820 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5216 (secure 0 0 0) 0x7fd4480c9040 con 0x7fd448159dd0 2024-09-10T23:24:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:11.660 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"btime":"2024-09-10T23:22:22:200267+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/151616867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":151616867},{"type":"v1","addr":"172.21.15.77:6836","nonce":151616867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7824,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/623866149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":623866149},{"type":"v1","addr":"172.21.15.17:6834","nonce":623866149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7827,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2269575278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2269575278},{"type":"v1","addr":"172.21.15.17:6835","nonce":2269575278}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T23:22:12.557691+0000","modified":"2024-09-10T23:22:21.252279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/258682540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":258682540},{"type":"v1","addr":"172.21.15.77:6837","nonce":258682540}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":7}]} 2024-09-10T23:24:11.660 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 87 2024-09-10T23:24:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd428072610 msgr2=0x7fd428074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd428072610 0x7fd428074ad0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd43c001250 tx=0x7fd43c006040 comp rx=0 tx=0).stop 2024-09-10T23:24:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd448159dd0 msgr2=0x7fd4480712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd448159dd0 0x7fd4480712e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fd448073220 tx=0x7fd4400019c0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 shutdown_connections 2024-09-10T23:24:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd428072610 0x7fd428074ad0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd448159dd0 0x7fd4480712e0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4480c7a10 0x7fd4481fb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 --2- 172.21.15.17:0/1552180820 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd430004810 0x7fd4481ec4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 >> 172.21.15.17:0/1552180820 conn(0x7fd4480d1d10 msgr2=0x7fd4480d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 shutdown_connections 2024-09-10T23:24:11.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.659+0000 7fd44f400640 1 -- 172.21.15.17:0/1552180820 wait complete. 2024-09-10T23:24:11.680 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:11.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.823+0000 7f8bf2a00640 1 -- 172.21.15.17:0/204671865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bec0d0670 msgr2=0x7f8bec0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.823+0000 7f8bf2a00640 1 --2- 172.21.15.17:0/204671865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bec0d0670 0x7f8bec0b31c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009bc0 tx=0x7f8be401cba0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.823+0000 7f8bf2a00640 1 -- 172.21.15.17:0/204671865 shutdown_connections 2024-09-10T23:24:11.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.823+0000 7f8bf2a00640 1 --2- 172.21.15.17:0/204671865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bec0d0670 0x7f8bec0b31c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.823+0000 7f8bf2a00640 1 --2- 172.21.15.17:0/204671865 >> v2:172.21.15.77:3300/0 conn(0x7f8bec13ce90 0x7f8bec0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.823+0000 7f8bf2a00640 1 -- 172.21.15.17:0/204671865 >> 172.21.15.17:0/204671865 conn(0x7f8bec06cfc0 msgr2=0x7f8bec06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:11.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.823+0000 7f8bf2a00640 1 -- 172.21.15.17:0/204671865 shutdown_connections 2024-09-10T23:24:11.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.823+0000 7f8bf2a00640 1 -- 172.21.15.17:0/204671865 wait complete. 2024-09-10T23:24:11.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 Processor -- start 2024-09-10T23:24:11.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 -- start start 2024-09-10T23:24:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bec0d0290 0x7f8bec137650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bec0d0670 0x7f8bec1fad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec13ce90 0x7f8bec1fb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec166d00 con 0x7f8bec0d0290 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec15b1c0 con 0x7f8bec13ce90 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8bec166e80 con 0x7f8bec0d0670 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bec0d0290 0x7f8bec137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bec0d0290 0x7f8bec137650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35404/0 (socket says 172.21.15.17:35404) 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bebe00640 1 -- 172.21.15.17:0/1593385671 learned_addr learned my addr 172.21.15.17:0/1593385671 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8beb400640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bec0d0670 0x7f8bec1fad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf0a00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec13ce90 0x7f8bec1fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bebe00640 1 -- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bec0d0670 msgr2=0x7f8bec1fad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bebe00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bec0d0670 0x7f8bec1fad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bebe00640 1 -- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec13ce90 msgr2=0x7f8bec1fb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bebe00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec13ce90 0x7f8bec1fb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bebe00640 1 -- 172.21.15.17:0/1593385671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec137370 con 0x7f8bec0d0290 2024-09-10T23:24:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf0a00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec13ce90 0x7f8bec1fb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bebe00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bec0d0290 0x7f8bec137650 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c490 tx=0x7f8bdc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8be3e00640 1 -- 172.21.15.17:0/1593385671 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc011790 con 0x7f8bec0d0290 2024-09-10T23:24:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8be3e00640 1 -- 172.21.15.17:0/1593385671 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bdc017070 con 0x7f8bec0d0290 2024-09-10T23:24:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8be3e00640 1 -- 172.21.15.17:0/1593385671 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc011ce0 con 0x7f8bec0d0290 2024-09-10T23:24:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bec1fba80 con 0x7f8bec0d0290 2024-09-10T23:24:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bec1fb7a0 con 0x7f8bec0d0290 2024-09-10T23:24:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.827+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bec13c780 con 0x7f8bec0d0290 2024-09-10T23:24:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.831+0000 7f8be3e00640 1 -- 172.21.15.17:0/1593385671 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8bdc01c460 con 0x7f8bec0d0290 2024-09-10T23:24:11.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.831+0000 7f8be3e00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bcc072610 0x7f8bcc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:11.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.831+0000 7f8be3e00640 1 -- 172.21.15.17:0/1593385671 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7f8bdc093130 con 0x7f8bec0d0290 2024-09-10T23:24:11.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.831+0000 7f8beb400640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bcc072610 0x7f8bcc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:11.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.831+0000 7f8beb400640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bcc072610 0x7f8bcc074ad0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800afd0 tx=0x7f8bd800c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:11.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:11.835+0000 7f8be3e00640 1 -- 172.21.15.17:0/1593385671 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8bdc05e670 con 0x7f8bec0d0290 2024-09-10T23:24:12.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bec13d710 con 0x7f8bec0d0290 2024-09-10T23:24:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8be3e00640 1 -- 172.21.15.17:0/1593385671 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5216 (secure 0 0 0) 0x7f8bdc05df70 con 0x7f8bec0d0290 2024-09-10T23:24:12.045 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:12.045 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":87,"btime":"2024-09-10T23:22:22:200267+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/151616867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":151616867},{"type":"v1","addr":"172.21.15.77:6836","nonce":151616867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7824,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/623866149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":623866149},{"type":"v1","addr":"172.21.15.17:6834","nonce":623866149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7827,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2269575278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2269575278},{"type":"v1","addr":"172.21.15.17:6835","nonce":2269575278}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T23:22:12.557691+0000","modified":"2024-09-10T23:22:21.252279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/258682540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":258682540},{"type":"v1","addr":"172.21.15.77:6837","nonce":258682540}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":7}]} 2024-09-10T23:24:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 87 2024-09-10T23:24:12.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bcc072610 msgr2=0x7f8bcc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bcc072610 0x7f8bcc074ad0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800afd0 tx=0x7f8bd800c040 comp rx=0 tx=0).stop 2024-09-10T23:24:12.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bec0d0290 msgr2=0x7f8bec137650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bec0d0290 0x7f8bec137650 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c490 tx=0x7f8bdc00c950 comp rx=0 tx=0).stop 2024-09-10T23:24:12.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 shutdown_connections 2024-09-10T23:24:12.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bcc072610 0x7f8bcc074ad0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bec13ce90 0x7f8bec1fb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bec0d0670 0x7f8bec1fad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 --2- 172.21.15.17:0/1593385671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bec0d0290 0x7f8bec137650 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 >> 172.21.15.17:0/1593385671 conn(0x7f8bec06cfc0 msgr2=0x7f8bec138e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 shutdown_connections 2024-09-10T23:24:12.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.043+0000 7f8bf2a00640 1 -- 172.21.15.17:0/1593385671 wait complete. 2024-09-10T23:24:12.067 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:24:12.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 -- 172.21.15.17:0/3422754846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 msgr2=0x7f83200d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 --2- 172.21.15.17:0/3422754846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 0x7f83200d0030 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f832006db00 tx=0x7f830c01f0b0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 -- 172.21.15.17:0/3422754846 shutdown_connections 2024-09-10T23:24:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 --2- 172.21.15.17:0/3422754846 >> v2:172.21.15.77:3300/0 conn(0x7f8320160660 0x7f83200af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 --2- 172.21.15.17:0/3422754846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 0x7f83200d0030 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 --2- 172.21.15.17:0/3422754846 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8320160280 0x7f83200cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 -- 172.21.15.17:0/3422754846 >> 172.21.15.17:0/3422754846 conn(0x7f83200d1d10 msgr2=0x7f83200d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 -- 172.21.15.17:0/3422754846 shutdown_connections 2024-09-10T23:24:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 -- 172.21.15.17:0/3422754846 wait complete. 2024-09-10T23:24:12.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 Processor -- start 2024-09-10T23:24:12.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.215+0000 7f8327e00640 1 -- start start 2024-09-10T23:24:12.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8327e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 0x7f8320155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8327e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8320160280 0x7f83200ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8327e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8320160660 0x7f83200c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8327e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83200b0060 con 0x7f83200d2830 2024-09-10T23:24:12.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8327e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f83200afee0 con 0x7f8320160660 2024-09-10T23:24:12.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8327e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f83200b01e0 con 0x7f8320160280 2024-09-10T23:24:12.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 0x7f8320155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 0x7f8320155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35416/0 (socket says 172.21.15.17:35416) 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325400640 1 -- 172.21.15.17:0/2017830129 learned_addr learned my addr 172.21.15.17:0/2017830129 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325e00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8320160660 0x7f83200c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8324a00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8320160280 0x7f83200ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325400640 1 -- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8320160280 msgr2=0x7f83200ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325400640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8320160280 0x7f83200ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325400640 1 -- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8320160660 msgr2=0x7f83200c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325400640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8320160660 0x7f83200c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325400640 1 -- 172.21.15.17:0/2017830129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83200cd7f0 con 0x7f83200d2830 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8324a00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8320160280 0x7f83200ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325e00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8320160660 0x7f83200c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8325400640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 0x7f8320155560 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f831400b550 tx=0x7f831400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f831d600640 1 -- 172.21.15.17:0/2017830129 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314014070 con 0x7f83200d2830 2024-09-10T23:24:12.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f831d600640 1 -- 172.21.15.17:0/2017830129 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8314010980 con 0x7f83200d2830 2024-09-10T23:24:12.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f831d600640 1 -- 172.21.15.17:0/2017830129 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314010dd0 con 0x7f83200d2830 2024-09-10T23:24:12.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83200cda90 con 0x7f83200d2830 2024-09-10T23:24:12.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83200ce050 con 0x7f83200d2830 2024-09-10T23:24:12.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83200b0700 con 0x7f83200d2830 2024-09-10T23:24:12.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.219+0000 7f831d600640 1 -- 172.21.15.17:0/2017830129 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f831400f3c0 con 0x7f83200d2830 2024-09-10T23:24:12.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.223+0000 7f831d600640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83000725e0 0x7f8300074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.223+0000 7f831d600640 1 -- 172.21.15.17:0/2017830129 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7f83140934f0 con 0x7f83200d2830 2024-09-10T23:24:12.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.223+0000 7f8324a00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83000725e0 0x7f8300074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.223+0000 7f8324a00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83000725e0 0x7f8300074aa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f830c0b2000 tx=0x7f830c01d8f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.227+0000 7f831d600640 1 -- 172.21.15.17:0/2017830129 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f831405ea00 con 0x7f83200d2830 2024-09-10T23:24:12.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.399+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83200b5ad0 con 0x7f83200d2830 2024-09-10T23:24:12.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f831d600640 1 -- 172.21.15.17:0/2017830129 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+17001 (secure 0 0 0) 0x7f831405e300 con 0x7f83200d2830 2024-09-10T23:24:12.404 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:12.404 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":122,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:23:45.768021+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:22:10.273423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-10T23:22:11.522343+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":121,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:12.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83000725e0 msgr2=0x7f8300074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83000725e0 0x7f8300074aa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f830c0b2000 tx=0x7f830c01d8f0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 msgr2=0x7f8320155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 0x7f8320155560 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f831400b550 tx=0x7f831400ba10 comp rx=0 tx=0).stop 2024-09-10T23:24:12.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 shutdown_connections 2024-09-10T23:24:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83000725e0 0x7f8300074aa0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8320160660 0x7f83200c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8320160280 0x7f83200ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 --2- 172.21.15.17:0/2017830129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83200d2830 0x7f8320155560 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 >> 172.21.15.17:0/2017830129 conn(0x7f83200d1d10 msgr2=0x7f83200b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 shutdown_connections 2024-09-10T23:24:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.403+0000 7f8327e00640 1 -- 172.21.15.17:0/2017830129 wait complete. 2024-09-10T23:24:12.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:24:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.571+0000 7f1914e00640 1 -- 172.21.15.17:0/3951616164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015bd60 msgr2=0x7f19100cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.571+0000 7f1914e00640 1 --2- 172.21.15.17:0/3951616164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015bd60 0x7f19100cf940 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f19100d1400 tx=0x7f18f801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.571+0000 7f1914e00640 1 -- 172.21.15.17:0/3951616164 shutdown_connections 2024-09-10T23:24:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.571+0000 7f1914e00640 1 --2- 172.21.15.17:0/3951616164 >> v2:172.21.15.77:3300/0 conn(0x7f19100d1990 0x7f19100d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.571+0000 7f1914e00640 1 --2- 172.21.15.17:0/3951616164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015bd60 0x7f19100cf940 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.571+0000 7f1914e00640 1 -- 172.21.15.17:0/3951616164 >> 172.21.15.17:0/3951616164 conn(0x7f191009a9f0 msgr2=0x7f191009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.571+0000 7f1914e00640 1 -- 172.21.15.17:0/3951616164 shutdown_connections 2024-09-10T23:24:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.571+0000 7f1914e00640 1 -- 172.21.15.17:0/3951616164 wait complete. 2024-09-10T23:24:12.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 Processor -- start 2024-09-10T23:24:12.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 -- start start 2024-09-10T23:24:12.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19100d1990 0x7f19100b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015b980 0x7f1910156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191015bd60 0x7f19100b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1910168ab0 con 0x7f191015b980 2024-09-10T23:24:12.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1910168930 con 0x7f19100d1990 2024-09-10T23:24:12.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1910168c30 con 0x7f191015bd60 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015b980 0x7f1910156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015b980 0x7f1910156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35428/0 (socket says 172.21.15.17:35428) 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907e00640 1 -- 172.21.15.17:0/3271702714 learned_addr learned my addr 172.21.15.17:0/3271702714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f190f400640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19100d1990 0x7f19100b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f190fe00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191015bd60 0x7f19100b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907e00640 1 -- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191015bd60 msgr2=0x7f19100b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907e00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191015bd60 0x7f19100b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907e00640 1 -- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19100d1990 msgr2=0x7f19100b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907e00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19100d1990 0x7f19100b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907e00640 1 -- 172.21.15.17:0/3271702714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1910071320 con 0x7f191015b980 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907e00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015b980 0x7f1910156840 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f18f80b0040 tx=0x7f18f8005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907400640 1 -- 172.21.15.17:0/3271702714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80b2040 con 0x7f191015b980 2024-09-10T23:24:12.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907400640 1 -- 172.21.15.17:0/3271702714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18f80044b0 con 0x7f191015b980 2024-09-10T23:24:12.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1907400640 1 -- 172.21.15.17:0/3271702714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8003860 con 0x7f191015b980 2024-09-10T23:24:12.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19100715c0 con 0x7f191015b980 2024-09-10T23:24:12.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.575+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19100b5770 con 0x7f191015b980 2024-09-10T23:24:12.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.579+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19100d1de0 con 0x7f191015b980 2024-09-10T23:24:12.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.579+0000 7f1907400640 1 -- 172.21.15.17:0/3271702714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f18f8003a00 con 0x7f191015b980 2024-09-10T23:24:12.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.579+0000 7f1907400640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18ec0725e0 0x7f18ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.579+0000 7f1907400640 1 -- 172.21.15.17:0/3271702714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6158+0+0 (secure 0 0 0) 0x7f18f812d330 con 0x7f191015b980 2024-09-10T23:24:12.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.579+0000 7f190f400640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18ec0725e0 0x7f18ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.583+0000 7f190f400640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18ec0725e0 0x7f18ec074aa0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1900004e30 tx=0x7f1900009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.583+0000 7f1907400640 1 -- 172.21.15.17:0/3271702714 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f18f80bd060 con 0x7f191015b980 2024-09-10T23:24:12.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.795+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f19100721d0 con 0x7f191015b980 2024-09-10T23:24:12.796 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:24:12.795+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:24:12.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.795+0000 7f1907400640 1 -- 172.21.15.17:0/3271702714 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v88) ==== 161+0+0 (secure 0 0 0) 0x7f18f80164b0 con 0x7f191015b980 2024-09-10T23:24:12.798 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:24:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18ec0725e0 msgr2=0x7f18ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18ec0725e0 0x7f18ec074aa0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1900004e30 tx=0x7f1900009040 comp rx=0 tx=0).stop 2024-09-10T23:24:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015b980 msgr2=0x7f1910156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015b980 0x7f1910156840 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f18f80b0040 tx=0x7f18f8005770 comp rx=0 tx=0).stop 2024-09-10T23:24:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 shutdown_connections 2024-09-10T23:24:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18ec0725e0 0x7f18ec074aa0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f191015bd60 0x7f19100b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f191015b980 0x7f1910156840 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 --2- 172.21.15.17:0/3271702714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19100d1990 0x7f19100b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 >> 172.21.15.17:0/3271702714 conn(0x7f191009a9f0 msgr2=0x7f191006e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 shutdown_connections 2024-09-10T23:24:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.799+0000 7f1914e00640 1 -- 172.21.15.17:0/3271702714 wait complete. 2024-09-10T23:24:12.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:24:12.876 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:24:12.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.971+0000 7fa854c00640 1 -- 172.21.15.17:0/3344172866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8500b2540 msgr2=0x7fa8500d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.971+0000 7fa854c00640 1 --2- 172.21.15.17:0/3344172866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8500b2540 0x7fa8500d03b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fa838009840 tx=0x7fa83801c820 comp rx=0 tx=0).stop 2024-09-10T23:24:12.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.971+0000 7fa854c00640 1 -- 172.21.15.17:0/3344172866 shutdown_connections 2024-09-10T23:24:12.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.971+0000 7fa854c00640 1 --2- 172.21.15.17:0/3344172866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8500b2540 0x7fa8500d03b0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.971+0000 7fa854c00640 1 -- 172.21.15.17:0/3344172866 >> 172.21.15.17:0/3344172866 conn(0x7fa8500d1da0 msgr2=0x7fa8500d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:12.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.971+0000 7fa854c00640 1 -- 172.21.15.17:0/3344172866 shutdown_connections 2024-09-10T23:24:12.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.971+0000 7fa854c00640 1 -- 172.21.15.17:0/3344172866 wait complete. 2024-09-10T23:24:12.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.971+0000 7fa854c00640 1 Processor -- start 2024-09-10T23:24:12.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.971+0000 7fa854c00640 1 -- start start 2024-09-10T23:24:12.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa854c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8500b2540 0x7fa85015e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa854c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8500b31b0 0x7fa8500cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa854c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa85015f400 0x7fa8500d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa854c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa850169e80 con 0x7fa85015f400 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa854c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8500cdc80 con 0x7fa8500b2540 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa854c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa85016a000 con 0x7fa8500b31b0 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa85015f400 0x7fa8500d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa85015f400 0x7fa8500d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35454/0 (socket says 172.21.15.17:35454) 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84e800640 1 -- 172.21.15.17:0/3437220299 learned_addr learned my addr 172.21.15.17:0/3437220299 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa847e00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8500b31b0 0x7fa8500cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84de00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8500b2540 0x7fa85015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84e800640 1 -- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8500b31b0 msgr2=0x7fa8500cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84e800640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8500b31b0 0x7fa8500cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84e800640 1 -- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8500b2540 msgr2=0x7fa85015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84e800640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8500b2540 0x7fa85015e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84e800640 1 -- 172.21.15.17:0/3437220299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8500b7410 con 0x7fa85015f400 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa84e800640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa85015f400 0x7fa8500d01e0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fa84800c7c0 tx=0x7fa84800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa846000640 1 -- 172.21.15.17:0/3437220299 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848003b80 con 0x7fa85015f400 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa846000640 1 -- 172.21.15.17:0/3437220299 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa848003d20 con 0x7fa85015f400 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa846000640 1 -- 172.21.15.17:0/3437220299 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84800aab0 con 0x7fa85015f400 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8500b76f0 con 0x7fa85015f400 2024-09-10T23:24:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8500b65a0 con 0x7fa85015f400 2024-09-10T23:24:12.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.975+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa85014b3e0 con 0x7fa85015f400 2024-09-10T23:24:12.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.979+0000 7fa846000640 1 -- 172.21.15.17:0/3437220299 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa84800ac50 con 0x7fa85015f400 2024-09-10T23:24:12.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.979+0000 7fa846000640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa82c0725e0 0x7fa82c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:12.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.979+0000 7fa846000640 1 -- 172.21.15.17:0/3437220299 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 6216+0+0 (secure 0 0 0) 0x7fa8480931e0 con 0x7fa85015f400 2024-09-10T23:24:12.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.979+0000 7fa84de00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa82c0725e0 0x7fa82c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:12.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.979+0000 7fa84de00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa82c0725e0 0x7fa82c074aa0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa840001870 tx=0x7fa840001380 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:12.983+0000 7fa846000640 1 -- 172.21.15.17:0/3437220299 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa85014b3e0 con 0x7fa85015f400 2024-09-10T23:24:13.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.195+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa8500cc8b0 con 0x7fa85015f400 2024-09-10T23:24:13.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.883+0000 7fa846000640 1 -- 172.21.15.17:0/3437220299 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v89) ==== 104+0+0 (secure 0 0 0) 0x7fa84805e060 con 0x7fa85015f400 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.883+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa82c0725e0 msgr2=0x7fa82c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.883+0000 7fa854c00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa82c0725e0 0x7fa82c074aa0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa840001870 tx=0x7fa840001380 comp rx=0 tx=0).stop 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa85015f400 msgr2=0x7fa8500d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa85015f400 0x7fa8500d01e0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fa84800c7c0 tx=0x7fa84800cc80 comp rx=0 tx=0).stop 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 shutdown_connections 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa82c0725e0 0x7fa82c074aa0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa85015f400 0x7fa8500d01e0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8500b31b0 0x7fa8500cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 --2- 172.21.15.17:0/3437220299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8500b2540 0x7fa85015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:13.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 >> 172.21.15.17:0/3437220299 conn(0x7fa8500d1da0 msgr2=0x7fa8500aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:13.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 shutdown_connections 2024-09-10T23:24:13.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:13.887+0000 7fa854c00640 1 -- 172.21.15.17:0/3437220299 wait complete. 2024-09-10T23:24:13.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:24:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 -- 172.21.15.17:0/2164412440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f40004810 msgr2=0x7f1f40004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 --2- 172.21.15.17:0/2164412440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f40004810 0x7f1f40004c90 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f1f440016c0 tx=0x7f1f4401c790 comp rx=0 tx=0).stop 2024-09-10T23:24:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f5a800640 1 -- 172.21.15.17:0/2164412440 reap_dead start 2024-09-10T23:24:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 -- 172.21.15.17:0/2164412440 shutdown_connections 2024-09-10T23:24:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 -- 172.21.15.17:0/2164412440 >> 172.21.15.17:0/2164412440 conn(0x7f1f5c0b17a0 msgr2=0x7f1f5c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 -- 172.21.15.17:0/2164412440 shutdown_connections 2024-09-10T23:24:14.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 -- 172.21.15.17:0/2164412440 wait complete. 2024-09-10T23:24:14.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 Processor -- start 2024-09-10T23:24:14.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 -- start start 2024-09-10T23:24:14.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f40004810 0x7f1f5c143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:14.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f5c1f56d0 0x7f1f5c0ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:14.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f5c0adee0 0x7f1f5c0ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:14.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c073780 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c073600 con 0x7f1f5c0adee0 2024-09-10T23:24:14.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f60c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c073900 con 0x7f1f40004810 2024-09-10T23:24:14.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f51400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f5c1f56d0 0x7f1f5c0ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:14.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f51400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f5c1f56d0 0x7f1f5c0ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35470/0 (socket says 172.21.15.17:35470) 2024-09-10T23:24:14.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f51400640 1 -- 172.21.15.17:0/3388573256 learned_addr learned my addr 172.21.15.17:0/3388573256 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:14.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f59e00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f40004810 0x7f1f5c143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:14.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f5a800640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f5c0adee0 0x7f1f5c0ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:14.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f51400640 1 -- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f40004810 msgr2=0x7f1f5c143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f51400640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f40004810 0x7f1f5c143bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f51400640 1 -- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f5c0adee0 msgr2=0x7f1f5c0ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f51400640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f5c0adee0 0x7f1f5c0ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.063+0000 7f1f51400640 1 -- 172.21.15.17:0/3388573256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c0cea20 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.067+0000 7f1f51400640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f5c1f56d0 0x7f1f5c0ad9a0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000c10 tx=0x7f1f44003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.067+0000 7f1f52a00640 1 -- 172.21.15.17:0/3388573256 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44001310 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.067+0000 7f1f52a00640 1 -- 172.21.15.17:0/3388573256 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f44006500 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.067+0000 7f1f52a00640 1 -- 172.21.15.17:0/3388573256 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44006930 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.067+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c144100 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.067+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c0aac20 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.067+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5c074450 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.067+0000 7f1f52a00640 1 -- 172.21.15.17:0/3388573256 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1f440a64f0 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.067+0000 7f1f52a00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1f380725e0 0x7f1f38074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:14.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.071+0000 7f1f52a00640 1 -- 172.21.15.17:0/3388573256 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 6216+0+0 (secure 0 0 0) 0x7f1f4412d610 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.071+0000 7f1f59e00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1f380725e0 0x7f1f38074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:14.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.071+0000 7f1f59e00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1f380725e0 0x7f1f38074aa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009b60 tx=0x7f1f4c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:14.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.071+0000 7f1f52a00640 1 -- 172.21.15.17:0/3388573256 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1f440bf060 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.247+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1f5c068f70 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.887+0000 7f1f52a00640 1 -- 172.21.15.17:0/3388573256 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v124) ==== 181+0+0 (secure 0 0 0) 0x7f1f440aa050 con 0x7f1f5c1f56d0 2024-09-10T23:24:14.891 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:24:14.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1f380725e0 msgr2=0x7f1f38074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1f380725e0 0x7f1f38074aa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009b60 tx=0x7f1f4c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f5c1f56d0 msgr2=0x7f1f5c0ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:14.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f5c1f56d0 0x7f1f5c0ad9a0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000c10 tx=0x7f1f44003be0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 shutdown_connections 2024-09-10T23:24:14.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1f380725e0 0x7f1f38074aa0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f5c0adee0 0x7f1f5c0ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f5c1f56d0 0x7f1f5c0ad9a0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 --2- 172.21.15.17:0/3388573256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f40004810 0x7f1f5c143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:14.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 >> 172.21.15.17:0/3388573256 conn(0x7f1f5c0b17a0 msgr2=0x7f1f5c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:14.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 shutdown_connections 2024-09-10T23:24:14.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:14.891+0000 7f1f60c00640 1 -- 172.21.15.17:0/3388573256 wait complete. 2024-09-10T23:24:14.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:24:15.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.071+0000 7f4c8a400640 1 -- 172.21.15.17:0/17693955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c840cf750 msgr2=0x7f4c8406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.071+0000 7f4c8a400640 1 --2- 172.21.15.17:0/17693955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c840cf750 0x7f4c8406f700 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f4c8406c870 tx=0x7f4c7c01cd50 comp rx=0 tx=0).stop 2024-09-10T23:24:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.071+0000 7f4c8a400640 1 -- 172.21.15.17:0/17693955 shutdown_connections 2024-09-10T23:24:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.071+0000 7f4c8a400640 1 --2- 172.21.15.17:0/17693955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c840cf750 0x7f4c8406f700 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.071+0000 7f4c8a400640 1 --2- 172.21.15.17:0/17693955 >> v2:172.21.15.77:3300/0 conn(0x7f4c8415a2a0 0x7f4c840b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.071+0000 7f4c8a400640 1 -- 172.21.15.17:0/17693955 >> 172.21.15.17:0/17693955 conn(0x7f4c840b17a0 msgr2=0x7f4c840b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.071+0000 7f4c8a400640 1 -- 172.21.15.17:0/17693955 shutdown_connections 2024-09-10T23:24:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.071+0000 7f4c8a400640 1 -- 172.21.15.17:0/17693955 wait complete. 2024-09-10T23:24:15.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 Processor -- start 2024-09-10T23:24:15.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 -- start start 2024-09-10T23:24:15.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c840b2fe0 0x7f4c84163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c840cf750 0x7f4c8415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c8415a2a0 0x7f4c8414e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c84167940 con 0x7f4c8415a2a0 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4c84167ac0 con 0x7f4c840cf750 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4c84167c40 con 0x7f4c840b2fe0 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c8415a2a0 0x7f4c8414e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c8415a2a0 0x7f4c8414e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35484/0 (socket says 172.21.15.17:35484) 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83e00640 1 -- 172.21.15.17:0/2270896903 learned_addr learned my addr 172.21.15.17:0/2270896903 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c840b2fe0 0x7f4c84163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c7be00640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c840cf750 0x7f4c8415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83e00640 1 -- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c840b2fe0 msgr2=0x7f4c84163dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83e00640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c840b2fe0 0x7f4c84163dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83e00640 1 -- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c840cf750 msgr2=0x7f4c8415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83e00640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c840cf750 0x7f4c8415bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83e00640 1 -- 172.21.15.17:0/2270896903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c840cd590 con 0x7f4c8415a2a0 2024-09-10T23:24:15.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c83e00640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c8415a2a0 0x7f4c8414e1e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c019960 tx=0x7f4c7c0a5d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c7b400640 1 -- 172.21.15.17:0/2270896903 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0bb070 con 0x7f4c8415a2a0 2024-09-10T23:24:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c7b400640 1 -- 172.21.15.17:0/2270896903 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c7c004c50 con 0x7f4c8415a2a0 2024-09-10T23:24:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c7b400640 1 -- 172.21.15.17:0/2270896903 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0b2040 con 0x7f4c8415a2a0 2024-09-10T23:24:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c84162d80 con 0x7f4c8415a2a0 2024-09-10T23:24:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c841635c0 con 0x7f4c8415a2a0 2024-09-10T23:24:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.075+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c840b2aa0 con 0x7f4c8415a2a0 2024-09-10T23:24:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.079+0000 7f4c7b400640 1 -- 172.21.15.17:0/2270896903 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4c7c0b5030 con 0x7f4c8415a2a0 2024-09-10T23:24:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.079+0000 7f4c7b400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c600725d0 0x7f4c60074a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.079+0000 7f4c7b400640 1 -- 172.21.15.17:0/2270896903 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5778+0+0 (secure 0 0 0) 0x7f4c7c12cfd0 con 0x7f4c8415a2a0 2024-09-10T23:24:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.079+0000 7f4c83400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c600725d0 0x7f4c60074a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:15.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.079+0000 7f4c83400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c600725d0 0x7f4c60074a90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4c74006fd0 tx=0x7f4c74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:15.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.083+0000 7f4c7b400640 1 -- 172.21.15.17:0/2270896903 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4c84162d80 con 0x7f4c8415a2a0 2024-09-10T23:24:15.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.255+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4c840733c0 con 0x7f4c8415a2a0 2024-09-10T23:24:15.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.891+0000 7f4c7b400640 1 -- 172.21.15.17:0/2270896903 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v125) ==== 169+0+0 (secure 0 0 0) 0x7f4c7c016970 con 0x7f4c8415a2a0 2024-09-10T23:24:15.893 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:24:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c600725d0 msgr2=0x7f4c60074a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c600725d0 0x7f4c60074a90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4c74006fd0 tx=0x7f4c74008040 comp rx=0 tx=0).stop 2024-09-10T23:24:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c8415a2a0 msgr2=0x7f4c8414e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c8415a2a0 0x7f4c8414e1e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c019960 tx=0x7f4c7c0a5d80 comp rx=0 tx=0).stop 2024-09-10T23:24:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 shutdown_connections 2024-09-10T23:24:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c600725d0 0x7f4c60074a90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c8415a2a0 0x7f4c8414e1e0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c840cf750 0x7f4c8415bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 --2- 172.21.15.17:0/2270896903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c840b2fe0 0x7f4c84163dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 >> 172.21.15.17:0/2270896903 conn(0x7f4c840b17a0 msgr2=0x7f4c8406ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 shutdown_connections 2024-09-10T23:24:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:15.895+0000 7f4c8a400640 1 -- 172.21.15.17:0/2270896903 wait complete. 2024-09-10T23:24:15.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:24:16.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.087+0000 7f174e800640 1 -- 172.21.15.17:0/2125481373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f174815f130 msgr2=0x7f17480b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.087+0000 7f174e800640 1 --2- 172.21.15.17:0/2125481373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f174815f130 0x7f17480b21d0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f1738009900 tx=0x7f173801c8b0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.087+0000 7f174e800640 1 -- 172.21.15.17:0/2125481373 shutdown_connections 2024-09-10T23:24:16.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.087+0000 7f174e800640 1 --2- 172.21.15.17:0/2125481373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17480b3110 0x7f17480cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.087+0000 7f174e800640 1 --2- 172.21.15.17:0/2125481373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f174815f130 0x7f17480b21d0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.087+0000 7f174e800640 1 -- 172.21.15.17:0/2125481373 >> 172.21.15.17:0/2125481373 conn(0x7f17480b3870 msgr2=0x7f17480b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:16.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.087+0000 7f174e800640 1 -- 172.21.15.17:0/2125481373 shutdown_connections 2024-09-10T23:24:16.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.087+0000 7f174e800640 1 -- 172.21.15.17:0/2125481373 wait complete. 2024-09-10T23:24:16.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 Processor -- start 2024-09-10T23:24:16.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 -- start start 2024-09-10T23:24:16.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17480b3110 0x7f17481fbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480d02e0 0x7f174814f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174815f130 0x7f174814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1748169270 con 0x7f17480b3110 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17481690f0 con 0x7f17480d02e0 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f17481693f0 con 0x7f174815f130 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17480b3110 0x7f17481fbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17480b3110 0x7f17481fbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35504/0 (socket says 172.21.15.17:35504) 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747400640 1 -- 172.21.15.17:0/711089327 learned_addr learned my addr 172.21.15.17:0/711089327 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f173fe00640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480d02e0 0x7f174814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747e00640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174815f130 0x7f174814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747400640 1 -- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174815f130 msgr2=0x7f174814fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747400640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174815f130 0x7f174814fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747400640 1 -- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480d02e0 msgr2=0x7f174814f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747400640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480d02e0 0x7f174814f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747400640 1 -- 172.21.15.17:0/711089327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17481fb340 con 0x7f17480b3110 2024-09-10T23:24:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f1747400640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17480b3110 0x7f17481fbe00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f1738009850 tx=0x7f1738005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f173f400640 1 -- 172.21.15.17:0/711089327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380b2040 con 0x7f17480b3110 2024-09-10T23:24:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f173f400640 1 -- 172.21.15.17:0/711089327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1738005320 con 0x7f17480b3110 2024-09-10T23:24:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1748166460 con 0x7f17480b3110 2024-09-10T23:24:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f173f400640 1 -- 172.21.15.17:0/711089327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380046d0 con 0x7f17480b3110 2024-09-10T23:24:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17481fb8e0 con 0x7f17480b3110 2024-09-10T23:24:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.091+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17480cc5a0 con 0x7f17480b3110 2024-09-10T23:24:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.095+0000 7f173f400640 1 -- 172.21.15.17:0/711089327 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1738004870 con 0x7f17480b3110 2024-09-10T23:24:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.095+0000 7f173f400640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1724072610 0x7f1724074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.095+0000 7f173f400640 1 -- 172.21.15.17:0/711089327 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5335+0+0 (secure 0 0 0) 0x7f173812d070 con 0x7f17480b3110 2024-09-10T23:24:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.095+0000 7f173fe00640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1724072610 0x7f1724074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.095+0000 7f173fe00640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1724072610 0x7f1724074ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f17480d0280 tx=0x7f1730009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.099+0000 7f173f400640 1 -- 172.21.15.17:0/711089327 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f17380bc060 con 0x7f17480b3110 2024-09-10T23:24:16.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.275+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f1748070b20 con 0x7f17480b3110 2024-09-10T23:24:16.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.279+0000 7f173f400640 1 -- 172.21.15.17:0/711089327 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v47) ==== 71+0+0 (secure 0 0 0) 0x7f17380164d0 con 0x7f17480b3110 2024-09-10T23:24:16.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1724072610 msgr2=0x7f1724074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1724072610 0x7f1724074ad0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f17480d0280 tx=0x7f1730009040 comp rx=0 tx=0).stop 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17480b3110 msgr2=0x7f17481fbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17480b3110 0x7f17481fbe00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f1738009850 tx=0x7f1738005760 comp rx=0 tx=0).stop 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 shutdown_connections 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1724072610 0x7f1724074ad0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174815f130 0x7f174814fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17480d02e0 0x7f174814f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 --2- 172.21.15.17:0/711089327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17480b3110 0x7f17481fbe00 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 >> 172.21.15.17:0/711089327 conn(0x7f17480b3870 msgr2=0x7f17480d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 shutdown_connections 2024-09-10T23:24:16.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.283+0000 7f174e800640 1 -- 172.21.15.17:0/711089327 wait complete. 2024-09-10T23:24:16.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-10T23:24:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 -- 172.21.15.17:0/2748187615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 msgr2=0x7f686c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 --2- 172.21.15.17:0/2748187615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 0x7f686c003e80 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f687800c310 tx=0x7f687801cef0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 -- 172.21.15.17:0/2748187615 shutdown_connections 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 --2- 172.21.15.17:0/2748187615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 0x7f686c003e80 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 -- 172.21.15.17:0/2748187615 >> 172.21.15.17:0/2748187615 conn(0x7f688806cfc0 msgr2=0x7f688806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 -- 172.21.15.17:0/2748187615 shutdown_connections 2024-09-10T23:24:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 -- 172.21.15.17:0/2748187615 wait complete. 2024-09-10T23:24:16.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 Processor -- start 2024-09-10T23:24:16.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 -- start start 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 0x7f6888152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6888148f50 0x7f68880aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68880ce210 0x7f68880ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6888073cc0 con 0x7f686c003a60 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6888073b40 con 0x7f68880ce210 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f688da00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6888073e40 con 0x7f6888148f50 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f6886a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 0x7f6888152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f6886a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 0x7f6888152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35526/0 (socket says 172.21.15.17:35526) 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f6886a00640 1 -- 172.21.15.17:0/4236590929 learned_addr learned my addr 172.21.15.17:0/4236590929 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f6886000640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6888148f50 0x7f68880aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.451+0000 7f6887400640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68880ce210 0x7f68880ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f6886a00640 1 -- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6888148f50 msgr2=0x7f68880aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f6886a00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6888148f50 0x7f68880aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f6886a00640 1 -- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68880ce210 msgr2=0x7f68880ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f6886a00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68880ce210 0x7f68880ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f6886a00640 1 -- 172.21.15.17:0/4236590929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68881fb530 con 0x7f686c003a60 2024-09-10T23:24:16.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f6886a00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 0x7f6888152540 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f687801c9b0 tx=0x7f6878004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f687ea00640 1 -- 172.21.15.17:0/4236590929 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878006c80 con 0x7f686c003a60 2024-09-10T23:24:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f687ea00640 1 -- 172.21.15.17:0/4236590929 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6878006420 con 0x7f686c003a60 2024-09-10T23:24:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f687ea00640 1 -- 172.21.15.17:0/4236590929 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878001d00 con 0x7f686c003a60 2024-09-10T23:24:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68881fb810 con 0x7f686c003a60 2024-09-10T23:24:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68881fbdd0 con 0x7f686c003a60 2024-09-10T23:24:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688806f860 con 0x7f686c003a60 2024-09-10T23:24:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f687ea00640 1 -- 172.21.15.17:0/4236590929 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f68780c1450 con 0x7f686c003a60 2024-09-10T23:24:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.455+0000 7f687ea00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6868072610 0x7f6868074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:16.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.459+0000 7f687ea00640 1 -- 172.21.15.17:0/4236590929 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5335+0+0 (secure 0 0 0) 0x7f687812d6c0 con 0x7f686c003a60 2024-09-10T23:24:16.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.459+0000 7f6886000640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6868072610 0x7f6868074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:16.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.459+0000 7f6886000640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6868072610 0x7f6868074ad0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f688814cee0 tx=0x7f6874006b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:16.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.463+0000 7f687ea00640 1 -- 172.21.15.17:0/4236590929 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6878016cd0 con 0x7f686c003a60 2024-09-10T23:24:16.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.699+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f6888150df0 con 0x7f686c003a60 2024-09-10T23:24:16.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.899+0000 7f687ea00640 1 -- 172.21.15.17:0/4236590929 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v404) ==== 158+0+0 (secure 0 0 0) 0x7f68780f8820 con 0x7f686c003a60 2024-09-10T23:24:16.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.899+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6868072610 msgr2=0x7f6868074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.899+0000 7f688da00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6868072610 0x7f6868074ad0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f688814cee0 tx=0x7f6874006b80 comp rx=0 tx=0).stop 2024-09-10T23:24:16.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.899+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 msgr2=0x7f6888152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:16.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.899+0000 7f688da00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 0x7f6888152540 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f687801c9b0 tx=0x7f6878004be0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.903+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 shutdown_connections 2024-09-10T23:24:16.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.903+0000 7f688da00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6868072610 0x7f6868074ad0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.903+0000 7f688da00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68880ce210 0x7f68880ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.903+0000 7f688da00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6888148f50 0x7f68880aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.903+0000 7f688da00640 1 --2- 172.21.15.17:0/4236590929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f686c003a60 0x7f6888152540 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:16.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.903+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 >> 172.21.15.17:0/4236590929 conn(0x7f688806cfc0 msgr2=0x7f688806fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:16.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.903+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 shutdown_connections 2024-09-10T23:24:16.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:16.903+0000 7f688da00640 1 -- 172.21.15.17:0/4236590929 wait complete. 2024-09-10T23:24:16.925 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-09-10T23:24:16.925 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T23:24:16.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:24:17.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.071+0000 7fd3fce00640 1 -- 172.21.15.17:0/9870515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 msgr2=0x7fd3dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.071+0000 7fd3fce00640 1 --2- 172.21.15.17:0/9870515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 0x7fd3dc004c90 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0006f70 tx=0x7fd3e001f5f0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.071+0000 7fd3fce00640 1 -- 172.21.15.17:0/9870515 shutdown_connections 2024-09-10T23:24:17.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.071+0000 7fd3fce00640 1 --2- 172.21.15.17:0/9870515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 0x7fd3dc004c90 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.071+0000 7fd3fce00640 1 -- 172.21.15.17:0/9870515 >> 172.21.15.17:0/9870515 conn(0x7fd3f806cfc0 msgr2=0x7fd3f806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:17.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.071+0000 7fd3fce00640 1 -- 172.21.15.17:0/9870515 shutdown_connections 2024-09-10T23:24:17.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.071+0000 7fd3fce00640 1 -- 172.21.15.17:0/9870515 wait complete. 2024-09-10T23:24:17.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 Processor -- start 2024-09-10T23:24:17.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 -- start start 2024-09-10T23:24:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 0x7fd3f8138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3f81479b0 0x7fd3f81f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3f81f3f50 0x7fd3f8159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f815afe0 con 0x7fd3dc004810 2024-09-10T23:24:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f80d09a0 con 0x7fd3f81f3f50 2024-09-10T23:24:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f815b160 con 0x7fd3f81479b0 2024-09-10T23:24:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 0x7fd3f8138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 0x7fd3f8138a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46320/0 (socket says 172.21.15.17:46320) 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f5e00640 1 -- 172.21.15.17:0/1956788364 learned_addr learned my addr 172.21.15.17:0/1956788364 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3efe00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3f81479b0 0x7fd3f81f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f6800640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3f81f3f50 0x7fd3f8159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f5e00640 1 -- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3f81479b0 msgr2=0x7fd3f81f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f5e00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3f81479b0 0x7fd3f81f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f5e00640 1 -- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3f81f3f50 msgr2=0x7fd3f8159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f5e00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3f81f3f50 0x7fd3f8159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f5e00640 1 -- 172.21.15.17:0/1956788364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f806d850 con 0x7fd3dc004810 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3efe00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3f81479b0 0x7fd3f81f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f6800640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3f81f3f50 0x7fd3f8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3f5e00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 0x7fd3f8138a60 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80117e0 tx=0x7fd3e8011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3ee000640 1 -- 172.21.15.17:0/1956788364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800fd50 con 0x7fd3dc004810 2024-09-10T23:24:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3ee000640 1 -- 172.21.15.17:0/1956788364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3e8016070 con 0x7fd3dc004810 2024-09-10T23:24:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3ee000640 1 -- 172.21.15.17:0/1956788364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8012690 con 0x7fd3dc004810 2024-09-10T23:24:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f8147e30 con 0x7fd3dc004810 2024-09-10T23:24:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f81f4860 con 0x7fd3dc004810 2024-09-10T23:24:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.075+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f80b3e30 con 0x7fd3dc004810 2024-09-10T23:24:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.079+0000 7fd3ee000640 1 -- 172.21.15.17:0/1956788364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd3e8012830 con 0x7fd3dc004810 2024-09-10T23:24:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.079+0000 7fd3ee000640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3d40725e0 0x7fd3d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.079+0000 7fd3ee000640 1 -- 172.21.15.17:0/1956788364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5335+0+0 (secure 0 0 0) 0x7fd3e8093ce0 con 0x7fd3dc004810 2024-09-10T23:24:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.079+0000 7fd3efe00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3d40725e0 0x7fd3d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.079+0000 7fd3efe00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3d40725e0 0x7fd3d4074aa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00b0000 tx=0x7fd3e001c430 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:17.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.083+0000 7fd3ee000640 1 -- 172.21.15.17:0/1956788364 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd3e805f490 con 0x7fd3dc004810 2024-09-10T23:24:17.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.259+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3f8151240 con 0x7fd3dc004810 2024-09-10T23:24:17.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.259+0000 7fd3ee000640 1 -- 172.21.15.17:0/1956788364 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+13253 (secure 0 0 0) 0x7fd3e805ed90 con 0x7fd3dc004810 2024-09-10T23:24:17.262 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:17.263 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":125,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:24:15.891508+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/258682540":"2024-09-11T23:24:12.797108+0000","172.21.15.77:6835/258682540":"2024-09-11T23:24:12.797108+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:17.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3d40725e0 msgr2=0x7fd3d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3d40725e0 0x7fd3d4074aa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd3e00b0000 tx=0x7fd3e001c430 comp rx=0 tx=0).stop 2024-09-10T23:24:17.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 msgr2=0x7fd3f8138a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 0x7fd3f8138a60 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80117e0 tx=0x7fd3e8011ca0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 shutdown_connections 2024-09-10T23:24:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3d40725e0 0x7fd3d4074aa0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3f81f3f50 0x7fd3f8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3f81479b0 0x7fd3f81f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 --2- 172.21.15.17:0/1956788364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3dc004810 0x7fd3f8138a60 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 >> 172.21.15.17:0/1956788364 conn(0x7fd3f806cfc0 msgr2=0x7fd3f8158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 shutdown_connections 2024-09-10T23:24:17.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.263+0000 7fd3fce00640 1 -- 172.21.15.17:0/1956788364 wait complete. 2024-09-10T23:24:17.285 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:24:17.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:24:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.431+0000 7f1ea7800640 1 -- 172.21.15.17:0/3615882730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 msgr2=0x7f1ea0071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.431+0000 7f1ea7800640 1 --2- 172.21.15.17:0/3615882730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 0x7f1ea0071670 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00747e0 tx=0x7f1e8c01c570 comp rx=0 tx=0).stop 2024-09-10T23:24:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.431+0000 7f1ea7800640 1 -- 172.21.15.17:0/3615882730 shutdown_connections 2024-09-10T23:24:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.431+0000 7f1ea7800640 1 --2- 172.21.15.17:0/3615882730 >> v2:172.21.15.77:3300/0 conn(0x7f1ea0071bb0 0x7f1ea00ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.431+0000 7f1ea7800640 1 --2- 172.21.15.17:0/3615882730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 0x7f1ea0071670 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.431+0000 7f1ea7800640 1 --2- 172.21.15.17:0/3615882730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea015be20 0x7f1ea00d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.431+0000 7f1ea7800640 1 -- 172.21.15.17:0/3615882730 >> 172.21.15.17:0/3615882730 conn(0x7f1ea009a9f0 msgr2=0x7f1ea009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 -- 172.21.15.17:0/3615882730 shutdown_connections 2024-09-10T23:24:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 -- 172.21.15.17:0/3615882730 wait complete. 2024-09-10T23:24:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 Processor -- start 2024-09-10T23:24:17.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 -- start start 2024-09-10T23:24:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea0071bb0 0x7f1ea00b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 0x7f1ea0165ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea015be20 0x7f1ea0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea00cd450 con 0x7f1ea00d2210 2024-09-10T23:24:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea00cd2d0 con 0x7f1ea0071bb0 2024-09-10T23:24:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea7800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea00cd5d0 con 0x7f1ea015be20 2024-09-10T23:24:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 0x7f1ea0165ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 0x7f1ea0165ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46344/0 (socket says 172.21.15.17:46344) 2024-09-10T23:24:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9fe00640 1 -- 172.21.15.17:0/4100507927 learned_addr learned my addr 172.21.15.17:0/4100507927 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea4e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea0071bb0 0x7f1ea00b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1ea5800640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea015be20 0x7f1ea0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9fe00640 1 -- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea015be20 msgr2=0x7f1ea0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9fe00640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea015be20 0x7f1ea0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9fe00640 1 -- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea0071bb0 msgr2=0x7f1ea00b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9fe00640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea0071bb0 0x7f1ea00b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9fe00640 1 -- 172.21.15.17:0/4100507927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea00b7210 con 0x7f1ea00d2210 2024-09-10T23:24:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9fe00640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 0x7f1ea0165ed0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009850 tx=0x7f1e8c0a6b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:17.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.435+0000 7f1e9cc00640 1 -- 172.21.15.17:0/4100507927 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0ac070 con 0x7f1ea00d2210 2024-09-10T23:24:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.439+0000 7f1e9cc00640 1 -- 172.21.15.17:0/4100507927 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e8c004030 con 0x7f1ea00d2210 2024-09-10T23:24:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.439+0000 7f1e9cc00640 1 -- 172.21.15.17:0/4100507927 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0044a0 con 0x7f1ea00d2210 2024-09-10T23:24:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.439+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea00b74f0 con 0x7f1ea00d2210 2024-09-10T23:24:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.439+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea0166410 con 0x7f1ea00d2210 2024-09-10T23:24:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.439+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea0071670 con 0x7f1ea00d2210 2024-09-10T23:24:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.439+0000 7f1e9cc00640 1 -- 172.21.15.17:0/4100507927 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1e8c005040 con 0x7f1ea00d2210 2024-09-10T23:24:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.439+0000 7f1e9cc00640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e80072610 0x7f1e80074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.439+0000 7f1e9cc00640 1 -- 172.21.15.17:0/4100507927 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5335+0+0 (secure 0 0 0) 0x7f1e8c12d070 con 0x7f1ea00d2210 2024-09-10T23:24:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.439+0000 7f1ea4e00640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e80072610 0x7f1e80074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.443+0000 7f1ea4e00640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e80072610 0x7f1e80074ad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1ea006feb0 tx=0x7f1e9400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:17.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.443+0000 7f1e9cc00640 1 -- 172.21.15.17:0/4100507927 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1e8c0164b0 con 0x7f1ea00d2210 2024-09-10T23:24:17.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.619+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ea00b7a10 con 0x7f1ea00d2210 2024-09-10T23:24:17.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.619+0000 7f1e9cc00640 1 -- 172.21.15.17:0/4100507927 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) ==== 93+0+10 (secure 0 0 0) 0x7f1e8c0f81e0 con 0x7f1ea00d2210 2024-09-10T23:24:17.623 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e80072610 msgr2=0x7f1e80074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e80072610 0x7f1e80074ad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1ea006feb0 tx=0x7f1e9400b2e0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 msgr2=0x7f1ea0165ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 0x7f1ea0165ed0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009850 tx=0x7f1e8c0a6b50 comp rx=0 tx=0).stop 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 shutdown_connections 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e80072610 0x7f1e80074ad0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea015be20 0x7f1ea0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea00d2210 0x7f1ea0165ed0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 --2- 172.21.15.17:0/4100507927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea0071bb0 0x7f1ea00b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 >> 172.21.15.17:0/4100507927 conn(0x7f1ea009a9f0 msgr2=0x7f1ea0156890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:17.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 shutdown_connections 2024-09-10T23:24:17.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.623+0000 7f1ea7800640 1 -- 172.21.15.17:0/4100507927 wait complete. 2024-09-10T23:24:17.644 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-10T23:24:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.791+0000 7f619ae00640 1 -- 172.21.15.17:0/3113708301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 msgr2=0x7f617800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.791+0000 7f619ae00640 1 --2- 172.21.15.17:0/3113708301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 0x7f617800b9d0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f618c009ee0 tx=0x7f618c01d630 comp rx=0 tx=0).stop 2024-09-10T23:24:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.791+0000 7f619ae00640 1 -- 172.21.15.17:0/3113708301 shutdown_connections 2024-09-10T23:24:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.791+0000 7f619ae00640 1 --2- 172.21.15.17:0/3113708301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 0x7f617800b9d0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.791+0000 7f619ae00640 1 -- 172.21.15.17:0/3113708301 >> 172.21.15.17:0/3113708301 conn(0x7f61940d03d0 msgr2=0x7f61940d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.791+0000 7f619ae00640 1 -- 172.21.15.17:0/3113708301 shutdown_connections 2024-09-10T23:24:17.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.791+0000 7f619ae00640 1 -- 172.21.15.17:0/3113708301 wait complete. 2024-09-10T23:24:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.791+0000 7f619ae00640 1 Processor -- start 2024-09-10T23:24:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.791+0000 7f619ae00640 1 -- start start 2024-09-10T23:24:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f619ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 0x7f61941f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f619ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61941f78d0 0x7f6194142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f619ae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619406efe0 0x7f619415af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f619ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f61940b4e70 con 0x7f61780051d0 2024-09-10T23:24:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f619ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61940b4cf0 con 0x7f61941f78d0 2024-09-10T23:24:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f619ae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61940b4ff0 con 0x7f619406efe0 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6193e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 0x7f61941f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6193e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 0x7f61941f4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46354/0 (socket says 172.21.15.17:46354) 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6193e00640 1 -- 172.21.15.17:0/4147200321 learned_addr learned my addr 172.21.15.17:0/4147200321 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f618be00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61941f78d0 0x7f6194142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6198e00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619406efe0 0x7f619415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6193e00640 1 -- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619406efe0 msgr2=0x7f619415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6193e00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619406efe0 0x7f619415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6193e00640 1 -- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61941f78d0 msgr2=0x7f6194142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6193e00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61941f78d0 0x7f6194142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6193e00640 1 -- 172.21.15.17:0/4147200321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6194153610 con 0x7f61780051d0 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6198e00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619406efe0 0x7f619415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6193e00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 0x7f61941f4290 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f6184003e50 tx=0x7f6184001720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6190c00640 1 -- 172.21.15.17:0/4147200321 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184015070 con 0x7f61780051d0 2024-09-10T23:24:17.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6190c00640 1 -- 172.21.15.17:0/4147200321 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6184011840 con 0x7f61780051d0 2024-09-10T23:24:17.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f6190c00640 1 -- 172.21.15.17:0/4147200321 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184011c90 con 0x7f61780051d0 2024-09-10T23:24:17.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61941f4ac0 con 0x7f61780051d0 2024-09-10T23:24:17.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61941f5080 con 0x7f61780051d0 2024-09-10T23:24:17.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.795+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61941f5280 con 0x7f61780051d0 2024-09-10T23:24:17.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.799+0000 7f6190c00640 1 -- 172.21.15.17:0/4147200321 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f61840103c0 con 0x7f61780051d0 2024-09-10T23:24:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.799+0000 7f6190c00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61700725e0 0x7f6170074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.799+0000 7f6190c00640 1 -- 172.21.15.17:0/4147200321 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5335+0+0 (secure 0 0 0) 0x7f6184094150 con 0x7f61780051d0 2024-09-10T23:24:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.799+0000 7f618be00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61700725e0 0x7f6170074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.799+0000 7f618be00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61700725e0 0x7f6170074aa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f617c0017e0 tx=0x7f617c001e80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:17.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:17.803+0000 7f6190c00640 1 -- 172.21.15.17:0/4147200321 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f618405fa50 con 0x7f61780051d0 2024-09-10T23:24:18.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.039+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f61941537e0 con 0x7f61780051d0 2024-09-10T23:24:18.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.907+0000 7f6190c00640 1 -- 172.21.15.17:0/4147200321 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v406) ==== 147+0+0 (secure 0 0 0) 0x7f618405f350 con 0x7f61780051d0 2024-09-10T23:24:18.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61700725e0 msgr2=0x7f6170074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61700725e0 0x7f6170074aa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f617c0017e0 tx=0x7f617c001e80 comp rx=0 tx=0).stop 2024-09-10T23:24:18.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 msgr2=0x7f61941f4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:18.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 0x7f61941f4290 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f6184003e50 tx=0x7f6184001720 comp rx=0 tx=0).stop 2024-09-10T23:24:18.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 shutdown_connections 2024-09-10T23:24:18.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61700725e0 0x7f6170074aa0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f619406efe0 0x7f619415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61941f78d0 0x7f6194142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 --2- 172.21.15.17:0/4147200321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61780051d0 0x7f61941f4290 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 >> 172.21.15.17:0/4147200321 conn(0x7f61940d03d0 msgr2=0x7f61940b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 shutdown_connections 2024-09-10T23:24:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:18.911+0000 7f619ae00640 1 -- 172.21.15.17:0/4147200321 wait complete. 2024-09-10T23:24:18.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:24:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 -- 172.21.15.17:0/949787265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f40051d0 msgr2=0x7fe2f400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 --2- 172.21.15.17:0/949787265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2f40051d0 0x7fe2f400b9d0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe304009f20 tx=0x7fe30401d630 comp rx=0 tx=0).stop 2024-09-10T23:24:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe311e00640 1 -- 172.21.15.17:0/949787265 reap_dead start 2024-09-10T23:24:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 -- 172.21.15.17:0/949787265 shutdown_connections 2024-09-10T23:24:19.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 -- 172.21.15.17:0/949787265 >> 172.21.15.17:0/949787265 conn(0x7fe30c0d1d60 msgr2=0x7fe30c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 -- 172.21.15.17:0/949787265 shutdown_connections 2024-09-10T23:24:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 -- 172.21.15.17:0/949787265 wait complete. 2024-09-10T23:24:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 Processor -- start 2024-09-10T23:24:19.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 -- start start 2024-09-10T23:24:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2f40051d0 0x7fe30c1f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0c4d70 0x7fe30c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c155f60 0x7fe30c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c071030 con 0x7fe30c155f60 2024-09-10T23:24:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c070eb0 con 0x7fe30c0c4d70 2024-09-10T23:24:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.087+0000 7fe313e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c0711b0 con 0x7fe2f40051d0 2024-09-10T23:24:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c155f60 0x7fe30c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c155f60 0x7fe30c1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46370/0 (socket says 172.21.15.17:46370) 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311e00640 1 -- 172.21.15.17:0/1736433590 learned_addr learned my addr 172.21.15.17:0/1736433590 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311400640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2f40051d0 0x7fe30c1f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe310a00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0c4d70 0x7fe30c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311e00640 1 -- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2f40051d0 msgr2=0x7fe30c1f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311e00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2f40051d0 0x7fe30c1f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311e00640 1 -- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0c4d70 msgr2=0x7fe30c0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311e00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0c4d70 0x7fe30c0cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311e00640 1 -- 172.21.15.17:0/1736433590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c1f8ac0 con 0x7fe30c155f60 2024-09-10T23:24:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe311e00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c155f60 0x7fe30c1563f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fe304009f20 tx=0x7fe304009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:19.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe309600640 1 -- 172.21.15.17:0/1736433590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3040ad050 con 0x7fe30c155f60 2024-09-10T23:24:19.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe309600640 1 -- 172.21.15.17:0/1736433590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3040a7b00 con 0x7fe30c155f60 2024-09-10T23:24:19.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe309600640 1 -- 172.21.15.17:0/1736433590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3040a7ed0 con 0x7fe30c155f60 2024-09-10T23:24:19.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c1f4750 con 0x7fe30c155f60 2024-09-10T23:24:19.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1f4d10 con 0x7fe30c155f60 2024-09-10T23:24:19.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c071360 con 0x7fe30c155f60 2024-09-10T23:24:19.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.091+0000 7fe309600640 1 -- 172.21.15.17:0/1736433590 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe3040ba020 con 0x7fe30c155f60 2024-09-10T23:24:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.095+0000 7fe309600640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2ec072610 0x7fe2ec074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.095+0000 7fe309600640 1 -- 172.21.15.17:0/1736433590 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5335+0+0 (secure 0 0 0) 0x7fe30412df30 con 0x7fe30c155f60 2024-09-10T23:24:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.095+0000 7fe311400640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2ec072610 0x7fe2ec074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.095+0000 7fe311400640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2ec072610 0x7fe2ec074ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe300001d60 tx=0x7fe3000015e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:19.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.099+0000 7fe309600640 1 -- 172.21.15.17:0/1736433590 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe3040c3030 con 0x7fe30c155f60 2024-09-10T23:24:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.271+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe30c09fd50 con 0x7fe30c155f60 2024-09-10T23:24:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.271+0000 7fe309600640 1 -- 172.21.15.17:0/1736433590 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v47) ==== 59+0+1998 (secure 0 0 0) 0x7fe304017380 con 0x7fe30c155f60 2024-09-10T23:24:19.274 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:24:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:24:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:24:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2ec072610 msgr2=0x7fe2ec074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2ec072610 0x7fe2ec074ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe300001d60 tx=0x7fe3000015e0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c155f60 msgr2=0x7fe30c1563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c155f60 0x7fe30c1563f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fe304009f20 tx=0x7fe304009480 comp rx=0 tx=0).stop 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 shutdown_connections 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2ec072610 0x7fe2ec074ad0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c155f60 0x7fe30c1563f0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0c4d70 0x7fe30c0cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 --2- 172.21.15.17:0/1736433590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2f40051d0 0x7fe30c1f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 >> 172.21.15.17:0/1736433590 conn(0x7fe30c0d1d60 msgr2=0x7fe30c0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 shutdown_connections 2024-09-10T23:24:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.275+0000 7fe313e00640 1 -- 172.21.15.17:0/1736433590 wait complete. 2024-09-10T23:24:19.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:24:19.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.443+0000 7fcfe2200640 1 -- 172.21.15.17:0/2987231262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfc0004d50 msgr2=0x7fcfc00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.443+0000 7fcfe2200640 1 --2- 172.21.15.17:0/2987231262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfc0004d50 0x7fcfc00051d0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc072640 tx=0x7fcfd401d570 comp rx=0 tx=0).stop 2024-09-10T23:24:19.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.443+0000 7fcfdbe00640 1 -- 172.21.15.17:0/2987231262 reap_dead start 2024-09-10T23:24:19.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.443+0000 7fcfe2200640 1 -- 172.21.15.17:0/2987231262 shutdown_connections 2024-09-10T23:24:19.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.443+0000 7fcfe2200640 1 -- 172.21.15.17:0/2987231262 >> 172.21.15.17:0/2987231262 conn(0x7fcfdc0b17a0 msgr2=0x7fcfdc0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:19.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.443+0000 7fcfe2200640 1 -- 172.21.15.17:0/2987231262 shutdown_connections 2024-09-10T23:24:19.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.443+0000 7fcfe2200640 1 -- 172.21.15.17:0/2987231262 wait complete. 2024-09-10T23:24:19.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.443+0000 7fcfe2200640 1 Processor -- start 2024-09-10T23:24:19.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.443+0000 7fcfe2200640 1 -- start start 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfe2200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc0004d50 0x7fcfdc13a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfe2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfdc13b930 0x7fcfdc15c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfe2200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfdc13eaf0 0x7fcfdc15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfe2200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc072dd0 con 0x7fcfdc13b930 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfe2200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc072c50 con 0x7fcfc0004d50 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfe2200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcfdc072f50 con 0x7fcfdc13eaf0 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfdc13b930 0x7fcfdc15c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfdc13b930 0x7fcfdc15c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46388/0 (socket says 172.21.15.17:46388) 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3e00640 1 -- 172.21.15.17:0/3238977766 learned_addr learned my addr 172.21.15.17:0/3238977766 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfdb400640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc0004d50 0x7fcfdc13a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:19.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfdbe00640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfdc13eaf0 0x7fcfdc15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3e00640 1 -- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfdc13eaf0 msgr2=0x7fcfdc15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3e00640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfdc13eaf0 0x7fcfdc15c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3e00640 1 -- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc0004d50 msgr2=0x7fcfdc13a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3e00640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc0004d50 0x7fcfdc13a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3e00640 1 -- 172.21.15.17:0/3238977766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc13c010 con 0x7fcfdc13b930 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfdbe00640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfdc13eaf0 0x7fcfdc15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3e00640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfdc13b930 0x7fcfdc15c0f0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4004f00 tx=0x7fcfc4001720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3400640 1 -- 172.21.15.17:0/3238977766 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4015020 con 0x7fcfdc13b930 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3400640 1 -- 172.21.15.17:0/3238977766 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfc4011960 con 0x7fcfdc13b930 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfd3400640 1 -- 172.21.15.17:0/3238977766 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4011d70 con 0x7fcfdc13b930 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfdc13c2f0 con 0x7fcfdc13b930 2024-09-10T23:24:19.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfdc13c8b0 con 0x7fcfdc13b930 2024-09-10T23:24:19.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.447+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfdc0741d0 con 0x7fcfdc13b930 2024-09-10T23:24:19.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.451+0000 7fcfd3400640 1 -- 172.21.15.17:0/3238977766 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcfc401a400 con 0x7fcfdc13b930 2024-09-10T23:24:19.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.451+0000 7fcfd3400640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb8072610 0x7fcfb8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:19.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.451+0000 7fcfd3400640 1 -- 172.21.15.17:0/3238977766 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5335+0+0 (secure 0 0 0) 0x7fcfc4093fb0 con 0x7fcfdc13b930 2024-09-10T23:24:19.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.451+0000 7fcfdb400640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb8072610 0x7fcfb8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:19.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.451+0000 7fcfdb400640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb8072610 0x7fcfb8074ad0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc006780 tx=0x7fcfcc006960 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:19.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.455+0000 7fcfd3400640 1 -- 172.21.15.17:0/3238977766 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcfc401f020 con 0x7fcfdc13b930 2024-09-10T23:24:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.627+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcfdc0b3aa0 con 0x7fcfdc13b930 2024-09-10T23:24:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.631+0000 7fcfd3400640 1 -- 172.21.15.17:0/3238977766 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7fcfc405f760 con 0x7fcfdc13b930 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb8072610 msgr2=0x7fcfb8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb8072610 0x7fcfb8074ad0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc006780 tx=0x7fcfcc006960 comp rx=0 tx=0).stop 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfdc13b930 msgr2=0x7fcfdc15c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfdc13b930 0x7fcfdc15c0f0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4004f00 tx=0x7fcfc4001720 comp rx=0 tx=0).stop 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 shutdown_connections 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb8072610 0x7fcfb8074ad0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfdc13eaf0 0x7fcfdc15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfdc13b930 0x7fcfdc15c0f0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 --2- 172.21.15.17:0/3238977766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfc0004d50 0x7fcfdc13a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 >> 172.21.15.17:0/3238977766 conn(0x7fcfdc0b17a0 msgr2=0x7fcfdc0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 shutdown_connections 2024-09-10T23:24:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:19.635+0000 7fcfe2200640 1 -- 172.21.15.17:0/3238977766 wait complete. 2024-09-10T23:24:19.657 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:24:19.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:24:19.766 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:24:19.866 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:24:19.866 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:24:19.866 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:19.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:24:19.875 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:24:19.875 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:19.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:24:19.885 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:24:19.885 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:19.931 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:24:19.932 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:24:19.932 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:19.941 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:24:19.941 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:24:19.941 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:20.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 -- 172.21.15.17:0/1386137702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c070ad0 msgr2=0x7f082c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 --2- 172.21.15.17:0/1386137702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c070ad0 0x7f082c15f060 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f082c0c5320 tx=0x7f081c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 -- 172.21.15.17:0/1386137702 shutdown_connections 2024-09-10T23:24:20.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 --2- 172.21.15.17:0/1386137702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f082c0cf320 0x7f082c0cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 --2- 172.21.15.17:0/1386137702 >> v2:172.21.15.77:3300/0 conn(0x7f082c0d1830 0x7f082c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 --2- 172.21.15.17:0/1386137702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c070ad0 0x7f082c15f060 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 -- 172.21.15.17:0/1386137702 >> 172.21.15.17:0/1386137702 conn(0x7f082c0d1d60 msgr2=0x7f082c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 -- 172.21.15.17:0/1386137702 shutdown_connections 2024-09-10T23:24:20.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 -- 172.21.15.17:0/1386137702 wait complete. 2024-09-10T23:24:20.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 Processor -- start 2024-09-10T23:24:20.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.123+0000 7f0832000640 1 -- start start 2024-09-10T23:24:20.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0832000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f082c070ad0 0x7f082c0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0832000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f082c0cf320 0x7f082c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0832000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c0d1830 0x7f082c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0832000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f082c0cd290 con 0x7f082c0d1830 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0832000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f082c0cd110 con 0x7f082c0cf320 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0832000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f082c0cd410 con 0x7f082c070ad0 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c0d1830 0x7f082c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c0d1830 0x7f082c0b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46414/0 (socket says 172.21.15.17:46414) 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082be00640 1 -- 172.21.15.17:0/795298519 learned_addr learned my addr 172.21.15.17:0/795298519 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082aa00640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f082c0cf320 0x7f082c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082b400640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f082c070ad0 0x7f082c0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082be00640 1 -- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f082c070ad0 msgr2=0x7f082c0c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082be00640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f082c070ad0 0x7f082c0c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082be00640 1 -- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f082c0cf320 msgr2=0x7f082c0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082be00640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f082c0cf320 0x7f082c0b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082be00640 1 -- 172.21.15.17:0/795298519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082c0c5180 con 0x7f082c0d1830 2024-09-10T23:24:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082b400640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f082c070ad0 0x7f082c0c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f082be00640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c0d1830 0x7f082c0b65c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f082400e990 tx=0x7f082400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0823400640 1 -- 172.21.15.17:0/795298519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824004d30 con 0x7f082c0d1830 2024-09-10T23:24:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0823400640 1 -- 172.21.15.17:0/795298519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f082400cb00 con 0x7f082c0d1830 2024-09-10T23:24:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082c0b4010 con 0x7f082c0d1830 2024-09-10T23:24:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0823400640 1 -- 172.21.15.17:0/795298519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824005020 con 0x7f082c0d1830 2024-09-10T23:24:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f082c0b4590 con 0x7f082c0d1830 2024-09-10T23:24:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f082c0cfc60 con 0x7f082c0d1830 2024-09-10T23:24:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.127+0000 7f0823400640 1 -- 172.21.15.17:0/795298519 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f082400f040 con 0x7f082c0d1830 2024-09-10T23:24:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.131+0000 7f0823400640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f080c0725e0 0x7f080c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.131+0000 7f0823400640 1 -- 172.21.15.17:0/795298519 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5335+0+0 (secure 0 0 0) 0x7f08240936d0 con 0x7f082c0d1830 2024-09-10T23:24:20.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.131+0000 7f082b400640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f080c0725e0 0x7f080c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.131+0000 7f082b400640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f080c0725e0 0x7f080c074aa0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f081c0af000 tx=0x7f081c01b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.135+0000 7f0823400640 1 -- 172.21.15.17:0/795298519 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0824016030 con 0x7f082c0d1830 2024-09-10T23:24:20.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f082c06ed50 con 0x7f082c0d1830 2024-09-10T23:24:20.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0823400640 1 -- 172.21.15.17:0/795298519 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+3905 (secure 0 0 0) 0x7f082405e830 con 0x7f082c0d1830 2024-09-10T23:24:20.345 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:20.345 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":89,"btime":"2024-09-10T23:24:13:879556+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/151616867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":151616867},{"type":"v1","addr":"172.21.15.77:6836","nonce":151616867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":6860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3366628043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3366628043},{"type":"v1","addr":"172.21.15.77:6837","nonce":3366628043}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7824,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/623866149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":623866149},{"type":"v1","addr":"172.21.15.17:6834","nonce":623866149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7827,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2269575278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2269575278},{"type":"v1","addr":"172.21.15.17:6835","nonce":2269575278}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[]} 2024-09-10T23:24:20.346 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 89 2024-09-10T23:24:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f080c0725e0 msgr2=0x7f080c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f080c0725e0 0x7f080c074aa0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f081c0af000 tx=0x7f081c01b100 comp rx=0 tx=0).stop 2024-09-10T23:24:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c0d1830 msgr2=0x7f082c0b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c0d1830 0x7f082c0b65c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f082400e990 tx=0x7f082400ee50 comp rx=0 tx=0).stop 2024-09-10T23:24:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 shutdown_connections 2024-09-10T23:24:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f080c0725e0 0x7f080c074aa0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c0d1830 0x7f082c0b65c0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f082c0cf320 0x7f082c0b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 --2- 172.21.15.17:0/795298519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f082c070ad0 0x7f082c0c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 >> 172.21.15.17:0/795298519 conn(0x7f082c0d1d60 msgr2=0x7f082c0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 shutdown_connections 2024-09-10T23:24:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.343+0000 7f0832000640 1 -- 172.21.15.17:0/795298519 wait complete. 2024-09-10T23:24:20.366 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:24:20.366 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:24:20.367 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:24:20.367 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:24:20.367 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:24:20.367 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:24:20.367 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:24:20.367 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:24:20.367 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:24:20.368 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:24:20.368 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:24:20.368 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:24:20.368 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:24:20.368 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:24:20.368 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:24:20.368 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:24:20.380 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:24:20.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:24:20.381 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:24:20.381 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:24:20.382 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:24:20.382 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:24:20.383 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:24:20.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:24:20.426 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:24:20.426 DEBUG:teuthology.parallel:result is None 2024-09-10T23:24:20.428 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:24:20.428 DEBUG:teuthology.parallel:result is None 2024-09-10T23:24:20.430 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:24:20.431 DEBUG:teuthology.parallel:result is None 2024-09-10T23:24:20.432 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:24:20.432 DEBUG:teuthology.parallel:result is None 2024-09-10T23:24:20.432 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:24:20.516 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:24:20.517 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:24:20.518 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:24:20.518 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:24:20.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 -- 172.21.15.17:0/1154253544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d9c0cedf0 msgr2=0x7f4d9c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 --2- 172.21.15.17:0/1154253544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d9c0cedf0 0x7f4d9c0b4bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009840 tx=0x7f4d8801c760 comp rx=0 tx=0).stop 2024-09-10T23:24:20.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 -- 172.21.15.17:0/1154253544 shutdown_connections 2024-09-10T23:24:20.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 --2- 172.21.15.17:0/1154253544 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d9c0cedf0 0x7f4d9c0b4bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 --2- 172.21.15.17:0/1154253544 >> v2:172.21.15.77:3300/0 conn(0x7f4d9c15be80 0x7f4d9c0d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 -- 172.21.15.17:0/1154253544 >> 172.21.15.17:0/1154253544 conn(0x7f4d9c0d1da0 msgr2=0x7f4d9c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 -- 172.21.15.17:0/1154253544 shutdown_connections 2024-09-10T23:24:20.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 -- 172.21.15.17:0/1154253544 wait complete. 2024-09-10T23:24:20.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 Processor -- start 2024-09-10T23:24:20.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.583+0000 7f4da3a00640 1 -- start start 2024-09-10T23:24:20.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da3a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d9c0b5130 0x7f4d9c1f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da3a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d9c15be80 0x7f4d9c0b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da3a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d9c0c8250 0x7f4d9c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da3a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c168d40 con 0x7f4d9c0c8250 2024-09-10T23:24:20.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da3a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c160320 con 0x7f4d9c15be80 2024-09-10T23:24:20.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da3a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c168ec0 con 0x7f4d9c0b5130 2024-09-10T23:24:20.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d9c0c8250 0x7f4d9c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d9c0c8250 0x7f4d9c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46464/0 (socket says 172.21.15.17:46464) 2024-09-10T23:24:20.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1a00640 1 -- 172.21.15.17:0/3741051808 learned_addr learned my addr 172.21.15.17:0/3741051808 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:20.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1000640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d9c0b5130 0x7f4d9c1f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4d9be00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d9c15be80 0x7f4d9c0b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1a00640 1 -- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d9c0b5130 msgr2=0x7f4d9c1f8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1a00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d9c0b5130 0x7f4d9c1f8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1a00640 1 -- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d9c15be80 msgr2=0x7f4d9c0b74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1a00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d9c15be80 0x7f4d9c0b74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1a00640 1 -- 172.21.15.17:0/3741051808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c0c9560 con 0x7f4d9c0c8250 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da1a00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d9c0c8250 0x7f4d9c0cb970 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400cbf0 tx=0x7f4d9400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4d98c00640 1 -- 172.21.15.17:0/3741051808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94016020 con 0x7f4d9c0c8250 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4d98c00640 1 -- 172.21.15.17:0/3741051808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d9400ab00 con 0x7f4d9c0c8250 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4d98c00640 1 -- 172.21.15.17:0/3741051808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94012420 con 0x7f4d9c0c8250 2024-09-10T23:24:20.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c0c9990 con 0x7f4d9c0c8250 2024-09-10T23:24:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c0c91f0 con 0x7f4d9c0c8250 2024-09-10T23:24:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9c0b4bf0 con 0x7f4d9c0c8250 2024-09-10T23:24:20.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.587+0000 7f4d98c00640 1 -- 172.21.15.17:0/3741051808 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4d940125c0 con 0x7f4d9c0c8250 2024-09-10T23:24:20.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.591+0000 7f4d98c00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d7c0725e0 0x7f4d7c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:20.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.591+0000 7f4d98c00640 1 -- 172.21.15.17:0/3741051808 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5335+0+0 (secure 0 0 0) 0x7f4d94093580 con 0x7f4d9c0c8250 2024-09-10T23:24:20.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.591+0000 7f4da1000640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d7c0725e0 0x7f4d7c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:20.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.591+0000 7f4da1000640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d7c0725e0 0x7f4d7c074aa0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009b40 tx=0x7f4d900091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:20.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.595+0000 7f4d98c00640 1 -- 172.21.15.17:0/3741051808 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4d94020020 con 0x7f4d9c0c8250 2024-09-10T23:24:20.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.779+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4d9c0c8be0 con 0x7f4d9c0c8250 2024-09-10T23:24:20.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.919+0000 7f4d98c00640 1 -- 172.21.15.17:0/3741051808 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v127) ==== 97+0+0 (secure 0 0 0) 0x7f4d9405e770 con 0x7f4d9c0c8250 2024-09-10T23:24:20.922 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:24:20.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d7c0725e0 msgr2=0x7f4d7c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d7c0725e0 0x7f4d7c074aa0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009b40 tx=0x7f4d900091e0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d9c0c8250 msgr2=0x7f4d9c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d9c0c8250 0x7f4d9c0cb970 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400cbf0 tx=0x7f4d9400cce0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 shutdown_connections 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d7c0725e0 0x7f4d7c074aa0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d9c0c8250 0x7f4d9c0cb970 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d9c15be80 0x7f4d9c0b74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 --2- 172.21.15.17:0/3741051808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d9c0b5130 0x7f4d9c1f8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 >> 172.21.15.17:0/3741051808 conn(0x7f4d9c0d1da0 msgr2=0x7f4d9c156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 shutdown_connections 2024-09-10T23:24:20.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:20.923+0000 7f4da3a00640 1 -- 172.21.15.17:0/3741051808 wait complete. 2024-09-10T23:24:20.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:24:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.091+0000 7fd09b000640 1 -- 172.21.15.17:0/1357090058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078003ab0 msgr2=0x7fd078003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.091+0000 7fd09b000640 1 --2- 172.21.15.17:0/1357090058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078003ab0 0x7fd078003ed0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fd084006f90 tx=0x7fd08401ce70 comp rx=0 tx=0).stop 2024-09-10T23:24:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.091+0000 7fd09b000640 1 -- 172.21.15.17:0/1357090058 shutdown_connections 2024-09-10T23:24:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.091+0000 7fd09b000640 1 --2- 172.21.15.17:0/1357090058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078003ab0 0x7fd078003ed0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.091+0000 7fd09b000640 1 -- 172.21.15.17:0/1357090058 >> 172.21.15.17:0/1357090058 conn(0x7fd0940d1d60 msgr2=0x7fd0940d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.091+0000 7fd09b000640 1 -- 172.21.15.17:0/1357090058 shutdown_connections 2024-09-10T23:24:21.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.091+0000 7fd09b000640 1 -- 172.21.15.17:0/1357090058 wait complete. 2024-09-10T23:24:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 Processor -- start 2024-09-10T23:24:21.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 -- start start 2024-09-10T23:24:21.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd078003ab0 0x7fd09415b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0940c7760 0x7fd0940af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c7be0 0x7fd0940af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940d0800 con 0x7fd0940c7be0 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940d0680 con 0x7fd0940c7760 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd0940d0980 con 0x7fd078003ab0 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd099000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c7be0 0x7fd0940af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd099000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c7be0 0x7fd0940af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46480/0 (socket says 172.21.15.17:46480) 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd099000640 1 -- 172.21.15.17:0/1932864359 learned_addr learned my addr 172.21.15.17:0/1932864359 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd08be00640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0940c7760 0x7fd0940af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd093e00640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd078003ab0 0x7fd09415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd099000640 1 -- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd078003ab0 msgr2=0x7fd09415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd099000640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd078003ab0 0x7fd09415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd099000640 1 -- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0940c7760 msgr2=0x7fd0940af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd099000640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0940c7760 0x7fd0940af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd099000640 1 -- 172.21.15.17:0/1932864359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0940c8140 con 0x7fd0940c7be0 2024-09-10T23:24:21.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd08be00640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0940c7760 0x7fd0940af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:21.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd099000640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c7be0 0x7fd0940af8e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd094071ef0 tx=0x7fd08c006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:21.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd090c00640 1 -- 172.21.15.17:0/1932864359 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c015070 con 0x7fd0940c7be0 2024-09-10T23:24:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd090c00640 1 -- 172.21.15.17:0/1932864359 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd08c011840 con 0x7fd0940c7be0 2024-09-10T23:24:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0941fb6a0 con 0x7fd0940c7be0 2024-09-10T23:24:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd090c00640 1 -- 172.21.15.17:0/1932864359 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c011c90 con 0x7fd0940c7be0 2024-09-10T23:24:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.095+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0941fbc60 con 0x7fd0940c7be0 2024-09-10T23:24:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.099+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0941fbe60 con 0x7fd0940c7be0 2024-09-10T23:24:21.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.099+0000 7fd090c00640 1 -- 172.21.15.17:0/1932864359 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd08c0103c0 con 0x7fd0940c7be0 2024-09-10T23:24:21.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.099+0000 7fd090c00640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd070072610 0x7fd070074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.099+0000 7fd090c00640 1 -- 172.21.15.17:0/1932864359 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5249+0+0 (secure 0 0 0) 0x7fd08c093f30 con 0x7fd0940c7be0 2024-09-10T23:24:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.099+0000 7fd093e00640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd070072610 0x7fd070074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.099+0000 7fd093e00640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd070072610 0x7fd070074ad0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd0840ac000 tx=0x7fd084019cb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:21.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.103+0000 7fd090c00640 1 -- 172.21.15.17:0/1932864359 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd0941fbe60 con 0x7fd0940c7be0 2024-09-10T23:24:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd0940ccaa0 con 0x7fd0940c7be0 2024-09-10T23:24:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd090c00640 1 -- 172.21.15.17:0/1932864359 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7fd08c05f7c0 con 0x7fd0940c7be0 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:24:21.349 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:24:21.351 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:24:21.352 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.353 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.354 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.356 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.357 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:24:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:24:21.359 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:24:21.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.361 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:24:21.362 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:24:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:24:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:24:21.363 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:24:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd070072610 msgr2=0x7fd070074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd070072610 0x7fd070074ad0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd0840ac000 tx=0x7fd084019cb0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c7be0 msgr2=0x7fd0940af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c7be0 0x7fd0940af8e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd094071ef0 tx=0x7fd08c006430 comp rx=0 tx=0).stop 2024-09-10T23:24:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 shutdown_connections 2024-09-10T23:24:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd070072610 0x7fd070074ad0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0940c7be0 0x7fd0940af8e0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0940c7760 0x7fd0940af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 --2- 172.21.15.17:0/1932864359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd078003ab0 0x7fd09415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 >> 172.21.15.17:0/1932864359 conn(0x7fd0940d1d60 msgr2=0x7fd0940cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 shutdown_connections 2024-09-10T23:24:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.347+0000 7fd09b000640 1 -- 172.21.15.17:0/1932864359 wait complete. 2024-09-10T23:24:21.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:24:21.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 -- 172.21.15.17:0/437646820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 msgr2=0x7fbcd80b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 --2- 172.21.15.17:0/437646820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 0x7fbcd80b1d20 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009c80 tx=0x7fbcd001f5a0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 -- 172.21.15.17:0/437646820 shutdown_connections 2024-09-10T23:24:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 --2- 172.21.15.17:0/437646820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 0x7fbcd80b1d20 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 -- 172.21.15.17:0/437646820 >> 172.21.15.17:0/437646820 conn(0x7fbcd80d1d10 msgr2=0x7fbcd80d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 -- 172.21.15.17:0/437646820 shutdown_connections 2024-09-10T23:24:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 -- 172.21.15.17:0/437646820 wait complete. 2024-09-10T23:24:21.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 Processor -- start 2024-09-10T23:24:21.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 -- start start 2024-09-10T23:24:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 0x7fbcd81f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd80d2830 0x7fbcd81f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd8160280 0x7fbcd80c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd80b2260 con 0x7fbcd80d0200 2024-09-10T23:24:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd80b07c0 con 0x7fbcd8160280 2024-09-10T23:24:21.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcdca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd80b23e0 con 0x7fbcd80d2830 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 0x7fbcd81f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 0x7fbcd81f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46488/0 (socket says 172.21.15.17:46488) 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd5e00640 1 -- 172.21.15.17:0/1359966635 learned_addr learned my addr 172.21.15.17:0/1359966635 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd6800640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd8160280 0x7fbcd80c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbccd400640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd80d2830 0x7fbcd81f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd5e00640 1 -- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd80d2830 msgr2=0x7fbcd81f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd5e00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd80d2830 0x7fbcd81f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd5e00640 1 -- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd8160280 msgr2=0x7fbcd80c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd5e00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd8160280 0x7fbcd80c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd5e00640 1 -- 172.21.15.17:0/1359966635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd80cae80 con 0x7fbcd80d0200 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.515+0000 7fbcd6800640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd8160280 0x7fbcd80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbcd5e00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 0x7fbcd81f5ac0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800c420 tx=0x7fbcc800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbccea00640 1 -- 172.21.15.17:0/1359966635 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8017070 con 0x7fbcd80d0200 2024-09-10T23:24:21.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbccea00640 1 -- 172.21.15.17:0/1359966635 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcc80053c0 con 0x7fbcd80d0200 2024-09-10T23:24:21.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbccea00640 1 -- 172.21.15.17:0/1359966635 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8003860 con 0x7fbcd80d0200 2024-09-10T23:24:21.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd80cb160 con 0x7fbcd80d0200 2024-09-10T23:24:21.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd80cb720 con 0x7fbcd80d0200 2024-09-10T23:24:21.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd80cbb50 con 0x7fbcd80d0200 2024-09-10T23:24:21.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbccea00640 1 -- 172.21.15.17:0/1359966635 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbcc8003a00 con 0x7fbcd80d0200 2024-09-10T23:24:21.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbccea00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb4072610 0x7fbcb4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbccea00640 1 -- 172.21.15.17:0/1359966635 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5249+0+0 (secure 0 0 0) 0x7fbcc8092750 con 0x7fbcd80d0200 2024-09-10T23:24:21.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.519+0000 7fbccd400640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb4072610 0x7fbcb4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.523+0000 7fbccd400640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb4072610 0x7fbcb4074ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80cf440 tx=0x7fbcc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.523+0000 7fbccea00640 1 -- 172.21.15.17:0/1359966635 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbcc805df50 con 0x7fbcd80d0200 2024-09-10T23:24:21.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.699+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbcd80b28d0 con 0x7fbcd80d0200 2024-09-10T23:24:21.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.699+0000 7fbccea00640 1 -- 172.21.15.17:0/1359966635 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v129) ==== 84+0+65 (secure 0 0 0) 0x7fbcc805d850 con 0x7fbcd80d0200 2024-09-10T23:24:21.703 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:21.703 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:24:21.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:24:21.703 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:24:21.703 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:24:21.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:21.704 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:24:21.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb4072610 msgr2=0x7fbcb4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb4072610 0x7fbcb4074ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80cf440 tx=0x7fbcc0009040 comp rx=0 tx=0).stop 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 msgr2=0x7fbcd81f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 0x7fbcd81f5ac0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800c420 tx=0x7fbcc800c8e0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 shutdown_connections 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcb4072610 0x7fbcb4074ad0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcd8160280 0x7fbcd80c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcd80d2830 0x7fbcd81f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 --2- 172.21.15.17:0/1359966635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcd80d0200 0x7fbcd81f5ac0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 >> 172.21.15.17:0/1359966635 conn(0x7fbcd80d1d10 msgr2=0x7fbcd80aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 shutdown_connections 2024-09-10T23:24:21.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.703+0000 7fbcdca00640 1 -- 172.21.15.17:0/1359966635 wait complete. 2024-09-10T23:24:21.726 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:24:21.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:24:21.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 -- 172.21.15.17:0/2878940772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c0b3d00 msgr2=0x7fcc9c072690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 --2- 172.21.15.17:0/2878940772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c0b3d00 0x7fcc9c072690 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0720a0 tx=0x7fcc8401c890 comp rx=0 tx=0).stop 2024-09-10T23:24:21.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 -- 172.21.15.17:0/2878940772 shutdown_connections 2024-09-10T23:24:21.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 --2- 172.21.15.17:0/2878940772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc9c15a390 0x7fcc9c072bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 --2- 172.21.15.17:0/2878940772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c0b3d00 0x7fcc9c072690 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 --2- 172.21.15.17:0/2878940772 >> v2:172.21.15.77:3300/0 conn(0x7fcc9c1430e0 0x7fcc9c0b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 -- 172.21.15.17:0/2878940772 >> 172.21.15.17:0/2878940772 conn(0x7fcc9c0b17a0 msgr2=0x7fcc9c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:21.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 -- 172.21.15.17:0/2878940772 shutdown_connections 2024-09-10T23:24:21.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 -- 172.21.15.17:0/2878940772 wait complete. 2024-09-10T23:24:21.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 Processor -- start 2024-09-10T23:24:21.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 -- start start 2024-09-10T23:24:21.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc9c0b3d00 0x7fcc9c1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c1430e0 0x7fcc9c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c15a390 0x7fcc9c157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c06f270 con 0x7fcc9c15a390 2024-09-10T23:24:21.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c15e6b0 con 0x7fcc9c1430e0 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcca1e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c06f3f0 con 0x7fcc9c0b3d00 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc9b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c15a390 0x7fcc9c157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc9b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c15a390 0x7fcc9c157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46506/0 (socket says 172.21.15.17:46506) 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc9b400640 1 -- 172.21.15.17:0/3822927158 learned_addr learned my addr 172.21.15.17:0/3822927158 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc9aa00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc9c0b3d00 0x7fcc9c1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc92000640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c1430e0 0x7fcc9c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc9b400640 1 -- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc9c0b3d00 msgr2=0x7fcc9c1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc9b400640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc9c0b3d00 0x7fcc9c1547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc9b400640 1 -- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c1430e0 msgr2=0x7fcc9c156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc9b400640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c1430e0 0x7fcc9c156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.875+0000 7fcc9b400640 1 -- 172.21.15.17:0/3822927158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c139ac0 con 0x7fcc9c15a390 2024-09-10T23:24:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcc9b400640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c15a390 0x7fcc9c157360 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400e9a0 tx=0x7fcc9400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcc93e00640 1 -- 172.21.15.17:0/3822927158 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94004d30 con 0x7fcc9c15a390 2024-09-10T23:24:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcc93e00640 1 -- 172.21.15.17:0/3822927158 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc9400cb20 con 0x7fcc9c15a390 2024-09-10T23:24:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9c1381d0 con 0x7fcc9c15a390 2024-09-10T23:24:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcc93e00640 1 -- 172.21.15.17:0/3822927158 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94005020 con 0x7fcc9c15a390 2024-09-10T23:24:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9c138750 con 0x7fcc9c15a390 2024-09-10T23:24:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c0b37c0 con 0x7fcc9c15a390 2024-09-10T23:24:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcc93e00640 1 -- 172.21.15.17:0/3822927158 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcc9400f040 con 0x7fcc9c15a390 2024-09-10T23:24:21.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcc93e00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcc780725e0 0x7fcc78074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:21.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcc93e00640 1 -- 172.21.15.17:0/3822927158 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5249+0+0 (secure 0 0 0) 0x7fcc94093660 con 0x7fcc9c15a390 2024-09-10T23:24:21.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.879+0000 7fcc9aa00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcc780725e0 0x7fcc78074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.883+0000 7fcc9aa00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcc780725e0 0x7fcc78074aa0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009b60 tx=0x7fcc8c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:21.883+0000 7fcc93e00640 1 -- 172.21.15.17:0/3822927158 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcc94016030 con 0x7fcc9c15a390 2024-09-10T23:24:22.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.059+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcc9c1588e0 con 0x7fcc9c15a390 2024-09-10T23:24:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcc93e00640 1 -- 172.21.15.17:0/3822927158 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v130) ==== 138+0+0 (secure 0 0 0) 0x7fcc9405e8a0 con 0x7fcc9c15a390 2024-09-10T23:24:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:24:22.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcc780725e0 msgr2=0x7fcc78074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcc780725e0 0x7fcc78074aa0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009b60 tx=0x7fcc8c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c15a390 msgr2=0x7fcc9c157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c15a390 0x7fcc9c157360 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400e9a0 tx=0x7fcc9400ee60 comp rx=0 tx=0).stop 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 shutdown_connections 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcc780725e0 0x7fcc78074aa0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc9c15a390 0x7fcc9c157360 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc9c1430e0 0x7fcc9c156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 --2- 172.21.15.17:0/3822927158 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc9c0b3d00 0x7fcc9c1547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.931+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 >> 172.21.15.17:0/3822927158 conn(0x7fcc9c0b17a0 msgr2=0x7fcc9c140680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.935+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 shutdown_connections 2024-09-10T23:24:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:22.935+0000 7fcca1e00640 1 -- 172.21.15.17:0/3822927158 wait complete. 2024-09-10T23:24:22.965 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:24:23.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 -- 172.21.15.17:0/191173423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe9815a2a0 msgr2=0x7efe980b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:23.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 --2- 172.21.15.17:0/191173423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe9815a2a0 0x7efe980b2aa0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7efe980cc500 tx=0x7efe8801c890 comp rx=0 tx=0).stop 2024-09-10T23:24:23.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 -- 172.21.15.17:0/191173423 shutdown_connections 2024-09-10T23:24:23.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 --2- 172.21.15.17:0/191173423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe980cf580 0x7efe9806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 --2- 172.21.15.17:0/191173423 >> v2:172.21.15.77:3300/0 conn(0x7efe980b2fe0 0x7efe980cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 --2- 172.21.15.17:0/191173423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe9815a2a0 0x7efe980b2aa0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 -- 172.21.15.17:0/191173423 >> 172.21.15.17:0/191173423 conn(0x7efe980b17a0 msgr2=0x7efe980b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:23.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 -- 172.21.15.17:0/191173423 shutdown_connections 2024-09-10T23:24:23.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 -- 172.21.15.17:0/191173423 wait complete. 2024-09-10T23:24:23.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 Processor -- start 2024-09-10T23:24:23.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 -- start start 2024-09-10T23:24:23.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980b2fe0 0x7efe98151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:23.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980cf580 0x7efe980a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:23.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe9815a2a0 0x7efe98152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:23.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe9806f9f0 con 0x7efe980b2fe0 2024-09-10T23:24:23.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe9806f870 con 0x7efe980cf580 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe9d600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efe9806fb70 con 0x7efe9815a2a0 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe96a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980b2fe0 0x7efe98151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe96a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980b2fe0 0x7efe98151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46518/0 (socket says 172.21.15.17:46518) 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe96a00640 1 -- 172.21.15.17:0/269374032 learned_addr learned my addr 172.21.15.17:0/269374032 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe97400640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe9815a2a0 0x7efe98152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.123+0000 7efe8fe00640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980cf580 0x7efe980a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe96a00640 1 -- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe9815a2a0 msgr2=0x7efe98152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe96a00640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe9815a2a0 0x7efe98152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe96a00640 1 -- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980cf580 msgr2=0x7efe980a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe96a00640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980cf580 0x7efe980a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe96a00640 1 -- 172.21.15.17:0/269374032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe981f85b0 con 0x7efe980b2fe0 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe96a00640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980b2fe0 0x7efe98151ca0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7efe880b0040 tx=0x7efe880a57f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:23.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe8ea00640 1 -- 172.21.15.17:0/269374032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe880b2040 con 0x7efe980b2fe0 2024-09-10T23:24:23.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe8ea00640 1 -- 172.21.15.17:0/269374032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe880044b0 con 0x7efe980b2fe0 2024-09-10T23:24:23.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe981f8890 con 0x7efe980b2fe0 2024-09-10T23:24:23.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe8ea00640 1 -- 172.21.15.17:0/269374032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe880052d0 con 0x7efe980b2fe0 2024-09-10T23:24:23.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe981f8e50 con 0x7efe980b2fe0 2024-09-10T23:24:23.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe9806ef80 con 0x7efe980b2fe0 2024-09-10T23:24:23.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe8ea00640 1 -- 172.21.15.17:0/269374032 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efe880046d0 con 0x7efe980b2fe0 2024-09-10T23:24:23.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe8ea00640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe740725e0 0x7efe74074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:23.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.127+0000 7efe8ea00640 1 -- 172.21.15.17:0/269374032 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5619+0+0 (secure 0 0 0) 0x7efe8812c4e0 con 0x7efe980b2fe0 2024-09-10T23:24:23.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.131+0000 7efe8fe00640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe740725e0 0x7efe74074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:23.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.131+0000 7efe8fe00640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe740725e0 0x7efe74074aa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efe98151700 tx=0x7efe8000b3e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:23.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.135+0000 7efe8ea00640 1 -- 172.21.15.17:0/269374032 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efe880164b0 con 0x7efe980b2fe0 2024-09-10T23:24:23.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.311+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efe980b06e0 con 0x7efe980b2fe0 2024-09-10T23:24:23.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe8ea00640 1 -- 172.21.15.17:0/269374032 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v131) ==== 170+0+0 (secure 0 0 0) 0x7efe880f7520 con 0x7efe980b2fe0 2024-09-10T23:24:23.936 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe740725e0 msgr2=0x7efe74074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe9d600640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe740725e0 0x7efe74074aa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efe98151700 tx=0x7efe8000b3e0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980b2fe0 msgr2=0x7efe98151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe9d600640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980b2fe0 0x7efe98151ca0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7efe880b0040 tx=0x7efe880a57f0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 shutdown_connections 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe9d600640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe740725e0 0x7efe74074aa0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe9d600640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe9815a2a0 0x7efe98152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe9d600640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980cf580 0x7efe980a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.935+0000 7efe9d600640 1 --2- 172.21.15.17:0/269374032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980b2fe0 0x7efe98151ca0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.939+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 >> 172.21.15.17:0/269374032 conn(0x7efe980b17a0 msgr2=0x7efe980b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.939+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 shutdown_connections 2024-09-10T23:24:23.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:23.939+0000 7efe9d600640 1 -- 172.21.15.17:0/269374032 wait complete. 2024-09-10T23:24:23.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:24:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 -- 172.21.15.17:0/4249042688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b5c0d04f0 msgr2=0x7f2b5c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 --2- 172.21.15.17:0/4249042688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b5c0d04f0 0x7f2b5c15c680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009bf0 tx=0x7f2b5401cbe0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 -- 172.21.15.17:0/4249042688 shutdown_connections 2024-09-10T23:24:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 --2- 172.21.15.17:0/4249042688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b5c0d04f0 0x7f2b5c15c680 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 -- 172.21.15.17:0/4249042688 >> 172.21.15.17:0/4249042688 conn(0x7f2b5c09a9f0 msgr2=0x7f2b5c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 -- 172.21.15.17:0/4249042688 shutdown_connections 2024-09-10T23:24:24.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 -- 172.21.15.17:0/4249042688 wait complete. 2024-09-10T23:24:24.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 Processor -- start 2024-09-10T23:24:24.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 -- start start 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b5c0d04f0 0x7f2b5c1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b5c15be00 0x7f2b5c1faa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b5c15d4f0 0x7f2b5c0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c169e50 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c169cd0 con 0x7f2b5c15be00 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b60a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2b5c169fd0 con 0x7f2b5c0d04f0 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b5a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b5c15d4f0 0x7f2b5c0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b5a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b5c15d4f0 0x7f2b5c0af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46534/0 (socket says 172.21.15.17:46534) 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b53e00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b5c15be00 0x7f2b5c1faa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b5a800640 1 -- 172.21.15.17:0/2618697778 learned_addr learned my addr 172.21.15.17:0/2618697778 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:24.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b59e00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b5c0d04f0 0x7f2b5c1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b5a800640 1 -- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b5c0d04f0 msgr2=0x7f2b5c1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b5a800640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b5c0d04f0 0x7f2b5c1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b5a800640 1 -- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b5c15be00 msgr2=0x7f2b5c1faa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b5a800640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b5c15be00 0x7f2b5c1faa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b5a800640 1 -- 172.21.15.17:0/2618697778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c1fb370 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b53e00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b5c15be00 0x7f2b5c1faa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.131+0000 7f2b5a800640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b5c15d4f0 0x7f2b5c0af310 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f2b540197f0 tx=0x7f2b54009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.135+0000 7f2b52000640 1 -- 172.21.15.17:0/2618697778 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b540bb070 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.135+0000 7f2b52000640 1 -- 172.21.15.17:0/2618697778 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b54004d40 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.135+0000 7f2b52000640 1 -- 172.21.15.17:0/2618697778 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b540b2040 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.135+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c1fb650 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.135+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5c0aeb10 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.135+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5c15c680 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.135+0000 7f2b52000640 1 -- 172.21.15.17:0/2618697778 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2b540b5030 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.139+0000 7f2b52000640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b380725e0 0x7f2b38074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:24.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.139+0000 7f2b52000640 1 -- 172.21.15.17:0/2618697778 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 6001+0+0 (secure 0 0 0) 0x7f2b5412d1f0 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.139+0000 7f2b59e00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b380725e0 0x7f2b38074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:24.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.139+0000 7f2b59e00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b380725e0 0x7f2b38074aa0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c001300 tx=0x7f2b4c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:24.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.139+0000 7f2b52000640 1 -- 172.21.15.17:0/2618697778 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2b540167d0 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.351+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2b5c15b4f0 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.963+0000 7f2b52000640 1 -- 172.21.15.17:0/2618697778 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v92) ==== 174+0+0 (secure 0 0 0) 0x7f2b540f81c0 con 0x7f2b5c15d4f0 2024-09-10T23:24:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 17 and data pool 18 2024-09-10T23:24:24.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b380725e0 msgr2=0x7f2b38074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b380725e0 0x7f2b38074aa0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c001300 tx=0x7f2b4c009040 comp rx=0 tx=0).stop 2024-09-10T23:24:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b5c15d4f0 msgr2=0x7f2b5c0af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b5c15d4f0 0x7f2b5c0af310 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f2b540197f0 tx=0x7f2b54009200 comp rx=0 tx=0).stop 2024-09-10T23:24:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 shutdown_connections 2024-09-10T23:24:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b380725e0 0x7f2b38074aa0 secure :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c001300 tx=0x7f2b4c009040 comp rx=0 tx=0).stop 2024-09-10T23:24:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b5c15d4f0 0x7f2b5c0af310 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b5c15be00 0x7f2b5c1faa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 --2- 172.21.15.17:0/2618697778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b5c0d04f0 0x7f2b5c1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:24.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.975+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 >> 172.21.15.17:0/2618697778 conn(0x7f2b5c09a9f0 msgr2=0x7f2b5c15ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:24.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.979+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 shutdown_connections 2024-09-10T23:24:24.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:24.983+0000 7f2b60a00640 1 -- 172.21.15.17:0/2618697778 wait complete. 2024-09-10T23:24:25.012 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:24:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.159+0000 7f323a000640 1 -- 172.21.15.17:0/855579266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234070ad0 msgr2=0x7f323415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.159+0000 7f323a000640 1 --2- 172.21.15.17:0/855579266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234070ad0 0x7f323415f060 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f32340c5320 tx=0x7f322401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.159+0000 7f323a000640 1 -- 172.21.15.17:0/855579266 shutdown_connections 2024-09-10T23:24:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.159+0000 7f323a000640 1 --2- 172.21.15.17:0/855579266 >> v2:172.21.15.77:3300/0 conn(0x7f32340d1830 0x7f323415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.159+0000 7f323a000640 1 --2- 172.21.15.17:0/855579266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3234070ad0 0x7f323415f060 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.159+0000 7f323a000640 1 -- 172.21.15.17:0/855579266 >> 172.21.15.17:0/855579266 conn(0x7f32340d1d60 msgr2=0x7f32340d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.159+0000 7f323a000640 1 -- 172.21.15.17:0/855579266 shutdown_connections 2024-09-10T23:24:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.159+0000 7f323a000640 1 -- 172.21.15.17:0/855579266 wait complete. 2024-09-10T23:24:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 Processor -- start 2024-09-10T23:24:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 -- start start 2024-09-10T23:24:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3234070ad0 0x7f32341fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340cf320 0x7f32340b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32340d1830 0x7f32340b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3234169400 con 0x7f32340cf320 2024-09-10T23:24:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3234169280 con 0x7f3234070ad0 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3234169580 con 0x7f32340d1830 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340cf320 0x7f32340b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340cf320 0x7f32340b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46554/0 (socket says 172.21.15.17:46554) 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322aa00640 1 -- 172.21.15.17:0/1301974483 learned_addr learned my addr 172.21.15.17:0/1301974483 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f3233400640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3234070ad0 0x7f32341fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f3233e00640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32340d1830 0x7f32340b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322aa00640 1 -- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32340d1830 msgr2=0x7f32340b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322aa00640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32340d1830 0x7f32340b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322aa00640 1 -- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3234070ad0 msgr2=0x7f32341fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322aa00640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3234070ad0 0x7f32341fbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322aa00640 1 -- 172.21.15.17:0/1301974483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32341f8300 con 0x7f32340cf320 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f3233e00640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32340d1830 0x7f32340b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f3233400640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3234070ad0 0x7f32341fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322aa00640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340cf320 0x7f32340b17c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f321c00b410 tx=0x7f321c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:25.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322be00640 1 -- 172.21.15.17:0/1301974483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c015020 con 0x7f32340cf320 2024-09-10T23:24:25.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322be00640 1 -- 172.21.15.17:0/1301974483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f321c011920 con 0x7f32340cf320 2024-09-10T23:24:25.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f322be00640 1 -- 172.21.15.17:0/1301974483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321c011d70 con 0x7f32340cf320 2024-09-10T23:24:25.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32341f85e0 con 0x7f32340cf320 2024-09-10T23:24:25.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32341f8ba0 con 0x7f32340cf320 2024-09-10T23:24:25.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.163+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32340cfc60 con 0x7f32340cf320 2024-09-10T23:24:25.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.167+0000 7f322be00640 1 -- 172.21.15.17:0/1301974483 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f321c01a400 con 0x7f32340cf320 2024-09-10T23:24:25.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.167+0000 7f322be00640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3210072610 0x7f3210074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.167+0000 7f322be00640 1 -- 172.21.15.17:0/1301974483 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f321c0936d0 con 0x7f32340cf320 2024-09-10T23:24:25.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.167+0000 7f3233400640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3210072610 0x7f3210074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.167+0000 7f3233400640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3210072610 0x7f3210074ad0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f32240af000 tx=0x7f322401b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.171+0000 7f322be00640 1 -- 172.21.15.17:0/1301974483 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f321c01f020 con 0x7f32340cf320 2024-09-10T23:24:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.347+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f323415e880 con 0x7f32340cf320 2024-09-10T23:24:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.347+0000 7f322be00640 1 -- 172.21.15.17:0/1301974483 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16965 (secure 0 0 0) 0x7f321c05eb80 con 0x7f32340cf320 2024-09-10T23:24:25.352 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:25.352 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":132,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:24:24.355093+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:24:22.074232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-10T23:24:23.324088+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3210072610 msgr2=0x7f3210074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3210072610 0x7f3210074ad0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f32240af000 tx=0x7f322401b100 comp rx=0 tx=0).stop 2024-09-10T23:24:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340cf320 msgr2=0x7f32340b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340cf320 0x7f32340b17c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f321c00b410 tx=0x7f321c00b8d0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 shutdown_connections 2024-09-10T23:24:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3210072610 0x7f3210074ad0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32340d1830 0x7f32340b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32340cf320 0x7f32340b17c0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 --2- 172.21.15.17:0/1301974483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3234070ad0 0x7f32341fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 >> 172.21.15.17:0/1301974483 conn(0x7f32340d1d60 msgr2=0x7f32340b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:25.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 shutdown_connections 2024-09-10T23:24:25.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.351+0000 7f323a000640 1 -- 172.21.15.17:0/1301974483 wait complete. 2024-09-10T23:24:25.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:24:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 -- 172.21.15.17:0/3206862803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb92c15cb00 msgr2=0x7fb92c070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 --2- 172.21.15.17:0/3206862803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb92c15cb00 0x7fb92c070390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb918009840 tx=0x7fb91801c790 comp rx=0 tx=0).stop 2024-09-10T23:24:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 -- 172.21.15.17:0/3206862803 shutdown_connections 2024-09-10T23:24:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 --2- 172.21.15.17:0/3206862803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb92c15cb00 0x7fb92c070390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 --2- 172.21.15.17:0/3206862803 >> v2:172.21.15.77:3300/0 conn(0x7fb92c15fd90 0x7fb92c160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 -- 172.21.15.17:0/3206862803 >> 172.21.15.17:0/3206862803 conn(0x7fb92c06cfc0 msgr2=0x7fb92c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 -- 172.21.15.17:0/3206862803 shutdown_connections 2024-09-10T23:24:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 -- 172.21.15.17:0/3206862803 wait complete. 2024-09-10T23:24:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 Processor -- start 2024-09-10T23:24:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.519+0000 7fb934000640 1 -- start start 2024-09-10T23:24:25.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb934000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb92c0cffc0 0x7fb92c1478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb934000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c15cb00 0x7fb92c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb934000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb92c15fd90 0x7fb92c14d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb934000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c169410 con 0x7fb92c15cb00 2024-09-10T23:24:25.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb934000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c169290 con 0x7fb92c0cffc0 2024-09-10T23:24:25.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb934000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb92c169590 con 0x7fb92c15fd90 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb930c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c15cb00 0x7fb92c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb930c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c15cb00 0x7fb92c150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46564/0 (socket says 172.21.15.17:46564) 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb930c00640 1 -- 172.21.15.17:0/920880729 learned_addr learned my addr 172.21.15.17:0/920880729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb931600640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb92c0cffc0 0x7fb92c1478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb932000640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb92c15fd90 0x7fb92c14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb930c00640 1 -- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb92c15fd90 msgr2=0x7fb92c14d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb930c00640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb92c15fd90 0x7fb92c14d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb930c00640 1 -- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb92c0cffc0 msgr2=0x7fb92c1478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb930c00640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb92c0cffc0 0x7fb92c1478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb930c00640 1 -- 172.21.15.17:0/920880729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c151760 con 0x7fb92c15cb00 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb932000640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb92c15fd90 0x7fb92c14d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb930c00640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c15cb00 0x7fb92c150d10 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fb91801d030 tx=0x7fb9180a6f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:25.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb929600640 1 -- 172.21.15.17:0/920880729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9180ac070 con 0x7fb92c15cb00 2024-09-10T23:24:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb929600640 1 -- 172.21.15.17:0/920880729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb918005130 con 0x7fb92c15cb00 2024-09-10T23:24:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb929600640 1 -- 172.21.15.17:0/920880729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918005560 con 0x7fb92c15cb00 2024-09-10T23:24:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92c1fb130 con 0x7fb92c15cb00 2024-09-10T23:24:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92c1fb6f0 con 0x7fb92c15cb00 2024-09-10T23:24:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.523+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92c15d2c0 con 0x7fb92c15cb00 2024-09-10T23:24:25.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.527+0000 7fb929600640 1 -- 172.21.15.17:0/920880729 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb9180046d0 con 0x7fb92c15cb00 2024-09-10T23:24:25.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.527+0000 7fb929600640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb90c0725e0 0x7fb90c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.527+0000 7fb929600640 1 -- 172.21.15.17:0/920880729 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7fb91812d160 con 0x7fb92c15cb00 2024-09-10T23:24:25.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.527+0000 7fb931600640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb90c0725e0 0x7fb90c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.527+0000 7fb931600640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb90c0725e0 0x7fb90c074aa0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb920009ad0 tx=0x7fb9200091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:25.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.531+0000 7fb929600640 1 -- 172.21.15.17:0/920880729 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb9180c0070 con 0x7fb92c15cb00 2024-09-10T23:24:25.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.703+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb92c0b2e40 con 0x7fb92c15cb00 2024-09-10T23:24:25.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb929600640 1 -- 172.21.15.17:0/920880729 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16965 (secure 0 0 0) 0x7fb918016410 con 0x7fb92c15cb00 2024-09-10T23:24:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:25.708 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":132,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:24:24.355093+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:24:22.074232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-10T23:24:23.324088+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:25.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb90c0725e0 msgr2=0x7fb90c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb90c0725e0 0x7fb90c074aa0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb920009ad0 tx=0x7fb9200091e0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c15cb00 msgr2=0x7fb92c150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c15cb00 0x7fb92c150d10 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fb91801d030 tx=0x7fb9180a6f90 comp rx=0 tx=0).stop 2024-09-10T23:24:25.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 shutdown_connections 2024-09-10T23:24:25.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb90c0725e0 0x7fb90c074aa0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb92c15fd90 0x7fb92c14d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c15cb00 0x7fb92c150d10 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 --2- 172.21.15.17:0/920880729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb92c0cffc0 0x7fb92c1478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 >> 172.21.15.17:0/920880729 conn(0x7fb92c06cfc0 msgr2=0x7fb92c06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:25.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 shutdown_connections 2024-09-10T23:24:25.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.707+0000 7fb934000640 1 -- 172.21.15.17:0/920880729 wait complete. 2024-09-10T23:24:25.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:24:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.875+0000 7f0fddc00640 1 -- 172.21.15.17:0/1720221173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd815f360 msgr2=0x7f0fd80694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.875+0000 7f0fddc00640 1 --2- 172.21.15.17:0/1720221173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd815f360 0x7f0fd80694e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009900 tx=0x7f0fc801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 -- 172.21.15.17:0/1720221173 shutdown_connections 2024-09-10T23:24:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 --2- 172.21.15.17:0/1720221173 >> v2:172.21.15.77:3300/0 conn(0x7f0fd80b08d0 0x7f0fd80b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 --2- 172.21.15.17:0/1720221173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd815f360 0x7f0fd80694e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 -- 172.21.15.17:0/1720221173 >> 172.21.15.17:0/1720221173 conn(0x7f0fd80d0360 msgr2=0x7f0fd80d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:25.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 -- 172.21.15.17:0/1720221173 shutdown_connections 2024-09-10T23:24:25.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 -- 172.21.15.17:0/1720221173 wait complete. 2024-09-10T23:24:25.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 Processor -- start 2024-09-10T23:24:25.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 -- start start 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd80b08d0 0x7f0fd80984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd80b50c0 0x7f0fd815c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd815f360 0x7f0fd80c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd8168ef0 con 0x7f0fd815f360 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd8168d70 con 0x7f0fd80b50c0 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fddc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd8169070 con 0x7f0fd80b08d0 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd815f360 0x7f0fd80c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd815f360 0x7f0fd80c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46578/0 (socket says 172.21.15.17:46578) 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fcfe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd80b50c0 0x7f0fd815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd7400640 1 -- 172.21.15.17:0/772502372 learned_addr learned my addr 172.21.15.17:0/772502372 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd80b08d0 0x7f0fd80984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd7400640 1 -- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd80b08d0 msgr2=0x7f0fd80984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd7400640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd80b08d0 0x7f0fd80984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd7400640 1 -- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd80b50c0 msgr2=0x7f0fd815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd7400640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd80b50c0 0x7f0fd815c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd7400640 1 -- 172.21.15.17:0/772502372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd815ca40 con 0x7f0fd815f360 2024-09-10T23:24:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.879+0000 7f0fd7400640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd815f360 0x7f0fd80c2dc0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000efd0 tx=0x7f0fd000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fcea00640 1 -- 172.21.15.17:0/772502372 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0003b80 con 0x7f0fd815f360 2024-09-10T23:24:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fcea00640 1 -- 172.21.15.17:0/772502372 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fd0003d20 con 0x7f0fd815f360 2024-09-10T23:24:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fcea00640 1 -- 172.21.15.17:0/772502372 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0004280 con 0x7f0fd815f360 2024-09-10T23:24:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd8154610 con 0x7f0fd815f360 2024-09-10T23:24:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd8154bd0 con 0x7f0fd815f360 2024-09-10T23:24:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd8154dd0 con 0x7f0fd815f360 2024-09-10T23:24:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fcea00640 1 -- 172.21.15.17:0/772502372 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0fd0004420 con 0x7f0fd815f360 2024-09-10T23:24:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fcea00640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb40725e0 0x7f0fb4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fcea00640 1 -- 172.21.15.17:0/772502372 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 6101+0+0 (secure 0 0 0) 0x7f0fd00940c0 con 0x7f0fd815f360 2024-09-10T23:24:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.883+0000 7f0fd6a00640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb40725e0 0x7f0fb4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.887+0000 7f0fd6a00640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb40725e0 0x7f0fb4074aa0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80af000 tx=0x7f0fc801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:25.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:25.887+0000 7f0fcea00640 1 -- 172.21.15.17:0/772502372 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0fd8154dd0 con 0x7f0fd815f360 2024-09-10T23:24:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.103+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0fd8154400 con 0x7f0fd815f360 2024-09-10T23:24:26.929 INFO:tasks.ceph.mds.a.smithi017.stderr:2024-09-10T23:24:26.927+0000 7f1951600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:24:26.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.971+0000 7f0fcea00640 1 -- 172.21.15.17:0/772502372 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v94) ==== 118+0+0 (secure 0 0 0) 0x7f0fd005ef20 con 0x7f0fd815f360 2024-09-10T23:24:26.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb40725e0 msgr2=0x7f0fb4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:26.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb40725e0 0x7f0fb4074aa0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80af000 tx=0x7f0fc801b120 comp rx=0 tx=0).stop 2024-09-10T23:24:26.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd815f360 msgr2=0x7f0fd80c2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:26.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd815f360 0x7f0fd80c2dc0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000efd0 tx=0x7f0fd000c6a0 comp rx=0 tx=0).stop 2024-09-10T23:24:26.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 shutdown_connections 2024-09-10T23:24:26.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb40725e0 0x7f0fb4074aa0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:26.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd815f360 0x7f0fd80c2dc0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:26.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd80b50c0 0x7f0fd815c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:26.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 --2- 172.21.15.17:0/772502372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd80b08d0 0x7f0fd80984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:26.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 >> 172.21.15.17:0/772502372 conn(0x7f0fd80d0360 msgr2=0x7f0fd8158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:26.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 shutdown_connections 2024-09-10T23:24:26.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:26.975+0000 7f0fddc00640 1 -- 172.21.15.17:0/772502372 wait complete. 2024-09-10T23:24:27.002 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:24:27.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:24:27.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 -- 172.21.15.17:0/1197970728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15bca0 msgr2=0x7f039c0b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:27.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 --2- 172.21.15.17:0/1197970728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15bca0 0x7f039c0b29d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0384009900 tx=0x7f038401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:24:27.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 -- 172.21.15.17:0/1197970728 shutdown_connections 2024-09-10T23:24:27.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 --2- 172.21.15.17:0/1197970728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f039c0b2f10 0x7f039c1654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:27.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 --2- 172.21.15.17:0/1197970728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15bca0 0x7f039c0b29d0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:27.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 -- 172.21.15.17:0/1197970728 >> 172.21.15.17:0/1197970728 conn(0x7f039c09a9f0 msgr2=0x7f039c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:27.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 -- 172.21.15.17:0/1197970728 shutdown_connections 2024-09-10T23:24:27.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 -- 172.21.15.17:0/1197970728 wait complete. 2024-09-10T23:24:27.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 Processor -- start 2024-09-10T23:24:27.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 -- start start 2024-09-10T23:24:27.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f039c0b2f10 0x7f039c06f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:27.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15b8c0 0x7f039c155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:27.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f039c15bca0 0x7f039c155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:27.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f039c168710 con 0x7f039c15b8c0 2024-09-10T23:24:27.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f039c168590 con 0x7f039c0b2f10 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.155+0000 7f03a1600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f039c168890 con 0x7f039c15bca0 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0393400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15b8c0 0x7f039c155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0393400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15b8c0 0x7f039c155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39656/0 (socket says 172.21.15.17:39656) 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0393400640 1 -- 172.21.15.17:0/2908992722 learned_addr learned my addr 172.21.15.17:0/2908992722 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f03a0c00640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f039c15bca0 0x7f039c155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f039be00640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f039c0b2f10 0x7f039c06f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0393400640 1 -- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f039c15bca0 msgr2=0x7f039c155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0393400640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f039c15bca0 0x7f039c155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0393400640 1 -- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f039c0b2f10 msgr2=0x7f039c06f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0393400640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f039c0b2f10 0x7f039c06f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0393400640 1 -- 172.21.15.17:0/2908992722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039c0b5710 con 0x7f039c15b8c0 2024-09-10T23:24:27.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0393400640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15b8c0 0x7f039c155860 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f0384009850 tx=0x7f0384005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:27.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0398c00640 1 -- 172.21.15.17:0/2908992722 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03840b2040 con 0x7f039c15b8c0 2024-09-10T23:24:27.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0398c00640 1 -- 172.21.15.17:0/2908992722 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0384005320 con 0x7f039c15b8c0 2024-09-10T23:24:27.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f039c0b59b0 con 0x7f039c15b8c0 2024-09-10T23:24:27.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0398c00640 1 -- 172.21.15.17:0/2908992722 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03840046d0 con 0x7f039c15b8c0 2024-09-10T23:24:27.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f039c0b5f70 con 0x7f039c15b8c0 2024-09-10T23:24:27.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f039c0b29d0 con 0x7f039c15b8c0 2024-09-10T23:24:27.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.159+0000 7f0398c00640 1 -- 172.21.15.17:0/2908992722 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0384004870 con 0x7f039c15b8c0 2024-09-10T23:24:27.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.163+0000 7f0398c00640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03780725e0 0x7f0378074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:27.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.163+0000 7f0398c00640 1 -- 172.21.15.17:0/2908992722 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f038412d220 con 0x7f039c15b8c0 2024-09-10T23:24:27.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.163+0000 7f039be00640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03780725e0 0x7f0378074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:27.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.163+0000 7f039be00640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03780725e0 0x7f0378074aa0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f038c007fd0 tx=0x7f038c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:27.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.167+0000 7f0398c00640 1 -- 172.21.15.17:0/2908992722 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f03840bc060 con 0x7f039c15b8c0 2024-09-10T23:24:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.379+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f039c06f6b0 con 0x7f039c15b8c0 2024-09-10T23:24:27.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f0398c00640 1 -- 172.21.15.17:0/2908992722 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v95) ==== 122+0+0 (secure 0 0 0) 0x7f03840164d0 con 0x7f039c15b8c0 2024-09-10T23:24:27.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03780725e0 msgr2=0x7f0378074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:27.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03780725e0 0x7f0378074aa0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f038c007fd0 tx=0x7f038c009040 comp rx=0 tx=0).stop 2024-09-10T23:24:27.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15b8c0 msgr2=0x7f039c155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15b8c0 0x7f039c155860 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f0384009850 tx=0x7f0384005760 comp rx=0 tx=0).stop 2024-09-10T23:24:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 shutdown_connections 2024-09-10T23:24:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03780725e0 0x7f0378074aa0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f039c15bca0 0x7f039c155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f039c15b8c0 0x7f039c155860 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 --2- 172.21.15.17:0/2908992722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f039c0b2f10 0x7f039c06f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.975+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 >> 172.21.15.17:0/2908992722 conn(0x7f039c09a9f0 msgr2=0x7f039c156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.979+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 shutdown_connections 2024-09-10T23:24:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:27.979+0000 7f03a1600640 1 -- 172.21.15.17:0/2908992722 wait complete. 2024-09-10T23:24:28.003 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:24:28.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 -- 172.21.15.17:0/3331367866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e415f770 msgr2=0x7f83e40cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 --2- 172.21.15.17:0/3331367866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e415f770 0x7f83e40cc870 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f83e40c5320 tx=0x7f83d001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 -- 172.21.15.17:0/3331367866 shutdown_connections 2024-09-10T23:24:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 --2- 172.21.15.17:0/3331367866 >> v2:172.21.15.77:3300/0 conn(0x7f83e40d1830 0x7f83e40ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 --2- 172.21.15.17:0/3331367866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e415f770 0x7f83e40cc870 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 -- 172.21.15.17:0/3331367866 >> 172.21.15.17:0/3331367866 conn(0x7f83e40d1d60 msgr2=0x7f83e40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 -- 172.21.15.17:0/3331367866 shutdown_connections 2024-09-10T23:24:28.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 -- 172.21.15.17:0/3331367866 wait complete. 2024-09-10T23:24:28.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 Processor -- start 2024-09-10T23:24:28.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.151+0000 7f83ec600640 1 -- start start 2024-09-10T23:24:28.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ec600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e4070ad0 0x7f83e415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ec600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83e40d1830 0x7f83e41504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ec600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83e415f770 0x7f83e415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ec600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f83e4169330 con 0x7f83e4070ad0 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ec600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f83e41691b0 con 0x7f83e415f770 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ec600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f83e41694b0 con 0x7f83e40d1830 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e4070ad0 0x7f83e415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e4070ad0 0x7f83e415dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39682/0 (socket says 172.21.15.17:39682) 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9c00640 1 -- 172.21.15.17:0/3590262832 learned_addr learned my addr 172.21.15.17:0/3590262832 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ea600640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83e415f770 0x7f83e415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9200640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83e40d1830 0x7f83e41504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9c00640 1 -- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83e40d1830 msgr2=0x7f83e41504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9c00640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83e40d1830 0x7f83e41504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9c00640 1 -- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83e415f770 msgr2=0x7f83e415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9c00640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83e415f770 0x7f83e415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9c00640 1 -- 172.21.15.17:0/3590262832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e40b2d80 con 0x7f83e4070ad0 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ea600640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83e415f770 0x7f83e415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e9c00640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e4070ad0 0x7f83e415dff0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c480 tx=0x7f83d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e1600640 1 -- 172.21.15.17:0/3590262832 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d80052d0 con 0x7f83e4070ad0 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e1600640 1 -- 172.21.15.17:0/3590262832 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83d8005470 con 0x7f83e4070ad0 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83e1600640 1 -- 172.21.15.17:0/3590262832 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8012890 con 0x7f83e4070ad0 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e4150a30 con 0x7f83e4070ad0 2024-09-10T23:24:28.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e415e8b0 con 0x7f83e4070ad0 2024-09-10T23:24:28.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.155+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e415f060 con 0x7f83e4070ad0 2024-09-10T23:24:28.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.159+0000 7f83e1600640 1 -- 172.21.15.17:0/3590262832 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f83d8003620 con 0x7f83e4070ad0 2024-09-10T23:24:28.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.159+0000 7f83e1600640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83c40725e0 0x7f83c4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.159+0000 7f83e1600640 1 -- 172.21.15.17:0/3590262832 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f83d80930c0 con 0x7f83e4070ad0 2024-09-10T23:24:28.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.159+0000 7f83e9200640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83c40725e0 0x7f83c4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.159+0000 7f83e9200640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83c40725e0 0x7f83c4074aa0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f83d00af000 tx=0x7f83d001b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:28.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.163+0000 7f83e1600640 1 -- 172.21.15.17:0/3590262832 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f83d805e6c0 con 0x7f83e4070ad0 2024-09-10T23:24:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.371+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83e415eaf0 con 0x7f83e4070ad0 2024-09-10T23:24:28.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.371+0000 7f83e1600640 1 -- 172.21.15.17:0/3590262832 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5222 (secure 0 0 0) 0x7f83d805dfc0 con 0x7f83e4070ad0 2024-09-10T23:24:28.374 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:28.374 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":95,"btime":"2024-09-10T23:24:27:975406+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4055700220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4055700220},{"type":"v1","addr":"172.21.15.77:6836","nonce":4055700220}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2576092770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2576092770},{"type":"v1","addr":"172.21.15.77:6837","nonce":2576092770}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3395065105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3395065105},{"type":"v1","addr":"172.21.15.17:6834","nonce":3395065105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:24:24.355056+0000","modified":"2024-09-10T23:24:27.384443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8238":{"gid":8238,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/884432446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":884432446},{"type":"v1","addr":"172.21.15.17:6835","nonce":884432446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":8}]} 2024-09-10T23:24:28.374 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 95 2024-09-10T23:24:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83c40725e0 msgr2=0x7f83c4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83c40725e0 0x7f83c4074aa0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f83d00af000 tx=0x7f83d001b100 comp rx=0 tx=0).stop 2024-09-10T23:24:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e4070ad0 msgr2=0x7f83e415dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e4070ad0 0x7f83e415dff0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c480 tx=0x7f83d800c940 comp rx=0 tx=0).stop 2024-09-10T23:24:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 shutdown_connections 2024-09-10T23:24:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f83c40725e0 0x7f83c4074aa0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83e415f770 0x7f83e415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83e40d1830 0x7f83e41504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 --2- 172.21.15.17:0/3590262832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e4070ad0 0x7f83e415dff0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 >> 172.21.15.17:0/3590262832 conn(0x7f83e40d1d60 msgr2=0x7f83e40d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 shutdown_connections 2024-09-10T23:24:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.375+0000 7f83ec600640 1 -- 172.21.15.17:0/3590262832 wait complete. 2024-09-10T23:24:28.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:24:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.539+0000 7f03cb800640 1 -- 172.21.15.17:0/4273582519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 msgr2=0x7f03c415f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.539+0000 7f03cb800640 1 --2- 172.21.15.17:0/4273582519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 0x7f03c415f5a0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f03c40b7e10 tx=0x7f03b001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.539+0000 7f03cb800640 1 -- 172.21.15.17:0/4273582519 shutdown_connections 2024-09-10T23:24:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.539+0000 7f03cb800640 1 --2- 172.21.15.17:0/4273582519 >> v2:172.21.15.77:3300/0 conn(0x7f03c40cf320 0x7f03c40cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.539+0000 7f03cb800640 1 --2- 172.21.15.17:0/4273582519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 0x7f03c415f5a0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.539+0000 7f03cb800640 1 --2- 172.21.15.17:0/4273582519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03c4070ad0 0x7f03c415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.539+0000 7f03cb800640 1 -- 172.21.15.17:0/4273582519 >> 172.21.15.17:0/4273582519 conn(0x7f03c40d1d60 msgr2=0x7f03c40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.539+0000 7f03cb800640 1 -- 172.21.15.17:0/4273582519 shutdown_connections 2024-09-10T23:24:28.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.539+0000 7f03cb800640 1 -- 172.21.15.17:0/4273582519 wait complete. 2024-09-10T23:24:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 Processor -- start 2024-09-10T23:24:28.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 -- start start 2024-09-10T23:24:28.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c4070ad0 0x7f03c415e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03c40cf320 0x7f03c4157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 0x7f03c41f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f03c40cd2c0 con 0x7f03c40d1830 2024-09-10T23:24:28.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f03c40cd140 con 0x7f03c4070ad0 2024-09-10T23:24:28.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f03c40cd440 con 0x7f03c40cf320 2024-09-10T23:24:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 0x7f03c41f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 0x7f03c41f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39708/0 (socket says 172.21.15.17:39708) 2024-09-10T23:24:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c9800640 1 -- 172.21.15.17:0/372879226 learned_addr learned my addr 172.21.15.17:0/372879226 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c8e00640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c4070ad0 0x7f03c415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c3e00640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03c40cf320 0x7f03c4157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c9800640 1 -- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03c40cf320 msgr2=0x7f03c4157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c9800640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03c40cf320 0x7f03c4157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c9800640 1 -- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c4070ad0 msgr2=0x7f03c415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c9800640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c4070ad0 0x7f03c415e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c9800640 1 -- 172.21.15.17:0/372879226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c41589e0 con 0x7f03c40d1830 2024-09-10T23:24:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c8e00640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c4070ad0 0x7f03c415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c9800640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 0x7f03c41f8690 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00ea20 tx=0x7f03bc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c0c00640 1 -- 172.21.15.17:0/372879226 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00cde0 con 0x7f03c40d1830 2024-09-10T23:24:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c0c00640 1 -- 172.21.15.17:0/372879226 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03bc004c40 con 0x7f03c40d1830 2024-09-10T23:24:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03c0c00640 1 -- 172.21.15.17:0/372879226 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc005280 con 0x7f03c40d1830 2024-09-10T23:24:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c40b23c0 con 0x7f03c40d1830 2024-09-10T23:24:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.543+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c40b2980 con 0x7f03c40d1830 2024-09-10T23:24:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.547+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c40cfc60 con 0x7f03c40d1830 2024-09-10T23:24:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.547+0000 7f03c0c00640 1 -- 172.21.15.17:0/372879226 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f03bc00f040 con 0x7f03c40d1830 2024-09-10T23:24:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.547+0000 7f03c0c00640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03a40725e0 0x7f03a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.547+0000 7f03c0c00640 1 -- 172.21.15.17:0/372879226 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f03bc093a50 con 0x7f03c40d1830 2024-09-10T23:24:28.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.547+0000 7f03c8e00640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03a40725e0 0x7f03a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.547+0000 7f03c8e00640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03a40725e0 0x7f03a4074aa0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f03b8005e10 tx=0x7f03b8005d60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:28.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.551+0000 7f03c0c00640 1 -- 172.21.15.17:0/372879226 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f03bc016030 con 0x7f03c40d1830 2024-09-10T23:24:28.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03c40afb40 con 0x7f03c40d1830 2024-09-10T23:24:28.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03c0c00640 1 -- 172.21.15.17:0/372879226 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+16952 (secure 0 0 0) 0x7f03bc05f030 con 0x7f03c40d1830 2024-09-10T23:24:28.729 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":133,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:24:25.950001+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:24:22.074232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-10T23:24:23.324088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03a40725e0 msgr2=0x7f03a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03a40725e0 0x7f03a4074aa0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f03b8005e10 tx=0x7f03b8005d60 comp rx=0 tx=0).stop 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 msgr2=0x7f03c41f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 0x7f03c41f8690 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00ea20 tx=0x7f03bc00eee0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 shutdown_connections 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f03a40725e0 0x7f03a4074aa0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03c40d1830 0x7f03c41f8690 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03c40cf320 0x7f03c4157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 --2- 172.21.15.17:0/372879226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03c4070ad0 0x7f03c415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 >> 172.21.15.17:0/372879226 conn(0x7f03c40d1d60 msgr2=0x7f03c40af430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.727+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 shutdown_connections 2024-09-10T23:24:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.731+0000 7f03cb800640 1 -- 172.21.15.17:0/372879226 wait complete. 2024-09-10T23:24:28.752 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:24:28.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:24:28.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.895+0000 7fd764400640 1 -- 172.21.15.17:0/2464957310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 msgr2=0x7fd75c0af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.895+0000 7fd764400640 1 --2- 172.21.15.17:0/2464957310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 0x7fd75c0af5a0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd75c073bd0 tx=0x7fd75401f580 comp rx=0 tx=0).stop 2024-09-10T23:24:28.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.895+0000 7fd764400640 1 -- 172.21.15.17:0/2464957310 shutdown_connections 2024-09-10T23:24:28.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.895+0000 7fd764400640 1 --2- 172.21.15.17:0/2464957310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 0x7fd75c0af5a0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.895+0000 7fd764400640 1 --2- 172.21.15.17:0/2464957310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c0d2830 0x7fd75c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.895+0000 7fd764400640 1 --2- 172.21.15.17:0/2464957310 >> v2:172.21.15.77:3300/0 conn(0x7fd75c160280 0x7fd75c0cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.895+0000 7fd764400640 1 -- 172.21.15.17:0/2464957310 >> 172.21.15.17:0/2464957310 conn(0x7fd75c0d1d10 msgr2=0x7fd75c0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:28.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.895+0000 7fd764400640 1 -- 172.21.15.17:0/2464957310 shutdown_connections 2024-09-10T23:24:28.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.895+0000 7fd764400640 1 -- 172.21.15.17:0/2464957310 wait complete. 2024-09-10T23:24:28.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 Processor -- start 2024-09-10T23:24:28.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 -- start start 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c0d2830 0x7fd75c1f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c160280 0x7fd75c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 0x7fd75c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c0b0060 con 0x7fd75c160660 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c0afee0 con 0x7fd75c0d2830 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd75c0b01e0 con 0x7fd75c160280 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd762400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 0x7fd75c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd762400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 0x7fd75c0cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39740/0 (socket says 172.21.15.17:39740) 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd762400640 1 -- 172.21.15.17:0/4098132722 learned_addr learned my addr 172.21.15.17:0/4098132722 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:28.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd761000640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c160280 0x7fd75c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd761a00640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c0d2830 0x7fd75c1f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd762400640 1 -- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c160280 msgr2=0x7fd75c1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd762400640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c160280 0x7fd75c1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd762400640 1 -- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c0d2830 msgr2=0x7fd75c1f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd762400640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c0d2830 0x7fd75c1f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd762400640 1 -- 172.21.15.17:0/4098132722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c1f39f0 con 0x7fd75c160660 2024-09-10T23:24:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd762400640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 0x7fd75c0cb7b0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd7540b3040 tx=0x7fd754009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd759600640 1 -- 172.21.15.17:0/4098132722 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754004d20 con 0x7fd75c160660 2024-09-10T23:24:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd759600640 1 -- 172.21.15.17:0/4098132722 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7540b07b0 con 0x7fd75c160660 2024-09-10T23:24:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd759600640 1 -- 172.21.15.17:0/4098132722 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7540b0bc0 con 0x7fd75c160660 2024-09-10T23:24:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75c1f2de0 con 0x7fd75c160660 2024-09-10T23:24:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.899+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75c1f33a0 con 0x7fd75c160660 2024-09-10T23:24:28.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.903+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75c0b0700 con 0x7fd75c160660 2024-09-10T23:24:28.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.903+0000 7fd759600640 1 -- 172.21.15.17:0/4098132722 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd754004000 con 0x7fd75c160660 2024-09-10T23:24:28.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.903+0000 7fd759600640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd73c0725e0 0x7fd73c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:28.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.903+0000 7fd759600640 1 -- 172.21.15.17:0/4098132722 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fd754134d40 con 0x7fd75c160660 2024-09-10T23:24:28.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.903+0000 7fd761a00640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd73c0725e0 0x7fd73c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:28.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.903+0000 7fd761a00640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd73c0725e0 0x7fd73c074aa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd75c15ce20 tx=0x7fd75000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:28.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:28.907+0000 7fd759600640 1 -- 172.21.15.17:0/4098132722 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd7540bd070 con 0x7fd75c160660 2024-09-10T23:24:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.079+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd75c074af0 con 0x7fd73c0725e0 2024-09-10T23:24:29.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd759600640 1 -- 172.21.15.17:0/4098132722 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252474 (secure 0 0 0) 0x7fd75c074af0 con 0x7fd73c0725e0 2024-09-10T23:24:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:29.092 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:24:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd73c0725e0 msgr2=0x7fd73c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd73c0725e0 0x7fd73c074aa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd75c15ce20 tx=0x7fd75000b390 comp rx=0 tx=0).stop 2024-09-10T23:24:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 msgr2=0x7fd75c0cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 0x7fd75c0cb7b0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd7540b3040 tx=0x7fd754009350 comp rx=0 tx=0).stop 2024-09-10T23:24:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 shutdown_connections 2024-09-10T23:24:29.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd73c0725e0 0x7fd73c074aa0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd75c160660 0x7fd75c0cb7b0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd75c160280 0x7fd75c1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 --2- 172.21.15.17:0/4098132722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd75c0d2830 0x7fd75c1f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 >> 172.21.15.17:0/4098132722 conn(0x7fd75c0d1d10 msgr2=0x7fd75c0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 shutdown_connections 2024-09-10T23:24:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.087+0000 7fd764400640 1 -- 172.21.15.17:0/4098132722 wait complete. 2024-09-10T23:24:29.110 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-10T23:24:28.420813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":495268,"kb_used_data":13916,"kb_used_omap":12,"kb_used_meta":481139,"kb_avail":754479452,"statfs":{"total":773094113280,"available":772586958848,"internally_reserved":0,"allocated":14249984,"data_stored":7296663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":492686897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.483470"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.976123+0000","last_change":"2024-09-10T23:24:24.970114+0000","last_active":"2024-09-10T23:24:24.976123+0000","last_peered":"2024-09-10T23:24:24.976123+0000","last_clean":"2024-09-10T23:24:24.976123+0000","last_became_active":"2024-09-10T23:24:24.966757+0000","last_became_peered":"2024-09-10T23:24:24.966757+0000","last_unstale":"2024-09-10T23:24:24.976123+0000","last_undegraded":"2024-09-10T23:24:24.976123+0000","last_fullsized":"2024-09-10T23:24:24.976123+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:12.175541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332809+0000","last_change":"2024-09-10T23:24:24.980058+0000","last_active":"2024-09-10T23:24:26.332809+0000","last_peered":"2024-09-10T23:24:26.332809+0000","last_clean":"2024-09-10T23:24:26.332809+0000","last_became_active":"2024-09-10T23:24:24.976773+0000","last_became_peered":"2024-09-10T23:24:24.976773+0000","last_unstale":"2024-09-10T23:24:26.332809+0000","last_undegraded":"2024-09-10T23:24:26.332809+0000","last_fullsized":"2024-09-10T23:24:26.332809+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:14.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.333064+0000","last_change":"2024-09-10T23:24:24.972040+0000","last_active":"2024-09-10T23:24:26.333064+0000","last_peered":"2024-09-10T23:24:26.333064+0000","last_clean":"2024-09-10T23:24:26.333064+0000","last_became_active":"2024-09-10T23:24:24.971727+0000","last_became_peered":"2024-09-10T23:24:24.971727+0000","last_unstale":"2024-09-10T23:24:26.333064+0000","last_undegraded":"2024-09-10T23:24:26.333064+0000","last_fullsized":"2024-09-10T23:24:26.333064+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:08.598900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981820+0000","last_change":"2024-09-10T23:24:24.977890+0000","last_active":"2024-09-10T23:24:24.981820+0000","last_peered":"2024-09-10T23:24:24.981820+0000","last_clean":"2024-09-10T23:24:24.981820+0000","last_became_active":"2024-09-10T23:24:24.977631+0000","last_became_peered":"2024-09-10T23:24:24.977631+0000","last_unstale":"2024-09-10T23:24:24.981820+0000","last_undegraded":"2024-09-10T23:24:24.981820+0000","last_fullsized":"2024-09-10T23:24:24.981820+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:39.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979853+0000","last_change":"2024-09-10T23:24:24.977189+0000","last_active":"2024-09-10T23:24:24.979853+0000","last_peered":"2024-09-10T23:24:24.979853+0000","last_clean":"2024-09-10T23:24:24.979853+0000","last_became_active":"2024-09-10T23:24:24.976862+0000","last_became_peered":"2024-09-10T23:24:24.976862+0000","last_unstale":"2024-09-10T23:24:24.979853+0000","last_undegraded":"2024-09-10T23:24:24.979853+0000","last_fullsized":"2024-09-10T23:24:24.979853+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:25.935101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979354+0000","last_change":"2024-09-10T23:24:24.969990+0000","last_active":"2024-09-10T23:24:24.979354+0000","last_peered":"2024-09-10T23:24:24.979354+0000","last_clean":"2024-09-10T23:24:24.979354+0000","last_became_active":"2024-09-10T23:24:24.969150+0000","last_became_peered":"2024-09-10T23:24:24.969150+0000","last_unstale":"2024-09-10T23:24:24.979354+0000","last_undegraded":"2024-09-10T23:24:24.979354+0000","last_fullsized":"2024-09-10T23:24:24.979354+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:55.209906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978490+0000","last_change":"2024-09-10T23:24:24.968617+0000","last_active":"2024-09-10T23:24:24.978490+0000","last_peered":"2024-09-10T23:24:24.978490+0000","last_clean":"2024-09-10T23:24:24.978490+0000","last_became_active":"2024-09-10T23:24:24.968290+0000","last_became_peered":"2024-09-10T23:24:24.968290+0000","last_unstale":"2024-09-10T23:24:24.978490+0000","last_undegraded":"2024-09-10T23:24:24.978490+0000","last_fullsized":"2024-09-10T23:24:24.978490+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:45.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332425+0000","last_change":"2024-09-10T23:24:24.985546+0000","last_active":"2024-09-10T23:24:26.332425+0000","last_peered":"2024-09-10T23:24:26.332425+0000","last_clean":"2024-09-10T23:24:26.332425+0000","last_became_active":"2024-09-10T23:24:24.985269+0000","last_became_peered":"2024-09-10T23:24:24.985269+0000","last_unstale":"2024-09-10T23:24:26.332425+0000","last_undegraded":"2024-09-10T23:24:26.332425+0000","last_fullsized":"2024-09-10T23:24:26.332425+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:14.237017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981069+0000","last_change":"2024-09-10T23:24:24.973728+0000","last_active":"2024-09-10T23:24:24.981069+0000","last_peered":"2024-09-10T23:24:24.981069+0000","last_clean":"2024-09-10T23:24:24.981069+0000","last_became_active":"2024-09-10T23:24:24.973283+0000","last_became_peered":"2024-09-10T23:24:24.973283+0000","last_unstale":"2024-09-10T23:24:24.981069+0000","last_undegraded":"2024-09-10T23:24:24.981069+0000","last_fullsized":"2024-09-10T23:24:24.981069+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:14.055599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.986787+0000","last_change":"2024-09-10T23:24:24.976497+0000","last_active":"2024-09-10T23:24:24.986787+0000","last_peered":"2024-09-10T23:24:24.986787+0000","last_clean":"2024-09-10T23:24:24.986787+0000","last_became_active":"2024-09-10T23:24:24.976197+0000","last_became_peered":"2024-09-10T23:24:24.976197+0000","last_unstale":"2024-09-10T23:24:24.986787+0000","last_undegraded":"2024-09-10T23:24:24.986787+0000","last_fullsized":"2024-09-10T23:24:24.986787+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:45.803060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.984024+0000","last_change":"2024-09-10T23:24:24.981195+0000","last_active":"2024-09-10T23:24:24.984024+0000","last_peered":"2024-09-10T23:24:24.984024+0000","last_clean":"2024-09-10T23:24:24.984024+0000","last_became_active":"2024-09-10T23:24:24.980926+0000","last_became_peered":"2024-09-10T23:24:24.980926+0000","last_unstale":"2024-09-10T23:24:24.984024+0000","last_undegraded":"2024-09-10T23:24:24.984024+0000","last_fullsized":"2024-09-10T23:24:24.984024+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:01.744825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.962990+0000","last_change":"2024-09-10T23:24:24.959343+0000","last_active":"2024-09-10T23:24:24.962990+0000","last_peered":"2024-09-10T23:24:24.962990+0000","last_clean":"2024-09-10T23:24:24.962990+0000","last_became_active":"2024-09-10T23:24:24.958467+0000","last_became_peered":"2024-09-10T23:24:24.958467+0000","last_unstale":"2024-09-10T23:24:24.962990+0000","last_undegraded":"2024-09-10T23:24:24.962990+0000","last_fullsized":"2024-09-10T23:24:24.962990+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:03.006277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.987544+0000","last_change":"2024-09-10T23:24:24.978101+0000","last_active":"2024-09-10T23:24:24.987544+0000","last_peered":"2024-09-10T23:24:24.987544+0000","last_clean":"2024-09-10T23:24:24.987544+0000","last_became_active":"2024-09-10T23:24:24.977821+0000","last_became_peered":"2024-09-10T23:24:24.977821+0000","last_unstale":"2024-09-10T23:24:24.987544+0000","last_undegraded":"2024-09-10T23:24:24.987544+0000","last_fullsized":"2024-09-10T23:24:24.987544+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:04.269621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332272+0000","last_change":"2024-09-10T23:24:24.984592+0000","last_active":"2024-09-10T23:24:26.332272+0000","last_peered":"2024-09-10T23:24:26.332272+0000","last_clean":"2024-09-10T23:24:26.332272+0000","last_became_active":"2024-09-10T23:24:24.983999+0000","last_became_peered":"2024-09-10T23:24:24.983999+0000","last_unstale":"2024-09-10T23:24:26.332272+0000","last_undegraded":"2024-09-10T23:24:26.332272+0000","last_fullsized":"2024-09-10T23:24:26.332272+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:27.867698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.977743+0000","last_change":"2024-09-10T23:24:24.971684+0000","last_active":"2024-09-10T23:24:24.977743+0000","last_peered":"2024-09-10T23:24:24.977743+0000","last_clean":"2024-09-10T23:24:24.977743+0000","last_became_active":"2024-09-10T23:24:24.971419+0000","last_became_peered":"2024-09-10T23:24:24.971419+0000","last_unstale":"2024-09-10T23:24:24.977743+0000","last_undegraded":"2024-09-10T23:24:24.977743+0000","last_fullsized":"2024-09-10T23:24:24.977743+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:21.515832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978718+0000","last_change":"2024-09-10T23:24:24.970314+0000","last_active":"2024-09-10T23:24:24.978718+0000","last_peered":"2024-09-10T23:24:24.978718+0000","last_clean":"2024-09-10T23:24:24.978718+0000","last_became_active":"2024-09-10T23:24:24.968434+0000","last_became_peered":"2024-09-10T23:24:24.968434+0000","last_unstale":"2024-09-10T23:24:24.978718+0000","last_undegraded":"2024-09-10T23:24:24.978718+0000","last_fullsized":"2024-09-10T23:24:24.978718+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:35.812574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.987003+0000","last_change":"2024-09-10T23:24:24.978005+0000","last_active":"2024-09-10T23:24:24.987003+0000","last_peered":"2024-09-10T23:24:24.987003+0000","last_clean":"2024-09-10T23:24:24.987003+0000","last_became_active":"2024-09-10T23:24:24.976240+0000","last_became_peered":"2024-09-10T23:24:24.976240+0000","last_unstale":"2024-09-10T23:24:24.987003+0000","last_undegraded":"2024-09-10T23:24:24.987003+0000","last_fullsized":"2024-09-10T23:24:24.987003+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:10.421020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332989+0000","last_change":"2024-09-10T23:24:24.969900+0000","last_active":"2024-09-10T23:24:26.332989+0000","last_peered":"2024-09-10T23:24:26.332989+0000","last_clean":"2024-09-10T23:24:26.332989+0000","last_became_active":"2024-09-10T23:24:24.969592+0000","last_became_peered":"2024-09-10T23:24:24.969592+0000","last_unstale":"2024-09-10T23:24:26.332989+0000","last_undegraded":"2024-09-10T23:24:26.332989+0000","last_fullsized":"2024-09-10T23:24:26.332989+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:11.358250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.983945+0000","last_change":"2024-09-10T23:24:24.980819+0000","last_active":"2024-09-10T23:24:25.983945+0000","last_peered":"2024-09-10T23:24:25.983945+0000","last_clean":"2024-09-10T23:24:25.983945+0000","last_became_active":"2024-09-10T23:24:24.975534+0000","last_became_peered":"2024-09-10T23:24:24.975534+0000","last_unstale":"2024-09-10T23:24:25.983945+0000","last_undegraded":"2024-09-10T23:24:25.983945+0000","last_fullsized":"2024-09-10T23:24:25.983945+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:45.919397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.970533+0000","last_change":"2024-09-10T23:24:24.965410+0000","last_active":"2024-09-10T23:24:24.970533+0000","last_peered":"2024-09-10T23:24:24.970533+0000","last_clean":"2024-09-10T23:24:24.970533+0000","last_became_active":"2024-09-10T23:24:24.965086+0000","last_became_peered":"2024-09-10T23:24:24.965086+0000","last_unstale":"2024-09-10T23:24:24.970533+0000","last_undegraded":"2024-09-10T23:24:24.970533+0000","last_fullsized":"2024-09-10T23:24:24.970533+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:29.084373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.980003+0000","last_change":"2024-09-10T23:24:24.972772+0000","last_active":"2024-09-10T23:24:24.980003+0000","last_peered":"2024-09-10T23:24:24.980003+0000","last_clean":"2024-09-10T23:24:24.980003+0000","last_became_active":"2024-09-10T23:24:24.972451+0000","last_became_peered":"2024-09-10T23:24:24.972451+0000","last_unstale":"2024-09-10T23:24:24.980003+0000","last_undegraded":"2024-09-10T23:24:24.980003+0000","last_fullsized":"2024-09-10T23:24:24.980003+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:14.817581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.977998+0000","last_change":"2024-09-10T23:24:24.974149+0000","last_active":"2024-09-10T23:24:24.977998+0000","last_peered":"2024-09-10T23:24:24.977998+0000","last_clean":"2024-09-10T23:24:24.977998+0000","last_became_active":"2024-09-10T23:24:24.972288+0000","last_became_peered":"2024-09-10T23:24:24.972288+0000","last_unstale":"2024-09-10T23:24:24.977998+0000","last_undegraded":"2024-09-10T23:24:24.977998+0000","last_fullsized":"2024-09-10T23:24:24.977998+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:07.792052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981146+0000","last_change":"2024-09-10T23:24:24.973777+0000","last_active":"2024-09-10T23:24:24.981146+0000","last_peered":"2024-09-10T23:24:24.981146+0000","last_clean":"2024-09-10T23:24:24.981146+0000","last_became_active":"2024-09-10T23:24:24.973247+0000","last_became_peered":"2024-09-10T23:24:24.973247+0000","last_unstale":"2024-09-10T23:24:24.981146+0000","last_undegraded":"2024-09-10T23:24:24.981146+0000","last_fullsized":"2024-09-10T23:24:24.981146+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:12.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979492+0000","last_change":"2024-09-10T23:24:24.972431+0000","last_active":"2024-09-10T23:24:24.979492+0000","last_peered":"2024-09-10T23:24:24.979492+0000","last_clean":"2024-09-10T23:24:24.979492+0000","last_became_active":"2024-09-10T23:24:24.972148+0000","last_became_peered":"2024-09-10T23:24:24.972148+0000","last_unstale":"2024-09-10T23:24:24.979492+0000","last_undegraded":"2024-09-10T23:24:24.979492+0000","last_fullsized":"2024-09-10T23:24:24.979492+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:27.990438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979423+0000","last_change":"2024-09-10T23:24:24.976550+0000","last_active":"2024-09-10T23:24:24.979423+0000","last_peered":"2024-09-10T23:24:24.979423+0000","last_clean":"2024-09-10T23:24:24.979423+0000","last_became_active":"2024-09-10T23:24:24.976317+0000","last_became_peered":"2024-09-10T23:24:24.976317+0000","last_unstale":"2024-09-10T23:24:24.979423+0000","last_undegraded":"2024-09-10T23:24:24.979423+0000","last_fullsized":"2024-09-10T23:24:24.979423+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:50.365139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.967109+0000","last_change":"2024-09-10T23:24:24.965331+0000","last_active":"2024-09-10T23:24:24.967109+0000","last_peered":"2024-09-10T23:24:24.967109+0000","last_clean":"2024-09-10T23:24:24.967109+0000","last_became_active":"2024-09-10T23:24:24.965017+0000","last_became_peered":"2024-09-10T23:24:24.965017+0000","last_unstale":"2024-09-10T23:24:24.967109+0000","last_undegraded":"2024-09-10T23:24:24.967109+0000","last_fullsized":"2024-09-10T23:24:24.967109+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:17.476894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.984000+0000","last_change":"2024-09-10T23:24:24.980072+0000","last_active":"2024-09-10T23:24:25.984000+0000","last_peered":"2024-09-10T23:24:25.984000+0000","last_clean":"2024-09-10T23:24:25.984000+0000","last_became_active":"2024-09-10T23:24:24.975121+0000","last_became_peered":"2024-09-10T23:24:24.975121+0000","last_unstale":"2024-09-10T23:24:25.984000+0000","last_undegraded":"2024-09-10T23:24:25.984000+0000","last_fullsized":"2024-09-10T23:24:25.984000+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:08.154933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.985905+0000","last_change":"2024-09-10T23:24:24.979683+0000","last_active":"2024-09-10T23:24:24.985905+0000","last_peered":"2024-09-10T23:24:24.985905+0000","last_clean":"2024-09-10T23:24:24.985905+0000","last_became_active":"2024-09-10T23:24:24.979363+0000","last_became_peered":"2024-09-10T23:24:24.979363+0000","last_unstale":"2024-09-10T23:24:24.985905+0000","last_undegraded":"2024-09-10T23:24:24.985905+0000","last_fullsized":"2024-09-10T23:24:24.985905+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:04.903958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.967755+0000","last_change":"2024-09-10T23:24:24.966302+0000","last_active":"2024-09-10T23:24:24.967755+0000","last_peered":"2024-09-10T23:24:24.967755+0000","last_clean":"2024-09-10T23:24:24.967755+0000","last_became_active":"2024-09-10T23:24:24.966022+0000","last_became_peered":"2024-09-10T23:24:24.966022+0000","last_unstale":"2024-09-10T23:24:24.967755+0000","last_undegraded":"2024-09-10T23:24:24.967755+0000","last_fullsized":"2024-09-10T23:24:24.967755+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:42.157355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332496+0000","last_change":"2024-09-10T23:24:24.977271+0000","last_active":"2024-09-10T23:24:26.332496+0000","last_peered":"2024-09-10T23:24:26.332496+0000","last_clean":"2024-09-10T23:24:26.332496+0000","last_became_active":"2024-09-10T23:24:24.976356+0000","last_became_peered":"2024-09-10T23:24:24.976356+0000","last_unstale":"2024-09-10T23:24:26.332496+0000","last_undegraded":"2024-09-10T23:24:26.332496+0000","last_fullsized":"2024-09-10T23:24:26.332496+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:40.451317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.982617+0000","last_change":"2024-09-10T23:24:24.978092+0000","last_active":"2024-09-10T23:24:24.982617+0000","last_peered":"2024-09-10T23:24:24.982617+0000","last_clean":"2024-09-10T23:24:24.982617+0000","last_became_active":"2024-09-10T23:24:24.977831+0000","last_became_peered":"2024-09-10T23:24:24.977831+0000","last_unstale":"2024-09-10T23:24:24.982617+0000","last_undegraded":"2024-09-10T23:24:24.982617+0000","last_fullsized":"2024-09-10T23:24:24.982617+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.128571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979520+0000","last_change":"2024-09-10T23:24:24.973717+0000","last_active":"2024-09-10T23:24:24.979520+0000","last_peered":"2024-09-10T23:24:24.979520+0000","last_clean":"2024-09-10T23:24:24.979520+0000","last_became_active":"2024-09-10T23:24:24.973393+0000","last_became_peered":"2024-09-10T23:24:24.973393+0000","last_unstale":"2024-09-10T23:24:24.979520+0000","last_undegraded":"2024-09-10T23:24:24.979520+0000","last_fullsized":"2024-09-10T23:24:24.979520+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:07.792052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.987590+0000","last_change":"2024-09-10T23:24:24.983132+0000","last_active":"2024-09-10T23:24:24.987590+0000","last_peered":"2024-09-10T23:24:24.987590+0000","last_clean":"2024-09-10T23:24:24.987590+0000","last_became_active":"2024-09-10T23:24:24.982741+0000","last_became_peered":"2024-09-10T23:24:24.982741+0000","last_unstale":"2024-09-10T23:24:24.987590+0000","last_undegraded":"2024-09-10T23:24:24.987590+0000","last_fullsized":"2024-09-10T23:24:24.987590+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:12.175541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"132'4","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.983881+0000","last_change":"2024-09-10T23:24:23.967292+0000","last_active":"2024-09-10T23:24:25.983881+0000","last_peered":"2024-09-10T23:24:25.983881+0000","last_clean":"2024-09-10T23:24:25.983881+0000","last_became_active":"2024-09-10T23:24:23.966997+0000","last_became_peered":"2024-09-10T23:24:23.966997+0000","last_unstale":"2024-09-10T23:24:25.983881+0000","last_undegraded":"2024-09-10T23:24:25.983881+0000","last_fullsized":"2024-09-10T23:24:25.983881+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:09.413814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978660+0000","last_change":"2024-09-10T23:24:24.970932+0000","last_active":"2024-09-10T23:24:24.978660+0000","last_peered":"2024-09-10T23:24:24.978660+0000","last_clean":"2024-09-10T23:24:24.978660+0000","last_became_active":"2024-09-10T23:24:24.970628+0000","last_became_peered":"2024-09-10T23:24:24.970628+0000","last_unstale":"2024-09-10T23:24:24.978660+0000","last_undegraded":"2024-09-10T23:24:24.978660+0000","last_fullsized":"2024-09-10T23:24:24.978660+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:03.427796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.988281+0000","last_change":"2024-09-10T23:24:23.963347+0000","last_active":"2024-09-10T23:24:24.988281+0000","last_peered":"2024-09-10T23:24:24.988281+0000","last_clean":"2024-09-10T23:24:24.988281+0000","last_became_active":"2024-09-10T23:24:23.963033+0000","last_became_peered":"2024-09-10T23:24:23.963033+0000","last_unstale":"2024-09-10T23:24:24.988281+0000","last_undegraded":"2024-09-10T23:24:24.988281+0000","last_fullsized":"2024-09-10T23:24:24.988281+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:41.935990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.984797+0000","last_change":"2024-09-10T23:24:24.983276+0000","last_active":"2024-09-10T23:24:24.984797+0000","last_peered":"2024-09-10T23:24:24.984797+0000","last_clean":"2024-09-10T23:24:24.984797+0000","last_became_active":"2024-09-10T23:24:24.982903+0000","last_became_peered":"2024-09-10T23:24:24.982903+0000","last_unstale":"2024-09-10T23:24:24.984797+0000","last_undegraded":"2024-09-10T23:24:24.984797+0000","last_fullsized":"2024-09-10T23:24:24.984797+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:48.849597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.994187+0000","last_change":"2024-09-10T23:24:23.970975+0000","last_active":"2024-09-10T23:24:24.994187+0000","last_peered":"2024-09-10T23:24:24.994187+0000","last_clean":"2024-09-10T23:24:24.994187+0000","last_became_active":"2024-09-10T23:24:23.970731+0000","last_became_peered":"2024-09-10T23:24:23.970731+0000","last_unstale":"2024-09-10T23:24:24.994187+0000","last_undegraded":"2024-09-10T23:24:24.994187+0000","last_fullsized":"2024-09-10T23:24:24.994187+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:36.478392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981524+0000","last_change":"2024-09-10T23:24:24.976469+0000","last_active":"2024-09-10T23:24:24.981524+0000","last_peered":"2024-09-10T23:24:24.981524+0000","last_clean":"2024-09-10T23:24:24.981524+0000","last_became_active":"2024-09-10T23:24:24.972909+0000","last_became_peered":"2024-09-10T23:24:24.972909+0000","last_unstale":"2024-09-10T23:24:24.981524+0000","last_undegraded":"2024-09-10T23:24:24.981524+0000","last_fullsized":"2024-09-10T23:24:24.981524+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:31.860851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.988823+0000","last_change":"2024-09-10T23:24:23.966163+0000","last_active":"2024-09-10T23:24:24.988823+0000","last_peered":"2024-09-10T23:24:24.988823+0000","last_clean":"2024-09-10T23:24:24.988823+0000","last_became_active":"2024-09-10T23:24:23.965883+0000","last_became_peered":"2024-09-10T23:24:23.965883+0000","last_unstale":"2024-09-10T23:24:24.988823+0000","last_undegraded":"2024-09-10T23:24:24.988823+0000","last_fullsized":"2024-09-10T23:24:24.988823+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:34.676657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.975499+0000","last_change":"2024-09-10T23:24:24.974240+0000","last_active":"2024-09-10T23:24:24.975499+0000","last_peered":"2024-09-10T23:24:24.975499+0000","last_clean":"2024-09-10T23:24:24.975499+0000","last_became_active":"2024-09-10T23:24:24.973947+0000","last_became_peered":"2024-09-10T23:24:24.973947+0000","last_unstale":"2024-09-10T23:24:24.975499+0000","last_undegraded":"2024-09-10T23:24:24.975499+0000","last_fullsized":"2024-09-10T23:24:24.975499+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:48.038469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.991977+0000","last_change":"2024-09-10T23:24:23.966143+0000","last_active":"2024-09-10T23:24:24.991977+0000","last_peered":"2024-09-10T23:24:24.991977+0000","last_clean":"2024-09-10T23:24:24.991977+0000","last_became_active":"2024-09-10T23:24:23.965866+0000","last_became_peered":"2024-09-10T23:24:23.965866+0000","last_unstale":"2024-09-10T23:24:24.991977+0000","last_undegraded":"2024-09-10T23:24:24.991977+0000","last_fullsized":"2024-09-10T23:24:24.991977+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.795855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.976082+0000","last_change":"2024-09-10T23:24:24.966838+0000","last_active":"2024-09-10T23:24:24.976082+0000","last_peered":"2024-09-10T23:24:24.976082+0000","last_clean":"2024-09-10T23:24:24.976082+0000","last_became_active":"2024-09-10T23:24:24.966566+0000","last_became_peered":"2024-09-10T23:24:24.966566+0000","last_unstale":"2024-09-10T23:24:24.976082+0000","last_undegraded":"2024-09-10T23:24:24.976082+0000","last_fullsized":"2024-09-10T23:24:24.976082+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:04.269621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.995053+0000","last_change":"2024-09-10T23:24:23.968051+0000","last_active":"2024-09-10T23:24:24.995053+0000","last_peered":"2024-09-10T23:24:24.995053+0000","last_clean":"2024-09-10T23:24:24.995053+0000","last_became_active":"2024-09-10T23:24:23.967721+0000","last_became_peered":"2024-09-10T23:24:23.967721+0000","last_unstale":"2024-09-10T23:24:24.995053+0000","last_undegraded":"2024-09-10T23:24:24.995053+0000","last_fullsized":"2024-09-10T23:24:24.995053+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:21.260452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332775+0000","last_change":"2024-09-10T23:24:24.976443+0000","last_active":"2024-09-10T23:24:26.332775+0000","last_peered":"2024-09-10T23:24:26.332775+0000","last_clean":"2024-09-10T23:24:26.332775+0000","last_became_active":"2024-09-10T23:24:24.976148+0000","last_became_peered":"2024-09-10T23:24:24.976148+0000","last_unstale":"2024-09-10T23:24:26.332775+0000","last_undegraded":"2024-09-10T23:24:26.332775+0000","last_fullsized":"2024-09-10T23:24:26.332775+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:50.694920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.962961+0000","last_change":"2024-09-10T23:24:23.962846+0000","last_active":"2024-09-10T23:24:24.962961+0000","last_peered":"2024-09-10T23:24:24.962961+0000","last_clean":"2024-09-10T23:24:24.962961+0000","last_became_active":"2024-09-10T23:24:23.961213+0000","last_became_peered":"2024-09-10T23:24:23.961213+0000","last_unstale":"2024-09-10T23:24:24.962961+0000","last_undegraded":"2024-09-10T23:24:24.962961+0000","last_fullsized":"2024-09-10T23:24:24.962961+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:03.262416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.974086+0000","last_change":"2024-09-10T23:24:24.969900+0000","last_active":"2024-09-10T23:24:24.974086+0000","last_peered":"2024-09-10T23:24:24.974086+0000","last_clean":"2024-09-10T23:24:24.974086+0000","last_became_active":"2024-09-10T23:24:24.969599+0000","last_became_peered":"2024-09-10T23:24:24.969599+0000","last_unstale":"2024-09-10T23:24:24.974086+0000","last_undegraded":"2024-09-10T23:24:24.974086+0000","last_fullsized":"2024-09-10T23:24:24.974086+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:24.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.953288+0000","last_change":"2024-09-10T23:24:23.965405+0000","last_active":"2024-09-10T23:24:24.953288+0000","last_peered":"2024-09-10T23:24:24.953288+0000","last_clean":"2024-09-10T23:24:24.953288+0000","last_became_active":"2024-09-10T23:24:23.965134+0000","last_became_peered":"2024-09-10T23:24:23.965134+0000","last_unstale":"2024-09-10T23:24:24.953288+0000","last_undegraded":"2024-09-10T23:24:24.953288+0000","last_fullsized":"2024-09-10T23:24:24.953288+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:15.822085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.983801+0000","last_change":"2024-09-10T23:24:24.974858+0000","last_active":"2024-09-10T23:24:25.983801+0000","last_peered":"2024-09-10T23:24:25.983801+0000","last_clean":"2024-09-10T23:24:25.983801+0000","last_became_active":"2024-09-10T23:24:24.974547+0000","last_became_peered":"2024-09-10T23:24:24.974547+0000","last_unstale":"2024-09-10T23:24:25.983801+0000","last_undegraded":"2024-09-10T23:24:25.983801+0000","last_fullsized":"2024-09-10T23:24:25.983801+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:44.945239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.984005+0000","last_change":"2024-09-10T23:24:23.963479+0000","last_active":"2024-09-10T23:24:25.984005+0000","last_peered":"2024-09-10T23:24:25.984005+0000","last_clean":"2024-09-10T23:24:25.984005+0000","last_became_active":"2024-09-10T23:24:23.962924+0000","last_became_peered":"2024-09-10T23:24:23.962924+0000","last_unstale":"2024-09-10T23:24:25.984005+0000","last_undegraded":"2024-09-10T23:24:25.984005+0000","last_fullsized":"2024-09-10T23:24:25.984005+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:03.262416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979263+0000","last_change":"2024-09-10T23:24:24.974467+0000","last_active":"2024-09-10T23:24:24.979263+0000","last_peered":"2024-09-10T23:24:24.979263+0000","last_clean":"2024-09-10T23:24:24.979263+0000","last_became_active":"2024-09-10T23:24:24.974194+0000","last_became_peered":"2024-09-10T23:24:24.974194+0000","last_unstale":"2024-09-10T23:24:24.979263+0000","last_undegraded":"2024-09-10T23:24:24.979263+0000","last_fullsized":"2024-09-10T23:24:24.979263+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:25.935101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.964345+0000","last_change":"2024-09-10T23:24:23.966191+0000","last_active":"2024-09-10T23:24:24.964345+0000","last_peered":"2024-09-10T23:24:24.964345+0000","last_clean":"2024-09-10T23:24:24.964345+0000","last_became_active":"2024-09-10T23:24:23.965666+0000","last_became_peered":"2024-09-10T23:24:23.965666+0000","last_unstale":"2024-09-10T23:24:24.964345+0000","last_undegraded":"2024-09-10T23:24:24.964345+0000","last_fullsized":"2024-09-10T23:24:24.964345+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:11.168335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332991+0000","last_change":"2024-09-10T23:24:24.973252+0000","last_active":"2024-09-10T23:24:26.332991+0000","last_peered":"2024-09-10T23:24:26.332991+0000","last_clean":"2024-09-10T23:24:26.332991+0000","last_became_active":"2024-09-10T23:24:24.972966+0000","last_became_peered":"2024-09-10T23:24:24.972966+0000","last_unstale":"2024-09-10T23:24:26.332991+0000","last_undegraded":"2024-09-10T23:24:26.332991+0000","last_fullsized":"2024-09-10T23:24:26.332991+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:33.826460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"132'3","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.991316+0000","last_change":"2024-09-10T23:24:23.965374+0000","last_active":"2024-09-10T23:24:24.991316+0000","last_peered":"2024-09-10T23:24:24.991316+0000","last_clean":"2024-09-10T23:24:24.991316+0000","last_became_active":"2024-09-10T23:24:23.965121+0000","last_became_peered":"2024-09-10T23:24:23.965121+0000","last_unstale":"2024-09-10T23:24:24.991316+0000","last_undegraded":"2024-09-10T23:24:24.991316+0000","last_fullsized":"2024-09-10T23:24:24.991316+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:20.508627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979404+0000","last_change":"2024-09-10T23:24:24.975981+0000","last_active":"2024-09-10T23:24:24.979404+0000","last_peered":"2024-09-10T23:24:24.979404+0000","last_clean":"2024-09-10T23:24:24.979404+0000","last_became_active":"2024-09-10T23:24:24.975733+0000","last_became_peered":"2024-09-10T23:24:24.975733+0000","last_unstale":"2024-09-10T23:24:24.979404+0000","last_undegraded":"2024-09-10T23:24:24.979404+0000","last_fullsized":"2024-09-10T23:24:24.979404+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:28.493627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"132'6","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332594+0000","last_change":"2024-09-10T23:24:23.957523+0000","last_active":"2024-09-10T23:24:26.332594+0000","last_peered":"2024-09-10T23:24:26.332594+0000","last_clean":"2024-09-10T23:24:26.332594+0000","last_became_active":"2024-09-10T23:24:23.957206+0000","last_became_peered":"2024-09-10T23:24:23.957206+0000","last_unstale":"2024-09-10T23:24:26.332594+0000","last_undegraded":"2024-09-10T23:24:26.332594+0000","last_fullsized":"2024-09-10T23:24:26.332594+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:26.648109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.983984+0000","last_change":"2024-09-10T23:24:24.979639+0000","last_active":"2024-09-10T23:24:25.983984+0000","last_peered":"2024-09-10T23:24:25.983984+0000","last_clean":"2024-09-10T23:24:25.983984+0000","last_became_active":"2024-09-10T23:24:24.971590+0000","last_became_peered":"2024-09-10T23:24:24.971590+0000","last_unstale":"2024-09-10T23:24:25.983984+0000","last_undegraded":"2024-09-10T23:24:25.983984+0000","last_fullsized":"2024-09-10T23:24:25.983984+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:52.868641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"132'2","reported_seq":17,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332472+0000","last_change":"2024-09-10T23:24:23.965218+0000","last_active":"2024-09-10T23:24:26.332472+0000","last_peered":"2024-09-10T23:24:26.332472+0000","last_clean":"2024-09-10T23:24:26.332472+0000","last_became_active":"2024-09-10T23:24:23.964928+0000","last_became_peered":"2024-09-10T23:24:23.964928+0000","last_unstale":"2024-09-10T23:24:26.332472+0000","last_undegraded":"2024-09-10T23:24:26.332472+0000","last_fullsized":"2024-09-10T23:24:26.332472+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:17.013997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.972657+0000","last_change":"2024-09-10T23:24:24.969406+0000","last_active":"2024-09-10T23:24:24.972657+0000","last_peered":"2024-09-10T23:24:24.972657+0000","last_clean":"2024-09-10T23:24:24.972657+0000","last_became_active":"2024-09-10T23:24:24.969106+0000","last_became_peered":"2024-09-10T23:24:24.969106+0000","last_unstale":"2024-09-10T23:24:24.972657+0000","last_undegraded":"2024-09-10T23:24:24.972657+0000","last_fullsized":"2024-09-10T23:24:24.972657+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:48.308092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332848+0000","last_change":"2024-09-10T23:24:23.962630+0000","last_active":"2024-09-10T23:24:26.332848+0000","last_peered":"2024-09-10T23:24:26.332848+0000","last_clean":"2024-09-10T23:24:26.332848+0000","last_became_active":"2024-09-10T23:24:23.962295+0000","last_became_peered":"2024-09-10T23:24:23.962295+0000","last_unstale":"2024-09-10T23:24:26.332848+0000","last_undegraded":"2024-09-10T23:24:26.332848+0000","last_fullsized":"2024-09-10T23:24:26.332848+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:00.157461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979564+0000","last_change":"2024-09-10T23:24:24.971404+0000","last_active":"2024-09-10T23:24:24.979564+0000","last_peered":"2024-09-10T23:24:24.979564+0000","last_clean":"2024-09-10T23:24:24.979564+0000","last_became_active":"2024-09-10T23:24:24.971096+0000","last_became_peered":"2024-09-10T23:24:24.971096+0000","last_unstale":"2024-09-10T23:24:24.979564+0000","last_undegraded":"2024-09-10T23:24:24.979564+0000","last_fullsized":"2024-09-10T23:24:24.979564+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:32.644985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332314+0000","last_change":"2024-09-10T23:24:23.961119+0000","last_active":"2024-09-10T23:24:26.332314+0000","last_peered":"2024-09-10T23:24:26.332314+0000","last_clean":"2024-09-10T23:24:26.332314+0000","last_became_active":"2024-09-10T23:24:23.958149+0000","last_became_peered":"2024-09-10T23:24:23.958149+0000","last_unstale":"2024-09-10T23:24:26.332314+0000","last_undegraded":"2024-09-10T23:24:26.332314+0000","last_fullsized":"2024-09-10T23:24:26.332314+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:57.876980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.987116+0000","last_change":"2024-09-10T23:24:24.986158+0000","last_active":"2024-09-10T23:24:24.987116+0000","last_peered":"2024-09-10T23:24:24.987116+0000","last_clean":"2024-09-10T23:24:24.987116+0000","last_became_active":"2024-09-10T23:24:24.985780+0000","last_became_peered":"2024-09-10T23:24:24.985780+0000","last_unstale":"2024-09-10T23:24:24.987116+0000","last_undegraded":"2024-09-10T23:24:24.987116+0000","last_fullsized":"2024-09-10T23:24:24.987116+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:58.986921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.990182+0000","last_change":"2024-09-10T23:24:23.962066+0000","last_active":"2024-09-10T23:24:24.990182+0000","last_peered":"2024-09-10T23:24:24.990182+0000","last_clean":"2024-09-10T23:24:24.990182+0000","last_became_active":"2024-09-10T23:24:23.961700+0000","last_became_peered":"2024-09-10T23:24:23.961700+0000","last_unstale":"2024-09-10T23:24:24.990182+0000","last_undegraded":"2024-09-10T23:24:24.990182+0000","last_fullsized":"2024-09-10T23:24:24.990182+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:07.100425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978187+0000","last_change":"2024-09-10T23:24:24.973296+0000","last_active":"2024-09-10T23:24:24.978187+0000","last_peered":"2024-09-10T23:24:24.978187+0000","last_clean":"2024-09-10T23:24:24.978187+0000","last_became_active":"2024-09-10T23:24:24.973005+0000","last_became_peered":"2024-09-10T23:24:24.973005+0000","last_unstale":"2024-09-10T23:24:24.978187+0000","last_undegraded":"2024-09-10T23:24:24.978187+0000","last_fullsized":"2024-09-10T23:24:24.978187+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:27.990438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.995299+0000","last_change":"2024-09-10T23:24:23.962667+0000","last_active":"2024-09-10T23:24:24.995299+0000","last_peered":"2024-09-10T23:24:24.995299+0000","last_clean":"2024-09-10T23:24:24.995299+0000","last_became_active":"2024-09-10T23:24:23.962402+0000","last_became_peered":"2024-09-10T23:24:23.962402+0000","last_unstale":"2024-09-10T23:24:24.995299+0000","last_undegraded":"2024-09-10T23:24:24.995299+0000","last_fullsized":"2024-09-10T23:24:24.995299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978617+0000","last_change":"2024-09-10T23:24:24.967890+0000","last_active":"2024-09-10T23:24:24.978617+0000","last_peered":"2024-09-10T23:24:24.978617+0000","last_clean":"2024-09-10T23:24:24.978617+0000","last_became_active":"2024-09-10T23:24:24.966933+0000","last_became_peered":"2024-09-10T23:24:24.966933+0000","last_unstale":"2024-09-10T23:24:24.978617+0000","last_undegraded":"2024-09-10T23:24:24.978617+0000","last_fullsized":"2024-09-10T23:24:24.978617+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:42.271595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.992183+0000","last_change":"2024-09-10T23:24:23.969219+0000","last_active":"2024-09-10T23:24:24.992183+0000","last_peered":"2024-09-10T23:24:24.992183+0000","last_clean":"2024-09-10T23:24:24.992183+0000","last_became_active":"2024-09-10T23:24:23.968480+0000","last_became_peered":"2024-09-10T23:24:23.968480+0000","last_unstale":"2024-09-10T23:24:24.992183+0000","last_undegraded":"2024-09-10T23:24:24.992183+0000","last_fullsized":"2024-09-10T23:24:24.992183+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:44.912192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979376+0000","last_change":"2024-09-10T23:24:24.975371+0000","last_active":"2024-09-10T23:24:24.979376+0000","last_peered":"2024-09-10T23:24:24.979376+0000","last_clean":"2024-09-10T23:24:24.979376+0000","last_became_active":"2024-09-10T23:24:24.975123+0000","last_became_peered":"2024-09-10T23:24:24.975123+0000","last_unstale":"2024-09-10T23:24:24.979376+0000","last_undegraded":"2024-09-10T23:24:24.979376+0000","last_fullsized":"2024-09-10T23:24:24.979376+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:01.744825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.965299+0000","last_change":"2024-09-10T23:24:23.973661+0000","last_active":"2024-09-10T23:24:24.965299+0000","last_peered":"2024-09-10T23:24:24.965299+0000","last_clean":"2024-09-10T23:24:24.965299+0000","last_became_active":"2024-09-10T23:24:23.973402+0000","last_became_peered":"2024-09-10T23:24:23.973402+0000","last_unstale":"2024-09-10T23:24:24.965299+0000","last_undegraded":"2024-09-10T23:24:24.965299+0000","last_fullsized":"2024-09-10T23:24:24.965299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:51.861436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978695+0000","last_change":"2024-09-10T23:24:24.968412+0000","last_active":"2024-09-10T23:24:24.978695+0000","last_peered":"2024-09-10T23:24:24.978695+0000","last_clean":"2024-09-10T23:24:24.978695+0000","last_became_active":"2024-09-10T23:24:24.968102+0000","last_became_peered":"2024-09-10T23:24:24.968102+0000","last_unstale":"2024-09-10T23:24:24.978695+0000","last_undegraded":"2024-09-10T23:24:24.978695+0000","last_fullsized":"2024-09-10T23:24:24.978695+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:27.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.995781+0000","last_change":"2024-09-10T23:24:23.966289+0000","last_active":"2024-09-10T23:24:24.995781+0000","last_peered":"2024-09-10T23:24:24.995781+0000","last_clean":"2024-09-10T23:24:24.995781+0000","last_became_active":"2024-09-10T23:24:23.966017+0000","last_became_peered":"2024-09-10T23:24:23.966017+0000","last_unstale":"2024-09-10T23:24:24.995781+0000","last_undegraded":"2024-09-10T23:24:24.995781+0000","last_fullsized":"2024-09-10T23:24:24.995781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:07.571487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332070+0000","last_change":"2024-09-10T23:24:24.980434+0000","last_active":"2024-09-10T23:24:26.332070+0000","last_peered":"2024-09-10T23:24:26.332070+0000","last_clean":"2024-09-10T23:24:26.332070+0000","last_became_active":"2024-09-10T23:24:24.980176+0000","last_became_peered":"2024-09-10T23:24:24.980176+0000","last_unstale":"2024-09-10T23:24:26.332070+0000","last_undegraded":"2024-09-10T23:24:26.332070+0000","last_fullsized":"2024-09-10T23:24:26.332070+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:43.523002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.966612+0000","last_change":"2024-09-10T23:24:23.968813+0000","last_active":"2024-09-10T23:24:24.966612+0000","last_peered":"2024-09-10T23:24:24.966612+0000","last_clean":"2024-09-10T23:24:24.966612+0000","last_became_active":"2024-09-10T23:24:23.967935+0000","last_became_peered":"2024-09-10T23:24:23.967935+0000","last_unstale":"2024-09-10T23:24:24.966612+0000","last_undegraded":"2024-09-10T23:24:24.966612+0000","last_fullsized":"2024-09-10T23:24:24.966612+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:49.899503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332892+0000","last_change":"2024-09-10T23:24:24.984295+0000","last_active":"2024-09-10T23:24:26.332892+0000","last_peered":"2024-09-10T23:24:26.332892+0000","last_clean":"2024-09-10T23:24:26.332892+0000","last_became_active":"2024-09-10T23:24:24.983644+0000","last_became_peered":"2024-09-10T23:24:24.983644+0000","last_unstale":"2024-09-10T23:24:26.332892+0000","last_undegraded":"2024-09-10T23:24:26.332892+0000","last_fullsized":"2024-09-10T23:24:26.332892+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.093613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332336+0000","last_change":"2024-09-10T23:24:23.959230+0000","last_active":"2024-09-10T23:24:26.332336+0000","last_peered":"2024-09-10T23:24:26.332336+0000","last_clean":"2024-09-10T23:24:26.332336+0000","last_became_active":"2024-09-10T23:24:23.958785+0000","last_became_peered":"2024-09-10T23:24:23.958785+0000","last_unstale":"2024-09-10T23:24:26.332336+0000","last_undegraded":"2024-09-10T23:24:26.332336+0000","last_fullsized":"2024-09-10T23:24:26.332336+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:21.459799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.980359+0000","last_change":"2024-09-10T23:24:24.976727+0000","last_active":"2024-09-10T23:24:24.980359+0000","last_peered":"2024-09-10T23:24:24.980359+0000","last_clean":"2024-09-10T23:24:24.980359+0000","last_became_active":"2024-09-10T23:24:24.976447+0000","last_became_peered":"2024-09-10T23:24:24.976447+0000","last_unstale":"2024-09-10T23:24:24.980359+0000","last_undegraded":"2024-09-10T23:24:24.980359+0000","last_fullsized":"2024-09-10T23:24:24.980359+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:08.154933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.964522+0000","last_change":"2024-09-10T23:24:23.969426+0000","last_active":"2024-09-10T23:24:24.964522+0000","last_peered":"2024-09-10T23:24:24.964522+0000","last_clean":"2024-09-10T23:24:24.964522+0000","last_became_active":"2024-09-10T23:24:23.968899+0000","last_became_peered":"2024-09-10T23:24:23.968899+0000","last_unstale":"2024-09-10T23:24:24.964522+0000","last_undegraded":"2024-09-10T23:24:24.964522+0000","last_fullsized":"2024-09-10T23:24:24.964522+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:18.535651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.980426+0000","last_change":"2024-09-10T23:24:24.969139+0000","last_active":"2024-09-10T23:24:24.980426+0000","last_peered":"2024-09-10T23:24:24.980426+0000","last_clean":"2024-09-10T23:24:24.980426+0000","last_became_active":"2024-09-10T23:24:24.968063+0000","last_became_peered":"2024-09-10T23:24:24.968063+0000","last_unstale":"2024-09-10T23:24:24.980426+0000","last_undegraded":"2024-09-10T23:24:24.980426+0000","last_fullsized":"2024-09-10T23:24:24.980426+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:37.586152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.994870+0000","last_change":"2024-09-10T23:24:23.948687+0000","last_active":"2024-09-10T23:24:24.994870+0000","last_peered":"2024-09-10T23:24:24.994870+0000","last_clean":"2024-09-10T23:24:24.994870+0000","last_became_active":"2024-09-10T23:24:23.948379+0000","last_became_peered":"2024-09-10T23:24:23.948379+0000","last_unstale":"2024-09-10T23:24:24.994870+0000","last_undegraded":"2024-09-10T23:24:24.994870+0000","last_fullsized":"2024-09-10T23:24:24.994870+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:27.984877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.974134+0000","last_change":"2024-09-10T23:24:24.972239+0000","last_active":"2024-09-10T23:24:24.974134+0000","last_peered":"2024-09-10T23:24:24.974134+0000","last_clean":"2024-09-10T23:24:24.974134+0000","last_became_active":"2024-09-10T23:24:24.971887+0000","last_became_peered":"2024-09-10T23:24:24.971887+0000","last_unstale":"2024-09-10T23:24:24.974134+0000","last_undegraded":"2024-09-10T23:24:24.974134+0000","last_fullsized":"2024-09-10T23:24:24.974134+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:34.860106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"133'1","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.985241+0000","last_change":"2024-09-10T23:24:23.964410+0000","last_active":"2024-09-10T23:24:25.985241+0000","last_peered":"2024-09-10T23:24:25.985241+0000","last_clean":"2024-09-10T23:24:25.985241+0000","last_became_active":"2024-09-10T23:24:23.962333+0000","last_became_peered":"2024-09-10T23:24:23.962333+0000","last_unstale":"2024-09-10T23:24:25.985241+0000","last_undegraded":"2024-09-10T23:24:25.985241+0000","last_fullsized":"2024-09-10T23:24:25.985241+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:11.168335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981536+0000","last_change":"2024-09-10T23:24:24.975955+0000","last_active":"2024-09-10T23:24:24.981536+0000","last_peered":"2024-09-10T23:24:24.981536+0000","last_clean":"2024-09-10T23:24:24.981536+0000","last_became_active":"2024-09-10T23:24:24.975688+0000","last_became_peered":"2024-09-10T23:24:24.975688+0000","last_unstale":"2024-09-10T23:24:24.981536+0000","last_undegraded":"2024-09-10T23:24:24.981536+0000","last_fullsized":"2024-09-10T23:24:24.981536+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:26.950051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.984061+0000","last_change":"2024-09-10T23:24:23.962655+0000","last_active":"2024-09-10T23:24:25.984061+0000","last_peered":"2024-09-10T23:24:25.984061+0000","last_clean":"2024-09-10T23:24:25.984061+0000","last_became_active":"2024-09-10T23:24:23.962306+0000","last_became_peered":"2024-09-10T23:24:23.962306+0000","last_unstale":"2024-09-10T23:24:25.984061+0000","last_undegraded":"2024-09-10T23:24:25.984061+0000","last_fullsized":"2024-09-10T23:24:25.984061+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:26.983232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.984828+0000","last_change":"2024-09-10T23:24:24.978717+0000","last_active":"2024-09-10T23:24:24.984828+0000","last_peered":"2024-09-10T23:24:24.984828+0000","last_clean":"2024-09-10T23:24:24.984828+0000","last_became_active":"2024-09-10T23:24:24.978403+0000","last_became_peered":"2024-09-10T23:24:24.978403+0000","last_unstale":"2024-09-10T23:24:24.984828+0000","last_undegraded":"2024-09-10T23:24:24.984828+0000","last_fullsized":"2024-09-10T23:24:24.984828+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:30.299185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.953485+0000","last_change":"2024-09-10T23:24:23.964520+0000","last_active":"2024-09-10T23:24:24.953485+0000","last_peered":"2024-09-10T23:24:24.953485+0000","last_clean":"2024-09-10T23:24:24.953485+0000","last_became_active":"2024-09-10T23:24:23.964244+0000","last_became_peered":"2024-09-10T23:24:23.964244+0000","last_unstale":"2024-09-10T23:24:24.953485+0000","last_undegraded":"2024-09-10T23:24:24.953485+0000","last_fullsized":"2024-09-10T23:24:24.953485+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:42.230993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.960442+0000","last_change":"2024-09-10T23:24:24.956789+0000","last_active":"2024-09-10T23:24:24.960442+0000","last_peered":"2024-09-10T23:24:24.960442+0000","last_clean":"2024-09-10T23:24:24.960442+0000","last_became_active":"2024-09-10T23:24:24.956141+0000","last_became_peered":"2024-09-10T23:24:24.956141+0000","last_unstale":"2024-09-10T23:24:24.960442+0000","last_undegraded":"2024-09-10T23:24:24.960442+0000","last_fullsized":"2024-09-10T23:24:24.960442+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:29.154457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.960033+0000","last_change":"2024-09-10T23:24:23.965478+0000","last_active":"2024-09-10T23:24:24.960033+0000","last_peered":"2024-09-10T23:24:24.960033+0000","last_clean":"2024-09-10T23:24:24.960033+0000","last_became_active":"2024-09-10T23:24:23.965175+0000","last_became_peered":"2024-09-10T23:24:23.965175+0000","last_unstale":"2024-09-10T23:24:24.960033+0000","last_undegraded":"2024-09-10T23:24:24.960033+0000","last_fullsized":"2024-09-10T23:24:24.960033+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:09.413814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332276+0000","last_change":"2024-09-10T23:24:24.974640+0000","last_active":"2024-09-10T23:24:26.332276+0000","last_peered":"2024-09-10T23:24:26.332276+0000","last_clean":"2024-09-10T23:24:26.332276+0000","last_became_active":"2024-09-10T23:24:24.974325+0000","last_became_peered":"2024-09-10T23:24:24.974325+0000","last_unstale":"2024-09-10T23:24:26.332276+0000","last_undegraded":"2024-09-10T23:24:26.332276+0000","last_fullsized":"2024-09-10T23:24:26.332276+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:02:37.611167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.959207+0000","last_change":"2024-09-10T23:24:23.959882+0000","last_active":"2024-09-10T23:24:24.959207+0000","last_peered":"2024-09-10T23:24:24.959207+0000","last_clean":"2024-09-10T23:24:24.959207+0000","last_became_active":"2024-09-10T23:24:23.959592+0000","last_became_peered":"2024-09-10T23:24:23.959592+0000","last_unstale":"2024-09-10T23:24:24.959207+0000","last_undegraded":"2024-09-10T23:24:24.959207+0000","last_fullsized":"2024-09-10T23:24:24.959207+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:47.031263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.986099+0000","last_change":"2024-09-10T23:24:24.985293+0000","last_active":"2024-09-10T23:24:24.986099+0000","last_peered":"2024-09-10T23:24:24.986099+0000","last_clean":"2024-09-10T23:24:24.986099+0000","last_became_active":"2024-09-10T23:24:24.984930+0000","last_became_peered":"2024-09-10T23:24:24.984930+0000","last_unstale":"2024-09-10T23:24:24.986099+0000","last_undegraded":"2024-09-10T23:24:24.986099+0000","last_fullsized":"2024-09-10T23:24:24.986099+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:34.104665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.953632+0000","last_change":"2024-09-10T23:24:23.964310+0000","last_active":"2024-09-10T23:24:24.953632+0000","last_peered":"2024-09-10T23:24:24.953632+0000","last_clean":"2024-09-10T23:24:24.953632+0000","last_became_active":"2024-09-10T23:24:23.964042+0000","last_became_peered":"2024-09-10T23:24:23.964042+0000","last_unstale":"2024-09-10T23:24:24.953632+0000","last_undegraded":"2024-09-10T23:24:24.953632+0000","last_fullsized":"2024-09-10T23:24:24.953632+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:44.260643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.974118+0000","last_change":"2024-09-10T23:24:24.972149+0000","last_active":"2024-09-10T23:24:24.974118+0000","last_peered":"2024-09-10T23:24:24.974118+0000","last_clean":"2024-09-10T23:24:24.974118+0000","last_became_active":"2024-09-10T23:24:24.971808+0000","last_became_peered":"2024-09-10T23:24:24.971808+0000","last_unstale":"2024-09-10T23:24:24.974118+0000","last_undegraded":"2024-09-10T23:24:24.974118+0000","last_fullsized":"2024-09-10T23:24:24.974118+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:30.595705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.964713+0000","last_change":"2024-09-10T23:24:23.969129+0000","last_active":"2024-09-10T23:24:24.964713+0000","last_peered":"2024-09-10T23:24:24.964713+0000","last_clean":"2024-09-10T23:24:24.964713+0000","last_became_active":"2024-09-10T23:24:23.966876+0000","last_became_peered":"2024-09-10T23:24:23.966876+0000","last_unstale":"2024-09-10T23:24:24.964713+0000","last_undegraded":"2024-09-10T23:24:24.964713+0000","last_fullsized":"2024-09-10T23:24:24.964713+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:43.938034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981119+0000","last_change":"2024-09-10T23:24:24.975832+0000","last_active":"2024-09-10T23:24:24.981119+0000","last_peered":"2024-09-10T23:24:24.981119+0000","last_clean":"2024-09-10T23:24:24.981119+0000","last_became_active":"2024-09-10T23:24:24.972596+0000","last_became_peered":"2024-09-10T23:24:24.972596+0000","last_unstale":"2024-09-10T23:24:24.981119+0000","last_undegraded":"2024-09-10T23:24:24.981119+0000","last_fullsized":"2024-09-10T23:24:24.981119+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:20.856924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"132'8","reported_seq":23,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.331952+0000","last_change":"2024-09-10T23:24:23.964055+0000","last_active":"2024-09-10T23:24:26.331952+0000","last_peered":"2024-09-10T23:24:26.331952+0000","last_clean":"2024-09-10T23:24:26.331952+0000","last_became_active":"2024-09-10T23:24:23.963812+0000","last_became_peered":"2024-09-10T23:24:23.963812+0000","last_unstale":"2024-09-10T23:24:26.331952+0000","last_undegraded":"2024-09-10T23:24:26.331952+0000","last_fullsized":"2024-09-10T23:24:26.331952+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:19.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":307,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.964850+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:24:24.964850+0000","last_peered":"2024-09-10T23:24:24.964850+0000","last_clean":"2024-09-10T23:24:24.964850+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:24:24.964850+0000","last_undegraded":"2024-09-10T23:24:24.964850+0000","last_fullsized":"2024-09-10T23:24:24.964850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476847,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63336,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308504,"statfs":{"total":96636764160,"available":96571908096,"internally_reserved":0,"allocated":1650688,"data_stored":774290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509552,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2215936,"data_stored":1350217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54984,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316856,"statfs":{"total":96636764160,"available":96580460544,"internally_reserved":0,"allocated":1622016,"data_stored":759849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509552,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64712,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94307128,"statfs":{"total":96636764160,"available":96570499072,"internally_reserved":0,"allocated":1622016,"data_stored":759849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68868,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302972,"statfs":{"total":96636764160,"available":96566243328,"internally_reserved":0,"allocated":1622016,"data_stored":759849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1638400,"data_stored":767038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509551,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69452,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302388,"statfs":{"total":96636764160,"available":96565645312,"internally_reserved":0,"allocated":2215936,"data_stored":1350217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59188,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312652,"statfs":{"total":96636764160,"available":96576155648,"internally_reserved":0,"allocated":1662976,"data_stored":775354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:24:29.115 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:24:29.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 -- 172.21.15.17:0/3248533102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0cf230 msgr2=0x7f9dec06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 --2- 172.21.15.17:0/3248533102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0cf230 0x7f9dec06e750 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9de000aa10 tx=0x7f9de0020420 comp rx=0 tx=0).stop 2024-09-10T23:24:29.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 -- 172.21.15.17:0/3248533102 shutdown_connections 2024-09-10T23:24:29.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 --2- 172.21.15.17:0/3248533102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0cf230 0x7f9dec06e750 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 -- 172.21.15.17:0/3248533102 >> 172.21.15.17:0/3248533102 conn(0x7f9dec06cfc0 msgr2=0x7f9dec06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:29.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 -- 172.21.15.17:0/3248533102 shutdown_connections 2024-09-10T23:24:29.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 -- 172.21.15.17:0/3248533102 wait complete. 2024-09-10T23:24:29.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 Processor -- start 2024-09-10T23:24:29.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 -- start start 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0b32d0 0x7f9dec0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dec0cf230 0x7f9dec1e97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.299+0000 7f9df4800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dec0cf610 0x7f9dec1f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df4800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9dec0d04a0 con 0x7f9dec0b32d0 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df4800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9dec0d0320 con 0x7f9dec0cf610 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df4800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9dec0d0620 con 0x7f9dec0cf230 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0b32d0 0x7f9dec0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0b32d0 0x7f9dec0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39748/0 (socket says 172.21.15.17:39748) 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1e00640 1 -- 172.21.15.17:0/1999575224 learned_addr learned my addr 172.21.15.17:0/1999575224 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:29.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1400640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dec0cf230 0x7f9dec1e97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df2800640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dec0cf610 0x7f9dec1f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1e00640 1 -- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dec0cf230 msgr2=0x7f9dec1e97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1e00640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dec0cf230 0x7f9dec1e97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1e00640 1 -- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dec0cf610 msgr2=0x7f9dec1f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1e00640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dec0cf610 0x7f9dec1f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1e00640 1 -- 172.21.15.17:0/1999575224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dec0ccb80 con 0x7f9dec0b32d0 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df2800640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dec0cf610 0x7f9dec1f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df1e00640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0b32d0 0x7f9dec0cdc00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f9de00b3040 tx=0x7f9de00b0400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9de6000640 1 -- 172.21.15.17:0/1999575224 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de00b5040 con 0x7f9dec0b32d0 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9de6000640 1 -- 172.21.15.17:0/1999575224 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9de00b0be0 con 0x7f9dec0b32d0 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dec0cce60 con 0x7f9dec0b32d0 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9de6000640 1 -- 172.21.15.17:0/1999575224 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0005030 con 0x7f9dec0b32d0 2024-09-10T23:24:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dec0cd420 con 0x7f9dec0b32d0 2024-09-10T23:24:29.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dec06e750 con 0x7f9dec0b32d0 2024-09-10T23:24:29.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.303+0000 7f9de6000640 1 -- 172.21.15.17:0/1999575224 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9de00b8070 con 0x7f9dec0b32d0 2024-09-10T23:24:29.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.307+0000 7f9de6000640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd00725e0 0x7f9dd0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:29.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.307+0000 7f9de6000640 1 -- 172.21.15.17:0/1999575224 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f9de0131060 con 0x7f9dec0b32d0 2024-09-10T23:24:29.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.307+0000 7f9df1400640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd00725e0 0x7f9dd0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.307+0000 7f9df1400640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd00725e0 0x7f9dd0074aa0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9dec15a6e0 tx=0x7f9ddc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.311+0000 7f9de6000640 1 -- 172.21.15.17:0/1999575224 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9de0019f80 con 0x7f9dec0b32d0 2024-09-10T23:24:29.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.483+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dec06a030 con 0x7f9dd00725e0 2024-09-10T23:24:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.487+0000 7f9de6000640 1 -- 172.21.15.17:0/1999575224 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252474 (secure 0 0 0) 0x7f9dec06a030 con 0x7f9dd00725e0 2024-09-10T23:24:29.492 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:29.494 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:24:29.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd00725e0 msgr2=0x7f9dd0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd00725e0 0x7f9dd0074aa0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9dec15a6e0 tx=0x7f9ddc009040 comp rx=0 tx=0).stop 2024-09-10T23:24:29.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0b32d0 msgr2=0x7f9dec0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0b32d0 0x7f9dec0cdc00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f9de00b3040 tx=0x7f9de00b0400 comp rx=0 tx=0).stop 2024-09-10T23:24:29.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 shutdown_connections 2024-09-10T23:24:29.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9dd00725e0 0x7f9dd0074aa0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dec0cf610 0x7f9dec1f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dec0cf230 0x7f9dec1e97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 --2- 172.21.15.17:0/1999575224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dec0b32d0 0x7f9dec0cdc00 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 >> 172.21.15.17:0/1999575224 conn(0x7f9dec06cfc0 msgr2=0x7f9dec068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:29.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 shutdown_connections 2024-09-10T23:24:29.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.491+0000 7f9df4800640 1 -- 172.21.15.17:0/1999575224 wait complete. 2024-09-10T23:24:29.513 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-10T23:24:28.420813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":495268,"kb_used_data":13916,"kb_used_omap":12,"kb_used_meta":481139,"kb_avail":754479452,"statfs":{"total":773094113280,"available":772586958848,"internally_reserved":0,"allocated":14249984,"data_stored":7296663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":492686897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.483470"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.976123+0000","last_change":"2024-09-10T23:24:24.970114+0000","last_active":"2024-09-10T23:24:24.976123+0000","last_peered":"2024-09-10T23:24:24.976123+0000","last_clean":"2024-09-10T23:24:24.976123+0000","last_became_active":"2024-09-10T23:24:24.966757+0000","last_became_peered":"2024-09-10T23:24:24.966757+0000","last_unstale":"2024-09-10T23:24:24.976123+0000","last_undegraded":"2024-09-10T23:24:24.976123+0000","last_fullsized":"2024-09-10T23:24:24.976123+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:12.175541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332809+0000","last_change":"2024-09-10T23:24:24.980058+0000","last_active":"2024-09-10T23:24:26.332809+0000","last_peered":"2024-09-10T23:24:26.332809+0000","last_clean":"2024-09-10T23:24:26.332809+0000","last_became_active":"2024-09-10T23:24:24.976773+0000","last_became_peered":"2024-09-10T23:24:24.976773+0000","last_unstale":"2024-09-10T23:24:26.332809+0000","last_undegraded":"2024-09-10T23:24:26.332809+0000","last_fullsized":"2024-09-10T23:24:26.332809+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:14.023319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.333064+0000","last_change":"2024-09-10T23:24:24.972040+0000","last_active":"2024-09-10T23:24:26.333064+0000","last_peered":"2024-09-10T23:24:26.333064+0000","last_clean":"2024-09-10T23:24:26.333064+0000","last_became_active":"2024-09-10T23:24:24.971727+0000","last_became_peered":"2024-09-10T23:24:24.971727+0000","last_unstale":"2024-09-10T23:24:26.333064+0000","last_undegraded":"2024-09-10T23:24:26.333064+0000","last_fullsized":"2024-09-10T23:24:26.333064+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:08.598900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981820+0000","last_change":"2024-09-10T23:24:24.977890+0000","last_active":"2024-09-10T23:24:24.981820+0000","last_peered":"2024-09-10T23:24:24.981820+0000","last_clean":"2024-09-10T23:24:24.981820+0000","last_became_active":"2024-09-10T23:24:24.977631+0000","last_became_peered":"2024-09-10T23:24:24.977631+0000","last_unstale":"2024-09-10T23:24:24.981820+0000","last_undegraded":"2024-09-10T23:24:24.981820+0000","last_fullsized":"2024-09-10T23:24:24.981820+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:39.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979853+0000","last_change":"2024-09-10T23:24:24.977189+0000","last_active":"2024-09-10T23:24:24.979853+0000","last_peered":"2024-09-10T23:24:24.979853+0000","last_clean":"2024-09-10T23:24:24.979853+0000","last_became_active":"2024-09-10T23:24:24.976862+0000","last_became_peered":"2024-09-10T23:24:24.976862+0000","last_unstale":"2024-09-10T23:24:24.979853+0000","last_undegraded":"2024-09-10T23:24:24.979853+0000","last_fullsized":"2024-09-10T23:24:24.979853+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:25.935101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979354+0000","last_change":"2024-09-10T23:24:24.969990+0000","last_active":"2024-09-10T23:24:24.979354+0000","last_peered":"2024-09-10T23:24:24.979354+0000","last_clean":"2024-09-10T23:24:24.979354+0000","last_became_active":"2024-09-10T23:24:24.969150+0000","last_became_peered":"2024-09-10T23:24:24.969150+0000","last_unstale":"2024-09-10T23:24:24.979354+0000","last_undegraded":"2024-09-10T23:24:24.979354+0000","last_fullsized":"2024-09-10T23:24:24.979354+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:55.209906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978490+0000","last_change":"2024-09-10T23:24:24.968617+0000","last_active":"2024-09-10T23:24:24.978490+0000","last_peered":"2024-09-10T23:24:24.978490+0000","last_clean":"2024-09-10T23:24:24.978490+0000","last_became_active":"2024-09-10T23:24:24.968290+0000","last_became_peered":"2024-09-10T23:24:24.968290+0000","last_unstale":"2024-09-10T23:24:24.978490+0000","last_undegraded":"2024-09-10T23:24:24.978490+0000","last_fullsized":"2024-09-10T23:24:24.978490+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:45.631061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332425+0000","last_change":"2024-09-10T23:24:24.985546+0000","last_active":"2024-09-10T23:24:26.332425+0000","last_peered":"2024-09-10T23:24:26.332425+0000","last_clean":"2024-09-10T23:24:26.332425+0000","last_became_active":"2024-09-10T23:24:24.985269+0000","last_became_peered":"2024-09-10T23:24:24.985269+0000","last_unstale":"2024-09-10T23:24:26.332425+0000","last_undegraded":"2024-09-10T23:24:26.332425+0000","last_fullsized":"2024-09-10T23:24:26.332425+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:14.237017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981069+0000","last_change":"2024-09-10T23:24:24.973728+0000","last_active":"2024-09-10T23:24:24.981069+0000","last_peered":"2024-09-10T23:24:24.981069+0000","last_clean":"2024-09-10T23:24:24.981069+0000","last_became_active":"2024-09-10T23:24:24.973283+0000","last_became_peered":"2024-09-10T23:24:24.973283+0000","last_unstale":"2024-09-10T23:24:24.981069+0000","last_undegraded":"2024-09-10T23:24:24.981069+0000","last_fullsized":"2024-09-10T23:24:24.981069+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:14.055599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.986787+0000","last_change":"2024-09-10T23:24:24.976497+0000","last_active":"2024-09-10T23:24:24.986787+0000","last_peered":"2024-09-10T23:24:24.986787+0000","last_clean":"2024-09-10T23:24:24.986787+0000","last_became_active":"2024-09-10T23:24:24.976197+0000","last_became_peered":"2024-09-10T23:24:24.976197+0000","last_unstale":"2024-09-10T23:24:24.986787+0000","last_undegraded":"2024-09-10T23:24:24.986787+0000","last_fullsized":"2024-09-10T23:24:24.986787+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:45.803060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.984024+0000","last_change":"2024-09-10T23:24:24.981195+0000","last_active":"2024-09-10T23:24:24.984024+0000","last_peered":"2024-09-10T23:24:24.984024+0000","last_clean":"2024-09-10T23:24:24.984024+0000","last_became_active":"2024-09-10T23:24:24.980926+0000","last_became_peered":"2024-09-10T23:24:24.980926+0000","last_unstale":"2024-09-10T23:24:24.984024+0000","last_undegraded":"2024-09-10T23:24:24.984024+0000","last_fullsized":"2024-09-10T23:24:24.984024+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:01.744825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.962990+0000","last_change":"2024-09-10T23:24:24.959343+0000","last_active":"2024-09-10T23:24:24.962990+0000","last_peered":"2024-09-10T23:24:24.962990+0000","last_clean":"2024-09-10T23:24:24.962990+0000","last_became_active":"2024-09-10T23:24:24.958467+0000","last_became_peered":"2024-09-10T23:24:24.958467+0000","last_unstale":"2024-09-10T23:24:24.962990+0000","last_undegraded":"2024-09-10T23:24:24.962990+0000","last_fullsized":"2024-09-10T23:24:24.962990+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:44:03.006277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.987544+0000","last_change":"2024-09-10T23:24:24.978101+0000","last_active":"2024-09-10T23:24:24.987544+0000","last_peered":"2024-09-10T23:24:24.987544+0000","last_clean":"2024-09-10T23:24:24.987544+0000","last_became_active":"2024-09-10T23:24:24.977821+0000","last_became_peered":"2024-09-10T23:24:24.977821+0000","last_unstale":"2024-09-10T23:24:24.987544+0000","last_undegraded":"2024-09-10T23:24:24.987544+0000","last_fullsized":"2024-09-10T23:24:24.987544+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:04.269621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332272+0000","last_change":"2024-09-10T23:24:24.984592+0000","last_active":"2024-09-10T23:24:26.332272+0000","last_peered":"2024-09-10T23:24:26.332272+0000","last_clean":"2024-09-10T23:24:26.332272+0000","last_became_active":"2024-09-10T23:24:24.983999+0000","last_became_peered":"2024-09-10T23:24:24.983999+0000","last_unstale":"2024-09-10T23:24:26.332272+0000","last_undegraded":"2024-09-10T23:24:26.332272+0000","last_fullsized":"2024-09-10T23:24:26.332272+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:27.867698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.977743+0000","last_change":"2024-09-10T23:24:24.971684+0000","last_active":"2024-09-10T23:24:24.977743+0000","last_peered":"2024-09-10T23:24:24.977743+0000","last_clean":"2024-09-10T23:24:24.977743+0000","last_became_active":"2024-09-10T23:24:24.971419+0000","last_became_peered":"2024-09-10T23:24:24.971419+0000","last_unstale":"2024-09-10T23:24:24.977743+0000","last_undegraded":"2024-09-10T23:24:24.977743+0000","last_fullsized":"2024-09-10T23:24:24.977743+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:21.515832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978718+0000","last_change":"2024-09-10T23:24:24.970314+0000","last_active":"2024-09-10T23:24:24.978718+0000","last_peered":"2024-09-10T23:24:24.978718+0000","last_clean":"2024-09-10T23:24:24.978718+0000","last_became_active":"2024-09-10T23:24:24.968434+0000","last_became_peered":"2024-09-10T23:24:24.968434+0000","last_unstale":"2024-09-10T23:24:24.978718+0000","last_undegraded":"2024-09-10T23:24:24.978718+0000","last_fullsized":"2024-09-10T23:24:24.978718+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:35.812574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.987003+0000","last_change":"2024-09-10T23:24:24.978005+0000","last_active":"2024-09-10T23:24:24.987003+0000","last_peered":"2024-09-10T23:24:24.987003+0000","last_clean":"2024-09-10T23:24:24.987003+0000","last_became_active":"2024-09-10T23:24:24.976240+0000","last_became_peered":"2024-09-10T23:24:24.976240+0000","last_unstale":"2024-09-10T23:24:24.987003+0000","last_undegraded":"2024-09-10T23:24:24.987003+0000","last_fullsized":"2024-09-10T23:24:24.987003+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:10.421020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332989+0000","last_change":"2024-09-10T23:24:24.969900+0000","last_active":"2024-09-10T23:24:26.332989+0000","last_peered":"2024-09-10T23:24:26.332989+0000","last_clean":"2024-09-10T23:24:26.332989+0000","last_became_active":"2024-09-10T23:24:24.969592+0000","last_became_peered":"2024-09-10T23:24:24.969592+0000","last_unstale":"2024-09-10T23:24:26.332989+0000","last_undegraded":"2024-09-10T23:24:26.332989+0000","last_fullsized":"2024-09-10T23:24:26.332989+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:11.358250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.983945+0000","last_change":"2024-09-10T23:24:24.980819+0000","last_active":"2024-09-10T23:24:25.983945+0000","last_peered":"2024-09-10T23:24:25.983945+0000","last_clean":"2024-09-10T23:24:25.983945+0000","last_became_active":"2024-09-10T23:24:24.975534+0000","last_became_peered":"2024-09-10T23:24:24.975534+0000","last_unstale":"2024-09-10T23:24:25.983945+0000","last_undegraded":"2024-09-10T23:24:25.983945+0000","last_fullsized":"2024-09-10T23:24:25.983945+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:45.919397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.970533+0000","last_change":"2024-09-10T23:24:24.965410+0000","last_active":"2024-09-10T23:24:24.970533+0000","last_peered":"2024-09-10T23:24:24.970533+0000","last_clean":"2024-09-10T23:24:24.970533+0000","last_became_active":"2024-09-10T23:24:24.965086+0000","last_became_peered":"2024-09-10T23:24:24.965086+0000","last_unstale":"2024-09-10T23:24:24.970533+0000","last_undegraded":"2024-09-10T23:24:24.970533+0000","last_fullsized":"2024-09-10T23:24:24.970533+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:29.084373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.980003+0000","last_change":"2024-09-10T23:24:24.972772+0000","last_active":"2024-09-10T23:24:24.980003+0000","last_peered":"2024-09-10T23:24:24.980003+0000","last_clean":"2024-09-10T23:24:24.980003+0000","last_became_active":"2024-09-10T23:24:24.972451+0000","last_became_peered":"2024-09-10T23:24:24.972451+0000","last_unstale":"2024-09-10T23:24:24.980003+0000","last_undegraded":"2024-09-10T23:24:24.980003+0000","last_fullsized":"2024-09-10T23:24:24.980003+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:58:14.817581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.977998+0000","last_change":"2024-09-10T23:24:24.974149+0000","last_active":"2024-09-10T23:24:24.977998+0000","last_peered":"2024-09-10T23:24:24.977998+0000","last_clean":"2024-09-10T23:24:24.977998+0000","last_became_active":"2024-09-10T23:24:24.972288+0000","last_became_peered":"2024-09-10T23:24:24.972288+0000","last_unstale":"2024-09-10T23:24:24.977998+0000","last_undegraded":"2024-09-10T23:24:24.977998+0000","last_fullsized":"2024-09-10T23:24:24.977998+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:07.792052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981146+0000","last_change":"2024-09-10T23:24:24.973777+0000","last_active":"2024-09-10T23:24:24.981146+0000","last_peered":"2024-09-10T23:24:24.981146+0000","last_clean":"2024-09-10T23:24:24.981146+0000","last_became_active":"2024-09-10T23:24:24.973247+0000","last_became_peered":"2024-09-10T23:24:24.973247+0000","last_unstale":"2024-09-10T23:24:24.981146+0000","last_undegraded":"2024-09-10T23:24:24.981146+0000","last_fullsized":"2024-09-10T23:24:24.981146+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:37:12.954987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979492+0000","last_change":"2024-09-10T23:24:24.972431+0000","last_active":"2024-09-10T23:24:24.979492+0000","last_peered":"2024-09-10T23:24:24.979492+0000","last_clean":"2024-09-10T23:24:24.979492+0000","last_became_active":"2024-09-10T23:24:24.972148+0000","last_became_peered":"2024-09-10T23:24:24.972148+0000","last_unstale":"2024-09-10T23:24:24.979492+0000","last_undegraded":"2024-09-10T23:24:24.979492+0000","last_fullsized":"2024-09-10T23:24:24.979492+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:27.990438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979423+0000","last_change":"2024-09-10T23:24:24.976550+0000","last_active":"2024-09-10T23:24:24.979423+0000","last_peered":"2024-09-10T23:24:24.979423+0000","last_clean":"2024-09-10T23:24:24.979423+0000","last_became_active":"2024-09-10T23:24:24.976317+0000","last_became_peered":"2024-09-10T23:24:24.976317+0000","last_unstale":"2024-09-10T23:24:24.979423+0000","last_undegraded":"2024-09-10T23:24:24.979423+0000","last_fullsized":"2024-09-10T23:24:24.979423+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:50.365139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.967109+0000","last_change":"2024-09-10T23:24:24.965331+0000","last_active":"2024-09-10T23:24:24.967109+0000","last_peered":"2024-09-10T23:24:24.967109+0000","last_clean":"2024-09-10T23:24:24.967109+0000","last_became_active":"2024-09-10T23:24:24.965017+0000","last_became_peered":"2024-09-10T23:24:24.965017+0000","last_unstale":"2024-09-10T23:24:24.967109+0000","last_undegraded":"2024-09-10T23:24:24.967109+0000","last_fullsized":"2024-09-10T23:24:24.967109+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:17.476894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.984000+0000","last_change":"2024-09-10T23:24:24.980072+0000","last_active":"2024-09-10T23:24:25.984000+0000","last_peered":"2024-09-10T23:24:25.984000+0000","last_clean":"2024-09-10T23:24:25.984000+0000","last_became_active":"2024-09-10T23:24:24.975121+0000","last_became_peered":"2024-09-10T23:24:24.975121+0000","last_unstale":"2024-09-10T23:24:25.984000+0000","last_undegraded":"2024-09-10T23:24:25.984000+0000","last_fullsized":"2024-09-10T23:24:25.984000+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:08.154933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.985905+0000","last_change":"2024-09-10T23:24:24.979683+0000","last_active":"2024-09-10T23:24:24.985905+0000","last_peered":"2024-09-10T23:24:24.985905+0000","last_clean":"2024-09-10T23:24:24.985905+0000","last_became_active":"2024-09-10T23:24:24.979363+0000","last_became_peered":"2024-09-10T23:24:24.979363+0000","last_unstale":"2024-09-10T23:24:24.985905+0000","last_undegraded":"2024-09-10T23:24:24.985905+0000","last_fullsized":"2024-09-10T23:24:24.985905+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:04.903958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.967755+0000","last_change":"2024-09-10T23:24:24.966302+0000","last_active":"2024-09-10T23:24:24.967755+0000","last_peered":"2024-09-10T23:24:24.967755+0000","last_clean":"2024-09-10T23:24:24.967755+0000","last_became_active":"2024-09-10T23:24:24.966022+0000","last_became_peered":"2024-09-10T23:24:24.966022+0000","last_unstale":"2024-09-10T23:24:24.967755+0000","last_undegraded":"2024-09-10T23:24:24.967755+0000","last_fullsized":"2024-09-10T23:24:24.967755+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:42.157355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332496+0000","last_change":"2024-09-10T23:24:24.977271+0000","last_active":"2024-09-10T23:24:26.332496+0000","last_peered":"2024-09-10T23:24:26.332496+0000","last_clean":"2024-09-10T23:24:26.332496+0000","last_became_active":"2024-09-10T23:24:24.976356+0000","last_became_peered":"2024-09-10T23:24:24.976356+0000","last_unstale":"2024-09-10T23:24:26.332496+0000","last_undegraded":"2024-09-10T23:24:26.332496+0000","last_fullsized":"2024-09-10T23:24:26.332496+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:40.451317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.982617+0000","last_change":"2024-09-10T23:24:24.978092+0000","last_active":"2024-09-10T23:24:24.982617+0000","last_peered":"2024-09-10T23:24:24.982617+0000","last_clean":"2024-09-10T23:24:24.982617+0000","last_became_active":"2024-09-10T23:24:24.977831+0000","last_became_peered":"2024-09-10T23:24:24.977831+0000","last_unstale":"2024-09-10T23:24:24.982617+0000","last_undegraded":"2024-09-10T23:24:24.982617+0000","last_fullsized":"2024-09-10T23:24:24.982617+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.128571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979520+0000","last_change":"2024-09-10T23:24:24.973717+0000","last_active":"2024-09-10T23:24:24.979520+0000","last_peered":"2024-09-10T23:24:24.979520+0000","last_clean":"2024-09-10T23:24:24.979520+0000","last_became_active":"2024-09-10T23:24:24.973393+0000","last_became_peered":"2024-09-10T23:24:24.973393+0000","last_unstale":"2024-09-10T23:24:24.979520+0000","last_undegraded":"2024-09-10T23:24:24.979520+0000","last_fullsized":"2024-09-10T23:24:24.979520+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:07.792052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.987590+0000","last_change":"2024-09-10T23:24:24.983132+0000","last_active":"2024-09-10T23:24:24.987590+0000","last_peered":"2024-09-10T23:24:24.987590+0000","last_clean":"2024-09-10T23:24:24.987590+0000","last_became_active":"2024-09-10T23:24:24.982741+0000","last_became_peered":"2024-09-10T23:24:24.982741+0000","last_unstale":"2024-09-10T23:24:24.987590+0000","last_undegraded":"2024-09-10T23:24:24.987590+0000","last_fullsized":"2024-09-10T23:24:24.987590+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:12.175541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"132'4","reported_seq":19,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.983881+0000","last_change":"2024-09-10T23:24:23.967292+0000","last_active":"2024-09-10T23:24:25.983881+0000","last_peered":"2024-09-10T23:24:25.983881+0000","last_clean":"2024-09-10T23:24:25.983881+0000","last_became_active":"2024-09-10T23:24:23.966997+0000","last_became_peered":"2024-09-10T23:24:23.966997+0000","last_unstale":"2024-09-10T23:24:25.983881+0000","last_undegraded":"2024-09-10T23:24:25.983881+0000","last_fullsized":"2024-09-10T23:24:25.983881+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:09.413814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978660+0000","last_change":"2024-09-10T23:24:24.970932+0000","last_active":"2024-09-10T23:24:24.978660+0000","last_peered":"2024-09-10T23:24:24.978660+0000","last_clean":"2024-09-10T23:24:24.978660+0000","last_became_active":"2024-09-10T23:24:24.970628+0000","last_became_peered":"2024-09-10T23:24:24.970628+0000","last_unstale":"2024-09-10T23:24:24.978660+0000","last_undegraded":"2024-09-10T23:24:24.978660+0000","last_fullsized":"2024-09-10T23:24:24.978660+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:03.427796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.988281+0000","last_change":"2024-09-10T23:24:23.963347+0000","last_active":"2024-09-10T23:24:24.988281+0000","last_peered":"2024-09-10T23:24:24.988281+0000","last_clean":"2024-09-10T23:24:24.988281+0000","last_became_active":"2024-09-10T23:24:23.963033+0000","last_became_peered":"2024-09-10T23:24:23.963033+0000","last_unstale":"2024-09-10T23:24:24.988281+0000","last_undegraded":"2024-09-10T23:24:24.988281+0000","last_fullsized":"2024-09-10T23:24:24.988281+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:41.935990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.984797+0000","last_change":"2024-09-10T23:24:24.983276+0000","last_active":"2024-09-10T23:24:24.984797+0000","last_peered":"2024-09-10T23:24:24.984797+0000","last_clean":"2024-09-10T23:24:24.984797+0000","last_became_active":"2024-09-10T23:24:24.982903+0000","last_became_peered":"2024-09-10T23:24:24.982903+0000","last_unstale":"2024-09-10T23:24:24.984797+0000","last_undegraded":"2024-09-10T23:24:24.984797+0000","last_fullsized":"2024-09-10T23:24:24.984797+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:48.849597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.994187+0000","last_change":"2024-09-10T23:24:23.970975+0000","last_active":"2024-09-10T23:24:24.994187+0000","last_peered":"2024-09-10T23:24:24.994187+0000","last_clean":"2024-09-10T23:24:24.994187+0000","last_became_active":"2024-09-10T23:24:23.970731+0000","last_became_peered":"2024-09-10T23:24:23.970731+0000","last_unstale":"2024-09-10T23:24:24.994187+0000","last_undegraded":"2024-09-10T23:24:24.994187+0000","last_fullsized":"2024-09-10T23:24:24.994187+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:29:36.478392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981524+0000","last_change":"2024-09-10T23:24:24.976469+0000","last_active":"2024-09-10T23:24:24.981524+0000","last_peered":"2024-09-10T23:24:24.981524+0000","last_clean":"2024-09-10T23:24:24.981524+0000","last_became_active":"2024-09-10T23:24:24.972909+0000","last_became_peered":"2024-09-10T23:24:24.972909+0000","last_unstale":"2024-09-10T23:24:24.981524+0000","last_undegraded":"2024-09-10T23:24:24.981524+0000","last_fullsized":"2024-09-10T23:24:24.981524+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:31.860851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.988823+0000","last_change":"2024-09-10T23:24:23.966163+0000","last_active":"2024-09-10T23:24:24.988823+0000","last_peered":"2024-09-10T23:24:24.988823+0000","last_clean":"2024-09-10T23:24:24.988823+0000","last_became_active":"2024-09-10T23:24:23.965883+0000","last_became_peered":"2024-09-10T23:24:23.965883+0000","last_unstale":"2024-09-10T23:24:24.988823+0000","last_undegraded":"2024-09-10T23:24:24.988823+0000","last_fullsized":"2024-09-10T23:24:24.988823+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:34.676657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.975499+0000","last_change":"2024-09-10T23:24:24.974240+0000","last_active":"2024-09-10T23:24:24.975499+0000","last_peered":"2024-09-10T23:24:24.975499+0000","last_clean":"2024-09-10T23:24:24.975499+0000","last_became_active":"2024-09-10T23:24:24.973947+0000","last_became_peered":"2024-09-10T23:24:24.973947+0000","last_unstale":"2024-09-10T23:24:24.975499+0000","last_undegraded":"2024-09-10T23:24:24.975499+0000","last_fullsized":"2024-09-10T23:24:24.975499+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:48.038469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.991977+0000","last_change":"2024-09-10T23:24:23.966143+0000","last_active":"2024-09-10T23:24:24.991977+0000","last_peered":"2024-09-10T23:24:24.991977+0000","last_clean":"2024-09-10T23:24:24.991977+0000","last_became_active":"2024-09-10T23:24:23.965866+0000","last_became_peered":"2024-09-10T23:24:23.965866+0000","last_unstale":"2024-09-10T23:24:24.991977+0000","last_undegraded":"2024-09-10T23:24:24.991977+0000","last_fullsized":"2024-09-10T23:24:24.991977+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:44.795855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.976082+0000","last_change":"2024-09-10T23:24:24.966838+0000","last_active":"2024-09-10T23:24:24.976082+0000","last_peered":"2024-09-10T23:24:24.976082+0000","last_clean":"2024-09-10T23:24:24.976082+0000","last_became_active":"2024-09-10T23:24:24.966566+0000","last_became_peered":"2024-09-10T23:24:24.966566+0000","last_unstale":"2024-09-10T23:24:24.976082+0000","last_undegraded":"2024-09-10T23:24:24.976082+0000","last_fullsized":"2024-09-10T23:24:24.976082+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:04.269621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.995053+0000","last_change":"2024-09-10T23:24:23.968051+0000","last_active":"2024-09-10T23:24:24.995053+0000","last_peered":"2024-09-10T23:24:24.995053+0000","last_clean":"2024-09-10T23:24:24.995053+0000","last_became_active":"2024-09-10T23:24:23.967721+0000","last_became_peered":"2024-09-10T23:24:23.967721+0000","last_unstale":"2024-09-10T23:24:24.995053+0000","last_undegraded":"2024-09-10T23:24:24.995053+0000","last_fullsized":"2024-09-10T23:24:24.995053+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:21.260452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332775+0000","last_change":"2024-09-10T23:24:24.976443+0000","last_active":"2024-09-10T23:24:26.332775+0000","last_peered":"2024-09-10T23:24:26.332775+0000","last_clean":"2024-09-10T23:24:26.332775+0000","last_became_active":"2024-09-10T23:24:24.976148+0000","last_became_peered":"2024-09-10T23:24:24.976148+0000","last_unstale":"2024-09-10T23:24:26.332775+0000","last_undegraded":"2024-09-10T23:24:26.332775+0000","last_fullsized":"2024-09-10T23:24:26.332775+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:50.694920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.962961+0000","last_change":"2024-09-10T23:24:23.962846+0000","last_active":"2024-09-10T23:24:24.962961+0000","last_peered":"2024-09-10T23:24:24.962961+0000","last_clean":"2024-09-10T23:24:24.962961+0000","last_became_active":"2024-09-10T23:24:23.961213+0000","last_became_peered":"2024-09-10T23:24:23.961213+0000","last_unstale":"2024-09-10T23:24:24.962961+0000","last_undegraded":"2024-09-10T23:24:24.962961+0000","last_fullsized":"2024-09-10T23:24:24.962961+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:03.262416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.974086+0000","last_change":"2024-09-10T23:24:24.969900+0000","last_active":"2024-09-10T23:24:24.974086+0000","last_peered":"2024-09-10T23:24:24.974086+0000","last_clean":"2024-09-10T23:24:24.974086+0000","last_became_active":"2024-09-10T23:24:24.969599+0000","last_became_peered":"2024-09-10T23:24:24.969599+0000","last_unstale":"2024-09-10T23:24:24.974086+0000","last_undegraded":"2024-09-10T23:24:24.974086+0000","last_fullsized":"2024-09-10T23:24:24.974086+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:24.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.953288+0000","last_change":"2024-09-10T23:24:23.965405+0000","last_active":"2024-09-10T23:24:24.953288+0000","last_peered":"2024-09-10T23:24:24.953288+0000","last_clean":"2024-09-10T23:24:24.953288+0000","last_became_active":"2024-09-10T23:24:23.965134+0000","last_became_peered":"2024-09-10T23:24:23.965134+0000","last_unstale":"2024-09-10T23:24:24.953288+0000","last_undegraded":"2024-09-10T23:24:24.953288+0000","last_fullsized":"2024-09-10T23:24:24.953288+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:15.822085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.983801+0000","last_change":"2024-09-10T23:24:24.974858+0000","last_active":"2024-09-10T23:24:25.983801+0000","last_peered":"2024-09-10T23:24:25.983801+0000","last_clean":"2024-09-10T23:24:25.983801+0000","last_became_active":"2024-09-10T23:24:24.974547+0000","last_became_peered":"2024-09-10T23:24:24.974547+0000","last_unstale":"2024-09-10T23:24:25.983801+0000","last_undegraded":"2024-09-10T23:24:25.983801+0000","last_fullsized":"2024-09-10T23:24:25.983801+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:44.945239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.984005+0000","last_change":"2024-09-10T23:24:23.963479+0000","last_active":"2024-09-10T23:24:25.984005+0000","last_peered":"2024-09-10T23:24:25.984005+0000","last_clean":"2024-09-10T23:24:25.984005+0000","last_became_active":"2024-09-10T23:24:23.962924+0000","last_became_peered":"2024-09-10T23:24:23.962924+0000","last_unstale":"2024-09-10T23:24:25.984005+0000","last_undegraded":"2024-09-10T23:24:25.984005+0000","last_fullsized":"2024-09-10T23:24:25.984005+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:03.262416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979263+0000","last_change":"2024-09-10T23:24:24.974467+0000","last_active":"2024-09-10T23:24:24.979263+0000","last_peered":"2024-09-10T23:24:24.979263+0000","last_clean":"2024-09-10T23:24:24.979263+0000","last_became_active":"2024-09-10T23:24:24.974194+0000","last_became_peered":"2024-09-10T23:24:24.974194+0000","last_unstale":"2024-09-10T23:24:24.979263+0000","last_undegraded":"2024-09-10T23:24:24.979263+0000","last_fullsized":"2024-09-10T23:24:24.979263+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:25.935101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.964345+0000","last_change":"2024-09-10T23:24:23.966191+0000","last_active":"2024-09-10T23:24:24.964345+0000","last_peered":"2024-09-10T23:24:24.964345+0000","last_clean":"2024-09-10T23:24:24.964345+0000","last_became_active":"2024-09-10T23:24:23.965666+0000","last_became_peered":"2024-09-10T23:24:23.965666+0000","last_unstale":"2024-09-10T23:24:24.964345+0000","last_undegraded":"2024-09-10T23:24:24.964345+0000","last_fullsized":"2024-09-10T23:24:24.964345+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:11.168335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332991+0000","last_change":"2024-09-10T23:24:24.973252+0000","last_active":"2024-09-10T23:24:26.332991+0000","last_peered":"2024-09-10T23:24:26.332991+0000","last_clean":"2024-09-10T23:24:26.332991+0000","last_became_active":"2024-09-10T23:24:24.972966+0000","last_became_peered":"2024-09-10T23:24:24.972966+0000","last_unstale":"2024-09-10T23:24:26.332991+0000","last_undegraded":"2024-09-10T23:24:26.332991+0000","last_fullsized":"2024-09-10T23:24:26.332991+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:33.826460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"132'3","reported_seq":16,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.991316+0000","last_change":"2024-09-10T23:24:23.965374+0000","last_active":"2024-09-10T23:24:24.991316+0000","last_peered":"2024-09-10T23:24:24.991316+0000","last_clean":"2024-09-10T23:24:24.991316+0000","last_became_active":"2024-09-10T23:24:23.965121+0000","last_became_peered":"2024-09-10T23:24:23.965121+0000","last_unstale":"2024-09-10T23:24:24.991316+0000","last_undegraded":"2024-09-10T23:24:24.991316+0000","last_fullsized":"2024-09-10T23:24:24.991316+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:10:20.508627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979404+0000","last_change":"2024-09-10T23:24:24.975981+0000","last_active":"2024-09-10T23:24:24.979404+0000","last_peered":"2024-09-10T23:24:24.979404+0000","last_clean":"2024-09-10T23:24:24.979404+0000","last_became_active":"2024-09-10T23:24:24.975733+0000","last_became_peered":"2024-09-10T23:24:24.975733+0000","last_unstale":"2024-09-10T23:24:24.979404+0000","last_undegraded":"2024-09-10T23:24:24.979404+0000","last_fullsized":"2024-09-10T23:24:24.979404+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:28.493627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"132'6","reported_seq":21,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332594+0000","last_change":"2024-09-10T23:24:23.957523+0000","last_active":"2024-09-10T23:24:26.332594+0000","last_peered":"2024-09-10T23:24:26.332594+0000","last_clean":"2024-09-10T23:24:26.332594+0000","last_became_active":"2024-09-10T23:24:23.957206+0000","last_became_peered":"2024-09-10T23:24:23.957206+0000","last_unstale":"2024-09-10T23:24:26.332594+0000","last_undegraded":"2024-09-10T23:24:26.332594+0000","last_fullsized":"2024-09-10T23:24:26.332594+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:26.648109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.983984+0000","last_change":"2024-09-10T23:24:24.979639+0000","last_active":"2024-09-10T23:24:25.983984+0000","last_peered":"2024-09-10T23:24:25.983984+0000","last_clean":"2024-09-10T23:24:25.983984+0000","last_became_active":"2024-09-10T23:24:24.971590+0000","last_became_peered":"2024-09-10T23:24:24.971590+0000","last_unstale":"2024-09-10T23:24:25.983984+0000","last_undegraded":"2024-09-10T23:24:25.983984+0000","last_fullsized":"2024-09-10T23:24:25.983984+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:52.868641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"132'2","reported_seq":17,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332472+0000","last_change":"2024-09-10T23:24:23.965218+0000","last_active":"2024-09-10T23:24:26.332472+0000","last_peered":"2024-09-10T23:24:26.332472+0000","last_clean":"2024-09-10T23:24:26.332472+0000","last_became_active":"2024-09-10T23:24:23.964928+0000","last_became_peered":"2024-09-10T23:24:23.964928+0000","last_unstale":"2024-09-10T23:24:26.332472+0000","last_undegraded":"2024-09-10T23:24:26.332472+0000","last_fullsized":"2024-09-10T23:24:26.332472+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:17.013997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.972657+0000","last_change":"2024-09-10T23:24:24.969406+0000","last_active":"2024-09-10T23:24:24.972657+0000","last_peered":"2024-09-10T23:24:24.972657+0000","last_clean":"2024-09-10T23:24:24.972657+0000","last_became_active":"2024-09-10T23:24:24.969106+0000","last_became_peered":"2024-09-10T23:24:24.969106+0000","last_unstale":"2024-09-10T23:24:24.972657+0000","last_undegraded":"2024-09-10T23:24:24.972657+0000","last_fullsized":"2024-09-10T23:24:24.972657+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:48.308092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332848+0000","last_change":"2024-09-10T23:24:23.962630+0000","last_active":"2024-09-10T23:24:26.332848+0000","last_peered":"2024-09-10T23:24:26.332848+0000","last_clean":"2024-09-10T23:24:26.332848+0000","last_became_active":"2024-09-10T23:24:23.962295+0000","last_became_peered":"2024-09-10T23:24:23.962295+0000","last_unstale":"2024-09-10T23:24:26.332848+0000","last_undegraded":"2024-09-10T23:24:26.332848+0000","last_fullsized":"2024-09-10T23:24:26.332848+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:06:00.157461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979564+0000","last_change":"2024-09-10T23:24:24.971404+0000","last_active":"2024-09-10T23:24:24.979564+0000","last_peered":"2024-09-10T23:24:24.979564+0000","last_clean":"2024-09-10T23:24:24.979564+0000","last_became_active":"2024-09-10T23:24:24.971096+0000","last_became_peered":"2024-09-10T23:24:24.971096+0000","last_unstale":"2024-09-10T23:24:24.979564+0000","last_undegraded":"2024-09-10T23:24:24.979564+0000","last_fullsized":"2024-09-10T23:24:24.979564+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:40:32.644985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332314+0000","last_change":"2024-09-10T23:24:23.961119+0000","last_active":"2024-09-10T23:24:26.332314+0000","last_peered":"2024-09-10T23:24:26.332314+0000","last_clean":"2024-09-10T23:24:26.332314+0000","last_became_active":"2024-09-10T23:24:23.958149+0000","last_became_peered":"2024-09-10T23:24:23.958149+0000","last_unstale":"2024-09-10T23:24:26.332314+0000","last_undegraded":"2024-09-10T23:24:26.332314+0000","last_fullsized":"2024-09-10T23:24:26.332314+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:57.876980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.987116+0000","last_change":"2024-09-10T23:24:24.986158+0000","last_active":"2024-09-10T23:24:24.987116+0000","last_peered":"2024-09-10T23:24:24.987116+0000","last_clean":"2024-09-10T23:24:24.987116+0000","last_became_active":"2024-09-10T23:24:24.985780+0000","last_became_peered":"2024-09-10T23:24:24.985780+0000","last_unstale":"2024-09-10T23:24:24.987116+0000","last_undegraded":"2024-09-10T23:24:24.987116+0000","last_fullsized":"2024-09-10T23:24:24.987116+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:58.986921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.990182+0000","last_change":"2024-09-10T23:24:23.962066+0000","last_active":"2024-09-10T23:24:24.990182+0000","last_peered":"2024-09-10T23:24:24.990182+0000","last_clean":"2024-09-10T23:24:24.990182+0000","last_became_active":"2024-09-10T23:24:23.961700+0000","last_became_peered":"2024-09-10T23:24:23.961700+0000","last_unstale":"2024-09-10T23:24:24.990182+0000","last_undegraded":"2024-09-10T23:24:24.990182+0000","last_fullsized":"2024-09-10T23:24:24.990182+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:07.100425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978187+0000","last_change":"2024-09-10T23:24:24.973296+0000","last_active":"2024-09-10T23:24:24.978187+0000","last_peered":"2024-09-10T23:24:24.978187+0000","last_clean":"2024-09-10T23:24:24.978187+0000","last_became_active":"2024-09-10T23:24:24.973005+0000","last_became_peered":"2024-09-10T23:24:24.973005+0000","last_unstale":"2024-09-10T23:24:24.978187+0000","last_undegraded":"2024-09-10T23:24:24.978187+0000","last_fullsized":"2024-09-10T23:24:24.978187+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:27.990438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.995299+0000","last_change":"2024-09-10T23:24:23.962667+0000","last_active":"2024-09-10T23:24:24.995299+0000","last_peered":"2024-09-10T23:24:24.995299+0000","last_clean":"2024-09-10T23:24:24.995299+0000","last_became_active":"2024-09-10T23:24:23.962402+0000","last_became_peered":"2024-09-10T23:24:23.962402+0000","last_unstale":"2024-09-10T23:24:24.995299+0000","last_undegraded":"2024-09-10T23:24:24.995299+0000","last_fullsized":"2024-09-10T23:24:24.995299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:37.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978617+0000","last_change":"2024-09-10T23:24:24.967890+0000","last_active":"2024-09-10T23:24:24.978617+0000","last_peered":"2024-09-10T23:24:24.978617+0000","last_clean":"2024-09-10T23:24:24.978617+0000","last_became_active":"2024-09-10T23:24:24.966933+0000","last_became_peered":"2024-09-10T23:24:24.966933+0000","last_unstale":"2024-09-10T23:24:24.978617+0000","last_undegraded":"2024-09-10T23:24:24.978617+0000","last_fullsized":"2024-09-10T23:24:24.978617+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:39:42.271595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"132'1","reported_seq":14,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.992183+0000","last_change":"2024-09-10T23:24:23.969219+0000","last_active":"2024-09-10T23:24:24.992183+0000","last_peered":"2024-09-10T23:24:24.992183+0000","last_clean":"2024-09-10T23:24:24.992183+0000","last_became_active":"2024-09-10T23:24:23.968480+0000","last_became_peered":"2024-09-10T23:24:23.968480+0000","last_unstale":"2024-09-10T23:24:24.992183+0000","last_undegraded":"2024-09-10T23:24:24.992183+0000","last_fullsized":"2024-09-10T23:24:24.992183+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:44.912192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.979376+0000","last_change":"2024-09-10T23:24:24.975371+0000","last_active":"2024-09-10T23:24:24.979376+0000","last_peered":"2024-09-10T23:24:24.979376+0000","last_clean":"2024-09-10T23:24:24.979376+0000","last_became_active":"2024-09-10T23:24:24.975123+0000","last_became_peered":"2024-09-10T23:24:24.975123+0000","last_unstale":"2024-09-10T23:24:24.979376+0000","last_undegraded":"2024-09-10T23:24:24.979376+0000","last_fullsized":"2024-09-10T23:24:24.979376+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:01.744825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.965299+0000","last_change":"2024-09-10T23:24:23.973661+0000","last_active":"2024-09-10T23:24:24.965299+0000","last_peered":"2024-09-10T23:24:24.965299+0000","last_clean":"2024-09-10T23:24:24.965299+0000","last_became_active":"2024-09-10T23:24:23.973402+0000","last_became_peered":"2024-09-10T23:24:23.973402+0000","last_unstale":"2024-09-10T23:24:24.965299+0000","last_undegraded":"2024-09-10T23:24:24.965299+0000","last_fullsized":"2024-09-10T23:24:24.965299+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:51.861436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.978695+0000","last_change":"2024-09-10T23:24:24.968412+0000","last_active":"2024-09-10T23:24:24.978695+0000","last_peered":"2024-09-10T23:24:24.978695+0000","last_clean":"2024-09-10T23:24:24.978695+0000","last_became_active":"2024-09-10T23:24:24.968102+0000","last_became_peered":"2024-09-10T23:24:24.968102+0000","last_unstale":"2024-09-10T23:24:24.978695+0000","last_undegraded":"2024-09-10T23:24:24.978695+0000","last_fullsized":"2024-09-10T23:24:24.978695+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:27.076969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.995781+0000","last_change":"2024-09-10T23:24:23.966289+0000","last_active":"2024-09-10T23:24:24.995781+0000","last_peered":"2024-09-10T23:24:24.995781+0000","last_clean":"2024-09-10T23:24:24.995781+0000","last_became_active":"2024-09-10T23:24:23.966017+0000","last_became_peered":"2024-09-10T23:24:23.966017+0000","last_unstale":"2024-09-10T23:24:24.995781+0000","last_undegraded":"2024-09-10T23:24:24.995781+0000","last_fullsized":"2024-09-10T23:24:24.995781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:07.571487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332070+0000","last_change":"2024-09-10T23:24:24.980434+0000","last_active":"2024-09-10T23:24:26.332070+0000","last_peered":"2024-09-10T23:24:26.332070+0000","last_clean":"2024-09-10T23:24:26.332070+0000","last_became_active":"2024-09-10T23:24:24.980176+0000","last_became_peered":"2024-09-10T23:24:24.980176+0000","last_unstale":"2024-09-10T23:24:26.332070+0000","last_undegraded":"2024-09-10T23:24:26.332070+0000","last_fullsized":"2024-09-10T23:24:26.332070+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:43.523002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.966612+0000","last_change":"2024-09-10T23:24:23.968813+0000","last_active":"2024-09-10T23:24:24.966612+0000","last_peered":"2024-09-10T23:24:24.966612+0000","last_clean":"2024-09-10T23:24:24.966612+0000","last_became_active":"2024-09-10T23:24:23.967935+0000","last_became_peered":"2024-09-10T23:24:23.967935+0000","last_unstale":"2024-09-10T23:24:24.966612+0000","last_undegraded":"2024-09-10T23:24:24.966612+0000","last_fullsized":"2024-09-10T23:24:24.966612+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:49.899503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332892+0000","last_change":"2024-09-10T23:24:24.984295+0000","last_active":"2024-09-10T23:24:26.332892+0000","last_peered":"2024-09-10T23:24:26.332892+0000","last_clean":"2024-09-10T23:24:26.332892+0000","last_became_active":"2024-09-10T23:24:24.983644+0000","last_became_peered":"2024-09-10T23:24:24.983644+0000","last_unstale":"2024-09-10T23:24:26.332892+0000","last_undegraded":"2024-09-10T23:24:26.332892+0000","last_fullsized":"2024-09-10T23:24:26.332892+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:36.093613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332336+0000","last_change":"2024-09-10T23:24:23.959230+0000","last_active":"2024-09-10T23:24:26.332336+0000","last_peered":"2024-09-10T23:24:26.332336+0000","last_clean":"2024-09-10T23:24:26.332336+0000","last_became_active":"2024-09-10T23:24:23.958785+0000","last_became_peered":"2024-09-10T23:24:23.958785+0000","last_unstale":"2024-09-10T23:24:26.332336+0000","last_undegraded":"2024-09-10T23:24:26.332336+0000","last_fullsized":"2024-09-10T23:24:26.332336+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:21.459799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.980359+0000","last_change":"2024-09-10T23:24:24.976727+0000","last_active":"2024-09-10T23:24:24.980359+0000","last_peered":"2024-09-10T23:24:24.980359+0000","last_clean":"2024-09-10T23:24:24.980359+0000","last_became_active":"2024-09-10T23:24:24.976447+0000","last_became_peered":"2024-09-10T23:24:24.976447+0000","last_unstale":"2024-09-10T23:24:24.980359+0000","last_undegraded":"2024-09-10T23:24:24.980359+0000","last_fullsized":"2024-09-10T23:24:24.980359+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:08.154933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.964522+0000","last_change":"2024-09-10T23:24:23.969426+0000","last_active":"2024-09-10T23:24:24.964522+0000","last_peered":"2024-09-10T23:24:24.964522+0000","last_clean":"2024-09-10T23:24:24.964522+0000","last_became_active":"2024-09-10T23:24:23.968899+0000","last_became_peered":"2024-09-10T23:24:23.968899+0000","last_unstale":"2024-09-10T23:24:24.964522+0000","last_undegraded":"2024-09-10T23:24:24.964522+0000","last_fullsized":"2024-09-10T23:24:24.964522+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:18.535651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.980426+0000","last_change":"2024-09-10T23:24:24.969139+0000","last_active":"2024-09-10T23:24:24.980426+0000","last_peered":"2024-09-10T23:24:24.980426+0000","last_clean":"2024-09-10T23:24:24.980426+0000","last_became_active":"2024-09-10T23:24:24.968063+0000","last_became_peered":"2024-09-10T23:24:24.968063+0000","last_unstale":"2024-09-10T23:24:24.980426+0000","last_undegraded":"2024-09-10T23:24:24.980426+0000","last_fullsized":"2024-09-10T23:24:24.980426+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:37.586152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"132'2","reported_seq":15,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.994870+0000","last_change":"2024-09-10T23:24:23.948687+0000","last_active":"2024-09-10T23:24:24.994870+0000","last_peered":"2024-09-10T23:24:24.994870+0000","last_clean":"2024-09-10T23:24:24.994870+0000","last_became_active":"2024-09-10T23:24:23.948379+0000","last_became_peered":"2024-09-10T23:24:23.948379+0000","last_unstale":"2024-09-10T23:24:24.994870+0000","last_undegraded":"2024-09-10T23:24:24.994870+0000","last_fullsized":"2024-09-10T23:24:24.994870+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:27.984877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.974134+0000","last_change":"2024-09-10T23:24:24.972239+0000","last_active":"2024-09-10T23:24:24.974134+0000","last_peered":"2024-09-10T23:24:24.974134+0000","last_clean":"2024-09-10T23:24:24.974134+0000","last_became_active":"2024-09-10T23:24:24.971887+0000","last_became_peered":"2024-09-10T23:24:24.971887+0000","last_unstale":"2024-09-10T23:24:24.974134+0000","last_undegraded":"2024-09-10T23:24:24.974134+0000","last_fullsized":"2024-09-10T23:24:24.974134+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:34.860106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"133'1","reported_seq":16,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.985241+0000","last_change":"2024-09-10T23:24:23.964410+0000","last_active":"2024-09-10T23:24:25.985241+0000","last_peered":"2024-09-10T23:24:25.985241+0000","last_clean":"2024-09-10T23:24:25.985241+0000","last_became_active":"2024-09-10T23:24:23.962333+0000","last_became_peered":"2024-09-10T23:24:23.962333+0000","last_unstale":"2024-09-10T23:24:25.985241+0000","last_undegraded":"2024-09-10T23:24:25.985241+0000","last_fullsized":"2024-09-10T23:24:25.985241+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:11.168335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981536+0000","last_change":"2024-09-10T23:24:24.975955+0000","last_active":"2024-09-10T23:24:24.981536+0000","last_peered":"2024-09-10T23:24:24.981536+0000","last_clean":"2024-09-10T23:24:24.981536+0000","last_became_active":"2024-09-10T23:24:24.975688+0000","last_became_peered":"2024-09-10T23:24:24.975688+0000","last_unstale":"2024-09-10T23:24:24.981536+0000","last_undegraded":"2024-09-10T23:24:24.981536+0000","last_fullsized":"2024-09-10T23:24:24.981536+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:26.950051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":15,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:25.984061+0000","last_change":"2024-09-10T23:24:23.962655+0000","last_active":"2024-09-10T23:24:25.984061+0000","last_peered":"2024-09-10T23:24:25.984061+0000","last_clean":"2024-09-10T23:24:25.984061+0000","last_became_active":"2024-09-10T23:24:23.962306+0000","last_became_peered":"2024-09-10T23:24:23.962306+0000","last_unstale":"2024-09-10T23:24:25.984061+0000","last_undegraded":"2024-09-10T23:24:25.984061+0000","last_fullsized":"2024-09-10T23:24:25.984061+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:26.983232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.984828+0000","last_change":"2024-09-10T23:24:24.978717+0000","last_active":"2024-09-10T23:24:24.984828+0000","last_peered":"2024-09-10T23:24:24.984828+0000","last_clean":"2024-09-10T23:24:24.984828+0000","last_became_active":"2024-09-10T23:24:24.978403+0000","last_became_peered":"2024-09-10T23:24:24.978403+0000","last_unstale":"2024-09-10T23:24:24.984828+0000","last_undegraded":"2024-09-10T23:24:24.984828+0000","last_fullsized":"2024-09-10T23:24:24.984828+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:30.299185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.953485+0000","last_change":"2024-09-10T23:24:23.964520+0000","last_active":"2024-09-10T23:24:24.953485+0000","last_peered":"2024-09-10T23:24:24.953485+0000","last_clean":"2024-09-10T23:24:24.953485+0000","last_became_active":"2024-09-10T23:24:23.964244+0000","last_became_peered":"2024-09-10T23:24:23.964244+0000","last_unstale":"2024-09-10T23:24:24.953485+0000","last_undegraded":"2024-09-10T23:24:24.953485+0000","last_fullsized":"2024-09-10T23:24:24.953485+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:42.230993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.960442+0000","last_change":"2024-09-10T23:24:24.956789+0000","last_active":"2024-09-10T23:24:24.960442+0000","last_peered":"2024-09-10T23:24:24.960442+0000","last_clean":"2024-09-10T23:24:24.960442+0000","last_became_active":"2024-09-10T23:24:24.956141+0000","last_became_peered":"2024-09-10T23:24:24.956141+0000","last_unstale":"2024-09-10T23:24:24.960442+0000","last_undegraded":"2024-09-10T23:24:24.960442+0000","last_fullsized":"2024-09-10T23:24:24.960442+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:29.154457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.960033+0000","last_change":"2024-09-10T23:24:23.965478+0000","last_active":"2024-09-10T23:24:24.960033+0000","last_peered":"2024-09-10T23:24:24.960033+0000","last_clean":"2024-09-10T23:24:24.960033+0000","last_became_active":"2024-09-10T23:24:23.965175+0000","last_became_peered":"2024-09-10T23:24:23.965175+0000","last_unstale":"2024-09-10T23:24:24.960033+0000","last_undegraded":"2024-09-10T23:24:24.960033+0000","last_fullsized":"2024-09-10T23:24:24.960033+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:09.413814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.332276+0000","last_change":"2024-09-10T23:24:24.974640+0000","last_active":"2024-09-10T23:24:26.332276+0000","last_peered":"2024-09-10T23:24:26.332276+0000","last_clean":"2024-09-10T23:24:26.332276+0000","last_became_active":"2024-09-10T23:24:24.974325+0000","last_became_peered":"2024-09-10T23:24:24.974325+0000","last_unstale":"2024-09-10T23:24:26.332276+0000","last_undegraded":"2024-09-10T23:24:26.332276+0000","last_fullsized":"2024-09-10T23:24:26.332276+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:02:37.611167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.959207+0000","last_change":"2024-09-10T23:24:23.959882+0000","last_active":"2024-09-10T23:24:24.959207+0000","last_peered":"2024-09-10T23:24:24.959207+0000","last_clean":"2024-09-10T23:24:24.959207+0000","last_became_active":"2024-09-10T23:24:23.959592+0000","last_became_peered":"2024-09-10T23:24:23.959592+0000","last_unstale":"2024-09-10T23:24:24.959207+0000","last_undegraded":"2024-09-10T23:24:24.959207+0000","last_fullsized":"2024-09-10T23:24:24.959207+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:47.031263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.986099+0000","last_change":"2024-09-10T23:24:24.985293+0000","last_active":"2024-09-10T23:24:24.986099+0000","last_peered":"2024-09-10T23:24:24.986099+0000","last_clean":"2024-09-10T23:24:24.986099+0000","last_became_active":"2024-09-10T23:24:24.984930+0000","last_became_peered":"2024-09-10T23:24:24.984930+0000","last_unstale":"2024-09-10T23:24:24.986099+0000","last_undegraded":"2024-09-10T23:24:24.986099+0000","last_fullsized":"2024-09-10T23:24:24.986099+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:06:34.104665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.953632+0000","last_change":"2024-09-10T23:24:23.964310+0000","last_active":"2024-09-10T23:24:24.953632+0000","last_peered":"2024-09-10T23:24:24.953632+0000","last_clean":"2024-09-10T23:24:24.953632+0000","last_became_active":"2024-09-10T23:24:23.964042+0000","last_became_peered":"2024-09-10T23:24:23.964042+0000","last_unstale":"2024-09-10T23:24:24.953632+0000","last_undegraded":"2024-09-10T23:24:24.953632+0000","last_fullsized":"2024-09-10T23:24:24.953632+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:44.260643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.974118+0000","last_change":"2024-09-10T23:24:24.972149+0000","last_active":"2024-09-10T23:24:24.974118+0000","last_peered":"2024-09-10T23:24:24.974118+0000","last_clean":"2024-09-10T23:24:24.974118+0000","last_became_active":"2024-09-10T23:24:24.971808+0000","last_became_peered":"2024-09-10T23:24:24.971808+0000","last_unstale":"2024-09-10T23:24:24.974118+0000","last_undegraded":"2024-09-10T23:24:24.974118+0000","last_fullsized":"2024-09-10T23:24:24.974118+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:30.595705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.964713+0000","last_change":"2024-09-10T23:24:23.969129+0000","last_active":"2024-09-10T23:24:24.964713+0000","last_peered":"2024-09-10T23:24:24.964713+0000","last_clean":"2024-09-10T23:24:24.964713+0000","last_became_active":"2024-09-10T23:24:23.966876+0000","last_became_peered":"2024-09-10T23:24:23.966876+0000","last_unstale":"2024-09-10T23:24:24.964713+0000","last_undegraded":"2024-09-10T23:24:24.964713+0000","last_fullsized":"2024-09-10T23:24:24.964713+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:43.938034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.981119+0000","last_change":"2024-09-10T23:24:24.975832+0000","last_active":"2024-09-10T23:24:24.981119+0000","last_peered":"2024-09-10T23:24:24.981119+0000","last_clean":"2024-09-10T23:24:24.981119+0000","last_became_active":"2024-09-10T23:24:24.972596+0000","last_became_peered":"2024-09-10T23:24:24.972596+0000","last_unstale":"2024-09-10T23:24:24.981119+0000","last_undegraded":"2024-09-10T23:24:24.981119+0000","last_fullsized":"2024-09-10T23:24:24.981119+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:23.933058+0000","last_clean_scrub_stamp":"2024-09-10T23:24:23.933058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:20.856924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"132'8","reported_seq":23,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-10T23:24:26.331952+0000","last_change":"2024-09-10T23:24:23.964055+0000","last_active":"2024-09-10T23:24:26.331952+0000","last_peered":"2024-09-10T23:24:26.331952+0000","last_clean":"2024-09-10T23:24:26.331952+0000","last_became_active":"2024-09-10T23:24:23.963812+0000","last_became_peered":"2024-09-10T23:24:23.963812+0000","last_unstale":"2024-09-10T23:24:26.331952+0000","last_undegraded":"2024-09-10T23:24:26.331952+0000","last_fullsized":"2024-09-10T23:24:26.331952+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:24:22.925853+0000","last_clean_scrub_stamp":"2024-09-10T23:24:22.925853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:19.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":307,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-10T23:24:24.964850+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:24:24.964850+0000","last_peered":"2024-09-10T23:24:24.964850+0000","last_clean":"2024-09-10T23:24:24.964850+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:24:24.964850+0000","last_undegraded":"2024-09-10T23:24:24.964850+0000","last_fullsized":"2024-09-10T23:24:24.964850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476847,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63336,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308504,"statfs":{"total":96636764160,"available":96571908096,"internally_reserved":0,"allocated":1650688,"data_stored":774290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509552,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2215936,"data_stored":1350217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54984,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316856,"statfs":{"total":96636764160,"available":96580460544,"internally_reserved":0,"allocated":1622016,"data_stored":759849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509552,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64712,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94307128,"statfs":{"total":96636764160,"available":96570499072,"internally_reserved":0,"allocated":1622016,"data_stored":759849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68868,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302972,"statfs":{"total":96636764160,"available":96566243328,"internally_reserved":0,"allocated":1622016,"data_stored":759849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1638400,"data_stored":767038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509551,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69452,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302388,"statfs":{"total":96636764160,"available":96565645312,"internally_reserved":0,"allocated":2215936,"data_stored":1350217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59188,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312652,"statfs":{"total":96636764160,"available":96576155648,"internally_reserved":0,"allocated":1662976,"data_stored":775354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:24:29.517 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:24:29.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:24:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 -- 172.21.15.17:0/4283159858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e0003c90 msgr2=0x7fa6e0004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 --2- 172.21.15.17:0/4283159858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e0003c90 0x7fa6e0004090 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00c2e0 tx=0x7fa6ec01cde0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 -- 172.21.15.17:0/4283159858 shutdown_connections 2024-09-10T23:24:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 --2- 172.21.15.17:0/4283159858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e0003c90 0x7fa6e0004090 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 -- 172.21.15.17:0/4283159858 >> 172.21.15.17:0/4283159858 conn(0x7fa6f80b17a0 msgr2=0x7fa6f80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 -- 172.21.15.17:0/4283159858 shutdown_connections 2024-09-10T23:24:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 -- 172.21.15.17:0/4283159858 wait complete. 2024-09-10T23:24:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 Processor -- start 2024-09-10T23:24:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 -- start start 2024-09-10T23:24:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e0003c90 0x7fa6f813c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6f813d340 0x7fa6f81fafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6f813d7c0 0x7fa6f81fb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f80733f0 con 0x7fa6f813d7c0 2024-09-10T23:24:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f8073270 con 0x7fa6e0003c90 2024-09-10T23:24:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6ffe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f8073570 con 0x7fa6f813d340 2024-09-10T23:24:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6fde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6f813d7c0 0x7fa6f81fb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6fde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6f813d7c0 0x7fa6f81fb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39768/0 (socket says 172.21.15.17:39768) 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.707+0000 7fa6fde00640 1 -- 172.21.15.17:0/2039788312 learned_addr learned my addr 172.21.15.17:0/2039788312 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6fd400640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e0003c90 0x7fa6f813c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6fca00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6f813d340 0x7fa6f81fafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6fde00640 1 -- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6f813d340 msgr2=0x7fa6f81fafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6fde00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6f813d340 0x7fa6f81fafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6fde00640 1 -- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e0003c90 msgr2=0x7fa6f813c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6fde00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e0003c90 0x7fa6f813c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6fde00640 1 -- 172.21.15.17:0/2039788312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f813f4b0 con 0x7fa6f813d7c0 2024-09-10T23:24:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6fde00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6f813d7c0 0x7fa6f81fb500 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fa6f806e610 tx=0x7fa6f0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6f5600640 1 -- 172.21.15.17:0/2039788312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0015070 con 0x7fa6f813d7c0 2024-09-10T23:24:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6f5600640 1 -- 172.21.15.17:0/2039788312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6f0011920 con 0x7fa6f813d7c0 2024-09-10T23:24:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6f5600640 1 -- 172.21.15.17:0/2039788312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0011d70 con 0x7fa6f813d7c0 2024-09-10T23:24:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f813f790 con 0x7fa6f813d7c0 2024-09-10T23:24:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f813f180 con 0x7fa6f813d7c0 2024-09-10T23:24:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f815c130 con 0x7fa6f813d7c0 2024-09-10T23:24:29.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.711+0000 7fa6f5600640 1 -- 172.21.15.17:0/2039788312 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa6f0010420 con 0x7fa6f813d7c0 2024-09-10T23:24:29.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.715+0000 7fa6f5600640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6d80725e0 0x7fa6d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:29.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.715+0000 7fa6f5600640 1 -- 172.21.15.17:0/2039788312 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fa6f0093fe0 con 0x7fa6f813d7c0 2024-09-10T23:24:29.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.715+0000 7fa6fd400640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6d80725e0 0x7fa6d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.715+0000 7fa6fd400640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6d80725e0 0x7fa6d8074aa0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0ab000 tx=0x7fa6ec019c20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.719+0000 7fa6f5600640 1 -- 172.21.15.17:0/2039788312 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa6f005eed0 con 0x7fa6f813d7c0 2024-09-10T23:24:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.951+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa6f8075750 con 0x7fa6f813d7c0 2024-09-10T23:24:29.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6f5600640 1 -- 172.21.15.17:0/2039788312 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7fa6f0063900 con 0x7fa6f813d7c0 2024-09-10T23:24:29.957 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:24:29.957 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:24:29.957 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:24:29.957 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:24:29.957 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:24:29.958 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:24:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6d80725e0 msgr2=0x7fa6d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6d80725e0 0x7fa6d8074aa0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec0ab000 tx=0x7fa6ec019c20 comp rx=0 tx=0).stop 2024-09-10T23:24:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6f813d7c0 msgr2=0x7fa6f81fb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6f813d7c0 0x7fa6f81fb500 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fa6f806e610 tx=0x7fa6f0003f90 comp rx=0 tx=0).stop 2024-09-10T23:24:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 shutdown_connections 2024-09-10T23:24:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6d80725e0 0x7fa6d8074aa0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6f813d7c0 0x7fa6f81fb500 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6f813d340 0x7fa6f81fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 --2- 172.21.15.17:0/2039788312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6e0003c90 0x7fa6f813c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 >> 172.21.15.17:0/2039788312 conn(0x7fa6f80b17a0 msgr2=0x7fa6f815d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 shutdown_connections 2024-09-10T23:24:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:29.955+0000 7fa6ffe00640 1 -- 172.21.15.17:0/2039788312 wait complete. 2024-09-10T23:24:29.978 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 -- 172.21.15.17:0/1196312579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 msgr2=0x7ff1040b1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 --2- 172.21.15.17:0/1196312579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 0x7ff1040b1b50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff1040b3010 tx=0x7ff0fc01f560 comp rx=0 tx=0).stop 2024-09-10T23:24:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 -- 172.21.15.17:0/1196312579 shutdown_connections 2024-09-10T23:24:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 --2- 172.21.15.17:0/1196312579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 0x7ff1040b1b50 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 --2- 172.21.15.17:0/1196312579 >> v2:172.21.15.77:3300/0 conn(0x7ff1040d2830 0x7ff1040b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 -- 172.21.15.17:0/1196312579 >> 172.21.15.17:0/1196312579 conn(0x7ff1040d1d10 msgr2=0x7ff1040d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 -- 172.21.15.17:0/1196312579 shutdown_connections 2024-09-10T23:24:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 -- 172.21.15.17:0/1196312579 wait complete. 2024-09-10T23:24:30.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 Processor -- start 2024-09-10T23:24:30.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 -- start start 2024-09-10T23:24:30.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 0x7ff1040c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1040d2830 0x7ff1040c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff104160280 0x7ff1041f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1041608d0 con 0x7ff1040d0200 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040b07c0 con 0x7ff104160280 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff10a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1040b2090 con 0x7ff1040d2830 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff103400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 0x7ff1040c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff103400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 0x7ff1040c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39784/0 (socket says 172.21.15.17:39784) 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.123+0000 7ff103400640 1 -- 172.21.15.17:0/2411176668 learned_addr learned my addr 172.21.15.17:0/2411176668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff0fbe00640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1040d2830 0x7ff1040c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff103e00640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff104160280 0x7ff1041f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff103400640 1 -- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1040d2830 msgr2=0x7ff1040c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff103400640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1040d2830 0x7ff1040c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff103400640 1 -- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff104160280 msgr2=0x7ff1041f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff103400640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff104160280 0x7ff1041f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff103400640 1 -- 172.21.15.17:0/2411176668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1040c7710 con 0x7ff1040d0200 2024-09-10T23:24:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff103400640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 0x7ff1040c5a60 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4001ec0 tx=0x7ff0f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff0fb400640 1 -- 172.21.15.17:0/2411176668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4017070 con 0x7ff1040d0200 2024-09-10T23:24:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff0fb400640 1 -- 172.21.15.17:0/2411176668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0f4003600 con 0x7ff1040d0200 2024-09-10T23:24:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1040c79b0 con 0x7ff1040d0200 2024-09-10T23:24:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff0fb400640 1 -- 172.21.15.17:0/2411176668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4003a50 con 0x7ff1040d0200 2024-09-10T23:24:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1040c7f70 con 0x7ff1040d0200 2024-09-10T23:24:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1040b25b0 con 0x7ff1040d0200 2024-09-10T23:24:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff0fb400640 1 -- 172.21.15.17:0/2411176668 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff0f4003bf0 con 0x7ff1040d0200 2024-09-10T23:24:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff0fb400640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0e00725e0 0x7ff0e0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.127+0000 7ff0fb400640 1 -- 172.21.15.17:0/2411176668 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7ff0f4092a00 con 0x7ff1040d0200 2024-09-10T23:24:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.131+0000 7ff0fbe00640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0e00725e0 0x7ff0e0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.131+0000 7ff0fbe00640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0e00725e0 0x7ff0e0074aa0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0058d0 tx=0x7ff0ec005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.131+0000 7ff0fb400640 1 -- 172.21.15.17:0/2411176668 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff0f405df50 con 0x7ff1040d0200 2024-09-10T23:24:30.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.339+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff104074af0 con 0x7ff1040d0200 2024-09-10T23:24:30.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff0fb400640 1 -- 172.21.15.17:0/2411176668 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5222 (secure 0 0 0) 0x7ff0f405d850 con 0x7ff1040d0200 2024-09-10T23:24:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:30.344 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":95,"btime":"2024-09-10T23:24:27:975406+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4055700220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4055700220},{"type":"v1","addr":"172.21.15.77:6836","nonce":4055700220}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2576092770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2576092770},{"type":"v1","addr":"172.21.15.77:6837","nonce":2576092770}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3395065105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3395065105},{"type":"v1","addr":"172.21.15.17:6834","nonce":3395065105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:24:24.355056+0000","modified":"2024-09-10T23:24:27.384443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8238":{"gid":8238,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/884432446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":884432446},{"type":"v1","addr":"172.21.15.17:6835","nonce":884432446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":8}]} 2024-09-10T23:24:30.344 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 95 2024-09-10T23:24:30.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0e00725e0 msgr2=0x7ff0e0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0e00725e0 0x7ff0e0074aa0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0058d0 tx=0x7ff0ec005860 comp rx=0 tx=0).stop 2024-09-10T23:24:30.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 msgr2=0x7ff1040c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 0x7ff1040c5a60 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4001ec0 tx=0x7ff0f400c890 comp rx=0 tx=0).stop 2024-09-10T23:24:30.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 shutdown_connections 2024-09-10T23:24:30.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0e00725e0 0x7ff0e0074aa0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff104160280 0x7ff1041f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1040d2830 0x7ff1040c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 --2- 172.21.15.17:0/2411176668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1040d0200 0x7ff1040c5a60 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 >> 172.21.15.17:0/2411176668 conn(0x7ff1040d1d10 msgr2=0x7ff1040b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 shutdown_connections 2024-09-10T23:24:30.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.343+0000 7ff10a000640 1 -- 172.21.15.17:0/2411176668 wait complete. 2024-09-10T23:24:30.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:24:24.355056+0000', 'modified': '2024-09-10T23:24:27.384443+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8238}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8238': {'gid': 8238, 'name': 'a', 'rank': 0, 'incarnation': 92, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/884432446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 884432446}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 884432446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8238, 'qdb_cluster': [8238]} 2024-09-10T23:24:30.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:24:30.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:24:30.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.915+0000 7fcaf6400640 1 -- 172.21.15.17:0/4221341865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf006ef80 msgr2=0x7fcaf00726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.915+0000 7fcaf6400640 1 --2- 172.21.15.17:0/4221341865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf006ef80 0x7fcaf00726f0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009bc0 tx=0x7fcae801d600 comp rx=0 tx=0).stop 2024-09-10T23:24:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.915+0000 7fcaf6400640 1 -- 172.21.15.17:0/4221341865 shutdown_connections 2024-09-10T23:24:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.915+0000 7fcaf6400640 1 --2- 172.21.15.17:0/4221341865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf006ef80 0x7fcaf00726f0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.915+0000 7fcaf6400640 1 -- 172.21.15.17:0/4221341865 >> 172.21.15.17:0/4221341865 conn(0x7fcaf00b1730 msgr2=0x7fcaf00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.915+0000 7fcaf6400640 1 -- 172.21.15.17:0/4221341865 shutdown_connections 2024-09-10T23:24:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.915+0000 7fcaf6400640 1 -- 172.21.15.17:0/4221341865 wait complete. 2024-09-10T23:24:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.915+0000 7fcaf6400640 1 Processor -- start 2024-09-10T23:24:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.915+0000 7fcaf6400640 1 -- start start 2024-09-10T23:24:30.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaf6400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf006ef80 0x7fcaf01f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaf6400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf00cf700 0x7fcaf0150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaf6400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcaf01546f0 0x7fcaf01575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaf6400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0168240 con 0x7fcaf00cf700 2024-09-10T23:24:30.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaf6400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf01680c0 con 0x7fcaf006ef80 2024-09-10T23:24:30.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaf6400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf01683c0 con 0x7fcaf01546f0 2024-09-10T23:24:30.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf00cf700 0x7fcaf0150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf00cf700 0x7fcaf0150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39800/0 (socket says 172.21.15.17:39800) 2024-09-10T23:24:30.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7e00640 1 -- 172.21.15.17:0/3719208670 learned_addr learned my addr 172.21.15.17:0/3719208670 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:30.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaef400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf006ef80 0x7fcaf01f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaefe00640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcaf01546f0 0x7fcaf01575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7e00640 1 -- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcaf01546f0 msgr2=0x7fcaf01575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7e00640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcaf01546f0 0x7fcaf01575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7e00640 1 -- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf006ef80 msgr2=0x7fcaf01f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7e00640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf006ef80 0x7fcaf01f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7e00640 1 -- 172.21.15.17:0/3719208670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf00cc780 con 0x7fcaf00cf700 2024-09-10T23:24:30.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7e00640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf00cf700 0x7fcaf0150b00 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c4b0 tx=0x7fcad800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7400640 1 -- 172.21.15.17:0/3719208670 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8016020 con 0x7fcaf00cf700 2024-09-10T23:24:30.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7400640 1 -- 172.21.15.17:0/3719208670 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcad8012920 con 0x7fcaf00cf700 2024-09-10T23:24:30.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7400640 1 -- 172.21.15.17:0/3719208670 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8012d90 con 0x7fcaf00cf700 2024-09-10T23:24:30.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaf6400640 1 -- 172.21.15.17:0/3719208670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf01f8100 con 0x7fcaf00cf700 2024-09-10T23:24:30.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcaf6400640 1 -- 172.21.15.17:0/3719208670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf01f86c0 con 0x7fcaf00cf700 2024-09-10T23:24:30.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.919+0000 7fcae7400640 1 -- 172.21.15.17:0/3719208670 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcad801a3b0 con 0x7fcaf00cf700 2024-09-10T23:24:30.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcae7400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcacc0725e0 0x7fcacc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcae7400640 1 -- 172.21.15.17:0/3719208670 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fcad8093350 con 0x7fcaf00cf700 2024-09-10T23:24:30.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaf9736000 1 Processor -- start 2024-09-10T23:24:30.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcacc0725e0 0x7fcacc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaf9736000 1 -- start start 2024-09-10T23:24:30.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcacc0725e0 0x7fcacc074aa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcae0001650 tx=0x7fcae0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de802e9d0 0x563de802edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de7fe28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de7fe2e10 0x563de7fe31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaf9736000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563de7f033f0 con 0x563de802e9d0 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaf9736000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563de7e40b20 con 0x563de7fe2e10 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaf9736000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563de7e2ff50 con 0x563de802f2f0 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de802e9d0 0x563de802edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de802e9d0 0x563de802edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39812/0 (socket says 172.21.15.17:39812) 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 -- 172.21.15.17:0/4053921507 learned_addr learned my addr 172.21.15.17:0/4053921507 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcae7e00640 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de7fe28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaefe00640 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de7fe2e10 0x563de7fe31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 -- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 msgr2=0x563de7fe28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de7fe28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 -- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de7fe2e10 msgr2=0x563de7fe31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de7fe2e10 0x563de7fe31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 -- 172.21.15.17:0/4053921507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de7df7590 con 0x563de802e9d0 2024-09-10T23:24:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaefe00640 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de7fe2e10 0x563de7fe31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcae7e00640 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de7fe28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcaef400640 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de802e9d0 0x563de802edb0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fcae00052b0 tx=0x7fcae0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b238c9b213a32774 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcadfe00640 1 -- 172.21.15.17:0/4053921507 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0021450 con 0x563de802e9d0 2024-09-10T23:24:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcadfe00640 1 -- 172.21.15.17:0/4053921507 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcae00216e0 con 0x563de802e9d0 2024-09-10T23:24:30.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.923+0000 7fcadfe00640 1 -- 172.21.15.17:0/4053921507 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0021af0 con 0x563de802e9d0 2024-09-10T23:24:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- 172.21.15.17:0/4053921507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de802e9d0 msgr2=0x563de802edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de802e9d0 0x563de802edb0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fcae00052b0 tx=0x7fcae0011000 comp rx=0 tx=0).stop 2024-09-10T23:24:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- 172.21.15.17:0/4053921507 shutdown_connections 2024-09-10T23:24:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de7fe2e10 0x563de7fe31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de7fe28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 --2- 172.21.15.17:0/4053921507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de802e9d0 0x563de802edb0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- 172.21.15.17:0/4053921507 >> 172.21.15.17:0/4053921507 conn(0x563de7ecc130 msgr2=0x563de8011e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- 172.21.15.17:0/4053921507 shutdown_connections 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- 172.21.15.17:0/4053921507 wait complete. 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- start start 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 Processor -- start 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de800f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 0x563de800fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de80103b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563de7dca5d0 con 0x563de7fe2e10 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563de7e33d60 con 0x563de802e9d0 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563de7dd6500 con 0x563de802f2f0 2024-09-10T23:24:30.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 10 client.0 _ll_register_callbacks cb 0x563de7dda810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de800f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de800f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39824/0 (socket says 172.21.15.17:39824) 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaef400640 1 -- 172.21.15.17:0/822155059 learned_addr learned my addr 172.21.15.17:0/822155059 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaefe00640 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de80103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcae7e00640 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 0x563de800fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaef400640 1 -- 172.21.15.17:0/822155059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 msgr2=0x563de80103b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaef400640 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de80103b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaef400640 1 -- 172.21.15.17:0/822155059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 msgr2=0x563de800fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaef400640 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 0x563de800fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaef400640 1 -- 172.21.15.17:0/822155059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de7dce170 con 0x563de7fe2e10 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaef400640 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de800f6a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fcae0003fd0 tx=0x7fcae00219f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03a9798cc858d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcadcc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcadcc00640 1 -- 172.21.15.17:0/822155059 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0021df0 con 0x563de7fe2e10 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- 172.21.15.17:0/822155059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563de7dc80f0 con 0x563de7fe2e10 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcadcc00640 1 -- 172.21.15.17:0/822155059 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fcae0010050 con 0x563de7fe2e10 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcadcc00640 1 -- 172.21.15.17:0/822155059 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fcae0033050 con 0x563de7fe2e10 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 10 client.8361 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.927+0000 7fcaf9736000 1 -- 172.21.15.17:0/822155059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x563de7eb4ef0 con 0x563de7fe2e10 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcadcc00640 1 -- 172.21.15.17:0/822155059 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563de7dc80f0 con 0x563de7fe2e10 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcadcc00640 1 -- 172.21.15.17:0/822155059 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7fcae0036020 con 0x563de7fe2e10 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 10 client.8361 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 10 client.8361 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 20 client.8361 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x563de80110f0 0x563de8040c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 4 client.8361 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 -- 172.21.15.17:0/822155059 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563de7e42a70 con 0x563de80110f0 2024-09-10T23:24:30.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcae7e00640 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x563de80110f0 0x563de8040c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcae7e00640 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x563de80110f0 0x563de8040c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a53a464694f5c65 server_cookie=e80445bf40f0a656 in_seq=0 out_seq=0 2024-09-10T23:24:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcadcc00640 10 client.8361 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcadcc00640 1 -- 172.21.15.17:0/822155059 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563de7e42a70 con 0x563de80110f0 2024-09-10T23:24:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcadcc00640 10 client.8361 handle_command_reply: tid=0 2024-09-10T23:24:30.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 client.8361 shutdown 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 -- 172.21.15.17:0/822155059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 msgr2=0x563de800f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de800f6a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fcae0003fd0 tx=0x7fcae00219f0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 -- 172.21.15.17:0/822155059 shutdown_connections 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x563de80110f0 0x563de8040c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de80103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 0x563de800fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 --2- 172.21.15.17:0/822155059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de800f6a0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcadcc00640 0 client.8361 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 -- 172.21.15.17:0/822155059 >> 172.21.15.17:0/822155059 conn(0x563de7ecc130 msgr2=0x563de7fe1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 -- 172.21.15.17:0/822155059 shutdown_connections 2024-09-10T23:24:30.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 1 -- 172.21.15.17:0/822155059 wait complete. 2024-09-10T23:24:30.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.931+0000 7fcaf9736000 20 client.8361 trim_cache size 0 max 16384 2024-09-10T23:24:30.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaf9736000 1 Processor -- start 2024-09-10T23:24:30.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaf9736000 1 -- start start 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802e9d0 0x563de80a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802f2f0 0x563de80a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaf9736000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0204840 con 0x563de7fe2e10 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaf9736000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0203850 con 0x563de802f2f0 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaf9736000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf00cdcd0 con 0x563de802e9d0 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39836/0 (socket says 172.21.15.17:39836) 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaef400640 1 -- 172.21.15.17:0/4258794206 learned_addr learned my addr 172.21.15.17:0/4258794206 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcae7e00640 1 --2- 172.21.15.17:0/4258794206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802e9d0 0x563de80a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaefe00640 1 --2- 172.21.15.17:0/4258794206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802f2f0 0x563de80a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaef400640 1 -- 172.21.15.17:0/4258794206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802e9d0 msgr2=0x563de80a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaef400640 1 --2- 172.21.15.17:0/4258794206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802e9d0 0x563de80a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaef400640 1 -- 172.21.15.17:0/4258794206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802f2f0 msgr2=0x563de80a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:30.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaef400640 1 --2- 172.21.15.17:0/4258794206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802f2f0 0x563de80a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaef400640 1 -- 172.21.15.17:0/4258794206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de7e8bd90 con 0x563de7fe2e10 2024-09-10T23:24:30.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcaef400640 1 --2- 172.21.15.17:0/4258794206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a0dd0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e780 tx=0x7fcae000ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9183d5770659fa34 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcadf400640 1 -- 172.21.15.17:0/4258794206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0030070 con 0x563de7fe2e10 2024-09-10T23:24:30.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcadf400640 1 -- 172.21.15.17:0/4258794206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcae000ecb0 con 0x563de7fe2e10 2024-09-10T23:24:30.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.951+0000 7fcadf400640 1 -- 172.21.15.17:0/4258794206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0013420 con 0x563de7fe2e10 2024-09-10T23:24:30.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- 172.21.15.17:0/4258794206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 msgr2=0x563de80a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 --2- 172.21.15.17:0/4258794206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a0dd0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e780 tx=0x7fcae000ea90 comp rx=0 tx=0).stop 2024-09-10T23:24:30.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- 172.21.15.17:0/4258794206 shutdown_connections 2024-09-10T23:24:30.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 --2- 172.21.15.17:0/4258794206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802f2f0 0x563de80a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 --2- 172.21.15.17:0/4258794206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802e9d0 0x563de80a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 --2- 172.21.15.17:0/4258794206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a0dd0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- 172.21.15.17:0/4258794206 >> 172.21.15.17:0/4258794206 conn(0x563de7ecc130 msgr2=0x563de7feaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- 172.21.15.17:0/4258794206 shutdown_connections 2024-09-10T23:24:30.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- 172.21.15.17:0/4258794206 wait complete. 2024-09-10T23:24:30.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- start start 2024-09-10T23:24:30.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 Processor -- start 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 0x563de80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de80a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563de7dca5d0 con 0x563de7fe2e10 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563de8045ce0 con 0x563de802e9d0 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563de7eef730 con 0x563de802f2f0 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 10 client.0 _ll_register_callbacks cb 0x7fcae00051b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39846/0 (socket says 172.21.15.17:39846) 2024-09-10T23:24:30.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaef400640 1 -- 172.21.15.17:0/208919147 learned_addr learned my addr 172.21.15.17:0/208919147 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaefe00640 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de80a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcae7e00640 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 0x563de80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaef400640 1 -- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 msgr2=0x563de80a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaef400640 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de80a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaef400640 1 -- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 msgr2=0x563de80a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaef400640 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 0x563de80a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaef400640 1 -- 172.21.15.17:0/208919147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de7df6a90 con 0x563de7fe2e10 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcae7e00640 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 0x563de80a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaefe00640 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de80a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaef400640 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a4e10 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fcae0015040 tx=0x7fcae0013800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7984ba498bb33aa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcadcc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcadcc00640 1 -- 172.21.15.17:0/208919147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0030070 con 0x563de7fe2e10 2024-09-10T23:24:30.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcadcc00640 1 -- 172.21.15.17:0/208919147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fcae0027040 con 0x563de7fe2e10 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- 172.21.15.17:0/208919147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcae000ecb0 con 0x563de7fe2e10 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcadcc00640 1 -- 172.21.15.17:0/208919147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fcae0003e60 con 0x563de7fe2e10 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 10 client.8367 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcaf9736000 1 -- 172.21.15.17:0/208919147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x563de7dd5050 con 0x563de7fe2e10 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.955+0000 7fcadcc00640 1 -- 172.21.15.17:0/208919147 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcae000ecb0 con 0x563de7fe2e10 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcadcc00640 1 -- 172.21.15.17:0/208919147 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7fcae0036070 con 0x563de7fe2e10 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 10 client.8367 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 10 client.8367 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 20 client.8367 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x563de8042bb0 0x563de8042f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 4 client.8367 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:24:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 -- 172.21.15.17:0/208919147 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "status"}) -- 0x563de7e3e520 con 0x563de8042bb0 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcae7e00640 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x563de8042bb0 0x563de8042f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcae7e00640 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x563de8042bb0 0x563de8042f90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39911f5566fc8d90 server_cookie=8946cd4b698752ae in_seq=0 out_seq=0 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcadcc00640 10 client.8367 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcadcc00640 1 -- 172.21.15.17:0/208919147 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563de7e3e520 con 0x563de8042bb0 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcadcc00640 10 client.8367 handle_command_reply: tid=0 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 client.8367 shutdown 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 -- 172.21.15.17:0/208919147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 msgr2=0x563de80a4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a4e10 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fcae0015040 tx=0x7fcae0013800 comp rx=0 tx=0).stop 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 -- 172.21.15.17:0/208919147 shutdown_connections 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x563de8042bb0 0x563de8042f90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563de802f2f0 0x563de80a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563de802e9d0 0x563de80a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcadcc00640 0 client.8367 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 --2- 172.21.15.17:0/208919147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563de7fe2e10 0x563de80a4e10 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 -- 172.21.15.17:0/208919147 >> 172.21.15.17:0/208919147 conn(0x563de7ecc130 msgr2=0x563de7feaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 -- 172.21.15.17:0/208919147 shutdown_connections 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 1 -- 172.21.15.17:0/208919147 wait complete. 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf9736000 20 client.8367 trim_cache size 0 max 16384 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 8238, 2024-09-10T23:24:30.966 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:24:30.967 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:24:30.967 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:24:30.967 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 5.9958484920000004, 2024-09-10T23:24:30.967 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 95, 2024-09-10T23:24:30.967 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 133, 2024-09-10T23:24:30.967 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 133, 2024-09-10T23:24:30.967 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 10.438712813 2024-09-10T23:24:30.967 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:24:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 -- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcacc0725e0 msgr2=0x7fcacc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcacc0725e0 0x7fcacc074aa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcae0001650 tx=0x7fcae0009040 comp rx=0 tx=0).stop 2024-09-10T23:24:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 -- 172.21.15.17:0/3719208670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf00cf700 msgr2=0x7fcaf0150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf00cf700 0x7fcaf0150b00 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c4b0 tx=0x7fcad800c970 comp rx=0 tx=0).stop 2024-09-10T23:24:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 -- 172.21.15.17:0/3719208670 shutdown_connections 2024-09-10T23:24:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcacc0725e0 0x7fcacc074aa0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcaf01546f0 0x7fcaf01575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaf00cf700 0x7fcaf0150b00 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 --2- 172.21.15.17:0/3719208670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcaf006ef80 0x7fcaf01f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:30.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 -- 172.21.15.17:0/3719208670 >> 172.21.15.17:0/3719208670 conn(0x7fcaf00b1730 msgr2=0x7fcaf0152510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:30.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 -- 172.21.15.17:0/3719208670 shutdown_connections 2024-09-10T23:24:30.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:30.959+0000 7fcaf6400640 1 -- 172.21.15.17:0/3719208670 wait complete. 2024-09-10T23:24:30.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:24:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 -- 172.21.15.17:0/2409821191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 msgr2=0x7fc0580d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 --2- 172.21.15.17:0/2409821191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 0x7fc0580d0450 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc050009c80 tx=0x7fc05001cd10 comp rx=0 tx=0).stop 2024-09-10T23:24:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 -- 172.21.15.17:0/2409821191 shutdown_connections 2024-09-10T23:24:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 --2- 172.21.15.17:0/2409821191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 0x7fc0580d0450 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 --2- 172.21.15.17:0/2409821191 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc05815fd90 0x7fc058160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 -- 172.21.15.17:0/2409821191 >> 172.21.15.17:0/2409821191 conn(0x7fc05806cfc0 msgr2=0x7fc05806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 -- 172.21.15.17:0/2409821191 shutdown_connections 2024-09-10T23:24:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 -- 172.21.15.17:0/2409821191 wait complete. 2024-09-10T23:24:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 Processor -- start 2024-09-10T23:24:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 -- start start 2024-09-10T23:24:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 0x7fc0580b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc05815cb00 0x7fc0580b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc05815fd90 0x7fc058146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0581689f0 con 0x7fc0580cffc0 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc058168870 con 0x7fc05815fd90 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc05cc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc058168b70 con 0x7fc05815cb00 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc055e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 0x7fc0580b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc055e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 0x7fc0580b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39864/0 (socket says 172.21.15.17:39864) 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.127+0000 7fc055e00640 1 -- 172.21.15.17:0/2509842426 learned_addr learned my addr 172.21.15.17:0/2509842426 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc04fe00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc05815cb00 0x7fc0580b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc056800640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc05815fd90 0x7fc058146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc055e00640 1 -- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc05815cb00 msgr2=0x7fc0580b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc055e00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc05815cb00 0x7fc0580b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc055e00640 1 -- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc05815fd90 msgr2=0x7fc058146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc055e00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc05815fd90 0x7fc058146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc055e00640 1 -- 172.21.15.17:0/2509842426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0580b0880 con 0x7fc0580cffc0 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc04fe00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc05815cb00 0x7fc0580b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc055e00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 0x7fc0580b1d10 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc04800c9f0 tx=0x7fc04800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc04e000640 1 -- 172.21.15.17:0/2509842426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048007bb0 con 0x7fc0580cffc0 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc04e000640 1 -- 172.21.15.17:0/2509842426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc048007e40 con 0x7fc0580cffc0 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc04e000640 1 -- 172.21.15.17:0/2509842426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04800f690 con 0x7fc0580cffc0 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc058074640 con 0x7fc0580cffc0 2024-09-10T23:24:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc058073b60 con 0x7fc0580cffc0 2024-09-10T23:24:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0580d0450 con 0x7fc0580cffc0 2024-09-10T23:24:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc04e000640 1 -- 172.21.15.17:0/2509842426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc04800f830 con 0x7fc0580cffc0 2024-09-10T23:24:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc04e000640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0340725e0 0x7fc034074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.131+0000 7fc04e000640 1 -- 172.21.15.17:0/2509842426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fc048093c30 con 0x7fc0580cffc0 2024-09-10T23:24:31.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.135+0000 7fc04fe00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0340725e0 0x7fc034074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:31.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.135+0000 7fc04fe00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0340725e0 0x7fc034074aa0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc040007fd0 tx=0x7fc040009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:31.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.135+0000 7fc04e000640 1 -- 172.21.15.17:0/2509842426 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc048014030 con 0x7fc0580cffc0 2024-09-10T23:24:31.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc058147cc0 con 0x7fc0580cffc0 2024-09-10T23:24:31.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc04e000640 1 -- 172.21.15.17:0/2509842426 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) ==== 53+0+73 (secure 0 0 0) 0x7fc04805f0e0 con 0x7fc0580cffc0 2024-09-10T23:24:31.353 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:24:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0340725e0 msgr2=0x7fc034074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0340725e0 0x7fc034074aa0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc040007fd0 tx=0x7fc040009040 comp rx=0 tx=0).stop 2024-09-10T23:24:31.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 msgr2=0x7fc0580b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:31.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 0x7fc0580b1d10 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc04800c9f0 tx=0x7fc04800ceb0 comp rx=0 tx=0).stop 2024-09-10T23:24:31.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 shutdown_connections 2024-09-10T23:24:31.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0340725e0 0x7fc034074aa0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:31.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc05815fd90 0x7fc058146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:31.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc05815cb00 0x7fc0580b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:31.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 --2- 172.21.15.17:0/2509842426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0580cffc0 0x7fc0580b1d10 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:31.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 >> 172.21.15.17:0/2509842426 conn(0x7fc05806cfc0 msgr2=0x7fc05814c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:31.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 shutdown_connections 2024-09-10T23:24:31.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31.351+0000 7fc05cc00640 1 -- 172.21.15.17:0/2509842426 wait complete. 2024-09-10T23:24:31.375 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:24:31.375 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:24:31.375 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:24:31.375 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:24:31.375 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:31.375 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:24:31.375 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:24:31.375 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:24:31.375 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:24:31.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:31.376 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:24:31.385 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:24:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41900sec preferred_lft 41900sec 2024-09-10T23:24:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:24:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:24:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:24:31.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:31.389 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:24:31.445 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:24:31.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:31.447 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:24:31.500 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:24:31.500 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:24:31.500 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:24:31.501 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:24:31.501 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:24:31.501 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:24:31.501 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:24:31.501 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:31.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:24:31.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:24:31.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:24:31.502 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:31.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:24:31.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:31.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:31.643 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:24:31.653 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:24:31.653 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:24:31.653 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:24:31.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:31.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:24:31.715 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:24:31.715 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:24:31.715 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:31.767 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:24:31.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:24:31.768 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:31.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:24:31.880 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:24:31.937 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:24:31.937 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:24:31.937 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:24:31.937 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:24:31.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:24:31.937 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:24:31.937 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:24:31.937 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:24:31.937 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:24:31.938 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:24:31.939 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:24:31.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:31.940 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:24:31.995 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:24:31.996 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:24:32.042 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:24:32.064 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:24:32.117 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:24:32.118 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:24:32.119 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:24:32.119 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:24:32.119 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:24:32.119 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:24:32.119 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:24:32.119 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:24:32.119 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:24:32.119 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:24:32.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:32.120 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:24:32.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:24:32.135+0000 7f6510e21580 -1 init, newargv = 0x555ba866abf0 newargc=15 2024-09-10T23:24:32.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[72356]: starting ceph client 2024-09-10T23:24:32.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[72356]: starting fuse 2024-09-10T23:24:32.146 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:24:32.147 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:24:32.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:24:32.147 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:24:32.147 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:24:32.147 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:24:32.147 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:24:32.147 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:24:32.147 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:24:32.147 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:24:32.147 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:24:32.148 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:24:32.149 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:24:32.149 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:24:32.149 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:24:32.149 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:24:32.149 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:24:32.149 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:24:32.149 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:24:32.274 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.72356.asok 2024-09-10T23:24:32.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:32.285 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.72356.asok 2024-09-10T23:24:32.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:32.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.72356.asok status 2024-09-10T23:24:32.459 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "72356", 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:24:32.460 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 8385, 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 8385 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 698953193 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:24:32.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 698953193 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.8385 192.168.0.1:0/698953193", 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/698953193", 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 95, 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 133, 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:24:32.462 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:24:32.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:32.475 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:24:32.475 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:32.484 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:24:32.484 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:32.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:32.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:32.548 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:32.548 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:32.548 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T23:24:32.548 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:32.548 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:32.548 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:32.548 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:32.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189783 s, 55.3 MB/s 2024-09-10T23:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016069 s, 65.3 MB/s 2024-09-10T23:24:32.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.724 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018133 s, 57.8 MB/s 2024-09-10T23:24:32.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.740 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121408 s, 86.4 MB/s 2024-09-10T23:24:32.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.759 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149267 s, 70.2 MB/s 2024-09-10T23:24:32.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.781 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183079 s, 57.3 MB/s 2024-09-10T23:24:32.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161148 s, 65.1 MB/s 2024-09-10T23:24:32.820 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.821 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169095 s, 62.0 MB/s 2024-09-10T23:24:32.837 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134516 s, 78.0 MB/s 2024-09-10T23:24:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.855 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130907 s, 80.1 MB/s 2024-09-10T23:24:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.871 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132019 s, 79.4 MB/s 2024-09-10T23:24:32.888 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.888 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133737 s, 78.4 MB/s 2024-09-10T23:24:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130414 s, 80.4 MB/s 2024-09-10T23:24:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.923 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014613 s, 71.8 MB/s 2024-09-10T23:24:32.941 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.941 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.941 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144569 s, 72.5 MB/s 2024-09-10T23:24:32.958 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.959 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013681 s, 76.6 MB/s 2024-09-10T23:24:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.979 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016228 s, 64.6 MB/s 2024-09-10T23:24:32.997 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:32.997 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:32.997 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014199 s, 73.8 MB/s 2024-09-10T23:24:33.013 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01291 s, 81.2 MB/s 2024-09-10T23:24:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128691 s, 81.5 MB/s 2024-09-10T23:24:33.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130709 s, 80.2 MB/s 2024-09-10T23:24:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131769 s, 79.6 MB/s 2024-09-10T23:24:33.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.082 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135409 s, 77.4 MB/s 2024-09-10T23:24:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146724 s, 71.5 MB/s 2024-09-10T23:24:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142095 s, 73.8 MB/s 2024-09-10T23:24:33.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.137 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136144 s, 77.0 MB/s 2024-09-10T23:24:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123215 s, 85.1 MB/s 2024-09-10T23:24:33.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.169 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126155 s, 83.1 MB/s 2024-09-10T23:24:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.188 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141483 s, 74.1 MB/s 2024-09-10T23:24:33.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.204 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129277 s, 81.1 MB/s 2024-09-10T23:24:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140026 s, 74.9 MB/s 2024-09-10T23:24:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175665 s, 59.7 MB/s 2024-09-10T23:24:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:33.252 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:33.252 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:33.252 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T23:24:33.252 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:33.252 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:33.252 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:33.252 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:33.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.325 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135473 s, 77.4 MB/s 2024-09-10T23:24:33.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.343 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131021 s, 80.0 MB/s 2024-09-10T23:24:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125104 s, 83.8 MB/s 2024-09-10T23:24:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.377 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135949 s, 77.1 MB/s 2024-09-10T23:24:33.393 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.393 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.393 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123593 s, 84.8 MB/s 2024-09-10T23:24:33.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.410 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127845 s, 82.0 MB/s 2024-09-10T23:24:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.427 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134467 s, 78.0 MB/s 2024-09-10T23:24:33.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.444 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.444 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121021 s, 86.6 MB/s 2024-09-10T23:24:33.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.462 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01364 s, 76.9 MB/s 2024-09-10T23:24:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.478 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133376 s, 78.6 MB/s 2024-09-10T23:24:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.496 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136703 s, 76.7 MB/s 2024-09-10T23:24:33.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123062 s, 85.2 MB/s 2024-09-10T23:24:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123991 s, 84.6 MB/s 2024-09-10T23:24:33.544 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.544 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.544 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127198 s, 82.4 MB/s 2024-09-10T23:24:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014179 s, 74.0 MB/s 2024-09-10T23:24:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.578 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.578 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121436 s, 86.3 MB/s 2024-09-10T23:24:33.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.593 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119407 s, 87.8 MB/s 2024-09-10T23:24:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126742 s, 82.7 MB/s 2024-09-10T23:24:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122673 s, 85.5 MB/s 2024-09-10T23:24:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136341 s, 76.9 MB/s 2024-09-10T23:24:33.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133874 s, 78.3 MB/s 2024-09-10T23:24:33.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.676 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131105 s, 80.0 MB/s 2024-09-10T23:24:33.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.694 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146264 s, 71.7 MB/s 2024-09-10T23:24:33.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126377 s, 83.0 MB/s 2024-09-10T23:24:33.727 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.727 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.727 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131124 s, 80.0 MB/s 2024-09-10T23:24:33.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.745 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138771 s, 75.6 MB/s 2024-09-10T23:24:33.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.761 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128449 s, 81.6 MB/s 2024-09-10T23:24:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142592 s, 73.5 MB/s 2024-09-10T23:24:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134969 s, 77.7 MB/s 2024-09-10T23:24:33.813 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.813 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.813 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126765 s, 82.7 MB/s 2024-09-10T23:24:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125911 s, 83.3 MB/s 2024-09-10T23:24:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125354 s, 83.6 MB/s 2024-09-10T23:24:33.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:33.853 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:33.853 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:33.853 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T23:24:33.853 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:33.853 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:33.853 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:33.853 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.926 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147181 s, 71.2 MB/s 2024-09-10T23:24:33.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.945 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141819 s, 73.9 MB/s 2024-09-10T23:24:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127778 s, 82.1 MB/s 2024-09-10T23:24:33.977 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.977 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.977 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123917 s, 84.6 MB/s 2024-09-10T23:24:33.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:33.995 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:33.995 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133573 s, 78.5 MB/s 2024-09-10T23:24:34.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.011 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.011 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123533 s, 84.9 MB/s 2024-09-10T23:24:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136281 s, 76.9 MB/s 2024-09-10T23:24:34.044 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.044 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.044 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121821 s, 86.1 MB/s 2024-09-10T23:24:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124033 s, 84.5 MB/s 2024-09-10T23:24:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.077 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134436 s, 78.0 MB/s 2024-09-10T23:24:34.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.093 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123068 s, 85.2 MB/s 2024-09-10T23:24:34.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132499 s, 79.1 MB/s 2024-09-10T23:24:34.127 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.127 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.127 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131242 s, 79.9 MB/s 2024-09-10T23:24:34.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.144 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135753 s, 77.2 MB/s 2024-09-10T23:24:34.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.160 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123212 s, 85.1 MB/s 2024-09-10T23:24:34.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.177 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136043 s, 77.1 MB/s 2024-09-10T23:24:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.195 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136262 s, 77.0 MB/s 2024-09-10T23:24:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012889 s, 81.4 MB/s 2024-09-10T23:24:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133768 s, 78.4 MB/s 2024-09-10T23:24:34.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.245 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126711 s, 82.8 MB/s 2024-09-10T23:24:34.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.262 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132876 s, 78.9 MB/s 2024-09-10T23:24:34.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.278 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125697 s, 83.4 MB/s 2024-09-10T23:24:34.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.295 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134762 s, 77.8 MB/s 2024-09-10T23:24:34.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.312 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124122 s, 84.5 MB/s 2024-09-10T23:24:34.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.328 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124594 s, 84.2 MB/s 2024-09-10T23:24:34.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.345 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127896 s, 82.0 MB/s 2024-09-10T23:24:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130402 s, 80.4 MB/s 2024-09-10T23:24:34.379 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.379 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.379 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142834 s, 73.4 MB/s 2024-09-10T23:24:34.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.396 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128336 s, 81.7 MB/s 2024-09-10T23:24:34.412 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.412 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.412 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124089 s, 84.5 MB/s 2024-09-10T23:24:34.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.430 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136097 s, 77.0 MB/s 2024-09-10T23:24:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133761 s, 78.4 MB/s 2024-09-10T23:24:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:34.454 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:34.454 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:34.454 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T23:24:34.454 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:34.454 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:34.454 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:34.455 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:34.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141067 s, 74.3 MB/s 2024-09-10T23:24:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013865 s, 75.6 MB/s 2024-09-10T23:24:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132668 s, 79.0 MB/s 2024-09-10T23:24:34.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.579 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131038 s, 80.0 MB/s 2024-09-10T23:24:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.595 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127132 s, 82.5 MB/s 2024-09-10T23:24:34.611 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.611 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.611 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012283 s, 85.4 MB/s 2024-09-10T23:24:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136278 s, 76.9 MB/s 2024-09-10T23:24:34.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.645 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121077 s, 86.6 MB/s 2024-09-10T23:24:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124164 s, 84.5 MB/s 2024-09-10T23:24:34.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.678 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136061 s, 77.1 MB/s 2024-09-10T23:24:34.695 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.695 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.695 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133629 s, 78.5 MB/s 2024-09-10T23:24:34.712 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.712 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.712 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124843 s, 84.0 MB/s 2024-09-10T23:24:34.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.728 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122146 s, 85.8 MB/s 2024-09-10T23:24:34.743 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.744 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012036 s, 87.1 MB/s 2024-09-10T23:24:34.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.761 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133718 s, 78.4 MB/s 2024-09-10T23:24:34.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132943 s, 78.9 MB/s 2024-09-10T23:24:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128821 s, 81.4 MB/s 2024-09-10T23:24:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012873 s, 81.5 MB/s 2024-09-10T23:24:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127073 s, 82.5 MB/s 2024-09-10T23:24:34.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.843 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124678 s, 84.1 MB/s 2024-09-10T23:24:34.860 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.860 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134035 s, 78.2 MB/s 2024-09-10T23:24:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120522 s, 87.0 MB/s 2024-09-10T23:24:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146306 s, 71.7 MB/s 2024-09-10T23:24:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133071 s, 78.8 MB/s 2024-09-10T23:24:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136865 s, 76.6 MB/s 2024-09-10T23:24:34.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.946 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123854 s, 84.7 MB/s 2024-09-10T23:24:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.962 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125064 s, 83.8 MB/s 2024-09-10T23:24:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126522 s, 82.9 MB/s 2024-09-10T23:24:34.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:34.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:34.994 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124175 s, 84.4 MB/s 2024-09-10T23:24:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.011 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123863 s, 84.7 MB/s 2024-09-10T23:24:35.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.027 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126965 s, 82.6 MB/s 2024-09-10T23:24:35.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.043 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124782 s, 84.0 MB/s 2024-09-10T23:24:35.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:35.050 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:35.050 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:35.050 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T23:24:35.050 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:35.050 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:35.050 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:35.050 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125955 s, 83.3 MB/s 2024-09-10T23:24:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012525 s, 83.7 MB/s 2024-09-10T23:24:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130953 s, 80.1 MB/s 2024-09-10T23:24:35.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.173 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141367 s, 74.2 MB/s 2024-09-10T23:24:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013103 s, 80.0 MB/s 2024-09-10T23:24:35.206 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.206 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.206 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124035 s, 84.5 MB/s 2024-09-10T23:24:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138245 s, 75.8 MB/s 2024-09-10T23:24:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127825 s, 82.0 MB/s 2024-09-10T23:24:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.258 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014181 s, 73.9 MB/s 2024-09-10T23:24:35.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.274 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125765 s, 83.4 MB/s 2024-09-10T23:24:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.290 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126596 s, 82.8 MB/s 2024-09-10T23:24:35.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.307 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122756 s, 85.4 MB/s 2024-09-10T23:24:35.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.323 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126928 s, 82.6 MB/s 2024-09-10T23:24:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.340 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135395 s, 77.4 MB/s 2024-09-10T23:24:35.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.357 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013615 s, 77.0 MB/s 2024-09-10T23:24:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129833 s, 80.8 MB/s 2024-09-10T23:24:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126582 s, 82.8 MB/s 2024-09-10T23:24:35.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.408 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.408 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134063 s, 78.2 MB/s 2024-09-10T23:24:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123843 s, 84.7 MB/s 2024-09-10T23:24:35.441 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.441 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.441 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133508 s, 78.5 MB/s 2024-09-10T23:24:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126448 s, 82.9 MB/s 2024-09-10T23:24:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134895 s, 77.7 MB/s 2024-09-10T23:24:35.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.492 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135663 s, 77.3 MB/s 2024-09-10T23:24:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134989 s, 77.7 MB/s 2024-09-10T23:24:35.525 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.525 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.525 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122112 s, 85.9 MB/s 2024-09-10T23:24:35.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.542 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136689 s, 76.7 MB/s 2024-09-10T23:24:35.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146817 s, 71.4 MB/s 2024-09-10T23:24:35.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.580 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140124 s, 74.8 MB/s 2024-09-10T23:24:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161737 s, 64.8 MB/s 2024-09-10T23:24:35.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.617 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137727 s, 76.1 MB/s 2024-09-10T23:24:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.634 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013208 s, 79.4 MB/s 2024-09-10T23:24:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129126 s, 81.2 MB/s 2024-09-10T23:24:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:35.658 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:35.658 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:35.658 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T23:24:35.658 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:35.658 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:35.658 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:35.658 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132556 s, 79.1 MB/s 2024-09-10T23:24:35.746 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.747 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.747 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129517 s, 81.0 MB/s 2024-09-10T23:24:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144562 s, 72.5 MB/s 2024-09-10T23:24:35.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.782 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135646 s, 77.3 MB/s 2024-09-10T23:24:35.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132454 s, 79.2 MB/s 2024-09-10T23:24:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126674 s, 82.8 MB/s 2024-09-10T23:24:35.832 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.833 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131664 s, 79.6 MB/s 2024-09-10T23:24:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013575 s, 77.2 MB/s 2024-09-10T23:24:35.866 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.867 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.867 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128155 s, 81.8 MB/s 2024-09-10T23:24:35.882 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125058 s, 83.8 MB/s 2024-09-10T23:24:35.900 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.900 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.900 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134766 s, 77.8 MB/s 2024-09-10T23:24:35.916 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.916 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.916 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127893 s, 82.0 MB/s 2024-09-10T23:24:35.933 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.933 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.933 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131877 s, 79.5 MB/s 2024-09-10T23:24:35.950 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.950 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.950 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129615 s, 80.9 MB/s 2024-09-10T23:24:35.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.967 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137909 s, 76.0 MB/s 2024-09-10T23:24:35.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:35.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:35.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123807 s, 84.7 MB/s 2024-09-10T23:24:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129688 s, 80.9 MB/s 2024-09-10T23:24:36.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012886 s, 81.4 MB/s 2024-09-10T23:24:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126891 s, 82.6 MB/s 2024-09-10T23:24:36.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123723 s, 84.8 MB/s 2024-09-10T23:24:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124309 s, 84.4 MB/s 2024-09-10T23:24:36.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.081 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124609 s, 84.1 MB/s 2024-09-10T23:24:36.099 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.099 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.099 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137102 s, 76.5 MB/s 2024-09-10T23:24:36.116 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.116 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.116 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130733 s, 80.2 MB/s 2024-09-10T23:24:36.132 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.133 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.133 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134791 s, 77.8 MB/s 2024-09-10T23:24:36.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.151 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144731 s, 72.5 MB/s 2024-09-10T23:24:36.167 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.167 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.167 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126693 s, 82.8 MB/s 2024-09-10T23:24:36.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.184 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132206 s, 79.3 MB/s 2024-09-10T23:24:36.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.200 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127754 s, 82.1 MB/s 2024-09-10T23:24:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129452 s, 81.0 MB/s 2024-09-10T23:24:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.233 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129079 s, 81.2 MB/s 2024-09-10T23:24:36.250 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130958 s, 80.1 MB/s 2024-09-10T23:24:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:36.258 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:36.258 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:36.258 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T23:24:36.258 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:36.258 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:36.258 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:36.259 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:36.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:36.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.331 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139089 s, 75.4 MB/s 2024-09-10T23:24:36.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.347 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122518 s, 85.6 MB/s 2024-09-10T23:24:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125824 s, 83.3 MB/s 2024-09-10T23:24:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140837 s, 74.5 MB/s 2024-09-10T23:24:36.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.397 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125448 s, 83.6 MB/s 2024-09-10T23:24:36.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.414 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126893 s, 82.6 MB/s 2024-09-10T23:24:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122955 s, 85.3 MB/s 2024-09-10T23:24:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123911 s, 84.6 MB/s 2024-09-10T23:24:36.463 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.464 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.464 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142285 s, 73.7 MB/s 2024-09-10T23:24:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126138 s, 83.1 MB/s 2024-09-10T23:24:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127413 s, 82.3 MB/s 2024-09-10T23:24:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116768 s, 89.8 MB/s 2024-09-10T23:24:36.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.528 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125267 s, 83.7 MB/s 2024-09-10T23:24:36.543 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.543 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.543 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111958 s, 93.7 MB/s 2024-09-10T23:24:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107909 s, 97.2 MB/s 2024-09-10T23:24:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118807 s, 88.3 MB/s 2024-09-10T23:24:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.589 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121475 s, 86.3 MB/s 2024-09-10T23:24:36.604 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.604 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.604 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113748 s, 92.2 MB/s 2024-09-10T23:24:36.620 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.620 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.620 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127259 s, 82.4 MB/s 2024-09-10T23:24:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110428 s, 95.0 MB/s 2024-09-10T23:24:36.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.650 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116037 s, 90.4 MB/s 2024-09-10T23:24:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126578 s, 82.8 MB/s 2024-09-10T23:24:36.683 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.683 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.683 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124463 s, 84.2 MB/s 2024-09-10T23:24:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114061 s, 91.9 MB/s 2024-09-10T23:24:36.713 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.713 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.713 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113347 s, 92.5 MB/s 2024-09-10T23:24:36.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.729 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124955 s, 83.9 MB/s 2024-09-10T23:24:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112051 s, 93.6 MB/s 2024-09-10T23:24:36.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.758 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107111 s, 97.9 MB/s 2024-09-10T23:24:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115627 s, 90.7 MB/s 2024-09-10T23:24:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125519 s, 83.5 MB/s 2024-09-10T23:24:36.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.806 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.806 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012028 s, 87.2 MB/s 2024-09-10T23:24:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.821 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118677 s, 88.4 MB/s 2024-09-10T23:24:36.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:36.829 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:36.829 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:36.829 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T23:24:36.829 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:36.829 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:36.829 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:36.829 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:36.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011481 s, 91.3 MB/s 2024-09-10T23:24:36.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.915 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121458 s, 86.3 MB/s 2024-09-10T23:24:36.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.931 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117576 s, 89.2 MB/s 2024-09-10T23:24:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115218 s, 91.0 MB/s 2024-09-10T23:24:36.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.961 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112857 s, 92.9 MB/s 2024-09-10T23:24:36.977 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.978 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.978 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128707 s, 81.5 MB/s 2024-09-10T23:24:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:36.993 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114741 s, 91.4 MB/s 2024-09-10T23:24:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121494 s, 86.3 MB/s 2024-09-10T23:24:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108598 s, 96.6 MB/s 2024-09-10T23:24:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110024 s, 95.3 MB/s 2024-09-10T23:24:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011541 s, 90.9 MB/s 2024-09-10T23:24:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115085 s, 91.1 MB/s 2024-09-10T23:24:37.083 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.083 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.084 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113108 s, 92.7 MB/s 2024-09-10T23:24:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128324 s, 81.7 MB/s 2024-09-10T23:24:37.115 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.115 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.115 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115696 s, 90.6 MB/s 2024-09-10T23:24:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.132 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128479 s, 81.6 MB/s 2024-09-10T23:24:37.147 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.147 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.147 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116447 s, 90.0 MB/s 2024-09-10T23:24:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109977 s, 95.3 MB/s 2024-09-10T23:24:37.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.178 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116597 s, 89.9 MB/s 2024-09-10T23:24:37.193 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.193 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.193 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116408 s, 90.1 MB/s 2024-09-10T23:24:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123906 s, 84.6 MB/s 2024-09-10T23:24:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124047 s, 84.5 MB/s 2024-09-10T23:24:37.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.241 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.241 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119679 s, 87.6 MB/s 2024-09-10T23:24:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124099 s, 84.5 MB/s 2024-09-10T23:24:37.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.272 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116134 s, 90.3 MB/s 2024-09-10T23:24:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121862 s, 86.0 MB/s 2024-09-10T23:24:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.304 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120055 s, 87.3 MB/s 2024-09-10T23:24:37.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134692 s, 77.8 MB/s 2024-09-10T23:24:37.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.336 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113597 s, 92.3 MB/s 2024-09-10T23:24:37.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.352 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129983 s, 80.7 MB/s 2024-09-10T23:24:37.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.367 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110492 s, 94.9 MB/s 2024-09-10T23:24:37.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.383 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122901 s, 85.3 MB/s 2024-09-10T23:24:37.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:37.390 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:37.391 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:37.391 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T23:24:37.391 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:37.391 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:37.391 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:37.391 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:37.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:24:37.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:37.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:24:37.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.462 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012798 s, 81.9 MB/s 2024-09-10T23:24:37.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.478 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124742 s, 84.1 MB/s 2024-09-10T23:24:37.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.495 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123455 s, 84.9 MB/s 2024-09-10T23:24:37.509 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.509 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.509 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116336 s, 90.1 MB/s 2024-09-10T23:24:37.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.525 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116615 s, 89.9 MB/s 2024-09-10T23:24:37.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.540 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.540 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011725 s, 89.4 MB/s 2024-09-10T23:24:37.554 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.554 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.554 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109261 s, 96.0 MB/s 2024-09-10T23:24:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.571 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129222 s, 81.1 MB/s 2024-09-10T23:24:37.585 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.585 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.586 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112356 s, 93.3 MB/s 2024-09-10T23:24:37.600 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.600 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.600 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105674 s, 99.2 MB/s 2024-09-10T23:24:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127208 s, 82.4 MB/s 2024-09-10T23:24:37.632 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.632 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.632 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117827 s, 89.0 MB/s 2024-09-10T23:24:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.647 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107574 s, 97.5 MB/s 2024-09-10T23:24:37.662 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.662 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.662 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124623 s, 84.1 MB/s 2024-09-10T23:24:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.679 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012669 s, 82.8 MB/s 2024-09-10T23:24:37.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.694 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115027 s, 91.2 MB/s 2024-09-10T23:24:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110287 s, 95.1 MB/s 2024-09-10T23:24:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126008 s, 83.2 MB/s 2024-09-10T23:24:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.741 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120711 s, 86.9 MB/s 2024-09-10T23:24:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113036 s, 92.8 MB/s 2024-09-10T23:24:37.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.770 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107108 s, 97.9 MB/s 2024-09-10T23:24:37.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116522 s, 90.0 MB/s 2024-09-10T23:24:37.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110057 s, 95.3 MB/s 2024-09-10T23:24:37.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.815 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118253 s, 88.7 MB/s 2024-09-10T23:24:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107014 s, 98.0 MB/s 2024-09-10T23:24:37.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.846 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125107 s, 83.8 MB/s 2024-09-10T23:24:37.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011779 s, 89.0 MB/s 2024-09-10T23:24:37.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.876 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112006 s, 93.6 MB/s 2024-09-10T23:24:37.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.890 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112941 s, 92.8 MB/s 2024-09-10T23:24:37.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.906 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123319 s, 85.0 MB/s 2024-09-10T23:24:37.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110787 s, 94.6 MB/s 2024-09-10T23:24:37.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:37.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:37.936 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114474 s, 91.6 MB/s 2024-09-10T23:24:37.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:37.943 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:37.944 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:37.944 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T23:24:37.944 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:37.944 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:37.944 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:37.944 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:38.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:38.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.058 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127756 s, 82.1 MB/s 2024-09-10T23:24:38.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.074 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.074 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121489 s, 86.3 MB/s 2024-09-10T23:24:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.089 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118791 s, 88.3 MB/s 2024-09-10T23:24:38.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.104 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109901 s, 95.4 MB/s 2024-09-10T23:24:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.120 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116022 s, 90.4 MB/s 2024-09-10T23:24:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.135 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121497 s, 86.3 MB/s 2024-09-10T23:24:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128481 s, 81.6 MB/s 2024-09-10T23:24:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121613 s, 86.2 MB/s 2024-09-10T23:24:38.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110027 s, 95.3 MB/s 2024-09-10T23:24:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.198 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115449 s, 90.8 MB/s 2024-09-10T23:24:38.214 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.214 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.214 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120975 s, 86.7 MB/s 2024-09-10T23:24:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114945 s, 91.2 MB/s 2024-09-10T23:24:38.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.245 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118373 s, 88.6 MB/s 2024-09-10T23:24:38.260 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.261 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121083 s, 86.6 MB/s 2024-09-10T23:24:38.275 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.275 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.275 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01084 s, 96.7 MB/s 2024-09-10T23:24:38.291 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.291 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.291 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123799 s, 84.7 MB/s 2024-09-10T23:24:38.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.307 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012268 s, 85.5 MB/s 2024-09-10T23:24:38.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.323 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121299 s, 86.4 MB/s 2024-09-10T23:24:38.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.339 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119742 s, 87.6 MB/s 2024-09-10T23:24:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117645 s, 89.1 MB/s 2024-09-10T23:24:38.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.369 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116709 s, 89.8 MB/s 2024-09-10T23:24:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114061 s, 91.9 MB/s 2024-09-10T23:24:38.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.401 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123338 s, 85.0 MB/s 2024-09-10T23:24:38.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.416 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112752 s, 93.0 MB/s 2024-09-10T23:24:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110362 s, 95.0 MB/s 2024-09-10T23:24:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.448 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.449 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114798 s, 91.3 MB/s 2024-09-10T23:24:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111931 s, 93.7 MB/s 2024-09-10T23:24:38.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122252 s, 85.8 MB/s 2024-09-10T23:24:38.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.493 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120989 s, 86.7 MB/s 2024-09-10T23:24:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114127 s, 91.9 MB/s 2024-09-10T23:24:38.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.523 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011371 s, 92.2 MB/s 2024-09-10T23:24:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012037 s, 87.1 MB/s 2024-09-10T23:24:38.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:38.545 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:38.546 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:38.546 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T23:24:38.546 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:38.546 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:38.546 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:38.546 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:38.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.617 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126307 s, 83.0 MB/s 2024-09-10T23:24:38.632 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.632 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.632 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109206 s, 96.0 MB/s 2024-09-10T23:24:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011301 s, 92.8 MB/s 2024-09-10T23:24:38.662 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.662 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.662 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113265 s, 92.6 MB/s 2024-09-10T23:24:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.677 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114256 s, 91.8 MB/s 2024-09-10T23:24:38.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.692 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010503 s, 99.8 MB/s 2024-09-10T23:24:38.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.708 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128068 s, 81.9 MB/s 2024-09-10T23:24:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.724 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124721 s, 84.1 MB/s 2024-09-10T23:24:38.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.740 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119278 s, 87.9 MB/s 2024-09-10T23:24:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108112 s, 97.0 MB/s 2024-09-10T23:24:38.769 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.770 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116596 s, 89.9 MB/s 2024-09-10T23:24:38.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115554 s, 90.7 MB/s 2024-09-10T23:24:38.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113683 s, 92.2 MB/s 2024-09-10T23:24:38.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.816 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126592 s, 82.8 MB/s 2024-09-10T23:24:38.832 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124401 s, 84.3 MB/s 2024-09-10T23:24:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116815 s, 89.8 MB/s 2024-09-10T23:24:38.863 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.863 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.863 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111049 s, 94.4 MB/s 2024-09-10T23:24:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114638 s, 91.5 MB/s 2024-09-10T23:24:38.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.894 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125167 s, 83.8 MB/s 2024-09-10T23:24:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011486 s, 91.3 MB/s 2024-09-10T23:24:38.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.925 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112455 s, 93.2 MB/s 2024-09-10T23:24:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119567 s, 87.7 MB/s 2024-09-10T23:24:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124539 s, 84.2 MB/s 2024-09-10T23:24:38.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.971 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109233 s, 96.0 MB/s 2024-09-10T23:24:38.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:38.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:38.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118194 s, 88.7 MB/s 2024-09-10T23:24:39.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.002 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111103 s, 94.4 MB/s 2024-09-10T23:24:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122898 s, 85.3 MB/s 2024-09-10T23:24:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.032 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111863 s, 93.7 MB/s 2024-09-10T23:24:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115798 s, 90.6 MB/s 2024-09-10T23:24:39.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.064 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125647 s, 83.5 MB/s 2024-09-10T23:24:39.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.080 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121352 s, 86.4 MB/s 2024-09-10T23:24:39.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.095 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119168 s, 88.0 MB/s 2024-09-10T23:24:39.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:39.102 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:39.103 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:39.103 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T23:24:39.103 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:39.103 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:39.103 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:39.103 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:39.181 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.181 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.181 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151626 s, 69.2 MB/s 2024-09-10T23:24:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.197 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112851 s, 92.9 MB/s 2024-09-10T23:24:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122638 s, 85.5 MB/s 2024-09-10T23:24:39.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.229 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122454 s, 85.6 MB/s 2024-09-10T23:24:39.244 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.244 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115135 s, 91.1 MB/s 2024-09-10T23:24:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122451 s, 85.6 MB/s 2024-09-10T23:24:39.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.277 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126212 s, 83.1 MB/s 2024-09-10T23:24:39.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.292 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113591 s, 92.3 MB/s 2024-09-10T23:24:39.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.308 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121095 s, 86.6 MB/s 2024-09-10T23:24:39.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.323 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115809 s, 90.5 MB/s 2024-09-10T23:24:39.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.338 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112414 s, 93.3 MB/s 2024-09-10T23:24:39.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.354 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119597 s, 87.7 MB/s 2024-09-10T23:24:39.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.368 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108832 s, 96.3 MB/s 2024-09-10T23:24:39.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.383 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110066 s, 95.3 MB/s 2024-09-10T23:24:39.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.398 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110208 s, 95.1 MB/s 2024-09-10T23:24:39.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.413 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109095 s, 96.1 MB/s 2024-09-10T23:24:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.430 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130141 s, 80.6 MB/s 2024-09-10T23:24:39.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.445 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114805 s, 91.3 MB/s 2024-09-10T23:24:39.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.461 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122296 s, 85.7 MB/s 2024-09-10T23:24:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120949 s, 86.7 MB/s 2024-09-10T23:24:39.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.493 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.493 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011569 s, 90.6 MB/s 2024-09-10T23:24:39.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.508 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111815 s, 93.8 MB/s 2024-09-10T23:24:39.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.523 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120553 s, 87.0 MB/s 2024-09-10T23:24:39.538 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.538 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.539 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011508 s, 91.1 MB/s 2024-09-10T23:24:39.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.555 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131978 s, 79.5 MB/s 2024-09-10T23:24:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114473 s, 91.6 MB/s 2024-09-10T23:24:39.586 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.586 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.586 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114907 s, 91.3 MB/s 2024-09-10T23:24:39.601 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.601 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.601 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120598 s, 86.9 MB/s 2024-09-10T23:24:39.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.618 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.618 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124413 s, 84.3 MB/s 2024-09-10T23:24:39.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.633 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112909 s, 92.9 MB/s 2024-09-10T23:24:39.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.649 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125051 s, 83.9 MB/s 2024-09-10T23:24:39.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.666 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127254 s, 82.4 MB/s 2024-09-10T23:24:39.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:39.673 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:39.673 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:39.673 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T23:24:39.673 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:39.673 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:39.673 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:39.674 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:39.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.744 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116875 s, 89.7 MB/s 2024-09-10T23:24:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114193 s, 91.8 MB/s 2024-09-10T23:24:39.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.776 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012792 s, 82.0 MB/s 2024-09-10T23:24:39.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.791 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111519 s, 94.0 MB/s 2024-09-10T23:24:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.807 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120838 s, 86.8 MB/s 2024-09-10T23:24:39.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.822 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113864 s, 92.1 MB/s 2024-09-10T23:24:39.836 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.837 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114602 s, 91.5 MB/s 2024-09-10T23:24:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.851 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104918 s, 99.9 MB/s 2024-09-10T23:24:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114925 s, 91.2 MB/s 2024-09-10T23:24:39.881 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.881 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.881 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114263 s, 91.8 MB/s 2024-09-10T23:24:39.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.898 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125515 s, 83.5 MB/s 2024-09-10T23:24:39.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.913 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116961 s, 89.7 MB/s 2024-09-10T23:24:39.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.929 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122542 s, 85.6 MB/s 2024-09-10T23:24:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119644 s, 87.6 MB/s 2024-09-10T23:24:39.960 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.960 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.960 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112836 s, 92.9 MB/s 2024-09-10T23:24:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115015 s, 91.2 MB/s 2024-09-10T23:24:39.991 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:39.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:39.992 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119678 s, 87.6 MB/s 2024-09-10T23:24:40.007 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.007 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.007 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115706 s, 90.6 MB/s 2024-09-10T23:24:40.022 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.022 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.022 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114937 s, 91.2 MB/s 2024-09-10T23:24:40.039 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.039 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.039 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129261 s, 81.1 MB/s 2024-09-10T23:24:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116916 s, 89.7 MB/s 2024-09-10T23:24:40.068 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.068 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.069 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108396 s, 96.7 MB/s 2024-09-10T23:24:40.084 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.084 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.084 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115617 s, 90.7 MB/s 2024-09-10T23:24:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.099 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112913 s, 92.9 MB/s 2024-09-10T23:24:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.114 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113917 s, 92.0 MB/s 2024-09-10T23:24:40.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.128 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108519 s, 96.6 MB/s 2024-09-10T23:24:40.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.145 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123377 s, 85.0 MB/s 2024-09-10T23:24:40.175 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.176 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115476 s, 90.8 MB/s 2024-09-10T23:24:40.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.190 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109136 s, 96.1 MB/s 2024-09-10T23:24:40.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.205 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115315 s, 90.9 MB/s 2024-09-10T23:24:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.220 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011081 s, 94.6 MB/s 2024-09-10T23:24:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.235 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114675 s, 91.4 MB/s 2024-09-10T23:24:40.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:40.242 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:40.243 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:40.243 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T23:24:40.243 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:40.243 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:40.243 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:40.243 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:40.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.314 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119605 s, 87.7 MB/s 2024-09-10T23:24:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113033 s, 92.8 MB/s 2024-09-10T23:24:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.344 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113331 s, 92.5 MB/s 2024-09-10T23:24:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012246 s, 85.6 MB/s 2024-09-10T23:24:40.376 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.376 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.376 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124724 s, 84.1 MB/s 2024-09-10T23:24:40.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.391 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114829 s, 91.3 MB/s 2024-09-10T23:24:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121815 s, 86.1 MB/s 2024-09-10T23:24:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112438 s, 93.3 MB/s 2024-09-10T23:24:40.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.437 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115986 s, 90.4 MB/s 2024-09-10T23:24:40.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115855 s, 90.5 MB/s 2024-09-10T23:24:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011772 s, 89.1 MB/s 2024-09-10T23:24:40.485 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.485 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.485 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131909 s, 79.5 MB/s 2024-09-10T23:24:40.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.502 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131707 s, 79.6 MB/s 2024-09-10T23:24:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111935 s, 93.7 MB/s 2024-09-10T23:24:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126269 s, 83.0 MB/s 2024-09-10T23:24:40.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.555 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173851 s, 60.3 MB/s 2024-09-10T23:24:40.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.572 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.572 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012942 s, 81.0 MB/s 2024-09-10T23:24:40.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.590 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137235 s, 76.4 MB/s 2024-09-10T23:24:40.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013473 s, 77.8 MB/s 2024-09-10T23:24:40.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.629 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175132 s, 59.9 MB/s 2024-09-10T23:24:40.648 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.713 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.713 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141317 s, 74.2 MB/s 2024-09-10T23:24:40.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.714 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145676 s, 72.0 MB/s 2024-09-10T23:24:40.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.714 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121982 s, 86.0 MB/s 2024-09-10T23:24:40.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114175 s, 91.8 MB/s 2024-09-10T23:24:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011846 s, 88.5 MB/s 2024-09-10T23:24:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114284 s, 91.8 MB/s 2024-09-10T23:24:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111699 s, 93.9 MB/s 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129396 s, 81.0 MB/s 2024-09-10T23:24:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.778 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011956 s, 87.7 MB/s 2024-09-10T23:24:40.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.794 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120109 s, 87.3 MB/s 2024-09-10T23:24:40.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121379 s, 86.4 MB/s 2024-09-10T23:24:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012234 s, 85.7 MB/s 2024-09-10T23:24:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:40.835 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:40.835 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:40.835 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T23:24:40.835 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:40.835 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:40.835 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:40.835 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:40.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:40.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.907 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011147 s, 94.1 MB/s 2024-09-10T23:24:40.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.922 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111375 s, 94.1 MB/s 2024-09-10T23:24:40.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.938 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011553 s, 90.8 MB/s 2024-09-10T23:24:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110107 s, 95.2 MB/s 2024-09-10T23:24:40.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.969 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128041 s, 81.9 MB/s 2024-09-10T23:24:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123341 s, 85.0 MB/s 2024-09-10T23:24:41.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.001 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118964 s, 88.1 MB/s 2024-09-10T23:24:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012468 s, 84.1 MB/s 2024-09-10T23:24:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115024 s, 91.2 MB/s 2024-09-10T23:24:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127715 s, 82.1 MB/s 2024-09-10T23:24:41.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120197 s, 87.2 MB/s 2024-09-10T23:24:41.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.080 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117546 s, 89.2 MB/s 2024-09-10T23:24:41.096 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.096 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.096 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123265 s, 85.1 MB/s 2024-09-10T23:24:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.111 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114749 s, 91.4 MB/s 2024-09-10T23:24:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118606 s, 88.4 MB/s 2024-09-10T23:24:41.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112013 s, 93.6 MB/s 2024-09-10T23:24:41.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.160 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145529 s, 72.1 MB/s 2024-09-10T23:24:41.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.178 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110527 s, 94.9 MB/s 2024-09-10T23:24:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108369 s, 96.8 MB/s 2024-09-10T23:24:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111008 s, 94.5 MB/s 2024-09-10T23:24:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.223 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.223 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120546 s, 87.0 MB/s 2024-09-10T23:24:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111566 s, 94.0 MB/s 2024-09-10T23:24:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012697 s, 82.6 MB/s 2024-09-10T23:24:41.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.270 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122437 s, 85.6 MB/s 2024-09-10T23:24:41.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108743 s, 96.4 MB/s 2024-09-10T23:24:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.299 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107729 s, 97.3 MB/s 2024-09-10T23:24:41.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.316 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124162 s, 84.5 MB/s 2024-09-10T23:24:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122709 s, 85.5 MB/s 2024-09-10T23:24:41.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.346 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011229 s, 93.4 MB/s 2024-09-10T23:24:41.361 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.362 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119528 s, 87.7 MB/s 2024-09-10T23:24:41.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.377 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121277 s, 86.5 MB/s 2024-09-10T23:24:41.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.392 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109462 s, 95.8 MB/s 2024-09-10T23:24:41.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:41.399 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:41.399 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:41.399 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T23:24:41.400 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:41.400 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:41.400 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:41.400 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:41.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:41.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.514 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121666 s, 86.2 MB/s 2024-09-10T23:24:41.529 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.529 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.529 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113482 s, 92.4 MB/s 2024-09-10T23:24:41.544 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.544 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.544 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114603 s, 91.5 MB/s 2024-09-10T23:24:41.559 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.559 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.560 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118897 s, 88.2 MB/s 2024-09-10T23:24:41.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.576 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126959 s, 82.6 MB/s 2024-09-10T23:24:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.592 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121171 s, 86.5 MB/s 2024-09-10T23:24:41.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.607 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115735 s, 90.6 MB/s 2024-09-10T23:24:41.621 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.621 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.621 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108199 s, 96.9 MB/s 2024-09-10T23:24:41.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.637 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123789 s, 84.7 MB/s 2024-09-10T23:24:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116863 s, 89.7 MB/s 2024-09-10T23:24:41.668 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.669 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121049 s, 86.6 MB/s 2024-09-10T23:24:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012334 s, 85.0 MB/s 2024-09-10T23:24:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109768 s, 95.5 MB/s 2024-09-10T23:24:41.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.715 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115935 s, 90.4 MB/s 2024-09-10T23:24:41.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.732 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131925 s, 79.5 MB/s 2024-09-10T23:24:41.749 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.749 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.749 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134744 s, 77.8 MB/s 2024-09-10T23:24:41.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.764 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114613 s, 91.5 MB/s 2024-09-10T23:24:41.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.779 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110808 s, 94.6 MB/s 2024-09-10T23:24:41.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.795 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126826 s, 82.7 MB/s 2024-09-10T23:24:41.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121535 s, 86.3 MB/s 2024-09-10T23:24:41.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.826 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110817 s, 94.6 MB/s 2024-09-10T23:24:41.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.841 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011626 s, 90.2 MB/s 2024-09-10T23:24:41.856 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.856 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.856 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112846 s, 92.9 MB/s 2024-09-10T23:24:41.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.871 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108051 s, 97.0 MB/s 2024-09-10T23:24:41.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.886 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113449 s, 92.4 MB/s 2024-09-10T23:24:41.901 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.902 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.902 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120894 s, 86.7 MB/s 2024-09-10T23:24:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124413 s, 84.3 MB/s 2024-09-10T23:24:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116688 s, 89.9 MB/s 2024-09-10T23:24:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113761 s, 92.2 MB/s 2024-09-10T23:24:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120522 s, 87.0 MB/s 2024-09-10T23:24:41.980 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.980 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.980 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120745 s, 86.8 MB/s 2024-09-10T23:24:41.996 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:41.996 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:41.996 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012193 s, 86.0 MB/s 2024-09-10T23:24:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:42.004 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:42.004 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:42.004 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T23:24:42.004 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:42.004 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:42.004 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:42.004 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:42.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:42.075 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.075 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.076 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113315 s, 92.5 MB/s 2024-09-10T23:24:42.090 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.091 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112724 s, 93.0 MB/s 2024-09-10T23:24:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.106 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112287 s, 93.4 MB/s 2024-09-10T23:24:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011435 s, 91.7 MB/s 2024-09-10T23:24:42.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.137 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113105 s, 92.7 MB/s 2024-09-10T23:24:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.152 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113475 s, 92.4 MB/s 2024-09-10T23:24:42.183 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.184 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109729 s, 95.6 MB/s 2024-09-10T23:24:42.199 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.199 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.199 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119945 s, 87.4 MB/s 2024-09-10T23:24:42.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.215 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119821 s, 87.5 MB/s 2024-09-10T23:24:42.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.229 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109413 s, 95.8 MB/s 2024-09-10T23:24:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.245 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120693 s, 86.9 MB/s 2024-09-10T23:24:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125075 s, 83.8 MB/s 2024-09-10T23:24:42.276 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.277 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110706 s, 94.7 MB/s 2024-09-10T23:24:42.291 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.291 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.291 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118397 s, 88.6 MB/s 2024-09-10T23:24:42.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.307 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118939 s, 88.2 MB/s 2024-09-10T23:24:42.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.323 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122405 s, 85.7 MB/s 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.338 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117593 s, 89.2 MB/s 2024-09-10T23:24:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129451 s, 81.0 MB/s 2024-09-10T23:24:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105865 s, 99.0 MB/s 2024-09-10T23:24:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121713 s, 86.2 MB/s 2024-09-10T23:24:42.399 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.400 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112252 s, 93.4 MB/s 2024-09-10T23:24:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.415 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118819 s, 88.2 MB/s 2024-09-10T23:24:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109677 s, 95.6 MB/s 2024-09-10T23:24:42.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.445 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115866 s, 90.5 MB/s 2024-09-10T23:24:42.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.461 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124521 s, 84.2 MB/s 2024-09-10T23:24:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011246 s, 93.2 MB/s 2024-09-10T23:24:42.493 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.493 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.493 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133789 s, 78.4 MB/s 2024-09-10T23:24:42.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.507 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107431 s, 97.6 MB/s 2024-09-10T23:24:42.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.524 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125056 s, 83.8 MB/s 2024-09-10T23:24:42.538 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.539 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111225 s, 94.3 MB/s 2024-09-10T23:24:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111971 s, 93.6 MB/s 2024-09-10T23:24:42.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115032 s, 91.2 MB/s 2024-09-10T23:24:42.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:42.576 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:42.576 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:42.576 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T23:24:42.576 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:42.576 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:42.576 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:42.576 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:42.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011059 s, 94.8 MB/s 2024-09-10T23:24:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110017 s, 95.3 MB/s 2024-09-10T23:24:42.675 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.675 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.675 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106854 s, 98.1 MB/s 2024-09-10T23:24:42.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.691 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125199 s, 83.8 MB/s 2024-09-10T23:24:42.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.707 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121485 s, 86.3 MB/s 2024-09-10T23:24:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.721 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109264 s, 96.0 MB/s 2024-09-10T23:24:42.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.736 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112335 s, 93.3 MB/s 2024-09-10T23:24:42.751 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.751 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.752 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114821 s, 91.3 MB/s 2024-09-10T23:24:42.767 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.767 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.767 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120359 s, 87.1 MB/s 2024-09-10T23:24:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114096 s, 91.9 MB/s 2024-09-10T23:24:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.797 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110966 s, 94.5 MB/s 2024-09-10T23:24:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114146 s, 91.9 MB/s 2024-09-10T23:24:42.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116557 s, 90.0 MB/s 2024-09-10T23:24:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.843 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011361 s, 92.3 MB/s 2024-09-10T23:24:42.857 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.857 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110585 s, 94.8 MB/s 2024-09-10T23:24:42.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.873 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117589 s, 89.2 MB/s 2024-09-10T23:24:42.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109688 s, 95.6 MB/s 2024-09-10T23:24:42.902 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.902 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.902 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107318 s, 97.7 MB/s 2024-09-10T23:24:42.917 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.917 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.917 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116793 s, 89.8 MB/s 2024-09-10T23:24:42.932 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.932 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.932 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113211 s, 92.6 MB/s 2024-09-10T23:24:42.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.948 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121138 s, 86.6 MB/s 2024-09-10T23:24:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107588 s, 97.5 MB/s 2024-09-10T23:24:42.978 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.978 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.978 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124037 s, 84.5 MB/s 2024-09-10T23:24:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:42.993 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114489 s, 91.6 MB/s 2024-09-10T23:24:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111429 s, 94.1 MB/s 2024-09-10T23:24:43.023 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118045 s, 88.8 MB/s 2024-09-10T23:24:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.038 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108424 s, 96.7 MB/s 2024-09-10T23:24:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119068 s, 88.1 MB/s 2024-09-10T23:24:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.070 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124831 s, 84.0 MB/s 2024-09-10T23:24:43.085 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.085 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.085 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116657 s, 89.9 MB/s 2024-09-10T23:24:43.099 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.100 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.100 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010923 s, 96.0 MB/s 2024-09-10T23:24:43.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.114 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107684 s, 97.4 MB/s 2024-09-10T23:24:43.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:43.122 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:43.122 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:43.122 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T23:24:43.122 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:43.122 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:43.122 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:43.122 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:43.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012316 s, 85.1 MB/s 2024-09-10T23:24:43.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.210 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111305 s, 94.2 MB/s 2024-09-10T23:24:43.225 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.225 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.226 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114404 s, 91.7 MB/s 2024-09-10T23:24:43.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.240 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108681 s, 96.5 MB/s 2024-09-10T23:24:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124064 s, 84.5 MB/s 2024-09-10T23:24:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111579 s, 94.0 MB/s 2024-09-10T23:24:43.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.289 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143599 s, 73.0 MB/s 2024-09-10T23:24:43.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.304 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115297 s, 90.9 MB/s 2024-09-10T23:24:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.319 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107547 s, 97.5 MB/s 2024-09-10T23:24:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119215 s, 88.0 MB/s 2024-09-10T23:24:43.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.350 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119602 s, 87.7 MB/s 2024-09-10T23:24:43.364 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.364 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.365 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105533 s, 99.4 MB/s 2024-09-10T23:24:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.381 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130325 s, 80.5 MB/s 2024-09-10T23:24:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.396 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114612 s, 91.5 MB/s 2024-09-10T23:24:43.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.411 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010894 s, 96.3 MB/s 2024-09-10T23:24:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109595 s, 95.7 MB/s 2024-09-10T23:24:43.441 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.441 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.441 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117434 s, 89.3 MB/s 2024-09-10T23:24:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110566 s, 94.8 MB/s 2024-09-10T23:24:43.471 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.471 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.471 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113498 s, 92.4 MB/s 2024-09-10T23:24:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130487 s, 80.4 MB/s 2024-09-10T23:24:43.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.504 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120919 s, 86.7 MB/s 2024-09-10T23:24:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113415 s, 92.5 MB/s 2024-09-10T23:24:43.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119512 s, 87.7 MB/s 2024-09-10T23:24:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.549 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112213 s, 93.4 MB/s 2024-09-10T23:24:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114647 s, 91.5 MB/s 2024-09-10T23:24:43.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.582 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130049 s, 80.6 MB/s 2024-09-10T23:24:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114396 s, 91.7 MB/s 2024-09-10T23:24:43.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.612 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117991 s, 88.9 MB/s 2024-09-10T23:24:43.627 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.627 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.627 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111022 s, 94.4 MB/s 2024-09-10T23:24:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124851 s, 84.0 MB/s 2024-09-10T23:24:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119813 s, 87.5 MB/s 2024-09-10T23:24:43.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.673 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106359 s, 98.6 MB/s 2024-09-10T23:24:43.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:43.681 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:43.681 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:43.681 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T23:24:43.681 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:43.681 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:43.681 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:43.681 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:43.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130579 s, 80.3 MB/s 2024-09-10T23:24:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110487 s, 94.9 MB/s 2024-09-10T23:24:43.783 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.783 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.783 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114665 s, 91.4 MB/s 2024-09-10T23:24:43.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.799 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124286 s, 84.4 MB/s 2024-09-10T23:24:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109668 s, 95.6 MB/s 2024-09-10T23:24:43.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124364 s, 84.3 MB/s 2024-09-10T23:24:43.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.846 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120412 s, 87.1 MB/s 2024-09-10T23:24:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119761 s, 87.6 MB/s 2024-09-10T23:24:43.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.876 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109063 s, 96.1 MB/s 2024-09-10T23:24:43.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.893 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012558 s, 83.5 MB/s 2024-09-10T23:24:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114654 s, 91.5 MB/s 2024-09-10T23:24:43.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129998 s, 80.7 MB/s 2024-09-10T23:24:43.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.940 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115234 s, 91.0 MB/s 2024-09-10T23:24:43.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112643 s, 93.1 MB/s 2024-09-10T23:24:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122776 s, 85.4 MB/s 2024-09-10T23:24:43.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121196 s, 86.5 MB/s 2024-09-10T23:24:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113362 s, 92.5 MB/s 2024-09-10T23:24:44.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.018 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.018 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121755 s, 86.1 MB/s 2024-09-10T23:24:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011513 s, 91.1 MB/s 2024-09-10T23:24:44.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109069 s, 96.1 MB/s 2024-09-10T23:24:44.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.064 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111412 s, 94.1 MB/s 2024-09-10T23:24:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118374 s, 88.6 MB/s 2024-09-10T23:24:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112293 s, 93.4 MB/s 2024-09-10T23:24:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011167 s, 93.9 MB/s 2024-09-10T23:24:44.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125899 s, 83.3 MB/s 2024-09-10T23:24:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114205 s, 91.8 MB/s 2024-09-10T23:24:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111029 s, 94.4 MB/s 2024-09-10T23:24:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.172 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130725 s, 80.2 MB/s 2024-09-10T23:24:44.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.201 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109471 s, 95.8 MB/s 2024-09-10T23:24:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113004 s, 92.8 MB/s 2024-09-10T23:24:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119169 s, 88.0 MB/s 2024-09-10T23:24:44.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110972 s, 94.5 MB/s 2024-09-10T23:24:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:44.253 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:44.253 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:44.253 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T23:24:44.253 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:44.253 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:44.253 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:44.254 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:44.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119738 s, 87.6 MB/s 2024-09-10T23:24:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01206 s, 86.9 MB/s 2024-09-10T23:24:44.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.355 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112587 s, 93.1 MB/s 2024-09-10T23:24:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.371 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125775 s, 83.4 MB/s 2024-09-10T23:24:44.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.389 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119578 s, 87.7 MB/s 2024-09-10T23:24:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114584 s, 91.5 MB/s 2024-09-10T23:24:44.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.418 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116807 s, 89.8 MB/s 2024-09-10T23:24:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.432 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.433 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110777 s, 94.7 MB/s 2024-09-10T23:24:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.448 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114247 s, 91.8 MB/s 2024-09-10T23:24:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138146 s, 75.9 MB/s 2024-09-10T23:24:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.480 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111872 s, 93.7 MB/s 2024-09-10T23:24:44.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120642 s, 86.9 MB/s 2024-09-10T23:24:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119497 s, 87.7 MB/s 2024-09-10T23:24:44.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.527 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122376 s, 85.7 MB/s 2024-09-10T23:24:44.543 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.543 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.543 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109446 s, 95.8 MB/s 2024-09-10T23:24:44.560 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.560 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.560 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128997 s, 81.3 MB/s 2024-09-10T23:24:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118308 s, 88.6 MB/s 2024-09-10T23:24:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124858 s, 84.0 MB/s 2024-09-10T23:24:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108592 s, 96.6 MB/s 2024-09-10T23:24:44.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.624 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116176 s, 90.3 MB/s 2024-09-10T23:24:44.640 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.640 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.640 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120024 s, 87.4 MB/s 2024-09-10T23:24:44.655 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.656 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.656 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113303 s, 92.5 MB/s 2024-09-10T23:24:44.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.672 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117327 s, 89.4 MB/s 2024-09-10T23:24:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011139 s, 94.1 MB/s 2024-09-10T23:24:44.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133099 s, 78.8 MB/s 2024-09-10T23:24:44.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.721 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113719 s, 92.2 MB/s 2024-09-10T23:24:44.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.735 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109715 s, 95.6 MB/s 2024-09-10T23:24:44.751 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.751 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.751 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112659 s, 93.1 MB/s 2024-09-10T23:24:44.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133443 s, 78.6 MB/s 2024-09-10T23:24:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119601 s, 87.7 MB/s 2024-09-10T23:24:44.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.801 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119709 s, 87.6 MB/s 2024-09-10T23:24:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111321 s, 94.2 MB/s 2024-09-10T23:24:44.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:44.823 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:44.823 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:44.823 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T23:24:44.823 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:44.823 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:44.823 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:44.823 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:44.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.938 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119134 s, 88.0 MB/s 2024-09-10T23:24:44.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.953 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115602 s, 90.7 MB/s 2024-09-10T23:24:44.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.969 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01212 s, 86.5 MB/s 2024-09-10T23:24:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111712 s, 93.9 MB/s 2024-09-10T23:24:45.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122895 s, 85.3 MB/s 2024-09-10T23:24:45.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.015 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112857 s, 92.9 MB/s 2024-09-10T23:24:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121932 s, 86.0 MB/s 2024-09-10T23:24:45.045 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.045 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108846 s, 96.3 MB/s 2024-09-10T23:24:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110362 s, 95.0 MB/s 2024-09-10T23:24:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121334 s, 86.4 MB/s 2024-09-10T23:24:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.092 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125208 s, 83.7 MB/s 2024-09-10T23:24:45.107 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.107 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.107 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110864 s, 94.6 MB/s 2024-09-10T23:24:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110158 s, 95.2 MB/s 2024-09-10T23:24:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118469 s, 88.5 MB/s 2024-09-10T23:24:45.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118294 s, 88.6 MB/s 2024-09-10T23:24:45.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.168 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118541 s, 88.5 MB/s 2024-09-10T23:24:45.196 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.197 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.197 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114094 s, 91.9 MB/s 2024-09-10T23:24:45.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.211 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109185 s, 96.0 MB/s 2024-09-10T23:24:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127645 s, 82.1 MB/s 2024-09-10T23:24:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124292 s, 84.4 MB/s 2024-09-10T23:24:45.260 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.260 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.260 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119765 s, 87.6 MB/s 2024-09-10T23:24:45.276 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.276 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.276 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121331 s, 86.4 MB/s 2024-09-10T23:24:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.292 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121958 s, 86.0 MB/s 2024-09-10T23:24:45.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.307 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111405 s, 94.1 MB/s 2024-09-10T23:24:45.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.323 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121236 s, 86.5 MB/s 2024-09-10T23:24:45.337 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.338 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113709 s, 92.2 MB/s 2024-09-10T23:24:45.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.353 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114542 s, 91.5 MB/s 2024-09-10T23:24:45.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121709 s, 86.2 MB/s 2024-09-10T23:24:45.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.383 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111876 s, 93.7 MB/s 2024-09-10T23:24:45.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.398 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111841 s, 93.8 MB/s 2024-09-10T23:24:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.413 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011296 s, 92.8 MB/s 2024-09-10T23:24:45.428 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.429 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115167 s, 91.0 MB/s 2024-09-10T23:24:45.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:45.436 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:45.436 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:45.436 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T23:24:45.436 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:45.436 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:45.437 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:45.437 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130667 s, 80.2 MB/s 2024-09-10T23:24:45.525 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.525 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.525 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012463 s, 84.1 MB/s 2024-09-10T23:24:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.542 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125801 s, 83.4 MB/s 2024-09-10T23:24:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159792 s, 65.6 MB/s 2024-09-10T23:24:45.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129631 s, 80.9 MB/s 2024-09-10T23:24:45.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.599 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147761 s, 71.0 MB/s 2024-09-10T23:24:45.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.617 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127405 s, 82.3 MB/s 2024-09-10T23:24:45.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.638 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155947 s, 67.2 MB/s 2024-09-10T23:24:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012453 s, 84.2 MB/s 2024-09-10T23:24:45.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.672 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137961 s, 76.0 MB/s 2024-09-10T23:24:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121697 s, 86.2 MB/s 2024-09-10T23:24:45.703 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.703 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115899 s, 90.5 MB/s 2024-09-10T23:24:45.718 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011447 s, 91.6 MB/s 2024-09-10T23:24:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121653 s, 86.2 MB/s 2024-09-10T23:24:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118325 s, 88.6 MB/s 2024-09-10T23:24:45.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.766 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115058 s, 91.1 MB/s 2024-09-10T23:24:45.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.780 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111135 s, 94.4 MB/s 2024-09-10T23:24:45.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.795 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111422 s, 94.1 MB/s 2024-09-10T23:24:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.812 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133699 s, 78.4 MB/s 2024-09-10T23:24:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113772 s, 92.2 MB/s 2024-09-10T23:24:45.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.843 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125956 s, 83.2 MB/s 2024-09-10T23:24:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.858 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112963 s, 92.8 MB/s 2024-09-10T23:24:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120276 s, 87.2 MB/s 2024-09-10T23:24:45.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.890 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119468 s, 87.8 MB/s 2024-09-10T23:24:45.904 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.904 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.904 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107715 s, 97.3 MB/s 2024-09-10T23:24:45.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.920 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119861 s, 87.5 MB/s 2024-09-10T23:24:45.934 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.935 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111322 s, 94.2 MB/s 2024-09-10T23:24:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111026 s, 94.4 MB/s 2024-09-10T23:24:45.964 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.965 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.965 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116694 s, 89.9 MB/s 2024-09-10T23:24:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.980 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011424 s, 91.8 MB/s 2024-09-10T23:24:45.995 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:45.996 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122821 s, 85.4 MB/s 2024-09-10T23:24:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.010 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106821 s, 98.2 MB/s 2024-09-10T23:24:46.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:46.017 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:46.017 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:46.018 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T23:24:46.018 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:46.018 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:46.018 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:46.018 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:46.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.088 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109928 s, 95.4 MB/s 2024-09-10T23:24:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124378 s, 84.3 MB/s 2024-09-10T23:24:46.119 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.119 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.119 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117565 s, 89.2 MB/s 2024-09-10T23:24:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110975 s, 94.5 MB/s 2024-09-10T23:24:46.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.148 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111808 s, 93.8 MB/s 2024-09-10T23:24:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.163 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.164 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115397 s, 90.9 MB/s 2024-09-10T23:24:46.183 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.183 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.183 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165335 s, 63.4 MB/s 2024-09-10T23:24:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114136 s, 91.9 MB/s 2024-09-10T23:24:46.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129477 s, 81.0 MB/s 2024-09-10T23:24:46.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.233 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123066 s, 85.2 MB/s 2024-09-10T23:24:46.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.247 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110508 s, 94.9 MB/s 2024-09-10T23:24:46.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.262 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110275 s, 95.1 MB/s 2024-09-10T23:24:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118189 s, 88.7 MB/s 2024-09-10T23:24:46.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.293 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118501 s, 88.5 MB/s 2024-09-10T23:24:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129756 s, 80.8 MB/s 2024-09-10T23:24:46.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.325 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121574 s, 86.2 MB/s 2024-09-10T23:24:46.341 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.341 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.341 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120983 s, 86.7 MB/s 2024-09-10T23:24:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111073 s, 94.4 MB/s 2024-09-10T23:24:46.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.371 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.371 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110206 s, 95.1 MB/s 2024-09-10T23:24:46.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.385 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113838 s, 92.1 MB/s 2024-09-10T23:24:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112779 s, 93.0 MB/s 2024-09-10T23:24:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114036 s, 92.0 MB/s 2024-09-10T23:24:46.432 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.432 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.432 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106604 s, 98.4 MB/s 2024-09-10T23:24:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114229 s, 91.8 MB/s 2024-09-10T23:24:46.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.461 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120189 s, 87.2 MB/s 2024-09-10T23:24:46.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.476 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111627 s, 93.9 MB/s 2024-09-10T23:24:46.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.493 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.493 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127298 s, 82.4 MB/s 2024-09-10T23:24:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.507 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110708 s, 94.7 MB/s 2024-09-10T23:24:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121742 s, 86.1 MB/s 2024-09-10T23:24:46.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.539 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123609 s, 84.8 MB/s 2024-09-10T23:24:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012844 s, 81.6 MB/s 2024-09-10T23:24:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111797 s, 93.8 MB/s 2024-09-10T23:24:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:46.577 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:46.578 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:46.578 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T23:24:46.578 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:46.578 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:46.578 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:46.578 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:46.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:46.648 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.648 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.648 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112649 s, 93.1 MB/s 2024-09-10T23:24:46.664 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.664 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.664 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127185 s, 82.4 MB/s 2024-09-10T23:24:46.680 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.680 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.680 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118851 s, 88.2 MB/s 2024-09-10T23:24:46.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.694 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110517 s, 94.9 MB/s 2024-09-10T23:24:46.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.709 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109139 s, 96.1 MB/s 2024-09-10T23:24:46.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.725 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119217 s, 88.0 MB/s 2024-09-10T23:24:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111298 s, 94.2 MB/s 2024-09-10T23:24:46.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109928 s, 95.4 MB/s 2024-09-10T23:24:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125854 s, 83.3 MB/s 2024-09-10T23:24:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.786 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.786 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117421 s, 89.3 MB/s 2024-09-10T23:24:46.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109523 s, 95.7 MB/s 2024-09-10T23:24:46.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.816 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124437 s, 84.3 MB/s 2024-09-10T23:24:46.832 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.832 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.832 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121716 s, 86.1 MB/s 2024-09-10T23:24:46.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.847 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113775 s, 92.2 MB/s 2024-09-10T23:24:46.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.862 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114699 s, 91.4 MB/s 2024-09-10T23:24:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.878 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119787 s, 87.5 MB/s 2024-09-10T23:24:46.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.892 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107128 s, 97.9 MB/s 2024-09-10T23:24:46.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.907 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110341 s, 95.0 MB/s 2024-09-10T23:24:46.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.922 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111854 s, 93.7 MB/s 2024-09-10T23:24:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113375 s, 92.5 MB/s 2024-09-10T23:24:46.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.951 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108489 s, 96.7 MB/s 2024-09-10T23:24:46.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.966 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011672 s, 89.8 MB/s 2024-09-10T23:24:46.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.982 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116288 s, 90.2 MB/s 2024-09-10T23:24:46.997 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:46.997 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:46.997 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113907 s, 92.1 MB/s 2024-09-10T23:24:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.012 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01152 s, 91.0 MB/s 2024-09-10T23:24:47.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118046 s, 88.8 MB/s 2024-09-10T23:24:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110287 s, 95.1 MB/s 2024-09-10T23:24:47.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.058 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114381 s, 91.7 MB/s 2024-09-10T23:24:47.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.073 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119161 s, 88.0 MB/s 2024-09-10T23:24:47.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.089 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.089 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116408 s, 90.1 MB/s 2024-09-10T23:24:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012759 s, 82.2 MB/s 2024-09-10T23:24:47.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.120 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111016 s, 94.5 MB/s 2024-09-10T23:24:47.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:47.127 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:47.127 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:47.127 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T23:24:47.127 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:47.127 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:47.127 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:47.127 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:47.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:47.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.210 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115269 s, 91.0 MB/s 2024-09-10T23:24:47.226 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.226 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.227 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128598 s, 81.5 MB/s 2024-09-10T23:24:47.241 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.241 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.241 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110299 s, 95.1 MB/s 2024-09-10T23:24:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.258 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129476 s, 81.0 MB/s 2024-09-10T23:24:47.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.273 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115176 s, 91.0 MB/s 2024-09-10T23:24:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121705 s, 86.2 MB/s 2024-09-10T23:24:47.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.306 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012883 s, 81.4 MB/s 2024-09-10T23:24:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117008 s, 89.6 MB/s 2024-09-10T23:24:47.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.337 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.337 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011676 s, 89.8 MB/s 2024-09-10T23:24:47.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.353 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122285 s, 85.7 MB/s 2024-09-10T23:24:47.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.368 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118343 s, 88.6 MB/s 2024-09-10T23:24:47.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.383 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109977 s, 95.3 MB/s 2024-09-10T23:24:47.399 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.399 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.399 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124969 s, 83.9 MB/s 2024-09-10T23:24:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.413 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110078 s, 95.3 MB/s 2024-09-10T23:24:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112838 s, 92.9 MB/s 2024-09-10T23:24:47.444 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.444 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.444 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118484 s, 88.5 MB/s 2024-09-10T23:24:47.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.459 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114778 s, 91.4 MB/s 2024-09-10T23:24:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011406 s, 91.9 MB/s 2024-09-10T23:24:47.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.490 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124138 s, 84.5 MB/s 2024-09-10T23:24:47.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.505 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110012 s, 95.3 MB/s 2024-09-10T23:24:47.520 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.521 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120958 s, 86.7 MB/s 2024-09-10T23:24:47.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.537 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129635 s, 80.9 MB/s 2024-09-10T23:24:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.551 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105422 s, 99.5 MB/s 2024-09-10T23:24:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.567 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121505 s, 86.3 MB/s 2024-09-10T23:24:47.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.582 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112284 s, 93.4 MB/s 2024-09-10T23:24:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123206 s, 85.1 MB/s 2024-09-10T23:24:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114886 s, 91.3 MB/s 2024-09-10T23:24:47.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.629 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117962 s, 88.9 MB/s 2024-09-10T23:24:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127564 s, 82.2 MB/s 2024-09-10T23:24:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105765 s, 99.1 MB/s 2024-09-10T23:24:47.674 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.674 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.674 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112776 s, 93.0 MB/s 2024-09-10T23:24:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124029 s, 84.5 MB/s 2024-09-10T23:24:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:47.698 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:47.698 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:47.698 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T23:24:47.698 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:47.698 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:47.698 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:47.698 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:47.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.769 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.769 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114632 s, 91.5 MB/s 2024-09-10T23:24:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123859 s, 84.7 MB/s 2024-09-10T23:24:47.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.799 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108202 s, 96.9 MB/s 2024-09-10T23:24:47.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.815 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118292 s, 88.6 MB/s 2024-09-10T23:24:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011874 s, 88.3 MB/s 2024-09-10T23:24:47.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.846 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117722 s, 89.1 MB/s 2024-09-10T23:24:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114378 s, 91.7 MB/s 2024-09-10T23:24:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114696 s, 91.4 MB/s 2024-09-10T23:24:47.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.892 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118121 s, 88.8 MB/s 2024-09-10T23:24:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123026 s, 85.2 MB/s 2024-09-10T23:24:47.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012014 s, 87.3 MB/s 2024-09-10T23:24:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125801 s, 83.4 MB/s 2024-09-10T23:24:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120448 s, 87.1 MB/s 2024-09-10T23:24:47.972 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.973 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.973 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124753 s, 84.1 MB/s 2024-09-10T23:24:47.988 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:47.988 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:47.988 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123232 s, 85.1 MB/s 2024-09-10T23:24:48.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.004 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118568 s, 88.4 MB/s 2024-09-10T23:24:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.019 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011742 s, 89.3 MB/s 2024-09-10T23:24:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.034 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108977 s, 96.2 MB/s 2024-09-10T23:24:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116102 s, 90.3 MB/s 2024-09-10T23:24:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105058 s, 99.8 MB/s 2024-09-10T23:24:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.080 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012417 s, 84.4 MB/s 2024-09-10T23:24:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.096 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119899 s, 87.5 MB/s 2024-09-10T23:24:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111316 s, 94.2 MB/s 2024-09-10T23:24:48.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.126 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114669 s, 91.4 MB/s 2024-09-10T23:24:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119265 s, 87.9 MB/s 2024-09-10T23:24:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119611 s, 87.7 MB/s 2024-09-10T23:24:48.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.171 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111562 s, 94.0 MB/s 2024-09-10T23:24:48.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.190 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146899 s, 71.4 MB/s 2024-09-10T23:24:48.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.211 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111413 s, 94.1 MB/s 2024-09-10T23:24:48.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.227 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122621 s, 85.5 MB/s 2024-09-10T23:24:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.243 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121933 s, 86.0 MB/s 2024-09-10T23:24:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.258 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116047 s, 90.4 MB/s 2024-09-10T23:24:48.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:48.265 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:48.266 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:48.266 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T23:24:48.266 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:48.266 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:48.266 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:48.266 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:48.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:48.337 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.337 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.337 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121841 s, 86.1 MB/s 2024-09-10T23:24:48.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.353 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123131 s, 85.2 MB/s 2024-09-10T23:24:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.369 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012047 s, 87.0 MB/s 2024-09-10T23:24:48.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.384 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113865 s, 92.1 MB/s 2024-09-10T23:24:48.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.400 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123174 s, 85.1 MB/s 2024-09-10T23:24:48.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.415 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118413 s, 88.6 MB/s 2024-09-10T23:24:48.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.431 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.431 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117397 s, 89.3 MB/s 2024-09-10T23:24:48.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.446 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116724 s, 89.8 MB/s 2024-09-10T23:24:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109598 s, 95.7 MB/s 2024-09-10T23:24:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139598 s, 75.1 MB/s 2024-09-10T23:24:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.495 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128507 s, 81.6 MB/s 2024-09-10T23:24:48.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121914 s, 86.0 MB/s 2024-09-10T23:24:48.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.527 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125938 s, 83.3 MB/s 2024-09-10T23:24:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.542 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011636 s, 90.1 MB/s 2024-09-10T23:24:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120066 s, 87.3 MB/s 2024-09-10T23:24:48.574 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.574 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.574 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116958 s, 89.7 MB/s 2024-09-10T23:24:48.589 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.589 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.589 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114315 s, 91.7 MB/s 2024-09-10T23:24:48.605 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.605 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.605 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128448 s, 81.6 MB/s 2024-09-10T23:24:48.620 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.620 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.620 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113537 s, 92.4 MB/s 2024-09-10T23:24:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.635 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011491 s, 91.3 MB/s 2024-09-10T23:24:48.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.650 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106539 s, 98.4 MB/s 2024-09-10T23:24:48.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.665 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115119 s, 91.1 MB/s 2024-09-10T23:24:48.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.679 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105062 s, 99.8 MB/s 2024-09-10T23:24:48.695 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.695 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.695 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119413 s, 87.8 MB/s 2024-09-10T23:24:48.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.710 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114678 s, 91.4 MB/s 2024-09-10T23:24:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.725 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115279 s, 91.0 MB/s 2024-09-10T23:24:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118642 s, 88.4 MB/s 2024-09-10T23:24:48.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.756 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117962 s, 88.9 MB/s 2024-09-10T23:24:48.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.772 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114485 s, 91.6 MB/s 2024-09-10T23:24:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125626 s, 83.5 MB/s 2024-09-10T23:24:48.802 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.802 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.802 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111121 s, 94.4 MB/s 2024-09-10T23:24:48.818 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.818 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.818 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118036 s, 88.8 MB/s 2024-09-10T23:24:48.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:48.825 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:48.825 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:48.825 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T23:24:48.826 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:48.826 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:48.826 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:48.826 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:48.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:48.896 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.896 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.896 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114807 s, 91.3 MB/s 2024-09-10T23:24:48.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.913 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142052 s, 73.8 MB/s 2024-09-10T23:24:48.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.930 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.930 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124726 s, 84.1 MB/s 2024-09-10T23:24:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.945 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011606 s, 90.3 MB/s 2024-09-10T23:24:48.960 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.960 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.960 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011158 s, 94.0 MB/s 2024-09-10T23:24:48.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.977 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127497 s, 82.2 MB/s 2024-09-10T23:24:48.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:48.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:48.993 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120871 s, 86.8 MB/s 2024-09-10T23:24:49.009 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.009 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.009 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126189 s, 83.1 MB/s 2024-09-10T23:24:49.023 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111435 s, 94.1 MB/s 2024-09-10T23:24:49.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.038 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109571 s, 95.7 MB/s 2024-09-10T23:24:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.054 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118187 s, 88.7 MB/s 2024-09-10T23:24:49.069 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.069 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.069 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114446 s, 91.6 MB/s 2024-09-10T23:24:49.083 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.083 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.084 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111499 s, 94.0 MB/s 2024-09-10T23:24:49.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.098 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105541 s, 99.4 MB/s 2024-09-10T23:24:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106854 s, 98.1 MB/s 2024-09-10T23:24:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107254 s, 97.8 MB/s 2024-09-10T23:24:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110765 s, 94.7 MB/s 2024-09-10T23:24:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123571 s, 84.9 MB/s 2024-09-10T23:24:49.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.172 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116522 s, 90.0 MB/s 2024-09-10T23:24:49.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.191 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145114 s, 72.3 MB/s 2024-09-10T23:24:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131655 s, 79.6 MB/s 2024-09-10T23:24:49.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118877 s, 88.2 MB/s 2024-09-10T23:24:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118752 s, 88.3 MB/s 2024-09-10T23:24:49.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.264 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122666 s, 85.5 MB/s 2024-09-10T23:24:49.280 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125986 s, 83.2 MB/s 2024-09-10T23:24:49.296 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.296 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.296 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118211 s, 88.7 MB/s 2024-09-10T23:24:49.311 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.311 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.311 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112494 s, 93.2 MB/s 2024-09-10T23:24:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126426 s, 82.9 MB/s 2024-09-10T23:24:49.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.343 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119874 s, 87.5 MB/s 2024-09-10T23:24:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125593 s, 83.5 MB/s 2024-09-10T23:24:49.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.375 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118098 s, 88.8 MB/s 2024-09-10T23:24:49.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.390 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113072 s, 92.7 MB/s 2024-09-10T23:24:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:49.397 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:49.398 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:49.398 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T23:24:49.398 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:49.398 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:49.398 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:49.398 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:49.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.469 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128272 s, 81.7 MB/s 2024-09-10T23:24:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.485 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119333 s, 87.9 MB/s 2024-09-10T23:24:49.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.502 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129325 s, 81.1 MB/s 2024-09-10T23:24:49.516 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.516 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.516 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110609 s, 94.8 MB/s 2024-09-10T23:24:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.531 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106389 s, 98.6 MB/s 2024-09-10T23:24:49.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.547 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118374 s, 88.6 MB/s 2024-09-10T23:24:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111681 s, 93.9 MB/s 2024-09-10T23:24:49.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.577 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119329 s, 87.9 MB/s 2024-09-10T23:24:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115799 s, 90.6 MB/s 2024-09-10T23:24:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113254 s, 92.6 MB/s 2024-09-10T23:24:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116073 s, 90.3 MB/s 2024-09-10T23:24:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112835 s, 92.9 MB/s 2024-09-10T23:24:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112651 s, 93.1 MB/s 2024-09-10T23:24:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112721 s, 93.0 MB/s 2024-09-10T23:24:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120241 s, 87.2 MB/s 2024-09-10T23:24:49.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.699 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114004 s, 92.0 MB/s 2024-09-10T23:24:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109373 s, 95.9 MB/s 2024-09-10T23:24:49.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.730 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012317 s, 85.1 MB/s 2024-09-10T23:24:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011374 s, 92.2 MB/s 2024-09-10T23:24:49.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.761 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013147 s, 79.8 MB/s 2024-09-10T23:24:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011031 s, 95.1 MB/s 2024-09-10T23:24:49.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.792 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.792 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118079 s, 88.8 MB/s 2024-09-10T23:24:49.807 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.807 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.807 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118941 s, 88.2 MB/s 2024-09-10T23:24:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.822 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011299 s, 92.8 MB/s 2024-09-10T23:24:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130991 s, 80.0 MB/s 2024-09-10T23:24:49.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.854 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118125 s, 88.8 MB/s 2024-09-10T23:24:49.869 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.870 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.870 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114265 s, 91.8 MB/s 2024-09-10T23:24:49.885 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.885 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.885 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114755 s, 91.4 MB/s 2024-09-10T23:24:49.901 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.901 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.901 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121047 s, 86.6 MB/s 2024-09-10T23:24:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113226 s, 92.6 MB/s 2024-09-10T23:24:49.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.931 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011605 s, 90.4 MB/s 2024-09-10T23:24:49.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:49.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:49.946 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112003 s, 93.6 MB/s 2024-09-10T23:24:49.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:49.953 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:49.954 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:49.954 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T23:24:49.954 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:49.954 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:49.954 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:49.954 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:50.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:50.025 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.025 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.025 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113724 s, 92.2 MB/s 2024-09-10T23:24:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180965 s, 57.9 MB/s 2024-09-10T23:24:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122716 s, 85.4 MB/s 2024-09-10T23:24:50.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.080 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116181 s, 90.3 MB/s 2024-09-10T23:24:50.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.095 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113641 s, 92.3 MB/s 2024-09-10T23:24:50.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119127 s, 88.0 MB/s 2024-09-10T23:24:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109324 s, 95.9 MB/s 2024-09-10T23:24:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.140 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113104 s, 92.7 MB/s 2024-09-10T23:24:50.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.155 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116182 s, 90.3 MB/s 2024-09-10T23:24:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.170 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113609 s, 92.3 MB/s 2024-09-10T23:24:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112908 s, 92.9 MB/s 2024-09-10T23:24:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011382 s, 92.1 MB/s 2024-09-10T23:24:50.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.234 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113016 s, 92.8 MB/s 2024-09-10T23:24:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.249 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118892 s, 88.2 MB/s 2024-09-10T23:24:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123552 s, 84.9 MB/s 2024-09-10T23:24:50.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103074 s, 102 MB/s 2024-09-10T23:24:50.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.295 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120835 s, 86.8 MB/s 2024-09-10T23:24:50.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.309 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106889 s, 98.1 MB/s 2024-09-10T23:24:50.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.325 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115652 s, 90.7 MB/s 2024-09-10T23:24:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106659 s, 98.3 MB/s 2024-09-10T23:24:50.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.354 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113037 s, 92.8 MB/s 2024-09-10T23:24:50.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.369 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112743 s, 93.0 MB/s 2024-09-10T23:24:50.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.385 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118407 s, 88.6 MB/s 2024-09-10T23:24:50.399 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.400 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113408 s, 92.5 MB/s 2024-09-10T23:24:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115812 s, 90.5 MB/s 2024-09-10T23:24:50.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.430 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112507 s, 93.2 MB/s 2024-09-10T23:24:50.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.446 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125887 s, 83.3 MB/s 2024-09-10T23:24:50.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.462 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118918 s, 88.2 MB/s 2024-09-10T23:24:50.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113128 s, 92.7 MB/s 2024-09-10T23:24:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109412 s, 95.8 MB/s 2024-09-10T23:24:50.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.507 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120912 s, 86.7 MB/s 2024-09-10T23:24:50.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120685 s, 86.9 MB/s 2024-09-10T23:24:50.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:50.533 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:24:50.533 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:24:50.533 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T23:24:50.533 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:24:50.533 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:24:50.533 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:24:50.533 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:24:50.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:24:50.690 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.690 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.690 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123486 s, 84.9 MB/s 2024-09-10T23:24:50.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011572 s, 90.6 MB/s 2024-09-10T23:24:50.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.721 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114898 s, 91.3 MB/s 2024-09-10T23:24:50.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.737 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105713 s, 99.2 MB/s 2024-09-10T23:24:50.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.752 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133137 s, 78.8 MB/s 2024-09-10T23:24:50.767 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.767 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120577 s, 87.0 MB/s 2024-09-10T23:24:50.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131065 s, 80.0 MB/s 2024-09-10T23:24:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112927 s, 92.9 MB/s 2024-09-10T23:24:50.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.816 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129174 s, 81.2 MB/s 2024-09-10T23:24:50.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.831 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114616 s, 91.5 MB/s 2024-09-10T23:24:50.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.847 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118209 s, 88.7 MB/s 2024-09-10T23:24:50.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109321 s, 95.9 MB/s 2024-09-10T23:24:50.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.876 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113778 s, 92.2 MB/s 2024-09-10T23:24:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011306 s, 92.7 MB/s 2024-09-10T23:24:50.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.907 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117066 s, 89.6 MB/s 2024-09-10T23:24:50.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.922 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114503 s, 91.6 MB/s 2024-09-10T23:24:50.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.939 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130107 s, 80.6 MB/s 2024-09-10T23:24:50.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.955 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121411 s, 86.4 MB/s 2024-09-10T23:24:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.971 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119882 s, 87.5 MB/s 2024-09-10T23:24:50.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:50.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:50.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012456 s, 84.2 MB/s 2024-09-10T23:24:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.002 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010931 s, 95.9 MB/s 2024-09-10T23:24:51.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115036 s, 91.2 MB/s 2024-09-10T23:24:51.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119427 s, 87.8 MB/s 2024-09-10T23:24:51.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114824 s, 91.3 MB/s 2024-09-10T23:24:51.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012061 s, 86.9 MB/s 2024-09-10T23:24:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112563 s, 93.2 MB/s 2024-09-10T23:24:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120443 s, 87.1 MB/s 2024-09-10T23:24:51.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118677 s, 88.4 MB/s 2024-09-10T23:24:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.124 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110295 s, 95.1 MB/s 2024-09-10T23:24:51.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.139 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105982 s, 98.9 MB/s 2024-09-10T23:24:51.154 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.154 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.154 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118098 s, 88.8 MB/s 2024-09-10T23:24:51.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:24:51.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:24:51.170 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118325 s, 88.6 MB/s 2024-09-10T23:24:51.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:24:51.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:51.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-09-10T23:24:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.326+0000 7f0be4400640 1 -- 172.21.15.17:0/2911354199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bdc15f600 msgr2=0x7f0bdc0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.326+0000 7f0be4400640 1 --2- 172.21.15.17:0/2911354199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bdc15f600 0x7f0bdc0cc900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009c80 tx=0x7f0bd001cda0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.326+0000 7f0be4400640 1 -- 172.21.15.17:0/2911354199 shutdown_connections 2024-09-10T23:24:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.326+0000 7f0be4400640 1 --2- 172.21.15.17:0/2911354199 >> v2:172.21.15.77:3300/0 conn(0x7f0bdc0b28e0 0x7f0bdc0cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.326+0000 7f0be4400640 1 --2- 172.21.15.17:0/2911354199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bdc15f600 0x7f0bdc0cc900 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.326+0000 7f0be4400640 1 -- 172.21.15.17:0/2911354199 >> 172.21.15.17:0/2911354199 conn(0x7f0bdc09b080 msgr2=0x7f0bdc0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.326+0000 7f0be4400640 1 -- 172.21.15.17:0/2911354199 shutdown_connections 2024-09-10T23:24:51.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.326+0000 7f0be4400640 1 -- 172.21.15.17:0/2911354199 wait complete. 2024-09-10T23:24:51.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 Processor -- start 2024-09-10T23:24:51.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 -- start start 2024-09-10T23:24:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bdc0b0990 0x7f0bdc0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc0b28e0 0x7f0bdc15e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bdc15f600 0x7f0bdc14cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc169750 con 0x7f0bdc0b28e0 2024-09-10T23:24:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc1695d0 con 0x7f0bdc0b0990 2024-09-10T23:24:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc1698d0 con 0x7f0bdc15f600 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc0b28e0 0x7f0bdc15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bdc0b0990 0x7f0bdc0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc0b28e0 0x7f0bdc15e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46610/0 (socket says 172.21.15.17:46610) 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1000640 1 -- 172.21.15.17:0/2775497883 learned_addr learned my addr 172.21.15.17:0/2775497883 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be2400640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bdc15f600 0x7f0bdc14cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1a00640 1 -- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bdc15f600 msgr2=0x7f0bdc14cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1a00640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bdc15f600 0x7f0bdc14cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1a00640 1 -- 172.21.15.17:0/2775497883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc0b28e0 msgr2=0x7f0bdc15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1a00640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc0b28e0 0x7f0bdc15e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1a00640 1 -- 172.21.15.17:0/2775497883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc15ee70 con 0x7f0bdc0b0990 2024-09-10T23:24:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be1a00640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bdc0b0990 0x7f0bdc0c57e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00ac000 tx=0x7f0bd0009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0bd9600640 1 -- 172.21.15.17:0/2775497883 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00bb070 con 0x7f0bdc0b0990 2024-09-10T23:24:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0bd9600640 1 -- 172.21.15.17:0/2775497883 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bd0004d40 con 0x7f0bdc0b0990 2024-09-10T23:24:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0bd9600640 1 -- 172.21.15.17:0/2775497883 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00b2040 con 0x7f0bdc0b0990 2024-09-10T23:24:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 -- 172.21.15.17:0/2775497883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bdc158c30 con 0x7f0bdc0b0990 2024-09-10T23:24:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.330+0000 7f0be4400640 1 -- 172.21.15.17:0/2775497883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bdc15b2c0 con 0x7f0bdc0b0990 2024-09-10T23:24:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.334+0000 7f0bd9600640 1 -- 172.21.15.17:0/2775497883 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0bd00b5030 con 0x7f0bdc0b0990 2024-09-10T23:24:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.334+0000 7f0bd9600640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0bbc0725e0 0x7f0bbc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.334+0000 7f0bd9600640 1 -- 172.21.15.17:0/2775497883 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f0bd012cf20 con 0x7f0bdc0b0990 2024-09-10T23:24:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.334+0000 7f0be1000640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0bbc0725e0 0x7f0bbc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.334+0000 7f0be779c000 1 Processor -- start 2024-09-10T23:24:51.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.334+0000 7f0be779c000 1 -- start start 2024-09-10T23:24:51.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be1000640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0bbc0725e0 0x7f0bbc074aa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0cd550 tx=0x7f0bc8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378ef060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 0x5577378a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378a5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5577377008f0 con 0x5577378a53a0 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5577376efd20 con 0x5577378ef5a0 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5577376f3b30 con 0x5577378eec80 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46622/0 (socket says 172.21.15.17:46622) 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be2400640 1 -- 172.21.15.17:0/3573472147 learned_addr learned my addr 172.21.15.17:0/3573472147 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be1a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be1000640 1 --2- 172.21.15.17:0/3573472147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 0x5577378a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be2400640 1 -- 172.21.15.17:0/3573472147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 msgr2=0x5577378ef060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be2400640 1 --2- 172.21.15.17:0/3573472147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378ef060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be2400640 1 -- 172.21.15.17:0/3573472147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 msgr2=0x5577378a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be2400640 1 --2- 172.21.15.17:0/3573472147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 0x5577378a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be2400640 1 -- 172.21.15.17:0/3573472147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55773768e2c0 con 0x5577378a53a0 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be2400640 1 --2- 172.21.15.17:0/3573472147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378a5780 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009c30 tx=0x7f0bd4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f5b1cc1d028b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0bce000640 1 -- 172.21.15.17:0/3573472147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd401e070 con 0x5577378a53a0 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0bce000640 1 -- 172.21.15.17:0/3573472147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bd4019720 con 0x5577378a53a0 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0bce000640 1 -- 172.21.15.17:0/3573472147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4019b30 con 0x5577378a53a0 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 -- 172.21.15.17:0/3573472147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 msgr2=0x5577378a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 --2- 172.21.15.17:0/3573472147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378a5780 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009c30 tx=0x7f0bd4011810 comp rx=0 tx=0).stop 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 -- 172.21.15.17:0/3573472147 shutdown_connections 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 --2- 172.21.15.17:0/3573472147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378a5780 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 --2- 172.21.15.17:0/3573472147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 0x5577378a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 --2- 172.21.15.17:0/3573472147 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378ef060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 -- 172.21.15.17:0/3573472147 >> 172.21.15.17:0/3573472147 conn(0x5577378a1350 msgr2=0x5577378a3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 -- 172.21.15.17:0/3573472147 shutdown_connections 2024-09-10T23:24:51.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 -- 172.21.15.17:0/3573472147 wait complete. 2024-09-10T23:24:51.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 -- start start 2024-09-10T23:24:51.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.338+0000 7f0be779c000 1 Processor -- start 2024-09-10T23:24:51.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378f6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 0x5577378f6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557737699cf0 con 0x5577378a53a0 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55773769b2c0 con 0x5577378ef5a0 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5577376ff6c0 con 0x5577378eec80 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 10 client.0 _ll_register_callbacks cb 0x557737890770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378f5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46626/0 (socket says 172.21.15.17:46626) 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1a00640 1 -- 172.21.15.17:0/4288852145 learned_addr learned my addr 172.21.15.17:0/4288852145 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be2400640 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 0x5577378f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1000640 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1a00640 1 -- 172.21.15.17:0/4288852145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 msgr2=0x5577378f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1a00640 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1a00640 1 -- 172.21.15.17:0/4288852145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 msgr2=0x5577378f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1a00640 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 0x5577378f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1a00640 1 -- 172.21.15.17:0/4288852145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577376ad230 con 0x5577378a53a0 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be2400640 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 0x5577378f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1a00640 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378f5bf0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00f7a80 tx=0x7f0bd00f82d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e168fd82621686ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0bc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0bc2a00640 1 -- 172.21.15.17:0/4288852145 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00f74f0 con 0x5577378a53a0 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0bc2a00640 1 -- 172.21.15.17:0/4288852145 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f0bd00f36d0 con 0x5577378a53a0 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 -- 172.21.15.17:0/4288852145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557737688400 con 0x5577378a53a0 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0bc2a00640 1 -- 172.21.15.17:0/4288852145 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f0bd00ad440 con 0x5577378a53a0 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 10 client.8394 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 -- 172.21.15.17:0/4288852145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x557737675010 con 0x5577378a53a0 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0bc2a00640 1 -- 172.21.15.17:0/4288852145 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557737688400 con 0x5577378a53a0 2024-09-10T23:24:51.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0bc2a00640 1 -- 172.21.15.17:0/4288852145 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f0bd00f38d0 con 0x5577378a53a0 2024-09-10T23:24:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 10 client.8394 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 10 client.8394 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-10T23:24:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 20 client.8394 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x5577378fdfc0 0x5577379003b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 4 client.8394 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:51.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be779c000 1 -- 172.21.15.17:0/4288852145 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557737702840 con 0x5577378fdfc0 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1000640 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x5577378fdfc0 0x5577379003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0be1000640 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x5577378fdfc0 0x5577379003b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecdfb238f0e07496 server_cookie=91f1e9c1fa8e3953 in_seq=0 out_seq=0 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0bc2a00640 10 client.8394 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0bc2a00640 1 -- 172.21.15.17:0/4288852145 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557737702840 con 0x5577378fdfc0 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.342+0000 7f0bc2a00640 10 client.8394 handle_command_reply: tid=0 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 client.8394 shutdown 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 -- 172.21.15.17:0/4288852145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 msgr2=0x5577378f5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378f5bf0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00f7a80 tx=0x7f0bd00f82d0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 -- 172.21.15.17:0/4288852145 shutdown_connections 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x5577378fdfc0 0x5577379003b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378ef5a0 0x5577378f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 --2- 172.21.15.17:0/4288852145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378f5bf0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0bc2a00640 0 client.8394 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 -- 172.21.15.17:0/4288852145 >> 172.21.15.17:0/4288852145 conn(0x5577378a1350 msgr2=0x5577378a3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 -- 172.21.15.17:0/4288852145 shutdown_connections 2024-09-10T23:24:51.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 1 -- 172.21.15.17:0/4288852145 wait complete. 2024-09-10T23:24:51.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.346+0000 7f0be779c000 20 client.8394 trim_cache size 0 max 16384 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.362+0000 7f0be779c000 1 Processor -- start 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.362+0000 7f0be779c000 1 -- start start 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.362+0000 7f0be779c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a1350 0x5577378a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.362+0000 7f0be779c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a53a0 0x5577378aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.362+0000 7f0be779c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.362+0000 7f0be779c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc203df0 con 0x5577378a1350 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.362+0000 7f0be779c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc15c820 con 0x5577378a53a0 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.362+0000 7f0be779c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0bdc154c60 con 0x5577378eec80 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a1350 0x5577378a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a53a0 0x5577378aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be2400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a1350 0x5577378a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46634/0 (socket says 172.21.15.17:46634) 2024-09-10T23:24:51.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 -- 172.21.15.17:0/3345620239 learned_addr learned my addr 172.21.15.17:0/3345620239 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 -- 172.21.15.17:0/3345620239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 msgr2=0x5577378f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 --2- 172.21.15.17:0/3345620239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378f8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 -- 172.21.15.17:0/3345620239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a53a0 msgr2=0x5577378aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 --2- 172.21.15.17:0/3345620239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a53a0 0x5577378aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 -- 172.21.15.17:0/3345620239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55773774c320 con 0x5577378a1350 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 --2- 172.21.15.17:0/3345620239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a1350 0x5577378a9df0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00f7d10 tx=0x7f0bd00f3c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36737e83572097aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0bcd600640 1 -- 172.21.15.17:0/3345620239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00f43d0 con 0x5577378a1350 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0bcd600640 1 -- 172.21.15.17:0/3345620239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bd00f7890 con 0x5577378a1350 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0bcd600640 1 -- 172.21.15.17:0/3345620239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd01011d0 con 0x5577378a1350 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 -- 172.21.15.17:0/3345620239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a1350 msgr2=0x5577378a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 --2- 172.21.15.17:0/3345620239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a1350 0x5577378a9df0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00f7d10 tx=0x7f0bd00f3c80 comp rx=0 tx=0).stop 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 -- 172.21.15.17:0/3345620239 shutdown_connections 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 --2- 172.21.15.17:0/3345620239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577378f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 --2- 172.21.15.17:0/3345620239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a53a0 0x5577378aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 --2- 172.21.15.17:0/3345620239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a1350 0x5577378a9df0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 -- 172.21.15.17:0/3345620239 >> 172.21.15.17:0/3345620239 conn(0x5577378a74e0 msgr2=0x5577378a4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 -- 172.21.15.17:0/3345620239 shutdown_connections 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 -- 172.21.15.17:0/3345620239 wait complete. 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 -- start start 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 Processor -- start 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a1350 0x5577378fb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378fb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577379228e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5577376f2e40 con 0x5577378a53a0 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5577376af830 con 0x5577378a1350 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5577376f8160 con 0x5577378eec80 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be779c000 10 client.0 _ll_register_callbacks cb 0x7f0bd00095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378fb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378fb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46638/0 (socket says 172.21.15.17:46638) 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1000640 1 -- 172.21.15.17:0/1164223724 learned_addr learned my addr 172.21.15.17:0/1164223724 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a1350 0x5577378fb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be2400640 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577379228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1000640 1 -- 172.21.15.17:0/1164223724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 msgr2=0x5577379228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1000640 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577379228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1000640 1 -- 172.21.15.17:0/1164223724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a1350 msgr2=0x5577378fb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1000640 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a1350 0x5577378fb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.366+0000 7f0be1000640 1 -- 172.21.15.17:0/1164223724 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577376b8d60 con 0x5577378a53a0 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be1000640 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378fb950 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800ff00 tx=0x7f0bc8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b67dba4316b193a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0bc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0bc2a00640 1 -- 172.21.15.17:0/1164223724 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8023720 con 0x5577378a53a0 2024-09-10T23:24:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0bc2a00640 1 -- 172.21.15.17:0/1164223724 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f0bc8010040 con 0x5577378a53a0 2024-09-10T23:24:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be779c000 1 -- 172.21.15.17:0/1164223724 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bd00f7890 con 0x5577378a53a0 2024-09-10T23:24:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0bc2a00640 1 -- 172.21.15.17:0/1164223724 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f0bc8037050 con 0x5577378a53a0 2024-09-10T23:24:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be779c000 10 client.8400 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be779c000 1 -- 172.21.15.17:0/1164223724 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x5577373a61a0 con 0x5577378a53a0 2024-09-10T23:24:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0bc2a00640 1 -- 172.21.15.17:0/1164223724 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bd00f7890 con 0x5577378a53a0 2024-09-10T23:24:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0bc2a00640 1 -- 172.21.15.17:0/1164223724 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f0bc803a020 con 0x5577378a53a0 2024-09-10T23:24:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be779c000 10 client.8400 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be779c000 10 client.8400 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-10T23:24:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be779c000 20 client.8400 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be779c000 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x5577378ef5a0 0x557737965d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be779c000 4 client.8400 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T23:24:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be779c000 1 -- 172.21.15.17:0/1164223724 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5577379066d0 con 0x5577378ef5a0 2024-09-10T23:24:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be1a00640 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x5577378ef5a0 0x557737965d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0be1a00640 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x5577378ef5a0 0x557737965d10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a87b7d5be4f19bb server_cookie=199536ae401d75d6 in_seq=0 out_seq=0 2024-09-10T23:24:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.370+0000 7f0bc2a00640 10 client.8400 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0bc2a00640 1 -- 172.21.15.17:0/1164223724 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5577379066d0 con 0x5577378ef5a0 2024-09-10T23:24:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0bc2a00640 10 client.8400 handle_command_reply: tid=0 2024-09-10T23:24:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 client.8400 shutdown 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 -- 172.21.15.17:0/1164223724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 msgr2=0x5577378fb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378fb950 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800ff00 tx=0x7f0bc8000ee0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 -- 172.21.15.17:0/1164223724 shutdown_connections 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x5577378ef5a0 0x557737965d10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5577378eec80 0x5577379228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5577378a53a0 0x5577378fb950 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 --2- 172.21.15.17:0/1164223724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5577378a1350 0x5577378fb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 -- 172.21.15.17:0/1164223724 >> 172.21.15.17:0/1164223724 conn(0x5577378a74e0 msgr2=0x5577378aa610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0bc2a00640 0 client.8400 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 -- 172.21.15.17:0/1164223724 shutdown_connections 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 1 -- 172.21.15.17:0/1164223724 wait complete. 2024-09-10T23:24:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be779c000 20 client.8400 trim_cache size 0 max 16384 2024-09-10T23:24:51.380 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:24:51.380 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:24:51.380 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "e8a539f6-f61c-4148-92a3-a7f76e0567fd", 2024-09-10T23:24:51.380 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:24:51.380 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 -- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0bbc0725e0 msgr2=0x7f0bbc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0bbc0725e0 0x7f0bbc074aa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0cd550 tx=0x7f0bc8009040 comp rx=0 tx=0).stop 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 -- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bdc0b0990 msgr2=0x7f0bdc0c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bdc0b0990 0x7f0bdc0c57e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00ac000 tx=0x7f0bd0009340 comp rx=0 tx=0).stop 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 -- 172.21.15.17:0/2775497883 shutdown_connections 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0bbc0725e0 0x7f0bbc074aa0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0bdc15f600 0x7f0bdc14cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc0b28e0 0x7f0bdc15e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 --2- 172.21.15.17:0/2775497883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bdc0b0990 0x7f0bdc0c57e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 -- 172.21.15.17:0/2775497883 >> 172.21.15.17:0/2775497883 conn(0x7f0bdc09b080 msgr2=0x7f0bdc0aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 -- 172.21.15.17:0/2775497883 shutdown_connections 2024-09-10T23:24:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.374+0000 7f0be4400640 1 -- 172.21.15.17:0/2775497883 wait complete. 2024-09-10T23:24:51.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:51.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-09-10T23:24:51.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.610+0000 7f7e9e200640 1 -- 172.21.15.17:0/1312818736 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980b30e0 msgr2=0x7f7e981654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.610+0000 7f7e9e200640 1 --2- 172.21.15.17:0/1312818736 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980b30e0 0x7f7e981654c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009bc0 tx=0x7f7e9001ca90 comp rx=0 tx=0).stop 2024-09-10T23:24:51.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.610+0000 7f7e9e200640 1 -- 172.21.15.17:0/1312818736 shutdown_connections 2024-09-10T23:24:51.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.610+0000 7f7e9e200640 1 --2- 172.21.15.17:0/1312818736 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980b30e0 0x7f7e981654c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.610+0000 7f7e9e200640 1 --2- 172.21.15.17:0/1312818736 >> v2:172.21.15.77:3300/0 conn(0x7f7e9815b8c0 0x7f7e980d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.610+0000 7f7e9e200640 1 -- 172.21.15.17:0/1312818736 >> 172.21.15.17:0/1312818736 conn(0x7f7e9809a9f0 msgr2=0x7f7e9809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.610+0000 7f7e9e200640 1 -- 172.21.15.17:0/1312818736 shutdown_connections 2024-09-10T23:24:51.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.610+0000 7f7e9e200640 1 -- 172.21.15.17:0/1312818736 wait complete. 2024-09-10T23:24:51.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9e200640 1 Processor -- start 2024-09-10T23:24:51.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9e200640 1 -- start start 2024-09-10T23:24:51.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980b30e0 0x7f7e981523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e980d06b0 0x7f7e98157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9815b8c0 0x7f7e981517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9e200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98168c90 con 0x7f7e980d06b0 2024-09-10T23:24:51.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98168b10 con 0x7f7e9815b8c0 2024-09-10T23:24:51.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e98168e10 con 0x7f7e980b30e0 2024-09-10T23:24:51.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e980d06b0 0x7f7e98157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980b30e0 0x7f7e981523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e980d06b0 0x7f7e98157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46650/0 (socket says 172.21.15.17:46650) 2024-09-10T23:24:51.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e97e00640 1 -- 172.21.15.17:0/474442824 learned_addr learned my addr 172.21.15.17:0/474442824 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9d800640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9815b8c0 0x7f7e981517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9ce00640 1 -- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9815b8c0 msgr2=0x7f7e981517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9815b8c0 0x7f7e981517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9ce00640 1 -- 172.21.15.17:0/474442824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e980d06b0 msgr2=0x7f7e98157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e980d06b0 0x7f7e98157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9ce00640 1 -- 172.21.15.17:0/474442824 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e980b4ab0 con 0x7f7e980b30e0 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e9d800640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9815b8c0 0x7f7e981517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.614+0000 7f7e97e00640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e980d06b0 0x7f7e98157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.618+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980b30e0 0x7f7e981523c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00e9f0 tx=0x7f7e8c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.618+0000 7f7e94c00640 1 -- 172.21.15.17:0/474442824 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00ccc0 con 0x7f7e980b30e0 2024-09-10T23:24:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.618+0000 7f7e94c00640 1 -- 172.21.15.17:0/474442824 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e8c004020 con 0x7f7e980b30e0 2024-09-10T23:24:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.618+0000 7f7e94c00640 1 -- 172.21.15.17:0/474442824 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00ce60 con 0x7f7e980b30e0 2024-09-10T23:24:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.618+0000 7f7e9e200640 1 -- 172.21.15.17:0/474442824 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e981fb510 con 0x7f7e980b30e0 2024-09-10T23:24:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.618+0000 7f7e9e200640 1 -- 172.21.15.17:0/474442824 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e981fb7f0 con 0x7f7e980b30e0 2024-09-10T23:24:51.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.618+0000 7f7e94c00640 1 -- 172.21.15.17:0/474442824 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7e8c003600 con 0x7f7e980b30e0 2024-09-10T23:24:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7ea2bde000 1 Processor -- start 2024-09-10T23:24:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7ea2bde000 1 -- start start 2024-09-10T23:24:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e94c00640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e78072630 0x7f7e78074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e94c00640 1 -- 172.21.15.17:0/474442824 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f7e8c093c20 con 0x7f7e980b30e0 2024-09-10T23:24:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e78072630 0x7f7e78074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc13e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cc143d0 0x562c0cc147b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cbca5a0 0x562c0cbca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562c0c9c82c0 con 0x562c0cab21d0 2024-09-10T23:24:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c0ca25b90 con 0x562c0cbca5a0 2024-09-10T23:24:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562c0ca14fc0 con 0x562c0cc143d0 2024-09-10T23:24:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cbca5a0 0x562c0cbca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc13e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e97e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cc143d0 0x562c0cc147b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cbca5a0 0x562c0cbca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:59594/0 (socket says 172.21.15.17:59594) 2024-09-10T23:24:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc13e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46652/0 (socket says 172.21.15.17:46652) 2024-09-10T23:24:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 -- 172.21.15.17:0/3295256105 learned_addr learned my addr 172.21.15.17:0/3295256105 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e78072630 0x7f7e78074af0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7e900af000 tx=0x7f7e9001b2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 -- 172.21.15.17:0/3295256105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cc143d0 msgr2=0x562c0cc147b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 --2- 172.21.15.17:0/3295256105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cc143d0 0x562c0cc147b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 -- 172.21.15.17:0/3295256105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 msgr2=0x562c0cc13e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 --2- 172.21.15.17:0/3295256105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc13e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 -- 172.21.15.17:0/3295256105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0c9b31a0 con 0x562c0cbca5a0 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e9d800640 1 --2- 172.21.15.17:0/3295256105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cbca5a0 0x562c0cbca980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7e9001c500 tx=0x7f7e900b9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e52c2d51dd2362 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e89600640 1 -- 172.21.15.17:0/3295256105 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e900b2040 con 0x562c0cbca5a0 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e89600640 1 -- 172.21.15.17:0/3295256105 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e900c7070 con 0x562c0cbca5a0 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.622+0000 7f7e89600640 1 -- 172.21.15.17:0/3295256105 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e900a57b0 con 0x562c0cbca5a0 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3295256105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cbca5a0 msgr2=0x562c0cbca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3295256105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cbca5a0 0x562c0cbca980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7e9001c500 tx=0x7f7e900b9000 comp rx=0 tx=0).stop 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3295256105 shutdown_connections 2024-09-10T23:24:51.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3295256105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cbca5a0 0x562c0cbca980 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3295256105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cc143d0 0x562c0cc147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3295256105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc13e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3295256105 >> 172.21.15.17:0/3295256105 conn(0x562c0c6d3880 msgr2=0x562c0cbc8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3295256105 shutdown_connections 2024-09-10T23:24:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3295256105 wait complete. 2024-09-10T23:24:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 -- start start 2024-09-10T23:24:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 Processor -- start 2024-09-10T23:24:51.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc1aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc1af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc1b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562c0c9ba4d0 con 0x562c0cbca5a0 2024-09-10T23:24:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c0ca18dd0 con 0x562c0cc143d0 2024-09-10T23:24:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.626+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562c0c6da620 con 0x562c0cab21d0 2024-09-10T23:24:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 10 client.0 _ll_register_callbacks cb 0x562c0c9ebcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc1aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc1aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:58138/0 (socket says 172.21.15.17:58138) 2024-09-10T23:24:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9ce00640 1 -- 172.21.15.17:0/2958420771 learned_addr learned my addr 172.21.15.17:0/2958420771 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9d800640 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc1b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e97e00640 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc1af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9ce00640 1 -- 172.21.15.17:0/2958420771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 msgr2=0x562c0cc1b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc1b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9ce00640 1 -- 172.21.15.17:0/2958420771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 msgr2=0x562c0cc1af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc1af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9ce00640 1 -- 172.21.15.17:0/2958420771 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x562c0cae4720 con 0x562c0cab21d0 2024-09-10T23:24:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc1aa20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c091fa0 tx=0x7f7e8c05f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=902404b318d35423 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e7e000640 10 client.0 ms_handle_connect on v2:172.21.15.77:3301/0 2024-09-10T23:24:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e7e000640 1 -- 172.21.15.17:0/2958420771 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c063530 con 0x562c0cab21d0 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e7e000640 1 -- 172.21.15.17:0/2958420771 <== mon.2 v2:172.21.15.77:3301/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f7e8c05eec0 con 0x562c0cab21d0 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 1 -- 172.21.15.17:0/2958420771 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c0c9ad2e0 con 0x562c0cab21d0 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e7e000640 1 -- 172.21.15.17:0/2958420771 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f7e8c067f50 con 0x562c0cab21d0 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 10 client.7043 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 1 -- 172.21.15.17:0/2958420771 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x562c0ca9a420 con 0x562c0cab21d0 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e7e000640 1 -- 172.21.15.17:0/2958420771 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562c0c9ad2e0 con 0x562c0cab21d0 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e7e000640 1 -- 172.21.15.17:0/2958420771 <== mon.2 v2:172.21.15.77:3301/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f7e8c067ac0 con 0x562c0cab21d0 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 10 client.7043 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 10 client.7043 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-10T23:24:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 20 client.7043 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:51.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x562c0cc22df0 0x562c0cc251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 4 client.7043 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:51.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7ea2bde000 1 -- 172.21.15.17:0/2958420771 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c0ca27ae0 con 0x562c0cc22df0 2024-09-10T23:24:51.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e97e00640 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x562c0cc22df0 0x562c0cc251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e7e000640 10 client.7043 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.630+0000 7f7e97e00640 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x562c0cc22df0 0x562c0cc251e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b031f03c7c81ba5 server_cookie=7aa68d36ae69bcf4 in_seq=0 out_seq=0 2024-09-10T23:24:51.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7e7e000640 1 -- 172.21.15.17:0/2958420771 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c0ca27ae0 con 0x562c0cc22df0 2024-09-10T23:24:51.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7e7e000640 10 client.7043 handle_command_reply: tid=0 2024-09-10T23:24:51.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 client.7043 shutdown 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 -- 172.21.15.17:0/2958420771 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 msgr2=0x562c0cc1aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc1aa20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c091fa0 tx=0x7f7e8c05f210 comp rx=0 tx=0).stop 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 -- 172.21.15.17:0/2958420771 shutdown_connections 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x562c0cc22df0 0x562c0cc251e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc1b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc1af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/2958420771 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc1aa20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7e7e000640 0 client.7043 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 -- 172.21.15.17:0/2958420771 >> 172.21.15.17:0/2958420771 conn(0x562c0c6d3880 msgr2=0x562c0cbc9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 -- 172.21.15.17:0/2958420771 shutdown_connections 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 1 -- 172.21.15.17:0/2958420771 wait complete. 2024-09-10T23:24:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.634+0000 7f7ea2bde000 20 client.7043 trim_cache size 0 max 16384 2024-09-10T23:24:51.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.666+0000 7f7ea2bde000 1 Processor -- start 2024-09-10T23:24:51.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.666+0000 7f7ea2bde000 1 -- start start 2024-09-10T23:24:51.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc86540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc86a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc86fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98204380 con 0x562c0cbca5a0 2024-09-10T23:24:51.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e982033c0 con 0x562c0cc143d0 2024-09-10T23:24:51.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e98156330 con 0x562c0cab21d0 2024-09-10T23:24:51.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc86a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc86a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46662/0 (socket says 172.21.15.17:46662) 2024-09-10T23:24:51.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e97e00640 1 -- 172.21.15.17:0/652578178 learned_addr learned my addr 172.21.15.17:0/652578178 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e9d800640 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc86fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc86540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e97e00640 1 -- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 msgr2=0x562c0cc86540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e97e00640 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc86540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e97e00640 1 -- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 msgr2=0x562c0cc86fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e97e00640 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc86fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e97e00640 1 -- 172.21.15.17:0/652578178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0ca71ae0 con 0x562c0cbca5a0 2024-09-10T23:24:51.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e9d800640 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc86fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:51.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc86540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:51.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e97e00640 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc86a80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f7e980c8830 tx=0x7f7e84009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7653faa5312d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e88c00640 1 -- 172.21.15.17:0/652578178 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84014da0 con 0x562c0cbca5a0 2024-09-10T23:24:51.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e88c00640 1 -- 172.21.15.17:0/652578178 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e84004020 con 0x562c0cbca5a0 2024-09-10T23:24:51.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7e88c00640 1 -- 172.21.15.17:0/652578178 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84004250 con 0x562c0cbca5a0 2024-09-10T23:24:51.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 -- 172.21.15.17:0/652578178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 msgr2=0x562c0cc86a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc86a80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f7e980c8830 tx=0x7f7e84009040 comp rx=0 tx=0).stop 2024-09-10T23:24:51.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 -- 172.21.15.17:0/652578178 shutdown_connections 2024-09-10T23:24:51.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc86fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cbca5a0 0x562c0cc86a80 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/652578178 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cab21d0 0x562c0cc86540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 -- 172.21.15.17:0/652578178 >> 172.21.15.17:0/652578178 conn(0x562c0c6d3880 msgr2=0x562c0cbd0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 -- 172.21.15.17:0/652578178 shutdown_connections 2024-09-10T23:24:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 -- 172.21.15.17:0/652578178 wait complete. 2024-09-10T23:24:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.670+0000 7f7ea2bde000 1 -- start start 2024-09-10T23:24:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 Processor -- start 2024-09-10T23:24:51.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc8a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cbca5a0 0x562c0cc8aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc8b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562c0c9c0020 con 0x562c0cab21d0 2024-09-10T23:24:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98202d70 con 0x562c0cc143d0 2024-09-10T23:24:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562c0ca180e0 con 0x562c0cbca5a0 2024-09-10T23:24:51.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 10 client.0 _ll_register_callbacks cb 0x7f7e8c05e8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e9ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc8a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e97e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cbca5a0 0x562c0cc8aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e9ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc8a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46668/0 (socket says 172.21.15.17:46668) 2024-09-10T23:24:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e9ce00640 1 -- 172.21.15.17:0/3531944560 learned_addr learned my addr 172.21.15.17:0/3531944560 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e9d800640 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc8b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e97e00640 1 -- 172.21.15.17:0/3531944560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 msgr2=0x562c0cc8b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e97e00640 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc8b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e97e00640 1 -- 172.21.15.17:0/3531944560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 msgr2=0x562c0cc8a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e97e00640 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc8a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e97e00640 1 -- 172.21.15.17:0/3531944560 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x562c0c9df040 con 0x562c0cbca5a0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc8a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e97e00640 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cbca5a0 0x562c0cc8aac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e84020000 tx=0x7f7e840143e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e779dab646586d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e7e000640 10 client.0 ms_handle_connect on v2:172.21.15.77:3301/0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e7e000640 1 -- 172.21.15.17:0/3531944560 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8402a020 con 0x562c0cbca5a0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e7e000640 1 -- 172.21.15.17:0/3531944560 <== mon.2 v2:172.21.15.77:3301/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f7e84017a80 con 0x562c0cbca5a0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3531944560 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e84004020 con 0x562c0cbca5a0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e7e000640 1 -- 172.21.15.17:0/3531944560 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f7e84017c80 con 0x562c0cbca5a0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 10 client.7046 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3531944560 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x562c0c9ab620 con 0x562c0cbca5a0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e7e000640 1 -- 172.21.15.17:0/3531944560 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e84004020 con 0x562c0cbca5a0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e7e000640 1 -- 172.21.15.17:0/3531944560 <== mon.2 v2:172.21.15.77:3301/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f7e84003600 con 0x562c0cbca5a0 2024-09-10T23:24:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 10 client.7046 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:51.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 10 client.7046 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-10T23:24:51.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 20 client.7046 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:51.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x562c0cc292f0 0x562c0cc296d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 4 client.7046 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-10T23:24:51.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3531944560 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x562c0ca23590 con 0x562c0cc292f0 2024-09-10T23:24:51.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.674+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x562c0cc292f0 0x562c0cc296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.678+0000 7f7e9ce00640 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x562c0cc292f0 0x562c0cc296d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9fdb0a594bc8c4f server_cookie=fed7c15f12559ba6 in_seq=0 out_seq=0 2024-09-10T23:24:51.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.678+0000 7f7e7e000640 10 client.7046 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7e7e000640 1 -- 172.21.15.17:0/3531944560 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562c0ca23590 con 0x562c0cc292f0 2024-09-10T23:24:51.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7e7e000640 10 client.7046 handle_command_reply: tid=0 2024-09-10T23:24:51.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 client.7046 shutdown 2024-09-10T23:24:51.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3531944560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cbca5a0 msgr2=0x562c0cc8aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cbca5a0 0x562c0cc8aac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e84020000 tx=0x7f7e840143e0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3531944560 shutdown_connections 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x562c0cc292f0 0x562c0cc296d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c0cc143d0 0x562c0cc8b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c0cbca5a0 0x562c0cc8aac0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7e7e000640 0 client.7046 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 --2- 172.21.15.17:0/3531944560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c0cab21d0 0x562c0cc8a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3531944560 >> 172.21.15.17:0/3531944560 conn(0x562c0c6d3880 msgr2=0x562c0cbc8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3531944560 shutdown_connections 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 1 -- 172.21.15.17:0/3531944560 wait complete. 2024-09-10T23:24:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7ea2bde000 20 client.7046 trim_cache size 0 max 16384 2024-09-10T23:24:51.691 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:24:51.691 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:24:51.691 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:24:51.691 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:24:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7e9e200640 1 -- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e78072630 msgr2=0x7f7e78074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7e9e200640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e78072630 0x7f7e78074af0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7e900af000 tx=0x7f7e9001b2d0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7e9e200640 1 -- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980b30e0 msgr2=0x7f7e981523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.682+0000 7f7e9e200640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980b30e0 0x7f7e981523c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00e9f0 tx=0x7f7e8c00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.686+0000 7f7e9e200640 1 -- 172.21.15.17:0/474442824 shutdown_connections 2024-09-10T23:24:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.686+0000 7f7e9e200640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e78072630 0x7f7e78074af0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.686+0000 7f7e9e200640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9815b8c0 0x7f7e981517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.686+0000 7f7e9e200640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e980d06b0 0x7f7e98157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.686+0000 7f7e9e200640 1 --2- 172.21.15.17:0/474442824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e980b30e0 0x7f7e981523c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.686+0000 7f7e9e200640 1 -- 172.21.15.17:0/474442824 >> 172.21.15.17:0/474442824 conn(0x7f7e9809a9f0 msgr2=0x7f7e980afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.686+0000 7f7e9e200640 1 -- 172.21.15.17:0/474442824 shutdown_connections 2024-09-10T23:24:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.686+0000 7f7e9e200640 1 -- 172.21.15.17:0/474442824 wait complete. 2024-09-10T23:24:51.707 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T23:24:51.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-10T23:24:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.866+0000 7f74ab400640 1 -- 172.21.15.17:0/2340063384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74a4074660 msgr2=0x7f74a4072fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.866+0000 7f74ab400640 1 --2- 172.21.15.17:0/2340063384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74a4074660 0x7f74a4072fc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f749c009bf0 tx=0x7f749c01cac0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.866+0000 7f74ab400640 1 -- 172.21.15.17:0/2340063384 shutdown_connections 2024-09-10T23:24:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.866+0000 7f74ab400640 1 --2- 172.21.15.17:0/2340063384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74a4074660 0x7f74a4072fc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.866+0000 7f74ab400640 1 -- 172.21.15.17:0/2340063384 >> 172.21.15.17:0/2340063384 conn(0x7f74a40b17a0 msgr2=0x7f74a40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.866+0000 7f74ab400640 1 -- 172.21.15.17:0/2340063384 shutdown_connections 2024-09-10T23:24:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.866+0000 7f74ab400640 1 -- 172.21.15.17:0/2340063384 wait complete. 2024-09-10T23:24:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 Processor -- start 2024-09-10T23:24:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 -- start start 2024-09-10T23:24:51.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74a40741d0 0x7f74a413dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74a4074660 0x7f74a4154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a41457c0 0x7f74a4154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f74a4073950 con 0x7f74a41457c0 2024-09-10T23:24:51.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f74a40737d0 con 0x7f74a40741d0 2024-09-10T23:24:51.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f74a416a120 con 0x7f74a4074660 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a41457c0 0x7f74a4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a41457c0 0x7f74a4154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46672/0 (socket says 172.21.15.17:46672) 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a9400640 1 -- 172.21.15.17:0/3678444324 learned_addr learned my addr 172.21.15.17:0/3678444324 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a3e00640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74a4074660 0x7f74a4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a8a00640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74a40741d0 0x7f74a413dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a9400640 1 -- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74a4074660 msgr2=0x7f74a4154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a9400640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74a4074660 0x7f74a4154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a9400640 1 -- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74a40741d0 msgr2=0x7f74a413dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a9400640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74a40741d0 0x7f74a413dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a9400640 1 -- 172.21.15.17:0/3678444324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a41fa730 con 0x7f74a41457c0 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a3e00640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74a4074660 0x7f74a4154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a9400640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a41457c0 0x7f74a4154950 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f749c01a6f0 tx=0x7f749c0092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a0c00640 1 -- 172.21.15.17:0/3678444324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c0b2040 con 0x7f74a41457c0 2024-09-10T23:24:51.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a0c00640 1 -- 172.21.15.17:0/3678444324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f749c004200 con 0x7f74a41457c0 2024-09-10T23:24:51.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74a0c00640 1 -- 172.21.15.17:0/3678444324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c004610 con 0x7f74a41457c0 2024-09-10T23:24:51.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 -- 172.21.15.17:0/3678444324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a41faa10 con 0x7f74a41457c0 2024-09-10T23:24:51.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.870+0000 7f74ab400640 1 -- 172.21.15.17:0/3678444324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a41fb2b0 con 0x7f74a41457c0 2024-09-10T23:24:51.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a0c00640 1 -- 172.21.15.17:0/3678444324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f749c0b5070 con 0x7f74a41457c0 2024-09-10T23:24:51.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a0c00640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7484072610 0x7f7484074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a0c00640 1 -- 172.21.15.17:0/3678444324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f749c12d900 con 0x7f74a41457c0 2024-09-10T23:24:51.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74ae7c3000 1 Processor -- start 2024-09-10T23:24:51.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74ae7c3000 1 -- start start 2024-09-10T23:24:51.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a8a00640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7484072610 0x7f7484074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a8a00640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7484072610 0x7f7484074ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7498000f70 tx=0x7f7498009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 0x560768ed3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768e89680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768e89fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560768d71cb0 con 0x560768ed3ac0 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560768c87310 con 0x560768e89bc0 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560768ce4b90 con 0x560768ed31a0 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768e89680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768e89680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46682/0 (socket says 172.21.15.17:46682) 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a3e00640 1 -- 172.21.15.17:0/2228851934 learned_addr learned my addr 172.21.15.17:0/2228851934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a8a00640 1 --2- 172.21.15.17:0/2228851934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 0x560768ed3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a9400640 1 --2- 172.21.15.17:0/2228851934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768e89fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a3e00640 1 -- 172.21.15.17:0/2228851934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 msgr2=0x560768ed3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a3e00640 1 --2- 172.21.15.17:0/2228851934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 0x560768ed3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a3e00640 1 -- 172.21.15.17:0/2228851934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 msgr2=0x560768e89fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.874+0000 7f74a3e00640 1 --2- 172.21.15.17:0/2228851934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768e89fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 -- 172.21.15.17:0/2228851934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560768c88c60 con 0x560768ed3ac0 2024-09-10T23:24:51.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 --2- 172.21.15.17:0/2228851934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768e89680 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7490007a40 tx=0x7f7490001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0ec62ad5b0ac42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f7495600640 1 -- 172.21.15.17:0/2228851934 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749000e950 con 0x560768ed3ac0 2024-09-10T23:24:51.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f7495600640 1 -- 172.21.15.17:0/2228851934 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7490019070 con 0x560768ed3ac0 2024-09-10T23:24:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f7495600640 1 -- 172.21.15.17:0/2228851934 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749000ee60 con 0x560768ed3ac0 2024-09-10T23:24:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2228851934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 msgr2=0x560768e89680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2228851934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768e89680 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7490007a40 tx=0x7f7490001b10 comp rx=0 tx=0).stop 2024-09-10T23:24:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2228851934 shutdown_connections 2024-09-10T23:24:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2228851934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768e89fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2228851934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768e89680 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2228851934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 0x560768ed3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2228851934 >> 172.21.15.17:0/2228851934 conn(0x560768e8fd20 msgr2=0x560768e87f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2228851934 shutdown_connections 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2228851934 wait complete. 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 -- start start 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 Processor -- start 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768eda530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed31a0 0x560768edaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed3ac0 0x560768edafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560768cd7dd0 con 0x560768ed31a0 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560768cd3fc0 con 0x560768e89bc0 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560768c794b0 con 0x560768ed3ac0 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74ae7c3000 10 client.0 _ll_register_callbacks cb 0x560768c577d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed31a0 0x560768edaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed31a0 0x560768edaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46686/0 (socket says 172.21.15.17:46686) 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 -- 172.21.15.17:0/3110151118 learned_addr learned my addr 172.21.15.17:0/3110151118 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a9400640 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed3ac0 0x560768edafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a8a00640 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768eda530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 -- 172.21.15.17:0/3110151118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed3ac0 msgr2=0x560768edafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed3ac0 0x560768edafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 -- 172.21.15.17:0/3110151118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 msgr2=0x560768eda530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768eda530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a3e00640 1 -- 172.21.15.17:0/3110151118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560768c721f0 con 0x560768ed31a0 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.878+0000 7f74a8a00640 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768eda530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74a3e00640 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed31a0 0x560768edaa70 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7490009010 tx=0x7f7490001410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a55ec07149f3248 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 1 -- 172.21.15.17:0/3110151118 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7490024030 con 0x560768ed31a0 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 1 -- 172.21.15.17:0/3110151118 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f7490010040 con 0x560768ed31a0 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 -- 172.21.15.17:0/3110151118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560768c6c330 con 0x560768ed31a0 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 1 -- 172.21.15.17:0/3110151118 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f749002d050 con 0x560768ed31a0 2024-09-10T23:24:51.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 10 client.8430 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 -- 172.21.15.17:0/3110151118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x560768c58fa0 con 0x560768ed31a0 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 1 -- 172.21.15.17:0/3110151118 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560768c6c330 con 0x560768ed31a0 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 1 -- 172.21.15.17:0/3110151118 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f7490030020 con 0x560768ed31a0 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 10 client.8430 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 10 client.8430 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 20 client.8430 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x560768ee2900 0x560768ee4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 4 client.8430 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 -- 172.21.15.17:0/3110151118 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560768ce6ae0 con 0x560768ee2900 2024-09-10T23:24:51.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74a8a00640 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x560768ee2900 0x560768ee4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74a8a00640 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x560768ee2900 0x560768ee4cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9de2dfce3c1dcab0 server_cookie=da954c3c152e2e0b in_seq=0 out_seq=0 2024-09-10T23:24:51.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 10 client.8430 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 1 -- 172.21.15.17:0/3110151118 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560768ce6ae0 con 0x560768ee2900 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 10 client.8430 handle_command_reply: tid=0 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 client.8430 shutdown 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 -- 172.21.15.17:0/3110151118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed31a0 msgr2=0x560768edaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed31a0 0x560768edaa70 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7490009010 tx=0x7f7490001410 comp rx=0 tx=0).stop 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 -- 172.21.15.17:0/3110151118 shutdown_connections 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x560768ee2900 0x560768ee4cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed3ac0 0x560768edafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed31a0 0x560768edaa70 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f748a000640 0 client.8430 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/3110151118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768eda530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 -- 172.21.15.17:0/3110151118 >> 172.21.15.17:0/3110151118 conn(0x560768e8fd20 msgr2=0x560768e87f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 -- 172.21.15.17:0/3110151118 shutdown_connections 2024-09-10T23:24:51.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 1 -- 172.21.15.17:0/3110151118 wait complete. 2024-09-10T23:24:51.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.882+0000 7f74ae7c3000 20 client.8430 trim_cache size 0 max 16384 2024-09-10T23:24:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 Processor -- start 2024-09-10T23:24:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 -- start start 2024-09-10T23:24:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768e89070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 0x560768e895b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768edd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f74a42043b0 con 0x560768ed3ac0 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f74a42033d0 con 0x560768e89bc0 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f74a4140070 con 0x560768ed31a0 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768edd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768edd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46690/0 (socket says 172.21.15.17:46690) 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a9400640 1 -- 172.21.15.17:0/553090810 learned_addr learned my addr 172.21.15.17:0/553090810 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a8a00640 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768e89070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a3e00640 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 0x560768e895b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a9400640 1 -- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 msgr2=0x560768e895b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a9400640 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 0x560768e895b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a9400640 1 -- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 msgr2=0x560768e89070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a9400640 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768e89070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a9400640 1 -- 172.21.15.17:0/553090810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560768d31660 con 0x560768ed3ac0 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a8a00640 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768e89070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a3e00640 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 0x560768e895b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74a9400640 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768edd310 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f749c0f8650 tx=0x7f749c0f4560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2022f53aad9876ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f7494c00640 1 -- 172.21.15.17:0/553090810 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c0f7e30 con 0x560768ed3ac0 2024-09-10T23:24:51.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f7494c00640 1 -- 172.21.15.17:0/553090810 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f749c0f81d0 con 0x560768ed3ac0 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f7494c00640 1 -- 172.21.15.17:0/553090810 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c0f8dc0 con 0x560768ed3ac0 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 -- 172.21.15.17:0/553090810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 msgr2=0x560768edd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768edd310 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f749c0f8650 tx=0x7f749c0f4560 comp rx=0 tx=0).stop 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 -- 172.21.15.17:0/553090810 shutdown_connections 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768edd310 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768ed31a0 0x560768e895b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/553090810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768e89bc0 0x560768e89070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 -- 172.21.15.17:0/553090810 >> 172.21.15.17:0/553090810 conn(0x560768e8fd20 msgr2=0x560768e88960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 -- 172.21.15.17:0/553090810 shutdown_connections 2024-09-10T23:24:51.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.902+0000 7f74ae7c3000 1 -- 172.21.15.17:0/553090810 wait complete. 2024-09-10T23:24:51.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 -- start start 2024-09-10T23:24:51.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 Processor -- start 2024-09-10T23:24:51.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768e89bc0 0x560768edffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768ed31a0 0x560768ee0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768f05210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560768e92d40 con 0x560768ed3ac0 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560768e90100 con 0x560768ed31a0 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560768cceec0 con 0x560768e89bc0 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 10 client.0 _ll_register_callbacks cb 0x7f749c009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768f05210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768f05210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46704/0 (socket says 172.21.15.17:46704) 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a8a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768e89bc0 0x560768edffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a3e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768ed31a0 0x560768ee0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a9400640 1 -- 172.21.15.17:0/2741540457 learned_addr learned my addr 172.21.15.17:0/2741540457 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:51.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a9400640 1 -- 172.21.15.17:0/2741540457 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768e89bc0 msgr2=0x560768edffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a9400640 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768e89bc0 0x560768edffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a9400640 1 -- 172.21.15.17:0/2741540457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768ed31a0 msgr2=0x560768ee0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a9400640 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768ed31a0 0x560768ee0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a9400640 1 -- 172.21.15.17:0/2741540457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560768c9e090 con 0x560768ed3ac0 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a8a00640 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768e89bc0 0x560768edffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a9400640 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768f05210 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f749c0196d0 tx=0x7f749c0f7e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8929fad421a691c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f748a000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f748a000640 1 -- 172.21.15.17:0/2741540457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c0a5a90 con 0x560768ed3ac0 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f748a000640 1 -- 172.21.15.17:0/2741540457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f749c0f8920 con 0x560768ed3ac0 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2741540457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f749c0f81d0 con 0x560768ed3ac0 2024-09-10T23:24:51.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f748a000640 1 -- 172.21.15.17:0/2741540457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f749c0fd1a0 con 0x560768ed3ac0 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 10 client.8436 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2741540457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x560768c6a5f0 con 0x560768ed3ac0 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f748a000640 1 -- 172.21.15.17:0/2741540457 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f749c12a070 con 0x560768ed3ac0 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f748a000640 1 -- 172.21.15.17:0/2741540457 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f749c101730 con 0x560768ed3ac0 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 10 client.8436 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 10 client.8436 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 20 client.8436 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x560768f05b70 0x560768f48640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 4 client.8436 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:24:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2741540457 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560768ce2590 con 0x560768f05b70 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.906+0000 7f74a8a00640 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x560768f05b70 0x560768f48640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74a8a00640 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x560768f05b70 0x560768f48640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6555c582aede8f69 server_cookie=1f69f0e84ae6fe95 in_seq=0 out_seq=0 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f748a000640 10 client.8436 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f748a000640 1 -- 172.21.15.17:0/2741540457 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x560768ce2590 con 0x560768f05b70 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f748a000640 10 client.8436 handle_command_reply: tid=0 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 client.8436 shutdown 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2741540457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 msgr2=0x560768f05210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768f05210 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f749c0196d0 tx=0x7f749c0f7e30 comp rx=0 tx=0).stop 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2741540457 shutdown_connections 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x560768f05b70 0x560768f48640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560768ed3ac0 0x560768f05210 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560768ed31a0 0x560768ee0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 --2- 172.21.15.17:0/2741540457 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560768e89bc0 0x560768edffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f748a000640 0 client.8436 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:51.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2741540457 >> 172.21.15.17:0/2741540457 conn(0x560768e8fd20 msgr2=0x560768e89180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2741540457 shutdown_connections 2024-09-10T23:24:51.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 1 -- 172.21.15.17:0/2741540457 wait complete. 2024-09-10T23:24:51.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ae7c3000 20 client.8436 trim_cache size 0 max 16384 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout: "e8a539f6-f61c-4148-92a3-a7f76e0567fd": { 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "e8a539f6-f61c-4148-92a3-a7f76e0567fd", 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive" 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:24:51.920 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout: "e8a539f6-f61c-4148-92a3-a7f76e0567fd": { 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:24:51.370900+0000", 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:51.921 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:24:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 -- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7484072610 msgr2=0x7f7484074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7484072610 0x7f7484074ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7498000f70 tx=0x7f7498009040 comp rx=0 tx=0).stop 2024-09-10T23:24:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 -- 172.21.15.17:0/3678444324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a41457c0 msgr2=0x7f74a4154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:51.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a41457c0 0x7f74a4154950 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f749c01a6f0 tx=0x7f749c0092a0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 -- 172.21.15.17:0/3678444324 shutdown_connections 2024-09-10T23:24:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7484072610 0x7f7484074ad0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74a41457c0 0x7f74a4154950 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74a4074660 0x7f74a4154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 --2- 172.21.15.17:0/3678444324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74a40741d0 0x7f74a413dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 -- 172.21.15.17:0/3678444324 >> 172.21.15.17:0/3678444324 conn(0x7f74a40b17a0 msgr2=0x7f74a406e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 -- 172.21.15.17:0/3678444324 shutdown_connections 2024-09-10T23:24:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:51.910+0000 7f74ab400640 1 -- 172.21.15.17:0/3678444324 wait complete. 2024-09-10T23:24:56.932 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T23:24:56.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-10T23:24:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.094+0000 7f41b9800640 1 -- 172.21.15.17:0/1742339383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b40b2540 msgr2=0x7f41b40d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.094+0000 7f41b9800640 1 --2- 172.21.15.17:0/1742339383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b40b2540 0x7f41b40d03b0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f41b40cf770 tx=0x7f419c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.094+0000 7f41b9800640 1 -- 172.21.15.17:0/1742339383 shutdown_connections 2024-09-10T23:24:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.094+0000 7f41b9800640 1 --2- 172.21.15.17:0/1742339383 >> v2:172.21.15.77:3300/0 conn(0x7f41b40b31b0 0x7f41b40cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.094+0000 7f41b9800640 1 --2- 172.21.15.17:0/1742339383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b40b2540 0x7f41b40d03b0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.094+0000 7f41b9800640 1 -- 172.21.15.17:0/1742339383 >> 172.21.15.17:0/1742339383 conn(0x7f41b40d1da0 msgr2=0x7f41b40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.094+0000 7f41b9800640 1 -- 172.21.15.17:0/1742339383 shutdown_connections 2024-09-10T23:24:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.094+0000 7f41b9800640 1 -- 172.21.15.17:0/1742339383 wait complete. 2024-09-10T23:24:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 Processor -- start 2024-09-10T23:24:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 -- start start 2024-09-10T23:24:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41b40b2540 0x7f41b40cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40b31b0 0x7f41b41501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b415f400 0x7f41b40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f41b4168c60 con 0x7f41b415f400 2024-09-10T23:24:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41b40cdb80 con 0x7f41b40b31b0 2024-09-10T23:24:57.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f41b4168de0 con 0x7f41b40b2540 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b415f400 0x7f41b40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b415f400 0x7f41b40718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42498/0 (socket says 172.21.15.17:42498) 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b3400640 1 -- 172.21.15.17:0/759349704 learned_addr learned my addr 172.21.15.17:0/759349704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b2a00640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41b40b2540 0x7f41b40cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41abe00640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40b31b0 0x7f41b41501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b3400640 1 -- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41b40b2540 msgr2=0x7f41b40cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b3400640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41b40b2540 0x7f41b40cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b3400640 1 -- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40b31b0 msgr2=0x7f41b41501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b3400640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40b31b0 0x7f41b41501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b3400640 1 -- 172.21.15.17:0/759349704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b40cc220 con 0x7f41b415f400 2024-09-10T23:24:57.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b3400640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b415f400 0x7f41b40718c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00b970 tx=0x7f41ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41aaa00640 1 -- 172.21.15.17:0/759349704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac019070 con 0x7f41b415f400 2024-09-10T23:24:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41aaa00640 1 -- 172.21.15.17:0/759349704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41ac00cc50 con 0x7f41b415f400 2024-09-10T23:24:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41aaa00640 1 -- 172.21.15.17:0/759349704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0146a0 con 0x7f41b415f400 2024-09-10T23:24:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 -- 172.21.15.17:0/759349704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b41f75c0 con 0x7f41b415f400 2024-09-10T23:24:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.098+0000 7f41b9800640 1 -- 172.21.15.17:0/759349704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b40b6220 con 0x7f41b415f400 2024-09-10T23:24:57.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41aaa00640 1 -- 172.21.15.17:0/759349704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f41ac01d3b0 con 0x7f41b415f400 2024-09-10T23:24:57.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41aaa00640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41900725e0 0x7f4190074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41aaa00640 1 -- 172.21.15.17:0/759349704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f41ac093480 con 0x7f41b415f400 2024-09-10T23:24:57.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41bcc25000 1 Processor -- start 2024-09-10T23:24:57.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41bcc25000 1 -- start start 2024-09-10T23:24:57.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41b2a00640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41900725e0 0x7f4190074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b1a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49ad0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41b2a00640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41900725e0 0x7f4190074aa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f41a4007fd0 tx=0x7f41a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 0x557f49ad0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41bcc25000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557f499b8cb0 con 0x557f49b1a1a0 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41bcc25000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557f498ce310 con 0x557f49b1aac0 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41bcc25000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557f4992bb90 con 0x557f49ad0bc0 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41b2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b1a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41abe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49ad0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41b2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b1a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42502/0 (socket says 172.21.15.17:42502) 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41b2a00640 1 -- 172.21.15.17:0/2091589981 learned_addr learned my addr 172.21.15.17:0/2091589981 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.102+0000 7f41b3400640 1 --2- 172.21.15.17:0/2091589981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 0x557f49ad0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41abe00640 1 -- 172.21.15.17:0/2091589981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 msgr2=0x557f49ad0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41abe00640 1 --2- 172.21.15.17:0/2091589981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 0x557f49ad0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41abe00640 1 -- 172.21.15.17:0/2091589981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 msgr2=0x557f49b1a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41abe00640 1 --2- 172.21.15.17:0/2091589981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b1a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41abe00640 1 -- 172.21.15.17:0/2091589981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f498cfc60 con 0x557f49b1aac0 2024-09-10T23:24:57.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41b2a00640 1 --2- 172.21.15.17:0/2091589981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b1a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:24:57.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41abe00640 1 --2- 172.21.15.17:0/2091589981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49ad0680 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f419c0ac000 tx=0x7f419c019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e83ddd56ca419e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41a3400640 1 -- 172.21.15.17:0/2091589981 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c0bb070 con 0x557f49b1aac0 2024-09-10T23:24:57.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41a3400640 1 -- 172.21.15.17:0/2091589981 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f419c005040 con 0x557f49b1aac0 2024-09-10T23:24:57.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41a3400640 1 -- 172.21.15.17:0/2091589981 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c0b2040 con 0x557f49b1aac0 2024-09-10T23:24:57.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 -- 172.21.15.17:0/2091589981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 msgr2=0x557f49ad0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2091589981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49ad0680 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f419c0ac000 tx=0x7f419c019660 comp rx=0 tx=0).stop 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 -- 172.21.15.17:0/2091589981 shutdown_connections 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2091589981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 0x557f49ad0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2091589981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49ad0680 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2091589981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b1a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 -- 172.21.15.17:0/2091589981 >> 172.21.15.17:0/2091589981 conn(0x557f49ad6d20 msgr2=0x557f49acef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 -- 172.21.15.17:0/2091589981 shutdown_connections 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 -- 172.21.15.17:0/2091589981 wait complete. 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 -- start start 2024-09-10T23:24:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 Processor -- start 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b21530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49b1a1a0 0x557f49b21a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1aac0 0x557f49b21fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557f4991edd0 con 0x557f49b1aac0 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557f4991afc0 con 0x557f49ad0bc0 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557f498c04b0 con 0x557f49b1a1a0 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41bcc25000 10 client.0 _ll_register_callbacks cb 0x557f4989e7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1aac0 0x557f49b21fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1aac0 0x557f49b21fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42514/0 (socket says 172.21.15.17:42514) 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41b3400640 1 -- 172.21.15.17:0/2634087255 learned_addr learned my addr 172.21.15.17:0/2634087255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41b2a00640 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b21530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.106+0000 7f41abe00640 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49b1a1a0 0x557f49b21a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41b3400640 1 -- 172.21.15.17:0/2634087255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49b1a1a0 msgr2=0x557f49b21a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41b3400640 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49b1a1a0 0x557f49b21a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41b3400640 1 -- 172.21.15.17:0/2634087255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 msgr2=0x557f49b21530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41b3400640 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b21530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41b3400640 1 -- 172.21.15.17:0/2634087255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f498b91f0 con 0x557f49b1aac0 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41b2a00640 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b21530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41b3400640 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1aac0 0x557f49b21fb0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f41ac091780 tx=0x7f41ac00ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ec0b524a0891a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 1 -- 172.21.15.17:0/2634087255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac062d10 con 0x557f49b1aac0 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 1 -- 172.21.15.17:0/2634087255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f41ac083180 con 0x557f49b1aac0 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 -- 172.21.15.17:0/2634087255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f498b3330 con 0x557f49b1aac0 2024-09-10T23:24:57.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 1 -- 172.21.15.17:0/2634087255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f41ac08f050 con 0x557f49b1aac0 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 10 client.8451 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 -- 172.21.15.17:0/2634087255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x557f4989ffa0 con 0x557f49b1aac0 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 1 -- 172.21.15.17:0/2634087255 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557f498b3330 con 0x557f49b1aac0 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 1 -- 172.21.15.17:0/2634087255 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f41ac0912f0 con 0x557f49b1aac0 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 10 client.8451 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 10 client.8451 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 20 client.8451 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x557f49b29900 0x557f49b2bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 4 client.8451 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 -- 172.21.15.17:0/2634087255 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f4992dae0 con 0x557f49b29900 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41b2a00640 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x557f49b29900 0x557f49b2bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 10 client.8451 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:57.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41b2a00640 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x557f49b29900 0x557f49b2bcf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c76b02a6e74d9651 server_cookie=3cf54a1023ce9c19 in_seq=0 out_seq=0 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 1 -- 172.21.15.17:0/2634087255 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f4992dae0 con 0x557f49b29900 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 10 client.8451 handle_command_reply: tid=0 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 client.8451 shutdown 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 -- 172.21.15.17:0/2634087255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1aac0 msgr2=0x557f49b21fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1aac0 0x557f49b21fb0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f41ac091780 tx=0x7f41ac00ce40 comp rx=0 tx=0).stop 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 -- 172.21.15.17:0/2634087255 shutdown_connections 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x557f49b29900 0x557f49b2bcf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1aac0 0x557f49b21fb0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49b1a1a0 0x557f49b21a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 --2- 172.21.15.17:0/2634087255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b21530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f4197e00640 0 client.8451 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 -- 172.21.15.17:0/2634087255 >> 172.21.15.17:0/2634087255 conn(0x557f49ad6d20 msgr2=0x557f49acef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 -- 172.21.15.17:0/2634087255 shutdown_connections 2024-09-10T23:24:57.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 1 -- 172.21.15.17:0/2634087255 wait complete. 2024-09-10T23:24:57.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.110+0000 7f41bcc25000 20 client.8451 trim_cache size 0 max 16384 2024-09-10T23:24:57.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41bcc25000 1 Processor -- start 2024-09-10T23:24:57.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41bcc25000 1 -- start start 2024-09-10T23:24:57.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b27bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49ad0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49b1aac0 0x557f49ad05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41bcc25000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f41b42042c0 con 0x557f49b1a1a0 2024-09-10T23:24:57.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41bcc25000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41b42032e0 con 0x557f49ad0bc0 2024-09-10T23:24:57.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41bcc25000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f41b40b5940 con 0x557f49b1aac0 2024-09-10T23:24:57.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49ad0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49ad0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42526/0 (socket says 172.21.15.17:42526) 2024-09-10T23:24:57.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41abe00640 1 -- 172.21.15.17:0/3682651838 learned_addr learned my addr 172.21.15.17:0/3682651838 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:57.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41abe00640 1 -- 172.21.15.17:0/3682651838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49b1aac0 msgr2=0x557f49ad05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41abe00640 1 --2- 172.21.15.17:0/3682651838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49b1aac0 0x557f49ad05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41b2a00640 1 --2- 172.21.15.17:0/3682651838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b27bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41abe00640 1 -- 172.21.15.17:0/3682651838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 msgr2=0x557f49b27bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41abe00640 1 --2- 172.21.15.17:0/3682651838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b27bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41abe00640 1 -- 172.21.15.17:0/3682651838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f49978660 con 0x557f49b1a1a0 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41b2a00640 1 --2- 172.21.15.17:0/3682651838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b27bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41abe00640 1 --2- 172.21.15.17:0/3682651838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49ad0070 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f419c009230 tx=0x7f419c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496e10dc0c72c583 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41a2a00640 1 -- 172.21.15.17:0/3682651838 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c0c4070 con 0x557f49b1a1a0 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41a2a00640 1 -- 172.21.15.17:0/3682651838 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f419c004440 con 0x557f49b1a1a0 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.130+0000 7f41a2a00640 1 -- 172.21.15.17:0/3682651838 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c0b2070 con 0x557f49b1a1a0 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- 172.21.15.17:0/3682651838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 msgr2=0x557f49ad0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3682651838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49ad0070 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f419c009230 tx=0x7f419c009260 comp rx=0 tx=0).stop 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- 172.21.15.17:0/3682651838 shutdown_connections 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3682651838 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49b1aac0 0x557f49ad05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3682651838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49ad0070 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3682651838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49ad0bc0 0x557f49b27bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- 172.21.15.17:0/3682651838 >> 172.21.15.17:0/3682651838 conn(0x557f49ad6d20 msgr2=0x557f49acf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- 172.21.15.17:0/3682651838 shutdown_connections 2024-09-10T23:24:57.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- 172.21.15.17:0/3682651838 wait complete. 2024-09-10T23:24:57.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- start start 2024-09-10T23:24:57.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 Processor -- start 2024-09-10T23:24:57.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 0x557f49b26fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b27500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49b4c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557f49ad9d40 con 0x557f49b1a1a0 2024-09-10T23:24:57.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557f49ad7100 con 0x557f49b1aac0 2024-09-10T23:24:57.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557f49915ec0 con 0x557f49ad0bc0 2024-09-10T23:24:57.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 10 client.0 _ll_register_callbacks cb 0x7f41ac05da50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:24:57.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b27500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b27500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42540/0 (socket says 172.21.15.17:42540) 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41abe00640 1 -- 172.21.15.17:0/3305575911 learned_addr learned my addr 172.21.15.17:0/3305575911 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41b2a00640 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 0x557f49b26fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41b3400640 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49b4c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41abe00640 1 -- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 msgr2=0x557f49b26fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41abe00640 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 0x557f49b26fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41abe00640 1 -- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 msgr2=0x557f49b4c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41abe00640 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49b4c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41abe00640 1 -- 172.21.15.17:0/3305575911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f498e5090 con 0x557f49b1a1a0 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41b3400640 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49b4c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41b2a00640 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 0x557f49b26fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41abe00640 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b27500 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f419c01d160 tx=0x7f419c0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a23bc8c57e818a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f4197e00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f4197e00640 1 -- 172.21.15.17:0/3305575911 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c0cd060 con 0x557f49b1a1a0 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f4197e00640 1 -- 172.21.15.17:0/3305575911 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f419c0041c0 con 0x557f49b1a1a0 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- 172.21.15.17:0/3305575911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f419c004440 con 0x557f49b1a1a0 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f4197e00640 1 -- 172.21.15.17:0/3305575911 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f419c0d3050 con 0x557f49b1a1a0 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 10 client.8457 fetch_fsmap learned FSMap version 95 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- 172.21.15.17:0/3305575911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x557f498b15f0 con 0x557f49b1a1a0 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f4197e00640 1 -- 172.21.15.17:0/3305575911 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f419c004440 con 0x557f49b1a1a0 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f4197e00640 1 -- 172.21.15.17:0/3305575911 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f419c0046d0 con 0x557f49b1a1a0 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 10 client.8457 fetch_fsmap finished waiting for FSMap version 95 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 10 client.8457 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 20 client.8457 populate_metadata read hostname 'smithi017' 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x557f49b4cc00 0x557f49b97680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 4 client.8457 mds_command: new command op to 8238 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:24:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.134+0000 7f41bcc25000 1 -- 172.21.15.17:0/3305575911 --> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f49929590 con 0x557f49b4cc00 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b2a00640 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x557f49b4cc00 0x557f49b97680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b2a00640 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x557f49b4cc00 0x557f49b97680 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f233e12a8f52317 server_cookie=2a417b62b911c09d in_seq=0 out_seq=0 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f4197e00640 10 client.8457 ms_handle_connect on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f4197e00640 1 -- 172.21.15.17:0/3305575911 <== mds.0 v2:172.21.15.17:6833/884432446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+397 (crc 0 0 0) 0x557f49929590 con 0x557f49b4cc00 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f4197e00640 10 client.8457 handle_command_reply: tid=0 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 client.8457 shutdown 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 -- 172.21.15.17:0/3305575911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 msgr2=0x557f49b27500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b27500 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f419c01d160 tx=0x7f419c0054a0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 -- 172.21.15.17:0/3305575911 shutdown_connections 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.17:6833/884432446,v1:172.21.15.17:6835/884432446] conn(0x557f49b4cc00 0x557f49b97680 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557f49b1aac0 0x557f49b4c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f49b1a1a0 0x557f49b27500 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 --2- 172.21.15.17:0/3305575911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557f49ad0bc0 0x557f49b26fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f4197e00640 0 client.8457 ms_handle_reset on v2:172.21.15.17:6833/884432446 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 -- 172.21.15.17:0/3305575911 >> 172.21.15.17:0/3305575911 conn(0x557f49ad6d20 msgr2=0x557f49ad0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 -- 172.21.15.17:0/3305575911 shutdown_connections 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 1 -- 172.21.15.17:0/3305575911 wait complete. 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41bcc25000 20 client.8457 trim_cache size 0 max 16384 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:24:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "e8a539f6-f61c-4148-92a3-a7f76e0567fd": { 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:24:51.370900+0000", 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:24:57.146 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:24:57.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 -- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41900725e0 msgr2=0x7f4190074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41900725e0 0x7f4190074aa0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f41a4007fd0 tx=0x7f41a4009040 comp rx=0 tx=0).stop 2024-09-10T23:24:57.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 -- 172.21.15.17:0/759349704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b415f400 msgr2=0x7f41b40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b415f400 0x7f41b40718c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00b970 tx=0x7f41ac00be30 comp rx=0 tx=0).stop 2024-09-10T23:24:57.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 -- 172.21.15.17:0/759349704 shutdown_connections 2024-09-10T23:24:57.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41900725e0 0x7f4190074aa0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41b415f400 0x7f41b40718c0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41b40b31b0 0x7f41b41501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 --2- 172.21.15.17:0/759349704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41b40b2540 0x7f41b40cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 -- 172.21.15.17:0/759349704 >> 172.21.15.17:0/759349704 conn(0x7f41b40d1da0 msgr2=0x7f41b406e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 -- 172.21.15.17:0/759349704 shutdown_connections 2024-09-10T23:24:57.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.138+0000 7f41b9800640 1 -- 172.21.15.17:0/759349704 wait complete. 2024-09-10T23:24:57.160 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:24:57.161 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.302+0000 7f3d33000640 1 -- 172.21.15.17:0/4117632475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d2c070ad0 msgr2=0x7f3d2c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.302+0000 7f3d33000640 1 --2- 172.21.15.17:0/4117632475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d2c070ad0 0x7f3d2c15f060 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0cf010 tx=0x7f3d1c01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 -- 172.21.15.17:0/4117632475 shutdown_connections 2024-09-10T23:24:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 --2- 172.21.15.17:0/4117632475 >> v2:172.21.15.77:3300/0 conn(0x7f3d2c0cf320 0x7f3d2c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 --2- 172.21.15.17:0/4117632475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d2c070ad0 0x7f3d2c15f060 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 -- 172.21.15.17:0/4117632475 >> 172.21.15.17:0/4117632475 conn(0x7f3d2c0d1d60 msgr2=0x7f3d2c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 -- 172.21.15.17:0/4117632475 shutdown_connections 2024-09-10T23:24:57.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 -- 172.21.15.17:0/4117632475 wait complete. 2024-09-10T23:24:57.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 Processor -- start 2024-09-10T23:24:57.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 -- start start 2024-09-10T23:24:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c070ad0 0x7f3d2c06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d2c0cf320 0x7f3d2c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c0d1830 0x7f3d2c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c1693d0 con 0x7f3d2c070ad0 2024-09-10T23:24:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c169250 con 0x7f3d2c0d1830 2024-09-10T23:24:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d33000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c169550 con 0x7f3d2c0cf320 2024-09-10T23:24:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c070ad0 0x7f3d2c06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c070ad0 0x7f3d2c06f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42544/0 (socket says 172.21.15.17:42544) 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d2be00640 1 -- 172.21.15.17:0/1998632561 learned_addr learned my addr 172.21.15.17:0/1998632561 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d23e00640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d2c0cf320 0x7f3d2c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d31000640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c0d1830 0x7f3d2c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d2be00640 1 -- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d2c0cf320 msgr2=0x7f3d2c0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d2be00640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d2c0cf320 0x7f3d2c0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d2be00640 1 -- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c0d1830 msgr2=0x7f3d2c1598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d2be00640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c0d1830 0x7f3d2c1598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d2be00640 1 -- 172.21.15.17:0/1998632561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c15b1e0 con 0x7f3d2c070ad0 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d31000640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c0d1830 0x7f3d2c1598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.306+0000 7f3d2be00640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c070ad0 0x7f3d2c06f8f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0b0040 tx=0x7f3d1c0a57c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d28c00640 1 -- 172.21.15.17:0/1998632561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c0b2040 con 0x7f3d2c070ad0 2024-09-10T23:24:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d28c00640 1 -- 172.21.15.17:0/1998632561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d1c005030 con 0x7f3d2c070ad0 2024-09-10T23:24:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d28c00640 1 -- 172.21.15.17:0/1998632561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c005480 con 0x7f3d2c070ad0 2024-09-10T23:24:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2c15b4c0 con 0x7f3d2c070ad0 2024-09-10T23:24:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d2c15aeb0 con 0x7f3d2c070ad0 2024-09-10T23:24:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d2c06dcd0 con 0x7f3d2c070ad0 2024-09-10T23:24:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d28c00640 1 -- 172.21.15.17:0/1998632561 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3d1c0bf060 con 0x7f3d2c070ad0 2024-09-10T23:24:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d28c00640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d080725e0 0x7f3d08074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d28c00640 1 -- 172.21.15.17:0/1998632561 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f3d1c12c430 con 0x7f3d2c070ad0 2024-09-10T23:24:57.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.310+0000 7f3d23e00640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d080725e0 0x7f3d08074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.314+0000 7f3d23e00640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d080725e0 0x7f3d08074aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c15ad40 tx=0x7f3d14009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.314+0000 7f3d28c00640 1 -- 172.21.15.17:0/1998632561 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3d2c06dcd0 con 0x7f3d2c070ad0 2024-09-10T23:24:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d2c15f060 con 0x7f3d2c070ad0 2024-09-10T23:24:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d28c00640 1 -- 172.21.15.17:0/1998632561 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5222 (secure 0 0 0) 0x7f3d1c0164d0 con 0x7f3d2c070ad0 2024-09-10T23:24:57.529 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:57.529 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":95,"btime":"2024-09-10T23:24:27:975406+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4055700220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4055700220},{"type":"v1","addr":"172.21.15.77:6836","nonce":4055700220}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2576092770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2576092770},{"type":"v1","addr":"172.21.15.77:6837","nonce":2576092770}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3395065105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3395065105},{"type":"v1","addr":"172.21.15.17:6834","nonce":3395065105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:24:24.355056+0000","modified":"2024-09-10T23:24:27.384443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8238":{"gid":8238,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/884432446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":884432446},{"type":"v1","addr":"172.21.15.17:6835","nonce":884432446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":8}]} 2024-09-10T23:24:57.530 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 95 2024-09-10T23:24:57.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d080725e0 msgr2=0x7f3d08074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d080725e0 0x7f3d08074aa0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c15ad40 tx=0x7f3d14009040 comp rx=0 tx=0).stop 2024-09-10T23:24:57.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c070ad0 msgr2=0x7f3d2c06f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c070ad0 0x7f3d2c06f8f0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0b0040 tx=0x7f3d1c0a57c0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 shutdown_connections 2024-09-10T23:24:57.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3d080725e0 0x7f3d08074aa0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d2c0d1830 0x7f3d2c1598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d2c0cf320 0x7f3d2c0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 --2- 172.21.15.17:0/1998632561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2c070ad0 0x7f3d2c06f8f0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 >> 172.21.15.17:0/1998632561 conn(0x7f3d2c0d1d60 msgr2=0x7f3d2c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 shutdown_connections 2024-09-10T23:24:57.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.526+0000 7f3d33000640 1 -- 172.21.15.17:0/1998632561 wait complete. 2024-09-10T23:24:57.551 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-10T23:24:57.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:24:57.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.694+0000 7f1d1b600640 1 -- 172.21.15.17:0/2626726216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc004810 msgr2=0x7f1cfc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.694+0000 7f1d1b600640 1 --2- 172.21.15.17:0/2626726216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cfc004810 0x7f1cfc004c90 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009b60 tx=0x7f1d0001d270 comp rx=0 tx=0).stop 2024-09-10T23:24:57.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.694+0000 7f1d19600640 1 -- 172.21.15.17:0/2626726216 reap_dead start 2024-09-10T23:24:57.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.694+0000 7f1d1b600640 1 -- 172.21.15.17:0/2626726216 shutdown_connections 2024-09-10T23:24:57.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.694+0000 7f1d1b600640 1 -- 172.21.15.17:0/2626726216 >> 172.21.15.17:0/2626726216 conn(0x7f1d140d0c50 msgr2=0x7f1d140d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.694+0000 7f1d1b600640 1 -- 172.21.15.17:0/2626726216 shutdown_connections 2024-09-10T23:24:57.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.694+0000 7f1d1b600640 1 -- 172.21.15.17:0/2626726216 wait complete. 2024-09-10T23:24:57.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 Processor -- start 2024-09-10T23:24:57.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 -- start start 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cfc004810 0x7f1d1414b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d1414ba60 0x7f1d1414bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d1414f0e0 0x7f1d1414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1415f9a0 con 0x7f1d1414f0e0 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1415f820 con 0x7f1d1414ba60 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1415fb20 con 0x7f1cfc004810 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d19600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d1414f0e0 0x7f1d1414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d19600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d1414f0e0 0x7f1d1414f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42564/0 (socket says 172.21.15.17:42564) 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d19600640 1 -- 172.21.15.17:0/960272867 learned_addr learned my addr 172.21.15.17:0/960272867 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d18c00640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cfc004810 0x7f1d1414b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d13e00640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d1414ba60 0x7f1d1414bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d19600640 1 -- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cfc004810 msgr2=0x7f1d1414b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d19600640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cfc004810 0x7f1d1414b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d19600640 1 -- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d1414ba60 msgr2=0x7f1d1414bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d19600640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d1414ba60 0x7f1d1414bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d19600640 1 -- 172.21.15.17:0/960272867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d141ec810 con 0x7f1d1414f0e0 2024-09-10T23:24:57.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d19600640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d1414f0e0 0x7f1d1414f560 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f1d14075130 tx=0x7f1d0c006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d10c00640 1 -- 172.21.15.17:0/960272867 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c015070 con 0x7f1d1414f0e0 2024-09-10T23:24:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d10c00640 1 -- 172.21.15.17:0/960272867 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d0c011920 con 0x7f1d1414f0e0 2024-09-10T23:24:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d141560b0 con 0x7f1d1414f0e0 2024-09-10T23:24:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d10c00640 1 -- 172.21.15.17:0/960272867 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c011d70 con 0x7f1d1414f0e0 2024-09-10T23:24:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d141eb1f0 con 0x7f1d1414f0e0 2024-09-10T23:24:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.698+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1414faa0 con 0x7f1d1414f0e0 2024-09-10T23:24:57.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.702+0000 7f1d10c00640 1 -- 172.21.15.17:0/960272867 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1d0c0103c0 con 0x7f1d1414f0e0 2024-09-10T23:24:57.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.702+0000 7f1d10c00640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cf4072610 0x7f1cf4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:57.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.702+0000 7f1d10c00640 1 -- 172.21.15.17:0/960272867 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f1d0c093ff0 con 0x7f1d1414f0e0 2024-09-10T23:24:57.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.702+0000 7f1d18c00640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cf4072610 0x7f1cf4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:57.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.702+0000 7f1d18c00640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cf4072610 0x7f1cf4074ad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1d1415f740 tx=0x7f1d08006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:57.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.706+0000 7f1d10c00640 1 -- 172.21.15.17:0/960272867 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1d0c05ef00 con 0x7f1d1414f0e0 2024-09-10T23:24:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.938+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1d14154180 con 0x7f1d1414f0e0 2024-09-10T23:24:57.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.938+0000 7f1d10c00640 1 -- 172.21.15.17:0/960272867 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1230 (secure 0 0 0) 0x7f1d0c063930 con 0x7f1d1414f0e0 2024-09-10T23:24:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:57.942 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":587,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":133,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078001578,"bytes_used":2645032960,"bytes_avail":770449080320,"bytes_total":773094113280,"write_bytes_sec":51146702,"read_op_per_sec":0,"write_op_per_sec":57},"fsmap":{"epoch":95,"btime":"2024-09-10T23:24:27:975406+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8238}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-10T23:23:50.411458+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:24:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.938+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cf4072610 msgr2=0x7f1cf4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.938+0000 7f1d1b600640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cf4072610 0x7f1cf4074ad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1d1415f740 tx=0x7f1d08006040 comp rx=0 tx=0).stop 2024-09-10T23:24:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.938+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d1414f0e0 msgr2=0x7f1d1414f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.938+0000 7f1d1b600640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d1414f0e0 0x7f1d1414f560 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f1d14075130 tx=0x7f1d0c006430 comp rx=0 tx=0).stop 2024-09-10T23:24:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.942+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 shutdown_connections 2024-09-10T23:24:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.942+0000 7f1d1b600640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1cf4072610 0x7f1cf4074ad0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.942+0000 7f1d1b600640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d1414f0e0 0x7f1d1414f560 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.942+0000 7f1d1b600640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d1414ba60 0x7f1d1414bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.942+0000 7f1d1b600640 1 --2- 172.21.15.17:0/960272867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1cfc004810 0x7f1d1414b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:57.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.942+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 >> 172.21.15.17:0/960272867 conn(0x7f1d140d0c50 msgr2=0x7f1d140b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:57.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.942+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 shutdown_connections 2024-09-10T23:24:57.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:57.942+0000 7f1d1b600640 1 -- 172.21.15.17:0/960272867 wait complete. 2024-09-10T23:24:57.962 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:24:57.962 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:24:57.963 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:24:58.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:24:58.146 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:24:58.146 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:24:58.146 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:24:58.146 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:58.155 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:24:58.155 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:58.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:24:58.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.394+0000 7fc2dce00640 1 -- 172.21.15.17:0/1982530369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80af8d0 msgr2=0x7fc2d80afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.394+0000 7fc2dce00640 1 --2- 172.21.15.17:0/1982530369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80af8d0 0x7fc2d80afd40 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009c80 tx=0x7fc2d001cda0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.394+0000 7fc2dce00640 1 -- 172.21.15.17:0/1982530369 shutdown_connections 2024-09-10T23:24:58.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.394+0000 7fc2dce00640 1 --2- 172.21.15.17:0/1982530369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80af8d0 0x7fc2d80afd40 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.394+0000 7fc2dce00640 1 --2- 172.21.15.17:0/1982530369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d815be40 0x7fc2d80cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.394+0000 7fc2dce00640 1 -- 172.21.15.17:0/1982530369 >> 172.21.15.17:0/1982530369 conn(0x7fc2d80d1d60 msgr2=0x7fc2d80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:58.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.394+0000 7fc2dce00640 1 -- 172.21.15.17:0/1982530369 shutdown_connections 2024-09-10T23:24:58.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.394+0000 7fc2dce00640 1 -- 172.21.15.17:0/1982530369 wait complete. 2024-09-10T23:24:58.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 Processor -- start 2024-09-10T23:24:58.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 -- start start 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d80af8d0 0x7fc2d814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80b3360 0x7fc2d81fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d815be40 0x7fc2d80cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d8168e10 con 0x7fc2d80b3360 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d8168c90 con 0x7fc2d815be40 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d8168f90 con 0x7fc2d80af8d0 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80b3360 0x7fc2d81fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80b3360 0x7fc2d81fbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42582/0 (socket says 172.21.15.17:42582) 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cd400640 1 -- 172.21.15.17:0/3690391537 learned_addr learned my addr 172.21.15.17:0/3690391537 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2d5e00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d80af8d0 0x7fc2d814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cd400640 1 -- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d80af8d0 msgr2=0x7fc2d814f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cd400640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d80af8d0 0x7fc2d814f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2d6800640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d815be40 0x7fc2d80cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cd400640 1 -- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d815be40 msgr2=0x7fc2d80cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cd400640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d815be40 0x7fc2d80cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cd400640 1 -- 172.21.15.17:0/3690391537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d81fc0a0 con 0x7fc2d80b3360 2024-09-10T23:24:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2d5e00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d80af8d0 0x7fc2d814f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2d6800640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d815be40 0x7fc2d80cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cd400640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80b3360 0x7fc2d81fbb60 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c450 tx=0x7fc2c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cea00640 1 -- 172.21.15.17:0/3690391537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0017070 con 0x7fc2d80b3360 2024-09-10T23:24:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cea00640 1 -- 172.21.15.17:0/3690391537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2c0003600 con 0x7fc2d80b3360 2024-09-10T23:24:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2cea00640 1 -- 172.21.15.17:0/3690391537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0003a50 con 0x7fc2d80b3360 2024-09-10T23:24:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d80b6130 con 0x7fc2d80b3360 2024-09-10T23:24:58.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d80b66f0 con 0x7fc2d80b3360 2024-09-10T23:24:58.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.398+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d80afd40 con 0x7fc2d80b3360 2024-09-10T23:24:58.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.402+0000 7fc2cea00640 1 -- 172.21.15.17:0/3690391537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc2c0003bf0 con 0x7fc2d80b3360 2024-09-10T23:24:58.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.402+0000 7fc2cea00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2b40725e0 0x7fc2b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:58.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.402+0000 7fc2cea00640 1 -- 172.21.15.17:0/3690391537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fc2c0092a40 con 0x7fc2d80b3360 2024-09-10T23:24:58.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.402+0000 7fc2d5e00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2b40725e0 0x7fc2b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:58.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.402+0000 7fc2d5e00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2b40725e0 0x7fc2b4074aa0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009aa0 tx=0x7fc2c8005d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.406+0000 7fc2cea00640 1 -- 172.21.15.17:0/3690391537 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc2d81fc0a0 con 0x7fc2d80b3360 2024-09-10T23:24:58.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.590+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2d80709a0 con 0x7fc2d80b3360 2024-09-10T23:24:58.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2cea00640 1 -- 172.21.15.17:0/3690391537 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v133) ==== 80+0+0 (secure 0 0 0) 0x7fc2c005e040 con 0x7fc2d80b3360 2024-09-10T23:24:58.596 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:24:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2b40725e0 msgr2=0x7fc2b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2b40725e0 0x7fc2b4074aa0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009aa0 tx=0x7fc2c8005d30 comp rx=0 tx=0).stop 2024-09-10T23:24:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80b3360 msgr2=0x7fc2d81fbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80b3360 0x7fc2d81fbb60 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c450 tx=0x7fc2c000c910 comp rx=0 tx=0).stop 2024-09-10T23:24:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 shutdown_connections 2024-09-10T23:24:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc2b40725e0 0x7fc2b4074aa0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2d815be40 0x7fc2d80cdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2d80b3360 0x7fc2d81fbb60 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 --2- 172.21.15.17:0/3690391537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2d80af8d0 0x7fc2d814f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:58.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 >> 172.21.15.17:0/3690391537 conn(0x7fc2d80d1d60 msgr2=0x7fc2d8165f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:58.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 shutdown_connections 2024-09-10T23:24:58.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:58.594+0000 7fc2dce00640 1 -- 172.21.15.17:0/3690391537 wait complete. 2024-09-10T23:24:58.617 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:24:58.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:58.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:24:58.636 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[72356]: fuse finished with error 0 and tester_r 0 2024-09-10T23:24:58.845 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:24:58.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:24:58.845 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:24:59.039 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:24:59.039 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:24:59.040 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:59.049 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:24:59.050 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:24:59.050 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:24:59.050 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:59.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:24:59.095 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:24:59.096 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:24:59.096 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:24:59.105 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:24:59.105 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:59.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 -- 172.21.15.17:0/86458350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec070ad0 msgr2=0x7f04ec15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 --2- 172.21.15.17:0/86458350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec070ad0 0x7f04ec15f060 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0c5320 tx=0x7f04dc01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 -- 172.21.15.17:0/86458350 shutdown_connections 2024-09-10T23:24:59.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 --2- 172.21.15.17:0/86458350 >> v2:172.21.15.77:3300/0 conn(0x7f04ec0d1830 0x7f04ec15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 --2- 172.21.15.17:0/86458350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec070ad0 0x7f04ec15f060 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 -- 172.21.15.17:0/86458350 >> 172.21.15.17:0/86458350 conn(0x7f04ec0d1d60 msgr2=0x7f04ec0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 -- 172.21.15.17:0/86458350 shutdown_connections 2024-09-10T23:24:59.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 -- 172.21.15.17:0/86458350 wait complete. 2024-09-10T23:24:59.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 Processor -- start 2024-09-10T23:24:59.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 -- start start 2024-09-10T23:24:59.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec070ad0 0x7f04ec0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec0cf320 0x7f04ec15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec0d1830 0x7f04ec15dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec169320 con 0x7f04ec0d1830 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec1691a0 con 0x7f04ec0cf320 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04f1800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f04ec1694a0 con 0x7f04ec070ad0 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec0d1830 0x7f04ec15dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec0d1830 0x7f04ec15dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42600/0 (socket says 172.21.15.17:42600) 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04eb400640 1 -- 172.21.15.17:0/1926272021 learned_addr learned my addr 172.21.15.17:0/1926272021 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04ea000640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec0cf320 0x7f04ec15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04eaa00640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec070ad0 0x7f04ec0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04eb400640 1 -- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec070ad0 msgr2=0x7f04ec0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04eb400640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec070ad0 0x7f04ec0b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04eb400640 1 -- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec0cf320 msgr2=0x7f04ec15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04eb400640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec0cf320 0x7f04ec15b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04eb400640 1 -- 172.21.15.17:0/1926272021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ec15bc30 con 0x7f04ec0d1830 2024-09-10T23:24:59.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.282+0000 7f04ea000640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec0cf320 0x7f04ec15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:24:59.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04eb400640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec0d1830 0x7f04ec15dde0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c7c0 tx=0x7f04e400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04e2a00640 1 -- 172.21.15.17:0/1926272021 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4003b80 con 0x7f04ec0d1830 2024-09-10T23:24:59.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04e2a00640 1 -- 172.21.15.17:0/1926272021 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04e4003d20 con 0x7f04ec0d1830 2024-09-10T23:24:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ec15bf00 con 0x7f04ec0d1830 2024-09-10T23:24:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04e2a00640 1 -- 172.21.15.17:0/1926272021 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e400aab0 con 0x7f04ec0d1830 2024-09-10T23:24:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ec0b1aa0 con 0x7f04ec0d1830 2024-09-10T23:24:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ec0cfc60 con 0x7f04ec0d1830 2024-09-10T23:24:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04e2a00640 1 -- 172.21.15.17:0/1926272021 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f04e400ac50 con 0x7f04ec0d1830 2024-09-10T23:24:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04e2a00640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f04cc0725e0 0x7f04cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04e2a00640 1 -- 172.21.15.17:0/1926272021 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f04e4093340 con 0x7f04ec0d1830 2024-09-10T23:24:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.286+0000 7f04eaa00640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f04cc0725e0 0x7f04cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.290+0000 7f04eaa00640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f04cc0725e0 0x7f04cc074aa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0af000 tx=0x7f04dc01b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.290+0000 7f04e2a00640 1 -- 172.21.15.17:0/1926272021 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f04e405e7f0 con 0x7f04ec0d1830 2024-09-10T23:24:59.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.498+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04ec0b6c90 con 0x7f04ec0d1830 2024-09-10T23:24:59.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.498+0000 7f04e2a00640 1 -- 172.21.15.17:0/1926272021 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5222 (secure 0 0 0) 0x7f04e405e0f0 con 0x7f04ec0d1830 2024-09-10T23:24:59.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:59.502 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":95,"btime":"2024-09-10T23:24:27:975406+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4055700220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4055700220},{"type":"v1","addr":"172.21.15.77:6836","nonce":4055700220}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2576092770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2576092770},{"type":"v1","addr":"172.21.15.77:6837","nonce":2576092770}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3395065105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3395065105},{"type":"v1","addr":"172.21.15.17:6834","nonce":3395065105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:24:24.355056+0000","modified":"2024-09-10T23:24:27.384443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8238":{"gid":8238,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/884432446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":884432446},{"type":"v1","addr":"172.21.15.17:6835","nonce":884432446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":8}]} 2024-09-10T23:24:59.503 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 95 2024-09-10T23:24:59.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f04cc0725e0 msgr2=0x7f04cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f04cc0725e0 0x7f04cc074aa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0af000 tx=0x7f04dc01b100 comp rx=0 tx=0).stop 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec0d1830 msgr2=0x7f04ec15dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec0d1830 0x7f04ec15dde0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c7c0 tx=0x7f04e400cc80 comp rx=0 tx=0).stop 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 shutdown_connections 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f04cc0725e0 0x7f04cc074aa0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04ec0d1830 0x7f04ec15dde0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04ec0cf320 0x7f04ec15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 --2- 172.21.15.17:0/1926272021 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04ec070ad0 0x7f04ec0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 >> 172.21.15.17:0/1926272021 conn(0x7f04ec0d1d60 msgr2=0x7f04ec0b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 shutdown_connections 2024-09-10T23:24:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.502+0000 7f04f1800640 1 -- 172.21.15.17:0/1926272021 wait complete. 2024-09-10T23:24:59.524 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:24:59.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.666+0000 7fad50c00640 1 -- 172.21.15.17:0/444317691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 msgr2=0x7fad4c0d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.666+0000 7fad50c00640 1 --2- 172.21.15.17:0/444317691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 0x7fad4c0d0380 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fad38009900 tx=0x7fad3801f0d0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.666+0000 7fad50c00640 1 -- 172.21.15.17:0/444317691 shutdown_connections 2024-09-10T23:24:59.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.666+0000 7fad50c00640 1 --2- 172.21.15.17:0/444317691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 0x7fad4c0d0380 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.666+0000 7fad50c00640 1 --2- 172.21.15.17:0/444317691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad4c15ab00 0x7fad4c0741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.666+0000 7fad50c00640 1 -- 172.21.15.17:0/444317691 >> 172.21.15.17:0/444317691 conn(0x7fad4c0d0c60 msgr2=0x7fad4c0d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.666+0000 7fad50c00640 1 -- 172.21.15.17:0/444317691 shutdown_connections 2024-09-10T23:24:59.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.666+0000 7fad50c00640 1 -- 172.21.15.17:0/444317691 wait complete. 2024-09-10T23:24:59.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.666+0000 7fad50c00640 1 Processor -- start 2024-09-10T23:24:59.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 -- start start 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 0x7fad4c0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad4c0c6430 0x7fad4c0c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad4c15ab00 0x7fad4c142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c070090 con 0x7fad4c0711f0 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c06ff10 con 0x7fad4c0c6430 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fad4c070210 con 0x7fad4c15ab00 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 0x7fad4c0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 0x7fad4c0ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42616/0 (socket says 172.21.15.17:42616) 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49e00640 1 -- 172.21.15.17:0/3192306824 learned_addr learned my addr 172.21.15.17:0/3192306824 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49400640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad4c0c6430 0x7fad4c0c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad4a800640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad4c15ab00 0x7fad4c142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49e00640 1 -- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad4c15ab00 msgr2=0x7fad4c142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49e00640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad4c15ab00 0x7fad4c142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49e00640 1 -- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad4c0c6430 msgr2=0x7fad4c0c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49e00640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad4c0c6430 0x7fad4c0c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49e00640 1 -- 172.21.15.17:0/3192306824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4c142bb0 con 0x7fad4c0711f0 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad4a800640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad4c15ab00 0x7fad4c142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad49e00640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 0x7fad4c0ca540 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00d950 tx=0x7fad3c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad42000640 1 -- 172.21.15.17:0/3192306824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c017070 con 0x7fad4c0711f0 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad42000640 1 -- 172.21.15.17:0/3192306824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad3c009d20 con 0x7fad4c0711f0 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4c145e50 con 0x7fad4c0711f0 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad42000640 1 -- 172.21.15.17:0/3192306824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0106c0 con 0x7fad4c0711f0 2024-09-10T23:24:59.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4c143220 con 0x7fad4c0711f0 2024-09-10T23:24:59.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.670+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad4c0c6aa0 con 0x7fad4c0711f0 2024-09-10T23:24:59.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.674+0000 7fad42000640 1 -- 172.21.15.17:0/3192306824 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fad3c010860 con 0x7fad4c0711f0 2024-09-10T23:24:59.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.674+0000 7fad42000640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad2c0725e0 0x7fad2c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:24:59.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.674+0000 7fad42000640 1 -- 172.21.15.17:0/3192306824 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fad3c093870 con 0x7fad4c0711f0 2024-09-10T23:24:59.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.674+0000 7fad49400640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad2c0725e0 0x7fad2c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:24:59.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.674+0000 7fad49400640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad2c0725e0 0x7fad2c074aa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fad380b2000 tx=0x7fad3801d910 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:24:59.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.678+0000 7fad42000640 1 -- 172.21.15.17:0/3192306824 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fad3c05edb0 con 0x7fad4c0711f0 2024-09-10T23:24:59.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.886+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad4c15a230 con 0x7fad4c0711f0 2024-09-10T23:24:59.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.886+0000 7fad42000640 1 -- 172.21.15.17:0/3192306824 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5222 (secure 0 0 0) 0x7fad3c05e6b0 con 0x7fad4c0711f0 2024-09-10T23:24:59.890 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:24:59.890 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":95,"btime":"2024-09-10T23:24:27:975406+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4055700220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4055700220},{"type":"v1","addr":"172.21.15.77:6836","nonce":4055700220}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2576092770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2576092770},{"type":"v1","addr":"172.21.15.77:6837","nonce":2576092770}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3395065105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3395065105},{"type":"v1","addr":"172.21.15.17:6834","nonce":3395065105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:24:24.355056+0000","modified":"2024-09-10T23:24:27.384443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8238":{"gid":8238,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/884432446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":884432446},{"type":"v1","addr":"172.21.15.17:6835","nonce":884432446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":8}]} 2024-09-10T23:24:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 95 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad2c0725e0 msgr2=0x7fad2c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad2c0725e0 0x7fad2c074aa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fad380b2000 tx=0x7fad3801d910 comp rx=0 tx=0).stop 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 msgr2=0x7fad4c0ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 0x7fad4c0ca540 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00d950 tx=0x7fad3c00de10 comp rx=0 tx=0).stop 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 shutdown_connections 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fad2c0725e0 0x7fad2c074aa0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad4c15ab00 0x7fad4c142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad4c0c6430 0x7fad4c0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 --2- 172.21.15.17:0/3192306824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad4c0711f0 0x7fad4c0ca540 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 >> 172.21.15.17:0/3192306824 conn(0x7fad4c0d0c60 msgr2=0x7fad4c155940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:24:59.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 shutdown_connections 2024-09-10T23:24:59.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:24:59.890+0000 7fad50c00640 1 -- 172.21.15.17:0/3192306824 wait complete. 2024-09-10T23:24:59.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:25:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 -- 172.21.15.17:0/1373141606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf9c15f000 msgr2=0x7fdf9c160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 --2- 172.21.15.17:0/1373141606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf9c15f000 0x7fdf9c160260 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009840 tx=0x7fdf8c01c6a0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 -- 172.21.15.17:0/1373141606 shutdown_connections 2024-09-10T23:25:00.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 --2- 172.21.15.17:0/1373141606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf9c06cbc0 0x7fdf9c06d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 --2- 172.21.15.17:0/1373141606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf9c15f000 0x7fdf9c160260 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 -- 172.21.15.17:0/1373141606 >> 172.21.15.17:0/1373141606 conn(0x7fdf9c0d0c40 msgr2=0x7fdf9c0d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 -- 172.21.15.17:0/1373141606 shutdown_connections 2024-09-10T23:25:00.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 -- 172.21.15.17:0/1373141606 wait complete. 2024-09-10T23:25:00.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 Processor -- start 2024-09-10T23:25:00.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 -- start start 2024-09-10T23:25:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf9c06cbc0 0x7fdf9c1f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf9c0d1920 0x7fdf9c0b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf9c15f000 0x7fdf9c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c168930 con 0x7fdf9c15f000 2024-09-10T23:25:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9c168ab0 con 0x7fdf9c06cbc0 2024-09-10T23:25:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdfa1200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9c168c30 con 0x7fdf9c0d1920 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf9a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf9c15f000 0x7fdf9c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf9a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf9c15f000 0x7fdf9c1595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42630/0 (socket says 172.21.15.17:42630) 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf9a800640 1 -- 172.21.15.17:0/616232330 learned_addr learned my addr 172.21.15.17:0/616232330 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf99e00640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf9c06cbc0 0x7fdf9c1f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf93e00640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf9c0d1920 0x7fdf9c0b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf9a800640 1 -- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf9c0d1920 msgr2=0x7fdf9c0b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf9a800640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf9c0d1920 0x7fdf9c0b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf9a800640 1 -- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf9c06cbc0 msgr2=0x7fdf9c1f7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf9a800640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf9c06cbc0 0x7fdf9c1f7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.058+0000 7fdf9a800640 1 -- 172.21.15.17:0/616232330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9c15cbd0 con 0x7fdf9c15f000 2024-09-10T23:25:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdf9a800640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf9c15f000 0x7fdf9c1595a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400eb20 tx=0x7fdf9400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdf92000640 1 -- 172.21.15.17:0/616232330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94004b30 con 0x7fdf9c15f000 2024-09-10T23:25:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdf92000640 1 -- 172.21.15.17:0/616232330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf94004cf0 con 0x7fdf9c15f000 2024-09-10T23:25:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdf92000640 1 -- 172.21.15.17:0/616232330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94005280 con 0x7fdf9c15f000 2024-09-10T23:25:00.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9c1f80c0 con 0x7fdf9c15f000 2024-09-10T23:25:00.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9c1f8680 con 0x7fdf9c15f000 2024-09-10T23:25:00.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf9c15cda0 con 0x7fdf9c15f000 2024-09-10T23:25:00.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdf92000640 1 -- 172.21.15.17:0/616232330 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdf94005420 con 0x7fdf9c15f000 2024-09-10T23:25:00.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdf92000640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf780725e0 0x7fdf78074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdf92000640 1 -- 172.21.15.17:0/616232330 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fdf94093fd0 con 0x7fdf9c15f000 2024-09-10T23:25:00.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.062+0000 7fdf99e00640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf780725e0 0x7fdf78074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.066+0000 7fdf99e00640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf780725e0 0x7fdf78074aa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0af000 tx=0x7fdf8c01af40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.066+0000 7fdf92000640 1 -- 172.21.15.17:0/616232330 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdf9405eec0 con 0x7fdf9c15f000 2024-09-10T23:25:00.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf9c06d050 con 0x7fdf9c15f000 2024-09-10T23:25:00.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdf92000640 1 -- 172.21.15.17:0/616232330 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+16952 (secure 0 0 0) 0x7fdf940638f0 con 0x7fdf9c15f000 2024-09-10T23:25:00.245 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:00.245 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":133,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:24:25.950001+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:24:22.074232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-10T23:24:23.324088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:25:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf780725e0 msgr2=0x7fdf78074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf780725e0 0x7fdf78074aa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0af000 tx=0x7fdf8c01af40 comp rx=0 tx=0).stop 2024-09-10T23:25:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf9c15f000 msgr2=0x7fdf9c1595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf9c15f000 0x7fdf9c1595a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400eb20 tx=0x7fdf9400c2d0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 shutdown_connections 2024-09-10T23:25:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf780725e0 0x7fdf78074aa0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf9c15f000 0x7fdf9c1595a0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf9c0d1920 0x7fdf9c0b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 --2- 172.21.15.17:0/616232330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf9c06cbc0 0x7fdf9c1f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 >> 172.21.15.17:0/616232330 conn(0x7fdf9c0d0c40 msgr2=0x7fdf9c15b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 shutdown_connections 2024-09-10T23:25:00.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.242+0000 7fdfa1200640 1 -- 172.21.15.17:0/616232330 wait complete. 2024-09-10T23:25:00.268 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:25:00.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.410+0000 7f417a000640 1 -- 172.21.15.17:0/2416847438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41740cf9c0 msgr2=0x7f41740b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.410+0000 7f417a000640 1 --2- 172.21.15.17:0/2416847438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41740cf9c0 0x7f41740b3420 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f416c009c80 tx=0x7f416c01d800 comp rx=0 tx=0).stop 2024-09-10T23:25:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.410+0000 7f417a000640 1 -- 172.21.15.17:0/2416847438 shutdown_connections 2024-09-10T23:25:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.410+0000 7f417a000640 1 --2- 172.21.15.17:0/2416847438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41740cf9c0 0x7f41740b3420 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.410+0000 7f417a000640 1 --2- 172.21.15.17:0/2416847438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f417415e840 0x7f41740691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.410+0000 7f417a000640 1 -- 172.21.15.17:0/2416847438 >> 172.21.15.17:0/2416847438 conn(0x7f41740d03d0 msgr2=0x7f41740d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.410+0000 7f417a000640 1 -- 172.21.15.17:0/2416847438 shutdown_connections 2024-09-10T23:25:00.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.410+0000 7f417a000640 1 -- 172.21.15.17:0/2416847438 wait complete. 2024-09-10T23:25:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 Processor -- start 2024-09-10T23:25:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 -- start start 2024-09-10T23:25:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41740cf9c0 0x7f417414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41740d0ef0 0x7f417414df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417415e840 0x7f41740b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4174168530 con 0x7f417415e840 2024-09-10T23:25:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41741683b0 con 0x7f41740cf9c0 2024-09-10T23:25:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f41741686b0 con 0x7f41740d0ef0 2024-09-10T23:25:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417415e840 0x7f41740b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417415e840 0x7f41740b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42652/0 (socket says 172.21.15.17:42652) 2024-09-10T23:25:00.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173e00640 1 -- 172.21.15.17:0/1234845939 learned_addr learned my addr 172.21.15.17:0/1234845939 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173400640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41740cf9c0 0x7f417414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f416aa00640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41740d0ef0 0x7f417414df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173e00640 1 -- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41740d0ef0 msgr2=0x7f417414df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173e00640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41740d0ef0 0x7f417414df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173e00640 1 -- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41740cf9c0 msgr2=0x7f417414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173e00640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41740cf9c0 0x7f417414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173e00640 1 -- 172.21.15.17:0/1234845939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4174152900 con 0x7f417415e840 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173400640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41740cf9c0 0x7f417414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f4173e00640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417415e840 0x7f41740b1640 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f416c009bd0 tx=0x7f416c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f416be00640 1 -- 172.21.15.17:0/1234845939 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c0bb070 con 0x7f417415e840 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f416be00640 1 -- 172.21.15.17:0/1234845939 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f416c004e00 con 0x7f417415e840 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f416be00640 1 -- 172.21.15.17:0/1234845939 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c0b2040 con 0x7f417415e840 2024-09-10T23:25:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417414ced0 con 0x7f417415e840 2024-09-10T23:25:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.414+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417414d490 con 0x7f417415e840 2024-09-10T23:25:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.418+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41740b3420 con 0x7f417415e840 2024-09-10T23:25:00.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.418+0000 7f416be00640 1 -- 172.21.15.17:0/1234845939 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f416c0b5030 con 0x7f417415e840 2024-09-10T23:25:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.418+0000 7f416be00640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41500725e0 0x7f4150074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.418+0000 7f416be00640 1 -- 172.21.15.17:0/1234845939 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f416c12d090 con 0x7f417415e840 2024-09-10T23:25:00.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.418+0000 7f4173400640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41500725e0 0x7f4150074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.418+0000 7f4173400640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41500725e0 0x7f4150074aa0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4164005fd0 tx=0x7f4164005f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.422+0000 7f416be00640 1 -- 172.21.15.17:0/1234845939 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f416c016990 con 0x7f417415e840 2024-09-10T23:25:00.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.638+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4174073f20 con 0x7f417415e840 2024-09-10T23:25:00.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.638+0000 7f416be00640 1 -- 172.21.15.17:0/1234845939 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5222 (secure 0 0 0) 0x7f416c0f8540 con 0x7f417415e840 2024-09-10T23:25:00.643 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:00.643 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":95,"btime":"2024-09-10T23:24:27:975406+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4055700220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4055700220},{"type":"v1","addr":"172.21.15.77:6836","nonce":4055700220}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2576092770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2576092770},{"type":"v1","addr":"172.21.15.77:6837","nonce":2576092770}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3395065105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3395065105},{"type":"v1","addr":"172.21.15.17:6834","nonce":3395065105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:24:24.355056+0000","modified":"2024-09-10T23:24:27.384443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8238":{"gid":8238,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/884432446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":884432446},{"type":"v1","addr":"172.21.15.17:6835","nonce":884432446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":8}]} 2024-09-10T23:25:00.644 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 95 2024-09-10T23:25:00.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41500725e0 msgr2=0x7f4150074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41500725e0 0x7f4150074aa0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4164005fd0 tx=0x7f4164005f20 comp rx=0 tx=0).stop 2024-09-10T23:25:00.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417415e840 msgr2=0x7f41740b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417415e840 0x7f41740b1640 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f416c009bd0 tx=0x7f416c003f60 comp rx=0 tx=0).stop 2024-09-10T23:25:00.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 shutdown_connections 2024-09-10T23:25:00.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41500725e0 0x7f4150074aa0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f417415e840 0x7f41740b1640 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41740d0ef0 0x7f417414df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 --2- 172.21.15.17:0/1234845939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41740cf9c0 0x7f417414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 >> 172.21.15.17:0/1234845939 conn(0x7f41740d03d0 msgr2=0x7f4174073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 shutdown_connections 2024-09-10T23:25:00.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.642+0000 7f417a000640 1 -- 172.21.15.17:0/1234845939 wait complete. 2024-09-10T23:25:00.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:00.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.806+0000 7f22c0800640 1 -- 172.21.15.17:0/533675299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 msgr2=0x7f22b80cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.806+0000 7f22c0800640 1 --2- 172.21.15.17:0/533675299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 0x7f22b80cd880 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f22b80cf010 tx=0x7f22b401cda0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.806+0000 7f22c0800640 1 -- 172.21.15.17:0/533675299 shutdown_connections 2024-09-10T23:25:00.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.806+0000 7f22c0800640 1 --2- 172.21.15.17:0/533675299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 0x7f22b80cd880 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.806+0000 7f22c0800640 1 --2- 172.21.15.17:0/533675299 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22b8070ad0 0x7f22b815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.806+0000 7f22c0800640 1 -- 172.21.15.17:0/533675299 >> 172.21.15.17:0/533675299 conn(0x7f22b80d1d60 msgr2=0x7f22b80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:00.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.806+0000 7f22c0800640 1 -- 172.21.15.17:0/533675299 shutdown_connections 2024-09-10T23:25:00.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.806+0000 7f22c0800640 1 -- 172.21.15.17:0/533675299 wait complete. 2024-09-10T23:25:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 Processor -- start 2024-09-10T23:25:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 -- start start 2024-09-10T23:25:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b8070ad0 0x7f22b80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 0x7f22b8153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22b80d1830 0x7f22b815c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f22b8169460 con 0x7f22b80cf320 2024-09-10T23:25:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f22b81692e0 con 0x7f22b8070ad0 2024-09-10T23:25:00.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f22b81695e0 con 0x7f22b80d1830 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 0x7f22b8153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 0x7f22b8153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42672/0 (socket says 172.21.15.17:42672) 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bd400640 1 -- 172.21.15.17:0/3560117562 learned_addr learned my addr 172.21.15.17:0/3560117562 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22be800640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22b80d1830 0x7f22b815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bde00640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b8070ad0 0x7f22b80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bd400640 1 -- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22b80d1830 msgr2=0x7f22b815c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bd400640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22b80d1830 0x7f22b815c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bd400640 1 -- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b8070ad0 msgr2=0x7f22b80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bd400640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b8070ad0 0x7f22b80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bd400640 1 -- 172.21.15.17:0/3560117562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b815ce40 con 0x7f22b80cf320 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22bd400640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 0x7f22b8153dc0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c3f0 tx=0x7f22a800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22b2000640 1 -- 172.21.15.17:0/3560117562 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8017070 con 0x7f22b80cf320 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22b2000640 1 -- 172.21.15.17:0/3560117562 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22a80053c0 con 0x7f22b80cf320 2024-09-10T23:25:00.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22b2000640 1 -- 172.21.15.17:0/3560117562 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8003860 con 0x7f22b80cf320 2024-09-10T23:25:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b80b1d80 con 0x7f22b80cf320 2024-09-10T23:25:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b80b2340 con 0x7f22b80cf320 2024-09-10T23:25:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.810+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b815f060 con 0x7f22b80cf320 2024-09-10T23:25:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.814+0000 7f22b2000640 1 -- 172.21.15.17:0/3560117562 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f22a8003a00 con 0x7f22b80cf320 2024-09-10T23:25:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.814+0000 7f22b2000640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f229c0725e0 0x7f229c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.814+0000 7f22b2000640 1 -- 172.21.15.17:0/3560117562 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7f22a8092a40 con 0x7f22b80cf320 2024-09-10T23:25:00.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.814+0000 7f22bde00640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f229c0725e0 0x7f229c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:00.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.814+0000 7f22bde00640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f229c0725e0 0x7f229c074aa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0058d0 tx=0x7f22ac005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:00.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:00.818+0000 7f22b2000640 1 -- 172.21.15.17:0/3560117562 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f22a805d810 con 0x7f22b80cf320 2024-09-10T23:25:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.026+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22b8166a90 con 0x7f22b80cf320 2024-09-10T23:25:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.026+0000 7f22b2000640 1 -- 172.21.15.17:0/3560117562 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5222 (secure 0 0 0) 0x7f22a8062240 con 0x7f22b80cf320 2024-09-10T23:25:01.030 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:01.030 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":95,"btime":"2024-09-10T23:24:27:975406+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4055700220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4055700220},{"type":"v1","addr":"172.21.15.77:6836","nonce":4055700220}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2576092770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2576092770},{"type":"v1","addr":"172.21.15.77:6837","nonce":2576092770}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":8232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3395065105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3395065105},{"type":"v1","addr":"172.21.15.17:6834","nonce":3395065105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:24:24.355056+0000","modified":"2024-09-10T23:24:27.384443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8238},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8238":{"gid":8238,"name":"a","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/884432446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":884432446},{"type":"v1","addr":"172.21.15.17:6835","nonce":884432446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8238,"qdb_cluster":[8238]},"id":8}]} 2024-09-10T23:25:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 95 2024-09-10T23:25:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f229c0725e0 msgr2=0x7f229c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f229c0725e0 0x7f229c074aa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0058d0 tx=0x7f22ac005860 comp rx=0 tx=0).stop 2024-09-10T23:25:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 msgr2=0x7f22b8153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 0x7f22b8153dc0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c3f0 tx=0x7f22a800c8b0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 shutdown_connections 2024-09-10T23:25:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f229c0725e0 0x7f229c074aa0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22b80d1830 0x7f22b815c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22b80cf320 0x7f22b8153dc0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 --2- 172.21.15.17:0/3560117562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22b8070ad0 0x7f22b80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 >> 172.21.15.17:0/3560117562 conn(0x7f22b80d1d60 msgr2=0x7f22b815e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 shutdown_connections 2024-09-10T23:25:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.030+0000 7f22c0800640 1 -- 172.21.15.17:0/3560117562 wait complete. 2024-09-10T23:25:01.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:25:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 -- 172.21.15.17:0/2966113596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4300d1920 msgr2=0x7fc430160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 --2- 172.21.15.17:0/2966113596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4300d1920 0x7fc430160260 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc43006f270 tx=0x7fc41801c780 comp rx=0 tx=0).stop 2024-09-10T23:25:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 -- 172.21.15.17:0/2966113596 shutdown_connections 2024-09-10T23:25:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 --2- 172.21.15.17:0/2966113596 >> v2:172.21.15.77:3300/0 conn(0x7fc43006cbc0 0x7fc43006d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 --2- 172.21.15.17:0/2966113596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4300d1920 0x7fc430160260 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 -- 172.21.15.17:0/2966113596 >> 172.21.15.17:0/2966113596 conn(0x7fc4300d0c40 msgr2=0x7fc4300d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:01.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 -- 172.21.15.17:0/2966113596 shutdown_connections 2024-09-10T23:25:01.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 -- 172.21.15.17:0/2966113596 wait complete. 2024-09-10T23:25:01.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 Processor -- start 2024-09-10T23:25:01.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 -- start start 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc43006cbc0 0x7fc430164c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300d1920 0x7fc4300c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43015f000 0x7fc4300c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc430168930 con 0x7fc43006cbc0 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4300cf7b0 con 0x7fc43015f000 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc436e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc430168ab0 con 0x7fc4300d1920 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc42fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc43006cbc0 0x7fc430164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc42fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc43006cbc0 0x7fc430164c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42690/0 (socket says 172.21.15.17:42690) 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc42fe00640 1 -- 172.21.15.17:0/3901108912 learned_addr learned my addr 172.21.15.17:0/3901108912 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc434e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43015f000 0x7fc4300c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc427e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300d1920 0x7fc4300c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc42fe00640 1 -- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300d1920 msgr2=0x7fc4300c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc42fe00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300d1920 0x7fc4300c3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc42fe00640 1 -- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43015f000 msgr2=0x7fc4300c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc42fe00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43015f000 0x7fc4300c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc42fe00640 1 -- 172.21.15.17:0/3901108912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4300ca3b0 con 0x7fc43006cbc0 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.198+0000 7fc434e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43015f000 0x7fc4300c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc42fe00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc43006cbc0 0x7fc430164c50 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c3f0 tx=0x7fc42000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc42cc00640 1 -- 172.21.15.17:0/3901108912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420017070 con 0x7fc43006cbc0 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc42cc00640 1 -- 172.21.15.17:0/3901108912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4200053c0 con 0x7fc43006cbc0 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc42cc00640 1 -- 172.21.15.17:0/3901108912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420003860 con 0x7fc43006cbc0 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4300ca690 con 0x7fc43006cbc0 2024-09-10T23:25:01.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4300c3ed0 con 0x7fc43006cbc0 2024-09-10T23:25:01.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc43006d050 con 0x7fc43006cbc0 2024-09-10T23:25:01.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc42cc00640 1 -- 172.21.15.17:0/3901108912 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc420003a00 con 0x7fc43006cbc0 2024-09-10T23:25:01.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc42cc00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc40c0725e0 0x7fc40c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc42cc00640 1 -- 172.21.15.17:0/3901108912 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fc4200929e0 con 0x7fc43006cbc0 2024-09-10T23:25:01.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.202+0000 7fc427e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc40c0725e0 0x7fc40c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.206+0000 7fc427e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc40c0725e0 0x7fc40c074aa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc4180af000 tx=0x7fc41801afc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:01.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.206+0000 7fc42cc00640 1 -- 172.21.15.17:0/3901108912 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc42005df20 con 0x7fc43006cbc0 2024-09-10T23:25:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.382+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4300cabb0 con 0x7fc43006cbc0 2024-09-10T23:25:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.382+0000 7fc42cc00640 1 -- 172.21.15.17:0/3901108912 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+16952 (secure 0 0 0) 0x7fc42005d820 con 0x7fc43006cbc0 2024-09-10T23:25:01.386 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:01.386 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":133,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:24:25.950001+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:24:22.074232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-10T23:24:23.324088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:25:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc40c0725e0 msgr2=0x7fc40c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc40c0725e0 0x7fc40c074aa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc4180af000 tx=0x7fc41801afc0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc43006cbc0 msgr2=0x7fc430164c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc43006cbc0 0x7fc430164c50 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c3f0 tx=0x7fc42000c8b0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 shutdown_connections 2024-09-10T23:25:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc40c0725e0 0x7fc40c074aa0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc43015f000 0x7fc4300c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300d1920 0x7fc4300c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 --2- 172.21.15.17:0/3901108912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc43006cbc0 0x7fc430164c50 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 >> 172.21.15.17:0/3901108912 conn(0x7fc4300d0c40 msgr2=0x7fc4300b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 shutdown_connections 2024-09-10T23:25:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.386+0000 7fc436e00640 1 -- 172.21.15.17:0/3901108912 wait complete. 2024-09-10T23:25:01.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:25:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.554+0000 7fef2ca00640 1 -- 172.21.15.17:0/1961331386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 msgr2=0x7fef280cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.554+0000 7fef2ca00640 1 --2- 172.21.15.17:0/1961331386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 0x7fef280cb520 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fef18009840 tx=0x7fef1801c820 comp rx=0 tx=0).stop 2024-09-10T23:25:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.554+0000 7fef2ca00640 1 -- 172.21.15.17:0/1961331386 shutdown_connections 2024-09-10T23:25:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.554+0000 7fef2ca00640 1 --2- 172.21.15.17:0/1961331386 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef280ca780 0x7fef280cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.554+0000 7fef2ca00640 1 --2- 172.21.15.17:0/1961331386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 0x7fef280cb520 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.554+0000 7fef2ca00640 1 -- 172.21.15.17:0/1961331386 >> 172.21.15.17:0/1961331386 conn(0x7fef280cfd50 msgr2=0x7fef280d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.554+0000 7fef2ca00640 1 -- 172.21.15.17:0/1961331386 shutdown_connections 2024-09-10T23:25:01.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.554+0000 7fef2ca00640 1 -- 172.21.15.17:0/1961331386 wait complete. 2024-09-10T23:25:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 Processor -- start 2024-09-10T23:25:01.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 -- start start 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 0x7fef281541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef280ca780 0x7fef280b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef280ce1b0 0x7fef28150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fef28164ff0 con 0x7fef280ca3a0 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fef28164e70 con 0x7fef280ca780 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fef28165170 con 0x7fef280ce1b0 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef26800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 0x7fef281541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef26800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 0x7fef281541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42694/0 (socket says 172.21.15.17:42694) 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef26800640 1 -- 172.21.15.17:0/3399348756 learned_addr learned my addr 172.21.15.17:0/3399348756 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef27200640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef280ce1b0 0x7fef28150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef1de00640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef280ca780 0x7fef280b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef26800640 1 -- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef280ce1b0 msgr2=0x7fef28150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef26800640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef280ce1b0 0x7fef28150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef26800640 1 -- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef280ca780 msgr2=0x7fef280b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef26800640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef280ca780 0x7fef280b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef26800640 1 -- 172.21.15.17:0/3399348756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef28154720 con 0x7fef280ca3a0 2024-09-10T23:25:01.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef26800640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 0x7fef281541e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fef18009790 tx=0x7fef180a6700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef1f400640 1 -- 172.21.15.17:0/3399348756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef180042c0 con 0x7fef280ca3a0 2024-09-10T23:25:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef1f400640 1 -- 172.21.15.17:0/3399348756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef18005020 con 0x7fef280ca3a0 2024-09-10T23:25:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef1f400640 1 -- 172.21.15.17:0/3399348756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18005450 con 0x7fef280ca3a0 2024-09-10T23:25:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef281fb310 con 0x7fef280ca3a0 2024-09-10T23:25:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef281fb8d0 con 0x7fef280ca3a0 2024-09-10T23:25:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.558+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef281656d0 con 0x7fef280ca3a0 2024-09-10T23:25:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.562+0000 7fef1f400640 1 -- 172.21.15.17:0/3399348756 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fef180046d0 con 0x7fef280ca3a0 2024-09-10T23:25:01.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.562+0000 7fef1f400640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef040725e0 0x7fef04074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.562+0000 7fef1f400640 1 -- 172.21.15.17:0/3399348756 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 6101+0+0 (secure 0 0 0) 0x7fef1812da40 con 0x7fef280ca3a0 2024-09-10T23:25:01.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.562+0000 7fef1de00640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef040725e0 0x7fef04074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.562+0000 7fef1de00640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef040725e0 0x7fef04074aa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fef10005fd0 tx=0x7fef10005db0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:01.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.566+0000 7fef1f400640 1 -- 172.21.15.17:0/3399348756 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fef18016410 con 0x7fef280ca3a0 2024-09-10T23:25:01.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.774+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fef280cf470 con 0x7fef280ca3a0 2024-09-10T23:25:01.779 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:25:01.778+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:25:01.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.778+0000 7fef1f400640 1 -- 172.21.15.17:0/3399348756 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) ==== 161+0+0 (secure 0 0 0) 0x7fef180f9020 con 0x7fef280ca3a0 2024-09-10T23:25:01.781 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:25:01.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef040725e0 msgr2=0x7fef04074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef040725e0 0x7fef04074aa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fef10005fd0 tx=0x7fef10005db0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 msgr2=0x7fef281541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 0x7fef281541e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fef18009790 tx=0x7fef180a6700 comp rx=0 tx=0).stop 2024-09-10T23:25:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 shutdown_connections 2024-09-10T23:25:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fef040725e0 0x7fef04074aa0 secure :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fef10005fd0 tx=0x7fef10005db0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef280ce1b0 0x7fef28150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef280ca780 0x7fef280b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 --2- 172.21.15.17:0/3399348756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef280ca3a0 0x7fef281541e0 secure :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fef18009790 tx=0x7fef180a6700 comp rx=0 tx=0).stop 2024-09-10T23:25:01.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 >> 172.21.15.17:0/3399348756 conn(0x7fef280cfd50 msgr2=0x7fef280c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:01.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 shutdown_connections 2024-09-10T23:25:01.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.782+0000 7fef2ca00640 1 -- 172.21.15.17:0/3399348756 wait complete. 2024-09-10T23:25:01.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:25:01.850 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:25:01.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.954+0000 7f6e6c200640 1 -- 172.21.15.17:0/2276074448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 msgr2=0x7f6e4c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.954+0000 7f6e6c200640 1 --2- 172.21.15.17:0/2276074448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 0x7f6e4c003e80 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f6e580016f0 tx=0x7f6e5801c750 comp rx=0 tx=0).stop 2024-09-10T23:25:01.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.954+0000 7f6e6c200640 1 -- 172.21.15.17:0/2276074448 shutdown_connections 2024-09-10T23:25:01.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.954+0000 7f6e6c200640 1 --2- 172.21.15.17:0/2276074448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 0x7f6e4c003e80 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.954+0000 7f6e6c200640 1 -- 172.21.15.17:0/2276074448 >> 172.21.15.17:0/2276074448 conn(0x7f6e640d0320 msgr2=0x7f6e640d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:01.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.954+0000 7f6e6c200640 1 -- 172.21.15.17:0/2276074448 shutdown_connections 2024-09-10T23:25:01.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.954+0000 7f6e6c200640 1 -- 172.21.15.17:0/2276074448 wait complete. 2024-09-10T23:25:01.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.954+0000 7f6e6c200640 1 Processor -- start 2024-09-10T23:25:01.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.954+0000 7f6e6c200640 1 -- start start 2024-09-10T23:25:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 0x7f6e641fb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e640c58b0 0x7f6e640c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e640c2c80 0x7f6e640c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6e64074950 con 0x7f6e4c003a60 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6e640747d0 con 0x7f6e640c2c80 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6e64074ad0 con 0x7f6e640c58b0 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e69800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 0x7f6e641fb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e69800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 0x7f6e641fb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42734/0 (socket says 172.21.15.17:42734) 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e69800640 1 -- 172.21.15.17:0/615989738 learned_addr learned my addr 172.21.15.17:0/615989738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6a200640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e640c2c80 0x7f6e640c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e68e00640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e640c58b0 0x7f6e640c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e69800640 1 -- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e640c58b0 msgr2=0x7f6e640c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e69800640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e640c58b0 0x7f6e640c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e69800640 1 -- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e640c2c80 msgr2=0x7f6e640c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e69800640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e640c2c80 0x7f6e640c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e69800640 1 -- 172.21.15.17:0/615989738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e640c6910 con 0x7f6e4c003a60 2024-09-10T23:25:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6a200640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e640c2c80 0x7f6e640c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e69800640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 0x7f6e641fb250 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f6e5801b020 tx=0x7f6e58006500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e61600640 1 -- 172.21.15.17:0/615989738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e580b9070 con 0x7f6e4c003a60 2024-09-10T23:25:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e61600640 1 -- 172.21.15.17:0/615989738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e580af040 con 0x7f6e4c003a60 2024-09-10T23:25:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e640c6350 con 0x7f6e4c003a60 2024-09-10T23:25:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e61600640 1 -- 172.21.15.17:0/615989738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e580ae070 con 0x7f6e4c003a60 2024-09-10T23:25:01.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e64151250 con 0x7f6e4c003a60 2024-09-10T23:25:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.958+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e64075030 con 0x7f6e4c003a60 2024-09-10T23:25:01.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.962+0000 7f6e61600640 1 -- 172.21.15.17:0/615989738 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6e58003910 con 0x7f6e4c003a60 2024-09-10T23:25:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.962+0000 7f6e61600640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6e44072610 0x7f6e44074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.962+0000 7f6e61600640 1 -- 172.21.15.17:0/615989738 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 6187+0+0 (secure 0 0 0) 0x7f6e5812c390 con 0x7f6e4c003a60 2024-09-10T23:25:01.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.962+0000 7f6e68e00640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6e44072610 0x7f6e44074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:01.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.962+0000 7f6e68e00640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6e44072610 0x7f6e44074ad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6e640af290 tx=0x7f6e500091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:01.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:01.966+0000 7f6e61600640 1 -- 172.21.15.17:0/615989738 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6e580164b0 con 0x7f6e4c003a60 2024-09-10T23:25:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.174+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6e640c3620 con 0x7f6e4c003a60 2024-09-10T23:25:02.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e61600640 1 -- 172.21.15.17:0/615989738 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v97) ==== 104+0+0 (secure 0 0 0) 0x7f6e580f71a0 con 0x7f6e4c003a60 2024-09-10T23:25:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6e44072610 msgr2=0x7f6e44074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6e44072610 0x7f6e44074ad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6e640af290 tx=0x7f6e500091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 msgr2=0x7f6e641fb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 0x7f6e641fb250 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f6e5801b020 tx=0x7f6e58006500 comp rx=0 tx=0).stop 2024-09-10T23:25:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 shutdown_connections 2024-09-10T23:25:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6e44072610 0x7f6e44074ad0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e640c2c80 0x7f6e640c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6e640c58b0 0x7f6e640c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 --2- 172.21.15.17:0/615989738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e4c003a60 0x7f6e641fb250 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:02.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 >> 172.21.15.17:0/615989738 conn(0x7f6e640d0320 msgr2=0x7f6e640b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:02.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 shutdown_connections 2024-09-10T23:25:02.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:02.786+0000 7f6e6c200640 1 -- 172.21.15.17:0/615989738 wait complete. 2024-09-10T23:25:02.815 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:25:03.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.014+0000 7f75cdc00640 1 -- 172.21.15.17:0/45941805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 msgr2=0x7f75c80cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.014+0000 7f75cdc00640 1 --2- 172.21.15.17:0/45941805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 0x7f75c80cc7a0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009930 tx=0x7f75b801c880 comp rx=0 tx=0).stop 2024-09-10T23:25:03.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.014+0000 7f75cdc00640 1 -- 172.21.15.17:0/45941805 shutdown_connections 2024-09-10T23:25:03.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.014+0000 7f75cdc00640 1 --2- 172.21.15.17:0/45941805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 0x7f75c80cc7a0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.014+0000 7f75cdc00640 1 -- 172.21.15.17:0/45941805 >> 172.21.15.17:0/45941805 conn(0x7f75c809a9f0 msgr2=0x7f75c809add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.014+0000 7f75cdc00640 1 -- 172.21.15.17:0/45941805 shutdown_connections 2024-09-10T23:25:03.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.014+0000 7f75cdc00640 1 -- 172.21.15.17:0/45941805 wait complete. 2024-09-10T23:25:03.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.014+0000 7f75cdc00640 1 Processor -- start 2024-09-10T23:25:03.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.014+0000 7f75cdc00640 1 -- start start 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cdc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75c80ccce0 0x7f75c814e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cdc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75c80d0980 0x7f75c814eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cdc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 0x7f75c8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cdc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8169be0 con 0x7f75c815bb40 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cdc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8169a60 con 0x7f75c80d0980 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cdc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f75c8169d60 con 0x7f75c80ccce0 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cd200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 0x7f75c8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cd200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 0x7f75c8151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42762/0 (socket says 172.21.15.17:42762) 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cd200640 1 -- 172.21.15.17:0/3320819752 learned_addr learned my addr 172.21.15.17:0/3320819752 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75c7e00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75c80ccce0 0x7f75c814e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75bf400640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75c80d0980 0x7f75c814eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cd200640 1 -- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75c80ccce0 msgr2=0x7f75c814e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cd200640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75c80ccce0 0x7f75c814e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cd200640 1 -- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75c80d0980 msgr2=0x7f75c814eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cd200640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75c80d0980 0x7f75c814eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cd200640 1 -- 172.21.15.17:0/3320819752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c8152fd0 con 0x7f75c815bb40 2024-09-10T23:25:03.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cd200640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 0x7f75c8151e00 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c730 tx=0x7f75c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75c4c00640 1 -- 172.21.15.17:0/3320819752 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0003db0 con 0x7f75c815bb40 2024-09-10T23:25:03.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75c4c00640 1 -- 172.21.15.17:0/3320819752 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75c000ce40 con 0x7f75c815bb40 2024-09-10T23:25:03.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75c4c00640 1 -- 172.21.15.17:0/3320819752 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c00052d0 con 0x7f75c815bb40 2024-09-10T23:25:03.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c81532b0 con 0x7f75c815bb40 2024-09-10T23:25:03.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c8153870 con 0x7f75c815bb40 2024-09-10T23:25:03.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c809ae70 con 0x7f75c815bb40 2024-09-10T23:25:03.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.018+0000 7f75c4c00640 1 -- 172.21.15.17:0/3320819752 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f75c0005470 con 0x7f75c815bb40 2024-09-10T23:25:03.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.022+0000 7f75c4c00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75a4072610 0x7f75a4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.022+0000 7f75c4c00640 1 -- 172.21.15.17:0/3320819752 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 6187+0+0 (secure 0 0 0) 0x7f75c0093330 con 0x7f75c815bb40 2024-09-10T23:25:03.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.022+0000 7f75c7e00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75a4072610 0x7f75a4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.022+0000 7f75c7e00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75a4072610 0x7f75a4074ad0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f75b80af000 tx=0x7f75b801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.026+0000 7f75c4c00640 1 -- 172.21.15.17:0/3320819752 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f75c005e790 con 0x7f75c815bb40 2024-09-10T23:25:03.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.198+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f75c80d0480 con 0x7f75c815bb40 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.786+0000 7f75c4c00640 1 -- 172.21.15.17:0/3320819752 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v135) ==== 181+0+0 (secure 0 0 0) 0x7f75c005e090 con 0x7f75c815bb40 2024-09-10T23:25:03.790 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75a4072610 msgr2=0x7f75a4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75a4072610 0x7f75a4074ad0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f75b80af000 tx=0x7f75b801b120 comp rx=0 tx=0).stop 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 msgr2=0x7f75c8151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 0x7f75c8151e00 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c730 tx=0x7f75c000cbf0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 shutdown_connections 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75a4072610 0x7f75a4074ad0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75c815bb40 0x7f75c8151e00 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75c80d0980 0x7f75c814eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 --2- 172.21.15.17:0/3320819752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f75c80ccce0 0x7f75c814e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 >> 172.21.15.17:0/3320819752 conn(0x7f75c809a9f0 msgr2=0x7f75c80b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 shutdown_connections 2024-09-10T23:25:03.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.790+0000 7f75cdc00640 1 -- 172.21.15.17:0/3320819752 wait complete. 2024-09-10T23:25:03.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:25:03.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.970+0000 7fdec3600640 1 -- 172.21.15.17:0/901748813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc0b28e0 msgr2=0x7fdebc0cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.970+0000 7fdec3600640 1 --2- 172.21.15.17:0/901748813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc0b28e0 0x7fdebc0cff20 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fdebc073ff0 tx=0x7fdeb401cd80 comp rx=0 tx=0).stop 2024-09-10T23:25:03.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.970+0000 7fdec3600640 1 -- 172.21.15.17:0/901748813 shutdown_connections 2024-09-10T23:25:03.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.970+0000 7fdec3600640 1 --2- 172.21.15.17:0/901748813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc0b28e0 0x7fdebc0cff20 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.970+0000 7fdec3600640 1 --2- 172.21.15.17:0/901748813 >> v2:172.21.15.77:3300/0 conn(0x7fdebc15f600 0x7fdebc0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.970+0000 7fdec3600640 1 -- 172.21.15.17:0/901748813 >> 172.21.15.17:0/901748813 conn(0x7fdebc09b080 msgr2=0x7fdebc0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:03.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.970+0000 7fdec3600640 1 -- 172.21.15.17:0/901748813 shutdown_connections 2024-09-10T23:25:03.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.970+0000 7fdec3600640 1 -- 172.21.15.17:0/901748813 wait complete. 2024-09-10T23:25:03.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 Processor -- start 2024-09-10T23:25:03.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 -- start start 2024-09-10T23:25:03.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0b0990 0x7fdebc150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdebc0b28e0 0x7fdebc0c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc15f600 0x7fdebc15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc169750 con 0x7fdebc15f600 2024-09-10T23:25:03.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc1695d0 con 0x7fdebc0b0990 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdebc1698d0 con 0x7fdebc0b28e0 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc15f600 0x7fdebc15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc15f600 0x7fdebc15a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42774/0 (socket says 172.21.15.17:42774) 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec1600640 1 -- 172.21.15.17:0/1781983103 learned_addr learned my addr 172.21.15.17:0/1781983103 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec0c00640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0b0990 0x7fdebc150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec1600640 1 -- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdebc0b28e0 msgr2=0x7fdebc0c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdeb3e00640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdebc0b28e0 0x7fdebc0c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec1600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdebc0b28e0 0x7fdebc0c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec1600640 1 -- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0b0990 msgr2=0x7fdebc150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec1600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0b0990 0x7fdebc150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec1600640 1 -- 172.21.15.17:0/1781983103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc156a70 con 0x7fdebc15f600 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec0c00640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0b0990 0x7fdebc150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:03.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdeb3e00640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdebc0b28e0 0x7fdebc0c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec1600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc15f600 0x7fdebc15a280 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4019990 tx=0x7fdeb4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdeb9600640 1 -- 172.21.15.17:0/1781983103 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40bb070 con 0x7fdebc15f600 2024-09-10T23:25:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdeb9600640 1 -- 172.21.15.17:0/1781983103 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeb4004e00 con 0x7fdebc15f600 2024-09-10T23:25:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdebc15adf0 con 0x7fdebc15f600 2024-09-10T23:25:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdeb9600640 1 -- 172.21.15.17:0/1781983103 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40b2040 con 0x7fdebc15f600 2024-09-10T23:25:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdebc156ff0 con 0x7fdebc15f600 2024-09-10T23:25:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.974+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdebc151260 con 0x7fdebc15f600 2024-09-10T23:25:03.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.978+0000 7fdeb9600640 1 -- 172.21.15.17:0/1781983103 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdeb40b5030 con 0x7fdebc15f600 2024-09-10T23:25:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.978+0000 7fdeb9600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde980725e0 0x7fde98074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.978+0000 7fdeb9600640 1 -- 172.21.15.17:0/1781983103 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5749+0+0 (secure 0 0 0) 0x7fdeb412cf70 con 0x7fdebc15f600 2024-09-10T23:25:03.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.978+0000 7fdec0c00640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde980725e0 0x7fde98074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.978+0000 7fdec0c00640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde980725e0 0x7fde98074aa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdeac005fd0 tx=0x7fdeac005dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:03.982+0000 7fdeb9600640 1 -- 172.21.15.17:0/1781983103 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdeb4016970 con 0x7fdebc15f600 2024-09-10T23:25:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.154+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdebc15ed00 con 0x7fdebc15f600 2024-09-10T23:25:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.794+0000 7fdeb9600640 1 -- 172.21.15.17:0/1781983103 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v136) ==== 169+0+0 (secure 0 0 0) 0x7fdeb40f8580 con 0x7fdebc15f600 2024-09-10T23:25:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:25:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde980725e0 msgr2=0x7fde98074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde980725e0 0x7fde98074aa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdeac005fd0 tx=0x7fdeac005dc0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc15f600 msgr2=0x7fdebc15a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc15f600 0x7fdebc15a280 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4019990 tx=0x7fdeb4003f60 comp rx=0 tx=0).stop 2024-09-10T23:25:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 shutdown_connections 2024-09-10T23:25:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fde980725e0 0x7fde98074aa0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdebc15f600 0x7fdebc15a280 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdebc0b28e0 0x7fdebc0c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 --2- 172.21.15.17:0/1781983103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdebc0b0990 0x7fdebc150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 >> 172.21.15.17:0/1781983103 conn(0x7fdebc09b080 msgr2=0x7fdebc0707e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 shutdown_connections 2024-09-10T23:25:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.798+0000 7fdec3600640 1 -- 172.21.15.17:0/1781983103 wait complete. 2024-09-10T23:25:04.830 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:25:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 -- 172.21.15.17:0/3869588533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 msgr2=0x7ff8dc0b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 --2- 172.21.15.17:0/3869588533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 0x7ff8dc0b2a30 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009c80 tx=0x7ff8d401cd70 comp rx=0 tx=0).stop 2024-09-10T23:25:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 -- 172.21.15.17:0/3869588533 shutdown_connections 2024-09-10T23:25:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 --2- 172.21.15.17:0/3869588533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 0x7ff8dc0b2a30 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 --2- 172.21.15.17:0/3869588533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8dc155010 0x7ff8dc0726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 -- 172.21.15.17:0/3869588533 >> 172.21.15.17:0/3869588533 conn(0x7ff8dc0b1730 msgr2=0x7ff8dc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 -- 172.21.15.17:0/3869588533 shutdown_connections 2024-09-10T23:25:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 -- 172.21.15.17:0/3869588533 wait complete. 2024-09-10T23:25:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 Processor -- start 2024-09-10T23:25:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.982+0000 7ff8e4200640 1 -- start start 2024-09-10T23:25:04.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e4200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 0x7ff8dc14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:04.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e4200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc072c30 0x7ff8dc0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:04.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e4200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8dc155010 0x7ff8dc0c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e4200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc167cb0 con 0x7ff8dc0707a0 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e4200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8dc167b30 con 0x7ff8dc072c30 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e4200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff8dc167e30 con 0x7ff8dc155010 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 0x7ff8dc14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 0x7ff8dc14ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42796/0 (socket says 172.21.15.17:42796) 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e1800640 1 -- 172.21.15.17:0/4188524513 learned_addr learned my addr 172.21.15.17:0/4188524513 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e0e00640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc072c30 0x7ff8dc0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e2200640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8dc155010 0x7ff8dc0c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e1800640 1 -- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8dc155010 msgr2=0x7ff8dc0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e1800640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8dc155010 0x7ff8dc0c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e1800640 1 -- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc072c30 msgr2=0x7ff8dc0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e1800640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc072c30 0x7ff8dc0c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e1800640 1 -- 172.21.15.17:0/4188524513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8dc14bf80 con 0x7ff8dc0707a0 2024-09-10T23:25:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e0e00640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc072c30 0x7ff8dc0c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e1800640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 0x7ff8dc14ba40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d950 tx=0x7ff8d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8d9600640 1 -- 172.21.15.17:0/4188524513 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0017070 con 0x7ff8dc0707a0 2024-09-10T23:25:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8d9600640 1 -- 172.21.15.17:0/4188524513 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8d0009d20 con 0x7ff8dc0707a0 2024-09-10T23:25:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8dc1f7fa0 con 0x7ff8dc0707a0 2024-09-10T23:25:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8d9600640 1 -- 172.21.15.17:0/4188524513 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00106c0 con 0x7ff8dc0707a0 2024-09-10T23:25:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8dc0c4db0 con 0x7ff8dc0707a0 2024-09-10T23:25:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8dc0b2a30 con 0x7ff8dc0707a0 2024-09-10T23:25:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.986+0000 7ff8d9600640 1 -- 172.21.15.17:0/4188524513 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff8d0010860 con 0x7ff8dc0707a0 2024-09-10T23:25:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.990+0000 7ff8d9600640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8bc0725e0 0x7ff8bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.990+0000 7ff8d9600640 1 -- 172.21.15.17:0/4188524513 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5335+0+0 (secure 0 0 0) 0x7ff8d00934c0 con 0x7ff8dc0707a0 2024-09-10T23:25:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.990+0000 7ff8e0e00640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8bc0725e0 0x7ff8bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.990+0000 7ff8e0e00640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8bc0725e0 0x7ff8bc074aa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc14cd20 tx=0x7ff8c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:04.994+0000 7ff8d9600640 1 -- 172.21.15.17:0/4188524513 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff8d005e6b0 con 0x7ff8dc0707a0 2024-09-10T23:25:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.170+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7ff8dc0b1bb0 con 0x7ff8dc0707a0 2024-09-10T23:25:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8d9600640 1 -- 172.21.15.17:0/4188524513 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v49) ==== 71+0+0 (secure 0 0 0) 0x7ff8d00630e0 con 0x7ff8dc0707a0 2024-09-10T23:25:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8bc0725e0 msgr2=0x7ff8bc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8bc0725e0 0x7ff8bc074aa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc14cd20 tx=0x7ff8c8009040 comp rx=0 tx=0).stop 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 msgr2=0x7ff8dc14ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 0x7ff8dc14ba40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d950 tx=0x7ff8d000de10 comp rx=0 tx=0).stop 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 shutdown_connections 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff8bc0725e0 0x7ff8bc074aa0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff8dc155010 0x7ff8dc0c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8dc072c30 0x7ff8dc0c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 --2- 172.21.15.17:0/4188524513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8dc0707a0 0x7ff8dc14ba40 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 >> 172.21.15.17:0/4188524513 conn(0x7ff8dc0b1730 msgr2=0x7ff8dc1532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 shutdown_connections 2024-09-10T23:25:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.174+0000 7ff8e4200640 1 -- 172.21.15.17:0/4188524513 wait complete. 2024-09-10T23:25:05.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-10T23:25:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 -- 172.21.15.17:0/3032464349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c0d2180 msgr2=0x7faf5c06eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 --2- 172.21.15.17:0/3032464349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c0d2180 0x7faf5c06eff0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7faf50009900 tx=0x7faf5001c7c0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 -- 172.21.15.17:0/3032464349 shutdown_connections 2024-09-10T23:25:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 --2- 172.21.15.17:0/3032464349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d4a10 0x7faf5c161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 --2- 172.21.15.17:0/3032464349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c0d2180 0x7faf5c06eff0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 -- 172.21.15.17:0/3032464349 >> 172.21.15.17:0/3032464349 conn(0x7faf5c0d3f20 msgr2=0x7faf5c0d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 -- 172.21.15.17:0/3032464349 shutdown_connections 2024-09-10T23:25:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 -- 172.21.15.17:0/3032464349 wait complete. 2024-09-10T23:25:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 Processor -- start 2024-09-10T23:25:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 -- start start 2024-09-10T23:25:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2180 0x7faf5c0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c0d2560 0x7faf5c159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c0d4a10 0x7faf5c0c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c16b380 con 0x7faf5c0d4a10 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c16b200 con 0x7faf5c0d2560 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf63e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c16b500 con 0x7faf5c0d2180 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf61400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2180 0x7faf5c0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf61e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c0d4a10 0x7faf5c0c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf61400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2180 0x7faf5c0c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:41044/0 (socket says 172.21.15.17:41044) 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf61400640 1 -- 172.21.15.17:0/390540156 learned_addr learned my addr 172.21.15.17:0/390540156 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.374+0000 7faf60a00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c0d2560 0x7faf5c159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf61e00640 1 -- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2180 msgr2=0x7faf5c0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf61e00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2180 0x7faf5c0c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf61e00640 1 -- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c0d2560 msgr2=0x7faf5c159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf61e00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c0d2560 0x7faf5c159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf61e00640 1 -- 172.21.15.17:0/390540156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c158dc0 con 0x7faf5c0d4a10 2024-09-10T23:25:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf61e00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c0d4a10 0x7faf5c0c7dd0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c730 tx=0x7faf5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf59600640 1 -- 172.21.15.17:0/390540156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54003b80 con 0x7faf5c0d4a10 2024-09-10T23:25:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf59600640 1 -- 172.21.15.17:0/390540156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf54003d20 con 0x7faf5c0d4a10 2024-09-10T23:25:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c0b7130 con 0x7faf5c0d4a10 2024-09-10T23:25:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf59600640 1 -- 172.21.15.17:0/390540156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54005330 con 0x7faf5c0d4a10 2024-09-10T23:25:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c0ca510 con 0x7faf5c0d4a10 2024-09-10T23:25:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5c06eff0 con 0x7faf5c0d4a10 2024-09-10T23:25:05.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf59600640 1 -- 172.21.15.17:0/390540156 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faf5400a640 con 0x7faf5c0d4a10 2024-09-10T23:25:05.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf59600640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf3c0725e0 0x7faf3c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.378+0000 7faf59600640 1 -- 172.21.15.17:0/390540156 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5335+0+0 (secure 0 0 0) 0x7faf54092fe0 con 0x7faf5c0d4a10 2024-09-10T23:25:05.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.382+0000 7faf61400640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf3c0725e0 0x7faf3c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.382+0000 7faf61400640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf3c0725e0 0x7faf3c074aa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7faf5001a450 tx=0x7faf500a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.382+0000 7faf59600640 1 -- 172.21.15.17:0/390540156 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faf5405e120 con 0x7faf5c0d4a10 2024-09-10T23:25:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.618+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7faf5c0b5360 con 0x7faf5c0d4a10 2024-09-10T23:25:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.794+0000 7faf59600640 1 -- 172.21.15.17:0/390540156 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v441) ==== 144+0+0 (secure 0 0 0) 0x7faf54062b50 con 0x7faf5c0d4a10 2024-09-10T23:25:05.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf3c0725e0 msgr2=0x7faf3c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf3c0725e0 0x7faf3c074aa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7faf5001a450 tx=0x7faf500a7040 comp rx=0 tx=0).stop 2024-09-10T23:25:05.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c0d4a10 msgr2=0x7faf5c0c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c0d4a10 0x7faf5c0c7dd0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c730 tx=0x7faf5400cbf0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 shutdown_connections 2024-09-10T23:25:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf3c0725e0 0x7faf3c074aa0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf5c0d4a10 0x7faf5c0c7dd0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf5c0d2560 0x7faf5c159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 --2- 172.21.15.17:0/390540156 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf5c0d2180 0x7faf5c0c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 >> 172.21.15.17:0/390540156 conn(0x7faf5c0d3f20 msgr2=0x7faf5c0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 shutdown_connections 2024-09-10T23:25:05.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.798+0000 7faf63e00640 1 -- 172.21.15.17:0/390540156 wait complete. 2024-09-10T23:25:05.820 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T23:25:05.820 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T23:25:05.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:25:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.962+0000 7f784bc00640 1 -- 172.21.15.17:0/2899716113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 msgr2=0x7f784415b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.962+0000 7f784bc00640 1 --2- 172.21.15.17:0/2899716113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 0x7f784415b240 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f7830009900 tx=0x7f783001f0d0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.962+0000 7f784bc00640 1 -- 172.21.15.17:0/2899716113 shutdown_connections 2024-09-10T23:25:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.962+0000 7f784bc00640 1 --2- 172.21.15.17:0/2899716113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 0x7f784415b240 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.962+0000 7f784bc00640 1 --2- 172.21.15.17:0/2899716113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78440cf230 0x7f784406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.962+0000 7f784bc00640 1 -- 172.21.15.17:0/2899716113 >> 172.21.15.17:0/2899716113 conn(0x7f784406cfc0 msgr2=0x7f784406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.962+0000 7f784bc00640 1 -- 172.21.15.17:0/2899716113 shutdown_connections 2024-09-10T23:25:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.962+0000 7f784bc00640 1 -- 172.21.15.17:0/2899716113 wait complete. 2024-09-10T23:25:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 Processor -- start 2024-09-10T23:25:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 -- start start 2024-09-10T23:25:05.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440b32d0 0x7f78441f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78440cf230 0x7f78441f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 0x7f7844143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f78440d0330 con 0x7f78440cf610 2024-09-10T23:25:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f78440d01b0 con 0x7f78440b32d0 2024-09-10T23:25:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f78440d04b0 con 0x7f78440cf230 2024-09-10T23:25:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 0x7f7844143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7843e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78440cf230 0x7f78441f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 0x7f7844143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42838/0 (socket says 172.21.15.17:42838) 2024-09-10T23:25:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849c00640 1 -- 172.21.15.17:0/556240929 learned_addr learned my addr 172.21.15.17:0/556240929 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849200640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440b32d0 0x7f78441f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849c00640 1 -- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78440cf230 msgr2=0x7f78441f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849c00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78440cf230 0x7f78441f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849c00640 1 -- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440b32d0 msgr2=0x7f78441f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849c00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440b32d0 0x7f78441f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849c00640 1 -- 172.21.15.17:0/556240929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78441f8b50 con 0x7f78440cf610 2024-09-10T23:25:05.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7849c00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 0x7f7844143440 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c780 tx=0x7f783c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7840c00640 1 -- 172.21.15.17:0/556240929 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c004b70 con 0x7f78440cf610 2024-09-10T23:25:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7840c00640 1 -- 172.21.15.17:0/556240929 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f783c004e00 con 0x7f78440cf610 2024-09-10T23:25:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78441f4c40 con 0x7f78440cf610 2024-09-10T23:25:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f7840c00640 1 -- 172.21.15.17:0/556240929 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c00aa90 con 0x7f78440cf610 2024-09-10T23:25:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.966+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78441f5200 con 0x7f78440cf610 2024-09-10T23:25:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.970+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784406e750 con 0x7f78440cf610 2024-09-10T23:25:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.970+0000 7f7840c00640 1 -- 172.21.15.17:0/556240929 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f783c00ac30 con 0x7f78440cf610 2024-09-10T23:25:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.970+0000 7f7840c00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78240725e0 0x7f7824074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.970+0000 7f7840c00640 1 -- 172.21.15.17:0/556240929 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5335+0+0 (secure 0 0 0) 0x7f783c093250 con 0x7f78440cf610 2024-09-10T23:25:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.970+0000 7f7849200640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78240725e0 0x7f7824074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.970+0000 7f7849200640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78240725e0 0x7f7824074aa0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f783800bd00 tx=0x7f783800b490 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:05.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:05.974+0000 7f7840c00640 1 -- 172.21.15.17:0/556240929 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f783c020070 con 0x7f78440cf610 2024-09-10T23:25:06.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.158+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7844068990 con 0x7f78440cf610 2024-09-10T23:25:06.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f7840c00640 1 -- 172.21.15.17:0/556240929 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+13253 (secure 0 0 0) 0x7f78441f8b50 con 0x7f78440cf610 2024-09-10T23:25:06.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:06.164 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":136,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:25:04.791123+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/884432446":"2024-09-11T23:25:01.780647+0000","172.21.15.17:6833/884432446":"2024-09-11T23:25:01.780647+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:25:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78240725e0 msgr2=0x7f7824074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78240725e0 0x7f7824074aa0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f783800bd00 tx=0x7f783800b490 comp rx=0 tx=0).stop 2024-09-10T23:25:06.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 msgr2=0x7f7844143440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 0x7f7844143440 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c780 tx=0x7f783c00cc40 comp rx=0 tx=0).stop 2024-09-10T23:25:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 shutdown_connections 2024-09-10T23:25:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78240725e0 0x7f7824074aa0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78440cf610 0x7f7844143440 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78440cf230 0x7f78441f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 --2- 172.21.15.17:0/556240929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78440b32d0 0x7f78441f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 >> 172.21.15.17:0/556240929 conn(0x7f784406cfc0 msgr2=0x7f78441598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 shutdown_connections 2024-09-10T23:25:06.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.162+0000 7f784bc00640 1 -- 172.21.15.17:0/556240929 wait complete. 2024-09-10T23:25:06.185 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:25:06.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:25:06.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.330+0000 7f4763000640 1 -- 172.21.15.17:0/1882896475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b2540 msgr2=0x7f475c0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.330+0000 7f4763000640 1 --2- 172.21.15.17:0/1882896475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b2540 0x7f475c0cc8b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f475c073a70 tx=0x7f475401cb80 comp rx=0 tx=0).stop 2024-09-10T23:25:06.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.330+0000 7f4763000640 1 -- 172.21.15.17:0/1882896475 shutdown_connections 2024-09-10T23:25:06.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.330+0000 7f4763000640 1 --2- 172.21.15.17:0/1882896475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b2540 0x7f475c0cc8b0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.330+0000 7f4763000640 1 --2- 172.21.15.17:0/1882896475 >> v2:172.21.15.77:3300/0 conn(0x7f475c15f400 0x7f475c0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.330+0000 7f4763000640 1 -- 172.21.15.17:0/1882896475 >> 172.21.15.17:0/1882896475 conn(0x7f475c0d1da0 msgr2=0x7f475c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.330+0000 7f4763000640 1 -- 172.21.15.17:0/1882896475 shutdown_connections 2024-09-10T23:25:06.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.330+0000 7f4763000640 1 -- 172.21.15.17:0/1882896475 wait complete. 2024-09-10T23:25:06.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 Processor -- start 2024-09-10T23:25:06.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 -- start start 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f475c0b2540 0x7f475c1fb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b31b0 0x7f475c1f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f475c15f400 0x7f475c1576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f475c168c60 con 0x7f475c0b31b0 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f475c0cdc00 con 0x7f475c0b2540 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f475c168de0 con 0x7f475c15f400 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4753e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b31b0 0x7f475c1f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4753e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b31b0 0x7f475c1f7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42856/0 (socket says 172.21.15.17:42856) 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4753e00640 1 -- 172.21.15.17:0/2305952522 learned_addr learned my addr 172.21.15.17:0/2305952522 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f475be00640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f475c0b2540 0x7f475c1fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4761000640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f475c15f400 0x7f475c1576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4753e00640 1 -- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f475c15f400 msgr2=0x7f475c1576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4753e00640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f475c15f400 0x7f475c1576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4753e00640 1 -- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f475c0b2540 msgr2=0x7f475c1fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4753e00640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f475c0b2540 0x7f475c1fb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4753e00640 1 -- 172.21.15.17:0/2305952522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c1f83e0 con 0x7f475c0b31b0 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4753e00640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b31b0 0x7f475c1f7ea0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f474400c480 tx=0x7f474400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4758c00640 1 -- 172.21.15.17:0/2305952522 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744016020 con 0x7f475c0b31b0 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4758c00640 1 -- 172.21.15.17:0/2305952522 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4744012940 con 0x7f475c0b31b0 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4758c00640 1 -- 172.21.15.17:0/2305952522 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744012d90 con 0x7f475c0b31b0 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c06e5f0 con 0x7f475c0b31b0 2024-09-10T23:25:06.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.334+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c1f76a0 con 0x7f475c0b31b0 2024-09-10T23:25:06.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.338+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c1f7490 con 0x7f475c0b31b0 2024-09-10T23:25:06.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.338+0000 7f4758c00640 1 -- 172.21.15.17:0/2305952522 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f474401a3b0 con 0x7f475c0b31b0 2024-09-10T23:25:06.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.338+0000 7f4758c00640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47380725e0 0x7f4738074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.338+0000 7f4758c00640 1 -- 172.21.15.17:0/2305952522 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5335+0+0 (secure 0 0 0) 0x7f4744092fa0 con 0x7f475c0b31b0 2024-09-10T23:25:06.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.338+0000 7f475be00640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47380725e0 0x7f4738074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.338+0000 7f475be00640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47380725e0 0x7f4738074aa0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f474c009b40 tx=0x7f474c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.342+0000 7f4758c00640 1 -- 172.21.15.17:0/2305952522 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4744020030 con 0x7f475c0b31b0 2024-09-10T23:25:06.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f475c0cc8b0 con 0x7f475c0b31b0 2024-09-10T23:25:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4758c00640 1 -- 172.21.15.17:0/2305952522 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v136) ==== 93+0+10 (secure 0 0 0) 0x7f475c1f83e0 con 0x7f475c0b31b0 2024-09-10T23:25:06.521 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:25:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47380725e0 msgr2=0x7f4738074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47380725e0 0x7f4738074aa0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f474c009b40 tx=0x7f474c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b31b0 msgr2=0x7f475c1f7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b31b0 0x7f475c1f7ea0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f474400c480 tx=0x7f474400c940 comp rx=0 tx=0).stop 2024-09-10T23:25:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 shutdown_connections 2024-09-10T23:25:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47380725e0 0x7f4738074aa0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f475c15f400 0x7f475c1576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f475c0b31b0 0x7f475c1f7ea0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 --2- 172.21.15.17:0/2305952522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f475c0b2540 0x7f475c1fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 >> 172.21.15.17:0/2305952522 conn(0x7f475c0d1da0 msgr2=0x7f475c0af060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 shutdown_connections 2024-09-10T23:25:06.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.518+0000 7f4763000640 1 -- 172.21.15.17:0/2305952522 wait complete. 2024-09-10T23:25:06.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-10T23:25:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 -- 172.21.15.17:0/2778092956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540d1ed0 msgr2=0x7f8b540b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 --2- 172.21.15.17:0/2778092956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540d1ed0 0x7f8b540b10f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8b540c5560 tx=0x7f8b4c01cb80 comp rx=0 tx=0).stop 2024-09-10T23:25:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 -- 172.21.15.17:0/2778092956 shutdown_connections 2024-09-10T23:25:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 --2- 172.21.15.17:0/2778092956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540d1ed0 0x7f8b540b10f0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 --2- 172.21.15.17:0/2778092956 >> v2:172.21.15.77:3300/0 conn(0x7f8b540cfa20 0x7f8b540d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 -- 172.21.15.17:0/2778092956 >> 172.21.15.17:0/2778092956 conn(0x7f8b5409a9f0 msgr2=0x7f8b5409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 -- 172.21.15.17:0/2778092956 shutdown_connections 2024-09-10T23:25:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 -- 172.21.15.17:0/2778092956 wait complete. 2024-09-10T23:25:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 Processor -- start 2024-09-10T23:25:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.686+0000 7f8b59200640 1 -- start start 2024-09-10T23:25:06.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b59200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540cfa20 0x7f8b54159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b59200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b540d1ed0 0x7f8b54151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b59200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5415bc70 0x7f8b5415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b59200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8b541688a0 con 0x7f8b540cfa20 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b59200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8b54168720 con 0x7f8b5415bc70 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b59200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8b54168a20 con 0x7f8b540d1ed0 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540cfa20 0x7f8b54159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540cfa20 0x7f8b54159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42870/0 (socket says 172.21.15.17:42870) 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53400640 1 -- 172.21.15.17:0/1249593612 learned_addr learned my addr 172.21.15.17:0/1249593612 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b52a00640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b540d1ed0 0x7f8b54151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53e00640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5415bc70 0x7f8b5415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53400640 1 -- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b540d1ed0 msgr2=0x7f8b54151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53400640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b540d1ed0 0x7f8b54151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53400640 1 -- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5415bc70 msgr2=0x7f8b5415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53400640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5415bc70 0x7f8b5415ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53400640 1 -- 172.21.15.17:0/1249593612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b54153b70 con 0x7f8b540cfa20 2024-09-10T23:25:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b53400640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540cfa20 0x7f8b54159710 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c3c0 tx=0x7f8b4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b4b400640 1 -- 172.21.15.17:0/1249593612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011790 con 0x7f8b540cfa20 2024-09-10T23:25:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b4b400640 1 -- 172.21.15.17:0/1249593612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b44017070 con 0x7f8b540cfa20 2024-09-10T23:25:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b4b400640 1 -- 172.21.15.17:0/1249593612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011d40 con 0x7f8b540cfa20 2024-09-10T23:25:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b54151060 con 0x7f8b540cfa20 2024-09-10T23:25:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b54154bb0 con 0x7f8b540cfa20 2024-09-10T23:25:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.690+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b540d1990 con 0x7f8b540cfa20 2024-09-10T23:25:06.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.694+0000 7f8b4b400640 1 -- 172.21.15.17:0/1249593612 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8b4401c460 con 0x7f8b540cfa20 2024-09-10T23:25:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.694+0000 7f8b4b400640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b340725e0 0x7f8b34074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.694+0000 7f8b4b400640 1 -- 172.21.15.17:0/1249593612 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5335+0+0 (secure 0 0 0) 0x7f8b44092d50 con 0x7f8b540cfa20 2024-09-10T23:25:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.694+0000 7f8b52a00640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b340725e0 0x7f8b34074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:06.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.694+0000 7f8b52a00640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b340725e0 0x7f8b34074aa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8b5415f280 tx=0x7f8b4000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:06.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.698+0000 7f8b4b400640 1 -- 172.21.15.17:0/1249593612 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8b4405df40 con 0x7f8b540cfa20 2024-09-10T23:25:06.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:06.942+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f8b54151840 con 0x7f8b540cfa20 2024-09-10T23:25:07.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:25:07.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:25:07.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.802+0000 7f8b4b400640 1 -- 172.21.15.17:0/1249593612 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v443) ==== 158+0+0 (secure 0 0 0) 0x7f8b54151840 con 0x7f8b540cfa20 2024-09-10T23:25:07.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b340725e0 msgr2=0x7f8b34074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b340725e0 0x7f8b34074aa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8b5415f280 tx=0x7f8b4000b390 comp rx=0 tx=0).stop 2024-09-10T23:25:07.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540cfa20 msgr2=0x7f8b54159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540cfa20 0x7f8b54159710 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c3c0 tx=0x7f8b4400c880 comp rx=0 tx=0).stop 2024-09-10T23:25:07.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 shutdown_connections 2024-09-10T23:25:07.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8b340725e0 0x7f8b34074aa0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b5415bc70 0x7f8b5415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8b540d1ed0 0x7f8b54151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 --2- 172.21.15.17:0/1249593612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b540cfa20 0x7f8b54159710 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 >> 172.21.15.17:0/1249593612 conn(0x7f8b5409a9f0 msgr2=0x7f8b54071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:07.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 shutdown_connections 2024-09-10T23:25:07.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.806+0000 7f8b59200640 1 -- 172.21.15.17:0/1249593612 wait complete. 2024-09-10T23:25:07.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:25:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 -- 172.21.15.17:0/913387659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73340d0520 msgr2=0x7f73340b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 --2- 172.21.15.17:0/913387659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73340d0520 0x7f73340b2ac0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f732c009900 tx=0x7f732c01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 -- 172.21.15.17:0/913387659 shutdown_connections 2024-09-10T23:25:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 --2- 172.21.15.17:0/913387659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73340d0520 0x7f73340b2ac0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 --2- 172.21.15.17:0/913387659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73341602d0 0x7f73340cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 -- 172.21.15.17:0/913387659 >> 172.21.15.17:0/913387659 conn(0x7f733406cfc0 msgr2=0x7f733406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:07.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 -- 172.21.15.17:0/913387659 shutdown_connections 2024-09-10T23:25:07.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 -- 172.21.15.17:0/913387659 wait complete. 2024-09-10T23:25:07.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 Processor -- start 2024-09-10T23:25:07.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 -- start start 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73340d0520 0x7f73341421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7334152b40 0x7f73340b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73341602d0 0x7f733415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7334168c50 con 0x7f7334152b40 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7334168ad0 con 0x7f73341602d0 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7339e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7334168dd0 con 0x7f73340d0520 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f732a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7334152b40 0x7f73340b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f732a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7334152b40 0x7f73340b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34478/0 (socket says 172.21.15.17:34478) 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f732a000640 1 -- 172.21.15.17:0/1314382024 learned_addr learned my addr 172.21.15.17:0/1314382024 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7332a00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73340d0520 0x7f73341421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f7333400640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73341602d0 0x7f733415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f732a000640 1 -- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73340d0520 msgr2=0x7f73341421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f732a000640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73340d0520 0x7f73341421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f732a000640 1 -- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73341602d0 msgr2=0x7f733415a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:07.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f732a000640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73341602d0 0x7f733415a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:07.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f732a000640 1 -- 172.21.15.17:0/1314382024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7334155930 con 0x7f7334152b40 2024-09-10T23:25:07.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.982+0000 7f732a000640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7334152b40 0x7f73340b1300 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f731c00e770 tx=0x7f731c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:07.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f732be00640 1 -- 172.21.15.17:0/1314382024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c00ccc0 con 0x7f7334152b40 2024-09-10T23:25:07.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f732be00640 1 -- 172.21.15.17:0/1314382024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f731c00ee80 con 0x7f7334152b40 2024-09-10T23:25:07.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7334155bf0 con 0x7f7334152b40 2024-09-10T23:25:07.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f732be00640 1 -- 172.21.15.17:0/1314382024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c00ce60 con 0x7f7334152b40 2024-09-10T23:25:07.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7334155ed0 con 0x7f7334152b40 2024-09-10T23:25:07.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73340b2ac0 con 0x7f7334152b40 2024-09-10T23:25:07.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f732be00640 1 -- 172.21.15.17:0/1314382024 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f731c004260 con 0x7f7334152b40 2024-09-10T23:25:07.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f732be00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7310072610 0x7f7310074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:07.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f732be00640 1 -- 172.21.15.17:0/1314382024 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5335+0+0 (secure 0 0 0) 0x7f731c093950 con 0x7f7334152b40 2024-09-10T23:25:07.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.986+0000 7f7332a00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7310072610 0x7f7310074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:07.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.990+0000 7f7332a00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7310072610 0x7f7310074ad0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7324001ee0 tx=0x7f7324009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:07.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:07.990+0000 7f732be00640 1 -- 172.21.15.17:0/1314382024 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f731c05eab0 con 0x7f7334152b40 2024-09-10T23:25:08.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f73341492e0 con 0x7f7334152b40 2024-09-10T23:25:08.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f732be00640 1 -- 172.21.15.17:0/1314382024 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v49) ==== 59+0+1998 (secure 0 0 0) 0x7f731c0634e0 con 0x7f7334152b40 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:25:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:25:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:25:08.175 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:25:08.175 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:25:08.175 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7310072610 msgr2=0x7f7310074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7310072610 0x7f7310074ad0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7324001ee0 tx=0x7f7324009040 comp rx=0 tx=0).stop 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7334152b40 msgr2=0x7f73340b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7334152b40 0x7f73340b1300 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f731c00e770 tx=0x7f731c00ec30 comp rx=0 tx=0).stop 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 shutdown_connections 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7310072610 0x7f7310074ad0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73341602d0 0x7f733415a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7334152b40 0x7f73340b1300 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 --2- 172.21.15.17:0/1314382024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73340d0520 0x7f73341421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 >> 172.21.15.17:0/1314382024 conn(0x7f733406cfc0 msgr2=0x7f73340b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 shutdown_connections 2024-09-10T23:25:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.170+0000 7f7339e00640 1 -- 172.21.15.17:0/1314382024 wait complete. 2024-09-10T23:25:08.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:25:08.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 -- 172.21.15.17:0/1506534287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8cc0b14d0 msgr2=0x7fc8cc074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 --2- 172.21.15.17:0/1506534287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8cc0b14d0 0x7fc8cc074290 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0097c0 tx=0x7fc8bc01c570 comp rx=0 tx=0).stop 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 -- 172.21.15.17:0/1506534287 shutdown_connections 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 --2- 172.21.15.17:0/1506534287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8cc0b14d0 0x7fc8cc074290 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 -- 172.21.15.17:0/1506534287 >> 172.21.15.17:0/1506534287 conn(0x7fc8cc0d0360 msgr2=0x7fc8cc0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 -- 172.21.15.17:0/1506534287 shutdown_connections 2024-09-10T23:25:08.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 -- 172.21.15.17:0/1506534287 wait complete. 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 Processor -- start 2024-09-10T23:25:08.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 -- start start 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8cc069590 0x7fc8cc0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8cc0afa90 0x7fc8cc1f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0b14d0 0x7fc8cc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc0b18b0 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc06d0f0 con 0x7fc8cc069590 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8d1400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc8cc0b1a30 con 0x7fc8cc0afa90 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8cb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0b14d0 0x7fc8cc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8cb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0b14d0 0x7fc8cc0b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34490/0 (socket says 172.21.15.17:34490) 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8cb200640 1 -- 172.21.15.17:0/3802004781 learned_addr learned my addr 172.21.15.17:0/3802004781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8ca800640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8cc069590 0x7fc8cc0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.342+0000 7fc8c1e00640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8cc0afa90 0x7fc8cc1f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8cb200640 1 -- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8cc0afa90 msgr2=0x7fc8cc1f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8cb200640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8cc0afa90 0x7fc8cc1f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8cb200640 1 -- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8cc069590 msgr2=0x7fc8cc0c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8cb200640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8cc069590 0x7fc8cc0c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8cb200640 1 -- 172.21.15.17:0/3802004781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc0ca5c0 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8cb200640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0b14d0 0x7fc8cc0b1e10 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400caa0 tx=0x7fc8c400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8c3400640 1 -- 172.21.15.17:0/3802004781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4017070 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8c3400640 1 -- 172.21.15.17:0/3802004781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8c4005070 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8c3400640 1 -- 172.21.15.17:0/3802004781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4005500 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8cc09ded0 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8cc1527e0 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8cc15ea60 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8c3400640 1 -- 172.21.15.17:0/3802004781 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc8c400a610 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.346+0000 7fc8c3400640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8a80725e0 0x7fc8a8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.350+0000 7fc8c3400640 1 -- 172.21.15.17:0/3802004781 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5335+0+0 (secure 0 0 0) 0x7fc8c4092bd0 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.350+0000 7fc8ca800640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8a80725e0 0x7fc8a8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.350+0000 7fc8ca800640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8a80725e0 0x7fc8a8074aa0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0ae000 tx=0x7fc8bc01adb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:08.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.350+0000 7fc8c3400640 1 -- 172.21.15.17:0/3802004781 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc8cc09ded0 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.526+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc8cc0c39f0 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8c3400640 1 -- 172.21.15.17:0/3802004781 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v50)=0 v50) ==== 122+0+0 (secure 0 0 0) 0x7fc8c405dd40 con 0x7fc8cc0b14d0 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8a80725e0 msgr2=0x7fc8a8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8a80725e0 0x7fc8a8074aa0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0ae000 tx=0x7fc8bc01adb0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0b14d0 msgr2=0x7fc8cc0b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0b14d0 0x7fc8cc0b1e10 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fc8c400caa0 tx=0x7fc8c400cf60 comp rx=0 tx=0).stop 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 shutdown_connections 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc8a80725e0 0x7fc8a8074aa0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8cc0b14d0 0x7fc8cc0b1e10 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8cc0afa90 0x7fc8cc1f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 --2- 172.21.15.17:0/3802004781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8cc069590 0x7fc8cc0c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 >> 172.21.15.17:0/3802004781 conn(0x7fc8cc0d0360 msgr2=0x7fc8cc070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 shutdown_connections 2024-09-10T23:25:08.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.530+0000 7fc8d1400640 1 -- 172.21.15.17:0/3802004781 wait complete. 2024-09-10T23:25:08.554 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:25:08.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:25:08.662 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:25:08.741 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:25:08.742 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:25:08.742 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:25:08.750 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:25:08.751 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:25:08.751 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:25:08.759 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:25:08.759 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:25:08.759 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:25:08.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:25:08.799 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:25:08.800 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:25:08.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:25:08.815 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:25:08.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:08.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 -- 172.21.15.17:0/493535073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815f650 msgr2=0x7fb9580d16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 --2- 172.21.15.17:0/493535073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815f650 0x7fb9580d16f0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb9580b0780 tx=0x7fb94c01c770 comp rx=0 tx=0).stop 2024-09-10T23:25:08.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 -- 172.21.15.17:0/493535073 shutdown_connections 2024-09-10T23:25:08.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 --2- 172.21.15.17:0/493535073 >> v2:172.21.15.77:3300/0 conn(0x7fb95806d5d0 0x7fb95806f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 --2- 172.21.15.17:0/493535073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815f650 0x7fb9580d16f0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 -- 172.21.15.17:0/493535073 >> 172.21.15.17:0/493535073 conn(0x7fb9580d0bd0 msgr2=0x7fb9580d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:08.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 -- 172.21.15.17:0/493535073 shutdown_connections 2024-09-10T23:25:08.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 -- 172.21.15.17:0/493535073 wait complete. 2024-09-10T23:25:08.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 Processor -- start 2024-09-10T23:25:08.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.986+0000 7fb960600640 1 -- start start 2024-09-10T23:25:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb960600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb95806d5d0 0x7fb958148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb960600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb95815f650 0x7fb958147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb960600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815fa30 0x7fb95815bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb960600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb958168e30 con 0x7fb95815fa30 2024-09-10T23:25:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb960600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb958168cb0 con 0x7fb95815f650 2024-09-10T23:25:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb960600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb958168fb0 con 0x7fb95806d5d0 2024-09-10T23:25:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815fa30 0x7fb95815bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815fa30 0x7fb95815bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34494/0 (socket says 172.21.15.17:34494) 2024-09-10T23:25:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95e600640 1 -- 172.21.15.17:0/2775968409 learned_addr learned my addr 172.21.15.17:0/2775968409 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95d200640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb95815f650 0x7fb958147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95dc00640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb95806d5d0 0x7fb958148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95e600640 1 -- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb95806d5d0 msgr2=0x7fb958148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95e600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb95806d5d0 0x7fb958148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95e600640 1 -- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb95815f650 msgr2=0x7fb958147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95e600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb95815f650 0x7fb958147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95e600640 1 -- 172.21.15.17:0/2775968409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb958153c80 con 0x7fb95815fa30 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95d200640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb95815f650 0x7fb958147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95dc00640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb95806d5d0 0x7fb958148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb95e600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815fa30 0x7fb95815bc10 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb95000cb40 tx=0x7fb95000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb955600640 1 -- 172.21.15.17:0/2775968409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950016020 con 0x7fb95815fa30 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb955600640 1 -- 172.21.15.17:0/2775968409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb95000ab60 con 0x7fb95815fa30 2024-09-10T23:25:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb955600640 1 -- 172.21.15.17:0/2775968409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950012420 con 0x7fb95815fa30 2024-09-10T23:25:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb958153f60 con 0x7fb95815fa30 2024-09-10T23:25:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb958155c50 con 0x7fb95815fa30 2024-09-10T23:25:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb958155e50 con 0x7fb95815fa30 2024-09-10T23:25:08.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.990+0000 7fb955600640 1 -- 172.21.15.17:0/2775968409 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb9500125c0 con 0x7fb95815fa30 2024-09-10T23:25:08.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.994+0000 7fb955600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9380725e0 0x7fb938074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:08.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.994+0000 7fb955600640 1 -- 172.21.15.17:0/2775968409 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5335+0+0 (secure 0 0 0) 0x7fb950093650 con 0x7fb95815fa30 2024-09-10T23:25:08.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.994+0000 7fb95dc00640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9380725e0 0x7fb938074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:08.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.994+0000 7fb95dc00640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9380725e0 0x7fb938074aa0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0af000 tx=0x7fb94c01afb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:09.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:08.998+0000 7fb955600640 1 -- 172.21.15.17:0/2775968409 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb958155e50 con 0x7fb95815fa30 2024-09-10T23:25:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.202+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb958071d90 con 0x7fb95815fa30 2024-09-10T23:25:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.202+0000 7fb955600640 1 -- 172.21.15.17:0/2775968409 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) ==== 94+0+3908 (secure 0 0 0) 0x7fb950020020 con 0x7fb95815fa30 2024-09-10T23:25:09.208 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:09.208 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":97,"btime":"2024-09-10T23:25:02:783116+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6914,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/4055700220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4055700220},{"type":"v1","addr":"172.21.15.77:6836","nonce":4055700220}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2576092770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2576092770},{"type":"v1","addr":"172.21.15.77:6837","nonce":2576092770}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/547184744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":547184744},{"type":"v1","addr":"172.21.15.17:6835","nonce":547184744}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3395065105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3395065105},{"type":"v1","addr":"172.21.15.17:6834","nonce":3395065105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[]} 2024-09-10T23:25:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 97 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9380725e0 msgr2=0x7fb938074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9380725e0 0x7fb938074aa0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0af000 tx=0x7fb94c01afb0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815fa30 msgr2=0x7fb95815bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815fa30 0x7fb95815bc10 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb95000cb40 tx=0x7fb95000cc30 comp rx=0 tx=0).stop 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 shutdown_connections 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9380725e0 0x7fb938074aa0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb95815fa30 0x7fb95815bc10 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb95815f650 0x7fb958147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 --2- 172.21.15.17:0/2775968409 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb95806d5d0 0x7fb958148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 >> 172.21.15.17:0/2775968409 conn(0x7fb9580d0bd0 msgr2=0x7fb95806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 shutdown_connections 2024-09-10T23:25:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.206+0000 7fb960600640 1 -- 172.21.15.17:0/2775968409 wait complete. 2024-09-10T23:25:09.230 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:25:09.230 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:25:09.230 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:25:09.230 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:25:09.230 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:25:09.230 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:25:09.231 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:25:09.231 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:25:09.231 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:25:09.231 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:25:09.231 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:25:09.231 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:25:09.231 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:25:09.231 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:25:09.232 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:25:09.232 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:25:09.242 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:25:09.242 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:25:09.243 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:25:09.244 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:25:09.245 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:25:09.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:25:09.247 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:25:09.247 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:25:09.290 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:25:09.291 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:09.292 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:25:09.292 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:09.297 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:25:09.297 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:09.299 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:25:09.300 DEBUG:teuthology.parallel:result is None 2024-09-10T23:25:09.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:25:09.378 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:25:09.378 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:25:09.393 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:25:09.393 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:25:09.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.450+0000 7f4593c00640 1 -- 172.21.15.17:0/782033765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3f80 msgr2=0x7f458c06d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.450+0000 7f4593c00640 1 --2- 172.21.15.17:0/782033765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3f80 0x7f458c06d2d0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f4584009bc0 tx=0x7f458401cba0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.450+0000 7f4593c00640 1 -- 172.21.15.17:0/782033765 shutdown_connections 2024-09-10T23:25:09.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.450+0000 7f4593c00640 1 --2- 172.21.15.17:0/782033765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3f80 0x7f458c06d2d0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.450+0000 7f4593c00640 1 -- 172.21.15.17:0/782033765 >> 172.21.15.17:0/782033765 conn(0x7f458c0d0410 msgr2=0x7f458c0d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:09.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.450+0000 7f4593c00640 1 -- 172.21.15.17:0/782033765 shutdown_connections 2024-09-10T23:25:09.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.450+0000 7f4593c00640 1 -- 172.21.15.17:0/782033765 wait complete. 2024-09-10T23:25:09.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.450+0000 7f4593c00640 1 Processor -- start 2024-09-10T23:25:09.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.450+0000 7f4593c00640 1 -- start start 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4593c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3b30 0x7f458c1fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4593c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f458c0b3f80 0x7f458c157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4593c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f458c15a0c0 0x7f458c1439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4593c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f458c167f50 con 0x7f458c0b3b30 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4593c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f458c0d0030 con 0x7f458c15a0c0 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4593c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f458c1680d0 con 0x7f458c0b3f80 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3b30 0x7f458c1fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3b30 0x7f458c1fba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34550/0 (socket says 172.21.15.17:34550) 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591200640 1 -- 172.21.15.17:0/3561733402 learned_addr learned my addr 172.21.15.17:0/3561733402 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591c00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f458c15a0c0 0x7f458c1439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f458be00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f458c0b3f80 0x7f458c157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591200640 1 -- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f458c0b3f80 msgr2=0x7f458c157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591200640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f458c0b3f80 0x7f458c157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591200640 1 -- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f458c15a0c0 msgr2=0x7f458c1439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591200640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f458c15a0c0 0x7f458c1439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591200640 1 -- 172.21.15.17:0/3561733402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c1fbf60 con 0x7f458c0b3b30 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4591200640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3b30 0x7f458c1fba20 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f458000c400 tx=0x7f458000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4588c00640 1 -- 172.21.15.17:0/3561733402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580011790 con 0x7f458c0b3b30 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4588c00640 1 -- 172.21.15.17:0/3561733402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4580017070 con 0x7f458c0b3b30 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c155340 con 0x7f458c0b3b30 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4588c00640 1 -- 172.21.15.17:0/3561733402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580011ce0 con 0x7f458c0b3b30 2024-09-10T23:25:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c155900 con 0x7f458c0b3b30 2024-09-10T23:25:09.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.454+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f458c0b3420 con 0x7f458c0b3b30 2024-09-10T23:25:09.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.458+0000 7f4588c00640 1 -- 172.21.15.17:0/3561733402 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f458001c460 con 0x7f458c0b3b30 2024-09-10T23:25:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.458+0000 7f4588c00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f456c0725e0 0x7f456c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.458+0000 7f4588c00640 1 -- 172.21.15.17:0/3561733402 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5335+0+0 (secure 0 0 0) 0x7f4580092d50 con 0x7f458c0b3b30 2024-09-10T23:25:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.458+0000 7f458be00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f456c0725e0 0x7f456c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.458+0000 7f458be00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f456c0725e0 0x7f456c074aa0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4578000c10 tx=0x7f4578009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:09.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.462+0000 7f4588c00640 1 -- 172.21.15.17:0/3561733402 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f458c1fbf60 con 0x7f458c0b3b30 2024-09-10T23:25:09.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.646+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f458c0af4f0 con 0x7f458c0b3b30 2024-09-10T23:25:09.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.818+0000 7f4588c00640 1 -- 172.21.15.17:0/3561733402 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v138) ==== 97+0+0 (secure 0 0 0) 0x7f458005df40 con 0x7f458c0b3b30 2024-09-10T23:25:09.823 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:25:09.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f456c0725e0 msgr2=0x7f456c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f456c0725e0 0x7f456c074aa0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4578000c10 tx=0x7f4578009040 comp rx=0 tx=0).stop 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3b30 msgr2=0x7f458c1fba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3b30 0x7f458c1fba20 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f458000c400 tx=0x7f458000c8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 shutdown_connections 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f456c0725e0 0x7f456c074aa0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f458c15a0c0 0x7f458c1439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f458c0b3f80 0x7f458c157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 --2- 172.21.15.17:0/3561733402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f458c0b3b30 0x7f458c1fba20 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 >> 172.21.15.17:0/3561733402 conn(0x7f458c0d0410 msgr2=0x7f458c0ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 shutdown_connections 2024-09-10T23:25:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.822+0000 7f4593c00640 1 -- 172.21.15.17:0/3561733402 wait complete. 2024-09-10T23:25:09.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:25:09.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3482511455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 msgr2=0x7f5e780d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 --2- 172.21.15.17:0/3482511455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 0x7f5e780d02d0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5e780cfb50 tx=0x7f5e7001cd80 comp rx=0 tx=0).stop 2024-09-10T23:25:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3482511455 shutdown_connections 2024-09-10T23:25:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 --2- 172.21.15.17:0/3482511455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 0x7f5e780d02d0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 --2- 172.21.15.17:0/3482511455 >> v2:172.21.15.77:3300/0 conn(0x7f5e780cef60 0x7f5e780cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3482511455 >> 172.21.15.17:0/3482511455 conn(0x7f5e780b3870 msgr2=0x7f5e780b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3482511455 shutdown_connections 2024-09-10T23:25:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3482511455 wait complete. 2024-09-10T23:25:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 Processor -- start 2024-09-10T23:25:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 -- start start 2024-09-10T23:25:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.990+0000 7f5e7fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e780b4390 0x7f5e781fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e780cef60 0x7f5e781fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 0x7f5e780b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5e78169530 con 0x7f5e780cf340 2024-09-10T23:25:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5e781693b0 con 0x7f5e780cef60 2024-09-10T23:25:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5e781696b0 con 0x7f5e780b4390 2024-09-10T23:25:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 0x7f5e780b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 0x7f5e780b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34564/0 (socket says 172.21.15.17:34564) 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7de00640 1 -- 172.21.15.17:0/3584341616 learned_addr learned my addr 172.21.15.17:0/3584341616 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7d400640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e780b4390 0x7f5e781fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7ca00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e780cef60 0x7f5e781fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7de00640 1 -- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e780b4390 msgr2=0x7f5e781fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7de00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e780b4390 0x7f5e781fb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7de00640 1 -- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e780cef60 msgr2=0x7f5e781fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7de00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e780cef60 0x7f5e781fbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7de00640 1 -- 172.21.15.17:0/3584341616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e781f9390 con 0x7f5e780cf340 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7ca00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e780cef60 0x7f5e781fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7de00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 0x7f5e780b7110 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009bd0 tx=0x7f5e70005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e75600640 1 -- 172.21.15.17:0/3584341616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700bb070 con 0x7f5e780cf340 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e75600640 1 -- 172.21.15.17:0/3584341616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e70004d40 con 0x7f5e780cf340 2024-09-10T23:25:09.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e75600640 1 -- 172.21.15.17:0/3584341616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e700b2040 con 0x7f5e780cf340 2024-09-10T23:25:09.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e780c9740 con 0x7f5e780cf340 2024-09-10T23:25:09.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e780cb100 con 0x7f5e780cf340 2024-09-10T23:25:09.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e7815fb90 con 0x7f5e780cf340 2024-09-10T23:25:09.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.994+0000 7f5e75600640 1 -- 172.21.15.17:0/3584341616 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5e700b5030 con 0x7f5e780cf340 2024-09-10T23:25:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.998+0000 7f5e75600640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e580725e0 0x7f5e58074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.998+0000 7f5e75600640 1 -- 172.21.15.17:0/3584341616 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5249+0+0 (secure 0 0 0) 0x7f5e7012cae0 con 0x7f5e780cf340 2024-09-10T23:25:10.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.998+0000 7f5e7d400640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e580725e0 0x7f5e58074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:09.998+0000 7f5e7d400640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e580725e0 0x7f5e58074aa0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c005d90 tx=0x7f5e6c00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:10.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.002+0000 7f5e75600640 1 -- 172.21.15.17:0/3584341616 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5e70016970 con 0x7f5e780cf340 2024-09-10T23:25:10.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5e780b1030 con 0x7f5e780cf340 2024-09-10T23:25:10.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e75600640 1 -- 172.21.15.17:0/3584341616 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f5e700f7d20 con 0x7f5e780cf340 2024-09-10T23:25:10.240 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:10.240 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:25:10.240 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.241 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:25:10.242 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:25:10.244 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:25:10.245 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:25:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.248 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:25:10.249 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:25:10.249 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.249 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:25:10.249 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:25:10.249 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.249 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:25:10.250 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.251 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.252 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:25:10.254 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:25:10.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e580725e0 msgr2=0x7f5e58074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e580725e0 0x7f5e58074aa0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c005d90 tx=0x7f5e6c00b390 comp rx=0 tx=0).stop 2024-09-10T23:25:10.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 msgr2=0x7f5e780b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 0x7f5e780b7110 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009bd0 tx=0x7f5e70005ae0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 shutdown_connections 2024-09-10T23:25:10.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e580725e0 0x7f5e58074aa0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e780cf340 0x7f5e780b7110 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e780cef60 0x7f5e781fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 --2- 172.21.15.17:0/3584341616 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e780b4390 0x7f5e781fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 >> 172.21.15.17:0/3584341616 conn(0x7f5e780b3870 msgr2=0x7f5e78165950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:10.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 shutdown_connections 2024-09-10T23:25:10.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.238+0000 7f5e7fe00640 1 -- 172.21.15.17:0/3584341616 wait complete. 2024-09-10T23:25:10.262 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:25:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.406+0000 7f85dd400640 1 -- 172.21.15.17:0/1917197934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8070ad0 msgr2=0x7f85d815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.406+0000 7f85dd400640 1 --2- 172.21.15.17:0/1917197934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8070ad0 0x7f85d815f060 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f85d80c5320 tx=0x7f85c801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.406+0000 7f85dd400640 1 -- 172.21.15.17:0/1917197934 shutdown_connections 2024-09-10T23:25:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.406+0000 7f85dd400640 1 --2- 172.21.15.17:0/1917197934 >> v2:172.21.15.77:3300/0 conn(0x7f85d80d1830 0x7f85d815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.406+0000 7f85dd400640 1 --2- 172.21.15.17:0/1917197934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d8070ad0 0x7f85d815f060 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.406+0000 7f85dd400640 1 -- 172.21.15.17:0/1917197934 >> 172.21.15.17:0/1917197934 conn(0x7f85d80d1d60 msgr2=0x7f85d80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.406+0000 7f85dd400640 1 -- 172.21.15.17:0/1917197934 shutdown_connections 2024-09-10T23:25:10.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.406+0000 7f85dd400640 1 -- 172.21.15.17:0/1917197934 wait complete. 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 Processor -- start 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 -- start start 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d8070ad0 0x7f85d815e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80cf320 0x7f85d81562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d80d1830 0x7f85d80c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f85d81693d0 con 0x7f85d80cf320 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f85d8169250 con 0x7f85d8070ad0 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f85d8169550 con 0x7f85d80d1830 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80cf320 0x7f85d81562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80cf320 0x7f85d81562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34582/0 (socket says 172.21.15.17:34582) 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cfe00640 1 -- 172.21.15.17:0/735480495 learned_addr learned my addr 172.21.15.17:0/735480495 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85d7200640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d80d1830 0x7f85d80c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85d6800640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d8070ad0 0x7f85d815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cfe00640 1 -- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d80d1830 msgr2=0x7f85d80c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cfe00640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d80d1830 0x7f85d80c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cfe00640 1 -- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d8070ad0 msgr2=0x7f85d815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cfe00640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d8070ad0 0x7f85d815e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cfe00640 1 -- 172.21.15.17:0/735480495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d8156d10 con 0x7f85d80cf320 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cfe00640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80cf320 0x7f85d81562c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c9f0 tx=0x7f85c000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cea00640 1 -- 172.21.15.17:0/735480495 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0007bb0 con 0x7f85d80cf320 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cea00640 1 -- 172.21.15.17:0/735480495 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85c0007e40 con 0x7f85d80cf320 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85cea00640 1 -- 172.21.15.17:0/735480495 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c000f690 con 0x7f85d80cf320 2024-09-10T23:25:10.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d80b1960 con 0x7f85d80cf320 2024-09-10T23:25:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.410+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d80b1f20 con 0x7f85d80cf320 2024-09-10T23:25:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.414+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d80cfc60 con 0x7f85d80cf320 2024-09-10T23:25:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.414+0000 7f85cea00640 1 -- 172.21.15.17:0/735480495 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f85c000f830 con 0x7f85d80cf320 2024-09-10T23:25:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.414+0000 7f85cea00640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85b4072610 0x7f85b4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.414+0000 7f85cea00640 1 -- 172.21.15.17:0/735480495 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5249+0+0 (secure 0 0 0) 0x7f85c00936d0 con 0x7f85d80cf320 2024-09-10T23:25:10.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.414+0000 7f85d6800640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85b4072610 0x7f85b4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.414+0000 7f85d6800640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85b4072610 0x7f85b4074ad0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f85c80af000 tx=0x7f85c801b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:10.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.418+0000 7f85cea00640 1 -- 172.21.15.17:0/735480495 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f85c0014030 con 0x7f85d80cf320 2024-09-10T23:25:10.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.594+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f85d81591c0 con 0x7f85d80cf320 2024-09-10T23:25:10.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85cea00640 1 -- 172.21.15.17:0/735480495 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v140) ==== 84+0+65 (secure 0 0 0) 0x7f85c005e910 con 0x7f85d80cf320 2024-09-10T23:25:10.600 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:25:10.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:25:10.600 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:25:10.600 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:25:10.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:25:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85b4072610 msgr2=0x7f85b4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85b4072610 0x7f85b4074ad0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f85c80af000 tx=0x7f85c801b100 comp rx=0 tx=0).stop 2024-09-10T23:25:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80cf320 msgr2=0x7f85d81562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80cf320 0x7f85d81562c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c9f0 tx=0x7f85c000ceb0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 shutdown_connections 2024-09-10T23:25:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85b4072610 0x7f85b4074ad0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85d80d1830 0x7f85d80c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80cf320 0x7f85d81562c0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 --2- 172.21.15.17:0/735480495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85d8070ad0 0x7f85d815e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 >> 172.21.15.17:0/735480495 conn(0x7f85d80d1d60 msgr2=0x7f85d80d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 shutdown_connections 2024-09-10T23:25:10.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.598+0000 7f85dd400640 1 -- 172.21.15.17:0/735480495 wait complete. 2024-09-10T23:25:10.621 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:25:10.622 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:25:10.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.770+0000 7ffa62000640 1 -- 172.21.15.17:0/3968798145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c072b40 msgr2=0x7ffa5c073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.770+0000 7ffa62000640 1 --2- 172.21.15.17:0/3968798145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c072b40 0x7ffa5c073710 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009840 tx=0x7ffa4401c800 comp rx=0 tx=0).stop 2024-09-10T23:25:10.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.770+0000 7ffa62000640 1 -- 172.21.15.17:0/3968798145 shutdown_connections 2024-09-10T23:25:10.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.770+0000 7ffa62000640 1 --2- 172.21.15.17:0/3968798145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c072b40 0x7ffa5c073710 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.770+0000 7ffa62000640 1 -- 172.21.15.17:0/3968798145 >> 172.21.15.17:0/3968798145 conn(0x7ffa5c0b17a0 msgr2=0x7ffa5c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:10.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 -- 172.21.15.17:0/3968798145 shutdown_connections 2024-09-10T23:25:10.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 -- 172.21.15.17:0/3968798145 wait complete. 2024-09-10T23:25:10.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 Processor -- start 2024-09-10T23:25:10.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 -- start start 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c072b40 0x7ffa5c15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa5c0b3940 0x7ffa5c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa5c15ab30 0x7ffa5c0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c168c50 con 0x7ffa5c0b3940 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5c168ad0 con 0x7ffa5c072b40 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa62000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5c168dd0 con 0x7ffa5c15ab30 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa5c0b3940 0x7ffa5c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa5c0b3940 0x7ffa5c14ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34592/0 (socket says 172.21.15.17:34592) 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa53e00640 1 -- 172.21.15.17:0/3224018684 learned_addr learned my addr 172.21.15.17:0/3224018684 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa5b400640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c072b40 0x7ffa5c15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa5be00640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa5c15ab30 0x7ffa5c0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa53e00640 1 -- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa5c15ab30 msgr2=0x7ffa5c0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa53e00640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa5c15ab30 0x7ffa5c0aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa53e00640 1 -- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c072b40 msgr2=0x7ffa5c15baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:10.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa53e00640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c072b40 0x7ffa5c15baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:10.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa53e00640 1 -- 172.21.15.17:0/3224018684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5c15d550 con 0x7ffa5c0b3940 2024-09-10T23:25:10.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa5b400640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c072b40 0x7ffa5c15baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:10.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.774+0000 7ffa53e00640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa5c0b3940 0x7ffa5c14ec10 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ffa4401a430 tx=0x7ffa440a56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:10.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa53400640 1 -- 172.21.15.17:0/3224018684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa440b2040 con 0x7ffa5c0b3940 2024-09-10T23:25:10.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa53400640 1 -- 172.21.15.17:0/3224018684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa44004430 con 0x7ffa5c0b3940 2024-09-10T23:25:10.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa53400640 1 -- 172.21.15.17:0/3224018684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44005280 con 0x7ffa5c0b3940 2024-09-10T23:25:10.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5c15d7f0 con 0x7ffa5c0b3940 2024-09-10T23:25:10.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa5c14e410 con 0x7ffa5c0b3940 2024-09-10T23:25:10.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa5c0b3df0 con 0x7ffa5c0b3940 2024-09-10T23:25:10.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa53400640 1 -- 172.21.15.17:0/3224018684 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffa440b5070 con 0x7ffa5c0b3940 2024-09-10T23:25:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa53400640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa380725e0 0x7ffa38074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa53400640 1 -- 172.21.15.17:0/3224018684 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5249+0+0 (secure 0 0 0) 0x7ffa4412c6b0 con 0x7ffa5c0b3940 2024-09-10T23:25:10.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.778+0000 7ffa5b400640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa380725e0 0x7ffa38074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:10.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.782+0000 7ffa5b400640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa380725e0 0x7ffa38074aa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c000f70 tx=0x7ffa4c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:10.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.782+0000 7ffa53400640 1 -- 172.21.15.17:0/3224018684 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ffa440163f0 con 0x7ffa5c0b3940 2024-09-10T23:25:10.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:10.958+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ffa5c150a40 con 0x7ffa5c0b3940 2024-09-10T23:25:11.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.830+0000 7ffa53400640 1 -- 172.21.15.17:0/3224018684 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v141) ==== 138+0+0 (secure 0 0 0) 0x7ffa440f7eb0 con 0x7ffa5c0b3940 2024-09-10T23:25:11.835 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:25:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa380725e0 msgr2=0x7ffa38074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa380725e0 0x7ffa38074aa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c000f70 tx=0x7ffa4c009040 comp rx=0 tx=0).stop 2024-09-10T23:25:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa5c0b3940 msgr2=0x7ffa5c14ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa5c0b3940 0x7ffa5c14ec10 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ffa4401a430 tx=0x7ffa440a56e0 comp rx=0 tx=0).stop 2024-09-10T23:25:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 shutdown_connections 2024-09-10T23:25:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffa380725e0 0x7ffa38074aa0 secure :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c000f70 tx=0x7ffa4c009040 comp rx=0 tx=0).stop 2024-09-10T23:25:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa5c15ab30 0x7ffa5c0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa5c0b3940 0x7ffa5c14ec10 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:11.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 --2- 172.21.15.17:0/3224018684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa5c072b40 0x7ffa5c15baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:11.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.834+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 >> 172.21.15.17:0/3224018684 conn(0x7ffa5c0b17a0 msgr2=0x7ffa5c0cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:11.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.838+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 shutdown_connections 2024-09-10T23:25:11.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:11.838+0000 7ffa62000640 1 -- 172.21.15.17:0/3224018684 wait complete. 2024-09-10T23:25:11.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:25:12.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 -- 172.21.15.17:0/2359334842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b440ad860 msgr2=0x7f2b440aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 --2- 172.21.15.17:0/2359334842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b440ad860 0x7f2b440aeec0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f2b44074320 tx=0x7f2b3001c890 comp rx=0 tx=0).stop 2024-09-10T23:25:12.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 -- 172.21.15.17:0/2359334842 shutdown_connections 2024-09-10T23:25:12.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 --2- 172.21.15.17:0/2359334842 >> v2:172.21.15.77:3300/0 conn(0x7f2b440af400 0x7f2b4406ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 --2- 172.21.15.17:0/2359334842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b440ad860 0x7f2b440aeec0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 --2- 172.21.15.17:0/2359334842 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b44158430 0x7f2b4415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 -- 172.21.15.17:0/2359334842 >> 172.21.15.17:0/2359334842 conn(0x7f2b440b1d50 msgr2=0x7f2b440b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 -- 172.21.15.17:0/2359334842 shutdown_connections 2024-09-10T23:25:12.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 -- 172.21.15.17:0/2359334842 wait complete. 2024-09-10T23:25:12.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.022+0000 7f2b4c200640 1 Processor -- start 2024-09-10T23:25:12.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 -- start start 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b440ad860 0x7f2b44157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44158430 0x7f2b441579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b4415c6c0 0x7f2b4415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440739a0 con 0x7f2b44158430 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44073820 con 0x7f2b440ad860 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2b44073b20 con 0x7f2b4415c6c0 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b48e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44158430 0x7f2b441579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b48e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44158430 0x7f2b441579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34616/0 (socket says 172.21.15.17:34616) 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b48e00640 1 -- 172.21.15.17:0/4126917864 learned_addr learned my addr 172.21.15.17:0/4126917864 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b49800640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b440ad860 0x7f2b44157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4a200640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b4415c6c0 0x7f2b4415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b48e00640 1 -- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b4415c6c0 msgr2=0x7f2b4415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b48e00640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b4415c6c0 0x7f2b4415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b48e00640 1 -- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b440ad860 msgr2=0x7f2b44157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b48e00640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b440ad860 0x7f2b44157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b48e00640 1 -- 172.21.15.17:0/4126917864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b441418d0 con 0x7f2b44158430 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4a200640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b4415c6c0 0x7f2b4415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b48e00640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44158430 0x7f2b441579b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f2b300b0040 tx=0x7f2b300a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b41600640 1 -- 172.21.15.17:0/4126917864 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b300b2040 con 0x7f2b44158430 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b41600640 1 -- 172.21.15.17:0/4126917864 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b30005030 con 0x7f2b44158430 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b41600640 1 -- 172.21.15.17:0/4126917864 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30005480 con 0x7f2b44158430 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b44141bb0 con 0x7f2b44158430 2024-09-10T23:25:12.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b44142170 con 0x7f2b44158430 2024-09-10T23:25:12.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.026+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b44074040 con 0x7f2b44158430 2024-09-10T23:25:12.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.030+0000 7f2b41600640 1 -- 172.21.15.17:0/4126917864 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2b300046d0 con 0x7f2b44158430 2024-09-10T23:25:12.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.030+0000 7f2b41600640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b240725e0 0x7f2b24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:12.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.030+0000 7f2b41600640 1 -- 172.21.15.17:0/4126917864 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5619+0+0 (secure 0 0 0) 0x7f2b3012d260 con 0x7f2b44158430 2024-09-10T23:25:12.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.030+0000 7f2b49800640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b240725e0 0x7f2b24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:12.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.030+0000 7f2b49800640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b240725e0 0x7f2b24074aa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800bb50 tx=0x7f2b3800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:12.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.034+0000 7f2b41600640 1 -- 172.21.15.17:0/4126917864 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2b300164b0 con 0x7f2b44158430 2024-09-10T23:25:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.210+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2b440aeed0 con 0x7f2b44158430 2024-09-10T23:25:12.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.838+0000 7f2b41600640 1 -- 172.21.15.17:0/4126917864 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v142) ==== 170+0+0 (secure 0 0 0) 0x7f2b300f8980 con 0x7f2b44158430 2024-09-10T23:25:12.842 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:25:12.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b240725e0 msgr2=0x7f2b24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b240725e0 0x7f2b24074aa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800bb50 tx=0x7f2b3800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44158430 msgr2=0x7f2b441579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:12.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44158430 0x7f2b441579b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f2b300b0040 tx=0x7f2b300a5730 comp rx=0 tx=0).stop 2024-09-10T23:25:12.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 shutdown_connections 2024-09-10T23:25:12.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2b240725e0 0x7f2b24074aa0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b4415c6c0 0x7f2b4415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44158430 0x7f2b441579b0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 --2- 172.21.15.17:0/4126917864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b440ad860 0x7f2b44157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:12.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 >> 172.21.15.17:0/4126917864 conn(0x7f2b440b1d50 msgr2=0x7f2b440b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:12.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 shutdown_connections 2024-09-10T23:25:12.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:12.842+0000 7f2b4c200640 1 -- 172.21.15.17:0/4126917864 wait complete. 2024-09-10T23:25:12.886 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:25:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 -- 172.21.15.17:0/1111975645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 msgr2=0x7f1c680b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 --2- 172.21.15.17:0/1111975645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 0x7f1c680b29d0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009840 tx=0x7f1c5001c820 comp rx=0 tx=0).stop 2024-09-10T23:25:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 -- 172.21.15.17:0/1111975645 shutdown_connections 2024-09-10T23:25:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 --2- 172.21.15.17:0/1111975645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 0x7f1c680b29d0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 -- 172.21.15.17:0/1111975645 >> 172.21.15.17:0/1111975645 conn(0x7f1c6809a9f0 msgr2=0x7f1c6809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 -- 172.21.15.17:0/1111975645 shutdown_connections 2024-09-10T23:25:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 -- 172.21.15.17:0/1111975645 wait complete. 2024-09-10T23:25:13.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 Processor -- start 2024-09-10T23:25:13.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 -- start start 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c680b2f10 0x7f1c681f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c6815b8c0 0x7f1c6814d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 0x7f1c681fb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1c68169a60 con 0x7f1c6815bca0 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1c681698e0 con 0x7f1c680b2f10 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c6ce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1c68169be0 con 0x7f1c6815b8c0 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c67e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 0x7f1c681fb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c67e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 0x7f1c681fb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34644/0 (socket says 172.21.15.17:34644) 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.038+0000 7f1c67e00640 1 -- 172.21.15.17:0/4289649444 learned_addr learned my addr 172.21.15.17:0/4289649444 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c5fe00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c6815b8c0 0x7f1c6814d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c67400640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c680b2f10 0x7f1c681f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c67e00640 1 -- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c6815b8c0 msgr2=0x7f1c6814d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c67e00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c6815b8c0 0x7f1c6814d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c67e00640 1 -- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c680b2f10 msgr2=0x7f1c681f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c67e00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c680b2f10 0x7f1c681f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c67e00640 1 -- 172.21.15.17:0/4289649444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6814dc70 con 0x7f1c6815bca0 2024-09-10T23:25:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c67e00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 0x7f1c681fb290 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000cbc0 tx=0x7f1c6000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c5f400640 1 -- 172.21.15.17:0/4289649444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60016020 con 0x7f1c6815bca0 2024-09-10T23:25:13.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c5f400640 1 -- 172.21.15.17:0/4289649444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c6000ab00 con 0x7f1c6815bca0 2024-09-10T23:25:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c5f400640 1 -- 172.21.15.17:0/4289649444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60012420 con 0x7f1c6815bca0 2024-09-10T23:25:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c681f72e0 con 0x7f1c6815bca0 2024-09-10T23:25:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c681576e0 con 0x7f1c6815bca0 2024-09-10T23:25:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c680b29d0 con 0x7f1c6815bca0 2024-09-10T23:25:13.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.042+0000 7f1c5f400640 1 -- 172.21.15.17:0/4289649444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1c60004a50 con 0x7f1c6815bca0 2024-09-10T23:25:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.046+0000 7f1c5f400640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c44072610 0x7f1c44074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.046+0000 7f1c5f400640 1 -- 172.21.15.17:0/4289649444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 6001+0+0 (secure 0 0 0) 0x7f1c60093d20 con 0x7f1c6815bca0 2024-09-10T23:25:13.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.046+0000 7f1c67400640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c44072610 0x7f1c44074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:13.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.046+0000 7f1c67400640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c44072610 0x7f1c44074ad0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1c58000c10 tx=0x7f1c58009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:13.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.050+0000 7f1c5f400640 1 -- 172.21.15.17:0/4289649444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1c60020020 con 0x7f1c6815bca0 2024-09-10T23:25:13.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.254+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1c680b4530 con 0x7f1c6815bca0 2024-09-10T23:25:13.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.842+0000 7f1c5f400640 1 -- 172.21.15.17:0/4289649444 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v100) ==== 174+0+0 (secure 0 0 0) 0x7f1c6005ecf0 con 0x7f1c6815bca0 2024-09-10T23:25:13.845 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 19 and data pool 20 2024-09-10T23:25:13.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c44072610 msgr2=0x7f1c44074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:13.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c44072610 0x7f1c44074ad0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1c58000c10 tx=0x7f1c58009040 comp rx=0 tx=0).stop 2024-09-10T23:25:13.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 msgr2=0x7f1c681fb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:13.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 0x7f1c681fb290 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000cbc0 tx=0x7f1c6000ccb0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 shutdown_connections 2024-09-10T23:25:13.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1c44072610 0x7f1c44074ad0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c6815bca0 0x7f1c681fb290 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1c6815b8c0 0x7f1c6814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 --2- 172.21.15.17:0/4289649444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c680b2f10 0x7f1c681f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:13.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 >> 172.21.15.17:0/4289649444 conn(0x7f1c6809a9f0 msgr2=0x7f1c680afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:13.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 shutdown_connections 2024-09-10T23:25:13.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:13.846+0000 7f1c6ce00640 1 -- 172.21.15.17:0/4289649444 wait complete. 2024-09-10T23:25:13.901 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:25:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.046+0000 7f58c0400640 1 -- 172.21.15.17:0/1437039931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b815f730 msgr2=0x7f58b80b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.046+0000 7f58c0400640 1 --2- 172.21.15.17:0/1437039931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b815f730 0x7f58b80b3130 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009840 tx=0x7f58a401c790 comp rx=0 tx=0).stop 2024-09-10T23:25:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 -- 172.21.15.17:0/1437039931 shutdown_connections 2024-09-10T23:25:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 --2- 172.21.15.17:0/1437039931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b815f730 0x7f58b80b3130 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 -- 172.21.15.17:0/1437039931 >> 172.21.15.17:0/1437039931 conn(0x7f58b80d1d10 msgr2=0x7f58b80d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 -- 172.21.15.17:0/1437039931 shutdown_connections 2024-09-10T23:25:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 -- 172.21.15.17:0/1437039931 wait complete. 2024-09-10T23:25:14.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 Processor -- start 2024-09-10T23:25:14.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 -- start start 2024-09-10T23:25:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b80cee30 0x7f58b81673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b815f350 0x7f58b80af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58b815f730 0x7f58b80afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58b8169fc0 con 0x7f58b80cee30 2024-09-10T23:25:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58b8169e40 con 0x7f58b815f350 2024-09-10T23:25:14.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58c0400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f58b816a140 con 0x7f58b815f730 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bda00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b80cee30 0x7f58b81673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bda00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b80cee30 0x7f58b81673e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34658/0 (socket says 172.21.15.17:34658) 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bda00640 1 -- 172.21.15.17:0/1629349045 learned_addr learned my addr 172.21.15.17:0/1629349045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bd000640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b815f350 0x7f58b80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58be400640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58b815f730 0x7f58b80afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bda00640 1 -- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58b815f730 msgr2=0x7f58b80afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bda00640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58b815f730 0x7f58b80afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bda00640 1 -- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b815f350 msgr2=0x7f58b80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bda00640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b815f350 0x7f58b80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bda00640 1 -- 172.21.15.17:0/1629349045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b81f8010 con 0x7f58b80cee30 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58be400640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58b815f730 0x7f58b80afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58bda00640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b80cee30 0x7f58b81673e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c500 tx=0x7f58ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.050+0000 7f58b5600640 1 -- 172.21.15.17:0/1629349045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac017070 con 0x7f58b80cee30 2024-09-10T23:25:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.054+0000 7f58b5600640 1 -- 172.21.15.17:0/1629349045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58ac0053c0 con 0x7f58b80cee30 2024-09-10T23:25:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.054+0000 7f58b5600640 1 -- 172.21.15.17:0/1629349045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac012890 con 0x7f58b80cee30 2024-09-10T23:25:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.054+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b81f82f0 con 0x7f58b80cee30 2024-09-10T23:25:14.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.054+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b81f88b0 con 0x7f58b80cee30 2024-09-10T23:25:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.054+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b80b3130 con 0x7f58b80cee30 2024-09-10T23:25:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.054+0000 7f58b5600640 1 -- 172.21.15.17:0/1629349045 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f58ac003600 con 0x7f58b80cee30 2024-09-10T23:25:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.054+0000 7f58b5600640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5898072610 0x7f5898074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.054+0000 7f58b5600640 1 -- 172.21.15.17:0/1629349045 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f58ac092950 con 0x7f58b80cee30 2024-09-10T23:25:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.054+0000 7f58bd000640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5898072610 0x7f5898074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.058+0000 7f58bd000640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5898072610 0x7f5898074ad0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f58a40af000 tx=0x7f58a401afd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.058+0000 7f58b5600640 1 -- 172.21.15.17:0/1629349045 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f58ac05d7c0 con 0x7f58b80cee30 2024-09-10T23:25:14.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58b80cc1d0 con 0x7f58b80cee30 2024-09-10T23:25:14.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58b5600640 1 -- 172.21.15.17:0/1629349045 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16913 (secure 0 0 0) 0x7f58ac0621f0 con 0x7f58b80cee30 2024-09-10T23:25:14.241 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:14.241 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":143,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:25:13.261013+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:25:10.976327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-10T23:25:12.226641+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:25:14.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5898072610 msgr2=0x7f5898074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5898072610 0x7f5898074ad0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f58a40af000 tx=0x7f58a401afd0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b80cee30 msgr2=0x7f58b81673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b80cee30 0x7f58b81673e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00c500 tx=0x7f58ac00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 shutdown_connections 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5898072610 0x7f5898074ad0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58b815f730 0x7f58b80afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58b815f350 0x7f58b80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 --2- 172.21.15.17:0/1629349045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b80cee30 0x7f58b81673e0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 >> 172.21.15.17:0/1629349045 conn(0x7f58b80d1d10 msgr2=0x7f58b8157440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 shutdown_connections 2024-09-10T23:25:14.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.238+0000 7f58c0400640 1 -- 172.21.15.17:0/1629349045 wait complete. 2024-09-10T23:25:14.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:25:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 -- 172.21.15.17:0/3288545591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99880d2830 msgr2=0x7f99880b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 --2- 172.21.15.17:0/3288545591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99880d2830 0x7f99880b1610 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f9970009900 tx=0x7f997001f090 comp rx=0 tx=0).stop 2024-09-10T23:25:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 -- 172.21.15.17:0/3288545591 shutdown_connections 2024-09-10T23:25:14.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 --2- 172.21.15.17:0/3288545591 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99880d0200 0x7f99880b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 --2- 172.21.15.17:0/3288545591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99880d2830 0x7f99880b1610 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 -- 172.21.15.17:0/3288545591 >> 172.21.15.17:0/3288545591 conn(0x7f99880d1d10 msgr2=0x7f99880d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 -- 172.21.15.17:0/3288545591 shutdown_connections 2024-09-10T23:25:14.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 -- 172.21.15.17:0/3288545591 wait complete. 2024-09-10T23:25:14.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 Processor -- start 2024-09-10T23:25:14.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.406+0000 7f998e600640 1 -- start start 2024-09-10T23:25:14.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f998e600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99880d0200 0x7f99881f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f998e600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99880d2830 0x7f99881eeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f998e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988160280 0x7f99880c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f998e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99880b2090 con 0x7f9988160280 2024-09-10T23:25:14.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f998e600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f99880b07c0 con 0x7f99880d2830 2024-09-10T23:25:14.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f998e600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f99880b2210 con 0x7f99880d0200 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988160280 0x7f99880c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988160280 0x7f99880c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34678/0 (socket says 172.21.15.17:34678) 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987e00640 1 -- 172.21.15.17:0/3904532601 learned_addr learned my addr 172.21.15.17:0/3904532601 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987400640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99880d0200 0x7f99881f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f997fe00640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99880d2830 0x7f99881eeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987e00640 1 -- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99880d0200 msgr2=0x7f99881f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987e00640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99880d0200 0x7f99881f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987e00640 1 -- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99880d2830 msgr2=0x7f99881eeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987e00640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99880d2830 0x7f99881eeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987e00640 1 -- 172.21.15.17:0/3904532601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9988072090 con 0x7f9988160280 2024-09-10T23:25:14.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f9987e00640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988160280 0x7f99880c8de0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f998000b9e0 tx=0x7f998000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f997f400640 1 -- 172.21.15.17:0/3904532601 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980019070 con 0x7f9988160280 2024-09-10T23:25:14.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f997f400640 1 -- 172.21.15.17:0/3904532601 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f998000cc30 con 0x7f9988160280 2024-09-10T23:25:14.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f997f400640 1 -- 172.21.15.17:0/3904532601 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99800146a0 con 0x7f9988160280 2024-09-10T23:25:14.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99880c5550 con 0x7f9988160280 2024-09-10T23:25:14.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99880ccd30 con 0x7f9988160280 2024-09-10T23:25:14.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99880b2740 con 0x7f9988160280 2024-09-10T23:25:14.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.410+0000 7f997f400640 1 -- 172.21.15.17:0/3904532601 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f998001d3b0 con 0x7f9988160280 2024-09-10T23:25:14.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.414+0000 7f997f400640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99640725e0 0x7f9964074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.414+0000 7f997f400640 1 -- 172.21.15.17:0/3904532601 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7f9980093340 con 0x7f9988160280 2024-09-10T23:25:14.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.414+0000 7f9987400640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99640725e0 0x7f9964074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.414+0000 7f9987400640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99640725e0 0x7f9964074aa0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f99880c8d90 tx=0x7f9978009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.418+0000 7f997f400640 1 -- 172.21.15.17:0/3904532601 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f998000ce20 con 0x7f9988160280 2024-09-10T23:25:14.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.590+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9988074af0 con 0x7f9988160280 2024-09-10T23:25:14.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f997f400640 1 -- 172.21.15.17:0/3904532601 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16913 (secure 0 0 0) 0x7f998005e230 con 0x7f9988160280 2024-09-10T23:25:14.596 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:14.597 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":143,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:25:13.261013+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:25:10.976327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-10T23:25:12.226641+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99640725e0 msgr2=0x7f9964074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99640725e0 0x7f9964074aa0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f99880c8d90 tx=0x7f9978009060 comp rx=0 tx=0).stop 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988160280 msgr2=0x7f99880c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988160280 0x7f99880c8de0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f998000b9e0 tx=0x7f998000bea0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 shutdown_connections 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99640725e0 0x7f9964074aa0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9988160280 0x7f99880c8de0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99880d2830 0x7f99881eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 --2- 172.21.15.17:0/3904532601 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99880d0200 0x7f99881f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 >> 172.21.15.17:0/3904532601 conn(0x7f99880d1d10 msgr2=0x7f99880ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 shutdown_connections 2024-09-10T23:25:14.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.594+0000 7f998e600640 1 -- 172.21.15.17:0/3904532601 wait complete. 2024-09-10T23:25:14.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:25:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.762+0000 7fb20e200640 1 -- 172.21.15.17:0/637734181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208073dd0 msgr2=0x7fb20806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.762+0000 7fb20e200640 1 --2- 172.21.15.17:0/637734181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208073dd0 0x7fb20806fb10 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb2080d1b00 tx=0x7fb20001cb30 comp rx=0 tx=0).stop 2024-09-10T23:25:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.762+0000 7fb20e200640 1 -- 172.21.15.17:0/637734181 shutdown_connections 2024-09-10T23:25:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.762+0000 7fb20e200640 1 --2- 172.21.15.17:0/637734181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208073dd0 0x7fb20806fb10 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.762+0000 7fb20e200640 1 --2- 172.21.15.17:0/637734181 >> v2:172.21.15.77:3300/0 conn(0x7fb208155270 0x7fb20815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.762+0000 7fb20e200640 1 -- 172.21.15.17:0/637734181 >> 172.21.15.17:0/637734181 conn(0x7fb2080d0b80 msgr2=0x7fb2080d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.762+0000 7fb20e200640 1 -- 172.21.15.17:0/637734181 shutdown_connections 2024-09-10T23:25:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 -- 172.21.15.17:0/637734181 wait complete. 2024-09-10T23:25:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 Processor -- start 2024-09-10T23:25:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 -- start start 2024-09-10T23:25:14.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208073dd0 0x7fb2080c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208074400 0x7fb2080ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb208155270 0x7fb2080c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb208167df0 con 0x7fb208074400 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb208167c70 con 0x7fb208073dd0 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb208167f70 con 0x7fb208155270 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1fea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208074400 0x7fb2080ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1fea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208074400 0x7fb2080ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34686/0 (socket says 172.21.15.17:34686) 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1fea00640 1 -- 172.21.15.17:0/2189954778 learned_addr learned my addr 172.21.15.17:0/2189954778 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb207e00640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb208155270 0x7fb2080c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb207400640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208073dd0 0x7fb2080c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1fea00640 1 -- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb208155270 msgr2=0x7fb2080c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1fea00640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb208155270 0x7fb2080c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1fea00640 1 -- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208073dd0 msgr2=0x7fb2080c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1fea00640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208073dd0 0x7fb2080c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:14.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1fea00640 1 -- 172.21.15.17:0/2189954778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2080c98a0 con 0x7fb208074400 2024-09-10T23:25:14.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb207e00640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb208155270 0x7fb2080c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:14.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb207400640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208073dd0 0x7fb2080c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:14.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1fea00640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208074400 0x7fb2080ca940 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c490 tx=0x7fb1f000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1ffe00640 1 -- 172.21.15.17:0/2189954778 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0016020 con 0x7fb208074400 2024-09-10T23:25:14.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1ffe00640 1 -- 172.21.15.17:0/2189954778 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1f0012940 con 0x7fb208074400 2024-09-10T23:25:14.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb1ffe00640 1 -- 172.21.15.17:0/2189954778 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0012d90 con 0x7fb208074400 2024-09-10T23:25:14.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.766+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2080c9b80 con 0x7fb208074400 2024-09-10T23:25:14.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.770+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2080ca140 con 0x7fb208074400 2024-09-10T23:25:14.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.770+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20806fb10 con 0x7fb208074400 2024-09-10T23:25:14.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.770+0000 7fb1ffe00640 1 -- 172.21.15.17:0/2189954778 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb1f001b400 con 0x7fb208074400 2024-09-10T23:25:14.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.770+0000 7fb1ffe00640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1e4072610 0x7fb1e4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:14.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.770+0000 7fb1ffe00640 1 -- 172.21.15.17:0/2189954778 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 6101+0+0 (secure 0 0 0) 0x7fb1f00937b0 con 0x7fb208074400 2024-09-10T23:25:14.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.770+0000 7fb207400640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1e4072610 0x7fb1e4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.774+0000 7fb207400640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1e4072610 0x7fb1e4074ad0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009b90 tx=0x7fb1f80091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.774+0000 7fb1ffe00640 1 -- 172.21.15.17:0/2189954778 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb1f0020020 con 0x7fb208074400 2024-09-10T23:25:14.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:14.990+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb2080b6b00 con 0x7fb208074400 2024-09-10T23:25:15.834 INFO:tasks.ceph.mds.d.smithi077.stderr:2024-09-10T23:25:15.834+0000 7fd168200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:25:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.866+0000 7fb1ffe00640 1 -- 172.21.15.17:0/2189954778 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v103) ==== 118+0+0 (secure 0 0 0) 0x7fb1f005ed20 con 0x7fb208074400 2024-09-10T23:25:15.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1e4072610 msgr2=0x7fb1e4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1e4072610 0x7fb1e4074ad0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009b90 tx=0x7fb1f80091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208074400 msgr2=0x7fb2080ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:15.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208074400 0x7fb2080ca940 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c490 tx=0x7fb1f000c950 comp rx=0 tx=0).stop 2024-09-10T23:25:15.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 shutdown_connections 2024-09-10T23:25:15.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb1e4072610 0x7fb1e4074ad0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb208155270 0x7fb2080c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb208074400 0x7fb2080ca940 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 --2- 172.21.15.17:0/2189954778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb208073dd0 0x7fb2080c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:15.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 >> 172.21.15.17:0/2189954778 conn(0x7fb2080d0b80 msgr2=0x7fb20815d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:15.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 shutdown_connections 2024-09-10T23:25:15.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:15.870+0000 7fb20e200640 1 -- 172.21.15.17:0/2189954778 wait complete. 2024-09-10T23:25:15.895 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:25:15.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:25:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.046+0000 7ff206800640 1 -- 172.21.15.17:0/3065165028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff20015ab30 msgr2=0x7ff200073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.046+0000 7ff206800640 1 --2- 172.21.15.17:0/3065165028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff20015ab30 0x7ff200073000 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7ff20015e600 tx=0x7ff1f001c800 comp rx=0 tx=0).stop 2024-09-10T23:25:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.046+0000 7ff206800640 1 -- 172.21.15.17:0/3065165028 shutdown_connections 2024-09-10T23:25:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.046+0000 7ff206800640 1 --2- 172.21.15.17:0/3065165028 >> v2:172.21.15.77:3300/0 conn(0x7ff2000b3940 0x7ff2000b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.046+0000 7ff206800640 1 --2- 172.21.15.17:0/3065165028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff20015ab30 0x7ff200073000 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.046+0000 7ff206800640 1 -- 172.21.15.17:0/3065165028 >> 172.21.15.17:0/3065165028 conn(0x7ff2000b17a0 msgr2=0x7ff2000b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.046+0000 7ff206800640 1 -- 172.21.15.17:0/3065165028 shutdown_connections 2024-09-10T23:25:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.046+0000 7ff206800640 1 -- 172.21.15.17:0/3065165028 wait complete. 2024-09-10T23:25:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 Processor -- start 2024-09-10T23:25:16.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 -- start start 2024-09-10T23:25:16.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff200072b40 0x7ff20014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:16.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2000b3940 0x7ff20014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:16.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff20015ab30 0x7ff200152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:16.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff200167a70 con 0x7ff2000b3940 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff200073e70 con 0x7ff200072b40 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff200167bf0 con 0x7ff20015ab30 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2000b3940 0x7ff20014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2000b3940 0x7ff20014a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34708/0 (socket says 172.21.15.17:34708) 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f6a00640 1 -- 172.21.15.17:0/2783293604 learned_addr learned my addr 172.21.15.17:0/2783293604 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1ff400640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff200072b40 0x7ff20014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1ffe00640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff20015ab30 0x7ff200152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f6a00640 1 -- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff20015ab30 msgr2=0x7ff200152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f6a00640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff20015ab30 0x7ff200152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f6a00640 1 -- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff200072b40 msgr2=0x7ff20014bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f6a00640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff200072b40 0x7ff20014bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f6a00640 1 -- 172.21.15.17:0/2783293604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20014c460 con 0x7ff2000b3940 2024-09-10T23:25:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1ffe00640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff20015ab30 0x7ff200152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f6a00640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2000b3940 0x7ff20014a4a0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800c730 tx=0x7ff1e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f7e00640 1 -- 172.21.15.17:0/2783293604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8017070 con 0x7ff2000b3940 2024-09-10T23:25:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f7e00640 1 -- 172.21.15.17:0/2783293604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1e80051a0 con 0x7ff2000b3940 2024-09-10T23:25:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff1f7e00640 1 -- 172.21.15.17:0/2783293604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800a640 con 0x7ff2000b3940 2024-09-10T23:25:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff200153800 con 0x7ff2000b3940 2024-09-10T23:25:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.050+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff200154970 con 0x7ff2000b3940 2024-09-10T23:25:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.054+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2000b3df0 con 0x7ff2000b3940 2024-09-10T23:25:16.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.054+0000 7ff1f7e00640 1 -- 172.21.15.17:0/2783293604 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff1e800a7e0 con 0x7ff2000b3940 2024-09-10T23:25:16.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.054+0000 7ff1f7e00640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1dc0725e0 0x7ff1dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:16.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.054+0000 7ff1f7e00640 1 -- 172.21.15.17:0/2783293604 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7ff1e80929b0 con 0x7ff2000b3940 2024-09-10T23:25:16.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.054+0000 7ff1ff400640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1dc0725e0 0x7ff1dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.054+0000 7ff1ff400640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1dc0725e0 0x7ff1dc074aa0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00af000 tx=0x7ff1f001b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.058+0000 7ff1f7e00640 1 -- 172.21.15.17:0/2783293604 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff2000cd030 con 0x7ff2000b3940 2024-09-10T23:25:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.266+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff200152510 con 0x7ff2000b3940 2024-09-10T23:25:16.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.874+0000 7ff1f7e00640 1 -- 172.21.15.17:0/2783293604 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v104) ==== 122+0+0 (secure 0 0 0) 0x7ff1e805d8a0 con 0x7ff2000b3940 2024-09-10T23:25:16.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1dc0725e0 msgr2=0x7ff1dc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:16.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1dc0725e0 0x7ff1dc074aa0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00af000 tx=0x7ff1f001b040 comp rx=0 tx=0).stop 2024-09-10T23:25:16.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2000b3940 msgr2=0x7ff20014a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:16.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2000b3940 0x7ff20014a4a0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800c730 tx=0x7ff1e800cbf0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 shutdown_connections 2024-09-10T23:25:16.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1dc0725e0 0x7ff1dc074aa0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff20015ab30 0x7ff200152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2000b3940 0x7ff20014a4a0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 --2- 172.21.15.17:0/2783293604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff200072b40 0x7ff20014bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:16.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 >> 172.21.15.17:0/2783293604 conn(0x7ff2000b17a0 msgr2=0x7ff200072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:16.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 shutdown_connections 2024-09-10T23:25:16.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:16.878+0000 7ff206800640 1 -- 172.21.15.17:0/2783293604 wait complete. 2024-09-10T23:25:16.902 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:25:16.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 -- 172.21.15.17:0/2459509542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff450074740 msgr2=0x7ff4500d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 --2- 172.21.15.17:0/2459509542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff450074740 0x7ff4500d0460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff448009c80 tx=0x7ff44801cce0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 -- 172.21.15.17:0/2459509542 shutdown_connections 2024-09-10T23:25:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 --2- 172.21.15.17:0/2459509542 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff450074740 0x7ff4500d0460 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 --2- 172.21.15.17:0/2459509542 >> v2:172.21.15.77:3300/0 conn(0x7ff4500b3870 0x7ff4500cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 -- 172.21.15.17:0/2459509542 >> 172.21.15.17:0/2459509542 conn(0x7ff45006cfc0 msgr2=0x7ff45006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 -- 172.21.15.17:0/2459509542 shutdown_connections 2024-09-10T23:25:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 -- 172.21.15.17:0/2459509542 wait complete. 2024-09-10T23:25:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 Processor -- start 2024-09-10T23:25:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 -- start start 2024-09-10T23:25:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450074740 0x7ff4500ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4500b3870 0x7ff45014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4501550b0 0x7ff450149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff4501679e0 con 0x7ff450074740 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff450167860 con 0x7ff4500b3870 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff456600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff450167b60 con 0x7ff4501550b0 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff44f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450074740 0x7ff4500ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff44f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450074740 0x7ff4500ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55838/0 (socket says 172.21.15.17:55838) 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff44f400640 1 -- 172.21.15.17:0/839744865 learned_addr learned my addr 172.21.15.17:0/839744865 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff44fe00640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4501550b0 0x7ff450149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.050+0000 7ff447e00640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4500b3870 0x7ff45014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff44f400640 1 -- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4501550b0 msgr2=0x7ff450149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff44f400640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4501550b0 0x7ff450149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff44f400640 1 -- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4500b3870 msgr2=0x7ff45014f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff44f400640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4500b3870 0x7ff45014f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff44f400640 1 -- 172.21.15.17:0/839744865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff450145940 con 0x7ff450074740 2024-09-10T23:25:17.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff44fe00640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4501550b0 0x7ff450149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:17.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff447e00640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4500b3870 0x7ff45014f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:17.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff44f400640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450074740 0x7ff4500ce910 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff44000c3c0 tx=0x7ff44000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff447400640 1 -- 172.21.15.17:0/839744865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440017070 con 0x7ff450074740 2024-09-10T23:25:17.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff447400640 1 -- 172.21.15.17:0/839744865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4400053c0 con 0x7ff450074740 2024-09-10T23:25:17.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff447400640 1 -- 172.21.15.17:0/839744865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440003860 con 0x7ff450074740 2024-09-10T23:25:17.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff450145c20 con 0x7ff450074740 2024-09-10T23:25:17.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4501461e0 con 0x7ff450074740 2024-09-10T23:25:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4500b3e10 con 0x7ff450074740 2024-09-10T23:25:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff447400640 1 -- 172.21.15.17:0/839744865 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff440003a00 con 0x7ff450074740 2024-09-10T23:25:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff447400640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff42c072610 0x7ff42c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.054+0000 7ff447400640 1 -- 172.21.15.17:0/839744865 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7ff440092a80 con 0x7ff450074740 2024-09-10T23:25:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.058+0000 7ff447e00640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff42c072610 0x7ff42c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.058+0000 7ff447e00640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff42c072610 0x7ff42c074ad0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff45014f260 tx=0x7ff4380091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.058+0000 7ff447400640 1 -- 172.21.15.17:0/839744865 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff440094e20 con 0x7ff450074740 2024-09-10T23:25:17.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.266+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff45006e8f0 con 0x7ff450074740 2024-09-10T23:25:17.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.266+0000 7ff447400640 1 -- 172.21.15.17:0/839744865 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7ff44005d850 con 0x7ff450074740 2024-09-10T23:25:17.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:17.270 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:17.270 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff42c072610 msgr2=0x7ff42c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff42c072610 0x7ff42c074ad0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff45014f260 tx=0x7ff4380091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450074740 msgr2=0x7ff4500ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450074740 0x7ff4500ce910 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff44000c3c0 tx=0x7ff44000c880 comp rx=0 tx=0).stop 2024-09-10T23:25:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 shutdown_connections 2024-09-10T23:25:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff42c072610 0x7ff42c074ad0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4501550b0 0x7ff450149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4500b3870 0x7ff45014f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 --2- 172.21.15.17:0/839744865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450074740 0x7ff4500ce910 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 >> 172.21.15.17:0/839744865 conn(0x7ff45006cfc0 msgr2=0x7ff45014d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 shutdown_connections 2024-09-10T23:25:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.270+0000 7ff456600640 1 -- 172.21.15.17:0/839744865 wait complete. 2024-09-10T23:25:17.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:25:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.434+0000 7f494fe00640 1 -- 172.21.15.17:0/2708689722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 msgr2=0x7f4950166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.434+0000 7f494fe00640 1 --2- 172.21.15.17:0/2708689722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 0x7f4950166710 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f4948009c80 tx=0x7f494801cda0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.434+0000 7f494fe00640 1 -- 172.21.15.17:0/2708689722 shutdown_connections 2024-09-10T23:25:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.434+0000 7f494fe00640 1 --2- 172.21.15.17:0/2708689722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 0x7f4950166710 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.434+0000 7f494fe00640 1 -- 172.21.15.17:0/2708689722 >> 172.21.15.17:0/2708689722 conn(0x7f495009a9f0 msgr2=0x7f495009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.434+0000 7f494fe00640 1 -- 172.21.15.17:0/2708689722 shutdown_connections 2024-09-10T23:25:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.434+0000 7f494fe00640 1 -- 172.21.15.17:0/2708689722 wait complete. 2024-09-10T23:25:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 Processor -- start 2024-09-10T23:25:17.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 -- start start 2024-09-10T23:25:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49500cfa20 0x7f49501f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 0x7f495014b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f495015bc70 0x7f4950155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4950169cd0 con 0x7f49500d20a0 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4950169b50 con 0x7f49500cfa20 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4950169e50 con 0x7f495015bc70 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4946000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 0x7f495014b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4946000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 0x7f495014b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55870/0 (socket says 172.21.15.17:55870) 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4946000640 1 -- 172.21.15.17:0/2869547189 learned_addr learned my addr 172.21.15.17:0/2869547189 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494f400640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f495015bc70 0x7f4950155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494ea00640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49500cfa20 0x7f49501f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4946000640 1 -- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f495015bc70 msgr2=0x7f4950155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4946000640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f495015bc70 0x7f4950155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4946000640 1 -- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49500cfa20 msgr2=0x7f49501f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4946000640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49500cfa20 0x7f49501f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4946000640 1 -- 172.21.15.17:0/2869547189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49501f8310 con 0x7f49500d20a0 2024-09-10T23:25:17.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4946000640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 0x7f495014b650 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f493800c450 tx=0x7f493800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4947400640 1 -- 172.21.15.17:0/2869547189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49380052d0 con 0x7f49500d20a0 2024-09-10T23:25:17.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4947400640 1 -- 172.21.15.17:0/2869547189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4938005470 con 0x7f49500d20a0 2024-09-10T23:25:17.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f4947400640 1 -- 172.21.15.17:0/2869547189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938012890 con 0x7f49500d20a0 2024-09-10T23:25:17.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49501fabc0 con 0x7f49500d20a0 2024-09-10T23:25:17.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.438+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49501fb180 con 0x7f49500d20a0 2024-09-10T23:25:17.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.442+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49500d1990 con 0x7f49500d20a0 2024-09-10T23:25:17.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.442+0000 7f4947400640 1 -- 172.21.15.17:0/2869547189 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4938003620 con 0x7f49500d20a0 2024-09-10T23:25:17.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.442+0000 7f4947400640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f492c0725e0 0x7f492c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.442+0000 7f4947400640 1 -- 172.21.15.17:0/2869547189 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f4938092e40 con 0x7f49500d20a0 2024-09-10T23:25:17.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.442+0000 7f494ea00640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f492c0725e0 0x7f492c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.442+0000 7f494ea00640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f492c0725e0 0x7f492c074aa0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f49400098e0 tx=0x7f4940009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.446+0000 7f4947400640 1 -- 172.21.15.17:0/2869547189 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f493805ddf0 con 0x7f49500d20a0 2024-09-10T23:25:17.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.622+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49500d0740 con 0x7f49500d20a0 2024-09-10T23:25:17.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.622+0000 7f4947400640 1 -- 172.21.15.17:0/2869547189 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+16900 (secure 0 0 0) 0x7f4938062820 con 0x7f49500d20a0 2024-09-10T23:25:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:17.627 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":144,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:25:14.845302+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:25:10.976327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-10T23:25:12.226641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f492c0725e0 msgr2=0x7f492c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f492c0725e0 0x7f492c074aa0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f49400098e0 tx=0x7f4940009060 comp rx=0 tx=0).stop 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 msgr2=0x7f495014b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 0x7f495014b650 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f493800c450 tx=0x7f493800c910 comp rx=0 tx=0).stop 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 shutdown_connections 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f492c0725e0 0x7f492c074aa0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f495015bc70 0x7f4950155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49500d20a0 0x7f495014b650 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 --2- 172.21.15.17:0/2869547189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49500cfa20 0x7f49501f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 >> 172.21.15.17:0/2869547189 conn(0x7f495009a9f0 msgr2=0x7f49500b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 shutdown_connections 2024-09-10T23:25:17.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.626+0000 7f494fe00640 1 -- 172.21.15.17:0/2869547189 wait complete. 2024-09-10T23:25:17.649 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:25:17.649 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:25:17.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 -- 172.21.15.17:0/3615561244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580cff20 msgr2=0x7f81580d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 --2- 172.21.15.17:0/3615561244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580cff20 0x7f81580d03b0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f815806dba0 tx=0x7f815001ccf0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 -- 172.21.15.17:0/3615561244 shutdown_connections 2024-09-10T23:25:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 --2- 172.21.15.17:0/3615561244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580cff20 0x7f81580d03b0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 --2- 172.21.15.17:0/3615561244 >> v2:172.21.15.77:3300/0 conn(0x7f81580cf4f0 0x7f81580b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 -- 172.21.15.17:0/3615561244 >> 172.21.15.17:0/3615561244 conn(0x7f815806cfc0 msgr2=0x7f815806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 -- 172.21.15.17:0/3615561244 shutdown_connections 2024-09-10T23:25:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 -- 172.21.15.17:0/3615561244 wait complete. 2024-09-10T23:25:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 Processor -- start 2024-09-10T23:25:17.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 -- start start 2024-09-10T23:25:17.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580b48f0 0x7f8158147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81580cf4f0 0x7f81581f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81580cff20 0x7f81581f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8158168b70 con 0x7f81580b48f0 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81581689f0 con 0x7f81580cf4f0 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f815e600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8158168cf0 con 0x7f81580cff20 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f8157400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580b48f0 0x7f8158147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f8157400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580b48f0 0x7f8158147160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55888/0 (socket says 172.21.15.17:55888) 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f8157400640 1 -- 172.21.15.17:0/1302361335 learned_addr learned my addr 172.21.15.17:0/1302361335 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f814fe00640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81580cf4f0 0x7f81581f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.794+0000 7f8157e00640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81580cff20 0x7f81581f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f8157400640 1 -- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81580cff20 msgr2=0x7f81581f7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f8157400640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81580cff20 0x7f81581f7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f8157400640 1 -- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81580cf4f0 msgr2=0x7f81581f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f8157400640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81580cf4f0 0x7f81581f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f8157400640 1 -- 172.21.15.17:0/1302361335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8158147b50 con 0x7f81580b48f0 2024-09-10T23:25:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f814fe00640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81580cf4f0 0x7f81581f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f8157e00640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81580cff20 0x7f81581f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f8157400640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580b48f0 0x7f8158147160 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f814800d980 tx=0x7f814800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f814f400640 1 -- 172.21.15.17:0/1302361335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148017070 con 0x7f81580b48f0 2024-09-10T23:25:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f814f400640 1 -- 172.21.15.17:0/1302361335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8148009cc0 con 0x7f81580b48f0 2024-09-10T23:25:17.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f814f400640 1 -- 172.21.15.17:0/1302361335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81480106c0 con 0x7f81580b48f0 2024-09-10T23:25:17.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8158072cb0 con 0x7f81580b48f0 2024-09-10T23:25:17.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8158073270 con 0x7f81580b48f0 2024-09-10T23:25:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81580b37f0 con 0x7f81580b48f0 2024-09-10T23:25:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f814f400640 1 -- 172.21.15.17:0/1302361335 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8148010860 con 0x7f81580b48f0 2024-09-10T23:25:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f814f400640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8134072610 0x7f8134074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.798+0000 7f814f400640 1 -- 172.21.15.17:0/1302361335 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f81480936d0 con 0x7f81580b48f0 2024-09-10T23:25:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.802+0000 7f814fe00640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8134072610 0x7f8134074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.802+0000 7f814fe00640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8134072610 0x7f8134074ad0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f81581f86d0 tx=0x7f8140009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:17.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.802+0000 7f814f400640 1 -- 172.21.15.17:0/1302361335 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f814805ecb0 con 0x7f81580b48f0 2024-09-10T23:25:17.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.974+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81580cf060 con 0x7f8134072610 2024-09-10T23:25:17.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f814f400640 1 -- 172.21.15.17:0/1302361335 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251791 (secure 0 0 0) 0x7f8140001ca0 con 0x7f8134072610 2024-09-10T23:25:17.990 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:17.991 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8134072610 msgr2=0x7f8134074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8134072610 0x7f8134074ad0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f81581f86d0 tx=0x7f8140009040 comp rx=0 tx=0).stop 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580b48f0 msgr2=0x7f8158147160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580b48f0 0x7f8158147160 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f814800d980 tx=0x7f814800de40 comp rx=0 tx=0).stop 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 shutdown_connections 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8134072610 0x7f8134074ad0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81580cff20 0x7f81581f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81580cf4f0 0x7f81581f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 --2- 172.21.15.17:0/1302361335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81580b48f0 0x7f8158147160 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 >> 172.21.15.17:0/1302361335 conn(0x7f815806cfc0 msgr2=0x7f81581502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:17.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 shutdown_connections 2024-09-10T23:25:17.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:17.982+0000 7f815e600640 1 -- 172.21.15.17:0/1302361335 wait complete. 2024-09-10T23:25:18.006 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":434,"stamp":"2024-09-10T23:25:16.431796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":479808,"kb_used_data":15108,"kb_used_omap":12,"kb_used_meta":464499,"kb_avail":754494912,"statfs":{"total":773094113280,"available":772602789888,"internally_reserved":0,"allocated":15470592,"data_stored":7866284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":475647537},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.591527"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.870355+0000","last_change":"2024-09-10T23:25:13.865559+0000","last_active":"2024-09-10T23:25:13.870355+0000","last_peered":"2024-09-10T23:25:13.870355+0000","last_clean":"2024-09-10T23:25:13.870355+0000","last_became_active":"2024-09-10T23:25:13.865244+0000","last_became_peered":"2024-09-10T23:25:13.865244+0000","last_unstale":"2024-09-10T23:25:13.870355+0000","last_undegraded":"2024-09-10T23:25:13.870355+0000","last_fullsized":"2024-09-10T23:25:13.870355+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:07.293961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.874913+0000","last_change":"2024-09-10T23:25:13.869884+0000","last_active":"2024-09-10T23:25:13.874913+0000","last_peered":"2024-09-10T23:25:13.874913+0000","last_clean":"2024-09-10T23:25:13.874913+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:13.874913+0000","last_undegraded":"2024-09-10T23:25:13.874913+0000","last_fullsized":"2024-09-10T23:25:13.874913+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:07.467267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543691+0000","last_change":"2024-09-10T23:25:13.873797+0000","last_active":"2024-09-10T23:25:15.543691+0000","last_peered":"2024-09-10T23:25:15.543691+0000","last_clean":"2024-09-10T23:25:15.543691+0000","last_became_active":"2024-09-10T23:25:13.873417+0000","last_became_peered":"2024-09-10T23:25:13.873417+0000","last_unstale":"2024-09-10T23:25:15.543691+0000","last_undegraded":"2024-09-10T23:25:15.543691+0000","last_fullsized":"2024-09-10T23:25:15.543691+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.073999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.876094+0000","last_change":"2024-09-10T23:25:13.871941+0000","last_active":"2024-09-10T23:25:13.876094+0000","last_peered":"2024-09-10T23:25:13.876094+0000","last_clean":"2024-09-10T23:25:13.876094+0000","last_became_active":"2024-09-10T23:25:13.871660+0000","last_became_peered":"2024-09-10T23:25:13.871660+0000","last_unstale":"2024-09-10T23:25:13.876094+0000","last_undegraded":"2024-09-10T23:25:13.876094+0000","last_fullsized":"2024-09-10T23:25:13.876094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:22.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.849219+0000","last_change":"2024-09-10T23:25:12.849219+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.849219+0000","last_undegraded":"2024-09-10T23:25:12.849219+0000","last_fullsized":"2024-09-10T23:25:12.849219+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849317+0000","last_change":"2024-09-10T23:25:13.869860+0000","last_active":"2024-09-10T23:25:14.849317+0000","last_peered":"2024-09-10T23:25:14.849317+0000","last_clean":"2024-09-10T23:25:14.849317+0000","last_became_active":"2024-09-10T23:25:13.869577+0000","last_became_peered":"2024-09-10T23:25:13.869577+0000","last_unstale":"2024-09-10T23:25:14.849317+0000","last_undegraded":"2024-09-10T23:25:14.849317+0000","last_fullsized":"2024-09-10T23:25:14.849317+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:41.363760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167998+0000","last_change":"2024-09-10T23:25:13.882785+0000","last_active":"2024-09-10T23:25:15.167998+0000","last_peered":"2024-09-10T23:25:15.167998+0000","last_clean":"2024-09-10T23:25:15.167998+0000","last_became_active":"2024-09-10T23:25:13.877627+0000","last_became_peered":"2024-09-10T23:25:13.877627+0000","last_unstale":"2024-09-10T23:25:15.167998+0000","last_undegraded":"2024-09-10T23:25:15.167998+0000","last_fullsized":"2024-09-10T23:25:15.167998+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:44.875736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854072+0000","last_change":"2024-09-10T23:25:13.867473+0000","last_active":"2024-09-10T23:25:14.854072+0000","last_peered":"2024-09-10T23:25:14.854072+0000","last_clean":"2024-09-10T23:25:14.854072+0000","last_became_active":"2024-09-10T23:25:13.867208+0000","last_became_peered":"2024-09-10T23:25:13.867208+0000","last_unstale":"2024-09-10T23:25:14.854072+0000","last_undegraded":"2024-09-10T23:25:14.854072+0000","last_fullsized":"2024-09-10T23:25:14.854072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:19.792842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849974+0000","last_change":"2024-09-10T23:25:13.875490+0000","last_active":"2024-09-10T23:25:14.849974+0000","last_peered":"2024-09-10T23:25:14.849974+0000","last_clean":"2024-09-10T23:25:14.849974+0000","last_became_active":"2024-09-10T23:25:13.875205+0000","last_became_peered":"2024-09-10T23:25:13.875205+0000","last_unstale":"2024-09-10T23:25:14.849974+0000","last_undegraded":"2024-09-10T23:25:14.849974+0000","last_fullsized":"2024-09-10T23:25:14.849974+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:51.185099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.857080+0000","last_change":"2024-09-10T23:25:13.854593+0000","last_active":"2024-09-10T23:25:13.857080+0000","last_peered":"2024-09-10T23:25:13.857080+0000","last_clean":"2024-09-10T23:25:13.857080+0000","last_became_active":"2024-09-10T23:25:13.854336+0000","last_became_peered":"2024-09-10T23:25:13.854336+0000","last_unstale":"2024-09-10T23:25:13.857080+0000","last_undegraded":"2024-09-10T23:25:13.857080+0000","last_fullsized":"2024-09-10T23:25:13.857080+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.179524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881188+0000","last_change":"2024-09-10T23:25:13.876510+0000","last_active":"2024-09-10T23:25:13.881188+0000","last_peered":"2024-09-10T23:25:13.881188+0000","last_clean":"2024-09-10T23:25:13.881188+0000","last_became_active":"2024-09-10T23:25:13.876168+0000","last_became_peered":"2024-09-10T23:25:13.876168+0000","last_unstale":"2024-09-10T23:25:13.881188+0000","last_undegraded":"2024-09-10T23:25:13.881188+0000","last_fullsized":"2024-09-10T23:25:13.881188+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:22.257735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.872176+0000","last_change":"2024-09-10T23:25:13.866253+0000","last_active":"2024-09-10T23:25:13.872176+0000","last_peered":"2024-09-10T23:25:13.872176+0000","last_clean":"2024-09-10T23:25:13.872176+0000","last_became_active":"2024-09-10T23:25:13.865309+0000","last_became_peered":"2024-09-10T23:25:13.865309+0000","last_unstale":"2024-09-10T23:25:13.872176+0000","last_undegraded":"2024-09-10T23:25:13.872176+0000","last_fullsized":"2024-09-10T23:25:13.872176+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.331722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849866+0000","last_change":"2024-09-10T23:25:13.871849+0000","last_active":"2024-09-10T23:25:14.849866+0000","last_peered":"2024-09-10T23:25:14.849866+0000","last_clean":"2024-09-10T23:25:14.849866+0000","last_became_active":"2024-09-10T23:25:13.871410+0000","last_became_peered":"2024-09-10T23:25:13.871410+0000","last_unstale":"2024-09-10T23:25:14.849866+0000","last_undegraded":"2024-09-10T23:25:14.849866+0000","last_fullsized":"2024-09-10T23:25:14.849866+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:05.732775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875164+0000","last_change":"2024-09-10T23:25:13.871872+0000","last_active":"2024-09-10T23:25:13.875164+0000","last_peered":"2024-09-10T23:25:13.875164+0000","last_clean":"2024-09-10T23:25:13.875164+0000","last_became_active":"2024-09-10T23:25:13.871601+0000","last_became_peered":"2024-09-10T23:25:13.871601+0000","last_unstale":"2024-09-10T23:25:13.875164+0000","last_undegraded":"2024-09-10T23:25:13.875164+0000","last_fullsized":"2024-09-10T23:25:13.875164+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:31.846681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.868359+0000","last_change":"2024-09-10T23:25:13.861355+0000","last_active":"2024-09-10T23:25:13.868359+0000","last_peered":"2024-09-10T23:25:13.868359+0000","last_clean":"2024-09-10T23:25:13.868359+0000","last_became_active":"2024-09-10T23:25:13.860218+0000","last_became_peered":"2024-09-10T23:25:13.860218+0000","last_unstale":"2024-09-10T23:25:13.868359+0000","last_undegraded":"2024-09-10T23:25:13.868359+0000","last_fullsized":"2024-09-10T23:25:13.868359+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:30.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849485+0000","last_change":"2024-09-10T23:25:13.863772+0000","last_active":"2024-09-10T23:25:14.849485+0000","last_peered":"2024-09-10T23:25:14.849485+0000","last_clean":"2024-09-10T23:25:14.849485+0000","last_became_active":"2024-09-10T23:25:13.863386+0000","last_became_peered":"2024-09-10T23:25:13.863386+0000","last_unstale":"2024-09-10T23:25:14.849485+0000","last_undegraded":"2024-09-10T23:25:14.849485+0000","last_fullsized":"2024-09-10T23:25:14.849485+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849983+0000","last_change":"2024-09-10T23:25:13.864064+0000","last_active":"2024-09-10T23:25:14.849983+0000","last_peered":"2024-09-10T23:25:14.849983+0000","last_clean":"2024-09-10T23:25:14.849983+0000","last_became_active":"2024-09-10T23:25:13.863786+0000","last_became_peered":"2024-09-10T23:25:13.863786+0000","last_unstale":"2024-09-10T23:25:14.849983+0000","last_undegraded":"2024-09-10T23:25:14.849983+0000","last_fullsized":"2024-09-10T23:25:14.849983+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:32.141683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.851164+0000","last_change":"2024-09-10T23:25:12.851164+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.851164+0000","last_undegraded":"2024-09-10T23:25:12.851164+0000","last_fullsized":"2024-09-10T23:25:12.851164+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:13.875171+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:13.874560+0000","last_became_peered":"2024-09-10T23:25:13.874560+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:58.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.853187+0000","last_change":"2024-09-10T23:25:12.853187+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.853187+0000","last_undegraded":"2024-09-10T23:25:12.853187+0000","last_fullsized":"2024-09-10T23:25:12.853187+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875674+0000","last_change":"2024-09-10T23:25:13.871600+0000","last_active":"2024-09-10T23:25:13.875674+0000","last_peered":"2024-09-10T23:25:13.875674+0000","last_clean":"2024-09-10T23:25:13.875674+0000","last_became_active":"2024-09-10T23:25:13.871261+0000","last_became_peered":"2024-09-10T23:25:13.871261+0000","last_unstale":"2024-09-10T23:25:13.875674+0000","last_undegraded":"2024-09-10T23:25:13.875674+0000","last_fullsized":"2024-09-10T23:25:13.875674+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:33.139403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878388+0000","last_change":"2024-09-10T23:25:13.875260+0000","last_active":"2024-09-10T23:25:13.878388+0000","last_peered":"2024-09-10T23:25:13.878388+0000","last_clean":"2024-09-10T23:25:13.878388+0000","last_became_active":"2024-09-10T23:25:13.874961+0000","last_became_peered":"2024-09-10T23:25:13.874961+0000","last_unstale":"2024-09-10T23:25:13.878388+0000","last_undegraded":"2024-09-10T23:25:13.878388+0000","last_fullsized":"2024-09-10T23:25:13.878388+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:13.378132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881255+0000","last_change":"2024-09-10T23:25:13.878417+0000","last_active":"2024-09-10T23:25:13.881255+0000","last_peered":"2024-09-10T23:25:13.881255+0000","last_clean":"2024-09-10T23:25:13.881255+0000","last_became_active":"2024-09-10T23:25:13.878116+0000","last_became_peered":"2024-09-10T23:25:13.878116+0000","last_unstale":"2024-09-10T23:25:13.881255+0000","last_undegraded":"2024-09-10T23:25:13.881255+0000","last_fullsized":"2024-09-10T23:25:13.881255+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:16.040337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849229+0000","last_change":"2024-09-10T23:25:13.872929+0000","last_active":"2024-09-10T23:25:14.849229+0000","last_peered":"2024-09-10T23:25:14.849229+0000","last_clean":"2024-09-10T23:25:14.849229+0000","last_became_active":"2024-09-10T23:25:13.870728+0000","last_became_peered":"2024-09-10T23:25:13.870728+0000","last_unstale":"2024-09-10T23:25:14.849229+0000","last_undegraded":"2024-09-10T23:25:14.849229+0000","last_fullsized":"2024-09-10T23:25:14.849229+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544072+0000","last_change":"2024-09-10T23:25:13.876451+0000","last_active":"2024-09-10T23:25:15.544072+0000","last_peered":"2024-09-10T23:25:15.544072+0000","last_clean":"2024-09-10T23:25:15.544072+0000","last_became_active":"2024-09-10T23:25:13.876073+0000","last_became_peered":"2024-09-10T23:25:13.876073+0000","last_unstale":"2024-09-10T23:25:15.544072+0000","last_undegraded":"2024-09-10T23:25:15.544072+0000","last_fullsized":"2024-09-10T23:25:15.544072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544042+0000","last_change":"2024-09-10T23:25:13.881177+0000","last_active":"2024-09-10T23:25:15.544042+0000","last_peered":"2024-09-10T23:25:15.544042+0000","last_clean":"2024-09-10T23:25:15.544042+0000","last_became_active":"2024-09-10T23:25:13.880913+0000","last_became_peered":"2024-09-10T23:25:13.880913+0000","last_unstale":"2024-09-10T23:25:15.544042+0000","last_undegraded":"2024-09-10T23:25:15.544042+0000","last_fullsized":"2024-09-10T23:25:15.544042+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168384+0000","last_change":"2024-09-10T23:25:13.875429+0000","last_active":"2024-09-10T23:25:15.168384+0000","last_peered":"2024-09-10T23:25:15.168384+0000","last_clean":"2024-09-10T23:25:15.168384+0000","last_became_active":"2024-09-10T23:25:13.874893+0000","last_became_peered":"2024-09-10T23:25:13.874893+0000","last_unstale":"2024-09-10T23:25:15.168384+0000","last_undegraded":"2024-09-10T23:25:15.168384+0000","last_fullsized":"2024-09-10T23:25:15.168384+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:47.064911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.856715+0000","last_change":"2024-09-10T23:25:13.853437+0000","last_active":"2024-09-10T23:25:13.856715+0000","last_peered":"2024-09-10T23:25:13.856715+0000","last_clean":"2024-09-10T23:25:13.856715+0000","last_became_active":"2024-09-10T23:25:13.853158+0000","last_became_peered":"2024-09-10T23:25:13.853158+0000","last_unstale":"2024-09-10T23:25:13.856715+0000","last_undegraded":"2024-09-10T23:25:13.856715+0000","last_fullsized":"2024-09-10T23:25:13.856715+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:14.818230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543699+0000","last_change":"2024-09-10T23:25:13.878111+0000","last_active":"2024-09-10T23:25:15.543699+0000","last_peered":"2024-09-10T23:25:15.543699+0000","last_clean":"2024-09-10T23:25:15.543699+0000","last_became_active":"2024-09-10T23:25:13.877815+0000","last_became_peered":"2024-09-10T23:25:13.877815+0000","last_unstale":"2024-09-10T23:25:15.543699+0000","last_undegraded":"2024-09-10T23:25:15.543699+0000","last_fullsized":"2024-09-10T23:25:15.543699+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:33.139403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543716+0000","last_change":"2024-09-10T23:25:13.878758+0000","last_active":"2024-09-10T23:25:15.543716+0000","last_peered":"2024-09-10T23:25:15.543716+0000","last_clean":"2024-09-10T23:25:15.543716+0000","last_became_active":"2024-09-10T23:25:13.878493+0000","last_became_peered":"2024-09-10T23:25:13.878493+0000","last_unstale":"2024-09-10T23:25:15.543716+0000","last_undegraded":"2024-09-10T23:25:15.543716+0000","last_fullsized":"2024-09-10T23:25:15.543716+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:27.113577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854060+0000","last_change":"2024-09-10T23:25:13.869209+0000","last_active":"2024-09-10T23:25:14.854060+0000","last_peered":"2024-09-10T23:25:14.854060+0000","last_clean":"2024-09-10T23:25:14.854060+0000","last_became_active":"2024-09-10T23:25:13.868965+0000","last_became_peered":"2024-09-10T23:25:13.868965+0000","last_unstale":"2024-09-10T23:25:14.854060+0000","last_undegraded":"2024-09-10T23:25:14.854060+0000","last_fullsized":"2024-09-10T23:25:14.854060+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:59.422431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875736+0000","last_change":"2024-09-10T23:25:13.875122+0000","last_active":"2024-09-10T23:25:13.875736+0000","last_peered":"2024-09-10T23:25:13.875736+0000","last_clean":"2024-09-10T23:25:13.875736+0000","last_became_active":"2024-09-10T23:25:13.874015+0000","last_became_peered":"2024-09-10T23:25:13.874015+0000","last_unstale":"2024-09-10T23:25:13.875736+0000","last_undegraded":"2024-09-10T23:25:13.875736+0000","last_fullsized":"2024-09-10T23:25:13.875736+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:05.311293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854201+0000","last_change":"2024-09-10T23:25:13.869068+0000","last_active":"2024-09-10T23:25:14.854201+0000","last_peered":"2024-09-10T23:25:14.854201+0000","last_clean":"2024-09-10T23:25:14.854201+0000","last_became_active":"2024-09-10T23:25:13.865220+0000","last_became_peered":"2024-09-10T23:25:13.865220+0000","last_unstale":"2024-09-10T23:25:14.854201+0000","last_undegraded":"2024-09-10T23:25:14.854201+0000","last_fullsized":"2024-09-10T23:25:14.854201+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:25.648301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"143'4","reported_seq":19,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543988+0000","last_change":"2024-09-10T23:25:12.873694+0000","last_active":"2024-09-10T23:25:15.543988+0000","last_peered":"2024-09-10T23:25:15.543988+0000","last_clean":"2024-09-10T23:25:15.543988+0000","last_became_active":"2024-09-10T23:25:12.871488+0000","last_became_peered":"2024-09-10T23:25:12.871488+0000","last_unstale":"2024-09-10T23:25:15.543988+0000","last_undegraded":"2024-09-10T23:25:15.543988+0000","last_fullsized":"2024-09-10T23:25:15.543988+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:17.859612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.873431+0000","last_change":"2024-09-10T23:25:13.869377+0000","last_active":"2024-09-10T23:25:13.873431+0000","last_peered":"2024-09-10T23:25:13.873431+0000","last_clean":"2024-09-10T23:25:13.873431+0000","last_became_active":"2024-09-10T23:25:13.869123+0000","last_became_peered":"2024-09-10T23:25:13.869123+0000","last_unstale":"2024-09-10T23:25:13.873431+0000","last_undegraded":"2024-09-10T23:25:13.873431+0000","last_fullsized":"2024-09-10T23:25:13.873431+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:24.587347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-10T23:25:12.865601+0000","last_change":"2024-09-10T23:25:12.864352+0000","last_active":"2024-09-10T23:25:12.865601+0000","last_peered":"2024-09-10T23:25:12.865601+0000","last_clean":"2024-09-10T23:25:12.865601+0000","last_became_active":"2024-09-10T23:25:12.864097+0000","last_became_peered":"2024-09-10T23:25:12.864097+0000","last_unstale":"2024-09-10T23:25:12.865601+0000","last_undegraded":"2024-09-10T23:25:12.865601+0000","last_fullsized":"2024-09-10T23:25:12.865601+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:08.918560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881249+0000","last_change":"2024-09-10T23:25:13.876002+0000","last_active":"2024-09-10T23:25:13.881249+0000","last_peered":"2024-09-10T23:25:13.881249+0000","last_clean":"2024-09-10T23:25:13.881249+0000","last_became_active":"2024-09-10T23:25:13.875699+0000","last_became_peered":"2024-09-10T23:25:13.875699+0000","last_unstale":"2024-09-10T23:25:13.881249+0000","last_undegraded":"2024-09-10T23:25:13.881249+0000","last_fullsized":"2024-09-10T23:25:13.881249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168318+0000","last_change":"2024-09-10T23:25:12.869556+0000","last_active":"2024-09-10T23:25:15.168318+0000","last_peered":"2024-09-10T23:25:15.168318+0000","last_clean":"2024-09-10T23:25:15.168318+0000","last_became_active":"2024-09-10T23:25:12.869278+0000","last_became_peered":"2024-09-10T23:25:12.869278+0000","last_unstale":"2024-09-10T23:25:15.168318+0000","last_undegraded":"2024-09-10T23:25:15.168318+0000","last_fullsized":"2024-09-10T23:25:15.168318+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:56.479420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878651+0000","last_change":"2024-09-10T23:25:13.872607+0000","last_active":"2024-09-10T23:25:13.878651+0000","last_peered":"2024-09-10T23:25:13.878651+0000","last_clean":"2024-09-10T23:25:13.878651+0000","last_became_active":"2024-09-10T23:25:13.872280+0000","last_became_peered":"2024-09-10T23:25:13.872280+0000","last_unstale":"2024-09-10T23:25:13.878651+0000","last_undegraded":"2024-09-10T23:25:13.878651+0000","last_fullsized":"2024-09-10T23:25:13.878651+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:57.011115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168214+0000","last_change":"2024-09-10T23:25:12.865957+0000","last_active":"2024-09-10T23:25:15.168214+0000","last_peered":"2024-09-10T23:25:15.168214+0000","last_clean":"2024-09-10T23:25:15.168214+0000","last_became_active":"2024-09-10T23:25:12.865662+0000","last_became_peered":"2024-09-10T23:25:12.865662+0000","last_unstale":"2024-09-10T23:25:15.168214+0000","last_undegraded":"2024-09-10T23:25:15.168214+0000","last_fullsized":"2024-09-10T23:25:15.168214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:10.168386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854351+0000","last_change":"2024-09-10T23:25:13.868440+0000","last_active":"2024-09-10T23:25:14.854351+0000","last_peered":"2024-09-10T23:25:14.854351+0000","last_clean":"2024-09-10T23:25:14.854351+0000","last_became_active":"2024-09-10T23:25:13.868181+0000","last_became_peered":"2024-09-10T23:25:13.868181+0000","last_unstale":"2024-09-10T23:25:14.854351+0000","last_undegraded":"2024-09-10T23:25:14.854351+0000","last_fullsized":"2024-09-10T23:25:14.854351+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:05.848015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854302+0000","last_change":"2024-09-10T23:25:12.874108+0000","last_active":"2024-09-10T23:25:14.854302+0000","last_peered":"2024-09-10T23:25:14.854302+0000","last_clean":"2024-09-10T23:25:14.854302+0000","last_became_active":"2024-09-10T23:25:12.872828+0000","last_became_peered":"2024-09-10T23:25:12.872828+0000","last_unstale":"2024-09-10T23:25:14.854302+0000","last_undegraded":"2024-09-10T23:25:14.854302+0000","last_fullsized":"2024-09-10T23:25:14.854302+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854662+0000","last_change":"2024-09-10T23:25:13.861557+0000","last_active":"2024-09-10T23:25:14.854662+0000","last_peered":"2024-09-10T23:25:14.854662+0000","last_clean":"2024-09-10T23:25:14.854662+0000","last_became_active":"2024-09-10T23:25:13.861288+0000","last_became_peered":"2024-09-10T23:25:13.861288+0000","last_unstale":"2024-09-10T23:25:14.854662+0000","last_undegraded":"2024-09-10T23:25:14.854662+0000","last_fullsized":"2024-09-10T23:25:14.854662+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:07.467267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-10T23:25:12.865626+0000","last_change":"2024-09-10T23:25:12.861726+0000","last_active":"2024-09-10T23:25:12.865626+0000","last_peered":"2024-09-10T23:25:12.865626+0000","last_clean":"2024-09-10T23:25:12.865626+0000","last_became_active":"2024-09-10T23:25:12.861433+0000","last_became_peered":"2024-09-10T23:25:12.861433+0000","last_unstale":"2024-09-10T23:25:12.865626+0000","last_undegraded":"2024-09-10T23:25:12.865626+0000","last_fullsized":"2024-09-10T23:25:12.865626+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:27.649038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.850758+0000","last_change":"2024-09-10T23:25:12.850758+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.850758+0000","last_undegraded":"2024-09-10T23:25:12.850758+0000","last_fullsized":"2024-09-10T23:25:12.850758+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849066+0000","last_change":"2024-09-10T23:25:12.857750+0000","last_active":"2024-09-10T23:25:14.849066+0000","last_peered":"2024-09-10T23:25:14.849066+0000","last_clean":"2024-09-10T23:25:14.849066+0000","last_became_active":"2024-09-10T23:25:12.857460+0000","last_became_peered":"2024-09-10T23:25:12.857460+0000","last_unstale":"2024-09-10T23:25:14.849066+0000","last_undegraded":"2024-09-10T23:25:14.849066+0000","last_fullsized":"2024-09-10T23:25:14.849066+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168579+0000","last_change":"2024-09-10T23:25:13.880336+0000","last_active":"2024-09-10T23:25:15.168579+0000","last_peered":"2024-09-10T23:25:15.168579+0000","last_clean":"2024-09-10T23:25:15.168579+0000","last_became_active":"2024-09-10T23:25:13.877088+0000","last_became_peered":"2024-09-10T23:25:13.877088+0000","last_unstale":"2024-09-10T23:25:15.168579+0000","last_undegraded":"2024-09-10T23:25:15.168579+0000","last_fullsized":"2024-09-10T23:25:15.168579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:30.634846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543073+0000","last_change":"2024-09-10T23:25:12.872243+0000","last_active":"2024-09-10T23:25:15.543073+0000","last_peered":"2024-09-10T23:25:15.543073+0000","last_clean":"2024-09-10T23:25:15.543073+0000","last_became_active":"2024-09-10T23:25:12.870719+0000","last_became_peered":"2024-09-10T23:25:12.870719+0000","last_unstale":"2024-09-10T23:25:15.543073+0000","last_undegraded":"2024-09-10T23:25:15.543073+0000","last_fullsized":"2024-09-10T23:25:15.543073+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:44.618611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878550+0000","last_change":"2024-09-10T23:25:13.874102+0000","last_active":"2024-09-10T23:25:13.878550+0000","last_peered":"2024-09-10T23:25:13.878550+0000","last_clean":"2024-09-10T23:25:13.878550+0000","last_became_active":"2024-09-10T23:25:13.873768+0000","last_became_peered":"2024-09-10T23:25:13.873768+0000","last_unstale":"2024-09-10T23:25:13.878550+0000","last_undegraded":"2024-09-10T23:25:13.878550+0000","last_fullsized":"2024-09-10T23:25:13.878550+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:37.211577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.864004+0000","last_change":"2024-09-10T23:25:12.867851+0000","last_active":"2024-09-10T23:25:13.864004+0000","last_peered":"2024-09-10T23:25:13.864004+0000","last_clean":"2024-09-10T23:25:13.864004+0000","last_became_active":"2024-09-10T23:25:12.867574+0000","last_became_peered":"2024-09-10T23:25:12.867574+0000","last_unstale":"2024-09-10T23:25:13.864004+0000","last_undegraded":"2024-09-10T23:25:13.864004+0000","last_fullsized":"2024-09-10T23:25:13.864004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:04.845258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849337+0000","last_change":"2024-09-10T23:25:13.863808+0000","last_active":"2024-09-10T23:25:14.849337+0000","last_peered":"2024-09-10T23:25:14.849337+0000","last_clean":"2024-09-10T23:25:14.849337+0000","last_became_active":"2024-09-10T23:25:13.863523+0000","last_became_peered":"2024-09-10T23:25:13.863523+0000","last_unstale":"2024-09-10T23:25:14.849337+0000","last_undegraded":"2024-09-10T23:25:14.849337+0000","last_fullsized":"2024-09-10T23:25:14.849337+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.854459+0000","last_change":"2024-09-10T23:25:12.870251+0000","last_active":"2024-09-10T23:25:13.854459+0000","last_peered":"2024-09-10T23:25:13.854459+0000","last_clean":"2024-09-10T23:25:13.854459+0000","last_became_active":"2024-09-10T23:25:12.868133+0000","last_became_peered":"2024-09-10T23:25:12.868133+0000","last_unstale":"2024-09-10T23:25:13.854459+0000","last_undegraded":"2024-09-10T23:25:13.854459+0000","last_fullsized":"2024-09-10T23:25:13.854459+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543987+0000","last_change":"2024-09-10T23:25:13.876765+0000","last_active":"2024-09-10T23:25:15.543987+0000","last_peered":"2024-09-10T23:25:15.543987+0000","last_clean":"2024-09-10T23:25:15.543987+0000","last_became_active":"2024-09-10T23:25:13.876265+0000","last_became_peered":"2024-09-10T23:25:13.876265+0000","last_unstale":"2024-09-10T23:25:15.543987+0000","last_undegraded":"2024-09-10T23:25:15.543987+0000","last_fullsized":"2024-09-10T23:25:15.543987+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"143'3","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168465+0000","last_change":"2024-09-10T23:25:12.866370+0000","last_active":"2024-09-10T23:25:15.168465+0000","last_peered":"2024-09-10T23:25:15.168465+0000","last_clean":"2024-09-10T23:25:15.168465+0000","last_became_active":"2024-09-10T23:25:12.866110+0000","last_became_peered":"2024-09-10T23:25:12.866110+0000","last_unstale":"2024-09-10T23:25:15.168465+0000","last_undegraded":"2024-09-10T23:25:15.168465+0000","last_fullsized":"2024-09-10T23:25:15.168465+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:16.892811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543795+0000","last_change":"2024-09-10T23:25:13.872367+0000","last_active":"2024-09-10T23:25:15.543795+0000","last_peered":"2024-09-10T23:25:15.543795+0000","last_clean":"2024-09-10T23:25:15.543795+0000","last_became_active":"2024-09-10T23:25:13.871439+0000","last_became_peered":"2024-09-10T23:25:13.871439+0000","last_unstale":"2024-09-10T23:25:15.543795+0000","last_undegraded":"2024-09-10T23:25:15.543795+0000","last_fullsized":"2024-09-10T23:25:15.543795+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"143'6","reported_seq":21,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168138+0000","last_change":"2024-09-10T23:25:12.863438+0000","last_active":"2024-09-10T23:25:15.168138+0000","last_peered":"2024-09-10T23:25:15.168138+0000","last_clean":"2024-09-10T23:25:15.168138+0000","last_became_active":"2024-09-10T23:25:12.863119+0000","last_became_peered":"2024-09-10T23:25:12.863119+0000","last_unstale":"2024-09-10T23:25:15.168138+0000","last_undegraded":"2024-09-10T23:25:15.168138+0000","last_fullsized":"2024-09-10T23:25:15.168138+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:04.730019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.866856+0000","last_change":"2024-09-10T23:25:13.863293+0000","last_active":"2024-09-10T23:25:13.866856+0000","last_peered":"2024-09-10T23:25:13.866856+0000","last_clean":"2024-09-10T23:25:13.866856+0000","last_became_active":"2024-09-10T23:25:13.861554+0000","last_became_peered":"2024-09-10T23:25:13.861554+0000","last_unstale":"2024-09-10T23:25:13.866856+0000","last_undegraded":"2024-09-10T23:25:13.866856+0000","last_fullsized":"2024-09-10T23:25:13.866856+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:05.775013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"143'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.883312+0000","last_change":"2024-09-10T23:25:12.870308+0000","last_active":"2024-09-10T23:25:13.883312+0000","last_peered":"2024-09-10T23:25:13.883312+0000","last_clean":"2024-09-10T23:25:13.883312+0000","last_became_active":"2024-09-10T23:25:12.870004+0000","last_became_peered":"2024-09-10T23:25:12.870004+0000","last_unstale":"2024-09-10T23:25:13.883312+0000","last_undegraded":"2024-09-10T23:25:13.883312+0000","last_fullsized":"2024-09-10T23:25:13.883312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:26.297677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168548+0000","last_change":"2024-09-10T23:25:13.879660+0000","last_active":"2024-09-10T23:25:15.168548+0000","last_peered":"2024-09-10T23:25:15.168548+0000","last_clean":"2024-09-10T23:25:15.168548+0000","last_became_active":"2024-09-10T23:25:13.876125+0000","last_became_peered":"2024-09-10T23:25:13.876125+0000","last_unstale":"2024-09-10T23:25:15.168548+0000","last_undegraded":"2024-09-10T23:25:15.168548+0000","last_fullsized":"2024-09-10T23:25:15.168548+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:13.803118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543208+0000","last_change":"2024-09-10T23:25:12.867167+0000","last_active":"2024-09-10T23:25:15.543208+0000","last_peered":"2024-09-10T23:25:15.543208+0000","last_clean":"2024-09-10T23:25:15.543208+0000","last_became_active":"2024-09-10T23:25:12.866906+0000","last_became_peered":"2024-09-10T23:25:12.866906+0000","last_unstale":"2024-09-10T23:25:15.543208+0000","last_undegraded":"2024-09-10T23:25:15.543208+0000","last_fullsized":"2024-09-10T23:25:15.543208+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:16.047610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.849112+0000","last_change":"2024-09-10T23:25:12.849112+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.849112+0000","last_undegraded":"2024-09-10T23:25:12.849112+0000","last_fullsized":"2024-09-10T23:25:12.849112+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"143'8","reported_seq":23,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849356+0000","last_change":"2024-09-10T23:25:12.860677+0000","last_active":"2024-09-10T23:25:14.849356+0000","last_peered":"2024-09-10T23:25:14.849356+0000","last_clean":"2024-09-10T23:25:14.849356+0000","last_became_active":"2024-09-10T23:25:12.860380+0000","last_became_peered":"2024-09-10T23:25:12.860380+0000","last_unstale":"2024-09-10T23:25:14.849356+0000","last_undegraded":"2024-09-10T23:25:14.849356+0000","last_fullsized":"2024-09-10T23:25:14.849356+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:06.604930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543016+0000","last_change":"2024-09-10T23:25:13.873862+0000","last_active":"2024-09-10T23:25:15.543016+0000","last_peered":"2024-09-10T23:25:15.543016+0000","last_clean":"2024-09-10T23:25:15.543016+0000","last_became_active":"2024-09-10T23:25:13.873313+0000","last_became_peered":"2024-09-10T23:25:13.873313+0000","last_unstale":"2024-09-10T23:25:15.543016+0000","last_undegraded":"2024-09-10T23:25:15.543016+0000","last_fullsized":"2024-09-10T23:25:15.543016+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:01.634211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"143'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.879076+0000","last_change":"2024-09-10T23:25:12.872714+0000","last_active":"2024-09-10T23:25:13.879076+0000","last_peered":"2024-09-10T23:25:13.879076+0000","last_clean":"2024-09-10T23:25:13.879076+0000","last_became_active":"2024-09-10T23:25:12.872395+0000","last_became_peered":"2024-09-10T23:25:12.872395+0000","last_unstale":"2024-09-10T23:25:13.879076+0000","last_undegraded":"2024-09-10T23:25:13.879076+0000","last_fullsized":"2024-09-10T23:25:13.879076+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:24.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168048+0000","last_change":"2024-09-10T23:25:13.883771+0000","last_active":"2024-09-10T23:25:15.168048+0000","last_peered":"2024-09-10T23:25:15.168048+0000","last_clean":"2024-09-10T23:25:15.168048+0000","last_became_active":"2024-09-10T23:25:13.883497+0000","last_became_peered":"2024-09-10T23:25:13.883497+0000","last_unstale":"2024-09-10T23:25:15.168048+0000","last_undegraded":"2024-09-10T23:25:15.168048+0000","last_fullsized":"2024-09-10T23:25:15.168048+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:09.361672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543952+0000","last_change":"2024-09-10T23:25:12.869708+0000","last_active":"2024-09-10T23:25:15.543952+0000","last_peered":"2024-09-10T23:25:15.543952+0000","last_clean":"2024-09-10T23:25:15.543952+0000","last_became_active":"2024-09-10T23:25:12.869271+0000","last_became_peered":"2024-09-10T23:25:12.869271+0000","last_unstale":"2024-09-10T23:25:15.543952+0000","last_undegraded":"2024-09-10T23:25:15.543952+0000","last_fullsized":"2024-09-10T23:25:15.543952+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:03.491852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168211+0000","last_change":"2024-09-10T23:25:13.872726+0000","last_active":"2024-09-10T23:25:15.168211+0000","last_peered":"2024-09-10T23:25:15.168211+0000","last_clean":"2024-09-10T23:25:15.168211+0000","last_became_active":"2024-09-10T23:25:13.872469+0000","last_became_peered":"2024-09-10T23:25:13.872469+0000","last_unstale":"2024-09-10T23:25:15.168211+0000","last_undegraded":"2024-09-10T23:25:15.168211+0000","last_fullsized":"2024-09-10T23:25:15.168211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:17.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849871+0000","last_change":"2024-09-10T23:25:12.858520+0000","last_active":"2024-09-10T23:25:14.849871+0000","last_peered":"2024-09-10T23:25:14.849871+0000","last_clean":"2024-09-10T23:25:14.849871+0000","last_became_active":"2024-09-10T23:25:12.858244+0000","last_became_peered":"2024-09-10T23:25:12.858244+0000","last_unstale":"2024-09-10T23:25:14.849871+0000","last_undegraded":"2024-09-10T23:25:14.849871+0000","last_fullsized":"2024-09-10T23:25:14.849871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:44.403969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.871379+0000","last_change":"2024-09-10T23:25:13.869640+0000","last_active":"2024-09-10T23:25:13.871379+0000","last_peered":"2024-09-10T23:25:13.871379+0000","last_clean":"2024-09-10T23:25:13.871379+0000","last_became_active":"2024-09-10T23:25:13.869369+0000","last_became_peered":"2024-09-10T23:25:13.869369+0000","last_unstale":"2024-09-10T23:25:13.871379+0000","last_undegraded":"2024-09-10T23:25:13.871379+0000","last_fullsized":"2024-09-10T23:25:13.871379+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.521443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-10T23:25:12.866885+0000","last_change":"2024-09-10T23:25:12.865263+0000","last_active":"2024-09-10T23:25:12.866885+0000","last_peered":"2024-09-10T23:25:12.866885+0000","last_clean":"2024-09-10T23:25:12.866885+0000","last_became_active":"2024-09-10T23:25:12.863466+0000","last_became_peered":"2024-09-10T23:25:12.863466+0000","last_unstale":"2024-09-10T23:25:12.866885+0000","last_undegraded":"2024-09-10T23:25:12.866885+0000","last_fullsized":"2024-09-10T23:25:12.866885+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:46.200173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.852705+0000","last_change":"2024-09-10T23:25:12.852705+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.852705+0000","last_undegraded":"2024-09-10T23:25:12.852705+0000","last_fullsized":"2024-09-10T23:25:12.852705+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854312+0000","last_change":"2024-09-10T23:25:12.867813+0000","last_active":"2024-09-10T23:25:14.854312+0000","last_peered":"2024-09-10T23:25:14.854312+0000","last_clean":"2024-09-10T23:25:14.854312+0000","last_became_active":"2024-09-10T23:25:12.867541+0000","last_became_peered":"2024-09-10T23:25:12.867541+0000","last_unstale":"2024-09-10T23:25:14.854312+0000","last_undegraded":"2024-09-10T23:25:14.854312+0000","last_fullsized":"2024-09-10T23:25:14.854312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.866595+0000","last_change":"2024-09-10T23:25:13.860966+0000","last_active":"2024-09-10T23:25:13.866595+0000","last_peered":"2024-09-10T23:25:13.866595+0000","last_clean":"2024-09-10T23:25:13.866595+0000","last_became_active":"2024-09-10T23:25:13.860080+0000","last_became_peered":"2024-09-10T23:25:13.860080+0000","last_unstale":"2024-09-10T23:25:13.866595+0000","last_undegraded":"2024-09-10T23:25:13.866595+0000","last_fullsized":"2024-09-10T23:25:13.866595+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:01.935345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.853652+0000","last_change":"2024-09-10T23:25:12.871815+0000","last_active":"2024-09-10T23:25:13.853652+0000","last_peered":"2024-09-10T23:25:13.853652+0000","last_clean":"2024-09-10T23:25:13.853652+0000","last_became_active":"2024-09-10T23:25:12.871500+0000","last_became_peered":"2024-09-10T23:25:12.871500+0000","last_unstale":"2024-09-10T23:25:13.853652+0000","last_undegraded":"2024-09-10T23:25:13.853652+0000","last_fullsized":"2024-09-10T23:25:13.853652+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:27.313249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.850306+0000","last_change":"2024-09-10T23:25:12.850306+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.850306+0000","last_undegraded":"2024-09-10T23:25:12.850306+0000","last_fullsized":"2024-09-10T23:25:12.850306+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:12.869257+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:12.868744+0000","last_became_peered":"2024-09-10T23:25:12.868744+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:10.106175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881361+0000","last_change":"2024-09-10T23:25:13.877129+0000","last_active":"2024-09-10T23:25:13.881361+0000","last_peered":"2024-09-10T23:25:13.881361+0000","last_clean":"2024-09-10T23:25:13.881361+0000","last_became_active":"2024-09-10T23:25:13.876849+0000","last_became_peered":"2024-09-10T23:25:13.876849+0000","last_unstale":"2024-09-10T23:25:13.881361+0000","last_undegraded":"2024-09-10T23:25:13.881361+0000","last_fullsized":"2024-09-10T23:25:13.881361+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:24.911994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849479+0000","last_change":"2024-09-10T23:25:12.869026+0000","last_active":"2024-09-10T23:25:14.849479+0000","last_peered":"2024-09-10T23:25:14.849479+0000","last_clean":"2024-09-10T23:25:14.849479+0000","last_became_active":"2024-09-10T23:25:12.868703+0000","last_became_peered":"2024-09-10T23:25:12.868703+0000","last_unstale":"2024-09-10T23:25:14.849479+0000","last_undegraded":"2024-09-10T23:25:14.849479+0000","last_fullsized":"2024-09-10T23:25:14.849479+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.849389+0000","last_change":"2024-09-10T23:25:12.849389+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.849389+0000","last_undegraded":"2024-09-10T23:25:12.849389+0000","last_fullsized":"2024-09-10T23:25:12.849389+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"143'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.888059+0000","last_change":"2024-09-10T23:25:12.867865+0000","last_active":"2024-09-10T23:25:13.888059+0000","last_peered":"2024-09-10T23:25:13.888059+0000","last_clean":"2024-09-10T23:25:13.888059+0000","last_became_active":"2024-09-10T23:25:12.867588+0000","last_became_peered":"2024-09-10T23:25:12.867588+0000","last_unstale":"2024-09-10T23:25:13.888059+0000","last_undegraded":"2024-09-10T23:25:13.888059+0000","last_fullsized":"2024-09-10T23:25:13.888059+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:34.917685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543230+0000","last_change":"2024-09-10T23:25:13.870979+0000","last_active":"2024-09-10T23:25:15.543230+0000","last_peered":"2024-09-10T23:25:15.543230+0000","last_clean":"2024-09-10T23:25:15.543230+0000","last_became_active":"2024-09-10T23:25:13.870036+0000","last_became_peered":"2024-09-10T23:25:13.870036+0000","last_unstale":"2024-09-10T23:25:15.543230+0000","last_undegraded":"2024-09-10T23:25:15.543230+0000","last_fullsized":"2024-09-10T23:25:15.543230+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:34.682442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854692+0000","last_change":"2024-09-10T23:25:12.873264+0000","last_active":"2024-09-10T23:25:14.854692+0000","last_peered":"2024-09-10T23:25:14.854692+0000","last_clean":"2024-09-10T23:25:14.854692+0000","last_became_active":"2024-09-10T23:25:12.872396+0000","last_became_peered":"2024-09-10T23:25:12.872396+0000","last_unstale":"2024-09-10T23:25:14.854692+0000","last_undegraded":"2024-09-10T23:25:14.854692+0000","last_fullsized":"2024-09-10T23:25:14.854692+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167852+0000","last_change":"2024-09-10T23:25:13.882067+0000","last_active":"2024-09-10T23:25:15.167852+0000","last_peered":"2024-09-10T23:25:15.167852+0000","last_clean":"2024-09-10T23:25:15.167852+0000","last_became_active":"2024-09-10T23:25:13.877949+0000","last_became_peered":"2024-09-10T23:25:13.877949+0000","last_unstale":"2024-09-10T23:25:15.167852+0000","last_undegraded":"2024-09-10T23:25:15.167852+0000","last_fullsized":"2024-09-10T23:25:15.167852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:50.603669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854542+0000","last_change":"2024-09-10T23:25:12.870970+0000","last_active":"2024-09-10T23:25:14.854542+0000","last_peered":"2024-09-10T23:25:14.854542+0000","last_clean":"2024-09-10T23:25:14.854542+0000","last_became_active":"2024-09-10T23:25:12.870538+0000","last_became_peered":"2024-09-10T23:25:12.870538+0000","last_unstale":"2024-09-10T23:25:14.854542+0000","last_undegraded":"2024-09-10T23:25:14.854542+0000","last_fullsized":"2024-09-10T23:25:14.854542+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.858411+0000","last_change":"2024-09-10T23:25:13.855869+0000","last_active":"2024-09-10T23:25:13.858411+0000","last_peered":"2024-09-10T23:25:13.858411+0000","last_clean":"2024-09-10T23:25:13.858411+0000","last_became_active":"2024-09-10T23:25:13.855567+0000","last_became_peered":"2024-09-10T23:25:13.855567+0000","last_unstale":"2024-09-10T23:25:13.858411+0000","last_undegraded":"2024-09-10T23:25:13.858411+0000","last_fullsized":"2024-09-10T23:25:13.858411+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:13.882085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849680+0000","last_change":"2024-09-10T23:25:12.868622+0000","last_active":"2024-09-10T23:25:14.849680+0000","last_peered":"2024-09-10T23:25:14.849680+0000","last_clean":"2024-09-10T23:25:14.849680+0000","last_became_active":"2024-09-10T23:25:12.868338+0000","last_became_peered":"2024-09-10T23:25:12.868338+0000","last_unstale":"2024-09-10T23:25:14.849680+0000","last_undegraded":"2024-09-10T23:25:14.849680+0000","last_fullsized":"2024-09-10T23:25:14.849680+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849579+0000","last_change":"2024-09-10T23:25:13.869075+0000","last_active":"2024-09-10T23:25:14.849579+0000","last_peered":"2024-09-10T23:25:14.849579+0000","last_clean":"2024-09-10T23:25:14.849579+0000","last_became_active":"2024-09-10T23:25:13.868451+0000","last_became_peered":"2024-09-10T23:25:13.868451+0000","last_unstale":"2024-09-10T23:25:14.849579+0000","last_undegraded":"2024-09-10T23:25:14.849579+0000","last_fullsized":"2024-09-10T23:25:14.849579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:47.345674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.859960+0000","last_change":"2024-09-10T23:25:12.872334+0000","last_active":"2024-09-10T23:25:13.859960+0000","last_peered":"2024-09-10T23:25:13.859960+0000","last_clean":"2024-09-10T23:25:13.859960+0000","last_became_active":"2024-09-10T23:25:12.871522+0000","last_became_peered":"2024-09-10T23:25:12.871522+0000","last_unstale":"2024-09-10T23:25:13.859960+0000","last_undegraded":"2024-09-10T23:25:13.859960+0000","last_fullsized":"2024-09-10T23:25:13.859960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:38.706629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849806+0000","last_change":"2024-09-10T23:25:13.869176+0000","last_active":"2024-09-10T23:25:14.849806+0000","last_peered":"2024-09-10T23:25:14.849806+0000","last_clean":"2024-09-10T23:25:14.849806+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:14.849806+0000","last_undegraded":"2024-09-10T23:25:14.849806+0000","last_fullsized":"2024-09-10T23:25:14.849806+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:11.171142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168230+0000","last_change":"2024-09-10T23:25:12.867607+0000","last_active":"2024-09-10T23:25:15.168230+0000","last_peered":"2024-09-10T23:25:15.168230+0000","last_clean":"2024-09-10T23:25:15.168230+0000","last_became_active":"2024-09-10T23:25:12.865003+0000","last_became_peered":"2024-09-10T23:25:12.865003+0000","last_unstale":"2024-09-10T23:25:15.168230+0000","last_undegraded":"2024-09-10T23:25:15.168230+0000","last_fullsized":"2024-09-10T23:25:15.168230+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:25.534423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849577+0000","last_change":"2024-09-10T23:25:13.877088+0000","last_active":"2024-09-10T23:25:14.849577+0000","last_peered":"2024-09-10T23:25:14.849577+0000","last_clean":"2024-09-10T23:25:14.849577+0000","last_became_active":"2024-09-10T23:25:13.876820+0000","last_became_peered":"2024-09-10T23:25:13.876820+0000","last_unstale":"2024-09-10T23:25:14.849577+0000","last_undegraded":"2024-09-10T23:25:14.849577+0000","last_fullsized":"2024-09-10T23:25:14.849577+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849440+0000","last_change":"2024-09-10T23:25:12.855796+0000","last_active":"2024-09-10T23:25:14.849440+0000","last_peered":"2024-09-10T23:25:14.849440+0000","last_clean":"2024-09-10T23:25:14.849440+0000","last_became_active":"2024-09-10T23:25:12.855449+0000","last_became_peered":"2024-09-10T23:25:12.855449+0000","last_unstale":"2024-09-10T23:25:14.849440+0000","last_undegraded":"2024-09-10T23:25:14.849440+0000","last_fullsized":"2024-09-10T23:25:14.849440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168525+0000","last_change":"2024-09-10T23:25:13.880032+0000","last_active":"2024-09-10T23:25:15.168525+0000","last_peered":"2024-09-10T23:25:15.168525+0000","last_clean":"2024-09-10T23:25:15.168525+0000","last_became_active":"2024-09-10T23:25:13.879777+0000","last_became_peered":"2024-09-10T23:25:13.879777+0000","last_unstale":"2024-09-10T23:25:15.168525+0000","last_undegraded":"2024-09-10T23:25:15.168525+0000","last_fullsized":"2024-09-10T23:25:15.168525+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:52.516915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-10T23:25:12.865750+0000","last_change":"2024-09-10T23:25:12.864319+0000","last_active":"2024-09-10T23:25:12.865750+0000","last_peered":"2024-09-10T23:25:12.865750+0000","last_clean":"2024-09-10T23:25:12.865750+0000","last_became_active":"2024-09-10T23:25:12.864040+0000","last_became_peered":"2024-09-10T23:25:12.864040+0000","last_unstale":"2024-09-10T23:25:12.865750+0000","last_undegraded":"2024-09-10T23:25:12.865750+0000","last_fullsized":"2024-09-10T23:25:12.865750+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:42.822581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543804+0000","last_change":"2024-09-10T23:25:13.873870+0000","last_active":"2024-09-10T23:25:15.543804+0000","last_peered":"2024-09-10T23:25:15.543804+0000","last_clean":"2024-09-10T23:25:15.543804+0000","last_became_active":"2024-09-10T23:25:13.873421+0000","last_became_peered":"2024-09-10T23:25:13.873421+0000","last_unstale":"2024-09-10T23:25:15.543804+0000","last_undegraded":"2024-09-10T23:25:15.543804+0000","last_fullsized":"2024-09-10T23:25:15.543804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167955+0000","last_change":"2024-09-10T23:25:12.867113+0000","last_active":"2024-09-10T23:25:15.167955+0000","last_peered":"2024-09-10T23:25:15.167955+0000","last_clean":"2024-09-10T23:25:15.167955+0000","last_became_active":"2024-09-10T23:25:12.866816+0000","last_became_peered":"2024-09-10T23:25:12.866816+0000","last_unstale":"2024-09-10T23:25:15.167955+0000","last_undegraded":"2024-09-10T23:25:15.167955+0000","last_fullsized":"2024-09-10T23:25:15.167955+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:40.361003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":329,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167673+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:25:15.167673+0000","last_peered":"2024-09-10T23:25:15.167673+0000","last_clean":"2024-09-10T23:25:15.167673+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:25:15.167673+0000","last_undegraded":"2024-09-10T23:25:15.167673+0000","last_fullsized":"2024-09-10T23:25:15.167673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46832,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325008,"statfs":{"total":96636764160,"available":96588808192,"internally_reserved":0,"allocated":1798144,"data_stored":841884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509562,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64048,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307792,"statfs":{"total":96636764160,"available":96571179008,"internally_reserved":0,"allocated":2387968,"data_stored":1426590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59300,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312540,"statfs":{"total":96636764160,"available":96576040960,"internally_reserved":0,"allocated":1781760,"data_stored":834542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64876,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306964,"statfs":{"total":96636764160,"available":96570331136,"internally_reserved":0,"allocated":1789952,"data_stored":841212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509561,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69040,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302800,"statfs":{"total":96636764160,"available":96566067200,"internally_reserved":0,"allocated":1785856,"data_stored":835136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509562,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55152,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316688,"statfs":{"total":96636764160,"available":96580288512,"internally_reserved":0,"allocated":1794048,"data_stored":841282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509561,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73768,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298072,"statfs":{"total":96636764160,"available":96561225728,"internally_reserved":0,"allocated":2379776,"data_stored":1424944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46792,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325048,"statfs":{"total":96636764160,"available":96588849152,"internally_reserved":0,"allocated":1753088,"data_stored":820694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:25:18.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:25:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 -- 172.21.15.17:0/903905076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e80d20c0 msgr2=0x7f46e8072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 --2- 172.21.15.17:0/903905076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e80d20c0 0x7f46e8072320 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009900 tx=0x7f46d401c7c0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 -- 172.21.15.17:0/903905076 shutdown_connections 2024-09-10T23:25:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 --2- 172.21.15.17:0/903905076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46e815bc70 0x7f46e80d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 --2- 172.21.15.17:0/903905076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e80d20c0 0x7f46e8072320 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 -- 172.21.15.17:0/903905076 >> 172.21.15.17:0/903905076 conn(0x7f46e809a9f0 msgr2=0x7f46e809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 -- 172.21.15.17:0/903905076 shutdown_connections 2024-09-10T23:25:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 -- 172.21.15.17:0/903905076 wait complete. 2024-09-10T23:25:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 Processor -- start 2024-09-10T23:25:18.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.194+0000 7f46ee800640 1 -- start start 2024-09-10T23:25:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ee800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46e80d20c0 0x7f46e8150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ee800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46e815b890 0x7f46e8165420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ee800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e815bc70 0x7f46e80cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ee800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46e8071f40 con 0x7f46e815bc70 2024-09-10T23:25:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ee800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46e8071dc0 con 0x7f46e80d20c0 2024-09-10T23:25:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ee800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46e81686f0 con 0x7f46e815b890 2024-09-10T23:25:18.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ede00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e815bc70 0x7f46e80cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ede00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e815bc70 0x7f46e80cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55896/0 (socket says 172.21.15.17:55896) 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ede00640 1 -- 172.21.15.17:0/1201561503 learned_addr learned my addr 172.21.15.17:0/1201561503 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ed400640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46e80d20c0 0x7f46e8150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46eca00640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46e815b890 0x7f46e8165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ede00640 1 -- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46e815b890 msgr2=0x7f46e8165420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ede00640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46e815b890 0x7f46e8165420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ede00640 1 -- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46e80d20c0 msgr2=0x7f46e8150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ede00640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46e80d20c0 0x7f46e8150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ede00640 1 -- 172.21.15.17:0/1201561503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e80cc9f0 con 0x7f46e815bc70 2024-09-10T23:25:18.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ede00640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e815bc70 0x7f46e80cda90 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f46e000cce0 tx=0x7f46e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46e5600640 1 -- 172.21.15.17:0/1201561503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e000f450 con 0x7f46e815bc70 2024-09-10T23:25:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46e5600640 1 -- 172.21.15.17:0/1201561503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46e000f6e0 con 0x7f46e815bc70 2024-09-10T23:25:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e80cccd0 con 0x7f46e815bc70 2024-09-10T23:25:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46e5600640 1 -- 172.21.15.17:0/1201561503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e000fb30 con 0x7f46e815bc70 2024-09-10T23:25:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e80cd290 con 0x7f46e815bc70 2024-09-10T23:25:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.198+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e8072320 con 0x7f46e815bc70 2024-09-10T23:25:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.202+0000 7f46e5600640 1 -- 172.21.15.17:0/1201561503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f46e000fcd0 con 0x7f46e815bc70 2024-09-10T23:25:18.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.202+0000 7f46e5600640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46c80725e0 0x7f46c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.202+0000 7f46e5600640 1 -- 172.21.15.17:0/1201561503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f46e0093ea0 con 0x7f46e815bc70 2024-09-10T23:25:18.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.202+0000 7f46ed400640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46c80725e0 0x7f46c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.202+0000 7f46ed400640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46c80725e0 0x7f46c8074aa0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f46e81581c0 tx=0x7f46dc007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.206+0000 7f46e5600640 1 -- 172.21.15.17:0/1201561503 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f46e0014030 con 0x7f46e815bc70 2024-09-10T23:25:18.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.378+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46e80d0280 con 0x7f46c80725e0 2024-09-10T23:25:18.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.382+0000 7f46e5600640 1 -- 172.21.15.17:0/1201561503 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251791 (secure 0 0 0) 0x7f46e80d0280 con 0x7f46c80725e0 2024-09-10T23:25:18.390 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:18.391 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:25:18.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46c80725e0 msgr2=0x7f46c8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46c80725e0 0x7f46c8074aa0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f46e81581c0 tx=0x7f46dc007e40 comp rx=0 tx=0).stop 2024-09-10T23:25:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e815bc70 msgr2=0x7f46e80cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e815bc70 0x7f46e80cda90 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f46e000cce0 tx=0x7f46e000a620 comp rx=0 tx=0).stop 2024-09-10T23:25:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 shutdown_connections 2024-09-10T23:25:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46c80725e0 0x7f46c8074aa0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46e815bc70 0x7f46e80cda90 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46e815b890 0x7f46e8165420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 --2- 172.21.15.17:0/1201561503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46e80d20c0 0x7f46e8150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 >> 172.21.15.17:0/1201561503 conn(0x7f46e809a9f0 msgr2=0x7f46e815df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 shutdown_connections 2024-09-10T23:25:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.386+0000 7f46ee800640 1 -- 172.21.15.17:0/1201561503 wait complete. 2024-09-10T23:25:18.412 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":434,"stamp":"2024-09-10T23:25:16.431796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":479808,"kb_used_data":15108,"kb_used_omap":12,"kb_used_meta":464499,"kb_avail":754494912,"statfs":{"total":773094113280,"available":772602789888,"internally_reserved":0,"allocated":15470592,"data_stored":7866284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":475647537},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.591527"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.870355+0000","last_change":"2024-09-10T23:25:13.865559+0000","last_active":"2024-09-10T23:25:13.870355+0000","last_peered":"2024-09-10T23:25:13.870355+0000","last_clean":"2024-09-10T23:25:13.870355+0000","last_became_active":"2024-09-10T23:25:13.865244+0000","last_became_peered":"2024-09-10T23:25:13.865244+0000","last_unstale":"2024-09-10T23:25:13.870355+0000","last_undegraded":"2024-09-10T23:25:13.870355+0000","last_fullsized":"2024-09-10T23:25:13.870355+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:07.293961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.874913+0000","last_change":"2024-09-10T23:25:13.869884+0000","last_active":"2024-09-10T23:25:13.874913+0000","last_peered":"2024-09-10T23:25:13.874913+0000","last_clean":"2024-09-10T23:25:13.874913+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:13.874913+0000","last_undegraded":"2024-09-10T23:25:13.874913+0000","last_fullsized":"2024-09-10T23:25:13.874913+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:07.467267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543691+0000","last_change":"2024-09-10T23:25:13.873797+0000","last_active":"2024-09-10T23:25:15.543691+0000","last_peered":"2024-09-10T23:25:15.543691+0000","last_clean":"2024-09-10T23:25:15.543691+0000","last_became_active":"2024-09-10T23:25:13.873417+0000","last_became_peered":"2024-09-10T23:25:13.873417+0000","last_unstale":"2024-09-10T23:25:15.543691+0000","last_undegraded":"2024-09-10T23:25:15.543691+0000","last_fullsized":"2024-09-10T23:25:15.543691+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.073999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.876094+0000","last_change":"2024-09-10T23:25:13.871941+0000","last_active":"2024-09-10T23:25:13.876094+0000","last_peered":"2024-09-10T23:25:13.876094+0000","last_clean":"2024-09-10T23:25:13.876094+0000","last_became_active":"2024-09-10T23:25:13.871660+0000","last_became_peered":"2024-09-10T23:25:13.871660+0000","last_unstale":"2024-09-10T23:25:13.876094+0000","last_undegraded":"2024-09-10T23:25:13.876094+0000","last_fullsized":"2024-09-10T23:25:13.876094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:22.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.849219+0000","last_change":"2024-09-10T23:25:12.849219+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.849219+0000","last_undegraded":"2024-09-10T23:25:12.849219+0000","last_fullsized":"2024-09-10T23:25:12.849219+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849317+0000","last_change":"2024-09-10T23:25:13.869860+0000","last_active":"2024-09-10T23:25:14.849317+0000","last_peered":"2024-09-10T23:25:14.849317+0000","last_clean":"2024-09-10T23:25:14.849317+0000","last_became_active":"2024-09-10T23:25:13.869577+0000","last_became_peered":"2024-09-10T23:25:13.869577+0000","last_unstale":"2024-09-10T23:25:14.849317+0000","last_undegraded":"2024-09-10T23:25:14.849317+0000","last_fullsized":"2024-09-10T23:25:14.849317+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:41.363760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167998+0000","last_change":"2024-09-10T23:25:13.882785+0000","last_active":"2024-09-10T23:25:15.167998+0000","last_peered":"2024-09-10T23:25:15.167998+0000","last_clean":"2024-09-10T23:25:15.167998+0000","last_became_active":"2024-09-10T23:25:13.877627+0000","last_became_peered":"2024-09-10T23:25:13.877627+0000","last_unstale":"2024-09-10T23:25:15.167998+0000","last_undegraded":"2024-09-10T23:25:15.167998+0000","last_fullsized":"2024-09-10T23:25:15.167998+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:44.875736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854072+0000","last_change":"2024-09-10T23:25:13.867473+0000","last_active":"2024-09-10T23:25:14.854072+0000","last_peered":"2024-09-10T23:25:14.854072+0000","last_clean":"2024-09-10T23:25:14.854072+0000","last_became_active":"2024-09-10T23:25:13.867208+0000","last_became_peered":"2024-09-10T23:25:13.867208+0000","last_unstale":"2024-09-10T23:25:14.854072+0000","last_undegraded":"2024-09-10T23:25:14.854072+0000","last_fullsized":"2024-09-10T23:25:14.854072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:19.792842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849974+0000","last_change":"2024-09-10T23:25:13.875490+0000","last_active":"2024-09-10T23:25:14.849974+0000","last_peered":"2024-09-10T23:25:14.849974+0000","last_clean":"2024-09-10T23:25:14.849974+0000","last_became_active":"2024-09-10T23:25:13.875205+0000","last_became_peered":"2024-09-10T23:25:13.875205+0000","last_unstale":"2024-09-10T23:25:14.849974+0000","last_undegraded":"2024-09-10T23:25:14.849974+0000","last_fullsized":"2024-09-10T23:25:14.849974+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:51.185099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.857080+0000","last_change":"2024-09-10T23:25:13.854593+0000","last_active":"2024-09-10T23:25:13.857080+0000","last_peered":"2024-09-10T23:25:13.857080+0000","last_clean":"2024-09-10T23:25:13.857080+0000","last_became_active":"2024-09-10T23:25:13.854336+0000","last_became_peered":"2024-09-10T23:25:13.854336+0000","last_unstale":"2024-09-10T23:25:13.857080+0000","last_undegraded":"2024-09-10T23:25:13.857080+0000","last_fullsized":"2024-09-10T23:25:13.857080+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.179524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881188+0000","last_change":"2024-09-10T23:25:13.876510+0000","last_active":"2024-09-10T23:25:13.881188+0000","last_peered":"2024-09-10T23:25:13.881188+0000","last_clean":"2024-09-10T23:25:13.881188+0000","last_became_active":"2024-09-10T23:25:13.876168+0000","last_became_peered":"2024-09-10T23:25:13.876168+0000","last_unstale":"2024-09-10T23:25:13.881188+0000","last_undegraded":"2024-09-10T23:25:13.881188+0000","last_fullsized":"2024-09-10T23:25:13.881188+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:22.257735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.872176+0000","last_change":"2024-09-10T23:25:13.866253+0000","last_active":"2024-09-10T23:25:13.872176+0000","last_peered":"2024-09-10T23:25:13.872176+0000","last_clean":"2024-09-10T23:25:13.872176+0000","last_became_active":"2024-09-10T23:25:13.865309+0000","last_became_peered":"2024-09-10T23:25:13.865309+0000","last_unstale":"2024-09-10T23:25:13.872176+0000","last_undegraded":"2024-09-10T23:25:13.872176+0000","last_fullsized":"2024-09-10T23:25:13.872176+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.331722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849866+0000","last_change":"2024-09-10T23:25:13.871849+0000","last_active":"2024-09-10T23:25:14.849866+0000","last_peered":"2024-09-10T23:25:14.849866+0000","last_clean":"2024-09-10T23:25:14.849866+0000","last_became_active":"2024-09-10T23:25:13.871410+0000","last_became_peered":"2024-09-10T23:25:13.871410+0000","last_unstale":"2024-09-10T23:25:14.849866+0000","last_undegraded":"2024-09-10T23:25:14.849866+0000","last_fullsized":"2024-09-10T23:25:14.849866+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:05.732775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875164+0000","last_change":"2024-09-10T23:25:13.871872+0000","last_active":"2024-09-10T23:25:13.875164+0000","last_peered":"2024-09-10T23:25:13.875164+0000","last_clean":"2024-09-10T23:25:13.875164+0000","last_became_active":"2024-09-10T23:25:13.871601+0000","last_became_peered":"2024-09-10T23:25:13.871601+0000","last_unstale":"2024-09-10T23:25:13.875164+0000","last_undegraded":"2024-09-10T23:25:13.875164+0000","last_fullsized":"2024-09-10T23:25:13.875164+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:31.846681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.868359+0000","last_change":"2024-09-10T23:25:13.861355+0000","last_active":"2024-09-10T23:25:13.868359+0000","last_peered":"2024-09-10T23:25:13.868359+0000","last_clean":"2024-09-10T23:25:13.868359+0000","last_became_active":"2024-09-10T23:25:13.860218+0000","last_became_peered":"2024-09-10T23:25:13.860218+0000","last_unstale":"2024-09-10T23:25:13.868359+0000","last_undegraded":"2024-09-10T23:25:13.868359+0000","last_fullsized":"2024-09-10T23:25:13.868359+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:30.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849485+0000","last_change":"2024-09-10T23:25:13.863772+0000","last_active":"2024-09-10T23:25:14.849485+0000","last_peered":"2024-09-10T23:25:14.849485+0000","last_clean":"2024-09-10T23:25:14.849485+0000","last_became_active":"2024-09-10T23:25:13.863386+0000","last_became_peered":"2024-09-10T23:25:13.863386+0000","last_unstale":"2024-09-10T23:25:14.849485+0000","last_undegraded":"2024-09-10T23:25:14.849485+0000","last_fullsized":"2024-09-10T23:25:14.849485+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849983+0000","last_change":"2024-09-10T23:25:13.864064+0000","last_active":"2024-09-10T23:25:14.849983+0000","last_peered":"2024-09-10T23:25:14.849983+0000","last_clean":"2024-09-10T23:25:14.849983+0000","last_became_active":"2024-09-10T23:25:13.863786+0000","last_became_peered":"2024-09-10T23:25:13.863786+0000","last_unstale":"2024-09-10T23:25:14.849983+0000","last_undegraded":"2024-09-10T23:25:14.849983+0000","last_fullsized":"2024-09-10T23:25:14.849983+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:32.141683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.851164+0000","last_change":"2024-09-10T23:25:12.851164+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.851164+0000","last_undegraded":"2024-09-10T23:25:12.851164+0000","last_fullsized":"2024-09-10T23:25:12.851164+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:13.875171+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:13.874560+0000","last_became_peered":"2024-09-10T23:25:13.874560+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:58.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.853187+0000","last_change":"2024-09-10T23:25:12.853187+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.853187+0000","last_undegraded":"2024-09-10T23:25:12.853187+0000","last_fullsized":"2024-09-10T23:25:12.853187+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875674+0000","last_change":"2024-09-10T23:25:13.871600+0000","last_active":"2024-09-10T23:25:13.875674+0000","last_peered":"2024-09-10T23:25:13.875674+0000","last_clean":"2024-09-10T23:25:13.875674+0000","last_became_active":"2024-09-10T23:25:13.871261+0000","last_became_peered":"2024-09-10T23:25:13.871261+0000","last_unstale":"2024-09-10T23:25:13.875674+0000","last_undegraded":"2024-09-10T23:25:13.875674+0000","last_fullsized":"2024-09-10T23:25:13.875674+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:33.139403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878388+0000","last_change":"2024-09-10T23:25:13.875260+0000","last_active":"2024-09-10T23:25:13.878388+0000","last_peered":"2024-09-10T23:25:13.878388+0000","last_clean":"2024-09-10T23:25:13.878388+0000","last_became_active":"2024-09-10T23:25:13.874961+0000","last_became_peered":"2024-09-10T23:25:13.874961+0000","last_unstale":"2024-09-10T23:25:13.878388+0000","last_undegraded":"2024-09-10T23:25:13.878388+0000","last_fullsized":"2024-09-10T23:25:13.878388+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:13.378132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881255+0000","last_change":"2024-09-10T23:25:13.878417+0000","last_active":"2024-09-10T23:25:13.881255+0000","last_peered":"2024-09-10T23:25:13.881255+0000","last_clean":"2024-09-10T23:25:13.881255+0000","last_became_active":"2024-09-10T23:25:13.878116+0000","last_became_peered":"2024-09-10T23:25:13.878116+0000","last_unstale":"2024-09-10T23:25:13.881255+0000","last_undegraded":"2024-09-10T23:25:13.881255+0000","last_fullsized":"2024-09-10T23:25:13.881255+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:16.040337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849229+0000","last_change":"2024-09-10T23:25:13.872929+0000","last_active":"2024-09-10T23:25:14.849229+0000","last_peered":"2024-09-10T23:25:14.849229+0000","last_clean":"2024-09-10T23:25:14.849229+0000","last_became_active":"2024-09-10T23:25:13.870728+0000","last_became_peered":"2024-09-10T23:25:13.870728+0000","last_unstale":"2024-09-10T23:25:14.849229+0000","last_undegraded":"2024-09-10T23:25:14.849229+0000","last_fullsized":"2024-09-10T23:25:14.849229+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544072+0000","last_change":"2024-09-10T23:25:13.876451+0000","last_active":"2024-09-10T23:25:15.544072+0000","last_peered":"2024-09-10T23:25:15.544072+0000","last_clean":"2024-09-10T23:25:15.544072+0000","last_became_active":"2024-09-10T23:25:13.876073+0000","last_became_peered":"2024-09-10T23:25:13.876073+0000","last_unstale":"2024-09-10T23:25:15.544072+0000","last_undegraded":"2024-09-10T23:25:15.544072+0000","last_fullsized":"2024-09-10T23:25:15.544072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544042+0000","last_change":"2024-09-10T23:25:13.881177+0000","last_active":"2024-09-10T23:25:15.544042+0000","last_peered":"2024-09-10T23:25:15.544042+0000","last_clean":"2024-09-10T23:25:15.544042+0000","last_became_active":"2024-09-10T23:25:13.880913+0000","last_became_peered":"2024-09-10T23:25:13.880913+0000","last_unstale":"2024-09-10T23:25:15.544042+0000","last_undegraded":"2024-09-10T23:25:15.544042+0000","last_fullsized":"2024-09-10T23:25:15.544042+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168384+0000","last_change":"2024-09-10T23:25:13.875429+0000","last_active":"2024-09-10T23:25:15.168384+0000","last_peered":"2024-09-10T23:25:15.168384+0000","last_clean":"2024-09-10T23:25:15.168384+0000","last_became_active":"2024-09-10T23:25:13.874893+0000","last_became_peered":"2024-09-10T23:25:13.874893+0000","last_unstale":"2024-09-10T23:25:15.168384+0000","last_undegraded":"2024-09-10T23:25:15.168384+0000","last_fullsized":"2024-09-10T23:25:15.168384+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:47.064911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.856715+0000","last_change":"2024-09-10T23:25:13.853437+0000","last_active":"2024-09-10T23:25:13.856715+0000","last_peered":"2024-09-10T23:25:13.856715+0000","last_clean":"2024-09-10T23:25:13.856715+0000","last_became_active":"2024-09-10T23:25:13.853158+0000","last_became_peered":"2024-09-10T23:25:13.853158+0000","last_unstale":"2024-09-10T23:25:13.856715+0000","last_undegraded":"2024-09-10T23:25:13.856715+0000","last_fullsized":"2024-09-10T23:25:13.856715+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:14.818230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543699+0000","last_change":"2024-09-10T23:25:13.878111+0000","last_active":"2024-09-10T23:25:15.543699+0000","last_peered":"2024-09-10T23:25:15.543699+0000","last_clean":"2024-09-10T23:25:15.543699+0000","last_became_active":"2024-09-10T23:25:13.877815+0000","last_became_peered":"2024-09-10T23:25:13.877815+0000","last_unstale":"2024-09-10T23:25:15.543699+0000","last_undegraded":"2024-09-10T23:25:15.543699+0000","last_fullsized":"2024-09-10T23:25:15.543699+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:33.139403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543716+0000","last_change":"2024-09-10T23:25:13.878758+0000","last_active":"2024-09-10T23:25:15.543716+0000","last_peered":"2024-09-10T23:25:15.543716+0000","last_clean":"2024-09-10T23:25:15.543716+0000","last_became_active":"2024-09-10T23:25:13.878493+0000","last_became_peered":"2024-09-10T23:25:13.878493+0000","last_unstale":"2024-09-10T23:25:15.543716+0000","last_undegraded":"2024-09-10T23:25:15.543716+0000","last_fullsized":"2024-09-10T23:25:15.543716+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:27.113577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854060+0000","last_change":"2024-09-10T23:25:13.869209+0000","last_active":"2024-09-10T23:25:14.854060+0000","last_peered":"2024-09-10T23:25:14.854060+0000","last_clean":"2024-09-10T23:25:14.854060+0000","last_became_active":"2024-09-10T23:25:13.868965+0000","last_became_peered":"2024-09-10T23:25:13.868965+0000","last_unstale":"2024-09-10T23:25:14.854060+0000","last_undegraded":"2024-09-10T23:25:14.854060+0000","last_fullsized":"2024-09-10T23:25:14.854060+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:59.422431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875736+0000","last_change":"2024-09-10T23:25:13.875122+0000","last_active":"2024-09-10T23:25:13.875736+0000","last_peered":"2024-09-10T23:25:13.875736+0000","last_clean":"2024-09-10T23:25:13.875736+0000","last_became_active":"2024-09-10T23:25:13.874015+0000","last_became_peered":"2024-09-10T23:25:13.874015+0000","last_unstale":"2024-09-10T23:25:13.875736+0000","last_undegraded":"2024-09-10T23:25:13.875736+0000","last_fullsized":"2024-09-10T23:25:13.875736+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:05.311293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854201+0000","last_change":"2024-09-10T23:25:13.869068+0000","last_active":"2024-09-10T23:25:14.854201+0000","last_peered":"2024-09-10T23:25:14.854201+0000","last_clean":"2024-09-10T23:25:14.854201+0000","last_became_active":"2024-09-10T23:25:13.865220+0000","last_became_peered":"2024-09-10T23:25:13.865220+0000","last_unstale":"2024-09-10T23:25:14.854201+0000","last_undegraded":"2024-09-10T23:25:14.854201+0000","last_fullsized":"2024-09-10T23:25:14.854201+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:25.648301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"143'4","reported_seq":19,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543988+0000","last_change":"2024-09-10T23:25:12.873694+0000","last_active":"2024-09-10T23:25:15.543988+0000","last_peered":"2024-09-10T23:25:15.543988+0000","last_clean":"2024-09-10T23:25:15.543988+0000","last_became_active":"2024-09-10T23:25:12.871488+0000","last_became_peered":"2024-09-10T23:25:12.871488+0000","last_unstale":"2024-09-10T23:25:15.543988+0000","last_undegraded":"2024-09-10T23:25:15.543988+0000","last_fullsized":"2024-09-10T23:25:15.543988+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:17.859612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.873431+0000","last_change":"2024-09-10T23:25:13.869377+0000","last_active":"2024-09-10T23:25:13.873431+0000","last_peered":"2024-09-10T23:25:13.873431+0000","last_clean":"2024-09-10T23:25:13.873431+0000","last_became_active":"2024-09-10T23:25:13.869123+0000","last_became_peered":"2024-09-10T23:25:13.869123+0000","last_unstale":"2024-09-10T23:25:13.873431+0000","last_undegraded":"2024-09-10T23:25:13.873431+0000","last_fullsized":"2024-09-10T23:25:13.873431+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:24.587347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-10T23:25:12.865601+0000","last_change":"2024-09-10T23:25:12.864352+0000","last_active":"2024-09-10T23:25:12.865601+0000","last_peered":"2024-09-10T23:25:12.865601+0000","last_clean":"2024-09-10T23:25:12.865601+0000","last_became_active":"2024-09-10T23:25:12.864097+0000","last_became_peered":"2024-09-10T23:25:12.864097+0000","last_unstale":"2024-09-10T23:25:12.865601+0000","last_undegraded":"2024-09-10T23:25:12.865601+0000","last_fullsized":"2024-09-10T23:25:12.865601+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:08.918560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881249+0000","last_change":"2024-09-10T23:25:13.876002+0000","last_active":"2024-09-10T23:25:13.881249+0000","last_peered":"2024-09-10T23:25:13.881249+0000","last_clean":"2024-09-10T23:25:13.881249+0000","last_became_active":"2024-09-10T23:25:13.875699+0000","last_became_peered":"2024-09-10T23:25:13.875699+0000","last_unstale":"2024-09-10T23:25:13.881249+0000","last_undegraded":"2024-09-10T23:25:13.881249+0000","last_fullsized":"2024-09-10T23:25:13.881249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168318+0000","last_change":"2024-09-10T23:25:12.869556+0000","last_active":"2024-09-10T23:25:15.168318+0000","last_peered":"2024-09-10T23:25:15.168318+0000","last_clean":"2024-09-10T23:25:15.168318+0000","last_became_active":"2024-09-10T23:25:12.869278+0000","last_became_peered":"2024-09-10T23:25:12.869278+0000","last_unstale":"2024-09-10T23:25:15.168318+0000","last_undegraded":"2024-09-10T23:25:15.168318+0000","last_fullsized":"2024-09-10T23:25:15.168318+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:56.479420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878651+0000","last_change":"2024-09-10T23:25:13.872607+0000","last_active":"2024-09-10T23:25:13.878651+0000","last_peered":"2024-09-10T23:25:13.878651+0000","last_clean":"2024-09-10T23:25:13.878651+0000","last_became_active":"2024-09-10T23:25:13.872280+0000","last_became_peered":"2024-09-10T23:25:13.872280+0000","last_unstale":"2024-09-10T23:25:13.878651+0000","last_undegraded":"2024-09-10T23:25:13.878651+0000","last_fullsized":"2024-09-10T23:25:13.878651+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:57.011115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168214+0000","last_change":"2024-09-10T23:25:12.865957+0000","last_active":"2024-09-10T23:25:15.168214+0000","last_peered":"2024-09-10T23:25:15.168214+0000","last_clean":"2024-09-10T23:25:15.168214+0000","last_became_active":"2024-09-10T23:25:12.865662+0000","last_became_peered":"2024-09-10T23:25:12.865662+0000","last_unstale":"2024-09-10T23:25:15.168214+0000","last_undegraded":"2024-09-10T23:25:15.168214+0000","last_fullsized":"2024-09-10T23:25:15.168214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:10.168386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854351+0000","last_change":"2024-09-10T23:25:13.868440+0000","last_active":"2024-09-10T23:25:14.854351+0000","last_peered":"2024-09-10T23:25:14.854351+0000","last_clean":"2024-09-10T23:25:14.854351+0000","last_became_active":"2024-09-10T23:25:13.868181+0000","last_became_peered":"2024-09-10T23:25:13.868181+0000","last_unstale":"2024-09-10T23:25:14.854351+0000","last_undegraded":"2024-09-10T23:25:14.854351+0000","last_fullsized":"2024-09-10T23:25:14.854351+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:05.848015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854302+0000","last_change":"2024-09-10T23:25:12.874108+0000","last_active":"2024-09-10T23:25:14.854302+0000","last_peered":"2024-09-10T23:25:14.854302+0000","last_clean":"2024-09-10T23:25:14.854302+0000","last_became_active":"2024-09-10T23:25:12.872828+0000","last_became_peered":"2024-09-10T23:25:12.872828+0000","last_unstale":"2024-09-10T23:25:14.854302+0000","last_undegraded":"2024-09-10T23:25:14.854302+0000","last_fullsized":"2024-09-10T23:25:14.854302+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854662+0000","last_change":"2024-09-10T23:25:13.861557+0000","last_active":"2024-09-10T23:25:14.854662+0000","last_peered":"2024-09-10T23:25:14.854662+0000","last_clean":"2024-09-10T23:25:14.854662+0000","last_became_active":"2024-09-10T23:25:13.861288+0000","last_became_peered":"2024-09-10T23:25:13.861288+0000","last_unstale":"2024-09-10T23:25:14.854662+0000","last_undegraded":"2024-09-10T23:25:14.854662+0000","last_fullsized":"2024-09-10T23:25:14.854662+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:07.467267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-10T23:25:12.865626+0000","last_change":"2024-09-10T23:25:12.861726+0000","last_active":"2024-09-10T23:25:12.865626+0000","last_peered":"2024-09-10T23:25:12.865626+0000","last_clean":"2024-09-10T23:25:12.865626+0000","last_became_active":"2024-09-10T23:25:12.861433+0000","last_became_peered":"2024-09-10T23:25:12.861433+0000","last_unstale":"2024-09-10T23:25:12.865626+0000","last_undegraded":"2024-09-10T23:25:12.865626+0000","last_fullsized":"2024-09-10T23:25:12.865626+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:27.649038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.850758+0000","last_change":"2024-09-10T23:25:12.850758+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.850758+0000","last_undegraded":"2024-09-10T23:25:12.850758+0000","last_fullsized":"2024-09-10T23:25:12.850758+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849066+0000","last_change":"2024-09-10T23:25:12.857750+0000","last_active":"2024-09-10T23:25:14.849066+0000","last_peered":"2024-09-10T23:25:14.849066+0000","last_clean":"2024-09-10T23:25:14.849066+0000","last_became_active":"2024-09-10T23:25:12.857460+0000","last_became_peered":"2024-09-10T23:25:12.857460+0000","last_unstale":"2024-09-10T23:25:14.849066+0000","last_undegraded":"2024-09-10T23:25:14.849066+0000","last_fullsized":"2024-09-10T23:25:14.849066+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168579+0000","last_change":"2024-09-10T23:25:13.880336+0000","last_active":"2024-09-10T23:25:15.168579+0000","last_peered":"2024-09-10T23:25:15.168579+0000","last_clean":"2024-09-10T23:25:15.168579+0000","last_became_active":"2024-09-10T23:25:13.877088+0000","last_became_peered":"2024-09-10T23:25:13.877088+0000","last_unstale":"2024-09-10T23:25:15.168579+0000","last_undegraded":"2024-09-10T23:25:15.168579+0000","last_fullsized":"2024-09-10T23:25:15.168579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:30.634846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543073+0000","last_change":"2024-09-10T23:25:12.872243+0000","last_active":"2024-09-10T23:25:15.543073+0000","last_peered":"2024-09-10T23:25:15.543073+0000","last_clean":"2024-09-10T23:25:15.543073+0000","last_became_active":"2024-09-10T23:25:12.870719+0000","last_became_peered":"2024-09-10T23:25:12.870719+0000","last_unstale":"2024-09-10T23:25:15.543073+0000","last_undegraded":"2024-09-10T23:25:15.543073+0000","last_fullsized":"2024-09-10T23:25:15.543073+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:44.618611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878550+0000","last_change":"2024-09-10T23:25:13.874102+0000","last_active":"2024-09-10T23:25:13.878550+0000","last_peered":"2024-09-10T23:25:13.878550+0000","last_clean":"2024-09-10T23:25:13.878550+0000","last_became_active":"2024-09-10T23:25:13.873768+0000","last_became_peered":"2024-09-10T23:25:13.873768+0000","last_unstale":"2024-09-10T23:25:13.878550+0000","last_undegraded":"2024-09-10T23:25:13.878550+0000","last_fullsized":"2024-09-10T23:25:13.878550+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:37.211577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.864004+0000","last_change":"2024-09-10T23:25:12.867851+0000","last_active":"2024-09-10T23:25:13.864004+0000","last_peered":"2024-09-10T23:25:13.864004+0000","last_clean":"2024-09-10T23:25:13.864004+0000","last_became_active":"2024-09-10T23:25:12.867574+0000","last_became_peered":"2024-09-10T23:25:12.867574+0000","last_unstale":"2024-09-10T23:25:13.864004+0000","last_undegraded":"2024-09-10T23:25:13.864004+0000","last_fullsized":"2024-09-10T23:25:13.864004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:04.845258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849337+0000","last_change":"2024-09-10T23:25:13.863808+0000","last_active":"2024-09-10T23:25:14.849337+0000","last_peered":"2024-09-10T23:25:14.849337+0000","last_clean":"2024-09-10T23:25:14.849337+0000","last_became_active":"2024-09-10T23:25:13.863523+0000","last_became_peered":"2024-09-10T23:25:13.863523+0000","last_unstale":"2024-09-10T23:25:14.849337+0000","last_undegraded":"2024-09-10T23:25:14.849337+0000","last_fullsized":"2024-09-10T23:25:14.849337+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.854459+0000","last_change":"2024-09-10T23:25:12.870251+0000","last_active":"2024-09-10T23:25:13.854459+0000","last_peered":"2024-09-10T23:25:13.854459+0000","last_clean":"2024-09-10T23:25:13.854459+0000","last_became_active":"2024-09-10T23:25:12.868133+0000","last_became_peered":"2024-09-10T23:25:12.868133+0000","last_unstale":"2024-09-10T23:25:13.854459+0000","last_undegraded":"2024-09-10T23:25:13.854459+0000","last_fullsized":"2024-09-10T23:25:13.854459+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543987+0000","last_change":"2024-09-10T23:25:13.876765+0000","last_active":"2024-09-10T23:25:15.543987+0000","last_peered":"2024-09-10T23:25:15.543987+0000","last_clean":"2024-09-10T23:25:15.543987+0000","last_became_active":"2024-09-10T23:25:13.876265+0000","last_became_peered":"2024-09-10T23:25:13.876265+0000","last_unstale":"2024-09-10T23:25:15.543987+0000","last_undegraded":"2024-09-10T23:25:15.543987+0000","last_fullsized":"2024-09-10T23:25:15.543987+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"143'3","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168465+0000","last_change":"2024-09-10T23:25:12.866370+0000","last_active":"2024-09-10T23:25:15.168465+0000","last_peered":"2024-09-10T23:25:15.168465+0000","last_clean":"2024-09-10T23:25:15.168465+0000","last_became_active":"2024-09-10T23:25:12.866110+0000","last_became_peered":"2024-09-10T23:25:12.866110+0000","last_unstale":"2024-09-10T23:25:15.168465+0000","last_undegraded":"2024-09-10T23:25:15.168465+0000","last_fullsized":"2024-09-10T23:25:15.168465+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:16.892811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543795+0000","last_change":"2024-09-10T23:25:13.872367+0000","last_active":"2024-09-10T23:25:15.543795+0000","last_peered":"2024-09-10T23:25:15.543795+0000","last_clean":"2024-09-10T23:25:15.543795+0000","last_became_active":"2024-09-10T23:25:13.871439+0000","last_became_peered":"2024-09-10T23:25:13.871439+0000","last_unstale":"2024-09-10T23:25:15.543795+0000","last_undegraded":"2024-09-10T23:25:15.543795+0000","last_fullsized":"2024-09-10T23:25:15.543795+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"143'6","reported_seq":21,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168138+0000","last_change":"2024-09-10T23:25:12.863438+0000","last_active":"2024-09-10T23:25:15.168138+0000","last_peered":"2024-09-10T23:25:15.168138+0000","last_clean":"2024-09-10T23:25:15.168138+0000","last_became_active":"2024-09-10T23:25:12.863119+0000","last_became_peered":"2024-09-10T23:25:12.863119+0000","last_unstale":"2024-09-10T23:25:15.168138+0000","last_undegraded":"2024-09-10T23:25:15.168138+0000","last_fullsized":"2024-09-10T23:25:15.168138+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:04.730019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.866856+0000","last_change":"2024-09-10T23:25:13.863293+0000","last_active":"2024-09-10T23:25:13.866856+0000","last_peered":"2024-09-10T23:25:13.866856+0000","last_clean":"2024-09-10T23:25:13.866856+0000","last_became_active":"2024-09-10T23:25:13.861554+0000","last_became_peered":"2024-09-10T23:25:13.861554+0000","last_unstale":"2024-09-10T23:25:13.866856+0000","last_undegraded":"2024-09-10T23:25:13.866856+0000","last_fullsized":"2024-09-10T23:25:13.866856+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:05.775013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"143'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.883312+0000","last_change":"2024-09-10T23:25:12.870308+0000","last_active":"2024-09-10T23:25:13.883312+0000","last_peered":"2024-09-10T23:25:13.883312+0000","last_clean":"2024-09-10T23:25:13.883312+0000","last_became_active":"2024-09-10T23:25:12.870004+0000","last_became_peered":"2024-09-10T23:25:12.870004+0000","last_unstale":"2024-09-10T23:25:13.883312+0000","last_undegraded":"2024-09-10T23:25:13.883312+0000","last_fullsized":"2024-09-10T23:25:13.883312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:26.297677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168548+0000","last_change":"2024-09-10T23:25:13.879660+0000","last_active":"2024-09-10T23:25:15.168548+0000","last_peered":"2024-09-10T23:25:15.168548+0000","last_clean":"2024-09-10T23:25:15.168548+0000","last_became_active":"2024-09-10T23:25:13.876125+0000","last_became_peered":"2024-09-10T23:25:13.876125+0000","last_unstale":"2024-09-10T23:25:15.168548+0000","last_undegraded":"2024-09-10T23:25:15.168548+0000","last_fullsized":"2024-09-10T23:25:15.168548+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:13.803118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543208+0000","last_change":"2024-09-10T23:25:12.867167+0000","last_active":"2024-09-10T23:25:15.543208+0000","last_peered":"2024-09-10T23:25:15.543208+0000","last_clean":"2024-09-10T23:25:15.543208+0000","last_became_active":"2024-09-10T23:25:12.866906+0000","last_became_peered":"2024-09-10T23:25:12.866906+0000","last_unstale":"2024-09-10T23:25:15.543208+0000","last_undegraded":"2024-09-10T23:25:15.543208+0000","last_fullsized":"2024-09-10T23:25:15.543208+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:16.047610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.849112+0000","last_change":"2024-09-10T23:25:12.849112+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.849112+0000","last_undegraded":"2024-09-10T23:25:12.849112+0000","last_fullsized":"2024-09-10T23:25:12.849112+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"143'8","reported_seq":23,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849356+0000","last_change":"2024-09-10T23:25:12.860677+0000","last_active":"2024-09-10T23:25:14.849356+0000","last_peered":"2024-09-10T23:25:14.849356+0000","last_clean":"2024-09-10T23:25:14.849356+0000","last_became_active":"2024-09-10T23:25:12.860380+0000","last_became_peered":"2024-09-10T23:25:12.860380+0000","last_unstale":"2024-09-10T23:25:14.849356+0000","last_undegraded":"2024-09-10T23:25:14.849356+0000","last_fullsized":"2024-09-10T23:25:14.849356+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:06.604930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543016+0000","last_change":"2024-09-10T23:25:13.873862+0000","last_active":"2024-09-10T23:25:15.543016+0000","last_peered":"2024-09-10T23:25:15.543016+0000","last_clean":"2024-09-10T23:25:15.543016+0000","last_became_active":"2024-09-10T23:25:13.873313+0000","last_became_peered":"2024-09-10T23:25:13.873313+0000","last_unstale":"2024-09-10T23:25:15.543016+0000","last_undegraded":"2024-09-10T23:25:15.543016+0000","last_fullsized":"2024-09-10T23:25:15.543016+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:01.634211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"143'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.879076+0000","last_change":"2024-09-10T23:25:12.872714+0000","last_active":"2024-09-10T23:25:13.879076+0000","last_peered":"2024-09-10T23:25:13.879076+0000","last_clean":"2024-09-10T23:25:13.879076+0000","last_became_active":"2024-09-10T23:25:12.872395+0000","last_became_peered":"2024-09-10T23:25:12.872395+0000","last_unstale":"2024-09-10T23:25:13.879076+0000","last_undegraded":"2024-09-10T23:25:13.879076+0000","last_fullsized":"2024-09-10T23:25:13.879076+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:24.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168048+0000","last_change":"2024-09-10T23:25:13.883771+0000","last_active":"2024-09-10T23:25:15.168048+0000","last_peered":"2024-09-10T23:25:15.168048+0000","last_clean":"2024-09-10T23:25:15.168048+0000","last_became_active":"2024-09-10T23:25:13.883497+0000","last_became_peered":"2024-09-10T23:25:13.883497+0000","last_unstale":"2024-09-10T23:25:15.168048+0000","last_undegraded":"2024-09-10T23:25:15.168048+0000","last_fullsized":"2024-09-10T23:25:15.168048+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:09.361672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543952+0000","last_change":"2024-09-10T23:25:12.869708+0000","last_active":"2024-09-10T23:25:15.543952+0000","last_peered":"2024-09-10T23:25:15.543952+0000","last_clean":"2024-09-10T23:25:15.543952+0000","last_became_active":"2024-09-10T23:25:12.869271+0000","last_became_peered":"2024-09-10T23:25:12.869271+0000","last_unstale":"2024-09-10T23:25:15.543952+0000","last_undegraded":"2024-09-10T23:25:15.543952+0000","last_fullsized":"2024-09-10T23:25:15.543952+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:03.491852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168211+0000","last_change":"2024-09-10T23:25:13.872726+0000","last_active":"2024-09-10T23:25:15.168211+0000","last_peered":"2024-09-10T23:25:15.168211+0000","last_clean":"2024-09-10T23:25:15.168211+0000","last_became_active":"2024-09-10T23:25:13.872469+0000","last_became_peered":"2024-09-10T23:25:13.872469+0000","last_unstale":"2024-09-10T23:25:15.168211+0000","last_undegraded":"2024-09-10T23:25:15.168211+0000","last_fullsized":"2024-09-10T23:25:15.168211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:17.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849871+0000","last_change":"2024-09-10T23:25:12.858520+0000","last_active":"2024-09-10T23:25:14.849871+0000","last_peered":"2024-09-10T23:25:14.849871+0000","last_clean":"2024-09-10T23:25:14.849871+0000","last_became_active":"2024-09-10T23:25:12.858244+0000","last_became_peered":"2024-09-10T23:25:12.858244+0000","last_unstale":"2024-09-10T23:25:14.849871+0000","last_undegraded":"2024-09-10T23:25:14.849871+0000","last_fullsized":"2024-09-10T23:25:14.849871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:44.403969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.871379+0000","last_change":"2024-09-10T23:25:13.869640+0000","last_active":"2024-09-10T23:25:13.871379+0000","last_peered":"2024-09-10T23:25:13.871379+0000","last_clean":"2024-09-10T23:25:13.871379+0000","last_became_active":"2024-09-10T23:25:13.869369+0000","last_became_peered":"2024-09-10T23:25:13.869369+0000","last_unstale":"2024-09-10T23:25:13.871379+0000","last_undegraded":"2024-09-10T23:25:13.871379+0000","last_fullsized":"2024-09-10T23:25:13.871379+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.521443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-10T23:25:12.866885+0000","last_change":"2024-09-10T23:25:12.865263+0000","last_active":"2024-09-10T23:25:12.866885+0000","last_peered":"2024-09-10T23:25:12.866885+0000","last_clean":"2024-09-10T23:25:12.866885+0000","last_became_active":"2024-09-10T23:25:12.863466+0000","last_became_peered":"2024-09-10T23:25:12.863466+0000","last_unstale":"2024-09-10T23:25:12.866885+0000","last_undegraded":"2024-09-10T23:25:12.866885+0000","last_fullsized":"2024-09-10T23:25:12.866885+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:46.200173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.852705+0000","last_change":"2024-09-10T23:25:12.852705+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.852705+0000","last_undegraded":"2024-09-10T23:25:12.852705+0000","last_fullsized":"2024-09-10T23:25:12.852705+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854312+0000","last_change":"2024-09-10T23:25:12.867813+0000","last_active":"2024-09-10T23:25:14.854312+0000","last_peered":"2024-09-10T23:25:14.854312+0000","last_clean":"2024-09-10T23:25:14.854312+0000","last_became_active":"2024-09-10T23:25:12.867541+0000","last_became_peered":"2024-09-10T23:25:12.867541+0000","last_unstale":"2024-09-10T23:25:14.854312+0000","last_undegraded":"2024-09-10T23:25:14.854312+0000","last_fullsized":"2024-09-10T23:25:14.854312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.866595+0000","last_change":"2024-09-10T23:25:13.860966+0000","last_active":"2024-09-10T23:25:13.866595+0000","last_peered":"2024-09-10T23:25:13.866595+0000","last_clean":"2024-09-10T23:25:13.866595+0000","last_became_active":"2024-09-10T23:25:13.860080+0000","last_became_peered":"2024-09-10T23:25:13.860080+0000","last_unstale":"2024-09-10T23:25:13.866595+0000","last_undegraded":"2024-09-10T23:25:13.866595+0000","last_fullsized":"2024-09-10T23:25:13.866595+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:01.935345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.853652+0000","last_change":"2024-09-10T23:25:12.871815+0000","last_active":"2024-09-10T23:25:13.853652+0000","last_peered":"2024-09-10T23:25:13.853652+0000","last_clean":"2024-09-10T23:25:13.853652+0000","last_became_active":"2024-09-10T23:25:12.871500+0000","last_became_peered":"2024-09-10T23:25:12.871500+0000","last_unstale":"2024-09-10T23:25:13.853652+0000","last_undegraded":"2024-09-10T23:25:13.853652+0000","last_fullsized":"2024-09-10T23:25:13.853652+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:27.313249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.850306+0000","last_change":"2024-09-10T23:25:12.850306+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.850306+0000","last_undegraded":"2024-09-10T23:25:12.850306+0000","last_fullsized":"2024-09-10T23:25:12.850306+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:12.869257+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:12.868744+0000","last_became_peered":"2024-09-10T23:25:12.868744+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:10.106175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881361+0000","last_change":"2024-09-10T23:25:13.877129+0000","last_active":"2024-09-10T23:25:13.881361+0000","last_peered":"2024-09-10T23:25:13.881361+0000","last_clean":"2024-09-10T23:25:13.881361+0000","last_became_active":"2024-09-10T23:25:13.876849+0000","last_became_peered":"2024-09-10T23:25:13.876849+0000","last_unstale":"2024-09-10T23:25:13.881361+0000","last_undegraded":"2024-09-10T23:25:13.881361+0000","last_fullsized":"2024-09-10T23:25:13.881361+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:24.911994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849479+0000","last_change":"2024-09-10T23:25:12.869026+0000","last_active":"2024-09-10T23:25:14.849479+0000","last_peered":"2024-09-10T23:25:14.849479+0000","last_clean":"2024-09-10T23:25:14.849479+0000","last_became_active":"2024-09-10T23:25:12.868703+0000","last_became_peered":"2024-09-10T23:25:12.868703+0000","last_unstale":"2024-09-10T23:25:14.849479+0000","last_undegraded":"2024-09-10T23:25:14.849479+0000","last_fullsized":"2024-09-10T23:25:14.849479+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2024-09-10T23:25:12.849389+0000","last_change":"2024-09-10T23:25:12.849389+0000","last_active":"2024-09-10T23:25:12.836543+0000","last_peered":"2024-09-10T23:25:12.836543+0000","last_clean":"2024-09-10T23:25:12.836543+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:25:12.849389+0000","last_undegraded":"2024-09-10T23:25:12.849389+0000","last_fullsized":"2024-09-10T23:25:12.849389+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"143'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.888059+0000","last_change":"2024-09-10T23:25:12.867865+0000","last_active":"2024-09-10T23:25:13.888059+0000","last_peered":"2024-09-10T23:25:13.888059+0000","last_clean":"2024-09-10T23:25:13.888059+0000","last_became_active":"2024-09-10T23:25:12.867588+0000","last_became_peered":"2024-09-10T23:25:12.867588+0000","last_unstale":"2024-09-10T23:25:13.888059+0000","last_undegraded":"2024-09-10T23:25:13.888059+0000","last_fullsized":"2024-09-10T23:25:13.888059+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:34.917685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543230+0000","last_change":"2024-09-10T23:25:13.870979+0000","last_active":"2024-09-10T23:25:15.543230+0000","last_peered":"2024-09-10T23:25:15.543230+0000","last_clean":"2024-09-10T23:25:15.543230+0000","last_became_active":"2024-09-10T23:25:13.870036+0000","last_became_peered":"2024-09-10T23:25:13.870036+0000","last_unstale":"2024-09-10T23:25:15.543230+0000","last_undegraded":"2024-09-10T23:25:15.543230+0000","last_fullsized":"2024-09-10T23:25:15.543230+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:34.682442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854692+0000","last_change":"2024-09-10T23:25:12.873264+0000","last_active":"2024-09-10T23:25:14.854692+0000","last_peered":"2024-09-10T23:25:14.854692+0000","last_clean":"2024-09-10T23:25:14.854692+0000","last_became_active":"2024-09-10T23:25:12.872396+0000","last_became_peered":"2024-09-10T23:25:12.872396+0000","last_unstale":"2024-09-10T23:25:14.854692+0000","last_undegraded":"2024-09-10T23:25:14.854692+0000","last_fullsized":"2024-09-10T23:25:14.854692+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167852+0000","last_change":"2024-09-10T23:25:13.882067+0000","last_active":"2024-09-10T23:25:15.167852+0000","last_peered":"2024-09-10T23:25:15.167852+0000","last_clean":"2024-09-10T23:25:15.167852+0000","last_became_active":"2024-09-10T23:25:13.877949+0000","last_became_peered":"2024-09-10T23:25:13.877949+0000","last_unstale":"2024-09-10T23:25:15.167852+0000","last_undegraded":"2024-09-10T23:25:15.167852+0000","last_fullsized":"2024-09-10T23:25:15.167852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:50.603669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854542+0000","last_change":"2024-09-10T23:25:12.870970+0000","last_active":"2024-09-10T23:25:14.854542+0000","last_peered":"2024-09-10T23:25:14.854542+0000","last_clean":"2024-09-10T23:25:14.854542+0000","last_became_active":"2024-09-10T23:25:12.870538+0000","last_became_peered":"2024-09-10T23:25:12.870538+0000","last_unstale":"2024-09-10T23:25:14.854542+0000","last_undegraded":"2024-09-10T23:25:14.854542+0000","last_fullsized":"2024-09-10T23:25:14.854542+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.858411+0000","last_change":"2024-09-10T23:25:13.855869+0000","last_active":"2024-09-10T23:25:13.858411+0000","last_peered":"2024-09-10T23:25:13.858411+0000","last_clean":"2024-09-10T23:25:13.858411+0000","last_became_active":"2024-09-10T23:25:13.855567+0000","last_became_peered":"2024-09-10T23:25:13.855567+0000","last_unstale":"2024-09-10T23:25:13.858411+0000","last_undegraded":"2024-09-10T23:25:13.858411+0000","last_fullsized":"2024-09-10T23:25:13.858411+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:13.882085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849680+0000","last_change":"2024-09-10T23:25:12.868622+0000","last_active":"2024-09-10T23:25:14.849680+0000","last_peered":"2024-09-10T23:25:14.849680+0000","last_clean":"2024-09-10T23:25:14.849680+0000","last_became_active":"2024-09-10T23:25:12.868338+0000","last_became_peered":"2024-09-10T23:25:12.868338+0000","last_unstale":"2024-09-10T23:25:14.849680+0000","last_undegraded":"2024-09-10T23:25:14.849680+0000","last_fullsized":"2024-09-10T23:25:14.849680+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849579+0000","last_change":"2024-09-10T23:25:13.869075+0000","last_active":"2024-09-10T23:25:14.849579+0000","last_peered":"2024-09-10T23:25:14.849579+0000","last_clean":"2024-09-10T23:25:14.849579+0000","last_became_active":"2024-09-10T23:25:13.868451+0000","last_became_peered":"2024-09-10T23:25:13.868451+0000","last_unstale":"2024-09-10T23:25:14.849579+0000","last_undegraded":"2024-09-10T23:25:14.849579+0000","last_fullsized":"2024-09-10T23:25:14.849579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:47.345674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.859960+0000","last_change":"2024-09-10T23:25:12.872334+0000","last_active":"2024-09-10T23:25:13.859960+0000","last_peered":"2024-09-10T23:25:13.859960+0000","last_clean":"2024-09-10T23:25:13.859960+0000","last_became_active":"2024-09-10T23:25:12.871522+0000","last_became_peered":"2024-09-10T23:25:12.871522+0000","last_unstale":"2024-09-10T23:25:13.859960+0000","last_undegraded":"2024-09-10T23:25:13.859960+0000","last_fullsized":"2024-09-10T23:25:13.859960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:38.706629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849806+0000","last_change":"2024-09-10T23:25:13.869176+0000","last_active":"2024-09-10T23:25:14.849806+0000","last_peered":"2024-09-10T23:25:14.849806+0000","last_clean":"2024-09-10T23:25:14.849806+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:14.849806+0000","last_undegraded":"2024-09-10T23:25:14.849806+0000","last_fullsized":"2024-09-10T23:25:14.849806+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:11.171142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168230+0000","last_change":"2024-09-10T23:25:12.867607+0000","last_active":"2024-09-10T23:25:15.168230+0000","last_peered":"2024-09-10T23:25:15.168230+0000","last_clean":"2024-09-10T23:25:15.168230+0000","last_became_active":"2024-09-10T23:25:12.865003+0000","last_became_peered":"2024-09-10T23:25:12.865003+0000","last_unstale":"2024-09-10T23:25:15.168230+0000","last_undegraded":"2024-09-10T23:25:15.168230+0000","last_fullsized":"2024-09-10T23:25:15.168230+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:25.534423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849577+0000","last_change":"2024-09-10T23:25:13.877088+0000","last_active":"2024-09-10T23:25:14.849577+0000","last_peered":"2024-09-10T23:25:14.849577+0000","last_clean":"2024-09-10T23:25:14.849577+0000","last_became_active":"2024-09-10T23:25:13.876820+0000","last_became_peered":"2024-09-10T23:25:13.876820+0000","last_unstale":"2024-09-10T23:25:14.849577+0000","last_undegraded":"2024-09-10T23:25:14.849577+0000","last_fullsized":"2024-09-10T23:25:14.849577+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849440+0000","last_change":"2024-09-10T23:25:12.855796+0000","last_active":"2024-09-10T23:25:14.849440+0000","last_peered":"2024-09-10T23:25:14.849440+0000","last_clean":"2024-09-10T23:25:14.849440+0000","last_became_active":"2024-09-10T23:25:12.855449+0000","last_became_peered":"2024-09-10T23:25:12.855449+0000","last_unstale":"2024-09-10T23:25:14.849440+0000","last_undegraded":"2024-09-10T23:25:14.849440+0000","last_fullsized":"2024-09-10T23:25:14.849440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168525+0000","last_change":"2024-09-10T23:25:13.880032+0000","last_active":"2024-09-10T23:25:15.168525+0000","last_peered":"2024-09-10T23:25:15.168525+0000","last_clean":"2024-09-10T23:25:15.168525+0000","last_became_active":"2024-09-10T23:25:13.879777+0000","last_became_peered":"2024-09-10T23:25:13.879777+0000","last_unstale":"2024-09-10T23:25:15.168525+0000","last_undegraded":"2024-09-10T23:25:15.168525+0000","last_fullsized":"2024-09-10T23:25:15.168525+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:52.516915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-10T23:25:12.865750+0000","last_change":"2024-09-10T23:25:12.864319+0000","last_active":"2024-09-10T23:25:12.865750+0000","last_peered":"2024-09-10T23:25:12.865750+0000","last_clean":"2024-09-10T23:25:12.865750+0000","last_became_active":"2024-09-10T23:25:12.864040+0000","last_became_peered":"2024-09-10T23:25:12.864040+0000","last_unstale":"2024-09-10T23:25:12.865750+0000","last_undegraded":"2024-09-10T23:25:12.865750+0000","last_fullsized":"2024-09-10T23:25:12.865750+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:42.822581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543804+0000","last_change":"2024-09-10T23:25:13.873870+0000","last_active":"2024-09-10T23:25:15.543804+0000","last_peered":"2024-09-10T23:25:15.543804+0000","last_clean":"2024-09-10T23:25:15.543804+0000","last_became_active":"2024-09-10T23:25:13.873421+0000","last_became_peered":"2024-09-10T23:25:13.873421+0000","last_unstale":"2024-09-10T23:25:15.543804+0000","last_undegraded":"2024-09-10T23:25:15.543804+0000","last_fullsized":"2024-09-10T23:25:15.543804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167955+0000","last_change":"2024-09-10T23:25:12.867113+0000","last_active":"2024-09-10T23:25:15.167955+0000","last_peered":"2024-09-10T23:25:15.167955+0000","last_clean":"2024-09-10T23:25:15.167955+0000","last_became_active":"2024-09-10T23:25:12.866816+0000","last_became_peered":"2024-09-10T23:25:12.866816+0000","last_unstale":"2024-09-10T23:25:15.167955+0000","last_undegraded":"2024-09-10T23:25:15.167955+0000","last_fullsized":"2024-09-10T23:25:15.167955+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:40.361003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":329,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167673+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:25:15.167673+0000","last_peered":"2024-09-10T23:25:15.167673+0000","last_clean":"2024-09-10T23:25:15.167673+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:25:15.167673+0000","last_undegraded":"2024-09-10T23:25:15.167673+0000","last_fullsized":"2024-09-10T23:25:15.167673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46832,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325008,"statfs":{"total":96636764160,"available":96588808192,"internally_reserved":0,"allocated":1798144,"data_stored":841884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509562,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64048,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307792,"statfs":{"total":96636764160,"available":96571179008,"internally_reserved":0,"allocated":2387968,"data_stored":1426590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59300,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312540,"statfs":{"total":96636764160,"available":96576040960,"internally_reserved":0,"allocated":1781760,"data_stored":834542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64876,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306964,"statfs":{"total":96636764160,"available":96570331136,"internally_reserved":0,"allocated":1789952,"data_stored":841212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509561,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69040,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302800,"statfs":{"total":96636764160,"available":96566067200,"internally_reserved":0,"allocated":1785856,"data_stored":835136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509562,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55152,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316688,"statfs":{"total":96636764160,"available":96580288512,"internally_reserved":0,"allocated":1794048,"data_stored":841282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509561,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73768,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298072,"statfs":{"total":96636764160,"available":96561225728,"internally_reserved":0,"allocated":2379776,"data_stored":1424944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46792,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325048,"statfs":{"total":96636764160,"available":96588849152,"internally_reserved":0,"allocated":1753088,"data_stored":820694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:25:18.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:25:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 -- 172.21.15.17:0/2901502805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51180cc740 msgr2=0x7f5118070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 --2- 172.21.15.17:0/2901502805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51180cc740 0x7f5118070c70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f51180709f0 tx=0x7f510401c800 comp rx=0 tx=0).stop 2024-09-10T23:25:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 -- 172.21.15.17:0/2901502805 shutdown_connections 2024-09-10T23:25:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 --2- 172.21.15.17:0/2901502805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51180cc740 0x7f5118070c70 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 --2- 172.21.15.17:0/2901502805 >> v2:172.21.15.77:3300/0 conn(0x7f511815ba80 0x7f5118160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 -- 172.21.15.17:0/2901502805 >> 172.21.15.17:0/2901502805 conn(0x7f511809b2a0 msgr2=0x7f511808bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 -- 172.21.15.17:0/2901502805 shutdown_connections 2024-09-10T23:25:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 -- 172.21.15.17:0/2901502805 wait complete. 2024-09-10T23:25:18.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 Processor -- start 2024-09-10T23:25:18.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 -- start start 2024-09-10T23:25:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51180711b0 0x7f51181fb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51180cc740 0x7f5118164c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f511815ba80 0x7f51181651b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5118168ad0 con 0x7f511815ba80 2024-09-10T23:25:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f51180afe60 con 0x7f51180711b0 2024-09-10T23:25:18.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.602+0000 7f511f600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5118168c50 con 0x7f51180cc740 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f511815ba80 0x7f51181651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51180711b0 0x7f51181fb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f511815ba80 0x7f51181651b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55924/0 (socket says 172.21.15.17:55924) 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511d600640 1 -- 172.21.15.17:0/2670059108 learned_addr learned my addr 172.21.15.17:0/2670059108 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f5117e00640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51180cc740 0x7f5118164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511d600640 1 -- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51180cc740 msgr2=0x7f5118164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511d600640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51180cc740 0x7f5118164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511d600640 1 -- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51180711b0 msgr2=0x7f51181fb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511d600640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51180711b0 0x7f51181fb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511d600640 1 -- 172.21.15.17:0/2670059108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51181f7690 con 0x7f511815ba80 2024-09-10T23:25:18.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511d600640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f511815ba80 0x7f51181651b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f511000cbc0 tx=0x7f511000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f5114c00640 1 -- 172.21.15.17:0/2670059108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110016020 con 0x7f511815ba80 2024-09-10T23:25:18.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f5114c00640 1 -- 172.21.15.17:0/2670059108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f511000ab40 con 0x7f511815ba80 2024-09-10T23:25:18.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f5114c00640 1 -- 172.21.15.17:0/2670059108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5110012420 con 0x7f511815ba80 2024-09-10T23:25:18.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51181f7950 con 0x7f511815ba80 2024-09-10T23:25:18.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51181f7f10 con 0x7f511815ba80 2024-09-10T23:25:18.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511806fce0 con 0x7f511815ba80 2024-09-10T23:25:18.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.606+0000 7f5114c00640 1 -- 172.21.15.17:0/2670059108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f511001a3b0 con 0x7f511815ba80 2024-09-10T23:25:18.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.610+0000 7f5114c00640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50f80725e0 0x7f50f8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:18.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.610+0000 7f5114c00640 1 -- 172.21.15.17:0/2670059108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f5110093580 con 0x7f511815ba80 2024-09-10T23:25:18.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.610+0000 7f511cc00640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50f80725e0 0x7f50f8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:18.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.610+0000 7f511cc00640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50f80725e0 0x7f50f8074aa0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f510c00bb50 tx=0x7f510c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:18.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.614+0000 7f5114c00640 1 -- 172.21.15.17:0/2670059108 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5110020030 con 0x7f511815ba80 2024-09-10T23:25:18.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.782+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5118070c70 con 0x7f50f80725e0 2024-09-10T23:25:18.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.786+0000 7f5114c00640 1 -- 172.21.15.17:0/2670059108 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252471 (secure 0 0 0) 0x7f5118070c70 con 0x7f50f80725e0 2024-09-10T23:25:18.792 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:18.793 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:25:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50f80725e0 msgr2=0x7f50f8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50f80725e0 0x7f50f8074aa0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f510c00bb50 tx=0x7f510c00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f511815ba80 msgr2=0x7f51181651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f511815ba80 0x7f51181651b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f511000cbc0 tx=0x7f511000ccb0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 shutdown_connections 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50f80725e0 0x7f50f8074aa0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f511815ba80 0x7f51181651b0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51180cc740 0x7f5118164c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 --2- 172.21.15.17:0/2670059108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51180711b0 0x7f51181fb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 >> 172.21.15.17:0/2670059108 conn(0x7f511809b2a0 msgr2=0x7f51181585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 shutdown_connections 2024-09-10T23:25:18.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:18.790+0000 7f511f600640 1 -- 172.21.15.17:0/2670059108 wait complete. 2024-09-10T23:25:18.813 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2024-09-10T23:25:18.432561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":479860,"kb_used_data":15160,"kb_used_omap":12,"kb_used_meta":464499,"kb_avail":754494860,"statfs":{"total":773094113280,"available":772602736640,"internally_reserved":0,"allocated":15523840,"data_stored":7888484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":475647537},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001628"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.870355+0000","last_change":"2024-09-10T23:25:13.865559+0000","last_active":"2024-09-10T23:25:13.870355+0000","last_peered":"2024-09-10T23:25:13.870355+0000","last_clean":"2024-09-10T23:25:13.870355+0000","last_became_active":"2024-09-10T23:25:13.865244+0000","last_became_peered":"2024-09-10T23:25:13.865244+0000","last_unstale":"2024-09-10T23:25:13.870355+0000","last_undegraded":"2024-09-10T23:25:13.870355+0000","last_fullsized":"2024-09-10T23:25:13.870355+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:07.293961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.874913+0000","last_change":"2024-09-10T23:25:13.869884+0000","last_active":"2024-09-10T23:25:13.874913+0000","last_peered":"2024-09-10T23:25:13.874913+0000","last_clean":"2024-09-10T23:25:13.874913+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:13.874913+0000","last_undegraded":"2024-09-10T23:25:13.874913+0000","last_fullsized":"2024-09-10T23:25:13.874913+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:07.467267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543691+0000","last_change":"2024-09-10T23:25:13.873797+0000","last_active":"2024-09-10T23:25:15.543691+0000","last_peered":"2024-09-10T23:25:15.543691+0000","last_clean":"2024-09-10T23:25:15.543691+0000","last_became_active":"2024-09-10T23:25:13.873417+0000","last_became_peered":"2024-09-10T23:25:13.873417+0000","last_unstale":"2024-09-10T23:25:15.543691+0000","last_undegraded":"2024-09-10T23:25:15.543691+0000","last_fullsized":"2024-09-10T23:25:15.543691+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.073999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.876094+0000","last_change":"2024-09-10T23:25:13.871941+0000","last_active":"2024-09-10T23:25:13.876094+0000","last_peered":"2024-09-10T23:25:13.876094+0000","last_clean":"2024-09-10T23:25:13.876094+0000","last_became_active":"2024-09-10T23:25:13.871660+0000","last_became_peered":"2024-09-10T23:25:13.871660+0000","last_unstale":"2024-09-10T23:25:13.876094+0000","last_undegraded":"2024-09-10T23:25:13.876094+0000","last_fullsized":"2024-09-10T23:25:13.876094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:22.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539081+0000","last_change":"2024-09-10T23:25:13.864537+0000","last_active":"2024-09-10T23:25:15.539081+0000","last_peered":"2024-09-10T23:25:15.539081+0000","last_clean":"2024-09-10T23:25:15.539081+0000","last_became_active":"2024-09-10T23:25:13.862390+0000","last_became_peered":"2024-09-10T23:25:13.862390+0000","last_unstale":"2024-09-10T23:25:15.539081+0000","last_undegraded":"2024-09-10T23:25:15.539081+0000","last_fullsized":"2024-09-10T23:25:15.539081+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:09.158036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849317+0000","last_change":"2024-09-10T23:25:13.869860+0000","last_active":"2024-09-10T23:25:14.849317+0000","last_peered":"2024-09-10T23:25:14.849317+0000","last_clean":"2024-09-10T23:25:14.849317+0000","last_became_active":"2024-09-10T23:25:13.869577+0000","last_became_peered":"2024-09-10T23:25:13.869577+0000","last_unstale":"2024-09-10T23:25:14.849317+0000","last_undegraded":"2024-09-10T23:25:14.849317+0000","last_fullsized":"2024-09-10T23:25:14.849317+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:41.363760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167998+0000","last_change":"2024-09-10T23:25:13.882785+0000","last_active":"2024-09-10T23:25:15.167998+0000","last_peered":"2024-09-10T23:25:15.167998+0000","last_clean":"2024-09-10T23:25:15.167998+0000","last_became_active":"2024-09-10T23:25:13.877627+0000","last_became_peered":"2024-09-10T23:25:13.877627+0000","last_unstale":"2024-09-10T23:25:15.167998+0000","last_undegraded":"2024-09-10T23:25:15.167998+0000","last_fullsized":"2024-09-10T23:25:15.167998+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:44.875736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854072+0000","last_change":"2024-09-10T23:25:13.867473+0000","last_active":"2024-09-10T23:25:14.854072+0000","last_peered":"2024-09-10T23:25:14.854072+0000","last_clean":"2024-09-10T23:25:14.854072+0000","last_became_active":"2024-09-10T23:25:13.867208+0000","last_became_peered":"2024-09-10T23:25:13.867208+0000","last_unstale":"2024-09-10T23:25:14.854072+0000","last_undegraded":"2024-09-10T23:25:14.854072+0000","last_fullsized":"2024-09-10T23:25:14.854072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:19.792842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849974+0000","last_change":"2024-09-10T23:25:13.875490+0000","last_active":"2024-09-10T23:25:14.849974+0000","last_peered":"2024-09-10T23:25:14.849974+0000","last_clean":"2024-09-10T23:25:14.849974+0000","last_became_active":"2024-09-10T23:25:13.875205+0000","last_became_peered":"2024-09-10T23:25:13.875205+0000","last_unstale":"2024-09-10T23:25:14.849974+0000","last_undegraded":"2024-09-10T23:25:14.849974+0000","last_fullsized":"2024-09-10T23:25:14.849974+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:51.185099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.857080+0000","last_change":"2024-09-10T23:25:13.854593+0000","last_active":"2024-09-10T23:25:13.857080+0000","last_peered":"2024-09-10T23:25:13.857080+0000","last_clean":"2024-09-10T23:25:13.857080+0000","last_became_active":"2024-09-10T23:25:13.854336+0000","last_became_peered":"2024-09-10T23:25:13.854336+0000","last_unstale":"2024-09-10T23:25:13.857080+0000","last_undegraded":"2024-09-10T23:25:13.857080+0000","last_fullsized":"2024-09-10T23:25:13.857080+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.179524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881188+0000","last_change":"2024-09-10T23:25:13.876510+0000","last_active":"2024-09-10T23:25:13.881188+0000","last_peered":"2024-09-10T23:25:13.881188+0000","last_clean":"2024-09-10T23:25:13.881188+0000","last_became_active":"2024-09-10T23:25:13.876168+0000","last_became_peered":"2024-09-10T23:25:13.876168+0000","last_unstale":"2024-09-10T23:25:13.881188+0000","last_undegraded":"2024-09-10T23:25:13.881188+0000","last_fullsized":"2024-09-10T23:25:13.881188+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:22.257735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.872176+0000","last_change":"2024-09-10T23:25:13.866253+0000","last_active":"2024-09-10T23:25:13.872176+0000","last_peered":"2024-09-10T23:25:13.872176+0000","last_clean":"2024-09-10T23:25:13.872176+0000","last_became_active":"2024-09-10T23:25:13.865309+0000","last_became_peered":"2024-09-10T23:25:13.865309+0000","last_unstale":"2024-09-10T23:25:13.872176+0000","last_undegraded":"2024-09-10T23:25:13.872176+0000","last_fullsized":"2024-09-10T23:25:13.872176+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.331722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849866+0000","last_change":"2024-09-10T23:25:13.871849+0000","last_active":"2024-09-10T23:25:14.849866+0000","last_peered":"2024-09-10T23:25:14.849866+0000","last_clean":"2024-09-10T23:25:14.849866+0000","last_became_active":"2024-09-10T23:25:13.871410+0000","last_became_peered":"2024-09-10T23:25:13.871410+0000","last_unstale":"2024-09-10T23:25:14.849866+0000","last_undegraded":"2024-09-10T23:25:14.849866+0000","last_fullsized":"2024-09-10T23:25:14.849866+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:05.732775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875164+0000","last_change":"2024-09-10T23:25:13.871872+0000","last_active":"2024-09-10T23:25:13.875164+0000","last_peered":"2024-09-10T23:25:13.875164+0000","last_clean":"2024-09-10T23:25:13.875164+0000","last_became_active":"2024-09-10T23:25:13.871601+0000","last_became_peered":"2024-09-10T23:25:13.871601+0000","last_unstale":"2024-09-10T23:25:13.875164+0000","last_undegraded":"2024-09-10T23:25:13.875164+0000","last_fullsized":"2024-09-10T23:25:13.875164+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:31.846681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.868359+0000","last_change":"2024-09-10T23:25:13.861355+0000","last_active":"2024-09-10T23:25:13.868359+0000","last_peered":"2024-09-10T23:25:13.868359+0000","last_clean":"2024-09-10T23:25:13.868359+0000","last_became_active":"2024-09-10T23:25:13.860218+0000","last_became_peered":"2024-09-10T23:25:13.860218+0000","last_unstale":"2024-09-10T23:25:13.868359+0000","last_undegraded":"2024-09-10T23:25:13.868359+0000","last_fullsized":"2024-09-10T23:25:13.868359+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:30.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849485+0000","last_change":"2024-09-10T23:25:13.863772+0000","last_active":"2024-09-10T23:25:14.849485+0000","last_peered":"2024-09-10T23:25:14.849485+0000","last_clean":"2024-09-10T23:25:14.849485+0000","last_became_active":"2024-09-10T23:25:13.863386+0000","last_became_peered":"2024-09-10T23:25:13.863386+0000","last_unstale":"2024-09-10T23:25:14.849485+0000","last_undegraded":"2024-09-10T23:25:14.849485+0000","last_fullsized":"2024-09-10T23:25:14.849485+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849983+0000","last_change":"2024-09-10T23:25:13.864064+0000","last_active":"2024-09-10T23:25:14.849983+0000","last_peered":"2024-09-10T23:25:14.849983+0000","last_clean":"2024-09-10T23:25:14.849983+0000","last_became_active":"2024-09-10T23:25:13.863786+0000","last_became_peered":"2024-09-10T23:25:13.863786+0000","last_unstale":"2024-09-10T23:25:14.849983+0000","last_undegraded":"2024-09-10T23:25:14.849983+0000","last_fullsized":"2024-09-10T23:25:14.849983+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:32.141683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539218+0000","last_change":"2024-09-10T23:25:13.870353+0000","last_active":"2024-09-10T23:25:15.539218+0000","last_peered":"2024-09-10T23:25:15.539218+0000","last_clean":"2024-09-10T23:25:15.539218+0000","last_became_active":"2024-09-10T23:25:13.870057+0000","last_became_peered":"2024-09-10T23:25:13.870057+0000","last_unstale":"2024-09-10T23:25:15.539218+0000","last_undegraded":"2024-09-10T23:25:15.539218+0000","last_fullsized":"2024-09-10T23:25:15.539218+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:51.889316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:13.875171+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:13.874560+0000","last_became_peered":"2024-09-10T23:25:13.874560+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:58.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539399+0000","last_change":"2024-09-10T23:25:13.876342+0000","last_active":"2024-09-10T23:25:15.539399+0000","last_peered":"2024-09-10T23:25:15.539399+0000","last_clean":"2024-09-10T23:25:15.539399+0000","last_became_active":"2024-09-10T23:25:13.875990+0000","last_became_peered":"2024-09-10T23:25:13.875990+0000","last_unstale":"2024-09-10T23:25:15.539399+0000","last_undegraded":"2024-09-10T23:25:15.539399+0000","last_fullsized":"2024-09-10T23:25:15.539399+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:29.164335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875674+0000","last_change":"2024-09-10T23:25:13.871600+0000","last_active":"2024-09-10T23:25:13.875674+0000","last_peered":"2024-09-10T23:25:13.875674+0000","last_clean":"2024-09-10T23:25:13.875674+0000","last_became_active":"2024-09-10T23:25:13.871261+0000","last_became_peered":"2024-09-10T23:25:13.871261+0000","last_unstale":"2024-09-10T23:25:13.875674+0000","last_undegraded":"2024-09-10T23:25:13.875674+0000","last_fullsized":"2024-09-10T23:25:13.875674+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:33.139403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878388+0000","last_change":"2024-09-10T23:25:13.875260+0000","last_active":"2024-09-10T23:25:13.878388+0000","last_peered":"2024-09-10T23:25:13.878388+0000","last_clean":"2024-09-10T23:25:13.878388+0000","last_became_active":"2024-09-10T23:25:13.874961+0000","last_became_peered":"2024-09-10T23:25:13.874961+0000","last_unstale":"2024-09-10T23:25:13.878388+0000","last_undegraded":"2024-09-10T23:25:13.878388+0000","last_fullsized":"2024-09-10T23:25:13.878388+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:13.378132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881255+0000","last_change":"2024-09-10T23:25:13.878417+0000","last_active":"2024-09-10T23:25:13.881255+0000","last_peered":"2024-09-10T23:25:13.881255+0000","last_clean":"2024-09-10T23:25:13.881255+0000","last_became_active":"2024-09-10T23:25:13.878116+0000","last_became_peered":"2024-09-10T23:25:13.878116+0000","last_unstale":"2024-09-10T23:25:13.881255+0000","last_undegraded":"2024-09-10T23:25:13.881255+0000","last_fullsized":"2024-09-10T23:25:13.881255+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:16.040337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849229+0000","last_change":"2024-09-10T23:25:13.872929+0000","last_active":"2024-09-10T23:25:14.849229+0000","last_peered":"2024-09-10T23:25:14.849229+0000","last_clean":"2024-09-10T23:25:14.849229+0000","last_became_active":"2024-09-10T23:25:13.870728+0000","last_became_peered":"2024-09-10T23:25:13.870728+0000","last_unstale":"2024-09-10T23:25:14.849229+0000","last_undegraded":"2024-09-10T23:25:14.849229+0000","last_fullsized":"2024-09-10T23:25:14.849229+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544072+0000","last_change":"2024-09-10T23:25:13.876451+0000","last_active":"2024-09-10T23:25:15.544072+0000","last_peered":"2024-09-10T23:25:15.544072+0000","last_clean":"2024-09-10T23:25:15.544072+0000","last_became_active":"2024-09-10T23:25:13.876073+0000","last_became_peered":"2024-09-10T23:25:13.876073+0000","last_unstale":"2024-09-10T23:25:15.544072+0000","last_undegraded":"2024-09-10T23:25:15.544072+0000","last_fullsized":"2024-09-10T23:25:15.544072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544042+0000","last_change":"2024-09-10T23:25:13.881177+0000","last_active":"2024-09-10T23:25:15.544042+0000","last_peered":"2024-09-10T23:25:15.544042+0000","last_clean":"2024-09-10T23:25:15.544042+0000","last_became_active":"2024-09-10T23:25:13.880913+0000","last_became_peered":"2024-09-10T23:25:13.880913+0000","last_unstale":"2024-09-10T23:25:15.544042+0000","last_undegraded":"2024-09-10T23:25:15.544042+0000","last_fullsized":"2024-09-10T23:25:15.544042+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168384+0000","last_change":"2024-09-10T23:25:13.875429+0000","last_active":"2024-09-10T23:25:15.168384+0000","last_peered":"2024-09-10T23:25:15.168384+0000","last_clean":"2024-09-10T23:25:15.168384+0000","last_became_active":"2024-09-10T23:25:13.874893+0000","last_became_peered":"2024-09-10T23:25:13.874893+0000","last_unstale":"2024-09-10T23:25:15.168384+0000","last_undegraded":"2024-09-10T23:25:15.168384+0000","last_fullsized":"2024-09-10T23:25:15.168384+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:47.064911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.856715+0000","last_change":"2024-09-10T23:25:13.853437+0000","last_active":"2024-09-10T23:25:13.856715+0000","last_peered":"2024-09-10T23:25:13.856715+0000","last_clean":"2024-09-10T23:25:13.856715+0000","last_became_active":"2024-09-10T23:25:13.853158+0000","last_became_peered":"2024-09-10T23:25:13.853158+0000","last_unstale":"2024-09-10T23:25:13.856715+0000","last_undegraded":"2024-09-10T23:25:13.856715+0000","last_fullsized":"2024-09-10T23:25:13.856715+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:14.818230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543699+0000","last_change":"2024-09-10T23:25:13.878111+0000","last_active":"2024-09-10T23:25:15.543699+0000","last_peered":"2024-09-10T23:25:15.543699+0000","last_clean":"2024-09-10T23:25:15.543699+0000","last_became_active":"2024-09-10T23:25:13.877815+0000","last_became_peered":"2024-09-10T23:25:13.877815+0000","last_unstale":"2024-09-10T23:25:15.543699+0000","last_undegraded":"2024-09-10T23:25:15.543699+0000","last_fullsized":"2024-09-10T23:25:15.543699+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:33.139403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543716+0000","last_change":"2024-09-10T23:25:13.878758+0000","last_active":"2024-09-10T23:25:15.543716+0000","last_peered":"2024-09-10T23:25:15.543716+0000","last_clean":"2024-09-10T23:25:15.543716+0000","last_became_active":"2024-09-10T23:25:13.878493+0000","last_became_peered":"2024-09-10T23:25:13.878493+0000","last_unstale":"2024-09-10T23:25:15.543716+0000","last_undegraded":"2024-09-10T23:25:15.543716+0000","last_fullsized":"2024-09-10T23:25:15.543716+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:27.113577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854060+0000","last_change":"2024-09-10T23:25:13.869209+0000","last_active":"2024-09-10T23:25:14.854060+0000","last_peered":"2024-09-10T23:25:14.854060+0000","last_clean":"2024-09-10T23:25:14.854060+0000","last_became_active":"2024-09-10T23:25:13.868965+0000","last_became_peered":"2024-09-10T23:25:13.868965+0000","last_unstale":"2024-09-10T23:25:14.854060+0000","last_undegraded":"2024-09-10T23:25:14.854060+0000","last_fullsized":"2024-09-10T23:25:14.854060+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:59.422431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875736+0000","last_change":"2024-09-10T23:25:13.875122+0000","last_active":"2024-09-10T23:25:13.875736+0000","last_peered":"2024-09-10T23:25:13.875736+0000","last_clean":"2024-09-10T23:25:13.875736+0000","last_became_active":"2024-09-10T23:25:13.874015+0000","last_became_peered":"2024-09-10T23:25:13.874015+0000","last_unstale":"2024-09-10T23:25:13.875736+0000","last_undegraded":"2024-09-10T23:25:13.875736+0000","last_fullsized":"2024-09-10T23:25:13.875736+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:05.311293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854201+0000","last_change":"2024-09-10T23:25:13.869068+0000","last_active":"2024-09-10T23:25:14.854201+0000","last_peered":"2024-09-10T23:25:14.854201+0000","last_clean":"2024-09-10T23:25:14.854201+0000","last_became_active":"2024-09-10T23:25:13.865220+0000","last_became_peered":"2024-09-10T23:25:13.865220+0000","last_unstale":"2024-09-10T23:25:14.854201+0000","last_undegraded":"2024-09-10T23:25:14.854201+0000","last_fullsized":"2024-09-10T23:25:14.854201+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:25.648301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"143'4","reported_seq":19,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543988+0000","last_change":"2024-09-10T23:25:12.873694+0000","last_active":"2024-09-10T23:25:15.543988+0000","last_peered":"2024-09-10T23:25:15.543988+0000","last_clean":"2024-09-10T23:25:15.543988+0000","last_became_active":"2024-09-10T23:25:12.871488+0000","last_became_peered":"2024-09-10T23:25:12.871488+0000","last_unstale":"2024-09-10T23:25:15.543988+0000","last_undegraded":"2024-09-10T23:25:15.543988+0000","last_fullsized":"2024-09-10T23:25:15.543988+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:17.859612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.873431+0000","last_change":"2024-09-10T23:25:13.869377+0000","last_active":"2024-09-10T23:25:13.873431+0000","last_peered":"2024-09-10T23:25:13.873431+0000","last_clean":"2024-09-10T23:25:13.873431+0000","last_became_active":"2024-09-10T23:25:13.869123+0000","last_became_peered":"2024-09-10T23:25:13.869123+0000","last_unstale":"2024-09-10T23:25:13.873431+0000","last_undegraded":"2024-09-10T23:25:13.873431+0000","last_fullsized":"2024-09-10T23:25:13.873431+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:24.587347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539832+0000","last_change":"2024-09-10T23:25:12.864352+0000","last_active":"2024-09-10T23:25:15.539832+0000","last_peered":"2024-09-10T23:25:15.539832+0000","last_clean":"2024-09-10T23:25:15.539832+0000","last_became_active":"2024-09-10T23:25:12.864097+0000","last_became_peered":"2024-09-10T23:25:12.864097+0000","last_unstale":"2024-09-10T23:25:15.539832+0000","last_undegraded":"2024-09-10T23:25:15.539832+0000","last_fullsized":"2024-09-10T23:25:15.539832+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:40.097226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881249+0000","last_change":"2024-09-10T23:25:13.876002+0000","last_active":"2024-09-10T23:25:13.881249+0000","last_peered":"2024-09-10T23:25:13.881249+0000","last_clean":"2024-09-10T23:25:13.881249+0000","last_became_active":"2024-09-10T23:25:13.875699+0000","last_became_peered":"2024-09-10T23:25:13.875699+0000","last_unstale":"2024-09-10T23:25:13.881249+0000","last_undegraded":"2024-09-10T23:25:13.881249+0000","last_fullsized":"2024-09-10T23:25:13.881249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168318+0000","last_change":"2024-09-10T23:25:12.869556+0000","last_active":"2024-09-10T23:25:15.168318+0000","last_peered":"2024-09-10T23:25:15.168318+0000","last_clean":"2024-09-10T23:25:15.168318+0000","last_became_active":"2024-09-10T23:25:12.869278+0000","last_became_peered":"2024-09-10T23:25:12.869278+0000","last_unstale":"2024-09-10T23:25:15.168318+0000","last_undegraded":"2024-09-10T23:25:15.168318+0000","last_fullsized":"2024-09-10T23:25:15.168318+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:56.479420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878651+0000","last_change":"2024-09-10T23:25:13.872607+0000","last_active":"2024-09-10T23:25:13.878651+0000","last_peered":"2024-09-10T23:25:13.878651+0000","last_clean":"2024-09-10T23:25:13.878651+0000","last_became_active":"2024-09-10T23:25:13.872280+0000","last_became_peered":"2024-09-10T23:25:13.872280+0000","last_unstale":"2024-09-10T23:25:13.878651+0000","last_undegraded":"2024-09-10T23:25:13.878651+0000","last_fullsized":"2024-09-10T23:25:13.878651+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:57.011115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168214+0000","last_change":"2024-09-10T23:25:12.865957+0000","last_active":"2024-09-10T23:25:15.168214+0000","last_peered":"2024-09-10T23:25:15.168214+0000","last_clean":"2024-09-10T23:25:15.168214+0000","last_became_active":"2024-09-10T23:25:12.865662+0000","last_became_peered":"2024-09-10T23:25:12.865662+0000","last_unstale":"2024-09-10T23:25:15.168214+0000","last_undegraded":"2024-09-10T23:25:15.168214+0000","last_fullsized":"2024-09-10T23:25:15.168214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:10.168386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854351+0000","last_change":"2024-09-10T23:25:13.868440+0000","last_active":"2024-09-10T23:25:14.854351+0000","last_peered":"2024-09-10T23:25:14.854351+0000","last_clean":"2024-09-10T23:25:14.854351+0000","last_became_active":"2024-09-10T23:25:13.868181+0000","last_became_peered":"2024-09-10T23:25:13.868181+0000","last_unstale":"2024-09-10T23:25:14.854351+0000","last_undegraded":"2024-09-10T23:25:14.854351+0000","last_fullsized":"2024-09-10T23:25:14.854351+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:05.848015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854302+0000","last_change":"2024-09-10T23:25:12.874108+0000","last_active":"2024-09-10T23:25:14.854302+0000","last_peered":"2024-09-10T23:25:14.854302+0000","last_clean":"2024-09-10T23:25:14.854302+0000","last_became_active":"2024-09-10T23:25:12.872828+0000","last_became_peered":"2024-09-10T23:25:12.872828+0000","last_unstale":"2024-09-10T23:25:14.854302+0000","last_undegraded":"2024-09-10T23:25:14.854302+0000","last_fullsized":"2024-09-10T23:25:14.854302+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854662+0000","last_change":"2024-09-10T23:25:13.861557+0000","last_active":"2024-09-10T23:25:14.854662+0000","last_peered":"2024-09-10T23:25:14.854662+0000","last_clean":"2024-09-10T23:25:14.854662+0000","last_became_active":"2024-09-10T23:25:13.861288+0000","last_became_peered":"2024-09-10T23:25:13.861288+0000","last_unstale":"2024-09-10T23:25:14.854662+0000","last_undegraded":"2024-09-10T23:25:14.854662+0000","last_fullsized":"2024-09-10T23:25:14.854662+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:07.467267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539287+0000","last_change":"2024-09-10T23:25:12.861726+0000","last_active":"2024-09-10T23:25:15.539287+0000","last_peered":"2024-09-10T23:25:15.539287+0000","last_clean":"2024-09-10T23:25:15.539287+0000","last_became_active":"2024-09-10T23:25:12.861433+0000","last_became_peered":"2024-09-10T23:25:12.861433+0000","last_unstale":"2024-09-10T23:25:15.539287+0000","last_undegraded":"2024-09-10T23:25:15.539287+0000","last_fullsized":"2024-09-10T23:25:15.539287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:18.517338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539453+0000","last_change":"2024-09-10T23:25:13.876395+0000","last_active":"2024-09-10T23:25:15.539453+0000","last_peered":"2024-09-10T23:25:15.539453+0000","last_clean":"2024-09-10T23:25:15.539453+0000","last_became_active":"2024-09-10T23:25:13.876074+0000","last_became_peered":"2024-09-10T23:25:13.876074+0000","last_unstale":"2024-09-10T23:25:15.539453+0000","last_undegraded":"2024-09-10T23:25:15.539453+0000","last_fullsized":"2024-09-10T23:25:15.539453+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:48.273393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849066+0000","last_change":"2024-09-10T23:25:12.857750+0000","last_active":"2024-09-10T23:25:14.849066+0000","last_peered":"2024-09-10T23:25:14.849066+0000","last_clean":"2024-09-10T23:25:14.849066+0000","last_became_active":"2024-09-10T23:25:12.857460+0000","last_became_peered":"2024-09-10T23:25:12.857460+0000","last_unstale":"2024-09-10T23:25:14.849066+0000","last_undegraded":"2024-09-10T23:25:14.849066+0000","last_fullsized":"2024-09-10T23:25:14.849066+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168579+0000","last_change":"2024-09-10T23:25:13.880336+0000","last_active":"2024-09-10T23:25:15.168579+0000","last_peered":"2024-09-10T23:25:15.168579+0000","last_clean":"2024-09-10T23:25:15.168579+0000","last_became_active":"2024-09-10T23:25:13.877088+0000","last_became_peered":"2024-09-10T23:25:13.877088+0000","last_unstale":"2024-09-10T23:25:15.168579+0000","last_undegraded":"2024-09-10T23:25:15.168579+0000","last_fullsized":"2024-09-10T23:25:15.168579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:30.634846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543073+0000","last_change":"2024-09-10T23:25:12.872243+0000","last_active":"2024-09-10T23:25:15.543073+0000","last_peered":"2024-09-10T23:25:15.543073+0000","last_clean":"2024-09-10T23:25:15.543073+0000","last_became_active":"2024-09-10T23:25:12.870719+0000","last_became_peered":"2024-09-10T23:25:12.870719+0000","last_unstale":"2024-09-10T23:25:15.543073+0000","last_undegraded":"2024-09-10T23:25:15.543073+0000","last_fullsized":"2024-09-10T23:25:15.543073+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:44.618611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878550+0000","last_change":"2024-09-10T23:25:13.874102+0000","last_active":"2024-09-10T23:25:13.878550+0000","last_peered":"2024-09-10T23:25:13.878550+0000","last_clean":"2024-09-10T23:25:13.878550+0000","last_became_active":"2024-09-10T23:25:13.873768+0000","last_became_peered":"2024-09-10T23:25:13.873768+0000","last_unstale":"2024-09-10T23:25:13.878550+0000","last_undegraded":"2024-09-10T23:25:13.878550+0000","last_fullsized":"2024-09-10T23:25:13.878550+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:37.211577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.864004+0000","last_change":"2024-09-10T23:25:12.867851+0000","last_active":"2024-09-10T23:25:13.864004+0000","last_peered":"2024-09-10T23:25:13.864004+0000","last_clean":"2024-09-10T23:25:13.864004+0000","last_became_active":"2024-09-10T23:25:12.867574+0000","last_became_peered":"2024-09-10T23:25:12.867574+0000","last_unstale":"2024-09-10T23:25:13.864004+0000","last_undegraded":"2024-09-10T23:25:13.864004+0000","last_fullsized":"2024-09-10T23:25:13.864004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:04.845258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849337+0000","last_change":"2024-09-10T23:25:13.863808+0000","last_active":"2024-09-10T23:25:14.849337+0000","last_peered":"2024-09-10T23:25:14.849337+0000","last_clean":"2024-09-10T23:25:14.849337+0000","last_became_active":"2024-09-10T23:25:13.863523+0000","last_became_peered":"2024-09-10T23:25:13.863523+0000","last_unstale":"2024-09-10T23:25:14.849337+0000","last_undegraded":"2024-09-10T23:25:14.849337+0000","last_fullsized":"2024-09-10T23:25:14.849337+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.854459+0000","last_change":"2024-09-10T23:25:12.870251+0000","last_active":"2024-09-10T23:25:13.854459+0000","last_peered":"2024-09-10T23:25:13.854459+0000","last_clean":"2024-09-10T23:25:13.854459+0000","last_became_active":"2024-09-10T23:25:12.868133+0000","last_became_peered":"2024-09-10T23:25:12.868133+0000","last_unstale":"2024-09-10T23:25:13.854459+0000","last_undegraded":"2024-09-10T23:25:13.854459+0000","last_fullsized":"2024-09-10T23:25:13.854459+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543987+0000","last_change":"2024-09-10T23:25:13.876765+0000","last_active":"2024-09-10T23:25:15.543987+0000","last_peered":"2024-09-10T23:25:15.543987+0000","last_clean":"2024-09-10T23:25:15.543987+0000","last_became_active":"2024-09-10T23:25:13.876265+0000","last_became_peered":"2024-09-10T23:25:13.876265+0000","last_unstale":"2024-09-10T23:25:15.543987+0000","last_undegraded":"2024-09-10T23:25:15.543987+0000","last_fullsized":"2024-09-10T23:25:15.543987+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"143'3","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168465+0000","last_change":"2024-09-10T23:25:12.866370+0000","last_active":"2024-09-10T23:25:15.168465+0000","last_peered":"2024-09-10T23:25:15.168465+0000","last_clean":"2024-09-10T23:25:15.168465+0000","last_became_active":"2024-09-10T23:25:12.866110+0000","last_became_peered":"2024-09-10T23:25:12.866110+0000","last_unstale":"2024-09-10T23:25:15.168465+0000","last_undegraded":"2024-09-10T23:25:15.168465+0000","last_fullsized":"2024-09-10T23:25:15.168465+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:16.892811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543795+0000","last_change":"2024-09-10T23:25:13.872367+0000","last_active":"2024-09-10T23:25:15.543795+0000","last_peered":"2024-09-10T23:25:15.543795+0000","last_clean":"2024-09-10T23:25:15.543795+0000","last_became_active":"2024-09-10T23:25:13.871439+0000","last_became_peered":"2024-09-10T23:25:13.871439+0000","last_unstale":"2024-09-10T23:25:15.543795+0000","last_undegraded":"2024-09-10T23:25:15.543795+0000","last_fullsized":"2024-09-10T23:25:15.543795+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"143'6","reported_seq":21,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168138+0000","last_change":"2024-09-10T23:25:12.863438+0000","last_active":"2024-09-10T23:25:15.168138+0000","last_peered":"2024-09-10T23:25:15.168138+0000","last_clean":"2024-09-10T23:25:15.168138+0000","last_became_active":"2024-09-10T23:25:12.863119+0000","last_became_peered":"2024-09-10T23:25:12.863119+0000","last_unstale":"2024-09-10T23:25:15.168138+0000","last_undegraded":"2024-09-10T23:25:15.168138+0000","last_fullsized":"2024-09-10T23:25:15.168138+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:04.730019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.866856+0000","last_change":"2024-09-10T23:25:13.863293+0000","last_active":"2024-09-10T23:25:13.866856+0000","last_peered":"2024-09-10T23:25:13.866856+0000","last_clean":"2024-09-10T23:25:13.866856+0000","last_became_active":"2024-09-10T23:25:13.861554+0000","last_became_peered":"2024-09-10T23:25:13.861554+0000","last_unstale":"2024-09-10T23:25:13.866856+0000","last_undegraded":"2024-09-10T23:25:13.866856+0000","last_fullsized":"2024-09-10T23:25:13.866856+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:05.775013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"143'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.883312+0000","last_change":"2024-09-10T23:25:12.870308+0000","last_active":"2024-09-10T23:25:13.883312+0000","last_peered":"2024-09-10T23:25:13.883312+0000","last_clean":"2024-09-10T23:25:13.883312+0000","last_became_active":"2024-09-10T23:25:12.870004+0000","last_became_peered":"2024-09-10T23:25:12.870004+0000","last_unstale":"2024-09-10T23:25:13.883312+0000","last_undegraded":"2024-09-10T23:25:13.883312+0000","last_fullsized":"2024-09-10T23:25:13.883312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:26.297677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168548+0000","last_change":"2024-09-10T23:25:13.879660+0000","last_active":"2024-09-10T23:25:15.168548+0000","last_peered":"2024-09-10T23:25:15.168548+0000","last_clean":"2024-09-10T23:25:15.168548+0000","last_became_active":"2024-09-10T23:25:13.876125+0000","last_became_peered":"2024-09-10T23:25:13.876125+0000","last_unstale":"2024-09-10T23:25:15.168548+0000","last_undegraded":"2024-09-10T23:25:15.168548+0000","last_fullsized":"2024-09-10T23:25:15.168548+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:13.803118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543208+0000","last_change":"2024-09-10T23:25:12.867167+0000","last_active":"2024-09-10T23:25:15.543208+0000","last_peered":"2024-09-10T23:25:15.543208+0000","last_clean":"2024-09-10T23:25:15.543208+0000","last_became_active":"2024-09-10T23:25:12.866906+0000","last_became_peered":"2024-09-10T23:25:12.866906+0000","last_unstale":"2024-09-10T23:25:15.543208+0000","last_undegraded":"2024-09-10T23:25:15.543208+0000","last_fullsized":"2024-09-10T23:25:15.543208+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:16.047610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539611+0000","last_change":"2024-09-10T23:25:13.869365+0000","last_active":"2024-09-10T23:25:15.539611+0000","last_peered":"2024-09-10T23:25:15.539611+0000","last_clean":"2024-09-10T23:25:15.539611+0000","last_became_active":"2024-09-10T23:25:13.869097+0000","last_became_peered":"2024-09-10T23:25:13.869097+0000","last_unstale":"2024-09-10T23:25:15.539611+0000","last_undegraded":"2024-09-10T23:25:15.539611+0000","last_fullsized":"2024-09-10T23:25:15.539611+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:57.674366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"143'8","reported_seq":23,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849356+0000","last_change":"2024-09-10T23:25:12.860677+0000","last_active":"2024-09-10T23:25:14.849356+0000","last_peered":"2024-09-10T23:25:14.849356+0000","last_clean":"2024-09-10T23:25:14.849356+0000","last_became_active":"2024-09-10T23:25:12.860380+0000","last_became_peered":"2024-09-10T23:25:12.860380+0000","last_unstale":"2024-09-10T23:25:14.849356+0000","last_undegraded":"2024-09-10T23:25:14.849356+0000","last_fullsized":"2024-09-10T23:25:14.849356+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:06.604930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543016+0000","last_change":"2024-09-10T23:25:13.873862+0000","last_active":"2024-09-10T23:25:15.543016+0000","last_peered":"2024-09-10T23:25:15.543016+0000","last_clean":"2024-09-10T23:25:15.543016+0000","last_became_active":"2024-09-10T23:25:13.873313+0000","last_became_peered":"2024-09-10T23:25:13.873313+0000","last_unstale":"2024-09-10T23:25:15.543016+0000","last_undegraded":"2024-09-10T23:25:15.543016+0000","last_fullsized":"2024-09-10T23:25:15.543016+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:01.634211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"143'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.879076+0000","last_change":"2024-09-10T23:25:12.872714+0000","last_active":"2024-09-10T23:25:13.879076+0000","last_peered":"2024-09-10T23:25:13.879076+0000","last_clean":"2024-09-10T23:25:13.879076+0000","last_became_active":"2024-09-10T23:25:12.872395+0000","last_became_peered":"2024-09-10T23:25:12.872395+0000","last_unstale":"2024-09-10T23:25:13.879076+0000","last_undegraded":"2024-09-10T23:25:13.879076+0000","last_fullsized":"2024-09-10T23:25:13.879076+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:24.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168048+0000","last_change":"2024-09-10T23:25:13.883771+0000","last_active":"2024-09-10T23:25:15.168048+0000","last_peered":"2024-09-10T23:25:15.168048+0000","last_clean":"2024-09-10T23:25:15.168048+0000","last_became_active":"2024-09-10T23:25:13.883497+0000","last_became_peered":"2024-09-10T23:25:13.883497+0000","last_unstale":"2024-09-10T23:25:15.168048+0000","last_undegraded":"2024-09-10T23:25:15.168048+0000","last_fullsized":"2024-09-10T23:25:15.168048+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:09.361672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543952+0000","last_change":"2024-09-10T23:25:12.869708+0000","last_active":"2024-09-10T23:25:15.543952+0000","last_peered":"2024-09-10T23:25:15.543952+0000","last_clean":"2024-09-10T23:25:15.543952+0000","last_became_active":"2024-09-10T23:25:12.869271+0000","last_became_peered":"2024-09-10T23:25:12.869271+0000","last_unstale":"2024-09-10T23:25:15.543952+0000","last_undegraded":"2024-09-10T23:25:15.543952+0000","last_fullsized":"2024-09-10T23:25:15.543952+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:03.491852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168211+0000","last_change":"2024-09-10T23:25:13.872726+0000","last_active":"2024-09-10T23:25:15.168211+0000","last_peered":"2024-09-10T23:25:15.168211+0000","last_clean":"2024-09-10T23:25:15.168211+0000","last_became_active":"2024-09-10T23:25:13.872469+0000","last_became_peered":"2024-09-10T23:25:13.872469+0000","last_unstale":"2024-09-10T23:25:15.168211+0000","last_undegraded":"2024-09-10T23:25:15.168211+0000","last_fullsized":"2024-09-10T23:25:15.168211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:17.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849871+0000","last_change":"2024-09-10T23:25:12.858520+0000","last_active":"2024-09-10T23:25:14.849871+0000","last_peered":"2024-09-10T23:25:14.849871+0000","last_clean":"2024-09-10T23:25:14.849871+0000","last_became_active":"2024-09-10T23:25:12.858244+0000","last_became_peered":"2024-09-10T23:25:12.858244+0000","last_unstale":"2024-09-10T23:25:14.849871+0000","last_undegraded":"2024-09-10T23:25:14.849871+0000","last_fullsized":"2024-09-10T23:25:14.849871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:44.403969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.871379+0000","last_change":"2024-09-10T23:25:13.869640+0000","last_active":"2024-09-10T23:25:13.871379+0000","last_peered":"2024-09-10T23:25:13.871379+0000","last_clean":"2024-09-10T23:25:13.871379+0000","last_became_active":"2024-09-10T23:25:13.869369+0000","last_became_peered":"2024-09-10T23:25:13.869369+0000","last_unstale":"2024-09-10T23:25:13.871379+0000","last_undegraded":"2024-09-10T23:25:13.871379+0000","last_fullsized":"2024-09-10T23:25:13.871379+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.521443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539560+0000","last_change":"2024-09-10T23:25:12.865263+0000","last_active":"2024-09-10T23:25:15.539560+0000","last_peered":"2024-09-10T23:25:15.539560+0000","last_clean":"2024-09-10T23:25:15.539560+0000","last_became_active":"2024-09-10T23:25:12.863466+0000","last_became_peered":"2024-09-10T23:25:12.863466+0000","last_unstale":"2024-09-10T23:25:15.539560+0000","last_undegraded":"2024-09-10T23:25:15.539560+0000","last_fullsized":"2024-09-10T23:25:15.539560+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:44.648714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539565+0000","last_change":"2024-09-10T23:25:13.864977+0000","last_active":"2024-09-10T23:25:15.539565+0000","last_peered":"2024-09-10T23:25:15.539565+0000","last_clean":"2024-09-10T23:25:15.539565+0000","last_became_active":"2024-09-10T23:25:13.864697+0000","last_became_peered":"2024-09-10T23:25:13.864697+0000","last_unstale":"2024-09-10T23:25:15.539565+0000","last_undegraded":"2024-09-10T23:25:15.539565+0000","last_fullsized":"2024-09-10T23:25:15.539565+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:08.249549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854312+0000","last_change":"2024-09-10T23:25:12.867813+0000","last_active":"2024-09-10T23:25:14.854312+0000","last_peered":"2024-09-10T23:25:14.854312+0000","last_clean":"2024-09-10T23:25:14.854312+0000","last_became_active":"2024-09-10T23:25:12.867541+0000","last_became_peered":"2024-09-10T23:25:12.867541+0000","last_unstale":"2024-09-10T23:25:14.854312+0000","last_undegraded":"2024-09-10T23:25:14.854312+0000","last_fullsized":"2024-09-10T23:25:14.854312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.866595+0000","last_change":"2024-09-10T23:25:13.860966+0000","last_active":"2024-09-10T23:25:13.866595+0000","last_peered":"2024-09-10T23:25:13.866595+0000","last_clean":"2024-09-10T23:25:13.866595+0000","last_became_active":"2024-09-10T23:25:13.860080+0000","last_became_peered":"2024-09-10T23:25:13.860080+0000","last_unstale":"2024-09-10T23:25:13.866595+0000","last_undegraded":"2024-09-10T23:25:13.866595+0000","last_fullsized":"2024-09-10T23:25:13.866595+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:01.935345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.853652+0000","last_change":"2024-09-10T23:25:12.871815+0000","last_active":"2024-09-10T23:25:13.853652+0000","last_peered":"2024-09-10T23:25:13.853652+0000","last_clean":"2024-09-10T23:25:13.853652+0000","last_became_active":"2024-09-10T23:25:12.871500+0000","last_became_peered":"2024-09-10T23:25:12.871500+0000","last_unstale":"2024-09-10T23:25:13.853652+0000","last_undegraded":"2024-09-10T23:25:13.853652+0000","last_fullsized":"2024-09-10T23:25:13.853652+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:27.313249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539699+0000","last_change":"2024-09-10T23:25:13.874902+0000","last_active":"2024-09-10T23:25:15.539699+0000","last_peered":"2024-09-10T23:25:15.539699+0000","last_clean":"2024-09-10T23:25:15.539699+0000","last_became_active":"2024-09-10T23:25:13.874194+0000","last_became_peered":"2024-09-10T23:25:13.874194+0000","last_unstale":"2024-09-10T23:25:15.539699+0000","last_undegraded":"2024-09-10T23:25:15.539699+0000","last_fullsized":"2024-09-10T23:25:15.539699+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:08.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:12.869257+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:12.868744+0000","last_became_peered":"2024-09-10T23:25:12.868744+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:10.106175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881361+0000","last_change":"2024-09-10T23:25:13.877129+0000","last_active":"2024-09-10T23:25:13.881361+0000","last_peered":"2024-09-10T23:25:13.881361+0000","last_clean":"2024-09-10T23:25:13.881361+0000","last_became_active":"2024-09-10T23:25:13.876849+0000","last_became_peered":"2024-09-10T23:25:13.876849+0000","last_unstale":"2024-09-10T23:25:13.881361+0000","last_undegraded":"2024-09-10T23:25:13.881361+0000","last_fullsized":"2024-09-10T23:25:13.881361+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:24.911994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849479+0000","last_change":"2024-09-10T23:25:12.869026+0000","last_active":"2024-09-10T23:25:14.849479+0000","last_peered":"2024-09-10T23:25:14.849479+0000","last_clean":"2024-09-10T23:25:14.849479+0000","last_became_active":"2024-09-10T23:25:12.868703+0000","last_became_peered":"2024-09-10T23:25:12.868703+0000","last_unstale":"2024-09-10T23:25:14.849479+0000","last_undegraded":"2024-09-10T23:25:14.849479+0000","last_fullsized":"2024-09-10T23:25:14.849479+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539219+0000","last_change":"2024-09-10T23:25:13.874349+0000","last_active":"2024-09-10T23:25:15.539219+0000","last_peered":"2024-09-10T23:25:15.539219+0000","last_clean":"2024-09-10T23:25:15.539219+0000","last_became_active":"2024-09-10T23:25:13.874070+0000","last_became_peered":"2024-09-10T23:25:13.874070+0000","last_unstale":"2024-09-10T23:25:15.539219+0000","last_undegraded":"2024-09-10T23:25:15.539219+0000","last_fullsized":"2024-09-10T23:25:15.539219+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:06.242809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"143'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.888059+0000","last_change":"2024-09-10T23:25:12.867865+0000","last_active":"2024-09-10T23:25:13.888059+0000","last_peered":"2024-09-10T23:25:13.888059+0000","last_clean":"2024-09-10T23:25:13.888059+0000","last_became_active":"2024-09-10T23:25:12.867588+0000","last_became_peered":"2024-09-10T23:25:12.867588+0000","last_unstale":"2024-09-10T23:25:13.888059+0000","last_undegraded":"2024-09-10T23:25:13.888059+0000","last_fullsized":"2024-09-10T23:25:13.888059+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:34.917685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543230+0000","last_change":"2024-09-10T23:25:13.870979+0000","last_active":"2024-09-10T23:25:15.543230+0000","last_peered":"2024-09-10T23:25:15.543230+0000","last_clean":"2024-09-10T23:25:15.543230+0000","last_became_active":"2024-09-10T23:25:13.870036+0000","last_became_peered":"2024-09-10T23:25:13.870036+0000","last_unstale":"2024-09-10T23:25:15.543230+0000","last_undegraded":"2024-09-10T23:25:15.543230+0000","last_fullsized":"2024-09-10T23:25:15.543230+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:34.682442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854692+0000","last_change":"2024-09-10T23:25:12.873264+0000","last_active":"2024-09-10T23:25:14.854692+0000","last_peered":"2024-09-10T23:25:14.854692+0000","last_clean":"2024-09-10T23:25:14.854692+0000","last_became_active":"2024-09-10T23:25:12.872396+0000","last_became_peered":"2024-09-10T23:25:12.872396+0000","last_unstale":"2024-09-10T23:25:14.854692+0000","last_undegraded":"2024-09-10T23:25:14.854692+0000","last_fullsized":"2024-09-10T23:25:14.854692+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167852+0000","last_change":"2024-09-10T23:25:13.882067+0000","last_active":"2024-09-10T23:25:15.167852+0000","last_peered":"2024-09-10T23:25:15.167852+0000","last_clean":"2024-09-10T23:25:15.167852+0000","last_became_active":"2024-09-10T23:25:13.877949+0000","last_became_peered":"2024-09-10T23:25:13.877949+0000","last_unstale":"2024-09-10T23:25:15.167852+0000","last_undegraded":"2024-09-10T23:25:15.167852+0000","last_fullsized":"2024-09-10T23:25:15.167852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:50.603669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854542+0000","last_change":"2024-09-10T23:25:12.870970+0000","last_active":"2024-09-10T23:25:14.854542+0000","last_peered":"2024-09-10T23:25:14.854542+0000","last_clean":"2024-09-10T23:25:14.854542+0000","last_became_active":"2024-09-10T23:25:12.870538+0000","last_became_peered":"2024-09-10T23:25:12.870538+0000","last_unstale":"2024-09-10T23:25:14.854542+0000","last_undegraded":"2024-09-10T23:25:14.854542+0000","last_fullsized":"2024-09-10T23:25:14.854542+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.858411+0000","last_change":"2024-09-10T23:25:13.855869+0000","last_active":"2024-09-10T23:25:13.858411+0000","last_peered":"2024-09-10T23:25:13.858411+0000","last_clean":"2024-09-10T23:25:13.858411+0000","last_became_active":"2024-09-10T23:25:13.855567+0000","last_became_peered":"2024-09-10T23:25:13.855567+0000","last_unstale":"2024-09-10T23:25:13.858411+0000","last_undegraded":"2024-09-10T23:25:13.858411+0000","last_fullsized":"2024-09-10T23:25:13.858411+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:13.882085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849680+0000","last_change":"2024-09-10T23:25:12.868622+0000","last_active":"2024-09-10T23:25:14.849680+0000","last_peered":"2024-09-10T23:25:14.849680+0000","last_clean":"2024-09-10T23:25:14.849680+0000","last_became_active":"2024-09-10T23:25:12.868338+0000","last_became_peered":"2024-09-10T23:25:12.868338+0000","last_unstale":"2024-09-10T23:25:14.849680+0000","last_undegraded":"2024-09-10T23:25:14.849680+0000","last_fullsized":"2024-09-10T23:25:14.849680+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849579+0000","last_change":"2024-09-10T23:25:13.869075+0000","last_active":"2024-09-10T23:25:14.849579+0000","last_peered":"2024-09-10T23:25:14.849579+0000","last_clean":"2024-09-10T23:25:14.849579+0000","last_became_active":"2024-09-10T23:25:13.868451+0000","last_became_peered":"2024-09-10T23:25:13.868451+0000","last_unstale":"2024-09-10T23:25:14.849579+0000","last_undegraded":"2024-09-10T23:25:14.849579+0000","last_fullsized":"2024-09-10T23:25:14.849579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:47.345674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.859960+0000","last_change":"2024-09-10T23:25:12.872334+0000","last_active":"2024-09-10T23:25:13.859960+0000","last_peered":"2024-09-10T23:25:13.859960+0000","last_clean":"2024-09-10T23:25:13.859960+0000","last_became_active":"2024-09-10T23:25:12.871522+0000","last_became_peered":"2024-09-10T23:25:12.871522+0000","last_unstale":"2024-09-10T23:25:13.859960+0000","last_undegraded":"2024-09-10T23:25:13.859960+0000","last_fullsized":"2024-09-10T23:25:13.859960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:38.706629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849806+0000","last_change":"2024-09-10T23:25:13.869176+0000","last_active":"2024-09-10T23:25:14.849806+0000","last_peered":"2024-09-10T23:25:14.849806+0000","last_clean":"2024-09-10T23:25:14.849806+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:14.849806+0000","last_undegraded":"2024-09-10T23:25:14.849806+0000","last_fullsized":"2024-09-10T23:25:14.849806+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:11.171142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168230+0000","last_change":"2024-09-10T23:25:12.867607+0000","last_active":"2024-09-10T23:25:15.168230+0000","last_peered":"2024-09-10T23:25:15.168230+0000","last_clean":"2024-09-10T23:25:15.168230+0000","last_became_active":"2024-09-10T23:25:12.865003+0000","last_became_peered":"2024-09-10T23:25:12.865003+0000","last_unstale":"2024-09-10T23:25:15.168230+0000","last_undegraded":"2024-09-10T23:25:15.168230+0000","last_fullsized":"2024-09-10T23:25:15.168230+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:25.534423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849577+0000","last_change":"2024-09-10T23:25:13.877088+0000","last_active":"2024-09-10T23:25:14.849577+0000","last_peered":"2024-09-10T23:25:14.849577+0000","last_clean":"2024-09-10T23:25:14.849577+0000","last_became_active":"2024-09-10T23:25:13.876820+0000","last_became_peered":"2024-09-10T23:25:13.876820+0000","last_unstale":"2024-09-10T23:25:14.849577+0000","last_undegraded":"2024-09-10T23:25:14.849577+0000","last_fullsized":"2024-09-10T23:25:14.849577+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849440+0000","last_change":"2024-09-10T23:25:12.855796+0000","last_active":"2024-09-10T23:25:14.849440+0000","last_peered":"2024-09-10T23:25:14.849440+0000","last_clean":"2024-09-10T23:25:14.849440+0000","last_became_active":"2024-09-10T23:25:12.855449+0000","last_became_peered":"2024-09-10T23:25:12.855449+0000","last_unstale":"2024-09-10T23:25:14.849440+0000","last_undegraded":"2024-09-10T23:25:14.849440+0000","last_fullsized":"2024-09-10T23:25:14.849440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168525+0000","last_change":"2024-09-10T23:25:13.880032+0000","last_active":"2024-09-10T23:25:15.168525+0000","last_peered":"2024-09-10T23:25:15.168525+0000","last_clean":"2024-09-10T23:25:15.168525+0000","last_became_active":"2024-09-10T23:25:13.879777+0000","last_became_peered":"2024-09-10T23:25:13.879777+0000","last_unstale":"2024-09-10T23:25:15.168525+0000","last_undegraded":"2024-09-10T23:25:15.168525+0000","last_fullsized":"2024-09-10T23:25:15.168525+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:52.516915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539380+0000","last_change":"2024-09-10T23:25:12.864319+0000","last_active":"2024-09-10T23:25:15.539380+0000","last_peered":"2024-09-10T23:25:15.539380+0000","last_clean":"2024-09-10T23:25:15.539380+0000","last_became_active":"2024-09-10T23:25:12.864040+0000","last_became_peered":"2024-09-10T23:25:12.864040+0000","last_unstale":"2024-09-10T23:25:15.539380+0000","last_undegraded":"2024-09-10T23:25:15.539380+0000","last_fullsized":"2024-09-10T23:25:15.539380+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.439090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543804+0000","last_change":"2024-09-10T23:25:13.873870+0000","last_active":"2024-09-10T23:25:15.543804+0000","last_peered":"2024-09-10T23:25:15.543804+0000","last_clean":"2024-09-10T23:25:15.543804+0000","last_became_active":"2024-09-10T23:25:13.873421+0000","last_became_peered":"2024-09-10T23:25:13.873421+0000","last_unstale":"2024-09-10T23:25:15.543804+0000","last_undegraded":"2024-09-10T23:25:15.543804+0000","last_fullsized":"2024-09-10T23:25:15.543804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167955+0000","last_change":"2024-09-10T23:25:12.867113+0000","last_active":"2024-09-10T23:25:15.167955+0000","last_peered":"2024-09-10T23:25:15.167955+0000","last_clean":"2024-09-10T23:25:15.167955+0000","last_became_active":"2024-09-10T23:25:12.866816+0000","last_became_peered":"2024-09-10T23:25:12.866816+0000","last_unstale":"2024-09-10T23:25:15.167955+0000","last_undegraded":"2024-09-10T23:25:15.167955+0000","last_fullsized":"2024-09-10T23:25:15.167955+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:40.361003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":329,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167673+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:25:15.167673+0000","last_peered":"2024-09-10T23:25:15.167673+0000","last_clean":"2024-09-10T23:25:15.167673+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:25:15.167673+0000","last_undegraded":"2024-09-10T23:25:15.167673+0000","last_fullsized":"2024-09-10T23:25:15.167673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46832,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325008,"statfs":{"total":96636764160,"available":96588808192,"internally_reserved":0,"allocated":1798144,"data_stored":841884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509562,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64048,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307792,"statfs":{"total":96636764160,"available":96571179008,"internally_reserved":0,"allocated":2387968,"data_stored":1426590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59300,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312540,"statfs":{"total":96636764160,"available":96576040960,"internally_reserved":0,"allocated":1781760,"data_stored":834542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64876,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306964,"statfs":{"total":96636764160,"available":96570331136,"internally_reserved":0,"allocated":1789952,"data_stored":841212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509561,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69040,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302800,"statfs":{"total":96636764160,"available":96566067200,"internally_reserved":0,"allocated":1785856,"data_stored":835136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509562,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55152,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316688,"statfs":{"total":96636764160,"available":96580288512,"internally_reserved":0,"allocated":1794048,"data_stored":841282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509561,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73768,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298072,"statfs":{"total":96636764160,"available":96561225728,"internally_reserved":0,"allocated":2379776,"data_stored":1424944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46844,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324996,"statfs":{"total":96636764160,"available":96588795904,"internally_reserved":0,"allocated":1806336,"data_stored":842894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:25:18.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:25:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.002+0000 7f62a0200640 1 -- 172.21.15.17:0/3294085809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 msgr2=0x7f62980ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.002+0000 7f62a0200640 1 --2- 172.21.15.17:0/3294085809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 0x7f62980ccf80 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f6290009bc0 tx=0x7f629001cba0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.002+0000 7f62a0200640 1 -- 172.21.15.17:0/3294085809 shutdown_connections 2024-09-10T23:25:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.002+0000 7f62a0200640 1 --2- 172.21.15.17:0/3294085809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 0x7f62980ccf80 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.002+0000 7f62a0200640 1 -- 172.21.15.17:0/3294085809 >> 172.21.15.17:0/3294085809 conn(0x7f62980d1d60 msgr2=0x7f62980d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.002+0000 7f62a0200640 1 -- 172.21.15.17:0/3294085809 shutdown_connections 2024-09-10T23:25:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.002+0000 7f62a0200640 1 -- 172.21.15.17:0/3294085809 wait complete. 2024-09-10T23:25:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.002+0000 7f62a0200640 1 Processor -- start 2024-09-10T23:25:19.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.002+0000 7f62a0200640 1 -- start start 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f62a0200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6298070ad0 0x7f629814dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f62a0200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 0x7f62980b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f62a0200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f629815f770 0x7f62980b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f62a0200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f629816a550 con 0x7f62980d1830 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f62a0200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f629816a3d0 con 0x7f6298070ad0 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f62a0200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f629816a6d0 con 0x7f629815f770 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 0x7f62980b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 0x7f62980b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55952/0 (socket says 172.21.15.17:55952) 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629ce00640 1 -- 172.21.15.17:0/3727759193 learned_addr learned my addr 172.21.15.17:0/3727759193 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629d800640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6298070ad0 0x7f629814dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629e200640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f629815f770 0x7f62980b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629ce00640 1 -- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f629815f770 msgr2=0x7f62980b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629ce00640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f629815f770 0x7f62980b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629ce00640 1 -- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6298070ad0 msgr2=0x7f629814dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629ce00640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6298070ad0 0x7f629814dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629ce00640 1 -- 172.21.15.17:0/3727759193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629814e490 con 0x7f62980d1830 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f629ce00640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 0x7f62980b3ef0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f628400c3c0 tx=0x7f628400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f6295600640 1 -- 172.21.15.17:0/3727759193 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284017070 con 0x7f62980d1830 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f6295600640 1 -- 172.21.15.17:0/3727759193 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62840053c0 con 0x7f62980d1830 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629814e750 con 0x7f62980d1830 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f6295600640 1 -- 172.21.15.17:0/3727759193 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284003860 con 0x7f62980d1830 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f629814ed10 con 0x7f62980d1830 2024-09-10T23:25:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.006+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f629815f060 con 0x7f62980d1830 2024-09-10T23:25:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.010+0000 7f6295600640 1 -- 172.21.15.17:0/3727759193 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6284003a00 con 0x7f62980d1830 2024-09-10T23:25:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.010+0000 7f6295600640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62780725e0 0x7f6278074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.010+0000 7f6295600640 1 -- 172.21.15.17:0/3727759193 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f6284092a10 con 0x7f62980d1830 2024-09-10T23:25:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.010+0000 7f629d800640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62780725e0 0x7f6278074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.010+0000 7f629d800640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62780725e0 0x7f6278074aa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f628c0046c0 tx=0x7f628c007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:19.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.014+0000 7f6295600640 1 -- 172.21.15.17:0/3727759193 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f628405d7e0 con 0x7f62980d1830 2024-09-10T23:25:19.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6298157d50 con 0x7f62980d1830 2024-09-10T23:25:19.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f6295600640 1 -- 172.21.15.17:0/3727759193 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1477 (secure 0 0 0) 0x7f6284062210 con 0x7f62980d1830 2024-09-10T23:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":608,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":491376640,"bytes_avail":772602736640,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-10T23:25:02.429010+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:25:19.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62780725e0 msgr2=0x7f6278074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62780725e0 0x7f6278074aa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f628c0046c0 tx=0x7f628c007ec0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 msgr2=0x7f62980b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 0x7f62980b3ef0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f628400c3c0 tx=0x7f628400c880 comp rx=0 tx=0).stop 2024-09-10T23:25:19.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 shutdown_connections 2024-09-10T23:25:19.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62780725e0 0x7f6278074aa0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f629815f770 0x7f62980b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62980d1830 0x7f62980b3ef0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 --2- 172.21.15.17:0/3727759193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6298070ad0 0x7f629814dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 >> 172.21.15.17:0/3727759193 conn(0x7f62980d1d60 msgr2=0x7f62981572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:19.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 shutdown_connections 2024-09-10T23:25:19.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.250+0000 7f62a0200640 1 -- 172.21.15.17:0/3727759193 wait complete. 2024-09-10T23:25:19.273 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:25:19.273 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:25:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.414+0000 7f056ca00640 1 -- 172.21.15.17:0/2672014263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05680d0030 msgr2=0x7f05680d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.414+0000 7f056ca00640 1 --2- 172.21.15.17:0/2672014263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05680d0030 0x7f05680d0460 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f0568072880 tx=0x7f056001cd50 comp rx=0 tx=0).stop 2024-09-10T23:25:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.414+0000 7f056ca00640 1 -- 172.21.15.17:0/2672014263 shutdown_connections 2024-09-10T23:25:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.414+0000 7f056ca00640 1 --2- 172.21.15.17:0/2672014263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05680d0030 0x7f05680d0460 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.414+0000 7f056ca00640 1 --2- 172.21.15.17:0/2672014263 >> v2:172.21.15.77:3300/0 conn(0x7f056815ef40 0x7f056815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.414+0000 7f056ca00640 1 -- 172.21.15.17:0/2672014263 >> 172.21.15.17:0/2672014263 conn(0x7f056806cfc0 msgr2=0x7f056806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.414+0000 7f056ca00640 1 -- 172.21.15.17:0/2672014263 shutdown_connections 2024-09-10T23:25:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.414+0000 7f056ca00640 1 -- 172.21.15.17:0/2672014263 wait complete. 2024-09-10T23:25:19.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 Processor -- start 2024-09-10T23:25:19.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 -- start start 2024-09-10T23:25:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05680d0030 0x7f056814d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f056815e5d0 0x7f0568164a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f056815ef40 0x7f05680b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0568167c00 con 0x7f056815e5d0 2024-09-10T23:25:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0568167a80 con 0x7f05680d0030 2024-09-10T23:25:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0568167d80 con 0x7f056815ef40 2024-09-10T23:25:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f056815e5d0 0x7f0568164a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f056815e5d0 0x7f0568164a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55966/0 (socket says 172.21.15.17:55966) 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055fe00640 1 -- 172.21.15.17:0/3323845202 learned_addr learned my addr 172.21.15.17:0/3323845202 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f0565e00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05680d0030 0x7f056814d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f0566800640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f056815ef40 0x7f05680b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055fe00640 1 -- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f056815ef40 msgr2=0x7f05680b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055fe00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f056815ef40 0x7f05680b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055fe00640 1 -- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05680d0030 msgr2=0x7f056814d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055fe00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05680d0030 0x7f056814d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055fe00640 1 -- 172.21.15.17:0/3323845202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0568164fc0 con 0x7f056815e5d0 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055fe00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f056815e5d0 0x7f0568164a80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f055000c500 tx=0x7f055000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055e000640 1 -- 172.21.15.17:0/3323845202 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550017070 con 0x7f056815e5d0 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055e000640 1 -- 172.21.15.17:0/3323845202 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05500053c0 con 0x7f056815e5d0 2024-09-10T23:25:19.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f055e000640 1 -- 172.21.15.17:0/3323845202 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550012890 con 0x7f056815e5d0 2024-09-10T23:25:19.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05681fb140 con 0x7f056815e5d0 2024-09-10T23:25:19.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.418+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05681fb700 con 0x7f056815e5d0 2024-09-10T23:25:19.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.422+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05680d0460 con 0x7f056815e5d0 2024-09-10T23:25:19.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.422+0000 7f055e000640 1 -- 172.21.15.17:0/3323845202 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0550003600 con 0x7f056815e5d0 2024-09-10T23:25:19.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.422+0000 7f055e000640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05440725e0 0x7f0544074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:19.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.422+0000 7f055e000640 1 -- 172.21.15.17:0/3323845202 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f0550092990 con 0x7f056815e5d0 2024-09-10T23:25:19.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.422+0000 7f0565e00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05440725e0 0x7f0544074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:19.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.422+0000 7f0565e00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05440725e0 0x7f0544074aa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f05680b2700 tx=0x7f05580091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:19.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.426+0000 7f055e000640 1 -- 172.21.15.17:0/3323845202 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f055005d800 con 0x7f056815e5d0 2024-09-10T23:25:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.598+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05681faef0 con 0x7f05440725e0 2024-09-10T23:25:19.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.602+0000 7f055e000640 1 -- 172.21.15.17:0/3323845202 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252471 (secure 0 0 0) 0x7f05681faef0 con 0x7f05440725e0 2024-09-10T23:25:19.607 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:19.609 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:25:19.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05440725e0 msgr2=0x7f0544074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05440725e0 0x7f0544074aa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f05680b2700 tx=0x7f05580091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f056815e5d0 msgr2=0x7f0568164a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f056815e5d0 0x7f0568164a80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f055000c500 tx=0x7f055000c9c0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 shutdown_connections 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05440725e0 0x7f0544074aa0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f056815ef40 0x7f05680b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f056815e5d0 0x7f0568164a80 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 --2- 172.21.15.17:0/3323845202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05680d0030 0x7f056814d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 >> 172.21.15.17:0/3323845202 conn(0x7f056806cfc0 msgr2=0x7f056806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 shutdown_connections 2024-09-10T23:25:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:19.606+0000 7f056ca00640 1 -- 172.21.15.17:0/3323845202 wait complete. 2024-09-10T23:25:19.628 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2024-09-10T23:25:18.432561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":479860,"kb_used_data":15160,"kb_used_omap":12,"kb_used_meta":464499,"kb_avail":754494860,"statfs":{"total":773094113280,"available":772602736640,"internally_reserved":0,"allocated":15523840,"data_stored":7888484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":475647537},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001628"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.870355+0000","last_change":"2024-09-10T23:25:13.865559+0000","last_active":"2024-09-10T23:25:13.870355+0000","last_peered":"2024-09-10T23:25:13.870355+0000","last_clean":"2024-09-10T23:25:13.870355+0000","last_became_active":"2024-09-10T23:25:13.865244+0000","last_became_peered":"2024-09-10T23:25:13.865244+0000","last_unstale":"2024-09-10T23:25:13.870355+0000","last_undegraded":"2024-09-10T23:25:13.870355+0000","last_fullsized":"2024-09-10T23:25:13.870355+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:07.293961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.874913+0000","last_change":"2024-09-10T23:25:13.869884+0000","last_active":"2024-09-10T23:25:13.874913+0000","last_peered":"2024-09-10T23:25:13.874913+0000","last_clean":"2024-09-10T23:25:13.874913+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:13.874913+0000","last_undegraded":"2024-09-10T23:25:13.874913+0000","last_fullsized":"2024-09-10T23:25:13.874913+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:07.467267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543691+0000","last_change":"2024-09-10T23:25:13.873797+0000","last_active":"2024-09-10T23:25:15.543691+0000","last_peered":"2024-09-10T23:25:15.543691+0000","last_clean":"2024-09-10T23:25:15.543691+0000","last_became_active":"2024-09-10T23:25:13.873417+0000","last_became_peered":"2024-09-10T23:25:13.873417+0000","last_unstale":"2024-09-10T23:25:15.543691+0000","last_undegraded":"2024-09-10T23:25:15.543691+0000","last_fullsized":"2024-09-10T23:25:15.543691+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.073999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.876094+0000","last_change":"2024-09-10T23:25:13.871941+0000","last_active":"2024-09-10T23:25:13.876094+0000","last_peered":"2024-09-10T23:25:13.876094+0000","last_clean":"2024-09-10T23:25:13.876094+0000","last_became_active":"2024-09-10T23:25:13.871660+0000","last_became_peered":"2024-09-10T23:25:13.871660+0000","last_unstale":"2024-09-10T23:25:13.876094+0000","last_undegraded":"2024-09-10T23:25:13.876094+0000","last_fullsized":"2024-09-10T23:25:13.876094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:22.732044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539081+0000","last_change":"2024-09-10T23:25:13.864537+0000","last_active":"2024-09-10T23:25:15.539081+0000","last_peered":"2024-09-10T23:25:15.539081+0000","last_clean":"2024-09-10T23:25:15.539081+0000","last_became_active":"2024-09-10T23:25:13.862390+0000","last_became_peered":"2024-09-10T23:25:13.862390+0000","last_unstale":"2024-09-10T23:25:15.539081+0000","last_undegraded":"2024-09-10T23:25:15.539081+0000","last_fullsized":"2024-09-10T23:25:15.539081+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:09.158036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849317+0000","last_change":"2024-09-10T23:25:13.869860+0000","last_active":"2024-09-10T23:25:14.849317+0000","last_peered":"2024-09-10T23:25:14.849317+0000","last_clean":"2024-09-10T23:25:14.849317+0000","last_became_active":"2024-09-10T23:25:13.869577+0000","last_became_peered":"2024-09-10T23:25:13.869577+0000","last_unstale":"2024-09-10T23:25:14.849317+0000","last_undegraded":"2024-09-10T23:25:14.849317+0000","last_fullsized":"2024-09-10T23:25:14.849317+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:41.363760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167998+0000","last_change":"2024-09-10T23:25:13.882785+0000","last_active":"2024-09-10T23:25:15.167998+0000","last_peered":"2024-09-10T23:25:15.167998+0000","last_clean":"2024-09-10T23:25:15.167998+0000","last_became_active":"2024-09-10T23:25:13.877627+0000","last_became_peered":"2024-09-10T23:25:13.877627+0000","last_unstale":"2024-09-10T23:25:15.167998+0000","last_undegraded":"2024-09-10T23:25:15.167998+0000","last_fullsized":"2024-09-10T23:25:15.167998+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:44.875736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854072+0000","last_change":"2024-09-10T23:25:13.867473+0000","last_active":"2024-09-10T23:25:14.854072+0000","last_peered":"2024-09-10T23:25:14.854072+0000","last_clean":"2024-09-10T23:25:14.854072+0000","last_became_active":"2024-09-10T23:25:13.867208+0000","last_became_peered":"2024-09-10T23:25:13.867208+0000","last_unstale":"2024-09-10T23:25:14.854072+0000","last_undegraded":"2024-09-10T23:25:14.854072+0000","last_fullsized":"2024-09-10T23:25:14.854072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:19.792842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849974+0000","last_change":"2024-09-10T23:25:13.875490+0000","last_active":"2024-09-10T23:25:14.849974+0000","last_peered":"2024-09-10T23:25:14.849974+0000","last_clean":"2024-09-10T23:25:14.849974+0000","last_became_active":"2024-09-10T23:25:13.875205+0000","last_became_peered":"2024-09-10T23:25:13.875205+0000","last_unstale":"2024-09-10T23:25:14.849974+0000","last_undegraded":"2024-09-10T23:25:14.849974+0000","last_fullsized":"2024-09-10T23:25:14.849974+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:51.185099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.857080+0000","last_change":"2024-09-10T23:25:13.854593+0000","last_active":"2024-09-10T23:25:13.857080+0000","last_peered":"2024-09-10T23:25:13.857080+0000","last_clean":"2024-09-10T23:25:13.857080+0000","last_became_active":"2024-09-10T23:25:13.854336+0000","last_became_peered":"2024-09-10T23:25:13.854336+0000","last_unstale":"2024-09-10T23:25:13.857080+0000","last_undegraded":"2024-09-10T23:25:13.857080+0000","last_fullsized":"2024-09-10T23:25:13.857080+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:56.179524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881188+0000","last_change":"2024-09-10T23:25:13.876510+0000","last_active":"2024-09-10T23:25:13.881188+0000","last_peered":"2024-09-10T23:25:13.881188+0000","last_clean":"2024-09-10T23:25:13.881188+0000","last_became_active":"2024-09-10T23:25:13.876168+0000","last_became_peered":"2024-09-10T23:25:13.876168+0000","last_unstale":"2024-09-10T23:25:13.881188+0000","last_undegraded":"2024-09-10T23:25:13.881188+0000","last_fullsized":"2024-09-10T23:25:13.881188+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:22.257735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.872176+0000","last_change":"2024-09-10T23:25:13.866253+0000","last_active":"2024-09-10T23:25:13.872176+0000","last_peered":"2024-09-10T23:25:13.872176+0000","last_clean":"2024-09-10T23:25:13.872176+0000","last_became_active":"2024-09-10T23:25:13.865309+0000","last_became_peered":"2024-09-10T23:25:13.865309+0000","last_unstale":"2024-09-10T23:25:13.872176+0000","last_undegraded":"2024-09-10T23:25:13.872176+0000","last_fullsized":"2024-09-10T23:25:13.872176+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:22.331722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849866+0000","last_change":"2024-09-10T23:25:13.871849+0000","last_active":"2024-09-10T23:25:14.849866+0000","last_peered":"2024-09-10T23:25:14.849866+0000","last_clean":"2024-09-10T23:25:14.849866+0000","last_became_active":"2024-09-10T23:25:13.871410+0000","last_became_peered":"2024-09-10T23:25:13.871410+0000","last_unstale":"2024-09-10T23:25:14.849866+0000","last_undegraded":"2024-09-10T23:25:14.849866+0000","last_fullsized":"2024-09-10T23:25:14.849866+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:05.732775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875164+0000","last_change":"2024-09-10T23:25:13.871872+0000","last_active":"2024-09-10T23:25:13.875164+0000","last_peered":"2024-09-10T23:25:13.875164+0000","last_clean":"2024-09-10T23:25:13.875164+0000","last_became_active":"2024-09-10T23:25:13.871601+0000","last_became_peered":"2024-09-10T23:25:13.871601+0000","last_unstale":"2024-09-10T23:25:13.875164+0000","last_undegraded":"2024-09-10T23:25:13.875164+0000","last_fullsized":"2024-09-10T23:25:13.875164+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:31.846681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.868359+0000","last_change":"2024-09-10T23:25:13.861355+0000","last_active":"2024-09-10T23:25:13.868359+0000","last_peered":"2024-09-10T23:25:13.868359+0000","last_clean":"2024-09-10T23:25:13.868359+0000","last_became_active":"2024-09-10T23:25:13.860218+0000","last_became_peered":"2024-09-10T23:25:13.860218+0000","last_unstale":"2024-09-10T23:25:13.868359+0000","last_undegraded":"2024-09-10T23:25:13.868359+0000","last_fullsized":"2024-09-10T23:25:13.868359+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:30.917011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849485+0000","last_change":"2024-09-10T23:25:13.863772+0000","last_active":"2024-09-10T23:25:14.849485+0000","last_peered":"2024-09-10T23:25:14.849485+0000","last_clean":"2024-09-10T23:25:14.849485+0000","last_became_active":"2024-09-10T23:25:13.863386+0000","last_became_peered":"2024-09-10T23:25:13.863386+0000","last_unstale":"2024-09-10T23:25:14.849485+0000","last_undegraded":"2024-09-10T23:25:14.849485+0000","last_fullsized":"2024-09-10T23:25:14.849485+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849983+0000","last_change":"2024-09-10T23:25:13.864064+0000","last_active":"2024-09-10T23:25:14.849983+0000","last_peered":"2024-09-10T23:25:14.849983+0000","last_clean":"2024-09-10T23:25:14.849983+0000","last_became_active":"2024-09-10T23:25:13.863786+0000","last_became_peered":"2024-09-10T23:25:13.863786+0000","last_unstale":"2024-09-10T23:25:14.849983+0000","last_undegraded":"2024-09-10T23:25:14.849983+0000","last_fullsized":"2024-09-10T23:25:14.849983+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:32.141683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539218+0000","last_change":"2024-09-10T23:25:13.870353+0000","last_active":"2024-09-10T23:25:15.539218+0000","last_peered":"2024-09-10T23:25:15.539218+0000","last_clean":"2024-09-10T23:25:15.539218+0000","last_became_active":"2024-09-10T23:25:13.870057+0000","last_became_peered":"2024-09-10T23:25:13.870057+0000","last_unstale":"2024-09-10T23:25:15.539218+0000","last_undegraded":"2024-09-10T23:25:15.539218+0000","last_fullsized":"2024-09-10T23:25:15.539218+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:51.889316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:13.875171+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:13.874560+0000","last_became_peered":"2024-09-10T23:25:13.874560+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:58.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539399+0000","last_change":"2024-09-10T23:25:13.876342+0000","last_active":"2024-09-10T23:25:15.539399+0000","last_peered":"2024-09-10T23:25:15.539399+0000","last_clean":"2024-09-10T23:25:15.539399+0000","last_became_active":"2024-09-10T23:25:13.875990+0000","last_became_peered":"2024-09-10T23:25:13.875990+0000","last_unstale":"2024-09-10T23:25:15.539399+0000","last_undegraded":"2024-09-10T23:25:15.539399+0000","last_fullsized":"2024-09-10T23:25:15.539399+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:29.164335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875674+0000","last_change":"2024-09-10T23:25:13.871600+0000","last_active":"2024-09-10T23:25:13.875674+0000","last_peered":"2024-09-10T23:25:13.875674+0000","last_clean":"2024-09-10T23:25:13.875674+0000","last_became_active":"2024-09-10T23:25:13.871261+0000","last_became_peered":"2024-09-10T23:25:13.871261+0000","last_unstale":"2024-09-10T23:25:13.875674+0000","last_undegraded":"2024-09-10T23:25:13.875674+0000","last_fullsized":"2024-09-10T23:25:13.875674+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:33.139403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878388+0000","last_change":"2024-09-10T23:25:13.875260+0000","last_active":"2024-09-10T23:25:13.878388+0000","last_peered":"2024-09-10T23:25:13.878388+0000","last_clean":"2024-09-10T23:25:13.878388+0000","last_became_active":"2024-09-10T23:25:13.874961+0000","last_became_peered":"2024-09-10T23:25:13.874961+0000","last_unstale":"2024-09-10T23:25:13.878388+0000","last_undegraded":"2024-09-10T23:25:13.878388+0000","last_fullsized":"2024-09-10T23:25:13.878388+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:19:13.378132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881255+0000","last_change":"2024-09-10T23:25:13.878417+0000","last_active":"2024-09-10T23:25:13.881255+0000","last_peered":"2024-09-10T23:25:13.881255+0000","last_clean":"2024-09-10T23:25:13.881255+0000","last_became_active":"2024-09-10T23:25:13.878116+0000","last_became_peered":"2024-09-10T23:25:13.878116+0000","last_unstale":"2024-09-10T23:25:13.881255+0000","last_undegraded":"2024-09-10T23:25:13.881255+0000","last_fullsized":"2024-09-10T23:25:13.881255+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:16.040337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849229+0000","last_change":"2024-09-10T23:25:13.872929+0000","last_active":"2024-09-10T23:25:14.849229+0000","last_peered":"2024-09-10T23:25:14.849229+0000","last_clean":"2024-09-10T23:25:14.849229+0000","last_became_active":"2024-09-10T23:25:13.870728+0000","last_became_peered":"2024-09-10T23:25:13.870728+0000","last_unstale":"2024-09-10T23:25:14.849229+0000","last_undegraded":"2024-09-10T23:25:14.849229+0000","last_fullsized":"2024-09-10T23:25:14.849229+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544072+0000","last_change":"2024-09-10T23:25:13.876451+0000","last_active":"2024-09-10T23:25:15.544072+0000","last_peered":"2024-09-10T23:25:15.544072+0000","last_clean":"2024-09-10T23:25:15.544072+0000","last_became_active":"2024-09-10T23:25:13.876073+0000","last_became_peered":"2024-09-10T23:25:13.876073+0000","last_unstale":"2024-09-10T23:25:15.544072+0000","last_undegraded":"2024-09-10T23:25:15.544072+0000","last_fullsized":"2024-09-10T23:25:15.544072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544042+0000","last_change":"2024-09-10T23:25:13.881177+0000","last_active":"2024-09-10T23:25:15.544042+0000","last_peered":"2024-09-10T23:25:15.544042+0000","last_clean":"2024-09-10T23:25:15.544042+0000","last_became_active":"2024-09-10T23:25:13.880913+0000","last_became_peered":"2024-09-10T23:25:13.880913+0000","last_unstale":"2024-09-10T23:25:15.544042+0000","last_undegraded":"2024-09-10T23:25:15.544042+0000","last_fullsized":"2024-09-10T23:25:15.544042+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168384+0000","last_change":"2024-09-10T23:25:13.875429+0000","last_active":"2024-09-10T23:25:15.168384+0000","last_peered":"2024-09-10T23:25:15.168384+0000","last_clean":"2024-09-10T23:25:15.168384+0000","last_became_active":"2024-09-10T23:25:13.874893+0000","last_became_peered":"2024-09-10T23:25:13.874893+0000","last_unstale":"2024-09-10T23:25:15.168384+0000","last_undegraded":"2024-09-10T23:25:15.168384+0000","last_fullsized":"2024-09-10T23:25:15.168384+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:47.064911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.856715+0000","last_change":"2024-09-10T23:25:13.853437+0000","last_active":"2024-09-10T23:25:13.856715+0000","last_peered":"2024-09-10T23:25:13.856715+0000","last_clean":"2024-09-10T23:25:13.856715+0000","last_became_active":"2024-09-10T23:25:13.853158+0000","last_became_peered":"2024-09-10T23:25:13.853158+0000","last_unstale":"2024-09-10T23:25:13.856715+0000","last_undegraded":"2024-09-10T23:25:13.856715+0000","last_fullsized":"2024-09-10T23:25:13.856715+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:14.818230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543699+0000","last_change":"2024-09-10T23:25:13.878111+0000","last_active":"2024-09-10T23:25:15.543699+0000","last_peered":"2024-09-10T23:25:15.543699+0000","last_clean":"2024-09-10T23:25:15.543699+0000","last_became_active":"2024-09-10T23:25:13.877815+0000","last_became_peered":"2024-09-10T23:25:13.877815+0000","last_unstale":"2024-09-10T23:25:15.543699+0000","last_undegraded":"2024-09-10T23:25:15.543699+0000","last_fullsized":"2024-09-10T23:25:15.543699+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:33.139403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543716+0000","last_change":"2024-09-10T23:25:13.878758+0000","last_active":"2024-09-10T23:25:15.543716+0000","last_peered":"2024-09-10T23:25:15.543716+0000","last_clean":"2024-09-10T23:25:15.543716+0000","last_became_active":"2024-09-10T23:25:13.878493+0000","last_became_peered":"2024-09-10T23:25:13.878493+0000","last_unstale":"2024-09-10T23:25:15.543716+0000","last_undegraded":"2024-09-10T23:25:15.543716+0000","last_fullsized":"2024-09-10T23:25:15.543716+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:27.113577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854060+0000","last_change":"2024-09-10T23:25:13.869209+0000","last_active":"2024-09-10T23:25:14.854060+0000","last_peered":"2024-09-10T23:25:14.854060+0000","last_clean":"2024-09-10T23:25:14.854060+0000","last_became_active":"2024-09-10T23:25:13.868965+0000","last_became_peered":"2024-09-10T23:25:13.868965+0000","last_unstale":"2024-09-10T23:25:14.854060+0000","last_undegraded":"2024-09-10T23:25:14.854060+0000","last_fullsized":"2024-09-10T23:25:14.854060+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:59.422431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.875736+0000","last_change":"2024-09-10T23:25:13.875122+0000","last_active":"2024-09-10T23:25:13.875736+0000","last_peered":"2024-09-10T23:25:13.875736+0000","last_clean":"2024-09-10T23:25:13.875736+0000","last_became_active":"2024-09-10T23:25:13.874015+0000","last_became_peered":"2024-09-10T23:25:13.874015+0000","last_unstale":"2024-09-10T23:25:13.875736+0000","last_undegraded":"2024-09-10T23:25:13.875736+0000","last_fullsized":"2024-09-10T23:25:13.875736+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:05.311293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854201+0000","last_change":"2024-09-10T23:25:13.869068+0000","last_active":"2024-09-10T23:25:14.854201+0000","last_peered":"2024-09-10T23:25:14.854201+0000","last_clean":"2024-09-10T23:25:14.854201+0000","last_became_active":"2024-09-10T23:25:13.865220+0000","last_became_peered":"2024-09-10T23:25:13.865220+0000","last_unstale":"2024-09-10T23:25:14.854201+0000","last_undegraded":"2024-09-10T23:25:14.854201+0000","last_fullsized":"2024-09-10T23:25:14.854201+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:25.648301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"143'4","reported_seq":19,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543988+0000","last_change":"2024-09-10T23:25:12.873694+0000","last_active":"2024-09-10T23:25:15.543988+0000","last_peered":"2024-09-10T23:25:15.543988+0000","last_clean":"2024-09-10T23:25:15.543988+0000","last_became_active":"2024-09-10T23:25:12.871488+0000","last_became_peered":"2024-09-10T23:25:12.871488+0000","last_unstale":"2024-09-10T23:25:15.543988+0000","last_undegraded":"2024-09-10T23:25:15.543988+0000","last_fullsized":"2024-09-10T23:25:15.543988+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:17.859612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.873431+0000","last_change":"2024-09-10T23:25:13.869377+0000","last_active":"2024-09-10T23:25:13.873431+0000","last_peered":"2024-09-10T23:25:13.873431+0000","last_clean":"2024-09-10T23:25:13.873431+0000","last_became_active":"2024-09-10T23:25:13.869123+0000","last_became_peered":"2024-09-10T23:25:13.869123+0000","last_unstale":"2024-09-10T23:25:13.873431+0000","last_undegraded":"2024-09-10T23:25:13.873431+0000","last_fullsized":"2024-09-10T23:25:13.873431+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:24.587347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539832+0000","last_change":"2024-09-10T23:25:12.864352+0000","last_active":"2024-09-10T23:25:15.539832+0000","last_peered":"2024-09-10T23:25:15.539832+0000","last_clean":"2024-09-10T23:25:15.539832+0000","last_became_active":"2024-09-10T23:25:12.864097+0000","last_became_peered":"2024-09-10T23:25:12.864097+0000","last_unstale":"2024-09-10T23:25:15.539832+0000","last_undegraded":"2024-09-10T23:25:15.539832+0000","last_fullsized":"2024-09-10T23:25:15.539832+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:40.097226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881249+0000","last_change":"2024-09-10T23:25:13.876002+0000","last_active":"2024-09-10T23:25:13.881249+0000","last_peered":"2024-09-10T23:25:13.881249+0000","last_clean":"2024-09-10T23:25:13.881249+0000","last_became_active":"2024-09-10T23:25:13.875699+0000","last_became_peered":"2024-09-10T23:25:13.875699+0000","last_unstale":"2024-09-10T23:25:13.881249+0000","last_undegraded":"2024-09-10T23:25:13.881249+0000","last_fullsized":"2024-09-10T23:25:13.881249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168318+0000","last_change":"2024-09-10T23:25:12.869556+0000","last_active":"2024-09-10T23:25:15.168318+0000","last_peered":"2024-09-10T23:25:15.168318+0000","last_clean":"2024-09-10T23:25:15.168318+0000","last_became_active":"2024-09-10T23:25:12.869278+0000","last_became_peered":"2024-09-10T23:25:12.869278+0000","last_unstale":"2024-09-10T23:25:15.168318+0000","last_undegraded":"2024-09-10T23:25:15.168318+0000","last_fullsized":"2024-09-10T23:25:15.168318+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:56.479420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878651+0000","last_change":"2024-09-10T23:25:13.872607+0000","last_active":"2024-09-10T23:25:13.878651+0000","last_peered":"2024-09-10T23:25:13.878651+0000","last_clean":"2024-09-10T23:25:13.878651+0000","last_became_active":"2024-09-10T23:25:13.872280+0000","last_became_peered":"2024-09-10T23:25:13.872280+0000","last_unstale":"2024-09-10T23:25:13.878651+0000","last_undegraded":"2024-09-10T23:25:13.878651+0000","last_fullsized":"2024-09-10T23:25:13.878651+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:57.011115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168214+0000","last_change":"2024-09-10T23:25:12.865957+0000","last_active":"2024-09-10T23:25:15.168214+0000","last_peered":"2024-09-10T23:25:15.168214+0000","last_clean":"2024-09-10T23:25:15.168214+0000","last_became_active":"2024-09-10T23:25:12.865662+0000","last_became_peered":"2024-09-10T23:25:12.865662+0000","last_unstale":"2024-09-10T23:25:15.168214+0000","last_undegraded":"2024-09-10T23:25:15.168214+0000","last_fullsized":"2024-09-10T23:25:15.168214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:10.168386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854351+0000","last_change":"2024-09-10T23:25:13.868440+0000","last_active":"2024-09-10T23:25:14.854351+0000","last_peered":"2024-09-10T23:25:14.854351+0000","last_clean":"2024-09-10T23:25:14.854351+0000","last_became_active":"2024-09-10T23:25:13.868181+0000","last_became_peered":"2024-09-10T23:25:13.868181+0000","last_unstale":"2024-09-10T23:25:14.854351+0000","last_undegraded":"2024-09-10T23:25:14.854351+0000","last_fullsized":"2024-09-10T23:25:14.854351+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:05.848015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854302+0000","last_change":"2024-09-10T23:25:12.874108+0000","last_active":"2024-09-10T23:25:14.854302+0000","last_peered":"2024-09-10T23:25:14.854302+0000","last_clean":"2024-09-10T23:25:14.854302+0000","last_became_active":"2024-09-10T23:25:12.872828+0000","last_became_peered":"2024-09-10T23:25:12.872828+0000","last_unstale":"2024-09-10T23:25:14.854302+0000","last_undegraded":"2024-09-10T23:25:14.854302+0000","last_fullsized":"2024-09-10T23:25:14.854302+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854662+0000","last_change":"2024-09-10T23:25:13.861557+0000","last_active":"2024-09-10T23:25:14.854662+0000","last_peered":"2024-09-10T23:25:14.854662+0000","last_clean":"2024-09-10T23:25:14.854662+0000","last_became_active":"2024-09-10T23:25:13.861288+0000","last_became_peered":"2024-09-10T23:25:13.861288+0000","last_unstale":"2024-09-10T23:25:14.854662+0000","last_undegraded":"2024-09-10T23:25:14.854662+0000","last_fullsized":"2024-09-10T23:25:14.854662+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:07.467267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539287+0000","last_change":"2024-09-10T23:25:12.861726+0000","last_active":"2024-09-10T23:25:15.539287+0000","last_peered":"2024-09-10T23:25:15.539287+0000","last_clean":"2024-09-10T23:25:15.539287+0000","last_became_active":"2024-09-10T23:25:12.861433+0000","last_became_peered":"2024-09-10T23:25:12.861433+0000","last_unstale":"2024-09-10T23:25:15.539287+0000","last_undegraded":"2024-09-10T23:25:15.539287+0000","last_fullsized":"2024-09-10T23:25:15.539287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:18.517338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539453+0000","last_change":"2024-09-10T23:25:13.876395+0000","last_active":"2024-09-10T23:25:15.539453+0000","last_peered":"2024-09-10T23:25:15.539453+0000","last_clean":"2024-09-10T23:25:15.539453+0000","last_became_active":"2024-09-10T23:25:13.876074+0000","last_became_peered":"2024-09-10T23:25:13.876074+0000","last_unstale":"2024-09-10T23:25:15.539453+0000","last_undegraded":"2024-09-10T23:25:15.539453+0000","last_fullsized":"2024-09-10T23:25:15.539453+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:48.273393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849066+0000","last_change":"2024-09-10T23:25:12.857750+0000","last_active":"2024-09-10T23:25:14.849066+0000","last_peered":"2024-09-10T23:25:14.849066+0000","last_clean":"2024-09-10T23:25:14.849066+0000","last_became_active":"2024-09-10T23:25:12.857460+0000","last_became_peered":"2024-09-10T23:25:12.857460+0000","last_unstale":"2024-09-10T23:25:14.849066+0000","last_undegraded":"2024-09-10T23:25:14.849066+0000","last_fullsized":"2024-09-10T23:25:14.849066+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168579+0000","last_change":"2024-09-10T23:25:13.880336+0000","last_active":"2024-09-10T23:25:15.168579+0000","last_peered":"2024-09-10T23:25:15.168579+0000","last_clean":"2024-09-10T23:25:15.168579+0000","last_became_active":"2024-09-10T23:25:13.877088+0000","last_became_peered":"2024-09-10T23:25:13.877088+0000","last_unstale":"2024-09-10T23:25:15.168579+0000","last_undegraded":"2024-09-10T23:25:15.168579+0000","last_fullsized":"2024-09-10T23:25:15.168579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:30.634846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543073+0000","last_change":"2024-09-10T23:25:12.872243+0000","last_active":"2024-09-10T23:25:15.543073+0000","last_peered":"2024-09-10T23:25:15.543073+0000","last_clean":"2024-09-10T23:25:15.543073+0000","last_became_active":"2024-09-10T23:25:12.870719+0000","last_became_peered":"2024-09-10T23:25:12.870719+0000","last_unstale":"2024-09-10T23:25:15.543073+0000","last_undegraded":"2024-09-10T23:25:15.543073+0000","last_fullsized":"2024-09-10T23:25:15.543073+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:44.618611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.878550+0000","last_change":"2024-09-10T23:25:13.874102+0000","last_active":"2024-09-10T23:25:13.878550+0000","last_peered":"2024-09-10T23:25:13.878550+0000","last_clean":"2024-09-10T23:25:13.878550+0000","last_became_active":"2024-09-10T23:25:13.873768+0000","last_became_peered":"2024-09-10T23:25:13.873768+0000","last_unstale":"2024-09-10T23:25:13.878550+0000","last_undegraded":"2024-09-10T23:25:13.878550+0000","last_fullsized":"2024-09-10T23:25:13.878550+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:37.211577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.864004+0000","last_change":"2024-09-10T23:25:12.867851+0000","last_active":"2024-09-10T23:25:13.864004+0000","last_peered":"2024-09-10T23:25:13.864004+0000","last_clean":"2024-09-10T23:25:13.864004+0000","last_became_active":"2024-09-10T23:25:12.867574+0000","last_became_peered":"2024-09-10T23:25:12.867574+0000","last_unstale":"2024-09-10T23:25:13.864004+0000","last_undegraded":"2024-09-10T23:25:13.864004+0000","last_fullsized":"2024-09-10T23:25:13.864004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:04.845258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849337+0000","last_change":"2024-09-10T23:25:13.863808+0000","last_active":"2024-09-10T23:25:14.849337+0000","last_peered":"2024-09-10T23:25:14.849337+0000","last_clean":"2024-09-10T23:25:14.849337+0000","last_became_active":"2024-09-10T23:25:13.863523+0000","last_became_peered":"2024-09-10T23:25:13.863523+0000","last_unstale":"2024-09-10T23:25:14.849337+0000","last_undegraded":"2024-09-10T23:25:14.849337+0000","last_fullsized":"2024-09-10T23:25:14.849337+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.854459+0000","last_change":"2024-09-10T23:25:12.870251+0000","last_active":"2024-09-10T23:25:13.854459+0000","last_peered":"2024-09-10T23:25:13.854459+0000","last_clean":"2024-09-10T23:25:13.854459+0000","last_became_active":"2024-09-10T23:25:12.868133+0000","last_became_peered":"2024-09-10T23:25:12.868133+0000","last_unstale":"2024-09-10T23:25:13.854459+0000","last_undegraded":"2024-09-10T23:25:13.854459+0000","last_fullsized":"2024-09-10T23:25:13.854459+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543987+0000","last_change":"2024-09-10T23:25:13.876765+0000","last_active":"2024-09-10T23:25:15.543987+0000","last_peered":"2024-09-10T23:25:15.543987+0000","last_clean":"2024-09-10T23:25:15.543987+0000","last_became_active":"2024-09-10T23:25:13.876265+0000","last_became_peered":"2024-09-10T23:25:13.876265+0000","last_unstale":"2024-09-10T23:25:15.543987+0000","last_undegraded":"2024-09-10T23:25:15.543987+0000","last_fullsized":"2024-09-10T23:25:15.543987+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"143'3","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168465+0000","last_change":"2024-09-10T23:25:12.866370+0000","last_active":"2024-09-10T23:25:15.168465+0000","last_peered":"2024-09-10T23:25:15.168465+0000","last_clean":"2024-09-10T23:25:15.168465+0000","last_became_active":"2024-09-10T23:25:12.866110+0000","last_became_peered":"2024-09-10T23:25:12.866110+0000","last_unstale":"2024-09-10T23:25:15.168465+0000","last_undegraded":"2024-09-10T23:25:15.168465+0000","last_fullsized":"2024-09-10T23:25:15.168465+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:16.892811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543795+0000","last_change":"2024-09-10T23:25:13.872367+0000","last_active":"2024-09-10T23:25:15.543795+0000","last_peered":"2024-09-10T23:25:15.543795+0000","last_clean":"2024-09-10T23:25:15.543795+0000","last_became_active":"2024-09-10T23:25:13.871439+0000","last_became_peered":"2024-09-10T23:25:13.871439+0000","last_unstale":"2024-09-10T23:25:15.543795+0000","last_undegraded":"2024-09-10T23:25:15.543795+0000","last_fullsized":"2024-09-10T23:25:15.543795+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"143'6","reported_seq":21,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168138+0000","last_change":"2024-09-10T23:25:12.863438+0000","last_active":"2024-09-10T23:25:15.168138+0000","last_peered":"2024-09-10T23:25:15.168138+0000","last_clean":"2024-09-10T23:25:15.168138+0000","last_became_active":"2024-09-10T23:25:12.863119+0000","last_became_peered":"2024-09-10T23:25:12.863119+0000","last_unstale":"2024-09-10T23:25:15.168138+0000","last_undegraded":"2024-09-10T23:25:15.168138+0000","last_fullsized":"2024-09-10T23:25:15.168138+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:04.730019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.866856+0000","last_change":"2024-09-10T23:25:13.863293+0000","last_active":"2024-09-10T23:25:13.866856+0000","last_peered":"2024-09-10T23:25:13.866856+0000","last_clean":"2024-09-10T23:25:13.866856+0000","last_became_active":"2024-09-10T23:25:13.861554+0000","last_became_peered":"2024-09-10T23:25:13.861554+0000","last_unstale":"2024-09-10T23:25:13.866856+0000","last_undegraded":"2024-09-10T23:25:13.866856+0000","last_fullsized":"2024-09-10T23:25:13.866856+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:05.775013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"143'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.883312+0000","last_change":"2024-09-10T23:25:12.870308+0000","last_active":"2024-09-10T23:25:13.883312+0000","last_peered":"2024-09-10T23:25:13.883312+0000","last_clean":"2024-09-10T23:25:13.883312+0000","last_became_active":"2024-09-10T23:25:12.870004+0000","last_became_peered":"2024-09-10T23:25:12.870004+0000","last_unstale":"2024-09-10T23:25:13.883312+0000","last_undegraded":"2024-09-10T23:25:13.883312+0000","last_fullsized":"2024-09-10T23:25:13.883312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:26.297677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168548+0000","last_change":"2024-09-10T23:25:13.879660+0000","last_active":"2024-09-10T23:25:15.168548+0000","last_peered":"2024-09-10T23:25:15.168548+0000","last_clean":"2024-09-10T23:25:15.168548+0000","last_became_active":"2024-09-10T23:25:13.876125+0000","last_became_peered":"2024-09-10T23:25:13.876125+0000","last_unstale":"2024-09-10T23:25:15.168548+0000","last_undegraded":"2024-09-10T23:25:15.168548+0000","last_fullsized":"2024-09-10T23:25:15.168548+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:13.803118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543208+0000","last_change":"2024-09-10T23:25:12.867167+0000","last_active":"2024-09-10T23:25:15.543208+0000","last_peered":"2024-09-10T23:25:15.543208+0000","last_clean":"2024-09-10T23:25:15.543208+0000","last_became_active":"2024-09-10T23:25:12.866906+0000","last_became_peered":"2024-09-10T23:25:12.866906+0000","last_unstale":"2024-09-10T23:25:15.543208+0000","last_undegraded":"2024-09-10T23:25:15.543208+0000","last_fullsized":"2024-09-10T23:25:15.543208+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:16.047610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539611+0000","last_change":"2024-09-10T23:25:13.869365+0000","last_active":"2024-09-10T23:25:15.539611+0000","last_peered":"2024-09-10T23:25:15.539611+0000","last_clean":"2024-09-10T23:25:15.539611+0000","last_became_active":"2024-09-10T23:25:13.869097+0000","last_became_peered":"2024-09-10T23:25:13.869097+0000","last_unstale":"2024-09-10T23:25:15.539611+0000","last_undegraded":"2024-09-10T23:25:15.539611+0000","last_fullsized":"2024-09-10T23:25:15.539611+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:57.674366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"143'8","reported_seq":23,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849356+0000","last_change":"2024-09-10T23:25:12.860677+0000","last_active":"2024-09-10T23:25:14.849356+0000","last_peered":"2024-09-10T23:25:14.849356+0000","last_clean":"2024-09-10T23:25:14.849356+0000","last_became_active":"2024-09-10T23:25:12.860380+0000","last_became_peered":"2024-09-10T23:25:12.860380+0000","last_unstale":"2024-09-10T23:25:14.849356+0000","last_undegraded":"2024-09-10T23:25:14.849356+0000","last_fullsized":"2024-09-10T23:25:14.849356+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:06.604930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543016+0000","last_change":"2024-09-10T23:25:13.873862+0000","last_active":"2024-09-10T23:25:15.543016+0000","last_peered":"2024-09-10T23:25:15.543016+0000","last_clean":"2024-09-10T23:25:15.543016+0000","last_became_active":"2024-09-10T23:25:13.873313+0000","last_became_peered":"2024-09-10T23:25:13.873313+0000","last_unstale":"2024-09-10T23:25:15.543016+0000","last_undegraded":"2024-09-10T23:25:15.543016+0000","last_fullsized":"2024-09-10T23:25:15.543016+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:01.634211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"143'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.879076+0000","last_change":"2024-09-10T23:25:12.872714+0000","last_active":"2024-09-10T23:25:13.879076+0000","last_peered":"2024-09-10T23:25:13.879076+0000","last_clean":"2024-09-10T23:25:13.879076+0000","last_became_active":"2024-09-10T23:25:12.872395+0000","last_became_peered":"2024-09-10T23:25:12.872395+0000","last_unstale":"2024-09-10T23:25:13.879076+0000","last_undegraded":"2024-09-10T23:25:13.879076+0000","last_fullsized":"2024-09-10T23:25:13.879076+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:24.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168048+0000","last_change":"2024-09-10T23:25:13.883771+0000","last_active":"2024-09-10T23:25:15.168048+0000","last_peered":"2024-09-10T23:25:15.168048+0000","last_clean":"2024-09-10T23:25:15.168048+0000","last_became_active":"2024-09-10T23:25:13.883497+0000","last_became_peered":"2024-09-10T23:25:13.883497+0000","last_unstale":"2024-09-10T23:25:15.168048+0000","last_undegraded":"2024-09-10T23:25:15.168048+0000","last_fullsized":"2024-09-10T23:25:15.168048+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:09.361672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543952+0000","last_change":"2024-09-10T23:25:12.869708+0000","last_active":"2024-09-10T23:25:15.543952+0000","last_peered":"2024-09-10T23:25:15.543952+0000","last_clean":"2024-09-10T23:25:15.543952+0000","last_became_active":"2024-09-10T23:25:12.869271+0000","last_became_peered":"2024-09-10T23:25:12.869271+0000","last_unstale":"2024-09-10T23:25:15.543952+0000","last_undegraded":"2024-09-10T23:25:15.543952+0000","last_fullsized":"2024-09-10T23:25:15.543952+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:03.491852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168211+0000","last_change":"2024-09-10T23:25:13.872726+0000","last_active":"2024-09-10T23:25:15.168211+0000","last_peered":"2024-09-10T23:25:15.168211+0000","last_clean":"2024-09-10T23:25:15.168211+0000","last_became_active":"2024-09-10T23:25:13.872469+0000","last_became_peered":"2024-09-10T23:25:13.872469+0000","last_unstale":"2024-09-10T23:25:15.168211+0000","last_undegraded":"2024-09-10T23:25:15.168211+0000","last_fullsized":"2024-09-10T23:25:15.168211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:17.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849871+0000","last_change":"2024-09-10T23:25:12.858520+0000","last_active":"2024-09-10T23:25:14.849871+0000","last_peered":"2024-09-10T23:25:14.849871+0000","last_clean":"2024-09-10T23:25:14.849871+0000","last_became_active":"2024-09-10T23:25:12.858244+0000","last_became_peered":"2024-09-10T23:25:12.858244+0000","last_unstale":"2024-09-10T23:25:14.849871+0000","last_undegraded":"2024-09-10T23:25:14.849871+0000","last_fullsized":"2024-09-10T23:25:14.849871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:44.403969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.871379+0000","last_change":"2024-09-10T23:25:13.869640+0000","last_active":"2024-09-10T23:25:13.871379+0000","last_peered":"2024-09-10T23:25:13.871379+0000","last_clean":"2024-09-10T23:25:13.871379+0000","last_became_active":"2024-09-10T23:25:13.869369+0000","last_became_peered":"2024-09-10T23:25:13.869369+0000","last_unstale":"2024-09-10T23:25:13.871379+0000","last_undegraded":"2024-09-10T23:25:13.871379+0000","last_fullsized":"2024-09-10T23:25:13.871379+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.521443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539560+0000","last_change":"2024-09-10T23:25:12.865263+0000","last_active":"2024-09-10T23:25:15.539560+0000","last_peered":"2024-09-10T23:25:15.539560+0000","last_clean":"2024-09-10T23:25:15.539560+0000","last_became_active":"2024-09-10T23:25:12.863466+0000","last_became_peered":"2024-09-10T23:25:12.863466+0000","last_unstale":"2024-09-10T23:25:15.539560+0000","last_undegraded":"2024-09-10T23:25:15.539560+0000","last_fullsized":"2024-09-10T23:25:15.539560+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:44.648714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539565+0000","last_change":"2024-09-10T23:25:13.864977+0000","last_active":"2024-09-10T23:25:15.539565+0000","last_peered":"2024-09-10T23:25:15.539565+0000","last_clean":"2024-09-10T23:25:15.539565+0000","last_became_active":"2024-09-10T23:25:13.864697+0000","last_became_peered":"2024-09-10T23:25:13.864697+0000","last_unstale":"2024-09-10T23:25:15.539565+0000","last_undegraded":"2024-09-10T23:25:15.539565+0000","last_fullsized":"2024-09-10T23:25:15.539565+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:08.249549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854312+0000","last_change":"2024-09-10T23:25:12.867813+0000","last_active":"2024-09-10T23:25:14.854312+0000","last_peered":"2024-09-10T23:25:14.854312+0000","last_clean":"2024-09-10T23:25:14.854312+0000","last_became_active":"2024-09-10T23:25:12.867541+0000","last_became_peered":"2024-09-10T23:25:12.867541+0000","last_unstale":"2024-09-10T23:25:14.854312+0000","last_undegraded":"2024-09-10T23:25:14.854312+0000","last_fullsized":"2024-09-10T23:25:14.854312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.866595+0000","last_change":"2024-09-10T23:25:13.860966+0000","last_active":"2024-09-10T23:25:13.866595+0000","last_peered":"2024-09-10T23:25:13.866595+0000","last_clean":"2024-09-10T23:25:13.866595+0000","last_became_active":"2024-09-10T23:25:13.860080+0000","last_became_peered":"2024-09-10T23:25:13.860080+0000","last_unstale":"2024-09-10T23:25:13.866595+0000","last_undegraded":"2024-09-10T23:25:13.866595+0000","last_fullsized":"2024-09-10T23:25:13.866595+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:57:01.935345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.853652+0000","last_change":"2024-09-10T23:25:12.871815+0000","last_active":"2024-09-10T23:25:13.853652+0000","last_peered":"2024-09-10T23:25:13.853652+0000","last_clean":"2024-09-10T23:25:13.853652+0000","last_became_active":"2024-09-10T23:25:12.871500+0000","last_became_peered":"2024-09-10T23:25:12.871500+0000","last_unstale":"2024-09-10T23:25:13.853652+0000","last_undegraded":"2024-09-10T23:25:13.853652+0000","last_fullsized":"2024-09-10T23:25:13.853652+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:27.313249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539699+0000","last_change":"2024-09-10T23:25:13.874902+0000","last_active":"2024-09-10T23:25:15.539699+0000","last_peered":"2024-09-10T23:25:15.539699+0000","last_clean":"2024-09-10T23:25:15.539699+0000","last_became_active":"2024-09-10T23:25:13.874194+0000","last_became_peered":"2024-09-10T23:25:13.874194+0000","last_unstale":"2024-09-10T23:25:15.539699+0000","last_undegraded":"2024-09-10T23:25:15.539699+0000","last_fullsized":"2024-09-10T23:25:15.539699+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:08.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:12.869257+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:12.868744+0000","last_became_peered":"2024-09-10T23:25:12.868744+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:10.106175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.881361+0000","last_change":"2024-09-10T23:25:13.877129+0000","last_active":"2024-09-10T23:25:13.881361+0000","last_peered":"2024-09-10T23:25:13.881361+0000","last_clean":"2024-09-10T23:25:13.881361+0000","last_became_active":"2024-09-10T23:25:13.876849+0000","last_became_peered":"2024-09-10T23:25:13.876849+0000","last_unstale":"2024-09-10T23:25:13.881361+0000","last_undegraded":"2024-09-10T23:25:13.881361+0000","last_fullsized":"2024-09-10T23:25:13.881361+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:24.911994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849479+0000","last_change":"2024-09-10T23:25:12.869026+0000","last_active":"2024-09-10T23:25:14.849479+0000","last_peered":"2024-09-10T23:25:14.849479+0000","last_clean":"2024-09-10T23:25:14.849479+0000","last_became_active":"2024-09-10T23:25:12.868703+0000","last_became_peered":"2024-09-10T23:25:12.868703+0000","last_unstale":"2024-09-10T23:25:14.849479+0000","last_undegraded":"2024-09-10T23:25:14.849479+0000","last_fullsized":"2024-09-10T23:25:14.849479+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539219+0000","last_change":"2024-09-10T23:25:13.874349+0000","last_active":"2024-09-10T23:25:15.539219+0000","last_peered":"2024-09-10T23:25:15.539219+0000","last_clean":"2024-09-10T23:25:15.539219+0000","last_became_active":"2024-09-10T23:25:13.874070+0000","last_became_peered":"2024-09-10T23:25:13.874070+0000","last_unstale":"2024-09-10T23:25:15.539219+0000","last_undegraded":"2024-09-10T23:25:15.539219+0000","last_fullsized":"2024-09-10T23:25:15.539219+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:06.242809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"143'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.888059+0000","last_change":"2024-09-10T23:25:12.867865+0000","last_active":"2024-09-10T23:25:13.888059+0000","last_peered":"2024-09-10T23:25:13.888059+0000","last_clean":"2024-09-10T23:25:13.888059+0000","last_became_active":"2024-09-10T23:25:12.867588+0000","last_became_peered":"2024-09-10T23:25:12.867588+0000","last_unstale":"2024-09-10T23:25:13.888059+0000","last_undegraded":"2024-09-10T23:25:13.888059+0000","last_fullsized":"2024-09-10T23:25:13.888059+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:34.917685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543230+0000","last_change":"2024-09-10T23:25:13.870979+0000","last_active":"2024-09-10T23:25:15.543230+0000","last_peered":"2024-09-10T23:25:15.543230+0000","last_clean":"2024-09-10T23:25:15.543230+0000","last_became_active":"2024-09-10T23:25:13.870036+0000","last_became_peered":"2024-09-10T23:25:13.870036+0000","last_unstale":"2024-09-10T23:25:15.543230+0000","last_undegraded":"2024-09-10T23:25:15.543230+0000","last_fullsized":"2024-09-10T23:25:15.543230+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:34.682442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854692+0000","last_change":"2024-09-10T23:25:12.873264+0000","last_active":"2024-09-10T23:25:14.854692+0000","last_peered":"2024-09-10T23:25:14.854692+0000","last_clean":"2024-09-10T23:25:14.854692+0000","last_became_active":"2024-09-10T23:25:12.872396+0000","last_became_peered":"2024-09-10T23:25:12.872396+0000","last_unstale":"2024-09-10T23:25:14.854692+0000","last_undegraded":"2024-09-10T23:25:14.854692+0000","last_fullsized":"2024-09-10T23:25:14.854692+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167852+0000","last_change":"2024-09-10T23:25:13.882067+0000","last_active":"2024-09-10T23:25:15.167852+0000","last_peered":"2024-09-10T23:25:15.167852+0000","last_clean":"2024-09-10T23:25:15.167852+0000","last_became_active":"2024-09-10T23:25:13.877949+0000","last_became_peered":"2024-09-10T23:25:13.877949+0000","last_unstale":"2024-09-10T23:25:15.167852+0000","last_undegraded":"2024-09-10T23:25:15.167852+0000","last_fullsized":"2024-09-10T23:25:15.167852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:50.603669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854542+0000","last_change":"2024-09-10T23:25:12.870970+0000","last_active":"2024-09-10T23:25:14.854542+0000","last_peered":"2024-09-10T23:25:14.854542+0000","last_clean":"2024-09-10T23:25:14.854542+0000","last_became_active":"2024-09-10T23:25:12.870538+0000","last_became_peered":"2024-09-10T23:25:12.870538+0000","last_unstale":"2024-09-10T23:25:14.854542+0000","last_undegraded":"2024-09-10T23:25:14.854542+0000","last_fullsized":"2024-09-10T23:25:14.854542+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.858411+0000","last_change":"2024-09-10T23:25:13.855869+0000","last_active":"2024-09-10T23:25:13.858411+0000","last_peered":"2024-09-10T23:25:13.858411+0000","last_clean":"2024-09-10T23:25:13.858411+0000","last_became_active":"2024-09-10T23:25:13.855567+0000","last_became_peered":"2024-09-10T23:25:13.855567+0000","last_unstale":"2024-09-10T23:25:13.858411+0000","last_undegraded":"2024-09-10T23:25:13.858411+0000","last_fullsized":"2024-09-10T23:25:13.858411+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:13.882085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849680+0000","last_change":"2024-09-10T23:25:12.868622+0000","last_active":"2024-09-10T23:25:14.849680+0000","last_peered":"2024-09-10T23:25:14.849680+0000","last_clean":"2024-09-10T23:25:14.849680+0000","last_became_active":"2024-09-10T23:25:12.868338+0000","last_became_peered":"2024-09-10T23:25:12.868338+0000","last_unstale":"2024-09-10T23:25:14.849680+0000","last_undegraded":"2024-09-10T23:25:14.849680+0000","last_fullsized":"2024-09-10T23:25:14.849680+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849579+0000","last_change":"2024-09-10T23:25:13.869075+0000","last_active":"2024-09-10T23:25:14.849579+0000","last_peered":"2024-09-10T23:25:14.849579+0000","last_clean":"2024-09-10T23:25:14.849579+0000","last_became_active":"2024-09-10T23:25:13.868451+0000","last_became_peered":"2024-09-10T23:25:13.868451+0000","last_unstale":"2024-09-10T23:25:14.849579+0000","last_undegraded":"2024-09-10T23:25:14.849579+0000","last_fullsized":"2024-09-10T23:25:14.849579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:47.345674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T23:25:13.859960+0000","last_change":"2024-09-10T23:25:12.872334+0000","last_active":"2024-09-10T23:25:13.859960+0000","last_peered":"2024-09-10T23:25:13.859960+0000","last_clean":"2024-09-10T23:25:13.859960+0000","last_became_active":"2024-09-10T23:25:12.871522+0000","last_became_peered":"2024-09-10T23:25:12.871522+0000","last_unstale":"2024-09-10T23:25:13.859960+0000","last_undegraded":"2024-09-10T23:25:13.859960+0000","last_fullsized":"2024-09-10T23:25:13.859960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:38.706629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849806+0000","last_change":"2024-09-10T23:25:13.869176+0000","last_active":"2024-09-10T23:25:14.849806+0000","last_peered":"2024-09-10T23:25:14.849806+0000","last_clean":"2024-09-10T23:25:14.849806+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:14.849806+0000","last_undegraded":"2024-09-10T23:25:14.849806+0000","last_fullsized":"2024-09-10T23:25:14.849806+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:11.171142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168230+0000","last_change":"2024-09-10T23:25:12.867607+0000","last_active":"2024-09-10T23:25:15.168230+0000","last_peered":"2024-09-10T23:25:15.168230+0000","last_clean":"2024-09-10T23:25:15.168230+0000","last_became_active":"2024-09-10T23:25:12.865003+0000","last_became_peered":"2024-09-10T23:25:12.865003+0000","last_unstale":"2024-09-10T23:25:15.168230+0000","last_undegraded":"2024-09-10T23:25:15.168230+0000","last_fullsized":"2024-09-10T23:25:15.168230+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:25.534423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849577+0000","last_change":"2024-09-10T23:25:13.877088+0000","last_active":"2024-09-10T23:25:14.849577+0000","last_peered":"2024-09-10T23:25:14.849577+0000","last_clean":"2024-09-10T23:25:14.849577+0000","last_became_active":"2024-09-10T23:25:13.876820+0000","last_became_peered":"2024-09-10T23:25:13.876820+0000","last_unstale":"2024-09-10T23:25:14.849577+0000","last_undegraded":"2024-09-10T23:25:14.849577+0000","last_fullsized":"2024-09-10T23:25:14.849577+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849440+0000","last_change":"2024-09-10T23:25:12.855796+0000","last_active":"2024-09-10T23:25:14.849440+0000","last_peered":"2024-09-10T23:25:14.849440+0000","last_clean":"2024-09-10T23:25:14.849440+0000","last_became_active":"2024-09-10T23:25:12.855449+0000","last_became_peered":"2024-09-10T23:25:12.855449+0000","last_unstale":"2024-09-10T23:25:14.849440+0000","last_undegraded":"2024-09-10T23:25:14.849440+0000","last_fullsized":"2024-09-10T23:25:14.849440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168525+0000","last_change":"2024-09-10T23:25:13.880032+0000","last_active":"2024-09-10T23:25:15.168525+0000","last_peered":"2024-09-10T23:25:15.168525+0000","last_clean":"2024-09-10T23:25:15.168525+0000","last_became_active":"2024-09-10T23:25:13.879777+0000","last_became_peered":"2024-09-10T23:25:13.879777+0000","last_unstale":"2024-09-10T23:25:15.168525+0000","last_undegraded":"2024-09-10T23:25:15.168525+0000","last_fullsized":"2024-09-10T23:25:15.168525+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:52.516915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539380+0000","last_change":"2024-09-10T23:25:12.864319+0000","last_active":"2024-09-10T23:25:15.539380+0000","last_peered":"2024-09-10T23:25:15.539380+0000","last_clean":"2024-09-10T23:25:15.539380+0000","last_became_active":"2024-09-10T23:25:12.864040+0000","last_became_peered":"2024-09-10T23:25:12.864040+0000","last_unstale":"2024-09-10T23:25:15.539380+0000","last_undegraded":"2024-09-10T23:25:15.539380+0000","last_fullsized":"2024-09-10T23:25:15.539380+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.439090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543804+0000","last_change":"2024-09-10T23:25:13.873870+0000","last_active":"2024-09-10T23:25:15.543804+0000","last_peered":"2024-09-10T23:25:15.543804+0000","last_clean":"2024-09-10T23:25:15.543804+0000","last_became_active":"2024-09-10T23:25:13.873421+0000","last_became_peered":"2024-09-10T23:25:13.873421+0000","last_unstale":"2024-09-10T23:25:15.543804+0000","last_undegraded":"2024-09-10T23:25:15.543804+0000","last_fullsized":"2024-09-10T23:25:15.543804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167955+0000","last_change":"2024-09-10T23:25:12.867113+0000","last_active":"2024-09-10T23:25:15.167955+0000","last_peered":"2024-09-10T23:25:15.167955+0000","last_clean":"2024-09-10T23:25:15.167955+0000","last_became_active":"2024-09-10T23:25:12.866816+0000","last_became_peered":"2024-09-10T23:25:12.866816+0000","last_unstale":"2024-09-10T23:25:15.167955+0000","last_undegraded":"2024-09-10T23:25:15.167955+0000","last_fullsized":"2024-09-10T23:25:15.167955+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:40.361003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":329,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167673+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:25:15.167673+0000","last_peered":"2024-09-10T23:25:15.167673+0000","last_clean":"2024-09-10T23:25:15.167673+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:25:15.167673+0000","last_undegraded":"2024-09-10T23:25:15.167673+0000","last_fullsized":"2024-09-10T23:25:15.167673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46832,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325008,"statfs":{"total":96636764160,"available":96588808192,"internally_reserved":0,"allocated":1798144,"data_stored":841884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509562,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64048,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307792,"statfs":{"total":96636764160,"available":96571179008,"internally_reserved":0,"allocated":2387968,"data_stored":1426590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59300,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312540,"statfs":{"total":96636764160,"available":96576040960,"internally_reserved":0,"allocated":1781760,"data_stored":834542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64876,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306964,"statfs":{"total":96636764160,"available":96570331136,"internally_reserved":0,"allocated":1789952,"data_stored":841212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509561,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69040,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302800,"statfs":{"total":96636764160,"available":96566067200,"internally_reserved":0,"allocated":1785856,"data_stored":835136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509562,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55152,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316688,"statfs":{"total":96636764160,"available":96580288512,"internally_reserved":0,"allocated":1794048,"data_stored":841282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509561,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73768,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298072,"statfs":{"total":96636764160,"available":96561225728,"internally_reserved":0,"allocated":2379776,"data_stored":1424944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46844,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324996,"statfs":{"total":96636764160,"available":96588795904,"internally_reserved":0,"allocated":1806336,"data_stored":842894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:25:22.633 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:25:22.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 -- 172.21.15.17:0/2783129033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd920070ad0 msgr2=0x7fd92015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:22.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 --2- 172.21.15.17:0/2783129033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd920070ad0 0x7fd92015f060 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9200cf010 tx=0x7fd91001c740 comp rx=0 tx=0).stop 2024-09-10T23:25:22.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 -- 172.21.15.17:0/2783129033 shutdown_connections 2024-09-10T23:25:22.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 --2- 172.21.15.17:0/2783129033 >> v2:172.21.15.77:3300/0 conn(0x7fd9200d1830 0x7fd92015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:22.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 --2- 172.21.15.17:0/2783129033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd920070ad0 0x7fd92015f060 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:22.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 -- 172.21.15.17:0/2783129033 >> 172.21.15.17:0/2783129033 conn(0x7fd9200d1d60 msgr2=0x7fd9200d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:22.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 -- 172.21.15.17:0/2783129033 shutdown_connections 2024-09-10T23:25:22.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 -- 172.21.15.17:0/2783129033 wait complete. 2024-09-10T23:25:22.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 Processor -- start 2024-09-10T23:25:22.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 -- start start 2024-09-10T23:25:22.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd920070ad0 0x7fd92006f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9200cf320 0x7fd9201fc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9200d1830 0x7fd920157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201693b0 con 0x7fd920070ad0 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd920169230 con 0x7fd9200cf320 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd925800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd920169530 con 0x7fd9200d1830 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd91ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd920070ad0 0x7fd92006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd91ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd920070ad0 0x7fd92006f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55976/0 (socket says 172.21.15.17:55976) 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd91ea00640 1 -- 172.21.15.17:0/885992351 learned_addr learned my addr 172.21.15.17:0/885992351 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd917e00640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9200cf320 0x7fd9201fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.790+0000 7fd91f400640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9200d1830 0x7fd920157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd91ea00640 1 -- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9200d1830 msgr2=0x7fd920157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:22.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd91ea00640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9200d1830 0x7fd920157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd91ea00640 1 -- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9200cf320 msgr2=0x7fd9201fc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd91ea00640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9200cf320 0x7fd9201fc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd91ea00640 1 -- 172.21.15.17:0/885992351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9201581c0 con 0x7fd920070ad0 2024-09-10T23:25:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd91ea00640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd920070ad0 0x7fd92006f180 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd910000c10 tx=0x7fd910004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:22.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd916a00640 1 -- 172.21.15.17:0/885992351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9100bc070 con 0x7fd920070ad0 2024-09-10T23:25:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd916a00640 1 -- 172.21.15.17:0/885992351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9100a5cb0 con 0x7fd920070ad0 2024-09-10T23:25:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd916a00640 1 -- 172.21.15.17:0/885992351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9100b2040 con 0x7fd920070ad0 2024-09-10T23:25:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92006f7a0 con 0x7fd920070ad0 2024-09-10T23:25:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9201fbe70 con 0x7fd920070ad0 2024-09-10T23:25:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9200cfc60 con 0x7fd920070ad0 2024-09-10T23:25:22.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.794+0000 7fd916a00640 1 -- 172.21.15.17:0/885992351 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd9100b5070 con 0x7fd920070ad0 2024-09-10T23:25:22.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.798+0000 7fd916a00640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8fc072610 0x7fd8fc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:22.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.798+0000 7fd916a00640 1 -- 172.21.15.17:0/885992351 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fd91012c860 con 0x7fd920070ad0 2024-09-10T23:25:22.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.798+0000 7fd917e00640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8fc072610 0x7fd8fc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:22.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.798+0000 7fd917e00640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8fc072610 0x7fd8fc074ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd9201565f0 tx=0x7fd9080091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:22.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.802+0000 7fd916a00640 1 -- 172.21.15.17:0/885992351 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd9201581c0 con 0x7fd920070ad0 2024-09-10T23:25:22.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.974+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd920069e10 con 0x7fd8fc072610 2024-09-10T23:25:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.978+0000 7fd916a00640 1 -- 172.21.15.17:0/885992351 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252387 (secure 0 0 0) 0x7fd908011b20 con 0x7fd8fc072610 2024-09-10T23:25:22.984 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:22.985 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:25:22.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8fc072610 msgr2=0x7fd8fc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:22.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8fc072610 0x7fd8fc074ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd9201565f0 tx=0x7fd9080091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd920070ad0 msgr2=0x7fd92006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd920070ad0 0x7fd92006f180 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd910000c10 tx=0x7fd910004620 comp rx=0 tx=0).stop 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 shutdown_connections 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8fc072610 0x7fd8fc074ad0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd9200d1830 0x7fd920157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9200cf320 0x7fd9201fc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 --2- 172.21.15.17:0/885992351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd920070ad0 0x7fd92006f180 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 >> 172.21.15.17:0/885992351 conn(0x7fd9200d1d60 msgr2=0x7fd9200b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 shutdown_connections 2024-09-10T23:25:22.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:22.982+0000 7fd925800640 1 -- 172.21.15.17:0/885992351 wait complete. 2024-09-10T23:25:23.005 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2024-09-10T23:25:22.433684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":479908,"kb_used_data":15208,"kb_used_omap":12,"kb_used_meta":464499,"kb_avail":754494812,"statfs":{"total":773094113280,"available":772602687488,"internally_reserved":0,"allocated":15572992,"data_stored":7915252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":475647537},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.583387"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.540544+0000","last_change":"2024-09-10T23:25:13.865559+0000","last_active":"2024-09-10T23:25:15.540544+0000","last_peered":"2024-09-10T23:25:15.540544+0000","last_clean":"2024-09-10T23:25:15.540544+0000","last_became_active":"2024-09-10T23:25:13.865244+0000","last_became_peered":"2024-09-10T23:25:13.865244+0000","last_unstale":"2024-09-10T23:25:15.540544+0000","last_undegraded":"2024-09-10T23:25:15.540544+0000","last_fullsized":"2024-09-10T23:25:15.540544+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:16.893922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543258+0000","last_change":"2024-09-10T23:25:13.869884+0000","last_active":"2024-09-10T23:25:15.543258+0000","last_peered":"2024-09-10T23:25:15.543258+0000","last_clean":"2024-09-10T23:25:15.543258+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:15.543258+0000","last_undegraded":"2024-09-10T23:25:15.543258+0000","last_fullsized":"2024-09-10T23:25:15.543258+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:22.968981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543691+0000","last_change":"2024-09-10T23:25:13.873797+0000","last_active":"2024-09-10T23:25:15.543691+0000","last_peered":"2024-09-10T23:25:15.543691+0000","last_clean":"2024-09-10T23:25:15.543691+0000","last_became_active":"2024-09-10T23:25:13.873417+0000","last_became_peered":"2024-09-10T23:25:13.873417+0000","last_unstale":"2024-09-10T23:25:15.543691+0000","last_undegraded":"2024-09-10T23:25:15.543691+0000","last_fullsized":"2024-09-10T23:25:15.543691+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:31.073999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.542968+0000","last_change":"2024-09-10T23:25:13.871941+0000","last_active":"2024-09-10T23:25:15.542968+0000","last_peered":"2024-09-10T23:25:15.542968+0000","last_clean":"2024-09-10T23:25:15.542968+0000","last_became_active":"2024-09-10T23:25:13.871660+0000","last_became_peered":"2024-09-10T23:25:13.871660+0000","last_unstale":"2024-09-10T23:25:15.542968+0000","last_undegraded":"2024-09-10T23:25:15.542968+0000","last_fullsized":"2024-09-10T23:25:15.542968+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:32.141683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539081+0000","last_change":"2024-09-10T23:25:13.864537+0000","last_active":"2024-09-10T23:25:15.539081+0000","last_peered":"2024-09-10T23:25:15.539081+0000","last_clean":"2024-09-10T23:25:15.539081+0000","last_became_active":"2024-09-10T23:25:13.862390+0000","last_became_peered":"2024-09-10T23:25:13.862390+0000","last_unstale":"2024-09-10T23:25:15.539081+0000","last_undegraded":"2024-09-10T23:25:15.539081+0000","last_fullsized":"2024-09-10T23:25:15.539081+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:09.158036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849317+0000","last_change":"2024-09-10T23:25:13.869860+0000","last_active":"2024-09-10T23:25:14.849317+0000","last_peered":"2024-09-10T23:25:14.849317+0000","last_clean":"2024-09-10T23:25:14.849317+0000","last_became_active":"2024-09-10T23:25:13.869577+0000","last_became_peered":"2024-09-10T23:25:13.869577+0000","last_unstale":"2024-09-10T23:25:14.849317+0000","last_undegraded":"2024-09-10T23:25:14.849317+0000","last_fullsized":"2024-09-10T23:25:14.849317+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:41.363760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167998+0000","last_change":"2024-09-10T23:25:13.882785+0000","last_active":"2024-09-10T23:25:15.167998+0000","last_peered":"2024-09-10T23:25:15.167998+0000","last_clean":"2024-09-10T23:25:15.167998+0000","last_became_active":"2024-09-10T23:25:13.877627+0000","last_became_peered":"2024-09-10T23:25:13.877627+0000","last_unstale":"2024-09-10T23:25:15.167998+0000","last_undegraded":"2024-09-10T23:25:15.167998+0000","last_fullsized":"2024-09-10T23:25:15.167998+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:44.875736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854072+0000","last_change":"2024-09-10T23:25:13.867473+0000","last_active":"2024-09-10T23:25:14.854072+0000","last_peered":"2024-09-10T23:25:14.854072+0000","last_clean":"2024-09-10T23:25:14.854072+0000","last_became_active":"2024-09-10T23:25:13.867208+0000","last_became_peered":"2024-09-10T23:25:13.867208+0000","last_unstale":"2024-09-10T23:25:14.854072+0000","last_undegraded":"2024-09-10T23:25:14.854072+0000","last_fullsized":"2024-09-10T23:25:14.854072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:19.792842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849974+0000","last_change":"2024-09-10T23:25:13.875490+0000","last_active":"2024-09-10T23:25:14.849974+0000","last_peered":"2024-09-10T23:25:14.849974+0000","last_clean":"2024-09-10T23:25:14.849974+0000","last_became_active":"2024-09-10T23:25:13.875205+0000","last_became_peered":"2024-09-10T23:25:13.875205+0000","last_unstale":"2024-09-10T23:25:14.849974+0000","last_undegraded":"2024-09-10T23:25:14.849974+0000","last_fullsized":"2024-09-10T23:25:14.849974+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:51.185099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.540283+0000","last_change":"2024-09-10T23:25:13.854593+0000","last_active":"2024-09-10T23:25:15.540283+0000","last_peered":"2024-09-10T23:25:15.540283+0000","last_clean":"2024-09-10T23:25:15.540283+0000","last_became_active":"2024-09-10T23:25:13.854336+0000","last_became_peered":"2024-09-10T23:25:13.854336+0000","last_unstale":"2024-09-10T23:25:15.540283+0000","last_undegraded":"2024-09-10T23:25:15.540283+0000","last_fullsized":"2024-09-10T23:25:15.540283+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:13:10.954421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.542652+0000","last_change":"2024-09-10T23:25:13.876510+0000","last_active":"2024-09-10T23:25:15.542652+0000","last_peered":"2024-09-10T23:25:15.542652+0000","last_clean":"2024-09-10T23:25:15.542652+0000","last_became_active":"2024-09-10T23:25:13.876168+0000","last_became_peered":"2024-09-10T23:25:13.876168+0000","last_unstale":"2024-09-10T23:25:15.542652+0000","last_undegraded":"2024-09-10T23:25:15.542652+0000","last_fullsized":"2024-09-10T23:25:15.542652+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:11.171142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.540249+0000","last_change":"2024-09-10T23:25:13.866253+0000","last_active":"2024-09-10T23:25:15.540249+0000","last_peered":"2024-09-10T23:25:15.540249+0000","last_clean":"2024-09-10T23:25:15.540249+0000","last_became_active":"2024-09-10T23:25:13.865309+0000","last_became_peered":"2024-09-10T23:25:13.865309+0000","last_unstale":"2024-09-10T23:25:15.540249+0000","last_undegraded":"2024-09-10T23:25:15.540249+0000","last_fullsized":"2024-09-10T23:25:15.540249+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:44:01.079025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849866+0000","last_change":"2024-09-10T23:25:13.871849+0000","last_active":"2024-09-10T23:25:14.849866+0000","last_peered":"2024-09-10T23:25:14.849866+0000","last_clean":"2024-09-10T23:25:14.849866+0000","last_became_active":"2024-09-10T23:25:13.871410+0000","last_became_peered":"2024-09-10T23:25:13.871410+0000","last_unstale":"2024-09-10T23:25:14.849866+0000","last_undegraded":"2024-09-10T23:25:14.849866+0000","last_fullsized":"2024-09-10T23:25:14.849866+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:05.732775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539942+0000","last_change":"2024-09-10T23:25:13.871872+0000","last_active":"2024-09-10T23:25:15.539942+0000","last_peered":"2024-09-10T23:25:15.539942+0000","last_clean":"2024-09-10T23:25:15.539942+0000","last_became_active":"2024-09-10T23:25:13.871601+0000","last_became_peered":"2024-09-10T23:25:13.871601+0000","last_unstale":"2024-09-10T23:25:15.539942+0000","last_undegraded":"2024-09-10T23:25:15.539942+0000","last_fullsized":"2024-09-10T23:25:15.539942+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:43.343748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.538901+0000","last_change":"2024-09-10T23:25:13.861355+0000","last_active":"2024-09-10T23:25:15.538901+0000","last_peered":"2024-09-10T23:25:15.538901+0000","last_clean":"2024-09-10T23:25:15.538901+0000","last_became_active":"2024-09-10T23:25:13.860218+0000","last_became_peered":"2024-09-10T23:25:13.860218+0000","last_unstale":"2024-09-10T23:25:15.538901+0000","last_undegraded":"2024-09-10T23:25:15.538901+0000","last_fullsized":"2024-09-10T23:25:15.538901+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:19.499190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849485+0000","last_change":"2024-09-10T23:25:13.863772+0000","last_active":"2024-09-10T23:25:14.849485+0000","last_peered":"2024-09-10T23:25:14.849485+0000","last_clean":"2024-09-10T23:25:14.849485+0000","last_became_active":"2024-09-10T23:25:13.863386+0000","last_became_peered":"2024-09-10T23:25:13.863386+0000","last_unstale":"2024-09-10T23:25:14.849485+0000","last_undegraded":"2024-09-10T23:25:14.849485+0000","last_fullsized":"2024-09-10T23:25:14.849485+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849983+0000","last_change":"2024-09-10T23:25:13.864064+0000","last_active":"2024-09-10T23:25:14.849983+0000","last_peered":"2024-09-10T23:25:14.849983+0000","last_clean":"2024-09-10T23:25:14.849983+0000","last_became_active":"2024-09-10T23:25:13.863786+0000","last_became_peered":"2024-09-10T23:25:13.863786+0000","last_unstale":"2024-09-10T23:25:14.849983+0000","last_undegraded":"2024-09-10T23:25:14.849983+0000","last_fullsized":"2024-09-10T23:25:14.849983+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:32.141683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539218+0000","last_change":"2024-09-10T23:25:13.870353+0000","last_active":"2024-09-10T23:25:15.539218+0000","last_peered":"2024-09-10T23:25:15.539218+0000","last_clean":"2024-09-10T23:25:15.539218+0000","last_became_active":"2024-09-10T23:25:13.870057+0000","last_became_peered":"2024-09-10T23:25:13.870057+0000","last_unstale":"2024-09-10T23:25:15.539218+0000","last_undegraded":"2024-09-10T23:25:15.539218+0000","last_fullsized":"2024-09-10T23:25:15.539218+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:51.889316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:13.875171+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:13.874560+0000","last_became_peered":"2024-09-10T23:25:13.874560+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:58.866468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539399+0000","last_change":"2024-09-10T23:25:13.876342+0000","last_active":"2024-09-10T23:25:15.539399+0000","last_peered":"2024-09-10T23:25:15.539399+0000","last_clean":"2024-09-10T23:25:15.539399+0000","last_became_active":"2024-09-10T23:25:13.875990+0000","last_became_peered":"2024-09-10T23:25:13.875990+0000","last_unstale":"2024-09-10T23:25:15.539399+0000","last_undegraded":"2024-09-10T23:25:15.539399+0000","last_fullsized":"2024-09-10T23:25:15.539399+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:29.164335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.542658+0000","last_change":"2024-09-10T23:25:13.871600+0000","last_active":"2024-09-10T23:25:15.542658+0000","last_peered":"2024-09-10T23:25:15.542658+0000","last_clean":"2024-09-10T23:25:15.542658+0000","last_became_active":"2024-09-10T23:25:13.871261+0000","last_became_peered":"2024-09-10T23:25:13.871261+0000","last_unstale":"2024-09-10T23:25:15.542658+0000","last_undegraded":"2024-09-10T23:25:15.542658+0000","last_fullsized":"2024-09-10T23:25:15.542658+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:57.643569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539837+0000","last_change":"2024-09-10T23:25:13.875260+0000","last_active":"2024-09-10T23:25:15.539837+0000","last_peered":"2024-09-10T23:25:15.539837+0000","last_clean":"2024-09-10T23:25:15.539837+0000","last_became_active":"2024-09-10T23:25:13.874961+0000","last_became_peered":"2024-09-10T23:25:13.874961+0000","last_unstale":"2024-09-10T23:25:15.539837+0000","last_undegraded":"2024-09-10T23:25:15.539837+0000","last_fullsized":"2024-09-10T23:25:15.539837+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:39:34.706545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.542388+0000","last_change":"2024-09-10T23:25:13.878417+0000","last_active":"2024-09-10T23:25:15.542388+0000","last_peered":"2024-09-10T23:25:15.542388+0000","last_clean":"2024-09-10T23:25:15.542388+0000","last_became_active":"2024-09-10T23:25:13.878116+0000","last_became_peered":"2024-09-10T23:25:13.878116+0000","last_unstale":"2024-09-10T23:25:15.542388+0000","last_undegraded":"2024-09-10T23:25:15.542388+0000","last_fullsized":"2024-09-10T23:25:15.542388+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:47.345674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849229+0000","last_change":"2024-09-10T23:25:13.872929+0000","last_active":"2024-09-10T23:25:14.849229+0000","last_peered":"2024-09-10T23:25:14.849229+0000","last_clean":"2024-09-10T23:25:14.849229+0000","last_became_active":"2024-09-10T23:25:13.870728+0000","last_became_peered":"2024-09-10T23:25:13.870728+0000","last_unstale":"2024-09-10T23:25:14.849229+0000","last_undegraded":"2024-09-10T23:25:14.849229+0000","last_fullsized":"2024-09-10T23:25:14.849229+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544072+0000","last_change":"2024-09-10T23:25:13.876451+0000","last_active":"2024-09-10T23:25:15.544072+0000","last_peered":"2024-09-10T23:25:15.544072+0000","last_clean":"2024-09-10T23:25:15.544072+0000","last_became_active":"2024-09-10T23:25:13.876073+0000","last_became_peered":"2024-09-10T23:25:13.876073+0000","last_unstale":"2024-09-10T23:25:15.544072+0000","last_undegraded":"2024-09-10T23:25:15.544072+0000","last_fullsized":"2024-09-10T23:25:15.544072+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.544042+0000","last_change":"2024-09-10T23:25:13.881177+0000","last_active":"2024-09-10T23:25:15.544042+0000","last_peered":"2024-09-10T23:25:15.544042+0000","last_clean":"2024-09-10T23:25:15.544042+0000","last_became_active":"2024-09-10T23:25:13.880913+0000","last_became_peered":"2024-09-10T23:25:13.880913+0000","last_unstale":"2024-09-10T23:25:15.544042+0000","last_undegraded":"2024-09-10T23:25:15.544042+0000","last_fullsized":"2024-09-10T23:25:15.544042+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:26.537179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168384+0000","last_change":"2024-09-10T23:25:13.875429+0000","last_active":"2024-09-10T23:25:15.168384+0000","last_peered":"2024-09-10T23:25:15.168384+0000","last_clean":"2024-09-10T23:25:15.168384+0000","last_became_active":"2024-09-10T23:25:13.874893+0000","last_became_peered":"2024-09-10T23:25:13.874893+0000","last_unstale":"2024-09-10T23:25:15.168384+0000","last_undegraded":"2024-09-10T23:25:15.168384+0000","last_fullsized":"2024-09-10T23:25:15.168384+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:47.064911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.538960+0000","last_change":"2024-09-10T23:25:13.853437+0000","last_active":"2024-09-10T23:25:15.538960+0000","last_peered":"2024-09-10T23:25:15.538960+0000","last_clean":"2024-09-10T23:25:15.538960+0000","last_became_active":"2024-09-10T23:25:13.853158+0000","last_became_peered":"2024-09-10T23:25:13.853158+0000","last_unstale":"2024-09-10T23:25:15.538960+0000","last_undegraded":"2024-09-10T23:25:15.538960+0000","last_fullsized":"2024-09-10T23:25:15.538960+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:20.132921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543699+0000","last_change":"2024-09-10T23:25:13.878111+0000","last_active":"2024-09-10T23:25:15.543699+0000","last_peered":"2024-09-10T23:25:15.543699+0000","last_clean":"2024-09-10T23:25:15.543699+0000","last_became_active":"2024-09-10T23:25:13.877815+0000","last_became_peered":"2024-09-10T23:25:13.877815+0000","last_unstale":"2024-09-10T23:25:15.543699+0000","last_undegraded":"2024-09-10T23:25:15.543699+0000","last_fullsized":"2024-09-10T23:25:15.543699+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:33.139403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543716+0000","last_change":"2024-09-10T23:25:13.878758+0000","last_active":"2024-09-10T23:25:15.543716+0000","last_peered":"2024-09-10T23:25:15.543716+0000","last_clean":"2024-09-10T23:25:15.543716+0000","last_became_active":"2024-09-10T23:25:13.878493+0000","last_became_peered":"2024-09-10T23:25:13.878493+0000","last_unstale":"2024-09-10T23:25:15.543716+0000","last_undegraded":"2024-09-10T23:25:15.543716+0000","last_fullsized":"2024-09-10T23:25:15.543716+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:27.113577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854060+0000","last_change":"2024-09-10T23:25:13.869209+0000","last_active":"2024-09-10T23:25:14.854060+0000","last_peered":"2024-09-10T23:25:14.854060+0000","last_clean":"2024-09-10T23:25:14.854060+0000","last_became_active":"2024-09-10T23:25:13.868965+0000","last_became_peered":"2024-09-10T23:25:13.868965+0000","last_unstale":"2024-09-10T23:25:14.854060+0000","last_undegraded":"2024-09-10T23:25:14.854060+0000","last_fullsized":"2024-09-10T23:25:14.854060+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:59.422431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.538526+0000","last_change":"2024-09-10T23:25:13.875122+0000","last_active":"2024-09-10T23:25:15.538526+0000","last_peered":"2024-09-10T23:25:15.538526+0000","last_clean":"2024-09-10T23:25:15.538526+0000","last_became_active":"2024-09-10T23:25:13.874015+0000","last_became_peered":"2024-09-10T23:25:13.874015+0000","last_unstale":"2024-09-10T23:25:15.538526+0000","last_undegraded":"2024-09-10T23:25:15.538526+0000","last_fullsized":"2024-09-10T23:25:15.538526+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:39:36.158535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854201+0000","last_change":"2024-09-10T23:25:13.869068+0000","last_active":"2024-09-10T23:25:14.854201+0000","last_peered":"2024-09-10T23:25:14.854201+0000","last_clean":"2024-09-10T23:25:14.854201+0000","last_became_active":"2024-09-10T23:25:13.865220+0000","last_became_peered":"2024-09-10T23:25:13.865220+0000","last_unstale":"2024-09-10T23:25:14.854201+0000","last_undegraded":"2024-09-10T23:25:14.854201+0000","last_fullsized":"2024-09-10T23:25:14.854201+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:25.648301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"143'4","reported_seq":19,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543988+0000","last_change":"2024-09-10T23:25:12.873694+0000","last_active":"2024-09-10T23:25:15.543988+0000","last_peered":"2024-09-10T23:25:15.543988+0000","last_clean":"2024-09-10T23:25:15.543988+0000","last_became_active":"2024-09-10T23:25:12.871488+0000","last_became_peered":"2024-09-10T23:25:12.871488+0000","last_unstale":"2024-09-10T23:25:15.543988+0000","last_undegraded":"2024-09-10T23:25:15.543988+0000","last_fullsized":"2024-09-10T23:25:15.543988+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:23:17.859612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539486+0000","last_change":"2024-09-10T23:25:13.869377+0000","last_active":"2024-09-10T23:25:15.539486+0000","last_peered":"2024-09-10T23:25:15.539486+0000","last_clean":"2024-09-10T23:25:15.539486+0000","last_became_active":"2024-09-10T23:25:13.869123+0000","last_became_peered":"2024-09-10T23:25:13.869123+0000","last_unstale":"2024-09-10T23:25:15.539486+0000","last_undegraded":"2024-09-10T23:25:15.539486+0000","last_fullsized":"2024-09-10T23:25:15.539486+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:23.763591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539832+0000","last_change":"2024-09-10T23:25:12.864352+0000","last_active":"2024-09-10T23:25:15.539832+0000","last_peered":"2024-09-10T23:25:15.539832+0000","last_clean":"2024-09-10T23:25:15.539832+0000","last_became_active":"2024-09-10T23:25:12.864097+0000","last_became_peered":"2024-09-10T23:25:12.864097+0000","last_unstale":"2024-09-10T23:25:15.539832+0000","last_undegraded":"2024-09-10T23:25:15.539832+0000","last_fullsized":"2024-09-10T23:25:15.539832+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:40.097226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.542688+0000","last_change":"2024-09-10T23:25:13.876002+0000","last_active":"2024-09-10T23:25:15.542688+0000","last_peered":"2024-09-10T23:25:15.542688+0000","last_clean":"2024-09-10T23:25:15.542688+0000","last_became_active":"2024-09-10T23:25:13.875699+0000","last_became_peered":"2024-09-10T23:25:13.875699+0000","last_unstale":"2024-09-10T23:25:15.542688+0000","last_undegraded":"2024-09-10T23:25:15.542688+0000","last_fullsized":"2024-09-10T23:25:15.542688+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:47.181849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168318+0000","last_change":"2024-09-10T23:25:12.869556+0000","last_active":"2024-09-10T23:25:15.168318+0000","last_peered":"2024-09-10T23:25:15.168318+0000","last_clean":"2024-09-10T23:25:15.168318+0000","last_became_active":"2024-09-10T23:25:12.869278+0000","last_became_peered":"2024-09-10T23:25:12.869278+0000","last_unstale":"2024-09-10T23:25:15.168318+0000","last_undegraded":"2024-09-10T23:25:15.168318+0000","last_fullsized":"2024-09-10T23:25:15.168318+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:56.479420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539951+0000","last_change":"2024-09-10T23:25:13.872607+0000","last_active":"2024-09-10T23:25:15.539951+0000","last_peered":"2024-09-10T23:25:15.539951+0000","last_clean":"2024-09-10T23:25:15.539951+0000","last_became_active":"2024-09-10T23:25:13.872280+0000","last_became_peered":"2024-09-10T23:25:13.872280+0000","last_unstale":"2024-09-10T23:25:15.539951+0000","last_undegraded":"2024-09-10T23:25:15.539951+0000","last_fullsized":"2024-09-10T23:25:15.539951+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:31:59.324504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168214+0000","last_change":"2024-09-10T23:25:12.865957+0000","last_active":"2024-09-10T23:25:15.168214+0000","last_peered":"2024-09-10T23:25:15.168214+0000","last_clean":"2024-09-10T23:25:15.168214+0000","last_became_active":"2024-09-10T23:25:12.865662+0000","last_became_peered":"2024-09-10T23:25:12.865662+0000","last_unstale":"2024-09-10T23:25:15.168214+0000","last_undegraded":"2024-09-10T23:25:15.168214+0000","last_fullsized":"2024-09-10T23:25:15.168214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:10.168386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854351+0000","last_change":"2024-09-10T23:25:13.868440+0000","last_active":"2024-09-10T23:25:14.854351+0000","last_peered":"2024-09-10T23:25:14.854351+0000","last_clean":"2024-09-10T23:25:14.854351+0000","last_became_active":"2024-09-10T23:25:13.868181+0000","last_became_peered":"2024-09-10T23:25:13.868181+0000","last_unstale":"2024-09-10T23:25:14.854351+0000","last_undegraded":"2024-09-10T23:25:14.854351+0000","last_fullsized":"2024-09-10T23:25:14.854351+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:05.848015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854302+0000","last_change":"2024-09-10T23:25:12.874108+0000","last_active":"2024-09-10T23:25:14.854302+0000","last_peered":"2024-09-10T23:25:14.854302+0000","last_clean":"2024-09-10T23:25:14.854302+0000","last_became_active":"2024-09-10T23:25:12.872828+0000","last_became_peered":"2024-09-10T23:25:12.872828+0000","last_unstale":"2024-09-10T23:25:14.854302+0000","last_undegraded":"2024-09-10T23:25:14.854302+0000","last_fullsized":"2024-09-10T23:25:14.854302+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854662+0000","last_change":"2024-09-10T23:25:13.861557+0000","last_active":"2024-09-10T23:25:14.854662+0000","last_peered":"2024-09-10T23:25:14.854662+0000","last_clean":"2024-09-10T23:25:14.854662+0000","last_became_active":"2024-09-10T23:25:13.861288+0000","last_became_peered":"2024-09-10T23:25:13.861288+0000","last_unstale":"2024-09-10T23:25:14.854662+0000","last_undegraded":"2024-09-10T23:25:14.854662+0000","last_fullsized":"2024-09-10T23:25:14.854662+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:07.467267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539287+0000","last_change":"2024-09-10T23:25:12.861726+0000","last_active":"2024-09-10T23:25:15.539287+0000","last_peered":"2024-09-10T23:25:15.539287+0000","last_clean":"2024-09-10T23:25:15.539287+0000","last_became_active":"2024-09-10T23:25:12.861433+0000","last_became_peered":"2024-09-10T23:25:12.861433+0000","last_unstale":"2024-09-10T23:25:15.539287+0000","last_undegraded":"2024-09-10T23:25:15.539287+0000","last_fullsized":"2024-09-10T23:25:15.539287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:18.517338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539453+0000","last_change":"2024-09-10T23:25:13.876395+0000","last_active":"2024-09-10T23:25:15.539453+0000","last_peered":"2024-09-10T23:25:15.539453+0000","last_clean":"2024-09-10T23:25:15.539453+0000","last_became_active":"2024-09-10T23:25:13.876074+0000","last_became_peered":"2024-09-10T23:25:13.876074+0000","last_unstale":"2024-09-10T23:25:15.539453+0000","last_undegraded":"2024-09-10T23:25:15.539453+0000","last_fullsized":"2024-09-10T23:25:15.539453+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:48.273393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849066+0000","last_change":"2024-09-10T23:25:12.857750+0000","last_active":"2024-09-10T23:25:14.849066+0000","last_peered":"2024-09-10T23:25:14.849066+0000","last_clean":"2024-09-10T23:25:14.849066+0000","last_became_active":"2024-09-10T23:25:12.857460+0000","last_became_peered":"2024-09-10T23:25:12.857460+0000","last_unstale":"2024-09-10T23:25:14.849066+0000","last_undegraded":"2024-09-10T23:25:14.849066+0000","last_fullsized":"2024-09-10T23:25:14.849066+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168579+0000","last_change":"2024-09-10T23:25:13.880336+0000","last_active":"2024-09-10T23:25:15.168579+0000","last_peered":"2024-09-10T23:25:15.168579+0000","last_clean":"2024-09-10T23:25:15.168579+0000","last_became_active":"2024-09-10T23:25:13.877088+0000","last_became_peered":"2024-09-10T23:25:13.877088+0000","last_unstale":"2024-09-10T23:25:15.168579+0000","last_undegraded":"2024-09-10T23:25:15.168579+0000","last_fullsized":"2024-09-10T23:25:15.168579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:30.634846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543073+0000","last_change":"2024-09-10T23:25:12.872243+0000","last_active":"2024-09-10T23:25:15.543073+0000","last_peered":"2024-09-10T23:25:15.543073+0000","last_clean":"2024-09-10T23:25:15.543073+0000","last_became_active":"2024-09-10T23:25:12.870719+0000","last_became_peered":"2024-09-10T23:25:12.870719+0000","last_unstale":"2024-09-10T23:25:15.543073+0000","last_undegraded":"2024-09-10T23:25:15.543073+0000","last_fullsized":"2024-09-10T23:25:15.543073+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:44.618611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.538860+0000","last_change":"2024-09-10T23:25:13.874102+0000","last_active":"2024-09-10T23:25:15.538860+0000","last_peered":"2024-09-10T23:25:15.538860+0000","last_clean":"2024-09-10T23:25:15.538860+0000","last_became_active":"2024-09-10T23:25:13.873768+0000","last_became_peered":"2024-09-10T23:25:13.873768+0000","last_unstale":"2024-09-10T23:25:15.538860+0000","last_undegraded":"2024-09-10T23:25:15.538860+0000","last_fullsized":"2024-09-10T23:25:15.538860+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:36.941953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543141+0000","last_change":"2024-09-10T23:25:12.867851+0000","last_active":"2024-09-10T23:25:15.543141+0000","last_peered":"2024-09-10T23:25:15.543141+0000","last_clean":"2024-09-10T23:25:15.543141+0000","last_became_active":"2024-09-10T23:25:12.867574+0000","last_became_peered":"2024-09-10T23:25:12.867574+0000","last_unstale":"2024-09-10T23:25:15.543141+0000","last_undegraded":"2024-09-10T23:25:15.543141+0000","last_fullsized":"2024-09-10T23:25:15.543141+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:04.845258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849337+0000","last_change":"2024-09-10T23:25:13.863808+0000","last_active":"2024-09-10T23:25:14.849337+0000","last_peered":"2024-09-10T23:25:14.849337+0000","last_clean":"2024-09-10T23:25:14.849337+0000","last_became_active":"2024-09-10T23:25:13.863523+0000","last_became_peered":"2024-09-10T23:25:13.863523+0000","last_unstale":"2024-09-10T23:25:14.849337+0000","last_undegraded":"2024-09-10T23:25:14.849337+0000","last_fullsized":"2024-09-10T23:25:14.849337+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.540444+0000","last_change":"2024-09-10T23:25:12.870251+0000","last_active":"2024-09-10T23:25:15.540444+0000","last_peered":"2024-09-10T23:25:15.540444+0000","last_clean":"2024-09-10T23:25:15.540444+0000","last_became_active":"2024-09-10T23:25:12.868133+0000","last_became_peered":"2024-09-10T23:25:12.868133+0000","last_unstale":"2024-09-10T23:25:15.540444+0000","last_undegraded":"2024-09-10T23:25:15.540444+0000","last_fullsized":"2024-09-10T23:25:15.540444+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543987+0000","last_change":"2024-09-10T23:25:13.876765+0000","last_active":"2024-09-10T23:25:15.543987+0000","last_peered":"2024-09-10T23:25:15.543987+0000","last_clean":"2024-09-10T23:25:15.543987+0000","last_became_active":"2024-09-10T23:25:13.876265+0000","last_became_peered":"2024-09-10T23:25:13.876265+0000","last_unstale":"2024-09-10T23:25:15.543987+0000","last_undegraded":"2024-09-10T23:25:15.543987+0000","last_fullsized":"2024-09-10T23:25:15.543987+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:11.108931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"143'3","reported_seq":18,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168465+0000","last_change":"2024-09-10T23:25:12.866370+0000","last_active":"2024-09-10T23:25:15.168465+0000","last_peered":"2024-09-10T23:25:15.168465+0000","last_clean":"2024-09-10T23:25:15.168465+0000","last_became_active":"2024-09-10T23:25:12.866110+0000","last_became_peered":"2024-09-10T23:25:12.866110+0000","last_unstale":"2024-09-10T23:25:15.168465+0000","last_undegraded":"2024-09-10T23:25:15.168465+0000","last_fullsized":"2024-09-10T23:25:15.168465+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:16.892811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543795+0000","last_change":"2024-09-10T23:25:13.872367+0000","last_active":"2024-09-10T23:25:15.543795+0000","last_peered":"2024-09-10T23:25:15.543795+0000","last_clean":"2024-09-10T23:25:15.543795+0000","last_became_active":"2024-09-10T23:25:13.871439+0000","last_became_peered":"2024-09-10T23:25:13.871439+0000","last_unstale":"2024-09-10T23:25:15.543795+0000","last_undegraded":"2024-09-10T23:25:15.543795+0000","last_fullsized":"2024-09-10T23:25:15.543795+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:08.100813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"143'6","reported_seq":21,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168138+0000","last_change":"2024-09-10T23:25:12.863438+0000","last_active":"2024-09-10T23:25:15.168138+0000","last_peered":"2024-09-10T23:25:15.168138+0000","last_clean":"2024-09-10T23:25:15.168138+0000","last_became_active":"2024-09-10T23:25:12.863119+0000","last_became_peered":"2024-09-10T23:25:12.863119+0000","last_unstale":"2024-09-10T23:25:15.168138+0000","last_undegraded":"2024-09-10T23:25:15.168138+0000","last_fullsized":"2024-09-10T23:25:15.168138+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:04.730019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539884+0000","last_change":"2024-09-10T23:25:13.863293+0000","last_active":"2024-09-10T23:25:15.539884+0000","last_peered":"2024-09-10T23:25:15.539884+0000","last_clean":"2024-09-10T23:25:15.539884+0000","last_became_active":"2024-09-10T23:25:13.861554+0000","last_became_peered":"2024-09-10T23:25:13.861554+0000","last_unstale":"2024-09-10T23:25:15.539884+0000","last_undegraded":"2024-09-10T23:25:15.539884+0000","last_fullsized":"2024-09-10T23:25:15.539884+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:29.336675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.540020+0000","last_change":"2024-09-10T23:25:12.870308+0000","last_active":"2024-09-10T23:25:15.540020+0000","last_peered":"2024-09-10T23:25:15.540020+0000","last_clean":"2024-09-10T23:25:15.540020+0000","last_became_active":"2024-09-10T23:25:12.870004+0000","last_became_peered":"2024-09-10T23:25:12.870004+0000","last_unstale":"2024-09-10T23:25:15.540020+0000","last_undegraded":"2024-09-10T23:25:15.540020+0000","last_fullsized":"2024-09-10T23:25:15.540020+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:26.297677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168548+0000","last_change":"2024-09-10T23:25:13.879660+0000","last_active":"2024-09-10T23:25:15.168548+0000","last_peered":"2024-09-10T23:25:15.168548+0000","last_clean":"2024-09-10T23:25:15.168548+0000","last_became_active":"2024-09-10T23:25:13.876125+0000","last_became_peered":"2024-09-10T23:25:13.876125+0000","last_unstale":"2024-09-10T23:25:15.168548+0000","last_undegraded":"2024-09-10T23:25:15.168548+0000","last_fullsized":"2024-09-10T23:25:15.168548+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:13.803118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543208+0000","last_change":"2024-09-10T23:25:12.867167+0000","last_active":"2024-09-10T23:25:15.543208+0000","last_peered":"2024-09-10T23:25:15.543208+0000","last_clean":"2024-09-10T23:25:15.543208+0000","last_became_active":"2024-09-10T23:25:12.866906+0000","last_became_peered":"2024-09-10T23:25:12.866906+0000","last_unstale":"2024-09-10T23:25:15.543208+0000","last_undegraded":"2024-09-10T23:25:15.543208+0000","last_fullsized":"2024-09-10T23:25:15.543208+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:16.047610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539611+0000","last_change":"2024-09-10T23:25:13.869365+0000","last_active":"2024-09-10T23:25:15.539611+0000","last_peered":"2024-09-10T23:25:15.539611+0000","last_clean":"2024-09-10T23:25:15.539611+0000","last_became_active":"2024-09-10T23:25:13.869097+0000","last_became_peered":"2024-09-10T23:25:13.869097+0000","last_unstale":"2024-09-10T23:25:15.539611+0000","last_undegraded":"2024-09-10T23:25:15.539611+0000","last_fullsized":"2024-09-10T23:25:15.539611+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:30:57.674366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"143'8","reported_seq":23,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849356+0000","last_change":"2024-09-10T23:25:12.860677+0000","last_active":"2024-09-10T23:25:14.849356+0000","last_peered":"2024-09-10T23:25:14.849356+0000","last_clean":"2024-09-10T23:25:14.849356+0000","last_became_active":"2024-09-10T23:25:12.860380+0000","last_became_peered":"2024-09-10T23:25:12.860380+0000","last_unstale":"2024-09-10T23:25:14.849356+0000","last_undegraded":"2024-09-10T23:25:14.849356+0000","last_fullsized":"2024-09-10T23:25:14.849356+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:06.604930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543016+0000","last_change":"2024-09-10T23:25:13.873862+0000","last_active":"2024-09-10T23:25:15.543016+0000","last_peered":"2024-09-10T23:25:15.543016+0000","last_clean":"2024-09-10T23:25:15.543016+0000","last_became_active":"2024-09-10T23:25:13.873313+0000","last_became_peered":"2024-09-10T23:25:13.873313+0000","last_unstale":"2024-09-10T23:25:15.543016+0000","last_undegraded":"2024-09-10T23:25:15.543016+0000","last_fullsized":"2024-09-10T23:25:15.543016+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:01.634211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543221+0000","last_change":"2024-09-10T23:25:12.872714+0000","last_active":"2024-09-10T23:25:15.543221+0000","last_peered":"2024-09-10T23:25:15.543221+0000","last_clean":"2024-09-10T23:25:15.543221+0000","last_became_active":"2024-09-10T23:25:12.872395+0000","last_became_peered":"2024-09-10T23:25:12.872395+0000","last_unstale":"2024-09-10T23:25:15.543221+0000","last_undegraded":"2024-09-10T23:25:15.543221+0000","last_fullsized":"2024-09-10T23:25:15.543221+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:24.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168048+0000","last_change":"2024-09-10T23:25:13.883771+0000","last_active":"2024-09-10T23:25:15.168048+0000","last_peered":"2024-09-10T23:25:15.168048+0000","last_clean":"2024-09-10T23:25:15.168048+0000","last_became_active":"2024-09-10T23:25:13.883497+0000","last_became_peered":"2024-09-10T23:25:13.883497+0000","last_unstale":"2024-09-10T23:25:15.168048+0000","last_undegraded":"2024-09-10T23:25:15.168048+0000","last_fullsized":"2024-09-10T23:25:15.168048+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:09.361672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543952+0000","last_change":"2024-09-10T23:25:12.869708+0000","last_active":"2024-09-10T23:25:15.543952+0000","last_peered":"2024-09-10T23:25:15.543952+0000","last_clean":"2024-09-10T23:25:15.543952+0000","last_became_active":"2024-09-10T23:25:12.869271+0000","last_became_peered":"2024-09-10T23:25:12.869271+0000","last_unstale":"2024-09-10T23:25:15.543952+0000","last_undegraded":"2024-09-10T23:25:15.543952+0000","last_fullsized":"2024-09-10T23:25:15.543952+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:03.491852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168211+0000","last_change":"2024-09-10T23:25:13.872726+0000","last_active":"2024-09-10T23:25:15.168211+0000","last_peered":"2024-09-10T23:25:15.168211+0000","last_clean":"2024-09-10T23:25:15.168211+0000","last_became_active":"2024-09-10T23:25:13.872469+0000","last_became_peered":"2024-09-10T23:25:13.872469+0000","last_unstale":"2024-09-10T23:25:15.168211+0000","last_undegraded":"2024-09-10T23:25:15.168211+0000","last_fullsized":"2024-09-10T23:25:15.168211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:17.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"143'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849871+0000","last_change":"2024-09-10T23:25:12.858520+0000","last_active":"2024-09-10T23:25:14.849871+0000","last_peered":"2024-09-10T23:25:14.849871+0000","last_clean":"2024-09-10T23:25:14.849871+0000","last_became_active":"2024-09-10T23:25:12.858244+0000","last_became_peered":"2024-09-10T23:25:12.858244+0000","last_unstale":"2024-09-10T23:25:14.849871+0000","last_undegraded":"2024-09-10T23:25:14.849871+0000","last_fullsized":"2024-09-10T23:25:14.849871+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:44.403969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.538883+0000","last_change":"2024-09-10T23:25:13.869640+0000","last_active":"2024-09-10T23:25:15.538883+0000","last_peered":"2024-09-10T23:25:15.538883+0000","last_clean":"2024-09-10T23:25:15.538883+0000","last_became_active":"2024-09-10T23:25:13.869369+0000","last_became_peered":"2024-09-10T23:25:13.869369+0000","last_unstale":"2024-09-10T23:25:15.538883+0000","last_undegraded":"2024-09-10T23:25:15.538883+0000","last_fullsized":"2024-09-10T23:25:15.538883+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:04.046832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539560+0000","last_change":"2024-09-10T23:25:12.865263+0000","last_active":"2024-09-10T23:25:15.539560+0000","last_peered":"2024-09-10T23:25:15.539560+0000","last_clean":"2024-09-10T23:25:15.539560+0000","last_became_active":"2024-09-10T23:25:12.863466+0000","last_became_peered":"2024-09-10T23:25:12.863466+0000","last_unstale":"2024-09-10T23:25:15.539560+0000","last_undegraded":"2024-09-10T23:25:15.539560+0000","last_fullsized":"2024-09-10T23:25:15.539560+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:44.648714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539565+0000","last_change":"2024-09-10T23:25:13.864977+0000","last_active":"2024-09-10T23:25:15.539565+0000","last_peered":"2024-09-10T23:25:15.539565+0000","last_clean":"2024-09-10T23:25:15.539565+0000","last_became_active":"2024-09-10T23:25:13.864697+0000","last_became_peered":"2024-09-10T23:25:13.864697+0000","last_unstale":"2024-09-10T23:25:15.539565+0000","last_undegraded":"2024-09-10T23:25:15.539565+0000","last_fullsized":"2024-09-10T23:25:15.539565+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:08.249549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854312+0000","last_change":"2024-09-10T23:25:12.867813+0000","last_active":"2024-09-10T23:25:14.854312+0000","last_peered":"2024-09-10T23:25:14.854312+0000","last_clean":"2024-09-10T23:25:14.854312+0000","last_became_active":"2024-09-10T23:25:12.867541+0000","last_became_peered":"2024-09-10T23:25:12.867541+0000","last_unstale":"2024-09-10T23:25:14.854312+0000","last_undegraded":"2024-09-10T23:25:14.854312+0000","last_fullsized":"2024-09-10T23:25:14.854312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.540406+0000","last_change":"2024-09-10T23:25:13.860966+0000","last_active":"2024-09-10T23:25:15.540406+0000","last_peered":"2024-09-10T23:25:15.540406+0000","last_clean":"2024-09-10T23:25:15.540406+0000","last_became_active":"2024-09-10T23:25:13.860080+0000","last_became_peered":"2024-09-10T23:25:13.860080+0000","last_unstale":"2024-09-10T23:25:15.540406+0000","last_undegraded":"2024-09-10T23:25:15.540406+0000","last_fullsized":"2024-09-10T23:25:15.540406+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:10.419317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.540008+0000","last_change":"2024-09-10T23:25:12.871815+0000","last_active":"2024-09-10T23:25:15.540008+0000","last_peered":"2024-09-10T23:25:15.540008+0000","last_clean":"2024-09-10T23:25:15.540008+0000","last_became_active":"2024-09-10T23:25:12.871500+0000","last_became_peered":"2024-09-10T23:25:12.871500+0000","last_unstale":"2024-09-10T23:25:15.540008+0000","last_undegraded":"2024-09-10T23:25:15.540008+0000","last_fullsized":"2024-09-10T23:25:15.540008+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:27.313249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539699+0000","last_change":"2024-09-10T23:25:13.874902+0000","last_active":"2024-09-10T23:25:15.539699+0000","last_peered":"2024-09-10T23:25:15.539699+0000","last_clean":"2024-09-10T23:25:15.539699+0000","last_became_active":"2024-09-10T23:25:13.874194+0000","last_became_peered":"2024-09-10T23:25:13.874194+0000","last_unstale":"2024-09-10T23:25:15.539699+0000","last_undegraded":"2024-09-10T23:25:15.539699+0000","last_fullsized":"2024-09-10T23:25:15.539699+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:08.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168123+0000","last_change":"2024-09-10T23:25:12.869257+0000","last_active":"2024-09-10T23:25:15.168123+0000","last_peered":"2024-09-10T23:25:15.168123+0000","last_clean":"2024-09-10T23:25:15.168123+0000","last_became_active":"2024-09-10T23:25:12.868744+0000","last_became_peered":"2024-09-10T23:25:12.868744+0000","last_unstale":"2024-09-10T23:25:15.168123+0000","last_undegraded":"2024-09-10T23:25:15.168123+0000","last_fullsized":"2024-09-10T23:25:15.168123+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:10.106175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.542988+0000","last_change":"2024-09-10T23:25:13.877129+0000","last_active":"2024-09-10T23:25:15.542988+0000","last_peered":"2024-09-10T23:25:15.542988+0000","last_clean":"2024-09-10T23:25:15.542988+0000","last_became_active":"2024-09-10T23:25:13.876849+0000","last_became_peered":"2024-09-10T23:25:13.876849+0000","last_unstale":"2024-09-10T23:25:15.542988+0000","last_undegraded":"2024-09-10T23:25:15.542988+0000","last_fullsized":"2024-09-10T23:25:15.542988+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:34.171333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849479+0000","last_change":"2024-09-10T23:25:12.869026+0000","last_active":"2024-09-10T23:25:14.849479+0000","last_peered":"2024-09-10T23:25:14.849479+0000","last_clean":"2024-09-10T23:25:14.849479+0000","last_became_active":"2024-09-10T23:25:12.868703+0000","last_became_peered":"2024-09-10T23:25:12.868703+0000","last_unstale":"2024-09-10T23:25:14.849479+0000","last_undegraded":"2024-09-10T23:25:14.849479+0000","last_fullsized":"2024-09-10T23:25:14.849479+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539219+0000","last_change":"2024-09-10T23:25:13.874349+0000","last_active":"2024-09-10T23:25:15.539219+0000","last_peered":"2024-09-10T23:25:15.539219+0000","last_clean":"2024-09-10T23:25:15.539219+0000","last_became_active":"2024-09-10T23:25:13.874070+0000","last_became_peered":"2024-09-10T23:25:13.874070+0000","last_unstale":"2024-09-10T23:25:15.539219+0000","last_undegraded":"2024-09-10T23:25:15.539219+0000","last_fullsized":"2024-09-10T23:25:15.539219+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:06.242809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"143'2","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.540527+0000","last_change":"2024-09-10T23:25:12.867865+0000","last_active":"2024-09-10T23:25:15.540527+0000","last_peered":"2024-09-10T23:25:15.540527+0000","last_clean":"2024-09-10T23:25:15.540527+0000","last_became_active":"2024-09-10T23:25:12.867588+0000","last_became_peered":"2024-09-10T23:25:12.867588+0000","last_unstale":"2024-09-10T23:25:15.540527+0000","last_undegraded":"2024-09-10T23:25:15.540527+0000","last_fullsized":"2024-09-10T23:25:15.540527+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:34.917685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543230+0000","last_change":"2024-09-10T23:25:13.870979+0000","last_active":"2024-09-10T23:25:15.543230+0000","last_peered":"2024-09-10T23:25:15.543230+0000","last_clean":"2024-09-10T23:25:15.543230+0000","last_became_active":"2024-09-10T23:25:13.870036+0000","last_became_peered":"2024-09-10T23:25:13.870036+0000","last_unstale":"2024-09-10T23:25:15.543230+0000","last_undegraded":"2024-09-10T23:25:15.543230+0000","last_fullsized":"2024-09-10T23:25:15.543230+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:34.682442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"144'1","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.385351+0000","last_change":"2024-09-10T23:25:12.873264+0000","last_active":"2024-09-10T23:25:15.385351+0000","last_peered":"2024-09-10T23:25:15.385351+0000","last_clean":"2024-09-10T23:25:15.385351+0000","last_became_active":"2024-09-10T23:25:12.872396+0000","last_became_peered":"2024-09-10T23:25:12.872396+0000","last_unstale":"2024-09-10T23:25:15.385351+0000","last_undegraded":"2024-09-10T23:25:15.385351+0000","last_fullsized":"2024-09-10T23:25:15.385351+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:30.465502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167852+0000","last_change":"2024-09-10T23:25:13.882067+0000","last_active":"2024-09-10T23:25:15.167852+0000","last_peered":"2024-09-10T23:25:15.167852+0000","last_clean":"2024-09-10T23:25:15.167852+0000","last_became_active":"2024-09-10T23:25:13.877949+0000","last_became_peered":"2024-09-10T23:25:13.877949+0000","last_unstale":"2024-09-10T23:25:15.167852+0000","last_undegraded":"2024-09-10T23:25:15.167852+0000","last_fullsized":"2024-09-10T23:25:15.167852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:56:50.603669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.854542+0000","last_change":"2024-09-10T23:25:12.870970+0000","last_active":"2024-09-10T23:25:14.854542+0000","last_peered":"2024-09-10T23:25:14.854542+0000","last_clean":"2024-09-10T23:25:14.854542+0000","last_became_active":"2024-09-10T23:25:12.870538+0000","last_became_peered":"2024-09-10T23:25:12.870538+0000","last_unstale":"2024-09-10T23:25:14.854542+0000","last_undegraded":"2024-09-10T23:25:14.854542+0000","last_fullsized":"2024-09-10T23:25:14.854542+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:46.795196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539106+0000","last_change":"2024-09-10T23:25:13.855869+0000","last_active":"2024-09-10T23:25:15.539106+0000","last_peered":"2024-09-10T23:25:15.539106+0000","last_clean":"2024-09-10T23:25:15.539106+0000","last_became_active":"2024-09-10T23:25:13.855567+0000","last_became_peered":"2024-09-10T23:25:13.855567+0000","last_unstale":"2024-09-10T23:25:15.539106+0000","last_undegraded":"2024-09-10T23:25:15.539106+0000","last_fullsized":"2024-09-10T23:25:15.539106+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:56.368396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849680+0000","last_change":"2024-09-10T23:25:12.868622+0000","last_active":"2024-09-10T23:25:14.849680+0000","last_peered":"2024-09-10T23:25:14.849680+0000","last_clean":"2024-09-10T23:25:14.849680+0000","last_became_active":"2024-09-10T23:25:12.868338+0000","last_became_peered":"2024-09-10T23:25:12.868338+0000","last_unstale":"2024-09-10T23:25:14.849680+0000","last_undegraded":"2024-09-10T23:25:14.849680+0000","last_fullsized":"2024-09-10T23:25:14.849680+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:41.711308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849579+0000","last_change":"2024-09-10T23:25:13.869075+0000","last_active":"2024-09-10T23:25:14.849579+0000","last_peered":"2024-09-10T23:25:14.849579+0000","last_clean":"2024-09-10T23:25:14.849579+0000","last_became_active":"2024-09-10T23:25:13.868451+0000","last_became_peered":"2024-09-10T23:25:13.868451+0000","last_unstale":"2024-09-10T23:25:14.849579+0000","last_undegraded":"2024-09-10T23:25:14.849579+0000","last_fullsized":"2024-09-10T23:25:14.849579+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:47.345674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.542837+0000","last_change":"2024-09-10T23:25:12.872334+0000","last_active":"2024-09-10T23:25:15.542837+0000","last_peered":"2024-09-10T23:25:15.542837+0000","last_clean":"2024-09-10T23:25:15.542837+0000","last_became_active":"2024-09-10T23:25:12.871522+0000","last_became_peered":"2024-09-10T23:25:12.871522+0000","last_unstale":"2024-09-10T23:25:15.542837+0000","last_undegraded":"2024-09-10T23:25:15.542837+0000","last_fullsized":"2024-09-10T23:25:15.542837+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:38.706629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849806+0000","last_change":"2024-09-10T23:25:13.869176+0000","last_active":"2024-09-10T23:25:14.849806+0000","last_peered":"2024-09-10T23:25:14.849806+0000","last_clean":"2024-09-10T23:25:14.849806+0000","last_became_active":"2024-09-10T23:25:13.868900+0000","last_became_peered":"2024-09-10T23:25:13.868900+0000","last_unstale":"2024-09-10T23:25:14.849806+0000","last_undegraded":"2024-09-10T23:25:14.849806+0000","last_fullsized":"2024-09-10T23:25:14.849806+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:11.171142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168230+0000","last_change":"2024-09-10T23:25:12.867607+0000","last_active":"2024-09-10T23:25:15.168230+0000","last_peered":"2024-09-10T23:25:15.168230+0000","last_clean":"2024-09-10T23:25:15.168230+0000","last_became_active":"2024-09-10T23:25:12.865003+0000","last_became_peered":"2024-09-10T23:25:12.865003+0000","last_unstale":"2024-09-10T23:25:15.168230+0000","last_undegraded":"2024-09-10T23:25:15.168230+0000","last_fullsized":"2024-09-10T23:25:15.168230+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:25.534423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849577+0000","last_change":"2024-09-10T23:25:13.877088+0000","last_active":"2024-09-10T23:25:14.849577+0000","last_peered":"2024-09-10T23:25:14.849577+0000","last_clean":"2024-09-10T23:25:14.849577+0000","last_became_active":"2024-09-10T23:25:13.876820+0000","last_became_peered":"2024-09-10T23:25:13.876820+0000","last_unstale":"2024-09-10T23:25:14.849577+0000","last_undegraded":"2024-09-10T23:25:14.849577+0000","last_fullsized":"2024-09-10T23:25:14.849577+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:57.482177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:14.849440+0000","last_change":"2024-09-10T23:25:12.855796+0000","last_active":"2024-09-10T23:25:14.849440+0000","last_peered":"2024-09-10T23:25:14.849440+0000","last_clean":"2024-09-10T23:25:14.849440+0000","last_became_active":"2024-09-10T23:25:12.855449+0000","last_became_peered":"2024-09-10T23:25:12.855449+0000","last_unstale":"2024-09-10T23:25:14.849440+0000","last_undegraded":"2024-09-10T23:25:14.849440+0000","last_fullsized":"2024-09-10T23:25:14.849440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:16.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.168525+0000","last_change":"2024-09-10T23:25:13.880032+0000","last_active":"2024-09-10T23:25:15.168525+0000","last_peered":"2024-09-10T23:25:15.168525+0000","last_clean":"2024-09-10T23:25:15.168525+0000","last_became_active":"2024-09-10T23:25:13.879777+0000","last_became_peered":"2024-09-10T23:25:13.879777+0000","last_unstale":"2024-09-10T23:25:15.168525+0000","last_undegraded":"2024-09-10T23:25:15.168525+0000","last_fullsized":"2024-09-10T23:25:15.168525+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:52.516915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.539380+0000","last_change":"2024-09-10T23:25:12.864319+0000","last_active":"2024-09-10T23:25:15.539380+0000","last_peered":"2024-09-10T23:25:15.539380+0000","last_clean":"2024-09-10T23:25:15.539380+0000","last_became_active":"2024-09-10T23:25:12.864040+0000","last_became_peered":"2024-09-10T23:25:12.864040+0000","last_unstale":"2024-09-10T23:25:15.539380+0000","last_undegraded":"2024-09-10T23:25:15.539380+0000","last_fullsized":"2024-09-10T23:25:15.539380+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:28.439090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.543804+0000","last_change":"2024-09-10T23:25:13.873870+0000","last_active":"2024-09-10T23:25:15.543804+0000","last_peered":"2024-09-10T23:25:15.543804+0000","last_clean":"2024-09-10T23:25:15.543804+0000","last_became_active":"2024-09-10T23:25:13.873421+0000","last_became_peered":"2024-09-10T23:25:13.873421+0000","last_unstale":"2024-09-10T23:25:15.543804+0000","last_undegraded":"2024-09-10T23:25:15.543804+0000","last_fullsized":"2024-09-10T23:25:15.543804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:12.836543+0000","last_clean_scrub_stamp":"2024-09-10T23:25:12.836543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:41.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167955+0000","last_change":"2024-09-10T23:25:12.867113+0000","last_active":"2024-09-10T23:25:15.167955+0000","last_peered":"2024-09-10T23:25:15.167955+0000","last_clean":"2024-09-10T23:25:15.167955+0000","last_became_active":"2024-09-10T23:25:12.866816+0000","last_became_peered":"2024-09-10T23:25:12.866816+0000","last_unstale":"2024-09-10T23:25:15.167955+0000","last_undegraded":"2024-09-10T23:25:15.167955+0000","last_fullsized":"2024-09-10T23:25:15.167955+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:25:11.833786+0000","last_clean_scrub_stamp":"2024-09-10T23:25:11.833786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:40.361003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":329,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-10T23:25:15.167673+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:25:15.167673+0000","last_peered":"2024-09-10T23:25:15.167673+0000","last_clean":"2024-09-10T23:25:15.167673+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:25:15.167673+0000","last_undegraded":"2024-09-10T23:25:15.167673+0000","last_fullsized":"2024-09-10T23:25:15.167673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476858,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46832,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325008,"statfs":{"total":96636764160,"available":96588808192,"internally_reserved":0,"allocated":1798144,"data_stored":841884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509563,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64064,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307776,"statfs":{"total":96636764160,"available":96571162624,"internally_reserved":0,"allocated":2400256,"data_stored":1433282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509562,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59316,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312524,"statfs":{"total":96636764160,"available":96576024576,"internally_reserved":0,"allocated":1794048,"data_stored":841234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509563,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64876,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306964,"statfs":{"total":96636764160,"available":96570331136,"internally_reserved":0,"allocated":1789952,"data_stored":841212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509562,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69040,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302800,"statfs":{"total":96636764160,"available":96566067200,"internally_reserved":0,"allocated":1798144,"data_stored":841828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509563,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55152,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316688,"statfs":{"total":96636764160,"available":96580288512,"internally_reserved":0,"allocated":1794048,"data_stored":841282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509562,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73784,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298056,"statfs":{"total":96636764160,"available":96561209344,"internally_reserved":0,"allocated":2392064,"data_stored":1431636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46844,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324996,"statfs":{"total":96636764160,"available":96588795904,"internally_reserved":0,"allocated":1806336,"data_stored":842894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:25:23.009 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:25:23.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:25:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 -- 172.21.15.17:0/483121339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 msgr2=0x7fc0d80b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 --2- 172.21.15.17:0/483121339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 0x7fc0d80b2aa0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80cc500 tx=0x7fc0c801db00 comp rx=0 tx=0).stop 2024-09-10T23:25:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 -- 172.21.15.17:0/483121339 shutdown_connections 2024-09-10T23:25:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 --2- 172.21.15.17:0/483121339 >> v2:172.21.15.77:3300/0 conn(0x7fc0d80b2fe0 0x7fc0d80cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 --2- 172.21.15.17:0/483121339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 0x7fc0d80b2aa0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 -- 172.21.15.17:0/483121339 >> 172.21.15.17:0/483121339 conn(0x7fc0d80b17a0 msgr2=0x7fc0d80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 -- 172.21.15.17:0/483121339 shutdown_connections 2024-09-10T23:25:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 -- 172.21.15.17:0/483121339 wait complete. 2024-09-10T23:25:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 Processor -- start 2024-09-10T23:25:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 -- start start 2024-09-10T23:25:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0d80b2fe0 0x7fc0d81589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d80cf580 0x7fc0d81465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 0x7fc0d815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d806fa20 con 0x7fc0d815a2a0 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d806f8a0 con 0x7fc0d80cf580 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0dd600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d806fba0 con 0x7fc0d80b2fe0 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 0x7fc0d815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 0x7fc0d815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56004/0 (socket says 172.21.15.17:56004) 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0d7400640 1 -- 172.21.15.17:0/2606922688 learned_addr learned my addr 172.21.15.17:0/2606922688 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0d6a00640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0d80b2fe0 0x7fc0d81589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0cfe00640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d80cf580 0x7fc0d81465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0d7400640 1 -- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0d80b2fe0 msgr2=0x7fc0d81589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0d7400640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0d80b2fe0 0x7fc0d81589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0d7400640 1 -- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d80cf580 msgr2=0x7fc0d81465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0d7400640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d80cf580 0x7fc0d81465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0d7400640 1 -- 172.21.15.17:0/2606922688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d80ad9e0 con 0x7fc0d815a2a0 2024-09-10T23:25:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.198+0000 7fc0cfe00640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d80cf580 0x7fc0d81465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.202+0000 7fc0d7400640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 0x7fc0d815abd0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000c730 tx=0x7fc0d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.202+0000 7fc0cea00640 1 -- 172.21.15.17:0/2606922688 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0003db0 con 0x7fc0d815a2a0 2024-09-10T23:25:23.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.202+0000 7fc0cea00640 1 -- 172.21.15.17:0/2606922688 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0d000ce40 con 0x7fc0d815a2a0 2024-09-10T23:25:23.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.202+0000 7fc0cea00640 1 -- 172.21.15.17:0/2606922688 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00052d0 con 0x7fc0d815a2a0 2024-09-10T23:25:23.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.202+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d80adcc0 con 0x7fc0d815a2a0 2024-09-10T23:25:23.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.202+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d8146b30 con 0x7fc0d815a2a0 2024-09-10T23:25:23.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.202+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d80cf040 con 0x7fc0d815a2a0 2024-09-10T23:25:23.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.202+0000 7fc0cea00640 1 -- 172.21.15.17:0/2606922688 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc0d0005470 con 0x7fc0d815a2a0 2024-09-10T23:25:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.206+0000 7fc0cea00640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0b40725e0 0x7fc0b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.206+0000 7fc0cea00640 1 -- 172.21.15.17:0/2606922688 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fc0d00931d0 con 0x7fc0d815a2a0 2024-09-10T23:25:23.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.206+0000 7fc0d6a00640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0b40725e0 0x7fc0b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.206+0000 7fc0d6a00640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0b40725e0 0x7fc0b4074aa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80b0000 tx=0x7fc0c801c340 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.210+0000 7fc0cea00640 1 -- 172.21.15.17:0/2606922688 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc0d005e710 con 0x7fc0d815a2a0 2024-09-10T23:25:23.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.446+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc0d806ff90 con 0x7fc0d815a2a0 2024-09-10T23:25:23.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.446+0000 7fc0cea00640 1 -- 172.21.15.17:0/2606922688 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7fc0d005e010 con 0x7fc0d815a2a0 2024-09-10T23:25:23.451 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:25:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:25:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:25:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:25:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:25:23.452 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:25:23.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0b40725e0 msgr2=0x7fc0b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0b40725e0 0x7fc0b4074aa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80b0000 tx=0x7fc0c801c340 comp rx=0 tx=0).stop 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 msgr2=0x7fc0d815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 0x7fc0d815abd0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000c730 tx=0x7fc0d000cbf0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 shutdown_connections 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc0b40725e0 0x7fc0b4074aa0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0d815a2a0 0x7fc0d815abd0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d80cf580 0x7fc0d81465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 --2- 172.21.15.17:0/2606922688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc0d80b2fe0 0x7fc0d81589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 >> 172.21.15.17:0/2606922688 conn(0x7fc0d80b17a0 msgr2=0x7fc0d8156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 shutdown_connections 2024-09-10T23:25:23.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.450+0000 7fc0dd600640 1 -- 172.21.15.17:0/2606922688 wait complete. 2024-09-10T23:25:23.473 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.614+0000 7ff059000640 1 -- 172.21.15.17:0/3083603796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 msgr2=0x7ff054150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.614+0000 7ff059000640 1 --2- 172.21.15.17:0/3083603796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 0x7ff054150d70 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7ff05406dba0 tx=0x7ff04c01f580 comp rx=0 tx=0).stop 2024-09-10T23:25:23.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.614+0000 7ff059000640 1 -- 172.21.15.17:0/3083603796 shutdown_connections 2024-09-10T23:25:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.614+0000 7ff059000640 1 --2- 172.21.15.17:0/3083603796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 0x7ff054150d70 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.614+0000 7ff059000640 1 --2- 172.21.15.17:0/3083603796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0540cf610 0x7ff05415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.614+0000 7ff059000640 1 --2- 172.21.15.17:0/3083603796 >> v2:172.21.15.77:3300/0 conn(0x7ff0540cf230 0x7ff05406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.614+0000 7ff059000640 1 -- 172.21.15.17:0/3083603796 >> 172.21.15.17:0/3083603796 conn(0x7ff05406cfc0 msgr2=0x7ff05406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.614+0000 7ff059000640 1 -- 172.21.15.17:0/3083603796 shutdown_connections 2024-09-10T23:25:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.614+0000 7ff059000640 1 -- 172.21.15.17:0/3083603796 wait complete. 2024-09-10T23:25:23.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 Processor -- start 2024-09-10T23:25:23.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 -- start start 2024-09-10T23:25:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 0x7ff054147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0540cf230 0x7ff05414c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0540cf610 0x7ff0540cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0540d0120 con 0x7ff0540b32d0 2024-09-10T23:25:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0540cffa0 con 0x7ff0540cf610 2024-09-10T23:25:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff0540d02a0 con 0x7ff0540cf230 2024-09-10T23:25:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff051e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 0x7ff054147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff051e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 0x7ff054147490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56026/0 (socket says 172.21.15.17:56026) 2024-09-10T23:25:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff051e00640 1 -- 172.21.15.17:0/997136103 learned_addr learned my addr 172.21.15.17:0/997136103 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff052800640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0540cf610 0x7ff0540cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff04be00640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0540cf230 0x7ff05414c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff051e00640 1 -- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0540cf230 msgr2=0x7ff05414c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff051e00640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0540cf230 0x7ff05414c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff051e00640 1 -- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0540cf610 msgr2=0x7ff0540cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff051e00640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0540cf610 0x7ff0540cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff051e00640 1 -- 172.21.15.17:0/997136103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0541479d0 con 0x7ff0540b32d0 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff04be00640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0540cf230 0x7ff05414c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff051e00640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 0x7ff054147490 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7ff04400d720 tx=0x7ff04400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff04a000640 1 -- 172.21.15.17:0/997136103 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044017070 con 0x7ff0540b32d0 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff04a000640 1 -- 172.21.15.17:0/997136103 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff044009d20 con 0x7ff0540b32d0 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff04a000640 1 -- 172.21.15.17:0/997136103 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044004280 con 0x7ff0540b32d0 2024-09-10T23:25:23.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05414ccf0 con 0x7ff0540b32d0 2024-09-10T23:25:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.618+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0541f60c0 con 0x7ff0540b32d0 2024-09-10T23:25:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.622+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05406e750 con 0x7ff0540b32d0 2024-09-10T23:25:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.622+0000 7ff04a000640 1 -- 172.21.15.17:0/997136103 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff044005020 con 0x7ff0540b32d0 2024-09-10T23:25:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.622+0000 7ff04a000640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0300725e0 0x7ff030074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.622+0000 7ff04a000640 1 -- 172.21.15.17:0/997136103 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7ff044093890 con 0x7ff0540b32d0 2024-09-10T23:25:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.622+0000 7ff04be00640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0300725e0 0x7ff030074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:23.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.622+0000 7ff04be00640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0300725e0 0x7ff030074aa0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff0540b1280 tx=0x7ff03c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:23.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.626+0000 7ff04a000640 1 -- 172.21.15.17:0/997136103 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff044020020 con 0x7ff0540b32d0 2024-09-10T23:25:23.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.834+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff054150d50 con 0x7ff0540b32d0 2024-09-10T23:25:23.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.834+0000 7ff04a000640 1 -- 172.21.15.17:0/997136103 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7ff04405ecc0 con 0x7ff0540b32d0 2024-09-10T23:25:23.839 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:23.839 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:23.840 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0300725e0 msgr2=0x7ff030074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0300725e0 0x7ff030074aa0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff0540b1280 tx=0x7ff03c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 msgr2=0x7ff054147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 0x7ff054147490 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7ff04400d720 tx=0x7ff04400dbe0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 shutdown_connections 2024-09-10T23:25:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0300725e0 0x7ff030074aa0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0540cf610 0x7ff0540cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0540cf230 0x7ff05414c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 --2- 172.21.15.17:0/997136103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0540b32d0 0x7ff054147490 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 >> 172.21.15.17:0/997136103 conn(0x7ff05406cfc0 msgr2=0x7ff05414a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:23.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 shutdown_connections 2024-09-10T23:25:23.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:23.838+0000 7ff059000640 1 -- 172.21.15.17:0/997136103 wait complete. 2024-09-10T23:25:24.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:25:13.260978+0000', 'modified': '2024-09-10T23:25:16.270101+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8634': {'gid': 8634, 'name': 'd', 'rank': 0, 'incarnation': 100, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/1244612709', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6835', 'nonce': 1244612709}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 1244612709}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8634, 'qdb_cluster': [8634]} 2024-09-10T23:25:24.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:25:24.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T23:25:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.410+0000 7fe62f000640 1 -- 172.21.15.17:0/1900214264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 msgr2=0x7fe62806ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.410+0000 7fe62f000640 1 --2- 172.21.15.17:0/1900214264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 0x7fe62806ef80 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe61800aa10 tx=0x7fe61801dc30 comp rx=0 tx=0).stop 2024-09-10T23:25:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 -- 172.21.15.17:0/1900214264 shutdown_connections 2024-09-10T23:25:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 --2- 172.21.15.17:0/1900214264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6280ceed0 0x7fe6280cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 --2- 172.21.15.17:0/1900214264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 0x7fe62806ef80 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 -- 172.21.15.17:0/1900214264 >> 172.21.15.17:0/1900214264 conn(0x7fe6280b1730 msgr2=0x7fe6280b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 -- 172.21.15.17:0/1900214264 shutdown_connections 2024-09-10T23:25:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 -- 172.21.15.17:0/1900214264 wait complete. 2024-09-10T23:25:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 Processor -- start 2024-09-10T23:25:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 -- start start 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe628072840 0x7fe6281f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6280ceed0 0x7fe62815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 0x7fe62814d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe628167210 con 0x7fe6281513b0 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe628167090 con 0x7fe6280ceed0 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62f000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe628167390 con 0x7fe628072840 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 0x7fe62814d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 0x7fe62814d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56050/0 (socket says 172.21.15.17:56050) 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62d000640 1 -- 172.21.15.17:0/1884759182 learned_addr learned my addr 172.21.15.17:0/1884759182 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe627e00640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe628072840 0x7fe6281f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe627400640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6280ceed0 0x7fe62815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62d000640 1 -- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe628072840 msgr2=0x7fe6281f8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62d000640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe628072840 0x7fe6281f8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62d000640 1 -- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6280ceed0 msgr2=0x7fe62815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62d000640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6280ceed0 0x7fe62815b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62d000640 1 -- 172.21.15.17:0/1884759182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62814dc70 con 0x7fe6281513b0 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.414+0000 7fe62d000640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 0x7fe62814d1c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c7a0 tx=0x7fe62000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe61fe00640 1 -- 172.21.15.17:0/1884759182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620003b80 con 0x7fe6281513b0 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe61fe00640 1 -- 172.21.15.17:0/1884759182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe620003d40 con 0x7fe6281513b0 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe61fe00640 1 -- 172.21.15.17:0/1884759182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62000aab0 con 0x7fe6281513b0 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe62f000640 1 -- 172.21.15.17:0/1884759182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62815bad0 con 0x7fe6281513b0 2024-09-10T23:25:24.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe62f000640 1 -- 172.21.15.17:0/1884759182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62815c090 con 0x7fe6281513b0 2024-09-10T23:25:24.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe61fe00640 1 -- 172.21.15.17:0/1884759182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe62000ac50 con 0x7fe6281513b0 2024-09-10T23:25:24.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe61fe00640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe608072610 0x7fe608074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe61fe00640 1 -- 172.21.15.17:0/1884759182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fe620092fe0 con 0x7fe6281513b0 2024-09-10T23:25:24.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe6323bd000 1 Processor -- start 2024-09-10T23:25:24.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe627e00640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe608072610 0x7fe608074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.418+0000 7fe6323bd000 1 -- start start 2024-09-10T23:25:24.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627e00640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe608072610 0x7fe608074ad0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe6180b0000 tx=0x7fe61801c470 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 0x55f70f903db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f8b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f8b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f70f7d83f0 con 0x55f70f9042f0 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f70f715b20 con 0x55f70f9039d0 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f70f704f50 con 0x55f70f8b7e10 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f8b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f8b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56060/0 (socket says 172.21.15.17:56060) 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627400640 1 -- 172.21.15.17:0/3377036636 learned_addr learned my addr 172.21.15.17:0/3377036636 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe62d000640 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f8b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627e00640 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 0x55f70f903db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627400640 1 -- 172.21.15.17:0/3377036636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 msgr2=0x55f70f8b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627400640 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f8b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627400640 1 -- 172.21.15.17:0/3377036636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 msgr2=0x55f70f903db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627400640 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 0x55f70f903db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627400640 1 -- 172.21.15.17:0/3377036636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70f6cc590 con 0x55f70f9042f0 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627e00640 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 0x55f70f903db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe627400640 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f8b78d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fe614009c30 tx=0x7fe614011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75184fafc9cfd93b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe61cc00640 1 -- 172.21.15.17:0/3377036636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614004220 con 0x55f70f9042f0 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe61cc00640 1 -- 172.21.15.17:0/3377036636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe614003600 con 0x55f70f9042f0 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe61cc00640 1 -- 172.21.15.17:0/3377036636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6140044b0 con 0x55f70f9042f0 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 -- 172.21.15.17:0/3377036636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 msgr2=0x55f70f8b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f8b78d0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fe614009c30 tx=0x7fe614011810 comp rx=0 tx=0).stop 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 -- 172.21.15.17:0/3377036636 shutdown_connections 2024-09-10T23:25:24.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f8b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f8b78d0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 --2- 172.21.15.17:0/3377036636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 0x55f70f903db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 -- 172.21.15.17:0/3377036636 >> 172.21.15.17:0/3377036636 conn(0x55f70f7a1130 msgr2=0x55f70f8e6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:24.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 -- 172.21.15.17:0/3377036636 shutdown_connections 2024-09-10T23:25:24.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 -- 172.21.15.17:0/3377036636 wait complete. 2024-09-10T23:25:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 -- start start 2024-09-10T23:25:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.422+0000 7fe6323bd000 1 Processor -- start 2024-09-10T23:25:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f8b7e10 0x55f70f8e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f8e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f9042f0 0x55f70f8e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f70f69f5d0 con 0x55f70f9039d0 2024-09-10T23:25:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f70f708d60 con 0x55f70f8b7e10 2024-09-10T23:25:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f70f6ab500 con 0x55f70f9042f0 2024-09-10T23:25:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 10 client.0 _ll_register_callbacks cb 0x55f70f6af810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f8e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f8e4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56070/0 (socket says 172.21.15.17:56070) 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627400640 1 -- 172.21.15.17:0/2405125620 learned_addr learned my addr 172.21.15.17:0/2405125620 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627e00640 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f8b7e10 0x55f70f8e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe62d000640 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f9042f0 0x55f70f8e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627400640 1 -- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f9042f0 msgr2=0x55f70f8e53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627400640 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f9042f0 0x55f70f8e53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627400640 1 -- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f8b7e10 msgr2=0x55f70f8e46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627400640 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f8b7e10 0x55f70f8e46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627400640 1 -- 172.21.15.17:0/2405125620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70f6a3170 con 0x55f70f9039d0 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627400640 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f8e4e70 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe61401b040 tx=0x7fe614009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2caedb29e4b28946 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe611600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe611600640 1 -- 172.21.15.17:0/2405125620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614029020 con 0x55f70f9039d0 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 -- 172.21.15.17:0/2405125620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f70f69d0f0 con 0x55f70f9039d0 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe611600640 1 -- 172.21.15.17:0/2405125620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fe614003a10 con 0x55f70f9039d0 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe611600640 1 -- 172.21.15.17:0/2405125620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fe614033050 con 0x55f70f9039d0 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 10 client.8790 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 -- 172.21.15.17:0/2405125620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55f70f789ef0 con 0x55f70f9039d0 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe611600640 1 -- 172.21.15.17:0/2405125620 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f70f69d0f0 con 0x55f70f9039d0 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe611600640 1 -- 172.21.15.17:0/2405125620 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fe614036020 con 0x55f70f9039d0 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 10 client.8790 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 10 client.8790 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 20 client.8790 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55f70f8e60f0 0x55f70f915c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 4 client.8790 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe6323bd000 1 -- 172.21.15.17:0/2405125620 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f70f717a70 con 0x55f70f8e60f0 2024-09-10T23:25:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627e00640 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55f70f8e60f0 0x55f70f915c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe627e00640 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55f70f8e60f0 0x55f70f915c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f1750b9ab0d47c8 server_cookie=e5fbae844511bc32 in_seq=0 out_seq=0 2024-09-10T23:25:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.426+0000 7fe611600640 10 client.8790 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe611600640 1 -- 172.21.15.17:0/2405125620 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f70f717a70 con 0x55f70f8e60f0 2024-09-10T23:25:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe611600640 10 client.8790 handle_command_reply: tid=0 2024-09-10T23:25:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 client.8790 shutdown 2024-09-10T23:25:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 -- 172.21.15.17:0/2405125620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 msgr2=0x55f70f8e4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f8e4e70 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe61401b040 tx=0x7fe614009690 comp rx=0 tx=0).stop 2024-09-10T23:25:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 -- 172.21.15.17:0/2405125620 shutdown_connections 2024-09-10T23:25:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55f70f8e60f0 0x55f70f915c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f9042f0 0x55f70f8e53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe611600640 0 client.8790 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f8e4e70 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2405125620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f8b7e10 0x55f70f8e46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 -- 172.21.15.17:0/2405125620 >> 172.21.15.17:0/2405125620 conn(0x55f70f7a1130 msgr2=0x55f70f8b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 -- 172.21.15.17:0/2405125620 shutdown_connections 2024-09-10T23:25:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 1 -- 172.21.15.17:0/2405125620 wait complete. 2024-09-10T23:25:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.430+0000 7fe6323bd000 20 client.8790 trim_cache size 0 max 16384 2024-09-10T23:25:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 Processor -- start 2024-09-10T23:25:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- start start 2024-09-10T23:25:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f975bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f976100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9042f0 0x55f70f976640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe628204ba0 con 0x55f70f9039d0 2024-09-10T23:25:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe628203bd0 con 0x55f70f9042f0 2024-09-10T23:25:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6280ae730 con 0x55f70f8b7e10 2024-09-10T23:25:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f976100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f976100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56082/0 (socket says 172.21.15.17:56082) 2024-09-10T23:25:24.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627400640 1 -- 172.21.15.17:0/2147542206 learned_addr learned my addr 172.21.15.17:0/2147542206 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627e00640 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f975bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe62d000640 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9042f0 0x55f70f976640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627400640 1 -- 172.21.15.17:0/2147542206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 msgr2=0x55f70f975bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627400640 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f975bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627400640 1 -- 172.21.15.17:0/2147542206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9042f0 msgr2=0x55f70f976640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627400640 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9042f0 0x55f70f976640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627400640 1 -- 172.21.15.17:0/2147542206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70f760d90 con 0x55f70f9039d0 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe62d000640 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9042f0 0x55f70f976640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe627400640 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f976100 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe614009830 tx=0x7fe614009a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0087c1439f5e221 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe613e00640 1 -- 172.21.15.17:0/2147542206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614029040 con 0x55f70f9039d0 2024-09-10T23:25:24.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe613e00640 1 -- 172.21.15.17:0/2147542206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe614000e50 con 0x55f70f9039d0 2024-09-10T23:25:24.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe613e00640 1 -- 172.21.15.17:0/2147542206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614003a70 con 0x55f70f9039d0 2024-09-10T23:25:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- 172.21.15.17:0/2147542206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 msgr2=0x55f70f976100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f976100 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fe614009830 tx=0x7fe614009a80 comp rx=0 tx=0).stop 2024-09-10T23:25:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- 172.21.15.17:0/2147542206 shutdown_connections 2024-09-10T23:25:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9042f0 0x55f70f976640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9039d0 0x55f70f976100 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 --2- 172.21.15.17:0/2147542206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f975bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- 172.21.15.17:0/2147542206 >> 172.21.15.17:0/2147542206 conn(0x55f70f7a1130 msgr2=0x55f70f910fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- 172.21.15.17:0/2147542206 shutdown_connections 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- 172.21.15.17:0/2147542206 wait complete. 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 -- start start 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.450+0000 7fe6323bd000 1 Processor -- start 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f9797e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 0x55f70f979d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f97a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f70f7148f0 con 0x55f70f9042f0 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f70f7c4730 con 0x55f70f9039d0 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f70f70d390 con 0x55f70f8b7e10 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 10 client.0 _ll_register_callbacks cb 0x7fe62005a580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:24.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe62d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f97a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe627e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f9797e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe627e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f9797e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56400/0 (socket says 172.21.15.17:56400) 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe627e00640 1 -- 172.21.15.17:0/539278565 learned_addr learned my addr 172.21.15.17:0/539278565 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe62d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f97a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56096/0 (socket says 172.21.15.17:56096) 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe627400640 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 0x55f70f979d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe62d000640 1 -- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 msgr2=0x55f70f9797e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe62d000640 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f9797e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe62d000640 1 -- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 msgr2=0x55f70f979d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe62d000640 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 0x55f70f979d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe62d000640 1 -- 172.21.15.17:0/539278565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70f6cba90 con 0x55f70f9042f0 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe627e00640 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f9797e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe62d000640 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f97a260 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fe62000a430 tx=0x7fe620000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221811f72c273cab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 1 -- 172.21.15.17:0/539278565 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620077020 con 0x55f70f9042f0 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 1 -- 172.21.15.17:0/539278565 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fe620063af0 con 0x55f70f9042f0 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 -- 172.21.15.17:0/539278565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe614000e50 con 0x55f70f9042f0 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 1 -- 172.21.15.17:0/539278565 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fe620091050 con 0x55f70f9042f0 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 10 client.8796 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 -- 172.21.15.17:0/539278565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55f70f6aa050 con 0x55f70f9042f0 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 1 -- 172.21.15.17:0/539278565 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe614000e50 con 0x55f70f9042f0 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 1 -- 172.21.15.17:0/539278565 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fe620059880 con 0x55f70f9042f0 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 10 client.8796 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 10 client.8796 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 20 client.8796 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55f70f918b80 0x55f70f982a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 4 client.8796 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 -- 172.21.15.17:0/539278565 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "status"}) -- 0x55f70f713520 con 0x55f70f918b80 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe627e00640 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55f70f918b80 0x55f70f982a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe627e00640 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55f70f918b80 0x55f70f982a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ac97b2f5849548c server_cookie=8dac9bd547a5676f in_seq=0 out_seq=0 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 10 client.8796 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 1 -- 172.21.15.17:0/539278565 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f70f713520 con 0x55f70f918b80 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 10 client.8796 handle_command_reply: tid=0 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 client.8796 shutdown 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 -- 172.21.15.17:0/539278565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 msgr2=0x55f70f97a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f97a260 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fe62000a430 tx=0x7fe620000f50 comp rx=0 tx=0).stop 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 -- 172.21.15.17:0/539278565 shutdown_connections 2024-09-10T23:25:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55f70f918b80 0x55f70f982a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f70f9042f0 0x55f70f97a260 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f70f9039d0 0x55f70f979d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe611600640 0 client.8796 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 --2- 172.21.15.17:0/539278565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f70f8b7e10 0x55f70f9797e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.454+0000 7fe6323bd000 1 -- 172.21.15.17:0/539278565 >> 172.21.15.17:0/539278565 conn(0x55f70f7a1130 msgr2=0x55f70f8bfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe6323bd000 1 -- 172.21.15.17:0/539278565 shutdown_connections 2024-09-10T23:25:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe6323bd000 1 -- 172.21.15.17:0/539278565 wait complete. 2024-09-10T23:25:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe6323bd000 20 client.8796 trim_cache size 0 max 16384 2024-09-10T23:25:24.466 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:25:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:25:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:25:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 8634, 2024-09-10T23:25:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:25:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:25:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:25:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 10.613835929, 2024-09-10T23:25:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 104, 2024-09-10T23:25:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 144, 2024-09-10T23:25:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 144, 2024-09-10T23:25:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 15.063556383 2024-09-10T23:25:24.468 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:25:24.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 -- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe608072610 msgr2=0x7fe608074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe608072610 0x7fe608074ad0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe6180b0000 tx=0x7fe61801c470 comp rx=0 tx=0).stop 2024-09-10T23:25:24.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 -- 172.21.15.17:0/1884759182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 msgr2=0x7fe62814d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 0x7fe62814d1c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c7a0 tx=0x7fe62000cc60 comp rx=0 tx=0).stop 2024-09-10T23:25:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 -- 172.21.15.17:0/1884759182 shutdown_connections 2024-09-10T23:25:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe608072610 0x7fe608074ad0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6281513b0 0x7fe62814d1c0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6280ceed0 0x7fe62815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 --2- 172.21.15.17:0/1884759182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe628072840 0x7fe6281f8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 -- 172.21.15.17:0/1884759182 >> 172.21.15.17:0/1884759182 conn(0x7fe6280b1730 msgr2=0x7fe6281504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 -- 172.21.15.17:0/1884759182 shutdown_connections 2024-09-10T23:25:24.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.458+0000 7fe62f000640 1 -- 172.21.15.17:0/1884759182 wait complete. 2024-09-10T23:25:24.479 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:25:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 -- 172.21.15.17:0/229421710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 msgr2=0x7f27b40d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 --2- 172.21.15.17:0/229421710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 0x7f27b40d0030 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009bc0 tx=0x7f27ac01f3b0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 -- 172.21.15.17:0/229421710 shutdown_connections 2024-09-10T23:25:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 --2- 172.21.15.17:0/229421710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 0x7f27b40d0030 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 --2- 172.21.15.17:0/229421710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27b4160280 0x7f27b40cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 -- 172.21.15.17:0/229421710 >> 172.21.15.17:0/229421710 conn(0x7f27b40d1d10 msgr2=0x7f27b40d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 -- 172.21.15.17:0/229421710 shutdown_connections 2024-09-10T23:25:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 -- 172.21.15.17:0/229421710 wait complete. 2024-09-10T23:25:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 Processor -- start 2024-09-10T23:25:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.622+0000 7f27b9a00640 1 -- start start 2024-09-10T23:25:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b9a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27b40d2830 0x7f27b40c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b9a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27b4160280 0x7f27b40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b9a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 0x7f27b40c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b9a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f27b40afe30 con 0x7f27b4160660 2024-09-10T23:25:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b9a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f27b40afcb0 con 0x7f27b4160280 2024-09-10T23:25:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b9a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f27b40affb0 con 0x7f27b40d2830 2024-09-10T23:25:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 0x7f27b40c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 0x7f27b40c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56126/0 (socket says 172.21.15.17:56126) 2024-09-10T23:25:24.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b3400640 1 -- 172.21.15.17:0/2375779634 learned_addr learned my addr 172.21.15.17:0/2375779634 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b2a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27b40d2830 0x7f27b40c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b3400640 1 -- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27b40d2830 msgr2=0x7f27b40c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b3400640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27b40d2830 0x7f27b40c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27aa000640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27b4160280 0x7f27b40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b3400640 1 -- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27b4160280 msgr2=0x7f27b40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b3400640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27b4160280 0x7f27b40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b3400640 1 -- 172.21.15.17:0/2375779634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b40c8240 con 0x7f27b4160660 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b2a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27b40d2830 0x7f27b40c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27aa000640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27b4160280 0x7f27b40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b3400640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 0x7f27b40c6230 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f27ac01cfe0 tx=0x7f27ac005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27ab400640 1 -- 172.21.15.17:0/2375779634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0b4040 con 0x7f27b4160660 2024-09-10T23:25:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27ab400640 1 -- 172.21.15.17:0/2375779634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27ac0af8a0 con 0x7f27b4160660 2024-09-10T23:25:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27ab400640 1 -- 172.21.15.17:0/2375779634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0afc90 con 0x7f27b4160660 2024-09-10T23:25:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b40c8520 con 0x7f27b4160660 2024-09-10T23:25:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b40cef40 con 0x7f27b4160660 2024-09-10T23:25:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.626+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b40ce030 con 0x7f27b4160660 2024-09-10T23:25:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.630+0000 7f27ab400640 1 -- 172.21.15.17:0/2375779634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f27ac004040 con 0x7f27b4160660 2024-09-10T23:25:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.630+0000 7f27ab400640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f27900725e0 0x7f2790074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.630+0000 7f27ab400640 1 -- 172.21.15.17:0/2375779634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f27ac130f10 con 0x7f27b4160660 2024-09-10T23:25:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.630+0000 7f27b2a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f27900725e0 0x7f2790074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.630+0000 7f27b2a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f27900725e0 0x7f2790074aa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009b60 tx=0x7f27a40091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:24.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.634+0000 7f27ab400640 1 -- 172.21.15.17:0/2375779634 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f27ac0c8020 con 0x7f27b4160660 2024-09-10T23:25:24.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.842+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27b4070dc0 con 0x7f27b4160660 2024-09-10T23:25:24.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.842+0000 7f27ab400640 1 -- 172.21.15.17:0/2375779634 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) ==== 53+0+73 (secure 0 0 0) 0x7f27ac018f10 con 0x7f27b4160660 2024-09-10T23:25:24.847 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:25:24.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f27900725e0 msgr2=0x7f2790074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f27900725e0 0x7f2790074aa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009b60 tx=0x7f27a40091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 msgr2=0x7f27b40c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:24.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 0x7f27b40c6230 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f27ac01cfe0 tx=0x7f27ac005a60 comp rx=0 tx=0).stop 2024-09-10T23:25:24.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 shutdown_connections 2024-09-10T23:25:24.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f27900725e0 0x7f2790074aa0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27b4160660 0x7f27b40c6230 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27b4160280 0x7f27b40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 --2- 172.21.15.17:0/2375779634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f27b40d2830 0x7f27b40c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:24.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 >> 172.21.15.17:0/2375779634 conn(0x7f27b40d1d10 msgr2=0x7f27b40cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:24.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 shutdown_connections 2024-09-10T23:25:24.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:24.846+0000 7f27b9a00640 1 -- 172.21.15.17:0/2375779634 wait complete. 2024-09-10T23:25:24.868 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:25:24.868 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:25:24.869 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:25:24.869 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:25:24.869 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:25:24.869 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:25:24.869 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:25:24.869 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:25:24.869 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:25:24.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:24.869 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:25:24.878 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:25:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:25:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:25:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:25:24.878 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41846sec preferred_lft 41846sec 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:25:24.879 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:25:24.880 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:25:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:25:24.881 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:25:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:25:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:25:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:25:24.881 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:25:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:25:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:25:24.881 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:25:24.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:24.882 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:25:24.945 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:25:24.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:24.947 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:25:25.000 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:25:25.001 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:25:25.001 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:25:25.001 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:25:25.001 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:25:25.001 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:25:25.002 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:25:25.002 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:25.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:25:25.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:25:25.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:25:25.002 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:25:25.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:25.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:25.139 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:25:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:25:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:25:25.149 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:25:25.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:25.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:25:25.211 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:25:25.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:25:25.211 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:25:25.259 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:25:25.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:25:25.259 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:25:25.310 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:25:25.375 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:25:25.429 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:25:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:25:25.431 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:25:25.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:25.432 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:25:25.483 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:25:25.483 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:25:25.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:25:25.550 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:25:25.600 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:25:25.601 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:25:25.602 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:25:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:25:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:25:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:25:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:25:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:25:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:25:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:25:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:25:25.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:25.604 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:25:25.625 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:25:25.622+0000 7f2754e46580 -1 init, newargv = 0x55e17ab34db0 newargc=15 2024-09-10T23:25:25.625 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[75027]: starting ceph client 2024-09-10T23:25:25.633 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[75027]: starting fuse 2024-09-10T23:25:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:25:25.634 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:25:25.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:25:25.634 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:25:25.634 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:25:25.635 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:25:25.636 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:25:25.636 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:25:25.636 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:25:25.636 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:25:25.636 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:25:25.636 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:25:25.636 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:25:25.636 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:25:25.636 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:25:25.757 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.75027.asok 2024-09-10T23:25:25.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:25.769 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.75027.asok 2024-09-10T23:25:25.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:25.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.75027.asok status 2024-09-10T23:25:25.944 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:25:25.944 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:25:25.944 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:25:25.944 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:25:25.944 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:25:25.944 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "75027", 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 8814, 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 8814 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:25.945 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 140105523 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 140105523 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.8814 192.168.0.1:0/140105523", 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/140105523", 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:25:25.946 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 104, 2024-09-10T23:25:25.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 144, 2024-09-10T23:25:25.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:25:25.947 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:25:25.947 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:25:25.947 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:25:25.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:25.959 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:25:25.959 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:25:25.968 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:25:25.969 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:25:25.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:25.972 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:25:26.031 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-10T23:25:26.031 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-09-10T23:25:26.031 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:26.032 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:26.032 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T23:25:26.032 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:26.032 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:26.032 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:26.032 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:26.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.174 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217513 s, 48.2 MB/s 2024-09-10T23:25:26.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.195 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171827 s, 61.0 MB/s 2024-09-10T23:25:26.214 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.214 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.214 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015268 s, 68.7 MB/s 2024-09-10T23:25:26.231 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.232 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132986 s, 78.8 MB/s 2024-09-10T23:25:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117521 s, 89.2 MB/s 2024-09-10T23:25:26.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.264 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133236 s, 78.7 MB/s 2024-09-10T23:25:26.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.282 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139903 s, 74.9 MB/s 2024-09-10T23:25:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132875 s, 78.9 MB/s 2024-09-10T23:25:26.317 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.317 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.317 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137923 s, 76.0 MB/s 2024-09-10T23:25:26.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.335 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137315 s, 76.4 MB/s 2024-09-10T23:25:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012636 s, 83.0 MB/s 2024-09-10T23:25:26.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.370 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153091 s, 68.5 MB/s 2024-09-10T23:25:26.387 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.387 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.387 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128453 s, 81.6 MB/s 2024-09-10T23:25:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163905 s, 64.0 MB/s 2024-09-10T23:25:26.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.423 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118883 s, 88.2 MB/s 2024-09-10T23:25:26.440 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.440 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.440 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136089 s, 77.1 MB/s 2024-09-10T23:25:26.457 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.458 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133707 s, 78.4 MB/s 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.476 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149921 s, 69.9 MB/s 2024-09-10T23:25:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136223 s, 77.0 MB/s 2024-09-10T23:25:26.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.510 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123402 s, 85.0 MB/s 2024-09-10T23:25:26.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.528 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135445 s, 77.4 MB/s 2024-09-10T23:25:26.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.543 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.543 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116594 s, 89.9 MB/s 2024-09-10T23:25:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122746 s, 85.4 MB/s 2024-09-10T23:25:26.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.576 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138959 s, 75.5 MB/s 2024-09-10T23:25:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.592 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119008 s, 88.1 MB/s 2024-09-10T23:25:26.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.608 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012633 s, 83.0 MB/s 2024-09-10T23:25:26.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.626 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136851 s, 76.6 MB/s 2024-09-10T23:25:26.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118042 s, 88.8 MB/s 2024-09-10T23:25:26.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140388 s, 74.7 MB/s 2024-09-10T23:25:26.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.676 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012719 s, 82.4 MB/s 2024-09-10T23:25:26.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133723 s, 78.4 MB/s 2024-09-10T23:25:26.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.709 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120857 s, 86.8 MB/s 2024-09-10T23:25:26.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:26.716 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:26.717 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:26.717 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T23:25:26.717 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:26.717 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:26.717 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:26.717 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:26.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:26.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.789 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012355 s, 84.9 MB/s 2024-09-10T23:25:26.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.805 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126428 s, 82.9 MB/s 2024-09-10T23:25:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151787 s, 69.1 MB/s 2024-09-10T23:25:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130004 s, 80.7 MB/s 2024-09-10T23:25:26.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.858 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132478 s, 79.2 MB/s 2024-09-10T23:25:26.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.875 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133253 s, 78.7 MB/s 2024-09-10T23:25:26.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.892 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012331 s, 85.0 MB/s 2024-09-10T23:25:26.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126866 s, 82.7 MB/s 2024-09-10T23:25:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.926 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140954 s, 74.4 MB/s 2024-09-10T23:25:26.942 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.942 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.942 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122907 s, 85.3 MB/s 2024-09-10T23:25:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122068 s, 85.9 MB/s 2024-09-10T23:25:26.975 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.976 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128174 s, 81.8 MB/s 2024-09-10T23:25:26.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:26.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:26.992 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130777 s, 80.2 MB/s 2024-09-10T23:25:27.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.010 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140572 s, 74.6 MB/s 2024-09-10T23:25:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.027 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133839 s, 78.3 MB/s 2024-09-10T23:25:27.045 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014572 s, 72.0 MB/s 2024-09-10T23:25:27.061 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.062 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121772 s, 86.1 MB/s 2024-09-10T23:25:27.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128903 s, 81.3 MB/s 2024-09-10T23:25:27.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.095 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127798 s, 82.0 MB/s 2024-09-10T23:25:27.111 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.111 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.111 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128108 s, 81.9 MB/s 2024-09-10T23:25:27.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.128 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124998 s, 83.9 MB/s 2024-09-10T23:25:27.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.145 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130215 s, 80.5 MB/s 2024-09-10T23:25:27.163 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.163 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.163 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140378 s, 74.7 MB/s 2024-09-10T23:25:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.180 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131247 s, 79.9 MB/s 2024-09-10T23:25:27.196 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.197 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.197 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130611 s, 80.3 MB/s 2024-09-10T23:25:27.214 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.214 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.214 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140127 s, 74.8 MB/s 2024-09-10T23:25:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.231 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01268 s, 82.7 MB/s 2024-09-10T23:25:27.246 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.247 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121592 s, 86.2 MB/s 2024-09-10T23:25:27.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.263 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128045 s, 81.9 MB/s 2024-09-10T23:25:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122485 s, 85.6 MB/s 2024-09-10T23:25:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126136 s, 83.1 MB/s 2024-09-10T23:25:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.312 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125955 s, 83.2 MB/s 2024-09-10T23:25:27.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:27.319 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:27.319 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:27.319 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T23:25:27.320 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:27.320 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:27.320 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:27.320 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:27.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:27.395 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.395 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.395 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142127 s, 73.8 MB/s 2024-09-10T23:25:27.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.413 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137841 s, 76.1 MB/s 2024-09-10T23:25:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134459 s, 78.0 MB/s 2024-09-10T23:25:27.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.448 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138005 s, 76.0 MB/s 2024-09-10T23:25:27.464 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.465 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134354 s, 78.0 MB/s 2024-09-10T23:25:27.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.482 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133008 s, 78.8 MB/s 2024-09-10T23:25:27.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132346 s, 79.2 MB/s 2024-09-10T23:25:27.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.517 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135867 s, 77.2 MB/s 2024-09-10T23:25:27.533 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.534 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012867 s, 81.5 MB/s 2024-09-10T23:25:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.551 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140221 s, 74.8 MB/s 2024-09-10T23:25:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128751 s, 81.4 MB/s 2024-09-10T23:25:27.585 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.585 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.585 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134998 s, 77.7 MB/s 2024-09-10T23:25:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.602 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130627 s, 80.3 MB/s 2024-09-10T23:25:27.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.619 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013115 s, 80.0 MB/s 2024-09-10T23:25:27.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.639 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.639 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157551 s, 66.6 MB/s 2024-09-10T23:25:27.656 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.656 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.656 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013435 s, 78.0 MB/s 2024-09-10T23:25:27.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.673 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132838 s, 78.9 MB/s 2024-09-10T23:25:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.689 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123251 s, 85.1 MB/s 2024-09-10T23:25:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124665 s, 84.1 MB/s 2024-09-10T23:25:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123393 s, 85.0 MB/s 2024-09-10T23:25:27.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.738 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133679 s, 78.4 MB/s 2024-09-10T23:25:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131627 s, 79.7 MB/s 2024-09-10T23:25:27.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.772 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123515 s, 84.9 MB/s 2024-09-10T23:25:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124214 s, 84.4 MB/s 2024-09-10T23:25:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.804 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123484 s, 84.9 MB/s 2024-09-10T23:25:27.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.822 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013985 s, 75.0 MB/s 2024-09-10T23:25:27.837 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.838 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011865 s, 88.4 MB/s 2024-09-10T23:25:27.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.855 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.855 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134993 s, 77.7 MB/s 2024-09-10T23:25:27.870 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.871 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121062 s, 86.6 MB/s 2024-09-10T23:25:27.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.887 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126763 s, 82.7 MB/s 2024-09-10T23:25:27.904 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.904 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.904 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012869 s, 81.5 MB/s 2024-09-10T23:25:27.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:27.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:27.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123876 s, 84.6 MB/s 2024-09-10T23:25:27.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:27.928 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:27.928 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:27.928 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T23:25:27.928 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:27.928 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:27.928 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:27.928 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:27.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.001 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127222 s, 82.4 MB/s 2024-09-10T23:25:28.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.020 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141446 s, 74.1 MB/s 2024-09-10T23:25:28.037 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.037 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.037 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128253 s, 81.8 MB/s 2024-09-10T23:25:28.053 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.053 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.053 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120026 s, 87.4 MB/s 2024-09-10T23:25:28.070 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.070 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.070 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129793 s, 80.8 MB/s 2024-09-10T23:25:28.087 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.087 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.087 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012621 s, 83.1 MB/s 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.104 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123508 s, 84.9 MB/s 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.120 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126479 s, 82.9 MB/s 2024-09-10T23:25:28.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.138 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.138 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128533 s, 81.6 MB/s 2024-09-10T23:25:28.153 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.154 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126557 s, 82.9 MB/s 2024-09-10T23:25:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.169 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117458 s, 89.3 MB/s 2024-09-10T23:25:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124762 s, 84.0 MB/s 2024-09-10T23:25:28.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.202 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128751 s, 81.4 MB/s 2024-09-10T23:25:28.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.219 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013353 s, 78.5 MB/s 2024-09-10T23:25:28.236 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.236 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.236 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127492 s, 82.2 MB/s 2024-09-10T23:25:28.252 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.252 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.252 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126665 s, 82.8 MB/s 2024-09-10T23:25:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.268 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123095 s, 85.2 MB/s 2024-09-10T23:25:28.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.285 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129303 s, 81.1 MB/s 2024-09-10T23:25:28.301 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.302 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013122 s, 79.9 MB/s 2024-09-10T23:25:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127038 s, 82.5 MB/s 2024-09-10T23:25:28.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.334 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125094 s, 83.8 MB/s 2024-09-10T23:25:28.351 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.351 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.351 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135184 s, 77.6 MB/s 2024-09-10T23:25:28.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.368 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130329 s, 80.5 MB/s 2024-09-10T23:25:28.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.385 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135008 s, 77.7 MB/s 2024-09-10T23:25:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.402 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130237 s, 80.5 MB/s 2024-09-10T23:25:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124242 s, 84.4 MB/s 2024-09-10T23:25:28.435 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.435 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.435 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130632 s, 80.3 MB/s 2024-09-10T23:25:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127726 s, 82.1 MB/s 2024-09-10T23:25:28.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.469 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136565 s, 76.8 MB/s 2024-09-10T23:25:28.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.486 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133042 s, 78.8 MB/s 2024-09-10T23:25:28.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.503 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133856 s, 78.3 MB/s 2024-09-10T23:25:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012882 s, 81.4 MB/s 2024-09-10T23:25:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:28.528 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:28.528 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:28.528 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T23:25:28.528 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:28.528 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:28.528 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:28.528 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:28.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:28.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.649 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142763 s, 73.4 MB/s 2024-09-10T23:25:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.665 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127369 s, 82.3 MB/s 2024-09-10T23:25:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.682 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128768 s, 81.4 MB/s 2024-09-10T23:25:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136561 s, 76.8 MB/s 2024-09-10T23:25:28.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.715 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122683 s, 85.5 MB/s 2024-09-10T23:25:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123547 s, 84.9 MB/s 2024-09-10T23:25:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012798 s, 81.9 MB/s 2024-09-10T23:25:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134129 s, 78.2 MB/s 2024-09-10T23:25:28.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.782 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121194 s, 86.5 MB/s 2024-09-10T23:25:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121632 s, 86.2 MB/s 2024-09-10T23:25:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.816 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144175 s, 72.7 MB/s 2024-09-10T23:25:28.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.833 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013351 s, 78.5 MB/s 2024-09-10T23:25:28.850 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.850 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134787 s, 77.8 MB/s 2024-09-10T23:25:28.868 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.869 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.869 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140305 s, 74.7 MB/s 2024-09-10T23:25:28.885 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.885 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.885 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119373 s, 87.8 MB/s 2024-09-10T23:25:28.901 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.901 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.901 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123387 s, 85.0 MB/s 2024-09-10T23:25:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135818 s, 77.2 MB/s 2024-09-10T23:25:28.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.935 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01277 s, 82.1 MB/s 2024-09-10T23:25:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.952 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134344 s, 78.1 MB/s 2024-09-10T23:25:28.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.968 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122277 s, 85.8 MB/s 2024-09-10T23:25:28.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:28.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:28.986 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138207 s, 75.9 MB/s 2024-09-10T23:25:29.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.004 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135981 s, 77.1 MB/s 2024-09-10T23:25:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127226 s, 82.4 MB/s 2024-09-10T23:25:29.037 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.037 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.037 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130135 s, 80.6 MB/s 2024-09-10T23:25:29.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.054 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131049 s, 80.0 MB/s 2024-09-10T23:25:29.071 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.071 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.071 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133804 s, 78.4 MB/s 2024-09-10T23:25:29.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.088 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129414 s, 81.0 MB/s 2024-09-10T23:25:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130731 s, 80.2 MB/s 2024-09-10T23:25:29.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013579 s, 77.2 MB/s 2024-09-10T23:25:29.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140826 s, 74.5 MB/s 2024-09-10T23:25:29.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.158 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132802 s, 79.0 MB/s 2024-09-10T23:25:29.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.174 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012394 s, 84.6 MB/s 2024-09-10T23:25:29.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:29.181 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:29.181 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:29.181 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T23:25:29.181 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:29.182 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:29.182 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:29.182 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:29.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.255 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134677 s, 77.9 MB/s 2024-09-10T23:25:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125116 s, 83.8 MB/s 2024-09-10T23:25:29.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.288 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134191 s, 78.1 MB/s 2024-09-10T23:25:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.306 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137374 s, 76.3 MB/s 2024-09-10T23:25:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121331 s, 86.4 MB/s 2024-09-10T23:25:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01239 s, 84.6 MB/s 2024-09-10T23:25:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136804 s, 76.6 MB/s 2024-09-10T23:25:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.371 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119375 s, 87.8 MB/s 2024-09-10T23:25:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129845 s, 80.8 MB/s 2024-09-10T23:25:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136401 s, 76.9 MB/s 2024-09-10T23:25:29.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.423 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133601 s, 78.5 MB/s 2024-09-10T23:25:29.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.446 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186604 s, 56.2 MB/s 2024-09-10T23:25:29.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123525 s, 84.9 MB/s 2024-09-10T23:25:29.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.478 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012397 s, 84.6 MB/s 2024-09-10T23:25:29.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.494 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127626 s, 82.2 MB/s 2024-09-10T23:25:29.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128863 s, 81.4 MB/s 2024-09-10T23:25:29.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.529 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.529 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135612 s, 77.3 MB/s 2024-09-10T23:25:29.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.546 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132237 s, 79.3 MB/s 2024-09-10T23:25:29.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124917 s, 83.9 MB/s 2024-09-10T23:25:29.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.579 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130183 s, 80.5 MB/s 2024-09-10T23:25:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012592 s, 83.3 MB/s 2024-09-10T23:25:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.612 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130571 s, 80.3 MB/s 2024-09-10T23:25:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131688 s, 79.6 MB/s 2024-09-10T23:25:29.647 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.647 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.647 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140829 s, 74.5 MB/s 2024-09-10T23:25:29.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.665 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139977 s, 74.9 MB/s 2024-09-10T23:25:29.681 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.681 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.681 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120982 s, 86.7 MB/s 2024-09-10T23:25:29.697 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.698 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.698 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122884 s, 85.3 MB/s 2024-09-10T23:25:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126687 s, 82.8 MB/s 2024-09-10T23:25:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131496 s, 79.7 MB/s 2024-09-10T23:25:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012453 s, 84.2 MB/s 2024-09-10T23:25:29.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.765 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136061 s, 77.1 MB/s 2024-09-10T23:25:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121467 s, 86.3 MB/s 2024-09-10T23:25:29.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:29.788 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:29.789 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:29.789 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T23:25:29.789 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:29.789 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:29.789 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:29.789 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:29.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.862 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138479 s, 75.7 MB/s 2024-09-10T23:25:29.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.880 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134708 s, 77.8 MB/s 2024-09-10T23:25:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129309 s, 81.1 MB/s 2024-09-10T23:25:29.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.915 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132055 s, 79.4 MB/s 2024-09-10T23:25:29.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.932 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125707 s, 83.4 MB/s 2024-09-10T23:25:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127927 s, 82.0 MB/s 2024-09-10T23:25:29.965 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.965 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.965 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122173 s, 85.8 MB/s 2024-09-10T23:25:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120819 s, 86.8 MB/s 2024-09-10T23:25:29.996 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:29.996 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:29.996 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117828 s, 89.0 MB/s 2024-09-10T23:25:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111293 s, 94.2 MB/s 2024-09-10T23:25:30.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.028 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121446 s, 86.3 MB/s 2024-09-10T23:25:30.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.043 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114738 s, 91.4 MB/s 2024-09-10T23:25:30.059 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.060 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129154 s, 81.2 MB/s 2024-09-10T23:25:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012969 s, 80.9 MB/s 2024-09-10T23:25:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111127 s, 94.4 MB/s 2024-09-10T23:25:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110403 s, 95.0 MB/s 2024-09-10T23:25:30.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.121 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109925 s, 95.4 MB/s 2024-09-10T23:25:30.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.136 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108164 s, 96.9 MB/s 2024-09-10T23:25:30.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.151 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109786 s, 95.5 MB/s 2024-09-10T23:25:30.166 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.166 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.166 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118373 s, 88.6 MB/s 2024-09-10T23:25:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109824 s, 95.5 MB/s 2024-09-10T23:25:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.197 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120783 s, 86.8 MB/s 2024-09-10T23:25:30.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.212 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.212 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010779 s, 97.3 MB/s 2024-09-10T23:25:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.227 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111446 s, 94.1 MB/s 2024-09-10T23:25:30.241 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.241 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.241 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01065 s, 98.5 MB/s 2024-09-10T23:25:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129552 s, 80.9 MB/s 2024-09-10T23:25:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.273 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114686 s, 91.4 MB/s 2024-09-10T23:25:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111683 s, 93.9 MB/s 2024-09-10T23:25:30.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.303 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109321 s, 95.9 MB/s 2024-09-10T23:25:30.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.320 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128169 s, 81.8 MB/s 2024-09-10T23:25:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110097 s, 95.2 MB/s 2024-09-10T23:25:30.351 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.351 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.351 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121679 s, 86.2 MB/s 2024-09-10T23:25:30.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:30.359 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:30.359 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:30.359 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T23:25:30.359 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:30.360 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:30.360 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:30.360 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:30.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:30.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.430 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108073 s, 97.0 MB/s 2024-09-10T23:25:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127962 s, 81.9 MB/s 2024-09-10T23:25:30.463 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.463 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.463 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126128 s, 83.1 MB/s 2024-09-10T23:25:30.479 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.479 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.479 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117142 s, 89.5 MB/s 2024-09-10T23:25:30.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.495 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129232 s, 81.1 MB/s 2024-09-10T23:25:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108663 s, 96.5 MB/s 2024-09-10T23:25:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120004 s, 87.4 MB/s 2024-09-10T23:25:30.543 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.543 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.543 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133767 s, 78.4 MB/s 2024-09-10T23:25:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111759 s, 93.8 MB/s 2024-09-10T23:25:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113743 s, 92.2 MB/s 2024-09-10T23:25:30.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.588 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108238 s, 96.9 MB/s 2024-09-10T23:25:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104769 s, 100 MB/s 2024-09-10T23:25:30.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.617 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113213 s, 92.6 MB/s 2024-09-10T23:25:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105756 s, 99.2 MB/s 2024-09-10T23:25:30.648 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.648 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.648 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012942 s, 81.0 MB/s 2024-09-10T23:25:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111088 s, 94.4 MB/s 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120737 s, 86.8 MB/s 2024-09-10T23:25:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111018 s, 94.5 MB/s 2024-09-10T23:25:30.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.710 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013298 s, 78.9 MB/s 2024-09-10T23:25:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112345 s, 93.3 MB/s 2024-09-10T23:25:30.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.740 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112041 s, 93.6 MB/s 2024-09-10T23:25:30.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107687 s, 97.4 MB/s 2024-09-10T23:25:30.769 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.769 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.769 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111419 s, 94.1 MB/s 2024-09-10T23:25:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121355 s, 86.4 MB/s 2024-09-10T23:25:30.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.801 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.801 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118061 s, 88.8 MB/s 2024-09-10T23:25:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113665 s, 92.3 MB/s 2024-09-10T23:25:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.831 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115539 s, 90.8 MB/s 2024-09-10T23:25:30.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.846 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115232 s, 91.0 MB/s 2024-09-10T23:25:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.863 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126518 s, 82.9 MB/s 2024-09-10T23:25:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.878 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118383 s, 88.6 MB/s 2024-09-10T23:25:30.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114795 s, 91.3 MB/s 2024-09-10T23:25:30.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.910 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.910 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123782 s, 84.7 MB/s 2024-09-10T23:25:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:30.917 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:30.918 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:30.918 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T23:25:30.918 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:30.918 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:30.918 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:30.918 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:30.991 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:30.991 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:30.991 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124765 s, 84.0 MB/s 2024-09-10T23:25:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110506 s, 94.9 MB/s 2024-09-10T23:25:31.021 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.021 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.021 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110932 s, 94.5 MB/s 2024-09-10T23:25:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114498 s, 91.6 MB/s 2024-09-10T23:25:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.052 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011527 s, 91.0 MB/s 2024-09-10T23:25:31.066 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.067 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.067 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113647 s, 92.3 MB/s 2024-09-10T23:25:31.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.083 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.083 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012171 s, 86.2 MB/s 2024-09-10T23:25:31.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.098 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011769 s, 89.1 MB/s 2024-09-10T23:25:31.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.113 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010612 s, 98.8 MB/s 2024-09-10T23:25:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118391 s, 88.6 MB/s 2024-09-10T23:25:31.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.144 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011889 s, 88.2 MB/s 2024-09-10T23:25:31.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.159 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107094 s, 97.9 MB/s 2024-09-10T23:25:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.175 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121312 s, 86.4 MB/s 2024-09-10T23:25:31.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.190 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119643 s, 87.6 MB/s 2024-09-10T23:25:31.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.207 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012315 s, 85.1 MB/s 2024-09-10T23:25:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117483 s, 89.3 MB/s 2024-09-10T23:25:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117721 s, 89.1 MB/s 2024-09-10T23:25:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.252 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113609 s, 92.3 MB/s 2024-09-10T23:25:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.268 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115792 s, 90.6 MB/s 2024-09-10T23:25:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112454 s, 93.2 MB/s 2024-09-10T23:25:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115222 s, 91.0 MB/s 2024-09-10T23:25:31.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.314 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118675 s, 88.4 MB/s 2024-09-10T23:25:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.329 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109829 s, 95.5 MB/s 2024-09-10T23:25:31.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.344 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114924 s, 91.2 MB/s 2024-09-10T23:25:31.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111793 s, 93.8 MB/s 2024-09-10T23:25:31.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.376 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127215 s, 82.4 MB/s 2024-09-10T23:25:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011603 s, 90.4 MB/s 2024-09-10T23:25:31.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.406 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114068 s, 91.9 MB/s 2024-09-10T23:25:31.420 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110799 s, 94.6 MB/s 2024-09-10T23:25:31.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011673 s, 89.8 MB/s 2024-09-10T23:25:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113093 s, 92.7 MB/s 2024-09-10T23:25:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.466 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115849 s, 90.5 MB/s 2024-09-10T23:25:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:31.473 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:31.474 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:31.474 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T23:25:31.474 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:31.474 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:31.474 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:31.474 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:31.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115807 s, 90.5 MB/s 2024-09-10T23:25:31.560 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.561 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115238 s, 91.0 MB/s 2024-09-10T23:25:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010829 s, 96.8 MB/s 2024-09-10T23:25:31.591 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.591 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.591 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012286 s, 85.3 MB/s 2024-09-10T23:25:31.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.607 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012129 s, 86.5 MB/s 2024-09-10T23:25:31.623 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.623 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.623 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118649 s, 88.4 MB/s 2024-09-10T23:25:31.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147978 s, 70.9 MB/s 2024-09-10T23:25:31.657 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.657 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.657 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119802 s, 87.5 MB/s 2024-09-10T23:25:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124774 s, 84.0 MB/s 2024-09-10T23:25:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011536 s, 90.9 MB/s 2024-09-10T23:25:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012654 s, 82.9 MB/s 2024-09-10T23:25:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.722 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120344 s, 87.1 MB/s 2024-09-10T23:25:31.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.738 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122409 s, 85.7 MB/s 2024-09-10T23:25:31.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.753 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108673 s, 96.5 MB/s 2024-09-10T23:25:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108301 s, 96.8 MB/s 2024-09-10T23:25:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123288 s, 85.1 MB/s 2024-09-10T23:25:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117337 s, 89.4 MB/s 2024-09-10T23:25:31.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.815 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117125 s, 89.5 MB/s 2024-09-10T23:25:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114171 s, 91.8 MB/s 2024-09-10T23:25:31.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.847 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127959 s, 81.9 MB/s 2024-09-10T23:25:31.863 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.863 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.863 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118673 s, 88.4 MB/s 2024-09-10T23:25:31.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.878 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011712 s, 89.5 MB/s 2024-09-10T23:25:31.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.893 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110921 s, 94.5 MB/s 2024-09-10T23:25:31.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.908 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110302 s, 95.1 MB/s 2024-09-10T23:25:31.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118144 s, 88.8 MB/s 2024-09-10T23:25:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129801 s, 80.8 MB/s 2024-09-10T23:25:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011519 s, 91.0 MB/s 2024-09-10T23:25:31.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.971 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113989 s, 92.0 MB/s 2024-09-10T23:25:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012246 s, 85.6 MB/s 2024-09-10T23:25:32.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.002 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113437 s, 92.4 MB/s 2024-09-10T23:25:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115142 s, 91.1 MB/s 2024-09-10T23:25:32.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121109 s, 86.6 MB/s 2024-09-10T23:25:32.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:32.040 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:32.041 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:32.041 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T23:25:32.041 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:32.041 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:32.041 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:32.041 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:32.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:32.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.155 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118326 s, 88.6 MB/s 2024-09-10T23:25:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.170 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118816 s, 88.3 MB/s 2024-09-10T23:25:32.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.186 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011802 s, 88.8 MB/s 2024-09-10T23:25:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.201 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115769 s, 90.6 MB/s 2024-09-10T23:25:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118373 s, 88.6 MB/s 2024-09-10T23:25:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111072 s, 94.4 MB/s 2024-09-10T23:25:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107305 s, 97.7 MB/s 2024-09-10T23:25:32.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.262 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011106 s, 94.4 MB/s 2024-09-10T23:25:32.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.277 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116396 s, 90.1 MB/s 2024-09-10T23:25:32.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.293 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114635 s, 91.5 MB/s 2024-09-10T23:25:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.308 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115869 s, 90.5 MB/s 2024-09-10T23:25:32.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.324 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012052 s, 87.0 MB/s 2024-09-10T23:25:32.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.340 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127638 s, 82.2 MB/s 2024-09-10T23:25:32.358 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.358 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.358 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134625 s, 77.9 MB/s 2024-09-10T23:25:32.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117097 s, 89.5 MB/s 2024-09-10T23:25:32.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.389 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109652 s, 95.6 MB/s 2024-09-10T23:25:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113748 s, 92.2 MB/s 2024-09-10T23:25:32.419 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.419 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.419 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113958 s, 92.0 MB/s 2024-09-10T23:25:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115218 s, 91.0 MB/s 2024-09-10T23:25:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127828 s, 82.0 MB/s 2024-09-10T23:25:32.466 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113262 s, 92.6 MB/s 2024-09-10T23:25:32.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.482 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115946 s, 90.4 MB/s 2024-09-10T23:25:32.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128161 s, 81.8 MB/s 2024-09-10T23:25:32.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.514 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114483 s, 91.6 MB/s 2024-09-10T23:25:32.529 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.529 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.529 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112646 s, 93.1 MB/s 2024-09-10T23:25:32.544 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.544 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.544 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111892 s, 93.7 MB/s 2024-09-10T23:25:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115299 s, 90.9 MB/s 2024-09-10T23:25:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129347 s, 81.1 MB/s 2024-09-10T23:25:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.592 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113056 s, 92.7 MB/s 2024-09-10T23:25:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118919 s, 88.2 MB/s 2024-09-10T23:25:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125617 s, 83.5 MB/s 2024-09-10T23:25:32.640 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.640 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.640 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123205 s, 85.1 MB/s 2024-09-10T23:25:32.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:32.648 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:32.648 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:32.648 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T23:25:32.648 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:32.648 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:32.648 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:32.648 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:32.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.720 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125191 s, 83.8 MB/s 2024-09-10T23:25:32.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.736 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125279 s, 83.7 MB/s 2024-09-10T23:25:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111536 s, 94.0 MB/s 2024-09-10T23:25:32.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.765 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107199 s, 97.8 MB/s 2024-09-10T23:25:32.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.781 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114906 s, 91.3 MB/s 2024-09-10T23:25:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116268 s, 90.2 MB/s 2024-09-10T23:25:32.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117127 s, 89.5 MB/s 2024-09-10T23:25:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117269 s, 89.4 MB/s 2024-09-10T23:25:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114266 s, 91.8 MB/s 2024-09-10T23:25:32.857 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.857 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.857 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114644 s, 91.5 MB/s 2024-09-10T23:25:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107827 s, 97.2 MB/s 2024-09-10T23:25:32.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.887 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113003 s, 92.8 MB/s 2024-09-10T23:25:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.903 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012435 s, 84.3 MB/s 2024-09-10T23:25:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134908 s, 77.7 MB/s 2024-09-10T23:25:32.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.937 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118298 s, 88.6 MB/s 2024-09-10T23:25:32.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.951 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108502 s, 96.6 MB/s 2024-09-10T23:25:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.968 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012163 s, 86.2 MB/s 2024-09-10T23:25:32.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:32.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:32.985 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128527 s, 81.6 MB/s 2024-09-10T23:25:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117757 s, 89.0 MB/s 2024-09-10T23:25:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110181 s, 95.2 MB/s 2024-09-10T23:25:33.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.032 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135554 s, 77.4 MB/s 2024-09-10T23:25:33.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114687 s, 91.4 MB/s 2024-09-10T23:25:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113329 s, 92.5 MB/s 2024-09-10T23:25:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.077 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110795 s, 94.6 MB/s 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011784 s, 89.0 MB/s 2024-09-10T23:25:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119264 s, 87.9 MB/s 2024-09-10T23:25:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.124 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011388 s, 92.1 MB/s 2024-09-10T23:25:33.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012911 s, 81.2 MB/s 2024-09-10T23:25:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114966 s, 91.2 MB/s 2024-09-10T23:25:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.172 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115271 s, 91.0 MB/s 2024-09-10T23:25:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.187 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118361 s, 88.6 MB/s 2024-09-10T23:25:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105679 s, 99.2 MB/s 2024-09-10T23:25:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:33.209 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:33.209 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:33.209 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T23:25:33.209 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:33.209 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:33.209 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:33.209 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:33.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:33.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.282 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125663 s, 83.4 MB/s 2024-09-10T23:25:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123223 s, 85.1 MB/s 2024-09-10T23:25:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112785 s, 93.0 MB/s 2024-09-10T23:25:33.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.328 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107308 s, 97.7 MB/s 2024-09-10T23:25:33.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.343 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116106 s, 90.3 MB/s 2024-09-10T23:25:33.358 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.358 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.358 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114687 s, 91.4 MB/s 2024-09-10T23:25:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120804 s, 86.8 MB/s 2024-09-10T23:25:33.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.391 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132009 s, 79.4 MB/s 2024-09-10T23:25:33.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.406 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115117 s, 91.1 MB/s 2024-09-10T23:25:33.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011003 s, 95.3 MB/s 2024-09-10T23:25:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011565 s, 90.7 MB/s 2024-09-10T23:25:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011668 s, 89.9 MB/s 2024-09-10T23:25:33.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117643 s, 89.1 MB/s 2024-09-10T23:25:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119519 s, 87.7 MB/s 2024-09-10T23:25:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119293 s, 87.9 MB/s 2024-09-10T23:25:33.515 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.515 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.515 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118131 s, 88.8 MB/s 2024-09-10T23:25:33.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.530 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114297 s, 91.7 MB/s 2024-09-10T23:25:33.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.546 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121335 s, 86.4 MB/s 2024-09-10T23:25:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118047 s, 88.8 MB/s 2024-09-10T23:25:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122287 s, 85.7 MB/s 2024-09-10T23:25:33.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.593 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116238 s, 90.2 MB/s 2024-09-10T23:25:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122582 s, 85.5 MB/s 2024-09-10T23:25:33.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.625 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118914 s, 88.2 MB/s 2024-09-10T23:25:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129942 s, 80.7 MB/s 2024-09-10T23:25:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116236 s, 90.2 MB/s 2024-09-10T23:25:33.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.679 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115151 s, 91.1 MB/s 2024-09-10T23:25:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119941 s, 87.4 MB/s 2024-09-10T23:25:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127752 s, 82.1 MB/s 2024-09-10T23:25:33.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.728 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130688 s, 80.2 MB/s 2024-09-10T23:25:33.742 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.743 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.743 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010861 s, 96.5 MB/s 2024-09-10T23:25:33.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.758 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011292 s, 92.9 MB/s 2024-09-10T23:25:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132384 s, 79.2 MB/s 2024-09-10T23:25:33.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:33.782 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:33.782 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:33.782 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T23:25:33.782 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:33.782 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:33.782 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:33.782 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:33.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119352 s, 87.9 MB/s 2024-09-10T23:25:33.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.871 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133656 s, 78.5 MB/s 2024-09-10T23:25:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115262 s, 91.0 MB/s 2024-09-10T23:25:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130967 s, 80.1 MB/s 2024-09-10T23:25:33.919 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.919 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.919 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126545 s, 82.9 MB/s 2024-09-10T23:25:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109538 s, 95.7 MB/s 2024-09-10T23:25:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120667 s, 86.9 MB/s 2024-09-10T23:25:33.964 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.964 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.964 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106669 s, 98.3 MB/s 2024-09-10T23:25:33.980 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.980 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.980 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118974 s, 88.1 MB/s 2024-09-10T23:25:33.996 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:33.996 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:33.996 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120009 s, 87.4 MB/s 2024-09-10T23:25:34.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.011 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109232 s, 96.0 MB/s 2024-09-10T23:25:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122923 s, 85.3 MB/s 2024-09-10T23:25:34.042 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.042 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.042 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011694 s, 89.7 MB/s 2024-09-10T23:25:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115611 s, 90.7 MB/s 2024-09-10T23:25:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109324 s, 95.9 MB/s 2024-09-10T23:25:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115998 s, 90.4 MB/s 2024-09-10T23:25:34.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.104 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121674 s, 86.2 MB/s 2024-09-10T23:25:34.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.120 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120664 s, 86.9 MB/s 2024-09-10T23:25:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119059 s, 88.1 MB/s 2024-09-10T23:25:34.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.152 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119429 s, 87.8 MB/s 2024-09-10T23:25:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.166 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110043 s, 95.3 MB/s 2024-09-10T23:25:34.183 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.183 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.183 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125321 s, 83.7 MB/s 2024-09-10T23:25:34.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.198 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109105 s, 96.1 MB/s 2024-09-10T23:25:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114361 s, 91.7 MB/s 2024-09-10T23:25:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118159 s, 88.7 MB/s 2024-09-10T23:25:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113923 s, 92.0 MB/s 2024-09-10T23:25:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.260 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.260 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119899 s, 87.5 MB/s 2024-09-10T23:25:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116904 s, 89.7 MB/s 2024-09-10T23:25:34.290 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.290 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.290 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117452 s, 89.3 MB/s 2024-09-10T23:25:34.305 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.305 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.306 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113486 s, 92.4 MB/s 2024-09-10T23:25:34.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120065 s, 87.3 MB/s 2024-09-10T23:25:34.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.337 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116606 s, 89.9 MB/s 2024-09-10T23:25:34.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:34.344 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:34.344 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:34.344 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T23:25:34.344 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:34.345 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:34.345 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:34.345 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:34.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:34.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.508 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121439 s, 86.3 MB/s 2024-09-10T23:25:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122385 s, 85.7 MB/s 2024-09-10T23:25:34.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.539 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117759 s, 89.0 MB/s 2024-09-10T23:25:34.554 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.554 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.555 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112758 s, 93.0 MB/s 2024-09-10T23:25:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.572 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134341 s, 78.1 MB/s 2024-09-10T23:25:34.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.588 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120408 s, 87.1 MB/s 2024-09-10T23:25:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114094 s, 91.9 MB/s 2024-09-10T23:25:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107843 s, 97.2 MB/s 2024-09-10T23:25:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.633 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121243 s, 86.5 MB/s 2024-09-10T23:25:34.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.653 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124996 s, 83.9 MB/s 2024-09-10T23:25:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122137 s, 85.9 MB/s 2024-09-10T23:25:34.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.684 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115552 s, 90.7 MB/s 2024-09-10T23:25:34.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.700 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122137 s, 85.9 MB/s 2024-09-10T23:25:34.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.716 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116364 s, 90.1 MB/s 2024-09-10T23:25:34.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.733 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.733 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131336 s, 79.8 MB/s 2024-09-10T23:25:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012073 s, 86.9 MB/s 2024-09-10T23:25:34.763 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.764 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112167 s, 93.5 MB/s 2024-09-10T23:25:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104679 s, 100 MB/s 2024-09-10T23:25:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.794 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127927 s, 82.0 MB/s 2024-09-10T23:25:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119504 s, 87.7 MB/s 2024-09-10T23:25:34.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124967 s, 83.9 MB/s 2024-09-10T23:25:34.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128595 s, 81.5 MB/s 2024-09-10T23:25:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117958 s, 88.9 MB/s 2024-09-10T23:25:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120783 s, 86.8 MB/s 2024-09-10T23:25:34.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.892 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126813 s, 82.7 MB/s 2024-09-10T23:25:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013459 s, 77.9 MB/s 2024-09-10T23:25:34.925 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.925 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.925 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120113 s, 87.3 MB/s 2024-09-10T23:25:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115942 s, 90.4 MB/s 2024-09-10T23:25:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114819 s, 91.3 MB/s 2024-09-10T23:25:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121878 s, 86.0 MB/s 2024-09-10T23:25:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121414 s, 86.4 MB/s 2024-09-10T23:25:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118086 s, 88.8 MB/s 2024-09-10T23:25:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:35.010 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:35.011 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:35.011 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T23:25:35.011 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:35.011 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:35.011 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:35.011 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:35.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116127 s, 90.3 MB/s 2024-09-10T23:25:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011634 s, 90.1 MB/s 2024-09-10T23:25:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107979 s, 97.1 MB/s 2024-09-10T23:25:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126612 s, 82.8 MB/s 2024-09-10T23:25:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122409 s, 85.7 MB/s 2024-09-10T23:25:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117714 s, 89.1 MB/s 2024-09-10T23:25:35.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.176 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114043 s, 91.9 MB/s 2024-09-10T23:25:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111416 s, 94.1 MB/s 2024-09-10T23:25:35.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.205 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114564 s, 91.5 MB/s 2024-09-10T23:25:35.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112806 s, 93.0 MB/s 2024-09-10T23:25:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114221 s, 91.8 MB/s 2024-09-10T23:25:35.250 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.251 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110206 s, 95.1 MB/s 2024-09-10T23:25:35.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.265 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107356 s, 97.7 MB/s 2024-09-10T23:25:35.281 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.281 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.281 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121041 s, 86.6 MB/s 2024-09-10T23:25:35.296 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.296 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.296 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107673 s, 97.4 MB/s 2024-09-10T23:25:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.312 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119226 s, 87.9 MB/s 2024-09-10T23:25:35.326 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.326 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.326 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107413 s, 97.6 MB/s 2024-09-10T23:25:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106196 s, 98.7 MB/s 2024-09-10T23:25:35.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.357 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118277 s, 88.7 MB/s 2024-09-10T23:25:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127902 s, 82.0 MB/s 2024-09-10T23:25:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110189 s, 95.2 MB/s 2024-09-10T23:25:35.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.405 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125189 s, 83.8 MB/s 2024-09-10T23:25:35.420 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115988 s, 90.4 MB/s 2024-09-10T23:25:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.438 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126833 s, 82.7 MB/s 2024-09-10T23:25:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112761 s, 93.0 MB/s 2024-09-10T23:25:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118319 s, 88.6 MB/s 2024-09-10T23:25:35.485 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.485 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.485 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120738 s, 86.8 MB/s 2024-09-10T23:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112486 s, 93.2 MB/s 2024-09-10T23:25:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012571 s, 83.4 MB/s 2024-09-10T23:25:35.533 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.533 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.533 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111778 s, 93.8 MB/s 2024-09-10T23:25:35.549 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.550 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.550 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117659 s, 89.1 MB/s 2024-09-10T23:25:35.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.566 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125395 s, 83.6 MB/s 2024-09-10T23:25:35.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:35.574 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:35.574 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:35.574 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T23:25:35.574 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:35.574 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:35.574 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:35.574 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:35.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157642 s, 66.5 MB/s 2024-09-10T23:25:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.673 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124335 s, 84.3 MB/s 2024-09-10T23:25:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112727 s, 93.0 MB/s 2024-09-10T23:25:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107035 s, 98.0 MB/s 2024-09-10T23:25:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125021 s, 83.9 MB/s 2024-09-10T23:25:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107684 s, 97.4 MB/s 2024-09-10T23:25:35.747 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.747 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.747 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105316 s, 99.6 MB/s 2024-09-10T23:25:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122911 s, 85.3 MB/s 2024-09-10T23:25:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011689 s, 89.7 MB/s 2024-09-10T23:25:35.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.794 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116371 s, 90.1 MB/s 2024-09-10T23:25:35.809 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.809 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.809 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111221 s, 94.3 MB/s 2024-09-10T23:25:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.824 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107113 s, 97.9 MB/s 2024-09-10T23:25:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108241 s, 96.9 MB/s 2024-09-10T23:25:35.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.854 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119809 s, 87.5 MB/s 2024-09-10T23:25:35.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.871 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128256 s, 81.8 MB/s 2024-09-10T23:25:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116618 s, 89.9 MB/s 2024-09-10T23:25:35.901 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.901 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.901 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107665 s, 97.4 MB/s 2024-09-10T23:25:35.917 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.917 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.917 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120785 s, 86.8 MB/s 2024-09-10T23:25:35.934 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.934 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.934 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125659 s, 83.4 MB/s 2024-09-10T23:25:35.950 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.951 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120859 s, 86.8 MB/s 2024-09-10T23:25:35.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.966 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113566 s, 92.3 MB/s 2024-09-10T23:25:35.982 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.982 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.982 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119349 s, 87.9 MB/s 2024-09-10T23:25:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114636 s, 91.5 MB/s 2024-09-10T23:25:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.014 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119976 s, 87.4 MB/s 2024-09-10T23:25:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011741 s, 89.3 MB/s 2024-09-10T23:25:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118889 s, 88.2 MB/s 2024-09-10T23:25:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122233 s, 85.8 MB/s 2024-09-10T23:25:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122746 s, 85.4 MB/s 2024-09-10T23:25:36.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.095 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120601 s, 86.9 MB/s 2024-09-10T23:25:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.111 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118251 s, 88.7 MB/s 2024-09-10T23:25:36.127 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.127 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.127 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115383 s, 90.9 MB/s 2024-09-10T23:25:36.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.142 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114406 s, 91.7 MB/s 2024-09-10T23:25:36.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:36.150 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:36.150 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:36.150 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T23:25:36.150 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:36.150 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:36.150 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:36.150 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:36.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119942 s, 87.4 MB/s 2024-09-10T23:25:36.239 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.239 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.239 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122059 s, 85.9 MB/s 2024-09-10T23:25:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.254 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110195 s, 95.2 MB/s 2024-09-10T23:25:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133866 s, 78.3 MB/s 2024-09-10T23:25:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121046 s, 86.6 MB/s 2024-09-10T23:25:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.304 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121463 s, 86.3 MB/s 2024-09-10T23:25:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117352 s, 89.4 MB/s 2024-09-10T23:25:36.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.336 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120029 s, 87.4 MB/s 2024-09-10T23:25:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130442 s, 80.4 MB/s 2024-09-10T23:25:36.371 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.371 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.371 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131801 s, 79.6 MB/s 2024-09-10T23:25:36.386 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.387 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.387 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116072 s, 90.3 MB/s 2024-09-10T23:25:36.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.402 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110644 s, 94.8 MB/s 2024-09-10T23:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115239 s, 91.0 MB/s 2024-09-10T23:25:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116266 s, 90.2 MB/s 2024-09-10T23:25:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123308 s, 85.0 MB/s 2024-09-10T23:25:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.465 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116356 s, 90.1 MB/s 2024-09-10T23:25:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125258 s, 83.7 MB/s 2024-09-10T23:25:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.497 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105453 s, 99.4 MB/s 2024-09-10T23:25:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117499 s, 89.2 MB/s 2024-09-10T23:25:36.529 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.529 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.529 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120812 s, 86.8 MB/s 2024-09-10T23:25:36.544 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.545 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110301 s, 95.1 MB/s 2024-09-10T23:25:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115927 s, 90.5 MB/s 2024-09-10T23:25:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115538 s, 90.8 MB/s 2024-09-10T23:25:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.593 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122407 s, 85.7 MB/s 2024-09-10T23:25:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121344 s, 86.4 MB/s 2024-09-10T23:25:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122327 s, 85.7 MB/s 2024-09-10T23:25:36.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123183 s, 85.1 MB/s 2024-09-10T23:25:36.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.684 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01281 s, 81.9 MB/s 2024-09-10T23:25:36.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.700 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126956 s, 82.6 MB/s 2024-09-10T23:25:36.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.716 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112801 s, 93.0 MB/s 2024-09-10T23:25:36.731 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.731 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.731 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118992 s, 88.1 MB/s 2024-09-10T23:25:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112917 s, 92.9 MB/s 2024-09-10T23:25:36.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:36.754 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:36.754 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:36.754 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T23:25:36.754 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:36.754 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:36.754 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:36.754 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:36.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:36.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119507 s, 87.7 MB/s 2024-09-10T23:25:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116925 s, 89.7 MB/s 2024-09-10T23:25:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120852 s, 86.8 MB/s 2024-09-10T23:25:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122594 s, 85.5 MB/s 2024-09-10T23:25:36.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.891 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121525 s, 86.3 MB/s 2024-09-10T23:25:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120472 s, 87.0 MB/s 2024-09-10T23:25:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123771 s, 84.7 MB/s 2024-09-10T23:25:36.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.939 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118151 s, 88.7 MB/s 2024-09-10T23:25:36.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113965 s, 92.0 MB/s 2024-09-10T23:25:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.969 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109069 s, 96.1 MB/s 2024-09-10T23:25:36.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:36.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:36.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117829 s, 89.0 MB/s 2024-09-10T23:25:37.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011473 s, 91.4 MB/s 2024-09-10T23:25:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113721 s, 92.2 MB/s 2024-09-10T23:25:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116228 s, 90.2 MB/s 2024-09-10T23:25:37.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123783 s, 84.7 MB/s 2024-09-10T23:25:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123088 s, 85.2 MB/s 2024-09-10T23:25:37.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116304 s, 90.2 MB/s 2024-09-10T23:25:37.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120532 s, 87.0 MB/s 2024-09-10T23:25:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114435 s, 91.6 MB/s 2024-09-10T23:25:37.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.124 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113693 s, 92.2 MB/s 2024-09-10T23:25:37.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.140 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116762 s, 89.8 MB/s 2024-09-10T23:25:37.154 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.155 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112369 s, 93.3 MB/s 2024-09-10T23:25:37.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.171 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116802 s, 89.8 MB/s 2024-09-10T23:25:37.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.186 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116379 s, 90.1 MB/s 2024-09-10T23:25:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107722 s, 97.3 MB/s 2024-09-10T23:25:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126387 s, 83.0 MB/s 2024-09-10T23:25:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123507 s, 84.9 MB/s 2024-09-10T23:25:37.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.247 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112196 s, 93.5 MB/s 2024-09-10T23:25:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115619 s, 90.7 MB/s 2024-09-10T23:25:37.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.278 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113232 s, 92.6 MB/s 2024-09-10T23:25:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.293 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112496 s, 93.2 MB/s 2024-09-10T23:25:37.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.308 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117169 s, 89.5 MB/s 2024-09-10T23:25:37.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:37.315 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:37.315 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:37.316 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T23:25:37.316 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:37.316 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:37.316 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:37.316 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:37.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:37.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.390 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136459 s, 76.8 MB/s 2024-09-10T23:25:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124318 s, 84.3 MB/s 2024-09-10T23:25:37.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.422 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112187 s, 93.5 MB/s 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123002 s, 85.2 MB/s 2024-09-10T23:25:37.454 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.454 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.455 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124741 s, 84.1 MB/s 2024-09-10T23:25:37.470 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.470 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.470 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119659 s, 87.6 MB/s 2024-09-10T23:25:37.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.487 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129983 s, 80.7 MB/s 2024-09-10T23:25:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119352 s, 87.9 MB/s 2024-09-10T23:25:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.519 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123192 s, 85.1 MB/s 2024-09-10T23:25:37.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.534 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120686 s, 86.9 MB/s 2024-09-10T23:25:37.549 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.549 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.549 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110403 s, 95.0 MB/s 2024-09-10T23:25:37.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:25:37.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:25:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.566 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134861 s, 77.8 MB/s 2024-09-10T23:25:37.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.583 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.583 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127733 s, 82.1 MB/s 2024-09-10T23:25:37.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.598 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116556 s, 90.0 MB/s 2024-09-10T23:25:37.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.612 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108825 s, 96.4 MB/s 2024-09-10T23:25:37.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.629 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122889 s, 85.3 MB/s 2024-09-10T23:25:37.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121463 s, 86.3 MB/s 2024-09-10T23:25:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.677 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125186 s, 83.8 MB/s 2024-09-10T23:25:37.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115119 s, 91.1 MB/s 2024-09-10T23:25:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123427 s, 85.0 MB/s 2024-09-10T23:25:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124848 s, 84.0 MB/s 2024-09-10T23:25:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.742 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126655 s, 82.8 MB/s 2024-09-10T23:25:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108661 s, 96.5 MB/s 2024-09-10T23:25:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114716 s, 91.4 MB/s 2024-09-10T23:25:37.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.787 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114045 s, 91.9 MB/s 2024-09-10T23:25:37.801 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.801 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.801 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109017 s, 96.2 MB/s 2024-09-10T23:25:37.816 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115814 s, 90.5 MB/s 2024-09-10T23:25:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012127 s, 86.5 MB/s 2024-09-10T23:25:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115193 s, 91.0 MB/s 2024-09-10T23:25:37.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.863 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.863 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111628 s, 93.9 MB/s 2024-09-10T23:25:37.879 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.879 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.879 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121104 s, 86.6 MB/s 2024-09-10T23:25:37.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:37.895 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:37.895 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119195 s, 88.0 MB/s 2024-09-10T23:25:37.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:37.902 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:37.902 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:37.902 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T23:25:37.902 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:37.902 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:37.902 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:37.902 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:37.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:38.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.014 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117126 s, 89.5 MB/s 2024-09-10T23:25:38.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132017 s, 79.4 MB/s 2024-09-10T23:25:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115208 s, 91.0 MB/s 2024-09-10T23:25:38.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.062 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122496 s, 85.6 MB/s 2024-09-10T23:25:38.076 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.077 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107748 s, 97.3 MB/s 2024-09-10T23:25:38.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133663 s, 78.4 MB/s 2024-09-10T23:25:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124049 s, 84.5 MB/s 2024-09-10T23:25:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115454 s, 90.8 MB/s 2024-09-10T23:25:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116272 s, 90.2 MB/s 2024-09-10T23:25:38.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.157 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122342 s, 85.7 MB/s 2024-09-10T23:25:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117418 s, 89.3 MB/s 2024-09-10T23:25:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118428 s, 88.5 MB/s 2024-09-10T23:25:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117457 s, 89.3 MB/s 2024-09-10T23:25:38.218 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.219 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114419 s, 91.6 MB/s 2024-09-10T23:25:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113971 s, 92.0 MB/s 2024-09-10T23:25:38.250 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.250 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.250 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122736 s, 85.4 MB/s 2024-09-10T23:25:38.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.266 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.266 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117419 s, 89.3 MB/s 2024-09-10T23:25:38.281 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.281 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.281 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119299 s, 87.9 MB/s 2024-09-10T23:25:38.297 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.297 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.297 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123913 s, 84.6 MB/s 2024-09-10T23:25:38.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.312 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116957 s, 89.7 MB/s 2024-09-10T23:25:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116735 s, 89.8 MB/s 2024-09-10T23:25:38.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112506 s, 93.2 MB/s 2024-09-10T23:25:38.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124981 s, 83.9 MB/s 2024-09-10T23:25:38.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.375 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117107 s, 89.5 MB/s 2024-09-10T23:25:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106775 s, 98.2 MB/s 2024-09-10T23:25:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122694 s, 85.5 MB/s 2024-09-10T23:25:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122192 s, 85.8 MB/s 2024-09-10T23:25:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113706 s, 92.2 MB/s 2024-09-10T23:25:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121629 s, 86.2 MB/s 2024-09-10T23:25:38.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.469 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131495 s, 79.7 MB/s 2024-09-10T23:25:38.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.486 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133014 s, 78.8 MB/s 2024-09-10T23:25:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114664 s, 91.4 MB/s 2024-09-10T23:25:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:38.509 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:38.509 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:38.509 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T23:25:38.509 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:38.509 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:38.509 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:38.509 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:38.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.580 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119983 s, 87.4 MB/s 2024-09-10T23:25:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109784 s, 95.5 MB/s 2024-09-10T23:25:38.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.610 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011851 s, 88.5 MB/s 2024-09-10T23:25:38.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.628 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138295 s, 75.8 MB/s 2024-09-10T23:25:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108012 s, 97.1 MB/s 2024-09-10T23:25:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113612 s, 92.3 MB/s 2024-09-10T23:25:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126262 s, 83.0 MB/s 2024-09-10T23:25:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.694 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012581 s, 83.3 MB/s 2024-09-10T23:25:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122137 s, 85.9 MB/s 2024-09-10T23:25:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.728 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138906 s, 75.5 MB/s 2024-09-10T23:25:38.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.744 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119309 s, 87.9 MB/s 2024-09-10T23:25:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113833 s, 92.1 MB/s 2024-09-10T23:25:38.773 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.774 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.774 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111106 s, 94.4 MB/s 2024-09-10T23:25:38.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.789 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114333 s, 91.7 MB/s 2024-09-10T23:25:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011821 s, 88.7 MB/s 2024-09-10T23:25:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116018 s, 90.4 MB/s 2024-09-10T23:25:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114041 s, 91.9 MB/s 2024-09-10T23:25:38.850 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.850 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.850 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111623 s, 93.9 MB/s 2024-09-10T23:25:38.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.866 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120974 s, 86.7 MB/s 2024-09-10T23:25:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128622 s, 81.5 MB/s 2024-09-10T23:25:38.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.898 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011154 s, 94.0 MB/s 2024-09-10T23:25:38.914 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.914 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.914 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116862 s, 89.7 MB/s 2024-09-10T23:25:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.930 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115899 s, 90.5 MB/s 2024-09-10T23:25:38.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.946 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118551 s, 88.4 MB/s 2024-09-10T23:25:38.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.961 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114691 s, 91.4 MB/s 2024-09-10T23:25:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122099 s, 85.9 MB/s 2024-09-10T23:25:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131439 s, 79.8 MB/s 2024-09-10T23:25:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.009 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118217 s, 88.7 MB/s 2024-09-10T23:25:39.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.024 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109562 s, 95.7 MB/s 2024-09-10T23:25:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.040 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011922 s, 88.0 MB/s 2024-09-10T23:25:39.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.057 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134573 s, 77.9 MB/s 2024-09-10T23:25:39.072 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.072 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.072 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107603 s, 97.4 MB/s 2024-09-10T23:25:39.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:39.079 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:39.079 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:39.079 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T23:25:39.079 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:39.080 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:39.080 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:39.080 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:39.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:39.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.198 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118252 s, 88.7 MB/s 2024-09-10T23:25:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116908 s, 89.7 MB/s 2024-09-10T23:25:39.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.229 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119262 s, 87.9 MB/s 2024-09-10T23:25:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122469 s, 85.6 MB/s 2024-09-10T23:25:39.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.261 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120979 s, 86.7 MB/s 2024-09-10T23:25:39.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.277 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123748 s, 84.7 MB/s 2024-09-10T23:25:39.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.293 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116704 s, 89.8 MB/s 2024-09-10T23:25:39.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.309 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124413 s, 84.3 MB/s 2024-09-10T23:25:39.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.324 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011464 s, 91.5 MB/s 2024-09-10T23:25:39.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.340 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119945 s, 87.4 MB/s 2024-09-10T23:25:39.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.356 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121021 s, 86.6 MB/s 2024-09-10T23:25:39.372 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.372 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.372 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124639 s, 84.1 MB/s 2024-09-10T23:25:39.387 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.388 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112509 s, 93.2 MB/s 2024-09-10T23:25:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124121 s, 84.5 MB/s 2024-09-10T23:25:39.420 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127457 s, 82.3 MB/s 2024-09-10T23:25:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120751 s, 86.8 MB/s 2024-09-10T23:25:39.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.453 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125174 s, 83.8 MB/s 2024-09-10T23:25:39.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.469 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119816 s, 87.5 MB/s 2024-09-10T23:25:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.488 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145544 s, 72.0 MB/s 2024-09-10T23:25:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127092 s, 82.5 MB/s 2024-09-10T23:25:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.521 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012389 s, 84.6 MB/s 2024-09-10T23:25:39.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.539 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137847 s, 76.1 MB/s 2024-09-10T23:25:39.556 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137328 s, 76.4 MB/s 2024-09-10T23:25:39.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.574 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.574 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129767 s, 80.8 MB/s 2024-09-10T23:25:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123967 s, 84.6 MB/s 2024-09-10T23:25:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125255 s, 83.7 MB/s 2024-09-10T23:25:39.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.622 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110107 s, 95.2 MB/s 2024-09-10T23:25:39.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.639 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128658 s, 81.5 MB/s 2024-09-10T23:25:39.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.658 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154775 s, 67.7 MB/s 2024-09-10T23:25:39.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.676 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110896 s, 94.6 MB/s 2024-09-10T23:25:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.692 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120087 s, 87.3 MB/s 2024-09-10T23:25:39.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.710 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143433 s, 73.1 MB/s 2024-09-10T23:25:39.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:39.717 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:39.717 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:39.717 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T23:25:39.718 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:39.718 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:39.718 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:39.718 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:39.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:39.790 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.790 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.790 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115349 s, 90.9 MB/s 2024-09-10T23:25:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120683 s, 86.9 MB/s 2024-09-10T23:25:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129748 s, 80.8 MB/s 2024-09-10T23:25:39.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.838 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114447 s, 91.6 MB/s 2024-09-10T23:25:39.855 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.855 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.855 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125296 s, 83.7 MB/s 2024-09-10T23:25:39.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.871 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123106 s, 85.2 MB/s 2024-09-10T23:25:39.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.887 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116967 s, 89.6 MB/s 2024-09-10T23:25:39.903 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.903 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.903 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127735 s, 82.1 MB/s 2024-09-10T23:25:39.919 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.919 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.919 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116081 s, 90.3 MB/s 2024-09-10T23:25:39.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.935 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012424 s, 84.4 MB/s 2024-09-10T23:25:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120028 s, 87.4 MB/s 2024-09-10T23:25:39.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.967 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124914 s, 83.9 MB/s 2024-09-10T23:25:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115777 s, 90.6 MB/s 2024-09-10T23:25:39.999 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128741 s, 81.4 MB/s 2024-09-10T23:25:40.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.016 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125578 s, 83.5 MB/s 2024-09-10T23:25:40.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.032 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120901 s, 86.7 MB/s 2024-09-10T23:25:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115019 s, 91.2 MB/s 2024-09-10T23:25:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126806 s, 82.7 MB/s 2024-09-10T23:25:40.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.080 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117658 s, 89.1 MB/s 2024-09-10T23:25:40.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.095 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113733 s, 92.2 MB/s 2024-09-10T23:25:40.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107827 s, 97.2 MB/s 2024-09-10T23:25:40.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118501 s, 88.5 MB/s 2024-09-10T23:25:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129271 s, 81.1 MB/s 2024-09-10T23:25:40.158 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.158 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.158 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116746 s, 89.8 MB/s 2024-09-10T23:25:40.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.173 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111346 s, 94.2 MB/s 2024-09-10T23:25:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.188 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116477 s, 90.0 MB/s 2024-09-10T23:25:40.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.203 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112621 s, 93.1 MB/s 2024-09-10T23:25:40.218 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.218 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.218 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118477 s, 88.5 MB/s 2024-09-10T23:25:40.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.233 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110574 s, 94.8 MB/s 2024-09-10T23:25:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.248 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110877 s, 94.6 MB/s 2024-09-10T23:25:40.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.263 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111068 s, 94.4 MB/s 2024-09-10T23:25:40.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116674 s, 89.9 MB/s 2024-09-10T23:25:40.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:40.288 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:40.288 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:40.289 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T23:25:40.289 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:40.289 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:40.289 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:40.289 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:40.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.361 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.361 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123937 s, 84.6 MB/s 2024-09-10T23:25:40.376 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.376 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.376 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117731 s, 89.1 MB/s 2024-09-10T23:25:40.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127117 s, 82.5 MB/s 2024-09-10T23:25:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109096 s, 96.1 MB/s 2024-09-10T23:25:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.424 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.424 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122565 s, 85.6 MB/s 2024-09-10T23:25:40.439 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.440 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120529 s, 87.0 MB/s 2024-09-10T23:25:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116221 s, 90.2 MB/s 2024-09-10T23:25:40.470 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.471 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116847 s, 89.7 MB/s 2024-09-10T23:25:40.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.486 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116605 s, 89.9 MB/s 2024-09-10T23:25:40.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.503 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134818 s, 77.8 MB/s 2024-09-10T23:25:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.519 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01134 s, 92.5 MB/s 2024-09-10T23:25:40.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140576 s, 74.6 MB/s 2024-09-10T23:25:40.553 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.553 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.553 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129725 s, 80.8 MB/s 2024-09-10T23:25:40.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.571 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134759 s, 77.8 MB/s 2024-09-10T23:25:40.586 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.586 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.586 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011433 s, 91.7 MB/s 2024-09-10T23:25:40.601 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.601 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.601 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114155 s, 91.9 MB/s 2024-09-10T23:25:40.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.618 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126256 s, 83.1 MB/s 2024-09-10T23:25:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012356 s, 84.9 MB/s 2024-09-10T23:25:40.651 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.651 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.651 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134388 s, 78.0 MB/s 2024-09-10T23:25:40.683 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.683 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.683 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111046 s, 94.4 MB/s 2024-09-10T23:25:40.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.699 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126258 s, 83.1 MB/s 2024-09-10T23:25:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.715 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115984 s, 90.4 MB/s 2024-09-10T23:25:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.730 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119087 s, 88.1 MB/s 2024-09-10T23:25:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122053 s, 85.9 MB/s 2024-09-10T23:25:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.762 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114755 s, 91.4 MB/s 2024-09-10T23:25:40.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.777 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117654 s, 89.1 MB/s 2024-09-10T23:25:40.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.793 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122002 s, 85.9 MB/s 2024-09-10T23:25:40.809 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.809 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.809 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118611 s, 88.4 MB/s 2024-09-10T23:25:40.824 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.824 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.824 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110013 s, 95.3 MB/s 2024-09-10T23:25:40.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116696 s, 89.9 MB/s 2024-09-10T23:25:40.857 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.857 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.857 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135737 s, 77.3 MB/s 2024-09-10T23:25:40.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.873 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125629 s, 83.5 MB/s 2024-09-10T23:25:40.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:40.881 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:40.881 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:40.881 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T23:25:40.881 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:40.881 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:40.881 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:40.881 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125955 s, 83.2 MB/s 2024-09-10T23:25:40.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122693 s, 85.5 MB/s 2024-09-10T23:25:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119988 s, 87.4 MB/s 2024-09-10T23:25:41.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.002 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121091 s, 86.6 MB/s 2024-09-10T23:25:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112939 s, 92.8 MB/s 2024-09-10T23:25:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115817 s, 90.5 MB/s 2024-09-10T23:25:41.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109985 s, 95.3 MB/s 2024-09-10T23:25:41.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125946 s, 83.3 MB/s 2024-09-10T23:25:41.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130937 s, 80.1 MB/s 2024-09-10T23:25:41.096 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.096 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.096 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113238 s, 92.6 MB/s 2024-09-10T23:25:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.113 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118186 s, 88.7 MB/s 2024-09-10T23:25:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114056 s, 91.9 MB/s 2024-09-10T23:25:41.143 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.143 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.143 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111487 s, 94.1 MB/s 2024-09-10T23:25:41.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.160 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013046 s, 80.4 MB/s 2024-09-10T23:25:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.176 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120696 s, 86.9 MB/s 2024-09-10T23:25:41.191 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.191 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.191 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116888 s, 89.7 MB/s 2024-09-10T23:25:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131398 s, 79.8 MB/s 2024-09-10T23:25:41.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.224 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127531 s, 82.2 MB/s 2024-09-10T23:25:41.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.240 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120318 s, 87.2 MB/s 2024-09-10T23:25:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105712 s, 99.2 MB/s 2024-09-10T23:25:41.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.270 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119072 s, 88.1 MB/s 2024-09-10T23:25:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.286 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119052 s, 88.1 MB/s 2024-09-10T23:25:41.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.300 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106498 s, 98.5 MB/s 2024-09-10T23:25:41.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.315 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110627 s, 94.8 MB/s 2024-09-10T23:25:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121199 s, 86.5 MB/s 2024-09-10T23:25:41.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.347 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012036 s, 87.1 MB/s 2024-09-10T23:25:41.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.363 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115308 s, 90.9 MB/s 2024-09-10T23:25:41.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.378 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.378 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115429 s, 90.8 MB/s 2024-09-10T23:25:41.393 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.394 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122282 s, 85.8 MB/s 2024-09-10T23:25:41.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.410 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125291 s, 83.7 MB/s 2024-09-10T23:25:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.426 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118175 s, 88.7 MB/s 2024-09-10T23:25:41.442 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.442 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.442 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124944 s, 83.9 MB/s 2024-09-10T23:25:41.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:41.450 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:41.450 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:41.450 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T23:25:41.450 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:41.450 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:41.450 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:41.450 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:41.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.523 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121284 s, 86.5 MB/s 2024-09-10T23:25:41.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.539 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119882 s, 87.5 MB/s 2024-09-10T23:25:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122068 s, 85.9 MB/s 2024-09-10T23:25:41.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.570 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115365 s, 90.9 MB/s 2024-09-10T23:25:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127803 s, 82.0 MB/s 2024-09-10T23:25:41.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.603 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.603 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122518 s, 85.6 MB/s 2024-09-10T23:25:41.618 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.618 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.618 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116928 s, 89.7 MB/s 2024-09-10T23:25:41.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.634 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122911 s, 85.3 MB/s 2024-09-10T23:25:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114803 s, 91.3 MB/s 2024-09-10T23:25:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.666 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120837 s, 86.8 MB/s 2024-09-10T23:25:41.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.688 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117427 s, 89.3 MB/s 2024-09-10T23:25:41.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132553 s, 79.1 MB/s 2024-09-10T23:25:41.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.723 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134141 s, 78.2 MB/s 2024-09-10T23:25:41.737 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.738 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113198 s, 92.6 MB/s 2024-09-10T23:25:41.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.753 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010927 s, 96.0 MB/s 2024-09-10T23:25:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114577 s, 91.5 MB/s 2024-09-10T23:25:41.783 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.783 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.783 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011363 s, 92.3 MB/s 2024-09-10T23:25:41.801 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.801 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.801 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140198 s, 74.8 MB/s 2024-09-10T23:25:41.817 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.817 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.818 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125997 s, 83.2 MB/s 2024-09-10T23:25:41.834 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.834 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.834 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012382 s, 84.7 MB/s 2024-09-10T23:25:41.849 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.849 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.849 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115947 s, 90.4 MB/s 2024-09-10T23:25:41.866 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.866 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.866 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012569 s, 83.4 MB/s 2024-09-10T23:25:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.882 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124167 s, 84.4 MB/s 2024-09-10T23:25:41.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.898 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116287 s, 90.2 MB/s 2024-09-10T23:25:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01185 s, 88.5 MB/s 2024-09-10T23:25:41.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.928 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111483 s, 94.1 MB/s 2024-09-10T23:25:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116219 s, 90.2 MB/s 2024-09-10T23:25:41.960 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128387 s, 81.7 MB/s 2024-09-10T23:25:41.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.977 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.977 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120128 s, 87.3 MB/s 2024-09-10T23:25:41.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:41.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:41.992 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119823 s, 87.5 MB/s 2024-09-10T23:25:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116003 s, 90.4 MB/s 2024-09-10T23:25:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116615 s, 89.9 MB/s 2024-09-10T23:25:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:42.031 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:42.032 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:42.032 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T23:25:42.032 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:42.032 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:42.032 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:42.032 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:42.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128836 s, 81.4 MB/s 2024-09-10T23:25:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115905 s, 90.5 MB/s 2024-09-10T23:25:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117915 s, 88.9 MB/s 2024-09-10T23:25:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123079 s, 85.2 MB/s 2024-09-10T23:25:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.178 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117717 s, 89.1 MB/s 2024-09-10T23:25:42.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.184 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119803 s, 87.5 MB/s 2024-09-10T23:25:42.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.201 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123534 s, 84.9 MB/s 2024-09-10T23:25:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.216 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011728 s, 89.4 MB/s 2024-09-10T23:25:42.231 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.232 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115397 s, 90.9 MB/s 2024-09-10T23:25:42.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.248 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125556 s, 83.5 MB/s 2024-09-10T23:25:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116692 s, 89.9 MB/s 2024-09-10T23:25:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117744 s, 89.1 MB/s 2024-09-10T23:25:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.294 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117145 s, 89.5 MB/s 2024-09-10T23:25:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011965 s, 87.6 MB/s 2024-09-10T23:25:42.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121954 s, 86.0 MB/s 2024-09-10T23:25:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125286 s, 83.7 MB/s 2024-09-10T23:25:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114465 s, 91.6 MB/s 2024-09-10T23:25:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128294 s, 81.7 MB/s 2024-09-10T23:25:42.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.389 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113803 s, 92.1 MB/s 2024-09-10T23:25:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.405 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117267 s, 89.4 MB/s 2024-09-10T23:25:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122574 s, 85.5 MB/s 2024-09-10T23:25:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114973 s, 91.2 MB/s 2024-09-10T23:25:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124433 s, 84.3 MB/s 2024-09-10T23:25:42.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116721 s, 89.8 MB/s 2024-09-10T23:25:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122084 s, 85.9 MB/s 2024-09-10T23:25:42.498 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.498 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109541 s, 95.7 MB/s 2024-09-10T23:25:42.516 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.516 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.516 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136815 s, 76.6 MB/s 2024-09-10T23:25:42.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.532 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122248 s, 85.8 MB/s 2024-09-10T23:25:42.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.547 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116799 s, 89.8 MB/s 2024-09-10T23:25:42.563 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.563 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.563 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121613 s, 86.2 MB/s 2024-09-10T23:25:42.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.579 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117796 s, 89.0 MB/s 2024-09-10T23:25:42.594 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.594 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.594 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117673 s, 89.1 MB/s 2024-09-10T23:25:42.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:42.602 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:42.602 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:42.602 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T23:25:42.602 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:42.602 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:42.602 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:42.602 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:42.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:42.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.716 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127087 s, 82.5 MB/s 2024-09-10T23:25:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108555 s, 96.6 MB/s 2024-09-10T23:25:42.746 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.747 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.747 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123018 s, 85.2 MB/s 2024-09-10T23:25:42.762 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.762 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.762 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116806 s, 89.8 MB/s 2024-09-10T23:25:42.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.777 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106886 s, 98.1 MB/s 2024-09-10T23:25:42.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.793 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123127 s, 85.2 MB/s 2024-09-10T23:25:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133141 s, 78.8 MB/s 2024-09-10T23:25:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.825 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115679 s, 90.6 MB/s 2024-09-10T23:25:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111411 s, 94.1 MB/s 2024-09-10T23:25:42.855 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.855 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.855 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115636 s, 90.7 MB/s 2024-09-10T23:25:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.870 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112476 s, 93.2 MB/s 2024-09-10T23:25:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110584 s, 94.8 MB/s 2024-09-10T23:25:42.902 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.902 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.902 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135291 s, 77.5 MB/s 2024-09-10T23:25:42.919 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.919 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.919 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125946 s, 83.3 MB/s 2024-09-10T23:25:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118885 s, 88.2 MB/s 2024-09-10T23:25:42.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.951 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124229 s, 84.4 MB/s 2024-09-10T23:25:42.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.967 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127865 s, 82.0 MB/s 2024-09-10T23:25:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114612 s, 91.5 MB/s 2024-09-10T23:25:42.999 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:42.999 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:42.999 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012485 s, 84.0 MB/s 2024-09-10T23:25:43.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.016 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124654 s, 84.1 MB/s 2024-09-10T23:25:43.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120746 s, 86.8 MB/s 2024-09-10T23:25:43.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.047 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119974 s, 87.4 MB/s 2024-09-10T23:25:43.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119509 s, 87.7 MB/s 2024-09-10T23:25:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114728 s, 91.4 MB/s 2024-09-10T23:25:43.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124838 s, 84.0 MB/s 2024-09-10T23:25:43.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.109 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110304 s, 95.1 MB/s 2024-09-10T23:25:43.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122304 s, 85.7 MB/s 2024-09-10T23:25:43.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.140 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113132 s, 92.7 MB/s 2024-09-10T23:25:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119547 s, 87.7 MB/s 2024-09-10T23:25:43.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.172 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128224 s, 81.8 MB/s 2024-09-10T23:25:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119619 s, 87.7 MB/s 2024-09-10T23:25:43.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.204 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012088 s, 86.7 MB/s 2024-09-10T23:25:43.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:43.211 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:43.211 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:43.212 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T23:25:43.212 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:43.212 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:43.212 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:43.212 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:43.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125123 s, 83.8 MB/s 2024-09-10T23:25:43.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.299 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113558 s, 92.3 MB/s 2024-09-10T23:25:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117478 s, 89.3 MB/s 2024-09-10T23:25:43.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.330 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111093 s, 94.4 MB/s 2024-09-10T23:25:43.345 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.345 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.345 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114926 s, 91.2 MB/s 2024-09-10T23:25:43.360 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.360 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.360 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115032 s, 91.2 MB/s 2024-09-10T23:25:43.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.375 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114879 s, 91.3 MB/s 2024-09-10T23:25:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.390 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114507 s, 91.6 MB/s 2024-09-10T23:25:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012658 s, 82.8 MB/s 2024-09-10T23:25:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118909 s, 88.2 MB/s 2024-09-10T23:25:43.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.438 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121295 s, 86.4 MB/s 2024-09-10T23:25:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132109 s, 79.4 MB/s 2024-09-10T23:25:43.472 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.472 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.472 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125746 s, 83.4 MB/s 2024-09-10T23:25:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115836 s, 90.5 MB/s 2024-09-10T23:25:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119792 s, 87.5 MB/s 2024-09-10T23:25:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125067 s, 83.8 MB/s 2024-09-10T23:25:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123005 s, 85.2 MB/s 2024-09-10T23:25:43.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.552 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112241 s, 93.4 MB/s 2024-09-10T23:25:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115547 s, 90.7 MB/s 2024-09-10T23:25:43.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.582 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01176 s, 89.2 MB/s 2024-09-10T23:25:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.598 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118457 s, 88.5 MB/s 2024-09-10T23:25:43.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.614 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122155 s, 85.8 MB/s 2024-09-10T23:25:43.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.630 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122524 s, 85.6 MB/s 2024-09-10T23:25:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011836 s, 88.6 MB/s 2024-09-10T23:25:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128143 s, 81.8 MB/s 2024-09-10T23:25:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128152 s, 81.8 MB/s 2024-09-10T23:25:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120297 s, 87.2 MB/s 2024-09-10T23:25:43.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.724 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114962 s, 91.2 MB/s 2024-09-10T23:25:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.740 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121072 s, 86.6 MB/s 2024-09-10T23:25:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117105 s, 89.5 MB/s 2024-09-10T23:25:43.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.772 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120146 s, 87.3 MB/s 2024-09-10T23:25:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127997 s, 81.9 MB/s 2024-09-10T23:25:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:43.796 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:43.796 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:43.796 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T23:25:43.796 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:43.796 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:43.796 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:43.796 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:43.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:43.910 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.910 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.910 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119993 s, 87.4 MB/s 2024-09-10T23:25:43.926 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.926 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.926 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122138 s, 85.9 MB/s 2024-09-10T23:25:43.943 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.943 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.943 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130277 s, 80.5 MB/s 2024-09-10T23:25:43.960 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129624 s, 80.9 MB/s 2024-09-10T23:25:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118441 s, 88.5 MB/s 2024-09-10T23:25:43.991 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:43.991 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:43.991 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012481 s, 84.0 MB/s 2024-09-10T23:25:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125211 s, 83.7 MB/s 2024-09-10T23:25:44.023 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121053 s, 86.6 MB/s 2024-09-10T23:25:44.039 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.039 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.039 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112863 s, 92.9 MB/s 2024-09-10T23:25:44.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.054 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116293 s, 90.2 MB/s 2024-09-10T23:25:44.070 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.070 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.070 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121742 s, 86.1 MB/s 2024-09-10T23:25:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119893 s, 87.5 MB/s 2024-09-10T23:25:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113889 s, 92.1 MB/s 2024-09-10T23:25:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011073 s, 94.7 MB/s 2024-09-10T23:25:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012489 s, 84.0 MB/s 2024-09-10T23:25:44.147 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.147 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.147 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010962 s, 95.7 MB/s 2024-09-10T23:25:44.162 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.162 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.162 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111904 s, 93.7 MB/s 2024-09-10T23:25:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128336 s, 81.7 MB/s 2024-09-10T23:25:44.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.195 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115004 s, 91.2 MB/s 2024-09-10T23:25:44.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.210 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113494 s, 92.4 MB/s 2024-09-10T23:25:44.226 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.226 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.226 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121198 s, 86.5 MB/s 2024-09-10T23:25:44.242 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.243 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123303 s, 85.0 MB/s 2024-09-10T23:25:44.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.258 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118976 s, 88.1 MB/s 2024-09-10T23:25:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.274 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112919 s, 92.9 MB/s 2024-09-10T23:25:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115624 s, 90.7 MB/s 2024-09-10T23:25:44.305 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.305 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.305 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113697 s, 92.2 MB/s 2024-09-10T23:25:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120079 s, 87.3 MB/s 2024-09-10T23:25:44.337 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.337 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.337 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114253 s, 91.8 MB/s 2024-09-10T23:25:44.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.352 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120572 s, 87.0 MB/s 2024-09-10T23:25:44.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.368 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119191 s, 88.0 MB/s 2024-09-10T23:25:44.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.383 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113159 s, 92.7 MB/s 2024-09-10T23:25:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127055 s, 82.5 MB/s 2024-09-10T23:25:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:44.408 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:25:44.408 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:25:44.408 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T23:25:44.408 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:25:44.408 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:25:44.408 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:25:44.408 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:25:44.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:25:44.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.547 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122773 s, 85.4 MB/s 2024-09-10T23:25:44.564 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.564 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.564 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012272 s, 85.4 MB/s 2024-09-10T23:25:44.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.581 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127895 s, 82.0 MB/s 2024-09-10T23:25:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114863 s, 91.3 MB/s 2024-09-10T23:25:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121704 s, 86.2 MB/s 2024-09-10T23:25:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124906 s, 83.9 MB/s 2024-09-10T23:25:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011759 s, 89.2 MB/s 2024-09-10T23:25:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123271 s, 85.1 MB/s 2024-09-10T23:25:44.697 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.697 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.697 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131329 s, 79.8 MB/s 2024-09-10T23:25:44.713 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.713 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.713 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125089 s, 83.8 MB/s 2024-09-10T23:25:44.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.729 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118008 s, 88.9 MB/s 2024-09-10T23:25:44.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.745 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129886 s, 80.7 MB/s 2024-09-10T23:25:44.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.761 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117765 s, 89.0 MB/s 2024-09-10T23:25:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123402 s, 85.0 MB/s 2024-09-10T23:25:44.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.793 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112468 s, 93.2 MB/s 2024-09-10T23:25:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.808 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113195 s, 92.6 MB/s 2024-09-10T23:25:44.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.823 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109911 s, 95.4 MB/s 2024-09-10T23:25:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121787 s, 86.1 MB/s 2024-09-10T23:25:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118932 s, 88.2 MB/s 2024-09-10T23:25:44.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.873 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145778 s, 71.9 MB/s 2024-09-10T23:25:44.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.889 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126469 s, 82.9 MB/s 2024-09-10T23:25:44.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.905 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120421 s, 87.1 MB/s 2024-09-10T23:25:44.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121232 s, 86.5 MB/s 2024-09-10T23:25:44.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.938 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130065 s, 80.6 MB/s 2024-09-10T23:25:44.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123156 s, 85.1 MB/s 2024-09-10T23:25:44.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117473 s, 89.3 MB/s 2024-09-10T23:25:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108586 s, 96.6 MB/s 2024-09-10T23:25:45.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:45.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:45.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114753 s, 91.4 MB/s 2024-09-10T23:25:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115556 s, 90.7 MB/s 2024-09-10T23:25:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:45.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115587 s, 90.7 MB/s 2024-09-10T23:25:45.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:45.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:45.047 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114645 s, 91.5 MB/s 2024-09-10T23:25:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:25:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:25:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121175 s, 86.5 MB/s 2024-09-10T23:25:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:25:45.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:45.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-09-10T23:25:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 -- 172.21.15.17:0/2502088546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff9c0cec60 msgr2=0x7eff9c0aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 --2- 172.21.15.17:0/2502088546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff9c0cec60 0x7eff9c0aef60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7eff94009bc0 tx=0x7eff9401cba0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 -- 172.21.15.17:0/2502088546 shutdown_connections 2024-09-10T23:25:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 --2- 172.21.15.17:0/2502088546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff9c0cec60 0x7eff9c0aef60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 --2- 172.21.15.17:0/2502088546 >> v2:172.21.15.77:3300/0 conn(0x7eff9c15f1c0 0x7eff9c0d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 -- 172.21.15.17:0/2502088546 >> 172.21.15.17:0/2502088546 conn(0x7eff9c09b040 msgr2=0x7eff9c0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 -- 172.21.15.17:0/2502088546 shutdown_connections 2024-09-10T23:25:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 -- 172.21.15.17:0/2502088546 wait complete. 2024-09-10T23:25:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 Processor -- start 2024-09-10T23:25:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 -- start start 2024-09-10T23:25:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c0cec60 0x7eff9c157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff9c15f1c0 0x7eff9c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff9c15f5a0 0x7eff9c1f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c168e40 con 0x7eff9c0cec60 2024-09-10T23:25:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c168cc0 con 0x7eff9c15f5a0 2024-09-10T23:25:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa3c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff9c168fc0 con 0x7eff9c15f1c0 2024-09-10T23:25:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c0cec60 0x7eff9c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c0cec60 0x7eff9c157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38424/0 (socket says 172.21.15.17:38424) 2024-09-10T23:25:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.218+0000 7effa1200640 1 -- 172.21.15.17:0/821106933 learned_addr learned my addr 172.21.15.17:0/821106933 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7eff93e00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff9c15f1c0 0x7eff9c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7effa1c00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff9c15f5a0 0x7eff9c1f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7effa1200640 1 -- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff9c15f1c0 msgr2=0x7eff9c151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7effa1200640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff9c15f1c0 0x7eff9c151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7effa1200640 1 -- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff9c15f5a0 msgr2=0x7eff9c1f96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7effa1200640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff9c15f5a0 0x7eff9c1f96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7effa1200640 1 -- 172.21.15.17:0/821106933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c1f9bf0 con 0x7eff9c0cec60 2024-09-10T23:25:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7effa1200640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c0cec60 0x7eff9c157700 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00ea40 tx=0x7eff8c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7eff99600640 1 -- 172.21.15.17:0/821106933 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00ce40 con 0x7eff9c0cec60 2024-09-10T23:25:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7eff99600640 1 -- 172.21.15.17:0/821106933 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff8c004020 con 0x7eff9c0cec60 2024-09-10T23:25:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7eff99600640 1 -- 172.21.15.17:0/821106933 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c004470 con 0x7eff9c0cec60 2024-09-10T23:25:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7effa3c00640 1 -- 172.21.15.17:0/821106933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9c157ce0 con 0x7eff9c0cec60 2024-09-10T23:25:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7effa3c00640 1 -- 172.21.15.17:0/821106933 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9c1f5ba0 con 0x7eff9c0cec60 2024-09-10T23:25:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.222+0000 7eff99600640 1 -- 172.21.15.17:0/821106933 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7eff8c003600 con 0x7eff9c0cec60 2024-09-10T23:25:45.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 Processor -- start 2024-09-10T23:25:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff99600640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff780725e0 0x7eff78074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff99600640 1 -- 172.21.15.17:0/821106933 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7eff8c093e40 con 0x7eff9c0cec60 2024-09-10T23:25:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 -- start start 2024-09-10T23:25:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa1c00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff780725e0 0x7eff78074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa1c00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff780725e0 0x7eff78074aa0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7eff940af000 tx=0x7eff9401b3e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 0x5609f4485450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485990 0x5609f4432c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 0x5609f4433560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5609f428e8f0 con 0x5609f4485990 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5609f427dd20 con 0x5609f4485070 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5609f4281b30 con 0x5609f4433180 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485990 0x5609f4432c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485990 0x5609f4432c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38434/0 (socket says 172.21.15.17:38434) 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff93e00640 1 -- 172.21.15.17:0/2566368 learned_addr learned my addr 172.21.15.17:0/2566368 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa1200640 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 0x5609f4485450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa1c00640 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 0x5609f4433560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff93e00640 1 -- 172.21.15.17:0/2566368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 msgr2=0x5609f4433560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff93e00640 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 0x5609f4433560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff93e00640 1 -- 172.21.15.17:0/2566368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 msgr2=0x5609f4485450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff93e00640 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 0x5609f4485450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff93e00640 1 -- 172.21.15.17:0/2566368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609f421c2c0 con 0x5609f4485990 2024-09-10T23:25:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa1200640 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 0x5609f4485450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff93e00640 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485990 0x5609f4432c40 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7eff84007a60 tx=0x7eff840019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d810b37700ad3384 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff91600640 1 -- 172.21.15.17:0/2566368 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff840011e0 con 0x5609f4485990 2024-09-10T23:25:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff91600640 1 -- 172.21.15.17:0/2566368 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff84005110 con 0x5609f4485990 2024-09-10T23:25:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7eff91600640 1 -- 172.21.15.17:0/2566368 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84005360 con 0x5609f4485990 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 -- 172.21.15.17:0/2566368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485990 msgr2=0x5609f4432c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485990 0x5609f4432c40 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7eff84007a60 tx=0x7eff840019d0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 -- 172.21.15.17:0/2566368 shutdown_connections 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 0x5609f4433560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485990 0x5609f4432c40 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.226+0000 7effa7052000 1 --2- 172.21.15.17:0/2566368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 0x5609f4485450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 -- 172.21.15.17:0/2566368 >> 172.21.15.17:0/2566368 conn(0x5609f44392e0 msgr2=0x5609f4431520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 -- 172.21.15.17:0/2566368 shutdown_connections 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 -- 172.21.15.17:0/2566368 wait complete. 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 -- start start 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 Processor -- start 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4433180 0x5609f448c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485070 0x5609f448c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485990 0x5609f448ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5609f4227cf0 con 0x5609f4485070 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5609f42292c0 con 0x5609f4433180 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5609f428d6c0 con 0x5609f4485990 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 10 client.0 _ll_register_callbacks cb 0x5609f441e770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485070 0x5609f448c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485070 0x5609f448c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38448/0 (socket says 172.21.15.17:38448) 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff93e00640 1 -- 172.21.15.17:0/3358461921 learned_addr learned my addr 172.21.15.17:0/3358461921 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa1200640 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4433180 0x5609f448c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa1c00640 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485990 0x5609f448ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff93e00640 1 -- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485990 msgr2=0x5609f448ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff93e00640 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485990 0x5609f448ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff93e00640 1 -- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4433180 msgr2=0x5609f448c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff93e00640 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4433180 0x5609f448c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff93e00640 1 -- 172.21.15.17:0/3358461921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609f423b230 con 0x5609f4485070 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa1200640 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4433180 0x5609f448c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff93e00640 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485070 0x5609f448c940 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7eff84009010 tx=0x7eff84005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1b0a32220c9cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff8a000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff8a000640 1 -- 172.21.15.17:0/3358461921 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84024070 con 0x5609f4485070 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff8a000640 1 -- 172.21.15.17:0/3358461921 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7eff84010040 con 0x5609f4485070 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 -- 172.21.15.17:0/3358461921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5609f4216400 con 0x5609f4485070 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff8a000640 1 -- 172.21.15.17:0/3358461921 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7eff8402f050 con 0x5609f4485070 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 10 client.8826 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7effa7052000 1 -- 172.21.15.17:0/3358461921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x5609f4203010 con 0x5609f4485070 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff8a000640 1 -- 172.21.15.17:0/3358461921 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5609f4216400 con 0x5609f4485070 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.230+0000 7eff8a000640 1 -- 172.21.15.17:0/3358461921 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7eff84032020 con 0x5609f4485070 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 10 client.8826 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:45.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 10 client.8826 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 20 client.8826 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5609f44947d0 0x5609f4496bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 4 client.8826 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 -- 172.21.15.17:0/3358461921 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609f4290840 con 0x5609f44947d0 2024-09-10T23:25:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa1200640 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5609f44947d0 0x5609f4496bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa1200640 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5609f44947d0 0x5609f4496bc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2385dc6fc483474 server_cookie=703148e9a692589 in_seq=0 out_seq=0 2024-09-10T23:25:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7eff8a000640 10 client.8826 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7eff8a000640 1 -- 172.21.15.17:0/3358461921 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609f4290840 con 0x5609f44947d0 2024-09-10T23:25:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7eff8a000640 10 client.8826 handle_command_reply: tid=0 2024-09-10T23:25:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 client.8826 shutdown 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 -- 172.21.15.17:0/3358461921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485070 msgr2=0x5609f448c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485070 0x5609f448c940 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7eff84009010 tx=0x7eff84005530 comp rx=0 tx=0).stop 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 -- 172.21.15.17:0/3358461921 shutdown_connections 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5609f44947d0 0x5609f4496bc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485990 0x5609f448ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4485070 0x5609f448c940 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 --2- 172.21.15.17:0/3358461921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4433180 0x5609f448c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7eff8a000640 0 client.8826 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 -- 172.21.15.17:0/3358461921 >> 172.21.15.17:0/3358461921 conn(0x5609f44392e0 msgr2=0x5609f4431520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 -- 172.21.15.17:0/3358461921 shutdown_connections 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 1 -- 172.21.15.17:0/3358461921 wait complete. 2024-09-10T23:25:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.234+0000 7effa7052000 20 client.8826 trim_cache size 0 max 16384 2024-09-10T23:25:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 Processor -- start 2024-09-10T23:25:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 -- start start 2024-09-10T23:25:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f44392e0 0x5609f4434490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4433180 0x5609f44349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485070 0x5609f4492660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c06f550 con 0x5609f4433180 2024-09-10T23:25:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c1566b0 con 0x5609f44392e0 2024-09-10T23:25:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff9c06eee0 con 0x5609f4485070 2024-09-10T23:25:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4433180 0x5609f44349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4433180 0x5609f44349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38452/0 (socket says 172.21.15.17:38452) 2024-09-10T23:25:45.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff93e00640 1 -- 172.21.15.17:0/1353213763 learned_addr learned my addr 172.21.15.17:0/1353213763 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa1200640 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f44392e0 0x5609f4434490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa1c00640 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485070 0x5609f4492660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff93e00640 1 -- 172.21.15.17:0/1353213763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485070 msgr2=0x5609f4492660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff93e00640 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485070 0x5609f4492660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff93e00640 1 -- 172.21.15.17:0/1353213763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f44392e0 msgr2=0x5609f4434490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff93e00640 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f44392e0 0x5609f4434490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff93e00640 1 -- 172.21.15.17:0/1353213763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609f42da320 con 0x5609f4433180 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa1c00640 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485070 0x5609f4492660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff93e00640 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4433180 0x5609f44349d0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7eff8400e160 tx=0x7eff840019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7811ce51d1bb5d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff90c00640 1 -- 172.21.15.17:0/1353213763 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84024070 con 0x5609f4433180 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff90c00640 1 -- 172.21.15.17:0/1353213763 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff8400e8b0 con 0x5609f4433180 2024-09-10T23:25:45.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7eff90c00640 1 -- 172.21.15.17:0/1353213763 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84014480 con 0x5609f4433180 2024-09-10T23:25:45.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 -- 172.21.15.17:0/1353213763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4433180 msgr2=0x5609f44349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4433180 0x5609f44349d0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7eff8400e160 tx=0x7eff840019d0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 -- 172.21.15.17:0/1353213763 shutdown_connections 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4485070 0x5609f4492660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f4433180 0x5609f44349d0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 --2- 172.21.15.17:0/1353213763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f44392e0 0x5609f4434490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 -- 172.21.15.17:0/1353213763 >> 172.21.15.17:0/1353213763 conn(0x5609f442f830 msgr2=0x5609f4433d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 -- 172.21.15.17:0/1353213763 shutdown_connections 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.254+0000 7effa7052000 1 -- 172.21.15.17:0/1353213763 wait complete. 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 -- start start 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 Processor -- start 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 0x5609f4491980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f44392e0 0x5609f4491ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 0x5609f44b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5609f4280e40 con 0x5609f44392e0 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5609f423d830 con 0x5609f4485070 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5609f4286160 con 0x5609f4433180 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 10 client.0 _ll_register_callbacks cb 0x7eff8c0046d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f44392e0 0x5609f4491ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa1200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 0x5609f4491980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f44392e0 0x5609f4491ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38468/0 (socket says 172.21.15.17:38468) 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff93e00640 1 -- 172.21.15.17:0/4035460419 learned_addr learned my addr 172.21.15.17:0/4035460419 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa1c00640 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 0x5609f44b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff93e00640 1 -- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 msgr2=0x5609f4491980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff93e00640 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 0x5609f4491980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff93e00640 1 -- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 msgr2=0x5609f44b90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff93e00640 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 0x5609f44b90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff93e00640 1 -- 172.21.15.17:0/4035460419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609f4246d60 con 0x5609f44392e0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff93e00640 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f44392e0 0x5609f4491ec0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7eff8400e1e0 tx=0x7eff84006ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e27a3158011c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff8a000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff8a000640 1 -- 172.21.15.17:0/4035460419 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84024040 con 0x5609f44392e0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff8a000640 1 -- 172.21.15.17:0/4035460419 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7eff84014690 con 0x5609f44392e0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 -- 172.21.15.17:0/4035460419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff8400e8b0 con 0x5609f44392e0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff8a000640 1 -- 172.21.15.17:0/4035460419 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7eff84014890 con 0x5609f44392e0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 10 client.8832 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 -- 172.21.15.17:0/4035460419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x5609f3f341a0 con 0x5609f44392e0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff8a000640 1 -- 172.21.15.17:0/4035460419 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff8400e8b0 con 0x5609f44392e0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff8a000640 1 -- 172.21.15.17:0/4035460419 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7eff84043020 con 0x5609f44392e0 2024-09-10T23:25:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 10 client.8832 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:45.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 10 client.8832 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:45.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 20 client.8832 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:45.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5609f4485990 0x5609f44b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 4 client.8832 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T23:25:45.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa7052000 1 -- 172.21.15.17:0/4035460419 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5609f449cee0 con 0x5609f4485990 2024-09-10T23:25:45.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa1200640 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5609f4485990 0x5609f44b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7effa1200640 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5609f4485990 0x5609f44b9a80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88a51aab7c61cfc8 server_cookie=daf1e07b0fcd45a0 in_seq=0 out_seq=0 2024-09-10T23:25:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.258+0000 7eff8a000640 10 client.8832 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7eff8a000640 1 -- 172.21.15.17:0/4035460419 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5609f449cee0 con 0x5609f4485990 2024-09-10T23:25:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7eff8a000640 10 client.8832 handle_command_reply: tid=0 2024-09-10T23:25:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 client.8832 shutdown 2024-09-10T23:25:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 -- 172.21.15.17:0/4035460419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f44392e0 msgr2=0x5609f4491ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f44392e0 0x5609f4491ec0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7eff8400e1e0 tx=0x7eff84006ad0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 -- 172.21.15.17:0/4035460419 shutdown_connections 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5609f4485990 0x5609f44b9a80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5609f4485070 0x5609f44b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609f44392e0 0x5609f4491ec0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7eff8a000640 0 client.8832 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 --2- 172.21.15.17:0/4035460419 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5609f4433180 0x5609f4491980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 -- 172.21.15.17:0/4035460419 >> 172.21.15.17:0/4035460419 conn(0x5609f442f830 msgr2=0x5609f4434490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 -- 172.21.15.17:0/4035460419 shutdown_connections 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 1 -- 172.21.15.17:0/4035460419 wait complete. 2024-09-10T23:25:45.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa7052000 20 client.8832 trim_cache size 0 max 16384 2024-09-10T23:25:45.269 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:25:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:25:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "4273064a-bc50-407f-8592-08b4130dcbe9", 2024-09-10T23:25:45.269 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:25:45.269 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:25:45.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 -- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff780725e0 msgr2=0x7eff78074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff780725e0 0x7eff78074aa0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7eff940af000 tx=0x7eff9401b3e0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 -- 172.21.15.17:0/821106933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c0cec60 msgr2=0x7eff9c157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c0cec60 0x7eff9c157700 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00ea40 tx=0x7eff8c00ef00 comp rx=0 tx=0).stop 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 -- 172.21.15.17:0/821106933 shutdown_connections 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff780725e0 0x7eff78074aa0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff9c15f5a0 0x7eff9c1f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff9c15f1c0 0x7eff9c151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 --2- 172.21.15.17:0/821106933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff9c0cec60 0x7eff9c157700 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 -- 172.21.15.17:0/821106933 >> 172.21.15.17:0/821106933 conn(0x7eff9c09b040 msgr2=0x7eff9c0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 -- 172.21.15.17:0/821106933 shutdown_connections 2024-09-10T23:25:45.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.262+0000 7effa3c00640 1 -- 172.21.15.17:0/821106933 wait complete. 2024-09-10T23:25:45.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:45.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-09-10T23:25:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 -- 172.21.15.17:0/799342875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c0d2260 msgr2=0x7f8c1c0b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 --2- 172.21.15.17:0/799342875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c0d2260 0x7f8c1c0b50e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0d1570 tx=0x7f8c0c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 -- 172.21.15.17:0/799342875 shutdown_connections 2024-09-10T23:25:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 --2- 172.21.15.17:0/799342875 >> v2:172.21.15.77:3300/0 conn(0x7f8c1c0d2640 0x7f8c1c0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 --2- 172.21.15.17:0/799342875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c0d2260 0x7f8c1c0b50e0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 -- 172.21.15.17:0/799342875 >> 172.21.15.17:0/799342875 conn(0x7f8c1c09d0f0 msgr2=0x7f8c1c0d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 -- 172.21.15.17:0/799342875 shutdown_connections 2024-09-10T23:25:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 -- 172.21.15.17:0/799342875 wait complete. 2024-09-10T23:25:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 Processor -- start 2024-09-10T23:25:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 -- start start 2024-09-10T23:25:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c1c0d2260 0x7f8c1c0c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c1c0d2640 0x7f8c1c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c0d46d0 0x7f8c1c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c0b2a10 con 0x7f8c1c0d46d0 2024-09-10T23:25:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c0b2890 con 0x7f8c1c0d2260 2024-09-10T23:25:45.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c0b2b90 con 0x7f8c1c0d2640 2024-09-10T23:25:45.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c0d46d0 0x7f8c1c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c0d46d0 0x7f8c1c0c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38490/0 (socket says 172.21.15.17:38490) 2024-09-10T23:25:45.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c1a800640 1 -- 172.21.15.17:0/3979445801 learned_addr learned my addr 172.21.15.17:0/3979445801 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c19e00640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c1c0d2260 0x7f8c1c0c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.466+0000 7f8c19400640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c1c0d2640 0x7f8c1c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c19e00640 1 -- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c1c0d2640 msgr2=0x7f8c1c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c19e00640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c1c0d2640 0x7f8c1c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c19e00640 1 -- 172.21.15.17:0/3979445801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c0d46d0 msgr2=0x7f8c1c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c19e00640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c0d46d0 0x7f8c1c0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c19e00640 1 -- 172.21.15.17:0/3979445801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c158800 con 0x7f8c1c0d2260 2024-09-10T23:25:45.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c19e00640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c1c0d2260 0x7f8c1c0c78e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0752b0 tx=0x7f8c0c005e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c12000640 1 -- 172.21.15.17:0/3979445801 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0b2040 con 0x7f8c1c0d2260 2024-09-10T23:25:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c12000640 1 -- 172.21.15.17:0/3979445801 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c0c0a5c70 con 0x7f8c1c0d2260 2024-09-10T23:25:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c12000640 1 -- 172.21.15.17:0/3979445801 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c0a5e60 con 0x7f8c1c0d2260 2024-09-10T23:25:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c1b200640 1 -- 172.21.15.17:0/3979445801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c0caf20 con 0x7f8c1c0d2260 2024-09-10T23:25:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.470+0000 7f8c1b200640 1 -- 172.21.15.17:0/3979445801 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c0c7fe0 con 0x7f8c1c0d2260 2024-09-10T23:25:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c12000640 1 -- 172.21.15.17:0/3979445801 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8c0c005290 con 0x7f8c1c0d2260 2024-09-10T23:25:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c23e65000 1 Processor -- start 2024-09-10T23:25:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c23e65000 1 -- start start 2024-09-10T23:25:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c12000640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bf80725e0 0x7f8bf8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c12000640 1 -- 172.21.15.17:0/3979445801 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f8c0c12cd60 con 0x7f8c1c0d2260 2024-09-10T23:25:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c1a800640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bf80725e0 0x7f8bf8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165de421d0 0x56165dfa3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165dfa43d0 0x56165dfa47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df5a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c23e65000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56165dd582c0 con 0x56165df5a5a0 2024-09-10T23:25:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c23e65000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56165ddb5b90 con 0x56165de421d0 2024-09-10T23:25:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c23e65000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56165dda4fc0 con 0x56165dfa43d0 2024-09-10T23:25:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c19e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165de421d0 0x56165dfa3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c1a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df5a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c19e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165de421d0 0x56165dfa3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:53162/0 (socket says 172.21.15.17:53162) 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c19e00640 1 -- 172.21.15.17:0/3422446520 learned_addr learned my addr 172.21.15.17:0/3422446520 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c19400640 1 --2- 172.21.15.17:0/3422446520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165dfa43d0 0x56165dfa47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c1a800640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bf80725e0 0x7f8bf8074aa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009980 tx=0x7f8c14009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c1a800640 1 -- 172.21.15.17:0/3422446520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165dfa43d0 msgr2=0x56165dfa47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c1a800640 1 --2- 172.21.15.17:0/3422446520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165dfa43d0 0x56165dfa47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c1a800640 1 -- 172.21.15.17:0/3422446520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165de421d0 msgr2=0x56165dfa3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c1a800640 1 --2- 172.21.15.17:0/3422446520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165de421d0 0x56165dfa3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c1a800640 1 -- 172.21.15.17:0/3422446520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165dd431a0 con 0x56165df5a5a0 2024-09-10T23:25:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.474+0000 7f8c19e00640 1 --2- 172.21.15.17:0/3422446520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165de421d0 0x56165dfa3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c1a800640 1 --2- 172.21.15.17:0/3422446520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df5a980 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400f5c0 tx=0x7f8c14014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9cf4ffeac0a2b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c0aa00640 1 -- 172.21.15.17:0/3422446520 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1401c6d0 con 0x56165df5a5a0 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c0aa00640 1 -- 172.21.15.17:0/3422446520 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c1401c960 con 0x56165df5a5a0 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c0aa00640 1 -- 172.21.15.17:0/3422446520 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1401cdb0 con 0x56165df5a5a0 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 -- 172.21.15.17:0/3422446520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 msgr2=0x56165df5a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 --2- 172.21.15.17:0/3422446520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df5a980 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400f5c0 tx=0x7f8c14014000 comp rx=0 tx=0).stop 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 -- 172.21.15.17:0/3422446520 shutdown_connections 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 --2- 172.21.15.17:0/3422446520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df5a980 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 --2- 172.21.15.17:0/3422446520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165dfa43d0 0x56165dfa47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 --2- 172.21.15.17:0/3422446520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165de421d0 0x56165dfa3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 -- 172.21.15.17:0/3422446520 >> 172.21.15.17:0/3422446520 conn(0x56165da63880 msgr2=0x56165df58e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 -- 172.21.15.17:0/3422446520 shutdown_connections 2024-09-10T23:25:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 -- 172.21.15.17:0/3422446520 wait complete. 2024-09-10T23:25:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 -- start start 2024-09-10T23:25:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 Processor -- start 2024-09-10T23:25:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 0x56165dfaaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165dfaaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165dfab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56165dd4a4d0 con 0x56165df5a5a0 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56165dda8dd0 con 0x56165dfa43d0 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56165da6a620 con 0x56165de421d0 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c23e65000 10 client.0 _ll_register_callbacks cb 0x56165dd7bcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c19400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165dfaaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c19e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 0x56165dfaaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c1a800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165dfab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c19400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165dfaaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38508/0 (socket says 172.21.15.17:38508) 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.478+0000 7f8c19400640 1 -- 172.21.15.17:0/2701718058 learned_addr learned my addr 172.21.15.17:0/2701718058 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c19400640 1 -- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 msgr2=0x56165dfaaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c19400640 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 0x56165dfaaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c19400640 1 -- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 msgr2=0x56165dfab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c19400640 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165dfab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c19400640 1 -- 172.21.15.17:0/2701718058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56165de74720 con 0x56165df5a5a0 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c19400640 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165dfaaf60 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f8c040122c0 tx=0x7f8c04012780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a431d814f80dd0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8bff400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8bff400640 1 -- 172.21.15.17:0/2701718058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04019020 con 0x56165df5a5a0 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8bff400640 1 -- 172.21.15.17:0/2701718058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f8c040053a0 con 0x56165df5a5a0 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c23e65000 1 -- 172.21.15.17:0/2701718058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56165dd3d2e0 con 0x56165df5a5a0 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8bff400640 1 -- 172.21.15.17:0/2701718058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f8c04023050 con 0x56165df5a5a0 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c23e65000 10 client.8847 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:45.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c23e65000 1 -- 172.21.15.17:0/2701718058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x56165de2a420 con 0x56165df5a5a0 2024-09-10T23:25:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8bff400640 1 -- 172.21.15.17:0/2701718058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56165dd3d2e0 con 0x56165df5a5a0 2024-09-10T23:25:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8bff400640 1 -- 172.21.15.17:0/2701718058 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f8c04026020 con 0x56165df5a5a0 2024-09-10T23:25:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c23e65000 10 client.8847 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:45.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c23e65000 10 client.8847 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c23e65000 20 client.8847 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c23e65000 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x56165dfb2df0 0x56165dfb51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c23e65000 4 client.8847 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c23e65000 1 -- 172.21.15.17:0/2701718058 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56165ddb7ae0 con 0x56165dfb2df0 2024-09-10T23:25:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c19e00640 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x56165dfb2df0 0x56165dfb51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8c19e00640 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x56165dfb2df0 0x56165dfb51e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd9a95e9e968e351 server_cookie=9040b4994f212062 in_seq=0 out_seq=0 2024-09-10T23:25:45.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.482+0000 7f8bff400640 10 client.8847 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8bff400640 1 -- 172.21.15.17:0/2701718058 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56165ddb7ae0 con 0x56165dfb2df0 2024-09-10T23:25:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8bff400640 10 client.8847 handle_command_reply: tid=0 2024-09-10T23:25:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 client.8847 shutdown 2024-09-10T23:25:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 -- 172.21.15.17:0/2701718058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 msgr2=0x56165dfaaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165dfaaf60 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f8c040122c0 tx=0x7f8c04012780 comp rx=0 tx=0).stop 2024-09-10T23:25:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 -- 172.21.15.17:0/2701718058 shutdown_connections 2024-09-10T23:25:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x56165dfb2df0 0x56165dfb51e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165dfab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165dfaaf60 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 --2- 172.21.15.17:0/2701718058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 0x56165dfaaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8bff400640 0 client.8847 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 -- 172.21.15.17:0/2701718058 >> 172.21.15.17:0/2701718058 conn(0x56165da63880 msgr2=0x56165df59590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 -- 172.21.15.17:0/2701718058 shutdown_connections 2024-09-10T23:25:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 1 -- 172.21.15.17:0/2701718058 wait complete. 2024-09-10T23:25:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.486+0000 7f8c23e65000 20 client.8847 trim_cache size 0 max 16384 2024-09-10T23:25:45.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c23e65000 1 Processor -- start 2024-09-10T23:25:45.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c23e65000 1 -- start start 2024-09-10T23:25:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 0x56165df58660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df58ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165df590e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c23e65000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c204150 con 0x56165df5a5a0 2024-09-10T23:25:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c23e65000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c2031d0 con 0x56165dfa43d0 2024-09-10T23:25:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c23e65000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c0cc750 con 0x56165de421d0 2024-09-10T23:25:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c19400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df58ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c19400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df58ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38524/0 (socket says 172.21.15.17:38524) 2024-09-10T23:25:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c19400640 1 -- 172.21.15.17:0/3544178862 learned_addr learned my addr 172.21.15.17:0/3544178862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c1a800640 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165df590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c19e00640 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 0x56165df58660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c19400640 1 -- 172.21.15.17:0/3544178862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 msgr2=0x56165df58660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c19400640 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 0x56165df58660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c19400640 1 -- 172.21.15.17:0/3544178862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 msgr2=0x56165df590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c19400640 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165df590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c19400640 1 -- 172.21.15.17:0/3544178862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56165de01ae0 con 0x56165df5a5a0 2024-09-10T23:25:45.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.510+0000 7f8c1a800640 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165df590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c19400640 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df58ba0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f8c04007f10 tx=0x7f8c04001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e544e01484cb52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c0a000640 1 -- 172.21.15.17:0/3544178862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04019070 con 0x56165df5a5a0 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c0a000640 1 -- 172.21.15.17:0/3544178862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c04012c80 con 0x56165df5a5a0 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c0a000640 1 -- 172.21.15.17:0/3544178862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c04003cc0 con 0x56165df5a5a0 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 -- 172.21.15.17:0/3544178862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 msgr2=0x56165df58ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df58ba0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f8c04007f10 tx=0x7f8c04001b30 comp rx=0 tx=0).stop 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 -- 172.21.15.17:0/3544178862 shutdown_connections 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165df590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165df5a5a0 0x56165df58ba0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 --2- 172.21.15.17:0/3544178862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165de421d0 0x56165df58660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 -- 172.21.15.17:0/3544178862 >> 172.21.15.17:0/3544178862 conn(0x56165da63880 msgr2=0x56165df5f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 -- 172.21.15.17:0/3544178862 shutdown_connections 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 -- 172.21.15.17:0/3544178862 wait complete. 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 -- start start 2024-09-10T23:25:45.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 Processor -- start 2024-09-10T23:25:45.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165de421d0 0x56165e01a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165df5a5a0 0x56165e01aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165e01b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56165df5cc40 con 0x56165de421d0 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56165dd6b2c0 con 0x56165dfa43d0 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56165dd70c50 con 0x56165df5a5a0 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c23e65000 10 client.0 _ll_register_callbacks cb 0x7f8c04001380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c19e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165de421d0 0x56165e01a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c19e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165de421d0 0x56165e01a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38536/0 (socket says 172.21.15.17:38536) 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c19e00640 1 -- 172.21.15.17:0/1966912308 learned_addr learned my addr 172.21.15.17:0/1966912308 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c19400640 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165df5a5a0 0x56165e01aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.514+0000 7f8c1a800640 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165e01b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c19e00640 1 -- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165df5a5a0 msgr2=0x56165e01aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c19e00640 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165df5a5a0 0x56165e01aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c19e00640 1 -- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 msgr2=0x56165e01b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c19e00640 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165e01b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c19e00640 1 -- 172.21.15.17:0/1966912308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56165dd6f040 con 0x56165de421d0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c19e00640 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165de421d0 0x56165e01a580 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c01cda0 tx=0x7f8c0c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b2057d0846e2d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8bff400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8bff400640 1 -- 172.21.15.17:0/1966912308 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c11b040 con 0x56165de421d0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8bff400640 1 -- 172.21.15.17:0/1966912308 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f8c0c12b1e0 con 0x56165de421d0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c23e65000 1 -- 172.21.15.17:0/1966912308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c04012c80 con 0x56165de421d0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8bff400640 1 -- 172.21.15.17:0/1966912308 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f8c0c0bd040 con 0x56165de421d0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c23e65000 10 client.8853 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c23e65000 1 -- 172.21.15.17:0/1966912308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x56165dd3b620 con 0x56165de421d0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8bff400640 1 -- 172.21.15.17:0/1966912308 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c04012c80 con 0x56165de421d0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8bff400640 1 -- 172.21.15.17:0/1966912308 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f8c0c0f3f60 con 0x56165de421d0 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c23e65000 10 client.8853 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:45.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c23e65000 10 client.8853 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:45.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c23e65000 20 client.8853 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:45.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c23e65000 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x56165dfb01a0 0x56165dfb05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c23e65000 4 client.8853 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T23:25:45.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c23e65000 1 -- 172.21.15.17:0/1966912308 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x56165dfbb500 con 0x56165dfb01a0 2024-09-10T23:25:45.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c19400640 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x56165dfb01a0 0x56165dfb05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8c19400640 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x56165dfb01a0 0x56165dfb05b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db3a2fb5253f1c54 server_cookie=696d1bd64eca423e in_seq=0 out_seq=0 2024-09-10T23:25:45.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.518+0000 7f8bff400640 10 client.8853 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8bff400640 1 -- 172.21.15.17:0/1966912308 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56165dfbb500 con 0x56165dfb01a0 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8bff400640 10 client.8853 handle_command_reply: tid=0 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8c23e65000 1 client.8853 shutdown 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8c23e65000 1 -- 172.21.15.17:0/1966912308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165de421d0 msgr2=0x56165e01a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8c23e65000 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165de421d0 0x56165e01a580 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c01cda0 tx=0x7f8c0c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8c23e65000 1 -- 172.21.15.17:0/1966912308 shutdown_connections 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8c23e65000 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x56165dfb01a0 0x56165dfb05b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8c23e65000 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56165dfa43d0 0x56165e01b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8c23e65000 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56165df5a5a0 0x56165e01aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8c23e65000 1 --2- 172.21.15.17:0/1966912308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56165de421d0 0x56165e01a580 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8bff400640 0 client.8853 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.522+0000 7f8c23e65000 1 -- 172.21.15.17:0/1966912308 >> 172.21.15.17:0/1966912308 conn(0x56165da63880 msgr2=0x56165df5f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c23e65000 1 -- 172.21.15.17:0/1966912308 shutdown_connections 2024-09-10T23:25:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c23e65000 1 -- 172.21.15.17:0/1966912308 wait complete. 2024-09-10T23:25:45.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c23e65000 20 client.8853 trim_cache size 0 max 16384 2024-09-10T23:25:45.529 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:25:45.529 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:25:45.529 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:25:45.529 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:25:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 -- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bf80725e0 msgr2=0x7f8bf8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bf80725e0 0x7f8bf8074aa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009980 tx=0x7f8c14009500 comp rx=0 tx=0).stop 2024-09-10T23:25:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 -- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c1c0d2260 msgr2=0x7f8c1c0c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c1c0d2260 0x7f8c1c0c78e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0752b0 tx=0x7f8c0c005e70 comp rx=0 tx=0).stop 2024-09-10T23:25:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 -- 172.21.15.17:0/3979445801 shutdown_connections 2024-09-10T23:25:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8bf80725e0 0x7f8bf8074aa0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c0d46d0 0x7f8c1c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8c1c0d2640 0x7f8c1c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 --2- 172.21.15.17:0/3979445801 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8c1c0d2260 0x7f8c1c0c78e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 -- 172.21.15.17:0/3979445801 >> 172.21.15.17:0/3979445801 conn(0x7f8c1c09d0f0 msgr2=0x7f8c1c15b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 -- 172.21.15.17:0/3979445801 shutdown_connections 2024-09-10T23:25:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.526+0000 7f8c1b200640 1 -- 172.21.15.17:0/3979445801 wait complete. 2024-09-10T23:25:45.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:45.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-10T23:25:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.702+0000 7fca54400640 1 -- 172.21.15.17:0/1907080252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca4c073d60 msgr2=0x7fca4c0cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.702+0000 7fca54400640 1 --2- 172.21.15.17:0/1907080252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca4c073d60 0x7fca4c0cca60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fca44009bf0 tx=0x7fca4401cb00 comp rx=0 tx=0).stop 2024-09-10T23:25:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.702+0000 7fca54400640 1 -- 172.21.15.17:0/1907080252 shutdown_connections 2024-09-10T23:25:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.702+0000 7fca54400640 1 --2- 172.21.15.17:0/1907080252 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca4c073d60 0x7fca4c0cca60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.702+0000 7fca54400640 1 -- 172.21.15.17:0/1907080252 >> 172.21.15.17:0/1907080252 conn(0x7fca4c0d0c10 msgr2=0x7fca4c0d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.702+0000 7fca54400640 1 -- 172.21.15.17:0/1907080252 shutdown_connections 2024-09-10T23:25:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.702+0000 7fca54400640 1 -- 172.21.15.17:0/1907080252 wait complete. 2024-09-10T23:25:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 Processor -- start 2024-09-10T23:25:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 -- start start 2024-09-10T23:25:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca4c071bd0 0x7fca4c15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca4c073d60 0x7fca4c0701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca4c140210 0x7fca4c1fb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c169740 con 0x7fca4c140210 2024-09-10T23:25:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c1695c0 con 0x7fca4c071bd0 2024-09-10T23:25:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fca4c1698c0 con 0x7fca4c073d60 2024-09-10T23:25:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca52400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca4c140210 0x7fca4c1fb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca52400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca4c140210 0x7fca4c1fb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38546/0 (socket says 172.21.15.17:38546) 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca52400640 1 -- 172.21.15.17:0/1997514839 learned_addr learned my addr 172.21.15.17:0/1997514839 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca51a00640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca4c071bd0 0x7fca4c15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca51000640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca4c073d60 0x7fca4c0701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca52400640 1 -- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca4c073d60 msgr2=0x7fca4c0701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca52400640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca4c073d60 0x7fca4c0701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca52400640 1 -- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca4c071bd0 msgr2=0x7fca4c15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca52400640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca4c071bd0 0x7fca4c15ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca52400640 1 -- 172.21.15.17:0/1997514839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c1fc100 con 0x7fca4c140210 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca51a00640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca4c071bd0 0x7fca4c15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca51000640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca4c073d60 0x7fca4c0701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca52400640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca4c140210 0x7fca4c1fb250 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fca440b0040 tx=0x7fca44005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca49600640 1 -- 172.21.15.17:0/1997514839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440bb070 con 0x7fca4c140210 2024-09-10T23:25:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca49600640 1 -- 172.21.15.17:0/1997514839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca44004e00 con 0x7fca4c140210 2024-09-10T23:25:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca49600640 1 -- 172.21.15.17:0/1997514839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440b2040 con 0x7fca4c140210 2024-09-10T23:25:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 -- 172.21.15.17:0/1997514839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4c153cb0 con 0x7fca4c140210 2024-09-10T23:25:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.706+0000 7fca54400640 1 -- 172.21.15.17:0/1997514839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4c15b350 con 0x7fca4c140210 2024-09-10T23:25:45.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca49600640 1 -- 172.21.15.17:0/1997514839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fca440b5070 con 0x7fca4c140210 2024-09-10T23:25:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca49600640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca2c0725e0 0x7fca2c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca49600640 1 -- 172.21.15.17:0/1997514839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fca4412cac0 con 0x7fca4c140210 2024-09-10T23:25:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca577d3000 1 Processor -- start 2024-09-10T23:25:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca51a00640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca2c0725e0 0x7fca2c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca577d3000 1 -- start start 2024-09-10T23:25:45.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca51a00640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca2c0725e0 0x7fca2c074aa0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fca400017a0 tx=0x7fca40009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca577d3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 0x55a30de76580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca577d3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30de2c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca577d3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de2cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca577d3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a30dd14cb0 con 0x55a30de2cbc0 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca577d3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a30dc2a310 con 0x55a30de761a0 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.710+0000 7fca577d3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a30dc87b90 con 0x55a30de76ac0 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca51a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 0x55a30de76580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca52400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de2cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca51a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 0x55a30de76580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:53210/0 (socket says 172.21.15.17:53210) 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca51a00640 1 -- 172.21.15.17:0/2176867162 learned_addr learned my addr 172.21.15.17:0/2176867162 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca51000640 1 --2- 172.21.15.17:0/2176867162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30de2c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca52400640 1 -- 172.21.15.17:0/2176867162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 msgr2=0x55a30de2c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca52400640 1 --2- 172.21.15.17:0/2176867162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30de2c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca52400640 1 -- 172.21.15.17:0/2176867162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 msgr2=0x55a30de76580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca52400640 1 --2- 172.21.15.17:0/2176867162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 0x55a30de76580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca52400640 1 -- 172.21.15.17:0/2176867162 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a30dc2bc60 con 0x55a30de2cbc0 2024-09-10T23:25:45.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca52400640 1 --2- 172.21.15.17:0/2176867162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de2cfa0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fca4412ae50 tx=0x7fca440f76d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87f0e75f923ee42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca3e000640 1 -- 172.21.15.17:0/2176867162 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440f8000 con 0x55a30de2cbc0 2024-09-10T23:25:45.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca3e000640 1 -- 172.21.15.17:0/2176867162 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca440f7900 con 0x55a30de2cbc0 2024-09-10T23:25:45.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca3e000640 1 -- 172.21.15.17:0/2176867162 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca440fc3e0 con 0x55a30de2cbc0 2024-09-10T23:25:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 -- 172.21.15.17:0/2176867162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 msgr2=0x55a30de2cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 --2- 172.21.15.17:0/2176867162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de2cfa0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fca4412ae50 tx=0x7fca440f76d0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 -- 172.21.15.17:0/2176867162 shutdown_connections 2024-09-10T23:25:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 --2- 172.21.15.17:0/2176867162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de2cfa0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 --2- 172.21.15.17:0/2176867162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30de2c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 --2- 172.21.15.17:0/2176867162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 0x55a30de76580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 -- 172.21.15.17:0/2176867162 >> 172.21.15.17:0/2176867162 conn(0x55a30de32d20 msgr2=0x55a30de2af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 -- 172.21.15.17:0/2176867162 shutdown_connections 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 -- 172.21.15.17:0/2176867162 wait complete. 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 -- start start 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 Processor -- start 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de2cbc0 0x55a30de7d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de7da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30de7dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a30dc7add0 con 0x55a30de761a0 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a30dc76fc0 con 0x55a30de2cbc0 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a30dc1c4b0 con 0x55a30de76ac0 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.714+0000 7fca577d3000 10 client.0 _ll_register_callbacks cb 0x55a30dbfa7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de7da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de7da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38570/0 (socket says 172.21.15.17:38570) 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51000640 1 -- 172.21.15.17:0/1684350169 learned_addr learned my addr 172.21.15.17:0/1684350169 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca52400640 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30de7dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51a00640 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de2cbc0 0x55a30de7d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51000640 1 -- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 msgr2=0x55a30de7dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51000640 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30de7dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51000640 1 -- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de2cbc0 msgr2=0x55a30de7d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51000640 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de2cbc0 0x55a30de7d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51000640 1 -- 172.21.15.17:0/1684350169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a30dc151f0 con 0x55a30de761a0 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51000640 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de7da70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fca38011460 tx=0x7fca38011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68f52631c994211 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 1 -- 172.21.15.17:0/1684350169 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca380052e0 con 0x55a30de761a0 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 1 -- 172.21.15.17:0/1684350169 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fca38003600 con 0x55a30de761a0 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 -- 172.21.15.17:0/1684350169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a30dc0f330 con 0x55a30de761a0 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 1 -- 172.21.15.17:0/1684350169 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fca38022050 con 0x55a30de761a0 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 10 client.8865 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 -- 172.21.15.17:0/1684350169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55a30dbfbfa0 con 0x55a30de761a0 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 1 -- 172.21.15.17:0/1684350169 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a30dc0f330 con 0x55a30de761a0 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 1 -- 172.21.15.17:0/1684350169 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fca38025020 con 0x55a30de761a0 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 10 client.8865 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 10 client.8865 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 20 client.8865 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55a30de85900 0x55a30de87cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 4 client.8865 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 -- 172.21.15.17:0/1684350169 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a30dc89ae0 con 0x55a30de85900 2024-09-10T23:25:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51a00640 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55a30de85900 0x55a30de87cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca51a00640 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55a30de85900 0x55a30de87cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e61468a473762b31 server_cookie=539eadbfdec8d5df in_seq=0 out_seq=0 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 10 client.8865 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 1 -- 172.21.15.17:0/1684350169 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a30dc89ae0 con 0x55a30de85900 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 10 client.8865 handle_command_reply: tid=0 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 client.8865 shutdown 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 -- 172.21.15.17:0/1684350169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 msgr2=0x55a30de7da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de7da70 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fca38011460 tx=0x7fca38011860 comp rx=0 tx=0).stop 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 -- 172.21.15.17:0/1684350169 shutdown_connections 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55a30de85900 0x55a30de87cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30de7dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de7da70 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 --2- 172.21.15.17:0/1684350169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de2cbc0 0x55a30de7d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca32a00640 0 client.8865 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 -- 172.21.15.17:0/1684350169 >> 172.21.15.17:0/1684350169 conn(0x55a30de32d20 msgr2=0x55a30de2af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 -- 172.21.15.17:0/1684350169 shutdown_connections 2024-09-10T23:25:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 1 -- 172.21.15.17:0/1684350169 wait complete. 2024-09-10T23:25:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.718+0000 7fca577d3000 20 client.8865 trim_cache size 0 max 16384 2024-09-10T23:25:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca577d3000 1 Processor -- start 2024-09-10T23:25:45.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca577d3000 1 -- start start 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca577d3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de2cbc0 0x55a30de83dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca577d3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de2c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca577d3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de76ac0 0x55a30de2c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca577d3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c204cb0 con 0x55a30de761a0 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca577d3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca4c203cd0 con 0x55a30de76ac0 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca577d3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fca4c0c6e40 con 0x55a30de2cbc0 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de2c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de2c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38582/0 (socket says 172.21.15.17:38582) 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51000640 1 -- 172.21.15.17:0/1723192065 learned_addr learned my addr 172.21.15.17:0/1723192065 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51a00640 1 --2- 172.21.15.17:0/1723192065 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de2cbc0 0x55a30de83dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca52400640 1 --2- 172.21.15.17:0/1723192065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de76ac0 0x55a30de2c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51000640 1 -- 172.21.15.17:0/1723192065 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de2cbc0 msgr2=0x55a30de83dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51000640 1 --2- 172.21.15.17:0/1723192065 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de2cbc0 0x55a30de83dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51000640 1 -- 172.21.15.17:0/1723192065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de76ac0 msgr2=0x55a30de2c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51000640 1 --2- 172.21.15.17:0/1723192065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de76ac0 0x55a30de2c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51000640 1 -- 172.21.15.17:0/1723192065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a30dcd4660 con 0x55a30de761a0 2024-09-10T23:25:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca51000640 1 --2- 172.21.15.17:0/1723192065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de2c070 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fca38007bd0 tx=0x7fca380011f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782b57366a29dcc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca3d600640 1 -- 172.21.15.17:0/1723192065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38011d60 con 0x55a30de761a0 2024-09-10T23:25:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca3d600640 1 -- 172.21.15.17:0/1723192065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca3801a070 con 0x55a30de761a0 2024-09-10T23:25:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.738+0000 7fca3d600640 1 -- 172.21.15.17:0/1723192065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38003600 con 0x55a30de761a0 2024-09-10T23:25:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- 172.21.15.17:0/1723192065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 msgr2=0x55a30de2c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 --2- 172.21.15.17:0/1723192065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de2c070 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fca38007bd0 tx=0x7fca380011f0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- 172.21.15.17:0/1723192065 shutdown_connections 2024-09-10T23:25:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 --2- 172.21.15.17:0/1723192065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de76ac0 0x55a30de2c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 --2- 172.21.15.17:0/1723192065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de761a0 0x55a30de2c070 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 --2- 172.21.15.17:0/1723192065 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de2cbc0 0x55a30de83dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- 172.21.15.17:0/1723192065 >> 172.21.15.17:0/1723192065 conn(0x55a30de32d20 msgr2=0x55a30de2b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- 172.21.15.17:0/1723192065 shutdown_connections 2024-09-10T23:25:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- 172.21.15.17:0/1723192065 wait complete. 2024-09-10T23:25:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- start start 2024-09-10T23:25:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 Processor -- start 2024-09-10T23:25:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de82fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 0x55a30de83500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30dea8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55a30de35d40 con 0x55a30de2cbc0 2024-09-10T23:25:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a30de33100 con 0x55a30de761a0 2024-09-10T23:25:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55a30dc71ec0 con 0x55a30de76ac0 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 10 client.0 _ll_register_callbacks cb 0x7fca38007ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de82fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de82fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38584/0 (socket says 172.21.15.17:38584) 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 0x55a30de83500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51a00640 1 -- 172.21.15.17:0/454050361 learned_addr learned my addr 172.21.15.17:0/454050361 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca52400640 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30dea8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51a00640 1 -- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 msgr2=0x55a30dea8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51a00640 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30dea8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51a00640 1 -- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 msgr2=0x55a30de83500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51a00640 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 0x55a30de83500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51a00640 1 -- 172.21.15.17:0/454050361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a30dc41090 con 0x55a30de2cbc0 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca51a00640 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de82fc0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fca40007fd0 tx=0x7fca40007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18313b77afa9f328 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca32a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca32a00640 1 -- 172.21.15.17:0/454050361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40030060 con 0x55a30de2cbc0 2024-09-10T23:25:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca32a00640 1 -- 172.21.15.17:0/454050361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fca40010040 con 0x55a30de2cbc0 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- 172.21.15.17:0/454050361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca3801a070 con 0x55a30de2cbc0 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca32a00640 1 -- 172.21.15.17:0/454050361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fca40036050 con 0x55a30de2cbc0 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 10 client.8871 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.742+0000 7fca577d3000 1 -- 172.21.15.17:0/454050361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55a30dc0d5f0 con 0x55a30de2cbc0 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca32a00640 1 -- 172.21.15.17:0/454050361 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca3801a070 con 0x55a30de2cbc0 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca32a00640 1 -- 172.21.15.17:0/454050361 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fca40039020 con 0x55a30de2cbc0 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 10 client.8871 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 10 client.8871 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 20 client.8871 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55a30deeba60 0x55a30deebe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 4 client.8871 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 -- 172.21.15.17:0/454050361 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a30dc85590 con 0x55a30deeba60 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca51000640 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55a30deeba60 0x55a30deebe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca51000640 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55a30deeba60 0x55a30deebe70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e23c66c74e1144b8 server_cookie=731ca187ecf107a2 in_seq=0 out_seq=0 2024-09-10T23:25:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca32a00640 10 client.8871 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca32a00640 1 -- 172.21.15.17:0/454050361 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x55a30dc85590 con 0x55a30deeba60 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca32a00640 10 client.8871 handle_command_reply: tid=0 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 client.8871 shutdown 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 -- 172.21.15.17:0/454050361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 msgr2=0x55a30de82fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de82fc0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fca40007fd0 tx=0x7fca40007a10 comp rx=0 tx=0).stop 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 -- 172.21.15.17:0/454050361 shutdown_connections 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x55a30deeba60 0x55a30deebe70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55a30de76ac0 0x55a30dea8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a30de761a0 0x55a30de83500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca32a00640 0 client.8871 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 --2- 172.21.15.17:0/454050361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a30de2cbc0 0x55a30de82fc0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 -- 172.21.15.17:0/454050361 >> 172.21.15.17:0/454050361 conn(0x55a30de32d20 msgr2=0x55a30de2c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 -- 172.21.15.17:0/454050361 shutdown_connections 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 1 -- 172.21.15.17:0/454050361 wait complete. 2024-09-10T23:25:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca577d3000 20 client.8871 trim_cache size 0 max 16384 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "PAUSED (620 inodes in the stack)", 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout: "4273064a-bc50-407f-8592-08b4130dcbe9": { 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "4273064a-bc50-407f-8592-08b4130dcbe9", 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive" 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:45.753 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout: "4273064a-bc50-407f-8592-08b4130dcbe9": { 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:25:45.265758+0000", 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:45.754 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 -- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca2c0725e0 msgr2=0x7fca2c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca2c0725e0 0x7fca2c074aa0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fca400017a0 tx=0x7fca40009040 comp rx=0 tx=0).stop 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 -- 172.21.15.17:0/1997514839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca4c140210 msgr2=0x7fca4c1fb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca4c140210 0x7fca4c1fb250 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fca440b0040 tx=0x7fca44005ac0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 -- 172.21.15.17:0/1997514839 shutdown_connections 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca2c0725e0 0x7fca2c074aa0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca4c140210 0x7fca4c1fb250 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca4c073d60 0x7fca4c0701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 --2- 172.21.15.17:0/1997514839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca4c071bd0 0x7fca4c15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 -- 172.21.15.17:0/1997514839 >> 172.21.15.17:0/1997514839 conn(0x7fca4c0d0c10 msgr2=0x7fca4c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 -- 172.21.15.17:0/1997514839 shutdown_connections 2024-09-10T23:25:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.746+0000 7fca54400640 1 -- 172.21.15.17:0/1997514839 wait complete. 2024-09-10T23:25:45.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:45.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 -- 172.21.15.17:0/2156092581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c1618a0 msgr2=0x7f9a7c0cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 --2- 172.21.15.17:0/2156092581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c1618a0 0x7f9a7c0cee10 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009900 tx=0x7f9a7401c820 comp rx=0 tx=0).stop 2024-09-10T23:25:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 -- 172.21.15.17:0/2156092581 shutdown_connections 2024-09-10T23:25:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 --2- 172.21.15.17:0/2156092581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c1618a0 0x7f9a7c0cee10 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 --2- 172.21.15.17:0/2156092581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a7c0d4a10 0x7f9a7c06eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 -- 172.21.15.17:0/2156092581 >> 172.21.15.17:0/2156092581 conn(0x7f9a7c0d3f20 msgr2=0x7f9a7c0d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 -- 172.21.15.17:0/2156092581 shutdown_connections 2024-09-10T23:25:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 -- 172.21.15.17:0/2156092581 wait complete. 2024-09-10T23:25:45.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 Processor -- start 2024-09-10T23:25:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.914+0000 7f9a82e00640 1 -- start start 2024-09-10T23:25:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a82e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0d2180 0x7f9a7c154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a82e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a7c0d4a10 0x7f9a7c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a82e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a7c1618a0 0x7f9a7c154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a82e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c16b170 con 0x7f9a7c0d2180 2024-09-10T23:25:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a82e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c16aff0 con 0x7f9a7c0d4a10 2024-09-10T23:25:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a82e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7c16b2f0 con 0x7f9a7c1618a0 2024-09-10T23:25:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0d2180 0x7f9a7c154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0d2180 0x7f9a7c154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38600/0 (socket says 172.21.15.17:38600) 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a7be00640 1 -- 172.21.15.17:0/3175172822 learned_addr learned my addr 172.21.15.17:0/3175172822 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a73400640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a7c0d4a10 0x7f9a7c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a80e00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a7c1618a0 0x7f9a7c154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a7be00640 1 -- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a7c1618a0 msgr2=0x7f9a7c154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a7be00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a7c1618a0 0x7f9a7c154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a7be00640 1 -- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a7c0d4a10 msgr2=0x7f9a7c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a7be00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a7c0d4a10 0x7f9a7c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a7be00640 1 -- 172.21.15.17:0/3175172822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c155d20 con 0x7f9a7c0d2180 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a7be00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0d2180 0x7f9a7c154040 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00c500 tx=0x7f9a6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a78c00640 1 -- 172.21.15.17:0/3175172822 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c017070 con 0x7f9a7c0d2180 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a78c00640 1 -- 172.21.15.17:0/3175172822 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a6c003600 con 0x7f9a7c0d2180 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a78c00640 1 -- 172.21.15.17:0/3175172822 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c003a90 con 0x7f9a7c0d2180 2024-09-10T23:25:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c15b570 con 0x7f9a7c0d2180 2024-09-10T23:25:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c15bb30 con 0x7f9a7c0d2180 2024-09-10T23:25:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c06eff0 con 0x7f9a7c0d2180 2024-09-10T23:25:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.918+0000 7f9a78c00640 1 -- 172.21.15.17:0/3175172822 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9a6c003c30 con 0x7f9a7c0d2180 2024-09-10T23:25:45.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.922+0000 7f9a78c00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a58072610 0x7f9a58074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:45.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.922+0000 7f9a78c00640 1 -- 172.21.15.17:0/3175172822 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f9a6c092b30 con 0x7f9a7c0d2180 2024-09-10T23:25:45.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.922+0000 7f9a73400640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a58072610 0x7f9a58074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:45.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.922+0000 7f9a73400640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a58072610 0x7f9a58074ad0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0696a0 tx=0x7f9a64009680 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:45.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:45.926+0000 7f9a78c00640 1 -- 172.21.15.17:0/3175172822 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9a6c05da60 con 0x7f9a7c0d2180 2024-09-10T23:25:46.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.134+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a7c0d14b0 con 0x7f9a7c0d2180 2024-09-10T23:25:46.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.134+0000 7f9a78c00640 1 -- 172.21.15.17:0/3175172822 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f9a6c062490 con 0x7f9a7c0d2180 2024-09-10T23:25:46.138 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:46.138 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:46.138 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:46.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a58072610 msgr2=0x7f9a58074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a58072610 0x7f9a58074ad0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0696a0 tx=0x7f9a64009680 comp rx=0 tx=0).stop 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0d2180 msgr2=0x7f9a7c154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0d2180 0x7f9a7c154040 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00c500 tx=0x7f9a6c00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 shutdown_connections 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a58072610 0x7f9a58074ad0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a7c1618a0 0x7f9a7c154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a7c0d4a10 0x7f9a7c0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 --2- 172.21.15.17:0/3175172822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a7c0d2180 0x7f9a7c154040 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 >> 172.21.15.17:0/3175172822 conn(0x7f9a7c0d3f20 msgr2=0x7f9a7c0b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 shutdown_connections 2024-09-10T23:25:46.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.138+0000 7f9a82e00640 1 -- 172.21.15.17:0/3175172822 wait complete. 2024-09-10T23:25:46.160 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:25:46.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:25:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 -- 172.21.15.17:0/309918862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0600b2cd0 msgr2=0x7fd060161ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 --2- 172.21.15.17:0/309918862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0600b2cd0 0x7fd060161ba0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fd0600707b0 tx=0x7fd05801ccf0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 -- 172.21.15.17:0/309918862 shutdown_connections 2024-09-10T23:25:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 --2- 172.21.15.17:0/309918862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0600b2cd0 0x7fd060161ba0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 --2- 172.21.15.17:0/309918862 >> v2:172.21.15.77:3300/0 conn(0x7fd060161620 0x7fd06006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 -- 172.21.15.17:0/309918862 >> 172.21.15.17:0/309918862 conn(0x7fd0600d1d10 msgr2=0x7fd0600d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 -- 172.21.15.17:0/309918862 shutdown_connections 2024-09-10T23:25:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 -- 172.21.15.17:0/309918862 wait complete. 2024-09-10T23:25:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 Processor -- start 2024-09-10T23:25:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 -- start start 2024-09-10T23:25:46.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0600b2cd0 0x7fd060156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0600d0ec0 0x7fd060070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd060161620 0x7fd060070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd06016bb40 con 0x7fd060161620 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd06016b9c0 con 0x7fd0600b2cd0 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd066e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd06016bcc0 con 0x7fd0600d0ec0 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd05fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0600b2cd0 0x7fd060156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd064e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd060161620 0x7fd060070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd05fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0600b2cd0 0x7fd060156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:53262/0 (socket says 172.21.15.17:53262) 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd05fe00640 1 -- 172.21.15.17:0/3721717771 learned_addr learned my addr 172.21.15.17:0/3721717771 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd057e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0600d0ec0 0x7fd060070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd064e00640 1 -- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0600d0ec0 msgr2=0x7fd060070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd064e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0600d0ec0 0x7fd060070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd064e00640 1 -- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0600b2cd0 msgr2=0x7fd060156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd064e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0600b2cd0 0x7fd060156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.306+0000 7fd064e00640 1 -- 172.21.15.17:0/3721717771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd060154ed0 con 0x7fd060161620 2024-09-10T23:25:46.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd064e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd060161620 0x7fd060070ea0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fd0580ac000 tx=0x7fd058004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:46.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd05cc00640 1 -- 172.21.15.17:0/3721717771 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580bb070 con 0x7fd060161620 2024-09-10T23:25:46.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd05cc00640 1 -- 172.21.15.17:0/3721717771 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd058004b40 con 0x7fd060161620 2024-09-10T23:25:46.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd05cc00640 1 -- 172.21.15.17:0/3721717771 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580b2040 con 0x7fd060161620 2024-09-10T23:25:46.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0601f8440 con 0x7fd060161620 2024-09-10T23:25:46.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0601f86e0 con 0x7fd060161620 2024-09-10T23:25:46.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd060161ba0 con 0x7fd060161620 2024-09-10T23:25:46.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd05cc00640 1 -- 172.21.15.17:0/3721717771 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd0580b5030 con 0x7fd060161620 2024-09-10T23:25:46.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd05cc00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd03c0725e0 0x7fd03c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:46.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.310+0000 7fd05cc00640 1 -- 172.21.15.17:0/3721717771 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fd05812d190 con 0x7fd060161620 2024-09-10T23:25:46.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.314+0000 7fd05fe00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd03c0725e0 0x7fd03c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:46.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.314+0000 7fd05fe00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd03c0725e0 0x7fd03c074aa0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd050005fd0 tx=0x7fd05000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.314+0000 7fd05cc00640 1 -- 172.21.15.17:0/3721717771 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd058016970 con 0x7fd060161620 2024-09-10T23:25:46.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd060074af0 con 0x7fd060161620 2024-09-10T23:25:46.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd05cc00640 1 -- 172.21.15.17:0/3721717771 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1487 (secure 0 0 0) 0x7fd0580f7ff0 con 0x7fd060161620 2024-09-10T23:25:46.561 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:46.561 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":635,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":816,"data_bytes":833328945,"bytes_used":2100994048,"bytes_avail":770993119232,"bytes_total":773094113280,"write_bytes_sec":50659701,"read_op_per_sec":0,"write_op_per_sec":51},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-10T23:25:02.429010+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:25:46.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd03c0725e0 msgr2=0x7fd03c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd03c0725e0 0x7fd03c074aa0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd050005fd0 tx=0x7fd05000b390 comp rx=0 tx=0).stop 2024-09-10T23:25:46.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd060161620 msgr2=0x7fd060070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:46.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd060161620 0x7fd060070ea0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fd0580ac000 tx=0x7fd058004270 comp rx=0 tx=0).stop 2024-09-10T23:25:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 shutdown_connections 2024-09-10T23:25:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd03c0725e0 0x7fd03c074aa0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd060161620 0x7fd060070ea0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0600d0ec0 0x7fd060070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 --2- 172.21.15.17:0/3721717771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0600b2cd0 0x7fd060156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 >> 172.21.15.17:0/3721717771 conn(0x7fd0600d1d10 msgr2=0x7fd060072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 shutdown_connections 2024-09-10T23:25:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:46.558+0000 7fd066e00640 1 -- 172.21.15.17:0/3721717771 wait complete. 2024-09-10T23:25:46.582 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:25:47.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:47.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.738+0000 7f7925e00640 1 -- 172.21.15.17:0/2022813144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200b48f0 msgr2=0x7f792015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.738+0000 7f7925e00640 1 --2- 172.21.15.17:0/2022813144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200b48f0 0x7f792015cbd0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f7908009840 tx=0x7f790801c820 comp rx=0 tx=0).stop 2024-09-10T23:25:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.738+0000 7f7925e00640 1 -- 172.21.15.17:0/2022813144 shutdown_connections 2024-09-10T23:25:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.738+0000 7f7925e00640 1 --2- 172.21.15.17:0/2022813144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200b48f0 0x7f792015cbd0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.738+0000 7f7925e00640 1 --2- 172.21.15.17:0/2022813144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79200cf4f0 0x7f79200b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.738+0000 7f7925e00640 1 -- 172.21.15.17:0/2022813144 >> 172.21.15.17:0/2022813144 conn(0x7f792006cfc0 msgr2=0x7f792006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.738+0000 7f7925e00640 1 -- 172.21.15.17:0/2022813144 shutdown_connections 2024-09-10T23:25:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.738+0000 7f7925e00640 1 -- 172.21.15.17:0/2022813144 wait complete. 2024-09-10T23:25:47.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 Processor -- start 2024-09-10T23:25:47.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 -- start start 2024-09-10T23:25:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79200b48f0 0x7f792014f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79200cf4f0 0x7f7920149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200cff20 0x7f7920145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7920168b20 con 0x7f79200cff20 2024-09-10T23:25:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f79201689a0 con 0x7f79200b48f0 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7920168ca0 con 0x7f79200cf4f0 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200cff20 0x7f7920145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200cff20 0x7f7920145090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45988/0 (socket says 172.21.15.17:45988) 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791f400640 1 -- 172.21.15.17:0/3938471338 learned_addr learned my addr 172.21.15.17:0/3938471338 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7916000640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79200cf4f0 0x7f7920149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791ea00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79200b48f0 0x7f792014f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791f400640 1 -- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79200cf4f0 msgr2=0x7f7920149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791f400640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79200cf4f0 0x7f7920149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791f400640 1 -- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79200b48f0 msgr2=0x7f792014f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791f400640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79200b48f0 0x7f792014f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791f400640 1 -- 172.21.15.17:0/3938471338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7920070970 con 0x7f79200cff20 2024-09-10T23:25:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f791f400640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200cff20 0x7f7920145090 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f791800ca80 tx=0x7f791800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:47.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7917e00640 1 -- 172.21.15.17:0/3938471338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918016020 con 0x7f79200cff20 2024-09-10T23:25:47.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7917e00640 1 -- 172.21.15.17:0/3938471338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f791800a930 con 0x7f79200cff20 2024-09-10T23:25:47.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7917e00640 1 -- 172.21.15.17:0/3938471338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791800ad80 con 0x7f79200cff20 2024-09-10T23:25:47.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79201487b0 con 0x7f79200cff20 2024-09-10T23:25:47.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7920148d70 con 0x7f79200cff20 2024-09-10T23:25:47.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.742+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792015cbd0 con 0x7f79200cff20 2024-09-10T23:25:47.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.746+0000 7f7917e00640 1 -- 172.21.15.17:0/3938471338 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f791801b400 con 0x7f79200cff20 2024-09-10T23:25:47.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.746+0000 7f7917e00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072610 0x7f78fc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:47.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.746+0000 7f7917e00640 1 -- 172.21.15.17:0/3938471338 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f79180937b0 con 0x7f79200cff20 2024-09-10T23:25:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.746+0000 7f791ea00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072610 0x7f78fc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.746+0000 7f791ea00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072610 0x7f78fc074ad0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f79100058d0 tx=0x7f7910005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:47.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.750+0000 7f7917e00640 1 -- 172.21.15.17:0/3938471338 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7918020020 con 0x7f79200cff20 2024-09-10T23:25:47.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.958+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f792006f440 con 0x7f79200cff20 2024-09-10T23:25:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.958+0000 7f7917e00640 1 -- 172.21.15.17:0/3938471338 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f792015d110 con 0x7f79200cff20 2024-09-10T23:25:47.963 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:47.963 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:47.963 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:47.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072610 msgr2=0x7f78fc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:47.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072610 0x7f78fc074ad0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f79100058d0 tx=0x7f7910005860 comp rx=0 tx=0).stop 2024-09-10T23:25:47.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200cff20 msgr2=0x7f7920145090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:47.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200cff20 0x7f7920145090 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f791800ca80 tx=0x7f791800cb70 comp rx=0 tx=0).stop 2024-09-10T23:25:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 shutdown_connections 2024-09-10T23:25:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072610 0x7f78fc074ad0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79200cff20 0x7f7920145090 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f79200cf4f0 0x7f7920149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 --2- 172.21.15.17:0/3938471338 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79200b48f0 0x7f792014f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 >> 172.21.15.17:0/3938471338 conn(0x7f792006cfc0 msgr2=0x7f792014bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 shutdown_connections 2024-09-10T23:25:47.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:47.962+0000 7f7925e00640 1 -- 172.21.15.17:0/3938471338 wait complete. 2024-09-10T23:25:47.984 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:25:47.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:25:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.126+0000 7f42a6000640 1 -- 172.21.15.17:0/3812209667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42a0070ad0 msgr2=0x7f42a015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.126+0000 7f42a6000640 1 --2- 172.21.15.17:0/3812209667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42a0070ad0 0x7f42a015f060 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4290009870 tx=0x7f429001c750 comp rx=0 tx=0).stop 2024-09-10T23:25:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.126+0000 7f42a6000640 1 -- 172.21.15.17:0/3812209667 shutdown_connections 2024-09-10T23:25:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.126+0000 7f42a6000640 1 --2- 172.21.15.17:0/3812209667 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42a0070ad0 0x7f42a015f060 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.126+0000 7f42a6000640 1 -- 172.21.15.17:0/3812209667 >> 172.21.15.17:0/3812209667 conn(0x7f42a00d1d60 msgr2=0x7f42a00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.126+0000 7f42a6000640 1 -- 172.21.15.17:0/3812209667 shutdown_connections 2024-09-10T23:25:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.126+0000 7f42a6000640 1 -- 172.21.15.17:0/3812209667 wait complete. 2024-09-10T23:25:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.126+0000 7f42a6000640 1 Processor -- start 2024-09-10T23:25:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.126+0000 7f42a6000640 1 -- start start 2024-09-10T23:25:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f42a6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42a0070ad0 0x7f42a00c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f42a6000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42a00cf320 0x7f42a00b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f42a6000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42a00d1830 0x7f42a0151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:48.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f42a6000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f42a016a660 con 0x7f42a0070ad0 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f42a6000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f42a016a4e0 con 0x7f42a00d1830 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f42a6000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f42a016a7e0 con 0x7f42a00cf320 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42a0070ad0 0x7f42a00c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42a0070ad0 0x7f42a00c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45992/0 (socket says 172.21.15.17:45992) 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429f400640 1 -- 172.21.15.17:0/268980617 learned_addr learned my addr 172.21.15.17:0/268980617 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429fe00640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42a00d1830 0x7f42a0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f4297e00640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42a00cf320 0x7f42a00b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429f400640 1 -- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42a00cf320 msgr2=0x7f42a00b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429f400640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42a00cf320 0x7f42a00b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429f400640 1 -- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42a00d1830 msgr2=0x7f42a0151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429f400640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42a00d1830 0x7f42a0151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:48.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429f400640 1 -- 172.21.15.17:0/268980617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a00c6800 con 0x7f42a0070ad0 2024-09-10T23:25:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f429f400640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42a0070ad0 0x7f42a00c8330 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f429001a380 tx=0x7f4290004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f4297400640 1 -- 172.21.15.17:0/268980617 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900b2040 con 0x7f42a0070ad0 2024-09-10T23:25:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f4297400640 1 -- 172.21.15.17:0/268980617 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42900a5a00 con 0x7f42a0070ad0 2024-09-10T23:25:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f4297400640 1 -- 172.21.15.17:0/268980617 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900a5df0 con 0x7f42a0070ad0 2024-09-10T23:25:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a00c6ae0 con 0x7f42a0070ad0 2024-09-10T23:25:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a015aef0 con 0x7f42a0070ad0 2024-09-10T23:25:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.130+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a015f060 con 0x7f42a0070ad0 2024-09-10T23:25:48.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.134+0000 7f4297400640 1 -- 172.21.15.17:0/268980617 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f42900b5070 con 0x7f42a0070ad0 2024-09-10T23:25:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.134+0000 7f4297400640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f427c0725e0 0x7f427c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.134+0000 7f4297400640 1 -- 172.21.15.17:0/268980617 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f429012cf10 con 0x7f42a0070ad0 2024-09-10T23:25:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.134+0000 7f4297e00640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f427c0725e0 0x7f427c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:48.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.134+0000 7f4297e00640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f427c0725e0 0x7f427c074aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4288001250 tx=0x7f4288009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:48.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.138+0000 7f4297400640 1 -- 172.21.15.17:0/268980617 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f42900c4020 con 0x7f42a0070ad0 2024-09-10T23:25:48.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.370+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f42a015b0c0 con 0x7f42a0070ad0 2024-09-10T23:25:48.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f4297400640 1 -- 172.21.15.17:0/268980617 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f4290016370 con 0x7f42a0070ad0 2024-09-10T23:25:48.376 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:48.376 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":637,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1040,"data_bytes":1069527875,"bytes_used":2593861632,"bytes_avail":770500251648,"bytes_total":773094113280,"write_bytes_sec":66322357,"read_op_per_sec":0,"write_op_per_sec":70},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-10T23:25:02.429010+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:25:48.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f427c0725e0 msgr2=0x7f427c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:48.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f427c0725e0 0x7f427c074aa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4288001250 tx=0x7f4288009040 comp rx=0 tx=0).stop 2024-09-10T23:25:48.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42a0070ad0 msgr2=0x7f42a00c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42a0070ad0 0x7f42a00c8330 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f429001a380 tx=0x7f4290004620 comp rx=0 tx=0).stop 2024-09-10T23:25:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 shutdown_connections 2024-09-10T23:25:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f427c0725e0 0x7f427c074aa0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42a00d1830 0x7f42a0151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42a00cf320 0x7f42a00b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 --2- 172.21.15.17:0/268980617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42a0070ad0 0x7f42a00c8330 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 >> 172.21.15.17:0/268980617 conn(0x7f42a00d1d60 msgr2=0x7f42a00af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 shutdown_connections 2024-09-10T23:25:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:48.374+0000 7f42a6000640 1 -- 172.21.15.17:0/268980617 wait complete. 2024-09-10T23:25:48.397 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:25:49.399 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 -- 172.21.15.17:0/1401194186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c40051d0 msgr2=0x7f99c400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 --2- 172.21.15.17:0/1401194186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99c40051d0 0x7f99c400b9d0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009eb0 tx=0x7f99d801d5f0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e2800640 1 -- 172.21.15.17:0/1401194186 reap_dead start 2024-09-10T23:25:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 -- 172.21.15.17:0/1401194186 shutdown_connections 2024-09-10T23:25:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 -- 172.21.15.17:0/1401194186 >> 172.21.15.17:0/1401194186 conn(0x7f99dc0d1d60 msgr2=0x7f99dc0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 -- 172.21.15.17:0/1401194186 shutdown_connections 2024-09-10T23:25:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 -- 172.21.15.17:0/1401194186 wait complete. 2024-09-10T23:25:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 Processor -- start 2024-09-10T23:25:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 -- start start 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c40051d0 0x7f99dc0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99dc1588f0 0x7f99dc0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99dc0c4d60 0x7f99dc0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc071030 con 0x7f99dc1588f0 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc070eb0 con 0x7f99c40051d0 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e4800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f99dc0711b0 con 0x7f99dc0c4d60 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99dc1588f0 0x7f99dc0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99dc1588f0 0x7f99dc0cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46010/0 (socket says 172.21.15.17:46010) 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1400640 1 -- 172.21.15.17:0/1047282096 learned_addr learned my addr 172.21.15.17:0/1047282096 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1e00640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c40051d0 0x7f99dc0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e2800640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99dc0c4d60 0x7f99dc0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1400640 1 -- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99dc0c4d60 msgr2=0x7f99dc0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1400640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99dc0c4d60 0x7f99dc0cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1400640 1 -- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c40051d0 msgr2=0x7f99dc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1400640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c40051d0 0x7f99dc0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1400640 1 -- 172.21.15.17:0/1047282096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc158db0 con 0x7f99dc1588f0 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.558+0000 7f99e1400640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99dc1588f0 0x7f99dc0cb3a0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00f760 tx=0x7f99cc00fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99d6000640 1 -- 172.21.15.17:0/1047282096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00bcb0 con 0x7f99dc1588f0 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99d6000640 1 -- 172.21.15.17:0/1047282096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99cc00fe70 con 0x7f99dc1588f0 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc158610 con 0x7f99dc1588f0 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99d6000640 1 -- 172.21.15.17:0/1047282096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc011640 con 0x7f99dc1588f0 2024-09-10T23:25:49.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc0c9ba0 con 0x7f99dc1588f0 2024-09-10T23:25:49.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99dc15f060 con 0x7f99dc1588f0 2024-09-10T23:25:49.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99d6000640 1 -- 172.21.15.17:0/1047282096 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f99cc0117e0 con 0x7f99dc1588f0 2024-09-10T23:25:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99d6000640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99c00725e0 0x7f99c0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99d6000640 1 -- 172.21.15.17:0/1047282096 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f99cc094030 con 0x7f99dc1588f0 2024-09-10T23:25:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.562+0000 7f99e1e00640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99c00725e0 0x7f99c0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.566+0000 7f99e1e00640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99c00725e0 0x7f99c0074aa0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0b1f10 tx=0x7f99d0006730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:49.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.566+0000 7f99d6000640 1 -- 172.21.15.17:0/1047282096 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f99cc05ee90 con 0x7f99dc1588f0 2024-09-10T23:25:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.774+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99dc0b7aa0 con 0x7f99dc1588f0 2024-09-10T23:25:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99d6000640 1 -- 172.21.15.17:0/1047282096 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f99cc0638c0 con 0x7f99dc1588f0 2024-09-10T23:25:49.780 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:49.780 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99c00725e0 msgr2=0x7f99c0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99c00725e0 0x7f99c0074aa0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0b1f10 tx=0x7f99d0006730 comp rx=0 tx=0).stop 2024-09-10T23:25:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99dc1588f0 msgr2=0x7f99dc0cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99dc1588f0 0x7f99dc0cb3a0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00f760 tx=0x7f99cc00fc20 comp rx=0 tx=0).stop 2024-09-10T23:25:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 shutdown_connections 2024-09-10T23:25:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99c00725e0 0x7f99c0074aa0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99dc0c4d60 0x7f99dc0cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99dc1588f0 0x7f99dc0cb3a0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 --2- 172.21.15.17:0/1047282096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99c40051d0 0x7f99dc0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 >> 172.21.15.17:0/1047282096 conn(0x7f99dc0d1d60 msgr2=0x7f99dc0b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 shutdown_connections 2024-09-10T23:25:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.778+0000 7f99e4800640 1 -- 172.21.15.17:0/1047282096 wait complete. 2024-09-10T23:25:49.801 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:25:49.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:25:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.946+0000 7f9bdec00640 1 -- 172.21.15.17:0/692132684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bbc003a60 msgr2=0x7f9bbc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.946+0000 7f9bdec00640 1 --2- 172.21.15.17:0/692132684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bbc003a60 0x7f9bbc003e80 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8006fd0 tx=0x7f9bc801cef0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.946+0000 7f9bdec00640 1 -- 172.21.15.17:0/692132684 shutdown_connections 2024-09-10T23:25:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.946+0000 7f9bdec00640 1 --2- 172.21.15.17:0/692132684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bbc003a60 0x7f9bbc003e80 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.946+0000 7f9bdec00640 1 -- 172.21.15.17:0/692132684 >> 172.21.15.17:0/692132684 conn(0x7f9bd80d1d60 msgr2=0x7f9bd80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.946+0000 7f9bdec00640 1 -- 172.21.15.17:0/692132684 shutdown_connections 2024-09-10T23:25:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.946+0000 7f9bdec00640 1 -- 172.21.15.17:0/692132684 wait complete. 2024-09-10T23:25:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.946+0000 7f9bdec00640 1 Processor -- start 2024-09-10T23:25:49.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 -- start start 2024-09-10T23:25:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bbc003a60 0x7f9bd81522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bd80c6780 0x7f9bd80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd80b38c0 0x7f9bd80b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd815f3f0 con 0x7f9bd80b38c0 2024-09-10T23:25:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd815f270 con 0x7f9bd80c6780 2024-09-10T23:25:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd815f570 con 0x7f9bbc003a60 2024-09-10T23:25:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdcc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd80b38c0 0x7f9bd80b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdcc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd80b38c0 0x7f9bd80b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46038/0 (socket says 172.21.15.17:46038) 2024-09-10T23:25:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bd7400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bd80c6780 0x7f9bd80c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdcc00640 1 -- 172.21.15.17:0/2539280797 learned_addr learned my addr 172.21.15.17:0/2539280797 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bd7e00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bbc003a60 0x7f9bd81522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bd7400640 1 -- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bbc003a60 msgr2=0x7f9bd81522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bd7400640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bbc003a60 0x7f9bd81522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bd7400640 1 -- 172.21.15.17:0/2539280797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd80b38c0 msgr2=0x7f9bd80b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bd7400640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd80b38c0 0x7f9bd80b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bd7400640 1 -- 172.21.15.17:0/2539280797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd80c7200 con 0x7f9bd80c6780 2024-09-10T23:25:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdcc00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd80b38c0 0x7f9bd80b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bd7400640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bd80c6780 0x7f9bd80c6c00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4011b40 tx=0x7f9bc4009e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bcfe00640 1 -- 172.21.15.17:0/2539280797 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc401e070 con 0x7f9bd80c6780 2024-09-10T23:25:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bcfe00640 1 -- 172.21.15.17:0/2539280797 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bc400fe70 con 0x7f9bd80c6780 2024-09-10T23:25:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bcfe00640 1 -- 172.21.15.17:0/2539280797 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40042b0 con 0x7f9bd80c6780 2024-09-10T23:25:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd80b1880 con 0x7f9bd80c6780 2024-09-10T23:25:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd80c74e0 con 0x7f9bd80c6780 2024-09-10T23:25:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.950+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd80cd230 con 0x7f9bd80c6780 2024-09-10T23:25:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.954+0000 7f9bcfe00640 1 -- 172.21.15.17:0/2539280797 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9bc4003600 con 0x7f9bd80c6780 2024-09-10T23:25:49.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.954+0000 7f9bcfe00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9bb8072610 0x7f9bb8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:49.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.954+0000 7f9bcfe00640 1 -- 172.21.15.17:0/2539280797 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f9bc4093fe0 con 0x7f9bd80c6780 2024-09-10T23:25:49.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.954+0000 7f9bd7e00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9bb8072610 0x7f9bb8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:49.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.954+0000 7f9bd7e00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9bb8072610 0x7f9bb8074ad0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80ac000 tx=0x7f9bc8019d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:49.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:49.958+0000 7f9bcfe00640 1 -- 172.21.15.17:0/2539280797 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9bc405ef10 con 0x7f9bd80c6780 2024-09-10T23:25:50.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.194+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9bd80d25f0 con 0x7f9bd80c6780 2024-09-10T23:25:50.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.194+0000 7f9bcfe00640 1 -- 172.21.15.17:0/2539280797 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f9bc4063940 con 0x7f9bd80c6780 2024-09-10T23:25:50.199 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:50.199 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":639,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077916483,"bytes_used":2618318848,"bytes_avail":770475794432,"bytes_total":773094113280,"write_bytes_sec":46420028,"read_op_per_sec":0,"write_op_per_sec":49},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-10T23:25:02.429010+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:25:50.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9bb8072610 msgr2=0x7f9bb8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:50.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9bb8072610 0x7f9bb8074ad0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80ac000 tx=0x7f9bc8019d30 comp rx=0 tx=0).stop 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bd80c6780 msgr2=0x7f9bd80c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bd80c6780 0x7f9bd80c6c00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4011b40 tx=0x7f9bc4009e10 comp rx=0 tx=0).stop 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 shutdown_connections 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9bb8072610 0x7f9bb8074ad0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bd80b38c0 0x7f9bd80b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bd80c6780 0x7f9bd80c6c00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 --2- 172.21.15.17:0/2539280797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9bbc003a60 0x7f9bd81522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 >> 172.21.15.17:0/2539280797 conn(0x7f9bd80d1d60 msgr2=0x7f9bd80aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 shutdown_connections 2024-09-10T23:25:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:50.198+0000 7f9bdec00640 1 -- 172.21.15.17:0/2539280797 wait complete. 2024-09-10T23:25:50.220 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:25:51.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.370+0000 7fdf4a200640 1 -- 172.21.15.17:0/4096196501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf440cc570 msgr2=0x7fdf440d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.370+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4096196501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf440cc570 0x7fdf440d1990 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fdf440d2a50 tx=0x7fdf3001c5d0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 -- 172.21.15.17:0/4096196501 shutdown_connections 2024-09-10T23:25:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4096196501 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf440d1ed0 0x7fdf440ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4096196501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf440cc570 0x7fdf440d1990 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4096196501 >> v2:172.21.15.77:3300/0 conn(0x7fdf4415bc70 0x7fdf440cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 -- 172.21.15.17:0/4096196501 >> 172.21.15.17:0/4096196501 conn(0x7fdf4409a9f0 msgr2=0x7fdf4409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 -- 172.21.15.17:0/4096196501 shutdown_connections 2024-09-10T23:25:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 -- 172.21.15.17:0/4096196501 wait complete. 2024-09-10T23:25:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 Processor -- start 2024-09-10T23:25:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 -- start start 2024-09-10T23:25:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf440cc570 0x7fdf440b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf440d1ed0 0x7fdf440b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf4415bc70 0x7fdf440c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440b1500 con 0x7fdf4415bc70 2024-09-10T23:25:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440b1380 con 0x7fdf440d1ed0 2024-09-10T23:25:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf4a200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdf440b1680 con 0x7fdf440cc570 2024-09-10T23:25:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf49800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf4415bc70 0x7fdf440c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf49800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf4415bc70 0x7fdf440c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46054/0 (socket says 172.21.15.17:46054) 2024-09-10T23:25:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf49800640 1 -- 172.21.15.17:0/4058425112 learned_addr learned my addr 172.21.15.17:0/4058425112 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf48e00640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf440cc570 0x7fdf440b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf43e00640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf440d1ed0 0x7fdf440b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf49800640 1 -- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf440cc570 msgr2=0x7fdf440b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf49800640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf440cc570 0x7fdf440b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf49800640 1 -- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf440d1ed0 msgr2=0x7fdf440b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf49800640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf440d1ed0 0x7fdf440b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf49800640 1 -- 172.21.15.17:0/4058425112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf441fef10 con 0x7fdf4415bc70 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.374+0000 7fdf49800640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf4415bc70 0x7fdf440c7640 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00e990 tx=0x7fdf3c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf40c00640 1 -- 172.21.15.17:0/4058425112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c004d30 con 0x7fdf4415bc70 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf40c00640 1 -- 172.21.15.17:0/4058425112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf3c00caa0 con 0x7fdf4415bc70 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf40c00640 1 -- 172.21.15.17:0/4058425112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c005020 con 0x7fdf4415bc70 2024-09-10T23:25:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf441ff1f0 con 0x7fdf4415bc70 2024-09-10T23:25:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf441ff7b0 con 0x7fdf4415bc70 2024-09-10T23:25:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf440ce4b0 con 0x7fdf4415bc70 2024-09-10T23:25:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf40c00640 1 -- 172.21.15.17:0/4058425112 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdf3c00f040 con 0x7fdf4415bc70 2024-09-10T23:25:51.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf40c00640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf240725e0 0x7fdf24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf40c00640 1 -- 172.21.15.17:0/4058425112 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fdf3c093900 con 0x7fdf4415bc70 2024-09-10T23:25:51.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.378+0000 7fdf48e00640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf240725e0 0x7fdf24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.382+0000 7fdf48e00640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf240725e0 0x7fdf24074aa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800bb50 tx=0x7fdf3800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.382+0000 7fdf40c00640 1 -- 172.21.15.17:0/4058425112 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdf3c016030 con 0x7fdf4415bc70 2024-09-10T23:25:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.590+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf440b25b0 con 0x7fdf4415bc70 2024-09-10T23:25:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.590+0000 7fdf40c00640 1 -- 172.21.15.17:0/4058425112 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7fdf3c05e7f0 con 0x7fdf4415bc70 2024-09-10T23:25:51.594 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:51.594 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf240725e0 msgr2=0x7fdf24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf240725e0 0x7fdf24074aa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800bb50 tx=0x7fdf3800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf4415bc70 msgr2=0x7fdf440c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf4415bc70 0x7fdf440c7640 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00e990 tx=0x7fdf3c00ee50 comp rx=0 tx=0).stop 2024-09-10T23:25:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 shutdown_connections 2024-09-10T23:25:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdf240725e0 0x7fdf24074aa0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf4415bc70 0x7fdf440c7640 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf440d1ed0 0x7fdf440b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 --2- 172.21.15.17:0/4058425112 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf440cc570 0x7fdf440b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 >> 172.21.15.17:0/4058425112 conn(0x7fdf4409a9f0 msgr2=0x7fdf440b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 shutdown_connections 2024-09-10T23:25:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.594+0000 7fdf4a200640 1 -- 172.21.15.17:0/4058425112 wait complete. 2024-09-10T23:25:51.616 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:25:51.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:25:51.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.758+0000 7f1b06400640 1 -- 172.21.15.17:0/870376718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b00070ad0 msgr2=0x7f1b0015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.758+0000 7f1b06400640 1 --2- 172.21.15.17:0/870376718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b00070ad0 0x7f1b0015f060 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1b000cf010 tx=0x7f1af001c820 comp rx=0 tx=0).stop 2024-09-10T23:25:51.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.758+0000 7f1b06400640 1 -- 172.21.15.17:0/870376718 shutdown_connections 2024-09-10T23:25:51.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.758+0000 7f1b06400640 1 --2- 172.21.15.17:0/870376718 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b000d1830 0x7f1b0015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.758+0000 7f1b06400640 1 --2- 172.21.15.17:0/870376718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b00070ad0 0x7f1b0015f060 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.758+0000 7f1b06400640 1 -- 172.21.15.17:0/870376718 >> 172.21.15.17:0/870376718 conn(0x7f1b000d1d60 msgr2=0x7f1b000d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:51.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.758+0000 7f1b06400640 1 -- 172.21.15.17:0/870376718 shutdown_connections 2024-09-10T23:25:51.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.758+0000 7f1b06400640 1 -- 172.21.15.17:0/870376718 wait complete. 2024-09-10T23:25:51.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 Processor -- start 2024-09-10T23:25:51.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 -- start start 2024-09-10T23:25:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b00070ad0 0x7f1b000b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b000cf320 0x7f1b00159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b000d1830 0x7f1b000b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1b001693d0 con 0x7f1b00070ad0 2024-09-10T23:25:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1b00169250 con 0x7f1b000d1830 2024-09-10T23:25:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1b00169550 con 0x7f1b000cf320 2024-09-10T23:25:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1aff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b00070ad0 0x7f1b000b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b000cf320 0x7f1b00159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1aff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b00070ad0 0x7f1b000b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46068/0 (socket says 172.21.15.17:46068) 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1affe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b000d1830 0x7f1b000b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b000cf320 0x7f1b00159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:60426/0 (socket says 172.21.15.17:60426) 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1aff400640 1 -- 172.21.15.17:0/3511130781 learned_addr learned my addr 172.21.15.17:0/3511130781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7e00640 1 -- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b000d1830 msgr2=0x7f1b000b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7e00640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b000d1830 0x7f1b000b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7e00640 1 -- 172.21.15.17:0/3511130781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b00070ad0 msgr2=0x7f1b000b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7e00640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b00070ad0 0x7f1b000b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7e00640 1 -- 172.21.15.17:0/3511130781 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b000b2720 con 0x7f1b000cf320 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1aff400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b00070ad0 0x7f1b000b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7e00640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b000cf320 0x7f1b00159e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800e6c0 tx=0x7f1ae800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7400640 1 -- 172.21.15.17:0/3511130781 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae800cab0 con 0x7f1b000cf320 2024-09-10T23:25:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7400640 1 -- 172.21.15.17:0/3511130781 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ae800cd40 con 0x7f1b000cf320 2024-09-10T23:25:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1af7400640 1 -- 172.21.15.17:0/3511130781 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8010690 con 0x7f1b000cf320 2024-09-10T23:25:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b000b2a00 con 0x7f1b000cf320 2024-09-10T23:25:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.762+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b000b4f10 con 0x7f1b000cf320 2024-09-10T23:25:51.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.766+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b000cfc60 con 0x7f1b000cf320 2024-09-10T23:25:51.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.766+0000 7f1af7400640 1 -- 172.21.15.17:0/3511130781 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1ae803daa0 con 0x7f1b000cf320 2024-09-10T23:25:51.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.766+0000 7f1af7400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1adc0725e0 0x7f1adc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:51.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.766+0000 7f1af7400640 1 -- 172.21.15.17:0/3511130781 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f1ae8093d30 con 0x7f1b000cf320 2024-09-10T23:25:51.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.766+0000 7f1aff400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1adc0725e0 0x7f1adc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:51.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.770+0000 7f1aff400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1adc0725e0 0x7f1adc074aa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1af001aed0 tx=0x7f1af001b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:51.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:51.770+0000 7f1af7400640 1 -- 172.21.15.17:0/3511130781 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1ae805ec10 con 0x7f1b000cf320 2024-09-10T23:25:52.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.006+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1b000afd30 con 0x7f1b000cf320 2024-09-10T23:25:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.006+0000 7f1af7400640 1 -- 172.21.15.17:0/3511130781 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f1ae8063640 con 0x7f1b000cf320 2024-09-10T23:25:52.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:52.011 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":641,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078285443,"bytes_used":2629406720,"bytes_avail":770464706560,"bytes_total":773094113280,"write_bytes_sec":44180384,"read_op_per_sec":0,"write_op_per_sec":51},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-10T23:25:02.429010+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1adc0725e0 msgr2=0x7f1adc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1adc0725e0 0x7f1adc074aa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1af001aed0 tx=0x7f1af001b060 comp rx=0 tx=0).stop 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b000cf320 msgr2=0x7f1b00159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b000cf320 0x7f1b00159e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800e6c0 tx=0x7f1ae800eb80 comp rx=0 tx=0).stop 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 shutdown_connections 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1adc0725e0 0x7f1adc074aa0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b000d1830 0x7f1b000b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1b000cf320 0x7f1b00159e20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 --2- 172.21.15.17:0/3511130781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b00070ad0 0x7f1b000b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 >> 172.21.15.17:0/3511130781 conn(0x7f1b000d1d60 msgr2=0x7f1b0015e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 shutdown_connections 2024-09-10T23:25:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:52.010+0000 7f1b06400640 1 -- 172.21.15.17:0/3511130781 wait complete. 2024-09-10T23:25:52.034 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:25:53.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 -- 172.21.15.17:0/2746194759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40b32d0 msgr2=0x7f1ea4150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 --2- 172.21.15.17:0/2746194759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40b32d0 0x7f1ea4150d70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00acd0 tx=0x7f1e9c0205f0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 -- 172.21.15.17:0/2746194759 shutdown_connections 2024-09-10T23:25:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 --2- 172.21.15.17:0/2746194759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40b32d0 0x7f1ea4150d70 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 --2- 172.21.15.17:0/2746194759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea40cf230 0x7f1ea406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 -- 172.21.15.17:0/2746194759 >> 172.21.15.17:0/2746194759 conn(0x7f1ea406cfc0 msgr2=0x7f1ea406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 -- 172.21.15.17:0/2746194759 shutdown_connections 2024-09-10T23:25:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 -- 172.21.15.17:0/2746194759 wait complete. 2024-09-10T23:25:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 Processor -- start 2024-09-10T23:25:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.190+0000 7f1ea9000640 1 -- start start 2024-09-10T23:25:53.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea9000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40b32d0 0x7f1ea4149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea9000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea40cf230 0x7f1ea40b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea9000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea40cf610 0x7f1ea414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea9000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea40d0330 con 0x7f1ea40cf230 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea9000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea40d01b0 con 0x7f1ea40b32d0 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea9000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea40d04b0 con 0x7f1ea40cf610 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea40cf230 0x7f1ea40b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea40cf230 0x7f1ea40b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46072/0 (socket says 172.21.15.17:46072) 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9be00640 1 -- 172.21.15.17:0/2043554916 learned_addr learned my addr 172.21.15.17:0/2043554916 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea2800640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea40cf610 0x7f1ea414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea1e00640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40b32d0 0x7f1ea4149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9be00640 1 -- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea40cf610 msgr2=0x7f1ea414c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9be00640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea40cf610 0x7f1ea414c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9be00640 1 -- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40b32d0 msgr2=0x7f1ea4149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9be00640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40b32d0 0x7f1ea4149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9be00640 1 -- 172.21.15.17:0/2043554916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea41f27f0 con 0x7f1ea40cf230 2024-09-10T23:25:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9be00640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea40cf230 0x7f1ea40b1030 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00c500 tx=0x7f1e8c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9a000640 1 -- 172.21.15.17:0/2043554916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c016020 con 0x7f1ea40cf230 2024-09-10T23:25:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea41f2ad0 con 0x7f1ea40cf230 2024-09-10T23:25:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9a000640 1 -- 172.21.15.17:0/2043554916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e8c012940 con 0x7f1ea40cf230 2024-09-10T23:25:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1e9a000640 1 -- 172.21.15.17:0/2043554916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c012d90 con 0x7f1ea40cf230 2024-09-10T23:25:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea41f3090 con 0x7f1ea40cf230 2024-09-10T23:25:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.194+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea4150d70 con 0x7f1ea40cf230 2024-09-10T23:25:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.198+0000 7f1e9a000640 1 -- 172.21.15.17:0/2043554916 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1e8c01b400 con 0x7f1ea40cf230 2024-09-10T23:25:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.198+0000 7f1e9a000640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e800725e0 0x7f1e80074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.198+0000 7f1e9a000640 1 -- 172.21.15.17:0/2043554916 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f1e8c093810 con 0x7f1ea40cf230 2024-09-10T23:25:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.198+0000 7f1ea1e00640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e800725e0 0x7f1e80074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.198+0000 7f1ea1e00640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e800725e0 0x7f1e80074aa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009be0 tx=0x7f1e940091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.202+0000 7f1e9a000640 1 -- 172.21.15.17:0/2043554916 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1e8c020020 con 0x7f1ea40cf230 2024-09-10T23:25:53.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ea41f3260 con 0x7f1ea40cf230 2024-09-10T23:25:53.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1e9a000640 1 -- 172.21.15.17:0/2043554916 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f1e8c05e680 con 0x7f1ea40cf230 2024-09-10T23:25:53.417 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:53.418 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:53.418 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e800725e0 msgr2=0x7f1e80074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e800725e0 0x7f1e80074aa0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009be0 tx=0x7f1e940091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea40cf230 msgr2=0x7f1ea40b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea40cf230 0x7f1ea40b1030 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00c500 tx=0x7f1e8c00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 shutdown_connections 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1e800725e0 0x7f1e80074aa0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1ea40cf610 0x7f1ea414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ea40cf230 0x7f1ea40b1030 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 --2- 172.21.15.17:0/2043554916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ea40b32d0 0x7f1ea4149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 >> 172.21.15.17:0/2043554916 conn(0x7f1ea406cfc0 msgr2=0x7f1ea406fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.414+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 shutdown_connections 2024-09-10T23:25:53.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.418+0000 7f1ea9000640 1 -- 172.21.15.17:0/2043554916 wait complete. 2024-09-10T23:25:53.438 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:25:53.439 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:25:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 -- 172.21.15.17:0/3823560713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3415c570 msgr2=0x7fba34073630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 --2- 172.21.15.17:0/3823560713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3415c570 0x7fba34073630 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fba24009840 tx=0x7fba2401c7f0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 -- 172.21.15.17:0/3823560713 shutdown_connections 2024-09-10T23:25:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 --2- 172.21.15.17:0/3823560713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3415c570 0x7fba34073630 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 -- 172.21.15.17:0/3823560713 >> 172.21.15.17:0/3823560713 conn(0x7fba340691b0 msgr2=0x7fba340695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 -- 172.21.15.17:0/3823560713 shutdown_connections 2024-09-10T23:25:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 -- 172.21.15.17:0/3823560713 wait complete. 2024-09-10T23:25:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 Processor -- start 2024-09-10T23:25:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 -- start start 2024-09-10T23:25:53.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3406f710 0x7fba341656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:53.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3415c570 0x7fba341f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:53.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3415c950 0x7fba34163910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba3416a600 con 0x7fba3415c570 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba3416a480 con 0x7fba3406f710 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba3aa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fba3416a780 con 0x7fba3415c950 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3415c570 0x7fba341f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3415c570 0x7fba341f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46082/0 (socket says 172.21.15.17:46082) 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba2be00640 1 -- 172.21.15.17:0/3079047873 learned_addr learned my addr 172.21.15.17:0/3079047873 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba33e00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3406f710 0x7fba341656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba38a00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3415c950 0x7fba34163910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba2be00640 1 -- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3415c950 msgr2=0x7fba34163910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba2be00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3415c950 0x7fba34163910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba2be00640 1 -- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3406f710 msgr2=0x7fba341656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba2be00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3406f710 0x7fba341656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba2be00640 1 -- 172.21.15.17:0/3079047873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba34165d80 con 0x7fba3415c570 2024-09-10T23:25:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.582+0000 7fba33e00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3406f710 0x7fba341656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.586+0000 7fba2be00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3415c570 0x7fba341f8a60 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c3c0 tx=0x7fba1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.586+0000 7fba30c00640 1 -- 172.21.15.17:0/3079047873 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c011790 con 0x7fba3415c570 2024-09-10T23:25:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.586+0000 7fba30c00640 1 -- 172.21.15.17:0/3079047873 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba1c017070 con 0x7fba3415c570 2024-09-10T23:25:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.586+0000 7fba30c00640 1 -- 172.21.15.17:0/3079047873 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c011ca0 con 0x7fba3415c570 2024-09-10T23:25:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.586+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba34166060 con 0x7fba3415c570 2024-09-10T23:25:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.586+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba34166620 con 0x7fba3415c570 2024-09-10T23:25:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.586+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba34073630 con 0x7fba3415c570 2024-09-10T23:25:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.586+0000 7fba30c00640 1 -- 172.21.15.17:0/3079047873 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fba1c01c460 con 0x7fba3415c570 2024-09-10T23:25:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.590+0000 7fba30c00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.590+0000 7fba30c00640 1 -- 172.21.15.17:0/3079047873 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fba1c0931c0 con 0x7fba3415c570 2024-09-10T23:25:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.590+0000 7fba33e00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.590+0000 7fba33e00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba240af000 tx=0x7fba2401b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.594+0000 7fba30c00640 1 -- 172.21.15.17:0/3079047873 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fba1c05e670 con 0x7fba3415c570 2024-09-10T23:25:53.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.826+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fba3406f100 con 0x7fba3415c570 2024-09-10T23:25:53.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.826+0000 7fba30c00640 1 -- 172.21.15.17:0/3079047873 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fba1c05df70 con 0x7fba3415c570 2024-09-10T23:25:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:53.831 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":642,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078285443,"bytes_used":2629406720,"bytes_avail":770464706560,"bytes_total":773094113280,"write_bytes_sec":26876571,"read_op_per_sec":0,"write_op_per_sec":33},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-10T23:25:52.440874+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}}}}}},"progress_events":{}} 2024-09-10T23:25:53.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 msgr2=0x7fba10074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba240af000 tx=0x7fba2401b030 comp rx=0 tx=0).stop 2024-09-10T23:25:53.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3415c570 msgr2=0x7fba341f8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:53.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3415c570 0x7fba341f8a60 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c3c0 tx=0x7fba1c00c880 comp rx=0 tx=0).stop 2024-09-10T23:25:53.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 shutdown_connections 2024-09-10T23:25:53.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba3415c950 0x7fba34163910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba3415c570 0x7fba341f8a60 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 --2- 172.21.15.17:0/3079047873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba3406f710 0x7fba341656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:53.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 >> 172.21.15.17:0/3079047873 conn(0x7fba340691b0 msgr2=0x7fba34152910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:53.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 shutdown_connections 2024-09-10T23:25:53.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:53.830+0000 7fba3aa00640 1 -- 172.21.15.17:0/3079047873 wait complete. 2024-09-10T23:25:53.853 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused paths [/scrub_control_test_path]'} 2024-09-10T23:25:53.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:53.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-09-10T23:25:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 -- 172.21.15.17:0/3567121127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2dc00b4db0 msgr2=0x7f2dc00b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 --2- 172.21.15.17:0/3567121127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2dc00b4db0 0x7f2dc00b1910 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009bc0 tx=0x7f2db801ca80 comp rx=0 tx=0).stop 2024-09-10T23:25:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 -- 172.21.15.17:0/3567121127 shutdown_connections 2024-09-10T23:25:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 --2- 172.21.15.17:0/3567121127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2dc00b4db0 0x7f2dc00b1910 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 --2- 172.21.15.17:0/3567121127 >> v2:172.21.15.77:3300/0 conn(0x7f2dc00b47f0 0x7f2dc00d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 -- 172.21.15.17:0/3567121127 >> 172.21.15.17:0/3567121127 conn(0x7f2dc00d3ef0 msgr2=0x7f2dc00d42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 -- 172.21.15.17:0/3567121127 shutdown_connections 2024-09-10T23:25:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 -- 172.21.15.17:0/3567121127 wait complete. 2024-09-10T23:25:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 Processor -- start 2024-09-10T23:25:54.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.002+0000 7f2dc7600640 1 -- start start 2024-09-10T23:25:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc7600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc00b47f0 0x7f2dc0152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc7600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2dc00b4db0 0x7f2dc00b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc7600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dc01624d0 0x7f2dc00b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc7600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc016b060 con 0x7f2dc00b47f0 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc7600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc00b2c60 con 0x7f2dc01624d0 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc7600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc016b1e0 con 0x7f2dc00b4db0 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc00b47f0 0x7f2dc0152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc00b47f0 0x7f2dc0152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46084/0 (socket says 172.21.15.17:46084) 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc4c00640 1 -- 172.21.15.17:0/1043535381 learned_addr learned my addr 172.21.15.17:0/1043535381 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc5600640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dc01624d0 0x7f2dc00b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2dc00b4db0 0x7f2dc00b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc4c00640 1 -- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2dc00b4db0 msgr2=0x7f2dc00b8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2dc00b4db0 0x7f2dc00b8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc4c00640 1 -- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dc01624d0 msgr2=0x7f2dc00b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dc01624d0 0x7f2dc00b9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc4c00640 1 -- 172.21.15.17:0/1043535381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc00cfa80 con 0x7f2dc00b47f0 2024-09-10T23:25:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc5600640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dc01624d0 0x7f2dc00b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc00b47f0 0x7f2dc0152cf0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c400 tx=0x7f2db400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dbcc00640 1 -- 172.21.15.17:0/1043535381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4011790 con 0x7f2dc00b47f0 2024-09-10T23:25:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dbcc00640 1 -- 172.21.15.17:0/1043535381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db4017070 con 0x7f2dc00b47f0 2024-09-10T23:25:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc7600640 1 -- 172.21.15.17:0/1043535381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc00cd720 con 0x7f2dc00b47f0 2024-09-10T23:25:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dbcc00640 1 -- 172.21.15.17:0/1043535381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4011cc0 con 0x7f2dc00b47f0 2024-09-10T23:25:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.006+0000 7f2dc7600640 1 -- 172.21.15.17:0/1043535381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc00cdce0 con 0x7f2dc00b47f0 2024-09-10T23:25:54.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dbcc00640 1 -- 172.21.15.17:0/1043535381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2db401c460 con 0x7f2dc00b47f0 2024-09-10T23:25:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dbcc00640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2da00725e0 0x7f2da0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dca7ff000 1 Processor -- start 2024-09-10T23:25:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dbcc00640 1 -- 172.21.15.17:0/1043535381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f2db40930c0 con 0x7f2dc00b47f0 2024-09-10T23:25:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dca7ff000 1 -- start start 2024-09-10T23:25:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2da00725e0 0x7f2da0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 0x5579aa5a9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2da00725e0 0x7f2da0074aa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0154b80 tx=0x7f2dac0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 0x5579aa55f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa55fbc0 0x5579aa55ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5579aa447cb0 con 0x5579aa55fbc0 2024-09-10T23:25:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5579aa35d310 con 0x5579aa5a91a0 2024-09-10T23:25:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5579aa3bab90 con 0x5579aa5a9ac0 2024-09-10T23:25:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa55fbc0 0x5579aa55ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc4c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 0x5579aa5a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa55fbc0 0x5579aa55ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46100/0 (socket says 172.21.15.17:46100) 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc5600640 1 -- 172.21.15.17:0/4076451720 learned_addr learned my addr 172.21.15.17:0/4076451720 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/4076451720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 0x5579aa55f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc5600640 1 -- 172.21.15.17:0/4076451720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 msgr2=0x5579aa55f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc5600640 1 --2- 172.21.15.17:0/4076451720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 0x5579aa55f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc5600640 1 -- 172.21.15.17:0/4076451720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 msgr2=0x5579aa5a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc5600640 1 --2- 172.21.15.17:0/4076451720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 0x5579aa5a9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc5600640 1 -- 172.21.15.17:0/4076451720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579aa35ec60 con 0x5579aa55fbc0 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/4076451720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 0x5579aa5a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2dc5600640 1 --2- 172.21.15.17:0/4076451720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa55fbc0 0x5579aa55ffa0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2db801b130 tx=0x7f2db8019820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815595a8ae54cc6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2db1600640 1 -- 172.21.15.17:0/4076451720 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db80bb070 con 0x5579aa55fbc0 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2db1600640 1 -- 172.21.15.17:0/4076451720 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db80a5c60 con 0x5579aa55fbc0 2024-09-10T23:25:54.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.010+0000 7f2db1600640 1 -- 172.21.15.17:0/4076451720 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db80b2040 con 0x5579aa55fbc0 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4076451720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa55fbc0 msgr2=0x5579aa55ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/4076451720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa55fbc0 0x5579aa55ffa0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2db801b130 tx=0x7f2db8019820 comp rx=0 tx=0).stop 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4076451720 shutdown_connections 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/4076451720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa55fbc0 0x5579aa55ffa0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/4076451720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 0x5579aa55f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/4076451720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 0x5579aa5a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4076451720 >> 172.21.15.17:0/4076451720 conn(0x5579aa565d20 msgr2=0x5579aa55df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4076451720 shutdown_connections 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4076451720 wait complete. 2024-09-10T23:25:54.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- start start 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 Processor -- start 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 0x5579aa5b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a91a0 0x5579aa5b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 0x5579aa5b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5579aa3addd0 con 0x5579aa5a91a0 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5579aa3a9fc0 con 0x5579aa55fbc0 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5579aa34f4b0 con 0x5579aa5a9ac0 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 10 client.0 _ll_register_callbacks cb 0x5579aa32d7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dbfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a91a0 0x5579aa5b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dc4c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 0x5579aa5b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dbfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a91a0 0x5579aa5b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46102/0 (socket says 172.21.15.17:46102) 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dbfe00640 1 -- 172.21.15.17:0/1684077658 learned_addr learned my addr 172.21.15.17:0/1684077658 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dc5600640 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 0x5579aa5b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dbfe00640 1 -- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 msgr2=0x5579aa5b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 0x5579aa5b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dbfe00640 1 -- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 msgr2=0x5579aa5b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 0x5579aa5b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dbfe00640 1 -- 172.21.15.17:0/1684077658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579aa3481f0 con 0x5579aa5a91a0 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 0x5579aa5b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a91a0 0x5579aa5b0a70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00b4c00 tx=0x7f2dac004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb51bd4f799c566 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2da6000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2da6000640 1 -- 172.21.15.17:0/1684077658 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac005020 con 0x5579aa5a91a0 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2da6000640 1 -- 172.21.15.17:0/1684077658 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f2dac0051c0 con 0x5579aa5a91a0 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- 172.21.15.17:0/1684077658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5579aa342330 con 0x5579aa5a91a0 2024-09-10T23:25:54.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2da6000640 1 -- 172.21.15.17:0/1684077658 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f2dac02f050 con 0x5579aa5a91a0 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 10 client.8943 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.014+0000 7f2dca7ff000 1 -- 172.21.15.17:0/1684077658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x5579aa32efa0 con 0x5579aa5a91a0 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2da6000640 1 -- 172.21.15.17:0/1684077658 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5579aa342330 con 0x5579aa5a91a0 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2da6000640 1 -- 172.21.15.17:0/1684077658 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f2dac0053c0 con 0x5579aa5a91a0 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 10 client.8943 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 10 client.8943 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 20 client.8943 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5579aa5b8900 0x5579aa5bacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 4 client.8943 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:54.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 -- 172.21.15.17:0/1684077658 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579aa3bcae0 con 0x5579aa5b8900 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5579aa5b8900 0x5579aa5bacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2da6000640 10 client.8943 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5579aa5b8900 0x5579aa5bacf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3fcf70a79a3e46 server_cookie=90ca23eacad202fe in_seq=0 out_seq=0 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2da6000640 1 -- 172.21.15.17:0/1684077658 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5579aa3bcae0 con 0x5579aa5b8900 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2da6000640 10 client.8943 handle_command_reply: tid=0 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 client.8943 shutdown 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 -- 172.21.15.17:0/1684077658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a91a0 msgr2=0x5579aa5b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a91a0 0x5579aa5b0a70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00b4c00 tx=0x7f2dac004740 comp rx=0 tx=0).stop 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 -- 172.21.15.17:0/1684077658 shutdown_connections 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5579aa5b8900 0x5579aa5bacf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a9ac0 0x5579aa5b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a91a0 0x5579aa5b0a70 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2da6000640 0 client.8943 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/1684077658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 0x5579aa5b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 -- 172.21.15.17:0/1684077658 >> 172.21.15.17:0/1684077658 conn(0x5579aa565d20 msgr2=0x5579aa55df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 -- 172.21.15.17:0/1684077658 shutdown_connections 2024-09-10T23:25:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 1 -- 172.21.15.17:0/1684077658 wait complete. 2024-09-10T23:25:54.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.018+0000 7f2dca7ff000 20 client.8943 trim_cache size 0 max 16384 2024-09-10T23:25:54.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 Processor -- start 2024-09-10T23:25:54.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 -- start start 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 0x5579aa5b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a91a0 0x5579aa5b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc0204560 con 0x5579aa5a9ac0 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc00cb280 con 0x5579aa55fbc0 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc01fbd20 con 0x5579aa5a91a0 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46114/0 (socket says 172.21.15.17:46114) 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc5600640 1 -- 172.21.15.17:0/4001484317 learned_addr learned my addr 172.21.15.17:0/4001484317 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 0x5579aa5b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a91a0 0x5579aa5b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc5600640 1 -- 172.21.15.17:0/4001484317 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a91a0 msgr2=0x5579aa5b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc5600640 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a91a0 0x5579aa5b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc5600640 1 -- 172.21.15.17:0/4001484317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 msgr2=0x5579aa5b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc5600640 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 0x5579aa5b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc5600640 1 -- 172.21.15.17:0/4001484317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579aa407660 con 0x5579aa5a9ac0 2024-09-10T23:25:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a91a0 0x5579aa5b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:25:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dc5600640 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5b3d90 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009370 tx=0x7f2db8009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161096505db6fd0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2db0c00640 1 -- 172.21.15.17:0/4001484317 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db80bb040 con 0x5579aa5a9ac0 2024-09-10T23:25:54.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2db0c00640 1 -- 172.21.15.17:0/4001484317 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db80c4030 con 0x5579aa5a9ac0 2024-09-10T23:25:54.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2db0c00640 1 -- 172.21.15.17:0/4001484317 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db80b2040 con 0x5579aa5a9ac0 2024-09-10T23:25:54.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4001484317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 msgr2=0x5579aa5b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5b3d90 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009370 tx=0x7f2db8009500 comp rx=0 tx=0).stop 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4001484317 shutdown_connections 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5b3d90 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa5a91a0 0x5579aa5b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/4001484317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa55fbc0 0x5579aa5b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4001484317 >> 172.21.15.17:0/4001484317 conn(0x5579aa565d20 msgr2=0x5579aa55ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4001484317 shutdown_connections 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.038+0000 7f2dca7ff000 1 -- 172.21.15.17:0/4001484317 wait complete. 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 -- start start 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 Processor -- start 2024-09-10T23:25:54.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa55fbc0 0x5579aa5b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 0x5579aa5b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5db210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5579aa568d40 con 0x5579aa5a9ac0 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5579aa566100 con 0x5579aa5a91a0 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5579aa3a4ec0 con 0x5579aa55fbc0 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 10 client.0 _ll_register_callbacks cb 0x7f2dac005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5db210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5db210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46116/0 (socket says 172.21.15.17:46116) 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc5600640 1 -- 172.21.15.17:0/2729618463 learned_addr learned my addr 172.21.15.17:0/2729618463 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa55fbc0 0x5579aa5b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dbfe00640 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 0x5579aa5b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc5600640 1 -- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa55fbc0 msgr2=0x5579aa5b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc5600640 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa55fbc0 0x5579aa5b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc5600640 1 -- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 msgr2=0x5579aa5b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc5600640 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 0x5579aa5b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc5600640 1 -- 172.21.15.17:0/2729618463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579aa374090 con 0x5579aa5a9ac0 2024-09-10T23:25:54.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa55fbc0 0x5579aa5b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:54.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc5600640 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5db210 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f2db80a7040 tx=0x7f2db8005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b138a341381abe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2da6000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:54.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2da6000640 1 -- 172.21.15.17:0/2729618463 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db80cd060 con 0x5579aa5a9ac0 2024-09-10T23:25:54.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2da6000640 1 -- 172.21.15.17:0/2729618463 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f2db8004a50 con 0x5579aa5a9ac0 2024-09-10T23:25:54.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 -- 172.21.15.17:0/2729618463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2db80c4030 con 0x5579aa5a9ac0 2024-09-10T23:25:54.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2da6000640 1 -- 172.21.15.17:0/2729618463 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f2db80d3050 con 0x5579aa5a9ac0 2024-09-10T23:25:54.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 10 client.8949 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:54.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 -- 172.21.15.17:0/2729618463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x5579aa3405f0 con 0x5579aa5a9ac0 2024-09-10T23:25:54.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2da6000640 1 -- 172.21.15.17:0/2729618463 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db80c4030 con 0x5579aa5a9ac0 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2da6000640 1 -- 172.21.15.17:0/2729618463 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f2db80d6020 con 0x5579aa5a9ac0 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 10 client.8949 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 10 client.8949 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 20 client.8949 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5579aa5dbbd0 0x5579aa61f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 4 client.8949 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dca7ff000 1 -- 172.21.15.17:0/2729618463 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x5579aa3b8590 con 0x5579aa5dbbd0 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5579aa5dbbd0 0x5579aa61f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2dc4c00640 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5579aa5dbbd0 0x5579aa61f090 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44b6de1d70869a1c server_cookie=9861929dfa3da385 in_seq=0 out_seq=0 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.042+0000 7f2da6000640 10 client.8949 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2da6000640 1 -- 172.21.15.17:0/2729618463 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5579aa3b8590 con 0x5579aa5dbbd0 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2da6000640 10 client.8949 handle_command_reply: tid=0 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 client.8949 shutdown 2024-09-10T23:25:54.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 -- 172.21.15.17:0/2729618463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 msgr2=0x5579aa5db210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5db210 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f2db80a7040 tx=0x7f2db8005510 comp rx=0 tx=0).stop 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 -- 172.21.15.17:0/2729618463 shutdown_connections 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x5579aa5dbbd0 0x5579aa61f090 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579aa5a9ac0 0x5579aa5db210 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579aa5a91a0 0x5579aa5b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 --2- 172.21.15.17:0/2729618463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579aa55fbc0 0x5579aa5b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2da6000640 0 client.8949 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 -- 172.21.15.17:0/2729618463 >> 172.21.15.17:0/2729618463 conn(0x5579aa565d20 msgr2=0x5579aa55f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 -- 172.21.15.17:0/2729618463 shutdown_connections 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 1 -- 172.21.15.17:0/2729618463 wait complete. 2024-09-10T23:25:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dca7ff000 20 client.8949 trim_cache size 0 max 16384 2024-09-10T23:25:54.053 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:25:54.053 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:25:54.053 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:25:54.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 -- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2da00725e0 msgr2=0x7f2da0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2da00725e0 0x7f2da0074aa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0154b80 tx=0x7f2dac0091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 -- 172.21.15.17:0/1043535381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc00b47f0 msgr2=0x7f2dc0152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc00b47f0 0x7f2dc0152cf0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c400 tx=0x7f2db400c8c0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 -- 172.21.15.17:0/1043535381 shutdown_connections 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2da00725e0 0x7f2da0074aa0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dc01624d0 0x7f2dc00b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2dc00b4db0 0x7f2dc00b8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 --2- 172.21.15.17:0/1043535381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc00b47f0 0x7f2dc0152cf0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 -- 172.21.15.17:0/1043535381 >> 172.21.15.17:0/1043535381 conn(0x7f2dc00d3ef0 msgr2=0x7f2dc006ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 -- 172.21.15.17:0/1043535381 shutdown_connections 2024-09-10T23:25:54.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.046+0000 7f2dc7600640 1 -- 172.21.15.17:0/1043535381 wait complete. 2024-09-10T23:25:54.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:25:54.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-10T23:25:54.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 -- 172.21.15.17:0/3753557475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 msgr2=0x7faea80cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 --2- 172.21.15.17:0/3753557475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 0x7faea80cf4b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7faea0009c80 tx=0x7faea001cd10 comp rx=0 tx=0).stop 2024-09-10T23:25:54.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 -- 172.21.15.17:0/3753557475 shutdown_connections 2024-09-10T23:25:54.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 --2- 172.21.15.17:0/3753557475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 0x7faea80cf4b0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 --2- 172.21.15.17:0/3753557475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faea815dd40 0x7faea80cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 -- 172.21.15.17:0/3753557475 >> 172.21.15.17:0/3753557475 conn(0x7faea80d0b40 msgr2=0x7faea80d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 -- 172.21.15.17:0/3753557475 shutdown_connections 2024-09-10T23:25:54.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 -- 172.21.15.17:0/3753557475 wait complete. 2024-09-10T23:25:54.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 Processor -- start 2024-09-10T23:25:54.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.234+0000 7faead400640 1 -- start start 2024-09-10T23:25:54.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faead400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 0x7faea81578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faead400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faea815dd40 0x7faea8163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faead400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea815e120 0x7faea8163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faead400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faea8167f30 con 0x7faea8073d40 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faead400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faea8167db0 con 0x7faea815e120 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faead400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faea81680b0 con 0x7faea815dd40 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 0x7faea81578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 0x7faea81578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46124/0 (socket says 172.21.15.17:46124) 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7e00640 1 -- 172.21.15.17:0/542302091 learned_addr learned my addr 172.21.15.17:0/542302091 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7400640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faea815dd40 0x7faea8163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faeaca00640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea815e120 0x7faea8163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7e00640 1 -- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faea815dd40 msgr2=0x7faea8163890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7e00640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faea815dd40 0x7faea8163890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7e00640 1 -- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea815e120 msgr2=0x7faea8163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7e00640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea815e120 0x7faea8163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7e00640 1 -- 172.21.15.17:0/542302091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea80c7cb0 con 0x7faea8073d40 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faeaca00640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea815e120 0x7faea8163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faea7e00640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 0x7faea81578c0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fae9800e9f0 tx=0x7fae9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7fae9fe00640 1 -- 172.21.15.17:0/542302091 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9800cd80 con 0x7faea8073d40 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7fae9fe00640 1 -- 172.21.15.17:0/542302091 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae98010430 con 0x7faea8073d40 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faead400640 1 -- 172.21.15.17:0/542302091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea80b5280 con 0x7faea8073d40 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7fae9fe00640 1 -- 172.21.15.17:0/542302091 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98010860 con 0x7faea8073d40 2024-09-10T23:25:54.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.238+0000 7faead400640 1 -- 172.21.15.17:0/542302091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea80b5560 con 0x7faea8073d40 2024-09-10T23:25:54.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.242+0000 7fae9fe00640 1 -- 172.21.15.17:0/542302091 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fae98010a00 con 0x7faea8073d40 2024-09-10T23:25:54.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.242+0000 7fae9fe00640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae880725e0 0x7fae88074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.242+0000 7fae9fe00640 1 -- 172.21.15.17:0/542302091 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fae98093f10 con 0x7faea8073d40 2024-09-10T23:25:54.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.242+0000 7faea7400640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae880725e0 0x7fae88074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.242+0000 7faeb1e10000 1 Processor -- start 2024-09-10T23:25:54.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.242+0000 7faeb1e10000 1 -- start start 2024-09-10T23:25:54.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.242+0000 7faea7400640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae880725e0 0x7fae88074aa0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7faea80cb000 tx=0x7fae94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 0x556d52f84680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52f84bc0 0x556d52f84fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556d52e6ccb0 con 0x556d52fce1a0 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556d52d82310 con 0x556d52fceac0 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556d52ddfb90 con 0x556d52f84bc0 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 0x556d52f84680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 0x556d52f84680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:49600/0 (socket says 172.21.15.17:49600) 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7400640 1 -- 172.21.15.17:0/1485633027 learned_addr learned my addr 172.21.15.17:0/1485633027 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46138/0 (socket says 172.21.15.17:46138) 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeaca00640 1 --2- 172.21.15.17:0/1485633027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52f84bc0 0x556d52f84fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7e00640 1 -- 172.21.15.17:0/1485633027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52f84bc0 msgr2=0x556d52f84fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7e00640 1 --2- 172.21.15.17:0/1485633027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52f84bc0 0x556d52f84fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7e00640 1 -- 172.21.15.17:0/1485633027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 msgr2=0x556d52f84680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7e00640 1 --2- 172.21.15.17:0/1485633027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 0x556d52f84680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7e00640 1 -- 172.21.15.17:0/1485633027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d52d83c60 con 0x556d52fce1a0 2024-09-10T23:25:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faea7e00640 1 --2- 172.21.15.17:0/1485633027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fce580 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fae9805ebc0 tx=0x7fae9805ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd126510310bc977 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7fae9cc00640 1 -- 172.21.15.17:0/1485633027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98068310 con 0x556d52fce1a0 2024-09-10T23:25:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7fae9cc00640 1 -- 172.21.15.17:0/1485633027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae98010d20 con 0x556d52fce1a0 2024-09-10T23:25:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7fae9cc00640 1 -- 172.21.15.17:0/1485633027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98066be0 con 0x556d52fce1a0 2024-09-10T23:25:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 -- 172.21.15.17:0/1485633027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 msgr2=0x556d52fce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 --2- 172.21.15.17:0/1485633027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fce580 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fae9805ebc0 tx=0x7fae9805ea90 comp rx=0 tx=0).stop 2024-09-10T23:25:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 -- 172.21.15.17:0/1485633027 shutdown_connections 2024-09-10T23:25:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 --2- 172.21.15.17:0/1485633027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52f84bc0 0x556d52f84fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 --2- 172.21.15.17:0/1485633027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 0x556d52f84680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 --2- 172.21.15.17:0/1485633027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fce580 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 -- 172.21.15.17:0/1485633027 >> 172.21.15.17:0/1485633027 conn(0x556d52f8ad20 msgr2=0x556d52f82f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 -- 172.21.15.17:0/1485633027 shutdown_connections 2024-09-10T23:25:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 -- 172.21.15.17:0/1485633027 wait complete. 2024-09-10T23:25:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 -- start start 2024-09-10T23:25:54.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.246+0000 7faeb1e10000 1 Processor -- start 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d52fd5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fd5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 0x556d52fd5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556d52dd2dd0 con 0x556d52fce1a0 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556d52dcefc0 con 0x556d52f84bc0 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556d52d744b0 con 0x556d52fceac0 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 10 client.0 _ll_register_callbacks cb 0x556d52d527d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d52fd5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fd5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d52fd5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:49608/0 (socket says 172.21.15.17:49608) 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7e00640 1 -- 172.21.15.17:0/3213248788 learned_addr learned my addr 172.21.15.17:0/3213248788 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeaca00640 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 0x556d52fd5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7e00640 1 -- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 msgr2=0x556d52fd5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7e00640 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 0x556d52fd5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7e00640 1 -- 172.21.15.17:0/3213248788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 msgr2=0x556d52fd5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7e00640 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fd5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7e00640 1 -- 172.21.15.17:0/3213248788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d52d6d1f0 con 0x556d52f84bc0 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7e00640 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d52fd5530 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fae9805f080 tx=0x7fae98005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7d7dbe019ebf884 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7fae91600640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7fae91600640 1 -- 172.21.15.17:0/3213248788 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98086070 con 0x556d52f84bc0 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7fae91600640 1 -- 172.21.15.17:0/3213248788 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fae98066de0 con 0x556d52f84bc0 2024-09-10T23:25:54.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 -- 172.21.15.17:0/3213248788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556d52d67330 con 0x556d52f84bc0 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7fae91600640 1 -- 172.21.15.17:0/3213248788 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fae98068310 con 0x556d52f84bc0 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 10 client.8338 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 -- 172.21.15.17:0/3213248788 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x556d52d53fa0 con 0x556d52f84bc0 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7fae91600640 1 -- 172.21.15.17:0/3213248788 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556d52d67330 con 0x556d52f84bc0 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7fae91600640 1 -- 172.21.15.17:0/3213248788 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fae98089020 con 0x556d52f84bc0 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 10 client.8338 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 10 client.8338 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 20 client.8338 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x556d52fdd900 0x556d52fdfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 4 client.8338 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faeb1e10000 1 -- 172.21.15.17:0/3213248788 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d52de1ae0 con 0x556d52fdd900 2024-09-10T23:25:54.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.250+0000 7faea7400640 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x556d52fdd900 0x556d52fdfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faea7400640 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x556d52fdd900 0x556d52fdfcf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ecf34d32fef49f5 server_cookie=4dd0242200a92e3e in_seq=0 out_seq=0 2024-09-10T23:25:54.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7fae91600640 10 client.8338 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7fae91600640 1 -- 172.21.15.17:0/3213248788 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556d52de1ae0 con 0x556d52fdd900 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7fae91600640 10 client.8338 handle_command_reply: tid=0 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 client.8338 shutdown 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 -- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 msgr2=0x556d52fd5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d52fd5530 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fae9805f080 tx=0x7fae98005760 comp rx=0 tx=0).stop 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 -- 172.21.15.17:0/3213248788 shutdown_connections 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x556d52fdd900 0x556d52fdfcf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 0x556d52fd5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d52fd5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3213248788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d52fd5530 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 -- 172.21.15.17:0/3213248788 >> 172.21.15.17:0/3213248788 conn(0x556d52f8ad20 msgr2=0x556d52f82f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7fae91600640 0 client.8338 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:54.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 -- 172.21.15.17:0/3213248788 shutdown_connections 2024-09-10T23:25:54.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 1 -- 172.21.15.17:0/3213248788 wait complete. 2024-09-10T23:25:54.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.254+0000 7faeb1e10000 20 client.8338 trim_cache size 0 max 16384 2024-09-10T23:25:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 Processor -- start 2024-09-10T23:25:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 -- start start 2024-09-10T23:25:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52f84bc0 0x556d5303fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fce1a0 0x556d5303ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 0x556d530404a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7faea8204640 con 0x556d52f84bc0 2024-09-10T23:25:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faea8203680 con 0x556d52fceac0 2024-09-10T23:25:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7faea8202b50 con 0x556d52fce1a0 2024-09-10T23:25:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52f84bc0 0x556d5303fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52f84bc0 0x556d5303fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46152/0 (socket says 172.21.15.17:46152) 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7e00640 1 -- 172.21.15.17:0/3135976311 learned_addr learned my addr 172.21.15.17:0/3135976311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeaca00640 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 0x556d530404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7400640 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fce1a0 0x556d5303ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7e00640 1 -- 172.21.15.17:0/3135976311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fce1a0 msgr2=0x556d5303ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7e00640 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fce1a0 0x556d5303ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7e00640 1 -- 172.21.15.17:0/3135976311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 msgr2=0x556d530404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7e00640 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 0x556d530404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7e00640 1 -- 172.21.15.17:0/3135976311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d52e2c660 con 0x556d52f84bc0 2024-09-10T23:25:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7400640 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fce1a0 0x556d5303ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:54.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faea7e00640 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52f84bc0 0x556d5303fa20 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fae9805c130 tx=0x7fae98005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17d028bc6742a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7fae93e00640 1 -- 172.21.15.17:0/3135976311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98086070 con 0x556d52f84bc0 2024-09-10T23:25:54.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7fae93e00640 1 -- 172.21.15.17:0/3135976311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae98078be0 con 0x556d52f84bc0 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7fae93e00640 1 -- 172.21.15.17:0/3135976311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98092040 con 0x556d52f84bc0 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 -- 172.21.15.17:0/3135976311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52f84bc0 msgr2=0x556d5303fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52f84bc0 0x556d5303fa20 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fae9805c130 tx=0x7fae98005f20 comp rx=0 tx=0).stop 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 -- 172.21.15.17:0/3135976311 shutdown_connections 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52fceac0 0x556d530404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fce1a0 0x556d5303ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 --2- 172.21.15.17:0/3135976311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52f84bc0 0x556d5303fa20 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 -- 172.21.15.17:0/3135976311 >> 172.21.15.17:0/3135976311 conn(0x556d52f8ad20 msgr2=0x556d52f85e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 -- 172.21.15.17:0/3135976311 shutdown_connections 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.278+0000 7faeb1e10000 1 -- 172.21.15.17:0/3135976311 wait complete. 2024-09-10T23:25:54.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 -- start start 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 Processor -- start 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d53043290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d530437d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 0x556d53043d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x556d52f8dd40 con 0x556d52fce1a0 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556d52f8b100 con 0x556d52f84bc0 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x556d52dc9ec0 con 0x556d52fceac0 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 10 client.0 _ll_register_callbacks cb 0x7fae94017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d530437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d53043290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d530437d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46160/0 (socket says 172.21.15.17:46160) 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7400640 1 -- 172.21.15.17:0/4168343096 learned_addr learned my addr 172.21.15.17:0/4168343096 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeaca00640 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 0x556d53043d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7400640 1 -- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 msgr2=0x556d53043d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7400640 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 0x556d53043d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7400640 1 -- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 msgr2=0x556d53043290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7400640 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d53043290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7400640 1 -- 172.21.15.17:0/4168343096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d52d99090 con 0x556d52fce1a0 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faea7400640 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d530437d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fae940012c0 tx=0x7fae94000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f6126e589039ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7fae91600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:25:54.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7fae91600640 1 -- 172.21.15.17:0/4168343096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94023450 con 0x556d52fce1a0 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7fae91600640 1 -- 172.21.15.17:0/4168343096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fae940235f0 con 0x556d52fce1a0 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 -- 172.21.15.17:0/4168343096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae98078be0 con 0x556d52fce1a0 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7fae91600640 1 -- 172.21.15.17:0/4168343096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fae94038050 con 0x556d52fce1a0 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 10 client.8967 fetch_fsmap learned FSMap version 104 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 -- 172.21.15.17:0/4168343096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x556d52d655f0 con 0x556d52fce1a0 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7fae91600640 1 -- 172.21.15.17:0/4168343096 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae98078be0 con 0x556d52fce1a0 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7fae91600640 1 -- 172.21.15.17:0/4168343096 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fae9403b020 con 0x556d52fce1a0 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 10 client.8967 fetch_fsmap finished waiting for FSMap version 104 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 10 client.8967 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 20 client.8967 populate_metadata read hostname 'smithi017' 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x556d52fe4df0 0x556d52fe5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 4 client.8967 mds_command: new command op to 8634 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:25:54.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.282+0000 7faeb1e10000 1 -- 172.21.15.17:0/4168343096 --> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556d52ddd590 con 0x556d52fe4df0 2024-09-10T23:25:54.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faea7e00640 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x556d52fe4df0 0x556d52fe5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faea7e00640 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x556d52fe4df0 0x556d52fe5200 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c232fd603a8b126 server_cookie=de3e963fc4fda2f5 in_seq=0 out_seq=0 2024-09-10T23:25:54.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7fae91600640 10 client.8967 ms_handle_connect on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:54.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7fae91600640 1 -- 172.21.15.17:0/4168343096 <== mds.0 v2:172.21.15.77:6835/1244612709 1 ==== command_reply(tid 0: 0 ) ==== 8+0+618 (crc 0 0 0) 0x556d52ddd590 con 0x556d52fe4df0 2024-09-10T23:25:54.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7fae91600640 10 client.8967 handle_command_reply: tid=0 2024-09-10T23:25:54.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 client.8967 shutdown 2024-09-10T23:25:54.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 -- 172.21.15.17:0/4168343096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 msgr2=0x556d530437d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d530437d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fae940012c0 tx=0x7fae94000ee0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 -- 172.21.15.17:0/4168343096 shutdown_connections 2024-09-10T23:25:54.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:6835/1244612709,v1:172.21.15.77:6837/1244612709] conn(0x556d52fe4df0 0x556d52fe5200 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x556d52fceac0 0x556d53043d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d52fce1a0 0x556d530437d0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 --2- 172.21.15.17:0/4168343096 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556d52f84bc0 0x556d53043290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 -- 172.21.15.17:0/4168343096 >> 172.21.15.17:0/4168343096 conn(0x556d52f8ad20 msgr2=0x556d52f86540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7fae91600640 0 client.8967 ms_handle_reset on v2:172.21.15.77:6835/1244612709 2024-09-10T23:25:54.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 -- 172.21.15.17:0/4168343096 shutdown_connections 2024-09-10T23:25:54.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 1 -- 172.21.15.17:0/4168343096 wait complete. 2024-09-10T23:25:54.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.286+0000 7faeb1e10000 20 client.8967 trim_cache size 0 max 16384 2024-09-10T23:25:54.292 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:25:54.292 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (239 inodes in the stack)", 2024-09-10T23:25:54.292 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "4273064a-bc50-407f-8592-08b4130dcbe9": { 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "4273064a-bc50-407f-8592-08b4130dcbe9", 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive" 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "4273064a-bc50-407f-8592-08b4130dcbe9": { 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:25:45.265758+0000", 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:25:54.293 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:25:54.294 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:25:54.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:54.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:25:54.294 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:25:54.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 -- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae880725e0 msgr2=0x7fae88074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae880725e0 0x7fae88074aa0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7faea80cb000 tx=0x7fae94009040 comp rx=0 tx=0).stop 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 -- 172.21.15.17:0/542302091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 msgr2=0x7faea81578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 0x7faea81578c0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fae9800e9f0 tx=0x7fae9800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 -- 172.21.15.17:0/542302091 shutdown_connections 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fae880725e0 0x7fae88074aa0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faea815e120 0x7faea8163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faea815dd40 0x7faea8163890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 --2- 172.21.15.17:0/542302091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faea8073d40 0x7faea81578c0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 -- 172.21.15.17:0/542302091 >> 172.21.15.17:0/542302091 conn(0x7faea80d0b40 msgr2=0x7faea80cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 -- 172.21.15.17:0/542302091 shutdown_connections 2024-09-10T23:25:54.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.290+0000 7faead400640 1 -- 172.21.15.17:0/542302091 wait complete. 2024-09-10T23:25:54.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:54.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 -- 172.21.15.17:0/265246280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f40d19b0 msgr2=0x7f76f40d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 --2- 172.21.15.17:0/265246280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f40d19b0 0x7f76f40d1e40 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f76f409b600 tx=0x7f76ec01cc60 comp rx=0 tx=0).stop 2024-09-10T23:25:54.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 -- 172.21.15.17:0/265246280 shutdown_connections 2024-09-10T23:25:54.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 --2- 172.21.15.17:0/265246280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f40d19b0 0x7f76f40d1e40 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 --2- 172.21.15.17:0/265246280 >> v2:172.21.15.77:3300/0 conn(0x7f76f415bc70 0x7f76f40d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 --2- 172.21.15.17:0/265246280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76f415b890 0x7f76f4072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 -- 172.21.15.17:0/265246280 >> 172.21.15.17:0/265246280 conn(0x7f76f409a9f0 msgr2=0x7f76f409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 -- 172.21.15.17:0/265246280 shutdown_connections 2024-09-10T23:25:54.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 -- 172.21.15.17:0/265246280 wait complete. 2024-09-10T23:25:54.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 Processor -- start 2024-09-10T23:25:54.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 -- start start 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76f40d19b0 0x7f76f41f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.486+0000 7f76f9600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76f415b890 0x7f76f40b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f415bc70 0x7f76f40b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f9600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4071070 con 0x7f76f415bc70 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f9600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4070ef0 con 0x7f76f40d19b0 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f9600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f76f40711f0 con 0x7f76f415b890 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f415bc70 0x7f76f40b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f3e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76f40d19b0 0x7f76f41f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f415bc70 0x7f76f40b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46174/0 (socket says 172.21.15.17:46174) 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f8c00640 1 -- 172.21.15.17:0/749951446 learned_addr learned my addr 172.21.15.17:0/749951446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f3400640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76f415b890 0x7f76f40b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f8c00640 1 -- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76f415b890 msgr2=0x7f76f40b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f8c00640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76f415b890 0x7f76f40b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f8c00640 1 -- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76f40d19b0 msgr2=0x7f76f41f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f8c00640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76f40d19b0 0x7f76f41f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f8c00640 1 -- 172.21.15.17:0/749951446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f4165710 con 0x7f76f415bc70 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f8c00640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f415bc70 0x7f76f40b5250 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f76ec01b310 tx=0x7f76ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76ebe00640 1 -- 172.21.15.17:0/749951446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec0bb070 con 0x7f76f415bc70 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76ebe00640 1 -- 172.21.15.17:0/749951446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76ec004a50 con 0x7f76f415bc70 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76ebe00640 1 -- 172.21.15.17:0/749951446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec0b2040 con 0x7f76f415bc70 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f41659f0 con 0x7f76f415bc70 2024-09-10T23:25:54.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f4165fb0 con 0x7f76f415bc70 2024-09-10T23:25:54.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.490+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f4072320 con 0x7f76f415bc70 2024-09-10T23:25:54.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.494+0000 7f76ebe00640 1 -- 172.21.15.17:0/749951446 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f76ec0b5030 con 0x7f76f415bc70 2024-09-10T23:25:54.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.494+0000 7f76ebe00640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76d40725e0 0x7f76d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.494+0000 7f76ebe00640 1 -- 172.21.15.17:0/749951446 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f76ec12d2e0 con 0x7f76f415bc70 2024-09-10T23:25:54.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.494+0000 7f76f3e00640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76d40725e0 0x7f76d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.494+0000 7f76f3e00640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76d40725e0 0x7f76d4074aa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009b60 tx=0x7f76e40091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.494+0000 7f76ebe00640 1 -- 172.21.15.17:0/749951446 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f76ec0c4020 con 0x7f76f415bc70 2024-09-10T23:25:54.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.706+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76f41661b0 con 0x7f76f415bc70 2024-09-10T23:25:54.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.706+0000 7f76ebe00640 1 -- 172.21.15.17:0/749951446 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f76ec016970 con 0x7f76f415bc70 2024-09-10T23:25:54.709 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:54.710 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:54.710 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76d40725e0 msgr2=0x7f76d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76d40725e0 0x7f76d4074aa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009b60 tx=0x7f76e40091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f415bc70 msgr2=0x7f76f40b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f415bc70 0x7f76f40b5250 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f76ec01b310 tx=0x7f76ec004270 comp rx=0 tx=0).stop 2024-09-10T23:25:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 shutdown_connections 2024-09-10T23:25:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76d40725e0 0x7f76d4074aa0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f415bc70 0x7f76f40b5250 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76f415b890 0x7f76f40b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 --2- 172.21.15.17:0/749951446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76f40d19b0 0x7f76f41f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 >> 172.21.15.17:0/749951446 conn(0x7f76f409a9f0 msgr2=0x7f76f415ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 shutdown_connections 2024-09-10T23:25:54.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.710+0000 7f76f9600640 1 -- 172.21.15.17:0/749951446 wait complete. 2024-09-10T23:25:54.731 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:25:54.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:25:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 -- 172.21.15.17:0/2385571136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c0cf320 msgr2=0x7f9c3c0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2385571136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c0cf320 0x7f9c3c0cfc60 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0d2e60 tx=0x7f9c3401cd80 comp rx=0 tx=0).stop 2024-09-10T23:25:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 -- 172.21.15.17:0/2385571136 shutdown_connections 2024-09-10T23:25:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2385571136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c0cf320 0x7f9c3c0cfc60 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2385571136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c3c0d1830 0x7f9c3c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2385571136 >> v2:172.21.15.77:3300/0 conn(0x7f9c3c070ad0 0x7f9c3c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 -- 172.21.15.17:0/2385571136 >> 172.21.15.17:0/2385571136 conn(0x7f9c3c0d1d60 msgr2=0x7f9c3c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 -- 172.21.15.17:0/2385571136 shutdown_connections 2024-09-10T23:25:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 -- 172.21.15.17:0/2385571136 wait complete. 2024-09-10T23:25:54.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 Processor -- start 2024-09-10T23:25:54.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.874+0000 7f9c43e00640 1 -- start start 2024-09-10T23:25:54.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c43e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c070ad0 0x7f9c3c0b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c43e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c3c0cf320 0x7f9c3c1fb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c43e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c3c0d1830 0x7f9c3c0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c43e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c0cd2f0 con 0x7f9c3c070ad0 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c43e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c0cd170 con 0x7f9c3c0cf320 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c43e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3c0cd470 con 0x7f9c3c0d1830 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c070ad0 0x7f9c3c0b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c070ad0 0x7f9c3c0b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46190/0 (socket says 172.21.15.17:46190) 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41400640 1 -- 172.21.15.17:0/2701484875 learned_addr learned my addr 172.21.15.17:0/2701484875 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41e00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c3c0d1830 0x7f9c3c0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c40a00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c3c0cf320 0x7f9c3c1fb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41400640 1 -- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c3c0d1830 msgr2=0x7f9c3c0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41400640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c3c0d1830 0x7f9c3c0cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41400640 1 -- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c3c0cf320 msgr2=0x7f9c3c1fb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41400640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c3c0cf320 0x7f9c3c1fb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41400640 1 -- 172.21.15.17:0/2701484875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3c1fba60 con 0x7f9c3c070ad0 2024-09-10T23:25:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c41400640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c070ad0 0x7f9c3c0b43b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000d750 tx=0x7f9c3000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c39600640 1 -- 172.21.15.17:0/2701484875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30017070 con 0x7f9c3c070ad0 2024-09-10T23:25:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c39600640 1 -- 172.21.15.17:0/2701484875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c30009d20 con 0x7f9c3c070ad0 2024-09-10T23:25:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3c1fbd40 con 0x7f9c3c070ad0 2024-09-10T23:25:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c39600640 1 -- 172.21.15.17:0/2701484875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30004280 con 0x7f9c3c070ad0 2024-09-10T23:25:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3c0b6ba0 con 0x7f9c3c070ad0 2024-09-10T23:25:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c3c0cfc60 con 0x7f9c3c070ad0 2024-09-10T23:25:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.878+0000 7f9c39600640 1 -- 172.21.15.17:0/2701484875 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9c30005020 con 0x7f9c3c070ad0 2024-09-10T23:25:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.882+0000 7f9c39600640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c1c072610 0x7f9c1c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.882+0000 7f9c39600640 1 -- 172.21.15.17:0/2701484875 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f9c30093620 con 0x7f9c3c070ad0 2024-09-10T23:25:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.882+0000 7f9c40a00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c1c072610 0x7f9c1c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.882+0000 7f9c40a00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c1c072610 0x7f9c1c074ad0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0c8ae0 tx=0x7f9c2800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:54.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:54.886+0000 7f9c39600640 1 -- 172.21.15.17:0/2701484875 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9c30020020 con 0x7f9c3c070ad0 2024-09-10T23:25:55.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.122+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9c3c06f0b0 con 0x7f9c3c070ad0 2024-09-10T23:25:55.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.122+0000 7f9c39600640 1 -- 172.21.15.17:0/2701484875 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7f9c3000de60 con 0x7f9c3c070ad0 2024-09-10T23:25:55.127 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:55.127 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":644,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078285443,"bytes_used":2629705728,"bytes_avail":770464407552,"bytes_total":773094113280,"write_bytes_sec":22858114,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-10T23:25:52.440874+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}}}}}},"progress_events":{}} 2024-09-10T23:25:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c1c072610 msgr2=0x7f9c1c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c1c072610 0x7f9c1c074ad0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0c8ae0 tx=0x7f9c2800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:25:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c070ad0 msgr2=0x7f9c3c0b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c070ad0 0x7f9c3c0b43b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000d750 tx=0x7f9c3000dc10 comp rx=0 tx=0).stop 2024-09-10T23:25:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 shutdown_connections 2024-09-10T23:25:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c1c072610 0x7f9c1c074ad0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c3c0d1830 0x7f9c3c0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:55.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c3c0cf320 0x7f9c3c1fb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:55.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 --2- 172.21.15.17:0/2701484875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c3c070ad0 0x7f9c3c0b43b0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:55.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 >> 172.21.15.17:0/2701484875 conn(0x7f9c3c0d1d60 msgr2=0x7f9c3c06f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:55.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 shutdown_connections 2024-09-10T23:25:55.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:55.126+0000 7f9c43e00640 1 -- 172.21.15.17:0/2701484875 wait complete. 2024-09-10T23:25:55.148 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused paths [/scrub_control_test_path]'} 2024-09-10T23:25:56.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:56.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.302+0000 7f988be00640 1 -- 172.21.15.17:0/1944069342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9870004d50 msgr2=0x7f98700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.302+0000 7f988be00640 1 --2- 172.21.15.17:0/1944069342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9870004d50 0x7f98700051d0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f988400c640 tx=0x7f988401d320 comp rx=0 tx=0).stop 2024-09-10T23:25:56.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.302+0000 7f988b400640 1 -- 172.21.15.17:0/1944069342 reap_dead start 2024-09-10T23:25:56.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.302+0000 7f988be00640 1 -- 172.21.15.17:0/1944069342 shutdown_connections 2024-09-10T23:25:56.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.302+0000 7f988be00640 1 -- 172.21.15.17:0/1944069342 >> 172.21.15.17:0/1944069342 conn(0x7f988c0d3ce0 msgr2=0x7f988c0d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:56.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.302+0000 7f988be00640 1 -- 172.21.15.17:0/1944069342 shutdown_connections 2024-09-10T23:25:56.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.302+0000 7f988be00640 1 -- 172.21.15.17:0/1944069342 wait complete. 2024-09-10T23:25:56.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 Processor -- start 2024-09-10T23:25:56.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 -- start start 2024-09-10T23:25:56.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9870004d50 0x7f988c14f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988c0cbff0 0x7f988c0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c0b5f00 0x7f988c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f988c0d22c0 con 0x7f988c0b5f00 2024-09-10T23:25:56.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f988c15e1f0 con 0x7f9870004d50 2024-09-10T23:25:56.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f988c0d2440 con 0x7f988c0cbff0 2024-09-10T23:25:56.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c0b5f00 0x7f988c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9870004d50 0x7f988c14f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c0b5f00 0x7f988c0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46218/0 (socket says 172.21.15.17:46218) 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988b400640 1 -- 172.21.15.17:0/423733766 learned_addr learned my addr 172.21.15.17:0/423733766 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988a000640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988c0cbff0 0x7f988c0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988b400640 1 -- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988c0cbff0 msgr2=0x7f988c0b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988b400640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988c0cbff0 0x7f988c0b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988b400640 1 -- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9870004d50 msgr2=0x7f988c14f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988b400640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9870004d50 0x7f988c14f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988b400640 1 -- 172.21.15.17:0/423733766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988c0caf50 con 0x7f988c0b5f00 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988aa00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9870004d50 0x7f988c14f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:25:56.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988b400640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c0b5f00 0x7f988c0cccc0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f988401dbc0 tx=0x7f9884006680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:56.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f9882a00640 1 -- 172.21.15.17:0/423733766 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98840be070 con 0x7f988c0b5f00 2024-09-10T23:25:56.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f9882a00640 1 -- 172.21.15.17:0/423733766 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9884004e40 con 0x7f988c0b5f00 2024-09-10T23:25:56.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f9882a00640 1 -- 172.21.15.17:0/423733766 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98840b2040 con 0x7f988c0b5f00 2024-09-10T23:25:56.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988c0cb230 con 0x7f988c0b5f00 2024-09-10T23:25:56.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.306+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988c0cb7f0 con 0x7f988c0b5f00 2024-09-10T23:25:56.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.310+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988c0b6380 con 0x7f988c0b5f00 2024-09-10T23:25:56.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.310+0000 7f9882a00640 1 -- 172.21.15.17:0/423733766 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9884003980 con 0x7f988c0b5f00 2024-09-10T23:25:56.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.310+0000 7f9882a00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f986c072610 0x7f986c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.310+0000 7f9882a00640 1 -- 172.21.15.17:0/423733766 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f988412da70 con 0x7f988c0b5f00 2024-09-10T23:25:56.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.310+0000 7f988aa00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f986c072610 0x7f986c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.314+0000 7f988aa00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f986c072610 0x7f986c074ad0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f987c005fd0 tx=0x7f987c00b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:56.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.314+0000 7f9882a00640 1 -- 172.21.15.17:0/423733766 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f98840170d0 con 0x7f988c0b5f00 2024-09-10T23:25:56.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.522+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f988c0ce110 con 0x7f988c0b5f00 2024-09-10T23:25:56.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.522+0000 7f9882a00640 1 -- 172.21.15.17:0/423733766 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f98840f8970 con 0x7f988c0b5f00 2024-09-10T23:25:56.528 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:56.528 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:56.528 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f986c072610 msgr2=0x7f986c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f986c072610 0x7f986c074ad0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f987c005fd0 tx=0x7f987c00b260 comp rx=0 tx=0).stop 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c0b5f00 msgr2=0x7f988c0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c0b5f00 0x7f988c0cccc0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f988401dbc0 tx=0x7f9884006680 comp rx=0 tx=0).stop 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 shutdown_connections 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f986c072610 0x7f986c074ad0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c0b5f00 0x7f988c0cccc0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f988c0cbff0 0x7f988c0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 --2- 172.21.15.17:0/423733766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9870004d50 0x7f988c14f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 >> 172.21.15.17:0/423733766 conn(0x7f988c0d3ce0 msgr2=0x7f988c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:56.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 shutdown_connections 2024-09-10T23:25:56.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.526+0000 7f988be00640 1 -- 172.21.15.17:0/423733766 wait complete. 2024-09-10T23:25:56.549 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:25:56.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:25:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.690+0000 7f41cbe00640 1 -- 172.21.15.17:0/4038429065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c4070ad0 msgr2=0x7f41c415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.690+0000 7f41cbe00640 1 --2- 172.21.15.17:0/4038429065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c4070ad0 0x7f41c415f060 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f41c40cf010 tx=0x7f41b801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.690+0000 7f41cbe00640 1 -- 172.21.15.17:0/4038429065 shutdown_connections 2024-09-10T23:25:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.690+0000 7f41cbe00640 1 --2- 172.21.15.17:0/4038429065 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40d1830 0x7f41c415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.690+0000 7f41cbe00640 1 --2- 172.21.15.17:0/4038429065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c4070ad0 0x7f41c415f060 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.690+0000 7f41cbe00640 1 -- 172.21.15.17:0/4038429065 >> 172.21.15.17:0/4038429065 conn(0x7f41c40d1d60 msgr2=0x7f41c40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.690+0000 7f41cbe00640 1 -- 172.21.15.17:0/4038429065 shutdown_connections 2024-09-10T23:25:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.690+0000 7f41cbe00640 1 -- 172.21.15.17:0/4038429065 wait complete. 2024-09-10T23:25:56.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 Processor -- start 2024-09-10T23:25:56.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 -- start start 2024-09-10T23:25:56.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c4070ad0 0x7f41c4165200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40cf320 0x7f41c4157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c40d1830 0x7f41c40b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f41c41693d0 con 0x7f41c40d1830 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41c4169250 con 0x7f41c4070ad0 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f41c4169550 con 0x7f41c40cf320 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c40d1830 0x7f41c40b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c40d1830 0x7f41c40b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46232/0 (socket says 172.21.15.17:46232) 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9e00640 1 -- 172.21.15.17:0/2353629442 learned_addr learned my addr 172.21.15.17:0/2353629442 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c8a00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40cf320 0x7f41c4157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9400640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c4070ad0 0x7f41c4165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9e00640 1 -- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40cf320 msgr2=0x7f41c4157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9e00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40cf320 0x7f41c4157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9e00640 1 -- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c4070ad0 msgr2=0x7f41c4165200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9e00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c4070ad0 0x7f41c4165200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9e00640 1 -- 172.21.15.17:0/2353629442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c4152730 con 0x7f41c40d1830 2024-09-10T23:25:56.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c9e00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c40d1830 0x7f41c40b4b90 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c7f0 tx=0x7f41bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:56.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c1600640 1 -- 172.21.15.17:0/2353629442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc003b80 con 0x7f41c40d1830 2024-09-10T23:25:56.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c1600640 1 -- 172.21.15.17:0/2353629442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41bc003d20 con 0x7f41c40d1830 2024-09-10T23:25:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c406fce0 con 0x7f41c40d1830 2024-09-10T23:25:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41c1600640 1 -- 172.21.15.17:0/2353629442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00aab0 con 0x7f41c40d1830 2024-09-10T23:25:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c4165990 con 0x7f41c40d1830 2024-09-10T23:25:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.694+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c40cfc60 con 0x7f41c40d1830 2024-09-10T23:25:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.698+0000 7f41c1600640 1 -- 172.21.15.17:0/2353629442 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f41bc00ac50 con 0x7f41c40d1830 2024-09-10T23:25:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.698+0000 7f41c1600640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41a40725e0 0x7f41a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.698+0000 7f41c1600640 1 -- 172.21.15.17:0/2353629442 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f41bc0931c0 con 0x7f41c40d1830 2024-09-10T23:25:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.698+0000 7f41c9400640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41a40725e0 0x7f41a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.698+0000 7f41c9400640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41a40725e0 0x7f41a4074aa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f41b80af000 tx=0x7f41b801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.702+0000 7f41c1600640 1 -- 172.21.15.17:0/2353629442 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f41bc05e0b0 con 0x7f41c40d1830 2024-09-10T23:25:56.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f41c41666c0 con 0x7f41c40d1830 2024-09-10T23:25:56.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41c1600640 1 -- 172.21.15.17:0/2353629442 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7f41bc062ae0 con 0x7f41c40d1830 2024-09-10T23:25:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:56.940 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":646,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078285443,"bytes_used":2629705728,"bytes_avail":770464407552,"bytes_total":773094113280,"write_bytes_sec":22858114,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-10T23:25:52.440874+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}}}}}},"progress_events":{}} 2024-09-10T23:25:56.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41a40725e0 msgr2=0x7f41a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41a40725e0 0x7f41a4074aa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f41b80af000 tx=0x7f41b801b120 comp rx=0 tx=0).stop 2024-09-10T23:25:56.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c40d1830 msgr2=0x7f41c40b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:56.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c40d1830 0x7f41c40b4b90 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c7f0 tx=0x7f41bc00ccb0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 shutdown_connections 2024-09-10T23:25:56.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41a40725e0 0x7f41a4074aa0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41c40d1830 0x7f41c40b4b90 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41c40cf320 0x7f41c4157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 --2- 172.21.15.17:0/2353629442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c4070ad0 0x7f41c4165200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:56.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 >> 172.21.15.17:0/2353629442 conn(0x7f41c40d1d60 msgr2=0x7f41c40d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:56.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 shutdown_connections 2024-09-10T23:25:56.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:56.938+0000 7f41cbe00640 1 -- 172.21.15.17:0/2353629442 wait complete. 2024-09-10T23:25:56.961 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused paths [/scrub_control_test_path]'} 2024-09-10T23:25:57.963 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.118+0000 7f5f76600640 1 -- 172.21.15.17:0/1374880716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f7015bc70 msgr2=0x7f5f700cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.118+0000 7f5f76600640 1 --2- 172.21.15.17:0/1374880716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f7015bc70 0x7f5f700cfa20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009900 tx=0x7f5f6401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 -- 172.21.15.17:0/1374880716 shutdown_connections 2024-09-10T23:25:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 --2- 172.21.15.17:0/1374880716 >> v2:172.21.15.77:3300/0 conn(0x7f5f700cc570 0x7f5f700d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 --2- 172.21.15.17:0/1374880716 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f7015bc70 0x7f5f700cfa20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 -- 172.21.15.17:0/1374880716 >> 172.21.15.17:0/1374880716 conn(0x7f5f7009a9f0 msgr2=0x7f5f7009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 -- 172.21.15.17:0/1374880716 shutdown_connections 2024-09-10T23:25:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 -- 172.21.15.17:0/1374880716 wait complete. 2024-09-10T23:25:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 Processor -- start 2024-09-10T23:25:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 -- start start 2024-09-10T23:25:58.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f700cc570 0x7f5f70152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f700d1ed0 0x7f5f7015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f7015bc70 0x7f5f7015e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f701688a0 con 0x7f5f7015bc70 2024-09-10T23:25:58.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70168720 con 0x7f5f700d1ed0 2024-09-10T23:25:58.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f76600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5f70168a20 con 0x7f5f700cc570 2024-09-10T23:25:58.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f7015bc70 0x7f5f7015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f700cc570 0x7f5f70152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f700cc570 0x7f5f70152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:47422/0 (socket says 172.21.15.17:47422) 2024-09-10T23:25:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75200640 1 -- 172.21.15.17:0/3896487679 learned_addr learned my addr 172.21.15.17:0/3896487679 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f6fe00640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f700d1ed0 0x7f5f7015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75200640 1 -- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f700d1ed0 msgr2=0x7f5f7015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75200640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f700d1ed0 0x7f5f7015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75200640 1 -- 172.21.15.17:0/3896487679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f7015bc70 msgr2=0x7f5f7015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75200640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f7015bc70 0x7f5f7015e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75200640 1 -- 172.21.15.17:0/3896487679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f70155270 con 0x7f5f700cc570 2024-09-10T23:25:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.122+0000 7f5f75200640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f700cc570 0x7f5f70152470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009850 tx=0x7f5f64005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f6cc00640 1 -- 172.21.15.17:0/3896487679 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f640b2040 con 0x7f5f700cc570 2024-09-10T23:25:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f6cc00640 1 -- 172.21.15.17:0/3896487679 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f64005320 con 0x7f5f700cc570 2024-09-10T23:25:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f6cc00640 1 -- 172.21.15.17:0/3896487679 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f640046d0 con 0x7f5f700cc570 2024-09-10T23:25:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f701554e0 con 0x7f5f700cc570 2024-09-10T23:25:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f701529b0 con 0x7f5f700cc570 2024-09-10T23:25:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f70155990 con 0x7f5f700cc570 2024-09-10T23:25:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f6cc00640 1 -- 172.21.15.17:0/3896487679 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5f64004870 con 0x7f5f700cc570 2024-09-10T23:25:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f6cc00640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f500725e0 0x7f5f50074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f6cc00640 1 -- 172.21.15.17:0/3896487679 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f5f6412d320 con 0x7f5f700cc570 2024-09-10T23:25:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.126+0000 7f5f6fe00640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f500725e0 0x7f5f50074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.130+0000 7f5f6fe00640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f500725e0 0x7f5f50074aa0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009600 tx=0x7f5f5c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.134+0000 7f5f6cc00640 1 -- 172.21.15.17:0/3896487679 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5f640164d0 con 0x7f5f700cc570 2024-09-10T23:25:58.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.346+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f7015e260 con 0x7f5f700cc570 2024-09-10T23:25:58.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.346+0000 7f5f6cc00640 1 -- 172.21.15.17:0/3896487679 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f5f640f8180 con 0x7f5f700cc570 2024-09-10T23:25:58.350 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:58.350 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:25:58.350 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.346+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f500725e0 msgr2=0x7f5f50074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.346+0000 7f5f76600640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f500725e0 0x7f5f50074aa0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009600 tx=0x7f5f5c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.346+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f700cc570 msgr2=0x7f5f70152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.346+0000 7f5f76600640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f700cc570 0x7f5f70152470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009850 tx=0x7f5f64005de0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.350+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 shutdown_connections 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.350+0000 7f5f76600640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f500725e0 0x7f5f50074aa0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.350+0000 7f5f76600640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f7015bc70 0x7f5f7015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.350+0000 7f5f76600640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f700d1ed0 0x7f5f7015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.350+0000 7f5f76600640 1 --2- 172.21.15.17:0/3896487679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f700cc570 0x7f5f70152470 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.350+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 >> 172.21.15.17:0/3896487679 conn(0x7f5f7009a9f0 msgr2=0x7f5f70158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.350+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 shutdown_connections 2024-09-10T23:25:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.350+0000 7f5f76600640 1 -- 172.21.15.17:0/3896487679 wait complete. 2024-09-10T23:25:58.370 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:25:58.371 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:25:58.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 -- 172.21.15.17:0/2428059805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 msgr2=0x7fa310070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 --2- 172.21.15.17:0/2428059805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 0x7fa310070350 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fa3100af9d0 tx=0x7fa30801cb70 comp rx=0 tx=0).stop 2024-09-10T23:25:58.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 -- 172.21.15.17:0/2428059805 shutdown_connections 2024-09-10T23:25:58.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 --2- 172.21.15.17:0/2428059805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 0x7fa310070350 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 -- 172.21.15.17:0/2428059805 >> 172.21.15.17:0/2428059805 conn(0x7fa3100d03d0 msgr2=0x7fa3100d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:58.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 -- 172.21.15.17:0/2428059805 shutdown_connections 2024-09-10T23:25:58.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 -- 172.21.15.17:0/2428059805 wait complete. 2024-09-10T23:25:58.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 Processor -- start 2024-09-10T23:25:58.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 -- start start 2024-09-10T23:25:58.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3100d1120 0x7fa310158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa310152c50 0x7fa31014b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 0x7fa310150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100b3e30 con 0x7fa310153030 2024-09-10T23:25:58.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100b56b0 con 0x7fa3100d1120 2024-09-10T23:25:58.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa315a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa3100b3fb0 con 0x7fa310152c50 2024-09-10T23:25:58.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 0x7fa310150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 0x7fa310150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38680/0 (socket says 172.21.15.17:38680) 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30f400640 1 -- 172.21.15.17:0/826302060 learned_addr learned my addr 172.21.15.17:0/826302060 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa307e00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa310152c50 0x7fa31014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30ea00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3100d1120 0x7fa310158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30f400640 1 -- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa310152c50 msgr2=0x7fa31014b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30f400640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa310152c50 0x7fa31014b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30f400640 1 -- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3100d1120 msgr2=0x7fa310158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30f400640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3100d1120 0x7fa310158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30f400640 1 -- 172.21.15.17:0/826302060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3100b15a0 con 0x7fa310153030 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30ea00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3100d1120 0x7fa310158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:25:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.514+0000 7fa30f400640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 0x7fa310150ce0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa308009b10 tx=0x7fa3080a5ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:58.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa306a00640 1 -- 172.21.15.17:0/826302060 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3080bb070 con 0x7fa310153030 2024-09-10T23:25:58.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa306a00640 1 -- 172.21.15.17:0/826302060 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa308004e00 con 0x7fa310153030 2024-09-10T23:25:58.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa306a00640 1 -- 172.21.15.17:0/826302060 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3080b2040 con 0x7fa310153030 2024-09-10T23:25:58.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31014f960 con 0x7fa310153030 2024-09-10T23:25:58.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31014ff20 con 0x7fa310153030 2024-09-10T23:25:58.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa310070350 con 0x7fa310153030 2024-09-10T23:25:58.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa306a00640 1 -- 172.21.15.17:0/826302060 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa3080b5030 con 0x7fa310153030 2024-09-10T23:25:58.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa306a00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2ec0725e0 0x7fa2ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:58.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa306a00640 1 -- 172.21.15.17:0/826302060 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fa30812cf90 con 0x7fa310153030 2024-09-10T23:25:58.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.518+0000 7fa30ea00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2ec0725e0 0x7fa2ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.522+0000 7fa30ea00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2ec0725e0 0x7fa2ec074aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa300001750 tx=0x7fa300009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.522+0000 7fa306a00640 1 -- 172.21.15.17:0/826302060 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa308016790 con 0x7fa310153030 2024-09-10T23:25:58.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.758+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa3100d0e10 con 0x7fa310153030 2024-09-10T23:25:58.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.758+0000 7fa306a00640 1 -- 172.21.15.17:0/826302060 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fa3080f7df0 con 0x7fa310153030 2024-09-10T23:25:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:25:58.762 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":647,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078429770,"bytes_used":2629853184,"bytes_avail":770464260096,"bytes_total":773094113280,"write_bytes_sec":20424380,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-10T23:25:52.440874+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}}}}}},"progress_events":{}} 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.758+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2ec0725e0 msgr2=0x7fa2ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.758+0000 7fa315a00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2ec0725e0 0x7fa2ec074aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa300001750 tx=0x7fa300009040 comp rx=0 tx=0).stop 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.758+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 msgr2=0x7fa310150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.758+0000 7fa315a00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 0x7fa310150ce0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa308009b10 tx=0x7fa3080a5ad0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.762+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 shutdown_connections 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.762+0000 7fa315a00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa2ec0725e0 0x7fa2ec074aa0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.762+0000 7fa315a00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa310153030 0x7fa310150ce0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.762+0000 7fa315a00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa310152c50 0x7fa31014b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.762+0000 7fa315a00640 1 --2- 172.21.15.17:0/826302060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3100d1120 0x7fa310158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.762+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 >> 172.21.15.17:0/826302060 conn(0x7fa3100d03d0 msgr2=0x7fa31015e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:58.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.762+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 shutdown_connections 2024-09-10T23:25:58.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:58.762+0000 7fa315a00640 1 -- 172.21.15.17:0/826302060 wait complete. 2024-09-10T23:25:58.782 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused paths [/scrub_control_test_path]'} 2024-09-10T23:25:59.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:25:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 -- 172.21.15.17:0/3055611236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0cc570 msgr2=0x7f464c0d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 --2- 172.21.15.17:0/3055611236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0cc570 0x7f464c0d1990 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f464c15f610 tx=0x7f463801c5d0 comp rx=0 tx=0).stop 2024-09-10T23:25:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 -- 172.21.15.17:0/3055611236 shutdown_connections 2024-09-10T23:25:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 --2- 172.21.15.17:0/3055611236 >> v2:172.21.15.77:3300/0 conn(0x7f464c0d1ed0 0x7f464c0ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 --2- 172.21.15.17:0/3055611236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0cc570 0x7f464c0d1990 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 --2- 172.21.15.17:0/3055611236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f464c15bc70 0x7f464c0cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:59.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 -- 172.21.15.17:0/3055611236 >> 172.21.15.17:0/3055611236 conn(0x7f464c09a9f0 msgr2=0x7f464c09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:25:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 -- 172.21.15.17:0/3055611236 shutdown_connections 2024-09-10T23:25:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 -- 172.21.15.17:0/3055611236 wait complete. 2024-09-10T23:25:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 Processor -- start 2024-09-10T23:25:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.938+0000 7f4651200640 1 -- start start 2024-09-10T23:25:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4651200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0cc570 0x7f464c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4651200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0d1ed0 0x7f464c0c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4651200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f464c15bc70 0x7f464c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4651200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f464c0b1530 con 0x7f464c0d1ed0 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4651200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f464c0b13b0 con 0x7f464c0cc570 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4651200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f464c0b16b0 con 0x7f464c15bc70 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f464aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0d1ed0 0x7f464c0c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f464aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0d1ed0 0x7f464c0c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38696/0 (socket says 172.21.15.17:38696) 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f464aa00640 1 -- 172.21.15.17:0/2462012444 learned_addr learned my addr 172.21.15.17:0/2462012444 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f464aa00640 1 -- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f464c15bc70 msgr2=0x7f464c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f464aa00640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f464c15bc70 0x7f464c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f464aa00640 1 -- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0cc570 msgr2=0x7f464c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f464aa00640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0cc570 0x7f464c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:25:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f464aa00640 1 -- 172.21.15.17:0/2462012444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464c155540 con 0x7f464c0d1ed0 2024-09-10T23:25:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f464aa00640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0d1ed0 0x7f464c0c5630 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f4638009850 tx=0x7f46380a64e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4643400640 1 -- 172.21.15.17:0/2462012444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46380ac070 con 0x7f464c0d1ed0 2024-09-10T23:25:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4643400640 1 -- 172.21.15.17:0/2462012444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4638004340 con 0x7f464c0d1ed0 2024-09-10T23:25:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4643400640 1 -- 172.21.15.17:0/2462012444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638005320 con 0x7f464c0d1ed0 2024-09-10T23:25:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f464c1fb6f0 con 0x7f464c0d1ed0 2024-09-10T23:25:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f464c1fae50 con 0x7f464c0d1ed0 2024-09-10T23:25:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.942+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f464c0ce4b0 con 0x7f464c0d1ed0 2024-09-10T23:25:59.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.946+0000 7f4643400640 1 -- 172.21.15.17:0/2462012444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f46380054c0 con 0x7f464c0d1ed0 2024-09-10T23:25:59.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.946+0000 7f4643400640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f462c0725e0 0x7f462c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:25:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.946+0000 7f4643400640 1 -- 172.21.15.17:0/2462012444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f463812dc60 con 0x7f464c0d1ed0 2024-09-10T23:25:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.946+0000 7f464b400640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f462c0725e0 0x7f462c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:25:59.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.946+0000 7f464b400640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f462c0725e0 0x7f462c074aa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f463c0058d0 tx=0x7f463c005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:25:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:25:59.950+0000 7f4643400640 1 -- 172.21.15.17:0/2462012444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f464c155540 con 0x7f464c0d1ed0 2024-09-10T23:26:00.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.158+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f464c159f00 con 0x7f464c0d1ed0 2024-09-10T23:26:00.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.158+0000 7f4643400640 1 -- 172.21.15.17:0/2462012444 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f46380164b0 con 0x7f464c0d1ed0 2024-09-10T23:26:00.162 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:00.162 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:26:00.163 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f462c0725e0 msgr2=0x7f462c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f462c0725e0 0x7f462c074aa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f463c0058d0 tx=0x7f463c005860 comp rx=0 tx=0).stop 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0d1ed0 msgr2=0x7f464c0c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0d1ed0 0x7f464c0c5630 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f4638009850 tx=0x7f46380a64e0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 shutdown_connections 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f462c0725e0 0x7f462c074aa0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f464c15bc70 0x7f464c0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f464c0d1ed0 0x7f464c0c5630 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 --2- 172.21.15.17:0/2462012444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f464c0cc570 0x7f464c0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 >> 172.21.15.17:0/2462012444 conn(0x7f464c09a9f0 msgr2=0x7f464c1590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:00.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 shutdown_connections 2024-09-10T23:26:00.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.162+0000 7f4651200640 1 -- 172.21.15.17:0/2462012444 wait complete. 2024-09-10T23:26:00.184 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:26:00.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:26:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.326+0000 7f294a400640 1 -- 172.21.15.17:0/2041330698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 msgr2=0x7f294415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.326+0000 7f294a400640 1 --2- 172.21.15.17:0/2041330698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 0x7f294415f060 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f29440cf010 tx=0x7f293401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.326+0000 7f294a400640 1 -- 172.21.15.17:0/2041330698 shutdown_connections 2024-09-10T23:26:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.326+0000 7f294a400640 1 --2- 172.21.15.17:0/2041330698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 0x7f294415f060 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.326+0000 7f294a400640 1 -- 172.21.15.17:0/2041330698 >> 172.21.15.17:0/2041330698 conn(0x7f29440d1d60 msgr2=0x7f29440d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.326+0000 7f294a400640 1 -- 172.21.15.17:0/2041330698 shutdown_connections 2024-09-10T23:26:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.326+0000 7f294a400640 1 -- 172.21.15.17:0/2041330698 wait complete. 2024-09-10T23:26:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.326+0000 7f294a400640 1 Processor -- start 2024-09-10T23:26:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.326+0000 7f294a400640 1 -- start start 2024-09-10T23:26:00.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f294a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 0x7f294415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:00.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f294a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29440cf320 0x7f29440b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:00.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f294a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29440d1830 0x7f29441551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f294a400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f294416a660 con 0x7f2944070ad0 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f294a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f294416a4e0 con 0x7f29440d1830 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f294a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f294416a7e0 con 0x7f29440cf320 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 0x7f294415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 0x7f294415aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38716/0 (socket says 172.21.15.17:38716) 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943400640 1 -- 172.21.15.17:0/3225705349 learned_addr learned my addr 172.21.15.17:0/3225705349 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943e00640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29440d1830 0x7f29441551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f293be00640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29440cf320 0x7f29440b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943400640 1 -- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29440cf320 msgr2=0x7f29440b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29440cf320 0x7f29440b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943400640 1 -- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29440d1830 msgr2=0x7f29441551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29440d1830 0x7f29441551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943400640 1 -- 172.21.15.17:0/3225705349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29440c9040 con 0x7f2944070ad0 2024-09-10T23:26:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f2943400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 0x7f294415aaf0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f29340b0040 tx=0x7f2934004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f293b400640 1 -- 172.21.15.17:0/3225705349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29340b2040 con 0x7f2944070ad0 2024-09-10T23:26:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f293b400640 1 -- 172.21.15.17:0/3225705349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2934003600 con 0x7f2944070ad0 2024-09-10T23:26:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29440c9320 con 0x7f2944070ad0 2024-09-10T23:26:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f293b400640 1 -- 172.21.15.17:0/3225705349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934003a30 con 0x7f2944070ad0 2024-09-10T23:26:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29440c98e0 con 0x7f2944070ad0 2024-09-10T23:26:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.330+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294415f060 con 0x7f2944070ad0 2024-09-10T23:26:00.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.334+0000 7f293b400640 1 -- 172.21.15.17:0/3225705349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2934003bd0 con 0x7f2944070ad0 2024-09-10T23:26:00.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.334+0000 7f293b400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29200725e0 0x7f2920074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:00.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.334+0000 7f293b400640 1 -- 172.21.15.17:0/3225705349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f293412d570 con 0x7f2944070ad0 2024-09-10T23:26:00.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.334+0000 7f293be00640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29200725e0 0x7f2920074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:00.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.334+0000 7f293be00640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29200725e0 0x7f2920074aa0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2944159860 tx=0x7f292c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:00.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.338+0000 7f293b400640 1 -- 172.21.15.17:0/3225705349 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f29340164d0 con 0x7f2944070ad0 2024-09-10T23:26:00.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2944157c50 con 0x7f2944070ad0 2024-09-10T23:26:00.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f293b400640 1 -- 172.21.15.17:0/3225705349 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1671 (secure 0 0 0) 0x7f29340f8ac0 con 0x7f2944070ad0 2024-09-10T23:26:00.576 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:00.576 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":649,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078429770,"bytes_used":2630000640,"bytes_avail":770464112640,"bytes_total":773094113280,"write_bytes_sec":742473,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-10T23:25:52.440874+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}}}}}},"progress_events":{}} 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29200725e0 msgr2=0x7f2920074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29200725e0 0x7f2920074aa0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2944159860 tx=0x7f292c009040 comp rx=0 tx=0).stop 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 msgr2=0x7f294415aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 0x7f294415aaf0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f29340b0040 tx=0x7f2934004040 comp rx=0 tx=0).stop 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 shutdown_connections 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29200725e0 0x7f2920074aa0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29440d1830 0x7f29441551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29440cf320 0x7f29440b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 --2- 172.21.15.17:0/3225705349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2944070ad0 0x7f294415aaf0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 >> 172.21.15.17:0/3225705349 conn(0x7f29440d1d60 msgr2=0x7f29440b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 shutdown_connections 2024-09-10T23:26:00.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:00.574+0000 7f294a400640 1 -- 172.21.15.17:0/3225705349 wait complete. 2024-09-10T23:26:00.597 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused paths [/scrub_control_test_path]'} 2024-09-10T23:26:01.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:01.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 -- 172.21.15.17:0/468519685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c41618a0 msgr2=0x7f85c406eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:01.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 --2- 172.21.15.17:0/468519685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c41618a0 0x7f85c406eff0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f85bc009cb0 tx=0x7f85bc01cd10 comp rx=0 tx=0).stop 2024-09-10T23:26:01.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 -- 172.21.15.17:0/468519685 shutdown_connections 2024-09-10T23:26:01.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 --2- 172.21.15.17:0/468519685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c41618a0 0x7f85c406eff0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:01.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 -- 172.21.15.17:0/468519685 >> 172.21.15.17:0/468519685 conn(0x7f85c40d3f20 msgr2=0x7f85c40d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:01.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 -- 172.21.15.17:0/468519685 shutdown_connections 2024-09-10T23:26:01.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 -- 172.21.15.17:0/468519685 wait complete. 2024-09-10T23:26:01.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 Processor -- start 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 -- start start 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85c40d2180 0x7f85c40ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c40d4a10 0x7f85c40c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85c41618a0 0x7f85c40c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f85c416c1d0 con 0x7f85c40d4a10 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f85c416c050 con 0x7f85c40d2180 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.750+0000 7f85c8a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f85c416c350 con 0x7f85c41618a0 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85b9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c40d4a10 0x7f85c40c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85b9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c40d4a10 0x7f85c40c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38742/0 (socket says 172.21.15.17:38742) 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85b9400640 1 -- 172.21.15.17:0/4129605397 learned_addr learned my addr 172.21.15.17:0/4129605397 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85c1e00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85c40d2180 0x7f85c40ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:01.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85c2800640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85c41618a0 0x7f85c40c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85b9400640 1 -- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85c41618a0 msgr2=0x7f85c40c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85b9400640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85c41618a0 0x7f85c40c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85b9400640 1 -- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85c40d2180 msgr2=0x7f85c40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85b9400640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85c40d2180 0x7f85c40ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85b9400640 1 -- 172.21.15.17:0/4129605397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c415f990 con 0x7f85c40d4a10 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85b9400640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c40d4a10 0x7f85c40c8460 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c480 tx=0x7f85ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85baa00640 1 -- 172.21.15.17:0/4129605397 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac012830 con 0x7f85c40d4a10 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85baa00640 1 -- 172.21.15.17:0/4129605397 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85ac017070 con 0x7f85c40d4a10 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c40c7bf0 con 0x7f85c40d4a10 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85baa00640 1 -- 172.21.15.17:0/4129605397 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac012d80 con 0x7f85c40d4a10 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c415fc00 con 0x7f85c40d4a10 2024-09-10T23:26:01.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c406eff0 con 0x7f85c40d4a10 2024-09-10T23:26:01.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.754+0000 7f85baa00640 1 -- 172.21.15.17:0/4129605397 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f85ac01c460 con 0x7f85c40d4a10 2024-09-10T23:26:01.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.758+0000 7f85baa00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85a00725e0 0x7f85a0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:01.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.758+0000 7f85baa00640 1 -- 172.21.15.17:0/4129605397 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f85ac093370 con 0x7f85c40d4a10 2024-09-10T23:26:01.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.758+0000 7f85c1e00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85a00725e0 0x7f85a0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:01.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.758+0000 7f85c1e00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85a00725e0 0x7f85a0074aa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f85c41fac50 tx=0x7f85b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:01.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.762+0000 7f85baa00640 1 -- 172.21.15.17:0/4129605397 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f85ac05e830 con 0x7f85c40d4a10 2024-09-10T23:26:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.974+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85c4075600 con 0x7f85c40d4a10 2024-09-10T23:26:01.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.974+0000 7f85baa00640 1 -- 172.21.15.17:0/4129605397 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f85ac05e130 con 0x7f85c40d4a10 2024-09-10T23:26:01.978 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:01.978 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:26:01.978 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:26:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85a00725e0 msgr2=0x7f85a0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85a00725e0 0x7f85a0074aa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f85c41fac50 tx=0x7f85b4009040 comp rx=0 tx=0).stop 2024-09-10T23:26:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c40d4a10 msgr2=0x7f85c40c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:01.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c40d4a10 0x7f85c40c8460 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c480 tx=0x7f85ac00c940 comp rx=0 tx=0).stop 2024-09-10T23:26:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 shutdown_connections 2024-09-10T23:26:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f85a00725e0 0x7f85a0074aa0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85c41618a0 0x7f85c40c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85c40d4a10 0x7f85c40c8460 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 --2- 172.21.15.17:0/4129605397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85c40d2180 0x7f85c40ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 >> 172.21.15.17:0/4129605397 conn(0x7f85c40d3f20 msgr2=0x7f85c40b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 shutdown_connections 2024-09-10T23:26:01.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:01.978+0000 7f85c8a00640 1 -- 172.21.15.17:0/4129605397 wait complete. 2024-09-10T23:26:02.000 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:26:02.000 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:26:02.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.142+0000 7f9fda400640 1 -- 172.21.15.17:0/2307723897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8004810 msgr2=0x7f9fb8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.142+0000 7f9fda400640 1 --2- 172.21.15.17:0/2307723897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8004810 0x7f9fb8004c90 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c310 tx=0x7f9fc001f720 comp rx=0 tx=0).stop 2024-09-10T23:26:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.142+0000 7f9fd3e00640 1 -- 172.21.15.17:0/2307723897 reap_dead start 2024-09-10T23:26:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.142+0000 7f9fda400640 1 -- 172.21.15.17:0/2307723897 shutdown_connections 2024-09-10T23:26:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.142+0000 7f9fda400640 1 -- 172.21.15.17:0/2307723897 >> 172.21.15.17:0/2307723897 conn(0x7f9fd40d1d60 msgr2=0x7f9fd40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.142+0000 7f9fda400640 1 -- 172.21.15.17:0/2307723897 shutdown_connections 2024-09-10T23:26:02.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.142+0000 7f9fda400640 1 -- 172.21.15.17:0/2307723897 wait complete. 2024-09-10T23:26:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 Processor -- start 2024-09-10T23:26:02.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 -- start start 2024-09-10T23:26:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb8004810 0x7f9fd40c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fd414b280 0x7f9fd41f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd41f7f50 0x7f9fd40b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:02.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd40d04f0 con 0x7f9fd41f7f50 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd40d0370 con 0x7f9fd414b280 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd40d0670 con 0x7f9fb8004810 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd41f7f50 0x7f9fd40b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd41f7f50 0x7f9fd40b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38766/0 (socket says 172.21.15.17:38766) 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3e00640 1 -- 172.21.15.17:0/2568885962 learned_addr learned my addr 172.21.15.17:0/2568885962 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd2a00640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fd414b280 0x7f9fd41f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb8004810 0x7f9fd40c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3e00640 1 -- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb8004810 msgr2=0x7f9fd40c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3e00640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb8004810 0x7f9fd40c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3e00640 1 -- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fd414b280 msgr2=0x7f9fd41f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3e00640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fd414b280 0x7f9fd41f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3e00640 1 -- 172.21.15.17:0/2568885962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd41f83d0 con 0x7f9fd41f7f50 2024-09-10T23:26:02.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb8004810 0x7f9fd40c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fd3e00640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd41f7f50 0x7f9fd40b5960 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4071ef0 tx=0x7f9fcc010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fcb400640 1 -- 172.21.15.17:0/2568885962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc003980 con 0x7f9fd41f7f50 2024-09-10T23:26:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fcb400640 1 -- 172.21.15.17:0/2568885962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fcc015070 con 0x7f9fd41f7f50 2024-09-10T23:26:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd41f86b0 con 0x7f9fd41f7f50 2024-09-10T23:26:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fcb400640 1 -- 172.21.15.17:0/2568885962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc004030 con 0x7f9fd41f7f50 2024-09-10T23:26:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd40ca920 con 0x7f9fd41f7f50 2024-09-10T23:26:02.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.146+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd40cfc60 con 0x7f9fd41f7f50 2024-09-10T23:26:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.150+0000 7f9fcb400640 1 -- 172.21.15.17:0/2568885962 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9fcc0041d0 con 0x7f9fd41f7f50 2024-09-10T23:26:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.150+0000 7f9fcb400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fb4072610 0x7f9fb4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.150+0000 7f9fcb400640 1 -- 172.21.15.17:0/2568885962 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f9fcc093e40 con 0x7f9fd41f7f50 2024-09-10T23:26:02.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.150+0000 7f9fd3400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fb4072610 0x7f9fb4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:02.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.150+0000 7f9fd3400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fb4072610 0x7f9fb4074ad0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4159e20 tx=0x7f9fc40091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:02.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.154+0000 7f9fcb400640 1 -- 172.21.15.17:0/2568885962 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9fcc05ed40 con 0x7f9fd41f7f50 2024-09-10T23:26:02.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.386+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9fd40ca410 con 0x7f9fd41f7f50 2024-09-10T23:26:02.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fcb400640 1 -- 172.21.15.17:0/2568885962 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1670 (secure 0 0 0) 0x7f9fcc063770 con 0x7f9fd41f7f50 2024-09-10T23:26:02.392 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:02.392 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":651,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078429770,"bytes_used":2630000640,"bytes_avail":770464112640,"bytes_total":773094113280,"write_bytes_sec":43594,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-10T23:25:52.440874+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}}}}}},"progress_events":{}} 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fb4072610 msgr2=0x7f9fb4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fb4072610 0x7f9fb4074ad0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4159e20 tx=0x7f9fc40091e0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd41f7f50 msgr2=0x7f9fd40b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd41f7f50 0x7f9fd40b5960 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4071ef0 tx=0x7f9fcc010f40 comp rx=0 tx=0).stop 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 shutdown_connections 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fb4072610 0x7f9fb4074ad0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd41f7f50 0x7f9fd40b5960 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9fd414b280 0x7f9fd41f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 --2- 172.21.15.17:0/2568885962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9fb8004810 0x7f9fd40c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 >> 172.21.15.17:0/2568885962 conn(0x7f9fd40d1d60 msgr2=0x7f9fd40d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 shutdown_connections 2024-09-10T23:26:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:02.390+0000 7f9fda400640 1 -- 172.21.15.17:0/2568885962 wait complete. 2024-09-10T23:26:02.413 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused paths [/scrub_control_test_path]'} 2024-09-10T23:26:03.414 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 -- 172.21.15.17:0/962575148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b4390 msgr2=0x7f16440d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 --2- 172.21.15.17:0/962575148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b4390 0x7f16440d0a90 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f163c009c80 tx=0x7f163c01cd70 comp rx=0 tx=0).stop 2024-09-10T23:26:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 -- 172.21.15.17:0/962575148 shutdown_connections 2024-09-10T23:26:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 --2- 172.21.15.17:0/962575148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b4390 0x7f16440d0a90 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 --2- 172.21.15.17:0/962575148 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16440b1f20 0x7f16440b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 -- 172.21.15.17:0/962575148 >> 172.21.15.17:0/962575148 conn(0x7f16440b3870 msgr2=0x7f16440b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:03.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 -- 172.21.15.17:0/962575148 shutdown_connections 2024-09-10T23:26:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 -- 172.21.15.17:0/962575148 wait complete. 2024-09-10T23:26:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 Processor -- start 2024-09-10T23:26:03.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 -- start start 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b1f20 0x7f1644153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16440b4390 0x7f16441575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1644161510 0x7f1644157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f164416ae00 con 0x7f16440b1f20 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f164416ac80 con 0x7f16440b4390 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f164416af80 con 0x7f1644161510 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1649800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b1f20 0x7f1644153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1649800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b1f20 0x7f1644153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38798/0 (socket says 172.21.15.17:38798) 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1649800640 1 -- 172.21.15.17:0/2130004507 learned_addr learned my addr 172.21.15.17:0/2130004507 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f164a200640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1644161510 0x7f1644157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1648e00640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16440b4390 0x7f16441575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1649800640 1 -- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1644161510 msgr2=0x7f1644157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1649800640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1644161510 0x7f1644157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1649800640 1 -- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16440b4390 msgr2=0x7f16441575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1649800640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16440b4390 0x7f16441575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1649800640 1 -- 172.21.15.17:0/2130004507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1644153ba0 con 0x7f16440b1f20 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.566+0000 7f1649800640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b1f20 0x7f1644153660 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f1638001ec0 tx=0x7f163800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.570+0000 7f1641600640 1 -- 172.21.15.17:0/2130004507 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638017070 con 0x7f16440b1f20 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.570+0000 7f1641600640 1 -- 172.21.15.17:0/2130004507 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1638003600 con 0x7f16440b1f20 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.570+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1644159460 con 0x7f16440b1f20 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.570+0000 7f1641600640 1 -- 172.21.15.17:0/2130004507 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638003a50 con 0x7f16440b1f20 2024-09-10T23:26:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.570+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1644159a20 con 0x7f16440b1f20 2024-09-10T23:26:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.570+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16440d0a90 con 0x7f16440b1f20 2024-09-10T23:26:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.570+0000 7f1641600640 1 -- 172.21.15.17:0/2130004507 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1638003bf0 con 0x7f16440b1f20 2024-09-10T23:26:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.570+0000 7f1641600640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16240725e0 0x7f1624074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.570+0000 7f1641600640 1 -- 172.21.15.17:0/2130004507 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f1638092a90 con 0x7f16440b1f20 2024-09-10T23:26:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.574+0000 7f1648e00640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16240725e0 0x7f1624074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.574+0000 7f1648e00640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16240725e0 0x7f1624074aa0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1644156ee0 tx=0x7f163000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.574+0000 7f1641600640 1 -- 172.21.15.17:0/2130004507 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f163805d870 con 0x7f16440b1f20 2024-09-10T23:26:03.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16440b3400 con 0x7f16440b1f20 2024-09-10T23:26:03.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f1641600640 1 -- 172.21.15.17:0/2130004507 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f1638092020 con 0x7f16440b1f20 2024-09-10T23:26:03.789 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:03.789 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:26:03.789 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:26:03.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16240725e0 msgr2=0x7f1624074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:03.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16240725e0 0x7f1624074aa0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1644156ee0 tx=0x7f163000b390 comp rx=0 tx=0).stop 2024-09-10T23:26:03.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b1f20 msgr2=0x7f1644153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:03.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b1f20 0x7f1644153660 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f1638001ec0 tx=0x7f163800c890 comp rx=0 tx=0).stop 2024-09-10T23:26:03.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 shutdown_connections 2024-09-10T23:26:03.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16240725e0 0x7f1624074aa0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1644161510 0x7f1644157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16440b4390 0x7f16441575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 --2- 172.21.15.17:0/2130004507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16440b1f20 0x7f1644153660 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 >> 172.21.15.17:0/2130004507 conn(0x7f16440b3870 msgr2=0x7f1644070960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:03.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 shutdown_connections 2024-09-10T23:26:03.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.786+0000 7f164c200640 1 -- 172.21.15.17:0/2130004507 wait complete. 2024-09-10T23:26:03.811 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T23:26:03.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:26:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 -- 172.21.15.17:0/58098673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80cf230 msgr2=0x7f63a8150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 --2- 172.21.15.17:0/58098673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80cf230 0x7f63a8150d70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009bc0 tx=0x7f63a001f3b0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 -- 172.21.15.17:0/58098673 shutdown_connections 2024-09-10T23:26:03.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 --2- 172.21.15.17:0/58098673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80cf230 0x7f63a8150d70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 --2- 172.21.15.17:0/58098673 >> v2:172.21.15.77:3300/0 conn(0x7f63a80b32d0 0x7f63a80cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 -- 172.21.15.17:0/58098673 >> 172.21.15.17:0/58098673 conn(0x7f63a806cfc0 msgr2=0x7f63a806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 -- 172.21.15.17:0/58098673 shutdown_connections 2024-09-10T23:26:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 -- 172.21.15.17:0/58098673 wait complete. 2024-09-10T23:26:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 Processor -- start 2024-09-10T23:26:03.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.954+0000 7f63ad200640 1 -- start start 2024-09-10T23:26:03.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63ad200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a806e750 0x7f63a80b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:03.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63ad200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a80b32d0 0x7f63a813cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:03.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63ad200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80cf230 0x7f63a813f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:03.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63ad200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f63a81512b0 con 0x7f63a806e750 2024-09-10T23:26:03.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63ad200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f63a80cf8d0 con 0x7f63a80b32d0 2024-09-10T23:26:03.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63ad200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f63a8151430 con 0x7f63a80cf230 2024-09-10T23:26:03.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a806e750 0x7f63a80b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:03.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a806e750 0x7f63a80b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38814/0 (socket says 172.21.15.17:38814) 2024-09-10T23:26:03.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a5e00640 1 -- 172.21.15.17:0/957753041 learned_addr learned my addr 172.21.15.17:0/957753041 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:03.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f639fe00640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a80b32d0 0x7f63a813cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:03.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a6800640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80cf230 0x7f63a813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a5e00640 1 -- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80cf230 msgr2=0x7f63a813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a5e00640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80cf230 0x7f63a813f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a5e00640 1 -- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a80b32d0 msgr2=0x7f63a813cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a5e00640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a80b32d0 0x7f63a813cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a5e00640 1 -- 172.21.15.17:0/957753041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a80b1bf0 con 0x7f63a806e750 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63a5e00640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a806e750 0x7f63a80b1490 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f639800c4c0 tx=0x7f639800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f639e000640 1 -- 172.21.15.17:0/957753041 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398016020 con 0x7f63a806e750 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f639e000640 1 -- 172.21.15.17:0/957753041 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6398012940 con 0x7f63a806e750 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f639e000640 1 -- 172.21.15.17:0/957753041 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6398012d90 con 0x7f63a806e750 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a80b1ed0 con 0x7f63a806e750 2024-09-10T23:26:03.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a813d570 con 0x7f63a806e750 2024-09-10T23:26:03.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a813d770 con 0x7f63a806e750 2024-09-10T23:26:03.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.958+0000 7f639e000640 1 -- 172.21.15.17:0/957753041 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f639801b400 con 0x7f63a806e750 2024-09-10T23:26:03.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.962+0000 7f639e000640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63840725e0 0x7f6384074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:03.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.962+0000 7f639e000640 1 -- 172.21.15.17:0/957753041 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f6398093630 con 0x7f63a806e750 2024-09-10T23:26:03.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.962+0000 7f639fe00640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63840725e0 0x7f6384074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:03.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.962+0000 7f639fe00640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63840725e0 0x7f6384074aa0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f63a81f5b20 tx=0x7f63900091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:03.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:03.966+0000 7f639e000640 1 -- 172.21.15.17:0/957753041 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f63a813d770 con 0x7f63a806e750 2024-09-10T23:26:04.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f63a80cffa0 con 0x7f63a806e750 2024-09-10T23:26:04.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f639e000640 1 -- 172.21.15.17:0/957753041 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1614 (secure 0 0 0) 0x7f6398020020 con 0x7f63a806e750 2024-09-10T23:26:04.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:04.205 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":653,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078429770,"bytes_used":2630000640,"bytes_avail":770464112640,"bytes_total":773094113280,"write_bytes_sec":12199,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8634}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-10T23:26:02.443559+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:26:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63840725e0 msgr2=0x7f6384074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63840725e0 0x7f6384074aa0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f63a81f5b20 tx=0x7f63900091e0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a806e750 msgr2=0x7f63a80b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a806e750 0x7f63a80b1490 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f639800c4c0 tx=0x7f639800c980 comp rx=0 tx=0).stop 2024-09-10T23:26:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 shutdown_connections 2024-09-10T23:26:04.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f63840725e0 0x7f6384074aa0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80cf230 0x7f63a813f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a80b32d0 0x7f63a813cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 --2- 172.21.15.17:0/957753041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63a806e750 0x7f63a80b1490 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 >> 172.21.15.17:0/957753041 conn(0x7f63a806cfc0 msgr2=0x7f63a806ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 shutdown_connections 2024-09-10T23:26:04.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.202+0000 7f63ad200640 1 -- 172.21.15.17:0/957753041 wait complete. 2024-09-10T23:26:04.226 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:26:04.227 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:26:04.227 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:26:04.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:26:04.373 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:26:04.374 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:26:04.374 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:26:04.374 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:26:04.382 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:26:04.383 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:26:04.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:26:04.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.618+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2955284383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 msgr2=0x7ff19c0ae970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.618+0000 7ff1a3a00640 1 --2- 172.21.15.17:0/2955284383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 0x7ff19c0ae970 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7ff19c073820 tx=0x7ff19001c7d0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.618+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2955284383 shutdown_connections 2024-09-10T23:26:04.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.618+0000 7ff1a3a00640 1 --2- 172.21.15.17:0/2955284383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 0x7ff19c0ae970 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.618+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2955284383 >> 172.21.15.17:0/2955284383 conn(0x7ff19c0d1ca0 msgr2=0x7ff19c0d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.618+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2955284383 shutdown_connections 2024-09-10T23:26:04.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.618+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2955284383 wait complete. 2024-09-10T23:26:04.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.618+0000 7ff1a3a00640 1 Processor -- start 2024-09-10T23:26:04.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.618+0000 7ff1a3a00640 1 -- start start 2024-09-10T23:26:04.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a3a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff19c0b24d0 0x7ff19c0b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a3a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff19c0cfef0 0x7ff19c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a3a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 0x7ff19c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a3a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c16a680 con 0x7ff19c15bfa0 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a3a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c16a500 con 0x7ff19c0b24d0 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a3a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff19c16a800 con 0x7ff19c0cfef0 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 0x7ff19c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 0x7ff19c06e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38840/0 (socket says 172.21.15.17:38840) 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1a00640 1 -- 172.21.15.17:0/2946870885 learned_addr learned my addr 172.21.15.17:0/2946870885 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1000640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff19c0b24d0 0x7ff19c0b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1a00640 1 -- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff19c0cfef0 msgr2=0x7ff19c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff19be00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff19c0cfef0 0x7ff19c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1a00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff19c0cfef0 0x7ff19c153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1a00640 1 -- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff19c0b24d0 msgr2=0x7ff19c0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1a00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff19c0b24d0 0x7ff19c0b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1a00640 1 -- 172.21.15.17:0/2946870885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c1fba00 con 0x7ff19c15bfa0 2024-09-10T23:26:04.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1000640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff19c0b24d0 0x7ff19c0b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:04.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff19be00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff19c0cfef0 0x7ff19c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:04.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a1a00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 0x7ff19c06e270 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ff19400cbc0 tx=0x7ff19400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff198c00640 1 -- 172.21.15.17:0/2946870885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194016020 con 0x7ff19c15bfa0 2024-09-10T23:26:04.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff198c00640 1 -- 172.21.15.17:0/2946870885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff19400ab40 con 0x7ff19c15bfa0 2024-09-10T23:26:04.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19c1fbce0 con 0x7ff19c15bfa0 2024-09-10T23:26:04.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff198c00640 1 -- 172.21.15.17:0/2946870885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194012420 con 0x7ff19c15bfa0 2024-09-10T23:26:04.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19c1fc2a0 con 0x7ff19c15bfa0 2024-09-10T23:26:04.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19c0ae970 con 0x7ff19c15bfa0 2024-09-10T23:26:04.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.622+0000 7ff198c00640 1 -- 172.21.15.17:0/2946870885 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff19401a3b0 con 0x7ff19c15bfa0 2024-09-10T23:26:04.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.626+0000 7ff198c00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff17c0725e0 0x7ff17c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:04.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.626+0000 7ff198c00640 1 -- 172.21.15.17:0/2946870885 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7ff194093700 con 0x7ff19c15bfa0 2024-09-10T23:26:04.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.626+0000 7ff1a1000640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff17c0725e0 0x7ff17c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:04.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.626+0000 7ff1a1000640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff17c0725e0 0x7ff17c074aa0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1900af000 tx=0x7ff19001b010 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:04.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.630+0000 7ff198c00640 1 -- 172.21.15.17:0/2946870885 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff194020030 con 0x7ff19c15bfa0 2024-09-10T23:26:04.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff19c0cf560 con 0x7ff19c15bfa0 2024-09-10T23:26:04.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff198c00640 1 -- 172.21.15.17:0/2946870885 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v144) ==== 80+0+0 (secure 0 0 0) 0x7ff194091e20 con 0x7ff19c15bfa0 2024-09-10T23:26:04.817 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:26:04.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff17c0725e0 msgr2=0x7ff17c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff17c0725e0 0x7ff17c074aa0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1900af000 tx=0x7ff19001b010 comp rx=0 tx=0).stop 2024-09-10T23:26:04.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 msgr2=0x7ff19c06e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 0x7ff19c06e270 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ff19400cbc0 tx=0x7ff19400ccb0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 shutdown_connections 2024-09-10T23:26:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff17c0725e0 0x7ff17c074aa0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff19c15bfa0 0x7ff19c06e270 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff19c0cfef0 0x7ff19c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 --2- 172.21.15.17:0/2946870885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff19c0b24d0 0x7ff19c0b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 >> 172.21.15.17:0/2946870885 conn(0x7ff19c0d1ca0 msgr2=0x7ff19c0b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 shutdown_connections 2024-09-10T23:26:04.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:04.814+0000 7ff1a3a00640 1 -- 172.21.15.17:0/2946870885 wait complete. 2024-09-10T23:26:04.839 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:26:04.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:04.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:04.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[75027]: fuse finished with error 0 and tester_r 0 2024-09-10T23:26:05.108 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:26:05.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:05.109 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:26:05.160 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:26:05.160 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:26:05.161 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:26:05.170 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:26:05.170 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:26:05.170 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:26:05.170 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:26:05.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:26:05.215 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:26:05.216 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:26:05.216 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:26:05.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:26:05.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:05.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 -- 172.21.15.17:0/389226721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160280 msgr2=0x7fef180cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:05.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 --2- 172.21.15.17:0/389226721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160280 0x7fef180cfaf0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fef180c8d90 tx=0x7fef0c01eff0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 -- 172.21.15.17:0/389226721 shutdown_connections 2024-09-10T23:26:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 --2- 172.21.15.17:0/389226721 >> v2:172.21.15.77:3300/0 conn(0x7fef180d2830 0x7fef180d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 --2- 172.21.15.17:0/389226721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160280 0x7fef180cfaf0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 -- 172.21.15.17:0/389226721 >> 172.21.15.17:0/389226721 conn(0x7fef180d1d10 msgr2=0x7fef180d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 -- 172.21.15.17:0/389226721 shutdown_connections 2024-09-10T23:26:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 -- 172.21.15.17:0/389226721 wait complete. 2024-09-10T23:26:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 Processor -- start 2024-09-10T23:26:05.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 -- start start 2024-09-10T23:26:05.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef180d2830 0x7fef18155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:05.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef18160280 0x7fef180c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:05.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160660 0x7fef180c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:05.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fef180afe30 con 0x7fef18160660 2024-09-10T23:26:05.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fef180afcb0 con 0x7fef180d2830 2024-09-10T23:26:05.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fef180affb0 con 0x7fef18160280 2024-09-10T23:26:05.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160660 0x7fef180c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:05.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160660 0x7fef180c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38846/0 (socket says 172.21.15.17:38846) 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1de00640 1 -- 172.21.15.17:0/3519476704 learned_addr learned my addr 172.21.15.17:0/3519476704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1d400640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef180d2830 0x7fef18155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.402+0000 7fef1ca00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef18160280 0x7fef180c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef1de00640 1 -- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef18160280 msgr2=0x7fef180c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef1de00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef18160280 0x7fef180c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef1de00640 1 -- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef180d2830 msgr2=0x7fef18155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef1de00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef180d2830 0x7fef18155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef1de00640 1 -- 172.21.15.17:0/3519476704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef181558a0 con 0x7fef18160660 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef1de00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160660 0x7fef180c7020 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c6b0 tx=0x7fef1000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef15600640 1 -- 172.21.15.17:0/3519476704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10017070 con 0x7fef18160660 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef15600640 1 -- 172.21.15.17:0/3519476704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef10003c70 con 0x7fef18160660 2024-09-10T23:26:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef15600640 1 -- 172.21.15.17:0/3519476704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10005350 con 0x7fef18160660 2024-09-10T23:26:05.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef180ce6b0 con 0x7fef18160660 2024-09-10T23:26:05.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef180cec70 con 0x7fef18160660 2024-09-10T23:26:05.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef180b04a0 con 0x7fef18160660 2024-09-10T23:26:05.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef15600640 1 -- 172.21.15.17:0/3519476704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fef100054f0 con 0x7fef18160660 2024-09-10T23:26:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef15600640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feef80725e0 0x7feef8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.406+0000 7fef15600640 1 -- 172.21.15.17:0/3519476704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fef10092c80 con 0x7fef18160660 2024-09-10T23:26:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.410+0000 7fef1d400640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feef80725e0 0x7feef8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:05.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.410+0000 7fef1d400640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feef80725e0 0x7feef8074aa0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0b2000 tx=0x7fef0c01d830 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.410+0000 7fef15600640 1 -- 172.21.15.17:0/3519476704 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fef1005db70 con 0x7fef18160660 2024-09-10T23:26:05.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.618+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef180b7780 con 0x7fef18160660 2024-09-10T23:26:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.618+0000 7fef15600640 1 -- 172.21.15.17:0/3519476704 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7fef100625a0 con 0x7fef18160660 2024-09-10T23:26:05.622 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:05.622 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:26:05.622 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:26:05.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feef80725e0 msgr2=0x7feef8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feef80725e0 0x7feef8074aa0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0b2000 tx=0x7fef0c01d830 comp rx=0 tx=0).stop 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160660 msgr2=0x7fef180c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160660 0x7fef180c7020 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fef1000c6b0 tx=0x7fef1000cb70 comp rx=0 tx=0).stop 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 shutdown_connections 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7feef80725e0 0x7feef8074aa0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef18160660 0x7fef180c7020 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fef18160280 0x7fef180c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 --2- 172.21.15.17:0/3519476704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef180d2830 0x7fef18155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 >> 172.21.15.17:0/3519476704 conn(0x7fef180d1d10 msgr2=0x7fef180ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 shutdown_connections 2024-09-10T23:26:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.622+0000 7fef1fe00640 1 -- 172.21.15.17:0/3519476704 wait complete. 2024-09-10T23:26:05.644 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:05.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.786+0000 7f50c6400640 1 -- 172.21.15.17:0/1921969985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00b76b0 msgr2=0x7f50c00b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:05.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.786+0000 7f50c6400640 1 --2- 172.21.15.17:0/1921969985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00b76b0 0x7f50c00b7b60 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009bc0 tx=0x7f50b801cb70 comp rx=0 tx=0).stop 2024-09-10T23:26:05.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.786+0000 7f50c6400640 1 -- 172.21.15.17:0/1921969985 shutdown_connections 2024-09-10T23:26:05.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.786+0000 7f50c6400640 1 --2- 172.21.15.17:0/1921969985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00b76b0 0x7f50c00b7b60 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.786+0000 7f50c6400640 1 --2- 172.21.15.17:0/1921969985 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c00d0450 0x7f50c00d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.786+0000 7f50c6400640 1 -- 172.21.15.17:0/1921969985 >> 172.21.15.17:0/1921969985 conn(0x7f50c00d3ce0 msgr2=0x7f50c00d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:05.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.786+0000 7f50c6400640 1 -- 172.21.15.17:0/1921969985 shutdown_connections 2024-09-10T23:26:05.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.786+0000 7f50c6400640 1 -- 172.21.15.17:0/1921969985 wait complete. 2024-09-10T23:26:05.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 Processor -- start 2024-09-10T23:26:05.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 -- start start 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c00b76b0 0x7f50c01522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c00d0450 0x7f50c0154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00d4800 0x7f50c01554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f50c016ace0 con 0x7f50c00d4800 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f50c016ab60 con 0x7f50c00b76b0 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f50c016ae60 con 0x7f50c00d0450 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00d4800 0x7f50c01554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00d4800 0x7f50c01554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38856/0 (socket says 172.21.15.17:38856) 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5a00640 1 -- 172.21.15.17:0/3948829434 learned_addr learned my addr 172.21.15.17:0/3948829434 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5000640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c00b76b0 0x7f50c01522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50b7e00640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c00d0450 0x7f50c0154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5a00640 1 -- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c00d0450 msgr2=0x7f50c0154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5a00640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c00d0450 0x7f50c0154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5a00640 1 -- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c00b76b0 msgr2=0x7f50c01522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5a00640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c00b76b0 0x7f50c01522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5a00640 1 -- 172.21.15.17:0/3948829434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c00c8500 con 0x7f50c00d4800 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50b7e00640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c00d0450 0x7f50c0154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c5a00640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00d4800 0x7f50c01554f0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f50b801a7a0 tx=0x7f50b8009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50bd600640 1 -- 172.21.15.17:0/3948829434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b80b2040 con 0x7f50c00d4800 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50bd600640 1 -- 172.21.15.17:0/3948829434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50b8004d40 con 0x7f50c00d4800 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50bd600640 1 -- 172.21.15.17:0/3948829434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8004240 con 0x7f50c00d4800 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c00c87e0 con 0x7f50c00d4800 2024-09-10T23:26:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.790+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c00c8da0 con 0x7f50c00d4800 2024-09-10T23:26:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.794+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c00b7b60 con 0x7f50c00d4800 2024-09-10T23:26:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.794+0000 7f50bd600640 1 -- 172.21.15.17:0/3948829434 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f50b80b5070 con 0x7f50c00d4800 2024-09-10T23:26:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.794+0000 7f50bd600640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f509c0725e0 0x7f509c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:05.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.794+0000 7f50bd600640 1 -- 172.21.15.17:0/3948829434 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f50b812d2d0 con 0x7f50c00d4800 2024-09-10T23:26:05.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.794+0000 7f50c5000640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f509c0725e0 0x7f509c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:05.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.798+0000 7f50c5000640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f509c0725e0 0x7f509c074aa0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f50b0005fd0 tx=0x7f50b0005db0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:05.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:05.798+0000 7f50bd600640 1 -- 172.21.15.17:0/3948829434 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f50b8016790 con 0x7f50c00d4800 2024-09-10T23:26:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.010+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50c00c8f70 con 0x7f50c00d4800 2024-09-10T23:26:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.010+0000 7f50bd600640 1 -- 172.21.15.17:0/3948829434 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f50b80f86f0 con 0x7f50c00d4800 2024-09-10T23:26:06.014 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:06.014 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:26:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:26:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f509c0725e0 msgr2=0x7f509c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f509c0725e0 0x7f509c074aa0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f50b0005fd0 tx=0x7f50b0005db0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00d4800 msgr2=0x7f50c01554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00d4800 0x7f50c01554f0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f50b801a7a0 tx=0x7f50b8009300 comp rx=0 tx=0).stop 2024-09-10T23:26:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 shutdown_connections 2024-09-10T23:26:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f509c0725e0 0x7f509c074aa0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50c00d4800 0x7f50c01554f0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c00d0450 0x7f50c0154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 --2- 172.21.15.17:0/3948829434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c00b76b0 0x7f50c01522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 >> 172.21.15.17:0/3948829434 conn(0x7f50c00d3ce0 msgr2=0x7f50c00d40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 shutdown_connections 2024-09-10T23:26:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.014+0000 7f50c6400640 1 -- 172.21.15.17:0/3948829434 wait complete. 2024-09-10T23:26:06.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:26:06.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.178+0000 7fea1cc00640 1 -- 172.21.15.17:0/2862329064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180d1830 msgr2=0x7fea180ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.178+0000 7fea1cc00640 1 --2- 172.21.15.17:0/2862329064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180d1830 0x7fea180ccf80 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fea10009bc0 tx=0x7fea1001cba0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.178+0000 7fea1cc00640 1 -- 172.21.15.17:0/2862329064 shutdown_connections 2024-09-10T23:26:06.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.178+0000 7fea1cc00640 1 --2- 172.21.15.17:0/2862329064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea180d1830 0x7fea180ccf80 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.178+0000 7fea1cc00640 1 -- 172.21.15.17:0/2862329064 >> 172.21.15.17:0/2862329064 conn(0x7fea180d1d60 msgr2=0x7fea180d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.178+0000 7fea1cc00640 1 -- 172.21.15.17:0/2862329064 shutdown_connections 2024-09-10T23:26:06.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.178+0000 7fea1cc00640 1 -- 172.21.15.17:0/2862329064 wait complete. 2024-09-10T23:26:06.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 Processor -- start 2024-09-10T23:26:06.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 -- start start 2024-09-10T23:26:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea18070ad0 0x7fea1814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea180d1830 0x7fea181533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea1815f770 0x7fea181538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fea1816a560 con 0x7fea1815f770 2024-09-10T23:26:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea1816a3e0 con 0x7fea180d1830 2024-09-10T23:26:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fea1816a6e0 con 0x7fea18070ad0 2024-09-10T23:26:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea16800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea1815f770 0x7fea181538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea16800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea1815f770 0x7fea181538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38876/0 (socket says 172.21.15.17:38876) 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea16800640 1 -- 172.21.15.17:0/3433038786 learned_addr learned my addr 172.21.15.17:0/3433038786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea16800640 1 -- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea18070ad0 msgr2=0x7fea1814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea16800640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea18070ad0 0x7fea1814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea16800640 1 -- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea180d1830 msgr2=0x7fea181533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea16800640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea180d1830 0x7fea181533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea16800640 1 -- 172.21.15.17:0/3433038786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea18155ac0 con 0x7fea1815f770 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea16800640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea1815f770 0x7fea181538f0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fea10009b10 tx=0x7fea100a5c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea0e000640 1 -- 172.21.15.17:0/3433038786 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea100bb070 con 0x7fea1815f770 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea0e000640 1 -- 172.21.15.17:0/3433038786 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea10004e00 con 0x7fea1815f770 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea18155da0 con 0x7fea1815f770 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea0e000640 1 -- 172.21.15.17:0/3433038786 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea100b2040 con 0x7fea1815f770 2024-09-10T23:26:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1814ff90 con 0x7fea1815f770 2024-09-10T23:26:06.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.182+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea1815f060 con 0x7fea1815f770 2024-09-10T23:26:06.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.186+0000 7fea0e000640 1 -- 172.21.15.17:0/3433038786 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fea100b5030 con 0x7fea1815f770 2024-09-10T23:26:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.186+0000 7fea0e000640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9f40725e0 0x7fe9f4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.186+0000 7fea0e000640 1 -- 172.21.15.17:0/3433038786 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7fea1012d240 con 0x7fea1815f770 2024-09-10T23:26:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.186+0000 7fea15e00640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9f40725e0 0x7fe9f4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.186+0000 7fea15e00640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9f40725e0 0x7fe9f4074aa0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fea08000f70 tx=0x7fea080078f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.190+0000 7fea0e000640 1 -- 172.21.15.17:0/3433038786 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fea10016790 con 0x7fea1815f770 2024-09-10T23:26:06.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.362+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea180b6f60 con 0x7fea1815f770 2024-09-10T23:26:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea0e000640 1 -- 172.21.15.17:0/3433038786 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+16900 (secure 0 0 0) 0x7fea100f8780 con 0x7fea1815f770 2024-09-10T23:26:06.368 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:06.368 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":144,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:25:14.845302+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:25:10.976327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-10T23:25:12.226641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9f40725e0 msgr2=0x7fe9f4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9f40725e0 0x7fe9f4074aa0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fea08000f70 tx=0x7fea080078f0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea1815f770 msgr2=0x7fea181538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea1815f770 0x7fea181538f0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fea10009b10 tx=0x7fea100a5c10 comp rx=0 tx=0).stop 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 shutdown_connections 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9f40725e0 0x7fe9f4074aa0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea1815f770 0x7fea181538f0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea180d1830 0x7fea181533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 --2- 172.21.15.17:0/3433038786 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea18070ad0 0x7fea1814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 >> 172.21.15.17:0/3433038786 conn(0x7fea180d1d60 msgr2=0x7fea180b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 shutdown_connections 2024-09-10T23:26:06.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.366+0000 7fea1cc00640 1 -- 172.21.15.17:0/3433038786 wait complete. 2024-09-10T23:26:06.390 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:26:06.390 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:06.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 -- 172.21.15.17:0/149262627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1394153030 msgr2=0x7f13940b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 --2- 172.21.15.17:0/149262627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1394153030 0x7f13940b3e30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f138c009c80 tx=0x7f138c01cd70 comp rx=0 tx=0).stop 2024-09-10T23:26:06.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 -- 172.21.15.17:0/149262627 shutdown_connections 2024-09-10T23:26:06.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 --2- 172.21.15.17:0/149262627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1394153030 0x7f13940b3e30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 --2- 172.21.15.17:0/149262627 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1394152c50 0x7f1394070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 -- 172.21.15.17:0/149262627 >> 172.21.15.17:0/149262627 conn(0x7f13940d03d0 msgr2=0x7f13940d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 -- 172.21.15.17:0/149262627 shutdown_connections 2024-09-10T23:26:06.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 -- 172.21.15.17:0/149262627 wait complete. 2024-09-10T23:26:06.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 Processor -- start 2024-09-10T23:26:06.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 -- start start 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940d1120 0x7f13941516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1394152c50 0x7f139414cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1394153030 0x7f13940b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1394071720 con 0x7f13940d1120 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f13940715a0 con 0x7f1394153030 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.534+0000 7f1399000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f13940b4a20 con 0x7f1394152c50 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1391e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940d1120 0x7f13941516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1391e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940d1120 0x7f13941516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38892/0 (socket says 172.21.15.17:38892) 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1391e00640 1 -- 172.21.15.17:0/1262689159 learned_addr learned my addr 172.21.15.17:0/1262689159 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f138be00640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1394152c50 0x7f139414cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1392800640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1394153030 0x7f13940b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1391e00640 1 -- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1394152c50 msgr2=0x7f139414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1391e00640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1394152c50 0x7f139414cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1391e00640 1 -- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1394153030 msgr2=0x7f13940b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1391e00640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1394153030 0x7f13940b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1391e00640 1 -- 172.21.15.17:0/1262689159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13941574b0 con 0x7f13940d1120 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1391e00640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940d1120 0x7f13941516e0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f138400ea20 tx=0x7f138400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f138a000640 1 -- 172.21.15.17:0/1262689159 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138400cd80 con 0x7f13940d1120 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f138a000640 1 -- 172.21.15.17:0/1262689159 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1384010430 con 0x7f13940d1120 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f138a000640 1 -- 172.21.15.17:0/1262689159 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384010860 con 0x7f13940d1120 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1394150c00 con 0x7f13940d1120 2024-09-10T23:26:06.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1394157790 con 0x7f13940d1120 2024-09-10T23:26:06.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1394070350 con 0x7f13940d1120 2024-09-10T23:26:06.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.538+0000 7f138a000640 1 -- 172.21.15.17:0/1262689159 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1384010a00 con 0x7f13940d1120 2024-09-10T23:26:06.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.542+0000 7f138a000640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13700725e0 0x7f1370074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.542+0000 7f138a000640 1 -- 172.21.15.17:0/1262689159 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f1384093e70 con 0x7f13940d1120 2024-09-10T23:26:06.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.542+0000 7f138be00640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13700725e0 0x7f1370074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.542+0000 7f138be00640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13700725e0 0x7f1370074aa0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f13941faa20 tx=0x7f137c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.546+0000 7f138a000640 1 -- 172.21.15.17:0/1262689159 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f138405ede0 con 0x7f13940d1120 2024-09-10T23:26:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.750+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13940ccc10 con 0x7f13940d1120 2024-09-10T23:26:06.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.750+0000 7f138a000640 1 -- 172.21.15.17:0/1262689159 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f1384063810 con 0x7f13940d1120 2024-09-10T23:26:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:06.756 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:26:06.756 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13700725e0 msgr2=0x7f1370074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13700725e0 0x7f1370074aa0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f13941faa20 tx=0x7f137c009040 comp rx=0 tx=0).stop 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940d1120 msgr2=0x7f13941516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940d1120 0x7f13941516e0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f138400ea20 tx=0x7f138400eee0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 shutdown_connections 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13700725e0 0x7f1370074aa0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1394153030 0x7f13940b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1394152c50 0x7f139414cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 --2- 172.21.15.17:0/1262689159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13940d1120 0x7f13941516e0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 >> 172.21.15.17:0/1262689159 conn(0x7f13940d03d0 msgr2=0x7f139406d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 shutdown_connections 2024-09-10T23:26:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.754+0000 7f1399000640 1 -- 172.21.15.17:0/1262689159 wait complete. 2024-09-10T23:26:06.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:06.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 -- 172.21.15.17:0/923040949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a60070ad0 msgr2=0x7f3a6015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 --2- 172.21.15.17:0/923040949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a60070ad0 0x7f3a6015f060 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f3a600b7de0 tx=0x7f3a5001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 -- 172.21.15.17:0/923040949 shutdown_connections 2024-09-10T23:26:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 --2- 172.21.15.17:0/923040949 >> v2:172.21.15.77:3300/0 conn(0x7f3a600cf320 0x7f3a600cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 --2- 172.21.15.17:0/923040949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a60070ad0 0x7f3a6015f060 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 -- 172.21.15.17:0/923040949 >> 172.21.15.17:0/923040949 conn(0x7f3a600d1d60 msgr2=0x7f3a600d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 -- 172.21.15.17:0/923040949 shutdown_connections 2024-09-10T23:26:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 -- 172.21.15.17:0/923040949 wait complete. 2024-09-10T23:26:06.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 Processor -- start 2024-09-10T23:26:06.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 -- start start 2024-09-10T23:26:06.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a60070ad0 0x7f3a60151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a600cf320 0x7f3a600c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a600d1830 0x7f3a600cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60169320 con 0x7f3a600cf320 2024-09-10T23:26:06.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3a601691a0 con 0x7f3a60070ad0 2024-09-10T23:26:06.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a67c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3a601694a0 con 0x7f3a600d1830 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a57e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a600cf320 0x7f3a600c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a57e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a600cf320 0x7f3a600c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36184/0 (socket says 172.21.15.17:36184) 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a57e00640 1 -- 172.21.15.17:0/4046438466 learned_addr learned my addr 172.21.15.17:0/4046438466 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a65200640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a60070ad0 0x7f3a60151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.922+0000 7f3a65c00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a600d1830 0x7f3a600cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a57e00640 1 -- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a600d1830 msgr2=0x7f3a600cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a57e00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a600d1830 0x7f3a600cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a57e00640 1 -- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a60070ad0 msgr2=0x7f3a60151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a57e00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a60070ad0 0x7f3a60151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a57e00640 1 -- 172.21.15.17:0/4046438466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a600c8e30 con 0x7f3a600cf320 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a57e00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a600cf320 0x7f3a600c59d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800b3e0 tx=0x7f3a4800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a5d600640 1 -- 172.21.15.17:0/4046438466 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48015020 con 0x7f3a600cf320 2024-09-10T23:26:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a5d600640 1 -- 172.21.15.17:0/4046438466 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a48011940 con 0x7f3a600cf320 2024-09-10T23:26:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a600c90d0 con 0x7f3a600cf320 2024-09-10T23:26:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a5d600640 1 -- 172.21.15.17:0/4046438466 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a48011d90 con 0x7f3a600cf320 2024-09-10T23:26:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a600c9690 con 0x7f3a600cf320 2024-09-10T23:26:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6015f060 con 0x7f3a600cf320 2024-09-10T23:26:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a5d600640 1 -- 172.21.15.17:0/4046438466 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3a4801a410 con 0x7f3a600cf320 2024-09-10T23:26:06.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a5d600640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a3c072610 0x7f3a3c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:06.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.926+0000 7f3a5d600640 1 -- 172.21.15.17:0/4046438466 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f3a48092fe0 con 0x7f3a600cf320 2024-09-10T23:26:06.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.930+0000 7f3a65200640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a3c072610 0x7f3a3c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:06.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.930+0000 7f3a65200640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a3c072610 0x7f3a3c074ad0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3a500af000 tx=0x7f3a5001b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:06.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:06.930+0000 7f3a5d600640 1 -- 172.21.15.17:0/4046438466 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3a4801f070 con 0x7f3a600cf320 2024-09-10T23:26:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a600b6c60 con 0x7f3a600cf320 2024-09-10T23:26:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a5d600640 1 -- 172.21.15.17:0/4046438466 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5225 (secure 0 0 0) 0x7f3a4805de80 con 0x7f3a600cf320 2024-09-10T23:26:07.145 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:07.145 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":104,"btime":"2024-09-10T23:25:16:870660+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:25:13.260978+0000","modified":"2024-09-10T23:25:16.270101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8634":{"gid":8634,"name":"d","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1244612709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1244612709},{"type":"v1","addr":"172.21.15.77:6837","nonce":1244612709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8634,"qdb_cluster":[8634]},"id":9}]} 2024-09-10T23:26:07.145 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 104 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a3c072610 msgr2=0x7f3a3c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a3c072610 0x7f3a3c074ad0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3a500af000 tx=0x7f3a5001b100 comp rx=0 tx=0).stop 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a600cf320 msgr2=0x7f3a600c59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a600cf320 0x7f3a600c59d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f3a4800b3e0 tx=0x7f3a4800b8a0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 shutdown_connections 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a3c072610 0x7f3a3c074ad0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3a600d1830 0x7f3a600cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a600cf320 0x7f3a600c59d0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 --2- 172.21.15.17:0/4046438466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a60070ad0 0x7f3a60151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 >> 172.21.15.17:0/4046438466 conn(0x7f3a600d1d60 msgr2=0x7f3a600b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 shutdown_connections 2024-09-10T23:26:07.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.142+0000 7f3a67c00640 1 -- 172.21.15.17:0/4046438466 wait complete. 2024-09-10T23:26:07.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:26:07.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.306+0000 7f8d28000640 1 -- 172.21.15.17:0/2706865796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200d2830 msgr2=0x7f8d200d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.306+0000 7f8d28000640 1 --2- 172.21.15.17:0/2706865796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200d2830 0x7f8d200d0030 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f8d20073bd0 tx=0x7f8d0c01eff0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 -- 172.21.15.17:0/2706865796 shutdown_connections 2024-09-10T23:26:07.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 --2- 172.21.15.17:0/2706865796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d200d2830 0x7f8d200d0030 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 --2- 172.21.15.17:0/2706865796 >> v2:172.21.15.77:3300/0 conn(0x7f8d20160280 0x7f8d200cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 -- 172.21.15.17:0/2706865796 >> 172.21.15.17:0/2706865796 conn(0x7f8d200d1d10 msgr2=0x7f8d200d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 -- 172.21.15.17:0/2706865796 shutdown_connections 2024-09-10T23:26:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 -- 172.21.15.17:0/2706865796 wait complete. 2024-09-10T23:26:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 Processor -- start 2024-09-10T23:26:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 -- start start 2024-09-10T23:26:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d200d2830 0x7f8d20155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d20160280 0x7f8d200c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d20160660 0x7f8d200ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8d200afe30 con 0x7f8d20160280 2024-09-10T23:26:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d200afcb0 con 0x7f8d200d2830 2024-09-10T23:26:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d28000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8d200affb0 con 0x7f8d20160660 2024-09-10T23:26:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d24c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d20160280 0x7f8d200c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d24c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d20160280 0x7f8d200c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36212/0 (socket says 172.21.15.17:36212) 2024-09-10T23:26:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d24c00640 1 -- 172.21.15.17:0/4086390360 learned_addr learned my addr 172.21.15.17:0/4086390360 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d25600640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d200d2830 0x7f8d20155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d26000640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d20160660 0x7f8d200ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d24c00640 1 -- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d20160660 msgr2=0x7f8d200ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d24c00640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d20160660 0x7f8d200ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d24c00640 1 -- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d200d2830 msgr2=0x7f8d20155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d24c00640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d200d2830 0x7f8d20155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d24c00640 1 -- 172.21.15.17:0/4086390360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d20156130 con 0x7f8d20160280 2024-09-10T23:26:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d26000640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d20160660 0x7f8d200ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.310+0000 7f8d24c00640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d20160280 0x7f8d200c4870 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009790 tx=0x7f8d0c0a8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:07.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d1d600640 1 -- 172.21.15.17:0/4086390360 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0b5040 con 0x7f8d20160280 2024-09-10T23:26:07.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d1d600640 1 -- 172.21.15.17:0/4086390360 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d0c0bf070 con 0x7f8d20160280 2024-09-10T23:26:07.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d20156410 con 0x7f8d20160280 2024-09-10T23:26:07.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d1d600640 1 -- 172.21.15.17:0/4086390360 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0b1c50 con 0x7f8d20160280 2024-09-10T23:26:07.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d201569d0 con 0x7f8d20160280 2024-09-10T23:26:07.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d201559a0 con 0x7f8d20160280 2024-09-10T23:26:07.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d1d600640 1 -- 172.21.15.17:0/4086390360 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8d0c0b8030 con 0x7f8d20160280 2024-09-10T23:26:07.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d1d600640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d00072610 0x7f8d00074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:07.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d1d600640 1 -- 172.21.15.17:0/4086390360 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f8d0c130d10 con 0x7f8d20160280 2024-09-10T23:26:07.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.314+0000 7f8d25600640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d00072610 0x7f8d00074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.318+0000 7f8d25600640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d00072610 0x7f8d00074ad0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8d140058d0 tx=0x7f8d14005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:07.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.318+0000 7f8d1d600640 1 -- 172.21.15.17:0/4086390360 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8d0c136020 con 0x7f8d20160280 2024-09-10T23:26:07.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.494+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d200b04a0 con 0x7f8d20160280 2024-09-10T23:26:07.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.494+0000 7f8d1d600640 1 -- 172.21.15.17:0/4086390360 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+16900 (secure 0 0 0) 0x7f8d0c018b50 con 0x7f8d20160280 2024-09-10T23:26:07.499 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:07.499 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":144,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:25:14.845302+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:25:10.976327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-10T23:25:12.226641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:26:07.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d00072610 msgr2=0x7f8d00074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d00072610 0x7f8d00074ad0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8d140058d0 tx=0x7f8d14005860 comp rx=0 tx=0).stop 2024-09-10T23:26:07.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d20160280 msgr2=0x7f8d200c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d20160280 0x7f8d200c4870 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009790 tx=0x7f8d0c0a8ca0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 shutdown_connections 2024-09-10T23:26:07.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8d00072610 0x7f8d00074ad0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d20160660 0x7f8d200ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d20160280 0x7f8d200c4870 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 --2- 172.21.15.17:0/4086390360 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d200d2830 0x7f8d20155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 >> 172.21.15.17:0/4086390360 conn(0x7f8d200d1d10 msgr2=0x7f8d200cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:07.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 shutdown_connections 2024-09-10T23:26:07.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.498+0000 7f8d28000640 1 -- 172.21.15.17:0/4086390360 wait complete. 2024-09-10T23:26:07.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:26:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.666+0000 7f1784a00640 1 -- 172.21.15.17:0/2072037041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17800cfbe0 msgr2=0x7f17800cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.666+0000 7f1784a00640 1 --2- 172.21.15.17:0/2072037041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17800cfbe0 0x7f17800cd800 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f1778009c80 tx=0x7f177801cc80 comp rx=0 tx=0).stop 2024-09-10T23:26:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.666+0000 7f1784a00640 1 -- 172.21.15.17:0/2072037041 shutdown_connections 2024-09-10T23:26:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.666+0000 7f1784a00640 1 --2- 172.21.15.17:0/2072037041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17800cfbe0 0x7f17800cd800 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.666+0000 7f1784a00640 1 --2- 172.21.15.17:0/2072037041 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f178015f2d0 0x7f17800d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.666+0000 7f1784a00640 1 -- 172.21.15.17:0/2072037041 >> 172.21.15.17:0/2072037041 conn(0x7f17800d1ce0 msgr2=0x7f17800d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.666+0000 7f1784a00640 1 -- 172.21.15.17:0/2072037041 shutdown_connections 2024-09-10T23:26:07.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.666+0000 7f1784a00640 1 -- 172.21.15.17:0/2072037041 wait complete. 2024-09-10T23:26:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.666+0000 7f1784a00640 1 Processor -- start 2024-09-10T23:26:07.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 -- start start 2024-09-10T23:26:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17800cfbe0 0x7f1780157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178015f2d0 0x7f178006e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178015f6b0 0x7f178015dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f17801693b0 con 0x7f178015f6b0 2024-09-10T23:26:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1780169230 con 0x7f178015f2d0 2024-09-10T23:26:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1780169530 con 0x7f17800cfbe0 2024-09-10T23:26:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178015f6b0 0x7f178015dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:07.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17800cfbe0 0x7f1780157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178015f6b0 0x7f178015dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36218/0 (socket says 172.21.15.17:36218) 2024-09-10T23:26:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177e800640 1 -- 172.21.15.17:0/3630351798 learned_addr learned my addr 172.21.15.17:0/3630351798 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1775400640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178015f2d0 0x7f178006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177e800640 1 -- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17800cfbe0 msgr2=0x7f1780157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177e800640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17800cfbe0 0x7f1780157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177e800640 1 -- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178015f2d0 msgr2=0x7f178006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177e800640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178015f2d0 0x7f178006e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177e800640 1 -- 172.21.15.17:0/3630351798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17801f8530 con 0x7f178015f6b0 2024-09-10T23:26:07.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1775400640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178015f2d0 0x7f178006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f177e800640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178015f6b0 0x7f178015dda0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f1778009bd0 tx=0x7f1778009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1776a00640 1 -- 172.21.15.17:0/3630351798 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17780bb070 con 0x7f178015f6b0 2024-09-10T23:26:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1776a00640 1 -- 172.21.15.17:0/3630351798 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1778004e00 con 0x7f178015f6b0 2024-09-10T23:26:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17801f8810 con 0x7f178015f6b0 2024-09-10T23:26:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1776a00640 1 -- 172.21.15.17:0/3630351798 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17780b2040 con 0x7f178015f6b0 2024-09-10T23:26:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17801f8dd0 con 0x7f178015f6b0 2024-09-10T23:26:07.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.670+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17800d00c0 con 0x7f178015f6b0 2024-09-10T23:26:07.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.674+0000 7f1776a00640 1 -- 172.21.15.17:0/3630351798 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f17780b5030 con 0x7f178015f6b0 2024-09-10T23:26:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.674+0000 7f1776a00640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f175c072610 0x7f175c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:07.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.674+0000 7f1776a00640 1 -- 172.21.15.17:0/3630351798 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 6101+0+0 (secure 0 0 0) 0x7f177812d140 con 0x7f178015f6b0 2024-09-10T23:26:07.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.674+0000 7f177de00640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f175c072610 0x7f175c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:07.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.674+0000 7f177de00640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f175c072610 0x7f175c074ad0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f17801f95f0 tx=0x7f177000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:07.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.678+0000 7f1776a00640 1 -- 172.21.15.17:0/3630351798 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f17800d0a10 con 0x7f178015f6b0 2024-09-10T23:26:07.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.890+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f17800b0430 con 0x7f178015f6b0 2024-09-10T23:26:07.896 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:26:07.890+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:26:07.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.890+0000 7f1776a00640 1 -- 172.21.15.17:0/3630351798 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) ==== 161+0+0 (secure 0 0 0) 0x7f1778016990 con 0x7f178015f6b0 2024-09-10T23:26:07.897 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:26:07.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f175c072610 msgr2=0x7f175c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f175c072610 0x7f175c074ad0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f17801f95f0 tx=0x7f177000b390 comp rx=0 tx=0).stop 2024-09-10T23:26:07.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178015f6b0 msgr2=0x7f178015dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178015f6b0 0x7f178015dda0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f1778009bd0 tx=0x7f1778009390 comp rx=0 tx=0).stop 2024-09-10T23:26:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 shutdown_connections 2024-09-10T23:26:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f175c072610 0x7f175c074ad0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f178015f6b0 0x7f178015dda0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f178015f2d0 0x7f178006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 --2- 172.21.15.17:0/3630351798 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17800cfbe0 0x7f1780157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 >> 172.21.15.17:0/3630351798 conn(0x7f17800d1ce0 msgr2=0x7f17800b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 shutdown_connections 2024-09-10T23:26:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:07.894+0000 7f1784a00640 1 -- 172.21.15.17:0/3630351798 wait complete. 2024-09-10T23:26:07.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:26:07.930 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:26:07.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:26:07.966 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:26:08.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.066+0000 7f2fcb000640 1 -- 172.21.15.17:0/1679072663 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2fc4073210 msgr2=0x7f2fc4165850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.066+0000 7f2fcb000640 1 --2- 172.21.15.17:0/1679072663 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2fc4073210 0x7f2fc4165850 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009bf0 tx=0x7f2fbc01cbe0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.066+0000 7f2fcb000640 1 -- 172.21.15.17:0/1679072663 shutdown_connections 2024-09-10T23:26:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.066+0000 7f2fcb000640 1 --2- 172.21.15.17:0/1679072663 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2fc4073210 0x7f2fc4165850 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.066+0000 7f2fcb000640 1 -- 172.21.15.17:0/1679072663 >> 172.21.15.17:0/1679072663 conn(0x7f2fc40b17a0 msgr2=0x7f2fc40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.066+0000 7f2fcb000640 1 -- 172.21.15.17:0/1679072663 shutdown_connections 2024-09-10T23:26:08.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.066+0000 7f2fcb000640 1 -- 172.21.15.17:0/1679072663 wait complete. 2024-09-10T23:26:08.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.066+0000 7f2fcb000640 1 Processor -- start 2024-09-10T23:26:08.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.066+0000 7f2fcb000640 1 -- start start 2024-09-10T23:26:08.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fcb000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4072690 0x7f2fc4159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fcb000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc4073210 0x7f2fc40b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fcb000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2fc415aa80 0x7f2fc4140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fcb000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4168cc0 con 0x7f2fc4072690 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fcb000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4168b40 con 0x7f2fc4073210 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fcb000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc4168e40 con 0x7f2fc415aa80 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4072690 0x7f2fc4159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4072690 0x7f2fc4159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36220/0 (socket says 172.21.15.17:36220) 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc3e00640 1 -- 172.21.15.17:0/2680427843 learned_addr learned my addr 172.21.15.17:0/2680427843 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc9000640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2fc415aa80 0x7f2fc4140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fbbe00640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc4073210 0x7f2fc40b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc3e00640 1 -- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2fc415aa80 msgr2=0x7f2fc4140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc3e00640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2fc415aa80 0x7f2fc4140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc3e00640 1 -- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc4073210 msgr2=0x7f2fc40b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc3e00640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc4073210 0x7f2fc40b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc3e00640 1 -- 172.21.15.17:0/2680427843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc41583b0 con 0x7f2fc4072690 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc9000640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2fc415aa80 0x7f2fc4140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc3e00640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4072690 0x7f2fc4159430 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400c430 tx=0x7f2fb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc0c00640 1 -- 172.21.15.17:0/2680427843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4011790 con 0x7f2fc4072690 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc0c00640 1 -- 172.21.15.17:0/2680427843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fb4017070 con 0x7f2fc4072690 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc0c00640 1 -- 172.21.15.17:0/2680427843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4011ce0 con 0x7f2fc4072690 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc4158670 con 0x7f2fc4072690 2024-09-10T23:26:08.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc4158c30 con 0x7f2fc4072690 2024-09-10T23:26:08.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc4157220 con 0x7f2fc4072690 2024-09-10T23:26:08.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.070+0000 7f2fc0c00640 1 -- 172.21.15.17:0/2680427843 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2fb401c460 con 0x7f2fc4072690 2024-09-10T23:26:08.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.074+0000 7f2fc0c00640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2fa0072610 0x7f2fa0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:08.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.074+0000 7f2fc0c00640 1 -- 172.21.15.17:0/2680427843 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6187+0+0 (secure 0 0 0) 0x7f2fb4093210 con 0x7f2fc4072690 2024-09-10T23:26:08.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.074+0000 7f2fbbe00640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2fa0072610 0x7f2fa0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:08.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.074+0000 7f2fbbe00640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2fa0072610 0x7f2fa0074ad0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4153a30 tx=0x7f2fac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:08.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.078+0000 7f2fc0c00640 1 -- 172.21.15.17:0/2680427843 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2fb405e7c0 con 0x7f2fc4072690 2024-09-10T23:26:08.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.286+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2fc406e9b0 con 0x7f2fc4072690 2024-09-10T23:26:08.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.894+0000 7f2fc0c00640 1 -- 172.21.15.17:0/2680427843 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v106) ==== 104+0+0 (secure 0 0 0) 0x7f2fb405e0c0 con 0x7f2fc4072690 2024-09-10T23:26:08.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2fa0072610 msgr2=0x7f2fa0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2fa0072610 0x7f2fa0074ad0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4153a30 tx=0x7f2fac009040 comp rx=0 tx=0).stop 2024-09-10T23:26:08.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4072690 msgr2=0x7f2fc4159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:08.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4072690 0x7f2fc4159430 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400c430 tx=0x7f2fb400c8f0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 shutdown_connections 2024-09-10T23:26:08.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2fa0072610 0x7f2fa0074ad0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2fc415aa80 0x7f2fc4140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2fc4073210 0x7f2fc40b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 --2- 172.21.15.17:0/2680427843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2fc4072690 0x7f2fc4159430 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:08.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 >> 172.21.15.17:0/2680427843 conn(0x7f2fc40b17a0 msgr2=0x7f2fc40ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:08.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 shutdown_connections 2024-09-10T23:26:08.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:08.898+0000 7f2fcb000640 1 -- 172.21.15.17:0/2680427843 wait complete. 2024-09-10T23:26:08.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:26:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.122+0000 7f51f2800640 1 -- 172.21.15.17:0/3055008655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b28e0 msgr2=0x7f51ec0cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.122+0000 7f51f2800640 1 --2- 172.21.15.17:0/3055008655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b28e0 0x7f51ec0cff20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f51ec073ff0 tx=0x7f51e401cd80 comp rx=0 tx=0).stop 2024-09-10T23:26:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.122+0000 7f51f2800640 1 -- 172.21.15.17:0/3055008655 shutdown_connections 2024-09-10T23:26:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.122+0000 7f51f2800640 1 --2- 172.21.15.17:0/3055008655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b28e0 0x7f51ec0cff20 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.122+0000 7f51f2800640 1 --2- 172.21.15.17:0/3055008655 >> v2:172.21.15.77:3300/0 conn(0x7f51ec15f600 0x7f51ec0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.122+0000 7f51f2800640 1 -- 172.21.15.17:0/3055008655 >> 172.21.15.17:0/3055008655 conn(0x7f51ec09b080 msgr2=0x7f51ec0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.122+0000 7f51f2800640 1 -- 172.21.15.17:0/3055008655 shutdown_connections 2024-09-10T23:26:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.122+0000 7f51f2800640 1 -- 172.21.15.17:0/3055008655 wait complete. 2024-09-10T23:26:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 Processor -- start 2024-09-10T23:26:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 -- start start 2024-09-10T23:26:09.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b0990 0x7f51ec14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:09.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51ec0b28e0 0x7f51ec157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:09.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51ec15f600 0x7f51ec1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:09.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec169750 con 0x7f51ec0b0990 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec1695d0 con 0x7f51ec0b28e0 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f51ec1698d0 con 0x7f51ec15f600 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b0990 0x7f51ec14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b0990 0x7f51ec14e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36244/0 (socket says 172.21.15.17:36244) 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51eb400640 1 -- 172.21.15.17:0/1676439248 learned_addr learned my addr 172.21.15.17:0/1676439248 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51e2a00640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51ec0b28e0 0x7f51ec157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51ebe00640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51ec15f600 0x7f51ec1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51eb400640 1 -- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51ec15f600 msgr2=0x7f51ec1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51eb400640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51ec15f600 0x7f51ec1576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51eb400640 1 -- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51ec0b28e0 msgr2=0x7f51ec157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51eb400640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51ec0b28e0 0x7f51ec157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51eb400640 1 -- 172.21.15.17:0/1676439248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ec06e890 con 0x7f51ec0b0990 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51e2a00640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51ec0b28e0 0x7f51ec157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51eb400640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b0990 0x7f51ec14e010 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00e7d0 tx=0x7f51dc00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51e3e00640 1 -- 172.21.15.17:0/1676439248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00ccc0 con 0x7f51ec0b0990 2024-09-10T23:26:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51e3e00640 1 -- 172.21.15.17:0/1676439248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51dc010430 con 0x7f51ec0b0990 2024-09-10T23:26:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51e3e00640 1 -- 172.21.15.17:0/1676439248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc010860 con 0x7f51ec0b0990 2024-09-10T23:26:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ec06eb70 con 0x7f51ec0b0990 2024-09-10T23:26:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.126+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ec06f130 con 0x7f51ec0b0990 2024-09-10T23:26:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.130+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ec0cff20 con 0x7f51ec0b0990 2024-09-10T23:26:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.130+0000 7f51e3e00640 1 -- 172.21.15.17:0/1676439248 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f51dc010a00 con 0x7f51ec0b0990 2024-09-10T23:26:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.130+0000 7f51e3e00640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51c80725e0 0x7f51c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.130+0000 7f51e3e00640 1 -- 172.21.15.17:0/1676439248 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 6187+0+0 (secure 0 0 0) 0x7f51dc093ee0 con 0x7f51ec0b0990 2024-09-10T23:26:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.130+0000 7f51e2a00640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51c80725e0 0x7f51c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:09.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.134+0000 7f51e2a00640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51c80725e0 0x7f51c8074aa0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0ce3b0 tx=0x7f51d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:09.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.134+0000 7f51e3e00640 1 -- 172.21.15.17:0/1676439248 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f51dc05f3d0 con 0x7f51ec0b0990 2024-09-10T23:26:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:09.310+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f51ec15bc40 con 0x7f51ec0b0990 2024-09-10T23:26:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.026+0000 7f51e3e00640 1 -- 172.21.15.17:0/1676439248 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v146) ==== 181+0+0 (secure 0 0 0) 0x7f51dc05ecd0 con 0x7f51ec0b0990 2024-09-10T23:26:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:26:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51c80725e0 msgr2=0x7f51c8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51c80725e0 0x7f51c8074aa0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0ce3b0 tx=0x7f51d4009040 comp rx=0 tx=0).stop 2024-09-10T23:26:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b0990 msgr2=0x7f51ec14e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b0990 0x7f51ec14e010 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00e7d0 tx=0x7f51dc00ec90 comp rx=0 tx=0).stop 2024-09-10T23:26:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 shutdown_connections 2024-09-10T23:26:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f51c80725e0 0x7f51c8074aa0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f51ec15f600 0x7f51ec1576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51ec0b28e0 0x7f51ec157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 --2- 172.21.15.17:0/1676439248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51ec0b0990 0x7f51ec14e010 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 >> 172.21.15.17:0/1676439248 conn(0x7f51ec09b080 msgr2=0x7f51ec0707e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 shutdown_connections 2024-09-10T23:26:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.030+0000 7f51f2800640 1 -- 172.21.15.17:0/1676439248 wait complete. 2024-09-10T23:26:10.058 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:26:10.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.206+0000 7f33e5600640 1 -- 172.21.15.17:0/2635155220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 msgr2=0x7f33e015f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.206+0000 7f33e5600640 1 --2- 172.21.15.17:0/2635155220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 0x7f33e015f770 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f33e006e610 tx=0x7f33c801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.206+0000 7f33e5600640 1 -- 172.21.15.17:0/2635155220 shutdown_connections 2024-09-10T23:26:10.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.206+0000 7f33e5600640 1 --2- 172.21.15.17:0/2635155220 >> v2:172.21.15.77:3300/0 conn(0x7f33e006e6f0 0x7f33e015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.206+0000 7f33e5600640 1 --2- 172.21.15.17:0/2635155220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 0x7f33e015f770 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.206+0000 7f33e5600640 1 --2- 172.21.15.17:0/2635155220 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33e0145800 0x7f33e00741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.206+0000 7f33e5600640 1 -- 172.21.15.17:0/2635155220 >> 172.21.15.17:0/2635155220 conn(0x7f33e00b17a0 msgr2=0x7f33e00b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:10.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.206+0000 7f33e5600640 1 -- 172.21.15.17:0/2635155220 shutdown_connections 2024-09-10T23:26:10.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.206+0000 7f33e5600640 1 -- 172.21.15.17:0/2635155220 wait complete. 2024-09-10T23:26:10.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 Processor -- start 2024-09-10T23:26:10.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 -- start start 2024-09-10T23:26:10.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e006e6f0 0x7f33e01f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33e0145800 0x7f33e0164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 0x7f33e01651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33e015c4c0 con 0x7f33e0160460 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f33e015c340 con 0x7f33e006e6f0 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f33e015c640 con 0x7f33e0145800 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33df400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 0x7f33e01651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33df400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 0x7f33e01651f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36268/0 (socket says 172.21.15.17:36268) 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33df400640 1 -- 172.21.15.17:0/4240764381 learned_addr learned my addr 172.21.15.17:0/4240764381 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33d7e00640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33e0145800 0x7f33e0164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33dea00640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e006e6f0 0x7f33e01f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33df400640 1 -- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33e0145800 msgr2=0x7f33e0164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33df400640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33e0145800 0x7f33e0164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33df400640 1 -- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e006e6f0 msgr2=0x7f33e01f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:10.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33df400640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e006e6f0 0x7f33e01f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33df400640 1 -- 172.21.15.17:0/4240764381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e01f7910 con 0x7f33e0160460 2024-09-10T23:26:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33d7e00640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33e0145800 0x7f33e0164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:10.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33df400640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 0x7f33e01651f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f33d800daf0 tx=0x7f33d8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33d6a00640 1 -- 172.21.15.17:0/4240764381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d800be00 con 0x7f33e0160460 2024-09-10T23:26:10.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33d6a00640 1 -- 172.21.15.17:0/4240764381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33d8003980 con 0x7f33e0160460 2024-09-10T23:26:10.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33d6a00640 1 -- 172.21.15.17:0/4240764381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d8003dd0 con 0x7f33e0160460 2024-09-10T23:26:10.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e01f7bf0 con 0x7f33e0160460 2024-09-10T23:26:10.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.210+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e0144940 con 0x7f33e0160460 2024-09-10T23:26:10.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.214+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e01f7e30 con 0x7f33e0160460 2024-09-10T23:26:10.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.214+0000 7f33d6a00640 1 -- 172.21.15.17:0/4240764381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f33d8003f70 con 0x7f33e0160460 2024-09-10T23:26:10.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.214+0000 7f33d6a00640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33bc0725e0 0x7f33bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:10.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.214+0000 7f33d6a00640 1 -- 172.21.15.17:0/4240764381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5749+0+0 (secure 0 0 0) 0x7f33d8093b40 con 0x7f33e0160460 2024-09-10T23:26:10.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.214+0000 7f33dea00640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33bc0725e0 0x7f33bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:10.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.214+0000 7f33dea00640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33bc0725e0 0x7f33bc074aa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009b70 tx=0x7f33d00091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:10.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.218+0000 7f33d6a00640 1 -- 172.21.15.17:0/4240764381 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f33e01f7e30 con 0x7f33e0160460 2024-09-10T23:26:10.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:10.394+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f33e00741d0 con 0x7f33e0160460 2024-09-10T23:26:11.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.034+0000 7f33d6a00640 1 -- 172.21.15.17:0/4240764381 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v147) ==== 169+0+0 (secure 0 0 0) 0x7f33d8020030 con 0x7f33e0160460 2024-09-10T23:26:11.037 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:26:11.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33bc0725e0 msgr2=0x7f33bc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33bc0725e0 0x7f33bc074aa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009b70 tx=0x7f33d00091e0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 msgr2=0x7f33e01651f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 0x7f33e01651f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f33d800daf0 tx=0x7f33d8009f60 comp rx=0 tx=0).stop 2024-09-10T23:26:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 shutdown_connections 2024-09-10T23:26:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33bc0725e0 0x7f33bc074aa0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33e0160460 0x7f33e01651f0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33e0145800 0x7f33e0164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 --2- 172.21.15.17:0/4240764381 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e006e6f0 0x7f33e01f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 >> 172.21.15.17:0/4240764381 conn(0x7f33e00b17a0 msgr2=0x7f33e015e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 shutdown_connections 2024-09-10T23:26:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.038+0000 7f33e5600640 1 -- 172.21.15.17:0/4240764381 wait complete. 2024-09-10T23:26:11.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:26:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.218+0000 7fb0fbe00640 1 -- 172.21.15.17:0/3427298139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f41416c0 msgr2=0x7fb0f40ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.218+0000 7fb0fbe00640 1 --2- 172.21.15.17:0/3427298139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f41416c0 0x7fb0f40ce250 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009840 tx=0x7fb0e801f010 comp rx=0 tx=0).stop 2024-09-10T23:26:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- 172.21.15.17:0/3427298139 shutdown_connections 2024-09-10T23:26:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 --2- 172.21.15.17:0/3427298139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f41416c0 0x7fb0f40ce250 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- 172.21.15.17:0/3427298139 >> 172.21.15.17:0/3427298139 conn(0x7fb0f40b1730 msgr2=0x7fb0f40b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- 172.21.15.17:0/3427298139 shutdown_connections 2024-09-10T23:26:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- 172.21.15.17:0/3427298139 wait complete. 2024-09-10T23:26:11.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 Processor -- start 2024-09-10T23:26:11.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- start start 2024-09-10T23:26:11.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f41416c0 0x7fb0f41e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0f4141aa0 0x7fb0f413d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f4141eb0 0x7fb0f40cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f40734d0 con 0x7fb0f4141eb0 2024-09-10T23:26:11.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4073350 con 0x7fb0f41416c0 2024-09-10T23:26:11.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f4073650 con 0x7fb0f4141aa0 2024-09-10T23:26:11.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f4141eb0 0x7fb0f40cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f4141eb0 0x7fb0f40cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36286/0 (socket says 172.21.15.17:36286) 2024-09-10T23:26:11.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f9e00640 1 -- 172.21.15.17:0/619109923 learned_addr learned my addr 172.21.15.17:0/619109923 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:11.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f9e00640 1 -- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0f4141aa0 msgr2=0x7fb0f413d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f9e00640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0f4141aa0 0x7fb0f413d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f9e00640 1 -- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f41416c0 msgr2=0x7fb0f41e7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f9e00640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f41416c0 0x7fb0f41e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f9e00640 1 -- 172.21.15.17:0/619109923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f41e6960 con 0x7fb0f4141eb0 2024-09-10T23:26:11.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f9e00640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f4141eb0 0x7fb0f40cae70 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00c740 tx=0x7fb0ec00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f1600640 1 -- 172.21.15.17:0/619109923 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec003b80 con 0x7fb0f4141eb0 2024-09-10T23:26:11.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f1600640 1 -- 172.21.15.17:0/619109923 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0ec00ce50 con 0x7fb0f4141eb0 2024-09-10T23:26:11.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f41e6150 con 0x7fb0f4141eb0 2024-09-10T23:26:11.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0f1600640 1 -- 172.21.15.17:0/619109923 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00a850 con 0x7fb0f4141eb0 2024-09-10T23:26:11.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.222+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f41e6ee0 con 0x7fb0f4141eb0 2024-09-10T23:26:11.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.226+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f4073b00 con 0x7fb0f4141eb0 2024-09-10T23:26:11.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.226+0000 7fb0f1600640 1 -- 172.21.15.17:0/619109923 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb0ec00a9f0 con 0x7fb0f4141eb0 2024-09-10T23:26:11.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.226+0000 7fb0f1600640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0d40725e0 0x7fb0d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.226+0000 7fb0f1600640 1 -- 172.21.15.17:0/619109923 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7fb0ec092f60 con 0x7fb0f4141eb0 2024-09-10T23:26:11.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.226+0000 7fb0f9400640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0d40725e0 0x7fb0d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.230+0000 7fb0f9400640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0d40725e0 0x7fb0d4074aa0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80b2000 tx=0x7fb0e801bdb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.230+0000 7fb0f1600640 1 -- 172.21.15.17:0/619109923 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb0ec05e710 con 0x7fb0f4141eb0 2024-09-10T23:26:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.406+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fb0f406a250 con 0x7fb0f4141eb0 2024-09-10T23:26:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.410+0000 7fb0f1600640 1 -- 172.21.15.17:0/619109923 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v51) ==== 71+0+0 (secure 0 0 0) 0x7fb0ec05e010 con 0x7fb0f4141eb0 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.410+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0d40725e0 msgr2=0x7fb0d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.410+0000 7fb0fbe00640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0d40725e0 0x7fb0d4074aa0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80b2000 tx=0x7fb0e801bdb0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.410+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f4141eb0 msgr2=0x7fb0f40cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.410+0000 7fb0fbe00640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f4141eb0 0x7fb0f40cae70 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00c740 tx=0x7fb0ec00cc00 comp rx=0 tx=0).stop 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.414+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 shutdown_connections 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.414+0000 7fb0fbe00640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0d40725e0 0x7fb0d4074aa0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.414+0000 7fb0fbe00640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0f4141eb0 0x7fb0f40cae70 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.414+0000 7fb0fbe00640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0f4141aa0 0x7fb0f413d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.414+0000 7fb0fbe00640 1 --2- 172.21.15.17:0/619109923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0f41416c0 0x7fb0f41e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.414+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 >> 172.21.15.17:0/619109923 conn(0x7fb0f40b1730 msgr2=0x7fb0f413f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.414+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 shutdown_connections 2024-09-10T23:26:11.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.414+0000 7fb0fbe00640 1 -- 172.21.15.17:0/619109923 wait complete. 2024-09-10T23:26:11.436 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-10T23:26:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 -- 172.21.15.17:0/2041339900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c240741c0 msgr2=0x7f4c240d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 --2- 172.21.15.17:0/2041339900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c240741c0 0x7f4c240d0360 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009840 tx=0x7f4c1c01c7f0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 -- 172.21.15.17:0/2041339900 shutdown_connections 2024-09-10T23:26:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 --2- 172.21.15.17:0/2041339900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c240741c0 0x7f4c240d0360 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 --2- 172.21.15.17:0/2041339900 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c241583e0 0x7f4c2415ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 -- 172.21.15.17:0/2041339900 >> 172.21.15.17:0/2041339900 conn(0x7f4c2406cfc0 msgr2=0x7f4c2406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 -- 172.21.15.17:0/2041339900 shutdown_connections 2024-09-10T23:26:11.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 -- 172.21.15.17:0/2041339900 wait complete. 2024-09-10T23:26:11.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 Processor -- start 2024-09-10T23:26:11.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.606+0000 7f4c2a200640 1 -- start start 2024-09-10T23:26:11.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c2a200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c240741c0 0x7f4c241ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c2a200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c240cff20 0x7f4c24154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c2a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c241583e0 0x7f4c241fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c2a200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2416ac90 con 0x7f4c241583e0 2024-09-10T23:26:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c2a200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2416ab10 con 0x7f4c240741c0 2024-09-10T23:26:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c2a200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2416ae10 con 0x7f4c240cff20 2024-09-10T23:26:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c241583e0 0x7f4c241fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c241583e0 0x7f4c241fb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36296/0 (socket says 172.21.15.17:36296) 2024-09-10T23:26:11.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23e00640 1 -- 172.21.15.17:0/1250395857 learned_addr learned my addr 172.21.15.17:0/1250395857 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:11.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23400640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c240741c0 0x7f4c241ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c22a00640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c240cff20 0x7f4c24154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23e00640 1 -- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c240cff20 msgr2=0x7f4c24154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23e00640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c240cff20 0x7f4c24154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23e00640 1 -- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c240741c0 msgr2=0x7f4c241ff9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23e00640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c240741c0 0x7f4c241ff9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23e00640 1 -- 172.21.15.17:0/1250395857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c241fc160 con 0x7f4c241583e0 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c22a00640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c240cff20 0x7f4c24154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c23e00640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c241583e0 0x7f4c241fb9d0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009790 tx=0x7f4c1c0051a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c1b400640 1 -- 172.21.15.17:0/1250395857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0b2040 con 0x7f4c241583e0 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c1b400640 1 -- 172.21.15.17:0/1250395857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c1c0054c0 con 0x7f4c241583e0 2024-09-10T23:26:11.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c241fc440 con 0x7f4c241583e0 2024-09-10T23:26:11.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c1b400640 1 -- 172.21.15.17:0/1250395857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c004290 con 0x7f4c241583e0 2024-09-10T23:26:11.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.610+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c240afd90 con 0x7f4c241583e0 2024-09-10T23:26:11.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.614+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c241fc960 con 0x7f4c241583e0 2024-09-10T23:26:11.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.614+0000 7f4c1b400640 1 -- 172.21.15.17:0/1250395857 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4c1c0b5070 con 0x7f4c241583e0 2024-09-10T23:26:11.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.614+0000 7f4c1b400640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c00072660 0x7f4c00074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.614+0000 7f4c1b400640 1 -- 172.21.15.17:0/1250395857 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7f4c1c12cd10 con 0x7f4c241583e0 2024-09-10T23:26:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.614+0000 7f4c23400640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c00072660 0x7f4c00074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.614+0000 7f4c23400640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c00072660 0x7f4c00074b20 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4c14005fd0 tx=0x7f4c1400a780 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:11.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.618+0000 7f4c1b400640 1 -- 172.21.15.17:0/1250395857 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4c241fc960 con 0x7f4c241583e0 2024-09-10T23:26:11.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:11.858+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f4c240d0360 con 0x7f4c241583e0 2024-09-10T23:26:12.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.034+0000 7f4c1b400640 1 -- 172.21.15.17:0/1250395857 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v495) ==== 155+0+0 (secure 0 0 0) 0x7f4c1c132020 con 0x7f4c241583e0 2024-09-10T23:26:12.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c00072660 msgr2=0x7f4c00074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c00072660 0x7f4c00074b20 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4c14005fd0 tx=0x7f4c1400a780 comp rx=0 tx=0).stop 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c241583e0 msgr2=0x7f4c241fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c241583e0 0x7f4c241fb9d0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009790 tx=0x7f4c1c0051a0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 shutdown_connections 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c00072660 0x7f4c00074b20 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c241583e0 0x7f4c241fb9d0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c240cff20 0x7f4c24154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 --2- 172.21.15.17:0/1250395857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c240741c0 0x7f4c241ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 >> 172.21.15.17:0/1250395857 conn(0x7f4c2406cfc0 msgr2=0x7f4c24156d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 shutdown_connections 2024-09-10T23:26:12.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.038+0000 7f4c2a200640 1 -- 172.21.15.17:0/1250395857 wait complete. 2024-09-10T23:26:12.060 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T23:26:12.060 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T23:26:12.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:26:12.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.206+0000 7f6ce2000640 1 -- 172.21.15.17:0/4005866552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc0003a40 msgr2=0x7f6cc0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.206+0000 7f6ce2000640 1 --2- 172.21.15.17:0/4005866552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc0003a40 0x7f6cc0003e20 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0017e0 tx=0x7f6ccc01c7f0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.206+0000 7f6cdbe00640 1 -- 172.21.15.17:0/4005866552 reap_dead start 2024-09-10T23:26:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.206+0000 7f6ce2000640 1 -- 172.21.15.17:0/4005866552 shutdown_connections 2024-09-10T23:26:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.206+0000 7f6ce2000640 1 -- 172.21.15.17:0/4005866552 >> 172.21.15.17:0/4005866552 conn(0x7f6cdc09d1c0 msgr2=0x7f6cdc0d4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.206+0000 7f6ce2000640 1 -- 172.21.15.17:0/4005866552 shutdown_connections 2024-09-10T23:26:12.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.206+0000 7f6ce2000640 1 -- 172.21.15.17:0/4005866552 wait complete. 2024-09-10T23:26:12.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.206+0000 7f6ce2000640 1 Processor -- start 2024-09-10T23:26:12.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.206+0000 7f6ce2000640 1 -- start start 2024-09-10T23:26:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6ce2000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc0003a40 0x7f6cdc1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6ce2000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cdc145760 0x7f6cdc1fb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6ce2000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cdc1fb760 0x7f6cdc1fbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6ce2000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc169ea0 con 0x7f6cdc145760 2024-09-10T23:26:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6ce2000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc169d20 con 0x7f6cc0003a40 2024-09-10T23:26:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6ce2000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6cdc16a020 con 0x7f6cdc1fb760 2024-09-10T23:26:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cdc145760 0x7f6cdc1fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cdb400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc0003a40 0x7f6cdc1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cdc145760 0x7f6cdc1fb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36308/0 (socket says 172.21.15.17:36308) 2024-09-10T23:26:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3e00640 1 -- 172.21.15.17:0/821645034 learned_addr learned my addr 172.21.15.17:0/821645034 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:12.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cdbe00640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cdc1fb760 0x7f6cdc1fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3e00640 1 -- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cdc1fb760 msgr2=0x7f6cdc1fbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3e00640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cdc1fb760 0x7f6cdc1fbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3e00640 1 -- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc0003a40 msgr2=0x7f6cdc1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3e00640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc0003a40 0x7f6cdc1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3e00640 1 -- 172.21.15.17:0/821645034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc0ca360 con 0x7f6cdc145760 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3e00640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cdc145760 0x7f6cdc1fb220 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40066e0 tx=0x7f6cc40039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3400640 1 -- 172.21.15.17:0/821645034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4015070 con 0x7f6cdc145760 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3400640 1 -- 172.21.15.17:0/821645034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc4011900 con 0x7f6cdc145760 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc0ca640 con 0x7f6cdc145760 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6cd3400640 1 -- 172.21.15.17:0/821645034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4011d50 con 0x7f6cdc145760 2024-09-10T23:26:12.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc0ccb40 con 0x7f6cdc145760 2024-09-10T23:26:12.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.210+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc0cf5a0 con 0x7f6cdc145760 2024-09-10T23:26:12.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.214+0000 7f6cd3400640 1 -- 172.21.15.17:0/821645034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6cc40103c0 con 0x7f6cdc145760 2024-09-10T23:26:12.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.214+0000 7f6cd3400640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cb80725e0 0x7f6cb8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.214+0000 7f6cd3400640 1 -- 172.21.15.17:0/821645034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7f6cc40940f0 con 0x7f6cdc145760 2024-09-10T23:26:12.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.214+0000 7f6cdb400640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cb80725e0 0x7f6cb8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.214+0000 7f6cdb400640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cb80725e0 0x7f6cb8074aa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0017b0 tx=0x7f6ccc0195e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:12.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.218+0000 7f6cd3400640 1 -- 172.21.15.17:0/821645034 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6cc405f260 con 0x7f6cdc145760 2024-09-10T23:26:12.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.434+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cdc0d0800 con 0x7f6cdc145760 2024-09-10T23:26:12.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6cd3400640 1 -- 172.21.15.17:0/821645034 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+13255 (secure 0 0 0) 0x7f6cc4063c90 con 0x7f6cdc145760 2024-09-10T23:26:12.440 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:12.440 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":147,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:26:11.031584+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/1244612709":"2024-09-11T23:26:07.893807+0000","172.21.15.77:6835/1244612709":"2024-09-11T23:26:07.893807+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:26:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cb80725e0 msgr2=0x7f6cb8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cb80725e0 0x7f6cb8074aa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0017b0 tx=0x7f6ccc0195e0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cdc145760 msgr2=0x7f6cdc1fb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cdc145760 0x7f6cdc1fb220 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40066e0 tx=0x7f6cc40039d0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 shutdown_connections 2024-09-10T23:26:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cb80725e0 0x7f6cb8074aa0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6cdc1fb760 0x7f6cdc1fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cdc145760 0x7f6cdc1fb220 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 --2- 172.21.15.17:0/821645034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6cc0003a40 0x7f6cdc1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 >> 172.21.15.17:0/821645034 conn(0x7f6cdc09d1c0 msgr2=0x7f6cdc0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:12.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 shutdown_connections 2024-09-10T23:26:12.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.438+0000 7f6ce2000640 1 -- 172.21.15.17:0/821645034 wait complete. 2024-09-10T23:26:12.462 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:26:12.463 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:26:12.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.610+0000 7f8945e00640 1 -- 172.21.15.17:0/3113147502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 msgr2=0x7f89400b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.610+0000 7f8945e00640 1 --2- 172.21.15.17:0/3113147502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 0x7f89400b2f10 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f89400b4770 tx=0x7f893801cd80 comp rx=0 tx=0).stop 2024-09-10T23:26:12.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.610+0000 7f8945e00640 1 -- 172.21.15.17:0/3113147502 shutdown_connections 2024-09-10T23:26:12.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.610+0000 7f8945e00640 1 --2- 172.21.15.17:0/3113147502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 0x7f89400b2f10 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.610+0000 7f8945e00640 1 --2- 172.21.15.17:0/3113147502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89400d06b0 0x7f89400b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.610+0000 7f8945e00640 1 --2- 172.21.15.17:0/3113147502 >> v2:172.21.15.77:3300/0 conn(0x7f894015b8c0 0x7f89400d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.610+0000 7f8945e00640 1 -- 172.21.15.17:0/3113147502 >> 172.21.15.17:0/3113147502 conn(0x7f894009a9f0 msgr2=0x7f894009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:12.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.610+0000 7f8945e00640 1 -- 172.21.15.17:0/3113147502 shutdown_connections 2024-09-10T23:26:12.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.610+0000 7f8945e00640 1 -- 172.21.15.17:0/3113147502 wait complete. 2024-09-10T23:26:12.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 Processor -- start 2024-09-10T23:26:12.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 -- start start 2024-09-10T23:26:12.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89400d06b0 0x7f89400c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894015b8c0 0x7f89400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 0x7f8940070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8940167860 con 0x7f894015bca0 2024-09-10T23:26:12.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89401676e0 con 0x7f894015b8c0 2024-09-10T23:26:12.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f89401679e0 con 0x7f89400d06b0 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 0x7f8940070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 0x7f8940070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36324/0 (socket says 172.21.15.17:36324) 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945400640 1 -- 172.21.15.17:0/4247109134 learned_addr learned my addr 172.21.15.17:0/4247109134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8944a00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89400d06b0 0x7f89400c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8937e00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894015b8c0 0x7f89400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945400640 1 -- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89400d06b0 msgr2=0x7f89400c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945400640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89400d06b0 0x7f89400c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945400640 1 -- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894015b8c0 msgr2=0x7f89400709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945400640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894015b8c0 0x7f89400709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945400640 1 -- 172.21.15.17:0/4247109134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89401f75a0 con 0x7f894015bca0 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8937e00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894015b8c0 0x7f89400709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:12.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945400640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 0x7f8940070f20 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f893801d620 tx=0x7f89380092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:12.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f893d600640 1 -- 172.21.15.17:0/4247109134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89380bb070 con 0x7f894015bca0 2024-09-10T23:26:12.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f893d600640 1 -- 172.21.15.17:0/4247109134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8938004d40 con 0x7f894015bca0 2024-09-10T23:26:12.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f893d600640 1 -- 172.21.15.17:0/4247109134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89380b2040 con 0x7f894015bca0 2024-09-10T23:26:12.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89401f7860 con 0x7f894015bca0 2024-09-10T23:26:12.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.614+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89401f7e20 con 0x7f894015bca0 2024-09-10T23:26:12.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.618+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89400d0170 con 0x7f894015bca0 2024-09-10T23:26:12.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.618+0000 7f893d600640 1 -- 172.21.15.17:0/4247109134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f89380b5030 con 0x7f894015bca0 2024-09-10T23:26:12.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.618+0000 7f893d600640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f891c0725e0 0x7f891c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:12.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.618+0000 7f893d600640 1 -- 172.21.15.17:0/4247109134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7f893812cd10 con 0x7f894015bca0 2024-09-10T23:26:12.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.618+0000 7f8944a00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f891c0725e0 0x7f891c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:12.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.618+0000 7f8944a00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f891c0725e0 0x7f891c074aa0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8930009b70 tx=0x7f89300091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:12.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.622+0000 7f893d600640 1 -- 172.21.15.17:0/4247109134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8938016970 con 0x7f894015bca0 2024-09-10T23:26:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.798+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f894009afe0 con 0x7f894015bca0 2024-09-10T23:26:12.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.798+0000 7f893d600640 1 -- 172.21.15.17:0/4247109134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) ==== 93+0+10 (secure 0 0 0) 0x7f89380f8710 con 0x7f894015bca0 2024-09-10T23:26:12.913 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:26:12.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f891c0725e0 msgr2=0x7f891c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f891c0725e0 0x7f891c074aa0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8930009b70 tx=0x7f89300091e0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 msgr2=0x7f8940070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 0x7f8940070f20 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f893801d620 tx=0x7f89380092c0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 shutdown_connections 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f891c0725e0 0x7f891c074aa0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f894015bca0 0x7f8940070f20 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f894015b8c0 0x7f89400709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 --2- 172.21.15.17:0/4247109134 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89400d06b0 0x7f89400c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 >> 172.21.15.17:0/4247109134 conn(0x7f894009a9f0 msgr2=0x7f89400b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 shutdown_connections 2024-09-10T23:26:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:12.802+0000 7f8945e00640 1 -- 172.21.15.17:0/4247109134 wait complete. 2024-09-10T23:26:12.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-10T23:26:13.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 -- 172.21.15.17:0/2202983179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c160280 msgr2=0x7f140c0cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 --2- 172.21.15.17:0/2202983179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c160280 0x7f140c0cfaf0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f140c06db00 tx=0x7f13fc01f0b0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 -- 172.21.15.17:0/2202983179 shutdown_connections 2024-09-10T23:26:13.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 --2- 172.21.15.17:0/2202983179 >> v2:172.21.15.77:3300/0 conn(0x7f140c160660 0x7f140c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 --2- 172.21.15.17:0/2202983179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140c0d2830 0x7f140c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 --2- 172.21.15.17:0/2202983179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c160280 0x7f140c0cfaf0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 -- 172.21.15.17:0/2202983179 >> 172.21.15.17:0/2202983179 conn(0x7f140c0d1d10 msgr2=0x7f140c0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:13.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 -- 172.21.15.17:0/2202983179 shutdown_connections 2024-09-10T23:26:13.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 -- 172.21.15.17:0/2202983179 wait complete. 2024-09-10T23:26:13.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 Processor -- start 2024-09-10T23:26:13.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 -- start start 2024-09-10T23:26:13.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c0d2830 0x7f140c1f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140c160280 0x7f140c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f140c160660 0x7f140c06e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0b0060 con 0x7f140c0d2830 2024-09-10T23:26:13.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f140c0afee0 con 0x7f140c160660 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f1412400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f140c0b01e0 con 0x7f140c160280 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c0d2830 0x7f140c1f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c0d2830 0x7f140c1f3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36354/0 (socket says 172.21.15.17:36354) 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140b400640 1 -- 172.21.15.17:0/2630456216 learned_addr learned my addr 172.21.15.17:0/2630456216 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140aa00640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140c160280 0x7f140c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140be00640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f140c160660 0x7f140c06e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140b400640 1 -- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140c160280 msgr2=0x7f140c06e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140b400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140c160280 0x7f140c06e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140b400640 1 -- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f140c160660 msgr2=0x7f140c06e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140b400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f140c160660 0x7f140c06e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.062+0000 7f140b400640 1 -- 172.21.15.17:0/2630456216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140c0ce6f0 con 0x7f140c0d2830 2024-09-10T23:26:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f140b400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c0d2830 0x7f140c1f3d10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0b3040 tx=0x7f13fc0a8de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f1403400640 1 -- 172.21.15.17:0/2630456216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0b5040 con 0x7f140c0d2830 2024-09-10T23:26:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f1403400640 1 -- 172.21.15.17:0/2630456216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13fc005340 con 0x7f140c0d2830 2024-09-10T23:26:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f1403400640 1 -- 172.21.15.17:0/2630456216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0046d0 con 0x7f140c0d2830 2024-09-10T23:26:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140c0cd650 con 0x7f140c0d2830 2024-09-10T23:26:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140c0cdc10 con 0x7f140c0d2830 2024-09-10T23:26:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140c0b0700 con 0x7f140c0d2830 2024-09-10T23:26:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f1403400640 1 -- 172.21.15.17:0/2630456216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f13fc004870 con 0x7f140c0d2830 2024-09-10T23:26:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f1403400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13ec0725d0 0x7f13ec074a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.066+0000 7f1403400640 1 -- 172.21.15.17:0/2630456216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7f13fc12fe80 con 0x7f140c0d2830 2024-09-10T23:26:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.070+0000 7f140aa00640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13ec0725d0 0x7f13ec074a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.070+0000 7f140aa00640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13ec0725d0 0x7f13ec074a90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f140c0cf690 tx=0x7f13f8009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:13.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.070+0000 7f1403400640 1 -- 172.21.15.17:0/2630456216 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f13fc018c10 con 0x7f140c0d2830 2024-09-10T23:26:13.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:13.306+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f140c15f930 con 0x7f140c0d2830 2024-09-10T23:26:14.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.038+0000 7f1403400640 1 -- 172.21.15.17:0/2630456216 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v497) ==== 169+0+0 (secure 0 0 0) 0x7f13fc0faff0 con 0x7f140c0d2830 2024-09-10T23:26:14.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13ec0725d0 msgr2=0x7f13ec074a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13ec0725d0 0x7f13ec074a90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f140c0cf690 tx=0x7f13f8009110 comp rx=0 tx=0).stop 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c0d2830 msgr2=0x7f140c1f3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c0d2830 0x7f140c1f3d10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0b3040 tx=0x7f13fc0a8de0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 shutdown_connections 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13ec0725d0 0x7f13ec074a90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f140c160660 0x7f140c06e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f140c160280 0x7f140c06e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 --2- 172.21.15.17:0/2630456216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f140c0d2830 0x7f140c1f3d10 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 >> 172.21.15.17:0/2630456216 conn(0x7f140c0d1d10 msgr2=0x7f140c0cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 shutdown_connections 2024-09-10T23:26:14.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.042+0000 7f1412400640 1 -- 172.21.15.17:0/2630456216 wait complete. 2024-09-10T23:26:14.066 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:26:14.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.214+0000 7f7146a00640 1 -- 172.21.15.17:0/1566457651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71240052f0 msgr2=0x7f712400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.214+0000 7f7146a00640 1 --2- 172.21.15.17:0/1566457651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71240052f0 0x7f712400b9d0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f713800c640 tx=0x7f713801f9c0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.214+0000 7f7146a00640 1 -- 172.21.15.17:0/1566457651 shutdown_connections 2024-09-10T23:26:14.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.214+0000 7f7146a00640 1 --2- 172.21.15.17:0/1566457651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71240052f0 0x7f712400b9d0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.214+0000 7f7146a00640 1 -- 172.21.15.17:0/1566457651 >> 172.21.15.17:0/1566457651 conn(0x7f71400d3f20 msgr2=0x7f71400d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:14.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.214+0000 7f7146a00640 1 -- 172.21.15.17:0/1566457651 shutdown_connections 2024-09-10T23:26:14.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.214+0000 7f7146a00640 1 -- 172.21.15.17:0/1566457651 wait complete. 2024-09-10T23:26:14.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 Processor -- start 2024-09-10T23:26:14.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 -- start start 2024-09-10T23:26:14.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71240052f0 0x7f71400c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f714015ebb0 0x7f714015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71401f74a0 0x7f71401f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f714006eff0 con 0x7f71401f74a0 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f71400d2770 con 0x7f71240052f0 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f714006f170 con 0x7f714015ebb0 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7144a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71401f74a0 0x7f71401f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7144a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71401f74a0 0x7f71401f7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36362/0 (socket says 172.21.15.17:36362) 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7144a00640 1 -- 172.21.15.17:0/3603967480 learned_addr learned my addr 172.21.15.17:0/3603967480 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7137e00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f714015ebb0 0x7f714015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f713fe00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71240052f0 0x7f71400c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7144a00640 1 -- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f714015ebb0 msgr2=0x7f714015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7144a00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f714015ebb0 0x7f714015efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7144a00640 1 -- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71240052f0 msgr2=0x7f71400c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7144a00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71240052f0 0x7f71400c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7144a00640 1 -- 172.21.15.17:0/3603967480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71400cb190 con 0x7f71401f74a0 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7137e00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f714015ebb0 0x7f714015efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7144a00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71401f74a0 0x7f71401f7930 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f7138020260 tx=0x7f71380066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f713cc00640 1 -- 172.21.15.17:0/3603967480 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138006d50 con 0x7f71401f74a0 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f713cc00640 1 -- 172.21.15.17:0/3603967480 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7138001880 con 0x7f71401f74a0 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f713cc00640 1 -- 172.21.15.17:0/3603967480 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138003be0 con 0x7f71401f74a0 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71400cb430 con 0x7f71401f74a0 2024-09-10T23:26:14.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.218+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71400cb9f0 con 0x7f71401f74a0 2024-09-10T23:26:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.222+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7140161270 con 0x7f71401f74a0 2024-09-10T23:26:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.222+0000 7f713cc00640 1 -- 172.21.15.17:0/3603967480 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f71380a9590 con 0x7f71401f74a0 2024-09-10T23:26:14.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.222+0000 7f713cc00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f711c0725e0 0x7f711c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.222+0000 7f713cc00640 1 -- 172.21.15.17:0/3603967480 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7f71381307e0 con 0x7f71401f74a0 2024-09-10T23:26:14.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.222+0000 7f713fe00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f711c0725e0 0x7f711c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.222+0000 7f713fe00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f711c0725e0 0x7f711c074aa0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7130009a40 tx=0x7f71300091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:14.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.226+0000 7f713cc00640 1 -- 172.21.15.17:0/3603967480 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7138019770 con 0x7f71401f74a0 2024-09-10T23:26:14.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f71400cbdd0 con 0x7f71401f74a0 2024-09-10T23:26:14.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f713cc00640 1 -- 172.21.15.17:0/3603967480 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v51) ==== 59+0+1998 (secure 0 0 0) 0x7f71380fba60 con 0x7f71401f74a0 2024-09-10T23:26:14.405 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:26:14.405 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:26:14.406 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:26:14.407 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:26:14.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f711c0725e0 msgr2=0x7f711c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f711c0725e0 0x7f711c074aa0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7130009a40 tx=0x7f71300091e0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71401f74a0 msgr2=0x7f71401f7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71401f74a0 0x7f71401f7930 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f7138020260 tx=0x7f71380066b0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 shutdown_connections 2024-09-10T23:26:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f711c0725e0 0x7f711c074aa0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71401f74a0 0x7f71401f7930 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f714015ebb0 0x7f714015efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 --2- 172.21.15.17:0/3603967480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71240052f0 0x7f71400c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 >> 172.21.15.17:0/3603967480 conn(0x7f71400d3f20 msgr2=0x7f71401600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 shutdown_connections 2024-09-10T23:26:14.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.402+0000 7f7146a00640 1 -- 172.21.15.17:0/3603967480 wait complete. 2024-09-10T23:26:14.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:26:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.574+0000 7fa74d400640 1 -- 172.21.15.17:0/1460860122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa74815b8c0 msgr2=0x7fa7480d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.574+0000 7fa74d400640 1 --2- 172.21.15.17:0/1460860122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa74815b8c0 0x7fa7480d0170 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fa738009840 tx=0x7fa73801c7f0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.574+0000 7fa74d400640 1 -- 172.21.15.17:0/1460860122 shutdown_connections 2024-09-10T23:26:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.574+0000 7fa74d400640 1 --2- 172.21.15.17:0/1460860122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7480b30e0 0x7fa7481654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.574+0000 7fa74d400640 1 --2- 172.21.15.17:0/1460860122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa74815b8c0 0x7fa7480d0170 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.574+0000 7fa74d400640 1 -- 172.21.15.17:0/1460860122 >> 172.21.15.17:0/1460860122 conn(0x7fa74809a9f0 msgr2=0x7fa74809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.574+0000 7fa74d400640 1 -- 172.21.15.17:0/1460860122 shutdown_connections 2024-09-10T23:26:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.574+0000 7fa74d400640 1 -- 172.21.15.17:0/1460860122 wait complete. 2024-09-10T23:26:14.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 Processor -- start 2024-09-10T23:26:14.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 -- start start 2024-09-10T23:26:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7480b30e0 0x7fa7481496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7480d06b0 0x7fa7481f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa74815b8c0 0x7fa7481526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa748168b80 con 0x7fa7480b30e0 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa748168a00 con 0x7fa7480d06b0 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa748168d00 con 0x7fa74815b8c0 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa747e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7480b30e0 0x7fa7481496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa747e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7480b30e0 0x7fa7481496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36384/0 (socket says 172.21.15.17:36384) 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa747e00640 1 -- 172.21.15.17:0/1405474154 learned_addr learned my addr 172.21.15.17:0/1405474154 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74ca00640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa74815b8c0 0x7fa7481526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa73fe00640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7480d06b0 0x7fa7481f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa747e00640 1 -- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa74815b8c0 msgr2=0x7fa7481526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa747e00640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa74815b8c0 0x7fa7481526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa747e00640 1 -- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7480d06b0 msgr2=0x7fa7481f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa747e00640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7480d06b0 0x7fa7481f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa747e00640 1 -- 172.21.15.17:0/1405474154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7481539d0 con 0x7fa7480b30e0 2024-09-10T23:26:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa73fe00640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7480d06b0 0x7fa7481f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa747e00640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7480b30e0 0x7fa7481496f0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fa738009790 tx=0x7fa738005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa744c00640 1 -- 172.21.15.17:0/1405474154 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7380b2040 con 0x7fa7480b30e0 2024-09-10T23:26:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa744c00640 1 -- 172.21.15.17:0/1405474154 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa738004330 con 0x7fa7480b30e0 2024-09-10T23:26:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa744c00640 1 -- 172.21.15.17:0/1405474154 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738003820 con 0x7fa7480b30e0 2024-09-10T23:26:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74814a6d0 con 0x7fa7480b30e0 2024-09-10T23:26:14.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7481536f0 con 0x7fa7480b30e0 2024-09-10T23:26:14.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.578+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7480d0170 con 0x7fa7480b30e0 2024-09-10T23:26:14.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.582+0000 7fa744c00640 1 -- 172.21.15.17:0/1405474154 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa7380b5070 con 0x7fa7480b30e0 2024-09-10T23:26:14.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.582+0000 7fa744c00640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7240725e0 0x7fa724074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:14.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.582+0000 7fa744c00640 1 -- 172.21.15.17:0/1405474154 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7fa73812c8c0 con 0x7fa7480b30e0 2024-09-10T23:26:14.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.582+0000 7fa73fe00640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7240725e0 0x7fa724074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:14.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.582+0000 7fa73fe00640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7240725e0 0x7fa724074aa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa730001230 tx=0x7fa730009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:14.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.586+0000 7fa744c00640 1 -- 172.21.15.17:0/1405474154 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa738016410 con 0x7fa7480b30e0 2024-09-10T23:26:14.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.758+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa748152290 con 0x7fa7480b30e0 2024-09-10T23:26:14.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.762+0000 7fa744c00640 1 -- 172.21.15.17:0/1405474154 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7fa7380f8070 con 0x7fa7480b30e0 2024-09-10T23:26:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7240725e0 msgr2=0x7fa724074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7240725e0 0x7fa724074aa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa730001230 tx=0x7fa730009040 comp rx=0 tx=0).stop 2024-09-10T23:26:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7480b30e0 msgr2=0x7fa7481496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7480b30e0 0x7fa7481496f0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fa738009790 tx=0x7fa738005d20 comp rx=0 tx=0).stop 2024-09-10T23:26:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 shutdown_connections 2024-09-10T23:26:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7240725e0 0x7fa724074aa0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa74815b8c0 0x7fa7481526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7480d06b0 0x7fa7481f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 --2- 172.21.15.17:0/1405474154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7480b30e0 0x7fa7481496f0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 >> 172.21.15.17:0/1405474154 conn(0x7fa74809a9f0 msgr2=0x7fa748156230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 shutdown_connections 2024-09-10T23:26:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:14.766+0000 7fa74d400640 1 -- 172.21.15.17:0/1405474154 wait complete. 2024-09-10T23:26:14.787 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:26:14.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:26:14.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:26:14.973 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:26:14.974 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:26:14.974 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:26:14.983 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:26:14.983 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:26:14.983 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:26:14.992 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:26:14.992 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:26:14.992 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:26:15.031 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:26:15.031 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:26:15.031 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:26:15.043 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:26:15.043 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:26:15.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:15.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 -- 172.21.15.17:0/765931866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0b32d0 msgr2=0x7fb0bc150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 --2- 172.21.15.17:0/765931866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0b32d0 0x7fb0bc150d70 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0cc5a0 tx=0x7fb0b4020690 comp rx=0 tx=0).stop 2024-09-10T23:26:15.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 -- 172.21.15.17:0/765931866 shutdown_connections 2024-09-10T23:26:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 --2- 172.21.15.17:0/765931866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0b32d0 0x7fb0bc150d70 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 --2- 172.21.15.17:0/765931866 >> v2:172.21.15.77:3300/0 conn(0x7fb0bc0cf610 0x7fb0bc06e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 -- 172.21.15.17:0/765931866 >> 172.21.15.17:0/765931866 conn(0x7fb0bc06cfc0 msgr2=0x7fb0bc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 -- 172.21.15.17:0/765931866 shutdown_connections 2024-09-10T23:26:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 -- 172.21.15.17:0/765931866 wait complete. 2024-09-10T23:26:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 Processor -- start 2024-09-10T23:26:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 -- start start 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc0b32d0 0x7fb0bc0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0cf230 0x7fb0bc14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0cf610 0x7fb0bc14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc0d0330 con 0x7fb0bc0cf230 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc0d01b0 con 0x7fb0bc0b32d0 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.218+0000 7fb0c2200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb0bc0d04b0 con 0x7fb0bc0cf610 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0cf230 0x7fb0bc14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0cf230 0x7fb0bc14f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36404/0 (socket says 172.21.15.17:36404) 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3e00640 1 -- 172.21.15.17:0/1262559582 learned_addr learned my addr 172.21.15.17:0/1262559582 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0bb400640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc0b32d0 0x7fb0bc0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0bbe00640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0cf610 0x7fb0bc14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3e00640 1 -- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0cf610 msgr2=0x7fb0bc14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3e00640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0cf610 0x7fb0bc14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3e00640 1 -- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc0b32d0 msgr2=0x7fb0bc0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3e00640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc0b32d0 0x7fb0bc0b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3e00640 1 -- 172.21.15.17:0/1262559582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc154570 con 0x7fb0bc0cf230 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0bbe00640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0cf610 0x7fb0bc14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3e00640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0cf230 0x7fb0bc14f1b0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40058d0 tx=0x7fb0a400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3400640 1 -- 172.21.15.17:0/1262559582 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4017070 con 0x7fb0bc0cf230 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3400640 1 -- 172.21.15.17:0/1262559582 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0a4009d20 con 0x7fb0bc0cf230 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3400640 1 -- 172.21.15.17:0/1262559582 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40106c0 con 0x7fb0bc0cf230 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0bc1f5a70 con 0x7fb0bc0cf230 2024-09-10T23:26:15.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0bc1f6030 con 0x7fb0bc0cf230 2024-09-10T23:26:15.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0bc150d70 con 0x7fb0bc0cf230 2024-09-10T23:26:15.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.222+0000 7fb0b3400640 1 -- 172.21.15.17:0/1262559582 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb0a4010860 con 0x7fb0bc0cf230 2024-09-10T23:26:15.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.226+0000 7fb0b3400640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0980725e0 0x7fb098074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.226+0000 7fb0b3400640 1 -- 172.21.15.17:0/1262559582 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7fb0a40935b0 con 0x7fb0bc0cf230 2024-09-10T23:26:15.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.226+0000 7fb0bb400640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0980725e0 0x7fb098074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.226+0000 7fb0bb400640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0980725e0 0x7fb098074aa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac001690 tx=0x7fb0ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.230+0000 7fb0b3400640 1 -- 172.21.15.17:0/1262559582 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb0a405edf0 con 0x7fb0bc0cf230 2024-09-10T23:26:15.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.438+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0bc15a600 con 0x7fb0bc0cf230 2024-09-10T23:26:15.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.438+0000 7fb0b3400640 1 -- 172.21.15.17:0/1262559582 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+3907 (secure 0 0 0) 0x7fb0a405e6f0 con 0x7fb0bc0cf230 2024-09-10T23:26:15.443 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:15.443 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":106,"btime":"2024-09-10T23:26:08:896385+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/1992557548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1992557548},{"type":"v1","addr":"172.21.15.17:6834","nonce":1992557548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2402468427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2402468427},{"type":"v1","addr":"172.21.15.77:6836","nonce":2402468427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/740281720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":740281720},{"type":"v1","addr":"172.21.15.77:6837","nonce":740281720}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106},{"gid":8616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/380916591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":380916591},{"type":"v1","addr":"172.21.15.17:6835","nonce":380916591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[]} 2024-09-10T23:26:15.443 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 106 2024-09-10T23:26:15.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0980725e0 msgr2=0x7fb098074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0980725e0 0x7fb098074aa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac001690 tx=0x7fb0ac009040 comp rx=0 tx=0).stop 2024-09-10T23:26:15.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0cf230 msgr2=0x7fb0bc14f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0cf230 0x7fb0bc14f1b0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40058d0 tx=0x7fb0a400dde0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 shutdown_connections 2024-09-10T23:26:15.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb0980725e0 0x7fb098074aa0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0bc0cf610 0x7fb0bc14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0bc0cf230 0x7fb0bc14f1b0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 --2- 172.21.15.17:0/1262559582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0bc0b32d0 0x7fb0bc0b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 >> 172.21.15.17:0/1262559582 conn(0x7fb0bc06cfc0 msgr2=0x7fb0bc15c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:15.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 shutdown_connections 2024-09-10T23:26:15.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.442+0000 7fb0c2200640 1 -- 172.21.15.17:0/1262559582 wait complete. 2024-09-10T23:26:15.465 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:26:15.465 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:26:15.466 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:26:15.466 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:26:15.466 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:26:15.466 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:26:15.466 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:26:15.466 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:26:15.466 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:26:15.467 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:26:15.467 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:26:15.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:26:15.467 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:26:15.467 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:26:15.467 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:26:15.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:26:15.477 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:26:15.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:26:15.478 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:26:15.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:26:15.481 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:26:15.481 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:26:15.482 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:26:15.483 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:26:15.522 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:26:15.522 DEBUG:teuthology.parallel:result is None 2024-09-10T23:26:15.523 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:26:15.523 DEBUG:teuthology.parallel:result is None 2024-09-10T23:26:15.532 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:26:15.533 DEBUG:teuthology.parallel:result is None 2024-09-10T23:26:15.535 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:26:15.535 DEBUG:teuthology.parallel:result is None 2024-09-10T23:26:15.535 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:26:15.610 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:26:15.610 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:26:15.629 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:26:15.629 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:26:15.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.682+0000 7f00f8200640 1 -- 172.21.15.17:0/3049810271 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00f00b4a90 msgr2=0x7f00f006ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.682+0000 7f00f8200640 1 --2- 172.21.15.17:0/3049810271 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00f00b4a90 0x7f00f006ef80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00aa40 tx=0x7f00dc020400 comp rx=0 tx=0).stop 2024-09-10T23:26:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.682+0000 7f00f8200640 1 -- 172.21.15.17:0/3049810271 shutdown_connections 2024-09-10T23:26:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.682+0000 7f00f8200640 1 --2- 172.21.15.17:0/3049810271 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00f00b4a90 0x7f00f006ef80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.682+0000 7f00f8200640 1 --2- 172.21.15.17:0/3049810271 >> v2:172.21.15.77:3300/0 conn(0x7f00f0157c70 0x7f00f00730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.682+0000 7f00f8200640 1 -- 172.21.15.17:0/3049810271 >> 172.21.15.17:0/3049810271 conn(0x7f00f00b1730 msgr2=0x7f00f00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.682+0000 7f00f8200640 1 -- 172.21.15.17:0/3049810271 shutdown_connections 2024-09-10T23:26:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.682+0000 7f00f8200640 1 -- 172.21.15.17:0/3049810271 wait complete. 2024-09-10T23:26:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 Processor -- start 2024-09-10T23:26:15.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 -- start start 2024-09-10T23:26:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f006f4c0 0x7f00f00ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00f00b4a90 0x7f00f01f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f0157c70 0x7f00f01520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f00f006e870 con 0x7f00f006f4c0 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f00f006e6f0 con 0x7f00f0157c70 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f00f006e9f0 con 0x7f00f00b4a90 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f006f4c0 0x7f00f00ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f006f4c0 0x7f00f00ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36454/0 (socket says 172.21.15.17:36454) 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f4e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00f00b4a90 0x7f00f01f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f5800640 1 -- 172.21.15.17:0/3403888455 learned_addr learned my addr 172.21.15.17:0/3403888455 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f6200640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f0157c70 0x7f00f01520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f4e00640 1 -- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f0157c70 msgr2=0x7f00f01520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f4e00640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f0157c70 0x7f00f01520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f4e00640 1 -- 172.21.15.17:0/3403888455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f006f4c0 msgr2=0x7f00f00ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f4e00640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f006f4c0 0x7f00f00ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f4e00640 1 -- 172.21.15.17:0/3403888455 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f00ce740 con 0x7f00f00b4a90 2024-09-10T23:26:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f5800640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f006f4c0 0x7f00f00ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f6200640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f0157c70 0x7f00f01520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f4e00640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00f00b4a90 0x7f00f01f8790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0b0000 tx=0x7f00dc005e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00ed600640 1 -- 172.21.15.17:0/3403888455 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0b5040 con 0x7f00f00b4a90 2024-09-10T23:26:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00ed600640 1 -- 172.21.15.17:0/3403888455 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00dc005310 con 0x7f00f00b4a90 2024-09-10T23:26:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00ed600640 1 -- 172.21.15.17:0/3403888455 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0b08a0 con 0x7f00f00b4a90 2024-09-10T23:26:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f0155cd0 con 0x7f00f00b4a90 2024-09-10T23:26:15.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f0156290 con 0x7f00f00b4a90 2024-09-10T23:26:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.686+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f00730b0 con 0x7f00f00b4a90 2024-09-10T23:26:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.690+0000 7f00ed600640 1 -- 172.21.15.17:0/3403888455 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f00dc0b8070 con 0x7f00f00b4a90 2024-09-10T23:26:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.690+0000 7f00ed600640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00d00725e0 0x7f00d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:15.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.690+0000 7f00ed600640 1 -- 172.21.15.17:0/3403888455 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(147..147 src has 1..147) ==== 5335+0+0 (secure 0 0 0) 0x7f00dc1305b0 con 0x7f00f00b4a90 2024-09-10T23:26:15.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.690+0000 7f00f5800640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00d00725e0 0x7f00d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:15.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.690+0000 7f00f5800640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00d00725e0 0x7f00d0074aa0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f00e4011440 tx=0x7f00e40091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:15.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.694+0000 7f00ed600640 1 -- 172.21.15.17:0/3403888455 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f00dc019f60 con 0x7f00f00b4a90 2024-09-10T23:26:15.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:15.874+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f00f00b2e70 con 0x7f00f00b4a90 2024-09-10T23:26:16.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.058+0000 7f00ed600640 1 -- 172.21.15.17:0/3403888455 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v149) ==== 97+0+0 (secure 0 0 0) 0x7f00dc0fb790 con 0x7f00f00b4a90 2024-09-10T23:26:16.063 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:26:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00d00725e0 msgr2=0x7f00d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00d00725e0 0x7f00d0074aa0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f00e4011440 tx=0x7f00e40091e0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00f00b4a90 msgr2=0x7f00f01f8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00f00b4a90 0x7f00f01f8790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0b0000 tx=0x7f00dc005e70 comp rx=0 tx=0).stop 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 shutdown_connections 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00d00725e0 0x7f00d0074aa0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f0157c70 0x7f00f01520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00f00b4a90 0x7f00f01f8790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 --2- 172.21.15.17:0/3403888455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00f006f4c0 0x7f00f00ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 >> 172.21.15.17:0/3403888455 conn(0x7f00f00b1730 msgr2=0x7f00f01582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 shutdown_connections 2024-09-10T23:26:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.062+0000 7f00f8200640 1 -- 172.21.15.17:0/3403888455 wait complete. 2024-09-10T23:26:16.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:26:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.230+0000 7f5cdf200640 1 -- 172.21.15.17:0/1275274394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 msgr2=0x7f5cc4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.230+0000 7f5cdf200640 1 --2- 172.21.15.17:0/1275274394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 0x7f5cc4004c90 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc001ec0 tx=0x7f5ccc01f610 comp rx=0 tx=0).stop 2024-09-10T23:26:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.230+0000 7f5cdf200640 1 -- 172.21.15.17:0/1275274394 shutdown_connections 2024-09-10T23:26:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.230+0000 7f5cdf200640 1 --2- 172.21.15.17:0/1275274394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 0x7f5cc4004c90 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.230+0000 7f5cdf200640 1 -- 172.21.15.17:0/1275274394 >> 172.21.15.17:0/1275274394 conn(0x7f5ce009a9f0 msgr2=0x7f5ce009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.230+0000 7f5cdf200640 1 -- 172.21.15.17:0/1275274394 shutdown_connections 2024-09-10T23:26:16.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.230+0000 7f5cdf200640 1 -- 172.21.15.17:0/1275274394 wait complete. 2024-09-10T23:26:16.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 Processor -- start 2024-09-10T23:26:16.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 -- start start 2024-09-10T23:26:16.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 0x7f5ce00c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ce01f42b0 0x7f5ce00cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ce00cb190 0x7f5ce014bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce00cfdb0 con 0x7f5cc4004810 2024-09-10T23:26:16.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce00cfc30 con 0x7f5ce01f42b0 2024-09-10T23:26:16.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce00ccba0 con 0x7f5ce00cb190 2024-09-10T23:26:16.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 0x7f5ce00c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 0x7f5ce00c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36460/0 (socket says 172.21.15.17:36460) 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdde00640 1 -- 172.21.15.17:0/211805857 learned_addr learned my addr 172.21.15.17:0/211805857 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cde800640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ce00cb190 0x7f5ce014bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdd400640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ce01f42b0 0x7f5ce00cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdde00640 1 -- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ce00cb190 msgr2=0x7f5ce014bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdde00640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ce00cb190 0x7f5ce014bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdde00640 1 -- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ce01f42b0 msgr2=0x7f5ce00cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdde00640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ce01f42b0 0x7f5ce00cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdde00640 1 -- 172.21.15.17:0/211805857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce00cb730 con 0x7f5cc4004810 2024-09-10T23:26:16.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdde00640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 0x7f5ce00c8e30 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0011a10 tx=0x7f5cd0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cd6000640 1 -- 172.21.15.17:0/211805857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd001e070 con 0x7f5cc4004810 2024-09-10T23:26:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cd6000640 1 -- 172.21.15.17:0/211805857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cd0004460 con 0x7f5cc4004810 2024-09-10T23:26:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cd6000640 1 -- 172.21.15.17:0/211805857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000fc00 con 0x7f5cc4004810 2024-09-10T23:26:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce00cba10 con 0x7f5cc4004810 2024-09-10T23:26:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.234+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce0159b10 con 0x7f5cc4004810 2024-09-10T23:26:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.238+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce0159920 con 0x7f5cc4004810 2024-09-10T23:26:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.238+0000 7f5cd6000640 1 -- 172.21.15.17:0/211805857 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5cd0003600 con 0x7f5cc4004810 2024-09-10T23:26:16.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.238+0000 7f5cd6000640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5cc00725e0 0x7f5cc0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.238+0000 7f5cd6000640 1 -- 172.21.15.17:0/211805857 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5249+0+0 (secure 0 0 0) 0x7f5cd0093da0 con 0x7f5cc4004810 2024-09-10T23:26:16.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.238+0000 7f5cdd400640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5cc00725e0 0x7f5cc0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.238+0000 7f5cdd400640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5cc00725e0 0x7f5cc0074aa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0b0000 tx=0x7f5ccc01c450 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.242+0000 7f5cd6000640 1 -- 172.21.15.17:0/211805857 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5cd005efe0 con 0x7f5cc4004810 2024-09-10T23:26:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.474+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5ce00d1d20 con 0x7f5cc4004810 2024-09-10T23:26:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cd6000640 1 -- 172.21.15.17:0/211805857 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) ==== 80+0+5304 (secure 0 0 0) 0x7f5cd0063a10 con 0x7f5cc4004810 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:26:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:26:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:26:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:26:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:26:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:26:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:26:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:26:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:26:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:26:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:26:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:26:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:26:16.494 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5cc00725e0 msgr2=0x7f5cc0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5cc00725e0 0x7f5cc0074aa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0b0000 tx=0x7f5ccc01c450 comp rx=0 tx=0).stop 2024-09-10T23:26:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 msgr2=0x7f5ce00c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 0x7f5ce00c8e30 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0011a10 tx=0x7f5cd0011ed0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 shutdown_connections 2024-09-10T23:26:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5cc00725e0 0x7f5cc0074aa0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ce00cb190 0x7f5ce014bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ce01f42b0 0x7f5ce00cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 --2- 172.21.15.17:0/211805857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cc4004810 0x7f5ce00c8e30 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 >> 172.21.15.17:0/211805857 conn(0x7f5ce009a9f0 msgr2=0x7f5ce00c5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 shutdown_connections 2024-09-10T23:26:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.478+0000 7f5cdf200640 1 -- 172.21.15.17:0/211805857 wait complete. 2024-09-10T23:26:16.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:26:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 -- 172.21.15.17:0/3022627257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15e5d0 msgr2=0x7ff1fc0b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 --2- 172.21.15.17:0/3022627257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15e5d0 0x7ff1fc0b3e30 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc158b20 tx=0x7ff1e401c890 comp rx=0 tx=0).stop 2024-09-10T23:26:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 -- 172.21.15.17:0/3022627257 shutdown_connections 2024-09-10T23:26:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 --2- 172.21.15.17:0/3022627257 >> v2:172.21.15.77:3300/0 conn(0x7ff1fc0b4370 0x7ff1fc0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 --2- 172.21.15.17:0/3022627257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15e5d0 0x7ff1fc0b3e30 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 --2- 172.21.15.17:0/3022627257 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1fc15ef40 0x7ff1fc15afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 -- 172.21.15.17:0/3022627257 >> 172.21.15.17:0/3022627257 conn(0x7ff1fc06cfc0 msgr2=0x7ff1fc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 -- 172.21.15.17:0/3022627257 shutdown_connections 2024-09-10T23:26:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 -- 172.21.15.17:0/3022627257 wait complete. 2024-09-10T23:26:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 Processor -- start 2024-09-10T23:26:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 -- start start 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1fc0b4370 0x7ff1fc14f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1fc15e5d0 0x7ff1fc150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15ef40 0x7ff1fc157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc070030 con 0x7ff1fc15ef40 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc06feb0 con 0x7ff1fc15e5d0 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff201800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff1fc0701b0 con 0x7ff1fc0b4370 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.646+0000 7ff1fb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15ef40 0x7ff1fc157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1fb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15ef40 0x7ff1fc157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36470/0 (socket says 172.21.15.17:36470) 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1fb400640 1 -- 172.21.15.17:0/2435586916 learned_addr learned my addr 172.21.15.17:0/2435586916 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1faa00640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1fc0b4370 0x7ff1fc14f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1f3e00640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1fc15e5d0 0x7ff1fc150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1fb400640 1 -- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1fc0b4370 msgr2=0x7ff1fc14f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1fb400640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1fc0b4370 0x7ff1fc14f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1fb400640 1 -- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1fc15e5d0 msgr2=0x7ff1fc150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1fb400640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1fc15e5d0 0x7ff1fc150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1fb400640 1 -- 172.21.15.17:0/2435586916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1fc155780 con 0x7ff1fc15ef40 2024-09-10T23:26:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1fb400640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15ef40 0x7ff1fc157bf0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400d900 tx=0x7ff1f400ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1f2a00640 1 -- 172.21.15.17:0/2435586916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4016070 con 0x7ff1fc15ef40 2024-09-10T23:26:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1f2a00640 1 -- 172.21.15.17:0/2435586916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1f4004d30 con 0x7ff1fc15ef40 2024-09-10T23:26:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1f2a00640 1 -- 172.21.15.17:0/2435586916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f400bd70 con 0x7ff1fc15ef40 2024-09-10T23:26:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1fc1552f0 con 0x7ff1fc15ef40 2024-09-10T23:26:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1fc1560b0 con 0x7ff1fc15ef40 2024-09-10T23:26:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1fc0b3e30 con 0x7ff1fc15ef40 2024-09-10T23:26:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.650+0000 7ff1f2a00640 1 -- 172.21.15.17:0/2435586916 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff1f4003980 con 0x7ff1fc15ef40 2024-09-10T23:26:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.654+0000 7ff1f2a00640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1d80725e0 0x7ff1d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.654+0000 7ff1f2a00640 1 -- 172.21.15.17:0/2435586916 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5249+0+0 (secure 0 0 0) 0x7ff1f4093950 con 0x7ff1fc15ef40 2024-09-10T23:26:16.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.654+0000 7ff1faa00640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1d80725e0 0x7ff1d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:16.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.654+0000 7ff1faa00640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1d80725e0 0x7ff1d8074aa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc154f90 tx=0x7ff1ec00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:16.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.658+0000 7ff1f2a00640 1 -- 172.21.15.17:0/2435586916 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff1f401f020 con 0x7ff1fc15ef40 2024-09-10T23:26:16.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.830+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff1fc163cd0 con 0x7ff1fc15ef40 2024-09-10T23:26:16.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.830+0000 7ff1f2a00640 1 -- 172.21.15.17:0/2435586916 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v151) ==== 84+0+65 (secure 0 0 0) 0x7ff1f405eb90 con 0x7ff1fc15ef40 2024-09-10T23:26:16.834 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:26:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:26:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:26:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:26:16.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:26:16.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1d80725e0 msgr2=0x7ff1d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1d80725e0 0x7ff1d8074aa0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc154f90 tx=0x7ff1ec00b390 comp rx=0 tx=0).stop 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15ef40 msgr2=0x7ff1fc157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15ef40 0x7ff1fc157bf0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400d900 tx=0x7ff1f400ddc0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 shutdown_connections 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff1d80725e0 0x7ff1d8074aa0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1fc15ef40 0x7ff1fc157bf0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1fc15e5d0 0x7ff1fc150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 --2- 172.21.15.17:0/2435586916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff1fc0b4370 0x7ff1fc14f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 >> 172.21.15.17:0/2435586916 conn(0x7ff1fc06cfc0 msgr2=0x7ff1fc0b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 shutdown_connections 2024-09-10T23:26:16.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:16.834+0000 7ff201800640 1 -- 172.21.15.17:0/2435586916 wait complete. 2024-09-10T23:26:16.857 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:26:16.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:26:17.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.002+0000 7fa122800640 1 -- 172.21.15.17:0/1011111182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 msgr2=0x7fa11c0741d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.002+0000 7fa122800640 1 --2- 172.21.15.17:0/1011111182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 0x7fa11c0741d0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009900 tx=0x7fa10c01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:26:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.002+0000 7fa122800640 1 -- 172.21.15.17:0/1011111182 shutdown_connections 2024-09-10T23:26:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.002+0000 7fa122800640 1 --2- 172.21.15.17:0/1011111182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11c160460 0x7fa11c15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.002+0000 7fa122800640 1 --2- 172.21.15.17:0/1011111182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 0x7fa11c0741d0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.002+0000 7fa122800640 1 -- 172.21.15.17:0/1011111182 >> 172.21.15.17:0/1011111182 conn(0x7fa11c0b17a0 msgr2=0x7fa11c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.002+0000 7fa122800640 1 -- 172.21.15.17:0/1011111182 shutdown_connections 2024-09-10T23:26:17.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.002+0000 7fa122800640 1 -- 172.21.15.17:0/1011111182 wait complete. 2024-09-10T23:26:17.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa122800640 1 Processor -- start 2024-09-10T23:26:17.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa122800640 1 -- start start 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa122800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11c06e6f0 0x7fa11c130290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa122800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 0x7fa11c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa122800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa11c160460 0x7fa11c161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa122800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c169110 con 0x7fa11c145800 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa122800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c168f90 con 0x7fa11c160460 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa122800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa11c169290 con 0x7fa11c06e6f0 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 0x7fa11c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 0x7fa11c0aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33586/0 (socket says 172.21.15.17:33586) 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11aa00640 1 -- 172.21.15.17:0/1919974213 learned_addr learned my addr 172.21.15.17:0/1919974213 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11b400640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11c06e6f0 0x7fa11c130290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:17.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11be00640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa11c160460 0x7fa11c161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11aa00640 1 -- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11c06e6f0 msgr2=0x7fa11c130290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11aa00640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11c06e6f0 0x7fa11c130290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11aa00640 1 -- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa11c160460 msgr2=0x7fa11c161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11aa00640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa11c160460 0x7fa11c161320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11aa00640 1 -- 172.21.15.17:0/1919974213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c1308e0 con 0x7fa11c145800 2024-09-10T23:26:17.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa11aa00640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 0x7fa11c0aef50 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e770 tx=0x7fa10800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa113400640 1 -- 172.21.15.17:0/1919974213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10800cc60 con 0x7fa11c145800 2024-09-10T23:26:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa113400640 1 -- 172.21.15.17:0/1919974213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa10800ce00 con 0x7fa11c145800 2024-09-10T23:26:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa113400640 1 -- 172.21.15.17:0/1919974213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108005280 con 0x7fa11c145800 2024-09-10T23:26:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.006+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11c130bc0 con 0x7fa11c145800 2024-09-10T23:26:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.010+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11c131180 con 0x7fa11c145800 2024-09-10T23:26:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.010+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11c0741d0 con 0x7fa11c145800 2024-09-10T23:26:17.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.010+0000 7fa113400640 1 -- 172.21.15.17:0/1919974213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa108005420 con 0x7fa11c145800 2024-09-10T23:26:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.010+0000 7fa113400640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0fc0725e0 0x7fa0fc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:17.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.010+0000 7fa113400640 1 -- 172.21.15.17:0/1919974213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5249+0+0 (secure 0 0 0) 0x7fa108093980 con 0x7fa11c145800 2024-09-10T23:26:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.010+0000 7fa11b400640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0fc0725e0 0x7fa0fc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:17.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.014+0000 7fa11b400640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0fc0725e0 0x7fa0fc074aa0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0af000 tx=0x7fa10c01b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:17.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.014+0000 7fa113400640 1 -- 172.21.15.17:0/1919974213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa10805f180 con 0x7fa11c145800 2024-09-10T23:26:17.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:17.194+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa11c071000 con 0x7fa11c145800 2024-09-10T23:26:18.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.070+0000 7fa113400640 1 -- 172.21.15.17:0/1919974213 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v152) ==== 138+0+0 (secure 0 0 0) 0x7fa10805ea80 con 0x7fa11c145800 2024-09-10T23:26:18.074 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:26:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0fc0725e0 msgr2=0x7fa0fc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0fc0725e0 0x7fa0fc074aa0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0af000 tx=0x7fa10c01b120 comp rx=0 tx=0).stop 2024-09-10T23:26:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 msgr2=0x7fa11c0aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 0x7fa11c0aef50 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e770 tx=0x7fa10800ec30 comp rx=0 tx=0).stop 2024-09-10T23:26:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 shutdown_connections 2024-09-10T23:26:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa0fc0725e0 0x7fa0fc074aa0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa11c160460 0x7fa11c161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa11c145800 0x7fa11c0aef50 secure :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e770 tx=0x7fa10800ec30 comp rx=0 tx=0).stop 2024-09-10T23:26:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 --2- 172.21.15.17:0/1919974213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa11c06e6f0 0x7fa11c130290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 >> 172.21.15.17:0/1919974213 conn(0x7fa11c0b17a0 msgr2=0x7fa11c15d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 shutdown_connections 2024-09-10T23:26:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.074+0000 7fa122800640 1 -- 172.21.15.17:0/1919974213 wait complete. 2024-09-10T23:26:18.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:26:18.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 -- 172.21.15.17:0/3521996149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d40d06b0 msgr2=0x7f52d40b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 --2- 172.21.15.17:0/3521996149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d40d06b0 0x7f52d40b29d0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f52c0009900 tx=0x7f52c001c8e0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 -- 172.21.15.17:0/3521996149 shutdown_connections 2024-09-10T23:26:18.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 --2- 172.21.15.17:0/3521996149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d40d06b0 0x7f52d40b29d0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 --2- 172.21.15.17:0/3521996149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d415b8c0 0x7f52d40d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 -- 172.21.15.17:0/3521996149 >> 172.21.15.17:0/3521996149 conn(0x7f52d409a9f0 msgr2=0x7f52d409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:18.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 -- 172.21.15.17:0/3521996149 shutdown_connections 2024-09-10T23:26:18.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 -- 172.21.15.17:0/3521996149 wait complete. 2024-09-10T23:26:18.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 Processor -- start 2024-09-10T23:26:18.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.262+0000 7f52da600640 1 -- start start 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52da600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d40d06b0 0x7f52d40c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52da600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d415b8c0 0x7f52d41fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52da600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d415bca0 0x7f52d40b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52da600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4168e20 con 0x7f52d415bca0 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52da600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52d4168ca0 con 0x7f52d415b8c0 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52da600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52d4168fa0 con 0x7f52d40d06b0 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d415bca0 0x7f52d40b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d415bca0 0x7f52d40b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33614/0 (socket says 172.21.15.17:33614) 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9c00640 1 -- 172.21.15.17:0/861526039 learned_addr learned my addr 172.21.15.17:0/861526039 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:18.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9200640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d40d06b0 0x7f52d40c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d3e00640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d415b8c0 0x7f52d41fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9c00640 1 -- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d40d06b0 msgr2=0x7f52d40c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9c00640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d40d06b0 0x7f52d40c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9c00640 1 -- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d415b8c0 msgr2=0x7f52d41fb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9c00640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d415b8c0 0x7f52d41fb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9c00640 1 -- 172.21.15.17:0/861526039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d40c8440 con 0x7f52d415bca0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d3e00640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d415b8c0 0x7f52d41fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d9c00640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d415bca0 0x7f52d40b6cf0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c710 tx=0x7f52cc00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d0c00640 1 -- 172.21.15.17:0/861526039 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc003b80 con 0x7f52d415bca0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d0c00640 1 -- 172.21.15.17:0/861526039 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52cc003d20 con 0x7f52d415bca0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52d0c00640 1 -- 172.21.15.17:0/861526039 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00aa50 con 0x7f52d415bca0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d41f7bf0 con 0x7f52d415bca0 2024-09-10T23:26:18.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d41f81b0 con 0x7f52d415bca0 2024-09-10T23:26:18.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.266+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d40b29d0 con 0x7f52d415bca0 2024-09-10T23:26:18.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.270+0000 7f52d0c00640 1 -- 172.21.15.17:0/861526039 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f52cc00abf0 con 0x7f52d415bca0 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.270+0000 7f52d0c00640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52b40725e0 0x7f52b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.270+0000 7f52d0c00640 1 -- 172.21.15.17:0/861526039 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5619+0+0 (secure 0 0 0) 0x7f52cc093a40 con 0x7f52d415bca0 2024-09-10T23:26:18.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.270+0000 7f52d9200640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52b40725e0 0x7f52b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:18.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.270+0000 7f52d9200640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52b40725e0 0x7f52b4074aa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f52c80058d0 tx=0x7f52c8005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:18.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.274+0000 7f52d0c00640 1 -- 172.21.15.17:0/861526039 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f52cc00ce20 con 0x7f52d415bca0 2024-09-10T23:26:18.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:18.450+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f52d40af230 con 0x7f52d415bca0 2024-09-10T23:26:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.078+0000 7f52d0c00640 1 -- 172.21.15.17:0/861526039 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v153) ==== 170+0+0 (secure 0 0 0) 0x7f52cc05f1e0 con 0x7f52d415bca0 2024-09-10T23:26:19.081 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:26:19.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52b40725e0 msgr2=0x7f52b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52b40725e0 0x7f52b4074aa0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f52c80058d0 tx=0x7f52c8005860 comp rx=0 tx=0).stop 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d415bca0 msgr2=0x7f52d40b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d415bca0 0x7f52d40b6cf0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c710 tx=0x7f52cc00cbd0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 shutdown_connections 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52b40725e0 0x7f52b4074aa0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d415bca0 0x7f52d40b6cf0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52d415b8c0 0x7f52d41fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 --2- 172.21.15.17:0/861526039 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52d40d06b0 0x7f52d40c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 >> 172.21.15.17:0/861526039 conn(0x7f52d409a9f0 msgr2=0x7f52d4070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 shutdown_connections 2024-09-10T23:26:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.082+0000 7f52da600640 1 -- 172.21.15.17:0/861526039 wait complete. 2024-09-10T23:26:19.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:26:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.270+0000 7eff5ba00640 1 -- 172.21.15.17:0/804364716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff3c004810 msgr2=0x7eff3c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.270+0000 7eff5ba00640 1 --2- 172.21.15.17:0/804364716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff3c004810 0x7eff3c004c90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7eff40006f10 tx=0x7eff4001ce30 comp rx=0 tx=0).stop 2024-09-10T23:26:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.270+0000 7eff5ba00640 1 -- 172.21.15.17:0/804364716 shutdown_connections 2024-09-10T23:26:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.270+0000 7eff5ba00640 1 --2- 172.21.15.17:0/804364716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff3c004810 0x7eff3c004c90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.270+0000 7eff5ba00640 1 -- 172.21.15.17:0/804364716 >> 172.21.15.17:0/804364716 conn(0x7eff5409a9f0 msgr2=0x7eff5409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.270+0000 7eff5ba00640 1 -- 172.21.15.17:0/804364716 shutdown_connections 2024-09-10T23:26:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.270+0000 7eff5ba00640 1 -- 172.21.15.17:0/804364716 wait complete. 2024-09-10T23:26:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.270+0000 7eff5ba00640 1 Processor -- start 2024-09-10T23:26:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.270+0000 7eff5ba00640 1 -- start start 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff5ba00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff3c004810 0x7eff540c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff5ba00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff540cbbf0 0x7eff540b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff5ba00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff540b62b0 0x7eff540b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff5ba00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff5415d200 con 0x7eff3c004810 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff5ba00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff5415d080 con 0x7eff540cbbf0 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff5ba00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff540cfde0 con 0x7eff540b62b0 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff3c004810 0x7eff540c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff3c004810 0x7eff540c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33638/0 (socket says 172.21.15.17:33638) 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59000640 1 -- 172.21.15.17:0/1180277620 learned_addr learned my addr 172.21.15.17:0/1180277620 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff53e00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff540cbbf0 0x7eff540b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59a00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff540b62b0 0x7eff540b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59000640 1 -- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff540b62b0 msgr2=0x7eff540b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59000640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff540b62b0 0x7eff540b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59000640 1 -- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff540cbbf0 msgr2=0x7eff540b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59000640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff540cbbf0 0x7eff540b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59000640 1 -- 172.21.15.17:0/1180277620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff540b5580 con 0x7eff3c004810 2024-09-10T23:26:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff59000640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff3c004810 0x7eff540c4ac0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7eff48011a80 tx=0x7eff48011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff50c00640 1 -- 172.21.15.17:0/1180277620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4800fd90 con 0x7eff3c004810 2024-09-10T23:26:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff50c00640 1 -- 172.21.15.17:0/1180277620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff48004020 con 0x7eff3c004810 2024-09-10T23:26:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff540b5860 con 0x7eff3c004810 2024-09-10T23:26:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff50c00640 1 -- 172.21.15.17:0/1180277620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48004490 con 0x7eff3c004810 2024-09-10T23:26:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff540b5e20 con 0x7eff3c004810 2024-09-10T23:26:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.274+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff540b6060 con 0x7eff3c004810 2024-09-10T23:26:19.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.278+0000 7eff50c00640 1 -- 172.21.15.17:0/1180277620 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7eff48005020 con 0x7eff3c004810 2024-09-10T23:26:19.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.278+0000 7eff50c00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff340725e0 0x7eff34074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:19.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.278+0000 7eff50c00640 1 -- 172.21.15.17:0/1180277620 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 6001+0+0 (secure 0 0 0) 0x7eff4801e070 con 0x7eff3c004810 2024-09-10T23:26:19.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.278+0000 7eff53e00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff340725e0 0x7eff34074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:19.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.278+0000 7eff53e00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff340725e0 0x7eff34074aa0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7eff40006ee0 tx=0x7eff40019c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:19.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.282+0000 7eff50c00640 1 -- 172.21.15.17:0/1180277620 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7eff540b6060 con 0x7eff3c004810 2024-09-10T23:26:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:19.494+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7eff5406dcd0 con 0x7eff3c004810 2024-09-10T23:26:20.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.078+0000 7eff50c00640 1 -- 172.21.15.17:0/1180277620 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v109) ==== 174+0+0 (secure 0 0 0) 0x7eff4805ecb0 con 0x7eff3c004810 2024-09-10T23:26:20.084 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 21 and data pool 22 2024-09-10T23:26:20.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.082+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff340725e0 msgr2=0x7eff34074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.082+0000 7eff5ba00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff340725e0 0x7eff34074aa0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7eff40006ee0 tx=0x7eff40019c70 comp rx=0 tx=0).stop 2024-09-10T23:26:20.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.082+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff3c004810 msgr2=0x7eff540c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.082+0000 7eff5ba00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff3c004810 0x7eff540c4ac0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7eff48011a80 tx=0x7eff48011f40 comp rx=0 tx=0).stop 2024-09-10T23:26:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.086+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 shutdown_connections 2024-09-10T23:26:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.086+0000 7eff5ba00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff340725e0 0x7eff34074aa0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.086+0000 7eff5ba00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff540b62b0 0x7eff540b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.086+0000 7eff5ba00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff540cbbf0 0x7eff540b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.086+0000 7eff5ba00640 1 --2- 172.21.15.17:0/1180277620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff3c004810 0x7eff540c4ac0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.086+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 >> 172.21.15.17:0/1180277620 conn(0x7eff5409a9f0 msgr2=0x7eff540b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.086+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 shutdown_connections 2024-09-10T23:26:20.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.086+0000 7eff5ba00640 1 -- 172.21.15.17:0/1180277620 wait complete. 2024-09-10T23:26:20.137 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:26:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.282+0000 7fd286000640 1 -- 172.21.15.17:0/3330753017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2680051d0 msgr2=0x7fd26800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.282+0000 7fd286000640 1 --2- 172.21.15.17:0/3330753017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2680051d0 0x7fd26800b9d0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fd278009ee0 tx=0x7fd27801d630 comp rx=0 tx=0).stop 2024-09-10T23:26:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.282+0000 7fd286000640 1 -- 172.21.15.17:0/3330753017 shutdown_connections 2024-09-10T23:26:20.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.282+0000 7fd286000640 1 --2- 172.21.15.17:0/3330753017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2680051d0 0x7fd26800b9d0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.282+0000 7fd286000640 1 -- 172.21.15.17:0/3330753017 >> 172.21.15.17:0/3330753017 conn(0x7fd2800d0380 msgr2=0x7fd2800d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.282+0000 7fd286000640 1 -- 172.21.15.17:0/3330753017 shutdown_connections 2024-09-10T23:26:20.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.282+0000 7fd286000640 1 -- 172.21.15.17:0/3330753017 wait complete. 2024-09-10T23:26:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 Processor -- start 2024-09-10T23:26:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 -- start start 2024-09-10T23:26:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2680051d0 0x7fd28015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2801f82a0 0x7fd2801565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd280156e50 0x7fd280158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd280069540 con 0x7fd280156e50 2024-09-10T23:26:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2800693c0 con 0x7fd2801f82a0 2024-09-10T23:26:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd2800696c0 con 0x7fd2680051d0 2024-09-10T23:26:20.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd285600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd280156e50 0x7fd280158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd284c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2680051d0 0x7fd28015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd285600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd280156e50 0x7fd280158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33666/0 (socket says 172.21.15.17:33666) 2024-09-10T23:26:20.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd285600640 1 -- 172.21.15.17:0/3521802850 learned_addr learned my addr 172.21.15.17:0/3521802850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:20.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd27fe00640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2801f82a0 0x7fd2801565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd285600640 1 -- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2680051d0 msgr2=0x7fd28015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd285600640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2680051d0 0x7fd28015a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd285600640 1 -- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2801f82a0 msgr2=0x7fd2801565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd285600640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2801f82a0 0x7fd2801565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd285600640 1 -- 172.21.15.17:0/3521802850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28015a9d0 con 0x7fd280156e50 2024-09-10T23:26:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd285600640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd280156e50 0x7fd280158600 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fd278009e00 tx=0x7fd278009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd27cc00640 1 -- 172.21.15.17:0/3521802850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2780b0070 con 0x7fd280156e50 2024-09-10T23:26:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd27cc00640 1 -- 172.21.15.17:0/3521802850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2780bc070 con 0x7fd280156e50 2024-09-10T23:26:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2801f87a0 con 0x7fd280156e50 2024-09-10T23:26:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd27cc00640 1 -- 172.21.15.17:0/3521802850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2780a8070 con 0x7fd280156e50 2024-09-10T23:26:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2800ce3d0 con 0x7fd280156e50 2024-09-10T23:26:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.286+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28006e090 con 0x7fd280156e50 2024-09-10T23:26:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.290+0000 7fd27cc00640 1 -- 172.21.15.17:0/3521802850 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd2780b5040 con 0x7fd280156e50 2024-09-10T23:26:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.290+0000 7fd27cc00640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd260072610 0x7fd260074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.290+0000 7fd27cc00640 1 -- 172.21.15.17:0/3521802850 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6101+0+0 (secure 0 0 0) 0x7fd27812f060 con 0x7fd280156e50 2024-09-10T23:26:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.290+0000 7fd284c00640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd260072610 0x7fd260074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.290+0000 7fd284c00640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd260072610 0x7fd260074ad0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd274001250 tx=0x7fd274001e80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.294+0000 7fd27cc00640 1 -- 172.21.15.17:0/3521802850 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd278017340 con 0x7fd280156e50 2024-09-10T23:26:20.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.470+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd280070400 con 0x7fd280156e50 2024-09-10T23:26:20.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.470+0000 7fd27cc00640 1 -- 172.21.15.17:0/3521802850 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16905 (secure 0 0 0) 0x7fd2780f9eb0 con 0x7fd280156e50 2024-09-10T23:26:20.474 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:20.474 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":154,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:26:19.498195+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:26:17.207114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-10T23:26:18.463692+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:26:20.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd260072610 msgr2=0x7fd260074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd260072610 0x7fd260074ad0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd274001250 tx=0x7fd274001e80 comp rx=0 tx=0).stop 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd280156e50 msgr2=0x7fd280158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd280156e50 0x7fd280158600 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fd278009e00 tx=0x7fd278009ab0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 shutdown_connections 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd260072610 0x7fd260074ad0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd280156e50 0x7fd280158600 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2801f82a0 0x7fd2801565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 --2- 172.21.15.17:0/3521802850 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2680051d0 0x7fd28015a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 >> 172.21.15.17:0/3521802850 conn(0x7fd2800d0380 msgr2=0x7fd2800ada60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 shutdown_connections 2024-09-10T23:26:20.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.474+0000 7fd286000640 1 -- 172.21.15.17:0/3521802850 wait complete. 2024-09-10T23:26:20.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:26:20.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.638+0000 7f7c58200640 1 -- 172.21.15.17:0/498451449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c500cf320 msgr2=0x7f7c500cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.638+0000 7f7c58200640 1 --2- 172.21.15.17:0/498451449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c500cf320 0x7f7c500cd880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009bc0 tx=0x7f7c4801cba0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.638+0000 7f7c58200640 1 -- 172.21.15.17:0/498451449 shutdown_connections 2024-09-10T23:26:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.638+0000 7f7c58200640 1 --2- 172.21.15.17:0/498451449 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c500cf320 0x7f7c500cd880 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.638+0000 7f7c58200640 1 --2- 172.21.15.17:0/498451449 >> v2:172.21.15.77:3300/0 conn(0x7f7c50070ad0 0x7f7c5015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.638+0000 7f7c58200640 1 -- 172.21.15.17:0/498451449 >> 172.21.15.17:0/498451449 conn(0x7f7c500d1d60 msgr2=0x7f7c500d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.638+0000 7f7c58200640 1 -- 172.21.15.17:0/498451449 shutdown_connections 2024-09-10T23:26:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.638+0000 7f7c58200640 1 -- 172.21.15.17:0/498451449 wait complete. 2024-09-10T23:26:20.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 Processor -- start 2024-09-10T23:26:20.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 -- start start 2024-09-10T23:26:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50070ad0 0x7f7c50154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c500cf320 0x7f7c50166250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c500d1830 0x7f7c500af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c50169480 con 0x7f7c500d1830 2024-09-10T23:26:20.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c50169300 con 0x7f7c50070ad0 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c50169600 con 0x7f7c500cf320 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c56200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c500d1830 0x7f7c500af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c56200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c500d1830 0x7f7c500af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33672/0 (socket says 172.21.15.17:33672) 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c56200640 1 -- 172.21.15.17:0/352558732 learned_addr learned my addr 172.21.15.17:0/352558732 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c54e00640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c500cf320 0x7f7c50166250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c55800640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50070ad0 0x7f7c50154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c56200640 1 -- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c500cf320 msgr2=0x7f7c50166250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c56200640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c500cf320 0x7f7c50166250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c56200640 1 -- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50070ad0 msgr2=0x7f7c50154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c56200640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50070ad0 0x7f7c50154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c56200640 1 -- 172.21.15.17:0/352558732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c500b0760 con 0x7f7c500d1830 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c54e00640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c500cf320 0x7f7c50166250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c55800640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50070ad0 0x7f7c50154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c56200640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c500d1830 0x7f7c500af4c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f7c4801a7d0 tx=0x7f7c48003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c4d600640 1 -- 172.21.15.17:0/352558732 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c480b2040 con 0x7f7c500d1830 2024-09-10T23:26:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c4d600640 1 -- 172.21.15.17:0/352558732 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c48004d40 con 0x7f7c500d1830 2024-09-10T23:26:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c4d600640 1 -- 172.21.15.17:0/352558732 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48004210 con 0x7f7c500d1830 2024-09-10T23:26:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c500b0a40 con 0x7f7c500d1830 2024-09-10T23:26:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c500aefa0 con 0x7f7c500d1830 2024-09-10T23:26:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.642+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5015f060 con 0x7f7c500d1830 2024-09-10T23:26:20.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.646+0000 7f7c4d600640 1 -- 172.21.15.17:0/352558732 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7c480b5070 con 0x7f7c500d1830 2024-09-10T23:26:20.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.646+0000 7f7c4d600640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c300725e0 0x7f7c30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:20.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.646+0000 7f7c4d600640 1 -- 172.21.15.17:0/352558732 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6101+0+0 (secure 0 0 0) 0x7f7c4812d150 con 0x7f7c500d1830 2024-09-10T23:26:20.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.646+0000 7f7c55800640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c300725e0 0x7f7c30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:20.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.646+0000 7f7c55800640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c300725e0 0x7f7c30074aa0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009c30 tx=0x7f7c440091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:20.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.650+0000 7f7c4d600640 1 -- 172.21.15.17:0/352558732 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7c480a5e20 con 0x7f7c500d1830 2024-09-10T23:26:20.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.826+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c500b6920 con 0x7f7c500d1830 2024-09-10T23:26:20.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.826+0000 7f7c4d600640 1 -- 172.21.15.17:0/352558732 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16905 (secure 0 0 0) 0x7f7c48016790 con 0x7f7c500d1830 2024-09-10T23:26:20.829 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:20.829 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":154,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:26:19.498195+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:26:17.207114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-10T23:26:18.463692+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c300725e0 msgr2=0x7f7c30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c300725e0 0x7f7c30074aa0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009c30 tx=0x7f7c440091e0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c500d1830 msgr2=0x7f7c500af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c500d1830 0x7f7c500af4c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f7c4801a7d0 tx=0x7f7c48003f60 comp rx=0 tx=0).stop 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 shutdown_connections 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c300725e0 0x7f7c30074aa0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c500d1830 0x7f7c500af4c0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c500cf320 0x7f7c50166250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 --2- 172.21.15.17:0/352558732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c50070ad0 0x7f7c50154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 >> 172.21.15.17:0/352558732 conn(0x7f7c500d1d60 msgr2=0x7f7c500b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:20.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 shutdown_connections 2024-09-10T23:26:20.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.830+0000 7f7c58200640 1 -- 172.21.15.17:0/352558732 wait complete. 2024-09-10T23:26:20.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:26:21.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 -- 172.21.15.17:0/1938076029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb61015f360 msgr2=0x7fb6100694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 --2- 172.21.15.17:0/1938076029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb61015f360 0x7fb6100694e0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fb6100b5ad0 tx=0x7fb60001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 -- 172.21.15.17:0/1938076029 shutdown_connections 2024-09-10T23:26:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 --2- 172.21.15.17:0/1938076029 >> v2:172.21.15.77:3300/0 conn(0x7fb6100b60a0 0x7fb6100b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 --2- 172.21.15.17:0/1938076029 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6100b50c0 0x7fb6100b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 --2- 172.21.15.17:0/1938076029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb61015f360 0x7fb6100694e0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 -- 172.21.15.17:0/1938076029 >> 172.21.15.17:0/1938076029 conn(0x7fb6100d0360 msgr2=0x7fb6100d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 -- 172.21.15.17:0/1938076029 shutdown_connections 2024-09-10T23:26:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 -- 172.21.15.17:0/1938076029 wait complete. 2024-09-10T23:26:21.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 Processor -- start 2024-09-10T23:26:21.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:20.998+0000 7fb616a00640 1 -- start start 2024-09-10T23:26:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb616a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6100b50c0 0x7fb61015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb616a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6100b60a0 0x7fb61009c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb616a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61015f360 0x7fb61015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb616a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb6100cd3b0 con 0x7fb6100b50c0 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb616a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6100cd230 con 0x7fb61015f360 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb616a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb6100cd530 con 0x7fb6100b60a0 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6100b50c0 0x7fb61015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6100b50c0 0x7fb61015cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33680/0 (socket says 172.21.15.17:33680) 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60fe00640 1 -- 172.21.15.17:0/3908001305 learned_addr learned my addr 172.21.15.17:0/3908001305 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60f400640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6100b60a0 0x7fb61009c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb614a00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61015f360 0x7fb61015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60fe00640 1 -- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6100b60a0 msgr2=0x7fb61009c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60fe00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6100b60a0 0x7fb61009c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60fe00640 1 -- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61015f360 msgr2=0x7fb61015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60fe00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61015f360 0x7fb61015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60fe00640 1 -- 172.21.15.17:0/3908001305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61009c8f0 con 0x7fb6100b50c0 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb60fe00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6100b50c0 0x7fb61015cdd0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fb6000b0040 tx=0x7fb6000a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb607e00640 1 -- 172.21.15.17:0/3908001305 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6000b2040 con 0x7fb6100b50c0 2024-09-10T23:26:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb607e00640 1 -- 172.21.15.17:0/3908001305 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6000043b0 con 0x7fb6100b50c0 2024-09-10T23:26:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61015d3b0 con 0x7fb6100b50c0 2024-09-10T23:26:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb607e00640 1 -- 172.21.15.17:0/3908001305 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb600003860 con 0x7fb6100b50c0 2024-09-10T23:26:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61015d970 con 0x7fb6100b50c0 2024-09-10T23:26:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.002+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6100c6b00 con 0x7fb6100b50c0 2024-09-10T23:26:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.006+0000 7fb607e00640 1 -- 172.21.15.17:0/3908001305 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb610074aa0 con 0x7fb6100b50c0 2024-09-10T23:26:21.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.006+0000 7fb607e00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5f0072610 0x7fb5f0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:21.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.006+0000 7fb607e00640 1 -- 172.21.15.17:0/3908001305 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6101+0+0 (secure 0 0 0) 0x7fb60012d310 con 0x7fb6100b50c0 2024-09-10T23:26:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.006+0000 7fb60f400640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5f0072610 0x7fb5f0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.006+0000 7fb60f400640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5f0072610 0x7fb5f0074ad0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc006fd0 tx=0x7fb5fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.010+0000 7fb607e00640 1 -- 172.21.15.17:0/3908001305 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb6000bd060 con 0x7fb6100b50c0 2024-09-10T23:26:21.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:21.222+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb610159cb0 con 0x7fb6100b50c0 2024-09-10T23:26:22.064 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:26:22.058+0000 7fb7e7600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:26:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb607e00640 1 -- 172.21.15.17:0/3908001305 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v111) ==== 118+0+0 (secure 0 0 0) 0x7fb61009c8f0 con 0x7fb6100b50c0 2024-09-10T23:26:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5f0072610 msgr2=0x7fb5f0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5f0072610 0x7fb5f0074ad0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc006fd0 tx=0x7fb5fc008040 comp rx=0 tx=0).stop 2024-09-10T23:26:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6100b50c0 msgr2=0x7fb61015cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6100b50c0 0x7fb61015cdd0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fb6000b0040 tx=0x7fb6000a55c0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 shutdown_connections 2024-09-10T23:26:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5f0072610 0x7fb5f0074ad0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61015f360 0x7fb61015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb6100b60a0 0x7fb61009c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 --2- 172.21.15.17:0/3908001305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6100b50c0 0x7fb61015cdd0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 >> 172.21.15.17:0/3908001305 conn(0x7fb6100d0360 msgr2=0x7fb6100b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:22.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 shutdown_connections 2024-09-10T23:26:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.102+0000 7fb616a00640 1 -- 172.21.15.17:0/3908001305 wait complete. 2024-09-10T23:26:22.131 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:26:22.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:26:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.282+0000 7fb9b9600640 1 -- 172.21.15.17:0/145445441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b40b63f0 msgr2=0x7fb9b40cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.282+0000 7fb9b9600640 1 --2- 172.21.15.17:0/145445441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b40b63f0 0x7fb9b40cbec0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4072d20 tx=0x7fb99c01c7e0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.282+0000 7fb9b9600640 1 -- 172.21.15.17:0/145445441 shutdown_connections 2024-09-10T23:26:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.282+0000 7fb9b9600640 1 --2- 172.21.15.17:0/145445441 >> v2:172.21.15.77:3300/0 conn(0x7fb9b4073960 0x7fb9b4073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.282+0000 7fb9b9600640 1 --2- 172.21.15.17:0/145445441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b40b63f0 0x7fb9b40cbec0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.282+0000 7fb9b9600640 1 -- 172.21.15.17:0/145445441 >> 172.21.15.17:0/145445441 conn(0x7fb9b40d0b80 msgr2=0x7fb9b40d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.282+0000 7fb9b9600640 1 -- 172.21.15.17:0/145445441 shutdown_connections 2024-09-10T23:26:22.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.282+0000 7fb9b9600640 1 -- 172.21.15.17:0/145445441 wait complete. 2024-09-10T23:26:22.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 Processor -- start 2024-09-10T23:26:22.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 -- start start 2024-09-10T23:26:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9b4073960 0x7fb9b414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b40b63f0 0x7fb9b40ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b415bee0 0x7fb9b40ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4168da0 con 0x7fb9b415bee0 2024-09-10T23:26:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b40d0920 con 0x7fb9b40b63f0 2024-09-10T23:26:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b4168f20 con 0x7fb9b4073960 2024-09-10T23:26:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b415bee0 0x7fb9b40ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b415bee0 0x7fb9b40ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33690/0 (socket says 172.21.15.17:33690) 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b3400640 1 -- 172.21.15.17:0/1091256264 learned_addr learned my addr 172.21.15.17:0/1091256264 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9aa000640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b40b63f0 0x7fb9b40ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b2a00640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9b4073960 0x7fb9b414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b3400640 1 -- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9b4073960 msgr2=0x7fb9b414deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b3400640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9b4073960 0x7fb9b414deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b3400640 1 -- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b40b63f0 msgr2=0x7fb9b40ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b3400640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b40b63f0 0x7fb9b40ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b3400640 1 -- 172.21.15.17:0/1091256264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b40c9a50 con 0x7fb9b415bee0 2024-09-10T23:26:22.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b3400640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b415bee0 0x7fb9b40ca560 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00ea20 tx=0x7fb9ac00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:22.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9ab400640 1 -- 172.21.15.17:0/1091256264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00cde0 con 0x7fb9b415bee0 2024-09-10T23:26:22.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9ab400640 1 -- 172.21.15.17:0/1091256264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9ac004c40 con 0x7fb9b415bee0 2024-09-10T23:26:22.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9ab400640 1 -- 172.21.15.17:0/1091256264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac005280 con 0x7fb9b415bee0 2024-09-10T23:26:22.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b40c9d10 con 0x7fb9b415bee0 2024-09-10T23:26:22.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.286+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b414e3f0 con 0x7fb9b415bee0 2024-09-10T23:26:22.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.290+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b406f230 con 0x7fb9b415bee0 2024-09-10T23:26:22.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.290+0000 7fb9ab400640 1 -- 172.21.15.17:0/1091256264 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb9ac00f040 con 0x7fb9b415bee0 2024-09-10T23:26:22.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.290+0000 7fb9ab400640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9900725e0 0x7fb990074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:22.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.290+0000 7fb9ab400640 1 -- 172.21.15.17:0/1091256264 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fb9ac093ab0 con 0x7fb9b415bee0 2024-09-10T23:26:22.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.290+0000 7fb9b2a00640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9900725e0 0x7fb990074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:22.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.290+0000 7fb9b2a00640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9900725e0 0x7fb990074aa0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40b58d0 tx=0x7fb9a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:22.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.294+0000 7fb9ab400640 1 -- 172.21.15.17:0/1091256264 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb9ac016030 con 0x7fb9b415bee0 2024-09-10T23:26:22.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:22.502+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb9b4157600 con 0x7fb9b415bee0 2024-09-10T23:26:23.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.102+0000 7fb9ab400640 1 -- 172.21.15.17:0/1091256264 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v112) ==== 122+0+0 (secure 0 0 0) 0x7fb9ac05e910 con 0x7fb9b415bee0 2024-09-10T23:26:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9900725e0 msgr2=0x7fb990074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9900725e0 0x7fb990074aa0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40b58d0 tx=0x7fb9a4009040 comp rx=0 tx=0).stop 2024-09-10T23:26:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b415bee0 msgr2=0x7fb9b40ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b415bee0 0x7fb9b40ca560 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00ea20 tx=0x7fb9ac00eee0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 shutdown_connections 2024-09-10T23:26:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9900725e0 0x7fb990074aa0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b415bee0 0x7fb9b40ca560 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9b40b63f0 0x7fb9b40ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 --2- 172.21.15.17:0/1091256264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb9b4073960 0x7fb9b414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 >> 172.21.15.17:0/1091256264 conn(0x7fb9b40d0b80 msgr2=0x7fb9b40d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:23.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 shutdown_connections 2024-09-10T23:26:23.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.106+0000 7fb9b9600640 1 -- 172.21.15.17:0/1091256264 wait complete. 2024-09-10T23:26:23.135 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:26:23.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.282+0000 7f0f60800640 1 -- 172.21.15.17:0/3609524647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f58074740 msgr2=0x7f0f580d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.282+0000 7f0f60800640 1 --2- 172.21.15.17:0/3609524647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f58074740 0x7f0f580d0460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009c80 tx=0x7f0f5401cce0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.282+0000 7f0f60800640 1 -- 172.21.15.17:0/3609524647 shutdown_connections 2024-09-10T23:26:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.282+0000 7f0f60800640 1 --2- 172.21.15.17:0/3609524647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f58074740 0x7f0f580d0460 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.282+0000 7f0f60800640 1 --2- 172.21.15.17:0/3609524647 >> v2:172.21.15.77:3300/0 conn(0x7f0f580b3870 0x7f0f580cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.282+0000 7f0f60800640 1 -- 172.21.15.17:0/3609524647 >> 172.21.15.17:0/3609524647 conn(0x7f0f5806cfc0 msgr2=0x7f0f5806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.282+0000 7f0f60800640 1 -- 172.21.15.17:0/3609524647 shutdown_connections 2024-09-10T23:26:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.282+0000 7f0f60800640 1 -- 172.21.15.17:0/3609524647 wait complete. 2024-09-10T23:26:23.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f60800640 1 Processor -- start 2024-09-10T23:26:23.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f60800640 1 -- start start 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f60800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f58074740 0x7f0f580ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f60800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f580b3870 0x7f0f58144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f60800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f581550b0 0x7f0f58147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f60800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0f581679e0 con 0x7f0f58074740 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f60800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0f58167860 con 0x7f0f581550b0 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f60800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0f58167b60 con 0x7f0f580b3870 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f58074740 0x7f0f580ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f58074740 0x7f0f580ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33692/0 (socket says 172.21.15.17:33692) 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5de00640 1 -- 172.21.15.17:0/3817503126 learned_addr learned my addr 172.21.15.17:0/3817503126 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5d400640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f580b3870 0x7f0f58144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5e800640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f581550b0 0x7f0f58147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5de00640 1 -- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f580b3870 msgr2=0x7f0f58144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5de00640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f580b3870 0x7f0f58144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5de00640 1 -- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f581550b0 msgr2=0x7f0f58147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5de00640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f581550b0 0x7f0f58147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5de00640 1 -- 172.21.15.17:0/3817503126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f581484b0 con 0x7f0f58074740 2024-09-10T23:26:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f5de00640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f58074740 0x7f0f580ce4f0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00c3f0 tx=0x7f0f4c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f52000640 1 -- 172.21.15.17:0/3817503126 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c017070 con 0x7f0f58074740 2024-09-10T23:26:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f52000640 1 -- 172.21.15.17:0/3817503126 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f4c0053c0 con 0x7f0f58074740 2024-09-10T23:26:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f52000640 1 -- 172.21.15.17:0/3817503126 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c003860 con 0x7f0f58074740 2024-09-10T23:26:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.286+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f581f7970 con 0x7f0f58074740 2024-09-10T23:26:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.290+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f580cedd0 con 0x7f0f58074740 2024-09-10T23:26:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.290+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f581f7d90 con 0x7f0f58074740 2024-09-10T23:26:23.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.290+0000 7f0f52000640 1 -- 172.21.15.17:0/3817503126 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0f4c003a00 con 0x7f0f58074740 2024-09-10T23:26:23.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.290+0000 7f0f52000640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f3c072610 0x7f0f3c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:23.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.290+0000 7f0f52000640 1 -- 172.21.15.17:0/3817503126 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f0f4c092960 con 0x7f0f58074740 2024-09-10T23:26:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.290+0000 7f0f5d400640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f3c072610 0x7f0f3c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.294+0000 7f0f5d400640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f3c072610 0x7f0f3c074ad0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0f5806e700 tx=0x7f0f480091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:23.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.294+0000 7f0f52000640 1 -- 172.21.15.17:0/3817503126 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0f4c05d850 con 0x7f0f58074740 2024-09-10T23:26:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f580b3e10 con 0x7f0f58074740 2024-09-10T23:26:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f52000640 1 -- 172.21.15.17:0/3817503126 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f0f4c062280 con 0x7f0f58074740 2024-09-10T23:26:23.509 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:23.509 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:26:23.509 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:26:23.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f3c072610 msgr2=0x7f0f3c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f3c072610 0x7f0f3c074ad0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0f5806e700 tx=0x7f0f480091e0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f58074740 msgr2=0x7f0f580ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f58074740 0x7f0f580ce4f0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00c3f0 tx=0x7f0f4c00c8b0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 shutdown_connections 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0f3c072610 0x7f0f3c074ad0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f581550b0 0x7f0f58147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0f580b3870 0x7f0f58144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 --2- 172.21.15.17:0/3817503126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f58074740 0x7f0f580ce4f0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 >> 172.21.15.17:0/3817503126 conn(0x7f0f5806cfc0 msgr2=0x7f0f5806f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 shutdown_connections 2024-09-10T23:26:23.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.506+0000 7f0f60800640 1 -- 172.21.15.17:0/3817503126 wait complete. 2024-09-10T23:26:23.531 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:26:23.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 -- 172.21.15.17:0/3165208521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 msgr2=0x7f56bc0d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 --2- 172.21.15.17:0/3165208521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 0x7f56bc0d0030 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009900 tx=0x7f56b401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 -- 172.21.15.17:0/3165208521 shutdown_connections 2024-09-10T23:26:23.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 --2- 172.21.15.17:0/3165208521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 0x7f56bc0d0030 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 --2- 172.21.15.17:0/3165208521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56bc15e5d0 0x7f56bc0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 -- 172.21.15.17:0/3165208521 >> 172.21.15.17:0/3165208521 conn(0x7f56bc06cfc0 msgr2=0x7f56bc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:23.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 -- 172.21.15.17:0/3165208521 shutdown_connections 2024-09-10T23:26:23.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 -- 172.21.15.17:0/3165208521 wait complete. 2024-09-10T23:26:23.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 Processor -- start 2024-09-10T23:26:23.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.674+0000 7f56c0c00640 1 -- start start 2024-09-10T23:26:23.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56c0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 0x7f56bc14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56c0c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56bc15e5d0 0x7f56bc0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56c0c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56bc15ef40 0x7f56bc164d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56c0c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc168140 con 0x7f56bc0b4370 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56c0c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc167fc0 con 0x7f56bc15ef40 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56c0c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56bc1682c0 con 0x7f56bc15e5d0 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 0x7f56bc14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 0x7f56bc14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33716/0 (socket says 172.21.15.17:33716) 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b9e00640 1 -- 172.21.15.17:0/649073296 learned_addr learned my addr 172.21.15.17:0/649073296 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b1400640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56bc15e5d0 0x7f56bc0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56ba800640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56bc15ef40 0x7f56bc164d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b9e00640 1 -- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56bc15e5d0 msgr2=0x7f56bc0b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b9e00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56bc15e5d0 0x7f56bc0b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b9e00640 1 -- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56bc15ef40 msgr2=0x7f56bc164d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b9e00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56bc15ef40 0x7f56bc164d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b9e00640 1 -- 172.21.15.17:0/649073296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc14b720 con 0x7f56bc0b4370 2024-09-10T23:26:23.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b9e00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 0x7f56bc14c1c0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00c7c0 tx=0x7f56ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:23.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b2a00640 1 -- 172.21.15.17:0/649073296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac016020 con 0x7f56bc0b4370 2024-09-10T23:26:23.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b2a00640 1 -- 172.21.15.17:0/649073296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ac00ab40 con 0x7f56bc0b4370 2024-09-10T23:26:23.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc0b1580 con 0x7f56bc0b4370 2024-09-10T23:26:23.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56b2a00640 1 -- 172.21.15.17:0/649073296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac012420 con 0x7f56bc0b4370 2024-09-10T23:26:23.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc14bca0 con 0x7f56bc0b4370 2024-09-10T23:26:23.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.678+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56bc0d0030 con 0x7f56bc0b4370 2024-09-10T23:26:23.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.682+0000 7f56b2a00640 1 -- 172.21.15.17:0/649073296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f56ac006b60 con 0x7f56bc0b4370 2024-09-10T23:26:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.682+0000 7f56b2a00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56980725e0 0x7f5698074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.682+0000 7f56b2a00640 1 -- 172.21.15.17:0/649073296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f56ac093a60 con 0x7f56bc0b4370 2024-09-10T23:26:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.682+0000 7f56b1400640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56980725e0 0x7f5698074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:23.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.682+0000 7f56b1400640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56980725e0 0x7f5698074aa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f56bc073770 tx=0x7f56a400a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.686+0000 7f56b2a00640 1 -- 172.21.15.17:0/649073296 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f56ac020030 con 0x7f56bc0b4370 2024-09-10T23:26:23.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.858+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56bc0cefa0 con 0x7f56bc0b4370 2024-09-10T23:26:23.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56b2a00640 1 -- 172.21.15.17:0/649073296 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16892 (secure 0 0 0) 0x7f56ac05e9d0 con 0x7f56bc0b4370 2024-09-10T23:26:23.864 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:23.864 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":155,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:26:21.092685+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:26:17.207114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-10T23:26:18.463692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:26:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56980725e0 msgr2=0x7f5698074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56980725e0 0x7f5698074aa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f56bc073770 tx=0x7f56a400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 msgr2=0x7f56bc14c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 0x7f56bc14c1c0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00c7c0 tx=0x7f56ac00cc80 comp rx=0 tx=0).stop 2024-09-10T23:26:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 shutdown_connections 2024-09-10T23:26:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56980725e0 0x7f5698074aa0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56bc15ef40 0x7f56bc164d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56bc15e5d0 0x7f56bc0b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 --2- 172.21.15.17:0/649073296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56bc0b4370 0x7f56bc14c1c0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:23.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 >> 172.21.15.17:0/649073296 conn(0x7f56bc06cfc0 msgr2=0x7f56bc15af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:23.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 shutdown_connections 2024-09-10T23:26:23.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:23.862+0000 7f56c0c00640 1 -- 172.21.15.17:0/649073296 wait complete. 2024-09-10T23:26:23.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:26:23.889 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:26:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.030+0000 7f40a6200640 1 -- 172.21.15.17:0/763812246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a00d1830 msgr2=0x7f40a015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.030+0000 7f40a6200640 1 --2- 172.21.15.17:0/763812246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a00d1830 0x7f40a015f5a0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f40a00cf010 tx=0x7f408801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.030+0000 7f40a6200640 1 -- 172.21.15.17:0/763812246 shutdown_connections 2024-09-10T23:26:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.030+0000 7f40a6200640 1 --2- 172.21.15.17:0/763812246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a00d1830 0x7f40a015f5a0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.030+0000 7f40a6200640 1 --2- 172.21.15.17:0/763812246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f40a0070ad0 0x7f40a015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.030+0000 7f40a6200640 1 -- 172.21.15.17:0/763812246 >> 172.21.15.17:0/763812246 conn(0x7f40a00d1d60 msgr2=0x7f40a00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.030+0000 7f40a6200640 1 -- 172.21.15.17:0/763812246 shutdown_connections 2024-09-10T23:26:24.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.030+0000 7f40a6200640 1 -- 172.21.15.17:0/763812246 wait complete. 2024-09-10T23:26:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 Processor -- start 2024-09-10T23:26:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 -- start start 2024-09-10T23:26:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0070ad0 0x7f40a0153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f40a00cf320 0x7f40a015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a00d1830 0x7f40a015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f40a0169430 con 0x7f40a0070ad0 2024-09-10T23:26:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f40a01692b0 con 0x7f40a00d1830 2024-09-10T23:26:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f40a01695b0 con 0x7f40a00cf320 2024-09-10T23:26:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f409f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0070ad0 0x7f40a0153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f409f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0070ad0 0x7f40a0153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33734/0 (socket says 172.21.15.17:33734) 2024-09-10T23:26:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f409f400640 1 -- 172.21.15.17:0/1506910860 learned_addr learned my addr 172.21.15.17:0/1506910860 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f409f400640 1 -- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f40a00cf320 msgr2=0x7f40a015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f409f400640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f40a00cf320 0x7f40a015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f409f400640 1 -- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a00d1830 msgr2=0x7f40a015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f409f400640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a00d1830 0x7f40a015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f409f400640 1 -- 172.21.15.17:0/1506910860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a01583b0 con 0x7f40a0070ad0 2024-09-10T23:26:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f409f400640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0070ad0 0x7f40a0153f30 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f409000d980 tx=0x7f409000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f4097e00640 1 -- 172.21.15.17:0/1506910860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4090017070 con 0x7f40a0070ad0 2024-09-10T23:26:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f4097e00640 1 -- 172.21.15.17:0/1506910860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4090009d20 con 0x7f40a0070ad0 2024-09-10T23:26:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f4097e00640 1 -- 172.21.15.17:0/1506910860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4090004280 con 0x7f40a0070ad0 2024-09-10T23:26:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a0158690 con 0x7f40a0070ad0 2024-09-10T23:26:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.034+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a0158c50 con 0x7f40a0070ad0 2024-09-10T23:26:24.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.038+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a00cfc60 con 0x7f40a0070ad0 2024-09-10T23:26:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.038+0000 7f4097e00640 1 -- 172.21.15.17:0/1506910860 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4090003600 con 0x7f40a0070ad0 2024-09-10T23:26:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.038+0000 7f4097e00640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f407c0725e0 0x7f407c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.038+0000 7f4097e00640 1 -- 172.21.15.17:0/1506910860 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f4090093e10 con 0x7f40a0070ad0 2024-09-10T23:26:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.038+0000 7f4096a00640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f407c0725e0 0x7f407c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.042+0000 7f4096a00640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f407c0725e0 0x7f407c074aa0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f40880af000 tx=0x7f4088019680 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:24.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.042+0000 7f4097e00640 1 -- 172.21.15.17:0/1506910860 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f409005f340 con 0x7f40a0070ad0 2024-09-10T23:26:24.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.214+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40a0069e10 con 0x7f407c0725e0 2024-09-10T23:26:24.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.218+0000 7f4097e00640 1 -- 172.21.15.17:0/1506910860 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250369 (secure 0 0 0) 0x7f4088005050 con 0x7f407c0725e0 2024-09-10T23:26:24.224 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:24.225 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f407c0725e0 msgr2=0x7f407c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f407c0725e0 0x7f407c074aa0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f40880af000 tx=0x7f4088019680 comp rx=0 tx=0).stop 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0070ad0 msgr2=0x7f40a0153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0070ad0 0x7f40a0153f30 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f409000d980 tx=0x7f409000de40 comp rx=0 tx=0).stop 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 shutdown_connections 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f407c0725e0 0x7f407c074aa0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40a00d1830 0x7f40a015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f40a00cf320 0x7f40a015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 --2- 172.21.15.17:0/1506910860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0070ad0 0x7f40a0153f30 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 >> 172.21.15.17:0/1506910860 conn(0x7f40a00d1d60 msgr2=0x7f40a00b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:24.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 shutdown_connections 2024-09-10T23:26:24.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.222+0000 7f40a6200640 1 -- 172.21.15.17:0/1506910860 wait complete. 2024-09-10T23:26:24.245 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2024-09-10T23:26:22.448883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":138,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472536,"kb_used_data":16152,"kb_used_omap":12,"kb_used_meta":456179,"kb_avail":754502184,"statfs":{"total":773094113280,"available":772610236416,"internally_reserved":0,"allocated":16539648,"data_stored":8365207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":467127857},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.368981"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.115608+0000","last_change":"2024-09-10T23:26:20.111533+0000","last_active":"2024-09-10T23:26:20.115608+0000","last_peered":"2024-09-10T23:26:20.115608+0000","last_clean":"2024-09-10T23:26:20.115608+0000","last_became_active":"2024-09-10T23:26:20.111248+0000","last_became_peered":"2024-09-10T23:26:20.111248+0000","last_unstale":"2024-09-10T23:26:20.115608+0000","last_undegraded":"2024-09-10T23:26:20.115608+0000","last_fullsized":"2024-09-10T23:26:20.115608+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:21.820064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.115373+0000","last_change":"2024-09-10T23:26:20.108814+0000","last_active":"2024-09-10T23:26:20.115373+0000","last_peered":"2024-09-10T23:26:20.115373+0000","last_clean":"2024-09-10T23:26:20.115373+0000","last_became_active":"2024-09-10T23:26:20.108506+0000","last_became_peered":"2024-09-10T23:26:20.108506+0000","last_unstale":"2024-09-10T23:26:20.115373+0000","last_undegraded":"2024-09-10T23:26:20.115373+0000","last_fullsized":"2024-09-10T23:26:20.115373+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:38.349703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121826+0000","last_change":"2024-09-10T23:26:20.114368+0000","last_active":"2024-09-10T23:26:20.121826+0000","last_peered":"2024-09-10T23:26:20.121826+0000","last_clean":"2024-09-10T23:26:20.121826+0000","last_became_active":"2024-09-10T23:26:20.114102+0000","last_became_peered":"2024-09-10T23:26:20.114102+0000","last_unstale":"2024-09-10T23:26:20.121826+0000","last_undegraded":"2024-09-10T23:26:20.121826+0000","last_fullsized":"2024-09-10T23:26:20.121826+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:37.660143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.118434+0000","last_change":"2024-09-10T23:26:20.116654+0000","last_active":"2024-09-10T23:26:20.118434+0000","last_peered":"2024-09-10T23:26:20.118434+0000","last_clean":"2024-09-10T23:26:20.118434+0000","last_became_active":"2024-09-10T23:26:20.116405+0000","last_became_peered":"2024-09-10T23:26:20.116405+0000","last_unstale":"2024-09-10T23:26:20.118434+0000","last_undegraded":"2024-09-10T23:26:20.118434+0000","last_fullsized":"2024-09-10T23:26:20.118434+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:03.941086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.115357+0000","last_change":"2024-09-10T23:26:20.112324+0000","last_active":"2024-09-10T23:26:20.115357+0000","last_peered":"2024-09-10T23:26:20.115357+0000","last_clean":"2024-09-10T23:26:20.115357+0000","last_became_active":"2024-09-10T23:26:20.112059+0000","last_became_peered":"2024-09-10T23:26:20.112059+0000","last_unstale":"2024-09-10T23:26:20.115357+0000","last_undegraded":"2024-09-10T23:26:20.115357+0000","last_fullsized":"2024-09-10T23:26:20.115357+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:49.745797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.128989+0000","last_change":"2024-09-10T23:26:20.128229+0000","last_active":"2024-09-10T23:26:20.128989+0000","last_peered":"2024-09-10T23:26:20.128989+0000","last_clean":"2024-09-10T23:26:20.128989+0000","last_became_active":"2024-09-10T23:26:20.125850+0000","last_became_peered":"2024-09-10T23:26:20.125850+0000","last_unstale":"2024-09-10T23:26:20.128989+0000","last_undegraded":"2024-09-10T23:26:20.128989+0000","last_fullsized":"2024-09-10T23:26:20.128989+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:20.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121413+0000","last_change":"2024-09-10T23:26:20.115719+0000","last_active":"2024-09-10T23:26:20.121413+0000","last_peered":"2024-09-10T23:26:20.121413+0000","last_clean":"2024-09-10T23:26:20.121413+0000","last_became_active":"2024-09-10T23:26:20.115136+0000","last_became_peered":"2024-09-10T23:26:20.115136+0000","last_unstale":"2024-09-10T23:26:20.121413+0000","last_undegraded":"2024-09-10T23:26:20.121413+0000","last_fullsized":"2024-09-10T23:26:20.121413+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:33.232406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114098+0000","last_change":"2024-09-10T23:26:20.111952+0000","last_active":"2024-09-10T23:26:20.114098+0000","last_peered":"2024-09-10T23:26:20.114098+0000","last_clean":"2024-09-10T23:26:20.114098+0000","last_became_active":"2024-09-10T23:26:20.111637+0000","last_became_peered":"2024-09-10T23:26:20.111637+0000","last_unstale":"2024-09-10T23:26:20.114098+0000","last_undegraded":"2024-09-10T23:26:20.114098+0000","last_fullsized":"2024-09-10T23:26:20.114098+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:31.652409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114328+0000","last_change":"2024-09-10T23:26:20.113241+0000","last_active":"2024-09-10T23:26:20.114328+0000","last_peered":"2024-09-10T23:26:20.114328+0000","last_clean":"2024-09-10T23:26:20.114328+0000","last_became_active":"2024-09-10T23:26:20.112961+0000","last_became_peered":"2024-09-10T23:26:20.112961+0000","last_unstale":"2024-09-10T23:26:20.114328+0000","last_undegraded":"2024-09-10T23:26:20.114328+0000","last_fullsized":"2024-09-10T23:26:20.114328+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:25.017276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116957+0000","last_change":"2024-09-10T23:26:20.107849+0000","last_active":"2024-09-10T23:26:20.116957+0000","last_peered":"2024-09-10T23:26:20.116957+0000","last_clean":"2024-09-10T23:26:20.116957+0000","last_became_active":"2024-09-10T23:26:20.106615+0000","last_became_peered":"2024-09-10T23:26:20.106615+0000","last_unstale":"2024-09-10T23:26:20.116957+0000","last_undegraded":"2024-09-10T23:26:20.116957+0000","last_fullsized":"2024-09-10T23:26:20.116957+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:25.976602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114062+0000","last_change":"2024-09-10T23:26:20.111471+0000","last_active":"2024-09-10T23:26:20.114062+0000","last_peered":"2024-09-10T23:26:20.114062+0000","last_clean":"2024-09-10T23:26:20.114062+0000","last_became_active":"2024-09-10T23:26:20.110793+0000","last_became_peered":"2024-09-10T23:26:20.110793+0000","last_unstale":"2024-09-10T23:26:20.114062+0000","last_undegraded":"2024-09-10T23:26:20.114062+0000","last_fullsized":"2024-09-10T23:26:20.114062+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:58.707289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.118572+0000","last_change":"2024-09-10T23:26:20.108264+0000","last_active":"2024-09-10T23:26:20.118572+0000","last_peered":"2024-09-10T23:26:20.118572+0000","last_clean":"2024-09-10T23:26:20.118572+0000","last_became_active":"2024-09-10T23:26:20.107985+0000","last_became_peered":"2024-09-10T23:26:20.107985+0000","last_unstale":"2024-09-10T23:26:20.118572+0000","last_undegraded":"2024-09-10T23:26:20.118572+0000","last_fullsized":"2024-09-10T23:26:20.118572+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:24.930942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117452+0000","last_change":"2024-09-10T23:26:20.111367+0000","last_active":"2024-09-10T23:26:20.117452+0000","last_peered":"2024-09-10T23:26:20.117452+0000","last_clean":"2024-09-10T23:26:20.117452+0000","last_became_active":"2024-09-10T23:26:20.109272+0000","last_became_peered":"2024-09-10T23:26:20.109272+0000","last_unstale":"2024-09-10T23:26:20.117452+0000","last_undegraded":"2024-09-10T23:26:20.117452+0000","last_fullsized":"2024-09-10T23:26:20.117452+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:02.607337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117603+0000","last_change":"2024-09-10T23:26:20.112254+0000","last_active":"2024-09-10T23:26:20.117603+0000","last_peered":"2024-09-10T23:26:20.117603+0000","last_clean":"2024-09-10T23:26:20.117603+0000","last_became_active":"2024-09-10T23:26:20.111958+0000","last_became_peered":"2024-09-10T23:26:20.111958+0000","last_unstale":"2024-09-10T23:26:20.117603+0000","last_undegraded":"2024-09-10T23:26:20.117603+0000","last_fullsized":"2024-09-10T23:26:20.117603+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:38.294463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122186+0000","last_change":"2024-09-10T23:26:20.116555+0000","last_active":"2024-09-10T23:26:20.122186+0000","last_peered":"2024-09-10T23:26:20.122186+0000","last_clean":"2024-09-10T23:26:20.122186+0000","last_became_active":"2024-09-10T23:26:20.112952+0000","last_became_peered":"2024-09-10T23:26:20.112952+0000","last_unstale":"2024-09-10T23:26:20.122186+0000","last_undegraded":"2024-09-10T23:26:20.122186+0000","last_fullsized":"2024-09-10T23:26:20.122186+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:20.121026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.106165+0000","last_change":"2024-09-10T23:26:20.103949+0000","last_active":"2024-09-10T23:26:20.106165+0000","last_peered":"2024-09-10T23:26:20.106165+0000","last_clean":"2024-09-10T23:26:20.106165+0000","last_became_active":"2024-09-10T23:26:20.103632+0000","last_became_peered":"2024-09-10T23:26:20.103632+0000","last_unstale":"2024-09-10T23:26:20.106165+0000","last_undegraded":"2024-09-10T23:26:20.106165+0000","last_fullsized":"2024-09-10T23:26:20.106165+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:18.879528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121040+0000","last_change":"2024-09-10T23:26:20.113156+0000","last_active":"2024-09-10T23:26:20.121040+0000","last_peered":"2024-09-10T23:26:20.121040+0000","last_clean":"2024-09-10T23:26:20.121040+0000","last_became_active":"2024-09-10T23:26:20.112902+0000","last_became_peered":"2024-09-10T23:26:20.112902+0000","last_unstale":"2024-09-10T23:26:20.121040+0000","last_undegraded":"2024-09-10T23:26:20.121040+0000","last_fullsized":"2024-09-10T23:26:20.121040+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:25.101310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122571+0000","last_change":"2024-09-10T23:26:20.115416+0000","last_active":"2024-09-10T23:26:20.122571+0000","last_peered":"2024-09-10T23:26:20.122571+0000","last_clean":"2024-09-10T23:26:20.122571+0000","last_became_active":"2024-09-10T23:26:20.113018+0000","last_became_peered":"2024-09-10T23:26:20.113018+0000","last_unstale":"2024-09-10T23:26:20.122571+0000","last_undegraded":"2024-09-10T23:26:20.122571+0000","last_fullsized":"2024-09-10T23:26:20.122571+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:02.418465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122256+0000","last_change":"2024-09-10T23:26:20.117324+0000","last_active":"2024-09-10T23:26:20.122256+0000","last_peered":"2024-09-10T23:26:20.122256+0000","last_clean":"2024-09-10T23:26:20.122256+0000","last_became_active":"2024-09-10T23:26:20.116983+0000","last_became_peered":"2024-09-10T23:26:20.116983+0000","last_unstale":"2024-09-10T23:26:20.122256+0000","last_undegraded":"2024-09-10T23:26:20.122256+0000","last_fullsized":"2024-09-10T23:26:20.122256+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:12.013954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.120215+0000","last_change":"2024-09-10T23:26:20.111962+0000","last_active":"2024-09-10T23:26:20.120215+0000","last_peered":"2024-09-10T23:26:20.120215+0000","last_clean":"2024-09-10T23:26:20.120215+0000","last_became_active":"2024-09-10T23:26:20.111605+0000","last_became_peered":"2024-09-10T23:26:20.111605+0000","last_unstale":"2024-09-10T23:26:20.120215+0000","last_undegraded":"2024-09-10T23:26:20.120215+0000","last_fullsized":"2024-09-10T23:26:20.120215+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:51.860308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117440+0000","last_change":"2024-09-10T23:26:20.109612+0000","last_active":"2024-09-10T23:26:20.117440+0000","last_peered":"2024-09-10T23:26:20.117440+0000","last_clean":"2024-09-10T23:26:20.117440+0000","last_became_active":"2024-09-10T23:26:20.109078+0000","last_became_peered":"2024-09-10T23:26:20.109078+0000","last_unstale":"2024-09-10T23:26:20.117440+0000","last_undegraded":"2024-09-10T23:26:20.117440+0000","last_fullsized":"2024-09-10T23:26:20.117440+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:51.114677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121191+0000","last_change":"2024-09-10T23:26:20.114023+0000","last_active":"2024-09-10T23:26:20.121191+0000","last_peered":"2024-09-10T23:26:20.121191+0000","last_clean":"2024-09-10T23:26:20.121191+0000","last_became_active":"2024-09-10T23:26:20.113760+0000","last_became_peered":"2024-09-10T23:26:20.113760+0000","last_unstale":"2024-09-10T23:26:20.121191+0000","last_undegraded":"2024-09-10T23:26:20.121191+0000","last_fullsized":"2024-09-10T23:26:20.121191+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:10.733549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.128706+0000","last_change":"2024-09-10T23:26:20.127891+0000","last_active":"2024-09-10T23:26:20.128706+0000","last_peered":"2024-09-10T23:26:20.128706+0000","last_clean":"2024-09-10T23:26:20.128706+0000","last_became_active":"2024-09-10T23:26:20.127130+0000","last_became_peered":"2024-09-10T23:26:20.127130+0000","last_unstale":"2024-09-10T23:26:20.128706+0000","last_undegraded":"2024-09-10T23:26:20.128706+0000","last_fullsized":"2024-09-10T23:26:20.128706+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:58.755855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114832+0000","last_change":"2024-09-10T23:26:20.106035+0000","last_active":"2024-09-10T23:26:20.114832+0000","last_peered":"2024-09-10T23:26:20.114832+0000","last_clean":"2024-09-10T23:26:20.114832+0000","last_became_active":"2024-09-10T23:26:20.105700+0000","last_became_peered":"2024-09-10T23:26:20.105700+0000","last_unstale":"2024-09-10T23:26:20.114832+0000","last_undegraded":"2024-09-10T23:26:20.114832+0000","last_fullsized":"2024-09-10T23:26:20.114832+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:25.639089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T23:26:18.339129+0000","last_change":"2024-09-10T23:26:18.339129+0000","last_active":"2024-09-10T23:26:18.072391+0000","last_peered":"2024-09-10T23:26:18.072391+0000","last_clean":"2024-09-10T23:26:18.072391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:18.339129+0000","last_undegraded":"2024-09-10T23:26:18.339129+0000","last_fullsized":"2024-09-10T23:26:18.339129+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121943+0000","last_change":"2024-09-10T23:26:20.117928+0000","last_active":"2024-09-10T23:26:20.121943+0000","last_peered":"2024-09-10T23:26:20.121943+0000","last_clean":"2024-09-10T23:26:20.121943+0000","last_became_active":"2024-09-10T23:26:20.117650+0000","last_became_peered":"2024-09-10T23:26:20.117650+0000","last_unstale":"2024-09-10T23:26:20.121943+0000","last_undegraded":"2024-09-10T23:26:20.121943+0000","last_fullsized":"2024-09-10T23:26:20.121943+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:34.971683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"154'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.123701+0000","last_change":"2024-09-10T23:26:19.112335+0000","last_active":"2024-09-10T23:26:20.123701+0000","last_peered":"2024-09-10T23:26:20.123701+0000","last_clean":"2024-09-10T23:26:20.123701+0000","last_became_active":"2024-09-10T23:26:19.112023+0000","last_became_peered":"2024-09-10T23:26:19.112023+0000","last_unstale":"2024-09-10T23:26:20.123701+0000","last_undegraded":"2024-09-10T23:26:20.123701+0000","last_fullsized":"2024-09-10T23:26:20.123701+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:09.282681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.108090+0000","last_change":"2024-09-10T23:26:20.105781+0000","last_active":"2024-09-10T23:26:20.108090+0000","last_peered":"2024-09-10T23:26:20.108090+0000","last_clean":"2024-09-10T23:26:20.108090+0000","last_became_active":"2024-09-10T23:26:20.105504+0000","last_became_peered":"2024-09-10T23:26:20.105504+0000","last_unstale":"2024-09-10T23:26:20.108090+0000","last_undegraded":"2024-09-10T23:26:20.108090+0000","last_fullsized":"2024-09-10T23:26:20.108090+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:56.842610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.124308+0000","last_change":"2024-09-10T23:26:19.112271+0000","last_active":"2024-09-10T23:26:20.124308+0000","last_peered":"2024-09-10T23:26:20.124308+0000","last_clean":"2024-09-10T23:26:20.124308+0000","last_became_active":"2024-09-10T23:26:19.111972+0000","last_became_peered":"2024-09-10T23:26:19.111972+0000","last_unstale":"2024-09-10T23:26:20.124308+0000","last_undegraded":"2024-09-10T23:26:20.124308+0000","last_fullsized":"2024-09-10T23:26:20.124308+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:26.757291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121266+0000","last_change":"2024-09-10T23:26:20.115265+0000","last_active":"2024-09-10T23:26:20.121266+0000","last_peered":"2024-09-10T23:26:20.121266+0000","last_clean":"2024-09-10T23:26:20.121266+0000","last_became_active":"2024-09-10T23:26:20.112159+0000","last_became_peered":"2024-09-10T23:26:20.112159+0000","last_unstale":"2024-09-10T23:26:20.121266+0000","last_undegraded":"2024-09-10T23:26:20.121266+0000","last_fullsized":"2024-09-10T23:26:20.121266+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:51.782425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122951+0000","last_change":"2024-09-10T23:26:19.113508+0000","last_active":"2024-09-10T23:26:20.122951+0000","last_peered":"2024-09-10T23:26:20.122951+0000","last_clean":"2024-09-10T23:26:20.122951+0000","last_became_active":"2024-09-10T23:26:19.113147+0000","last_became_peered":"2024-09-10T23:26:19.113147+0000","last_unstale":"2024-09-10T23:26:20.122951+0000","last_undegraded":"2024-09-10T23:26:20.122951+0000","last_fullsized":"2024-09-10T23:26:20.122951+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:52.300760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.119920+0000","last_change":"2024-09-10T23:26:20.116455+0000","last_active":"2024-09-10T23:26:20.119920+0000","last_peered":"2024-09-10T23:26:20.119920+0000","last_clean":"2024-09-10T23:26:20.119920+0000","last_became_active":"2024-09-10T23:26:20.116134+0000","last_became_peered":"2024-09-10T23:26:20.116134+0000","last_unstale":"2024-09-10T23:26:20.119920+0000","last_undegraded":"2024-09-10T23:26:20.119920+0000","last_fullsized":"2024-09-10T23:26:20.119920+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:29.683324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"154'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.124732+0000","last_change":"2024-09-10T23:26:19.115377+0000","last_active":"2024-09-10T23:26:20.124732+0000","last_peered":"2024-09-10T23:26:20.124732+0000","last_clean":"2024-09-10T23:26:20.124732+0000","last_became_active":"2024-09-10T23:26:19.115096+0000","last_became_peered":"2024-09-10T23:26:19.115096+0000","last_unstale":"2024-09-10T23:26:20.124732+0000","last_undegraded":"2024-09-10T23:26:20.124732+0000","last_fullsized":"2024-09-10T23:26:20.124732+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:29.172262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114046+0000","last_change":"2024-09-10T23:26:20.110971+0000","last_active":"2024-09-10T23:26:20.114046+0000","last_peered":"2024-09-10T23:26:20.114046+0000","last_clean":"2024-09-10T23:26:20.114046+0000","last_became_active":"2024-09-10T23:26:20.109868+0000","last_became_peered":"2024-09-10T23:26:20.109868+0000","last_unstale":"2024-09-10T23:26:20.114046+0000","last_undegraded":"2024-09-10T23:26:20.114046+0000","last_fullsized":"2024-09-10T23:26:20.114046+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:39.450715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T23:26:18.339093+0000","last_change":"2024-09-10T23:26:18.339093+0000","last_active":"2024-09-10T23:26:18.072391+0000","last_peered":"2024-09-10T23:26:18.072391+0000","last_clean":"2024-09-10T23:26:18.072391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:18.339093+0000","last_undegraded":"2024-09-10T23:26:18.339093+0000","last_fullsized":"2024-09-10T23:26:18.339093+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114721+0000","last_change":"2024-09-10T23:26:20.106716+0000","last_active":"2024-09-10T23:26:20.114721+0000","last_peered":"2024-09-10T23:26:20.114721+0000","last_clean":"2024-09-10T23:26:20.114721+0000","last_became_active":"2024-09-10T23:26:20.106378+0000","last_became_peered":"2024-09-10T23:26:20.106378+0000","last_unstale":"2024-09-10T23:26:20.114721+0000","last_undegraded":"2024-09-10T23:26:20.114721+0000","last_fullsized":"2024-09-10T23:26:20.114721+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:11.093802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.098843+0000","last_change":"2024-09-10T23:26:19.107769+0000","last_active":"2024-09-10T23:26:20.098843+0000","last_peered":"2024-09-10T23:26:20.098843+0000","last_clean":"2024-09-10T23:26:20.098843+0000","last_became_active":"2024-09-10T23:26:19.106325+0000","last_became_peered":"2024-09-10T23:26:19.106325+0000","last_unstale":"2024-09-10T23:26:20.098843+0000","last_undegraded":"2024-09-10T23:26:20.098843+0000","last_fullsized":"2024-09-10T23:26:20.098843+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:56.437615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116117+0000","last_change":"2024-09-10T23:26:20.110671+0000","last_active":"2024-09-10T23:26:20.116117+0000","last_peered":"2024-09-10T23:26:20.116117+0000","last_clean":"2024-09-10T23:26:20.116117+0000","last_became_active":"2024-09-10T23:26:20.110398+0000","last_became_peered":"2024-09-10T23:26:20.110398+0000","last_unstale":"2024-09-10T23:26:20.116117+0000","last_undegraded":"2024-09-10T23:26:20.116117+0000","last_fullsized":"2024-09-10T23:26:20.116117+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:34.185272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T23:26:18.339093+0000","last_change":"2024-09-10T23:26:18.339093+0000","last_active":"2024-09-10T23:26:18.072391+0000","last_peered":"2024-09-10T23:26:18.072391+0000","last_clean":"2024-09-10T23:26:18.072391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:18.339093+0000","last_undegraded":"2024-09-10T23:26:18.339093+0000","last_fullsized":"2024-09-10T23:26:18.339093+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.126883+0000","last_change":"2024-09-10T23:26:20.125273+0000","last_active":"2024-09-10T23:26:20.126883+0000","last_peered":"2024-09-10T23:26:20.126883+0000","last_clean":"2024-09-10T23:26:20.126883+0000","last_became_active":"2024-09-10T23:26:20.114737+0000","last_became_peered":"2024-09-10T23:26:20.114737+0000","last_unstale":"2024-09-10T23:26:20.126883+0000","last_undegraded":"2024-09-10T23:26:20.126883+0000","last_fullsized":"2024-09-10T23:26:20.126883+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:53.303852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.097000+0000","last_change":"2024-09-10T23:26:19.109024+0000","last_active":"2024-09-10T23:26:20.097000+0000","last_peered":"2024-09-10T23:26:20.097000+0000","last_clean":"2024-09-10T23:26:20.097000+0000","last_became_active":"2024-09-10T23:26:19.108767+0000","last_became_peered":"2024-09-10T23:26:19.108767+0000","last_unstale":"2024-09-10T23:26:20.097000+0000","last_undegraded":"2024-09-10T23:26:20.097000+0000","last_fullsized":"2024-09-10T23:26:20.097000+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:10.547141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121381+0000","last_change":"2024-09-10T23:26:20.115612+0000","last_active":"2024-09-10T23:26:20.121381+0000","last_peered":"2024-09-10T23:26:20.121381+0000","last_clean":"2024-09-10T23:26:20.121381+0000","last_became_active":"2024-09-10T23:26:20.115234+0000","last_became_peered":"2024-09-10T23:26:20.115234+0000","last_unstale":"2024-09-10T23:26:20.121381+0000","last_undegraded":"2024-09-10T23:26:20.121381+0000","last_fullsized":"2024-09-10T23:26:20.121381+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:58.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.099985+0000","last_change":"2024-09-10T23:26:19.108333+0000","last_active":"2024-09-10T23:26:20.099985+0000","last_peered":"2024-09-10T23:26:20.099985+0000","last_clean":"2024-09-10T23:26:20.099985+0000","last_became_active":"2024-09-10T23:26:19.107083+0000","last_became_peered":"2024-09-10T23:26:19.107083+0000","last_unstale":"2024-09-10T23:26:20.099985+0000","last_undegraded":"2024-09-10T23:26:20.099985+0000","last_fullsized":"2024-09-10T23:26:20.099985+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:52.997711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.118607+0000","last_change":"2024-09-10T23:26:20.110810+0000","last_active":"2024-09-10T23:26:20.118607+0000","last_peered":"2024-09-10T23:26:20.118607+0000","last_clean":"2024-09-10T23:26:20.118607+0000","last_became_active":"2024-09-10T23:26:20.110482+0000","last_became_peered":"2024-09-10T23:26:20.110482+0000","last_unstale":"2024-09-10T23:26:20.118607+0000","last_undegraded":"2024-09-10T23:26:20.118607+0000","last_fullsized":"2024-09-10T23:26:20.118607+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:23.289307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"154'3","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122836+0000","last_change":"2024-09-10T23:26:19.095015+0000","last_active":"2024-09-10T23:26:20.122836+0000","last_peered":"2024-09-10T23:26:20.122836+0000","last_clean":"2024-09-10T23:26:20.122836+0000","last_became_active":"2024-09-10T23:26:19.094127+0000","last_became_peered":"2024-09-10T23:26:19.094127+0000","last_unstale":"2024-09-10T23:26:20.122836+0000","last_undegraded":"2024-09-10T23:26:20.122836+0000","last_fullsized":"2024-09-10T23:26:20.122836+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:28.243999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117498+0000","last_change":"2024-09-10T23:26:20.109684+0000","last_active":"2024-09-10T23:26:20.117498+0000","last_peered":"2024-09-10T23:26:20.117498+0000","last_clean":"2024-09-10T23:26:20.117498+0000","last_became_active":"2024-09-10T23:26:20.109380+0000","last_became_peered":"2024-09-10T23:26:20.109380+0000","last_unstale":"2024-09-10T23:26:20.117498+0000","last_undegraded":"2024-09-10T23:26:20.117498+0000","last_fullsized":"2024-09-10T23:26:20.117498+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:15.600613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T23:26:18.339041+0000","last_change":"2024-09-10T23:26:18.339041+0000","last_active":"2024-09-10T23:26:18.072391+0000","last_peered":"2024-09-10T23:26:18.072391+0000","last_clean":"2024-09-10T23:26:18.072391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:18.339041+0000","last_undegraded":"2024-09-10T23:26:18.339041+0000","last_fullsized":"2024-09-10T23:26:18.339041+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116978+0000","last_change":"2024-09-10T23:26:20.108164+0000","last_active":"2024-09-10T23:26:20.116978+0000","last_peered":"2024-09-10T23:26:20.116978+0000","last_clean":"2024-09-10T23:26:20.116978+0000","last_became_active":"2024-09-10T23:26:20.107665+0000","last_became_peered":"2024-09-10T23:26:20.107665+0000","last_unstale":"2024-09-10T23:26:20.116978+0000","last_undegraded":"2024-09-10T23:26:20.116978+0000","last_fullsized":"2024-09-10T23:26:20.116978+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:16.233677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.096810+0000","last_change":"2024-09-10T23:26:19.115454+0000","last_active":"2024-09-10T23:26:20.096810+0000","last_peered":"2024-09-10T23:26:20.096810+0000","last_clean":"2024-09-10T23:26:20.096810+0000","last_became_active":"2024-09-10T23:26:19.115157+0000","last_became_peered":"2024-09-10T23:26:19.115157+0000","last_unstale":"2024-09-10T23:26:20.096810+0000","last_undegraded":"2024-09-10T23:26:20.096810+0000","last_fullsized":"2024-09-10T23:26:20.096810+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:59.043292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.096489+0000","last_change":"2024-09-10T23:26:19.106866+0000","last_active":"2024-09-10T23:26:20.096489+0000","last_peered":"2024-09-10T23:26:20.096489+0000","last_clean":"2024-09-10T23:26:20.096489+0000","last_became_active":"2024-09-10T23:26:19.106113+0000","last_became_peered":"2024-09-10T23:26:19.106113+0000","last_unstale":"2024-09-10T23:26:20.096489+0000","last_undegraded":"2024-09-10T23:26:20.096489+0000","last_fullsized":"2024-09-10T23:26:20.096489+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:29.951907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121616+0000","last_change":"2024-09-10T23:26:20.118268+0000","last_active":"2024-09-10T23:26:20.121616+0000","last_peered":"2024-09-10T23:26:20.121616+0000","last_clean":"2024-09-10T23:26:20.121616+0000","last_became_active":"2024-09-10T23:26:20.117917+0000","last_became_peered":"2024-09-10T23:26:20.117917+0000","last_unstale":"2024-09-10T23:26:20.121616+0000","last_undegraded":"2024-09-10T23:26:20.121616+0000","last_fullsized":"2024-09-10T23:26:20.121616+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:16.937180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"154'8","reported_seq":21,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.128837+0000","last_change":"2024-09-10T23:26:19.115170+0000","last_active":"2024-09-10T23:26:20.128837+0000","last_peered":"2024-09-10T23:26:20.128837+0000","last_clean":"2024-09-10T23:26:20.128837+0000","last_became_active":"2024-09-10T23:26:19.114902+0000","last_became_peered":"2024-09-10T23:26:19.114902+0000","last_unstale":"2024-09-10T23:26:20.128837+0000","last_undegraded":"2024-09-10T23:26:20.128837+0000","last_fullsized":"2024-09-10T23:26:20.128837+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:24.777555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.123002+0000","last_change":"2024-09-10T23:26:20.115607+0000","last_active":"2024-09-10T23:26:20.123002+0000","last_peered":"2024-09-10T23:26:20.123002+0000","last_clean":"2024-09-10T23:26:20.123002+0000","last_became_active":"2024-09-10T23:26:20.113057+0000","last_became_peered":"2024-09-10T23:26:20.113057+0000","last_unstale":"2024-09-10T23:26:20.123002+0000","last_undegraded":"2024-09-10T23:26:20.123002+0000","last_fullsized":"2024-09-10T23:26:20.123002+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:47.127350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"154'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121062+0000","last_change":"2024-09-10T23:26:19.101070+0000","last_active":"2024-09-10T23:26:20.121062+0000","last_peered":"2024-09-10T23:26:20.121062+0000","last_clean":"2024-09-10T23:26:20.121062+0000","last_became_active":"2024-09-10T23:26:19.100796+0000","last_became_peered":"2024-09-10T23:26:19.100796+0000","last_unstale":"2024-09-10T23:26:20.121062+0000","last_undegraded":"2024-09-10T23:26:20.121062+0000","last_fullsized":"2024-09-10T23:26:20.121062+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:21:59.492910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117907+0000","last_change":"2024-09-10T23:26:20.112434+0000","last_active":"2024-09-10T23:26:20.117907+0000","last_peered":"2024-09-10T23:26:20.117907+0000","last_clean":"2024-09-10T23:26:20.117907+0000","last_became_active":"2024-09-10T23:26:20.112116+0000","last_became_peered":"2024-09-10T23:26:20.112116+0000","last_unstale":"2024-09-10T23:26:20.117907+0000","last_undegraded":"2024-09-10T23:26:20.117907+0000","last_fullsized":"2024-09-10T23:26:20.117907+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:17.193361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.126542+0000","last_change":"2024-09-10T23:26:19.108057+0000","last_active":"2024-09-10T23:26:20.126542+0000","last_peered":"2024-09-10T23:26:20.126542+0000","last_clean":"2024-09-10T23:26:20.126542+0000","last_became_active":"2024-09-10T23:26:19.107780+0000","last_became_peered":"2024-09-10T23:26:19.107780+0000","last_unstale":"2024-09-10T23:26:20.126542+0000","last_undegraded":"2024-09-10T23:26:20.126542+0000","last_fullsized":"2024-09-10T23:26:20.126542+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:25.368770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.119109+0000","last_change":"2024-09-10T23:26:20.114954+0000","last_active":"2024-09-10T23:26:20.119109+0000","last_peered":"2024-09-10T23:26:20.119109+0000","last_clean":"2024-09-10T23:26:20.119109+0000","last_became_active":"2024-09-10T23:26:20.114608+0000","last_became_peered":"2024-09-10T23:26:20.114608+0000","last_unstale":"2024-09-10T23:26:20.119109+0000","last_undegraded":"2024-09-10T23:26:20.119109+0000","last_fullsized":"2024-09-10T23:26:20.119109+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:21.057171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"154'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122293+0000","last_change":"2024-09-10T23:26:19.106301+0000","last_active":"2024-09-10T23:26:20.122293+0000","last_peered":"2024-09-10T23:26:20.122293+0000","last_clean":"2024-09-10T23:26:20.122293+0000","last_became_active":"2024-09-10T23:26:19.105964+0000","last_became_peered":"2024-09-10T23:26:19.105964+0000","last_unstale":"2024-09-10T23:26:20.122293+0000","last_undegraded":"2024-09-10T23:26:20.122293+0000","last_fullsized":"2024-09-10T23:26:20.122293+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:57.752763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.111732+0000","last_change":"2024-09-10T23:26:20.104142+0000","last_active":"2024-09-10T23:26:20.111732+0000","last_peered":"2024-09-10T23:26:20.111732+0000","last_clean":"2024-09-10T23:26:20.111732+0000","last_became_active":"2024-09-10T23:26:20.103759+0000","last_became_peered":"2024-09-10T23:26:20.103759+0000","last_unstale":"2024-09-10T23:26:20.111732+0000","last_undegraded":"2024-09-10T23:26:20.111732+0000","last_fullsized":"2024-09-10T23:26:20.111732+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:10.388875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.098339+0000","last_change":"2024-09-10T23:26:19.117612+0000","last_active":"2024-09-10T23:26:20.098339+0000","last_peered":"2024-09-10T23:26:20.098339+0000","last_clean":"2024-09-10T23:26:20.098339+0000","last_became_active":"2024-09-10T23:26:19.117317+0000","last_became_peered":"2024-09-10T23:26:19.117317+0000","last_unstale":"2024-09-10T23:26:20.098339+0000","last_undegraded":"2024-09-10T23:26:20.098339+0000","last_fullsized":"2024-09-10T23:26:20.098339+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:24.620696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117860+0000","last_change":"2024-09-10T23:26:20.111945+0000","last_active":"2024-09-10T23:26:20.117860+0000","last_peered":"2024-09-10T23:26:20.117860+0000","last_clean":"2024-09-10T23:26:20.117860+0000","last_became_active":"2024-09-10T23:26:20.109315+0000","last_became_peered":"2024-09-10T23:26:20.109315+0000","last_unstale":"2024-09-10T23:26:20.117860+0000","last_undegraded":"2024-09-10T23:26:20.117860+0000","last_fullsized":"2024-09-10T23:26:20.117860+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:35.575616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.124398+0000","last_change":"2024-09-10T23:26:19.116075+0000","last_active":"2024-09-10T23:26:20.124398+0000","last_peered":"2024-09-10T23:26:20.124398+0000","last_clean":"2024-09-10T23:26:20.124398+0000","last_became_active":"2024-09-10T23:26:19.115814+0000","last_became_peered":"2024-09-10T23:26:19.115814+0000","last_unstale":"2024-09-10T23:26:20.124398+0000","last_undegraded":"2024-09-10T23:26:20.124398+0000","last_fullsized":"2024-09-10T23:26:20.124398+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:20.521768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116931+0000","last_change":"2024-09-10T23:26:20.101807+0000","last_active":"2024-09-10T23:26:20.116931+0000","last_peered":"2024-09-10T23:26:20.116931+0000","last_clean":"2024-09-10T23:26:20.116931+0000","last_became_active":"2024-09-10T23:26:20.101515+0000","last_became_peered":"2024-09-10T23:26:20.101515+0000","last_unstale":"2024-09-10T23:26:20.116931+0000","last_undegraded":"2024-09-10T23:26:20.116931+0000","last_fullsized":"2024-09-10T23:26:20.116931+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:36.873787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.093090+0000","last_change":"2024-09-10T23:26:19.114516+0000","last_active":"2024-09-10T23:26:20.093090+0000","last_peered":"2024-09-10T23:26:20.093090+0000","last_clean":"2024-09-10T23:26:20.093090+0000","last_became_active":"2024-09-10T23:26:19.114244+0000","last_became_peered":"2024-09-10T23:26:19.114244+0000","last_unstale":"2024-09-10T23:26:20.093090+0000","last_undegraded":"2024-09-10T23:26:20.093090+0000","last_fullsized":"2024-09-10T23:26:20.093090+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:29:11.422625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.125500+0000","last_change":"2024-09-10T23:26:20.122081+0000","last_active":"2024-09-10T23:26:20.125500+0000","last_peered":"2024-09-10T23:26:20.125500+0000","last_clean":"2024-09-10T23:26:20.125500+0000","last_became_active":"2024-09-10T23:26:20.121822+0000","last_became_peered":"2024-09-10T23:26:20.121822+0000","last_unstale":"2024-09-10T23:26:20.125500+0000","last_undegraded":"2024-09-10T23:26:20.125500+0000","last_fullsized":"2024-09-10T23:26:20.125500+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:41.420802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.087234+0000","last_change":"2024-09-10T23:26:19.112186+0000","last_active":"2024-09-10T23:26:20.087234+0000","last_peered":"2024-09-10T23:26:20.087234+0000","last_clean":"2024-09-10T23:26:20.087234+0000","last_became_active":"2024-09-10T23:26:19.111893+0000","last_became_peered":"2024-09-10T23:26:19.111893+0000","last_unstale":"2024-09-10T23:26:20.087234+0000","last_undegraded":"2024-09-10T23:26:20.087234+0000","last_fullsized":"2024-09-10T23:26:20.087234+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:39.129490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114772+0000","last_change":"2024-09-10T23:26:20.104913+0000","last_active":"2024-09-10T23:26:20.114772+0000","last_peered":"2024-09-10T23:26:20.114772+0000","last_clean":"2024-09-10T23:26:20.114772+0000","last_became_active":"2024-09-10T23:26:20.104611+0000","last_became_peered":"2024-09-10T23:26:20.104611+0000","last_unstale":"2024-09-10T23:26:20.114772+0000","last_undegraded":"2024-09-10T23:26:20.114772+0000","last_fullsized":"2024-09-10T23:26:20.114772+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:04.090474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.093234+0000","last_change":"2024-09-10T23:26:19.116276+0000","last_active":"2024-09-10T23:26:20.093234+0000","last_peered":"2024-09-10T23:26:20.093234+0000","last_clean":"2024-09-10T23:26:20.093234+0000","last_became_active":"2024-09-10T23:26:19.115847+0000","last_became_peered":"2024-09-10T23:26:19.115847+0000","last_unstale":"2024-09-10T23:26:20.093234+0000","last_undegraded":"2024-09-10T23:26:20.093234+0000","last_fullsized":"2024-09-10T23:26:20.093234+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:39.453738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.127795+0000","last_change":"2024-09-10T23:26:19.118609+0000","last_active":"2024-09-10T23:26:20.127795+0000","last_peered":"2024-09-10T23:26:20.127795+0000","last_clean":"2024-09-10T23:26:20.127795+0000","last_became_active":"2024-09-10T23:26:19.117719+0000","last_became_peered":"2024-09-10T23:26:19.117719+0000","last_unstale":"2024-09-10T23:26:20.127795+0000","last_undegraded":"2024-09-10T23:26:20.127795+0000","last_fullsized":"2024-09-10T23:26:20.127795+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.404548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116348+0000","last_change":"2024-09-10T23:26:20.113952+0000","last_active":"2024-09-10T23:26:20.116348+0000","last_peered":"2024-09-10T23:26:20.116348+0000","last_clean":"2024-09-10T23:26:20.116348+0000","last_became_active":"2024-09-10T23:26:20.113353+0000","last_became_peered":"2024-09-10T23:26:20.113353+0000","last_unstale":"2024-09-10T23:26:20.116348+0000","last_undegraded":"2024-09-10T23:26:20.116348+0000","last_fullsized":"2024-09-10T23:26:20.116348+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:30.174518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.099741+0000","last_change":"2024-09-10T23:26:19.114310+0000","last_active":"2024-09-10T23:26:20.099741+0000","last_peered":"2024-09-10T23:26:20.099741+0000","last_clean":"2024-09-10T23:26:20.099741+0000","last_became_active":"2024-09-10T23:26:19.114028+0000","last_became_peered":"2024-09-10T23:26:19.114028+0000","last_unstale":"2024-09-10T23:26:20.099741+0000","last_undegraded":"2024-09-10T23:26:20.099741+0000","last_fullsized":"2024-09-10T23:26:20.099741+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:19.008053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.115647+0000","last_change":"2024-09-10T23:26:20.110854+0000","last_active":"2024-09-10T23:26:20.115647+0000","last_peered":"2024-09-10T23:26:20.115647+0000","last_clean":"2024-09-10T23:26:20.115647+0000","last_became_active":"2024-09-10T23:26:20.110591+0000","last_became_peered":"2024-09-10T23:26:20.110591+0000","last_unstale":"2024-09-10T23:26:20.115647+0000","last_undegraded":"2024-09-10T23:26:20.115647+0000","last_fullsized":"2024-09-10T23:26:20.115647+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:33:21.001588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.100187+0000","last_change":"2024-09-10T23:26:19.107560+0000","last_active":"2024-09-10T23:26:20.100187+0000","last_peered":"2024-09-10T23:26:20.100187+0000","last_clean":"2024-09-10T23:26:20.100187+0000","last_became_active":"2024-09-10T23:26:19.107304+0000","last_became_peered":"2024-09-10T23:26:19.107304+0000","last_unstale":"2024-09-10T23:26:20.100187+0000","last_undegraded":"2024-09-10T23:26:20.100187+0000","last_fullsized":"2024-09-10T23:26:20.100187+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:19.038967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:26:19.075484+0000","last_change":"2024-09-10T23:26:19.075484+0000","last_active":"2024-09-10T23:26:19.075484+0000","last_peered":"2024-09-10T23:26:19.075484+0000","last_clean":"2024-09-10T23:26:19.075484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:19.075484+0000","last_undegraded":"2024-09-10T23:26:19.075484+0000","last_fullsized":"2024-09-10T23:26:19.075484+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-10T23:26:18.339115+0000","last_change":"2024-09-10T23:26:18.339115+0000","last_active":"2024-09-10T23:26:18.072391+0000","last_peered":"2024-09-10T23:26:18.072391+0000","last_clean":"2024-09-10T23:26:18.072391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:26:18.339115+0000","last_undegraded":"2024-09-10T23:26:18.339115+0000","last_fullsized":"2024-09-10T23:26:18.339115+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.105785+0000","last_change":"2024-09-10T23:26:20.102689+0000","last_active":"2024-09-10T23:26:20.105785+0000","last_peered":"2024-09-10T23:26:20.105785+0000","last_clean":"2024-09-10T23:26:20.105785+0000","last_became_active":"2024-09-10T23:26:20.102427+0000","last_became_peered":"2024-09-10T23:26:20.102427+0000","last_unstale":"2024-09-10T23:26:20.105785+0000","last_undegraded":"2024-09-10T23:26:20.105785+0000","last_fullsized":"2024-09-10T23:26:20.105785+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:27.992848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.099361+0000","last_change":"2024-09-10T23:26:19.111103+0000","last_active":"2024-09-10T23:26:20.099361+0000","last_peered":"2024-09-10T23:26:20.099361+0000","last_clean":"2024-09-10T23:26:20.099361+0000","last_became_active":"2024-09-10T23:26:19.110674+0000","last_became_peered":"2024-09-10T23:26:19.110674+0000","last_unstale":"2024-09-10T23:26:20.099361+0000","last_undegraded":"2024-09-10T23:26:20.099361+0000","last_fullsized":"2024-09-10T23:26:20.099361+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:35.735847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.120967+0000","last_change":"2024-09-10T23:26:20.119802+0000","last_active":"2024-09-10T23:26:20.120967+0000","last_peered":"2024-09-10T23:26:20.120967+0000","last_clean":"2024-09-10T23:26:20.120967+0000","last_became_active":"2024-09-10T23:26:20.118764+0000","last_became_peered":"2024-09-10T23:26:20.118764+0000","last_unstale":"2024-09-10T23:26:20.120967+0000","last_undegraded":"2024-09-10T23:26:20.120967+0000","last_fullsized":"2024-09-10T23:26:20.120967+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:57.440708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.097225+0000","last_change":"2024-09-10T23:26:19.112503+0000","last_active":"2024-09-10T23:26:20.097225+0000","last_peered":"2024-09-10T23:26:20.097225+0000","last_clean":"2024-09-10T23:26:20.097225+0000","last_became_active":"2024-09-10T23:26:19.112187+0000","last_became_peered":"2024-09-10T23:26:19.112187+0000","last_unstale":"2024-09-10T23:26:20.097225+0000","last_undegraded":"2024-09-10T23:26:20.097225+0000","last_fullsized":"2024-09-10T23:26:20.097225+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:33.745925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114694+0000","last_change":"2024-09-10T23:26:20.105065+0000","last_active":"2024-09-10T23:26:20.114694+0000","last_peered":"2024-09-10T23:26:20.114694+0000","last_clean":"2024-09-10T23:26:20.114694+0000","last_became_active":"2024-09-10T23:26:20.104501+0000","last_became_peered":"2024-09-10T23:26:20.104501+0000","last_unstale":"2024-09-10T23:26:20.114694+0000","last_undegraded":"2024-09-10T23:26:20.114694+0000","last_fullsized":"2024-09-10T23:26:20.114694+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:33.318408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.099050+0000","last_change":"2024-09-10T23:26:19.106668+0000","last_active":"2024-09-10T23:26:20.099050+0000","last_peered":"2024-09-10T23:26:20.099050+0000","last_clean":"2024-09-10T23:26:20.099050+0000","last_became_active":"2024-09-10T23:26:19.106357+0000","last_became_peered":"2024-09-10T23:26:19.106357+0000","last_unstale":"2024-09-10T23:26:20.099050+0000","last_undegraded":"2024-09-10T23:26:20.099050+0000","last_fullsized":"2024-09-10T23:26:20.099050+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:53.696662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117468+0000","last_change":"2024-09-10T23:26:20.113990+0000","last_active":"2024-09-10T23:26:20.117468+0000","last_peered":"2024-09-10T23:26:20.117468+0000","last_clean":"2024-09-10T23:26:20.117468+0000","last_became_active":"2024-09-10T23:26:20.109743+0000","last_became_peered":"2024-09-10T23:26:20.109743+0000","last_unstale":"2024-09-10T23:26:20.117468+0000","last_undegraded":"2024-09-10T23:26:20.117468+0000","last_fullsized":"2024-09-10T23:26:20.117468+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:05.105409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.097283+0000","last_change":"2024-09-10T23:26:19.108524+0000","last_active":"2024-09-10T23:26:20.097283+0000","last_peered":"2024-09-10T23:26:20.097283+0000","last_clean":"2024-09-10T23:26:20.097283+0000","last_became_active":"2024-09-10T23:26:19.108248+0000","last_became_peered":"2024-09-10T23:26:19.108248+0000","last_unstale":"2024-09-10T23:26:20.097283+0000","last_undegraded":"2024-09-10T23:26:20.097283+0000","last_fullsized":"2024-09-10T23:26:20.097283+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:41.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.124437+0000","last_change":"2024-09-10T23:26:20.117626+0000","last_active":"2024-09-10T23:26:20.124437+0000","last_peered":"2024-09-10T23:26:20.124437+0000","last_clean":"2024-09-10T23:26:20.124437+0000","last_became_active":"2024-09-10T23:26:20.115685+0000","last_became_peered":"2024-09-10T23:26:20.115685+0000","last_unstale":"2024-09-10T23:26:20.124437+0000","last_undegraded":"2024-09-10T23:26:20.124437+0000","last_fullsized":"2024-09-10T23:26:20.124437+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:23.958388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"154'6","reported_seq":19,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.127265+0000","last_change":"2024-09-10T23:26:19.112195+0000","last_active":"2024-09-10T23:26:20.127265+0000","last_peered":"2024-09-10T23:26:20.127265+0000","last_clean":"2024-09-10T23:26:20.127265+0000","last_became_active":"2024-09-10T23:26:19.111887+0000","last_became_peered":"2024-09-10T23:26:19.111887+0000","last_unstale":"2024-09-10T23:26:20.127265+0000","last_undegraded":"2024-09-10T23:26:20.127265+0000","last_fullsized":"2024-09-10T23:26:20.127265+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:33:43.915143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":348,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.097271+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:26:20.097271+0000","last_peered":"2024-09-10T23:26:20.097271+0000","last_clean":"2024-09-10T23:26:20.097271+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:26:20.097271+0000","last_undegraded":"2024-09-10T23:26:20.097271+0000","last_fullsized":"2024-09-10T23:26:20.097271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":7},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46964,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324876,"statfs":{"total":96636764160,"available":96588673024,"internally_reserved":0,"allocated":1925120,"data_stored":902102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509575,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47540,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324300,"statfs":{"total":96636764160,"available":96588083200,"internally_reserved":0,"allocated":2519040,"data_stored":1492422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59420,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312420,"statfs":{"total":96636764160,"available":96575918080,"internally_reserved":0,"allocated":1908736,"data_stored":894865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69152,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302688,"statfs":{"total":96636764160,"available":96565952512,"internally_reserved":0,"allocated":1908736,"data_stored":894865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509574,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69176,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302664,"statfs":{"total":96636764160,"available":96565927936,"internally_reserved":0,"allocated":1929216,"data_stored":902144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509575,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59436,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312404,"statfs":{"total":96636764160,"available":96575901696,"internally_reserved":0,"allocated":1925120,"data_stored":902102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509574,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73924,"kb_used_data":2480,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297916,"statfs":{"total":96636764160,"available":96561065984,"internally_reserved":0,"allocated":2539520,"data_stored":1494718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46924,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324916,"statfs":{"total":96636764160,"available":96588713984,"internally_reserved":0,"allocated":1884160,"data_stored":881989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:26:24.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:26:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 -- 172.21.15.17:0/1330443072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 msgr2=0x7ffb680cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/1330443072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 0x7ffb680cfc60 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7ffb680d2e60 tx=0x7ffb6001cd80 comp rx=0 tx=0).stop 2024-09-10T23:26:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 -- 172.21.15.17:0/1330443072 shutdown_connections 2024-09-10T23:26:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/1330443072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 0x7ffb680cfc60 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/1330443072 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb680d1830 0x7ffb6815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/1330443072 >> v2:172.21.15.77:3300/0 conn(0x7ffb68070ad0 0x7ffb6815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 -- 172.21.15.17:0/1330443072 >> 172.21.15.17:0/1330443072 conn(0x7ffb680d1d60 msgr2=0x7ffb680d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 -- 172.21.15.17:0/1330443072 shutdown_connections 2024-09-10T23:26:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 -- 172.21.15.17:0/1330443072 wait complete. 2024-09-10T23:26:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 Processor -- start 2024-09-10T23:26:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.430+0000 7ffb6ee00640 1 -- start start 2024-09-10T23:26:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb68070ad0 0x7ffb6814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 0x7ffb68157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb680d1830 0x7ffb680b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680cd2f0 con 0x7ffb680cf320 2024-09-10T23:26:24.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680cd170 con 0x7ffb680d1830 2024-09-10T23:26:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffb680cd470 con 0x7ffb68070ad0 2024-09-10T23:26:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 0x7ffb68157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 0x7ffb68157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33742/0 (socket says 172.21.15.17:33742) 2024-09-10T23:26:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67400640 1 -- 172.21.15.17:0/3847157982 learned_addr learned my addr 172.21.15.17:0/3847157982 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67e00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb68070ad0 0x7ffb6814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ce00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb680d1830 0x7ffb680b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67400640 1 -- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb68070ad0 msgr2=0x7ffb6814fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67400640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb68070ad0 0x7ffb6814fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67400640 1 -- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb680d1830 msgr2=0x7ffb680b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67400640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb680d1830 0x7ffb680b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67400640 1 -- 172.21.15.17:0/3847157982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb68150000 con 0x7ffb680cf320 2024-09-10T23:26:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb67400640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 0x7ffb68157730 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400c9f0 tx=0x7ffb5400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb5fe00640 1 -- 172.21.15.17:0/3847157982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54007bb0 con 0x7ffb680cf320 2024-09-10T23:26:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb5fe00640 1 -- 172.21.15.17:0/3847157982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb54007e40 con 0x7ffb680cf320 2024-09-10T23:26:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb5fe00640 1 -- 172.21.15.17:0/3847157982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400f690 con 0x7ffb680cf320 2024-09-10T23:26:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb680afc90 con 0x7ffb680cf320 2024-09-10T23:26:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb68158980 con 0x7ffb680cf320 2024-09-10T23:26:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb680cfc60 con 0x7ffb680cf320 2024-09-10T23:26:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.434+0000 7ffb5fe00640 1 -- 172.21.15.17:0/3847157982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffb54020030 con 0x7ffb680cf320 2024-09-10T23:26:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.438+0000 7ffb5fe00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb480725e0 0x7ffb48074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.438+0000 7ffb5fe00640 1 -- 172.21.15.17:0/3847157982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7ffb540937c0 con 0x7ffb680cf320 2024-09-10T23:26:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.438+0000 7ffb67e00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb480725e0 0x7ffb48074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.438+0000 7ffb67e00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb480725e0 0x7ffb48074aa0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ffb58005fd0 tx=0x7ffb5800a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:24.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.442+0000 7ffb5fe00640 1 -- 172.21.15.17:0/3847157982 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ffb54014030 con 0x7ffb680cf320 2024-09-10T23:26:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.614+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb68159ab0 con 0x7ffb480725e0 2024-09-10T23:26:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.618+0000 7ffb5fe00640 1 -- 172.21.15.17:0/3847157982 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252468 (secure 0 0 0) 0x7ffb68159ab0 con 0x7ffb480725e0 2024-09-10T23:26:24.624 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:26:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb480725e0 msgr2=0x7ffb48074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb480725e0 0x7ffb48074aa0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ffb58005fd0 tx=0x7ffb5800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 msgr2=0x7ffb68157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 0x7ffb68157730 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400c9f0 tx=0x7ffb5400ceb0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 shutdown_connections 2024-09-10T23:26:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb480725e0 0x7ffb48074aa0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb680d1830 0x7ffb680b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb680cf320 0x7ffb68157730 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 --2- 172.21.15.17:0/3847157982 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb68070ad0 0x7ffb6814fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 >> 172.21.15.17:0/3847157982 conn(0x7ffb680d1d60 msgr2=0x7ffb680b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 shutdown_connections 2024-09-10T23:26:24.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.622+0000 7ffb6ee00640 1 -- 172.21.15.17:0/3847157982 wait complete. 2024-09-10T23:26:24.643 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":479,"stamp":"2024-09-10T23:26:24.449517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472592,"kb_used_data":16208,"kb_used_omap":12,"kb_used_meta":456179,"kb_avail":754502128,"statfs":{"total":773094113280,"available":772610179072,"internally_reserved":0,"allocated":16596992,"data_stored":8392558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":467127857},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001744"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.115608+0000","last_change":"2024-09-10T23:26:20.111533+0000","last_active":"2024-09-10T23:26:20.115608+0000","last_peered":"2024-09-10T23:26:20.115608+0000","last_clean":"2024-09-10T23:26:20.115608+0000","last_became_active":"2024-09-10T23:26:20.111248+0000","last_became_peered":"2024-09-10T23:26:20.111248+0000","last_unstale":"2024-09-10T23:26:20.115608+0000","last_undegraded":"2024-09-10T23:26:20.115608+0000","last_fullsized":"2024-09-10T23:26:20.115608+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:21.820064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.115373+0000","last_change":"2024-09-10T23:26:20.108814+0000","last_active":"2024-09-10T23:26:20.115373+0000","last_peered":"2024-09-10T23:26:20.115373+0000","last_clean":"2024-09-10T23:26:20.115373+0000","last_became_active":"2024-09-10T23:26:20.108506+0000","last_became_peered":"2024-09-10T23:26:20.108506+0000","last_unstale":"2024-09-10T23:26:20.115373+0000","last_undegraded":"2024-09-10T23:26:20.115373+0000","last_fullsized":"2024-09-10T23:26:20.115373+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:38.349703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121826+0000","last_change":"2024-09-10T23:26:20.114368+0000","last_active":"2024-09-10T23:26:20.121826+0000","last_peered":"2024-09-10T23:26:20.121826+0000","last_clean":"2024-09-10T23:26:20.121826+0000","last_became_active":"2024-09-10T23:26:20.114102+0000","last_became_peered":"2024-09-10T23:26:20.114102+0000","last_unstale":"2024-09-10T23:26:20.121826+0000","last_undegraded":"2024-09-10T23:26:20.121826+0000","last_fullsized":"2024-09-10T23:26:20.121826+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:37.660143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.118434+0000","last_change":"2024-09-10T23:26:20.116654+0000","last_active":"2024-09-10T23:26:20.118434+0000","last_peered":"2024-09-10T23:26:20.118434+0000","last_clean":"2024-09-10T23:26:20.118434+0000","last_became_active":"2024-09-10T23:26:20.116405+0000","last_became_peered":"2024-09-10T23:26:20.116405+0000","last_unstale":"2024-09-10T23:26:20.118434+0000","last_undegraded":"2024-09-10T23:26:20.118434+0000","last_fullsized":"2024-09-10T23:26:20.118434+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:03.941086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549438+0000","last_change":"2024-09-10T23:26:20.103310+0000","last_active":"2024-09-10T23:26:21.549438+0000","last_peered":"2024-09-10T23:26:21.549438+0000","last_clean":"2024-09-10T23:26:21.549438+0000","last_became_active":"2024-09-10T23:26:20.102988+0000","last_became_peered":"2024-09-10T23:26:20.102988+0000","last_unstale":"2024-09-10T23:26:21.549438+0000","last_undegraded":"2024-09-10T23:26:21.549438+0000","last_fullsized":"2024-09-10T23:26:21.549438+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:54.815565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.548175+0000","last_change":"2024-09-10T23:26:20.109674+0000","last_active":"2024-09-10T23:26:21.548175+0000","last_peered":"2024-09-10T23:26:21.548175+0000","last_clean":"2024-09-10T23:26:21.548175+0000","last_became_active":"2024-09-10T23:26:20.109299+0000","last_became_peered":"2024-09-10T23:26:20.109299+0000","last_unstale":"2024-09-10T23:26:21.548175+0000","last_undegraded":"2024-09-10T23:26:21.548175+0000","last_fullsized":"2024-09-10T23:26:21.548175+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:38.810140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.115357+0000","last_change":"2024-09-10T23:26:20.112324+0000","last_active":"2024-09-10T23:26:20.115357+0000","last_peered":"2024-09-10T23:26:20.115357+0000","last_clean":"2024-09-10T23:26:20.115357+0000","last_became_active":"2024-09-10T23:26:20.112059+0000","last_became_peered":"2024-09-10T23:26:20.112059+0000","last_unstale":"2024-09-10T23:26:20.115357+0000","last_undegraded":"2024-09-10T23:26:20.115357+0000","last_fullsized":"2024-09-10T23:26:20.115357+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:49.745797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.128989+0000","last_change":"2024-09-10T23:26:20.128229+0000","last_active":"2024-09-10T23:26:20.128989+0000","last_peered":"2024-09-10T23:26:20.128989+0000","last_clean":"2024-09-10T23:26:20.128989+0000","last_became_active":"2024-09-10T23:26:20.125850+0000","last_became_peered":"2024-09-10T23:26:20.125850+0000","last_unstale":"2024-09-10T23:26:20.128989+0000","last_undegraded":"2024-09-10T23:26:20.128989+0000","last_fullsized":"2024-09-10T23:26:20.128989+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:20.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549390+0000","last_change":"2024-09-10T23:26:20.108391+0000","last_active":"2024-09-10T23:26:21.549390+0000","last_peered":"2024-09-10T23:26:21.549390+0000","last_clean":"2024-09-10T23:26:21.549390+0000","last_became_active":"2024-09-10T23:26:20.108113+0000","last_became_peered":"2024-09-10T23:26:20.108113+0000","last_unstale":"2024-09-10T23:26:21.549390+0000","last_undegraded":"2024-09-10T23:26:21.549390+0000","last_fullsized":"2024-09-10T23:26:21.549390+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:04.381413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549474+0000","last_change":"2024-09-10T23:26:20.112420+0000","last_active":"2024-09-10T23:26:21.549474+0000","last_peered":"2024-09-10T23:26:21.549474+0000","last_clean":"2024-09-10T23:26:21.549474+0000","last_became_active":"2024-09-10T23:26:20.111902+0000","last_became_peered":"2024-09-10T23:26:20.111902+0000","last_unstale":"2024-09-10T23:26:21.549474+0000","last_undegraded":"2024-09-10T23:26:21.549474+0000","last_fullsized":"2024-09-10T23:26:21.549474+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:32.613458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121413+0000","last_change":"2024-09-10T23:26:20.115719+0000","last_active":"2024-09-10T23:26:20.121413+0000","last_peered":"2024-09-10T23:26:20.121413+0000","last_clean":"2024-09-10T23:26:20.121413+0000","last_became_active":"2024-09-10T23:26:20.115136+0000","last_became_peered":"2024-09-10T23:26:20.115136+0000","last_unstale":"2024-09-10T23:26:20.121413+0000","last_undegraded":"2024-09-10T23:26:20.121413+0000","last_fullsized":"2024-09-10T23:26:20.121413+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:33.232406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114098+0000","last_change":"2024-09-10T23:26:20.111952+0000","last_active":"2024-09-10T23:26:20.114098+0000","last_peered":"2024-09-10T23:26:20.114098+0000","last_clean":"2024-09-10T23:26:20.114098+0000","last_became_active":"2024-09-10T23:26:20.111637+0000","last_became_peered":"2024-09-10T23:26:20.111637+0000","last_unstale":"2024-09-10T23:26:20.114098+0000","last_undegraded":"2024-09-10T23:26:20.114098+0000","last_fullsized":"2024-09-10T23:26:20.114098+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:31.652409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549199+0000","last_change":"2024-09-10T23:26:20.107042+0000","last_active":"2024-09-10T23:26:21.549199+0000","last_peered":"2024-09-10T23:26:21.549199+0000","last_clean":"2024-09-10T23:26:21.549199+0000","last_became_active":"2024-09-10T23:26:20.105943+0000","last_became_peered":"2024-09-10T23:26:20.105943+0000","last_unstale":"2024-09-10T23:26:21.549199+0000","last_undegraded":"2024-09-10T23:26:21.549199+0000","last_fullsized":"2024-09-10T23:26:21.549199+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:19.742936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114328+0000","last_change":"2024-09-10T23:26:20.113241+0000","last_active":"2024-09-10T23:26:20.114328+0000","last_peered":"2024-09-10T23:26:20.114328+0000","last_clean":"2024-09-10T23:26:20.114328+0000","last_became_active":"2024-09-10T23:26:20.112961+0000","last_became_peered":"2024-09-10T23:26:20.112961+0000","last_unstale":"2024-09-10T23:26:20.114328+0000","last_undegraded":"2024-09-10T23:26:20.114328+0000","last_fullsized":"2024-09-10T23:26:20.114328+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:25.017276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116957+0000","last_change":"2024-09-10T23:26:20.107849+0000","last_active":"2024-09-10T23:26:20.116957+0000","last_peered":"2024-09-10T23:26:20.116957+0000","last_clean":"2024-09-10T23:26:20.116957+0000","last_became_active":"2024-09-10T23:26:20.106615+0000","last_became_peered":"2024-09-10T23:26:20.106615+0000","last_unstale":"2024-09-10T23:26:20.116957+0000","last_undegraded":"2024-09-10T23:26:20.116957+0000","last_fullsized":"2024-09-10T23:26:20.116957+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:25.976602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.547814+0000","last_change":"2024-09-10T23:26:20.119428+0000","last_active":"2024-09-10T23:26:21.547814+0000","last_peered":"2024-09-10T23:26:21.547814+0000","last_clean":"2024-09-10T23:26:21.547814+0000","last_became_active":"2024-09-10T23:26:20.119163+0000","last_became_peered":"2024-09-10T23:26:20.119163+0000","last_unstale":"2024-09-10T23:26:21.547814+0000","last_undegraded":"2024-09-10T23:26:21.547814+0000","last_fullsized":"2024-09-10T23:26:21.547814+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:23.368277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114062+0000","last_change":"2024-09-10T23:26:20.111471+0000","last_active":"2024-09-10T23:26:20.114062+0000","last_peered":"2024-09-10T23:26:20.114062+0000","last_clean":"2024-09-10T23:26:20.114062+0000","last_became_active":"2024-09-10T23:26:20.110793+0000","last_became_peered":"2024-09-10T23:26:20.110793+0000","last_unstale":"2024-09-10T23:26:20.114062+0000","last_undegraded":"2024-09-10T23:26:20.114062+0000","last_fullsized":"2024-09-10T23:26:20.114062+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:58.707289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.118572+0000","last_change":"2024-09-10T23:26:20.108264+0000","last_active":"2024-09-10T23:26:20.118572+0000","last_peered":"2024-09-10T23:26:20.118572+0000","last_clean":"2024-09-10T23:26:20.118572+0000","last_became_active":"2024-09-10T23:26:20.107985+0000","last_became_peered":"2024-09-10T23:26:20.107985+0000","last_unstale":"2024-09-10T23:26:20.118572+0000","last_undegraded":"2024-09-10T23:26:20.118572+0000","last_fullsized":"2024-09-10T23:26:20.118572+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:24.930942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117452+0000","last_change":"2024-09-10T23:26:20.111367+0000","last_active":"2024-09-10T23:26:20.117452+0000","last_peered":"2024-09-10T23:26:20.117452+0000","last_clean":"2024-09-10T23:26:20.117452+0000","last_became_active":"2024-09-10T23:26:20.109272+0000","last_became_peered":"2024-09-10T23:26:20.109272+0000","last_unstale":"2024-09-10T23:26:20.117452+0000","last_undegraded":"2024-09-10T23:26:20.117452+0000","last_fullsized":"2024-09-10T23:26:20.117452+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:02.607337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117603+0000","last_change":"2024-09-10T23:26:20.112254+0000","last_active":"2024-09-10T23:26:20.117603+0000","last_peered":"2024-09-10T23:26:20.117603+0000","last_clean":"2024-09-10T23:26:20.117603+0000","last_became_active":"2024-09-10T23:26:20.111958+0000","last_became_peered":"2024-09-10T23:26:20.111958+0000","last_unstale":"2024-09-10T23:26:20.117603+0000","last_undegraded":"2024-09-10T23:26:20.117603+0000","last_fullsized":"2024-09-10T23:26:20.117603+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:20:38.294463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549258+0000","last_change":"2024-09-10T23:26:20.108511+0000","last_active":"2024-09-10T23:26:21.549258+0000","last_peered":"2024-09-10T23:26:21.549258+0000","last_clean":"2024-09-10T23:26:21.549258+0000","last_became_active":"2024-09-10T23:26:20.108231+0000","last_became_peered":"2024-09-10T23:26:20.108231+0000","last_unstale":"2024-09-10T23:26:21.549258+0000","last_undegraded":"2024-09-10T23:26:21.549258+0000","last_fullsized":"2024-09-10T23:26:21.549258+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:43:14.669524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122186+0000","last_change":"2024-09-10T23:26:20.116555+0000","last_active":"2024-09-10T23:26:20.122186+0000","last_peered":"2024-09-10T23:26:20.122186+0000","last_clean":"2024-09-10T23:26:20.122186+0000","last_became_active":"2024-09-10T23:26:20.112952+0000","last_became_peered":"2024-09-10T23:26:20.112952+0000","last_unstale":"2024-09-10T23:26:20.122186+0000","last_undegraded":"2024-09-10T23:26:20.122186+0000","last_fullsized":"2024-09-10T23:26:20.122186+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:20.121026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.106165+0000","last_change":"2024-09-10T23:26:20.103949+0000","last_active":"2024-09-10T23:26:20.106165+0000","last_peered":"2024-09-10T23:26:20.106165+0000","last_clean":"2024-09-10T23:26:20.106165+0000","last_became_active":"2024-09-10T23:26:20.103632+0000","last_became_peered":"2024-09-10T23:26:20.103632+0000","last_unstale":"2024-09-10T23:26:20.106165+0000","last_undegraded":"2024-09-10T23:26:20.106165+0000","last_fullsized":"2024-09-10T23:26:20.106165+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:18.879528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121040+0000","last_change":"2024-09-10T23:26:20.113156+0000","last_active":"2024-09-10T23:26:20.121040+0000","last_peered":"2024-09-10T23:26:20.121040+0000","last_clean":"2024-09-10T23:26:20.121040+0000","last_became_active":"2024-09-10T23:26:20.112902+0000","last_became_peered":"2024-09-10T23:26:20.112902+0000","last_unstale":"2024-09-10T23:26:20.121040+0000","last_undegraded":"2024-09-10T23:26:20.121040+0000","last_fullsized":"2024-09-10T23:26:20.121040+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:25.101310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122571+0000","last_change":"2024-09-10T23:26:20.115416+0000","last_active":"2024-09-10T23:26:20.122571+0000","last_peered":"2024-09-10T23:26:20.122571+0000","last_clean":"2024-09-10T23:26:20.122571+0000","last_became_active":"2024-09-10T23:26:20.113018+0000","last_became_peered":"2024-09-10T23:26:20.113018+0000","last_unstale":"2024-09-10T23:26:20.122571+0000","last_undegraded":"2024-09-10T23:26:20.122571+0000","last_fullsized":"2024-09-10T23:26:20.122571+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:02.418465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122256+0000","last_change":"2024-09-10T23:26:20.117324+0000","last_active":"2024-09-10T23:26:20.122256+0000","last_peered":"2024-09-10T23:26:20.122256+0000","last_clean":"2024-09-10T23:26:20.122256+0000","last_became_active":"2024-09-10T23:26:20.116983+0000","last_became_peered":"2024-09-10T23:26:20.116983+0000","last_unstale":"2024-09-10T23:26:20.122256+0000","last_undegraded":"2024-09-10T23:26:20.122256+0000","last_fullsized":"2024-09-10T23:26:20.122256+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:12.013954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549209+0000","last_change":"2024-09-10T23:26:20.120214+0000","last_active":"2024-09-10T23:26:21.549209+0000","last_peered":"2024-09-10T23:26:21.549209+0000","last_clean":"2024-09-10T23:26:21.549209+0000","last_became_active":"2024-09-10T23:26:20.119933+0000","last_became_peered":"2024-09-10T23:26:20.119933+0000","last_unstale":"2024-09-10T23:26:21.549209+0000","last_undegraded":"2024-09-10T23:26:21.549209+0000","last_fullsized":"2024-09-10T23:26:21.549209+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:04.294761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.120215+0000","last_change":"2024-09-10T23:26:20.111962+0000","last_active":"2024-09-10T23:26:20.120215+0000","last_peered":"2024-09-10T23:26:20.120215+0000","last_clean":"2024-09-10T23:26:20.120215+0000","last_became_active":"2024-09-10T23:26:20.111605+0000","last_became_peered":"2024-09-10T23:26:20.111605+0000","last_unstale":"2024-09-10T23:26:20.120215+0000","last_undegraded":"2024-09-10T23:26:20.120215+0000","last_fullsized":"2024-09-10T23:26:20.120215+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:51.860308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117440+0000","last_change":"2024-09-10T23:26:20.109612+0000","last_active":"2024-09-10T23:26:20.117440+0000","last_peered":"2024-09-10T23:26:20.117440+0000","last_clean":"2024-09-10T23:26:20.117440+0000","last_became_active":"2024-09-10T23:26:20.109078+0000","last_became_peered":"2024-09-10T23:26:20.109078+0000","last_unstale":"2024-09-10T23:26:20.117440+0000","last_undegraded":"2024-09-10T23:26:20.117440+0000","last_fullsized":"2024-09-10T23:26:20.117440+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:51.114677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121191+0000","last_change":"2024-09-10T23:26:20.114023+0000","last_active":"2024-09-10T23:26:20.121191+0000","last_peered":"2024-09-10T23:26:20.121191+0000","last_clean":"2024-09-10T23:26:20.121191+0000","last_became_active":"2024-09-10T23:26:20.113760+0000","last_became_peered":"2024-09-10T23:26:20.113760+0000","last_unstale":"2024-09-10T23:26:20.121191+0000","last_undegraded":"2024-09-10T23:26:20.121191+0000","last_fullsized":"2024-09-10T23:26:20.121191+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:10.733549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.548044+0000","last_change":"2024-09-10T23:26:20.117833+0000","last_active":"2024-09-10T23:26:21.548044+0000","last_peered":"2024-09-10T23:26:21.548044+0000","last_clean":"2024-09-10T23:26:21.548044+0000","last_became_active":"2024-09-10T23:26:20.117565+0000","last_became_peered":"2024-09-10T23:26:20.117565+0000","last_unstale":"2024-09-10T23:26:21.548044+0000","last_undegraded":"2024-09-10T23:26:21.548044+0000","last_fullsized":"2024-09-10T23:26:21.548044+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:00.092683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.128706+0000","last_change":"2024-09-10T23:26:20.127891+0000","last_active":"2024-09-10T23:26:20.128706+0000","last_peered":"2024-09-10T23:26:20.128706+0000","last_clean":"2024-09-10T23:26:20.128706+0000","last_became_active":"2024-09-10T23:26:20.127130+0000","last_became_peered":"2024-09-10T23:26:20.127130+0000","last_unstale":"2024-09-10T23:26:20.128706+0000","last_undegraded":"2024-09-10T23:26:20.128706+0000","last_fullsized":"2024-09-10T23:26:20.128706+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:58.755855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114832+0000","last_change":"2024-09-10T23:26:20.106035+0000","last_active":"2024-09-10T23:26:20.114832+0000","last_peered":"2024-09-10T23:26:20.114832+0000","last_clean":"2024-09-10T23:26:20.114832+0000","last_became_active":"2024-09-10T23:26:20.105700+0000","last_became_peered":"2024-09-10T23:26:20.105700+0000","last_unstale":"2024-09-10T23:26:20.114832+0000","last_undegraded":"2024-09-10T23:26:20.114832+0000","last_fullsized":"2024-09-10T23:26:20.114832+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:35:25.639089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"154'4","reported_seq":19,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549558+0000","last_change":"2024-09-10T23:26:19.096890+0000","last_active":"2024-09-10T23:26:21.549558+0000","last_peered":"2024-09-10T23:26:21.549558+0000","last_clean":"2024-09-10T23:26:21.549558+0000","last_became_active":"2024-09-10T23:26:19.096592+0000","last_became_peered":"2024-09-10T23:26:19.096592+0000","last_unstale":"2024-09-10T23:26:21.549558+0000","last_undegraded":"2024-09-10T23:26:21.549558+0000","last_fullsized":"2024-09-10T23:26:21.549558+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:43.515187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121943+0000","last_change":"2024-09-10T23:26:20.117928+0000","last_active":"2024-09-10T23:26:20.121943+0000","last_peered":"2024-09-10T23:26:20.121943+0000","last_clean":"2024-09-10T23:26:20.121943+0000","last_became_active":"2024-09-10T23:26:20.117650+0000","last_became_peered":"2024-09-10T23:26:20.117650+0000","last_unstale":"2024-09-10T23:26:20.121943+0000","last_undegraded":"2024-09-10T23:26:20.121943+0000","last_fullsized":"2024-09-10T23:26:20.121943+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:34.971683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"154'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.123701+0000","last_change":"2024-09-10T23:26:19.112335+0000","last_active":"2024-09-10T23:26:20.123701+0000","last_peered":"2024-09-10T23:26:20.123701+0000","last_clean":"2024-09-10T23:26:20.123701+0000","last_became_active":"2024-09-10T23:26:19.112023+0000","last_became_peered":"2024-09-10T23:26:19.112023+0000","last_unstale":"2024-09-10T23:26:20.123701+0000","last_undegraded":"2024-09-10T23:26:20.123701+0000","last_fullsized":"2024-09-10T23:26:20.123701+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:12:09.282681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.108090+0000","last_change":"2024-09-10T23:26:20.105781+0000","last_active":"2024-09-10T23:26:20.108090+0000","last_peered":"2024-09-10T23:26:20.108090+0000","last_clean":"2024-09-10T23:26:20.108090+0000","last_became_active":"2024-09-10T23:26:20.105504+0000","last_became_peered":"2024-09-10T23:26:20.105504+0000","last_unstale":"2024-09-10T23:26:20.108090+0000","last_undegraded":"2024-09-10T23:26:20.108090+0000","last_fullsized":"2024-09-10T23:26:20.108090+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:56.842610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.124308+0000","last_change":"2024-09-10T23:26:19.112271+0000","last_active":"2024-09-10T23:26:20.124308+0000","last_peered":"2024-09-10T23:26:20.124308+0000","last_clean":"2024-09-10T23:26:20.124308+0000","last_became_active":"2024-09-10T23:26:19.111972+0000","last_became_peered":"2024-09-10T23:26:19.111972+0000","last_unstale":"2024-09-10T23:26:20.124308+0000","last_undegraded":"2024-09-10T23:26:20.124308+0000","last_fullsized":"2024-09-10T23:26:20.124308+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:21:26.757291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121266+0000","last_change":"2024-09-10T23:26:20.115265+0000","last_active":"2024-09-10T23:26:20.121266+0000","last_peered":"2024-09-10T23:26:20.121266+0000","last_clean":"2024-09-10T23:26:20.121266+0000","last_became_active":"2024-09-10T23:26:20.112159+0000","last_became_peered":"2024-09-10T23:26:20.112159+0000","last_unstale":"2024-09-10T23:26:20.121266+0000","last_undegraded":"2024-09-10T23:26:20.121266+0000","last_fullsized":"2024-09-10T23:26:20.121266+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:51.782425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122951+0000","last_change":"2024-09-10T23:26:19.113508+0000","last_active":"2024-09-10T23:26:20.122951+0000","last_peered":"2024-09-10T23:26:20.122951+0000","last_clean":"2024-09-10T23:26:20.122951+0000","last_became_active":"2024-09-10T23:26:19.113147+0000","last_became_peered":"2024-09-10T23:26:19.113147+0000","last_unstale":"2024-09-10T23:26:20.122951+0000","last_undegraded":"2024-09-10T23:26:20.122951+0000","last_fullsized":"2024-09-10T23:26:20.122951+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:52.300760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.119920+0000","last_change":"2024-09-10T23:26:20.116455+0000","last_active":"2024-09-10T23:26:20.119920+0000","last_peered":"2024-09-10T23:26:20.119920+0000","last_clean":"2024-09-10T23:26:20.119920+0000","last_became_active":"2024-09-10T23:26:20.116134+0000","last_became_peered":"2024-09-10T23:26:20.116134+0000","last_unstale":"2024-09-10T23:26:20.119920+0000","last_undegraded":"2024-09-10T23:26:20.119920+0000","last_fullsized":"2024-09-10T23:26:20.119920+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:29.683324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"154'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.124732+0000","last_change":"2024-09-10T23:26:19.115377+0000","last_active":"2024-09-10T23:26:20.124732+0000","last_peered":"2024-09-10T23:26:20.124732+0000","last_clean":"2024-09-10T23:26:20.124732+0000","last_became_active":"2024-09-10T23:26:19.115096+0000","last_became_peered":"2024-09-10T23:26:19.115096+0000","last_unstale":"2024-09-10T23:26:20.124732+0000","last_undegraded":"2024-09-10T23:26:20.124732+0000","last_fullsized":"2024-09-10T23:26:20.124732+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:29.172262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114046+0000","last_change":"2024-09-10T23:26:20.110971+0000","last_active":"2024-09-10T23:26:20.114046+0000","last_peered":"2024-09-10T23:26:20.114046+0000","last_clean":"2024-09-10T23:26:20.114046+0000","last_became_active":"2024-09-10T23:26:20.109868+0000","last_became_peered":"2024-09-10T23:26:20.109868+0000","last_unstale":"2024-09-10T23:26:20.114046+0000","last_undegraded":"2024-09-10T23:26:20.114046+0000","last_fullsized":"2024-09-10T23:26:20.114046+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:11:39.450715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"154'1","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.548583+0000","last_change":"2024-09-10T23:26:19.103971+0000","last_active":"2024-09-10T23:26:21.548583+0000","last_peered":"2024-09-10T23:26:21.548583+0000","last_clean":"2024-09-10T23:26:21.548583+0000","last_became_active":"2024-09-10T23:26:19.103678+0000","last_became_peered":"2024-09-10T23:26:19.103678+0000","last_unstale":"2024-09-10T23:26:21.548583+0000","last_undegraded":"2024-09-10T23:26:21.548583+0000","last_fullsized":"2024-09-10T23:26:21.548583+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:24.747415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114721+0000","last_change":"2024-09-10T23:26:20.106716+0000","last_active":"2024-09-10T23:26:20.114721+0000","last_peered":"2024-09-10T23:26:20.114721+0000","last_clean":"2024-09-10T23:26:20.114721+0000","last_became_active":"2024-09-10T23:26:20.106378+0000","last_became_peered":"2024-09-10T23:26:20.106378+0000","last_unstale":"2024-09-10T23:26:20.114721+0000","last_undegraded":"2024-09-10T23:26:20.114721+0000","last_fullsized":"2024-09-10T23:26:20.114721+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:11.093802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.098843+0000","last_change":"2024-09-10T23:26:19.107769+0000","last_active":"2024-09-10T23:26:20.098843+0000","last_peered":"2024-09-10T23:26:20.098843+0000","last_clean":"2024-09-10T23:26:20.098843+0000","last_became_active":"2024-09-10T23:26:19.106325+0000","last_became_peered":"2024-09-10T23:26:19.106325+0000","last_unstale":"2024-09-10T23:26:20.098843+0000","last_undegraded":"2024-09-10T23:26:20.098843+0000","last_fullsized":"2024-09-10T23:26:20.098843+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:56.437615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116117+0000","last_change":"2024-09-10T23:26:20.110671+0000","last_active":"2024-09-10T23:26:20.116117+0000","last_peered":"2024-09-10T23:26:20.116117+0000","last_clean":"2024-09-10T23:26:20.116117+0000","last_became_active":"2024-09-10T23:26:20.110398+0000","last_became_peered":"2024-09-10T23:26:20.110398+0000","last_unstale":"2024-09-10T23:26:20.116117+0000","last_undegraded":"2024-09-10T23:26:20.116117+0000","last_fullsized":"2024-09-10T23:26:20.116117+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:34.185272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.548467+0000","last_change":"2024-09-10T23:26:19.103844+0000","last_active":"2024-09-10T23:26:21.548467+0000","last_peered":"2024-09-10T23:26:21.548467+0000","last_clean":"2024-09-10T23:26:21.548467+0000","last_became_active":"2024-09-10T23:26:19.103339+0000","last_became_peered":"2024-09-10T23:26:19.103339+0000","last_unstale":"2024-09-10T23:26:21.548467+0000","last_undegraded":"2024-09-10T23:26:21.548467+0000","last_fullsized":"2024-09-10T23:26:21.548467+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:17.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.126883+0000","last_change":"2024-09-10T23:26:20.125273+0000","last_active":"2024-09-10T23:26:20.126883+0000","last_peered":"2024-09-10T23:26:20.126883+0000","last_clean":"2024-09-10T23:26:20.126883+0000","last_became_active":"2024-09-10T23:26:20.114737+0000","last_became_peered":"2024-09-10T23:26:20.114737+0000","last_unstale":"2024-09-10T23:26:20.126883+0000","last_undegraded":"2024-09-10T23:26:20.126883+0000","last_fullsized":"2024-09-10T23:26:20.126883+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:53.303852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.097000+0000","last_change":"2024-09-10T23:26:19.109024+0000","last_active":"2024-09-10T23:26:20.097000+0000","last_peered":"2024-09-10T23:26:20.097000+0000","last_clean":"2024-09-10T23:26:20.097000+0000","last_became_active":"2024-09-10T23:26:19.108767+0000","last_became_peered":"2024-09-10T23:26:19.108767+0000","last_unstale":"2024-09-10T23:26:20.097000+0000","last_undegraded":"2024-09-10T23:26:20.097000+0000","last_fullsized":"2024-09-10T23:26:20.097000+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:10.547141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121381+0000","last_change":"2024-09-10T23:26:20.115612+0000","last_active":"2024-09-10T23:26:20.121381+0000","last_peered":"2024-09-10T23:26:20.121381+0000","last_clean":"2024-09-10T23:26:20.121381+0000","last_became_active":"2024-09-10T23:26:20.115234+0000","last_became_peered":"2024-09-10T23:26:20.115234+0000","last_unstale":"2024-09-10T23:26:20.121381+0000","last_undegraded":"2024-09-10T23:26:20.121381+0000","last_fullsized":"2024-09-10T23:26:20.121381+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:58.068503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.099985+0000","last_change":"2024-09-10T23:26:19.108333+0000","last_active":"2024-09-10T23:26:20.099985+0000","last_peered":"2024-09-10T23:26:20.099985+0000","last_clean":"2024-09-10T23:26:20.099985+0000","last_became_active":"2024-09-10T23:26:19.107083+0000","last_became_peered":"2024-09-10T23:26:19.107083+0000","last_unstale":"2024-09-10T23:26:20.099985+0000","last_undegraded":"2024-09-10T23:26:20.099985+0000","last_fullsized":"2024-09-10T23:26:20.099985+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:52.997711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.118607+0000","last_change":"2024-09-10T23:26:20.110810+0000","last_active":"2024-09-10T23:26:20.118607+0000","last_peered":"2024-09-10T23:26:20.118607+0000","last_clean":"2024-09-10T23:26:20.118607+0000","last_became_active":"2024-09-10T23:26:20.110482+0000","last_became_peered":"2024-09-10T23:26:20.110482+0000","last_unstale":"2024-09-10T23:26:20.118607+0000","last_undegraded":"2024-09-10T23:26:20.118607+0000","last_fullsized":"2024-09-10T23:26:20.118607+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:23.289307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"154'3","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122836+0000","last_change":"2024-09-10T23:26:19.095015+0000","last_active":"2024-09-10T23:26:20.122836+0000","last_peered":"2024-09-10T23:26:20.122836+0000","last_clean":"2024-09-10T23:26:20.122836+0000","last_became_active":"2024-09-10T23:26:19.094127+0000","last_became_peered":"2024-09-10T23:26:19.094127+0000","last_unstale":"2024-09-10T23:26:20.122836+0000","last_undegraded":"2024-09-10T23:26:20.122836+0000","last_fullsized":"2024-09-10T23:26:20.122836+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:08:28.243999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117498+0000","last_change":"2024-09-10T23:26:20.109684+0000","last_active":"2024-09-10T23:26:20.117498+0000","last_peered":"2024-09-10T23:26:20.117498+0000","last_clean":"2024-09-10T23:26:20.117498+0000","last_became_active":"2024-09-10T23:26:20.109380+0000","last_became_peered":"2024-09-10T23:26:20.109380+0000","last_unstale":"2024-09-10T23:26:20.117498+0000","last_undegraded":"2024-09-10T23:26:20.117498+0000","last_fullsized":"2024-09-10T23:26:20.117498+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:15.600613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"154'2","reported_seq":17,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549419+0000","last_change":"2024-09-10T23:26:19.096350+0000","last_active":"2024-09-10T23:26:21.549419+0000","last_peered":"2024-09-10T23:26:21.549419+0000","last_clean":"2024-09-10T23:26:21.549419+0000","last_became_active":"2024-09-10T23:26:19.096095+0000","last_became_peered":"2024-09-10T23:26:19.096095+0000","last_unstale":"2024-09-10T23:26:21.549419+0000","last_undegraded":"2024-09-10T23:26:21.549419+0000","last_fullsized":"2024-09-10T23:26:21.549419+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:18.942473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116978+0000","last_change":"2024-09-10T23:26:20.108164+0000","last_active":"2024-09-10T23:26:20.116978+0000","last_peered":"2024-09-10T23:26:20.116978+0000","last_clean":"2024-09-10T23:26:20.116978+0000","last_became_active":"2024-09-10T23:26:20.107665+0000","last_became_peered":"2024-09-10T23:26:20.107665+0000","last_unstale":"2024-09-10T23:26:20.116978+0000","last_undegraded":"2024-09-10T23:26:20.116978+0000","last_fullsized":"2024-09-10T23:26:20.116978+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:16.233677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.096810+0000","last_change":"2024-09-10T23:26:19.115454+0000","last_active":"2024-09-10T23:26:20.096810+0000","last_peered":"2024-09-10T23:26:20.096810+0000","last_clean":"2024-09-10T23:26:20.096810+0000","last_became_active":"2024-09-10T23:26:19.115157+0000","last_became_peered":"2024-09-10T23:26:19.115157+0000","last_unstale":"2024-09-10T23:26:20.096810+0000","last_undegraded":"2024-09-10T23:26:20.096810+0000","last_fullsized":"2024-09-10T23:26:20.096810+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:59.043292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.548445+0000","last_change":"2024-09-10T23:26:20.120398+0000","last_active":"2024-09-10T23:26:21.548445+0000","last_peered":"2024-09-10T23:26:21.548445+0000","last_clean":"2024-09-10T23:26:21.548445+0000","last_became_active":"2024-09-10T23:26:20.120117+0000","last_became_peered":"2024-09-10T23:26:20.120117+0000","last_unstale":"2024-09-10T23:26:21.548445+0000","last_undegraded":"2024-09-10T23:26:21.548445+0000","last_fullsized":"2024-09-10T23:26:21.548445+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:58.701108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.096489+0000","last_change":"2024-09-10T23:26:19.106866+0000","last_active":"2024-09-10T23:26:20.096489+0000","last_peered":"2024-09-10T23:26:20.096489+0000","last_clean":"2024-09-10T23:26:20.096489+0000","last_became_active":"2024-09-10T23:26:19.106113+0000","last_became_peered":"2024-09-10T23:26:19.106113+0000","last_unstale":"2024-09-10T23:26:20.096489+0000","last_undegraded":"2024-09-10T23:26:20.096489+0000","last_fullsized":"2024-09-10T23:26:20.096489+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:29.951907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121616+0000","last_change":"2024-09-10T23:26:20.118268+0000","last_active":"2024-09-10T23:26:20.121616+0000","last_peered":"2024-09-10T23:26:20.121616+0000","last_clean":"2024-09-10T23:26:20.121616+0000","last_became_active":"2024-09-10T23:26:20.117917+0000","last_became_peered":"2024-09-10T23:26:20.117917+0000","last_unstale":"2024-09-10T23:26:20.121616+0000","last_undegraded":"2024-09-10T23:26:20.121616+0000","last_fullsized":"2024-09-10T23:26:20.121616+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:16.937180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"154'8","reported_seq":21,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.128837+0000","last_change":"2024-09-10T23:26:19.115170+0000","last_active":"2024-09-10T23:26:20.128837+0000","last_peered":"2024-09-10T23:26:20.128837+0000","last_clean":"2024-09-10T23:26:20.128837+0000","last_became_active":"2024-09-10T23:26:19.114902+0000","last_became_peered":"2024-09-10T23:26:19.114902+0000","last_unstale":"2024-09-10T23:26:20.128837+0000","last_undegraded":"2024-09-10T23:26:20.128837+0000","last_fullsized":"2024-09-10T23:26:20.128837+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:24.777555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.123002+0000","last_change":"2024-09-10T23:26:20.115607+0000","last_active":"2024-09-10T23:26:20.123002+0000","last_peered":"2024-09-10T23:26:20.123002+0000","last_clean":"2024-09-10T23:26:20.123002+0000","last_became_active":"2024-09-10T23:26:20.113057+0000","last_became_peered":"2024-09-10T23:26:20.113057+0000","last_unstale":"2024-09-10T23:26:20.123002+0000","last_undegraded":"2024-09-10T23:26:20.123002+0000","last_fullsized":"2024-09-10T23:26:20.123002+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:47.127350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"154'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.121062+0000","last_change":"2024-09-10T23:26:19.101070+0000","last_active":"2024-09-10T23:26:20.121062+0000","last_peered":"2024-09-10T23:26:20.121062+0000","last_clean":"2024-09-10T23:26:20.121062+0000","last_became_active":"2024-09-10T23:26:19.100796+0000","last_became_peered":"2024-09-10T23:26:19.100796+0000","last_unstale":"2024-09-10T23:26:20.121062+0000","last_undegraded":"2024-09-10T23:26:20.121062+0000","last_fullsized":"2024-09-10T23:26:20.121062+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:21:59.492910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117907+0000","last_change":"2024-09-10T23:26:20.112434+0000","last_active":"2024-09-10T23:26:20.117907+0000","last_peered":"2024-09-10T23:26:20.117907+0000","last_clean":"2024-09-10T23:26:20.117907+0000","last_became_active":"2024-09-10T23:26:20.112116+0000","last_became_peered":"2024-09-10T23:26:20.112116+0000","last_unstale":"2024-09-10T23:26:20.117907+0000","last_undegraded":"2024-09-10T23:26:20.117907+0000","last_fullsized":"2024-09-10T23:26:20.117907+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:17.193361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.126542+0000","last_change":"2024-09-10T23:26:19.108057+0000","last_active":"2024-09-10T23:26:20.126542+0000","last_peered":"2024-09-10T23:26:20.126542+0000","last_clean":"2024-09-10T23:26:20.126542+0000","last_became_active":"2024-09-10T23:26:19.107780+0000","last_became_peered":"2024-09-10T23:26:19.107780+0000","last_unstale":"2024-09-10T23:26:20.126542+0000","last_undegraded":"2024-09-10T23:26:20.126542+0000","last_fullsized":"2024-09-10T23:26:20.126542+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:25.368770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.119109+0000","last_change":"2024-09-10T23:26:20.114954+0000","last_active":"2024-09-10T23:26:20.119109+0000","last_peered":"2024-09-10T23:26:20.119109+0000","last_clean":"2024-09-10T23:26:20.119109+0000","last_became_active":"2024-09-10T23:26:20.114608+0000","last_became_peered":"2024-09-10T23:26:20.114608+0000","last_unstale":"2024-09-10T23:26:20.119109+0000","last_undegraded":"2024-09-10T23:26:20.119109+0000","last_fullsized":"2024-09-10T23:26:20.119109+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:21.057171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"154'1","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.122293+0000","last_change":"2024-09-10T23:26:19.106301+0000","last_active":"2024-09-10T23:26:20.122293+0000","last_peered":"2024-09-10T23:26:20.122293+0000","last_clean":"2024-09-10T23:26:20.122293+0000","last_became_active":"2024-09-10T23:26:19.105964+0000","last_became_peered":"2024-09-10T23:26:19.105964+0000","last_unstale":"2024-09-10T23:26:20.122293+0000","last_undegraded":"2024-09-10T23:26:20.122293+0000","last_fullsized":"2024-09-10T23:26:20.122293+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:57.752763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.111732+0000","last_change":"2024-09-10T23:26:20.104142+0000","last_active":"2024-09-10T23:26:20.111732+0000","last_peered":"2024-09-10T23:26:20.111732+0000","last_clean":"2024-09-10T23:26:20.111732+0000","last_became_active":"2024-09-10T23:26:20.103759+0000","last_became_peered":"2024-09-10T23:26:20.103759+0000","last_unstale":"2024-09-10T23:26:20.111732+0000","last_undegraded":"2024-09-10T23:26:20.111732+0000","last_fullsized":"2024-09-10T23:26:20.111732+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:22:10.388875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.098339+0000","last_change":"2024-09-10T23:26:19.117612+0000","last_active":"2024-09-10T23:26:20.098339+0000","last_peered":"2024-09-10T23:26:20.098339+0000","last_clean":"2024-09-10T23:26:20.098339+0000","last_became_active":"2024-09-10T23:26:19.117317+0000","last_became_peered":"2024-09-10T23:26:19.117317+0000","last_unstale":"2024-09-10T23:26:20.098339+0000","last_undegraded":"2024-09-10T23:26:20.098339+0000","last_fullsized":"2024-09-10T23:26:20.098339+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:24.620696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117860+0000","last_change":"2024-09-10T23:26:20.111945+0000","last_active":"2024-09-10T23:26:20.117860+0000","last_peered":"2024-09-10T23:26:20.117860+0000","last_clean":"2024-09-10T23:26:20.117860+0000","last_became_active":"2024-09-10T23:26:20.109315+0000","last_became_peered":"2024-09-10T23:26:20.109315+0000","last_unstale":"2024-09-10T23:26:20.117860+0000","last_undegraded":"2024-09-10T23:26:20.117860+0000","last_fullsized":"2024-09-10T23:26:20.117860+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:35.575616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.124398+0000","last_change":"2024-09-10T23:26:19.116075+0000","last_active":"2024-09-10T23:26:20.124398+0000","last_peered":"2024-09-10T23:26:20.124398+0000","last_clean":"2024-09-10T23:26:20.124398+0000","last_became_active":"2024-09-10T23:26:19.115814+0000","last_became_peered":"2024-09-10T23:26:19.115814+0000","last_unstale":"2024-09-10T23:26:20.124398+0000","last_undegraded":"2024-09-10T23:26:20.124398+0000","last_fullsized":"2024-09-10T23:26:20.124398+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:20.521768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116931+0000","last_change":"2024-09-10T23:26:20.101807+0000","last_active":"2024-09-10T23:26:20.116931+0000","last_peered":"2024-09-10T23:26:20.116931+0000","last_clean":"2024-09-10T23:26:20.116931+0000","last_became_active":"2024-09-10T23:26:20.101515+0000","last_became_peered":"2024-09-10T23:26:20.101515+0000","last_unstale":"2024-09-10T23:26:20.116931+0000","last_undegraded":"2024-09-10T23:26:20.116931+0000","last_fullsized":"2024-09-10T23:26:20.116931+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:36.873787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.093090+0000","last_change":"2024-09-10T23:26:19.114516+0000","last_active":"2024-09-10T23:26:20.093090+0000","last_peered":"2024-09-10T23:26:20.093090+0000","last_clean":"2024-09-10T23:26:20.093090+0000","last_became_active":"2024-09-10T23:26:19.114244+0000","last_became_peered":"2024-09-10T23:26:19.114244+0000","last_unstale":"2024-09-10T23:26:20.093090+0000","last_undegraded":"2024-09-10T23:26:20.093090+0000","last_fullsized":"2024-09-10T23:26:20.093090+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:29:11.422625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.125500+0000","last_change":"2024-09-10T23:26:20.122081+0000","last_active":"2024-09-10T23:26:20.125500+0000","last_peered":"2024-09-10T23:26:20.125500+0000","last_clean":"2024-09-10T23:26:20.125500+0000","last_became_active":"2024-09-10T23:26:20.121822+0000","last_became_peered":"2024-09-10T23:26:20.121822+0000","last_unstale":"2024-09-10T23:26:20.125500+0000","last_undegraded":"2024-09-10T23:26:20.125500+0000","last_fullsized":"2024-09-10T23:26:20.125500+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:41.420802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.087234+0000","last_change":"2024-09-10T23:26:19.112186+0000","last_active":"2024-09-10T23:26:20.087234+0000","last_peered":"2024-09-10T23:26:20.087234+0000","last_clean":"2024-09-10T23:26:20.087234+0000","last_became_active":"2024-09-10T23:26:19.111893+0000","last_became_peered":"2024-09-10T23:26:19.111893+0000","last_unstale":"2024-09-10T23:26:20.087234+0000","last_undegraded":"2024-09-10T23:26:20.087234+0000","last_fullsized":"2024-09-10T23:26:20.087234+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:39.129490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114772+0000","last_change":"2024-09-10T23:26:20.104913+0000","last_active":"2024-09-10T23:26:20.114772+0000","last_peered":"2024-09-10T23:26:20.114772+0000","last_clean":"2024-09-10T23:26:20.114772+0000","last_became_active":"2024-09-10T23:26:20.104611+0000","last_became_peered":"2024-09-10T23:26:20.104611+0000","last_unstale":"2024-09-10T23:26:20.114772+0000","last_undegraded":"2024-09-10T23:26:20.114772+0000","last_fullsized":"2024-09-10T23:26:20.114772+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:04.090474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.093234+0000","last_change":"2024-09-10T23:26:19.116276+0000","last_active":"2024-09-10T23:26:20.093234+0000","last_peered":"2024-09-10T23:26:20.093234+0000","last_clean":"2024-09-10T23:26:20.093234+0000","last_became_active":"2024-09-10T23:26:19.115847+0000","last_became_peered":"2024-09-10T23:26:19.115847+0000","last_unstale":"2024-09-10T23:26:20.093234+0000","last_undegraded":"2024-09-10T23:26:20.093234+0000","last_fullsized":"2024-09-10T23:26:20.093234+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:39.453738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549194+0000","last_change":"2024-09-10T23:26:20.109448+0000","last_active":"2024-09-10T23:26:21.549194+0000","last_peered":"2024-09-10T23:26:21.549194+0000","last_clean":"2024-09-10T23:26:21.549194+0000","last_became_active":"2024-09-10T23:26:20.109183+0000","last_became_peered":"2024-09-10T23:26:20.109183+0000","last_unstale":"2024-09-10T23:26:21.549194+0000","last_undegraded":"2024-09-10T23:26:21.549194+0000","last_fullsized":"2024-09-10T23:26:21.549194+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:45.647793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"154'2","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.127795+0000","last_change":"2024-09-10T23:26:19.118609+0000","last_active":"2024-09-10T23:26:20.127795+0000","last_peered":"2024-09-10T23:26:20.127795+0000","last_clean":"2024-09-10T23:26:20.127795+0000","last_became_active":"2024-09-10T23:26:19.117719+0000","last_became_peered":"2024-09-10T23:26:19.117719+0000","last_unstale":"2024-09-10T23:26:20.127795+0000","last_undegraded":"2024-09-10T23:26:20.127795+0000","last_fullsized":"2024-09-10T23:26:20.127795+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:59.404548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.116348+0000","last_change":"2024-09-10T23:26:20.113952+0000","last_active":"2024-09-10T23:26:20.116348+0000","last_peered":"2024-09-10T23:26:20.116348+0000","last_clean":"2024-09-10T23:26:20.116348+0000","last_became_active":"2024-09-10T23:26:20.113353+0000","last_became_peered":"2024-09-10T23:26:20.113353+0000","last_unstale":"2024-09-10T23:26:20.116348+0000","last_undegraded":"2024-09-10T23:26:20.116348+0000","last_fullsized":"2024-09-10T23:26:20.116348+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:30.174518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.099741+0000","last_change":"2024-09-10T23:26:19.114310+0000","last_active":"2024-09-10T23:26:20.099741+0000","last_peered":"2024-09-10T23:26:20.099741+0000","last_clean":"2024-09-10T23:26:20.099741+0000","last_became_active":"2024-09-10T23:26:19.114028+0000","last_became_peered":"2024-09-10T23:26:19.114028+0000","last_unstale":"2024-09-10T23:26:20.099741+0000","last_undegraded":"2024-09-10T23:26:20.099741+0000","last_fullsized":"2024-09-10T23:26:20.099741+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:19.008053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.115647+0000","last_change":"2024-09-10T23:26:20.110854+0000","last_active":"2024-09-10T23:26:20.115647+0000","last_peered":"2024-09-10T23:26:20.115647+0000","last_clean":"2024-09-10T23:26:20.115647+0000","last_became_active":"2024-09-10T23:26:20.110591+0000","last_became_peered":"2024-09-10T23:26:20.110591+0000","last_unstale":"2024-09-10T23:26:20.115647+0000","last_undegraded":"2024-09-10T23:26:20.115647+0000","last_fullsized":"2024-09-10T23:26:20.115647+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:33:21.001588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.100187+0000","last_change":"2024-09-10T23:26:19.107560+0000","last_active":"2024-09-10T23:26:20.100187+0000","last_peered":"2024-09-10T23:26:20.100187+0000","last_clean":"2024-09-10T23:26:20.100187+0000","last_became_active":"2024-09-10T23:26:19.107304+0000","last_became_peered":"2024-09-10T23:26:19.107304+0000","last_unstale":"2024-09-10T23:26:20.100187+0000","last_undegraded":"2024-09-10T23:26:20.100187+0000","last_fullsized":"2024-09-10T23:26:20.100187+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:19.038967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549616+0000","last_change":"2024-09-10T23:26:20.105611+0000","last_active":"2024-09-10T23:26:21.549616+0000","last_peered":"2024-09-10T23:26:21.549616+0000","last_clean":"2024-09-10T23:26:21.549616+0000","last_became_active":"2024-09-10T23:26:20.104778+0000","last_became_peered":"2024-09-10T23:26:20.104778+0000","last_unstale":"2024-09-10T23:26:21.549616+0000","last_undegraded":"2024-09-10T23:26:21.549616+0000","last_fullsized":"2024-09-10T23:26:21.549616+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:40.712141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-10T23:26:21.549268+0000","last_change":"2024-09-10T23:26:19.113773+0000","last_active":"2024-09-10T23:26:21.549268+0000","last_peered":"2024-09-10T23:26:21.549268+0000","last_clean":"2024-09-10T23:26:21.549268+0000","last_became_active":"2024-09-10T23:26:19.113453+0000","last_became_peered":"2024-09-10T23:26:19.113453+0000","last_unstale":"2024-09-10T23:26:21.549268+0000","last_undegraded":"2024-09-10T23:26:21.549268+0000","last_fullsized":"2024-09-10T23:26:21.549268+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:12.565554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.105785+0000","last_change":"2024-09-10T23:26:20.102689+0000","last_active":"2024-09-10T23:26:20.105785+0000","last_peered":"2024-09-10T23:26:20.105785+0000","last_clean":"2024-09-10T23:26:20.105785+0000","last_became_active":"2024-09-10T23:26:20.102427+0000","last_became_peered":"2024-09-10T23:26:20.102427+0000","last_unstale":"2024-09-10T23:26:20.105785+0000","last_undegraded":"2024-09-10T23:26:20.105785+0000","last_fullsized":"2024-09-10T23:26:20.105785+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:52:27.992848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.099361+0000","last_change":"2024-09-10T23:26:19.111103+0000","last_active":"2024-09-10T23:26:20.099361+0000","last_peered":"2024-09-10T23:26:20.099361+0000","last_clean":"2024-09-10T23:26:20.099361+0000","last_became_active":"2024-09-10T23:26:19.110674+0000","last_became_peered":"2024-09-10T23:26:19.110674+0000","last_unstale":"2024-09-10T23:26:20.099361+0000","last_undegraded":"2024-09-10T23:26:20.099361+0000","last_fullsized":"2024-09-10T23:26:20.099361+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:03:35.735847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.120967+0000","last_change":"2024-09-10T23:26:20.119802+0000","last_active":"2024-09-10T23:26:20.120967+0000","last_peered":"2024-09-10T23:26:20.120967+0000","last_clean":"2024-09-10T23:26:20.120967+0000","last_became_active":"2024-09-10T23:26:20.118764+0000","last_became_peered":"2024-09-10T23:26:20.118764+0000","last_unstale":"2024-09-10T23:26:20.120967+0000","last_undegraded":"2024-09-10T23:26:20.120967+0000","last_fullsized":"2024-09-10T23:26:20.120967+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:57.440708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.097225+0000","last_change":"2024-09-10T23:26:19.112503+0000","last_active":"2024-09-10T23:26:20.097225+0000","last_peered":"2024-09-10T23:26:20.097225+0000","last_clean":"2024-09-10T23:26:20.097225+0000","last_became_active":"2024-09-10T23:26:19.112187+0000","last_became_peered":"2024-09-10T23:26:19.112187+0000","last_unstale":"2024-09-10T23:26:20.097225+0000","last_undegraded":"2024-09-10T23:26:20.097225+0000","last_fullsized":"2024-09-10T23:26:20.097225+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:10:33.745925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.114694+0000","last_change":"2024-09-10T23:26:20.105065+0000","last_active":"2024-09-10T23:26:20.114694+0000","last_peered":"2024-09-10T23:26:20.114694+0000","last_clean":"2024-09-10T23:26:20.114694+0000","last_became_active":"2024-09-10T23:26:20.104501+0000","last_became_peered":"2024-09-10T23:26:20.104501+0000","last_unstale":"2024-09-10T23:26:20.114694+0000","last_undegraded":"2024-09-10T23:26:20.114694+0000","last_fullsized":"2024-09-10T23:26:20.114694+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:05:33.318408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.099050+0000","last_change":"2024-09-10T23:26:19.106668+0000","last_active":"2024-09-10T23:26:20.099050+0000","last_peered":"2024-09-10T23:26:20.099050+0000","last_clean":"2024-09-10T23:26:20.099050+0000","last_became_active":"2024-09-10T23:26:19.106357+0000","last_became_peered":"2024-09-10T23:26:19.106357+0000","last_unstale":"2024-09-10T23:26:20.099050+0000","last_undegraded":"2024-09-10T23:26:20.099050+0000","last_fullsized":"2024-09-10T23:26:20.099050+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:48:53.696662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.117468+0000","last_change":"2024-09-10T23:26:20.113990+0000","last_active":"2024-09-10T23:26:20.117468+0000","last_peered":"2024-09-10T23:26:20.117468+0000","last_clean":"2024-09-10T23:26:20.117468+0000","last_became_active":"2024-09-10T23:26:20.109743+0000","last_became_peered":"2024-09-10T23:26:20.109743+0000","last_unstale":"2024-09-10T23:26:20.117468+0000","last_undegraded":"2024-09-10T23:26:20.117468+0000","last_fullsized":"2024-09-10T23:26:20.117468+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:05.105409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.097283+0000","last_change":"2024-09-10T23:26:19.108524+0000","last_active":"2024-09-10T23:26:20.097283+0000","last_peered":"2024-09-10T23:26:20.097283+0000","last_clean":"2024-09-10T23:26:20.097283+0000","last_became_active":"2024-09-10T23:26:19.108248+0000","last_became_peered":"2024-09-10T23:26:19.108248+0000","last_unstale":"2024-09-10T23:26:20.097283+0000","last_undegraded":"2024-09-10T23:26:20.097283+0000","last_fullsized":"2024-09-10T23:26:20.097283+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:41.394384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.124437+0000","last_change":"2024-09-10T23:26:20.117626+0000","last_active":"2024-09-10T23:26:20.124437+0000","last_peered":"2024-09-10T23:26:20.124437+0000","last_clean":"2024-09-10T23:26:20.124437+0000","last_became_active":"2024-09-10T23:26:20.115685+0000","last_became_peered":"2024-09-10T23:26:20.115685+0000","last_unstale":"2024-09-10T23:26:20.124437+0000","last_undegraded":"2024-09-10T23:26:20.124437+0000","last_fullsized":"2024-09-10T23:26:20.124437+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:19.075484+0000","last_clean_scrub_stamp":"2024-09-10T23:26:19.075484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:23.958388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"154'6","reported_seq":19,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.127265+0000","last_change":"2024-09-10T23:26:19.112195+0000","last_active":"2024-09-10T23:26:20.127265+0000","last_peered":"2024-09-10T23:26:20.127265+0000","last_clean":"2024-09-10T23:26:20.127265+0000","last_became_active":"2024-09-10T23:26:19.111887+0000","last_became_peered":"2024-09-10T23:26:19.111887+0000","last_unstale":"2024-09-10T23:26:20.127265+0000","last_undegraded":"2024-09-10T23:26:20.127265+0000","last_fullsized":"2024-09-10T23:26:20.127265+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:26:18.072391+0000","last_clean_scrub_stamp":"2024-09-10T23:26:18.072391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:33:43.915143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":348,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-10T23:26:20.097271+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:26:20.097271+0000","last_peered":"2024-09-10T23:26:20.097271+0000","last_clean":"2024-09-10T23:26:20.097271+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:26:20.097271+0000","last_undegraded":"2024-09-10T23:26:20.097271+0000","last_fullsized":"2024-09-10T23:26:20.097271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46964,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324876,"statfs":{"total":96636764160,"available":96588673024,"internally_reserved":0,"allocated":1925120,"data_stored":902102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509575,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47540,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324300,"statfs":{"total":96636764160,"available":96588083200,"internally_reserved":0,"allocated":2519040,"data_stored":1492422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59420,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312420,"statfs":{"total":96636764160,"available":96575918080,"internally_reserved":0,"allocated":1908736,"data_stored":894865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509575,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69152,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302688,"statfs":{"total":96636764160,"available":96565952512,"internally_reserved":0,"allocated":1908736,"data_stored":894865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509574,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69176,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302664,"statfs":{"total":96636764160,"available":96565927936,"internally_reserved":0,"allocated":1929216,"data_stored":902144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509575,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59436,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312404,"statfs":{"total":96636764160,"available":96575901696,"internally_reserved":0,"allocated":1925120,"data_stored":902102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509574,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73924,"kb_used_data":2480,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297916,"statfs":{"total":96636764160,"available":96561065984,"internally_reserved":0,"allocated":2539520,"data_stored":1494718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46980,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324860,"statfs":{"total":96636764160,"available":96588656640,"internally_reserved":0,"allocated":1941504,"data_stored":909340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:26:24.648 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:26:24.648 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:26:24.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.842+0000 7f3aaa400640 1 -- 172.21.15.17:0/2305396209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88004810 msgr2=0x7f3a88004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.842+0000 7f3aaa400640 1 --2- 172.21.15.17:0/2305396209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88004810 0x7f3a88004c90 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c009b60 tx=0x7f3a8c01d270 comp rx=0 tx=0).stop 2024-09-10T23:26:24.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.842+0000 7f3aa9a00640 1 -- 172.21.15.17:0/2305396209 reap_dead start 2024-09-10T23:26:24.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.842+0000 7f3aaa400640 1 -- 172.21.15.17:0/2305396209 shutdown_connections 2024-09-10T23:26:24.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.842+0000 7f3aaa400640 1 -- 172.21.15.17:0/2305396209 >> 172.21.15.17:0/2305396209 conn(0x7f3aa409d0f0 msgr2=0x7f3aa40d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:24.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.842+0000 7f3aaa400640 1 -- 172.21.15.17:0/2305396209 shutdown_connections 2024-09-10T23:26:24.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.842+0000 7f3aaa400640 1 -- 172.21.15.17:0/2305396209 wait complete. 2024-09-10T23:26:24.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.842+0000 7f3aaa400640 1 Processor -- start 2024-09-10T23:26:24.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 -- start start 2024-09-10T23:26:24.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88004810 0x7f3aa4157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa4163ec0 0x7f3aa40b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa40b7120 0x7f3aa40b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa40b50e0 con 0x7f3a88004810 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa40b2cb0 con 0x7f3aa40b7120 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa40b5260 con 0x7f3aa4163ec0 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88004810 0x7f3aa4157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88004810 0x7f3aa4157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33756/0 (socket says 172.21.15.17:33756) 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9000640 1 -- 172.21.15.17:0/4197414266 learned_addr learned my addr 172.21.15.17:0/4197414266 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3a9be00640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa4163ec0 0x7f3aa40b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9a00640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa40b7120 0x7f3aa40b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9000640 1 -- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa4163ec0 msgr2=0x7f3aa40b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9000640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa4163ec0 0x7f3aa40b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9000640 1 -- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa40b7120 msgr2=0x7f3aa40b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9000640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa40b7120 0x7f3aa40b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:24.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9000640 1 -- 172.21.15.17:0/4197414266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa40b88a0 con 0x7f3a88004810 2024-09-10T23:26:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9a00640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa40b7120 0x7f3aa40b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3a9be00640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa4163ec0 0x7f3aa40b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa9000640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88004810 0x7f3aa4157ec0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f3a94000fe0 tx=0x7f3a9400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa1600640 1 -- 172.21.15.17:0/4197414266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94004440 con 0x7f3a88004810 2024-09-10T23:26:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa1600640 1 -- 172.21.15.17:0/4197414266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a94016070 con 0x7f3a88004810 2024-09-10T23:26:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa40b8b80 con 0x7f3a88004810 2024-09-10T23:26:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aa1600640 1 -- 172.21.15.17:0/4197414266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9400ca40 con 0x7f3a88004810 2024-09-10T23:26:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa40b9140 con 0x7f3a88004810 2024-09-10T23:26:24.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.846+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa40b3e80 con 0x7f3a88004810 2024-09-10T23:26:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.850+0000 7f3aa1600640 1 -- 172.21.15.17:0/4197414266 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3a9400cbe0 con 0x7f3a88004810 2024-09-10T23:26:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.850+0000 7f3aa1600640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a80072610 0x7f3a80074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.850+0000 7f3aa1600640 1 -- 172.21.15.17:0/4197414266 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f3a94093940 con 0x7f3a88004810 2024-09-10T23:26:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.850+0000 7f3a9be00640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a80072610 0x7f3a80074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:24.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.850+0000 7f3a9be00640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a80072610 0x7f3a80074ad0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0ae000 tx=0x7f3a8c01a010 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:24.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:24.854+0000 7f3aa1600640 1 -- 172.21.15.17:0/4197414266 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3a9405ee80 con 0x7f3a88004810 2024-09-10T23:26:25.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.086+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3aa40b62d0 con 0x7f3a88004810 2024-09-10T23:26:25.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.090+0000 7f3aa1600640 1 -- 172.21.15.17:0/4197414266 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) ==== 190+0+147 (secure 0 0 0) 0x7f3a9405e780 con 0x7f3a88004810 2024-09-10T23:26:25.094 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:26:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:26:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:26:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:26:25.094 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:26:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:26:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a80072610 msgr2=0x7f3a80074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a80072610 0x7f3a80074ad0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0ae000 tx=0x7f3a8c01a010 comp rx=0 tx=0).stop 2024-09-10T23:26:25.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88004810 msgr2=0x7f3aa4157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88004810 0x7f3aa4157ec0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f3a94000fe0 tx=0x7f3a9400eb60 comp rx=0 tx=0).stop 2024-09-10T23:26:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 shutdown_connections 2024-09-10T23:26:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3a80072610 0x7f3a80074ad0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa40b7120 0x7f3aa40b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa4163ec0 0x7f3aa40b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 --2- 172.21.15.17:0/4197414266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a88004810 0x7f3aa4157ec0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 >> 172.21.15.17:0/4197414266 conn(0x7f3aa409d0f0 msgr2=0x7f3aa40d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 shutdown_connections 2024-09-10T23:26:25.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.094+0000 7f3aaa400640 1 -- 172.21.15.17:0/4197414266 wait complete. 2024-09-10T23:26:25.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.258+0000 7f6a73800640 1 -- 172.21.15.17:0/2249311461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c160660 msgr2=0x7f6a6c0af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.258+0000 7f6a73800640 1 --2- 172.21.15.17:0/2249311461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c160660 0x7f6a6c0af5a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c073bd0 tx=0x7f6a6401f580 comp rx=0 tx=0).stop 2024-09-10T23:26:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.258+0000 7f6a73800640 1 -- 172.21.15.17:0/2249311461 shutdown_connections 2024-09-10T23:26:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.258+0000 7f6a73800640 1 --2- 172.21.15.17:0/2249311461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c160660 0x7f6a6c0af5a0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.258+0000 7f6a73800640 1 --2- 172.21.15.17:0/2249311461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a6c0d2830 0x7f6a6c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.258+0000 7f6a73800640 1 --2- 172.21.15.17:0/2249311461 >> v2:172.21.15.77:3300/0 conn(0x7f6a6c160280 0x7f6a6c0cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.258+0000 7f6a73800640 1 -- 172.21.15.17:0/2249311461 >> 172.21.15.17:0/2249311461 conn(0x7f6a6c0d1d10 msgr2=0x7f6a6c0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 -- 172.21.15.17:0/2249311461 shutdown_connections 2024-09-10T23:26:25.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 -- 172.21.15.17:0/2249311461 wait complete. 2024-09-10T23:26:25.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 Processor -- start 2024-09-10T23:26:25.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 -- start start 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c0d2830 0x7f6a6c0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a6c160280 0x7f6a6c1f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6c160660 0x7f6a6c0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0b0060 con 0x7f6a6c0d2830 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c0afee0 con 0x7f6a6c160660 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a73800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0b01e0 con 0x7f6a6c160280 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a70e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c0d2830 0x7f6a6c0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a70e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c0d2830 0x7f6a6c0cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33778/0 (socket says 172.21.15.17:33778) 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a70e00640 1 -- 172.21.15.17:0/2445172233 learned_addr learned my addr 172.21.15.17:0/2445172233 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a63e00640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a6c160280 0x7f6a6c1f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a71800640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6c160660 0x7f6a6c0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:25.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a70e00640 1 -- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a6c160280 msgr2=0x7f6a6c1f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a70e00640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a6c160280 0x7f6a6c1f4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a70e00640 1 -- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6c160660 msgr2=0x7f6a6c0cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a70e00640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6c160660 0x7f6a6c0cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a70e00640 1 -- 172.21.15.17:0/2445172233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c0ce080 con 0x7f6a6c0d2830 2024-09-10T23:26:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.262+0000 7f6a70e00640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c0d2830 0x7f6a6c0cd460 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00d980 tx=0x7f6a5c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a69600640 1 -- 172.21.15.17:0/2445172233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c017070 con 0x7f6a6c0d2830 2024-09-10T23:26:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a69600640 1 -- 172.21.15.17:0/2445172233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a5c009d20 con 0x7f6a6c0d2830 2024-09-10T23:26:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c1f4cc0 con 0x7f6a6c0d2830 2024-09-10T23:26:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a69600640 1 -- 172.21.15.17:0/2445172233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0106c0 con 0x7f6a6c0d2830 2024-09-10T23:26:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c1f5280 con 0x7f6a6c0d2830 2024-09-10T23:26:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c0b0700 con 0x7f6a6c0d2830 2024-09-10T23:26:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a69600640 1 -- 172.21.15.17:0/2445172233 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6a5c010860 con 0x7f6a6c0d2830 2024-09-10T23:26:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a69600640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a480725e0 0x7f6a48074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a69600640 1 -- 172.21.15.17:0/2445172233 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f6a5c093830 con 0x7f6a6c0d2830 2024-09-10T23:26:25.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.266+0000 7f6a63e00640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a480725e0 0x7f6a48074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:25.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.270+0000 7f6a63e00640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a480725e0 0x7f6a48074aa0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0b7440 tx=0x7f6a5400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:25.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.270+0000 7f6a69600640 1 -- 172.21.15.17:0/2445172233 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6a5c05e600 con 0x7f6a6c0d2830 2024-09-10T23:26:25.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.482+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a6c074af0 con 0x7f6a6c0d2830 2024-09-10T23:26:25.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.482+0000 7f6a69600640 1 -- 172.21.15.17:0/2445172233 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f6a5c063030 con 0x7f6a6c0d2830 2024-09-10T23:26:25.486 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:25.486 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:26:25.487 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a480725e0 msgr2=0x7f6a48074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a480725e0 0x7f6a48074aa0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0b7440 tx=0x7f6a5400b2e0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c0d2830 msgr2=0x7f6a6c0cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c0d2830 0x7f6a6c0cd460 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00d980 tx=0x7f6a5c00de40 comp rx=0 tx=0).stop 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 shutdown_connections 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a480725e0 0x7f6a48074aa0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6c160660 0x7f6a6c0cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a6c160280 0x7f6a6c1f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 --2- 172.21.15.17:0/2445172233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a6c0d2830 0x7f6a6c0cd460 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 >> 172.21.15.17:0/2445172233 conn(0x7f6a6c0d1d10 msgr2=0x7f6a6c0d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 shutdown_connections 2024-09-10T23:26:25.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:25.486+0000 7f6a73800640 1 -- 172.21.15.17:0/2445172233 wait complete. 2024-09-10T23:26:25.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 112, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:26:19.498160+0000', 'modified': '2024-09-10T23:26:22.508026+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9201}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9201': {'gid': 9201, 'name': 'c', 'rank': 0, 'incarnation': 109, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/1449354346', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 1449354346}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 1449354346}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9201, 'qdb_cluster': [9201]} 2024-09-10T23:26:25.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:26:25.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:26:26.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 -- 172.21.15.17:0/139203757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c1546f0 msgr2=0x7f502c0726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 --2- 172.21.15.17:0/139203757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c1546f0 0x7f502c0726f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f501c00ad90 tx=0x7f501c01dcb0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 -- 172.21.15.17:0/139203757 shutdown_connections 2024-09-10T23:26:26.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 --2- 172.21.15.17:0/139203757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f502c0cf700 0x7f502c15b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 --2- 172.21.15.17:0/139203757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c1546f0 0x7f502c0726f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 -- 172.21.15.17:0/139203757 >> 172.21.15.17:0/139203757 conn(0x7f502c0b1730 msgr2=0x7f502c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 -- 172.21.15.17:0/139203757 shutdown_connections 2024-09-10T23:26:26.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 -- 172.21.15.17:0/139203757 wait complete. 2024-09-10T23:26:26.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 Processor -- start 2024-09-10T23:26:26.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.058+0000 7f5032000640 1 -- start start 2024-09-10T23:26:26.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5032000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f502c06ef80 0x7f502c14ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5032000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cf700 0x7f502c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5032000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f502c1546f0 0x7f502c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5032000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f502c15e710 con 0x7f502c1546f0 2024-09-10T23:26:26.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5032000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f502c15e590 con 0x7f502c0cf700 2024-09-10T23:26:26.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5032000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f502c15e890 con 0x7f502c06ef80 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f502c1546f0 0x7f502c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f502c1546f0 0x7f502c0cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33784/0 (socket says 172.21.15.17:33784) 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502be00640 1 -- 172.21.15.17:0/1891326434 learned_addr learned my addr 172.21.15.17:0/1891326434 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5022a00640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cf700 0x7f502c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502b400640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f502c06ef80 0x7f502c14ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502be00640 1 -- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f502c06ef80 msgr2=0x7f502c14ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502be00640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f502c06ef80 0x7f502c14ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502be00640 1 -- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cf700 msgr2=0x7f502c0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502be00640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cf700 0x7f502c0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502be00640 1 -- 172.21.15.17:0/1891326434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c0b4360 con 0x7f502c1546f0 2024-09-10T23:26:26.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f502be00640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f502c1546f0 0x7f502c0cdd10 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f502400e940 tx=0x7f502400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5023e00640 1 -- 172.21.15.17:0/1891326434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502400ccc0 con 0x7f502c1546f0 2024-09-10T23:26:26.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5023e00640 1 -- 172.21.15.17:0/1891326434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5024005020 con 0x7f502c1546f0 2024-09-10T23:26:26.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5032000640 1 -- 172.21.15.17:0/1891326434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c0aab70 con 0x7f502c1546f0 2024-09-10T23:26:26.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5023e00640 1 -- 172.21.15.17:0/1891326434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502400ce60 con 0x7f502c1546f0 2024-09-10T23:26:26.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.062+0000 7f5032000640 1 -- 172.21.15.17:0/1891326434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c1f8f70 con 0x7f502c1546f0 2024-09-10T23:26:26.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f5023e00640 1 -- 172.21.15.17:0/1891326434 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5024005450 con 0x7f502c1546f0 2024-09-10T23:26:26.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f5023e00640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50080725e0 0x7f5008074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f5023e00640 1 -- 172.21.15.17:0/1891326434 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f5024093e00 con 0x7f502c1546f0 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f502b400640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50080725e0 0x7f5008074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f50354b8000 1 Processor -- start 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f50354b8000 1 -- start start 2024-09-10T23:26:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f502b400640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50080725e0 0x7f5008074aa0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f501c0b0000 tx=0x7f501c01c4f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f50354b8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c881a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f50354b8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2c3bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f50354b8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2c3c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f50354b8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c3a2b583f0 con 0x55c3a2c3c220 2024-09-10T23:26:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f50354b8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c3a2a95b20 con 0x55c3a2c87dc0 2024-09-10T23:26:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f50354b8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c3a2a84f50 con 0x55c3a2c886e0 2024-09-10T23:26:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.065+0000 7f502be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2c3c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2c3c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33786/0 (socket says 172.21.15.17:33786) 2024-09-10T23:26:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502be00640 1 -- 172.21.15.17:0/914325773 learned_addr learned my addr 172.21.15.17:0/914325773 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502b400640 1 --2- 172.21.15.17:0/914325773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c881a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f5022a00640 1 --2- 172.21.15.17:0/914325773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2c3bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502be00640 1 -- 172.21.15.17:0/914325773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 msgr2=0x55c3a2c3bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502be00640 1 --2- 172.21.15.17:0/914325773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2c3bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502be00640 1 -- 172.21.15.17:0/914325773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 msgr2=0x55c3a2c881a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502be00640 1 --2- 172.21.15.17:0/914325773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c881a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502be00640 1 -- 172.21.15.17:0/914325773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a2a4c590 con 0x55c3a2c3c220 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502be00640 1 --2- 172.21.15.17:0/914325773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2c3c600 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f50240920d0 tx=0x7f502405eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed546e72cf27ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f501be00640 1 -- 172.21.15.17:0/914325773 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50240636a0 con 0x55c3a2c3c220 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f501be00640 1 -- 172.21.15.17:0/914325773 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50240680c0 con 0x55c3a2c3c220 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f501be00640 1 -- 172.21.15.17:0/914325773 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024067e90 con 0x55c3a2c3c220 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 -- 172.21.15.17:0/914325773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 msgr2=0x55c3a2c3c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 --2- 172.21.15.17:0/914325773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2c3c600 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f50240920d0 tx=0x7f502405eb70 comp rx=0 tx=0).stop 2024-09-10T23:26:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 -- 172.21.15.17:0/914325773 shutdown_connections 2024-09-10T23:26:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 --2- 172.21.15.17:0/914325773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2c3c600 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 --2- 172.21.15.17:0/914325773 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2c3bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 --2- 172.21.15.17:0/914325773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c881a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 -- 172.21.15.17:0/914325773 >> 172.21.15.17:0/914325773 conn(0x55c3a2b21130 msgr2=0x55c3a2c66e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 -- 172.21.15.17:0/914325773 shutdown_connections 2024-09-10T23:26:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 -- 172.21.15.17:0/914325773 wait complete. 2024-09-10T23:26:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 -- start start 2024-09-10T23:26:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 Processor -- start 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c3c220 0x55c3a2c72360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c728a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2c72de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c3a2a1f5d0 con 0x55c3a2c87dc0 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c3a2a88d60 con 0x55c3a2c3c220 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c3a2a2b500 con 0x55c3a2c886e0 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f50354b8000 10 client.0 _ll_register_callbacks cb 0x55c3a2a2f810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f5022a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f502b400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c3c220 0x55c3a2c72360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f5022a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33794/0 (socket says 172.21.15.17:33794) 2024-09-10T23:26:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.069+0000 7f5022a00640 1 -- 172.21.15.17:0/2168208067 learned_addr learned my addr 172.21.15.17:0/2168208067 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f502be00640 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2c72de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5022a00640 1 -- 172.21.15.17:0/2168208067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 msgr2=0x55c3a2c72de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5022a00640 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2c72de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5022a00640 1 -- 172.21.15.17:0/2168208067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c3c220 msgr2=0x55c3a2c72360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5022a00640 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c3c220 0x55c3a2c72360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5022a00640 1 -- 172.21.15.17:0/2168208067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a2a23170 con 0x55c3a2c87dc0 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5022a00640 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c728a0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f50140122f0 tx=0x7f50140127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b85636bb69866e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 1 -- 172.21.15.17:0/2168208067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014005320 con 0x55c3a2c87dc0 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 1 -- 172.21.15.17:0/2168208067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f5014018910 con 0x55c3a2c87dc0 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 -- 172.21.15.17:0/2168208067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c3a2a1d0f0 con 0x55c3a2c87dc0 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 1 -- 172.21.15.17:0/2168208067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f50140054c0 con 0x55c3a2c87dc0 2024-09-10T23:26:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 10 client.9318 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 -- 172.21.15.17:0/2168208067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55c3a2b09ef0 con 0x55c3a2c87dc0 2024-09-10T23:26:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 1 -- 172.21.15.17:0/2168208067 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c3a2a1d0f0 con 0x55c3a2c87dc0 2024-09-10T23:26:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 1 -- 172.21.15.17:0/2168208067 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f5014018c00 con 0x55c3a2c87dc0 2024-09-10T23:26:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 10 client.9318 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 10 client.9318 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:26:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 20 client.9318 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c3a2c737f0 0x55c3a2c99070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 4 client.9318 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 -- 172.21.15.17:0/2168208067 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3a2a97a70 con 0x55c3a2c737f0 2024-09-10T23:26:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f502b400640 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c3a2c737f0 0x55c3a2c99070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f502b400640 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c3a2c737f0 0x55c3a2c99070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=750f34b39e5ed6b4 server_cookie=1693d8072e48a17b in_seq=0 out_seq=0 2024-09-10T23:26:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 10 client.9318 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 1 -- 172.21.15.17:0/2168208067 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3a2a97a70 con 0x55c3a2c737f0 2024-09-10T23:26:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 10 client.9318 handle_command_reply: tid=0 2024-09-10T23:26:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 client.9318 shutdown 2024-09-10T23:26:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 -- 172.21.15.17:0/2168208067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 msgr2=0x55c3a2c728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c728a0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f50140122f0 tx=0x7f50140127b0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 -- 172.21.15.17:0/2168208067 shutdown_connections 2024-09-10T23:26:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c3a2c737f0 0x55c3a2c99070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2c72de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c728a0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 --2- 172.21.15.17:0/2168208067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c3c220 0x55c3a2c72360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 -- 172.21.15.17:0/2168208067 >> 172.21.15.17:0/2168208067 conn(0x55c3a2b21130 msgr2=0x55c3a2c368c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f5018c00640 0 client.9318 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 -- 172.21.15.17:0/2168208067 shutdown_connections 2024-09-10T23:26:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 1 -- 172.21.15.17:0/2168208067 wait complete. 2024-09-10T23:26:26.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.073+0000 7f50354b8000 20 client.9318 trim_cache size 0 max 16384 2024-09-10T23:26:26.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f50354b8000 1 Processor -- start 2024-09-10T23:26:26.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f50354b8000 1 -- start start 2024-09-10T23:26:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f50354b8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c3c220 0x55c3a2c44a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f50354b8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c44fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f50354b8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c886e0 0x55c3a2c99070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f50354b8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1f65c0 con 0x55c3a2c87dc0 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f50354b8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c3a2a8d390 con 0x55c3a2c886e0 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f50354b8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c3a2b44730 con 0x55c3a2c3c220 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f5022a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c44fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f5022a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c44fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33808/0 (socket says 172.21.15.17:33808) 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f5022a00640 1 -- 172.21.15.17:0/3784226835 learned_addr learned my addr 172.21.15.17:0/3784226835 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f502b400640 1 --2- 172.21.15.17:0/3784226835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c3c220 0x55c3a2c44a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.093+0000 7f502be00640 1 --2- 172.21.15.17:0/3784226835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c886e0 0x55c3a2c99070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f5022a00640 1 -- 172.21.15.17:0/3784226835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c3c220 msgr2=0x55c3a2c44a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f5022a00640 1 --2- 172.21.15.17:0/3784226835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c3c220 0x55c3a2c44a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f5022a00640 1 -- 172.21.15.17:0/3784226835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c886e0 msgr2=0x55c3a2c99070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:26.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f5022a00640 1 --2- 172.21.15.17:0/3784226835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c886e0 0x55c3a2c99070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f5022a00640 1 -- 172.21.15.17:0/3784226835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a2ae0d90 con 0x55c3a2c87dc0 2024-09-10T23:26:26.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f5022a00640 1 --2- 172.21.15.17:0/3784226835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c44fa0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f50140018e0 tx=0x7f5014007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41196173ce358f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f501b400640 1 -- 172.21.15.17:0/3784226835 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50140076d0 con 0x55c3a2c87dc0 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f501b400640 1 -- 172.21.15.17:0/3784226835 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50140067e0 con 0x55c3a2c87dc0 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f501b400640 1 -- 172.21.15.17:0/3784226835 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014006bf0 con 0x55c3a2c87dc0 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 -- 172.21.15.17:0/3784226835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 msgr2=0x55c3a2c44fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 --2- 172.21.15.17:0/3784226835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c44fa0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f50140018e0 tx=0x7f5014007be0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 -- 172.21.15.17:0/3784226835 shutdown_connections 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 --2- 172.21.15.17:0/3784226835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c886e0 0x55c3a2c99070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 --2- 172.21.15.17:0/3784226835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c87dc0 0x55c3a2c44fa0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 --2- 172.21.15.17:0/3784226835 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c3c220 0x55c3a2c44a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 -- 172.21.15.17:0/3784226835 >> 172.21.15.17:0/3784226835 conn(0x55c3a2b21130 msgr2=0x55c3a2c64150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 -- 172.21.15.17:0/3784226835 shutdown_connections 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 -- 172.21.15.17:0/3784226835 wait complete. 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 -- start start 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 Processor -- start 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2cfdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 0x55c3a2cfe320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2cfe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c3a2a948f0 con 0x55c3a2c3c220 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c3a2b09a60 con 0x55c3a2c87dc0 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c3a2a88070 con 0x55c3a2c886e0 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f50354b8000 10 client.0 _ll_register_callbacks cb 0x7f5014001b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f502b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2cfdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f502b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2cfdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33822/0 (socket says 172.21.15.17:33822) 2024-09-10T23:26:26.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f502b400640 1 -- 172.21.15.17:0/3452310398 learned_addr learned my addr 172.21.15.17:0/3452310398 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f5022a00640 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 0x55c3a2cfe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f502be00640 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2cfe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f502b400640 1 -- 172.21.15.17:0/3452310398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 msgr2=0x55c3a2cfe860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f502b400640 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2cfe860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f502b400640 1 -- 172.21.15.17:0/3452310398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 msgr2=0x55c3a2cfe320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f502b400640 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 0x55c3a2cfe320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.097+0000 7f502b400640 1 -- 172.21.15.17:0/3452310398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a2a4ba90 con 0x55c3a2c3c220 2024-09-10T23:26:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f502b400640 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2cfdde0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f501c00ad90 tx=0x7f501c00a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b969552c7f0b2fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:26.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 1 -- 172.21.15.17:0/3452310398 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c004040 con 0x55c3a2c3c220 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 1 -- 172.21.15.17:0/3452310398 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f501c0041e0 con 0x55c3a2c3c220 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 -- 172.21.15.17:0/3452310398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50140067e0 con 0x55c3a2c3c220 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 1 -- 172.21.15.17:0/3452310398 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f501c0d7050 con 0x55c3a2c3c220 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 10 client.9324 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 -- 172.21.15.17:0/3452310398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55c3a2a2a050 con 0x55c3a2c3c220 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 1 -- 172.21.15.17:0/3452310398 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50140067e0 con 0x55c3a2c3c220 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 1 -- 172.21.15.17:0/3452310398 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f501c0da020 con 0x55c3a2c3c220 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 10 client.9324 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 10 client.9324 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 20 client.9324 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c3a2d05030 0x55c3a2d07420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 4 client.9324 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:26:26.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 -- 172.21.15.17:0/3452310398 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "status"}) -- 0x55c3a2a93520 con 0x55c3a2d05030 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5022a00640 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c3a2d05030 0x55c3a2d07420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5022a00640 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c3a2d05030 0x55c3a2d07420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cee8de06f8f127c0 server_cookie=b73ec6a497ce6234 in_seq=0 out_seq=0 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 10 client.9324 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 1 -- 172.21.15.17:0/3452310398 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55c3a2a93520 con 0x55c3a2d05030 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 10 client.9324 handle_command_reply: tid=0 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 client.9324 shutdown 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 -- 172.21.15.17:0/3452310398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 msgr2=0x55c3a2cfdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2cfdde0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f501c00ad90 tx=0x7f501c00a6d0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 -- 172.21.15.17:0/3452310398 shutdown_connections 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c3a2d05030 0x55c3a2d07420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c3a2c886e0 0x55c3a2cfe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3a2c87dc0 0x55c3a2cfe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5018c00640 0 client.9324 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:26.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 --2- 172.21.15.17:0/3452310398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c3a2c3c220 0x55c3a2cfdde0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 -- 172.21.15.17:0/3452310398 >> 172.21.15.17:0/3452310398 conn(0x55c3a2b21130 msgr2=0x55c3a2c45280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 -- 172.21.15.17:0/3452310398 shutdown_connections 2024-09-10T23:26:26.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 1 -- 172.21.15.17:0/3452310398 wait complete. 2024-09-10T23:26:26.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f50354b8000 20 client.9324 trim_cache size 0 max 16384 2024-09-10T23:26:26.112 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:26.112 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:26:26.112 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:26:26.112 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 9201, 2024-09-10T23:26:26.113 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:26:26.113 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:26:26.113 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:26:26.113 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.0208032469999999, 2024-09-10T23:26:26.113 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 112, 2024-09-10T23:26:26.113 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 155, 2024-09-10T23:26:26.113 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 155, 2024-09-10T23:26:26.113 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 10.491890028 2024-09-10T23:26:26.113 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 -- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50080725e0 msgr2=0x7f5008074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50080725e0 0x7f5008074aa0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f501c0b0000 tx=0x7f501c01c4f0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 -- 172.21.15.17:0/1891326434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f502c1546f0 msgr2=0x7f502c0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f502c1546f0 0x7f502c0cdd10 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f502400e940 tx=0x7f502400ee00 comp rx=0 tx=0).stop 2024-09-10T23:26:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 -- 172.21.15.17:0/1891326434 shutdown_connections 2024-09-10T23:26:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50080725e0 0x7f5008074aa0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f502c1546f0 0x7f502c0cdd10 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f502c0cf700 0x7f502c0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 --2- 172.21.15.17:0/1891326434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f502c06ef80 0x7f502c14ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 -- 172.21.15.17:0/1891326434 >> 172.21.15.17:0/1891326434 conn(0x7f502c0b1730 msgr2=0x7f502c1533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 -- 172.21.15.17:0/1891326434 shutdown_connections 2024-09-10T23:26:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.101+0000 7f5032000640 1 -- 172.21.15.17:0/1891326434 wait complete. 2024-09-10T23:26:26.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:26:26.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.265+0000 7f710a600640 1 -- 172.21.15.17:0/3886984894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710415f130 msgr2=0x7f71040b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.265+0000 7f710a600640 1 --2- 172.21.15.17:0/3886984894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710415f130 0x7f71040b21d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009900 tx=0x7f70f401c8b0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 -- 172.21.15.17:0/3886984894 shutdown_connections 2024-09-10T23:26:26.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 --2- 172.21.15.17:0/3886984894 >> v2:172.21.15.77:3300/0 conn(0x7f71040d02e0 0x7f71040b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 --2- 172.21.15.17:0/3886984894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710415f130 0x7f71040b21d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 -- 172.21.15.17:0/3886984894 >> 172.21.15.17:0/3886984894 conn(0x7f71040b3870 msgr2=0x7f71040b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 -- 172.21.15.17:0/3886984894 shutdown_connections 2024-09-10T23:26:26.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 -- 172.21.15.17:0/3886984894 wait complete. 2024-09-10T23:26:26.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 Processor -- start 2024-09-10T23:26:26.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 -- start start 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71040d02e0 0x7f71040aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710415f130 0x7f71040c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710415f510 0x7f710414d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f71041691b0 con 0x7f710415f130 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7104169030 con 0x7f71040d02e0 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f710a600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7104169330 con 0x7f710415f510 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f70fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710415f130 0x7f71040c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f7103400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71040d02e0 0x7f71040aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f7103400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71040d02e0 0x7f71040aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:34032/0 (socket says 172.21.15.17:34032) 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f7103400640 1 -- 172.21.15.17:0/280962188 learned_addr learned my addr 172.21.15.17:0/280962188 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:26.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f7103e00640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710415f510 0x7f710414d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f70fbe00640 1 -- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710415f510 msgr2=0x7f710414d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f70fbe00640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710415f510 0x7f710414d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f70fbe00640 1 -- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71040d02e0 msgr2=0x7f71040aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f70fbe00640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71040d02e0 0x7f71040aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f70fbe00640 1 -- 172.21.15.17:0/280962188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71041fc2b0 con 0x7f710415f130 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.269+0000 7f7103400640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71040d02e0 0x7f71040aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f70fbe00640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710415f130 0x7f71040c8150 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e9f0 tx=0x7f70ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f70fb400640 1 -- 172.21.15.17:0/280962188 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00cc60 con 0x7f710415f130 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f70fb400640 1 -- 172.21.15.17:0/280962188 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70ec010430 con 0x7f710415f130 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f70fb400640 1 -- 172.21.15.17:0/280962188 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec010860 con 0x7f710415f130 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71041fb6a0 con 0x7f710415f130 2024-09-10T23:26:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71041fbc60 con 0x7f710415f130 2024-09-10T23:26:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71040b2a00 con 0x7f710415f130 2024-09-10T23:26:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f70fb400640 1 -- 172.21.15.17:0/280962188 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f70ec010a00 con 0x7f710415f130 2024-09-10T23:26:26.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f70fb400640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e0072610 0x7f70e0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:26.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f70fb400640 1 -- 172.21.15.17:0/280962188 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f70ec093d90 con 0x7f710415f130 2024-09-10T23:26:26.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.273+0000 7f7103400640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e0072610 0x7f70e0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:26.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.277+0000 7f7103400640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e0072610 0x7f70e0074ad0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f70f401af60 tx=0x7f70f401b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:26.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.277+0000 7f70fb400640 1 -- 172.21.15.17:0/280962188 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f70ec05ec80 con 0x7f710415f130 2024-09-10T23:26:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.489+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7104165fc0 con 0x7f710415f130 2024-09-10T23:26:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.489+0000 7f70fb400640 1 -- 172.21.15.17:0/280962188 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v112) ==== 53+0+73 (secure 0 0 0) 0x7f70ec0636b0 con 0x7f710415f130 2024-09-10T23:26:26.494 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:26:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e0072610 msgr2=0x7f70e0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e0072610 0x7f70e0074ad0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f70f401af60 tx=0x7f70f401b0f0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710415f130 msgr2=0x7f71040c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710415f130 0x7f71040c8150 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e9f0 tx=0x7f70ec00eeb0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 shutdown_connections 2024-09-10T23:26:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70e0072610 0x7f70e0074ad0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f710415f510 0x7f710414d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f710415f130 0x7f71040c8150 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 --2- 172.21.15.17:0/280962188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71040d02e0 0x7f71040aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 >> 172.21.15.17:0/280962188 conn(0x7f71040b3870 msgr2=0x7f71040720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 shutdown_connections 2024-09-10T23:26:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26.493+0000 7f710a600640 1 -- 172.21.15.17:0/280962188 wait complete. 2024-09-10T23:26:26.517 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:26:26.517 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:26:26.517 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:26:26.517 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:26:26.517 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:26.517 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:26:26.517 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:26:26.517 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:26:26.517 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:26:26.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:26.518 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:26:26.526 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:26.527 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41785sec preferred_lft 41785sec 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:26:26.528 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:26:26.529 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:26:26.530 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:26:26.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:26.530 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:26:26.589 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:26:26.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:26.591 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:26:26.644 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:26:26.644 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:26:26.644 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:26:26.644 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:26:26.644 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:26:26.644 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:26:26.645 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:26:26.645 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:26.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:26:26.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:26:26.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:26:26.645 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:26:26.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:26.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:26.787 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:26:26.797 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:26:26.797 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:26:26.797 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:26:26.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:26.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:26:26.859 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:26:26.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:26:26.859 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:26.916 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:26:26.916 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:26:26.916 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:26.970 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:26:27.031 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:26:27.088 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:26:27.088 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:26:27.089 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:26:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:26:27.091 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:26:27.091 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:26:27.091 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:26:27.091 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:27.091 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:27.091 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:26:27.091 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:26:27.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:27.092 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:26:27.143 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:26:27.144 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:26:27.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:26:27.211 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:26:27.265 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:26:27.266 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:26:27.267 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:26:27.267 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:26:27.267 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:26:27.267 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:26:27.267 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:27.267 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:26:27.267 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:26:27.267 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:26:27.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:27.268 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:26:27.286 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:26:27.281+0000 7f0200047580 -1 init, newargv = 0x55f664b97ae0 newargc=15 2024-09-10T23:26:27.286 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[78156]: starting ceph client 2024-09-10T23:26:27.292 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[78156]: starting fuse 2024-09-10T23:26:27.295 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:26:27.295 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:26:27.295 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:26:27.295 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:26:27.295 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:26:27.295 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:26:27.296 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:26:27.297 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:26:27.297 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:26:27.297 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:26:27.297 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:26:27.297 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:26:27.297 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:26:27.297 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:26:27.297 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:26:27.425 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.78156.asok 2024-09-10T23:26:27.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:27.437 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.78156.asok 2024-09-10T23:26:27.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:27.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.78156.asok status 2024-09-10T23:26:27.610 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:27.610 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:26:27.610 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "78156", 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 9336, 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:26:27.611 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 9336 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2004964836 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2004964836 2024-09-10T23:26:27.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.9336 192.168.0.1:0/2004964836", 2024-09-10T23:26:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/2004964836", 2024-09-10T23:26:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:26:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 112, 2024-09-10T23:26:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 155, 2024-09-10T23:26:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:26:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:26:27.613 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:26:27.613 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:27.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:27.625 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:26:27.626 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:27.635 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:26:27.635 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:27.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:27.635 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:26:27.699 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:27.699 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:27.699 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T23:26:27.699 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:27.699 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:27.699 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:27.699 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:27.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.823 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169644 s, 61.8 MB/s 2024-09-10T23:26:27.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.840 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127224 s, 82.4 MB/s 2024-09-10T23:26:27.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183444 s, 57.2 MB/s 2024-09-10T23:26:27.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.877 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118623 s, 88.4 MB/s 2024-09-10T23:26:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.898 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171137 s, 61.3 MB/s 2024-09-10T23:26:27.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.915 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138066 s, 75.9 MB/s 2024-09-10T23:26:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.936 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174224 s, 60.2 MB/s 2024-09-10T23:26:27.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.956 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164705 s, 63.7 MB/s 2024-09-10T23:26:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.973 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.974 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136886 s, 76.6 MB/s 2024-09-10T23:26:27.991 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:27.991 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:27.991 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139461 s, 75.2 MB/s 2024-09-10T23:26:28.009 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.009 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.009 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01445 s, 72.6 MB/s 2024-09-10T23:26:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01523 s, 68.8 MB/s 2024-09-10T23:26:28.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.043 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118214 s, 88.7 MB/s 2024-09-10T23:26:28.061 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.062 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146589 s, 71.5 MB/s 2024-09-10T23:26:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137297 s, 76.4 MB/s 2024-09-10T23:26:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.097 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137078 s, 76.5 MB/s 2024-09-10T23:26:28.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.115 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146013 s, 71.8 MB/s 2024-09-10T23:26:28.131 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.132 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.132 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013283 s, 78.9 MB/s 2024-09-10T23:26:28.149 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.149 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.149 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132166 s, 79.3 MB/s 2024-09-10T23:26:28.167 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146027 s, 71.8 MB/s 2024-09-10T23:26:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136739 s, 76.7 MB/s 2024-09-10T23:26:28.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.203 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135364 s, 77.5 MB/s 2024-09-10T23:26:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.221 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133698 s, 78.4 MB/s 2024-09-10T23:26:28.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.238 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130681 s, 80.2 MB/s 2024-09-10T23:26:28.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.255 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129665 s, 80.9 MB/s 2024-09-10T23:26:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131093 s, 80.0 MB/s 2024-09-10T23:26:28.290 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.290 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.290 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141627 s, 74.0 MB/s 2024-09-10T23:26:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127587 s, 82.2 MB/s 2024-09-10T23:26:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121289 s, 86.5 MB/s 2024-09-10T23:26:28.339 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.339 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.339 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126563 s, 82.9 MB/s 2024-09-10T23:26:28.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.355 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132181 s, 79.3 MB/s 2024-09-10T23:26:28.372 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.372 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.372 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133438 s, 78.6 MB/s 2024-09-10T23:26:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:28.380 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:28.380 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:28.380 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T23:26:28.380 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:28.380 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:28.380 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:28.380 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:28.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131695 s, 79.6 MB/s 2024-09-10T23:26:28.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123407 s, 85.0 MB/s 2024-09-10T23:26:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131547 s, 79.7 MB/s 2024-09-10T23:26:28.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.502 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135377 s, 77.5 MB/s 2024-09-10T23:26:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129407 s, 81.0 MB/s 2024-09-10T23:26:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.536 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130449 s, 80.4 MB/s 2024-09-10T23:26:28.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.552 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124817 s, 84.0 MB/s 2024-09-10T23:26:28.569 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.569 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.569 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012544 s, 83.6 MB/s 2024-09-10T23:26:28.585 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.585 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.585 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128316 s, 81.7 MB/s 2024-09-10T23:26:28.601 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132411 s, 79.2 MB/s 2024-09-10T23:26:28.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.620 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141153 s, 74.3 MB/s 2024-09-10T23:26:28.636 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.636 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.636 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127559 s, 82.2 MB/s 2024-09-10T23:26:28.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.654 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143299 s, 73.2 MB/s 2024-09-10T23:26:28.671 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.671 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.671 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137077 s, 76.5 MB/s 2024-09-10T23:26:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.689 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129624 s, 80.9 MB/s 2024-09-10T23:26:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118848 s, 88.2 MB/s 2024-09-10T23:26:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124345 s, 84.3 MB/s 2024-09-10T23:26:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131759 s, 79.6 MB/s 2024-09-10T23:26:28.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129597 s, 80.9 MB/s 2024-09-10T23:26:28.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.770 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128056 s, 81.9 MB/s 2024-09-10T23:26:28.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.787 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130629 s, 80.3 MB/s 2024-09-10T23:26:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119897 s, 87.5 MB/s 2024-09-10T23:26:28.818 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.819 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126187 s, 83.1 MB/s 2024-09-10T23:26:28.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.838 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158131 s, 66.3 MB/s 2024-09-10T23:26:28.855 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.856 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137279 s, 76.4 MB/s 2024-09-10T23:26:28.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.873 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132089 s, 79.4 MB/s 2024-09-10T23:26:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.889 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128701 s, 81.5 MB/s 2024-09-10T23:26:28.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.906 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125002 s, 83.9 MB/s 2024-09-10T23:26:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120384 s, 87.1 MB/s 2024-09-10T23:26:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120092 s, 87.3 MB/s 2024-09-10T23:26:28.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132824 s, 78.9 MB/s 2024-09-10T23:26:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117502 s, 89.2 MB/s 2024-09-10T23:26:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:28.977 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:28.977 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:28.977 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T23:26:28.977 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:28.977 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:28.977 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:28.977 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:29.050 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.050 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.050 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137854 s, 76.1 MB/s 2024-09-10T23:26:29.067 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.067 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.067 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135226 s, 77.5 MB/s 2024-09-10T23:26:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.083 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117214 s, 89.5 MB/s 2024-09-10T23:26:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152738 s, 68.7 MB/s 2024-09-10T23:26:29.117 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.117 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.117 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120347 s, 87.1 MB/s 2024-09-10T23:26:29.134 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.134 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.134 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129004 s, 81.3 MB/s 2024-09-10T23:26:29.150 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128892 s, 81.4 MB/s 2024-09-10T23:26:29.167 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.167 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.168 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133938 s, 78.3 MB/s 2024-09-10T23:26:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133067 s, 78.8 MB/s 2024-09-10T23:26:29.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.201 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012191 s, 86.0 MB/s 2024-09-10T23:26:29.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128229 s, 81.8 MB/s 2024-09-10T23:26:29.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.235 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139753 s, 75.0 MB/s 2024-09-10T23:26:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.252 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134799 s, 77.8 MB/s 2024-09-10T23:26:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129403 s, 81.0 MB/s 2024-09-10T23:26:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.286 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132756 s, 79.0 MB/s 2024-09-10T23:26:29.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.303 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132706 s, 79.0 MB/s 2024-09-10T23:26:29.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.320 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131424 s, 79.8 MB/s 2024-09-10T23:26:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127142 s, 82.5 MB/s 2024-09-10T23:26:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125127 s, 83.8 MB/s 2024-09-10T23:26:29.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.369 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125787 s, 83.4 MB/s 2024-09-10T23:26:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129974 s, 80.7 MB/s 2024-09-10T23:26:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129511 s, 81.0 MB/s 2024-09-10T23:26:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.418 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.419 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129482 s, 81.0 MB/s 2024-09-10T23:26:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137876 s, 76.1 MB/s 2024-09-10T23:26:29.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124198 s, 84.4 MB/s 2024-09-10T23:26:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.469 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129412 s, 81.0 MB/s 2024-09-10T23:26:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140261 s, 74.8 MB/s 2024-09-10T23:26:29.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.506 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.506 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152469 s, 68.8 MB/s 2024-09-10T23:26:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136156 s, 77.0 MB/s 2024-09-10T23:26:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121246 s, 86.5 MB/s 2024-09-10T23:26:29.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.555 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124817 s, 84.0 MB/s 2024-09-10T23:26:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124054 s, 84.5 MB/s 2024-09-10T23:26:29.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:29.579 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:29.579 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:29.579 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T23:26:29.579 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:29.579 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:29.579 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:29.579 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:29.651 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.651 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.651 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138655 s, 75.6 MB/s 2024-09-10T23:26:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.667 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124852 s, 84.0 MB/s 2024-09-10T23:26:29.686 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.686 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.686 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148153 s, 70.8 MB/s 2024-09-10T23:26:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.703 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.703 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013001 s, 80.7 MB/s 2024-09-10T23:26:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134334 s, 78.1 MB/s 2024-09-10T23:26:29.737 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.737 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.737 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134741 s, 77.8 MB/s 2024-09-10T23:26:29.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.755 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.755 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140356 s, 74.7 MB/s 2024-09-10T23:26:29.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.772 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134032 s, 78.2 MB/s 2024-09-10T23:26:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123311 s, 85.0 MB/s 2024-09-10T23:26:29.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.805 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139261 s, 75.3 MB/s 2024-09-10T23:26:29.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.823 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134305 s, 78.1 MB/s 2024-09-10T23:26:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.838 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122999 s, 85.3 MB/s 2024-09-10T23:26:29.855 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.856 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.856 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134424 s, 78.0 MB/s 2024-09-10T23:26:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118787 s, 88.3 MB/s 2024-09-10T23:26:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144652 s, 72.5 MB/s 2024-09-10T23:26:29.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013522 s, 77.5 MB/s 2024-09-10T23:26:29.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.923 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126258 s, 83.0 MB/s 2024-09-10T23:26:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.939 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127466 s, 82.3 MB/s 2024-09-10T23:26:29.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.957 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.957 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135912 s, 77.2 MB/s 2024-09-10T23:26:29.973 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.973 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.973 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130957 s, 80.1 MB/s 2024-09-10T23:26:29.989 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:29.990 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:29.990 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126653 s, 82.8 MB/s 2024-09-10T23:26:30.007 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.007 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.007 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135497 s, 77.4 MB/s 2024-09-10T23:26:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.024 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134367 s, 78.0 MB/s 2024-09-10T23:26:30.041 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.041 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.041 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133231 s, 78.7 MB/s 2024-09-10T23:26:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.057 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012863 s, 81.5 MB/s 2024-09-10T23:26:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011667 s, 89.9 MB/s 2024-09-10T23:26:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135772 s, 77.2 MB/s 2024-09-10T23:26:30.107 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.107 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.107 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134549 s, 77.9 MB/s 2024-09-10T23:26:30.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.124 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013084 s, 80.1 MB/s 2024-09-10T23:26:30.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.142 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140815 s, 74.5 MB/s 2024-09-10T23:26:30.158 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.158 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.158 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127268 s, 82.4 MB/s 2024-09-10T23:26:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.174 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128528 s, 81.6 MB/s 2024-09-10T23:26:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:30.182 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:30.182 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:30.182 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T23:26:30.182 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:30.182 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:30.182 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:30.182 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:30.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:30.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.253 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125961 s, 83.2 MB/s 2024-09-10T23:26:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.271 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013185 s, 79.5 MB/s 2024-09-10T23:26:30.287 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.288 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136337 s, 76.9 MB/s 2024-09-10T23:26:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119504 s, 87.7 MB/s 2024-09-10T23:26:30.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.320 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128142 s, 81.8 MB/s 2024-09-10T23:26:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.337 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125156 s, 83.8 MB/s 2024-09-10T23:26:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.354 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135337 s, 77.5 MB/s 2024-09-10T23:26:30.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.370 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133005 s, 78.8 MB/s 2024-09-10T23:26:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.388 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134347 s, 78.0 MB/s 2024-09-10T23:26:30.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.405 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013211 s, 79.4 MB/s 2024-09-10T23:26:30.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.422 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133685 s, 78.4 MB/s 2024-09-10T23:26:30.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.438 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130977 s, 80.1 MB/s 2024-09-10T23:26:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125934 s, 83.3 MB/s 2024-09-10T23:26:30.471 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.471 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.471 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128998 s, 81.3 MB/s 2024-09-10T23:26:30.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.487 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124803 s, 84.0 MB/s 2024-09-10T23:26:30.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.505 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139101 s, 75.4 MB/s 2024-09-10T23:26:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128993 s, 81.3 MB/s 2024-09-10T23:26:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.539 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139715 s, 75.1 MB/s 2024-09-10T23:26:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130943 s, 80.1 MB/s 2024-09-10T23:26:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132869 s, 78.9 MB/s 2024-09-10T23:26:30.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.590 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133629 s, 78.5 MB/s 2024-09-10T23:26:30.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.608 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138524 s, 75.7 MB/s 2024-09-10T23:26:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132425 s, 79.2 MB/s 2024-09-10T23:26:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016769 s, 62.5 MB/s 2024-09-10T23:26:30.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.670 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185054 s, 56.7 MB/s 2024-09-10T23:26:30.686 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.687 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.687 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134382 s, 78.0 MB/s 2024-09-10T23:26:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124427 s, 84.3 MB/s 2024-09-10T23:26:30.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.719 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130394 s, 80.4 MB/s 2024-09-10T23:26:30.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.736 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125293 s, 83.7 MB/s 2024-09-10T23:26:30.751 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.751 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.751 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121126 s, 86.6 MB/s 2024-09-10T23:26:30.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012605 s, 83.2 MB/s 2024-09-10T23:26:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125084 s, 83.8 MB/s 2024-09-10T23:26:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:30.791 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:30.791 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:30.791 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T23:26:30.792 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:30.792 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:30.792 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:30.792 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:30.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:30.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.865 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137817 s, 76.1 MB/s 2024-09-10T23:26:30.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.880 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118998 s, 88.1 MB/s 2024-09-10T23:26:30.896 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.897 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126815 s, 82.7 MB/s 2024-09-10T23:26:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.913 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133657 s, 78.5 MB/s 2024-09-10T23:26:30.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.931 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134127 s, 78.2 MB/s 2024-09-10T23:26:30.947 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.947 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.947 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013011 s, 80.6 MB/s 2024-09-10T23:26:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.964 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.965 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136844 s, 76.6 MB/s 2024-09-10T23:26:30.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134284 s, 78.1 MB/s 2024-09-10T23:26:30.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:30.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:30.998 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130007 s, 80.7 MB/s 2024-09-10T23:26:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133584 s, 78.5 MB/s 2024-09-10T23:26:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014216 s, 73.8 MB/s 2024-09-10T23:26:31.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121069 s, 86.6 MB/s 2024-09-10T23:26:31.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125002 s, 83.9 MB/s 2024-09-10T23:26:31.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.081 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127041 s, 82.5 MB/s 2024-09-10T23:26:31.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.097 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122412 s, 85.7 MB/s 2024-09-10T23:26:31.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.113 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125128 s, 83.8 MB/s 2024-09-10T23:26:31.131 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014527 s, 72.2 MB/s 2024-09-10T23:26:31.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.149 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134064 s, 78.2 MB/s 2024-09-10T23:26:31.165 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.165 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.165 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130942 s, 80.1 MB/s 2024-09-10T23:26:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129656 s, 80.9 MB/s 2024-09-10T23:26:31.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.198 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125674 s, 83.4 MB/s 2024-09-10T23:26:31.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.216 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136006 s, 77.1 MB/s 2024-09-10T23:26:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.232 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131094 s, 80.0 MB/s 2024-09-10T23:26:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129168 s, 81.2 MB/s 2024-09-10T23:26:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.265 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012689 s, 82.6 MB/s 2024-09-10T23:26:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136401 s, 76.9 MB/s 2024-09-10T23:26:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128469 s, 81.6 MB/s 2024-09-10T23:26:31.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.315 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128947 s, 81.3 MB/s 2024-09-10T23:26:31.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.331 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125329 s, 83.7 MB/s 2024-09-10T23:26:31.348 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.348 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.348 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132429 s, 79.2 MB/s 2024-09-10T23:26:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.365 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129843 s, 80.8 MB/s 2024-09-10T23:26:31.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.382 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137061 s, 76.5 MB/s 2024-09-10T23:26:31.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:31.389 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:31.390 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:31.390 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T23:26:31.390 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:31.390 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:31.390 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:31.390 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:31.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.463 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138804 s, 75.5 MB/s 2024-09-10T23:26:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012187 s, 86.0 MB/s 2024-09-10T23:26:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.495 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131232 s, 79.9 MB/s 2024-09-10T23:26:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121505 s, 86.3 MB/s 2024-09-10T23:26:31.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.528 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133226 s, 78.7 MB/s 2024-09-10T23:26:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.545 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131814 s, 79.5 MB/s 2024-09-10T23:26:31.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135608 s, 77.3 MB/s 2024-09-10T23:26:31.578 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.578 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.578 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125037 s, 83.9 MB/s 2024-09-10T23:26:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.596 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.596 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137946 s, 76.0 MB/s 2024-09-10T23:26:31.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.612 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129374 s, 81.0 MB/s 2024-09-10T23:26:31.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.628 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012402 s, 84.5 MB/s 2024-09-10T23:26:31.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.644 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123904 s, 84.6 MB/s 2024-09-10T23:26:31.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.660 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119994 s, 87.4 MB/s 2024-09-10T23:26:31.675 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.675 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.675 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115601 s, 90.7 MB/s 2024-09-10T23:26:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114477 s, 91.6 MB/s 2024-09-10T23:26:31.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107336 s, 97.7 MB/s 2024-09-10T23:26:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.721 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01235 s, 84.9 MB/s 2024-09-10T23:26:31.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122931 s, 85.3 MB/s 2024-09-10T23:26:31.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.752 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117259 s, 89.4 MB/s 2024-09-10T23:26:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121555 s, 86.3 MB/s 2024-09-10T23:26:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.784 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123642 s, 84.8 MB/s 2024-09-10T23:26:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118584 s, 88.4 MB/s 2024-09-10T23:26:31.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.815 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118304 s, 88.6 MB/s 2024-09-10T23:26:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114563 s, 91.5 MB/s 2024-09-10T23:26:31.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.846 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125213 s, 83.7 MB/s 2024-09-10T23:26:31.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111013 s, 94.5 MB/s 2024-09-10T23:26:31.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.877 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120364 s, 87.1 MB/s 2024-09-10T23:26:31.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.892 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116195 s, 90.2 MB/s 2024-09-10T23:26:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.908 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115967 s, 90.4 MB/s 2024-09-10T23:26:31.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.923 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120333 s, 87.1 MB/s 2024-09-10T23:26:31.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.938 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113008 s, 92.8 MB/s 2024-09-10T23:26:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122633 s, 85.5 MB/s 2024-09-10T23:26:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:31.961 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:31.962 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:31.962 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T23:26:31.962 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:31.962 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:31.962 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:31.962 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:32.034 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.034 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.034 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129129 s, 81.2 MB/s 2024-09-10T23:26:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115309 s, 90.9 MB/s 2024-09-10T23:26:32.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113715 s, 92.2 MB/s 2024-09-10T23:26:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118177 s, 88.7 MB/s 2024-09-10T23:26:32.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.097 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123607 s, 84.8 MB/s 2024-09-10T23:26:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130919 s, 80.1 MB/s 2024-09-10T23:26:32.129 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.129 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.129 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012167 s, 86.2 MB/s 2024-09-10T23:26:32.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.145 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117492 s, 89.2 MB/s 2024-09-10T23:26:32.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.159 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107048 s, 98.0 MB/s 2024-09-10T23:26:32.175 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.175 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.175 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118924 s, 88.2 MB/s 2024-09-10T23:26:32.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.190 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116115 s, 90.3 MB/s 2024-09-10T23:26:32.206 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.206 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.206 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126014 s, 83.2 MB/s 2024-09-10T23:26:32.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.222 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119813 s, 87.5 MB/s 2024-09-10T23:26:32.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.238 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124199 s, 84.4 MB/s 2024-09-10T23:26:32.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.254 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115238 s, 91.0 MB/s 2024-09-10T23:26:32.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.268 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112667 s, 93.1 MB/s 2024-09-10T23:26:32.283 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.283 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.283 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113463 s, 92.4 MB/s 2024-09-10T23:26:32.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.298 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110913 s, 94.5 MB/s 2024-09-10T23:26:32.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.313 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116908 s, 89.7 MB/s 2024-09-10T23:26:32.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.328 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106454 s, 98.5 MB/s 2024-09-10T23:26:32.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.343 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117608 s, 89.2 MB/s 2024-09-10T23:26:32.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124812 s, 84.0 MB/s 2024-09-10T23:26:32.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.375 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117017 s, 89.6 MB/s 2024-09-10T23:26:32.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.391 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127032 s, 82.5 MB/s 2024-09-10T23:26:32.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125011 s, 83.9 MB/s 2024-09-10T23:26:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115816 s, 90.5 MB/s 2024-09-10T23:26:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.437 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011016 s, 95.2 MB/s 2024-09-10T23:26:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115013 s, 91.2 MB/s 2024-09-10T23:26:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.467 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011436 s, 91.7 MB/s 2024-09-10T23:26:32.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.483 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125721 s, 83.4 MB/s 2024-09-10T23:26:32.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117723 s, 89.1 MB/s 2024-09-10T23:26:32.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.515 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.515 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120453 s, 87.1 MB/s 2024-09-10T23:26:32.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:32.522 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:32.522 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:32.523 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T23:26:32.523 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:32.523 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:32.523 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:32.523 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.593 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116858 s, 89.7 MB/s 2024-09-10T23:26:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01195 s, 87.7 MB/s 2024-09-10T23:26:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119238 s, 87.9 MB/s 2024-09-10T23:26:32.639 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.639 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.640 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115574 s, 90.7 MB/s 2024-09-10T23:26:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.656 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124825 s, 84.0 MB/s 2024-09-10T23:26:32.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.672 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012964 s, 80.9 MB/s 2024-09-10T23:26:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110076 s, 95.3 MB/s 2024-09-10T23:26:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123754 s, 84.7 MB/s 2024-09-10T23:26:32.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.719 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121915 s, 86.0 MB/s 2024-09-10T23:26:32.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.735 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122449 s, 85.6 MB/s 2024-09-10T23:26:32.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.751 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116639 s, 89.9 MB/s 2024-09-10T23:26:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.766 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120161 s, 87.3 MB/s 2024-09-10T23:26:32.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.781 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112617 s, 93.1 MB/s 2024-09-10T23:26:32.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110809 s, 94.6 MB/s 2024-09-10T23:26:32.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119558 s, 87.7 MB/s 2024-09-10T23:26:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126087 s, 83.2 MB/s 2024-09-10T23:26:32.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122015 s, 85.9 MB/s 2024-09-10T23:26:32.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.859 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117981 s, 88.9 MB/s 2024-09-10T23:26:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117793 s, 89.0 MB/s 2024-09-10T23:26:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110171 s, 95.2 MB/s 2024-09-10T23:26:32.904 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.905 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120311 s, 87.2 MB/s 2024-09-10T23:26:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125491 s, 83.6 MB/s 2024-09-10T23:26:32.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.936 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116065 s, 90.3 MB/s 2024-09-10T23:26:32.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.952 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011896 s, 88.1 MB/s 2024-09-10T23:26:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.967 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112588 s, 93.1 MB/s 2024-09-10T23:26:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.983 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118753 s, 88.3 MB/s 2024-09-10T23:26:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119249 s, 87.9 MB/s 2024-09-10T23:26:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.014 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012262 s, 85.5 MB/s 2024-09-10T23:26:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129559 s, 80.9 MB/s 2024-09-10T23:26:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01168 s, 89.8 MB/s 2024-09-10T23:26:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124027 s, 84.5 MB/s 2024-09-10T23:26:33.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115943 s, 90.4 MB/s 2024-09-10T23:26:33.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:33.085 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:33.085 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:33.085 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T23:26:33.086 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:33.086 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:33.086 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:33.086 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:33.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130242 s, 80.5 MB/s 2024-09-10T23:26:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.174 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123307 s, 85.0 MB/s 2024-09-10T23:26:33.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.189 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123156 s, 85.1 MB/s 2024-09-10T23:26:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116336 s, 90.1 MB/s 2024-09-10T23:26:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.220 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109611 s, 95.7 MB/s 2024-09-10T23:26:33.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.235 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011297 s, 92.8 MB/s 2024-09-10T23:26:33.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.251 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127956 s, 81.9 MB/s 2024-09-10T23:26:33.266 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.266 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.266 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118353 s, 88.6 MB/s 2024-09-10T23:26:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.281 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111368 s, 94.2 MB/s 2024-09-10T23:26:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.298 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131235 s, 79.9 MB/s 2024-09-10T23:26:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010942 s, 95.8 MB/s 2024-09-10T23:26:33.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.329 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120116 s, 87.3 MB/s 2024-09-10T23:26:33.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.344 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112954 s, 92.8 MB/s 2024-09-10T23:26:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115988 s, 90.4 MB/s 2024-09-10T23:26:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116349 s, 90.1 MB/s 2024-09-10T23:26:33.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.389 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110546 s, 94.9 MB/s 2024-09-10T23:26:33.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.404 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114897 s, 91.3 MB/s 2024-09-10T23:26:33.419 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.419 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.419 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115109 s, 91.1 MB/s 2024-09-10T23:26:33.435 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127823 s, 82.0 MB/s 2024-09-10T23:26:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011075 s, 94.7 MB/s 2024-09-10T23:26:33.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.466 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.466 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116875 s, 89.7 MB/s 2024-09-10T23:26:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133352 s, 78.6 MB/s 2024-09-10T23:26:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125874 s, 83.3 MB/s 2024-09-10T23:26:33.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.514 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114555 s, 91.5 MB/s 2024-09-10T23:26:33.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.530 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118547 s, 88.5 MB/s 2024-09-10T23:26:33.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.546 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122254 s, 85.8 MB/s 2024-09-10T23:26:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012396 s, 84.6 MB/s 2024-09-10T23:26:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113383 s, 92.5 MB/s 2024-09-10T23:26:33.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.592 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120911 s, 86.7 MB/s 2024-09-10T23:26:33.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.608 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119431 s, 87.8 MB/s 2024-09-10T23:26:33.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.622 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108579 s, 96.6 MB/s 2024-09-10T23:26:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.638 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122587 s, 85.5 MB/s 2024-09-10T23:26:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:33.646 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:33.646 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:33.646 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T23:26:33.646 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:33.646 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:33.646 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:33.646 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:33.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:33.717 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.717 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.717 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121204 s, 86.5 MB/s 2024-09-10T23:26:33.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.733 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.733 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011853 s, 88.5 MB/s 2024-09-10T23:26:33.748 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.748 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.748 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012034 s, 87.1 MB/s 2024-09-10T23:26:33.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.765 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123891 s, 84.6 MB/s 2024-09-10T23:26:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.780 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112401 s, 93.3 MB/s 2024-09-10T23:26:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117708 s, 89.1 MB/s 2024-09-10T23:26:33.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.812 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133566 s, 78.5 MB/s 2024-09-10T23:26:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118935 s, 88.2 MB/s 2024-09-10T23:26:33.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.843 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120329 s, 87.1 MB/s 2024-09-10T23:26:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011954 s, 87.7 MB/s 2024-09-10T23:26:33.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.873 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107265 s, 97.8 MB/s 2024-09-10T23:26:33.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.890 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135994 s, 77.1 MB/s 2024-09-10T23:26:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116494 s, 90.0 MB/s 2024-09-10T23:26:33.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110396 s, 95.0 MB/s 2024-09-10T23:26:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112241 s, 93.4 MB/s 2024-09-10T23:26:33.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.951 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123155 s, 85.1 MB/s 2024-09-10T23:26:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.967 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117045 s, 89.6 MB/s 2024-09-10T23:26:33.982 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.982 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.982 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117947 s, 88.9 MB/s 2024-09-10T23:26:33.997 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:33.997 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:33.997 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011427 s, 91.8 MB/s 2024-09-10T23:26:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117238 s, 89.4 MB/s 2024-09-10T23:26:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122664 s, 85.5 MB/s 2024-09-10T23:26:34.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.044 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.044 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113213 s, 92.6 MB/s 2024-09-10T23:26:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116475 s, 90.0 MB/s 2024-09-10T23:26:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113303 s, 92.5 MB/s 2024-09-10T23:26:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012019 s, 87.2 MB/s 2024-09-10T23:26:34.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.105 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121592 s, 86.2 MB/s 2024-09-10T23:26:34.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.121 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011654 s, 90.0 MB/s 2024-09-10T23:26:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.136 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119468 s, 87.8 MB/s 2024-09-10T23:26:34.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.152 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121302 s, 86.4 MB/s 2024-09-10T23:26:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121182 s, 86.5 MB/s 2024-09-10T23:26:34.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.184 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119903 s, 87.5 MB/s 2024-09-10T23:26:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.200 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124206 s, 84.4 MB/s 2024-09-10T23:26:34.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:34.207 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:34.207 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:34.207 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T23:26:34.208 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:34.208 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:34.208 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:34.208 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:34.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:34.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114125 s, 91.9 MB/s 2024-09-10T23:26:34.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.293 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115862 s, 90.5 MB/s 2024-09-10T23:26:34.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.323 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010512 s, 99.8 MB/s 2024-09-10T23:26:34.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.338 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119008 s, 88.1 MB/s 2024-09-10T23:26:34.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.354 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123384 s, 85.0 MB/s 2024-09-10T23:26:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117474 s, 89.3 MB/s 2024-09-10T23:26:34.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.385 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116115 s, 90.3 MB/s 2024-09-10T23:26:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.401 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130919 s, 80.1 MB/s 2024-09-10T23:26:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123548 s, 84.9 MB/s 2024-09-10T23:26:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.434 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011931 s, 87.9 MB/s 2024-09-10T23:26:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111589 s, 94.0 MB/s 2024-09-10T23:26:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.465 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109926 s, 95.4 MB/s 2024-09-10T23:26:34.480 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.480 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.480 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114179 s, 91.8 MB/s 2024-09-10T23:26:34.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.496 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119497 s, 87.7 MB/s 2024-09-10T23:26:34.513 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.513 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.513 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124909 s, 83.9 MB/s 2024-09-10T23:26:34.529 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.530 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121686 s, 86.2 MB/s 2024-09-10T23:26:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011644 s, 90.1 MB/s 2024-09-10T23:26:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121798 s, 86.1 MB/s 2024-09-10T23:26:34.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109251 s, 96.0 MB/s 2024-09-10T23:26:34.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.593 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119516 s, 87.7 MB/s 2024-09-10T23:26:34.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.608 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111998 s, 93.6 MB/s 2024-09-10T23:26:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.626 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134615 s, 77.9 MB/s 2024-09-10T23:26:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.641 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117268 s, 89.4 MB/s 2024-09-10T23:26:34.657 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.657 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.657 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124078 s, 84.5 MB/s 2024-09-10T23:26:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011003 s, 95.3 MB/s 2024-09-10T23:26:34.687 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.687 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.687 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111089 s, 94.4 MB/s 2024-09-10T23:26:34.703 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.703 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.703 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129649 s, 80.9 MB/s 2024-09-10T23:26:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.719 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120148 s, 87.3 MB/s 2024-09-10T23:26:34.734 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.734 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.734 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115302 s, 90.9 MB/s 2024-09-10T23:26:34.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.750 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125324 s, 83.7 MB/s 2024-09-10T23:26:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118309 s, 88.6 MB/s 2024-09-10T23:26:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.781 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121243 s, 86.5 MB/s 2024-09-10T23:26:34.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:34.789 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:34.789 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:34.789 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T23:26:34.789 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:34.789 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:34.789 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:34.789 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:34.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118742 s, 88.3 MB/s 2024-09-10T23:26:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115468 s, 90.8 MB/s 2024-09-10T23:26:34.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.890 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115955 s, 90.4 MB/s 2024-09-10T23:26:34.904 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114607 s, 91.5 MB/s 2024-09-10T23:26:34.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128724 s, 81.5 MB/s 2024-09-10T23:26:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125308 s, 83.7 MB/s 2024-09-10T23:26:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122272 s, 85.8 MB/s 2024-09-10T23:26:34.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.968 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113697 s, 92.2 MB/s 2024-09-10T23:26:34.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:34.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:34.985 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124864 s, 84.0 MB/s 2024-09-10T23:26:35.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.001 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128471 s, 81.6 MB/s 2024-09-10T23:26:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122524 s, 85.6 MB/s 2024-09-10T23:26:35.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109595 s, 95.7 MB/s 2024-09-10T23:26:35.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126973 s, 82.6 MB/s 2024-09-10T23:26:35.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114944 s, 91.2 MB/s 2024-09-10T23:26:35.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112584 s, 93.1 MB/s 2024-09-10T23:26:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131665 s, 79.6 MB/s 2024-09-10T23:26:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133973 s, 78.3 MB/s 2024-09-10T23:26:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013069 s, 80.2 MB/s 2024-09-10T23:26:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114844 s, 91.3 MB/s 2024-09-10T23:26:35.161 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.161 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124235 s, 84.4 MB/s 2024-09-10T23:26:35.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.177 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115835 s, 90.5 MB/s 2024-09-10T23:26:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107115 s, 97.9 MB/s 2024-09-10T23:26:35.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.208 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.208 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011543 s, 90.8 MB/s 2024-09-10T23:26:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120697 s, 86.9 MB/s 2024-09-10T23:26:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.241 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125109 s, 83.8 MB/s 2024-09-10T23:26:35.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.257 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126622 s, 82.8 MB/s 2024-09-10T23:26:35.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.273 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120155 s, 87.3 MB/s 2024-09-10T23:26:35.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.289 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012 s, 87.4 MB/s 2024-09-10T23:26:35.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.307 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013503 s, 77.7 MB/s 2024-09-10T23:26:35.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.328 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117634 s, 89.1 MB/s 2024-09-10T23:26:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115062 s, 91.1 MB/s 2024-09-10T23:26:35.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117577 s, 89.2 MB/s 2024-09-10T23:26:35.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:35.366 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:35.366 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:35.367 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T23:26:35.367 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:35.367 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:35.367 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:35.367 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:35.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114966 s, 91.2 MB/s 2024-09-10T23:26:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127624 s, 82.2 MB/s 2024-09-10T23:26:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132867 s, 78.9 MB/s 2024-09-10T23:26:35.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.487 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116794 s, 89.8 MB/s 2024-09-10T23:26:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113736 s, 92.2 MB/s 2024-09-10T23:26:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118922 s, 88.2 MB/s 2024-09-10T23:26:35.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.532 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117123 s, 89.5 MB/s 2024-09-10T23:26:35.548 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.548 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.548 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122674 s, 85.5 MB/s 2024-09-10T23:26:35.564 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.564 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.565 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125796 s, 83.4 MB/s 2024-09-10T23:26:35.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.581 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122835 s, 85.4 MB/s 2024-09-10T23:26:35.596 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.597 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124304 s, 84.4 MB/s 2024-09-10T23:26:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.611 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.612 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111106 s, 94.4 MB/s 2024-09-10T23:26:35.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.629 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133042 s, 78.8 MB/s 2024-09-10T23:26:35.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012954 s, 80.9 MB/s 2024-09-10T23:26:35.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.666 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161191 s, 65.1 MB/s 2024-09-10T23:26:35.687 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.688 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169406 s, 61.9 MB/s 2024-09-10T23:26:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148928 s, 70.4 MB/s 2024-09-10T23:26:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128914 s, 81.3 MB/s 2024-09-10T23:26:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141743 s, 74.0 MB/s 2024-09-10T23:26:35.760 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.760 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140024 s, 74.9 MB/s 2024-09-10T23:26:35.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.780 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143194 s, 73.2 MB/s 2024-09-10T23:26:35.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.796 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116129 s, 90.3 MB/s 2024-09-10T23:26:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124046 s, 84.5 MB/s 2024-09-10T23:26:35.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111155 s, 94.3 MB/s 2024-09-10T23:26:35.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.844 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.844 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01261 s, 83.2 MB/s 2024-09-10T23:26:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.859 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123279 s, 85.1 MB/s 2024-09-10T23:26:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116236 s, 90.2 MB/s 2024-09-10T23:26:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.890 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116267 s, 90.2 MB/s 2024-09-10T23:26:35.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.906 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116666 s, 89.9 MB/s 2024-09-10T23:26:35.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.922 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124947 s, 83.9 MB/s 2024-09-10T23:26:35.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.937 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115076 s, 91.1 MB/s 2024-09-10T23:26:35.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:35.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:35.953 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118754 s, 88.3 MB/s 2024-09-10T23:26:35.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:35.960 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:35.960 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:35.960 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T23:26:35.960 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:35.960 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:35.960 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:35.960 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:36.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116215 s, 90.2 MB/s 2024-09-10T23:26:36.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013313 s, 78.8 MB/s 2024-09-10T23:26:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118301 s, 88.6 MB/s 2024-09-10T23:26:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127611 s, 82.2 MB/s 2024-09-10T23:26:36.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.095 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012068 s, 86.9 MB/s 2024-09-10T23:26:36.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.112 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129412 s, 81.0 MB/s 2024-09-10T23:26:36.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.128 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118208 s, 88.7 MB/s 2024-09-10T23:26:36.143 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.143 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.143 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116279 s, 90.2 MB/s 2024-09-10T23:26:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109999 s, 95.3 MB/s 2024-09-10T23:26:36.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.174 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118853 s, 88.2 MB/s 2024-09-10T23:26:36.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.189 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116476 s, 90.0 MB/s 2024-09-10T23:26:36.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.204 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011413 s, 91.9 MB/s 2024-09-10T23:26:36.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011899 s, 88.1 MB/s 2024-09-10T23:26:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.236 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122092 s, 85.9 MB/s 2024-09-10T23:26:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.251 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117139 s, 89.5 MB/s 2024-09-10T23:26:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132961 s, 78.9 MB/s 2024-09-10T23:26:36.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.284 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012173 s, 86.1 MB/s 2024-09-10T23:26:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115725 s, 90.6 MB/s 2024-09-10T23:26:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117999 s, 88.9 MB/s 2024-09-10T23:26:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115681 s, 90.6 MB/s 2024-09-10T23:26:36.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.365 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112787 s, 93.0 MB/s 2024-09-10T23:26:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120212 s, 87.2 MB/s 2024-09-10T23:26:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.396 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116787 s, 89.8 MB/s 2024-09-10T23:26:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.411 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116733 s, 89.8 MB/s 2024-09-10T23:26:36.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.428 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.428 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126321 s, 83.0 MB/s 2024-09-10T23:26:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.443 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119804 s, 87.5 MB/s 2024-09-10T23:26:36.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.459 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116566 s, 90.0 MB/s 2024-09-10T23:26:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.474 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011959 s, 87.7 MB/s 2024-09-10T23:26:36.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.490 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119892 s, 87.5 MB/s 2024-09-10T23:26:36.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.506 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.506 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121325 s, 86.4 MB/s 2024-09-10T23:26:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124022 s, 84.5 MB/s 2024-09-10T23:26:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120587 s, 87.0 MB/s 2024-09-10T23:26:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:36.545 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:36.545 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:36.545 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T23:26:36.545 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:36.546 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:36.546 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:36.546 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:36.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.616 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115251 s, 91.0 MB/s 2024-09-10T23:26:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121831 s, 86.1 MB/s 2024-09-10T23:26:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126879 s, 82.6 MB/s 2024-09-10T23:26:36.662 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.662 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.662 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108293 s, 96.8 MB/s 2024-09-10T23:26:36.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.678 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121061 s, 86.6 MB/s 2024-09-10T23:26:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113219 s, 92.6 MB/s 2024-09-10T23:26:36.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.710 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012987 s, 80.7 MB/s 2024-09-10T23:26:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.726 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123272 s, 85.1 MB/s 2024-09-10T23:26:36.741 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.741 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.741 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120621 s, 86.9 MB/s 2024-09-10T23:26:36.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.758 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130047 s, 80.6 MB/s 2024-09-10T23:26:36.773 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116199 s, 90.2 MB/s 2024-09-10T23:26:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111507 s, 94.0 MB/s 2024-09-10T23:26:36.803 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.804 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.804 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117768 s, 89.0 MB/s 2024-09-10T23:26:36.819 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.820 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.820 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124244 s, 84.4 MB/s 2024-09-10T23:26:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128448 s, 81.6 MB/s 2024-09-10T23:26:36.852 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.852 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.852 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121417 s, 86.4 MB/s 2024-09-10T23:26:36.868 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.868 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.868 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124378 s, 84.3 MB/s 2024-09-10T23:26:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118904 s, 88.2 MB/s 2024-09-10T23:26:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116845 s, 89.7 MB/s 2024-09-10T23:26:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.914 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111593 s, 94.0 MB/s 2024-09-10T23:26:36.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.929 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117929 s, 88.9 MB/s 2024-09-10T23:26:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110096 s, 95.2 MB/s 2024-09-10T23:26:36.959 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.959 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.959 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116952 s, 89.7 MB/s 2024-09-10T23:26:36.974 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.974 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.974 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113086 s, 92.7 MB/s 2024-09-10T23:26:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:36.990 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:36.990 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116067 s, 90.3 MB/s 2024-09-10T23:26:37.006 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.006 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.006 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012393 s, 84.6 MB/s 2024-09-10T23:26:37.021 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118911 s, 88.2 MB/s 2024-09-10T23:26:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132729 s, 79.0 MB/s 2024-09-10T23:26:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.055 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129411 s, 81.0 MB/s 2024-09-10T23:26:37.070 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.071 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.071 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117603 s, 89.2 MB/s 2024-09-10T23:26:37.086 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.086 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.086 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011833 s, 88.6 MB/s 2024-09-10T23:26:37.102 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.103 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.103 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127826 s, 82.0 MB/s 2024-09-10T23:26:37.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:37.110 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:37.110 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:37.110 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T23:26:37.110 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:37.111 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:37.111 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:37.111 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.222 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126331 s, 83.0 MB/s 2024-09-10T23:26:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.239 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.239 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128735 s, 81.5 MB/s 2024-09-10T23:26:37.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.254 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118668 s, 88.4 MB/s 2024-09-10T23:26:37.269 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.270 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116787 s, 89.8 MB/s 2024-09-10T23:26:37.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.286 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124185 s, 84.4 MB/s 2024-09-10T23:26:37.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.302 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129956 s, 80.7 MB/s 2024-09-10T23:26:37.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153505 s, 68.3 MB/s 2024-09-10T23:26:37.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.343 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.343 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122823 s, 85.4 MB/s 2024-09-10T23:26:37.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127999 s, 81.9 MB/s 2024-09-10T23:26:37.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113739 s, 92.2 MB/s 2024-09-10T23:26:37.393 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.393 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.393 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012334 s, 85.0 MB/s 2024-09-10T23:26:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126888 s, 82.6 MB/s 2024-09-10T23:26:37.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.422 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117818 s, 89.0 MB/s 2024-09-10T23:26:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.437 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112633 s, 93.1 MB/s 2024-09-10T23:26:37.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.453 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120733 s, 86.9 MB/s 2024-09-10T23:26:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116331 s, 90.1 MB/s 2024-09-10T23:26:37.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.485 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127041 s, 82.5 MB/s 2024-09-10T23:26:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118819 s, 88.2 MB/s 2024-09-10T23:26:37.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.517 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133585 s, 78.5 MB/s 2024-09-10T23:26:37.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.532 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116421 s, 90.1 MB/s 2024-09-10T23:26:37.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113885 s, 92.1 MB/s 2024-09-10T23:26:37.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011289 s, 92.9 MB/s 2024-09-10T23:26:37.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.577 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116325 s, 90.1 MB/s 2024-09-10T23:26:37.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.593 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122314 s, 85.7 MB/s 2024-09-10T23:26:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.608 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107557 s, 97.5 MB/s 2024-09-10T23:26:37.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.623 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113622 s, 92.3 MB/s 2024-09-10T23:26:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.637 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110964 s, 94.5 MB/s 2024-09-10T23:26:37.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.654 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129046 s, 81.3 MB/s 2024-09-10T23:26:37.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.670 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117277 s, 89.4 MB/s 2024-09-10T23:26:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109122 s, 96.1 MB/s 2024-09-10T23:26:37.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.700 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125656 s, 83.4 MB/s 2024-09-10T23:26:37.717 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.717 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.717 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130005 s, 80.7 MB/s 2024-09-10T23:26:37.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:37.724 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:37.724 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:37.724 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T23:26:37.724 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:37.725 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:37.725 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:37.725 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:37.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:37.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.796 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011457 s, 91.5 MB/s 2024-09-10T23:26:37.809 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.809 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.810 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111427 s, 94.1 MB/s 2024-09-10T23:26:37.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013897 s, 75.5 MB/s 2024-09-10T23:26:37.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.841 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106561 s, 98.4 MB/s 2024-09-10T23:26:37.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.858 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013307 s, 78.8 MB/s 2024-09-10T23:26:37.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.874 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123612 s, 84.8 MB/s 2024-09-10T23:26:37.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.890 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116181 s, 90.3 MB/s 2024-09-10T23:26:37.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.905 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116667 s, 89.9 MB/s 2024-09-10T23:26:37.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.920 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116772 s, 89.8 MB/s 2024-09-10T23:26:37.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.935 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112921 s, 92.9 MB/s 2024-09-10T23:26:37.949 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.949 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.949 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110328 s, 95.0 MB/s 2024-09-10T23:26:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012304 s, 85.2 MB/s 2024-09-10T23:26:37.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.981 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119699 s, 87.6 MB/s 2024-09-10T23:26:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:37.997 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125635 s, 83.5 MB/s 2024-09-10T23:26:38.013 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.013 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.013 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127349 s, 82.3 MB/s 2024-09-10T23:26:38.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.029 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.029 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011716 s, 89.5 MB/s 2024-09-10T23:26:38.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.043 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108451 s, 96.7 MB/s 2024-09-10T23:26:38.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:26:38.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:26:38.059 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.059 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.059 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123309 s, 85.0 MB/s 2024-09-10T23:26:38.075 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.075 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.075 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116225 s, 90.2 MB/s 2024-09-10T23:26:38.090 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.091 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118218 s, 88.7 MB/s 2024-09-10T23:26:38.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011441 s, 91.7 MB/s 2024-09-10T23:26:38.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.120 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011331 s, 92.5 MB/s 2024-09-10T23:26:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.136 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123873 s, 84.6 MB/s 2024-09-10T23:26:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120951 s, 86.7 MB/s 2024-09-10T23:26:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120138 s, 87.3 MB/s 2024-09-10T23:26:38.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.184 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124661 s, 84.1 MB/s 2024-09-10T23:26:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.199 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111111 s, 94.4 MB/s 2024-09-10T23:26:38.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139141 s, 75.4 MB/s 2024-09-10T23:26:38.231 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.231 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.232 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111984 s, 93.6 MB/s 2024-09-10T23:26:38.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.247 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114842 s, 91.3 MB/s 2024-09-10T23:26:38.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.262 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115437 s, 90.8 MB/s 2024-09-10T23:26:38.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.277 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112643 s, 93.1 MB/s 2024-09-10T23:26:38.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:38.284 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:38.284 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:38.284 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T23:26:38.284 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:38.285 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:38.285 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:38.285 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:38.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:38.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115608 s, 90.7 MB/s 2024-09-10T23:26:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114931 s, 91.2 MB/s 2024-09-10T23:26:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113574 s, 92.3 MB/s 2024-09-10T23:26:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.459 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115211 s, 91.0 MB/s 2024-09-10T23:26:38.460 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.460 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.460 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010458 s, 100 MB/s 2024-09-10T23:26:38.475 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.475 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.475 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110413 s, 95.0 MB/s 2024-09-10T23:26:38.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.490 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115705 s, 90.6 MB/s 2024-09-10T23:26:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105877 s, 99.0 MB/s 2024-09-10T23:26:38.520 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.520 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.520 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116811 s, 89.8 MB/s 2024-09-10T23:26:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128349 s, 81.7 MB/s 2024-09-10T23:26:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115328 s, 90.9 MB/s 2024-09-10T23:26:38.567 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.567 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.567 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116073 s, 90.3 MB/s 2024-09-10T23:26:38.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.581 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108968 s, 96.2 MB/s 2024-09-10T23:26:38.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.597 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117334 s, 89.4 MB/s 2024-09-10T23:26:38.611 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.611 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.612 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110788 s, 94.6 MB/s 2024-09-10T23:26:38.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.626 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110795 s, 94.6 MB/s 2024-09-10T23:26:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122526 s, 85.6 MB/s 2024-09-10T23:26:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.658 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122138 s, 85.9 MB/s 2024-09-10T23:26:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114509 s, 91.6 MB/s 2024-09-10T23:26:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.688 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112024 s, 93.6 MB/s 2024-09-10T23:26:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.703 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.703 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111536 s, 94.0 MB/s 2024-09-10T23:26:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.718 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120812 s, 86.8 MB/s 2024-09-10T23:26:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011744 s, 89.3 MB/s 2024-09-10T23:26:38.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.750 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131168 s, 79.9 MB/s 2024-09-10T23:26:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.766 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120153 s, 87.3 MB/s 2024-09-10T23:26:38.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.782 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122777 s, 85.4 MB/s 2024-09-10T23:26:38.798 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.798 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.798 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125598 s, 83.5 MB/s 2024-09-10T23:26:38.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.814 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121168 s, 86.5 MB/s 2024-09-10T23:26:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01179 s, 88.9 MB/s 2024-09-10T23:26:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122719 s, 85.4 MB/s 2024-09-10T23:26:38.860 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.860 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.860 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109281 s, 96.0 MB/s 2024-09-10T23:26:38.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.877 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129774 s, 80.8 MB/s 2024-09-10T23:26:38.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:38.884 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:38.884 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:38.884 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T23:26:38.884 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:38.884 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:38.884 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:38.884 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:38.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112123 s, 93.5 MB/s 2024-09-10T23:26:38.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.969 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110534 s, 94.9 MB/s 2024-09-10T23:26:38.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.985 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119583 s, 87.7 MB/s 2024-09-10T23:26:38.999 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:38.999 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:38.999 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109772 s, 95.5 MB/s 2024-09-10T23:26:39.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.015 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123842 s, 84.7 MB/s 2024-09-10T23:26:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120925 s, 86.7 MB/s 2024-09-10T23:26:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119965 s, 87.4 MB/s 2024-09-10T23:26:39.061 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.061 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.061 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011065 s, 94.8 MB/s 2024-09-10T23:26:39.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.077 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124626 s, 84.1 MB/s 2024-09-10T23:26:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124718 s, 84.1 MB/s 2024-09-10T23:26:39.108 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.109 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115611 s, 90.7 MB/s 2024-09-10T23:26:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106604 s, 98.4 MB/s 2024-09-10T23:26:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112187 s, 93.5 MB/s 2024-09-10T23:26:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114862 s, 91.3 MB/s 2024-09-10T23:26:39.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.170 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125248 s, 83.7 MB/s 2024-09-10T23:26:39.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.186 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128138 s, 81.8 MB/s 2024-09-10T23:26:39.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.203 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132495 s, 79.1 MB/s 2024-09-10T23:26:39.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.218 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112963 s, 92.8 MB/s 2024-09-10T23:26:39.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119332 s, 87.9 MB/s 2024-09-10T23:26:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.249 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120839 s, 86.8 MB/s 2024-09-10T23:26:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109373 s, 95.9 MB/s 2024-09-10T23:26:39.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.278 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011518 s, 91.0 MB/s 2024-09-10T23:26:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.294 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116331 s, 90.1 MB/s 2024-09-10T23:26:39.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.309 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118714 s, 88.3 MB/s 2024-09-10T23:26:39.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.327 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139306 s, 75.3 MB/s 2024-09-10T23:26:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118865 s, 88.2 MB/s 2024-09-10T23:26:39.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.362 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112512 s, 93.2 MB/s 2024-09-10T23:26:39.378 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.378 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.378 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117159 s, 89.5 MB/s 2024-09-10T23:26:39.394 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.394 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.394 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123572 s, 84.9 MB/s 2024-09-10T23:26:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113052 s, 92.8 MB/s 2024-09-10T23:26:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115534 s, 90.8 MB/s 2024-09-10T23:26:39.439 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.439 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.439 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114883 s, 91.3 MB/s 2024-09-10T23:26:39.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:39.447 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:39.447 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:39.447 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T23:26:39.447 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:39.447 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:39.448 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:39.448 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:39.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:39.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.566 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112737 s, 93.0 MB/s 2024-09-10T23:26:39.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.581 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112711 s, 93.0 MB/s 2024-09-10T23:26:39.596 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.596 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.596 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113173 s, 92.7 MB/s 2024-09-10T23:26:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.613 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123962 s, 84.6 MB/s 2024-09-10T23:26:39.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.629 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121702 s, 86.2 MB/s 2024-09-10T23:26:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.644 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115395 s, 90.9 MB/s 2024-09-10T23:26:39.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.660 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120082 s, 87.3 MB/s 2024-09-10T23:26:39.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.676 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124816 s, 84.0 MB/s 2024-09-10T23:26:39.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.691 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114976 s, 91.2 MB/s 2024-09-10T23:26:39.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.706 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113989 s, 92.0 MB/s 2024-09-10T23:26:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114844 s, 91.3 MB/s 2024-09-10T23:26:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.738 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126215 s, 83.1 MB/s 2024-09-10T23:26:39.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128678 s, 81.5 MB/s 2024-09-10T23:26:39.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.770 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115317 s, 90.9 MB/s 2024-09-10T23:26:39.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113445 s, 92.4 MB/s 2024-09-10T23:26:39.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114854 s, 91.3 MB/s 2024-09-10T23:26:39.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.815 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107794 s, 97.3 MB/s 2024-09-10T23:26:39.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.829 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110295 s, 95.1 MB/s 2024-09-10T23:26:39.844 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.844 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.844 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111908 s, 93.7 MB/s 2024-09-10T23:26:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012252 s, 85.6 MB/s 2024-09-10T23:26:39.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.875 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109544 s, 95.7 MB/s 2024-09-10T23:26:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.891 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119807 s, 87.5 MB/s 2024-09-10T23:26:39.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.906 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110268 s, 95.1 MB/s 2024-09-10T23:26:39.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108245 s, 96.9 MB/s 2024-09-10T23:26:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.938 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130866 s, 80.1 MB/s 2024-09-10T23:26:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128668 s, 81.5 MB/s 2024-09-10T23:26:39.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.969 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115243 s, 91.0 MB/s 2024-09-10T23:26:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:39.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110187 s, 95.2 MB/s 2024-09-10T23:26:40.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130157 s, 80.6 MB/s 2024-09-10T23:26:40.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.016 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121975 s, 86.0 MB/s 2024-09-10T23:26:40.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126412 s, 82.9 MB/s 2024-09-10T23:26:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117105 s, 89.5 MB/s 2024-09-10T23:26:40.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:40.056 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:40.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:40.127 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.127 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.127 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118188 s, 88.7 MB/s 2024-09-10T23:26:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.142 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115193 s, 91.0 MB/s 2024-09-10T23:26:40.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.158 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114792 s, 91.3 MB/s 2024-09-10T23:26:40.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.173 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119573 s, 87.7 MB/s 2024-09-10T23:26:40.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.189 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123558 s, 84.9 MB/s 2024-09-10T23:26:40.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.205 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115935 s, 90.4 MB/s 2024-09-10T23:26:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.221 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123907 s, 84.6 MB/s 2024-09-10T23:26:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137812 s, 76.1 MB/s 2024-09-10T23:26:40.256 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.257 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128027 s, 81.9 MB/s 2024-09-10T23:26:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113153 s, 92.7 MB/s 2024-09-10T23:26:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.285 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116287 s, 90.2 MB/s 2024-09-10T23:26:40.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.300 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109672 s, 95.6 MB/s 2024-09-10T23:26:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010994 s, 95.4 MB/s 2024-09-10T23:26:40.333 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.334 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137816 s, 76.1 MB/s 2024-09-10T23:26:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121232 s, 86.5 MB/s 2024-09-10T23:26:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012082 s, 86.8 MB/s 2024-09-10T23:26:40.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.381 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115278 s, 91.0 MB/s 2024-09-10T23:26:40.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.397 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117256 s, 89.4 MB/s 2024-09-10T23:26:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107099 s, 97.9 MB/s 2024-09-10T23:26:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.426 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117591 s, 89.2 MB/s 2024-09-10T23:26:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.442 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123663 s, 84.8 MB/s 2024-09-10T23:26:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115136 s, 91.1 MB/s 2024-09-10T23:26:40.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.474 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012624 s, 83.1 MB/s 2024-09-10T23:26:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.489 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120035 s, 87.4 MB/s 2024-09-10T23:26:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.505 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115513 s, 90.8 MB/s 2024-09-10T23:26:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122546 s, 85.6 MB/s 2024-09-10T23:26:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124352 s, 84.3 MB/s 2024-09-10T23:26:40.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.552 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115671 s, 90.7 MB/s 2024-09-10T23:26:40.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.568 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119795 s, 87.5 MB/s 2024-09-10T23:26:40.583 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.583 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.583 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114769 s, 91.4 MB/s 2024-09-10T23:26:40.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.599 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011879 s, 88.3 MB/s 2024-09-10T23:26:40.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.615 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128548 s, 81.6 MB/s 2024-09-10T23:26:40.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:40.625 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:40.625 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:40.625 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T23:26:40.625 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:40.625 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:40.625 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:40.625 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:40.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:40.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.759 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139524 s, 75.2 MB/s 2024-09-10T23:26:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124476 s, 84.2 MB/s 2024-09-10T23:26:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114805 s, 91.3 MB/s 2024-09-10T23:26:40.807 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.807 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.807 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124228 s, 84.4 MB/s 2024-09-10T23:26:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.823 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116468 s, 90.0 MB/s 2024-09-10T23:26:40.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.838 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115719 s, 90.6 MB/s 2024-09-10T23:26:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.854 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114065 s, 91.9 MB/s 2024-09-10T23:26:40.869 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.869 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.870 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112018 s, 93.6 MB/s 2024-09-10T23:26:40.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.886 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129097 s, 81.2 MB/s 2024-09-10T23:26:40.902 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.902 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.902 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120421 s, 87.1 MB/s 2024-09-10T23:26:40.919 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.919 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.919 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129924 s, 80.7 MB/s 2024-09-10T23:26:40.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.935 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011458 s, 91.5 MB/s 2024-09-10T23:26:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121536 s, 86.3 MB/s 2024-09-10T23:26:40.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.969 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130965 s, 80.1 MB/s 2024-09-10T23:26:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115911 s, 90.5 MB/s 2024-09-10T23:26:41.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115416 s, 90.9 MB/s 2024-09-10T23:26:41.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124609 s, 84.1 MB/s 2024-09-10T23:26:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.032 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113028 s, 92.8 MB/s 2024-09-10T23:26:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01273 s, 82.4 MB/s 2024-09-10T23:26:41.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.066 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126084 s, 83.2 MB/s 2024-09-10T23:26:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.082 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122354 s, 85.7 MB/s 2024-09-10T23:26:41.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.099 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.099 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124303 s, 84.4 MB/s 2024-09-10T23:26:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.114 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115636 s, 90.7 MB/s 2024-09-10T23:26:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112345 s, 93.3 MB/s 2024-09-10T23:26:41.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.144 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114661 s, 91.4 MB/s 2024-09-10T23:26:41.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.159 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116155 s, 90.3 MB/s 2024-09-10T23:26:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.175 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120033 s, 87.4 MB/s 2024-09-10T23:26:41.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.189 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109924 s, 95.4 MB/s 2024-09-10T23:26:41.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.205 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118303 s, 88.6 MB/s 2024-09-10T23:26:41.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.220 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118584 s, 88.4 MB/s 2024-09-10T23:26:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011715 s, 89.5 MB/s 2024-09-10T23:26:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123755 s, 84.7 MB/s 2024-09-10T23:26:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:41.259 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:41.259 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:41.259 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T23:26:41.259 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:41.259 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:41.259 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:41.259 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:41.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:41.333 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.333 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.333 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160285 s, 65.4 MB/s 2024-09-10T23:26:41.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.353 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118534 s, 88.5 MB/s 2024-09-10T23:26:41.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.368 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115534 s, 90.8 MB/s 2024-09-10T23:26:41.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.384 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126437 s, 82.9 MB/s 2024-09-10T23:26:41.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.401 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135887 s, 77.2 MB/s 2024-09-10T23:26:41.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.417 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119256 s, 87.9 MB/s 2024-09-10T23:26:41.431 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.432 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.432 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112785 s, 93.0 MB/s 2024-09-10T23:26:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131561 s, 79.7 MB/s 2024-09-10T23:26:41.463 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.463 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.463 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109501 s, 95.8 MB/s 2024-09-10T23:26:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012156 s, 86.3 MB/s 2024-09-10T23:26:41.493 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.493 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.493 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011487 s, 91.3 MB/s 2024-09-10T23:26:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011533 s, 90.9 MB/s 2024-09-10T23:26:41.525 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.525 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.525 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124978 s, 83.9 MB/s 2024-09-10T23:26:41.540 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.540 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.540 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112645 s, 93.1 MB/s 2024-09-10T23:26:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.555 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010995 s, 95.4 MB/s 2024-09-10T23:26:41.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.571 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119039 s, 88.1 MB/s 2024-09-10T23:26:41.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.589 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130501 s, 80.3 MB/s 2024-09-10T23:26:41.604 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.604 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.605 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119676 s, 87.6 MB/s 2024-09-10T23:26:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116426 s, 90.1 MB/s 2024-09-10T23:26:41.636 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.636 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.636 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118902 s, 88.2 MB/s 2024-09-10T23:26:41.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.654 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134578 s, 77.9 MB/s 2024-09-10T23:26:41.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.672 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136863 s, 76.6 MB/s 2024-09-10T23:26:41.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.689 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126284 s, 83.0 MB/s 2024-09-10T23:26:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117025 s, 89.6 MB/s 2024-09-10T23:26:41.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.721 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122861 s, 85.3 MB/s 2024-09-10T23:26:41.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.736 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110635 s, 94.8 MB/s 2024-09-10T23:26:41.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.752 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121551 s, 86.3 MB/s 2024-09-10T23:26:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116859 s, 89.7 MB/s 2024-09-10T23:26:41.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.784 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117822 s, 89.0 MB/s 2024-09-10T23:26:41.801 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.801 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.801 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124728 s, 84.1 MB/s 2024-09-10T23:26:41.817 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.817 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.817 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123022 s, 85.2 MB/s 2024-09-10T23:26:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120283 s, 87.2 MB/s 2024-09-10T23:26:41.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:41.841 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:41.841 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:41.841 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T23:26:41.841 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:41.841 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:41.841 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:41.841 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:41.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110452 s, 94.9 MB/s 2024-09-10T23:26:41.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.929 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125775 s, 83.4 MB/s 2024-09-10T23:26:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.944 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112393 s, 93.3 MB/s 2024-09-10T23:26:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124381 s, 84.3 MB/s 2024-09-10T23:26:41.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.977 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.977 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011432 s, 91.7 MB/s 2024-09-10T23:26:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012155 s, 86.3 MB/s 2024-09-10T23:26:42.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.010 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012915 s, 81.2 MB/s 2024-09-10T23:26:42.026 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.026 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.027 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122212 s, 85.8 MB/s 2024-09-10T23:26:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.044 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134452 s, 78.0 MB/s 2024-09-10T23:26:42.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.061 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012216 s, 85.8 MB/s 2024-09-10T23:26:42.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.077 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120503 s, 87.0 MB/s 2024-09-10T23:26:42.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.093 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116195 s, 90.2 MB/s 2024-09-10T23:26:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130585 s, 80.3 MB/s 2024-09-10T23:26:42.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111108 s, 94.4 MB/s 2024-09-10T23:26:42.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111286 s, 94.2 MB/s 2024-09-10T23:26:42.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110733 s, 94.7 MB/s 2024-09-10T23:26:42.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.172 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114919 s, 91.2 MB/s 2024-09-10T23:26:42.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.187 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113256 s, 92.6 MB/s 2024-09-10T23:26:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131613 s, 79.7 MB/s 2024-09-10T23:26:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.223 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138805 s, 75.5 MB/s 2024-09-10T23:26:42.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.238 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01141 s, 91.9 MB/s 2024-09-10T23:26:42.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.253 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117136 s, 89.5 MB/s 2024-09-10T23:26:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.268 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110465 s, 94.9 MB/s 2024-09-10T23:26:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117787 s, 89.0 MB/s 2024-09-10T23:26:42.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.300 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128421 s, 81.7 MB/s 2024-09-10T23:26:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.316 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119049 s, 88.1 MB/s 2024-09-10T23:26:42.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.334 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148059 s, 70.8 MB/s 2024-09-10T23:26:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012369 s, 84.8 MB/s 2024-09-10T23:26:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124717 s, 84.1 MB/s 2024-09-10T23:26:42.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.388 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112976 s, 92.8 MB/s 2024-09-10T23:26:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114536 s, 91.5 MB/s 2024-09-10T23:26:42.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011161 s, 94.0 MB/s 2024-09-10T23:26:42.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:42.425 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:42.425 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:42.425 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T23:26:42.425 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:42.425 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:42.426 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:42.426 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:42.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:42.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.496 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120805 s, 86.8 MB/s 2024-09-10T23:26:42.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112171 s, 93.5 MB/s 2024-09-10T23:26:42.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.526 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115666 s, 90.7 MB/s 2024-09-10T23:26:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.542 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123008 s, 85.2 MB/s 2024-09-10T23:26:42.557 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.558 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.558 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122292 s, 85.7 MB/s 2024-09-10T23:26:42.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.573 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119453 s, 87.8 MB/s 2024-09-10T23:26:42.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.590 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132104 s, 79.4 MB/s 2024-09-10T23:26:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.605 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113729 s, 92.2 MB/s 2024-09-10T23:26:42.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.620 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110672 s, 94.7 MB/s 2024-09-10T23:26:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120747 s, 86.8 MB/s 2024-09-10T23:26:42.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.650 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115732 s, 90.6 MB/s 2024-09-10T23:26:42.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.666 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117691 s, 89.1 MB/s 2024-09-10T23:26:42.683 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.683 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.683 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134601 s, 77.9 MB/s 2024-09-10T23:26:42.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.700 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136351 s, 76.9 MB/s 2024-09-10T23:26:42.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.716 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011735 s, 89.4 MB/s 2024-09-10T23:26:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118141 s, 88.8 MB/s 2024-09-10T23:26:42.747 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.748 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.748 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128333 s, 81.7 MB/s 2024-09-10T23:26:42.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.764 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120804 s, 86.8 MB/s 2024-09-10T23:26:42.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.779 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111174 s, 94.3 MB/s 2024-09-10T23:26:42.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.794 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119592 s, 87.7 MB/s 2024-09-10T23:26:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.810 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121385 s, 86.4 MB/s 2024-09-10T23:26:42.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.826 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117924 s, 88.9 MB/s 2024-09-10T23:26:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.842 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127999 s, 81.9 MB/s 2024-09-10T23:26:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117083 s, 89.6 MB/s 2024-09-10T23:26:42.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.873 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113971 s, 92.0 MB/s 2024-09-10T23:26:42.888 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.889 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119981 s, 87.4 MB/s 2024-09-10T23:26:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.905 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124012 s, 84.6 MB/s 2024-09-10T23:26:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117063 s, 89.6 MB/s 2024-09-10T23:26:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117001 s, 89.6 MB/s 2024-09-10T23:26:42.950 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.950 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.950 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116547 s, 90.0 MB/s 2024-09-10T23:26:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.967 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122354 s, 85.7 MB/s 2024-09-10T23:26:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109797 s, 95.5 MB/s 2024-09-10T23:26:42.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:42.989 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:42.989 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:42.989 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T23:26:42.989 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:42.990 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:42.990 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:42.990 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:43.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127213 s, 82.4 MB/s 2024-09-10T23:26:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132682 s, 79.0 MB/s 2024-09-10T23:26:43.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125782 s, 83.4 MB/s 2024-09-10T23:26:43.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120207 s, 87.2 MB/s 2024-09-10T23:26:43.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110307 s, 95.1 MB/s 2024-09-10T23:26:43.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.140 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117637 s, 89.1 MB/s 2024-09-10T23:26:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110942 s, 94.5 MB/s 2024-09-10T23:26:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138709 s, 75.6 MB/s 2024-09-10T23:26:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113871 s, 92.1 MB/s 2024-09-10T23:26:43.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.205 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113916 s, 92.0 MB/s 2024-09-10T23:26:43.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.221 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118106 s, 88.8 MB/s 2024-09-10T23:26:43.237 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.237 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.237 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117157 s, 89.5 MB/s 2024-09-10T23:26:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.253 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117382 s, 89.3 MB/s 2024-09-10T23:26:43.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.268 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116207 s, 90.2 MB/s 2024-09-10T23:26:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117165 s, 89.5 MB/s 2024-09-10T23:26:43.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.300 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116081 s, 90.3 MB/s 2024-09-10T23:26:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.317 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123927 s, 84.6 MB/s 2024-09-10T23:26:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131352 s, 79.8 MB/s 2024-09-10T23:26:43.361 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.362 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112643 s, 93.1 MB/s 2024-09-10T23:26:43.376 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.376 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.376 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110079 s, 95.3 MB/s 2024-09-10T23:26:43.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.391 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116172 s, 90.3 MB/s 2024-09-10T23:26:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116478 s, 90.0 MB/s 2024-09-10T23:26:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110253 s, 95.1 MB/s 2024-09-10T23:26:43.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.438 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126309 s, 83.0 MB/s 2024-09-10T23:26:43.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110476 s, 94.9 MB/s 2024-09-10T23:26:43.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123453 s, 84.9 MB/s 2024-09-10T23:26:43.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.484 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125529 s, 83.5 MB/s 2024-09-10T23:26:43.500 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.500 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.500 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121453 s, 86.3 MB/s 2024-09-10T23:26:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122505 s, 85.6 MB/s 2024-09-10T23:26:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110663 s, 94.8 MB/s 2024-09-10T23:26:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.548 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121883 s, 86.0 MB/s 2024-09-10T23:26:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114785 s, 91.4 MB/s 2024-09-10T23:26:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:43.570 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:43.571 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:43.571 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T23:26:43.571 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:43.571 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:43.571 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:43.571 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:43.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132769 s, 79.0 MB/s 2024-09-10T23:26:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112464 s, 93.2 MB/s 2024-09-10T23:26:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140414 s, 74.7 MB/s 2024-09-10T23:26:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124884 s, 84.0 MB/s 2024-09-10T23:26:43.711 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.711 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.711 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118747 s, 88.3 MB/s 2024-09-10T23:26:43.727 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.727 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.727 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114903 s, 91.3 MB/s 2024-09-10T23:26:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011492 s, 91.2 MB/s 2024-09-10T23:26:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114023 s, 92.0 MB/s 2024-09-10T23:26:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126974 s, 82.6 MB/s 2024-09-10T23:26:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115404 s, 90.9 MB/s 2024-09-10T23:26:43.807 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.808 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.808 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125708 s, 83.4 MB/s 2024-09-10T23:26:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122955 s, 85.3 MB/s 2024-09-10T23:26:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111499 s, 94.0 MB/s 2024-09-10T23:26:43.857 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.858 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138914 s, 75.5 MB/s 2024-09-10T23:26:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118661 s, 88.4 MB/s 2024-09-10T23:26:43.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.891 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013031 s, 80.5 MB/s 2024-09-10T23:26:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012142 s, 86.4 MB/s 2024-09-10T23:26:43.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.923 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112879 s, 92.9 MB/s 2024-09-10T23:26:43.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.938 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114436 s, 91.6 MB/s 2024-09-10T23:26:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129191 s, 81.2 MB/s 2024-09-10T23:26:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110987 s, 94.5 MB/s 2024-09-10T23:26:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121399 s, 86.4 MB/s 2024-09-10T23:26:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120937 s, 86.7 MB/s 2024-09-10T23:26:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123525 s, 84.9 MB/s 2024-09-10T23:26:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114926 s, 91.2 MB/s 2024-09-10T23:26:44.052 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.052 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.052 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124861 s, 84.0 MB/s 2024-09-10T23:26:44.068 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.068 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.068 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123886 s, 84.6 MB/s 2024-09-10T23:26:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117294 s, 89.4 MB/s 2024-09-10T23:26:44.099 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.099 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.099 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111657 s, 93.9 MB/s 2024-09-10T23:26:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136012 s, 77.1 MB/s 2024-09-10T23:26:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.133 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109123 s, 96.1 MB/s 2024-09-10T23:26:44.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.148 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117106 s, 89.5 MB/s 2024-09-10T23:26:44.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:44.156 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:44.156 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:44.156 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T23:26:44.156 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:44.156 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:44.156 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:44.156 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:44.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:44.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.275 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.275 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134436 s, 78.0 MB/s 2024-09-10T23:26:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012145 s, 86.3 MB/s 2024-09-10T23:26:44.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.306 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116763 s, 89.8 MB/s 2024-09-10T23:26:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117918 s, 88.9 MB/s 2024-09-10T23:26:44.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135727 s, 77.3 MB/s 2024-09-10T23:26:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.366 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113183 s, 92.6 MB/s 2024-09-10T23:26:44.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.381 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113462 s, 92.4 MB/s 2024-09-10T23:26:44.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117002 s, 89.6 MB/s 2024-09-10T23:26:44.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.412 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114637 s, 91.5 MB/s 2024-09-10T23:26:44.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.426 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112031 s, 93.6 MB/s 2024-09-10T23:26:44.441 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.442 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.442 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113295 s, 92.6 MB/s 2024-09-10T23:26:44.457 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.457 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.457 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115731 s, 90.6 MB/s 2024-09-10T23:26:44.473 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.473 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.473 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124937 s, 83.9 MB/s 2024-09-10T23:26:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.488 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114997 s, 91.2 MB/s 2024-09-10T23:26:44.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.504 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119844 s, 87.5 MB/s 2024-09-10T23:26:44.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.519 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114449 s, 91.6 MB/s 2024-09-10T23:26:44.535 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.535 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.536 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127296 s, 82.4 MB/s 2024-09-10T23:26:44.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.551 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116988 s, 89.6 MB/s 2024-09-10T23:26:44.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.567 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.567 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011941 s, 87.8 MB/s 2024-09-10T23:26:44.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.583 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118823 s, 88.2 MB/s 2024-09-10T23:26:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011659 s, 89.9 MB/s 2024-09-10T23:26:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114214 s, 91.8 MB/s 2024-09-10T23:26:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126607 s, 82.8 MB/s 2024-09-10T23:26:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115984 s, 90.4 MB/s 2024-09-10T23:26:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113204 s, 92.6 MB/s 2024-09-10T23:26:44.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.676 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132037 s, 79.4 MB/s 2024-09-10T23:26:44.692 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.692 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.692 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012663 s, 82.8 MB/s 2024-09-10T23:26:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.708 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114442 s, 91.6 MB/s 2024-09-10T23:26:44.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.723 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117901 s, 88.9 MB/s 2024-09-10T23:26:44.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.739 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123504 s, 84.9 MB/s 2024-09-10T23:26:44.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113965 s, 92.0 MB/s 2024-09-10T23:26:44.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.770 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129187 s, 81.2 MB/s 2024-09-10T23:26:44.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:44.777 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:44.778 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:44.778 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T23:26:44.778 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:44.778 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:44.778 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:44.778 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:44.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114776 s, 91.4 MB/s 2024-09-10T23:26:44.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.862 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107012 s, 98.0 MB/s 2024-09-10T23:26:44.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.878 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114595 s, 91.5 MB/s 2024-09-10T23:26:44.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.894 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127755 s, 82.1 MB/s 2024-09-10T23:26:44.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011382 s, 92.1 MB/s 2024-09-10T23:26:44.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109856 s, 95.4 MB/s 2024-09-10T23:26:44.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.938 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107955 s, 97.1 MB/s 2024-09-10T23:26:44.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.955 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122206 s, 85.8 MB/s 2024-09-10T23:26:44.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.972 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133874 s, 78.3 MB/s 2024-09-10T23:26:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108691 s, 96.5 MB/s 2024-09-10T23:26:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116245 s, 90.2 MB/s 2024-09-10T23:26:45.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122899 s, 85.3 MB/s 2024-09-10T23:26:45.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124383 s, 84.3 MB/s 2024-09-10T23:26:45.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113589 s, 92.3 MB/s 2024-09-10T23:26:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123302 s, 85.0 MB/s 2024-09-10T23:26:45.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.079 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114057 s, 91.9 MB/s 2024-09-10T23:26:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125797 s, 83.4 MB/s 2024-09-10T23:26:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.111 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122243 s, 85.8 MB/s 2024-09-10T23:26:45.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.127 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113915 s, 92.0 MB/s 2024-09-10T23:26:45.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109877 s, 95.4 MB/s 2024-09-10T23:26:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111998 s, 93.6 MB/s 2024-09-10T23:26:45.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.171 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011866 s, 88.4 MB/s 2024-09-10T23:26:45.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.188 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123 s, 85.3 MB/s 2024-09-10T23:26:45.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.202 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107732 s, 97.3 MB/s 2024-09-10T23:26:45.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119282 s, 87.9 MB/s 2024-09-10T23:26:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.232 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111899 s, 93.7 MB/s 2024-09-10T23:26:45.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116249 s, 90.2 MB/s 2024-09-10T23:26:45.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012449 s, 84.2 MB/s 2024-09-10T23:26:45.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114488 s, 91.6 MB/s 2024-09-10T23:26:45.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.294 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110703 s, 94.7 MB/s 2024-09-10T23:26:45.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.309 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113826 s, 92.1 MB/s 2024-09-10T23:26:45.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.324 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113646 s, 92.3 MB/s 2024-09-10T23:26:45.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:45.331 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:45.331 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:45.331 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T23:26:45.331 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:45.331 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:45.331 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:45.331 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:45.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124715 s, 84.1 MB/s 2024-09-10T23:26:45.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112273 s, 93.4 MB/s 2024-09-10T23:26:45.451 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.451 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.451 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111278 s, 94.2 MB/s 2024-09-10T23:26:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012708 s, 82.5 MB/s 2024-09-10T23:26:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.484 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116002 s, 90.4 MB/s 2024-09-10T23:26:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116197 s, 90.2 MB/s 2024-09-10T23:26:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.517 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137048 s, 76.5 MB/s 2024-09-10T23:26:45.533 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.533 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.534 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130176 s, 80.6 MB/s 2024-09-10T23:26:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.550 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126979 s, 82.6 MB/s 2024-09-10T23:26:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.566 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119747 s, 87.6 MB/s 2024-09-10T23:26:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114833 s, 91.3 MB/s 2024-09-10T23:26:45.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.597 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124106 s, 84.5 MB/s 2024-09-10T23:26:45.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.614 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123913 s, 84.6 MB/s 2024-09-10T23:26:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.631 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.632 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141586 s, 74.1 MB/s 2024-09-10T23:26:45.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.649 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130028 s, 80.6 MB/s 2024-09-10T23:26:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142014 s, 73.8 MB/s 2024-09-10T23:26:45.686 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.686 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.686 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126121 s, 83.1 MB/s 2024-09-10T23:26:45.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.703 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125148 s, 83.8 MB/s 2024-09-10T23:26:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012481 s, 84.0 MB/s 2024-09-10T23:26:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.736 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131105 s, 80.0 MB/s 2024-09-10T23:26:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167874 s, 62.5 MB/s 2024-09-10T23:26:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.776 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134571 s, 77.9 MB/s 2024-09-10T23:26:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017251 s, 60.8 MB/s 2024-09-10T23:26:45.813 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.813 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.813 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114687 s, 91.4 MB/s 2024-09-10T23:26:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119879 s, 87.5 MB/s 2024-09-10T23:26:45.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.847 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134641 s, 77.9 MB/s 2024-09-10T23:26:45.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.864 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121405 s, 86.4 MB/s 2024-09-10T23:26:45.881 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.882 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.882 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131589 s, 79.7 MB/s 2024-09-10T23:26:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.897 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112893 s, 92.9 MB/s 2024-09-10T23:26:45.912 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.912 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.912 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112328 s, 93.3 MB/s 2024-09-10T23:26:45.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.928 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118093 s, 88.8 MB/s 2024-09-10T23:26:45.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:45.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:45.945 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121442 s, 86.3 MB/s 2024-09-10T23:26:45.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:45.952 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:26:45.952 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:26:45.952 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T23:26:45.952 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:26:45.952 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:26:45.952 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:26:45.952 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:26:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:26:46.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.024 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128456 s, 81.6 MB/s 2024-09-10T23:26:46.041 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.041 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.042 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013147 s, 79.8 MB/s 2024-09-10T23:26:46.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126695 s, 82.8 MB/s 2024-09-10T23:26:46.074 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.074 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.074 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114963 s, 91.2 MB/s 2024-09-10T23:26:46.090 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.090 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.090 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118229 s, 88.7 MB/s 2024-09-10T23:26:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119837 s, 87.5 MB/s 2024-09-10T23:26:46.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118209 s, 88.7 MB/s 2024-09-10T23:26:46.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.139 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127302 s, 82.4 MB/s 2024-09-10T23:26:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119668 s, 87.6 MB/s 2024-09-10T23:26:46.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129047 s, 81.3 MB/s 2024-09-10T23:26:46.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.189 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123373 s, 85.0 MB/s 2024-09-10T23:26:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116773 s, 89.8 MB/s 2024-09-10T23:26:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011927 s, 87.9 MB/s 2024-09-10T23:26:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120427 s, 87.1 MB/s 2024-09-10T23:26:46.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.254 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117576 s, 89.2 MB/s 2024-09-10T23:26:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120466 s, 87.0 MB/s 2024-09-10T23:26:46.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.286 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123613 s, 84.8 MB/s 2024-09-10T23:26:46.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.302 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114064 s, 91.9 MB/s 2024-09-10T23:26:46.318 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.318 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.318 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121688 s, 86.2 MB/s 2024-09-10T23:26:46.333 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.333 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.333 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110629 s, 94.8 MB/s 2024-09-10T23:26:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018606 s, 56.4 MB/s 2024-09-10T23:26:46.373 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.373 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.373 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121637 s, 86.2 MB/s 2024-09-10T23:26:46.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.389 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120553 s, 87.0 MB/s 2024-09-10T23:26:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114892 s, 91.3 MB/s 2024-09-10T23:26:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124803 s, 84.0 MB/s 2024-09-10T23:26:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117143 s, 89.5 MB/s 2024-09-10T23:26:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128779 s, 81.4 MB/s 2024-09-10T23:26:46.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.467 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112374 s, 93.3 MB/s 2024-09-10T23:26:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115767 s, 90.6 MB/s 2024-09-10T23:26:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112479 s, 93.2 MB/s 2024-09-10T23:26:46.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108605 s, 96.5 MB/s 2024-09-10T23:26:46.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:26:46.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:26:46.527 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119506 s, 87.7 MB/s 2024-09-10T23:26:46.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:26:46.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:46.535 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-09-10T23:26:46.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.721+0000 7f9139000640 1 -- 172.21.15.17:0/470852854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9134073ce0 msgr2=0x7f913415e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:46.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.721+0000 7f9139000640 1 --2- 172.21.15.17:0/470852854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9134073ce0 0x7f913415e800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f911c009900 tx=0x7f911c01f0d0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.721+0000 7f9139000640 1 -- 172.21.15.17:0/470852854 shutdown_connections 2024-09-10T23:26:46.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.721+0000 7f9139000640 1 --2- 172.21.15.17:0/470852854 >> v2:172.21.15.77:3300/0 conn(0x7f91340ccf10 0x7f9134070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.721+0000 7f9139000640 1 --2- 172.21.15.17:0/470852854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9134073ce0 0x7f913415e800 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.721+0000 7f9139000640 1 -- 172.21.15.17:0/470852854 >> 172.21.15.17:0/470852854 conn(0x7f91340d0c90 msgr2=0x7f91340d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:46.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.721+0000 7f9139000640 1 -- 172.21.15.17:0/470852854 shutdown_connections 2024-09-10T23:26:46.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.721+0000 7f9139000640 1 -- 172.21.15.17:0/470852854 wait complete. 2024-09-10T23:26:46.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 Processor -- start 2024-09-10T23:26:46.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 -- start start 2024-09-10T23:26:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9134073ce0 0x7f9134158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91340ccf10 0x7f91341596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f913415ab20 0x7f91340c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f91340cf470 con 0x7f91340ccf10 2024-09-10T23:26:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f91340cf2f0 con 0x7f913415ab20 2024-09-10T23:26:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f91340cf5f0 con 0x7f9134073ce0 2024-09-10T23:26:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9129400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91340ccf10 0x7f91341596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9129400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91340ccf10 0x7f91341596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58018/0 (socket says 172.21.15.17:58018) 2024-09-10T23:26:46.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9129400640 1 -- 172.21.15.17:0/351937533 learned_addr learned my addr 172.21.15.17:0/351937533 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:46.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9132800640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f913415ab20 0x7f91340c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9131e00640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9134073ce0 0x7f9134158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9129400640 1 -- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9134073ce0 msgr2=0x7f9134158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9129400640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9134073ce0 0x7f9134158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9129400640 1 -- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f913415ab20 msgr2=0x7f91340c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9129400640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f913415ab20 0x7f91340c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9129400640 1 -- 172.21.15.17:0/351937533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91341f4770 con 0x7f91340ccf10 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9129400640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91340ccf10 0x7f91341596d0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f911c009850 tx=0x7f911c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f912aa00640 1 -- 172.21.15.17:0/351937533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c0be070 con 0x7f91340ccf10 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f912aa00640 1 -- 172.21.15.17:0/351937533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f911c0053e0 con 0x7f91340ccf10 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 -- 172.21.15.17:0/351937533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91341f4a50 con 0x7f91340ccf10 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f912aa00640 1 -- 172.21.15.17:0/351937533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c0b5040 con 0x7f91340ccf10 2024-09-10T23:26:46.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.725+0000 7f9139000640 1 -- 172.21.15.17:0/351937533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91341f5010 con 0x7f91340ccf10 2024-09-10T23:26:46.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f912aa00640 1 -- 172.21.15.17:0/351937533 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f911c0b8030 con 0x7f91340ccf10 2024-09-10T23:26:46.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f913c468000 1 Processor -- start 2024-09-10T23:26:46.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f912aa00640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91100725d0 0x7f9110074a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f912aa00640 1 -- 172.21.15.17:0/351937533 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f911c1300e0 con 0x7f91340ccf10 2024-09-10T23:26:46.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f913c468000 1 -- start start 2024-09-10T23:26:46.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9131e00640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91100725d0 0x7f9110074a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9131e00640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91100725d0 0x7f9110074a90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9134159470 tx=0x7f9124009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:46.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f913c468000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9a860 0x55971df9ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f913c468000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 0x55971df50c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f913c468000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df51180 0x55971df51560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f913c468000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55971ddac8f0 con 0x55971df51180 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f913c468000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55971dd9bd20 con 0x55971df9b180 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f913c468000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55971dd9fb30 con 0x55971df9a860 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9131e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9a860 0x55971df9ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9132800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df51180 0x55971df51560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9129400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 0x55971df50c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9131e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9a860 0x55971df9ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:38794/0 (socket says 172.21.15.17:38794) 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9132800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df51180 0x55971df51560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58026/0 (socket says 172.21.15.17:58026) 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9131e00640 1 -- 172.21.15.17:0/1483005896 learned_addr learned my addr 172.21.15.17:0/1483005896 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9132800640 1 -- 172.21.15.17:0/1483005896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9a860 msgr2=0x55971df9ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9132800640 1 --2- 172.21.15.17:0/1483005896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9a860 0x55971df9ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9132800640 1 -- 172.21.15.17:0/1483005896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 msgr2=0x55971df50c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9132800640 1 --2- 172.21.15.17:0/1483005896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 0x55971df50c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.729+0000 7f9132800640 1 -- 172.21.15.17:0/1483005896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55971dd3a2c0 con 0x55971df51180 2024-09-10T23:26:46.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9131e00640 1 --2- 172.21.15.17:0/1483005896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9a860 0x55971df9ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:46.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9132800640 1 --2- 172.21.15.17:0/1483005896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df51180 0x55971df51560 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f912c009ee0 tx=0x7f912c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff50bc7d9dcece73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9122a00640 1 -- 172.21.15.17:0/1483005896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c003b80 con 0x55971df51180 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9122a00640 1 -- 172.21.15.17:0/1483005896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912c015070 con 0x55971df51180 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9122a00640 1 -- 172.21.15.17:0/1483005896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c004290 con 0x55971df51180 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 -- 172.21.15.17:0/1483005896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df51180 msgr2=0x55971df51560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 --2- 172.21.15.17:0/1483005896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df51180 0x55971df51560 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f912c009ee0 tx=0x7f912c0107a0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 -- 172.21.15.17:0/1483005896 shutdown_connections 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 --2- 172.21.15.17:0/1483005896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df51180 0x55971df51560 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 --2- 172.21.15.17:0/1483005896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 0x55971df50c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 --2- 172.21.15.17:0/1483005896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9a860 0x55971df9ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 -- 172.21.15.17:0/1483005896 >> 172.21.15.17:0/1483005896 conn(0x55971df572e0 msgr2=0x55971df4f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 -- 172.21.15.17:0/1483005896 shutdown_connections 2024-09-10T23:26:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 -- 172.21.15.17:0/1483005896 wait complete. 2024-09-10T23:26:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 -- start start 2024-09-10T23:26:46.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 Processor -- start 2024-09-10T23:26:46.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 0x55971dfa1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971dfa2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 0x55971dfa2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55971dd45cf0 con 0x55971df9a860 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55971dd472c0 con 0x55971df9b180 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55971ddab6c0 con 0x55971df51180 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f913c468000 10 client.0 _ll_register_callbacks cb 0x55971df3c770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9129400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971dfa2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9131e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 0x55971dfa1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9129400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971dfa2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58036/0 (socket says 172.21.15.17:58036) 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9129400640 1 -- 172.21.15.17:0/1177912125 learned_addr learned my addr 172.21.15.17:0/1177912125 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9132800640 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 0x55971dfa2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9129400640 1 -- 172.21.15.17:0/1177912125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 msgr2=0x55971dfa1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9129400640 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 0x55971dfa1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9129400640 1 -- 172.21.15.17:0/1177912125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 msgr2=0x55971dfa2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9129400640 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 0x55971dfa2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9129400640 1 -- 172.21.15.17:0/1177912125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55971dd59230 con 0x55971df9a860 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.733+0000 7f9131e00640 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 0x55971dfa1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9129400640 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971dfa2130 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f911c0099f0 tx=0x7f911c0a8e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a69699373805210 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 1 -- 172.21.15.17:0/1177912125 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c104190 con 0x55971df9a860 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 1 -- 172.21.15.17:0/1177912125 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f911c100b90 con 0x55971df9a860 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 -- 172.21.15.17:0/1177912125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55971dd34400 con 0x55971df9a860 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 1 -- 172.21.15.17:0/1177912125 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f911c0faf20 con 0x55971df9a860 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 10 client.9345 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 -- 172.21.15.17:0/1177912125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55971dd21010 con 0x55971df9a860 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 1 -- 172.21.15.17:0/1177912125 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55971dd34400 con 0x55971df9a860 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 1 -- 172.21.15.17:0/1177912125 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f911c0fa180 con 0x55971df9a860 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 10 client.9345 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 10 client.9345 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:46.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 20 client.9345 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55971dfa9fc0 0x55971dfac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 4 client.9345 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 -- 172.21.15.17:0/1177912125 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55971ddae840 con 0x55971dfa9fc0 2024-09-10T23:26:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9131e00640 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55971dfa9fc0 0x55971dfac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9131e00640 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55971dfa9fc0 0x55971dfac3b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33f57ce423df7e80 server_cookie=c2f39e5c0478330e in_seq=0 out_seq=0 2024-09-10T23:26:46.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 10 client.9345 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:46.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 1 -- 172.21.15.17:0/1177912125 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55971ddae840 con 0x55971dfa9fc0 2024-09-10T23:26:46.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 10 client.9345 handle_command_reply: tid=0 2024-09-10T23:26:46.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 client.9345 shutdown 2024-09-10T23:26:46.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 -- 172.21.15.17:0/1177912125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 msgr2=0x55971dfa2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:46.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971dfa2130 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f911c0099f0 tx=0x7f911c0a8e60 comp rx=0 tx=0).stop 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 -- 172.21.15.17:0/1177912125 shutdown_connections 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55971dfa9fc0 0x55971dfac3b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9b180 0x55971dfa2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971dfa2130 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f9117400640 0 client.9345 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 --2- 172.21.15.17:0/1177912125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 0x55971dfa1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 -- 172.21.15.17:0/1177912125 >> 172.21.15.17:0/1177912125 conn(0x55971df572e0 msgr2=0x55971df4f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 -- 172.21.15.17:0/1177912125 shutdown_connections 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 1 -- 172.21.15.17:0/1177912125 wait complete. 2024-09-10T23:26:46.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.737+0000 7f913c468000 20 client.9345 trim_cache size 0 max 16384 2024-09-10T23:26:46.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f913c468000 1 Processor -- start 2024-09-10T23:26:46.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f913c468000 1 -- start start 2024-09-10T23:26:46.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f913c468000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 0x55971e00db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f913c468000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9a860 0x55971e00e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f913c468000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9b180 0x55971e00e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f913c468000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9134200720 con 0x55971df9b180 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f913c468000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f91340c61f0 con 0x55971df9a860 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f913c468000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f91342000d0 con 0x55971df51180 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9132800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9b180 0x55971e00e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9132800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9b180 0x55971e00e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58040/0 (socket says 172.21.15.17:58040) 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9132800640 1 -- 172.21.15.17:0/4187667508 learned_addr learned my addr 172.21.15.17:0/4187667508 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9131e00640 1 --2- 172.21.15.17:0/4187667508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 0x55971e00db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9129400640 1 --2- 172.21.15.17:0/4187667508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9a860 0x55971e00e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9132800640 1 -- 172.21.15.17:0/4187667508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 msgr2=0x55971e00db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9132800640 1 --2- 172.21.15.17:0/4187667508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 0x55971e00db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9132800640 1 -- 172.21.15.17:0/4187667508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9a860 msgr2=0x55971e00e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:46.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9132800640 1 --2- 172.21.15.17:0/4187667508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9a860 0x55971e00e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9132800640 1 -- 172.21.15.17:0/4187667508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55971ddf8320 con 0x55971df9b180 2024-09-10T23:26:46.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9132800640 1 --2- 172.21.15.17:0/4187667508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9b180 0x55971e00e5b0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x55971dd5ee30 tx=0x7f912c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afff4b1a033cc53c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9122000640 1 -- 172.21.15.17:0/4187667508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c004b30 con 0x55971df9b180 2024-09-10T23:26:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9122000640 1 -- 172.21.15.17:0/4187667508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912c015040 con 0x55971df9b180 2024-09-10T23:26:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.757+0000 7f9122000640 1 -- 172.21.15.17:0/4187667508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c003980 con 0x55971df9b180 2024-09-10T23:26:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- 172.21.15.17:0/4187667508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9b180 msgr2=0x55971e00e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 --2- 172.21.15.17:0/4187667508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9b180 0x55971e00e5b0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x55971dd5ee30 tx=0x7f912c004ac0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- 172.21.15.17:0/4187667508 shutdown_connections 2024-09-10T23:26:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 --2- 172.21.15.17:0/4187667508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9b180 0x55971e00e5b0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 --2- 172.21.15.17:0/4187667508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df9a860 0x55971e00e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 --2- 172.21.15.17:0/4187667508 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df51180 0x55971e00db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- 172.21.15.17:0/4187667508 >> 172.21.15.17:0/4187667508 conn(0x55971df572e0 msgr2=0x55971df52780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:46.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- 172.21.15.17:0/4187667508 shutdown_connections 2024-09-10T23:26:46.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- 172.21.15.17:0/4187667508 wait complete. 2024-09-10T23:26:46.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- start start 2024-09-10T23:26:46.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 Processor -- start 2024-09-10T23:26:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df51180 0x55971e011540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971e011a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9b180 0x55971e011fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55971dd9ee40 con 0x55971df9a860 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55971dd5b830 con 0x55971df51180 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55971dda4160 con 0x55971df9b180 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 10 client.0 _ll_register_callbacks cb 0x7f911c0f6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9129400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971e011a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9129400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971e011a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58048/0 (socket says 172.21.15.17:58048) 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9129400640 1 -- 172.21.15.17:0/775662333 learned_addr learned my addr 172.21.15.17:0/775662333 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9132800640 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9b180 0x55971e011fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9131e00640 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df51180 0x55971e011540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9129400640 1 -- 172.21.15.17:0/775662333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9b180 msgr2=0x55971e011fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9129400640 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9b180 0x55971e011fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9129400640 1 -- 172.21.15.17:0/775662333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df51180 msgr2=0x55971e011540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9129400640 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df51180 0x55971e011540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9129400640 1 -- 172.21.15.17:0/775662333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55971dd64d60 con 0x55971df9a860 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9129400640 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971e011a80 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f911c0f76e0 tx=0x7f911c12e320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678c7d28d2a999aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9117400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9117400640 1 -- 172.21.15.17:0/775662333 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c0fa870 con 0x55971df9a860 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9117400640 1 -- 172.21.15.17:0/775662333 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f911c100b90 con 0x55971df9a860 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- 172.21.15.17:0/775662333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f912c015040 con 0x55971df9a860 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9117400640 1 -- 172.21.15.17:0/775662333 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f911c0ffa00 con 0x55971df9a860 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 10 client.9351 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 1 -- 172.21.15.17:0/775662333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55971da521a0 con 0x55971df9a860 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9117400640 1 -- 172.21.15.17:0/775662333 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912c015040 con 0x55971df9a860 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f9117400640 1 -- 172.21.15.17:0/775662333 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f911c127170 con 0x55971df9a860 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 10 client.9351 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 10 client.9351 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.761+0000 7f913c468000 20 client.9351 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55971dfa7190 0x55971dfa75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 4 client.9351 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T23:26:46.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 -- 172.21.15.17:0/775662333 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55971ddaa2f0 con 0x55971dfa7190 2024-09-10T23:26:46.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f9131e00640 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55971dfa7190 0x55971dfa75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:46.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f9117400640 10 client.9351 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:46.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f9131e00640 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55971dfa7190 0x55971dfa75a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7914e15c2f5d3eaf server_cookie=198fe2908487cb24 in_seq=0 out_seq=0 2024-09-10T23:26:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f9117400640 1 -- 172.21.15.17:0/775662333 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55971ddaa2f0 con 0x55971dfa7190 2024-09-10T23:26:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f9117400640 10 client.9351 handle_command_reply: tid=0 2024-09-10T23:26:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 client.9351 shutdown 2024-09-10T23:26:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 -- 172.21.15.17:0/775662333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 msgr2=0x55971e011a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971e011a80 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f911c0f76e0 tx=0x7f911c12e320 comp rx=0 tx=0).stop 2024-09-10T23:26:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 -- 172.21.15.17:0/775662333 shutdown_connections 2024-09-10T23:26:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55971dfa7190 0x55971dfa75a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55971df9b180 0x55971e011fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55971df9a860 0x55971e011a80 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 --2- 172.21.15.17:0/775662333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55971df51180 0x55971e011540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 -- 172.21.15.17:0/775662333 >> 172.21.15.17:0/775662333 conn(0x55971df572e0 msgr2=0x55971df51d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:46.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f9117400640 0 client.9351 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:46.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 -- 172.21.15.17:0/775662333 shutdown_connections 2024-09-10T23:26:46.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.765+0000 7f913c468000 1 -- 172.21.15.17:0/775662333 wait complete. 2024-09-10T23:26:46.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f913c468000 20 client.9351 trim_cache size 0 max 16384 2024-09-10T23:26:46.773 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:26:46.773 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "ec9b90e9-9427-44eb-9e5b-ff67747f9b99", 2024-09-10T23:26:46.774 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:26:46.774 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:46.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 -- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91100725d0 msgr2=0x7f9110074a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91100725d0 0x7f9110074a90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9134159470 tx=0x7f9124009040 comp rx=0 tx=0).stop 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 -- 172.21.15.17:0/351937533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91340ccf10 msgr2=0x7f91341596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91340ccf10 0x7f91341596d0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f911c009850 tx=0x7f911c005e70 comp rx=0 tx=0).stop 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 -- 172.21.15.17:0/351937533 shutdown_connections 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f91100725d0 0x7f9110074a90 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f913415ab20 0x7f91340c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91340ccf10 0x7f91341596d0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 --2- 172.21.15.17:0/351937533 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9134073ce0 0x7f9134158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 -- 172.21.15.17:0/351937533 >> 172.21.15.17:0/351937533 conn(0x7f91340d0c90 msgr2=0x7f9134068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 -- 172.21.15.17:0/351937533 shutdown_connections 2024-09-10T23:26:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:46.769+0000 7f9139000640 1 -- 172.21.15.17:0/351937533 wait complete. 2024-09-10T23:26:46.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:46.795 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-09-10T23:26:47.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.013+0000 7f9ac4a00640 1 -- 172.21.15.17:0/1500252618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac015bbc0 msgr2=0x7f9ac00b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.013+0000 7f9ac4a00640 1 --2- 172.21.15.17:0/1500252618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac015bbc0 0x7f9ac00b4950 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009bc0 tx=0x7f9ab801cba0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.013+0000 7f9ac4a00640 1 -- 172.21.15.17:0/1500252618 shutdown_connections 2024-09-10T23:26:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.013+0000 7f9ac4a00640 1 --2- 172.21.15.17:0/1500252618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac015bbc0 0x7f9ac00b4950 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.013+0000 7f9ac4a00640 1 -- 172.21.15.17:0/1500252618 >> 172.21.15.17:0/1500252618 conn(0x7f9ac00cff10 msgr2=0x7f9ac00d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.013+0000 7f9ac4a00640 1 -- 172.21.15.17:0/1500252618 shutdown_connections 2024-09-10T23:26:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.013+0000 7f9ac4a00640 1 -- 172.21.15.17:0/1500252618 wait complete. 2024-09-10T23:26:47.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.013+0000 7f9ac4a00640 1 Processor -- start 2024-09-10T23:26:47.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ac4a00640 1 -- start start 2024-09-10T23:26:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ac4a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ac0151860 0x7f9ac01659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ac4a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0151c40 0x7f9ac01fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ac4a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ac015bbc0 0x7f9ac01fc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ac4a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac0168cd0 con 0x7f9ac0151c40 2024-09-10T23:26:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ac4a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac0168b50 con 0x7f9ac0151860 2024-09-10T23:26:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ac4a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac0168e50 con 0x7f9ac015bbc0 2024-09-10T23:26:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0151c40 0x7f9ac01fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abf400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ac0151860 0x7f9ac01659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0151c40 0x7f9ac01fbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43914/0 (socket says 172.21.15.17:43914) 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abea00640 1 -- 172.21.15.17:0/2714849212 learned_addr learned my addr 172.21.15.17:0/2714849212 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abf400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ac0151860 0x7f9ac01659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:33716/0 (socket says 172.21.15.17:33716) 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abfe00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ac015bbc0 0x7f9ac01fc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abea00640 1 -- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ac015bbc0 msgr2=0x7f9ac01fc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abea00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ac015bbc0 0x7f9ac01fc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abea00640 1 -- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ac0151860 msgr2=0x7f9ac01659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abea00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ac0151860 0x7f9ac01659d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abea00640 1 -- 172.21.15.17:0/2714849212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac0143d10 con 0x7f9ac0151c40 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abf400640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ac0151860 0x7f9ac01659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:47.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abfe00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ac015bbc0 0x7f9ac01fc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9abea00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0151c40 0x7f9ac01fbca0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00c480 tx=0x7f9aac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ab7400640 1 -- 172.21.15.17:0/2714849212 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac016020 con 0x7f9ac0151c40 2024-09-10T23:26:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ab7400640 1 -- 172.21.15.17:0/2714849212 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aac012920 con 0x7f9ac0151c40 2024-09-10T23:26:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ab7400640 1 -- 172.21.15.17:0/2714849212 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac012db0 con 0x7f9ac0151c40 2024-09-10T23:26:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ac4a00640 1 -- 172.21.15.17:0/2714849212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac01fc720 con 0x7f9ac0151c40 2024-09-10T23:26:47.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.017+0000 7f9ac4a00640 1 -- 172.21.15.17:0/2714849212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac0143230 con 0x7f9ac0151c40 2024-09-10T23:26:47.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.021+0000 7f9ab7400640 1 -- 172.21.15.17:0/2714849212 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9aac01a3b0 con 0x7f9ac0151c40 2024-09-10T23:26:47.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.021+0000 7f9ac93dd000 1 Processor -- start 2024-09-10T23:26:47.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 -- start start 2024-09-10T23:26:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ab7400640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aa00725e0 0x7f9aa0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ab7400640 1 -- 172.21.15.17:0/2714849212 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f9aac0934c0 con 0x7f9ac0151c40 2024-09-10T23:26:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x562533974e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x5625339757b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abfe00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aa00725e0 0x7f9aa0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 0x56253392b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5625337292c0 con 0x5625338131d0 2024-09-10T23:26:47.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562533786b90 con 0x56253392b5a0 2024-09-10T23:26:47.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562533775fc0 con 0x5625339753d0 2024-09-10T23:26:47.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x562533974e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x5625339757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abfe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 0x56253392b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x562533974e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43930/0 (socket says 172.21.15.17:43930) 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x5625339757b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56074/0 (socket says 172.21.15.17:56074) 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abf400640 1 -- 172.21.15.17:0/3100583005 learned_addr learned my addr 172.21.15.17:0/3100583005 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abf400640 1 -- 172.21.15.17:0/3100583005 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 msgr2=0x5625339757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abf400640 1 --2- 172.21.15.17:0/3100583005 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x5625339757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abf400640 1 -- 172.21.15.17:0/3100583005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 msgr2=0x56253392b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abf400640 1 --2- 172.21.15.17:0/3100583005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 0x56253392b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abf400640 1 -- 172.21.15.17:0/3100583005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625337141a0 con 0x5625338131d0 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abea00640 1 --2- 172.21.15.17:0/3100583005 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x5625339757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abfe00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aa00725e0 0x7f9aa0074aa0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80af000 tx=0x7f9ab8004ee0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9abf400640 1 --2- 172.21.15.17:0/3100583005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x562533974e90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0001720 tx=0x7f9ab0001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33b7dd5a09954d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9aabe00640 1 -- 172.21.15.17:0/3100583005 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0019070 con 0x5625338131d0 2024-09-10T23:26:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9aabe00640 1 -- 172.21.15.17:0/3100583005 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab00052e0 con 0x5625338131d0 2024-09-10T23:26:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9aabe00640 1 -- 172.21.15.17:0/3100583005 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000e920 con 0x5625338131d0 2024-09-10T23:26:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 -- 172.21.15.17:0/3100583005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 msgr2=0x562533974e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/3100583005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x562533974e90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0001720 tx=0x7f9ab0001be0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 -- 172.21.15.17:0/3100583005 shutdown_connections 2024-09-10T23:26:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/3100583005 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 0x56253392b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/3100583005 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x5625339757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/3100583005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x562533974e90 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.025+0000 7f9ac93dd000 1 -- 172.21.15.17:0/3100583005 >> 172.21.15.17:0/3100583005 conn(0x562533434880 msgr2=0x562533929e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 -- 172.21.15.17:0/3100583005 shutdown_connections 2024-09-10T23:26:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 -- 172.21.15.17:0/3100583005 wait complete. 2024-09-10T23:26:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 -- start start 2024-09-10T23:26:47.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 Processor -- start 2024-09-10T23:26:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x56253397ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 0x56253397bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x56253397c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56253371b4d0 con 0x5625338131d0 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562533779dd0 con 0x56253392b5a0 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56253343b620 con 0x5625339753d0 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9ac93dd000 10 client.0 _ll_register_callbacks cb 0x56253374ccd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 0x56253397bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abfe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x56253397c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x56253397ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 0x56253397bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:33722/0 (socket says 172.21.15.17:33722) 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abea00640 1 -- 172.21.15.17:0/994388088 learned_addr learned my addr 172.21.15.17:0/994388088 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abf400640 1 -- 172.21.15.17:0/994388088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 msgr2=0x56253397c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abf400640 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x56253397c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abf400640 1 -- 172.21.15.17:0/994388088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 msgr2=0x56253397bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abf400640 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 0x56253397bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.029+0000 7f9abf400640 1 -- 172.21.15.17:0/994388088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562533845720 con 0x5625338131d0 2024-09-10T23:26:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9abf400640 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x56253397ba20 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0016000 tx=0x7f9ab0005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907c4a395deb40df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9aa8c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:47.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9aa8c00640 1 -- 172.21.15.17:0/994388088 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0019070 con 0x5625338131d0 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9aa8c00640 1 -- 172.21.15.17:0/994388088 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f9ab000e9d0 con 0x5625338131d0 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9ac93dd000 1 -- 172.21.15.17:0/994388088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56253370e2e0 con 0x5625338131d0 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9aa8c00640 1 -- 172.21.15.17:0/994388088 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f9ab002a050 con 0x5625338131d0 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9ac93dd000 10 client.9366 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9ac93dd000 1 -- 172.21.15.17:0/994388088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x5625337fb420 con 0x5625338131d0 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9aa8c00640 1 -- 172.21.15.17:0/994388088 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56253370e2e0 con 0x5625338131d0 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9aa8c00640 1 -- 172.21.15.17:0/994388088 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f9ab002d020 con 0x5625338131d0 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9ac93dd000 10 client.9366 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9ac93dd000 10 client.9366 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9ac93dd000 20 client.9366 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562533983df0 0x5625339861e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9ac93dd000 4 client.9366 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9ac93dd000 1 -- 172.21.15.17:0/994388088 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562533788ae0 con 0x562533983df0 2024-09-10T23:26:47.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9abea00640 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562533983df0 0x5625339861e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9abea00640 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562533983df0 0x5625339861e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc6958929eca4612 server_cookie=8028110c0c506078 in_seq=0 out_seq=0 2024-09-10T23:26:47.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.033+0000 7f9aa8c00640 10 client.9366 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9aa8c00640 1 -- 172.21.15.17:0/994388088 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562533788ae0 con 0x562533983df0 2024-09-10T23:26:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9aa8c00640 10 client.9366 handle_command_reply: tid=0 2024-09-10T23:26:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 client.9366 shutdown 2024-09-10T23:26:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 -- 172.21.15.17:0/994388088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 msgr2=0x56253397ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x56253397ba20 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0016000 tx=0x7f9ab0005590 comp rx=0 tx=0).stop 2024-09-10T23:26:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 -- 172.21.15.17:0/994388088 shutdown_connections 2024-09-10T23:26:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562533983df0 0x5625339861e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625339753d0 0x56253397c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56253392b5a0 0x56253397bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/994388088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x56253397ba20 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9aa8c00640 0 client.9366 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 -- 172.21.15.17:0/994388088 >> 172.21.15.17:0/994388088 conn(0x562533434880 msgr2=0x56253392a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 -- 172.21.15.17:0/994388088 shutdown_connections 2024-09-10T23:26:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 1 -- 172.21.15.17:0/994388088 wait complete. 2024-09-10T23:26:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.037+0000 7f9ac93dd000 20 client.9366 trim_cache size 0 max 16384 2024-09-10T23:26:47.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9ac93dd000 1 Processor -- start 2024-09-10T23:26:47.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9ac93dd000 1 -- start start 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625338131d0 0x5625339820a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56253392b5a0 0x562533929660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 0x562533929ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac0208b00 con 0x56253392b5a0 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac01ff840 con 0x5625339753d0 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac0073660 con 0x5625338131d0 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56253392b5a0 0x562533929660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56253392b5a0 0x562533929660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43948/0 (socket says 172.21.15.17:43948) 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abea00640 1 -- 172.21.15.17:0/664843831 learned_addr learned my addr 172.21.15.17:0/664843831 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abfe00640 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 0x562533929ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abf400640 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625338131d0 0x5625339820a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abea00640 1 -- 172.21.15.17:0/664843831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625338131d0 msgr2=0x5625339820a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abea00640 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625338131d0 0x5625339820a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abea00640 1 -- 172.21.15.17:0/664843831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 msgr2=0x562533929ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abea00640 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 0x562533929ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abea00640 1 -- 172.21.15.17:0/664843831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625337d2ae0 con 0x56253392b5a0 2024-09-10T23:26:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.061+0000 7f9abf400640 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625338131d0 0x5625339820a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9abea00640 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56253392b5a0 0x562533929660 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f9aac05e290 tx=0x7f9aac093040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b917fcd4c7525c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9aab400640 1 -- 172.21.15.17:0/664843831 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac062de0 con 0x56253392b5a0 2024-09-10T23:26:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9aab400640 1 -- 172.21.15.17:0/664843831 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aac05a570 con 0x56253392b5a0 2024-09-10T23:26:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9aab400640 1 -- 172.21.15.17:0/664843831 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac067370 con 0x56253392b5a0 2024-09-10T23:26:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 -- 172.21.15.17:0/664843831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56253392b5a0 msgr2=0x562533929660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56253392b5a0 0x562533929660 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f9aac05e290 tx=0x7f9aac093040 comp rx=0 tx=0).stop 2024-09-10T23:26:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 -- 172.21.15.17:0/664843831 shutdown_connections 2024-09-10T23:26:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 0x562533929ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56253392b5a0 0x562533929660 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/664843831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5625338131d0 0x5625339820a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 -- 172.21.15.17:0/664843831 >> 172.21.15.17:0/664843831 conn(0x562533434880 msgr2=0x56253392d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 -- 172.21.15.17:0/664843831 shutdown_connections 2024-09-10T23:26:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 -- 172.21.15.17:0/664843831 wait complete. 2024-09-10T23:26:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 -- start start 2024-09-10T23:26:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.065+0000 7f9ac93dd000 1 Processor -- start 2024-09-10T23:26:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x5625339eaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56253392b5a0 0x5625339eb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 0x5625339eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56253377e400 con 0x5625338131d0 2024-09-10T23:26:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5625337790e0 con 0x5625339753d0 2024-09-10T23:26:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562533741c50 con 0x56253392b5a0 2024-09-10T23:26:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 10 client.0 _ll_register_callbacks cb 0x7f9ab0017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x5625339eaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x5625339eaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43956/0 (socket says 172.21.15.17:43956) 2024-09-10T23:26:47.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abf400640 1 -- 172.21.15.17:0/1237126681 learned_addr learned my addr 172.21.15.17:0/1237126681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abfe00640 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 0x5625339eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abf400640 1 -- 172.21.15.17:0/1237126681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56253392b5a0 msgr2=0x5625339eb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abf400640 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56253392b5a0 0x5625339eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abf400640 1 -- 172.21.15.17:0/1237126681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 msgr2=0x5625339eb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abf400640 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 0x5625339eb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abf400640 1 -- 172.21.15.17:0/1237126681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562533740040 con 0x5625338131d0 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abfe00640 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 0x5625339eb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abf400640 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x5625339eaf50 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0001720 tx=0x7f9ab0006e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c162dea7fe87ab6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9aa8c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1237126681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0033060 con 0x5625338131d0 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1237126681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f9ab000e9d0 con 0x5625338131d0 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 -- 172.21.15.17:0/1237126681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aac05a570 con 0x5625338131d0 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1237126681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f9ab0039050 con 0x5625338131d0 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 10 client.9372 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 -- 172.21.15.17:0/1237126681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x56253370c620 con 0x5625338131d0 2024-09-10T23:26:47.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1237126681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aac05a570 con 0x5625338131d0 2024-09-10T23:26:47.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1237126681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f9ab003c020 con 0x5625338131d0 2024-09-10T23:26:47.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 10 client.9372 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:47.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 10 client.9372 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:47.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 20 client.9372 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:47.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562533980e00 0x562533981210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 4 client.9372 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T23:26:47.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9ac93dd000 1 -- 172.21.15.17:0/1237126681 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x56253398c500 con 0x562533980e00 2024-09-10T23:26:47.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abea00640 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562533980e00 0x562533981210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9abea00640 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562533980e00 0x562533981210 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d7a0af3d8e4634 server_cookie=3057534628db991e in_seq=0 out_seq=0 2024-09-10T23:26:47.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.069+0000 7f9aa8c00640 10 client.9372 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:47.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1237126681 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56253398c500 con 0x562533980e00 2024-09-10T23:26:47.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9aa8c00640 10 client.9372 handle_command_reply: tid=0 2024-09-10T23:26:47.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 client.9372 shutdown 2024-09-10T23:26:47.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 -- 172.21.15.17:0/1237126681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 msgr2=0x5625339eaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x5625339eaf50 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0001720 tx=0x7f9ab0006e40 comp rx=0 tx=0).stop 2024-09-10T23:26:47.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 -- 172.21.15.17:0/1237126681 shutdown_connections 2024-09-10T23:26:47.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562533980e00 0x562533981210 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5625339753d0 0x5625339eb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56253392b5a0 0x5625339eb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 --2- 172.21.15.17:0/1237126681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5625338131d0 0x5625339eaf50 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 -- 172.21.15.17:0/1237126681 >> 172.21.15.17:0/1237126681 conn(0x562533434880 msgr2=0x562533930190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9aa8c00640 0 client.9372 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:47.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 -- 172.21.15.17:0/1237126681 shutdown_connections 2024-09-10T23:26:47.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 1 -- 172.21.15.17:0/1237126681 wait complete. 2024-09-10T23:26:47.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.077+0000 7f9ac93dd000 20 client.9372 trim_cache size 0 max 16384 2024-09-10T23:26:47.084 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:47.084 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:26:47.085 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:26:47.085 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:47.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 -- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aa00725e0 msgr2=0x7f9aa0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aa00725e0 0x7f9aa0074aa0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80af000 tx=0x7f9ab8004ee0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 -- 172.21.15.17:0/2714849212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0151c40 msgr2=0x7f9ac01fbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0151c40 0x7f9ac01fbca0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00c480 tx=0x7f9aac00c940 comp rx=0 tx=0).stop 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 -- 172.21.15.17:0/2714849212 shutdown_connections 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9aa00725e0 0x7f9aa0074aa0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ac015bbc0 0x7f9ac01fc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0151c40 0x7f9ac01fbca0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 --2- 172.21.15.17:0/2714849212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ac0151860 0x7f9ac01659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 -- 172.21.15.17:0/2714849212 >> 172.21.15.17:0/2714849212 conn(0x7f9ac00cff10 msgr2=0x7f9ac00ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 -- 172.21.15.17:0/2714849212 shutdown_connections 2024-09-10T23:26:47.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.081+0000 7f9ac4a00640 1 -- 172.21.15.17:0/2714849212 wait complete. 2024-09-10T23:26:47.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:47.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-10T23:26:47.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.265+0000 7fa218400640 1 -- 172.21.15.17:0/4105136419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2100cf0b0 msgr2=0x7fa2100cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.265+0000 7fa218400640 1 --2- 172.21.15.17:0/4105136419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2100cf0b0 0x7fa2100cd4d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa208009c80 tx=0x7fa20801cda0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.265+0000 7fa218400640 1 -- 172.21.15.17:0/4105136419 shutdown_connections 2024-09-10T23:26:47.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.265+0000 7fa218400640 1 --2- 172.21.15.17:0/4105136419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2100cf0b0 0x7fa2100cd4d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.265+0000 7fa218400640 1 --2- 172.21.15.17:0/4105136419 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2100ce5c0 0x7fa21006f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.265+0000 7fa218400640 1 -- 172.21.15.17:0/4105136419 >> 172.21.15.17:0/4105136419 conn(0x7fa21009a9f0 msgr2=0x7fa21009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.265+0000 7fa218400640 1 -- 172.21.15.17:0/4105136419 shutdown_connections 2024-09-10T23:26:47.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.265+0000 7fa218400640 1 -- 172.21.15.17:0/4105136419 wait complete. 2024-09-10T23:26:47.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 Processor -- start 2024-09-10T23:26:47.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 -- start start 2024-09-10T23:26:47.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2100aeb50 0x7fa21015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2100ce5c0 0x7fa210156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2100cf0b0 0x7fa2100b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa21016aeb0 con 0x7fa2100ce5c0 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa21016ad30 con 0x7fa2100cf0b0 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa21016b030 con 0x7fa2100aeb50 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2100ce5c0 0x7fa210156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2100ce5c0 0x7fa210156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43962/0 (socket says 172.21.15.17:43962) 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215000640 1 -- 172.21.15.17:0/3195922418 learned_addr learned my addr 172.21.15.17:0/3195922418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa216400640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2100cf0b0 0x7fa2100b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215a00640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2100aeb50 0x7fa21015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215000640 1 -- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2100aeb50 msgr2=0x7fa21015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215000640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2100aeb50 0x7fa21015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215000640 1 -- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2100cf0b0 msgr2=0x7fa2100b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215000640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2100cf0b0 0x7fa2100b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215000640 1 -- 172.21.15.17:0/3195922418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2101f7f00 con 0x7fa2100ce5c0 2024-09-10T23:26:47.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa215000640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2100ce5c0 0x7fa210156dd0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c400 tx=0x7fa1fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa20d600640 1 -- 172.21.15.17:0/3195922418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc017070 con 0x7fa2100ce5c0 2024-09-10T23:26:47.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa20d600640 1 -- 172.21.15.17:0/3195922418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1fc0053e0 con 0x7fa2100ce5c0 2024-09-10T23:26:47.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa20d600640 1 -- 172.21.15.17:0/3195922418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc003860 con 0x7fa2100ce5c0 2024-09-10T23:26:47.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 -- 172.21.15.17:0/3195922418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2101f81e0 con 0x7fa2100ce5c0 2024-09-10T23:26:47.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.269+0000 7fa218400640 1 -- 172.21.15.17:0/3195922418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa210157460 con 0x7fa2100ce5c0 2024-09-10T23:26:47.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa20d600640 1 -- 172.21.15.17:0/3195922418 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa1fc003a00 con 0x7fa2100ce5c0 2024-09-10T23:26:47.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa20d600640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1f0072610 0x7fa1f0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa21b8c2000 1 Processor -- start 2024-09-10T23:26:47.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa20d600640 1 -- 172.21.15.17:0/3195922418 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fa1fc092a10 con 0x7fa2100ce5c0 2024-09-10T23:26:47.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa21b8c2000 1 -- start start 2024-09-10T23:26:47.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa215a00640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1f0072610 0x7fa1f0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa215a00640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1f0072610 0x7fa1f0074ad0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa204009be0 tx=0x7fa2040091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bd2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0b88680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0b88fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564be0a70cb0 con 0x564be0b88bc0 2024-09-10T23:26:47.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564be0986310 con 0x564be0bd2ac0 2024-09-10T23:26:47.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564be09e3b90 con 0x564be0bd21a0 2024-09-10T23:26:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa216400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0b88fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa215000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0b88680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa215a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bd2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa215000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0b88680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:33766/0 (socket says 172.21.15.17:33766) 2024-09-10T23:26:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.273+0000 7fa215000640 1 -- 172.21.15.17:0/3553004919 learned_addr learned my addr 172.21.15.17:0/3553004919 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa215000640 1 -- 172.21.15.17:0/3553004919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 msgr2=0x564be0bd2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa215000640 1 --2- 172.21.15.17:0/3553004919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bd2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa215000640 1 -- 172.21.15.17:0/3553004919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 msgr2=0x564be0b88fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa215000640 1 --2- 172.21.15.17:0/3553004919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0b88fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa215000640 1 -- 172.21.15.17:0/3553004919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be0987c60 con 0x564be0bd2ac0 2024-09-10T23:26:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa215000640 1 --2- 172.21.15.17:0/3553004919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0b88680 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc05d890 tx=0x7fa1fc05d800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=371607bfb256394e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa202000640 1 -- 172.21.15.17:0/3553004919 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc062070 con 0x564be0bd2ac0 2024-09-10T23:26:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa202000640 1 -- 172.21.15.17:0/3553004919 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1fc062330 con 0x564be0bd2ac0 2024-09-10T23:26:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa202000640 1 -- 172.21.15.17:0/3553004919 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc092040 con 0x564be0bd2ac0 2024-09-10T23:26:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3553004919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 msgr2=0x564be0b88680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3553004919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0b88680 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc05d890 tx=0x7fa1fc05d800 comp rx=0 tx=0).stop 2024-09-10T23:26:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3553004919 shutdown_connections 2024-09-10T23:26:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3553004919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0b88fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3553004919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0b88680 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3553004919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bd2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3553004919 >> 172.21.15.17:0/3553004919 conn(0x564be0b8ed20 msgr2=0x564be0b86f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3553004919 shutdown_connections 2024-09-10T23:26:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3553004919 wait complete. 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 -- start start 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 Processor -- start 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0b88bc0 0x564be0bd9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bd9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0bd2ac0 0x564be0bd9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564be09d6dd0 con 0x564be0bd2ac0 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564be09d2fc0 con 0x564be0b88bc0 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564be09784b0 con 0x564be0bd21a0 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa21b8c2000 10 client.0 _ll_register_callbacks cb 0x564be09567d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa216400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0bd2ac0 0x564be0bd9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa216400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0bd2ac0 0x564be0bd9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43974/0 (socket says 172.21.15.17:43974) 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa216400640 1 -- 172.21.15.17:0/3348166765 learned_addr learned my addr 172.21.15.17:0/3348166765 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa215a00640 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0b88bc0 0x564be0bd9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.277+0000 7fa215000640 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bd9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa216400640 1 -- 172.21.15.17:0/3348166765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 msgr2=0x564be0bd9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa216400640 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bd9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa216400640 1 -- 172.21.15.17:0/3348166765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0b88bc0 msgr2=0x564be0bd9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa216400640 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0b88bc0 0x564be0bd9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa216400640 1 -- 172.21.15.17:0/3348166765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564be09711f0 con 0x564be0bd2ac0 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa216400640 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0bd2ac0 0x564be0bd9fb0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fa2080b0040 tx=0x7fa208003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42327e15f91efedc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 1 -- 172.21.15.17:0/3348166765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2080b2040 con 0x564be0bd2ac0 2024-09-10T23:26:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3348166765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564be096b330 con 0x564be0bd2ac0 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 1 -- 172.21.15.17:0/3348166765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fa208004040 con 0x564be0bd2ac0 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 1 -- 172.21.15.17:0/3348166765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fa2080c7050 con 0x564be0bd2ac0 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 10 client.9381 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3348166765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x564be0957fa0 con 0x564be0bd2ac0 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 1 -- 172.21.15.17:0/3348166765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564be096b330 con 0x564be0bd2ac0 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 1 -- 172.21.15.17:0/3348166765 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fa2080ca020 con 0x564be0bd2ac0 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 10 client.9381 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 10 client.9381 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 20 client.9381 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x564be0be1900 0x564be0be3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 4 client.9381 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3348166765 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564be09e5ae0 con 0x564be0be1900 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa215a00640 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x564be0be1900 0x564be0be3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa215a00640 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x564be0be1900 0x564be0be3cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281ae10958f067e server_cookie=b24127bf5e2f3fe4 in_seq=0 out_seq=0 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 10 client.9381 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 1 -- 172.21.15.17:0/3348166765 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564be09e5ae0 con 0x564be0be1900 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 10 client.9381 handle_command_reply: tid=0 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 client.9381 shutdown 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3348166765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0bd2ac0 msgr2=0x564be0bd9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0bd2ac0 0x564be0bd9fb0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fa2080b0040 tx=0x7fa208003f90 comp rx=0 tx=0).stop 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3348166765 shutdown_connections 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x564be0be1900 0x564be0be3cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0bd2ac0 0x564be0bd9fb0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bd9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3348166765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0b88bc0 0x564be0bd9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa1f6a00640 0 client.9381 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3348166765 >> 172.21.15.17:0/3348166765 conn(0x564be0b8ed20 msgr2=0x564be0b86f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3348166765 shutdown_connections 2024-09-10T23:26:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3348166765 wait complete. 2024-09-10T23:26:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.281+0000 7fa21b8c2000 20 client.9381 trim_cache size 0 max 16384 2024-09-10T23:26:47.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa21b8c2000 1 Processor -- start 2024-09-10T23:26:47.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa21b8c2000 1 -- start start 2024-09-10T23:26:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0bdcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa210204690 con 0x564be0b88bc0 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa210203730 con 0x564be0bd2ac0 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa2101fb820 con 0x564be0bd21a0 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43988/0 (socket says 172.21.15.17:43988) 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215a00640 1 -- 172.21.15.17:0/3550264306 learned_addr learned my addr 172.21.15.17:0/3550264306 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa216400640 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0bdcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215000640 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215a00640 1 -- 172.21.15.17:0/3550264306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 msgr2=0x564be0bdca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215a00640 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215a00640 1 -- 172.21.15.17:0/3550264306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 msgr2=0x564be0bdcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215a00640 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0bdcfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215a00640 1 -- 172.21.15.17:0/3550264306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be0a30660 con 0x564be0b88bc0 2024-09-10T23:26:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa216400640 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0bdcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa215a00640 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdc550 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fa204004310 tx=0x7fa204014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547cf7b5dee319df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa201600640 1 -- 172.21.15.17:0/3550264306 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204005020 con 0x564be0b88bc0 2024-09-10T23:26:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa201600640 1 -- 172.21.15.17:0/3550264306 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2040051c0 con 0x564be0b88bc0 2024-09-10T23:26:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.301+0000 7fa201600640 1 -- 172.21.15.17:0/3550264306 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2040055b0 con 0x564be0b88bc0 2024-09-10T23:26:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3550264306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 msgr2=0x564be0bdc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdc550 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fa204004310 tx=0x7fa204014000 comp rx=0 tx=0).stop 2024-09-10T23:26:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3550264306 shutdown_connections 2024-09-10T23:26:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0bdcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/3550264306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdc550 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3550264306 >> 172.21.15.17:0/3550264306 conn(0x564be0b8ed20 msgr2=0x564be0b88fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3550264306 shutdown_connections 2024-09-10T23:26:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- 172.21.15.17:0/3550264306 wait complete. 2024-09-10T23:26:47.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- start start 2024-09-10T23:26:47.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 Processor -- start 2024-09-10T23:26:47.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0c04210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564be09d6dd0 con 0x564be0b88bc0 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564be0b91d40 con 0x564be0bd2ac0 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564be0b8f100 con 0x564be0bd21a0 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 10 client.0 _ll_register_callbacks cb 0x7fa208009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa215a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa215000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa216400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0c04210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa215a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43994/0 (socket says 172.21.15.17:43994) 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa215000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:56148/0 (socket says 172.21.15.17:56148) 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa216400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0c04210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:33788/0 (socket says 172.21.15.17:33788) 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa215a00640 1 -- 172.21.15.17:0/502901004 learned_addr learned my addr 172.21.15.17:0/502901004 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa216400640 1 -- 172.21.15.17:0/502901004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 msgr2=0x564be0bdf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa216400640 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa216400640 1 -- 172.21.15.17:0/502901004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 msgr2=0x564be0bdf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa216400640 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa216400640 1 -- 172.21.15.17:0/502901004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564be099d090 con 0x564be0bd2ac0 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa215000640 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa216400640 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0c04210 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa208009bd0 tx=0x7fa208005f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99e189d3e4bbbcab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa1f6a00640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa1f6a00640 1 -- 172.21.15.17:0/502901004 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2080b2070 con 0x564be0bd2ac0 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa1f6a00640 1 -- 172.21.15.17:0/502901004 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fa2080a5b80 con 0x564be0bd2ac0 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- 172.21.15.17:0/502901004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2040051c0 con 0x564be0bd2ac0 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa1f6a00640 1 -- 172.21.15.17:0/502901004 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fa2080d3050 con 0x564be0bd2ac0 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 10 client.8707 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:47.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- 172.21.15.17:0/502901004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x564be09695f0 con 0x564be0bd2ac0 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa1f6a00640 1 -- 172.21.15.17:0/502901004 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2040051c0 con 0x564be0bd2ac0 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa1f6a00640 1 -- 172.21.15.17:0/502901004 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fa2080d6020 con 0x564be0bd2ac0 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 10 client.8707 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 10 client.8707 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 20 client.8707 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x564be0c04bd0 0x564be0c48090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 4 client.8707 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.305+0000 7fa21b8c2000 1 -- 172.21.15.17:0/502901004 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564be09e1590 con 0x564be0c04bd0 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa215a00640 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x564be0c04bd0 0x564be0c48090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa215a00640 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x564be0c04bd0 0x564be0c48090 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2c8dabad600642b server_cookie=a36336627f84d4c2 in_seq=0 out_seq=0 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa1f6a00640 10 client.8707 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa1f6a00640 1 -- 172.21.15.17:0/502901004 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x564be09e1590 con 0x564be0c04bd0 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa1f6a00640 10 client.8707 handle_command_reply: tid=0 2024-09-10T23:26:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 client.8707 shutdown 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 -- 172.21.15.17:0/502901004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 msgr2=0x564be0c04210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0c04210 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa208009bd0 tx=0x7fa208005f60 comp rx=0 tx=0).stop 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 -- 172.21.15.17:0/502901004 shutdown_connections 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x564be0c04bd0 0x564be0c48090 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564be0bd2ac0 0x564be0c04210 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564be0bd21a0 0x564be0bdf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa1f6a00640 0 client.8707 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 --2- 172.21.15.17:0/502901004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564be0b88bc0 0x564be0bdf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 -- 172.21.15.17:0/502901004 >> 172.21.15.17:0/502901004 conn(0x564be0b8ed20 msgr2=0x564be0b88070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 -- 172.21.15.17:0/502901004 shutdown_connections 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 1 -- 172.21.15.17:0/502901004 wait complete. 2024-09-10T23:26:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa21b8c2000 20 client.8707 trim_cache size 0 max 16384 2024-09-10T23:26:47.319 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "PAUSED (643 inodes in the stack)", 2024-09-10T23:26:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:26:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "ec9b90e9-9427-44eb-9e5b-ff67747f9b99": { 2024-09-10T23:26:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:26:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "ec9b90e9-9427-44eb-9e5b-ff67747f9b99", 2024-09-10T23:26:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive" 2024-09-10T23:26:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "ec9b90e9-9427-44eb-9e5b-ff67747f9b99": { 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:26:46.765805+0000", 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:47.320 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 -- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1f0072610 msgr2=0x7fa1f0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1f0072610 0x7fa1f0074ad0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa204009be0 tx=0x7fa2040091e0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 -- 172.21.15.17:0/3195922418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2100ce5c0 msgr2=0x7fa210156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2100ce5c0 0x7fa210156dd0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c400 tx=0x7fa1fc00c8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 -- 172.21.15.17:0/3195922418 shutdown_connections 2024-09-10T23:26:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1f0072610 0x7fa1f0074ad0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2100cf0b0 0x7fa2100b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2100ce5c0 0x7fa210156dd0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 --2- 172.21.15.17:0/3195922418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa2100aeb50 0x7fa21015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 -- 172.21.15.17:0/3195922418 >> 172.21.15.17:0/3195922418 conn(0x7fa21009a9f0 msgr2=0x7fa2100b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 -- 172.21.15.17:0/3195922418 shutdown_connections 2024-09-10T23:26:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.309+0000 7fa218400640 1 -- 172.21.15.17:0/3195922418 wait complete. 2024-09-10T23:26:47.332 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 -- 172.21.15.17:0/882690688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f5415bc00 msgr2=0x7f6f540acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 --2- 172.21.15.17:0/882690688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f5415bc00 0x7f6f540acd20 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009900 tx=0x7f6f4401c8a0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 -- 172.21.15.17:0/882690688 shutdown_connections 2024-09-10T23:26:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 --2- 172.21.15.17:0/882690688 >> v2:172.21.15.77:3300/0 conn(0x7f6f5415d4c0 0x7f6f540ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 --2- 172.21.15.17:0/882690688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f5415bc00 0x7f6f540acd20 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 -- 172.21.15.17:0/882690688 >> 172.21.15.17:0/882690688 conn(0x7f6f540cfd30 msgr2=0x7f6f540d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 -- 172.21.15.17:0/882690688 shutdown_connections 2024-09-10T23:26:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 -- 172.21.15.17:0/882690688 wait complete. 2024-09-10T23:26:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 Processor -- start 2024-09-10T23:26:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.477+0000 7f6f53e00640 1 -- start start 2024-09-10T23:26:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f540aedc0 0x7f6f5414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5415bc00 0x7f6f5409d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f5415d4c0 0x7f6f540cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54168d80 con 0x7f6f540aedc0 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54168c00 con 0x7f6f5415bc00 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6f54168f00 con 0x7f6f5415d4c0 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f540aedc0 0x7f6f5414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f540aedc0 0x7f6f5414d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44010/0 (socket says 172.21.15.17:44010) 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52a00640 1 -- 172.21.15.17:0/16180468 learned_addr learned my addr 172.21.15.17:0/16180468 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52000640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5415bc00 0x7f6f5409d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53400640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f5415d4c0 0x7f6f540cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52a00640 1 -- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f5415d4c0 msgr2=0x7f6f540cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52a00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f5415d4c0 0x7f6f540cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52a00640 1 -- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5415bc00 msgr2=0x7f6f5409d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52a00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5415bc00 0x7f6f5409d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52a00640 1 -- 172.21.15.17:0/16180468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f540c5130 con 0x7f6f540aedc0 2024-09-10T23:26:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f52a00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f540aedc0 0x7f6f5414d220 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009850 tx=0x7f6f440a55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f4aa00640 1 -- 172.21.15.17:0/16180468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f440b2040 con 0x7f6f540aedc0 2024-09-10T23:26:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f4aa00640 1 -- 172.21.15.17:0/16180468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f44004470 con 0x7f6f540aedc0 2024-09-10T23:26:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f4aa00640 1 -- 172.21.15.17:0/16180468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44005280 con 0x7f6f540aedc0 2024-09-10T23:26:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f540c5410 con 0x7f6f540aedc0 2024-09-10T23:26:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f540c59d0 con 0x7f6f540aedc0 2024-09-10T23:26:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f540acd20 con 0x7f6f540aedc0 2024-09-10T23:26:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.481+0000 7f6f4aa00640 1 -- 172.21.15.17:0/16180468 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6f44005420 con 0x7f6f540aedc0 2024-09-10T23:26:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.485+0000 7f6f4aa00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f340725e0 0x7f6f34074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.485+0000 7f6f4aa00640 1 -- 172.21.15.17:0/16180468 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f6f4412ce50 con 0x7f6f540aedc0 2024-09-10T23:26:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.485+0000 7f6f52000640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f340725e0 0x7f6f34074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.485+0000 7f6f52000640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f340725e0 0x7f6f34074aa0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6f541fa850 tx=0x7f6f4000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.489+0000 7f6f4aa00640 1 -- 172.21.15.17:0/16180468 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6f44016490 con 0x7f6f540aedc0 2024-09-10T23:26:47.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.697+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f540b5cb0 con 0x7f6f540aedc0 2024-09-10T23:26:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.697+0000 7f6f4aa00640 1 -- 172.21.15.17:0/16180468 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f6f440f8310 con 0x7f6f540aedc0 2024-09-10T23:26:47.702 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:47.702 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:26:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:26:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f340725e0 msgr2=0x7f6f34074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f340725e0 0x7f6f34074aa0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6f541fa850 tx=0x7f6f4000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f540aedc0 msgr2=0x7f6f5414d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f540aedc0 0x7f6f5414d220 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009850 tx=0x7f6f440a55f0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 shutdown_connections 2024-09-10T23:26:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f340725e0 0x7f6f34074aa0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f5415d4c0 0x7f6f540cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f5415bc00 0x7f6f5409d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 --2- 172.21.15.17:0/16180468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f540aedc0 0x7f6f5414d220 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 >> 172.21.15.17:0/16180468 conn(0x7f6f540cfd30 msgr2=0x7f6f540ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 shutdown_connections 2024-09-10T23:26:47.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.701+0000 7f6f53e00640 1 -- 172.21.15.17:0/16180468 wait complete. 2024-09-10T23:26:47.722 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:26:47.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:26:47.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 -- 172.21.15.17:0/3913373336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f415bc70 msgr2=0x7fe4f40cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 --2- 172.21.15.17:0/3913373336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f415bc70 0x7fe4f40cfa20 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40cf530 tx=0x7fe4e801c890 comp rx=0 tx=0).stop 2024-09-10T23:26:47.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 -- 172.21.15.17:0/3913373336 shutdown_connections 2024-09-10T23:26:47.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 --2- 172.21.15.17:0/3913373336 >> v2:172.21.15.77:3300/0 conn(0x7fe4f40d20a0 0x7fe4f40b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 --2- 172.21.15.17:0/3913373336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f415bc70 0x7fe4f40cfa20 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 -- 172.21.15.17:0/3913373336 >> 172.21.15.17:0/3913373336 conn(0x7fe4f409a9f0 msgr2=0x7fe4f409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:47.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 -- 172.21.15.17:0/3913373336 shutdown_connections 2024-09-10T23:26:47.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 -- 172.21.15.17:0/3913373336 wait complete. 2024-09-10T23:26:47.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 Processor -- start 2024-09-10T23:26:47.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 -- start start 2024-09-10T23:26:47.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4f40cc570 0x7fe4f41f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f40d20a0 0x7fe4f4159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f415bc70 0x7fe4f40b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f41688a0 con 0x7fe4f40d20a0 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f4168720 con 0x7fe4f415bc70 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4faa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f4168a20 con 0x7fe4f40cc570 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4f8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f40d20a0 0x7fe4f4159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4f8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f40d20a0 0x7fe4f4159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44038/0 (socket says 172.21.15.17:44038) 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.865+0000 7fe4f8c00640 1 -- 172.21.15.17:0/2423424063 learned_addr learned my addr 172.21.15.17:0/2423424063 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4fa000640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f415bc70 0x7fe4f40b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f9600640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4f40cc570 0x7fe4f41f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f8c00640 1 -- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4f40cc570 msgr2=0x7fe4f41f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f8c00640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4f40cc570 0x7fe4f41f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f8c00640 1 -- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f415bc70 msgr2=0x7fe4f40b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:47.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f8c00640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f415bc70 0x7fe4f40b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f8c00640 1 -- 172.21.15.17:0/2423424063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f415f350 con 0x7fe4f40d20a0 2024-09-10T23:26:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f9600640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4f40cc570 0x7fe4f41f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f8c00640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f40d20a0 0x7fe4f4159100 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000c430 tx=0x7fe4e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f1600640 1 -- 172.21.15.17:0/2423424063 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0017070 con 0x7fe4f40d20a0 2024-09-10T23:26:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f1600640 1 -- 172.21.15.17:0/2423424063 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4e00053c0 con 0x7fe4f40d20a0 2024-09-10T23:26:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f41f9420 con 0x7fe4f40d20a0 2024-09-10T23:26:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f1600640 1 -- 172.21.15.17:0/2423424063 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0003880 con 0x7fe4f40d20a0 2024-09-10T23:26:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f41f8e60 con 0x7fe4f40d20a0 2024-09-10T23:26:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f40b10f0 con 0x7fe4f40d20a0 2024-09-10T23:26:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.869+0000 7fe4f1600640 1 -- 172.21.15.17:0/2423424063 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe4e0003a20 con 0x7fe4f40d20a0 2024-09-10T23:26:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.873+0000 7fe4f1600640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d40725e0 0x7fe4d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.873+0000 7fe4f1600640 1 -- 172.21.15.17:0/2423424063 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fe4e0092ab0 con 0x7fe4f40d20a0 2024-09-10T23:26:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.873+0000 7fe4f9600640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d40725e0 0x7fe4d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:47.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.873+0000 7fe4f9600640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d40725e0 0x7fe4d4074aa0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80af000 tx=0x7fe4e801b0d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:47.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:47.877+0000 7fe4f1600640 1 -- 172.21.15.17:0/2423424063 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe4e0001130 con 0x7fe4f40d20a0 2024-09-10T23:26:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.109+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe4f40b2b50 con 0x7fe4f40d20a0 2024-09-10T23:26:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.109+0000 7fe4f1600640 1 -- 172.21.15.17:0/2423424063 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1231 (secure 0 0 0) 0x7fe4e005dff0 con 0x7fe4f40d20a0 2024-09-10T23:26:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:48.115 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":697,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":155,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":969,"data_bytes":993742886,"bytes_used":2503122944,"bytes_avail":770590990336,"bytes_total":773094113280,"write_bytes_sec":67727036,"read_op_per_sec":0,"write_op_per_sec":68},"fsmap":{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9201}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-10T23:26:12.446418+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d40725e0 msgr2=0x7fe4d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d40725e0 0x7fe4d4074aa0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80af000 tx=0x7fe4e801b0d0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f40d20a0 msgr2=0x7fe4f4159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f40d20a0 0x7fe4f4159100 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000c430 tx=0x7fe4e000c8f0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 shutdown_connections 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d40725e0 0x7fe4d4074aa0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f415bc70 0x7fe4f40b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f40d20a0 0x7fe4f4159100 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 --2- 172.21.15.17:0/2423424063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4f40cc570 0x7fe4f41f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 >> 172.21.15.17:0/2423424063 conn(0x7fe4f409a9f0 msgr2=0x7fe4f40705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 shutdown_connections 2024-09-10T23:26:48.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:48.113+0000 7fe4faa00640 1 -- 172.21.15.17:0/2423424063 wait complete. 2024-09-10T23:26:48.135 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:26:49.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:49.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.289+0000 7fd79a400640 1 -- 172.21.15.17:0/2687944019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7940d1830 msgr2=0x7fd7940ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.289+0000 7fd79a400640 1 --2- 172.21.15.17:0/2687944019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7940d1830 0x7fd7940ccf80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009bf0 tx=0x7fd78c01cbe0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.289+0000 7fd79a400640 1 -- 172.21.15.17:0/2687944019 shutdown_connections 2024-09-10T23:26:49.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.289+0000 7fd79a400640 1 --2- 172.21.15.17:0/2687944019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7940d1830 0x7fd7940ccf80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.289+0000 7fd79a400640 1 -- 172.21.15.17:0/2687944019 >> 172.21.15.17:0/2687944019 conn(0x7fd7940d1d60 msgr2=0x7fd7940d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:49.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.289+0000 7fd79a400640 1 -- 172.21.15.17:0/2687944019 shutdown_connections 2024-09-10T23:26:49.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.289+0000 7fd79a400640 1 -- 172.21.15.17:0/2687944019 wait complete. 2024-09-10T23:26:49.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd79a400640 1 Processor -- start 2024-09-10T23:26:49.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd79a400640 1 -- start start 2024-09-10T23:26:49.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd79a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd794070ad0 0x7fd794159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd79a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7940d1830 0x7fd7940cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd79a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd79415f770 0x7fd79415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd79a400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd79416a5a0 con 0x7fd794070ad0 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd79a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd79416a420 con 0x7fd7940d1830 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd79a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd79416a720 con 0x7fd79415f770 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd794070ad0 0x7fd794159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd794070ad0 0x7fd794159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44040/0 (socket says 172.21.15.17:44040) 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793400640 1 -- 172.21.15.17:0/16099419 learned_addr learned my addr 172.21.15.17:0/16099419 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd78aa00640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7940d1830 0x7fd7940cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793e00640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd79415f770 0x7fd79415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:49.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793400640 1 -- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd79415f770 msgr2=0x7fd79415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793400640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd79415f770 0x7fd79415baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793400640 1 -- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7940d1830 msgr2=0x7fd7940cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793400640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7940d1830 0x7fd7940cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793400640 1 -- 172.21.15.17:0/16099419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7940cbe20 con 0x7fd794070ad0 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd793400640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd794070ad0 0x7fd794159a40 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c530 tx=0x7fd78400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.293+0000 7fd78be00640 1 -- 172.21.15.17:0/16099419 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784016020 con 0x7fd794070ad0 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.297+0000 7fd78be00640 1 -- 172.21.15.17:0/16099419 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd784012940 con 0x7fd794070ad0 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.297+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7941f9250 con 0x7fd794070ad0 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.297+0000 7fd78be00640 1 -- 172.21.15.17:0/16099419 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784012d90 con 0x7fd794070ad0 2024-09-10T23:26:49.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.297+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7941f9810 con 0x7fd794070ad0 2024-09-10T23:26:49.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.297+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7941f9040 con 0x7fd794070ad0 2024-09-10T23:26:49.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.297+0000 7fd78be00640 1 -- 172.21.15.17:0/16099419 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd78401b400 con 0x7fd794070ad0 2024-09-10T23:26:49.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.297+0000 7fd78be00640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd770072610 0x7fd770074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:49.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.297+0000 7fd78be00640 1 -- 172.21.15.17:0/16099419 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fd784093600 con 0x7fd794070ad0 2024-09-10T23:26:49.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.297+0000 7fd78aa00640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd770072610 0x7fd770074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:49.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.301+0000 7fd78aa00640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd770072610 0x7fd770074ad0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c10 tx=0x7fd77c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:49.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.301+0000 7fd78be00640 1 -- 172.21.15.17:0/16099419 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd784020020 con 0x7fd794070ad0 2024-09-10T23:26:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.509+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd79415f060 con 0x7fd794070ad0 2024-09-10T23:26:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.509+0000 7fd78be00640 1 -- 172.21.15.17:0/16099419 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7fd78405e460 con 0x7fd794070ad0 2024-09-10T23:26:49.516 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:49.516 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:26:49.516 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:26:49.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd770072610 msgr2=0x7fd770074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd770072610 0x7fd770074ad0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c10 tx=0x7fd77c009040 comp rx=0 tx=0).stop 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd794070ad0 msgr2=0x7fd794159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd794070ad0 0x7fd794159a40 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c530 tx=0x7fd78400c9f0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 shutdown_connections 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd770072610 0x7fd770074ad0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd79415f770 0x7fd79415baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7940d1830 0x7fd7940cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 --2- 172.21.15.17:0/16099419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd794070ad0 0x7fd794159a40 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 >> 172.21.15.17:0/16099419 conn(0x7fd7940d1d60 msgr2=0x7fd79415d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 shutdown_connections 2024-09-10T23:26:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.513+0000 7fd79a400640 1 -- 172.21.15.17:0/16099419 wait complete. 2024-09-10T23:26:49.536 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:26:49.537 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:26:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 -- 172.21.15.17:0/3960498620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc070ad0 msgr2=0x7fdccc15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 --2- 172.21.15.17:0/3960498620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc070ad0 0x7fdccc15f060 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0cf010 tx=0x7fdcbc01c820 comp rx=0 tx=0).stop 2024-09-10T23:26:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 -- 172.21.15.17:0/3960498620 shutdown_connections 2024-09-10T23:26:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 --2- 172.21.15.17:0/3960498620 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdccc0d1830 0x7fdccc15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 --2- 172.21.15.17:0/3960498620 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc070ad0 0x7fdccc15f060 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 -- 172.21.15.17:0/3960498620 >> 172.21.15.17:0/3960498620 conn(0x7fdccc0d1d60 msgr2=0x7fdccc0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 -- 172.21.15.17:0/3960498620 shutdown_connections 2024-09-10T23:26:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 -- 172.21.15.17:0/3960498620 wait complete. 2024-09-10T23:26:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 Processor -- start 2024-09-10T23:26:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.677+0000 7fdcd0c00640 1 -- start start 2024-09-10T23:26:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcd0c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdccc070ad0 0x7fdccc153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcd0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdccc0cf320 0x7fdccc0b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcd0c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc0d1830 0x7fdccc0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcd0c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc1693d0 con 0x7fdccc0cf320 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcd0c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc169250 con 0x7fdccc0d1830 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcd0c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc169550 con 0x7fdccc070ad0 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdccc0cf320 0x7fdccc0b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdccc0cf320 0x7fdccc0b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44048/0 (socket says 172.21.15.17:44048) 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc3e00640 1 -- 172.21.15.17:0/659006518 learned_addr learned my addr 172.21.15.17:0/659006518 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcca800640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc0d1830 0x7fdccc0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc9e00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdccc070ad0 0x7fdccc153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc3e00640 1 -- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdccc070ad0 msgr2=0x7fdccc153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc3e00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdccc070ad0 0x7fdccc153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc3e00640 1 -- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc0d1830 msgr2=0x7fdccc0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc3e00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc0d1830 0x7fdccc0b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc3e00640 1 -- 172.21.15.17:0/659006518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc0b2680 con 0x7fdccc0cf320 2024-09-10T23:26:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc9e00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdccc070ad0 0x7fdccc153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc3e00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdccc0cf320 0x7fdccc0b2a70 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400e7a0 tx=0x7fdcb400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc2000640 1 -- 172.21.15.17:0/659006518 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400ccc0 con 0x7fdccc0cf320 2024-09-10T23:26:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc2000640 1 -- 172.21.15.17:0/659006518 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcb4010430 con 0x7fdccc0cf320 2024-09-10T23:26:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc0b20c0 con 0x7fdccc0cf320 2024-09-10T23:26:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcc2000640 1 -- 172.21.15.17:0/659006518 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4010860 con 0x7fdccc0cf320 2024-09-10T23:26:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc1545b0 con 0x7fdccc0cf320 2024-09-10T23:26:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.681+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdccc0cfc60 con 0x7fdccc0cf320 2024-09-10T23:26:49.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.685+0000 7fdcc2000640 1 -- 172.21.15.17:0/659006518 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdcb4010a00 con 0x7fdccc0cf320 2024-09-10T23:26:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.685+0000 7fdcc2000640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdca80725e0 0x7fdca8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.685+0000 7fdcc2000640 1 -- 172.21.15.17:0/659006518 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fdcb4093d00 con 0x7fdccc0cf320 2024-09-10T23:26:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.685+0000 7fdcc9e00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdca80725e0 0x7fdca8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.685+0000 7fdcc9e00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdca80725e0 0x7fdca8074aa0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0af000 tx=0x7fdcbc01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:49.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.689+0000 7fdcc2000640 1 -- 172.21.15.17:0/659006518 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdcb405ec90 con 0x7fdccc0cf320 2024-09-10T23:26:49.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.921+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdccc0d0120 con 0x7fdccc0cf320 2024-09-10T23:26:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.921+0000 7fdcc2000640 1 -- 172.21.15.17:0/659006518 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1233 (secure 0 0 0) 0x7fdcb40636c0 con 0x7fdccc0cf320 2024-09-10T23:26:49.927 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:49.927 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":699,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":155,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1003,"data_bytes":1029394470,"bytes_used":2556600320,"bytes_avail":770537512960,"bytes_total":773094113280,"write_bytes_sec":50312910,"read_op_per_sec":0,"write_op_per_sec":50},"fsmap":{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9201}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-10T23:26:12.446418+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:26:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdca80725e0 msgr2=0x7fdca8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdca80725e0 0x7fdca8074aa0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0af000 tx=0x7fdcbc01b060 comp rx=0 tx=0).stop 2024-09-10T23:26:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdccc0cf320 msgr2=0x7fdccc0b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdccc0cf320 0x7fdccc0b2a70 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400e7a0 tx=0x7fdcb400ec60 comp rx=0 tx=0).stop 2024-09-10T23:26:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 shutdown_connections 2024-09-10T23:26:49.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdca80725e0 0x7fdca8074aa0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc0d1830 0x7fdccc0b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdccc0cf320 0x7fdccc0b2a70 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 --2- 172.21.15.17:0/659006518 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdccc070ad0 0x7fdccc153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:49.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 >> 172.21.15.17:0/659006518 conn(0x7fdccc0d1d60 msgr2=0x7fdccc0b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:49.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 shutdown_connections 2024-09-10T23:26:49.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:49.925+0000 7fdcd0c00640 1 -- 172.21.15.17:0/659006518 wait complete. 2024-09-10T23:26:49.948 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:26:50.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:51.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.093+0000 7f986ea00640 1 -- 172.21.15.17:0/1021819513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 msgr2=0x7f9868070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.093+0000 7f986ea00640 1 --2- 172.21.15.17:0/1021819513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 0x7f9868070390 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f98680b40b0 tx=0x7f985001c830 comp rx=0 tx=0).stop 2024-09-10T23:26:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.093+0000 7f986ea00640 1 -- 172.21.15.17:0/1021819513 shutdown_connections 2024-09-10T23:26:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.093+0000 7f986ea00640 1 --2- 172.21.15.17:0/1021819513 >> v2:172.21.15.77:3300/0 conn(0x7f98680cffc0 0x7f98680d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.093+0000 7f986ea00640 1 --2- 172.21.15.17:0/1021819513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 0x7f9868070390 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.093+0000 7f986ea00640 1 -- 172.21.15.17:0/1021819513 >> 172.21.15.17:0/1021819513 conn(0x7f986806cfc0 msgr2=0x7f986806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.093+0000 7f986ea00640 1 -- 172.21.15.17:0/1021819513 shutdown_connections 2024-09-10T23:26:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.093+0000 7f986ea00640 1 -- 172.21.15.17:0/1021819513 wait complete. 2024-09-10T23:26:51.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ea00640 1 Processor -- start 2024-09-10T23:26:51.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ea00640 1 -- start start 2024-09-10T23:26:51.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98680cffc0 0x7f9868147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f986815fd90 0x7f98680741c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 0x7f98681fa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9868168a80 con 0x7f9868160170 2024-09-10T23:26:51.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ea00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98680b3650 con 0x7f986815fd90 2024-09-10T23:26:51.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ea00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9868168c00 con 0x7f98680cffc0 2024-09-10T23:26:51.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 0x7f98681fa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 0x7f98681fa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44074/0 (socket says 172.21.15.17:44074) 2024-09-10T23:26:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ca00640 1 -- 172.21.15.17:0/4033521274 learned_addr learned my addr 172.21.15.17:0/4033521274 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f9867e00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98680cffc0 0x7f9868147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f985f400640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f986815fd90 0x7f98680741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ca00640 1 -- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98680cffc0 msgr2=0x7f9868147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ca00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98680cffc0 0x7f9868147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ca00640 1 -- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f986815fd90 msgr2=0x7f98680741c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ca00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f986815fd90 0x7f98680741c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.097+0000 7f986ca00640 1 -- 172.21.15.17:0/4033521274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9868074700 con 0x7f9868160170 2024-09-10T23:26:51.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f986ca00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 0x7f98681fa350 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f986000ea20 tx=0x7f986000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:51.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f9864c00640 1 -- 172.21.15.17:0/4033521274 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986000cde0 con 0x7f9868160170 2024-09-10T23:26:51.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f9864c00640 1 -- 172.21.15.17:0/4033521274 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9860004c40 con 0x7f9868160170 2024-09-10T23:26:51.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f9864c00640 1 -- 172.21.15.17:0/4033521274 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860005280 con 0x7f9868160170 2024-09-10T23:26:51.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98681fb0d0 con 0x7f9868160170 2024-09-10T23:26:51.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98680b1f40 con 0x7f9868160170 2024-09-10T23:26:51.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98680d03f0 con 0x7f9868160170 2024-09-10T23:26:51.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f9864c00640 1 -- 172.21.15.17:0/4033521274 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f986000f040 con 0x7f9868160170 2024-09-10T23:26:51.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f9864c00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98440725e0 0x7f9844074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.101+0000 7f9864c00640 1 -- 172.21.15.17:0/4033521274 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f9860093a40 con 0x7f9868160170 2024-09-10T23:26:51.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.105+0000 7f9867e00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98440725e0 0x7f9844074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.105+0000 7f9867e00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98440725e0 0x7f9844074aa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9858007fd0 tx=0x7f9858009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:51.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.109+0000 7f9864c00640 1 -- 172.21.15.17:0/4033521274 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9860016030 con 0x7f9868160170 2024-09-10T23:26:51.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.313+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98680b25a0 con 0x7f9868160170 2024-09-10T23:26:51.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f9864c00640 1 -- 172.21.15.17:0/4033521274 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f986005e930 con 0x7f9868160170 2024-09-10T23:26:51.320 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:51.320 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:26:51.320 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98440725e0 msgr2=0x7f9844074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98440725e0 0x7f9844074aa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9858007fd0 tx=0x7f9858009040 comp rx=0 tx=0).stop 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 msgr2=0x7f98681fa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 0x7f98681fa350 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f986000ea20 tx=0x7f986000eee0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 shutdown_connections 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f98440725e0 0x7f9844074aa0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9868160170 0x7f98681fa350 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f986815fd90 0x7f98680741c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 --2- 172.21.15.17:0/4033521274 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98680cffc0 0x7f9868147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 >> 172.21.15.17:0/4033521274 conn(0x7f986806cfc0 msgr2=0x7f98681492d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 shutdown_connections 2024-09-10T23:26:51.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.317+0000 7f986ea00640 1 -- 172.21.15.17:0/4033521274 wait complete. 2024-09-10T23:26:51.341 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:26:51.341 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:26:51.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 -- 172.21.15.17:0/2519591447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a8004010 msgr2=0x7fd5a8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 --2- 172.21.15.17:0/2519591447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a8004010 0x7fd5a8004810 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00016f0 tx=0x7fd5b001c7b0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c3400640 1 -- 172.21.15.17:0/2519591447 reap_dead start 2024-09-10T23:26:51.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 -- 172.21.15.17:0/2519591447 shutdown_connections 2024-09-10T23:26:51.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 -- 172.21.15.17:0/2519591447 >> 172.21.15.17:0/2519591447 conn(0x7fd5c40d03d0 msgr2=0x7fd5c40d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:51.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 -- 172.21.15.17:0/2519591447 shutdown_connections 2024-09-10T23:26:51.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 -- 172.21.15.17:0/2519591447 wait complete. 2024-09-10T23:26:51.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 Processor -- start 2024-09-10T23:26:51.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 -- start start 2024-09-10T23:26:51.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a8004010 0x7fd5c4154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5c41f7a90 0x7fd5c41f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c4145d10 0x7fd5c41461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4070560 con 0x7fd5a8004010 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4160340 con 0x7fd5c4145d10 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c9e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c40706e0 con 0x7fd5c41f7a90 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a8004010 0x7fd5c4154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a8004010 0x7fd5c4154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44094/0 (socket says 172.21.15.17:44094) 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c2a00640 1 -- 172.21.15.17:0/140536509 learned_addr learned my addr 172.21.15.17:0/140536509 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c2000640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5c41f7a90 0x7fd5c41f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.485+0000 7fd5c3400640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c4145d10 0x7fd5c41461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5c2a00640 1 -- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5c41f7a90 msgr2=0x7fd5c41f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5c2a00640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5c41f7a90 0x7fd5c41f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5c2a00640 1 -- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c4145d10 msgr2=0x7fd5c41461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5c2a00640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c4145d10 0x7fd5c41461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5c2a00640 1 -- 172.21.15.17:0/140536509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c41466e0 con 0x7fd5a8004010 2024-09-10T23:26:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5c2a00640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a8004010 0x7fd5c4154460 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4001060 tx=0x7fd5b4012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5bb400640 1 -- 172.21.15.17:0/140536509 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4010ae0 con 0x7fd5a8004010 2024-09-10T23:26:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5bb400640 1 -- 172.21.15.17:0/140536509 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5b4010c80 con 0x7fd5a8004010 2024-09-10T23:26:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c4154d60 con 0x7fd5a8004010 2024-09-10T23:26:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5bb400640 1 -- 172.21.15.17:0/140536509 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40136b0 con 0x7fd5a8004010 2024-09-10T23:26:51.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c4155320 con 0x7fd5a8004010 2024-09-10T23:26:51.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c40b4120 con 0x7fd5a8004010 2024-09-10T23:26:51.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.489+0000 7fd5bb400640 1 -- 172.21.15.17:0/140536509 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd5b4027440 con 0x7fd5a8004010 2024-09-10T23:26:51.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.493+0000 7fd5bb400640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5a4072610 0x7fd5a4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:51.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.493+0000 7fd5bb400640 1 -- 172.21.15.17:0/140536509 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fd5b4097510 con 0x7fd5a8004010 2024-09-10T23:26:51.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.493+0000 7fd5c2000640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5a4072610 0x7fd5a4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.493+0000 7fd5c2000640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5a4072610 0x7fd5a4074ad0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0006040 tx=0x7fd5b00b1040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:51.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.493+0000 7fd5bb400640 1 -- 172.21.15.17:0/140536509 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd5b40623f0 con 0x7fd5a8004010 2024-09-10T23:26:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.733+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd5c4152460 con 0x7fd5a8004010 2024-09-10T23:26:51.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.733+0000 7fd5bb400640 1 -- 172.21.15.17:0/140536509 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1233 (secure 0 0 0) 0x7fd5b4066e20 con 0x7fd5a8004010 2024-09-10T23:26:51.739 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:51.740 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":700,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":155,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1047,"data_bytes":1076943348,"bytes_used":2684207104,"bytes_avail":770409906176,"bytes_total":773094113280,"write_bytes_sec":49559385,"read_op_per_sec":0,"write_op_per_sec":56},"fsmap":{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9201}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-10T23:26:12.446418+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5a4072610 msgr2=0x7fd5a4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5a4072610 0x7fd5a4074ad0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0006040 tx=0x7fd5b00b1040 comp rx=0 tx=0).stop 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a8004010 msgr2=0x7fd5c4154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a8004010 0x7fd5c4154460 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4001060 tx=0x7fd5b4012b20 comp rx=0 tx=0).stop 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 shutdown_connections 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5a4072610 0x7fd5a4074ad0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5c4145d10 0x7fd5c41461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5c41f7a90 0x7fd5c41f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 --2- 172.21.15.17:0/140536509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a8004010 0x7fd5c4154460 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:51.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 >> 172.21.15.17:0/140536509 conn(0x7fd5c40d03d0 msgr2=0x7fd5c415f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:51.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 shutdown_connections 2024-09-10T23:26:51.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:51.737+0000 7fd5c9e00640 1 -- 172.21.15.17:0/140536509 wait complete. 2024-09-10T23:26:51.760 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:26:52.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:52.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 -- 172.21.15.17:0/3018795387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 msgr2=0x7f4a2c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:52.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 --2- 172.21.15.17:0/3018795387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 0x7f4a2c15f060 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0b7de0 tx=0x7f4a2001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:52.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 -- 172.21.15.17:0/3018795387 shutdown_connections 2024-09-10T23:26:52.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 --2- 172.21.15.17:0/3018795387 >> v2:172.21.15.77:3300/0 conn(0x7f4a2c0cf320 0x7f4a2c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:52.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 --2- 172.21.15.17:0/3018795387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 0x7f4a2c15f060 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:52.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 -- 172.21.15.17:0/3018795387 >> 172.21.15.17:0/3018795387 conn(0x7f4a2c0d1d60 msgr2=0x7f4a2c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:52.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 -- 172.21.15.17:0/3018795387 shutdown_connections 2024-09-10T23:26:52.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 -- 172.21.15.17:0/3018795387 wait complete. 2024-09-10T23:26:52.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 Processor -- start 2024-09-10T23:26:52.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 -- start start 2024-09-10T23:26:52.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 0x7f4a2c1f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2c0cf320 0x7f4a2c0c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2c0d1830 0x7f4a2c1f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c169320 con 0x7f4a2c070ad0 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c1691a0 con 0x7f4a2c0cf320 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a34800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2c1694a0 con 0x7f4a2c0d1830 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a31e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 0x7f4a2c1f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a31e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 0x7f4a2c1f9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44104/0 (socket says 172.21.15.17:44104) 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.913+0000 7f4a31e00640 1 -- 172.21.15.17:0/1402482280 learned_addr learned my addr 172.21.15.17:0/1402482280 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a32800640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2c0d1830 0x7f4a2c1f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a31400640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2c0cf320 0x7f4a2c0c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a31e00640 1 -- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2c0d1830 msgr2=0x7f4a2c1f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:52.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a31e00640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2c0d1830 0x7f4a2c1f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a31e00640 1 -- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2c0cf320 msgr2=0x7f4a2c0c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a31e00640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2c0cf320 0x7f4a2c0c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a31e00640 1 -- 172.21.15.17:0/1402482280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c1f6d70 con 0x7f4a2c070ad0 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a31400640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2c0cf320 0x7f4a2c0c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a31e00640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 0x7f4a2c1f9390 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f4a200b0040 tx=0x7f4a200a56a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a26000640 1 -- 172.21.15.17:0/1402482280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a200b2040 con 0x7f4a2c070ad0 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a26000640 1 -- 172.21.15.17:0/1402482280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a200043e0 con 0x7f4a2c070ad0 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a26000640 1 -- 172.21.15.17:0/1402482280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20005280 con 0x7f4a2c070ad0 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2c14d5b0 con 0x7f4a2c070ad0 2024-09-10T23:26:52.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2c1f9ca0 con 0x7f4a2c070ad0 2024-09-10T23:26:52.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2c15f060 con 0x7f4a2c070ad0 2024-09-10T23:26:52.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a26000640 1 -- 172.21.15.17:0/1402482280 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4a20005420 con 0x7f4a2c070ad0 2024-09-10T23:26:52.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.917+0000 7f4a26000640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a100725e0 0x7f4a10074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:52.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.921+0000 7f4a26000640 1 -- 172.21.15.17:0/1402482280 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f4a2012cff0 con 0x7f4a2c070ad0 2024-09-10T23:26:52.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.921+0000 7f4a31400640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a100725e0 0x7f4a10074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:52.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.921+0000 7f4a31400640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a100725e0 0x7f4a10074aa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0b0c40 tx=0x7f4a1c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:52.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:52.925+0000 7f4a26000640 1 -- 172.21.15.17:0/1402482280 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4a200164b0 con 0x7f4a2c070ad0 2024-09-10T23:26:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.133+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a2c0cc190 con 0x7f4a2c070ad0 2024-09-10T23:26:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.133+0000 7f4a26000640 1 -- 172.21.15.17:0/1402482280 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f4a200f8550 con 0x7f4a2c070ad0 2024-09-10T23:26:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:53.138 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:26:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:26:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a100725e0 msgr2=0x7f4a10074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a100725e0 0x7f4a10074aa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0b0c40 tx=0x7f4a1c008040 comp rx=0 tx=0).stop 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 msgr2=0x7f4a2c1f9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 0x7f4a2c1f9390 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f4a200b0040 tx=0x7f4a200a56a0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 shutdown_connections 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a100725e0 0x7f4a10074aa0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a2c0d1830 0x7f4a2c1f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2c0cf320 0x7f4a2c0c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 --2- 172.21.15.17:0/1402482280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a2c070ad0 0x7f4a2c1f9390 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 >> 172.21.15.17:0/1402482280 conn(0x7f4a2c0d1d60 msgr2=0x7f4a2c158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 shutdown_connections 2024-09-10T23:26:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.137+0000 7f4a34800640 1 -- 172.21.15.17:0/1402482280 wait complete. 2024-09-10T23:26:53.161 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:26:53.161 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:26:53.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.301+0000 7fa497c00640 1 -- 172.21.15.17:0/341243760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa490070ad0 msgr2=0x7fa49015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.301+0000 7fa497c00640 1 --2- 172.21.15.17:0/341243760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa490070ad0 0x7fa49015f060 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fa4900b7e10 tx=0x7fa48401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.301+0000 7fa497c00640 1 -- 172.21.15.17:0/341243760 shutdown_connections 2024-09-10T23:26:53.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.301+0000 7fa497c00640 1 --2- 172.21.15.17:0/341243760 >> v2:172.21.15.77:3300/0 conn(0x7fa4900cf320 0x7fa4900cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.301+0000 7fa497c00640 1 --2- 172.21.15.17:0/341243760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4900d1830 0x7fa49015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.301+0000 7fa497c00640 1 --2- 172.21.15.17:0/341243760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa490070ad0 0x7fa49015f060 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.301+0000 7fa497c00640 1 -- 172.21.15.17:0/341243760 >> 172.21.15.17:0/341243760 conn(0x7fa4900d1d60 msgr2=0x7fa4900d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.301+0000 7fa497c00640 1 -- 172.21.15.17:0/341243760 shutdown_connections 2024-09-10T23:26:53.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.301+0000 7fa497c00640 1 -- 172.21.15.17:0/341243760 wait complete. 2024-09-10T23:26:53.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 Processor -- start 2024-09-10T23:26:53.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 -- start start 2024-09-10T23:26:53.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa490070ad0 0x7fa49014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4900cf320 0x7fa4901f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4900d1830 0x7fa4901f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa4900cd270 con 0x7fa4900cf320 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa4900cd0f0 con 0x7fa490070ad0 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa4900cd3f0 con 0x7fa4900d1830 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4900cf320 0x7fa4901f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4900cf320 0x7fa4901f8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44132/0 (socket says 172.21.15.17:44132) 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48fe00640 1 -- 172.21.15.17:0/3577259734 learned_addr learned my addr 172.21.15.17:0/3577259734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa495200640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa490070ad0 0x7fa49014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa495c00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4900d1830 0x7fa4901f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48fe00640 1 -- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4900d1830 msgr2=0x7fa4901f8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48fe00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4900d1830 0x7fa4901f8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48fe00640 1 -- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa490070ad0 msgr2=0x7fa49014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48fe00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa490070ad0 0x7fa49014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48fe00640 1 -- 172.21.15.17:0/3577259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa490164700 con 0x7fa4900cf320 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa495c00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4900d1830 0x7fa4901f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48fe00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4900cf320 0x7fa4901f8220 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00d720 tx=0x7fa47c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48cc00640 1 -- 172.21.15.17:0/3577259734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c017070 con 0x7fa4900cf320 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48cc00640 1 -- 172.21.15.17:0/3577259734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa47c009d20 con 0x7fa4900cf320 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa48cc00640 1 -- 172.21.15.17:0/3577259734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c005280 con 0x7fa4900cf320 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4901649e0 con 0x7fa4900cf320 2024-09-10T23:26:53.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.305+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa490166750 con 0x7fa4900cf320 2024-09-10T23:26:53.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.309+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4900cfc60 con 0x7fa4900cf320 2024-09-10T23:26:53.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.309+0000 7fa48cc00640 1 -- 172.21.15.17:0/3577259734 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa47c005420 con 0x7fa4900cf320 2024-09-10T23:26:53.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.309+0000 7fa48cc00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4700725e0 0x7fa470074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.309+0000 7fa48cc00640 1 -- 172.21.15.17:0/3577259734 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fa47c093450 con 0x7fa4900cf320 2024-09-10T23:26:53.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.309+0000 7fa495200640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4700725e0 0x7fa470074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.313+0000 7fa495200640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4700725e0 0x7fa470074aa0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa4840af000 tx=0x7fa48401b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.313+0000 7fa48cc00640 1 -- 172.21.15.17:0/3577259734 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa47c05e350 con 0x7fa4900cf320 2024-09-10T23:26:53.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.553+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa490159da0 con 0x7fa4900cf320 2024-09-10T23:26:53.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.553+0000 7fa48cc00640 1 -- 172.21.15.17:0/3577259734 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7fa47c062d80 con 0x7fa4900cf320 2024-09-10T23:26:53.558 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:53.558 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":702,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":155,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077991924,"bytes_used":2688401408,"bytes_avail":770405711872,"bytes_total":773094113280,"write_bytes_sec":33934822,"read_op_per_sec":0,"write_op_per_sec":40},"fsmap":{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9201}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-09-10T23:26:52.456006+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:26:53.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4700725e0 msgr2=0x7fa470074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4700725e0 0x7fa470074aa0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa4840af000 tx=0x7fa48401b100 comp rx=0 tx=0).stop 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4900cf320 msgr2=0x7fa4901f8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4900cf320 0x7fa4901f8220 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00d720 tx=0x7fa47c00dbe0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 shutdown_connections 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4700725e0 0x7fa470074aa0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4900d1830 0x7fa4901f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4900cf320 0x7fa4901f8220 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 --2- 172.21.15.17:0/3577259734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa490070ad0 0x7fa49014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 >> 172.21.15.17:0/3577259734 conn(0x7fa4900d1d60 msgr2=0x7fa49014f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 shutdown_connections 2024-09-10T23:26:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.557+0000 7fa497c00640 1 -- 172.21.15.17:0/3577259734 wait complete. 2024-09-10T23:26:53.579 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-10T23:26:53.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:53.579 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-09-10T23:26:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 -- 172.21.15.17:0/754541010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf00d04f0 msgr2=0x7f2cf015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 --2- 172.21.15.17:0/754541010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf00d04f0 0x7f2cf015c680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009c80 tx=0x7f2ce801cd10 comp rx=0 tx=0).stop 2024-09-10T23:26:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 -- 172.21.15.17:0/754541010 shutdown_connections 2024-09-10T23:26:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 --2- 172.21.15.17:0/754541010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf00d04f0 0x7f2cf015c680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 --2- 172.21.15.17:0/754541010 >> v2:172.21.15.77:3300/0 conn(0x7f2cf015be00 0x7f2cf015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 -- 172.21.15.17:0/754541010 >> 172.21.15.17:0/754541010 conn(0x7f2cf009a9f0 msgr2=0x7f2cf009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 -- 172.21.15.17:0/754541010 shutdown_connections 2024-09-10T23:26:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 -- 172.21.15.17:0/754541010 wait complete. 2024-09-10T23:26:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 Processor -- start 2024-09-10T23:26:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 -- start start 2024-09-10T23:26:53.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cf00b12e0 0x7f2cf00b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf00d04f0 0x7f2cf0150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf015be00 0x7f2cf00aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0168f50 con 0x7f2cf00b12e0 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0168dd0 con 0x7f2cf00d04f0 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf7600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf01690d0 con 0x7f2cf015be00 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cf00b12e0 0x7f2cf00b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cf00b12e0 0x7f2cf00b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44144/0 (socket says 172.21.15.17:44144) 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf4c00640 1 -- 172.21.15.17:0/841687494 learned_addr learned my addr 172.21.15.17:0/841687494 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf5600640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf015be00 0x7f2cf00aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf00d04f0 0x7f2cf0150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf4c00640 1 -- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf015be00 msgr2=0x7f2cf00aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf015be00 0x7f2cf00aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf4c00640 1 -- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf00d04f0 msgr2=0x7f2cf0150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf00d04f0 0x7f2cf0150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf4c00640 1 -- 172.21.15.17:0/841687494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf0159320 con 0x7f2cf00b12e0 2024-09-10T23:26:53.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.725+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cf00b12e0 0x7f2cf00b0830 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000e9a0 tx=0x7f2ce000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2ced600640 1 -- 172.21.15.17:0/841687494 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000cd80 con 0x7f2cf00b12e0 2024-09-10T23:26:53.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2ced600640 1 -- 172.21.15.17:0/841687494 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ce0004020 con 0x7f2cf00b12e0 2024-09-10T23:26:53.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2ced600640 1 -- 172.21.15.17:0/841687494 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0004450 con 0x7f2cf00b12e0 2024-09-10T23:26:53.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2cf7600640 1 -- 172.21.15.17:0/841687494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf0159600 con 0x7f2cf00b12e0 2024-09-10T23:26:53.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2cf7600640 1 -- 172.21.15.17:0/841687494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf0151060 con 0x7f2cf00b12e0 2024-09-10T23:26:53.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2ced600640 1 -- 172.21.15.17:0/841687494 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2ce0003600 con 0x7f2cf00b12e0 2024-09-10T23:26:53.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2ced600640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ccc0725e0 0x7f2ccc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2ced600640 1 -- 172.21.15.17:0/841687494 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f2ce0093c40 con 0x7f2cf00b12e0 2024-09-10T23:26:53.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2cfaac1000 1 Processor -- start 2024-09-10T23:26:53.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2cfaac1000 1 -- start start 2024-09-10T23:26:53.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.729+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ccc0725e0 0x7f2ccc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006709e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ccc0725e0 0x7f2ccc074aa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00d1f40 tx=0x7f2cd8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x55800670a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580066c0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580064be2c0 con 0x5580065a81d0 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55800651bb90 con 0x55800670a3d0 2024-09-10T23:26:53.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55800650afc0 con 0x5580066c05a0 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cf4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006709e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cf4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006709e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44156/0 (socket says 172.21.15.17:44156) 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cf4c00640 1 -- 172.21.15.17:0/2933311662 learned_addr learned my addr 172.21.15.17:0/2933311662 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/2933311662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x55800670a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cf4c00640 1 -- 172.21.15.17:0/2933311662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 msgr2=0x5580066c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/2933311662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580066c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cf4c00640 1 -- 172.21.15.17:0/2933311662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 msgr2=0x55800670a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/2933311662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x55800670a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cf4c00640 1 -- 172.21.15.17:0/2933311662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580064a91a0 con 0x5580065a81d0 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/2933311662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x55800670a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/2933311662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006709e90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f2ce005eac0 tx=0x7f2ce005e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcc847e64eece20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2ce5600640 1 -- 172.21.15.17:0/2933311662 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce008c020 con 0x5580065a81d0 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2ce5600640 1 -- 172.21.15.17:0/2933311662 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ce005eb30 con 0x5580065a81d0 2024-09-10T23:26:53.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2ce5600640 1 -- 172.21.15.17:0/2933311662 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0083030 con 0x5580065a81d0 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2933311662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 msgr2=0x558006709e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/2933311662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006709e90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f2ce005eac0 tx=0x7f2ce005e540 comp rx=0 tx=0).stop 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2933311662 shutdown_connections 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/2933311662 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580066c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/2933311662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x55800670a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/2933311662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006709e90 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2933311662 >> 172.21.15.17:0/2933311662 conn(0x5580061c9880 msgr2=0x5580066bee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2933311662 shutdown_connections 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2933311662 wait complete. 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 -- start start 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.733+0000 7f2cfaac1000 1 Processor -- start 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006710a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x558006710f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x5580067114a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580064b04d0 con 0x5580065a81d0 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55800650edd0 con 0x55800670a3d0 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5580061d0620 con 0x5580066c05a0 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 10 client.0 _ll_register_callbacks cb 0x5580064e1cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006710a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006710a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44172/0 (socket says 172.21.15.17:44172) 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf4c00640 1 -- 172.21.15.17:0/4097195182 learned_addr learned my addr 172.21.15.17:0/4097195182 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x558006710f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf5600640 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x5580067114a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf4c00640 1 -- 172.21.15.17:0/4097195182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 msgr2=0x558006710f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x558006710f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf4c00640 1 -- 172.21.15.17:0/4097195182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 msgr2=0x5580067114a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x5580067114a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf4c00640 1 -- 172.21.15.17:0/4097195182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580065da720 con 0x5580065a81d0 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006710a20 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0062010 tx=0x7f2ce0063400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc96821e0844155 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cde000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cde000640 1 -- 172.21.15.17:0/4097195182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce008c050 con 0x5580065a81d0 2024-09-10T23:26:53.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cde000640 1 -- 172.21.15.17:0/4097195182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f2ce005dd90 con 0x5580065a81d0 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 -- 172.21.15.17:0/4097195182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5580064a32e0 con 0x5580065a81d0 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cde000640 1 -- 172.21.15.17:0/4097195182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f2ce0063560 con 0x5580065a81d0 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 10 client.9447 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 -- 172.21.15.17:0/4097195182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x558006590420 con 0x5580065a81d0 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cde000640 1 -- 172.21.15.17:0/4097195182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5580064a32e0 con 0x5580065a81d0 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cde000640 1 -- 172.21.15.17:0/4097195182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f2ce005a480 con 0x5580065a81d0 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 10 client.9447 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 10 client.9447 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 20 client.9447 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x558006718df0 0x55800671b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 4 client.9447 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:53.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 -- 172.21.15.17:0/4097195182 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55800651dae0 con 0x558006718df0 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x558006718df0 0x55800671b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cde000640 10 client.9447 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:53.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x558006718df0 0x55800671b1e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6575eb52abbad51 server_cookie=3660582904f731ed in_seq=0 out_seq=0 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cde000640 1 -- 172.21.15.17:0/4097195182 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55800651dae0 con 0x558006718df0 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cde000640 10 client.9447 handle_command_reply: tid=0 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.737+0000 7f2cfaac1000 1 client.9447 shutdown 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 -- 172.21.15.17:0/4097195182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 msgr2=0x558006710a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006710a20 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0062010 tx=0x7f2ce0063400 comp rx=0 tx=0).stop 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 -- 172.21.15.17:0/4097195182 shutdown_connections 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x558006718df0 0x55800671b1e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x5580067114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x558006710f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/4097195182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006710a20 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cde000640 0 client.9447 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 -- 172.21.15.17:0/4097195182 >> 172.21.15.17:0/4097195182 conn(0x5580061c9880 msgr2=0x5580066bf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 -- 172.21.15.17:0/4097195182 shutdown_connections 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 1 -- 172.21.15.17:0/4097195182 wait complete. 2024-09-10T23:26:53.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.741+0000 7f2cfaac1000 20 client.9447 trim_cache size 0 max 16384 2024-09-10T23:26:53.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cfaac1000 1 Processor -- start 2024-09-10T23:26:53.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cfaac1000 1 -- start start 2024-09-10T23:26:53.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580065a81d0 0x5580066be660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580066beba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55800670a3d0 0x5580066bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0204820 con 0x55800670a3d0 2024-09-10T23:26:53.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0203880 con 0x5580065a81d0 2024-09-10T23:26:53.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf0155f50 con 0x5580066c05a0 2024-09-10T23:26:53.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cf5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55800670a3d0 0x5580066bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cf5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55800670a3d0 0x5580066bf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44178/0 (socket says 172.21.15.17:44178) 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cf5600640 1 -- 172.21.15.17:0/2408447862 learned_addr learned my addr 172.21.15.17:0/2408447862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/2408447862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580065a81d0 0x5580066be660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/2408447862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580066beba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cf5600640 1 -- 172.21.15.17:0/2408447862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 msgr2=0x5580066beba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cf5600640 1 --2- 172.21.15.17:0/2408447862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580066beba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cf5600640 1 -- 172.21.15.17:0/2408447862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580065a81d0 msgr2=0x5580066be660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cf5600640 1 --2- 172.21.15.17:0/2408447862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580065a81d0 0x5580066be660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.757+0000 7f2cf5600640 1 -- 172.21.15.17:0/2408447862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558006567ae0 con 0x55800670a3d0 2024-09-10T23:26:53.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf5600640 1 --2- 172.21.15.17:0/2408447862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55800670a3d0 0x5580066bf0e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f2ce801a9a0 tx=0x7f2ce8009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2229fc0d5c1f2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2ce4c00640 1 -- 172.21.15.17:0/2408447862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80bc020 con 0x55800670a3d0 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2ce4c00640 1 -- 172.21.15.17:0/2408447862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ce8004a50 con 0x55800670a3d0 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2ce4c00640 1 -- 172.21.15.17:0/2408447862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80b2040 con 0x55800670a3d0 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2408447862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55800670a3d0 msgr2=0x5580066bf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/2408447862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55800670a3d0 0x5580066bf0e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f2ce801a9a0 tx=0x7f2ce8009350 comp rx=0 tx=0).stop 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2408447862 shutdown_connections 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/2408447862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55800670a3d0 0x5580066bf0e0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/2408447862 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580066beba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/2408447862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580065a81d0 0x5580066be660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2408447862 >> 172.21.15.17:0/2408447862 conn(0x5580061c9880 msgr2=0x5580066c5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2408447862 shutdown_connections 2024-09-10T23:26:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 -- 172.21.15.17:0/2408447862 wait complete. 2024-09-10T23:26:53.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 -- start start 2024-09-10T23:26:53.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 Processor -- start 2024-09-10T23:26:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006780160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580067806a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x558006780be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55800650afc0 con 0x5580065a81d0 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55800651bb90 con 0x55800670a3d0 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5580064be2c0 con 0x5580066c05a0 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cfaac1000 10 client.0 _ll_register_callbacks cb 0x7f2ce005e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006780160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006780160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44194/0 (socket says 172.21.15.17:44194) 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf4c00640 1 -- 172.21.15.17:0/3150813070 learned_addr learned my addr 172.21.15.17:0/3150813070 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580067806a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf5600640 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x558006780be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf4c00640 1 -- 172.21.15.17:0/3150813070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 msgr2=0x5580067806a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580067806a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf4c00640 1 -- 172.21.15.17:0/3150813070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 msgr2=0x558006780be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x558006780be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf4c00640 1 -- 172.21.15.17:0/3150813070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580064d5040 con 0x5580065a81d0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cf4c00640 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006780160 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f2ce005bda0 tx=0x7f2ce0063360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9350872b4a74b7ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cde000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.761+0000 7f2cde000640 1 -- 172.21.15.17:0/3150813070 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce008c030 con 0x5580065a81d0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cde000640 1 -- 172.21.15.17:0/3150813070 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f2ce0075db0 con 0x5580065a81d0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 -- 172.21.15.17:0/3150813070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce8004a50 con 0x5580065a81d0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cde000640 1 -- 172.21.15.17:0/3150813070 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f2ce0083070 con 0x5580065a81d0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 10 client.9453 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 -- 172.21.15.17:0/3150813070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x5580064a1620 con 0x5580065a81d0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cde000640 1 -- 172.21.15.17:0/3150813070 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ce8004a50 con 0x5580065a81d0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cde000640 1 -- 172.21.15.17:0/3150813070 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f2ce005d800 con 0x5580065a81d0 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 10 client.9453 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 10 client.9453 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 20 client.9453 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x558006716150 0x558006716560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 4 client.9453 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 -- 172.21.15.17:0/3150813070 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x558006519590 con 0x558006716150 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x558006716150 0x558006716560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2ce7e00640 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x558006716150 0x558006716560 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e83a69da0510e75c server_cookie=82033ce13d190cf1 in_seq=0 out_seq=0 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cde000640 10 client.9453 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cde000640 1 -- 172.21.15.17:0/3150813070 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558006519590 con 0x558006716150 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cde000640 10 client.9453 handle_command_reply: tid=0 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 client.9453 shutdown 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 -- 172.21.15.17:0/3150813070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 msgr2=0x558006780160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006780160 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f2ce005bda0 tx=0x7f2ce0063360 comp rx=0 tx=0).stop 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 -- 172.21.15.17:0/3150813070 shutdown_connections 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x558006716150 0x558006716560 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55800670a3d0 0x558006780be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580066c05a0 0x5580067806a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cde000640 0 client.9453 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 --2- 172.21.15.17:0/3150813070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580065a81d0 0x558006780160 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 -- 172.21.15.17:0/3150813070 >> 172.21.15.17:0/3150813070 conn(0x5580061c9880 msgr2=0x5580066c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 -- 172.21.15.17:0/3150813070 shutdown_connections 2024-09-10T23:26:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 1 -- 172.21.15.17:0/3150813070 wait complete. 2024-09-10T23:26:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cfaac1000 20 client.9453 trim_cache size 0 max 16384 2024-09-10T23:26:53.774 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:53.774 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:26:53.775 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:26:53.775 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 -- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ccc0725e0 msgr2=0x7f2ccc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ccc0725e0 0x7f2ccc074aa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00d1f40 tx=0x7f2cd8009040 comp rx=0 tx=0).stop 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 -- 172.21.15.17:0/841687494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cf00b12e0 msgr2=0x7f2cf00b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cf00b12e0 0x7f2cf00b0830 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000e9a0 tx=0x7f2ce000ee60 comp rx=0 tx=0).stop 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 -- 172.21.15.17:0/841687494 shutdown_connections 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ccc0725e0 0x7f2ccc074aa0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf015be00 0x7f2cf00aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf00d04f0 0x7f2cf0150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 --2- 172.21.15.17:0/841687494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cf00b12e0 0x7f2cf00b0830 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 -- 172.21.15.17:0/841687494 >> 172.21.15.17:0/841687494 conn(0x7f2cf009a9f0 msgr2=0x7f2cf00b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 -- 172.21.15.17:0/841687494 shutdown_connections 2024-09-10T23:26:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.765+0000 7f2cf7600640 1 -- 172.21.15.17:0/841687494 wait complete. 2024-09-10T23:26:53.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:53.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-10T23:26:53.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 -- 172.21.15.17:0/1818717033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab40b31b0 msgr2=0x7fbab40d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 --2- 172.21.15.17:0/1818717033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab40b31b0 0x7fbab40d01e0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fbab4073a70 tx=0x7fbaa001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 -- 172.21.15.17:0/1818717033 shutdown_connections 2024-09-10T23:26:53.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 --2- 172.21.15.17:0/1818717033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab40b31b0 0x7fbab40d01e0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 --2- 172.21.15.17:0/1818717033 >> v2:172.21.15.77:3300/0 conn(0x7fbab415f400 0x7fbab40cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 -- 172.21.15.17:0/1818717033 >> 172.21.15.17:0/1818717033 conn(0x7fbab40d1da0 msgr2=0x7fbab40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 -- 172.21.15.17:0/1818717033 shutdown_connections 2024-09-10T23:26:53.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 -- 172.21.15.17:0/1818717033 wait complete. 2024-09-10T23:26:53.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 Processor -- start 2024-09-10T23:26:53.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 -- start start 2024-09-10T23:26:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab40b1530 0x7fbab41664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbab40b31b0 0x7fbab406ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab415f400 0x7fbab41f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41690b0 con 0x7fbab415f400 2024-09-10T23:26:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4168f30 con 0x7fbab40b1530 2024-09-10T23:26:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbabc000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbab4169230 con 0x7fbab40b31b0 2024-09-10T23:26:53.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbaba000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab415f400 0x7fbab41f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbaba000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab415f400 0x7fbab41f7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44208/0 (socket says 172.21.15.17:44208) 2024-09-10T23:26:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbaba000640 1 -- 172.21.15.17:0/360622522 learned_addr learned my addr 172.21.15.17:0/360622522 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbab9600640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab40b1530 0x7fbab41664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.937+0000 7fbab8c00640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbab40b31b0 0x7fbab406ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbaba000640 1 -- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbab40b31b0 msgr2=0x7fbab406ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbaba000640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbab40b31b0 0x7fbab406ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbaba000640 1 -- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab40b1530 msgr2=0x7fbab41664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbaba000640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab40b1530 0x7fbab41664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbaba000640 1 -- 172.21.15.17:0/360622522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab41f8df0 con 0x7fbab415f400 2024-09-10T23:26:53.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbaba000640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab415f400 0x7fbab41f7f40 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00c7c0 tx=0x7fbaac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbab1600640 1 -- 172.21.15.17:0/360622522 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac003b80 con 0x7fbab415f400 2024-09-10T23:26:53.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbab1600640 1 -- 172.21.15.17:0/360622522 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaac003d20 con 0x7fbab415f400 2024-09-10T23:26:53.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbab1600640 1 -- 172.21.15.17:0/360622522 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00aab0 con 0x7fbab415f400 2024-09-10T23:26:53.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbabc000640 1 -- 172.21.15.17:0/360622522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab4166a20 con 0x7fbab415f400 2024-09-10T23:26:53.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.941+0000 7fbabc000640 1 -- 172.21.15.17:0/360622522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab41581f0 con 0x7fbab415f400 2024-09-10T23:26:53.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab1600640 1 -- 172.21.15.17:0/360622522 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbaac00ac50 con 0x7fbab415f400 2024-09-10T23:26:53.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 Processor -- start 2024-09-10T23:26:53.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab1600640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba940725e0 0x7fba94074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 -- start start 2024-09-10T23:26:53.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab1600640 1 -- 172.21.15.17:0/360622522 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fbaac093130 con 0x7fbab415f400 2024-09-10T23:26:53.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab8c00640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba940725e0 0x7fba94074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a901a0 0x55c141a90580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a90ac0 0x55c141a46680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 0x55c141a46fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c14192ecb0 con 0x55c141a901a0 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c141844310 con 0x55c141a90ac0 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c1418a1b90 con 0x55c141a46bc0 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab8c00640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba940725e0 0x7fba94074aa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00af000 tx=0x7fbaa001b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a901a0 0x55c141a90580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a901a0 0x55c141a90580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44218/0 (socket says 172.21.15.17:44218) 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab9600640 1 -- 172.21.15.17:0/1248397123 learned_addr learned my addr 172.21.15.17:0/1248397123 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab8c00640 1 --2- 172.21.15.17:0/1248397123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a90ac0 0x55c141a46680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbaba000640 1 --2- 172.21.15.17:0/1248397123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 0x55c141a46fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab9600640 1 -- 172.21.15.17:0/1248397123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 msgr2=0x55c141a46fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab9600640 1 --2- 172.21.15.17:0/1248397123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 0x55c141a46fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab9600640 1 -- 172.21.15.17:0/1248397123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a90ac0 msgr2=0x55c141a46680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab9600640 1 --2- 172.21.15.17:0/1248397123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a90ac0 0x55c141a46680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab9600640 1 -- 172.21.15.17:0/1248397123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c141845c60 con 0x55c141a901a0 2024-09-10T23:26:53.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbab9600640 1 --2- 172.21.15.17:0/1248397123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a901a0 0x55c141a90580 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009c60 tx=0x7fbaa8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99146ded342ab7b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbaa6000640 1 -- 172.21.15.17:0/1248397123 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8004230 con 0x55c141a901a0 2024-09-10T23:26:53.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbaa6000640 1 -- 172.21.15.17:0/1248397123 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaa80044c0 con 0x55c141a901a0 2024-09-10T23:26:53.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbaa6000640 1 -- 172.21.15.17:0/1248397123 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8003860 con 0x55c141a901a0 2024-09-10T23:26:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 -- 172.21.15.17:0/1248397123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a901a0 msgr2=0x55c141a90580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.945+0000 7fbabf378000 1 --2- 172.21.15.17:0/1248397123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a901a0 0x55c141a90580 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009c60 tx=0x7fbaa8011810 comp rx=0 tx=0).stop 2024-09-10T23:26:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- 172.21.15.17:0/1248397123 shutdown_connections 2024-09-10T23:26:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 --2- 172.21.15.17:0/1248397123 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 0x55c141a46fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 --2- 172.21.15.17:0/1248397123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a90ac0 0x55c141a46680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 --2- 172.21.15.17:0/1248397123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a901a0 0x55c141a90580 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- 172.21.15.17:0/1248397123 >> 172.21.15.17:0/1248397123 conn(0x55c141a4cd20 msgr2=0x55c141a44f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- 172.21.15.17:0/1248397123 shutdown_connections 2024-09-10T23:26:53.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- 172.21.15.17:0/1248397123 wait complete. 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- start start 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 Processor -- start 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 0x55c141a97530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 0x55c141a97a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141a97fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c141894dd0 con 0x55c141a90ac0 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c141890fc0 con 0x55c141a901a0 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c1418364b0 con 0x55c141a46bc0 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 10 client.0 _ll_register_callbacks cb 0x55c1418147d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbaba000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141a97fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbab8c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 0x55c141a97a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbaba000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141a97fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44220/0 (socket says 172.21.15.17:44220) 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbaba000640 1 -- 172.21.15.17:0/1780552549 learned_addr learned my addr 172.21.15.17:0/1780552549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbab9600640 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 0x55c141a97530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbaba000640 1 -- 172.21.15.17:0/1780552549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 msgr2=0x55c141a97530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbaba000640 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 0x55c141a97530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbaba000640 1 -- 172.21.15.17:0/1780552549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 msgr2=0x55c141a97a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbaba000640 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 0x55c141a97a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbaba000640 1 -- 172.21.15.17:0/1780552549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14182f1f0 con 0x55c141a90ac0 2024-09-10T23:26:53.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbaba000640 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141a97fb0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00a430 tx=0x7fbaac05daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c72bb4caf034c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fba9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:53.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fba9aa00640 1 -- 172.21.15.17:0/1780552549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac05e0c0 con 0x55c141a90ac0 2024-09-10T23:26:53.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fba9aa00640 1 -- 172.21.15.17:0/1780552549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fbaac073b00 con 0x55c141a90ac0 2024-09-10T23:26:53.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- 172.21.15.17:0/1780552549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c141829330 con 0x55c141a90ac0 2024-09-10T23:26:53.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fba9aa00640 1 -- 172.21.15.17:0/1780552549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fbaac062af0 con 0x55c141a90ac0 2024-09-10T23:26:53.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 10 client.9468 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- 172.21.15.17:0/1780552549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55c141815fa0 con 0x55c141a90ac0 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fba9aa00640 1 -- 172.21.15.17:0/1780552549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c141829330 con 0x55c141a90ac0 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fba9aa00640 1 -- 172.21.15.17:0/1780552549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fbaac059a10 con 0x55c141a90ac0 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 10 client.9468 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 10 client.9468 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 20 client.9468 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c141a9f900 0x55c141aa1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 4 client.9468 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.949+0000 7fbabf378000 1 -- 172.21.15.17:0/1780552549 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1418a3ae0 con 0x55c141a9f900 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbab9600640 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c141a9f900 0x55c141aa1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbab9600640 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c141a9f900 0x55c141aa1cf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50a33279d2025e94 server_cookie=bb3ca188a63299da in_seq=0 out_seq=0 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fba9aa00640 10 client.9468 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:53.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fba9aa00640 1 -- 172.21.15.17:0/1780552549 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c1418a3ae0 con 0x55c141a9f900 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fba9aa00640 10 client.9468 handle_command_reply: tid=0 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 client.9468 shutdown 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 -- 172.21.15.17:0/1780552549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 msgr2=0x55c141a97fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141a97fb0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00a430 tx=0x7fbaac05daf0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 -- 172.21.15.17:0/1780552549 shutdown_connections 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c141a9f900 0x55c141aa1cf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141a97fb0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 0x55c141a97a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 --2- 172.21.15.17:0/1780552549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a46bc0 0x55c141a97530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fba9aa00640 0 client.9468 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 -- 172.21.15.17:0/1780552549 >> 172.21.15.17:0/1780552549 conn(0x55c141a4cd20 msgr2=0x55c141a44f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 -- 172.21.15.17:0/1780552549 shutdown_connections 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 1 -- 172.21.15.17:0/1780552549 wait complete. 2024-09-10T23:26:53.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.953+0000 7fbabf378000 20 client.9468 trim_cache size 0 max 16384 2024-09-10T23:26:53.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.969+0000 7fbabf378000 1 Processor -- start 2024-09-10T23:26:53.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- start start 2024-09-10T23:26:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a46bc0 0x55c141b01a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 0x55c141b01f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a90ac0 0x55c141b024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4204a20 con 0x55c141a46bc0 2024-09-10T23:26:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4203ab0 con 0x55c141a901a0 2024-09-10T23:26:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbab415e950 con 0x55c141a90ac0 2024-09-10T23:26:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a46bc0 0x55c141b01a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a46bc0 0x55c141b01a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44222/0 (socket says 172.21.15.17:44222) 2024-09-10T23:26:53.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab9600640 1 -- 172.21.15.17:0/345045098 learned_addr learned my addr 172.21.15.17:0/345045098 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab8c00640 1 --2- 172.21.15.17:0/345045098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 0x55c141b01f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbaba000640 1 --2- 172.21.15.17:0/345045098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a90ac0 0x55c141b024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab9600640 1 -- 172.21.15.17:0/345045098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a90ac0 msgr2=0x55c141b024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab9600640 1 --2- 172.21.15.17:0/345045098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a90ac0 0x55c141b024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab9600640 1 -- 172.21.15.17:0/345045098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 msgr2=0x55c141b01f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab9600640 1 --2- 172.21.15.17:0/345045098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 0x55c141b01f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab9600640 1 -- 172.21.15.17:0/345045098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1418ee660 con 0x55c141a46bc0 2024-09-10T23:26:53.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbab9600640 1 --2- 172.21.15.17:0/345045098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a46bc0 0x55c141b01a20 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8004000 tx=0x7fbaa8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890d0d614ba0d929 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbaa5600640 1 -- 172.21.15.17:0/345045098 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8004030 con 0x55c141a46bc0 2024-09-10T23:26:53.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbaa5600640 1 -- 172.21.15.17:0/345045098 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaa80042c0 con 0x55c141a46bc0 2024-09-10T23:26:53.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbaa5600640 1 -- 172.21.15.17:0/345045098 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8003860 con 0x55c141a46bc0 2024-09-10T23:26:53.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- 172.21.15.17:0/345045098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a46bc0 msgr2=0x55c141b01a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 --2- 172.21.15.17:0/345045098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a46bc0 0x55c141b01a20 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8004000 tx=0x7fbaa8004740 comp rx=0 tx=0).stop 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- 172.21.15.17:0/345045098 shutdown_connections 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 --2- 172.21.15.17:0/345045098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a90ac0 0x55c141b024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 --2- 172.21.15.17:0/345045098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a901a0 0x55c141b01f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 --2- 172.21.15.17:0/345045098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a46bc0 0x55c141b01a20 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- 172.21.15.17:0/345045098 >> 172.21.15.17:0/345045098 conn(0x55c141a4cd20 msgr2=0x55c141a48080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- 172.21.15.17:0/345045098 shutdown_connections 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- 172.21.15.17:0/345045098 wait complete. 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 -- start start 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.973+0000 7fbabf378000 1 Processor -- start 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a46bc0 0x55c141aa6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a901a0 0x55c141aa6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141ac2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c141894dd0 con 0x55c141a90ac0 2024-09-10T23:26:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c141a4fd40 con 0x55c141a46bc0 2024-09-10T23:26:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c141a4d100 con 0x55c141a901a0 2024-09-10T23:26:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 10 client.0 _ll_register_callbacks cb 0x7fbaac059f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbaba000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141ac2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbaba000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141ac2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44230/0 (socket says 172.21.15.17:44230) 2024-09-10T23:26:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbaba000640 1 -- 172.21.15.17:0/4155157889 learned_addr learned my addr 172.21.15.17:0/4155157889 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbab9600640 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a46bc0 0x55c141aa6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbab8c00640 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a901a0 0x55c141aa6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbaba000640 1 -- 172.21.15.17:0/4155157889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a901a0 msgr2=0x55c141aa6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbaba000640 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a901a0 0x55c141aa6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbaba000640 1 -- 172.21.15.17:0/4155157889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a46bc0 msgr2=0x55c141aa6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbaba000640 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a46bc0 0x55c141aa6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbaba000640 1 -- 172.21.15.17:0/4155157889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14185b090 con 0x55c141a90ac0 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbaba000640 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141ac2210 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0019f0 tx=0x7fbaac001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6331694af5642b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 1 -- 172.21.15.17:0/4155157889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac05de90 con 0x55c141a90ac0 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 1 -- 172.21.15.17:0/4155157889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fbaac059a10 con 0x55c141a90ac0 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- 172.21.15.17:0/4155157889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaa80042c0 con 0x55c141a90ac0 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 1 -- 172.21.15.17:0/4155157889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fbaac05e0c0 con 0x55c141a90ac0 2024-09-10T23:26:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 10 client.9474 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- 172.21.15.17:0/4155157889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55c1418275f0 con 0x55c141a90ac0 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 1 -- 172.21.15.17:0/4155157889 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaa80042c0 con 0x55c141a90ac0 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 1 -- 172.21.15.17:0/4155157889 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fbaac073b00 con 0x55c141a90ac0 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 10 client.9474 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 10 client.9474 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 20 client.9474 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c141ac2d50 0x55c141b05640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 4 client.9474 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- 172.21.15.17:0/4155157889 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c14189f590 con 0x55c141ac2d50 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbab9600640 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c141ac2d50 0x55c141b05640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbab9600640 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c141ac2d50 0x55c141b05640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5c5343874be951 server_cookie=7003c40ece6c147b in_seq=0 out_seq=0 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 10 client.9474 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:53.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 1 -- 172.21.15.17:0/4155157889 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x55c14189f590 con 0x55c141ac2d50 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 10 client.9474 handle_command_reply: tid=0 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 client.9474 shutdown 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- 172.21.15.17:0/4155157889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 msgr2=0x55c141ac2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141ac2210 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0019f0 tx=0x7fbaac001930 comp rx=0 tx=0).stop 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- 172.21.15.17:0/4155157889 shutdown_connections 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55c141ac2d50 0x55c141b05640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c141a90ac0 0x55c141ac2210 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c141a901a0 0x55c141aa6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fba9aa00640 0 client.9474 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 --2- 172.21.15.17:0/4155157889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c141a46bc0 0x55c141aa6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- 172.21.15.17:0/4155157889 >> 172.21.15.17:0/4155157889 conn(0x55c141a4cd20 msgr2=0x55c141aa1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- 172.21.15.17:0/4155157889 shutdown_connections 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.977+0000 7fbabf378000 1 -- 172.21.15.17:0/4155157889 wait complete. 2024-09-10T23:26:53.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabf378000 20 client.9474 trim_cache size 0 max 16384 2024-09-10T23:26:53.988 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T23:26:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:26:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "ec9b90e9-9427-44eb-9e5b-ff67747f9b99": { 2024-09-10T23:26:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:26:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "ec9b90e9-9427-44eb-9e5b-ff67747f9b99", 2024-09-10T23:26:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive" 2024-09-10T23:26:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:53.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "ec9b90e9-9427-44eb-9e5b-ff67747f9b99": { 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:26:46.765805+0000", 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:53.989 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:53.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 -- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba940725e0 msgr2=0x7fba94074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba940725e0 0x7fba94074aa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00af000 tx=0x7fbaa001b100 comp rx=0 tx=0).stop 2024-09-10T23:26:53.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 -- 172.21.15.17:0/360622522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab415f400 msgr2=0x7fbab41f7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:53.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab415f400 0x7fbab41f7f40 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00c7c0 tx=0x7fbaac00cc80 comp rx=0 tx=0).stop 2024-09-10T23:26:53.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 -- 172.21.15.17:0/360622522 shutdown_connections 2024-09-10T23:26:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba940725e0 0x7fba94074aa0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab415f400 0x7fbab41f7f40 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbab40b31b0 0x7fbab406ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 --2- 172.21.15.17:0/360622522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab40b1530 0x7fbab41664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 -- 172.21.15.17:0/360622522 >> 172.21.15.17:0/360622522 conn(0x7fbab40d1da0 msgr2=0x7fbab40b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 -- 172.21.15.17:0/360622522 shutdown_connections 2024-09-10T23:26:53.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:53.981+0000 7fbabc000640 1 -- 172.21.15.17:0/360622522 wait complete. 2024-09-10T23:26:54.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:26:54.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 -- 172.21.15.17:0/4057840133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe38015c570 msgr2=0x7fe380073630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 --2- 172.21.15.17:0/4057840133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe38015c570 0x7fe380073630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe370009930 tx=0x7fe37001c8e0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 -- 172.21.15.17:0/4057840133 shutdown_connections 2024-09-10T23:26:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 --2- 172.21.15.17:0/4057840133 >> v2:172.21.15.77:3300/0 conn(0x7fe38006f710 0x7fe38015cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 --2- 172.21.15.17:0/4057840133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe38015c570 0x7fe380073630 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 -- 172.21.15.17:0/4057840133 >> 172.21.15.17:0/4057840133 conn(0x7fe3800691b0 msgr2=0x7fe3800695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 -- 172.21.15.17:0/4057840133 shutdown_connections 2024-09-10T23:26:54.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 -- 172.21.15.17:0/4057840133 wait complete. 2024-09-10T23:26:54.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 Processor -- start 2024-09-10T23:26:54.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 -- start start 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe38006f710 0x7fe3801f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe38015c570 0x7fe38014c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe38015c950 0x7fe3800ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe380168c10 con 0x7fe38006f710 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe38015e020 con 0x7fe38015c570 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe387000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe380168d90 con 0x7fe38015c950 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe37fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe38006f710 0x7fe3801f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe37fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe38006f710 0x7fe3801f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44242/0 (socket says 172.21.15.17:44242) 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.149+0000 7fe37fe00640 1 -- 172.21.15.17:0/46635459 learned_addr learned my addr 172.21.15.17:0/46635459 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe377e00640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe38015c570 0x7fe38014c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe385000640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe38015c950 0x7fe3800ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37fe00640 1 -- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe38015c950 msgr2=0x7fe3800ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37fe00640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe38015c950 0x7fe3800ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37fe00640 1 -- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe38015c570 msgr2=0x7fe38014c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37fe00640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe38015c570 0x7fe38014c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37fe00640 1 -- 172.21.15.17:0/46635459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38014c6c0 con 0x7fe38006f710 2024-09-10T23:26:54.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37fe00640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe38006f710 0x7fe3801f55a0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fe3700b0040 tx=0x7fe3700a5690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37cc00640 1 -- 172.21.15.17:0/46635459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3700b2040 con 0x7fe38006f710 2024-09-10T23:26:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37cc00640 1 -- 172.21.15.17:0/46635459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3700041b0 con 0x7fe38006f710 2024-09-10T23:26:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37cc00640 1 -- 172.21.15.17:0/46635459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370003600 con 0x7fe38006f710 2024-09-10T23:26:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe380156df0 con 0x7fe38006f710 2024-09-10T23:26:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3801573b0 con 0x7fe38006f710 2024-09-10T23:26:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38015cd90 con 0x7fe38006f710 2024-09-10T23:26:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37cc00640 1 -- 172.21.15.17:0/46635459 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe3700037a0 con 0x7fe38006f710 2024-09-10T23:26:54.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.153+0000 7fe37cc00640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe35c072610 0x7fe35c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.157+0000 7fe37cc00640 1 -- 172.21.15.17:0/46635459 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fe37012d9e0 con 0x7fe38006f710 2024-09-10T23:26:54.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.157+0000 7fe377e00640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe35c072610 0x7fe35c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.157+0000 7fe377e00640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe35c072610 0x7fe35c074ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe3800736a0 tx=0x7fe368009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.157+0000 7fe37cc00640 1 -- 172.21.15.17:0/46635459 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe3700c6020 con 0x7fe38006f710 2024-09-10T23:26:54.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe38006dbd0 con 0x7fe38006f710 2024-09-10T23:26:54.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe37cc00640 1 -- 172.21.15.17:0/46635459 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7fe3700164d0 con 0x7fe38006f710 2024-09-10T23:26:54.376 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:54.377 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:26:54.377 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:26:54.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe35c072610 msgr2=0x7fe35c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe35c072610 0x7fe35c074ad0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe3800736a0 tx=0x7fe368009040 comp rx=0 tx=0).stop 2024-09-10T23:26:54.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe38006f710 msgr2=0x7fe3801f55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe38006f710 0x7fe3801f55a0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fe3700b0040 tx=0x7fe3700a5690 comp rx=0 tx=0).stop 2024-09-10T23:26:54.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 shutdown_connections 2024-09-10T23:26:54.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe35c072610 0x7fe35c074ad0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe38015c950 0x7fe3800ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe38015c570 0x7fe38014c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 --2- 172.21.15.17:0/46635459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe38006f710 0x7fe3801f55a0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 >> 172.21.15.17:0/46635459 conn(0x7fe3800691b0 msgr2=0x7fe38006efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:54.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 shutdown_connections 2024-09-10T23:26:54.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.373+0000 7fe387000640 1 -- 172.21.15.17:0/46635459 wait complete. 2024-09-10T23:26:54.398 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:26:54.398 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:26:54.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 -- 172.21.15.17:0/1859277391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80cf610 msgr2=0x7f61c806e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 --2- 172.21.15.17:0/1859277391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80cf610 0x7f61c806e750 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009900 tx=0x7f61b40201e0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 -- 172.21.15.17:0/1859277391 shutdown_connections 2024-09-10T23:26:54.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 --2- 172.21.15.17:0/1859277391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80cf610 0x7f61c806e750 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 -- 172.21.15.17:0/1859277391 >> 172.21.15.17:0/1859277391 conn(0x7f61c806cfc0 msgr2=0x7f61c806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:54.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 -- 172.21.15.17:0/1859277391 shutdown_connections 2024-09-10T23:26:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 -- 172.21.15.17:0/1859277391 wait complete. 2024-09-10T23:26:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 Processor -- start 2024-09-10T23:26:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 -- start start 2024-09-10T23:26:54.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80b32d0 0x7f61c81e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c80cf230 0x7f61c81e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61c80cf610 0x7f61c814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80d04a0 con 0x7f61c80b32d0 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61c80d0320 con 0x7f61c80cf230 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cfe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61c80d0620 con 0x7f61c80cf610 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80b32d0 0x7f61c81e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80b32d0 0x7f61c81e3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44264/0 (socket says 172.21.15.17:44264) 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cd400640 1 -- 172.21.15.17:0/3216976168 learned_addr learned my addr 172.21.15.17:0/3216976168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cca00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c80cf230 0x7f61c81e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cde00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61c80cf610 0x7f61c814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cd400640 1 -- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61c80cf610 msgr2=0x7f61c814f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cd400640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61c80cf610 0x7f61c814f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cd400640 1 -- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c80cf230 msgr2=0x7f61c81e7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cd400640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c80cf230 0x7f61c81e7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cd400640 1 -- 172.21.15.17:0/3216976168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c80cc6f0 con 0x7f61c80b32d0 2024-09-10T23:26:54.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.541+0000 7f61cca00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c80cf230 0x7f61c81e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:54.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61cd400640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80b32d0 0x7f61c81e3c50 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c4b0 tx=0x7f61bc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61c5600640 1 -- 172.21.15.17:0/3216976168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc0052d0 con 0x7f61c80b32d0 2024-09-10T23:26:54.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61c5600640 1 -- 172.21.15.17:0/3216976168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61bc005470 con 0x7f61c80b32d0 2024-09-10T23:26:54.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61c5600640 1 -- 172.21.15.17:0/3216976168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc012870 con 0x7f61c80b32d0 2024-09-10T23:26:54.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c80cc9d0 con 0x7f61c80b32d0 2024-09-10T23:26:54.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c80ccf90 con 0x7f61c80b32d0 2024-09-10T23:26:54.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c806e750 con 0x7f61c80b32d0 2024-09-10T23:26:54.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61c5600640 1 -- 172.21.15.17:0/3216976168 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f61bc003600 con 0x7f61c80b32d0 2024-09-10T23:26:54.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61c5600640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61a8072610 0x7f61a8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.545+0000 7f61c5600640 1 -- 172.21.15.17:0/3216976168 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f61bc092f50 con 0x7f61c80b32d0 2024-09-10T23:26:54.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.549+0000 7f61cca00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61a8072610 0x7f61a8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.549+0000 7f61cca00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61a8072610 0x7f61a8074ad0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f61b40b2000 tx=0x7f61b401ea20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.553+0000 7f61c5600640 1 -- 172.21.15.17:0/3216976168 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f61bc05e490 con 0x7f61c80b32d0 2024-09-10T23:26:54.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f61c81e34b0 con 0x7f61c80b32d0 2024-09-10T23:26:54.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61c5600640 1 -- 172.21.15.17:0/3216976168 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f61bc05dd90 con 0x7f61c80b32d0 2024-09-10T23:26:54.792 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:26:54.792 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":703,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":155,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077991924,"bytes_used":2688401408,"bytes_avail":770405711872,"bytes_total":773094113280,"write_bytes_sec":31750549,"read_op_per_sec":0,"write_op_per_sec":38},"fsmap":{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9201}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-09-10T23:26:52.456006+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61a8072610 msgr2=0x7f61a8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61a8072610 0x7f61a8074ad0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f61b40b2000 tx=0x7f61b401ea20 comp rx=0 tx=0).stop 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80b32d0 msgr2=0x7f61c81e3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80b32d0 0x7f61c81e3c50 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c4b0 tx=0x7f61bc00c970 comp rx=0 tx=0).stop 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 shutdown_connections 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61a8072610 0x7f61a8074ad0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61c80cf610 0x7f61c814f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61c80cf230 0x7f61c81e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 --2- 172.21.15.17:0/3216976168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c80b32d0 0x7f61c81e3c50 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 >> 172.21.15.17:0/3216976168 conn(0x7f61c806cfc0 msgr2=0x7f61c81522d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 shutdown_connections 2024-09-10T23:26:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.789+0000 7f61cfe00640 1 -- 172.21.15.17:0/3216976168 wait complete. 2024-09-10T23:26:54.813 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-10T23:26:54.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:26:54.813 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-09-10T23:26:54.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.957+0000 7ff5f7200640 1 -- 172.21.15.17:0/1816522583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5f00b2540 msgr2=0x7ff5f00cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.957+0000 7ff5f7200640 1 --2- 172.21.15.17:0/1816522583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5f00b2540 0x7ff5f00cc8b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009bc0 tx=0x7ff5e801cba0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.957+0000 7ff5f7200640 1 -- 172.21.15.17:0/1816522583 shutdown_connections 2024-09-10T23:26:54.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.957+0000 7ff5f7200640 1 --2- 172.21.15.17:0/1816522583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5f00b2540 0x7ff5f00cc8b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.957+0000 7ff5f7200640 1 --2- 172.21.15.17:0/1816522583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5f015f400 0x7ff5f00cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.957+0000 7ff5f7200640 1 -- 172.21.15.17:0/1816522583 >> 172.21.15.17:0/1816522583 conn(0x7ff5f00d1da0 msgr2=0x7ff5f00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:54.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.957+0000 7ff5f7200640 1 -- 172.21.15.17:0/1816522583 shutdown_connections 2024-09-10T23:26:54.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.957+0000 7ff5f7200640 1 -- 172.21.15.17:0/1816522583 wait complete. 2024-09-10T23:26:54.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 Processor -- start 2024-09-10T23:26:54.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 -- start start 2024-09-10T23:26:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00b2540 0x7ff5f00b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5f00b31b0 0x7ff5f015c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5f015f400 0x7ff5f00c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f0168de0 con 0x7ff5f00b2540 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f0168c60 con 0x7ff5f00b31b0 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f0168f60 con 0x7ff5f015f400 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00b2540 0x7ff5f00b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00b2540 0x7ff5f00b75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44276/0 (socket says 172.21.15.17:44276) 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5efe00640 1 -- 172.21.15.17:0/2771564825 learned_addr learned my addr 172.21.15.17:0/2771564825 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f5200640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5f015f400 0x7ff5f00c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5e7400640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5f00b31b0 0x7ff5f015c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5efe00640 1 -- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5f015f400 msgr2=0x7ff5f00c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5efe00640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5f015f400 0x7ff5f00c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5efe00640 1 -- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5f00b31b0 msgr2=0x7ff5f015c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5efe00640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5f00b31b0 0x7ff5f015c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5efe00640 1 -- 172.21.15.17:0/2771564825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f00b4d20 con 0x7ff5f00b2540 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5efe00640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00b2540 0x7ff5f00b75f0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000ea20 tx=0x7ff5e000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5ecc00640 1 -- 172.21.15.17:0/2771564825 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000cd80 con 0x7ff5f00b2540 2024-09-10T23:26:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5ecc00640 1 -- 172.21.15.17:0/2771564825 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5e0004020 con 0x7ff5f00b2540 2024-09-10T23:26:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5ecc00640 1 -- 172.21.15.17:0/2771564825 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0004450 con 0x7ff5f00b2540 2024-09-10T23:26:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 -- 172.21.15.17:0/2771564825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f00b5000 con 0x7ff5f00b2540 2024-09-10T23:26:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.961+0000 7ff5f7200640 1 -- 172.21.15.17:0/2771564825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f015d650 con 0x7ff5f00b2540 2024-09-10T23:26:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5ecc00640 1 -- 172.21.15.17:0/2771564825 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff5e0003600 con 0x7ff5f00b2540 2024-09-10T23:26:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5ecc00640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5cc0725e0 0x7ff5cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5ecc00640 1 -- 172.21.15.17:0/2771564825 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7ff5e0093ba0 con 0x7ff5f00b2540 2024-09-10T23:26:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5fa553000 1 Processor -- start 2024-09-10T23:26:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5e7400640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5cc0725e0 0x7ff5cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5fa553000 1 -- start start 2024-09-10T23:26:54.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5e7400640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5cc0725e0 0x7ff5cc074aa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff5f006f5f0 tx=0x7ff5d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e910580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 0x55fa2e8c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 0x55fa2e8c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5fa553000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fa2e7aecb0 con 0x55fa2e9101a0 2024-09-10T23:26:54.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5fa553000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fa2e6c4310 con 0x55fa2e910ac0 2024-09-10T23:26:54.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5fa553000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fa2e721b90 con 0x55fa2e8c6bc0 2024-09-10T23:26:54.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e910580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5efe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e910580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44288/0 (socket says 172.21.15.17:44288) 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5efe00640 1 -- 172.21.15.17:0/2080692073 learned_addr learned my addr 172.21.15.17:0/2080692073 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5e7400640 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 0x55fa2e8c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.965+0000 7ff5f5200640 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 0x55fa2e8c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5efe00640 1 -- 172.21.15.17:0/2080692073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 msgr2=0x55fa2e8c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5efe00640 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 0x55fa2e8c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5efe00640 1 -- 172.21.15.17:0/2080692073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 msgr2=0x55fa2e8c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5efe00640 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 0x55fa2e8c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5efe00640 1 -- 172.21.15.17:0/2080692073 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa2e6c5c60 con 0x55fa2e9101a0 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5e7400640 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 0x55fa2e8c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5efe00640 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e910580 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7ff5e005eac0 tx=0x7ff5e005e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4384b9246f54a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5e4c00640 1 -- 172.21.15.17:0/2080692073 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e008c020 con 0x55fa2e9101a0 2024-09-10T23:26:54.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5e4c00640 1 -- 172.21.15.17:0/2080692073 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5e0063560 con 0x55fa2e9101a0 2024-09-10T23:26:54.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5e4c00640 1 -- 172.21.15.17:0/2080692073 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0083030 con 0x55fa2e9101a0 2024-09-10T23:26:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 -- 172.21.15.17:0/2080692073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 msgr2=0x55fa2e910580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e910580 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7ff5e005eac0 tx=0x7ff5e005e540 comp rx=0 tx=0).stop 2024-09-10T23:26:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 -- 172.21.15.17:0/2080692073 shutdown_connections 2024-09-10T23:26:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 0x55fa2e8c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 0x55fa2e8c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2080692073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e910580 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 -- 172.21.15.17:0/2080692073 >> 172.21.15.17:0/2080692073 conn(0x55fa2e8ccd20 msgr2=0x55fa2e8c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 -- 172.21.15.17:0/2080692073 shutdown_connections 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 -- 172.21.15.17:0/2080692073 wait complete. 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 -- start start 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 Processor -- start 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 0x55fa2e917530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e917a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 0x55fa2e917fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fa2e714dd0 con 0x55fa2e9101a0 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fa2e710fc0 con 0x55fa2e910ac0 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fa2e6b64b0 con 0x55fa2e8c6bc0 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5fa553000 10 client.0 _ll_register_callbacks cb 0x55fa2e6947d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5e7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e917a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5e7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e917a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44296/0 (socket says 172.21.15.17:44296) 2024-09-10T23:26:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5e7400640 1 -- 172.21.15.17:0/2020783477 learned_addr learned my addr 172.21.15.17:0/2020783477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5efe00640 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 0x55fa2e917530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.969+0000 7ff5f5200640 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 0x55fa2e917fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5e7400640 1 -- 172.21.15.17:0/2020783477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 msgr2=0x55fa2e917530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5e7400640 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 0x55fa2e917530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5e7400640 1 -- 172.21.15.17:0/2020783477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 msgr2=0x55fa2e917fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5e7400640 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 0x55fa2e917fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5e7400640 1 -- 172.21.15.17:0/2020783477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa2e6af1f0 con 0x55fa2e9101a0 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5e7400640 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e917a70 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8014780 tx=0x7ff5d8001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e704ba2436147 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 1 -- 172.21.15.17:0/2020783477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8014e50 con 0x55fa2e9101a0 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 -- 172.21.15.17:0/2020783477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa2e6a9330 con 0x55fa2e9101a0 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 1 -- 172.21.15.17:0/2020783477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7ff5d8013930 con 0x55fa2e9101a0 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 1 -- 172.21.15.17:0/2020783477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7ff5d802e050 con 0x55fa2e9101a0 2024-09-10T23:26:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 10 client.9495 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 -- 172.21.15.17:0/2020783477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55fa2e695fa0 con 0x55fa2e9101a0 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 1 -- 172.21.15.17:0/2020783477 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55fa2e6a9330 con 0x55fa2e9101a0 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 1 -- 172.21.15.17:0/2020783477 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7ff5d8031020 con 0x55fa2e9101a0 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 10 client.9495 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 10 client.9495 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 20 client.9495 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55fa2e91f900 0x55fa2e921cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 4 client.9495 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 -- 172.21.15.17:0/2020783477 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa2e723ae0 con 0x55fa2e91f900 2024-09-10T23:26:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5efe00640 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55fa2e91f900 0x55fa2e921cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5efe00640 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55fa2e91f900 0x55fa2e921cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45df9a9b1ec15013 server_cookie=8813048410d13147 in_seq=0 out_seq=0 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 10 client.9495 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 1 -- 172.21.15.17:0/2020783477 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa2e723ae0 con 0x55fa2e91f900 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 10 client.9495 handle_command_reply: tid=0 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 client.9495 shutdown 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 -- 172.21.15.17:0/2020783477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 msgr2=0x55fa2e917a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e917a70 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8014780 tx=0x7ff5d8001130 comp rx=0 tx=0).stop 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 -- 172.21.15.17:0/2020783477 shutdown_connections 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55fa2e91f900 0x55fa2e921cf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e910ac0 0x55fa2e917fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e917a70 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 --2- 172.21.15.17:0/2020783477 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e8c6bc0 0x55fa2e917530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5dd600640 0 client.9495 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 -- 172.21.15.17:0/2020783477 >> 172.21.15.17:0/2020783477 conn(0x55fa2e8ccd20 msgr2=0x55fa2e8c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 -- 172.21.15.17:0/2020783477 shutdown_connections 2024-09-10T23:26:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 1 -- 172.21.15.17:0/2020783477 wait complete. 2024-09-10T23:26:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.973+0000 7ff5fa553000 20 client.9495 trim_cache size 0 max 16384 2024-09-10T23:26:54.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5fa553000 1 Processor -- start 2024-09-10T23:26:54.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5fa553000 1 -- start start 2024-09-10T23:26:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e8c6bc0 0x55fa2e91ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e8c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e910ac0 0x55fa2e8c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5fa553000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f02046a0 con 0x55fa2e9101a0 2024-09-10T23:26:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5fa553000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f0203700 con 0x55fa2e8c6bc0 2024-09-10T23:26:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5fa553000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f00c66b0 con 0x55fa2e910ac0 2024-09-10T23:26:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5e7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e8c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5e7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e8c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44304/0 (socket says 172.21.15.17:44304) 2024-09-10T23:26:54.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5e7400640 1 -- 172.21.15.17:0/3155545179 learned_addr learned my addr 172.21.15.17:0/3155545179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:55.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5e7400640 1 -- 172.21.15.17:0/3155545179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e910ac0 msgr2=0x55fa2e8c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5e7400640 1 --2- 172.21.15.17:0/3155545179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e910ac0 0x55fa2e8c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5e7400640 1 -- 172.21.15.17:0/3155545179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e8c6bc0 msgr2=0x55fa2e91ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5e7400640 1 --2- 172.21.15.17:0/3155545179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e8c6bc0 0x55fa2e91ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5e7400640 1 -- 172.21.15.17:0/3155545179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa2e76e660 con 0x55fa2e9101a0 2024-09-10T23:26:55.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5e7400640 1 --2- 172.21.15.17:0/3155545179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e8c6070 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800fbf0 tx=0x7ff5d800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6940627c5f03e1b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5dfe00640 1 -- 172.21.15.17:0/3155545179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8036030 con 0x55fa2e9101a0 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5dfe00640 1 -- 172.21.15.17:0/3155545179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5d8026070 con 0x55fa2e9101a0 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.993+0000 7ff5dfe00640 1 -- 172.21.15.17:0/3155545179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8015e60 con 0x55fa2e9101a0 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- 172.21.15.17:0/3155545179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 msgr2=0x55fa2e8c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 --2- 172.21.15.17:0/3155545179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e8c6070 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800fbf0 tx=0x7ff5d800f5a0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- 172.21.15.17:0/3155545179 shutdown_connections 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 --2- 172.21.15.17:0/3155545179 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e910ac0 0x55fa2e8c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 --2- 172.21.15.17:0/3155545179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e9101a0 0x55fa2e8c6070 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 --2- 172.21.15.17:0/3155545179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e8c6bc0 0x55fa2e91ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- 172.21.15.17:0/3155545179 >> 172.21.15.17:0/3155545179 conn(0x55fa2e8ccd20 msgr2=0x55fa2e8c5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- 172.21.15.17:0/3155545179 shutdown_connections 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- 172.21.15.17:0/3155545179 wait complete. 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- start start 2024-09-10T23:26:55.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 Processor -- start 2024-09-10T23:26:55.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e8c6bc0 0x55fa2e91cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e9101a0 0x55fa2e91d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e910ac0 0x55fa2e942210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55fa2e714dd0 con 0x55fa2e910ac0 2024-09-10T23:26:55.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fa2e70bec0 con 0x55fa2e8c6bc0 2024-09-10T23:26:55.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55fa2e8cfd40 con 0x55fa2e9101a0 2024-09-10T23:26:55.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 10 client.0 _ll_register_callbacks cb 0x7ff5d8017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:55.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5f5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e910ac0 0x55fa2e942210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5f5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e910ac0 0x55fa2e942210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44314/0 (socket says 172.21.15.17:44314) 2024-09-10T23:26:55.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5f5200640 1 -- 172.21.15.17:0/216475560 learned_addr learned my addr 172.21.15.17:0/216475560 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:55.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5efe00640 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e8c6bc0 0x55fa2e91cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5e7400640 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e9101a0 0x55fa2e91d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5f5200640 1 -- 172.21.15.17:0/216475560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e9101a0 msgr2=0x55fa2e91d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5f5200640 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e9101a0 0x55fa2e91d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5f5200640 1 -- 172.21.15.17:0/216475560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e8c6bc0 msgr2=0x55fa2e91cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5f5200640 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e8c6bc0 0x55fa2e91cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5f5200640 1 -- 172.21.15.17:0/216475560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa2e6db090 con 0x55fa2e910ac0 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5e7400640 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e9101a0 0x55fa2e91d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5f5200640 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e910ac0 0x55fa2e942210 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ff5e801a7d0 tx=0x7ff5e8004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5947b0ea7e428576 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5dd600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5dd600640 1 -- 172.21.15.17:0/216475560 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80b2040 con 0x55fa2e910ac0 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5dd600640 1 -- 172.21.15.17:0/216475560 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7ff5e8003b80 con 0x55fa2e910ac0 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- 172.21.15.17:0/216475560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5d8026070 con 0x55fa2e910ac0 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5dd600640 1 -- 172.21.15.17:0/216475560 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7ff5e80c6050 con 0x55fa2e910ac0 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 10 client.9501 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:55.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- 172.21.15.17:0/216475560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x55fa2e6a75f0 con 0x55fa2e910ac0 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5dd600640 1 -- 172.21.15.17:0/216475560 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5d8026070 con 0x55fa2e910ac0 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5dd600640 1 -- 172.21.15.17:0/216475560 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7ff5e80c9020 con 0x55fa2e910ac0 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 10 client.9501 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 10 client.9501 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 20 client.9501 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55fa2e985850 0x55fa2e985c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 4 client.9501 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:54.997+0000 7ff5fa553000 1 -- 172.21.15.17:0/216475560 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55fa2e71f590 con 0x55fa2e985850 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5efe00640 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55fa2e985850 0x55fa2e985c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5efe00640 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55fa2e985850 0x55fa2e985c60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b552462f83b8b4e server_cookie=96539e0fbe10465e in_seq=0 out_seq=0 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5dd600640 10 client.9501 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5dd600640 1 -- 172.21.15.17:0/216475560 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55fa2e71f590 con 0x55fa2e985850 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5dd600640 10 client.9501 handle_command_reply: tid=0 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 client.9501 shutdown 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 -- 172.21.15.17:0/216475560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e910ac0 msgr2=0x55fa2e942210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e910ac0 0x55fa2e942210 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ff5e801a7d0 tx=0x7ff5e8004bb0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 -- 172.21.15.17:0/216475560 shutdown_connections 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x55fa2e985850 0x55fa2e985c60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa2e910ac0 0x55fa2e942210 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5dd600640 0 client.9501 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55fa2e9101a0 0x55fa2e91d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 --2- 172.21.15.17:0/216475560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fa2e8c6bc0 0x55fa2e91cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 -- 172.21.15.17:0/216475560 >> 172.21.15.17:0/216475560 conn(0x55fa2e8ccd20 msgr2=0x55fa2e8c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 -- 172.21.15.17:0/216475560 shutdown_connections 2024-09-10T23:26:55.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 1 -- 172.21.15.17:0/216475560 wait complete. 2024-09-10T23:26:55.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5fa553000 20 client.9501 trim_cache size 0 max 16384 2024-09-10T23:26:55.011 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:55.011 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:26:55.011 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:55.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 -- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5cc0725e0 msgr2=0x7ff5cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5cc0725e0 0x7ff5cc074aa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff5f006f5f0 tx=0x7ff5d8009040 comp rx=0 tx=0).stop 2024-09-10T23:26:55.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 -- 172.21.15.17:0/2771564825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00b2540 msgr2=0x7ff5f00b75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00b2540 0x7ff5f00b75f0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000ea20 tx=0x7ff5e000ee20 comp rx=0 tx=0).stop 2024-09-10T23:26:55.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 -- 172.21.15.17:0/2771564825 shutdown_connections 2024-09-10T23:26:55.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff5cc0725e0 0x7ff5cc074aa0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5f015f400 0x7ff5f00c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5f00b31b0 0x7ff5f015c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 --2- 172.21.15.17:0/2771564825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f00b2540 0x7ff5f00b75f0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 -- 172.21.15.17:0/2771564825 >> 172.21.15.17:0/2771564825 conn(0x7ff5f00d1da0 msgr2=0x7ff5f006e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 -- 172.21.15.17:0/2771564825 shutdown_connections 2024-09-10T23:26:55.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.001+0000 7ff5f7200640 1 -- 172.21.15.17:0/2771564825 wait complete. 2024-09-10T23:26:55.025 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T23:26:55.025 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-10T23:26:55.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 -- 172.21.15.17:0/374564262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b1740 msgr2=0x7f6a800d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 --2- 172.21.15.17:0/374564262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b1740 0x7f6a800d0320 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f6a80075590 tx=0x7f6a7801cd30 comp rx=0 tx=0).stop 2024-09-10T23:26:55.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 -- 172.21.15.17:0/374564262 shutdown_connections 2024-09-10T23:26:55.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 --2- 172.21.15.17:0/374564262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b1740 0x7f6a800d0320 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 --2- 172.21.15.17:0/374564262 >> v2:172.21.15.77:3300/0 conn(0x7f6a800b12e0 0x7f6a800cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 --2- 172.21.15.17:0/374564262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a8015be00 0x7f6a8015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 -- 172.21.15.17:0/374564262 >> 172.21.15.17:0/374564262 conn(0x7f6a8009a9f0 msgr2=0x7f6a8009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 -- 172.21.15.17:0/374564262 shutdown_connections 2024-09-10T23:26:55.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 -- 172.21.15.17:0/374564262 wait complete. 2024-09-10T23:26:55.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 Processor -- start 2024-09-10T23:26:55.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.169+0000 7f6a85c00640 1 -- start start 2024-09-10T23:26:55.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a85c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b12e0 0x7f6a800b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a85c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a800b1740 0x7f6a8014b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a85c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a8015be00 0x7f6a800cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a85c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8015d2b0 con 0x7f6a800b12e0 2024-09-10T23:26:55.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a85c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8015d130 con 0x7f6a8015be00 2024-09-10T23:26:55.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a85c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a800b1c50 con 0x7f6a800b1740 2024-09-10T23:26:55.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b12e0 0x7f6a800b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b12e0 0x7f6a800b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44344/0 (socket says 172.21.15.17:44344) 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7ea00640 1 -- 172.21.15.17:0/152056757 learned_addr learned my addr 172.21.15.17:0/152056757 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7e000640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a800b1740 0x7f6a8014b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7f400640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a8015be00 0x7f6a800cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7ea00640 1 -- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a800b1740 msgr2=0x7f6a8014b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a800b1740 0x7f6a8014b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7ea00640 1 -- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a8015be00 msgr2=0x7f6a800cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a8015be00 0x7f6a800cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7ea00640 1 -- 172.21.15.17:0/152056757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a800cd4f0 con 0x7f6a800b12e0 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7f400640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a8015be00 0x7f6a800cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b12e0 0x7f6a800b0030 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000d750 tx=0x7f6a7000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a76a00640 1 -- 172.21.15.17:0/152056757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70017070 con 0x7f6a800b12e0 2024-09-10T23:26:55.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a76a00640 1 -- 172.21.15.17:0/152056757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a70009cc0 con 0x7f6a800b12e0 2024-09-10T23:26:55.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a85c00640 1 -- 172.21.15.17:0/152056757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a800cee70 con 0x7f6a800b12e0 2024-09-10T23:26:55.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a76a00640 1 -- 172.21.15.17:0/152056757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70005280 con 0x7f6a800b12e0 2024-09-10T23:26:55.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.173+0000 7f6a85c00640 1 -- 172.21.15.17:0/152056757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a8014c210 con 0x7f6a800b12e0 2024-09-10T23:26:55.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a76a00640 1 -- 172.21.15.17:0/152056757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6a70005420 con 0x7f6a800b12e0 2024-09-10T23:26:55.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a76a00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a600725e0 0x7f6a60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a76a00640 1 -- 172.21.15.17:0/152056757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f6a70093570 con 0x7f6a800b12e0 2024-09-10T23:26:55.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 Processor -- start 2024-09-10T23:26:55.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 -- start start 2024-09-10T23:26:55.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a600725e0 0x7f6a60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 0x559fd84129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd83c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd83c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559fd82accb0 con 0x559fd8412f20 2024-09-10T23:26:55.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559fd81c2310 con 0x559fd8412600 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559fd821fb90 con 0x559fd83c8fd0 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a600725e0 0x7f6a60074aa0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c005fd0 tx=0x7f6a6c005e60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd83c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd83c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44350/0 (socket says 172.21.15.17:44350) 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 -- 172.21.15.17:0/1825972885 learned_addr learned my addr 172.21.15.17:0/1825972885 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/1825972885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 0x559fd84129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7f400640 1 --2- 172.21.15.17:0/1825972885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd83c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 -- 172.21.15.17:0/1825972885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 msgr2=0x559fd83c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 --2- 172.21.15.17:0/1825972885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd83c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 -- 172.21.15.17:0/1825972885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 msgr2=0x559fd84129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 --2- 172.21.15.17:0/1825972885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 0x559fd84129e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 -- 172.21.15.17:0/1825972885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fd81c3c60 con 0x559fd8412f20 2024-09-10T23:26:55.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a7e000640 1 --2- 172.21.15.17:0/1825972885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd83c8a90 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00fdf0 tx=0x7f6a6c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a9737799133791 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a6b400640 1 -- 172.21.15.17:0/1825972885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c022070 con 0x559fd8412f20 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a6b400640 1 -- 172.21.15.17:0/1825972885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a6c01e450 con 0x559fd8412f20 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a6b400640 1 -- 172.21.15.17:0/1825972885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c01e8a0 con 0x559fd8412f20 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 -- 172.21.15.17:0/1825972885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 msgr2=0x559fd83c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 --2- 172.21.15.17:0/1825972885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd83c8a90 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00fdf0 tx=0x7f6a6c012000 comp rx=0 tx=0).stop 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 -- 172.21.15.17:0/1825972885 shutdown_connections 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 --2- 172.21.15.17:0/1825972885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd83c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 --2- 172.21.15.17:0/1825972885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd83c8a90 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 --2- 172.21.15.17:0/1825972885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 0x559fd84129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.177+0000 7f6a890e1000 1 -- 172.21.15.17:0/1825972885 >> 172.21.15.17:0/1825972885 conn(0x559fd83cad20 msgr2=0x559fd83c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 -- 172.21.15.17:0/1825972885 shutdown_connections 2024-09-10T23:26:55.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 -- 172.21.15.17:0/1825972885 wait complete. 2024-09-10T23:26:55.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 -- start start 2024-09-10T23:26:55.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 Processor -- start 2024-09-10T23:26:55.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd83c8fd0 0x559fd83fca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd8412600 0x559fd83fcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd83fd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559fd8212dd0 con 0x559fd83c8fd0 2024-09-10T23:26:55.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559fd820efc0 con 0x559fd8412f20 2024-09-10T23:26:55.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559fd81b44b0 con 0x559fd8412600 2024-09-10T23:26:55.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 10 client.0 _ll_register_callbacks cb 0x559fd81927d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:55.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd83c8fd0 0x559fd83fca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd83c8fd0 0x559fd83fca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44366/0 (socket says 172.21.15.17:44366) 2024-09-10T23:26:55.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7ea00640 1 -- 172.21.15.17:0/2002908301 learned_addr learned my addr 172.21.15.17:0/2002908301 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:55.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7e000640 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd8412600 0x559fd83fcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7ea00640 1 -- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd8412600 msgr2=0x559fd83fcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7f400640 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd83fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd8412600 0x559fd83fcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7ea00640 1 -- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 msgr2=0x559fd83fd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd83fd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7ea00640 1 -- 172.21.15.17:0/2002908301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fd81ad1f0 con 0x559fd83c8fd0 2024-09-10T23:26:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7e000640 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd8412600 0x559fd83fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7f400640 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd83fd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:26:55.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd83c8fd0 0x559fd83fca50 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009610 tx=0x7f6a7005dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1dda2ca54834b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a5fe00640 1 -- 172.21.15.17:0/2002908301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a70020040 con 0x559fd83c8fd0 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a5fe00640 1 -- 172.21.15.17:0/2002908301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f6a70083180 con 0x559fd83c8fd0 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 -- 172.21.15.17:0/2002908301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559fd81a7330 con 0x559fd83c8fd0 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a5fe00640 1 -- 172.21.15.17:0/2002908301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f6a7005de30 con 0x559fd83c8fd0 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 10 client.9513 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 -- 172.21.15.17:0/2002908301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x559fd8193fa0 con 0x559fd83c8fd0 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a5fe00640 1 -- 172.21.15.17:0/2002908301 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559fd81a7330 con 0x559fd83c8fd0 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a5fe00640 1 -- 172.21.15.17:0/2002908301 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f6a700650b0 con 0x559fd83c8fd0 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 10 client.9513 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 10 client.9513 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:55.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 20 client.9513 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x559fd83fdee0 0x559fd84238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 4 client.9513 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a890e1000 1 -- 172.21.15.17:0/2002908301 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fd8221ae0 con 0x559fd83fdee0 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.181+0000 7f6a7e000640 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x559fd83fdee0 0x559fd84238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a7e000640 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x559fd83fdee0 0x559fd84238b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f3fd28e313330fe server_cookie=dc9d059b1f45a43c in_seq=0 out_seq=0 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a5fe00640 10 client.9513 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a5fe00640 1 -- 172.21.15.17:0/2002908301 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559fd8221ae0 con 0x559fd83fdee0 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a5fe00640 10 client.9513 handle_command_reply: tid=0 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 client.9513 shutdown 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 -- 172.21.15.17:0/2002908301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd83c8fd0 msgr2=0x559fd83fca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd83c8fd0 0x559fd83fca50 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f6a70009610 tx=0x7f6a7005dda0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 -- 172.21.15.17:0/2002908301 shutdown_connections 2024-09-10T23:26:55.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x559fd83fdee0 0x559fd84238b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd83fd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd8412600 0x559fd83fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 --2- 172.21.15.17:0/2002908301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd83c8fd0 0x559fd83fca50 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 -- 172.21.15.17:0/2002908301 >> 172.21.15.17:0/2002908301 conn(0x559fd83cad20 msgr2=0x559fd83ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a5fe00640 0 client.9513 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:55.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 -- 172.21.15.17:0/2002908301 shutdown_connections 2024-09-10T23:26:55.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 1 -- 172.21.15.17:0/2002908301 wait complete. 2024-09-10T23:26:55.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.185+0000 7f6a890e1000 20 client.9513 trim_cache size 0 max 16384 2024-09-10T23:26:55.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.201+0000 7f6a890e1000 1 Processor -- start 2024-09-10T23:26:55.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.201+0000 7f6a890e1000 1 -- start start 2024-09-10T23:26:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd8484800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 0x559fd8484d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd8485280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6a801ffeb0 con 0x559fd8412f20 2024-09-10T23:26:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8006f530 con 0x559fd8412600 2024-09-10T23:26:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6a800af570 con 0x559fd83c8fd0 2024-09-10T23:26:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd8485280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd8485280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44374/0 (socket says 172.21.15.17:44374) 2024-09-10T23:26:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7f400640 1 -- 172.21.15.17:0/3324644785 learned_addr learned my addr 172.21.15.17:0/3324644785 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:55.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/3324644785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd8484800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7e000640 1 --2- 172.21.15.17:0/3324644785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 0x559fd8484d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7f400640 1 -- 172.21.15.17:0/3324644785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 msgr2=0x559fd8484800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7f400640 1 --2- 172.21.15.17:0/3324644785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd8484800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7f400640 1 -- 172.21.15.17:0/3324644785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 msgr2=0x559fd8484d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7f400640 1 --2- 172.21.15.17:0/3324644785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 0x559fd8484d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7f400640 1 -- 172.21.15.17:0/3324644785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fd8412d50 con 0x559fd8412f20 2024-09-10T23:26:55.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a7f400640 1 --2- 172.21.15.17:0/3324644785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd8485280 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009c80 tx=0x7f6a78019ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf515a15eec404a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a6aa00640 1 -- 172.21.15.17:0/3324644785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a780b2040 con 0x559fd8412f20 2024-09-10T23:26:55.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a6aa00640 1 -- 172.21.15.17:0/3324644785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a78004a50 con 0x559fd8412f20 2024-09-10T23:26:55.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a6aa00640 1 -- 172.21.15.17:0/3324644785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a78003980 con 0x559fd8412f20 2024-09-10T23:26:55.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 -- 172.21.15.17:0/3324644785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 msgr2=0x559fd8485280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3324644785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd8485280 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009c80 tx=0x7f6a78019ad0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 -- 172.21.15.17:0/3324644785 shutdown_connections 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3324644785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412f20 0x559fd8485280 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3324644785 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412600 0x559fd8484d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3324644785 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd8484800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 -- 172.21.15.17:0/3324644785 >> 172.21.15.17:0/3324644785 conn(0x559fd83cad20 msgr2=0x559fd83c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 -- 172.21.15.17:0/3324644785 shutdown_connections 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 -- 172.21.15.17:0/3324644785 wait complete. 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 -- start start 2024-09-10T23:26:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.205+0000 7f6a890e1000 1 Processor -- start 2024-09-10T23:26:55.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd8488570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412600 0x559fd8488ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd8488ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559fd81a62e0 con 0x559fd8412600 2024-09-10T23:26:55.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559fd83cdd40 con 0x559fd8412f20 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559fd83cb100 con 0x559fd83c8fd0 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 10 client.0 _ll_register_callbacks cb 0x7f6a70009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412600 0x559fd8488ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412600 0x559fd8488ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44382/0 (socket says 172.21.15.17:44382) 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7e000640 1 -- 172.21.15.17:0/3623118459 learned_addr learned my addr 172.21.15.17:0/3623118459 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd8488570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7f400640 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd8488ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7e000640 1 -- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 msgr2=0x559fd8488570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7e000640 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd8488570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7e000640 1 -- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 msgr2=0x559fd8488ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7e000640 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd8488ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7e000640 1 -- 172.21.15.17:0/3623118459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fd826c660 con 0x559fd8412600 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd8488570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7f400640 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd8488ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7e000640 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412600 0x559fd8488ab0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c011ca0 tx=0x7f6a6c005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a5d0f585dcb268 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 1 -- 172.21.15.17:0/3623118459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c015040 con 0x559fd8412600 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- 172.21.15.17:0/3623118459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a78004a50 con 0x559fd8412600 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 1 -- 172.21.15.17:0/3623118459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f6a6c01e810 con 0x559fd8412600 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 1 -- 172.21.15.17:0/3623118459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7f6a6c041050 con 0x559fd8412600 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 10 client.9519 fetch_fsmap learned FSMap version 112 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- 172.21.15.17:0/3623118459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x559fd81d9090 con 0x559fd8412600 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 1 -- 172.21.15.17:0/3623118459 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a78004a50 con 0x559fd8412600 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 1 -- 172.21.15.17:0/3623118459 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7f6a6c044020 con 0x559fd8412600 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 10 client.9519 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:26:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 10 client.9519 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 20 client.9519 populate_metadata read hostname 'smithi017' 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x559fd8444530 0x559fd8444910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 4 client.9519 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- 172.21.15.17:0/3623118459 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559fd821d590 con 0x559fd8444530 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x559fd8444530 0x559fd8444910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a7ea00640 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x559fd8444530 0x559fd8444910 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13908ee520e8d2ea server_cookie=9d4f71a82022811d in_seq=0 out_seq=0 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 10 client.9519 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 1 -- 172.21.15.17:0/3623118459 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x559fd821d590 con 0x559fd8444530 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 10 client.9519 handle_command_reply: tid=0 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 client.9519 shutdown 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- 172.21.15.17:0/3623118459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412600 msgr2=0x559fd8488ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412600 0x559fd8488ab0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c011ca0 tx=0x7f6a6c005d10 comp rx=0 tx=0).stop 2024-09-10T23:26:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- 172.21.15.17:0/3623118459 shutdown_connections 2024-09-10T23:26:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x559fd8444530 0x559fd8444910 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559fd8412f20 0x559fd8488ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559fd8412600 0x559fd8488ab0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 --2- 172.21.15.17:0/3623118459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559fd83c8fd0 0x559fd8488570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a5fe00640 0 client.9519 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:26:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- 172.21.15.17:0/3623118459 >> 172.21.15.17:0/3623118459 conn(0x559fd83cad20 msgr2=0x559fd83c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- 172.21.15.17:0/3623118459 shutdown_connections 2024-09-10T23:26:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 1 -- 172.21.15.17:0/3623118459 wait complete. 2024-09-10T23:26:55.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.209+0000 7f6a890e1000 20 client.9519 trim_cache size 0 max 16384 2024-09-10T23:26:55.221 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:26:55.221 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:26:55.221 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:26:55.221 INFO:teuthology.orchestra.run.smithi017.stdout: "ec9b90e9-9427-44eb-9e5b-ff67747f9b99": { 2024-09-10T23:26:55.221 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:26:55.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "ec9b90e9-9427-44eb-9e5b-ff67747f9b99", 2024-09-10T23:26:55.222 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive" 2024-09-10T23:26:55.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:55.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:26:55.222 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:26:55.222 INFO:teuthology.orchestra.run.smithi017.stdout: "ec9b90e9-9427-44eb-9e5b-ff67747f9b99": { 2024-09-10T23:26:55.222 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:26:46.765805+0000", 2024-09-10T23:26:55.222 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:26:55.222 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:26:55.222 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:26:55.223 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:26:55.223 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:26:55.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:55.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:26:55.223 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:26:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 -- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a600725e0 msgr2=0x7f6a60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a600725e0 0x7f6a60074aa0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c005fd0 tx=0x7f6a6c005e60 comp rx=0 tx=0).stop 2024-09-10T23:26:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 -- 172.21.15.17:0/152056757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b12e0 msgr2=0x7f6a800b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:26:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b12e0 0x7f6a800b0030 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000d750 tx=0x7f6a7000dc10 comp rx=0 tx=0).stop 2024-09-10T23:26:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 -- 172.21.15.17:0/152056757 shutdown_connections 2024-09-10T23:26:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6a600725e0 0x7f6a60074aa0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a8015be00 0x7f6a800cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a800b1740 0x7f6a8014b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 --2- 172.21.15.17:0/152056757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a800b12e0 0x7f6a800b0030 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:26:55.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 -- 172.21.15.17:0/152056757 >> 172.21.15.17:0/152056757 conn(0x7f6a8009a9f0 msgr2=0x7f6a80156160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:26:55.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 -- 172.21.15.17:0/152056757 shutdown_connections 2024-09-10T23:26:55.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:26:55.213+0000 7f6a85c00640 1 -- 172.21.15.17:0/152056757 wait complete. 2024-09-10T23:27:00.235 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T23:27:00.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-10T23:27:00.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.393+0000 7fe63d800640 1 -- 172.21.15.17:0/4016566692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c003fd0 msgr2=0x7fe61c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.393+0000 7fe63d800640 1 --2- 172.21.15.17:0/4016566692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c003fd0 0x7fe61c004810 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fe620009b30 tx=0x7fe62001d170 comp rx=0 tx=0).stop 2024-09-10T23:27:00.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.393+0000 7fe637400640 1 -- 172.21.15.17:0/4016566692 reap_dead start 2024-09-10T23:27:00.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.393+0000 7fe63d800640 1 -- 172.21.15.17:0/4016566692 shutdown_connections 2024-09-10T23:27:00.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.393+0000 7fe63d800640 1 -- 172.21.15.17:0/4016566692 >> 172.21.15.17:0/4016566692 conn(0x7fe6380b17a0 msgr2=0x7fe6380b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.393+0000 7fe63d800640 1 -- 172.21.15.17:0/4016566692 shutdown_connections 2024-09-10T23:27:00.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.393+0000 7fe63d800640 1 -- 172.21.15.17:0/4016566692 wait complete. 2024-09-10T23:27:00.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.393+0000 7fe63d800640 1 Processor -- start 2024-09-10T23:27:00.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe63d800640 1 -- start start 2024-09-10T23:27:00.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe63d800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe61c003fd0 0x7fe6381f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe63d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6381f7a80 0x7fe6380cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe63d800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6380cd340 0x7fe6380cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe63d800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe638072c50 con 0x7fe6381f7a80 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe63d800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe638072ad0 con 0x7fe6380cd340 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe63d800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe638072dd0 con 0x7fe61c003fd0 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6381f7a80 0x7fe6380cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6381f7a80 0x7fe6380cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39364/0 (socket says 172.21.15.17:39364) 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62fe00640 1 -- 172.21.15.17:0/294766902 learned_addr learned my addr 172.21.15.17:0/294766902 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe637400640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6380cd340 0x7fe6380cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe636a00640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe61c003fd0 0x7fe6381f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62fe00640 1 -- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe61c003fd0 msgr2=0x7fe6381f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62fe00640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe61c003fd0 0x7fe6381f4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62fe00640 1 -- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6380cd340 msgr2=0x7fe6380cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62fe00640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6380cd340 0x7fe6380cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62fe00640 1 -- 172.21.15.17:0/294766902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6380cef80 con 0x7fe6381f7a80 2024-09-10T23:27:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe636a00640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe61c003fd0 0x7fe6381f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe637400640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6380cd340 0x7fe6380cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62fe00640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6381f7a80 0x7fe6380cb2d0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fe620009b30 tx=0x7fe6200acd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62ea00640 1 -- 172.21.15.17:0/294766902 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6200b1040 con 0x7fe6381f7a80 2024-09-10T23:27:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62ea00640 1 -- 172.21.15.17:0/294766902 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6200ac400 con 0x7fe6381f7a80 2024-09-10T23:27:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe62ea00640 1 -- 172.21.15.17:0/294766902 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6200a5e60 con 0x7fe6381f7a80 2024-09-10T23:27:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe63d800640 1 -- 172.21.15.17:0/294766902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6381f4b70 con 0x7fe6381f7a80 2024-09-10T23:27:00.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.397+0000 7fe63d800640 1 -- 172.21.15.17:0/294766902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6381f5130 con 0x7fe6381f7a80 2024-09-10T23:27:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe62ea00640 1 -- 172.21.15.17:0/294766902 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe620005280 con 0x7fe6381f7a80 2024-09-10T23:27:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe62ea00640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6140725e0 0x7fe614074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe62ea00640 1 -- 172.21.15.17:0/294766902 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fe62012e600 con 0x7fe6381f7a80 2024-09-10T23:27:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe640c91000 1 Processor -- start 2024-09-10T23:27:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe640c91000 1 -- start start 2024-09-10T23:27:00.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6140725e0 0x7fe614074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6140725e0 0x7fe614074aa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe628001990 tx=0x7fe6280068b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe640c91000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe640c91000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 0x562c7f769680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe640c91000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f769bc0 0x562c7f769fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe640c91000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562c7f651cb0 con 0x562c7f7b31a0 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe640c91000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c7f567310 con 0x562c7f7b3ac0 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe640c91000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562c7f5c4b90 con 0x562c7f769bc0 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39366/0 (socket says 172.21.15.17:39366) 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 -- 172.21.15.17:0/1479975856 learned_addr learned my addr 172.21.15.17:0/1479975856 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 -- 172.21.15.17:0/1479975856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f769bc0 msgr2=0x562c7f769fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 --2- 172.21.15.17:0/1479975856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f769bc0 0x562c7f769fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe62fe00640 1 --2- 172.21.15.17:0/1479975856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 0x562c7f769680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 -- 172.21.15.17:0/1479975856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 msgr2=0x562c7f769680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 --2- 172.21.15.17:0/1479975856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 0x562c7f769680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 -- 172.21.15.17:0/1479975856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7f568c60 con 0x562c7f7b31a0 2024-09-10T23:27:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe62fe00640 1 --2- 172.21.15.17:0/1479975856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 0x562c7f769680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.401+0000 7fe636a00640 1 --2- 172.21.15.17:0/1479975856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7b3580 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fe628006ef0 tx=0x7fe628013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47ea005f88120a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe627400640 1 -- 172.21.15.17:0/1479975856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628022070 con 0x562c7f7b31a0 2024-09-10T23:27:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe627400640 1 -- 172.21.15.17:0/1479975856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe628012b40 con 0x562c7f7b31a0 2024-09-10T23:27:00.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe627400640 1 -- 172.21.15.17:0/1479975856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628016070 con 0x562c7f7b31a0 2024-09-10T23:27:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 -- 172.21.15.17:0/1479975856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 msgr2=0x562c7f7b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 --2- 172.21.15.17:0/1479975856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7b3580 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fe628006ef0 tx=0x7fe628013000 comp rx=0 tx=0).stop 2024-09-10T23:27:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 -- 172.21.15.17:0/1479975856 shutdown_connections 2024-09-10T23:27:00.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 --2- 172.21.15.17:0/1479975856 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f769bc0 0x562c7f769fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 --2- 172.21.15.17:0/1479975856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 0x562c7f769680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 --2- 172.21.15.17:0/1479975856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7b3580 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 -- 172.21.15.17:0/1479975856 >> 172.21.15.17:0/1479975856 conn(0x562c7f76fd20 msgr2=0x562c7f767f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 -- 172.21.15.17:0/1479975856 shutdown_connections 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 -- 172.21.15.17:0/1479975856 wait complete. 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 -- start start 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 Processor -- start 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 0x562c7f7ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7baa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 0x562c7f7bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562c7f5b7dd0 con 0x562c7f7b31a0 2024-09-10T23:27:00.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c7f5b3fc0 con 0x562c7f769bc0 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562c7f5594b0 con 0x562c7f7b3ac0 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe640c91000 10 client.0 _ll_register_callbacks cb 0x562c7f5377d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7baa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7baa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39380/0 (socket says 172.21.15.17:39380) 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe62fe00640 1 -- 172.21.15.17:0/4155972683 learned_addr learned my addr 172.21.15.17:0/4155972683 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe637400640 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 0x562c7f7bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe636a00640 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 0x562c7f7ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe62fe00640 1 -- 172.21.15.17:0/4155972683 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 msgr2=0x562c7f7bafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe62fe00640 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 0x562c7f7bafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe62fe00640 1 -- 172.21.15.17:0/4155972683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 msgr2=0x562c7f7ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe62fe00640 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 0x562c7f7ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe62fe00640 1 -- 172.21.15.17:0/4155972683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7f5521f0 con 0x562c7f7b31a0 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe62fe00640 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7baa70 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fe620009a80 tx=0x7fe6200f5350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ac83c91950530b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe61be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:27:00.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe61be00640 1 -- 172.21.15.17:0/4155972683 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620102620 con 0x562c7f7b31a0 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.405+0000 7fe61be00640 1 -- 172.21.15.17:0/4155972683 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fe62011e1b0 con 0x562c7f7b31a0 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 -- 172.21.15.17:0/4155972683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c7f54c330 con 0x562c7f7b31a0 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe61be00640 1 -- 172.21.15.17:0/4155972683 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fe6200f9ab0 con 0x562c7f7b31a0 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 10 client.9531 fetch_fsmap learned FSMap version 112 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 -- 172.21.15.17:0/4155972683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x562c7f538fa0 con 0x562c7f7b31a0 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe61be00640 1 -- 172.21.15.17:0/4155972683 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562c7f54c330 con 0x562c7f7b31a0 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe61be00640 1 -- 172.21.15.17:0/4155972683 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fe6200f8610 con 0x562c7f7b31a0 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 10 client.9531 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 10 client.9531 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 20 client.9531 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562c7f7c2900 0x562c7f7c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 4 client.9531 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 -- 172.21.15.17:0/4155972683 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c7f5c6ae0 con 0x562c7f7c2900 2024-09-10T23:27:00.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe636a00640 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562c7f7c2900 0x562c7f7c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe61be00640 10 client.9531 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe636a00640 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562c7f7c2900 0x562c7f7c4cf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8fb54afb4ffa7e0 server_cookie=f1883c08881d7dd8 in_seq=0 out_seq=0 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe61be00640 1 -- 172.21.15.17:0/4155972683 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c7f5c6ae0 con 0x562c7f7c2900 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe61be00640 10 client.9531 handle_command_reply: tid=0 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 client.9531 shutdown 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 -- 172.21.15.17:0/4155972683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 msgr2=0x562c7f7baa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7baa70 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fe620009a80 tx=0x7fe6200f5350 comp rx=0 tx=0).stop 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 -- 172.21.15.17:0/4155972683 shutdown_connections 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562c7f7c2900 0x562c7f7c4cf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 0x562c7f7bafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7baa70 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe61be00640 0 client.9531 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:27:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 --2- 172.21.15.17:0/4155972683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 0x562c7f7ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 -- 172.21.15.17:0/4155972683 >> 172.21.15.17:0/4155972683 conn(0x562c7f76fd20 msgr2=0x562c7f767f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 -- 172.21.15.17:0/4155972683 shutdown_connections 2024-09-10T23:27:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 1 -- 172.21.15.17:0/4155972683 wait complete. 2024-09-10T23:27:00.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.409+0000 7fe640c91000 20 client.9531 trim_cache size 0 max 16384 2024-09-10T23:27:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 Processor -- start 2024-09-10T23:27:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 -- start start 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 0x562c7f769070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 0x562c7f7bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe638201f50 con 0x562c7f7b31a0 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe638201050 con 0x562c7f769bc0 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6381f71d0 con 0x562c7f7b3ac0 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7695b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39394/0 (socket says 172.21.15.17:39394) 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe62fe00640 1 -- 172.21.15.17:0/2042862423 learned_addr learned my addr 172.21.15.17:0/2042862423 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe636a00640 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 0x562c7f769070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe637400640 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 0x562c7f7bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe62fe00640 1 -- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 msgr2=0x562c7f7bd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe62fe00640 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 0x562c7f7bd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe62fe00640 1 -- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 msgr2=0x562c7f769070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe62fe00640 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 0x562c7f769070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe62fe00640 1 -- 172.21.15.17:0/2042862423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7f611660 con 0x562c7f7b31a0 2024-09-10T23:27:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe636a00640 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 0x562c7f769070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe637400640 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 0x562c7f7bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe62fe00640 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7695b0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fe6200f90b0 tx=0x7fe6200f8b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837b98f2c100a002 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe626a00640 1 -- 172.21.15.17:0/2042862423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6201021f0 con 0x562c7f7b31a0 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe626a00640 1 -- 172.21.15.17:0/2042862423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe620102040 con 0x562c7f7b31a0 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe626a00640 1 -- 172.21.15.17:0/2042862423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620102620 con 0x562c7f7b31a0 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 -- 172.21.15.17:0/2042862423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 msgr2=0x562c7f7695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7695b0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fe6200f90b0 tx=0x7fe6200f8b20 comp rx=0 tx=0).stop 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 -- 172.21.15.17:0/2042862423 shutdown_connections 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f7b3ac0 0x562c7f7bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7695b0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 --2- 172.21.15.17:0/2042862423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f769bc0 0x562c7f769070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 -- 172.21.15.17:0/2042862423 >> 172.21.15.17:0/2042862423 conn(0x562c7f76fd20 msgr2=0x562c7f768960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 -- 172.21.15.17:0/2042862423 shutdown_connections 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.429+0000 7fe640c91000 1 -- 172.21.15.17:0/2042862423 wait complete. 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 -- start start 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 Processor -- start 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f769bc0 0x562c7f7bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7c0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 0x562c7f7e5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562c7f772d40 con 0x562c7f7b31a0 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562c7f770100 con 0x562c7f7b3ac0 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562c7f5aeec0 con 0x562c7f769bc0 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 10 client.0 _ll_register_callbacks cb 0x7fe620009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7c0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39398/0 (socket says 172.21.15.17:39398) 2024-09-10T23:27:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe62fe00640 1 -- 172.21.15.17:0/89773423 learned_addr learned my addr 172.21.15.17:0/89773423 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe636a00640 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f769bc0 0x562c7f7bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe637400640 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 0x562c7f7e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe62fe00640 1 -- 172.21.15.17:0/89773423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f769bc0 msgr2=0x562c7f7bffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe62fe00640 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f769bc0 0x562c7f7bffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe62fe00640 1 -- 172.21.15.17:0/89773423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 msgr2=0x562c7f7e5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe62fe00640 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 0x562c7f7e5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe62fe00640 1 -- 172.21.15.17:0/89773423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7f57e090 con 0x562c7f7b31a0 2024-09-10T23:27:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe62fe00640 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7c0500 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fe6200f53c0 tx=0x7fe6201026d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135f102c3ec1c7e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe61be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:27:00.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe61be00640 1 -- 172.21.15.17:0/89773423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6201021f0 con 0x562c7f7b31a0 2024-09-10T23:27:00.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe61be00640 1 -- 172.21.15.17:0/89773423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fe62012e0b0 con 0x562c7f7b31a0 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 -- 172.21.15.17:0/89773423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe620102040 con 0x562c7f7b31a0 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe61be00640 1 -- 172.21.15.17:0/89773423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) ==== 24+0+0 (secure 0 0 0) 0x7fe6200fde90 con 0x562c7f7b31a0 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 10 client.9537 fetch_fsmap learned FSMap version 112 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 -- 172.21.15.17:0/89773423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) -- 0x562c7f54a5f0 con 0x562c7f7b31a0 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe61be00640 1 -- 172.21.15.17:0/89773423 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe620102040 con 0x562c7f7b31a0 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe61be00640 1 -- 172.21.15.17:0/89773423 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 112) ==== 3502+0+0 (secure 0 0 0) 0x7fe620100090 con 0x562c7f7b31a0 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 10 client.9537 fetch_fsmap finished waiting for FSMap version 112 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 10 client.9537 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 20 client.9537 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562c7f7e5c00 0x562c7f828640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 4 client.9537 mds_command: new command op to 9201 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe640c91000 1 -- 172.21.15.17:0/89773423 --> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562c7f5c2590 con 0x562c7f7e5c00 2024-09-10T23:27:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.433+0000 7fe636a00640 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562c7f7e5c00 0x562c7f828640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe636a00640 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562c7f7e5c00 0x562c7f828640 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70b89fd68f2ab35f server_cookie=e95713d102536ee6 in_seq=0 out_seq=0 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe61be00640 10 client.9537 ms_handle_connect on v2:172.21.15.17:6833/1449354346 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe61be00640 1 -- 172.21.15.17:0/89773423 <== mds.0 v2:172.21.15.17:6833/1449354346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+397 (crc 0 0 0) 0x562c7f5c2590 con 0x562c7f7e5c00 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe61be00640 10 client.9537 handle_command_reply: tid=0 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 client.9537 shutdown 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 -- 172.21.15.17:0/89773423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 msgr2=0x562c7f7c0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7c0500 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fe6200f53c0 tx=0x7fe6201026d0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 -- 172.21.15.17:0/89773423 shutdown_connections 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.17:6833/1449354346,v1:172.21.15.17:6835/1449354346] conn(0x562c7f7e5c00 0x562c7f828640 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562c7f7b3ac0 0x562c7f7e5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c7f7b31a0 0x562c7f7c0500 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe61be00640 0 client.9537 ms_handle_reset on v2:172.21.15.17:6833/1449354346 2024-09-10T23:27:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 --2- 172.21.15.17:0/89773423 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562c7f769bc0 0x562c7f7bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 -- 172.21.15.17:0/89773423 >> 172.21.15.17:0/89773423 conn(0x562c7f76fd20 msgr2=0x562c7f769180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 -- 172.21.15.17:0/89773423 shutdown_connections 2024-09-10T23:27:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 1 -- 172.21.15.17:0/89773423 wait complete. 2024-09-10T23:27:00.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe640c91000 20 client.9537 trim_cache size 0 max 16384 2024-09-10T23:27:00.445 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:27:00.445 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:27:00.445 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:27:00.445 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout: "ec9b90e9-9427-44eb-9e5b-ff67747f9b99": { 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:26:46.765805+0000", 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:00.446 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:27:00.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 -- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6140725e0 msgr2=0x7fe614074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6140725e0 0x7fe614074aa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe628001990 tx=0x7fe6280068b0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 -- 172.21.15.17:0/294766902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6381f7a80 msgr2=0x7fe6380cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6381f7a80 0x7fe6380cb2d0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fe620009b30 tx=0x7fe6200acd20 comp rx=0 tx=0).stop 2024-09-10T23:27:00.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 -- 172.21.15.17:0/294766902 shutdown_connections 2024-09-10T23:27:00.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6140725e0 0x7fe614074aa0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6380cd340 0x7fe6380cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6381f7a80 0x7fe6380cb2d0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 --2- 172.21.15.17:0/294766902 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe61c003fd0 0x7fe6381f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 -- 172.21.15.17:0/294766902 >> 172.21.15.17:0/294766902 conn(0x7fe6380b17a0 msgr2=0x7fe63806e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 -- 172.21.15.17:0/294766902 shutdown_connections 2024-09-10T23:27:00.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.437+0000 7fe63d800640 1 -- 172.21.15.17:0/294766902 wait complete. 2024-09-10T23:27:00.460 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:27:00.460 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:00.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.601+0000 7f2a05000640 1 -- 172.21.15.17:0/2990370975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 msgr2=0x7f2a000b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.601+0000 7f2a05000640 1 --2- 172.21.15.17:0/2990370975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 0x7f2a000b37f0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009900 tx=0x7f29e801c850 comp rx=0 tx=0).stop 2024-09-10T23:27:00.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.601+0000 7f2a05000640 1 -- 172.21.15.17:0/2990370975 shutdown_connections 2024-09-10T23:27:00.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.601+0000 7f2a05000640 1 --2- 172.21.15.17:0/2990370975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 0x7f2a000b37f0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.601+0000 7f2a05000640 1 -- 172.21.15.17:0/2990370975 >> 172.21.15.17:0/2990370975 conn(0x7f2a0006cfc0 msgr2=0x7f2a0006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.601+0000 7f2a05000640 1 -- 172.21.15.17:0/2990370975 shutdown_connections 2024-09-10T23:27:00.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.601+0000 7f2a05000640 1 -- 172.21.15.17:0/2990370975 wait complete. 2024-09-10T23:27:00.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 Processor -- start 2024-09-10T23:27:00.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 -- start start 2024-09-10T23:27:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 0x7f2a00148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a000cf4f0 0x7f2a001372f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a000cff20 0x7f2a0015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0016a0f0 con 0x7f2a000b48f0 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00169f70 con 0x7f2a000cf4f0 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0016a270 con 0x7f2a000cff20 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 0x7f2a00148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 0x7f2a00148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39430/0 (socket says 172.21.15.17:39430) 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fde00640 1 -- 172.21.15.17:0/3679650565 learned_addr learned my addr 172.21.15.17:0/3679650565 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29f7e00640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a000cf4f0 0x7f2a001372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fe800640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a000cff20 0x7f2a0015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fde00640 1 -- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a000cff20 msgr2=0x7f2a0015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fde00640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a000cff20 0x7f2a0015ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fde00640 1 -- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a000cf4f0 msgr2=0x7f2a001372f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fde00640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a000cf4f0 0x7f2a001372f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fde00640 1 -- 172.21.15.17:0/3679650565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a00147190 con 0x7f2a000b48f0 2024-09-10T23:27:00.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29fde00640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 0x7f2a00148660 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c4b0 tx=0x7f29f000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29f6000640 1 -- 172.21.15.17:0/3679650565 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00052d0 con 0x7f2a000b48f0 2024-09-10T23:27:00.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29f6000640 1 -- 172.21.15.17:0/3679650565 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29f0005470 con 0x7f2a000b48f0 2024-09-10T23:27:00.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f29f6000640 1 -- 172.21.15.17:0/3679650565 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0012870 con 0x7f2a000b48f0 2024-09-10T23:27:00.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a00147470 con 0x7f2a000b48f0 2024-09-10T23:27:00.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.605+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a00147a30 con 0x7f2a000b48f0 2024-09-10T23:27:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.609+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a000b37f0 con 0x7f2a000b48f0 2024-09-10T23:27:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.609+0000 7f29f6000640 1 -- 172.21.15.17:0/3679650565 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f29f0003600 con 0x7f2a000b48f0 2024-09-10T23:27:00.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.609+0000 7f29f6000640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29dc0725e0 0x7f29dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:00.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.609+0000 7f29f6000640 1 -- 172.21.15.17:0/3679650565 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f29f0092e60 con 0x7f2a000b48f0 2024-09-10T23:27:00.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.609+0000 7f29f7e00640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29dc0725e0 0x7f29dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.613+0000 7f29f7e00640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29dc0725e0 0x7f29dc074aa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f29e80af000 tx=0x7f29e801b090 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:00.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.613+0000 7f29f6000640 1 -- 172.21.15.17:0/3679650565 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f29f005e3a0 con 0x7f2a000b48f0 2024-09-10T23:27:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a000b4680 con 0x7f2a000b48f0 2024-09-10T23:27:00.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f29f6000640 1 -- 172.21.15.17:0/3679650565 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f29f005dca0 con 0x7f2a000b48f0 2024-09-10T23:27:00.830 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:00.830 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:27:00.830 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:27:00.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29dc0725e0 msgr2=0x7f29dc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29dc0725e0 0x7f29dc074aa0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f29e80af000 tx=0x7f29e801b090 comp rx=0 tx=0).stop 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 msgr2=0x7f2a00148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 0x7f2a00148660 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c4b0 tx=0x7f29f000c970 comp rx=0 tx=0).stop 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 shutdown_connections 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f29dc0725e0 0x7f29dc074aa0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a000cff20 0x7f2a0015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a000cf4f0 0x7f2a001372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 --2- 172.21.15.17:0/3679650565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a000b48f0 0x7f2a00148660 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.825+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 >> 172.21.15.17:0/3679650565 conn(0x7f2a0006cfc0 msgr2=0x7f2a0006e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.829+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 shutdown_connections 2024-09-10T23:27:00.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.829+0000 7f2a05000640 1 -- 172.21.15.17:0/3679650565 wait complete. 2024-09-10T23:27:00.851 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:27:00.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:27:00.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 -- 172.21.15.17:0/2374254131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb4070ad0 msgr2=0x7f5fb415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 --2- 172.21.15.17:0/2374254131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb4070ad0 0x7f5fb415f060 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40b7de0 tx=0x7f5fa401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 -- 172.21.15.17:0/2374254131 shutdown_connections 2024-09-10T23:27:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 --2- 172.21.15.17:0/2374254131 >> v2:172.21.15.77:3300/0 conn(0x7f5fb40cf320 0x7f5fb40cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 --2- 172.21.15.17:0/2374254131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb4070ad0 0x7f5fb415f060 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 -- 172.21.15.17:0/2374254131 >> 172.21.15.17:0/2374254131 conn(0x7f5fb40d1d60 msgr2=0x7f5fb40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 -- 172.21.15.17:0/2374254131 shutdown_connections 2024-09-10T23:27:00.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 -- 172.21.15.17:0/2374254131 wait complete. 2024-09-10T23:27:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 Processor -- start 2024-09-10T23:27:00.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.993+0000 7f5fbaa00640 1 -- start start 2024-09-10T23:27:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fbaa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fb4070ad0 0x7f5fb40b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fbaa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40cf320 0x7f5fb4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fbaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40d1830 0x7f5fb40cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fbaa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb4169320 con 0x7f5fb40d1830 2024-09-10T23:27:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fbaa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb41691a0 con 0x7f5fb40cf320 2024-09-10T23:27:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fbaa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb41694a0 con 0x7f5fb4070ad0 2024-09-10T23:27:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40d1830 0x7f5fb40cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40d1830 0x7f5fb40cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39448/0 (socket says 172.21.15.17:39448) 2024-09-10T23:27:01.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb8a00640 1 -- 172.21.15.17:0/725648414 learned_addr learned my addr 172.21.15.17:0/725648414 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:01.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb3400640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40cf320 0x7f5fb4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb3e00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fb4070ad0 0x7f5fb40b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb8a00640 1 -- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fb4070ad0 msgr2=0x7f5fb40b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb8a00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fb4070ad0 0x7f5fb40b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb8a00640 1 -- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40cf320 msgr2=0x7f5fb4151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb8a00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40cf320 0x7f5fb4151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb8a00640 1 -- 172.21.15.17:0/725648414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb415ab70 con 0x7f5fb40d1830 2024-09-10T23:27:01.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fb8a00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40d1830 0x7f5fb40cded0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00ea20 tx=0x7f5fac00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fabe00640 1 -- 172.21.15.17:0/725648414 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00cde0 con 0x7f5fb40d1830 2024-09-10T23:27:01.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fabe00640 1 -- 172.21.15.17:0/725648414 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fac004c40 con 0x7f5fb40d1830 2024-09-10T23:27:01.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fabe00640 1 -- 172.21.15.17:0/725648414 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac005280 con 0x7f5fb40d1830 2024-09-10T23:27:01.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb415ae50 con 0x7f5fb40d1830 2024-09-10T23:27:01.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb415b410 con 0x7f5fb40d1830 2024-09-10T23:27:01.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb415f060 con 0x7f5fb40d1830 2024-09-10T23:27:01.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:00.997+0000 7f5fabe00640 1 -- 172.21.15.17:0/725648414 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5fac00f040 con 0x7f5fb40d1830 2024-09-10T23:27:01.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.001+0000 7f5fabe00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f940725e0 0x7f5f94074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.001+0000 7f5fabe00640 1 -- 172.21.15.17:0/725648414 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f5fac093a40 con 0x7f5fb40d1830 2024-09-10T23:27:01.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.001+0000 7f5fb3e00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f940725e0 0x7f5f94074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.001+0000 7f5fb3e00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f940725e0 0x7f5f94074aa0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40af000 tx=0x7f5fa401b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.005+0000 7f5fabe00640 1 -- 172.21.15.17:0/725648414 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5fac016030 con 0x7f5fb40d1830 2024-09-10T23:27:01.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.237+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5fb409fde0 con 0x7f5fb40d1830 2024-09-10T23:27:01.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.237+0000 7f5fabe00640 1 -- 172.21.15.17:0/725648414 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1619 (secure 0 0 0) 0x7f5fac05e930 con 0x7f5fb40d1830 2024-09-10T23:27:01.244 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:01.244 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":710,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":155,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078434219,"bytes_used":2689286144,"bytes_avail":770404827136,"bytes_total":773094113280,"write_bytes_sec":4088575,"read_op_per_sec":0,"write_op_per_sec":11},"fsmap":{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9201}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-10T23:26:58.457659+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:27:01.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f940725e0 msgr2=0x7f5f94074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f940725e0 0x7f5f94074aa0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40af000 tx=0x7f5fa401b100 comp rx=0 tx=0).stop 2024-09-10T23:27:01.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40d1830 msgr2=0x7f5fb40cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40d1830 0x7f5fb40cded0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00ea20 tx=0x7f5fac00eee0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 shutdown_connections 2024-09-10T23:27:01.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f940725e0 0x7f5f94074aa0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40d1830 0x7f5fb40cded0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fb40cf320 0x7f5fb4151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 --2- 172.21.15.17:0/725648414 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fb4070ad0 0x7f5fb40b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 >> 172.21.15.17:0/725648414 conn(0x7f5fb40d1d60 msgr2=0x7f5fb40b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 shutdown_connections 2024-09-10T23:27:01.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.241+0000 7f5fbaa00640 1 -- 172.21.15.17:0/725648414 wait complete. 2024-09-10T23:27:01.265 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:27:01.265 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:27:01.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:27:01.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:27:01.453 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:27:01.454 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:27:01.454 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:27:01.454 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:27:01.464 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:27:01.464 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:27:01.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:27:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.709+0000 7f6b52c00640 1 -- 172.21.15.17:0/1503910778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 msgr2=0x7f6b4c0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.709+0000 7f6b52c00640 1 --2- 172.21.15.17:0/1503910778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 0x7f6b4c0691b0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c072f30 tx=0x7f6b3c01c570 comp rx=0 tx=0).stop 2024-09-10T23:27:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.709+0000 7f6b52c00640 1 -- 172.21.15.17:0/1503910778 shutdown_connections 2024-09-10T23:27:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.709+0000 7f6b52c00640 1 --2- 172.21.15.17:0/1503910778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b4c06e110 0x7f6b4c0ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.709+0000 7f6b52c00640 1 --2- 172.21.15.17:0/1503910778 >> v2:172.21.15.77:3300/0 conn(0x7f6b4c0cf000 0x7f6b4c06dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.709+0000 7f6b52c00640 1 --2- 172.21.15.17:0/1503910778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 0x7f6b4c0691b0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.709+0000 7f6b52c00640 1 -- 172.21.15.17:0/1503910778 >> 172.21.15.17:0/1503910778 conn(0x7f6b4c072f80 msgr2=0x7f6b4c073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.709+0000 7f6b52c00640 1 -- 172.21.15.17:0/1503910778 shutdown_connections 2024-09-10T23:27:01.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.709+0000 7f6b52c00640 1 -- 172.21.15.17:0/1503910778 wait complete. 2024-09-10T23:27:01.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 Processor -- start 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 -- start start 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4c06e110 0x7f6b4c14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b4c0cf000 0x7f6b4c159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 0x7f6b4c14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c070740 con 0x7f6b4c15ab90 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c0705c0 con 0x7f6b4c06e110 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4c0708c0 con 0x7f6b4c0cf000 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b50c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 0x7f6b4c14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b50c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 0x7f6b4c14ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39464/0 (socket says 172.21.15.17:39464) 2024-09-10T23:27:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b50c00640 1 -- 172.21.15.17:0/874498017 learned_addr learned my addr 172.21.15.17:0/874498017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b4be00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4c06e110 0x7f6b4c14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b43e00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b4c0cf000 0x7f6b4c159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b50c00640 1 -- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b4c0cf000 msgr2=0x7f6b4c159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b50c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b4c0cf000 0x7f6b4c159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b50c00640 1 -- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4c06e110 msgr2=0x7f6b4c14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b50c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4c06e110 0x7f6b4c14c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b50c00640 1 -- 172.21.15.17:0/874498017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c0b39f0 con 0x7f6b4c15ab90 2024-09-10T23:27:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b50c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 0x7f6b4c14ca30 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400e9c0 tx=0x7f6b4400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b48c00640 1 -- 172.21.15.17:0/874498017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400cd80 con 0x7f6b4c15ab90 2024-09-10T23:27:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b48c00640 1 -- 172.21.15.17:0/874498017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b44004b30 con 0x7f6b4c15ab90 2024-09-10T23:27:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b48c00640 1 -- 172.21.15.17:0/874498017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44005020 con 0x7f6b4c15ab90 2024-09-10T23:27:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c14ede0 con 0x7f6b4c15ab90 2024-09-10T23:27:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.713+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c158a40 con 0x7f6b4c15ab90 2024-09-10T23:27:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.717+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4c06dbd0 con 0x7f6b4c15ab90 2024-09-10T23:27:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.717+0000 7f6b48c00640 1 -- 172.21.15.17:0/874498017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6b4400f040 con 0x7f6b4c15ab90 2024-09-10T23:27:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.717+0000 7f6b48c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b280725e0 0x7f6b28074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.717+0000 7f6b48c00640 1 -- 172.21.15.17:0/874498017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f6b44093910 con 0x7f6b4c15ab90 2024-09-10T23:27:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.717+0000 7f6b4be00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b280725e0 0x7f6b28074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.717+0000 7f6b4be00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b280725e0 0x7f6b28074aa0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0af000 tx=0x7f6b3c01adb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.721+0000 7f6b48c00640 1 -- 172.21.15.17:0/874498017 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6b44016030 con 0x7f6b4c15ab90 2024-09-10T23:27:01.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.905+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6b4c0754e0 con 0x7f6b4c15ab90 2024-09-10T23:27:01.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.905+0000 7f6b48c00640 1 -- 172.21.15.17:0/874498017 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v155) ==== 80+0+0 (secure 0 0 0) 0x7f6b4405e800 con 0x7f6b4c15ab90 2024-09-10T23:27:01.911 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:27:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b280725e0 msgr2=0x7f6b28074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b280725e0 0x7f6b28074aa0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c0af000 tx=0x7f6b3c01adb0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 msgr2=0x7f6b4c14ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 0x7f6b4c14ca30 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400e9c0 tx=0x7f6b4400ee80 comp rx=0 tx=0).stop 2024-09-10T23:27:01.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 shutdown_connections 2024-09-10T23:27:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6b280725e0 0x7f6b28074aa0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b4c15ab90 0x7f6b4c14ca30 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b4c0cf000 0x7f6b4c159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 --2- 172.21.15.17:0/874498017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b4c06e110 0x7f6b4c14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 >> 172.21.15.17:0/874498017 conn(0x7f6b4c072f80 msgr2=0x7f6b4c068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 shutdown_connections 2024-09-10T23:27:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:01.909+0000 7f6b52c00640 1 -- 172.21.15.17:0/874498017 wait complete. 2024-09-10T23:27:01.932 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:27:01.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:01.932 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:27:01.950 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[78156]: fuse finished with error 0 and tester_r 0 2024-09-10T23:27:02.202 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:27:02.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:02.203 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:27:02.313 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:27:02.314 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:27:02.314 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:27:02.324 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:27:02.324 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:27:02.324 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:27:02.324 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:27:02.333 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:27:02.333 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:27:02.333 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:27:02.334 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:27:02.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:27:02.374 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.517+0000 7f21fba00640 1 -- 172.21.15.17:0/3910738169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21f4070ad0 msgr2=0x7f21f415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.517+0000 7f21fba00640 1 --2- 172.21.15.17:0/3910738169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21f4070ad0 0x7f21f415f060 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009900 tx=0x7f21e401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.517+0000 7f21fba00640 1 -- 172.21.15.17:0/3910738169 shutdown_connections 2024-09-10T23:27:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.517+0000 7f21fba00640 1 --2- 172.21.15.17:0/3910738169 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21f40cf320 0x7f21f40cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.517+0000 7f21fba00640 1 --2- 172.21.15.17:0/3910738169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21f4070ad0 0x7f21f415f060 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.517+0000 7f21fba00640 1 -- 172.21.15.17:0/3910738169 >> 172.21.15.17:0/3910738169 conn(0x7f21f40d1d60 msgr2=0x7f21f40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.517+0000 7f21fba00640 1 -- 172.21.15.17:0/3910738169 shutdown_connections 2024-09-10T23:27:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.517+0000 7f21fba00640 1 -- 172.21.15.17:0/3910738169 wait complete. 2024-09-10T23:27:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 Processor -- start 2024-09-10T23:27:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 -- start start 2024-09-10T23:27:02.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21f4070ad0 0x7f21f414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21f40cf320 0x7f21f40cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21f40d1830 0x7f21f40ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f21f4169430 con 0x7f21f40cf320 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f21f41692b0 con 0x7f21f40d1830 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f21f41695b0 con 0x7f21f4070ad0 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21ebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21f40cf320 0x7f21f40cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21ebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21f40cf320 0x7f21f40cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39472/0 (socket says 172.21.15.17:39472) 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21ebe00640 1 -- 172.21.15.17:0/316212905 learned_addr learned my addr 172.21.15.17:0/316212905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21f9000640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21f4070ad0 0x7f21f414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21f9a00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21f40d1830 0x7f21f40ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21ebe00640 1 -- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21f4070ad0 msgr2=0x7f21f414cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:02.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21ebe00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21f4070ad0 0x7f21f414cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21ebe00640 1 -- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21f40d1830 msgr2=0x7f21f40ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21ebe00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21f40d1830 0x7f21f40ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21ebe00640 1 -- 172.21.15.17:0/316212905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f4156b70 con 0x7f21f40cf320 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21f9000640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21f4070ad0 0x7f21f414cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21ebe00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21f40cf320 0x7f21f40cded0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00c3c0 tx=0x7f21dc00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21f1600640 1 -- 172.21.15.17:0/316212905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0052d0 con 0x7f21f40cf320 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21f1600640 1 -- 172.21.15.17:0/316212905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21dc007020 con 0x7f21f40cf320 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f4156e50 con 0x7f21f40cf320 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21f1600640 1 -- 172.21.15.17:0/316212905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc007470 con 0x7f21f40cf320 2024-09-10T23:27:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.521+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f406e050 con 0x7f21f40cf320 2024-09-10T23:27:02.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.525+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f415f060 con 0x7f21f40cf320 2024-09-10T23:27:02.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.525+0000 7f21f1600640 1 -- 172.21.15.17:0/316212905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f21dc0067e0 con 0x7f21f40cf320 2024-09-10T23:27:02.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.525+0000 7f21f1600640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21d00725e0 0x7f21d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:02.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.525+0000 7f21f1600640 1 -- 172.21.15.17:0/316212905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f21dc0928c0 con 0x7f21f40cf320 2024-09-10T23:27:02.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.525+0000 7f21f9000640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21d00725e0 0x7f21d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.529+0000 7f21f9000640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21d00725e0 0x7f21d0074aa0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f21e40af000 tx=0x7f21e401b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:02.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.529+0000 7f21f1600640 1 -- 172.21.15.17:0/316212905 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f21dc05d720 con 0x7f21f40cf320 2024-09-10T23:27:02.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.741+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21f40b68d0 con 0x7f21f40cf320 2024-09-10T23:27:02.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.741+0000 7f21f1600640 1 -- 172.21.15.17:0/316212905 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f21dc062150 con 0x7f21f40cf320 2024-09-10T23:27:02.747 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:02.747 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:27:02.748 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21d00725e0 msgr2=0x7f21d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21d00725e0 0x7f21d0074aa0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f21e40af000 tx=0x7f21e401b120 comp rx=0 tx=0).stop 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21f40cf320 msgr2=0x7f21f40cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21f40cf320 0x7f21f40cded0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00c3c0 tx=0x7f21dc00c7c0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 shutdown_connections 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21d00725e0 0x7f21d0074aa0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21f40d1830 0x7f21f40ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21f40cf320 0x7f21f40cded0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 --2- 172.21.15.17:0/316212905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21f4070ad0 0x7f21f414cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 >> 172.21.15.17:0/316212905 conn(0x7f21f40d1d60 msgr2=0x7f21f40b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 shutdown_connections 2024-09-10T23:27:02.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.745+0000 7f21fba00640 1 -- 172.21.15.17:0/316212905 wait complete. 2024-09-10T23:27:02.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:02.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 -- 172.21.15.17:0/2572651545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d813dae0 msgr2=0x7f70d8073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:02.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 --2- 172.21.15.17:0/2572651545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d813dae0 0x7f70d8073bc0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009900 tx=0x7f70c801c7c0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 -- 172.21.15.17:0/2572651545 shutdown_connections 2024-09-10T23:27:02.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 --2- 172.21.15.17:0/2572651545 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70d815b8f0 0x7f70d80b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 --2- 172.21.15.17:0/2572651545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d813dae0 0x7f70d8073bc0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 -- 172.21.15.17:0/2572651545 >> 172.21.15.17:0/2572651545 conn(0x7f70d80691b0 msgr2=0x7f70d80695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:02.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 -- 172.21.15.17:0/2572651545 shutdown_connections 2024-09-10T23:27:02.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 -- 172.21.15.17:0/2572651545 wait complete. 2024-09-10T23:27:02.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 Processor -- start 2024-09-10T23:27:02.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 -- start start 2024-09-10T23:27:02.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70d8074100 0x7f70d81f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:02.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d813dae0 0x7f70d8159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d815b8f0 0x7f70d815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f70d8167b70 con 0x7f70d815b8f0 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f70d80b4df0 con 0x7f70d813dae0 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.913+0000 7f70dde00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f70d8167cf0 con 0x7f70d8074100 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d815b8f0 0x7f70d815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d815b8f0 0x7f70d815a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39500/0 (socket says 172.21.15.17:39500) 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d7400640 1 -- 172.21.15.17:0/2622496703 learned_addr learned my addr 172.21.15.17:0/2622496703 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d6a00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70d8074100 0x7f70d81f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70cfe00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d813dae0 0x7f70d8159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d7400640 1 -- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70d8074100 msgr2=0x7f70d81f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d7400640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70d8074100 0x7f70d81f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d7400640 1 -- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d813dae0 msgr2=0x7f70d8159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d7400640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d813dae0 0x7f70d8159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d7400640 1 -- 172.21.15.17:0/2622496703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d813ffc0 con 0x7f70d815b8f0 2024-09-10T23:27:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70cfe00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d813dae0 0x7f70d8159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70d7400640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d815b8f0 0x7f70d815a190 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f70d000e970 tx=0x7f70d000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70cf400640 1 -- 172.21.15.17:0/2622496703 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0004d30 con 0x7f70d815b8f0 2024-09-10T23:27:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70cf400640 1 -- 172.21.15.17:0/2622496703 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70d000cb20 con 0x7f70d815b8f0 2024-09-10T23:27:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d81fb200 con 0x7f70d815b8f0 2024-09-10T23:27:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70cf400640 1 -- 172.21.15.17:0/2622496703 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0005020 con 0x7f70d815b8f0 2024-09-10T23:27:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d81fb7c0 con 0x7f70d815b8f0 2024-09-10T23:27:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d8073bc0 con 0x7f70d815b8f0 2024-09-10T23:27:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.917+0000 7f70cf400640 1 -- 172.21.15.17:0/2622496703 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f70d000f040 con 0x7f70d815b8f0 2024-09-10T23:27:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.921+0000 7f70cf400640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70b40725e0 0x7f70b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.921+0000 7f70cf400640 1 -- 172.21.15.17:0/2622496703 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f70d00939c0 con 0x7f70d815b8f0 2024-09-10T23:27:02.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.921+0000 7f70d6a00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70b40725e0 0x7f70b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:02.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.921+0000 7f70d6a00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70b40725e0 0x7f70b4074aa0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f70c80af000 tx=0x7f70c801b000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:02.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:02.925+0000 7f70cf400640 1 -- 172.21.15.17:0/2622496703 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f70d0016030 con 0x7f70d815b8f0 2024-09-10T23:27:03.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70d80732c0 con 0x7f70d815b8f0 2024-09-10T23:27:03.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70cf400640 1 -- 172.21.15.17:0/2622496703 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f70d005e820 con 0x7f70d815b8f0 2024-09-10T23:27:03.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:03.137 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:27:03.138 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:27:03.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70b40725e0 msgr2=0x7f70b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70b40725e0 0x7f70b4074aa0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f70c80af000 tx=0x7f70c801b000 comp rx=0 tx=0).stop 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d815b8f0 msgr2=0x7f70d815a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d815b8f0 0x7f70d815a190 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f70d000e970 tx=0x7f70d000ee30 comp rx=0 tx=0).stop 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 shutdown_connections 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f70b40725e0 0x7f70b4074aa0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d815b8f0 0x7f70d815a190 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70d813dae0 0x7f70d8159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 --2- 172.21.15.17:0/2622496703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f70d8074100 0x7f70d81f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 >> 172.21.15.17:0/2622496703 conn(0x7f70d80691b0 msgr2=0x7f70d815ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 shutdown_connections 2024-09-10T23:27:03.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.133+0000 7f70dde00640 1 -- 172.21.15.17:0/2622496703 wait complete. 2024-09-10T23:27:03.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:27:03.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 -- 172.21.15.17:0/2149529796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50fc0cf4f0 msgr2=0x7f50fc0b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 --2- 172.21.15.17:0/2149529796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50fc0cf4f0 0x7f50fc0b37f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009840 tx=0x7f50ec01c740 comp rx=0 tx=0).stop 2024-09-10T23:27:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 -- 172.21.15.17:0/2149529796 shutdown_connections 2024-09-10T23:27:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 --2- 172.21.15.17:0/2149529796 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50fc0cff20 0x7f50fc0d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 --2- 172.21.15.17:0/2149529796 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50fc0cf4f0 0x7f50fc0b37f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 -- 172.21.15.17:0/2149529796 >> 172.21.15.17:0/2149529796 conn(0x7f50fc06cfc0 msgr2=0x7f50fc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 -- 172.21.15.17:0/2149529796 shutdown_connections 2024-09-10T23:27:03.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 -- 172.21.15.17:0/2149529796 wait complete. 2024-09-10T23:27:03.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 Processor -- start 2024-09-10T23:27:03.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.301+0000 7f5101200640 1 -- start start 2024-09-10T23:27:03.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f5101200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50fc0b48f0 0x7f50fc140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f5101200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50fc0cf4f0 0x7f50fc144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f5101200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50fc0cff20 0x7f50fc144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f5101200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc168b20 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f5101200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1689a0 con 0x7f50fc0cff20 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f5101200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f50fc168ca0 con 0x7f50fc0b48f0 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50fc0cf4f0 0x7f50fc144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50fc0cf4f0 0x7f50fc144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39502/0 (socket says 172.21.15.17:39502) 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f3e00640 1 -- 172.21.15.17:0/3260633569 learned_addr learned my addr 172.21.15.17:0/3260633569 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f9e00640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50fc0b48f0 0x7f50fc140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50fa800640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50fc0cff20 0x7f50fc144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f3e00640 1 -- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50fc0b48f0 msgr2=0x7f50fc140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f3e00640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50fc0b48f0 0x7f50fc140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f3e00640 1 -- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50fc0cff20 msgr2=0x7f50fc144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f3e00640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50fc0cff20 0x7f50fc144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f3e00640 1 -- 172.21.15.17:0/3260633569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc141400 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f3e00640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50fc0cf4f0 0x7f50fc144720 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f50e400c730 tx=0x7f50e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f2000640 1 -- 172.21.15.17:0/3260633569 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4016020 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f2000640 1 -- 172.21.15.17:0/3260633569 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50e400a8f0 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f50f2000640 1 -- 172.21.15.17:0/3260633569 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e400ad40 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50fc146bb0 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50fc147170 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.305+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50fc0b37f0 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.309+0000 7f50f2000640 1 -- 172.21.15.17:0/3260633569 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f50e401b400 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.309+0000 7f50f2000640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50d80725e0 0x7f50d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.309+0000 7f50f2000640 1 -- 172.21.15.17:0/3260633569 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f50e4093670 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.309+0000 7f50f9e00640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50d80725e0 0x7f50d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.309+0000 7f50f9e00640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50d80725e0 0x7f50d8074aa0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0af000 tx=0x7f50ec0b4040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.313+0000 7f50f2000640 1 -- 172.21.15.17:0/3260633569 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f50e4020020 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50fc0731a0 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f50f2000640 1 -- 172.21.15.17:0/3260633569 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16892 (secure 0 0 0) 0x7f50fc141400 con 0x7f50fc0cf4f0 2024-09-10T23:27:03.497 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:03.497 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":155,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:26:21.092685+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:26:17.207114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-10T23:26:18.463692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:27:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50d80725e0 msgr2=0x7f50d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50d80725e0 0x7f50d8074aa0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0af000 tx=0x7f50ec0b4040 comp rx=0 tx=0).stop 2024-09-10T23:27:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50fc0cf4f0 msgr2=0x7f50fc144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50fc0cf4f0 0x7f50fc144720 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f50e400c730 tx=0x7f50e400cbf0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 shutdown_connections 2024-09-10T23:27:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f50d80725e0 0x7f50d8074aa0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50fc0cff20 0x7f50fc144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50fc0cf4f0 0x7f50fc144720 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 --2- 172.21.15.17:0/3260633569 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50fc0b48f0 0x7f50fc140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 >> 172.21.15.17:0/3260633569 conn(0x7f50fc06cfc0 msgr2=0x7f50fc0726f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 shutdown_connections 2024-09-10T23:27:03.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.493+0000 7f5101200640 1 -- 172.21.15.17:0/3260633569 wait complete. 2024-09-10T23:27:03.518 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:27:03.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:03.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.661+0000 7f9dc7400640 1 -- 172.21.15.17:0/818246881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f350 msgr2=0x7f9dc00b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.661+0000 7f9dc7400640 1 --2- 172.21.15.17:0/818246881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f350 0x7f9dc00b3130 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009840 tx=0x7f9db401c790 comp rx=0 tx=0).stop 2024-09-10T23:27:03.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.661+0000 7f9dc7400640 1 -- 172.21.15.17:0/818246881 shutdown_connections 2024-09-10T23:27:03.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.661+0000 7f9dc7400640 1 --2- 172.21.15.17:0/818246881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f350 0x7f9dc00b3130 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.661+0000 7f9dc7400640 1 -- 172.21.15.17:0/818246881 >> 172.21.15.17:0/818246881 conn(0x7f9dc00d1d10 msgr2=0x7f9dc00d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.661+0000 7f9dc7400640 1 -- 172.21.15.17:0/818246881 shutdown_connections 2024-09-10T23:27:03.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.661+0000 7f9dc7400640 1 -- 172.21.15.17:0/818246881 wait complete. 2024-09-10T23:27:03.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.661+0000 7f9dc7400640 1 Processor -- start 2024-09-10T23:27:03.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.661+0000 7f9dc7400640 1 -- start start 2024-09-10T23:27:03.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc00cee30 0x7f9dc00cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc7400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc015f350 0x7f9dc00b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f730 0x7f9dc00b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc7400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0169fc0 con 0x7f9dc015f730 2024-09-10T23:27:03.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc7400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0169e40 con 0x7f9dc015f350 2024-09-10T23:27:03.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc7400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc016a140 con 0x7f9dc00cee30 2024-09-10T23:27:03.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f730 0x7f9dc00b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f730 0x7f9dc00b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39512/0 (socket says 172.21.15.17:39512) 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc5400640 1 -- 172.21.15.17:0/709135229 learned_addr learned my addr 172.21.15.17:0/709135229 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dbfe00640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc015f350 0x7f9dc00b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc4a00640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc00cee30 0x7f9dc00cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc5400640 1 -- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc00cee30 msgr2=0x7f9dc00cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc5400640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc00cee30 0x7f9dc00cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc5400640 1 -- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc015f350 msgr2=0x7f9dc00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc5400640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc015f350 0x7f9dc00b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc5400640 1 -- 172.21.15.17:0/709135229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc00726e0 con 0x7f9dc015f730 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc4a00640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc00cee30 0x7f9dc00cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dbfe00640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc015f350 0x7f9dc00b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc5400640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f730 0x7f9dc00b0640 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f9db800c7c0 tx=0x7f9db800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dbcc00640 1 -- 172.21.15.17:0/709135229 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8003b80 con 0x7f9dc015f730 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dbcc00640 1 -- 172.21.15.17:0/709135229 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9db8003d20 con 0x7f9dc015f730 2024-09-10T23:27:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc015e4d0 con 0x7f9dc015f730 2024-09-10T23:27:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dbcc00640 1 -- 172.21.15.17:0/709135229 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db800aab0 con 0x7f9dc015f730 2024-09-10T23:27:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc015bd00 con 0x7f9dc015f730 2024-09-10T23:27:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc00b3130 con 0x7f9dc015f730 2024-09-10T23:27:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.665+0000 7f9dbcc00640 1 -- 172.21.15.17:0/709135229 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9db800ac50 con 0x7f9dc015f730 2024-09-10T23:27:03.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.669+0000 7f9dbcc00640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9da00725e0 0x7f9da0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:03.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.669+0000 7f9dbcc00640 1 -- 172.21.15.17:0/709135229 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f9db80932b0 con 0x7f9dc015f730 2024-09-10T23:27:03.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.669+0000 7f9dc4a00640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9da00725e0 0x7f9da0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:03.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.669+0000 7f9dc4a00640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9da00725e0 0x7f9da0074aa0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9db40af000 tx=0x7f9db401afd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:03.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.673+0000 7f9dbcc00640 1 -- 172.21.15.17:0/709135229 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9db805e7f0 con 0x7f9dc015f730 2024-09-10T23:27:03.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.881+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dc015e9f0 con 0x7f9dc015f730 2024-09-10T23:27:03.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.881+0000 7f9dbcc00640 1 -- 172.21.15.17:0/709135229 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f9db805e0f0 con 0x7f9dc015f730 2024-09-10T23:27:03.887 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:03.888 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:27:03.888 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:27:03.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9da00725e0 msgr2=0x7f9da0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9da00725e0 0x7f9da0074aa0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9db40af000 tx=0x7f9db401afd0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f730 msgr2=0x7f9dc00b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f730 0x7f9dc00b0640 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f9db800c7c0 tx=0x7f9db800cc80 comp rx=0 tx=0).stop 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 shutdown_connections 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9da00725e0 0x7f9da0074aa0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc015f730 0x7f9dc00b0640 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dc015f350 0x7f9dc00b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 --2- 172.21.15.17:0/709135229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dc00cee30 0x7f9dc00cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 >> 172.21.15.17:0/709135229 conn(0x7f9dc00d1d10 msgr2=0x7f9dc00d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 shutdown_connections 2024-09-10T23:27:03.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:03.885+0000 7f9dc7400640 1 -- 172.21.15.17:0/709135229 wait complete. 2024-09-10T23:27:03.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.053+0000 7f6762800640 1 -- 172.21.15.17:0/983680035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67400053d0 msgr2=0x7f674000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.053+0000 7f6762800640 1 --2- 172.21.15.17:0/983680035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67400053d0 0x7f674000b9d0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f6754001dc0 tx=0x7f675401cb30 comp rx=0 tx=0).stop 2024-09-10T23:27:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.053+0000 7f6762800640 1 -- 172.21.15.17:0/983680035 shutdown_connections 2024-09-10T23:27:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.053+0000 7f6762800640 1 --2- 172.21.15.17:0/983680035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67400053d0 0x7f674000b9d0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.053+0000 7f6762800640 1 -- 172.21.15.17:0/983680035 >> 172.21.15.17:0/983680035 conn(0x7f675c0d0c40 msgr2=0x7f675c0d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.053+0000 7f6762800640 1 -- 172.21.15.17:0/983680035 shutdown_connections 2024-09-10T23:27:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.053+0000 7f6762800640 1 -- 172.21.15.17:0/983680035 wait complete. 2024-09-10T23:27:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.053+0000 7f6762800640 1 Processor -- start 2024-09-10T23:27:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.053+0000 7f6762800640 1 -- start start 2024-09-10T23:27:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6762800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400053d0 0x7f675c0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6762800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f675c1fb000 0x7f675c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6762800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f675c0c6670 0x7f675c0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6762800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f675c1603c0 con 0x7f675c0c6670 2024-09-10T23:27:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6762800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f675c160240 con 0x7f67400053d0 2024-09-10T23:27:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6762800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f675c160540 con 0x7f675c1fb000 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f675be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f675c0c6670 0x7f675c0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f675be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f675c0c6670 0x7f675c0b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39536/0 (socket says 172.21.15.17:39536) 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f675be00640 1 -- 172.21.15.17:0/2591876403 learned_addr learned my addr 172.21.15.17:0/2591876403 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f675be00640 1 -- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f675c1fb000 msgr2=0x7f675c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f675be00640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f675c1fb000 0x7f675c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f675be00640 1 -- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400053d0 msgr2=0x7f675c0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f675be00640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400053d0 0x7f675c0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f675be00640 1 -- 172.21.15.17:0/2591876403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675c0c8250 con 0x7f675c0c6670 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f675be00640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f675c0c6670 0x7f675c0b4f90 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f675401d3d0 tx=0x7f6754006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6753400640 1 -- 172.21.15.17:0/2591876403 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6754003980 con 0x7f675c0c6670 2024-09-10T23:27:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6753400640 1 -- 172.21.15.17:0/2591876403 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6754003c10 con 0x7f675c0c6670 2024-09-10T23:27:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6753400640 1 -- 172.21.15.17:0/2591876403 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67540060d0 con 0x7f675c0c6670 2024-09-10T23:27:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675c1fb490 con 0x7f675c0c6670 2024-09-10T23:27:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f675c1fba50 con 0x7f675c0c6670 2024-09-10T23:27:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.057+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f675c0ced50 con 0x7f675c0c6670 2024-09-10T23:27:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.061+0000 7f6753400640 1 -- 172.21.15.17:0/2591876403 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6754006270 con 0x7f675c0c6670 2024-09-10T23:27:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.061+0000 7f6753400640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67380725d0 0x7f6738074a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.061+0000 7f6753400640 1 -- 172.21.15.17:0/2591876403 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f675412e0d0 con 0x7f675c0c6670 2024-09-10T23:27:04.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.061+0000 7f675b400640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67380725d0 0x7f6738074a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.061+0000 7f675b400640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67380725d0 0x7f6738074a90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f674c001230 tx=0x7f674c001be0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:04.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.065+0000 7f6753400640 1 -- 172.21.15.17:0/2591876403 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f67540bf030 con 0x7f675c0c6670 2024-09-10T23:27:04.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.269+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f675c0b08e0 con 0x7f675c0c6670 2024-09-10T23:27:04.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.269+0000 7f6753400640 1 -- 172.21.15.17:0/2591876403 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5224 (secure 0 0 0) 0x7f6754016890 con 0x7f675c0c6670 2024-09-10T23:27:04.275 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:04.275 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":112,"btime":"2024-09-10T23:26:23:104643+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:26:19.498160+0000","modified":"2024-09-10T23:26:22.508026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9201":{"gid":9201,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1449354346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1449354346},{"type":"v1","addr":"172.21.15.17:6835","nonce":1449354346}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9201,"qdb_cluster":[9201]},"id":10}]} 2024-09-10T23:27:04.276 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 112 2024-09-10T23:27:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67380725d0 msgr2=0x7f6738074a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67380725d0 0x7f6738074a90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f674c001230 tx=0x7f674c001be0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f675c0c6670 msgr2=0x7f675c0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f675c0c6670 0x7f675c0b4f90 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f675401d3d0 tx=0x7f6754006d30 comp rx=0 tx=0).stop 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 shutdown_connections 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67380725d0 0x7f6738074a90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f675c0c6670 0x7f675c0b4f90 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f675c1fb000 0x7f675c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 --2- 172.21.15.17:0/2591876403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67400053d0 0x7f675c0c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 >> 172.21.15.17:0/2591876403 conn(0x7f675c0d0c40 msgr2=0x7f675c145210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 shutdown_connections 2024-09-10T23:27:04.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.273+0000 7f6762800640 1 -- 172.21.15.17:0/2591876403 wait complete. 2024-09-10T23:27:04.298 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:27:04.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 -- 172.21.15.17:0/3255666966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c0b3130 msgr2=0x7f643c166bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 --2- 172.21.15.17:0/3255666966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c0b3130 0x7f643c166bc0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f6434009bc0 tx=0x7f643401cb10 comp rx=0 tx=0).stop 2024-09-10T23:27:04.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 -- 172.21.15.17:0/3255666966 shutdown_connections 2024-09-10T23:27:04.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 --2- 172.21.15.17:0/3255666966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c0b3130 0x7f643c166bc0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 -- 172.21.15.17:0/3255666966 >> 172.21.15.17:0/3255666966 conn(0x7f643c0d1d10 msgr2=0x7f643c0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 -- 172.21.15.17:0/3255666966 shutdown_connections 2024-09-10T23:27:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 -- 172.21.15.17:0/3255666966 wait complete. 2024-09-10T23:27:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 Processor -- start 2024-09-10T23:27:04.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 -- start start 2024-09-10T23:27:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f643c0b3130 0x7f643c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c15f350 0x7f643c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f643c15f730 0x7f643c0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f643c169d70 con 0x7f643c15f350 2024-09-10T23:27:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f643c169bf0 con 0x7f643c15f730 2024-09-10T23:27:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6443800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f643c169ef0 con 0x7f643c0b3130 2024-09-10T23:27:04.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f643be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c15f350 0x7f643c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f643be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c15f350 0x7f643c15d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39568/0 (socket says 172.21.15.17:39568) 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f643be00640 1 -- 172.21.15.17:0/1009481509 learned_addr learned my addr 172.21.15.17:0/1009481509 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6440e00640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f643c0b3130 0x7f643c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.441+0000 7f6441800640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f643c15f730 0x7f643c0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f643be00640 1 -- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f643c0b3130 msgr2=0x7f643c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f643be00640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f643c0b3130 0x7f643c1570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f643be00640 1 -- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f643c15f730 msgr2=0x7f643c0b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f643be00640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f643c15f730 0x7f643c0b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f643be00640 1 -- 172.21.15.17:0/1009481509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c0cd250 con 0x7f643c15f350 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f643be00640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c15f350 0x7f643c15d600 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f642800c3c0 tx=0x7f642800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f6438c00640 1 -- 172.21.15.17:0/1009481509 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428017070 con 0x7f643c15f350 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f6438c00640 1 -- 172.21.15.17:0/1009481509 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64280053c0 con 0x7f643c15f350 2024-09-10T23:27:04.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f6438c00640 1 -- 172.21.15.17:0/1009481509 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428003860 con 0x7f643c15f350 2024-09-10T23:27:04.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c157600 con 0x7f643c15f350 2024-09-10T23:27:04.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c0b4f50 con 0x7f643c15f350 2024-09-10T23:27:04.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643c0ce720 con 0x7f643c15f350 2024-09-10T23:27:04.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f6438c00640 1 -- 172.21.15.17:0/1009481509 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6428003a00 con 0x7f643c15f350 2024-09-10T23:27:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.445+0000 7f6438c00640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f641c072610 0x7f641c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.449+0000 7f6438c00640 1 -- 172.21.15.17:0/1009481509 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7f6428092b20 con 0x7f643c15f350 2024-09-10T23:27:04.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.449+0000 7f6440e00640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f641c072610 0x7f641c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.449+0000 7f6440e00640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f641c072610 0x7f641c074ad0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f64300046c0 tx=0x7f6430007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:04.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.449+0000 7f6438c00640 1 -- 172.21.15.17:0/1009481509 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6428021080 con 0x7f643c15f350 2024-09-10T23:27:04.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.625+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f643c0b3df0 con 0x7f643c15f350 2024-09-10T23:27:04.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6438c00640 1 -- 172.21.15.17:0/1009481509 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16892 (secure 0 0 0) 0x7f643c157600 con 0x7f643c15f350 2024-09-10T23:27:04.632 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:04.632 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":155,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:26:21.092685+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:26:17.207114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-10T23:26:18.463692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f641c072610 msgr2=0x7f641c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f641c072610 0x7f641c074ad0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f64300046c0 tx=0x7f6430007ea0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c15f350 msgr2=0x7f643c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c15f350 0x7f643c15d600 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f642800c3c0 tx=0x7f642800c880 comp rx=0 tx=0).stop 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 shutdown_connections 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f641c072610 0x7f641c074ad0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f643c15f730 0x7f643c0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f643c15f350 0x7f643c15d600 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 --2- 172.21.15.17:0/1009481509 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f643c0b3130 0x7f643c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 >> 172.21.15.17:0/1009481509 conn(0x7f643c0d1d10 msgr2=0x7f643c15e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:04.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 shutdown_connections 2024-09-10T23:27:04.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.629+0000 7f6443800640 1 -- 172.21.15.17:0/1009481509 wait complete. 2024-09-10T23:27:04.654 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:27:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 -- 172.21.15.17:0/2542603975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe99815f6b0 msgr2=0x7fe9980d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 --2- 172.21.15.17:0/2542603975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe99815f6b0 0x7fe9980d0600 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fe984009900 tx=0x7fe98401c7c0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 -- 172.21.15.17:0/2542603975 shutdown_connections 2024-09-10T23:27:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 --2- 172.21.15.17:0/2542603975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe99815f6b0 0x7fe9980d0600 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 --2- 172.21.15.17:0/2542603975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe99815f2d0 0x7fe9980d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 -- 172.21.15.17:0/2542603975 >> 172.21.15.17:0/2542603975 conn(0x7fe9980d1ce0 msgr2=0x7fe9980d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 -- 172.21.15.17:0/2542603975 shutdown_connections 2024-09-10T23:27:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 -- 172.21.15.17:0/2542603975 wait complete. 2024-09-10T23:27:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 Processor -- start 2024-09-10T23:27:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.797+0000 7fe99dc00640 1 -- start start 2024-09-10T23:27:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe99dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9980cfbe0 0x7fe998156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe99dc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe99815f2d0 0x7fe998155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe99dc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe99815f6b0 0x7fe9981574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe99dc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe998169260 con 0x7fe9980cfbe0 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe99dc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9981690e0 con 0x7fe99815f6b0 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe99dc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe9981693e0 con 0x7fe99815f2d0 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9980cfbe0 0x7fe998156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9980cfbe0 0x7fe998156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39582/0 (socket says 172.21.15.17:39582) 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996a00640 1 -- 172.21.15.17:0/103440053 learned_addr learned my addr 172.21.15.17:0/103440053 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996000640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe99815f2d0 0x7fe998155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe997400640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe99815f6b0 0x7fe9981574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996a00640 1 -- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe99815f2d0 msgr2=0x7fe998155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996a00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe99815f2d0 0x7fe998155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996a00640 1 -- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe99815f6b0 msgr2=0x7fe9981574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996a00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe99815f6b0 0x7fe9981574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996a00640 1 -- 172.21.15.17:0/103440053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe998165810 con 0x7fe9980cfbe0 2024-09-10T23:27:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe996a00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9980cfbe0 0x7fe998156a90 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fe98800d950 tx=0x7fe98800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe98ea00640 1 -- 172.21.15.17:0/103440053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988017070 con 0x7fe9980cfbe0 2024-09-10T23:27:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe98ea00640 1 -- 172.21.15.17:0/103440053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe988009d20 con 0x7fe9980cfbe0 2024-09-10T23:27:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe98ea00640 1 -- 172.21.15.17:0/103440053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9880106c0 con 0x7fe9980cfbe0 2024-09-10T23:27:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe998157100 con 0x7fe9980cfbe0 2024-09-10T23:27:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99815dcb0 con 0x7fe9980cfbe0 2024-09-10T23:27:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.801+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99815d7e0 con 0x7fe9980cfbe0 2024-09-10T23:27:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.805+0000 7fe98ea00640 1 -- 172.21.15.17:0/103440053 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe988010860 con 0x7fe9980cfbe0 2024-09-10T23:27:04.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.805+0000 7fe98ea00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9780725e0 0x7fe978074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:04.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.805+0000 7fe98ea00640 1 -- 172.21.15.17:0/103440053 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6101+0+0 (secure 0 0 0) 0x7fe988093c50 con 0x7fe9980cfbe0 2024-09-10T23:27:04.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.805+0000 7fe996000640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9780725e0 0x7fe978074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:04.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.805+0000 7fe996000640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9780725e0 0x7fe978074aa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe9840ae000 tx=0x7fe9840b4040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:04.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:04.805+0000 7fe98ea00640 1 -- 172.21.15.17:0/103440053 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe98805ebc0 con 0x7fe9980cfbe0 2024-09-10T23:27:05.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.013+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe9980cdfd0 con 0x7fe9980cfbe0 2024-09-10T23:27:05.017 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:27:05.013+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:27:05.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.013+0000 7fe98ea00640 1 -- 172.21.15.17:0/103440053 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v113) ==== 161+0+0 (secure 0 0 0) 0x7fe9880635f0 con 0x7fe9980cfbe0 2024-09-10T23:27:05.019 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:27:05.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9780725e0 msgr2=0x7fe978074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9780725e0 0x7fe978074aa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe9840ae000 tx=0x7fe9840b4040 comp rx=0 tx=0).stop 2024-09-10T23:27:05.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9980cfbe0 msgr2=0x7fe998156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9980cfbe0 0x7fe998156a90 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fe98800d950 tx=0x7fe98800de10 comp rx=0 tx=0).stop 2024-09-10T23:27:05.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 shutdown_connections 2024-09-10T23:27:05.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9780725e0 0x7fe978074aa0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe99815f6b0 0x7fe9981574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe99815f2d0 0x7fe998155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 --2- 172.21.15.17:0/103440053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9980cfbe0 0x7fe998156a90 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 >> 172.21.15.17:0/103440053 conn(0x7fe9980d1ce0 msgr2=0x7fe9980d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:05.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 shutdown_connections 2024-09-10T23:27:05.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.017+0000 7fe99dc00640 1 -- 172.21.15.17:0/103440053 wait complete. 2024-09-10T23:27:05.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:27:05.091 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:27:05.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.189+0000 7fdbc8e00640 1 -- 172.21.15.17:0/2269983668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdbc4072690 msgr2=0x7fdbc4072ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.189+0000 7fdbc8e00640 1 --2- 172.21.15.17:0/2269983668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdbc4072690 0x7fdbc4072ad0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009870 tx=0x7fdbac01c780 comp rx=0 tx=0).stop 2024-09-10T23:27:05.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.189+0000 7fdbc8e00640 1 -- 172.21.15.17:0/2269983668 shutdown_connections 2024-09-10T23:27:05.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.189+0000 7fdbc8e00640 1 --2- 172.21.15.17:0/2269983668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdbc4072690 0x7fdbc4072ad0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.189+0000 7fdbc8e00640 1 -- 172.21.15.17:0/2269983668 >> 172.21.15.17:0/2269983668 conn(0x7fdbc40b17a0 msgr2=0x7fdbc40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:05.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.189+0000 7fdbc8e00640 1 -- 172.21.15.17:0/2269983668 shutdown_connections 2024-09-10T23:27:05.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.189+0000 7fdbc8e00640 1 -- 172.21.15.17:0/2269983668 wait complete. 2024-09-10T23:27:05.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 Processor -- start 2024-09-10T23:27:05.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 -- start start 2024-09-10T23:27:05.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc4072690 0x7fdbc413a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc4073010 0x7fdbc414e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdbc415aa80 0x7fdbc414e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc4168f90 con 0x7fdbc4073010 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc4168e10 con 0x7fdbc4072690 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc4169110 con 0x7fdbc415aa80 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbbbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc4073010 0x7fdbc414e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbbbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc4073010 0x7fdbc414e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39610/0 (socket says 172.21.15.17:39610) 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbbbe00640 1 -- 172.21.15.17:0/3381211481 learned_addr learned my addr 172.21.15.17:0/3381211481 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc1e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc4072690 0x7fdbc413a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbbbe00640 1 -- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdbc415aa80 msgr2=0x7fdbc414e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc2800640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdbc415aa80 0x7fdbc414e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbbbe00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdbc415aa80 0x7fdbc414e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbbbe00640 1 -- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc4072690 msgr2=0x7fdbc413a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbbbe00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc4072690 0x7fdbc413a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbbbe00640 1 -- 172.21.15.17:0/3381211481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc413d8a0 con 0x7fdbc4073010 2024-09-10T23:27:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc1e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc4072690 0x7fdbc413a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc2800640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdbc415aa80 0x7fdbc414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbbbe00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc4073010 0x7fdbc414e3a0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fdbac01d020 tx=0x7fdbac005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbba000640 1 -- 172.21.15.17:0/3381211481 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0050f0 con 0x7fdbc4073010 2024-09-10T23:27:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbba000640 1 -- 172.21.15.17:0/3381211481 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbac005380 con 0x7fdbc4073010 2024-09-10T23:27:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbba000640 1 -- 172.21.15.17:0/3381211481 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0a7890 con 0x7fdbc4073010 2024-09-10T23:27:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc413a5e0 con 0x7fdbc4073010 2024-09-10T23:27:05.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.193+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc413cae0 con 0x7fdbc4073010 2024-09-10T23:27:05.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.197+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc4072ad0 con 0x7fdbc4073010 2024-09-10T23:27:05.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.197+0000 7fdbba000640 1 -- 172.21.15.17:0/3381211481 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdbac0a7a30 con 0x7fdbc4073010 2024-09-10T23:27:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.197+0000 7fdbba000640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdba00725e0 0x7fdba0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.197+0000 7fdbba000640 1 -- 172.21.15.17:0/3381211481 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 6187+0+0 (secure 0 0 0) 0x7fdbac12e3b0 con 0x7fdbc4073010 2024-09-10T23:27:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.197+0000 7fdbc1e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdba00725e0 0x7fdba0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:05.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.197+0000 7fdbc1e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdba00725e0 0x7fdba0074aa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40010f0 tx=0x7fdbb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:05.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.201+0000 7fdbba000640 1 -- 172.21.15.17:0/3381211481 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdbac0c7020 con 0x7fdbc4073010 2024-09-10T23:27:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:05.409+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdbc415e9e0 con 0x7fdbc4073010 2024-09-10T23:27:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.017+0000 7fdbba000640 1 -- 172.21.15.17:0/3381211481 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v114) ==== 104+0+0 (secure 0 0 0) 0x7fdbac016370 con 0x7fdbc4073010 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdba00725e0 msgr2=0x7fdba0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdba00725e0 0x7fdba0074aa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40010f0 tx=0x7fdbb4009040 comp rx=0 tx=0).stop 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc4073010 msgr2=0x7fdbc414e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc4073010 0x7fdbc414e3a0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fdbac01d020 tx=0x7fdbac005d40 comp rx=0 tx=0).stop 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 shutdown_connections 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdba00725e0 0x7fdba0074aa0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdbc415aa80 0x7fdbc414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbc4073010 0x7fdbc414e3a0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 --2- 172.21.15.17:0/3381211481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc4072690 0x7fdbc413a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 >> 172.21.15.17:0/3381211481 conn(0x7fdbc40b17a0 msgr2=0x7fdbc415ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:06.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 shutdown_connections 2024-09-10T23:27:06.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.021+0000 7fdbc8e00640 1 -- 172.21.15.17:0/3381211481 wait complete. 2024-09-10T23:27:06.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:27:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.197+0000 7f5df2c00640 1 -- 172.21.15.17:0/1011142663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2750 msgr2=0x7f5dec0b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.197+0000 7f5df2c00640 1 --2- 172.21.15.17:0/1011142663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2750 0x7f5dec0b50f0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009870 tx=0x7f5dd801f010 comp rx=0 tx=0).stop 2024-09-10T23:27:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.197+0000 7f5df2c00640 1 -- 172.21.15.17:0/1011142663 shutdown_connections 2024-09-10T23:27:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.197+0000 7f5df2c00640 1 --2- 172.21.15.17:0/1011142663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2750 0x7f5dec0b50f0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.197+0000 7f5df2c00640 1 -- 172.21.15.17:0/1011142663 >> 172.21.15.17:0/1011142663 conn(0x7f5dec09d0b0 msgr2=0x7f5dec0d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.197+0000 7f5df2c00640 1 -- 172.21.15.17:0/1011142663 shutdown_connections 2024-09-10T23:27:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.197+0000 7f5df2c00640 1 -- 172.21.15.17:0/1011142663 wait complete. 2024-09-10T23:27:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 Processor -- start 2024-09-10T23:27:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 -- start start 2024-09-10T23:27:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dec0b3de0 0x7f5dec1e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2370 0x7f5dec1e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dec0d2750 0x7f5dec1f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec0b1da0 con 0x7f5dec0d2370 2024-09-10T23:27:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec0b4480 con 0x7f5dec0d2750 2024-09-10T23:27:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec0b1f20 con 0x7f5dec0b3de0 2024-09-10T23:27:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2370 0x7f5dec1e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2370 0x7f5dec1e8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39638/0 (socket says 172.21.15.17:39638) 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df0e00640 1 -- 172.21.15.17:0/4092359917 learned_addr learned my addr 172.21.15.17:0/4092359917 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df1800640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dec0b3de0 0x7f5dec1e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2200640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dec0d2750 0x7f5dec1f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df0e00640 1 -- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dec0b3de0 msgr2=0x7f5dec1e68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df0e00640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dec0b3de0 0x7f5dec1e68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df0e00640 1 -- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dec0d2750 msgr2=0x7f5dec1f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df0e00640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dec0d2750 0x7f5dec1f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df0e00640 1 -- 172.21.15.17:0/4092359917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec1f5490 con 0x7f5dec0d2370 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df0e00640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2370 0x7f5dec1e8d80 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f5dd801bc20 tx=0x7f5dd80a8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5de9600640 1 -- 172.21.15.17:0/4092359917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80b5040 con 0x7f5dec0d2370 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5de9600640 1 -- 172.21.15.17:0/4092359917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dd80b1680 con 0x7f5dec0d2370 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5de9600640 1 -- 172.21.15.17:0/4092359917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80b1a90 con 0x7f5dec0d2370 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec1f5770 con 0x7f5dec0d2370 2024-09-10T23:27:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec1f81e0 con 0x7f5dec0d2370 2024-09-10T23:27:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.201+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dec0b81c0 con 0x7f5dec0d2370 2024-09-10T23:27:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.205+0000 7f5de9600640 1 -- 172.21.15.17:0/4092359917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5dd80b8030 con 0x7f5dec0d2370 2024-09-10T23:27:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.205+0000 7f5de9600640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dcc072610 0x7f5dcc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.205+0000 7f5de9600640 1 -- 172.21.15.17:0/4092359917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 6187+0+0 (secure 0 0 0) 0x7f5dd81305c0 con 0x7f5dec0d2370 2024-09-10T23:27:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.205+0000 7f5df1800640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dcc072610 0x7f5dcc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:06.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.205+0000 7f5df1800640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dcc072610 0x7f5dcc074ad0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5de0000f70 tx=0x7f5de0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.209+0000 7f5de9600640 1 -- 172.21.15.17:0/4092359917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5dd80c8020 con 0x7f5dec0d2370 2024-09-10T23:27:06.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:06.385+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5dec0b50f0 con 0x7f5dec0d2370 2024-09-10T23:27:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.025+0000 7f5de9600640 1 -- 172.21.15.17:0/4092359917 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v157) ==== 181+0+0 (secure 0 0 0) 0x7f5dd8018b70 con 0x7f5dec0d2370 2024-09-10T23:27:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:27:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.025+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dcc072610 msgr2=0x7f5dcc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.025+0000 7f5df2c00640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dcc072610 0x7f5dcc074ad0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5de0000f70 tx=0x7f5de0009040 comp rx=0 tx=0).stop 2024-09-10T23:27:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.025+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2370 msgr2=0x7f5dec1e8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.025+0000 7f5df2c00640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2370 0x7f5dec1e8d80 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f5dd801bc20 tx=0x7f5dd80a8ca0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.029+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 shutdown_connections 2024-09-10T23:27:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.029+0000 7f5df2c00640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5dcc072610 0x7f5dcc074ad0 secure :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5de0000f70 tx=0x7f5de0009040 comp rx=0 tx=0).stop 2024-09-10T23:27:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.029+0000 7f5df2c00640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5dec0d2750 0x7f5dec1f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.029+0000 7f5df2c00640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dec0d2370 0x7f5dec1e8d80 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.029+0000 7f5df2c00640 1 --2- 172.21.15.17:0/4092359917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5dec0b3de0 0x7f5dec1e68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.029+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 >> 172.21.15.17:0/4092359917 conn(0x7f5dec09d0b0 msgr2=0x7f5dec0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:07.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.029+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 shutdown_connections 2024-09-10T23:27:07.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.029+0000 7f5df2c00640 1 -- 172.21.15.17:0/4092359917 wait complete. 2024-09-10T23:27:07.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:27:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.205+0000 7fbf8c600640 1 -- 172.21.15.17:0/1641573206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415ab30 msgr2=0x7fbf84073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.205+0000 7fbf8c600640 1 --2- 172.21.15.17:0/1641573206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415ab30 0x7fbf84073000 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fbf840b27e0 tx=0x7fbf7801c7d0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.205+0000 7fbf8c600640 1 -- 172.21.15.17:0/1641573206 shutdown_connections 2024-09-10T23:27:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.205+0000 7fbf8c600640 1 --2- 172.21.15.17:0/1641573206 >> v2:172.21.15.77:3300/0 conn(0x7fbf84072b40 0x7fbf84073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.205+0000 7fbf8c600640 1 --2- 172.21.15.17:0/1641573206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415ab30 0x7fbf84073000 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.205+0000 7fbf8c600640 1 -- 172.21.15.17:0/1641573206 >> 172.21.15.17:0/1641573206 conn(0x7fbf840b17a0 msgr2=0x7fbf840b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.205+0000 7fbf8c600640 1 -- 172.21.15.17:0/1641573206 shutdown_connections 2024-09-10T23:27:07.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.205+0000 7fbf8c600640 1 -- 172.21.15.17:0/1641573206 wait complete. 2024-09-10T23:27:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 Processor -- start 2024-09-10T23:27:07.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 -- start start 2024-09-10T23:27:07.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf84072b40 0x7fbf8415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf84073a80 0x7fbf840ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf8415ab30 0x7fbf841f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf84167bf0 con 0x7fbf84073a80 2024-09-10T23:27:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbf84167a70 con 0x7fbf8415ab30 2024-09-10T23:27:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbf84167d70 con 0x7fbf84072b40 2024-09-10T23:27:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf84073a80 0x7fbf840ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf84073a80 0x7fbf840ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49702/0 (socket says 172.21.15.17:49702) 2024-09-10T23:27:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89200640 1 -- 172.21.15.17:0/1439480697 learned_addr learned my addr 172.21.15.17:0/1439480697 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89c00640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf84072b40 0x7fbf8415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8a600640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf8415ab30 0x7fbf841f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89200640 1 -- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf84072b40 msgr2=0x7fbf8415be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89200640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf84072b40 0x7fbf8415be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89200640 1 -- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf8415ab30 msgr2=0x7fbf841f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89200640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf8415ab30 0x7fbf841f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89200640 1 -- 172.21.15.17:0/1439480697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf841f8550 con 0x7fbf84073a80 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8a600640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf8415ab30 0x7fbf841f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf89200640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf84073a80 0x7fbf840ce860 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000d980 tx=0x7fbf7000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf81600640 1 -- 172.21.15.17:0/1439480697 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70017070 con 0x7fbf84073a80 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf81600640 1 -- 172.21.15.17:0/1439480697 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf70009cc0 con 0x7fbf84073a80 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf840cefb0 con 0x7fbf84073a80 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf81600640 1 -- 172.21.15.17:0/1439480697 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf700106c0 con 0x7fbf84073a80 2024-09-10T23:27:07.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.209+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf84151230 con 0x7fbf84073a80 2024-09-10T23:27:07.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.213+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf8415e6d0 con 0x7fbf84073a80 2024-09-10T23:27:07.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.213+0000 7fbf81600640 1 -- 172.21.15.17:0/1439480697 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbf70010860 con 0x7fbf84073a80 2024-09-10T23:27:07.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.213+0000 7fbf81600640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf64072610 0x7fbf64074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:07.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.213+0000 7fbf81600640 1 -- 172.21.15.17:0/1439480697 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5749+0+0 (secure 0 0 0) 0x7fbf70093560 con 0x7fbf84073a80 2024-09-10T23:27:07.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.213+0000 7fbf89c00640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf64072610 0x7fbf64074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:07.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.213+0000 7fbf89c00640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf64072610 0x7fbf64074ad0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbf780af000 tx=0x7fbf7801b010 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:07.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.217+0000 7fbf81600640 1 -- 172.21.15.17:0/1439480697 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbf7005e5b0 con 0x7fbf84073a80 2024-09-10T23:27:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:07.389+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbf840cbc50 con 0x7fbf84073a80 2024-09-10T23:27:08.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.025+0000 7fbf81600640 1 -- 172.21.15.17:0/1439480697 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v158) ==== 169+0+0 (secure 0 0 0) 0x7fbf70062fe0 con 0x7fbf84073a80 2024-09-10T23:27:08.031 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:27:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf64072610 msgr2=0x7fbf64074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf64072610 0x7fbf64074ad0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbf780af000 tx=0x7fbf7801b010 comp rx=0 tx=0).stop 2024-09-10T23:27:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf84073a80 msgr2=0x7fbf840ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf84073a80 0x7fbf840ce860 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000d980 tx=0x7fbf7000de40 comp rx=0 tx=0).stop 2024-09-10T23:27:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 shutdown_connections 2024-09-10T23:27:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf64072610 0x7fbf64074ad0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf8415ab30 0x7fbf841f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf84073a80 0x7fbf840ce860 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 --2- 172.21.15.17:0/1439480697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf84072b40 0x7fbf8415be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 >> 172.21.15.17:0/1439480697 conn(0x7fbf840b17a0 msgr2=0x7fbf8415b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 shutdown_connections 2024-09-10T23:27:08.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.029+0000 7fbf8c600640 1 -- 172.21.15.17:0/1439480697 wait complete. 2024-09-10T23:27:08.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:27:08.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:27:08.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:27:08.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.209+0000 7f4ef2c00640 1 -- 172.21.15.17:0/541154596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec06ef80 msgr2=0x7f4eec0726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.209+0000 7f4ef2c00640 1 --2- 172.21.15.17:0/541154596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec06ef80 0x7f4eec0726f0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009bc0 tx=0x7f4ee401d600 comp rx=0 tx=0).stop 2024-09-10T23:27:08.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.209+0000 7f4ef2c00640 1 -- 172.21.15.17:0/541154596 shutdown_connections 2024-09-10T23:27:08.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.209+0000 7f4ef2c00640 1 --2- 172.21.15.17:0/541154596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec06ef80 0x7f4eec0726f0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.209+0000 7f4ef2c00640 1 -- 172.21.15.17:0/541154596 >> 172.21.15.17:0/541154596 conn(0x7f4eec0b1730 msgr2=0x7f4eec0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:08.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.209+0000 7f4ef2c00640 1 -- 172.21.15.17:0/541154596 shutdown_connections 2024-09-10T23:27:08.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.209+0000 7f4ef2c00640 1 -- 172.21.15.17:0/541154596 wait complete. 2024-09-10T23:27:08.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 Processor -- start 2024-09-10T23:27:08.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 -- start start 2024-09-10T23:27:08.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eec06ef80 0x7f4eec150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec0cf700 0x7f4eec158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eec1546f0 0x7f4eec1592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec168240 con 0x7f4eec0cf700 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec1680c0 con 0x7f4eec06ef80 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4eec1683c0 con 0x7f4eec1546f0 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec0cf700 0x7f4eec158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec0cf700 0x7f4eec158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49718/0 (socket says 172.21.15.17:49718) 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee3e00640 1 -- 172.21.15.17:0/3857194487 learned_addr learned my addr 172.21.15.17:0/3857194487 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4eebe00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eec06ef80 0x7f4eec150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef0c00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eec1546f0 0x7f4eec1592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee3e00640 1 -- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eec1546f0 msgr2=0x7f4eec1592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee3e00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eec1546f0 0x7f4eec1592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee3e00640 1 -- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eec06ef80 msgr2=0x7f4eec150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee3e00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eec06ef80 0x7f4eec150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee3e00640 1 -- 172.21.15.17:0/3857194487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eec0aa380 con 0x7f4eec0cf700 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4eebe00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eec06ef80 0x7f4eec150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef0c00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eec1546f0 0x7f4eec1592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee3e00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec0cf700 0x7f4eec158da0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400c500 tx=0x7f4ed400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee8c00640 1 -- 172.21.15.17:0/3857194487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4017070 con 0x7f4eec0cf700 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee8c00640 1 -- 172.21.15.17:0/3857194487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ed4003600 con 0x7f4eec0cf700 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ee8c00640 1 -- 172.21.15.17:0/3857194487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4003a90 con 0x7f4eec0cf700 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eec0aa660 con 0x7f4eec0cf700 2024-09-10T23:27:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.213+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eec0aac20 con 0x7f4eec0cf700 2024-09-10T23:27:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.217+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eec1516f0 con 0x7f4eec0cf700 2024-09-10T23:27:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.217+0000 7f4ee8c00640 1 -- 172.21.15.17:0/3857194487 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4ed4003c30 con 0x7f4eec0cf700 2024-09-10T23:27:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.217+0000 7f4ee8c00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ec80725e0 0x7f4ec8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.217+0000 7f4ee8c00640 1 -- 172.21.15.17:0/3857194487 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f4ed4092880 con 0x7f4eec0cf700 2024-09-10T23:27:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.217+0000 7f4eebe00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ec80725e0 0x7f4ec8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.217+0000 7f4eebe00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ec80725e0 0x7f4ec8074aa0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4edc007a60 tx=0x7f4edc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:08.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.221+0000 7f4ee8c00640 1 -- 172.21.15.17:0/3857194487 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4eec1516f0 con 0x7f4eec0cf700 2024-09-10T23:27:08.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.409+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f4eec0b2de0 con 0x7f4eec0cf700 2024-09-10T23:27:08.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.413+0000 7f4ee8c00640 1 -- 172.21.15.17:0/3857194487 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v53) ==== 71+0+0 (secure 0 0 0) 0x7f4ed405e180 con 0x7f4eec0cf700 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ec80725e0 msgr2=0x7f4ec8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ec80725e0 0x7f4ec8074aa0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4edc007a60 tx=0x7f4edc009040 comp rx=0 tx=0).stop 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec0cf700 msgr2=0x7f4eec158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec0cf700 0x7f4eec158da0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400c500 tx=0x7f4ed400c9c0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 shutdown_connections 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ec80725e0 0x7f4ec8074aa0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eec1546f0 0x7f4eec1592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4eec0cf700 0x7f4eec158da0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 --2- 172.21.15.17:0/3857194487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eec06ef80 0x7f4eec150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 >> 172.21.15.17:0/3857194487 conn(0x7f4eec0b1730 msgr2=0x7f4eec158290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:08.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 shutdown_connections 2024-09-10T23:27:08.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.417+0000 7f4ef2c00640 1 -- 172.21.15.17:0/3857194487 wait complete. 2024-09-10T23:27:08.439 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-10T23:27:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.581+0000 7f3d21000640 1 -- 172.21.15.17:0/4235896661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c070ad0 msgr2=0x7f3d1c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.581+0000 7f3d21000640 1 --2- 172.21.15.17:0/4235896661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c070ad0 0x7f3d1c15f060 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0cf010 tx=0x7f3d0c01c7f0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.581+0000 7f3d21000640 1 -- 172.21.15.17:0/4235896661 shutdown_connections 2024-09-10T23:27:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.581+0000 7f3d21000640 1 --2- 172.21.15.17:0/4235896661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c070ad0 0x7f3d1c15f060 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.581+0000 7f3d21000640 1 -- 172.21.15.17:0/4235896661 >> 172.21.15.17:0/4235896661 conn(0x7f3d1c0d1d60 msgr2=0x7f3d1c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.581+0000 7f3d21000640 1 -- 172.21.15.17:0/4235896661 shutdown_connections 2024-09-10T23:27:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.581+0000 7f3d21000640 1 -- 172.21.15.17:0/4235896661 wait complete. 2024-09-10T23:27:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 Processor -- start 2024-09-10T23:27:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 -- start start 2024-09-10T23:27:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d1c070ad0 0x7f3d1c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1c0cf320 0x7f3d1c153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c0d1830 0x7f3d1c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c16a4e0 con 0x7f3d1c0d1830 2024-09-10T23:27:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c16a660 con 0x7f3d1c0cf320 2024-09-10T23:27:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1c16a7e0 con 0x7f3d1c070ad0 2024-09-10T23:27:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d1a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c0d1830 0x7f3d1c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d1a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c0d1830 0x7f3d1c153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49736/0 (socket says 172.21.15.17:49736) 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d1a800640 1 -- 172.21.15.17:0/2261071192 learned_addr learned my addr 172.21.15.17:0/2261071192 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d19e00640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d1c070ad0 0x7f3d1c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d19400640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1c0cf320 0x7f3d1c153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d1a800640 1 -- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d1c070ad0 msgr2=0x7f3d1c14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d1a800640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d1c070ad0 0x7f3d1c14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d1a800640 1 -- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1c0cf320 msgr2=0x7f3d1c153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d1a800640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1c0cf320 0x7f3d1c153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d1a800640 1 -- 172.21.15.17:0/2261071192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c1502b0 con 0x7f3d1c0d1830 2024-09-10T23:27:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d1a800640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c0d1830 0x7f3d1c153870 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400c780 tx=0x7f3d1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d12000640 1 -- 172.21.15.17:0/2261071192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d14004b70 con 0x7f3d1c0d1830 2024-09-10T23:27:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d12000640 1 -- 172.21.15.17:0/2261071192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d14004e00 con 0x7f3d1c0d1830 2024-09-10T23:27:08.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d12000640 1 -- 172.21.15.17:0/2261071192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1400aa90 con 0x7f3d1c0d1830 2024-09-10T23:27:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1c150590 con 0x7f3d1c0d1830 2024-09-10T23:27:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.585+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1c150b50 con 0x7f3d1c0d1830 2024-09-10T23:27:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.589+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d1c15f060 con 0x7f3d1c0d1830 2024-09-10T23:27:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.589+0000 7f3d12000640 1 -- 172.21.15.17:0/2261071192 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3d1400ac30 con 0x7f3d1c0d1830 2024-09-10T23:27:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.589+0000 7f3d12000640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cfc0725e0 0x7f3cfc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.589+0000 7f3d12000640 1 -- 172.21.15.17:0/2261071192 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f3d14093370 con 0x7f3d1c0d1830 2024-09-10T23:27:08.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.589+0000 7f3d19e00640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cfc0725e0 0x7f3cfc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:08.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.589+0000 7f3d19e00640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cfc0725e0 0x7f3cfc074aa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0af000 tx=0x7f3d0c01b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:08.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.593+0000 7f3d12000640 1 -- 172.21.15.17:0/2261071192 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3d14020070 con 0x7f3d1c0d1830 2024-09-10T23:27:08.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:08.829+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f3d1c0d21e0 con 0x7f3d1c0d1830 2024-09-10T23:27:09.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d12000640 1 -- 172.21.15.17:0/2261071192 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v539) ==== 166+0+0 (secure 0 0 0) 0x7f3d14093130 con 0x7f3d1c0d1830 2024-09-10T23:27:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cfc0725e0 msgr2=0x7f3cfc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cfc0725e0 0x7f3cfc074aa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0af000 tx=0x7f3d0c01b030 comp rx=0 tx=0).stop 2024-09-10T23:27:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c0d1830 msgr2=0x7f3d1c153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c0d1830 0x7f3d1c153870 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400c780 tx=0x7f3d1400cc40 comp rx=0 tx=0).stop 2024-09-10T23:27:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 shutdown_connections 2024-09-10T23:27:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3cfc0725e0 0x7f3cfc074aa0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d1c0d1830 0x7f3d1c153870 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d1c0cf320 0x7f3d1c153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 --2- 172.21.15.17:0/2261071192 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3d1c070ad0 0x7f3d1c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 >> 172.21.15.17:0/2261071192 conn(0x7f3d1c0d1d60 msgr2=0x7f3d1c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 shutdown_connections 2024-09-10T23:27:09.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.029+0000 7f3d21000640 1 -- 172.21.15.17:0/2261071192 wait complete. 2024-09-10T23:27:09.054 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T23:27:09.055 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T23:27:09.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:27:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 -- 172.21.15.17:0/1907373051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d80d2240 msgr2=0x7f61d80cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 --2- 172.21.15.17:0/1907373051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d80d2240 0x7f61d80cf010 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f61d80b4810 tx=0x7f61d001cb80 comp rx=0 tx=0).stop 2024-09-10T23:27:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 -- 172.21.15.17:0/1907373051 shutdown_connections 2024-09-10T23:27:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 --2- 172.21.15.17:0/1907373051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d80d2240 0x7f61d80cf010 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 --2- 172.21.15.17:0/1907373051 >> v2:172.21.15.77:3300/0 conn(0x7f61d80b1280 0x7f61d80cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 -- 172.21.15.17:0/1907373051 >> 172.21.15.17:0/1907373051 conn(0x7f61d809a9f0 msgr2=0x7f61d809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 -- 172.21.15.17:0/1907373051 shutdown_connections 2024-09-10T23:27:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 -- 172.21.15.17:0/1907373051 wait complete. 2024-09-10T23:27:09.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 Processor -- start 2024-09-10T23:27:09.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.197+0000 7f61dd000640 1 -- start start 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61dd000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d80b1280 0x7f61d81500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61dd000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61d80d2240 0x7f61d80b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61dd000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d815e190 0x7f61d81541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61dd000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f61d816a9e0 con 0x7f61d815e190 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61dd000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8071870 con 0x7f61d80b1280 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61dd000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61d816ab60 con 0x7f61d80d2240 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d815e190 0x7f61d81541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d815e190 0x7f61d81541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49754/0 (socket says 172.21.15.17:49754) 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d80b1280 0x7f61d81500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7e00640 1 -- 172.21.15.17:0/2557492668 learned_addr learned my addr 172.21.15.17:0/2557492668 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d6a00640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61d80d2240 0x7f61d80b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7e00640 1 -- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61d80d2240 msgr2=0x7f61d80b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7e00640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61d80d2240 0x7f61d80b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7e00640 1 -- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d80b1280 msgr2=0x7f61d81500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7e00640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d80b1280 0x7f61d81500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7e00640 1 -- 172.21.15.17:0/2557492668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d80b45e0 con 0x7f61d815e190 2024-09-10T23:27:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61d7e00640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d815e190 0x7f61d81541a0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f61d001c5f0 tx=0x7f61d0005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61cf400640 1 -- 172.21.15.17:0/2557492668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d00b2040 con 0x7f61d815e190 2024-09-10T23:27:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61cf400640 1 -- 172.21.15.17:0/2557492668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61d00bb070 con 0x7f61d815e190 2024-09-10T23:27:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61cf400640 1 -- 172.21.15.17:0/2557492668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0004330 con 0x7f61d815e190 2024-09-10T23:27:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d80b2910 con 0x7f61d815e190 2024-09-10T23:27:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d814fb30 con 0x7f61d815e190 2024-09-10T23:27:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.201+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d80cfcb0 con 0x7f61d815e190 2024-09-10T23:27:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.205+0000 7f61cf400640 1 -- 172.21.15.17:0/2557492668 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f61d00b5070 con 0x7f61d815e190 2024-09-10T23:27:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.205+0000 7f61cf400640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61b80725e0 0x7f61b8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.205+0000 7f61cf400640 1 -- 172.21.15.17:0/2557492668 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f61d012d730 con 0x7f61d815e190 2024-09-10T23:27:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.205+0000 7f61d7400640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61b80725e0 0x7f61b8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.205+0000 7f61d7400640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61b80725e0 0x7f61b8074aa0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f61c800abe0 tx=0x7f61c800a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:09.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.209+0000 7f61cf400640 1 -- 172.21.15.17:0/2557492668 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f61d0016770 con 0x7f61d815e190 2024-09-10T23:27:09.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.409+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61d809b110 con 0x7f61d815e190 2024-09-10T23:27:09.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.409+0000 7f61cf400640 1 -- 172.21.15.17:0/2557492668 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+13255 (secure 0 0 0) 0x7f61d00f8890 con 0x7f61d815e190 2024-09-10T23:27:09.416 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:09.416 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":158,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:27:08.029565+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/1449354346":"2024-09-11T23:27:05.018341+0000","172.21.15.17:6833/1449354346":"2024-09-11T23:27:05.018341+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:27:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61b80725e0 msgr2=0x7f61b8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61b80725e0 0x7f61b8074aa0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f61c800abe0 tx=0x7f61c800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d815e190 msgr2=0x7f61d81541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d815e190 0x7f61d81541a0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f61d001c5f0 tx=0x7f61d0005b00 comp rx=0 tx=0).stop 2024-09-10T23:27:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 shutdown_connections 2024-09-10T23:27:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61b80725e0 0x7f61b8074aa0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61d815e190 0x7f61d81541a0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61d80d2240 0x7f61d80b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 --2- 172.21.15.17:0/2557492668 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d80b1280 0x7f61d81500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 >> 172.21.15.17:0/2557492668 conn(0x7f61d809a9f0 msgr2=0x7f61d8155010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 shutdown_connections 2024-09-10T23:27:09.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.413+0000 7f61dd000640 1 -- 172.21.15.17:0/2557492668 wait complete. 2024-09-10T23:27:09.438 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:27:09.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:27:09.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 -- 172.21.15.17:0/4237316894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920072b40 msgr2=0x7f7920073540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 --2- 172.21.15.17:0/4237316894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920072b40 0x7f7920073540 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7908009900 tx=0x7f790801c850 comp rx=0 tx=0).stop 2024-09-10T23:27:09.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 -- 172.21.15.17:0/4237316894 shutdown_connections 2024-09-10T23:27:09.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 --2- 172.21.15.17:0/4237316894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920072b40 0x7f7920073540 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 --2- 172.21.15.17:0/4237316894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f792015ab30 0x7f7920073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 -- 172.21.15.17:0/4237316894 >> 172.21.15.17:0/4237316894 conn(0x7f79200b17a0 msgr2=0x7f79200b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:09.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 -- 172.21.15.17:0/4237316894 shutdown_connections 2024-09-10T23:27:09.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 -- 172.21.15.17:0/4237316894 wait complete. 2024-09-10T23:27:09.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 Processor -- start 2024-09-10T23:27:09.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 -- start start 2024-09-10T23:27:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7920072b40 0x7f792014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920073a80 0x7f79200cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f792015ab30 0x7f792014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7920167bf0 con 0x7f7920073a80 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7920167a70 con 0x7f792015ab30 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7924c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7920167d70 con 0x7f7920072b40 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7917e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920073a80 0x7f79200cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7917e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920073a80 0x7f79200cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49782/0 (socket says 172.21.15.17:49782) 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7917e00640 1 -- 172.21.15.17:0/4055490398 learned_addr learned my addr 172.21.15.17:0/4055490398 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f791de00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7920072b40 0x7f792014a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f791e800640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f792015ab30 0x7f792014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7917e00640 1 -- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7920072b40 msgr2=0x7f792014a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7917e00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7920072b40 0x7f792014a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7917e00640 1 -- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f792015ab30 msgr2=0x7f792014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7917e00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f792015ab30 0x7f792014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.585+0000 7f7917e00640 1 -- 172.21.15.17:0/4055490398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79201505c0 con 0x7f7920073a80 2024-09-10T23:27:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.589+0000 7f7917e00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920073a80 0x7f79200cde20 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7908009850 tx=0x7f79080a5710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.589+0000 7f7916000640 1 -- 172.21.15.17:0/4055490398 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79080b2040 con 0x7f7920073a80 2024-09-10T23:27:09.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.589+0000 7f7916000640 1 -- 172.21.15.17:0/4055490398 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7908005020 con 0x7f7920073a80 2024-09-10T23:27:09.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.589+0000 7f7916000640 1 -- 172.21.15.17:0/4055490398 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79080044f0 con 0x7f7920073a80 2024-09-10T23:27:09.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.589+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79200cd340 con 0x7f7920073a80 2024-09-10T23:27:09.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.589+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79200cd900 con 0x7f7920073a80 2024-09-10T23:27:09.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.589+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7920155cf0 con 0x7f7920073a80 2024-09-10T23:27:09.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.589+0000 7f7916000640 1 -- 172.21.15.17:0/4055490398 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7908005430 con 0x7f7920073a80 2024-09-10T23:27:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.593+0000 7f7916000640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072630 0x7f78fc074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.593+0000 7f7916000640 1 -- 172.21.15.17:0/4055490398 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f790812ca00 con 0x7f7920073a80 2024-09-10T23:27:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.593+0000 7f791de00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072630 0x7f78fc074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.593+0000 7f791de00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072630 0x7f78fc074af0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f791000bb50 tx=0x7f791000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.597+0000 7f7916000640 1 -- 172.21.15.17:0/4055490398 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7920155cf0 con 0x7f7920073a80 2024-09-10T23:27:09.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f792015e6d0 con 0x7f7920073a80 2024-09-10T23:27:09.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7916000640 1 -- 172.21.15.17:0/4055490398 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) ==== 93+0+10 (secure 0 0 0) 0x7f79080164d0 con 0x7f7920073a80 2024-09-10T23:27:09.773 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:27:09.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072630 msgr2=0x7f78fc074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072630 0x7f78fc074af0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f791000bb50 tx=0x7f791000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920073a80 msgr2=0x7f79200cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920073a80 0x7f79200cde20 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7908009850 tx=0x7f79080a5710 comp rx=0 tx=0).stop 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 shutdown_connections 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f78fc072630 0x7f78fc074af0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f792015ab30 0x7f792014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7920073a80 0x7f79200cde20 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 --2- 172.21.15.17:0/4055490398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7920072b40 0x7f792014a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 >> 172.21.15.17:0/4055490398 conn(0x7f79200b17a0 msgr2=0x7f7920156740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 shutdown_connections 2024-09-10T23:27:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.769+0000 7f7924c00640 1 -- 172.21.15.17:0/4055490398 wait complete. 2024-09-10T23:27:09.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-10T23:27:09.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.937+0000 7f9dbf000640 1 -- 172.21.15.17:0/2859242574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d9c003c20 msgr2=0x7f9d9c004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.937+0000 7f9dbf000640 1 --2- 172.21.15.17:0/2859242574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d9c003c20 0x7f9d9c004020 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f9da8001860 tx=0x7f9da801f050 comp rx=0 tx=0).stop 2024-09-10T23:27:09.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.937+0000 7f9dbd000640 1 -- 172.21.15.17:0/2859242574 reap_dead start 2024-09-10T23:27:09.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.937+0000 7f9dbf000640 1 -- 172.21.15.17:0/2859242574 shutdown_connections 2024-09-10T23:27:09.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.937+0000 7f9dbf000640 1 -- 172.21.15.17:0/2859242574 >> 172.21.15.17:0/2859242574 conn(0x7f9db80d1d10 msgr2=0x7f9db80d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:09.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.937+0000 7f9dbf000640 1 -- 172.21.15.17:0/2859242574 shutdown_connections 2024-09-10T23:27:09.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.937+0000 7f9dbf000640 1 -- 172.21.15.17:0/2859242574 wait complete. 2024-09-10T23:27:09.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.937+0000 7f9dbf000640 1 Processor -- start 2024-09-10T23:27:09.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 -- start start 2024-09-10T23:27:09.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d9c003c20 0x7f9db806e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db80c9b10 0x7f9db81f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9db80c8de0 0x7f9db80c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9db80b1610 con 0x7f9db80c8de0 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9db80b07c0 con 0x7f9db80c9b10 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9db80b1790 con 0x7f9d9c003c20 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbd000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9db80c8de0 0x7f9db80c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbd000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9db80c8de0 0x7f9db80c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49802/0 (socket says 172.21.15.17:49802) 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbd000640 1 -- 172.21.15.17:0/1728666171 learned_addr learned my addr 172.21.15.17:0/1728666171 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9db7e00640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d9c003c20 0x7f9db806e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9daf400640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db80c9b10 0x7f9db81f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbd000640 1 -- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d9c003c20 msgr2=0x7f9db806e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbd000640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d9c003c20 0x7f9db806e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbd000640 1 -- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db80c9b10 msgr2=0x7f9db81f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbd000640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db80c9b10 0x7f9db81f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbd000640 1 -- 172.21.15.17:0/1728666171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db806fc60 con 0x7f9db80c8de0 2024-09-10T23:27:09.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9db7e00640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d9c003c20 0x7f9db806e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:09.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9daf400640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db80c9b10 0x7f9db81f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:09.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbd000640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9db80c8de0 0x7f9db80c9290 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f9db0001340 tx=0x7f9db000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:09.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9db4c00640 1 -- 172.21.15.17:0/1728666171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db000cbc0 con 0x7f9db80c8de0 2024-09-10T23:27:09.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9db4c00640 1 -- 172.21.15.17:0/1728666171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9db0018070 con 0x7f9db80c8de0 2024-09-10T23:27:09.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db806ebc0 con 0x7f9db80c8de0 2024-09-10T23:27:09.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9db4c00640 1 -- 172.21.15.17:0/1728666171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db00116c0 con 0x7f9db80c8de0 2024-09-10T23:27:09.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db806f180 con 0x7f9db80c8de0 2024-09-10T23:27:09.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.941+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db80cfaf0 con 0x7f9db80c8de0 2024-09-10T23:27:09.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.945+0000 7f9db4c00640 1 -- 172.21.15.17:0/1728666171 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9db0011860 con 0x7f9db80c8de0 2024-09-10T23:27:09.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.945+0000 7f9db4c00640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d94072610 0x7f9d94074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:09.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.945+0000 7f9db4c00640 1 -- 172.21.15.17:0/1728666171 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f9db0093520 con 0x7f9db80c8de0 2024-09-10T23:27:09.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.945+0000 7f9db7e00640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d94072610 0x7f9d94074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:09.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.945+0000 7f9db7e00640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d94072610 0x7f9d94074ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9da80ac000 tx=0x7f9da801be90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:09.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:09.949+0000 7f9db4c00640 1 -- 172.21.15.17:0/1728666171 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9db005ecd0 con 0x7f9db80c8de0 2024-09-10T23:27:10.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:10.185+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f9db8074af0 con 0x7f9db80c8de0 2024-09-10T23:27:11.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9db4c00640 1 -- 172.21.15.17:0/1728666171 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v541) ==== 169+0+0 (secure 0 0 0) 0x7f9db00673f0 con 0x7f9db80c8de0 2024-09-10T23:27:11.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d94072610 msgr2=0x7f9d94074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d94072610 0x7f9d94074ad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9da80ac000 tx=0x7f9da801be90 comp rx=0 tx=0).stop 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9db80c8de0 msgr2=0x7f9db80c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9db80c8de0 0x7f9db80c9290 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f9db0001340 tx=0x7f9db000ed10 comp rx=0 tx=0).stop 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 shutdown_connections 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d94072610 0x7f9d94074ad0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9db80c8de0 0x7f9db80c9290 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9db80c9b10 0x7f9db81f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 --2- 172.21.15.17:0/1728666171 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d9c003c20 0x7f9db806e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.037+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 >> 172.21.15.17:0/1728666171 conn(0x7f9db80d1d10 msgr2=0x7f9db80b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.041+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 shutdown_connections 2024-09-10T23:27:11.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.041+0000 7f9dbf000640 1 -- 172.21.15.17:0/1728666171 wait complete. 2024-09-10T23:27:11.067 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:27:11.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.213+0000 7f52fd000640 1 -- 172.21.15.17:0/2836280825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 msgr2=0x7f52f80d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.213+0000 7f52fd000640 1 --2- 172.21.15.17:0/2836280825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 0x7f52f80d0470 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f52f80b3be0 tx=0x7f52f001cba0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.213+0000 7f52fd000640 1 -- 172.21.15.17:0/2836280825 shutdown_connections 2024-09-10T23:27:11.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.213+0000 7f52fd000640 1 --2- 172.21.15.17:0/2836280825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 0x7f52f80d0470 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.213+0000 7f52fd000640 1 --2- 172.21.15.17:0/2836280825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f815f270 0x7f52f815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.213+0000 7f52fd000640 1 -- 172.21.15.17:0/2836280825 >> 172.21.15.17:0/2836280825 conn(0x7f52f806cfc0 msgr2=0x7f52f806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:11.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.213+0000 7f52fd000640 1 -- 172.21.15.17:0/2836280825 shutdown_connections 2024-09-10T23:27:11.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.213+0000 7f52fd000640 1 -- 172.21.15.17:0/2836280825 wait complete. 2024-09-10T23:27:11.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 Processor -- start 2024-09-10T23:27:11.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 -- start start 2024-09-10T23:27:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 0x7f52f8136e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f815e5d0 0x7f52f814e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815f270 0x7f52f815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52f8167b40 con 0x7f52f80cffc0 2024-09-10T23:27:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52f81679c0 con 0x7f52f815f270 2024-09-10T23:27:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52f8167cc0 con 0x7f52f815e5d0 2024-09-10T23:27:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 0x7f52f8136e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 0x7f52f8136e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49830/0 (socket says 172.21.15.17:49830) 2024-09-10T23:27:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f5e00640 1 -- 172.21.15.17:0/736380061 learned_addr learned my addr 172.21.15.17:0/736380061 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52efe00640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f815e5d0 0x7f52f814e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f6800640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815f270 0x7f52f815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f5e00640 1 -- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f815e5d0 msgr2=0x7f52f814e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f5e00640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f815e5d0 0x7f52f814e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f5e00640 1 -- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815f270 msgr2=0x7f52f815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f5e00640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815f270 0x7f52f815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f5e00640 1 -- 172.21.15.17:0/736380061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f815edb0 con 0x7f52f80cffc0 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52efe00640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f815e5d0 0x7f52f814e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52f5e00640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 0x7f52f8136e30 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f52e800e7d0 tx=0x7f52e800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52ee000640 1 -- 172.21.15.17:0/736380061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e800ccc0 con 0x7f52f80cffc0 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52ee000640 1 -- 172.21.15.17:0/736380061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52e8010430 con 0x7f52f80cffc0 2024-09-10T23:27:11.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52ee000640 1 -- 172.21.15.17:0/736380061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8010860 con 0x7f52f80cffc0 2024-09-10T23:27:11.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f81fab20 con 0x7f52f80cffc0 2024-09-10T23:27:11.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.217+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f81fb0e0 con 0x7f52f80cffc0 2024-09-10T23:27:11.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.221+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f80d0470 con 0x7f52f80cffc0 2024-09-10T23:27:11.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.221+0000 7f52ee000640 1 -- 172.21.15.17:0/736380061 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f52e8010a00 con 0x7f52f80cffc0 2024-09-10T23:27:11.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.221+0000 7f52ee000640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52d40725e0 0x7f52d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:11.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.221+0000 7f52ee000640 1 -- 172.21.15.17:0/736380061 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f52e8093ad0 con 0x7f52f80cffc0 2024-09-10T23:27:11.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.221+0000 7f52efe00640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52d40725e0 0x7f52d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:11.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.225+0000 7f52efe00640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52d40725e0 0x7f52d4074aa0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f52e0007fd0 tx=0x7f52e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:11.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.225+0000 7f52ee000640 1 -- 172.21.15.17:0/736380061 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f52e805f310 con 0x7f52f80cffc0 2024-09-10T23:27:11.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f52f814d020 con 0x7f52f80cffc0 2024-09-10T23:27:11.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52ee000640 1 -- 172.21.15.17:0/736380061 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v53) ==== 59+0+1998 (secure 0 0 0) 0x7f52e805ec10 con 0x7f52f80cffc0 2024-09-10T23:27:11.405 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:27:11.406 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:27:11.407 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:27:11.408 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:27:11.408 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:27:11.408 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:27:11.408 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52d40725e0 msgr2=0x7f52d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52d40725e0 0x7f52d4074aa0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f52e0007fd0 tx=0x7f52e0009040 comp rx=0 tx=0).stop 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 msgr2=0x7f52f8136e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 0x7f52f8136e30 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f52e800e7d0 tx=0x7f52e800ec90 comp rx=0 tx=0).stop 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 shutdown_connections 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52d40725e0 0x7f52d4074aa0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52f815f270 0x7f52f815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52f815e5d0 0x7f52f814e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 --2- 172.21.15.17:0/736380061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52f80cffc0 0x7f52f8136e30 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.401+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 >> 172.21.15.17:0/736380061 conn(0x7f52f806cfc0 msgr2=0x7f52f8152570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:11.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.405+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 shutdown_connections 2024-09-10T23:27:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.405+0000 7f52fd000640 1 -- 172.21.15.17:0/736380061 wait complete. 2024-09-10T23:27:11.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:27:11.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 -- 172.21.15.17:0/4259101491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff09015fe80 msgr2=0x7ff090072c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 --2- 172.21.15.17:0/4259101491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff09015fe80 0x7ff090072c50 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7ff0900708a0 tx=0x7ff08801cd80 comp rx=0 tx=0).stop 2024-09-10T23:27:11.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 -- 172.21.15.17:0/4259101491 shutdown_connections 2024-09-10T23:27:11.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 --2- 172.21.15.17:0/4259101491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff09015fe80 0x7ff090072c50 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 --2- 172.21.15.17:0/4259101491 >> v2:172.21.15.77:3300/0 conn(0x7ff090145800 0x7ff0900741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 -- 172.21.15.17:0/4259101491 >> 172.21.15.17:0/4259101491 conn(0x7ff0900b17a0 msgr2=0x7ff0900b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:11.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 -- 172.21.15.17:0/4259101491 shutdown_connections 2024-09-10T23:27:11.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 -- 172.21.15.17:0/4259101491 wait complete. 2024-09-10T23:27:11.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 Processor -- start 2024-09-10T23:27:11.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.573+0000 7ff098600640 1 -- start start 2024-09-10T23:27:11.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff098600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff090145800 0x7ff090156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff098600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff09015fe80 0x7ff09012ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff098600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff090160460 0x7ff09013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff098600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff090169330 con 0x7ff090160460 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff098600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0901691b0 con 0x7ff090145800 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff098600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff0901694b0 con 0x7ff09015fe80 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff096600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff090160460 0x7ff09013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff096600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff090160460 0x7ff09013f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49840/0 (socket says 172.21.15.17:49840) 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff096600640 1 -- 172.21.15.17:0/73705037 learned_addr learned my addr 172.21.15.17:0/73705037 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff095c00640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff090145800 0x7ff090156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff095200640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff09015fe80 0x7ff09012ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff096600640 1 -- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff09015fe80 msgr2=0x7ff09012ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff096600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff09015fe80 0x7ff09012ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff096600640 1 -- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff090145800 msgr2=0x7ff090156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff096600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff090145800 0x7ff090156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff096600640 1 -- 172.21.15.17:0/73705037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff090140810 con 0x7ff090160460 2024-09-10T23:27:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff095200640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff09015fe80 0x7ff09012ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff096600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff090160460 0x7ff09013f9d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7ff088019990 tx=0x7ff088009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:11.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff08d600640 1 -- 172.21.15.17:0/73705037 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0880bb070 con 0x7ff090160460 2024-09-10T23:27:11.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff08d600640 1 -- 172.21.15.17:0/73705037 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff088004d40 con 0x7ff090160460 2024-09-10T23:27:11.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff08d600640 1 -- 172.21.15.17:0/73705037 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0880b2040 con 0x7ff090160460 2024-09-10T23:27:11.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff090161480 con 0x7ff090160460 2024-09-10T23:27:11.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09013f1d0 con 0x7ff090160460 2024-09-10T23:27:11.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.577+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0900741d0 con 0x7ff090160460 2024-09-10T23:27:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.581+0000 7ff08d600640 1 -- 172.21.15.17:0/73705037 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff0880b5030 con 0x7ff090160460 2024-09-10T23:27:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.581+0000 7ff08d600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0700725e0 0x7ff070074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.581+0000 7ff08d600640 1 -- 172.21.15.17:0/73705037 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7ff08812ca90 con 0x7ff090160460 2024-09-10T23:27:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.581+0000 7ff095c00640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0700725e0 0x7ff070074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.581+0000 7ff095c00640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0700725e0 0x7ff070074aa0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff084009be0 tx=0x7ff0840091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:11.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.585+0000 7ff08d600640 1 -- 172.21.15.17:0/73705037 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff090140810 con 0x7ff090160460 2024-09-10T23:27:11.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.757+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff090156590 con 0x7ff090160460 2024-09-10T23:27:11.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.761+0000 7ff08d600640 1 -- 172.21.15.17:0/73705037 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v54)=0 v54) ==== 122+0+0 (secure 0 0 0) 0x7ff088016970 con 0x7ff090160460 2024-09-10T23:27:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0700725e0 msgr2=0x7ff070074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0700725e0 0x7ff070074aa0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff084009be0 tx=0x7ff0840091e0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff090160460 msgr2=0x7ff09013f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff090160460 0x7ff09013f9d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7ff088019990 tx=0x7ff088009300 comp rx=0 tx=0).stop 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 shutdown_connections 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0700725e0 0x7ff070074aa0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff090160460 0x7ff09013f9d0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff09015fe80 0x7ff09012ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 --2- 172.21.15.17:0/73705037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff090145800 0x7ff090156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 >> 172.21.15.17:0/73705037 conn(0x7ff0900b17a0 msgr2=0x7ff09006ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 shutdown_connections 2024-09-10T23:27:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:11.765+0000 7ff098600640 1 -- 172.21.15.17:0/73705037 wait complete. 2024-09-10T23:27:11.789 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:27:11.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:27:11.874 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:27:11.981 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:27:11.981 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:27:11.981 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:27:11.990 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:27:11.990 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:27:11.990 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:27:12.000 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:27:12.000 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:27:12.000 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:27:12.039 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:27:12.039 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:27:12.039 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:27:12.055 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:27:12.055 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:27:12.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:12.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 -- 172.21.15.17:0/1908451719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7554160280 msgr2=0x7f75540cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:12.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 --2- 172.21.15.17:0/1908451719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7554160280 0x7f75540cfaf0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f75540c8d90 tx=0x7f754401f0b0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 -- 172.21.15.17:0/1908451719 shutdown_connections 2024-09-10T23:27:12.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 --2- 172.21.15.17:0/1908451719 >> v2:172.21.15.77:3300/0 conn(0x7f75540d2830 0x7f75540d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 --2- 172.21.15.17:0/1908451719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7554160280 0x7f75540cfaf0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 -- 172.21.15.17:0/1908451719 >> 172.21.15.17:0/1908451719 conn(0x7f75540d1d10 msgr2=0x7f75540d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:12.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 -- 172.21.15.17:0/1908451719 shutdown_connections 2024-09-10T23:27:12.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 -- 172.21.15.17:0/1908451719 wait complete. 2024-09-10T23:27:12.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 Processor -- start 2024-09-10T23:27:12.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 -- start start 2024-09-10T23:27:12.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75540d2830 0x7f75540cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:12.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554160280 0x7f75540c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:12.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554160660 0x7f7554150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:12.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f75540afe30 con 0x7f75540d2830 2024-09-10T23:27:12.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75540afcb0 con 0x7f7554160660 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7558e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f75540affb0 con 0x7f7554160280 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7551e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75540d2830 0x7f75540cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7551e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75540d2830 0x7f75540cba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49858/0 (socket says 172.21.15.17:49858) 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7551e00640 1 -- 172.21.15.17:0/1585837404 learned_addr learned my addr 172.21.15.17:0/1585837404 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f754be00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554160280 0x7f75540c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7552800640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554160660 0x7f7554150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7551e00640 1 -- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554160280 msgr2=0x7f75540c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7551e00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554160280 0x7f75540c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7551e00640 1 -- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554160660 msgr2=0x7f7554150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7551e00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554160660 0x7f7554150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.225+0000 7f7551e00640 1 -- 172.21.15.17:0/1585837404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75540cd780 con 0x7f75540d2830 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.229+0000 7f7551e00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75540d2830 0x7f75540cba50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f75440b3040 tx=0x7f7544005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.229+0000 7f754a000640 1 -- 172.21.15.17:0/1585837404 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75440be070 con 0x7f75540d2830 2024-09-10T23:27:12.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.229+0000 7f754a000640 1 -- 172.21.15.17:0/1585837404 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75440053e0 con 0x7f75540d2830 2024-09-10T23:27:12.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.229+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75540cda60 con 0x7f75540d2830 2024-09-10T23:27:12.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.229+0000 7f754a000640 1 -- 172.21.15.17:0/1585837404 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75440b5040 con 0x7f75540d2830 2024-09-10T23:27:12.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.229+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75540ce020 con 0x7f75540d2830 2024-09-10T23:27:12.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.229+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75540b04a0 con 0x7f75540d2830 2024-09-10T23:27:12.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.229+0000 7f754a000640 1 -- 172.21.15.17:0/1585837404 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f75440b8030 con 0x7f75540d2830 2024-09-10T23:27:12.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.233+0000 7f754a000640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75300725e0 0x7f7530074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:12.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.233+0000 7f754a000640 1 -- 172.21.15.17:0/1585837404 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f754412ff50 con 0x7f75540d2830 2024-09-10T23:27:12.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.233+0000 7f754be00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75300725e0 0x7f7530074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:12.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.233+0000 7f754be00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75300725e0 0x7f7530074aa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f753c0058d0 tx=0x7f753c005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:12.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.237+0000 7f754a000640 1 -- 172.21.15.17:0/1585837404 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7544018c10 con 0x7f75540d2830 2024-09-10T23:27:12.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.445+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7554074af0 con 0x7f75540d2830 2024-09-10T23:27:12.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.445+0000 7f754a000640 1 -- 172.21.15.17:0/1585837404 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+3907 (secure 0 0 0) 0x7f75440fb790 con 0x7f75540d2830 2024-09-10T23:27:12.450 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:12.450 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":114,"btime":"2024-09-10T23:27:06:020414+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7850,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2059532966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2059532966},{"type":"v1","addr":"172.21.15.17:6835","nonce":2059532966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/845345083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":845345083},{"type":"v1","addr":"172.21.15.77:6836","nonce":845345083}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8524,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/29897070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":29897070},{"type":"v1","addr":"172.21.15.77:6837","nonce":29897070}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9198,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/2539528954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":2539528954},{"type":"v1","addr":"172.21.15.17:6834","nonce":2539528954}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[]} 2024-09-10T23:27:12.451 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 114 2024-09-10T23:27:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75300725e0 msgr2=0x7f7530074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75300725e0 0x7f7530074aa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f753c0058d0 tx=0x7f753c005860 comp rx=0 tx=0).stop 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75540d2830 msgr2=0x7f75540cba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75540d2830 0x7f75540cba50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f75440b3040 tx=0x7f7544005760 comp rx=0 tx=0).stop 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 shutdown_connections 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f75300725e0 0x7f7530074aa0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554160660 0x7f7554150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7554160280 0x7f75540c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 --2- 172.21.15.17:0/1585837404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75540d2830 0x7f75540cba50 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 >> 172.21.15.17:0/1585837404 conn(0x7f75540d1d10 msgr2=0x7f75540cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 shutdown_connections 2024-09-10T23:27:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.449+0000 7f7558e00640 1 -- 172.21.15.17:0/1585837404 wait complete. 2024-09-10T23:27:12.472 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:27:12.473 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:27:12.473 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:27:12.473 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:27:12.473 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:27:12.473 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:27:12.473 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:27:12.473 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:27:12.474 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:27:12.474 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:27:12.474 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:27:12.474 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:27:12.474 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:27:12.474 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:27:12.475 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:27:12.475 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:27:12.486 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:27:12.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:27:12.488 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:27:12.488 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:27:12.491 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:27:12.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:27:12.492 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:27:12.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:27:12.533 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:27:12.534 DEBUG:teuthology.parallel:result is None 2024-09-10T23:27:12.535 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:27:12.536 DEBUG:teuthology.parallel:result is None 2024-09-10T23:27:12.541 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:27:12.541 DEBUG:teuthology.parallel:result is None 2024-09-10T23:27:12.542 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:27:12.542 DEBUG:teuthology.parallel:result is None 2024-09-10T23:27:12.543 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:27:12.619 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:27:12.620 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:27:12.633 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:27:12.635 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:27:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 -- 172.21.15.17:0/2954787265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 msgr2=0x7f49980d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 --2- 172.21.15.17:0/2954787265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 0x7f49980d28c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4988009840 tx=0x7f498801c790 comp rx=0 tx=0).stop 2024-09-10T23:27:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 -- 172.21.15.17:0/2954787265 shutdown_connections 2024-09-10T23:27:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 --2- 172.21.15.17:0/2954787265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 0x7f49980d28c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 -- 172.21.15.17:0/2954787265 >> 172.21.15.17:0/2954787265 conn(0x7f49980d1da0 msgr2=0x7f49980d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 -- 172.21.15.17:0/2954787265 shutdown_connections 2024-09-10T23:27:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 -- 172.21.15.17:0/2954787265 wait complete. 2024-09-10T23:27:12.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 Processor -- start 2024-09-10T23:27:12.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 -- start start 2024-09-10T23:27:12.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 0x7f49980cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f499815fa00 0x7f4998153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4998154580 0x7f4998165280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f499816a770 con 0x7f4998154580 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49980b5490 con 0x7f499815be80 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f499d800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f499816a8f0 con 0x7f499815fa00 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f4996a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 0x7f49980cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f4997400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4998154580 0x7f4998165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f4996a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 0x7f49980cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:35184/0 (socket says 172.21.15.17:35184) 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.693+0000 7f4996a00640 1 -- 172.21.15.17:0/640853946 learned_addr learned my addr 172.21.15.17:0/640853946 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f498e000640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f499815fa00 0x7f4998153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f4996a00640 1 -- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f499815fa00 msgr2=0x7f4998153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f4996a00640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f499815fa00 0x7f4998153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f4996a00640 1 -- 172.21.15.17:0/640853946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4998154580 msgr2=0x7f4998165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f4996a00640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4998154580 0x7f4998165280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f4996a00640 1 -- 172.21.15.17:0/640853946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49981586e0 con 0x7f499815be80 2024-09-10T23:27:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f4996a00640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 0x7f49980cd2c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4988000c10 tx=0x7f49880a6670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f498f400640 1 -- 172.21.15.17:0/640853946 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49880050c0 con 0x7f499815be80 2024-09-10T23:27:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f498f400640 1 -- 172.21.15.17:0/640853946 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4988005260 con 0x7f499815be80 2024-09-10T23:27:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4998157e40 con 0x7f499815be80 2024-09-10T23:27:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f498f400640 1 -- 172.21.15.17:0/640853946 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988005650 con 0x7f499815be80 2024-09-10T23:27:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4998158400 con 0x7f499815be80 2024-09-10T23:27:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49980d28c0 con 0x7f499815be80 2024-09-10T23:27:12.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.697+0000 7f498f400640 1 -- 172.21.15.17:0/640853946 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f49880d9bc0 con 0x7f499815be80 2024-09-10T23:27:12.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.701+0000 7f498f400640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4974072780 0x7f4974074c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:12.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.701+0000 7f498f400640 1 -- 172.21.15.17:0/640853946 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5335+0+0 (secure 0 0 0) 0x7f498812cd40 con 0x7f499815be80 2024-09-10T23:27:12.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.701+0000 7f498e000640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4974072780 0x7f4974074c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:12.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.701+0000 7f498e000640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4974072780 0x7f4974074c40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4998071a10 tx=0x7f4980007cd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:12.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.701+0000 7f498f400640 1 -- 172.21.15.17:0/640853946 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f49880ac030 con 0x7f499815be80 2024-09-10T23:27:12.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:12.889+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f49980c8be0 con 0x7f499815be80 2024-09-10T23:27:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.065+0000 7f498f400640 1 -- 172.21.15.17:0/640853946 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v160) ==== 97+0+0 (secure 0 0 0) 0x7f4988016410 con 0x7f499815be80 2024-09-10T23:27:13.069 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:27:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4974072780 msgr2=0x7f4974074c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4974072780 0x7f4974074c40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4998071a10 tx=0x7f4980007cd0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 msgr2=0x7f49980cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 0x7f49980cd2c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4988000c10 tx=0x7f49880a6670 comp rx=0 tx=0).stop 2024-09-10T23:27:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 shutdown_connections 2024-09-10T23:27:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4974072780 0x7f4974074c40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4998154580 0x7f4998165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f499815fa00 0x7f4998153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 --2- 172.21.15.17:0/640853946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f499815be80 0x7f49980cd2c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 >> 172.21.15.17:0/640853946 conn(0x7f49980d1da0 msgr2=0x7f49980b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:13.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 shutdown_connections 2024-09-10T23:27:13.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.069+0000 7f499d800640 1 -- 172.21.15.17:0/640853946 wait complete. 2024-09-10T23:27:13.093 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:27:13.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.233+0000 7f4ae8000640 1 -- 172.21.15.17:0/2895567479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cf340 msgr2=0x7f4ae015e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.233+0000 7f4ae8000640 1 --2- 172.21.15.17:0/2895567479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cf340 0x7f4ae015e040 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009c80 tx=0x7f4ad801cda0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.233+0000 7f4ae8000640 1 -- 172.21.15.17:0/2895567479 shutdown_connections 2024-09-10T23:27:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.233+0000 7f4ae8000640 1 --2- 172.21.15.17:0/2895567479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cf340 0x7f4ae015e040 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.233+0000 7f4ae8000640 1 --2- 172.21.15.17:0/2895567479 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ae00b4390 0x7f4ae015db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.233+0000 7f4ae8000640 1 -- 172.21.15.17:0/2895567479 >> 172.21.15.17:0/2895567479 conn(0x7f4ae00b3870 msgr2=0x7f4ae00b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.233+0000 7f4ae8000640 1 -- 172.21.15.17:0/2895567479 shutdown_connections 2024-09-10T23:27:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.233+0000 7f4ae8000640 1 -- 172.21.15.17:0/2895567479 wait complete. 2024-09-10T23:27:13.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 Processor -- start 2024-09-10T23:27:13.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 -- start start 2024-09-10T23:27:13.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ae00b4390 0x7f4ae0153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:13.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cef60 0x7f4ae0157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:13.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ae00cf340 0x7f4ae0154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:13.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0168ed0 con 0x7f4ae00cef60 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0071ce0 con 0x7f4ae00b4390 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae0169050 con 0x7f4ae00cf340 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cef60 0x7f4ae0157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cef60 0x7f4ae0157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49914/0 (socket says 172.21.15.17:49914) 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae4c00640 1 -- 172.21.15.17:0/1279033883 learned_addr learned my addr 172.21.15.17:0/1279033883 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae6000640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ae00cf340 0x7f4ae0154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae5600640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ae00b4390 0x7f4ae0153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae4c00640 1 -- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ae00cf340 msgr2=0x7f4ae0154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae4c00640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ae00cf340 0x7f4ae0154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae4c00640 1 -- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ae00b4390 msgr2=0x7f4ae0153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae4c00640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ae00b4390 0x7f4ae0153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae4c00640 1 -- 172.21.15.17:0/1279033883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae0155810 con 0x7f4ae00cef60 2024-09-10T23:27:13.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae4c00640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cef60 0x7f4ae0157b30 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00d980 tx=0x7f4acc00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4add600640 1 -- 172.21.15.17:0/1279033883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc017070 con 0x7f4ae00cef60 2024-09-10T23:27:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4add600640 1 -- 172.21.15.17:0/1279033883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4acc009d20 con 0x7f4ae00cef60 2024-09-10T23:27:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae0156d70 con 0x7f4ae00cef60 2024-09-10T23:27:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4add600640 1 -- 172.21.15.17:0/1279033883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc004280 con 0x7f4ae00cef60 2024-09-10T23:27:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.237+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae0157330 con 0x7f4ae00cef60 2024-09-10T23:27:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.241+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae0157760 con 0x7f4ae00cef60 2024-09-10T23:27:13.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.241+0000 7f4add600640 1 -- 172.21.15.17:0/1279033883 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4acc003600 con 0x7f4ae00cef60 2024-09-10T23:27:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.241+0000 7f4add600640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ac00725e0 0x7f4ac0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.241+0000 7f4add600640 1 -- 172.21.15.17:0/1279033883 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5249+0+0 (secure 0 0 0) 0x7f4acc0934e0 con 0x7f4ae00cef60 2024-09-10T23:27:13.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.241+0000 7f4ae5600640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ac00725e0 0x7f4ac0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:13.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.241+0000 7f4ae5600640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ac00725e0 0x7f4ac0074aa0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000f70 tx=0x7f4ad4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:13.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.245+0000 7f4add600640 1 -- 172.21.15.17:0/1279033883 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4ae0155810 con 0x7f4ae00cef60 2024-09-10T23:27:13.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4ae00cfd90 con 0x7f4ae00cef60 2024-09-10T23:27:13.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4add600640 1 -- 172.21.15.17:0/1279033883 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7f4acc05e720 con 0x7f4ae00cef60 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:27:13.487 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:27:13.488 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:27:13.489 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:27:13.490 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.491 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:27:13.492 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.494 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:27:13.495 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:27:13.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.499 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:27:13.499 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:27:13.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ac00725e0 msgr2=0x7f4ac0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ac00725e0 0x7f4ac0074aa0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000f70 tx=0x7f4ad4009040 comp rx=0 tx=0).stop 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cef60 msgr2=0x7f4ae0157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cef60 0x7f4ae0157b30 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00d980 tx=0x7f4acc00de40 comp rx=0 tx=0).stop 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 shutdown_connections 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ac00725e0 0x7f4ac0074aa0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ae00cf340 0x7f4ae0154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae00cef60 0x7f4ae0157b30 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 --2- 172.21.15.17:0/1279033883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ae00b4390 0x7f4ae0153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 >> 172.21.15.17:0/1279033883 conn(0x7f4ae00b3870 msgr2=0x7f4ae00cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 shutdown_connections 2024-09-10T23:27:13.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.481+0000 7f4ae8000640 1 -- 172.21.15.17:0/1279033883 wait complete. 2024-09-10T23:27:13.506 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:27:13.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 -- 172.21.15.17:0/1641026013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 msgr2=0x7f5d4415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 --2- 172.21.15.17:0/1641026013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 0x7f5d4415f060 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f5d440cf010 tx=0x7f5d3401c8e0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 -- 172.21.15.17:0/1641026013 shutdown_connections 2024-09-10T23:27:13.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 --2- 172.21.15.17:0/1641026013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d440d1830 0x7f5d4415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 --2- 172.21.15.17:0/1641026013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 0x7f5d4415f060 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 -- 172.21.15.17:0/1641026013 >> 172.21.15.17:0/1641026013 conn(0x7f5d440d1d60 msgr2=0x7f5d440d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:13.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 -- 172.21.15.17:0/1641026013 shutdown_connections 2024-09-10T23:27:13.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 -- 172.21.15.17:0/1641026013 wait complete. 2024-09-10T23:27:13.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 Processor -- start 2024-09-10T23:27:13.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 -- start start 2024-09-10T23:27:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 0x7f5d4406f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d440cf320 0x7f5d441fc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d440d1830 0x7f5d441f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441693d0 con 0x7f5d44070ad0 2024-09-10T23:27:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d44169250 con 0x7f5d440cf320 2024-09-10T23:27:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d4ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d44169550 con 0x7f5d440d1830 2024-09-10T23:27:13.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d43e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 0x7f5d4406f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d43e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 0x7f5d4406f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49928/0 (socket says 172.21.15.17:49928) 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d43e00640 1 -- 172.21.15.17:0/3661075811 learned_addr learned my addr 172.21.15.17:0/3661075811 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d3be00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d440cf320 0x7f5d441fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d48c00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d440d1830 0x7f5d441f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d43e00640 1 -- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d440d1830 msgr2=0x7f5d441f7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d43e00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d440d1830 0x7f5d441f7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d43e00640 1 -- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d440cf320 msgr2=0x7f5d441fc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d43e00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d440cf320 0x7f5d441fc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d43e00640 1 -- 172.21.15.17:0/3661075811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d441640b0 con 0x7f5d44070ad0 2024-09-10T23:27:13.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.649+0000 7f5d3be00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d440cf320 0x7f5d441fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d43e00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 0x7f5d4406f4b0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f5d340b0040 tx=0x7f5d340a57c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d40c00640 1 -- 172.21.15.17:0/3661075811 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340b2040 con 0x7f5d44070ad0 2024-09-10T23:27:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d40c00640 1 -- 172.21.15.17:0/3661075811 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d340053e0 con 0x7f5d44070ad0 2024-09-10T23:27:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d40c00640 1 -- 172.21.15.17:0/3661075811 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340046d0 con 0x7f5d44070ad0 2024-09-10T23:27:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d44164390 con 0x7f5d44070ad0 2024-09-10T23:27:13.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d441fbb30 con 0x7f5d44070ad0 2024-09-10T23:27:13.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d440cfc60 con 0x7f5d44070ad0 2024-09-10T23:27:13.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d40c00640 1 -- 172.21.15.17:0/3661075811 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5d34004870 con 0x7f5d44070ad0 2024-09-10T23:27:13.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d40c00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d200725d0 0x7f5d20074a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:13.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.653+0000 7f5d40c00640 1 -- 172.21.15.17:0/3661075811 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5249+0+0 (secure 0 0 0) 0x7f5d3412cc90 con 0x7f5d44070ad0 2024-09-10T23:27:13.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.657+0000 7f5d3be00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d200725d0 0x7f5d20074a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:13.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.657+0000 7f5d3be00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d200725d0 0x7f5d20074a90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c005fd0 tx=0x7f5d2c005f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.657+0000 7f5d40c00640 1 -- 172.21.15.17:0/3661075811 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5d340164d0 con 0x7f5d44070ad0 2024-09-10T23:27:13.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.833+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5d440d2630 con 0x7f5d44070ad0 2024-09-10T23:27:13.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.833+0000 7f5d40c00640 1 -- 172.21.15.17:0/3661075811 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v162) ==== 84+0+65 (secure 0 0 0) 0x7f5d340f7ed0 con 0x7f5d44070ad0 2024-09-10T23:27:13.839 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:13.840 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:27:13.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:27:13.840 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:27:13.840 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:27:13.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:13.840 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d200725d0 msgr2=0x7f5d20074a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d200725d0 0x7f5d20074a90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c005fd0 tx=0x7f5d2c005f20 comp rx=0 tx=0).stop 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 msgr2=0x7f5d4406f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 0x7f5d4406f4b0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f5d340b0040 tx=0x7f5d340a57c0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 shutdown_connections 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d200725d0 0x7f5d20074a90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d440d1830 0x7f5d441f7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d440cf320 0x7f5d441fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 --2- 172.21.15.17:0/3661075811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d44070ad0 0x7f5d4406f4b0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 >> 172.21.15.17:0/3661075811 conn(0x7f5d440d1d60 msgr2=0x7f5d440b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:13.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 shutdown_connections 2024-09-10T23:27:13.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:13.837+0000 7f5d4ac00640 1 -- 172.21.15.17:0/3661075811 wait complete. 2024-09-10T23:27:13.861 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:27:13.861 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:27:14.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 -- 172.21.15.17:0/624805679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 msgr2=0x7fe5380cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:14.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 --2- 172.21.15.17:0/624805679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 0x7fe5380cd080 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fe528009900 tx=0x7fe52801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:27:14.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 -- 172.21.15.17:0/624805679 shutdown_connections 2024-09-10T23:27:14.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 --2- 172.21.15.17:0/624805679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5380d0320 0x7fe5380d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:14.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 --2- 172.21.15.17:0/624805679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 0x7fe5380cd080 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:14.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 -- 172.21.15.17:0/624805679 >> 172.21.15.17:0/624805679 conn(0x7fe53809a9f0 msgr2=0x7fe53809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:14.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 -- 172.21.15.17:0/624805679 shutdown_connections 2024-09-10T23:27:14.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 -- 172.21.15.17:0/624805679 wait complete. 2024-09-10T23:27:14.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 Processor -- start 2024-09-10T23:27:14.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 -- start start 2024-09-10T23:27:14.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5380d0320 0x7fe5380b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:14.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5380d2210 0x7fe538150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:14.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 0x7fe538151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:14.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe538169010 con 0x7fe53815f210 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe538168e90 con 0x7fe5380d2210 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53fc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe538169190 con 0x7fe5380d0320 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 0x7fe538151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 0x7fe538151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49946/0 (socket says 172.21.15.17:49946) 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.009+0000 7fe53dc00640 1 -- 172.21.15.17:0/3986695115 learned_addr learned my addr 172.21.15.17:0/3986695115 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53d200640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5380d0320 0x7fe5380b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe52fe00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5380d2210 0x7fe538150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53dc00640 1 -- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5380d0320 msgr2=0x7fe5380b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53dc00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5380d0320 0x7fe5380b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53dc00640 1 -- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5380d2210 msgr2=0x7fe538150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53dc00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5380d2210 0x7fe538150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53dc00640 1 -- 172.21.15.17:0/3986695115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe538157cf0 con 0x7fe53815f210 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53dc00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 0x7fe538151470 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c7a0 tx=0x7fe53000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:14.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe535600640 1 -- 172.21.15.17:0/3986695115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530003b80 con 0x7fe53815f210 2024-09-10T23:27:14.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe535600640 1 -- 172.21.15.17:0/3986695115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe530003d40 con 0x7fe53815f210 2024-09-10T23:27:14.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe535600640 1 -- 172.21.15.17:0/3986695115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53000aab0 con 0x7fe53815f210 2024-09-10T23:27:14.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5380b0530 con 0x7fe53815f210 2024-09-10T23:27:14.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5380b0af0 con 0x7fe53815f210 2024-09-10T23:27:14.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5380d1cd0 con 0x7fe53815f210 2024-09-10T23:27:14.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.013+0000 7fe535600640 1 -- 172.21.15.17:0/3986695115 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe53000ac50 con 0x7fe53815f210 2024-09-10T23:27:14.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.017+0000 7fe535600640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe514072610 0x7fe514074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:14.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.017+0000 7fe535600640 1 -- 172.21.15.17:0/3986695115 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5249+0+0 (secure 0 0 0) 0x7fe530092e30 con 0x7fe53815f210 2024-09-10T23:27:14.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.017+0000 7fe53d200640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe514072610 0x7fe514074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:14.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.017+0000 7fe53d200640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe514072610 0x7fe514074ad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe5280af000 tx=0x7fe52801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:14.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.021+0000 7fe535600640 1 -- 172.21.15.17:0/3986695115 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe53005df50 con 0x7fe53815f210 2024-09-10T23:27:14.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:14.201+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe5380b7800 con 0x7fe53815f210 2024-09-10T23:27:15.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.061+0000 7fe535600640 1 -- 172.21.15.17:0/3986695115 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v163) ==== 138+0+0 (secure 0 0 0) 0x7fe530062980 con 0x7fe53815f210 2024-09-10T23:27:15.067 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:27:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe514072610 msgr2=0x7fe514074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe514072610 0x7fe514074ad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe5280af000 tx=0x7fe52801b120 comp rx=0 tx=0).stop 2024-09-10T23:27:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 msgr2=0x7fe538151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 0x7fe538151470 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c7a0 tx=0x7fe53000cc60 comp rx=0 tx=0).stop 2024-09-10T23:27:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 shutdown_connections 2024-09-10T23:27:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe514072610 0x7fe514074ad0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe53815f210 0x7fe538151470 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5380d2210 0x7fe538150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:15.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 --2- 172.21.15.17:0/3986695115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe5380d0320 0x7fe5380b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:15.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 >> 172.21.15.17:0/3986695115 conn(0x7fe53809a9f0 msgr2=0x7fe5380ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:15.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 shutdown_connections 2024-09-10T23:27:15.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.065+0000 7fe53fc00640 1 -- 172.21.15.17:0/3986695115 wait complete. 2024-09-10T23:27:15.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:27:15.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.253+0000 7f774e200640 1 -- 172.21.15.17:0/3798878545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77300051d0 msgr2=0x7f773000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:15.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.253+0000 7f774e200640 1 --2- 172.21.15.17:0/3798878545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77300051d0 0x7f773000b9d0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f7740001dc0 tx=0x7f774001cb30 comp rx=0 tx=0).stop 2024-09-10T23:27:15.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.253+0000 7f774e200640 1 -- 172.21.15.17:0/3798878545 shutdown_connections 2024-09-10T23:27:15.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.253+0000 7f774e200640 1 --2- 172.21.15.17:0/3798878545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77300051d0 0x7f773000b9d0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:15.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.253+0000 7f774e200640 1 -- 172.21.15.17:0/3798878545 >> 172.21.15.17:0/3798878545 conn(0x7f774809a9f0 msgr2=0x7f774809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:15.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.253+0000 7f774e200640 1 -- 172.21.15.17:0/3798878545 shutdown_connections 2024-09-10T23:27:15.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.253+0000 7f774e200640 1 -- 172.21.15.17:0/3798878545 wait complete. 2024-09-10T23:27:15.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.253+0000 7f774e200640 1 Processor -- start 2024-09-10T23:27:15.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.253+0000 7f774e200640 1 -- start start 2024-09-10T23:27:15.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77300051d0 0x7f7748153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7748153b70 0x7f77480c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748156500 0x7f77481e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774e200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f77480b2b50 con 0x7f7748153b70 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f77480b29d0 con 0x7f7748156500 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f77480b2cd0 con 0x7f77300051d0 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7747e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7748153b70 0x7f77480c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77300051d0 0x7f7748153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7747e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7748153b70 0x7f77480c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49966/0 (socket says 172.21.15.17:49966) 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7747e00640 1 -- 172.21.15.17:0/1900177028 learned_addr learned my addr 172.21.15.17:0/1900177028 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774d800640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748156500 0x7f77481e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7747e00640 1 -- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77300051d0 msgr2=0x7f7748153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7747e00640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77300051d0 0x7f7748153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7747e00640 1 -- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748156500 msgr2=0x7f77481e63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7747e00640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748156500 0x7f77481e63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7747e00640 1 -- 172.21.15.17:0/1900177028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7748154570 con 0x7f7748153b70 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774ce00640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77300051d0 0x7f7748153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7747e00640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7748153b70 0x7f77480c56f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f7734011b10 tx=0x7f7734009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7744c00640 1 -- 172.21.15.17:0/1900177028 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773401e070 con 0x7f7748153b70 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7744c00640 1 -- 172.21.15.17:0/1900177028 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f773400fbe0 con 0x7f7748153b70 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f7744c00640 1 -- 172.21.15.17:0/1900177028 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734019410 con 0x7f7748153b70 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7748154850 con 0x7f7748153b70 2024-09-10T23:27:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7748154e10 con 0x7f7748153b70 2024-09-10T23:27:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.257+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77480d0480 con 0x7f7748153b70 2024-09-10T23:27:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.261+0000 7f7744c00640 1 -- 172.21.15.17:0/1900177028 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f77340195b0 con 0x7f7748153b70 2024-09-10T23:27:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.261+0000 7f7744c00640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7728072610 0x7f7728074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.261+0000 7f7744c00640 1 -- 172.21.15.17:0/1900177028 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5619+0+0 (secure 0 0 0) 0x7f7734093c60 con 0x7f7748153b70 2024-09-10T23:27:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.261+0000 7f774ce00640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7728072610 0x7f7728074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.261+0000 7f774ce00640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7728072610 0x7f7728074ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f773c0060c0 tx=0x7f773c0067b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.265+0000 7f7744c00640 1 -- 172.21.15.17:0/1900177028 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f773405eca0 con 0x7f7748153b70 2024-09-10T23:27:15.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:15.437+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f77480b20e0 con 0x7f7748153b70 2024-09-10T23:27:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.065+0000 7f7744c00640 1 -- 172.21.15.17:0/1900177028 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v164) ==== 170+0+0 (secure 0 0 0) 0x7f77340636d0 con 0x7f7748153b70 2024-09-10T23:27:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:27:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7728072610 msgr2=0x7f7728074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7728072610 0x7f7728074ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f773c0060c0 tx=0x7f773c0067b0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7748153b70 msgr2=0x7f77480c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7748153b70 0x7f77480c56f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f7734011b10 tx=0x7f7734009e70 comp rx=0 tx=0).stop 2024-09-10T23:27:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 shutdown_connections 2024-09-10T23:27:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7728072610 0x7f7728074ad0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7748156500 0x7f77481e63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7748153b70 0x7f77480c56f0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 --2- 172.21.15.17:0/1900177028 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f77300051d0 0x7f7748153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 >> 172.21.15.17:0/1900177028 conn(0x7f774809a9f0 msgr2=0x7f7748071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:16.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.069+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 shutdown_connections 2024-09-10T23:27:16.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.073+0000 7f774e200640 1 -- 172.21.15.17:0/1900177028 wait complete. 2024-09-10T23:27:16.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:27:16.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 -- 172.21.15.17:0/2070164646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd800d23e0 msgr2=0x7fdd80071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 --2- 172.21.15.17:0/2070164646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd800d23e0 0x7fdd80071060 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009c80 tx=0x7fdd7801cda0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 -- 172.21.15.17:0/2070164646 shutdown_connections 2024-09-10T23:27:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 --2- 172.21.15.17:0/2070164646 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd800d23e0 0x7fdd80071060 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 --2- 172.21.15.17:0/2070164646 >> v2:172.21.15.77:3300/0 conn(0x7fdd8015f210 0x7fdd800cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 -- 172.21.15.17:0/2070164646 >> 172.21.15.17:0/2070164646 conn(0x7fdd8009a9f0 msgr2=0x7fdd8009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 -- 172.21.15.17:0/2070164646 shutdown_connections 2024-09-10T23:27:16.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 -- 172.21.15.17:0/2070164646 wait complete. 2024-09-10T23:27:16.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 Processor -- start 2024-09-10T23:27:16.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 -- start start 2024-09-10T23:27:16.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd800d0320 0x7fdd80152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:16.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd800d23e0 0x7fdd8015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:16.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f210 0x7fdd8015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:16.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80168b00 con 0x7fdd800d0320 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80072350 con 0x7fdd8015f210 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd88200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdd80168c80 con 0x7fdd800d23e0 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd85800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd800d0320 0x7fdd80152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd85800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd800d0320 0x7fdd80152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49972/0 (socket says 172.21.15.17:49972) 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd85800640 1 -- 172.21.15.17:0/1630202936 learned_addr learned my addr 172.21.15.17:0/1630202936 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd84e00640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd800d23e0 0x7fdd8015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.261+0000 7fdd86200640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f210 0x7fdd8015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd84e00640 1 -- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f210 msgr2=0x7fdd8015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd84e00640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f210 0x7fdd8015bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd84e00640 1 -- 172.21.15.17:0/1630202936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd800d0320 msgr2=0x7fdd80152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd84e00640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd800d0320 0x7fdd80152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd84e00640 1 -- 172.21.15.17:0/1630202936 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd801527a0 con 0x7fdd800d23e0 2024-09-10T23:27:16.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd85800640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd800d0320 0x7fdd80152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd84e00640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd800d23e0 0x7fdd8015bab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00c390 tx=0x7fdd6c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:16.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd7d600640 1 -- 172.21.15.17:0/1630202936 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c017070 con 0x7fdd800d23e0 2024-09-10T23:27:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd7d600640 1 -- 172.21.15.17:0/1630202936 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd6c0053c0 con 0x7fdd800d23e0 2024-09-10T23:27:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd7d600640 1 -- 172.21.15.17:0/1630202936 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c003840 con 0x7fdd800d23e0 2024-09-10T23:27:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd800b02d0 con 0x7fdd800d23e0 2024-09-10T23:27:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd800b0890 con 0x7fdd800d23e0 2024-09-10T23:27:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd80071060 con 0x7fdd800d23e0 2024-09-10T23:27:16.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd7d600640 1 -- 172.21.15.17:0/1630202936 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdd6c037a50 con 0x7fdd800d23e0 2024-09-10T23:27:16.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.265+0000 7fdd7d600640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd600725e0 0x7fdd60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:16.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.269+0000 7fdd7d600640 1 -- 172.21.15.17:0/1630202936 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(164..164 src has 1..164) ==== 6001+0+0 (secure 0 0 0) 0x7fdd6c092980 con 0x7fdd800d23e0 2024-09-10T23:27:16.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.269+0000 7fdd85800640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd600725e0 0x7fdd60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:16.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.269+0000 7fdd85800640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd600725e0 0x7fdd60074aa0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdd801fab40 tx=0x7fdd740091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:16.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.269+0000 7fdd7d600640 1 -- 172.21.15.17:0/1630202936 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdd6c05d8c0 con 0x7fdd800d23e0 2024-09-10T23:27:16.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:16.477+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fdd800b7000 con 0x7fdd800d23e0 2024-09-10T23:27:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.101+0000 7fdd7d600640 1 -- 172.21.15.17:0/1630202936 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v117) ==== 174+0+0 (secure 0 0 0) 0x7fdd6c0622f0 con 0x7fdd800d23e0 2024-09-10T23:27:17.112 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 23 and data pool 24 2024-09-10T23:27:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd600725e0 msgr2=0x7fdd60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd600725e0 0x7fdd60074aa0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdd801fab40 tx=0x7fdd740091e0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd800d23e0 msgr2=0x7fdd8015bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd800d23e0 0x7fdd8015bab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00c390 tx=0x7fdd6c00c850 comp rx=0 tx=0).stop 2024-09-10T23:27:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 shutdown_connections 2024-09-10T23:27:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd600725e0 0x7fdd60074aa0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f210 0x7fdd8015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd800d23e0 0x7fdd8015bab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 --2- 172.21.15.17:0/1630202936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd800d0320 0x7fdd80152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 >> 172.21.15.17:0/1630202936 conn(0x7fdd8009a9f0 msgr2=0x7fdd800b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 shutdown_connections 2024-09-10T23:27:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.113+0000 7fdd88200640 1 -- 172.21.15.17:0/1630202936 wait complete. 2024-09-10T23:27:17.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:27:17.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 -- 172.21.15.17:0/3314691587 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd100d1830 msgr2=0x7efd100ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 --2- 172.21.15.17:0/3314691587 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd100d1830 0x7efd100ccdb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd08009bc0 tx=0x7efd0801cba0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 -- 172.21.15.17:0/3314691587 shutdown_connections 2024-09-10T23:27:17.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 --2- 172.21.15.17:0/3314691587 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd100d1830 0x7efd100ccdb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 --2- 172.21.15.17:0/3314691587 >> v2:172.21.15.77:3300/0 conn(0x7efd1015f770 0x7efd100cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 -- 172.21.15.17:0/3314691587 >> 172.21.15.17:0/3314691587 conn(0x7efd100d1d60 msgr2=0x7efd100d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 -- 172.21.15.17:0/3314691587 shutdown_connections 2024-09-10T23:27:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 -- 172.21.15.17:0/3314691587 wait complete. 2024-09-10T23:27:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 Processor -- start 2024-09-10T23:27:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.293+0000 7efd14a00640 1 -- start start 2024-09-10T23:27:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd14a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd10070ad0 0x7efd101658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:17.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd14a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd100d1830 0x7efd101579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd14a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd1015f770 0x7efd10154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd14a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efd101693b0 con 0x7efd1015f770 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd14a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd10169230 con 0x7efd100d1830 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd14a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efd10169530 con 0x7efd10070ad0 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd1015f770 0x7efd10154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd1015f770 0x7efd10154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34932/0 (socket says 172.21.15.17:34932) 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0e800640 1 -- 172.21.15.17:0/559725442 learned_addr learned my addr 172.21.15.17:0/559725442 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0de00640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd10070ad0 0x7efd101658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0d400640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd100d1830 0x7efd101579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0e800640 1 -- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd10070ad0 msgr2=0x7efd101658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0e800640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd10070ad0 0x7efd101658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0e800640 1 -- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd100d1830 msgr2=0x7efd101579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0e800640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd100d1830 0x7efd101579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0e800640 1 -- 172.21.15.17:0/559725442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1006a240 con 0x7efd1015f770 2024-09-10T23:27:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd0e800640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd1015f770 0x7efd10154f80 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7efd0801a7d0 tx=0x7efd08003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd06000640 1 -- 172.21.15.17:0/559725442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd080b2040 con 0x7efd1015f770 2024-09-10T23:27:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd10157f30 con 0x7efd1015f770 2024-09-10T23:27:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd06000640 1 -- 172.21.15.17:0/559725442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd08004d40 con 0x7efd1015f770 2024-09-10T23:27:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd06000640 1 -- 172.21.15.17:0/559725442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08004210 con 0x7efd1015f770 2024-09-10T23:27:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd10165ed0 con 0x7efd1015f770 2024-09-10T23:27:17.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.297+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1015f060 con 0x7efd1015f770 2024-09-10T23:27:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.301+0000 7efd06000640 1 -- 172.21.15.17:0/559725442 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efd080b5070 con 0x7efd1015f770 2024-09-10T23:27:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.301+0000 7efd06000640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcf00725e0 0x7efcf0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.301+0000 7efd06000640 1 -- 172.21.15.17:0/559725442 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7efd0812cfa0 con 0x7efd1015f770 2024-09-10T23:27:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.301+0000 7efd0de00640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcf00725e0 0x7efcf0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:17.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.301+0000 7efd0de00640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcf00725e0 0x7efcf0074aa0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efd00001910 tx=0x7efd00001420 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:17.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.305+0000 7efd06000640 1 -- 172.21.15.17:0/559725442 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efd08016790 con 0x7efd1015f770 2024-09-10T23:27:17.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.485+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd100b01e0 con 0x7efd1015f770 2024-09-10T23:27:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.485+0000 7efd06000640 1 -- 172.21.15.17:0/559725442 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16897 (secure 0 0 0) 0x7efd080f7d80 con 0x7efd1015f770 2024-09-10T23:27:17.490 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:17.490 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":165,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:27:16.483997+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:27:14.215056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-10T23:27:15.453956+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:27:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcf00725e0 msgr2=0x7efcf0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcf00725e0 0x7efcf0074aa0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efd00001910 tx=0x7efd00001420 comp rx=0 tx=0).stop 2024-09-10T23:27:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd1015f770 msgr2=0x7efd10154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd1015f770 0x7efd10154f80 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7efd0801a7d0 tx=0x7efd08003f60 comp rx=0 tx=0).stop 2024-09-10T23:27:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 shutdown_connections 2024-09-10T23:27:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcf00725e0 0x7efcf0074aa0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd1015f770 0x7efd10154f80 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd100d1830 0x7efd101579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 --2- 172.21.15.17:0/559725442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd10070ad0 0x7efd101658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 >> 172.21.15.17:0/559725442 conn(0x7efd100d1d60 msgr2=0x7efd100b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:17.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 shutdown_connections 2024-09-10T23:27:17.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.489+0000 7efd14a00640 1 -- 172.21.15.17:0/559725442 wait complete. 2024-09-10T23:27:17.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:27:17.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.657+0000 7f988ce00640 1 -- 172.21.15.17:0/4188427408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986c004d50 msgr2=0x7f986c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.657+0000 7f988ce00640 1 --2- 172.21.15.17:0/4188427408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986c004d50 0x7f986c0051d0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f988806c9a0 tx=0x7f988001d590 comp rx=0 tx=0).stop 2024-09-10T23:27:17.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.657+0000 7f9886800640 1 -- 172.21.15.17:0/4188427408 reap_dead start 2024-09-10T23:27:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.657+0000 7f988ce00640 1 -- 172.21.15.17:0/4188427408 shutdown_connections 2024-09-10T23:27:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.657+0000 7f988ce00640 1 -- 172.21.15.17:0/4188427408 >> 172.21.15.17:0/4188427408 conn(0x7f98880d1d10 msgr2=0x7f98880d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.657+0000 7f988ce00640 1 -- 172.21.15.17:0/4188427408 shutdown_connections 2024-09-10T23:27:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.657+0000 7f988ce00640 1 -- 172.21.15.17:0/4188427408 wait complete. 2024-09-10T23:27:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.657+0000 7f988ce00640 1 Processor -- start 2024-09-10T23:27:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.657+0000 7f988ce00640 1 -- start start 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f988ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986c004d50 0x7f98881508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f988ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98881539e0 0x7f9888156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f988ce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98881f8120 0x7f98881f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f988ce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f98880b1d20 con 0x7f986c004d50 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f988ce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f98880b07c0 con 0x7f98881f8120 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f988ce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f98880b1ea0 con 0x7f98881539e0 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9885e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986c004d50 0x7f98881508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9885e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986c004d50 0x7f98881508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34962/0 (socket says 172.21.15.17:34962) 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9885e00640 1 -- 172.21.15.17:0/2244300858 learned_addr learned my addr 172.21.15.17:0/2244300858 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f987d400640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98881539e0 0x7f9888156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9886800640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98881f8120 0x7f98881f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9885e00640 1 -- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98881539e0 msgr2=0x7f9888156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9885e00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98881539e0 0x7f9888156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9885e00640 1 -- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98881f8120 msgr2=0x7f98881f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9885e00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98881f8120 0x7f98881f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9885e00640 1 -- 172.21.15.17:0/2244300858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9888153ec0 con 0x7f986c004d50 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f9885e00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986c004d50 0x7f98881508b0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f9878003f60 tx=0x7f9878003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f987ea00640 1 -- 172.21.15.17:0/2244300858 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878015070 con 0x7f986c004d50 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f987ea00640 1 -- 172.21.15.17:0/2244300858 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9878011900 con 0x7f986c004d50 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f987ea00640 1 -- 172.21.15.17:0/2244300858 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878011d30 con 0x7f986c004d50 2024-09-10T23:27:17.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98880cb8e0 con 0x7f986c004d50 2024-09-10T23:27:17.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98881f7c00 con 0x7f986c004d50 2024-09-10T23:27:17.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98880b1610 con 0x7f986c004d50 2024-09-10T23:27:17.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.661+0000 7f987ea00640 1 -- 172.21.15.17:0/2244300858 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f98780103c0 con 0x7f986c004d50 2024-09-10T23:27:17.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.665+0000 7f987ea00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9864072610 0x7f9864074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:17.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.665+0000 7f987ea00640 1 -- 172.21.15.17:0/2244300858 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f98780944b0 con 0x7f986c004d50 2024-09-10T23:27:17.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.665+0000 7f987d400640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9864072610 0x7f9864074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:17.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.665+0000 7f987d400640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9864072610 0x7f9864074ad0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9870001c40 tx=0x7f9870001b90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:17.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.669+0000 7f987ea00640 1 -- 172.21.15.17:0/2244300858 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f987805f9f0 con 0x7f986c004d50 2024-09-10T23:27:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.845+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9888074af0 con 0x7f986c004d50 2024-09-10T23:27:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f987ea00640 1 -- 172.21.15.17:0/2244300858 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16897 (secure 0 0 0) 0x7f987805f2f0 con 0x7f986c004d50 2024-09-10T23:27:17.852 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:17.852 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":165,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:27:16.483997+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:27:14.215056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-10T23:27:15.453956+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:27:17.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9864072610 msgr2=0x7f9864074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9864072610 0x7f9864074ad0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9870001c40 tx=0x7f9870001b90 comp rx=0 tx=0).stop 2024-09-10T23:27:17.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986c004d50 msgr2=0x7f98881508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:17.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986c004d50 0x7f98881508b0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f9878003f60 tx=0x7f9878003f90 comp rx=0 tx=0).stop 2024-09-10T23:27:17.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 shutdown_connections 2024-09-10T23:27:17.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9864072610 0x7f9864074ad0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98881f8120 0x7f98881f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98881539e0 0x7f9888156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 --2- 172.21.15.17:0/2244300858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f986c004d50 0x7f98881508b0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:17.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 >> 172.21.15.17:0/2244300858 conn(0x7f98880d1d10 msgr2=0x7f988806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:17.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 shutdown_connections 2024-09-10T23:27:17.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:17.849+0000 7f988ce00640 1 -- 172.21.15.17:0/2244300858 wait complete. 2024-09-10T23:27:17.874 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:27:18.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 -- 172.21.15.17:0/894742138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b6406e6f0 msgr2=0x7f0b6415fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:18.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 --2- 172.21.15.17:0/894742138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b6406e6f0 0x7f0b6415fcb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009bc0 tx=0x7f0b5c01cba0 comp rx=0 tx=0).stop 2024-09-10T23:27:18.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 -- 172.21.15.17:0/894742138 shutdown_connections 2024-09-10T23:27:18.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 --2- 172.21.15.17:0/894742138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b6406e6f0 0x7f0b6415fcb0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:18.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 --2- 172.21.15.17:0/894742138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b64160460 0x7f0b6415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:18.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 -- 172.21.15.17:0/894742138 >> 172.21.15.17:0/894742138 conn(0x7f0b640b17a0 msgr2=0x7f0b640b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:18.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 -- 172.21.15.17:0/894742138 shutdown_connections 2024-09-10T23:27:18.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 -- 172.21.15.17:0/894742138 wait complete. 2024-09-10T23:27:18.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 Processor -- start 2024-09-10T23:27:18.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 -- start start 2024-09-10T23:27:18.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b6406e6f0 0x7f0b640b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:18.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b64145800 0x7f0b64156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:18.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b64160460 0x7f0b641323b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:18.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0b64168c90 con 0x7f0b64160460 2024-09-10T23:27:18.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b64168b10 con 0x7f0b6406e6f0 2024-09-10T23:27:18.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b6ae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b64168e10 con 0x7f0b64145800 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b68e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b64160460 0x7f0b641323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b68e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b64160460 0x7f0b641323b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34972/0 (socket says 172.21.15.17:34972) 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b68e00640 1 -- 172.21.15.17:0/425517268 learned_addr learned my addr 172.21.15.17:0/425517268 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b63e00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b6406e6f0 0x7f0b640b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b5b400640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b64145800 0x7f0b64156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b68e00640 1 -- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b64145800 msgr2=0x7f0b64156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b68e00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b64145800 0x7f0b64156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b68e00640 1 -- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b6406e6f0 msgr2=0x7f0b640b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b68e00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b6406e6f0 0x7f0b640b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b68e00640 1 -- 172.21.15.17:0/425517268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b641328f0 con 0x7f0b64160460 2024-09-10T23:27:18.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.021+0000 7f0b68e00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b64160460 0x7f0b641323b0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009b10 tx=0x7f0b5c005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:18.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b60c00640 1 -- 172.21.15.17:0/425517268 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0b2040 con 0x7f0b64160460 2024-09-10T23:27:18.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b60c00640 1 -- 172.21.15.17:0/425517268 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b5c0bc070 con 0x7f0b64160460 2024-09-10T23:27:18.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b60c00640 1 -- 172.21.15.17:0/425517268 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c004280 con 0x7f0b64160460 2024-09-10T23:27:18.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b640b4990 con 0x7f0b64160460 2024-09-10T23:27:18.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b640b3020 con 0x7f0b64160460 2024-09-10T23:27:18.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b640741d0 con 0x7f0b64160460 2024-09-10T23:27:18.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b60c00640 1 -- 172.21.15.17:0/425517268 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0b5c0b5070 con 0x7f0b64160460 2024-09-10T23:27:18.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b60c00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b400725e0 0x7f0b40074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:18.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b60c00640 1 -- 172.21.15.17:0/425517268 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f0b5c12e460 con 0x7f0b64160460 2024-09-10T23:27:18.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.025+0000 7f0b63e00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b400725e0 0x7f0b40074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:18.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.029+0000 7f0b63e00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b400725e0 0x7f0b40074aa0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0b54001890 tx=0x7f0b54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:18.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.029+0000 7f0b60c00640 1 -- 172.21.15.17:0/425517268 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0b5c016790 con 0x7f0b64160460 2024-09-10T23:27:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:18.245+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0b64165b90 con 0x7f0b64160460 2024-09-10T23:27:19.066 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:27:19.061+0000 7f37ea800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:27:19.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.105+0000 7f0b60c00640 1 -- 172.21.15.17:0/425517268 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v120) ==== 118+0+0 (secure 0 0 0) 0x7f0b5c1021d0 con 0x7f0b64160460 2024-09-10T23:27:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b400725e0 msgr2=0x7f0b40074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b400725e0 0x7f0b40074aa0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0b54001890 tx=0x7f0b54009040 comp rx=0 tx=0).stop 2024-09-10T23:27:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b64160460 msgr2=0x7f0b641323b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b64160460 0x7f0b641323b0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009b10 tx=0x7f0b5c005a60 comp rx=0 tx=0).stop 2024-09-10T23:27:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 shutdown_connections 2024-09-10T23:27:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0b400725e0 0x7f0b40074aa0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b64160460 0x7f0b641323b0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:19.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b64145800 0x7f0b64156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:19.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 --2- 172.21.15.17:0/425517268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b6406e6f0 0x7f0b640b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:19.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 >> 172.21.15.17:0/425517268 conn(0x7f0b640b17a0 msgr2=0x7f0b6415e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:19.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 shutdown_connections 2024-09-10T23:27:19.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.109+0000 7f0b6ae00640 1 -- 172.21.15.17:0/425517268 wait complete. 2024-09-10T23:27:19.138 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:27:19.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:27:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.289+0000 7fcdf9c00640 1 -- 172.21.15.17:0/1997173784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdd8004220 msgr2=0x7fcdd8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.289+0000 7fcdf9c00640 1 --2- 172.21.15.17:0/1997173784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdd8004220 0x7fcdd8004810 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fcddc001860 tx=0x7fcddc01f050 comp rx=0 tx=0).stop 2024-09-10T23:27:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.289+0000 7fcdf9200640 1 -- 172.21.15.17:0/1997173784 reap_dead start 2024-09-10T23:27:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.289+0000 7fcdf9c00640 1 -- 172.21.15.17:0/1997173784 shutdown_connections 2024-09-10T23:27:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.289+0000 7fcdf9c00640 1 -- 172.21.15.17:0/1997173784 >> 172.21.15.17:0/1997173784 conn(0x7fcdf409a9f0 msgr2=0x7fcdf409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.289+0000 7fcdf9c00640 1 -- 172.21.15.17:0/1997173784 shutdown_connections 2024-09-10T23:27:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.289+0000 7fcdf9c00640 1 -- 172.21.15.17:0/1997173784 wait complete. 2024-09-10T23:27:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.289+0000 7fcdf9c00640 1 Processor -- start 2024-09-10T23:27:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.289+0000 7fcdf9c00640 1 -- start start 2024-09-10T23:27:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdd8004220 0x7fcdf4154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdf41620c0 0x7fcdf41f7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdf41f7d60 0x7fcdf4154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf4164850 con 0x7fcdf41f7d60 2024-09-10T23:27:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf41646d0 con 0x7fcdf41620c0 2024-09-10T23:27:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf41649d0 con 0x7fcdd8004220 2024-09-10T23:27:19.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdf41f7d60 0x7fcdf4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdd8004220 0x7fcdf4154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdf41f7d60 0x7fcdf4154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34990/0 (socket says 172.21.15.17:34990) 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9200640 1 -- 172.21.15.17:0/160947570 learned_addr learned my addr 172.21.15.17:0/160947570 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdebe00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdf41620c0 0x7fcdf41f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9200640 1 -- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdd8004220 msgr2=0x7fcdf4154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9200640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdd8004220 0x7fcdf4154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9200640 1 -- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdf41620c0 msgr2=0x7fcdf41f7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9200640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdf41620c0 0x7fcdf41f7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9200640 1 -- 172.21.15.17:0/160947570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf41f81e0 con 0x7fcdf41f7d60 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf3e00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdd8004220 0x7fcdf4154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9200640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdf41f7d60 0x7fcdf4154810 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fcdec011b20 tx=0x7fcdec00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf0c00640 1 -- 172.21.15.17:0/160947570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec004b30 con 0x7fcdf41f7d60 2024-09-10T23:27:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf0c00640 1 -- 172.21.15.17:0/160947570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdec004cd0 con 0x7fcdf41f7d60 2024-09-10T23:27:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf0c00640 1 -- 172.21.15.17:0/160947570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec003bc0 con 0x7fcdf41f7d60 2024-09-10T23:27:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf41f84c0 con 0x7fcdf41f7d60 2024-09-10T23:27:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf4163890 con 0x7fcdf41f7d60 2024-09-10T23:27:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.293+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf41f8700 con 0x7fcdf41f7d60 2024-09-10T23:27:19.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.297+0000 7fcdf0c00640 1 -- 172.21.15.17:0/160947570 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcdec004030 con 0x7fcdf41f7d60 2024-09-10T23:27:19.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.297+0000 7fcdf0c00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcdd00725e0 0x7fcdd0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:19.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.297+0000 7fcdf0c00640 1 -- 172.21.15.17:0/160947570 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fcdec093cd0 con 0x7fcdf41f7d60 2024-09-10T23:27:19.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.297+0000 7fcdf3e00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcdd00725e0 0x7fcdd0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:19.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.297+0000 7fcdf3e00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcdd00725e0 0x7fcdd0074aa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcde4001ec0 tx=0x7fcde4006f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:19.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.301+0000 7fcdf0c00640 1 -- 172.21.15.17:0/160947570 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcdf41f8700 con 0x7fcdf41f7d60 2024-09-10T23:27:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:19.513+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcdf40d0170 con 0x7fcdf41f7d60 2024-09-10T23:27:20.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf0c00640 1 -- 172.21.15.17:0/160947570 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v121) ==== 122+0+0 (secure 0 0 0) 0x7fcdec020020 con 0x7fcdf41f7d60 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcdd00725e0 msgr2=0x7fcdd0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcdd00725e0 0x7fcdd0074aa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcde4001ec0 tx=0x7fcde4006f20 comp rx=0 tx=0).stop 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdf41f7d60 msgr2=0x7fcdf4154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdf41f7d60 0x7fcdf4154810 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fcdec011b20 tx=0x7fcdec00f3c0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 shutdown_connections 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcdd00725e0 0x7fcdd0074aa0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdf41f7d60 0x7fcdf4154810 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdf41620c0 0x7fcdf41f7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 --2- 172.21.15.17:0/160947570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdd8004220 0x7fcdf4154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 >> 172.21.15.17:0/160947570 conn(0x7fcdf409a9f0 msgr2=0x7fcdf4071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:20.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 shutdown_connections 2024-09-10T23:27:20.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.109+0000 7fcdf9c00640 1 -- 172.21.15.17:0/160947570 wait complete. 2024-09-10T23:27:20.140 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:27:20.140 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:20.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.285+0000 7f446f600640 1 -- 172.21.15.17:0/1553426158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 msgr2=0x7f44680cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.285+0000 7f446f600640 1 --2- 172.21.15.17:0/1553426158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 0x7f44680cfc60 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f44680d2e60 tx=0x7f446001cd80 comp rx=0 tx=0).stop 2024-09-10T23:27:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.285+0000 7f446f600640 1 -- 172.21.15.17:0/1553426158 shutdown_connections 2024-09-10T23:27:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.285+0000 7f446f600640 1 --2- 172.21.15.17:0/1553426158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 0x7f44680cfc60 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.285+0000 7f446f600640 1 --2- 172.21.15.17:0/1553426158 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44680d1830 0x7f446815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.285+0000 7f446f600640 1 --2- 172.21.15.17:0/1553426158 >> v2:172.21.15.77:3300/0 conn(0x7f4468070ad0 0x7f446815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.285+0000 7f446f600640 1 -- 172.21.15.17:0/1553426158 >> 172.21.15.17:0/1553426158 conn(0x7f44680d1d60 msgr2=0x7f44680d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.285+0000 7f446f600640 1 -- 172.21.15.17:0/1553426158 shutdown_connections 2024-09-10T23:27:20.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.285+0000 7f446f600640 1 -- 172.21.15.17:0/1553426158 wait complete. 2024-09-10T23:27:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 Processor -- start 2024-09-10T23:27:20.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 -- start start 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468070ad0 0x7f44681591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 0x7f4468158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44680d1830 0x7f44680c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f44680cd2f0 con 0x7f44680cf320 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f44680cd170 con 0x7f4468070ad0 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f44680cd470 con 0x7f44680d1830 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f445fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 0x7f4468158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f445fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 0x7f4468158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35020/0 (socket says 172.21.15.17:35020) 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f445fe00640 1 -- 172.21.15.17:0/2384935109 learned_addr learned my addr 172.21.15.17:0/2384935109 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446cc00640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468070ad0 0x7f44681591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:20.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446d600640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44680d1830 0x7f44680c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f445fe00640 1 -- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44680d1830 msgr2=0x7f44680c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f445fe00640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44680d1830 0x7f44680c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f445fe00640 1 -- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468070ad0 msgr2=0x7f44681591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f445fe00640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468070ad0 0x7f44681591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f445fe00640 1 -- 172.21.15.17:0/2384935109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4468158f20 con 0x7f44680cf320 2024-09-10T23:27:20.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f445fe00640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 0x7f4468158570 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f445000c9f0 tx=0x7f445000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f4465600640 1 -- 172.21.15.17:0/2384935109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450007bb0 con 0x7f44680cf320 2024-09-10T23:27:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f4465600640 1 -- 172.21.15.17:0/2384935109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4450007e40 con 0x7f44680cf320 2024-09-10T23:27:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44680b3760 con 0x7f44680cf320 2024-09-10T23:27:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f4465600640 1 -- 172.21.15.17:0/2384935109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445000f690 con 0x7f44680cf320 2024-09-10T23:27:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.289+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44680c5dc0 con 0x7f44680cf320 2024-09-10T23:27:20.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.293+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44680cfc60 con 0x7f44680cf320 2024-09-10T23:27:20.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.293+0000 7f4465600640 1 -- 172.21.15.17:0/2384935109 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4450020030 con 0x7f44680cf320 2024-09-10T23:27:20.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.293+0000 7f4465600640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44440725e0 0x7f4444074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:20.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.293+0000 7f4465600640 1 -- 172.21.15.17:0/2384935109 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f44500937c0 con 0x7f44680cf320 2024-09-10T23:27:20.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.293+0000 7f446cc00640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44440725e0 0x7f4444074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:20.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.293+0000 7f446cc00640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44440725e0 0x7f4444074aa0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f44680b7cb0 tx=0x7f445800a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:20.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.297+0000 7f4465600640 1 -- 172.21.15.17:0/2384935109 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4450014030 con 0x7f44680cf320 2024-09-10T23:27:20.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.505+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f446806f990 con 0x7f44680cf320 2024-09-10T23:27:20.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.505+0000 7f4465600640 1 -- 172.21.15.17:0/2384935109 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7f445005e6c0 con 0x7f44680cf320 2024-09-10T23:27:20.510 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:20.511 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:27:20.511 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:27:20.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44440725e0 msgr2=0x7f4444074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44440725e0 0x7f4444074aa0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f44680b7cb0 tx=0x7f445800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 msgr2=0x7f4468158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 0x7f4468158570 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f445000c9f0 tx=0x7f445000ceb0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 shutdown_connections 2024-09-10T23:27:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f44440725e0 0x7f4444074aa0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44680d1830 0x7f44680c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44680cf320 0x7f4468158570 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 --2- 172.21.15.17:0/2384935109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468070ad0 0x7f44681591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 >> 172.21.15.17:0/2384935109 conn(0x7f44680d1d60 msgr2=0x7f44680affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 shutdown_connections 2024-09-10T23:27:20.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.509+0000 7f446f600640 1 -- 172.21.15.17:0/2384935109 wait complete. 2024-09-10T23:27:20.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:27:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 -- 172.21.15.17:0/1764181927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb815f730 msgr2=0x7f7bb80ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 --2- 172.21.15.17:0/1764181927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb815f730 0x7f7bb80ce720 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009900 tx=0x7f7ba001c670 comp rx=0 tx=0).stop 2024-09-10T23:27:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 -- 172.21.15.17:0/1764181927 shutdown_connections 2024-09-10T23:27:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 --2- 172.21.15.17:0/1764181927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb815f730 0x7f7bb80ce720 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 --2- 172.21.15.17:0/1764181927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bb815f350 0x7f7bb80b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 -- 172.21.15.17:0/1764181927 >> 172.21.15.17:0/1764181927 conn(0x7f7bb80d1d10 msgr2=0x7f7bb80d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 -- 172.21.15.17:0/1764181927 shutdown_connections 2024-09-10T23:27:20.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 -- 172.21.15.17:0/1764181927 wait complete. 2024-09-10T23:27:20.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 Processor -- start 2024-09-10T23:27:20.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 -- start start 2024-09-10T23:27:20.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb80cec60 0x7f7bb8166340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bb815f350 0x7f7bb8159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bb815f730 0x7f7bb80af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb8169050 con 0x7f7bb80cec60 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb8168ed0 con 0x7f7bb815f350 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bbe600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb81691d0 con 0x7f7bb815f730 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bb7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb80cec60 0x7f7bb8166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bb7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb80cec60 0x7f7bb8166340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35040/0 (socket says 172.21.15.17:35040) 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7bb7400640 1 -- 172.21.15.17:0/175075463 learned_addr learned my addr 172.21.15.17:0/175075463 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.677+0000 7f7baea00640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bb815f350 0x7f7bb8159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bb7e00640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bb815f730 0x7f7bb80af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:20.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bb7400640 1 -- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bb815f730 msgr2=0x7f7bb80af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bb7400640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bb815f730 0x7f7bb80af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bb7400640 1 -- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bb815f350 msgr2=0x7f7bb8159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bb7400640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bb815f350 0x7f7bb8159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bb7400640 1 -- 172.21.15.17:0/175075463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb81652a0 con 0x7f7bb80cec60 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bb7400640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb80cec60 0x7f7bb8166340 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c970 tx=0x7f7ba800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bafe00640 1 -- 172.21.15.17:0/175075463 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8007c70 con 0x7f7bb80cec60 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bafe00640 1 -- 172.21.15.17:0/175075463 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ba800f450 con 0x7f7bb80cec60 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb8165580 con 0x7f7bb80cec60 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bafe00640 1 -- 172.21.15.17:0/175075463 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800f8a0 con 0x7f7bb80cec60 2024-09-10T23:27:20.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb8165b40 con 0x7f7bb80cec60 2024-09-10T23:27:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb80b3130 con 0x7f7bb80cec60 2024-09-10T23:27:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bafe00640 1 -- 172.21.15.17:0/175075463 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7ba8020030 con 0x7f7bb80cec60 2024-09-10T23:27:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bafe00640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b94072610 0x7f7b94074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.681+0000 7f7bafe00640 1 -- 172.21.15.17:0/175075463 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f7ba8093810 con 0x7f7bb80cec60 2024-09-10T23:27:20.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.685+0000 7f7baea00640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b94072610 0x7f7b94074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:20.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.685+0000 7f7baea00640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b94072610 0x7f7b94074ad0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00af000 tx=0x7f7ba001aeb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:20.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.685+0000 7f7bafe00640 1 -- 172.21.15.17:0/175075463 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7ba8014030 con 0x7f7bb80cec60 2024-09-10T23:27:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.861+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bb8166880 con 0x7f7bb80cec60 2024-09-10T23:27:20.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.861+0000 7f7bafe00640 1 -- 172.21.15.17:0/175075463 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16884 (secure 0 0 0) 0x7f7ba805edf0 con 0x7f7bb80cec60 2024-09-10T23:27:20.867 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:20.868 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":166,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:27:18.084152+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:27:14.215056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-10T23:27:15.453956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:27:20.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b94072610 msgr2=0x7f7b94074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b94072610 0x7f7b94074ad0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00af000 tx=0x7f7ba001aeb0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb80cec60 msgr2=0x7f7bb8166340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:20.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb80cec60 0x7f7bb8166340 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c970 tx=0x7f7ba800ce30 comp rx=0 tx=0).stop 2024-09-10T23:27:20.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 shutdown_connections 2024-09-10T23:27:20.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b94072610 0x7f7b94074ad0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bb815f730 0x7f7bb80af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bb815f350 0x7f7bb8159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 --2- 172.21.15.17:0/175075463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bb80cec60 0x7f7bb8166340 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:20.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 >> 172.21.15.17:0/175075463 conn(0x7f7bb80d1d10 msgr2=0x7f7bb80d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:20.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 shutdown_connections 2024-09-10T23:27:20.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:20.865+0000 7f7bbe600640 1 -- 172.21.15.17:0/175075463 wait complete. 2024-09-10T23:27:20.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:27:20.889 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:27:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 -- 172.21.15.17:0/2105727305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc15bc70 msgr2=0x7f67fc0cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 --2- 172.21.15.17:0/2105727305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc15bc70 0x7f67fc0cfa20 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009900 tx=0x7f67ec01c7c0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 -- 172.21.15.17:0/2105727305 shutdown_connections 2024-09-10T23:27:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 --2- 172.21.15.17:0/2105727305 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67fc0d20a0 0x7f67fc0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 --2- 172.21.15.17:0/2105727305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc15bc70 0x7f67fc0cfa20 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 -- 172.21.15.17:0/2105727305 >> 172.21.15.17:0/2105727305 conn(0x7f67fc09a9f0 msgr2=0x7f67fc09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 -- 172.21.15.17:0/2105727305 shutdown_connections 2024-09-10T23:27:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 -- 172.21.15.17:0/2105727305 wait complete. 2024-09-10T23:27:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 Processor -- start 2024-09-10T23:27:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 -- start start 2024-09-10T23:27:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67fc0cc570 0x7f67fc0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc0d20a0 0x7f67fc0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67fc15bc70 0x7f67fc15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc168930 con 0x7f67fc0d20a0 2024-09-10T23:27:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0b21a0 con 0x7f67fc0cc570 2024-09-10T23:27:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.033+0000 7f67fb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc168ab0 con 0x7f67fc15bc70 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc0d20a0 0x7f67fc0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc0d20a0 0x7f67fc0af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35058/0 (socket says 172.21.15.17:35058) 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f3e00640 1 -- 172.21.15.17:0/463366994 learned_addr learned my addr 172.21.15.17:0/463366994 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67fa800640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67fc15bc70 0x7f67fc15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f9e00640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67fc0cc570 0x7f67fc0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f3e00640 1 -- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67fc15bc70 msgr2=0x7f67fc15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f3e00640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67fc15bc70 0x7f67fc15c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f3e00640 1 -- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67fc0cc570 msgr2=0x7f67fc0b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f3e00640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67fc0cc570 0x7f67fc0b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f3e00640 1 -- 172.21.15.17:0/463366994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc0b6f50 con 0x7f67fc0d20a0 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f9e00640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67fc0cc570 0x7f67fc0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f3e00640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc0d20a0 0x7f67fc0af2c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f67e400c480 tx=0x7f67e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f2000640 1 -- 172.21.15.17:0/463366994 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e40052d0 con 0x7f67fc0d20a0 2024-09-10T23:27:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f2000640 1 -- 172.21.15.17:0/463366994 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67e4005470 con 0x7f67fc0d20a0 2024-09-10T23:27:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67fc0b7230 con 0x7f67fc0d20a0 2024-09-10T23:27:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f2000640 1 -- 172.21.15.17:0/463366994 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4012890 con 0x7f67fc0d20a0 2024-09-10T23:27:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67fc0af800 con 0x7f67fc0d20a0 2024-09-10T23:27:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67fc0b10f0 con 0x7f67fc0d20a0 2024-09-10T23:27:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.037+0000 7f67f2000640 1 -- 172.21.15.17:0/463366994 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f67e4003620 con 0x7f67fc0d20a0 2024-09-10T23:27:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.041+0000 7f67f2000640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67d80725e0 0x7f67d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.041+0000 7f67f2000640 1 -- 172.21.15.17:0/463366994 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f67e40930d0 con 0x7f67fc0d20a0 2024-09-10T23:27:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.041+0000 7f67f9e00640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67d80725e0 0x7f67d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.041+0000 7f67f9e00640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67d80725e0 0x7f67d8074aa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0af000 tx=0x7f67ec01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:21.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.045+0000 7f67f2000640 1 -- 172.21.15.17:0/463366994 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f67e405e650 con 0x7f67fc0d20a0 2024-09-10T23:27:21.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.213+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67fc069e10 con 0x7f67d80725e0 2024-09-10T23:27:21.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.221+0000 7f67f2000640 1 -- 172.21.15.17:0/463366994 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252057 (secure 0 0 0) 0x7f67ec0b3040 con 0x7f67d80725e0 2024-09-10T23:27:21.227 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:21.228 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67d80725e0 msgr2=0x7f67d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67d80725e0 0x7f67d8074aa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0af000 tx=0x7f67ec01b060 comp rx=0 tx=0).stop 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc0d20a0 msgr2=0x7f67fc0af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc0d20a0 0x7f67fc0af2c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f67e400c480 tx=0x7f67e400c940 comp rx=0 tx=0).stop 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 shutdown_connections 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f67d80725e0 0x7f67d8074aa0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67fc15bc70 0x7f67fc15c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67fc0d20a0 0x7f67fc0af2c0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 --2- 172.21.15.17:0/463366994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67fc0cc570 0x7f67fc0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 >> 172.21.15.17:0/463366994 conn(0x7f67fc09a9f0 msgr2=0x7f67fc06dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 shutdown_connections 2024-09-10T23:27:21.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.225+0000 7f67fb200640 1 -- 172.21.15.17:0/463366994 wait complete. 2024-09-10T23:27:21.247 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":518,"stamp":"2024-09-10T23:27:20.462625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522232,"kb_used_data":17412,"kb_used_omap":12,"kb_used_meta":504627,"kb_avail":754452488,"statfs":{"total":773094113280,"available":772559347712,"internally_reserved":0,"allocated":17829888,"data_stored":8974862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516738609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.389823"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095075+0000","last_change":"2024-09-10T23:27:17.106584+0000","last_active":"2024-09-10T23:27:18.095075+0000","last_peered":"2024-09-10T23:27:18.095075+0000","last_clean":"2024-09-10T23:27:18.095075+0000","last_became_active":"2024-09-10T23:27:17.106315+0000","last_became_peered":"2024-09-10T23:27:17.106315+0000","last_unstale":"2024-09-10T23:27:18.095075+0000","last_undegraded":"2024-09-10T23:27:18.095075+0000","last_fullsized":"2024-09-10T23:27:18.095075+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:54.902790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655807+0000","last_change":"2024-09-10T23:27:17.115113+0000","last_active":"2024-09-10T23:27:18.655807+0000","last_peered":"2024-09-10T23:27:18.655807+0000","last_clean":"2024-09-10T23:27:18.655807+0000","last_became_active":"2024-09-10T23:27:17.114341+0000","last_became_peered":"2024-09-10T23:27:17.114341+0000","last_unstale":"2024-09-10T23:27:18.655807+0000","last_undegraded":"2024-09-10T23:27:18.655807+0000","last_fullsized":"2024-09-10T23:27:18.655807+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:20.113939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094285+0000","last_change":"2024-09-10T23:27:17.101230+0000","last_active":"2024-09-10T23:27:18.094285+0000","last_peered":"2024-09-10T23:27:18.094285+0000","last_clean":"2024-09-10T23:27:18.094285+0000","last_became_active":"2024-09-10T23:27:17.100946+0000","last_became_peered":"2024-09-10T23:27:17.100946+0000","last_unstale":"2024-09-10T23:27:18.094285+0000","last_undegraded":"2024-09-10T23:27:18.094285+0000","last_fullsized":"2024-09-10T23:27:18.094285+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:20.365134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094578+0000","last_change":"2024-09-10T23:27:17.105978+0000","last_active":"2024-09-10T23:27:18.094578+0000","last_peered":"2024-09-10T23:27:18.094578+0000","last_clean":"2024-09-10T23:27:18.094578+0000","last_became_active":"2024-09-10T23:27:17.105502+0000","last_became_peered":"2024-09-10T23:27:17.105502+0000","last_unstale":"2024-09-10T23:27:18.094578+0000","last_undegraded":"2024-09-10T23:27:18.094578+0000","last_fullsized":"2024-09-10T23:27:18.094578+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:04.674325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649044+0000","last_change":"2024-09-10T23:27:17.108926+0000","last_active":"2024-09-10T23:27:18.649044+0000","last_peered":"2024-09-10T23:27:18.649044+0000","last_clean":"2024-09-10T23:27:18.649044+0000","last_became_active":"2024-09-10T23:27:17.108589+0000","last_became_peered":"2024-09-10T23:27:17.108589+0000","last_unstale":"2024-09-10T23:27:18.649044+0000","last_undegraded":"2024-09-10T23:27:18.649044+0000","last_fullsized":"2024-09-10T23:27:18.649044+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:47.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654886+0000","last_change":"2024-09-10T23:27:17.114012+0000","last_active":"2024-09-10T23:27:18.654886+0000","last_peered":"2024-09-10T23:27:18.654886+0000","last_clean":"2024-09-10T23:27:18.654886+0000","last_became_active":"2024-09-10T23:27:17.111391+0000","last_became_peered":"2024-09-10T23:27:17.111391+0000","last_unstale":"2024-09-10T23:27:18.654886+0000","last_undegraded":"2024-09-10T23:27:18.654886+0000","last_fullsized":"2024-09-10T23:27:18.654886+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:33.637514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123961+0000","last_change":"2024-09-10T23:27:17.104858+0000","last_active":"2024-09-10T23:27:18.123961+0000","last_peered":"2024-09-10T23:27:18.123961+0000","last_clean":"2024-09-10T23:27:18.123961+0000","last_became_active":"2024-09-10T23:27:17.104575+0000","last_became_peered":"2024-09-10T23:27:17.104575+0000","last_unstale":"2024-09-10T23:27:18.123961+0000","last_undegraded":"2024-09-10T23:27:18.123961+0000","last_fullsized":"2024-09-10T23:27:18.123961+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123806+0000","last_change":"2024-09-10T23:27:17.110407+0000","last_active":"2024-09-10T23:27:18.123806+0000","last_peered":"2024-09-10T23:27:18.123806+0000","last_clean":"2024-09-10T23:27:18.123806+0000","last_became_active":"2024-09-10T23:27:17.110090+0000","last_became_peered":"2024-09-10T23:27:17.110090+0000","last_unstale":"2024-09-10T23:27:18.123806+0000","last_undegraded":"2024-09-10T23:27:18.123806+0000","last_fullsized":"2024-09-10T23:27:18.123806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:55.534473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124433+0000","last_change":"2024-09-10T23:27:17.110221+0000","last_active":"2024-09-10T23:27:18.124433+0000","last_peered":"2024-09-10T23:27:18.124433+0000","last_clean":"2024-09-10T23:27:18.124433+0000","last_became_active":"2024-09-10T23:27:17.109916+0000","last_became_peered":"2024-09-10T23:27:17.109916+0000","last_unstale":"2024-09-10T23:27:18.124433+0000","last_undegraded":"2024-09-10T23:27:18.124433+0000","last_fullsized":"2024-09-10T23:27:18.124433+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124429+0000","last_change":"2024-09-10T23:27:17.103184+0000","last_active":"2024-09-10T23:27:18.124429+0000","last_peered":"2024-09-10T23:27:18.124429+0000","last_clean":"2024-09-10T23:27:18.124429+0000","last_became_active":"2024-09-10T23:27:17.102108+0000","last_became_peered":"2024-09-10T23:27:17.102108+0000","last_unstale":"2024-09-10T23:27:18.124429+0000","last_undegraded":"2024-09-10T23:27:18.124429+0000","last_fullsized":"2024-09-10T23:27:18.124429+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655402+0000","last_change":"2024-09-10T23:27:17.120609+0000","last_active":"2024-09-10T23:27:18.655402+0000","last_peered":"2024-09-10T23:27:18.655402+0000","last_clean":"2024-09-10T23:27:18.655402+0000","last_became_active":"2024-09-10T23:27:17.120402+0000","last_became_peered":"2024-09-10T23:27:17.120402+0000","last_unstale":"2024-09-10T23:27:18.655402+0000","last_undegraded":"2024-09-10T23:27:18.655402+0000","last_fullsized":"2024-09-10T23:27:18.655402+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:58.328456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655563+0000","last_change":"2024-09-10T23:27:17.113454+0000","last_active":"2024-09-10T23:27:18.655563+0000","last_peered":"2024-09-10T23:27:18.655563+0000","last_clean":"2024-09-10T23:27:18.655563+0000","last_became_active":"2024-09-10T23:27:17.113102+0000","last_became_peered":"2024-09-10T23:27:17.113102+0000","last_unstale":"2024-09-10T23:27:18.655563+0000","last_undegraded":"2024-09-10T23:27:18.655563+0000","last_fullsized":"2024-09-10T23:27:18.655563+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:24.438181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121506+0000","last_change":"2024-09-10T23:27:17.104651+0000","last_active":"2024-09-10T23:27:18.121506+0000","last_peered":"2024-09-10T23:27:18.121506+0000","last_clean":"2024-09-10T23:27:18.121506+0000","last_became_active":"2024-09-10T23:27:17.104356+0000","last_became_peered":"2024-09-10T23:27:17.104356+0000","last_unstale":"2024-09-10T23:27:18.121506+0000","last_undegraded":"2024-09-10T23:27:18.121506+0000","last_fullsized":"2024-09-10T23:27:18.121506+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:31.195103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648806+0000","last_change":"2024-09-10T23:27:17.112364+0000","last_active":"2024-09-10T23:27:18.648806+0000","last_peered":"2024-09-10T23:27:18.648806+0000","last_clean":"2024-09-10T23:27:18.648806+0000","last_became_active":"2024-09-10T23:27:17.110862+0000","last_became_peered":"2024-09-10T23:27:17.110862+0000","last_unstale":"2024-09-10T23:27:18.648806+0000","last_undegraded":"2024-09-10T23:27:18.648806+0000","last_fullsized":"2024-09-10T23:27:18.648806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:37.706200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654100+0000","last_change":"2024-09-10T23:27:17.115869+0000","last_active":"2024-09-10T23:27:18.654100+0000","last_peered":"2024-09-10T23:27:18.654100+0000","last_clean":"2024-09-10T23:27:18.654100+0000","last_became_active":"2024-09-10T23:27:17.115594+0000","last_became_peered":"2024-09-10T23:27:17.115594+0000","last_unstale":"2024-09-10T23:27:18.654100+0000","last_undegraded":"2024-09-10T23:27:18.654100+0000","last_fullsized":"2024-09-10T23:27:18.654100+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094113+0000","last_change":"2024-09-10T23:27:17.105827+0000","last_active":"2024-09-10T23:27:18.094113+0000","last_peered":"2024-09-10T23:27:18.094113+0000","last_clean":"2024-09-10T23:27:18.094113+0000","last_became_active":"2024-09-10T23:27:17.105514+0000","last_became_peered":"2024-09-10T23:27:17.105514+0000","last_unstale":"2024-09-10T23:27:18.094113+0000","last_undegraded":"2024-09-10T23:27:18.094113+0000","last_fullsized":"2024-09-10T23:27:18.094113+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:41.256305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124559+0000","last_change":"2024-09-10T23:27:17.103100+0000","last_active":"2024-09-10T23:27:18.124559+0000","last_peered":"2024-09-10T23:27:18.124559+0000","last_clean":"2024-09-10T23:27:18.124559+0000","last_became_active":"2024-09-10T23:27:17.101922+0000","last_became_peered":"2024-09-10T23:27:17.101922+0000","last_unstale":"2024-09-10T23:27:18.124559+0000","last_undegraded":"2024-09-10T23:27:18.124559+0000","last_fullsized":"2024-09-10T23:27:18.124559+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:21.276448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.089170+0000","last_change":"2024-09-10T23:27:16.089170+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.089170+0000","last_undegraded":"2024-09-10T23:27:16.089170+0000","last_fullsized":"2024-09-10T23:27:16.089170+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654548+0000","last_change":"2024-09-10T23:27:17.115816+0000","last_active":"2024-09-10T23:27:18.654548+0000","last_peered":"2024-09-10T23:27:18.654548+0000","last_clean":"2024-09-10T23:27:18.654548+0000","last_became_active":"2024-09-10T23:27:17.115530+0000","last_became_peered":"2024-09-10T23:27:17.115530+0000","last_unstale":"2024-09-10T23:27:18.654548+0000","last_undegraded":"2024-09-10T23:27:18.654548+0000","last_fullsized":"2024-09-10T23:27:18.654548+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088360+0000","last_change":"2024-09-10T23:27:17.115834+0000","last_active":"2024-09-10T23:27:18.088360+0000","last_peered":"2024-09-10T23:27:18.088360+0000","last_clean":"2024-09-10T23:27:18.088360+0000","last_became_active":"2024-09-10T23:27:17.115548+0000","last_became_peered":"2024-09-10T23:27:17.115548+0000","last_unstale":"2024-09-10T23:27:18.088360+0000","last_undegraded":"2024-09-10T23:27:18.088360+0000","last_fullsized":"2024-09-10T23:27:18.088360+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:55.699175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121835+0000","last_change":"2024-09-10T23:27:17.093723+0000","last_active":"2024-09-10T23:27:18.121835+0000","last_peered":"2024-09-10T23:27:18.121835+0000","last_clean":"2024-09-10T23:27:18.121835+0000","last_became_active":"2024-09-10T23:27:17.093438+0000","last_became_peered":"2024-09-10T23:27:17.093438+0000","last_unstale":"2024-09-10T23:27:18.121835+0000","last_undegraded":"2024-09-10T23:27:18.121835+0000","last_fullsized":"2024-09-10T23:27:18.121835+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:09.201890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655133+0000","last_change":"2024-09-10T23:27:17.121543+0000","last_active":"2024-09-10T23:27:18.655133+0000","last_peered":"2024-09-10T23:27:18.655133+0000","last_clean":"2024-09-10T23:27:18.655133+0000","last_became_active":"2024-09-10T23:27:17.121249+0000","last_became_peered":"2024-09-10T23:27:17.121249+0000","last_unstale":"2024-09-10T23:27:18.655133+0000","last_undegraded":"2024-09-10T23:27:18.655133+0000","last_fullsized":"2024-09-10T23:27:18.655133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:37.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648649+0000","last_change":"2024-09-10T23:27:17.107888+0000","last_active":"2024-09-10T23:27:18.648649+0000","last_peered":"2024-09-10T23:27:18.648649+0000","last_clean":"2024-09-10T23:27:18.648649+0000","last_became_active":"2024-09-10T23:27:17.107606+0000","last_became_peered":"2024-09-10T23:27:17.107606+0000","last_unstale":"2024-09-10T23:27:18.648649+0000","last_undegraded":"2024-09-10T23:27:18.648649+0000","last_fullsized":"2024-09-10T23:27:18.648649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:35.414834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094571+0000","last_change":"2024-09-10T23:27:17.096587+0000","last_active":"2024-09-10T23:27:18.094571+0000","last_peered":"2024-09-10T23:27:18.094571+0000","last_clean":"2024-09-10T23:27:18.094571+0000","last_became_active":"2024-09-10T23:27:17.096284+0000","last_became_peered":"2024-09-10T23:27:17.096284+0000","last_unstale":"2024-09-10T23:27:18.094571+0000","last_undegraded":"2024-09-10T23:27:18.094571+0000","last_fullsized":"2024-09-10T23:27:18.094571+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:37.468206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122133+0000","last_change":"2024-09-10T23:27:17.102475+0000","last_active":"2024-09-10T23:27:18.122133+0000","last_peered":"2024-09-10T23:27:18.122133+0000","last_clean":"2024-09-10T23:27:18.122133+0000","last_became_active":"2024-09-10T23:27:17.102152+0000","last_became_peered":"2024-09-10T23:27:17.102152+0000","last_unstale":"2024-09-10T23:27:18.122133+0000","last_undegraded":"2024-09-10T23:27:18.122133+0000","last_fullsized":"2024-09-10T23:27:18.122133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:36.895870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088313+0000","last_change":"2024-09-10T23:27:17.101777+0000","last_active":"2024-09-10T23:27:18.088313+0000","last_peered":"2024-09-10T23:27:18.088313+0000","last_clean":"2024-09-10T23:27:18.088313+0000","last_became_active":"2024-09-10T23:27:17.101450+0000","last_became_peered":"2024-09-10T23:27:17.101450+0000","last_unstale":"2024-09-10T23:27:18.088313+0000","last_undegraded":"2024-09-10T23:27:18.088313+0000","last_fullsized":"2024-09-10T23:27:18.088313+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:36.442601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655290+0000","last_change":"2024-09-10T23:27:17.121509+0000","last_active":"2024-09-10T23:27:18.655290+0000","last_peered":"2024-09-10T23:27:18.655290+0000","last_clean":"2024-09-10T23:27:18.655290+0000","last_became_active":"2024-09-10T23:27:17.121230+0000","last_became_peered":"2024-09-10T23:27:17.121230+0000","last_unstale":"2024-09-10T23:27:18.655290+0000","last_undegraded":"2024-09-10T23:27:18.655290+0000","last_fullsized":"2024-09-10T23:27:18.655290+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:02.572094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121637+0000","last_change":"2024-09-10T23:27:17.092322+0000","last_active":"2024-09-10T23:27:18.121637+0000","last_peered":"2024-09-10T23:27:18.121637+0000","last_clean":"2024-09-10T23:27:18.121637+0000","last_became_active":"2024-09-10T23:27:17.092042+0000","last_became_peered":"2024-09-10T23:27:17.092042+0000","last_unstale":"2024-09-10T23:27:18.121637+0000","last_undegraded":"2024-09-10T23:27:18.121637+0000","last_fullsized":"2024-09-10T23:27:18.121637+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:12.311349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654704+0000","last_change":"2024-09-10T23:27:17.115783+0000","last_active":"2024-09-10T23:27:18.654704+0000","last_peered":"2024-09-10T23:27:18.654704+0000","last_clean":"2024-09-10T23:27:18.654704+0000","last_became_active":"2024-09-10T23:27:17.115009+0000","last_became_peered":"2024-09-10T23:27:17.115009+0000","last_unstale":"2024-09-10T23:27:18.654704+0000","last_undegraded":"2024-09-10T23:27:18.654704+0000","last_fullsized":"2024-09-10T23:27:18.654704+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.085446+0000","last_change":"2024-09-10T23:27:16.085446+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.085446+0000","last_undegraded":"2024-09-10T23:27:16.085446+0000","last_fullsized":"2024-09-10T23:27:16.085446+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654122+0000","last_change":"2024-09-10T23:27:17.111758+0000","last_active":"2024-09-10T23:27:18.654122+0000","last_peered":"2024-09-10T23:27:18.654122+0000","last_clean":"2024-09-10T23:27:18.654122+0000","last_became_active":"2024-09-10T23:27:17.111409+0000","last_became_peered":"2024-09-10T23:27:17.111409+0000","last_unstale":"2024-09-10T23:27:18.654122+0000","last_undegraded":"2024-09-10T23:27:18.654122+0000","last_fullsized":"2024-09-10T23:27:18.654122+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.084929+0000","last_change":"2024-09-10T23:27:16.084929+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.084929+0000","last_undegraded":"2024-09-10T23:27:16.084929+0000","last_fullsized":"2024-09-10T23:27:16.084929+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654870+0000","last_change":"2024-09-10T23:27:17.112841+0000","last_active":"2024-09-10T23:27:18.654870+0000","last_peered":"2024-09-10T23:27:18.654870+0000","last_clean":"2024-09-10T23:27:18.654870+0000","last_became_active":"2024-09-10T23:27:17.112210+0000","last_became_peered":"2024-09-10T23:27:17.112210+0000","last_unstale":"2024-09-10T23:27:18.654870+0000","last_undegraded":"2024-09-10T23:27:18.654870+0000","last_fullsized":"2024-09-10T23:27:18.654870+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:32.914654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"165'4","reported_seq":19,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095147+0000","last_change":"2024-09-10T23:27:16.086889+0000","last_active":"2024-09-10T23:27:18.095147+0000","last_peered":"2024-09-10T23:27:18.095147+0000","last_clean":"2024-09-10T23:27:18.095147+0000","last_became_active":"2024-09-10T23:27:16.086511+0000","last_became_peered":"2024-09-10T23:27:16.086511+0000","last_unstale":"2024-09-10T23:27:18.095147+0000","last_undegraded":"2024-09-10T23:27:18.095147+0000","last_fullsized":"2024-09-10T23:27:18.095147+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:49.905701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121836+0000","last_change":"2024-09-10T23:27:17.107022+0000","last_active":"2024-09-10T23:27:18.121836+0000","last_peered":"2024-09-10T23:27:18.121836+0000","last_clean":"2024-09-10T23:27:18.121836+0000","last_became_active":"2024-09-10T23:27:17.106736+0000","last_became_peered":"2024-09-10T23:27:17.106736+0000","last_unstale":"2024-09-10T23:27:18.121836+0000","last_undegraded":"2024-09-10T23:27:18.121836+0000","last_fullsized":"2024-09-10T23:27:18.121836+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:12.419867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648898+0000","last_change":"2024-09-10T23:27:16.096542+0000","last_active":"2024-09-10T23:27:18.648898+0000","last_peered":"2024-09-10T23:27:18.648898+0000","last_clean":"2024-09-10T23:27:18.648898+0000","last_became_active":"2024-09-10T23:27:16.096251+0000","last_became_peered":"2024-09-10T23:27:16.096251+0000","last_unstale":"2024-09-10T23:27:18.648898+0000","last_undegraded":"2024-09-10T23:27:18.648898+0000","last_fullsized":"2024-09-10T23:27:18.648898+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:58.411262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648867+0000","last_change":"2024-09-10T23:27:17.115424+0000","last_active":"2024-09-10T23:27:18.648867+0000","last_peered":"2024-09-10T23:27:18.648867+0000","last_clean":"2024-09-10T23:27:18.648867+0000","last_became_active":"2024-09-10T23:27:17.110909+0000","last_became_peered":"2024-09-10T23:27:17.110909+0000","last_unstale":"2024-09-10T23:27:18.648867+0000","last_undegraded":"2024-09-10T23:27:18.648867+0000","last_fullsized":"2024-09-10T23:27:18.648867+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.523204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654701+0000","last_change":"2024-09-10T23:27:16.089236+0000","last_active":"2024-09-10T23:27:18.654701+0000","last_peered":"2024-09-10T23:27:18.654701+0000","last_clean":"2024-09-10T23:27:18.654701+0000","last_became_active":"2024-09-10T23:27:16.088941+0000","last_became_peered":"2024-09-10T23:27:16.088941+0000","last_unstale":"2024-09-10T23:27:18.654701+0000","last_undegraded":"2024-09-10T23:27:18.654701+0000","last_fullsized":"2024-09-10T23:27:18.654701+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:07.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654951+0000","last_change":"2024-09-10T23:27:17.110922+0000","last_active":"2024-09-10T23:27:18.654951+0000","last_peered":"2024-09-10T23:27:18.654951+0000","last_clean":"2024-09-10T23:27:18.654951+0000","last_became_active":"2024-09-10T23:27:17.110608+0000","last_became_peered":"2024-09-10T23:27:17.110608+0000","last_unstale":"2024-09-10T23:27:18.654951+0000","last_undegraded":"2024-09-10T23:27:18.654951+0000","last_fullsized":"2024-09-10T23:27:18.654951+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:58.856996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088437+0000","last_change":"2024-09-10T23:27:16.094988+0000","last_active":"2024-09-10T23:27:18.088437+0000","last_peered":"2024-09-10T23:27:18.088437+0000","last_clean":"2024-09-10T23:27:18.088437+0000","last_became_active":"2024-09-10T23:27:16.089019+0000","last_became_peered":"2024-09-10T23:27:16.089019+0000","last_unstale":"2024-09-10T23:27:18.088437+0000","last_undegraded":"2024-09-10T23:27:18.088437+0000","last_fullsized":"2024-09-10T23:27:18.088437+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:20.281854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124284+0000","last_change":"2024-09-10T23:27:17.105543+0000","last_active":"2024-09-10T23:27:18.124284+0000","last_peered":"2024-09-10T23:27:18.124284+0000","last_clean":"2024-09-10T23:27:18.124284+0000","last_became_active":"2024-09-10T23:27:17.105257+0000","last_became_peered":"2024-09-10T23:27:17.105257+0000","last_unstale":"2024-09-10T23:27:18.124284+0000","last_undegraded":"2024-09-10T23:27:18.124284+0000","last_fullsized":"2024-09-10T23:27:18.124284+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123894+0000","last_change":"2024-09-10T23:27:16.098401+0000","last_active":"2024-09-10T23:27:18.123894+0000","last_peered":"2024-09-10T23:27:18.123894+0000","last_clean":"2024-09-10T23:27:18.123894+0000","last_became_active":"2024-09-10T23:27:16.098145+0000","last_became_peered":"2024-09-10T23:27:16.098145+0000","last_unstale":"2024-09-10T23:27:18.123894+0000","last_undegraded":"2024-09-10T23:27:18.123894+0000","last_fullsized":"2024-09-10T23:27:18.123894+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:36.117554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088367+0000","last_change":"2024-09-10T23:27:17.101986+0000","last_active":"2024-09-10T23:27:18.088367+0000","last_peered":"2024-09-10T23:27:18.088367+0000","last_clean":"2024-09-10T23:27:18.088367+0000","last_became_active":"2024-09-10T23:27:17.101415+0000","last_became_peered":"2024-09-10T23:27:17.101415+0000","last_unstale":"2024-09-10T23:27:18.088367+0000","last_undegraded":"2024-09-10T23:27:18.088367+0000","last_fullsized":"2024-09-10T23:27:18.088367+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:55.747742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648884+0000","last_change":"2024-09-10T23:27:16.084947+0000","last_active":"2024-09-10T23:27:18.648884+0000","last_peered":"2024-09-10T23:27:18.648884+0000","last_clean":"2024-09-10T23:27:18.648884+0000","last_became_active":"2024-09-10T23:27:16.084692+0000","last_became_peered":"2024-09-10T23:27:16.084692+0000","last_unstale":"2024-09-10T23:27:18.648884+0000","last_undegraded":"2024-09-10T23:27:18.648884+0000","last_fullsized":"2024-09-10T23:27:18.648884+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:57.850082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088531+0000","last_change":"2024-09-10T23:27:17.098759+0000","last_active":"2024-09-10T23:27:18.088531+0000","last_peered":"2024-09-10T23:27:18.088531+0000","last_clean":"2024-09-10T23:27:18.088531+0000","last_became_active":"2024-09-10T23:27:17.098487+0000","last_became_peered":"2024-09-10T23:27:17.098487+0000","last_unstale":"2024-09-10T23:27:18.088531+0000","last_undegraded":"2024-09-10T23:27:18.088531+0000","last_fullsized":"2024-09-10T23:27:18.088531+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:27.166404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.087971+0000","last_change":"2024-09-10T23:27:16.087772+0000","last_active":"2024-09-10T23:27:18.087971+0000","last_peered":"2024-09-10T23:27:18.087971+0000","last_clean":"2024-09-10T23:27:18.087971+0000","last_became_active":"2024-09-10T23:27:16.087528+0000","last_became_peered":"2024-09-10T23:27:16.087528+0000","last_unstale":"2024-09-10T23:27:18.087971+0000","last_undegraded":"2024-09-10T23:27:18.087971+0000","last_fullsized":"2024-09-10T23:27:18.087971+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:36.395245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095077+0000","last_change":"2024-09-10T23:27:17.102817+0000","last_active":"2024-09-10T23:27:18.095077+0000","last_peered":"2024-09-10T23:27:18.095077+0000","last_clean":"2024-09-10T23:27:18.095077+0000","last_became_active":"2024-09-10T23:27:17.102164+0000","last_became_peered":"2024-09-10T23:27:17.102164+0000","last_unstale":"2024-09-10T23:27:18.095077+0000","last_undegraded":"2024-09-10T23:27:18.095077+0000","last_fullsized":"2024-09-10T23:27:18.095077+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:53.800068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123863+0000","last_change":"2024-09-10T23:27:16.099929+0000","last_active":"2024-09-10T23:27:18.123863+0000","last_peered":"2024-09-10T23:27:18.123863+0000","last_clean":"2024-09-10T23:27:18.123863+0000","last_became_active":"2024-09-10T23:27:16.099633+0000","last_became_peered":"2024-09-10T23:27:16.099633+0000","last_unstale":"2024-09-10T23:27:18.123863+0000","last_undegraded":"2024-09-10T23:27:18.123863+0000","last_fullsized":"2024-09-10T23:27:18.123863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:46.599497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654770+0000","last_change":"2024-09-10T23:27:17.113875+0000","last_active":"2024-09-10T23:27:18.654770+0000","last_peered":"2024-09-10T23:27:18.654770+0000","last_clean":"2024-09-10T23:27:18.654770+0000","last_became_active":"2024-09-10T23:27:17.113118+0000","last_became_peered":"2024-09-10T23:27:17.113118+0000","last_unstale":"2024-09-10T23:27:18.654770+0000","last_undegraded":"2024-09-10T23:27:18.654770+0000","last_fullsized":"2024-09-10T23:27:18.654770+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:04.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121961+0000","last_change":"2024-09-10T23:27:16.098737+0000","last_active":"2024-09-10T23:27:18.121961+0000","last_peered":"2024-09-10T23:27:18.121961+0000","last_clean":"2024-09-10T23:27:18.121961+0000","last_became_active":"2024-09-10T23:27:16.098442+0000","last_became_peered":"2024-09-10T23:27:16.098442+0000","last_unstale":"2024-09-10T23:27:18.121961+0000","last_undegraded":"2024-09-10T23:27:18.121961+0000","last_fullsized":"2024-09-10T23:27:18.121961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:59.654302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121238+0000","last_change":"2024-09-10T23:27:17.109414+0000","last_active":"2024-09-10T23:27:18.121238+0000","last_peered":"2024-09-10T23:27:18.121238+0000","last_clean":"2024-09-10T23:27:18.121238+0000","last_became_active":"2024-09-10T23:27:17.109116+0000","last_became_peered":"2024-09-10T23:27:17.109116+0000","last_unstale":"2024-09-10T23:27:18.121238+0000","last_undegraded":"2024-09-10T23:27:18.121238+0000","last_fullsized":"2024-09-10T23:27:18.121238+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:42.308068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"165'3","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094291+0000","last_change":"2024-09-10T23:27:16.097793+0000","last_active":"2024-09-10T23:27:18.094291+0000","last_peered":"2024-09-10T23:27:18.094291+0000","last_clean":"2024-09-10T23:27:18.094291+0000","last_became_active":"2024-09-10T23:27:16.097498+0000","last_became_peered":"2024-09-10T23:27:16.097498+0000","last_unstale":"2024-09-10T23:27:18.094291+0000","last_undegraded":"2024-09-10T23:27:18.094291+0000","last_fullsized":"2024-09-10T23:27:18.094291+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:57.282134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088279+0000","last_change":"2024-09-10T23:27:17.118822+0000","last_active":"2024-09-10T23:27:18.088279+0000","last_peered":"2024-09-10T23:27:18.088279+0000","last_clean":"2024-09-10T23:27:18.088279+0000","last_became_active":"2024-09-10T23:27:17.118563+0000","last_became_peered":"2024-09-10T23:27:17.118563+0000","last_unstale":"2024-09-10T23:27:18.088279+0000","last_undegraded":"2024-09-10T23:27:18.088279+0000","last_fullsized":"2024-09-10T23:27:18.088279+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:57.399526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"165'6","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121746+0000","last_change":"2024-09-10T23:27:16.101748+0000","last_active":"2024-09-10T23:27:18.121746+0000","last_peered":"2024-09-10T23:27:18.121746+0000","last_clean":"2024-09-10T23:27:18.121746+0000","last_became_active":"2024-09-10T23:27:16.100263+0000","last_became_peered":"2024-09-10T23:27:16.100263+0000","last_unstale":"2024-09-10T23:27:18.121746+0000","last_undegraded":"2024-09-10T23:27:18.121746+0000","last_fullsized":"2024-09-10T23:27:18.121746+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:38.172255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.088745+0000","last_change":"2024-09-10T23:27:16.088745+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.088745+0000","last_undegraded":"2024-09-10T23:27:16.088745+0000","last_fullsized":"2024-09-10T23:27:16.088745+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649018+0000","last_change":"2024-09-10T23:27:16.091730+0000","last_active":"2024-09-10T23:27:18.649018+0000","last_peered":"2024-09-10T23:27:18.649018+0000","last_clean":"2024-09-10T23:27:18.649018+0000","last_became_active":"2024-09-10T23:27:16.090957+0000","last_became_peered":"2024-09-10T23:27:16.090957+0000","last_unstale":"2024-09-10T23:27:18.649018+0000","last_undegraded":"2024-09-10T23:27:18.649018+0000","last_fullsized":"2024-09-10T23:27:18.649018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:23.431267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124243+0000","last_change":"2024-09-10T23:27:17.118859+0000","last_active":"2024-09-10T23:27:18.124243+0000","last_peered":"2024-09-10T23:27:18.124243+0000","last_clean":"2024-09-10T23:27:18.124243+0000","last_became_active":"2024-09-10T23:27:17.118402+0000","last_became_peered":"2024-09-10T23:27:17.118402+0000","last_unstale":"2024-09-10T23:27:18.124243+0000","last_undegraded":"2024-09-10T23:27:18.124243+0000","last_fullsized":"2024-09-10T23:27:18.124243+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121380+0000","last_change":"2024-09-10T23:27:16.085990+0000","last_active":"2024-09-10T23:27:18.121380+0000","last_peered":"2024-09-10T23:27:18.121380+0000","last_clean":"2024-09-10T23:27:18.121380+0000","last_became_active":"2024-09-10T23:27:16.085702+0000","last_became_peered":"2024-09-10T23:27:16.085702+0000","last_unstale":"2024-09-10T23:27:18.121380+0000","last_undegraded":"2024-09-10T23:27:18.121380+0000","last_fullsized":"2024-09-10T23:27:18.121380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:33.884766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654861+0000","last_change":"2024-09-10T23:27:17.116517+0000","last_active":"2024-09-10T23:27:18.654861+0000","last_peered":"2024-09-10T23:27:18.654861+0000","last_clean":"2024-09-10T23:27:18.654861+0000","last_became_active":"2024-09-10T23:27:17.116082+0000","last_became_peered":"2024-09-10T23:27:17.116082+0000","last_unstale":"2024-09-10T23:27:18.654861+0000","last_undegraded":"2024-09-10T23:27:18.654861+0000","last_fullsized":"2024-09-10T23:27:18.654861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654176+0000","last_change":"2024-09-10T23:27:16.092789+0000","last_active":"2024-09-10T23:27:18.654176+0000","last_peered":"2024-09-10T23:27:18.654176+0000","last_clean":"2024-09-10T23:27:18.654176+0000","last_became_active":"2024-09-10T23:27:16.092548+0000","last_became_peered":"2024-09-10T23:27:16.092548+0000","last_unstale":"2024-09-10T23:27:18.654176+0000","last_undegraded":"2024-09-10T23:27:18.654176+0000","last_fullsized":"2024-09-10T23:27:18.654176+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:17.509832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088448+0000","last_change":"2024-09-10T23:27:17.102362+0000","last_active":"2024-09-10T23:27:18.088448+0000","last_peered":"2024-09-10T23:27:18.088448+0000","last_clean":"2024-09-10T23:27:18.088448+0000","last_became_active":"2024-09-10T23:27:17.102022+0000","last_became_peered":"2024-09-10T23:27:17.102022+0000","last_unstale":"2024-09-10T23:27:18.088448+0000","last_undegraded":"2024-09-10T23:27:18.088448+0000","last_fullsized":"2024-09-10T23:27:18.088448+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:22.009162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"165'8","reported_seq":23,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123907+0000","last_change":"2024-09-10T23:27:16.097848+0000","last_active":"2024-09-10T23:27:18.123907+0000","last_peered":"2024-09-10T23:27:18.123907+0000","last_clean":"2024-09-10T23:27:18.123907+0000","last_became_active":"2024-09-10T23:27:16.097483+0000","last_became_peered":"2024-09-10T23:27:16.097483+0000","last_unstale":"2024-09-10T23:27:18.123907+0000","last_undegraded":"2024-09-10T23:27:18.123907+0000","last_fullsized":"2024-09-10T23:27:18.123907+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:59.132712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123840+0000","last_change":"2024-09-10T23:27:17.104862+0000","last_active":"2024-09-10T23:27:18.123840+0000","last_peered":"2024-09-10T23:27:18.123840+0000","last_clean":"2024-09-10T23:27:18.123840+0000","last_became_active":"2024-09-10T23:27:17.103480+0000","last_became_peered":"2024-09-10T23:27:17.103480+0000","last_unstale":"2024-09-10T23:27:18.123840+0000","last_undegraded":"2024-09-10T23:27:18.123840+0000","last_fullsized":"2024-09-10T23:27:18.123840+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122067+0000","last_change":"2024-09-10T23:27:16.084160+0000","last_active":"2024-09-10T23:27:18.122067+0000","last_peered":"2024-09-10T23:27:18.122067+0000","last_clean":"2024-09-10T23:27:18.122067+0000","last_became_active":"2024-09-10T23:27:16.083818+0000","last_became_peered":"2024-09-10T23:27:16.083818+0000","last_unstale":"2024-09-10T23:27:18.122067+0000","last_undegraded":"2024-09-10T23:27:18.122067+0000","last_fullsized":"2024-09-10T23:27:18.122067+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:44.668087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.084619+0000","last_change":"2024-09-10T23:27:16.084619+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.084619+0000","last_undegraded":"2024-09-10T23:27:16.084619+0000","last_fullsized":"2024-09-10T23:27:16.084619+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124345+0000","last_change":"2024-09-10T23:27:16.095550+0000","last_active":"2024-09-10T23:27:18.124345+0000","last_peered":"2024-09-10T23:27:18.124345+0000","last_clean":"2024-09-10T23:27:18.124345+0000","last_became_active":"2024-09-10T23:27:16.093841+0000","last_became_peered":"2024-09-10T23:27:16.093841+0000","last_unstale":"2024-09-10T23:27:18.124345+0000","last_undegraded":"2024-09-10T23:27:18.124345+0000","last_fullsized":"2024-09-10T23:27:18.124345+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654590+0000","last_change":"2024-09-10T23:27:17.102508+0000","last_active":"2024-09-10T23:27:18.654590+0000","last_peered":"2024-09-10T23:27:18.654590+0000","last_clean":"2024-09-10T23:27:18.654590+0000","last_became_active":"2024-09-10T23:27:17.102219+0000","last_became_peered":"2024-09-10T23:27:17.102219+0000","last_unstale":"2024-09-10T23:27:18.654590+0000","last_undegraded":"2024-09-10T23:27:18.654590+0000","last_fullsized":"2024-09-10T23:27:18.654590+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648863+0000","last_change":"2024-09-10T23:27:16.082194+0000","last_active":"2024-09-10T23:27:18.648863+0000","last_peered":"2024-09-10T23:27:18.648863+0000","last_clean":"2024-09-10T23:27:18.648863+0000","last_became_active":"2024-09-10T23:27:16.081929+0000","last_became_peered":"2024-09-10T23:27:16.081929+0000","last_unstale":"2024-09-10T23:27:18.648863+0000","last_undegraded":"2024-09-10T23:27:18.648863+0000","last_fullsized":"2024-09-10T23:27:18.648863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:01.565180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654640+0000","last_change":"2024-09-10T23:27:17.116874+0000","last_active":"2024-09-10T23:27:18.654640+0000","last_peered":"2024-09-10T23:27:18.654640+0000","last_clean":"2024-09-10T23:27:18.654640+0000","last_became_active":"2024-09-10T23:27:17.116618+0000","last_became_peered":"2024-09-10T23:27:17.116618+0000","last_unstale":"2024-09-10T23:27:18.654640+0000","last_undegraded":"2024-09-10T23:27:18.654640+0000","last_fullsized":"2024-09-10T23:27:18.654640+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124289+0000","last_change":"2024-09-10T23:27:16.097769+0000","last_active":"2024-09-10T23:27:18.124289+0000","last_peered":"2024-09-10T23:27:18.124289+0000","last_clean":"2024-09-10T23:27:18.124289+0000","last_became_active":"2024-09-10T23:27:16.097374+0000","last_became_peered":"2024-09-10T23:27:16.097374+0000","last_unstale":"2024-09-10T23:27:18.124289+0000","last_undegraded":"2024-09-10T23:27:18.124289+0000","last_fullsized":"2024-09-10T23:27:18.124289+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.793154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121765+0000","last_change":"2024-09-10T23:27:17.092162+0000","last_active":"2024-09-10T23:27:18.121765+0000","last_peered":"2024-09-10T23:27:18.121765+0000","last_clean":"2024-09-10T23:27:18.121765+0000","last_became_active":"2024-09-10T23:27:17.091863+0000","last_became_peered":"2024-09-10T23:27:17.091863+0000","last_unstale":"2024-09-10T23:27:18.121765+0000","last_undegraded":"2024-09-10T23:27:18.121765+0000","last_fullsized":"2024-09-10T23:27:18.121765+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.826000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649109+0000","last_change":"2024-09-10T23:27:16.089641+0000","last_active":"2024-09-10T23:27:18.649109+0000","last_peered":"2024-09-10T23:27:18.649109+0000","last_clean":"2024-09-10T23:27:18.649109+0000","last_became_active":"2024-09-10T23:27:16.088701+0000","last_became_peered":"2024-09-10T23:27:16.088701+0000","last_unstale":"2024-09-10T23:27:18.649109+0000","last_undegraded":"2024-09-10T23:27:18.649109+0000","last_fullsized":"2024-09-10T23:27:18.649109+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:45.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649034+0000","last_change":"2024-09-10T23:27:17.115275+0000","last_active":"2024-09-10T23:27:18.649034+0000","last_peered":"2024-09-10T23:27:18.649034+0000","last_clean":"2024-09-10T23:27:18.649034+0000","last_became_active":"2024-09-10T23:27:17.114068+0000","last_became_peered":"2024-09-10T23:27:17.114068+0000","last_unstale":"2024-09-10T23:27:18.649034+0000","last_undegraded":"2024-09-10T23:27:18.649034+0000","last_fullsized":"2024-09-10T23:27:18.649034+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:47.769062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654274+0000","last_change":"2024-09-10T23:27:16.091395+0000","last_active":"2024-09-10T23:27:18.654274+0000","last_peered":"2024-09-10T23:27:18.654274+0000","last_clean":"2024-09-10T23:27:18.654274+0000","last_became_active":"2024-09-10T23:27:16.091136+0000","last_became_peered":"2024-09-10T23:27:16.091136+0000","last_unstale":"2024-09-10T23:27:18.654274+0000","last_undegraded":"2024-09-10T23:27:18.654274+0000","last_fullsized":"2024-09-10T23:27:18.654274+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649010+0000","last_change":"2024-09-10T23:27:17.116302+0000","last_active":"2024-09-10T23:27:18.649010+0000","last_peered":"2024-09-10T23:27:18.649010+0000","last_clean":"2024-09-10T23:27:18.649010+0000","last_became_active":"2024-09-10T23:27:17.115078+0000","last_became_peered":"2024-09-10T23:27:17.115078+0000","last_unstale":"2024-09-10T23:27:18.649010+0000","last_undegraded":"2024-09-10T23:27:18.649010+0000","last_fullsized":"2024-09-10T23:27:18.649010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.266065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088362+0000","last_change":"2024-09-10T23:27:16.093832+0000","last_active":"2024-09-10T23:27:18.088362+0000","last_peered":"2024-09-10T23:27:18.088362+0000","last_clean":"2024-09-10T23:27:18.088362+0000","last_became_active":"2024-09-10T23:27:16.089264+0000","last_became_peered":"2024-09-10T23:27:16.089264+0000","last_unstale":"2024-09-10T23:27:18.088362+0000","last_undegraded":"2024-09-10T23:27:18.088362+0000","last_fullsized":"2024-09-10T23:27:18.088362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:34.365596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655734+0000","last_change":"2024-09-10T23:27:17.113240+0000","last_active":"2024-09-10T23:27:18.655734+0000","last_peered":"2024-09-10T23:27:18.655734+0000","last_clean":"2024-09-10T23:27:18.655734+0000","last_became_active":"2024-09-10T23:27:17.112858+0000","last_became_peered":"2024-09-10T23:27:17.112858+0000","last_unstale":"2024-09-10T23:27:18.655734+0000","last_undegraded":"2024-09-10T23:27:18.655734+0000","last_fullsized":"2024-09-10T23:27:18.655734+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:25.920123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654938+0000","last_change":"2024-09-10T23:27:16.098898+0000","last_active":"2024-09-10T23:27:18.654938+0000","last_peered":"2024-09-10T23:27:18.654938+0000","last_clean":"2024-09-10T23:27:18.654938+0000","last_became_active":"2024-09-10T23:27:16.098612+0000","last_became_peered":"2024-09-10T23:27:16.098612+0000","last_unstale":"2024-09-10T23:27:18.654938+0000","last_undegraded":"2024-09-10T23:27:18.654938+0000","last_fullsized":"2024-09-10T23:27:18.654938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:20.951718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.653946+0000","last_change":"2024-09-10T23:27:17.111049+0000","last_active":"2024-09-10T23:27:18.653946+0000","last_peered":"2024-09-10T23:27:18.653946+0000","last_clean":"2024-09-10T23:27:18.653946+0000","last_became_active":"2024-09-10T23:27:17.110785+0000","last_became_peered":"2024-09-10T23:27:17.110785+0000","last_unstale":"2024-09-10T23:27:18.653946+0000","last_undegraded":"2024-09-10T23:27:18.653946+0000","last_fullsized":"2024-09-10T23:27:18.653946+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649027+0000","last_change":"2024-09-10T23:27:16.084074+0000","last_active":"2024-09-10T23:27:18.649027+0000","last_peered":"2024-09-10T23:27:18.649027+0000","last_clean":"2024-09-10T23:27:18.649027+0000","last_became_active":"2024-09-10T23:27:16.083796+0000","last_became_peered":"2024-09-10T23:27:16.083796+0000","last_unstale":"2024-09-10T23:27:18.649027+0000","last_undegraded":"2024-09-10T23:27:18.649027+0000","last_fullsized":"2024-09-10T23:27:18.649027+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:31.907739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123973+0000","last_change":"2024-09-10T23:27:17.109500+0000","last_active":"2024-09-10T23:27:18.123973+0000","last_peered":"2024-09-10T23:27:18.123973+0000","last_clean":"2024-09-10T23:27:18.123973+0000","last_became_active":"2024-09-10T23:27:17.109163+0000","last_became_peered":"2024-09-10T23:27:17.109163+0000","last_unstale":"2024-09-10T23:27:18.123973+0000","last_undegraded":"2024-09-10T23:27:18.123973+0000","last_fullsized":"2024-09-10T23:27:18.123973+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"166'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123185+0000","last_change":"2024-09-10T23:27:16.099284+0000","last_active":"2024-09-10T23:27:18.123185+0000","last_peered":"2024-09-10T23:27:18.123185+0000","last_clean":"2024-09-10T23:27:18.123185+0000","last_became_active":"2024-09-10T23:27:16.098730+0000","last_became_peered":"2024-09-10T23:27:16.098730+0000","last_unstale":"2024-09-10T23:27:18.123185+0000","last_undegraded":"2024-09-10T23:27:18.123185+0000","last_fullsized":"2024-09-10T23:27:18.123185+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:36.406564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088655+0000","last_change":"2024-09-10T23:27:17.100031+0000","last_active":"2024-09-10T23:27:18.088655+0000","last_peered":"2024-09-10T23:27:18.088655+0000","last_clean":"2024-09-10T23:27:18.088655+0000","last_became_active":"2024-09-10T23:27:17.099753+0000","last_became_peered":"2024-09-10T23:27:17.099753+0000","last_unstale":"2024-09-10T23:27:18.088655+0000","last_undegraded":"2024-09-10T23:27:18.088655+0000","last_fullsized":"2024-09-10T23:27:18.088655+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:00.932972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121568+0000","last_change":"2024-09-10T23:27:16.093939+0000","last_active":"2024-09-10T23:27:18.121568+0000","last_peered":"2024-09-10T23:27:18.121568+0000","last_clean":"2024-09-10T23:27:18.121568+0000","last_became_active":"2024-09-10T23:27:16.093597+0000","last_became_peered":"2024-09-10T23:27:16.093597+0000","last_unstale":"2024-09-10T23:27:18.121568+0000","last_undegraded":"2024-09-10T23:27:18.121568+0000","last_fullsized":"2024-09-10T23:27:18.121568+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:43.549959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124149+0000","last_change":"2024-09-10T23:27:17.107113+0000","last_active":"2024-09-10T23:27:18.124149+0000","last_peered":"2024-09-10T23:27:18.124149+0000","last_clean":"2024-09-10T23:27:18.124149+0000","last_became_active":"2024-09-10T23:27:17.106859+0000","last_became_peered":"2024-09-10T23:27:17.106859+0000","last_unstale":"2024-09-10T23:27:18.124149+0000","last_undegraded":"2024-09-10T23:27:18.124149+0000","last_fullsized":"2024-09-10T23:27:18.124149+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088636+0000","last_change":"2024-09-10T23:27:16.100147+0000","last_active":"2024-09-10T23:27:18.088636+0000","last_peered":"2024-09-10T23:27:18.088636+0000","last_clean":"2024-09-10T23:27:18.088636+0000","last_became_active":"2024-09-10T23:27:16.099691+0000","last_became_peered":"2024-09-10T23:27:16.099691+0000","last_unstale":"2024-09-10T23:27:18.088636+0000","last_undegraded":"2024-09-10T23:27:18.088636+0000","last_fullsized":"2024-09-10T23:27:18.088636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:54.133674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094649+0000","last_change":"2024-09-10T23:27:17.119298+0000","last_active":"2024-09-10T23:27:18.094649+0000","last_peered":"2024-09-10T23:27:18.094649+0000","last_clean":"2024-09-10T23:27:18.094649+0000","last_became_active":"2024-09-10T23:27:17.118918+0000","last_became_peered":"2024-09-10T23:27:17.118918+0000","last_unstale":"2024-09-10T23:27:18.094649+0000","last_undegraded":"2024-09-10T23:27:18.094649+0000","last_fullsized":"2024-09-10T23:27:18.094649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:55.884595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094384+0000","last_change":"2024-09-10T23:27:16.090393+0000","last_active":"2024-09-10T23:27:18.094384+0000","last_peered":"2024-09-10T23:27:18.094384+0000","last_clean":"2024-09-10T23:27:18.094384+0000","last_became_active":"2024-09-10T23:27:16.090138+0000","last_became_peered":"2024-09-10T23:27:16.090138+0000","last_unstale":"2024-09-10T23:27:18.094384+0000","last_undegraded":"2024-09-10T23:27:18.094384+0000","last_fullsized":"2024-09-10T23:27:18.094384+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:12.975929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655516+0000","last_change":"2024-09-10T23:27:17.110962+0000","last_active":"2024-09-10T23:27:18.655516+0000","last_peered":"2024-09-10T23:27:18.655516+0000","last_clean":"2024-09-10T23:27:18.655516+0000","last_became_active":"2024-09-10T23:27:17.110669+0000","last_became_peered":"2024-09-10T23:27:17.110669+0000","last_unstale":"2024-09-10T23:27:18.655516+0000","last_undegraded":"2024-09-10T23:27:18.655516+0000","last_fullsized":"2024-09-10T23:27:18.655516+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:46.498405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121402+0000","last_change":"2024-09-10T23:27:16.089373+0000","last_active":"2024-09-10T23:27:18.121402+0000","last_peered":"2024-09-10T23:27:18.121402+0000","last_clean":"2024-09-10T23:27:18.121402+0000","last_became_active":"2024-09-10T23:27:16.089120+0000","last_became_peered":"2024-09-10T23:27:16.089120+0000","last_unstale":"2024-09-10T23:27:18.121402+0000","last_undegraded":"2024-09-10T23:27:18.121402+0000","last_fullsized":"2024-09-10T23:27:18.121402+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:19.387603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121663+0000","last_change":"2024-09-10T23:27:17.094316+0000","last_active":"2024-09-10T23:27:18.121663+0000","last_peered":"2024-09-10T23:27:18.121663+0000","last_clean":"2024-09-10T23:27:18.121663+0000","last_became_active":"2024-09-10T23:27:17.094021+0000","last_became_peered":"2024-09-10T23:27:17.094021+0000","last_unstale":"2024-09-10T23:27:18.121663+0000","last_undegraded":"2024-09-10T23:27:18.121663+0000","last_fullsized":"2024-09-10T23:27:18.121663+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:15.902576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654294+0000","last_change":"2024-09-10T23:27:16.096182+0000","last_active":"2024-09-10T23:27:18.654294+0000","last_peered":"2024-09-10T23:27:18.654294+0000","last_clean":"2024-09-10T23:27:18.654294+0000","last_became_active":"2024-09-10T23:27:16.094386+0000","last_became_peered":"2024-09-10T23:27:16.094386+0000","last_unstale":"2024-09-10T23:27:18.654294+0000","last_undegraded":"2024-09-10T23:27:18.654294+0000","last_fullsized":"2024-09-10T23:27:18.654294+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.903208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088687+0000","last_change":"2024-09-10T23:27:17.116139+0000","last_active":"2024-09-10T23:27:18.088687+0000","last_peered":"2024-09-10T23:27:18.088687+0000","last_clean":"2024-09-10T23:27:18.088687+0000","last_became_active":"2024-09-10T23:27:17.115852+0000","last_became_peered":"2024-09-10T23:27:17.115852+0000","last_unstale":"2024-09-10T23:27:18.088687+0000","last_undegraded":"2024-09-10T23:27:18.088687+0000","last_fullsized":"2024-09-10T23:27:18.088687+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:54.432594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648362+0000","last_change":"2024-09-10T23:27:16.093853+0000","last_active":"2024-09-10T23:27:18.648362+0000","last_peered":"2024-09-10T23:27:18.648362+0000","last_clean":"2024-09-10T23:27:18.648362+0000","last_became_active":"2024-09-10T23:27:16.093586+0000","last_became_peered":"2024-09-10T23:27:16.093586+0000","last_unstale":"2024-09-10T23:27:18.648362+0000","last_undegraded":"2024-09-10T23:27:18.648362+0000","last_fullsized":"2024-09-10T23:27:18.648362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:03.023982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654467+0000","last_change":"2024-09-10T23:27:17.114770+0000","last_active":"2024-09-10T23:27:18.654467+0000","last_peered":"2024-09-10T23:27:18.654467+0000","last_clean":"2024-09-10T23:27:18.654467+0000","last_became_active":"2024-09-10T23:27:17.112895+0000","last_became_peered":"2024-09-10T23:27:17.112895+0000","last_unstale":"2024-09-10T23:27:18.654467+0000","last_undegraded":"2024-09-10T23:27:18.654467+0000","last_fullsized":"2024-09-10T23:27:18.654467+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:05.711658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121640+0000","last_change":"2024-09-10T23:27:16.099331+0000","last_active":"2024-09-10T23:27:18.121640+0000","last_peered":"2024-09-10T23:27:18.121640+0000","last_clean":"2024-09-10T23:27:18.121640+0000","last_became_active":"2024-09-10T23:27:16.099068+0000","last_became_peered":"2024-09-10T23:27:16.099068+0000","last_unstale":"2024-09-10T23:27:18.121640+0000","last_undegraded":"2024-09-10T23:27:18.121640+0000","last_fullsized":"2024-09-10T23:27:18.121640+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:23.742338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":370,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655059+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:27:18.655059+0000","last_peered":"2024-09-10T23:27:18.655059+0000","last_clean":"2024-09-10T23:27:18.655059+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:27:18.655059+0000","last_undegraded":"2024-09-10T23:27:18.655059+0000","last_fullsized":"2024-09-10T23:27:18.655059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69212,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302628,"statfs":{"total":96636764160,"available":96565891072,"internally_reserved":0,"allocated":2039808,"data_stored":955710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509587,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69832,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302008,"statfs":{"total":96636764160,"available":96565256192,"internally_reserved":0,"allocated":2670592,"data_stored":1566596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2084864,"data_stored":976352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69328,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302512,"statfs":{"total":96636764160,"available":96565772288,"internally_reserved":0,"allocated":2093056,"data_stored":976992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509586,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69312,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302528,"statfs":{"total":96636764160,"available":96565788672,"internally_reserved":0,"allocated":2076672,"data_stored":976228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509587,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2088960,"data_stored":977840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509586,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74060,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297780,"statfs":{"total":96636764160,"available":96560926720,"internally_reserved":0,"allocated":2678784,"data_stored":1566700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2097152,"data_stored":978444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:27:21.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:27:21.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.437+0000 7fb74a000640 1 -- 172.21.15.17:0/3964573865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb728004810 msgr2=0x7fb728004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.437+0000 7fb74a000640 1 --2- 172.21.15.17:0/3964573865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb728004810 0x7fb728004c90 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fb72c001730 tx=0x7fb72c01ef70 comp rx=0 tx=0).stop 2024-09-10T23:27:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.437+0000 7fb743e00640 1 -- 172.21.15.17:0/3964573865 reap_dead start 2024-09-10T23:27:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.437+0000 7fb74a000640 1 -- 172.21.15.17:0/3964573865 shutdown_connections 2024-09-10T23:27:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.437+0000 7fb74a000640 1 -- 172.21.15.17:0/3964573865 >> 172.21.15.17:0/3964573865 conn(0x7fb74406cfc0 msgr2=0x7fb74406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.437+0000 7fb74a000640 1 -- 172.21.15.17:0/3964573865 shutdown_connections 2024-09-10T23:27:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.437+0000 7fb74a000640 1 -- 172.21.15.17:0/3964573865 wait complete. 2024-09-10T23:27:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.437+0000 7fb74a000640 1 Processor -- start 2024-09-10T23:27:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.437+0000 7fb74a000640 1 -- start start 2024-09-10T23:27:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb74a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb728004810 0x7fb7441f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb74a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb74414f490 0x7fb7441f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb74a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7441f38e0 0x7fb7440a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb74a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb7440d07c0 con 0x7fb728004810 2024-09-10T23:27:21.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb74a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb7440d0640 con 0x7fb7441f38e0 2024-09-10T23:27:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb74a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb744073930 con 0x7fb74414f490 2024-09-10T23:27:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb728004810 0x7fb7441f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb728004810 0x7fb7441f6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35082/0 (socket says 172.21.15.17:35082) 2024-09-10T23:27:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743400640 1 -- 172.21.15.17:0/1303333340 learned_addr learned my addr 172.21.15.17:0/1303333340 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743400640 1 -- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb74414f490 msgr2=0x7fb7441f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb73aa00640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb74414f490 0x7fb7441f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743e00640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7441f38e0 0x7fb7440a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743400640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb74414f490 0x7fb7441f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743400640 1 -- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7441f38e0 msgr2=0x7fb7440a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743400640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7441f38e0 0x7fb7440a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743400640 1 -- 172.21.15.17:0/1303333340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7441e6a20 con 0x7fb728004810 2024-09-10T23:27:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb73aa00640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb74414f490 0x7fb7441f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743e00640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7441f38e0 0x7fb7440a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb743400640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb728004810 0x7fb7441f6720 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fb734006fa0 tx=0x7fb7340039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb73be00640 1 -- 172.21.15.17:0/1303333340 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734011700 con 0x7fb728004810 2024-09-10T23:27:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb73be00640 1 -- 172.21.15.17:0/1303333340 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb734016020 con 0x7fb728004810 2024-09-10T23:27:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7441e44a0 con 0x7fb728004810 2024-09-10T23:27:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb73be00640 1 -- 172.21.15.17:0/1303333340 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734011b40 con 0x7fb728004810 2024-09-10T23:27:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7441e4a60 con 0x7fb728004810 2024-09-10T23:27:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb744073e90 con 0x7fb728004810 2024-09-10T23:27:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.441+0000 7fb73be00640 1 -- 172.21.15.17:0/1303333340 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb734011ce0 con 0x7fb728004810 2024-09-10T23:27:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.445+0000 7fb73be00640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7200725e0 0x7fb720074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.445+0000 7fb73be00640 1 -- 172.21.15.17:0/1303333340 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fb734093a50 con 0x7fb728004810 2024-09-10T23:27:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.445+0000 7fb73aa00640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7200725e0 0x7fb720074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.445+0000 7fb73aa00640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7200725e0 0x7fb720074aa0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb7280057f0 tx=0x7fb72c01bd10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:21.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.449+0000 7fb73be00640 1 -- 172.21.15.17:0/1303333340 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb734020030 con 0x7fb728004810 2024-09-10T23:27:21.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.621+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7441e4250 con 0x7fb7200725e0 2024-09-10T23:27:21.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.625+0000 7fb73be00640 1 -- 172.21.15.17:0/1303333340 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252057 (secure 0 0 0) 0x7fb7441e4250 con 0x7fb7200725e0 2024-09-10T23:27:21.631 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:27:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7200725e0 msgr2=0x7fb720074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7200725e0 0x7fb720074aa0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb7280057f0 tx=0x7fb72c01bd10 comp rx=0 tx=0).stop 2024-09-10T23:27:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb728004810 msgr2=0x7fb7441f6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb728004810 0x7fb7441f6720 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fb734006fa0 tx=0x7fb7340039d0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 shutdown_connections 2024-09-10T23:27:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb7200725e0 0x7fb720074aa0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7441f38e0 0x7fb7440a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb74414f490 0x7fb7441f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 --2- 172.21.15.17:0/1303333340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb728004810 0x7fb7441f6720 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 >> 172.21.15.17:0/1303333340 conn(0x7fb74406cfc0 msgr2=0x7fb744158b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 shutdown_connections 2024-09-10T23:27:21.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.629+0000 7fb74a000640 1 -- 172.21.15.17:0/1303333340 wait complete. 2024-09-10T23:27:21.653 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":518,"stamp":"2024-09-10T23:27:20.462625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522232,"kb_used_data":17412,"kb_used_omap":12,"kb_used_meta":504627,"kb_avail":754452488,"statfs":{"total":773094113280,"available":772559347712,"internally_reserved":0,"allocated":17829888,"data_stored":8974862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516738609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.389823"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095075+0000","last_change":"2024-09-10T23:27:17.106584+0000","last_active":"2024-09-10T23:27:18.095075+0000","last_peered":"2024-09-10T23:27:18.095075+0000","last_clean":"2024-09-10T23:27:18.095075+0000","last_became_active":"2024-09-10T23:27:17.106315+0000","last_became_peered":"2024-09-10T23:27:17.106315+0000","last_unstale":"2024-09-10T23:27:18.095075+0000","last_undegraded":"2024-09-10T23:27:18.095075+0000","last_fullsized":"2024-09-10T23:27:18.095075+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:54.902790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655807+0000","last_change":"2024-09-10T23:27:17.115113+0000","last_active":"2024-09-10T23:27:18.655807+0000","last_peered":"2024-09-10T23:27:18.655807+0000","last_clean":"2024-09-10T23:27:18.655807+0000","last_became_active":"2024-09-10T23:27:17.114341+0000","last_became_peered":"2024-09-10T23:27:17.114341+0000","last_unstale":"2024-09-10T23:27:18.655807+0000","last_undegraded":"2024-09-10T23:27:18.655807+0000","last_fullsized":"2024-09-10T23:27:18.655807+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:20.113939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094285+0000","last_change":"2024-09-10T23:27:17.101230+0000","last_active":"2024-09-10T23:27:18.094285+0000","last_peered":"2024-09-10T23:27:18.094285+0000","last_clean":"2024-09-10T23:27:18.094285+0000","last_became_active":"2024-09-10T23:27:17.100946+0000","last_became_peered":"2024-09-10T23:27:17.100946+0000","last_unstale":"2024-09-10T23:27:18.094285+0000","last_undegraded":"2024-09-10T23:27:18.094285+0000","last_fullsized":"2024-09-10T23:27:18.094285+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:20.365134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094578+0000","last_change":"2024-09-10T23:27:17.105978+0000","last_active":"2024-09-10T23:27:18.094578+0000","last_peered":"2024-09-10T23:27:18.094578+0000","last_clean":"2024-09-10T23:27:18.094578+0000","last_became_active":"2024-09-10T23:27:17.105502+0000","last_became_peered":"2024-09-10T23:27:17.105502+0000","last_unstale":"2024-09-10T23:27:18.094578+0000","last_undegraded":"2024-09-10T23:27:18.094578+0000","last_fullsized":"2024-09-10T23:27:18.094578+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:04.674325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649044+0000","last_change":"2024-09-10T23:27:17.108926+0000","last_active":"2024-09-10T23:27:18.649044+0000","last_peered":"2024-09-10T23:27:18.649044+0000","last_clean":"2024-09-10T23:27:18.649044+0000","last_became_active":"2024-09-10T23:27:17.108589+0000","last_became_peered":"2024-09-10T23:27:17.108589+0000","last_unstale":"2024-09-10T23:27:18.649044+0000","last_undegraded":"2024-09-10T23:27:18.649044+0000","last_fullsized":"2024-09-10T23:27:18.649044+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:47.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654886+0000","last_change":"2024-09-10T23:27:17.114012+0000","last_active":"2024-09-10T23:27:18.654886+0000","last_peered":"2024-09-10T23:27:18.654886+0000","last_clean":"2024-09-10T23:27:18.654886+0000","last_became_active":"2024-09-10T23:27:17.111391+0000","last_became_peered":"2024-09-10T23:27:17.111391+0000","last_unstale":"2024-09-10T23:27:18.654886+0000","last_undegraded":"2024-09-10T23:27:18.654886+0000","last_fullsized":"2024-09-10T23:27:18.654886+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:33.637514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123961+0000","last_change":"2024-09-10T23:27:17.104858+0000","last_active":"2024-09-10T23:27:18.123961+0000","last_peered":"2024-09-10T23:27:18.123961+0000","last_clean":"2024-09-10T23:27:18.123961+0000","last_became_active":"2024-09-10T23:27:17.104575+0000","last_became_peered":"2024-09-10T23:27:17.104575+0000","last_unstale":"2024-09-10T23:27:18.123961+0000","last_undegraded":"2024-09-10T23:27:18.123961+0000","last_fullsized":"2024-09-10T23:27:18.123961+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123806+0000","last_change":"2024-09-10T23:27:17.110407+0000","last_active":"2024-09-10T23:27:18.123806+0000","last_peered":"2024-09-10T23:27:18.123806+0000","last_clean":"2024-09-10T23:27:18.123806+0000","last_became_active":"2024-09-10T23:27:17.110090+0000","last_became_peered":"2024-09-10T23:27:17.110090+0000","last_unstale":"2024-09-10T23:27:18.123806+0000","last_undegraded":"2024-09-10T23:27:18.123806+0000","last_fullsized":"2024-09-10T23:27:18.123806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:55.534473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124433+0000","last_change":"2024-09-10T23:27:17.110221+0000","last_active":"2024-09-10T23:27:18.124433+0000","last_peered":"2024-09-10T23:27:18.124433+0000","last_clean":"2024-09-10T23:27:18.124433+0000","last_became_active":"2024-09-10T23:27:17.109916+0000","last_became_peered":"2024-09-10T23:27:17.109916+0000","last_unstale":"2024-09-10T23:27:18.124433+0000","last_undegraded":"2024-09-10T23:27:18.124433+0000","last_fullsized":"2024-09-10T23:27:18.124433+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124429+0000","last_change":"2024-09-10T23:27:17.103184+0000","last_active":"2024-09-10T23:27:18.124429+0000","last_peered":"2024-09-10T23:27:18.124429+0000","last_clean":"2024-09-10T23:27:18.124429+0000","last_became_active":"2024-09-10T23:27:17.102108+0000","last_became_peered":"2024-09-10T23:27:17.102108+0000","last_unstale":"2024-09-10T23:27:18.124429+0000","last_undegraded":"2024-09-10T23:27:18.124429+0000","last_fullsized":"2024-09-10T23:27:18.124429+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655402+0000","last_change":"2024-09-10T23:27:17.120609+0000","last_active":"2024-09-10T23:27:18.655402+0000","last_peered":"2024-09-10T23:27:18.655402+0000","last_clean":"2024-09-10T23:27:18.655402+0000","last_became_active":"2024-09-10T23:27:17.120402+0000","last_became_peered":"2024-09-10T23:27:17.120402+0000","last_unstale":"2024-09-10T23:27:18.655402+0000","last_undegraded":"2024-09-10T23:27:18.655402+0000","last_fullsized":"2024-09-10T23:27:18.655402+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:58.328456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655563+0000","last_change":"2024-09-10T23:27:17.113454+0000","last_active":"2024-09-10T23:27:18.655563+0000","last_peered":"2024-09-10T23:27:18.655563+0000","last_clean":"2024-09-10T23:27:18.655563+0000","last_became_active":"2024-09-10T23:27:17.113102+0000","last_became_peered":"2024-09-10T23:27:17.113102+0000","last_unstale":"2024-09-10T23:27:18.655563+0000","last_undegraded":"2024-09-10T23:27:18.655563+0000","last_fullsized":"2024-09-10T23:27:18.655563+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:24.438181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121506+0000","last_change":"2024-09-10T23:27:17.104651+0000","last_active":"2024-09-10T23:27:18.121506+0000","last_peered":"2024-09-10T23:27:18.121506+0000","last_clean":"2024-09-10T23:27:18.121506+0000","last_became_active":"2024-09-10T23:27:17.104356+0000","last_became_peered":"2024-09-10T23:27:17.104356+0000","last_unstale":"2024-09-10T23:27:18.121506+0000","last_undegraded":"2024-09-10T23:27:18.121506+0000","last_fullsized":"2024-09-10T23:27:18.121506+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:31.195103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648806+0000","last_change":"2024-09-10T23:27:17.112364+0000","last_active":"2024-09-10T23:27:18.648806+0000","last_peered":"2024-09-10T23:27:18.648806+0000","last_clean":"2024-09-10T23:27:18.648806+0000","last_became_active":"2024-09-10T23:27:17.110862+0000","last_became_peered":"2024-09-10T23:27:17.110862+0000","last_unstale":"2024-09-10T23:27:18.648806+0000","last_undegraded":"2024-09-10T23:27:18.648806+0000","last_fullsized":"2024-09-10T23:27:18.648806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:37.706200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654100+0000","last_change":"2024-09-10T23:27:17.115869+0000","last_active":"2024-09-10T23:27:18.654100+0000","last_peered":"2024-09-10T23:27:18.654100+0000","last_clean":"2024-09-10T23:27:18.654100+0000","last_became_active":"2024-09-10T23:27:17.115594+0000","last_became_peered":"2024-09-10T23:27:17.115594+0000","last_unstale":"2024-09-10T23:27:18.654100+0000","last_undegraded":"2024-09-10T23:27:18.654100+0000","last_fullsized":"2024-09-10T23:27:18.654100+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094113+0000","last_change":"2024-09-10T23:27:17.105827+0000","last_active":"2024-09-10T23:27:18.094113+0000","last_peered":"2024-09-10T23:27:18.094113+0000","last_clean":"2024-09-10T23:27:18.094113+0000","last_became_active":"2024-09-10T23:27:17.105514+0000","last_became_peered":"2024-09-10T23:27:17.105514+0000","last_unstale":"2024-09-10T23:27:18.094113+0000","last_undegraded":"2024-09-10T23:27:18.094113+0000","last_fullsized":"2024-09-10T23:27:18.094113+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:41.256305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124559+0000","last_change":"2024-09-10T23:27:17.103100+0000","last_active":"2024-09-10T23:27:18.124559+0000","last_peered":"2024-09-10T23:27:18.124559+0000","last_clean":"2024-09-10T23:27:18.124559+0000","last_became_active":"2024-09-10T23:27:17.101922+0000","last_became_peered":"2024-09-10T23:27:17.101922+0000","last_unstale":"2024-09-10T23:27:18.124559+0000","last_undegraded":"2024-09-10T23:27:18.124559+0000","last_fullsized":"2024-09-10T23:27:18.124559+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:21.276448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.089170+0000","last_change":"2024-09-10T23:27:16.089170+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.089170+0000","last_undegraded":"2024-09-10T23:27:16.089170+0000","last_fullsized":"2024-09-10T23:27:16.089170+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654548+0000","last_change":"2024-09-10T23:27:17.115816+0000","last_active":"2024-09-10T23:27:18.654548+0000","last_peered":"2024-09-10T23:27:18.654548+0000","last_clean":"2024-09-10T23:27:18.654548+0000","last_became_active":"2024-09-10T23:27:17.115530+0000","last_became_peered":"2024-09-10T23:27:17.115530+0000","last_unstale":"2024-09-10T23:27:18.654548+0000","last_undegraded":"2024-09-10T23:27:18.654548+0000","last_fullsized":"2024-09-10T23:27:18.654548+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088360+0000","last_change":"2024-09-10T23:27:17.115834+0000","last_active":"2024-09-10T23:27:18.088360+0000","last_peered":"2024-09-10T23:27:18.088360+0000","last_clean":"2024-09-10T23:27:18.088360+0000","last_became_active":"2024-09-10T23:27:17.115548+0000","last_became_peered":"2024-09-10T23:27:17.115548+0000","last_unstale":"2024-09-10T23:27:18.088360+0000","last_undegraded":"2024-09-10T23:27:18.088360+0000","last_fullsized":"2024-09-10T23:27:18.088360+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:55.699175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121835+0000","last_change":"2024-09-10T23:27:17.093723+0000","last_active":"2024-09-10T23:27:18.121835+0000","last_peered":"2024-09-10T23:27:18.121835+0000","last_clean":"2024-09-10T23:27:18.121835+0000","last_became_active":"2024-09-10T23:27:17.093438+0000","last_became_peered":"2024-09-10T23:27:17.093438+0000","last_unstale":"2024-09-10T23:27:18.121835+0000","last_undegraded":"2024-09-10T23:27:18.121835+0000","last_fullsized":"2024-09-10T23:27:18.121835+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:09.201890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655133+0000","last_change":"2024-09-10T23:27:17.121543+0000","last_active":"2024-09-10T23:27:18.655133+0000","last_peered":"2024-09-10T23:27:18.655133+0000","last_clean":"2024-09-10T23:27:18.655133+0000","last_became_active":"2024-09-10T23:27:17.121249+0000","last_became_peered":"2024-09-10T23:27:17.121249+0000","last_unstale":"2024-09-10T23:27:18.655133+0000","last_undegraded":"2024-09-10T23:27:18.655133+0000","last_fullsized":"2024-09-10T23:27:18.655133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:37.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648649+0000","last_change":"2024-09-10T23:27:17.107888+0000","last_active":"2024-09-10T23:27:18.648649+0000","last_peered":"2024-09-10T23:27:18.648649+0000","last_clean":"2024-09-10T23:27:18.648649+0000","last_became_active":"2024-09-10T23:27:17.107606+0000","last_became_peered":"2024-09-10T23:27:17.107606+0000","last_unstale":"2024-09-10T23:27:18.648649+0000","last_undegraded":"2024-09-10T23:27:18.648649+0000","last_fullsized":"2024-09-10T23:27:18.648649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:35.414834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094571+0000","last_change":"2024-09-10T23:27:17.096587+0000","last_active":"2024-09-10T23:27:18.094571+0000","last_peered":"2024-09-10T23:27:18.094571+0000","last_clean":"2024-09-10T23:27:18.094571+0000","last_became_active":"2024-09-10T23:27:17.096284+0000","last_became_peered":"2024-09-10T23:27:17.096284+0000","last_unstale":"2024-09-10T23:27:18.094571+0000","last_undegraded":"2024-09-10T23:27:18.094571+0000","last_fullsized":"2024-09-10T23:27:18.094571+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:37.468206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122133+0000","last_change":"2024-09-10T23:27:17.102475+0000","last_active":"2024-09-10T23:27:18.122133+0000","last_peered":"2024-09-10T23:27:18.122133+0000","last_clean":"2024-09-10T23:27:18.122133+0000","last_became_active":"2024-09-10T23:27:17.102152+0000","last_became_peered":"2024-09-10T23:27:17.102152+0000","last_unstale":"2024-09-10T23:27:18.122133+0000","last_undegraded":"2024-09-10T23:27:18.122133+0000","last_fullsized":"2024-09-10T23:27:18.122133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:36.895870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088313+0000","last_change":"2024-09-10T23:27:17.101777+0000","last_active":"2024-09-10T23:27:18.088313+0000","last_peered":"2024-09-10T23:27:18.088313+0000","last_clean":"2024-09-10T23:27:18.088313+0000","last_became_active":"2024-09-10T23:27:17.101450+0000","last_became_peered":"2024-09-10T23:27:17.101450+0000","last_unstale":"2024-09-10T23:27:18.088313+0000","last_undegraded":"2024-09-10T23:27:18.088313+0000","last_fullsized":"2024-09-10T23:27:18.088313+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:36.442601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655290+0000","last_change":"2024-09-10T23:27:17.121509+0000","last_active":"2024-09-10T23:27:18.655290+0000","last_peered":"2024-09-10T23:27:18.655290+0000","last_clean":"2024-09-10T23:27:18.655290+0000","last_became_active":"2024-09-10T23:27:17.121230+0000","last_became_peered":"2024-09-10T23:27:17.121230+0000","last_unstale":"2024-09-10T23:27:18.655290+0000","last_undegraded":"2024-09-10T23:27:18.655290+0000","last_fullsized":"2024-09-10T23:27:18.655290+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:02.572094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121637+0000","last_change":"2024-09-10T23:27:17.092322+0000","last_active":"2024-09-10T23:27:18.121637+0000","last_peered":"2024-09-10T23:27:18.121637+0000","last_clean":"2024-09-10T23:27:18.121637+0000","last_became_active":"2024-09-10T23:27:17.092042+0000","last_became_peered":"2024-09-10T23:27:17.092042+0000","last_unstale":"2024-09-10T23:27:18.121637+0000","last_undegraded":"2024-09-10T23:27:18.121637+0000","last_fullsized":"2024-09-10T23:27:18.121637+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:12.311349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654704+0000","last_change":"2024-09-10T23:27:17.115783+0000","last_active":"2024-09-10T23:27:18.654704+0000","last_peered":"2024-09-10T23:27:18.654704+0000","last_clean":"2024-09-10T23:27:18.654704+0000","last_became_active":"2024-09-10T23:27:17.115009+0000","last_became_peered":"2024-09-10T23:27:17.115009+0000","last_unstale":"2024-09-10T23:27:18.654704+0000","last_undegraded":"2024-09-10T23:27:18.654704+0000","last_fullsized":"2024-09-10T23:27:18.654704+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.085446+0000","last_change":"2024-09-10T23:27:16.085446+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.085446+0000","last_undegraded":"2024-09-10T23:27:16.085446+0000","last_fullsized":"2024-09-10T23:27:16.085446+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654122+0000","last_change":"2024-09-10T23:27:17.111758+0000","last_active":"2024-09-10T23:27:18.654122+0000","last_peered":"2024-09-10T23:27:18.654122+0000","last_clean":"2024-09-10T23:27:18.654122+0000","last_became_active":"2024-09-10T23:27:17.111409+0000","last_became_peered":"2024-09-10T23:27:17.111409+0000","last_unstale":"2024-09-10T23:27:18.654122+0000","last_undegraded":"2024-09-10T23:27:18.654122+0000","last_fullsized":"2024-09-10T23:27:18.654122+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.084929+0000","last_change":"2024-09-10T23:27:16.084929+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.084929+0000","last_undegraded":"2024-09-10T23:27:16.084929+0000","last_fullsized":"2024-09-10T23:27:16.084929+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654870+0000","last_change":"2024-09-10T23:27:17.112841+0000","last_active":"2024-09-10T23:27:18.654870+0000","last_peered":"2024-09-10T23:27:18.654870+0000","last_clean":"2024-09-10T23:27:18.654870+0000","last_became_active":"2024-09-10T23:27:17.112210+0000","last_became_peered":"2024-09-10T23:27:17.112210+0000","last_unstale":"2024-09-10T23:27:18.654870+0000","last_undegraded":"2024-09-10T23:27:18.654870+0000","last_fullsized":"2024-09-10T23:27:18.654870+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:32.914654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"165'4","reported_seq":19,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095147+0000","last_change":"2024-09-10T23:27:16.086889+0000","last_active":"2024-09-10T23:27:18.095147+0000","last_peered":"2024-09-10T23:27:18.095147+0000","last_clean":"2024-09-10T23:27:18.095147+0000","last_became_active":"2024-09-10T23:27:16.086511+0000","last_became_peered":"2024-09-10T23:27:16.086511+0000","last_unstale":"2024-09-10T23:27:18.095147+0000","last_undegraded":"2024-09-10T23:27:18.095147+0000","last_fullsized":"2024-09-10T23:27:18.095147+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:49.905701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121836+0000","last_change":"2024-09-10T23:27:17.107022+0000","last_active":"2024-09-10T23:27:18.121836+0000","last_peered":"2024-09-10T23:27:18.121836+0000","last_clean":"2024-09-10T23:27:18.121836+0000","last_became_active":"2024-09-10T23:27:17.106736+0000","last_became_peered":"2024-09-10T23:27:17.106736+0000","last_unstale":"2024-09-10T23:27:18.121836+0000","last_undegraded":"2024-09-10T23:27:18.121836+0000","last_fullsized":"2024-09-10T23:27:18.121836+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:12.419867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648898+0000","last_change":"2024-09-10T23:27:16.096542+0000","last_active":"2024-09-10T23:27:18.648898+0000","last_peered":"2024-09-10T23:27:18.648898+0000","last_clean":"2024-09-10T23:27:18.648898+0000","last_became_active":"2024-09-10T23:27:16.096251+0000","last_became_peered":"2024-09-10T23:27:16.096251+0000","last_unstale":"2024-09-10T23:27:18.648898+0000","last_undegraded":"2024-09-10T23:27:18.648898+0000","last_fullsized":"2024-09-10T23:27:18.648898+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:58.411262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648867+0000","last_change":"2024-09-10T23:27:17.115424+0000","last_active":"2024-09-10T23:27:18.648867+0000","last_peered":"2024-09-10T23:27:18.648867+0000","last_clean":"2024-09-10T23:27:18.648867+0000","last_became_active":"2024-09-10T23:27:17.110909+0000","last_became_peered":"2024-09-10T23:27:17.110909+0000","last_unstale":"2024-09-10T23:27:18.648867+0000","last_undegraded":"2024-09-10T23:27:18.648867+0000","last_fullsized":"2024-09-10T23:27:18.648867+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.523204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654701+0000","last_change":"2024-09-10T23:27:16.089236+0000","last_active":"2024-09-10T23:27:18.654701+0000","last_peered":"2024-09-10T23:27:18.654701+0000","last_clean":"2024-09-10T23:27:18.654701+0000","last_became_active":"2024-09-10T23:27:16.088941+0000","last_became_peered":"2024-09-10T23:27:16.088941+0000","last_unstale":"2024-09-10T23:27:18.654701+0000","last_undegraded":"2024-09-10T23:27:18.654701+0000","last_fullsized":"2024-09-10T23:27:18.654701+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:07.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654951+0000","last_change":"2024-09-10T23:27:17.110922+0000","last_active":"2024-09-10T23:27:18.654951+0000","last_peered":"2024-09-10T23:27:18.654951+0000","last_clean":"2024-09-10T23:27:18.654951+0000","last_became_active":"2024-09-10T23:27:17.110608+0000","last_became_peered":"2024-09-10T23:27:17.110608+0000","last_unstale":"2024-09-10T23:27:18.654951+0000","last_undegraded":"2024-09-10T23:27:18.654951+0000","last_fullsized":"2024-09-10T23:27:18.654951+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:58.856996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088437+0000","last_change":"2024-09-10T23:27:16.094988+0000","last_active":"2024-09-10T23:27:18.088437+0000","last_peered":"2024-09-10T23:27:18.088437+0000","last_clean":"2024-09-10T23:27:18.088437+0000","last_became_active":"2024-09-10T23:27:16.089019+0000","last_became_peered":"2024-09-10T23:27:16.089019+0000","last_unstale":"2024-09-10T23:27:18.088437+0000","last_undegraded":"2024-09-10T23:27:18.088437+0000","last_fullsized":"2024-09-10T23:27:18.088437+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:20.281854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124284+0000","last_change":"2024-09-10T23:27:17.105543+0000","last_active":"2024-09-10T23:27:18.124284+0000","last_peered":"2024-09-10T23:27:18.124284+0000","last_clean":"2024-09-10T23:27:18.124284+0000","last_became_active":"2024-09-10T23:27:17.105257+0000","last_became_peered":"2024-09-10T23:27:17.105257+0000","last_unstale":"2024-09-10T23:27:18.124284+0000","last_undegraded":"2024-09-10T23:27:18.124284+0000","last_fullsized":"2024-09-10T23:27:18.124284+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123894+0000","last_change":"2024-09-10T23:27:16.098401+0000","last_active":"2024-09-10T23:27:18.123894+0000","last_peered":"2024-09-10T23:27:18.123894+0000","last_clean":"2024-09-10T23:27:18.123894+0000","last_became_active":"2024-09-10T23:27:16.098145+0000","last_became_peered":"2024-09-10T23:27:16.098145+0000","last_unstale":"2024-09-10T23:27:18.123894+0000","last_undegraded":"2024-09-10T23:27:18.123894+0000","last_fullsized":"2024-09-10T23:27:18.123894+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:36.117554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088367+0000","last_change":"2024-09-10T23:27:17.101986+0000","last_active":"2024-09-10T23:27:18.088367+0000","last_peered":"2024-09-10T23:27:18.088367+0000","last_clean":"2024-09-10T23:27:18.088367+0000","last_became_active":"2024-09-10T23:27:17.101415+0000","last_became_peered":"2024-09-10T23:27:17.101415+0000","last_unstale":"2024-09-10T23:27:18.088367+0000","last_undegraded":"2024-09-10T23:27:18.088367+0000","last_fullsized":"2024-09-10T23:27:18.088367+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:55.747742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648884+0000","last_change":"2024-09-10T23:27:16.084947+0000","last_active":"2024-09-10T23:27:18.648884+0000","last_peered":"2024-09-10T23:27:18.648884+0000","last_clean":"2024-09-10T23:27:18.648884+0000","last_became_active":"2024-09-10T23:27:16.084692+0000","last_became_peered":"2024-09-10T23:27:16.084692+0000","last_unstale":"2024-09-10T23:27:18.648884+0000","last_undegraded":"2024-09-10T23:27:18.648884+0000","last_fullsized":"2024-09-10T23:27:18.648884+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:57.850082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088531+0000","last_change":"2024-09-10T23:27:17.098759+0000","last_active":"2024-09-10T23:27:18.088531+0000","last_peered":"2024-09-10T23:27:18.088531+0000","last_clean":"2024-09-10T23:27:18.088531+0000","last_became_active":"2024-09-10T23:27:17.098487+0000","last_became_peered":"2024-09-10T23:27:17.098487+0000","last_unstale":"2024-09-10T23:27:18.088531+0000","last_undegraded":"2024-09-10T23:27:18.088531+0000","last_fullsized":"2024-09-10T23:27:18.088531+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:27.166404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.087971+0000","last_change":"2024-09-10T23:27:16.087772+0000","last_active":"2024-09-10T23:27:18.087971+0000","last_peered":"2024-09-10T23:27:18.087971+0000","last_clean":"2024-09-10T23:27:18.087971+0000","last_became_active":"2024-09-10T23:27:16.087528+0000","last_became_peered":"2024-09-10T23:27:16.087528+0000","last_unstale":"2024-09-10T23:27:18.087971+0000","last_undegraded":"2024-09-10T23:27:18.087971+0000","last_fullsized":"2024-09-10T23:27:18.087971+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:36.395245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095077+0000","last_change":"2024-09-10T23:27:17.102817+0000","last_active":"2024-09-10T23:27:18.095077+0000","last_peered":"2024-09-10T23:27:18.095077+0000","last_clean":"2024-09-10T23:27:18.095077+0000","last_became_active":"2024-09-10T23:27:17.102164+0000","last_became_peered":"2024-09-10T23:27:17.102164+0000","last_unstale":"2024-09-10T23:27:18.095077+0000","last_undegraded":"2024-09-10T23:27:18.095077+0000","last_fullsized":"2024-09-10T23:27:18.095077+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:53.800068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123863+0000","last_change":"2024-09-10T23:27:16.099929+0000","last_active":"2024-09-10T23:27:18.123863+0000","last_peered":"2024-09-10T23:27:18.123863+0000","last_clean":"2024-09-10T23:27:18.123863+0000","last_became_active":"2024-09-10T23:27:16.099633+0000","last_became_peered":"2024-09-10T23:27:16.099633+0000","last_unstale":"2024-09-10T23:27:18.123863+0000","last_undegraded":"2024-09-10T23:27:18.123863+0000","last_fullsized":"2024-09-10T23:27:18.123863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:46.599497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654770+0000","last_change":"2024-09-10T23:27:17.113875+0000","last_active":"2024-09-10T23:27:18.654770+0000","last_peered":"2024-09-10T23:27:18.654770+0000","last_clean":"2024-09-10T23:27:18.654770+0000","last_became_active":"2024-09-10T23:27:17.113118+0000","last_became_peered":"2024-09-10T23:27:17.113118+0000","last_unstale":"2024-09-10T23:27:18.654770+0000","last_undegraded":"2024-09-10T23:27:18.654770+0000","last_fullsized":"2024-09-10T23:27:18.654770+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:04.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121961+0000","last_change":"2024-09-10T23:27:16.098737+0000","last_active":"2024-09-10T23:27:18.121961+0000","last_peered":"2024-09-10T23:27:18.121961+0000","last_clean":"2024-09-10T23:27:18.121961+0000","last_became_active":"2024-09-10T23:27:16.098442+0000","last_became_peered":"2024-09-10T23:27:16.098442+0000","last_unstale":"2024-09-10T23:27:18.121961+0000","last_undegraded":"2024-09-10T23:27:18.121961+0000","last_fullsized":"2024-09-10T23:27:18.121961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:59.654302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121238+0000","last_change":"2024-09-10T23:27:17.109414+0000","last_active":"2024-09-10T23:27:18.121238+0000","last_peered":"2024-09-10T23:27:18.121238+0000","last_clean":"2024-09-10T23:27:18.121238+0000","last_became_active":"2024-09-10T23:27:17.109116+0000","last_became_peered":"2024-09-10T23:27:17.109116+0000","last_unstale":"2024-09-10T23:27:18.121238+0000","last_undegraded":"2024-09-10T23:27:18.121238+0000","last_fullsized":"2024-09-10T23:27:18.121238+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:42.308068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"165'3","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094291+0000","last_change":"2024-09-10T23:27:16.097793+0000","last_active":"2024-09-10T23:27:18.094291+0000","last_peered":"2024-09-10T23:27:18.094291+0000","last_clean":"2024-09-10T23:27:18.094291+0000","last_became_active":"2024-09-10T23:27:16.097498+0000","last_became_peered":"2024-09-10T23:27:16.097498+0000","last_unstale":"2024-09-10T23:27:18.094291+0000","last_undegraded":"2024-09-10T23:27:18.094291+0000","last_fullsized":"2024-09-10T23:27:18.094291+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:57.282134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088279+0000","last_change":"2024-09-10T23:27:17.118822+0000","last_active":"2024-09-10T23:27:18.088279+0000","last_peered":"2024-09-10T23:27:18.088279+0000","last_clean":"2024-09-10T23:27:18.088279+0000","last_became_active":"2024-09-10T23:27:17.118563+0000","last_became_peered":"2024-09-10T23:27:17.118563+0000","last_unstale":"2024-09-10T23:27:18.088279+0000","last_undegraded":"2024-09-10T23:27:18.088279+0000","last_fullsized":"2024-09-10T23:27:18.088279+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:57.399526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"165'6","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121746+0000","last_change":"2024-09-10T23:27:16.101748+0000","last_active":"2024-09-10T23:27:18.121746+0000","last_peered":"2024-09-10T23:27:18.121746+0000","last_clean":"2024-09-10T23:27:18.121746+0000","last_became_active":"2024-09-10T23:27:16.100263+0000","last_became_peered":"2024-09-10T23:27:16.100263+0000","last_unstale":"2024-09-10T23:27:18.121746+0000","last_undegraded":"2024-09-10T23:27:18.121746+0000","last_fullsized":"2024-09-10T23:27:18.121746+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:38.172255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.088745+0000","last_change":"2024-09-10T23:27:16.088745+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.088745+0000","last_undegraded":"2024-09-10T23:27:16.088745+0000","last_fullsized":"2024-09-10T23:27:16.088745+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649018+0000","last_change":"2024-09-10T23:27:16.091730+0000","last_active":"2024-09-10T23:27:18.649018+0000","last_peered":"2024-09-10T23:27:18.649018+0000","last_clean":"2024-09-10T23:27:18.649018+0000","last_became_active":"2024-09-10T23:27:16.090957+0000","last_became_peered":"2024-09-10T23:27:16.090957+0000","last_unstale":"2024-09-10T23:27:18.649018+0000","last_undegraded":"2024-09-10T23:27:18.649018+0000","last_fullsized":"2024-09-10T23:27:18.649018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:23.431267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124243+0000","last_change":"2024-09-10T23:27:17.118859+0000","last_active":"2024-09-10T23:27:18.124243+0000","last_peered":"2024-09-10T23:27:18.124243+0000","last_clean":"2024-09-10T23:27:18.124243+0000","last_became_active":"2024-09-10T23:27:17.118402+0000","last_became_peered":"2024-09-10T23:27:17.118402+0000","last_unstale":"2024-09-10T23:27:18.124243+0000","last_undegraded":"2024-09-10T23:27:18.124243+0000","last_fullsized":"2024-09-10T23:27:18.124243+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121380+0000","last_change":"2024-09-10T23:27:16.085990+0000","last_active":"2024-09-10T23:27:18.121380+0000","last_peered":"2024-09-10T23:27:18.121380+0000","last_clean":"2024-09-10T23:27:18.121380+0000","last_became_active":"2024-09-10T23:27:16.085702+0000","last_became_peered":"2024-09-10T23:27:16.085702+0000","last_unstale":"2024-09-10T23:27:18.121380+0000","last_undegraded":"2024-09-10T23:27:18.121380+0000","last_fullsized":"2024-09-10T23:27:18.121380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:33.884766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654861+0000","last_change":"2024-09-10T23:27:17.116517+0000","last_active":"2024-09-10T23:27:18.654861+0000","last_peered":"2024-09-10T23:27:18.654861+0000","last_clean":"2024-09-10T23:27:18.654861+0000","last_became_active":"2024-09-10T23:27:17.116082+0000","last_became_peered":"2024-09-10T23:27:17.116082+0000","last_unstale":"2024-09-10T23:27:18.654861+0000","last_undegraded":"2024-09-10T23:27:18.654861+0000","last_fullsized":"2024-09-10T23:27:18.654861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654176+0000","last_change":"2024-09-10T23:27:16.092789+0000","last_active":"2024-09-10T23:27:18.654176+0000","last_peered":"2024-09-10T23:27:18.654176+0000","last_clean":"2024-09-10T23:27:18.654176+0000","last_became_active":"2024-09-10T23:27:16.092548+0000","last_became_peered":"2024-09-10T23:27:16.092548+0000","last_unstale":"2024-09-10T23:27:18.654176+0000","last_undegraded":"2024-09-10T23:27:18.654176+0000","last_fullsized":"2024-09-10T23:27:18.654176+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:17.509832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088448+0000","last_change":"2024-09-10T23:27:17.102362+0000","last_active":"2024-09-10T23:27:18.088448+0000","last_peered":"2024-09-10T23:27:18.088448+0000","last_clean":"2024-09-10T23:27:18.088448+0000","last_became_active":"2024-09-10T23:27:17.102022+0000","last_became_peered":"2024-09-10T23:27:17.102022+0000","last_unstale":"2024-09-10T23:27:18.088448+0000","last_undegraded":"2024-09-10T23:27:18.088448+0000","last_fullsized":"2024-09-10T23:27:18.088448+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:22.009162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"165'8","reported_seq":23,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123907+0000","last_change":"2024-09-10T23:27:16.097848+0000","last_active":"2024-09-10T23:27:18.123907+0000","last_peered":"2024-09-10T23:27:18.123907+0000","last_clean":"2024-09-10T23:27:18.123907+0000","last_became_active":"2024-09-10T23:27:16.097483+0000","last_became_peered":"2024-09-10T23:27:16.097483+0000","last_unstale":"2024-09-10T23:27:18.123907+0000","last_undegraded":"2024-09-10T23:27:18.123907+0000","last_fullsized":"2024-09-10T23:27:18.123907+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:59.132712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123840+0000","last_change":"2024-09-10T23:27:17.104862+0000","last_active":"2024-09-10T23:27:18.123840+0000","last_peered":"2024-09-10T23:27:18.123840+0000","last_clean":"2024-09-10T23:27:18.123840+0000","last_became_active":"2024-09-10T23:27:17.103480+0000","last_became_peered":"2024-09-10T23:27:17.103480+0000","last_unstale":"2024-09-10T23:27:18.123840+0000","last_undegraded":"2024-09-10T23:27:18.123840+0000","last_fullsized":"2024-09-10T23:27:18.123840+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122067+0000","last_change":"2024-09-10T23:27:16.084160+0000","last_active":"2024-09-10T23:27:18.122067+0000","last_peered":"2024-09-10T23:27:18.122067+0000","last_clean":"2024-09-10T23:27:18.122067+0000","last_became_active":"2024-09-10T23:27:16.083818+0000","last_became_peered":"2024-09-10T23:27:16.083818+0000","last_unstale":"2024-09-10T23:27:18.122067+0000","last_undegraded":"2024-09-10T23:27:18.122067+0000","last_fullsized":"2024-09-10T23:27:18.122067+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:44.668087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.084619+0000","last_change":"2024-09-10T23:27:16.084619+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.084619+0000","last_undegraded":"2024-09-10T23:27:16.084619+0000","last_fullsized":"2024-09-10T23:27:16.084619+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124345+0000","last_change":"2024-09-10T23:27:16.095550+0000","last_active":"2024-09-10T23:27:18.124345+0000","last_peered":"2024-09-10T23:27:18.124345+0000","last_clean":"2024-09-10T23:27:18.124345+0000","last_became_active":"2024-09-10T23:27:16.093841+0000","last_became_peered":"2024-09-10T23:27:16.093841+0000","last_unstale":"2024-09-10T23:27:18.124345+0000","last_undegraded":"2024-09-10T23:27:18.124345+0000","last_fullsized":"2024-09-10T23:27:18.124345+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654590+0000","last_change":"2024-09-10T23:27:17.102508+0000","last_active":"2024-09-10T23:27:18.654590+0000","last_peered":"2024-09-10T23:27:18.654590+0000","last_clean":"2024-09-10T23:27:18.654590+0000","last_became_active":"2024-09-10T23:27:17.102219+0000","last_became_peered":"2024-09-10T23:27:17.102219+0000","last_unstale":"2024-09-10T23:27:18.654590+0000","last_undegraded":"2024-09-10T23:27:18.654590+0000","last_fullsized":"2024-09-10T23:27:18.654590+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648863+0000","last_change":"2024-09-10T23:27:16.082194+0000","last_active":"2024-09-10T23:27:18.648863+0000","last_peered":"2024-09-10T23:27:18.648863+0000","last_clean":"2024-09-10T23:27:18.648863+0000","last_became_active":"2024-09-10T23:27:16.081929+0000","last_became_peered":"2024-09-10T23:27:16.081929+0000","last_unstale":"2024-09-10T23:27:18.648863+0000","last_undegraded":"2024-09-10T23:27:18.648863+0000","last_fullsized":"2024-09-10T23:27:18.648863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:01.565180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654640+0000","last_change":"2024-09-10T23:27:17.116874+0000","last_active":"2024-09-10T23:27:18.654640+0000","last_peered":"2024-09-10T23:27:18.654640+0000","last_clean":"2024-09-10T23:27:18.654640+0000","last_became_active":"2024-09-10T23:27:17.116618+0000","last_became_peered":"2024-09-10T23:27:17.116618+0000","last_unstale":"2024-09-10T23:27:18.654640+0000","last_undegraded":"2024-09-10T23:27:18.654640+0000","last_fullsized":"2024-09-10T23:27:18.654640+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124289+0000","last_change":"2024-09-10T23:27:16.097769+0000","last_active":"2024-09-10T23:27:18.124289+0000","last_peered":"2024-09-10T23:27:18.124289+0000","last_clean":"2024-09-10T23:27:18.124289+0000","last_became_active":"2024-09-10T23:27:16.097374+0000","last_became_peered":"2024-09-10T23:27:16.097374+0000","last_unstale":"2024-09-10T23:27:18.124289+0000","last_undegraded":"2024-09-10T23:27:18.124289+0000","last_fullsized":"2024-09-10T23:27:18.124289+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.793154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121765+0000","last_change":"2024-09-10T23:27:17.092162+0000","last_active":"2024-09-10T23:27:18.121765+0000","last_peered":"2024-09-10T23:27:18.121765+0000","last_clean":"2024-09-10T23:27:18.121765+0000","last_became_active":"2024-09-10T23:27:17.091863+0000","last_became_peered":"2024-09-10T23:27:17.091863+0000","last_unstale":"2024-09-10T23:27:18.121765+0000","last_undegraded":"2024-09-10T23:27:18.121765+0000","last_fullsized":"2024-09-10T23:27:18.121765+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.826000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649109+0000","last_change":"2024-09-10T23:27:16.089641+0000","last_active":"2024-09-10T23:27:18.649109+0000","last_peered":"2024-09-10T23:27:18.649109+0000","last_clean":"2024-09-10T23:27:18.649109+0000","last_became_active":"2024-09-10T23:27:16.088701+0000","last_became_peered":"2024-09-10T23:27:16.088701+0000","last_unstale":"2024-09-10T23:27:18.649109+0000","last_undegraded":"2024-09-10T23:27:18.649109+0000","last_fullsized":"2024-09-10T23:27:18.649109+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:45.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649034+0000","last_change":"2024-09-10T23:27:17.115275+0000","last_active":"2024-09-10T23:27:18.649034+0000","last_peered":"2024-09-10T23:27:18.649034+0000","last_clean":"2024-09-10T23:27:18.649034+0000","last_became_active":"2024-09-10T23:27:17.114068+0000","last_became_peered":"2024-09-10T23:27:17.114068+0000","last_unstale":"2024-09-10T23:27:18.649034+0000","last_undegraded":"2024-09-10T23:27:18.649034+0000","last_fullsized":"2024-09-10T23:27:18.649034+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:47.769062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654274+0000","last_change":"2024-09-10T23:27:16.091395+0000","last_active":"2024-09-10T23:27:18.654274+0000","last_peered":"2024-09-10T23:27:18.654274+0000","last_clean":"2024-09-10T23:27:18.654274+0000","last_became_active":"2024-09-10T23:27:16.091136+0000","last_became_peered":"2024-09-10T23:27:16.091136+0000","last_unstale":"2024-09-10T23:27:18.654274+0000","last_undegraded":"2024-09-10T23:27:18.654274+0000","last_fullsized":"2024-09-10T23:27:18.654274+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649010+0000","last_change":"2024-09-10T23:27:17.116302+0000","last_active":"2024-09-10T23:27:18.649010+0000","last_peered":"2024-09-10T23:27:18.649010+0000","last_clean":"2024-09-10T23:27:18.649010+0000","last_became_active":"2024-09-10T23:27:17.115078+0000","last_became_peered":"2024-09-10T23:27:17.115078+0000","last_unstale":"2024-09-10T23:27:18.649010+0000","last_undegraded":"2024-09-10T23:27:18.649010+0000","last_fullsized":"2024-09-10T23:27:18.649010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.266065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088362+0000","last_change":"2024-09-10T23:27:16.093832+0000","last_active":"2024-09-10T23:27:18.088362+0000","last_peered":"2024-09-10T23:27:18.088362+0000","last_clean":"2024-09-10T23:27:18.088362+0000","last_became_active":"2024-09-10T23:27:16.089264+0000","last_became_peered":"2024-09-10T23:27:16.089264+0000","last_unstale":"2024-09-10T23:27:18.088362+0000","last_undegraded":"2024-09-10T23:27:18.088362+0000","last_fullsized":"2024-09-10T23:27:18.088362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:34.365596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655734+0000","last_change":"2024-09-10T23:27:17.113240+0000","last_active":"2024-09-10T23:27:18.655734+0000","last_peered":"2024-09-10T23:27:18.655734+0000","last_clean":"2024-09-10T23:27:18.655734+0000","last_became_active":"2024-09-10T23:27:17.112858+0000","last_became_peered":"2024-09-10T23:27:17.112858+0000","last_unstale":"2024-09-10T23:27:18.655734+0000","last_undegraded":"2024-09-10T23:27:18.655734+0000","last_fullsized":"2024-09-10T23:27:18.655734+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:25.920123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654938+0000","last_change":"2024-09-10T23:27:16.098898+0000","last_active":"2024-09-10T23:27:18.654938+0000","last_peered":"2024-09-10T23:27:18.654938+0000","last_clean":"2024-09-10T23:27:18.654938+0000","last_became_active":"2024-09-10T23:27:16.098612+0000","last_became_peered":"2024-09-10T23:27:16.098612+0000","last_unstale":"2024-09-10T23:27:18.654938+0000","last_undegraded":"2024-09-10T23:27:18.654938+0000","last_fullsized":"2024-09-10T23:27:18.654938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:20.951718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.653946+0000","last_change":"2024-09-10T23:27:17.111049+0000","last_active":"2024-09-10T23:27:18.653946+0000","last_peered":"2024-09-10T23:27:18.653946+0000","last_clean":"2024-09-10T23:27:18.653946+0000","last_became_active":"2024-09-10T23:27:17.110785+0000","last_became_peered":"2024-09-10T23:27:17.110785+0000","last_unstale":"2024-09-10T23:27:18.653946+0000","last_undegraded":"2024-09-10T23:27:18.653946+0000","last_fullsized":"2024-09-10T23:27:18.653946+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649027+0000","last_change":"2024-09-10T23:27:16.084074+0000","last_active":"2024-09-10T23:27:18.649027+0000","last_peered":"2024-09-10T23:27:18.649027+0000","last_clean":"2024-09-10T23:27:18.649027+0000","last_became_active":"2024-09-10T23:27:16.083796+0000","last_became_peered":"2024-09-10T23:27:16.083796+0000","last_unstale":"2024-09-10T23:27:18.649027+0000","last_undegraded":"2024-09-10T23:27:18.649027+0000","last_fullsized":"2024-09-10T23:27:18.649027+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:31.907739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123973+0000","last_change":"2024-09-10T23:27:17.109500+0000","last_active":"2024-09-10T23:27:18.123973+0000","last_peered":"2024-09-10T23:27:18.123973+0000","last_clean":"2024-09-10T23:27:18.123973+0000","last_became_active":"2024-09-10T23:27:17.109163+0000","last_became_peered":"2024-09-10T23:27:17.109163+0000","last_unstale":"2024-09-10T23:27:18.123973+0000","last_undegraded":"2024-09-10T23:27:18.123973+0000","last_fullsized":"2024-09-10T23:27:18.123973+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"166'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123185+0000","last_change":"2024-09-10T23:27:16.099284+0000","last_active":"2024-09-10T23:27:18.123185+0000","last_peered":"2024-09-10T23:27:18.123185+0000","last_clean":"2024-09-10T23:27:18.123185+0000","last_became_active":"2024-09-10T23:27:16.098730+0000","last_became_peered":"2024-09-10T23:27:16.098730+0000","last_unstale":"2024-09-10T23:27:18.123185+0000","last_undegraded":"2024-09-10T23:27:18.123185+0000","last_fullsized":"2024-09-10T23:27:18.123185+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:36.406564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088655+0000","last_change":"2024-09-10T23:27:17.100031+0000","last_active":"2024-09-10T23:27:18.088655+0000","last_peered":"2024-09-10T23:27:18.088655+0000","last_clean":"2024-09-10T23:27:18.088655+0000","last_became_active":"2024-09-10T23:27:17.099753+0000","last_became_peered":"2024-09-10T23:27:17.099753+0000","last_unstale":"2024-09-10T23:27:18.088655+0000","last_undegraded":"2024-09-10T23:27:18.088655+0000","last_fullsized":"2024-09-10T23:27:18.088655+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:00.932972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121568+0000","last_change":"2024-09-10T23:27:16.093939+0000","last_active":"2024-09-10T23:27:18.121568+0000","last_peered":"2024-09-10T23:27:18.121568+0000","last_clean":"2024-09-10T23:27:18.121568+0000","last_became_active":"2024-09-10T23:27:16.093597+0000","last_became_peered":"2024-09-10T23:27:16.093597+0000","last_unstale":"2024-09-10T23:27:18.121568+0000","last_undegraded":"2024-09-10T23:27:18.121568+0000","last_fullsized":"2024-09-10T23:27:18.121568+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:43.549959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124149+0000","last_change":"2024-09-10T23:27:17.107113+0000","last_active":"2024-09-10T23:27:18.124149+0000","last_peered":"2024-09-10T23:27:18.124149+0000","last_clean":"2024-09-10T23:27:18.124149+0000","last_became_active":"2024-09-10T23:27:17.106859+0000","last_became_peered":"2024-09-10T23:27:17.106859+0000","last_unstale":"2024-09-10T23:27:18.124149+0000","last_undegraded":"2024-09-10T23:27:18.124149+0000","last_fullsized":"2024-09-10T23:27:18.124149+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088636+0000","last_change":"2024-09-10T23:27:16.100147+0000","last_active":"2024-09-10T23:27:18.088636+0000","last_peered":"2024-09-10T23:27:18.088636+0000","last_clean":"2024-09-10T23:27:18.088636+0000","last_became_active":"2024-09-10T23:27:16.099691+0000","last_became_peered":"2024-09-10T23:27:16.099691+0000","last_unstale":"2024-09-10T23:27:18.088636+0000","last_undegraded":"2024-09-10T23:27:18.088636+0000","last_fullsized":"2024-09-10T23:27:18.088636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:54.133674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094649+0000","last_change":"2024-09-10T23:27:17.119298+0000","last_active":"2024-09-10T23:27:18.094649+0000","last_peered":"2024-09-10T23:27:18.094649+0000","last_clean":"2024-09-10T23:27:18.094649+0000","last_became_active":"2024-09-10T23:27:17.118918+0000","last_became_peered":"2024-09-10T23:27:17.118918+0000","last_unstale":"2024-09-10T23:27:18.094649+0000","last_undegraded":"2024-09-10T23:27:18.094649+0000","last_fullsized":"2024-09-10T23:27:18.094649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:55.884595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094384+0000","last_change":"2024-09-10T23:27:16.090393+0000","last_active":"2024-09-10T23:27:18.094384+0000","last_peered":"2024-09-10T23:27:18.094384+0000","last_clean":"2024-09-10T23:27:18.094384+0000","last_became_active":"2024-09-10T23:27:16.090138+0000","last_became_peered":"2024-09-10T23:27:16.090138+0000","last_unstale":"2024-09-10T23:27:18.094384+0000","last_undegraded":"2024-09-10T23:27:18.094384+0000","last_fullsized":"2024-09-10T23:27:18.094384+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:12.975929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655516+0000","last_change":"2024-09-10T23:27:17.110962+0000","last_active":"2024-09-10T23:27:18.655516+0000","last_peered":"2024-09-10T23:27:18.655516+0000","last_clean":"2024-09-10T23:27:18.655516+0000","last_became_active":"2024-09-10T23:27:17.110669+0000","last_became_peered":"2024-09-10T23:27:17.110669+0000","last_unstale":"2024-09-10T23:27:18.655516+0000","last_undegraded":"2024-09-10T23:27:18.655516+0000","last_fullsized":"2024-09-10T23:27:18.655516+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:46.498405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121402+0000","last_change":"2024-09-10T23:27:16.089373+0000","last_active":"2024-09-10T23:27:18.121402+0000","last_peered":"2024-09-10T23:27:18.121402+0000","last_clean":"2024-09-10T23:27:18.121402+0000","last_became_active":"2024-09-10T23:27:16.089120+0000","last_became_peered":"2024-09-10T23:27:16.089120+0000","last_unstale":"2024-09-10T23:27:18.121402+0000","last_undegraded":"2024-09-10T23:27:18.121402+0000","last_fullsized":"2024-09-10T23:27:18.121402+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:19.387603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121663+0000","last_change":"2024-09-10T23:27:17.094316+0000","last_active":"2024-09-10T23:27:18.121663+0000","last_peered":"2024-09-10T23:27:18.121663+0000","last_clean":"2024-09-10T23:27:18.121663+0000","last_became_active":"2024-09-10T23:27:17.094021+0000","last_became_peered":"2024-09-10T23:27:17.094021+0000","last_unstale":"2024-09-10T23:27:18.121663+0000","last_undegraded":"2024-09-10T23:27:18.121663+0000","last_fullsized":"2024-09-10T23:27:18.121663+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:15.902576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654294+0000","last_change":"2024-09-10T23:27:16.096182+0000","last_active":"2024-09-10T23:27:18.654294+0000","last_peered":"2024-09-10T23:27:18.654294+0000","last_clean":"2024-09-10T23:27:18.654294+0000","last_became_active":"2024-09-10T23:27:16.094386+0000","last_became_peered":"2024-09-10T23:27:16.094386+0000","last_unstale":"2024-09-10T23:27:18.654294+0000","last_undegraded":"2024-09-10T23:27:18.654294+0000","last_fullsized":"2024-09-10T23:27:18.654294+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.903208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088687+0000","last_change":"2024-09-10T23:27:17.116139+0000","last_active":"2024-09-10T23:27:18.088687+0000","last_peered":"2024-09-10T23:27:18.088687+0000","last_clean":"2024-09-10T23:27:18.088687+0000","last_became_active":"2024-09-10T23:27:17.115852+0000","last_became_peered":"2024-09-10T23:27:17.115852+0000","last_unstale":"2024-09-10T23:27:18.088687+0000","last_undegraded":"2024-09-10T23:27:18.088687+0000","last_fullsized":"2024-09-10T23:27:18.088687+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:54.432594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648362+0000","last_change":"2024-09-10T23:27:16.093853+0000","last_active":"2024-09-10T23:27:18.648362+0000","last_peered":"2024-09-10T23:27:18.648362+0000","last_clean":"2024-09-10T23:27:18.648362+0000","last_became_active":"2024-09-10T23:27:16.093586+0000","last_became_peered":"2024-09-10T23:27:16.093586+0000","last_unstale":"2024-09-10T23:27:18.648362+0000","last_undegraded":"2024-09-10T23:27:18.648362+0000","last_fullsized":"2024-09-10T23:27:18.648362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:03.023982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654467+0000","last_change":"2024-09-10T23:27:17.114770+0000","last_active":"2024-09-10T23:27:18.654467+0000","last_peered":"2024-09-10T23:27:18.654467+0000","last_clean":"2024-09-10T23:27:18.654467+0000","last_became_active":"2024-09-10T23:27:17.112895+0000","last_became_peered":"2024-09-10T23:27:17.112895+0000","last_unstale":"2024-09-10T23:27:18.654467+0000","last_undegraded":"2024-09-10T23:27:18.654467+0000","last_fullsized":"2024-09-10T23:27:18.654467+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:05.711658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121640+0000","last_change":"2024-09-10T23:27:16.099331+0000","last_active":"2024-09-10T23:27:18.121640+0000","last_peered":"2024-09-10T23:27:18.121640+0000","last_clean":"2024-09-10T23:27:18.121640+0000","last_became_active":"2024-09-10T23:27:16.099068+0000","last_became_peered":"2024-09-10T23:27:16.099068+0000","last_unstale":"2024-09-10T23:27:18.121640+0000","last_undegraded":"2024-09-10T23:27:18.121640+0000","last_fullsized":"2024-09-10T23:27:18.121640+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:23.742338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":370,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655059+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:27:18.655059+0000","last_peered":"2024-09-10T23:27:18.655059+0000","last_clean":"2024-09-10T23:27:18.655059+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:27:18.655059+0000","last_undegraded":"2024-09-10T23:27:18.655059+0000","last_fullsized":"2024-09-10T23:27:18.655059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69212,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302628,"statfs":{"total":96636764160,"available":96565891072,"internally_reserved":0,"allocated":2039808,"data_stored":955710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509587,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69832,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302008,"statfs":{"total":96636764160,"available":96565256192,"internally_reserved":0,"allocated":2670592,"data_stored":1566596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2084864,"data_stored":976352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69328,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302512,"statfs":{"total":96636764160,"available":96565772288,"internally_reserved":0,"allocated":2093056,"data_stored":976992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509586,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69312,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302528,"statfs":{"total":96636764160,"available":96565788672,"internally_reserved":0,"allocated":2076672,"data_stored":976228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509587,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2088960,"data_stored":977840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509586,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74060,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297780,"statfs":{"total":96636764160,"available":96560926720,"internally_reserved":0,"allocated":2678784,"data_stored":1566700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2097152,"data_stored":978444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:27:21.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:27:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 -- 172.21.15.17:0/588726204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c6c0b4f40 msgr2=0x7f9c6c164460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 --2- 172.21.15.17:0/588726204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c164460 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009c80 tx=0x7f9c6401cda0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 -- 172.21.15.17:0/588726204 shutdown_connections 2024-09-10T23:27:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 --2- 172.21.15.17:0/588726204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c6c0b4f40 0x7f9c6c164460 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 --2- 172.21.15.17:0/588726204 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c6c070ab0 0x7f9c6c0b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 -- 172.21.15.17:0/588726204 >> 172.21.15.17:0/588726204 conn(0x7f9c6c0b2740 msgr2=0x7f9c6c0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 -- 172.21.15.17:0/588726204 shutdown_connections 2024-09-10T23:27:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 -- 172.21.15.17:0/588726204 wait complete. 2024-09-10T23:27:21.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 Processor -- start 2024-09-10T23:27:21.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.841+0000 7f9c6b200640 1 -- start start 2024-09-10T23:27:21.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c070ab0 0x7f9c6c14f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c6c0b4620 0x7f9c6c14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c6c0b4f40 0x7f9c6c150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c167880 con 0x7f9c6c070ab0 2024-09-10T23:27:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6c167700 con 0x7f9c6c0b4620 2024-09-10T23:27:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9c6c167a00 con 0x7f9c6c0b4f40 2024-09-10T23:27:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c69e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c070ab0 0x7f9c6c14f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c69e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c070ab0 0x7f9c6c14f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35094/0 (socket says 172.21.15.17:35094) 2024-09-10T23:27:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c69e00640 1 -- 172.21.15.17:0/3648427536 learned_addr learned my addr 172.21.15.17:0/3648427536 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c63e00640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c6c0b4620 0x7f9c6c14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6a800640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c6c0b4f40 0x7f9c6c150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c69e00640 1 -- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c6c0b4f40 msgr2=0x7f9c6c150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c69e00640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c6c0b4f40 0x7f9c6c150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c69e00640 1 -- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c6c0b4620 msgr2=0x7f9c6c14e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c69e00640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c6c0b4620 0x7f9c6c14e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c69e00640 1 -- 172.21.15.17:0/3648427536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6c1f8170 con 0x7f9c6c070ab0 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c69e00640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c070ab0 0x7f9c6c14f5e0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c530 tx=0x7f9c5c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c62000640 1 -- 172.21.15.17:0/3648427536 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c017070 con 0x7f9c6c070ab0 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c62000640 1 -- 172.21.15.17:0/3648427536 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c5c0053c0 con 0x7f9c6c070ab0 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c62000640 1 -- 172.21.15.17:0/3648427536 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c012890 con 0x7f9c6c070ab0 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6c15acd0 con 0x7f9c6c070ab0 2024-09-10T23:27:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c6c1f8710 con 0x7f9c6c070ab0 2024-09-10T23:27:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.845+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6c0b4a00 con 0x7f9c6c070ab0 2024-09-10T23:27:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.849+0000 7f9c62000640 1 -- 172.21.15.17:0/3648427536 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9c5c003600 con 0x7f9c6c070ab0 2024-09-10T23:27:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.849+0000 7f9c62000640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c480725e0 0x7f9c48074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.849+0000 7f9c62000640 1 -- 172.21.15.17:0/3648427536 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f9c5c092900 con 0x7f9c6c070ab0 2024-09-10T23:27:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.849+0000 7f9c63e00640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c480725e0 0x7f9c48074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.849+0000 7f9c63e00640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c480725e0 0x7f9c48074aa0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c14fb20 tx=0x7f9c540091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:21.853+0000 7f9c62000640 1 -- 172.21.15.17:0/3648427536 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9c5c05d800 con 0x7f9c6c070ab0 2024-09-10T23:27:22.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.025+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c6c0ce9f0 con 0x7f9c480725e0 2024-09-10T23:27:22.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c62000640 1 -- 172.21.15.17:0/3648427536 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252057 (secure 0 0 0) 0x7f9c6c0ce9f0 con 0x7f9c480725e0 2024-09-10T23:27:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:22.040 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:27:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c480725e0 msgr2=0x7f9c48074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c480725e0 0x7f9c48074aa0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c14fb20 tx=0x7f9c540091e0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c070ab0 msgr2=0x7f9c6c14f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c070ab0 0x7f9c6c14f5e0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c530 tx=0x7f9c5c00c9f0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 shutdown_connections 2024-09-10T23:27:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9c480725e0 0x7f9c48074aa0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c6c0b4f40 0x7f9c6c150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c6c0b4620 0x7f9c6c14e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 --2- 172.21.15.17:0/3648427536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c070ab0 0x7f9c6c14f5e0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 >> 172.21.15.17:0/3648427536 conn(0x7f9c6c0b2740 msgr2=0x7f9c6c151220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:22.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 shutdown_connections 2024-09-10T23:27:22.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.033+0000 7f9c6b200640 1 -- 172.21.15.17:0/3648427536 wait complete. 2024-09-10T23:27:22.059 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":518,"stamp":"2024-09-10T23:27:20.462625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522232,"kb_used_data":17412,"kb_used_omap":12,"kb_used_meta":504627,"kb_avail":754452488,"statfs":{"total":773094113280,"available":772559347712,"internally_reserved":0,"allocated":17829888,"data_stored":8974862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516738609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.389823"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095075+0000","last_change":"2024-09-10T23:27:17.106584+0000","last_active":"2024-09-10T23:27:18.095075+0000","last_peered":"2024-09-10T23:27:18.095075+0000","last_clean":"2024-09-10T23:27:18.095075+0000","last_became_active":"2024-09-10T23:27:17.106315+0000","last_became_peered":"2024-09-10T23:27:17.106315+0000","last_unstale":"2024-09-10T23:27:18.095075+0000","last_undegraded":"2024-09-10T23:27:18.095075+0000","last_fullsized":"2024-09-10T23:27:18.095075+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:54.902790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655807+0000","last_change":"2024-09-10T23:27:17.115113+0000","last_active":"2024-09-10T23:27:18.655807+0000","last_peered":"2024-09-10T23:27:18.655807+0000","last_clean":"2024-09-10T23:27:18.655807+0000","last_became_active":"2024-09-10T23:27:17.114341+0000","last_became_peered":"2024-09-10T23:27:17.114341+0000","last_unstale":"2024-09-10T23:27:18.655807+0000","last_undegraded":"2024-09-10T23:27:18.655807+0000","last_fullsized":"2024-09-10T23:27:18.655807+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:20.113939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094285+0000","last_change":"2024-09-10T23:27:17.101230+0000","last_active":"2024-09-10T23:27:18.094285+0000","last_peered":"2024-09-10T23:27:18.094285+0000","last_clean":"2024-09-10T23:27:18.094285+0000","last_became_active":"2024-09-10T23:27:17.100946+0000","last_became_peered":"2024-09-10T23:27:17.100946+0000","last_unstale":"2024-09-10T23:27:18.094285+0000","last_undegraded":"2024-09-10T23:27:18.094285+0000","last_fullsized":"2024-09-10T23:27:18.094285+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:20.365134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094578+0000","last_change":"2024-09-10T23:27:17.105978+0000","last_active":"2024-09-10T23:27:18.094578+0000","last_peered":"2024-09-10T23:27:18.094578+0000","last_clean":"2024-09-10T23:27:18.094578+0000","last_became_active":"2024-09-10T23:27:17.105502+0000","last_became_peered":"2024-09-10T23:27:17.105502+0000","last_unstale":"2024-09-10T23:27:18.094578+0000","last_undegraded":"2024-09-10T23:27:18.094578+0000","last_fullsized":"2024-09-10T23:27:18.094578+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:04.674325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649044+0000","last_change":"2024-09-10T23:27:17.108926+0000","last_active":"2024-09-10T23:27:18.649044+0000","last_peered":"2024-09-10T23:27:18.649044+0000","last_clean":"2024-09-10T23:27:18.649044+0000","last_became_active":"2024-09-10T23:27:17.108589+0000","last_became_peered":"2024-09-10T23:27:17.108589+0000","last_unstale":"2024-09-10T23:27:18.649044+0000","last_undegraded":"2024-09-10T23:27:18.649044+0000","last_fullsized":"2024-09-10T23:27:18.649044+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:47.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654886+0000","last_change":"2024-09-10T23:27:17.114012+0000","last_active":"2024-09-10T23:27:18.654886+0000","last_peered":"2024-09-10T23:27:18.654886+0000","last_clean":"2024-09-10T23:27:18.654886+0000","last_became_active":"2024-09-10T23:27:17.111391+0000","last_became_peered":"2024-09-10T23:27:17.111391+0000","last_unstale":"2024-09-10T23:27:18.654886+0000","last_undegraded":"2024-09-10T23:27:18.654886+0000","last_fullsized":"2024-09-10T23:27:18.654886+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:33.637514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123961+0000","last_change":"2024-09-10T23:27:17.104858+0000","last_active":"2024-09-10T23:27:18.123961+0000","last_peered":"2024-09-10T23:27:18.123961+0000","last_clean":"2024-09-10T23:27:18.123961+0000","last_became_active":"2024-09-10T23:27:17.104575+0000","last_became_peered":"2024-09-10T23:27:17.104575+0000","last_unstale":"2024-09-10T23:27:18.123961+0000","last_undegraded":"2024-09-10T23:27:18.123961+0000","last_fullsized":"2024-09-10T23:27:18.123961+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123806+0000","last_change":"2024-09-10T23:27:17.110407+0000","last_active":"2024-09-10T23:27:18.123806+0000","last_peered":"2024-09-10T23:27:18.123806+0000","last_clean":"2024-09-10T23:27:18.123806+0000","last_became_active":"2024-09-10T23:27:17.110090+0000","last_became_peered":"2024-09-10T23:27:17.110090+0000","last_unstale":"2024-09-10T23:27:18.123806+0000","last_undegraded":"2024-09-10T23:27:18.123806+0000","last_fullsized":"2024-09-10T23:27:18.123806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:55.534473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124433+0000","last_change":"2024-09-10T23:27:17.110221+0000","last_active":"2024-09-10T23:27:18.124433+0000","last_peered":"2024-09-10T23:27:18.124433+0000","last_clean":"2024-09-10T23:27:18.124433+0000","last_became_active":"2024-09-10T23:27:17.109916+0000","last_became_peered":"2024-09-10T23:27:17.109916+0000","last_unstale":"2024-09-10T23:27:18.124433+0000","last_undegraded":"2024-09-10T23:27:18.124433+0000","last_fullsized":"2024-09-10T23:27:18.124433+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124429+0000","last_change":"2024-09-10T23:27:17.103184+0000","last_active":"2024-09-10T23:27:18.124429+0000","last_peered":"2024-09-10T23:27:18.124429+0000","last_clean":"2024-09-10T23:27:18.124429+0000","last_became_active":"2024-09-10T23:27:17.102108+0000","last_became_peered":"2024-09-10T23:27:17.102108+0000","last_unstale":"2024-09-10T23:27:18.124429+0000","last_undegraded":"2024-09-10T23:27:18.124429+0000","last_fullsized":"2024-09-10T23:27:18.124429+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655402+0000","last_change":"2024-09-10T23:27:17.120609+0000","last_active":"2024-09-10T23:27:18.655402+0000","last_peered":"2024-09-10T23:27:18.655402+0000","last_clean":"2024-09-10T23:27:18.655402+0000","last_became_active":"2024-09-10T23:27:17.120402+0000","last_became_peered":"2024-09-10T23:27:17.120402+0000","last_unstale":"2024-09-10T23:27:18.655402+0000","last_undegraded":"2024-09-10T23:27:18.655402+0000","last_fullsized":"2024-09-10T23:27:18.655402+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:58.328456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655563+0000","last_change":"2024-09-10T23:27:17.113454+0000","last_active":"2024-09-10T23:27:18.655563+0000","last_peered":"2024-09-10T23:27:18.655563+0000","last_clean":"2024-09-10T23:27:18.655563+0000","last_became_active":"2024-09-10T23:27:17.113102+0000","last_became_peered":"2024-09-10T23:27:17.113102+0000","last_unstale":"2024-09-10T23:27:18.655563+0000","last_undegraded":"2024-09-10T23:27:18.655563+0000","last_fullsized":"2024-09-10T23:27:18.655563+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:24.438181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121506+0000","last_change":"2024-09-10T23:27:17.104651+0000","last_active":"2024-09-10T23:27:18.121506+0000","last_peered":"2024-09-10T23:27:18.121506+0000","last_clean":"2024-09-10T23:27:18.121506+0000","last_became_active":"2024-09-10T23:27:17.104356+0000","last_became_peered":"2024-09-10T23:27:17.104356+0000","last_unstale":"2024-09-10T23:27:18.121506+0000","last_undegraded":"2024-09-10T23:27:18.121506+0000","last_fullsized":"2024-09-10T23:27:18.121506+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:31.195103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648806+0000","last_change":"2024-09-10T23:27:17.112364+0000","last_active":"2024-09-10T23:27:18.648806+0000","last_peered":"2024-09-10T23:27:18.648806+0000","last_clean":"2024-09-10T23:27:18.648806+0000","last_became_active":"2024-09-10T23:27:17.110862+0000","last_became_peered":"2024-09-10T23:27:17.110862+0000","last_unstale":"2024-09-10T23:27:18.648806+0000","last_undegraded":"2024-09-10T23:27:18.648806+0000","last_fullsized":"2024-09-10T23:27:18.648806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:37.706200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654100+0000","last_change":"2024-09-10T23:27:17.115869+0000","last_active":"2024-09-10T23:27:18.654100+0000","last_peered":"2024-09-10T23:27:18.654100+0000","last_clean":"2024-09-10T23:27:18.654100+0000","last_became_active":"2024-09-10T23:27:17.115594+0000","last_became_peered":"2024-09-10T23:27:17.115594+0000","last_unstale":"2024-09-10T23:27:18.654100+0000","last_undegraded":"2024-09-10T23:27:18.654100+0000","last_fullsized":"2024-09-10T23:27:18.654100+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094113+0000","last_change":"2024-09-10T23:27:17.105827+0000","last_active":"2024-09-10T23:27:18.094113+0000","last_peered":"2024-09-10T23:27:18.094113+0000","last_clean":"2024-09-10T23:27:18.094113+0000","last_became_active":"2024-09-10T23:27:17.105514+0000","last_became_peered":"2024-09-10T23:27:17.105514+0000","last_unstale":"2024-09-10T23:27:18.094113+0000","last_undegraded":"2024-09-10T23:27:18.094113+0000","last_fullsized":"2024-09-10T23:27:18.094113+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:41.256305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124559+0000","last_change":"2024-09-10T23:27:17.103100+0000","last_active":"2024-09-10T23:27:18.124559+0000","last_peered":"2024-09-10T23:27:18.124559+0000","last_clean":"2024-09-10T23:27:18.124559+0000","last_became_active":"2024-09-10T23:27:17.101922+0000","last_became_peered":"2024-09-10T23:27:17.101922+0000","last_unstale":"2024-09-10T23:27:18.124559+0000","last_undegraded":"2024-09-10T23:27:18.124559+0000","last_fullsized":"2024-09-10T23:27:18.124559+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:21.276448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.089170+0000","last_change":"2024-09-10T23:27:16.089170+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.089170+0000","last_undegraded":"2024-09-10T23:27:16.089170+0000","last_fullsized":"2024-09-10T23:27:16.089170+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654548+0000","last_change":"2024-09-10T23:27:17.115816+0000","last_active":"2024-09-10T23:27:18.654548+0000","last_peered":"2024-09-10T23:27:18.654548+0000","last_clean":"2024-09-10T23:27:18.654548+0000","last_became_active":"2024-09-10T23:27:17.115530+0000","last_became_peered":"2024-09-10T23:27:17.115530+0000","last_unstale":"2024-09-10T23:27:18.654548+0000","last_undegraded":"2024-09-10T23:27:18.654548+0000","last_fullsized":"2024-09-10T23:27:18.654548+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088360+0000","last_change":"2024-09-10T23:27:17.115834+0000","last_active":"2024-09-10T23:27:18.088360+0000","last_peered":"2024-09-10T23:27:18.088360+0000","last_clean":"2024-09-10T23:27:18.088360+0000","last_became_active":"2024-09-10T23:27:17.115548+0000","last_became_peered":"2024-09-10T23:27:17.115548+0000","last_unstale":"2024-09-10T23:27:18.088360+0000","last_undegraded":"2024-09-10T23:27:18.088360+0000","last_fullsized":"2024-09-10T23:27:18.088360+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:55.699175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121835+0000","last_change":"2024-09-10T23:27:17.093723+0000","last_active":"2024-09-10T23:27:18.121835+0000","last_peered":"2024-09-10T23:27:18.121835+0000","last_clean":"2024-09-10T23:27:18.121835+0000","last_became_active":"2024-09-10T23:27:17.093438+0000","last_became_peered":"2024-09-10T23:27:17.093438+0000","last_unstale":"2024-09-10T23:27:18.121835+0000","last_undegraded":"2024-09-10T23:27:18.121835+0000","last_fullsized":"2024-09-10T23:27:18.121835+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:09.201890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655133+0000","last_change":"2024-09-10T23:27:17.121543+0000","last_active":"2024-09-10T23:27:18.655133+0000","last_peered":"2024-09-10T23:27:18.655133+0000","last_clean":"2024-09-10T23:27:18.655133+0000","last_became_active":"2024-09-10T23:27:17.121249+0000","last_became_peered":"2024-09-10T23:27:17.121249+0000","last_unstale":"2024-09-10T23:27:18.655133+0000","last_undegraded":"2024-09-10T23:27:18.655133+0000","last_fullsized":"2024-09-10T23:27:18.655133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:37.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648649+0000","last_change":"2024-09-10T23:27:17.107888+0000","last_active":"2024-09-10T23:27:18.648649+0000","last_peered":"2024-09-10T23:27:18.648649+0000","last_clean":"2024-09-10T23:27:18.648649+0000","last_became_active":"2024-09-10T23:27:17.107606+0000","last_became_peered":"2024-09-10T23:27:17.107606+0000","last_unstale":"2024-09-10T23:27:18.648649+0000","last_undegraded":"2024-09-10T23:27:18.648649+0000","last_fullsized":"2024-09-10T23:27:18.648649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:35.414834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094571+0000","last_change":"2024-09-10T23:27:17.096587+0000","last_active":"2024-09-10T23:27:18.094571+0000","last_peered":"2024-09-10T23:27:18.094571+0000","last_clean":"2024-09-10T23:27:18.094571+0000","last_became_active":"2024-09-10T23:27:17.096284+0000","last_became_peered":"2024-09-10T23:27:17.096284+0000","last_unstale":"2024-09-10T23:27:18.094571+0000","last_undegraded":"2024-09-10T23:27:18.094571+0000","last_fullsized":"2024-09-10T23:27:18.094571+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:37.468206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122133+0000","last_change":"2024-09-10T23:27:17.102475+0000","last_active":"2024-09-10T23:27:18.122133+0000","last_peered":"2024-09-10T23:27:18.122133+0000","last_clean":"2024-09-10T23:27:18.122133+0000","last_became_active":"2024-09-10T23:27:17.102152+0000","last_became_peered":"2024-09-10T23:27:17.102152+0000","last_unstale":"2024-09-10T23:27:18.122133+0000","last_undegraded":"2024-09-10T23:27:18.122133+0000","last_fullsized":"2024-09-10T23:27:18.122133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:36.895870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088313+0000","last_change":"2024-09-10T23:27:17.101777+0000","last_active":"2024-09-10T23:27:18.088313+0000","last_peered":"2024-09-10T23:27:18.088313+0000","last_clean":"2024-09-10T23:27:18.088313+0000","last_became_active":"2024-09-10T23:27:17.101450+0000","last_became_peered":"2024-09-10T23:27:17.101450+0000","last_unstale":"2024-09-10T23:27:18.088313+0000","last_undegraded":"2024-09-10T23:27:18.088313+0000","last_fullsized":"2024-09-10T23:27:18.088313+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:36.442601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655290+0000","last_change":"2024-09-10T23:27:17.121509+0000","last_active":"2024-09-10T23:27:18.655290+0000","last_peered":"2024-09-10T23:27:18.655290+0000","last_clean":"2024-09-10T23:27:18.655290+0000","last_became_active":"2024-09-10T23:27:17.121230+0000","last_became_peered":"2024-09-10T23:27:17.121230+0000","last_unstale":"2024-09-10T23:27:18.655290+0000","last_undegraded":"2024-09-10T23:27:18.655290+0000","last_fullsized":"2024-09-10T23:27:18.655290+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:02.572094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121637+0000","last_change":"2024-09-10T23:27:17.092322+0000","last_active":"2024-09-10T23:27:18.121637+0000","last_peered":"2024-09-10T23:27:18.121637+0000","last_clean":"2024-09-10T23:27:18.121637+0000","last_became_active":"2024-09-10T23:27:17.092042+0000","last_became_peered":"2024-09-10T23:27:17.092042+0000","last_unstale":"2024-09-10T23:27:18.121637+0000","last_undegraded":"2024-09-10T23:27:18.121637+0000","last_fullsized":"2024-09-10T23:27:18.121637+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:12.311349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654704+0000","last_change":"2024-09-10T23:27:17.115783+0000","last_active":"2024-09-10T23:27:18.654704+0000","last_peered":"2024-09-10T23:27:18.654704+0000","last_clean":"2024-09-10T23:27:18.654704+0000","last_became_active":"2024-09-10T23:27:17.115009+0000","last_became_peered":"2024-09-10T23:27:17.115009+0000","last_unstale":"2024-09-10T23:27:18.654704+0000","last_undegraded":"2024-09-10T23:27:18.654704+0000","last_fullsized":"2024-09-10T23:27:18.654704+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.085446+0000","last_change":"2024-09-10T23:27:16.085446+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.085446+0000","last_undegraded":"2024-09-10T23:27:16.085446+0000","last_fullsized":"2024-09-10T23:27:16.085446+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654122+0000","last_change":"2024-09-10T23:27:17.111758+0000","last_active":"2024-09-10T23:27:18.654122+0000","last_peered":"2024-09-10T23:27:18.654122+0000","last_clean":"2024-09-10T23:27:18.654122+0000","last_became_active":"2024-09-10T23:27:17.111409+0000","last_became_peered":"2024-09-10T23:27:17.111409+0000","last_unstale":"2024-09-10T23:27:18.654122+0000","last_undegraded":"2024-09-10T23:27:18.654122+0000","last_fullsized":"2024-09-10T23:27:18.654122+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.084929+0000","last_change":"2024-09-10T23:27:16.084929+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.084929+0000","last_undegraded":"2024-09-10T23:27:16.084929+0000","last_fullsized":"2024-09-10T23:27:16.084929+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654870+0000","last_change":"2024-09-10T23:27:17.112841+0000","last_active":"2024-09-10T23:27:18.654870+0000","last_peered":"2024-09-10T23:27:18.654870+0000","last_clean":"2024-09-10T23:27:18.654870+0000","last_became_active":"2024-09-10T23:27:17.112210+0000","last_became_peered":"2024-09-10T23:27:17.112210+0000","last_unstale":"2024-09-10T23:27:18.654870+0000","last_undegraded":"2024-09-10T23:27:18.654870+0000","last_fullsized":"2024-09-10T23:27:18.654870+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:32.914654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"165'4","reported_seq":19,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095147+0000","last_change":"2024-09-10T23:27:16.086889+0000","last_active":"2024-09-10T23:27:18.095147+0000","last_peered":"2024-09-10T23:27:18.095147+0000","last_clean":"2024-09-10T23:27:18.095147+0000","last_became_active":"2024-09-10T23:27:16.086511+0000","last_became_peered":"2024-09-10T23:27:16.086511+0000","last_unstale":"2024-09-10T23:27:18.095147+0000","last_undegraded":"2024-09-10T23:27:18.095147+0000","last_fullsized":"2024-09-10T23:27:18.095147+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:49.905701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121836+0000","last_change":"2024-09-10T23:27:17.107022+0000","last_active":"2024-09-10T23:27:18.121836+0000","last_peered":"2024-09-10T23:27:18.121836+0000","last_clean":"2024-09-10T23:27:18.121836+0000","last_became_active":"2024-09-10T23:27:17.106736+0000","last_became_peered":"2024-09-10T23:27:17.106736+0000","last_unstale":"2024-09-10T23:27:18.121836+0000","last_undegraded":"2024-09-10T23:27:18.121836+0000","last_fullsized":"2024-09-10T23:27:18.121836+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:12.419867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648898+0000","last_change":"2024-09-10T23:27:16.096542+0000","last_active":"2024-09-10T23:27:18.648898+0000","last_peered":"2024-09-10T23:27:18.648898+0000","last_clean":"2024-09-10T23:27:18.648898+0000","last_became_active":"2024-09-10T23:27:16.096251+0000","last_became_peered":"2024-09-10T23:27:16.096251+0000","last_unstale":"2024-09-10T23:27:18.648898+0000","last_undegraded":"2024-09-10T23:27:18.648898+0000","last_fullsized":"2024-09-10T23:27:18.648898+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:58.411262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648867+0000","last_change":"2024-09-10T23:27:17.115424+0000","last_active":"2024-09-10T23:27:18.648867+0000","last_peered":"2024-09-10T23:27:18.648867+0000","last_clean":"2024-09-10T23:27:18.648867+0000","last_became_active":"2024-09-10T23:27:17.110909+0000","last_became_peered":"2024-09-10T23:27:17.110909+0000","last_unstale":"2024-09-10T23:27:18.648867+0000","last_undegraded":"2024-09-10T23:27:18.648867+0000","last_fullsized":"2024-09-10T23:27:18.648867+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.523204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654701+0000","last_change":"2024-09-10T23:27:16.089236+0000","last_active":"2024-09-10T23:27:18.654701+0000","last_peered":"2024-09-10T23:27:18.654701+0000","last_clean":"2024-09-10T23:27:18.654701+0000","last_became_active":"2024-09-10T23:27:16.088941+0000","last_became_peered":"2024-09-10T23:27:16.088941+0000","last_unstale":"2024-09-10T23:27:18.654701+0000","last_undegraded":"2024-09-10T23:27:18.654701+0000","last_fullsized":"2024-09-10T23:27:18.654701+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:07.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654951+0000","last_change":"2024-09-10T23:27:17.110922+0000","last_active":"2024-09-10T23:27:18.654951+0000","last_peered":"2024-09-10T23:27:18.654951+0000","last_clean":"2024-09-10T23:27:18.654951+0000","last_became_active":"2024-09-10T23:27:17.110608+0000","last_became_peered":"2024-09-10T23:27:17.110608+0000","last_unstale":"2024-09-10T23:27:18.654951+0000","last_undegraded":"2024-09-10T23:27:18.654951+0000","last_fullsized":"2024-09-10T23:27:18.654951+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:58.856996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088437+0000","last_change":"2024-09-10T23:27:16.094988+0000","last_active":"2024-09-10T23:27:18.088437+0000","last_peered":"2024-09-10T23:27:18.088437+0000","last_clean":"2024-09-10T23:27:18.088437+0000","last_became_active":"2024-09-10T23:27:16.089019+0000","last_became_peered":"2024-09-10T23:27:16.089019+0000","last_unstale":"2024-09-10T23:27:18.088437+0000","last_undegraded":"2024-09-10T23:27:18.088437+0000","last_fullsized":"2024-09-10T23:27:18.088437+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:20.281854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124284+0000","last_change":"2024-09-10T23:27:17.105543+0000","last_active":"2024-09-10T23:27:18.124284+0000","last_peered":"2024-09-10T23:27:18.124284+0000","last_clean":"2024-09-10T23:27:18.124284+0000","last_became_active":"2024-09-10T23:27:17.105257+0000","last_became_peered":"2024-09-10T23:27:17.105257+0000","last_unstale":"2024-09-10T23:27:18.124284+0000","last_undegraded":"2024-09-10T23:27:18.124284+0000","last_fullsized":"2024-09-10T23:27:18.124284+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123894+0000","last_change":"2024-09-10T23:27:16.098401+0000","last_active":"2024-09-10T23:27:18.123894+0000","last_peered":"2024-09-10T23:27:18.123894+0000","last_clean":"2024-09-10T23:27:18.123894+0000","last_became_active":"2024-09-10T23:27:16.098145+0000","last_became_peered":"2024-09-10T23:27:16.098145+0000","last_unstale":"2024-09-10T23:27:18.123894+0000","last_undegraded":"2024-09-10T23:27:18.123894+0000","last_fullsized":"2024-09-10T23:27:18.123894+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:36.117554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088367+0000","last_change":"2024-09-10T23:27:17.101986+0000","last_active":"2024-09-10T23:27:18.088367+0000","last_peered":"2024-09-10T23:27:18.088367+0000","last_clean":"2024-09-10T23:27:18.088367+0000","last_became_active":"2024-09-10T23:27:17.101415+0000","last_became_peered":"2024-09-10T23:27:17.101415+0000","last_unstale":"2024-09-10T23:27:18.088367+0000","last_undegraded":"2024-09-10T23:27:18.088367+0000","last_fullsized":"2024-09-10T23:27:18.088367+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:55.747742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648884+0000","last_change":"2024-09-10T23:27:16.084947+0000","last_active":"2024-09-10T23:27:18.648884+0000","last_peered":"2024-09-10T23:27:18.648884+0000","last_clean":"2024-09-10T23:27:18.648884+0000","last_became_active":"2024-09-10T23:27:16.084692+0000","last_became_peered":"2024-09-10T23:27:16.084692+0000","last_unstale":"2024-09-10T23:27:18.648884+0000","last_undegraded":"2024-09-10T23:27:18.648884+0000","last_fullsized":"2024-09-10T23:27:18.648884+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:57.850082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088531+0000","last_change":"2024-09-10T23:27:17.098759+0000","last_active":"2024-09-10T23:27:18.088531+0000","last_peered":"2024-09-10T23:27:18.088531+0000","last_clean":"2024-09-10T23:27:18.088531+0000","last_became_active":"2024-09-10T23:27:17.098487+0000","last_became_peered":"2024-09-10T23:27:17.098487+0000","last_unstale":"2024-09-10T23:27:18.088531+0000","last_undegraded":"2024-09-10T23:27:18.088531+0000","last_fullsized":"2024-09-10T23:27:18.088531+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:27.166404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.087971+0000","last_change":"2024-09-10T23:27:16.087772+0000","last_active":"2024-09-10T23:27:18.087971+0000","last_peered":"2024-09-10T23:27:18.087971+0000","last_clean":"2024-09-10T23:27:18.087971+0000","last_became_active":"2024-09-10T23:27:16.087528+0000","last_became_peered":"2024-09-10T23:27:16.087528+0000","last_unstale":"2024-09-10T23:27:18.087971+0000","last_undegraded":"2024-09-10T23:27:18.087971+0000","last_fullsized":"2024-09-10T23:27:18.087971+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:36.395245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095077+0000","last_change":"2024-09-10T23:27:17.102817+0000","last_active":"2024-09-10T23:27:18.095077+0000","last_peered":"2024-09-10T23:27:18.095077+0000","last_clean":"2024-09-10T23:27:18.095077+0000","last_became_active":"2024-09-10T23:27:17.102164+0000","last_became_peered":"2024-09-10T23:27:17.102164+0000","last_unstale":"2024-09-10T23:27:18.095077+0000","last_undegraded":"2024-09-10T23:27:18.095077+0000","last_fullsized":"2024-09-10T23:27:18.095077+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:53.800068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123863+0000","last_change":"2024-09-10T23:27:16.099929+0000","last_active":"2024-09-10T23:27:18.123863+0000","last_peered":"2024-09-10T23:27:18.123863+0000","last_clean":"2024-09-10T23:27:18.123863+0000","last_became_active":"2024-09-10T23:27:16.099633+0000","last_became_peered":"2024-09-10T23:27:16.099633+0000","last_unstale":"2024-09-10T23:27:18.123863+0000","last_undegraded":"2024-09-10T23:27:18.123863+0000","last_fullsized":"2024-09-10T23:27:18.123863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:46.599497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654770+0000","last_change":"2024-09-10T23:27:17.113875+0000","last_active":"2024-09-10T23:27:18.654770+0000","last_peered":"2024-09-10T23:27:18.654770+0000","last_clean":"2024-09-10T23:27:18.654770+0000","last_became_active":"2024-09-10T23:27:17.113118+0000","last_became_peered":"2024-09-10T23:27:17.113118+0000","last_unstale":"2024-09-10T23:27:18.654770+0000","last_undegraded":"2024-09-10T23:27:18.654770+0000","last_fullsized":"2024-09-10T23:27:18.654770+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:04.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121961+0000","last_change":"2024-09-10T23:27:16.098737+0000","last_active":"2024-09-10T23:27:18.121961+0000","last_peered":"2024-09-10T23:27:18.121961+0000","last_clean":"2024-09-10T23:27:18.121961+0000","last_became_active":"2024-09-10T23:27:16.098442+0000","last_became_peered":"2024-09-10T23:27:16.098442+0000","last_unstale":"2024-09-10T23:27:18.121961+0000","last_undegraded":"2024-09-10T23:27:18.121961+0000","last_fullsized":"2024-09-10T23:27:18.121961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:59.654302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121238+0000","last_change":"2024-09-10T23:27:17.109414+0000","last_active":"2024-09-10T23:27:18.121238+0000","last_peered":"2024-09-10T23:27:18.121238+0000","last_clean":"2024-09-10T23:27:18.121238+0000","last_became_active":"2024-09-10T23:27:17.109116+0000","last_became_peered":"2024-09-10T23:27:17.109116+0000","last_unstale":"2024-09-10T23:27:18.121238+0000","last_undegraded":"2024-09-10T23:27:18.121238+0000","last_fullsized":"2024-09-10T23:27:18.121238+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:42.308068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"165'3","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094291+0000","last_change":"2024-09-10T23:27:16.097793+0000","last_active":"2024-09-10T23:27:18.094291+0000","last_peered":"2024-09-10T23:27:18.094291+0000","last_clean":"2024-09-10T23:27:18.094291+0000","last_became_active":"2024-09-10T23:27:16.097498+0000","last_became_peered":"2024-09-10T23:27:16.097498+0000","last_unstale":"2024-09-10T23:27:18.094291+0000","last_undegraded":"2024-09-10T23:27:18.094291+0000","last_fullsized":"2024-09-10T23:27:18.094291+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:57.282134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088279+0000","last_change":"2024-09-10T23:27:17.118822+0000","last_active":"2024-09-10T23:27:18.088279+0000","last_peered":"2024-09-10T23:27:18.088279+0000","last_clean":"2024-09-10T23:27:18.088279+0000","last_became_active":"2024-09-10T23:27:17.118563+0000","last_became_peered":"2024-09-10T23:27:17.118563+0000","last_unstale":"2024-09-10T23:27:18.088279+0000","last_undegraded":"2024-09-10T23:27:18.088279+0000","last_fullsized":"2024-09-10T23:27:18.088279+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:57.399526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"165'6","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121746+0000","last_change":"2024-09-10T23:27:16.101748+0000","last_active":"2024-09-10T23:27:18.121746+0000","last_peered":"2024-09-10T23:27:18.121746+0000","last_clean":"2024-09-10T23:27:18.121746+0000","last_became_active":"2024-09-10T23:27:16.100263+0000","last_became_peered":"2024-09-10T23:27:16.100263+0000","last_unstale":"2024-09-10T23:27:18.121746+0000","last_undegraded":"2024-09-10T23:27:18.121746+0000","last_fullsized":"2024-09-10T23:27:18.121746+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:38.172255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.088745+0000","last_change":"2024-09-10T23:27:16.088745+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.088745+0000","last_undegraded":"2024-09-10T23:27:16.088745+0000","last_fullsized":"2024-09-10T23:27:16.088745+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649018+0000","last_change":"2024-09-10T23:27:16.091730+0000","last_active":"2024-09-10T23:27:18.649018+0000","last_peered":"2024-09-10T23:27:18.649018+0000","last_clean":"2024-09-10T23:27:18.649018+0000","last_became_active":"2024-09-10T23:27:16.090957+0000","last_became_peered":"2024-09-10T23:27:16.090957+0000","last_unstale":"2024-09-10T23:27:18.649018+0000","last_undegraded":"2024-09-10T23:27:18.649018+0000","last_fullsized":"2024-09-10T23:27:18.649018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:23.431267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124243+0000","last_change":"2024-09-10T23:27:17.118859+0000","last_active":"2024-09-10T23:27:18.124243+0000","last_peered":"2024-09-10T23:27:18.124243+0000","last_clean":"2024-09-10T23:27:18.124243+0000","last_became_active":"2024-09-10T23:27:17.118402+0000","last_became_peered":"2024-09-10T23:27:17.118402+0000","last_unstale":"2024-09-10T23:27:18.124243+0000","last_undegraded":"2024-09-10T23:27:18.124243+0000","last_fullsized":"2024-09-10T23:27:18.124243+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121380+0000","last_change":"2024-09-10T23:27:16.085990+0000","last_active":"2024-09-10T23:27:18.121380+0000","last_peered":"2024-09-10T23:27:18.121380+0000","last_clean":"2024-09-10T23:27:18.121380+0000","last_became_active":"2024-09-10T23:27:16.085702+0000","last_became_peered":"2024-09-10T23:27:16.085702+0000","last_unstale":"2024-09-10T23:27:18.121380+0000","last_undegraded":"2024-09-10T23:27:18.121380+0000","last_fullsized":"2024-09-10T23:27:18.121380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:33.884766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654861+0000","last_change":"2024-09-10T23:27:17.116517+0000","last_active":"2024-09-10T23:27:18.654861+0000","last_peered":"2024-09-10T23:27:18.654861+0000","last_clean":"2024-09-10T23:27:18.654861+0000","last_became_active":"2024-09-10T23:27:17.116082+0000","last_became_peered":"2024-09-10T23:27:17.116082+0000","last_unstale":"2024-09-10T23:27:18.654861+0000","last_undegraded":"2024-09-10T23:27:18.654861+0000","last_fullsized":"2024-09-10T23:27:18.654861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654176+0000","last_change":"2024-09-10T23:27:16.092789+0000","last_active":"2024-09-10T23:27:18.654176+0000","last_peered":"2024-09-10T23:27:18.654176+0000","last_clean":"2024-09-10T23:27:18.654176+0000","last_became_active":"2024-09-10T23:27:16.092548+0000","last_became_peered":"2024-09-10T23:27:16.092548+0000","last_unstale":"2024-09-10T23:27:18.654176+0000","last_undegraded":"2024-09-10T23:27:18.654176+0000","last_fullsized":"2024-09-10T23:27:18.654176+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:17.509832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088448+0000","last_change":"2024-09-10T23:27:17.102362+0000","last_active":"2024-09-10T23:27:18.088448+0000","last_peered":"2024-09-10T23:27:18.088448+0000","last_clean":"2024-09-10T23:27:18.088448+0000","last_became_active":"2024-09-10T23:27:17.102022+0000","last_became_peered":"2024-09-10T23:27:17.102022+0000","last_unstale":"2024-09-10T23:27:18.088448+0000","last_undegraded":"2024-09-10T23:27:18.088448+0000","last_fullsized":"2024-09-10T23:27:18.088448+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:22.009162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"165'8","reported_seq":23,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123907+0000","last_change":"2024-09-10T23:27:16.097848+0000","last_active":"2024-09-10T23:27:18.123907+0000","last_peered":"2024-09-10T23:27:18.123907+0000","last_clean":"2024-09-10T23:27:18.123907+0000","last_became_active":"2024-09-10T23:27:16.097483+0000","last_became_peered":"2024-09-10T23:27:16.097483+0000","last_unstale":"2024-09-10T23:27:18.123907+0000","last_undegraded":"2024-09-10T23:27:18.123907+0000","last_fullsized":"2024-09-10T23:27:18.123907+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:59.132712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123840+0000","last_change":"2024-09-10T23:27:17.104862+0000","last_active":"2024-09-10T23:27:18.123840+0000","last_peered":"2024-09-10T23:27:18.123840+0000","last_clean":"2024-09-10T23:27:18.123840+0000","last_became_active":"2024-09-10T23:27:17.103480+0000","last_became_peered":"2024-09-10T23:27:17.103480+0000","last_unstale":"2024-09-10T23:27:18.123840+0000","last_undegraded":"2024-09-10T23:27:18.123840+0000","last_fullsized":"2024-09-10T23:27:18.123840+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122067+0000","last_change":"2024-09-10T23:27:16.084160+0000","last_active":"2024-09-10T23:27:18.122067+0000","last_peered":"2024-09-10T23:27:18.122067+0000","last_clean":"2024-09-10T23:27:18.122067+0000","last_became_active":"2024-09-10T23:27:16.083818+0000","last_became_peered":"2024-09-10T23:27:16.083818+0000","last_unstale":"2024-09-10T23:27:18.122067+0000","last_undegraded":"2024-09-10T23:27:18.122067+0000","last_fullsized":"2024-09-10T23:27:18.122067+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:44.668087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":164,"state":"creating+peering","last_fresh":"2024-09-10T23:27:16.084619+0000","last_change":"2024-09-10T23:27:16.084619+0000","last_active":"2024-09-10T23:27:16.067370+0000","last_peered":"2024-09-10T23:27:16.067370+0000","last_clean":"2024-09-10T23:27:16.067370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:27:16.084619+0000","last_undegraded":"2024-09-10T23:27:16.084619+0000","last_fullsized":"2024-09-10T23:27:16.084619+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124345+0000","last_change":"2024-09-10T23:27:16.095550+0000","last_active":"2024-09-10T23:27:18.124345+0000","last_peered":"2024-09-10T23:27:18.124345+0000","last_clean":"2024-09-10T23:27:18.124345+0000","last_became_active":"2024-09-10T23:27:16.093841+0000","last_became_peered":"2024-09-10T23:27:16.093841+0000","last_unstale":"2024-09-10T23:27:18.124345+0000","last_undegraded":"2024-09-10T23:27:18.124345+0000","last_fullsized":"2024-09-10T23:27:18.124345+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654590+0000","last_change":"2024-09-10T23:27:17.102508+0000","last_active":"2024-09-10T23:27:18.654590+0000","last_peered":"2024-09-10T23:27:18.654590+0000","last_clean":"2024-09-10T23:27:18.654590+0000","last_became_active":"2024-09-10T23:27:17.102219+0000","last_became_peered":"2024-09-10T23:27:17.102219+0000","last_unstale":"2024-09-10T23:27:18.654590+0000","last_undegraded":"2024-09-10T23:27:18.654590+0000","last_fullsized":"2024-09-10T23:27:18.654590+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648863+0000","last_change":"2024-09-10T23:27:16.082194+0000","last_active":"2024-09-10T23:27:18.648863+0000","last_peered":"2024-09-10T23:27:18.648863+0000","last_clean":"2024-09-10T23:27:18.648863+0000","last_became_active":"2024-09-10T23:27:16.081929+0000","last_became_peered":"2024-09-10T23:27:16.081929+0000","last_unstale":"2024-09-10T23:27:18.648863+0000","last_undegraded":"2024-09-10T23:27:18.648863+0000","last_fullsized":"2024-09-10T23:27:18.648863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:01.565180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654640+0000","last_change":"2024-09-10T23:27:17.116874+0000","last_active":"2024-09-10T23:27:18.654640+0000","last_peered":"2024-09-10T23:27:18.654640+0000","last_clean":"2024-09-10T23:27:18.654640+0000","last_became_active":"2024-09-10T23:27:17.116618+0000","last_became_peered":"2024-09-10T23:27:17.116618+0000","last_unstale":"2024-09-10T23:27:18.654640+0000","last_undegraded":"2024-09-10T23:27:18.654640+0000","last_fullsized":"2024-09-10T23:27:18.654640+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124289+0000","last_change":"2024-09-10T23:27:16.097769+0000","last_active":"2024-09-10T23:27:18.124289+0000","last_peered":"2024-09-10T23:27:18.124289+0000","last_clean":"2024-09-10T23:27:18.124289+0000","last_became_active":"2024-09-10T23:27:16.097374+0000","last_became_peered":"2024-09-10T23:27:16.097374+0000","last_unstale":"2024-09-10T23:27:18.124289+0000","last_undegraded":"2024-09-10T23:27:18.124289+0000","last_fullsized":"2024-09-10T23:27:18.124289+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.793154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121765+0000","last_change":"2024-09-10T23:27:17.092162+0000","last_active":"2024-09-10T23:27:18.121765+0000","last_peered":"2024-09-10T23:27:18.121765+0000","last_clean":"2024-09-10T23:27:18.121765+0000","last_became_active":"2024-09-10T23:27:17.091863+0000","last_became_peered":"2024-09-10T23:27:17.091863+0000","last_unstale":"2024-09-10T23:27:18.121765+0000","last_undegraded":"2024-09-10T23:27:18.121765+0000","last_fullsized":"2024-09-10T23:27:18.121765+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.826000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649109+0000","last_change":"2024-09-10T23:27:16.089641+0000","last_active":"2024-09-10T23:27:18.649109+0000","last_peered":"2024-09-10T23:27:18.649109+0000","last_clean":"2024-09-10T23:27:18.649109+0000","last_became_active":"2024-09-10T23:27:16.088701+0000","last_became_peered":"2024-09-10T23:27:16.088701+0000","last_unstale":"2024-09-10T23:27:18.649109+0000","last_undegraded":"2024-09-10T23:27:18.649109+0000","last_fullsized":"2024-09-10T23:27:18.649109+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:45.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649034+0000","last_change":"2024-09-10T23:27:17.115275+0000","last_active":"2024-09-10T23:27:18.649034+0000","last_peered":"2024-09-10T23:27:18.649034+0000","last_clean":"2024-09-10T23:27:18.649034+0000","last_became_active":"2024-09-10T23:27:17.114068+0000","last_became_peered":"2024-09-10T23:27:17.114068+0000","last_unstale":"2024-09-10T23:27:18.649034+0000","last_undegraded":"2024-09-10T23:27:18.649034+0000","last_fullsized":"2024-09-10T23:27:18.649034+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:47.769062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654274+0000","last_change":"2024-09-10T23:27:16.091395+0000","last_active":"2024-09-10T23:27:18.654274+0000","last_peered":"2024-09-10T23:27:18.654274+0000","last_clean":"2024-09-10T23:27:18.654274+0000","last_became_active":"2024-09-10T23:27:16.091136+0000","last_became_peered":"2024-09-10T23:27:16.091136+0000","last_unstale":"2024-09-10T23:27:18.654274+0000","last_undegraded":"2024-09-10T23:27:18.654274+0000","last_fullsized":"2024-09-10T23:27:18.654274+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649010+0000","last_change":"2024-09-10T23:27:17.116302+0000","last_active":"2024-09-10T23:27:18.649010+0000","last_peered":"2024-09-10T23:27:18.649010+0000","last_clean":"2024-09-10T23:27:18.649010+0000","last_became_active":"2024-09-10T23:27:17.115078+0000","last_became_peered":"2024-09-10T23:27:17.115078+0000","last_unstale":"2024-09-10T23:27:18.649010+0000","last_undegraded":"2024-09-10T23:27:18.649010+0000","last_fullsized":"2024-09-10T23:27:18.649010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.266065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088362+0000","last_change":"2024-09-10T23:27:16.093832+0000","last_active":"2024-09-10T23:27:18.088362+0000","last_peered":"2024-09-10T23:27:18.088362+0000","last_clean":"2024-09-10T23:27:18.088362+0000","last_became_active":"2024-09-10T23:27:16.089264+0000","last_became_peered":"2024-09-10T23:27:16.089264+0000","last_unstale":"2024-09-10T23:27:18.088362+0000","last_undegraded":"2024-09-10T23:27:18.088362+0000","last_fullsized":"2024-09-10T23:27:18.088362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:34.365596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655734+0000","last_change":"2024-09-10T23:27:17.113240+0000","last_active":"2024-09-10T23:27:18.655734+0000","last_peered":"2024-09-10T23:27:18.655734+0000","last_clean":"2024-09-10T23:27:18.655734+0000","last_became_active":"2024-09-10T23:27:17.112858+0000","last_became_peered":"2024-09-10T23:27:17.112858+0000","last_unstale":"2024-09-10T23:27:18.655734+0000","last_undegraded":"2024-09-10T23:27:18.655734+0000","last_fullsized":"2024-09-10T23:27:18.655734+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:25.920123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654938+0000","last_change":"2024-09-10T23:27:16.098898+0000","last_active":"2024-09-10T23:27:18.654938+0000","last_peered":"2024-09-10T23:27:18.654938+0000","last_clean":"2024-09-10T23:27:18.654938+0000","last_became_active":"2024-09-10T23:27:16.098612+0000","last_became_peered":"2024-09-10T23:27:16.098612+0000","last_unstale":"2024-09-10T23:27:18.654938+0000","last_undegraded":"2024-09-10T23:27:18.654938+0000","last_fullsized":"2024-09-10T23:27:18.654938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:20.951718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.653946+0000","last_change":"2024-09-10T23:27:17.111049+0000","last_active":"2024-09-10T23:27:18.653946+0000","last_peered":"2024-09-10T23:27:18.653946+0000","last_clean":"2024-09-10T23:27:18.653946+0000","last_became_active":"2024-09-10T23:27:17.110785+0000","last_became_peered":"2024-09-10T23:27:17.110785+0000","last_unstale":"2024-09-10T23:27:18.653946+0000","last_undegraded":"2024-09-10T23:27:18.653946+0000","last_fullsized":"2024-09-10T23:27:18.653946+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649027+0000","last_change":"2024-09-10T23:27:16.084074+0000","last_active":"2024-09-10T23:27:18.649027+0000","last_peered":"2024-09-10T23:27:18.649027+0000","last_clean":"2024-09-10T23:27:18.649027+0000","last_became_active":"2024-09-10T23:27:16.083796+0000","last_became_peered":"2024-09-10T23:27:16.083796+0000","last_unstale":"2024-09-10T23:27:18.649027+0000","last_undegraded":"2024-09-10T23:27:18.649027+0000","last_fullsized":"2024-09-10T23:27:18.649027+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:31.907739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123973+0000","last_change":"2024-09-10T23:27:17.109500+0000","last_active":"2024-09-10T23:27:18.123973+0000","last_peered":"2024-09-10T23:27:18.123973+0000","last_clean":"2024-09-10T23:27:18.123973+0000","last_became_active":"2024-09-10T23:27:17.109163+0000","last_became_peered":"2024-09-10T23:27:17.109163+0000","last_unstale":"2024-09-10T23:27:18.123973+0000","last_undegraded":"2024-09-10T23:27:18.123973+0000","last_fullsized":"2024-09-10T23:27:18.123973+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"166'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123185+0000","last_change":"2024-09-10T23:27:16.099284+0000","last_active":"2024-09-10T23:27:18.123185+0000","last_peered":"2024-09-10T23:27:18.123185+0000","last_clean":"2024-09-10T23:27:18.123185+0000","last_became_active":"2024-09-10T23:27:16.098730+0000","last_became_peered":"2024-09-10T23:27:16.098730+0000","last_unstale":"2024-09-10T23:27:18.123185+0000","last_undegraded":"2024-09-10T23:27:18.123185+0000","last_fullsized":"2024-09-10T23:27:18.123185+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:36.406564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088655+0000","last_change":"2024-09-10T23:27:17.100031+0000","last_active":"2024-09-10T23:27:18.088655+0000","last_peered":"2024-09-10T23:27:18.088655+0000","last_clean":"2024-09-10T23:27:18.088655+0000","last_became_active":"2024-09-10T23:27:17.099753+0000","last_became_peered":"2024-09-10T23:27:17.099753+0000","last_unstale":"2024-09-10T23:27:18.088655+0000","last_undegraded":"2024-09-10T23:27:18.088655+0000","last_fullsized":"2024-09-10T23:27:18.088655+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:00.932972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121568+0000","last_change":"2024-09-10T23:27:16.093939+0000","last_active":"2024-09-10T23:27:18.121568+0000","last_peered":"2024-09-10T23:27:18.121568+0000","last_clean":"2024-09-10T23:27:18.121568+0000","last_became_active":"2024-09-10T23:27:16.093597+0000","last_became_peered":"2024-09-10T23:27:16.093597+0000","last_unstale":"2024-09-10T23:27:18.121568+0000","last_undegraded":"2024-09-10T23:27:18.121568+0000","last_fullsized":"2024-09-10T23:27:18.121568+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:43.549959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124149+0000","last_change":"2024-09-10T23:27:17.107113+0000","last_active":"2024-09-10T23:27:18.124149+0000","last_peered":"2024-09-10T23:27:18.124149+0000","last_clean":"2024-09-10T23:27:18.124149+0000","last_became_active":"2024-09-10T23:27:17.106859+0000","last_became_peered":"2024-09-10T23:27:17.106859+0000","last_unstale":"2024-09-10T23:27:18.124149+0000","last_undegraded":"2024-09-10T23:27:18.124149+0000","last_fullsized":"2024-09-10T23:27:18.124149+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088636+0000","last_change":"2024-09-10T23:27:16.100147+0000","last_active":"2024-09-10T23:27:18.088636+0000","last_peered":"2024-09-10T23:27:18.088636+0000","last_clean":"2024-09-10T23:27:18.088636+0000","last_became_active":"2024-09-10T23:27:16.099691+0000","last_became_peered":"2024-09-10T23:27:16.099691+0000","last_unstale":"2024-09-10T23:27:18.088636+0000","last_undegraded":"2024-09-10T23:27:18.088636+0000","last_fullsized":"2024-09-10T23:27:18.088636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:54.133674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094649+0000","last_change":"2024-09-10T23:27:17.119298+0000","last_active":"2024-09-10T23:27:18.094649+0000","last_peered":"2024-09-10T23:27:18.094649+0000","last_clean":"2024-09-10T23:27:18.094649+0000","last_became_active":"2024-09-10T23:27:17.118918+0000","last_became_peered":"2024-09-10T23:27:17.118918+0000","last_unstale":"2024-09-10T23:27:18.094649+0000","last_undegraded":"2024-09-10T23:27:18.094649+0000","last_fullsized":"2024-09-10T23:27:18.094649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:55.884595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094384+0000","last_change":"2024-09-10T23:27:16.090393+0000","last_active":"2024-09-10T23:27:18.094384+0000","last_peered":"2024-09-10T23:27:18.094384+0000","last_clean":"2024-09-10T23:27:18.094384+0000","last_became_active":"2024-09-10T23:27:16.090138+0000","last_became_peered":"2024-09-10T23:27:16.090138+0000","last_unstale":"2024-09-10T23:27:18.094384+0000","last_undegraded":"2024-09-10T23:27:18.094384+0000","last_fullsized":"2024-09-10T23:27:18.094384+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:12.975929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655516+0000","last_change":"2024-09-10T23:27:17.110962+0000","last_active":"2024-09-10T23:27:18.655516+0000","last_peered":"2024-09-10T23:27:18.655516+0000","last_clean":"2024-09-10T23:27:18.655516+0000","last_became_active":"2024-09-10T23:27:17.110669+0000","last_became_peered":"2024-09-10T23:27:17.110669+0000","last_unstale":"2024-09-10T23:27:18.655516+0000","last_undegraded":"2024-09-10T23:27:18.655516+0000","last_fullsized":"2024-09-10T23:27:18.655516+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:46.498405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121402+0000","last_change":"2024-09-10T23:27:16.089373+0000","last_active":"2024-09-10T23:27:18.121402+0000","last_peered":"2024-09-10T23:27:18.121402+0000","last_clean":"2024-09-10T23:27:18.121402+0000","last_became_active":"2024-09-10T23:27:16.089120+0000","last_became_peered":"2024-09-10T23:27:16.089120+0000","last_unstale":"2024-09-10T23:27:18.121402+0000","last_undegraded":"2024-09-10T23:27:18.121402+0000","last_fullsized":"2024-09-10T23:27:18.121402+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:19.387603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121663+0000","last_change":"2024-09-10T23:27:17.094316+0000","last_active":"2024-09-10T23:27:18.121663+0000","last_peered":"2024-09-10T23:27:18.121663+0000","last_clean":"2024-09-10T23:27:18.121663+0000","last_became_active":"2024-09-10T23:27:17.094021+0000","last_became_peered":"2024-09-10T23:27:17.094021+0000","last_unstale":"2024-09-10T23:27:18.121663+0000","last_undegraded":"2024-09-10T23:27:18.121663+0000","last_fullsized":"2024-09-10T23:27:18.121663+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:15.902576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654294+0000","last_change":"2024-09-10T23:27:16.096182+0000","last_active":"2024-09-10T23:27:18.654294+0000","last_peered":"2024-09-10T23:27:18.654294+0000","last_clean":"2024-09-10T23:27:18.654294+0000","last_became_active":"2024-09-10T23:27:16.094386+0000","last_became_peered":"2024-09-10T23:27:16.094386+0000","last_unstale":"2024-09-10T23:27:18.654294+0000","last_undegraded":"2024-09-10T23:27:18.654294+0000","last_fullsized":"2024-09-10T23:27:18.654294+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.903208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088687+0000","last_change":"2024-09-10T23:27:17.116139+0000","last_active":"2024-09-10T23:27:18.088687+0000","last_peered":"2024-09-10T23:27:18.088687+0000","last_clean":"2024-09-10T23:27:18.088687+0000","last_became_active":"2024-09-10T23:27:17.115852+0000","last_became_peered":"2024-09-10T23:27:17.115852+0000","last_unstale":"2024-09-10T23:27:18.088687+0000","last_undegraded":"2024-09-10T23:27:18.088687+0000","last_fullsized":"2024-09-10T23:27:18.088687+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:54.432594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648362+0000","last_change":"2024-09-10T23:27:16.093853+0000","last_active":"2024-09-10T23:27:18.648362+0000","last_peered":"2024-09-10T23:27:18.648362+0000","last_clean":"2024-09-10T23:27:18.648362+0000","last_became_active":"2024-09-10T23:27:16.093586+0000","last_became_peered":"2024-09-10T23:27:16.093586+0000","last_unstale":"2024-09-10T23:27:18.648362+0000","last_undegraded":"2024-09-10T23:27:18.648362+0000","last_fullsized":"2024-09-10T23:27:18.648362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:03.023982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654467+0000","last_change":"2024-09-10T23:27:17.114770+0000","last_active":"2024-09-10T23:27:18.654467+0000","last_peered":"2024-09-10T23:27:18.654467+0000","last_clean":"2024-09-10T23:27:18.654467+0000","last_became_active":"2024-09-10T23:27:17.112895+0000","last_became_peered":"2024-09-10T23:27:17.112895+0000","last_unstale":"2024-09-10T23:27:18.654467+0000","last_undegraded":"2024-09-10T23:27:18.654467+0000","last_fullsized":"2024-09-10T23:27:18.654467+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:05.711658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121640+0000","last_change":"2024-09-10T23:27:16.099331+0000","last_active":"2024-09-10T23:27:18.121640+0000","last_peered":"2024-09-10T23:27:18.121640+0000","last_clean":"2024-09-10T23:27:18.121640+0000","last_became_active":"2024-09-10T23:27:16.099068+0000","last_became_peered":"2024-09-10T23:27:16.099068+0000","last_unstale":"2024-09-10T23:27:18.121640+0000","last_undegraded":"2024-09-10T23:27:18.121640+0000","last_fullsized":"2024-09-10T23:27:18.121640+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:23.742338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":370,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655059+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:27:18.655059+0000","last_peered":"2024-09-10T23:27:18.655059+0000","last_clean":"2024-09-10T23:27:18.655059+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:27:18.655059+0000","last_undegraded":"2024-09-10T23:27:18.655059+0000","last_fullsized":"2024-09-10T23:27:18.655059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69212,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302628,"statfs":{"total":96636764160,"available":96565891072,"internally_reserved":0,"allocated":2039808,"data_stored":955710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509587,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69832,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302008,"statfs":{"total":96636764160,"available":96565256192,"internally_reserved":0,"allocated":2670592,"data_stored":1566596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2084864,"data_stored":976352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69328,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302512,"statfs":{"total":96636764160,"available":96565772288,"internally_reserved":0,"allocated":2093056,"data_stored":976992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509586,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69312,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302528,"statfs":{"total":96636764160,"available":96565788672,"internally_reserved":0,"allocated":2076672,"data_stored":976228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509587,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2088960,"data_stored":977840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509586,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74060,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297780,"statfs":{"total":96636764160,"available":96560926720,"internally_reserved":0,"allocated":2678784,"data_stored":1566700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2097152,"data_stored":978444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:27:22.063 INFO:tasks.ceph.ceph_manager.ceph:PG 24.2e is not active+clean 2024-09-10T23:27:22.063 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 164, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:27:16.089170+0000', 'last_change': '2024-09-10T23:27:16.089170+0000', 'last_active': '2024-09-10T23:27:16.067370+0000', 'last_peered': '2024-09-10T23:27:16.067370+0000', 'last_clean': '2024-09-10T23:27:16.067370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:27:16.089170+0000', 'last_undegraded': '2024-09-10T23:27:16.089170+0000', 'last_fullsized': '2024-09-10T23:27:16.089170+0000', 'mapping_epoch': 164, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 164, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_clean_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:27:22.063 INFO:tasks.ceph.ceph_manager.ceph:PG 24.22 is not active+clean 2024-09-10T23:27:22.063 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 164, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:27:16.085446+0000', 'last_change': '2024-09-10T23:27:16.085446+0000', 'last_active': '2024-09-10T23:27:16.067370+0000', 'last_peered': '2024-09-10T23:27:16.067370+0000', 'last_clean': '2024-09-10T23:27:16.067370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:27:16.085446+0000', 'last_undegraded': '2024-09-10T23:27:16.085446+0000', 'last_fullsized': '2024-09-10T23:27:16.085446+0000', 'mapping_epoch': 164, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 164, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_clean_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:27:22.064 INFO:tasks.ceph.ceph_manager.ceph:PG 24.20 is not active+clean 2024-09-10T23:27:22.064 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 164, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:27:16.084929+0000', 'last_change': '2024-09-10T23:27:16.084929+0000', 'last_active': '2024-09-10T23:27:16.067370+0000', 'last_peered': '2024-09-10T23:27:16.067370+0000', 'last_clean': '2024-09-10T23:27:16.067370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:27:16.084929+0000', 'last_undegraded': '2024-09-10T23:27:16.084929+0000', 'last_fullsized': '2024-09-10T23:27:16.084929+0000', 'mapping_epoch': 164, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 164, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_clean_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:27:22.064 INFO:tasks.ceph.ceph_manager.ceph:PG 24.1c is not active+clean 2024-09-10T23:27:22.064 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 164, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:27:16.088745+0000', 'last_change': '2024-09-10T23:27:16.088745+0000', 'last_active': '2024-09-10T23:27:16.067370+0000', 'last_peered': '2024-09-10T23:27:16.067370+0000', 'last_clean': '2024-09-10T23:27:16.067370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:27:16.088745+0000', 'last_undegraded': '2024-09-10T23:27:16.088745+0000', 'last_fullsized': '2024-09-10T23:27:16.088745+0000', 'mapping_epoch': 164, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 164, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_clean_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:27:22.064 INFO:tasks.ceph.ceph_manager.ceph:PG 24.1 is not active+clean 2024-09-10T23:27:22.064 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 164, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:27:16.084619+0000', 'last_change': '2024-09-10T23:27:16.084619+0000', 'last_active': '2024-09-10T23:27:16.067370+0000', 'last_peered': '2024-09-10T23:27:16.067370+0000', 'last_clean': '2024-09-10T23:27:16.067370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:27:16.084619+0000', 'last_undegraded': '2024-09-10T23:27:16.084619+0000', 'last_fullsized': '2024-09-10T23:27:16.084619+0000', 'mapping_epoch': 164, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 164, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'last_clean_scrub_stamp': '2024-09-10T23:27:16.067370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T23:27:22.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:27:22.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 -- 172.21.15.17:0/2919474475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68380d1830 msgr2=0x7f683815f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 --2- 172.21.15.17:0/2919474475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68380d1830 0x7f683815f5a0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f68380d2e60 tx=0x7f682401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 -- 172.21.15.17:0/2919474475 shutdown_connections 2024-09-10T23:27:22.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 --2- 172.21.15.17:0/2919474475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68380d1830 0x7f683815f5a0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 --2- 172.21.15.17:0/2919474475 >> v2:172.21.15.77:3300/0 conn(0x7f6838070ad0 0x7f683815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 -- 172.21.15.17:0/2919474475 >> 172.21.15.17:0/2919474475 conn(0x7f68380d1d60 msgr2=0x7f68380d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:22.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 -- 172.21.15.17:0/2919474475 shutdown_connections 2024-09-10T23:27:22.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 -- 172.21.15.17:0/2919474475 wait complete. 2024-09-10T23:27:22.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 Processor -- start 2024-09-10T23:27:22.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 -- start start 2024-09-10T23:27:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6838070ad0 0x7f683814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68380cf320 0x7f68380c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68380d1830 0x7f683814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f68381693d0 con 0x7f6838070ad0 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6838169250 con 0x7f68380cf320 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683f600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6838169550 con 0x7f68380d1830 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6838070ad0 0x7f683814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6838070ad0 0x7f683814eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35112/0 (socket says 172.21.15.17:35112) 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683cc00640 1 -- 172.21.15.17:0/2753829467 learned_addr learned my addr 172.21.15.17:0/2753829467 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f6837e00640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68380cf320 0x7f68380c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683d600640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68380d1830 0x7f683814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683cc00640 1 -- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68380d1830 msgr2=0x7f683814fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683cc00640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68380d1830 0x7f683814fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683cc00640 1 -- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68380cf320 msgr2=0x7f68380c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683cc00640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68380cf320 0x7f68380c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.245+0000 7f683cc00640 1 -- 172.21.15.17:0/2753829467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6838150810 con 0x7f6838070ad0 2024-09-10T23:27:22.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f683cc00640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6838070ad0 0x7f683814eda0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f682c00d980 tx=0x7f682c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:22.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f6834c00640 1 -- 172.21.15.17:0/2753829467 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c017070 con 0x7f6838070ad0 2024-09-10T23:27:22.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f6834c00640 1 -- 172.21.15.17:0/2753829467 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f682c009d60 con 0x7f6838070ad0 2024-09-10T23:27:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f6834c00640 1 -- 172.21.15.17:0/2753829467 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c005280 con 0x7f6838070ad0 2024-09-10T23:27:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68380c7230 con 0x7f6838070ad0 2024-09-10T23:27:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68380c77f0 con 0x7f6838070ad0 2024-09-10T23:27:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68380cfc60 con 0x7f6838070ad0 2024-09-10T23:27:22.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f6834c00640 1 -- 172.21.15.17:0/2753829467 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f682c005420 con 0x7f6838070ad0 2024-09-10T23:27:22.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f6834c00640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68180725e0 0x7f6818074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.249+0000 7f6834c00640 1 -- 172.21.15.17:0/2753829467 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f682c093500 con 0x7f6838070ad0 2024-09-10T23:27:22.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.253+0000 7f6837e00640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68180725e0 0x7f6818074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.253+0000 7f6837e00640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68180725e0 0x7f6818074aa0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f68240af000 tx=0x7f682401b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:22.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.253+0000 7f6834c00640 1 -- 172.21.15.17:0/2753829467 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6838150810 con 0x7f6838070ad0 2024-09-10T23:27:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f68380b6580 con 0x7f6838070ad0 2024-09-10T23:27:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f6834c00640 1 -- 172.21.15.17:0/2753829467 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1694 (secure 0 0 0) 0x7f682c05e400 con 0x7f6838070ad0 2024-09-10T23:27:22.492 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:22.493 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":731,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":534765568,"bytes_avail":772559347712,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2659,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9711}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-10T23:26:58.457659+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68180725e0 msgr2=0x7f6818074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68180725e0 0x7f6818074aa0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f68240af000 tx=0x7f682401b100 comp rx=0 tx=0).stop 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6838070ad0 msgr2=0x7f683814eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6838070ad0 0x7f683814eda0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f682c00d980 tx=0x7f682c00de40 comp rx=0 tx=0).stop 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 shutdown_connections 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f68180725e0 0x7f6818074aa0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68380d1830 0x7f683814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68380cf320 0x7f68380c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 --2- 172.21.15.17:0/2753829467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6838070ad0 0x7f683814eda0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 >> 172.21.15.17:0/2753829467 conn(0x7f68380d1d60 msgr2=0x7f68380b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 shutdown_connections 2024-09-10T23:27:22.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.489+0000 7f683f600640 1 -- 172.21.15.17:0/2753829467 wait complete. 2024-09-10T23:27:22.515 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:27:22.515 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:27:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.657+0000 7f6f2ce00640 1 -- 172.21.15.17:0/214214639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f280cd4c0 msgr2=0x7f6f2815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.657+0000 7f6f2ce00640 1 --2- 172.21.15.17:0/214214639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f280cd4c0 0x7f6f2815c7c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009840 tx=0x7f6f1001c820 comp rx=0 tx=0).stop 2024-09-10T23:27:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.657+0000 7f6f2ce00640 1 -- 172.21.15.17:0/214214639 shutdown_connections 2024-09-10T23:27:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.657+0000 7f6f2ce00640 1 --2- 172.21.15.17:0/214214639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f280cd4c0 0x7f6f2815c7c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.657+0000 7f6f2ce00640 1 --2- 172.21.15.17:0/214214639 >> v2:172.21.15.77:3300/0 conn(0x7f6f28070730 0x7f6f2815ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.657+0000 7f6f2ce00640 1 -- 172.21.15.17:0/214214639 >> 172.21.15.17:0/214214639 conn(0x7f6f280b2740 msgr2=0x7f6f280b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.657+0000 7f6f2ce00640 1 -- 172.21.15.17:0/214214639 shutdown_connections 2024-09-10T23:27:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.657+0000 7f6f2ce00640 1 -- 172.21.15.17:0/214214639 wait complete. 2024-09-10T23:27:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 Processor -- start 2024-09-10T23:27:22.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 -- start start 2024-09-10T23:27:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28070730 0x7f6f28139450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f280cd4c0 0x7f6f281fa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f281fad70 0x7f6f281508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280b3cc0 con 0x7f6f280cd4c0 2024-09-10T23:27:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280b3b40 con 0x7f6f28070730 2024-09-10T23:27:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6f280b3e40 con 0x7f6f281fad70 2024-09-10T23:27:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f280cd4c0 0x7f6f281fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f280cd4c0 0x7f6f281fa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35114/0 (socket says 172.21.15.17:35114) 2024-09-10T23:27:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1fe00640 1 -- 172.21.15.17:0/3789094259 learned_addr learned my addr 172.21.15.17:0/3789094259 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f27400640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28070730 0x7f6f28139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f27e00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f281fad70 0x7f6f281508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1fe00640 1 -- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f281fad70 msgr2=0x7f6f281508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1fe00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f281fad70 0x7f6f281508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1fe00640 1 -- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28070730 msgr2=0x7f6f28139450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1fe00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28070730 0x7f6f28139450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1fe00640 1 -- 172.21.15.17:0/3789094259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f28151640 con 0x7f6f280cd4c0 2024-09-10T23:27:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1fe00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f280cd4c0 0x7f6f281fa830 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009790 tx=0x7f6f100a56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1f400640 1 -- 172.21.15.17:0/3789094259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100b2040 con 0x7f6f280cd4c0 2024-09-10T23:27:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1f400640 1 -- 172.21.15.17:0/3789094259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f10004430 con 0x7f6f280cd4c0 2024-09-10T23:27:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f1f400640 1 -- 172.21.15.17:0/3789094259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10005280 con 0x7f6f280cd4c0 2024-09-10T23:27:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f28151920 con 0x7f6f280cd4c0 2024-09-10T23:27:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f28151ee0 con 0x7f6f280cd4c0 2024-09-10T23:27:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.661+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f281fb180 con 0x7f6f280cd4c0 2024-09-10T23:27:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.665+0000 7f6f1f400640 1 -- 172.21.15.17:0/3789094259 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6f100b5070 con 0x7f6f280cd4c0 2024-09-10T23:27:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.665+0000 7f6f1f400640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f040725e0 0x7f6f04074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.665+0000 7f6f1f400640 1 -- 172.21.15.17:0/3789094259 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f6f1012ca20 con 0x7f6f280cd4c0 2024-09-10T23:27:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.665+0000 7f6f27400640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f040725e0 0x7f6f04074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.665+0000 7f6f27400640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f040725e0 0x7f6f04074aa0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009be0 tx=0x7f6f18009260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.669+0000 7f6f1f400640 1 -- 172.21.15.17:0/3789094259 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6f281fb180 con 0x7f6f280cd4c0 2024-09-10T23:27:22.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.841+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f280b4580 con 0x7f6f040725e0 2024-09-10T23:27:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.845+0000 7f6f1f400640 1 -- 172.21.15.17:0/3789094259 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252468 (secure 0 0 0) 0x7f6f280b4580 con 0x7f6f040725e0 2024-09-10T23:27:22.855 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:22.858 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:27:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f040725e0 msgr2=0x7f6f04074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f040725e0 0x7f6f04074aa0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009be0 tx=0x7f6f18009260 comp rx=0 tx=0).stop 2024-09-10T23:27:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f280cd4c0 msgr2=0x7f6f281fa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f280cd4c0 0x7f6f281fa830 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009790 tx=0x7f6f100a56e0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 shutdown_connections 2024-09-10T23:27:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f040725e0 0x7f6f04074aa0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f281fad70 0x7f6f281508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f280cd4c0 0x7f6f281fa830 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 --2- 172.21.15.17:0/3789094259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f28070730 0x7f6f28139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 >> 172.21.15.17:0/3789094259 conn(0x7f6f280b2740 msgr2=0x7f6f2806cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 shutdown_connections 2024-09-10T23:27:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:22.849+0000 7f6f2ce00640 1 -- 172.21.15.17:0/3789094259 wait complete. 2024-09-10T23:27:22.874 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2024-09-10T23:27:22.463191+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522268,"kb_used_data":17448,"kb_used_omap":12,"kb_used_meta":504627,"kb_avail":754452452,"statfs":{"total":773094113280,"available":772559310848,"internally_reserved":0,"allocated":17866752,"data_stored":8995380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516738609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.387598"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095075+0000","last_change":"2024-09-10T23:27:17.106584+0000","last_active":"2024-09-10T23:27:18.095075+0000","last_peered":"2024-09-10T23:27:18.095075+0000","last_clean":"2024-09-10T23:27:18.095075+0000","last_became_active":"2024-09-10T23:27:17.106315+0000","last_became_peered":"2024-09-10T23:27:17.106315+0000","last_unstale":"2024-09-10T23:27:18.095075+0000","last_undegraded":"2024-09-10T23:27:18.095075+0000","last_fullsized":"2024-09-10T23:27:18.095075+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:54.902790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655807+0000","last_change":"2024-09-10T23:27:17.115113+0000","last_active":"2024-09-10T23:27:18.655807+0000","last_peered":"2024-09-10T23:27:18.655807+0000","last_clean":"2024-09-10T23:27:18.655807+0000","last_became_active":"2024-09-10T23:27:17.114341+0000","last_became_peered":"2024-09-10T23:27:17.114341+0000","last_unstale":"2024-09-10T23:27:18.655807+0000","last_undegraded":"2024-09-10T23:27:18.655807+0000","last_fullsized":"2024-09-10T23:27:18.655807+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:20.113939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094285+0000","last_change":"2024-09-10T23:27:17.101230+0000","last_active":"2024-09-10T23:27:18.094285+0000","last_peered":"2024-09-10T23:27:18.094285+0000","last_clean":"2024-09-10T23:27:18.094285+0000","last_became_active":"2024-09-10T23:27:17.100946+0000","last_became_peered":"2024-09-10T23:27:17.100946+0000","last_unstale":"2024-09-10T23:27:18.094285+0000","last_undegraded":"2024-09-10T23:27:18.094285+0000","last_fullsized":"2024-09-10T23:27:18.094285+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:20.365134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094578+0000","last_change":"2024-09-10T23:27:17.105978+0000","last_active":"2024-09-10T23:27:18.094578+0000","last_peered":"2024-09-10T23:27:18.094578+0000","last_clean":"2024-09-10T23:27:18.094578+0000","last_became_active":"2024-09-10T23:27:17.105502+0000","last_became_peered":"2024-09-10T23:27:17.105502+0000","last_unstale":"2024-09-10T23:27:18.094578+0000","last_undegraded":"2024-09-10T23:27:18.094578+0000","last_fullsized":"2024-09-10T23:27:18.094578+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:04.674325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649044+0000","last_change":"2024-09-10T23:27:17.108926+0000","last_active":"2024-09-10T23:27:18.649044+0000","last_peered":"2024-09-10T23:27:18.649044+0000","last_clean":"2024-09-10T23:27:18.649044+0000","last_became_active":"2024-09-10T23:27:17.108589+0000","last_became_peered":"2024-09-10T23:27:17.108589+0000","last_unstale":"2024-09-10T23:27:18.649044+0000","last_undegraded":"2024-09-10T23:27:18.649044+0000","last_fullsized":"2024-09-10T23:27:18.649044+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:47.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654886+0000","last_change":"2024-09-10T23:27:17.114012+0000","last_active":"2024-09-10T23:27:18.654886+0000","last_peered":"2024-09-10T23:27:18.654886+0000","last_clean":"2024-09-10T23:27:18.654886+0000","last_became_active":"2024-09-10T23:27:17.111391+0000","last_became_peered":"2024-09-10T23:27:17.111391+0000","last_unstale":"2024-09-10T23:27:18.654886+0000","last_undegraded":"2024-09-10T23:27:18.654886+0000","last_fullsized":"2024-09-10T23:27:18.654886+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:33.637514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123961+0000","last_change":"2024-09-10T23:27:17.104858+0000","last_active":"2024-09-10T23:27:18.123961+0000","last_peered":"2024-09-10T23:27:18.123961+0000","last_clean":"2024-09-10T23:27:18.123961+0000","last_became_active":"2024-09-10T23:27:17.104575+0000","last_became_peered":"2024-09-10T23:27:17.104575+0000","last_unstale":"2024-09-10T23:27:18.123961+0000","last_undegraded":"2024-09-10T23:27:18.123961+0000","last_fullsized":"2024-09-10T23:27:18.123961+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123806+0000","last_change":"2024-09-10T23:27:17.110407+0000","last_active":"2024-09-10T23:27:18.123806+0000","last_peered":"2024-09-10T23:27:18.123806+0000","last_clean":"2024-09-10T23:27:18.123806+0000","last_became_active":"2024-09-10T23:27:17.110090+0000","last_became_peered":"2024-09-10T23:27:17.110090+0000","last_unstale":"2024-09-10T23:27:18.123806+0000","last_undegraded":"2024-09-10T23:27:18.123806+0000","last_fullsized":"2024-09-10T23:27:18.123806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:55.534473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124433+0000","last_change":"2024-09-10T23:27:17.110221+0000","last_active":"2024-09-10T23:27:18.124433+0000","last_peered":"2024-09-10T23:27:18.124433+0000","last_clean":"2024-09-10T23:27:18.124433+0000","last_became_active":"2024-09-10T23:27:17.109916+0000","last_became_peered":"2024-09-10T23:27:17.109916+0000","last_unstale":"2024-09-10T23:27:18.124433+0000","last_undegraded":"2024-09-10T23:27:18.124433+0000","last_fullsized":"2024-09-10T23:27:18.124433+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124429+0000","last_change":"2024-09-10T23:27:17.103184+0000","last_active":"2024-09-10T23:27:18.124429+0000","last_peered":"2024-09-10T23:27:18.124429+0000","last_clean":"2024-09-10T23:27:18.124429+0000","last_became_active":"2024-09-10T23:27:17.102108+0000","last_became_peered":"2024-09-10T23:27:17.102108+0000","last_unstale":"2024-09-10T23:27:18.124429+0000","last_undegraded":"2024-09-10T23:27:18.124429+0000","last_fullsized":"2024-09-10T23:27:18.124429+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655402+0000","last_change":"2024-09-10T23:27:17.120609+0000","last_active":"2024-09-10T23:27:18.655402+0000","last_peered":"2024-09-10T23:27:18.655402+0000","last_clean":"2024-09-10T23:27:18.655402+0000","last_became_active":"2024-09-10T23:27:17.120402+0000","last_became_peered":"2024-09-10T23:27:17.120402+0000","last_unstale":"2024-09-10T23:27:18.655402+0000","last_undegraded":"2024-09-10T23:27:18.655402+0000","last_fullsized":"2024-09-10T23:27:18.655402+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:58.328456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655563+0000","last_change":"2024-09-10T23:27:17.113454+0000","last_active":"2024-09-10T23:27:18.655563+0000","last_peered":"2024-09-10T23:27:18.655563+0000","last_clean":"2024-09-10T23:27:18.655563+0000","last_became_active":"2024-09-10T23:27:17.113102+0000","last_became_peered":"2024-09-10T23:27:17.113102+0000","last_unstale":"2024-09-10T23:27:18.655563+0000","last_undegraded":"2024-09-10T23:27:18.655563+0000","last_fullsized":"2024-09-10T23:27:18.655563+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:24.438181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121506+0000","last_change":"2024-09-10T23:27:17.104651+0000","last_active":"2024-09-10T23:27:18.121506+0000","last_peered":"2024-09-10T23:27:18.121506+0000","last_clean":"2024-09-10T23:27:18.121506+0000","last_became_active":"2024-09-10T23:27:17.104356+0000","last_became_peered":"2024-09-10T23:27:17.104356+0000","last_unstale":"2024-09-10T23:27:18.121506+0000","last_undegraded":"2024-09-10T23:27:18.121506+0000","last_fullsized":"2024-09-10T23:27:18.121506+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:31.195103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648806+0000","last_change":"2024-09-10T23:27:17.112364+0000","last_active":"2024-09-10T23:27:18.648806+0000","last_peered":"2024-09-10T23:27:18.648806+0000","last_clean":"2024-09-10T23:27:18.648806+0000","last_became_active":"2024-09-10T23:27:17.110862+0000","last_became_peered":"2024-09-10T23:27:17.110862+0000","last_unstale":"2024-09-10T23:27:18.648806+0000","last_undegraded":"2024-09-10T23:27:18.648806+0000","last_fullsized":"2024-09-10T23:27:18.648806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:37.706200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654100+0000","last_change":"2024-09-10T23:27:17.115869+0000","last_active":"2024-09-10T23:27:18.654100+0000","last_peered":"2024-09-10T23:27:18.654100+0000","last_clean":"2024-09-10T23:27:18.654100+0000","last_became_active":"2024-09-10T23:27:17.115594+0000","last_became_peered":"2024-09-10T23:27:17.115594+0000","last_unstale":"2024-09-10T23:27:18.654100+0000","last_undegraded":"2024-09-10T23:27:18.654100+0000","last_fullsized":"2024-09-10T23:27:18.654100+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094113+0000","last_change":"2024-09-10T23:27:17.105827+0000","last_active":"2024-09-10T23:27:18.094113+0000","last_peered":"2024-09-10T23:27:18.094113+0000","last_clean":"2024-09-10T23:27:18.094113+0000","last_became_active":"2024-09-10T23:27:17.105514+0000","last_became_peered":"2024-09-10T23:27:17.105514+0000","last_unstale":"2024-09-10T23:27:18.094113+0000","last_undegraded":"2024-09-10T23:27:18.094113+0000","last_fullsized":"2024-09-10T23:27:18.094113+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:41.256305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124559+0000","last_change":"2024-09-10T23:27:17.103100+0000","last_active":"2024-09-10T23:27:18.124559+0000","last_peered":"2024-09-10T23:27:18.124559+0000","last_clean":"2024-09-10T23:27:18.124559+0000","last_became_active":"2024-09-10T23:27:17.101922+0000","last_became_peered":"2024-09-10T23:27:17.101922+0000","last_unstale":"2024-09-10T23:27:18.124559+0000","last_undegraded":"2024-09-10T23:27:18.124559+0000","last_fullsized":"2024-09-10T23:27:18.124559+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:21.276448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654474+0000","last_change":"2024-09-10T23:27:17.114876+0000","last_active":"2024-09-10T23:27:18.654474+0000","last_peered":"2024-09-10T23:27:18.654474+0000","last_clean":"2024-09-10T23:27:18.654474+0000","last_became_active":"2024-09-10T23:27:17.114350+0000","last_became_peered":"2024-09-10T23:27:17.114350+0000","last_unstale":"2024-09-10T23:27:18.654474+0000","last_undegraded":"2024-09-10T23:27:18.654474+0000","last_fullsized":"2024-09-10T23:27:18.654474+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:47.677311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654548+0000","last_change":"2024-09-10T23:27:17.115816+0000","last_active":"2024-09-10T23:27:18.654548+0000","last_peered":"2024-09-10T23:27:18.654548+0000","last_clean":"2024-09-10T23:27:18.654548+0000","last_became_active":"2024-09-10T23:27:17.115530+0000","last_became_peered":"2024-09-10T23:27:17.115530+0000","last_unstale":"2024-09-10T23:27:18.654548+0000","last_undegraded":"2024-09-10T23:27:18.654548+0000","last_fullsized":"2024-09-10T23:27:18.654548+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088360+0000","last_change":"2024-09-10T23:27:17.115834+0000","last_active":"2024-09-10T23:27:18.088360+0000","last_peered":"2024-09-10T23:27:18.088360+0000","last_clean":"2024-09-10T23:27:18.088360+0000","last_became_active":"2024-09-10T23:27:17.115548+0000","last_became_peered":"2024-09-10T23:27:17.115548+0000","last_unstale":"2024-09-10T23:27:18.088360+0000","last_undegraded":"2024-09-10T23:27:18.088360+0000","last_fullsized":"2024-09-10T23:27:18.088360+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:55.699175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121835+0000","last_change":"2024-09-10T23:27:17.093723+0000","last_active":"2024-09-10T23:27:18.121835+0000","last_peered":"2024-09-10T23:27:18.121835+0000","last_clean":"2024-09-10T23:27:18.121835+0000","last_became_active":"2024-09-10T23:27:17.093438+0000","last_became_peered":"2024-09-10T23:27:17.093438+0000","last_unstale":"2024-09-10T23:27:18.121835+0000","last_undegraded":"2024-09-10T23:27:18.121835+0000","last_fullsized":"2024-09-10T23:27:18.121835+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:09.201890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655133+0000","last_change":"2024-09-10T23:27:17.121543+0000","last_active":"2024-09-10T23:27:18.655133+0000","last_peered":"2024-09-10T23:27:18.655133+0000","last_clean":"2024-09-10T23:27:18.655133+0000","last_became_active":"2024-09-10T23:27:17.121249+0000","last_became_peered":"2024-09-10T23:27:17.121249+0000","last_unstale":"2024-09-10T23:27:18.655133+0000","last_undegraded":"2024-09-10T23:27:18.655133+0000","last_fullsized":"2024-09-10T23:27:18.655133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:37.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648649+0000","last_change":"2024-09-10T23:27:17.107888+0000","last_active":"2024-09-10T23:27:18.648649+0000","last_peered":"2024-09-10T23:27:18.648649+0000","last_clean":"2024-09-10T23:27:18.648649+0000","last_became_active":"2024-09-10T23:27:17.107606+0000","last_became_peered":"2024-09-10T23:27:17.107606+0000","last_unstale":"2024-09-10T23:27:18.648649+0000","last_undegraded":"2024-09-10T23:27:18.648649+0000","last_fullsized":"2024-09-10T23:27:18.648649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:35.414834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094571+0000","last_change":"2024-09-10T23:27:17.096587+0000","last_active":"2024-09-10T23:27:18.094571+0000","last_peered":"2024-09-10T23:27:18.094571+0000","last_clean":"2024-09-10T23:27:18.094571+0000","last_became_active":"2024-09-10T23:27:17.096284+0000","last_became_peered":"2024-09-10T23:27:17.096284+0000","last_unstale":"2024-09-10T23:27:18.094571+0000","last_undegraded":"2024-09-10T23:27:18.094571+0000","last_fullsized":"2024-09-10T23:27:18.094571+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:37.468206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122133+0000","last_change":"2024-09-10T23:27:17.102475+0000","last_active":"2024-09-10T23:27:18.122133+0000","last_peered":"2024-09-10T23:27:18.122133+0000","last_clean":"2024-09-10T23:27:18.122133+0000","last_became_active":"2024-09-10T23:27:17.102152+0000","last_became_peered":"2024-09-10T23:27:17.102152+0000","last_unstale":"2024-09-10T23:27:18.122133+0000","last_undegraded":"2024-09-10T23:27:18.122133+0000","last_fullsized":"2024-09-10T23:27:18.122133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:36.895870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088313+0000","last_change":"2024-09-10T23:27:17.101777+0000","last_active":"2024-09-10T23:27:18.088313+0000","last_peered":"2024-09-10T23:27:18.088313+0000","last_clean":"2024-09-10T23:27:18.088313+0000","last_became_active":"2024-09-10T23:27:17.101450+0000","last_became_peered":"2024-09-10T23:27:17.101450+0000","last_unstale":"2024-09-10T23:27:18.088313+0000","last_undegraded":"2024-09-10T23:27:18.088313+0000","last_fullsized":"2024-09-10T23:27:18.088313+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:36.442601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655290+0000","last_change":"2024-09-10T23:27:17.121509+0000","last_active":"2024-09-10T23:27:18.655290+0000","last_peered":"2024-09-10T23:27:18.655290+0000","last_clean":"2024-09-10T23:27:18.655290+0000","last_became_active":"2024-09-10T23:27:17.121230+0000","last_became_peered":"2024-09-10T23:27:17.121230+0000","last_unstale":"2024-09-10T23:27:18.655290+0000","last_undegraded":"2024-09-10T23:27:18.655290+0000","last_fullsized":"2024-09-10T23:27:18.655290+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:02.572094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121637+0000","last_change":"2024-09-10T23:27:17.092322+0000","last_active":"2024-09-10T23:27:18.121637+0000","last_peered":"2024-09-10T23:27:18.121637+0000","last_clean":"2024-09-10T23:27:18.121637+0000","last_became_active":"2024-09-10T23:27:17.092042+0000","last_became_peered":"2024-09-10T23:27:17.092042+0000","last_unstale":"2024-09-10T23:27:18.121637+0000","last_undegraded":"2024-09-10T23:27:18.121637+0000","last_fullsized":"2024-09-10T23:27:18.121637+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:12.311349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654704+0000","last_change":"2024-09-10T23:27:17.115783+0000","last_active":"2024-09-10T23:27:18.654704+0000","last_peered":"2024-09-10T23:27:18.654704+0000","last_clean":"2024-09-10T23:27:18.654704+0000","last_became_active":"2024-09-10T23:27:17.115009+0000","last_became_peered":"2024-09-10T23:27:17.115009+0000","last_unstale":"2024-09-10T23:27:18.654704+0000","last_undegraded":"2024-09-10T23:27:18.654704+0000","last_fullsized":"2024-09-10T23:27:18.654704+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655239+0000","last_change":"2024-09-10T23:27:17.121603+0000","last_active":"2024-09-10T23:27:18.655239+0000","last_peered":"2024-09-10T23:27:18.655239+0000","last_clean":"2024-09-10T23:27:18.655239+0000","last_became_active":"2024-09-10T23:27:17.121229+0000","last_became_peered":"2024-09-10T23:27:17.121229+0000","last_unstale":"2024-09-10T23:27:18.655239+0000","last_undegraded":"2024-09-10T23:27:18.655239+0000","last_fullsized":"2024-09-10T23:27:18.655239+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:14.789550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654122+0000","last_change":"2024-09-10T23:27:17.111758+0000","last_active":"2024-09-10T23:27:18.654122+0000","last_peered":"2024-09-10T23:27:18.654122+0000","last_clean":"2024-09-10T23:27:18.654122+0000","last_became_active":"2024-09-10T23:27:17.111409+0000","last_became_peered":"2024-09-10T23:27:17.111409+0000","last_unstale":"2024-09-10T23:27:18.654122+0000","last_undegraded":"2024-09-10T23:27:18.654122+0000","last_fullsized":"2024-09-10T23:27:18.654122+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.653950+0000","last_change":"2024-09-10T23:27:17.117296+0000","last_active":"2024-09-10T23:27:18.653950+0000","last_peered":"2024-09-10T23:27:18.653950+0000","last_clean":"2024-09-10T23:27:18.653950+0000","last_became_active":"2024-09-10T23:27:17.117034+0000","last_became_peered":"2024-09-10T23:27:17.117034+0000","last_unstale":"2024-09-10T23:27:18.653950+0000","last_undegraded":"2024-09-10T23:27:18.653950+0000","last_fullsized":"2024-09-10T23:27:18.653950+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:50.912615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654870+0000","last_change":"2024-09-10T23:27:17.112841+0000","last_active":"2024-09-10T23:27:18.654870+0000","last_peered":"2024-09-10T23:27:18.654870+0000","last_clean":"2024-09-10T23:27:18.654870+0000","last_became_active":"2024-09-10T23:27:17.112210+0000","last_became_peered":"2024-09-10T23:27:17.112210+0000","last_unstale":"2024-09-10T23:27:18.654870+0000","last_undegraded":"2024-09-10T23:27:18.654870+0000","last_fullsized":"2024-09-10T23:27:18.654870+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:32.914654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"165'4","reported_seq":19,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095147+0000","last_change":"2024-09-10T23:27:16.086889+0000","last_active":"2024-09-10T23:27:18.095147+0000","last_peered":"2024-09-10T23:27:18.095147+0000","last_clean":"2024-09-10T23:27:18.095147+0000","last_became_active":"2024-09-10T23:27:16.086511+0000","last_became_peered":"2024-09-10T23:27:16.086511+0000","last_unstale":"2024-09-10T23:27:18.095147+0000","last_undegraded":"2024-09-10T23:27:18.095147+0000","last_fullsized":"2024-09-10T23:27:18.095147+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:49.905701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121836+0000","last_change":"2024-09-10T23:27:17.107022+0000","last_active":"2024-09-10T23:27:18.121836+0000","last_peered":"2024-09-10T23:27:18.121836+0000","last_clean":"2024-09-10T23:27:18.121836+0000","last_became_active":"2024-09-10T23:27:17.106736+0000","last_became_peered":"2024-09-10T23:27:17.106736+0000","last_unstale":"2024-09-10T23:27:18.121836+0000","last_undegraded":"2024-09-10T23:27:18.121836+0000","last_fullsized":"2024-09-10T23:27:18.121836+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:12.419867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648898+0000","last_change":"2024-09-10T23:27:16.096542+0000","last_active":"2024-09-10T23:27:18.648898+0000","last_peered":"2024-09-10T23:27:18.648898+0000","last_clean":"2024-09-10T23:27:18.648898+0000","last_became_active":"2024-09-10T23:27:16.096251+0000","last_became_peered":"2024-09-10T23:27:16.096251+0000","last_unstale":"2024-09-10T23:27:18.648898+0000","last_undegraded":"2024-09-10T23:27:18.648898+0000","last_fullsized":"2024-09-10T23:27:18.648898+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:58.411262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648867+0000","last_change":"2024-09-10T23:27:17.115424+0000","last_active":"2024-09-10T23:27:18.648867+0000","last_peered":"2024-09-10T23:27:18.648867+0000","last_clean":"2024-09-10T23:27:18.648867+0000","last_became_active":"2024-09-10T23:27:17.110909+0000","last_became_peered":"2024-09-10T23:27:17.110909+0000","last_unstale":"2024-09-10T23:27:18.648867+0000","last_undegraded":"2024-09-10T23:27:18.648867+0000","last_fullsized":"2024-09-10T23:27:18.648867+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.523204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654701+0000","last_change":"2024-09-10T23:27:16.089236+0000","last_active":"2024-09-10T23:27:18.654701+0000","last_peered":"2024-09-10T23:27:18.654701+0000","last_clean":"2024-09-10T23:27:18.654701+0000","last_became_active":"2024-09-10T23:27:16.088941+0000","last_became_peered":"2024-09-10T23:27:16.088941+0000","last_unstale":"2024-09-10T23:27:18.654701+0000","last_undegraded":"2024-09-10T23:27:18.654701+0000","last_fullsized":"2024-09-10T23:27:18.654701+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:07.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654951+0000","last_change":"2024-09-10T23:27:17.110922+0000","last_active":"2024-09-10T23:27:18.654951+0000","last_peered":"2024-09-10T23:27:18.654951+0000","last_clean":"2024-09-10T23:27:18.654951+0000","last_became_active":"2024-09-10T23:27:17.110608+0000","last_became_peered":"2024-09-10T23:27:17.110608+0000","last_unstale":"2024-09-10T23:27:18.654951+0000","last_undegraded":"2024-09-10T23:27:18.654951+0000","last_fullsized":"2024-09-10T23:27:18.654951+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:58.856996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088437+0000","last_change":"2024-09-10T23:27:16.094988+0000","last_active":"2024-09-10T23:27:18.088437+0000","last_peered":"2024-09-10T23:27:18.088437+0000","last_clean":"2024-09-10T23:27:18.088437+0000","last_became_active":"2024-09-10T23:27:16.089019+0000","last_became_peered":"2024-09-10T23:27:16.089019+0000","last_unstale":"2024-09-10T23:27:18.088437+0000","last_undegraded":"2024-09-10T23:27:18.088437+0000","last_fullsized":"2024-09-10T23:27:18.088437+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:20.281854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124284+0000","last_change":"2024-09-10T23:27:17.105543+0000","last_active":"2024-09-10T23:27:18.124284+0000","last_peered":"2024-09-10T23:27:18.124284+0000","last_clean":"2024-09-10T23:27:18.124284+0000","last_became_active":"2024-09-10T23:27:17.105257+0000","last_became_peered":"2024-09-10T23:27:17.105257+0000","last_unstale":"2024-09-10T23:27:18.124284+0000","last_undegraded":"2024-09-10T23:27:18.124284+0000","last_fullsized":"2024-09-10T23:27:18.124284+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123894+0000","last_change":"2024-09-10T23:27:16.098401+0000","last_active":"2024-09-10T23:27:18.123894+0000","last_peered":"2024-09-10T23:27:18.123894+0000","last_clean":"2024-09-10T23:27:18.123894+0000","last_became_active":"2024-09-10T23:27:16.098145+0000","last_became_peered":"2024-09-10T23:27:16.098145+0000","last_unstale":"2024-09-10T23:27:18.123894+0000","last_undegraded":"2024-09-10T23:27:18.123894+0000","last_fullsized":"2024-09-10T23:27:18.123894+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:36.117554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088367+0000","last_change":"2024-09-10T23:27:17.101986+0000","last_active":"2024-09-10T23:27:18.088367+0000","last_peered":"2024-09-10T23:27:18.088367+0000","last_clean":"2024-09-10T23:27:18.088367+0000","last_became_active":"2024-09-10T23:27:17.101415+0000","last_became_peered":"2024-09-10T23:27:17.101415+0000","last_unstale":"2024-09-10T23:27:18.088367+0000","last_undegraded":"2024-09-10T23:27:18.088367+0000","last_fullsized":"2024-09-10T23:27:18.088367+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:55.747742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648884+0000","last_change":"2024-09-10T23:27:16.084947+0000","last_active":"2024-09-10T23:27:18.648884+0000","last_peered":"2024-09-10T23:27:18.648884+0000","last_clean":"2024-09-10T23:27:18.648884+0000","last_became_active":"2024-09-10T23:27:16.084692+0000","last_became_peered":"2024-09-10T23:27:16.084692+0000","last_unstale":"2024-09-10T23:27:18.648884+0000","last_undegraded":"2024-09-10T23:27:18.648884+0000","last_fullsized":"2024-09-10T23:27:18.648884+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:57.850082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088531+0000","last_change":"2024-09-10T23:27:17.098759+0000","last_active":"2024-09-10T23:27:18.088531+0000","last_peered":"2024-09-10T23:27:18.088531+0000","last_clean":"2024-09-10T23:27:18.088531+0000","last_became_active":"2024-09-10T23:27:17.098487+0000","last_became_peered":"2024-09-10T23:27:17.098487+0000","last_unstale":"2024-09-10T23:27:18.088531+0000","last_undegraded":"2024-09-10T23:27:18.088531+0000","last_fullsized":"2024-09-10T23:27:18.088531+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:27.166404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.087971+0000","last_change":"2024-09-10T23:27:16.087772+0000","last_active":"2024-09-10T23:27:18.087971+0000","last_peered":"2024-09-10T23:27:18.087971+0000","last_clean":"2024-09-10T23:27:18.087971+0000","last_became_active":"2024-09-10T23:27:16.087528+0000","last_became_peered":"2024-09-10T23:27:16.087528+0000","last_unstale":"2024-09-10T23:27:18.087971+0000","last_undegraded":"2024-09-10T23:27:18.087971+0000","last_fullsized":"2024-09-10T23:27:18.087971+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:36.395245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095077+0000","last_change":"2024-09-10T23:27:17.102817+0000","last_active":"2024-09-10T23:27:18.095077+0000","last_peered":"2024-09-10T23:27:18.095077+0000","last_clean":"2024-09-10T23:27:18.095077+0000","last_became_active":"2024-09-10T23:27:17.102164+0000","last_became_peered":"2024-09-10T23:27:17.102164+0000","last_unstale":"2024-09-10T23:27:18.095077+0000","last_undegraded":"2024-09-10T23:27:18.095077+0000","last_fullsized":"2024-09-10T23:27:18.095077+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:53.800068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123863+0000","last_change":"2024-09-10T23:27:16.099929+0000","last_active":"2024-09-10T23:27:18.123863+0000","last_peered":"2024-09-10T23:27:18.123863+0000","last_clean":"2024-09-10T23:27:18.123863+0000","last_became_active":"2024-09-10T23:27:16.099633+0000","last_became_peered":"2024-09-10T23:27:16.099633+0000","last_unstale":"2024-09-10T23:27:18.123863+0000","last_undegraded":"2024-09-10T23:27:18.123863+0000","last_fullsized":"2024-09-10T23:27:18.123863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:46.599497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654770+0000","last_change":"2024-09-10T23:27:17.113875+0000","last_active":"2024-09-10T23:27:18.654770+0000","last_peered":"2024-09-10T23:27:18.654770+0000","last_clean":"2024-09-10T23:27:18.654770+0000","last_became_active":"2024-09-10T23:27:17.113118+0000","last_became_peered":"2024-09-10T23:27:17.113118+0000","last_unstale":"2024-09-10T23:27:18.654770+0000","last_undegraded":"2024-09-10T23:27:18.654770+0000","last_fullsized":"2024-09-10T23:27:18.654770+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:04.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121961+0000","last_change":"2024-09-10T23:27:16.098737+0000","last_active":"2024-09-10T23:27:18.121961+0000","last_peered":"2024-09-10T23:27:18.121961+0000","last_clean":"2024-09-10T23:27:18.121961+0000","last_became_active":"2024-09-10T23:27:16.098442+0000","last_became_peered":"2024-09-10T23:27:16.098442+0000","last_unstale":"2024-09-10T23:27:18.121961+0000","last_undegraded":"2024-09-10T23:27:18.121961+0000","last_fullsized":"2024-09-10T23:27:18.121961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:59.654302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121238+0000","last_change":"2024-09-10T23:27:17.109414+0000","last_active":"2024-09-10T23:27:18.121238+0000","last_peered":"2024-09-10T23:27:18.121238+0000","last_clean":"2024-09-10T23:27:18.121238+0000","last_became_active":"2024-09-10T23:27:17.109116+0000","last_became_peered":"2024-09-10T23:27:17.109116+0000","last_unstale":"2024-09-10T23:27:18.121238+0000","last_undegraded":"2024-09-10T23:27:18.121238+0000","last_fullsized":"2024-09-10T23:27:18.121238+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:42.308068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"165'3","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094291+0000","last_change":"2024-09-10T23:27:16.097793+0000","last_active":"2024-09-10T23:27:18.094291+0000","last_peered":"2024-09-10T23:27:18.094291+0000","last_clean":"2024-09-10T23:27:18.094291+0000","last_became_active":"2024-09-10T23:27:16.097498+0000","last_became_peered":"2024-09-10T23:27:16.097498+0000","last_unstale":"2024-09-10T23:27:18.094291+0000","last_undegraded":"2024-09-10T23:27:18.094291+0000","last_fullsized":"2024-09-10T23:27:18.094291+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:57.282134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088279+0000","last_change":"2024-09-10T23:27:17.118822+0000","last_active":"2024-09-10T23:27:18.088279+0000","last_peered":"2024-09-10T23:27:18.088279+0000","last_clean":"2024-09-10T23:27:18.088279+0000","last_became_active":"2024-09-10T23:27:17.118563+0000","last_became_peered":"2024-09-10T23:27:17.118563+0000","last_unstale":"2024-09-10T23:27:18.088279+0000","last_undegraded":"2024-09-10T23:27:18.088279+0000","last_fullsized":"2024-09-10T23:27:18.088279+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:57.399526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"165'6","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121746+0000","last_change":"2024-09-10T23:27:16.101748+0000","last_active":"2024-09-10T23:27:18.121746+0000","last_peered":"2024-09-10T23:27:18.121746+0000","last_clean":"2024-09-10T23:27:18.121746+0000","last_became_active":"2024-09-10T23:27:16.100263+0000","last_became_peered":"2024-09-10T23:27:16.100263+0000","last_unstale":"2024-09-10T23:27:18.121746+0000","last_undegraded":"2024-09-10T23:27:18.121746+0000","last_fullsized":"2024-09-10T23:27:18.121746+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:38.172255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654797+0000","last_change":"2024-09-10T23:27:17.117290+0000","last_active":"2024-09-10T23:27:18.654797+0000","last_peered":"2024-09-10T23:27:18.654797+0000","last_clean":"2024-09-10T23:27:18.654797+0000","last_became_active":"2024-09-10T23:27:17.117017+0000","last_became_peered":"2024-09-10T23:27:17.117017+0000","last_unstale":"2024-09-10T23:27:18.654797+0000","last_undegraded":"2024-09-10T23:27:18.654797+0000","last_fullsized":"2024-09-10T23:27:18.654797+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:16.111352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649018+0000","last_change":"2024-09-10T23:27:16.091730+0000","last_active":"2024-09-10T23:27:18.649018+0000","last_peered":"2024-09-10T23:27:18.649018+0000","last_clean":"2024-09-10T23:27:18.649018+0000","last_became_active":"2024-09-10T23:27:16.090957+0000","last_became_peered":"2024-09-10T23:27:16.090957+0000","last_unstale":"2024-09-10T23:27:18.649018+0000","last_undegraded":"2024-09-10T23:27:18.649018+0000","last_fullsized":"2024-09-10T23:27:18.649018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:23.431267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124243+0000","last_change":"2024-09-10T23:27:17.118859+0000","last_active":"2024-09-10T23:27:18.124243+0000","last_peered":"2024-09-10T23:27:18.124243+0000","last_clean":"2024-09-10T23:27:18.124243+0000","last_became_active":"2024-09-10T23:27:17.118402+0000","last_became_peered":"2024-09-10T23:27:17.118402+0000","last_unstale":"2024-09-10T23:27:18.124243+0000","last_undegraded":"2024-09-10T23:27:18.124243+0000","last_fullsized":"2024-09-10T23:27:18.124243+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121380+0000","last_change":"2024-09-10T23:27:16.085990+0000","last_active":"2024-09-10T23:27:18.121380+0000","last_peered":"2024-09-10T23:27:18.121380+0000","last_clean":"2024-09-10T23:27:18.121380+0000","last_became_active":"2024-09-10T23:27:16.085702+0000","last_became_peered":"2024-09-10T23:27:16.085702+0000","last_unstale":"2024-09-10T23:27:18.121380+0000","last_undegraded":"2024-09-10T23:27:18.121380+0000","last_fullsized":"2024-09-10T23:27:18.121380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:33.884766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654861+0000","last_change":"2024-09-10T23:27:17.116517+0000","last_active":"2024-09-10T23:27:18.654861+0000","last_peered":"2024-09-10T23:27:18.654861+0000","last_clean":"2024-09-10T23:27:18.654861+0000","last_became_active":"2024-09-10T23:27:17.116082+0000","last_became_peered":"2024-09-10T23:27:17.116082+0000","last_unstale":"2024-09-10T23:27:18.654861+0000","last_undegraded":"2024-09-10T23:27:18.654861+0000","last_fullsized":"2024-09-10T23:27:18.654861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654176+0000","last_change":"2024-09-10T23:27:16.092789+0000","last_active":"2024-09-10T23:27:18.654176+0000","last_peered":"2024-09-10T23:27:18.654176+0000","last_clean":"2024-09-10T23:27:18.654176+0000","last_became_active":"2024-09-10T23:27:16.092548+0000","last_became_peered":"2024-09-10T23:27:16.092548+0000","last_unstale":"2024-09-10T23:27:18.654176+0000","last_undegraded":"2024-09-10T23:27:18.654176+0000","last_fullsized":"2024-09-10T23:27:18.654176+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:17.509832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088448+0000","last_change":"2024-09-10T23:27:17.102362+0000","last_active":"2024-09-10T23:27:18.088448+0000","last_peered":"2024-09-10T23:27:18.088448+0000","last_clean":"2024-09-10T23:27:18.088448+0000","last_became_active":"2024-09-10T23:27:17.102022+0000","last_became_peered":"2024-09-10T23:27:17.102022+0000","last_unstale":"2024-09-10T23:27:18.088448+0000","last_undegraded":"2024-09-10T23:27:18.088448+0000","last_fullsized":"2024-09-10T23:27:18.088448+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:22.009162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"165'8","reported_seq":23,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123907+0000","last_change":"2024-09-10T23:27:16.097848+0000","last_active":"2024-09-10T23:27:18.123907+0000","last_peered":"2024-09-10T23:27:18.123907+0000","last_clean":"2024-09-10T23:27:18.123907+0000","last_became_active":"2024-09-10T23:27:16.097483+0000","last_became_peered":"2024-09-10T23:27:16.097483+0000","last_unstale":"2024-09-10T23:27:18.123907+0000","last_undegraded":"2024-09-10T23:27:18.123907+0000","last_fullsized":"2024-09-10T23:27:18.123907+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:59.132712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123840+0000","last_change":"2024-09-10T23:27:17.104862+0000","last_active":"2024-09-10T23:27:18.123840+0000","last_peered":"2024-09-10T23:27:18.123840+0000","last_clean":"2024-09-10T23:27:18.123840+0000","last_became_active":"2024-09-10T23:27:17.103480+0000","last_became_peered":"2024-09-10T23:27:17.103480+0000","last_unstale":"2024-09-10T23:27:18.123840+0000","last_undegraded":"2024-09-10T23:27:18.123840+0000","last_fullsized":"2024-09-10T23:27:18.123840+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122067+0000","last_change":"2024-09-10T23:27:16.084160+0000","last_active":"2024-09-10T23:27:18.122067+0000","last_peered":"2024-09-10T23:27:18.122067+0000","last_clean":"2024-09-10T23:27:18.122067+0000","last_became_active":"2024-09-10T23:27:16.083818+0000","last_became_peered":"2024-09-10T23:27:16.083818+0000","last_unstale":"2024-09-10T23:27:18.122067+0000","last_undegraded":"2024-09-10T23:27:18.122067+0000","last_fullsized":"2024-09-10T23:27:18.122067+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:44.668087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655052+0000","last_change":"2024-09-10T23:27:17.110648+0000","last_active":"2024-09-10T23:27:18.655052+0000","last_peered":"2024-09-10T23:27:18.655052+0000","last_clean":"2024-09-10T23:27:18.655052+0000","last_became_active":"2024-09-10T23:27:17.110352+0000","last_became_peered":"2024-09-10T23:27:17.110352+0000","last_unstale":"2024-09-10T23:27:18.655052+0000","last_undegraded":"2024-09-10T23:27:18.655052+0000","last_fullsized":"2024-09-10T23:27:18.655052+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:51.518892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124345+0000","last_change":"2024-09-10T23:27:16.095550+0000","last_active":"2024-09-10T23:27:18.124345+0000","last_peered":"2024-09-10T23:27:18.124345+0000","last_clean":"2024-09-10T23:27:18.124345+0000","last_became_active":"2024-09-10T23:27:16.093841+0000","last_became_peered":"2024-09-10T23:27:16.093841+0000","last_unstale":"2024-09-10T23:27:18.124345+0000","last_undegraded":"2024-09-10T23:27:18.124345+0000","last_fullsized":"2024-09-10T23:27:18.124345+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654590+0000","last_change":"2024-09-10T23:27:17.102508+0000","last_active":"2024-09-10T23:27:18.654590+0000","last_peered":"2024-09-10T23:27:18.654590+0000","last_clean":"2024-09-10T23:27:18.654590+0000","last_became_active":"2024-09-10T23:27:17.102219+0000","last_became_peered":"2024-09-10T23:27:17.102219+0000","last_unstale":"2024-09-10T23:27:18.654590+0000","last_undegraded":"2024-09-10T23:27:18.654590+0000","last_fullsized":"2024-09-10T23:27:18.654590+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648863+0000","last_change":"2024-09-10T23:27:16.082194+0000","last_active":"2024-09-10T23:27:18.648863+0000","last_peered":"2024-09-10T23:27:18.648863+0000","last_clean":"2024-09-10T23:27:18.648863+0000","last_became_active":"2024-09-10T23:27:16.081929+0000","last_became_peered":"2024-09-10T23:27:16.081929+0000","last_unstale":"2024-09-10T23:27:18.648863+0000","last_undegraded":"2024-09-10T23:27:18.648863+0000","last_fullsized":"2024-09-10T23:27:18.648863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:01.565180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654640+0000","last_change":"2024-09-10T23:27:17.116874+0000","last_active":"2024-09-10T23:27:18.654640+0000","last_peered":"2024-09-10T23:27:18.654640+0000","last_clean":"2024-09-10T23:27:18.654640+0000","last_became_active":"2024-09-10T23:27:17.116618+0000","last_became_peered":"2024-09-10T23:27:17.116618+0000","last_unstale":"2024-09-10T23:27:18.654640+0000","last_undegraded":"2024-09-10T23:27:18.654640+0000","last_fullsized":"2024-09-10T23:27:18.654640+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124289+0000","last_change":"2024-09-10T23:27:16.097769+0000","last_active":"2024-09-10T23:27:18.124289+0000","last_peered":"2024-09-10T23:27:18.124289+0000","last_clean":"2024-09-10T23:27:18.124289+0000","last_became_active":"2024-09-10T23:27:16.097374+0000","last_became_peered":"2024-09-10T23:27:16.097374+0000","last_unstale":"2024-09-10T23:27:18.124289+0000","last_undegraded":"2024-09-10T23:27:18.124289+0000","last_fullsized":"2024-09-10T23:27:18.124289+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.793154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121765+0000","last_change":"2024-09-10T23:27:17.092162+0000","last_active":"2024-09-10T23:27:18.121765+0000","last_peered":"2024-09-10T23:27:18.121765+0000","last_clean":"2024-09-10T23:27:18.121765+0000","last_became_active":"2024-09-10T23:27:17.091863+0000","last_became_peered":"2024-09-10T23:27:17.091863+0000","last_unstale":"2024-09-10T23:27:18.121765+0000","last_undegraded":"2024-09-10T23:27:18.121765+0000","last_fullsized":"2024-09-10T23:27:18.121765+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.826000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649109+0000","last_change":"2024-09-10T23:27:16.089641+0000","last_active":"2024-09-10T23:27:18.649109+0000","last_peered":"2024-09-10T23:27:18.649109+0000","last_clean":"2024-09-10T23:27:18.649109+0000","last_became_active":"2024-09-10T23:27:16.088701+0000","last_became_peered":"2024-09-10T23:27:16.088701+0000","last_unstale":"2024-09-10T23:27:18.649109+0000","last_undegraded":"2024-09-10T23:27:18.649109+0000","last_fullsized":"2024-09-10T23:27:18.649109+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:45.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649034+0000","last_change":"2024-09-10T23:27:17.115275+0000","last_active":"2024-09-10T23:27:18.649034+0000","last_peered":"2024-09-10T23:27:18.649034+0000","last_clean":"2024-09-10T23:27:18.649034+0000","last_became_active":"2024-09-10T23:27:17.114068+0000","last_became_peered":"2024-09-10T23:27:17.114068+0000","last_unstale":"2024-09-10T23:27:18.649034+0000","last_undegraded":"2024-09-10T23:27:18.649034+0000","last_fullsized":"2024-09-10T23:27:18.649034+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:47.769062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654274+0000","last_change":"2024-09-10T23:27:16.091395+0000","last_active":"2024-09-10T23:27:18.654274+0000","last_peered":"2024-09-10T23:27:18.654274+0000","last_clean":"2024-09-10T23:27:18.654274+0000","last_became_active":"2024-09-10T23:27:16.091136+0000","last_became_peered":"2024-09-10T23:27:16.091136+0000","last_unstale":"2024-09-10T23:27:18.654274+0000","last_undegraded":"2024-09-10T23:27:18.654274+0000","last_fullsized":"2024-09-10T23:27:18.654274+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649010+0000","last_change":"2024-09-10T23:27:17.116302+0000","last_active":"2024-09-10T23:27:18.649010+0000","last_peered":"2024-09-10T23:27:18.649010+0000","last_clean":"2024-09-10T23:27:18.649010+0000","last_became_active":"2024-09-10T23:27:17.115078+0000","last_became_peered":"2024-09-10T23:27:17.115078+0000","last_unstale":"2024-09-10T23:27:18.649010+0000","last_undegraded":"2024-09-10T23:27:18.649010+0000","last_fullsized":"2024-09-10T23:27:18.649010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.266065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088362+0000","last_change":"2024-09-10T23:27:16.093832+0000","last_active":"2024-09-10T23:27:18.088362+0000","last_peered":"2024-09-10T23:27:18.088362+0000","last_clean":"2024-09-10T23:27:18.088362+0000","last_became_active":"2024-09-10T23:27:16.089264+0000","last_became_peered":"2024-09-10T23:27:16.089264+0000","last_unstale":"2024-09-10T23:27:18.088362+0000","last_undegraded":"2024-09-10T23:27:18.088362+0000","last_fullsized":"2024-09-10T23:27:18.088362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:34.365596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655734+0000","last_change":"2024-09-10T23:27:17.113240+0000","last_active":"2024-09-10T23:27:18.655734+0000","last_peered":"2024-09-10T23:27:18.655734+0000","last_clean":"2024-09-10T23:27:18.655734+0000","last_became_active":"2024-09-10T23:27:17.112858+0000","last_became_peered":"2024-09-10T23:27:17.112858+0000","last_unstale":"2024-09-10T23:27:18.655734+0000","last_undegraded":"2024-09-10T23:27:18.655734+0000","last_fullsized":"2024-09-10T23:27:18.655734+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:25.920123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654938+0000","last_change":"2024-09-10T23:27:16.098898+0000","last_active":"2024-09-10T23:27:18.654938+0000","last_peered":"2024-09-10T23:27:18.654938+0000","last_clean":"2024-09-10T23:27:18.654938+0000","last_became_active":"2024-09-10T23:27:16.098612+0000","last_became_peered":"2024-09-10T23:27:16.098612+0000","last_unstale":"2024-09-10T23:27:18.654938+0000","last_undegraded":"2024-09-10T23:27:18.654938+0000","last_fullsized":"2024-09-10T23:27:18.654938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:20.951718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.653946+0000","last_change":"2024-09-10T23:27:17.111049+0000","last_active":"2024-09-10T23:27:18.653946+0000","last_peered":"2024-09-10T23:27:18.653946+0000","last_clean":"2024-09-10T23:27:18.653946+0000","last_became_active":"2024-09-10T23:27:17.110785+0000","last_became_peered":"2024-09-10T23:27:17.110785+0000","last_unstale":"2024-09-10T23:27:18.653946+0000","last_undegraded":"2024-09-10T23:27:18.653946+0000","last_fullsized":"2024-09-10T23:27:18.653946+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649027+0000","last_change":"2024-09-10T23:27:16.084074+0000","last_active":"2024-09-10T23:27:18.649027+0000","last_peered":"2024-09-10T23:27:18.649027+0000","last_clean":"2024-09-10T23:27:18.649027+0000","last_became_active":"2024-09-10T23:27:16.083796+0000","last_became_peered":"2024-09-10T23:27:16.083796+0000","last_unstale":"2024-09-10T23:27:18.649027+0000","last_undegraded":"2024-09-10T23:27:18.649027+0000","last_fullsized":"2024-09-10T23:27:18.649027+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:31.907739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123973+0000","last_change":"2024-09-10T23:27:17.109500+0000","last_active":"2024-09-10T23:27:18.123973+0000","last_peered":"2024-09-10T23:27:18.123973+0000","last_clean":"2024-09-10T23:27:18.123973+0000","last_became_active":"2024-09-10T23:27:17.109163+0000","last_became_peered":"2024-09-10T23:27:17.109163+0000","last_unstale":"2024-09-10T23:27:18.123973+0000","last_undegraded":"2024-09-10T23:27:18.123973+0000","last_fullsized":"2024-09-10T23:27:18.123973+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"166'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123185+0000","last_change":"2024-09-10T23:27:16.099284+0000","last_active":"2024-09-10T23:27:18.123185+0000","last_peered":"2024-09-10T23:27:18.123185+0000","last_clean":"2024-09-10T23:27:18.123185+0000","last_became_active":"2024-09-10T23:27:16.098730+0000","last_became_peered":"2024-09-10T23:27:16.098730+0000","last_unstale":"2024-09-10T23:27:18.123185+0000","last_undegraded":"2024-09-10T23:27:18.123185+0000","last_fullsized":"2024-09-10T23:27:18.123185+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:36.406564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088655+0000","last_change":"2024-09-10T23:27:17.100031+0000","last_active":"2024-09-10T23:27:18.088655+0000","last_peered":"2024-09-10T23:27:18.088655+0000","last_clean":"2024-09-10T23:27:18.088655+0000","last_became_active":"2024-09-10T23:27:17.099753+0000","last_became_peered":"2024-09-10T23:27:17.099753+0000","last_unstale":"2024-09-10T23:27:18.088655+0000","last_undegraded":"2024-09-10T23:27:18.088655+0000","last_fullsized":"2024-09-10T23:27:18.088655+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:00.932972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121568+0000","last_change":"2024-09-10T23:27:16.093939+0000","last_active":"2024-09-10T23:27:18.121568+0000","last_peered":"2024-09-10T23:27:18.121568+0000","last_clean":"2024-09-10T23:27:18.121568+0000","last_became_active":"2024-09-10T23:27:16.093597+0000","last_became_peered":"2024-09-10T23:27:16.093597+0000","last_unstale":"2024-09-10T23:27:18.121568+0000","last_undegraded":"2024-09-10T23:27:18.121568+0000","last_fullsized":"2024-09-10T23:27:18.121568+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:43.549959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124149+0000","last_change":"2024-09-10T23:27:17.107113+0000","last_active":"2024-09-10T23:27:18.124149+0000","last_peered":"2024-09-10T23:27:18.124149+0000","last_clean":"2024-09-10T23:27:18.124149+0000","last_became_active":"2024-09-10T23:27:17.106859+0000","last_became_peered":"2024-09-10T23:27:17.106859+0000","last_unstale":"2024-09-10T23:27:18.124149+0000","last_undegraded":"2024-09-10T23:27:18.124149+0000","last_fullsized":"2024-09-10T23:27:18.124149+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088636+0000","last_change":"2024-09-10T23:27:16.100147+0000","last_active":"2024-09-10T23:27:18.088636+0000","last_peered":"2024-09-10T23:27:18.088636+0000","last_clean":"2024-09-10T23:27:18.088636+0000","last_became_active":"2024-09-10T23:27:16.099691+0000","last_became_peered":"2024-09-10T23:27:16.099691+0000","last_unstale":"2024-09-10T23:27:18.088636+0000","last_undegraded":"2024-09-10T23:27:18.088636+0000","last_fullsized":"2024-09-10T23:27:18.088636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:54.133674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094649+0000","last_change":"2024-09-10T23:27:17.119298+0000","last_active":"2024-09-10T23:27:18.094649+0000","last_peered":"2024-09-10T23:27:18.094649+0000","last_clean":"2024-09-10T23:27:18.094649+0000","last_became_active":"2024-09-10T23:27:17.118918+0000","last_became_peered":"2024-09-10T23:27:17.118918+0000","last_unstale":"2024-09-10T23:27:18.094649+0000","last_undegraded":"2024-09-10T23:27:18.094649+0000","last_fullsized":"2024-09-10T23:27:18.094649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:55.884595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094384+0000","last_change":"2024-09-10T23:27:16.090393+0000","last_active":"2024-09-10T23:27:18.094384+0000","last_peered":"2024-09-10T23:27:18.094384+0000","last_clean":"2024-09-10T23:27:18.094384+0000","last_became_active":"2024-09-10T23:27:16.090138+0000","last_became_peered":"2024-09-10T23:27:16.090138+0000","last_unstale":"2024-09-10T23:27:18.094384+0000","last_undegraded":"2024-09-10T23:27:18.094384+0000","last_fullsized":"2024-09-10T23:27:18.094384+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:12.975929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655516+0000","last_change":"2024-09-10T23:27:17.110962+0000","last_active":"2024-09-10T23:27:18.655516+0000","last_peered":"2024-09-10T23:27:18.655516+0000","last_clean":"2024-09-10T23:27:18.655516+0000","last_became_active":"2024-09-10T23:27:17.110669+0000","last_became_peered":"2024-09-10T23:27:17.110669+0000","last_unstale":"2024-09-10T23:27:18.655516+0000","last_undegraded":"2024-09-10T23:27:18.655516+0000","last_fullsized":"2024-09-10T23:27:18.655516+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:46.498405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121402+0000","last_change":"2024-09-10T23:27:16.089373+0000","last_active":"2024-09-10T23:27:18.121402+0000","last_peered":"2024-09-10T23:27:18.121402+0000","last_clean":"2024-09-10T23:27:18.121402+0000","last_became_active":"2024-09-10T23:27:16.089120+0000","last_became_peered":"2024-09-10T23:27:16.089120+0000","last_unstale":"2024-09-10T23:27:18.121402+0000","last_undegraded":"2024-09-10T23:27:18.121402+0000","last_fullsized":"2024-09-10T23:27:18.121402+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:19.387603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121663+0000","last_change":"2024-09-10T23:27:17.094316+0000","last_active":"2024-09-10T23:27:18.121663+0000","last_peered":"2024-09-10T23:27:18.121663+0000","last_clean":"2024-09-10T23:27:18.121663+0000","last_became_active":"2024-09-10T23:27:17.094021+0000","last_became_peered":"2024-09-10T23:27:17.094021+0000","last_unstale":"2024-09-10T23:27:18.121663+0000","last_undegraded":"2024-09-10T23:27:18.121663+0000","last_fullsized":"2024-09-10T23:27:18.121663+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:15.902576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654294+0000","last_change":"2024-09-10T23:27:16.096182+0000","last_active":"2024-09-10T23:27:18.654294+0000","last_peered":"2024-09-10T23:27:18.654294+0000","last_clean":"2024-09-10T23:27:18.654294+0000","last_became_active":"2024-09-10T23:27:16.094386+0000","last_became_peered":"2024-09-10T23:27:16.094386+0000","last_unstale":"2024-09-10T23:27:18.654294+0000","last_undegraded":"2024-09-10T23:27:18.654294+0000","last_fullsized":"2024-09-10T23:27:18.654294+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.903208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088687+0000","last_change":"2024-09-10T23:27:17.116139+0000","last_active":"2024-09-10T23:27:18.088687+0000","last_peered":"2024-09-10T23:27:18.088687+0000","last_clean":"2024-09-10T23:27:18.088687+0000","last_became_active":"2024-09-10T23:27:17.115852+0000","last_became_peered":"2024-09-10T23:27:17.115852+0000","last_unstale":"2024-09-10T23:27:18.088687+0000","last_undegraded":"2024-09-10T23:27:18.088687+0000","last_fullsized":"2024-09-10T23:27:18.088687+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:54.432594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648362+0000","last_change":"2024-09-10T23:27:16.093853+0000","last_active":"2024-09-10T23:27:18.648362+0000","last_peered":"2024-09-10T23:27:18.648362+0000","last_clean":"2024-09-10T23:27:18.648362+0000","last_became_active":"2024-09-10T23:27:16.093586+0000","last_became_peered":"2024-09-10T23:27:16.093586+0000","last_unstale":"2024-09-10T23:27:18.648362+0000","last_undegraded":"2024-09-10T23:27:18.648362+0000","last_fullsized":"2024-09-10T23:27:18.648362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:03.023982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654467+0000","last_change":"2024-09-10T23:27:17.114770+0000","last_active":"2024-09-10T23:27:18.654467+0000","last_peered":"2024-09-10T23:27:18.654467+0000","last_clean":"2024-09-10T23:27:18.654467+0000","last_became_active":"2024-09-10T23:27:17.112895+0000","last_became_peered":"2024-09-10T23:27:17.112895+0000","last_unstale":"2024-09-10T23:27:18.654467+0000","last_undegraded":"2024-09-10T23:27:18.654467+0000","last_fullsized":"2024-09-10T23:27:18.654467+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:05.711658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121640+0000","last_change":"2024-09-10T23:27:16.099331+0000","last_active":"2024-09-10T23:27:18.121640+0000","last_peered":"2024-09-10T23:27:18.121640+0000","last_clean":"2024-09-10T23:27:18.121640+0000","last_became_active":"2024-09-10T23:27:16.099068+0000","last_became_peered":"2024-09-10T23:27:16.099068+0000","last_unstale":"2024-09-10T23:27:18.121640+0000","last_undegraded":"2024-09-10T23:27:18.121640+0000","last_fullsized":"2024-09-10T23:27:18.121640+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:23.742338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":370,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655059+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:27:18.655059+0000","last_peered":"2024-09-10T23:27:18.655059+0000","last_clean":"2024-09-10T23:27:18.655059+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:27:18.655059+0000","last_undegraded":"2024-09-10T23:27:18.655059+0000","last_fullsized":"2024-09-10T23:27:18.655059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476882,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69248,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302592,"statfs":{"total":96636764160,"available":96565854208,"internally_reserved":0,"allocated":2076672,"data_stored":976228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509587,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69832,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302008,"statfs":{"total":96636764160,"available":96565256192,"internally_reserved":0,"allocated":2670592,"data_stored":1566596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2084864,"data_stored":976352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69328,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302512,"statfs":{"total":96636764160,"available":96565772288,"internally_reserved":0,"allocated":2093056,"data_stored":976992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509586,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69312,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302528,"statfs":{"total":96636764160,"available":96565788672,"internally_reserved":0,"allocated":2076672,"data_stored":976228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509587,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2088960,"data_stored":977840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509586,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74060,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297780,"statfs":{"total":96636764160,"available":96560926720,"internally_reserved":0,"allocated":2678784,"data_stored":1566700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2097152,"data_stored":978444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:27:25.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:27:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 -- 172.21.15.17:0/1147184817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95900b3870 msgr2=0x7f95900cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 --2- 172.21.15.17:0/1147184817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95900b3870 0x7f95900cff20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9578009840 tx=0x7f957801c760 comp rx=0 tx=0).stop 2024-09-10T23:27:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 -- 172.21.15.17:0/1147184817 shutdown_connections 2024-09-10T23:27:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 --2- 172.21.15.17:0/1147184817 >> v2:172.21.15.77:3300/0 conn(0x7f9590074740 0x7f95900d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 --2- 172.21.15.17:0/1147184817 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95900b3870 0x7f95900cff20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 -- 172.21.15.17:0/1147184817 >> 172.21.15.17:0/1147184817 conn(0x7f959006cfc0 msgr2=0x7f959006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 -- 172.21.15.17:0/1147184817 shutdown_connections 2024-09-10T23:27:26.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 -- 172.21.15.17:0/1147184817 wait complete. 2024-09-10T23:27:26.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 Processor -- start 2024-09-10T23:27:26.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 -- start start 2024-09-10T23:27:26.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9590074740 0x7f9590143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95900b3870 0x7f959014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95901550b0 0x7f959014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9590167860 con 0x7f95900b3870 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f959015cfe0 con 0x7f95901550b0 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9595800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f95901679e0 con 0x7f9590074740 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9587e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95900b3870 0x7f959014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9587e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95900b3870 0x7f959014f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35122/0 (socket says 172.21.15.17:35122) 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9587e00640 1 -- 172.21.15.17:0/1638028255 learned_addr learned my addr 172.21.15.17:0/1638028255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f958f400640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95901550b0 0x7f959014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f958ea00640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9590074740 0x7f9590143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9587e00640 1 -- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9590074740 msgr2=0x7f9590143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9587e00640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9590074740 0x7f9590143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9587e00640 1 -- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95901550b0 msgr2=0x7f959014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9587e00640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95901550b0 0x7f959014fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.037+0000 7f9587e00640 1 -- 172.21.15.17:0/1638028255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959006e7f0 con 0x7f95900b3870 2024-09-10T23:27:26.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9587e00640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95900b3870 0x7f959014f510 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f9578009790 tx=0x7f95780a5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:26.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9586a00640 1 -- 172.21.15.17:0/1638028255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95780bc070 con 0x7f95900b3870 2024-09-10T23:27:26.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9586a00640 1 -- 172.21.15.17:0/1638028255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95780043f0 con 0x7f95900b3870 2024-09-10T23:27:26.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959006ea90 con 0x7f95900b3870 2024-09-10T23:27:26.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9586a00640 1 -- 172.21.15.17:0/1638028255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95780b2040 con 0x7f95900b3870 2024-09-10T23:27:26.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959006f050 con 0x7f95900b3870 2024-09-10T23:27:26.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95900b3e10 con 0x7f95900b3870 2024-09-10T23:27:26.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9586a00640 1 -- 172.21.15.17:0/1638028255 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f95780b5070 con 0x7f95900b3870 2024-09-10T23:27:26.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9586a00640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f956c0725e0 0x7f956c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f9586a00640 1 -- 172.21.15.17:0/1638028255 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f957812cb80 con 0x7f95900b3870 2024-09-10T23:27:26.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.041+0000 7f958ea00640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f956c0725e0 0x7f956c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.045+0000 7f958ea00640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f956c0725e0 0x7f956c074aa0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9580007fd0 tx=0x7f9580009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:26.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.045+0000 7f9586a00640 1 -- 172.21.15.17:0/1638028255 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9578016410 con 0x7f95900b3870 2024-09-10T23:27:26.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.217+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9590143c40 con 0x7f956c0725e0 2024-09-10T23:27:26.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.225+0000 7f9586a00640 1 -- 172.21.15.17:0/1638028255 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252457 (secure 0 0 0) 0x7f9590143c40 con 0x7f956c0725e0 2024-09-10T23:27:26.231 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:26.232 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:27:26.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f956c0725e0 msgr2=0x7f956c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f956c0725e0 0x7f956c074aa0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9580007fd0 tx=0x7f9580009040 comp rx=0 tx=0).stop 2024-09-10T23:27:26.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95900b3870 msgr2=0x7f959014f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95900b3870 0x7f959014f510 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f9578009790 tx=0x7f95780a5f90 comp rx=0 tx=0).stop 2024-09-10T23:27:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 shutdown_connections 2024-09-10T23:27:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f956c0725e0 0x7f956c074aa0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95901550b0 0x7f959014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95900b3870 0x7f959014f510 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 --2- 172.21.15.17:0/1638028255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9590074740 0x7f9590143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 >> 172.21.15.17:0/1638028255 conn(0x7f959006cfc0 msgr2=0x7f959015b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 shutdown_connections 2024-09-10T23:27:26.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.229+0000 7f9595800640 1 -- 172.21.15.17:0/1638028255 wait complete. 2024-09-10T23:27:26.252 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2024-09-10T23:27:24.463631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":522268,"kb_used_data":17448,"kb_used_omap":12,"kb_used_meta":504627,"kb_avail":754452452,"statfs":{"total":773094113280,"available":772559310848,"internally_reserved":0,"allocated":17866752,"data_stored":8995380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":516738609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001845"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095075+0000","last_change":"2024-09-10T23:27:17.106584+0000","last_active":"2024-09-10T23:27:18.095075+0000","last_peered":"2024-09-10T23:27:18.095075+0000","last_clean":"2024-09-10T23:27:18.095075+0000","last_became_active":"2024-09-10T23:27:17.106315+0000","last_became_peered":"2024-09-10T23:27:17.106315+0000","last_unstale":"2024-09-10T23:27:18.095075+0000","last_undegraded":"2024-09-10T23:27:18.095075+0000","last_fullsized":"2024-09-10T23:27:18.095075+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:54.902790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655807+0000","last_change":"2024-09-10T23:27:17.115113+0000","last_active":"2024-09-10T23:27:18.655807+0000","last_peered":"2024-09-10T23:27:18.655807+0000","last_clean":"2024-09-10T23:27:18.655807+0000","last_became_active":"2024-09-10T23:27:17.114341+0000","last_became_peered":"2024-09-10T23:27:17.114341+0000","last_unstale":"2024-09-10T23:27:18.655807+0000","last_undegraded":"2024-09-10T23:27:18.655807+0000","last_fullsized":"2024-09-10T23:27:18.655807+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:05:20.113939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094285+0000","last_change":"2024-09-10T23:27:17.101230+0000","last_active":"2024-09-10T23:27:18.094285+0000","last_peered":"2024-09-10T23:27:18.094285+0000","last_clean":"2024-09-10T23:27:18.094285+0000","last_became_active":"2024-09-10T23:27:17.100946+0000","last_became_peered":"2024-09-10T23:27:17.100946+0000","last_unstale":"2024-09-10T23:27:18.094285+0000","last_undegraded":"2024-09-10T23:27:18.094285+0000","last_fullsized":"2024-09-10T23:27:18.094285+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:32:20.365134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094578+0000","last_change":"2024-09-10T23:27:17.105978+0000","last_active":"2024-09-10T23:27:18.094578+0000","last_peered":"2024-09-10T23:27:18.094578+0000","last_clean":"2024-09-10T23:27:18.094578+0000","last_became_active":"2024-09-10T23:27:17.105502+0000","last_became_peered":"2024-09-10T23:27:17.105502+0000","last_unstale":"2024-09-10T23:27:18.094578+0000","last_undegraded":"2024-09-10T23:27:18.094578+0000","last_fullsized":"2024-09-10T23:27:18.094578+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:50:04.674325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649044+0000","last_change":"2024-09-10T23:27:17.108926+0000","last_active":"2024-09-10T23:27:18.649044+0000","last_peered":"2024-09-10T23:27:18.649044+0000","last_clean":"2024-09-10T23:27:18.649044+0000","last_became_active":"2024-09-10T23:27:17.108589+0000","last_became_peered":"2024-09-10T23:27:17.108589+0000","last_unstale":"2024-09-10T23:27:18.649044+0000","last_undegraded":"2024-09-10T23:27:18.649044+0000","last_fullsized":"2024-09-10T23:27:18.649044+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:17:47.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654886+0000","last_change":"2024-09-10T23:27:17.114012+0000","last_active":"2024-09-10T23:27:18.654886+0000","last_peered":"2024-09-10T23:27:18.654886+0000","last_clean":"2024-09-10T23:27:18.654886+0000","last_became_active":"2024-09-10T23:27:17.111391+0000","last_became_peered":"2024-09-10T23:27:17.111391+0000","last_unstale":"2024-09-10T23:27:18.654886+0000","last_undegraded":"2024-09-10T23:27:18.654886+0000","last_fullsized":"2024-09-10T23:27:18.654886+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:33.637514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123961+0000","last_change":"2024-09-10T23:27:17.104858+0000","last_active":"2024-09-10T23:27:18.123961+0000","last_peered":"2024-09-10T23:27:18.123961+0000","last_clean":"2024-09-10T23:27:18.123961+0000","last_became_active":"2024-09-10T23:27:17.104575+0000","last_became_peered":"2024-09-10T23:27:17.104575+0000","last_unstale":"2024-09-10T23:27:18.123961+0000","last_undegraded":"2024-09-10T23:27:18.123961+0000","last_fullsized":"2024-09-10T23:27:18.123961+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123806+0000","last_change":"2024-09-10T23:27:17.110407+0000","last_active":"2024-09-10T23:27:18.123806+0000","last_peered":"2024-09-10T23:27:18.123806+0000","last_clean":"2024-09-10T23:27:18.123806+0000","last_became_active":"2024-09-10T23:27:17.110090+0000","last_became_peered":"2024-09-10T23:27:17.110090+0000","last_unstale":"2024-09-10T23:27:18.123806+0000","last_undegraded":"2024-09-10T23:27:18.123806+0000","last_fullsized":"2024-09-10T23:27:18.123806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:53:55.534473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124433+0000","last_change":"2024-09-10T23:27:17.110221+0000","last_active":"2024-09-10T23:27:18.124433+0000","last_peered":"2024-09-10T23:27:18.124433+0000","last_clean":"2024-09-10T23:27:18.124433+0000","last_became_active":"2024-09-10T23:27:17.109916+0000","last_became_peered":"2024-09-10T23:27:17.109916+0000","last_unstale":"2024-09-10T23:27:18.124433+0000","last_undegraded":"2024-09-10T23:27:18.124433+0000","last_fullsized":"2024-09-10T23:27:18.124433+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124429+0000","last_change":"2024-09-10T23:27:17.103184+0000","last_active":"2024-09-10T23:27:18.124429+0000","last_peered":"2024-09-10T23:27:18.124429+0000","last_clean":"2024-09-10T23:27:18.124429+0000","last_became_active":"2024-09-10T23:27:17.102108+0000","last_became_peered":"2024-09-10T23:27:17.102108+0000","last_unstale":"2024-09-10T23:27:18.124429+0000","last_undegraded":"2024-09-10T23:27:18.124429+0000","last_fullsized":"2024-09-10T23:27:18.124429+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655402+0000","last_change":"2024-09-10T23:27:17.120609+0000","last_active":"2024-09-10T23:27:18.655402+0000","last_peered":"2024-09-10T23:27:18.655402+0000","last_clean":"2024-09-10T23:27:18.655402+0000","last_became_active":"2024-09-10T23:27:17.120402+0000","last_became_peered":"2024-09-10T23:27:17.120402+0000","last_unstale":"2024-09-10T23:27:18.655402+0000","last_undegraded":"2024-09-10T23:27:18.655402+0000","last_fullsized":"2024-09-10T23:27:18.655402+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:58.328456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655563+0000","last_change":"2024-09-10T23:27:17.113454+0000","last_active":"2024-09-10T23:27:18.655563+0000","last_peered":"2024-09-10T23:27:18.655563+0000","last_clean":"2024-09-10T23:27:18.655563+0000","last_became_active":"2024-09-10T23:27:17.113102+0000","last_became_peered":"2024-09-10T23:27:17.113102+0000","last_unstale":"2024-09-10T23:27:18.655563+0000","last_undegraded":"2024-09-10T23:27:18.655563+0000","last_fullsized":"2024-09-10T23:27:18.655563+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:24.438181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121506+0000","last_change":"2024-09-10T23:27:17.104651+0000","last_active":"2024-09-10T23:27:18.121506+0000","last_peered":"2024-09-10T23:27:18.121506+0000","last_clean":"2024-09-10T23:27:18.121506+0000","last_became_active":"2024-09-10T23:27:17.104356+0000","last_became_peered":"2024-09-10T23:27:17.104356+0000","last_unstale":"2024-09-10T23:27:18.121506+0000","last_undegraded":"2024-09-10T23:27:18.121506+0000","last_fullsized":"2024-09-10T23:27:18.121506+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:31.195103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648806+0000","last_change":"2024-09-10T23:27:17.112364+0000","last_active":"2024-09-10T23:27:18.648806+0000","last_peered":"2024-09-10T23:27:18.648806+0000","last_clean":"2024-09-10T23:27:18.648806+0000","last_became_active":"2024-09-10T23:27:17.110862+0000","last_became_peered":"2024-09-10T23:27:17.110862+0000","last_unstale":"2024-09-10T23:27:18.648806+0000","last_undegraded":"2024-09-10T23:27:18.648806+0000","last_fullsized":"2024-09-10T23:27:18.648806+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:37.706200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654100+0000","last_change":"2024-09-10T23:27:17.115869+0000","last_active":"2024-09-10T23:27:18.654100+0000","last_peered":"2024-09-10T23:27:18.654100+0000","last_clean":"2024-09-10T23:27:18.654100+0000","last_became_active":"2024-09-10T23:27:17.115594+0000","last_became_peered":"2024-09-10T23:27:17.115594+0000","last_unstale":"2024-09-10T23:27:18.654100+0000","last_undegraded":"2024-09-10T23:27:18.654100+0000","last_fullsized":"2024-09-10T23:27:18.654100+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:51.741476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094113+0000","last_change":"2024-09-10T23:27:17.105827+0000","last_active":"2024-09-10T23:27:18.094113+0000","last_peered":"2024-09-10T23:27:18.094113+0000","last_clean":"2024-09-10T23:27:18.094113+0000","last_became_active":"2024-09-10T23:27:17.105514+0000","last_became_peered":"2024-09-10T23:27:17.105514+0000","last_unstale":"2024-09-10T23:27:18.094113+0000","last_undegraded":"2024-09-10T23:27:18.094113+0000","last_fullsized":"2024-09-10T23:27:18.094113+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:58:41.256305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124559+0000","last_change":"2024-09-10T23:27:17.103100+0000","last_active":"2024-09-10T23:27:18.124559+0000","last_peered":"2024-09-10T23:27:18.124559+0000","last_clean":"2024-09-10T23:27:18.124559+0000","last_became_active":"2024-09-10T23:27:17.101922+0000","last_became_peered":"2024-09-10T23:27:17.101922+0000","last_unstale":"2024-09-10T23:27:18.124559+0000","last_undegraded":"2024-09-10T23:27:18.124559+0000","last_fullsized":"2024-09-10T23:27:18.124559+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:21.276448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654474+0000","last_change":"2024-09-10T23:27:17.114876+0000","last_active":"2024-09-10T23:27:18.654474+0000","last_peered":"2024-09-10T23:27:18.654474+0000","last_clean":"2024-09-10T23:27:18.654474+0000","last_became_active":"2024-09-10T23:27:17.114350+0000","last_became_peered":"2024-09-10T23:27:17.114350+0000","last_unstale":"2024-09-10T23:27:18.654474+0000","last_undegraded":"2024-09-10T23:27:18.654474+0000","last_fullsized":"2024-09-10T23:27:18.654474+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:47.677311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654548+0000","last_change":"2024-09-10T23:27:17.115816+0000","last_active":"2024-09-10T23:27:18.654548+0000","last_peered":"2024-09-10T23:27:18.654548+0000","last_clean":"2024-09-10T23:27:18.654548+0000","last_became_active":"2024-09-10T23:27:17.115530+0000","last_became_peered":"2024-09-10T23:27:17.115530+0000","last_unstale":"2024-09-10T23:27:18.654548+0000","last_undegraded":"2024-09-10T23:27:18.654548+0000","last_fullsized":"2024-09-10T23:27:18.654548+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088360+0000","last_change":"2024-09-10T23:27:17.115834+0000","last_active":"2024-09-10T23:27:18.088360+0000","last_peered":"2024-09-10T23:27:18.088360+0000","last_clean":"2024-09-10T23:27:18.088360+0000","last_became_active":"2024-09-10T23:27:17.115548+0000","last_became_peered":"2024-09-10T23:27:17.115548+0000","last_unstale":"2024-09-10T23:27:18.088360+0000","last_undegraded":"2024-09-10T23:27:18.088360+0000","last_fullsized":"2024-09-10T23:27:18.088360+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:37:55.699175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121835+0000","last_change":"2024-09-10T23:27:17.093723+0000","last_active":"2024-09-10T23:27:18.121835+0000","last_peered":"2024-09-10T23:27:18.121835+0000","last_clean":"2024-09-10T23:27:18.121835+0000","last_became_active":"2024-09-10T23:27:17.093438+0000","last_became_peered":"2024-09-10T23:27:17.093438+0000","last_unstale":"2024-09-10T23:27:18.121835+0000","last_undegraded":"2024-09-10T23:27:18.121835+0000","last_fullsized":"2024-09-10T23:27:18.121835+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:09.201890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655133+0000","last_change":"2024-09-10T23:27:17.121543+0000","last_active":"2024-09-10T23:27:18.655133+0000","last_peered":"2024-09-10T23:27:18.655133+0000","last_clean":"2024-09-10T23:27:18.655133+0000","last_became_active":"2024-09-10T23:27:17.121249+0000","last_became_peered":"2024-09-10T23:27:17.121249+0000","last_unstale":"2024-09-10T23:27:18.655133+0000","last_undegraded":"2024-09-10T23:27:18.655133+0000","last_fullsized":"2024-09-10T23:27:18.655133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:37.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648649+0000","last_change":"2024-09-10T23:27:17.107888+0000","last_active":"2024-09-10T23:27:18.648649+0000","last_peered":"2024-09-10T23:27:18.648649+0000","last_clean":"2024-09-10T23:27:18.648649+0000","last_became_active":"2024-09-10T23:27:17.107606+0000","last_became_peered":"2024-09-10T23:27:17.107606+0000","last_unstale":"2024-09-10T23:27:18.648649+0000","last_undegraded":"2024-09-10T23:27:18.648649+0000","last_fullsized":"2024-09-10T23:27:18.648649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:35.414834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094571+0000","last_change":"2024-09-10T23:27:17.096587+0000","last_active":"2024-09-10T23:27:18.094571+0000","last_peered":"2024-09-10T23:27:18.094571+0000","last_clean":"2024-09-10T23:27:18.094571+0000","last_became_active":"2024-09-10T23:27:17.096284+0000","last_became_peered":"2024-09-10T23:27:17.096284+0000","last_unstale":"2024-09-10T23:27:18.094571+0000","last_undegraded":"2024-09-10T23:27:18.094571+0000","last_fullsized":"2024-09-10T23:27:18.094571+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:37.468206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122133+0000","last_change":"2024-09-10T23:27:17.102475+0000","last_active":"2024-09-10T23:27:18.122133+0000","last_peered":"2024-09-10T23:27:18.122133+0000","last_clean":"2024-09-10T23:27:18.122133+0000","last_became_active":"2024-09-10T23:27:17.102152+0000","last_became_peered":"2024-09-10T23:27:17.102152+0000","last_unstale":"2024-09-10T23:27:18.122133+0000","last_undegraded":"2024-09-10T23:27:18.122133+0000","last_fullsized":"2024-09-10T23:27:18.122133+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:36.895870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088313+0000","last_change":"2024-09-10T23:27:17.101777+0000","last_active":"2024-09-10T23:27:18.088313+0000","last_peered":"2024-09-10T23:27:18.088313+0000","last_clean":"2024-09-10T23:27:18.088313+0000","last_became_active":"2024-09-10T23:27:17.101450+0000","last_became_peered":"2024-09-10T23:27:17.101450+0000","last_unstale":"2024-09-10T23:27:18.088313+0000","last_undegraded":"2024-09-10T23:27:18.088313+0000","last_fullsized":"2024-09-10T23:27:18.088313+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:36.442601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655290+0000","last_change":"2024-09-10T23:27:17.121509+0000","last_active":"2024-09-10T23:27:18.655290+0000","last_peered":"2024-09-10T23:27:18.655290+0000","last_clean":"2024-09-10T23:27:18.655290+0000","last_became_active":"2024-09-10T23:27:17.121230+0000","last_became_peered":"2024-09-10T23:27:17.121230+0000","last_unstale":"2024-09-10T23:27:18.655290+0000","last_undegraded":"2024-09-10T23:27:18.655290+0000","last_fullsized":"2024-09-10T23:27:18.655290+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:02.572094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121637+0000","last_change":"2024-09-10T23:27:17.092322+0000","last_active":"2024-09-10T23:27:18.121637+0000","last_peered":"2024-09-10T23:27:18.121637+0000","last_clean":"2024-09-10T23:27:18.121637+0000","last_became_active":"2024-09-10T23:27:17.092042+0000","last_became_peered":"2024-09-10T23:27:17.092042+0000","last_unstale":"2024-09-10T23:27:18.121637+0000","last_undegraded":"2024-09-10T23:27:18.121637+0000","last_fullsized":"2024-09-10T23:27:18.121637+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:12.311349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654704+0000","last_change":"2024-09-10T23:27:17.115783+0000","last_active":"2024-09-10T23:27:18.654704+0000","last_peered":"2024-09-10T23:27:18.654704+0000","last_clean":"2024-09-10T23:27:18.654704+0000","last_became_active":"2024-09-10T23:27:17.115009+0000","last_became_peered":"2024-09-10T23:27:17.115009+0000","last_unstale":"2024-09-10T23:27:18.654704+0000","last_undegraded":"2024-09-10T23:27:18.654704+0000","last_fullsized":"2024-09-10T23:27:18.654704+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:15.385185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655239+0000","last_change":"2024-09-10T23:27:17.121603+0000","last_active":"2024-09-10T23:27:18.655239+0000","last_peered":"2024-09-10T23:27:18.655239+0000","last_clean":"2024-09-10T23:27:18.655239+0000","last_became_active":"2024-09-10T23:27:17.121229+0000","last_became_peered":"2024-09-10T23:27:17.121229+0000","last_unstale":"2024-09-10T23:27:18.655239+0000","last_undegraded":"2024-09-10T23:27:18.655239+0000","last_fullsized":"2024-09-10T23:27:18.655239+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:14.789550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654122+0000","last_change":"2024-09-10T23:27:17.111758+0000","last_active":"2024-09-10T23:27:18.654122+0000","last_peered":"2024-09-10T23:27:18.654122+0000","last_clean":"2024-09-10T23:27:18.654122+0000","last_became_active":"2024-09-10T23:27:17.111409+0000","last_became_peered":"2024-09-10T23:27:17.111409+0000","last_unstale":"2024-09-10T23:27:18.654122+0000","last_undegraded":"2024-09-10T23:27:18.654122+0000","last_fullsized":"2024-09-10T23:27:18.654122+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.653950+0000","last_change":"2024-09-10T23:27:17.117296+0000","last_active":"2024-09-10T23:27:18.653950+0000","last_peered":"2024-09-10T23:27:18.653950+0000","last_clean":"2024-09-10T23:27:18.653950+0000","last_became_active":"2024-09-10T23:27:17.117034+0000","last_became_peered":"2024-09-10T23:27:17.117034+0000","last_unstale":"2024-09-10T23:27:18.653950+0000","last_undegraded":"2024-09-10T23:27:18.653950+0000","last_fullsized":"2024-09-10T23:27:18.653950+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:50.912615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654870+0000","last_change":"2024-09-10T23:27:17.112841+0000","last_active":"2024-09-10T23:27:18.654870+0000","last_peered":"2024-09-10T23:27:18.654870+0000","last_clean":"2024-09-10T23:27:18.654870+0000","last_became_active":"2024-09-10T23:27:17.112210+0000","last_became_peered":"2024-09-10T23:27:17.112210+0000","last_unstale":"2024-09-10T23:27:18.654870+0000","last_undegraded":"2024-09-10T23:27:18.654870+0000","last_fullsized":"2024-09-10T23:27:18.654870+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:32.914654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"165'4","reported_seq":19,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095147+0000","last_change":"2024-09-10T23:27:16.086889+0000","last_active":"2024-09-10T23:27:18.095147+0000","last_peered":"2024-09-10T23:27:18.095147+0000","last_clean":"2024-09-10T23:27:18.095147+0000","last_became_active":"2024-09-10T23:27:16.086511+0000","last_became_peered":"2024-09-10T23:27:16.086511+0000","last_unstale":"2024-09-10T23:27:18.095147+0000","last_undegraded":"2024-09-10T23:27:18.095147+0000","last_fullsized":"2024-09-10T23:27:18.095147+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:49.905701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121836+0000","last_change":"2024-09-10T23:27:17.107022+0000","last_active":"2024-09-10T23:27:18.121836+0000","last_peered":"2024-09-10T23:27:18.121836+0000","last_clean":"2024-09-10T23:27:18.121836+0000","last_became_active":"2024-09-10T23:27:17.106736+0000","last_became_peered":"2024-09-10T23:27:17.106736+0000","last_unstale":"2024-09-10T23:27:18.121836+0000","last_undegraded":"2024-09-10T23:27:18.121836+0000","last_fullsized":"2024-09-10T23:27:18.121836+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:12.419867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648898+0000","last_change":"2024-09-10T23:27:16.096542+0000","last_active":"2024-09-10T23:27:18.648898+0000","last_peered":"2024-09-10T23:27:18.648898+0000","last_clean":"2024-09-10T23:27:18.648898+0000","last_became_active":"2024-09-10T23:27:16.096251+0000","last_became_peered":"2024-09-10T23:27:16.096251+0000","last_unstale":"2024-09-10T23:27:18.648898+0000","last_undegraded":"2024-09-10T23:27:18.648898+0000","last_fullsized":"2024-09-10T23:27:18.648898+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:57:58.411262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648867+0000","last_change":"2024-09-10T23:27:17.115424+0000","last_active":"2024-09-10T23:27:18.648867+0000","last_peered":"2024-09-10T23:27:18.648867+0000","last_clean":"2024-09-10T23:27:18.648867+0000","last_became_active":"2024-09-10T23:27:17.110909+0000","last_became_peered":"2024-09-10T23:27:17.110909+0000","last_unstale":"2024-09-10T23:27:18.648867+0000","last_undegraded":"2024-09-10T23:27:18.648867+0000","last_fullsized":"2024-09-10T23:27:18.648867+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:34.523204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654701+0000","last_change":"2024-09-10T23:27:16.089236+0000","last_active":"2024-09-10T23:27:18.654701+0000","last_peered":"2024-09-10T23:27:18.654701+0000","last_clean":"2024-09-10T23:27:18.654701+0000","last_became_active":"2024-09-10T23:27:16.088941+0000","last_became_peered":"2024-09-10T23:27:16.088941+0000","last_unstale":"2024-09-10T23:27:18.654701+0000","last_undegraded":"2024-09-10T23:27:18.654701+0000","last_fullsized":"2024-09-10T23:27:18.654701+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:07.677234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654951+0000","last_change":"2024-09-10T23:27:17.110922+0000","last_active":"2024-09-10T23:27:18.654951+0000","last_peered":"2024-09-10T23:27:18.654951+0000","last_clean":"2024-09-10T23:27:18.654951+0000","last_became_active":"2024-09-10T23:27:17.110608+0000","last_became_peered":"2024-09-10T23:27:17.110608+0000","last_unstale":"2024-09-10T23:27:18.654951+0000","last_undegraded":"2024-09-10T23:27:18.654951+0000","last_fullsized":"2024-09-10T23:27:18.654951+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:58.856996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088437+0000","last_change":"2024-09-10T23:27:16.094988+0000","last_active":"2024-09-10T23:27:18.088437+0000","last_peered":"2024-09-10T23:27:18.088437+0000","last_clean":"2024-09-10T23:27:18.088437+0000","last_became_active":"2024-09-10T23:27:16.089019+0000","last_became_peered":"2024-09-10T23:27:16.089019+0000","last_unstale":"2024-09-10T23:27:18.088437+0000","last_undegraded":"2024-09-10T23:27:18.088437+0000","last_fullsized":"2024-09-10T23:27:18.088437+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:20.281854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124284+0000","last_change":"2024-09-10T23:27:17.105543+0000","last_active":"2024-09-10T23:27:18.124284+0000","last_peered":"2024-09-10T23:27:18.124284+0000","last_clean":"2024-09-10T23:27:18.124284+0000","last_became_active":"2024-09-10T23:27:17.105257+0000","last_became_peered":"2024-09-10T23:27:17.105257+0000","last_unstale":"2024-09-10T23:27:18.124284+0000","last_undegraded":"2024-09-10T23:27:18.124284+0000","last_fullsized":"2024-09-10T23:27:18.124284+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123894+0000","last_change":"2024-09-10T23:27:16.098401+0000","last_active":"2024-09-10T23:27:18.123894+0000","last_peered":"2024-09-10T23:27:18.123894+0000","last_clean":"2024-09-10T23:27:18.123894+0000","last_became_active":"2024-09-10T23:27:16.098145+0000","last_became_peered":"2024-09-10T23:27:16.098145+0000","last_unstale":"2024-09-10T23:27:18.123894+0000","last_undegraded":"2024-09-10T23:27:18.123894+0000","last_fullsized":"2024-09-10T23:27:18.123894+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:36.117554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088367+0000","last_change":"2024-09-10T23:27:17.101986+0000","last_active":"2024-09-10T23:27:18.088367+0000","last_peered":"2024-09-10T23:27:18.088367+0000","last_clean":"2024-09-10T23:27:18.088367+0000","last_became_active":"2024-09-10T23:27:17.101415+0000","last_became_peered":"2024-09-10T23:27:17.101415+0000","last_unstale":"2024-09-10T23:27:18.088367+0000","last_undegraded":"2024-09-10T23:27:18.088367+0000","last_fullsized":"2024-09-10T23:27:18.088367+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:03:55.747742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648884+0000","last_change":"2024-09-10T23:27:16.084947+0000","last_active":"2024-09-10T23:27:18.648884+0000","last_peered":"2024-09-10T23:27:18.648884+0000","last_clean":"2024-09-10T23:27:18.648884+0000","last_became_active":"2024-09-10T23:27:16.084692+0000","last_became_peered":"2024-09-10T23:27:16.084692+0000","last_unstale":"2024-09-10T23:27:18.648884+0000","last_undegraded":"2024-09-10T23:27:18.648884+0000","last_fullsized":"2024-09-10T23:27:18.648884+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:15:57.850082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088531+0000","last_change":"2024-09-10T23:27:17.098759+0000","last_active":"2024-09-10T23:27:18.088531+0000","last_peered":"2024-09-10T23:27:18.088531+0000","last_clean":"2024-09-10T23:27:18.088531+0000","last_became_active":"2024-09-10T23:27:17.098487+0000","last_became_peered":"2024-09-10T23:27:17.098487+0000","last_unstale":"2024-09-10T23:27:18.088531+0000","last_undegraded":"2024-09-10T23:27:18.088531+0000","last_fullsized":"2024-09-10T23:27:18.088531+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:27.166404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.087971+0000","last_change":"2024-09-10T23:27:16.087772+0000","last_active":"2024-09-10T23:27:18.087971+0000","last_peered":"2024-09-10T23:27:18.087971+0000","last_clean":"2024-09-10T23:27:18.087971+0000","last_became_active":"2024-09-10T23:27:16.087528+0000","last_became_peered":"2024-09-10T23:27:16.087528+0000","last_unstale":"2024-09-10T23:27:18.087971+0000","last_undegraded":"2024-09-10T23:27:18.087971+0000","last_fullsized":"2024-09-10T23:27:18.087971+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:36.395245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.095077+0000","last_change":"2024-09-10T23:27:17.102817+0000","last_active":"2024-09-10T23:27:18.095077+0000","last_peered":"2024-09-10T23:27:18.095077+0000","last_clean":"2024-09-10T23:27:18.095077+0000","last_became_active":"2024-09-10T23:27:17.102164+0000","last_became_peered":"2024-09-10T23:27:17.102164+0000","last_unstale":"2024-09-10T23:27:18.095077+0000","last_undegraded":"2024-09-10T23:27:18.095077+0000","last_fullsized":"2024-09-10T23:27:18.095077+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:53.800068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123863+0000","last_change":"2024-09-10T23:27:16.099929+0000","last_active":"2024-09-10T23:27:18.123863+0000","last_peered":"2024-09-10T23:27:18.123863+0000","last_clean":"2024-09-10T23:27:18.123863+0000","last_became_active":"2024-09-10T23:27:16.099633+0000","last_became_peered":"2024-09-10T23:27:16.099633+0000","last_unstale":"2024-09-10T23:27:18.123863+0000","last_undegraded":"2024-09-10T23:27:18.123863+0000","last_fullsized":"2024-09-10T23:27:18.123863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:46.599497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654770+0000","last_change":"2024-09-10T23:27:17.113875+0000","last_active":"2024-09-10T23:27:18.654770+0000","last_peered":"2024-09-10T23:27:18.654770+0000","last_clean":"2024-09-10T23:27:18.654770+0000","last_became_active":"2024-09-10T23:27:17.113118+0000","last_became_peered":"2024-09-10T23:27:17.113118+0000","last_unstale":"2024-09-10T23:27:18.654770+0000","last_undegraded":"2024-09-10T23:27:18.654770+0000","last_fullsized":"2024-09-10T23:27:18.654770+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:04.030896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121961+0000","last_change":"2024-09-10T23:27:16.098737+0000","last_active":"2024-09-10T23:27:18.121961+0000","last_peered":"2024-09-10T23:27:18.121961+0000","last_clean":"2024-09-10T23:27:18.121961+0000","last_became_active":"2024-09-10T23:27:16.098442+0000","last_became_peered":"2024-09-10T23:27:16.098442+0000","last_unstale":"2024-09-10T23:27:18.121961+0000","last_undegraded":"2024-09-10T23:27:18.121961+0000","last_fullsized":"2024-09-10T23:27:18.121961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:59.654302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121238+0000","last_change":"2024-09-10T23:27:17.109414+0000","last_active":"2024-09-10T23:27:18.121238+0000","last_peered":"2024-09-10T23:27:18.121238+0000","last_clean":"2024-09-10T23:27:18.121238+0000","last_became_active":"2024-09-10T23:27:17.109116+0000","last_became_peered":"2024-09-10T23:27:17.109116+0000","last_unstale":"2024-09-10T23:27:18.121238+0000","last_undegraded":"2024-09-10T23:27:18.121238+0000","last_fullsized":"2024-09-10T23:27:18.121238+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:42.308068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"165'3","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094291+0000","last_change":"2024-09-10T23:27:16.097793+0000","last_active":"2024-09-10T23:27:18.094291+0000","last_peered":"2024-09-10T23:27:18.094291+0000","last_clean":"2024-09-10T23:27:18.094291+0000","last_became_active":"2024-09-10T23:27:16.097498+0000","last_became_peered":"2024-09-10T23:27:16.097498+0000","last_unstale":"2024-09-10T23:27:18.094291+0000","last_undegraded":"2024-09-10T23:27:18.094291+0000","last_fullsized":"2024-09-10T23:27:18.094291+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:57.282134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088279+0000","last_change":"2024-09-10T23:27:17.118822+0000","last_active":"2024-09-10T23:27:18.088279+0000","last_peered":"2024-09-10T23:27:18.088279+0000","last_clean":"2024-09-10T23:27:18.088279+0000","last_became_active":"2024-09-10T23:27:17.118563+0000","last_became_peered":"2024-09-10T23:27:17.118563+0000","last_unstale":"2024-09-10T23:27:18.088279+0000","last_undegraded":"2024-09-10T23:27:18.088279+0000","last_fullsized":"2024-09-10T23:27:18.088279+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:57.399526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"165'6","reported_seq":21,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121746+0000","last_change":"2024-09-10T23:27:16.101748+0000","last_active":"2024-09-10T23:27:18.121746+0000","last_peered":"2024-09-10T23:27:18.121746+0000","last_clean":"2024-09-10T23:27:18.121746+0000","last_became_active":"2024-09-10T23:27:16.100263+0000","last_became_peered":"2024-09-10T23:27:16.100263+0000","last_unstale":"2024-09-10T23:27:18.121746+0000","last_undegraded":"2024-09-10T23:27:18.121746+0000","last_fullsized":"2024-09-10T23:27:18.121746+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:38.172255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654797+0000","last_change":"2024-09-10T23:27:17.117290+0000","last_active":"2024-09-10T23:27:18.654797+0000","last_peered":"2024-09-10T23:27:18.654797+0000","last_clean":"2024-09-10T23:27:18.654797+0000","last_became_active":"2024-09-10T23:27:17.117017+0000","last_became_peered":"2024-09-10T23:27:17.117017+0000","last_unstale":"2024-09-10T23:27:18.654797+0000","last_undegraded":"2024-09-10T23:27:18.654797+0000","last_fullsized":"2024-09-10T23:27:18.654797+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:16.111352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649018+0000","last_change":"2024-09-10T23:27:16.091730+0000","last_active":"2024-09-10T23:27:18.649018+0000","last_peered":"2024-09-10T23:27:18.649018+0000","last_clean":"2024-09-10T23:27:18.649018+0000","last_became_active":"2024-09-10T23:27:16.090957+0000","last_became_peered":"2024-09-10T23:27:16.090957+0000","last_unstale":"2024-09-10T23:27:18.649018+0000","last_undegraded":"2024-09-10T23:27:18.649018+0000","last_fullsized":"2024-09-10T23:27:18.649018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:23.431267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124243+0000","last_change":"2024-09-10T23:27:17.118859+0000","last_active":"2024-09-10T23:27:18.124243+0000","last_peered":"2024-09-10T23:27:18.124243+0000","last_clean":"2024-09-10T23:27:18.124243+0000","last_became_active":"2024-09-10T23:27:17.118402+0000","last_became_peered":"2024-09-10T23:27:17.118402+0000","last_unstale":"2024-09-10T23:27:18.124243+0000","last_undegraded":"2024-09-10T23:27:18.124243+0000","last_fullsized":"2024-09-10T23:27:18.124243+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121380+0000","last_change":"2024-09-10T23:27:16.085990+0000","last_active":"2024-09-10T23:27:18.121380+0000","last_peered":"2024-09-10T23:27:18.121380+0000","last_clean":"2024-09-10T23:27:18.121380+0000","last_became_active":"2024-09-10T23:27:16.085702+0000","last_became_peered":"2024-09-10T23:27:16.085702+0000","last_unstale":"2024-09-10T23:27:18.121380+0000","last_undegraded":"2024-09-10T23:27:18.121380+0000","last_fullsized":"2024-09-10T23:27:18.121380+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:45:33.884766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654861+0000","last_change":"2024-09-10T23:27:17.116517+0000","last_active":"2024-09-10T23:27:18.654861+0000","last_peered":"2024-09-10T23:27:18.654861+0000","last_clean":"2024-09-10T23:27:18.654861+0000","last_became_active":"2024-09-10T23:27:17.116082+0000","last_became_peered":"2024-09-10T23:27:17.116082+0000","last_unstale":"2024-09-10T23:27:18.654861+0000","last_undegraded":"2024-09-10T23:27:18.654861+0000","last_fullsized":"2024-09-10T23:27:18.654861+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.595148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654176+0000","last_change":"2024-09-10T23:27:16.092789+0000","last_active":"2024-09-10T23:27:18.654176+0000","last_peered":"2024-09-10T23:27:18.654176+0000","last_clean":"2024-09-10T23:27:18.654176+0000","last_became_active":"2024-09-10T23:27:16.092548+0000","last_became_peered":"2024-09-10T23:27:16.092548+0000","last_unstale":"2024-09-10T23:27:18.654176+0000","last_undegraded":"2024-09-10T23:27:18.654176+0000","last_fullsized":"2024-09-10T23:27:18.654176+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:17.509832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088448+0000","last_change":"2024-09-10T23:27:17.102362+0000","last_active":"2024-09-10T23:27:18.088448+0000","last_peered":"2024-09-10T23:27:18.088448+0000","last_clean":"2024-09-10T23:27:18.088448+0000","last_became_active":"2024-09-10T23:27:17.102022+0000","last_became_peered":"2024-09-10T23:27:17.102022+0000","last_unstale":"2024-09-10T23:27:18.088448+0000","last_undegraded":"2024-09-10T23:27:18.088448+0000","last_fullsized":"2024-09-10T23:27:18.088448+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:22.009162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"165'8","reported_seq":23,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123907+0000","last_change":"2024-09-10T23:27:16.097848+0000","last_active":"2024-09-10T23:27:18.123907+0000","last_peered":"2024-09-10T23:27:18.123907+0000","last_clean":"2024-09-10T23:27:18.123907+0000","last_became_active":"2024-09-10T23:27:16.097483+0000","last_became_peered":"2024-09-10T23:27:16.097483+0000","last_unstale":"2024-09-10T23:27:18.123907+0000","last_undegraded":"2024-09-10T23:27:18.123907+0000","last_fullsized":"2024-09-10T23:27:18.123907+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:59.132712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123840+0000","last_change":"2024-09-10T23:27:17.104862+0000","last_active":"2024-09-10T23:27:18.123840+0000","last_peered":"2024-09-10T23:27:18.123840+0000","last_clean":"2024-09-10T23:27:18.123840+0000","last_became_active":"2024-09-10T23:27:17.103480+0000","last_became_peered":"2024-09-10T23:27:17.103480+0000","last_unstale":"2024-09-10T23:27:18.123840+0000","last_undegraded":"2024-09-10T23:27:18.123840+0000","last_fullsized":"2024-09-10T23:27:18.123840+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.122067+0000","last_change":"2024-09-10T23:27:16.084160+0000","last_active":"2024-09-10T23:27:18.122067+0000","last_peered":"2024-09-10T23:27:18.122067+0000","last_clean":"2024-09-10T23:27:18.122067+0000","last_became_active":"2024-09-10T23:27:16.083818+0000","last_became_peered":"2024-09-10T23:27:16.083818+0000","last_unstale":"2024-09-10T23:27:18.122067+0000","last_undegraded":"2024-09-10T23:27:18.122067+0000","last_fullsized":"2024-09-10T23:27:18.122067+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:44.668087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655052+0000","last_change":"2024-09-10T23:27:17.110648+0000","last_active":"2024-09-10T23:27:18.655052+0000","last_peered":"2024-09-10T23:27:18.655052+0000","last_clean":"2024-09-10T23:27:18.655052+0000","last_became_active":"2024-09-10T23:27:17.110352+0000","last_became_peered":"2024-09-10T23:27:17.110352+0000","last_unstale":"2024-09-10T23:27:18.655052+0000","last_undegraded":"2024-09-10T23:27:18.655052+0000","last_fullsized":"2024-09-10T23:27:18.655052+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:51.518892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124345+0000","last_change":"2024-09-10T23:27:16.095550+0000","last_active":"2024-09-10T23:27:18.124345+0000","last_peered":"2024-09-10T23:27:18.124345+0000","last_clean":"2024-09-10T23:27:18.124345+0000","last_became_active":"2024-09-10T23:27:16.093841+0000","last_became_peered":"2024-09-10T23:27:16.093841+0000","last_unstale":"2024-09-10T23:27:18.124345+0000","last_undegraded":"2024-09-10T23:27:18.124345+0000","last_fullsized":"2024-09-10T23:27:18.124345+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654590+0000","last_change":"2024-09-10T23:27:17.102508+0000","last_active":"2024-09-10T23:27:18.654590+0000","last_peered":"2024-09-10T23:27:18.654590+0000","last_clean":"2024-09-10T23:27:18.654590+0000","last_became_active":"2024-09-10T23:27:17.102219+0000","last_became_peered":"2024-09-10T23:27:17.102219+0000","last_unstale":"2024-09-10T23:27:18.654590+0000","last_undegraded":"2024-09-10T23:27:18.654590+0000","last_fullsized":"2024-09-10T23:27:18.654590+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:11.817059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"165'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648863+0000","last_change":"2024-09-10T23:27:16.082194+0000","last_active":"2024-09-10T23:27:18.648863+0000","last_peered":"2024-09-10T23:27:18.648863+0000","last_clean":"2024-09-10T23:27:18.648863+0000","last_became_active":"2024-09-10T23:27:16.081929+0000","last_became_peered":"2024-09-10T23:27:16.081929+0000","last_unstale":"2024-09-10T23:27:18.648863+0000","last_undegraded":"2024-09-10T23:27:18.648863+0000","last_fullsized":"2024-09-10T23:27:18.648863+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:01.565180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654640+0000","last_change":"2024-09-10T23:27:17.116874+0000","last_active":"2024-09-10T23:27:18.654640+0000","last_peered":"2024-09-10T23:27:18.654640+0000","last_clean":"2024-09-10T23:27:18.654640+0000","last_became_active":"2024-09-10T23:27:17.116618+0000","last_became_peered":"2024-09-10T23:27:17.116618+0000","last_unstale":"2024-09-10T23:27:18.654640+0000","last_undegraded":"2024-09-10T23:27:18.654640+0000","last_fullsized":"2024-09-10T23:27:18.654640+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:35:33.820928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124289+0000","last_change":"2024-09-10T23:27:16.097769+0000","last_active":"2024-09-10T23:27:18.124289+0000","last_peered":"2024-09-10T23:27:18.124289+0000","last_clean":"2024-09-10T23:27:18.124289+0000","last_became_active":"2024-09-10T23:27:16.097374+0000","last_became_peered":"2024-09-10T23:27:16.097374+0000","last_unstale":"2024-09-10T23:27:18.124289+0000","last_undegraded":"2024-09-10T23:27:18.124289+0000","last_fullsized":"2024-09-10T23:27:18.124289+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:52.793154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121765+0000","last_change":"2024-09-10T23:27:17.092162+0000","last_active":"2024-09-10T23:27:18.121765+0000","last_peered":"2024-09-10T23:27:18.121765+0000","last_clean":"2024-09-10T23:27:18.121765+0000","last_became_active":"2024-09-10T23:27:17.091863+0000","last_became_peered":"2024-09-10T23:27:17.091863+0000","last_unstale":"2024-09-10T23:27:18.121765+0000","last_undegraded":"2024-09-10T23:27:18.121765+0000","last_fullsized":"2024-09-10T23:27:18.121765+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:27.826000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649109+0000","last_change":"2024-09-10T23:27:16.089641+0000","last_active":"2024-09-10T23:27:18.649109+0000","last_peered":"2024-09-10T23:27:18.649109+0000","last_clean":"2024-09-10T23:27:18.649109+0000","last_became_active":"2024-09-10T23:27:16.088701+0000","last_became_peered":"2024-09-10T23:27:16.088701+0000","last_unstale":"2024-09-10T23:27:18.649109+0000","last_undegraded":"2024-09-10T23:27:18.649109+0000","last_fullsized":"2024-09-10T23:27:18.649109+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:45.491491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649034+0000","last_change":"2024-09-10T23:27:17.115275+0000","last_active":"2024-09-10T23:27:18.649034+0000","last_peered":"2024-09-10T23:27:18.649034+0000","last_clean":"2024-09-10T23:27:18.649034+0000","last_became_active":"2024-09-10T23:27:17.114068+0000","last_became_peered":"2024-09-10T23:27:17.114068+0000","last_unstale":"2024-09-10T23:27:18.649034+0000","last_undegraded":"2024-09-10T23:27:18.649034+0000","last_fullsized":"2024-09-10T23:27:18.649034+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:47.769062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654274+0000","last_change":"2024-09-10T23:27:16.091395+0000","last_active":"2024-09-10T23:27:18.654274+0000","last_peered":"2024-09-10T23:27:18.654274+0000","last_clean":"2024-09-10T23:27:18.654274+0000","last_became_active":"2024-09-10T23:27:16.091136+0000","last_became_peered":"2024-09-10T23:27:16.091136+0000","last_unstale":"2024-09-10T23:27:18.654274+0000","last_undegraded":"2024-09-10T23:27:18.654274+0000","last_fullsized":"2024-09-10T23:27:18.654274+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:34.279435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649010+0000","last_change":"2024-09-10T23:27:17.116302+0000","last_active":"2024-09-10T23:27:18.649010+0000","last_peered":"2024-09-10T23:27:18.649010+0000","last_clean":"2024-09-10T23:27:18.649010+0000","last_became_active":"2024-09-10T23:27:17.115078+0000","last_became_peered":"2024-09-10T23:27:17.115078+0000","last_unstale":"2024-09-10T23:27:18.649010+0000","last_undegraded":"2024-09-10T23:27:18.649010+0000","last_fullsized":"2024-09-10T23:27:18.649010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.266065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088362+0000","last_change":"2024-09-10T23:27:16.093832+0000","last_active":"2024-09-10T23:27:18.088362+0000","last_peered":"2024-09-10T23:27:18.088362+0000","last_clean":"2024-09-10T23:27:18.088362+0000","last_became_active":"2024-09-10T23:27:16.089264+0000","last_became_peered":"2024-09-10T23:27:16.089264+0000","last_unstale":"2024-09-10T23:27:18.088362+0000","last_undegraded":"2024-09-10T23:27:18.088362+0000","last_fullsized":"2024-09-10T23:27:18.088362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:34.365596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655734+0000","last_change":"2024-09-10T23:27:17.113240+0000","last_active":"2024-09-10T23:27:18.655734+0000","last_peered":"2024-09-10T23:27:18.655734+0000","last_clean":"2024-09-10T23:27:18.655734+0000","last_became_active":"2024-09-10T23:27:17.112858+0000","last_became_peered":"2024-09-10T23:27:17.112858+0000","last_unstale":"2024-09-10T23:27:18.655734+0000","last_undegraded":"2024-09-10T23:27:18.655734+0000","last_fullsized":"2024-09-10T23:27:18.655734+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:25.920123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654938+0000","last_change":"2024-09-10T23:27:16.098898+0000","last_active":"2024-09-10T23:27:18.654938+0000","last_peered":"2024-09-10T23:27:18.654938+0000","last_clean":"2024-09-10T23:27:18.654938+0000","last_became_active":"2024-09-10T23:27:16.098612+0000","last_became_peered":"2024-09-10T23:27:16.098612+0000","last_unstale":"2024-09-10T23:27:18.654938+0000","last_undegraded":"2024-09-10T23:27:18.654938+0000","last_fullsized":"2024-09-10T23:27:18.654938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:20.951718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.653946+0000","last_change":"2024-09-10T23:27:17.111049+0000","last_active":"2024-09-10T23:27:18.653946+0000","last_peered":"2024-09-10T23:27:18.653946+0000","last_clean":"2024-09-10T23:27:18.653946+0000","last_became_active":"2024-09-10T23:27:17.110785+0000","last_became_peered":"2024-09-10T23:27:17.110785+0000","last_unstale":"2024-09-10T23:27:18.653946+0000","last_undegraded":"2024-09-10T23:27:18.653946+0000","last_fullsized":"2024-09-10T23:27:18.653946+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:19.777503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"165'2","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.649027+0000","last_change":"2024-09-10T23:27:16.084074+0000","last_active":"2024-09-10T23:27:18.649027+0000","last_peered":"2024-09-10T23:27:18.649027+0000","last_clean":"2024-09-10T23:27:18.649027+0000","last_became_active":"2024-09-10T23:27:16.083796+0000","last_became_peered":"2024-09-10T23:27:16.083796+0000","last_unstale":"2024-09-10T23:27:18.649027+0000","last_undegraded":"2024-09-10T23:27:18.649027+0000","last_fullsized":"2024-09-10T23:27:18.649027+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:31.907739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123973+0000","last_change":"2024-09-10T23:27:17.109500+0000","last_active":"2024-09-10T23:27:18.123973+0000","last_peered":"2024-09-10T23:27:18.123973+0000","last_clean":"2024-09-10T23:27:18.123973+0000","last_became_active":"2024-09-10T23:27:17.109163+0000","last_became_peered":"2024-09-10T23:27:17.109163+0000","last_unstale":"2024-09-10T23:27:18.123973+0000","last_undegraded":"2024-09-10T23:27:18.123973+0000","last_fullsized":"2024-09-10T23:27:18.123973+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:55.426972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"166'1","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.123185+0000","last_change":"2024-09-10T23:27:16.099284+0000","last_active":"2024-09-10T23:27:18.123185+0000","last_peered":"2024-09-10T23:27:18.123185+0000","last_clean":"2024-09-10T23:27:18.123185+0000","last_became_active":"2024-09-10T23:27:16.098730+0000","last_became_peered":"2024-09-10T23:27:16.098730+0000","last_unstale":"2024-09-10T23:27:18.123185+0000","last_undegraded":"2024-09-10T23:27:18.123185+0000","last_fullsized":"2024-09-10T23:27:18.123185+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:36.406564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088655+0000","last_change":"2024-09-10T23:27:17.100031+0000","last_active":"2024-09-10T23:27:18.088655+0000","last_peered":"2024-09-10T23:27:18.088655+0000","last_clean":"2024-09-10T23:27:18.088655+0000","last_became_active":"2024-09-10T23:27:17.099753+0000","last_became_peered":"2024-09-10T23:27:17.099753+0000","last_unstale":"2024-09-10T23:27:18.088655+0000","last_undegraded":"2024-09-10T23:27:18.088655+0000","last_fullsized":"2024-09-10T23:27:18.088655+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:00.932972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121568+0000","last_change":"2024-09-10T23:27:16.093939+0000","last_active":"2024-09-10T23:27:18.121568+0000","last_peered":"2024-09-10T23:27:18.121568+0000","last_clean":"2024-09-10T23:27:18.121568+0000","last_became_active":"2024-09-10T23:27:16.093597+0000","last_became_peered":"2024-09-10T23:27:16.093597+0000","last_unstale":"2024-09-10T23:27:18.121568+0000","last_undegraded":"2024-09-10T23:27:18.121568+0000","last_fullsized":"2024-09-10T23:27:18.121568+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:43.549959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.124149+0000","last_change":"2024-09-10T23:27:17.107113+0000","last_active":"2024-09-10T23:27:18.124149+0000","last_peered":"2024-09-10T23:27:18.124149+0000","last_clean":"2024-09-10T23:27:18.124149+0000","last_became_active":"2024-09-10T23:27:17.106859+0000","last_became_peered":"2024-09-10T23:27:17.106859+0000","last_unstale":"2024-09-10T23:27:18.124149+0000","last_undegraded":"2024-09-10T23:27:18.124149+0000","last_fullsized":"2024-09-10T23:27:18.124149+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:49.831010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088636+0000","last_change":"2024-09-10T23:27:16.100147+0000","last_active":"2024-09-10T23:27:18.088636+0000","last_peered":"2024-09-10T23:27:18.088636+0000","last_clean":"2024-09-10T23:27:18.088636+0000","last_became_active":"2024-09-10T23:27:16.099691+0000","last_became_peered":"2024-09-10T23:27:16.099691+0000","last_unstale":"2024-09-10T23:27:18.088636+0000","last_undegraded":"2024-09-10T23:27:18.088636+0000","last_fullsized":"2024-09-10T23:27:18.088636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:54.133674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094649+0000","last_change":"2024-09-10T23:27:17.119298+0000","last_active":"2024-09-10T23:27:18.094649+0000","last_peered":"2024-09-10T23:27:18.094649+0000","last_clean":"2024-09-10T23:27:18.094649+0000","last_became_active":"2024-09-10T23:27:17.118918+0000","last_became_peered":"2024-09-10T23:27:17.118918+0000","last_unstale":"2024-09-10T23:27:18.094649+0000","last_undegraded":"2024-09-10T23:27:18.094649+0000","last_fullsized":"2024-09-10T23:27:18.094649+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:55.884595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.094384+0000","last_change":"2024-09-10T23:27:16.090393+0000","last_active":"2024-09-10T23:27:18.094384+0000","last_peered":"2024-09-10T23:27:18.094384+0000","last_clean":"2024-09-10T23:27:18.094384+0000","last_became_active":"2024-09-10T23:27:16.090138+0000","last_became_peered":"2024-09-10T23:27:16.090138+0000","last_unstale":"2024-09-10T23:27:18.094384+0000","last_undegraded":"2024-09-10T23:27:18.094384+0000","last_fullsized":"2024-09-10T23:27:18.094384+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:12.975929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655516+0000","last_change":"2024-09-10T23:27:17.110962+0000","last_active":"2024-09-10T23:27:18.655516+0000","last_peered":"2024-09-10T23:27:18.655516+0000","last_clean":"2024-09-10T23:27:18.655516+0000","last_became_active":"2024-09-10T23:27:17.110669+0000","last_became_peered":"2024-09-10T23:27:17.110669+0000","last_unstale":"2024-09-10T23:27:18.655516+0000","last_undegraded":"2024-09-10T23:27:18.655516+0000","last_fullsized":"2024-09-10T23:27:18.655516+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:46.498405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121402+0000","last_change":"2024-09-10T23:27:16.089373+0000","last_active":"2024-09-10T23:27:18.121402+0000","last_peered":"2024-09-10T23:27:18.121402+0000","last_clean":"2024-09-10T23:27:18.121402+0000","last_became_active":"2024-09-10T23:27:16.089120+0000","last_became_peered":"2024-09-10T23:27:16.089120+0000","last_unstale":"2024-09-10T23:27:18.121402+0000","last_undegraded":"2024-09-10T23:27:18.121402+0000","last_fullsized":"2024-09-10T23:27:18.121402+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:19.387603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121663+0000","last_change":"2024-09-10T23:27:17.094316+0000","last_active":"2024-09-10T23:27:18.121663+0000","last_peered":"2024-09-10T23:27:18.121663+0000","last_clean":"2024-09-10T23:27:18.121663+0000","last_became_active":"2024-09-10T23:27:17.094021+0000","last_became_peered":"2024-09-10T23:27:17.094021+0000","last_unstale":"2024-09-10T23:27:18.121663+0000","last_undegraded":"2024-09-10T23:27:18.121663+0000","last_fullsized":"2024-09-10T23:27:18.121663+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:47:15.902576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654294+0000","last_change":"2024-09-10T23:27:16.096182+0000","last_active":"2024-09-10T23:27:18.654294+0000","last_peered":"2024-09-10T23:27:18.654294+0000","last_clean":"2024-09-10T23:27:18.654294+0000","last_became_active":"2024-09-10T23:27:16.094386+0000","last_became_peered":"2024-09-10T23:27:16.094386+0000","last_unstale":"2024-09-10T23:27:18.654294+0000","last_undegraded":"2024-09-10T23:27:18.654294+0000","last_fullsized":"2024-09-10T23:27:18.654294+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.903208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.088687+0000","last_change":"2024-09-10T23:27:17.116139+0000","last_active":"2024-09-10T23:27:18.088687+0000","last_peered":"2024-09-10T23:27:18.088687+0000","last_clean":"2024-09-10T23:27:18.088687+0000","last_became_active":"2024-09-10T23:27:17.115852+0000","last_became_peered":"2024-09-10T23:27:17.115852+0000","last_unstale":"2024-09-10T23:27:18.088687+0000","last_undegraded":"2024-09-10T23:27:18.088687+0000","last_fullsized":"2024-09-10T23:27:18.088687+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:48:54.432594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.648362+0000","last_change":"2024-09-10T23:27:16.093853+0000","last_active":"2024-09-10T23:27:18.648362+0000","last_peered":"2024-09-10T23:27:18.648362+0000","last_clean":"2024-09-10T23:27:18.648362+0000","last_became_active":"2024-09-10T23:27:16.093586+0000","last_became_peered":"2024-09-10T23:27:16.093586+0000","last_unstale":"2024-09-10T23:27:18.648362+0000","last_undegraded":"2024-09-10T23:27:18.648362+0000","last_fullsized":"2024-09-10T23:27:18.648362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:03.023982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.654467+0000","last_change":"2024-09-10T23:27:17.114770+0000","last_active":"2024-09-10T23:27:18.654467+0000","last_peered":"2024-09-10T23:27:18.654467+0000","last_clean":"2024-09-10T23:27:18.654467+0000","last_became_active":"2024-09-10T23:27:17.112895+0000","last_became_peered":"2024-09-10T23:27:17.112895+0000","last_unstale":"2024-09-10T23:27:18.654467+0000","last_undegraded":"2024-09-10T23:27:18.654467+0000","last_fullsized":"2024-09-10T23:27:18.654467+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:16.067370+0000","last_clean_scrub_stamp":"2024-09-10T23:27:16.067370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:05.711658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.121640+0000","last_change":"2024-09-10T23:27:16.099331+0000","last_active":"2024-09-10T23:27:18.121640+0000","last_peered":"2024-09-10T23:27:18.121640+0000","last_clean":"2024-09-10T23:27:18.121640+0000","last_became_active":"2024-09-10T23:27:16.099068+0000","last_became_peered":"2024-09-10T23:27:16.099068+0000","last_unstale":"2024-09-10T23:27:18.121640+0000","last_undegraded":"2024-09-10T23:27:18.121640+0000","last_fullsized":"2024-09-10T23:27:18.121640+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:27:15.060455+0000","last_clean_scrub_stamp":"2024-09-10T23:27:15.060455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:23.742338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":370,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-10T23:27:18.655059+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:27:18.655059+0000","last_peered":"2024-09-10T23:27:18.655059+0000","last_clean":"2024-09-10T23:27:18.655059+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:27:18.655059+0000","last_undegraded":"2024-09-10T23:27:18.655059+0000","last_fullsized":"2024-09-10T23:27:18.655059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476882,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69248,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302592,"statfs":{"total":96636764160,"available":96565854208,"internally_reserved":0,"allocated":2076672,"data_stored":976228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509587,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69832,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302008,"statfs":{"total":96636764160,"available":96565256192,"internally_reserved":0,"allocated":2670592,"data_stored":1566596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509586,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2084864,"data_stored":976352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69328,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302512,"statfs":{"total":96636764160,"available":96565772288,"internally_reserved":0,"allocated":2093056,"data_stored":976992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509586,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69312,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302528,"statfs":{"total":96636764160,"available":96565788672,"internally_reserved":0,"allocated":2076672,"data_stored":976228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509587,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2088960,"data_stored":977840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509586,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74060,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297780,"statfs":{"total":96636764160,"available":96560926720,"internally_reserved":0,"allocated":2678784,"data_stored":1566700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2097152,"data_stored":978444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:27:26.255 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:27:26.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:27:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 -- 172.21.15.17:0/4221047505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc15be00 msgr2=0x7f46dc15d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 --2- 172.21.15.17:0/4221047505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc15be00 0x7f46dc15d4f0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f46dc073280 tx=0x7f46cc01c870 comp rx=0 tx=0).stop 2024-09-10T23:27:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 -- 172.21.15.17:0/4221047505 shutdown_connections 2024-09-10T23:27:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 --2- 172.21.15.17:0/4221047505 >> v2:172.21.15.77:3300/0 conn(0x7f46dc0b1740 0x7f46dc0d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 --2- 172.21.15.17:0/4221047505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46dc0b12e0 0x7f46dc0cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 --2- 172.21.15.17:0/4221047505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc15be00 0x7f46dc15d4f0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 -- 172.21.15.17:0/4221047505 >> 172.21.15.17:0/4221047505 conn(0x7f46dc09a9f0 msgr2=0x7f46dc09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 -- 172.21.15.17:0/4221047505 shutdown_connections 2024-09-10T23:27:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 -- 172.21.15.17:0/4221047505 wait complete. 2024-09-10T23:27:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 Processor -- start 2024-09-10T23:27:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.445+0000 7f46e0e00640 1 -- start start 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46e0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc0b12e0 0x7f46dc1f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46e0e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46dc0b1740 0x7f46dc1f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46e0e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46dc15be00 0x7f46dc165bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46e0e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc15d2d0 con 0x7f46dc0b12e0 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46e0e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc15d150 con 0x7f46dc0b1740 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46e0e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f46dc0b1c50 con 0x7f46dc15be00 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc0b12e0 0x7f46dc1f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc0b12e0 0x7f46dc1f4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35152/0 (socket says 172.21.15.17:35152) 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9e00640 1 -- 172.21.15.17:0/1464554416 learned_addr learned my addr 172.21.15.17:0/1464554416 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9e00640 1 -- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46dc15be00 msgr2=0x7f46dc165bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9e00640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46dc15be00 0x7f46dc165bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9e00640 1 -- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46dc0b1740 msgr2=0x7f46dc1f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9400640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46dc0b1740 0x7f46dc1f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9e00640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46dc0b1740 0x7f46dc1f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9e00640 1 -- 172.21.15.17:0/1464554416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc0cc8f0 con 0x7f46dc0b12e0 2024-09-10T23:27:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9400640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46dc0b1740 0x7f46dc1f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d9e00640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc0b12e0 0x7f46dc1f4dc0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009850 tx=0x7f46cc0a5800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d2000640 1 -- 172.21.15.17:0/1464554416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0b2040 con 0x7f46dc0b12e0 2024-09-10T23:27:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d2000640 1 -- 172.21.15.17:0/1464554416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46cc004430 con 0x7f46dc0b12e0 2024-09-10T23:27:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46d2000640 1 -- 172.21.15.17:0/1464554416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc005290 con 0x7f46dc0b12e0 2024-09-10T23:27:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46dc0ccbd0 con 0x7f46dc0b12e0 2024-09-10T23:27:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46dc1f83d0 con 0x7f46dc0b12e0 2024-09-10T23:27:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.449+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46dc1f7780 con 0x7f46dc0b12e0 2024-09-10T23:27:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.453+0000 7f46d2000640 1 -- 172.21.15.17:0/1464554416 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f46cc005430 con 0x7f46dc0b12e0 2024-09-10T23:27:26.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.453+0000 7f46d2000640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46bc072610 0x7f46bc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.453+0000 7f46d2000640 1 -- 172.21.15.17:0/1464554416 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f46cc12ca70 con 0x7f46dc0b12e0 2024-09-10T23:27:26.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.453+0000 7f46d9400640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46bc072610 0x7f46bc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.453+0000 7f46d9400640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46bc072610 0x7f46bc074ad0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f46c8005fd0 tx=0x7f46c8005e60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:26.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.457+0000 7f46d2000640 1 -- 172.21.15.17:0/1464554416 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f46cc0bc060 con 0x7f46dc0b12e0 2024-09-10T23:27:26.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.693+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f46dc1f8660 con 0x7f46dc0b12e0 2024-09-10T23:27:26.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.697+0000 7f46d2000640 1 -- 172.21.15.17:0/1464554416 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) ==== 190+0+147 (secure 0 0 0) 0x7f46cc016490 con 0x7f46dc0b12e0 2024-09-10T23:27:26.702 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:27:26.702 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:27:26.702 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:27:26.702 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:27:26.702 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:27:26.702 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:27:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46bc072610 msgr2=0x7f46bc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46bc072610 0x7f46bc074ad0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f46c8005fd0 tx=0x7f46c8005e60 comp rx=0 tx=0).stop 2024-09-10T23:27:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc0b12e0 msgr2=0x7f46dc1f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc0b12e0 0x7f46dc1f4dc0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009850 tx=0x7f46cc0a5800 comp rx=0 tx=0).stop 2024-09-10T23:27:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 shutdown_connections 2024-09-10T23:27:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46bc072610 0x7f46bc074ad0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f46dc15be00 0x7f46dc165bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46dc0b1740 0x7f46dc1f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 --2- 172.21.15.17:0/1464554416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46dc0b12e0 0x7f46dc1f4dc0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 >> 172.21.15.17:0/1464554416 conn(0x7f46dc09a9f0 msgr2=0x7f46dc15e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:26.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 shutdown_connections 2024-09-10T23:27:26.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.701+0000 7f46e0e00640 1 -- 172.21.15.17:0/1464554416 wait complete. 2024-09-10T23:27:26.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:26.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.865+0000 7fd651200640 1 -- 172.21.15.17:0/2166111167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0d1830 msgr2=0x7fd64c15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.865+0000 7fd651200640 1 --2- 172.21.15.17:0/2166111167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0d1830 0x7fd64c15f5a0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0d2e60 tx=0x7fd63401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.865+0000 7fd651200640 1 -- 172.21.15.17:0/2166111167 shutdown_connections 2024-09-10T23:27:26.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.865+0000 7fd651200640 1 --2- 172.21.15.17:0/2166111167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0d1830 0x7fd64c15f5a0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.865+0000 7fd651200640 1 --2- 172.21.15.17:0/2166111167 >> v2:172.21.15.77:3300/0 conn(0x7fd64c070ad0 0x7fd64c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.865+0000 7fd651200640 1 -- 172.21.15.17:0/2166111167 >> 172.21.15.17:0/2166111167 conn(0x7fd64c0d1d60 msgr2=0x7fd64c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:26.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.865+0000 7fd651200640 1 -- 172.21.15.17:0/2166111167 shutdown_connections 2024-09-10T23:27:26.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.865+0000 7fd651200640 1 -- 172.21.15.17:0/2166111167 wait complete. 2024-09-10T23:27:26.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 Processor -- start 2024-09-10T23:27:26.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 -- start start 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd64c070ad0 0x7fd64c0b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0cf320 0x7fd64c153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd64c0d1830 0x7fd64c0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c169320 con 0x7fd64c0cf320 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c1691a0 con 0x7fd64c0d1830 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c1694a0 con 0x7fd64c070ad0 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd643e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0cf320 0x7fd64c153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd643e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0cf320 0x7fd64c153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36640/0 (socket says 172.21.15.17:36640) 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd643e00640 1 -- 172.21.15.17:0/4117186997 learned_addr learned my addr 172.21.15.17:0/4117186997 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd64a800640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd64c0d1830 0x7fd64c0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd649e00640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd64c070ad0 0x7fd64c0b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd643e00640 1 -- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd64c070ad0 msgr2=0x7fd64c0b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd643e00640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd64c070ad0 0x7fd64c0b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd643e00640 1 -- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd64c0d1830 msgr2=0x7fd64c0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:26.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd643e00640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd64c0d1830 0x7fd64c0b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:26.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd643e00640 1 -- 172.21.15.17:0/4117186997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c154300 con 0x7fd64c0cf320 2024-09-10T23:27:26.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd643e00640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0cf320 0x7fd64c153dc0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fd6340b0040 tx=0x7fd6340a57f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:26.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd642000640 1 -- 172.21.15.17:0/4117186997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6340bb070 con 0x7fd64c0cf320 2024-09-10T23:27:26.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd642000640 1 -- 172.21.15.17:0/4117186997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6340044b0 con 0x7fd64c0cf320 2024-09-10T23:27:26.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64c0b6920 con 0x7fd64c0cf320 2024-09-10T23:27:26.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd642000640 1 -- 172.21.15.17:0/4117186997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6340b2040 con 0x7fd64c0cf320 2024-09-10T23:27:26.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.869+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64c0b4f10 con 0x7fd64c0cf320 2024-09-10T23:27:26.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.873+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd64c0cfc60 con 0x7fd64c0cf320 2024-09-10T23:27:26.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.873+0000 7fd642000640 1 -- 172.21.15.17:0/4117186997 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd6340052d0 con 0x7fd64c0cf320 2024-09-10T23:27:26.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.873+0000 7fd642000640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6280725e0 0x7fd628074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:26.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.873+0000 7fd642000640 1 -- 172.21.15.17:0/4117186997 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fd63412cb40 con 0x7fd64c0cf320 2024-09-10T23:27:26.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.873+0000 7fd649e00640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6280725e0 0x7fd628074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:26.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.873+0000 7fd649e00640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6280725e0 0x7fd628074aa0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd64c1f5cb0 tx=0x7fd63c00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:26.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:26.877+0000 7fd642000640 1 -- 172.21.15.17:0/4117186997 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd6340164b0 con 0x7fd64c0cf320 2024-09-10T23:27:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.085+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd64c06df20 con 0x7fd64c0cf320 2024-09-10T23:27:27.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.085+0000 7fd642000640 1 -- 172.21.15.17:0/4117186997 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7fd6340f79c0 con 0x7fd64c0cf320 2024-09-10T23:27:27.090 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:27.090 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:27:27.090 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:27:27.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6280725e0 msgr2=0x7fd628074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6280725e0 0x7fd628074aa0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd64c1f5cb0 tx=0x7fd63c00b390 comp rx=0 tx=0).stop 2024-09-10T23:27:27.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0cf320 msgr2=0x7fd64c153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0cf320 0x7fd64c153dc0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fd6340b0040 tx=0x7fd6340a57f0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 shutdown_connections 2024-09-10T23:27:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6280725e0 0x7fd628074aa0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd64c0d1830 0x7fd64c0b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd64c0cf320 0x7fd64c153dc0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 --2- 172.21.15.17:0/4117186997 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd64c070ad0 0x7fd64c0b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 >> 172.21.15.17:0/4117186997 conn(0x7fd64c0d1d60 msgr2=0x7fd64c0af880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 shutdown_connections 2024-09-10T23:27:27.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.089+0000 7fd651200640 1 -- 172.21.15.17:0/4117186997 wait complete. 2024-09-10T23:27:27.513 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 121, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:27:16.483958+0000', 'modified': '2024-09-10T23:27:19.518936+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9711}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9711': {'gid': 9711, 'name': 'c', 'rank': 0, 'incarnation': 117, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/3026129347', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 3026129347}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 3026129347}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9711, 'qdb_cluster': [9711]} 2024-09-10T23:27:27.514 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:27:27.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:27:27.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 -- 172.21.15.17:0/994837689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2400cedf0 msgr2=0x7fb2400d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 --2- 172.21.15.17:0/994837689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2400cedf0 0x7fb2400d28c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb228009840 tx=0x7fb22801c790 comp rx=0 tx=0).stop 2024-09-10T23:27:27.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 -- 172.21.15.17:0/994837689 shutdown_connections 2024-09-10T23:27:27.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 --2- 172.21.15.17:0/994837689 >> v2:172.21.15.77:3300/0 conn(0x7fb24015fa00 0x7fb24015fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 --2- 172.21.15.17:0/994837689 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2400cedf0 0x7fb2400d28c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 -- 172.21.15.17:0/994837689 >> 172.21.15.17:0/994837689 conn(0x7fb2400d1da0 msgr2=0x7fb2400d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:27.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 -- 172.21.15.17:0/994837689 shutdown_connections 2024-09-10T23:27:27.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 -- 172.21.15.17:0/994837689 wait complete. 2024-09-10T23:27:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 Processor -- start 2024-09-10T23:27:27.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 -- start start 2024-09-10T23:27:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb24015be80 0x7fb2400c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb24015fa00 0x7fb2400c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2400cb6f0 0x7fb24015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb240168f50 con 0x7fb24015be80 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2400b54c0 con 0x7fb24015fa00 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb246e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb2401690d0 con 0x7fb2400cb6f0 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb23fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb24015be80 0x7fb2400c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb23fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb24015be80 0x7fb2400c59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36648/0 (socket says 172.21.15.17:36648) 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb23fe00640 1 -- 172.21.15.17:0/3711193984 learned_addr learned my addr 172.21.15.17:0/3711193984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.661+0000 7fb237e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb24015fa00 0x7fb2400c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb244e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2400cb6f0 0x7fb24015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23fe00640 1 -- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2400cb6f0 msgr2=0x7fb24015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23fe00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2400cb6f0 0x7fb24015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23fe00640 1 -- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb24015fa00 msgr2=0x7fb2400c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23fe00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb24015fa00 0x7fb2400c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23fe00640 1 -- 172.21.15.17:0/3711193984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2400cbc60 con 0x7fb24015be80 2024-09-10T23:27:27.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb244e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2400cb6f0 0x7fb24015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:27.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23fe00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb24015be80 0x7fb2400c59f0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c490 tx=0x7fb23000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23cc00640 1 -- 172.21.15.17:0/3711193984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230016020 con 0x7fb24015be80 2024-09-10T23:27:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23cc00640 1 -- 172.21.15.17:0/3711193984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb230012940 con 0x7fb24015be80 2024-09-10T23:27:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23cc00640 1 -- 172.21.15.17:0/3711193984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230012d90 con 0x7fb24015be80 2024-09-10T23:27:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb246e00640 1 -- 172.21.15.17:0/3711193984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24006de70 con 0x7fb24015be80 2024-09-10T23:27:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb246e00640 1 -- 172.21.15.17:0/3711193984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24006e430 con 0x7fb24015be80 2024-09-10T23:27:27.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23cc00640 1 -- 172.21.15.17:0/3711193984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb23001b400 con 0x7fb24015be80 2024-09-10T23:27:27.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.665+0000 7fb23cc00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb21c072610 0x7fb21c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb23cc00640 1 -- 172.21.15.17:0/3711193984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fb230093780 con 0x7fb24015be80 2024-09-10T23:27:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 Processor -- start 2024-09-10T23:27:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- start start 2024-09-10T23:27:27.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb237e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb21c072610 0x7fb21c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 0x55d4adb79db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 0x55d4adb2d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d4ada4e3f0 con 0x55d4adb2de10 2024-09-10T23:27:27.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d4ad98bb20 con 0x55d4adb799d0 2024-09-10T23:27:27.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d4ad97af50 con 0x55d4adb7a2f0 2024-09-10T23:27:27.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb244e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb237e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb21c072610 0x7fb21c074ad0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb2280af000 tx=0x7fb22801afd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb244e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36654/0 (socket says 172.21.15.17:36654) 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb244e00640 1 -- 172.21.15.17:0/682311230 learned_addr learned my addr 172.21.15.17:0/682311230 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb23fe00640 1 --2- 172.21.15.17:0/682311230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 0x55d4adb79db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb237e00640 1 --2- 172.21.15.17:0/682311230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 0x55d4adb2d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb244e00640 1 -- 172.21.15.17:0/682311230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 msgr2=0x55d4adb2d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb244e00640 1 --2- 172.21.15.17:0/682311230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 0x55d4adb2d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb244e00640 1 -- 172.21.15.17:0/682311230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 msgr2=0x55d4adb79db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb244e00640 1 --2- 172.21.15.17:0/682311230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 0x55d4adb79db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb244e00640 1 -- 172.21.15.17:0/682311230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4ad942590 con 0x55d4adb2de10 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb244e00640 1 --2- 172.21.15.17:0/682311230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2e1f0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fb238009f40 tx=0x7fb23800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7954022d0f8ea8f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb234c00640 1 -- 172.21.15.17:0/682311230 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238003b80 con 0x55d4adb2de10 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb234c00640 1 -- 172.21.15.17:0/682311230 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb238003e10 con 0x55d4adb2de10 2024-09-10T23:27:27.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb234c00640 1 -- 172.21.15.17:0/682311230 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238004280 con 0x55d4adb2de10 2024-09-10T23:27:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- 172.21.15.17:0/682311230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 msgr2=0x55d4adb2e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/682311230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2e1f0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fb238009f40 tx=0x7fb23800f7f0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- 172.21.15.17:0/682311230 shutdown_connections 2024-09-10T23:27:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/682311230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2e1f0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/682311230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 0x55d4adb2d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/682311230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 0x55d4adb79db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- 172.21.15.17:0/682311230 >> 172.21.15.17:0/682311230 conn(0x55d4ada17130 msgr2=0x55d4adb5ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- 172.21.15.17:0/682311230 shutdown_connections 2024-09-10T23:27:27.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- 172.21.15.17:0/682311230 wait complete. 2024-09-10T23:27:27.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 -- start start 2024-09-10T23:27:27.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.669+0000 7fb24a1a0000 1 Processor -- start 2024-09-10T23:27:27.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 0x55d4adb2f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb7a2f0 0x55d4adb2fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d4ad9155d0 con 0x55d4adb2de10 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d4ad97ed60 con 0x55d4adb7a2f0 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d4ad921500 con 0x55d4adb799d0 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 10 client.0 _ll_register_callbacks cb 0x55d4ad925810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb23fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb23fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36662/0 (socket says 172.21.15.17:36662) 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb23fe00640 1 -- 172.21.15.17:0/484013182 learned_addr learned my addr 172.21.15.17:0/484013182 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb237e00640 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 0x55d4adb2f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb244e00640 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb7a2f0 0x55d4adb2fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb23fe00640 1 -- 172.21.15.17:0/484013182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 msgr2=0x55d4adb2f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb23fe00640 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 0x55d4adb2f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb23fe00640 1 -- 172.21.15.17:0/484013182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb7a2f0 msgr2=0x55d4adb2fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:27.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb23fe00640 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb7a2f0 0x55d4adb2fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb23fe00640 1 -- 172.21.15.17:0/484013182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4ad919170 con 0x55d4adb2de10 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb23fe00640 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2f240 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fb230091a80 tx=0x7fb23005e240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484a399160eb694f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb22d600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb22d600640 1 -- 172.21.15.17:0/484013182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23005da50 con 0x55d4adb2de10 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb22d600640 1 -- 172.21.15.17:0/484013182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fb2300652e0 con 0x55d4adb2de10 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 -- 172.21.15.17:0/484013182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4ad9130f0 con 0x55d4adb2de10 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb22d600640 1 -- 172.21.15.17:0/484013182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7fb2300630d0 con 0x55d4adb2de10 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 10 client.9849 fetch_fsmap learned FSMap version 121 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 -- 172.21.15.17:0/484013182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) -- 0x55d4ad9ffef0 con 0x55d4adb2de10 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb22d600640 1 -- 172.21.15.17:0/484013182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d4ad9130f0 con 0x55d4adb2de10 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb22d600640 1 -- 172.21.15.17:0/484013182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 121) ==== 3502+0+0 (secure 0 0 0) 0x7fb230059f40 con 0x55d4adb2de10 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 10 client.9849 fetch_fsmap finished waiting for FSMap version 121 2024-09-10T23:27:27.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 10 client.9849 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 20 client.9849 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x55d4adb88c70 0x55d4adb8b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 4 client.9849 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb24a1a0000 1 -- 172.21.15.17:0/484013182 --> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4ad98da70 con 0x55d4adb88c70 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb237e00640 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x55d4adb88c70 0x55d4adb8b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb237e00640 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x55d4adb88c70 0x55d4adb8b060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=338ac0d6e6ca7b6 server_cookie=98f6e7a48fea8b7f in_seq=0 out_seq=0 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.673+0000 7fb22d600640 10 client.9849 ms_handle_connect on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb22d600640 1 -- 172.21.15.17:0/484013182 <== mds.0 v2:172.21.15.17:6833/3026129347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4ad98da70 con 0x55d4adb88c70 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb22d600640 10 client.9849 handle_command_reply: tid=0 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 client.9849 shutdown 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 -- 172.21.15.17:0/484013182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 msgr2=0x55d4adb2f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2f240 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fb230091a80 tx=0x7fb23005e240 comp rx=0 tx=0).stop 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 -- 172.21.15.17:0/484013182 shutdown_connections 2024-09-10T23:27:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x55d4adb88c70 0x55d4adb8b060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb7a2f0 0x55d4adb2fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 0x55d4adb2f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb22d600640 0 client.9849 ms_handle_reset on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/484013182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb2f240 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 -- 172.21.15.17:0/484013182 >> 172.21.15.17:0/484013182 conn(0x55d4ada17130 msgr2=0x55d4adb2cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 -- 172.21.15.17:0/484013182 shutdown_connections 2024-09-10T23:27:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 1 -- 172.21.15.17:0/484013182 wait complete. 2024-09-10T23:27:27.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.677+0000 7fb24a1a0000 20 client.9849 trim_cache size 0 max 16384 2024-09-10T23:27:27.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.693+0000 7fb24a1a0000 1 Processor -- start 2024-09-10T23:27:27.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.693+0000 7fb24a1a0000 1 -- start start 2024-09-10T23:27:27.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb2de10 0x55d4adbeb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 0x55d4adbeb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb7a2f0 0x55d4adbebc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb2401f7fa0 con 0x55d4adb7a2f0 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb240152c40 con 0x55d4adb2de10 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb240153290 con 0x55d4adb799d0 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb244e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb7a2f0 0x55d4adbebc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb244e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb7a2f0 0x55d4adbebc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36672/0 (socket says 172.21.15.17:36672) 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb244e00640 1 -- 172.21.15.17:0/3336602576 learned_addr learned my addr 172.21.15.17:0/3336602576 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb237e00640 1 --2- 172.21.15.17:0/3336602576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 0x55d4adbeb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb23fe00640 1 --2- 172.21.15.17:0/3336602576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb2de10 0x55d4adbeb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb244e00640 1 -- 172.21.15.17:0/3336602576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 msgr2=0x55d4adbeb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb244e00640 1 --2- 172.21.15.17:0/3336602576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 0x55d4adbeb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb244e00640 1 -- 172.21.15.17:0/3336602576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb2de10 msgr2=0x55d4adbeb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb244e00640 1 --2- 172.21.15.17:0/3336602576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb2de10 0x55d4adbeb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb244e00640 1 -- 172.21.15.17:0/3336602576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4ad9d6d90 con 0x55d4adb7a2f0 2024-09-10T23:27:27.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb244e00640 1 --2- 172.21.15.17:0/3336602576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb7a2f0 0x55d4adbebc30 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fb238009a10 tx=0x7fb238004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83905e60e80b092 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:27.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb22fe00640 1 -- 172.21.15.17:0/3336602576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238009a40 con 0x55d4adb7a2f0 2024-09-10T23:27:27.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb22fe00640 1 -- 172.21.15.17:0/3336602576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb238003b90 con 0x55d4adb7a2f0 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb22fe00640 1 -- 172.21.15.17:0/3336602576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238004040 con 0x55d4adb7a2f0 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3336602576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb7a2f0 msgr2=0x55d4adbebc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3336602576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb7a2f0 0x55d4adbebc30 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fb238009a10 tx=0x7fb238004ac0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3336602576 shutdown_connections 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3336602576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb7a2f0 0x55d4adbebc30 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3336602576 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb799d0 0x55d4adbeb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3336602576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb2de10 0x55d4adbeb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3336602576 >> 172.21.15.17:0/3336602576 conn(0x55d4ada17130 msgr2=0x55d4adb2d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3336602576 shutdown_connections 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3336602576 wait complete. 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- start start 2024-09-10T23:27:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 Processor -- start 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb90160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 0x55d4adbab580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 0x55d4adbabac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d4ad97e070 con 0x55d4adb2de10 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d4ad983390 con 0x55d4adb799d0 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d4ad98a8f0 con 0x55d4adb7a2f0 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.697+0000 7fb24a1a0000 10 client.0 _ll_register_callbacks cb 0x7fb23005e4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb23fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb90160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb23fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb90160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36688/0 (socket says 172.21.15.17:36688) 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb23fe00640 1 -- 172.21.15.17:0/3023644044 learned_addr learned my addr 172.21.15.17:0/3023644044 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb237e00640 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 0x55d4adbab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb244e00640 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 0x55d4adbabac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb23fe00640 1 -- 172.21.15.17:0/3023644044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 msgr2=0x55d4adbabac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:27.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb23fe00640 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 0x55d4adbabac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb23fe00640 1 -- 172.21.15.17:0/3023644044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 msgr2=0x55d4adbab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:27.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb23fe00640 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 0x55d4adbab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb23fe00640 1 -- 172.21.15.17:0/3023644044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4ad941a90 con 0x55d4adb2de10 2024-09-10T23:27:27.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb237e00640 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 0x55d4adbab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:27.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb23fe00640 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb90160 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb23000ce50 tx=0x7fb230067550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711cdc60f71f134f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 1 -- 172.21.15.17:0/3023644044 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23005ac40 con 0x55d4adb2de10 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 1 -- 172.21.15.17:0/3023644044 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fb23005d2c0 con 0x55d4adb2de10 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3023644044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb238003b90 con 0x55d4adb2de10 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 1 -- 172.21.15.17:0/3023644044 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7fb23007f050 con 0x55d4adb2de10 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 10 client.9855 fetch_fsmap learned FSMap version 121 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3023644044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) -- 0x55d4ad920050 con 0x55d4adb2de10 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 1 -- 172.21.15.17:0/3023644044 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb238003b90 con 0x55d4adb2de10 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 1 -- 172.21.15.17:0/3023644044 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 121) ==== 3502+0+0 (secure 0 0 0) 0x7fb23005d4c0 con 0x55d4adb2de10 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 10 client.9855 fetch_fsmap finished waiting for FSMap version 121 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 10 client.9855 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:27:27.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 20 client.9855 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x55d4adbac000 0x55d4adbef610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 4 client.9855 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3023644044 --> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] -- command(tid 0: {"prefix": "status"}) -- 0x55d4ad989520 con 0x55d4adbac000 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb237e00640 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x55d4adbac000 0x55d4adbef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb237e00640 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x55d4adbac000 0x55d4adbef610 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b6c3463cc18bbe0 server_cookie=d99beaae302c91a5 in_seq=0 out_seq=0 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 10 client.9855 ms_handle_connect on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 1 -- 172.21.15.17:0/3023644044 <== mds.0 v2:172.21.15.17:6833/3026129347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55d4ad989520 con 0x55d4adbac000 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 10 client.9855 handle_command_reply: tid=0 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 client.9855 shutdown 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3023644044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 msgr2=0x55d4adb90160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb90160 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb23000ce50 tx=0x7fb230067550 comp rx=0 tx=0).stop 2024-09-10T23:27:27.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3023644044 shutdown_connections 2024-09-10T23:27:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x55d4adbac000 0x55d4adbef610 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d4adb7a2f0 0x55d4adbabac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d4adb799d0 0x55d4adbab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb22d600640 0 client.9855 ms_handle_reset on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 --2- 172.21.15.17:0/3023644044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4adb2de10 0x55d4adb90160 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3023644044 >> 172.21.15.17:0/3023644044 conn(0x55d4ada17130 msgr2=0x55d4adb8b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3023644044 shutdown_connections 2024-09-10T23:27:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 1 -- 172.21.15.17:0/3023644044 wait complete. 2024-09-10T23:27:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.701+0000 7fb24a1a0000 20 client.9855 trim_cache size 0 max 16384 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 9711, 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 10.607033799, 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 121, 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 166, 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 166, 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 15.082190149000001 2024-09-10T23:27:27.712 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:27:27.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 -- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb21c072610 msgr2=0x7fb21c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb21c072610 0x7fb21c074ad0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb2280af000 tx=0x7fb22801afd0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 -- 172.21.15.17:0/3711193984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb24015be80 msgr2=0x7fb2400c59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb24015be80 0x7fb2400c59f0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c490 tx=0x7fb23000c950 comp rx=0 tx=0).stop 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 -- 172.21.15.17:0/3711193984 shutdown_connections 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb21c072610 0x7fb21c074ad0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2400cb6f0 0x7fb24015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb24015fa00 0x7fb2400c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 --2- 172.21.15.17:0/3711193984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb24015be80 0x7fb2400c59f0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 -- 172.21.15.17:0/3711193984 >> 172.21.15.17:0/3711193984 conn(0x7fb2400d1da0 msgr2=0x7fb240154c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 -- 172.21.15.17:0/3711193984 shutdown_connections 2024-09-10T23:27:27.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.705+0000 7fb246e00640 1 -- 172.21.15.17:0/3711193984 wait complete. 2024-09-10T23:27:27.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:27:27.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 -- 172.21.15.17:0/2922176306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32dc0b32d0 msgr2=0x7f32dc150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 --2- 172.21.15.17:0/2922176306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32dc0b32d0 0x7f32dc150d70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f32d400acd0 tx=0x7f32d40205f0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 -- 172.21.15.17:0/2922176306 shutdown_connections 2024-09-10T23:27:27.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 --2- 172.21.15.17:0/2922176306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32dc0b32d0 0x7f32dc150d70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 --2- 172.21.15.17:0/2922176306 >> v2:172.21.15.77:3300/0 conn(0x7f32dc0cf610 0x7f32dc06e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 -- 172.21.15.17:0/2922176306 >> 172.21.15.17:0/2922176306 conn(0x7f32dc06cfc0 msgr2=0x7f32dc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:27.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 -- 172.21.15.17:0/2922176306 shutdown_connections 2024-09-10T23:27:27.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 -- 172.21.15.17:0/2922176306 wait complete. 2024-09-10T23:27:27.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 Processor -- start 2024-09-10T23:27:27.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.869+0000 7f32e1e00640 1 -- start start 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32dc0b32d0 0x7f32dc13c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32dc0cf230 0x7f32dc0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32e1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32dc0cf610 0x7f32dc0b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32e1e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc0d0330 con 0x7f32dc0cf610 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32e1e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f32dc0d01b0 con 0x7f32dc0cf230 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32e1e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f32dc0d04b0 con 0x7f32dc0b32d0 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32db400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32dc0cf610 0x7f32dc0b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32db400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32dc0cf610 0x7f32dc0b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36690/0 (socket says 172.21.15.17:36690) 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32db400640 1 -- 172.21.15.17:0/2396885644 learned_addr learned my addr 172.21.15.17:0/2396885644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32da000640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32dc0cf230 0x7f32dc0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32daa00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32dc0b32d0 0x7f32dc13c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32db400640 1 -- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32dc0b32d0 msgr2=0x7f32dc13c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32db400640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32dc0b32d0 0x7f32dc13c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32db400640 1 -- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32dc0cf230 msgr2=0x7f32dc0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32db400640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32dc0cf230 0x7f32dc0b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32db400640 1 -- 172.21.15.17:0/2396885644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc14e900 con 0x7f32dc0cf610 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32daa00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32dc0b32d0 0x7f32dc13c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32db400640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32dc0cf610 0x7f32dc0b0b00 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f32d401eca0 tx=0x7f32d4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32d3400640 1 -- 172.21.15.17:0/2396885644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d40b6070 con 0x7f32dc0cf610 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32d3400640 1 -- 172.21.15.17:0/2396885644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32d40c0070 con 0x7f32dc0cf610 2024-09-10T23:27:27.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32dc14ebe0 con 0x7f32dc0cf610 2024-09-10T23:27:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32d3400640 1 -- 172.21.15.17:0/2396885644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4004040 con 0x7f32dc0cf610 2024-09-10T23:27:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32dc149810 con 0x7f32dc0cf610 2024-09-10T23:27:27.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.873+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32dc149aa0 con 0x7f32dc0cf610 2024-09-10T23:27:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.877+0000 7f32d3400640 1 -- 172.21.15.17:0/2396885644 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f32d400b040 con 0x7f32dc0cf610 2024-09-10T23:27:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.877+0000 7f32d3400640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32bc0725e0 0x7f32bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.877+0000 7f32d3400640 1 -- 172.21.15.17:0/2396885644 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f32d4131070 con 0x7f32dc0cf610 2024-09-10T23:27:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.877+0000 7f32daa00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32bc0725e0 0x7f32bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.877+0000 7f32daa00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32bc0725e0 0x7f32bc074aa0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f32cc001230 tx=0x7f32cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:27.881+0000 7f32d3400640 1 -- 172.21.15.17:0/2396885644 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f32dc149aa0 con 0x7f32dc0cf610 2024-09-10T23:27:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f32dc150d70 con 0x7f32dc0cf610 2024-09-10T23:27:28.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32d3400640 1 -- 172.21.15.17:0/2396885644 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v121) ==== 53+0+73 (secure 0 0 0) 0x7f32d40c9060 con 0x7f32dc0cf610 2024-09-10T23:27:28.097 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:27:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32bc0725e0 msgr2=0x7f32bc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32bc0725e0 0x7f32bc074aa0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f32cc001230 tx=0x7f32cc009040 comp rx=0 tx=0).stop 2024-09-10T23:27:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32dc0cf610 msgr2=0x7f32dc0b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32dc0cf610 0x7f32dc0b0b00 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f32d401eca0 tx=0x7f32d4003f60 comp rx=0 tx=0).stop 2024-09-10T23:27:28.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 shutdown_connections 2024-09-10T23:27:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32bc0725e0 0x7f32bc074aa0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32dc0cf610 0x7f32dc0b0b00 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32dc0cf230 0x7f32dc0b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 --2- 172.21.15.17:0/2396885644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32dc0b32d0 0x7f32dc13c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 >> 172.21.15.17:0/2396885644 conn(0x7f32dc06cfc0 msgr2=0x7f32dc15d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 shutdown_connections 2024-09-10T23:27:28.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28.093+0000 7f32e1e00640 1 -- 172.21.15.17:0/2396885644 wait complete. 2024-09-10T23:27:28.118 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:27:28.118 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:27:28.119 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:27:28.119 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:27:28.119 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:27:28.119 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:27:28.119 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:27:28.119 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:27:28.120 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:27:28.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:28.120 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:27:28.130 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:27:28.130 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:27:28.130 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:27:28.130 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:27:28.130 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:27:28.130 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:27:28.130 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:27:28.130 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:27:28.130 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41723sec preferred_lft 41723sec 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:27:28.131 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:27:28.132 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:27:28.133 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:27:28.133 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:27:28.133 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:27:28.133 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:27:28.133 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:27:28.133 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:27:28.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:28.133 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:27:28.193 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:27:28.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:28.195 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:27:28.249 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:27:28.249 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:27:28.249 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:27:28.249 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:27:28.249 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:27:28.249 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:27:28.249 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:27:28.249 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:28.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:27:28.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:27:28.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:27:28.250 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:28.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:27:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:28.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:28.386 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:27:28.395 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:27:28.395 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:27:28.396 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:27:28.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:28.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:27:28.463 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:27:28.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:27:28.464 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:27:28.516 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:27:28.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:27:28.516 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:27:28.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:27:28.631 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:27:28.684 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:27:28.684 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:27:28.685 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:27:28.686 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:27:28.687 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:27:28.687 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:27:28.687 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:27:28.687 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:27:28.687 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:27:28.687 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:27:28.687 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:27:28.687 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:27:28.687 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:27:28.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:28.688 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:27:28.739 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:27:28.739 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:27:28.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:27:28.803 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:27:28.856 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:27:28.856 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:27:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:27:28.858 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:27:28.859 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:27:28.859 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:27:28.859 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:27:28.859 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:27:28.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:28.860 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:27:28.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:27:28.873+0000 7ff80e09b580 -1 init, newargv = 0x55bd30169f40 newargc=15 2024-09-10T23:27:28.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[81302]: starting ceph client 2024-09-10T23:27:28.884 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[81302]: starting fuse 2024-09-10T23:27:28.886 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:27:28.887 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:27:28.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:27:28.887 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:27:28.887 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:27:28.887 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:27:28.887 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:27:28.887 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:27:28.887 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:27:28.887 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:27:28.887 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:27:28.888 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:27:28.889 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:27:28.889 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:27:28.889 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:27:29.014 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.81302.asok 2024-09-10T23:27:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:29.025 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.81302.asok 2024-09-10T23:27:29.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:29.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.81302.asok status 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "81302", 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:29.203 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 9870, 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 9870 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3618149595 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:29.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3618149595 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.9870 192.168.0.1:0/3618149595", 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/3618149595", 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 121, 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 166, 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:27:29.205 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:27:29.206 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:27:29.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:29.218 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:27:29.218 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:27:29.227 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:27:29.227 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:27:29.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:29.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:27:29.291 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 -- 172.21.15.17:0/2606173054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 msgr2=0x7fe97415b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 --2- 172.21.15.17:0/2606173054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 0x7fe97415b240 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fe96000aa10 tx=0x7fe960020420 comp rx=0 tx=0).stop 2024-09-10T23:27:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 -- 172.21.15.17:0/2606173054 shutdown_connections 2024-09-10T23:27:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 --2- 172.21.15.17:0/2606173054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 0x7fe97415b240 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 --2- 172.21.15.17:0/2606173054 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9740cf230 0x7fe97406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 -- 172.21.15.17:0/2606173054 >> 172.21.15.17:0/2606173054 conn(0x7fe97406cfc0 msgr2=0x7fe97406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 -- 172.21.15.17:0/2606173054 shutdown_connections 2024-09-10T23:27:29.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 -- 172.21.15.17:0/2606173054 wait complete. 2024-09-10T23:27:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 Processor -- start 2024-09-10T23:27:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.477+0000 7fe97b800640 1 -- start start 2024-09-10T23:27:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe97b800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9740b32d0 0x7fe974152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe97b800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9740cf230 0x7fe9740aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe97b800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 0x7fe97414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe97b800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9740d0330 con 0x7fe9740cf610 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe97b800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9740d01b0 con 0x7fe9740b32d0 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe97b800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe9740d04b0 con 0x7fe9740cf230 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe979800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 0x7fe97414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe979800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 0x7fe97414e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36704/0 (socket says 172.21.15.17:36704) 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe979800640 1 -- 172.21.15.17:0/1781560810 learned_addr learned my addr 172.21.15.17:0/1781560810 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe973e00640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9740cf230 0x7fe9740aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe978e00640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9740b32d0 0x7fe974152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe979800640 1 -- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9740cf230 msgr2=0x7fe9740aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe979800640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9740cf230 0x7fe9740aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe979800640 1 -- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9740b32d0 msgr2=0x7fe974152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe979800640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9740b32d0 0x7fe974152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe979800640 1 -- 172.21.15.17:0/1781560810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9741f4cd0 con 0x7fe9740cf610 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe973e00640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9740cf230 0x7fe9740aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe978e00640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9740b32d0 0x7fe974152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe979800640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 0x7fe97414e6b0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c7b0 tx=0x7fe96c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe970c00640 1 -- 172.21.15.17:0/1781560810 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c004b70 con 0x7fe9740cf610 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe970c00640 1 -- 172.21.15.17:0/1781560810 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe96c004e00 con 0x7fe9740cf610 2024-09-10T23:27:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9741f4fb0 con 0x7fe9740cf610 2024-09-10T23:27:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe970c00640 1 -- 172.21.15.17:0/1781560810 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c00aab0 con 0x7fe9740cf610 2024-09-10T23:27:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9741f5570 con 0x7fe9740cf610 2024-09-10T23:27:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97406e750 con 0x7fe9740cf610 2024-09-10T23:27:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.481+0000 7fe970c00640 1 -- 172.21.15.17:0/1781560810 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe96c00ac50 con 0x7fe9740cf610 2024-09-10T23:27:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.485+0000 7fe970c00640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9540725e0 0x7fe954074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.485+0000 7fe970c00640 1 -- 172.21.15.17:0/1781560810 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fe96c093710 con 0x7fe9740cf610 2024-09-10T23:27:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.485+0000 7fe978e00640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9540725e0 0x7fe954074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.485+0000 7fe978e00640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9540725e0 0x7fe954074aa0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe968005fd0 tx=0x7fe968005e60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:29.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.489+0000 7fe970c00640 1 -- 172.21.15.17:0/1781560810 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe96c020070 con 0x7fe9740cf610 2024-09-10T23:27:29.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.697+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9740af3e0 con 0x7fe9740cf610 2024-09-10T23:27:29.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.697+0000 7fe970c00640 1 -- 172.21.15.17:0/1781560810 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7fe96c05ec50 con 0x7fe9740cf610 2024-09-10T23:27:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:29.703 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:27:29.703 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:27:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9540725e0 msgr2=0x7fe954074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9540725e0 0x7fe954074aa0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe968005fd0 tx=0x7fe968005e60 comp rx=0 tx=0).stop 2024-09-10T23:27:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 msgr2=0x7fe97414e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 0x7fe97414e6b0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c7b0 tx=0x7fe96c00cc70 comp rx=0 tx=0).stop 2024-09-10T23:27:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 shutdown_connections 2024-09-10T23:27:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9540725e0 0x7fe954074aa0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9740cf610 0x7fe97414e6b0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9740cf230 0x7fe9740aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 --2- 172.21.15.17:0/1781560810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9740b32d0 0x7fe974152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 >> 172.21.15.17:0/1781560810 conn(0x7fe97406cfc0 msgr2=0x7fe974068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 shutdown_connections 2024-09-10T23:27:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.701+0000 7fe97b800640 1 -- 172.21.15.17:0/1781560810 wait complete. 2024-09-10T23:27:29.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.865+0000 7f8954c00640 1 -- 172.21.15.17:0/3456153076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f895015f770 msgr2=0x7f89500cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.865+0000 7f8954c00640 1 --2- 172.21.15.17:0/3456153076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f895015f770 0x7f89500cc870 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f89500c5320 tx=0x7f893801c800 comp rx=0 tx=0).stop 2024-09-10T23:27:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.865+0000 7f8954c00640 1 -- 172.21.15.17:0/3456153076 shutdown_connections 2024-09-10T23:27:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.865+0000 7f8954c00640 1 --2- 172.21.15.17:0/3456153076 >> v2:172.21.15.77:3300/0 conn(0x7f89500d1830 0x7f89500ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.865+0000 7f8954c00640 1 --2- 172.21.15.17:0/3456153076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f895015f770 0x7f89500cc870 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.865+0000 7f8954c00640 1 -- 172.21.15.17:0/3456153076 >> 172.21.15.17:0/3456153076 conn(0x7f89500d1d60 msgr2=0x7f89500d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.865+0000 7f8954c00640 1 -- 172.21.15.17:0/3456153076 shutdown_connections 2024-09-10T23:27:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.865+0000 7f8954c00640 1 -- 172.21.15.17:0/3456153076 wait complete. 2024-09-10T23:27:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 Processor -- start 2024-09-10T23:27:29.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 -- start start 2024-09-10T23:27:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8950070ad0 0x7f8950153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89500d1830 0x7f8950165d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f895015f770 0x7f89500b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8950169330 con 0x7f8950070ad0 2024-09-10T23:27:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89501691b0 con 0x7f89500d1830 2024-09-10T23:27:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f89501694b0 con 0x7f895015f770 2024-09-10T23:27:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8950070ad0 0x7f8950153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8950070ad0 0x7f8950153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36720/0 (socket says 172.21.15.17:36720) 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894de00640 1 -- 172.21.15.17:0/2603298506 learned_addr learned my addr 172.21.15.17:0/2603298506 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8945400640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89500d1830 0x7f8950165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894e800640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f895015f770 0x7f89500b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894de00640 1 -- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f895015f770 msgr2=0x7f89500b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894de00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f895015f770 0x7f89500b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894de00640 1 -- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89500d1830 msgr2=0x7f8950165d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894de00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89500d1830 0x7f8950165d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894de00640 1 -- 172.21.15.17:0/2603298506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89500b0110 con 0x7f8950070ad0 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894e800640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f895015f770 0x7f89500b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f894de00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8950070ad0 0x7f8950153dc0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f894000c450 tx=0x7f894000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8946a00640 1 -- 172.21.15.17:0/2603298506 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940016020 con 0x7f8950070ad0 2024-09-10T23:27:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8946a00640 1 -- 172.21.15.17:0/2603298506 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8940012940 con 0x7f8950070ad0 2024-09-10T23:27:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8946a00640 1 -- 172.21.15.17:0/2603298506 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940012d90 con 0x7f8950070ad0 2024-09-10T23:27:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8950164c70 con 0x7f8950070ad0 2024-09-10T23:27:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8950165230 con 0x7f8950070ad0 2024-09-10T23:27:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.869+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f895015f060 con 0x7f8950070ad0 2024-09-10T23:27:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.873+0000 7f8946a00640 1 -- 172.21.15.17:0/2603298506 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f894001a3b0 con 0x7f8950070ad0 2024-09-10T23:27:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.873+0000 7f8946a00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f892c0725e0 0x7f892c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.873+0000 7f8946a00640 1 -- 172.21.15.17:0/2603298506 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f8940093080 con 0x7f8950070ad0 2024-09-10T23:27:29.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.873+0000 7f8945400640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f892c0725e0 0x7f892c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:29.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.873+0000 7f8945400640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f892c0725e0 0x7f892c074aa0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f89380af000 tx=0x7f893801b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:29.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:29.877+0000 7f8946a00640 1 -- 172.21.15.17:0/2603298506 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8940020070 con 0x7f8950070ad0 2024-09-10T23:27:30.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f895015aa70 con 0x7f8950070ad0 2024-09-10T23:27:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8946a00640 1 -- 172.21.15.17:0/2603298506 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7f894005e5c0 con 0x7f8950070ad0 2024-09-10T23:27:30.088 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:30.088 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:27:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:27:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f892c0725e0 msgr2=0x7f892c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f892c0725e0 0x7f892c074aa0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f89380af000 tx=0x7f893801b040 comp rx=0 tx=0).stop 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8950070ad0 msgr2=0x7f8950153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8950070ad0 0x7f8950153dc0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f894000c450 tx=0x7f894000c910 comp rx=0 tx=0).stop 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 shutdown_connections 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f892c0725e0 0x7f892c074aa0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f895015f770 0x7f89500b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89500d1830 0x7f8950165d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 --2- 172.21.15.17:0/2603298506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8950070ad0 0x7f8950153dc0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 >> 172.21.15.17:0/2603298506 conn(0x7f89500d1d60 msgr2=0x7f89500afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 shutdown_connections 2024-09-10T23:27:30.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30.085+0000 7f8954c00640 1 -- 172.21.15.17:0/2603298506 wait complete. 2024-09-10T23:27:30.110 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:30.110 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:30.111 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T23:27:30.111 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:30.111 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:30.111 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:30.111 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:30.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.198 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164311 s, 63.8 MB/s 2024-09-10T23:27:30.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164983 s, 63.6 MB/s 2024-09-10T23:27:30.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.240 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168724 s, 62.1 MB/s 2024-09-10T23:27:30.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132743 s, 79.0 MB/s 2024-09-10T23:27:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173581 s, 60.4 MB/s 2024-09-10T23:27:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.300 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164202 s, 63.9 MB/s 2024-09-10T23:27:30.317 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.317 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.317 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134641 s, 77.9 MB/s 2024-09-10T23:27:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.336 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147242 s, 71.2 MB/s 2024-09-10T23:27:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131454 s, 79.8 MB/s 2024-09-10T23:27:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014505 s, 72.3 MB/s 2024-09-10T23:27:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143163 s, 73.2 MB/s 2024-09-10T23:27:30.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131563 s, 79.7 MB/s 2024-09-10T23:27:30.424 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.424 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.424 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129493 s, 81.0 MB/s 2024-09-10T23:27:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146733 s, 71.5 MB/s 2024-09-10T23:27:30.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.459 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121882 s, 86.0 MB/s 2024-09-10T23:27:30.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134884 s, 77.7 MB/s 2024-09-10T23:27:30.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.493 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120014 s, 87.4 MB/s 2024-09-10T23:27:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131619 s, 79.7 MB/s 2024-09-10T23:27:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141989 s, 73.8 MB/s 2024-09-10T23:27:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126277 s, 83.0 MB/s 2024-09-10T23:27:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132995 s, 78.8 MB/s 2024-09-10T23:27:30.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.580 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147935 s, 70.9 MB/s 2024-09-10T23:27:30.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.599 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150492 s, 69.7 MB/s 2024-09-10T23:27:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116329 s, 90.1 MB/s 2024-09-10T23:27:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121782 s, 86.1 MB/s 2024-09-10T23:27:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136889 s, 76.6 MB/s 2024-09-10T23:27:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.664 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.664 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129138 s, 81.2 MB/s 2024-09-10T23:27:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119127 s, 88.0 MB/s 2024-09-10T23:27:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138153 s, 75.9 MB/s 2024-09-10T23:27:30.713 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.713 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.713 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013007 s, 80.6 MB/s 2024-09-10T23:27:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.729 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124935 s, 83.9 MB/s 2024-09-10T23:27:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129265 s, 81.1 MB/s 2024-09-10T23:27:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:30.754 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:30.754 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:30.754 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T23:27:30.754 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:30.754 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:30.754 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:30.755 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:30.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131771 s, 79.6 MB/s 2024-09-10T23:27:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138666 s, 75.6 MB/s 2024-09-10T23:27:30.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142185 s, 73.7 MB/s 2024-09-10T23:27:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.877 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125749 s, 83.4 MB/s 2024-09-10T23:27:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.894 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127258 s, 82.4 MB/s 2024-09-10T23:27:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133327 s, 78.6 MB/s 2024-09-10T23:27:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.928 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133709 s, 78.4 MB/s 2024-09-10T23:27:30.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.944 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129153 s, 81.2 MB/s 2024-09-10T23:27:30.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.961 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012775 s, 82.1 MB/s 2024-09-10T23:27:30.977 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.977 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.977 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123291 s, 85.0 MB/s 2024-09-10T23:27:30.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:30.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:30.993 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120568 s, 87.0 MB/s 2024-09-10T23:27:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119079 s, 88.1 MB/s 2024-09-10T23:27:31.025 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.025 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.025 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128456 s, 81.6 MB/s 2024-09-10T23:27:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145737 s, 71.9 MB/s 2024-09-10T23:27:31.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.058 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115584 s, 90.7 MB/s 2024-09-10T23:27:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119992 s, 87.4 MB/s 2024-09-10T23:27:31.090 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.090 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.091 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130208 s, 80.5 MB/s 2024-09-10T23:27:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118971 s, 88.1 MB/s 2024-09-10T23:27:31.123 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.124 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013925 s, 75.3 MB/s 2024-09-10T23:27:31.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.140 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132971 s, 78.9 MB/s 2024-09-10T23:27:31.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.157 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127493 s, 82.2 MB/s 2024-09-10T23:27:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.173 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123513 s, 84.9 MB/s 2024-09-10T23:27:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.190 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135615 s, 77.3 MB/s 2024-09-10T23:27:31.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.205 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.205 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119583 s, 87.7 MB/s 2024-09-10T23:27:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122758 s, 85.4 MB/s 2024-09-10T23:27:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123542 s, 84.9 MB/s 2024-09-10T23:27:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123167 s, 85.1 MB/s 2024-09-10T23:27:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.269 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129201 s, 81.2 MB/s 2024-09-10T23:27:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129694 s, 80.8 MB/s 2024-09-10T23:27:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125458 s, 83.6 MB/s 2024-09-10T23:27:31.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.319 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133493 s, 78.5 MB/s 2024-09-10T23:27:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134344 s, 78.1 MB/s 2024-09-10T23:27:31.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:31.343 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:31.343 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:31.343 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T23:27:31.343 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:31.344 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:31.344 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:31.344 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:31.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.416 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131352 s, 79.8 MB/s 2024-09-10T23:27:31.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.433 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144415 s, 72.6 MB/s 2024-09-10T23:27:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130011 s, 80.7 MB/s 2024-09-10T23:27:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135671 s, 77.3 MB/s 2024-09-10T23:27:31.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.485 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136086 s, 77.1 MB/s 2024-09-10T23:27:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.502 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139052 s, 75.4 MB/s 2024-09-10T23:27:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134852 s, 77.8 MB/s 2024-09-10T23:27:31.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.536 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133591 s, 78.5 MB/s 2024-09-10T23:27:31.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.553 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.553 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127745 s, 82.1 MB/s 2024-09-10T23:27:31.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.570 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013898 s, 75.4 MB/s 2024-09-10T23:27:31.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.587 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134345 s, 78.1 MB/s 2024-09-10T23:27:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.604 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130888 s, 80.1 MB/s 2024-09-10T23:27:31.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.624 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135131 s, 77.6 MB/s 2024-09-10T23:27:31.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.638 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134775 s, 77.8 MB/s 2024-09-10T23:27:31.655 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.655 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.655 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134364 s, 78.0 MB/s 2024-09-10T23:27:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141139 s, 74.3 MB/s 2024-09-10T23:27:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128535 s, 81.6 MB/s 2024-09-10T23:27:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128266 s, 81.8 MB/s 2024-09-10T23:27:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.723 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132119 s, 79.4 MB/s 2024-09-10T23:27:31.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.739 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124745 s, 84.1 MB/s 2024-09-10T23:27:31.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.756 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132871 s, 78.9 MB/s 2024-09-10T23:27:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124319 s, 84.3 MB/s 2024-09-10T23:27:31.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.789 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128418 s, 81.7 MB/s 2024-09-10T23:27:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129625 s, 80.9 MB/s 2024-09-10T23:27:31.824 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.824 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.824 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146268 s, 71.7 MB/s 2024-09-10T23:27:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140069 s, 74.9 MB/s 2024-09-10T23:27:31.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.858 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128658 s, 81.5 MB/s 2024-09-10T23:27:31.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.876 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141964 s, 73.9 MB/s 2024-09-10T23:27:31.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.892 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121702 s, 86.2 MB/s 2024-09-10T23:27:31.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.908 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125915 s, 83.3 MB/s 2024-09-10T23:27:31.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128607 s, 81.5 MB/s 2024-09-10T23:27:31.942 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:31.942 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:31.942 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135772 s, 77.2 MB/s 2024-09-10T23:27:31.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:31.949 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:31.949 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:31.949 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T23:27:31.949 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:31.949 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:31.949 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:31.950 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:31.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121678 s, 86.2 MB/s 2024-09-10T23:27:32.039 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.039 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.039 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141743 s, 74.0 MB/s 2024-09-10T23:27:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123757 s, 84.7 MB/s 2024-09-10T23:27:32.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142773 s, 73.4 MB/s 2024-09-10T23:27:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.091 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136414 s, 76.9 MB/s 2024-09-10T23:27:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.108 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132034 s, 79.4 MB/s 2024-09-10T23:27:32.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132469 s, 79.2 MB/s 2024-09-10T23:27:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012511 s, 83.8 MB/s 2024-09-10T23:27:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.160 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143932 s, 72.9 MB/s 2024-09-10T23:27:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.177 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130905 s, 80.1 MB/s 2024-09-10T23:27:32.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.195 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136744 s, 76.7 MB/s 2024-09-10T23:27:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013481 s, 77.8 MB/s 2024-09-10T23:27:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121155 s, 86.5 MB/s 2024-09-10T23:27:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125046 s, 83.9 MB/s 2024-09-10T23:27:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138334 s, 75.8 MB/s 2024-09-10T23:27:32.280 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.280 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.280 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119395 s, 87.8 MB/s 2024-09-10T23:27:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.297 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125524 s, 83.5 MB/s 2024-09-10T23:27:32.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.314 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012692 s, 82.6 MB/s 2024-09-10T23:27:32.330 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.330 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.331 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012483 s, 84.0 MB/s 2024-09-10T23:27:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.347 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119819 s, 87.5 MB/s 2024-09-10T23:27:32.363 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.363 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.363 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125407 s, 83.6 MB/s 2024-09-10T23:27:32.380 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.380 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.381 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130598 s, 80.3 MB/s 2024-09-10T23:27:32.399 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.399 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.399 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145022 s, 72.3 MB/s 2024-09-10T23:27:32.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.415 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121734 s, 86.1 MB/s 2024-09-10T23:27:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.433 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135742 s, 77.2 MB/s 2024-09-10T23:27:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125009 s, 83.9 MB/s 2024-09-10T23:27:32.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139083 s, 75.4 MB/s 2024-09-10T23:27:32.485 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.486 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013483 s, 77.8 MB/s 2024-09-10T23:27:32.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.504 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014345 s, 73.1 MB/s 2024-09-10T23:27:32.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.522 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132175 s, 79.3 MB/s 2024-09-10T23:27:32.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.539 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013783 s, 76.1 MB/s 2024-09-10T23:27:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139854 s, 75.0 MB/s 2024-09-10T23:27:32.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:32.565 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:32.565 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:32.565 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T23:27:32.565 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:32.565 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:32.566 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:32.566 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:32.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016437 s, 63.8 MB/s 2024-09-10T23:27:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188357 s, 55.7 MB/s 2024-09-10T23:27:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185071 s, 56.7 MB/s 2024-09-10T23:27:32.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.707 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142781 s, 73.4 MB/s 2024-09-10T23:27:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.724 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127616 s, 82.2 MB/s 2024-09-10T23:27:32.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.740 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121583 s, 86.2 MB/s 2024-09-10T23:27:32.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.756 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125375 s, 83.6 MB/s 2024-09-10T23:27:32.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.772 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124907 s, 83.9 MB/s 2024-09-10T23:27:32.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.788 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124743 s, 84.1 MB/s 2024-09-10T23:27:32.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.805 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130573 s, 80.3 MB/s 2024-09-10T23:27:32.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.824 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140638 s, 74.6 MB/s 2024-09-10T23:27:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141912 s, 73.9 MB/s 2024-09-10T23:27:32.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147526 s, 71.1 MB/s 2024-09-10T23:27:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137822 s, 76.1 MB/s 2024-09-10T23:27:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.897 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126753 s, 82.7 MB/s 2024-09-10T23:27:32.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.914 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124959 s, 83.9 MB/s 2024-09-10T23:27:32.932 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.932 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.932 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014263 s, 73.5 MB/s 2024-09-10T23:27:32.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.949 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119095 s, 88.0 MB/s 2024-09-10T23:27:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.966 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126411 s, 82.9 MB/s 2024-09-10T23:27:32.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:32.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:32.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138497 s, 75.7 MB/s 2024-09-10T23:27:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143891 s, 72.9 MB/s 2024-09-10T23:27:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128955 s, 81.3 MB/s 2024-09-10T23:27:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136432 s, 76.9 MB/s 2024-09-10T23:27:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.054 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133472 s, 78.6 MB/s 2024-09-10T23:27:33.072 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.072 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.072 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139848 s, 75.0 MB/s 2024-09-10T23:27:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.089 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133011 s, 78.8 MB/s 2024-09-10T23:27:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.106 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129281 s, 81.1 MB/s 2024-09-10T23:27:33.123 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.123 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.123 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128595 s, 81.5 MB/s 2024-09-10T23:27:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144485 s, 72.6 MB/s 2024-09-10T23:27:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150147 s, 69.8 MB/s 2024-09-10T23:27:33.177 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.178 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130933 s, 80.1 MB/s 2024-09-10T23:27:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135009 s, 77.7 MB/s 2024-09-10T23:27:33.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:33.202 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:33.202 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:33.203 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T23:27:33.203 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:33.203 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:33.203 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:33.203 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:33.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.314 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124403 s, 84.3 MB/s 2024-09-10T23:27:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013817 s, 75.9 MB/s 2024-09-10T23:27:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.348 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012801 s, 81.9 MB/s 2024-09-10T23:27:33.364 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.364 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.364 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129173 s, 81.2 MB/s 2024-09-10T23:27:33.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.384 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148676 s, 70.5 MB/s 2024-09-10T23:27:33.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.401 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137929 s, 76.0 MB/s 2024-09-10T23:27:33.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.417 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129568 s, 80.9 MB/s 2024-09-10T23:27:33.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.434 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126536 s, 82.9 MB/s 2024-09-10T23:27:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.451 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130582 s, 80.3 MB/s 2024-09-10T23:27:33.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.467 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134247 s, 78.1 MB/s 2024-09-10T23:27:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129706 s, 80.8 MB/s 2024-09-10T23:27:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.501 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139374 s, 75.2 MB/s 2024-09-10T23:27:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127591 s, 82.2 MB/s 2024-09-10T23:27:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142733 s, 73.5 MB/s 2024-09-10T23:27:33.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.553 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.553 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125396 s, 83.6 MB/s 2024-09-10T23:27:33.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.568 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123162 s, 85.1 MB/s 2024-09-10T23:27:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.584 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118553 s, 88.4 MB/s 2024-09-10T23:27:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135425 s, 77.4 MB/s 2024-09-10T23:27:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014031 s, 74.7 MB/s 2024-09-10T23:27:33.636 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.636 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.636 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129605 s, 80.9 MB/s 2024-09-10T23:27:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140638 s, 74.6 MB/s 2024-09-10T23:27:33.671 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.672 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144604 s, 72.5 MB/s 2024-09-10T23:27:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.688 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125459 s, 83.6 MB/s 2024-09-10T23:27:33.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131846 s, 79.5 MB/s 2024-09-10T23:27:33.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.721 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128607 s, 81.5 MB/s 2024-09-10T23:27:33.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.738 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130298 s, 80.5 MB/s 2024-09-10T23:27:33.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128074 s, 81.9 MB/s 2024-09-10T23:27:33.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137038 s, 76.5 MB/s 2024-09-10T23:27:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127512 s, 82.2 MB/s 2024-09-10T23:27:33.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.806 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.806 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136903 s, 76.6 MB/s 2024-09-10T23:27:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013282 s, 78.9 MB/s 2024-09-10T23:27:33.840 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.840 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.840 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137762 s, 76.1 MB/s 2024-09-10T23:27:33.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:33.848 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:33.848 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:33.848 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T23:27:33.848 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:33.848 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:33.848 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:33.848 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:33.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:33.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141619 s, 74.0 MB/s 2024-09-10T23:27:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130899 s, 80.1 MB/s 2024-09-10T23:27:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127733 s, 82.1 MB/s 2024-09-10T23:27:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123851 s, 84.7 MB/s 2024-09-10T23:27:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122157 s, 85.8 MB/s 2024-09-10T23:27:34.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.004 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147611 s, 71.0 MB/s 2024-09-10T23:27:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013542 s, 77.4 MB/s 2024-09-10T23:27:34.037 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.038 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.038 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126053 s, 83.2 MB/s 2024-09-10T23:27:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139867 s, 75.0 MB/s 2024-09-10T23:27:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119887 s, 87.5 MB/s 2024-09-10T23:27:34.086 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.086 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.086 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114092 s, 91.9 MB/s 2024-09-10T23:27:34.101 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.101 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115815 s, 90.5 MB/s 2024-09-10T23:27:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.117 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121583 s, 86.2 MB/s 2024-09-10T23:27:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121523 s, 86.3 MB/s 2024-09-10T23:27:34.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.148 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112174 s, 93.5 MB/s 2024-09-10T23:27:34.164 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.164 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.164 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120467 s, 87.0 MB/s 2024-09-10T23:27:34.179 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.179 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.179 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111175 s, 94.3 MB/s 2024-09-10T23:27:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.194 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118425 s, 88.5 MB/s 2024-09-10T23:27:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133936 s, 78.3 MB/s 2024-09-10T23:27:34.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.227 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122354 s, 85.7 MB/s 2024-09-10T23:27:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115678 s, 90.6 MB/s 2024-09-10T23:27:34.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.257 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110037 s, 95.3 MB/s 2024-09-10T23:27:34.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.274 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130472 s, 80.4 MB/s 2024-09-10T23:27:34.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.289 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113095 s, 92.7 MB/s 2024-09-10T23:27:34.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.304 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113127 s, 92.7 MB/s 2024-09-10T23:27:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012558 s, 83.5 MB/s 2024-09-10T23:27:34.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.335 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010831 s, 96.8 MB/s 2024-09-10T23:27:34.349 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.349 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.349 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107372 s, 97.7 MB/s 2024-09-10T23:27:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.365 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122187 s, 85.8 MB/s 2024-09-10T23:27:34.380 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.380 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.380 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010957 s, 95.7 MB/s 2024-09-10T23:27:34.395 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.395 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.396 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118438 s, 88.5 MB/s 2024-09-10T23:27:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116378 s, 90.1 MB/s 2024-09-10T23:27:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:34.418 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:34.418 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:34.418 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T23:27:34.418 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:34.418 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:34.418 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:34.418 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:34.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:34.488 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114741 s, 91.4 MB/s 2024-09-10T23:27:34.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.505 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121761 s, 86.1 MB/s 2024-09-10T23:27:34.520 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012475 s, 84.1 MB/s 2024-09-10T23:27:34.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.536 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121055 s, 86.6 MB/s 2024-09-10T23:27:34.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.552 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120589 s, 87.0 MB/s 2024-09-10T23:27:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114898 s, 91.3 MB/s 2024-09-10T23:27:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109999 s, 95.3 MB/s 2024-09-10T23:27:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114851 s, 91.3 MB/s 2024-09-10T23:27:34.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.612 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112135 s, 93.5 MB/s 2024-09-10T23:27:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011335 s, 92.5 MB/s 2024-09-10T23:27:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115765 s, 90.6 MB/s 2024-09-10T23:27:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012667 s, 82.8 MB/s 2024-09-10T23:27:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110004 s, 95.3 MB/s 2024-09-10T23:27:34.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.689 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114396 s, 91.7 MB/s 2024-09-10T23:27:34.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123215 s, 85.1 MB/s 2024-09-10T23:27:34.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.784 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121419 s, 86.4 MB/s 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123772 s, 84.7 MB/s 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112429 s, 93.3 MB/s 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110745 s, 94.7 MB/s 2024-09-10T23:27:34.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.786 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.786 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011283 s, 92.9 MB/s 2024-09-10T23:27:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.796 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010868 s, 96.5 MB/s 2024-09-10T23:27:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132638 s, 79.1 MB/s 2024-09-10T23:27:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125438 s, 83.6 MB/s 2024-09-10T23:27:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116048 s, 90.4 MB/s 2024-09-10T23:27:34.860 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122632 s, 85.5 MB/s 2024-09-10T23:27:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114868 s, 91.3 MB/s 2024-09-10T23:27:34.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.893 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129958 s, 80.7 MB/s 2024-09-10T23:27:34.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121539 s, 86.3 MB/s 2024-09-10T23:27:34.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011724 s, 89.4 MB/s 2024-09-10T23:27:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133708 s, 78.4 MB/s 2024-09-10T23:27:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112308 s, 93.4 MB/s 2024-09-10T23:27:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112731 s, 93.0 MB/s 2024-09-10T23:27:34.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:34.978 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:34.978 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:34.978 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T23:27:34.978 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:34.978 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:34.978 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:34.978 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:35.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.051 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141871 s, 73.9 MB/s 2024-09-10T23:27:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112579 s, 93.1 MB/s 2024-09-10T23:27:35.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119314 s, 87.9 MB/s 2024-09-10T23:27:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122477 s, 85.6 MB/s 2024-09-10T23:27:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010691 s, 98.1 MB/s 2024-09-10T23:27:35.127 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.127 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.127 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114358 s, 91.7 MB/s 2024-09-10T23:27:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109109 s, 96.1 MB/s 2024-09-10T23:27:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114186 s, 91.8 MB/s 2024-09-10T23:27:35.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.172 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110911 s, 94.5 MB/s 2024-09-10T23:27:35.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.186 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105578 s, 99.3 MB/s 2024-09-10T23:27:35.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.201 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.201 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119897 s, 87.5 MB/s 2024-09-10T23:27:35.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118635 s, 88.4 MB/s 2024-09-10T23:27:35.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120136 s, 87.3 MB/s 2024-09-10T23:27:35.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.249 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122972 s, 85.3 MB/s 2024-09-10T23:27:35.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.263 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111989 s, 93.6 MB/s 2024-09-10T23:27:35.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116653 s, 89.9 MB/s 2024-09-10T23:27:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108976 s, 96.2 MB/s 2024-09-10T23:27:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.310 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130496 s, 80.4 MB/s 2024-09-10T23:27:35.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.327 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131923 s, 79.5 MB/s 2024-09-10T23:27:35.341 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.342 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01082 s, 96.9 MB/s 2024-09-10T23:27:35.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.358 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121206 s, 86.5 MB/s 2024-09-10T23:27:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129918 s, 80.7 MB/s 2024-09-10T23:27:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012875 s, 81.4 MB/s 2024-09-10T23:27:35.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.405 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.405 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106335 s, 98.6 MB/s 2024-09-10T23:27:35.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115118 s, 91.1 MB/s 2024-09-10T23:27:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121875 s, 86.0 MB/s 2024-09-10T23:27:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113534 s, 92.4 MB/s 2024-09-10T23:27:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115383 s, 90.9 MB/s 2024-09-10T23:27:35.482 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.483 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117314 s, 89.4 MB/s 2024-09-10T23:27:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011088 s, 94.6 MB/s 2024-09-10T23:27:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107472 s, 97.6 MB/s 2024-09-10T23:27:35.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.527 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110059 s, 95.3 MB/s 2024-09-10T23:27:35.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:35.534 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:35.534 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:35.534 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T23:27:35.534 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:35.534 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:35.534 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:35.534 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:35.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:35.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.606 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121614 s, 86.2 MB/s 2024-09-10T23:27:35.620 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.621 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111795 s, 93.8 MB/s 2024-09-10T23:27:35.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.637 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130514 s, 80.3 MB/s 2024-09-10T23:27:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.652 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113949 s, 92.0 MB/s 2024-09-10T23:27:35.667 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.667 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.667 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110786 s, 94.6 MB/s 2024-09-10T23:27:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117426 s, 89.3 MB/s 2024-09-10T23:27:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131362 s, 79.8 MB/s 2024-09-10T23:27:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.715 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112072 s, 93.6 MB/s 2024-09-10T23:27:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106129 s, 98.8 MB/s 2024-09-10T23:27:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128625 s, 81.5 MB/s 2024-09-10T23:27:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122559 s, 85.6 MB/s 2024-09-10T23:27:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.778 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124248 s, 84.4 MB/s 2024-09-10T23:27:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116763 s, 89.8 MB/s 2024-09-10T23:27:35.807 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.808 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.808 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109601 s, 95.7 MB/s 2024-09-10T23:27:35.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.822 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010803 s, 97.1 MB/s 2024-09-10T23:27:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121301 s, 86.4 MB/s 2024-09-10T23:27:35.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.854 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121786 s, 86.1 MB/s 2024-09-10T23:27:35.870 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.870 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.871 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126669 s, 82.8 MB/s 2024-09-10T23:27:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120319 s, 87.1 MB/s 2024-09-10T23:27:35.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012257 s, 85.5 MB/s 2024-09-10T23:27:35.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.925 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115666 s, 90.7 MB/s 2024-09-10T23:27:35.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.938 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104679 s, 100 MB/s 2024-09-10T23:27:35.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.953 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106174 s, 98.8 MB/s 2024-09-10T23:27:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012015 s, 87.3 MB/s 2024-09-10T23:27:35.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.983 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111772 s, 93.8 MB/s 2024-09-10T23:27:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110745 s, 94.7 MB/s 2024-09-10T23:27:36.012 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.012 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.012 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108559 s, 96.6 MB/s 2024-09-10T23:27:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122165 s, 85.8 MB/s 2024-09-10T23:27:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011181 s, 93.8 MB/s 2024-09-10T23:27:36.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.058 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109495 s, 95.8 MB/s 2024-09-10T23:27:36.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.073 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116317 s, 90.1 MB/s 2024-09-10T23:27:36.087 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.087 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.087 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010836 s, 96.8 MB/s 2024-09-10T23:27:36.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:36.095 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:36.095 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:36.095 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T23:27:36.095 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:36.095 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:36.095 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:36.095 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:36.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:36.166 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.166 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.166 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118015 s, 88.9 MB/s 2024-09-10T23:27:36.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.182 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123981 s, 84.6 MB/s 2024-09-10T23:27:36.199 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.199 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.199 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01274 s, 82.3 MB/s 2024-09-10T23:27:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112543 s, 93.2 MB/s 2024-09-10T23:27:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107843 s, 97.2 MB/s 2024-09-10T23:27:36.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.243 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110904 s, 94.5 MB/s 2024-09-10T23:27:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012356 s, 84.9 MB/s 2024-09-10T23:27:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.276 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131716 s, 79.6 MB/s 2024-09-10T23:27:36.291 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.292 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123519 s, 84.9 MB/s 2024-09-10T23:27:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010919 s, 96.0 MB/s 2024-09-10T23:27:36.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111535 s, 94.0 MB/s 2024-09-10T23:27:36.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.336 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.336 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117731 s, 89.1 MB/s 2024-09-10T23:27:36.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123468 s, 84.9 MB/s 2024-09-10T23:27:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112418 s, 93.3 MB/s 2024-09-10T23:27:36.383 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.384 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124729 s, 84.1 MB/s 2024-09-10T23:27:36.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.398 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107429 s, 97.6 MB/s 2024-09-10T23:27:36.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.413 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114552 s, 91.5 MB/s 2024-09-10T23:27:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.429 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128212 s, 81.8 MB/s 2024-09-10T23:27:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121025 s, 86.6 MB/s 2024-09-10T23:27:36.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.461 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122241 s, 85.8 MB/s 2024-09-10T23:27:36.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119379 s, 87.8 MB/s 2024-09-10T23:27:36.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.492 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012268 s, 85.5 MB/s 2024-09-10T23:27:36.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.508 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122207 s, 85.8 MB/s 2024-09-10T23:27:36.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.524 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121828 s, 86.1 MB/s 2024-09-10T23:27:36.540 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.540 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.540 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122497 s, 85.6 MB/s 2024-09-10T23:27:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120795 s, 86.8 MB/s 2024-09-10T23:27:36.572 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.572 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.572 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126313 s, 83.0 MB/s 2024-09-10T23:27:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114671 s, 91.4 MB/s 2024-09-10T23:27:36.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.602 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110931 s, 94.5 MB/s 2024-09-10T23:27:36.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.617 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.617 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117479 s, 89.3 MB/s 2024-09-10T23:27:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117126 s, 89.5 MB/s 2024-09-10T23:27:36.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.649 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123465 s, 84.9 MB/s 2024-09-10T23:27:36.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:36.657 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:36.657 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:36.657 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T23:27:36.657 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:36.657 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:36.657 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:36.657 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:36.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:36.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.728 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122893 s, 85.3 MB/s 2024-09-10T23:27:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121381 s, 86.4 MB/s 2024-09-10T23:27:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124366 s, 84.3 MB/s 2024-09-10T23:27:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125074 s, 83.8 MB/s 2024-09-10T23:27:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104749 s, 100 MB/s 2024-09-10T23:27:36.807 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.807 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.807 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123663 s, 84.8 MB/s 2024-09-10T23:27:36.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.822 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.823 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121465 s, 86.3 MB/s 2024-09-10T23:27:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119534 s, 87.7 MB/s 2024-09-10T23:27:36.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.854 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.854 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011903 s, 88.1 MB/s 2024-09-10T23:27:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119417 s, 87.8 MB/s 2024-09-10T23:27:36.888 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.888 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.888 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145037 s, 72.3 MB/s 2024-09-10T23:27:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.917 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.917 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117593 s, 89.2 MB/s 2024-09-10T23:27:36.932 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.932 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.932 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121816 s, 86.1 MB/s 2024-09-10T23:27:36.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.948 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120665 s, 86.9 MB/s 2024-09-10T23:27:36.963 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.963 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.963 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110642 s, 94.8 MB/s 2024-09-10T23:27:36.979 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.979 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.979 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119889 s, 87.5 MB/s 2024-09-10T23:27:36.995 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:36.995 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:36.995 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120327 s, 87.1 MB/s 2024-09-10T23:27:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.011 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121776 s, 86.1 MB/s 2024-09-10T23:27:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118407 s, 88.6 MB/s 2024-09-10T23:27:37.042 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.042 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.043 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125059 s, 83.8 MB/s 2024-09-10T23:27:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124877 s, 84.0 MB/s 2024-09-10T23:27:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.073 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010414 s, 101 MB/s 2024-09-10T23:27:37.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120477 s, 87.0 MB/s 2024-09-10T23:27:37.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.105 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128185 s, 81.8 MB/s 2024-09-10T23:27:37.119 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108053 s, 97.0 MB/s 2024-09-10T23:27:37.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.137 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123769 s, 84.7 MB/s 2024-09-10T23:27:37.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.152 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106556 s, 98.4 MB/s 2024-09-10T23:27:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012085 s, 86.8 MB/s 2024-09-10T23:27:37.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.185 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126888 s, 82.6 MB/s 2024-09-10T23:27:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109136 s, 96.1 MB/s 2024-09-10T23:27:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125359 s, 83.6 MB/s 2024-09-10T23:27:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126645 s, 82.8 MB/s 2024-09-10T23:27:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:37.241 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:37.241 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:37.241 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T23:27:37.241 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:37.242 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:37.242 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:37.242 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115717 s, 90.6 MB/s 2024-09-10T23:27:37.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.328 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106357 s, 98.6 MB/s 2024-09-10T23:27:37.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.345 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.345 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120376 s, 87.1 MB/s 2024-09-10T23:27:37.360 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.360 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.361 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125684 s, 83.4 MB/s 2024-09-10T23:27:37.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.377 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012252 s, 85.6 MB/s 2024-09-10T23:27:37.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.392 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109259 s, 96.0 MB/s 2024-09-10T23:27:37.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.408 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.408 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111602 s, 94.0 MB/s 2024-09-10T23:27:37.422 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.423 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108378 s, 96.8 MB/s 2024-09-10T23:27:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.438 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109942 s, 95.4 MB/s 2024-09-10T23:27:37.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.454 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113103 s, 92.7 MB/s 2024-09-10T23:27:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114715 s, 91.4 MB/s 2024-09-10T23:27:37.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.484 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118066 s, 88.8 MB/s 2024-09-10T23:27:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.500 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120135 s, 87.3 MB/s 2024-09-10T23:27:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107677 s, 97.4 MB/s 2024-09-10T23:27:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.531 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125515 s, 83.5 MB/s 2024-09-10T23:27:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134315 s, 78.1 MB/s 2024-09-10T23:27:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121024 s, 86.6 MB/s 2024-09-10T23:27:37.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.580 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128827 s, 81.4 MB/s 2024-09-10T23:27:37.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.597 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129759 s, 80.8 MB/s 2024-09-10T23:27:37.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.613 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120544 s, 87.0 MB/s 2024-09-10T23:27:37.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.629 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121725 s, 86.1 MB/s 2024-09-10T23:27:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.652 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180599 s, 58.1 MB/s 2024-09-10T23:27:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.676 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200807 s, 52.2 MB/s 2024-09-10T23:27:37.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124055 s, 84.5 MB/s 2024-09-10T23:27:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123791 s, 84.7 MB/s 2024-09-10T23:27:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.726 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122204 s, 85.8 MB/s 2024-09-10T23:27:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146154 s, 71.7 MB/s 2024-09-10T23:27:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.764 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014227 s, 73.7 MB/s 2024-09-10T23:27:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113429 s, 92.4 MB/s 2024-09-10T23:27:37.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.794 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116415 s, 90.1 MB/s 2024-09-10T23:27:37.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126258 s, 83.1 MB/s 2024-09-10T23:27:37.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.826 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120563 s, 87.0 MB/s 2024-09-10T23:27:37.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:37.834 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:37.834 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:37.834 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T23:27:37.834 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:37.834 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:37.834 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:37.834 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:37.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:37.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123769 s, 84.7 MB/s 2024-09-10T23:27:37.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.939 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121721 s, 86.1 MB/s 2024-09-10T23:27:37.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116227 s, 90.2 MB/s 2024-09-10T23:27:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109093 s, 96.1 MB/s 2024-09-10T23:27:37.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:37.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:37.983 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105806 s, 99.1 MB/s 2024-09-10T23:27:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133672 s, 78.4 MB/s 2024-09-10T23:27:38.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.016 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119981 s, 87.4 MB/s 2024-09-10T23:27:38.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.032 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124244 s, 84.4 MB/s 2024-09-10T23:27:38.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125729 s, 83.4 MB/s 2024-09-10T23:27:38.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123505 s, 84.9 MB/s 2024-09-10T23:27:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.080 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116315 s, 90.1 MB/s 2024-09-10T23:27:38.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.097 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134474 s, 78.0 MB/s 2024-09-10T23:27:38.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.113 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012695 s, 82.6 MB/s 2024-09-10T23:27:38.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.128 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113712 s, 92.2 MB/s 2024-09-10T23:27:38.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125479 s, 83.6 MB/s 2024-09-10T23:27:38.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.159 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010624 s, 98.7 MB/s 2024-09-10T23:27:38.168 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:27:38.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:27:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129445 s, 81.0 MB/s 2024-09-10T23:27:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123232 s, 85.1 MB/s 2024-09-10T23:27:38.208 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.208 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.208 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131576 s, 79.7 MB/s 2024-09-10T23:27:38.223 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.223 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.224 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116841 s, 89.7 MB/s 2024-09-10T23:27:38.239 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.239 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.240 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122736 s, 85.4 MB/s 2024-09-10T23:27:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.256 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.257 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132086 s, 79.4 MB/s 2024-09-10T23:27:38.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.272 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117047 s, 89.6 MB/s 2024-09-10T23:27:38.287 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.287 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.287 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115084 s, 91.1 MB/s 2024-09-10T23:27:38.301 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.301 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.301 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107424 s, 97.6 MB/s 2024-09-10T23:27:38.316 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.316 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.316 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108645 s, 96.5 MB/s 2024-09-10T23:27:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.331 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115582 s, 90.7 MB/s 2024-09-10T23:27:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113156 s, 92.7 MB/s 2024-09-10T23:27:38.361 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.362 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120176 s, 87.3 MB/s 2024-09-10T23:27:38.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.377 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114342 s, 91.7 MB/s 2024-09-10T23:27:38.393 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.394 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128208 s, 81.8 MB/s 2024-09-10T23:27:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.410 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128997 s, 81.3 MB/s 2024-09-10T23:27:38.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:38.417 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:38.417 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:38.418 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T23:27:38.418 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:38.418 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:38.418 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:38.418 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131994 s, 79.4 MB/s 2024-09-10T23:27:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129092 s, 81.2 MB/s 2024-09-10T23:27:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010965 s, 95.6 MB/s 2024-09-10T23:27:38.575 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.576 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106511 s, 98.4 MB/s 2024-09-10T23:27:38.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.592 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127006 s, 82.6 MB/s 2024-09-10T23:27:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.608 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120253 s, 87.2 MB/s 2024-09-10T23:27:38.623 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.623 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.623 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011415 s, 91.9 MB/s 2024-09-10T23:27:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.638 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113019 s, 92.8 MB/s 2024-09-10T23:27:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.653 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011519 s, 91.0 MB/s 2024-09-10T23:27:38.668 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.668 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.668 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116104 s, 90.3 MB/s 2024-09-10T23:27:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.684 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117658 s, 89.1 MB/s 2024-09-10T23:27:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.700 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123873 s, 84.6 MB/s 2024-09-10T23:27:38.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.715 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.715 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113429 s, 92.4 MB/s 2024-09-10T23:27:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.729 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107874 s, 97.2 MB/s 2024-09-10T23:27:38.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.744 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111127 s, 94.4 MB/s 2024-09-10T23:27:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108519 s, 96.6 MB/s 2024-09-10T23:27:38.773 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.773 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.773 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108269 s, 96.8 MB/s 2024-09-10T23:27:38.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.790 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.790 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126849 s, 82.7 MB/s 2024-09-10T23:27:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.805 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119224 s, 88.0 MB/s 2024-09-10T23:27:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.820 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110004 s, 95.3 MB/s 2024-09-10T23:27:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120504 s, 87.0 MB/s 2024-09-10T23:27:38.851 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.851 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.851 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119973 s, 87.4 MB/s 2024-09-10T23:27:38.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.865 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010418 s, 101 MB/s 2024-09-10T23:27:38.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115584 s, 90.7 MB/s 2024-09-10T23:27:38.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.897 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124205 s, 84.4 MB/s 2024-09-10T23:27:38.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124903 s, 84.0 MB/s 2024-09-10T23:27:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.940 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112964 s, 92.8 MB/s 2024-09-10T23:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123046 s, 85.2 MB/s 2024-09-10T23:27:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109419 s, 95.8 MB/s 2024-09-10T23:27:38.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:38.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:38.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127036 s, 82.5 MB/s 2024-09-10T23:27:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.003 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127627 s, 82.2 MB/s 2024-09-10T23:27:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107533 s, 97.5 MB/s 2024-09-10T23:27:39.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:39.025 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:39.025 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:39.025 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T23:27:39.025 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:39.025 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:39.025 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:39.025 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:39.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.097 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121131 s, 86.6 MB/s 2024-09-10T23:27:39.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.114 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136913 s, 76.6 MB/s 2024-09-10T23:27:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121624 s, 86.2 MB/s 2024-09-10T23:27:39.146 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.146 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.146 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122862 s, 85.3 MB/s 2024-09-10T23:27:39.162 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.162 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.162 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118643 s, 88.4 MB/s 2024-09-10T23:27:39.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.178 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128466 s, 81.6 MB/s 2024-09-10T23:27:39.193 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.194 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.194 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115308 s, 90.9 MB/s 2024-09-10T23:27:39.209 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.209 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.209 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114533 s, 91.6 MB/s 2024-09-10T23:27:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111125 s, 94.4 MB/s 2024-09-10T23:27:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110366 s, 95.0 MB/s 2024-09-10T23:27:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.254 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012092 s, 86.7 MB/s 2024-09-10T23:27:39.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.270 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126001 s, 83.2 MB/s 2024-09-10T23:27:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127342 s, 82.3 MB/s 2024-09-10T23:27:39.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.302 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120071 s, 87.3 MB/s 2024-09-10T23:27:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.318 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.318 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118785 s, 88.3 MB/s 2024-09-10T23:27:39.332 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.333 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.333 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011333 s, 92.5 MB/s 2024-09-10T23:27:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.347 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111774 s, 93.8 MB/s 2024-09-10T23:27:39.364 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.364 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.364 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107412 s, 97.6 MB/s 2024-09-10T23:27:39.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.377 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110715 s, 94.7 MB/s 2024-09-10T23:27:39.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.392 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114873 s, 91.3 MB/s 2024-09-10T23:27:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117068 s, 89.6 MB/s 2024-09-10T23:27:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122464 s, 85.6 MB/s 2024-09-10T23:27:39.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.439 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.439 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115432 s, 90.8 MB/s 2024-09-10T23:27:39.454 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.454 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.454 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113787 s, 92.2 MB/s 2024-09-10T23:27:39.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.469 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115629 s, 90.7 MB/s 2024-09-10T23:27:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.486 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132162 s, 79.3 MB/s 2024-09-10T23:27:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.503 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124457 s, 84.3 MB/s 2024-09-10T23:27:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121312 s, 86.4 MB/s 2024-09-10T23:27:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127235 s, 82.4 MB/s 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.551 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012507 s, 83.8 MB/s 2024-09-10T23:27:39.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.567 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121415 s, 86.4 MB/s 2024-09-10T23:27:39.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.582 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116815 s, 89.8 MB/s 2024-09-10T23:27:39.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:39.589 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:39.590 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:39.590 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T23:27:39.590 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:39.590 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:39.590 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:39.591 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:39.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:39.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.661 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114921 s, 91.2 MB/s 2024-09-10T23:27:39.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.678 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125327 s, 83.7 MB/s 2024-09-10T23:27:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.694 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118167 s, 88.7 MB/s 2024-09-10T23:27:39.708 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.708 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.708 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114009 s, 92.0 MB/s 2024-09-10T23:27:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122638 s, 85.5 MB/s 2024-09-10T23:27:39.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.740 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116826 s, 89.8 MB/s 2024-09-10T23:27:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01164 s, 90.1 MB/s 2024-09-10T23:27:39.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.770 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115282 s, 91.0 MB/s 2024-09-10T23:27:39.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.787 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.787 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127367 s, 82.3 MB/s 2024-09-10T23:27:39.802 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.802 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.802 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116328 s, 90.1 MB/s 2024-09-10T23:27:39.818 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.818 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.818 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121023 s, 86.6 MB/s 2024-09-10T23:27:39.834 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.834 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.834 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125603 s, 83.5 MB/s 2024-09-10T23:27:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112977 s, 92.8 MB/s 2024-09-10T23:27:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.864 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111145 s, 94.3 MB/s 2024-09-10T23:27:39.879 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.879 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.879 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113346 s, 92.5 MB/s 2024-09-10T23:27:39.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.894 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120732 s, 86.9 MB/s 2024-09-10T23:27:39.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.928 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116992 s, 89.6 MB/s 2024-09-10T23:27:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121696 s, 86.2 MB/s 2024-09-10T23:27:39.958 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.959 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.959 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108502 s, 96.6 MB/s 2024-09-10T23:27:39.975 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.975 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.975 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128431 s, 81.6 MB/s 2024-09-10T23:27:39.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:39.992 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:39.992 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133661 s, 78.5 MB/s 2024-09-10T23:27:40.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.009 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122972 s, 85.3 MB/s 2024-09-10T23:27:40.023 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.024 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113669 s, 92.2 MB/s 2024-09-10T23:27:40.040 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.040 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.040 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129973 s, 80.7 MB/s 2024-09-10T23:27:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127975 s, 81.9 MB/s 2024-09-10T23:27:40.072 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.073 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119668 s, 87.6 MB/s 2024-09-10T23:27:40.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.088 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113508 s, 92.4 MB/s 2024-09-10T23:27:40.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.104 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122456 s, 85.6 MB/s 2024-09-10T23:27:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112773 s, 93.0 MB/s 2024-09-10T23:27:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.134 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116595 s, 89.9 MB/s 2024-09-10T23:27:40.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.151 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129978 s, 80.7 MB/s 2024-09-10T23:27:40.165 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.165 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.165 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107546 s, 97.5 MB/s 2024-09-10T23:27:40.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:40.172 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:40.173 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:40.173 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T23:27:40.173 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:40.173 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:40.173 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:40.173 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:40.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.245 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134352 s, 78.0 MB/s 2024-09-10T23:27:40.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.262 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131411 s, 79.8 MB/s 2024-09-10T23:27:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.276 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010841 s, 96.7 MB/s 2024-09-10T23:27:40.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.292 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120387 s, 87.1 MB/s 2024-09-10T23:27:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113755 s, 92.2 MB/s 2024-09-10T23:27:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119326 s, 87.9 MB/s 2024-09-10T23:27:40.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.339 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.339 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126525 s, 82.9 MB/s 2024-09-10T23:27:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012127 s, 86.5 MB/s 2024-09-10T23:27:40.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.370 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125575 s, 83.5 MB/s 2024-09-10T23:27:40.386 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.386 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.387 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125884 s, 83.3 MB/s 2024-09-10T23:27:40.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124753 s, 84.1 MB/s 2024-09-10T23:27:40.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.417 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.417 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110688 s, 94.7 MB/s 2024-09-10T23:27:40.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.434 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.434 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124592 s, 84.2 MB/s 2024-09-10T23:27:40.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.448 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105745 s, 99.2 MB/s 2024-09-10T23:27:40.464 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.464 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.464 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128126 s, 81.8 MB/s 2024-09-10T23:27:40.479 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.479 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.479 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115284 s, 91.0 MB/s 2024-09-10T23:27:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.495 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117787 s, 89.0 MB/s 2024-09-10T23:27:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125247 s, 83.7 MB/s 2024-09-10T23:27:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112577 s, 93.1 MB/s 2024-09-10T23:27:40.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.542 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134716 s, 77.8 MB/s 2024-09-10T23:27:40.559 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.559 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.559 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012514 s, 83.8 MB/s 2024-09-10T23:27:40.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.573 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.573 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107071 s, 97.9 MB/s 2024-09-10T23:27:40.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.588 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011271 s, 93.0 MB/s 2024-09-10T23:27:40.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.603 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.603 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109441 s, 95.8 MB/s 2024-09-10T23:27:40.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.619 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122091 s, 85.9 MB/s 2024-09-10T23:27:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.634 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116783 s, 89.8 MB/s 2024-09-10T23:27:40.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.650 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120756 s, 86.8 MB/s 2024-09-10T23:27:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.665 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119734 s, 87.6 MB/s 2024-09-10T23:27:40.679 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.680 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.680 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108769 s, 96.4 MB/s 2024-09-10T23:27:40.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.694 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111928 s, 93.7 MB/s 2024-09-10T23:27:40.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.711 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012573 s, 83.4 MB/s 2024-09-10T23:27:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105988 s, 98.9 MB/s 2024-09-10T23:27:40.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:40.732 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:40.732 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:40.733 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T23:27:40.733 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:40.733 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:40.733 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:40.733 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:40.804 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.804 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.805 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127014 s, 82.6 MB/s 2024-09-10T23:27:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127438 s, 82.3 MB/s 2024-09-10T23:27:40.836 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.836 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.836 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011313 s, 92.7 MB/s 2024-09-10T23:27:40.852 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.853 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.853 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131671 s, 79.6 MB/s 2024-09-10T23:27:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.868 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119307 s, 87.9 MB/s 2024-09-10T23:27:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.883 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109948 s, 95.4 MB/s 2024-09-10T23:27:40.900 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.900 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.900 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135437 s, 77.4 MB/s 2024-09-10T23:27:40.930 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.930 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.931 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120873 s, 86.8 MB/s 2024-09-10T23:27:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111505 s, 94.0 MB/s 2024-09-10T23:27:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.960 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109111 s, 96.1 MB/s 2024-09-10T23:27:40.975 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.975 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.975 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121745 s, 86.1 MB/s 2024-09-10T23:27:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:40.990 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011274 s, 93.0 MB/s 2024-09-10T23:27:41.007 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.008 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.008 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132075 s, 79.4 MB/s 2024-09-10T23:27:41.023 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.023 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.024 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124359 s, 84.3 MB/s 2024-09-10T23:27:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124023 s, 84.5 MB/s 2024-09-10T23:27:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.056 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124518 s, 84.2 MB/s 2024-09-10T23:27:41.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.073 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127528 s, 82.2 MB/s 2024-09-10T23:27:41.087 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.087 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.087 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106972 s, 98.0 MB/s 2024-09-10T23:27:41.103 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.104 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125167 s, 83.8 MB/s 2024-09-10T23:27:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120968 s, 86.7 MB/s 2024-09-10T23:27:41.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.137 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01217 s, 86.2 MB/s 2024-09-10T23:27:41.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.151 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107091 s, 97.9 MB/s 2024-09-10T23:27:41.166 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.166 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.166 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115248 s, 91.0 MB/s 2024-09-10T23:27:41.181 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.181 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.181 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107506 s, 97.5 MB/s 2024-09-10T23:27:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114413 s, 91.6 MB/s 2024-09-10T23:27:41.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111831 s, 93.8 MB/s 2024-09-10T23:27:41.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.227 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125199 s, 83.8 MB/s 2024-09-10T23:27:41.242 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.242 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.242 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115155 s, 91.1 MB/s 2024-09-10T23:27:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.258 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119598 s, 87.7 MB/s 2024-09-10T23:27:41.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.274 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126834 s, 82.7 MB/s 2024-09-10T23:27:41.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.289 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113149 s, 92.7 MB/s 2024-09-10T23:27:41.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.304 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112979 s, 92.8 MB/s 2024-09-10T23:27:41.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:41.311 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:41.311 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:41.311 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T23:27:41.311 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:41.311 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:41.311 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:41.311 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:41.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:41.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.429 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011861 s, 88.4 MB/s 2024-09-10T23:27:41.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.447 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134012 s, 78.2 MB/s 2024-09-10T23:27:41.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.462 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01216 s, 86.2 MB/s 2024-09-10T23:27:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.478 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115276 s, 91.0 MB/s 2024-09-10T23:27:41.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.495 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012788 s, 82.0 MB/s 2024-09-10T23:27:41.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124316 s, 84.3 MB/s 2024-09-10T23:27:41.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.527 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120584 s, 87.0 MB/s 2024-09-10T23:27:41.541 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.541 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.542 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112596 s, 93.1 MB/s 2024-09-10T23:27:41.557 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.558 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.558 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124237 s, 84.4 MB/s 2024-09-10T23:27:41.574 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.574 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.574 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124832 s, 84.0 MB/s 2024-09-10T23:27:41.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.590 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.590 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118916 s, 88.2 MB/s 2024-09-10T23:27:41.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.606 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124337 s, 84.3 MB/s 2024-09-10T23:27:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108073 s, 97.0 MB/s 2024-09-10T23:27:41.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.637 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.637 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129196 s, 81.2 MB/s 2024-09-10T23:27:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117611 s, 89.2 MB/s 2024-09-10T23:27:41.668 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.668 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.668 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121859 s, 86.0 MB/s 2024-09-10T23:27:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134323 s, 78.1 MB/s 2024-09-10T23:27:41.701 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.701 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.701 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115205 s, 91.0 MB/s 2024-09-10T23:27:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.716 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116687 s, 89.9 MB/s 2024-09-10T23:27:41.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.732 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118003 s, 88.9 MB/s 2024-09-10T23:27:41.747 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.747 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.747 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117385 s, 89.3 MB/s 2024-09-10T23:27:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121444 s, 86.3 MB/s 2024-09-10T23:27:41.778 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.779 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012147 s, 86.3 MB/s 2024-09-10T23:27:41.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.796 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.796 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013699 s, 76.5 MB/s 2024-09-10T23:27:41.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111993 s, 93.6 MB/s 2024-09-10T23:27:41.828 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.828 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.828 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012281 s, 85.4 MB/s 2024-09-10T23:27:41.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.844 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.844 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125068 s, 83.8 MB/s 2024-09-10T23:27:41.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.860 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125632 s, 83.5 MB/s 2024-09-10T23:27:41.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.875 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011573 s, 90.6 MB/s 2024-09-10T23:27:41.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.890 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.890 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011057 s, 94.8 MB/s 2024-09-10T23:27:41.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151815 s, 69.1 MB/s 2024-09-10T23:27:41.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:41.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:41.936 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126534 s, 82.9 MB/s 2024-09-10T23:27:41.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:41.943 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:41.943 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:41.943 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T23:27:41.943 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:41.943 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:41.943 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:41.943 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:41.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136554 s, 76.8 MB/s 2024-09-10T23:27:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111612 s, 93.9 MB/s 2024-09-10T23:27:42.045 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113718 s, 92.2 MB/s 2024-09-10T23:27:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125251 s, 83.7 MB/s 2024-09-10T23:27:42.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128141 s, 81.8 MB/s 2024-09-10T23:27:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122371 s, 85.7 MB/s 2024-09-10T23:27:42.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113245 s, 92.6 MB/s 2024-09-10T23:27:42.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116826 s, 89.8 MB/s 2024-09-10T23:27:42.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122288 s, 85.7 MB/s 2024-09-10T23:27:42.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116294 s, 90.2 MB/s 2024-09-10T23:27:42.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.172 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117264 s, 89.4 MB/s 2024-09-10T23:27:42.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.188 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124507 s, 84.2 MB/s 2024-09-10T23:27:42.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.202 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109401 s, 95.8 MB/s 2024-09-10T23:27:42.218 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.218 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.218 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120458 s, 87.0 MB/s 2024-09-10T23:27:42.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.235 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122998 s, 85.3 MB/s 2024-09-10T23:27:42.249 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.249 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.250 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114259 s, 91.8 MB/s 2024-09-10T23:27:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.265 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119651 s, 87.6 MB/s 2024-09-10T23:27:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121318 s, 86.4 MB/s 2024-09-10T23:27:42.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.298 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.298 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131931 s, 79.5 MB/s 2024-09-10T23:27:42.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.313 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119669 s, 87.6 MB/s 2024-09-10T23:27:42.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.328 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.328 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112171 s, 93.5 MB/s 2024-09-10T23:27:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123329 s, 85.0 MB/s 2024-09-10T23:27:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113101 s, 92.7 MB/s 2024-09-10T23:27:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116862 s, 89.7 MB/s 2024-09-10T23:27:42.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.389 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113407 s, 92.5 MB/s 2024-09-10T23:27:42.403 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.404 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106589 s, 98.4 MB/s 2024-09-10T23:27:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011503 s, 91.2 MB/s 2024-09-10T23:27:42.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.434 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.434 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111687 s, 93.9 MB/s 2024-09-10T23:27:42.448 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.449 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.449 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010991 s, 95.4 MB/s 2024-09-10T23:27:42.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.465 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125807 s, 83.3 MB/s 2024-09-10T23:27:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.481 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117416 s, 89.3 MB/s 2024-09-10T23:27:42.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.496 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119584 s, 87.7 MB/s 2024-09-10T23:27:42.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:42.503 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:42.504 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:42.504 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T23:27:42.504 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:42.504 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:42.504 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:42.504 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:42.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:42.575 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.575 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.575 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118464 s, 88.5 MB/s 2024-09-10T23:27:42.591 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.591 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.592 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013264 s, 79.1 MB/s 2024-09-10T23:27:42.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.606 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108887 s, 96.3 MB/s 2024-09-10T23:27:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118964 s, 88.1 MB/s 2024-09-10T23:27:42.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.639 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129572 s, 80.9 MB/s 2024-09-10T23:27:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175849 s, 59.6 MB/s 2024-09-10T23:27:42.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.678 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.678 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127145 s, 82.5 MB/s 2024-09-10T23:27:42.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.694 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.695 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123286 s, 85.1 MB/s 2024-09-10T23:27:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.710 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119019 s, 88.1 MB/s 2024-09-10T23:27:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128518 s, 81.6 MB/s 2024-09-10T23:27:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.745 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129976 s, 80.7 MB/s 2024-09-10T23:27:42.760 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.760 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.760 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120647 s, 86.9 MB/s 2024-09-10T23:27:42.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.777 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126844 s, 82.7 MB/s 2024-09-10T23:27:42.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.793 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.793 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012358 s, 84.8 MB/s 2024-09-10T23:27:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.812 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014618 s, 71.7 MB/s 2024-09-10T23:27:42.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.831 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142243 s, 73.7 MB/s 2024-09-10T23:27:42.848 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.848 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.848 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128228 s, 81.8 MB/s 2024-09-10T23:27:42.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.865 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126041 s, 83.2 MB/s 2024-09-10T23:27:42.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.881 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112718 s, 93.0 MB/s 2024-09-10T23:27:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012117 s, 86.5 MB/s 2024-09-10T23:27:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.920 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183913 s, 57.0 MB/s 2024-09-10T23:27:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.939 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122138 s, 85.9 MB/s 2024-09-10T23:27:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112104 s, 93.5 MB/s 2024-09-10T23:27:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128713 s, 81.5 MB/s 2024-09-10T23:27:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115714 s, 90.6 MB/s 2024-09-10T23:27:43.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.002 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128983 s, 81.3 MB/s 2024-09-10T23:27:43.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.018 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.018 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114135 s, 91.9 MB/s 2024-09-10T23:27:43.034 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.034 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.034 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012752 s, 82.2 MB/s 2024-09-10T23:27:43.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.050 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118907 s, 88.2 MB/s 2024-09-10T23:27:43.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120198 s, 87.2 MB/s 2024-09-10T23:27:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130257 s, 80.5 MB/s 2024-09-10T23:27:43.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.098 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119691 s, 87.6 MB/s 2024-09-10T23:27:43.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:43.109 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:43.109 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:43.109 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T23:27:43.109 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:43.109 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:43.109 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:43.109 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:43.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:43.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.182 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136985 s, 76.5 MB/s 2024-09-10T23:27:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119248 s, 87.9 MB/s 2024-09-10T23:27:43.212 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.212 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.212 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110622 s, 94.8 MB/s 2024-09-10T23:27:43.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.227 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114276 s, 91.8 MB/s 2024-09-10T23:27:43.242 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.242 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.242 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113208 s, 92.6 MB/s 2024-09-10T23:27:43.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.257 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.257 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109505 s, 95.8 MB/s 2024-09-10T23:27:43.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.273 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.273 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120131 s, 87.3 MB/s 2024-09-10T23:27:43.288 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.289 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120593 s, 87.0 MB/s 2024-09-10T23:27:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010928 s, 96.0 MB/s 2024-09-10T23:27:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011087 s, 94.6 MB/s 2024-09-10T23:27:43.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.335 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139013 s, 75.4 MB/s 2024-09-10T23:27:43.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.350 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110607 s, 94.8 MB/s 2024-09-10T23:27:43.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.367 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013351 s, 78.5 MB/s 2024-09-10T23:27:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.383 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118168 s, 88.7 MB/s 2024-09-10T23:27:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120462 s, 87.0 MB/s 2024-09-10T23:27:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129969 s, 80.7 MB/s 2024-09-10T23:27:43.432 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.432 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.432 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129454 s, 81.0 MB/s 2024-09-10T23:27:43.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.447 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01119 s, 93.7 MB/s 2024-09-10T23:27:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.462 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114358 s, 91.7 MB/s 2024-09-10T23:27:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121884 s, 86.0 MB/s 2024-09-10T23:27:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.494 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119365 s, 87.8 MB/s 2024-09-10T23:27:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112769 s, 93.0 MB/s 2024-09-10T23:27:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116993 s, 89.6 MB/s 2024-09-10T23:27:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.540 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125828 s, 83.3 MB/s 2024-09-10T23:27:43.556 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.556 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.556 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125481 s, 83.6 MB/s 2024-09-10T23:27:43.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.571 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115472 s, 90.8 MB/s 2024-09-10T23:27:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012009 s, 87.3 MB/s 2024-09-10T23:27:43.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.602 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.602 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119069 s, 88.1 MB/s 2024-09-10T23:27:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.618 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120863 s, 86.8 MB/s 2024-09-10T23:27:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.633 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111523 s, 94.0 MB/s 2024-09-10T23:27:43.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128412 s, 81.7 MB/s 2024-09-10T23:27:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112878 s, 92.9 MB/s 2024-09-10T23:27:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:43.672 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:43.672 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:43.672 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T23:27:43.672 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:43.672 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:43.672 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:43.672 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113529 s, 92.4 MB/s 2024-09-10T23:27:43.757 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115871 s, 90.5 MB/s 2024-09-10T23:27:43.773 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.773 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.773 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113761 s, 92.2 MB/s 2024-09-10T23:27:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112226 s, 93.4 MB/s 2024-09-10T23:27:43.803 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.803 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.803 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116708 s, 89.8 MB/s 2024-09-10T23:27:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106817 s, 98.2 MB/s 2024-09-10T23:27:43.834 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.834 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.834 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131264 s, 79.9 MB/s 2024-09-10T23:27:43.849 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.850 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.850 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118009 s, 88.9 MB/s 2024-09-10T23:27:43.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.865 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120246 s, 87.2 MB/s 2024-09-10T23:27:43.882 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.882 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.882 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127965 s, 81.9 MB/s 2024-09-10T23:27:43.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.898 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126296 s, 83.0 MB/s 2024-09-10T23:27:43.914 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.915 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012761 s, 82.2 MB/s 2024-09-10T23:27:43.941 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.942 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.942 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105244 s, 99.6 MB/s 2024-09-10T23:27:43.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.957 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.957 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116187 s, 90.2 MB/s 2024-09-10T23:27:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110284 s, 95.1 MB/s 2024-09-10T23:27:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122257 s, 85.8 MB/s 2024-09-10T23:27:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012296 s, 85.3 MB/s 2024-09-10T23:27:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127148 s, 82.5 MB/s 2024-09-10T23:27:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012078 s, 86.8 MB/s 2024-09-10T23:27:44.051 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.052 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.052 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123627 s, 84.8 MB/s 2024-09-10T23:27:44.067 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.067 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.067 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121223 s, 86.5 MB/s 2024-09-10T23:27:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112607 s, 93.1 MB/s 2024-09-10T23:27:44.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.097 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109613 s, 95.7 MB/s 2024-09-10T23:27:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105783 s, 99.1 MB/s 2024-09-10T23:27:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.126 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110607 s, 94.8 MB/s 2024-09-10T23:27:44.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107051 s, 98.0 MB/s 2024-09-10T23:27:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112791 s, 93.0 MB/s 2024-09-10T23:27:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111952 s, 93.7 MB/s 2024-09-10T23:27:44.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.185 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.185 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114484 s, 91.6 MB/s 2024-09-10T23:27:44.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.200 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112749 s, 93.0 MB/s 2024-09-10T23:27:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111873 s, 93.7 MB/s 2024-09-10T23:27:44.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.232 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135106 s, 77.6 MB/s 2024-09-10T23:27:44.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:44.240 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:44.240 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:44.240 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T23:27:44.240 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:44.240 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:44.240 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:44.240 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:44.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.309 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109871 s, 95.4 MB/s 2024-09-10T23:27:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114492 s, 91.6 MB/s 2024-09-10T23:27:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117923 s, 88.9 MB/s 2024-09-10T23:27:44.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.355 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115845 s, 90.5 MB/s 2024-09-10T23:27:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111719 s, 93.9 MB/s 2024-09-10T23:27:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.385 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114978 s, 91.2 MB/s 2024-09-10T23:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118519 s, 88.5 MB/s 2024-09-10T23:27:44.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.415 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111253 s, 94.3 MB/s 2024-09-10T23:27:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124145 s, 84.5 MB/s 2024-09-10T23:27:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.447 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117503 s, 89.2 MB/s 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107482 s, 97.6 MB/s 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.476 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115136 s, 91.1 MB/s 2024-09-10T23:27:44.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.493 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.493 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126622 s, 82.8 MB/s 2024-09-10T23:27:44.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.508 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121456 s, 86.3 MB/s 2024-09-10T23:27:44.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.523 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108988 s, 96.2 MB/s 2024-09-10T23:27:44.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.537 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107078 s, 97.9 MB/s 2024-09-10T23:27:44.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.552 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115834 s, 90.5 MB/s 2024-09-10T23:27:44.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.569 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122663 s, 85.5 MB/s 2024-09-10T23:27:44.583 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.583 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.583 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109212 s, 96.0 MB/s 2024-09-10T23:27:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122719 s, 85.4 MB/s 2024-09-10T23:27:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123146 s, 85.1 MB/s 2024-09-10T23:27:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110694 s, 94.7 MB/s 2024-09-10T23:27:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123499 s, 84.9 MB/s 2024-09-10T23:27:44.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.660 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107731 s, 97.3 MB/s 2024-09-10T23:27:44.675 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.675 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.675 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01173 s, 89.4 MB/s 2024-09-10T23:27:44.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013571 s, 77.3 MB/s 2024-09-10T23:27:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.709 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128826 s, 81.4 MB/s 2024-09-10T23:27:44.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.725 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.725 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011676 s, 89.8 MB/s 2024-09-10T23:27:44.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.740 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119463 s, 87.8 MB/s 2024-09-10T23:27:44.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.757 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.757 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124517 s, 84.2 MB/s 2024-09-10T23:27:44.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.772 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115114 s, 91.1 MB/s 2024-09-10T23:27:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109302 s, 95.9 MB/s 2024-09-10T23:27:44.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:44.793 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:44.794 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:44.794 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T23:27:44.794 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:44.794 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:44.794 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:44.794 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:44.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:44.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117173 s, 89.5 MB/s 2024-09-10T23:27:44.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.928 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.928 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158811 s, 66.0 MB/s 2024-09-10T23:27:44.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.948 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119066 s, 88.1 MB/s 2024-09-10T23:27:44.966 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.967 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144511 s, 72.6 MB/s 2024-09-10T23:27:44.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.981 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110399 s, 95.0 MB/s 2024-09-10T23:27:44.996 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118587 s, 88.4 MB/s 2024-09-10T23:27:45.012 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.013 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.013 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125096 s, 83.8 MB/s 2024-09-10T23:27:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.029 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128953 s, 81.3 MB/s 2024-09-10T23:27:45.045 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.045 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.045 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123695 s, 84.8 MB/s 2024-09-10T23:27:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114895 s, 91.3 MB/s 2024-09-10T23:27:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011911 s, 88.0 MB/s 2024-09-10T23:27:45.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.091 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113187 s, 92.6 MB/s 2024-09-10T23:27:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.106 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116108 s, 90.3 MB/s 2024-09-10T23:27:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118745 s, 88.3 MB/s 2024-09-10T23:27:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118401 s, 88.6 MB/s 2024-09-10T23:27:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.153 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117374 s, 89.3 MB/s 2024-09-10T23:27:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121284 s, 86.5 MB/s 2024-09-10T23:27:45.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.186 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131047 s, 80.0 MB/s 2024-09-10T23:27:45.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.200 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107332 s, 97.7 MB/s 2024-09-10T23:27:45.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132223 s, 79.3 MB/s 2024-09-10T23:27:45.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.234 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127349 s, 82.3 MB/s 2024-09-10T23:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112709 s, 93.0 MB/s 2024-09-10T23:27:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119883 s, 87.5 MB/s 2024-09-10T23:27:45.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111967 s, 93.7 MB/s 2024-09-10T23:27:45.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.294 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115466 s, 90.8 MB/s 2024-09-10T23:27:45.310 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.310 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.310 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124505 s, 84.2 MB/s 2024-09-10T23:27:45.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109896 s, 95.4 MB/s 2024-09-10T23:27:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012579 s, 83.4 MB/s 2024-09-10T23:27:45.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.357 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.357 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117197 s, 89.5 MB/s 2024-09-10T23:27:45.372 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115809 s, 90.5 MB/s 2024-09-10T23:27:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122983 s, 85.3 MB/s 2024-09-10T23:27:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.403 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111941 s, 93.7 MB/s 2024-09-10T23:27:45.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:45.411 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:45.411 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:45.411 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T23:27:45.411 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:45.411 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:45.411 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:45.411 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125311 s, 83.7 MB/s 2024-09-10T23:27:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125627 s, 83.5 MB/s 2024-09-10T23:27:45.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.514 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113042 s, 92.8 MB/s 2024-09-10T23:27:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119122 s, 88.0 MB/s 2024-09-10T23:27:45.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.546 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113282 s, 92.6 MB/s 2024-09-10T23:27:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117745 s, 89.1 MB/s 2024-09-10T23:27:45.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.577 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126914 s, 82.6 MB/s 2024-09-10T23:27:45.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.592 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.593 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114311 s, 91.7 MB/s 2024-09-10T23:27:45.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.608 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118094 s, 88.8 MB/s 2024-09-10T23:27:45.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.624 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121651 s, 86.2 MB/s 2024-09-10T23:27:45.638 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.639 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107695 s, 97.4 MB/s 2024-09-10T23:27:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011972 s, 87.6 MB/s 2024-09-10T23:27:45.671 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.671 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.671 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126161 s, 83.1 MB/s 2024-09-10T23:27:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.688 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137342 s, 76.3 MB/s 2024-09-10T23:27:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124702 s, 84.1 MB/s 2024-09-10T23:27:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116584 s, 89.9 MB/s 2024-09-10T23:27:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.735 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116207 s, 90.2 MB/s 2024-09-10T23:27:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128672 s, 81.5 MB/s 2024-09-10T23:27:45.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120751 s, 86.8 MB/s 2024-09-10T23:27:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.783 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114055 s, 91.9 MB/s 2024-09-10T23:27:45.798 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.798 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.798 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115479 s, 90.8 MB/s 2024-09-10T23:27:45.813 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.813 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.813 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112359 s, 93.3 MB/s 2024-09-10T23:27:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124449 s, 84.3 MB/s 2024-09-10T23:27:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.844 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117135 s, 89.5 MB/s 2024-09-10T23:27:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123229 s, 85.1 MB/s 2024-09-10T23:27:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117067 s, 89.6 MB/s 2024-09-10T23:27:45.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.891 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117047 s, 89.6 MB/s 2024-09-10T23:27:45.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.907 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111498 s, 94.0 MB/s 2024-09-10T23:27:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134286 s, 78.1 MB/s 2024-09-10T23:27:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117182 s, 89.5 MB/s 2024-09-10T23:27:45.965 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.965 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.965 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116763 s, 89.8 MB/s 2024-09-10T23:27:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:45.980 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:45.980 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113492 s, 92.4 MB/s 2024-09-10T23:27:45.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:45.987 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:45.987 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:45.987 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T23:27:45.987 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:45.987 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:45.987 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:45.987 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:46.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.058 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121685 s, 86.2 MB/s 2024-09-10T23:27:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110808 s, 94.6 MB/s 2024-09-10T23:27:46.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.088 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111716 s, 93.9 MB/s 2024-09-10T23:27:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131776 s, 79.6 MB/s 2024-09-10T23:27:46.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.121 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125341 s, 83.7 MB/s 2024-09-10T23:27:46.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.137 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123446 s, 84.9 MB/s 2024-09-10T23:27:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.154 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129823 s, 80.8 MB/s 2024-09-10T23:27:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119897 s, 87.5 MB/s 2024-09-10T23:27:46.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.185 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113493 s, 92.4 MB/s 2024-09-10T23:27:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109233 s, 96.0 MB/s 2024-09-10T23:27:46.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.216 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131241 s, 79.9 MB/s 2024-09-10T23:27:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.230 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106702 s, 98.3 MB/s 2024-09-10T23:27:46.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.247 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.247 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130245 s, 80.5 MB/s 2024-09-10T23:27:46.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.262 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.262 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112863 s, 92.9 MB/s 2024-09-10T23:27:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120983 s, 86.7 MB/s 2024-09-10T23:27:46.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.294 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124078 s, 84.5 MB/s 2024-09-10T23:27:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113963 s, 92.0 MB/s 2024-09-10T23:27:46.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.325 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125418 s, 83.6 MB/s 2024-09-10T23:27:46.341 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.341 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.341 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011304 s, 92.8 MB/s 2024-09-10T23:27:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.356 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116371 s, 90.1 MB/s 2024-09-10T23:27:46.371 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.371 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.371 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113103 s, 92.7 MB/s 2024-09-10T23:27:46.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.388 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.388 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013354 s, 78.5 MB/s 2024-09-10T23:27:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113262 s, 92.6 MB/s 2024-09-10T23:27:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125592 s, 83.5 MB/s 2024-09-10T23:27:46.435 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123846 s, 84.7 MB/s 2024-09-10T23:27:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012649 s, 82.9 MB/s 2024-09-10T23:27:46.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119534 s, 87.7 MB/s 2024-09-10T23:27:46.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.484 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120916 s, 86.7 MB/s 2024-09-10T23:27:46.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117709 s, 89.1 MB/s 2024-09-10T23:27:46.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.514 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113016 s, 92.8 MB/s 2024-09-10T23:27:46.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.530 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122379 s, 85.7 MB/s 2024-09-10T23:27:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125328 s, 83.7 MB/s 2024-09-10T23:27:46.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:46.554 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:46.554 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:46.554 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T23:27:46.554 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:46.554 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:46.554 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:46.554 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:46.625 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.625 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.625 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120036 s, 87.4 MB/s 2024-09-10T23:27:46.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124491 s, 84.2 MB/s 2024-09-10T23:27:46.657 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.657 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.657 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115521 s, 90.8 MB/s 2024-09-10T23:27:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115327 s, 90.9 MB/s 2024-09-10T23:27:46.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.688 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.688 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124079 s, 84.5 MB/s 2024-09-10T23:27:46.704 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.704 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.704 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120558 s, 87.0 MB/s 2024-09-10T23:27:46.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.719 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114426 s, 91.6 MB/s 2024-09-10T23:27:46.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.735 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.735 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124623 s, 84.1 MB/s 2024-09-10T23:27:46.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.750 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113544 s, 92.3 MB/s 2024-09-10T23:27:46.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.767 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.767 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127134 s, 82.5 MB/s 2024-09-10T23:27:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111318 s, 94.2 MB/s 2024-09-10T23:27:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.797 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117208 s, 89.5 MB/s 2024-09-10T23:27:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110473 s, 94.9 MB/s 2024-09-10T23:27:46.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.826 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109843 s, 95.5 MB/s 2024-09-10T23:27:46.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.842 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125975 s, 83.2 MB/s 2024-09-10T23:27:46.857 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.857 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.857 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112153 s, 93.5 MB/s 2024-09-10T23:27:46.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.872 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114484 s, 91.6 MB/s 2024-09-10T23:27:46.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.887 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112746 s, 93.0 MB/s 2024-09-10T23:27:46.902 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.902 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.902 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115611 s, 90.7 MB/s 2024-09-10T23:27:46.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.918 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125849 s, 83.3 MB/s 2024-09-10T23:27:46.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.952 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122092 s, 85.9 MB/s 2024-09-10T23:27:46.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.967 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011635 s, 90.1 MB/s 2024-09-10T23:27:46.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122503 s, 85.6 MB/s 2024-09-10T23:27:46.999 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:46.999 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:46.999 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117177 s, 89.5 MB/s 2024-09-10T23:27:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111721 s, 93.9 MB/s 2024-09-10T23:27:47.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129863 s, 80.7 MB/s 2024-09-10T23:27:47.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.047 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128888 s, 81.4 MB/s 2024-09-10T23:27:47.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.062 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115989 s, 90.4 MB/s 2024-09-10T23:27:47.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.077 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111866 s, 93.7 MB/s 2024-09-10T23:27:47.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.093 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011543 s, 90.8 MB/s 2024-09-10T23:27:47.107 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010977 s, 95.5 MB/s 2024-09-10T23:27:47.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111728 s, 93.9 MB/s 2024-09-10T23:27:47.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:47.130 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:47.131 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:47.131 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T23:27:47.131 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:47.131 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:47.131 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:47.131 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:47.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:47.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.202 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126934 s, 82.6 MB/s 2024-09-10T23:27:47.218 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.218 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.218 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118319 s, 88.6 MB/s 2024-09-10T23:27:47.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.235 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131836 s, 79.5 MB/s 2024-09-10T23:27:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115943 s, 90.4 MB/s 2024-09-10T23:27:47.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.265 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.266 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114097 s, 91.9 MB/s 2024-09-10T23:27:47.280 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.280 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.280 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109717 s, 95.6 MB/s 2024-09-10T23:27:47.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.295 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108684 s, 96.5 MB/s 2024-09-10T23:27:47.311 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.311 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.311 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120998 s, 86.7 MB/s 2024-09-10T23:27:47.326 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123641 s, 84.8 MB/s 2024-09-10T23:27:47.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.343 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121309 s, 86.4 MB/s 2024-09-10T23:27:47.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.359 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.359 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012375 s, 84.7 MB/s 2024-09-10T23:27:47.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.375 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123082 s, 85.2 MB/s 2024-09-10T23:27:47.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.390 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.390 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011549 s, 90.8 MB/s 2024-09-10T23:27:47.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.406 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.406 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123777 s, 84.7 MB/s 2024-09-10T23:27:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.421 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111793 s, 93.8 MB/s 2024-09-10T23:27:47.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.437 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.437 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123723 s, 84.8 MB/s 2024-09-10T23:27:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.454 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127876 s, 82.0 MB/s 2024-09-10T23:27:47.469 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.470 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123246 s, 85.1 MB/s 2024-09-10T23:27:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115631 s, 90.7 MB/s 2024-09-10T23:27:47.500 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.501 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118532 s, 88.5 MB/s 2024-09-10T23:27:47.516 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.516 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.516 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115413 s, 90.9 MB/s 2024-09-10T23:27:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110226 s, 95.1 MB/s 2024-09-10T23:27:47.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.545 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111843 s, 93.8 MB/s 2024-09-10T23:27:47.563 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.563 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.563 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138662 s, 75.6 MB/s 2024-09-10T23:27:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121169 s, 86.5 MB/s 2024-09-10T23:27:47.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110782 s, 94.7 MB/s 2024-09-10T23:27:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.608 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.609 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113204 s, 92.6 MB/s 2024-09-10T23:27:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011271 s, 93.0 MB/s 2024-09-10T23:27:47.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143063 s, 73.3 MB/s 2024-09-10T23:27:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130115 s, 80.6 MB/s 2024-09-10T23:27:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.680 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172712 s, 60.7 MB/s 2024-09-10T23:27:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151014 s, 69.4 MB/s 2024-09-10T23:27:47.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:47.708 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:47.709 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:47.709 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T23:27:47.709 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:47.709 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:47.709 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:47.709 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:47.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.843 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122459 s, 85.6 MB/s 2024-09-10T23:27:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.859 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122992 s, 85.3 MB/s 2024-09-10T23:27:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.875 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126299 s, 83.0 MB/s 2024-09-10T23:27:47.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.891 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012123 s, 86.5 MB/s 2024-09-10T23:27:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126187 s, 83.1 MB/s 2024-09-10T23:27:47.932 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.932 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.932 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205718 s, 51.0 MB/s 2024-09-10T23:27:47.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.956 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114573 s, 91.5 MB/s 2024-09-10T23:27:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116796 s, 89.8 MB/s 2024-09-10T23:27:47.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:47.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:47.986 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117332 s, 89.4 MB/s 2024-09-10T23:27:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.001 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112129 s, 93.5 MB/s 2024-09-10T23:27:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124206 s, 84.4 MB/s 2024-09-10T23:27:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118394 s, 88.6 MB/s 2024-09-10T23:27:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131961 s, 79.5 MB/s 2024-09-10T23:27:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.066 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128826 s, 81.4 MB/s 2024-09-10T23:27:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.081 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114974 s, 91.2 MB/s 2024-09-10T23:27:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.098 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130735 s, 80.2 MB/s 2024-09-10T23:27:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011405 s, 91.9 MB/s 2024-09-10T23:27:48.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.128 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111836 s, 93.8 MB/s 2024-09-10T23:27:48.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012064 s, 86.9 MB/s 2024-09-10T23:27:48.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.161 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.161 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123962 s, 84.6 MB/s 2024-09-10T23:27:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113673 s, 92.2 MB/s 2024-09-10T23:27:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127122 s, 82.5 MB/s 2024-09-10T23:27:48.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.207 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110959 s, 94.5 MB/s 2024-09-10T23:27:48.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.224 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134904 s, 77.7 MB/s 2024-09-10T23:27:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117583 s, 89.2 MB/s 2024-09-10T23:27:48.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.256 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119885 s, 87.5 MB/s 2024-09-10T23:27:48.271 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.271 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.271 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118529 s, 88.5 MB/s 2024-09-10T23:27:48.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.286 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116453 s, 90.0 MB/s 2024-09-10T23:27:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134056 s, 78.2 MB/s 2024-09-10T23:27:48.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.319 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115262 s, 91.0 MB/s 2024-09-10T23:27:48.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.335 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122836 s, 85.4 MB/s 2024-09-10T23:27:48.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.350 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.350 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115403 s, 90.9 MB/s 2024-09-10T23:27:48.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:48.357 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:27:48.357 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:27:48.358 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T23:27:48.358 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:27:48.358 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:27:48.358 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:27:48.358 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:27:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:27:48.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.430 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133462 s, 78.6 MB/s 2024-09-10T23:27:48.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.445 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122201 s, 85.8 MB/s 2024-09-10T23:27:48.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.462 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125527 s, 83.5 MB/s 2024-09-10T23:27:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111125 s, 94.4 MB/s 2024-09-10T23:27:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.491 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.492 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109006 s, 96.2 MB/s 2024-09-10T23:27:48.506 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.506 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.506 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107431 s, 97.6 MB/s 2024-09-10T23:27:48.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.523 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127159 s, 82.5 MB/s 2024-09-10T23:27:48.538 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.538 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.538 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120687 s, 86.9 MB/s 2024-09-10T23:27:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.554 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121568 s, 86.3 MB/s 2024-09-10T23:27:48.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.570 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011809 s, 88.8 MB/s 2024-09-10T23:27:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.587 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129717 s, 80.8 MB/s 2024-09-10T23:27:48.601 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.601 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.601 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109361 s, 95.9 MB/s 2024-09-10T23:27:48.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.616 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011172 s, 93.9 MB/s 2024-09-10T23:27:48.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.633 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115948 s, 90.4 MB/s 2024-09-10T23:27:48.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111909 s, 93.7 MB/s 2024-09-10T23:27:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.662 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116001 s, 90.4 MB/s 2024-09-10T23:27:48.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.677 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116561 s, 90.0 MB/s 2024-09-10T23:27:48.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111198 s, 94.3 MB/s 2024-09-10T23:27:48.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.707 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122739 s, 85.4 MB/s 2024-09-10T23:27:48.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.723 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114513 s, 91.6 MB/s 2024-09-10T23:27:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129959 s, 80.7 MB/s 2024-09-10T23:27:48.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119334 s, 87.9 MB/s 2024-09-10T23:27:48.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.771 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.771 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125593 s, 83.5 MB/s 2024-09-10T23:27:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120152 s, 87.3 MB/s 2024-09-10T23:27:48.803 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.803 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.803 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128782 s, 81.4 MB/s 2024-09-10T23:27:48.818 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.818 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.818 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112761 s, 93.0 MB/s 2024-09-10T23:27:48.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.833 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011134 s, 94.2 MB/s 2024-09-10T23:27:48.848 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.848 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.848 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116626 s, 89.9 MB/s 2024-09-10T23:27:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123915 s, 84.6 MB/s 2024-09-10T23:27:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107645 s, 97.4 MB/s 2024-09-10T23:27:48.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.893 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110699 s, 94.7 MB/s 2024-09-10T23:27:48.910 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:27:48.910 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:27:48.910 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134333 s, 78.1 MB/s 2024-09-10T23:27:48.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:27:48.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:48.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-09-10T23:27:49.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.065+0000 7f243b800640 1 -- 172.21.15.17:0/3613304130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f243415ab30 msgr2=0x7f2434073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.065+0000 7f243b800640 1 --2- 172.21.15.17:0/3613304130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f243415ab30 0x7f2434073000 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f243415e600 tx=0x7f242801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.065+0000 7f243b800640 1 -- 172.21.15.17:0/3613304130 shutdown_connections 2024-09-10T23:27:49.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.065+0000 7f243b800640 1 --2- 172.21.15.17:0/3613304130 >> v2:172.21.15.77:3300/0 conn(0x7f24340b3940 0x7f24340b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.065+0000 7f243b800640 1 --2- 172.21.15.17:0/3613304130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f243415ab30 0x7f2434073000 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.065+0000 7f243b800640 1 -- 172.21.15.17:0/3613304130 >> 172.21.15.17:0/3613304130 conn(0x7f24340b17a0 msgr2=0x7f24340b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.065+0000 7f243b800640 1 -- 172.21.15.17:0/3613304130 shutdown_connections 2024-09-10T23:27:49.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.065+0000 7f243b800640 1 -- 172.21.15.17:0/3613304130 wait complete. 2024-09-10T23:27:49.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 Processor -- start 2024-09-10T23:27:49.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 -- start start 2024-09-10T23:27:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2434072b40 0x7f24341446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24340b3940 0x7f24341f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f243415ab30 0x7f2434158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2434167a70 con 0x7f24340b3940 2024-09-10T23:27:49.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2434073e70 con 0x7f2434072b40 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2434167bf0 con 0x7f243415ab30 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2433e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24340b3940 0x7f24341f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2439800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f243415ab30 0x7f2434158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2433e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24340b3940 0x7f24341f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53070/0 (socket says 172.21.15.17:53070) 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2438e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2434072b40 0x7f24341446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2433e00640 1 -- 172.21.15.17:0/6902864 learned_addr learned my addr 172.21.15.17:0/6902864 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2433e00640 1 -- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f243415ab30 msgr2=0x7f2434158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2433e00640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f243415ab30 0x7f2434158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2433e00640 1 -- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2434072b40 msgr2=0x7f24341446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2433e00640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2434072b40 0x7f24341446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2433e00640 1 -- 172.21.15.17:0/6902864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2434158180 con 0x7f24340b3940 2024-09-10T23:27:49.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2433e00640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24340b3940 0x7f24341f78c0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f242000c500 tx=0x7f242000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2430c00640 1 -- 172.21.15.17:0/6902864 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420017070 con 0x7f24340b3940 2024-09-10T23:27:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2430c00640 1 -- 172.21.15.17:0/6902864 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24200053c0 con 0x7f24340b3940 2024-09-10T23:27:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 -- 172.21.15.17:0/6902864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24341f8110 con 0x7f24340b3940 2024-09-10T23:27:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f2430c00640 1 -- 172.21.15.17:0/6902864 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420003860 con 0x7f24340b3940 2024-09-10T23:27:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.069+0000 7f243b800640 1 -- 172.21.15.17:0/6902864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24341f86d0 con 0x7f24340b3940 2024-09-10T23:27:49.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f2430c00640 1 -- 172.21.15.17:0/6902864 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2420003a00 con 0x7f24340b3940 2024-09-10T23:27:49.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f2430c00640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2414072610 0x7f2414074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f243ec21000 1 Processor -- start 2024-09-10T23:27:49.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f2430c00640 1 -- 172.21.15.17:0/6902864 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f24200929e0 con 0x7f24340b3940 2024-09-10T23:27:49.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f243ec21000 1 -- start start 2024-09-10T23:27:49.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f2438e00640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2414072610 0x7f2414074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f2438e00640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2414072610 0x7f2414074ad0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f24280af000 tx=0x7f242801b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f243ec21000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 0x5580e3de1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f243ec21000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 0x5580e3d8ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f243ec21000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f243ec21000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580e3bea8f0 con 0x5580e3d8f180 2024-09-10T23:27:49.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f243ec21000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5580e3bd9d20 con 0x5580e3de1990 2024-09-10T23:27:49.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f243ec21000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5580e3bddb30 con 0x5580e3de1070 2024-09-10T23:27:49.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f2439800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f2439800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53082/0 (socket says 172.21.15.17:53082) 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.073+0000 7f2439800640 1 -- 172.21.15.17:0/1612387397 learned_addr learned my addr 172.21.15.17:0/1612387397 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2438e00640 1 --2- 172.21.15.17:0/1612387397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 0x5580e3de1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2433e00640 1 --2- 172.21.15.17:0/1612387397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 0x5580e3d8ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2439800640 1 -- 172.21.15.17:0/1612387397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 msgr2=0x5580e3de1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2439800640 1 --2- 172.21.15.17:0/1612387397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 0x5580e3de1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2439800640 1 -- 172.21.15.17:0/1612387397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 msgr2=0x5580e3d8ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2439800640 1 --2- 172.21.15.17:0/1612387397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 0x5580e3d8ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2439800640 1 -- 172.21.15.17:0/1612387397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e3b782c0 con 0x5580e3d8f180 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2439800640 1 --2- 172.21.15.17:0/1612387397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f242c009a20 tx=0x7f242c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1635c1e3edc21057 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2425600640 1 -- 172.21.15.17:0/1612387397 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c01a470 con 0x5580e3d8f180 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2425600640 1 -- 172.21.15.17:0/1612387397 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f242c015070 con 0x5580e3d8f180 2024-09-10T23:27:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2425600640 1 -- 172.21.15.17:0/1612387397 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c01a900 con 0x5580e3d8f180 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 -- 172.21.15.17:0/1612387397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 msgr2=0x5580e3d8f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 --2- 172.21.15.17:0/1612387397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f242c009a20 tx=0x7f242c003f90 comp rx=0 tx=0).stop 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 -- 172.21.15.17:0/1612387397 shutdown_connections 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 --2- 172.21.15.17:0/1612387397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 --2- 172.21.15.17:0/1612387397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 0x5580e3d8ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 --2- 172.21.15.17:0/1612387397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 0x5580e3de1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 -- 172.21.15.17:0/1612387397 >> 172.21.15.17:0/1612387397 conn(0x5580e3d952e0 msgr2=0x5580e3d8d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 -- 172.21.15.17:0/1612387397 shutdown_connections 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 -- 172.21.15.17:0/1612387397 wait complete. 2024-09-10T23:27:49.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 -- start start 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 Processor -- start 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3d8f180 0x5580e3de8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1070 0x5580e3de8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1990 0x5580e3de8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580e3b83cf0 con 0x5580e3de1990 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5580e3b852c0 con 0x5580e3de1070 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5580e3be96c0 con 0x5580e3d8f180 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f243ec21000 10 client.0 _ll_register_callbacks cb 0x5580e3d7a770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2439800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1990 0x5580e3de8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2433e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1070 0x5580e3de8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2438e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3d8f180 0x5580e3de8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2433e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1070 0x5580e3de8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:51144/0 (socket says 172.21.15.17:51144) 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2438e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3d8f180 0x5580e3de8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:41896/0 (socket says 172.21.15.17:41896) 2024-09-10T23:27:49.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.077+0000 7f2433e00640 1 -- 172.21.15.17:0/171291934 learned_addr learned my addr 172.21.15.17:0/171291934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2439800640 1 -- 172.21.15.17:0/171291934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3d8f180 msgr2=0x5580e3de8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2439800640 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3d8f180 0x5580e3de8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2439800640 1 -- 172.21.15.17:0/171291934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1070 msgr2=0x5580e3de8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2439800640 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1070 0x5580e3de8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2439800640 1 -- 172.21.15.17:0/171291934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e3b97230 con 0x5580e3de1990 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2438e00640 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3d8f180 0x5580e3de8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2433e00640 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1070 0x5580e3de8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2439800640 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1990 0x5580e3de8e80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f242c019000 tx=0x7f242c004910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7539bf40748ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 1 -- 172.21.15.17:0/171291934 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c004b30 con 0x5580e3de1990 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 1 -- 172.21.15.17:0/171291934 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f242c004cd0 con 0x5580e3de1990 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 -- 172.21.15.17:0/171291934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5580e3b72400 con 0x5580e3de1990 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 1 -- 172.21.15.17:0/171291934 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7f242c01a840 con 0x5580e3de1990 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 10 client.9900 fetch_fsmap learned FSMap version 121 2024-09-10T23:27:49.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 -- 172.21.15.17:0/171291934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) -- 0x5580e3b5f010 con 0x5580e3de1990 2024-09-10T23:27:49.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 1 -- 172.21.15.17:0/171291934 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5580e3b72400 con 0x5580e3de1990 2024-09-10T23:27:49.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 1 -- 172.21.15.17:0/171291934 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 121) ==== 3502+0+0 (secure 0 0 0) 0x7f242c01a9e0 con 0x5580e3de1990 2024-09-10T23:27:49.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 10 client.9900 fetch_fsmap finished waiting for FSMap version 121 2024-09-10T23:27:49.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 10 client.9900 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-10T23:27:49.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 20 client.9900 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:49.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x5580e3df07d0 0x5580e3df2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 4 client.9900 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:49.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 -- 172.21.15.17:0/171291934 --> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580e3bec840 con 0x5580e3df07d0 2024-09-10T23:27:49.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2438e00640 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x5580e3df07d0 0x5580e3df2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f2438e00640 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x5580e3df07d0 0x5580e3df2bc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aa5cf400cfe12ac server_cookie=d28d9337cf459ea7 in_seq=0 out_seq=0 2024-09-10T23:27:49.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 10 client.9900 ms_handle_connect on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 1 -- 172.21.15.17:0/171291934 <== mds.0 v2:172.21.15.17:6833/3026129347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580e3bec840 con 0x5580e3df07d0 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 10 client.9900 handle_command_reply: tid=0 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 client.9900 shutdown 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 -- 172.21.15.17:0/171291934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1990 msgr2=0x5580e3de8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1990 0x5580e3de8e80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f242c019000 tx=0x7f242c004910 comp rx=0 tx=0).stop 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 -- 172.21.15.17:0/171291934 shutdown_connections 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x5580e3df07d0 0x5580e3df2bc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1990 0x5580e3de8e80 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1070 0x5580e3de8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 --2- 172.21.15.17:0/171291934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3d8f180 0x5580e3de8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f241a000640 0 client.9900 ms_handle_reset on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 -- 172.21.15.17:0/171291934 >> 172.21.15.17:0/171291934 conn(0x5580e3d952e0 msgr2=0x5580e3d8d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 -- 172.21.15.17:0/171291934 shutdown_connections 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 1 -- 172.21.15.17:0/171291934 wait complete. 2024-09-10T23:27:49.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.081+0000 7f243ec21000 20 client.9900 trim_cache size 0 max 16384 2024-09-10T23:27:49.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.101+0000 7f243ec21000 1 Processor -- start 2024-09-10T23:27:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.101+0000 7f243ec21000 1 -- start start 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1070 0x5580e3d8faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1990 0x5580e3d8ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2434161060 con 0x5580e3de1070 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24341fb7c0 con 0x5580e3d8f180 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2434160a10 con 0x5580e3de1990 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2433e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1070 0x5580e3d8faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2439800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1990 0x5580e3d8ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2438e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2433e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1070 0x5580e3d8faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53090/0 (socket says 172.21.15.17:53090) 2024-09-10T23:27:49.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2439800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1990 0x5580e3d8ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:41910/0 (socket says 172.21.15.17:41910) 2024-09-10T23:27:49.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2433e00640 1 -- 172.21.15.17:0/384469308 learned_addr learned my addr 172.21.15.17:0/384469308 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2439800640 1 -- 172.21.15.17:0/384469308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3d8f180 msgr2=0x5580e3d8f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2439800640 1 --2- 172.21.15.17:0/384469308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2439800640 1 -- 172.21.15.17:0/384469308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1070 msgr2=0x5580e3d8faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2439800640 1 --2- 172.21.15.17:0/384469308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1070 0x5580e3d8faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2439800640 1 -- 172.21.15.17:0/384469308 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580e3c36320 con 0x5580e3de1990 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2433e00640 1 --2- 172.21.15.17:0/384469308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1070 0x5580e3d8faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2438e00640 1 --2- 172.21.15.17:0/384469308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2439800640 1 --2- 172.21.15.17:0/384469308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1990 0x5580e3d8ffe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f242c009900 tx=0x7f242c003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bce6a9c6a390b77b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2424c00640 1 -- 172.21.15.17:0/384469308 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c003980 con 0x5580e3de1990 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2424c00640 1 -- 172.21.15.17:0/384469308 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f242c015040 con 0x5580e3de1990 2024-09-10T23:27:49.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f2424c00640 1 -- 172.21.15.17:0/384469308 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c01a9e0 con 0x5580e3de1990 2024-09-10T23:27:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 -- 172.21.15.17:0/384469308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1990 msgr2=0x5580e3d8ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 --2- 172.21.15.17:0/384469308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1990 0x5580e3d8ffe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f242c009900 tx=0x7f242c003f90 comp rx=0 tx=0).stop 2024-09-10T23:27:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 -- 172.21.15.17:0/384469308 shutdown_connections 2024-09-10T23:27:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 --2- 172.21.15.17:0/384469308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1990 0x5580e3d8ffe0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 --2- 172.21.15.17:0/384469308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3de1070 0x5580e3d8faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 --2- 172.21.15.17:0/384469308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3d8f180 0x5580e3d8f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 -- 172.21.15.17:0/384469308 >> 172.21.15.17:0/384469308 conn(0x5580e3d952e0 msgr2=0x5580e3d93440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 -- 172.21.15.17:0/384469308 shutdown_connections 2024-09-10T23:27:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 -- 172.21.15.17:0/384469308 wait complete. 2024-09-10T23:27:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.105+0000 7f243ec21000 1 -- start start 2024-09-10T23:27:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 Processor -- start 2024-09-10T23:27:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3e57d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 0x5580e3e58290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 0x5580e3e587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5580e3bdce40 con 0x5580e3d8f180 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5580e3b99830 con 0x5580e3de1990 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5580e3be2160 con 0x5580e3de1070 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 10 client.0 _ll_register_callbacks cb 0x7f242c003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2438e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3e57d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2438e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3e57d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53106/0 (socket says 172.21.15.17:53106) 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2438e00640 1 -- 172.21.15.17:0/2506015339 learned_addr learned my addr 172.21.15.17:0/2506015339 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2439800640 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 0x5580e3e587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2433e00640 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 0x5580e3e58290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2439800640 1 -- 172.21.15.17:0/2506015339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 msgr2=0x5580e3e58290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2439800640 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 0x5580e3e58290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2439800640 1 -- 172.21.15.17:0/2506015339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 msgr2=0x5580e3e57d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2439800640 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3e57d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2439800640 1 -- 172.21.15.17:0/2506015339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580e3ba2d60 con 0x5580e3de1990 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2438e00640 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3e57d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2439800640 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 0x5580e3e587d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f242c009690 tx=0x7f242c004d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98ea1767fda76475 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f241a000640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f241a000640 1 -- 172.21.15.17:0/2506015339 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c003980 con 0x5580e3de1990 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f241a000640 1 -- 172.21.15.17:0/2506015339 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f242c02d890 con 0x5580e3de1990 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 -- 172.21.15.17:0/2506015339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f242c015040 con 0x5580e3de1990 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f241a000640 1 -- 172.21.15.17:0/2506015339 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7f242c042050 con 0x5580e3de1990 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 10 client.9175 fetch_fsmap learned FSMap version 121 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 -- 172.21.15.17:0/2506015339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) -- 0x5580e38901a0 con 0x5580e3de1990 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f241a000640 1 -- 172.21.15.17:0/2506015339 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f242c015040 con 0x5580e3de1990 2024-09-10T23:27:49.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f241a000640 1 -- 172.21.15.17:0/2506015339 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 121) ==== 3502+0+0 (secure 0 0 0) 0x7f242c045020 con 0x5580e3de1990 2024-09-10T23:27:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 10 client.9175 fetch_fsmap finished waiting for FSMap version 121 2024-09-10T23:27:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 10 client.9175 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-10T23:27:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 20 client.9175 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x5580e3ded940 0x5580e3dedd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 4 client.9175 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T23:27:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f243ec21000 1 -- 172.21.15.17:0/2506015339 --> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5580e3df8ee0 con 0x5580e3ded940 2024-09-10T23:27:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.109+0000 7f2438e00640 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x5580e3ded940 0x5580e3dedd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f2438e00640 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x5580e3ded940 0x5580e3dedd50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c1eea44b2d2ce82 server_cookie=18a21bdf131f8661 in_seq=0 out_seq=0 2024-09-10T23:27:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f241a000640 10 client.9175 ms_handle_connect on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f241a000640 1 -- 172.21.15.17:0/2506015339 <== mds.0 v2:172.21.15.17:6833/3026129347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5580e3df8ee0 con 0x5580e3ded940 2024-09-10T23:27:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f241a000640 10 client.9175 handle_command_reply: tid=0 2024-09-10T23:27:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 client.9175 shutdown 2024-09-10T23:27:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 -- 172.21.15.17:0/2506015339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 msgr2=0x5580e3e587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 0x5580e3e587d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f242c009690 tx=0x7f242c004d60 comp rx=0 tx=0).stop 2024-09-10T23:27:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 -- 172.21.15.17:0/2506015339 shutdown_connections 2024-09-10T23:27:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x5580e3ded940 0x5580e3dedd50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5580e3de1990 0x5580e3e587d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5580e3de1070 0x5580e3e58290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 --2- 172.21.15.17:0/2506015339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580e3d8f180 0x5580e3e57d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f241a000640 0 client.9175 ms_handle_reset on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 -- 172.21.15.17:0/2506015339 >> 172.21.15.17:0/2506015339 conn(0x5580e3d952e0 msgr2=0x5580e3d93c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 -- 172.21.15.17:0/2506015339 shutdown_connections 2024-09-10T23:27:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 1 -- 172.21.15.17:0/2506015339 wait complete. 2024-09-10T23:27:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.113+0000 7f243ec21000 20 client.9175 trim_cache size 0 max 16384 2024-09-10T23:27:49.120 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:27:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:27:49.120 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "8eb67384-86a0-4384-927e-b6c13e1edd7f", 2024-09-10T23:27:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:27:49.121 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:27:49.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 -- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2414072610 msgr2=0x7f2414074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2414072610 0x7f2414074ad0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f24280af000 tx=0x7f242801b100 comp rx=0 tx=0).stop 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 -- 172.21.15.17:0/6902864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24340b3940 msgr2=0x7f24341f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24340b3940 0x7f24341f78c0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f242000c500 tx=0x7f242000c9c0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 -- 172.21.15.17:0/6902864 shutdown_connections 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2414072610 0x7f2414074ad0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f243415ab30 0x7f2434158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24340b3940 0x7f24341f78c0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 --2- 172.21.15.17:0/6902864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2434072b40 0x7f24341446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 -- 172.21.15.17:0/6902864 >> 172.21.15.17:0/6902864 conn(0x7f24340b17a0 msgr2=0x7f24340b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 -- 172.21.15.17:0/6902864 shutdown_connections 2024-09-10T23:27:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.117+0000 7f243b800640 1 -- 172.21.15.17:0/6902864 wait complete. 2024-09-10T23:27:49.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:49.143 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-09-10T23:27:49.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.361+0000 7f01a2c00640 1 -- 172.21.15.17:0/1228260176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c074b40 msgr2=0x7f019c0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.361+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1228260176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c074b40 0x7f019c0691b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f019c09e3d0 tx=0x7f018801c4b0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.361+0000 7f01a2c00640 1 -- 172.21.15.17:0/1228260176 shutdown_connections 2024-09-10T23:27:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.361+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1228260176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f019c0696f0 0x7f019c0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.361+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1228260176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c074b40 0x7f019c0691b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.361+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1228260176 >> v2:172.21.15.17:3300/0 conn(0x7f019c15bcd0 0x7f019c074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.361+0000 7f01a2c00640 1 -- 172.21.15.17:0/1228260176 >> 172.21.15.17:0/1228260176 conn(0x7f019c0b1da0 msgr2=0x7f019c0b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.361+0000 7f01a2c00640 1 -- 172.21.15.17:0/1228260176 shutdown_connections 2024-09-10T23:27:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.361+0000 7f01a2c00640 1 -- 172.21.15.17:0/1228260176 wait complete. 2024-09-10T23:27:49.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2c00640 1 Processor -- start 2024-09-10T23:27:49.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2c00640 1 -- start start 2024-09-10T23:27:49.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f019c0696f0 0x7f019c0c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019c074b40 0x7f019c099800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c15bcd0 0x7f019c0c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f019c0b5440 con 0x7f019c074b40 2024-09-10T23:27:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f019c0b52c0 con 0x7f019c15bcd0 2024-09-10T23:27:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f019c0b55c0 con 0x7f019c0696f0 2024-09-10T23:27:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c15bcd0 0x7f019c0c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019c074b40 0x7f019c099800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a1800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f019c0696f0 0x7f019c0c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c15bcd0 0x7f019c0c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:51168/0 (socket says 172.21.15.17:51168) 2024-09-10T23:27:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.365+0000 7f01a2200640 1 -- 172.21.15.17:0/1008791175 learned_addr learned my addr 172.21.15.17:0/1008791175 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f01a2200640 1 -- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f019c0696f0 msgr2=0x7f019c0c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f01a2200640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f019c0696f0 0x7f019c0c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f01a2200640 1 -- 172.21.15.17:0/1008791175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019c074b40 msgr2=0x7f019c099800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f01a2200640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019c074b40 0x7f019c099800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f01a2200640 1 -- 172.21.15.17:0/1008791175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c153ed0 con 0x7f019c15bcd0 2024-09-10T23:27:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f01a2200640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c15bcd0 0x7f019c0c4d50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f019400eab0 tx=0x7f019400ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f0199600640 1 -- 172.21.15.17:0/1008791175 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194004b30 con 0x7f019c15bcd0 2024-09-10T23:27:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f0199600640 1 -- 172.21.15.17:0/1008791175 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0194004dc0 con 0x7f019c15bcd0 2024-09-10T23:27:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f01a2c00640 1 -- 172.21.15.17:0/1008791175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019c156b90 con 0x7f019c15bcd0 2024-09-10T23:27:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f0199600640 1 -- 172.21.15.17:0/1008791175 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194005280 con 0x7f019c15bcd0 2024-09-10T23:27:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.369+0000 7f01a2c00640 1 -- 172.21.15.17:0/1008791175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019c0c4830 con 0x7f019c15bcd0 2024-09-10T23:27:49.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f0199600640 1 -- 172.21.15.17:0/1008791175 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0194020030 con 0x7f019c15bcd0 2024-09-10T23:27:49.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a755b000 1 Processor -- start 2024-09-10T23:27:49.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a755b000 1 -- start start 2024-09-10T23:27:49.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f0199600640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f017c072610 0x7f017c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f0199600640 1 -- 172.21.15.17:0/1008791175 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f0194093e00 con 0x7f019c15bcd0 2024-09-10T23:27:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a0e00640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f017c072610 0x7f017c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a755b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492ff0d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a755b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492ff0dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a755b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 0x56492fec3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a755b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56492fcbd2c0 con 0x56492fec39b0 2024-09-10T23:27:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a755b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56492fd1ab90 con 0x56492ff0d830 2024-09-10T23:27:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a755b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56492fd09fc0 con 0x56492fda71d0 2024-09-10T23:27:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a0e00640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f017c072610 0x7f017c074ad0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f01880af000 tx=0x7f018801acf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a1800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492ff0d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 0x56492fec3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a1800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492ff0d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:41958/0 (socket says 172.21.15.17:41958) 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a1800640 1 -- 172.21.15.17:0/1513553932 learned_addr learned my addr 172.21.15.17:0/1513553932 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.373+0000 7f01a0e00640 1 --2- 172.21.15.17:0/1513553932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492ff0dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a1800640 1 -- 172.21.15.17:0/1513553932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 msgr2=0x56492ff0dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a1800640 1 --2- 172.21.15.17:0/1513553932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492ff0dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a1800640 1 -- 172.21.15.17:0/1513553932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 msgr2=0x56492fec3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a1800640 1 --2- 172.21.15.17:0/1513553932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 0x56492fec3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a1800640 1 -- 172.21.15.17:0/1513553932 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492fca81a0 con 0x56492fda71d0 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a2200640 1 --2- 172.21.15.17:0/1513553932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 0x56492fec3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a1800640 1 --2- 172.21.15.17:0/1513553932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492ff0d2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0190009c60 tx=0x7f0190011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=857b53b8317fafa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f018e000640 1 -- 172.21.15.17:0/1513553932 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019001e070 con 0x56492fda71d0 2024-09-10T23:27:49.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f018e000640 1 -- 172.21.15.17:0/1513553932 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0190019720 con 0x56492fda71d0 2024-09-10T23:27:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f018e000640 1 -- 172.21.15.17:0/1513553932 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0190019b30 con 0x56492fda71d0 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 -- 172.21.15.17:0/1513553932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 msgr2=0x56492ff0d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 --2- 172.21.15.17:0/1513553932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492ff0d2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0190009c60 tx=0x7f0190011810 comp rx=0 tx=0).stop 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 -- 172.21.15.17:0/1513553932 shutdown_connections 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 --2- 172.21.15.17:0/1513553932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 0x56492fec3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 --2- 172.21.15.17:0/1513553932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492ff0dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 --2- 172.21.15.17:0/1513553932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492ff0d2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 -- 172.21.15.17:0/1513553932 >> 172.21.15.17:0/1513553932 conn(0x56492f9c8880 msgr2=0x56492fec2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 -- 172.21.15.17:0/1513553932 shutdown_connections 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 -- 172.21.15.17:0/1513553932 wait complete. 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 -- start start 2024-09-10T23:27:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.377+0000 7f01a755b000 1 Processor -- start 2024-09-10T23:27:49.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492fef8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 0x56492fef8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492fef94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56492fcaf4d0 con 0x56492fec39b0 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56492fd0ddd0 con 0x56492ff0d830 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56492f9cf620 con 0x56492fda71d0 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 10 client.0 _ll_register_callbacks cb 0x56492fce0cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a1800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492fef8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a1800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492fef8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:41970/0 (socket says 172.21.15.17:41970) 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a1800640 1 -- 172.21.15.17:0/2441175389 learned_addr learned my addr 172.21.15.17:0/2441175389 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a0e00640 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 0x56492fef8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a2200640 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492fef94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a1800640 1 -- 172.21.15.17:0/2441175389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 msgr2=0x56492fef94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a1800640 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492fef94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a1800640 1 -- 172.21.15.17:0/2441175389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 msgr2=0x56492fef8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a1800640 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 0x56492fef8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a1800640 1 -- 172.21.15.17:0/2441175389 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x56492fdd9720 con 0x56492fda71d0 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a1800640 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492fef8a70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x56492fcd2110 tx=0x7f0190004630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=634635b89fca9ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f0182a00640 10 client.0 ms_handle_connect on v2:172.21.15.77:3301/0 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f0182a00640 1 -- 172.21.15.17:0/2441175389 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019001e070 con 0x56492fda71d0 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f0182a00640 1 -- 172.21.15.17:0/2441175389 <== mon.2 v2:172.21.15.77:3301/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f0190003800 con 0x56492fda71d0 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 -- 172.21.15.17:0/2441175389 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x56492fca22e0 con 0x56492fda71d0 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f0182a00640 1 -- 172.21.15.17:0/2441175389 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7f0190030050 con 0x56492fda71d0 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 10 client.8060 fetch_fsmap learned FSMap version 121 2024-09-10T23:27:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 -- 172.21.15.17:0/2441175389 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) -- 0x56492fd8f420 con 0x56492fda71d0 2024-09-10T23:27:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f0182a00640 1 -- 172.21.15.17:0/2441175389 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56492fca22e0 con 0x56492fda71d0 2024-09-10T23:27:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f0182a00640 1 -- 172.21.15.17:0/2441175389 <== mon.2 v2:172.21.15.77:3301/0 5 ==== fsmap(e 121) ==== 3502+0+0 (secure 0 0 0) 0x7f0190033020 con 0x56492fda71d0 2024-09-10T23:27:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 10 client.8060 fetch_fsmap finished waiting for FSMap version 121 2024-09-10T23:27:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 10 client.8060 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-10T23:27:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 20 client.8060 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x56492ff1cfb0 0x56492ff1f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 4 client.8060 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:49.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.381+0000 7f01a755b000 1 -- 172.21.15.17:0/2441175389 --> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56492fd1cae0 con 0x56492ff1cfb0 2024-09-10T23:27:49.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a0e00640 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x56492ff1cfb0 0x56492ff1f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a0e00640 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x56492ff1cfb0 0x56492ff1f3a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c841b39601e70943 server_cookie=f73ed1321d38de33 in_seq=0 out_seq=0 2024-09-10T23:27:49.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f0182a00640 10 client.8060 ms_handle_connect on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f0182a00640 1 -- 172.21.15.17:0/2441175389 <== mds.0 v2:172.21.15.17:6833/3026129347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56492fd1cae0 con 0x56492ff1cfb0 2024-09-10T23:27:49.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f0182a00640 10 client.8060 handle_command_reply: tid=0 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 client.8060 shutdown 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 -- 172.21.15.17:0/2441175389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 msgr2=0x56492fef8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492fef8a70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x56492fcd2110 tx=0x7f0190004630 comp rx=0 tx=0).stop 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 -- 172.21.15.17:0/2441175389 shutdown_connections 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x56492ff1cfb0 0x56492ff1f3a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492fef94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fec39b0 0x56492fef8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 --2- 172.21.15.17:0/2441175389 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fda71d0 0x56492fef8a70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f0182a00640 0 client.8060 ms_handle_reset on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 -- 172.21.15.17:0/2441175389 >> 172.21.15.17:0/2441175389 conn(0x56492f9c8880 msgr2=0x56492fec2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 -- 172.21.15.17:0/2441175389 shutdown_connections 2024-09-10T23:27:49.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.385+0000 7f01a755b000 1 -- 172.21.15.17:0/2441175389 wait complete. 2024-09-10T23:27:49.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.389+0000 7f01a755b000 20 client.8060 trim_cache size 0 max 16384 2024-09-10T23:27:49.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a755b000 1 Processor -- start 2024-09-10T23:27:49.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a755b000 1 -- start start 2024-09-10T23:27:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a755b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492fec2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a755b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492fec39b0 0x56492fec27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a755b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492ff0d830 0x56492ff1d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a755b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f019c200380 con 0x56492fda71d0 2024-09-10T23:27:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a755b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f019c070840 con 0x56492fec39b0 2024-09-10T23:27:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a755b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f019c156240 con 0x56492ff0d830 2024-09-10T23:27:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492fec2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.413+0000 7f01a1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492fec2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53136/0 (socket says 172.21.15.17:53136) 2024-09-10T23:27:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a1800640 1 -- 172.21.15.17:0/2160048017 learned_addr learned my addr 172.21.15.17:0/2160048017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a2200640 1 --2- 172.21.15.17:0/2160048017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492ff0d830 0x56492ff1d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a0e00640 1 --2- 172.21.15.17:0/2160048017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492fec39b0 0x56492fec27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a1800640 1 -- 172.21.15.17:0/2160048017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492ff0d830 msgr2=0x56492ff1d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a1800640 1 --2- 172.21.15.17:0/2160048017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492ff0d830 0x56492ff1d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a1800640 1 -- 172.21.15.17:0/2160048017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492fec39b0 msgr2=0x56492fec27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a1800640 1 --2- 172.21.15.17:0/2160048017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492fec39b0 0x56492fec27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a1800640 1 -- 172.21.15.17:0/2160048017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492fd66ae0 con 0x56492fda71d0 2024-09-10T23:27:49.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a1800640 1 --2- 172.21.15.17:0/2160048017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492fec2290 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f0190009bb0 tx=0x7f0190003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b9e4d13dd3c062 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f018d600640 1 -- 172.21.15.17:0/2160048017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019003a070 con 0x56492fda71d0 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f018d600640 1 -- 172.21.15.17:0/2160048017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0190000e50 con 0x56492fda71d0 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f018d600640 1 -- 172.21.15.17:0/2160048017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019001e040 con 0x56492fda71d0 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 -- 172.21.15.17:0/2160048017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 msgr2=0x56492fec2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 --2- 172.21.15.17:0/2160048017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492fec2290 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f0190009bb0 tx=0x7f0190003f70 comp rx=0 tx=0).stop 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 -- 172.21.15.17:0/2160048017 shutdown_connections 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 --2- 172.21.15.17:0/2160048017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492ff0d830 0x56492ff1d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 --2- 172.21.15.17:0/2160048017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492fec39b0 0x56492fec27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 --2- 172.21.15.17:0/2160048017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492fec2290 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 -- 172.21.15.17:0/2160048017 >> 172.21.15.17:0/2160048017 conn(0x56492f9c8880 msgr2=0x56492ff1a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 -- 172.21.15.17:0/2160048017 shutdown_connections 2024-09-10T23:27:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 -- 172.21.15.17:0/2160048017 wait complete. 2024-09-10T23:27:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 -- start start 2024-09-10T23:27:49.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.417+0000 7f01a755b000 1 Processor -- start 2024-09-10T23:27:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492ff83520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fec39b0 0x56492ff83a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492ff83fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56492f9cf620 con 0x56492fda71d0 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56492fcb5020 con 0x56492ff0d830 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56492fcd5c50 con 0x56492fec39b0 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 10 client.0 _ll_register_callbacks cb 0x7f019001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492ff83520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492ff83520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53148/0 (socket says 172.21.15.17:53148) 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a1800640 1 -- 172.21.15.17:0/1235257606 learned_addr learned my addr 172.21.15.17:0/1235257606 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a0e00640 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fec39b0 0x56492ff83a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a2200640 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492ff83fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a1800640 1 -- 172.21.15.17:0/1235257606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fec39b0 msgr2=0x56492ff83a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a1800640 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fec39b0 0x56492ff83a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a1800640 1 -- 172.21.15.17:0/1235257606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 msgr2=0x56492ff83fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a1800640 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492ff83fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a1800640 1 -- 172.21.15.17:0/1235257606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56492fcd4040 con 0x56492fda71d0 2024-09-10T23:27:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a1800640 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492ff83520 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f0190009c60 tx=0x7f0190009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0c39941302d1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f0182a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:27:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f0182a00640 1 -- 172.21.15.17:0/1235257606 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019001e070 con 0x56492fda71d0 2024-09-10T23:27:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 -- 172.21.15.17:0/1235257606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0190000e50 con 0x56492fda71d0 2024-09-10T23:27:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f0182a00640 1 -- 172.21.15.17:0/1235257606 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f01900047b0 con 0x56492fda71d0 2024-09-10T23:27:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f0182a00640 1 -- 172.21.15.17:0/1235257606 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7f0190043050 con 0x56492fda71d0 2024-09-10T23:27:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 10 client.9924 fetch_fsmap learned FSMap version 121 2024-09-10T23:27:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 -- 172.21.15.17:0/1235257606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) -- 0x56492fca0620 con 0x56492fda71d0 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f0182a00640 1 -- 172.21.15.17:0/1235257606 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0190000e50 con 0x56492fda71d0 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f0182a00640 1 -- 172.21.15.17:0/1235257606 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 121) ==== 3502+0+0 (secure 0 0 0) 0x7f0190046020 con 0x56492fda71d0 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 10 client.9924 fetch_fsmap finished waiting for FSMap version 121 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 10 client.9924 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 20 client.9924 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x56492ff204c0 0x56492ff208d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 4 client.9924 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a755b000 1 -- 172.21.15.17:0/1235257606 --> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x56492fd18590 con 0x56492ff204c0 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.421+0000 7f01a0e00640 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x56492ff204c0 0x56492ff208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.425+0000 7f0182a00640 10 client.9924 ms_handle_connect on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.425+0000 7f01a0e00640 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x56492ff204c0 0x56492ff208d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5511e976c1fb60 server_cookie=c2cdd25222221a03 in_seq=0 out_seq=0 2024-09-10T23:27:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f0182a00640 1 -- 172.21.15.17:0/1235257606 <== mds.0 v2:172.21.15.17:6833/3026129347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56492fd18590 con 0x56492ff204c0 2024-09-10T23:27:49.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f0182a00640 10 client.9924 handle_command_reply: tid=0 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 client.9924 shutdown 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 -- 172.21.15.17:0/1235257606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 msgr2=0x56492ff83520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492ff83520 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f0190009c60 tx=0x7f0190009370 comp rx=0 tx=0).stop 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 -- 172.21.15.17:0/1235257606 shutdown_connections 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x56492ff204c0 0x56492ff208d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56492ff0d830 0x56492ff83fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x56492fec39b0 0x56492ff83a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 --2- 172.21.15.17:0/1235257606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56492fda71d0 0x56492ff83520 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 -- 172.21.15.17:0/1235257606 >> 172.21.15.17:0/1235257606 conn(0x56492f9c8880 msgr2=0x56492fec3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f0182a00640 0 client.9924 ms_handle_reset on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 -- 172.21.15.17:0/1235257606 shutdown_connections 2024-09-10T23:27:49.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 1 -- 172.21.15.17:0/1235257606 wait complete. 2024-09-10T23:27:49.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a755b000 20 client.9924 trim_cache size 0 max 16384 2024-09-10T23:27:49.435 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:27:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-09-10T23:27:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0 2024-09-10T23:27:49.436 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:27:49.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 -- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f017c072610 msgr2=0x7f017c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f017c072610 0x7f017c074ad0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f01880af000 tx=0x7f018801acf0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 -- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c15bcd0 msgr2=0x7f019c0c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c15bcd0 0x7f019c0c4d50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f019400eab0 tx=0x7f019400ef70 comp rx=0 tx=0).stop 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 -- 172.21.15.17:0/1008791175 shutdown_connections 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f017c072610 0x7f017c074ad0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f019c15bcd0 0x7f019c0c4d50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019c074b40 0x7f019c099800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 --2- 172.21.15.17:0/1008791175 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f019c0696f0 0x7f019c0c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 -- 172.21.15.17:0/1008791175 >> 172.21.15.17:0/1008791175 conn(0x7f019c0b1da0 msgr2=0x7f019c0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 -- 172.21.15.17:0/1008791175 shutdown_connections 2024-09-10T23:27:49.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.429+0000 7f01a2c00640 1 -- 172.21.15.17:0/1008791175 wait complete. 2024-09-10T23:27:49.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:27:49.456 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-09-10T23:27:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 -- 172.21.15.17:0/471985957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb80b30e0 msgr2=0x7f5eb81664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 --2- 172.21.15.17:0/471985957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb80b30e0 0x7f5eb81664d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009bf0 tx=0x7f5eb001cad0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 -- 172.21.15.17:0/471985957 shutdown_connections 2024-09-10T23:27:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 --2- 172.21.15.17:0/471985957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb80b30e0 0x7f5eb81664d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 -- 172.21.15.17:0/471985957 >> 172.21.15.17:0/471985957 conn(0x7f5eb809a9f0 msgr2=0x7f5eb809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 -- 172.21.15.17:0/471985957 shutdown_connections 2024-09-10T23:27:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 -- 172.21.15.17:0/471985957 wait complete. 2024-09-10T23:27:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 Processor -- start 2024-09-10T23:27:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 -- start start 2024-09-10T23:27:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb80b30e0 0x7f5eb8148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb815b8c0 0x7f5eb8150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb815bca0 0x7f5eb8157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8169e30 con 0x7f5eb80b30e0 2024-09-10T23:27:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8169cb0 con 0x7f5eb815bca0 2024-09-10T23:27:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebec00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb8169fb0 con 0x7f5eb815b8c0 2024-09-10T23:27:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebd800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb80b30e0 0x7f5eb8148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebd800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb80b30e0 0x7f5eb8148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53156/0 (socket says 172.21.15.17:53156) 2024-09-10T23:27:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebd800640 1 -- 172.21.15.17:0/1457836959 learned_addr learned my addr 172.21.15.17:0/1457836959 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebe200640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb815bca0 0x7f5eb8157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebce00640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb815b8c0 0x7f5eb8150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebd800640 1 -- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb815b8c0 msgr2=0x7f5eb8150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebd800640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb815b8c0 0x7f5eb8150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebd800640 1 -- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb815bca0 msgr2=0x7f5eb8157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebd800640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb815bca0 0x7f5eb8157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebd800640 1 -- 172.21.15.17:0/1457836959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb814ff40 con 0x7f5eb80b30e0 2024-09-10T23:27:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.621+0000 7f5ebd800640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb80b30e0 0x7f5eb8148cc0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00c700 tx=0x7f5eac00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.625+0000 7f5eb5600640 1 -- 172.21.15.17:0/1457836959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac016020 con 0x7f5eb80b30e0 2024-09-10T23:27:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.625+0000 7f5eb5600640 1 -- 172.21.15.17:0/1457836959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5eac00a930 con 0x7f5eb80b30e0 2024-09-10T23:27:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.625+0000 7f5eb5600640 1 -- 172.21.15.17:0/1457836959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac00ad80 con 0x7f5eb80b30e0 2024-09-10T23:27:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.625+0000 7f5ebec00640 1 -- 172.21.15.17:0/1457836959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb8156740 con 0x7f5eb80b30e0 2024-09-10T23:27:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.625+0000 7f5ebec00640 1 -- 172.21.15.17:0/1457836959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb8156d00 con 0x7f5eb80b30e0 2024-09-10T23:27:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.625+0000 7f5eb5600640 1 -- 172.21.15.17:0/1457836959 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5eac01b400 con 0x7f5eb80b30e0 2024-09-10T23:27:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5eb5600640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e980725e0 0x7f5e98074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 Processor -- start 2024-09-10T23:27:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5eb5600640 1 -- 172.21.15.17:0/1457836959 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f5eac093770 con 0x7f5eb80b30e0 2024-09-10T23:27:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 -- start start 2024-09-10T23:27:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e980725e0 0x7f5e98074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e980725e0 0x7f5e98074aa0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80c8980 tx=0x7f5ea4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 0x560eb82159e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215f20 0x560eb81cba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cbfd0 0x560eb81cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560eb80afcb0 con 0x560eb8215f20 2024-09-10T23:27:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560eb7fc5310 con 0x560eb8215600 2024-09-10T23:27:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560eb8022b90 con 0x560eb81cbfd0 2024-09-10T23:27:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215f20 0x560eb81cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215f20 0x560eb81cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53172/0 (socket says 172.21.15.17:53172) 2024-09-10T23:27:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 -- 172.21.15.17:0/3514093610 learned_addr learned my addr 172.21.15.17:0/3514093610 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebd800640 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 0x560eb82159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebe200640 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cbfd0 0x560eb81cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 -- 172.21.15.17:0/3514093610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cbfd0 msgr2=0x560eb81cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cbfd0 0x560eb81cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 -- 172.21.15.17:0/3514093610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 msgr2=0x560eb82159e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 0x560eb82159e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 -- 172.21.15.17:0/3514093610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb7fc6c60 con 0x560eb8215f20 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebd800640 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 0x560eb82159e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ebce00640 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215f20 0x560eb81cba90 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4001130 tx=0x7f5ea4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d867a19d95af974 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5eaa000640 1 -- 172.21.15.17:0/3514093610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4025070 con 0x560eb8215f20 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5eaa000640 1 -- 172.21.15.17:0/3514093610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ea401b050 con 0x560eb8215f20 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5eaa000640 1 -- 172.21.15.17:0/3514093610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4014c70 con 0x560eb8215f20 2024-09-10T23:27:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 -- 172.21.15.17:0/3514093610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215f20 msgr2=0x560eb81cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215f20 0x560eb81cba90 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4001130 tx=0x7f5ea4012000 comp rx=0 tx=0).stop 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 -- 172.21.15.17:0/3514093610 shutdown_connections 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cbfd0 0x560eb81cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215f20 0x560eb81cba90 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 --2- 172.21.15.17:0/3514093610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 0x560eb82159e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 -- 172.21.15.17:0/3514093610 >> 172.21.15.17:0/3514093610 conn(0x560eb81cdd20 msgr2=0x560eb81c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 -- 172.21.15.17:0/3514093610 shutdown_connections 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.629+0000 7f5ec3534000 1 -- 172.21.15.17:0/3514093610 wait complete. 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 -- start start 2024-09-10T23:27:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 Processor -- start 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cbfd0 0x560eb81ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 0x560eb81fff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215f20 0x560eb82004d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560eb8015dd0 con 0x560eb81cbfd0 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560eb8011fc0 con 0x560eb8215600 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560eb7fb74b0 con 0x560eb8215f20 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 10 client.0 _ll_register_callbacks cb 0x560eb7f957d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebd800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cbfd0 0x560eb81ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebd800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cbfd0 0x560eb81ffa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53182/0 (socket says 172.21.15.17:53182) 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebd800640 1 -- 172.21.15.17:0/1322738759 learned_addr learned my addr 172.21.15.17:0/1322738759 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebce00640 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 0x560eb81fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebe200640 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215f20 0x560eb82004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebd800640 1 -- 172.21.15.17:0/1322738759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215f20 msgr2=0x560eb82004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebd800640 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215f20 0x560eb82004d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebd800640 1 -- 172.21.15.17:0/1322738759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 msgr2=0x560eb81fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebd800640 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 0x560eb81fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebd800640 1 -- 172.21.15.17:0/1322738759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb7fb01f0 con 0x560eb81cbfd0 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebd800640 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cbfd0 0x560eb81ffa50 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f5eac05e2d0 tx=0x7f5eac063000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b724c910c3889af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5e9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5e9ea00640 1 -- 172.21.15.17:0/1322738759 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac05da30 con 0x560eb81cbfd0 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5e9ea00640 1 -- 172.21.15.17:0/1322738759 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f5eac065200 con 0x560eb81cbfd0 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 -- 172.21.15.17:0/1322738759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560eb7faa330 con 0x560eb81cbfd0 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5e9ea00640 1 -- 172.21.15.17:0/1322738759 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7f5eac065400 con 0x560eb81cbfd0 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 10 client.9936 fetch_fsmap learned FSMap version 121 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 -- 172.21.15.17:0/1322738759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) -- 0x560eb7f96fa0 con 0x560eb81cbfd0 2024-09-10T23:27:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5e9ea00640 1 -- 172.21.15.17:0/1322738759 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560eb7faa330 con 0x560eb81cbfd0 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5e9ea00640 1 -- 172.21.15.17:0/1322738759 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 121) ==== 3502+0+0 (secure 0 0 0) 0x7f5eac059f20 con 0x560eb81cbfd0 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 10 client.9936 fetch_fsmap finished waiting for FSMap version 121 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 10 client.9936 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 20 client.9936 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x560eb8200ee0 0x560eb82268b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 4 client.9936 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ec3534000 1 -- 172.21.15.17:0/1322738759 --> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eb8024ae0 con 0x560eb8200ee0 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.633+0000 7f5ebce00640 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x560eb8200ee0 0x560eb82268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ebce00640 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x560eb8200ee0 0x560eb82268b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e1ff52b8fb3c9de server_cookie=b92ca6cd60462b09 in_seq=0 out_seq=0 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5e9ea00640 10 client.9936 ms_handle_connect on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5e9ea00640 1 -- 172.21.15.17:0/1322738759 <== mds.0 v2:172.21.15.17:6833/3026129347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560eb8024ae0 con 0x560eb8200ee0 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5e9ea00640 10 client.9936 handle_command_reply: tid=0 2024-09-10T23:27:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 client.9936 shutdown 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 -- 172.21.15.17:0/1322738759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cbfd0 msgr2=0x560eb81ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cbfd0 0x560eb81ffa50 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f5eac05e2d0 tx=0x7f5eac063000 comp rx=0 tx=0).stop 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 -- 172.21.15.17:0/1322738759 shutdown_connections 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x560eb8200ee0 0x560eb82268b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215f20 0x560eb82004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb8215600 0x560eb81fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5e9ea00640 0 client.9936 ms_handle_reset on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 --2- 172.21.15.17:0/1322738759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cbfd0 0x560eb81ffa50 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 -- 172.21.15.17:0/1322738759 >> 172.21.15.17:0/1322738759 conn(0x560eb81cdd20 msgr2=0x560eb81cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 -- 172.21.15.17:0/1322738759 shutdown_connections 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 1 -- 172.21.15.17:0/1322738759 wait complete. 2024-09-10T23:27:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.637+0000 7f5ec3534000 20 client.9936 trim_cache size 0 max 16384 2024-09-10T23:27:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.653+0000 7f5ec3534000 1 Processor -- start 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.653+0000 7f5ec3534000 1 -- start start 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cdd20 0x560eb8288810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 0x560eb8288d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215600 0x560eb8289290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8200190 con 0x560eb8215600 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb806fc50 con 0x560eb81cbfd0 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb806efb0 con 0x560eb81cdd20 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebe200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215600 0x560eb8289290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebe200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215600 0x560eb8289290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53196/0 (socket says 172.21.15.17:53196) 2024-09-10T23:27:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebe200640 1 -- 172.21.15.17:0/3046094080 learned_addr learned my addr 172.21.15.17:0/3046094080 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebce00640 1 --2- 172.21.15.17:0/3046094080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 0x560eb8288d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebd800640 1 --2- 172.21.15.17:0/3046094080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cdd20 0x560eb8288810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebe200640 1 -- 172.21.15.17:0/3046094080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cdd20 msgr2=0x560eb8288810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebe200640 1 --2- 172.21.15.17:0/3046094080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cdd20 0x560eb8288810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebe200640 1 -- 172.21.15.17:0/3046094080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 msgr2=0x560eb8288d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebe200640 1 --2- 172.21.15.17:0/3046094080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 0x560eb8288d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebe200640 1 -- 172.21.15.17:0/3046094080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb806f660 con 0x560eb8215600 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ebe200640 1 --2- 172.21.15.17:0/3046094080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215600 0x560eb8289290 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f5eb001b180 tx=0x7f5eb0019870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebec7d5c3698ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ea9600640 1 -- 172.21.15.17:0/3046094080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb00b2040 con 0x560eb8215600 2024-09-10T23:27:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ea9600640 1 -- 172.21.15.17:0/3046094080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5eb0004d40 con 0x560eb8215600 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ea9600640 1 -- 172.21.15.17:0/3046094080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0003ca0 con 0x560eb8215600 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 -- 172.21.15.17:0/3046094080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215600 msgr2=0x560eb8289290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 --2- 172.21.15.17:0/3046094080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215600 0x560eb8289290 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f5eb001b180 tx=0x7f5eb0019870 comp rx=0 tx=0).stop 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 -- 172.21.15.17:0/3046094080 shutdown_connections 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 --2- 172.21.15.17:0/3046094080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb8215600 0x560eb8289290 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 --2- 172.21.15.17:0/3046094080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 0x560eb8288d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 --2- 172.21.15.17:0/3046094080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb81cdd20 0x560eb8288810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 -- 172.21.15.17:0/3046094080 >> 172.21.15.17:0/3046094080 conn(0x560eb81ffe90 msgr2=0x560eb81c65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 -- 172.21.15.17:0/3046094080 shutdown_connections 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 -- 172.21.15.17:0/3046094080 wait complete. 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 -- start start 2024-09-10T23:27:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 Processor -- start 2024-09-10T23:27:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.657+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 0x560eb828c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cdd20 0x560eb828c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215600 0x560eb828cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x560eb81d0d40 con 0x560eb81cdd20 2024-09-10T23:27:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x560eb7fa92e0 con 0x560eb81cbfd0 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x560eb81ce100 con 0x560eb8215600 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 10 client.0 _ll_register_callbacks cb 0x7f5eac05dd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cdd20 0x560eb828c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cdd20 0x560eb828c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53212/0 (socket says 172.21.15.17:53212) 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebce00640 1 -- 172.21.15.17:0/2526103944 learned_addr learned my addr 172.21.15.17:0/2526103944 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebe200640 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215600 0x560eb828cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebd800640 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 0x560eb828c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebce00640 1 -- 172.21.15.17:0/2526103944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215600 msgr2=0x560eb828cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebce00640 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215600 0x560eb828cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebce00640 1 -- 172.21.15.17:0/2526103944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 msgr2=0x560eb828c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebce00640 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 0x560eb828c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebce00640 1 -- 172.21.15.17:0/2526103944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb7fdc090 con 0x560eb81cdd20 2024-09-10T23:27:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebce00640 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cdd20 0x560eb828c6e0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4001610 tx=0x7f5ea4001dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a099bcda98171896 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 1 -- 172.21.15.17:0/2526103944 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4025040 con 0x560eb81cdd20 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 1 -- 172.21.15.17:0/2526103944 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f5ea4014aa0 con 0x560eb81cdd20 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- 172.21.15.17:0/2526103944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eb0004d40 con 0x560eb81cdd20 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 1 -- 172.21.15.17:0/2526103944 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) ==== 24+0+0 (secure 0 0 0) 0x7f5ea403d050 con 0x560eb81cdd20 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 10 client.9942 fetch_fsmap learned FSMap version 121 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- 172.21.15.17:0/2526103944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) -- 0x560eb7fa85f0 con 0x560eb81cdd20 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 1 -- 172.21.15.17:0/2526103944 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5eb0004d40 con 0x560eb81cdd20 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 1 -- 172.21.15.17:0/2526103944 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 121) ==== 3502+0+0 (secure 0 0 0) 0x7f5ea4040020 con 0x560eb81cdd20 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 10 client.9942 fetch_fsmap finished waiting for FSMap version 121 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 10 client.9942 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 20 client.9942 populate_metadata read hostname 'smithi017' 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x560eb8215f20 0x560eb8248270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 4 client.9942 mds_command: new command op to 9711 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- 172.21.15.17:0/2526103944 --> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560eb8020590 con 0x560eb8215f20 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebd800640 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x560eb8215f20 0x560eb8248270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 10 client.9942 ms_handle_connect on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ebd800640 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x560eb8215f20 0x560eb8248270 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e84646131a2fbae2 server_cookie=529bde95a3f6330c in_seq=0 out_seq=0 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 1 -- 172.21.15.17:0/2526103944 <== mds.0 v2:172.21.15.17:6833/3026129347 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x560eb8020590 con 0x560eb8215f20 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 10 client.9942 handle_command_reply: tid=0 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 client.9942 shutdown 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- 172.21.15.17:0/2526103944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cdd20 msgr2=0x560eb828c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cdd20 0x560eb828c6e0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4001610 tx=0x7f5ea4001dd0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- 172.21.15.17:0/2526103944 shutdown_connections 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.17:6833/3026129347,v1:172.21.15.17:6835/3026129347] conn(0x560eb8215f20 0x560eb8248270 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x560eb8215600 0x560eb828cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560eb81cdd20 0x560eb828c6e0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5e9ea00640 0 client.9942 ms_handle_reset on v2:172.21.15.17:6833/3026129347 2024-09-10T23:27:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 --2- 172.21.15.17:0/2526103944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x560eb81cbfd0 0x560eb828c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- 172.21.15.17:0/2526103944 >> 172.21.15.17:0/2526103944 conn(0x560eb81ffe90 msgr2=0x560eb82268b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- 172.21.15.17:0/2526103944 shutdown_connections 2024-09-10T23:27:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 1 -- 172.21.15.17:0/2526103944 wait complete. 2024-09-10T23:27:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.661+0000 7f5ec3534000 20 client.9942 trim_cache size 0 max 16384 2024-09-10T23:27:49.673 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:27:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "PAUSED (628 inodes in the stack)", 2024-09-10T23:27:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:27:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "8eb67384-86a0-4384-927e-b6c13e1edd7f": { 2024-09-10T23:27:49.673 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8eb67384-86a0-4384-927e-b6c13e1edd7f", 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive" 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "8eb67384-86a0-4384-927e-b6c13e1edd7f": { 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:27:49.113222+0000", 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/scrub_control_test_path", 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:49.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:27:49.675 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:27:49.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 -- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e980725e0 msgr2=0x7f5e98074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e980725e0 0x7f5e98074aa0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80c8980 tx=0x7f5ea4009040 comp rx=0 tx=0).stop 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 -- 172.21.15.17:0/1457836959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb80b30e0 msgr2=0x7f5eb8148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb80b30e0 0x7f5eb8148cc0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00c700 tx=0x7f5eac00cbc0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 -- 172.21.15.17:0/1457836959 shutdown_connections 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5e980725e0 0x7f5e98074aa0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5eb815bca0 0x7f5eb8157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5eb815b8c0 0x7f5eb8150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 --2- 172.21.15.17:0/1457836959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5eb80b30e0 0x7f5eb8148cc0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 -- 172.21.15.17:0/1457836959 >> 172.21.15.17:0/1457836959 conn(0x7f5eb809a9f0 msgr2=0x7f5eb8070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 -- 172.21.15.17:0/1457836959 shutdown_connections 2024-09-10T23:27:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.665+0000 7f5ebec00640 1 -- 172.21.15.17:0/1457836959 wait complete. 2024-09-10T23:27:49.686 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:49.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 -- 172.21.15.17:0/2128179734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 msgr2=0x7fbc980ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2128179734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 0x7fbc980ce4b0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fbc98072fc0 tx=0x7fbc9001cd50 comp rx=0 tx=0).stop 2024-09-10T23:27:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 -- 172.21.15.17:0/2128179734 shutdown_connections 2024-09-10T23:27:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2128179734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 0x7fbc980ce4b0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2128179734 >> v2:172.21.15.77:3300/0 conn(0x7fbc980cc570 0x7fbc980d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2128179734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc9815bc70 0x7fbc980cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 -- 172.21.15.17:0/2128179734 >> 172.21.15.17:0/2128179734 conn(0x7fbc9809a9f0 msgr2=0x7fbc9809add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 -- 172.21.15.17:0/2128179734 shutdown_connections 2024-09-10T23:27:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 -- 172.21.15.17:0/2128179734 wait complete. 2024-09-10T23:27:49.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 Processor -- start 2024-09-10T23:27:49.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.829+0000 7fbc97e00640 1 -- start start 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc980cc570 0x7fbc9815e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 0x7fbc9815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc9815bc70 0x7fbc981f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbc980b1270 con 0x7fbc980d1ed0 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc980b10f0 con 0x7fbc980cc570 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbc980b13f0 con 0x7fbc9815bc70 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 0x7fbc9815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 0x7fbc9815cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53222/0 (socket says 172.21.15.17:53222) 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96000640 1 -- 172.21.15.17:0/2810568309 learned_addr learned my addr 172.21.15.17:0/2810568309 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96a00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc980cc570 0x7fbc9815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97400640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc9815bc70 0x7fbc981f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96000640 1 -- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc9815bc70 msgr2=0x7fbc981f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96000640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc9815bc70 0x7fbc981f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96000640 1 -- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc980cc570 msgr2=0x7fbc9815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96000640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc980cc570 0x7fbc9815e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96000640 1 -- 172.21.15.17:0/2810568309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9815e670 con 0x7fbc980d1ed0 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc96000640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 0x7fbc9815cc20 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400e9f0 tx=0x7fbc8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc8ea00640 1 -- 172.21.15.17:0/2810568309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8400ccc0 con 0x7fbc980d1ed0 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc8ea00640 1 -- 172.21.15.17:0/2810568309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc84010430 con 0x7fbc980d1ed0 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc981f7c30 con 0x7fbc980d1ed0 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc8ea00640 1 -- 172.21.15.17:0/2810568309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84010840 con 0x7fbc980d1ed0 2024-09-10T23:27:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9815c420 con 0x7fbc980d1ed0 2024-09-10T23:27:49.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.833+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc980ce4b0 con 0x7fbc980d1ed0 2024-09-10T23:27:49.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.837+0000 7fbc8ea00640 1 -- 172.21.15.17:0/2810568309 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbc840109e0 con 0x7fbc980d1ed0 2024-09-10T23:27:49.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.837+0000 7fbc8ea00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbc780725e0 0x7fbc78074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:49.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.837+0000 7fbc8ea00640 1 -- 172.21.15.17:0/2810568309 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fbc84093e80 con 0x7fbc980d1ed0 2024-09-10T23:27:49.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.837+0000 7fbc96a00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbc780725e0 0x7fbc78074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:49.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.837+0000 7fbc96a00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbc780725e0 0x7fbc78074aa0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009b40 tx=0x7fbc880091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:49.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:49.841+0000 7fbc8ea00640 1 -- 172.21.15.17:0/2810568309 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbc8405ed70 con 0x7fbc980d1ed0 2024-09-10T23:27:50.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.057+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc98158680 con 0x7fbc980d1ed0 2024-09-10T23:27:50.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.057+0000 7fbc8ea00640 1 -- 172.21.15.17:0/2810568309 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7fbc840637a0 con 0x7fbc980d1ed0 2024-09-10T23:27:50.062 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:50.062 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:27:50.062 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:27:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbc780725e0 msgr2=0x7fbc78074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbc780725e0 0x7fbc78074aa0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009b40 tx=0x7fbc880091e0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 msgr2=0x7fbc9815cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 0x7fbc9815cc20 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400e9f0 tx=0x7fbc8400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 shutdown_connections 2024-09-10T23:27:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbc780725e0 0x7fbc78074aa0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbc9815bc70 0x7fbc981f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc980d1ed0 0x7fbc9815cc20 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 --2- 172.21.15.17:0/2810568309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc980cc570 0x7fbc9815e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 >> 172.21.15.17:0/2810568309 conn(0x7fbc9809a9f0 msgr2=0x7fbc98157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 shutdown_connections 2024-09-10T23:27:50.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.061+0000 7fbc97e00640 1 -- 172.21.15.17:0/2810568309 wait complete. 2024-09-10T23:27:50.083 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:27:50.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:27:50.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.253+0000 7fe50d800640 1 -- 172.21.15.17:0/3630389858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe508074030 msgr2=0x7fe50815eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.253+0000 7fe50d800640 1 --2- 172.21.15.17:0/3630389858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe508074030 0x7fe50815eb90 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fe500009bc0 tx=0x7fe50001f3b0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.253+0000 7fe50d800640 1 -- 172.21.15.17:0/3630389858 shutdown_connections 2024-09-10T23:27:50.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.253+0000 7fe50d800640 1 --2- 172.21.15.17:0/3630389858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe508074030 0x7fe50815eb90 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.253+0000 7fe50d800640 1 --2- 172.21.15.17:0/3630389858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe508073710 0x7fe508073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.253+0000 7fe50d800640 1 -- 172.21.15.17:0/3630389858 >> 172.21.15.17:0/3630389858 conn(0x7fe5080d0a20 msgr2=0x7fe5080d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.253+0000 7fe50d800640 1 -- 172.21.15.17:0/3630389858 shutdown_connections 2024-09-10T23:27:50.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.253+0000 7fe50d800640 1 -- 172.21.15.17:0/3630389858 wait complete. 2024-09-10T23:27:50.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 Processor -- start 2024-09-10T23:27:50.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 -- start start 2024-09-10T23:27:50.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe508073710 0x7fe508157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe508074030 0x7fe5080a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5080c40d0 0x7fe5080b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe5080cfae0 con 0x7fe5080c40d0 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5080cf960 con 0x7fe508074030 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe5080cfc60 con 0x7fe508073710 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5080c40d0 0x7fe5080b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5080c40d0 0x7fe5080b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53230/0 (socket says 172.21.15.17:53230) 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50ce00640 1 -- 172.21.15.17:0/2176670308 learned_addr learned my addr 172.21.15.17:0/2176670308 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe4ffe00640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe508074030 0x7fe5080a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe507e00640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe508073710 0x7fe508157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50ce00640 1 -- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe508073710 msgr2=0x7fe508157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50ce00640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe508073710 0x7fe508157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50ce00640 1 -- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe508074030 msgr2=0x7fe5080a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50ce00640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe508074030 0x7fe5080a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50ce00640 1 -- 172.21.15.17:0/2176670308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50815ccf0 con 0x7fe5080c40d0 2024-09-10T23:27:50.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50ce00640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5080c40d0 0x7fe5080b4d70 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fe50001cfe0 tx=0x7fe5000af420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe504c00640 1 -- 172.21.15.17:0/2176670308 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5000b4040 con 0x7fe5080c40d0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe504c00640 1 -- 172.21.15.17:0/2176670308 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe500004b40 con 0x7fe5080c40d0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe504c00640 1 -- 172.21.15.17:0/2176670308 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5000b0930 con 0x7fe5080c40d0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50815cfd0 con 0x7fe5080c40d0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.257+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe50815d590 con 0x7fe5080c40d0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.261+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5080d0110 con 0x7fe5080c40d0 2024-09-10T23:27:50.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.261+0000 7fe504c00640 1 -- 172.21.15.17:0/2176670308 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe5000b0ad0 con 0x7fe5080c40d0 2024-09-10T23:27:50.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.261+0000 7fe504c00640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4e40725e0 0x7fe4e4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:50.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.261+0000 7fe504c00640 1 -- 172.21.15.17:0/2176670308 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fe500131900 con 0x7fe5080c40d0 2024-09-10T23:27:50.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.261+0000 7fe507e00640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4e40725e0 0x7fe4e4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:50.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.261+0000 7fe507e00640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4e40725e0 0x7fe4e4074aa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8005d10 tx=0x7fe4f800b410 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:50.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.265+0000 7fe504c00640 1 -- 172.21.15.17:0/2176670308 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe500018f10 con 0x7fe5080c40d0 2024-09-10T23:27:50.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.501+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe5080a1d80 con 0x7fe5080c40d0 2024-09-10T23:27:50.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.501+0000 7fe504c00640 1 -- 172.21.15.17:0/2176670308 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7fe5000fc7f0 con 0x7fe5080c40d0 2024-09-10T23:27:50.506 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:50.506 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":759,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":875,"data_bytes":896142993,"bytes_used":2307100672,"bytes_avail":770787012608,"bytes_total":773094113280,"write_bytes_sec":51447442,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9711}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-10T23:26:58.457659+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:27:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4e40725e0 msgr2=0x7fe4e4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4e40725e0 0x7fe4e4074aa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8005d10 tx=0x7fe4f800b410 comp rx=0 tx=0).stop 2024-09-10T23:27:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5080c40d0 msgr2=0x7fe5080b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5080c40d0 0x7fe5080b4d70 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fe50001cfe0 tx=0x7fe5000af420 comp rx=0 tx=0).stop 2024-09-10T23:27:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 shutdown_connections 2024-09-10T23:27:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4e40725e0 0x7fe4e4074aa0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5080c40d0 0x7fe5080b4d70 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe508074030 0x7fe5080a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 --2- 172.21.15.17:0/2176670308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe508073710 0x7fe508157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:50.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 >> 172.21.15.17:0/2176670308 conn(0x7fe5080d0a20 msgr2=0x7fe5080b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:50.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 shutdown_connections 2024-09-10T23:27:50.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:50.505+0000 7fe50d800640 1 -- 172.21.15.17:0/2176670308 wait complete. 2024-09-10T23:27:50.527 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:27:51.528 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.681+0000 7f245a600640 1 -- 172.21.15.17:0/3363450310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2438004d50 msgr2=0x7f24380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.681+0000 7f245a600640 1 --2- 172.21.15.17:0/3363450310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2438004d50 0x7f24380051d0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f244c009ee0 tx=0x7f244c01d5f0 comp rx=0 tx=0).stop 2024-09-10T23:27:51.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.681+0000 7f2453e00640 1 -- 172.21.15.17:0/3363450310 reap_dead start 2024-09-10T23:27:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.681+0000 7f245a600640 1 -- 172.21.15.17:0/3363450310 shutdown_connections 2024-09-10T23:27:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.681+0000 7f245a600640 1 -- 172.21.15.17:0/3363450310 >> 172.21.15.17:0/3363450310 conn(0x7f24540d1d10 msgr2=0x7f24540d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.681+0000 7f245a600640 1 -- 172.21.15.17:0/3363450310 shutdown_connections 2024-09-10T23:27:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.681+0000 7f245a600640 1 -- 172.21.15.17:0/3363450310 wait complete. 2024-09-10T23:27:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 Processor -- start 2024-09-10T23:27:51.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 -- start start 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2438004d50 0x7f245409f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24540c97c0 0x7f24541f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24541f2c90 0x7f24541f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f24540cf370 con 0x7f24540c97c0 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24540b10f0 con 0x7f2438004d50 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f24540b1430 con 0x7f24541f2c90 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24540c97c0 0x7f24541f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24540c97c0 0x7f24541f2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53256/0 (socket says 172.21.15.17:53256) 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244be00640 1 -- 172.21.15.17:0/1328178192 learned_addr learned my addr 172.21.15.17:0/1328178192 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f2453e00640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24541f2c90 0x7f24541f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:51.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f2453400640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2438004d50 0x7f245409f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244be00640 1 -- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24541f2c90 msgr2=0x7f24541f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244be00640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24541f2c90 0x7f24541f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244be00640 1 -- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2438004d50 msgr2=0x7f245409f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244be00640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2438004d50 0x7f245409f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244be00640 1 -- 172.21.15.17:0/1328178192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245409f9f0 con 0x7f24540c97c0 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244be00640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24540c97c0 0x7f24541f2750 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f243c00e390 tx=0x7f243c00e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244b400640 1 -- 172.21.15.17:0/1328178192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c012910 con 0x7f24540c97c0 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244b400640 1 -- 172.21.15.17:0/1328178192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f243c012bc0 con 0x7f24540c97c0 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f244b400640 1 -- 172.21.15.17:0/1328178192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c01a400 con 0x7f24540c97c0 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24540ca080 con 0x7f24540c97c0 2024-09-10T23:27:51.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24540ca640 con 0x7f24540c97c0 2024-09-10T23:27:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.685+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24540b3130 con 0x7f24540c97c0 2024-09-10T23:27:51.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.689+0000 7f244b400640 1 -- 172.21.15.17:0/1328178192 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f243c022030 con 0x7f24540c97c0 2024-09-10T23:27:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.689+0000 7f244b400640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2430072610 0x7f2430074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.689+0000 7f244b400640 1 -- 172.21.15.17:0/1328178192 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f243c096a50 con 0x7f24540c97c0 2024-09-10T23:27:51.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.689+0000 7f2453400640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2430072610 0x7f2430074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:51.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.689+0000 7f2453400640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2430072610 0x7f2430074ad0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f24540cb6f0 tx=0x7f24440091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:51.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.693+0000 7f244b400640 1 -- 172.21.15.17:0/1328178192 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f243c016030 con 0x7f24540c97c0 2024-09-10T23:27:51.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24541f37f0 con 0x7f24540c97c0 2024-09-10T23:27:51.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f244b400640 1 -- 172.21.15.17:0/1328178192 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7f243c0618b0 con 0x7f24540c97c0 2024-09-10T23:27:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:51.904 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:27:51.905 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:27:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2430072610 msgr2=0x7f2430074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2430072610 0x7f2430074ad0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f24540cb6f0 tx=0x7f24440091e0 comp rx=0 tx=0).stop 2024-09-10T23:27:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24540c97c0 msgr2=0x7f24541f2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24540c97c0 0x7f24541f2750 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f243c00e390 tx=0x7f243c00e850 comp rx=0 tx=0).stop 2024-09-10T23:27:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 shutdown_connections 2024-09-10T23:27:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2430072610 0x7f2430074ad0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24541f2c90 0x7f24541f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24540c97c0 0x7f24541f2750 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 --2- 172.21.15.17:0/1328178192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2438004d50 0x7f245409f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 >> 172.21.15.17:0/1328178192 conn(0x7f24540d1d10 msgr2=0x7f24540b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 shutdown_connections 2024-09-10T23:27:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:51.901+0000 7f245a600640 1 -- 172.21.15.17:0/1328178192 wait complete. 2024-09-10T23:27:51.925 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:27:51.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:27:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.065+0000 7fb377000640 1 -- 172.21.15.17:0/2857275934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700d0670 msgr2=0x7fb37013ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.065+0000 7fb377000640 1 --2- 172.21.15.17:0/2857275934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700d0670 0x7fb37013ccc0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00aa10 tx=0x7fb35c01dc30 comp rx=0 tx=0).stop 2024-09-10T23:27:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.065+0000 7fb377000640 1 -- 172.21.15.17:0/2857275934 shutdown_connections 2024-09-10T23:27:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.065+0000 7fb377000640 1 --2- 172.21.15.17:0/2857275934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700d0670 0x7fb37013ccc0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.065+0000 7fb377000640 1 --2- 172.21.15.17:0/2857275934 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3700d0290 0x7fb37013c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.065+0000 7fb377000640 1 -- 172.21.15.17:0/2857275934 >> 172.21.15.17:0/2857275934 conn(0x7fb37006cfc0 msgr2=0x7fb37006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:52.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.065+0000 7fb377000640 1 -- 172.21.15.17:0/2857275934 shutdown_connections 2024-09-10T23:27:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.065+0000 7fb377000640 1 -- 172.21.15.17:0/2857275934 wait complete. 2024-09-10T23:27:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 Processor -- start 2024-09-10T23:27:52.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 -- start start 2024-09-10T23:27:52.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700b2c80 0x7fb37013aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3700d0290 0x7fb37013a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3700d0670 0x7fb37013b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb370166d00 con 0x7fb3700b2c80 2024-09-10T23:27:52.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb37015b1c0 con 0x7fb3700d0290 2024-09-10T23:27:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb370166e80 con 0x7fb3700d0670 2024-09-10T23:27:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700b2c80 0x7fb37013aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700b2c80 0x7fb37013aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53282/0 (socket says 172.21.15.17:53282) 2024-09-10T23:27:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36fe00640 1 -- 172.21.15.17:0/969910331 learned_addr learned my addr 172.21.15.17:0/969910331 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36f400640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3700d0290 0x7fb37013a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb375000640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3700d0670 0x7fb37013b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36fe00640 1 -- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3700d0670 msgr2=0x7fb37013b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36fe00640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3700d0670 0x7fb37013b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36fe00640 1 -- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3700d0290 msgr2=0x7fb37013a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36fe00640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3700d0290 0x7fb37013a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36fe00640 1 -- 172.21.15.17:0/969910331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37013a850 con 0x7fb3700b2c80 2024-09-10T23:27:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb36fe00640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700b2c80 0x7fb37013aa90 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fb36000d950 tx=0x7fb36000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb367e00640 1 -- 172.21.15.17:0/969910331 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360017070 con 0x7fb3700b2c80 2024-09-10T23:27:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb367e00640 1 -- 172.21.15.17:0/969910331 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb360009d20 con 0x7fb3700b2c80 2024-09-10T23:27:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb367e00640 1 -- 172.21.15.17:0/969910331 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3600106c0 con 0x7fb3700b2c80 2024-09-10T23:27:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3701fb4f0 con 0x7fb3700b2c80 2024-09-10T23:27:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.069+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3701fbab0 con 0x7fb3700b2c80 2024-09-10T23:27:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.073+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3700b3110 con 0x7fb3700b2c80 2024-09-10T23:27:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.073+0000 7fb367e00640 1 -- 172.21.15.17:0/969910331 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb360010860 con 0x7fb3700b2c80 2024-09-10T23:27:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.073+0000 7fb367e00640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.073+0000 7fb367e00640 1 -- 172.21.15.17:0/969910331 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fb3600937b0 con 0x7fb3700b2c80 2024-09-10T23:27:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.073+0000 7fb36f400640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:52.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.073+0000 7fb36f400640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b0000 tx=0x7fb35c01c470 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:52.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.077+0000 7fb367e00640 1 -- 172.21.15.17:0/969910331 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb36005e610 con 0x7fb3700b2c80 2024-09-10T23:27:52.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.313+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb37013e190 con 0x7fb3700b2c80 2024-09-10T23:27:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.313+0000 7fb367e00640 1 -- 172.21.15.17:0/969910331 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7fb360063040 con 0x7fb3700b2c80 2024-09-10T23:27:52.319 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:52.319 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":761,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1033,"data_bytes":1061818001,"bytes_used":2657861632,"bytes_avail":770436251648,"bytes_total":773094113280,"write_bytes_sec":62476484,"read_op_per_sec":0,"write_op_per_sec":62},"fsmap":{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9711}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-10T23:26:58.457659+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:27:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 msgr2=0x7fb350074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b0000 tx=0x7fb35c01c470 comp rx=0 tx=0).stop 2024-09-10T23:27:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700b2c80 msgr2=0x7fb37013aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700b2c80 0x7fb37013aa90 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fb36000d950 tx=0x7fb36000de10 comp rx=0 tx=0).stop 2024-09-10T23:27:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 shutdown_connections 2024-09-10T23:27:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3700d0670 0x7fb37013b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3700d0290 0x7fb37013a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 --2- 172.21.15.17:0/969910331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3700b2c80 0x7fb37013aa90 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 >> 172.21.15.17:0/969910331 conn(0x7fb37006cfc0 msgr2=0x7fb37015d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 shutdown_connections 2024-09-10T23:27:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:52.317+0000 7fb377000640 1 -- 172.21.15.17:0/969910331 wait complete. 2024-09-10T23:27:52.339 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:27:53.340 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.493+0000 7fe641a00640 1 -- 172.21.15.17:0/2050826039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe63c0d4a10 msgr2=0x7fe63c06eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.493+0000 7fe641a00640 1 --2- 172.21.15.17:0/2050826039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe63c0d4a10 0x7fe63c06eff0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe624009870 tx=0x7fe62401c790 comp rx=0 tx=0).stop 2024-09-10T23:27:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.493+0000 7fe641a00640 1 -- 172.21.15.17:0/2050826039 shutdown_connections 2024-09-10T23:27:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.493+0000 7fe641a00640 1 --2- 172.21.15.17:0/2050826039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe63c0d4a10 0x7fe63c06eff0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.493+0000 7fe641a00640 1 -- 172.21.15.17:0/2050826039 >> 172.21.15.17:0/2050826039 conn(0x7fe63c0d3f20 msgr2=0x7fe63c0d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.493+0000 7fe641a00640 1 -- 172.21.15.17:0/2050826039 shutdown_connections 2024-09-10T23:27:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.493+0000 7fe641a00640 1 -- 172.21.15.17:0/2050826039 wait complete. 2024-09-10T23:27:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 Processor -- start 2024-09-10T23:27:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 -- start start 2024-09-10T23:27:53.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe63c0d2180 0x7fe63c150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:53.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe63c0d4a10 0x7fe63c157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:53.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe63c1618a0 0x7fe63c0cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:53.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c16c1d0 con 0x7fe63c1618a0 2024-09-10T23:27:53.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c16c050 con 0x7fe63c0d2180 2024-09-10T23:27:53.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe63c16c350 con 0x7fe63c0d4a10 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe63c1618a0 0x7fe63c0cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe63c0d2180 0x7fe63c150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe63c1618a0 0x7fe63c0cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53298/0 (socket says 172.21.15.17:53298) 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63b400640 1 -- 172.21.15.17:0/3072892017 learned_addr learned my addr 172.21.15.17:0/3072892017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe632000640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe63c0d4a10 0x7fe63c157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63b400640 1 -- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe63c0d4a10 msgr2=0x7fe63c157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63b400640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe63c0d4a10 0x7fe63c157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63b400640 1 -- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe63c0d2180 msgr2=0x7fe63c150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63b400640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe63c0d2180 0x7fe63c150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63b400640 1 -- 172.21.15.17:0/3072892017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c158680 con 0x7fe63c1618a0 2024-09-10T23:27:53.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe63b400640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe63c1618a0 0x7fe63c0cd560 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fe63400c3f0 tx=0x7fe63400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:53.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe633400640 1 -- 172.21.15.17:0/3072892017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634011790 con 0x7fe63c1618a0 2024-09-10T23:27:53.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe633400640 1 -- 172.21.15.17:0/3072892017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe634017070 con 0x7fe63c1618a0 2024-09-10T23:27:53.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe633400640 1 -- 172.21.15.17:0/3072892017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634011ce0 con 0x7fe63c1618a0 2024-09-10T23:27:53.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63c158960 con 0x7fe63c1618a0 2024-09-10T23:27:53.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.497+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63c0b4750 con 0x7fe63c1618a0 2024-09-10T23:27:53.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.501+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63c06eff0 con 0x7fe63c1618a0 2024-09-10T23:27:53.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.501+0000 7fe633400640 1 -- 172.21.15.17:0/3072892017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe63401c460 con 0x7fe63c1618a0 2024-09-10T23:27:53.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.501+0000 7fe633400640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe618072610 0x7fe618074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:53.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.501+0000 7fe633400640 1 -- 172.21.15.17:0/3072892017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fe634092fe0 con 0x7fe63c1618a0 2024-09-10T23:27:53.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.501+0000 7fe63aa00640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe618072610 0x7fe618074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:53.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.505+0000 7fe63aa00640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe618072610 0x7fe618074ad0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe62c000f90 tx=0x7fe62c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:53.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.505+0000 7fe633400640 1 -- 172.21.15.17:0/3072892017 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe63405df10 con 0x7fe63c1618a0 2024-09-10T23:27:53.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.713+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe63c0b90e0 con 0x7fe63c1618a0 2024-09-10T23:27:53.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.713+0000 7fe633400640 1 -- 172.21.15.17:0/3072892017 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7fe634062940 con 0x7fe63c1618a0 2024-09-10T23:27:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:27:53.720 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe618072610 msgr2=0x7fe618074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe618072610 0x7fe618074ad0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe62c000f90 tx=0x7fe62c009040 comp rx=0 tx=0).stop 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe63c1618a0 msgr2=0x7fe63c0cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe63c1618a0 0x7fe63c0cd560 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fe63400c3f0 tx=0x7fe63400c8b0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 shutdown_connections 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe618072610 0x7fe618074ad0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe63c1618a0 0x7fe63c0cd560 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe63c0d4a10 0x7fe63c157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 --2- 172.21.15.17:0/3072892017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe63c0d2180 0x7fe63c150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 >> 172.21.15.17:0/3072892017 conn(0x7fe63c0d3f20 msgr2=0x7fe63c0b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:53.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 shutdown_connections 2024-09-10T23:27:53.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.717+0000 7fe641a00640 1 -- 172.21.15.17:0/3072892017 wait complete. 2024-09-10T23:27:53.741 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:27:53.741 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:27:53.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.881+0000 7fa49fa00640 1 -- 172.21.15.17:0/4055289524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980cef60 msgr2=0x7fa4980cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:53.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.881+0000 7fa49fa00640 1 --2- 172.21.15.17:0/4055289524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980cef60 0x7fa4980cfd90 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009840 tx=0x7fa48c01c820 comp rx=0 tx=0).stop 2024-09-10T23:27:53.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.881+0000 7fa49fa00640 1 -- 172.21.15.17:0/4055289524 shutdown_connections 2024-09-10T23:27:53.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.881+0000 7fa49fa00640 1 --2- 172.21.15.17:0/4055289524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980cef60 0x7fa4980cfd90 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.881+0000 7fa49fa00640 1 -- 172.21.15.17:0/4055289524 >> 172.21.15.17:0/4055289524 conn(0x7fa4980b3870 msgr2=0x7fa4980b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:53.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.881+0000 7fa49fa00640 1 -- 172.21.15.17:0/4055289524 shutdown_connections 2024-09-10T23:27:53.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.881+0000 7fa49fa00640 1 -- 172.21.15.17:0/4055289524 wait complete. 2024-09-10T23:27:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 Processor -- start 2024-09-10T23:27:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 -- start start 2024-09-10T23:27:53.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980b4390 0x7fa4980b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:53.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980cef60 0x7fa4980b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:53.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4980cf340 0x7fa49806df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:53.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa49816a870 con 0x7fa4980b4390 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa49816a6f0 con 0x7fa4980cef60 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa49816a9f0 con 0x7fa4980cf340 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980b4390 0x7fa4980b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980b4390 0x7fa4980b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53310/0 (socket says 172.21.15.17:53310) 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49d000640 1 -- 172.21.15.17:0/2608728483 learned_addr learned my addr 172.21.15.17:0/2608728483 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa497e00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980cef60 0x7fa4980b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49da00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4980cf340 0x7fa49806df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49d000640 1 -- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4980cf340 msgr2=0x7fa49806df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49d000640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4980cf340 0x7fa49806df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49d000640 1 -- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980cef60 msgr2=0x7fa4980b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49d000640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980cef60 0x7fa4980b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49d000640 1 -- 172.21.15.17:0/2608728483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4980b50b0 con 0x7fa4980b4390 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa497e00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980cef60 0x7fa4980b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49da00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4980cf340 0x7fa49806df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49d000640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980b4390 0x7fa4980b4b70 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009790 tx=0x7fa48c0a5f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa494c00640 1 -- 172.21.15.17:0/2608728483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c0b2040 con 0x7fa4980b4390 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa494c00640 1 -- 172.21.15.17:0/2608728483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa48c0043f0 con 0x7fa4980b4390 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa494c00640 1 -- 172.21.15.17:0/2608728483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c005220 con 0x7fa4980b4390 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4980b5380 con 0x7fa4980b4390 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4980b5940 con 0x7fa4980b4390 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.885+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4980cfd90 con 0x7fa4980b4390 2024-09-10T23:27:53.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.889+0000 7fa494c00640 1 -- 172.21.15.17:0/2608728483 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa48c0b5070 con 0x7fa4980b4390 2024-09-10T23:27:53.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.889+0000 7fa494c00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4780725e0 0x7fa478074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:53.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.889+0000 7fa494c00640 1 -- 172.21.15.17:0/2608728483 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fa48c12cb10 con 0x7fa4980b4390 2024-09-10T23:27:53.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.889+0000 7fa497e00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4780725e0 0x7fa478074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:53.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.889+0000 7fa497e00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4780725e0 0x7fa478074aa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa49806ebd0 tx=0x7fa484009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:53.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:53.893+0000 7fa494c00640 1 -- 172.21.15.17:0/2608728483 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa48c016410 con 0x7fa4980b4390 2024-09-10T23:27:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa4980b1030 con 0x7fa4980b4390 2024-09-10T23:27:54.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa494c00640 1 -- 172.21.15.17:0/2608728483 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7fa48c0f80f0 con 0x7fa4980b4390 2024-09-10T23:27:54.136 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:54.136 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":763,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1042,"data_bytes":1071255185,"bytes_used":2693513216,"bytes_avail":770400600064,"bytes_total":773094113280,"write_bytes_sec":43518677,"read_op_per_sec":0,"write_op_per_sec":44},"fsmap":{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9711}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-10T23:26:58.457659+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:27:54.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4780725e0 msgr2=0x7fa478074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4780725e0 0x7fa478074aa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa49806ebd0 tx=0x7fa484009040 comp rx=0 tx=0).stop 2024-09-10T23:27:54.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980b4390 msgr2=0x7fa4980b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:54.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980b4390 0x7fa4980b4b70 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009790 tx=0x7fa48c0a5f80 comp rx=0 tx=0).stop 2024-09-10T23:27:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 shutdown_connections 2024-09-10T23:27:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa4780725e0 0x7fa478074aa0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4980cf340 0x7fa49806df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4980cef60 0x7fa4980b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 --2- 172.21.15.17:0/2608728483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4980b4390 0x7fa4980b4b70 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 >> 172.21.15.17:0/2608728483 conn(0x7fa4980b3870 msgr2=0x7fa49815c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 shutdown_connections 2024-09-10T23:27:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:54.133+0000 7fa49fa00640 1 -- 172.21.15.17:0/2608728483 wait complete. 2024-09-10T23:27:54.157 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:27:55.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:55.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 -- 172.21.15.17:0/3133511237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 msgr2=0x7fac780b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 --2- 172.21.15.17:0/3133511237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 0x7fac780b5300 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fac780b5840 tx=0x7fac6801c800 comp rx=0 tx=0).stop 2024-09-10T23:27:55.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 -- 172.21.15.17:0/3133511237 shutdown_connections 2024-09-10T23:27:55.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 --2- 172.21.15.17:0/3133511237 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac780b4dd0 0x7fac780d2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 --2- 172.21.15.17:0/3133511237 >> v2:172.21.15.77:3300/0 conn(0x7fac78161750 0x7fac780d1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 --2- 172.21.15.17:0/3133511237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 0x7fac780b5300 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 -- 172.21.15.17:0/3133511237 >> 172.21.15.17:0/3133511237 conn(0x7fac780d3d80 msgr2=0x7fac780d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:55.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 -- 172.21.15.17:0/3133511237 shutdown_connections 2024-09-10T23:27:55.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 -- 172.21.15.17:0/3133511237 wait complete. 2024-09-10T23:27:55.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 Processor -- start 2024-09-10T23:27:55.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.313+0000 7fac7d400640 1 -- start start 2024-09-10T23:27:55.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac780b4dd0 0x7fac78150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 0x7fac780ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7d400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac78161750 0x7fac780ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7d400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac780b1760 con 0x7fac78161370 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7d400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac780b15e0 con 0x7fac78161750 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7d400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fac780b18e0 con 0x7fac780b4dd0 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 0x7fac780ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 0x7fac780ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53318/0 (socket says 172.21.15.17:53318) 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77400640 1 -- 172.21.15.17:0/599338865 learned_addr learned my addr 172.21.15.17:0/599338865 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77e00640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac780b4dd0 0x7fac78150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7ca00640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac78161750 0x7fac780ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77400640 1 -- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac780b4dd0 msgr2=0x7fac78150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77400640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac780b4dd0 0x7fac78150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77400640 1 -- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac78161750 msgr2=0x7fac780ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77400640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac78161750 0x7fac780ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77400640 1 -- 172.21.15.17:0/599338865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac780cd500 con 0x7fac78161370 2024-09-10T23:27:55.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac77400640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 0x7fac780ce7f0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b410 tx=0x7fac6400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:55.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac6fe00640 1 -- 172.21.15.17:0/599338865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64015020 con 0x7fac78161370 2024-09-10T23:27:55.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac6fe00640 1 -- 172.21.15.17:0/599338865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac64011920 con 0x7fac78161370 2024-09-10T23:27:55.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac6fe00640 1 -- 172.21.15.17:0/599338865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64011d70 con 0x7fac78161370 2024-09-10T23:27:55.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac780ce080 con 0x7fac78161370 2024-09-10T23:27:55.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7815a710 con 0x7fac78161370 2024-09-10T23:27:55.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.317+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac780cd160 con 0x7fac78161370 2024-09-10T23:27:55.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.321+0000 7fac6fe00640 1 -- 172.21.15.17:0/599338865 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fac6401a400 con 0x7fac78161370 2024-09-10T23:27:55.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.321+0000 7fac6fe00640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac580725e0 0x7fac58074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.321+0000 7fac6fe00640 1 -- 172.21.15.17:0/599338865 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fac64093660 con 0x7fac78161370 2024-09-10T23:27:55.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.321+0000 7fac77e00640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac580725e0 0x7fac58074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.321+0000 7fac77e00640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac580725e0 0x7fac58074aa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fac680af000 tx=0x7fac6801b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.325+0000 7fac6fe00640 1 -- 172.21.15.17:0/599338865 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fac6401f020 con 0x7fac78161370 2024-09-10T23:27:55.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.533+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac780b92b0 con 0x7fac78161370 2024-09-10T23:27:55.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.533+0000 7fac6fe00640 1 -- 172.21.15.17:0/599338865 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7fac6405ebc0 con 0x7fac78161370 2024-09-10T23:27:55.538 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:55.538 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:27:55.538 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:27:55.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac580725e0 msgr2=0x7fac58074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac580725e0 0x7fac58074aa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fac680af000 tx=0x7fac6801b040 comp rx=0 tx=0).stop 2024-09-10T23:27:55.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 msgr2=0x7fac780ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 0x7fac780ce7f0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b410 tx=0x7fac6400b8d0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 shutdown_connections 2024-09-10T23:27:55.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fac580725e0 0x7fac58074aa0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac78161750 0x7fac780ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac78161370 0x7fac780ce7f0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 --2- 172.21.15.17:0/599338865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac780b4dd0 0x7fac78150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 >> 172.21.15.17:0/599338865 conn(0x7fac780d3d80 msgr2=0x7fac780d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 shutdown_connections 2024-09-10T23:27:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.537+0000 7fac7d400640 1 -- 172.21.15.17:0/599338865 wait complete. 2024-09-10T23:27:55.559 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T23:27:55.559 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:27:55.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.701+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1993035835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb594003c20 msgr2=0x7fb594004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.701+0000 7fb5b6c00640 1 --2- 172.21.15.17:0/1993035835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb594003c20 0x7fb594004020 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0006fa0 tx=0x7fb5a001cee0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.701+0000 7fb5b4c00640 1 -- 172.21.15.17:0/1993035835 reap_dead start 2024-09-10T23:27:55.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.701+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1993035835 shutdown_connections 2024-09-10T23:27:55.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.701+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1993035835 >> 172.21.15.17:0/1993035835 conn(0x7fb5b00d1d60 msgr2=0x7fb5b00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:55.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.701+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1993035835 shutdown_connections 2024-09-10T23:27:55.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.701+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1993035835 wait complete. 2024-09-10T23:27:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b6c00640 1 Processor -- start 2024-09-10T23:27:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b6c00640 1 -- start start 2024-09-10T23:27:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b6c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb594003c20 0x7fb5b00c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b6c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b00b0520 0x7fb5b006f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b6c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b006fa60 0x7fb5b00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b6c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0168050 con 0x7fb5b006fa60 2024-09-10T23:27:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b6c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0167ed0 con 0x7fb5b00b0520 2024-09-10T23:27:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b6c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b01681d0 con 0x7fb594003c20 2024-09-10T23:27:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b006fa60 0x7fb5b00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b006fa60 0x7fb5b00aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53342/0 (socket says 172.21.15.17:53342) 2024-09-10T23:27:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b4c00640 1 -- 172.21.15.17:0/1493293267 learned_addr learned my addr 172.21.15.17:0/1493293267 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5afe00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb594003c20 0x7fb5b00c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5a7e00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b00b0520 0x7fb5b006f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b4c00640 1 -- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb594003c20 msgr2=0x7fb5b00c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b4c00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb594003c20 0x7fb5b00c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b4c00640 1 -- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b00b0520 msgr2=0x7fb5b006f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b4c00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b00b0520 0x7fb5b006f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b4c00640 1 -- 172.21.15.17:0/1493293267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b0160360 con 0x7fb5b006fa60 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5a7e00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b00b0520 0x7fb5b006f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5b4c00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b006fa60 0x7fb5b00aef40 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0071ef0 tx=0x7fb5a8001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.705+0000 7fb5acc00640 1 -- 172.21.15.17:0/1493293267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8017070 con 0x7fb5b006fa60 2024-09-10T23:27:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.709+0000 7fb5acc00640 1 -- 172.21.15.17:0/1493293267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5a8010980 con 0x7fb5b006fa60 2024-09-10T23:27:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.709+0000 7fb5acc00640 1 -- 172.21.15.17:0/1493293267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8010dd0 con 0x7fb5b006fa60 2024-09-10T23:27:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.709+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b00cbb90 con 0x7fb5b006fa60 2024-09-10T23:27:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.709+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b0160080 con 0x7fb5b006fa60 2024-09-10T23:27:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.709+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b00aed20 con 0x7fb5b006fa60 2024-09-10T23:27:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.709+0000 7fb5acc00640 1 -- 172.21.15.17:0/1493293267 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb5a801b3b0 con 0x7fb5b006fa60 2024-09-10T23:27:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.709+0000 7fb5acc00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb58c072610 0x7fb58c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.709+0000 7fb5acc00640 1 -- 172.21.15.17:0/1493293267 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7fb5a80934e0 con 0x7fb5b006fa60 2024-09-10T23:27:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.709+0000 7fb5afe00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb58c072610 0x7fb58c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:55.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.713+0000 7fb5afe00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb58c072610 0x7fb58c074ad0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00ac000 tx=0x7fb594005840 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:55.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.713+0000 7fb5acc00640 1 -- 172.21.15.17:0/1493293267 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb5b0160360 con 0x7fb5b006fa60 2024-09-10T23:27:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.949+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb5b015e4f0 con 0x7fb5b006fa60 2024-09-10T23:27:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.949+0000 7fb5acc00640 1 -- 172.21.15.17:0/1493293267 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7fb5a805e340 con 0x7fb5b006fa60 2024-09-10T23:27:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:55.955 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":765,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078240151,"bytes_used":2702594048,"bytes_avail":770391519232,"bytes_total":773094113280,"write_bytes_sec":42267226,"read_op_per_sec":0,"write_op_per_sec":49},"fsmap":{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9711}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-09-10T23:27:54.470816+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:27:55.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb58c072610 msgr2=0x7fb58c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb58c072610 0x7fb58c074ad0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00ac000 tx=0x7fb594005840 comp rx=0 tx=0).stop 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b006fa60 msgr2=0x7fb5b00aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b006fa60 0x7fb5b00aef40 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0071ef0 tx=0x7fb5a8001b90 comp rx=0 tx=0).stop 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 shutdown_connections 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb58c072610 0x7fb58c074ad0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5b006fa60 0x7fb5b00aef40 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b00b0520 0x7fb5b006f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 --2- 172.21.15.17:0/1493293267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb594003c20 0x7fb5b00c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 >> 172.21.15.17:0/1493293267 conn(0x7fb5b00d1d60 msgr2=0x7fb5b0153230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 shutdown_connections 2024-09-10T23:27:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:55.953+0000 7fb5b6c00640 1 -- 172.21.15.17:0/1493293267 wait complete. 2024-09-10T23:27:55.978 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-10T23:27:55.978 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:27:55.978 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:27:55.993 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:27:55.993 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'a', 'd', 'b'} 2024-09-10T23:27:55.994 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-10T23:27:56.192 INFO:teuthology.orchestra.run.smithi017.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-10T23:27:56.195 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-10T23:27:56.196 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:27:56.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.337+0000 7f5af6200640 1 -- 172.21.15.17:0/2484849485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 msgr2=0x7f5af00691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:56.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.337+0000 7f5af6200640 1 --2- 172.21.15.17:0/2484849485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 0x7f5af00691b0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009840 tx=0x7f5ad801c820 comp rx=0 tx=0).stop 2024-09-10T23:27:56.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.337+0000 7f5af6200640 1 -- 172.21.15.17:0/2484849485 shutdown_connections 2024-09-10T23:27:56.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.337+0000 7f5af6200640 1 --2- 172.21.15.17:0/2484849485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 0x7f5af00691b0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:56.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.337+0000 7f5af6200640 1 -- 172.21.15.17:0/2484849485 >> 172.21.15.17:0/2484849485 conn(0x7f5af00d03d0 msgr2=0x7f5af00d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:56.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.337+0000 7f5af6200640 1 -- 172.21.15.17:0/2484849485 shutdown_connections 2024-09-10T23:27:56.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.337+0000 7f5af6200640 1 -- 172.21.15.17:0/2484849485 wait complete. 2024-09-10T23:27:56.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 Processor -- start 2024-09-10T23:27:56.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 -- start start 2024-09-10T23:27:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5af00cf9c0 0x7f5af013eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 0x7f5af01574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af015e840 0x7f5af0151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0169740 con 0x7f5af00d0ef0 2024-09-10T23:27:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01695c0 con 0x7f5af015e840 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5af01698c0 con 0x7f5af00cf9c0 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 0x7f5af01574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 0x7f5af01574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53372/0 (socket says 172.21.15.17:53372) 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7e00640 1 -- 172.21.15.17:0/3119802866 learned_addr learned my addr 172.21.15.17:0/3119802866 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5aef400640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5af00cf9c0 0x7f5af013eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5aefe00640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af015e840 0x7f5af0151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7e00640 1 -- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5af00cf9c0 msgr2=0x7f5af013eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7e00640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5af00cf9c0 0x7f5af013eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7e00640 1 -- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af015e840 msgr2=0x7f5af0151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7e00640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af015e840 0x7f5af0151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7e00640 1 -- 172.21.15.17:0/3119802866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af014d980 con 0x7f5af00d0ef0 2024-09-10T23:27:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5aefe00640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af015e840 0x7f5af0151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:27:56.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7e00640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 0x7f5af01574d0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009790 tx=0x7f5ad8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:56.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7400640 1 -- 172.21.15.17:0/3119802866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8004430 con 0x7f5af00d0ef0 2024-09-10T23:27:56.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7400640 1 -- 172.21.15.17:0/3119802866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ad8005120 con 0x7f5af00d0ef0 2024-09-10T23:27:56.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5ae7400640 1 -- 172.21.15.17:0/3119802866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8005570 con 0x7f5af00d0ef0 2024-09-10T23:27:56.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af00700a0 con 0x7f5af00d0ef0 2024-09-10T23:27:56.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.341+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af0070380 con 0x7f5af00d0ef0 2024-09-10T23:27:56.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.345+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af00691b0 con 0x7f5af00d0ef0 2024-09-10T23:27:56.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.345+0000 7f5ae7400640 1 -- 172.21.15.17:0/3119802866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5ad80046d0 con 0x7f5af00d0ef0 2024-09-10T23:27:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.345+0000 7f5ae7400640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5acc072610 0x7f5acc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:27:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.345+0000 7f5ae7400640 1 -- 172.21.15.17:0/3119802866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f5ad812e370 con 0x7f5af00d0ef0 2024-09-10T23:27:56.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.345+0000 7f5aef400640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5acc072610 0x7f5acc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:27:56.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.349+0000 7f5aef400640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5acc072610 0x7f5acc074ad0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00046c0 tx=0x7f5ae0007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:27:56.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.349+0000 7f5ae7400640 1 -- 172.21.15.17:0/3119802866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5ad8016410 con 0x7f5af00d0ef0 2024-09-10T23:27:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.557+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5af0069820 con 0x7f5af00d0ef0 2024-09-10T23:27:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.557+0000 7f5ae7400640 1 -- 172.21.15.17:0/3119802866 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7f5ad80fee20 con 0x7f5af00d0ef0 2024-09-10T23:27:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:27:56.562 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:27:56.562 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.557+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5acc072610 msgr2=0x7f5acc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.557+0000 7f5af6200640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5acc072610 0x7f5acc074ad0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00046c0 tx=0x7f5ae0007ea0 comp rx=0 tx=0).stop 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.557+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 msgr2=0x7f5af01574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.557+0000 7f5af6200640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 0x7f5af01574d0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009790 tx=0x7f5ad8004040 comp rx=0 tx=0).stop 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.561+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 shutdown_connections 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.561+0000 7f5af6200640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5acc072610 0x7f5acc074ad0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.561+0000 7f5af6200640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af015e840 0x7f5af0151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.561+0000 7f5af6200640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5af00d0ef0 0x7f5af01574d0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.561+0000 7f5af6200640 1 --2- 172.21.15.17:0/3119802866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5af00cf9c0 0x7f5af013eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.561+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 >> 172.21.15.17:0/3119802866 conn(0x7f5af00d03d0 msgr2=0x7f5af00b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.561+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 shutdown_connections 2024-09-10T23:27:56.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:27:56.561+0000 7f5af6200640 1 -- 172.21.15.17:0/3119802866 wait complete. 2024-09-10T23:27:56.583 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-10T23:28:01.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:01.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.733+0000 7f6d77800640 1 -- 172.21.15.17:0/2851275193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700d1830 msgr2=0x7f6d7015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:01.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.733+0000 7f6d77800640 1 --2- 172.21.15.17:0/2851275193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700d1830 0x7f6d7015f5a0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f6d700d2e60 tx=0x7f6d5c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.733+0000 7f6d77800640 1 -- 172.21.15.17:0/2851275193 shutdown_connections 2024-09-10T23:28:01.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.733+0000 7f6d77800640 1 --2- 172.21.15.17:0/2851275193 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d700cf320 0x7f6d700cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.733+0000 7f6d77800640 1 --2- 172.21.15.17:0/2851275193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700d1830 0x7f6d7015f5a0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.733+0000 7f6d77800640 1 --2- 172.21.15.17:0/2851275193 >> v2:172.21.15.77:3300/0 conn(0x7f6d70070ad0 0x7f6d7015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.733+0000 7f6d77800640 1 -- 172.21.15.17:0/2851275193 >> 172.21.15.17:0/2851275193 conn(0x7f6d700d1d60 msgr2=0x7f6d700d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:01.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.733+0000 7f6d77800640 1 -- 172.21.15.17:0/2851275193 shutdown_connections 2024-09-10T23:28:01.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.733+0000 7f6d77800640 1 -- 172.21.15.17:0/2851275193 wait complete. 2024-09-10T23:28:01.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 Processor -- start 2024-09-10T23:28:01.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 -- start start 2024-09-10T23:28:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d70070ad0 0x7f6d700b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700cf320 0x7f6d700b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d700d1830 0x7f6d700c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d700cd2c0 con 0x7f6d700cf320 2024-09-10T23:28:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6d700cd140 con 0x7f6d700d1830 2024-09-10T23:28:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6d700cd440 con 0x7f6d70070ad0 2024-09-10T23:28:01.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700cf320 0x7f6d700b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700cf320 0x7f6d700b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43790/0 (socket says 172.21.15.17:43790) 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6fe00640 1 -- 172.21.15.17:0/3830649978 learned_addr learned my addr 172.21.15.17:0/3830649978 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d74e00640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d70070ad0 0x7f6d700b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d75800640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d700d1830 0x7f6d700c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6fe00640 1 -- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d70070ad0 msgr2=0x7f6d700b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6fe00640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d70070ad0 0x7f6d700b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6fe00640 1 -- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d700d1830 msgr2=0x7f6d700c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6fe00640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d700d1830 0x7f6d700c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6fe00640 1 -- 172.21.15.17:0/3830649978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d700b7640 con 0x7f6d700cf320 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d74e00640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d70070ad0 0x7f6d700b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d75800640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d700d1830 0x7f6d700c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:01.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6fe00640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700cf320 0x7f6d700b4b90 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0b0040 tx=0x7f6d5c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6cc00640 1 -- 172.21.15.17:0/3830649978 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0b2040 con 0x7f6d700cf320 2024-09-10T23:28:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6cc00640 1 -- 172.21.15.17:0/3830649978 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d5c005230 con 0x7f6d700cf320 2024-09-10T23:28:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d6cc00640 1 -- 172.21.15.17:0/3830649978 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0046d0 con 0x7f6d700cf320 2024-09-10T23:28:01.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d700b7920 con 0x7f6d700cf320 2024-09-10T23:28:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d700b7330 con 0x7f6d700cf320 2024-09-10T23:28:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.737+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d700cfc60 con 0x7f6d700cf320 2024-09-10T23:28:01.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.741+0000 7f6d6cc00640 1 -- 172.21.15.17:0/3830649978 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6d5c004870 con 0x7f6d700cf320 2024-09-10T23:28:01.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.741+0000 7f6d6cc00640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d500725e0 0x7f6d50074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:01.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.741+0000 7f6d6cc00640 1 -- 172.21.15.17:0/3830649978 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f6d5c12d320 con 0x7f6d700cf320 2024-09-10T23:28:01.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.741+0000 7f6d74e00640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d500725e0 0x7f6d50074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:01.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.741+0000 7f6d74e00640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d500725e0 0x7f6d50074aa0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005fd0 tx=0x7f6d60005f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:01.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.745+0000 7f6d6cc00640 1 -- 172.21.15.17:0/3830649978 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6d5c0164b0 con 0x7f6d700cf320 2024-09-10T23:28:01.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.953+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d700cfed0 con 0x7f6d700cf320 2024-09-10T23:28:01.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.953+0000 7f6d6cc00640 1 -- 172.21.15.17:0/3830649978 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7f6d5c0f8860 con 0x7f6d700cf320 2024-09-10T23:28:01.959 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:01.959 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:28:01.960 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:28:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d500725e0 msgr2=0x7f6d50074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:01.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d500725e0 0x7f6d50074aa0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005fd0 tx=0x7f6d60005f20 comp rx=0 tx=0).stop 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700cf320 msgr2=0x7f6d700b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700cf320 0x7f6d700b4b90 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0b0040 tx=0x7f6d5c004600 comp rx=0 tx=0).stop 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 shutdown_connections 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6d500725e0 0x7f6d50074aa0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d700d1830 0x7f6d700c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d700cf320 0x7f6d700b4b90 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 --2- 172.21.15.17:0/3830649978 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d70070ad0 0x7f6d700b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 >> 172.21.15.17:0/3830649978 conn(0x7f6d700d1d60 msgr2=0x7f6d7015b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 shutdown_connections 2024-09-10T23:28:01.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:01.957+0000 7f6d77800640 1 -- 172.21.15.17:0/3830649978 wait complete. 2024-09-10T23:28:01.982 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-10T23:28:06.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:07.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.137+0000 7f8ced400640 1 -- 172.21.15.17:0/1317080913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80d02e0 msgr2=0x7f8ce80cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:07.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.137+0000 7f8ced400640 1 --2- 172.21.15.17:0/1317080913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80d02e0 0x7f8ce80cc5a0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8073c60 tx=0x7f8ce001cd50 comp rx=0 tx=0).stop 2024-09-10T23:28:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.137+0000 7f8ced400640 1 -- 172.21.15.17:0/1317080913 shutdown_connections 2024-09-10T23:28:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.137+0000 7f8ced400640 1 --2- 172.21.15.17:0/1317080913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80d02e0 0x7f8ce80cc5a0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.137+0000 7f8ced400640 1 --2- 172.21.15.17:0/1317080913 >> v2:172.21.15.77:3300/0 conn(0x7f8ce80b3110 0x7f8ce80b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.137+0000 7f8ced400640 1 -- 172.21.15.17:0/1317080913 >> 172.21.15.17:0/1317080913 conn(0x7f8ce80b3870 msgr2=0x7f8ce80b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.137+0000 7f8ced400640 1 -- 172.21.15.17:0/1317080913 shutdown_connections 2024-09-10T23:28:07.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.137+0000 7f8ced400640 1 -- 172.21.15.17:0/1317080913 wait complete. 2024-09-10T23:28:07.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 Processor -- start 2024-09-10T23:28:07.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 -- start start 2024-09-10T23:28:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80b3110 0x7f8ce8153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ce80d02e0 0x7f8ce815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ce815f130 0x7f8ce81593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce81691f0 con 0x7f8ce80b3110 2024-09-10T23:28:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce8169070 con 0x7f8ce815f130 2024-09-10T23:28:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce8169370 con 0x7f8ce80d02e0 2024-09-10T23:28:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80b3110 0x7f8ce8153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80b3110 0x7f8ce8153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38006/0 (socket says 172.21.15.17:38006) 2024-09-10T23:28:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce6800640 1 -- 172.21.15.17:0/719527871 learned_addr learned my addr 172.21.15.17:0/719527871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8cdfe00640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ce80d02e0 0x7f8ce815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce7200640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ce815f130 0x7f8ce81593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce6800640 1 -- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ce80d02e0 msgr2=0x7f8ce815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce6800640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ce80d02e0 0x7f8ce815d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce6800640 1 -- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ce815f130 msgr2=0x7f8ce81593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce6800640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ce815f130 0x7f8ce81593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce6800640 1 -- 172.21.15.17:0/719527871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce815c320 con 0x7f8ce80b3110 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ce6800640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80b3110 0x7f8ce8153f10 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800c3c0 tx=0x7f8cd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8cdea00640 1 -- 172.21.15.17:0/719527871 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8017070 con 0x7f8ce80b3110 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8cdea00640 1 -- 172.21.15.17:0/719527871 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cd80053c0 con 0x7f8ce80b3110 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8cdea00640 1 -- 172.21.15.17:0/719527871 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8003860 con 0x7f8ce80b3110 2024-09-10T23:28:07.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce815c600 con 0x7f8ce80b3110 2024-09-10T23:28:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.141+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce815cbc0 con 0x7f8ce80b3110 2024-09-10T23:28:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.145+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce80b21d0 con 0x7f8ce80b3110 2024-09-10T23:28:07.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.145+0000 7f8cdea00640 1 -- 172.21.15.17:0/719527871 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8cd8003a00 con 0x7f8ce80b3110 2024-09-10T23:28:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.145+0000 7f8cdea00640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cc40725e0 0x7f8cc4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.145+0000 7f8cdea00640 1 -- 172.21.15.17:0/719527871 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6101+0+0 (secure 0 0 0) 0x7f8cd8092b40 con 0x7f8ce80b3110 2024-09-10T23:28:07.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.145+0000 7f8cdfe00640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cc40725e0 0x7f8cc4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:07.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.149+0000 7f8cdfe00640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cc40725e0 0x7f8cc4074aa0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0005d90 tx=0x7f8cd0005c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:07.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.149+0000 7f8cdea00640 1 -- 172.21.15.17:0/719527871 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8cd805df70 con 0x7f8ce80b3110 2024-09-10T23:28:07.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ce8163d80 con 0x7f8ce80b3110 2024-09-10T23:28:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8cdea00640 1 -- 172.21.15.17:0/719527871 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+5230 (secure 0 0 0) 0x7f8cd805d870 con 0x7f8ce80b3110 2024-09-10T23:28:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:07.364 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":121,"btime":"2024-09-10T23:27:20:111199+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":9708,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:27:19.518936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9711},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9711":{"gid":9711,"name":"c","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3026129347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3026129347},{"type":"v1","addr":"172.21.15.17:6835","nonce":3026129347}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9711,"qdb_cluster":[9711]},"id":11}]} 2024-09-10T23:28:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 121 2024-09-10T23:28:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cc40725e0 msgr2=0x7f8cc4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cc40725e0 0x7f8cc4074aa0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0005d90 tx=0x7f8cd0005c60 comp rx=0 tx=0).stop 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80b3110 msgr2=0x7f8ce8153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80b3110 0x7f8ce8153f10 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800c3c0 tx=0x7f8cd800c880 comp rx=0 tx=0).stop 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 shutdown_connections 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8cc40725e0 0x7f8cc4074aa0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ce815f130 0x7f8ce81593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ce80d02e0 0x7f8ce815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 --2- 172.21.15.17:0/719527871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ce80b3110 0x7f8ce8153f10 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 >> 172.21.15.17:0/719527871 conn(0x7f8ce80b3870 msgr2=0x7f8ce806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 shutdown_connections 2024-09-10T23:28:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:07.361+0000 7f8ced400640 1 -- 172.21.15.17:0/719527871 wait complete. 2024-09-10T23:28:07.386 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-10T23:28:08.362 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:28:08.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:28:12.387 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 -- 172.21.15.17:0/1482210458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec15bc70 msgr2=0x7fc6ec0cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 --2- 172.21.15.17:0/1482210458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec15bc70 0x7fc6ec0cfa20 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0d2a50 tx=0x7fc6e001c7a0 comp rx=0 tx=0).stop 2024-09-10T23:28:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 -- 172.21.15.17:0/1482210458 shutdown_connections 2024-09-10T23:28:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 --2- 172.21.15.17:0/1482210458 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6ec0d20a0 0x7fc6ec0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 --2- 172.21.15.17:0/1482210458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec15bc70 0x7fc6ec0cfa20 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 -- 172.21.15.17:0/1482210458 >> 172.21.15.17:0/1482210458 conn(0x7fc6ec09a9f0 msgr2=0x7fc6ec09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 -- 172.21.15.17:0/1482210458 shutdown_connections 2024-09-10T23:28:12.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 -- 172.21.15.17:0/1482210458 wait complete. 2024-09-10T23:28:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 Processor -- start 2024-09-10T23:28:12.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.541+0000 7fc6f3200640 1 -- start start 2024-09-10T23:28:12.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0cc570 0x7fc6ec163a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6ec0d20a0 0x7fc6ec155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f3200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6ec15bc70 0x7fc6ec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec168930 con 0x7fc6ec0cc570 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f3200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec0b21a0 con 0x7fc6ec15bc70 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ec168ab0 con 0x7fc6ec0d20a0 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0cc570 0x7fc6ec163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0cc570 0x7fc6ec163a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38016/0 (socket says 172.21.15.17:38016) 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1e00640 1 -- 172.21.15.17:0/2457378076 learned_addr learned my addr 172.21.15.17:0/2457378076 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1400640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6ec0d20a0 0x7fc6ec155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f2800640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6ec15bc70 0x7fc6ec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1e00640 1 -- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6ec0d20a0 msgr2=0x7fc6ec155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:12.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1e00640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6ec0d20a0 0x7fc6ec155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1e00640 1 -- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6ec15bc70 msgr2=0x7fc6ec06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1e00640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6ec15bc70 0x7fc6ec06dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1e00640 1 -- 172.21.15.17:0/2457378076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec164050 con 0x7fc6ec0cc570 2024-09-10T23:28:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f1e00640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0cc570 0x7fc6ec163a70 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fc6e001aeb0 tx=0x7fc6e00a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6e6000640 1 -- 172.21.15.17:0/2457378076 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00b2040 con 0x7fc6ec0cc570 2024-09-10T23:28:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6e6000640 1 -- 172.21.15.17:0/2457378076 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6e00044b0 con 0x7fc6ec0cc570 2024-09-10T23:28:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6e6000640 1 -- 172.21.15.17:0/2457378076 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0003840 con 0x7fc6ec0cc570 2024-09-10T23:28:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ec164330 con 0x7fc6ec0cc570 2024-09-10T23:28:12.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ec1579a0 con 0x7fc6ec0cc570 2024-09-10T23:28:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.545+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ec0b10f0 con 0x7fc6ec0cc570 2024-09-10T23:28:12.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.549+0000 7fc6e6000640 1 -- 172.21.15.17:0/2457378076 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc6e00039e0 con 0x7fc6ec0cc570 2024-09-10T23:28:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.549+0000 7fc6e6000640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc6d00725e0 0x7fc6d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.549+0000 7fc6e6000640 1 -- 172.21.15.17:0/2457378076 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7fc6e012d1f0 con 0x7fc6ec0cc570 2024-09-10T23:28:12.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.549+0000 7fc6f1400640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc6d00725e0 0x7fc6d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:12.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.549+0000 7fc6f1400640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc6d00725e0 0x7fc6d0074aa0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec06f350 tx=0x7fc6dc007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:12.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.553+0000 7fc6e6000640 1 -- 172.21.15.17:0/2457378076 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc6e00164b0 con 0x7fc6ec0cc570 2024-09-10T23:28:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6ec0cee40 con 0x7fc6ec0cc570 2024-09-10T23:28:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6e6000640 1 -- 172.21.15.17:0/2457378076 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+4403 (secure 0 0 0) 0x7fc6e00f8000 con 0x7fc6ec0cc570 2024-09-10T23:28:12.764 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:12.764 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":123,"btime":"2024-09-10T23:28:11:822773+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:28:10.979677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9708":{"gid":9708,"name":"a","rank":0,"incarnation":122,"state":"up:reconnect","state_seq":16,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":11}]} 2024-09-10T23:28:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 123 2024-09-10T23:28:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc6d00725e0 msgr2=0x7fc6d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc6d00725e0 0x7fc6d0074aa0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec06f350 tx=0x7fc6dc007e40 comp rx=0 tx=0).stop 2024-09-10T23:28:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0cc570 msgr2=0x7fc6ec163a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0cc570 0x7fc6ec163a70 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fc6e001aeb0 tx=0x7fc6e00a5750 comp rx=0 tx=0).stop 2024-09-10T23:28:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 shutdown_connections 2024-09-10T23:28:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc6d00725e0 0x7fc6d0074aa0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:12.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6ec15bc70 0x7fc6ec06dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:12.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc6ec0d20a0 0x7fc6ec155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:12.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 --2- 172.21.15.17:0/2457378076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0cc570 0x7fc6ec163a70 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:12.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 >> 172.21.15.17:0/2457378076 conn(0x7fc6ec09a9f0 msgr2=0x7fc6ec0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:12.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 shutdown_connections 2024-09-10T23:28:12.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:12.761+0000 7fc6f3200640 1 -- 172.21.15.17:0/2457378076 wait complete. 2024-09-10T23:28:12.787 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-10T23:28:17.788 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2001834367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf00d0030 msgr2=0x7fbaf00d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 --2- 172.21.15.17:0/2001834367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf00d0030 0x7fbaf00d0480 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009c80 tx=0x7fbae801cd70 comp rx=0 tx=0).stop 2024-09-10T23:28:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2001834367 shutdown_connections 2024-09-10T23:28:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 --2- 172.21.15.17:0/2001834367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf00d0030 0x7fbaf00d0480 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 --2- 172.21.15.17:0/2001834367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaf015ef40 0x7fbaf015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2001834367 >> 172.21.15.17:0/2001834367 conn(0x7fbaf006cfc0 msgr2=0x7fbaf006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2001834367 shutdown_connections 2024-09-10T23:28:17.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2001834367 wait complete. 2024-09-10T23:28:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 Processor -- start 2024-09-10T23:28:17.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 -- start start 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaf00d0030 0x7fbaf0152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf015e5d0 0x7fbaf006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaf015ef40 0x7fbaf0139fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0167cb0 con 0x7fbaf00d0030 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0167b30 con 0x7fbaf015e5d0 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaf4a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf0167e30 con 0x7fbaf015ef40 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaede00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaf00d0030 0x7fbaf0152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaede00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaf00d0030 0x7fbaf0152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49596/0 (socket says 172.21.15.17:49596) 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaede00640 1 -- 172.21.15.17:0/2892477398 learned_addr learned my addr 172.21.15.17:0/2892477398 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:17.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbae7e00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf015e5d0 0x7fbaf006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaee800640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaf015ef40 0x7fbaf0139fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaede00640 1 -- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaf015ef40 msgr2=0x7fbaf0139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaede00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaf015ef40 0x7fbaf0139fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaede00640 1 -- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf015e5d0 msgr2=0x7fbaf006e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaede00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf015e5d0 0x7fbaf006e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaede00640 1 -- 172.21.15.17:0/2892477398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf01468f0 con 0x7fbaf00d0030 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.944+0000 7fbaee800640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaf015ef40 0x7fbaf0139fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbaede00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaf00d0030 0x7fbaf0152070 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fbae000e9f0 tx=0x7fbae000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbae6000640 1 -- 172.21.15.17:0/2892477398 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae000cd80 con 0x7fbaf00d0030 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbae6000640 1 -- 172.21.15.17:0/2892477398 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbae0010430 con 0x7fbaf00d0030 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf00cd6a0 con 0x7fbaf00d0030 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbae6000640 1 -- 172.21.15.17:0/2892477398 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0010860 con 0x7fbaf00d0030 2024-09-10T23:28:17.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf01fb4b0 con 0x7fbaf00d0030 2024-09-10T23:28:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf00d0480 con 0x7fbaf00d0030 2024-09-10T23:28:17.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbae6000640 1 -- 172.21.15.17:0/2892477398 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbae0010a00 con 0x7fbaf00d0030 2024-09-10T23:28:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbae6000640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbacc0725e0 0x7fbacc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.948+0000 7fbae6000640 1 -- 172.21.15.17:0/2892477398 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7fbae00940d0 con 0x7fbaf00d0030 2024-09-10T23:28:17.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.952+0000 7fbae7e00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbacc0725e0 0x7fbacc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:17.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.952+0000 7fbae7e00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbacc0725e0 0x7fbacc074aa0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbaf014d7a0 tx=0x7fbad8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:17.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:17.952+0000 7fbae6000640 1 -- 172.21.15.17:0/2892477398 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbaf01468f0 con 0x7fbaf00d0030 2024-09-10T23:28:18.060 INFO:tasks.ceph.mds.a.smithi017.stderr:2024-09-10T23:28:18.056+0000 7fd12e000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:28:18.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.164+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbaf00cbfe0 con 0x7fbaf00d0030 2024-09-10T23:28:18.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.164+0000 7fbae6000640 1 -- 172.21.15.17:0/2892477398 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+4407 (secure 0 0 0) 0x7fbae005ef20 con 0x7fbaf00d0030 2024-09-10T23:28:18.169 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:18.169 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":125,"btime":"2024-09-10T23:28:13:830639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:28:13.830629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9708":{"gid":9708,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":18,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9708,"qdb_cluster":[9708]},"id":11}]} 2024-09-10T23:28:18.170 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 125 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbacc0725e0 msgr2=0x7fbacc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbacc0725e0 0x7fbacc074aa0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbaf014d7a0 tx=0x7fbad8009040 comp rx=0 tx=0).stop 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaf00d0030 msgr2=0x7fbaf0152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaf00d0030 0x7fbaf0152070 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fbae000e9f0 tx=0x7fbae000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 shutdown_connections 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbacc0725e0 0x7fbacc074aa0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaf015ef40 0x7fbaf0139fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaf015e5d0 0x7fbaf006e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 --2- 172.21.15.17:0/2892477398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbaf00d0030 0x7fbaf0152070 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 >> 172.21.15.17:0/2892477398 conn(0x7fbaf006cfc0 msgr2=0x7fbaf00af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 shutdown_connections 2024-09-10T23:28:18.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.168+0000 7fbaf4a00640 1 -- 172.21.15.17:0/2892477398 wait complete. 2024-09-10T23:28:18.191 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-10T23:28:18.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:18.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.332+0000 7f7c86a00640 1 -- 172.21.15.17:0/2551835396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c64003a10 msgr2=0x7f7c64003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.332+0000 7f7c86a00640 1 --2- 172.21.15.17:0/2551835396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c64003a10 0x7f7c64003e30 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009b60 tx=0x7f7c7001d2b0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.332+0000 7f7c84a00640 1 -- 172.21.15.17:0/2551835396 reap_dead start 2024-09-10T23:28:18.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.332+0000 7f7c86a00640 1 -- 172.21.15.17:0/2551835396 shutdown_connections 2024-09-10T23:28:18.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.332+0000 7f7c86a00640 1 -- 172.21.15.17:0/2551835396 >> 172.21.15.17:0/2551835396 conn(0x7f7c800d1d60 msgr2=0x7f7c800d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 -- 172.21.15.17:0/2551835396 shutdown_connections 2024-09-10T23:28:18.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 -- 172.21.15.17:0/2551835396 wait complete. 2024-09-10T23:28:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 Processor -- start 2024-09-10T23:28:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 -- start start 2024-09-10T23:28:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c64003a10 0x7f7c801fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c801f7df0 0x7f7c801590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c800c8e30 0x7f7c800b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80166e30 con 0x7f7c801f7df0 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80166cb0 con 0x7f7c64003a10 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c80166fb0 con 0x7f7c800c8e30 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c77e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c801f7df0 0x7f7c801590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c77e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c801f7df0 0x7f7c801590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49622/0 (socket says 172.21.15.17:49622) 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c77e00640 1 -- 172.21.15.17:0/2682615906 learned_addr learned my addr 172.21.15.17:0/2682615906 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c7fe00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c64003a10 0x7f7c801fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c84a00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c800c8e30 0x7f7c800b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c77e00640 1 -- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c800c8e30 msgr2=0x7f7c800b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c77e00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c800c8e30 0x7f7c800b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c77e00640 1 -- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c64003a10 msgr2=0x7f7c801fbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c77e00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c64003a10 0x7f7c801fbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c77e00640 1 -- 172.21.15.17:0/2682615906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c80159600 con 0x7f7c801f7df0 2024-09-10T23:28:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c77e00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c801f7df0 0x7f7c801590c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f7c68000fe0 tx=0x7f7c6800ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c7cc00640 1 -- 172.21.15.17:0/2682615906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68015070 con 0x7f7c801f7df0 2024-09-10T23:28:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c7cc00640 1 -- 172.21.15.17:0/2682615906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c68010980 con 0x7f7c801f7df0 2024-09-10T23:28:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c7cc00640 1 -- 172.21.15.17:0/2682615906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68010db0 con 0x7f7c801f7df0 2024-09-10T23:28:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.336+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c801f82d0 con 0x7f7c801f7df0 2024-09-10T23:28:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.340+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c801f8890 con 0x7f7c801f7df0 2024-09-10T23:28:18.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.340+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8015f060 con 0x7f7c801f7df0 2024-09-10T23:28:18.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.340+0000 7f7c7cc00640 1 -- 172.21.15.17:0/2682615906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7c68011460 con 0x7f7c801f7df0 2024-09-10T23:28:18.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.340+0000 7f7c7cc00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c5c072610 0x7f7c5c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.340+0000 7f7c7cc00640 1 -- 172.21.15.17:0/2682615906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f7c68093a80 con 0x7f7c801f7df0 2024-09-10T23:28:18.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.340+0000 7f7c7fe00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c5c072610 0x7f7c5c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.344+0000 7f7c7fe00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c5c072610 0x7f7c5c074ad0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7c700af000 tx=0x7f7c7001a050 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.344+0000 7f7c7cc00640 1 -- 172.21.15.17:0/2682615906 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7c68095e20 con 0x7f7c801f7df0 2024-09-10T23:28:18.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.552+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c8006fa60 con 0x7f7c801f7df0 2024-09-10T23:28:18.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.552+0000 7f7c7cc00640 1 -- 172.21.15.17:0/2682615906 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+4407 (secure 0 0 0) 0x7f7c6805e890 con 0x7f7c801f7df0 2024-09-10T23:28:18.559 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:18.560 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":125,"btime":"2024-09-10T23:28:13:830639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:28:13.830629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9708":{"gid":9708,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":18,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9708,"qdb_cluster":[9708]},"id":11}]} 2024-09-10T23:28:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 125 2024-09-10T23:28:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c5c072610 msgr2=0x7f7c5c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c5c072610 0x7f7c5c074ad0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7c700af000 tx=0x7f7c7001a050 comp rx=0 tx=0).stop 2024-09-10T23:28:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c801f7df0 msgr2=0x7f7c801590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c801f7df0 0x7f7c801590c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f7c68000fe0 tx=0x7f7c6800ea90 comp rx=0 tx=0).stop 2024-09-10T23:28:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 shutdown_connections 2024-09-10T23:28:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c5c072610 0x7f7c5c074ad0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c800c8e30 0x7f7c800b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c801f7df0 0x7f7c801590c0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 --2- 172.21.15.17:0/2682615906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c64003a10 0x7f7c801fbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 >> 172.21.15.17:0/2682615906 conn(0x7f7c800d1d60 msgr2=0x7f7c800b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 shutdown_connections 2024-09-10T23:28:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.556+0000 7f7c86a00640 1 -- 172.21.15.17:0/2682615906 wait complete. 2024-09-10T23:28:18.581 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-10T23:28:18.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:28:18.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.720+0000 7f07eda00640 1 -- 172.21.15.17:0/858751641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e8070ad0 msgr2=0x7f07e815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.720+0000 7f07eda00640 1 --2- 172.21.15.17:0/858751641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e8070ad0 0x7f07e815f060 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f07e80b7de0 tx=0x7f07d801c800 comp rx=0 tx=0).stop 2024-09-10T23:28:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.720+0000 7f07eda00640 1 -- 172.21.15.17:0/858751641 shutdown_connections 2024-09-10T23:28:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.720+0000 7f07eda00640 1 --2- 172.21.15.17:0/858751641 >> v2:172.21.15.77:3300/0 conn(0x7f07e80cf320 0x7f07e80cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.720+0000 7f07eda00640 1 --2- 172.21.15.17:0/858751641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e8070ad0 0x7f07e815f060 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.720+0000 7f07eda00640 1 -- 172.21.15.17:0/858751641 >> 172.21.15.17:0/858751641 conn(0x7f07e80d1d60 msgr2=0x7f07e80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.720+0000 7f07eda00640 1 -- 172.21.15.17:0/858751641 shutdown_connections 2024-09-10T23:28:18.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.720+0000 7f07eda00640 1 -- 172.21.15.17:0/858751641 wait complete. 2024-09-10T23:28:18.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 Processor -- start 2024-09-10T23:28:18.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 -- start start 2024-09-10T23:28:18.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07e8070ad0 0x7f07e8150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80cf320 0x7f07e80b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07e80d1830 0x7f07e80c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81692d0 con 0x7f07e80cf320 2024-09-10T23:28:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8169150 con 0x7f07e8070ad0 2024-09-10T23:28:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f07e8169450 con 0x7f07e80d1830 2024-09-10T23:28:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07de000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80cf320 0x7f07e80b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07de000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80cf320 0x7f07e80b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49642/0 (socket says 172.21.15.17:49642) 2024-09-10T23:28:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07de000640 1 -- 172.21.15.17:0/3875872972 learned_addr learned my addr 172.21.15.17:0/3875872972 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07e6a00640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07e8070ad0 0x7f07e8150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07e7400640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07e80d1830 0x7f07e80c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07de000640 1 -- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07e80d1830 msgr2=0x7f07e80c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07de000640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07e80d1830 0x7f07e80c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07de000640 1 -- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07e8070ad0 msgr2=0x7f07e8150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07de000640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07e8070ad0 0x7f07e8150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07de000640 1 -- 172.21.15.17:0/3875872972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e80b2c30 con 0x7f07e80cf320 2024-09-10T23:28:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07de000640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80cf320 0x7f07e80b5d90 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c430 tx=0x7f07d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07df400640 1 -- 172.21.15.17:0/3875872972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0011790 con 0x7f07e80cf320 2024-09-10T23:28:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07df400640 1 -- 172.21.15.17:0/3875872972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07d0017070 con 0x7f07e80cf320 2024-09-10T23:28:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07df400640 1 -- 172.21.15.17:0/3875872972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0011ce0 con 0x7f07e80cf320 2024-09-10T23:28:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e80b2f10 con 0x7f07e80cf320 2024-09-10T23:28:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.724+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e80b34d0 con 0x7f07e80cf320 2024-09-10T23:28:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.728+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e815f060 con 0x7f07e80cf320 2024-09-10T23:28:18.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.728+0000 7f07df400640 1 -- 172.21.15.17:0/3875872972 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f07d001c460 con 0x7f07e80cf320 2024-09-10T23:28:18.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.728+0000 7f07df400640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07c40725e0 0x7f07c4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:18.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.728+0000 7f07df400640 1 -- 172.21.15.17:0/3875872972 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f07d00931f0 con 0x7f07e80cf320 2024-09-10T23:28:18.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.728+0000 7f07e6a00640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07c40725e0 0x7f07c4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:18.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.728+0000 7f07e6a00640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07c40725e0 0x7f07c4074aa0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f07d80af000 tx=0x7f07d801b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:18.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.732+0000 7f07df400640 1 -- 172.21.15.17:0/3875872972 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f07d005e040 con 0x7f07e80cf320 2024-09-10T23:28:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.968+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f07e81508a0 con 0x7f07e80cf320 2024-09-10T23:28:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.968+0000 7f07df400640 1 -- 172.21.15.17:0/3875872972 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1254 (secure 0 0 0) 0x7f07d0062a70 con 0x7f07e80cf320 2024-09-10T23:28:18.975 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:18.975 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":788,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":167,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078507351,"bytes_used":2703163392,"bytes_avail":770390949888,"bytes_total":773094113280,"read_bytes_sec":399043,"write_bytes_sec":35932,"read_op_per_sec":7,"write_op_per_sec":10},"fsmap":{"epoch":125,"btime":"2024-09-10T23:28:13:830639+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9708}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":35,"modified":"2024-09-10T23:28:14.476145+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:28:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07c40725e0 msgr2=0x7f07c4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07c40725e0 0x7f07c4074aa0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f07d80af000 tx=0x7f07d801b040 comp rx=0 tx=0).stop 2024-09-10T23:28:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80cf320 msgr2=0x7f07e80b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80cf320 0x7f07e80b5d90 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c430 tx=0x7f07d000c8f0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 shutdown_connections 2024-09-10T23:28:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f07c40725e0 0x7f07c4074aa0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07e80d1830 0x7f07e80c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07e80cf320 0x7f07e80b5d90 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 --2- 172.21.15.17:0/3875872972 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07e8070ad0 0x7f07e8150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:18.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 >> 172.21.15.17:0/3875872972 conn(0x7f07e80d1d60 msgr2=0x7f07e80d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:18.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 shutdown_connections 2024-09-10T23:28:18.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:18.972+0000 7f07eda00640 1 -- 172.21.15.17:0/3875872972 wait complete. 2024-09-10T23:28:18.997 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T23:28:18.997 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:28:18.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:28:19.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:28:19.200 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:28:19.200 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:28:19.200 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:28:19.200 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:19.209 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:28:19.209 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:19.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:28:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.448+0000 7f3731800640 1 -- 172.21.15.17:0/3657240240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 msgr2=0x7f372c0b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.448+0000 7f3731800640 1 --2- 172.21.15.17:0/3657240240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 0x7f372c0b20c0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f372c072120 tx=0x7f371401f0b0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.448+0000 7f3731800640 1 -- 172.21.15.17:0/3657240240 shutdown_connections 2024-09-10T23:28:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.448+0000 7f3731800640 1 --2- 172.21.15.17:0/3657240240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 0x7f372c0b20c0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.448+0000 7f3731800640 1 --2- 172.21.15.17:0/3657240240 >> v2:172.21.15.77:3300/0 conn(0x7f372c15a250 0x7f372c0ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.448+0000 7f3731800640 1 -- 172.21.15.17:0/3657240240 >> 172.21.15.17:0/3657240240 conn(0x7f372c0ccbf0 msgr2=0x7f372c0cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.448+0000 7f3731800640 1 -- 172.21.15.17:0/3657240240 shutdown_connections 2024-09-10T23:28:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.448+0000 7f3731800640 1 -- 172.21.15.17:0/3657240240 wait complete. 2024-09-10T23:28:19.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 Processor -- start 2024-09-10T23:28:19.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 -- start start 2024-09-10T23:28:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 0x7f372c09d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f372c0b36a0 0x7f372c09bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f372c15a250 0x7f372c15c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f372c0695f0 con 0x7f372c0b1c60 2024-09-10T23:28:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f372c069470 con 0x7f372c0b36a0 2024-09-10T23:28:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f372c069770 con 0x7f372c15a250 2024-09-10T23:28:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f372be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 0x7f372c09d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f372be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 0x7f372c09d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49670/0 (socket says 172.21.15.17:49670) 2024-09-10T23:28:19.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f372be00640 1 -- 172.21.15.17:0/3340970913 learned_addr learned my addr 172.21.15.17:0/3340970913 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3723e00640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f372c0b36a0 0x7f372c09bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3730e00640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f372c15a250 0x7f372c15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f372be00640 1 -- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f372c15a250 msgr2=0x7f372c15c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f372be00640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f372c15a250 0x7f372c15c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f372be00640 1 -- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f372c0b36a0 msgr2=0x7f372c09bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f372be00640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f372c0b36a0 0x7f372c09bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f372be00640 1 -- 172.21.15.17:0/3340970913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c1f4a90 con 0x7f372c0b1c60 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3723e00640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f372c0b36a0 0x7f372c09bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f372be00640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 0x7f372c09d400 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c9f0 tx=0x7f371c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3728c00640 1 -- 172.21.15.17:0/3340970913 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c007bb0 con 0x7f372c0b1c60 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3728c00640 1 -- 172.21.15.17:0/3340970913 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f371c007e40 con 0x7f372c0b1c60 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3728c00640 1 -- 172.21.15.17:0/3340970913 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c00f690 con 0x7f372c0b1c60 2024-09-10T23:28:19.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372c09c310 con 0x7f372c0b1c60 2024-09-10T23:28:19.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372c15bd30 con 0x7f372c0b1c60 2024-09-10T23:28:19.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.452+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372c0b20c0 con 0x7f372c0b1c60 2024-09-10T23:28:19.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.456+0000 7f3728c00640 1 -- 172.21.15.17:0/3340970913 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f371c00f830 con 0x7f372c0b1c60 2024-09-10T23:28:19.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.456+0000 7f3728c00640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f37080725e0 0x7f3708074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:19.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.456+0000 7f3728c00640 1 -- 172.21.15.17:0/3340970913 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f371c093d00 con 0x7f372c0b1c60 2024-09-10T23:28:19.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.456+0000 7f3723e00640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f37080725e0 0x7f3708074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:19.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.456+0000 7f3723e00640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f37080725e0 0x7f3708074aa0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f37140b2000 tx=0x7f371401d8f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:19.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.460+0000 7f3728c00640 1 -- 172.21.15.17:0/3340970913 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f372c1f4a90 con 0x7f372c0b1c60 2024-09-10T23:28:19.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.644+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f372c0702f0 con 0x7f372c0b1c60 2024-09-10T23:28:19.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3728c00640 1 -- 172.21.15.17:0/3340970913 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v167) ==== 80+0+122 (secure 0 0 0) 0x7f371c014030 con 0x7f372c0b1c60 2024-09-10T23:28:19.652 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6835/3026129347 2024-09-11T23:28:10.820527+0000 2024-09-10T23:28:19.652 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6833/3026129347 2024-09-11T23:28:10.820527+0000 2024-09-10T23:28:19.652 INFO:teuthology.orchestra.run.smithi017.stderr:listed 2 entries 2024-09-10T23:28:19.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f37080725e0 msgr2=0x7f3708074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:19.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f37080725e0 0x7f3708074aa0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f37140b2000 tx=0x7f371401d8f0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 msgr2=0x7f372c09d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:19.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 0x7f372c09d400 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c9f0 tx=0x7f371c00ceb0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 shutdown_connections 2024-09-10T23:28:19.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f37080725e0 0x7f3708074aa0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f372c15a250 0x7f372c15c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f372c0b36a0 0x7f372c09bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 --2- 172.21.15.17:0/3340970913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f372c0b1c60 0x7f372c09d400 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:19.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 >> 172.21.15.17:0/3340970913 conn(0x7f372c0ccbf0 msgr2=0x7f372c072cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:19.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 shutdown_connections 2024-09-10T23:28:19.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:19.648+0000 7f3731800640 1 -- 172.21.15.17:0/3340970913 wait complete. 2024-09-10T23:28:19.673 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:28:19.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:19.673 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:28:19.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[81302]: fuse finished with error 0 and tester_r 0 2024-09-10T23:28:19.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:28:19.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:19.694 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:28:19.856 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:28:19.856 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:28:19.856 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:19.865 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:28:19.865 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:28:19.866 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:28:19.866 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:19.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:28:19.908 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:28:19.909 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:28:19.909 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:19.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:28:19.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.096+0000 7f6333e00640 1 -- 172.21.15.17:0/3986847438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 msgr2=0x7f632c0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.096+0000 7f6333e00640 1 --2- 172.21.15.17:0/3986847438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 0x7f632c0cfc60 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f632c073bf0 tx=0x7f632401cd80 comp rx=0 tx=0).stop 2024-09-10T23:28:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.096+0000 7f6333e00640 1 -- 172.21.15.17:0/3986847438 shutdown_connections 2024-09-10T23:28:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.096+0000 7f6333e00640 1 --2- 172.21.15.17:0/3986847438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 0x7f632c0cfc60 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.096+0000 7f6333e00640 1 --2- 172.21.15.17:0/3986847438 >> v2:172.21.15.77:3300/0 conn(0x7f632c0d1830 0x7f632c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.096+0000 7f6333e00640 1 --2- 172.21.15.17:0/3986847438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f632c070ad0 0x7f632c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.096+0000 7f6333e00640 1 -- 172.21.15.17:0/3986847438 >> 172.21.15.17:0/3986847438 conn(0x7f632c0d1d60 msgr2=0x7f632c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.096+0000 7f6333e00640 1 -- 172.21.15.17:0/3986847438 shutdown_connections 2024-09-10T23:28:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.096+0000 7f6333e00640 1 -- 172.21.15.17:0/3986847438 wait complete. 2024-09-10T23:28:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 Processor -- start 2024-09-10T23:28:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 -- start start 2024-09-10T23:28:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c070ad0 0x7f632c0b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 0x7f632c166420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f632c0d1830 0x7f632c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0cd2f0 con 0x7f632c0cf320 2024-09-10T23:28:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0cd170 con 0x7f632c070ad0 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f632c0cd470 con 0x7f632c0d1830 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6330a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 0x7f632c166420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6330a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 0x7f632c166420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49688/0 (socket says 172.21.15.17:49688) 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6330a00640 1 -- 172.21.15.17:0/4053569049 learned_addr learned my addr 172.21.15.17:0/4053569049 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6331400640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c070ad0 0x7f632c0b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6331e00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f632c0d1830 0x7f632c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6330a00640 1 -- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f632c0d1830 msgr2=0x7f632c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6330a00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f632c0d1830 0x7f632c0b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6330a00640 1 -- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c070ad0 msgr2=0x7f632c0b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6330a00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c070ad0 0x7f632c0b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6330a00640 1 -- 172.21.15.17:0/4053569049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c0b01b0 con 0x7f632c0cf320 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6330a00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 0x7f632c166420 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f631800e7d0 tx=0x7f631800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:20.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6329600640 1 -- 172.21.15.17:0/4053569049 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631800ccc0 con 0x7f632c0cf320 2024-09-10T23:28:20.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6329600640 1 -- 172.21.15.17:0/4053569049 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6318010430 con 0x7f632c0cf320 2024-09-10T23:28:20.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6329600640 1 -- 172.21.15.17:0/4053569049 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318010860 con 0x7f632c0cf320 2024-09-10T23:28:20.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c0b0bd0 con 0x7f632c0cf320 2024-09-10T23:28:20.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.100+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c0af9b0 con 0x7f632c0cf320 2024-09-10T23:28:20.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.104+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c0cfc60 con 0x7f632c0cf320 2024-09-10T23:28:20.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.104+0000 7f6329600640 1 -- 172.21.15.17:0/4053569049 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6318010a00 con 0x7f632c0cf320 2024-09-10T23:28:20.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.104+0000 7f6329600640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f630c0725e0 0x7f630c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.104+0000 7f6329600640 1 -- 172.21.15.17:0/4053569049 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f6318093da0 con 0x7f632c0cf320 2024-09-10T23:28:20.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.104+0000 7f6331400640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f630c0725e0 0x7f630c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.104+0000 7f6331400640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f630c0725e0 0x7f630c074aa0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6320009b60 tx=0x7f63200091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:20.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.108+0000 7f6329600640 1 -- 172.21.15.17:0/4053569049 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f631805ec40 con 0x7f632c0cf320 2024-09-10T23:28:20.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.320+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f632c0b52f0 con 0x7f632c0cf320 2024-09-10T23:28:20.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6329600640 1 -- 172.21.15.17:0/4053569049 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+4407 (secure 0 0 0) 0x7f6318063670 con 0x7f632c0cf320 2024-09-10T23:28:20.328 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:20.328 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":125,"btime":"2024-09-10T23:28:13:830639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:28:13.830629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9708":{"gid":9708,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":18,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9708,"qdb_cluster":[9708]},"id":11}]} 2024-09-10T23:28:20.328 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 125 2024-09-10T23:28:20.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f630c0725e0 msgr2=0x7f630c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f630c0725e0 0x7f630c074aa0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6320009b60 tx=0x7f63200091e0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 msgr2=0x7f632c166420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 0x7f632c166420 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f631800e7d0 tx=0x7f631800ec90 comp rx=0 tx=0).stop 2024-09-10T23:28:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 shutdown_connections 2024-09-10T23:28:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f630c0725e0 0x7f630c074aa0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f632c0d1830 0x7f632c0b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c0cf320 0x7f632c166420 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 --2- 172.21.15.17:0/4053569049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f632c070ad0 0x7f632c0b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 >> 172.21.15.17:0/4053569049 conn(0x7f632c0d1d60 msgr2=0x7f632c159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 shutdown_connections 2024-09-10T23:28:20.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.324+0000 7f6333e00640 1 -- 172.21.15.17:0/4053569049 wait complete. 2024-09-10T23:28:20.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 -- 172.21.15.17:0/3851023125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82280b32d0 msgr2=0x7f82280cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 --2- 172.21.15.17:0/3851023125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82280b32d0 0x7f82280cffa0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f82280b44b0 tx=0x7f821001f090 comp rx=0 tx=0).stop 2024-09-10T23:28:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 -- 172.21.15.17:0/3851023125 shutdown_connections 2024-09-10T23:28:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 --2- 172.21.15.17:0/3851023125 >> v2:172.21.15.77:3300/0 conn(0x7f82280cf230 0x7f8228150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 --2- 172.21.15.17:0/3851023125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82280b32d0 0x7f82280cffa0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 --2- 172.21.15.17:0/3851023125 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f822806e750 0x7f822815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 -- 172.21.15.17:0/3851023125 >> 172.21.15.17:0/3851023125 conn(0x7f822806cfc0 msgr2=0x7f822806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 -- 172.21.15.17:0/3851023125 shutdown_connections 2024-09-10T23:28:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 -- 172.21.15.17:0/3851023125 wait complete. 2024-09-10T23:28:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 Processor -- start 2024-09-10T23:28:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 -- start start 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f822806e750 0x7f82280cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82280b32d0 0x7f8228151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82280cf230 0x7f8228158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f82280d0680 con 0x7f822806e750 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82280cf8d0 con 0x7f82280b32d0 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f822d200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82281512b0 con 0x7f82280cf230 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.492+0000 7f8225e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f822806e750 0x7f82280cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f8225e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f822806e750 0x7f82280cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49710/0 (socket says 172.21.15.17:49710) 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f8225e00640 1 -- 172.21.15.17:0/1267220438 learned_addr learned my addr 172.21.15.17:0/1267220438 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f821d400640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82280b32d0 0x7f8228151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f8226800640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82280cf230 0x7f8228158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f8225e00640 1 -- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82280cf230 msgr2=0x7f8228158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f8225e00640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82280cf230 0x7f8228158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f8225e00640 1 -- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82280b32d0 msgr2=0x7f8228151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f8225e00640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82280b32d0 0x7f8228151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f8225e00640 1 -- 172.21.15.17:0/1267220438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82280ccc70 con 0x7f822806e750 2024-09-10T23:28:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f8225e00640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f822806e750 0x7f82280cc730 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f821800e9f0 tx=0x7f821800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:20.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f821ea00640 1 -- 172.21.15.17:0/1267220438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821800ccc0 con 0x7f822806e750 2024-09-10T23:28:20.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f821ea00640 1 -- 172.21.15.17:0/1267220438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f821800ce60 con 0x7f822806e750 2024-09-10T23:28:20.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f821ea00640 1 -- 172.21.15.17:0/1267220438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218005280 con 0x7f822806e750 2024-09-10T23:28:20.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82280ccef0 con 0x7f822806e750 2024-09-10T23:28:20.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82280cd4b0 con 0x7f822806e750 2024-09-10T23:28:20.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f822815fe30 con 0x7f822806e750 2024-09-10T23:28:20.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.496+0000 7f821ea00640 1 -- 172.21.15.17:0/1267220438 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8218005420 con 0x7f822806e750 2024-09-10T23:28:20.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.500+0000 7f821ea00640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82040725e0 0x7f8204074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.500+0000 7f821ea00640 1 -- 172.21.15.17:0/1267220438 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f8218094080 con 0x7f822806e750 2024-09-10T23:28:20.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.500+0000 7f821d400640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82040725e0 0x7f8204074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.500+0000 7f821d400640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82040725e0 0x7f8204074aa0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f82100b2000 tx=0x7f821001d8d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:20.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.504+0000 7f821ea00640 1 -- 172.21.15.17:0/1267220438 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f82280ccc70 con 0x7f822806e750 2024-09-10T23:28:20.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8228151c90 con 0x7f822806e750 2024-09-10T23:28:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f821ea00640 1 -- 172.21.15.17:0/1267220438 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+4407 (secure 0 0 0) 0x7f821805f570 con 0x7f822806e750 2024-09-10T23:28:20.717 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:20.717 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":125,"btime":"2024-09-10T23:28:13:830639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:28:13.830629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9708":{"gid":9708,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":18,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9708,"qdb_cluster":[9708]},"id":11}]} 2024-09-10T23:28:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 125 2024-09-10T23:28:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82040725e0 msgr2=0x7f8204074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82040725e0 0x7f8204074aa0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f82100b2000 tx=0x7f821001d8d0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f822806e750 msgr2=0x7f82280cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f822806e750 0x7f82280cc730 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f821800e9f0 tx=0x7f821800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 shutdown_connections 2024-09-10T23:28:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82040725e0 0x7f8204074aa0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82280cf230 0x7f8228158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82280b32d0 0x7f8228151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 --2- 172.21.15.17:0/1267220438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f822806e750 0x7f82280cc730 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 >> 172.21.15.17:0/1267220438 conn(0x7f822806cfc0 msgr2=0x7f822815c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 shutdown_connections 2024-09-10T23:28:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.712+0000 7f822d200640 1 -- 172.21.15.17:0/1267220438 wait complete. 2024-09-10T23:28:20.739 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:28:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 -- 172.21.15.17:0/108805760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00d1830 msgr2=0x7fc9f015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 --2- 172.21.15.17:0/108805760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00d1830 0x7fc9f015f5a0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00d2e60 tx=0x7fc9d801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 -- 172.21.15.17:0/108805760 shutdown_connections 2024-09-10T23:28:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 --2- 172.21.15.17:0/108805760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9f00cf320 0x7fc9f00cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 --2- 172.21.15.17:0/108805760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00d1830 0x7fc9f015f5a0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 --2- 172.21.15.17:0/108805760 >> v2:172.21.15.77:3300/0 conn(0x7fc9f0070ad0 0x7fc9f015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 -- 172.21.15.17:0/108805760 >> 172.21.15.17:0/108805760 conn(0x7fc9f00d1d60 msgr2=0x7fc9f00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 -- 172.21.15.17:0/108805760 shutdown_connections 2024-09-10T23:28:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 -- 172.21.15.17:0/108805760 wait complete. 2024-09-10T23:28:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.884+0000 7fc9f5000640 1 Processor -- start 2024-09-10T23:28:20.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 -- start start 2024-09-10T23:28:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9f0070ad0 0x7fc9f00c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00cf320 0x7fc9f00b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f00d1830 0x7fc9f00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f00cd2c0 con 0x7fc9f00cf320 2024-09-10T23:28:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f00cd140 con 0x7fc9f00d1830 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f00cd440 con 0x7fc9f0070ad0 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00cf320 0x7fc9f00b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00cf320 0x7fc9f00b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49732/0 (socket says 172.21.15.17:49732) 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e7e00640 1 -- 172.21.15.17:0/3357480839 learned_addr learned my addr 172.21.15.17:0/3357480839 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9ede00640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9f0070ad0 0x7fc9f00c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9ee800640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f00d1830 0x7fc9f00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e7e00640 1 -- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9f0070ad0 msgr2=0x7fc9f00c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e7e00640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9f0070ad0 0x7fc9f00c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e7e00640 1 -- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f00d1830 msgr2=0x7fc9f00b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e7e00640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f00d1830 0x7fc9f00b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e7e00640 1 -- 172.21.15.17:0/3357480839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f00b3e20 con 0x7fc9f00cf320 2024-09-10T23:28:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e7e00640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00cf320 0x7fc9f00b2fa0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fc9d80b0040 tx=0x7fc9d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e6000640 1 -- 172.21.15.17:0/3357480839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80b2040 con 0x7fc9f00cf320 2024-09-10T23:28:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e6000640 1 -- 172.21.15.17:0/3357480839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9d8005230 con 0x7fc9f00cf320 2024-09-10T23:28:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9e6000640 1 -- 172.21.15.17:0/3357480839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80046d0 con 0x7fc9f00cf320 2024-09-10T23:28:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f00b4100 con 0x7fc9f00cf320 2024-09-10T23:28:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f00b3a20 con 0x7fc9f00cf320 2024-09-10T23:28:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.888+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f00cfc60 con 0x7fc9f00cf320 2024-09-10T23:28:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.892+0000 7fc9e6000640 1 -- 172.21.15.17:0/3357480839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc9d8004870 con 0x7fc9f00cf320 2024-09-10T23:28:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.892+0000 7fc9e6000640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9cc0725e0 0x7fc9cc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.892+0000 7fc9e6000640 1 -- 172.21.15.17:0/3357480839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7fc9d812d1f0 con 0x7fc9f00cf320 2024-09-10T23:28:20.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.892+0000 7fc9ede00640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9cc0725e0 0x7fc9cc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:20.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.892+0000 7fc9ede00640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9cc0725e0 0x7fc9cc074aa0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000bb70 tx=0x7fc9e000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:20.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:20.896+0000 7fc9e6000640 1 -- 172.21.15.17:0/3357480839 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc9d80164b0 con 0x7fc9f00cf320 2024-09-10T23:28:21.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.068+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9f006f0b0 con 0x7fc9f00cf320 2024-09-10T23:28:21.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.068+0000 7fc9e6000640 1 -- 172.21.15.17:0/3357480839 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+17013 (secure 0 0 0) 0x7fc9d80f8090 con 0x7fc9f00cf320 2024-09-10T23:28:21.075 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:21.075 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":167,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:28:10.820642+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:27:14.215056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-10T23:27:15.453956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/3026129347":"2024-09-11T23:28:10.820527+0000","172.21.15.17:6833/3026129347":"2024-09-11T23:28:10.820527+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:28:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9cc0725e0 msgr2=0x7fc9cc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9cc0725e0 0x7fc9cc074aa0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000bb70 tx=0x7fc9e000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00cf320 msgr2=0x7fc9f00b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00cf320 0x7fc9f00b2fa0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fc9d80b0040 tx=0x7fc9d8004600 comp rx=0 tx=0).stop 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 shutdown_connections 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9cc0725e0 0x7fc9cc074aa0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9f00d1830 0x7fc9f00b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9f00cf320 0x7fc9f00b2fa0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 --2- 172.21.15.17:0/3357480839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9f0070ad0 0x7fc9f00c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 >> 172.21.15.17:0/3357480839 conn(0x7fc9f00d1d60 msgr2=0x7fc9f00b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 shutdown_connections 2024-09-10T23:28:21.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.072+0000 7fc9f5000640 1 -- 172.21.15.17:0/3357480839 wait complete. 2024-09-10T23:28:21.097 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:28:21.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 -- 172.21.15.17:0/1108301540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01500d1830 msgr2=0x7f01500ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 --2- 172.21.15.17:0/1108301540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01500d1830 0x7f01500ccdb0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f0148009bc0 tx=0x7f014801cb10 comp rx=0 tx=0).stop 2024-09-10T23:28:21.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 -- 172.21.15.17:0/1108301540 shutdown_connections 2024-09-10T23:28:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 --2- 172.21.15.17:0/1108301540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01500d1830 0x7f01500ccdb0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 --2- 172.21.15.17:0/1108301540 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f015015f770 0x7f01500cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 -- 172.21.15.17:0/1108301540 >> 172.21.15.17:0/1108301540 conn(0x7f01500d1d60 msgr2=0x7f01500d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 -- 172.21.15.17:0/1108301540 shutdown_connections 2024-09-10T23:28:21.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 -- 172.21.15.17:0/1108301540 wait complete. 2024-09-10T23:28:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 Processor -- start 2024-09-10T23:28:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.240+0000 7f0155400640 1 -- start start 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0155400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0150070ad0 0x7f0150157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0155400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01500d1830 0x7f01501fbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0155400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f015015f770 0x7f015015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0155400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0150169410 con 0x7f015015f770 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0155400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0150169290 con 0x7f0150070ad0 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0155400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0150169590 con 0x7f01500d1830 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f015015f770 0x7f015015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f015015f770 0x7f015015dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49752/0 (socket says 172.21.15.17:49752) 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014f200640 1 -- 172.21.15.17:0/3671640551 learned_addr learned my addr 172.21.15.17:0/3671640551 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0147e00640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01500d1830 0x7f01501fbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014e800640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0150070ad0 0x7f0150157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014f200640 1 -- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01500d1830 msgr2=0x7f01501fbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014f200640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01500d1830 0x7f01501fbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014f200640 1 -- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0150070ad0 msgr2=0x7f0150157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014f200640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0150070ad0 0x7f0150157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014f200640 1 -- 172.21.15.17:0/3671640551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01501fc470 con 0x7f015015f770 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f014f200640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f015015f770 0x7f015015dee0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f014801a740 tx=0x7f0148009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0146a00640 1 -- 172.21.15.17:0/3671640551 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01480b2040 con 0x7f015015f770 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0146a00640 1 -- 172.21.15.17:0/3671640551 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0148004d40 con 0x7f015015f770 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0146a00640 1 -- 172.21.15.17:0/3671640551 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0148004240 con 0x7f015015f770 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015015e420 con 0x7f015015f770 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0150156ee0 con 0x7f015015f770 2024-09-10T23:28:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f015015f060 con 0x7f015015f770 2024-09-10T23:28:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.244+0000 7f0146a00640 1 -- 172.21.15.17:0/3671640551 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f01480b5070 con 0x7f015015f770 2024-09-10T23:28:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.248+0000 7f0146a00640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f012c0725e0 0x7f012c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.248+0000 7f0146a00640 1 -- 172.21.15.17:0/3671640551 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f014812d160 con 0x7f015015f770 2024-09-10T23:28:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.248+0000 7f014e800640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f012c0725e0 0x7f012c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.248+0000 7f014e800640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f012c0725e0 0x7f012c074aa0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f01500715a0 tx=0x7f0140001440 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.252+0000 7f0146a00640 1 -- 172.21.15.17:0/3671640551 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f015015e420 con 0x7f015015f770 2024-09-10T23:28:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0150159190 con 0x7f015015f770 2024-09-10T23:28:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0146a00640 1 -- 172.21.15.17:0/3671640551 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+4407 (secure 0 0 0) 0x7f01501fc470 con 0x7f015015f770 2024-09-10T23:28:21.464 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:21.464 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":125,"btime":"2024-09-10T23:28:13:830639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:28:13.830629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9708":{"gid":9708,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":18,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9708,"qdb_cluster":[9708]},"id":11}]} 2024-09-10T23:28:21.465 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 125 2024-09-10T23:28:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f012c0725e0 msgr2=0x7f012c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f012c0725e0 0x7f012c074aa0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f01500715a0 tx=0x7f0140001440 comp rx=0 tx=0).stop 2024-09-10T23:28:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f015015f770 msgr2=0x7f015015dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f015015f770 0x7f015015dee0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f014801a740 tx=0x7f0148009300 comp rx=0 tx=0).stop 2024-09-10T23:28:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 shutdown_connections 2024-09-10T23:28:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f012c0725e0 0x7f012c074aa0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f015015f770 0x7f015015dee0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01500d1830 0x7f01501fbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 --2- 172.21.15.17:0/3671640551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0150070ad0 0x7f0150157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 >> 172.21.15.17:0/3671640551 conn(0x7f01500d1d60 msgr2=0x7f01500cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 shutdown_connections 2024-09-10T23:28:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.460+0000 7f0155400640 1 -- 172.21.15.17:0/3671640551 wait complete. 2024-09-10T23:28:21.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 -- 172.21.15.17:0/3404803487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00b2bf0 msgr2=0x7fcfd00af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 --2- 172.21.15.17:0/3404803487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00b2bf0 0x7fcfd00af3a0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00b0d20 tx=0x7fcfc801f370 comp rx=0 tx=0).stop 2024-09-10T23:28:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 -- 172.21.15.17:0/3404803487 shutdown_connections 2024-09-10T23:28:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 --2- 172.21.15.17:0/3404803487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00b2bf0 0x7fcfd00af3a0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 --2- 172.21.15.17:0/3404803487 >> v2:172.21.15.77:3300/0 conn(0x7fcfd00d2850 0x7fcfd00d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 -- 172.21.15.17:0/3404803487 >> 172.21.15.17:0/3404803487 conn(0x7fcfd00d1d30 msgr2=0x7fcfd00d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 -- 172.21.15.17:0/3404803487 shutdown_connections 2024-09-10T23:28:21.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 -- 172.21.15.17:0/3404803487 wait complete. 2024-09-10T23:28:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 Processor -- start 2024-09-10T23:28:21.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 -- start start 2024-09-10T23:28:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd00b2bf0 0x7fcfd01526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00d2850 0x7fcfd015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd015f400 0x7fcfd015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd00afa60 con 0x7fcfd00d2850 2024-09-10T23:28:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd00af8e0 con 0x7fcfd015f400 2024-09-10T23:28:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfd6e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd00afbe0 con 0x7fcfd00b2bf0 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfc7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00d2850 0x7fcfd015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfc7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00d2850 0x7fcfd015a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49772/0 (socket says 172.21.15.17:49772) 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.628+0000 7fcfc7e00640 1 -- 172.21.15.17:0/1156616795 learned_addr learned my addr 172.21.15.17:0/1156616795 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfd4e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd015f400 0x7fcfd015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfcfe00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd00b2bf0 0x7fcfd01526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfc7e00640 1 -- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd00b2bf0 msgr2=0x7fcfd01526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfc7e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd00b2bf0 0x7fcfd01526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfc7e00640 1 -- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd015f400 msgr2=0x7fcfd015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfc7e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd015f400 0x7fcfd015ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfc7e00640 1 -- 172.21.15.17:0/1156616795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd00cf390 con 0x7fcfd00d2850 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfcfe00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd00b2bf0 0x7fcfd01526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfc7e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00d2850 0x7fcfd015a8e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d980 tx=0x7fcfb800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfccc00640 1 -- 172.21.15.17:0/1156616795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8017070 con 0x7fcfd00d2850 2024-09-10T23:28:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfccc00640 1 -- 172.21.15.17:0/1156616795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfb8009d20 con 0x7fcfd00d2850 2024-09-10T23:28:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfccc00640 1 -- 172.21.15.17:0/1156616795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8004280 con 0x7fcfd00d2850 2024-09-10T23:28:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd00b6f80 con 0x7fcfd00d2850 2024-09-10T23:28:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd0152be0 con 0x7fcfd00d2850 2024-09-10T23:28:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd00b6db0 con 0x7fcfd00d2850 2024-09-10T23:28:21.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfccc00640 1 -- 172.21.15.17:0/1156616795 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcfb8003600 con 0x7fcfd00d2850 2024-09-10T23:28:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.632+0000 7fcfccc00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfac0725e0 0x7fcfac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.636+0000 7fcfccc00640 1 -- 172.21.15.17:0/1156616795 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7fcfb8093750 con 0x7fcfd00d2850 2024-09-10T23:28:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.636+0000 7fcfcfe00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfac0725e0 0x7fcfac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:21.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.636+0000 7fcfcfe00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfac0725e0 0x7fcfac074aa0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0001630 tx=0x7fcfc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:21.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.636+0000 7fcfccc00640 1 -- 172.21.15.17:0/1156616795 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcfb805eaa0 con 0x7fcfd00d2850 2024-09-10T23:28:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.844+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfd00b7640 con 0x7fcfd00d2850 2024-09-10T23:28:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.844+0000 7fcfccc00640 1 -- 172.21.15.17:0/1156616795 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+4407 (secure 0 0 0) 0x7fcfd00b7640 con 0x7fcfd00d2850 2024-09-10T23:28:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:21.851 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":125,"btime":"2024-09-10T23:28:13:830639+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:27:16.483958+0000","modified":"2024-09-10T23:28:13.830629+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":167,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9708},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9708":{"gid":9708,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":18,"addr":"172.21.15.17:6834/3935334503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3935334503},{"type":"v1","addr":"172.21.15.17:6834","nonce":3935334503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9708,"qdb_cluster":[9708]},"id":11}]} 2024-09-10T23:28:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 125 2024-09-10T23:28:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfac0725e0 msgr2=0x7fcfac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfac0725e0 0x7fcfac074aa0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0001630 tx=0x7fcfc0009040 comp rx=0 tx=0).stop 2024-09-10T23:28:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00d2850 msgr2=0x7fcfd015a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00d2850 0x7fcfd015a8e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d980 tx=0x7fcfb800de40 comp rx=0 tx=0).stop 2024-09-10T23:28:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 shutdown_connections 2024-09-10T23:28:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfac0725e0 0x7fcfac074aa0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd015f400 0x7fcfd015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd00d2850 0x7fcfd015a8e0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 --2- 172.21.15.17:0/1156616795 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd00b2bf0 0x7fcfd01526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 >> 172.21.15.17:0/1156616795 conn(0x7fcfd00d1d30 msgr2=0x7fcfd00d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 shutdown_connections 2024-09-10T23:28:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:21.848+0000 7fcfd6e00640 1 -- 172.21.15.17:0/1156616795 wait complete. 2024-09-10T23:28:21.874 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:28:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 -- 172.21.15.17:0/2008875783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040b4350 msgr2=0x7eff040d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 --2- 172.21.15.17:0/2008875783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040b4350 0x7eff040d0460 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7eff04070870 tx=0x7efefc01ccc0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 -- 172.21.15.17:0/2008875783 shutdown_connections 2024-09-10T23:28:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 --2- 172.21.15.17:0/2008875783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff040b4350 0x7eff040d0460 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 --2- 172.21.15.17:0/2008875783 >> v2:172.21.15.77:3300/0 conn(0x7eff040b3870 0x7eff040cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 --2- 172.21.15.17:0/2008875783 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff041550b0 0x7eff040b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 -- 172.21.15.17:0/2008875783 >> 172.21.15.17:0/2008875783 conn(0x7eff0406cfc0 msgr2=0x7eff0406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 -- 172.21.15.17:0/2008875783 shutdown_connections 2024-09-10T23:28:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 -- 172.21.15.17:0/2008875783 wait complete. 2024-09-10T23:28:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 Processor -- start 2024-09-10T23:28:22.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 -- start start 2024-09-10T23:28:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff040b3870 0x7eff04144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff040b4350 0x7eff041f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff041550b0 0x7eff04147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff04167c30 con 0x7eff041550b0 2024-09-10T23:28:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff04167ab0 con 0x7eff040b4350 2024-09-10T23:28:22.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff0b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff04167db0 con 0x7eff040b3870 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff09200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff041550b0 0x7eff04147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff09200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff041550b0 0x7eff04147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49782/0 (socket says 172.21.15.17:49782) 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff09200640 1 -- 172.21.15.17:0/4143429740 learned_addr learned my addr 172.21.15.17:0/4143429740 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff03e00640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff040b3870 0x7eff04144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7efefbe00640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff040b4350 0x7eff041f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff09200640 1 -- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff040b3870 msgr2=0x7eff04144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff09200640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff040b3870 0x7eff04144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff09200640 1 -- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff040b4350 msgr2=0x7eff041f99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff09200640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff040b4350 0x7eff041f99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.016+0000 7eff09200640 1 -- 172.21.15.17:0/4143429740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff040cc050 con 0x7eff041550b0 2024-09-10T23:28:22.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff09200640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff041550b0 0x7eff04147ba0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7efefc009bd0 tx=0x7efefc003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff00c00640 1 -- 172.21.15.17:0/4143429740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc0bb070 con 0x7eff041550b0 2024-09-10T23:28:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff00c00640 1 -- 172.21.15.17:0/4143429740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efefc004e00 con 0x7eff041550b0 2024-09-10T23:28:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff00c00640 1 -- 172.21.15.17:0/4143429740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc0b2040 con 0x7eff041550b0 2024-09-10T23:28:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff040cc330 con 0x7eff041550b0 2024-09-10T23:28:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff041f94c0 con 0x7eff041550b0 2024-09-10T23:28:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff040b3e10 con 0x7eff041550b0 2024-09-10T23:28:22.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff00c00640 1 -- 172.21.15.17:0/4143429740 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efefc0b5030 con 0x7eff041550b0 2024-09-10T23:28:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff00c00640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efee0072610 0x7efee0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.020+0000 7eff00c00640 1 -- 172.21.15.17:0/4143429740 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7efefc12cf30 con 0x7eff041550b0 2024-09-10T23:28:22.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.024+0000 7eff03e00640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efee0072610 0x7efee0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.024+0000 7eff03e00640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efee0072610 0x7efee0074ad0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efef400ab40 tx=0x7efef400a250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.028+0000 7eff00c00640 1 -- 172.21.15.17:0/4143429740 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efefc016970 con 0x7eff041550b0 2024-09-10T23:28:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.200+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff0414e4f0 con 0x7eff041550b0 2024-09-10T23:28:22.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.200+0000 7eff00c00640 1 -- 172.21.15.17:0/4143429740 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+17013 (secure 0 0 0) 0x7efefc0f7dd0 con 0x7eff041550b0 2024-09-10T23:28:22.206 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:22.206 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":167,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:28:10.820642+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:27:14.215056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-10T23:27:15.453956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/3026129347":"2024-09-11T23:28:10.820527+0000","172.21.15.17:6833/3026129347":"2024-09-11T23:28:10.820527+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:28:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efee0072610 msgr2=0x7efee0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efee0072610 0x7efee0074ad0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efef400ab40 tx=0x7efef400a250 comp rx=0 tx=0).stop 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff041550b0 msgr2=0x7eff04147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff041550b0 0x7eff04147ba0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7efefc009bd0 tx=0x7efefc003f60 comp rx=0 tx=0).stop 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 shutdown_connections 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efee0072610 0x7efee0074ad0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff041550b0 0x7eff04147ba0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff040b4350 0x7eff041f99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 --2- 172.21.15.17:0/4143429740 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff040b3870 0x7eff04144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 >> 172.21.15.17:0/4143429740 conn(0x7eff0406cfc0 msgr2=0x7eff04153700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 shutdown_connections 2024-09-10T23:28:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.204+0000 7eff0b200640 1 -- 172.21.15.17:0/4143429740 wait complete. 2024-09-10T23:28:22.227 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:28:22.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.372+0000 7f667ba00640 1 -- 172.21.15.17:0/2133777287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 msgr2=0x7f665c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.372+0000 7f667ba00640 1 --2- 172.21.15.17:0/2133777287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 0x7f665c00b9d0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f666c009eb0 tx=0x7f666c01d5f0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.372+0000 7f667ba00640 1 -- 172.21.15.17:0/2133777287 shutdown_connections 2024-09-10T23:28:22.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.372+0000 7f667ba00640 1 --2- 172.21.15.17:0/2133777287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 0x7f665c00b9d0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.372+0000 7f667ba00640 1 -- 172.21.15.17:0/2133777287 >> 172.21.15.17:0/2133777287 conn(0x7f66740d1da0 msgr2=0x7f66740d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.372+0000 7f667ba00640 1 -- 172.21.15.17:0/2133777287 shutdown_connections 2024-09-10T23:28:22.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.372+0000 7f667ba00640 1 -- 172.21.15.17:0/2133777287 wait complete. 2024-09-10T23:28:22.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.372+0000 7f667ba00640 1 Processor -- start 2024-09-10T23:28:22.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.372+0000 7f667ba00640 1 -- start start 2024-09-10T23:28:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f667ba00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 0x7f667415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f667ba00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6674153280 0x7f66740b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f667ba00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667414bcd0 0x7f667414c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f667ba00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66740d2a40 con 0x7f665c0052e0 2024-09-10T23:28:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f667ba00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f66740d28c0 con 0x7f6674153280 2024-09-10T23:28:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f667ba00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f66740d2bc0 con 0x7f667414bcd0 2024-09-10T23:28:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 0x7f667415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 0x7f667415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49794/0 (socket says 172.21.15.17:49794) 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679000640 1 -- 172.21.15.17:0/4085473720 learned_addr learned my addr 172.21.15.17:0/4085473720 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6673e00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6674153280 0x7f66740b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679a00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667414bcd0 0x7f667414c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679000640 1 -- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667414bcd0 msgr2=0x7f667414c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679000640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667414bcd0 0x7f667414c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679000640 1 -- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6674153280 msgr2=0x7f66740b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679000640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6674153280 0x7f66740b6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679000640 1 -- 172.21.15.17:0/4085473720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6674157a50 con 0x7f665c0052e0 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6679000640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 0x7f667415cee0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f6668005e70 tx=0x7f6668011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6670c00640 1 -- 172.21.15.17:0/4085473720 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6668005320 con 0x7f665c0052e0 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6670c00640 1 -- 172.21.15.17:0/4085473720 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6668018020 con 0x7f665c0052e0 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6674157d30 con 0x7f665c0052e0 2024-09-10T23:28:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6670c00640 1 -- 172.21.15.17:0/4085473720 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6668003860 con 0x7f665c0052e0 2024-09-10T23:28:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66741582f0 con 0x7f665c0052e0 2024-09-10T23:28:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f667415fca0 con 0x7f665c0052e0 2024-09-10T23:28:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.376+0000 7f6670c00640 1 -- 172.21.15.17:0/4085473720 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6668010040 con 0x7f665c0052e0 2024-09-10T23:28:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.380+0000 7f6670c00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66540725e0 0x7f6654074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.380+0000 7f6670c00640 1 -- 172.21.15.17:0/4085473720 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6187+0+0 (secure 0 0 0) 0x7f66680967b0 con 0x7f665c0052e0 2024-09-10T23:28:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.380+0000 7f6673e00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66540725e0 0x7f6654074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.380+0000 7f6673e00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66540725e0 0x7f6654074aa0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f667406fd60 tx=0x7f6660006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.384+0000 7f6670c00640 1 -- 172.21.15.17:0/4085473720 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6668022020 con 0x7f665c0052e0 2024-09-10T23:28:22.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.588+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f66740c8be0 con 0x7f665c0052e0 2024-09-10T23:28:22.595 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:28:22.592+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:28:22.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.592+0000 7f6670c00640 1 -- 172.21.15.17:0/4085473720 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v126) ==== 161+0+0 (secure 0 0 0) 0x7f66680615c0 con 0x7f665c0052e0 2024-09-10T23:28:22.597 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:28:22.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66540725e0 msgr2=0x7f6654074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66540725e0 0x7f6654074aa0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f667406fd60 tx=0x7f6660006040 comp rx=0 tx=0).stop 2024-09-10T23:28:22.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 msgr2=0x7f667415cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 0x7f667415cee0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f6668005e70 tx=0x7f6668011740 comp rx=0 tx=0).stop 2024-09-10T23:28:22.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 shutdown_connections 2024-09-10T23:28:22.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66540725e0 0x7f6654074aa0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f667414bcd0 0x7f667414c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6674153280 0x7f66740b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 --2- 172.21.15.17:0/4085473720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f665c0052e0 0x7f667415cee0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 >> 172.21.15.17:0/4085473720 conn(0x7f66740d1da0 msgr2=0x7f6674072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 shutdown_connections 2024-09-10T23:28:22.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.596+0000 7f667ba00640 1 -- 172.21.15.17:0/4085473720 wait complete. 2024-09-10T23:28:22.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:28:22.624 INFO:tasks.ceph.mds.a.smithi017.stderr: -169> 2024-09-10T23:28:18.056+0000 7fd12e000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:28:22.668 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:28:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.768+0000 7fb713000640 1 -- 172.21.15.17:0/2542626570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c15a3a0 msgr2=0x7fb70c0b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.768+0000 7fb713000640 1 --2- 172.21.15.17:0/2542626570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c15a3a0 0x7fb70c0b2aa0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00a950 tx=0x7fb6fc01db40 comp rx=0 tx=0).stop 2024-09-10T23:28:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.768+0000 7fb713000640 1 -- 172.21.15.17:0/2542626570 shutdown_connections 2024-09-10T23:28:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.768+0000 7fb713000640 1 --2- 172.21.15.17:0/2542626570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb70c073280 0x7fb70c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.768+0000 7fb713000640 1 --2- 172.21.15.17:0/2542626570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c15a3a0 0x7fb70c0b2aa0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.768+0000 7fb713000640 1 -- 172.21.15.17:0/2542626570 >> 172.21.15.17:0/2542626570 conn(0x7fb70c0b17a0 msgr2=0x7fb70c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.768+0000 7fb713000640 1 -- 172.21.15.17:0/2542626570 shutdown_connections 2024-09-10T23:28:22.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.768+0000 7fb713000640 1 -- 172.21.15.17:0/2542626570 wait complete. 2024-09-10T23:28:22.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 Processor -- start 2024-09-10T23:28:22.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 -- start start 2024-09-10T23:28:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb70c073280 0x7fb70c147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c0b2fe0 0x7fb70c143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb70c15a3a0 0x7fb70c1f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c0cd480 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c0cd300 con 0x7fb70c15a3a0 2024-09-10T23:28:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb70c0cd600 con 0x7fb70c073280 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c0b2fe0 0x7fb70c143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c0b2fe0 0x7fb70c143710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49830/0 (socket says 172.21.15.17:49830) 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70b400640 1 -- 172.21.15.17:0/1026864286 learned_addr learned my addr 172.21.15.17:0/1026864286 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70be00640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb70c073280 0x7fb70c147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb711000640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb70c15a3a0 0x7fb70c1f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70b400640 1 -- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb70c073280 msgr2=0x7fb70c147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70b400640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb70c073280 0x7fb70c147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70b400640 1 -- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb70c15a3a0 msgr2=0x7fb70c1f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70b400640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb70c15a3a0 0x7fb70c1f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70b400640 1 -- 172.21.15.17:0/1026864286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c15d340 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb70b400640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c0b2fe0 0x7fb70c143710 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c490 tx=0x7fb6f800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb703e00640 1 -- 172.21.15.17:0/1026864286 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8016020 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb703e00640 1 -- 172.21.15.17:0/1026864286 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6f8012940 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb703e00640 1 -- 172.21.15.17:0/1026864286 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8012d90 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c15d620 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c1f5460 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.772+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c0cc6f0 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.776+0000 7fb703e00640 1 -- 172.21.15.17:0/1026864286 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb6f801b400 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.776+0000 7fb703e00640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6ec0725e0 0x7fb6ec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:22.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.776+0000 7fb703e00640 1 -- 172.21.15.17:0/1026864286 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6273+0+0 (secure 0 0 0) 0x7fb6f8093690 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.776+0000 7fb70be00640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6ec0725e0 0x7fb6ec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.776+0000 7fb70be00640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6ec0725e0 0x7fb6ec074aa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0b0000 tx=0x7fb6fc01c380 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:22.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.780+0000 7fb703e00640 1 -- 172.21.15.17:0/1026864286 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb6f8020020 con 0x7fb70c0b2fe0 2024-09-10T23:28:22.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:22.988+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb70c143c50 con 0x7fb70c0b2fe0 2024-09-10T23:28:23.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb703e00640 1 -- 172.21.15.17:0/1026864286 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v127) ==== 104+0+0 (secure 0 0 0) 0x7fb6f805e500 con 0x7fb70c0b2fe0 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6ec0725e0 msgr2=0x7fb6ec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6ec0725e0 0x7fb6ec074aa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0b0000 tx=0x7fb6fc01c380 comp rx=0 tx=0).stop 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c0b2fe0 msgr2=0x7fb70c143710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c0b2fe0 0x7fb70c143710 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c490 tx=0x7fb6f800c950 comp rx=0 tx=0).stop 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 shutdown_connections 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb6ec0725e0 0x7fb6ec074aa0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb70c15a3a0 0x7fb70c1f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb70c0b2fe0 0x7fb70c143710 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 --2- 172.21.15.17:0/1026864286 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb70c073280 0x7fb70c147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 >> 172.21.15.17:0/1026864286 conn(0x7fb70c0b17a0 msgr2=0x7fb70c1512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 shutdown_connections 2024-09-10T23:28:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.596+0000 7fb713000640 1 -- 172.21.15.17:0/1026864286 wait complete. 2024-09-10T23:28:23.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:28:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.816+0000 7f4a23400640 1 -- 172.21.15.17:0/731667117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c15f600 msgr2=0x7f4a1c0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:23.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.816+0000 7f4a23400640 1 --2- 172.21.15.17:0/731667117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c15f600 0x7f4a1c0cc900 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009840 tx=0x7f4a1001c820 comp rx=0 tx=0).stop 2024-09-10T23:28:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.816+0000 7f4a23400640 1 -- 172.21.15.17:0/731667117 shutdown_connections 2024-09-10T23:28:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.816+0000 7f4a23400640 1 --2- 172.21.15.17:0/731667117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c15f600 0x7f4a1c0cc900 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.816+0000 7f4a23400640 1 -- 172.21.15.17:0/731667117 >> 172.21.15.17:0/731667117 conn(0x7f4a1c09b080 msgr2=0x7f4a1c0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.816+0000 7f4a23400640 1 -- 172.21.15.17:0/731667117 shutdown_connections 2024-09-10T23:28:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.816+0000 7f4a23400640 1 -- 172.21.15.17:0/731667117 wait complete. 2024-09-10T23:28:23.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a23400640 1 Processor -- start 2024-09-10T23:28:23.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a23400640 1 -- start start 2024-09-10T23:28:23.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a23400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a1c0b0990 0x7f4a1c15d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a23400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c0b28e0 0x7f4a1c14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a23400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a1c15f600 0x7f4a1c150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a23400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c0cd1d0 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a23400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c0cd050 con 0x7f4a1c15f600 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a23400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1c16a3d0 con 0x7f4a1c0b0990 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a1be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c0b28e0 0x7f4a1c14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a1be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c0b28e0 0x7f4a1c14ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49848/0 (socket says 172.21.15.17:49848) 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a1be00640 1 -- 172.21.15.17:0/2462442500 learned_addr learned my addr 172.21.15.17:0/2462442500 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a20a00640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a1c0b0990 0x7f4a1c15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a21400640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a1c15f600 0x7f4a1c150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:23.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a1be00640 1 -- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a1c0b0990 msgr2=0x7f4a1c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a1be00640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a1c0b0990 0x7f4a1c15d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a1be00640 1 -- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a1c15f600 msgr2=0x7f4a1c150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a1be00640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a1c15f600 0x7f4a1c150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a1be00640 1 -- 172.21.15.17:0/2462442500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c151f50 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a1be00640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c0b28e0 0x7f4a1c14ed00 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c510 tx=0x7f4a0800c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a18c00640 1 -- 172.21.15.17:0/2462442500 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a080052d0 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a18c00640 1 -- 172.21.15.17:0/2462442500 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a08005470 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.820+0000 7f4a18c00640 1 -- 172.21.15.17:0/2462442500 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08012870 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.824+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c06dee0 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.824+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1524d0 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.824+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1c0cc900 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.824+0000 7f4a18c00640 1 -- 172.21.15.17:0/2462442500 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4a08003600 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.824+0000 7f4a18c00640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49fc072610 0x7f49fc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:23.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.824+0000 7f4a18c00640 1 -- 172.21.15.17:0/2462442500 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 6273+0+0 (secure 0 0 0) 0x7f4a08092f80 con 0x7f4a1c0b28e0 2024-09-10T23:28:23.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.824+0000 7f4a20a00640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49fc072610 0x7f49fc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:23.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.828+0000 7f4a20a00640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49fc072610 0x7f49fc074ad0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4a100af000 tx=0x7f4a1001b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:23.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:23.828+0000 7f4a18c00640 1 -- 172.21.15.17:0/2462442500 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4a0805dd30 con 0x7f4a1c0b28e0 2024-09-10T23:28:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.008+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4a1c0b1430 con 0x7f4a1c0b28e0 2024-09-10T23:28:24.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.876+0000 7f4a18c00640 1 -- 172.21.15.17:0/2462442500 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v169) ==== 181+0+0 (secure 0 0 0) 0x7f4a08062760 con 0x7f4a1c0b28e0 2024-09-10T23:28:24.881 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:28:24.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49fc072610 msgr2=0x7f49fc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:24.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49fc072610 0x7f49fc074ad0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4a100af000 tx=0x7f4a1001b060 comp rx=0 tx=0).stop 2024-09-10T23:28:24.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c0b28e0 msgr2=0x7f4a1c14ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:24.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c0b28e0 0x7f4a1c14ed00 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c510 tx=0x7f4a0800c9d0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 shutdown_connections 2024-09-10T23:28:24.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f49fc072610 0x7f49fc074ad0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a1c15f600 0x7f4a1c150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a1c0b28e0 0x7f4a1c14ed00 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 --2- 172.21.15.17:0/2462442500 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a1c0b0990 0x7f4a1c15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:24.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 >> 172.21.15.17:0/2462442500 conn(0x7f4a1c09b080 msgr2=0x7f4a1c0d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:24.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 shutdown_connections 2024-09-10T23:28:24.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:24.880+0000 7f4a23400640 1 -- 172.21.15.17:0/2462442500 wait complete. 2024-09-10T23:28:24.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:28:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.064+0000 7f1618800640 1 -- 172.21.15.17:0/2454430816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8004d50 msgr2=0x7f15f80051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:25.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.064+0000 7f1618800640 1 --2- 172.21.15.17:0/2454430816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8004d50 0x7f15f80051b0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f16100cf270 tx=0x7f160c01caf0 comp rx=0 tx=0).stop 2024-09-10T23:28:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.064+0000 7f1616800640 1 -- 172.21.15.17:0/2454430816 reap_dead start 2024-09-10T23:28:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.064+0000 7f1618800640 1 -- 172.21.15.17:0/2454430816 shutdown_connections 2024-09-10T23:28:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.064+0000 7f1618800640 1 -- 172.21.15.17:0/2454430816 >> 172.21.15.17:0/2454430816 conn(0x7f161009b040 msgr2=0x7f16100d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.064+0000 7f1618800640 1 -- 172.21.15.17:0/2454430816 shutdown_connections 2024-09-10T23:28:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.064+0000 7f1618800640 1 -- 172.21.15.17:0/2454430816 wait complete. 2024-09-10T23:28:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.064+0000 7f1618800640 1 Processor -- start 2024-09-10T23:28:25.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.064+0000 7f1618800640 1 -- start start 2024-09-10T23:28:25.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1618800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8004d50 0x7f1610157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1618800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16100b75d0 0x7f16101e5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1618800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16101e5590 0x7f16100b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1618800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f16100d29a0 con 0x7f15f8004d50 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1618800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f16100d2820 con 0x7f16100b75d0 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1618800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f16100ce350 con 0x7f16101e5590 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1615e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8004d50 0x7f1610157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1615e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8004d50 0x7f1610157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49866/0 (socket says 172.21.15.17:49866) 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1615e00640 1 -- 172.21.15.17:0/38413489 learned_addr learned my addr 172.21.15.17:0/38413489 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1615e00640 1 -- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16101e5590 msgr2=0x7f16100b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1615e00640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16101e5590 0x7f16100b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:25.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1615e00640 1 -- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16100b75d0 msgr2=0x7f16101e5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:25.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1615e00640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16100b75d0 0x7f16101e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:25.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1615e00640 1 -- 172.21.15.17:0/38413489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16101e5a10 con 0x7f15f8004d50 2024-09-10T23:28:25.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1615e00640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8004d50 0x7f1610157d90 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f1604006680 tx=0x7f1604001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:25.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f160a000640 1 -- 172.21.15.17:0/38413489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604015070 con 0x7f15f8004d50 2024-09-10T23:28:25.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f160a000640 1 -- 172.21.15.17:0/38413489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1604011940 con 0x7f15f8004d50 2024-09-10T23:28:25.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f160a000640 1 -- 172.21.15.17:0/38413489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604011d90 con 0x7f15f8004d50 2024-09-10T23:28:25.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16101e5cf0 con 0x7f15f8004d50 2024-09-10T23:28:25.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101e8110 con 0x7f15f8004d50 2024-09-10T23:28:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16100ce550 con 0x7f15f8004d50 2024-09-10T23:28:25.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.068+0000 7f160a000640 1 -- 172.21.15.17:0/38413489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f16040103c0 con 0x7f15f8004d50 2024-09-10T23:28:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.072+0000 7f160a000640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f15f4072640 0x7f15f4074b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.072+0000 7f160a000640 1 -- 172.21.15.17:0/38413489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5835+0+0 (secure 0 0 0) 0x7f1604094310 con 0x7f15f8004d50 2024-09-10T23:28:25.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.072+0000 7f1615400640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f15f4072640 0x7f15f4074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:25.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.072+0000 7f1615400640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f15f4072640 0x7f15f4074b00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f16100b79f0 tx=0x7f1600009670 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:25.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.076+0000 7f160a000640 1 -- 172.21.15.17:0/38413489 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f160405f960 con 0x7f15f8004d50 2024-09-10T23:28:25.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.248+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f16101ea170 con 0x7f15f8004d50 2024-09-10T23:28:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.876+0000 7f160a000640 1 -- 172.21.15.17:0/38413489 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v170) ==== 169+0+0 (secure 0 0 0) 0x7f160405f260 con 0x7f15f8004d50 2024-09-10T23:28:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f15f4072640 msgr2=0x7f15f4074b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f15f4072640 0x7f15f4074b00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f16100b79f0 tx=0x7f1600009670 comp rx=0 tx=0).stop 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8004d50 msgr2=0x7f1610157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8004d50 0x7f1610157d90 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f1604006680 tx=0x7f1604001850 comp rx=0 tx=0).stop 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 shutdown_connections 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f15f4072640 0x7f15f4074b00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f16101e5590 0x7f16100b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16100b75d0 0x7f16101e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 --2- 172.21.15.17:0/38413489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8004d50 0x7f1610157d90 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.880+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 >> 172.21.15.17:0/38413489 conn(0x7f161009b040 msgr2=0x7f16101ea670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:25.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.884+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 shutdown_connections 2024-09-10T23:28:25.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:25.884+0000 7f1618800640 1 -- 172.21.15.17:0/38413489 wait complete. 2024-09-10T23:28:25.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:28:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.064+0000 7f1776a00640 1 -- 172.21.15.17:0/3461097695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f177006e2e0 msgr2=0x7f17700701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.064+0000 7f1776a00640 1 --2- 172.21.15.17:0/3461097695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f177006e2e0 0x7f17700701c0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f17700b3090 tx=0x7f176801ccc0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.064+0000 7f1776a00640 1 -- 172.21.15.17:0/3461097695 shutdown_connections 2024-09-10T23:28:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.064+0000 7f1776a00640 1 --2- 172.21.15.17:0/3461097695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f177006e2e0 0x7f17700701c0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.064+0000 7f1776a00640 1 --2- 172.21.15.17:0/3461097695 >> v2:172.21.15.77:3300/0 conn(0x7f177015ab90 0x7f17700691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.064+0000 7f1776a00640 1 -- 172.21.15.17:0/3461097695 >> 172.21.15.17:0/3461097695 conn(0x7f1770072f80 msgr2=0x7f1770073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:26.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.064+0000 7f1776a00640 1 -- 172.21.15.17:0/3461097695 shutdown_connections 2024-09-10T23:28:26.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.064+0000 7f1776a00640 1 -- 172.21.15.17:0/3461097695 wait complete. 2024-09-10T23:28:26.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1776a00640 1 Processor -- start 2024-09-10T23:28:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1776a00640 1 -- start start 2024-09-10T23:28:26.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1776a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f177006e2e0 0x7f17701faf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1776a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17700cf000 0x7f17701f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1776a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177015ab90 0x7f17700b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1776a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1770167850 con 0x7f17700cf000 2024-09-10T23:28:26.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1776a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17701676d0 con 0x7f177006e2e0 2024-09-10T23:28:26.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1776a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f17701679d0 con 0x7f177015ab90 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1774a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177015ab90 0x7f17700b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f176f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17700cf000 0x7f17701f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1774a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177015ab90 0x7f17700b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:33138/0 (socket says 172.21.15.17:33138) 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.068+0000 7f1774a00640 1 -- 172.21.15.17:0/3628655927 learned_addr learned my addr 172.21.15.17:0/3628655927 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f176fe00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f177006e2e0 0x7f17701faf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1774a00640 1 -- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f177006e2e0 msgr2=0x7f17701faf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1774a00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f177006e2e0 0x7f17701faf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1774a00640 1 -- 172.21.15.17:0/3628655927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17700cf000 msgr2=0x7f17701f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1774a00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17700cf000 0x7f17701f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1774a00640 1 -- 172.21.15.17:0/3628655927 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17701fb5a0 con 0x7f177015ab90 2024-09-10T23:28:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f176f400640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17700cf000 0x7f17701f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1774a00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177015ab90 0x7f17700b5310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1768009bd0 tx=0x7f1768009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1767e00640 1 -- 172.21.15.17:0/3628655927 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17680b2040 con 0x7f177015ab90 2024-09-10T23:28:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1767e00640 1 -- 172.21.15.17:0/3628655927 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1768004200 con 0x7f177015ab90 2024-09-10T23:28:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1767e00640 1 -- 172.21.15.17:0/3628655927 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768004610 con 0x7f177015ab90 2024-09-10T23:28:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17701fb880 con 0x7f177015ab90 2024-09-10T23:28:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1770158d20 con 0x7f177015ab90 2024-09-10T23:28:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.072+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17700701c0 con 0x7f177015ab90 2024-09-10T23:28:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.076+0000 7f1767e00640 1 -- 172.21.15.17:0/3628655927 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f17680b5070 con 0x7f177015ab90 2024-09-10T23:28:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.076+0000 7f1767e00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1750072630 0x7f1750074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.076+0000 7f1767e00640 1 -- 172.21.15.17:0/3628655927 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f176812d2e0 con 0x7f177015ab90 2024-09-10T23:28:26.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.076+0000 7f176fe00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1750072630 0x7f1750074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.076+0000 7f176fe00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1750072630 0x7f1750074af0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1760009b40 tx=0x7f17600091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:26.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.080+0000 7f1767e00640 1 -- 172.21.15.17:0/3628655927 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1768016970 con 0x7f177015ab90 2024-09-10T23:28:26.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.260+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f17701524e0 con 0x7f177015ab90 2024-09-10T23:28:26.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1767e00640 1 -- 172.21.15.17:0/3628655927 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v55) ==== 71+0+0 (secure 0 0 0) 0x7f17680f8500 con 0x7f177015ab90 2024-09-10T23:28:26.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1750072630 msgr2=0x7f1750074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1750072630 0x7f1750074af0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1760009b40 tx=0x7f17600091e0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177015ab90 msgr2=0x7f17700b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177015ab90 0x7f17700b5310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1768009bd0 tx=0x7f1768009340 comp rx=0 tx=0).stop 2024-09-10T23:28:26.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 shutdown_connections 2024-09-10T23:28:26.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1750072630 0x7f1750074af0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f177015ab90 0x7f17700b5310 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17700cf000 0x7f17701f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 --2- 172.21.15.17:0/3628655927 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f177006e2e0 0x7f17701faf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 >> 172.21.15.17:0/3628655927 conn(0x7f1770072f80 msgr2=0x7f1770156fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:26.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 shutdown_connections 2024-09-10T23:28:26.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.268+0000 7f1776a00640 1 -- 172.21.15.17:0/3628655927 wait complete. 2024-09-10T23:28:26.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-10T23:28:26.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 -- 172.21.15.17:0/2210685272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 msgr2=0x7f94280b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 --2- 172.21.15.17:0/2210685272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 0x7f94280b3130 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f94280b0e70 tx=0x7f941801c770 comp rx=0 tx=0).stop 2024-09-10T23:28:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 -- 172.21.15.17:0/2210685272 shutdown_connections 2024-09-10T23:28:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 --2- 172.21.15.17:0/2210685272 >> v2:172.21.15.77:3300/0 conn(0x7f942815f730 0x7f94280ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 --2- 172.21.15.17:0/2210685272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 0x7f94280b3130 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 -- 172.21.15.17:0/2210685272 >> 172.21.15.17:0/2210685272 conn(0x7f94280d1d10 msgr2=0x7f94280d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 -- 172.21.15.17:0/2210685272 shutdown_connections 2024-09-10T23:28:26.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 -- 172.21.15.17:0/2210685272 wait complete. 2024-09-10T23:28:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 Processor -- start 2024-09-10T23:28:26.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 -- start start 2024-09-10T23:28:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94280cec60 0x7f94280cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 0x7f942815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942815f730 0x7f942806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9428168f60 con 0x7f942815f350 2024-09-10T23:28:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9428168de0 con 0x7f94280cec60 2024-09-10T23:28:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f942ea00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f94281690e0 con 0x7f942815f730 2024-09-10T23:28:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f941fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 0x7f942815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f941fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 0x7f942815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49900/0 (socket says 172.21.15.17:49900) 2024-09-10T23:28:26.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.444+0000 7f941fe00640 1 -- 172.21.15.17:0/1905451152 learned_addr learned my addr 172.21.15.17:0/1905451152 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f9427e00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94280cec60 0x7f94280cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f942ca00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942815f730 0x7f942806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f941fe00640 1 -- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942815f730 msgr2=0x7f942806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f941fe00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942815f730 0x7f942806efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f941fe00640 1 -- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94280cec60 msgr2=0x7f94280cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f941fe00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94280cec60 0x7f94280cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f941fe00640 1 -- 172.21.15.17:0/1905451152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94280b5ba0 con 0x7f942815f350 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f942ca00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942815f730 0x7f942806efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f941fe00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 0x7f942815d020 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f941000d750 tx=0x7f941000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f9424c00640 1 -- 172.21.15.17:0/1905451152 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410017070 con 0x7f942815f350 2024-09-10T23:28:26.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f9424c00640 1 -- 172.21.15.17:0/1905451152 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9410009d20 con 0x7f942815f350 2024-09-10T23:28:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94280b5080 con 0x7f942815f350 2024-09-10T23:28:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f9424c00640 1 -- 172.21.15.17:0/1905451152 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941000de60 con 0x7f942815f350 2024-09-10T23:28:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94280b58c0 con 0x7f942815f350 2024-09-10T23:28:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94280b3130 con 0x7f942815f350 2024-09-10T23:28:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f9424c00640 1 -- 172.21.15.17:0/1905451152 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9410004280 con 0x7f942815f350 2024-09-10T23:28:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.448+0000 7f9424c00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.452+0000 7f9424c00640 1 -- 172.21.15.17:0/1905451152 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f94100935d0 con 0x7f942815f350 2024-09-10T23:28:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.452+0000 7f9427e00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:26.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.452+0000 7f9427e00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f94180af000 tx=0x7f941801afb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:26.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.456+0000 7f9424c00640 1 -- 172.21.15.17:0/1905451152 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9410020020 con 0x7f942815f350 2024-09-10T23:28:26.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.712+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f94280b5360 con 0x7f942815f350 2024-09-10T23:28:26.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f9424c00640 1 -- 172.21.15.17:0/1905451152 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v598) ==== 166+0+0 (secure 0 0 0) 0x7f94280b5080 con 0x7f942815f350 2024-09-10T23:28:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 msgr2=0x7f9404074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f94180af000 tx=0x7f941801afb0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 msgr2=0x7f942815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 0x7f942815d020 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f941000d750 tx=0x7f941000dc10 comp rx=0 tx=0).stop 2024-09-10T23:28:26.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 shutdown_connections 2024-09-10T23:28:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942815f730 0x7f942806efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942815f350 0x7f942815d020 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 --2- 172.21.15.17:0/1905451152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94280cec60 0x7f94280cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 >> 172.21.15.17:0/1905451152 conn(0x7f94280d1d10 msgr2=0x7f942815ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 shutdown_connections 2024-09-10T23:28:26.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:26.888+0000 7f942ea00640 1 -- 172.21.15.17:0/1905451152 wait complete. 2024-09-10T23:28:26.915 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T23:28:26.916 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T23:28:26.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:28:27.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.056+0000 7f0038a00640 1 -- 172.21.15.17:0/690140803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340b32d0 msgr2=0x7f0034150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.056+0000 7f0038a00640 1 --2- 172.21.15.17:0/690140803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340b32d0 0x7f0034150d70 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f00340d09a0 tx=0x7f002c01f580 comp rx=0 tx=0).stop 2024-09-10T23:28:27.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.056+0000 7f0038a00640 1 -- 172.21.15.17:0/690140803 shutdown_connections 2024-09-10T23:28:27.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.056+0000 7f0038a00640 1 --2- 172.21.15.17:0/690140803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340b32d0 0x7f0034150d70 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.056+0000 7f0038a00640 1 --2- 172.21.15.17:0/690140803 >> v2:172.21.15.77:3300/0 conn(0x7f00340cf610 0x7f003415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.056+0000 7f0038a00640 1 --2- 172.21.15.17:0/690140803 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00340cf230 0x7f003406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.056+0000 7f0038a00640 1 -- 172.21.15.17:0/690140803 >> 172.21.15.17:0/690140803 conn(0x7f003406cfc0 msgr2=0x7f003406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:27.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.056+0000 7f0038a00640 1 -- 172.21.15.17:0/690140803 shutdown_connections 2024-09-10T23:28:27.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.056+0000 7f0038a00640 1 -- 172.21.15.17:0/690140803 wait complete. 2024-09-10T23:28:27.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 Processor -- start 2024-09-10T23:28:27.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 -- start start 2024-09-10T23:28:27.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00340b32d0 0x7f0034149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00340cf230 0x7f00340cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340cf610 0x7f00340ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f00340d0120 con 0x7f00340cf610 2024-09-10T23:28:27.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f00340cffa0 con 0x7f00340cf230 2024-09-10T23:28:27.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f00340d02a0 con 0x7f00340b32d0 2024-09-10T23:28:27.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0032800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340cf610 0x7f00340ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0032800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340cf610 0x7f00340ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60166/0 (socket says 172.21.15.17:60166) 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0032800640 1 -- 172.21.15.17:0/1247655336 learned_addr learned my addr 172.21.15.17:0/1247655336 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0031e00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00340b32d0 0x7f0034149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f002be00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00340cf230 0x7f00340cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0032800640 1 -- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00340b32d0 msgr2=0x7f0034149380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0032800640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00340b32d0 0x7f0034149380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0032800640 1 -- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00340cf230 msgr2=0x7f00340cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0032800640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00340cf230 0x7f00340cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0032800640 1 -- 172.21.15.17:0/1247655336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003414f0b0 con 0x7f00340cf610 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0032800640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340cf610 0x7f00340ccc30 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f002c0b3040 tx=0x7f002c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f002a000640 1 -- 172.21.15.17:0/1247655336 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0bf070 con 0x7f00340cf610 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f002a000640 1 -- 172.21.15.17:0/1247655336 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f002c004b40 con 0x7f00340cf610 2024-09-10T23:28:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f002a000640 1 -- 172.21.15.17:0/1247655336 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0b5040 con 0x7f00340cf610 2024-09-10T23:28:27.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003415a090 con 0x7f00340cf610 2024-09-10T23:28:27.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.060+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00341498c0 con 0x7f00340cf610 2024-09-10T23:28:27.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.064+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003406e750 con 0x7f00340cf610 2024-09-10T23:28:27.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.064+0000 7f002a000640 1 -- 172.21.15.17:0/1247655336 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f002c0b8070 con 0x7f00340cf610 2024-09-10T23:28:27.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.064+0000 7f002a000640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00100725e0 0x7f0010074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.064+0000 7f002a000640 1 -- 172.21.15.17:0/1247655336 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f002c12ff80 con 0x7f00340cf610 2024-09-10T23:28:27.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.064+0000 7f0031e00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00100725e0 0x7f0010074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.068+0000 7f0031e00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00100725e0 0x7f0010074aa0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f003414e990 tx=0x7f00240091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:27.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.068+0000 7f002a000640 1 -- 172.21.15.17:0/1247655336 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f002c0190e0 con 0x7f00340cf610 2024-09-10T23:28:27.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.244+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0034072a60 con 0x7f00340cf610 2024-09-10T23:28:27.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f002a000640 1 -- 172.21.15.17:0/1247655336 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+13385 (secure 0 0 0) 0x7f002c0fb090 con 0x7f00340cf610 2024-09-10T23:28:27.252 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:27.252 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":170,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:28:25.882301+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6834/3935334503":"2024-09-11T23:28:22.596717+0000","172.21.15.17:6832/3935334503":"2024-09-11T23:28:22.596717+0000","172.21.15.17:6835/3026129347":"2024-09-11T23:28:10.820527+0000","172.21.15.17:6833/3026129347":"2024-09-11T23:28:10.820527+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:28:27.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00100725e0 msgr2=0x7f0010074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00100725e0 0x7f0010074aa0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f003414e990 tx=0x7f00240091e0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340cf610 msgr2=0x7f00340ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340cf610 0x7f00340ccc30 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f002c0b3040 tx=0x7f002c003f40 comp rx=0 tx=0).stop 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 shutdown_connections 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f00100725e0 0x7f0010074aa0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00340cf610 0x7f00340ccc30 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00340cf230 0x7f00340cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 --2- 172.21.15.17:0/1247655336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f00340b32d0 0x7f0034149380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 >> 172.21.15.17:0/1247655336 conn(0x7f003406cfc0 msgr2=0x7f0034150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 shutdown_connections 2024-09-10T23:28:27.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.248+0000 7f0038a00640 1 -- 172.21.15.17:0/1247655336 wait complete. 2024-09-10T23:28:27.275 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:28:27.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:28:27.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.420+0000 7f234fa00640 1 -- 172.21.15.17:0/3202222847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2330003a10 msgr2=0x7f2330003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.420+0000 7f234fa00640 1 --2- 172.21.15.17:0/3202222847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2330003a10 0x7f2330003e30 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f233c009b90 tx=0x7f233c01d270 comp rx=0 tx=0).stop 2024-09-10T23:28:27.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.420+0000 7f234da00640 1 -- 172.21.15.17:0/3202222847 reap_dead start 2024-09-10T23:28:27.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.420+0000 7f234fa00640 1 -- 172.21.15.17:0/3202222847 shutdown_connections 2024-09-10T23:28:27.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.420+0000 7f234fa00640 1 -- 172.21.15.17:0/3202222847 >> 172.21.15.17:0/3202222847 conn(0x7f234809a9f0 msgr2=0x7f234809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:27.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.420+0000 7f234fa00640 1 -- 172.21.15.17:0/3202222847 shutdown_connections 2024-09-10T23:28:27.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.420+0000 7f234fa00640 1 -- 172.21.15.17:0/3202222847 wait complete. 2024-09-10T23:28:27.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 Processor -- start 2024-09-10T23:28:27.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 -- start start 2024-09-10T23:28:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2330003a10 0x7f23480c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23480b0940 0x7f23481f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23480b3520 0x7f234806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2348166af0 con 0x7f2330003a10 2024-09-10T23:28:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2348072350 con 0x7f23480b3520 2024-09-10T23:28:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2348166c70 con 0x7f23480b0940 2024-09-10T23:28:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2330003a10 0x7f23480c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2330003a10 0x7f23480c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60188/0 (socket says 172.21.15.17:60188) 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234d000640 1 -- 172.21.15.17:0/3824487186 learned_addr learned my addr 172.21.15.17:0/3824487186 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234da00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23480b3520 0x7f234806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f2347e00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23480b0940 0x7f23481f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234d000640 1 -- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23480b0940 msgr2=0x7f23481f84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234d000640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23480b0940 0x7f23481f84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234d000640 1 -- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23480b3520 msgr2=0x7f234806f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234d000640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23480b3520 0x7f234806f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234d000640 1 -- 172.21.15.17:0/3824487186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23480ccd90 con 0x7f2330003a10 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234d000640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2330003a10 0x7f23480c8010 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f233c0af040 tx=0x7f233c005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f2344c00640 1 -- 172.21.15.17:0/3824487186 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c0b1040 con 0x7f2330003a10 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f2344c00640 1 -- 172.21.15.17:0/3824487186 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f233c0bb070 con 0x7f2330003a10 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f2344c00640 1 -- 172.21.15.17:0/3824487186 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c004290 con 0x7f2330003a10 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23480b3e70 con 0x7f2330003a10 2024-09-10T23:28:27.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23481f7ca0 con 0x7f2330003a10 2024-09-10T23:28:27.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.424+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23480cf5c0 con 0x7f2330003a10 2024-09-10T23:28:27.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.428+0000 7f2344c00640 1 -- 172.21.15.17:0/3824487186 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f233c0046d0 con 0x7f2330003a10 2024-09-10T23:28:27.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.428+0000 7f2344c00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2328072610 0x7f2328074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.428+0000 7f2344c00640 1 -- 172.21.15.17:0/3824487186 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f233c12dfd0 con 0x7f2330003a10 2024-09-10T23:28:27.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.428+0000 7f2347e00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2328072610 0x7f2328074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.428+0000 7f2347e00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2328072610 0x7f2328074ad0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2334001870 tx=0x7f2334006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:27.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.432+0000 7f2344c00640 1 -- 172.21.15.17:0/3824487186 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f233c016fc0 con 0x7f2330003a10 2024-09-10T23:28:27.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.604+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f23480b4390 con 0x7f2330003a10 2024-09-10T23:28:27.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f2344c00640 1 -- 172.21.15.17:0/3824487186 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) ==== 93+0+10 (secure 0 0 0) 0x7f233c1000c0 con 0x7f2330003a10 2024-09-10T23:28:27.612 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:28:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2328072610 msgr2=0x7f2328074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2328072610 0x7f2328074ad0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2334001870 tx=0x7f2334006040 comp rx=0 tx=0).stop 2024-09-10T23:28:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2330003a10 msgr2=0x7f23480c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2330003a10 0x7f23480c8010 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f233c0af040 tx=0x7f233c005590 comp rx=0 tx=0).stop 2024-09-10T23:28:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 shutdown_connections 2024-09-10T23:28:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2328072610 0x7f2328074ad0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23480b3520 0x7f234806f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23480b0940 0x7f23481f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 --2- 172.21.15.17:0/3824487186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2330003a10 0x7f23480c8010 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 >> 172.21.15.17:0/3824487186 conn(0x7f234809a9f0 msgr2=0x7f23480d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:27.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 shutdown_connections 2024-09-10T23:28:27.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.608+0000 7f234fa00640 1 -- 172.21.15.17:0/3824487186 wait complete. 2024-09-10T23:28:27.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-10T23:28:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 -- 172.21.15.17:0/2169959071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc15ba80 msgr2=0x7f62bc160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 --2- 172.21.15.17:0/2169959071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc15ba80 0x7f62bc160140 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009840 tx=0x7f62b001c7f0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 -- 172.21.15.17:0/2169959071 shutdown_connections 2024-09-10T23:28:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 --2- 172.21.15.17:0/2169959071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc15ba80 0x7f62bc160140 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 -- 172.21.15.17:0/2169959071 >> 172.21.15.17:0/2169959071 conn(0x7f62bc09b2a0 msgr2=0x7f62bc08bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:27.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 -- 172.21.15.17:0/2169959071 shutdown_connections 2024-09-10T23:28:27.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 -- 172.21.15.17:0/2169959071 wait complete. 2024-09-10T23:28:27.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 Processor -- start 2024-09-10T23:28:27.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 -- start start 2024-09-10T23:28:27.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62bc071380 0x7f62bc1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc0cc740 0x7f62bc0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62bc15ba80 0x7f62bc1fb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc169cb0 con 0x7f62bc0cc740 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc169b30 con 0x7f62bc15ba80 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.776+0000 7f62c3c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc169e30 con 0x7f62bc071380 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc0cc740 0x7f62bc0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc0cc740 0x7f62bc0c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60206/0 (socket says 172.21.15.17:60206) 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62c1200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62bc071380 0x7f62bc1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62bbe00640 1 -- 172.21.15.17:0/3610631772 learned_addr learned my addr 172.21.15.17:0/3610631772 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62c1c00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62bc15ba80 0x7f62bc1fb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62bbe00640 1 -- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62bc071380 msgr2=0x7f62bc1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62bbe00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62bc071380 0x7f62bc1573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62bbe00640 1 -- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62bc15ba80 msgr2=0x7f62bc1fb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62bbe00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62bc15ba80 0x7f62bc1fb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62bbe00640 1 -- 172.21.15.17:0/3610631772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc075ed0 con 0x7f62bc0cc740 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62bbe00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc0cc740 0x7f62bc0c6a60 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f62a8007fd0 tx=0x7f62a800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62b8c00640 1 -- 172.21.15.17:0/3610631772 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8017070 con 0x7f62bc0cc740 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62b8c00640 1 -- 172.21.15.17:0/3610631772 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62a80053c0 con 0x7f62bc0cc740 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62b8c00640 1 -- 172.21.15.17:0/3610631772 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8003860 con 0x7f62bc0cc740 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62bc1fbe20 con 0x7f62bc0cc740 2024-09-10T23:28:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62bc0c6260 con 0x7f62bc0cc740 2024-09-10T23:28:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62bc160140 con 0x7f62bc0cc740 2024-09-10T23:28:27.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.780+0000 7f62b8c00640 1 -- 172.21.15.17:0/3610631772 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f62a8003a00 con 0x7f62bc0cc740 2024-09-10T23:28:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.784+0000 7f62b8c00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f629c0725e0 0x7f629c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.784+0000 7f62b8c00640 1 -- 172.21.15.17:0/3610631772 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f62a8092780 con 0x7f62bc0cc740 2024-09-10T23:28:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.784+0000 7f62c1200640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f629c0725e0 0x7f629c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.784+0000 7f62c1200640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f629c0725e0 0x7f629c074aa0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f62b00af000 tx=0x7f62b001b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:27.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:27.788+0000 7f62b8c00640 1 -- 172.21.15.17:0/3610631772 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f62a805d920 con 0x7f62bc0cc740 2024-09-10T23:28:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.024+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f62bc157930 con 0x7f62bc0cc740 2024-09-10T23:28:28.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.896+0000 7f62b8c00640 1 -- 172.21.15.17:0/3610631772 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v600) ==== 162+0+0 (secure 0 0 0) 0x7f62a8062350 con 0x7f62bc0cc740 2024-09-10T23:28:28.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.896+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f629c0725e0 msgr2=0x7f629c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.896+0000 7f62c3c00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f629c0725e0 0x7f629c074aa0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f62b00af000 tx=0x7f62b001b030 comp rx=0 tx=0).stop 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.896+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc0cc740 msgr2=0x7f62bc0c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.896+0000 7f62c3c00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc0cc740 0x7f62bc0c6a60 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f62a8007fd0 tx=0x7f62a800c890 comp rx=0 tx=0).stop 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.900+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 shutdown_connections 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.900+0000 7f62c3c00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f629c0725e0 0x7f629c074aa0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.900+0000 7f62c3c00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62bc15ba80 0x7f62bc1fb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.900+0000 7f62c3c00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62bc0cc740 0x7f62bc0c6a60 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.900+0000 7f62c3c00640 1 --2- 172.21.15.17:0/3610631772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62bc071380 0x7f62bc1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.900+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 >> 172.21.15.17:0/3610631772 conn(0x7f62bc09b2a0 msgr2=0x7f62bc1670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:28.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.900+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 shutdown_connections 2024-09-10T23:28:28.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:28.900+0000 7f62c3c00640 1 -- 172.21.15.17:0/3610631772 wait complete. 2024-09-10T23:28:28.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:28:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 -- 172.21.15.17:0/368454865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d000d2830 msgr2=0x7f9d000d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 --2- 172.21.15.17:0/368454865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d000d2830 0x7f9d000d0030 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f9d0006db00 tx=0x7f9cec01f0b0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 -- 172.21.15.17:0/368454865 shutdown_connections 2024-09-10T23:28:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 --2- 172.21.15.17:0/368454865 >> v2:172.21.15.77:3300/0 conn(0x7f9d00160660 0x7f9d000af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 --2- 172.21.15.17:0/368454865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d000d2830 0x7f9d000d0030 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 --2- 172.21.15.17:0/368454865 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d00160280 0x7f9d000cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 -- 172.21.15.17:0/368454865 >> 172.21.15.17:0/368454865 conn(0x7f9d000d1d10 msgr2=0x7f9d000d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 -- 172.21.15.17:0/368454865 shutdown_connections 2024-09-10T23:28:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 -- 172.21.15.17:0/368454865 wait complete. 2024-09-10T23:28:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 Processor -- start 2024-09-10T23:28:29.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 -- start start 2024-09-10T23:28:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.076+0000 7f9d08000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d000d2830 0x7f9d001f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d08000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d00160280 0x7f9d001f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d08000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160660 0x7f9d001f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d08000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000affb0 con 0x7f9d00160280 2024-09-10T23:28:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d08000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000afe30 con 0x7f9d00160660 2024-09-10T23:28:29.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d08000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9d000b0130 con 0x7f9d000d2830 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d04c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d00160280 0x7f9d001f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d04c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d00160280 0x7f9d001f7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60216/0 (socket says 172.21.15.17:60216) 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d04c00640 1 -- 172.21.15.17:0/2490615649 learned_addr learned my addr 172.21.15.17:0/2490615649 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d05600640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d000d2830 0x7f9d001f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d06000640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160660 0x7f9d001f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d04c00640 1 -- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d000d2830 msgr2=0x7f9d001f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d04c00640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d000d2830 0x7f9d001f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d04c00640 1 -- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160660 msgr2=0x7f9d001f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d04c00640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160660 0x7f9d001f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d04c00640 1 -- 172.21.15.17:0/2490615649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d000cc600 con 0x7f9d00160280 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d06000640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160660 0x7f9d001f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:29.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d04c00640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d00160280 0x7f9d001f7b60 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0b3040 tx=0x7f9cec005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9cfd600640 1 -- 172.21.15.17:0/2490615649 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0b5040 con 0x7f9d00160280 2024-09-10T23:28:29.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9cfd600640 1 -- 172.21.15.17:0/2490615649 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cec005320 con 0x7f9d00160280 2024-09-10T23:28:29.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9cfd600640 1 -- 172.21.15.17:0/2490615649 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0046d0 con 0x7f9d00160280 2024-09-10T23:28:29.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d000c9260 con 0x7f9d00160280 2024-09-10T23:28:29.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d000cf260 con 0x7f9d00160280 2024-09-10T23:28:29.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d00153a50 con 0x7f9d00160280 2024-09-10T23:28:29.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.080+0000 7f9cfd600640 1 -- 172.21.15.17:0/2490615649 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9cec004870 con 0x7f9d00160280 2024-09-10T23:28:29.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.084+0000 7f9cfd600640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ce00725e0 0x7f9ce0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.084+0000 7f9cfd600640 1 -- 172.21.15.17:0/2490615649 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7f9cec130780 con 0x7f9d00160280 2024-09-10T23:28:29.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.084+0000 7f9d05600640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ce00725e0 0x7f9ce0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.084+0000 7f9d05600640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ce00725e0 0x7f9ce0074aa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400bb70 tx=0x7f9cf400b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.088+0000 7f9cfd600640 1 -- 172.21.15.17:0/2490615649 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9d00153a50 con 0x7f9d00160280 2024-09-10T23:28:29.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.260+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f9d000b0650 con 0x7f9d00160280 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.260+0000 7f9cfd600640 1 -- 172.21.15.17:0/2490615649 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v55) ==== 59+0+1998 (secure 0 0 0) 0x7f9cec018c10 con 0x7f9d00160280 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:28:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:28:29.268 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:28:29.269 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:28:29.269 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:28:29.269 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:28:29.269 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:28:29.269 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:28:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ce00725e0 msgr2=0x7f9ce0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ce00725e0 0x7f9ce0074aa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400bb70 tx=0x7f9cf400b2e0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d00160280 msgr2=0x7f9d001f7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d00160280 0x7f9d001f7b60 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0b3040 tx=0x7f9cec005e10 comp rx=0 tx=0).stop 2024-09-10T23:28:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 shutdown_connections 2024-09-10T23:28:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ce00725e0 0x7f9ce0074aa0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160660 0x7f9d001f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d00160280 0x7f9d001f7b60 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 --2- 172.21.15.17:0/2490615649 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d000d2830 0x7f9d001f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 >> 172.21.15.17:0/2490615649 conn(0x7f9d000d1d10 msgr2=0x7f9d000cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 shutdown_connections 2024-09-10T23:28:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.264+0000 7f9d08000640 1 -- 172.21.15.17:0/2490615649 wait complete. 2024-09-10T23:28:29.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:28:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.432+0000 7fcab6e00640 1 -- 172.21.15.17:0/2989915701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94004da0 msgr2=0x7fca94005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.432+0000 7fcab6e00640 1 --2- 172.21.15.17:0/2989915701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94004da0 0x7fca94005220 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8001f50 tx=0x7fcaa801cc40 comp rx=0 tx=0).stop 2024-09-10T23:28:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.432+0000 7fcab4e00640 1 -- 172.21.15.17:0/2989915701 reap_dead start 2024-09-10T23:28:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.432+0000 7fcab6e00640 1 -- 172.21.15.17:0/2989915701 shutdown_connections 2024-09-10T23:28:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.432+0000 7fcab6e00640 1 -- 172.21.15.17:0/2989915701 >> 172.21.15.17:0/2989915701 conn(0x7fcab009a9f0 msgr2=0x7fcab009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.432+0000 7fcab6e00640 1 -- 172.21.15.17:0/2989915701 shutdown_connections 2024-09-10T23:28:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.432+0000 7fcab6e00640 1 -- 172.21.15.17:0/2989915701 wait complete. 2024-09-10T23:28:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 Processor -- start 2024-09-10T23:28:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 -- start start 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94004da0 0x7fcab01f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcab00c81d0 0x7fcab00b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcab00b4b70 0x7fcab00c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcab015f450 con 0x7fca94004da0 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcab015f2d0 con 0x7fcab00b4b70 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcab015f5d0 con 0x7fcab00c81d0 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaafe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94004da0 0x7fcab01f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaafe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94004da0 0x7fcab01f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60234/0 (socket says 172.21.15.17:60234) 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaafe00640 1 -- 172.21.15.17:0/73101230 learned_addr learned my addr 172.21.15.17:0/73101230 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab4e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcab00b4b70 0x7fcab00c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaa7e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcab00c81d0 0x7fcab00b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaafe00640 1 -- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcab00c81d0 msgr2=0x7fcab00b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaafe00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcab00c81d0 0x7fcab00b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaafe00640 1 -- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcab00b4b70 msgr2=0x7fcab00c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaafe00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcab00b4b70 0x7fcab00c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaafe00640 1 -- 172.21.15.17:0/73101230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab01f50c0 con 0x7fca94004da0 2024-09-10T23:28:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaafe00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94004da0 0x7fcab01f4a70 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0011b10 tx=0x7fcaa0009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaacc00640 1 -- 172.21.15.17:0/73101230 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa001e070 con 0x7fca94004da0 2024-09-10T23:28:29.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaacc00640 1 -- 172.21.15.17:0/73101230 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcaa0004050 con 0x7fca94004da0 2024-09-10T23:28:29.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcaacc00640 1 -- 172.21.15.17:0/73101230 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa000fea0 con 0x7fca94004da0 2024-09-10T23:28:29.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab01f53a0 con 0x7fca94004da0 2024-09-10T23:28:29.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.436+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab01f5960 con 0x7fca94004da0 2024-09-10T23:28:29.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.440+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab015fb60 con 0x7fca94004da0 2024-09-10T23:28:29.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.440+0000 7fcaacc00640 1 -- 172.21.15.17:0/73101230 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcaa0003600 con 0x7fca94004da0 2024-09-10T23:28:29.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.440+0000 7fcaacc00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca8c0725e0 0x7fca8c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:29.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.440+0000 7fcaacc00640 1 -- 172.21.15.17:0/73101230 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7fcaa0093f80 con 0x7fca94004da0 2024-09-10T23:28:29.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.440+0000 7fcaa7e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca8c0725e0 0x7fca8c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:29.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.440+0000 7fcaa7e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca8c0725e0 0x7fca8c074aa0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fca98001420 tx=0x7fca98001370 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:29.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.444+0000 7fcaacc00640 1 -- 172.21.15.17:0/73101230 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcaa005f150 con 0x7fca94004da0 2024-09-10T23:28:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.620+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcab0160a60 con 0x7fca94004da0 2024-09-10T23:28:29.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.620+0000 7fcaacc00640 1 -- 172.21.15.17:0/73101230 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v56)=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7fcaa0063b80 con 0x7fca94004da0 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca8c0725e0 msgr2=0x7fca8c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca8c0725e0 0x7fca8c074aa0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fca98001420 tx=0x7fca98001370 comp rx=0 tx=0).stop 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94004da0 msgr2=0x7fcab01f4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94004da0 0x7fcab01f4a70 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0011b10 tx=0x7fcaa0009ea0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 shutdown_connections 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fca8c0725e0 0x7fca8c074aa0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcab00b4b70 0x7fcab00c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcab00c81d0 0x7fcab00b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 --2- 172.21.15.17:0/73101230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca94004da0 0x7fcab01f4a70 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 >> 172.21.15.17:0/73101230 conn(0x7fcab009a9f0 msgr2=0x7fcab00b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:29.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 shutdown_connections 2024-09-10T23:28:29.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:29.624+0000 7fcab6e00640 1 -- 172.21.15.17:0/73101230 wait complete. 2024-09-10T23:28:29.649 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:28:29.650 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:28:29.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:28:29.832 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:28:29.832 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:28:29.832 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:29.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:28:29.841 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:28:29.841 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:29.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:28:29.851 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:28:29.851 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:29.891 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:28:29.892 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:28:29.892 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:28:29.901 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:28:29.901 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:28:29.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 -- 172.21.15.17:0/1298501204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 msgr2=0x7fc9bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 --2- 172.21.15.17:0/1298501204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 0x7fc9bc004c90 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0001ec0 tx=0x7fc9c001cec0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 -- 172.21.15.17:0/1298501204 shutdown_connections 2024-09-10T23:28:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 --2- 172.21.15.17:0/1298501204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 0x7fc9bc004c90 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 -- 172.21.15.17:0/1298501204 >> 172.21.15.17:0/1298501204 conn(0x7fc9d406cfc0 msgr2=0x7fc9d406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 -- 172.21.15.17:0/1298501204 shutdown_connections 2024-09-10T23:28:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 -- 172.21.15.17:0/1298501204 wait complete. 2024-09-10T23:28:30.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 Processor -- start 2024-09-10T23:28:30.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 -- start start 2024-09-10T23:28:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 0x7fc9d4145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d41f6720 0x7fc9d41539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9d414efb0 0x7fc9d414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d415b5d0 con 0x7fc9bc004810 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d415b450 con 0x7fc9d41f6720 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9dc000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d415b750 con 0x7fc9d414efb0 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9d9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 0x7fc9d4145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9d9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 0x7fc9d4145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60254/0 (socket says 172.21.15.17:60254) 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.080+0000 7fc9d9600640 1 -- 172.21.15.17:0/2282786612 learned_addr learned my addr 172.21.15.17:0/2282786612 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9da000640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9d414efb0 0x7fc9d414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d8c00640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d41f6720 0x7fc9d41539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d9600640 1 -- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9d414efb0 msgr2=0x7fc9d414f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d9600640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9d414efb0 0x7fc9d414f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d9600640 1 -- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d41f6720 msgr2=0x7fc9d41539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d9600640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d41f6720 0x7fc9d41539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d9600640 1 -- 172.21.15.17:0/2282786612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d41f25a0 con 0x7fc9bc004810 2024-09-10T23:28:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d8c00640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d41f6720 0x7fc9d41539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d9600640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 0x7fc9d4145120 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800eb30 tx=0x7fc9c800d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d1600640 1 -- 172.21.15.17:0/2282786612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c801d070 con 0x7fc9bc004810 2024-09-10T23:28:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d1600640 1 -- 172.21.15.17:0/2282786612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c800de20 con 0x7fc9bc004810 2024-09-10T23:28:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d1600640 1 -- 172.21.15.17:0/2282786612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8018670 con 0x7fc9bc004810 2024-09-10T23:28:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d41f2840 con 0x7fc9bc004810 2024-09-10T23:28:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d41f2e00 con 0x7fc9bc004810 2024-09-10T23:28:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d40d0220 con 0x7fc9bc004810 2024-09-10T23:28:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.084+0000 7fc9d1600640 1 -- 172.21.15.17:0/2282786612 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc9c800b040 con 0x7fc9bc004810 2024-09-10T23:28:30.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.088+0000 7fc9d1600640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9b4072610 0x7fc9b4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:30.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.088+0000 7fc9d1600640 1 -- 172.21.15.17:0/2282786612 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7fc9c80938d0 con 0x7fc9bc004810 2024-09-10T23:28:30.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.088+0000 7fc9d8c00640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9b4072610 0x7fc9b4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:30.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.088+0000 7fc9d8c00640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9b4072610 0x7fc9b4074ad0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ac000 tx=0x7fc9c0019d00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.092+0000 7fc9d1600640 1 -- 172.21.15.17:0/2282786612 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc9c805e9e0 con 0x7fc9bc004810 2024-09-10T23:28:30.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.296+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9d40cd230 con 0x7fc9bc004810 2024-09-10T23:28:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.296+0000 7fc9d1600640 1 -- 172.21.15.17:0/2282786612 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+3088 (secure 0 0 0) 0x7fc9c8063410 con 0x7fc9bc004810 2024-09-10T23:28:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:30.302 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":127,"btime":"2024-09-10T23:28:23:598838+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7907,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/871481979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":871481979},{"type":"v1","addr":"172.21.15.77:6837","nonce":871481979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8998,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/4004032555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":4004032555},{"type":"v1","addr":"172.21.15.77:6835","nonce":4004032555}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":10104,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1446273767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1446273767},{"type":"v1","addr":"172.21.15.17:6833","nonce":1446273767}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":127}],"filesystems":[]} 2024-09-10T23:28:30.302 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 127 2024-09-10T23:28:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9b4072610 msgr2=0x7fc9b4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9b4072610 0x7fc9b4074ad0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ac000 tx=0x7fc9c0019d00 comp rx=0 tx=0).stop 2024-09-10T23:28:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 msgr2=0x7fc9d4145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 0x7fc9d4145120 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800eb30 tx=0x7fc9c800d3e0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 shutdown_connections 2024-09-10T23:28:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc9b4072610 0x7fc9b4074ad0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc9d414efb0 0x7fc9d414f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9d41f6720 0x7fc9d41539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 --2- 172.21.15.17:0/2282786612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9bc004810 0x7fc9d4145120 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 >> 172.21.15.17:0/2282786612 conn(0x7fc9d406cfc0 msgr2=0x7fc9d414cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 shutdown_connections 2024-09-10T23:28:30.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.300+0000 7fc9dc000640 1 -- 172.21.15.17:0/2282786612 wait complete. 2024-09-10T23:28:30.325 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:28:30.325 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:28:30.325 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:28:30.325 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:28:30.326 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:28:30.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:28:30.326 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:28:30.327 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:28:30.327 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:28:30.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:28:30.327 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:28:30.327 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:28:30.328 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:28:30.328 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:28:30.332 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:28:30.333 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:30.337 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:28:30.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:28:30.342 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:28:30.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:28:30.343 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:28:30.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:28:30.381 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:28:30.382 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:30.388 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:28:30.388 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:30.389 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:28:30.390 DEBUG:teuthology.parallel:result is None 2024-09-10T23:28:30.390 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:28:30.420 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:28:30.471 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:28:30.479 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:28:30.480 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:28:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 -- 172.21.15.17:0/3480487503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 msgr2=0x7fe24c15b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 --2- 172.21.15.17:0/3480487503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 0x7fe24c15b150 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fe244009bf0 tx=0x7fe24401cba0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 -- 172.21.15.17:0/3480487503 shutdown_connections 2024-09-10T23:28:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 --2- 172.21.15.17:0/3480487503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 0x7fe24c15b150 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 --2- 172.21.15.17:0/3480487503 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24c1546f0 0x7fe24c0726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 -- 172.21.15.17:0/3480487503 >> 172.21.15.17:0/3480487503 conn(0x7fe24c0b1730 msgr2=0x7fe24c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 -- 172.21.15.17:0/3480487503 shutdown_connections 2024-09-10T23:28:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 -- 172.21.15.17:0/3480487503 wait complete. 2024-09-10T23:28:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 Processor -- start 2024-09-10T23:28:30.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 -- start start 2024-09-10T23:28:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24c06ef80 0x7fe24c1445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.536+0000 7fe253800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 0x7fe24c158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe253800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c1546f0 0x7fe24c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe253800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c15e760 con 0x7fe24c0cf700 2024-09-10T23:28:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe253800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c15e5e0 con 0x7fe24c1546f0 2024-09-10T23:28:30.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe253800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe24c15e8e0 con 0x7fe24c06ef80 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe243e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 0x7fe24c158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe243e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 0x7fe24c158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60280/0 (socket says 172.21.15.17:60280) 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe243e00640 1 -- 172.21.15.17:0/1693168734 learned_addr learned my addr 172.21.15.17:0/1693168734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe250e00640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24c06ef80 0x7fe24c1445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe251800640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c1546f0 0x7fe24c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe243e00640 1 -- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24c06ef80 msgr2=0x7fe24c1445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe243e00640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24c06ef80 0x7fe24c1445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe243e00640 1 -- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c1546f0 msgr2=0x7fe24c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe243e00640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c1546f0 0x7fe24c159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe243e00640 1 -- 172.21.15.17:0/1693168734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c1530a0 con 0x7fe24c0cf700 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe250e00640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24c06ef80 0x7fe24c1445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:30.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe243e00640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 0x7fe24c158bf0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c430 tx=0x7fe23400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe249600640 1 -- 172.21.15.17:0/1693168734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234017070 con 0x7fe24c0cf700 2024-09-10T23:28:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe249600640 1 -- 172.21.15.17:0/1693168734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe234003600 con 0x7fe24c0cf700 2024-09-10T23:28:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24c15ef00 con 0x7fe24c0cf700 2024-09-10T23:28:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe249600640 1 -- 172.21.15.17:0/1693168734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234003a50 con 0x7fe24c0cf700 2024-09-10T23:28:30.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24c15f4c0 con 0x7fe24c0cf700 2024-09-10T23:28:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24c15b150 con 0x7fe24c0cf700 2024-09-10T23:28:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.540+0000 7fe249600640 1 -- 172.21.15.17:0/1693168734 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe234003bf0 con 0x7fe24c0cf700 2024-09-10T23:28:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.544+0000 7fe249600640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2280725e0 0x7fe228074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.544+0000 7fe249600640 1 -- 172.21.15.17:0/1693168734 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5421+0+0 (secure 0 0 0) 0x7fe234092740 con 0x7fe24c0cf700 2024-09-10T23:28:30.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.544+0000 7fe250e00640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2280725e0 0x7fe228074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.544+0000 7fe250e00640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2280725e0 0x7fe228074aa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe24c164e50 tx=0x7fe23c00a2f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.548+0000 7fe249600640 1 -- 172.21.15.17:0/1693168734 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe23405df30 con 0x7fe24c0cf700 2024-09-10T23:28:30.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.732+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe24c0703e0 con 0x7fe24c0cf700 2024-09-10T23:28:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.908+0000 7fe249600640 1 -- 172.21.15.17:0/1693168734 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v172) ==== 97+0+0 (secure 0 0 0) 0x7fe23405d830 con 0x7fe24c0cf700 2024-09-10T23:28:30.915 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:28:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2280725e0 msgr2=0x7fe228074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2280725e0 0x7fe228074aa0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe24c164e50 tx=0x7fe23c00a2f0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 msgr2=0x7fe24c158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 0x7fe24c158bf0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c430 tx=0x7fe23400c8f0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 shutdown_connections 2024-09-10T23:28:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2280725e0 0x7fe228074aa0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe24c1546f0 0x7fe24c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c0cf700 0x7fe24c158bf0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 --2- 172.21.15.17:0/1693168734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe24c06ef80 0x7fe24c1445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:30.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 >> 172.21.15.17:0/1693168734 conn(0x7fe24c0b1730 msgr2=0x7fe24c1532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:30.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 shutdown_connections 2024-09-10T23:28:30.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:30.912+0000 7fe253800640 1 -- 172.21.15.17:0/1693168734 wait complete. 2024-09-10T23:28:30.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:28:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.124+0000 7fe336200640 1 -- 172.21.15.17:0/3775366359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330160280 msgr2=0x7fe3300cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.124+0000 7fe336200640 1 --2- 172.21.15.17:0/3775366359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330160280 0x7fe3300cfaf0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fe320009840 tx=0x7fe32001f010 comp rx=0 tx=0).stop 2024-09-10T23:28:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.124+0000 7fe336200640 1 -- 172.21.15.17:0/3775366359 shutdown_connections 2024-09-10T23:28:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.124+0000 7fe336200640 1 --2- 172.21.15.17:0/3775366359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe330160280 0x7fe3300cfaf0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.124+0000 7fe336200640 1 -- 172.21.15.17:0/3775366359 >> 172.21.15.17:0/3775366359 conn(0x7fe3300d1d10 msgr2=0x7fe3300d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.124+0000 7fe336200640 1 -- 172.21.15.17:0/3775366359 shutdown_connections 2024-09-10T23:28:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.124+0000 7fe336200640 1 -- 172.21.15.17:0/3775366359 wait complete. 2024-09-10T23:28:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.124+0000 7fe336200640 1 Processor -- start 2024-09-10T23:28:31.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.124+0000 7fe336200640 1 -- start start 2024-09-10T23:28:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe336200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3300d2830 0x7fe3300c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe336200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe330160280 0x7fe3300c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe336200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe330160660 0x7fe3301f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe336200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe3300d01b0 con 0x7fe3300d2830 2024-09-10T23:28:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe336200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3300d0030 con 0x7fe330160660 2024-09-10T23:28:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe336200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3300d0330 con 0x7fe330160280 2024-09-10T23:28:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3300d2830 0x7fe3300c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3300d2830 0x7fe3300c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60304/0 (socket says 172.21.15.17:60304) 2024-09-10T23:28:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32f400640 1 -- 172.21.15.17:0/1637251520 learned_addr learned my addr 172.21.15.17:0/1637251520 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe327e00640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe330160280 0x7fe3300c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32fe00640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe330160660 0x7fe3301f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32f400640 1 -- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe330160280 msgr2=0x7fe3300c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32f400640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe330160280 0x7fe3300c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32f400640 1 -- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe330160660 msgr2=0x7fe3301f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32f400640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe330160660 0x7fe3301f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32f400640 1 -- 172.21.15.17:0/1637251520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3300c78c0 con 0x7fe3300d2830 2024-09-10T23:28:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe32f400640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3300d2830 0x7fe3300c8680 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fe320009790 tx=0x7fe320005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe327400640 1 -- 172.21.15.17:0/1637251520 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3200b5040 con 0x7fe3300d2830 2024-09-10T23:28:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe327400640 1 -- 172.21.15.17:0/1637251520 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe320005220 con 0x7fe3300d2830 2024-09-10T23:28:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe327400640 1 -- 172.21.15.17:0/1637251520 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3200046d0 con 0x7fe3300d2830 2024-09-10T23:28:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3300c7ba0 con 0x7fe3300d2830 2024-09-10T23:28:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3300c8160 con 0x7fe3300d2830 2024-09-10T23:28:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.128+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3300b0640 con 0x7fe3300d2830 2024-09-10T23:28:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.132+0000 7fe327400640 1 -- 172.21.15.17:0/1637251520 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe3200b8070 con 0x7fe3300d2830 2024-09-10T23:28:31.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.132+0000 7fe327400640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe30c0725e0 0x7fe30c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.132+0000 7fe327400640 1 -- 172.21.15.17:0/1637251520 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5249+0+0 (secure 0 0 0) 0x7fe32012fde0 con 0x7fe3300d2830 2024-09-10T23:28:31.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.132+0000 7fe327e00640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe30c0725e0 0x7fe30c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.132+0000 7fe327e00640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe30c0725e0 0x7fe30c074aa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe33015ebf0 tx=0x7fe318007cd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:31.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.136+0000 7fe327400640 1 -- 172.21.15.17:0/1637251520 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe320018b70 con 0x7fe3300d2830 2024-09-10T23:28:31.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe3300cf4a0 con 0x7fe3300d2830 2024-09-10T23:28:31.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe327400640 1 -- 172.21.15.17:0/1637251520 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7fe3200faf90 con 0x7fe3300d2830 2024-09-10T23:28:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:31.376 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:28:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:28:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.376 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:28:31.377 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:28:31.378 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:28:31.380 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.382 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:28:31.384 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:28:31.385 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.386 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:28:31.387 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:28:31.389 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:28:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:28:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:28:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:28:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:28:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:28:31.390 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:28:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe30c0725e0 msgr2=0x7fe30c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe30c0725e0 0x7fe30c074aa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe33015ebf0 tx=0x7fe318007cd0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3300d2830 msgr2=0x7fe3300c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3300d2830 0x7fe3300c8680 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fe320009790 tx=0x7fe320005dd0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 shutdown_connections 2024-09-10T23:28:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe30c0725e0 0x7fe30c074aa0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe330160660 0x7fe3301f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe330160280 0x7fe3300c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 --2- 172.21.15.17:0/1637251520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3300d2830 0x7fe3300c8680 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 >> 172.21.15.17:0/1637251520 conn(0x7fe3300d1d10 msgr2=0x7fe3300b6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:31.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 shutdown_connections 2024-09-10T23:28:31.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.372+0000 7fe336200640 1 -- 172.21.15.17:0/1637251520 wait complete. 2024-09-10T23:28:31.399 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:28:31.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.540+0000 7fa697e00640 1 -- 172.21.15.17:0/1656636800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6900d1830 msgr2=0x7fa69015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.540+0000 7fa697e00640 1 --2- 172.21.15.17:0/1656636800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6900d1830 0x7fa69015f5a0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fa6900d2e60 tx=0x7fa67c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.540+0000 7fa697e00640 1 -- 172.21.15.17:0/1656636800 shutdown_connections 2024-09-10T23:28:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.540+0000 7fa697e00640 1 --2- 172.21.15.17:0/1656636800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6900d1830 0x7fa69015f5a0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.540+0000 7fa697e00640 1 --2- 172.21.15.17:0/1656636800 >> v2:172.21.15.77:3300/0 conn(0x7fa690070ad0 0x7fa69015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.540+0000 7fa697e00640 1 -- 172.21.15.17:0/1656636800 >> 172.21.15.17:0/1656636800 conn(0x7fa6900d1d60 msgr2=0x7fa6900d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.540+0000 7fa697e00640 1 -- 172.21.15.17:0/1656636800 shutdown_connections 2024-09-10T23:28:31.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.540+0000 7fa697e00640 1 -- 172.21.15.17:0/1656636800 wait complete. 2024-09-10T23:28:31.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 Processor -- start 2024-09-10T23:28:31.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 -- start start 2024-09-10T23:28:31.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa690070ad0 0x7fa690150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6900cf320 0x7fa6901594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6900d1830 0x7fa690159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa690169320 con 0x7fa6900d1830 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6901691a0 con 0x7fa690070ad0 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa6901694a0 con 0x7fa6900cf320 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa690070ad0 0x7fa690150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6900d1830 0x7fa690159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa690070ad0 0x7fa690150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:50722/0 (socket says 172.21.15.17:50722) 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa694a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6900cf320 0x7fa6901594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695400640 1 -- 172.21.15.17:0/1011242941 learned_addr learned my addr 172.21.15.17:0/1011242941 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695400640 1 -- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6900cf320 msgr2=0x7fa6901594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695400640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6900cf320 0x7fa6901594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695400640 1 -- 172.21.15.17:0/1011242941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6900d1830 msgr2=0x7fa690159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695400640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6900d1830 0x7fa690159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695400640 1 -- 172.21.15.17:0/1011242941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69015ba20 con 0x7fa690070ad0 2024-09-10T23:28:31.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa695400640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa690070ad0 0x7fa690150900 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa68400d980 tx=0x7fa68400de40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:31.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa68d600640 1 -- 172.21.15.17:0/1011242941 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684017070 con 0x7fa690070ad0 2024-09-10T23:28:31.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa68d600640 1 -- 172.21.15.17:0/1011242941 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa684009d60 con 0x7fa690070ad0 2024-09-10T23:28:31.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa68d600640 1 -- 172.21.15.17:0/1011242941 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684005280 con 0x7fa690070ad0 2024-09-10T23:28:31.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69015bd00 con 0x7fa690070ad0 2024-09-10T23:28:31.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.544+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69015c2c0 con 0x7fa690070ad0 2024-09-10T23:28:31.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.548+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6900cfc60 con 0x7fa690070ad0 2024-09-10T23:28:31.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.548+0000 7fa68d600640 1 -- 172.21.15.17:0/1011242941 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa684005420 con 0x7fa690070ad0 2024-09-10T23:28:31.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.548+0000 7fa68d600640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa670072610 0x7fa670074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.548+0000 7fa68d600640 1 -- 172.21.15.17:0/1011242941 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5249+0+0 (secure 0 0 0) 0x7fa684093240 con 0x7fa690070ad0 2024-09-10T23:28:31.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.548+0000 7fa694a00640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa670072610 0x7fa670074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.548+0000 7fa694a00640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa670072610 0x7fa670074ad0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0af000 tx=0x7fa67c0a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:31.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.552+0000 7fa68d600640 1 -- 172.21.15.17:0/1011242941 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa68405e3f0 con 0x7fa690070ad0 2024-09-10T23:28:31.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.728+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa6900b0cb0 con 0x7fa690070ad0 2024-09-10T23:28:31.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.728+0000 7fa68d600640 1 -- 172.21.15.17:0/1011242941 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v173) ==== 84+0+65 (secure 0 0 0) 0x7fa684067160 con 0x7fa690070ad0 2024-09-10T23:28:31.734 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:31.735 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:28:31.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:28:31.735 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:28:31.735 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:28:31.735 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:31.735 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa670072610 msgr2=0x7fa670074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa670072610 0x7fa670074ad0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0af000 tx=0x7fa67c0a7040 comp rx=0 tx=0).stop 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa690070ad0 msgr2=0x7fa690150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa690070ad0 0x7fa690150900 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa68400d980 tx=0x7fa68400de40 comp rx=0 tx=0).stop 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 shutdown_connections 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa670072610 0x7fa670074ad0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6900d1830 0x7fa690159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6900cf320 0x7fa6901594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 --2- 172.21.15.17:0/1011242941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa690070ad0 0x7fa690150900 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 >> 172.21.15.17:0/1011242941 conn(0x7fa6900d1d60 msgr2=0x7fa6900d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:31.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 shutdown_connections 2024-09-10T23:28:31.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.732+0000 7fa697e00640 1 -- 172.21.15.17:0/1011242941 wait complete. 2024-09-10T23:28:31.755 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:28:31.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:28:31.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.900+0000 7f52c1400640 1 -- 172.21.15.17:0/3312209696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc15f600 msgr2=0x7f52bc0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.900+0000 7f52c1400640 1 --2- 172.21.15.17:0/3312209696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc15f600 0x7f52bc0cc900 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009840 tx=0x7f52ac01c820 comp rx=0 tx=0).stop 2024-09-10T23:28:31.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.900+0000 7f52c1400640 1 -- 172.21.15.17:0/3312209696 shutdown_connections 2024-09-10T23:28:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.900+0000 7f52c1400640 1 --2- 172.21.15.17:0/3312209696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc15f600 0x7f52bc0cc900 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.900+0000 7f52c1400640 1 -- 172.21.15.17:0/3312209696 >> 172.21.15.17:0/3312209696 conn(0x7f52bc09b080 msgr2=0x7f52bc0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.900+0000 7f52c1400640 1 -- 172.21.15.17:0/3312209696 shutdown_connections 2024-09-10T23:28:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.900+0000 7f52c1400640 1 -- 172.21.15.17:0/3312209696 wait complete. 2024-09-10T23:28:31.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 Processor -- start 2024-09-10T23:28:31.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 -- start start 2024-09-10T23:28:31.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52bc0b0990 0x7f52bc0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc0b28e0 0x7f52bc0cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52bc15f600 0x7f52bc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc0cd1d0 con 0x7f52bc0b28e0 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc0cd050 con 0x7f52bc0b0990 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f52bc16a3d0 con 0x7f52bc15f600 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc0b28e0 0x7f52bc0cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc0b28e0 0x7f52bc0cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60346/0 (socket says 172.21.15.17:60346) 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b3e00640 1 -- 172.21.15.17:0/2029626628 learned_addr learned my addr 172.21.15.17:0/2029626628 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52ba800640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52bc0b0990 0x7f52bc0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52bb200640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52bc15f600 0x7f52bc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b3e00640 1 -- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52bc15f600 msgr2=0x7f52bc06f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b3e00640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52bc15f600 0x7f52bc06f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b3e00640 1 -- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52bc0b0990 msgr2=0x7f52bc0c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:31.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b3e00640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52bc0b0990 0x7f52bc0c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b3e00640 1 -- 172.21.15.17:0/2029626628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc0b1100 con 0x7f52bc0b28e0 2024-09-10T23:28:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52bb200640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52bc15f600 0x7f52bc06f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b3e00640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc0b28e0 0x7f52bc0cb1f0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c420 tx=0x7f52a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b2a00640 1 -- 172.21.15.17:0/2029626628 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4017070 con 0x7f52bc0b28e0 2024-09-10T23:28:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b2a00640 1 -- 172.21.15.17:0/2029626628 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52a40053c0 con 0x7f52bc0b28e0 2024-09-10T23:28:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52b2a00640 1 -- 172.21.15.17:0/2029626628 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4003860 con 0x7f52bc0b28e0 2024-09-10T23:28:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc0c8670 con 0x7f52bc0b28e0 2024-09-10T23:28:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc1524f0 con 0x7f52bc0b28e0 2024-09-10T23:28:31.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.904+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52bc09fc50 con 0x7f52bc0b28e0 2024-09-10T23:28:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.908+0000 7f52b2a00640 1 -- 172.21.15.17:0/2029626628 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f52a4003a00 con 0x7f52bc0b28e0 2024-09-10T23:28:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.908+0000 7f52b2a00640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52980725e0 0x7f5298074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:31.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.908+0000 7f52b2a00640 1 -- 172.21.15.17:0/2029626628 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5249+0+0 (secure 0 0 0) 0x7f52a4092660 con 0x7f52bc0b28e0 2024-09-10T23:28:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.908+0000 7f52ba800640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52980725e0 0x7f5298074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:31.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.908+0000 7f52ba800640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52980725e0 0x7f5298074aa0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0af000 tx=0x7f52ac01b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:31.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:31.916+0000 7f52b2a00640 1 -- 172.21.15.17:0/2029626628 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f52a405d940 con 0x7f52bc0b28e0 2024-09-10T23:28:32.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.088+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f52bc0cc900 con 0x7f52bc0b28e0 2024-09-10T23:28:32.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.920+0000 7f52b2a00640 1 -- 172.21.15.17:0/2029626628 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v174) ==== 138+0+0 (secure 0 0 0) 0x7f52a4062370 con 0x7f52bc0b28e0 2024-09-10T23:28:32.927 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:28:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52980725e0 msgr2=0x7f5298074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52980725e0 0x7f5298074aa0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0af000 tx=0x7f52ac01b060 comp rx=0 tx=0).stop 2024-09-10T23:28:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc0b28e0 msgr2=0x7f52bc0cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc0b28e0 0x7f52bc0cb1f0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f52a400c420 tx=0x7f52a400c8e0 comp rx=0 tx=0).stop 2024-09-10T23:28:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 shutdown_connections 2024-09-10T23:28:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f52980725e0 0x7f5298074aa0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f52bc15f600 0x7f52bc06f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52bc0b28e0 0x7f52bc0cb1f0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 --2- 172.21.15.17:0/2029626628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52bc0b0990 0x7f52bc0c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 >> 172.21.15.17:0/2029626628 conn(0x7f52bc09b080 msgr2=0x7f52bc0cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 shutdown_connections 2024-09-10T23:28:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:32.924+0000 7f52c1400640 1 -- 172.21.15.17:0/2029626628 wait complete. 2024-09-10T23:28:32.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:28:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.108+0000 7fe84d200640 1 -- 172.21.15.17:0/2451542985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848160460 msgr2=0x7fe84815f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.108+0000 7fe84d200640 1 --2- 172.21.15.17:0/2451542985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848160460 0x7fe84815f770 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fe848072620 tx=0x7fe83001c800 comp rx=0 tx=0).stop 2024-09-10T23:28:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.108+0000 7fe84d200640 1 -- 172.21.15.17:0/2451542985 shutdown_connections 2024-09-10T23:28:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.108+0000 7fe84d200640 1 --2- 172.21.15.17:0/2451542985 >> v2:172.21.15.77:3300/0 conn(0x7fe84806e6f0 0x7fe84815fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.108+0000 7fe84d200640 1 --2- 172.21.15.17:0/2451542985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848160460 0x7fe84815f770 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.108+0000 7fe84d200640 1 -- 172.21.15.17:0/2451542985 >> 172.21.15.17:0/2451542985 conn(0x7fe8480b17a0 msgr2=0x7fe8480b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.108+0000 7fe84d200640 1 -- 172.21.15.17:0/2451542985 shutdown_connections 2024-09-10T23:28:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.108+0000 7fe84d200640 1 -- 172.21.15.17:0/2451542985 wait complete. 2024-09-10T23:28:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 Processor -- start 2024-09-10T23:28:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 -- start start 2024-09-10T23:28:33.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe84806e6f0 0x7fe848155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:33.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848145800 0x7fe8480b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe848160460 0x7fe848144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe848168c90 con 0x7fe848145800 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe848168b10 con 0x7fe84806e6f0 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe848168e10 con 0x7fe848160460 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848145800 0x7fe8480b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848145800 0x7fe8480b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60364/0 (socket says 172.21.15.17:60364) 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83d400640 1 -- 172.21.15.17:0/3697577467 learned_addr learned my addr 172.21.15.17:0/3697577467 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe845e00640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe84806e6f0 0x7fe848155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe846800640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe848160460 0x7fe848144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83d400640 1 -- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe848160460 msgr2=0x7fe848144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83d400640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe848160460 0x7fe848144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83d400640 1 -- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe84806e6f0 msgr2=0x7fe848155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83d400640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe84806e6f0 0x7fe848155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83d400640 1 -- 172.21.15.17:0/3697577467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe848155bd0 con 0x7fe848145800 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe845e00640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe84806e6f0 0x7fe848155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe846800640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe848160460 0x7fe848144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83d400640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848145800 0x7fe8480b4750 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fe830000c10 tx=0x7fe830004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83ea00640 1 -- 172.21.15.17:0/3697577467 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8300bb070 con 0x7fe848145800 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83ea00640 1 -- 172.21.15.17:0/3697577467 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe830005030 con 0x7fe848145800 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe83ea00640 1 -- 172.21.15.17:0/3697577467 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8300b2040 con 0x7fe848145800 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe848143010 con 0x7fe848145800 2024-09-10T23:28:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.112+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe848142400 con 0x7fe848145800 2024-09-10T23:28:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.116+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8480741d0 con 0x7fe848145800 2024-09-10T23:28:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.116+0000 7fe83ea00640 1 -- 172.21.15.17:0/3697577467 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe8300b5030 con 0x7fe848145800 2024-09-10T23:28:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.116+0000 7fe83ea00640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8240725e0 0x7fe824074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.116+0000 7fe83ea00640 1 -- 172.21.15.17:0/3697577467 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5619+0+0 (secure 0 0 0) 0x7fe83012c9b0 con 0x7fe848145800 2024-09-10T23:28:33.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.116+0000 7fe845e00640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8240725e0 0x7fe824074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:33.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.116+0000 7fe845e00640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8240725e0 0x7fe824074aa0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe838007fd0 tx=0x7fe838009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:33.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.120+0000 7fe83ea00640 1 -- 172.21.15.17:0/3697577467 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe848155bd0 con 0x7fe848145800 2024-09-10T23:28:33.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.292+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe84813d250 con 0x7fe848145800 2024-09-10T23:28:33.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.924+0000 7fe83ea00640 1 -- 172.21.15.17:0/3697577467 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v175) ==== 170+0+0 (secure 0 0 0) 0x7fe8300163f0 con 0x7fe848145800 2024-09-10T23:28:33.930 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:28:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8240725e0 msgr2=0x7fe824074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8240725e0 0x7fe824074aa0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe838007fd0 tx=0x7fe838009040 comp rx=0 tx=0).stop 2024-09-10T23:28:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848145800 msgr2=0x7fe8480b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848145800 0x7fe8480b4750 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fe830000c10 tx=0x7fe830004040 comp rx=0 tx=0).stop 2024-09-10T23:28:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 shutdown_connections 2024-09-10T23:28:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe8240725e0 0x7fe824074aa0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe848160460 0x7fe848144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe848145800 0x7fe8480b4750 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:33.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 --2- 172.21.15.17:0/3697577467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe84806e6f0 0x7fe848155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 >> 172.21.15.17:0/3697577467 conn(0x7fe8480b17a0 msgr2=0x7fe848140590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 shutdown_connections 2024-09-10T23:28:33.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:33.928+0000 7fe84d200640 1 -- 172.21.15.17:0/3697577467 wait complete. 2024-09-10T23:28:33.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:28:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 -- 172.21.15.17:0/1947116396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 msgr2=0x7f7dc40d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 --2- 172.21.15.17:0/1947116396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 0x7f7dc40d1cd0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009840 tx=0x7f7db401c7c0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 -- 172.21.15.17:0/1947116396 shutdown_connections 2024-09-10T23:28:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 --2- 172.21.15.17:0/1947116396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7dc4071d80 0x7f7dc40cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 --2- 172.21.15.17:0/1947116396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 0x7f7dc40d1cd0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 -- 172.21.15.17:0/1947116396 >> 172.21.15.17:0/1947116396 conn(0x7f7dc409a9f0 msgr2=0x7f7dc409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 -- 172.21.15.17:0/1947116396 shutdown_connections 2024-09-10T23:28:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 -- 172.21.15.17:0/1947116396 wait complete. 2024-09-10T23:28:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 Processor -- start 2024-09-10T23:28:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.124+0000 7f7dcac00640 1 -- start start 2024-09-10T23:28:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dcac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc4071d80 0x7f7dc4150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dcac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7dc40d2210 0x7f7dc40aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dcac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 0x7f7dc40af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dcac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4168b00 con 0x7f7dc415be20 2024-09-10T23:28:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dcac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc4168c80 con 0x7f7dc4071d80 2024-09-10T23:28:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dcac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc4168e00 con 0x7f7dc40d2210 2024-09-10T23:28:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 0x7f7dc40af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 0x7f7dc40af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60396/0 (socket says 172.21.15.17:60396) 2024-09-10T23:28:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc8c00640 1 -- 172.21.15.17:0/991224024 learned_addr learned my addr 172.21.15.17:0/991224024 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dbbe00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7dc40d2210 0x7f7dc40aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc3e00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc4071d80 0x7f7dc4150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc8c00640 1 -- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7dc40d2210 msgr2=0x7f7dc40aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc8c00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7dc40d2210 0x7f7dc40aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc8c00640 1 -- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc4071d80 msgr2=0x7f7dc4150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc8c00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc4071d80 0x7f7dc4150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc8c00640 1 -- 172.21.15.17:0/991224024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc4151630 con 0x7f7dc415be20 2024-09-10T23:28:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc8c00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 0x7f7dc40af090 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00ea20 tx=0x7f7dbc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc0c00640 1 -- 172.21.15.17:0/991224024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00cde0 con 0x7f7dc415be20 2024-09-10T23:28:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc0c00640 1 -- 172.21.15.17:0/991224024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7dbc004c40 con 0x7f7dc415be20 2024-09-10T23:28:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dc0c00640 1 -- 172.21.15.17:0/991224024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc005280 con 0x7f7dc415be20 2024-09-10T23:28:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc4151910 con 0x7f7dc415be20 2024-09-10T23:28:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc4151ed0 con 0x7f7dc415be20 2024-09-10T23:28:34.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.128+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc4159c80 con 0x7f7dc415be20 2024-09-10T23:28:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.132+0000 7f7dc0c00640 1 -- 172.21.15.17:0/991224024 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7dbc00f040 con 0x7f7dc415be20 2024-09-10T23:28:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.132+0000 7f7dc0c00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7da00725e0 0x7f7da0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.132+0000 7f7dc0c00640 1 -- 172.21.15.17:0/991224024 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 6001+0+0 (secure 0 0 0) 0x7f7dbc093db0 con 0x7f7dc415be20 2024-09-10T23:28:34.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.132+0000 7f7dc3e00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7da00725e0 0x7f7da0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:34.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.136+0000 7f7dc3e00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7da00725e0 0x7f7da0074aa0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7db40af000 tx=0x7f7db40b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.136+0000 7f7dc0c00640 1 -- 172.21.15.17:0/991224024 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7dbc016030 con 0x7f7dc415be20 2024-09-10T23:28:34.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.344+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7dc40cce50 con 0x7f7dc415be20 2024-09-10T23:28:34.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.960+0000 7f7dc0c00640 1 -- 172.21.15.17:0/991224024 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v130) ==== 174+0+0 (secure 0 0 0) 0x7f7dbc05ed80 con 0x7f7dc415be20 2024-09-10T23:28:34.969 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 25 and data pool 26 2024-09-10T23:28:34.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.968+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7da00725e0 msgr2=0x7f7da0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:34.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.968+0000 7f7dcac00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7da00725e0 0x7f7da0074aa0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7db40af000 tx=0x7f7db40b2040 comp rx=0 tx=0).stop 2024-09-10T23:28:34.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.968+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 msgr2=0x7f7dc40af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:34.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.968+0000 7f7dcac00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 0x7f7dc40af090 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00ea20 tx=0x7f7dbc00eee0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.972+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 shutdown_connections 2024-09-10T23:28:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.972+0000 7f7dcac00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7da00725e0 0x7f7da0074aa0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.972+0000 7f7dcac00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc415be20 0x7f7dc40af090 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.972+0000 7f7dcac00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7dc40d2210 0x7f7dc40aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.972+0000 7f7dcac00640 1 --2- 172.21.15.17:0/991224024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc4071d80 0x7f7dc4150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:34.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.972+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 >> 172.21.15.17:0/991224024 conn(0x7f7dc409a9f0 msgr2=0x7f7dc4158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.972+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 shutdown_connections 2024-09-10T23:28:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:34.972+0000 7f7dcac00640 1 -- 172.21.15.17:0/991224024 wait complete. 2024-09-10T23:28:35.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:28:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.152+0000 7fcf4ce00640 1 -- 172.21.15.17:0/2447335200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 msgr2=0x7fcf480d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.152+0000 7fcf4ce00640 1 --2- 172.21.15.17:0/2447335200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 0x7fcf480d05a0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fcf40009c80 tx=0x7fcf4001cc80 comp rx=0 tx=0).stop 2024-09-10T23:28:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.152+0000 7fcf4ce00640 1 -- 172.21.15.17:0/2447335200 shutdown_connections 2024-09-10T23:28:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.152+0000 7fcf4ce00640 1 --2- 172.21.15.17:0/2447335200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 0x7fcf480d05a0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.152+0000 7fcf4ce00640 1 --2- 172.21.15.17:0/2447335200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf4815b890 0x7fcf48072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.152+0000 7fcf4ce00640 1 -- 172.21.15.17:0/2447335200 >> 172.21.15.17:0/2447335200 conn(0x7fcf4809a9f0 msgr2=0x7fcf4809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.152+0000 7fcf4ce00640 1 -- 172.21.15.17:0/2447335200 shutdown_connections 2024-09-10T23:28:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.152+0000 7fcf4ce00640 1 -- 172.21.15.17:0/2447335200 wait complete. 2024-09-10T23:28:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 Processor -- start 2024-09-10T23:28:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 -- start start 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 0x7fcf4813fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf4815b890 0x7fcf48164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4815bc70 0x7fcf4815df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48071ff0 con 0x7fcf480d20c0 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48071e70 con 0x7fcf4815bc70 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcf481686f0 con 0x7fcf4815b890 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 0x7fcf4813fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf3ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf4815b890 0x7fcf48164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 0x7fcf4813fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60422/0 (socket says 172.21.15.17:60422) 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47400640 1 -- 172.21.15.17:0/4254522130 learned_addr learned my addr 172.21.15.17:0/4254522130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47e00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4815bc70 0x7fcf4815df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47400640 1 -- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf4815b890 msgr2=0x7fcf48164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47400640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf4815b890 0x7fcf48164bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47400640 1 -- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4815bc70 msgr2=0x7fcf4815df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47400640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4815bc70 0x7fcf4815df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47400640 1 -- 172.21.15.17:0/4254522130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf480b0420 con 0x7fcf480d20c0 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf47400640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 0x7fcf4813fc20 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800e9f0 tx=0x7fcf3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf3fe00640 1 -- 172.21.15.17:0/4254522130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800cd80 con 0x7fcf480d20c0 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf3fe00640 1 -- 172.21.15.17:0/4254522130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf38010430 con 0x7fcf480d20c0 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf3fe00640 1 -- 172.21.15.17:0/4254522130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38010860 con 0x7fcf480d20c0 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf48165500 con 0x7fcf480d20c0 2024-09-10T23:28:35.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf481573e0 con 0x7fcf480d20c0 2024-09-10T23:28:35.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.156+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf480d05a0 con 0x7fcf480d20c0 2024-09-10T23:28:35.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.160+0000 7fcf3fe00640 1 -- 172.21.15.17:0/4254522130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcf38010a00 con 0x7fcf480d20c0 2024-09-10T23:28:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.160+0000 7fcf3fe00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcf240725e0 0x7fcf24074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.160+0000 7fcf3fe00640 1 -- 172.21.15.17:0/4254522130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7fcf38093f10 con 0x7fcf480d20c0 2024-09-10T23:28:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.160+0000 7fcf3ea00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcf240725e0 0x7fcf24074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.160+0000 7fcf3ea00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcf240725e0 0x7fcf24074aa0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fcf4813faf0 tx=0x7fcf30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:35.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.164+0000 7fcf3fe00640 1 -- 172.21.15.17:0/4254522130 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcf3805eec0 con 0x7fcf480d20c0 2024-09-10T23:28:35.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.336+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf481577c0 con 0x7fcf480d20c0 2024-09-10T23:28:35.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf3fe00640 1 -- 172.21.15.17:0/4254522130 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16901 (secure 0 0 0) 0x7fcf380638f0 con 0x7fcf480d20c0 2024-09-10T23:28:35.345 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:35.345 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":176,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:28:34.352083+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:28:32.104576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-10T23:28:33.310367+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcf240725e0 msgr2=0x7fcf24074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcf240725e0 0x7fcf24074aa0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fcf4813faf0 tx=0x7fcf30009040 comp rx=0 tx=0).stop 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 msgr2=0x7fcf4813fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 0x7fcf4813fc20 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800e9f0 tx=0x7fcf3800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 shutdown_connections 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcf240725e0 0x7fcf24074aa0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf4815bc70 0x7fcf4815df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf4815b890 0x7fcf48164bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 --2- 172.21.15.17:0/4254522130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf480d20c0 0x7fcf4813fc20 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 >> 172.21.15.17:0/4254522130 conn(0x7fcf4809a9f0 msgr2=0x7fcf480af150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:35.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 shutdown_connections 2024-09-10T23:28:35.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.340+0000 7fcf4ce00640 1 -- 172.21.15.17:0/4254522130 wait complete. 2024-09-10T23:28:35.368 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:28:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.508+0000 7f4e18800640 1 -- 172.21.15.17:0/932323357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e10070ad0 msgr2=0x7f4e1015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.508+0000 7f4e18800640 1 --2- 172.21.15.17:0/932323357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e10070ad0 0x7f4e1015f060 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b7de0 tx=0x7f4e0401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.508+0000 7f4e18800640 1 -- 172.21.15.17:0/932323357 shutdown_connections 2024-09-10T23:28:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.508+0000 7f4e18800640 1 --2- 172.21.15.17:0/932323357 >> v2:172.21.15.77:3300/0 conn(0x7f4e100cf320 0x7f4e100cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.508+0000 7f4e18800640 1 --2- 172.21.15.17:0/932323357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e10070ad0 0x7f4e1015f060 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.508+0000 7f4e18800640 1 -- 172.21.15.17:0/932323357 >> 172.21.15.17:0/932323357 conn(0x7f4e100d1d60 msgr2=0x7f4e100d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.508+0000 7f4e18800640 1 -- 172.21.15.17:0/932323357 shutdown_connections 2024-09-10T23:28:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.508+0000 7f4e18800640 1 -- 172.21.15.17:0/932323357 wait complete. 2024-09-10T23:28:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 Processor -- start 2024-09-10T23:28:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 -- start start 2024-09-10T23:28:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e10070ad0 0x7f4e1006f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e100cf320 0x7f4e10157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e100d1830 0x7f4e101f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4e10169320 con 0x7f4e100cf320 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e101691a0 con 0x7f4e10070ad0 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e101694a0 con 0x7f4e100d1830 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e100cf320 0x7f4e10157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e100cf320 0x7f4e10157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60428/0 (socket says 172.21.15.17:60428) 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15400640 1 -- 172.21.15.17:0/2099091133 learned_addr learned my addr 172.21.15.17:0/2099091133 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e16800640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e100d1830 0x7f4e101f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15e00640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e10070ad0 0x7f4e1006f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15400640 1 -- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e100d1830 msgr2=0x7f4e101f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15400640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e100d1830 0x7f4e101f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15400640 1 -- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e10070ad0 msgr2=0x7f4e1006f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15400640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e10070ad0 0x7f4e1006f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15400640 1 -- 172.21.15.17:0/2099091133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1006e190 con 0x7f4e100cf320 2024-09-10T23:28:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e15400640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e100cf320 0x7f4e10157e60 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000b410 tx=0x7f4e0000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e0a000640 1 -- 172.21.15.17:0/2099091133 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00015030 con 0x7f4e100cf320 2024-09-10T23:28:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e0a000640 1 -- 172.21.15.17:0/2099091133 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e00004020 con 0x7f4e100cf320 2024-09-10T23:28:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1006e470 con 0x7f4e100cf320 2024-09-10T23:28:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e0a000640 1 -- 172.21.15.17:0/2099091133 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000044b0 con 0x7f4e100cf320 2024-09-10T23:28:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e1006ea30 con 0x7f4e100cf320 2024-09-10T23:28:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.512+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e1015f060 con 0x7f4e100cf320 2024-09-10T23:28:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.516+0000 7f4e0a000640 1 -- 172.21.15.17:0/2099091133 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4e00022060 con 0x7f4e100cf320 2024-09-10T23:28:35.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.516+0000 7f4e0a000640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df40725e0 0x7f4df4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.516+0000 7f4e0a000640 1 -- 172.21.15.17:0/2099091133 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f4e00092e20 con 0x7f4e100cf320 2024-09-10T23:28:35.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.516+0000 7f4e15e00640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df40725e0 0x7f4df4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.516+0000 7f4e15e00640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df40725e0 0x7f4df4074aa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4e040af000 tx=0x7f4e0401b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:35.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.520+0000 7f4e0a000640 1 -- 172.21.15.17:0/2099091133 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4e0005dd10 con 0x7f4e100cf320 2024-09-10T23:28:35.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.692+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e1009fde0 con 0x7f4e100cf320 2024-09-10T23:28:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e0a000640 1 -- 172.21.15.17:0/2099091133 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16901 (secure 0 0 0) 0x7f4e00062740 con 0x7f4e100cf320 2024-09-10T23:28:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:35.701 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":176,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:28:34.352083+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:28:32.104576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-10T23:28:33.310367+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df40725e0 msgr2=0x7f4df4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df40725e0 0x7f4df4074aa0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4e040af000 tx=0x7f4e0401b100 comp rx=0 tx=0).stop 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e100cf320 msgr2=0x7f4e10157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e100cf320 0x7f4e10157e60 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000b410 tx=0x7f4e0000b8d0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 shutdown_connections 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df40725e0 0x7f4df4074aa0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e100d1830 0x7f4e101f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e100cf320 0x7f4e10157e60 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 --2- 172.21.15.17:0/2099091133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e10070ad0 0x7f4e1006f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 >> 172.21.15.17:0/2099091133 conn(0x7f4e100d1d60 msgr2=0x7f4e10158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 shutdown_connections 2024-09-10T23:28:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.696+0000 7f4e18800640 1 -- 172.21.15.17:0/2099091133 wait complete. 2024-09-10T23:28:35.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:28:35.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 -- 172.21.15.17:0/2525401022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 msgr2=0x7f21740d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 --2- 172.21.15.17:0/2525401022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 0x7f21740d03b0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f21740cf770 tx=0x7f215c01c800 comp rx=0 tx=0).stop 2024-09-10T23:28:35.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 -- 172.21.15.17:0/2525401022 shutdown_connections 2024-09-10T23:28:35.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 --2- 172.21.15.17:0/2525401022 >> v2:172.21.15.77:3300/0 conn(0x7f21740b31b0 0x7f21740cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 --2- 172.21.15.17:0/2525401022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 0x7f21740d03b0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 -- 172.21.15.17:0/2525401022 >> 172.21.15.17:0/2525401022 conn(0x7f21740d1da0 msgr2=0x7f21740d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:35.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 -- 172.21.15.17:0/2525401022 shutdown_connections 2024-09-10T23:28:35.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 -- 172.21.15.17:0/2525401022 wait complete. 2024-09-10T23:28:35.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 Processor -- start 2024-09-10T23:28:35.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 -- start start 2024-09-10T23:28:35.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.868+0000 7f2179400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 0x7f217415d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2179400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21740b31b0 0x7f21740ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2179400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f217415f400 0x7f21740b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2179400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2174168c60 con 0x7f21740b2540 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2179400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f21740cdbd0 con 0x7f21740b31b0 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2179400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2174168de0 con 0x7f217415f400 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2172800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 0x7f217415d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2172800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 0x7f217415d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60446/0 (socket says 172.21.15.17:60446) 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2172800640 1 -- 172.21.15.17:0/690419615 learned_addr learned my addr 172.21.15.17:0/690419615 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2173200640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f217415f400 0x7f21740b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f216be00640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21740b31b0 0x7f21740ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2172800640 1 -- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f217415f400 msgr2=0x7f21740b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2172800640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f217415f400 0x7f21740b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2172800640 1 -- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21740b31b0 msgr2=0x7f21740ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2172800640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21740b31b0 0x7f21740ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:35.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2172800640 1 -- 172.21.15.17:0/690419615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21740cb790 con 0x7f21740b2540 2024-09-10T23:28:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f216be00640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21740b31b0 0x7f21740ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:28:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2172800640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 0x7f217415d8c0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f216400c3c0 tx=0x7f216400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f216aa00640 1 -- 172.21.15.17:0/690419615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164011790 con 0x7f21740b2540 2024-09-10T23:28:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f216aa00640 1 -- 172.21.15.17:0/690419615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2164017070 con 0x7f21740b2540 2024-09-10T23:28:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f216aa00640 1 -- 172.21.15.17:0/690419615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164011d40 con 0x7f21740b2540 2024-09-10T23:28:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21740cb1d0 con 0x7f21740b2540 2024-09-10T23:28:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21740b5de0 con 0x7f21740b2540 2024-09-10T23:28:35.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21740cc8b0 con 0x7f21740b2540 2024-09-10T23:28:35.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.872+0000 7f216aa00640 1 -- 172.21.15.17:0/690419615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f216401c460 con 0x7f21740b2540 2024-09-10T23:28:35.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.876+0000 7f216aa00640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21500725e0 0x7f2150074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:35.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.876+0000 7f216aa00640 1 -- 172.21.15.17:0/690419615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f2164092ff0 con 0x7f21740b2540 2024-09-10T23:28:35.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.876+0000 7f216be00640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21500725e0 0x7f2150074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:35.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.876+0000 7f216be00640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21500725e0 0x7f2150074aa0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f215c0af000 tx=0x7f215c01b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:35.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:35.880+0000 7f216aa00640 1 -- 172.21.15.17:0/690419615 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f216405df20 con 0x7f21740b2540 2024-09-10T23:28:35.919 INFO:tasks.ceph.mds.a.smithi017.stderr:2024-09-10T23:28:35.916+0000 7f2249a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:28:36.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.088+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f21740d2390 con 0x7f21740b2540 2024-09-10T23:28:36.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.972+0000 7f216aa00640 1 -- 172.21.15.17:0/690419615 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v132) ==== 118+0+0 (secure 0 0 0) 0x7f2164062950 con 0x7f21740b2540 2024-09-10T23:28:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21500725e0 msgr2=0x7f2150074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21500725e0 0x7f2150074aa0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f215c0af000 tx=0x7f215c01b040 comp rx=0 tx=0).stop 2024-09-10T23:28:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 msgr2=0x7f217415d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 0x7f217415d8c0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f216400c3c0 tx=0x7f216400c880 comp rx=0 tx=0).stop 2024-09-10T23:28:36.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 shutdown_connections 2024-09-10T23:28:36.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f21500725e0 0x7f2150074aa0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:36.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f217415f400 0x7f21740b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:36.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21740b31b0 0x7f21740ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:36.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 --2- 172.21.15.17:0/690419615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21740b2540 0x7f217415d8c0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:36.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 >> 172.21.15.17:0/690419615 conn(0x7f21740d1da0 msgr2=0x7f21740af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:36.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 shutdown_connections 2024-09-10T23:28:36.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:36.976+0000 7f2179400640 1 -- 172.21.15.17:0/690419615 wait complete. 2024-09-10T23:28:37.006 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:28:37.006 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:28:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.156+0000 7f56b3200640 1 -- 172.21.15.17:0/3960678907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5698004810 msgr2=0x7f5698004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.156+0000 7f56b3200640 1 --2- 172.21.15.17:0/3960678907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5698004810 0x7f5698004c90 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f56b40d2cc0 tx=0x7f569c01d430 comp rx=0 tx=0).stop 2024-09-10T23:28:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.156+0000 7f56b2800640 1 -- 172.21.15.17:0/3960678907 reap_dead start 2024-09-10T23:28:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.156+0000 7f56b3200640 1 -- 172.21.15.17:0/3960678907 shutdown_connections 2024-09-10T23:28:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.156+0000 7f56b3200640 1 -- 172.21.15.17:0/3960678907 >> 172.21.15.17:0/3960678907 conn(0x7f56b409a9f0 msgr2=0x7f56b409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.156+0000 7f56b3200640 1 -- 172.21.15.17:0/3960678907 shutdown_connections 2024-09-10T23:28:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.156+0000 7f56b3200640 1 -- 172.21.15.17:0/3960678907 wait complete. 2024-09-10T23:28:37.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.156+0000 7f56b3200640 1 Processor -- start 2024-09-10T23:28:37.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 -- start start 2024-09-10T23:28:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698004810 0x7f56b414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56b40d19f0 0x7f56b40d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40c9fb0 0x7f56b40ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f56b40b3090 con 0x7f56b40c9fb0 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56b40b2f10 con 0x7f5698004810 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f56b40b3210 con 0x7f56b40d19f0 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40c9fb0 0x7f56b40ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40c9fb0 0x7f56b40ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49258/0 (socket says 172.21.15.17:49258) 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b2800640 1 -- 172.21.15.17:0/693956127 learned_addr learned my addr 172.21.15.17:0/693956127 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b1e00640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698004810 0x7f56b414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56abe00640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56b40d19f0 0x7f56b40d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b2800640 1 -- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56b40d19f0 msgr2=0x7f56b40d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b2800640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56b40d19f0 0x7f56b40d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b2800640 1 -- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698004810 msgr2=0x7f56b414a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b2800640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698004810 0x7f56b414a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b2800640 1 -- 172.21.15.17:0/693956127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b40ca970 con 0x7f56b40c9fb0 2024-09-10T23:28:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b2800640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40c9fb0 0x7f56b40ca430 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f56b40d1670 tx=0x7f56ac012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56aa000640 1 -- 172.21.15.17:0/693956127 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0139e0 con 0x7f56b40c9fb0 2024-09-10T23:28:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56aa000640 1 -- 172.21.15.17:0/693956127 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ac013ba0 con 0x7f56b40c9fb0 2024-09-10T23:28:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56aa000640 1 -- 172.21.15.17:0/693956127 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac010480 con 0x7f56b40c9fb0 2024-09-10T23:28:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b40cac20 con 0x7f56b40c9fb0 2024-09-10T23:28:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b40cb1e0 con 0x7f56b40c9fb0 2024-09-10T23:28:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.160+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b40d23b0 con 0x7f56b40c9fb0 2024-09-10T23:28:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.164+0000 7f56aa000640 1 -- 172.21.15.17:0/693956127 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f56ac010640 con 0x7f56b40c9fb0 2024-09-10T23:28:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.164+0000 7f56aa000640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56900725e0 0x7f5690074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.164+0000 7f56aa000640 1 -- 172.21.15.17:0/693956127 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f56ac0972f0 con 0x7f56b40c9fb0 2024-09-10T23:28:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.164+0000 7f56b1e00640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56900725e0 0x7f5690074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.164+0000 7f56b1e00640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56900725e0 0x7f5690074aa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f56a4005e10 tx=0x7f56a40091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:37.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.168+0000 7f56aa000640 1 -- 172.21.15.17:0/693956127 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f56ac062150 con 0x7f56b40c9fb0 2024-09-10T23:28:37.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.376+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f56b406eac0 con 0x7f56b40c9fb0 2024-09-10T23:28:37.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.972+0000 7f56aa000640 1 -- 172.21.15.17:0/693956127 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v133) ==== 122+0+0 (secure 0 0 0) 0x7f56ac066b80 con 0x7f56b40c9fb0 2024-09-10T23:28:37.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56900725e0 msgr2=0x7f5690074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:37.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56900725e0 0x7f5690074aa0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f56a4005e10 tx=0x7f56a40091e0 comp rx=0 tx=0).stop 2024-09-10T23:28:37.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40c9fb0 msgr2=0x7f56b40ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40c9fb0 0x7f56b40ca430 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f56b40d1670 tx=0x7f56ac012870 comp rx=0 tx=0).stop 2024-09-10T23:28:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 shutdown_connections 2024-09-10T23:28:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f56900725e0 0x7f5690074aa0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56b40c9fb0 0x7f56b40ca430 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56b40d19f0 0x7f56b40d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 --2- 172.21.15.17:0/693956127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5698004810 0x7f56b414a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 >> 172.21.15.17:0/693956127 conn(0x7f56b409a9f0 msgr2=0x7f56b40b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 shutdown_connections 2024-09-10T23:28:37.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:37.976+0000 7f56b3200640 1 -- 172.21.15.17:0/693956127 wait complete. 2024-09-10T23:28:38.006 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:28:38.006 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:38.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 -- 172.21.15.17:0/2481311173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f000d02e0 msgr2=0x7f2f000b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 --2- 172.21.15.17:0/2481311173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f000d02e0 0x7f2f000b2a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009900 tx=0x7f2ee801c8b0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 -- 172.21.15.17:0/2481311173 shutdown_connections 2024-09-10T23:28:38.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 --2- 172.21.15.17:0/2481311173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f000d02e0 0x7f2f000b2a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 --2- 172.21.15.17:0/2481311173 >> v2:172.21.15.77:3300/0 conn(0x7f2f0015f130 0x7f2f000b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 -- 172.21.15.17:0/2481311173 >> 172.21.15.17:0/2481311173 conn(0x7f2f000b3870 msgr2=0x7f2f000b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:38.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 -- 172.21.15.17:0/2481311173 shutdown_connections 2024-09-10T23:28:38.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 -- 172.21.15.17:0/2481311173 wait complete. 2024-09-10T23:28:38.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 Processor -- start 2024-09-10T23:28:38.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.152+0000 7f2f05600640 1 -- start start 2024-09-10T23:28:38.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2f05600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f000d02e0 0x7f2f0014a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2f05600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f0015f130 0x7f2f000c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2f05600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f0015f510 0x7f2f000b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2f05600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f001691e0 con 0x7f2f000d02e0 2024-09-10T23:28:38.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2f05600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f00169060 con 0x7f2f0015f130 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2f05600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2f00169360 con 0x7f2f0015f510 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2efea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f000d02e0 0x7f2f0014a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2efea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f000d02e0 0x7f2f0014a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49260/0 (socket says 172.21.15.17:49260) 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2efea00640 1 -- 172.21.15.17:0/3832716309 learned_addr learned my addr 172.21.15.17:0/3832716309 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2ef6000640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f0015f130 0x7f2f000c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2eff400640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f0015f510 0x7f2f000b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2efea00640 1 -- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f0015f510 msgr2=0x7f2f000b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2efea00640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f0015f510 0x7f2f000b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2efea00640 1 -- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f0015f130 msgr2=0x7f2f000c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2efea00640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f0015f130 0x7f2f000c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2efea00640 1 -- 172.21.15.17:0/3832716309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0014a650 con 0x7f2f000d02e0 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2efea00640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f000d02e0 0x7f2f0014a110 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000e9f0 tx=0x7f2ef000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:38.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2ef7400640 1 -- 172.21.15.17:0/3832716309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000cd80 con 0x7f2f000d02e0 2024-09-10T23:28:38.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2ef7400640 1 -- 172.21.15.17:0/3832716309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ef0010430 con 0x7f2f000d02e0 2024-09-10T23:28:38.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f000c85a0 con 0x7f2f000d02e0 2024-09-10T23:28:38.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2ef7400640 1 -- 172.21.15.17:0/3832716309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0010860 con 0x7f2f000d02e0 2024-09-10T23:28:38.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f000afee0 con 0x7f2f000d02e0 2024-09-10T23:28:38.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.156+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f000b2a00 con 0x7f2f000d02e0 2024-09-10T23:28:38.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.160+0000 7f2ef7400640 1 -- 172.21.15.17:0/3832716309 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2ef0010a00 con 0x7f2f000d02e0 2024-09-10T23:28:38.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.160+0000 7f2ef7400640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2edc072610 0x7f2edc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.160+0000 7f2ef7400640 1 -- 172.21.15.17:0/3832716309 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f2ef0093fe0 con 0x7f2f000d02e0 2024-09-10T23:28:38.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.160+0000 7f2ef6000640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2edc072610 0x7f2edc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.160+0000 7f2ef6000640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2edc072610 0x7f2edc074ad0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80af000 tx=0x7f2ee801b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.164+0000 7f2ef7400640 1 -- 172.21.15.17:0/3832716309 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2ef005ef00 con 0x7f2f000d02e0 2024-09-10T23:28:38.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f000b2250 con 0x7f2f000d02e0 2024-09-10T23:28:38.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2ef7400640 1 -- 172.21.15.17:0/3832716309 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) ==== 95+0+5238 (secure 0 0 0) 0x7f2ef0063930 con 0x7f2f000d02e0 2024-09-10T23:28:38.376 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:38.376 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":133,"btime":"2024-09-10T23:28:37:977949+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1319528493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1319528493},{"type":"v1","addr":"172.21.15.17:6833","nonce":1319528493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1685364651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1685364651},{"type":"v1","addr":"172.21.15.77:6836","nonce":1685364651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129},{"gid":9436,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3587135392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3587135392},{"type":"v1","addr":"172.21.15.77:6837","nonce":3587135392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":133,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:28:34.352047+0000","modified":"2024-09-10T23:28:37.384077+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10197},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10197":{"gid":10197,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3849451590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3849451590},{"type":"v1","addr":"172.21.15.17:6835","nonce":3849451590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10197,"qdb_cluster":[10197]},"id":12}]} 2024-09-10T23:28:38.377 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 133 2024-09-10T23:28:38.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2edc072610 msgr2=0x7f2edc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2edc072610 0x7f2edc074ad0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80af000 tx=0x7f2ee801b0f0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f000d02e0 msgr2=0x7f2f0014a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f000d02e0 0x7f2f0014a110 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000e9f0 tx=0x7f2ef000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 shutdown_connections 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2edc072610 0x7f2edc074ad0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f0015f510 0x7f2f000b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f0015f130 0x7f2f000c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 --2- 172.21.15.17:0/3832716309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f000d02e0 0x7f2f0014a110 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 >> 172.21.15.17:0/3832716309 conn(0x7f2f000b3870 msgr2=0x7f2f0006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 shutdown_connections 2024-09-10T23:28:38.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.372+0000 7f2f05600640 1 -- 172.21.15.17:0/3832716309 wait complete. 2024-09-10T23:28:38.398 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:28:38.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:28:38.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:28:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 -- 172.21.15.17:0/1578411970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c070ad0 msgr2=0x7f577c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 --2- 172.21.15.17:0/1578411970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c070ad0 0x7f577c15f060 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f577c0b7de0 tx=0x7f576c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 -- 172.21.15.17:0/1578411970 shutdown_connections 2024-09-10T23:28:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 --2- 172.21.15.17:0/1578411970 >> v2:172.21.15.77:3300/0 conn(0x7f577c0cf320 0x7f577c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 --2- 172.21.15.17:0/1578411970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c070ad0 0x7f577c15f060 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 -- 172.21.15.17:0/1578411970 >> 172.21.15.17:0/1578411970 conn(0x7f577c0d1d60 msgr2=0x7f577c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 -- 172.21.15.17:0/1578411970 shutdown_connections 2024-09-10T23:28:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 -- 172.21.15.17:0/1578411970 wait complete. 2024-09-10T23:28:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 Processor -- start 2024-09-10T23:28:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.540+0000 7f5783000640 1 -- start start 2024-09-10T23:28:38.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5783000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c070ad0 0x7f577c0b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5783000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c0cf320 0x7f577c1fba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5783000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f577c0d1830 0x7f577c165f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5783000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f577c169350 con 0x7f577c0cf320 2024-09-10T23:28:38.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5783000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f577c1691d0 con 0x7f577c070ad0 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5783000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f577c1694d0 con 0x7f577c0d1830 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5773e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c0cf320 0x7f577c1fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5773e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c0cf320 0x7f577c1fba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49270/0 (socket says 172.21.15.17:49270) 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5773e00640 1 -- 172.21.15.17:0/1223792113 learned_addr learned my addr 172.21.15.17:0/1223792113 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f577be00640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c070ad0 0x7f577c0b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5781000640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f577c0d1830 0x7f577c165f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5773e00640 1 -- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f577c0d1830 msgr2=0x7f577c165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5773e00640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f577c0d1830 0x7f577c165f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5773e00640 1 -- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c070ad0 msgr2=0x7f577c0b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5773e00640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c070ad0 0x7f577c0b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5773e00640 1 -- 172.21.15.17:0/1223792113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c0af990 con 0x7f577c0cf320 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5773e00640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c0cf320 0x7f577c1fba70 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f576400b3e0 tx=0x7f576400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5778c00640 1 -- 172.21.15.17:0/1223792113 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5764015020 con 0x7f577c0cf320 2024-09-10T23:28:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5778c00640 1 -- 172.21.15.17:0/1223792113 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5764011940 con 0x7f577c0cf320 2024-09-10T23:28:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577c0b1d00 con 0x7f577c0cf320 2024-09-10T23:28:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5778c00640 1 -- 172.21.15.17:0/1223792113 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5764011d90 con 0x7f577c0cf320 2024-09-10T23:28:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f577c0af0f0 con 0x7f577c0cf320 2024-09-10T23:28:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.544+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f577c15f060 con 0x7f577c0cf320 2024-09-10T23:28:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.548+0000 7f5778c00640 1 -- 172.21.15.17:0/1223792113 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f576401a400 con 0x7f577c0cf320 2024-09-10T23:28:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.548+0000 7f5778c00640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5758072610 0x7f5758074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.548+0000 7f5778c00640 1 -- 172.21.15.17:0/1223792113 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f57640936e0 con 0x7f577c0cf320 2024-09-10T23:28:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.548+0000 7f577be00640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5758072610 0x7f5758074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.548+0000 7f577be00640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5758072610 0x7f5758074ad0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f576c0af000 tx=0x7f576c01b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:38.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.552+0000 7f5778c00640 1 -- 172.21.15.17:0/1223792113 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f576401f020 con 0x7f577c0cf320 2024-09-10T23:28:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.728+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f577c0b4760 con 0x7f577c0cf320 2024-09-10T23:28:38.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.728+0000 7f5778c00640 1 -- 172.21.15.17:0/1223792113 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+16888 (secure 0 0 0) 0x7f576405eba0 con 0x7f577c0cf320 2024-09-10T23:28:38.734 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:38.734 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":177,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:28:35.947957+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:28:32.104576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-10T23:28:33.310367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5758072610 msgr2=0x7f5758074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5758072610 0x7f5758074ad0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f576c0af000 tx=0x7f576c01b100 comp rx=0 tx=0).stop 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c0cf320 msgr2=0x7f577c1fba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c0cf320 0x7f577c1fba70 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f576400b3e0 tx=0x7f576400b8a0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 shutdown_connections 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5758072610 0x7f5758074ad0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f577c0d1830 0x7f577c165f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f577c0cf320 0x7f577c1fba70 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 --2- 172.21.15.17:0/1223792113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f577c070ad0 0x7f577c0b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 >> 172.21.15.17:0/1223792113 conn(0x7f577c0d1d60 msgr2=0x7f577c0b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:38.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 shutdown_connections 2024-09-10T23:28:38.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.732+0000 7f5783000640 1 -- 172.21.15.17:0/1223792113 wait complete. 2024-09-10T23:28:38.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:28:38.757 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:28:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 -- 172.21.15.17:0/2221989031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a4160280 msgr2=0x7f82a40cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 --2- 172.21.15.17:0/2221989031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a4160280 0x7f82a40cfaf0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f82a4074450 tx=0x7f829401eff0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 -- 172.21.15.17:0/2221989031 shutdown_connections 2024-09-10T23:28:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 --2- 172.21.15.17:0/2221989031 >> v2:172.21.15.77:3300/0 conn(0x7f82a4160660 0x7f82a40d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 --2- 172.21.15.17:0/2221989031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a4160280 0x7f82a40cfaf0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 -- 172.21.15.17:0/2221989031 >> 172.21.15.17:0/2221989031 conn(0x7f82a40d1d10 msgr2=0x7f82a40d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 -- 172.21.15.17:0/2221989031 shutdown_connections 2024-09-10T23:28:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 -- 172.21.15.17:0/2221989031 wait complete. 2024-09-10T23:28:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 Processor -- start 2024-09-10T23:28:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 -- start start 2024-09-10T23:28:38.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a40d2830 0x7f82a41efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a4160280 0x7f82a40c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82a4160660 0x7f82a40c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f82a40afe30 con 0x7f82a40d2830 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82a40afcb0 con 0x7f82a4160280 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a8a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82a40affb0 con 0x7f82a4160660 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a40d2830 0x7f82a41efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a40d2830 0x7f82a41efcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49300/0 (socket says 172.21.15.17:49300) 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a1e00640 1 -- 172.21.15.17:0/2371058525 learned_addr learned my addr 172.21.15.17:0/2371058525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f82a2800640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82a4160660 0x7f82a40c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.900+0000 7f829be00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a4160280 0x7f82a40c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f82a1e00640 1 -- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82a4160660 msgr2=0x7f82a40c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f82a1e00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82a4160660 0x7f82a40c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f82a1e00640 1 -- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a4160280 msgr2=0x7f82a40c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:38.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f82a1e00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a4160280 0x7f82a40c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:38.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f82a1e00640 1 -- 172.21.15.17:0/2371058525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a40ca7f0 con 0x7f82a40d2830 2024-09-10T23:28:38.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f82a1e00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a40d2830 0x7f82a41efcd0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f8294009790 tx=0x7f82940a8c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:38.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f829a000640 1 -- 172.21.15.17:0/2371058525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940b5040 con 0x7f82a40d2830 2024-09-10T23:28:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f829a000640 1 -- 172.21.15.17:0/2371058525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82940bf070 con 0x7f82a40d2830 2024-09-10T23:28:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f829a000640 1 -- 172.21.15.17:0/2371058525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940b1bb0 con 0x7f82a40d2830 2024-09-10T23:28:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a41f0210 con 0x7f82a40d2830 2024-09-10T23:28:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a41f3560 con 0x7f82a40d2830 2024-09-10T23:28:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a40b04a0 con 0x7f82a40d2830 2024-09-10T23:28:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.904+0000 7f829a000640 1 -- 172.21.15.17:0/2371058525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f82940b8030 con 0x7f82a40d2830 2024-09-10T23:28:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.908+0000 7f829a000640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82800725e0 0x7f8280074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.908+0000 7f829a000640 1 -- 172.21.15.17:0/2371058525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f8294130cb0 con 0x7f82a40d2830 2024-09-10T23:28:38.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.908+0000 7f829be00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82800725e0 0x7f8280074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:38.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.908+0000 7f829be00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82800725e0 0x7f8280074aa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f82a4158ae0 tx=0x7f828c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:38.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:38.912+0000 7f829a000640 1 -- 172.21.15.17:0/2371058525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f82a40ca7f0 con 0x7f82a40d2830 2024-09-10T23:28:39.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.084+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82a4074af0 con 0x7f82800725e0 2024-09-10T23:28:39.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.088+0000 7f829a000640 1 -- 172.21.15.17:0/2371058525 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252470 (secure 0 0 0) 0x7f82a4074af0 con 0x7f82800725e0 2024-09-10T23:28:39.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:39.098 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:28:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82800725e0 msgr2=0x7f8280074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82800725e0 0x7f8280074aa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f82a4158ae0 tx=0x7f828c009040 comp rx=0 tx=0).stop 2024-09-10T23:28:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a40d2830 msgr2=0x7f82a41efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a40d2830 0x7f82a41efcd0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f8294009790 tx=0x7f82940a8c80 comp rx=0 tx=0).stop 2024-09-10T23:28:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 shutdown_connections 2024-09-10T23:28:39.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82800725e0 0x7f8280074aa0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82a4160660 0x7f82a40c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82a4160280 0x7f82a40c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 --2- 172.21.15.17:0/2371058525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82a40d2830 0x7f82a41efcd0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 >> 172.21.15.17:0/2371058525 conn(0x7f82a40d1d10 msgr2=0x7f82a415f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 shutdown_connections 2024-09-10T23:28:39.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.092+0000 7f82a8a00640 1 -- 172.21.15.17:0/2371058525 wait complete. 2024-09-10T23:28:39.117 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2024-09-10T23:28:38.481975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":553696,"kb_used_data":18400,"kb_used_omap":12,"kb_used_meta":535091,"kb_avail":754421024,"statfs":{"total":773094113280,"available":772527128576,"internally_reserved":0,"allocated":18841600,"data_stored":9474627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":547933745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.548199"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.972704+0000","last_change":"2024-09-10T23:28:34.965879+0000","last_active":"2024-09-10T23:28:34.972704+0000","last_peered":"2024-09-10T23:28:34.972704+0000","last_clean":"2024-09-10T23:28:34.972704+0000","last_became_active":"2024-09-10T23:28:34.965524+0000","last_became_peered":"2024-09-10T23:28:34.965524+0000","last_unstale":"2024-09-10T23:28:34.972704+0000","last_undegraded":"2024-09-10T23:28:34.972704+0000","last_fullsized":"2024-09-10T23:28:34.972704+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:23.455232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.973598+0000","last_change":"2024-09-10T23:28:34.970548+0000","last_active":"2024-09-10T23:28:34.973598+0000","last_peered":"2024-09-10T23:28:34.973598+0000","last_clean":"2024-09-10T23:28:34.973598+0000","last_became_active":"2024-09-10T23:28:34.970269+0000","last_became_peered":"2024-09-10T23:28:34.970269+0000","last_unstale":"2024-09-10T23:28:34.973598+0000","last_undegraded":"2024-09-10T23:28:34.973598+0000","last_fullsized":"2024-09-10T23:28:34.973598+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:54.739800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962686+0000","last_change":"2024-09-10T23:28:34.982744+0000","last_active":"2024-09-10T23:28:35.962686+0000","last_peered":"2024-09-10T23:28:35.962686+0000","last_clean":"2024-09-10T23:28:35.962686+0000","last_became_active":"2024-09-10T23:28:34.982380+0000","last_became_peered":"2024-09-10T23:28:34.982380+0000","last_unstale":"2024-09-10T23:28:35.962686+0000","last_undegraded":"2024-09-10T23:28:35.962686+0000","last_fullsized":"2024-09-10T23:28:35.962686+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:03.834679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.971983+0000","last_change":"2024-09-10T23:28:34.969448+0000","last_active":"2024-09-10T23:28:34.971983+0000","last_peered":"2024-09-10T23:28:34.971983+0000","last_clean":"2024-09-10T23:28:34.971983+0000","last_became_active":"2024-09-10T23:28:34.969151+0000","last_became_peered":"2024-09-10T23:28:34.969151+0000","last_unstale":"2024-09-10T23:28:34.971983+0000","last_undegraded":"2024-09-10T23:28:34.971983+0000","last_fullsized":"2024-09-10T23:28:34.971983+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:57.830630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376568+0000","last_change":"2024-09-10T23:28:34.979375+0000","last_active":"2024-09-10T23:28:36.376568+0000","last_peered":"2024-09-10T23:28:36.376568+0000","last_clean":"2024-09-10T23:28:36.376568+0000","last_became_active":"2024-09-10T23:28:34.979101+0000","last_became_peered":"2024-09-10T23:28:34.979101+0000","last_unstale":"2024-09-10T23:28:36.376568+0000","last_undegraded":"2024-09-10T23:28:36.376568+0000","last_fullsized":"2024-09-10T23:28:36.376568+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:51.111925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376369+0000","last_change":"2024-09-10T23:28:34.966594+0000","last_active":"2024-09-10T23:28:36.376369+0000","last_peered":"2024-09-10T23:28:36.376369+0000","last_clean":"2024-09-10T23:28:36.376369+0000","last_became_active":"2024-09-10T23:28:34.966330+0000","last_became_peered":"2024-09-10T23:28:34.966330+0000","last_unstale":"2024-09-10T23:28:36.376369+0000","last_undegraded":"2024-09-10T23:28:36.376369+0000","last_fullsized":"2024-09-10T23:28:36.376369+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:21.035691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.975677+0000","last_change":"2024-09-10T23:28:34.968045+0000","last_active":"2024-09-10T23:28:34.975677+0000","last_peered":"2024-09-10T23:28:34.975677+0000","last_clean":"2024-09-10T23:28:34.975677+0000","last_became_active":"2024-09-10T23:28:34.967608+0000","last_became_peered":"2024-09-10T23:28:34.967608+0000","last_unstale":"2024-09-10T23:28:34.975677+0000","last_undegraded":"2024-09-10T23:28:34.975677+0000","last_fullsized":"2024-09-10T23:28:34.975677+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:06.634683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.984865+0000","last_change":"2024-09-10T23:28:34.979646+0000","last_active":"2024-09-10T23:28:34.984865+0000","last_peered":"2024-09-10T23:28:34.984865+0000","last_clean":"2024-09-10T23:28:34.984865+0000","last_became_active":"2024-09-10T23:28:34.979219+0000","last_became_peered":"2024-09-10T23:28:34.979219+0000","last_unstale":"2024-09-10T23:28:34.984865+0000","last_undegraded":"2024-09-10T23:28:34.984865+0000","last_fullsized":"2024-09-10T23:28:34.984865+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:03.854845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.977054+0000","last_change":"2024-09-10T23:28:34.973444+0000","last_active":"2024-09-10T23:28:34.977054+0000","last_peered":"2024-09-10T23:28:34.977054+0000","last_clean":"2024-09-10T23:28:34.977054+0000","last_became_active":"2024-09-10T23:28:34.972467+0000","last_became_peered":"2024-09-10T23:28:34.972467+0000","last_unstale":"2024-09-10T23:28:34.977054+0000","last_undegraded":"2024-09-10T23:28:34.977054+0000","last_fullsized":"2024-09-10T23:28:34.977054+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:07.976471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376892+0000","last_change":"2024-09-10T23:28:34.974355+0000","last_active":"2024-09-10T23:28:36.376892+0000","last_peered":"2024-09-10T23:28:36.376892+0000","last_clean":"2024-09-10T23:28:36.376892+0000","last_became_active":"2024-09-10T23:28:34.974062+0000","last_became_peered":"2024-09-10T23:28:34.974062+0000","last_unstale":"2024-09-10T23:28:36.376892+0000","last_undegraded":"2024-09-10T23:28:36.376892+0000","last_fullsized":"2024-09-10T23:28:36.376892+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:37.454505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.980763+0000","last_change":"2024-09-10T23:28:34.978041+0000","last_active":"2024-09-10T23:28:34.980763+0000","last_peered":"2024-09-10T23:28:34.980763+0000","last_clean":"2024-09-10T23:28:34.980763+0000","last_became_active":"2024-09-10T23:28:34.977698+0000","last_became_peered":"2024-09-10T23:28:34.977698+0000","last_unstale":"2024-09-10T23:28:34.980763+0000","last_undegraded":"2024-09-10T23:28:34.980763+0000","last_fullsized":"2024-09-10T23:28:34.980763+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:48.367301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.980598+0000","last_change":"2024-09-10T23:28:34.974386+0000","last_active":"2024-09-10T23:28:34.980598+0000","last_peered":"2024-09-10T23:28:34.980598+0000","last_clean":"2024-09-10T23:28:34.980598+0000","last_became_active":"2024-09-10T23:28:34.974047+0000","last_became_peered":"2024-09-10T23:28:34.974047+0000","last_unstale":"2024-09-10T23:28:34.980598+0000","last_undegraded":"2024-09-10T23:28:34.980598+0000","last_fullsized":"2024-09-10T23:28:34.980598+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:59.297213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981323+0000","last_change":"2024-09-10T23:28:34.974984+0000","last_active":"2024-09-10T23:28:34.981323+0000","last_peered":"2024-09-10T23:28:34.981323+0000","last_clean":"2024-09-10T23:28:34.981323+0000","last_became_active":"2024-09-10T23:28:34.974717+0000","last_became_peered":"2024-09-10T23:28:34.974717+0000","last_unstale":"2024-09-10T23:28:34.981323+0000","last_undegraded":"2024-09-10T23:28:34.981323+0000","last_fullsized":"2024-09-10T23:28:34.981323+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:20.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.982164+0000","last_change":"2024-09-10T23:28:34.977742+0000","last_active":"2024-09-10T23:28:34.982164+0000","last_peered":"2024-09-10T23:28:34.982164+0000","last_clean":"2024-09-10T23:28:34.982164+0000","last_became_active":"2024-09-10T23:28:34.977466+0000","last_became_peered":"2024-09-10T23:28:34.977466+0000","last_unstale":"2024-09-10T23:28:34.982164+0000","last_undegraded":"2024-09-10T23:28:34.982164+0000","last_fullsized":"2024-09-10T23:28:34.982164+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:15.897140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.962179+0000","last_change":"2024-09-10T23:28:34.958487+0000","last_active":"2024-09-10T23:28:34.962179+0000","last_peered":"2024-09-10T23:28:34.962179+0000","last_clean":"2024-09-10T23:28:34.962179+0000","last_became_active":"2024-09-10T23:28:34.957641+0000","last_became_peered":"2024-09-10T23:28:34.957641+0000","last_unstale":"2024-09-10T23:28:34.962179+0000","last_undegraded":"2024-09-10T23:28:34.962179+0000","last_fullsized":"2024-09-10T23:28:34.962179+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:30.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.375897+0000","last_change":"2024-09-10T23:28:34.980366+0000","last_active":"2024-09-10T23:28:36.375897+0000","last_peered":"2024-09-10T23:28:36.375897+0000","last_clean":"2024-09-10T23:28:36.375897+0000","last_became_active":"2024-09-10T23:28:34.979322+0000","last_became_peered":"2024-09-10T23:28:34.979322+0000","last_unstale":"2024-09-10T23:28:36.375897+0000","last_undegraded":"2024-09-10T23:28:36.375897+0000","last_fullsized":"2024-09-10T23:28:36.375897+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:46.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.377174+0000","last_change":"2024-09-10T23:28:34.976979+0000","last_active":"2024-09-10T23:28:36.377174+0000","last_peered":"2024-09-10T23:28:36.377174+0000","last_clean":"2024-09-10T23:28:36.377174+0000","last_became_active":"2024-09-10T23:28:34.973824+0000","last_became_peered":"2024-09-10T23:28:34.973824+0000","last_unstale":"2024-09-10T23:28:36.377174+0000","last_undegraded":"2024-09-10T23:28:36.377174+0000","last_fullsized":"2024-09-10T23:28:36.377174+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:32.427612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.978776+0000","last_change":"2024-09-10T23:28:34.972461+0000","last_active":"2024-09-10T23:28:34.978776+0000","last_peered":"2024-09-10T23:28:34.978776+0000","last_clean":"2024-09-10T23:28:34.978776+0000","last_became_active":"2024-09-10T23:28:34.972195+0000","last_became_peered":"2024-09-10T23:28:34.972195+0000","last_unstale":"2024-09-10T23:28:34.978776+0000","last_undegraded":"2024-09-10T23:28:34.978776+0000","last_fullsized":"2024-09-10T23:28:34.978776+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:17.278548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.974357+0000","last_change":"2024-09-10T23:28:34.969848+0000","last_active":"2024-09-10T23:28:34.974357+0000","last_peered":"2024-09-10T23:28:34.974357+0000","last_clean":"2024-09-10T23:28:34.974357+0000","last_became_active":"2024-09-10T23:28:34.968232+0000","last_became_peered":"2024-09-10T23:28:34.968232+0000","last_unstale":"2024-09-10T23:28:34.974357+0000","last_undegraded":"2024-09-10T23:28:34.974357+0000","last_fullsized":"2024-09-10T23:28:34.974357+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:50.775025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376648+0000","last_change":"2024-09-10T23:28:34.974676+0000","last_active":"2024-09-10T23:28:36.376648+0000","last_peered":"2024-09-10T23:28:36.376648+0000","last_clean":"2024-09-10T23:28:36.376648+0000","last_became_active":"2024-09-10T23:28:34.974389+0000","last_became_peered":"2024-09-10T23:28:34.974389+0000","last_unstale":"2024-09-10T23:28:36.376648+0000","last_undegraded":"2024-09-10T23:28:36.376648+0000","last_fullsized":"2024-09-10T23:28:36.376648+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:09.729024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.975442+0000","last_change":"2024-09-10T23:28:34.971818+0000","last_active":"2024-09-10T23:28:34.975442+0000","last_peered":"2024-09-10T23:28:34.975442+0000","last_clean":"2024-09-10T23:28:34.975442+0000","last_became_active":"2024-09-10T23:28:34.971506+0000","last_became_peered":"2024-09-10T23:28:34.971506+0000","last_unstale":"2024-09-10T23:28:34.975442+0000","last_undegraded":"2024-09-10T23:28:34.975442+0000","last_fullsized":"2024-09-10T23:28:34.975442+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:53.256216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.975779+0000","last_change":"2024-09-10T23:28:34.971694+0000","last_active":"2024-09-10T23:28:34.975779+0000","last_peered":"2024-09-10T23:28:34.975779+0000","last_clean":"2024-09-10T23:28:34.975779+0000","last_became_active":"2024-09-10T23:28:34.971427+0000","last_became_peered":"2024-09-10T23:28:34.971427+0000","last_unstale":"2024-09-10T23:28:34.975779+0000","last_undegraded":"2024-09-10T23:28:34.975779+0000","last_fullsized":"2024-09-10T23:28:34.975779+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:43.790460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.982053+0000","last_change":"2024-09-10T23:28:34.977060+0000","last_active":"2024-09-10T23:28:34.982053+0000","last_peered":"2024-09-10T23:28:34.982053+0000","last_clean":"2024-09-10T23:28:34.982053+0000","last_became_active":"2024-09-10T23:28:34.975296+0000","last_became_peered":"2024-09-10T23:28:34.975296+0000","last_unstale":"2024-09-10T23:28:34.982053+0000","last_undegraded":"2024-09-10T23:28:34.982053+0000","last_fullsized":"2024-09-10T23:28:34.982053+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:46.315738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.973782+0000","last_change":"2024-09-10T23:28:34.970801+0000","last_active":"2024-09-10T23:28:34.973782+0000","last_peered":"2024-09-10T23:28:34.973782+0000","last_clean":"2024-09-10T23:28:34.973782+0000","last_became_active":"2024-09-10T23:28:34.970525+0000","last_became_peered":"2024-09-10T23:28:34.970525+0000","last_unstale":"2024-09-10T23:28:34.973782+0000","last_undegraded":"2024-09-10T23:28:34.973782+0000","last_fullsized":"2024-09-10T23:28:34.973782+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:02.355873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.982773+0000","last_change":"2024-09-10T23:28:34.979520+0000","last_active":"2024-09-10T23:28:34.982773+0000","last_peered":"2024-09-10T23:28:34.982773+0000","last_clean":"2024-09-10T23:28:34.982773+0000","last_became_active":"2024-09-10T23:28:34.979172+0000","last_became_peered":"2024-09-10T23:28:34.979172+0000","last_unstale":"2024-09-10T23:28:34.982773+0000","last_undegraded":"2024-09-10T23:28:34.982773+0000","last_fullsized":"2024-09-10T23:28:34.982773+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:06.178207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.986515+0000","last_change":"2024-09-10T23:28:34.985523+0000","last_active":"2024-09-10T23:28:34.986515+0000","last_peered":"2024-09-10T23:28:34.986515+0000","last_clean":"2024-09-10T23:28:34.986515+0000","last_became_active":"2024-09-10T23:28:34.985056+0000","last_became_peered":"2024-09-10T23:28:34.985056+0000","last_unstale":"2024-09-10T23:28:34.986515+0000","last_undegraded":"2024-09-10T23:28:34.986515+0000","last_fullsized":"2024-09-10T23:28:34.986515+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:29.405620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.984692+0000","last_change":"2024-09-10T23:28:34.973368+0000","last_active":"2024-09-10T23:28:34.984692+0000","last_peered":"2024-09-10T23:28:34.984692+0000","last_clean":"2024-09-10T23:28:34.984692+0000","last_became_active":"2024-09-10T23:28:34.972865+0000","last_became_peered":"2024-09-10T23:28:34.972865+0000","last_unstale":"2024-09-10T23:28:34.984692+0000","last_undegraded":"2024-09-10T23:28:34.984692+0000","last_fullsized":"2024-09-10T23:28:34.984692+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:02.355873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376649+0000","last_change":"2024-09-10T23:28:34.979412+0000","last_active":"2024-09-10T23:28:36.376649+0000","last_peered":"2024-09-10T23:28:36.376649+0000","last_clean":"2024-09-10T23:28:36.376649+0000","last_became_active":"2024-09-10T23:28:34.979137+0000","last_became_peered":"2024-09-10T23:28:34.979137+0000","last_unstale":"2024-09-10T23:28:36.376649+0000","last_undegraded":"2024-09-10T23:28:36.376649+0000","last_fullsized":"2024-09-10T23:28:36.376649+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:39.363086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.984308+0000","last_change":"2024-09-10T23:28:34.978443+0000","last_active":"2024-09-10T23:28:34.984308+0000","last_peered":"2024-09-10T23:28:34.984308+0000","last_clean":"2024-09-10T23:28:34.984308+0000","last_became_active":"2024-09-10T23:28:34.978121+0000","last_became_peered":"2024-09-10T23:28:34.978121+0000","last_unstale":"2024-09-10T23:28:34.984308+0000","last_undegraded":"2024-09-10T23:28:34.984308+0000","last_fullsized":"2024-09-10T23:28:34.984308+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:20.786314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.983308+0000","last_change":"2024-09-10T23:28:34.978176+0000","last_active":"2024-09-10T23:28:34.983308+0000","last_peered":"2024-09-10T23:28:34.983308+0000","last_clean":"2024-09-10T23:28:34.983308+0000","last_became_active":"2024-09-10T23:28:34.977778+0000","last_became_peered":"2024-09-10T23:28:34.977778+0000","last_unstale":"2024-09-10T23:28:34.983308+0000","last_undegraded":"2024-09-10T23:28:34.983308+0000","last_fullsized":"2024-09-10T23:28:34.983308+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:25.082165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.964253+0000","last_change":"2024-09-10T23:28:34.963392+0000","last_active":"2024-09-10T23:28:34.964253+0000","last_peered":"2024-09-10T23:28:34.964253+0000","last_clean":"2024-09-10T23:28:34.964253+0000","last_became_active":"2024-09-10T23:28:34.962467+0000","last_became_peered":"2024-09-10T23:28:34.962467+0000","last_unstale":"2024-09-10T23:28:34.964253+0000","last_undegraded":"2024-09-10T23:28:34.964253+0000","last_fullsized":"2024-09-10T23:28:34.964253+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:50.427874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376122+0000","last_change":"2024-09-10T23:28:34.968609+0000","last_active":"2024-09-10T23:28:36.376122+0000","last_peered":"2024-09-10T23:28:36.376122+0000","last_clean":"2024-09-10T23:28:36.376122+0000","last_became_active":"2024-09-10T23:28:34.968325+0000","last_became_peered":"2024-09-10T23:28:34.968325+0000","last_unstale":"2024-09-10T23:28:36.376122+0000","last_undegraded":"2024-09-10T23:28:36.376122+0000","last_fullsized":"2024-09-10T23:28:36.376122+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:36.056180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981775+0000","last_change":"2024-09-10T23:28:34.974303+0000","last_active":"2024-09-10T23:28:34.981775+0000","last_peered":"2024-09-10T23:28:34.981775+0000","last_clean":"2024-09-10T23:28:34.981775+0000","last_became_active":"2024-09-10T23:28:34.974010+0000","last_became_peered":"2024-09-10T23:28:34.974010+0000","last_unstale":"2024-09-10T23:28:34.981775+0000","last_undegraded":"2024-09-10T23:28:34.981775+0000","last_fullsized":"2024-09-10T23:28:34.981775+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:53.256216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"176'4","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.994163+0000","last_change":"2024-09-10T23:28:33.958510+0000","last_active":"2024-09-10T23:28:34.994163+0000","last_peered":"2024-09-10T23:28:34.994163+0000","last_clean":"2024-09-10T23:28:34.994163+0000","last_became_active":"2024-09-10T23:28:33.956101+0000","last_became_peered":"2024-09-10T23:28:33.956101+0000","last_unstale":"2024-09-10T23:28:34.994163+0000","last_undegraded":"2024-09-10T23:28:34.994163+0000","last_fullsized":"2024-09-10T23:28:34.994163+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:53.687153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.975190+0000","last_change":"2024-09-10T23:28:34.967102+0000","last_active":"2024-09-10T23:28:34.975190+0000","last_peered":"2024-09-10T23:28:34.975190+0000","last_clean":"2024-09-10T23:28:34.975190+0000","last_became_active":"2024-09-10T23:28:34.966205+0000","last_became_peered":"2024-09-10T23:28:34.966205+0000","last_unstale":"2024-09-10T23:28:34.975190+0000","last_undegraded":"2024-09-10T23:28:34.975190+0000","last_fullsized":"2024-09-10T23:28:34.975190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:32.045619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376952+0000","last_change":"2024-09-10T23:28:33.958933+0000","last_active":"2024-09-10T23:28:36.376952+0000","last_peered":"2024-09-10T23:28:36.376952+0000","last_clean":"2024-09-10T23:28:36.376952+0000","last_became_active":"2024-09-10T23:28:33.957748+0000","last_became_peered":"2024-09-10T23:28:33.957748+0000","last_unstale":"2024-09-10T23:28:36.376952+0000","last_undegraded":"2024-09-10T23:28:36.376952+0000","last_fullsized":"2024-09-10T23:28:36.376952+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:24.060735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.983217+0000","last_change":"2024-09-10T23:28:34.978400+0000","last_active":"2024-09-10T23:28:34.983217+0000","last_peered":"2024-09-10T23:28:34.983217+0000","last_clean":"2024-09-10T23:28:34.983217+0000","last_became_active":"2024-09-10T23:28:34.978052+0000","last_became_peered":"2024-09-10T23:28:34.978052+0000","last_unstale":"2024-09-10T23:28:34.983217+0000","last_undegraded":"2024-09-10T23:28:34.983217+0000","last_fullsized":"2024-09-10T23:28:34.983217+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:33.307965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.996570+0000","last_change":"2024-09-10T23:28:33.958445+0000","last_active":"2024-09-10T23:28:34.996570+0000","last_peered":"2024-09-10T23:28:34.996570+0000","last_clean":"2024-09-10T23:28:34.996570+0000","last_became_active":"2024-09-10T23:28:33.958088+0000","last_became_peered":"2024-09-10T23:28:33.958088+0000","last_unstale":"2024-09-10T23:28:34.996570+0000","last_undegraded":"2024-09-10T23:28:34.996570+0000","last_fullsized":"2024-09-10T23:28:34.996570+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:46.801311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962964+0000","last_change":"2024-09-10T23:28:34.982640+0000","last_active":"2024-09-10T23:28:35.962964+0000","last_peered":"2024-09-10T23:28:35.962964+0000","last_clean":"2024-09-10T23:28:35.962964+0000","last_became_active":"2024-09-10T23:28:34.981659+0000","last_became_peered":"2024-09-10T23:28:34.981659+0000","last_unstale":"2024-09-10T23:28:35.962964+0000","last_undegraded":"2024-09-10T23:28:35.962964+0000","last_fullsized":"2024-09-10T23:28:35.962964+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:32.462320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.997103+0000","last_change":"2024-09-10T23:28:33.952910+0000","last_active":"2024-09-10T23:28:34.997103+0000","last_peered":"2024-09-10T23:28:34.997103+0000","last_clean":"2024-09-10T23:28:34.997103+0000","last_became_active":"2024-09-10T23:28:33.952509+0000","last_became_peered":"2024-09-10T23:28:33.952509+0000","last_unstale":"2024-09-10T23:28:34.997103+0000","last_undegraded":"2024-09-10T23:28:34.997103+0000","last_fullsized":"2024-09-10T23:28:34.997103+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:22.565695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.979429+0000","last_change":"2024-09-10T23:28:34.973595+0000","last_active":"2024-09-10T23:28:34.979429+0000","last_peered":"2024-09-10T23:28:34.979429+0000","last_clean":"2024-09-10T23:28:34.979429+0000","last_became_active":"2024-09-10T23:28:34.973300+0000","last_became_peered":"2024-09-10T23:28:34.973300+0000","last_unstale":"2024-09-10T23:28:34.979429+0000","last_undegraded":"2024-09-10T23:28:34.979429+0000","last_fullsized":"2024-09-10T23:28:34.979429+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:54.903389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376637+0000","last_change":"2024-09-10T23:28:33.957294+0000","last_active":"2024-09-10T23:28:36.376637+0000","last_peered":"2024-09-10T23:28:36.376637+0000","last_clean":"2024-09-10T23:28:36.376637+0000","last_became_active":"2024-09-10T23:28:33.956940+0000","last_became_peered":"2024-09-10T23:28:33.956940+0000","last_unstale":"2024-09-10T23:28:36.376637+0000","last_undegraded":"2024-09-10T23:28:36.376637+0000","last_fullsized":"2024-09-10T23:28:36.376637+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:45.334262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.962324+0000","last_change":"2024-09-10T23:28:34.960699+0000","last_active":"2024-09-10T23:28:34.962324+0000","last_peered":"2024-09-10T23:28:34.962324+0000","last_clean":"2024-09-10T23:28:34.962324+0000","last_became_active":"2024-09-10T23:28:34.960400+0000","last_became_peered":"2024-09-10T23:28:34.960400+0000","last_unstale":"2024-09-10T23:28:34.962324+0000","last_undegraded":"2024-09-10T23:28:34.962324+0000","last_fullsized":"2024-09-10T23:28:34.962324+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:17.936286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"176'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.992380+0000","last_change":"2024-09-10T23:28:33.955352+0000","last_active":"2024-09-10T23:28:34.992380+0000","last_peered":"2024-09-10T23:28:34.992380+0000","last_clean":"2024-09-10T23:28:34.992380+0000","last_became_active":"2024-09-10T23:28:33.954528+0000","last_became_peered":"2024-09-10T23:28:33.954528+0000","last_unstale":"2024-09-10T23:28:34.992380+0000","last_undegraded":"2024-09-10T23:28:34.992380+0000","last_fullsized":"2024-09-10T23:28:34.992380+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:16.514612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.962065+0000","last_change":"2024-09-10T23:28:34.959049+0000","last_active":"2024-09-10T23:28:34.962065+0000","last_peered":"2024-09-10T23:28:34.962065+0000","last_clean":"2024-09-10T23:28:34.962065+0000","last_became_active":"2024-09-10T23:28:34.958112+0000","last_became_peered":"2024-09-10T23:28:34.958112+0000","last_unstale":"2024-09-10T23:28:34.962065+0000","last_undegraded":"2024-09-10T23:28:34.962065+0000","last_fullsized":"2024-09-10T23:28:34.962065+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:26.831998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.961931+0000","last_change":"2024-09-10T23:28:33.958009+0000","last_active":"2024-09-10T23:28:34.961931+0000","last_peered":"2024-09-10T23:28:34.961931+0000","last_clean":"2024-09-10T23:28:34.961931+0000","last_became_active":"2024-09-10T23:28:33.957722+0000","last_became_peered":"2024-09-10T23:28:33.957722+0000","last_unstale":"2024-09-10T23:28:34.961931+0000","last_undegraded":"2024-09-10T23:28:34.961931+0000","last_fullsized":"2024-09-10T23:28:34.961931+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:02.828344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981803+0000","last_change":"2024-09-10T23:28:34.976348+0000","last_active":"2024-09-10T23:28:34.981803+0000","last_peered":"2024-09-10T23:28:34.981803+0000","last_clean":"2024-09-10T23:28:34.981803+0000","last_became_active":"2024-09-10T23:28:34.976026+0000","last_became_peered":"2024-09-10T23:28:34.976026+0000","last_unstale":"2024-09-10T23:28:34.981803+0000","last_undegraded":"2024-09-10T23:28:34.981803+0000","last_fullsized":"2024-09-10T23:28:34.981803+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:43.790460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.377119+0000","last_change":"2024-09-10T23:28:33.962677+0000","last_active":"2024-09-10T23:28:36.377119+0000","last_peered":"2024-09-10T23:28:36.377119+0000","last_clean":"2024-09-10T23:28:36.377119+0000","last_became_active":"2024-09-10T23:28:33.961585+0000","last_became_peered":"2024-09-10T23:28:33.961585+0000","last_unstale":"2024-09-10T23:28:36.377119+0000","last_undegraded":"2024-09-10T23:28:36.377119+0000","last_fullsized":"2024-09-10T23:28:36.377119+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:59.294376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376856+0000","last_change":"2024-09-10T23:28:34.967527+0000","last_active":"2024-09-10T23:28:36.376856+0000","last_peered":"2024-09-10T23:28:36.376856+0000","last_clean":"2024-09-10T23:28:36.376856+0000","last_became_active":"2024-09-10T23:28:34.967166+0000","last_became_peered":"2024-09-10T23:28:34.967166+0000","last_unstale":"2024-09-10T23:28:36.376856+0000","last_undegraded":"2024-09-10T23:28:36.376856+0000","last_fullsized":"2024-09-10T23:28:36.376856+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:25.580195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.951183+0000","last_change":"2024-09-10T23:28:33.953600+0000","last_active":"2024-09-10T23:28:34.951183+0000","last_peered":"2024-09-10T23:28:34.951183+0000","last_clean":"2024-09-10T23:28:34.951183+0000","last_became_active":"2024-09-10T23:28:33.953297+0000","last_became_peered":"2024-09-10T23:28:33.953297+0000","last_unstale":"2024-09-10T23:28:34.951183+0000","last_undegraded":"2024-09-10T23:28:34.951183+0000","last_fullsized":"2024-09-10T23:28:34.951183+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:59.769316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.983163+0000","last_change":"2024-09-10T23:28:34.978888+0000","last_active":"2024-09-10T23:28:34.983163+0000","last_peered":"2024-09-10T23:28:34.983163+0000","last_clean":"2024-09-10T23:28:34.983163+0000","last_became_active":"2024-09-10T23:28:34.978608+0000","last_became_peered":"2024-09-10T23:28:34.978608+0000","last_unstale":"2024-09-10T23:28:34.983163+0000","last_undegraded":"2024-09-10T23:28:34.983163+0000","last_fullsized":"2024-09-10T23:28:34.983163+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:42.298553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"176'3","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.992802+0000","last_change":"2024-09-10T23:28:33.953565+0000","last_active":"2024-09-10T23:28:34.992802+0000","last_peered":"2024-09-10T23:28:34.992802+0000","last_clean":"2024-09-10T23:28:34.992802+0000","last_became_active":"2024-09-10T23:28:33.953175+0000","last_became_peered":"2024-09-10T23:28:33.953175+0000","last_unstale":"2024-09-10T23:28:34.992802+0000","last_undegraded":"2024-09-10T23:28:34.992802+0000","last_fullsized":"2024-09-10T23:28:34.992802+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:01.398426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.976889+0000","last_change":"2024-09-10T23:28:34.972485+0000","last_active":"2024-09-10T23:28:34.976889+0000","last_peered":"2024-09-10T23:28:34.976889+0000","last_clean":"2024-09-10T23:28:34.976889+0000","last_became_active":"2024-09-10T23:28:34.972066+0000","last_became_peered":"2024-09-10T23:28:34.972066+0000","last_unstale":"2024-09-10T23:28:34.976889+0000","last_undegraded":"2024-09-10T23:28:34.976889+0000","last_fullsized":"2024-09-10T23:28:34.976889+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:46.315738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"176'6","reported_seq":19,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.999568+0000","last_change":"2024-09-10T23:28:33.958321+0000","last_active":"2024-09-10T23:28:34.999568+0000","last_peered":"2024-09-10T23:28:34.999568+0000","last_clean":"2024-09-10T23:28:34.999568+0000","last_became_active":"2024-09-10T23:28:33.957989+0000","last_became_peered":"2024-09-10T23:28:33.957989+0000","last_unstale":"2024-09-10T23:28:34.999568+0000","last_undegraded":"2024-09-10T23:28:34.999568+0000","last_fullsized":"2024-09-10T23:28:34.999568+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:32.239223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.978026+0000","last_change":"2024-09-10T23:28:34.974061+0000","last_active":"2024-09-10T23:28:34.978026+0000","last_peered":"2024-09-10T23:28:34.978026+0000","last_clean":"2024-09-10T23:28:34.978026+0000","last_became_active":"2024-09-10T23:28:34.968216+0000","last_became_peered":"2024-09-10T23:28:34.968216+0000","last_unstale":"2024-09-10T23:28:34.978026+0000","last_undegraded":"2024-09-10T23:28:34.978026+0000","last_fullsized":"2024-09-10T23:28:34.978026+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:56.273060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.998506+0000","last_change":"2024-09-10T23:28:33.943389+0000","last_active":"2024-09-10T23:28:34.998506+0000","last_peered":"2024-09-10T23:28:34.998506+0000","last_clean":"2024-09-10T23:28:34.998506+0000","last_became_active":"2024-09-10T23:28:33.943040+0000","last_became_peered":"2024-09-10T23:28:33.943040+0000","last_unstale":"2024-09-10T23:28:34.998506+0000","last_undegraded":"2024-09-10T23:28:34.998506+0000","last_fullsized":"2024-09-10T23:28:34.998506+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:31.455986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376144+0000","last_change":"2024-09-10T23:28:34.970301+0000","last_active":"2024-09-10T23:28:36.376144+0000","last_peered":"2024-09-10T23:28:36.376144+0000","last_clean":"2024-09-10T23:28:36.376144+0000","last_became_active":"2024-09-10T23:28:34.970023+0000","last_became_peered":"2024-09-10T23:28:34.970023+0000","last_unstale":"2024-09-10T23:28:36.376144+0000","last_undegraded":"2024-09-10T23:28:36.376144+0000","last_fullsized":"2024-09-10T23:28:36.376144+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:00.955657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.951605+0000","last_change":"2024-09-10T23:28:33.950506+0000","last_active":"2024-09-10T23:28:34.951605+0000","last_peered":"2024-09-10T23:28:34.951605+0000","last_clean":"2024-09-10T23:28:34.951605+0000","last_became_active":"2024-09-10T23:28:33.950187+0000","last_became_peered":"2024-09-10T23:28:33.950187+0000","last_unstale":"2024-09-10T23:28:34.951605+0000","last_undegraded":"2024-09-10T23:28:34.951605+0000","last_fullsized":"2024-09-10T23:28:34.951605+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:21.833452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.974551+0000","last_change":"2024-09-10T23:28:34.966560+0000","last_active":"2024-09-10T23:28:34.974551+0000","last_peered":"2024-09-10T23:28:34.974551+0000","last_clean":"2024-09-10T23:28:34.974551+0000","last_became_active":"2024-09-10T23:28:34.966253+0000","last_became_peered":"2024-09-10T23:28:34.966253+0000","last_unstale":"2024-09-10T23:28:34.974551+0000","last_undegraded":"2024-09-10T23:28:34.974551+0000","last_fullsized":"2024-09-10T23:28:34.974551+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:21.891268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.956880+0000","last_change":"2024-09-10T23:28:33.938875+0000","last_active":"2024-09-10T23:28:34.956880+0000","last_peered":"2024-09-10T23:28:34.956880+0000","last_clean":"2024-09-10T23:28:34.956880+0000","last_became_active":"2024-09-10T23:28:33.938543+0000","last_became_peered":"2024-09-10T23:28:33.938543+0000","last_unstale":"2024-09-10T23:28:34.956880+0000","last_undegraded":"2024-09-10T23:28:34.956880+0000","last_fullsized":"2024-09-10T23:28:34.956880+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:08.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981296+0000","last_change":"2024-09-10T23:28:34.973496+0000","last_active":"2024-09-10T23:28:34.981296+0000","last_peered":"2024-09-10T23:28:34.981296+0000","last_clean":"2024-09-10T23:28:34.981296+0000","last_became_active":"2024-09-10T23:28:34.973216+0000","last_became_peered":"2024-09-10T23:28:34.973216+0000","last_unstale":"2024-09-10T23:28:34.981296+0000","last_undegraded":"2024-09-10T23:28:34.981296+0000","last_fullsized":"2024-09-10T23:28:34.981296+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:16.717368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"176'8","reported_seq":21,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.999146+0000","last_change":"2024-09-10T23:28:33.962841+0000","last_active":"2024-09-10T23:28:34.999146+0000","last_peered":"2024-09-10T23:28:34.999146+0000","last_clean":"2024-09-10T23:28:34.999146+0000","last_became_active":"2024-09-10T23:28:33.962632+0000","last_became_peered":"2024-09-10T23:28:33.962632+0000","last_unstale":"2024-09-10T23:28:34.999146+0000","last_undegraded":"2024-09-10T23:28:34.999146+0000","last_fullsized":"2024-09-10T23:28:34.999146+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:48:43.120102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.964330+0000","last_change":"2024-09-10T23:28:34.963081+0000","last_active":"2024-09-10T23:28:34.964330+0000","last_peered":"2024-09-10T23:28:34.964330+0000","last_clean":"2024-09-10T23:28:34.964330+0000","last_became_active":"2024-09-10T23:28:34.962822+0000","last_became_peered":"2024-09-10T23:28:34.962822+0000","last_unstale":"2024-09-10T23:28:34.964330+0000","last_undegraded":"2024-09-10T23:28:34.964330+0000","last_fullsized":"2024-09-10T23:28:34.964330+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:17.459595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"176'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.998181+0000","last_change":"2024-09-10T23:28:33.954686+0000","last_active":"2024-09-10T23:28:34.998181+0000","last_peered":"2024-09-10T23:28:34.998181+0000","last_clean":"2024-09-10T23:28:34.998181+0000","last_became_active":"2024-09-10T23:28:33.954402+0000","last_became_peered":"2024-09-10T23:28:33.954402+0000","last_unstale":"2024-09-10T23:28:34.998181+0000","last_undegraded":"2024-09-10T23:28:34.998181+0000","last_fullsized":"2024-09-10T23:28:34.998181+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:04.623099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376706+0000","last_change":"2024-09-10T23:28:34.968633+0000","last_active":"2024-09-10T23:28:36.376706+0000","last_peered":"2024-09-10T23:28:36.376706+0000","last_clean":"2024-09-10T23:28:36.376706+0000","last_became_active":"2024-09-10T23:28:34.968356+0000","last_became_peered":"2024-09-10T23:28:34.968356+0000","last_unstale":"2024-09-10T23:28:36.376706+0000","last_undegraded":"2024-09-10T23:28:36.376706+0000","last_fullsized":"2024-09-10T23:28:36.376706+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:03.651473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.992169+0000","last_change":"2024-09-10T23:28:33.940306+0000","last_active":"2024-09-10T23:28:34.992169+0000","last_peered":"2024-09-10T23:28:34.992169+0000","last_clean":"2024-09-10T23:28:34.992169+0000","last_became_active":"2024-09-10T23:28:33.939978+0000","last_became_peered":"2024-09-10T23:28:33.939978+0000","last_unstale":"2024-09-10T23:28:34.992169+0000","last_undegraded":"2024-09-10T23:28:34.992169+0000","last_fullsized":"2024-09-10T23:28:34.992169+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:32.075978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.985848+0000","last_change":"2024-09-10T23:28:34.985090+0000","last_active":"2024-09-10T23:28:34.985848+0000","last_peered":"2024-09-10T23:28:34.985848+0000","last_clean":"2024-09-10T23:28:34.985848+0000","last_became_active":"2024-09-10T23:28:34.984821+0000","last_became_peered":"2024-09-10T23:28:34.984821+0000","last_unstale":"2024-09-10T23:28:34.985848+0000","last_undegraded":"2024-09-10T23:28:34.985848+0000","last_fullsized":"2024-09-10T23:28:34.985848+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:57.788377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962767+0000","last_change":"2024-09-10T23:28:33.959636+0000","last_active":"2024-09-10T23:28:35.962767+0000","last_peered":"2024-09-10T23:28:35.962767+0000","last_clean":"2024-09-10T23:28:35.962767+0000","last_became_active":"2024-09-10T23:28:33.958039+0000","last_became_peered":"2024-09-10T23:28:33.958039+0000","last_unstale":"2024-09-10T23:28:35.962767+0000","last_undegraded":"2024-09-10T23:28:35.962767+0000","last_fullsized":"2024-09-10T23:28:35.962767+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:36.252071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.972977+0000","last_change":"2024-09-10T23:28:34.969393+0000","last_active":"2024-09-10T23:28:34.972977+0000","last_peered":"2024-09-10T23:28:34.972977+0000","last_clean":"2024-09-10T23:28:34.972977+0000","last_became_active":"2024-09-10T23:28:34.969090+0000","last_became_peered":"2024-09-10T23:28:34.969090+0000","last_unstale":"2024-09-10T23:28:34.972977+0000","last_undegraded":"2024-09-10T23:28:34.972977+0000","last_fullsized":"2024-09-10T23:28:34.972977+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:51.755480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.969094+0000","last_change":"2024-09-10T23:28:33.955496+0000","last_active":"2024-09-10T23:28:34.969094+0000","last_peered":"2024-09-10T23:28:34.969094+0000","last_clean":"2024-09-10T23:28:34.969094+0000","last_became_active":"2024-09-10T23:28:33.955196+0000","last_became_peered":"2024-09-10T23:28:33.955196+0000","last_unstale":"2024-09-10T23:28:34.969094+0000","last_undegraded":"2024-09-10T23:28:34.969094+0000","last_fullsized":"2024-09-10T23:28:34.969094+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:16.306297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.973758+0000","last_change":"2024-09-10T23:28:34.969492+0000","last_active":"2024-09-10T23:28:34.973758+0000","last_peered":"2024-09-10T23:28:34.973758+0000","last_clean":"2024-09-10T23:28:34.973758+0000","last_became_active":"2024-09-10T23:28:34.968029+0000","last_became_peered":"2024-09-10T23:28:34.968029+0000","last_unstale":"2024-09-10T23:28:34.973758+0000","last_undegraded":"2024-09-10T23:28:34.973758+0000","last_fullsized":"2024-09-10T23:28:34.973758+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:14.474963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.996796+0000","last_change":"2024-09-10T23:28:33.951643+0000","last_active":"2024-09-10T23:28:34.996796+0000","last_peered":"2024-09-10T23:28:34.996796+0000","last_clean":"2024-09-10T23:28:34.996796+0000","last_became_active":"2024-09-10T23:28:33.950422+0000","last_became_peered":"2024-09-10T23:28:33.950422+0000","last_unstale":"2024-09-10T23:28:34.996796+0000","last_undegraded":"2024-09-10T23:28:34.996796+0000","last_fullsized":"2024-09-10T23:28:34.996796+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:41.841345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.972318+0000","last_change":"2024-09-10T23:28:34.970316+0000","last_active":"2024-09-10T23:28:34.972318+0000","last_peered":"2024-09-10T23:28:34.972318+0000","last_clean":"2024-09-10T23:28:34.972318+0000","last_became_active":"2024-09-10T23:28:34.970009+0000","last_became_peered":"2024-09-10T23:28:34.970009+0000","last_unstale":"2024-09-10T23:28:34.972318+0000","last_undegraded":"2024-09-10T23:28:34.972318+0000","last_fullsized":"2024-09-10T23:28:34.972318+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:24.644205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.959540+0000","last_change":"2024-09-10T23:28:33.955662+0000","last_active":"2024-09-10T23:28:34.959540+0000","last_peered":"2024-09-10T23:28:34.959540+0000","last_clean":"2024-09-10T23:28:34.959540+0000","last_became_active":"2024-09-10T23:28:33.955388+0000","last_became_peered":"2024-09-10T23:28:33.955388+0000","last_unstale":"2024-09-10T23:28:34.959540+0000","last_undegraded":"2024-09-10T23:28:34.959540+0000","last_fullsized":"2024-09-10T23:28:34.959540+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:16.892525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981248+0000","last_change":"2024-09-10T23:28:34.976480+0000","last_active":"2024-09-10T23:28:34.981248+0000","last_peered":"2024-09-10T23:28:34.981248+0000","last_clean":"2024-09-10T23:28:34.981248+0000","last_became_active":"2024-09-10T23:28:34.975157+0000","last_became_peered":"2024-09-10T23:28:34.975157+0000","last_unstale":"2024-09-10T23:28:34.981248+0000","last_undegraded":"2024-09-10T23:28:34.981248+0000","last_fullsized":"2024-09-10T23:28:34.981248+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:26.501094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.956357+0000","last_change":"2024-09-10T23:28:33.955688+0000","last_active":"2024-09-10T23:28:34.956357+0000","last_peered":"2024-09-10T23:28:34.956357+0000","last_clean":"2024-09-10T23:28:34.956357+0000","last_became_active":"2024-09-10T23:28:33.955089+0000","last_became_peered":"2024-09-10T23:28:33.955089+0000","last_unstale":"2024-09-10T23:28:34.956357+0000","last_undegraded":"2024-09-10T23:28:34.956357+0000","last_fullsized":"2024-09-10T23:28:34.956357+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:56.243399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.377036+0000","last_change":"2024-09-10T23:28:34.966902+0000","last_active":"2024-09-10T23:28:36.377036+0000","last_peered":"2024-09-10T23:28:36.377036+0000","last_clean":"2024-09-10T23:28:36.377036+0000","last_became_active":"2024-09-10T23:28:34.966628+0000","last_became_peered":"2024-09-10T23:28:34.966628+0000","last_unstale":"2024-09-10T23:28:36.377036+0000","last_undegraded":"2024-09-10T23:28:36.377036+0000","last_fullsized":"2024-09-10T23:28:36.377036+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:34.898389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962529+0000","last_change":"2024-09-10T23:28:33.954422+0000","last_active":"2024-09-10T23:28:35.962529+0000","last_peered":"2024-09-10T23:28:35.962529+0000","last_clean":"2024-09-10T23:28:35.962529+0000","last_became_active":"2024-09-10T23:28:33.954146+0000","last_became_peered":"2024-09-10T23:28:33.954146+0000","last_unstale":"2024-09-10T23:28:35.962529+0000","last_undegraded":"2024-09-10T23:28:35.962529+0000","last_fullsized":"2024-09-10T23:28:35.962529+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:02.528045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981280+0000","last_change":"2024-09-10T23:28:34.977109+0000","last_active":"2024-09-10T23:28:34.981280+0000","last_peered":"2024-09-10T23:28:34.981280+0000","last_clean":"2024-09-10T23:28:34.981280+0000","last_became_active":"2024-09-10T23:28:34.976801+0000","last_became_peered":"2024-09-10T23:28:34.976801+0000","last_unstale":"2024-09-10T23:28:34.981280+0000","last_undegraded":"2024-09-10T23:28:34.981280+0000","last_fullsized":"2024-09-10T23:28:34.981280+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:51.755670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.992808+0000","last_change":"2024-09-10T23:28:33.949615+0000","last_active":"2024-09-10T23:28:34.992808+0000","last_peered":"2024-09-10T23:28:34.992808+0000","last_clean":"2024-09-10T23:28:34.992808+0000","last_became_active":"2024-09-10T23:28:33.949362+0000","last_became_peered":"2024-09-10T23:28:33.949362+0000","last_unstale":"2024-09-10T23:28:34.992808+0000","last_undegraded":"2024-09-10T23:28:34.992808+0000","last_fullsized":"2024-09-10T23:28:34.992808+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:46.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.968328+0000","last_change":"2024-09-10T23:28:34.962544+0000","last_active":"2024-09-10T23:28:34.968328+0000","last_peered":"2024-09-10T23:28:34.968328+0000","last_clean":"2024-09-10T23:28:34.968328+0000","last_became_active":"2024-09-10T23:28:34.962006+0000","last_became_peered":"2024-09-10T23:28:34.962006+0000","last_unstale":"2024-09-10T23:28:34.968328+0000","last_undegraded":"2024-09-10T23:28:34.968328+0000","last_fullsized":"2024-09-10T23:28:34.968328+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:16.711354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.958290+0000","last_change":"2024-09-10T23:28:33.964600+0000","last_active":"2024-09-10T23:28:34.958290+0000","last_peered":"2024-09-10T23:28:34.958290+0000","last_clean":"2024-09-10T23:28:34.958290+0000","last_became_active":"2024-09-10T23:28:33.961619+0000","last_became_peered":"2024-09-10T23:28:33.961619+0000","last_unstale":"2024-09-10T23:28:34.958290+0000","last_undegraded":"2024-09-10T23:28:34.958290+0000","last_fullsized":"2024-09-10T23:28:34.958290+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:40.217786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.985088+0000","last_change":"2024-09-10T23:28:34.979197+0000","last_active":"2024-09-10T23:28:34.985088+0000","last_peered":"2024-09-10T23:28:34.985088+0000","last_clean":"2024-09-10T23:28:34.985088+0000","last_became_active":"2024-09-10T23:28:34.978833+0000","last_became_peered":"2024-09-10T23:28:34.978833+0000","last_unstale":"2024-09-10T23:28:34.985088+0000","last_undegraded":"2024-09-10T23:28:34.985088+0000","last_fullsized":"2024-09-10T23:28:34.985088+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:07.976471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376782+0000","last_change":"2024-09-10T23:28:33.957793+0000","last_active":"2024-09-10T23:28:36.376782+0000","last_peered":"2024-09-10T23:28:36.376782+0000","last_clean":"2024-09-10T23:28:36.376782+0000","last_became_active":"2024-09-10T23:28:33.957502+0000","last_became_peered":"2024-09-10T23:28:33.957502+0000","last_unstale":"2024-09-10T23:28:36.376782+0000","last_undegraded":"2024-09-10T23:28:36.376782+0000","last_fullsized":"2024-09-10T23:28:36.376782+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:44.445494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.977629+0000","last_change":"2024-09-10T23:28:34.973138+0000","last_active":"2024-09-10T23:28:34.977629+0000","last_peered":"2024-09-10T23:28:34.977629+0000","last_clean":"2024-09-10T23:28:34.977629+0000","last_became_active":"2024-09-10T23:28:34.972847+0000","last_became_peered":"2024-09-10T23:28:34.972847+0000","last_unstale":"2024-09-10T23:28:34.977629+0000","last_undegraded":"2024-09-10T23:28:34.977629+0000","last_fullsized":"2024-09-10T23:28:34.977629+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:20:01.979608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376740+0000","last_change":"2024-09-10T23:28:33.962250+0000","last_active":"2024-09-10T23:28:36.376740+0000","last_peered":"2024-09-10T23:28:36.376740+0000","last_clean":"2024-09-10T23:28:36.376740+0000","last_became_active":"2024-09-10T23:28:33.961838+0000","last_became_peered":"2024-09-10T23:28:33.961838+0000","last_unstale":"2024-09-10T23:28:36.376740+0000","last_undegraded":"2024-09-10T23:28:36.376740+0000","last_fullsized":"2024-09-10T23:28:36.376740+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:27.095653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962412+0000","last_change":"2024-09-10T23:28:34.975892+0000","last_active":"2024-09-10T23:28:35.962412+0000","last_peered":"2024-09-10T23:28:35.962412+0000","last_clean":"2024-09-10T23:28:35.962412+0000","last_became_active":"2024-09-10T23:28:34.975366+0000","last_became_peered":"2024-09-10T23:28:34.975366+0000","last_unstale":"2024-09-10T23:28:35.962412+0000","last_undegraded":"2024-09-10T23:28:35.962412+0000","last_fullsized":"2024-09-10T23:28:35.962412+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:52.230245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.967262+0000","last_change":"2024-09-10T23:28:33.958575+0000","last_active":"2024-09-10T23:28:34.967262+0000","last_peered":"2024-09-10T23:28:34.967262+0000","last_clean":"2024-09-10T23:28:34.967262+0000","last_became_active":"2024-09-10T23:28:33.958302+0000","last_became_peered":"2024-09-10T23:28:33.958302+0000","last_unstale":"2024-09-10T23:28:34.967262+0000","last_undegraded":"2024-09-10T23:28:34.967262+0000","last_fullsized":"2024-09-10T23:28:34.967262+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:53.733466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.978535+0000","last_change":"2024-09-10T23:28:34.975475+0000","last_active":"2024-09-10T23:28:34.978535+0000","last_peered":"2024-09-10T23:28:34.978535+0000","last_clean":"2024-09-10T23:28:34.978535+0000","last_became_active":"2024-09-10T23:28:34.975111+0000","last_became_peered":"2024-09-10T23:28:34.975111+0000","last_unstale":"2024-09-10T23:28:34.978535+0000","last_undegraded":"2024-09-10T23:28:34.978535+0000","last_fullsized":"2024-09-10T23:28:34.978535+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:04.358777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.966959+0000","last_change":"2024-09-10T23:28:33.968241+0000","last_active":"2024-09-10T23:28:34.966959+0000","last_peered":"2024-09-10T23:28:34.966959+0000","last_clean":"2024-09-10T23:28:34.966959+0000","last_became_active":"2024-09-10T23:28:33.967874+0000","last_became_peered":"2024-09-10T23:28:33.967874+0000","last_unstale":"2024-09-10T23:28:34.966959+0000","last_undegraded":"2024-09-10T23:28:34.966959+0000","last_fullsized":"2024-09-10T23:28:34.966959+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:13.468628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.972938+0000","last_change":"2024-09-10T23:28:34.968747+0000","last_active":"2024-09-10T23:28:34.972938+0000","last_peered":"2024-09-10T23:28:34.972938+0000","last_clean":"2024-09-10T23:28:34.972938+0000","last_became_active":"2024-09-10T23:28:34.968268+0000","last_became_peered":"2024-09-10T23:28:34.968268+0000","last_unstale":"2024-09-10T23:28:34.972938+0000","last_undegraded":"2024-09-10T23:28:34.972938+0000","last_fullsized":"2024-09-10T23:28:34.972938+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:16.739764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.956612+0000","last_change":"2024-09-10T23:28:33.955712+0000","last_active":"2024-09-10T23:28:34.956612+0000","last_peered":"2024-09-10T23:28:34.956612+0000","last_clean":"2024-09-10T23:28:34.956612+0000","last_became_active":"2024-09-10T23:28:33.955426+0000","last_became_peered":"2024-09-10T23:28:33.955426+0000","last_unstale":"2024-09-10T23:28:34.956612+0000","last_undegraded":"2024-09-10T23:28:34.956612+0000","last_fullsized":"2024-09-10T23:28:34.956612+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:24.131697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.984862+0000","last_change":"2024-09-10T23:28:34.980722+0000","last_active":"2024-09-10T23:28:34.984862+0000","last_peered":"2024-09-10T23:28:34.984862+0000","last_clean":"2024-09-10T23:28:34.984862+0000","last_became_active":"2024-09-10T23:28:34.980477+0000","last_became_peered":"2024-09-10T23:28:34.980477+0000","last_unstale":"2024-09-10T23:28:34.984862+0000","last_undegraded":"2024-09-10T23:28:34.984862+0000","last_fullsized":"2024-09-10T23:28:34.984862+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:23.362341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962530+0000","last_change":"2024-09-10T23:28:33.952206+0000","last_active":"2024-09-10T23:28:35.962530+0000","last_peered":"2024-09-10T23:28:35.962530+0000","last_clean":"2024-09-10T23:28:35.962530+0000","last_became_active":"2024-09-10T23:28:33.951809+0000","last_became_peered":"2024-09-10T23:28:33.951809+0000","last_unstale":"2024-09-10T23:28:35.962530+0000","last_undegraded":"2024-09-10T23:28:35.962530+0000","last_fullsized":"2024-09-10T23:28:35.962530+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:50.522566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962619+0000","last_change":"2024-09-10T23:28:34.980134+0000","last_active":"2024-09-10T23:28:35.962619+0000","last_peered":"2024-09-10T23:28:35.962619+0000","last_clean":"2024-09-10T23:28:35.962619+0000","last_became_active":"2024-09-10T23:28:34.977010+0000","last_became_peered":"2024-09-10T23:28:34.977010+0000","last_unstale":"2024-09-10T23:28:35.962619+0000","last_undegraded":"2024-09-10T23:28:35.962619+0000","last_fullsized":"2024-09-10T23:28:35.962619+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:05.242005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.955807+0000","last_change":"2024-09-10T23:28:33.950210+0000","last_active":"2024-09-10T23:28:34.955807+0000","last_peered":"2024-09-10T23:28:34.955807+0000","last_clean":"2024-09-10T23:28:34.955807+0000","last_became_active":"2024-09-10T23:28:33.949975+0000","last_became_peered":"2024-09-10T23:28:33.949975+0000","last_unstale":"2024-09-10T23:28:34.955807+0000","last_undegraded":"2024-09-10T23:28:34.955807+0000","last_fullsized":"2024-09-10T23:28:34.955807+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:52.148533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":390,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.966661+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:28:34.966661+0000","last_peered":"2024-09-10T23:28:34.966661+0000","last_clean":"2024-09-10T23:28:34.966661+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:28:34.966661+0000","last_undegraded":"2024-09-10T23:28:34.966661+0000","last_fullsized":"2024-09-10T23:28:34.966661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69384,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302456,"statfs":{"total":96636764160,"available":96565714944,"internally_reserved":0,"allocated":2211840,"data_stored":1038556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509602,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69956,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301884,"statfs":{"total":96636764160,"available":96565129216,"internally_reserved":0,"allocated":2801664,"data_stored":1628854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63872,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307968,"statfs":{"total":96636764160,"available":96571359232,"internally_reserved":0,"allocated":2195456,"data_stored":1031319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509602,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69428,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302412,"statfs":{"total":96636764160,"available":96565669888,"internally_reserved":0,"allocated":2195456,"data_stored":1031319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509601,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73608,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298232,"statfs":{"total":96636764160,"available":96561389568,"internally_reserved":0,"allocated":2211840,"data_stored":1039068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509602,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59720,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312120,"statfs":{"total":96636764160,"available":96575610880,"internally_reserved":0,"allocated":2207744,"data_stored":1038486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509601,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78332,"kb_used_data":2724,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293508,"statfs":{"total":96636764160,"available":96556552192,"internally_reserved":0,"allocated":2789376,"data_stored":1621687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69396,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302444,"statfs":{"total":96636764160,"available":96565702656,"internally_reserved":0,"allocated":2228224,"data_stored":1045338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:28:39.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:28:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.304+0000 7fd7ff400640 1 -- 172.21.15.17:0/2061665513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7e00041d0 msgr2=0x7fd7e0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.304+0000 7fd7ff400640 1 --2- 172.21.15.17:0/2061665513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7e00041d0 0x7fd7e0004810 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4006fa0 tx=0x7fd7e401cc20 comp rx=0 tx=0).stop 2024-09-10T23:28:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.304+0000 7fd7fd400640 1 -- 172.21.15.17:0/2061665513 reap_dead start 2024-09-10T23:28:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.304+0000 7fd7ff400640 1 -- 172.21.15.17:0/2061665513 shutdown_connections 2024-09-10T23:28:39.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.304+0000 7fd7ff400640 1 -- 172.21.15.17:0/2061665513 >> 172.21.15.17:0/2061665513 conn(0x7fd7f80d1d60 msgr2=0x7fd7f80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:39.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.304+0000 7fd7ff400640 1 -- 172.21.15.17:0/2061665513 shutdown_connections 2024-09-10T23:28:39.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.304+0000 7fd7ff400640 1 -- 172.21.15.17:0/2061665513 wait complete. 2024-09-10T23:28:39.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 Processor -- start 2024-09-10T23:28:39.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 -- start start 2024-09-10T23:28:39.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e00041d0 0x7fd7f81f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:39.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7f80b27f0 0x7fd7f80b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:39.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80c4890 0x7fd7f80c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:39.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f80cd880 con 0x7fd7f80c4890 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8071220 con 0x7fd7e00041d0 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd7f80cda00 con 0x7fd7f80b27f0 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80c4890 0x7fd7f80c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80c4890 0x7fd7f80c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49314/0 (socket says 172.21.15.17:49314) 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fd400640 1 -- 172.21.15.17:0/1878347323 learned_addr learned my addr 172.21.15.17:0/1878347323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7f7e00640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7f80b27f0 0x7fd7f80b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fca00640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e00041d0 0x7fd7f81f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fd400640 1 -- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7f80b27f0 msgr2=0x7fd7f80b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fd400640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7f80b27f0 0x7fd7f80b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fd400640 1 -- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e00041d0 msgr2=0x7fd7f81f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fd400640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e00041d0 0x7fd7f81f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fd400640 1 -- 172.21.15.17:0/1878347323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f80c53e0 con 0x7fd7f80c4890 2024-09-10T23:28:39.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7fd400640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80c4890 0x7fd7f80c5890 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80b7de0 tx=0x7fd7f0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:39.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7f4c00640 1 -- 172.21.15.17:0/1878347323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0003d90 con 0x7fd7f80c4890 2024-09-10T23:28:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7f4c00640 1 -- 172.21.15.17:0/1878347323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f0006820 con 0x7fd7f80c4890 2024-09-10T23:28:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f80b3040 con 0x7fd7f80c4890 2024-09-10T23:28:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7f4c00640 1 -- 172.21.15.17:0/1878347323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0011a00 con 0x7fd7f80c4890 2024-09-10T23:28:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.308+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f80b3600 con 0x7fd7f80c4890 2024-09-10T23:28:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.312+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f815f0f0 con 0x7fd7f80c4890 2024-09-10T23:28:39.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.312+0000 7fd7f4c00640 1 -- 172.21.15.17:0/1878347323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd7f0010040 con 0x7fd7f80c4890 2024-09-10T23:28:39.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.312+0000 7fd7f4c00640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7d8072610 0x7fd7d8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:39.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.312+0000 7fd7f4c00640 1 -- 172.21.15.17:0/1878347323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fd7f0096a50 con 0x7fd7f80c4890 2024-09-10T23:28:39.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.312+0000 7fd7fca00640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7d8072610 0x7fd7d8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:39.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.316+0000 7fd7fca00640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7d8072610 0x7fd7d8074ad0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009b80 tx=0x7fd7ec0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:39.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.316+0000 7fd7f4c00640 1 -- 172.21.15.17:0/1878347323 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd7f0061f00 con 0x7fd7f80c4890 2024-09-10T23:28:39.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.488+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd7f8069e10 con 0x7fd7d8072610 2024-09-10T23:28:39.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7f4c00640 1 -- 172.21.15.17:0/1878347323 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252470 (secure 0 0 0) 0x7fd7ec05ea50 con 0x7fd7d8072610 2024-09-10T23:28:39.502 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:39.503 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:28:39.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7d8072610 msgr2=0x7fd7d8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7d8072610 0x7fd7d8074ad0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009b80 tx=0x7fd7ec0091e0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80c4890 msgr2=0x7fd7f80c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80c4890 0x7fd7f80c5890 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80b7de0 tx=0x7fd7f0005f90 comp rx=0 tx=0).stop 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 shutdown_connections 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7d8072610 0x7fd7d8074ad0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd7f80c4890 0x7fd7f80c5890 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd7f80b27f0 0x7fd7f80b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 --2- 172.21.15.17:0/1878347323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e00041d0 0x7fd7f81f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 >> 172.21.15.17:0/1878347323 conn(0x7fd7f80d1d60 msgr2=0x7fd7f815d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 shutdown_connections 2024-09-10T23:28:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.496+0000 7fd7ff400640 1 -- 172.21.15.17:0/1878347323 wait complete. 2024-09-10T23:28:39.522 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2024-09-10T23:28:38.481975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":553696,"kb_used_data":18400,"kb_used_omap":12,"kb_used_meta":535091,"kb_avail":754421024,"statfs":{"total":773094113280,"available":772527128576,"internally_reserved":0,"allocated":18841600,"data_stored":9474627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":547933745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.548199"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.972704+0000","last_change":"2024-09-10T23:28:34.965879+0000","last_active":"2024-09-10T23:28:34.972704+0000","last_peered":"2024-09-10T23:28:34.972704+0000","last_clean":"2024-09-10T23:28:34.972704+0000","last_became_active":"2024-09-10T23:28:34.965524+0000","last_became_peered":"2024-09-10T23:28:34.965524+0000","last_unstale":"2024-09-10T23:28:34.972704+0000","last_undegraded":"2024-09-10T23:28:34.972704+0000","last_fullsized":"2024-09-10T23:28:34.972704+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:23.455232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.973598+0000","last_change":"2024-09-10T23:28:34.970548+0000","last_active":"2024-09-10T23:28:34.973598+0000","last_peered":"2024-09-10T23:28:34.973598+0000","last_clean":"2024-09-10T23:28:34.973598+0000","last_became_active":"2024-09-10T23:28:34.970269+0000","last_became_peered":"2024-09-10T23:28:34.970269+0000","last_unstale":"2024-09-10T23:28:34.973598+0000","last_undegraded":"2024-09-10T23:28:34.973598+0000","last_fullsized":"2024-09-10T23:28:34.973598+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:54.739800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962686+0000","last_change":"2024-09-10T23:28:34.982744+0000","last_active":"2024-09-10T23:28:35.962686+0000","last_peered":"2024-09-10T23:28:35.962686+0000","last_clean":"2024-09-10T23:28:35.962686+0000","last_became_active":"2024-09-10T23:28:34.982380+0000","last_became_peered":"2024-09-10T23:28:34.982380+0000","last_unstale":"2024-09-10T23:28:35.962686+0000","last_undegraded":"2024-09-10T23:28:35.962686+0000","last_fullsized":"2024-09-10T23:28:35.962686+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:03.834679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.971983+0000","last_change":"2024-09-10T23:28:34.969448+0000","last_active":"2024-09-10T23:28:34.971983+0000","last_peered":"2024-09-10T23:28:34.971983+0000","last_clean":"2024-09-10T23:28:34.971983+0000","last_became_active":"2024-09-10T23:28:34.969151+0000","last_became_peered":"2024-09-10T23:28:34.969151+0000","last_unstale":"2024-09-10T23:28:34.971983+0000","last_undegraded":"2024-09-10T23:28:34.971983+0000","last_fullsized":"2024-09-10T23:28:34.971983+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:57.830630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376568+0000","last_change":"2024-09-10T23:28:34.979375+0000","last_active":"2024-09-10T23:28:36.376568+0000","last_peered":"2024-09-10T23:28:36.376568+0000","last_clean":"2024-09-10T23:28:36.376568+0000","last_became_active":"2024-09-10T23:28:34.979101+0000","last_became_peered":"2024-09-10T23:28:34.979101+0000","last_unstale":"2024-09-10T23:28:36.376568+0000","last_undegraded":"2024-09-10T23:28:36.376568+0000","last_fullsized":"2024-09-10T23:28:36.376568+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:51.111925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376369+0000","last_change":"2024-09-10T23:28:34.966594+0000","last_active":"2024-09-10T23:28:36.376369+0000","last_peered":"2024-09-10T23:28:36.376369+0000","last_clean":"2024-09-10T23:28:36.376369+0000","last_became_active":"2024-09-10T23:28:34.966330+0000","last_became_peered":"2024-09-10T23:28:34.966330+0000","last_unstale":"2024-09-10T23:28:36.376369+0000","last_undegraded":"2024-09-10T23:28:36.376369+0000","last_fullsized":"2024-09-10T23:28:36.376369+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:21.035691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.975677+0000","last_change":"2024-09-10T23:28:34.968045+0000","last_active":"2024-09-10T23:28:34.975677+0000","last_peered":"2024-09-10T23:28:34.975677+0000","last_clean":"2024-09-10T23:28:34.975677+0000","last_became_active":"2024-09-10T23:28:34.967608+0000","last_became_peered":"2024-09-10T23:28:34.967608+0000","last_unstale":"2024-09-10T23:28:34.975677+0000","last_undegraded":"2024-09-10T23:28:34.975677+0000","last_fullsized":"2024-09-10T23:28:34.975677+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:06.634683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.984865+0000","last_change":"2024-09-10T23:28:34.979646+0000","last_active":"2024-09-10T23:28:34.984865+0000","last_peered":"2024-09-10T23:28:34.984865+0000","last_clean":"2024-09-10T23:28:34.984865+0000","last_became_active":"2024-09-10T23:28:34.979219+0000","last_became_peered":"2024-09-10T23:28:34.979219+0000","last_unstale":"2024-09-10T23:28:34.984865+0000","last_undegraded":"2024-09-10T23:28:34.984865+0000","last_fullsized":"2024-09-10T23:28:34.984865+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:03.854845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.977054+0000","last_change":"2024-09-10T23:28:34.973444+0000","last_active":"2024-09-10T23:28:34.977054+0000","last_peered":"2024-09-10T23:28:34.977054+0000","last_clean":"2024-09-10T23:28:34.977054+0000","last_became_active":"2024-09-10T23:28:34.972467+0000","last_became_peered":"2024-09-10T23:28:34.972467+0000","last_unstale":"2024-09-10T23:28:34.977054+0000","last_undegraded":"2024-09-10T23:28:34.977054+0000","last_fullsized":"2024-09-10T23:28:34.977054+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:07.976471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376892+0000","last_change":"2024-09-10T23:28:34.974355+0000","last_active":"2024-09-10T23:28:36.376892+0000","last_peered":"2024-09-10T23:28:36.376892+0000","last_clean":"2024-09-10T23:28:36.376892+0000","last_became_active":"2024-09-10T23:28:34.974062+0000","last_became_peered":"2024-09-10T23:28:34.974062+0000","last_unstale":"2024-09-10T23:28:36.376892+0000","last_undegraded":"2024-09-10T23:28:36.376892+0000","last_fullsized":"2024-09-10T23:28:36.376892+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:37.454505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.980763+0000","last_change":"2024-09-10T23:28:34.978041+0000","last_active":"2024-09-10T23:28:34.980763+0000","last_peered":"2024-09-10T23:28:34.980763+0000","last_clean":"2024-09-10T23:28:34.980763+0000","last_became_active":"2024-09-10T23:28:34.977698+0000","last_became_peered":"2024-09-10T23:28:34.977698+0000","last_unstale":"2024-09-10T23:28:34.980763+0000","last_undegraded":"2024-09-10T23:28:34.980763+0000","last_fullsized":"2024-09-10T23:28:34.980763+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:48.367301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.980598+0000","last_change":"2024-09-10T23:28:34.974386+0000","last_active":"2024-09-10T23:28:34.980598+0000","last_peered":"2024-09-10T23:28:34.980598+0000","last_clean":"2024-09-10T23:28:34.980598+0000","last_became_active":"2024-09-10T23:28:34.974047+0000","last_became_peered":"2024-09-10T23:28:34.974047+0000","last_unstale":"2024-09-10T23:28:34.980598+0000","last_undegraded":"2024-09-10T23:28:34.980598+0000","last_fullsized":"2024-09-10T23:28:34.980598+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:59.297213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981323+0000","last_change":"2024-09-10T23:28:34.974984+0000","last_active":"2024-09-10T23:28:34.981323+0000","last_peered":"2024-09-10T23:28:34.981323+0000","last_clean":"2024-09-10T23:28:34.981323+0000","last_became_active":"2024-09-10T23:28:34.974717+0000","last_became_peered":"2024-09-10T23:28:34.974717+0000","last_unstale":"2024-09-10T23:28:34.981323+0000","last_undegraded":"2024-09-10T23:28:34.981323+0000","last_fullsized":"2024-09-10T23:28:34.981323+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:20.432466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.982164+0000","last_change":"2024-09-10T23:28:34.977742+0000","last_active":"2024-09-10T23:28:34.982164+0000","last_peered":"2024-09-10T23:28:34.982164+0000","last_clean":"2024-09-10T23:28:34.982164+0000","last_became_active":"2024-09-10T23:28:34.977466+0000","last_became_peered":"2024-09-10T23:28:34.977466+0000","last_unstale":"2024-09-10T23:28:34.982164+0000","last_undegraded":"2024-09-10T23:28:34.982164+0000","last_fullsized":"2024-09-10T23:28:34.982164+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:15.897140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.962179+0000","last_change":"2024-09-10T23:28:34.958487+0000","last_active":"2024-09-10T23:28:34.962179+0000","last_peered":"2024-09-10T23:28:34.962179+0000","last_clean":"2024-09-10T23:28:34.962179+0000","last_became_active":"2024-09-10T23:28:34.957641+0000","last_became_peered":"2024-09-10T23:28:34.957641+0000","last_unstale":"2024-09-10T23:28:34.962179+0000","last_undegraded":"2024-09-10T23:28:34.962179+0000","last_fullsized":"2024-09-10T23:28:34.962179+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:30.807907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.375897+0000","last_change":"2024-09-10T23:28:34.980366+0000","last_active":"2024-09-10T23:28:36.375897+0000","last_peered":"2024-09-10T23:28:36.375897+0000","last_clean":"2024-09-10T23:28:36.375897+0000","last_became_active":"2024-09-10T23:28:34.979322+0000","last_became_peered":"2024-09-10T23:28:34.979322+0000","last_unstale":"2024-09-10T23:28:36.375897+0000","last_undegraded":"2024-09-10T23:28:36.375897+0000","last_fullsized":"2024-09-10T23:28:36.375897+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:46.143046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.377174+0000","last_change":"2024-09-10T23:28:34.976979+0000","last_active":"2024-09-10T23:28:36.377174+0000","last_peered":"2024-09-10T23:28:36.377174+0000","last_clean":"2024-09-10T23:28:36.377174+0000","last_became_active":"2024-09-10T23:28:34.973824+0000","last_became_peered":"2024-09-10T23:28:34.973824+0000","last_unstale":"2024-09-10T23:28:36.377174+0000","last_undegraded":"2024-09-10T23:28:36.377174+0000","last_fullsized":"2024-09-10T23:28:36.377174+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:32.427612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.978776+0000","last_change":"2024-09-10T23:28:34.972461+0000","last_active":"2024-09-10T23:28:34.978776+0000","last_peered":"2024-09-10T23:28:34.978776+0000","last_clean":"2024-09-10T23:28:34.978776+0000","last_became_active":"2024-09-10T23:28:34.972195+0000","last_became_peered":"2024-09-10T23:28:34.972195+0000","last_unstale":"2024-09-10T23:28:34.978776+0000","last_undegraded":"2024-09-10T23:28:34.978776+0000","last_fullsized":"2024-09-10T23:28:34.978776+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:59:17.278548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.974357+0000","last_change":"2024-09-10T23:28:34.969848+0000","last_active":"2024-09-10T23:28:34.974357+0000","last_peered":"2024-09-10T23:28:34.974357+0000","last_clean":"2024-09-10T23:28:34.974357+0000","last_became_active":"2024-09-10T23:28:34.968232+0000","last_became_peered":"2024-09-10T23:28:34.968232+0000","last_unstale":"2024-09-10T23:28:34.974357+0000","last_undegraded":"2024-09-10T23:28:34.974357+0000","last_fullsized":"2024-09-10T23:28:34.974357+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:50.775025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376648+0000","last_change":"2024-09-10T23:28:34.974676+0000","last_active":"2024-09-10T23:28:36.376648+0000","last_peered":"2024-09-10T23:28:36.376648+0000","last_clean":"2024-09-10T23:28:36.376648+0000","last_became_active":"2024-09-10T23:28:34.974389+0000","last_became_peered":"2024-09-10T23:28:34.974389+0000","last_unstale":"2024-09-10T23:28:36.376648+0000","last_undegraded":"2024-09-10T23:28:36.376648+0000","last_fullsized":"2024-09-10T23:28:36.376648+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:09.729024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.975442+0000","last_change":"2024-09-10T23:28:34.971818+0000","last_active":"2024-09-10T23:28:34.975442+0000","last_peered":"2024-09-10T23:28:34.975442+0000","last_clean":"2024-09-10T23:28:34.975442+0000","last_became_active":"2024-09-10T23:28:34.971506+0000","last_became_peered":"2024-09-10T23:28:34.971506+0000","last_unstale":"2024-09-10T23:28:34.975442+0000","last_undegraded":"2024-09-10T23:28:34.975442+0000","last_fullsized":"2024-09-10T23:28:34.975442+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:53.256216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.975779+0000","last_change":"2024-09-10T23:28:34.971694+0000","last_active":"2024-09-10T23:28:34.975779+0000","last_peered":"2024-09-10T23:28:34.975779+0000","last_clean":"2024-09-10T23:28:34.975779+0000","last_became_active":"2024-09-10T23:28:34.971427+0000","last_became_peered":"2024-09-10T23:28:34.971427+0000","last_unstale":"2024-09-10T23:28:34.975779+0000","last_undegraded":"2024-09-10T23:28:34.975779+0000","last_fullsized":"2024-09-10T23:28:34.975779+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:43.790460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.982053+0000","last_change":"2024-09-10T23:28:34.977060+0000","last_active":"2024-09-10T23:28:34.982053+0000","last_peered":"2024-09-10T23:28:34.982053+0000","last_clean":"2024-09-10T23:28:34.982053+0000","last_became_active":"2024-09-10T23:28:34.975296+0000","last_became_peered":"2024-09-10T23:28:34.975296+0000","last_unstale":"2024-09-10T23:28:34.982053+0000","last_undegraded":"2024-09-10T23:28:34.982053+0000","last_fullsized":"2024-09-10T23:28:34.982053+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:46.315738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.973782+0000","last_change":"2024-09-10T23:28:34.970801+0000","last_active":"2024-09-10T23:28:34.973782+0000","last_peered":"2024-09-10T23:28:34.973782+0000","last_clean":"2024-09-10T23:28:34.973782+0000","last_became_active":"2024-09-10T23:28:34.970525+0000","last_became_peered":"2024-09-10T23:28:34.970525+0000","last_unstale":"2024-09-10T23:28:34.973782+0000","last_undegraded":"2024-09-10T23:28:34.973782+0000","last_fullsized":"2024-09-10T23:28:34.973782+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:02.355873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.982773+0000","last_change":"2024-09-10T23:28:34.979520+0000","last_active":"2024-09-10T23:28:34.982773+0000","last_peered":"2024-09-10T23:28:34.982773+0000","last_clean":"2024-09-10T23:28:34.982773+0000","last_became_active":"2024-09-10T23:28:34.979172+0000","last_became_peered":"2024-09-10T23:28:34.979172+0000","last_unstale":"2024-09-10T23:28:34.982773+0000","last_undegraded":"2024-09-10T23:28:34.982773+0000","last_fullsized":"2024-09-10T23:28:34.982773+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:13:06.178207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.986515+0000","last_change":"2024-09-10T23:28:34.985523+0000","last_active":"2024-09-10T23:28:34.986515+0000","last_peered":"2024-09-10T23:28:34.986515+0000","last_clean":"2024-09-10T23:28:34.986515+0000","last_became_active":"2024-09-10T23:28:34.985056+0000","last_became_peered":"2024-09-10T23:28:34.985056+0000","last_unstale":"2024-09-10T23:28:34.986515+0000","last_undegraded":"2024-09-10T23:28:34.986515+0000","last_fullsized":"2024-09-10T23:28:34.986515+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:29.405620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.984692+0000","last_change":"2024-09-10T23:28:34.973368+0000","last_active":"2024-09-10T23:28:34.984692+0000","last_peered":"2024-09-10T23:28:34.984692+0000","last_clean":"2024-09-10T23:28:34.984692+0000","last_became_active":"2024-09-10T23:28:34.972865+0000","last_became_peered":"2024-09-10T23:28:34.972865+0000","last_unstale":"2024-09-10T23:28:34.984692+0000","last_undegraded":"2024-09-10T23:28:34.984692+0000","last_fullsized":"2024-09-10T23:28:34.984692+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:02.355873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376649+0000","last_change":"2024-09-10T23:28:34.979412+0000","last_active":"2024-09-10T23:28:36.376649+0000","last_peered":"2024-09-10T23:28:36.376649+0000","last_clean":"2024-09-10T23:28:36.376649+0000","last_became_active":"2024-09-10T23:28:34.979137+0000","last_became_peered":"2024-09-10T23:28:34.979137+0000","last_unstale":"2024-09-10T23:28:36.376649+0000","last_undegraded":"2024-09-10T23:28:36.376649+0000","last_fullsized":"2024-09-10T23:28:36.376649+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:23:39.363086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.984308+0000","last_change":"2024-09-10T23:28:34.978443+0000","last_active":"2024-09-10T23:28:34.984308+0000","last_peered":"2024-09-10T23:28:34.984308+0000","last_clean":"2024-09-10T23:28:34.984308+0000","last_became_active":"2024-09-10T23:28:34.978121+0000","last_became_peered":"2024-09-10T23:28:34.978121+0000","last_unstale":"2024-09-10T23:28:34.984308+0000","last_undegraded":"2024-09-10T23:28:34.984308+0000","last_fullsized":"2024-09-10T23:28:34.984308+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:20.786314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.983308+0000","last_change":"2024-09-10T23:28:34.978176+0000","last_active":"2024-09-10T23:28:34.983308+0000","last_peered":"2024-09-10T23:28:34.983308+0000","last_clean":"2024-09-10T23:28:34.983308+0000","last_became_active":"2024-09-10T23:28:34.977778+0000","last_became_peered":"2024-09-10T23:28:34.977778+0000","last_unstale":"2024-09-10T23:28:34.983308+0000","last_undegraded":"2024-09-10T23:28:34.983308+0000","last_fullsized":"2024-09-10T23:28:34.983308+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:25.082165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.964253+0000","last_change":"2024-09-10T23:28:34.963392+0000","last_active":"2024-09-10T23:28:34.964253+0000","last_peered":"2024-09-10T23:28:34.964253+0000","last_clean":"2024-09-10T23:28:34.964253+0000","last_became_active":"2024-09-10T23:28:34.962467+0000","last_became_peered":"2024-09-10T23:28:34.962467+0000","last_unstale":"2024-09-10T23:28:34.964253+0000","last_undegraded":"2024-09-10T23:28:34.964253+0000","last_fullsized":"2024-09-10T23:28:34.964253+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:50.427874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376122+0000","last_change":"2024-09-10T23:28:34.968609+0000","last_active":"2024-09-10T23:28:36.376122+0000","last_peered":"2024-09-10T23:28:36.376122+0000","last_clean":"2024-09-10T23:28:36.376122+0000","last_became_active":"2024-09-10T23:28:34.968325+0000","last_became_peered":"2024-09-10T23:28:34.968325+0000","last_unstale":"2024-09-10T23:28:36.376122+0000","last_undegraded":"2024-09-10T23:28:36.376122+0000","last_fullsized":"2024-09-10T23:28:36.376122+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:36.056180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981775+0000","last_change":"2024-09-10T23:28:34.974303+0000","last_active":"2024-09-10T23:28:34.981775+0000","last_peered":"2024-09-10T23:28:34.981775+0000","last_clean":"2024-09-10T23:28:34.981775+0000","last_became_active":"2024-09-10T23:28:34.974010+0000","last_became_peered":"2024-09-10T23:28:34.974010+0000","last_unstale":"2024-09-10T23:28:34.981775+0000","last_undegraded":"2024-09-10T23:28:34.981775+0000","last_fullsized":"2024-09-10T23:28:34.981775+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:53.256216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"176'4","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.994163+0000","last_change":"2024-09-10T23:28:33.958510+0000","last_active":"2024-09-10T23:28:34.994163+0000","last_peered":"2024-09-10T23:28:34.994163+0000","last_clean":"2024-09-10T23:28:34.994163+0000","last_became_active":"2024-09-10T23:28:33.956101+0000","last_became_peered":"2024-09-10T23:28:33.956101+0000","last_unstale":"2024-09-10T23:28:34.994163+0000","last_undegraded":"2024-09-10T23:28:34.994163+0000","last_fullsized":"2024-09-10T23:28:34.994163+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:53.687153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.975190+0000","last_change":"2024-09-10T23:28:34.967102+0000","last_active":"2024-09-10T23:28:34.975190+0000","last_peered":"2024-09-10T23:28:34.975190+0000","last_clean":"2024-09-10T23:28:34.975190+0000","last_became_active":"2024-09-10T23:28:34.966205+0000","last_became_peered":"2024-09-10T23:28:34.966205+0000","last_unstale":"2024-09-10T23:28:34.975190+0000","last_undegraded":"2024-09-10T23:28:34.975190+0000","last_fullsized":"2024-09-10T23:28:34.975190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:32.045619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376952+0000","last_change":"2024-09-10T23:28:33.958933+0000","last_active":"2024-09-10T23:28:36.376952+0000","last_peered":"2024-09-10T23:28:36.376952+0000","last_clean":"2024-09-10T23:28:36.376952+0000","last_became_active":"2024-09-10T23:28:33.957748+0000","last_became_peered":"2024-09-10T23:28:33.957748+0000","last_unstale":"2024-09-10T23:28:36.376952+0000","last_undegraded":"2024-09-10T23:28:36.376952+0000","last_fullsized":"2024-09-10T23:28:36.376952+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:24.060735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.983217+0000","last_change":"2024-09-10T23:28:34.978400+0000","last_active":"2024-09-10T23:28:34.983217+0000","last_peered":"2024-09-10T23:28:34.983217+0000","last_clean":"2024-09-10T23:28:34.983217+0000","last_became_active":"2024-09-10T23:28:34.978052+0000","last_became_peered":"2024-09-10T23:28:34.978052+0000","last_unstale":"2024-09-10T23:28:34.983217+0000","last_undegraded":"2024-09-10T23:28:34.983217+0000","last_fullsized":"2024-09-10T23:28:34.983217+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:33.307965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.996570+0000","last_change":"2024-09-10T23:28:33.958445+0000","last_active":"2024-09-10T23:28:34.996570+0000","last_peered":"2024-09-10T23:28:34.996570+0000","last_clean":"2024-09-10T23:28:34.996570+0000","last_became_active":"2024-09-10T23:28:33.958088+0000","last_became_peered":"2024-09-10T23:28:33.958088+0000","last_unstale":"2024-09-10T23:28:34.996570+0000","last_undegraded":"2024-09-10T23:28:34.996570+0000","last_fullsized":"2024-09-10T23:28:34.996570+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:51:46.801311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962964+0000","last_change":"2024-09-10T23:28:34.982640+0000","last_active":"2024-09-10T23:28:35.962964+0000","last_peered":"2024-09-10T23:28:35.962964+0000","last_clean":"2024-09-10T23:28:35.962964+0000","last_became_active":"2024-09-10T23:28:34.981659+0000","last_became_peered":"2024-09-10T23:28:34.981659+0000","last_unstale":"2024-09-10T23:28:35.962964+0000","last_undegraded":"2024-09-10T23:28:35.962964+0000","last_fullsized":"2024-09-10T23:28:35.962964+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:32.462320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.997103+0000","last_change":"2024-09-10T23:28:33.952910+0000","last_active":"2024-09-10T23:28:34.997103+0000","last_peered":"2024-09-10T23:28:34.997103+0000","last_clean":"2024-09-10T23:28:34.997103+0000","last_became_active":"2024-09-10T23:28:33.952509+0000","last_became_peered":"2024-09-10T23:28:33.952509+0000","last_unstale":"2024-09-10T23:28:34.997103+0000","last_undegraded":"2024-09-10T23:28:34.997103+0000","last_fullsized":"2024-09-10T23:28:34.997103+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:22.565695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.979429+0000","last_change":"2024-09-10T23:28:34.973595+0000","last_active":"2024-09-10T23:28:34.979429+0000","last_peered":"2024-09-10T23:28:34.979429+0000","last_clean":"2024-09-10T23:28:34.979429+0000","last_became_active":"2024-09-10T23:28:34.973300+0000","last_became_peered":"2024-09-10T23:28:34.973300+0000","last_unstale":"2024-09-10T23:28:34.979429+0000","last_undegraded":"2024-09-10T23:28:34.979429+0000","last_fullsized":"2024-09-10T23:28:34.979429+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:54.903389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376637+0000","last_change":"2024-09-10T23:28:33.957294+0000","last_active":"2024-09-10T23:28:36.376637+0000","last_peered":"2024-09-10T23:28:36.376637+0000","last_clean":"2024-09-10T23:28:36.376637+0000","last_became_active":"2024-09-10T23:28:33.956940+0000","last_became_peered":"2024-09-10T23:28:33.956940+0000","last_unstale":"2024-09-10T23:28:36.376637+0000","last_undegraded":"2024-09-10T23:28:36.376637+0000","last_fullsized":"2024-09-10T23:28:36.376637+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:45.334262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.962324+0000","last_change":"2024-09-10T23:28:34.960699+0000","last_active":"2024-09-10T23:28:34.962324+0000","last_peered":"2024-09-10T23:28:34.962324+0000","last_clean":"2024-09-10T23:28:34.962324+0000","last_became_active":"2024-09-10T23:28:34.960400+0000","last_became_peered":"2024-09-10T23:28:34.960400+0000","last_unstale":"2024-09-10T23:28:34.962324+0000","last_undegraded":"2024-09-10T23:28:34.962324+0000","last_fullsized":"2024-09-10T23:28:34.962324+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:17.936286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"176'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.992380+0000","last_change":"2024-09-10T23:28:33.955352+0000","last_active":"2024-09-10T23:28:34.992380+0000","last_peered":"2024-09-10T23:28:34.992380+0000","last_clean":"2024-09-10T23:28:34.992380+0000","last_became_active":"2024-09-10T23:28:33.954528+0000","last_became_peered":"2024-09-10T23:28:33.954528+0000","last_unstale":"2024-09-10T23:28:34.992380+0000","last_undegraded":"2024-09-10T23:28:34.992380+0000","last_fullsized":"2024-09-10T23:28:34.992380+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:16.514612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.962065+0000","last_change":"2024-09-10T23:28:34.959049+0000","last_active":"2024-09-10T23:28:34.962065+0000","last_peered":"2024-09-10T23:28:34.962065+0000","last_clean":"2024-09-10T23:28:34.962065+0000","last_became_active":"2024-09-10T23:28:34.958112+0000","last_became_peered":"2024-09-10T23:28:34.958112+0000","last_unstale":"2024-09-10T23:28:34.962065+0000","last_undegraded":"2024-09-10T23:28:34.962065+0000","last_fullsized":"2024-09-10T23:28:34.962065+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:26.831998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.961931+0000","last_change":"2024-09-10T23:28:33.958009+0000","last_active":"2024-09-10T23:28:34.961931+0000","last_peered":"2024-09-10T23:28:34.961931+0000","last_clean":"2024-09-10T23:28:34.961931+0000","last_became_active":"2024-09-10T23:28:33.957722+0000","last_became_peered":"2024-09-10T23:28:33.957722+0000","last_unstale":"2024-09-10T23:28:34.961931+0000","last_undegraded":"2024-09-10T23:28:34.961931+0000","last_fullsized":"2024-09-10T23:28:34.961931+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:02.828344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981803+0000","last_change":"2024-09-10T23:28:34.976348+0000","last_active":"2024-09-10T23:28:34.981803+0000","last_peered":"2024-09-10T23:28:34.981803+0000","last_clean":"2024-09-10T23:28:34.981803+0000","last_became_active":"2024-09-10T23:28:34.976026+0000","last_became_peered":"2024-09-10T23:28:34.976026+0000","last_unstale":"2024-09-10T23:28:34.981803+0000","last_undegraded":"2024-09-10T23:28:34.981803+0000","last_fullsized":"2024-09-10T23:28:34.981803+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:43.790460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.377119+0000","last_change":"2024-09-10T23:28:33.962677+0000","last_active":"2024-09-10T23:28:36.377119+0000","last_peered":"2024-09-10T23:28:36.377119+0000","last_clean":"2024-09-10T23:28:36.377119+0000","last_became_active":"2024-09-10T23:28:33.961585+0000","last_became_peered":"2024-09-10T23:28:33.961585+0000","last_unstale":"2024-09-10T23:28:36.377119+0000","last_undegraded":"2024-09-10T23:28:36.377119+0000","last_fullsized":"2024-09-10T23:28:36.377119+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:59.294376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376856+0000","last_change":"2024-09-10T23:28:34.967527+0000","last_active":"2024-09-10T23:28:36.376856+0000","last_peered":"2024-09-10T23:28:36.376856+0000","last_clean":"2024-09-10T23:28:36.376856+0000","last_became_active":"2024-09-10T23:28:34.967166+0000","last_became_peered":"2024-09-10T23:28:34.967166+0000","last_unstale":"2024-09-10T23:28:36.376856+0000","last_undegraded":"2024-09-10T23:28:36.376856+0000","last_fullsized":"2024-09-10T23:28:36.376856+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:29:25.580195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.951183+0000","last_change":"2024-09-10T23:28:33.953600+0000","last_active":"2024-09-10T23:28:34.951183+0000","last_peered":"2024-09-10T23:28:34.951183+0000","last_clean":"2024-09-10T23:28:34.951183+0000","last_became_active":"2024-09-10T23:28:33.953297+0000","last_became_peered":"2024-09-10T23:28:33.953297+0000","last_unstale":"2024-09-10T23:28:34.951183+0000","last_undegraded":"2024-09-10T23:28:34.951183+0000","last_fullsized":"2024-09-10T23:28:34.951183+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:59.769316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.983163+0000","last_change":"2024-09-10T23:28:34.978888+0000","last_active":"2024-09-10T23:28:34.983163+0000","last_peered":"2024-09-10T23:28:34.983163+0000","last_clean":"2024-09-10T23:28:34.983163+0000","last_became_active":"2024-09-10T23:28:34.978608+0000","last_became_peered":"2024-09-10T23:28:34.978608+0000","last_unstale":"2024-09-10T23:28:34.983163+0000","last_undegraded":"2024-09-10T23:28:34.983163+0000","last_fullsized":"2024-09-10T23:28:34.983163+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:59:42.298553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"176'3","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.992802+0000","last_change":"2024-09-10T23:28:33.953565+0000","last_active":"2024-09-10T23:28:34.992802+0000","last_peered":"2024-09-10T23:28:34.992802+0000","last_clean":"2024-09-10T23:28:34.992802+0000","last_became_active":"2024-09-10T23:28:33.953175+0000","last_became_peered":"2024-09-10T23:28:33.953175+0000","last_unstale":"2024-09-10T23:28:34.992802+0000","last_undegraded":"2024-09-10T23:28:34.992802+0000","last_fullsized":"2024-09-10T23:28:34.992802+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:01.398426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.976889+0000","last_change":"2024-09-10T23:28:34.972485+0000","last_active":"2024-09-10T23:28:34.976889+0000","last_peered":"2024-09-10T23:28:34.976889+0000","last_clean":"2024-09-10T23:28:34.976889+0000","last_became_active":"2024-09-10T23:28:34.972066+0000","last_became_peered":"2024-09-10T23:28:34.972066+0000","last_unstale":"2024-09-10T23:28:34.976889+0000","last_undegraded":"2024-09-10T23:28:34.976889+0000","last_fullsized":"2024-09-10T23:28:34.976889+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:06:46.315738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"176'6","reported_seq":19,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.999568+0000","last_change":"2024-09-10T23:28:33.958321+0000","last_active":"2024-09-10T23:28:34.999568+0000","last_peered":"2024-09-10T23:28:34.999568+0000","last_clean":"2024-09-10T23:28:34.999568+0000","last_became_active":"2024-09-10T23:28:33.957989+0000","last_became_peered":"2024-09-10T23:28:33.957989+0000","last_unstale":"2024-09-10T23:28:34.999568+0000","last_undegraded":"2024-09-10T23:28:34.999568+0000","last_fullsized":"2024-09-10T23:28:34.999568+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:18:32.239223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.978026+0000","last_change":"2024-09-10T23:28:34.974061+0000","last_active":"2024-09-10T23:28:34.978026+0000","last_peered":"2024-09-10T23:28:34.978026+0000","last_clean":"2024-09-10T23:28:34.978026+0000","last_became_active":"2024-09-10T23:28:34.968216+0000","last_became_peered":"2024-09-10T23:28:34.968216+0000","last_unstale":"2024-09-10T23:28:34.978026+0000","last_undegraded":"2024-09-10T23:28:34.978026+0000","last_fullsized":"2024-09-10T23:28:34.978026+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:56.273060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.998506+0000","last_change":"2024-09-10T23:28:33.943389+0000","last_active":"2024-09-10T23:28:34.998506+0000","last_peered":"2024-09-10T23:28:34.998506+0000","last_clean":"2024-09-10T23:28:34.998506+0000","last_became_active":"2024-09-10T23:28:33.943040+0000","last_became_peered":"2024-09-10T23:28:33.943040+0000","last_unstale":"2024-09-10T23:28:34.998506+0000","last_undegraded":"2024-09-10T23:28:34.998506+0000","last_fullsized":"2024-09-10T23:28:34.998506+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:31.455986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376144+0000","last_change":"2024-09-10T23:28:34.970301+0000","last_active":"2024-09-10T23:28:36.376144+0000","last_peered":"2024-09-10T23:28:36.376144+0000","last_clean":"2024-09-10T23:28:36.376144+0000","last_became_active":"2024-09-10T23:28:34.970023+0000","last_became_peered":"2024-09-10T23:28:34.970023+0000","last_unstale":"2024-09-10T23:28:36.376144+0000","last_undegraded":"2024-09-10T23:28:36.376144+0000","last_fullsized":"2024-09-10T23:28:36.376144+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:00.955657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.951605+0000","last_change":"2024-09-10T23:28:33.950506+0000","last_active":"2024-09-10T23:28:34.951605+0000","last_peered":"2024-09-10T23:28:34.951605+0000","last_clean":"2024-09-10T23:28:34.951605+0000","last_became_active":"2024-09-10T23:28:33.950187+0000","last_became_peered":"2024-09-10T23:28:33.950187+0000","last_unstale":"2024-09-10T23:28:34.951605+0000","last_undegraded":"2024-09-10T23:28:34.951605+0000","last_fullsized":"2024-09-10T23:28:34.951605+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:21.833452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.974551+0000","last_change":"2024-09-10T23:28:34.966560+0000","last_active":"2024-09-10T23:28:34.974551+0000","last_peered":"2024-09-10T23:28:34.974551+0000","last_clean":"2024-09-10T23:28:34.974551+0000","last_became_active":"2024-09-10T23:28:34.966253+0000","last_became_peered":"2024-09-10T23:28:34.966253+0000","last_unstale":"2024-09-10T23:28:34.974551+0000","last_undegraded":"2024-09-10T23:28:34.974551+0000","last_fullsized":"2024-09-10T23:28:34.974551+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:21.891268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.956880+0000","last_change":"2024-09-10T23:28:33.938875+0000","last_active":"2024-09-10T23:28:34.956880+0000","last_peered":"2024-09-10T23:28:34.956880+0000","last_clean":"2024-09-10T23:28:34.956880+0000","last_became_active":"2024-09-10T23:28:33.938543+0000","last_became_peered":"2024-09-10T23:28:33.938543+0000","last_unstale":"2024-09-10T23:28:34.956880+0000","last_undegraded":"2024-09-10T23:28:34.956880+0000","last_fullsized":"2024-09-10T23:28:34.956880+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:08.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981296+0000","last_change":"2024-09-10T23:28:34.973496+0000","last_active":"2024-09-10T23:28:34.981296+0000","last_peered":"2024-09-10T23:28:34.981296+0000","last_clean":"2024-09-10T23:28:34.981296+0000","last_became_active":"2024-09-10T23:28:34.973216+0000","last_became_peered":"2024-09-10T23:28:34.973216+0000","last_unstale":"2024-09-10T23:28:34.981296+0000","last_undegraded":"2024-09-10T23:28:34.981296+0000","last_fullsized":"2024-09-10T23:28:34.981296+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:16.717368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"176'8","reported_seq":21,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.999146+0000","last_change":"2024-09-10T23:28:33.962841+0000","last_active":"2024-09-10T23:28:34.999146+0000","last_peered":"2024-09-10T23:28:34.999146+0000","last_clean":"2024-09-10T23:28:34.999146+0000","last_became_active":"2024-09-10T23:28:33.962632+0000","last_became_peered":"2024-09-10T23:28:33.962632+0000","last_unstale":"2024-09-10T23:28:34.999146+0000","last_undegraded":"2024-09-10T23:28:34.999146+0000","last_fullsized":"2024-09-10T23:28:34.999146+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:48:43.120102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.964330+0000","last_change":"2024-09-10T23:28:34.963081+0000","last_active":"2024-09-10T23:28:34.964330+0000","last_peered":"2024-09-10T23:28:34.964330+0000","last_clean":"2024-09-10T23:28:34.964330+0000","last_became_active":"2024-09-10T23:28:34.962822+0000","last_became_peered":"2024-09-10T23:28:34.962822+0000","last_unstale":"2024-09-10T23:28:34.964330+0000","last_undegraded":"2024-09-10T23:28:34.964330+0000","last_fullsized":"2024-09-10T23:28:34.964330+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:17.459595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"176'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.998181+0000","last_change":"2024-09-10T23:28:33.954686+0000","last_active":"2024-09-10T23:28:34.998181+0000","last_peered":"2024-09-10T23:28:34.998181+0000","last_clean":"2024-09-10T23:28:34.998181+0000","last_became_active":"2024-09-10T23:28:33.954402+0000","last_became_peered":"2024-09-10T23:28:33.954402+0000","last_unstale":"2024-09-10T23:28:34.998181+0000","last_undegraded":"2024-09-10T23:28:34.998181+0000","last_fullsized":"2024-09-10T23:28:34.998181+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:04.623099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376706+0000","last_change":"2024-09-10T23:28:34.968633+0000","last_active":"2024-09-10T23:28:36.376706+0000","last_peered":"2024-09-10T23:28:36.376706+0000","last_clean":"2024-09-10T23:28:36.376706+0000","last_became_active":"2024-09-10T23:28:34.968356+0000","last_became_peered":"2024-09-10T23:28:34.968356+0000","last_unstale":"2024-09-10T23:28:36.376706+0000","last_undegraded":"2024-09-10T23:28:36.376706+0000","last_fullsized":"2024-09-10T23:28:36.376706+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:03.651473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.992169+0000","last_change":"2024-09-10T23:28:33.940306+0000","last_active":"2024-09-10T23:28:34.992169+0000","last_peered":"2024-09-10T23:28:34.992169+0000","last_clean":"2024-09-10T23:28:34.992169+0000","last_became_active":"2024-09-10T23:28:33.939978+0000","last_became_peered":"2024-09-10T23:28:33.939978+0000","last_unstale":"2024-09-10T23:28:34.992169+0000","last_undegraded":"2024-09-10T23:28:34.992169+0000","last_fullsized":"2024-09-10T23:28:34.992169+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:32.075978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.985848+0000","last_change":"2024-09-10T23:28:34.985090+0000","last_active":"2024-09-10T23:28:34.985848+0000","last_peered":"2024-09-10T23:28:34.985848+0000","last_clean":"2024-09-10T23:28:34.985848+0000","last_became_active":"2024-09-10T23:28:34.984821+0000","last_became_peered":"2024-09-10T23:28:34.984821+0000","last_unstale":"2024-09-10T23:28:34.985848+0000","last_undegraded":"2024-09-10T23:28:34.985848+0000","last_fullsized":"2024-09-10T23:28:34.985848+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:57.788377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"176'1","reported_seq":16,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962767+0000","last_change":"2024-09-10T23:28:33.959636+0000","last_active":"2024-09-10T23:28:35.962767+0000","last_peered":"2024-09-10T23:28:35.962767+0000","last_clean":"2024-09-10T23:28:35.962767+0000","last_became_active":"2024-09-10T23:28:33.958039+0000","last_became_peered":"2024-09-10T23:28:33.958039+0000","last_unstale":"2024-09-10T23:28:35.962767+0000","last_undegraded":"2024-09-10T23:28:35.962767+0000","last_fullsized":"2024-09-10T23:28:35.962767+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:36.252071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.972977+0000","last_change":"2024-09-10T23:28:34.969393+0000","last_active":"2024-09-10T23:28:34.972977+0000","last_peered":"2024-09-10T23:28:34.972977+0000","last_clean":"2024-09-10T23:28:34.972977+0000","last_became_active":"2024-09-10T23:28:34.969090+0000","last_became_peered":"2024-09-10T23:28:34.969090+0000","last_unstale":"2024-09-10T23:28:34.972977+0000","last_undegraded":"2024-09-10T23:28:34.972977+0000","last_fullsized":"2024-09-10T23:28:34.972977+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:51.755480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.969094+0000","last_change":"2024-09-10T23:28:33.955496+0000","last_active":"2024-09-10T23:28:34.969094+0000","last_peered":"2024-09-10T23:28:34.969094+0000","last_clean":"2024-09-10T23:28:34.969094+0000","last_became_active":"2024-09-10T23:28:33.955196+0000","last_became_peered":"2024-09-10T23:28:33.955196+0000","last_unstale":"2024-09-10T23:28:34.969094+0000","last_undegraded":"2024-09-10T23:28:34.969094+0000","last_fullsized":"2024-09-10T23:28:34.969094+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:16.306297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.973758+0000","last_change":"2024-09-10T23:28:34.969492+0000","last_active":"2024-09-10T23:28:34.973758+0000","last_peered":"2024-09-10T23:28:34.973758+0000","last_clean":"2024-09-10T23:28:34.973758+0000","last_became_active":"2024-09-10T23:28:34.968029+0000","last_became_peered":"2024-09-10T23:28:34.968029+0000","last_unstale":"2024-09-10T23:28:34.973758+0000","last_undegraded":"2024-09-10T23:28:34.973758+0000","last_fullsized":"2024-09-10T23:28:34.973758+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:14.474963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.996796+0000","last_change":"2024-09-10T23:28:33.951643+0000","last_active":"2024-09-10T23:28:34.996796+0000","last_peered":"2024-09-10T23:28:34.996796+0000","last_clean":"2024-09-10T23:28:34.996796+0000","last_became_active":"2024-09-10T23:28:33.950422+0000","last_became_peered":"2024-09-10T23:28:33.950422+0000","last_unstale":"2024-09-10T23:28:34.996796+0000","last_undegraded":"2024-09-10T23:28:34.996796+0000","last_fullsized":"2024-09-10T23:28:34.996796+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:41.841345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.972318+0000","last_change":"2024-09-10T23:28:34.970316+0000","last_active":"2024-09-10T23:28:34.972318+0000","last_peered":"2024-09-10T23:28:34.972318+0000","last_clean":"2024-09-10T23:28:34.972318+0000","last_became_active":"2024-09-10T23:28:34.970009+0000","last_became_peered":"2024-09-10T23:28:34.970009+0000","last_unstale":"2024-09-10T23:28:34.972318+0000","last_undegraded":"2024-09-10T23:28:34.972318+0000","last_fullsized":"2024-09-10T23:28:34.972318+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:24.644205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.959540+0000","last_change":"2024-09-10T23:28:33.955662+0000","last_active":"2024-09-10T23:28:34.959540+0000","last_peered":"2024-09-10T23:28:34.959540+0000","last_clean":"2024-09-10T23:28:34.959540+0000","last_became_active":"2024-09-10T23:28:33.955388+0000","last_became_peered":"2024-09-10T23:28:33.955388+0000","last_unstale":"2024-09-10T23:28:34.959540+0000","last_undegraded":"2024-09-10T23:28:34.959540+0000","last_fullsized":"2024-09-10T23:28:34.959540+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:16.892525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981248+0000","last_change":"2024-09-10T23:28:34.976480+0000","last_active":"2024-09-10T23:28:34.981248+0000","last_peered":"2024-09-10T23:28:34.981248+0000","last_clean":"2024-09-10T23:28:34.981248+0000","last_became_active":"2024-09-10T23:28:34.975157+0000","last_became_peered":"2024-09-10T23:28:34.975157+0000","last_unstale":"2024-09-10T23:28:34.981248+0000","last_undegraded":"2024-09-10T23:28:34.981248+0000","last_fullsized":"2024-09-10T23:28:34.981248+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:26.501094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.956357+0000","last_change":"2024-09-10T23:28:33.955688+0000","last_active":"2024-09-10T23:28:34.956357+0000","last_peered":"2024-09-10T23:28:34.956357+0000","last_clean":"2024-09-10T23:28:34.956357+0000","last_became_active":"2024-09-10T23:28:33.955089+0000","last_became_peered":"2024-09-10T23:28:33.955089+0000","last_unstale":"2024-09-10T23:28:34.956357+0000","last_undegraded":"2024-09-10T23:28:34.956357+0000","last_fullsized":"2024-09-10T23:28:34.956357+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:56.243399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.377036+0000","last_change":"2024-09-10T23:28:34.966902+0000","last_active":"2024-09-10T23:28:36.377036+0000","last_peered":"2024-09-10T23:28:36.377036+0000","last_clean":"2024-09-10T23:28:36.377036+0000","last_became_active":"2024-09-10T23:28:34.966628+0000","last_became_peered":"2024-09-10T23:28:34.966628+0000","last_unstale":"2024-09-10T23:28:36.377036+0000","last_undegraded":"2024-09-10T23:28:36.377036+0000","last_fullsized":"2024-09-10T23:28:36.377036+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:34.898389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962529+0000","last_change":"2024-09-10T23:28:33.954422+0000","last_active":"2024-09-10T23:28:35.962529+0000","last_peered":"2024-09-10T23:28:35.962529+0000","last_clean":"2024-09-10T23:28:35.962529+0000","last_became_active":"2024-09-10T23:28:33.954146+0000","last_became_peered":"2024-09-10T23:28:33.954146+0000","last_unstale":"2024-09-10T23:28:35.962529+0000","last_undegraded":"2024-09-10T23:28:35.962529+0000","last_fullsized":"2024-09-10T23:28:35.962529+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:01:02.528045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.981280+0000","last_change":"2024-09-10T23:28:34.977109+0000","last_active":"2024-09-10T23:28:34.981280+0000","last_peered":"2024-09-10T23:28:34.981280+0000","last_clean":"2024-09-10T23:28:34.981280+0000","last_became_active":"2024-09-10T23:28:34.976801+0000","last_became_peered":"2024-09-10T23:28:34.976801+0000","last_unstale":"2024-09-10T23:28:34.981280+0000","last_undegraded":"2024-09-10T23:28:34.981280+0000","last_fullsized":"2024-09-10T23:28:34.981280+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:51.755670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"176'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.992808+0000","last_change":"2024-09-10T23:28:33.949615+0000","last_active":"2024-09-10T23:28:34.992808+0000","last_peered":"2024-09-10T23:28:34.992808+0000","last_clean":"2024-09-10T23:28:34.992808+0000","last_became_active":"2024-09-10T23:28:33.949362+0000","last_became_peered":"2024-09-10T23:28:33.949362+0000","last_unstale":"2024-09-10T23:28:34.992808+0000","last_undegraded":"2024-09-10T23:28:34.992808+0000","last_fullsized":"2024-09-10T23:28:34.992808+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:46.882312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.968328+0000","last_change":"2024-09-10T23:28:34.962544+0000","last_active":"2024-09-10T23:28:34.968328+0000","last_peered":"2024-09-10T23:28:34.968328+0000","last_clean":"2024-09-10T23:28:34.968328+0000","last_became_active":"2024-09-10T23:28:34.962006+0000","last_became_peered":"2024-09-10T23:28:34.962006+0000","last_unstale":"2024-09-10T23:28:34.968328+0000","last_undegraded":"2024-09-10T23:28:34.968328+0000","last_fullsized":"2024-09-10T23:28:34.968328+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:16.711354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.958290+0000","last_change":"2024-09-10T23:28:33.964600+0000","last_active":"2024-09-10T23:28:34.958290+0000","last_peered":"2024-09-10T23:28:34.958290+0000","last_clean":"2024-09-10T23:28:34.958290+0000","last_became_active":"2024-09-10T23:28:33.961619+0000","last_became_peered":"2024-09-10T23:28:33.961619+0000","last_unstale":"2024-09-10T23:28:34.958290+0000","last_undegraded":"2024-09-10T23:28:34.958290+0000","last_fullsized":"2024-09-10T23:28:34.958290+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:40.217786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.985088+0000","last_change":"2024-09-10T23:28:34.979197+0000","last_active":"2024-09-10T23:28:34.985088+0000","last_peered":"2024-09-10T23:28:34.985088+0000","last_clean":"2024-09-10T23:28:34.985088+0000","last_became_active":"2024-09-10T23:28:34.978833+0000","last_became_peered":"2024-09-10T23:28:34.978833+0000","last_unstale":"2024-09-10T23:28:34.985088+0000","last_undegraded":"2024-09-10T23:28:34.985088+0000","last_fullsized":"2024-09-10T23:28:34.985088+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:07.976471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376782+0000","last_change":"2024-09-10T23:28:33.957793+0000","last_active":"2024-09-10T23:28:36.376782+0000","last_peered":"2024-09-10T23:28:36.376782+0000","last_clean":"2024-09-10T23:28:36.376782+0000","last_became_active":"2024-09-10T23:28:33.957502+0000","last_became_peered":"2024-09-10T23:28:33.957502+0000","last_unstale":"2024-09-10T23:28:36.376782+0000","last_undegraded":"2024-09-10T23:28:36.376782+0000","last_fullsized":"2024-09-10T23:28:36.376782+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:44.445494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.977629+0000","last_change":"2024-09-10T23:28:34.973138+0000","last_active":"2024-09-10T23:28:34.977629+0000","last_peered":"2024-09-10T23:28:34.977629+0000","last_clean":"2024-09-10T23:28:34.977629+0000","last_became_active":"2024-09-10T23:28:34.972847+0000","last_became_peered":"2024-09-10T23:28:34.972847+0000","last_unstale":"2024-09-10T23:28:34.977629+0000","last_undegraded":"2024-09-10T23:28:34.977629+0000","last_fullsized":"2024-09-10T23:28:34.977629+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:20:01.979608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:36.376740+0000","last_change":"2024-09-10T23:28:33.962250+0000","last_active":"2024-09-10T23:28:36.376740+0000","last_peered":"2024-09-10T23:28:36.376740+0000","last_clean":"2024-09-10T23:28:36.376740+0000","last_became_active":"2024-09-10T23:28:33.961838+0000","last_became_peered":"2024-09-10T23:28:33.961838+0000","last_unstale":"2024-09-10T23:28:36.376740+0000","last_undegraded":"2024-09-10T23:28:36.376740+0000","last_fullsized":"2024-09-10T23:28:36.376740+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:43:27.095653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962412+0000","last_change":"2024-09-10T23:28:34.975892+0000","last_active":"2024-09-10T23:28:35.962412+0000","last_peered":"2024-09-10T23:28:35.962412+0000","last_clean":"2024-09-10T23:28:35.962412+0000","last_became_active":"2024-09-10T23:28:34.975366+0000","last_became_peered":"2024-09-10T23:28:34.975366+0000","last_unstale":"2024-09-10T23:28:35.962412+0000","last_undegraded":"2024-09-10T23:28:35.962412+0000","last_fullsized":"2024-09-10T23:28:35.962412+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:52.230245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.967262+0000","last_change":"2024-09-10T23:28:33.958575+0000","last_active":"2024-09-10T23:28:34.967262+0000","last_peered":"2024-09-10T23:28:34.967262+0000","last_clean":"2024-09-10T23:28:34.967262+0000","last_became_active":"2024-09-10T23:28:33.958302+0000","last_became_peered":"2024-09-10T23:28:33.958302+0000","last_unstale":"2024-09-10T23:28:34.967262+0000","last_undegraded":"2024-09-10T23:28:34.967262+0000","last_fullsized":"2024-09-10T23:28:34.967262+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:53.733466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.978535+0000","last_change":"2024-09-10T23:28:34.975475+0000","last_active":"2024-09-10T23:28:34.978535+0000","last_peered":"2024-09-10T23:28:34.978535+0000","last_clean":"2024-09-10T23:28:34.978535+0000","last_became_active":"2024-09-10T23:28:34.975111+0000","last_became_peered":"2024-09-10T23:28:34.975111+0000","last_unstale":"2024-09-10T23:28:34.978535+0000","last_undegraded":"2024-09-10T23:28:34.978535+0000","last_fullsized":"2024-09-10T23:28:34.978535+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:04.358777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.966959+0000","last_change":"2024-09-10T23:28:33.968241+0000","last_active":"2024-09-10T23:28:34.966959+0000","last_peered":"2024-09-10T23:28:34.966959+0000","last_clean":"2024-09-10T23:28:34.966959+0000","last_became_active":"2024-09-10T23:28:33.967874+0000","last_became_peered":"2024-09-10T23:28:33.967874+0000","last_unstale":"2024-09-10T23:28:34.966959+0000","last_undegraded":"2024-09-10T23:28:34.966959+0000","last_fullsized":"2024-09-10T23:28:34.966959+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:15:13.468628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.972938+0000","last_change":"2024-09-10T23:28:34.968747+0000","last_active":"2024-09-10T23:28:34.972938+0000","last_peered":"2024-09-10T23:28:34.972938+0000","last_clean":"2024-09-10T23:28:34.972938+0000","last_became_active":"2024-09-10T23:28:34.968268+0000","last_became_peered":"2024-09-10T23:28:34.968268+0000","last_unstale":"2024-09-10T23:28:34.972938+0000","last_undegraded":"2024-09-10T23:28:34.972938+0000","last_fullsized":"2024-09-10T23:28:34.972938+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:16.739764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.956612+0000","last_change":"2024-09-10T23:28:33.955712+0000","last_active":"2024-09-10T23:28:34.956612+0000","last_peered":"2024-09-10T23:28:34.956612+0000","last_clean":"2024-09-10T23:28:34.956612+0000","last_became_active":"2024-09-10T23:28:33.955426+0000","last_became_peered":"2024-09-10T23:28:33.955426+0000","last_unstale":"2024-09-10T23:28:34.956612+0000","last_undegraded":"2024-09-10T23:28:34.956612+0000","last_fullsized":"2024-09-10T23:28:34.956612+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:24.131697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.984862+0000","last_change":"2024-09-10T23:28:34.980722+0000","last_active":"2024-09-10T23:28:34.984862+0000","last_peered":"2024-09-10T23:28:34.984862+0000","last_clean":"2024-09-10T23:28:34.984862+0000","last_became_active":"2024-09-10T23:28:34.980477+0000","last_became_peered":"2024-09-10T23:28:34.980477+0000","last_unstale":"2024-09-10T23:28:34.984862+0000","last_undegraded":"2024-09-10T23:28:34.984862+0000","last_fullsized":"2024-09-10T23:28:34.984862+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:23.362341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":15,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962530+0000","last_change":"2024-09-10T23:28:33.952206+0000","last_active":"2024-09-10T23:28:35.962530+0000","last_peered":"2024-09-10T23:28:35.962530+0000","last_clean":"2024-09-10T23:28:35.962530+0000","last_became_active":"2024-09-10T23:28:33.951809+0000","last_became_peered":"2024-09-10T23:28:33.951809+0000","last_unstale":"2024-09-10T23:28:35.962530+0000","last_undegraded":"2024-09-10T23:28:35.962530+0000","last_fullsized":"2024-09-10T23:28:35.962530+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:50.522566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-10T23:28:35.962619+0000","last_change":"2024-09-10T23:28:34.980134+0000","last_active":"2024-09-10T23:28:35.962619+0000","last_peered":"2024-09-10T23:28:35.962619+0000","last_clean":"2024-09-10T23:28:35.962619+0000","last_became_active":"2024-09-10T23:28:34.977010+0000","last_became_peered":"2024-09-10T23:28:34.977010+0000","last_unstale":"2024-09-10T23:28:35.962619+0000","last_undegraded":"2024-09-10T23:28:35.962619+0000","last_fullsized":"2024-09-10T23:28:35.962619+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:33.927741+0000","last_clean_scrub_stamp":"2024-09-10T23:28:33.927741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:05.242005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.955807+0000","last_change":"2024-09-10T23:28:33.950210+0000","last_active":"2024-09-10T23:28:34.955807+0000","last_peered":"2024-09-10T23:28:34.955807+0000","last_clean":"2024-09-10T23:28:34.955807+0000","last_became_active":"2024-09-10T23:28:33.949975+0000","last_became_peered":"2024-09-10T23:28:33.949975+0000","last_unstale":"2024-09-10T23:28:34.955807+0000","last_undegraded":"2024-09-10T23:28:34.955807+0000","last_fullsized":"2024-09-10T23:28:34.955807+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:28:32.921407+0000","last_clean_scrub_stamp":"2024-09-10T23:28:32.921407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:52.148533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":390,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-10T23:28:34.966661+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:28:34.966661+0000","last_peered":"2024-09-10T23:28:34.966661+0000","last_clean":"2024-09-10T23:28:34.966661+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:28:34.966661+0000","last_undegraded":"2024-09-10T23:28:34.966661+0000","last_fullsized":"2024-09-10T23:28:34.966661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69384,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302456,"statfs":{"total":96636764160,"available":96565714944,"internally_reserved":0,"allocated":2211840,"data_stored":1038556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509602,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69956,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301884,"statfs":{"total":96636764160,"available":96565129216,"internally_reserved":0,"allocated":2801664,"data_stored":1628854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63872,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307968,"statfs":{"total":96636764160,"available":96571359232,"internally_reserved":0,"allocated":2195456,"data_stored":1031319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509602,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69428,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94302412,"statfs":{"total":96636764160,"available":96565669888,"internally_reserved":0,"allocated":2195456,"data_stored":1031319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509601,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73608,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298232,"statfs":{"total":96636764160,"available":96561389568,"internally_reserved":0,"allocated":2211840,"data_stored":1039068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509602,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59720,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312120,"statfs":{"total":96636764160,"available":96575610880,"internally_reserved":0,"allocated":2207744,"data_stored":1038486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509601,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78332,"kb_used_data":2724,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293508,"statfs":{"total":96636764160,"available":96556552192,"internally_reserved":0,"allocated":2789376,"data_stored":1621687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69396,"kb_used_data":2176,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302444,"statfs":{"total":96636764160,"available":96565702656,"internally_reserved":0,"allocated":2228224,"data_stored":1045338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:28:39.526 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:28:39.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:28:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 -- 172.21.15.17:0/802834515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040aeb50 msgr2=0x7f73040cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 --2- 172.21.15.17:0/802834515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040aeb50 0x7f73040cd4d0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f73040cf720 tx=0x7f72fc01cd80 comp rx=0 tx=0).stop 2024-09-10T23:28:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 -- 172.21.15.17:0/802834515 shutdown_connections 2024-09-10T23:28:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 --2- 172.21.15.17:0/802834515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040aeb50 0x7f73040cd4d0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 --2- 172.21.15.17:0/802834515 >> v2:172.21.15.77:3300/0 conn(0x7f73040cf0b0 0x7f730406f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 -- 172.21.15.17:0/802834515 >> 172.21.15.17:0/802834515 conn(0x7f730409a9f0 msgr2=0x7f730409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 -- 172.21.15.17:0/802834515 shutdown_connections 2024-09-10T23:28:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 -- 172.21.15.17:0/802834515 wait complete. 2024-09-10T23:28:39.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 Processor -- start 2024-09-10T23:28:39.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.712+0000 7f730b600640 1 -- start start 2024-09-10T23:28:39.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f730b600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73040aeb50 0x7f7304154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:39.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f730b600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ce5c0 0x7f73040b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f730b600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73040cf0b0 0x7f73040b6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f730b600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f730416af60 con 0x7f73040ce5c0 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f730b600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f730416ade0 con 0x7f73040aeb50 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f730b600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f730416b0e0 con 0x7f73040cf0b0 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f72fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ce5c0 0x7f73040b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f72fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ce5c0 0x7f73040b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49344/0 (socket says 172.21.15.17:49344) 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f72fbe00640 1 -- 172.21.15.17:0/4004321693 learned_addr learned my addr 172.21.15.17:0/4004321693 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f7308c00640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73040aeb50 0x7f7304154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f7309600640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73040cf0b0 0x7f73040b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f72fbe00640 1 -- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73040cf0b0 msgr2=0x7f73040b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f72fbe00640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73040cf0b0 0x7f73040b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f72fbe00640 1 -- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73040aeb50 msgr2=0x7f7304154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f72fbe00640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73040aeb50 0x7f7304154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f72fbe00640 1 -- 172.21.15.17:0/4004321693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73040cacc0 con 0x7f73040ce5c0 2024-09-10T23:28:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f72fbe00640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ce5c0 0x7f73040b6250 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00b410 tx=0x7f72ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f7301600640 1 -- 172.21.15.17:0/4004321693 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec015020 con 0x7f73040ce5c0 2024-09-10T23:28:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f7301600640 1 -- 172.21.15.17:0/4004321693 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72ec011920 con 0x7f73040ce5c0 2024-09-10T23:28:39.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f7301600640 1 -- 172.21.15.17:0/4004321693 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec011d70 con 0x7f73040ce5c0 2024-09-10T23:28:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73040cafa0 con 0x7f73040ce5c0 2024-09-10T23:28:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73040cb560 con 0x7f73040ce5c0 2024-09-10T23:28:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.716+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73040cd4d0 con 0x7f73040ce5c0 2024-09-10T23:28:39.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.720+0000 7f7301600640 1 -- 172.21.15.17:0/4004321693 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f72ec01a400 con 0x7f73040ce5c0 2024-09-10T23:28:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.720+0000 7f7301600640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f72e00725e0 0x7f72e0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.720+0000 7f7301600640 1 -- 172.21.15.17:0/4004321693 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f72ec093520 con 0x7f73040ce5c0 2024-09-10T23:28:39.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.720+0000 7f7308c00640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f72e00725e0 0x7f72e0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:39.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.720+0000 7f7308c00640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f72e00725e0 0x7f72e0074aa0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f730406a0e0 tx=0x7f72f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.724+0000 7f7301600640 1 -- 172.21.15.17:0/4004321693 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f72ec01f020 con 0x7f73040ce5c0 2024-09-10T23:28:39.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.964+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f73040b1580 con 0x7f73040ce5c0 2024-09-10T23:28:39.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.968+0000 7f7301600640 1 -- 172.21.15.17:0/4004321693 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) ==== 190+0+147 (secure 0 0 0) 0x7f72ec05eb00 con 0x7f73040ce5c0 2024-09-10T23:28:39.974 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:28:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:28:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:28:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:28:39.974 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:28:39.974 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:28:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f72e00725e0 msgr2=0x7f72e0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f72e00725e0 0x7f72e0074aa0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f730406a0e0 tx=0x7f72f4009040 comp rx=0 tx=0).stop 2024-09-10T23:28:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ce5c0 msgr2=0x7f73040b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ce5c0 0x7f73040b6250 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00b410 tx=0x7f72ec00b8d0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 shutdown_connections 2024-09-10T23:28:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f72e00725e0 0x7f72e0074aa0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73040cf0b0 0x7f73040b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73040ce5c0 0x7f73040b6250 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 --2- 172.21.15.17:0/4004321693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73040aeb50 0x7f7304154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:39.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 >> 172.21.15.17:0/4004321693 conn(0x7f730409a9f0 msgr2=0x7f73040d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:39.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 shutdown_connections 2024-09-10T23:28:39.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:39.972+0000 7f730b600640 1 -- 172.21.15.17:0/4004321693 wait complete. 2024-09-10T23:28:39.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:28:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.136+0000 7f6acc800640 1 -- 172.21.15.17:0/721711594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac406e750 msgr2=0x7f6ac4150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.136+0000 7f6acc800640 1 --2- 172.21.15.17:0/721711594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac406e750 0x7f6ac4150d70 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009bc0 tx=0x7f6ac001f2d0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.136+0000 7f6acc800640 1 -- 172.21.15.17:0/721711594 shutdown_connections 2024-09-10T23:28:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.136+0000 7f6acc800640 1 --2- 172.21.15.17:0/721711594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac406e750 0x7f6ac4150d70 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.136+0000 7f6acc800640 1 -- 172.21.15.17:0/721711594 >> 172.21.15.17:0/721711594 conn(0x7f6ac406cfc0 msgr2=0x7f6ac406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.136+0000 7f6acc800640 1 -- 172.21.15.17:0/721711594 shutdown_connections 2024-09-10T23:28:40.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.136+0000 7f6acc800640 1 -- 172.21.15.17:0/721711594 wait complete. 2024-09-10T23:28:40.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 Processor -- start 2024-09-10T23:28:40.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 -- start start 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac406e750 0x7f6ac41e7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40cf230 0x7f6ac414db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac40cf610 0x7f6ac415bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40d03b0 con 0x7f6ac40cf230 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40d0230 con 0x7f6ac406e750 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac40d0530 con 0x7f6ac40cf610 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40cf230 0x7f6ac414db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40cf230 0x7f6ac414db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49366/0 (socket says 172.21.15.17:49366) 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9400640 1 -- 172.21.15.17:0/4257663534 learned_addr learned my addr 172.21.15.17:0/4257663534 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6aca800640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac40cf610 0x7f6ac415bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9e00640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac406e750 0x7f6ac41e7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9400640 1 -- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac40cf610 msgr2=0x7f6ac415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9400640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac40cf610 0x7f6ac415bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9400640 1 -- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac406e750 msgr2=0x7f6ac41e7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9400640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac406e750 0x7f6ac41e7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9400640 1 -- 172.21.15.17:0/4257663534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac40af8f0 con 0x7f6ac40cf230 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6ac9400640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40cf230 0x7f6ac414db40 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c3c0 tx=0x7f6ab400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6abe000640 1 -- 172.21.15.17:0/4257663534 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4017070 con 0x7f6ac40cf230 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6abe000640 1 -- 172.21.15.17:0/4257663534 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ab40053c0 con 0x7f6ac40cf230 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac40afbd0 con 0x7f6ac40cf230 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6abe000640 1 -- 172.21.15.17:0/4257663534 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4003860 con 0x7f6ac40cf230 2024-09-10T23:28:40.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.140+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac40b0190 con 0x7f6ac40cf230 2024-09-10T23:28:40.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.144+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac4150d70 con 0x7f6ac40cf230 2024-09-10T23:28:40.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.144+0000 7f6abe000640 1 -- 172.21.15.17:0/4257663534 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6ab4003a00 con 0x7f6ac40cf230 2024-09-10T23:28:40.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.144+0000 7f6abe000640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6aa80725e0 0x7f6aa8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.144+0000 7f6abe000640 1 -- 172.21.15.17:0/4257663534 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f6ab4092a00 con 0x7f6ac40cf230 2024-09-10T23:28:40.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.144+0000 7f6ac9e00640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6aa80725e0 0x7f6aa8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.144+0000 7f6ac9e00640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6aa80725e0 0x7f6aa8074aa0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8001ec0 tx=0x7f6ab8001a80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:40.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.148+0000 7f6abe000640 1 -- 172.21.15.17:0/4257663534 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6ab405d860 con 0x7f6ac40cf230 2024-09-10T23:28:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ac40b0360 con 0x7f6ac40cf230 2024-09-10T23:28:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6abe000640 1 -- 172.21.15.17:0/4257663534 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) ==== 95+0+5238 (secure 0 0 0) 0x7f6ab4062290 con 0x7f6ac40cf230 2024-09-10T23:28:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:28:40.360 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":133,"btime":"2024-09-10T23:28:37:977949+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1319528493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1319528493},{"type":"v1","addr":"172.21.15.17:6833","nonce":1319528493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1685364651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1685364651},{"type":"v1","addr":"172.21.15.77:6836","nonce":1685364651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129},{"gid":9436,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3587135392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3587135392},{"type":"v1","addr":"172.21.15.77:6837","nonce":3587135392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":133,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:28:34.352047+0000","modified":"2024-09-10T23:28:37.384077+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10197},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10197":{"gid":10197,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3849451590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3849451590},{"type":"v1","addr":"172.21.15.17:6835","nonce":3849451590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10197,"qdb_cluster":[10197]},"id":12}]} 2024-09-10T23:28:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 133 2024-09-10T23:28:40.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6aa80725e0 msgr2=0x7f6aa8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6aa80725e0 0x7f6aa8074aa0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8001ec0 tx=0x7f6ab8001a80 comp rx=0 tx=0).stop 2024-09-10T23:28:40.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40cf230 msgr2=0x7f6ac414db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40cf230 0x7f6ac414db40 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c3c0 tx=0x7f6ab400c880 comp rx=0 tx=0).stop 2024-09-10T23:28:40.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 shutdown_connections 2024-09-10T23:28:40.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6aa80725e0 0x7f6aa8074aa0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ac40cf610 0x7f6ac415bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ac40cf230 0x7f6ac414db40 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 --2- 172.21.15.17:0/4257663534 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ac406e750 0x7f6ac41e7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 >> 172.21.15.17:0/4257663534 conn(0x7f6ac406cfc0 msgr2=0x7f6ac4068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 shutdown_connections 2024-09-10T23:28:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.356+0000 7f6acc800640 1 -- 172.21.15.17:0/4257663534 wait complete. 2024-09-10T23:28:40.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 133, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:28:34.352047+0000', 'modified': '2024-09-10T23:28:37.384077+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10197}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10197': {'gid': 10197, 'name': 'a', 'rank': 0, 'incarnation': 130, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/3849451590', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 3849451590}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 3849451590}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10197, 'qdb_cluster': [10197]} 2024-09-10T23:28:40.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:28:40.785 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:28:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.932+0000 7f1f12e00640 1 -- 172.21.15.17:0/395577079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15b890 msgr2=0x7f1f0c073f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.932+0000 7f1f12e00640 1 --2- 172.21.15.17:0/395577079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15b890 0x7f1f0c073f30 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009900 tx=0x7f1f0001c7c0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.932+0000 7f1f12e00640 1 -- 172.21.15.17:0/395577079 shutdown_connections 2024-09-10T23:28:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.932+0000 7f1f12e00640 1 --2- 172.21.15.17:0/395577079 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f0c0ceeb0 0x7f1f0c06cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.932+0000 7f1f12e00640 1 --2- 172.21.15.17:0/395577079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15b890 0x7f1f0c073f30 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.932+0000 7f1f12e00640 1 -- 172.21.15.17:0/395577079 >> 172.21.15.17:0/395577079 conn(0x7f1f0c0b2740 msgr2=0x7f1f0c0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.932+0000 7f1f12e00640 1 -- 172.21.15.17:0/395577079 shutdown_connections 2024-09-10T23:28:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.932+0000 7f1f12e00640 1 -- 172.21.15.17:0/395577079 wait complete. 2024-09-10T23:28:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 Processor -- start 2024-09-10T23:28:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 -- start start 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f0c0ceeb0 0x7f1f0c144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f0c15b890 0x7f1f0c1f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15bc70 0x7f1f0c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c1689c0 con 0x7f1f0c15bc70 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0709e0 con 0x7f1f0c0ceeb0 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c168b40 con 0x7f1f0c15b890 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15bc70 0x7f1f0c14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15bc70 0x7f1f0c14ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49392/0 (socket says 172.21.15.17:49392) 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12400640 1 -- 172.21.15.17:0/3071582831 learned_addr learned my addr 172.21.15.17:0/3071582831 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f11a00640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f0c0ceeb0 0x7f1f0c144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f11000640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f0c15b890 0x7f1f0c1f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12400640 1 -- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f0c15b890 msgr2=0x7f1f0c1f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12400640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f0c15b890 0x7f1f0c1f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12400640 1 -- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f0c0ceeb0 msgr2=0x7f1f0c144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12400640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f0c0ceeb0 0x7f1f0c144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12400640 1 -- 172.21.15.17:0/3071582831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c0b5a40 con 0x7f1f0c15bc70 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f11000640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f0c15b890 0x7f1f0c1f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12400640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15bc70 0x7f1f0c14ea90 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e9f0 tx=0x7f1f0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f09600640 1 -- 172.21.15.17:0/3071582831 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400cd80 con 0x7f1f0c15bc70 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f09600640 1 -- 172.21.15.17:0/3071582831 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f04004c20 con 0x7f1f0c15bc70 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f09600640 1 -- 172.21.15.17:0/3071582831 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04005020 con 0x7f1f0c15bc70 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 -- 172.21.15.17:0/3071582831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c14adf0 con 0x7f1f0c15bc70 2024-09-10T23:28:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.936+0000 7f1f12e00640 1 -- 172.21.15.17:0/3071582831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c14b3b0 con 0x7f1f0c15bc70 2024-09-10T23:28:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.940+0000 7f1f09600640 1 -- 172.21.15.17:0/3071582831 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1f0400f040 con 0x7f1f0c15bc70 2024-09-10T23:28:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.940+0000 7f1f09600640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1eec072610 0x7f1eec074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.940+0000 7f1f177f5000 1 Processor -- start 2024-09-10T23:28:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.940+0000 7f1f09600640 1 -- 172.21.15.17:0/3071582831 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f1f040939b0 con 0x7f1f0c15bc70 2024-09-10T23:28:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.940+0000 7f1f177f5000 1 -- start start 2024-09-10T23:28:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.940+0000 7f1f11a00640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1eec072610 0x7f1eec074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca918afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918b02f0 0x55ca918638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca91863e10 0x55ca918641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca917843f0 con 0x55ca91863e10 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ca916c1b20 con 0x55ca918af9d0 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ca916b0f50 con 0x55ca918b02f0 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f11a00640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1eec072610 0x7f1eec074ad0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1f000ae000 tx=0x7f1f0001b000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca91863e10 0x55ca918641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca91863e10 0x55ca918641f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49396/0 (socket says 172.21.15.17:49396) 2024-09-10T23:28:40.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f12400640 1 -- 172.21.15.17:0/1077619187 learned_addr learned my addr 172.21.15.17:0/1077619187 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f11000640 1 --2- 172.21.15.17:0/1077619187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918b02f0 0x55ca918638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f11a00640 1 --2- 172.21.15.17:0/1077619187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca918afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f12400640 1 -- 172.21.15.17:0/1077619187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918b02f0 msgr2=0x55ca918638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f12400640 1 --2- 172.21.15.17:0/1077619187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918b02f0 0x55ca918638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f12400640 1 -- 172.21.15.17:0/1077619187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 msgr2=0x55ca918afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f12400640 1 --2- 172.21.15.17:0/1077619187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca918afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f12400640 1 -- 172.21.15.17:0/1077619187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca91678590 con 0x55ca91863e10 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f12400640 1 --2- 172.21.15.17:0/1077619187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca91863e10 0x55ca918641f0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f1f0405e840 tx=0x7f1f0405e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df01f73e783d0ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1efe000640 1 -- 172.21.15.17:0/1077619187 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04063070 con 0x55ca91863e10 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1efe000640 1 -- 172.21.15.17:0/1077619187 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f04067d00 con 0x55ca91863e10 2024-09-10T23:28:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1efe000640 1 -- 172.21.15.17:0/1077619187 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0401f040 con 0x55ca91863e10 2024-09-10T23:28:40.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 -- 172.21.15.17:0/1077619187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca91863e10 msgr2=0x55ca918641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 --2- 172.21.15.17:0/1077619187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca91863e10 0x55ca918641f0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f1f0405e840 tx=0x7f1f0405e7b0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 -- 172.21.15.17:0/1077619187 shutdown_connections 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 --2- 172.21.15.17:0/1077619187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca91863e10 0x55ca918641f0 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 --2- 172.21.15.17:0/1077619187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918b02f0 0x55ca918638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 --2- 172.21.15.17:0/1077619187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca918afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 -- 172.21.15.17:0/1077619187 >> 172.21.15.17:0/1077619187 conn(0x55ca9174d130 msgr2=0x55ca91892e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 -- 172.21.15.17:0/1077619187 shutdown_connections 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 -- 172.21.15.17:0/1077619187 wait complete. 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 -- start start 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.944+0000 7f1f177f5000 1 Processor -- start 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 0x55ca918906a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca91890e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca918913b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca9164b5d0 con 0x55ca918b02f0 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ca916b4d60 con 0x55ca918af9d0 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ca91657500 con 0x55ca91863e10 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 10 client.0 _ll_register_callbacks cb 0x55ca9165b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca918913b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca918913b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49408/0 (socket says 172.21.15.17:49408) 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f12400640 1 -- 172.21.15.17:0/898099688 learned_addr learned my addr 172.21.15.17:0/898099688 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f11000640 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca91890e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f11a00640 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 0x55ca918906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f12400640 1 -- 172.21.15.17:0/898099688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 msgr2=0x55ca918906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:40.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f12400640 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 0x55ca918906a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f12400640 1 -- 172.21.15.17:0/898099688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 msgr2=0x55ca91890e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f12400640 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca91890e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f12400640 1 -- 172.21.15.17:0/898099688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca9164f170 con 0x55ca918b02f0 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f12400640 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca918913b0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f1f04000f90 tx=0x7f1f04067d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45791a190d9dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1ef2a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1ef2a00640 1 -- 172.21.15.17:0/898099688 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0401f040 con 0x55ca918b02f0 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 -- 172.21.15.17:0/898099688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca916490f0 con 0x55ca918b02f0 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1ef2a00640 1 -- 172.21.15.17:0/898099688 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f1f0405db10 con 0x55ca918b02f0 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1ef2a00640 1 -- 172.21.15.17:0/898099688 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f1f04063040 con 0x55ca918b02f0 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 10 client.10335 fetch_fsmap learned FSMap version 133 2024-09-10T23:28:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 -- 172.21.15.17:0/898099688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55ca91735ef0 con 0x55ca918b02f0 2024-09-10T23:28:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1ef2a00640 1 -- 172.21.15.17:0/898099688 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ca916490f0 con 0x55ca918b02f0 2024-09-10T23:28:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1ef2a00640 1 -- 172.21.15.17:0/898099688 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 133) ==== 3502+0+0 (secure 0 0 0) 0x7f1f04075020 con 0x55ca918b02f0 2024-09-10T23:28:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 10 client.10335 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T23:28:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 10 client.10335 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:28:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 20 client.10335 populate_metadata read hostname 'smithi017' 2024-09-10T23:28:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55ca918920f0 0x55ca918c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 4 client.10335 mds_command: new command op to 10197 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:28:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 -- 172.21.15.17:0/898099688 --> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca916c3a70 con 0x55ca918920f0 2024-09-10T23:28:40.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f11a00640 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55ca918920f0 0x55ca918c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f11a00640 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55ca918920f0 0x55ca918c1c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=983082e75104b512 server_cookie=d6eb3a55fedc4bcd in_seq=0 out_seq=0 2024-09-10T23:28:40.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1ef2a00640 10 client.10335 ms_handle_connect on v2:172.21.15.17:6834/3849451590 2024-09-10T23:28:40.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1ef2a00640 1 -- 172.21.15.17:0/898099688 <== mds.0 v2:172.21.15.17:6834/3849451590 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca916c3a70 con 0x55ca918920f0 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1ef2a00640 10 client.10335 handle_command_reply: tid=0 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 client.10335 shutdown 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 -- 172.21.15.17:0/898099688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 msgr2=0x55ca918913b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca918913b0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f1f04000f90 tx=0x7f1f04067d00 comp rx=0 tx=0).stop 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 -- 172.21.15.17:0/898099688 shutdown_connections 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55ca918920f0 0x55ca918c1c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.952+0000 7f1ef2a00640 0 client.10335 ms_handle_reset on v2:172.21.15.17:6834/3849451590 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.948+0000 7f1f177f5000 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca918913b0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.952+0000 7f1f177f5000 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca91890e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.952+0000 7f1f177f5000 1 --2- 172.21.15.17:0/898099688 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 0x55ca918906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.952+0000 7f1f177f5000 1 -- 172.21.15.17:0/898099688 >> 172.21.15.17:0/898099688 conn(0x55ca9174d130 msgr2=0x55ca91862fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.952+0000 7f1f177f5000 1 -- 172.21.15.17:0/898099688 shutdown_connections 2024-09-10T23:28:40.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.952+0000 7f1f177f5000 1 -- 172.21.15.17:0/898099688 wait complete. 2024-09-10T23:28:40.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.952+0000 7f1f177f5000 20 client.10335 trim_cache size 0 max 16384 2024-09-10T23:28:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.968+0000 7f1f177f5000 1 Processor -- start 2024-09-10T23:28:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.968+0000 7f1f177f5000 1 -- start start 2024-09-10T23:28:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.968+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 0x55ca91921fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.968+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca91922520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.968+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91922a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.968+0000 7f1f177f5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c204170 con 0x55ca918b02f0 2024-09-10T23:28:40.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.968+0000 7f1f177f5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c203170 con 0x55ca918af9d0 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.968+0000 7f1f177f5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c1fb2d0 con 0x55ca91863e10 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91922a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91922a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49414/0 (socket says 172.21.15.17:49414) 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 -- 172.21.15.17:0/626269870 learned_addr learned my addr 172.21.15.17:0/626269870 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f11a00640 1 --2- 172.21.15.17:0/626269870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 0x55ca91921fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f11000640 1 --2- 172.21.15.17:0/626269870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca91922520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 -- 172.21.15.17:0/626269870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 msgr2=0x55ca91921fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 --2- 172.21.15.17:0/626269870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 0x55ca91921fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 -- 172.21.15.17:0/626269870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 msgr2=0x55ca91922520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 --2- 172.21.15.17:0/626269870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca91922520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 -- 172.21.15.17:0/626269870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca9170cd90 con 0x55ca918b02f0 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 --2- 172.21.15.17:0/626269870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91922a60 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f1f04004ff0 tx=0x7f1f04091c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb6086746ee353b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1efd600640 1 -- 172.21.15.17:0/626269870 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0401f050 con 0x55ca918b02f0 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1efd600640 1 -- 172.21.15.17:0/626269870 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f04078170 con 0x55ca918b02f0 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1efd600640 1 -- 172.21.15.17:0/626269870 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04093040 con 0x55ca918b02f0 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 -- 172.21.15.17:0/626269870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 msgr2=0x55ca91922a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 --2- 172.21.15.17:0/626269870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91922a60 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f1f04004ff0 tx=0x7f1f04091c90 comp rx=0 tx=0).stop 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 -- 172.21.15.17:0/626269870 shutdown_connections 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 --2- 172.21.15.17:0/626269870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91922a60 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 --2- 172.21.15.17:0/626269870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca918af9d0 0x55ca91922520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 --2- 172.21.15.17:0/626269870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca91863e10 0x55ca91921fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 -- 172.21.15.17:0/626269870 >> 172.21.15.17:0/626269870 conn(0x55ca9174d130 msgr2=0x55ca9186ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 -- 172.21.15.17:0/626269870 shutdown_connections 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 -- 172.21.15.17:0/626269870 wait complete. 2024-09-10T23:28:40.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 -- start start 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 Processor -- start 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca91863e10 0x55ca919259f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918af9d0 0x55ca91925f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91926470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ca9167cec0 con 0x55ca918b02f0 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c202c50 con 0x55ca91863e10 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ca9164b5d0 con 0x55ca918af9d0 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f177f5000 10 client.0 _ll_register_callbacks cb 0x7f1f0405e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91926470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91926470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49422/0 (socket says 172.21.15.17:49422) 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f12400640 1 -- 172.21.15.17:0/170773027 learned_addr learned my addr 172.21.15.17:0/170773027 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f11a00640 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca91863e10 0x55ca919259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.972+0000 7f1f11000640 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918af9d0 0x55ca91925f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12400640 1 -- 172.21.15.17:0/170773027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918af9d0 msgr2=0x55ca91925f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12400640 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918af9d0 0x55ca91925f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12400640 1 -- 172.21.15.17:0/170773027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca91863e10 msgr2=0x55ca919259f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12400640 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca91863e10 0x55ca919259f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12400640 1 -- 172.21.15.17:0/170773027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca91677a90 con 0x55ca918b02f0 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12400640 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91926470 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f1f0405ae30 tx=0x7f1f04078590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa9275336057ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 1 -- 172.21.15.17:0/170773027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0401f070 con 0x55ca918b02f0 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 1 -- 172.21.15.17:0/170773027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f1f0405a200 con 0x55ca918b02f0 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 -- 172.21.15.17:0/170773027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f04078170 con 0x55ca918b02f0 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 1 -- 172.21.15.17:0/170773027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f1f0407e050 con 0x55ca918b02f0 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 10 client.10341 fetch_fsmap learned FSMap version 133 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 -- 172.21.15.17:0/170773027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55ca91656050 con 0x55ca918b02f0 2024-09-10T23:28:40.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 1 -- 172.21.15.17:0/170773027 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f04078170 con 0x55ca918b02f0 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 1 -- 172.21.15.17:0/170773027 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 133) ==== 3502+0+0 (secure 0 0 0) 0x7f1f04075070 con 0x55ca918b02f0 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 10 client.10341 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 10 client.10341 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 20 client.10341 populate_metadata read hostname 'smithi017' 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55ca918c4450 0x55ca918c4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 4 client.10341 mds_command: new command op to 10197 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 -- 172.21.15.17:0/170773027 --> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] -- command(tid 0: {"prefix": "status"}) -- 0x55ca916bf520 con 0x55ca918c4450 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f11a00640 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55ca918c4450 0x55ca918c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f11a00640 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55ca918c4450 0x55ca918c4830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e018b3646af3bee8 server_cookie=f20b6d66d04d1f30 in_seq=0 out_seq=0 2024-09-10T23:28:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 10 client.10341 ms_handle_connect on v2:172.21.15.17:6834/3849451590 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 1 -- 172.21.15.17:0/170773027 <== mds.0 v2:172.21.15.17:6834/3849451590 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55ca916bf520 con 0x55ca918c4450 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 10 client.10341 handle_command_reply: tid=0 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 client.10341 shutdown 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 -- 172.21.15.17:0/170773027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 msgr2=0x55ca91926470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91926470 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f1f0405ae30 tx=0x7f1f04078590 comp rx=0 tx=0).stop 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 -- 172.21.15.17:0/170773027 shutdown_connections 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55ca918c4450 0x55ca918c4830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca918b02f0 0x55ca91926470 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ca918af9d0 0x55ca91925f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1ef2a00640 0 client.10341 ms_handle_reset on v2:172.21.15.17:6834/3849451590 2024-09-10T23:28:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 --2- 172.21.15.17:0/170773027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ca91863e10 0x55ca919259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 -- 172.21.15.17:0/170773027 >> 172.21.15.17:0/170773027 conn(0x55ca9174d130 msgr2=0x55ca918ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 -- 172.21.15.17:0/170773027 shutdown_connections 2024-09-10T23:28:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 1 -- 172.21.15.17:0/170773027 wait complete. 2024-09-10T23:28:40.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f177f5000 20 client.10341 trim_cache size 0 max 16384 2024-09-10T23:28:40.989 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:28:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:28:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:28:40.989 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 10197, 2024-09-10T23:28:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:28:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:28:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:28:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.0119953830000004, 2024-09-10T23:28:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 133, 2024-09-10T23:28:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 177, 2024-09-10T23:28:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 177, 2024-09-10T23:28:40.990 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 10.506533943999999 2024-09-10T23:28:40.990 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:28:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 -- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1eec072610 msgr2=0x7f1eec074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1eec072610 0x7f1eec074ad0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1f000ae000 tx=0x7f1f0001b000 comp rx=0 tx=0).stop 2024-09-10T23:28:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 -- 172.21.15.17:0/3071582831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15bc70 msgr2=0x7f1f0c14ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15bc70 0x7f1f0c14ea90 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e9f0 tx=0x7f1f0400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 -- 172.21.15.17:0/3071582831 shutdown_connections 2024-09-10T23:28:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1eec072610 0x7f1eec074ad0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f0c15bc70 0x7f1f0c14ea90 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1f0c15b890 0x7f1f0c1f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 --2- 172.21.15.17:0/3071582831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f0c0ceeb0 0x7f1f0c144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:40.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 -- 172.21.15.17:0/3071582831 >> 172.21.15.17:0/3071582831 conn(0x7f1f0c0b2740 msgr2=0x7f1f0c15aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:40.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 -- 172.21.15.17:0/3071582831 shutdown_connections 2024-09-10T23:28:40.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:40.976+0000 7f1f12e00640 1 -- 172.21.15.17:0/3071582831 wait complete. 2024-09-10T23:28:41.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:28:41.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.144+0000 7fce86a00640 1 -- 172.21.15.17:0/3248736199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800d4800 msgr2=0x7fce800d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:41.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.144+0000 7fce86a00640 1 --2- 172.21.15.17:0/3248736199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800d4800 0x7fce800d22c0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009840 tx=0x7fce6c01c7f0 comp rx=0 tx=0).stop 2024-09-10T23:28:41.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.144+0000 7fce86a00640 1 -- 172.21.15.17:0/3248736199 shutdown_connections 2024-09-10T23:28:41.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.144+0000 7fce86a00640 1 --2- 172.21.15.17:0/3248736199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800d4800 0x7fce800d22c0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:41.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.144+0000 7fce86a00640 1 -- 172.21.15.17:0/3248736199 >> 172.21.15.17:0/3248736199 conn(0x7fce800d3ce0 msgr2=0x7fce800d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:41.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.144+0000 7fce86a00640 1 -- 172.21.15.17:0/3248736199 shutdown_connections 2024-09-10T23:28:41.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.144+0000 7fce86a00640 1 -- 172.21.15.17:0/3248736199 wait complete. 2024-09-10T23:28:41.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.144+0000 7fce86a00640 1 Processor -- start 2024-09-10T23:28:41.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.144+0000 7fce86a00640 1 -- start start 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800b76b0 0x7fce8014feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce800d0450 0x7fce80152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800d4800 0x7fce801fab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fce8016bca0 con 0x7fce800b76b0 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce8016bb20 con 0x7fce800d4800 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fce8016be20 con 0x7fce800d0450 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce85600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800b76b0 0x7fce8014feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce85600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800b76b0 0x7fce8014feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49442/0 (socket says 172.21.15.17:49442) 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce85600640 1 -- 172.21.15.17:0/617844996 learned_addr learned my addr 172.21.15.17:0/617844996 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce84c00640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce800d0450 0x7fce80152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:41.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86000640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800d4800 0x7fce801fab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce85600640 1 -- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce800d0450 msgr2=0x7fce80152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce85600640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce800d0450 0x7fce80152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce85600640 1 -- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800d4800 msgr2=0x7fce801fab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce85600640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800d4800 0x7fce801fab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:41.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce85600640 1 -- 172.21.15.17:0/617844996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce800cb120 con 0x7fce800b76b0 2024-09-10T23:28:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce85600640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800b76b0 0x7fce8014feb0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c450 tx=0x7fce7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce7d600640 1 -- 172.21.15.17:0/617844996 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74005480 con 0x7fce800b76b0 2024-09-10T23:28:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce7d600640 1 -- 172.21.15.17:0/617844996 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce74003600 con 0x7fce800b76b0 2024-09-10T23:28:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce800cdb90 con 0x7fce800b76b0 2024-09-10T23:28:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce7d600640 1 -- 172.21.15.17:0/617844996 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74003a30 con 0x7fce800b76b0 2024-09-10T23:28:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce800cadb0 con 0x7fce800b76b0 2024-09-10T23:28:41.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce800d22c0 con 0x7fce800b76b0 2024-09-10T23:28:41.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.148+0000 7fce7d600640 1 -- 172.21.15.17:0/617844996 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fce74003bd0 con 0x7fce800b76b0 2024-09-10T23:28:41.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.152+0000 7fce7d600640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce600725e0 0x7fce60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:28:41.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.152+0000 7fce7d600640 1 -- 172.21.15.17:0/617844996 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fce74092ef0 con 0x7fce800b76b0 2024-09-10T23:28:41.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.152+0000 7fce84c00640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce600725e0 0x7fce60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:28:41.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.152+0000 7fce84c00640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce600725e0 0x7fce60074aa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0af000 tx=0x7fce6c01b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:28:41.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.156+0000 7fce7d600640 1 -- 172.21.15.17:0/617844996 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fce7405e3b0 con 0x7fce800b76b0 2024-09-10T23:28:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fce800754e0 con 0x7fce800b76b0 2024-09-10T23:28:41.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce7d600640 1 -- 172.21.15.17:0/617844996 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v133) ==== 53+0+73 (secure 0 0 0) 0x7fce7405dcb0 con 0x7fce800b76b0 2024-09-10T23:28:41.373 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:28:41.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce600725e0 msgr2=0x7fce60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:41.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce600725e0 0x7fce60074aa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0af000 tx=0x7fce6c01b030 comp rx=0 tx=0).stop 2024-09-10T23:28:41.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800b76b0 msgr2=0x7fce8014feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:28:41.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800b76b0 0x7fce8014feb0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c450 tx=0x7fce7400c910 comp rx=0 tx=0).stop 2024-09-10T23:28:41.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 shutdown_connections 2024-09-10T23:28:41.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fce600725e0 0x7fce60074aa0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:41.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800d4800 0x7fce801fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:41.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fce800d0450 0x7fce80152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:41.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 --2- 172.21.15.17:0/617844996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce800b76b0 0x7fce8014feb0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:28:41.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 >> 172.21.15.17:0/617844996 conn(0x7fce800d3ce0 msgr2=0x7fce8006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:28:41.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 shutdown_connections 2024-09-10T23:28:41.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41.368+0000 7fce86a00640 1 -- 172.21.15.17:0/617844996 wait complete. 2024-09-10T23:28:41.394 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:28:41.394 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:28:41.395 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:28:41.395 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:28:41.395 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:28:41.395 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:28:41.395 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:28:41.395 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:28:41.396 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:28:41.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:41.396 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:28:41.405 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:28:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41650sec preferred_lft 41650sec 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:28:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:28:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:28:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:28:41.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:41.410 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:28:41.468 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:28:41.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:41.471 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:28:41.524 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:28:41.524 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:28:41.524 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:28:41.525 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:28:41.525 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:28:41.525 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:28:41.525 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:28:41.525 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:41.525 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:28:41.525 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:28:41.525 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:28:41.525 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:41.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:28:41.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:41.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:41.663 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:28:41.720 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:28:41.720 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:28:41.721 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:28:41.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:41.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:28:41.783 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:28:41.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:28:41.784 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:28:41.835 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:28:41.836 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:28:41.836 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:28:41.886 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:28:41.948 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:28:42.001 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:28:42.002 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:28:42.003 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:28:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:28:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:28:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:28:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:28:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:28:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:28:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:28:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:28:42.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:42.005 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:28:42.059 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:28:42.059 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:28:42.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:28:42.130 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:28:42.181 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:28:42.182 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:28:42.183 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:28:42.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:42.184 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:28:42.209 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:28:42.200+0000 7f03a562a580 -1 init, newargv = 0x5585d9f9deb0 newargc=15 2024-09-10T23:28:42.209 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[84251]: starting ceph client 2024-09-10T23:28:42.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[84251]: starting fuse 2024-09-10T23:28:42.217 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:28:42.218 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:28:42.218 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:28:42.219 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:28:42.220 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:28:42.220 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:28:42.220 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:28:42.345 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.84251.asok 2024-09-10T23:28:42.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:42.356 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.84251.asok 2024-09-10T23:28:42.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:42.357 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.84251.asok status 2024-09-10T23:28:42.532 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:28:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:28:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:28:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "84251", 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 10356, 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:28:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 10356 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3246222740 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3246222740 2024-09-10T23:28:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:28:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.10356 192.168.0.1:0/3246222740", 2024-09-10T23:28:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/3246222740", 2024-09-10T23:28:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:28:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 133, 2024-09-10T23:28:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 177, 2024-09-10T23:28:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:28:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:28:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:28:42.535 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:28:42.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:42.548 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:28:42.548 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:28:42.557 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:28:42.557 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:28:42.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:28:42.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:28:42.622 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:42.622 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:42.622 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T23:28:42.622 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:42.622 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:42.622 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:42.622 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:42.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:42.755 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.755 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.755 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210555 s, 49.8 MB/s 2024-09-10T23:28:42.774 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.774 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.774 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155932 s, 67.2 MB/s 2024-09-10T23:28:42.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.795 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159909 s, 65.6 MB/s 2024-09-10T23:28:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135917 s, 77.1 MB/s 2024-09-10T23:28:42.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.829 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140131 s, 74.8 MB/s 2024-09-10T23:28:42.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.847 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144945 s, 72.3 MB/s 2024-09-10T23:28:42.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.864 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133823 s, 78.4 MB/s 2024-09-10T23:28:42.881 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.881 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.881 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140122 s, 74.8 MB/s 2024-09-10T23:28:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136054 s, 77.1 MB/s 2024-09-10T23:28:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161686 s, 64.9 MB/s 2024-09-10T23:28:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.934 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.935 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127458 s, 82.3 MB/s 2024-09-10T23:28:42.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.951 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124095 s, 84.5 MB/s 2024-09-10T23:28:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134747 s, 77.8 MB/s 2024-09-10T23:28:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143988 s, 72.8 MB/s 2024-09-10T23:28:43.005 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.005 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.005 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146059 s, 71.8 MB/s 2024-09-10T23:28:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156249 s, 67.1 MB/s 2024-09-10T23:28:43.042 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.042 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.042 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135651 s, 77.3 MB/s 2024-09-10T23:28:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013578 s, 77.2 MB/s 2024-09-10T23:28:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121177 s, 86.5 MB/s 2024-09-10T23:28:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125375 s, 83.6 MB/s 2024-09-10T23:28:43.107 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.107 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.107 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125713 s, 83.4 MB/s 2024-09-10T23:28:43.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.124 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128038 s, 81.9 MB/s 2024-09-10T23:28:43.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.140 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127671 s, 82.1 MB/s 2024-09-10T23:28:43.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121595 s, 86.2 MB/s 2024-09-10T23:28:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153846 s, 68.2 MB/s 2024-09-10T23:28:43.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.190 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012172 s, 86.1 MB/s 2024-09-10T23:28:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012283 s, 85.4 MB/s 2024-09-10T23:28:43.223 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.223 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.223 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132666 s, 79.0 MB/s 2024-09-10T23:28:43.241 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.241 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.241 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135229 s, 77.5 MB/s 2024-09-10T23:28:43.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.258 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.258 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135175 s, 77.6 MB/s 2024-09-10T23:28:43.275 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.275 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.276 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141572 s, 74.1 MB/s 2024-09-10T23:28:43.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.293 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135383 s, 77.5 MB/s 2024-09-10T23:28:43.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:43.300 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:43.300 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:43.300 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T23:28:43.301 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:43.301 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:43.301 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:43.301 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:43.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:43.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.374 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.374 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136126 s, 77.0 MB/s 2024-09-10T23:28:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.392 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143451 s, 73.1 MB/s 2024-09-10T23:28:43.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.410 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144612 s, 72.5 MB/s 2024-09-10T23:28:43.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.427 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012912 s, 81.2 MB/s 2024-09-10T23:28:43.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.443 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117905 s, 88.9 MB/s 2024-09-10T23:28:43.460 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.461 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142612 s, 73.5 MB/s 2024-09-10T23:28:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130725 s, 80.2 MB/s 2024-09-10T23:28:43.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.494 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129301 s, 81.1 MB/s 2024-09-10T23:28:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129038 s, 81.3 MB/s 2024-09-10T23:28:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128417 s, 81.7 MB/s 2024-09-10T23:28:43.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.545 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138654 s, 75.6 MB/s 2024-09-10T23:28:43.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.561 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125856 s, 83.3 MB/s 2024-09-10T23:28:43.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.577 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.577 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124231 s, 84.4 MB/s 2024-09-10T23:28:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.594 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127356 s, 82.3 MB/s 2024-09-10T23:28:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.610 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012614 s, 83.1 MB/s 2024-09-10T23:28:43.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.626 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128106 s, 81.9 MB/s 2024-09-10T23:28:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131346 s, 79.8 MB/s 2024-09-10T23:28:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139227 s, 75.3 MB/s 2024-09-10T23:28:43.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.678 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131914 s, 79.5 MB/s 2024-09-10T23:28:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123126 s, 85.2 MB/s 2024-09-10T23:28:43.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.710 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.710 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131607 s, 79.7 MB/s 2024-09-10T23:28:43.726 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.726 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.727 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126827 s, 82.7 MB/s 2024-09-10T23:28:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127403 s, 82.3 MB/s 2024-09-10T23:28:43.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.759 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.759 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122225 s, 85.8 MB/s 2024-09-10T23:28:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013876 s, 75.6 MB/s 2024-09-10T23:28:43.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.795 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144794 s, 72.4 MB/s 2024-09-10T23:28:43.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129321 s, 81.1 MB/s 2024-09-10T23:28:43.828 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.828 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.828 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126426 s, 82.9 MB/s 2024-09-10T23:28:43.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.845 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132787 s, 79.0 MB/s 2024-09-10T23:28:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126808 s, 82.7 MB/s 2024-09-10T23:28:43.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.880 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139135 s, 75.4 MB/s 2024-09-10T23:28:43.896 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.896 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.896 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124386 s, 84.3 MB/s 2024-09-10T23:28:43.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:43.904 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:43.904 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:43.904 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T23:28:43.904 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:43.904 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:43.904 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:43.904 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:43.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013122 s, 79.9 MB/s 2024-09-10T23:28:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138587 s, 75.7 MB/s 2024-09-10T23:28:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126933 s, 82.6 MB/s 2024-09-10T23:28:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.028 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.028 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130832 s, 80.1 MB/s 2024-09-10T23:28:44.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.047 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150341 s, 69.7 MB/s 2024-09-10T23:28:44.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.064 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134656 s, 77.9 MB/s 2024-09-10T23:28:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132036 s, 79.4 MB/s 2024-09-10T23:28:44.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.097 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.097 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012716 s, 82.5 MB/s 2024-09-10T23:28:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134197 s, 78.1 MB/s 2024-09-10T23:28:44.131 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.131 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.131 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135136 s, 77.6 MB/s 2024-09-10T23:28:44.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.148 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128474 s, 81.6 MB/s 2024-09-10T23:28:44.165 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.165 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.165 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138822 s, 75.5 MB/s 2024-09-10T23:28:44.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.182 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128909 s, 81.3 MB/s 2024-09-10T23:28:44.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.198 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.198 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012721 s, 82.4 MB/s 2024-09-10T23:28:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129929 s, 80.7 MB/s 2024-09-10T23:28:44.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.233 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.233 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142258 s, 73.7 MB/s 2024-09-10T23:28:44.250 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.251 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140354 s, 74.7 MB/s 2024-09-10T23:28:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133994 s, 78.3 MB/s 2024-09-10T23:28:44.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.285 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139046 s, 75.4 MB/s 2024-09-10T23:28:44.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.302 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131405 s, 79.8 MB/s 2024-09-10T23:28:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148415 s, 70.7 MB/s 2024-09-10T23:28:44.337 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.337 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.337 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126124 s, 83.1 MB/s 2024-09-10T23:28:44.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.353 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.354 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128312 s, 81.7 MB/s 2024-09-10T23:28:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.370 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127139 s, 82.5 MB/s 2024-09-10T23:28:44.386 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.386 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.386 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012751 s, 82.2 MB/s 2024-09-10T23:28:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124445 s, 84.3 MB/s 2024-09-10T23:28:44.419 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.419 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.419 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129877 s, 80.7 MB/s 2024-09-10T23:28:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131012 s, 80.0 MB/s 2024-09-10T23:28:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122556 s, 85.6 MB/s 2024-09-10T23:28:44.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.468 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127364 s, 82.3 MB/s 2024-09-10T23:28:44.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.487 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014674 s, 71.5 MB/s 2024-09-10T23:28:44.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.503 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126348 s, 83.0 MB/s 2024-09-10T23:28:44.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:44.511 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:44.511 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:44.511 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T23:28:44.511 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:44.511 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:44.512 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:44.512 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:44.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.630 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122343 s, 85.7 MB/s 2024-09-10T23:28:44.647 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.647 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.647 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134039 s, 78.2 MB/s 2024-09-10T23:28:44.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.666 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153932 s, 68.1 MB/s 2024-09-10T23:28:44.682 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129276 s, 81.1 MB/s 2024-09-10T23:28:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125874 s, 83.3 MB/s 2024-09-10T23:28:44.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.716 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.717 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137406 s, 76.3 MB/s 2024-09-10T23:28:44.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.732 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119381 s, 87.8 MB/s 2024-09-10T23:28:44.749 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.749 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.749 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129281 s, 81.1 MB/s 2024-09-10T23:28:44.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.766 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129626 s, 80.9 MB/s 2024-09-10T23:28:44.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.783 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.783 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134065 s, 78.2 MB/s 2024-09-10T23:28:44.798 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.798 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.799 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122077 s, 85.9 MB/s 2024-09-10T23:28:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.815 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126088 s, 83.2 MB/s 2024-09-10T23:28:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131173 s, 79.9 MB/s 2024-09-10T23:28:44.847 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.848 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122305 s, 85.7 MB/s 2024-09-10T23:28:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.865 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.865 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133153 s, 78.7 MB/s 2024-09-10T23:28:44.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.881 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.881 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122885 s, 85.3 MB/s 2024-09-10T23:28:44.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.897 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125208 s, 83.7 MB/s 2024-09-10T23:28:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01431 s, 73.3 MB/s 2024-09-10T23:28:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145356 s, 72.1 MB/s 2024-09-10T23:28:44.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.951 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137594 s, 76.2 MB/s 2024-09-10T23:28:44.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.967 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122241 s, 85.8 MB/s 2024-09-10T23:28:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137643 s, 76.2 MB/s 2024-09-10T23:28:45.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.003 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.003 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153022 s, 68.5 MB/s 2024-09-10T23:28:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131857 s, 79.5 MB/s 2024-09-10T23:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.037 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131322 s, 79.8 MB/s 2024-09-10T23:28:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135347 s, 77.5 MB/s 2024-09-10T23:28:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134073 s, 78.2 MB/s 2024-09-10T23:28:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.089 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125917 s, 83.3 MB/s 2024-09-10T23:28:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.105 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140409 s, 74.7 MB/s 2024-09-10T23:28:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124944 s, 83.9 MB/s 2024-09-10T23:28:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.140 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140851 s, 74.4 MB/s 2024-09-10T23:28:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135342 s, 77.5 MB/s 2024-09-10T23:28:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:45.164 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:45.165 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:45.165 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T23:28:45.165 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:45.165 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:45.165 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:45.165 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:45.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150996 s, 69.4 MB/s 2024-09-10T23:28:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.256 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.257 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135721 s, 77.3 MB/s 2024-09-10T23:28:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.274 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136685 s, 76.7 MB/s 2024-09-10T23:28:45.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.293 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128298 s, 81.7 MB/s 2024-09-10T23:28:45.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.307 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129471 s, 81.0 MB/s 2024-09-10T23:28:45.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.324 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.324 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129977 s, 80.7 MB/s 2024-09-10T23:28:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146647 s, 71.5 MB/s 2024-09-10T23:28:45.358 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.358 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.358 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123161 s, 85.1 MB/s 2024-09-10T23:28:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135312 s, 77.5 MB/s 2024-09-10T23:28:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124964 s, 83.9 MB/s 2024-09-10T23:28:45.408 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.409 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.409 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131484 s, 79.7 MB/s 2024-09-10T23:28:45.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.426 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.426 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137115 s, 76.5 MB/s 2024-09-10T23:28:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141518 s, 74.1 MB/s 2024-09-10T23:28:45.460 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128061 s, 81.9 MB/s 2024-09-10T23:28:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128756 s, 81.4 MB/s 2024-09-10T23:28:45.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.500 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.500 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185841 s, 56.4 MB/s 2024-09-10T23:28:45.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.519 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148353 s, 70.7 MB/s 2024-09-10T23:28:45.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.536 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131414 s, 79.8 MB/s 2024-09-10T23:28:45.554 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.554 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.554 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013926 s, 75.3 MB/s 2024-09-10T23:28:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.571 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129126 s, 81.2 MB/s 2024-09-10T23:28:45.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.588 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135331 s, 77.5 MB/s 2024-09-10T23:28:45.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.606 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141087 s, 74.3 MB/s 2024-09-10T23:28:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012906 s, 81.2 MB/s 2024-09-10T23:28:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.641 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150548 s, 69.7 MB/s 2024-09-10T23:28:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129076 s, 81.2 MB/s 2024-09-10T23:28:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013158 s, 79.7 MB/s 2024-09-10T23:28:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.691 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012338 s, 85.0 MB/s 2024-09-10T23:28:45.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120372 s, 87.1 MB/s 2024-09-10T23:28:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123748 s, 84.7 MB/s 2024-09-10T23:28:45.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.740 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132746 s, 79.0 MB/s 2024-09-10T23:28:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124476 s, 84.2 MB/s 2024-09-10T23:28:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127486 s, 82.3 MB/s 2024-09-10T23:28:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:45.780 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:45.780 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:45.780 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T23:28:45.780 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:45.780 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:45.781 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:45.781 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:45.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:45.895 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.895 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.895 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130162 s, 80.6 MB/s 2024-09-10T23:28:45.912 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.912 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.913 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128842 s, 81.4 MB/s 2024-09-10T23:28:45.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.930 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.930 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131846 s, 79.5 MB/s 2024-09-10T23:28:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131156 s, 79.9 MB/s 2024-09-10T23:28:45.963 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.964 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.964 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121118 s, 86.6 MB/s 2024-09-10T23:28:45.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.981 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014059 s, 74.6 MB/s 2024-09-10T23:28:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:45.998 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012513 s, 83.8 MB/s 2024-09-10T23:28:46.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139286 s, 75.3 MB/s 2024-09-10T23:28:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01452 s, 72.2 MB/s 2024-09-10T23:28:46.052 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.053 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129757 s, 80.8 MB/s 2024-09-10T23:28:46.070 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.070 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.070 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131188 s, 79.9 MB/s 2024-09-10T23:28:46.087 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.087 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.088 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133323 s, 78.6 MB/s 2024-09-10T23:28:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128569 s, 81.6 MB/s 2024-09-10T23:28:46.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133884 s, 78.3 MB/s 2024-09-10T23:28:46.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.139 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127761 s, 82.1 MB/s 2024-09-10T23:28:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127135 s, 82.5 MB/s 2024-09-10T23:28:46.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123332 s, 85.0 MB/s 2024-09-10T23:28:46.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.189 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127272 s, 82.4 MB/s 2024-09-10T23:28:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127325 s, 82.4 MB/s 2024-09-10T23:28:46.225 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.225 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.226 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139957 s, 74.9 MB/s 2024-09-10T23:28:46.242 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.242 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.242 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126958 s, 82.6 MB/s 2024-09-10T23:28:46.259 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.259 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.259 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129755 s, 80.8 MB/s 2024-09-10T23:28:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.278 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144218 s, 72.7 MB/s 2024-09-10T23:28:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.295 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133584 s, 78.5 MB/s 2024-09-10T23:28:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126885 s, 82.6 MB/s 2024-09-10T23:28:46.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.330 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.330 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129535 s, 80.9 MB/s 2024-09-10T23:28:46.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.346 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126241 s, 83.1 MB/s 2024-09-10T23:28:46.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.362 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124008 s, 84.6 MB/s 2024-09-10T23:28:46.380 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.380 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.380 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134925 s, 77.7 MB/s 2024-09-10T23:28:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139033 s, 75.4 MB/s 2024-09-10T23:28:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012185 s, 86.1 MB/s 2024-09-10T23:28:46.432 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.432 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.432 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135745 s, 77.2 MB/s 2024-09-10T23:28:46.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:46.439 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:46.440 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:46.440 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T23:28:46.440 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:46.440 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:46.440 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:46.440 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:46.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:46.513 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.513 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.514 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125455 s, 83.6 MB/s 2024-09-10T23:28:46.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.530 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123663 s, 84.8 MB/s 2024-09-10T23:28:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125649 s, 83.5 MB/s 2024-09-10T23:28:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143667 s, 73.0 MB/s 2024-09-10T23:28:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.582 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125718 s, 83.4 MB/s 2024-09-10T23:28:46.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.599 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129721 s, 80.8 MB/s 2024-09-10T23:28:46.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.616 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.616 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131167 s, 79.9 MB/s 2024-09-10T23:28:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.633 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127289 s, 82.4 MB/s 2024-09-10T23:28:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.650 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012407 s, 84.5 MB/s 2024-09-10T23:28:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115853 s, 90.5 MB/s 2024-09-10T23:28:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111512 s, 94.0 MB/s 2024-09-10T23:28:46.697 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.697 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.697 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116029 s, 90.4 MB/s 2024-09-10T23:28:46.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.714 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130679 s, 80.2 MB/s 2024-09-10T23:28:46.733 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.733 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.733 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013704 s, 76.5 MB/s 2024-09-10T23:28:46.748 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.748 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.748 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116809 s, 89.8 MB/s 2024-09-10T23:28:46.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.764 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011393 s, 92.0 MB/s 2024-09-10T23:28:46.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.779 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116187 s, 90.2 MB/s 2024-09-10T23:28:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.795 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011216 s, 93.5 MB/s 2024-09-10T23:28:46.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.811 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115417 s, 90.9 MB/s 2024-09-10T23:28:46.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120143 s, 87.3 MB/s 2024-09-10T23:28:46.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.842 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.842 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115745 s, 90.6 MB/s 2024-09-10T23:28:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.858 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111484 s, 94.1 MB/s 2024-09-10T23:28:46.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.874 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117793 s, 89.0 MB/s 2024-09-10T23:28:46.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.889 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110987 s, 94.5 MB/s 2024-09-10T23:28:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011399 s, 92.0 MB/s 2024-09-10T23:28:46.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.922 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127512 s, 82.2 MB/s 2024-09-10T23:28:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112229 s, 93.4 MB/s 2024-09-10T23:28:46.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123347 s, 85.0 MB/s 2024-09-10T23:28:46.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117151 s, 89.5 MB/s 2024-09-10T23:28:46.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:46.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:46.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128502 s, 81.6 MB/s 2024-09-10T23:28:47.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.004 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129087 s, 81.2 MB/s 2024-09-10T23:28:47.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.020 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119687 s, 87.6 MB/s 2024-09-10T23:28:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:47.027 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:47.028 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:47.028 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T23:28:47.028 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:47.028 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:47.028 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:47.028 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:47.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:47.102 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.102 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.102 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133177 s, 78.7 MB/s 2024-09-10T23:28:47.118 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.118 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.118 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125032 s, 83.9 MB/s 2024-09-10T23:28:47.135 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.135 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.135 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123976 s, 84.6 MB/s 2024-09-10T23:28:47.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.151 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.151 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011612 s, 90.3 MB/s 2024-09-10T23:28:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127198 s, 82.4 MB/s 2024-09-10T23:28:47.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.184 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.184 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123205 s, 85.1 MB/s 2024-09-10T23:28:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.200 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114859 s, 91.3 MB/s 2024-09-10T23:28:47.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.215 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.215 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112534 s, 93.2 MB/s 2024-09-10T23:28:47.230 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.231 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.231 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111117 s, 94.4 MB/s 2024-09-10T23:28:47.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.245 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.245 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110618 s, 94.8 MB/s 2024-09-10T23:28:47.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.261 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121462 s, 86.3 MB/s 2024-09-10T23:28:47.276 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.276 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.276 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115371 s, 90.9 MB/s 2024-09-10T23:28:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128905 s, 81.3 MB/s 2024-09-10T23:28:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115553 s, 90.7 MB/s 2024-09-10T23:28:47.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.324 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113766 s, 92.2 MB/s 2024-09-10T23:28:47.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.338 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113488 s, 92.4 MB/s 2024-09-10T23:28:47.354 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128231 s, 81.8 MB/s 2024-09-10T23:28:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.369 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.370 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111593 s, 94.0 MB/s 2024-09-10T23:28:47.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.384 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112911 s, 92.9 MB/s 2024-09-10T23:28:47.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.401 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.401 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124979 s, 83.9 MB/s 2024-09-10T23:28:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123392 s, 85.0 MB/s 2024-09-10T23:28:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.433 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.434 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110145 s, 95.2 MB/s 2024-09-10T23:28:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125315 s, 83.7 MB/s 2024-09-10T23:28:47.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.465 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.465 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108681 s, 96.5 MB/s 2024-09-10T23:28:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.481 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118179 s, 88.7 MB/s 2024-09-10T23:28:47.497 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.497 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.497 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011426 s, 91.8 MB/s 2024-09-10T23:28:47.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.514 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.514 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121351 s, 86.4 MB/s 2024-09-10T23:28:47.530 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.531 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01166 s, 89.9 MB/s 2024-09-10T23:28:47.549 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.549 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.549 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120845 s, 86.8 MB/s 2024-09-10T23:28:47.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.562 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.562 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112159 s, 93.5 MB/s 2024-09-10T23:28:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116482 s, 90.0 MB/s 2024-09-10T23:28:47.593 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119835 s, 87.5 MB/s 2024-09-10T23:28:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:47.601 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:47.601 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:47.602 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T23:28:47.602 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:47.602 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:47.602 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:47.602 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:47.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:47.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.672 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114562 s, 91.5 MB/s 2024-09-10T23:28:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.686 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010461 s, 100 MB/s 2024-09-10T23:28:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114106 s, 91.9 MB/s 2024-09-10T23:28:47.717 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.717 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.717 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119529 s, 87.7 MB/s 2024-09-10T23:28:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.734 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131465 s, 79.8 MB/s 2024-09-10T23:28:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120099 s, 87.3 MB/s 2024-09-10T23:28:47.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.765 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.765 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011567 s, 90.7 MB/s 2024-09-10T23:28:47.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.780 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110863 s, 94.6 MB/s 2024-09-10T23:28:47.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.794 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.794 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108866 s, 96.3 MB/s 2024-09-10T23:28:47.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.810 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118213 s, 88.7 MB/s 2024-09-10T23:28:47.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.826 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.826 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124267 s, 84.4 MB/s 2024-09-10T23:28:47.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.841 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110859 s, 94.6 MB/s 2024-09-10T23:28:47.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.858 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.858 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134355 s, 78.0 MB/s 2024-09-10T23:28:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.874 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120552 s, 87.0 MB/s 2024-09-10T23:28:47.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.889 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114859 s, 91.3 MB/s 2024-09-10T23:28:47.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.905 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.905 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122264 s, 85.8 MB/s 2024-09-10T23:28:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114267 s, 91.8 MB/s 2024-09-10T23:28:47.935 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.936 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115271 s, 91.0 MB/s 2024-09-10T23:28:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121258 s, 86.5 MB/s 2024-09-10T23:28:47.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.969 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127026 s, 82.5 MB/s 2024-09-10T23:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:47.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126872 s, 82.6 MB/s 2024-09-10T23:28:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011991 s, 87.4 MB/s 2024-09-10T23:28:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118035 s, 88.8 MB/s 2024-09-10T23:28:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.032 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111747 s, 93.8 MB/s 2024-09-10T23:28:48.050 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.051 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.051 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01159 s, 90.5 MB/s 2024-09-10T23:28:48.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.064 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115689 s, 90.6 MB/s 2024-09-10T23:28:48.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.079 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113065 s, 92.7 MB/s 2024-09-10T23:28:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108911 s, 96.3 MB/s 2024-09-10T23:28:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111267 s, 94.2 MB/s 2024-09-10T23:28:48.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123636 s, 84.8 MB/s 2024-09-10T23:28:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124424 s, 84.3 MB/s 2024-09-10T23:28:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115569 s, 90.7 MB/s 2024-09-10T23:28:48.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:48.166 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:48.166 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:48.166 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T23:28:48.166 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:48.166 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:48.166 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:48.166 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:48.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:48.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.238 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.238 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109639 s, 95.6 MB/s 2024-09-10T23:28:48.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.255 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137257 s, 76.4 MB/s 2024-09-10T23:28:48.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.270 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.270 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110185 s, 95.2 MB/s 2024-09-10T23:28:48.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.285 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112178 s, 93.5 MB/s 2024-09-10T23:28:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012523 s, 83.7 MB/s 2024-09-10T23:28:48.317 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.318 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.318 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129144 s, 81.2 MB/s 2024-09-10T23:28:48.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.334 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127187 s, 82.4 MB/s 2024-09-10T23:28:48.349 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.349 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.350 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113914 s, 92.1 MB/s 2024-09-10T23:28:48.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.365 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122803 s, 85.4 MB/s 2024-09-10T23:28:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012227 s, 85.8 MB/s 2024-09-10T23:28:48.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.396 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.396 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112727 s, 93.0 MB/s 2024-09-10T23:28:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111973 s, 93.6 MB/s 2024-09-10T23:28:48.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.427 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123904 s, 84.6 MB/s 2024-09-10T23:28:48.442 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.442 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.442 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113937 s, 92.0 MB/s 2024-09-10T23:28:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111369 s, 94.2 MB/s 2024-09-10T23:28:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128878 s, 81.4 MB/s 2024-09-10T23:28:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.489 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116469 s, 90.0 MB/s 2024-09-10T23:28:48.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.505 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120588 s, 87.0 MB/s 2024-09-10T23:28:48.520 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.520 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.520 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011066 s, 94.8 MB/s 2024-09-10T23:28:48.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.535 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.535 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011249 s, 93.2 MB/s 2024-09-10T23:28:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.550 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011654 s, 90.0 MB/s 2024-09-10T23:28:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.565 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110163 s, 95.2 MB/s 2024-09-10T23:28:48.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112544 s, 93.2 MB/s 2024-09-10T23:28:48.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.595 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111951 s, 93.7 MB/s 2024-09-10T23:28:48.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.610 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111951 s, 93.7 MB/s 2024-09-10T23:28:48.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.626 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119146 s, 88.0 MB/s 2024-09-10T23:28:48.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013 s, 80.7 MB/s 2024-09-10T23:28:48.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.658 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120754 s, 86.8 MB/s 2024-09-10T23:28:48.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.674 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01172 s, 89.5 MB/s 2024-09-10T23:28:48.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.689 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012285 s, 85.4 MB/s 2024-09-10T23:28:48.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119326 s, 87.9 MB/s 2024-09-10T23:28:48.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.721 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114486 s, 91.6 MB/s 2024-09-10T23:28:48.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:48.728 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:48.729 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:48.729 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T23:28:48.729 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:48.729 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:48.729 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:48.729 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:48.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:48.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118092 s, 88.8 MB/s 2024-09-10T23:28:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.814 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011093 s, 94.5 MB/s 2024-09-10T23:28:48.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122543 s, 85.6 MB/s 2024-09-10T23:28:48.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.846 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121812 s, 86.1 MB/s 2024-09-10T23:28:48.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.863 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.863 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126619 s, 82.8 MB/s 2024-09-10T23:28:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118583 s, 88.4 MB/s 2024-09-10T23:28:48.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.894 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.894 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122179 s, 85.8 MB/s 2024-09-10T23:28:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111304 s, 94.2 MB/s 2024-09-10T23:28:48.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.925 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115389 s, 90.9 MB/s 2024-09-10T23:28:48.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.939 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110545 s, 94.9 MB/s 2024-09-10T23:28:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.954 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110121 s, 95.2 MB/s 2024-09-10T23:28:48.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127764 s, 82.1 MB/s 2024-09-10T23:28:48.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:48.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:48.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013061 s, 80.3 MB/s 2024-09-10T23:28:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.002 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114151 s, 91.9 MB/s 2024-09-10T23:28:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.019 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131006 s, 80.0 MB/s 2024-09-10T23:28:49.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.035 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012153 s, 86.3 MB/s 2024-09-10T23:28:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012256 s, 85.6 MB/s 2024-09-10T23:28:49.066 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.066 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.067 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110081 s, 95.3 MB/s 2024-09-10T23:28:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.081 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111861 s, 93.7 MB/s 2024-09-10T23:28:49.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.098 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129953 s, 80.7 MB/s 2024-09-10T23:28:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123041 s, 85.2 MB/s 2024-09-10T23:28:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.131 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123816 s, 84.7 MB/s 2024-09-10T23:28:49.146 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.146 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127189 s, 82.4 MB/s 2024-09-10T23:28:49.163 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.163 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.164 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012808 s, 81.9 MB/s 2024-09-10T23:28:49.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.178 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.178 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112847 s, 92.9 MB/s 2024-09-10T23:28:49.194 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.194 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.194 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124562 s, 84.2 MB/s 2024-09-10T23:28:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114139 s, 91.9 MB/s 2024-09-10T23:28:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120822 s, 86.8 MB/s 2024-09-10T23:28:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012501 s, 83.9 MB/s 2024-09-10T23:28:49.260 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.260 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.260 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109763 s, 95.5 MB/s 2024-09-10T23:28:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.274 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106805 s, 98.2 MB/s 2024-09-10T23:28:49.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.289 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.289 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109494 s, 95.8 MB/s 2024-09-10T23:28:49.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:49.297 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:49.297 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:49.297 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T23:28:49.297 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:49.297 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:49.297 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:49.297 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:49.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:49.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116228 s, 90.2 MB/s 2024-09-10T23:28:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.382 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111192 s, 94.3 MB/s 2024-09-10T23:28:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.397 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114863 s, 91.3 MB/s 2024-09-10T23:28:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112662 s, 93.1 MB/s 2024-09-10T23:28:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.427 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111839 s, 93.8 MB/s 2024-09-10T23:28:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121972 s, 86.0 MB/s 2024-09-10T23:28:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.458 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110813 s, 94.6 MB/s 2024-09-10T23:28:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.474 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012396 s, 84.6 MB/s 2024-09-10T23:28:49.489 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.489 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.489 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116363 s, 90.1 MB/s 2024-09-10T23:28:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107787 s, 97.3 MB/s 2024-09-10T23:28:49.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.519 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.519 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117918 s, 88.9 MB/s 2024-09-10T23:28:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.534 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111401 s, 94.1 MB/s 2024-09-10T23:28:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132475 s, 79.2 MB/s 2024-09-10T23:28:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.567 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122967 s, 85.3 MB/s 2024-09-10T23:28:49.583 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.583 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.583 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124637 s, 84.1 MB/s 2024-09-10T23:28:49.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.598 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111386 s, 94.1 MB/s 2024-09-10T23:28:49.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.613 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114575 s, 91.5 MB/s 2024-09-10T23:28:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125228 s, 83.7 MB/s 2024-09-10T23:28:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114937 s, 91.2 MB/s 2024-09-10T23:28:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124544 s, 84.2 MB/s 2024-09-10T23:28:49.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.677 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126751 s, 82.7 MB/s 2024-09-10T23:28:49.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123643 s, 84.8 MB/s 2024-09-10T23:28:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.708 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114302 s, 91.7 MB/s 2024-09-10T23:28:49.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.724 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.724 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119683 s, 87.6 MB/s 2024-09-10T23:28:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125437 s, 83.6 MB/s 2024-09-10T23:28:49.756 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128464 s, 81.6 MB/s 2024-09-10T23:28:49.772 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121866 s, 86.0 MB/s 2024-09-10T23:28:49.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.789 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124244 s, 84.4 MB/s 2024-09-10T23:28:49.804 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.804 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.804 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112385 s, 93.3 MB/s 2024-09-10T23:28:49.819 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121483 s, 86.3 MB/s 2024-09-10T23:28:49.835 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.835 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.835 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113745 s, 92.2 MB/s 2024-09-10T23:28:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111734 s, 93.8 MB/s 2024-09-10T23:28:49.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:49.858 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:49.858 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:49.858 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T23:28:49.858 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:49.858 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:49.858 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:49.858 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:49.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.976 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.976 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119264 s, 87.9 MB/s 2024-09-10T23:28:49.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:49.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:49.994 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129487 s, 81.0 MB/s 2024-09-10T23:28:50.013 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.013 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.013 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163187 s, 64.3 MB/s 2024-09-10T23:28:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.029 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122165 s, 85.8 MB/s 2024-09-10T23:28:50.045 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012358 s, 84.8 MB/s 2024-09-10T23:28:50.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.062 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128793 s, 81.4 MB/s 2024-09-10T23:28:50.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.080 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.080 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133035 s, 78.8 MB/s 2024-09-10T23:28:50.096 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.096 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.096 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127561 s, 82.2 MB/s 2024-09-10T23:28:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012545 s, 83.6 MB/s 2024-09-10T23:28:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.128 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115424 s, 90.8 MB/s 2024-09-10T23:28:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.143 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111679 s, 93.9 MB/s 2024-09-10T23:28:50.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.157 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.157 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107973 s, 97.1 MB/s 2024-09-10T23:28:50.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.174 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124778 s, 84.0 MB/s 2024-09-10T23:28:50.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107054 s, 97.9 MB/s 2024-09-10T23:28:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.204 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120184 s, 87.2 MB/s 2024-09-10T23:28:50.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.220 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130436 s, 80.4 MB/s 2024-09-10T23:28:50.246 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.246 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.247 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111027 s, 94.4 MB/s 2024-09-10T23:28:50.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.261 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.261 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109671 s, 95.6 MB/s 2024-09-10T23:28:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.276 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111344 s, 94.2 MB/s 2024-09-10T23:28:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127021 s, 82.6 MB/s 2024-09-10T23:28:50.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.308 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.308 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118026 s, 88.8 MB/s 2024-09-10T23:28:50.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.323 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.323 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111023 s, 94.4 MB/s 2024-09-10T23:28:50.337 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.338 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113516 s, 92.4 MB/s 2024-09-10T23:28:50.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.352 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109497 s, 95.8 MB/s 2024-09-10T23:28:50.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.368 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121399 s, 86.4 MB/s 2024-09-10T23:28:50.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.384 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012626 s, 83.0 MB/s 2024-09-10T23:28:50.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.400 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.400 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012013 s, 87.3 MB/s 2024-09-10T23:28:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113827 s, 92.1 MB/s 2024-09-10T23:28:50.431 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.431 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.431 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115397 s, 90.9 MB/s 2024-09-10T23:28:50.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.446 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.446 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118387 s, 88.6 MB/s 2024-09-10T23:28:50.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.462 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114679 s, 91.4 MB/s 2024-09-10T23:28:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.476 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113809 s, 92.1 MB/s 2024-09-10T23:28:50.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:50.484 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:50.484 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:50.484 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T23:28:50.484 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:50.484 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:50.484 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:50.484 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:50.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:50.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119163 s, 88.0 MB/s 2024-09-10T23:28:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.615 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128017 s, 81.9 MB/s 2024-09-10T23:28:50.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.630 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115224 s, 91.0 MB/s 2024-09-10T23:28:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124033 s, 84.5 MB/s 2024-09-10T23:28:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.662 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011752 s, 89.2 MB/s 2024-09-10T23:28:50.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.677 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115166 s, 91.0 MB/s 2024-09-10T23:28:50.692 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.693 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.693 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012303 s, 85.2 MB/s 2024-09-10T23:28:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.707 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110285 s, 95.1 MB/s 2024-09-10T23:28:50.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.723 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012021 s, 87.2 MB/s 2024-09-10T23:28:50.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.739 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118345 s, 88.6 MB/s 2024-09-10T23:28:50.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011535 s, 90.9 MB/s 2024-09-10T23:28:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011128 s, 94.2 MB/s 2024-09-10T23:28:50.784 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123412 s, 85.0 MB/s 2024-09-10T23:28:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112556 s, 93.2 MB/s 2024-09-10T23:28:50.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.814 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111284 s, 94.2 MB/s 2024-09-10T23:28:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113518 s, 92.4 MB/s 2024-09-10T23:28:50.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.845 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119509 s, 87.7 MB/s 2024-09-10T23:28:50.860 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.861 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120273 s, 87.2 MB/s 2024-09-10T23:28:50.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.877 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121923 s, 86.0 MB/s 2024-09-10T23:28:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110003 s, 95.3 MB/s 2024-09-10T23:28:50.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.906 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.906 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110201 s, 95.2 MB/s 2024-09-10T23:28:50.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.922 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125241 s, 83.7 MB/s 2024-09-10T23:28:50.936 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.937 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.937 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110832 s, 94.6 MB/s 2024-09-10T23:28:50.951 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.952 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.952 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011389 s, 92.1 MB/s 2024-09-10T23:28:50.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.967 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.968 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120794 s, 86.8 MB/s 2024-09-10T23:28:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:50.985 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013295 s, 78.9 MB/s 2024-09-10T23:28:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.001 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114438 s, 91.6 MB/s 2024-09-10T23:28:51.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119337 s, 87.9 MB/s 2024-09-10T23:28:51.032 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124241 s, 84.4 MB/s 2024-09-10T23:28:51.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112952 s, 92.8 MB/s 2024-09-10T23:28:51.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.064 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129379 s, 81.0 MB/s 2024-09-10T23:28:51.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.079 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117188 s, 89.5 MB/s 2024-09-10T23:28:51.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:51.087 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:51.087 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:51.087 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T23:28:51.087 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:51.088 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:51.088 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:51.088 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:51.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:51.158 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.159 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.159 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011141 s, 94.1 MB/s 2024-09-10T23:28:51.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.174 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122432 s, 85.6 MB/s 2024-09-10T23:28:51.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.190 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.190 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117386 s, 89.3 MB/s 2024-09-10T23:28:51.206 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.206 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.206 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124876 s, 84.0 MB/s 2024-09-10T23:28:51.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.227 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172403 s, 60.8 MB/s 2024-09-10T23:28:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.254 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135738 s, 77.3 MB/s 2024-09-10T23:28:51.269 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.269 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.269 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113216 s, 92.6 MB/s 2024-09-10T23:28:51.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.284 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118105 s, 88.8 MB/s 2024-09-10T23:28:51.301 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.301 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.301 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123843 s, 84.7 MB/s 2024-09-10T23:28:51.316 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.316 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.316 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122375 s, 85.7 MB/s 2024-09-10T23:28:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111117 s, 94.4 MB/s 2024-09-10T23:28:51.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.346 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.347 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110925 s, 94.5 MB/s 2024-09-10T23:28:51.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.362 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120055 s, 87.3 MB/s 2024-09-10T23:28:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118564 s, 88.4 MB/s 2024-09-10T23:28:51.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.392 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113662 s, 92.3 MB/s 2024-09-10T23:28:51.409 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.410 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134334 s, 78.1 MB/s 2024-09-10T23:28:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114544 s, 91.5 MB/s 2024-09-10T23:28:51.440 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.440 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.440 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116627 s, 89.9 MB/s 2024-09-10T23:28:51.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.455 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110516 s, 94.9 MB/s 2024-09-10T23:28:51.471 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.472 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.472 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129214 s, 81.2 MB/s 2024-09-10T23:28:51.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.487 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.487 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116682 s, 89.9 MB/s 2024-09-10T23:28:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114896 s, 91.3 MB/s 2024-09-10T23:28:51.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.517 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112807 s, 93.0 MB/s 2024-09-10T23:28:51.533 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.533 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.533 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123553 s, 84.9 MB/s 2024-09-10T23:28:51.548 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.548 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.548 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110789 s, 94.6 MB/s 2024-09-10T23:28:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122117 s, 85.9 MB/s 2024-09-10T23:28:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115233 s, 91.0 MB/s 2024-09-10T23:28:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125546 s, 83.5 MB/s 2024-09-10T23:28:51.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.610 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115385 s, 90.9 MB/s 2024-09-10T23:28:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012208 s, 85.9 MB/s 2024-09-10T23:28:51.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121819 s, 86.1 MB/s 2024-09-10T23:28:51.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126655 s, 82.8 MB/s 2024-09-10T23:28:51.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:51.666 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:51.666 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:51.666 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T23:28:51.666 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:51.666 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:51.666 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:51.666 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:51.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.737 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119613 s, 87.7 MB/s 2024-09-10T23:28:51.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.752 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117072 s, 89.6 MB/s 2024-09-10T23:28:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114599 s, 91.5 MB/s 2024-09-10T23:28:51.783 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.829 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01212 s, 86.5 MB/s 2024-09-10T23:28:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119866 s, 87.5 MB/s 2024-09-10T23:28:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126469 s, 82.9 MB/s 2024-09-10T23:28:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117101 s, 89.5 MB/s 2024-09-10T23:28:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109361 s, 95.9 MB/s 2024-09-10T23:28:51.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.862 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131343 s, 79.8 MB/s 2024-09-10T23:28:51.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.877 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118446 s, 88.5 MB/s 2024-09-10T23:28:51.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116678 s, 89.9 MB/s 2024-09-10T23:28:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.908 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117161 s, 89.5 MB/s 2024-09-10T23:28:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113202 s, 92.6 MB/s 2024-09-10T23:28:51.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.939 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.939 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125373 s, 83.6 MB/s 2024-09-10T23:28:51.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.956 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124842 s, 84.0 MB/s 2024-09-10T23:28:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107353 s, 97.7 MB/s 2024-09-10T23:28:51.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:51.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:51.985 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011522 s, 91.0 MB/s 2024-09-10T23:28:52.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108926 s, 96.3 MB/s 2024-09-10T23:28:52.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.016 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120586 s, 87.0 MB/s 2024-09-10T23:28:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115313 s, 90.9 MB/s 2024-09-10T23:28:52.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115958 s, 90.4 MB/s 2024-09-10T23:28:52.062 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124505 s, 84.2 MB/s 2024-09-10T23:28:52.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114007 s, 92.0 MB/s 2024-09-10T23:28:52.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.095 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132269 s, 79.3 MB/s 2024-09-10T23:28:52.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114407 s, 91.7 MB/s 2024-09-10T23:28:52.124 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011223 s, 93.4 MB/s 2024-09-10T23:28:52.140 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012369 s, 84.8 MB/s 2024-09-10T23:28:52.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.155 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112507 s, 93.2 MB/s 2024-09-10T23:28:52.170 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.171 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111725 s, 93.9 MB/s 2024-09-10T23:28:52.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.186 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111016 s, 94.5 MB/s 2024-09-10T23:28:52.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.200 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.200 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109227 s, 96.0 MB/s 2024-09-10T23:28:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.217 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124337 s, 84.3 MB/s 2024-09-10T23:28:52.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:52.224 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:52.224 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:52.224 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T23:28:52.224 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:52.224 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:52.224 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:52.224 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:52.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:52.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.304 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.304 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125341 s, 83.7 MB/s 2024-09-10T23:28:52.318 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011224 s, 93.4 MB/s 2024-09-10T23:28:52.333 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.333 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.333 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108847 s, 96.3 MB/s 2024-09-10T23:28:52.348 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.349 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.349 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118269 s, 88.7 MB/s 2024-09-10T23:28:52.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.365 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.365 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129998 s, 80.7 MB/s 2024-09-10T23:28:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127083 s, 82.5 MB/s 2024-09-10T23:28:52.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.397 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011866 s, 88.4 MB/s 2024-09-10T23:28:52.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.413 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125107 s, 83.8 MB/s 2024-09-10T23:28:52.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.430 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.430 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124038 s, 84.5 MB/s 2024-09-10T23:28:52.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.445 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.445 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113471 s, 92.4 MB/s 2024-09-10T23:28:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131682 s, 79.6 MB/s 2024-09-10T23:28:52.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119136 s, 88.0 MB/s 2024-09-10T23:28:52.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.492 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.492 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113846 s, 92.1 MB/s 2024-09-10T23:28:52.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.508 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.508 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116189 s, 90.2 MB/s 2024-09-10T23:28:52.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.522 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010746 s, 97.6 MB/s 2024-09-10T23:28:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.537 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011611 s, 90.3 MB/s 2024-09-10T23:28:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109284 s, 95.9 MB/s 2024-09-10T23:28:52.569 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.569 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.569 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128678 s, 81.5 MB/s 2024-09-10T23:28:52.584 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.584 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.584 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116727 s, 89.8 MB/s 2024-09-10T23:28:52.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.599 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.599 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011935 s, 87.9 MB/s 2024-09-10T23:28:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.615 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123271 s, 85.1 MB/s 2024-09-10T23:28:52.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.630 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111938 s, 93.7 MB/s 2024-09-10T23:28:52.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.645 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.645 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110216 s, 95.1 MB/s 2024-09-10T23:28:52.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.660 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112925 s, 92.9 MB/s 2024-09-10T23:28:52.675 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.676 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120832 s, 86.8 MB/s 2024-09-10T23:28:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117946 s, 88.9 MB/s 2024-09-10T23:28:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115949 s, 90.4 MB/s 2024-09-10T23:28:52.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.723 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127528 s, 82.2 MB/s 2024-09-10T23:28:52.737 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.738 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114918 s, 91.2 MB/s 2024-09-10T23:28:52.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112408 s, 93.3 MB/s 2024-09-10T23:28:52.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.768 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.768 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117335 s, 89.4 MB/s 2024-09-10T23:28:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112376 s, 93.3 MB/s 2024-09-10T23:28:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:52.790 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:52.790 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:52.790 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T23:28:52.790 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:52.790 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:52.790 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:52.790 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:52.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:52.861 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.862 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122491 s, 85.6 MB/s 2024-09-10T23:28:52.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.878 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118334 s, 88.6 MB/s 2024-09-10T23:28:52.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.893 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.893 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124482 s, 84.2 MB/s 2024-09-10T23:28:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124424 s, 84.3 MB/s 2024-09-10T23:28:52.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116373 s, 90.1 MB/s 2024-09-10T23:28:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124231 s, 84.4 MB/s 2024-09-10T23:28:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110813 s, 94.6 MB/s 2024-09-10T23:28:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.969 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108514 s, 96.6 MB/s 2024-09-10T23:28:52.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:52.984 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:52.984 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109938 s, 95.4 MB/s 2024-09-10T23:28:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01179 s, 88.9 MB/s 2024-09-10T23:28:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129169 s, 81.2 MB/s 2024-09-10T23:28:53.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113421 s, 92.4 MB/s 2024-09-10T23:28:53.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.048 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121991 s, 86.0 MB/s 2024-09-10T23:28:53.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012276 s, 85.4 MB/s 2024-09-10T23:28:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.079 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121127 s, 86.6 MB/s 2024-09-10T23:28:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112655 s, 93.1 MB/s 2024-09-10T23:28:53.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124833 s, 84.0 MB/s 2024-09-10T23:28:53.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.125 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.125 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113618 s, 92.3 MB/s 2024-09-10T23:28:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115227 s, 91.0 MB/s 2024-09-10T23:28:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011587 s, 90.5 MB/s 2024-09-10T23:28:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114241 s, 91.8 MB/s 2024-09-10T23:28:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114377 s, 91.7 MB/s 2024-09-10T23:28:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118774 s, 88.3 MB/s 2024-09-10T23:28:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134492 s, 78.0 MB/s 2024-09-10T23:28:53.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.235 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120259 s, 87.2 MB/s 2024-09-10T23:28:53.263 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.264 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.264 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127526 s, 82.2 MB/s 2024-09-10T23:28:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.279 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121369 s, 86.4 MB/s 2024-09-10T23:28:53.293 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.294 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108126 s, 97.0 MB/s 2024-09-10T23:28:53.309 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.310 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.310 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123923 s, 84.6 MB/s 2024-09-10T23:28:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117998 s, 88.9 MB/s 2024-09-10T23:28:53.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.340 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.341 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113994 s, 92.0 MB/s 2024-09-10T23:28:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116 s, 90.4 MB/s 2024-09-10T23:28:53.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:53.363 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:53.364 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:53.364 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T23:28:53.364 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:53.364 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:53.364 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:53.364 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:53.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.434 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117261 s, 89.4 MB/s 2024-09-10T23:28:53.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.452 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.452 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132192 s, 79.3 MB/s 2024-09-10T23:28:53.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.467 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.467 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123583 s, 84.8 MB/s 2024-09-10T23:28:53.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.483 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.483 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122261 s, 85.8 MB/s 2024-09-10T23:28:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121751 s, 86.1 MB/s 2024-09-10T23:28:53.515 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.515 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.515 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126832 s, 82.7 MB/s 2024-09-10T23:28:53.531 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.531 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.531 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119244 s, 87.9 MB/s 2024-09-10T23:28:53.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.546 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.546 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112863 s, 92.9 MB/s 2024-09-10T23:28:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.561 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111486 s, 94.1 MB/s 2024-09-10T23:28:53.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.576 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.576 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112012 s, 93.6 MB/s 2024-09-10T23:28:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116617 s, 89.9 MB/s 2024-09-10T23:28:53.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.606 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109025 s, 96.2 MB/s 2024-09-10T23:28:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125332 s, 83.7 MB/s 2024-09-10T23:28:53.639 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.639 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.639 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128923 s, 81.3 MB/s 2024-09-10T23:28:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109815 s, 95.5 MB/s 2024-09-10T23:28:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119323 s, 87.9 MB/s 2024-09-10T23:28:53.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.684 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.684 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110964 s, 94.5 MB/s 2024-09-10T23:28:53.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.699 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.699 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114638 s, 91.5 MB/s 2024-09-10T23:28:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.714 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111138 s, 94.3 MB/s 2024-09-10T23:28:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.728 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106317 s, 98.6 MB/s 2024-09-10T23:28:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.743 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115911 s, 90.5 MB/s 2024-09-10T23:28:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.758 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110792 s, 94.6 MB/s 2024-09-10T23:28:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.774 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124494 s, 84.2 MB/s 2024-09-10T23:28:53.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.789 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.789 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110455 s, 94.9 MB/s 2024-09-10T23:28:53.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.805 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.805 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123662 s, 84.8 MB/s 2024-09-10T23:28:53.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.821 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122873 s, 85.3 MB/s 2024-09-10T23:28:53.837 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.837 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.837 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117558 s, 89.2 MB/s 2024-09-10T23:28:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.852 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116816 s, 89.8 MB/s 2024-09-10T23:28:53.868 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.869 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.869 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125892 s, 83.3 MB/s 2024-09-10T23:28:53.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.884 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.884 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011333 s, 92.5 MB/s 2024-09-10T23:28:53.899 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.899 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.899 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115687 s, 90.6 MB/s 2024-09-10T23:28:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117919 s, 88.9 MB/s 2024-09-10T23:28:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:53.921 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:53.922 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:53.922 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T23:28:53.922 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:53.922 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:53.922 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:53.922 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:53.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131763 s, 79.6 MB/s 2024-09-10T23:28:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122415 s, 85.7 MB/s 2024-09-10T23:28:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.027 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131473 s, 79.8 MB/s 2024-09-10T23:28:54.044 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.044 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.044 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126167 s, 83.1 MB/s 2024-09-10T23:28:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.060 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012193 s, 86.0 MB/s 2024-09-10T23:28:54.076 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.076 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.076 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012778 s, 82.1 MB/s 2024-09-10T23:28:54.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.091 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.091 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115621 s, 90.7 MB/s 2024-09-10T23:28:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114036 s, 92.0 MB/s 2024-09-10T23:28:54.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123331 s, 85.0 MB/s 2024-09-10T23:28:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.139 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129313 s, 81.1 MB/s 2024-09-10T23:28:54.154 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.155 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.155 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118818 s, 88.3 MB/s 2024-09-10T23:28:54.171 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.172 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013219 s, 79.3 MB/s 2024-09-10T23:28:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.187 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115598 s, 90.7 MB/s 2024-09-10T23:28:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.202 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121113 s, 86.6 MB/s 2024-09-10T23:28:54.217 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.218 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.218 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114747 s, 91.4 MB/s 2024-09-10T23:28:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110115 s, 95.2 MB/s 2024-09-10T23:28:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120932 s, 86.7 MB/s 2024-09-10T23:28:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.282 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114251 s, 91.8 MB/s 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.299 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128575 s, 81.6 MB/s 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.314 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113936 s, 92.0 MB/s 2024-09-10T23:28:54.330 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.331 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.331 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126539 s, 82.9 MB/s 2024-09-10T23:28:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125882 s, 83.3 MB/s 2024-09-10T23:28:54.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.363 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.363 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119853 s, 87.5 MB/s 2024-09-10T23:28:54.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.378 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.378 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114047 s, 91.9 MB/s 2024-09-10T23:28:54.393 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.394 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.394 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121668 s, 86.2 MB/s 2024-09-10T23:28:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.409 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115906 s, 90.5 MB/s 2024-09-10T23:28:54.424 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.424 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.424 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011488 s, 91.3 MB/s 2024-09-10T23:28:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010737 s, 97.7 MB/s 2024-09-10T23:28:54.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.453 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108145 s, 97.0 MB/s 2024-09-10T23:28:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.469 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117363 s, 89.3 MB/s 2024-09-10T23:28:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.484 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116256 s, 90.2 MB/s 2024-09-10T23:28:54.500 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.501 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127587 s, 82.2 MB/s 2024-09-10T23:28:54.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:54.508 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:54.509 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:54.509 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T23:28:54.509 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:54.509 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:54.509 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:54.509 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:54.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:54.580 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.581 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.581 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012021 s, 87.2 MB/s 2024-09-10T23:28:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124738 s, 84.1 MB/s 2024-09-10T23:28:54.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.612 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.612 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116229 s, 90.2 MB/s 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.627 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116833 s, 89.8 MB/s 2024-09-10T23:28:54.641 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.642 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108263 s, 96.9 MB/s 2024-09-10T23:28:54.657 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.657 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.657 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116181 s, 90.3 MB/s 2024-09-10T23:28:54.671 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.672 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110121 s, 95.2 MB/s 2024-09-10T23:28:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112566 s, 93.2 MB/s 2024-09-10T23:28:54.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.702 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.702 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122691 s, 85.5 MB/s 2024-09-10T23:28:54.717 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.717 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.718 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115772 s, 90.6 MB/s 2024-09-10T23:28:54.732 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.733 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011586 s, 90.5 MB/s 2024-09-10T23:28:54.749 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.749 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.749 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124966 s, 83.9 MB/s 2024-09-10T23:28:54.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.764 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.764 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119318 s, 87.9 MB/s 2024-09-10T23:28:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.780 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.780 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116611 s, 89.9 MB/s 2024-09-10T23:28:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.795 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120754 s, 86.8 MB/s 2024-09-10T23:28:54.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.810 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.810 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108254 s, 96.9 MB/s 2024-09-10T23:28:54.825 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.825 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.825 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113813 s, 92.1 MB/s 2024-09-10T23:28:54.840 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.841 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117994 s, 88.9 MB/s 2024-09-10T23:28:54.856 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.856 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.856 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119446 s, 87.8 MB/s 2024-09-10T23:28:54.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.872 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121785 s, 86.1 MB/s 2024-09-10T23:28:54.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.887 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.887 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118965 s, 88.1 MB/s 2024-09-10T23:28:54.901 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.901 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.902 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108395 s, 96.7 MB/s 2024-09-10T23:28:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111699 s, 93.9 MB/s 2024-09-10T23:28:54.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.931 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.931 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113392 s, 92.5 MB/s 2024-09-10T23:28:54.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.946 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.946 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111392 s, 94.1 MB/s 2024-09-10T23:28:54.962 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.962 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.962 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124734 s, 84.1 MB/s 2024-09-10T23:28:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122837 s, 85.4 MB/s 2024-09-10T23:28:54.993 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:54.994 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:54.994 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118836 s, 88.2 MB/s 2024-09-10T23:28:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.009 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116 s, 90.4 MB/s 2024-09-10T23:28:55.025 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.026 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.026 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127352 s, 82.3 MB/s 2024-09-10T23:28:55.042 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.042 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.042 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124621 s, 84.1 MB/s 2024-09-10T23:28:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115306 s, 90.9 MB/s 2024-09-10T23:28:55.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:55.064 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:55.064 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:55.064 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T23:28:55.064 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:55.065 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:55.065 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:55.065 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:55.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112501 s, 93.2 MB/s 2024-09-10T23:28:55.149 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.150 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.150 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118306 s, 88.6 MB/s 2024-09-10T23:28:55.164 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.164 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.164 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011161 s, 94.0 MB/s 2024-09-10T23:28:55.180 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.180 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.181 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125388 s, 83.6 MB/s 2024-09-10T23:28:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.196 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114324 s, 91.7 MB/s 2024-09-10T23:28:55.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.211 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.211 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118896 s, 88.2 MB/s 2024-09-10T23:28:55.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.227 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122328 s, 85.7 MB/s 2024-09-10T23:28:55.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.243 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012554 s, 83.5 MB/s 2024-09-10T23:28:55.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.268 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.268 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112734 s, 93.0 MB/s 2024-09-10T23:28:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121447 s, 86.3 MB/s 2024-09-10T23:28:55.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.299 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.299 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011377 s, 92.2 MB/s 2024-09-10T23:28:55.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.314 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116 s, 90.4 MB/s 2024-09-10T23:28:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.330 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113619 s, 92.3 MB/s 2024-09-10T23:28:55.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.344 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.344 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112208 s, 93.4 MB/s 2024-09-10T23:28:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131732 s, 79.6 MB/s 2024-09-10T23:28:55.376 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117038 s, 89.6 MB/s 2024-09-10T23:28:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114318 s, 91.7 MB/s 2024-09-10T23:28:55.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.407 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.408 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123466 s, 84.9 MB/s 2024-09-10T23:28:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120611 s, 86.9 MB/s 2024-09-10T23:28:55.440 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.440 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.440 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012809 s, 81.9 MB/s 2024-09-10T23:28:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117873 s, 89.0 MB/s 2024-09-10T23:28:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113643 s, 92.3 MB/s 2024-09-10T23:28:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114739 s, 91.4 MB/s 2024-09-10T23:28:55.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.505 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141474 s, 74.1 MB/s 2024-09-10T23:28:55.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.526 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161746 s, 64.8 MB/s 2024-09-10T23:28:55.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.545 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.545 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149005 s, 70.4 MB/s 2024-09-10T23:28:55.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.566 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.566 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166681 s, 62.9 MB/s 2024-09-10T23:28:55.586 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.586 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.587 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015861 s, 66.1 MB/s 2024-09-10T23:28:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148696 s, 70.5 MB/s 2024-09-10T23:28:55.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.622 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.622 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118877 s, 88.2 MB/s 2024-09-10T23:28:55.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.644 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175359 s, 59.8 MB/s 2024-09-10T23:28:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117484 s, 89.3 MB/s 2024-09-10T23:28:55.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:55.666 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:55.666 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:55.666 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T23:28:55.667 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:55.667 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:55.667 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:55.667 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:55.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120402 s, 87.1 MB/s 2024-09-10T23:28:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124117 s, 84.5 MB/s 2024-09-10T23:28:55.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.811 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.812 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109093 s, 96.1 MB/s 2024-09-10T23:28:55.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.827 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.827 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116556 s, 90.0 MB/s 2024-09-10T23:28:55.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.841 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.841 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107761 s, 97.3 MB/s 2024-09-10T23:28:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117592 s, 89.2 MB/s 2024-09-10T23:28:55.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.872 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.872 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118901 s, 88.2 MB/s 2024-09-10T23:28:55.888 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.888 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.888 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123529 s, 84.9 MB/s 2024-09-10T23:28:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109932 s, 95.4 MB/s 2024-09-10T23:28:55.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.918 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.918 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116826 s, 89.8 MB/s 2024-09-10T23:28:55.933 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.933 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.933 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110785 s, 94.6 MB/s 2024-09-10T23:28:55.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.948 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.948 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110912 s, 94.5 MB/s 2024-09-10T23:28:55.965 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.965 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.965 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138584 s, 75.7 MB/s 2024-09-10T23:28:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013736 s, 76.3 MB/s 2024-09-10T23:28:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114418 s, 91.6 MB/s 2024-09-10T23:28:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119401 s, 87.8 MB/s 2024-09-10T23:28:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126523 s, 82.9 MB/s 2024-09-10T23:28:56.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.046 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119749 s, 87.6 MB/s 2024-09-10T23:28:56.061 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.061 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.061 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117585 s, 89.2 MB/s 2024-09-10T23:28:56.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.077 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.077 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124435 s, 84.3 MB/s 2024-09-10T23:28:56.092 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.093 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.093 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118353 s, 88.6 MB/s 2024-09-10T23:28:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107895 s, 97.2 MB/s 2024-09-10T23:28:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.122 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115454 s, 90.8 MB/s 2024-09-10T23:28:56.136 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.137 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.137 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109238 s, 96.0 MB/s 2024-09-10T23:28:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.153 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117172 s, 89.5 MB/s 2024-09-10T23:28:56.167 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.167 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.167 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107458 s, 97.6 MB/s 2024-09-10T23:28:56.181 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.182 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.182 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112286 s, 93.4 MB/s 2024-09-10T23:28:56.197 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.197 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.197 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114885 s, 91.3 MB/s 2024-09-10T23:28:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110843 s, 94.6 MB/s 2024-09-10T23:28:56.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.227 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.227 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115705 s, 90.6 MB/s 2024-09-10T23:28:56.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.243 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.244 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126168 s, 83.1 MB/s 2024-09-10T23:28:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013015 s, 80.6 MB/s 2024-09-10T23:28:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:56.279 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:56.280 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:56.280 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T23:28:56.280 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:56.280 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:56.280 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:56.280 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:56.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126977 s, 82.6 MB/s 2024-09-10T23:28:56.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.368 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.368 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126247 s, 83.1 MB/s 2024-09-10T23:28:56.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.385 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130683 s, 80.2 MB/s 2024-09-10T23:28:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112549 s, 93.2 MB/s 2024-09-10T23:28:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111085 s, 94.4 MB/s 2024-09-10T23:28:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111991 s, 93.6 MB/s 2024-09-10T23:28:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114835 s, 91.3 MB/s 2024-09-10T23:28:56.459 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.460 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.460 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121628 s, 86.2 MB/s 2024-09-10T23:28:56.475 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.475 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.475 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115317 s, 90.9 MB/s 2024-09-10T23:28:56.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.490 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116471 s, 90.0 MB/s 2024-09-10T23:28:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.507 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125478 s, 83.6 MB/s 2024-09-10T23:28:56.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.521 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.521 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110257 s, 95.1 MB/s 2024-09-10T23:28:56.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.537 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.538 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126066 s, 83.2 MB/s 2024-09-10T23:28:56.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.553 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112278 s, 93.4 MB/s 2024-09-10T23:28:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.568 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116135 s, 90.3 MB/s 2024-09-10T23:28:56.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.583 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.583 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111011 s, 94.5 MB/s 2024-09-10T23:28:56.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.598 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.598 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011347 s, 92.4 MB/s 2024-09-10T23:28:56.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.615 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133569 s, 78.5 MB/s 2024-09-10T23:28:56.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.630 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.630 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116287 s, 90.2 MB/s 2024-09-10T23:28:56.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.646 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.646 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125028 s, 83.9 MB/s 2024-09-10T23:28:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.661 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115943 s, 90.4 MB/s 2024-09-10T23:28:56.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.677 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.677 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118681 s, 88.4 MB/s 2024-09-10T23:28:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111581 s, 94.0 MB/s 2024-09-10T23:28:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110635 s, 94.8 MB/s 2024-09-10T23:28:56.721 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116164 s, 90.3 MB/s 2024-09-10T23:28:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.739 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.739 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133933 s, 78.3 MB/s 2024-09-10T23:28:56.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116411 s, 90.1 MB/s 2024-09-10T23:28:56.769 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.770 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.770 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119544 s, 87.7 MB/s 2024-09-10T23:28:56.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.785 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114554 s, 91.5 MB/s 2024-09-10T23:28:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108936 s, 96.3 MB/s 2024-09-10T23:28:56.814 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.815 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116554 s, 90.0 MB/s 2024-09-10T23:28:56.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.831 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.831 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124329 s, 84.3 MB/s 2024-09-10T23:28:56.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:56.838 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:56.838 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:56.838 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T23:28:56.838 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:56.838 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:56.838 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:56.838 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:56.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:56.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.909 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.909 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121899 s, 86.0 MB/s 2024-09-10T23:28:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113929 s, 92.0 MB/s 2024-09-10T23:28:56.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.940 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124486 s, 84.2 MB/s 2024-09-10T23:28:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114344 s, 91.7 MB/s 2024-09-10T23:28:56.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011477 s, 91.4 MB/s 2024-09-10T23:28:56.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:56.986 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:56.986 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122266 s, 85.8 MB/s 2024-09-10T23:28:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113879 s, 92.1 MB/s 2024-09-10T23:28:57.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.016 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112108 s, 93.5 MB/s 2024-09-10T23:28:57.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.033 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.033 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134749 s, 77.8 MB/s 2024-09-10T23:28:57.048 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.049 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117726 s, 89.1 MB/s 2024-09-10T23:28:57.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.063 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.063 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111089 s, 94.4 MB/s 2024-09-10T23:28:57.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01078 s, 97.3 MB/s 2024-09-10T23:28:57.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.095 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.095 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132109 s, 79.4 MB/s 2024-09-10T23:28:57.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.112 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.112 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133035 s, 78.8 MB/s 2024-09-10T23:28:57.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.128 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116424 s, 90.1 MB/s 2024-09-10T23:28:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112048 s, 93.6 MB/s 2024-09-10T23:28:57.158 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.158 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.158 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112446 s, 93.3 MB/s 2024-09-10T23:28:57.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.174 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.174 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012475 s, 84.1 MB/s 2024-09-10T23:28:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110519 s, 94.9 MB/s 2024-09-10T23:28:57.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.204 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.204 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111787 s, 93.8 MB/s 2024-09-10T23:28:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121228 s, 86.5 MB/s 2024-09-10T23:28:57.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.235 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114685 s, 91.4 MB/s 2024-09-10T23:28:57.253 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.254 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.254 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014708 s, 71.3 MB/s 2024-09-10T23:28:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.277 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.278 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112726 s, 93.0 MB/s 2024-09-10T23:28:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110141 s, 95.2 MB/s 2024-09-10T23:28:57.306 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.307 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010947 s, 95.8 MB/s 2024-09-10T23:28:57.321 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.322 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.322 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112086 s, 93.6 MB/s 2024-09-10T23:28:57.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.338 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.338 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124991 s, 83.9 MB/s 2024-09-10T23:28:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108894 s, 96.3 MB/s 2024-09-10T23:28:57.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.367 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109516 s, 95.7 MB/s 2024-09-10T23:28:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013317 s, 78.7 MB/s 2024-09-10T23:28:57.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.399 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.399 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111193 s, 94.3 MB/s 2024-09-10T23:28:57.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:57.406 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:57.406 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:57.407 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T23:28:57.407 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:57.407 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:57.407 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:57.407 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:57.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.478 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.478 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131043 s, 80.0 MB/s 2024-09-10T23:28:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.494 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128291 s, 81.7 MB/s 2024-09-10T23:28:57.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.511 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.511 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132496 s, 79.1 MB/s 2024-09-10T23:28:57.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.526 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.526 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113214 s, 92.6 MB/s 2024-09-10T23:28:57.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.542 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.542 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115633 s, 90.7 MB/s 2024-09-10T23:28:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111962 s, 93.7 MB/s 2024-09-10T23:28:57.572 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.572 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.572 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118267 s, 88.7 MB/s 2024-09-10T23:28:57.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.588 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.588 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120211 s, 87.2 MB/s 2024-09-10T23:28:57.604 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.605 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.605 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131645 s, 79.7 MB/s 2024-09-10T23:28:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110047 s, 95.3 MB/s 2024-09-10T23:28:57.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.634 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.635 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113132 s, 92.7 MB/s 2024-09-10T23:28:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011426 s, 91.8 MB/s 2024-09-10T23:28:57.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.665 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.666 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121987 s, 86.0 MB/s 2024-09-10T23:28:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127878 s, 82.0 MB/s 2024-09-10T23:28:57.697 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.697 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.697 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116197 s, 90.2 MB/s 2024-09-10T23:28:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.714 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124474 s, 84.2 MB/s 2024-09-10T23:28:57.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.729 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.729 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113567 s, 92.3 MB/s 2024-09-10T23:28:57.744 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.745 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.745 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122855 s, 85.4 MB/s 2024-09-10T23:28:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.761 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122382 s, 85.7 MB/s 2024-09-10T23:28:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117038 s, 89.6 MB/s 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.791 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114044 s, 91.9 MB/s 2024-09-10T23:28:57.806 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.806 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.807 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116971 s, 89.6 MB/s 2024-09-10T23:28:57.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.821 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.821 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111856 s, 93.7 MB/s 2024-09-10T23:28:57.836 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.836 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.836 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110649 s, 94.8 MB/s 2024-09-10T23:28:57.851 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.851 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.851 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116898 s, 89.7 MB/s 2024-09-10T23:28:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.867 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122198 s, 85.8 MB/s 2024-09-10T23:28:57.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.883 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.883 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116741 s, 89.8 MB/s 2024-09-10T23:28:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110568 s, 94.8 MB/s 2024-09-10T23:28:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125111 s, 83.8 MB/s 2024-09-10T23:28:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.929 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113536 s, 92.4 MB/s 2024-09-10T23:28:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118249 s, 88.7 MB/s 2024-09-10T23:28:57.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:57.961 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132503 s, 79.1 MB/s 2024-09-10T23:28:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:57.969 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:57.969 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:57.969 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T23:28:57.969 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:57.969 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:57.969 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:57.969 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:58.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127842 s, 82.0 MB/s 2024-09-10T23:28:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124074 s, 84.5 MB/s 2024-09-10T23:28:58.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.073 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.073 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112216 s, 93.4 MB/s 2024-09-10T23:28:58.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.088 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.088 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113962 s, 92.0 MB/s 2024-09-10T23:28:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.103 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111116 s, 94.4 MB/s 2024-09-10T23:28:58.117 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.117 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.117 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108587 s, 96.6 MB/s 2024-09-10T23:28:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.133 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011433 s, 91.7 MB/s 2024-09-10T23:28:58.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.148 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.148 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117702 s, 89.1 MB/s 2024-09-10T23:28:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.164 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128569 s, 81.6 MB/s 2024-09-10T23:28:58.180 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.180 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.180 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012371 s, 84.8 MB/s 2024-09-10T23:28:58.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.195 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.195 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107768 s, 97.3 MB/s 2024-09-10T23:28:58.209 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.209 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.209 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106933 s, 98.1 MB/s 2024-09-10T23:28:58.225 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.225 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.225 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123396 s, 85.0 MB/s 2024-09-10T23:28:58.241 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.242 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.242 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123766 s, 84.7 MB/s 2024-09-10T23:28:58.259 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.260 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.260 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142966 s, 73.3 MB/s 2024-09-10T23:28:58.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.282 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.282 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125926 s, 83.3 MB/s 2024-09-10T23:28:58.297 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.297 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.297 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110353 s, 95.0 MB/s 2024-09-10T23:28:58.313 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.314 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.314 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130036 s, 80.6 MB/s 2024-09-10T23:28:58.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.329 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.329 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01134 s, 92.5 MB/s 2024-09-10T23:28:58.345 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.345 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.345 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129345 s, 81.1 MB/s 2024-09-10T23:28:58.360 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.360 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.360 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110453 s, 94.9 MB/s 2024-09-10T23:28:58.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.377 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.377 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132316 s, 79.2 MB/s 2024-09-10T23:28:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011555 s, 90.7 MB/s 2024-09-10T23:28:58.408 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.408 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.408 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011642 s, 90.1 MB/s 2024-09-10T23:28:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111438 s, 94.1 MB/s 2024-09-10T23:28:58.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.438 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.438 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118663 s, 88.4 MB/s 2024-09-10T23:28:58.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.453 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.453 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112794 s, 93.0 MB/s 2024-09-10T23:28:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132624 s, 79.1 MB/s 2024-09-10T23:28:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121509 s, 86.3 MB/s 2024-09-10T23:28:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115677 s, 90.6 MB/s 2024-09-10T23:28:58.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.517 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.517 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117394 s, 89.3 MB/s 2024-09-10T23:28:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114696 s, 91.4 MB/s 2024-09-10T23:28:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:58.539 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:58.539 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:58.540 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T23:28:58.540 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:58.540 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:58.540 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:58.540 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:58.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:58.610 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.611 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.611 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119559 s, 87.7 MB/s 2024-09-10T23:28:58.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.626 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.626 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121319 s, 86.4 MB/s 2024-09-10T23:28:58.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.643 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130457 s, 80.4 MB/s 2024-09-10T23:28:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128717 s, 81.5 MB/s 2024-09-10T23:28:58.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.676 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.676 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124834 s, 84.0 MB/s 2024-09-10T23:28:58.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.691 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.691 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114076 s, 91.9 MB/s 2024-09-10T23:28:58.708 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.708 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.708 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130768 s, 80.2 MB/s 2024-09-10T23:28:58.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.723 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.723 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113303 s, 92.5 MB/s 2024-09-10T23:28:58.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.738 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.738 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011248 s, 93.2 MB/s 2024-09-10T23:28:58.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.754 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.754 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115028 s, 91.2 MB/s 2024-09-10T23:28:58.769 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.769 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.769 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117275 s, 89.4 MB/s 2024-09-10T23:28:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128667 s, 81.5 MB/s 2024-09-10T23:28:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114363 s, 91.7 MB/s 2024-09-10T23:28:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127089 s, 82.5 MB/s 2024-09-10T23:28:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114877 s, 91.3 MB/s 2024-09-10T23:28:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.849 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125706 s, 83.4 MB/s 2024-09-10T23:28:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109974 s, 95.3 MB/s 2024-09-10T23:28:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.880 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121952 s, 86.0 MB/s 2024-09-10T23:28:58.895 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.895 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.895 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116765 s, 89.8 MB/s 2024-09-10T23:28:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.910 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111481 s, 94.1 MB/s 2024-09-10T23:28:58.925 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.925 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.925 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01084 s, 96.7 MB/s 2024-09-10T23:28:58.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.940 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.941 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121282 s, 86.5 MB/s 2024-09-10T23:28:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119225 s, 87.9 MB/s 2024-09-10T23:28:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.972 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125929 s, 83.3 MB/s 2024-09-10T23:28:58.989 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:58.989 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:58.989 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125318 s, 83.7 MB/s 2024-09-10T23:28:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115605 s, 90.7 MB/s 2024-09-10T23:28:59.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.020 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.020 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116526 s, 90.0 MB/s 2024-09-10T23:28:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116795 s, 89.8 MB/s 2024-09-10T23:28:59.051 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.051 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.051 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123938 s, 84.6 MB/s 2024-09-10T23:28:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118405 s, 88.6 MB/s 2024-09-10T23:28:59.084 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.084 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.084 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136645 s, 76.7 MB/s 2024-09-10T23:28:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.100 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127337 s, 82.3 MB/s 2024-09-10T23:28:59.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:59.108 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:59.108 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:59.108 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T23:28:59.108 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:59.108 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:59.108 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:59.108 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:59.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:59.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.225 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.225 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118333 s, 88.6 MB/s 2024-09-10T23:28:59.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.240 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116638 s, 89.9 MB/s 2024-09-10T23:28:59.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.255 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.255 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118174 s, 88.7 MB/s 2024-09-10T23:28:59.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.285 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.285 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131135 s, 80.0 MB/s 2024-09-10T23:28:59.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.300 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.300 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110983 s, 94.5 MB/s 2024-09-10T23:28:59.316 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.316 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.316 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127527 s, 82.2 MB/s 2024-09-10T23:28:59.332 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.332 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.333 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122159 s, 85.8 MB/s 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.347 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110737 s, 94.7 MB/s 2024-09-10T23:28:59.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.362 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.362 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113431 s, 92.4 MB/s 2024-09-10T23:28:59.378 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.378 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.378 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121588 s, 86.2 MB/s 2024-09-10T23:28:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125269 s, 83.7 MB/s 2024-09-10T23:28:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.410 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011701 s, 89.6 MB/s 2024-09-10T23:28:59.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.427 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129991 s, 80.7 MB/s 2024-09-10T23:28:59.441 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111081 s, 94.4 MB/s 2024-09-10T23:28:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125671 s, 83.4 MB/s 2024-09-10T23:28:59.475 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.475 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.475 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130619 s, 80.3 MB/s 2024-09-10T23:28:59.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.490 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.490 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110334 s, 95.0 MB/s 2024-09-10T23:28:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.505 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111466 s, 94.1 MB/s 2024-09-10T23:28:59.520 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.520 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.520 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117086 s, 89.6 MB/s 2024-09-10T23:28:59.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.536 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.536 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125235 s, 83.7 MB/s 2024-09-10T23:28:59.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.551 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.551 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111562 s, 94.0 MB/s 2024-09-10T23:28:59.565 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.565 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.565 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108706 s, 96.5 MB/s 2024-09-10T23:28:59.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.582 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.582 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127447 s, 82.3 MB/s 2024-09-10T23:28:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114976 s, 91.2 MB/s 2024-09-10T23:28:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117052 s, 89.6 MB/s 2024-09-10T23:28:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.628 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113047 s, 92.8 MB/s 2024-09-10T23:28:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123459 s, 84.9 MB/s 2024-09-10T23:28:59.658 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109393 s, 95.9 MB/s 2024-09-10T23:28:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.674 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115687 s, 90.6 MB/s 2024-09-10T23:28:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117827 s, 89.0 MB/s 2024-09-10T23:28:59.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.705 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.705 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121961 s, 86.0 MB/s 2024-09-10T23:28:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011535 s, 90.9 MB/s 2024-09-10T23:28:59.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:28:59.728 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:28:59.728 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:28:59.728 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T23:28:59.728 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:28:59.728 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:28:59.728 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:28:59.728 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:28:59.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:28:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:28:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125055 s, 83.8 MB/s 2024-09-10T23:28:59.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.815 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.815 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113943 s, 92.0 MB/s 2024-09-10T23:28:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115594 s, 90.7 MB/s 2024-09-10T23:28:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.846 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126308 s, 83.0 MB/s 2024-09-10T23:28:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.862 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115536 s, 90.8 MB/s 2024-09-10T23:28:59.876 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111748 s, 93.8 MB/s 2024-09-10T23:28:59.891 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.892 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113137 s, 92.7 MB/s 2024-09-10T23:28:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.907 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117177 s, 89.5 MB/s 2024-09-10T23:28:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.922 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114064 s, 91.9 MB/s 2024-09-10T23:28:59.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.938 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.939 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124317 s, 84.3 MB/s 2024-09-10T23:28:59.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.954 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123445 s, 84.9 MB/s 2024-09-10T23:28:59.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.971 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.971 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129474 s, 81.0 MB/s 2024-09-10T23:28:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:28:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:28:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120985 s, 86.7 MB/s 2024-09-10T23:29:00.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.002 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.002 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112196 s, 93.5 MB/s 2024-09-10T23:29:00.018 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.018 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.018 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118815 s, 88.3 MB/s 2024-09-10T23:29:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.035 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127734 s, 82.1 MB/s 2024-09-10T23:29:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.050 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118817 s, 88.3 MB/s 2024-09-10T23:29:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116705 s, 89.8 MB/s 2024-09-10T23:29:00.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.082 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012722 s, 82.4 MB/s 2024-09-10T23:29:00.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.098 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.098 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012637 s, 83.0 MB/s 2024-09-10T23:29:00.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.113 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.113 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110767 s, 94.7 MB/s 2024-09-10T23:29:00.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.128 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.129 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117735 s, 89.1 MB/s 2024-09-10T23:29:00.144 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.145 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.145 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122466 s, 85.6 MB/s 2024-09-10T23:29:00.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.160 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.161 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012174 s, 86.1 MB/s 2024-09-10T23:29:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123333 s, 85.0 MB/s 2024-09-10T23:29:00.193 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.193 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.193 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126271 s, 83.0 MB/s 2024-09-10T23:29:00.208 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.208 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.208 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116588 s, 89.9 MB/s 2024-09-10T23:29:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.224 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012442 s, 84.3 MB/s 2024-09-10T23:29:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119288 s, 87.9 MB/s 2024-09-10T23:29:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.257 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012437 s, 84.3 MB/s 2024-09-10T23:29:00.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.286 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123982 s, 84.6 MB/s 2024-09-10T23:29:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109603 s, 95.7 MB/s 2024-09-10T23:29:00.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:29:00.308 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:29:00.308 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:29:00.308 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T23:29:00.308 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:29:00.308 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:29:00.309 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:29:00.309 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:29:00.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:29:00.380 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.380 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.380 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115008 s, 91.2 MB/s 2024-09-10T23:29:00.395 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.395 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.395 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115009 s, 91.2 MB/s 2024-09-10T23:29:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.411 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122824 s, 85.4 MB/s 2024-09-10T23:29:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.428 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126554 s, 82.9 MB/s 2024-09-10T23:29:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.443 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115407 s, 90.9 MB/s 2024-09-10T23:29:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014265 s, 73.5 MB/s 2024-09-10T23:29:00.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.477 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.477 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123731 s, 84.7 MB/s 2024-09-10T23:29:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.496 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.496 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142991 s, 73.3 MB/s 2024-09-10T23:29:00.515 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.515 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.515 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152483 s, 68.8 MB/s 2024-09-10T23:29:00.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.534 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.534 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143839 s, 72.9 MB/s 2024-09-10T23:29:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139387 s, 75.2 MB/s 2024-09-10T23:29:00.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.571 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.571 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143511 s, 73.1 MB/s 2024-09-10T23:29:00.589 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.589 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.589 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133819 s, 78.4 MB/s 2024-09-10T23:29:00.605 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.605 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.606 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124188 s, 84.4 MB/s 2024-09-10T23:29:00.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.624 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.624 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146213 s, 71.7 MB/s 2024-09-10T23:29:00.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.643 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.643 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144114 s, 72.8 MB/s 2024-09-10T23:29:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012002 s, 87.4 MB/s 2024-09-10T23:29:00.673 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.674 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.674 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112777 s, 93.0 MB/s 2024-09-10T23:29:00.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.689 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.689 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115054 s, 91.1 MB/s 2024-09-10T23:29:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.704 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011108 s, 94.4 MB/s 2024-09-10T23:29:00.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.719 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.719 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113787 s, 92.2 MB/s 2024-09-10T23:29:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012867 s, 81.5 MB/s 2024-09-10T23:29:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123705 s, 84.8 MB/s 2024-09-10T23:29:00.767 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.767 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.767 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115086 s, 91.1 MB/s 2024-09-10T23:29:00.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.782 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.782 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011593 s, 90.4 MB/s 2024-09-10T23:29:00.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.797 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.797 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108895 s, 96.3 MB/s 2024-09-10T23:29:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112812 s, 92.9 MB/s 2024-09-10T23:29:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.828 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122778 s, 85.4 MB/s 2024-09-10T23:29:00.843 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.844 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012167 s, 86.2 MB/s 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.859 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115478 s, 90.8 MB/s 2024-09-10T23:29:00.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.874 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.874 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112605 s, 93.1 MB/s 2024-09-10T23:29:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.889 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011532 s, 90.9 MB/s 2024-09-10T23:29:00.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:29:00.897 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T23:29:00.897 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:29:00.897 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T23:29:00.897 DEBUG:teuthology.orchestra.run.smithi017:> for ((i = 0; i < 32; i++)); do 2024-09-10T23:29:00.897 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T23:29:00.897 DEBUG:teuthology.orchestra.run.smithi017:> done 2024-09-10T23:29:00.897 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:29:00.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T23:29:00.969 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.970 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.970 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134524 s, 77.9 MB/s 2024-09-10T23:29:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117079 s, 89.6 MB/s 2024-09-10T23:29:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.000 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.001 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116546 s, 90.0 MB/s 2024-09-10T23:29:01.015 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.016 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.016 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115036 s, 91.2 MB/s 2024-09-10T23:29:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111368 s, 94.2 MB/s 2024-09-10T23:29:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124992 s, 83.9 MB/s 2024-09-10T23:29:01.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.064 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.064 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131067 s, 80.0 MB/s 2024-09-10T23:29:01.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.078 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.078 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112901 s, 92.9 MB/s 2024-09-10T23:29:01.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.094 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.094 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116144 s, 90.3 MB/s 2024-09-10T23:29:01.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.110 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125315 s, 83.7 MB/s 2024-09-10T23:29:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.126 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116981 s, 89.6 MB/s 2024-09-10T23:29:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125142 s, 83.8 MB/s 2024-09-10T23:29:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117266 s, 89.4 MB/s 2024-09-10T23:29:01.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.173 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.173 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120508 s, 87.0 MB/s 2024-09-10T23:29:01.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.188 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.189 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112707 s, 93.0 MB/s 2024-09-10T23:29:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.203 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.204 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113203 s, 92.6 MB/s 2024-09-10T23:29:01.218 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114719 s, 91.4 MB/s 2024-09-10T23:29:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012287 s, 85.3 MB/s 2024-09-10T23:29:01.251 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.252 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.252 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013062 s, 80.3 MB/s 2024-09-10T23:29:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159532 s, 65.7 MB/s 2024-09-10T23:29:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112748 s, 93.0 MB/s 2024-09-10T23:29:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.319 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115778 s, 90.6 MB/s 2024-09-10T23:29:01.334 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.335 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.335 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01131 s, 92.7 MB/s 2024-09-10T23:29:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.351 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118594 s, 88.4 MB/s 2024-09-10T23:29:01.366 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.367 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.367 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011543 s, 90.8 MB/s 2024-09-10T23:29:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113553 s, 92.3 MB/s 2024-09-10T23:29:01.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.398 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.398 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112474 s, 93.2 MB/s 2024-09-10T23:29:01.413 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.414 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.414 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011428 s, 91.8 MB/s 2024-09-10T23:29:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131862 s, 79.5 MB/s 2024-09-10T23:29:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116451 s, 90.0 MB/s 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121978 s, 86.0 MB/s 2024-09-10T23:29:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-10T23:29:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-10T23:29:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115999 s, 90.4 MB/s 2024-09-10T23:29:01.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:29:01.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-09-10T23:29:01.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.680+0000 7f58f8000640 1 -- 172.21.15.17:0/2868858252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00cf040 msgr2=0x7f58f00cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.680+0000 7f58f8000640 1 --2- 172.21.15.17:0/2868858252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00cf040 0x7f58f00cf4d0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00aa10 tx=0x7f58dc01dc30 comp rx=0 tx=0).stop 2024-09-10T23:29:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.680+0000 7f58f8000640 1 -- 172.21.15.17:0/2868858252 shutdown_connections 2024-09-10T23:29:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.680+0000 7f58f8000640 1 --2- 172.21.15.17:0/2868858252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00cf040 0x7f58f00cf4d0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.680+0000 7f58f8000640 1 -- 172.21.15.17:0/2868858252 >> 172.21.15.17:0/2868858252 conn(0x7f58f00b17a0 msgr2=0x7f58f00b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.680+0000 7f58f8000640 1 -- 172.21.15.17:0/2868858252 shutdown_connections 2024-09-10T23:29:01.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.680+0000 7f58f8000640 1 -- 172.21.15.17:0/2868858252 wait complete. 2024-09-10T23:29:01.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.680+0000 7f58f8000640 1 Processor -- start 2024-09-10T23:29:01.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.680+0000 7f58f8000640 1 -- start start 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f8000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58f00cc730 0x7f58f013f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f8000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00cf040 0x7f58f014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f8000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f015a2a0 0x7f58f01f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f8000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58f01680b0 con 0x7f58f015a2a0 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f8000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58f0167f30 con 0x7f58f00cf040 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f8000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f58f0168230 con 0x7f58f00cc730 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f015a2a0 0x7f58f01f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f015a2a0 0x7f58f01f6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55304/0 (socket says 172.21.15.17:55304) 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f6000640 1 -- 172.21.15.17:0/3966065327 learned_addr learned my addr 172.21.15.17:0/3966065327 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f5600640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58f00cc730 0x7f58f013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f4c00640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00cf040 0x7f58f014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f6000640 1 -- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58f00cc730 msgr2=0x7f58f013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f6000640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58f00cc730 0x7f58f013f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f6000640 1 -- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00cf040 msgr2=0x7f58f014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f6000640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00cf040 0x7f58f014f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f6000640 1 -- 172.21.15.17:0/3966065327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f014f760 con 0x7f58f015a2a0 2024-09-10T23:29:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f6000640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f015a2a0 0x7f58f01f6320 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f58e800c730 tx=0x7f58e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58ed600640 1 -- 172.21.15.17:0/3966065327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8003b80 con 0x7f58f015a2a0 2024-09-10T23:29:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f014fa30 con 0x7f58f015a2a0 2024-09-10T23:29:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58ed600640 1 -- 172.21.15.17:0/3966065327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58e8003d40 con 0x7f58f015a2a0 2024-09-10T23:29:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58ed600640 1 -- 172.21.15.17:0/3966065327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e80052d0 con 0x7f58f015a2a0 2024-09-10T23:29:01.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f01f5b20 con 0x7f58f015a2a0 2024-09-10T23:29:01.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.684+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f00cf4d0 con 0x7f58f015a2a0 2024-09-10T23:29:01.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.688+0000 7f58ed600640 1 -- 172.21.15.17:0/3966065327 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f58e8005680 con 0x7f58f015a2a0 2024-09-10T23:29:01.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.688+0000 7f58ed600640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58d00725e0 0x7f58d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:01.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.688+0000 7f58ed600640 1 -- 172.21.15.17:0/3966065327 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f58e80932b0 con 0x7f58f015a2a0 2024-09-10T23:29:01.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.688+0000 7f58f5600640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58d00725e0 0x7f58d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:01.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.688+0000 7f58f5600640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58d00725e0 0x7f58d0074aa0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f58e4007fd0 tx=0x7f58e4007e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:01.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.692+0000 7f58ed600640 1 -- 172.21.15.17:0/3966065327 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f58e805e120 con 0x7f58f015a2a0 2024-09-10T23:29:01.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:01.904+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f58f00cd060 con 0x7f58f015a2a0 2024-09-10T23:29:02.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.540+0000 7f58ed600640 1 -- 172.21.15.17:0/3966065327 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v134) ==== 105+0+0 (secure 0 0 0) 0x7f58e8062b50 con 0x7f58f015a2a0 2024-09-10T23:29:02.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58d00725e0 msgr2=0x7f58d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58d00725e0 0x7f58d0074aa0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f58e4007fd0 tx=0x7f58e4007e40 comp rx=0 tx=0).stop 2024-09-10T23:29:02.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f015a2a0 msgr2=0x7f58f01f6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f015a2a0 0x7f58f01f6320 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f58e800c730 tx=0x7f58e800cbf0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 shutdown_connections 2024-09-10T23:29:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58d00725e0 0x7f58d0074aa0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f015a2a0 0x7f58f01f6320 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58f00cf040 0x7f58f014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 --2- 172.21.15.17:0/3966065327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58f00cc730 0x7f58f013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 >> 172.21.15.17:0/3966065327 conn(0x7f58f00b17a0 msgr2=0x7f58f0154aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 shutdown_connections 2024-09-10T23:29:02.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.544+0000 7f58f8000640 1 -- 172.21.15.17:0/3966065327 wait complete. 2024-09-10T23:29:02.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-10T23:29:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 -- 172.21.15.17:0/3922598391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942415a2a0 msgr2=0x7f94240b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 --2- 172.21.15.17:0/3922598391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942415a2a0 0x7f94240b2aa0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f9418009840 tx=0x7f941801c7f0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 -- 172.21.15.17:0/3922598391 shutdown_connections 2024-09-10T23:29:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 --2- 172.21.15.17:0/3922598391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94240cf750 0x7f94240cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 --2- 172.21.15.17:0/3922598391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f942415a2a0 0x7f94240b2aa0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 -- 172.21.15.17:0/3922598391 >> 172.21.15.17:0/3922598391 conn(0x7f94240b17a0 msgr2=0x7f94240b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 -- 172.21.15.17:0/3922598391 shutdown_connections 2024-09-10T23:29:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 -- 172.21.15.17:0/3922598391 wait complete. 2024-09-10T23:29:02.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 Processor -- start 2024-09-10T23:29:02.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.720+0000 7f942b800640 1 -- start start 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f942b800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94240b2fe0 0x7f94240b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f942b800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94240cf750 0x7f942415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f942b800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942415a2a0 0x7f942415a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f942b800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f94240cd470 con 0x7f94240b2fe0 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f942b800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f94240cd2f0 con 0x7f94240cf750 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f942b800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f94240cd5f0 con 0x7f942415a2a0 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9428e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94240b2fe0 0x7f94240b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9428e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94240b2fe0 0x7f94240b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55330/0 (socket says 172.21.15.17:55330) 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9428e00640 1 -- 172.21.15.17:0/1207021715 learned_addr learned my addr 172.21.15.17:0/1207021715 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9429800640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942415a2a0 0x7f942415a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9428e00640 1 -- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942415a2a0 msgr2=0x7f942415a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9428e00640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942415a2a0 0x7f942415a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9428e00640 1 -- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94240cf750 msgr2=0x7f942415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:02.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9423e00640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94240cf750 0x7f942415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9428e00640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94240cf750 0x7f942415bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:02.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9428e00640 1 -- 172.21.15.17:0/1207021715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9424073fe0 con 0x7f94240b2fe0 2024-09-10T23:29:02.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9423e00640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94240cf750 0x7f942415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:02.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9428e00640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94240b2fe0 0x7f94240b0310 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f9418009790 tx=0x7f94180a5720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:02.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9420c00640 1 -- 172.21.15.17:0/1207021715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94180bb070 con 0x7f94240b2fe0 2024-09-10T23:29:02.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9420c00640 1 -- 172.21.15.17:0/1207021715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9418005030 con 0x7f94240b2fe0 2024-09-10T23:29:02.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f9420c00640 1 -- 172.21.15.17:0/1207021715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94180b2040 con 0x7f94240b2fe0 2024-09-10T23:29:02.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942415b400 con 0x7f94240b2fe0 2024-09-10T23:29:02.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942415e560 con 0x7f94240b2fe0 2024-09-10T23:29:02.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.724+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94240cc730 con 0x7f94240b2fe0 2024-09-10T23:29:02.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.728+0000 7f9420c00640 1 -- 172.21.15.17:0/1207021715 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f94180b5030 con 0x7f94240b2fe0 2024-09-10T23:29:02.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.728+0000 7f9420c00640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:02.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.728+0000 7f9420c00640 1 -- 172.21.15.17:0/1207021715 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f941812cd60 con 0x7f94240b2fe0 2024-09-10T23:29:02.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.728+0000 7f9423e00640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:02.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.728+0000 7f9423e00640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9424164c60 tx=0x7f9410009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:02.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.732+0000 7f9420c00640 1 -- 172.21.15.17:0/1207021715 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9418016410 con 0x7f94240b2fe0 2024-09-10T23:29:02.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:02.940+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f94241571a0 con 0x7f94240b2fe0 2024-09-10T23:29:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f9420c00640 1 -- 172.21.15.17:0/1207021715 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v135) ==== 121+0+0 (secure 0 0 0) 0x7f94180f82a0 con 0x7f94240b2fe0 2024-09-10T23:29:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 msgr2=0x7f9404074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9424164c60 tx=0x7f9410009040 comp rx=0 tx=0).stop 2024-09-10T23:29:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94240b2fe0 msgr2=0x7f94240b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94240b2fe0 0x7f94240b0310 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f9418009790 tx=0x7f94180a5720 comp rx=0 tx=0).stop 2024-09-10T23:29:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 shutdown_connections 2024-09-10T23:29:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94040725e0 0x7f9404074aa0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f942415a2a0 0x7f942415a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94240cf750 0x7f942415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 --2- 172.21.15.17:0/1207021715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94240b2fe0 0x7f94240b0310 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 >> 172.21.15.17:0/1207021715 conn(0x7f94240b17a0 msgr2=0x7f94240ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 shutdown_connections 2024-09-10T23:29:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.544+0000 7f942b800640 1 -- 172.21.15.17:0/1207021715 wait complete. 2024-09-10T23:29:03.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:29:03.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.716+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3253954998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4d8005190 msgr2=0x7fe4d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.716+0000 7fe4f3e00640 1 --2- 172.21.15.17:0/3253954998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4d8005190 0x7fe4d800b9d0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40762a0 tx=0x7fe4ec01d590 comp rx=0 tx=0).stop 2024-09-10T23:29:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.716+0000 7fe4f3400640 1 -- 172.21.15.17:0/3253954998 reap_dead start 2024-09-10T23:29:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.716+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3253954998 shutdown_connections 2024-09-10T23:29:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.716+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3253954998 >> 172.21.15.17:0/3253954998 conn(0x7fe4f40b2740 msgr2=0x7fe4f40b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.716+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3253954998 shutdown_connections 2024-09-10T23:29:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.716+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3253954998 wait complete. 2024-09-10T23:29:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 Processor -- start 2024-09-10T23:29:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 -- start start 2024-09-10T23:29:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4d8005190 0x7fe4f414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f41f1d60 0x7fe4f414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f414e8f0 0x7fe4f41f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f4073990 con 0x7fe4f41f1d60 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f4073810 con 0x7fe4f414e8f0 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f4073b10 con 0x7fe4d8005190 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4ebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f41f1d60 0x7fe4f414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4ebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f41f1d60 0x7fe4f414fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55352/0 (socket says 172.21.15.17:55352) 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4ebe00640 1 -- 172.21.15.17:0/3445991496 learned_addr learned my addr 172.21.15.17:0/3445991496 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3400640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f414e8f0 0x7fe4f41f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f2a00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4d8005190 0x7fe4f414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4ebe00640 1 -- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4d8005190 msgr2=0x7fe4f414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4ebe00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4d8005190 0x7fe4f414f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4ebe00640 1 -- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f414e8f0 msgr2=0x7fe4f41f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4ebe00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f414e8f0 0x7fe4f41f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4ebe00640 1 -- 172.21.15.17:0/3445991496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f41f52e0 con 0x7fe4f41f1d60 2024-09-10T23:29:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3400640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f414e8f0 0x7fe4f41f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f2a00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4d8005190 0x7fe4f414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4ebe00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f41f1d60 0x7fe4f414fe30 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc011b40 tx=0x7fe4dc009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4eaa00640 1 -- 172.21.15.17:0/3445991496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00fd30 con 0x7fe4f41f1d60 2024-09-10T23:29:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4eaa00640 1 -- 172.21.15.17:0/3445991496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4dc004020 con 0x7fe4f41f1d60 2024-09-10T23:29:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f41f55c0 con 0x7fe4f41f1d60 2024-09-10T23:29:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4eaa00640 1 -- 172.21.15.17:0/3445991496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc004470 con 0x7fe4f41f1d60 2024-09-10T23:29:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.720+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f41f5b80 con 0x7fe4f41f1d60 2024-09-10T23:29:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.724+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f415ffe0 con 0x7fe4f41f1d60 2024-09-10T23:29:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.724+0000 7fe4eaa00640 1 -- 172.21.15.17:0/3445991496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe4dc003600 con 0x7fe4f41f1d60 2024-09-10T23:29:03.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.724+0000 7fe4eaa00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d0072610 0x7fe4d0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:03.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.724+0000 7fe4eaa00640 1 -- 172.21.15.17:0/3445991496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fe4dc093f80 con 0x7fe4f41f1d60 2024-09-10T23:29:03.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.724+0000 7fe4f2a00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d0072610 0x7fe4d0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:03.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.724+0000 7fe4f2a00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d0072610 0x7fe4d0074ad0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4001d60 tx=0x7fe4e4001c10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:03.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.728+0000 7fe4eaa00640 1 -- 172.21.15.17:0/3445991496 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe4dc05f430 con 0x7fe4f41f1d60 2024-09-10T23:29:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.940+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4f415bc70 con 0x7fe4f41f1d60 2024-09-10T23:29:03.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.940+0000 7fe4eaa00640 1 -- 172.21.15.17:0/3445991496 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5244 (secure 0 0 0) 0x7fe4dc05ed30 con 0x7fe4f41f1d60 2024-09-10T23:29:03.942 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:03.942 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":136,"btime":"2024-09-10T23:29:03:547935+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1319528493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1319528493},{"type":"v1","addr":"172.21.15.17:6833","nonce":1319528493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1685364651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1685364651},{"type":"v1","addr":"172.21.15.77:6836","nonce":1685364651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:28:34.352047+0000","modified":"2024-09-10T23:29:03.547919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10197},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9436":{"gid":9436,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/3587135392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3587135392},{"type":"v1","addr":"172.21.15.77:6837","nonce":3587135392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10197":{"gid":10197,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3849451590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3849451590},{"type":"v1","addr":"172.21.15.17:6835","nonce":3849451590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10197,"qdb_cluster":[10197]},"id":12}]} 2024-09-10T23:29:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 136 2024-09-10T23:29:03.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d0072610 msgr2=0x7fe4d0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d0072610 0x7fe4d0074ad0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4001d60 tx=0x7fe4e4001c10 comp rx=0 tx=0).stop 2024-09-10T23:29:03.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f41f1d60 msgr2=0x7fe4f414fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:03.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f41f1d60 0x7fe4f414fe30 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc011b40 tx=0x7fe4dc009f20 comp rx=0 tx=0).stop 2024-09-10T23:29:03.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 shutdown_connections 2024-09-10T23:29:03.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe4d0072610 0x7fe4d0074ad0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4f414e8f0 0x7fe4f41f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f41f1d60 0x7fe4f414fe30 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 --2- 172.21.15.17:0/3445991496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4d8005190 0x7fe4f414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:03.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 >> 172.21.15.17:0/3445991496 conn(0x7fe4f40b2740 msgr2=0x7fe4f40b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:03.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 shutdown_connections 2024-09-10T23:29:03.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:03.944+0000 7fe4f3e00640 1 -- 172.21.15.17:0/3445991496 wait complete. 2024-09-10T23:29:04.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 136, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T23:28:34.352047+0000', 'modified': '2024-09-10T23:29:03.547919+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10197}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9436': {'gid': 9436, 'name': 'd', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.77:6837/3587135392', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6835', 'nonce': 3587135392}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 3587135392}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_10197': {'gid': 10197, 'name': 'a', 'rank': 0, 'incarnation': 130, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/3849451590', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 3849451590}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 3849451590}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10197, 'qdb_cluster': [10197]} 2024-09-10T23:29:04.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:29:04.368 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T23:29:04.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 -- 172.21.15.17:0/3176779985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2c15be80 msgr2=0x7f7c2c0d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 --2- 172.21.15.17:0/3176779985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2c15be80 0x7f7c2c0d28c0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009900 tx=0x7f7c2001c820 comp rx=0 tx=0).stop 2024-09-10T23:29:04.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 -- 172.21.15.17:0/3176779985 shutdown_connections 2024-09-10T23:29:04.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 --2- 172.21.15.17:0/3176779985 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c2c0cedf0 0x7f7c2c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 --2- 172.21.15.17:0/3176779985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2c15be80 0x7f7c2c0d28c0 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 -- 172.21.15.17:0/3176779985 >> 172.21.15.17:0/3176779985 conn(0x7f7c2c0d1da0 msgr2=0x7f7c2c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 -- 172.21.15.17:0/3176779985 shutdown_connections 2024-09-10T23:29:04.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 -- 172.21.15.17:0/3176779985 wait complete. 2024-09-10T23:29:04.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 Processor -- start 2024-09-10T23:29:04.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.516+0000 7f7c34200640 1 -- start start 2024-09-10T23:29:04.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c34200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c0b5130 0x7f7c2c1fbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c34200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c2c15be80 0x7f7c2c0c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c34200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2c1fb4a0 0x7f7c2c153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c34200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c168d40 con 0x7f7c2c1fb4a0 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c34200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c160320 con 0x7f7c2c0b5130 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c34200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2c168ec0 con 0x7f7c2c15be80 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c32200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2c1fb4a0 0x7f7c2c153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c31800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c0b5130 0x7f7c2c1fbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c31800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c0b5130 0x7f7c2c1fbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:52592/0 (socket says 172.21.15.17:52592) 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c31800640 1 -- 172.21.15.17:0/1186709345 learned_addr learned my addr 172.21.15.17:0/1186709345 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c30e00640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c2c15be80 0x7f7c2c0c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c31800640 1 -- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c2c15be80 msgr2=0x7f7c2c0c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c31800640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c2c15be80 0x7f7c2c0c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c31800640 1 -- 172.21.15.17:0/1186709345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2c1fb4a0 msgr2=0x7f7c2c153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c31800640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2c1fb4a0 0x7f7c2c153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c31800640 1 -- 172.21.15.17:0/1186709345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c1fc310 con 0x7f7c2c0b5130 2024-09-10T23:29:04.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c32200640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2c1fb4a0 0x7f7c2c153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:04.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c31800640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c0b5130 0x7f7c2c1fbdd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7c200b0040 tx=0x7f7c20005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c29600640 1 -- 172.21.15.17:0/1186709345 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200ba020 con 0x7f7c2c0b5130 2024-09-10T23:29:04.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c29600640 1 -- 172.21.15.17:0/1186709345 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c200044b0 con 0x7f7c2c0b5130 2024-09-10T23:29:04.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c29600640 1 -- 172.21.15.17:0/1186709345 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200b2040 con 0x7f7c2c0b5130 2024-09-10T23:29:04.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c34200640 1 -- 172.21.15.17:0/1186709345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2c06ea90 con 0x7f7c2c0b5130 2024-09-10T23:29:04.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.520+0000 7f7c34200640 1 -- 172.21.15.17:0/1186709345 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2c06f050 con 0x7f7c2c0b5130 2024-09-10T23:29:04.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c29600640 1 -- 172.21.15.17:0/1186709345 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7c20003840 con 0x7f7c2c0b5130 2024-09-10T23:29:04.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c37524000 1 Processor -- start 2024-09-10T23:29:04.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c29600640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c0c0725e0 0x7f7c0c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c29600640 1 -- 172.21.15.17:0/1186709345 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f7c2012d010 con 0x7f7c2c0b5130 2024-09-10T23:29:04.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c37524000 1 -- start start 2024-09-10T23:29:04.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c32200640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c0c0725e0 0x7f7c0c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c32200640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c0c0725e0 0x7f7c0c074aa0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c1fb8c0 tx=0x7f7c24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c37524000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac09d0 0x55b013ac0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c37524000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac12f0 0x55b013a748d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c37524000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013a74e10 0x55b013a751f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c37524000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b0139953f0 con 0x55b013ac09d0 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c37524000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b0138d2b20 con 0x55b013ac12f0 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c37524000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b0138c1f50 con 0x55b013a74e10 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c31800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac09d0 0x55b013ac0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c31800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac09d0 0x55b013ac0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55374/0 (socket says 172.21.15.17:55374) 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c31800640 1 -- 172.21.15.17:0/1733536024 learned_addr learned my addr 172.21.15.17:0/1733536024 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c31800640 1 -- 172.21.15.17:0/1733536024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013a74e10 msgr2=0x55b013a751f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c31800640 1 --2- 172.21.15.17:0/1733536024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013a74e10 0x55b013a751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c31800640 1 -- 172.21.15.17:0/1733536024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac12f0 msgr2=0x55b013a748d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c31800640 1 --2- 172.21.15.17:0/1733536024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac12f0 0x55b013a748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c31800640 1 -- 172.21.15.17:0/1733536024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b013889590 con 0x55b013ac09d0 2024-09-10T23:29:04.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c31800640 1 --2- 172.21.15.17:0/1733536024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac09d0 0x55b013ac0db0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f7c200f7ed0 tx=0x7f7c200f7890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca359cfbe2f8048 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c1e000640 1 -- 172.21.15.17:0/1733536024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200f7f40 con 0x55b013ac09d0 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c1e000640 1 -- 172.21.15.17:0/1733536024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c200fc970 con 0x55b013ac09d0 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.524+0000 7f7c1e000640 1 -- 172.21.15.17:0/1733536024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20101390 con 0x55b013ac09d0 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- 172.21.15.17:0/1733536024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac09d0 msgr2=0x55b013ac0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 --2- 172.21.15.17:0/1733536024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac09d0 0x55b013ac0db0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f7c200f7ed0 tx=0x7f7c200f7890 comp rx=0 tx=0).stop 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- 172.21.15.17:0/1733536024 shutdown_connections 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 --2- 172.21.15.17:0/1733536024 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013a74e10 0x55b013a751f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 --2- 172.21.15.17:0/1733536024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac12f0 0x55b013a748d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 --2- 172.21.15.17:0/1733536024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac09d0 0x55b013ac0db0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- 172.21.15.17:0/1733536024 >> 172.21.15.17:0/1733536024 conn(0x55b01395e130 msgr2=0x55b013aa3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- 172.21.15.17:0/1733536024 shutdown_connections 2024-09-10T23:29:04.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- 172.21.15.17:0/1733536024 wait complete. 2024-09-10T23:29:04.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- start start 2024-09-10T23:29:04.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 Processor -- start 2024-09-10T23:29:04.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013aa16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac09d0 0x55b013aa1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac12f0 0x55b013aa23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b01385c5d0 con 0x55b013a74e10 2024-09-10T23:29:04.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b0138c5d60 con 0x55b013ac09d0 2024-09-10T23:29:04.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b013868500 con 0x55b013ac12f0 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 10 client.0 _ll_register_callbacks cb 0x55b01386c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c31800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013aa16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c31800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013aa16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55382/0 (socket says 172.21.15.17:55382) 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c31800640 1 -- 172.21.15.17:0/2758317310 learned_addr learned my addr 172.21.15.17:0/2758317310 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c32200640 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac12f0 0x55b013aa23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c30e00640 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac09d0 0x55b013aa1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c31800640 1 -- 172.21.15.17:0/2758317310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac12f0 msgr2=0x55b013aa23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c31800640 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac12f0 0x55b013aa23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c31800640 1 -- 172.21.15.17:0/2758317310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac09d0 msgr2=0x55b013aa1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c31800640 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac09d0 0x55b013aa1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c31800640 1 -- 172.21.15.17:0/2758317310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b013860170 con 0x55b013a74e10 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c30e00640 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac09d0 0x55b013aa1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:04.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c31800640 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013aa16a0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f7c2001cd90 tx=0x7f7c200095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2963fb262262db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c12a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c12a00640 1 -- 172.21.15.17:0/2758317310 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20101100 con 0x55b013a74e10 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c12a00640 1 -- 172.21.15.17:0/2758317310 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f7c200f71a0 con 0x55b013a74e10 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- 172.21.15.17:0/2758317310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b01385a0f0 con 0x55b013a74e10 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c12a00640 1 -- 172.21.15.17:0/2758317310 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f7c2012b050 con 0x55b013a74e10 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 10 client.10395 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c37524000 1 -- 172.21.15.17:0/2758317310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55b013946ef0 con 0x55b013a74e10 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.528+0000 7f7c12a00640 1 -- 172.21.15.17:0/2758317310 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b01385a0f0 con 0x55b013a74e10 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c12a00640 1 -- 172.21.15.17:0/2758317310 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f7c20003b60 con 0x55b013a74e10 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 10 client.10395 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 10 client.10395 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 20 client.10395 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55b013aa30f0 0x55b013ad2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 4 client.10395 mds_command: new command op to 10197 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:04.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 -- 172.21.15.17:0/2758317310 --> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0138d4a70 con 0x55b013aa30f0 2024-09-10T23:29:04.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c30e00640 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55b013aa30f0 0x55b013ad2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c30e00640 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55b013aa30f0 0x55b013ad2c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2441597a6badf3c0 server_cookie=50d19a3a9e83dde8 in_seq=0 out_seq=0 2024-09-10T23:29:04.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c12a00640 10 client.10395 ms_handle_connect on v2:172.21.15.17:6834/3849451590 2024-09-10T23:29:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c12a00640 1 -- 172.21.15.17:0/2758317310 <== mds.0 v2:172.21.15.17:6834/3849451590 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0138d4a70 con 0x55b013aa30f0 2024-09-10T23:29:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c12a00640 10 client.10395 handle_command_reply: tid=0 2024-09-10T23:29:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 client.10395 shutdown 2024-09-10T23:29:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 -- 172.21.15.17:0/2758317310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 msgr2=0x55b013aa16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013aa16a0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f7c2001cd90 tx=0x7f7c200095f0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 -- 172.21.15.17:0/2758317310 shutdown_connections 2024-09-10T23:29:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55b013aa30f0 0x55b013ad2c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac12f0 0x55b013aa23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac09d0 0x55b013aa1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 --2- 172.21.15.17:0/2758317310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013aa16a0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c12a00640 0 client.10395 ms_handle_reset on v2:172.21.15.17:6834/3849451590 2024-09-10T23:29:04.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 -- 172.21.15.17:0/2758317310 >> 172.21.15.17:0/2758317310 conn(0x55b01395e130 msgr2=0x55b013a73fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 -- 172.21.15.17:0/2758317310 shutdown_connections 2024-09-10T23:29:04.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 1 -- 172.21.15.17:0/2758317310 wait complete. 2024-09-10T23:29:04.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.532+0000 7f7c37524000 20 client.10395 trim_cache size 0 max 16384 2024-09-10T23:29:04.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.552+0000 7f7c37524000 1 Processor -- start 2024-09-10T23:29:04.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.552+0000 7f7c37524000 1 -- start start 2024-09-10T23:29:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013a74e10 0x55b013b32dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 0x55b013b33310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac12f0 0x55b013b33850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c203cd0 con 0x55b013ac12f0 2024-09-10T23:29:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c2043a0 con 0x55b013a74e10 2024-09-10T23:29:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2c202780 con 0x55b013ac09d0 2024-09-10T23:29:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c32200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac12f0 0x55b013b33850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c32200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac12f0 0x55b013b33850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55392/0 (socket says 172.21.15.17:55392) 2024-09-10T23:29:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c31800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013a74e10 0x55b013b32dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c32200640 1 -- 172.21.15.17:0/3016371673 learned_addr learned my addr 172.21.15.17:0/3016371673 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c30e00640 1 --2- 172.21.15.17:0/3016371673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 0x55b013b33310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c32200640 1 -- 172.21.15.17:0/3016371673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 msgr2=0x55b013b33310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c32200640 1 --2- 172.21.15.17:0/3016371673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 0x55b013b33310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c32200640 1 -- 172.21.15.17:0/3016371673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013a74e10 msgr2=0x55b013b32dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c32200640 1 --2- 172.21.15.17:0/3016371673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013a74e10 0x55b013b32dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c32200640 1 -- 172.21.15.17:0/3016371673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01391dd90 con 0x55b013ac12f0 2024-09-10T23:29:04.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c32200640 1 --2- 172.21.15.17:0/3016371673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac12f0 0x55b013b33850 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400ff60 tx=0x7f7c24012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c795ddbf61d6683 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c1d600640 1 -- 172.21.15.17:0/3016371673 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c240135c0 con 0x55b013ac12f0 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c1d600640 1 -- 172.21.15.17:0/3016371673 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c24026070 con 0x55b013ac12f0 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c1d600640 1 -- 172.21.15.17:0/3016371673 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24013890 con 0x55b013ac12f0 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 -- 172.21.15.17:0/3016371673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac12f0 msgr2=0x55b013b33850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 --2- 172.21.15.17:0/3016371673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac12f0 0x55b013b33850 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400ff60 tx=0x7f7c24012000 comp rx=0 tx=0).stop 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 -- 172.21.15.17:0/3016371673 shutdown_connections 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 --2- 172.21.15.17:0/3016371673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013ac12f0 0x55b013b33850 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 --2- 172.21.15.17:0/3016371673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 0x55b013b33310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 --2- 172.21.15.17:0/3016371673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013a74e10 0x55b013b32dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 -- 172.21.15.17:0/3016371673 >> 172.21.15.17:0/3016371673 conn(0x55b01395e130 msgr2=0x55b013a7cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 -- 172.21.15.17:0/3016371673 shutdown_connections 2024-09-10T23:29:04.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.556+0000 7f7c37524000 1 -- 172.21.15.17:0/3016371673 wait complete. 2024-09-10T23:29:04.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 -- start start 2024-09-10T23:29:04.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 Processor -- start 2024-09-10T23:29:04.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013b369f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 0x55b013b36f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac12f0 0x55b013b37470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b013868500 con 0x55b013a74e10 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c202dd0 con 0x55b013ac12f0 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b01385c5d0 con 0x55b013ac09d0 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 10 client.0 _ll_register_callbacks cb 0x7f7c200f3e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c31800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013b369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c31800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013b369f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55404/0 (socket says 172.21.15.17:55404) 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c31800640 1 -- 172.21.15.17:0/1176604484 learned_addr learned my addr 172.21.15.17:0/1176604484 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c30e00640 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 0x55b013b36f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c32200640 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac12f0 0x55b013b37470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c31800640 1 -- 172.21.15.17:0/1176604484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 msgr2=0x55b013b36f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c31800640 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 0x55b013b36f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c31800640 1 -- 172.21.15.17:0/1176604484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac12f0 msgr2=0x55b013b37470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c31800640 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac12f0 0x55b013b37470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c31800640 1 -- 172.21.15.17:0/1176604484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b013888a90 con 0x55b013a74e10 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c31800640 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013b369f0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f7c200f7f60 tx=0x7f7c201011b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2284c947ed9da8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c12a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c12a00640 1 -- 172.21.15.17:0/1176604484 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200f76b0 con 0x55b013a74e10 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c12a00640 1 -- 172.21.15.17:0/1176604484 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f7c2011cc70 con 0x55b013a74e10 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 -- 172.21.15.17:0/1176604484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c24026070 con 0x55b013a74e10 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c12a00640 1 -- 172.21.15.17:0/1176604484 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f7c2011ce70 con 0x55b013a74e10 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 10 client.10401 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 -- 172.21.15.17:0/1176604484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55b013867050 con 0x55b013a74e10 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c12a00640 1 -- 172.21.15.17:0/1176604484 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c24026070 con 0x55b013a74e10 2024-09-10T23:29:04.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c12a00640 1 -- 172.21.15.17:0/1176604484 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f7c201240b0 con 0x55b013a74e10 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 10 client.10401 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 10 client.10401 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 20 client.10401 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55b013ad5390 0x55b013ad5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 4 client.10401 mds_command: new command op to 10197 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c37524000 1 -- 172.21.15.17:0/1176604484 --> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] -- command(tid 0: {"prefix": "status"}) -- 0x55b0138d0520 con 0x55b013ad5390 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c30e00640 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55b013ad5390 0x55b013ad5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c30e00640 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55b013ad5390 0x55b013ad5770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d6793ba808a89d1 server_cookie=439d0fc16a779cbd in_seq=0 out_seq=0 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.560+0000 7f7c12a00640 10 client.10401 ms_handle_connect on v2:172.21.15.17:6834/3849451590 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c12a00640 1 -- 172.21.15.17:0/1176604484 <== mds.0 v2:172.21.15.17:6834/3849451590 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55b0138d0520 con 0x55b013ad5390 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c12a00640 10 client.10401 handle_command_reply: tid=0 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 client.10401 shutdown 2024-09-10T23:29:04.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 -- 172.21.15.17:0/1176604484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 msgr2=0x55b013b369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013b369f0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f7c200f7f60 tx=0x7f7c201011b0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 -- 172.21.15.17:0/1176604484 shutdown_connections 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.17:6834/3849451590,v1:172.21.15.17:6835/3849451590] conn(0x55b013ad5390 0x55b013ad5770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b013ac12f0 0x55b013b37470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b013ac09d0 0x55b013b36f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c12a00640 0 client.10401 ms_handle_reset on v2:172.21.15.17:6834/3849451590 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 --2- 172.21.15.17:0/1176604484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b013a74e10 0x55b013b369f0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 -- 172.21.15.17:0/1176604484 >> 172.21.15.17:0/1176604484 conn(0x55b01395e130 msgr2=0x55b013abf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 -- 172.21.15.17:0/1176604484 shutdown_connections 2024-09-10T23:29:04.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 1 -- 172.21.15.17:0/1176604484 wait complete. 2024-09-10T23:29:04.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c37524000 20 client.10401 trim_cache size 0 max 16384 2024-09-10T23:29:04.569 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:29:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:29:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:29:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 10197, 2024-09-10T23:29:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:29:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:29:04.569 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:29:04.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 29.593821414000001, 2024-09-10T23:29:04.570 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 136, 2024-09-10T23:29:04.570 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 177, 2024-09-10T23:29:04.570 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 177, 2024-09-10T23:29:04.570 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 34.088362945 2024-09-10T23:29:04.570 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 -- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c0c0725e0 msgr2=0x7f7c0c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c0c0725e0 0x7f7c0c074aa0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c1fb8c0 tx=0x7f7c24009040 comp rx=0 tx=0).stop 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 -- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c0b5130 msgr2=0x7f7c2c1fbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c0b5130 0x7f7c2c1fbdd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7c200b0040 tx=0x7f7c20005770 comp rx=0 tx=0).stop 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 -- 172.21.15.17:0/1186709345 shutdown_connections 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7c0c0725e0 0x7f7c0c074aa0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2c1fb4a0 0x7f7c2c153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c2c15be80 0x7f7c2c0c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 --2- 172.21.15.17:0/1186709345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c2c0b5130 0x7f7c2c1fbdd0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 -- 172.21.15.17:0/1186709345 >> 172.21.15.17:0/1186709345 conn(0x7f7c2c0d1da0 msgr2=0x7f7c2c159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 -- 172.21.15.17:0/1186709345 shutdown_connections 2024-09-10T23:29:04.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.564+0000 7f7c34200640 1 -- 172.21.15.17:0/1186709345 wait complete. 2024-09-10T23:29:04.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d scrub start /scrub_control_test_path recursive 2024-09-10T23:29:04.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 -- 172.21.15.17:0/1001360325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f474c004d50 msgr2=0x7f474c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 --2- 172.21.15.17:0/1001360325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f474c004d50 0x7f474c0051d0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f4760009eb0 tx=0x7f476001d5b0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f4767e00640 1 -- 172.21.15.17:0/1001360325 reap_dead start 2024-09-10T23:29:04.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 -- 172.21.15.17:0/1001360325 shutdown_connections 2024-09-10T23:29:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 -- 172.21.15.17:0/1001360325 >> 172.21.15.17:0/1001360325 conn(0x7f47680b17a0 msgr2=0x7f47680b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 -- 172.21.15.17:0/1001360325 shutdown_connections 2024-09-10T23:29:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 -- 172.21.15.17:0/1001360325 wait complete. 2024-09-10T23:29:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 Processor -- start 2024-09-10T23:29:04.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 -- start start 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f474c004d50 0x7f47681f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4768150cf0 0x7f476814ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476814f1a0 0x7f476813cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f476815a800 con 0x7f476814f1a0 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f476815a680 con 0x7f4768150cf0 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f476e600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f47680cf750 con 0x7f474c004d50 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f4767e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476814f1a0 0x7f476813cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f4767e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476814f1a0 0x7f476813cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55416/0 (socket says 172.21.15.17:55416) 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f4767e00640 1 -- 172.21.15.17:0/2456640373 learned_addr learned my addr 172.21.15.17:0/2456640373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f4767400640 1 --2- 172.21.15.17:0/2456640373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f474c004d50 0x7f47681f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.736+0000 7f475fe00640 1 --2- 172.21.15.17:0/2456640373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4768150cf0 0x7f476814ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f4767e00640 1 -- 172.21.15.17:0/2456640373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f474c004d50 msgr2=0x7f47681f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f4767e00640 1 --2- 172.21.15.17:0/2456640373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f474c004d50 0x7f47681f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f4767e00640 1 -- 172.21.15.17:0/2456640373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4768150cf0 msgr2=0x7f476814ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f4767e00640 1 --2- 172.21.15.17:0/2456640373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4768150cf0 0x7f476814ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f4767e00640 1 -- 172.21.15.17:0/2456640373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4768076aa0 con 0x7f476814f1a0 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f4767e00640 1 --2- 172.21.15.17:0/2456640373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476814f1a0 0x7f476813cd80 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f4760009eb0 tx=0x7f4760009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f475f400640 1 -- 172.21.15.17:0/2456640373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760009200 con 0x7f476814f1a0 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f475f400640 1 -- 172.21.15.17:0/2456640373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47600a94f0 con 0x7f476814f1a0 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f476e600640 1 -- 172.21.15.17:0/2456640373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47681f5a30 con 0x7f476814f1a0 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f475f400640 1 -- 172.21.15.17:0/2456640373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760003ba0 con 0x7f476814f1a0 2024-09-10T23:29:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f476e600640 1 -- 172.21.15.17:0/2456640373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47680c9e70 con 0x7f476814f1a0 2024-09-10T23:29:04.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f475f400640 1 -- 172.21.15.17:0/2456640373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f47600a96a0 con 0x7f476814f1a0 2024-09-10T23:29:04.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f475f400640 1 --2- 172.21.15.17:0/2456640373 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47440725e0 0x7f4744074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.740+0000 7f475f400640 1 -- 172.21.15.17:0/2456640373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f476012df50 con 0x7f476814f1a0 2024-09-10T23:29:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767400640 1 --2- 172.21.15.17:0/2456640373 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47440725e0 0x7f4744074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 Processor -- start 2024-09-10T23:29:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- start start 2024-09-10T23:29:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767400640 1 --2- 172.21.15.17:0/2456640373 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47440725e0 0x7f4744074aa0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4758001060 tx=0x7f4758006730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b3403d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403d6b0 0x558b33ff0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b33ff1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558b33e4edb0 con 0x558b33ff0c40 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558b33e3e1e0 con 0x558b3403cd90 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558b33e41ff0 con 0x558b3403d6b0 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b33ff1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b3403d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b3403d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:52650/0 (socket says 172.21.15.17:52650) 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767400640 1 -- 172.21.15.17:0/2526232890 learned_addr learned my addr 172.21.15.17:0/2526232890 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f475fe00640 1 --2- 172.21.15.17:0/2526232890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403d6b0 0x558b33ff0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767e00640 1 -- 172.21.15.17:0/2526232890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403d6b0 msgr2=0x558b33ff0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767e00640 1 --2- 172.21.15.17:0/2526232890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403d6b0 0x558b33ff0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767e00640 1 -- 172.21.15.17:0/2526232890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 msgr2=0x558b3403d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767e00640 1 --2- 172.21.15.17:0/2526232890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b3403d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767e00640 1 -- 172.21.15.17:0/2526232890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b33df77a0 con 0x558b33ff0c40 2024-09-10T23:29:04.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4767e00640 1 --2- 172.21.15.17:0/2526232890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b33ff1020 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f476012c250 tx=0x7f47600f8490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93058db4575d3b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4757e00640 1 -- 172.21.15.17:0/2526232890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47600c0070 con 0x558b33ff0c40 2024-09-10T23:29:04.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4757e00640 1 -- 172.21.15.17:0/2526232890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4760102200 con 0x558b33ff0c40 2024-09-10T23:29:04.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4757e00640 1 -- 172.21.15.17:0/2526232890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47600f7f80 con 0x558b33ff0c40 2024-09-10T23:29:04.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- 172.21.15.17:0/2526232890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 msgr2=0x558b33ff1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 --2- 172.21.15.17:0/2526232890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b33ff1020 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f476012c250 tx=0x7f47600f8490 comp rx=0 tx=0).stop 2024-09-10T23:29:04.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- 172.21.15.17:0/2526232890 shutdown_connections 2024-09-10T23:29:04.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 --2- 172.21.15.17:0/2526232890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b33ff1020 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 --2- 172.21.15.17:0/2526232890 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403d6b0 0x558b33ff0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 --2- 172.21.15.17:0/2526232890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b3403d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- 172.21.15.17:0/2526232890 >> 172.21.15.17:0/2526232890 conn(0x558b3401de50 msgr2=0x558b34020240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- 172.21.15.17:0/2526232890 shutdown_connections 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- 172.21.15.17:0/2526232890 wait complete. 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 -- start start 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.744+0000 7f4771acc000 1 Processor -- start 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b3401d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403cd90 0x558b33ff8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403d6b0 0x558b33ff8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558b33b035b0 con 0x558b33ff0c40 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558b33dd89a0 con 0x558b3403d6b0 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558b33df3cd0 con 0x558b3403cd90 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 10 client.0 _ll_register_callbacks cb 0x558b33de4870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b3401d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b3401d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55432/0 (socket says 172.21.15.17:55432) 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767400640 1 -- 172.21.15.17:0/1023236000 learned_addr learned my addr 172.21.15.17:0/1023236000 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f475fe00640 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403cd90 0x558b33ff8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767e00640 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403d6b0 0x558b33ff8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767400640 1 -- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403cd90 msgr2=0x558b33ff8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767400640 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403cd90 0x558b33ff8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767400640 1 -- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403d6b0 msgr2=0x558b33ff8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767400640 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403d6b0 0x558b33ff8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767400640 1 -- 172.21.15.17:0/1023236000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b33dfe2c0 con 0x558b33ff0c40 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4767400640 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b3401d470 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f4758001b40 tx=0x7f47680b39d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e89fc6cd0312a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4754c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4754c00640 1 -- 172.21.15.17:0/1023236000 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758021850 con 0x558b33ff0c40 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4754c00640 1 -- 172.21.15.17:0/1023236000 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f475800a030 con 0x558b33ff0c40 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 -- 172.21.15.17:0/1023236000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558b33dd6630 con 0x558b33ff0c40 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4754c00640 1 -- 172.21.15.17:0/1023236000 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f4758033050 con 0x558b33ff0c40 2024-09-10T23:29:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 10 client.10413 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 -- 172.21.15.17:0/1023236000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x558b33dfe4c0 con 0x558b33ff0c40 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4754c00640 1 -- 172.21.15.17:0/1023236000 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558b33dd6630 con 0x558b33ff0c40 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4754c00640 1 -- 172.21.15.17:0/1023236000 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f47580219f0 con 0x558b33ff0c40 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 10 client.10413 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 10 client.10413 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 20 client.10413 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x558b3401f750 0x558b3401fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 4 client.10413 mds_command: new command op to 9436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4771acc000 1 -- 172.21.15.17:0/1023236000 --> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b33e50d00 con 0x558b3401f750 2024-09-10T23:29:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f475fe00640 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x558b3401f750 0x558b3401fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f475fe00640 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x558b3401f750 0x558b3401fb30 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9436 client_cookie=56cb23a889f8e7d5 server_cookie=bf42501db82d540c in_seq=0 out_seq=0 2024-09-10T23:29:04.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.748+0000 7f4754c00640 10 client.10413 ms_handle_connect on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:04.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4754c00640 1 -- 172.21.15.17:0/1023236000 <== mds.9436 v2:172.21.15.77:6835/3587135392 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b33e50d00 con 0x558b3401f750 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4754c00640 10 client.10413 handle_command_reply: tid=0 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 client.10413 shutdown 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 -- 172.21.15.17:0/1023236000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 msgr2=0x558b3401d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b3401d470 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f4758001b40 tx=0x7f47680b39d0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 -- 172.21.15.17:0/1023236000 shutdown_connections 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x558b3401f750 0x558b3401fb30 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403d6b0 0x558b33ff8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3403cd90 0x558b33ff8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 --2- 172.21.15.17:0/1023236000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b33ff0c40 0x558b3401d470 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4754c00640 0 client.10413 ms_handle_reset on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 -- 172.21.15.17:0/1023236000 >> 172.21.15.17:0/1023236000 conn(0x558b3401de50 msgr2=0x558b33fefe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 -- 172.21.15.17:0/1023236000 shutdown_connections 2024-09-10T23:29:04.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 1 -- 172.21.15.17:0/1023236000 wait complete. 2024-09-10T23:29:04.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.752+0000 7f4771acc000 20 client.10413 trim_cache size 0 max 16384 2024-09-10T23:29:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.768+0000 7f4771acc000 1 Processor -- start 2024-09-10T23:29:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.768+0000 7f4771acc000 1 -- start start 2024-09-10T23:29:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3401de50 0x558b340b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b33ff0c40 0x558b340b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b340b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4768201bc0 con 0x558b3401de50 2024-09-10T23:29:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f47681f8b80 con 0x558b3403cd90 2024-09-10T23:29:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4768200550 con 0x558b33ff0c40 2024-09-10T23:29:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3401de50 0x558b340b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3401de50 0x558b340b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55446/0 (socket says 172.21.15.17:55446) 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767400640 1 -- 172.21.15.17:0/1419721025 learned_addr learned my addr 172.21.15.17:0/1419721025 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767e00640 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b340b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f475fe00640 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b33ff0c40 0x558b340b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767400640 1 -- 172.21.15.17:0/1419721025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b33ff0c40 msgr2=0x558b340b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767400640 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b33ff0c40 0x558b340b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767400640 1 -- 172.21.15.17:0/1419721025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 msgr2=0x558b340b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767400640 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b340b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767400640 1 -- 172.21.15.17:0/1419721025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b33ddc520 con 0x558b3401de50 2024-09-10T23:29:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767e00640 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b340b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4767400640 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3401de50 0x558b340b0290 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f4758013fc0 tx=0x7f4758004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a40158c42dba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4757400640 1 -- 172.21.15.17:0/1419721025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475803b070 con 0x558b3401de50 2024-09-10T23:29:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4757400640 1 -- 172.21.15.17:0/1419721025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4758021850 con 0x558b3401de50 2024-09-10T23:29:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4757400640 1 -- 172.21.15.17:0/1419721025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475802b430 con 0x558b3401de50 2024-09-10T23:29:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 -- 172.21.15.17:0/1419721025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3401de50 msgr2=0x558b340b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3401de50 0x558b340b0290 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f4758013fc0 tx=0x7f4758004540 comp rx=0 tx=0).stop 2024-09-10T23:29:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 -- 172.21.15.17:0/1419721025 shutdown_connections 2024-09-10T23:29:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b3403cd90 0x558b340b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b33ff0c40 0x558b340b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 --2- 172.21.15.17:0/1419721025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3401de50 0x558b340b0290 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 -- 172.21.15.17:0/1419721025 >> 172.21.15.17:0/1419721025 conn(0x558b33ff5600 msgr2=0x558b3401ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 -- 172.21.15.17:0/1419721025 shutdown_connections 2024-09-10T23:29:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 -- 172.21.15.17:0/1419721025 wait complete. 2024-09-10T23:29:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 -- start start 2024-09-10T23:29:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 Processor -- start 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b33ff0c40 0x558b340b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.772+0000 7f4771acc000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3401de50 0x558b340b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3403cd90 0x558b340b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558b33e4db80 con 0x558b3403cd90 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558b33efd550 con 0x558b33ff0c40 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558b33e41300 con 0x558b3401de50 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 10 client.0 _ll_register_callbacks cb 0x7f47580045e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3403cd90 0x558b340b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b33ff0c40 0x558b340b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3403cd90 0x558b340b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55448/0 (socket says 172.21.15.17:55448) 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f475fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3401de50 0x558b340b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767e00640 1 -- 172.21.15.17:0/23573325 learned_addr learned my addr 172.21.15.17:0/23573325 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767e00640 1 -- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3401de50 msgr2=0x558b340b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767e00640 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3401de50 0x558b340b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767e00640 1 -- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b33ff0c40 msgr2=0x558b340b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767e00640 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b33ff0c40 0x558b340b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767e00640 1 -- 172.21.15.17:0/23573325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b33ec27f0 con 0x558b3403cd90 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767e00640 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3403cd90 0x558b340b4300 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f47600990e0 tx=0x7f476012c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d17b5ef6b313b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 1 -- 172.21.15.17:0/23573325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760121070 con 0x558b3403cd90 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 1 -- 172.21.15.17:0/23573325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f47600f4670 con 0x558b3403cd90 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- 172.21.15.17:0/23573325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4758021850 con 0x558b3403cd90 2024-09-10T23:29:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 1 -- 172.21.15.17:0/23573325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f47600c0040 con 0x558b3403cd90 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 10 client.10419 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- 172.21.15.17:0/23573325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x558b33de3400 con 0x558b3403cd90 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 1 -- 172.21.15.17:0/23573325 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4758021850 con 0x558b3403cd90 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 1 -- 172.21.15.17:0/23573325 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f4760124030 con 0x558b3403cd90 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 10 client.10419 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 10 client.10419 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 20 client.10419 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x558b3403d6b0 0x558b34053210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 4 client.10419 mds_command: new command op to 9436 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- 172.21.15.17:0/23573325 --> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x558b33e4c7b0 con 0x558b3403d6b0 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767400640 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x558b3403d6b0 0x558b34053210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 10 client.10419 ms_handle_connect on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4767400640 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x558b3403d6b0 0x558b34053210 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9436 client_cookie=6bdaf1e8b7159d95 server_cookie=5def400494ecfac in_seq=0 out_seq=0 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 1 -- 172.21.15.17:0/23573325 <== mds.9436 v2:172.21.15.77:6835/3587135392 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x558b33e4c7b0 con 0x558b3403d6b0 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 10 client.10419 handle_command_reply: tid=0 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 client.10419 shutdown 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- 172.21.15.17:0/23573325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3403cd90 msgr2=0x558b340b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3403cd90 0x558b340b4300 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f47600990e0 tx=0x7f476012c120 comp rx=0 tx=0).stop 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- 172.21.15.17:0/23573325 shutdown_connections 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x558b3403d6b0 0x558b34053210 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b3403cd90 0x558b340b4300 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558b3401de50 0x558b340b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4754c00640 0 client.10419 ms_handle_reset on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 --2- 172.21.15.17:0/23573325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558b33ff0c40 0x558b340b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- 172.21.15.17:0/23573325 >> 172.21.15.17:0/23573325 conn(0x558b33ff5600 msgr2=0x558b3403bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- 172.21.15.17:0/23573325 shutdown_connections 2024-09-10T23:29:04.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 1 -- 172.21.15.17:0/23573325 wait complete. 2024-09-10T23:29:04.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.776+0000 7f4771acc000 20 client.10419 trim_cache size 0 max 16384 2024-09-10T23:29:04.783 INFO:teuthology.orchestra.run.smithi017.stderr:Error EINVAL: MDS is not active 2024-09-10T23:29:04.785 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T23:29:04.786 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d scrub pause 2024-09-10T23:29:04.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.932+0000 7fd1ef000640 1 -- 172.21.15.17:0/2616971739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e81457c0 msgr2=0x7fd1e806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.932+0000 7fd1ef000640 1 --2- 172.21.15.17:0/2616971739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e81457c0 0x7fd1e806e6f0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009840 tx=0x7fd1d801c700 comp rx=0 tx=0).stop 2024-09-10T23:29:04.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.932+0000 7fd1ef000640 1 -- 172.21.15.17:0/2616971739 shutdown_connections 2024-09-10T23:29:04.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.932+0000 7fd1ef000640 1 --2- 172.21.15.17:0/2616971739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e81457c0 0x7fd1e806e6f0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.932+0000 7fd1ef000640 1 -- 172.21.15.17:0/2616971739 >> 172.21.15.17:0/2616971739 conn(0x7fd1e80b17a0 msgr2=0x7fd1e80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.932+0000 7fd1ef000640 1 -- 172.21.15.17:0/2616971739 shutdown_connections 2024-09-10T23:29:04.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.932+0000 7fd1ef000640 1 -- 172.21.15.17:0/2616971739 wait complete. 2024-09-10T23:29:04.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.932+0000 7fd1ef000640 1 Processor -- start 2024-09-10T23:29:04.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ef000640 1 -- start start 2024-09-10T23:29:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ef000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1e80741d0 0x7fd1e8140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ef000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1e8074660 0x7fd1e80d0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ef000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e81457c0 0x7fd1e80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ef000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8073a60 con 0x7fd1e81457c0 2024-09-10T23:29:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ef000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e80738e0 con 0x7fd1e8074660 2024-09-10T23:29:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ef000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e8160100 con 0x7fd1e80741d0 2024-09-10T23:29:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ed000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e81457c0 0x7fd1e80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ed000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e81457c0 0x7fd1e80d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55460/0 (socket says 172.21.15.17:55460) 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ed000640 1 -- 172.21.15.17:0/3197086621 learned_addr learned my addr 172.21.15.17:0/3197086621 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1e80741d0 0x7fd1e8140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1df400640 1 --2- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1e8074660 0x7fd1e80d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ed000640 1 -- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1e80741d0 msgr2=0x7fd1e8140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ed000640 1 --2- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1e80741d0 0x7fd1e8140400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ed000640 1 -- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1e8074660 msgr2=0x7fd1e80d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ed000640 1 --2- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1e8074660 0x7fd1e80d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ed000640 1 -- 172.21.15.17:0/3197086621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e81f7cf0 con 0x7fd1e81457c0 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1df400640 1 --2- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1e8074660 0x7fd1e80d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ed000640 1 --2- 172.21.15.17:0/3197086621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e81457c0 0x7fd1e80d05a0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000cbc0 tx=0x7fd1e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1e4c00640 1 -- 172.21.15.17:0/3197086621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0016020 con 0x7fd1e81457c0 2024-09-10T23:29:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1e4c00640 1 -- 172.21.15.17:0/3197086621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1e000ab40 con 0x7fd1e81457c0 2024-09-10T23:29:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1e4c00640 1 -- 172.21.15.17:0/3197086621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0012420 con 0x7fd1e81457c0 2024-09-10T23:29:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ef000640 1 -- 172.21.15.17:0/3197086621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e81f7fd0 con 0x7fd1e81457c0 2024-09-10T23:29:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.936+0000 7fd1ef000640 1 -- 172.21.15.17:0/3197086621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e81f8590 con 0x7fd1e81457c0 2024-09-10T23:29:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e4c00640 1 -- 172.21.15.17:0/3197086621 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd1e001b400 con 0x7fd1e81457c0 2024-09-10T23:29:04.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e4c00640 1 --2- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1c40725e0 0x7fd1c4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e4c00640 1 -- 172.21.15.17:0/3197086621 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fd1e0093960 con 0x7fd1e81457c0 2024-09-10T23:29:04.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1f239b000 1 Processor -- start 2024-09-10T23:29:04.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1f239b000 1 -- start start 2024-09-10T23:29:04.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1c40725e0 0x7fd1c4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6f350 0x55debae6f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/3197086621 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1c40725e0 0x7fd1c4074aa0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80af000 tx=0x7fd1d801af40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 0x55debae28270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae287b0 0x55debae28b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1f239b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55debac80a90 con 0x55debae6f350 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1f239b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55debac6fec0 con 0x55debae287b0 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1f239b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55debac73cd0 con 0x55debae6fc70 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6f350 0x55debae6f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6f350 0x55debae6f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55464/0 (socket says 172.21.15.17:55464) 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 -- 172.21.15.17:0/3573295391 learned_addr learned my addr 172.21.15.17:0/3573295391 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1df400640 1 --2- 172.21.15.17:0/3573295391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 0x55debae28270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1ed000640 1 --2- 172.21.15.17:0/3573295391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae287b0 0x55debae28b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 -- 172.21.15.17:0/3573295391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 msgr2=0x55debae28270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/3573295391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 0x55debae28270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 -- 172.21.15.17:0/3573295391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae287b0 msgr2=0x55debae28b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/3573295391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae287b0 0x55debae28b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 -- 172.21.15.17:0/3573295391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55debac14220 con 0x55debae6f350 2024-09-10T23:29:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/3573295391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6f350 0x55debae6f730 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8000c10 tx=0x7fd1d80b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba8badf766819c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1dcc00640 1 -- 172.21.15.17:0/3573295391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80cb070 con 0x55debae6f350 2024-09-10T23:29:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1dcc00640 1 -- 172.21.15.17:0/3573295391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1d8004ba0 con 0x55debae6f350 2024-09-10T23:29:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.940+0000 7fd1dcc00640 1 -- 172.21.15.17:0/3573295391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8005ca0 con 0x55debae6f350 2024-09-10T23:29:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- 172.21.15.17:0/3573295391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6f350 msgr2=0x55debae6f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 --2- 172.21.15.17:0/3573295391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6f350 0x55debae6f730 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8000c10 tx=0x7fd1d80b5000 comp rx=0 tx=0).stop 2024-09-10T23:29:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- 172.21.15.17:0/3573295391 shutdown_connections 2024-09-10T23:29:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 --2- 172.21.15.17:0/3573295391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae287b0 0x55debae28b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 --2- 172.21.15.17:0/3573295391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 0x55debae28270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 --2- 172.21.15.17:0/3573295391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6f350 0x55debae6f730 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- 172.21.15.17:0/3573295391 >> 172.21.15.17:0/3573295391 conn(0x55debae1f610 msgr2=0x55debae26b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- 172.21.15.17:0/3573295391 shutdown_connections 2024-09-10T23:29:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- 172.21.15.17:0/3573295391 wait complete. 2024-09-10T23:29:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- start start 2024-09-10T23:29:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 Processor -- start 2024-09-10T23:29:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 0x55debae760b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debae765f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debae76b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55debac19a20 con 0x55debae6fc70 2024-09-10T23:29:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55debac1aff0 con 0x55debae6f350 2024-09-10T23:29:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55debac27c00 con 0x55debae287b0 2024-09-10T23:29:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 10 client.0 _ll_register_callbacks cb 0x55debad27fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1ed000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debae76b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1ed000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debae76b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55474/0 (socket says 172.21.15.17:55474) 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1ed000640 1 -- 172.21.15.17:0/2463847435 learned_addr learned my addr 172.21.15.17:0/2463847435 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 0x55debae760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1df400640 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debae765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1ed000640 1 -- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 msgr2=0x55debae760b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1ed000640 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 0x55debae760b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1ed000640 1 -- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 msgr2=0x55debae765f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1ed000640 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debae765f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1ed000640 1 -- 172.21.15.17:0/2463847435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55debac0e170 con 0x55debae6fc70 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1df400640 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debae765f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1ed000640 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debae76b30 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fd1e005e740 tx=0x7fd1e0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75fdf5a11056de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1d5600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1d5600640 1 -- 172.21.15.17:0/2463847435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0083070 con 0x55debae6fc70 2024-09-10T23:29:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- 172.21.15.17:0/2463847435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55debac080f0 con 0x55debae6fc70 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1d5600640 1 -- 172.21.15.17:0/2463847435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fd1e005dc10 con 0x55debae6fc70 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1d5600640 1 -- 172.21.15.17:0/2463847435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fd1e0091050 con 0x55debae6fc70 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 10 client.10434 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.944+0000 7fd1f239b000 1 -- 172.21.15.17:0/2463847435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55debacf6430 con 0x55debae6fc70 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1d5600640 1 -- 172.21.15.17:0/2463847435 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55debac080f0 con 0x55debae6fc70 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1d5600640 1 -- 172.21.15.17:0/2463847435 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7fd1e0076030 con 0x55debae6fc70 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 10 client.10434 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 10 client.10434 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 20 client.10434 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x55debae7e480 0x55debae80870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 4 client.10434 mds_command: new command op to 9436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 -- 172.21.15.17:0/2463847435 --> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55debac829e0 con 0x55debae7e480 2024-09-10T23:29:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x55debae7e480 0x55debae80870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x55debae7e480 0x55debae80870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9436 client_cookie=a13b600cfd531d55 server_cookie=26b84e1a013e8c88 in_seq=0 out_seq=0 2024-09-10T23:29:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1d5600640 10 client.10434 ms_handle_connect on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1d5600640 1 -- 172.21.15.17:0/2463847435 <== mds.9436 v2:172.21.15.77:6835/3587135392 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55debac829e0 con 0x55debae7e480 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1d5600640 10 client.10434 handle_command_reply: tid=0 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 client.10434 shutdown 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 -- 172.21.15.17:0/2463847435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 msgr2=0x55debae76b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debae76b30 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fd1e005e740 tx=0x7fd1e0001260 comp rx=0 tx=0).stop 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 -- 172.21.15.17:0/2463847435 shutdown_connections 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x55debae7e480 0x55debae80870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debae76b30 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debae765f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 --2- 172.21.15.17:0/2463847435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 0x55debae760b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 -- 172.21.15.17:0/2463847435 >> 172.21.15.17:0/2463847435 conn(0x55debae1f610 msgr2=0x55debae27260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1d5600640 0 client.10434 ms_handle_reset on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 -- 172.21.15.17:0/2463847435 shutdown_connections 2024-09-10T23:29:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 1 -- 172.21.15.17:0/2463847435 wait complete. 2024-09-10T23:29:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.948+0000 7fd1f239b000 20 client.10434 trim_cache size 0 max 16384 2024-09-10T23:29:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 Processor -- start 2024-09-10T23:29:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 -- start start 2024-09-10T23:29:04.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 0x55debaee1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debaee16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debaee1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8204520 con 0x55debae6fc70 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8142de0 con 0x55debae6f350 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e8144bf0 con 0x55debae287b0 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1ed000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debaee1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1ed000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debaee1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55486/0 (socket says 172.21.15.17:55486) 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1ed000640 1 -- 172.21.15.17:0/1614279487 learned_addr learned my addr 172.21.15.17:0/1614279487 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 0x55debaee1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1ed000640 1 -- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 msgr2=0x55debaee1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1df400640 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debaee16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1ed000640 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 0x55debaee1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1ed000640 1 -- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 msgr2=0x55debaee16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1ed000640 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debaee16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1ed000640 1 -- 172.21.15.17:0/1614279487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55debac18c00 con 0x55debae6fc70 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1df400640 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debaee16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 0x55debaee1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1ed000640 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debaee1c10 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000cfd0 tx=0x7fd1e005dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b850dc8ea842492 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1d7e00640 1 -- 172.21.15.17:0/1614279487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0083070 con 0x55debae6fc70 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1d7e00640 1 -- 172.21.15.17:0/1614279487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1e0083b70 con 0x55debae6fc70 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1d7e00640 1 -- 172.21.15.17:0/1614279487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0018b20 con 0x55debae6fc70 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 -- 172.21.15.17:0/1614279487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 msgr2=0x55debaee1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debaee1c10 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000cfd0 tx=0x7fd1e005dba0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 -- 172.21.15.17:0/1614279487 shutdown_connections 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae6fc70 0x55debaee1c10 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debaee16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 --2- 172.21.15.17:0/1614279487 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae287b0 0x55debaee1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 -- 172.21.15.17:0/1614279487 >> 172.21.15.17:0/1614279487 conn(0x55debae1f610 msgr2=0x55debae6e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 -- 172.21.15.17:0/1614279487 shutdown_connections 2024-09-10T23:29:04.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.968+0000 7fd1f239b000 1 -- 172.21.15.17:0/1614279487 wait complete. 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 -- start start 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 Processor -- start 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae287b0 0x55debaee5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debaee5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 0x55debaee5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55debac78300 con 0x55debae287b0 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55debac72fe0 con 0x55debae6f350 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55debac83600 con 0x55debae6fc70 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 10 client.0 _ll_register_callbacks cb 0x7fd1e005dff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae287b0 0x55debaee5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae287b0 0x55debaee5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55502/0 (socket says 172.21.15.17:55502) 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1e7e00640 1 -- 172.21.15.17:0/799833225 learned_addr learned my addr 172.21.15.17:0/799833225 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1df400640 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debaee5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1ed000640 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 0x55debaee5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1e7e00640 1 -- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 msgr2=0x55debaee5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 0x55debaee5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1e7e00640 1 -- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 msgr2=0x55debaee5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debaee5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1e7e00640 1 -- 172.21.15.17:0/799833225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55debabf9990 con 0x55debae287b0 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1e7e00640 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae287b0 0x55debaee5110 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009840 tx=0x7fd1d80194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e526a6f705ef91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1d5600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1d5600640 1 -- 172.21.15.17:0/799833225 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80cb070 con 0x55debae287b0 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1d5600640 1 -- 172.21.15.17:0/799833225 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fd1d8005040 con 0x55debae287b0 2024-09-10T23:29:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 -- 172.21.15.17:0/799833225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1e0083b70 con 0x55debae287b0 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1d5600640 1 -- 172.21.15.17:0/799833225 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fd1d80de050 con 0x55debae287b0 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 10 client.10440 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 -- 172.21.15.17:0/799833225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55debac15140 con 0x55debae287b0 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1d5600640 1 -- 172.21.15.17:0/799833225 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1e0083b70 con 0x55debae287b0 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1d5600640 1 -- 172.21.15.17:0/799833225 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7fd1d80e1020 con 0x55debae287b0 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 10 client.10440 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 10 client.10440 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 20 client.10440 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x55debaeec360 0x55debaea1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 4 client.10440 mds_command: new command op to 9436 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1f239b000 1 -- 172.21.15.17:0/799833225 --> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55debac7e490 con 0x55debaeec360 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.972+0000 7fd1df400640 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x55debaeec360 0x55debaea1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1df400640 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x55debaeec360 0x55debaea1680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9436 client_cookie=5f8f279be0a7afb6 server_cookie=dd38ea3e125524fa in_seq=0 out_seq=0 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1d5600640 10 client.10440 ms_handle_connect on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1d5600640 1 -- 172.21.15.17:0/799833225 <== mds.9436 v2:172.21.15.77:6835/3587135392 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55debac7e490 con 0x55debaeec360 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1d5600640 10 client.10440 handle_command_reply: tid=0 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 client.10440 shutdown 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 -- 172.21.15.17:0/799833225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae287b0 msgr2=0x55debaee5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae287b0 0x55debaee5110 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009840 tx=0x7fd1d80194a0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 -- 172.21.15.17:0/799833225 shutdown_connections 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x55debaeec360 0x55debaea1680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55debae6fc70 0x55debaee5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1d5600640 0 client.10440 ms_handle_reset on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55debae6f350 0x55debaee5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 --2- 172.21.15.17:0/799833225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55debae287b0 0x55debaee5110 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 -- 172.21.15.17:0/799833225 >> 172.21.15.17:0/799833225 conn(0x55debae1f610 msgr2=0x55debae6eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 -- 172.21.15.17:0/799833225 shutdown_connections 2024-09-10T23:29:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 1 -- 172.21.15.17:0/799833225 wait complete. 2024-09-10T23:29:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:04.976+0000 7fd1f239b000 20 client.10440 trim_cache size 0 max 16384 2024-09-10T23:29:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:Error EINVAL: MDS is not active 2024-09-10T23:29:04.982 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T23:29:04.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d scrub abort 2024-09-10T23:29:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 -- 172.21.15.17:0/972079376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f150415be00 msgr2=0x7f150415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 --2- 172.21.15.17:0/972079376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f150415be00 0x7f150415d4f0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f1504073280 tx=0x7f14f401c870 comp rx=0 tx=0).stop 2024-09-10T23:29:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 -- 172.21.15.17:0/972079376 shutdown_connections 2024-09-10T23:29:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 --2- 172.21.15.17:0/972079376 >> v2:172.21.15.77:3300/0 conn(0x7f15040b1740 0x7f15040d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 --2- 172.21.15.17:0/972079376 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15040b12e0 0x7f15040cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 --2- 172.21.15.17:0/972079376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f150415be00 0x7f150415d4f0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 -- 172.21.15.17:0/972079376 >> 172.21.15.17:0/972079376 conn(0x7f150409a9f0 msgr2=0x7f150409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 -- 172.21.15.17:0/972079376 shutdown_connections 2024-09-10T23:29:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 -- 172.21.15.17:0/972079376 wait complete. 2024-09-10T23:29:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 Processor -- start 2024-09-10T23:29:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 -- start start 2024-09-10T23:29:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15040b12e0 0x7f1504070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15040b1740 0x7f150414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150415be00 0x7f150414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f150415d2d0 con 0x7f15040b1740 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f150415d150 con 0x7f150415be00 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f150a200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f15040b1c50 con 0x7f15040b12e0 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f14fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15040b1740 0x7f150414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f14fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15040b1740 0x7f150414ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55522/0 (socket says 172.21.15.17:55522) 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f14fbe00640 1 -- 172.21.15.17:0/1744593383 learned_addr learned my addr 172.21.15.17:0/1744593383 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f1503400640 1 --2- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15040b12e0 0x7f1504070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f1503e00640 1 --2- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150415be00 0x7f150414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f14fbe00640 1 -- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15040b12e0 msgr2=0x7f1504070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f14fbe00640 1 --2- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f15040b12e0 0x7f1504070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f14fbe00640 1 -- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150415be00 msgr2=0x7f150414f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.132+0000 7f14fbe00640 1 --2- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150415be00 0x7f150414f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f14fbe00640 1 -- 172.21.15.17:0/1744593383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15040b78c0 con 0x7f15040b1740 2024-09-10T23:29:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f1503e00640 1 --2- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f150415be00 0x7f150414f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f14fbe00640 1 --2- 172.21.15.17:0/1744593383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15040b1740 0x7f150414ed80 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00d780 tx=0x7f14ec00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f14fb400640 1 -- 172.21.15.17:0/1744593383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec017020 con 0x7f15040b1740 2024-09-10T23:29:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f14fb400640 1 -- 172.21.15.17:0/1744593383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14ec00de90 con 0x7f15040b1740 2024-09-10T23:29:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f150a200640 1 -- 172.21.15.17:0/1744593383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15040b4ca0 con 0x7f15040b1740 2024-09-10T23:29:05.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f14fb400640 1 -- 172.21.15.17:0/1744593383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec009a20 con 0x7f15040b1740 2024-09-10T23:29:05.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f150a200640 1 -- 172.21.15.17:0/1744593383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15040b5260 con 0x7f15040b1740 2024-09-10T23:29:05.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f14fb400640 1 -- 172.21.15.17:0/1744593383 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f14ec009bc0 con 0x7f15040b1740 2024-09-10T23:29:05.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.136+0000 7f14fb400640 1 --2- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f14e00725e0 0x7f14e0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 Processor -- start 2024-09-10T23:29:05.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fb400640 1 -- 172.21.15.17:0/1744593383 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f14ec093af0 con 0x7f15040b1740 2024-09-10T23:29:05.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- start start 2024-09-10T23:29:05.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f1503400640 1 --2- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f14e00725e0 0x7f14e0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f1503400640 1 --2- 172.21.15.17:0/1744593383 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f14e00725e0 0x7f14e0074aa0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f14f40af000 tx=0x7f14f401b0b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x564085780fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5640855d4a90 con 0x5640857c80d0 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5640855c3ec0 con 0x5640857c77b0 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5640855c7cd0 con 0x564085780bc0 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55532/0 (socket says 172.21.15.17:55532) 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fbe00640 1 -- 172.21.15.17:0/3965436745 learned_addr learned my addr 172.21.15.17:0/3965436745 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f1503400640 1 --2- 172.21.15.17:0/3965436745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f1503e00640 1 --2- 172.21.15.17:0/3965436745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x564085780fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fbe00640 1 -- 172.21.15.17:0/3965436745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 msgr2=0x564085780fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fbe00640 1 --2- 172.21.15.17:0/3965436745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x564085780fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fbe00640 1 -- 172.21.15.17:0/3965436745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 msgr2=0x5640857c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fbe00640 1 --2- 172.21.15.17:0/3965436745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fbe00640 1 -- 172.21.15.17:0/3965436745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564085568220 con 0x5640857c80d0 2024-09-10T23:29:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14fbe00640 1 --2- 172.21.15.17:0/3965436745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780680 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009610 tx=0x7f14ec05e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c827002bd1963a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14f3e00640 1 -- 172.21.15.17:0/3965436745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec05e930 con 0x5640857c80d0 2024-09-10T23:29:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14f3e00640 1 -- 172.21.15.17:0/3965436745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14ec063410 con 0x5640857c80d0 2024-09-10T23:29:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f14f3e00640 1 -- 172.21.15.17:0/3965436745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec067e30 con 0x5640857c80d0 2024-09-10T23:29:05.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- 172.21.15.17:0/3965436745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 msgr2=0x564085780680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 --2- 172.21.15.17:0/3965436745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780680 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009610 tx=0x7f14ec05e440 comp rx=0 tx=0).stop 2024-09-10T23:29:05.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- 172.21.15.17:0/3965436745 shutdown_connections 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 --2- 172.21.15.17:0/3965436745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x564085780fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 --2- 172.21.15.17:0/3965436745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780680 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 --2- 172.21.15.17:0/3965436745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- 172.21.15.17:0/3965436745 >> 172.21.15.17:0/3965436745 conn(0x564085773610 msgr2=0x56408577ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- 172.21.15.17:0/3965436745 shutdown_connections 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- 172.21.15.17:0/3965436745 wait complete. 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 -- start start 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.140+0000 7f150d5a3000 1 Processor -- start 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x5640857ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x5640857cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x56408556da20 con 0x5640857c80d0 2024-09-10T23:29:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56408556eff0 con 0x5640857c77b0 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56408557bc00 con 0x564085780bc0 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 10 client.0 _ll_register_callbacks cb 0x56408567bfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x5640857cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x5640857cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55536/0 (socket says 172.21.15.17:55536) 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503e00640 1 -- 172.21.15.17:0/33648886 learned_addr learned my addr 172.21.15.17:0/33648886 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f14fbe00640 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503400640 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x5640857ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503e00640 1 -- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 msgr2=0x5640857ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503e00640 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x5640857ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503e00640 1 -- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 msgr2=0x5640857cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503e00640 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503e00640 1 -- 172.21.15.17:0/33648886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564085562170 con 0x5640857c80d0 2024-09-10T23:29:05.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503e00640 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x5640857cf3b0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00fa10 tx=0x7f14fc00fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30847dd2d2b00d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f14f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f14f0c00640 1 -- 172.21.15.17:0/33648886 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00de50 con 0x5640857c80d0 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 -- 172.21.15.17:0/33648886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56408555c0f0 con 0x5640857c80d0 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f14f0c00640 1 -- 172.21.15.17:0/33648886 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f14fc01b480 con 0x5640857c80d0 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f14f0c00640 1 -- 172.21.15.17:0/33648886 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f14fc023050 con 0x5640857c80d0 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 10 client.10452 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 -- 172.21.15.17:0/33648886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x56408564a430 con 0x5640857c80d0 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f14f0c00640 1 -- 172.21.15.17:0/33648886 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56408555c0f0 con 0x5640857c80d0 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f14f0c00640 1 -- 172.21.15.17:0/33648886 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f14fc026020 con 0x5640857c80d0 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 10 client.10452 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 10 client.10452 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 20 client.10452 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5640857d6d00 0x5640857d90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 4 client.10452 mds_command: new command op to 9436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:05.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f150d5a3000 1 -- 172.21.15.17:0/33648886 --> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640855d69e0 con 0x5640857d6d00 2024-09-10T23:29:05.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.144+0000 7f1503400640 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5640857d6d00 0x5640857d90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f1503400640 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5640857d6d00 0x5640857d90f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9436 client_cookie=cf9e61ac8fc6e6d1 server_cookie=700c8f0250d15967 in_seq=0 out_seq=0 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f14f0c00640 10 client.10452 ms_handle_connect on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f14f0c00640 1 -- 172.21.15.17:0/33648886 <== mds.9436 v2:172.21.15.77:6835/3587135392 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640855d69e0 con 0x5640857d6d00 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f14f0c00640 10 client.10452 handle_command_reply: tid=0 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 client.10452 shutdown 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 -- 172.21.15.17:0/33648886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 msgr2=0x5640857cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x5640857cf3b0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00fa10 tx=0x7f14fc00fed0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 -- 172.21.15.17:0/33648886 shutdown_connections 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5640857d6d00 0x5640857d90f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x5640857cf3b0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f14f0c00640 0 client.10452 ms_handle_reset on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:05.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 --2- 172.21.15.17:0/33648886 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x5640857ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 -- 172.21.15.17:0/33648886 >> 172.21.15.17:0/33648886 conn(0x564085773610 msgr2=0x564085781ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 -- 172.21.15.17:0/33648886 shutdown_connections 2024-09-10T23:29:05.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 1 -- 172.21.15.17:0/33648886 wait complete. 2024-09-10T23:29:05.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.148+0000 7f150d5a3000 20 client.10452 trim_cache size 0 max 16384 2024-09-10T23:29:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.164+0000 7f150d5a3000 1 Processor -- start 2024-09-10T23:29:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.164+0000 7f150d5a3000 1 -- start start 2024-09-10T23:29:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x5640857b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f15041fff50 con 0x5640857c80d0 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f15040b6630 con 0x5640857c77b0 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f150406ef30 con 0x564085780bc0 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55542/0 (socket says 172.21.15.17:55542) 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503e00640 1 -- 172.21.15.17:0/3943474266 learned_addr learned my addr 172.21.15.17:0/3943474266 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503400640 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x5640857b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f14fbe00640 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503e00640 1 -- 172.21.15.17:0/3943474266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 msgr2=0x5640857b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503e00640 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x5640857b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503e00640 1 -- 172.21.15.17:0/3943474266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 msgr2=0x5640857b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503e00640 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503e00640 1 -- 172.21.15.17:0/3943474266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56408556cc00 con 0x5640857c80d0 2024-09-10T23:29:05.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f14fbe00640 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f1503e00640 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780fa0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f14fc006010 tx=0x7f14fc008820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68406a4699027f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f14f3400640 1 -- 172.21.15.17:0/3943474266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc020040 con 0x5640857c80d0 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f14f3400640 1 -- 172.21.15.17:0/3943474266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14fc01b900 con 0x5640857c80d0 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f14f3400640 1 -- 172.21.15.17:0/3943474266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc010430 con 0x5640857c80d0 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- 172.21.15.17:0/3943474266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 msgr2=0x564085780fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780fa0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f14fc006010 tx=0x7f14fc008820 comp rx=0 tx=0).stop 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- 172.21.15.17:0/3943474266 shutdown_connections 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x564085780fa0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5640857c77b0 0x5640857b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- 172.21.15.17:0/3943474266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564085780bc0 0x5640857b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- 172.21.15.17:0/3943474266 >> 172.21.15.17:0/3943474266 conn(0x564085773610 msgr2=0x564085785160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- 172.21.15.17:0/3943474266 shutdown_connections 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- 172.21.15.17:0/3943474266 wait complete. 2024-09-10T23:29:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- start start 2024-09-10T23:29:05.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 Processor -- start 2024-09-10T23:29:05.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564085780bc0 0x56408583da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5640857c77b0 0x56408583df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x56408583e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5640855cc300 con 0x5640857c80d0 2024-09-10T23:29:05.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5640855c6fe0 con 0x564085780bc0 2024-09-10T23:29:05.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5640855d7600 con 0x5640857c77b0 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.168+0000 7f150d5a3000 10 client.0 _ll_register_callbacks cb 0x7f14fc008650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x56408583e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564085780bc0 0x56408583da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x56408583e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55550/0 (socket says 172.21.15.17:55550) 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503e00640 1 -- 172.21.15.17:0/2709025505 learned_addr learned my addr 172.21.15.17:0/2709025505 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14fbe00640 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5640857c77b0 0x56408583df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503e00640 1 -- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5640857c77b0 msgr2=0x56408583df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503e00640 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5640857c77b0 0x56408583df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503e00640 1 -- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564085780bc0 msgr2=0x56408583da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503e00640 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564085780bc0 0x56408583da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503e00640 1 -- 172.21.15.17:0/2709025505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56408554d990 con 0x5640857c80d0 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503e00640 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x56408583e4c0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f14fc002240 tx=0x7f14fc00dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e94ce403cb38d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 1 -- 172.21.15.17:0/2709025505 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc020040 con 0x5640857c80d0 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 1 -- 172.21.15.17:0/2709025505 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f14fc0088e0 con 0x5640857c80d0 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 -- 172.21.15.17:0/2709025505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14fc01b900 con 0x5640857c80d0 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 1 -- 172.21.15.17:0/2709025505 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f14fc010430 con 0x5640857c80d0 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 10 client.10458 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 -- 172.21.15.17:0/2709025505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x564085569140 con 0x5640857c80d0 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 1 -- 172.21.15.17:0/2709025505 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14fc01b900 con 0x5640857c80d0 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 1 -- 172.21.15.17:0/2709025505 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f14fc041020 con 0x5640857c80d0 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 10 client.10458 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 10 client.10458 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 20 client.10458 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5640857d3550 0x5640857d3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 4 client.10458 mds_command: new command op to 9436 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-10T23:29:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 -- 172.21.15.17:0/2709025505 --> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x5640855d2490 con 0x5640857d3550 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503400640 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5640857d3550 0x5640857d3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f1503400640 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5640857d3550 0x5640857d3930 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9436 client_cookie=3e6bad8424ebb921 server_cookie=1bf9cbc3e97a9101 in_seq=0 out_seq=0 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 10 client.10458 ms_handle_connect on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 1 -- 172.21.15.17:0/2709025505 <== mds.9436 v2:172.21.15.77:6835/3587135392 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x5640855d2490 con 0x5640857d3550 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 10 client.10458 handle_command_reply: tid=0 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 client.10458 shutdown 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 -- 172.21.15.17:0/2709025505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 msgr2=0x56408583e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x56408583e4c0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f14fc002240 tx=0x7f14fc00dfa0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 -- 172.21.15.17:0/2709025505 shutdown_connections 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5640857d3550 0x5640857d3930 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640857c80d0 0x56408583e4c0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5640857c77b0 0x56408583df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 --2- 172.21.15.17:0/2709025505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564085780bc0 0x56408583da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f14f0c00640 0 client.10458 ms_handle_reset on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 -- 172.21.15.17:0/2709025505 >> 172.21.15.17:0/2709025505 conn(0x564085773610 msgr2=0x5640857b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 -- 172.21.15.17:0/2709025505 shutdown_connections 2024-09-10T23:29:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 1 -- 172.21.15.17:0/2709025505 wait complete. 2024-09-10T23:29:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.172+0000 7f150d5a3000 20 client.10458 trim_cache size 0 max 16384 2024-09-10T23:29:05.180 INFO:teuthology.orchestra.run.smithi017.stderr:Error EINVAL: MDS is not active 2024-09-10T23:29:05.181 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T23:29:05.182 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d scrub resume 2024-09-10T23:29:05.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.328+0000 7f66ef600640 1 -- 172.21.15.17:0/945034233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66e8074630 msgr2=0x7f66e815fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.328+0000 7f66ef600640 1 --2- 172.21.15.17:0/945034233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66e8074630 0x7f66e815fcb0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009cb0 tx=0x7f66e001cc80 comp rx=0 tx=0).stop 2024-09-10T23:29:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 -- 172.21.15.17:0/945034233 shutdown_connections 2024-09-10T23:29:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 --2- 172.21.15.17:0/945034233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66e8074630 0x7f66e815fcb0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 --2- 172.21.15.17:0/945034233 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66e80741d0 0x7f66e815f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 -- 172.21.15.17:0/945034233 >> 172.21.15.17:0/945034233 conn(0x7f66e80b17a0 msgr2=0x7f66e80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 -- 172.21.15.17:0/945034233 shutdown_connections 2024-09-10T23:29:05.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 -- 172.21.15.17:0/945034233 wait complete. 2024-09-10T23:29:05.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 Processor -- start 2024-09-10T23:29:05.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 -- start start 2024-09-10T23:29:05.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66e80741d0 0x7f66e813a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66e8074630 0x7f66e813dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e81457c0 0x7f66e80b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66e8168c90 con 0x7f66e8074630 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f66e8168b10 con 0x7f66e81457c0 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ef600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f66e8168e10 con 0x7f66e80741d0 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66e8074630 0x7f66e813dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66e8074630 0x7f66e813dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55566/0 (socket says 172.21.15.17:55566) 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e7e00640 1 -- 172.21.15.17:0/1253764712 learned_addr learned my addr 172.21.15.17:0/1253764712 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ecc00640 1 --2- 172.21.15.17:0/1253764712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66e80741d0 0x7f66e813a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66ed600640 1 --2- 172.21.15.17:0/1253764712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e81457c0 0x7f66e80b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e7e00640 1 -- 172.21.15.17:0/1253764712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66e80741d0 msgr2=0x7f66e813a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e7e00640 1 --2- 172.21.15.17:0/1253764712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66e80741d0 0x7f66e813a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e7e00640 1 -- 172.21.15.17:0/1253764712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e81457c0 msgr2=0x7f66e80b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e7e00640 1 --2- 172.21.15.17:0/1253764712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e81457c0 0x7f66e80b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e7e00640 1 -- 172.21.15.17:0/1253764712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e80b3660 con 0x7f66e8074630 2024-09-10T23:29:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e7e00640 1 --2- 172.21.15.17:0/1253764712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66e8074630 0x7f66e813dd20 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f66d400d980 tx=0x7f66d400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e4c00640 1 -- 172.21.15.17:0/1253764712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4017070 con 0x7f66e8074630 2024-09-10T23:29:05.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e4c00640 1 -- 172.21.15.17:0/1253764712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66d4004310 con 0x7f66e8074630 2024-09-10T23:29:05.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.332+0000 7f66e4c00640 1 -- 172.21.15.17:0/1253764712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4009c30 con 0x7f66e8074630 2024-09-10T23:29:05.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.336+0000 7f66ef600640 1 -- 172.21.15.17:0/1253764712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e80b3940 con 0x7f66e8074630 2024-09-10T23:29:05.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.336+0000 7f66ef600640 1 -- 172.21.15.17:0/1253764712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e813aa80 con 0x7f66e8074630 2024-09-10T23:29:05.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.336+0000 7f66e4c00640 1 -- 172.21.15.17:0/1253764712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f66d4003600 con 0x7f66e8074630 2024-09-10T23:29:05.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.336+0000 7f66e4c00640 1 --2- 172.21.15.17:0/1253764712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66c80725e0 0x7f66c8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.336+0000 7f66e4c00640 1 -- 172.21.15.17:0/1253764712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f66d40937c0 con 0x7f66e8074630 2024-09-10T23:29:05.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.336+0000 7f66f295b000 1 Processor -- start 2024-09-10T23:29:05.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.336+0000 7f66f295b000 1 -- start start 2024-09-10T23:29:05.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.336+0000 7f66ecc00640 1 --2- 172.21.15.17:0/1253764712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66c80725e0 0x7f66c8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66ecc00640 1 --2- 172.21.15.17:0/1253764712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66c80725e0 0x7f66c8074aa0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f66e8156710 tx=0x7f66dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55796035e1d0 0x5579604bfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604765a0 0x557960476980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5579602742c0 con 0x5579604c03d0 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5579602d1b90 con 0x55796035e1d0 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5579602c0fc0 con 0x5579604765a0 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55582/0 (socket says 172.21.15.17:55582) 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66e7e00640 1 -- 172.21.15.17:0/3876295581 learned_addr learned my addr 172.21.15.17:0/3876295581 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66ed600640 1 --2- 172.21.15.17:0/3876295581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604765a0 0x557960476980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66ecc00640 1 --2- 172.21.15.17:0/3876295581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55796035e1d0 0x5579604bfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66e7e00640 1 -- 172.21.15.17:0/3876295581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604765a0 msgr2=0x557960476980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66e7e00640 1 --2- 172.21.15.17:0/3876295581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604765a0 0x557960476980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66e7e00640 1 -- 172.21.15.17:0/3876295581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55796035e1d0 msgr2=0x5579604bfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66e7e00640 1 --2- 172.21.15.17:0/3876295581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55796035e1d0 0x5579604bfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66e7e00640 1 -- 172.21.15.17:0/3876295581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796025f1a0 con 0x5579604c03d0 2024-09-10T23:29:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66e7e00640 1 --2- 172.21.15.17:0/3876295581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604c07b0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f66d4091ac0 tx=0x7f66d405e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5a7d51204b6a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66d9600640 1 -- 172.21.15.17:0/3876295581 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4020040 con 0x5579604c03d0 2024-09-10T23:29:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66d9600640 1 -- 172.21.15.17:0/3876295581 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66d405e6b0 con 0x5579604c03d0 2024-09-10T23:29:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66d9600640 1 -- 172.21.15.17:0/3876295581 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d40630e0 con 0x5579604c03d0 2024-09-10T23:29:05.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 -- 172.21.15.17:0/3876295581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 msgr2=0x5579604c07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 --2- 172.21.15.17:0/3876295581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604c07b0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f66d4091ac0 tx=0x7f66d405e0c0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 -- 172.21.15.17:0/3876295581 shutdown_connections 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 --2- 172.21.15.17:0/3876295581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604765a0 0x557960476980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 --2- 172.21.15.17:0/3876295581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604c07b0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 --2- 172.21.15.17:0/3876295581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55796035e1d0 0x5579604bfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 -- 172.21.15.17:0/3876295581 >> 172.21.15.17:0/3876295581 conn(0x55795ff7f880 msgr2=0x557960474e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 -- 172.21.15.17:0/3876295581 shutdown_connections 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 -- 172.21.15.17:0/3876295581 wait complete. 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 -- start start 2024-09-10T23:29:05.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.340+0000 7f66f295b000 1 Processor -- start 2024-09-10T23:29:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55796035e1d0 0x5579604c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 0x5579604c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604c03d0 0x5579604c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5579602664d0 con 0x55796035e1d0 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5579602c4dd0 con 0x5579604765a0 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55795ff86620 con 0x5579604c03d0 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 10 client.0 _ll_register_callbacks cb 0x557960297cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ecc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55796035e1d0 0x5579604c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ecc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55796035e1d0 0x5579604c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55598/0 (socket says 172.21.15.17:55598) 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ecc00640 1 -- 172.21.15.17:0/476590648 learned_addr learned my addr 172.21.15.17:0/476590648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66e7e00640 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 0x5579604c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ed600640 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604c03d0 0x5579604c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ecc00640 1 -- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604c03d0 msgr2=0x5579604c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ecc00640 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604c03d0 0x5579604c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ecc00640 1 -- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 msgr2=0x5579604c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ecc00640 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 0x5579604c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ecc00640 1 -- 172.21.15.17:0/476590648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557960390720 con 0x55796035e1d0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ecc00640 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55796035e1d0 0x5579604c6a20 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f66dc007d60 tx=0x7f66dc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5da18230b679a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ce000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ce000640 1 -- 172.21.15.17:0/476590648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc025020 con 0x55796035e1d0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ce000640 1 -- 172.21.15.17:0/476590648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f66dc021610 con 0x55796035e1d0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 -- 172.21.15.17:0/476590648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5579602592e0 con 0x55796035e1d0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ce000640 1 -- 172.21.15.17:0/476590648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f66dc02f050 con 0x55796035e1d0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 10 client.10473 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 -- 172.21.15.17:0/476590648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x557960346420 con 0x55796035e1d0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ce000640 1 -- 172.21.15.17:0/476590648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5579602592e0 con 0x55796035e1d0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ce000640 1 -- 172.21.15.17:0/476590648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f66dc032020 con 0x55796035e1d0 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 10 client.10473 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:05.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 10 client.10473 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:29:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 20 client.10473 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5579604cedf0 0x5579604d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 4 client.10473 mds_command: new command op to 9436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66f295b000 1 -- 172.21.15.17:0/476590648 --> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579602d3ae0 con 0x5579604cedf0 2024-09-10T23:29:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66e7e00640 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5579604cedf0 0x5579604d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66e7e00640 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5579604cedf0 0x5579604d11e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9436 client_cookie=972752a350a9f45a server_cookie=7a40bd48f794d7bf in_seq=0 out_seq=0 2024-09-10T23:29:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.344+0000 7f66ce000640 10 client.10473 ms_handle_connect on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:05.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66ce000640 1 -- 172.21.15.17:0/476590648 <== mds.9436 v2:172.21.15.77:6835/3587135392 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5579602d3ae0 con 0x5579604cedf0 2024-09-10T23:29:05.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66ce000640 10 client.10473 handle_command_reply: tid=0 2024-09-10T23:29:05.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 client.10473 shutdown 2024-09-10T23:29:05.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 -- 172.21.15.17:0/476590648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55796035e1d0 msgr2=0x5579604c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55796035e1d0 0x5579604c6a20 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f66dc007d60 tx=0x7f66dc000ee0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 -- 172.21.15.17:0/476590648 shutdown_connections 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5579604cedf0 0x5579604d11e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5579604c03d0 0x5579604c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 0x5579604c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66ce000640 0 client.10473 ms_handle_reset on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 --2- 172.21.15.17:0/476590648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55796035e1d0 0x5579604c6a20 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 -- 172.21.15.17:0/476590648 >> 172.21.15.17:0/476590648 conn(0x55795ff7f880 msgr2=0x557960475590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 -- 172.21.15.17:0/476590648 shutdown_connections 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 1 -- 172.21.15.17:0/476590648 wait complete. 2024-09-10T23:29:05.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.348+0000 7f66f295b000 20 client.10473 trim_cache size 0 max 16384 2024-09-10T23:29:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.364+0000 7f66f295b000 1 Processor -- start 2024-09-10T23:29:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.364+0000 7f66f295b000 1 -- start start 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 0x557960474660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 0x557960474ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604750e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f66e8203eb0 con 0x5579604c03d0 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f66e8204580 con 0x5579604765a0 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f66e8202a00 con 0x55796035e1d0 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ed600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ed600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604750e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55612/0 (socket says 172.21.15.17:55612) 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ed600640 1 -- 172.21.15.17:0/3491741905 learned_addr learned my addr 172.21.15.17:0/3491741905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66e7e00640 1 --2- 172.21.15.17:0/3491741905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 0x557960474ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ecc00640 1 --2- 172.21.15.17:0/3491741905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 0x557960474660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ed600640 1 -- 172.21.15.17:0/3491741905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 msgr2=0x557960474660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ed600640 1 --2- 172.21.15.17:0/3491741905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 0x557960474660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ed600640 1 -- 172.21.15.17:0/3491741905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 msgr2=0x557960474ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ed600640 1 --2- 172.21.15.17:0/3491741905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 0x557960474ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ed600640 1 -- 172.21.15.17:0/3491741905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55796031dae0 con 0x5579604c03d0 2024-09-10T23:29:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66ed600640 1 --2- 172.21.15.17:0/3491741905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604750e0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009a40 tx=0x7f66e0019a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfe1c9f2a1cb3a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66d8c00640 1 -- 172.21.15.17:0/3491741905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e00b2040 con 0x5579604c03d0 2024-09-10T23:29:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66d8c00640 1 -- 172.21.15.17:0/3491741905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e0003c70 con 0x5579604c03d0 2024-09-10T23:29:05.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66d8c00640 1 -- 172.21.15.17:0/3491741905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0003e60 con 0x5579604c03d0 2024-09-10T23:29:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 -- 172.21.15.17:0/3491741905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 msgr2=0x5579604750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 --2- 172.21.15.17:0/3491741905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604750e0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f66e0009a40 tx=0x7f66e0019a20 comp rx=0 tx=0).stop 2024-09-10T23:29:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 -- 172.21.15.17:0/3491741905 shutdown_connections 2024-09-10T23:29:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 --2- 172.21.15.17:0/3491741905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604c03d0 0x5579604750e0 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 --2- 172.21.15.17:0/3491741905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604765a0 0x557960474ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 --2- 172.21.15.17:0/3491741905 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 0x557960474660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 -- 172.21.15.17:0/3491741905 >> 172.21.15.17:0/3491741905 conn(0x55795ff7f880 msgr2=0x55796047b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 -- 172.21.15.17:0/3491741905 shutdown_connections 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 -- 172.21.15.17:0/3491741905 wait complete. 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 -- start start 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.368+0000 7f66f295b000 1 Processor -- start 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 0x557960536370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604765a0 0x5579605368b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604c03d0 0x557960536df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55796026c020 con 0x5579604765a0 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f66e8203020 con 0x5579604c03d0 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5579602d4700 con 0x55796035e1d0 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 10 client.0 _ll_register_callbacks cb 0x7f66dc001430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604765a0 0x5579605368b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604765a0 0x5579605368b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55614/0 (socket says 172.21.15.17:55614) 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66e7e00640 1 -- 172.21.15.17:0/128288418 learned_addr learned my addr 172.21.15.17:0/128288418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ed600640 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604c03d0 0x557960536df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ecc00640 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 0x557960536370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66e7e00640 1 -- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 msgr2=0x557960536370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66e7e00640 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 0x557960536370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66e7e00640 1 -- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604c03d0 msgr2=0x557960536df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66e7e00640 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604c03d0 0x557960536df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66e7e00640 1 -- 172.21.15.17:0/128288418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55796028b040 con 0x5579604765a0 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ed600640 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604c03d0 0x557960536df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ecc00640 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 0x557960536370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66e7e00640 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604765a0 0x5579605368b0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009610 tx=0x7f66d400b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81d7abaae55a30b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 1 -- 172.21.15.17:0/128288418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4091060 con 0x5579604765a0 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 1 -- 172.21.15.17:0/128288418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f66d405a920 con 0x5579604765a0 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- 172.21.15.17:0/128288418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66e0003c70 con 0x5579604765a0 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 1 -- 172.21.15.17:0/128288418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f66d4088050 con 0x5579604765a0 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 10 client.10479 fetch_fsmap learned FSMap version 136 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- 172.21.15.17:0/128288418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x557960257620 con 0x5579604765a0 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 1 -- 172.21.15.17:0/128288418 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e0003c70 con 0x5579604765a0 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 1 -- 172.21.15.17:0/128288418 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 136) ==== 3490+0+0 (secure 0 0 0) 0x7f66d4067670 con 0x5579604765a0 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 10 client.10479 fetch_fsmap finished waiting for FSMap version 136 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 10 client.10479 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 20 client.10479 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5579604cc1e0 0x5579604cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 4 client.10479 mds_command: new command op to 9436 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- 172.21.15.17:0/128288418 --> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x5579604d7500 con 0x5579604cc1e0 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ecc00640 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5579604cc1e0 0x5579604cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ecc00640 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5579604cc1e0 0x5579604cc5c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9436 client_cookie=3f4b3cf04bef733e server_cookie=1d67aa9c8c460833 in_seq=0 out_seq=0 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 10 client.10479 ms_handle_connect on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 1 -- 172.21.15.17:0/128288418 <== mds.9436 v2:172.21.15.77:6835/3587135392 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x5579604d7500 con 0x5579604cc1e0 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 10 client.10479 handle_command_reply: tid=0 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 client.10479 shutdown 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- 172.21.15.17:0/128288418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604765a0 msgr2=0x5579605368b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604765a0 0x5579605368b0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009610 tx=0x7f66d400b5e0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- 172.21.15.17:0/128288418 shutdown_connections 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:6835/3587135392,v1:172.21.15.77:6837/3587135392] conn(0x5579604cc1e0 0x5579604cc5c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5579604c03d0 0x557960536df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5579604765a0 0x5579605368b0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66ce000640 0 client.10479 ms_handle_reset on v2:172.21.15.77:6835/3587135392 2024-09-10T23:29:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 --2- 172.21.15.17:0/128288418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55796035e1d0 0x557960536370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- 172.21.15.17:0/128288418 >> 172.21.15.17:0/128288418 conn(0x55795ff7f880 msgr2=0x55796047b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- 172.21.15.17:0/128288418 shutdown_connections 2024-09-10T23:29:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 1 -- 172.21.15.17:0/128288418 wait complete. 2024-09-10T23:29:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.372+0000 7f66f295b000 20 client.10479 trim_cache size 0 max 16384 2024-09-10T23:29:05.381 INFO:teuthology.orchestra.run.smithi017.stderr:Error EINVAL: MDS is not active 2024-09-10T23:29:05.382 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T23:29:05.382 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:29:05.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:29:05.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:29:05.560 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:29:05.560 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:29:05.560 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:29:05.561 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:29:05.570 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:29:05.570 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:29:05.619 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:29:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.812+0000 7fe3b9c00640 1 -- 172.21.15.17:0/1158962827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3b406d200 msgr2=0x7fe3b4152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.812+0000 7fe3b9c00640 1 --2- 172.21.15.17:0/1158962827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3b406d200 0x7fe3b4152810 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009bc0 tx=0x7fe3ac01cb10 comp rx=0 tx=0).stop 2024-09-10T23:29:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.812+0000 7fe3b9c00640 1 -- 172.21.15.17:0/1158962827 shutdown_connections 2024-09-10T23:29:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.812+0000 7fe3b9c00640 1 --2- 172.21.15.17:0/1158962827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3b406d200 0x7fe3b4152810 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.812+0000 7fe3b9c00640 1 --2- 172.21.15.17:0/1158962827 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b406ce20 0x7fe3b4074060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.812+0000 7fe3b9c00640 1 -- 172.21.15.17:0/1158962827 >> 172.21.15.17:0/1158962827 conn(0x7fe3b40d0c40 msgr2=0x7fe3b40d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.812+0000 7fe3b9c00640 1 -- 172.21.15.17:0/1158962827 shutdown_connections 2024-09-10T23:29:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.812+0000 7fe3b9c00640 1 -- 172.21.15.17:0/1158962827 wait complete. 2024-09-10T23:29:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 Processor -- start 2024-09-10T23:29:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 -- start start 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b406ce20 0x7fe3b41513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b406d200 0x7fe3b40c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3b4071960 0x7fe3b40c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b406fb90 con 0x7fe3b406d200 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b406fa10 con 0x7fe3b4071960 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b406fd10 con 0x7fe3b406ce20 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b406d200 0x7fe3b40c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b406d200 0x7fe3b40c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55626/0 (socket says 172.21.15.17:55626) 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3abe00640 1 -- 172.21.15.17:0/39007545 learned_addr learned my addr 172.21.15.17:0/39007545 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b2a00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b406ce20 0x7fe3b41513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b3400640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3b4071960 0x7fe3b40c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3abe00640 1 -- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b406ce20 msgr2=0x7fe3b41513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3abe00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b406ce20 0x7fe3b41513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3abe00640 1 -- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3b4071960 msgr2=0x7fe3b40c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3abe00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3b4071960 0x7fe3b40c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3abe00640 1 -- 172.21.15.17:0/39007545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b40af380 con 0x7fe3b406d200 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3abe00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b406d200 0x7fe3b40c6fc0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00c3f0 tx=0x7fe39c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3aaa00640 1 -- 172.21.15.17:0/39007545 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c017070 con 0x7fe3b406d200 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3aaa00640 1 -- 172.21.15.17:0/39007545 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe39c0053c0 con 0x7fe3b406d200 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3aaa00640 1 -- 172.21.15.17:0/39007545 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c003860 con 0x7fe3b406d200 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b40aedc0 con 0x7fe3b406d200 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b40c67c0 con 0x7fe3b406d200 2024-09-10T23:29:05.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.816+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b4070200 con 0x7fe3b406d200 2024-09-10T23:29:05.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.820+0000 7fe3aaa00640 1 -- 172.21.15.17:0/39007545 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe39c003a00 con 0x7fe3b406d200 2024-09-10T23:29:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.820+0000 7fe3aaa00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3900725e0 0x7fe390074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.820+0000 7fe3aaa00640 1 -- 172.21.15.17:0/39007545 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fe39c092cd0 con 0x7fe3b406d200 2024-09-10T23:29:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.820+0000 7fe3b2a00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3900725e0 0x7fe390074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.820+0000 7fe3b2a00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3900725e0 0x7fe390074aa0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40096c0 tx=0x7fe3a4009260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:05.824+0000 7fe3aaa00640 1 -- 172.21.15.17:0/39007545 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe39c021020 con 0x7fe3b406d200 2024-09-10T23:29:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.008+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe3b40cd280 con 0x7fe3b406d200 2024-09-10T23:29:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3aaa00640 1 -- 172.21.15.17:0/39007545 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v177) ==== 80+0+0 (secure 0 0 0) 0x7fe39c001090 con 0x7fe3b406d200 2024-09-10T23:29:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3900725e0 msgr2=0x7fe390074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3900725e0 0x7fe390074aa0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40096c0 tx=0x7fe3a4009260 comp rx=0 tx=0).stop 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b406d200 msgr2=0x7fe3b40c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b406d200 0x7fe3b40c6fc0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00c3f0 tx=0x7fe39c00c8b0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 shutdown_connections 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3900725e0 0x7fe390074aa0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3b4071960 0x7fe3b40c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b406d200 0x7fe3b40c6fc0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 --2- 172.21.15.17:0/39007545 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b406ce20 0x7fe3b41513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 >> 172.21.15.17:0/39007545 conn(0x7fe3b40d0c40 msgr2=0x7fe3b40b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 shutdown_connections 2024-09-10T23:29:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.012+0000 7fe3b9c00640 1 -- 172.21.15.17:0/39007545 wait complete. 2024-09-10T23:29:06.033 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:29:06.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:06.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:29:06.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[84251]: fuse finished with error 0 and tester_r 0 2024-09-10T23:29:06.336 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:29:06.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:06.336 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:29:06.417 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:29:06.418 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:29:06.418 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:29:06.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:29:06.428 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:29:06.428 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:29:06.428 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:29:06.467 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:29:06.467 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:29:06.467 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:29:06.467 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:29:06.477 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:29:06.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:29:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 -- 172.21.15.17:0/1365681155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 msgr2=0x7f965c15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 --2- 172.21.15.17:0/1365681155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 0x7f965c15f5a0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f965c0d2e60 tx=0x7f964401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 -- 172.21.15.17:0/1365681155 shutdown_connections 2024-09-10T23:29:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 --2- 172.21.15.17:0/1365681155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f965c0cf320 0x7f965c0cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 --2- 172.21.15.17:0/1365681155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 0x7f965c15f5a0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 --2- 172.21.15.17:0/1365681155 >> v2:172.21.15.77:3300/0 conn(0x7f965c070ad0 0x7f965c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 -- 172.21.15.17:0/1365681155 >> 172.21.15.17:0/1365681155 conn(0x7f965c0d1d60 msgr2=0x7f965c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 -- 172.21.15.17:0/1365681155 shutdown_connections 2024-09-10T23:29:06.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 -- 172.21.15.17:0/1365681155 wait complete. 2024-09-10T23:29:06.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 Processor -- start 2024-09-10T23:29:06.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 -- start start 2024-09-10T23:29:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f965c070ad0 0x7f965c06f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0cf320 0x7f965c166640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 0x7f965c14eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0cd2c0 con 0x7f965c0d1830 2024-09-10T23:29:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0cd140 con 0x7f965c0cf320 2024-09-10T23:29:06.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.660+0000 7f9663600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f965c0cd440 con 0x7f965c070ad0 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9661600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 0x7f965c14eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9661600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 0x7f965c14eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55642/0 (socket says 172.21.15.17:55642) 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9661600640 1 -- 172.21.15.17:0/776172548 learned_addr learned my addr 172.21.15.17:0/776172548 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9660c00640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f965c070ad0 0x7f965c06f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9653e00640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0cf320 0x7f965c166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9661600640 1 -- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f965c070ad0 msgr2=0x7f965c06f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9661600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f965c070ad0 0x7f965c06f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9661600640 1 -- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0cf320 msgr2=0x7f965c166640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9661600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0cf320 0x7f965c166640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9661600640 1 -- 172.21.15.17:0/776172548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c164220 con 0x7f965c0d1830 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9661600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 0x7f965c14eb40 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f965400daa0 tx=0x7f965400df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:06.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9659600640 1 -- 172.21.15.17:0/776172548 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654017070 con 0x7f965c0d1830 2024-09-10T23:29:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9659600640 1 -- 172.21.15.17:0/776172548 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9654004b30 con 0x7f965c0d1830 2024-09-10T23:29:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9659600640 1 -- 172.21.15.17:0/776172548 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654005020 con 0x7f965c0d1830 2024-09-10T23:29:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965c06dd70 con 0x7f965c0d1830 2024-09-10T23:29:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c14f080 con 0x7f965c0d1830 2024-09-10T23:29:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965c0cfc60 con 0x7f965c0d1830 2024-09-10T23:29:06.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.664+0000 7f9659600640 1 -- 172.21.15.17:0/776172548 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f96540051c0 con 0x7f965c0d1830 2024-09-10T23:29:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.668+0000 7f9659600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96380725e0 0x7f9638074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:06.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.668+0000 7f9659600640 1 -- 172.21.15.17:0/776172548 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f9654093860 con 0x7f965c0d1830 2024-09-10T23:29:06.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.668+0000 7f9660c00640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96380725e0 0x7f9638074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:06.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.668+0000 7f9660c00640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96380725e0 0x7f9638074aa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f964c004610 tx=0x7f964c00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.672+0000 7f9659600640 1 -- 172.21.15.17:0/776172548 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9654020070 con 0x7f965c0d1830 2024-09-10T23:29:06.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.880+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f965c0b5680 con 0x7f965c0d1830 2024-09-10T23:29:06.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.880+0000 7f9659600640 1 -- 172.21.15.17:0/776172548 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5244 (secure 0 0 0) 0x7f965405e6c0 con 0x7f965c0d1830 2024-09-10T23:29:06.881 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:06.881 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":136,"btime":"2024-09-10T23:29:03:547935+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1319528493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1319528493},{"type":"v1","addr":"172.21.15.17:6833","nonce":1319528493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1685364651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1685364651},{"type":"v1","addr":"172.21.15.77:6836","nonce":1685364651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:28:34.352047+0000","modified":"2024-09-10T23:29:03.547919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10197},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9436":{"gid":9436,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/3587135392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3587135392},{"type":"v1","addr":"172.21.15.77:6837","nonce":3587135392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10197":{"gid":10197,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3849451590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3849451590},{"type":"v1","addr":"172.21.15.17:6835","nonce":3849451590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10197,"qdb_cluster":[10197]},"id":12}]} 2024-09-10T23:29:06.881 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 136 2024-09-10T23:29:06.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.880+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96380725e0 msgr2=0x7f9638074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.880+0000 7f9663600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96380725e0 0x7f9638074aa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f964c004610 tx=0x7f964c00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.880+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 msgr2=0x7f965c14eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.880+0000 7f9663600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 0x7f965c14eb40 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f965400daa0 tx=0x7f965400df60 comp rx=0 tx=0).stop 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.884+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 shutdown_connections 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.884+0000 7f9663600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96380725e0 0x7f9638074aa0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.884+0000 7f9663600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f965c0d1830 0x7f965c14eb40 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.884+0000 7f9663600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0cf320 0x7f965c166640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.884+0000 7f9663600640 1 --2- 172.21.15.17:0/776172548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f965c070ad0 0x7f965c06f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.884+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 >> 172.21.15.17:0/776172548 conn(0x7f965c0d1d60 msgr2=0x7f965c0b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.884+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 shutdown_connections 2024-09-10T23:29:06.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:06.884+0000 7f9663600640 1 -- 172.21.15.17:0/776172548 wait complete. 2024-09-10T23:29:06.903 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:29:07.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.052+0000 7fed3e600640 1 -- 172.21.15.17:0/3363460193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 msgr2=0x7fed380691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.052+0000 7fed3e600640 1 --2- 172.21.15.17:0/3363460193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 0x7fed380691b0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009840 tx=0x7fed2c01c700 comp rx=0 tx=0).stop 2024-09-10T23:29:07.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.052+0000 7fed3e600640 1 -- 172.21.15.17:0/3363460193 shutdown_connections 2024-09-10T23:29:07.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.052+0000 7fed3e600640 1 --2- 172.21.15.17:0/3363460193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 0x7fed380691b0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.052+0000 7fed3e600640 1 -- 172.21.15.17:0/3363460193 >> 172.21.15.17:0/3363460193 conn(0x7fed380d0380 msgr2=0x7fed380d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.052+0000 7fed3e600640 1 -- 172.21.15.17:0/3363460193 shutdown_connections 2024-09-10T23:29:07.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.052+0000 7fed3e600640 1 -- 172.21.15.17:0/3363460193 wait complete. 2024-09-10T23:29:07.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.052+0000 7fed3e600640 1 Processor -- start 2024-09-10T23:29:07.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.052+0000 7fed3e600640 1 -- start start 2024-09-10T23:29:07.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3e600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed380b0b80 0x7fed3809d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3e600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed380ccc00 0x7fed380ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 0x7fed3815b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed380696f0 con 0x7fed381614a0 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3e600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed380b5e00 con 0x7fed380b0b80 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3e600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed3816c6c0 con 0x7fed380ccc00 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 0x7fed3815b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 0x7fed3815b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33148/0 (socket says 172.21.15.17:33148) 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3dc00640 1 -- 172.21.15.17:0/3719975314 learned_addr learned my addr 172.21.15.17:0/3719975314 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3d200640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed380b0b80 0x7fed3809d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed37e00640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed380ccc00 0x7fed380ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3dc00640 1 -- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed380ccc00 msgr2=0x7fed380ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3dc00640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed380ccc00 0x7fed380ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3dc00640 1 -- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed380b0b80 msgr2=0x7fed3809d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3dc00640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed380b0b80 0x7fed3809d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3dc00640 1 -- 172.21.15.17:0/3719975314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed381fc1b0 con 0x7fed381614a0 2024-09-10T23:29:07.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed37e00640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed380ccc00 0x7fed380ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:07.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3dc00640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 0x7fed3815b690 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c730 tx=0x7fed3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed34c00640 1 -- 172.21.15.17:0/3719975314 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30003db0 con 0x7fed381614a0 2024-09-10T23:29:07.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed34c00640 1 -- 172.21.15.17:0/3719975314 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed3000ce40 con 0x7fed381614a0 2024-09-10T23:29:07.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed34c00640 1 -- 172.21.15.17:0/3719975314 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed300052d0 con 0x7fed381614a0 2024-09-10T23:29:07.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3815f4a0 con 0x7fed381614a0 2024-09-10T23:29:07.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3815fa60 con 0x7fed381614a0 2024-09-10T23:29:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.056+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed380691b0 con 0x7fed381614a0 2024-09-10T23:29:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.060+0000 7fed34c00640 1 -- 172.21.15.17:0/3719975314 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fed30005470 con 0x7fed381614a0 2024-09-10T23:29:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.060+0000 7fed34c00640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed180725e0 0x7fed18074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.060+0000 7fed34c00640 1 -- 172.21.15.17:0/3719975314 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fed30093270 con 0x7fed381614a0 2024-09-10T23:29:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.060+0000 7fed3d200640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed180725e0 0x7fed18074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.060+0000 7fed3d200640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed180725e0 0x7fed18074aa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0af000 tx=0x7fed2c0b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.064+0000 7fed34c00640 1 -- 172.21.15.17:0/3719975314 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fed3005e720 con 0x7fed381614a0 2024-09-10T23:29:07.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.272+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed3806e3a0 con 0x7fed381614a0 2024-09-10T23:29:07.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.272+0000 7fed34c00640 1 -- 172.21.15.17:0/3719975314 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5244 (secure 0 0 0) 0x7fed3005e020 con 0x7fed381614a0 2024-09-10T23:29:07.274 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:07.274 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":136,"btime":"2024-09-10T23:29:03:547935+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1319528493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1319528493},{"type":"v1","addr":"172.21.15.17:6833","nonce":1319528493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1685364651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1685364651},{"type":"v1","addr":"172.21.15.77:6836","nonce":1685364651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:28:34.352047+0000","modified":"2024-09-10T23:29:03.547919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10197},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9436":{"gid":9436,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/3587135392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3587135392},{"type":"v1","addr":"172.21.15.77:6837","nonce":3587135392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10197":{"gid":10197,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3849451590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3849451590},{"type":"v1","addr":"172.21.15.17:6835","nonce":3849451590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10197,"qdb_cluster":[10197]},"id":12}]} 2024-09-10T23:29:07.274 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 136 2024-09-10T23:29:07.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed180725e0 msgr2=0x7fed18074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed180725e0 0x7fed18074aa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fed2c0af000 tx=0x7fed2c0b2040 comp rx=0 tx=0).stop 2024-09-10T23:29:07.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 msgr2=0x7fed3815b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 0x7fed3815b690 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c730 tx=0x7fed3000cbf0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 shutdown_connections 2024-09-10T23:29:07.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed180725e0 0x7fed18074aa0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed381614a0 0x7fed3815b690 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed380ccc00 0x7fed380ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 --2- 172.21.15.17:0/3719975314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed380b0b80 0x7fed3809d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 >> 172.21.15.17:0/3719975314 conn(0x7fed380d0380 msgr2=0x7fed380ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 shutdown_connections 2024-09-10T23:29:07.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.276+0000 7fed3e600640 1 -- 172.21.15.17:0/3719975314 wait complete. 2024-09-10T23:29:07.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:29:07.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.440+0000 7f4f37c00640 1 -- 172.21.15.17:0/1639015028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3006e750 msgr2=0x7f4f3015b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.440+0000 7f4f37c00640 1 --2- 172.21.15.17:0/1639015028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3006e750 0x7f4f3015b240 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f4f300b4480 tx=0x7f4f2401c7d0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.440+0000 7f4f37c00640 1 -- 172.21.15.17:0/1639015028 shutdown_connections 2024-09-10T23:29:07.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.440+0000 7f4f37c00640 1 --2- 172.21.15.17:0/1639015028 >> v2:172.21.15.77:3300/0 conn(0x7f4f300cf230 0x7f4f30150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.440+0000 7f4f37c00640 1 --2- 172.21.15.17:0/1639015028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f3006e750 0x7f4f3015b240 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.440+0000 7f4f37c00640 1 -- 172.21.15.17:0/1639015028 >> 172.21.15.17:0/1639015028 conn(0x7f4f3006cfc0 msgr2=0x7f4f3006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.440+0000 7f4f37c00640 1 -- 172.21.15.17:0/1639015028 shutdown_connections 2024-09-10T23:29:07.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.440+0000 7f4f37c00640 1 -- 172.21.15.17:0/1639015028 wait complete. 2024-09-10T23:29:07.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 Processor -- start 2024-09-10T23:29:07.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 -- start start 2024-09-10T23:29:07.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f3006e750 0x7f4f30146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f300b32d0 0x7f4f3015c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f300cf230 0x7f4f3015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f300749f0 con 0x7f4f300cf230 2024-09-10T23:29:07.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f30074870 con 0x7f4f3006e750 2024-09-10T23:29:07.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4f30168090 con 0x7f4f300b32d0 2024-09-10T23:29:07.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f300cf230 0x7f4f3015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f300cf230 0x7f4f3015c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33176/0 (socket says 172.21.15.17:33176) 2024-09-10T23:29:07.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35c00640 1 -- 172.21.15.17:0/3776109882 learned_addr learned my addr 172.21.15.17:0/3776109882 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:07.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35200640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f3006e750 0x7f4f30146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35c00640 1 -- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f300b32d0 msgr2=0x7f4f3015c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35c00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f300b32d0 0x7f4f3015c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35c00640 1 -- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f3006e750 msgr2=0x7f4f30146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35c00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f3006e750 0x7f4f30146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35c00640 1 -- 172.21.15.17:0/3776109882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f30146690 con 0x7f4f300cf230 2024-09-10T23:29:07.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35200640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f3006e750 0x7f4f30146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:07.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f35c00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f300cf230 0x7f4f3015c7b0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800da10 tx=0x7f4f2800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f2cc00640 1 -- 172.21.15.17:0/3776109882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f28017070 con 0x7f4f300cf230 2024-09-10T23:29:07.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f2cc00640 1 -- 172.21.15.17:0/3776109882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f28004b30 con 0x7f4f300cf230 2024-09-10T23:29:07.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f300af7d0 con 0x7f4f300cf230 2024-09-10T23:29:07.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f2cc00640 1 -- 172.21.15.17:0/3776109882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800be60 con 0x7f4f300cf230 2024-09-10T23:29:07.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.444+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f300afd90 con 0x7f4f300cf230 2024-09-10T23:29:07.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.448+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f30150d70 con 0x7f4f300cf230 2024-09-10T23:29:07.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.448+0000 7f4f2cc00640 1 -- 172.21.15.17:0/3776109882 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4f28010460 con 0x7f4f300cf230 2024-09-10T23:29:07.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.448+0000 7f4f2cc00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f10072610 0x7f4f10074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.448+0000 7f4f2cc00640 1 -- 172.21.15.17:0/3776109882 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f4f28093830 con 0x7f4f300cf230 2024-09-10T23:29:07.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.448+0000 7f4f35200640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f10072610 0x7f4f10074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.448+0000 7f4f35200640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f10072610 0x7f4f10074ad0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4f240af000 tx=0x7f4f2401b010 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.452+0000 7f4f2cc00640 1 -- 172.21.15.17:0/3776109882 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4f28020070 con 0x7f4f300cf230 2024-09-10T23:29:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.628+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f300d0240 con 0x7f4f300cf230 2024-09-10T23:29:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.628+0000 7f4f2cc00640 1 -- 172.21.15.17:0/3776109882 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+16888 (secure 0 0 0) 0x7f4f2805ed70 con 0x7f4f300cf230 2024-09-10T23:29:07.632 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:07.632 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":177,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:28:35.947957+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:28:32.104576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-10T23:28:33.310367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:29:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f10072610 msgr2=0x7f4f10074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f10072610 0x7f4f10074ad0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4f240af000 tx=0x7f4f2401b010 comp rx=0 tx=0).stop 2024-09-10T23:29:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f300cf230 msgr2=0x7f4f3015c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f300cf230 0x7f4f3015c7b0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800da10 tx=0x7f4f2800ded0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 shutdown_connections 2024-09-10T23:29:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4f10072610 0x7f4f10074ad0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f300cf230 0x7f4f3015c7b0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f300b32d0 0x7f4f3015c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 --2- 172.21.15.17:0/3776109882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f3006e750 0x7f4f30146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 >> 172.21.15.17:0/3776109882 conn(0x7f4f3006cfc0 msgr2=0x7f4f30068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 shutdown_connections 2024-09-10T23:29:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.632+0000 7f4f37c00640 1 -- 172.21.15.17:0/3776109882 wait complete. 2024-09-10T23:29:07.652 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:29:07.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:29:07.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.796+0000 7fc34ac00640 1 -- 172.21.15.17:0/3571951933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf610 msgr2=0x7fc34415b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.796+0000 7fc34ac00640 1 --2- 172.21.15.17:0/3571951933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf610 0x7fc34415b240 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fc3440b44b0 tx=0x7fc32c01f0b0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.796+0000 7fc34ac00640 1 -- 172.21.15.17:0/3571951933 shutdown_connections 2024-09-10T23:29:07.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.796+0000 7fc34ac00640 1 --2- 172.21.15.17:0/3571951933 >> v2:172.21.15.77:3300/0 conn(0x7fc3440b32d0 0x7fc344150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.796+0000 7fc34ac00640 1 --2- 172.21.15.17:0/3571951933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf610 0x7fc34415b240 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.796+0000 7fc34ac00640 1 --2- 172.21.15.17:0/3571951933 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440cf230 0x7fc34406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.796+0000 7fc34ac00640 1 -- 172.21.15.17:0/3571951933 >> 172.21.15.17:0/3571951933 conn(0x7fc34406cfc0 msgr2=0x7fc34406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:07.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.796+0000 7fc34ac00640 1 -- 172.21.15.17:0/3571951933 shutdown_connections 2024-09-10T23:29:07.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.796+0000 7fc34ac00640 1 -- 172.21.15.17:0/3571951933 wait complete. 2024-09-10T23:29:07.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 Processor -- start 2024-09-10T23:29:07.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 -- start start 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3440b32d0 0x7fc3440b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf230 0x7fc344133050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440cf610 0x7fc3440cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440d0120 con 0x7fc3440cf230 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440cffa0 con 0x7fc3440b32d0 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc3440d02a0 con 0x7fc3440cf610 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc33b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf230 0x7fc344133050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc33b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf230 0x7fc344133050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33206/0 (socket says 172.21.15.17:33206) 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc33b400640 1 -- 172.21.15.17:0/2383602885 learned_addr learned my addr 172.21.15.17:0/2383602885 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc348c00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440cf610 0x7fc3440cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc343e00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3440b32d0 0x7fc3440b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc33b400640 1 -- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440cf610 msgr2=0x7fc3440cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc33b400640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440cf610 0x7fc3440cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc33b400640 1 -- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3440b32d0 msgr2=0x7fc3440b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:07.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc33b400640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3440b32d0 0x7fc3440b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:07.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc33b400640 1 -- 172.21.15.17:0/2383602885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc344133f60 con 0x7fc3440cf230 2024-09-10T23:29:07.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc33b400640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf230 0x7fc344133050 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0b3040 tx=0x7fc32c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc340c00640 1 -- 172.21.15.17:0/2383602885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0b5040 con 0x7fc3440cf230 2024-09-10T23:29:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc340c00640 1 -- 172.21.15.17:0/2383602885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc32c005320 con 0x7fc3440cf230 2024-09-10T23:29:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3441339a0 con 0x7fc3440cf230 2024-09-10T23:29:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc340c00640 1 -- 172.21.15.17:0/2383602885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0046d0 con 0x7fc3440cf230 2024-09-10T23:29:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.800+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3440cd7e0 con 0x7fc3440cf230 2024-09-10T23:29:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.804+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc34406e750 con 0x7fc3440cf230 2024-09-10T23:29:07.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.804+0000 7fc340c00640 1 -- 172.21.15.17:0/2383602885 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc32c004890 con 0x7fc3440cf230 2024-09-10T23:29:07.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.804+0000 7fc340c00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3200725e0 0x7fc320074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:07.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.804+0000 7fc340c00640 1 -- 172.21.15.17:0/2383602885 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fc32c130150 con 0x7fc3440cf230 2024-09-10T23:29:07.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.804+0000 7fc343e00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3200725e0 0x7fc320074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:07.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.804+0000 7fc343e00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3200725e0 0x7fc320074aa0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc3340058d0 tx=0x7fc334005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:07.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:07.808+0000 7fc340c00640 1 -- 172.21.15.17:0/2383602885 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc32c0bf060 con 0x7fc3440cf230 2024-09-10T23:29:08.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.016+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc344165c90 con 0x7fc3440cf230 2024-09-10T23:29:08.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.016+0000 7fc340c00640 1 -- 172.21.15.17:0/2383602885 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5244 (secure 0 0 0) 0x7fc32c018c10 con 0x7fc3440cf230 2024-09-10T23:29:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:08.019 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":136,"btime":"2024-09-10T23:29:03:547935+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1319528493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1319528493},{"type":"v1","addr":"172.21.15.17:6833","nonce":1319528493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1685364651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1685364651},{"type":"v1","addr":"172.21.15.77:6836","nonce":1685364651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:28:34.352047+0000","modified":"2024-09-10T23:29:03.547919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10197},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9436":{"gid":9436,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/3587135392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3587135392},{"type":"v1","addr":"172.21.15.77:6837","nonce":3587135392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10197":{"gid":10197,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3849451590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3849451590},{"type":"v1","addr":"172.21.15.17:6835","nonce":3849451590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10197,"qdb_cluster":[10197]},"id":12}]} 2024-09-10T23:29:08.019 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 136 2024-09-10T23:29:08.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3200725e0 msgr2=0x7fc320074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3200725e0 0x7fc320074aa0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc3340058d0 tx=0x7fc334005860 comp rx=0 tx=0).stop 2024-09-10T23:29:08.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf230 msgr2=0x7fc344133050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf230 0x7fc344133050 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0b3040 tx=0x7fc32c005780 comp rx=0 tx=0).stop 2024-09-10T23:29:08.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 shutdown_connections 2024-09-10T23:29:08.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3200725e0 0x7fc320074aa0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3440cf610 0x7fc3440cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3440cf230 0x7fc344133050 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 --2- 172.21.15.17:0/2383602885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3440b32d0 0x7fc3440b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 >> 172.21.15.17:0/2383602885 conn(0x7fc34406cfc0 msgr2=0x7fc34415c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 shutdown_connections 2024-09-10T23:29:08.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.020+0000 7fc34ac00640 1 -- 172.21.15.17:0/2383602885 wait complete. 2024-09-10T23:29:08.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:29:08.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 -- 172.21.15.17:0/3237479787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 msgr2=0x7fa1d00ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/3237479787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 0x7fa1d00ce720 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0073bd0 tx=0x7fa1b801c830 comp rx=0 tx=0).stop 2024-09-10T23:29:08.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 -- 172.21.15.17:0/3237479787 shutdown_connections 2024-09-10T23:29:08.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/3237479787 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1d00cec60 0x7fa1d00cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/3237479787 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 0x7fa1d00ce720 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/3237479787 >> v2:172.21.15.77:3300/0 conn(0x7fa1d015f350 0x7fa1d00b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 -- 172.21.15.17:0/3237479787 >> 172.21.15.17:0/3237479787 conn(0x7fa1d00d1d10 msgr2=0x7fa1d00d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 -- 172.21.15.17:0/3237479787 shutdown_connections 2024-09-10T23:29:08.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 -- 172.21.15.17:0/3237479787 wait complete. 2024-09-10T23:29:08.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 Processor -- start 2024-09-10T23:29:08.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 -- start start 2024-09-10T23:29:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1d00cec60 0x7fa1d006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d015f350 0x7fa1d01fb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 0x7fa1d01fb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d00b19e0 con 0x7fa1d015f730 2024-09-10T23:29:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d00b1860 con 0x7fa1d015f350 2024-09-10T23:29:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1d5c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d00b1b60 con 0x7fa1d00cec60 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1cf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 0x7fa1d01fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1cf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 0x7fa1d01fb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33218/0 (socket says 172.21.15.17:33218) 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1cf400640 1 -- 172.21.15.17:0/2768593006 learned_addr learned my addr 172.21.15.17:0/2768593006 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1c6000640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d015f350 0x7fa1d01fb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1cea00640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1d00cec60 0x7fa1d006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1cf400640 1 -- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1d00cec60 msgr2=0x7fa1d006eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1cf400640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1d00cec60 0x7fa1d006eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1cf400640 1 -- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d015f350 msgr2=0x7fa1d01fb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1cf400640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d015f350 0x7fa1d01fb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.188+0000 7fa1cf400640 1 -- 172.21.15.17:0/2768593006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d006f560 con 0x7fa1d015f730 2024-09-10T23:29:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1cf400640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 0x7fa1d01fb810 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800eab0 tx=0x7fa1c800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1c7400640 1 -- 172.21.15.17:0/2768593006 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8004b30 con 0x7fa1d015f730 2024-09-10T23:29:08.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1c7400640 1 -- 172.21.15.17:0/2768593006 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1c8004dc0 con 0x7fa1d015f730 2024-09-10T23:29:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d006f840 con 0x7fa1d015f730 2024-09-10T23:29:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1c7400640 1 -- 172.21.15.17:0/2768593006 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8005280 con 0x7fa1d015f730 2024-09-10T23:29:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d01535c0 con 0x7fa1d015f730 2024-09-10T23:29:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d006fcf0 con 0x7fa1d015f730 2024-09-10T23:29:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1c7400640 1 -- 172.21.15.17:0/2768593006 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa1c8020030 con 0x7fa1d015f730 2024-09-10T23:29:08.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1c7400640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1ac0725e0 0x7fa1ac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1c7400640 1 -- 172.21.15.17:0/2768593006 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7fa1c8093f90 con 0x7fa1d015f730 2024-09-10T23:29:08.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.192+0000 7fa1cea00640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1ac0725e0 0x7fa1ac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.196+0000 7fa1cea00640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1ac0725e0 0x7fa1ac074aa0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009b70 tx=0x7fa1c00091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.196+0000 7fa1c7400640 1 -- 172.21.15.17:0/2768593006 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa1c805f4d0 con 0x7fa1d015f730 2024-09-10T23:29:08.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1d00b20f0 con 0x7fa1d015f730 2024-09-10T23:29:08.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1c7400640 1 -- 172.21.15.17:0/2768593006 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5244 (secure 0 0 0) 0x7fa1c805edd0 con 0x7fa1d015f730 2024-09-10T23:29:08.409 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:08.409 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":136,"btime":"2024-09-10T23:29:03:547935+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1319528493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1319528493},{"type":"v1","addr":"172.21.15.17:6833","nonce":1319528493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1685364651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1685364651},{"type":"v1","addr":"172.21.15.77:6836","nonce":1685364651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129}],"filesystems":[{"mdsmap":{"epoch":136,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T23:28:34.352047+0000","modified":"2024-09-10T23:29:03.547919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10197},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9436":{"gid":9436,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.77:6837/3587135392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3587135392},{"type":"v1","addr":"172.21.15.77:6837","nonce":3587135392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10197":{"gid":10197,"name":"a","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/3849451590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3849451590},{"type":"v1","addr":"172.21.15.17:6835","nonce":3849451590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10197,"qdb_cluster":[10197]},"id":12}]} 2024-09-10T23:29:08.409 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 136 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1ac0725e0 msgr2=0x7fa1ac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1ac0725e0 0x7fa1ac074aa0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009b70 tx=0x7fa1c00091e0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 msgr2=0x7fa1d01fb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 0x7fa1d01fb810 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800eab0 tx=0x7fa1c800ef70 comp rx=0 tx=0).stop 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 shutdown_connections 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa1ac0725e0 0x7fa1ac074aa0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1d015f730 0x7fa1d01fb810 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d015f350 0x7fa1d01fb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 --2- 172.21.15.17:0/2768593006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1d00cec60 0x7fa1d006eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 >> 172.21.15.17:0/2768593006 conn(0x7fa1d00d1d10 msgr2=0x7fa1d00d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 shutdown_connections 2024-09-10T23:29:08.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.408+0000 7fa1d5c00640 1 -- 172.21.15.17:0/2768593006 wait complete. 2024-09-10T23:29:08.432 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:29:08.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:29:08.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:29:08.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.576+0000 7f33d7200640 1 -- 172.21.15.17:0/1003169397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d80b0ca0 msgr2=0x7f33d815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.576+0000 7f33d7200640 1 --2- 172.21.15.17:0/1003169397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d80b0ca0 0x7f33d815eaf0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009900 tx=0x7f33c401c790 comp rx=0 tx=0).stop 2024-09-10T23:29:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 -- 172.21.15.17:0/1003169397 shutdown_connections 2024-09-10T23:29:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 --2- 172.21.15.17:0/1003169397 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33d815f030 0x7f33d815f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 --2- 172.21.15.17:0/1003169397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d80b0ca0 0x7f33d815eaf0 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 -- 172.21.15.17:0/1003169397 >> 172.21.15.17:0/1003169397 conn(0x7f33d80d0380 msgr2=0x7f33d80d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 -- 172.21.15.17:0/1003169397 shutdown_connections 2024-09-10T23:29:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 -- 172.21.15.17:0/1003169397 wait complete. 2024-09-10T23:29:08.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 Processor -- start 2024-09-10T23:29:08.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 -- start start 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d806ce20 0x7f33d80ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33d80b0ca0 0x7f33d80ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d815f030 0x7f33d81faee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f33d806dda0 con 0x7f33d806ce20 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f33d806dc20 con 0x7f33d815f030 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f33d806df20 con 0x7f33d80b0ca0 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d806ce20 0x7f33d80ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d806ce20 0x7f33d80ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33236/0 (socket says 172.21.15.17:33236) 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5e00640 1 -- 172.21.15.17:0/1317509170 learned_addr learned my addr 172.21.15.17:0/1317509170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5400640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33d80b0ca0 0x7f33d80ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d6800640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d815f030 0x7f33d81faee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5e00640 1 -- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33d80b0ca0 msgr2=0x7f33d80ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5e00640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33d80b0ca0 0x7f33d80ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5e00640 1 -- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d815f030 msgr2=0x7f33d81faee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5e00640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d815f030 0x7f33d81faee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5e00640 1 -- 172.21.15.17:0/1317509170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d81f88c0 con 0x7f33d806ce20 2024-09-10T23:29:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.580+0000 7f33d5e00640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d806ce20 0x7f33d80ce970 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f33c800c450 tx=0x7f33c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33ce000640 1 -- 172.21.15.17:0/1317509170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c80052d0 con 0x7f33d806ce20 2024-09-10T23:29:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33ce000640 1 -- 172.21.15.17:0/1317509170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33c8005470 con 0x7f33d806ce20 2024-09-10T23:29:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33ce000640 1 -- 172.21.15.17:0/1317509170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8012890 con 0x7f33d806ce20 2024-09-10T23:29:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d81f7b00 con 0x7f33d806ce20 2024-09-10T23:29:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d81f80c0 con 0x7f33d806ce20 2024-09-10T23:29:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d815eaf0 con 0x7f33d806ce20 2024-09-10T23:29:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33ce000640 1 -- 172.21.15.17:0/1317509170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f33c8003620 con 0x7f33d806ce20 2024-09-10T23:29:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33ce000640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33b8072610 0x7f33b8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33ce000640 1 -- 172.21.15.17:0/1317509170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f33c8092dc0 con 0x7f33d806ce20 2024-09-10T23:29:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.584+0000 7f33d5400640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33b8072610 0x7f33b8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.588+0000 7f33d5400640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33b8072610 0x7f33b8074ad0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f33c40af000 tx=0x7f33c401afd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.588+0000 7f33ce000640 1 -- 172.21.15.17:0/1317509170 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f33c805dd70 con 0x7f33d806ce20 2024-09-10T23:29:08.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.764+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33d80ca580 con 0x7f33d806ce20 2024-09-10T23:29:08.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33ce000640 1 -- 172.21.15.17:0/1317509170 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+16888 (secure 0 0 0) 0x7f33c80627a0 con 0x7f33d806ce20 2024-09-10T23:29:08.767 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:08.769 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":177,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:28:35.947957+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:28:32.104576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-10T23:28:33.310367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:29:08.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33b8072610 msgr2=0x7f33b8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33b8072610 0x7f33b8074ad0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f33c40af000 tx=0x7f33c401afd0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d806ce20 msgr2=0x7f33d80ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d806ce20 0x7f33d80ce970 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f33c800c450 tx=0x7f33c800c910 comp rx=0 tx=0).stop 2024-09-10T23:29:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 shutdown_connections 2024-09-10T23:29:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f33b8072610 0x7f33b8074ad0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33d815f030 0x7f33d81faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33d80b0ca0 0x7f33d80ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 --2- 172.21.15.17:0/1317509170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33d806ce20 0x7f33d80ce970 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 >> 172.21.15.17:0/1317509170 conn(0x7f33d80d0380 msgr2=0x7f33d80cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 shutdown_connections 2024-09-10T23:29:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.768+0000 7f33d7200640 1 -- 172.21.15.17:0/1317509170 wait complete. 2024-09-10T23:29:08.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:29:08.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 -- 172.21.15.17:0/4105711728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b80cedf0 msgr2=0x7f31b80b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 --2- 172.21.15.17:0/4105711728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b80cedf0 0x7f31b80b4bf0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f31b8073640 tx=0x7f31a401c800 comp rx=0 tx=0).stop 2024-09-10T23:29:08.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 -- 172.21.15.17:0/4105711728 shutdown_connections 2024-09-10T23:29:08.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 --2- 172.21.15.17:0/4105711728 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b5130 0x7f31b815fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 --2- 172.21.15.17:0/4105711728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b80cedf0 0x7f31b80b4bf0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 --2- 172.21.15.17:0/4105711728 >> v2:172.21.15.77:3300/0 conn(0x7f31b815be80 0x7f31b80d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 -- 172.21.15.17:0/4105711728 >> 172.21.15.17:0/4105711728 conn(0x7f31b80d1da0 msgr2=0x7f31b80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:08.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 -- 172.21.15.17:0/4105711728 shutdown_connections 2024-09-10T23:29:08.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 -- 172.21.15.17:0/4105711728 wait complete. 2024-09-10T23:29:08.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.976+0000 7f31bcc00640 1 Processor -- start 2024-09-10T23:29:08.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 -- start start 2024-09-10T23:29:08.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b5130 0x7f31b8152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b815be80 0x7f31b80ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b81fbc70 0x7f31b8152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f31b80ccc50 con 0x7f31b81fbc70 2024-09-10T23:29:08.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31b80ccad0 con 0x7f31b815be80 2024-09-10T23:29:08.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f31b80ccdd0 con 0x7f31b80b5130 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b81fbc70 0x7f31b8152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b5130 0x7f31b8152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b81fbc70 0x7f31b8152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33254/0 (socket says 172.21.15.17:33254) 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b6800640 1 -- 172.21.15.17:0/1736349324 learned_addr learned my addr 172.21.15.17:0/1736349324 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b5400640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b815be80 0x7f31b80ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b6800640 1 -- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b5130 msgr2=0x7f31b8152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b6800640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b5130 0x7f31b8152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b6800640 1 -- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b815be80 msgr2=0x7f31b80ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b6800640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b815be80 0x7f31b80ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b6800640 1 -- 172.21.15.17:0/1736349324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b81536a0 con 0x7f31b81fbc70 2024-09-10T23:29:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b5e00640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b5130 0x7f31b8152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:08.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31b6800640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b81fbc70 0x7f31b8152710 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f31b000ea20 tx=0x7f31b000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31ae000640 1 -- 172.21.15.17:0/1736349324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b000cde0 con 0x7f31b81fbc70 2024-09-10T23:29:08.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31ae000640 1 -- 172.21.15.17:0/1736349324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31b0004c40 con 0x7f31b81fbc70 2024-09-10T23:29:08.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31ae000640 1 -- 172.21.15.17:0/1736349324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0005280 con 0x7f31b81fbc70 2024-09-10T23:29:08.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b8157a40 con 0x7f31b81fbc70 2024-09-10T23:29:08.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b80c8fa0 con 0x7f31b81fbc70 2024-09-10T23:29:08.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.980+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b80b4bf0 con 0x7f31b81fbc70 2024-09-10T23:29:08.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.984+0000 7f31ae000640 1 -- 172.21.15.17:0/1736349324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f31b000f040 con 0x7f31b81fbc70 2024-09-10T23:29:08.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.984+0000 7f31ae000640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3198072610 0x7f3198074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:08.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.984+0000 7f31ae000640 1 -- 172.21.15.17:0/1736349324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 6101+0+0 (secure 0 0 0) 0x7f31b0093960 con 0x7f31b81fbc70 2024-09-10T23:29:08.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.984+0000 7f31b5e00640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3198072610 0x7f3198074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:08.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.984+0000 7f31b5e00640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3198072610 0x7f3198074ad0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f31a800bec0 tx=0x7f31a800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:08.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:08.988+0000 7f31ae000640 1 -- 172.21.15.17:0/1736349324 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f31b0016030 con 0x7f31b81fbc70 2024-09-10T23:29:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.196+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f31b80c8be0 con 0x7f31b81fbc70 2024-09-10T23:29:09.199 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:29:09.196+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:29:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.200+0000 7f31ae000640 1 -- 172.21.15.17:0/1736349324 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v137) ==== 161+0+0 (secure 0 0 0) 0x7f31b005e850 con 0x7f31b81fbc70 2024-09-10T23:29:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:29:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3198072610 msgr2=0x7f3198074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3198072610 0x7f3198074ad0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f31a800bec0 tx=0x7f31a800b2e0 comp rx=0 tx=0).stop 2024-09-10T23:29:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b81fbc70 msgr2=0x7f31b8152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b81fbc70 0x7f31b8152710 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f31b000ea20 tx=0x7f31b000eee0 comp rx=0 tx=0).stop 2024-09-10T23:29:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 shutdown_connections 2024-09-10T23:29:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3198072610 0x7f3198074ad0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b81fbc70 0x7f31b8152710 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b815be80 0x7f31b80ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 --2- 172.21.15.17:0/1736349324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b5130 0x7f31b8152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 >> 172.21.15.17:0/1736349324 conn(0x7f31b80d1da0 msgr2=0x7f31b80709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 shutdown_connections 2024-09-10T23:29:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.204+0000 7f31bcc00640 1 -- 172.21.15.17:0/1736349324 wait complete. 2024-09-10T23:29:09.226 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:29:09.270 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:29:09.270 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:29:09.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 -- 172.21.15.17:0/2362935141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f972c0051d0 msgr2=0x7f972c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:09.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 --2- 172.21.15.17:0/2362935141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f972c0051d0 0x7f972c00b9d0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f9740001f50 tx=0x7f974001cc40 comp rx=0 tx=0).stop 2024-09-10T23:29:09.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f9747200640 1 -- 172.21.15.17:0/2362935141 reap_dead start 2024-09-10T23:29:09.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 -- 172.21.15.17:0/2362935141 shutdown_connections 2024-09-10T23:29:09.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 -- 172.21.15.17:0/2362935141 >> 172.21.15.17:0/2362935141 conn(0x7f974809d0f0 msgr2=0x7f97480d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:09.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 -- 172.21.15.17:0/2362935141 shutdown_connections 2024-09-10T23:29:09.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 -- 172.21.15.17:0/2362935141 wait complete. 2024-09-10T23:29:09.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 Processor -- start 2024-09-10T23:29:09.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 -- start start 2024-09-10T23:29:09.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f972c0051d0 0x7f974815f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815fbf0 0x7f97481f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97481f43d0 0x7f97480b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f97480b50e0 con 0x7f97481f43d0 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97480b2cb0 con 0x7f974815fbf0 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f974ca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f97480b5260 con 0x7f972c0051d0 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f9747200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97481f43d0 0x7f97480b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f9747200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97481f43d0 0x7f97480b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33292/0 (socket says 172.21.15.17:33292) 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.380+0000 7f9747200640 1 -- 172.21.15.17:0/4263223302 learned_addr learned my addr 172.21.15.17:0/4263223302 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f9746800640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f972c0051d0 0x7f974815f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:09.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f973fe00640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815fbf0 0x7f97481f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:09.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f9747200640 1 -- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f972c0051d0 msgr2=0x7f974815f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:09.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f9747200640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f972c0051d0 0x7f974815f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:09.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f9747200640 1 -- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815fbf0 msgr2=0x7f97481f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:09.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f9747200640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815fbf0 0x7f97481f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:09.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f9747200640 1 -- 172.21.15.17:0/4263223302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9748160090 con 0x7f97481f43d0 2024-09-10T23:29:09.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f973fe00640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815fbf0 0x7f97481f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:09.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f9747200640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97481f43d0 0x7f97480b7c30 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f9740001f50 tx=0x7f9740001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:09.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f973ea00640 1 -- 172.21.15.17:0/4263223302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740001ba0 con 0x7f97481f43d0 2024-09-10T23:29:09.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9748160370 con 0x7f97481f43d0 2024-09-10T23:29:09.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f973ea00640 1 -- 172.21.15.17:0/4263223302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97400b4030 con 0x7f97481f43d0 2024-09-10T23:29:09.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f973ea00640 1 -- 172.21.15.17:0/4263223302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740006c50 con 0x7f97481f43d0 2024-09-10T23:29:09.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9748154f90 con 0x7f97481f43d0 2024-09-10T23:29:09.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97481605b0 con 0x7f97481f43d0 2024-09-10T23:29:09.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.384+0000 7f973ea00640 1 -- 172.21.15.17:0/4263223302 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9740006480 con 0x7f97481f43d0 2024-09-10T23:29:09.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.388+0000 7f973ea00640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f97240725e0 0x7f9724074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:09.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.388+0000 7f973ea00640 1 -- 172.21.15.17:0/4263223302 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6187+0+0 (secure 0 0 0) 0x7f974012d7e0 con 0x7f97481f43d0 2024-09-10T23:29:09.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.388+0000 7f9746800640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f97240725e0 0x7f9724074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:09.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.388+0000 7f9746800640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f97240725e0 0x7f9724074aa0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9738000c10 tx=0x7f97380011d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.392+0000 7f973ea00640 1 -- 172.21.15.17:0/4263223302 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f97481605b0 con 0x7f97481f43d0 2024-09-10T23:29:09.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:09.604+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f974815f300 con 0x7f97481f43d0 2024-09-10T23:29:10.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.200+0000 7f973ea00640 1 -- 172.21.15.17:0/4263223302 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v138) ==== 104+0+0 (secure 0 0 0) 0x7f97400169f0 con 0x7f97481f43d0 2024-09-10T23:29:10.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f97240725e0 msgr2=0x7f9724074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f97240725e0 0x7f9724074aa0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9738000c10 tx=0x7f97380011d0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97481f43d0 msgr2=0x7f97480b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97481f43d0 0x7f97480b7c30 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f9740001f50 tx=0x7f9740001940 comp rx=0 tx=0).stop 2024-09-10T23:29:10.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 shutdown_connections 2024-09-10T23:29:10.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f97240725e0 0x7f9724074aa0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97481f43d0 0x7f97480b7c30 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f974815fbf0 0x7f97481f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 --2- 172.21.15.17:0/4263223302 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f972c0051d0 0x7f974815f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 >> 172.21.15.17:0/4263223302 conn(0x7f974809d0f0 msgr2=0x7f97480ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:10.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 shutdown_connections 2024-09-10T23:29:10.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.204+0000 7f974ca00640 1 -- 172.21.15.17:0/4263223302 wait complete. 2024-09-10T23:29:10.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:29:10.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 -- 172.21.15.17:0/3374528129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 msgr2=0x7f73b40d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 --2- 172.21.15.17:0/3374528129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 0x7f73b40d2610 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009bc0 tx=0x7f73ac01cba0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 -- 172.21.15.17:0/3374528129 shutdown_connections 2024-09-10T23:29:10.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 --2- 172.21.15.17:0/3374528129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 0x7f73b40d2610 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 -- 172.21.15.17:0/3374528129 >> 172.21.15.17:0/3374528129 conn(0x7f73b409b040 msgr2=0x7f73b40d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:10.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 -- 172.21.15.17:0/3374528129 shutdown_connections 2024-09-10T23:29:10.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 -- 172.21.15.17:0/3374528129 wait complete. 2024-09-10T23:29:10.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 Processor -- start 2024-09-10T23:29:10.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 -- start start 2024-09-10T23:29:10.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b40cec60 0x7f73b40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:10.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73b415f1c0 0x7f73b4159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:10.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 0x7f73b4151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:10.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f73b416a120 con 0x7f73b415f5a0 2024-09-10T23:29:10.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73b4169fa0 con 0x7f73b40cec60 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b9400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f73b416a2a0 con 0x7f73b415f1c0 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 0x7f73b4151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 0x7f73b4151cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33300/0 (socket says 172.21.15.17:33300) 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.432+0000 7f73b3200640 1 -- 172.21.15.17:0/1937957284 learned_addr learned my addr 172.21.15.17:0/1937957284 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73abe00640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73b415f1c0 0x7f73b4159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b2800640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b40cec60 0x7f73b40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b3200640 1 -- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73b415f1c0 msgr2=0x7f73b4159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b3200640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73b415f1c0 0x7f73b4159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b3200640 1 -- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b40cec60 msgr2=0x7f73b40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:10.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b3200640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b40cec60 0x7f73b40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:10.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b3200640 1 -- 172.21.15.17:0/1937957284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b415a2f0 con 0x7f73b415f5a0 2024-09-10T23:29:10.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b3200640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 0x7f73b4151cf0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0197b0 tx=0x7f73ac003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:10.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73aaa00640 1 -- 172.21.15.17:0/1937957284 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0bb070 con 0x7f73b415f5a0 2024-09-10T23:29:10.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73aaa00640 1 -- 172.21.15.17:0/1937957284 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73ac004d40 con 0x7f73b415f5a0 2024-09-10T23:29:10.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73aaa00640 1 -- 172.21.15.17:0/1937957284 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0b2040 con 0x7f73b415f5a0 2024-09-10T23:29:10.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b4156ac0 con 0x7f73b415f5a0 2024-09-10T23:29:10.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b4155ea0 con 0x7f73b415f5a0 2024-09-10T23:29:10.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b40d2610 con 0x7f73b415f5a0 2024-09-10T23:29:10.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.436+0000 7f73aaa00640 1 -- 172.21.15.17:0/1937957284 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f73ac0b5030 con 0x7f73b415f5a0 2024-09-10T23:29:10.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.440+0000 7f73aaa00640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73900725e0 0x7f7390074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:10.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.440+0000 7f73aaa00640 1 -- 172.21.15.17:0/1937957284 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6187+0+0 (secure 0 0 0) 0x7f73ac12ce40 con 0x7f73b415f5a0 2024-09-10T23:29:10.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.440+0000 7f73b2800640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73900725e0 0x7f7390074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:10.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.440+0000 7f73b2800640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73900725e0 0x7f7390074aa0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f73b40cda10 tx=0x7f73a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:10.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.444+0000 7f73aaa00640 1 -- 172.21.15.17:0/1937957284 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f73b415a2f0 con 0x7f73b415f5a0 2024-09-10T23:29:10.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:10.620+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f73b415aa70 con 0x7f73b415f5a0 2024-09-10T23:29:11.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.580+0000 7f73aaa00640 1 -- 172.21.15.17:0/1937957284 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v179) ==== 181+0+0 (secure 0 0 0) 0x7f73ac016790 con 0x7f73b415f5a0 2024-09-10T23:29:11.582 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:29:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73900725e0 msgr2=0x7f7390074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73900725e0 0x7f7390074aa0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f73b40cda10 tx=0x7f73a4009040 comp rx=0 tx=0).stop 2024-09-10T23:29:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 msgr2=0x7f73b4151cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 0x7f73b4151cf0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f73ac0197b0 tx=0x7f73ac003f60 comp rx=0 tx=0).stop 2024-09-10T23:29:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 shutdown_connections 2024-09-10T23:29:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f73900725e0 0x7f7390074aa0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b415f5a0 0x7f73b4151cf0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f73b415f1c0 0x7f73b4159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 --2- 172.21.15.17:0/1937957284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b40cec60 0x7f73b40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 >> 172.21.15.17:0/1937957284 conn(0x7f73b409b040 msgr2=0x7f73b415af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 shutdown_connections 2024-09-10T23:29:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.584+0000 7f73b9400640 1 -- 172.21.15.17:0/1937957284 wait complete. 2024-09-10T23:29:11.612 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:29:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 -- 172.21.15.17:0/1822334104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23000cfde0 msgr2=0x7f23000d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 --2- 172.21.15.17:0/1822334104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23000cfde0 0x7f23000d0230 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f23000b48e0 tx=0x7f22e801c6e0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 -- 172.21.15.17:0/1822334104 shutdown_connections 2024-09-10T23:29:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 --2- 172.21.15.17:0/1822334104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23000cfde0 0x7f23000d0230 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 --2- 172.21.15.17:0/1822334104 >> v2:172.21.15.77:3300/0 conn(0x7f230015eef0 0x7f230006eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 -- 172.21.15.17:0/1822334104 >> 172.21.15.17:0/1822334104 conn(0x7f230009a9f0 msgr2=0x7f230009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 -- 172.21.15.17:0/1822334104 shutdown_connections 2024-09-10T23:29:11.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 -- 172.21.15.17:0/1822334104 wait complete. 2024-09-10T23:29:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 Processor -- start 2024-09-10T23:29:11.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 -- start start 2024-09-10T23:29:11.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23000cfde0 0x7f23000c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000d1cb0 0x7f23001399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230015eef0 0x7f230014bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f230016ad80 con 0x7f230015eef0 2024-09-10T23:29:11.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f230016ac00 con 0x7f23000d1cb0 2024-09-10T23:29:11.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.768+0000 7f2305400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f230016af00 con 0x7f23000cfde0 2024-09-10T23:29:11.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22ff200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230015eef0 0x7f230014bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22f5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000d1cb0 0x7f23001399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22fe800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23000cfde0 0x7f23000c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22ff200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230015eef0 0x7f230014bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33308/0 (socket says 172.21.15.17:33308) 2024-09-10T23:29:11.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22ff200640 1 -- 172.21.15.17:0/2659770426 learned_addr learned my addr 172.21.15.17:0/2659770426 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:11.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22ff200640 1 -- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23000cfde0 msgr2=0x7f23000c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22ff200640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23000cfde0 0x7f23000c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22ff200640 1 -- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000d1cb0 msgr2=0x7f23001399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:11.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22ff200640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000d1cb0 0x7f23001399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:11.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22ff200640 1 -- 172.21.15.17:0/2659770426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230006ee70 con 0x7f230015eef0 2024-09-10T23:29:11.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22ff200640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230015eef0 0x7f230014bd20 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f22f800c780 tx=0x7f22f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:11.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22f7400640 1 -- 172.21.15.17:0/2659770426 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f8004b70 con 0x7f230015eef0 2024-09-10T23:29:11.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22f7400640 1 -- 172.21.15.17:0/2659770426 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22f8004e00 con 0x7f230015eef0 2024-09-10T23:29:11.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22f7400640 1 -- 172.21.15.17:0/2659770426 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f800aa90 con 0x7f230015eef0 2024-09-10T23:29:11.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23000c8160 con 0x7f230015eef0 2024-09-10T23:29:11.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23000b0f50 con 0x7f230015eef0 2024-09-10T23:29:11.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23000c8550 con 0x7f230015eef0 2024-09-10T23:29:11.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.772+0000 7f22f7400640 1 -- 172.21.15.17:0/2659770426 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f22f800ac30 con 0x7f230015eef0 2024-09-10T23:29:11.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.776+0000 7f22f7400640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22dc072610 0x7f22dc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:11.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.776+0000 7f22f7400640 1 -- 172.21.15.17:0/2659770426 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 5749+0+0 (secure 0 0 0) 0x7f22f8093410 con 0x7f230015eef0 2024-09-10T23:29:11.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.776+0000 7f22fe800640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22dc072610 0x7f22dc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:11.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.776+0000 7f22fe800640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22dc072610 0x7f22dc074ad0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f22f000ab40 tx=0x7f22f000a250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:11.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.780+0000 7f22f7400640 1 -- 172.21.15.17:0/2659770426 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f22f8020070 con 0x7f230015eef0 2024-09-10T23:29:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:11.960+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f23000d0230 con 0x7f230015eef0 2024-09-10T23:29:12.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.588+0000 7f22f7400640 1 -- 172.21.15.17:0/2659770426 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v180) ==== 169+0+0 (secure 0 0 0) 0x7f22f805e460 con 0x7f230015eef0 2024-09-10T23:29:12.589 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:29:12.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22dc072610 msgr2=0x7f22dc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:12.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22dc072610 0x7f22dc074ad0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f22f000ab40 tx=0x7f22f000a250 comp rx=0 tx=0).stop 2024-09-10T23:29:12.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230015eef0 msgr2=0x7f230014bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:12.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230015eef0 0x7f230014bd20 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f22f800c780 tx=0x7f22f800cc40 comp rx=0 tx=0).stop 2024-09-10T23:29:12.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 shutdown_connections 2024-09-10T23:29:12.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22dc072610 0x7f22dc074ad0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:12.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f230015eef0 0x7f230014bd20 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:12.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23000d1cb0 0x7f23001399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:12.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 --2- 172.21.15.17:0/2659770426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23000cfde0 0x7f23000c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:12.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 >> 172.21.15.17:0/2659770426 conn(0x7f230009a9f0 msgr2=0x7f2300160230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:12.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 shutdown_connections 2024-09-10T23:29:12.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.592+0000 7f2305400640 1 -- 172.21.15.17:0/2659770426 wait complete. 2024-09-10T23:29:12.629 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:29:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 -- 172.21.15.17:0/3910708320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415be80 msgr2=0x7ff4f40d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 --2- 172.21.15.17:0/3910708320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415be80 0x7ff4f40d28c0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009840 tx=0x7ff4e801c790 comp rx=0 tx=0).stop 2024-09-10T23:29:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 -- 172.21.15.17:0/3910708320 shutdown_connections 2024-09-10T23:29:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 --2- 172.21.15.17:0/3910708320 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415be80 0x7ff4f40d28c0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:12.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 -- 172.21.15.17:0/3910708320 >> 172.21.15.17:0/3910708320 conn(0x7ff4f40d1da0 msgr2=0x7ff4f40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 -- 172.21.15.17:0/3910708320 shutdown_connections 2024-09-10T23:29:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 -- 172.21.15.17:0/3910708320 wait complete. 2024-09-10T23:29:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 Processor -- start 2024-09-10T23:29:12.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 -- start start 2024-09-10T23:29:12.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4f415be80 0x7ff4f406f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:12.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4f415fa00 0x7ff4f415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:12.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415a5c0 0x7ff4f4070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:12.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f416a770 con 0x7ff4f415a5c0 2024-09-10T23:29:12.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40b5490 con 0x7ff4f415fa00 2024-09-10T23:29:12.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4fb800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f416a8f0 con 0x7ff4f415be80 2024-09-10T23:29:12.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415a5c0 0x7ff4f4070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:12.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415a5c0 0x7ff4f4070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33330/0 (socket says 172.21.15.17:33330) 2024-09-10T23:29:12.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f9800640 1 -- 172.21.15.17:0/1241199580 learned_addr learned my addr 172.21.15.17:0/1241199580 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:12.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f3e00640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4f415fa00 0x7ff4f415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:12.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f8e00640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4f415be80 0x7ff4f406f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:12.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f9800640 1 -- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4f415be80 msgr2=0x7ff4f406f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:12.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f9800640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4f415be80 0x7ff4f406f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:12.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f9800640 1 -- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4f415fa00 msgr2=0x7ff4f415a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:12.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f9800640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4f415fa00 0x7ff4f415a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:12.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f9800640 1 -- 172.21.15.17:0/1241199580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f41592c0 con 0x7ff4f415a5c0 2024-09-10T23:29:12.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.780+0000 7ff4f9800640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415a5c0 0x7ff4f4070f70 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b970 tx=0x7ff4ec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:12.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4f0c00640 1 -- 172.21.15.17:0/1241199580 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec019070 con 0x7ff4f415a5c0 2024-09-10T23:29:12.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4f0c00640 1 -- 172.21.15.17:0/1241199580 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4ec00cbd0 con 0x7ff4f415a5c0 2024-09-10T23:29:12.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4f0c00640 1 -- 172.21.15.17:0/1241199580 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0146a0 con 0x7ff4f415a5c0 2024-09-10T23:29:12.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f41595a0 con 0x7ff4f415a5c0 2024-09-10T23:29:12.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f406fbe0 con 0x7ff4f415a5c0 2024-09-10T23:29:12.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f40d28c0 con 0x7ff4f415a5c0 2024-09-10T23:29:12.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4f0c00640 1 -- 172.21.15.17:0/1241199580 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff4ec01e440 con 0x7ff4f415a5c0 2024-09-10T23:29:12.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4f0c00640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4d40725e0 0x7ff4d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:12.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4f0c00640 1 -- 172.21.15.17:0/1241199580 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5335+0+0 (secure 0 0 0) 0x7ff4ec092fc0 con 0x7ff4f415a5c0 2024-09-10T23:29:12.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.784+0000 7ff4f8e00640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4d40725e0 0x7ff4d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:12.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.788+0000 7ff4f8e00640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4d40725e0 0x7ff4d4074aa0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ae000 tx=0x7ff4e801afd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:12.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:12.788+0000 7ff4f0c00640 1 -- 172.21.15.17:0/1241199580 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff4ec05e120 con 0x7ff4f415a5c0 2024-09-10T23:29:13.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.008+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7ff4f40c8be0 con 0x7ff4f415a5c0 2024-09-10T23:29:13.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4f0c00640 1 -- 172.21.15.17:0/1241199580 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v57) ==== 71+0+0 (secure 0 0 0) 0x7ff4ec062b50 con 0x7ff4f415a5c0 2024-09-10T23:29:13.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4d40725e0 msgr2=0x7ff4d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4d40725e0 0x7ff4d4074aa0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ae000 tx=0x7ff4e801afd0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415a5c0 msgr2=0x7ff4f4070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415a5c0 0x7ff4f4070f70 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b970 tx=0x7ff4ec00be30 comp rx=0 tx=0).stop 2024-09-10T23:29:13.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 shutdown_connections 2024-09-10T23:29:13.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff4d40725e0 0x7ff4d4074aa0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f415a5c0 0x7ff4f4070f70 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff4f415fa00 0x7ff4f415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 --2- 172.21.15.17:0/1241199580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff4f415be80 0x7ff4f406f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 >> 172.21.15.17:0/1241199580 conn(0x7ff4f40d1da0 msgr2=0x7ff4f40b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:13.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 shutdown_connections 2024-09-10T23:29:13.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.012+0000 7ff4fb800640 1 -- 172.21.15.17:0/1241199580 wait complete. 2024-09-10T23:29:13.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-10T23:29:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.180+0000 7f8363800640 1 -- 172.21.15.17:0/1787859574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 msgr2=0x7f8344003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.180+0000 7f8363800640 1 --2- 172.21.15.17:0/1787859574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 0x7f8344003ed0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f83500016c0 tx=0x7f835001c720 comp rx=0 tx=0).stop 2024-09-10T23:29:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.180+0000 7f8363800640 1 -- 172.21.15.17:0/1787859574 shutdown_connections 2024-09-10T23:29:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.180+0000 7f8363800640 1 --2- 172.21.15.17:0/1787859574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 0x7f8344003ed0 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.180+0000 7f8363800640 1 -- 172.21.15.17:0/1787859574 >> 172.21.15.17:0/1787859574 conn(0x7f835c0d1d60 msgr2=0x7f835c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.180+0000 7f8363800640 1 -- 172.21.15.17:0/1787859574 shutdown_connections 2024-09-10T23:29:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.180+0000 7f8363800640 1 -- 172.21.15.17:0/1787859574 wait complete. 2024-09-10T23:29:13.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 Processor -- start 2024-09-10T23:29:13.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 -- start start 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 0x7f835c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f835c0b4010 0x7f835c1f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c0c9f70 0x7f835c0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f835c0d0800 con 0x7f8344003ab0 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f835c0d0680 con 0x7f835c0c9f70 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f835c0d0980 con 0x7f835c0b4010 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8360e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 0x7f835c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8360e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 0x7f835c152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33352/0 (socket says 172.21.15.17:33352) 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8360e00640 1 -- 172.21.15.17:0/2448316702 learned_addr learned my addr 172.21.15.17:0/2448316702 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f835be00640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f835c0b4010 0x7f835c1f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8361800640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c0c9f70 0x7f835c0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8360e00640 1 -- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f835c0b4010 msgr2=0x7f835c1f8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8360e00640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f835c0b4010 0x7f835c1f8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8360e00640 1 -- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c0c9f70 msgr2=0x7f835c0ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8360e00640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c0c9f70 0x7f835c0ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8360e00640 1 -- 172.21.15.17:0/2448316702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c1f9350 con 0x7f8344003ab0 2024-09-10T23:29:13.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8360e00640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 0x7f835c152260 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f835001ae20 tx=0x7f8350006930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:13.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8358c00640 1 -- 172.21.15.17:0/2448316702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8350003680 con 0x7f8344003ab0 2024-09-10T23:29:13.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8358c00640 1 -- 172.21.15.17:0/2448316702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8350003820 con 0x7f8344003ab0 2024-09-10T23:29:13.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c0c8ed0 con 0x7f8344003ab0 2024-09-10T23:29:13.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8358c00640 1 -- 172.21.15.17:0/2448316702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8350003c10 con 0x7f8344003ab0 2024-09-10T23:29:13.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.184+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c0c9490 con 0x7f8344003ab0 2024-09-10T23:29:13.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.188+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835c0ccaf0 con 0x7f8344003ab0 2024-09-10T23:29:13.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.188+0000 7f8358c00640 1 -- 172.21.15.17:0/2448316702 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f83500c0030 con 0x7f8344003ab0 2024-09-10T23:29:13.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.188+0000 7f8358c00640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f833c072610 0x7f833c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:13.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.188+0000 7f8358c00640 1 -- 172.21.15.17:0/2448316702 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5335+0+0 (secure 0 0 0) 0x7f835012caf0 con 0x7f8344003ab0 2024-09-10T23:29:13.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.188+0000 7f835be00640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f833c072610 0x7f833c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.188+0000 7f835be00640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f833c072610 0x7f833c074ad0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f835c0b3d60 tx=0x7f83480091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:13.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.192+0000 7f8358c00640 1 -- 172.21.15.17:0/2448316702 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f83500164b0 con 0x7f8344003ab0 2024-09-10T23:29:13.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.436+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f835c06df80 con 0x7f8344003ab0 2024-09-10T23:29:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.588+0000 7f8358c00640 1 -- 172.21.15.17:0/2448316702 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v635) ==== 159+0+0 (secure 0 0 0) 0x7f83500f7c50 con 0x7f8344003ab0 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f833c072610 msgr2=0x7f833c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f833c072610 0x7f833c074ad0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f835c0b3d60 tx=0x7f83480091e0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 msgr2=0x7f835c152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 0x7f835c152260 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f835001ae20 tx=0x7f8350006930 comp rx=0 tx=0).stop 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 shutdown_connections 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f833c072610 0x7f833c074ad0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c0c9f70 0x7f835c0ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f835c0b4010 0x7f835c1f8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 --2- 172.21.15.17:0/2448316702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8344003ab0 0x7f835c152260 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:13.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 >> 172.21.15.17:0/2448316702 conn(0x7f835c0d1d60 msgr2=0x7f835c0ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 shutdown_connections 2024-09-10T23:29:13.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:13.592+0000 7f8363800640 1 -- 172.21.15.17:0/2448316702 wait complete. 2024-09-10T23:29:13.847 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T23:29:13.847 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T23:29:13.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:29:14.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.016+0000 7f47b2c00640 1 -- 172.21.15.17:0/2399622276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac0d2830 msgr2=0x7f47ac0d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.016+0000 7f47b2c00640 1 --2- 172.21.15.17:0/2399622276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac0d2830 0x7f47ac0d0030 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f47ac073bd0 tx=0x7f479401f0b0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.016+0000 7f47b2c00640 1 -- 172.21.15.17:0/2399622276 shutdown_connections 2024-09-10T23:29:14.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.016+0000 7f47b2c00640 1 --2- 172.21.15.17:0/2399622276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac0d2830 0x7f47ac0d0030 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.016+0000 7f47b2c00640 1 --2- 172.21.15.17:0/2399622276 >> v2:172.21.15.77:3300/0 conn(0x7f47ac160280 0x7f47ac0cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.016+0000 7f47b2c00640 1 -- 172.21.15.17:0/2399622276 >> 172.21.15.17:0/2399622276 conn(0x7f47ac0d1d10 msgr2=0x7f47ac0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.016+0000 7f47b2c00640 1 -- 172.21.15.17:0/2399622276 shutdown_connections 2024-09-10T23:29:14.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.016+0000 7f47b2c00640 1 -- 172.21.15.17:0/2399622276 wait complete. 2024-09-10T23:29:14.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b2c00640 1 Processor -- start 2024-09-10T23:29:14.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b2c00640 1 -- start start 2024-09-10T23:29:14.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b2c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47ac0d2830 0x7f47ac0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b2c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac160280 0x7f47ac1f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b2c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac160660 0x7f47ac0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b2c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac0afe30 con 0x7f47ac160660 2024-09-10T23:29:14.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b2c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac0afcb0 con 0x7f47ac160280 2024-09-10T23:29:14.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b2c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f47ac0affb0 con 0x7f47ac0d2830 2024-09-10T23:29:14.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac160660 0x7f47ac0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac160660 0x7f47ac0ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33370/0 (socket says 172.21.15.17:33370) 2024-09-10T23:29:14.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b0c00640 1 -- 172.21.15.17:0/3681048309 learned_addr learned my addr 172.21.15.17:0/3681048309 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:14.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47a3400640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac160280 0x7f47ac1f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47abe00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47ac0d2830 0x7f47ac0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b0c00640 1 -- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47ac0d2830 msgr2=0x7f47ac0c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b0c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47ac0d2830 0x7f47ac0c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b0c00640 1 -- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac160280 msgr2=0x7f47ac1f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b0c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac160280 0x7f47ac1f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b0c00640 1 -- 172.21.15.17:0/3681048309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ac0c9230 con 0x7f47ac160660 2024-09-10T23:29:14.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b0c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac160660 0x7f47ac0ce7b0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c730 tx=0x7f47a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47a8c00640 1 -- 172.21.15.17:0/3681048309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a4003b80 con 0x7f47ac160660 2024-09-10T23:29:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47a8c00640 1 -- 172.21.15.17:0/3681048309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47a4003d20 con 0x7f47ac160660 2024-09-10T23:29:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ac0cbc00 con 0x7f47ac160660 2024-09-10T23:29:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.020+0000 7f47a8c00640 1 -- 172.21.15.17:0/3681048309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a400aab0 con 0x7f47ac160660 2024-09-10T23:29:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.024+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ac0cc1c0 con 0x7f47ac160660 2024-09-10T23:29:14.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.024+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ac0c95d0 con 0x7f47ac160660 2024-09-10T23:29:14.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.024+0000 7f47a8c00640 1 -- 172.21.15.17:0/3681048309 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f47a400ac50 con 0x7f47ac160660 2024-09-10T23:29:14.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.024+0000 7f47a8c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47880725e0 0x7f4788074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.024+0000 7f47a8c00640 1 -- 172.21.15.17:0/3681048309 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5335+0+0 (secure 0 0 0) 0x7f47a4092d60 con 0x7f47ac160660 2024-09-10T23:29:14.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.024+0000 7f47abe00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47880725e0 0x7f4788074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.024+0000 7f47abe00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47880725e0 0x7f4788074aa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f479c009be0 tx=0x7f479c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.028+0000 7f47a8c00640 1 -- 172.21.15.17:0/3681048309 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f47a405df50 con 0x7f47ac160660 2024-09-10T23:29:14.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.204+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47ac0b04a0 con 0x7f47ac160660 2024-09-10T23:29:14.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.204+0000 7f47a8c00640 1 -- 172.21.15.17:0/3681048309 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) ==== 74+0+13255 (secure 0 0 0) 0x7f47a4062980 con 0x7f47ac160660 2024-09-10T23:29:14.206 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:14.206 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":180,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:29:12.582932+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/3849451590":"2024-09-11T23:29:09.200210+0000","172.21.15.17:6834/3849451590":"2024-09-11T23:29:09.200210+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:29:14.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47880725e0 msgr2=0x7f4788074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47880725e0 0x7f4788074aa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f479c009be0 tx=0x7f479c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac160660 msgr2=0x7f47ac0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac160660 0x7f47ac0ce7b0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c730 tx=0x7f47a400cbf0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 shutdown_connections 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f47880725e0 0x7f4788074aa0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47ac160660 0x7f47ac0ce7b0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac160280 0x7f47ac1f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 --2- 172.21.15.17:0/3681048309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47ac0d2830 0x7f47ac0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 >> 172.21.15.17:0/3681048309 conn(0x7f47ac0d1d10 msgr2=0x7f47ac0cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 shutdown_connections 2024-09-10T23:29:14.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.208+0000 7f47b2c00640 1 -- 172.21.15.17:0/3681048309 wait complete. 2024-09-10T23:29:14.228 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:29:14.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:29:14.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.376+0000 7f82e2600640 1 -- 172.21.15.17:0/3835674652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 msgr2=0x7f82dc0b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.376+0000 7f82e2600640 1 --2- 172.21.15.17:0/3835674652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 0x7f82dc0b30b0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009840 tx=0x7f82c401c760 comp rx=0 tx=0).stop 2024-09-10T23:29:14.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.376+0000 7f82e2600640 1 -- 172.21.15.17:0/3835674652 shutdown_connections 2024-09-10T23:29:14.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.376+0000 7f82e2600640 1 --2- 172.21.15.17:0/3835674652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 0x7f82dc0b30b0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.376+0000 7f82e2600640 1 --2- 172.21.15.17:0/3835674652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82dc0cff00 0x7f82dc0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.376+0000 7f82e2600640 1 -- 172.21.15.17:0/3835674652 >> 172.21.15.17:0/3835674652 conn(0x7f82dc0d1da0 msgr2=0x7f82dc0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.376+0000 7f82e2600640 1 -- 172.21.15.17:0/3835674652 shutdown_connections 2024-09-10T23:29:14.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.376+0000 7f82e2600640 1 -- 172.21.15.17:0/3835674652 wait complete. 2024-09-10T23:29:14.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 Processor -- start 2024-09-10T23:29:14.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 -- start start 2024-09-10T23:29:14.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 0x7f82dc15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82dc0b0b00 0x7f82dc1616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82dc0cff00 0x7f82dc150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc06f790 con 0x7f82dc0aea70 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc06f610 con 0x7f82dc0b0b00 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f82dc06f910 con 0x7f82dc0cff00 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82db400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 0x7f82dc15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82db400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 0x7f82dc15f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33400/0 (socket says 172.21.15.17:33400) 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82db400640 1 -- 172.21.15.17:0/772282038 learned_addr learned my addr 172.21.15.17:0/772282038 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82d2a00640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82dc0b0b00 0x7f82dc1616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82dbe00640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82dc0cff00 0x7f82dc150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82db400640 1 -- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82dc0cff00 msgr2=0x7f82dc150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82db400640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82dc0cff00 0x7f82dc150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82db400640 1 -- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82dc0b0b00 msgr2=0x7f82dc1616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82db400640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82dc0b0b00 0x7f82dc1616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82db400640 1 -- 172.21.15.17:0/772282038 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82dc160150 con 0x7f82dc0aea70 2024-09-10T23:29:14.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82db400640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 0x7f82dc15f5a0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00e7a0 tx=0x7f82cc00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82d3e00640 1 -- 172.21.15.17:0/772282038 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00ccc0 con 0x7f82dc0aea70 2024-09-10T23:29:14.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82d3e00640 1 -- 172.21.15.17:0/772282038 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82cc010430 con 0x7f82dc0aea70 2024-09-10T23:29:14.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82d3e00640 1 -- 172.21.15.17:0/772282038 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc010860 con 0x7f82dc0aea70 2024-09-10T23:29:14.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82dc15fb90 con 0x7f82dc0aea70 2024-09-10T23:29:14.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82dc1567e0 con 0x7f82dc0aea70 2024-09-10T23:29:14.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.380+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82dc0b30b0 con 0x7f82dc0aea70 2024-09-10T23:29:14.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.384+0000 7f82d3e00640 1 -- 172.21.15.17:0/772282038 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f82cc010a00 con 0x7f82dc0aea70 2024-09-10T23:29:14.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.384+0000 7f82d3e00640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82b80725e0 0x7f82b8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.384+0000 7f82d3e00640 1 -- 172.21.15.17:0/772282038 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5335+0+0 (secure 0 0 0) 0x7f82cc093b30 con 0x7f82dc0aea70 2024-09-10T23:29:14.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.384+0000 7f82d2a00640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82b80725e0 0x7f82b8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.384+0000 7f82d2a00640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82b80725e0 0x7f82b8074aa0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f82c40af000 tx=0x7f82c401afa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.388+0000 7f82d3e00640 1 -- 172.21.15.17:0/772282038 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f82cc05ec90 con 0x7f82dc0aea70 2024-09-10T23:29:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.560+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82dc0b08e0 con 0x7f82dc0aea70 2024-09-10T23:29:14.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.560+0000 7f82d3e00640 1 -- 172.21.15.17:0/772282038 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) ==== 93+0+10 (secure 0 0 0) 0x7f82cc0636c0 con 0x7f82dc0aea70 2024-09-10T23:29:14.563 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:29:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82b80725e0 msgr2=0x7f82b8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82b80725e0 0x7f82b8074aa0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f82c40af000 tx=0x7f82c401afa0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 msgr2=0x7f82dc15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 0x7f82dc15f5a0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00e7a0 tx=0x7f82cc00ec60 comp rx=0 tx=0).stop 2024-09-10T23:29:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 shutdown_connections 2024-09-10T23:29:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f82b80725e0 0x7f82b8074aa0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f82dc0cff00 0x7f82dc150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82dc0b0b00 0x7f82dc1616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 --2- 172.21.15.17:0/772282038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82dc0aea70 0x7f82dc15f5a0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 >> 172.21.15.17:0/772282038 conn(0x7f82dc0d1da0 msgr2=0x7f82dc0d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 shutdown_connections 2024-09-10T23:29:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.564+0000 7f82e2600640 1 -- 172.21.15.17:0/772282038 wait complete. 2024-09-10T23:29:14.586 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-10T23:29:14.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.732+0000 7f6f6b800640 1 -- 172.21.15.17:0/3169848498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f730 msgr2=0x7f6f640b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.732+0000 7f6f6b800640 1 --2- 172.21.15.17:0/3169848498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f730 0x7f6f640b3130 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009840 tx=0x7f6f5001c790 comp rx=0 tx=0).stop 2024-09-10T23:29:14.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.732+0000 7f6f6b800640 1 -- 172.21.15.17:0/3169848498 shutdown_connections 2024-09-10T23:29:14.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.732+0000 7f6f6b800640 1 --2- 172.21.15.17:0/3169848498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f730 0x7f6f640b3130 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.732+0000 7f6f6b800640 1 -- 172.21.15.17:0/3169848498 >> 172.21.15.17:0/3169848498 conn(0x7f6f640d1d10 msgr2=0x7f6f640d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:14.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.732+0000 7f6f6b800640 1 -- 172.21.15.17:0/3169848498 shutdown_connections 2024-09-10T23:29:14.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.732+0000 7f6f6b800640 1 -- 172.21.15.17:0/3169848498 wait complete. 2024-09-10T23:29:14.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 Processor -- start 2024-09-10T23:29:14.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 -- start start 2024-09-10T23:29:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f640cee30 0x7f6f64159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f350 0x7f6f64070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f6415f730 0x7f6f640b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f64169f70 con 0x7f6f6415f350 2024-09-10T23:29:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f64169df0 con 0x7f6f640cee30 2024-09-10T23:29:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6416a0f0 con 0x7f6f6415f730 2024-09-10T23:29:14.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f63e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f350 0x7f6f64070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f63e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f350 0x7f6f64070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33414/0 (socket says 172.21.15.17:33414) 2024-09-10T23:29:14.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f63e00640 1 -- 172.21.15.17:0/3475296101 learned_addr learned my addr 172.21.15.17:0/3475296101 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:14.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f68e00640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f640cee30 0x7f6f64159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f69800640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f6415f730 0x7f6f640b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f63e00640 1 -- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f6415f730 msgr2=0x7f6f640b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f63e00640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f6415f730 0x7f6f640b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f63e00640 1 -- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f640cee30 msgr2=0x7f6f64159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f63e00640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f640cee30 0x7f6f64159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f63e00640 1 -- 172.21.15.17:0/3475296101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f641faf50 con 0x7f6f6415f350 2024-09-10T23:29:14.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f63e00640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f350 0x7f6f64070be0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009790 tx=0x7f6f500a6c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f60c00640 1 -- 172.21.15.17:0/3475296101 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500bd070 con 0x7f6f6415f350 2024-09-10T23:29:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f60c00640 1 -- 172.21.15.17:0/3475296101 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f500041e0 con 0x7f6f6415f350 2024-09-10T23:29:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f60c00640 1 -- 172.21.15.17:0/3475296101 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50005070 con 0x7f6f6415f350 2024-09-10T23:29:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f641fb1f0 con 0x7f6f6415f350 2024-09-10T23:29:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.736+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f641fb7b0 con 0x7f6f6415f350 2024-09-10T23:29:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.740+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f640b3130 con 0x7f6f6415f350 2024-09-10T23:29:14.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.740+0000 7f6f60c00640 1 -- 172.21.15.17:0/3475296101 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6f50005210 con 0x7f6f6415f350 2024-09-10T23:29:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.740+0000 7f6f60c00640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f440725e0 0x7f6f44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.740+0000 7f6f60c00640 1 -- 172.21.15.17:0/3475296101 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5335+0+0 (secure 0 0 0) 0x7f6f5012cf50 con 0x7f6f6415f350 2024-09-10T23:29:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.740+0000 7f6f68e00640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f440725e0 0x7f6f44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.744+0000 7f6f68e00640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f440725e0 0x7f6f44074aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:14.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.744+0000 7f6f60c00640 1 -- 172.21.15.17:0/3475296101 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6f50016410 con 0x7f6f6415f350 2024-09-10T23:29:14.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:14.980+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f6f640b4360 con 0x7f6f6415f350 2024-09-10T23:29:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.600+0000 7f6f60c00640 1 -- 172.21.15.17:0/3475296101 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v637) ==== 143+0+0 (secure 0 0 0) 0x7f6f500f8140 con 0x7f6f6415f350 2024-09-10T23:29:15.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f440725e0 msgr2=0x7f6f44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:15.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f440725e0 0x7f6f44074aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58009040 comp rx=0 tx=0).stop 2024-09-10T23:29:15.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f350 msgr2=0x7f6f64070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:15.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f350 0x7f6f64070be0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009790 tx=0x7f6f500a6c00 comp rx=0 tx=0).stop 2024-09-10T23:29:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 shutdown_connections 2024-09-10T23:29:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f440725e0 0x7f6f44074aa0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f6415f730 0x7f6f640b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f6415f350 0x7f6f64070be0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 --2- 172.21.15.17:0/3475296101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f640cee30 0x7f6f64159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 >> 172.21.15.17:0/3475296101 conn(0x7f6f640d1d10 msgr2=0x7f6f640aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 shutdown_connections 2024-09-10T23:29:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.604+0000 7f6f6b800640 1 -- 172.21.15.17:0/3475296101 wait complete. 2024-09-10T23:29:15.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:29:15.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 -- 172.21.15.17:0/1060687747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25dc003a60 msgr2=0x7f25dc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:15.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 --2- 172.21.15.17:0/1060687747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25dc003a60 0x7f25dc003e80 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009b90 tx=0x7f25e801d2b0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fa800640 1 -- 172.21.15.17:0/1060687747 reap_dead start 2024-09-10T23:29:15.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 -- 172.21.15.17:0/1060687747 shutdown_connections 2024-09-10T23:29:15.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 -- 172.21.15.17:0/1060687747 >> 172.21.15.17:0/1060687747 conn(0x7f25f40d1d10 msgr2=0x7f25f40d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:15.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 -- 172.21.15.17:0/1060687747 shutdown_connections 2024-09-10T23:29:15.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 -- 172.21.15.17:0/1060687747 wait complete. 2024-09-10T23:29:15.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 Processor -- start 2024-09-10T23:29:15.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 -- start start 2024-09-10T23:29:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25dc003a60 0x7f25f40c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f4071fc0 0x7f25f41f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25f41f5c80 0x7f25f41f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25f40d01b0 con 0x7f25f4071fc0 2024-09-10T23:29:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f25f40d0030 con 0x7f25dc003a60 2024-09-10T23:29:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fc800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f25f40d0330 con 0x7f25f41f5c80 2024-09-10T23:29:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f4071fc0 0x7f25f41f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25dc003a60 0x7f25f40c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:15.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25dc003a60 0x7f25f40c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:33410/0 (socket says 172.21.15.17:33410) 2024-09-10T23:29:15.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9e00640 1 -- 172.21.15.17:0/615526701 learned_addr learned my addr 172.21.15.17:0/615526701 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:15.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f4071fc0 0x7f25f41f1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33444/0 (socket says 172.21.15.17:33444) 2024-09-10T23:29:15.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25fa800640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25f41f5c80 0x7f25f41f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:15.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9400640 1 -- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25f41f5c80 msgr2=0x7f25f41f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:15.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9400640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25f41f5c80 0x7f25f41f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9400640 1 -- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25dc003a60 msgr2=0x7f25f40c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:15.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9400640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25dc003a60 0x7f25f40c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9400640 1 -- 172.21.15.17:0/615526701 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f406a270 con 0x7f25f4071fc0 2024-09-10T23:29:15.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.780+0000 7f25f9e00640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25dc003a60 0x7f25f40c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:15.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25f9400640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f4071fc0 0x7f25f41f1f20 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f25e4001250 tx=0x7f25e400ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:15.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25ee000640 1 -- 172.21.15.17:0/615526701 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e401f070 con 0x7f25f4071fc0 2024-09-10T23:29:15.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25ee000640 1 -- 172.21.15.17:0/615526701 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25e40110d0 con 0x7f25f4071fc0 2024-09-10T23:29:15.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25ee000640 1 -- 172.21.15.17:0/615526701 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e40114a0 con 0x7f25f4071fc0 2024-09-10T23:29:15.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f40c9320 con 0x7f25f4071fc0 2024-09-10T23:29:15.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f40cb830 con 0x7f25f4071fc0 2024-09-10T23:29:15.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f40cfaf0 con 0x7f25f4071fc0 2024-09-10T23:29:15.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25ee000640 1 -- 172.21.15.17:0/615526701 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f25e400f660 con 0x7f25f4071fc0 2024-09-10T23:29:15.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25ee000640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25d8072610 0x7f25d8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:15.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.784+0000 7f25ee000640 1 -- 172.21.15.17:0/615526701 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5335+0+0 (secure 0 0 0) 0x7f25e40997c0 con 0x7f25f4071fc0 2024-09-10T23:29:15.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.788+0000 7f25f9e00640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25d8072610 0x7f25d8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:15.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.788+0000 7f25f9e00640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25d8072610 0x7f25d8074ad0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009a80 tx=0x7f25e801a050 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:15.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.788+0000 7f25ee000640 1 -- 172.21.15.17:0/615526701 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f25e40649b0 con 0x7f25f4071fc0 2024-09-10T23:29:15.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.964+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f25f4074af0 con 0x7f25f4071fc0 2024-09-10T23:29:15.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.964+0000 7f25ee000640 1 -- 172.21.15.17:0/615526701 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v57) ==== 59+0+1998 (secure 0 0 0) 0x7f25e40693e0 con 0x7f25f4071fc0 2024-09-10T23:29:15.967 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:29:15.967 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:29:15.967 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:29:15.967 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:29:15.967 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:29:15.968 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:29:15.969 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:29:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25d8072610 msgr2=0x7f25d8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25d8072610 0x7f25d8074ad0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009a80 tx=0x7f25e801a050 comp rx=0 tx=0).stop 2024-09-10T23:29:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f4071fc0 msgr2=0x7f25f41f1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f4071fc0 0x7f25f41f1f20 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f25e4001250 tx=0x7f25e400ac10 comp rx=0 tx=0).stop 2024-09-10T23:29:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 shutdown_connections 2024-09-10T23:29:15.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25d8072610 0x7f25d8074ad0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25f41f5c80 0x7f25f41f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f4071fc0 0x7f25f41f1f20 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 --2- 172.21.15.17:0/615526701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25dc003a60 0x7f25f40c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:15.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 >> 172.21.15.17:0/615526701 conn(0x7f25f40d1d10 msgr2=0x7f25f40b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:15.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 shutdown_connections 2024-09-10T23:29:15.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:15.968+0000 7f25fc800640 1 -- 172.21.15.17:0/615526701 wait complete. 2024-09-10T23:29:15.989 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:29:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.136+0000 7f3906a00640 1 -- 172.21.15.17:0/360035069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39000cf040 msgr2=0x7f39000cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.136+0000 7f3906a00640 1 --2- 172.21.15.17:0/360035069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39000cf040 0x7f39000cf4d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009840 tx=0x7f38ec01c820 comp rx=0 tx=0).stop 2024-09-10T23:29:16.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.136+0000 7f3906a00640 1 -- 172.21.15.17:0/360035069 shutdown_connections 2024-09-10T23:29:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.136+0000 7f3906a00640 1 --2- 172.21.15.17:0/360035069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39000cf040 0x7f39000cf4d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.136+0000 7f3906a00640 1 -- 172.21.15.17:0/360035069 >> 172.21.15.17:0/360035069 conn(0x7f39000b17a0 msgr2=0x7f39000b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.136+0000 7f3906a00640 1 -- 172.21.15.17:0/360035069 shutdown_connections 2024-09-10T23:29:16.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.136+0000 7f3906a00640 1 -- 172.21.15.17:0/360035069 wait complete. 2024-09-10T23:29:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 Processor -- start 2024-09-10T23:29:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 -- start start 2024-09-10T23:29:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39000cc730 0x7f3900149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39000cf040 0x7f390015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390015a2a0 0x7f390014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f39001680b0 con 0x7f390015a2a0 2024-09-10T23:29:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3900167f30 con 0x7f39000cf040 2024-09-10T23:29:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3900168230 con 0x7f39000cc730 2024-09-10T23:29:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3904a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390015a2a0 0x7f390014a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3904a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390015a2a0 0x7f390014a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33446/0 (socket says 172.21.15.17:33446) 2024-09-10T23:29:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3904a00640 1 -- 172.21.15.17:0/3869862990 learned_addr learned my addr 172.21.15.17:0/3869862990 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f38ff400640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39000cf040 0x7f390015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f38ffe00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39000cc730 0x7f3900149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3904a00640 1 -- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39000cc730 msgr2=0x7f3900149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3904a00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39000cc730 0x7f3900149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3904a00640 1 -- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39000cf040 msgr2=0x7f390015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3904a00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39000cf040 0x7f390015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3904a00640 1 -- 172.21.15.17:0/3869862990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3900153700 con 0x7f390015a2a0 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3904a00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390015a2a0 0x7f390014a1e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f38f800cbc0 tx=0x7f38f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f38f7e00640 1 -- 172.21.15.17:0/3869862990 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8016020 con 0x7f390015a2a0 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f38f7e00640 1 -- 172.21.15.17:0/3869862990 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38f800ab00 con 0x7f390015a2a0 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39001539e0 con 0x7f390015a2a0 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f38f7e00640 1 -- 172.21.15.17:0/3869862990 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8012420 con 0x7f390015a2a0 2024-09-10T23:29:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390015af00 con 0x7f390015a2a0 2024-09-10T23:29:16.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.140+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39000cf4d0 con 0x7f390015a2a0 2024-09-10T23:29:16.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.144+0000 7f38f7e00640 1 -- 172.21.15.17:0/3869862990 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f38f80125c0 con 0x7f390015a2a0 2024-09-10T23:29:16.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.144+0000 7f38f7e00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38e00725e0 0x7f38e0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.144+0000 7f38f7e00640 1 -- 172.21.15.17:0/3869862990 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5335+0+0 (secure 0 0 0) 0x7f38f80935e0 con 0x7f390015a2a0 2024-09-10T23:29:16.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.144+0000 7f38ffe00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38e00725e0 0x7f38e0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.144+0000 7f38ffe00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38e00725e0 0x7f38e0074aa0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f38f0007fd0 tx=0x7f38f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.148+0000 7f38f7e00640 1 -- 172.21.15.17:0/3869862990 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f38f8020020 con 0x7f390015a2a0 2024-09-10T23:29:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.320+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3900150370 con 0x7f390015a2a0 2024-09-10T23:29:16.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.324+0000 7f38f7e00640 1 -- 172.21.15.17:0/3869862990 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) ==== 122+0+0 (secure 0 0 0) 0x7f38f805e740 con 0x7f390015a2a0 2024-09-10T23:29:16.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38e00725e0 msgr2=0x7f38e0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38e00725e0 0x7f38e0074aa0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f38f0007fd0 tx=0x7f38f0009040 comp rx=0 tx=0).stop 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390015a2a0 msgr2=0x7f390014a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390015a2a0 0x7f390014a1e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f38f800cbc0 tx=0x7f38f800ccb0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 shutdown_connections 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f38e00725e0 0x7f38e0074aa0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f390015a2a0 0x7f390014a1e0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39000cf040 0x7f390015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 --2- 172.21.15.17:0/3869862990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f39000cc730 0x7f3900149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 >> 172.21.15.17:0/3869862990 conn(0x7f39000b17a0 msgr2=0x7f390006f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 shutdown_connections 2024-09-10T23:29:16.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.328+0000 7f3906a00640 1 -- 172.21.15.17:0/3869862990 wait complete. 2024-09-10T23:29:16.347 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:29:16.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:29:16.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:29:16.488 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:29:16.488 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:29:16.488 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:29:16.498 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:29:16.498 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:29:16.498 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:29:16.507 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:29:16.507 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:29:16.507 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:29:16.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:29:16.547 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:29:16.547 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:29:16.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:29:16.561 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:29:16.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:29:16.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.736+0000 7fae04600640 1 -- 172.21.15.17:0/1882511926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadfc0d0630 msgr2=0x7fadfc0b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.736+0000 7fae04600640 1 --2- 172.21.15.17:0/1882511926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadfc0d0630 0x7fadfc0b37f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009bc0 tx=0x7fadf401cb10 comp rx=0 tx=0).stop 2024-09-10T23:29:16.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.736+0000 7fae04600640 1 -- 172.21.15.17:0/1882511926 shutdown_connections 2024-09-10T23:29:16.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.736+0000 7fae04600640 1 --2- 172.21.15.17:0/1882511926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadfc0d0630 0x7fadfc0b37f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.736+0000 7fae04600640 1 -- 172.21.15.17:0/1882511926 >> 172.21.15.17:0/1882511926 conn(0x7fadfc06cfc0 msgr2=0x7fadfc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.736+0000 7fae04600640 1 -- 172.21.15.17:0/1882511926 shutdown_connections 2024-09-10T23:29:16.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.736+0000 7fae04600640 1 -- 172.21.15.17:0/1882511926 wait complete. 2024-09-10T23:29:16.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 Processor -- start 2024-09-10T23:29:16.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 -- start start 2024-09-10T23:29:16.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadfc0b48f0 0x7fadfc142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadfc0cf4f0 0x7fadfc14f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadfc0d0630 0x7fadfc1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc169c90 con 0x7fadfc0d0630 2024-09-10T23:29:16.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc169b10 con 0x7fadfc0cf4f0 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc169e10 con 0x7fadfc0b48f0 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae02600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadfc0d0630 0x7fadfc1524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae02600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadfc0d0630 0x7fadfc1524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33448/0 (socket says 172.21.15.17:33448) 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae02600640 1 -- 172.21.15.17:0/4043302750 learned_addr learned my addr 172.21.15.17:0/4043302750 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae01c00640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadfc0b48f0 0x7fadfc142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae01200640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadfc0cf4f0 0x7fadfc14f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae02600640 1 -- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadfc0b48f0 msgr2=0x7fadfc142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae02600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadfc0b48f0 0x7fadfc142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae02600640 1 -- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadfc0cf4f0 msgr2=0x7fadfc14f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae02600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadfc0cf4f0 0x7fadfc14f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae02600640 1 -- 172.21.15.17:0/4043302750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc151400 con 0x7fadfc0d0630 2024-09-10T23:29:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae02600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadfc0d0630 0x7fadfc1524a0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fadf4019720 tx=0x7fadf4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fadf9600640 1 -- 172.21.15.17:0/4043302750 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40b2040 con 0x7fadfc0d0630 2024-09-10T23:29:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fadf9600640 1 -- 172.21.15.17:0/4043302750 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadf40bb070 con 0x7fadfc0d0630 2024-09-10T23:29:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadfc1516e0 con 0x7fadfc0d0630 2024-09-10T23:29:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fadf9600640 1 -- 172.21.15.17:0/4043302750 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40043b0 con 0x7fadfc0d0630 2024-09-10T23:29:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadfc151ca0 con 0x7fadfc0d0630 2024-09-10T23:29:16.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.740+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadfc0b37f0 con 0x7fadfc0d0630 2024-09-10T23:29:16.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.744+0000 7fadf9600640 1 -- 172.21.15.17:0/4043302750 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fadf40b5070 con 0x7fadfc0d0630 2024-09-10T23:29:16.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.744+0000 7fadf9600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faddc072610 0x7faddc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:16.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.744+0000 7fadf9600640 1 -- 172.21.15.17:0/4043302750 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5335+0+0 (secure 0 0 0) 0x7fadf412d540 con 0x7fadfc0d0630 2024-09-10T23:29:16.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.744+0000 7fae01c00640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faddc072610 0x7faddc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:16.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.744+0000 7fae01c00640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faddc072610 0x7faddc074ad0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fadf0001820 tx=0x7fadf0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:16.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.748+0000 7fadf9600640 1 -- 172.21.15.17:0/4043302750 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fadf4016790 con 0x7fadfc0d0630 2024-09-10T23:29:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.956+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadfc0d0410 con 0x7fadfc0d0630 2024-09-10T23:29:16.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.956+0000 7fadf9600640 1 -- 172.21.15.17:0/4043302750 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+3917 (secure 0 0 0) 0x7fadf4101420 con 0x7fadfc0d0630 2024-09-10T23:29:16.959 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:16.959 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":138,"btime":"2024-09-10T23:29:10:202197+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8237,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6833/1319528493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1319528493},{"type":"v1","addr":"172.21.15.17:6833","nonce":1319528493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":128},{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1685364651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1685364651},{"type":"v1","addr":"172.21.15.77:6836","nonce":1685364651}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129},{"gid":8471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2748864181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2748864181},{"type":"v1","addr":"172.21.15.77:6837","nonce":2748864181}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":138},{"gid":10545,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2057926499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2057926499},{"type":"v1","addr":"172.21.15.17:6835","nonce":2057926499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":138}],"filesystems":[]} 2024-09-10T23:29:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 138 2024-09-10T23:29:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faddc072610 msgr2=0x7faddc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faddc072610 0x7faddc074ad0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fadf0001820 tx=0x7fadf0009040 comp rx=0 tx=0).stop 2024-09-10T23:29:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadfc0d0630 msgr2=0x7fadfc1524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadfc0d0630 0x7fadfc1524a0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fadf4019720 tx=0x7fadf4003f60 comp rx=0 tx=0).stop 2024-09-10T23:29:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 shutdown_connections 2024-09-10T23:29:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faddc072610 0x7faddc074ad0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadfc0d0630 0x7fadfc1524a0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fadfc0cf4f0 0x7fadfc14f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 --2- 172.21.15.17:0/4043302750 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fadfc0b48f0 0x7fadfc142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:16.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 >> 172.21.15.17:0/4043302750 conn(0x7fadfc06cfc0 msgr2=0x7fadfc15ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:16.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 shutdown_connections 2024-09-10T23:29:16.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:16.960+0000 7fae04600640 1 -- 172.21.15.17:0/4043302750 wait complete. 2024-09-10T23:29:16.981 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:29:16.981 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:29:16.982 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:29:16.982 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:29:16.982 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:29:16.982 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:29:16.982 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:29:16.982 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:29:16.982 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:29:16.983 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:29:16.983 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:29:16.983 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:29:16.983 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:29:16.983 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:29:16.983 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:29:16.983 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:29:16.994 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:29:16.994 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:29:16.995 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:29:16.995 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:29:16.999 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:29:16.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:29:17.000 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:29:17.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:29:17.038 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:29:17.038 DEBUG:teuthology.parallel:result is None 2024-09-10T23:29:17.039 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:29:17.040 DEBUG:teuthology.parallel:result is None 2024-09-10T23:29:17.047 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:29:17.048 DEBUG:teuthology.parallel:result is None 2024-09-10T23:29:17.049 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:29:17.049 DEBUG:teuthology.parallel:result is None 2024-09-10T23:29:17.049 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:29:17.124 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:29:17.124 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:29:17.142 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:29:17.143 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:29:17.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.200+0000 7f8e15800640 1 -- 172.21.15.17:0/2421268981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100cedf0 msgr2=0x7f8e100b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:17.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.200+0000 7f8e15800640 1 --2- 172.21.15.17:0/2421268981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100cedf0 0x7f8e100b4bf0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f8e10073640 tx=0x7f8df801c770 comp rx=0 tx=0).stop 2024-09-10T23:29:17.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 -- 172.21.15.17:0/2421268981 shutdown_connections 2024-09-10T23:29:17.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 --2- 172.21.15.17:0/2421268981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100cedf0 0x7f8e100b4bf0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:17.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 --2- 172.21.15.17:0/2421268981 >> v2:172.21.15.77:3300/0 conn(0x7f8e1015be80 0x7f8e100d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:17.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 -- 172.21.15.17:0/2421268981 >> 172.21.15.17:0/2421268981 conn(0x7f8e100d1da0 msgr2=0x7f8e100d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:17.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 -- 172.21.15.17:0/2421268981 shutdown_connections 2024-09-10T23:29:17.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 -- 172.21.15.17:0/2421268981 wait complete. 2024-09-10T23:29:17.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 Processor -- start 2024-09-10T23:29:17.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 -- start start 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100b5130 0x7f8e101f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e1015be80 0x7f8e10153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e10154ce0 0x7f8e101538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e10168d40 con 0x7f8e100b5130 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e10160320 con 0x7f8e10154ce0 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8e10168ec0 con 0x7f8e1015be80 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100b5130 0x7f8e101f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100b5130 0x7f8e101f8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56370/0 (socket says 172.21.15.17:56370) 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0ea00640 1 -- 172.21.15.17:0/4194661705 learned_addr learned my addr 172.21.15.17:0/4194661705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e07e00640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e1015be80 0x7f8e10153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0f400640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e10154ce0 0x7f8e101538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:17.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0ea00640 1 -- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e1015be80 msgr2=0x7f8e10153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:17.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0ea00640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e1015be80 0x7f8e10153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:17.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0ea00640 1 -- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e10154ce0 msgr2=0x7f8e101538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:17.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0ea00640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e10154ce0 0x7f8e101538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:17.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0ea00640 1 -- 172.21.15.17:0/4194661705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1014bae0 con 0x7f8e100b5130 2024-09-10T23:29:17.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0f400640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e10154ce0 0x7f8e101538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:17.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e0ea00640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100b5130 0x7f8e101f8520 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000e7d0 tx=0x7f8e0000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:17.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e06a00640 1 -- 172.21.15.17:0/4194661705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000ccc0 con 0x7f8e100b5130 2024-09-10T23:29:17.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e06a00640 1 -- 172.21.15.17:0/4194661705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e00010430 con 0x7f8e100b5130 2024-09-10T23:29:17.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e06a00640 1 -- 172.21.15.17:0/4194661705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e00010860 con 0x7f8e100b5130 2024-09-10T23:29:17.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.204+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1014bdc0 con 0x7f8e100b5130 2024-09-10T23:29:17.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.208+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e101f8a60 con 0x7f8e100b5130 2024-09-10T23:29:17.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.208+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e100b4bf0 con 0x7f8e100b5130 2024-09-10T23:29:17.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.208+0000 7f8e06a00640 1 -- 172.21.15.17:0/4194661705 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8e00010a00 con 0x7f8e100b5130 2024-09-10T23:29:17.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.208+0000 7f8e06a00640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8dec0725e0 0x7f8dec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:17.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.208+0000 7f8e06a00640 1 -- 172.21.15.17:0/4194661705 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5335+0+0 (secure 0 0 0) 0x7f8e00093a50 con 0x7f8e100b5130 2024-09-10T23:29:17.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.208+0000 7f8e07e00640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8dec0725e0 0x7f8dec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:17.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.212+0000 7f8e07e00640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8dec0725e0 0x7f8dec074aa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8df80af000 tx=0x7f8df801afb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:17.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.212+0000 7f8e06a00640 1 -- 172.21.15.17:0/4194661705 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8e0005ec40 con 0x7f8e100b5130 2024-09-10T23:29:17.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:17.404+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8e1015c500 con 0x7f8e100b5130 2024-09-10T23:29:18.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.336+0000 7f8e06a00640 1 -- 172.21.15.17:0/4194661705 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v185) ==== 97+0+0 (secure 0 0 0) 0x7f8e00063670 con 0x7f8e100b5130 2024-09-10T23:29:18.339 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:29:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8dec0725e0 msgr2=0x7f8dec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8dec0725e0 0x7f8dec074aa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8df80af000 tx=0x7f8df801afb0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100b5130 msgr2=0x7f8e101f8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100b5130 0x7f8e101f8520 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000e7d0 tx=0x7f8e0000ec90 comp rx=0 tx=0).stop 2024-09-10T23:29:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 shutdown_connections 2024-09-10T23:29:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8dec0725e0 0x7f8dec074aa0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e10154ce0 0x7f8e101538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e1015be80 0x7f8e10153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 --2- 172.21.15.17:0/4194661705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e100b5130 0x7f8e101f8520 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 >> 172.21.15.17:0/4194661705 conn(0x7f8e100d1da0 msgr2=0x7f8e1015e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 shutdown_connections 2024-09-10T23:29:18.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.340+0000 7f8e15800640 1 -- 172.21.15.17:0/4194661705 wait complete. 2024-09-10T23:29:18.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:29:18.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 -- 172.21.15.17:0/2846805226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 msgr2=0x7f5bc40d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 --2- 172.21.15.17:0/2846805226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 0x7f5bc40d0030 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f5bc406dbd0 tx=0x7f5bbc01cd50 comp rx=0 tx=0).stop 2024-09-10T23:29:18.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 -- 172.21.15.17:0/2846805226 shutdown_connections 2024-09-10T23:29:18.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 --2- 172.21.15.17:0/2846805226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 0x7f5bc40d0030 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 --2- 172.21.15.17:0/2846805226 >> v2:172.21.15.77:3300/0 conn(0x7f5bc415e5d0 0x7f5bc40b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 --2- 172.21.15.17:0/2846805226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bc415ef40 0x7f5bc415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 -- 172.21.15.17:0/2846805226 >> 172.21.15.17:0/2846805226 conn(0x7f5bc406cfc0 msgr2=0x7f5bc406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 -- 172.21.15.17:0/2846805226 shutdown_connections 2024-09-10T23:29:18.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 -- 172.21.15.17:0/2846805226 wait complete. 2024-09-10T23:29:18.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 Processor -- start 2024-09-10T23:29:18.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 -- start start 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 0x7f5bc4135360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bc415e5d0 0x7f5bc40cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bc415ef40 0x7f5bc414fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc406ffe0 con 0x7f5bc40b4370 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc406fe60 con 0x7f5bc415e5d0 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bcc200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5bc4070160 con 0x7f5bc415ef40 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 0x7f5bc4135360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 0x7f5bc4135360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56392/0 (socket says 172.21.15.17:56392) 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc9800640 1 -- 172.21.15.17:0/1376561885 learned_addr learned my addr 172.21.15.17:0/1376561885 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc8e00640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bc415e5d0 0x7f5bc40cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bca200640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bc415ef40 0x7f5bc414fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc9800640 1 -- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bc415ef40 msgr2=0x7f5bc414fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc9800640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bc415ef40 0x7f5bc414fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc9800640 1 -- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bc415e5d0 msgr2=0x7f5bc40cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc9800640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bc415e5d0 0x7f5bc40cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc9800640 1 -- 172.21.15.17:0/1376561885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc41f9020 con 0x7f5bc40b4370 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.512+0000 7f5bc8e00640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bc415e5d0 0x7f5bc40cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bc9800640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 0x7f5bc4135360 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800d950 tx=0x7f5bb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bc1600640 1 -- 172.21.15.17:0/1376561885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8017070 con 0x7f5bc40b4370 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bc1600640 1 -- 172.21.15.17:0/1376561885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bb8009d20 con 0x7f5bc40b4370 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bc1600640 1 -- 172.21.15.17:0/1376561885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80106c0 con 0x7f5bc40b4370 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc41f9300 con 0x7f5bc40b4370 2024-09-10T23:29:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc41f98c0 con 0x7f5bc40b4370 2024-09-10T23:29:18.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc40b3e30 con 0x7f5bc40b4370 2024-09-10T23:29:18.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bc1600640 1 -- 172.21.15.17:0/1376561885 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5bb8010860 con 0x7f5bc40b4370 2024-09-10T23:29:18.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bc1600640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ba40725e0 0x7f5ba4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bc1600640 1 -- 172.21.15.17:0/1376561885 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5249+0+0 (secure 0 0 0) 0x7f5bb8093510 con 0x7f5bc40b4370 2024-09-10T23:29:18.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.516+0000 7f5bc8e00640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ba40725e0 0x7f5ba4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.520+0000 7f5bc8e00640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ba40725e0 0x7f5ba4074aa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0005fd0 tx=0x7f5bb0005f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.520+0000 7f5bc1600640 1 -- 172.21.15.17:0/1376561885 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5bb805ed10 con 0x7f5bc40b4370 2024-09-10T23:29:18.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5bc40b2f30 con 0x7f5bc40b4370 2024-09-10T23:29:18.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bc1600640 1 -- 172.21.15.17:0/1376561885 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) ==== 80+0+5304 (secure 0 0 0) 0x7f5bb805e610 con 0x7f5bc40b4370 2024-09-10T23:29:18.757 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:18.757 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:29:18.757 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:29:18.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.757 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.758 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.760 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:29:18.761 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.762 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:29:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:29:18.765 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.767 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:29:18.768 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.769 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:29:18.770 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:29:18.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:18.771 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:29:18.771 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:29:18.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ba40725e0 msgr2=0x7f5ba4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ba40725e0 0x7f5ba4074aa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0005fd0 tx=0x7f5bb0005f20 comp rx=0 tx=0).stop 2024-09-10T23:29:18.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 msgr2=0x7f5bc4135360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 0x7f5bc4135360 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800d950 tx=0x7f5bb800de10 comp rx=0 tx=0).stop 2024-09-10T23:29:18.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 shutdown_connections 2024-09-10T23:29:18.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ba40725e0 0x7f5ba4074aa0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bc415ef40 0x7f5bc414fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bc415e5d0 0x7f5bc40cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.756+0000 7f5bcc200640 1 --2- 172.21.15.17:0/1376561885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bc40b4370 0x7f5bc4135360 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.760+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 >> 172.21.15.17:0/1376561885 conn(0x7f5bc406cfc0 msgr2=0x7f5bc4068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.760+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 shutdown_connections 2024-09-10T23:29:18.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.760+0000 7f5bcc200640 1 -- 172.21.15.17:0/1376561885 wait complete. 2024-09-10T23:29:18.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:29:18.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.924+0000 7f4bd8600640 1 -- 172.21.15.17:0/83735303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bb8003fe0 msgr2=0x7f4bb8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.924+0000 7f4bd8600640 1 --2- 172.21.15.17:0/83735303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bb8003fe0 0x7f4bb8004810 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009b60 tx=0x7f4bbc01d2b0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.924+0000 7f4bd6600640 1 -- 172.21.15.17:0/83735303 reap_dead start 2024-09-10T23:29:18.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.924+0000 7f4bd8600640 1 -- 172.21.15.17:0/83735303 shutdown_connections 2024-09-10T23:29:18.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.924+0000 7f4bd8600640 1 -- 172.21.15.17:0/83735303 >> 172.21.15.17:0/83735303 conn(0x7f4bd00d1d10 msgr2=0x7f4bd00d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.924+0000 7f4bd8600640 1 -- 172.21.15.17:0/83735303 shutdown_connections 2024-09-10T23:29:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.924+0000 7f4bd8600640 1 -- 172.21.15.17:0/83735303 wait complete. 2024-09-10T23:29:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.924+0000 7f4bd8600640 1 Processor -- start 2024-09-10T23:29:18.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.924+0000 7f4bd8600640 1 -- start start 2024-09-10T23:29:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd8600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bb8003fe0 0x7f4bd0150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd8600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd0165580 0x7f4bd014f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd8600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd014c870 0x7f4bd014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd8600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0166d40 con 0x7f4bb8003fe0 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd8600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0166bc0 con 0x7f4bd0165580 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd8600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd0166ec0 con 0x7f4bd014c870 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bb8003fe0 0x7f4bd0150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bb8003fe0 0x7f4bd0150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56410/0 (socket says 172.21.15.17:56410) 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5c00640 1 -- 172.21.15.17:0/2702126683 learned_addr learned my addr 172.21.15.17:0/2702126683 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5200640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd0165580 0x7f4bd014f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd6600640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd014c870 0x7f4bd014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5c00640 1 -- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd014c870 msgr2=0x7f4bd014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5c00640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd014c870 0x7f4bd014cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5c00640 1 -- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd0165580 msgr2=0x7f4bd014f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5c00640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd0165580 0x7f4bd014f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:18.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5c00640 1 -- 172.21.15.17:0/2702126683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd0165a00 con 0x7f4bb8003fe0 2024-09-10T23:29:18.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd5c00640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bb8003fe0 0x7f4bd0150200 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4011b10 tx=0x7f4bc4009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bcd600640 1 -- 172.21.15.17:0/2702126683 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc401e070 con 0x7f4bb8003fe0 2024-09-10T23:29:18.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bcd600640 1 -- 172.21.15.17:0/2702126683 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bc4004050 con 0x7f4bb8003fe0 2024-09-10T23:29:18.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bcd600640 1 -- 172.21.15.17:0/2702126683 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc400fea0 con 0x7f4bb8003fe0 2024-09-10T23:29:18.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd00cb110 con 0x7f4bb8003fe0 2024-09-10T23:29:18.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd00cb3b0 con 0x7f4bb8003fe0 2024-09-10T23:29:18.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.928+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd00ce720 con 0x7f4bb8003fe0 2024-09-10T23:29:18.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.932+0000 7f4bcd600640 1 -- 172.21.15.17:0/2702126683 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4bc4003600 con 0x7f4bb8003fe0 2024-09-10T23:29:18.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.932+0000 7f4bcd600640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb00725e0 0x7f4bb0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:18.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.932+0000 7f4bcd600640 1 -- 172.21.15.17:0/2702126683 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5249+0+0 (secure 0 0 0) 0x7f4bc4093df0 con 0x7f4bb8003fe0 2024-09-10T23:29:18.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.932+0000 7f4bd5200640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb00725e0 0x7f4bb0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:18.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.932+0000 7f4bd5200640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb00725e0 0x7f4bb0074aa0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0ae000 tx=0x7f4bbc01a050 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:18.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:18.936+0000 7f4bcd600640 1 -- 172.21.15.17:0/2702126683 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4bd0165a00 con 0x7f4bb8003fe0 2024-09-10T23:29:19.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4bd00d2190 con 0x7f4bb8003fe0 2024-09-10T23:29:19.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bcd600640 1 -- 172.21.15.17:0/2702126683 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v185) ==== 84+0+65 (secure 0 0 0) 0x7f4bc405f060 con 0x7f4bb8003fe0 2024-09-10T23:29:19.113 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:19.113 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:29:19.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:29:19.113 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:29:19.113 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:29:19.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:19.113 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb00725e0 msgr2=0x7f4bb0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb00725e0 0x7f4bb0074aa0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0ae000 tx=0x7f4bbc01a050 comp rx=0 tx=0).stop 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bb8003fe0 msgr2=0x7f4bd0150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bb8003fe0 0x7f4bd0150200 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4011b10 tx=0x7f4bc4009ea0 comp rx=0 tx=0).stop 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 shutdown_connections 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb00725e0 0x7f4bb0074aa0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd014c870 0x7f4bd014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd0165580 0x7f4bd014f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 --2- 172.21.15.17:0/2702126683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bb8003fe0 0x7f4bd0150200 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:19.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 >> 172.21.15.17:0/2702126683 conn(0x7f4bd00d1d10 msgr2=0x7f4bd0071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:19.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 shutdown_connections 2024-09-10T23:29:19.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.112+0000 7f4bd8600640 1 -- 172.21.15.17:0/2702126683 wait complete. 2024-09-10T23:29:19.135 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:29:19.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:29:19.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.284+0000 7efeb4800640 1 -- 172.21.15.17:0/3928640994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 msgr2=0x7efeac0cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:19.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.284+0000 7efeb4800640 1 --2- 172.21.15.17:0/3928640994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 0x7efeac0cff20 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7efea8009bc0 tx=0x7efea801cba0 comp rx=0 tx=0).stop 2024-09-10T23:29:19.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.284+0000 7efeb4800640 1 -- 172.21.15.17:0/3928640994 shutdown_connections 2024-09-10T23:29:19.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.284+0000 7efeb4800640 1 --2- 172.21.15.17:0/3928640994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 0x7efeac0cff20 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:19.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.284+0000 7efeb4800640 1 -- 172.21.15.17:0/3928640994 >> 172.21.15.17:0/3928640994 conn(0x7efeac09b080 msgr2=0x7efeac0d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:19.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.284+0000 7efeb4800640 1 -- 172.21.15.17:0/3928640994 shutdown_connections 2024-09-10T23:29:19.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.284+0000 7efeb4800640 1 -- 172.21.15.17:0/3928640994 wait complete. 2024-09-10T23:29:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 Processor -- start 2024-09-10T23:29:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 -- start start 2024-09-10T23:29:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeac0b0990 0x7efeac14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 0x7efeac0b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeac15f600 0x7efeac148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efeac16a920 con 0x7efeac0b28e0 2024-09-10T23:29:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efeac16a7a0 con 0x7efeac0b0990 2024-09-10T23:29:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efeac16aaa0 con 0x7efeac15f600 2024-09-10T23:29:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 0x7efeac0b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 0x7efeac0b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56420/0 (socket says 172.21.15.17:56420) 2024-09-10T23:29:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1400640 1 -- 172.21.15.17:0/1034037203 learned_addr learned my addr 172.21.15.17:0/1034037203 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb2800640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeac15f600 0x7efeac148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1e00640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeac0b0990 0x7efeac14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1400640 1 -- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeac15f600 msgr2=0x7efeac148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1400640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeac15f600 0x7efeac148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1400640 1 -- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeac0b0990 msgr2=0x7efeac14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1400640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeac0b0990 0x7efeac14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1400640 1 -- 172.21.15.17:0/1034037203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeac1493e0 con 0x7efeac0b28e0 2024-09-10T23:29:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1e00640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeac0b0990 0x7efeac14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb1400640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 0x7efeac0b7520 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00c420 tx=0x7efe9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efea6000640 1 -- 172.21.15.17:0/1034037203 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c017070 con 0x7efeac0b28e0 2024-09-10T23:29:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efea6000640 1 -- 172.21.15.17:0/1034037203 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe9c003600 con 0x7efeac0b28e0 2024-09-10T23:29:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efea6000640 1 -- 172.21.15.17:0/1034037203 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c003a90 con 0x7efeac0b28e0 2024-09-10T23:29:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeac1496c0 con 0x7efeac0b28e0 2024-09-10T23:29:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.288+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeac149c80 con 0x7efeac0b28e0 2024-09-10T23:29:19.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.292+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeac0cff20 con 0x7efeac0b28e0 2024-09-10T23:29:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.292+0000 7efea6000640 1 -- 172.21.15.17:0/1034037203 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efe9c003c30 con 0x7efeac0b28e0 2024-09-10T23:29:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.292+0000 7efea6000640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe90072610 0x7efe90074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.292+0000 7efea6000640 1 -- 172.21.15.17:0/1034037203 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5249+0+0 (secure 0 0 0) 0x7efe9c092680 con 0x7efeac0b28e0 2024-09-10T23:29:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.292+0000 7efeb1e00640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe90072610 0x7efe90074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:19.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.292+0000 7efeb1e00640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe90072610 0x7efe90074ad0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7efea0000f70 tx=0x7efea0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:19.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.296+0000 7efea6000640 1 -- 172.21.15.17:0/1034037203 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efe9c05d830 con 0x7efeac0b28e0 2024-09-10T23:29:19.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:19.476+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efeac0b1430 con 0x7efeac0b28e0 2024-09-10T23:29:20.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.340+0000 7efea6000640 1 -- 172.21.15.17:0/1034037203 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v186) ==== 138+0+0 (secure 0 0 0) 0x7efe9c062260 con 0x7efeac0b28e0 2024-09-10T23:29:20.343 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:29:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe90072610 msgr2=0x7efe90074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe90072610 0x7efe90074ad0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7efea0000f70 tx=0x7efea0009040 comp rx=0 tx=0).stop 2024-09-10T23:29:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 msgr2=0x7efeac0b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 0x7efeac0b7520 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00c420 tx=0x7efe9c00c8e0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 shutdown_connections 2024-09-10T23:29:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe90072610 0x7efe90074ad0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeac15f600 0x7efeac148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeac0b28e0 0x7efeac0b7520 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 --2- 172.21.15.17:0/1034037203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeac0b0990 0x7efeac14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 >> 172.21.15.17:0/1034037203 conn(0x7efeac09b080 msgr2=0x7efeac0cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 shutdown_connections 2024-09-10T23:29:20.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.344+0000 7efeb4800640 1 -- 172.21.15.17:0/1034037203 wait complete. 2024-09-10T23:29:20.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:29:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.528+0000 7f930fa00640 1 -- 172.21.15.17:0/419510434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f0004810 msgr2=0x7f92f0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.528+0000 7f930fa00640 1 --2- 172.21.15.17:0/419510434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f0004810 0x7f92f0004c90 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f92f4006f20 tx=0x7f92f401ce80 comp rx=0 tx=0).stop 2024-09-10T23:29:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.528+0000 7f930da00640 1 -- 172.21.15.17:0/419510434 reap_dead start 2024-09-10T23:29:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.528+0000 7f930fa00640 1 -- 172.21.15.17:0/419510434 shutdown_connections 2024-09-10T23:29:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.528+0000 7f930fa00640 1 -- 172.21.15.17:0/419510434 >> 172.21.15.17:0/419510434 conn(0x7f930809a9f0 msgr2=0x7f930809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.528+0000 7f930fa00640 1 -- 172.21.15.17:0/419510434 shutdown_connections 2024-09-10T23:29:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.528+0000 7f930fa00640 1 -- 172.21.15.17:0/419510434 wait complete. 2024-09-10T23:29:20.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.528+0000 7f930fa00640 1 Processor -- start 2024-09-10T23:29:20.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.528+0000 7f930fa00640 1 -- start start 2024-09-10T23:29:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930fa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f0004810 0x7f93080cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930fa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93080cf360 0x7f93081f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930fa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93081f4830 0x7f93081f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930fa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93080d2bf0 con 0x7f93080cf360 2024-09-10T23:29:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930fa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93080d2a70 con 0x7f93081f4830 2024-09-10T23:29:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930fa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f930815c680 con 0x7f92f0004810 2024-09-10T23:29:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9307e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93080cf360 0x7f93081f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9307e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93080cf360 0x7f93081f1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56440/0 (socket says 172.21.15.17:56440) 2024-09-10T23:29:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9307e00640 1 -- 172.21.15.17:0/132684557 learned_addr learned my addr 172.21.15.17:0/132684557 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930d000640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f0004810 0x7f93080cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930da00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93081f4830 0x7f93081f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9307e00640 1 -- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f0004810 msgr2=0x7f93080cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9307e00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f0004810 0x7f93080cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9307e00640 1 -- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93081f4830 msgr2=0x7f93081f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9307e00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93081f4830 0x7f93081f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9307e00640 1 -- 172.21.15.17:0/132684557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93081f2280 con 0x7f93080cf360 2024-09-10T23:29:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930da00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93081f4830 0x7f93081f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9307e00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93080cf360 0x7f93081f1d40 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f92f401b580 tx=0x7f92f4004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9304c00640 1 -- 172.21.15.17:0/132684557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4006b50 con 0x7f93080cf360 2024-09-10T23:29:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9304c00640 1 -- 172.21.15.17:0/132684557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92f4006090 con 0x7f93080cf360 2024-09-10T23:29:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f9304c00640 1 -- 172.21.15.17:0/132684557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4001500 con 0x7f93080cf360 2024-09-10T23:29:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93080cee80 con 0x7f93080cf360 2024-09-10T23:29:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93080c9440 con 0x7f93080cf360 2024-09-10T23:29:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.532+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93080cec90 con 0x7f93080cf360 2024-09-10T23:29:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.536+0000 7f9304c00640 1 -- 172.21.15.17:0/132684557 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f92f40c1450 con 0x7f93080cf360 2024-09-10T23:29:20.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.536+0000 7f9304c00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92e80725e0 0x7f92e8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:20.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.536+0000 7f9304c00640 1 -- 172.21.15.17:0/132684557 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5619+0+0 (secure 0 0 0) 0x7f92f412dd60 con 0x7f93080cf360 2024-09-10T23:29:20.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.536+0000 7f930d000640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92e80725e0 0x7f92e8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.536+0000 7f930d000640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92e80725e0 0x7f92e8074aa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0037a0 tx=0x7f92fc00a9e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.540+0000 7f9304c00640 1 -- 172.21.15.17:0/132684557 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f92f4016c30 con 0x7f93080cf360 2024-09-10T23:29:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:20.716+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f93080b12e0 con 0x7f93080cf360 2024-09-10T23:29:21.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.348+0000 7f9304c00640 1 -- 172.21.15.17:0/132684557 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v187) ==== 170+0+0 (secure 0 0 0) 0x7f92f4006240 con 0x7f93080cf360 2024-09-10T23:29:21.350 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:29:21.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92e80725e0 msgr2=0x7f92e8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92e80725e0 0x7f92e8074aa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0037a0 tx=0x7f92fc00a9e0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93080cf360 msgr2=0x7f93081f1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93080cf360 0x7f93081f1d40 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f92f401b580 tx=0x7f92f4004bf0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 shutdown_connections 2024-09-10T23:29:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f92e80725e0 0x7f92e8074aa0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93081f4830 0x7f93081f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93080cf360 0x7f93081f1d40 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 --2- 172.21.15.17:0/132684557 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92f0004810 0x7f93080cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 >> 172.21.15.17:0/132684557 conn(0x7f930809a9f0 msgr2=0x7f93080711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 shutdown_connections 2024-09-10T23:29:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.352+0000 7f930fa00640 1 -- 172.21.15.17:0/132684557 wait complete. 2024-09-10T23:29:21.389 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:29:21.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.540+0000 7f4bdb800640 1 -- 172.21.15.17:0/3080983987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cc730 msgr2=0x7f4bd40ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.540+0000 7f4bdb800640 1 --2- 172.21.15.17:0/3080983987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cc730 0x7f4bd40ccba0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40cc500 tx=0x7f4bcc01cb80 comp rx=0 tx=0).stop 2024-09-10T23:29:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.540+0000 7f4bdb800640 1 -- 172.21.15.17:0/3080983987 shutdown_connections 2024-09-10T23:29:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.540+0000 7f4bdb800640 1 --2- 172.21.15.17:0/3080983987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cc730 0x7f4bd40ccba0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.540+0000 7f4bdb800640 1 --2- 172.21.15.17:0/3080983987 >> v2:172.21.15.77:3300/0 conn(0x7f4bd40cf040 0x7f4bd40cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.540+0000 7f4bdb800640 1 -- 172.21.15.17:0/3080983987 >> 172.21.15.17:0/3080983987 conn(0x7f4bd40b17a0 msgr2=0x7f4bd40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.540+0000 7f4bdb800640 1 -- 172.21.15.17:0/3080983987 shutdown_connections 2024-09-10T23:29:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.540+0000 7f4bdb800640 1 -- 172.21.15.17:0/3080983987 wait complete. 2024-09-10T23:29:21.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 Processor -- start 2024-09-10T23:29:21.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 -- start start 2024-09-10T23:29:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd40cc730 0x7f4bd4163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cf040 0x7f4bd41454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd415a2a0 0x7f4bd4153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40cd520 con 0x7f4bd40cf040 2024-09-10T23:29:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40cd3a0 con 0x7f4bd415a2a0 2024-09-10T23:29:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd40cd6a0 con 0x7f4bd40cc730 2024-09-10T23:29:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cf040 0x7f4bd41454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cf040 0x7f4bd41454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56446/0 (socket says 172.21.15.17:56446) 2024-09-10T23:29:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd3e00640 1 -- 172.21.15.17:0/2013154926 learned_addr learned my addr 172.21.15.17:0/2013154926 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd8e00640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd40cc730 0x7f4bd4163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd9800640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd415a2a0 0x7f4bd4153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd3e00640 1 -- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd40cc730 msgr2=0x7f4bd4163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd3e00640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd40cc730 0x7f4bd4163f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd3e00640 1 -- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd415a2a0 msgr2=0x7f4bd4153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd3e00640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd415a2a0 0x7f4bd4153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd3e00640 1 -- 172.21.15.17:0/2013154926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd4164860 con 0x7f4bd40cf040 2024-09-10T23:29:21.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd9800640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd415a2a0 0x7f4bd4153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:21.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd3e00640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cf040 0x7f4bd41454b0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000dba0 tx=0x7f4bc000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:21.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd0c00640 1 -- 172.21.15.17:0/2013154926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0005220 con 0x7f4bd40cf040 2024-09-10T23:29:21.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd0c00640 1 -- 172.21.15.17:0/2013154926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bc000ae50 con 0x7f4bd40cf040 2024-09-10T23:29:21.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd41fa920 con 0x7f4bd40cf040 2024-09-10T23:29:21.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bd0c00640 1 -- 172.21.15.17:0/2013154926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00047b0 con 0x7f4bd40cf040 2024-09-10T23:29:21.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd41faee0 con 0x7f4bd40cf040 2024-09-10T23:29:21.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.544+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd40ccba0 con 0x7f4bd40cf040 2024-09-10T23:29:21.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.548+0000 7f4bd0c00640 1 -- 172.21.15.17:0/2013154926 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4bc0027080 con 0x7f4bd40cf040 2024-09-10T23:29:21.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.548+0000 7f4bd0c00640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb40725e0 0x7f4bb4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:21.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.548+0000 7f4bd0c00640 1 -- 172.21.15.17:0/2013154926 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 6001+0+0 (secure 0 0 0) 0x7f4bc0093ff0 con 0x7f4bd40cf040 2024-09-10T23:29:21.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.548+0000 7f4bd8e00640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb40725e0 0x7f4bb4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:21.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.548+0000 7f4bd8e00640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb40725e0 0x7f4bb4074aa0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000f70 tx=0x7f4bc8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:21.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.552+0000 7f4bd0c00640 1 -- 172.21.15.17:0/2013154926 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4bc005f590 con 0x7f4bd40cf040 2024-09-10T23:29:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:21.764+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4bd41fb0b0 con 0x7f4bd40cf040 2024-09-10T23:29:22.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.368+0000 7f4bd0c00640 1 -- 172.21.15.17:0/2013154926 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 27 and data pool 28 v140) ==== 174+0+0 (secure 0 0 0) 0x7f4bc005ee90 con 0x7f4bd40cf040 2024-09-10T23:29:22.372 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 27 and data pool 28 2024-09-10T23:29:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb40725e0 msgr2=0x7f4bb4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb40725e0 0x7f4bb4074aa0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000f70 tx=0x7f4bc8009040 comp rx=0 tx=0).stop 2024-09-10T23:29:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cf040 msgr2=0x7f4bd41454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cf040 0x7f4bd41454b0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000dba0 tx=0x7f4bc000a620 comp rx=0 tx=0).stop 2024-09-10T23:29:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 shutdown_connections 2024-09-10T23:29:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4bb40725e0 0x7f4bb4074aa0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd415a2a0 0x7f4bd4153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bd40cf040 0x7f4bd41454b0 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 --2- 172.21.15.17:0/2013154926 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd40cc730 0x7f4bd4163f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 >> 172.21.15.17:0/2013154926 conn(0x7f4bd40b17a0 msgr2=0x7f4bd406f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 shutdown_connections 2024-09-10T23:29:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.380+0000 7f4bdb800640 1 -- 172.21.15.17:0/2013154926 wait complete. 2024-09-10T23:29:22.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:29:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 -- 172.21.15.17:0/1552036070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b4350 msgr2=0x7fda740d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 --2- 172.21.15.17:0/1552036070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b4350 0x7fda740d0460 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fda7406dba0 tx=0x7fda6c01ccc0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 -- 172.21.15.17:0/1552036070 shutdown_connections 2024-09-10T23:29:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 --2- 172.21.15.17:0/1552036070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b4350 0x7fda740d0460 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 --2- 172.21.15.17:0/1552036070 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda740b3870 0x7fda740cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 --2- 172.21.15.17:0/1552036070 >> v2:172.21.15.77:3300/0 conn(0x7fda741550b0 0x7fda740b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 -- 172.21.15.17:0/1552036070 >> 172.21.15.17:0/1552036070 conn(0x7fda7406cfc0 msgr2=0x7fda7406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 -- 172.21.15.17:0/1552036070 shutdown_connections 2024-09-10T23:29:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 -- 172.21.15.17:0/1552036070 wait complete. 2024-09-10T23:29:22.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 Processor -- start 2024-09-10T23:29:22.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 -- start start 2024-09-10T23:29:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b3870 0x7fda74147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda740b4350 0x7fda740c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda741550b0 0x7fda7415d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fda7415c5e0 con 0x7fda740b3870 2024-09-10T23:29:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda7415c460 con 0x7fda740b4350 2024-09-10T23:29:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fda7415c760 con 0x7fda741550b0 2024-09-10T23:29:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda79800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b3870 0x7fda74147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda79800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b3870 0x7fda74147910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56468/0 (socket says 172.21.15.17:56468) 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda79800640 1 -- 172.21.15.17:0/326822606 learned_addr learned my addr 172.21.15.17:0/326822606 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda78e00640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda740b4350 0x7fda740c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.564+0000 7fda7a200640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda741550b0 0x7fda7415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda79800640 1 -- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda741550b0 msgr2=0x7fda7415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda79800640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda741550b0 0x7fda7415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda79800640 1 -- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda740b4350 msgr2=0x7fda740c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda79800640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda740b4350 0x7fda740c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda79800640 1 -- 172.21.15.17:0/326822606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda740c5000 con 0x7fda740b3870 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda7a200640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda741550b0 0x7fda7415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda78e00640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda740b4350 0x7fda740c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda79800640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b3870 0x7fda74147910 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fda6800d950 tx=0x7fda6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda71600640 1 -- 172.21.15.17:0/326822606 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68017070 con 0x7fda740b3870 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda71600640 1 -- 172.21.15.17:0/326822606 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda68009d20 con 0x7fda740b3870 2024-09-10T23:29:22.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda74150490 con 0x7fda740b3870 2024-09-10T23:29:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda71600640 1 -- 172.21.15.17:0/326822606 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda680106c0 con 0x7fda740b3870 2024-09-10T23:29:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda74150a50 con 0x7fda740b3870 2024-09-10T23:29:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda740b3e10 con 0x7fda740b3870 2024-09-10T23:29:22.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.568+0000 7fda71600640 1 -- 172.21.15.17:0/326822606 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fda68010860 con 0x7fda740b3870 2024-09-10T23:29:22.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.572+0000 7fda71600640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fda540725e0 0x7fda54074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.572+0000 7fda71600640 1 -- 172.21.15.17:0/326822606 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 6101+0+0 (secure 0 0 0) 0x7fda68093bb0 con 0x7fda740b3870 2024-09-10T23:29:22.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.572+0000 7fda78e00640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fda540725e0 0x7fda54074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.572+0000 7fda78e00640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fda540725e0 0x7fda54074aa0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fda60005fd0 tx=0x7fda60005f00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.572+0000 7fda71600640 1 -- 172.21.15.17:0/326822606 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fda6805f270 con 0x7fda740b3870 2024-09-10T23:29:22.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.748+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda7414c390 con 0x7fda740b3870 2024-09-10T23:29:22.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda71600640 1 -- 172.21.15.17:0/326822606 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16965 (secure 0 0 0) 0x7fda6805eb70 con 0x7fda740b3870 2024-09-10T23:29:22.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:22.828 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":188,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:29:21.766112+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:29:19.490385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-10T23:29:20.728719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:29:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fda540725e0 msgr2=0x7fda54074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fda540725e0 0x7fda54074aa0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fda60005fd0 tx=0x7fda60005f00 comp rx=0 tx=0).stop 2024-09-10T23:29:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b3870 msgr2=0x7fda74147910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b3870 0x7fda74147910 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fda6800d950 tx=0x7fda6800de10 comp rx=0 tx=0).stop 2024-09-10T23:29:22.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 shutdown_connections 2024-09-10T23:29:22.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fda540725e0 0x7fda54074aa0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fda741550b0 0x7fda7415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda740b4350 0x7fda740c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 --2- 172.21.15.17:0/326822606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda740b3870 0x7fda74147910 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 >> 172.21.15.17:0/326822606 conn(0x7fda7406cfc0 msgr2=0x7fda74154080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 shutdown_connections 2024-09-10T23:29:22.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.752+0000 7fda7c200640 1 -- 172.21.15.17:0/326822606 wait complete. 2024-09-10T23:29:22.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:29:22.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 -- 172.21.15.17:0/2668704778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa774070730 msgr2=0x7fa77415ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 --2- 172.21.15.17:0/2668704778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa774070730 0x7fa77415ffe0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa768009900 tx=0x7fa76801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 -- 172.21.15.17:0/2668704778 shutdown_connections 2024-09-10T23:29:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 --2- 172.21.15.17:0/2668704778 >> v2:172.21.15.77:3300/0 conn(0x7fa7740cd4c0 0x7fa77415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 --2- 172.21.15.17:0/2668704778 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa774070730 0x7fa77415ffe0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 -- 172.21.15.17:0/2668704778 >> 172.21.15.17:0/2668704778 conn(0x7fa7740b2740 msgr2=0x7fa7740b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 -- 172.21.15.17:0/2668704778 shutdown_connections 2024-09-10T23:29:22.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 -- 172.21.15.17:0/2668704778 wait complete. 2024-09-10T23:29:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 Processor -- start 2024-09-10T23:29:22.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.976+0000 7fa77ac00640 1 -- start start 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa774070730 0x7fa774154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7740cd4c0 0x7fa774153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa77415eee0 0x7fa77414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa774168af0 con 0x7fa774070730 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa774168970 con 0x7fa77415eee0 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa774168c70 con 0x7fa7740cd4c0 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa779800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa774070730 0x7fa774154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa779800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa774070730 0x7fa774154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56472/0 (socket says 172.21.15.17:56472) 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa779800640 1 -- 172.21.15.17:0/670994330 learned_addr learned my addr 172.21.15.17:0/670994330 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa778e00640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7740cd4c0 0x7fa774153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77a200640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa77415eee0 0x7fa77414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa779800640 1 -- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7740cd4c0 msgr2=0x7fa774153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa779800640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7740cd4c0 0x7fa774153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa779800640 1 -- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa77415eee0 msgr2=0x7fa77414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa779800640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa77415eee0 0x7fa77414e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa779800640 1 -- 172.21.15.17:0/670994330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77414e840 con 0x7fa774070730 2024-09-10T23:29:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa779800640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa774070730 0x7fa774154c60 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fa7680b0040 tx=0x7fa7680a57a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa771600640 1 -- 172.21.15.17:0/670994330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680b2040 con 0x7fa774070730 2024-09-10T23:29:22.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa771600640 1 -- 172.21.15.17:0/670994330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa768005030 con 0x7fa774070730 2024-09-10T23:29:22.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa771600640 1 -- 172.21.15.17:0/670994330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680044f0 con 0x7fa774070730 2024-09-10T23:29:22.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7741fb180 con 0x7fa774070730 2024-09-10T23:29:22.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7741fb740 con 0x7fa774070730 2024-09-10T23:29:22.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.980+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa77415ffe0 con 0x7fa774070730 2024-09-10T23:29:22.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.984+0000 7fa771600640 1 -- 172.21.15.17:0/670994330 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa768005460 con 0x7fa774070730 2024-09-10T23:29:22.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.984+0000 7fa771600640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7540725e0 0x7fa754074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:22.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.984+0000 7fa771600640 1 -- 172.21.15.17:0/670994330 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 6101+0+0 (secure 0 0 0) 0x7fa76812ca20 con 0x7fa774070730 2024-09-10T23:29:22.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.984+0000 7fa778e00640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7540725e0 0x7fa754074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:22.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.984+0000 7fa778e00640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7540725e0 0x7fa754074aa0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa7740b08d0 tx=0x7fa7600091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:22.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:22.988+0000 7fa771600640 1 -- 172.21.15.17:0/670994330 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa7680164d0 con 0x7fa774070730 2024-09-10T23:29:23.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.160+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7741533b0 con 0x7fa774070730 2024-09-10T23:29:23.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa771600640 1 -- 172.21.15.17:0/670994330 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16965 (secure 0 0 0) 0x7fa7680f7880 con 0x7fa774070730 2024-09-10T23:29:23.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:23.164 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":188,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:29:21.766112+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:29:19.490385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-10T23:29:20.728719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:29:23.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7540725e0 msgr2=0x7fa754074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:23.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7540725e0 0x7fa754074aa0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa7740b08d0 tx=0x7fa7600091e0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa774070730 msgr2=0x7fa774154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:23.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa774070730 0x7fa774154c60 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fa7680b0040 tx=0x7fa7680a57a0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 shutdown_connections 2024-09-10T23:29:23.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa7540725e0 0x7fa754074aa0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa77415eee0 0x7fa77414e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7740cd4c0 0x7fa774153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 --2- 172.21.15.17:0/670994330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa774070730 0x7fa774154c60 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 >> 172.21.15.17:0/670994330 conn(0x7fa7740b2740 msgr2=0x7fa774151560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:23.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 shutdown_connections 2024-09-10T23:29:23.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.164+0000 7fa77ac00640 1 -- 172.21.15.17:0/670994330 wait complete. 2024-09-10T23:29:23.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:29:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 -- 172.21.15.17:0/1486791473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 msgr2=0x7f8e0415f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 --2- 172.21.15.17:0/1486791473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 0x7f8e0415f770 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009900 tx=0x7f8df001c700 comp rx=0 tx=0).stop 2024-09-10T23:29:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 -- 172.21.15.17:0/1486791473 shutdown_connections 2024-09-10T23:29:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 --2- 172.21.15.17:0/1486791473 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e0406e6f0 0x7f8e0415fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 --2- 172.21.15.17:0/1486791473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 0x7f8e0415f770 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 -- 172.21.15.17:0/1486791473 >> 172.21.15.17:0/1486791473 conn(0x7f8e040b17a0 msgr2=0x7f8e040b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 -- 172.21.15.17:0/1486791473 shutdown_connections 2024-09-10T23:29:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 -- 172.21.15.17:0/1486791473 wait complete. 2024-09-10T23:29:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 Processor -- start 2024-09-10T23:29:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 -- start start 2024-09-10T23:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e0406e6f0 0x7f8e041556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e04145800 0x7f8e0413b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 0x7f8e0413e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04168a80 con 0x7f8e04160460 2024-09-10T23:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04168900 con 0x7f8e04145800 2024-09-10T23:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0c400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8e04168c00 con 0x7f8e0406e6f0 2024-09-10T23:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 0x7f8e0413e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:23.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 0x7f8e0413e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56490/0 (socket says 172.21.15.17:56490) 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0a400640 1 -- 172.21.15.17:0/938321135 learned_addr learned my addr 172.21.15.17:0/938321135 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e09000640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e04145800 0x7f8e0413b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e09a00640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e0406e6f0 0x7f8e041556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0a400640 1 -- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e0406e6f0 msgr2=0x7f8e041556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0a400640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e0406e6f0 0x7f8e041556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0a400640 1 -- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e04145800 msgr2=0x7f8e0413b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0a400640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e04145800 0x7f8e0413b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e0a400640 1 -- 172.21.15.17:0/938321135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0413c200 con 0x7f8e04160460 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.336+0000 7f8e09000640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e04145800 0x7f8e0413b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:23.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e0a400640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 0x7f8e0413e600 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00cce0 tx=0x7f8dfc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e01600640 1 -- 172.21.15.17:0/938321135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00f450 con 0x7f8e04160460 2024-09-10T23:29:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e01600640 1 -- 172.21.15.17:0/938321135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dfc00f700 con 0x7f8e04160460 2024-09-10T23:29:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0413d840 con 0x7f8e04160460 2024-09-10T23:29:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e01600640 1 -- 172.21.15.17:0/938321135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00fb50 con 0x7f8e04160460 2024-09-10T23:29:23.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0413de00 con 0x7f8e04160460 2024-09-10T23:29:23.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e040741d0 con 0x7f8e04160460 2024-09-10T23:29:23.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e01600640 1 -- 172.21.15.17:0/938321135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8dfc0213f0 con 0x7f8e04160460 2024-09-10T23:29:23.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e01600640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8de4072610 0x7f8de4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:23.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e01600640 1 -- 172.21.15.17:0/938321135 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 6101+0+0 (secure 0 0 0) 0x7f8dfc094020 con 0x7f8e04160460 2024-09-10T23:29:23.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.340+0000 7f8e09a00640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8de4072610 0x7f8de4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:23.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.344+0000 7f8e09a00640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8de4072610 0x7f8de4074ad0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8e040d0580 tx=0x7f8df8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:23.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.344+0000 7f8e01600640 1 -- 172.21.15.17:0/938321135 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8dfc014030 con 0x7f8e04160460 2024-09-10T23:29:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:23.564+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8e0413cf20 con 0x7f8e04160460 2024-09-10T23:29:24.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.376+0000 7f8e01600640 1 -- 172.21.15.17:0/938321135 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v143) ==== 118+0+0 (secure 0 0 0) 0x7f8dfc05f560 con 0x7f8e04160460 2024-09-10T23:29:24.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8de4072610 msgr2=0x7f8de4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:24.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8de4072610 0x7f8de4074ad0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8e040d0580 tx=0x7f8df8009040 comp rx=0 tx=0).stop 2024-09-10T23:29:24.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 msgr2=0x7f8e0413e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:24.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 0x7f8e0413e600 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00cce0 tx=0x7f8dfc00a620 comp rx=0 tx=0).stop 2024-09-10T23:29:24.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 shutdown_connections 2024-09-10T23:29:24.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8de4072610 0x7f8de4074ad0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e04160460 0x7f8e0413e600 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e04145800 0x7f8e0413b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 --2- 172.21.15.17:0/938321135 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e0406e6f0 0x7f8e041556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 >> 172.21.15.17:0/938321135 conn(0x7f8e040b17a0 msgr2=0x7f8e040b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 shutdown_connections 2024-09-10T23:29:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.380+0000 7f8e0c400640 1 -- 172.21.15.17:0/938321135 wait complete. 2024-09-10T23:29:24.405 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:29:24.405 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:29:24.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 -- 172.21.15.17:0/3594584052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 msgr2=0x7f7e900cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:24.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 --2- 172.21.15.17:0/3594584052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 0x7f7e900cc730 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009bc0 tx=0x7f7e8801cb70 comp rx=0 tx=0).stop 2024-09-10T23:29:24.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 -- 172.21.15.17:0/3594584052 shutdown_connections 2024-09-10T23:29:24.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 --2- 172.21.15.17:0/3594584052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 0x7f7e900cc730 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 --2- 172.21.15.17:0/3594584052 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e9015a2a0 0x7f7e900b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 -- 172.21.15.17:0/3594584052 >> 172.21.15.17:0/3594584052 conn(0x7f7e900b17a0 msgr2=0x7f7e900b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:24.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 -- 172.21.15.17:0/3594584052 shutdown_connections 2024-09-10T23:29:24.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 -- 172.21.15.17:0/3594584052 wait complete. 2024-09-10T23:29:24.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 Processor -- start 2024-09-10T23:29:24.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 -- start start 2024-09-10T23:29:24.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900b2fe0 0x7f7e90147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:24.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 0x7f7e90149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:24.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015a2a0 0x7f7e90149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:24.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7e900cd470 con 0x7f7e900cf750 2024-09-10T23:29:24.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7e900cd2f0 con 0x7f7e9015a2a0 2024-09-10T23:29:24.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e96600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7e900cd5f0 con 0x7f7e900b2fe0 2024-09-10T23:29:24.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e86a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 0x7f7e90149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:24.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e86a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 0x7f7e90149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56506/0 (socket says 172.21.15.17:56506) 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.560+0000 7f7e86a00640 1 -- 172.21.15.17:0/1226513618 learned_addr learned my addr 172.21.15.17:0/1226513618 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e8fe00640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015a2a0 0x7f7e90149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e8f400640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900b2fe0 0x7f7e90147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e86a00640 1 -- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900b2fe0 msgr2=0x7f7e90147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e86a00640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900b2fe0 0x7f7e90147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e86a00640 1 -- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015a2a0 msgr2=0x7f7e90149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e86a00640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015a2a0 0x7f7e90149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e86a00640 1 -- 172.21.15.17:0/1226513618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9014abd0 con 0x7f7e900cf750 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e8f400640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900b2fe0 0x7f7e90147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e8fe00640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015a2a0 0x7f7e90149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e86a00640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 0x7f7e90149200 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800c500 tx=0x7f7e7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e87e00640 1 -- 172.21.15.17:0/1226513618 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78018070 con 0x7f7e900cf750 2024-09-10T23:29:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e87e00640 1 -- 172.21.15.17:0/1226513618 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e78003600 con 0x7f7e900cf750 2024-09-10T23:29:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e87e00640 1 -- 172.21.15.17:0/1226513618 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78003ad0 con 0x7f7e900cf750 2024-09-10T23:29:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9014aeb0 con 0x7f7e900cf750 2024-09-10T23:29:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9014cb50 con 0x7f7e900cf750 2024-09-10T23:29:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e900cc730 con 0x7f7e900cf750 2024-09-10T23:29:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.564+0000 7f7e87e00640 1 -- 172.21.15.17:0/1226513618 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7e78003c70 con 0x7f7e900cf750 2024-09-10T23:29:24.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.568+0000 7f7e87e00640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e6c0725e0 0x7f7e6c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:24.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.568+0000 7f7e87e00640 1 -- 172.21.15.17:0/1226513618 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f7e78092780 con 0x7f7e900cf750 2024-09-10T23:29:24.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.568+0000 7f7e8f400640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e6c0725e0 0x7f7e6c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:24.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.568+0000 7f7e8f400640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e6c0725e0 0x7f7e6c074aa0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e80005dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:24.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.568+0000 7f7e87e00640 1 -- 172.21.15.17:0/1226513618 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7e7805dd80 con 0x7f7e900cf750 2024-09-10T23:29:24.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:24.780+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7e90153600 con 0x7f7e900cf750 2024-09-10T23:29:25.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e87e00640 1 -- 172.21.15.17:0/1226513618 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v144) ==== 122+0+0 (secure 0 0 0) 0x7f7e7805d680 con 0x7f7e900cf750 2024-09-10T23:29:25.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e6c0725e0 msgr2=0x7f7e6c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e6c0725e0 0x7f7e6c074aa0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7e80005fd0 tx=0x7f7e80005dc0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 msgr2=0x7f7e90149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 0x7f7e90149200 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800c500 tx=0x7f7e7800c9c0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 shutdown_connections 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7e6c0725e0 0x7f7e6c074aa0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e9015a2a0 0x7f7e90149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e900cf750 0x7f7e90149200 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 --2- 172.21.15.17:0/1226513618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7e900b2fe0 0x7f7e90147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 >> 172.21.15.17:0/1226513618 conn(0x7f7e900b17a0 msgr2=0x7f7e901588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 shutdown_connections 2024-09-10T23:29:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.384+0000 7f7e96600640 1 -- 172.21.15.17:0/1226513618 wait complete. 2024-09-10T23:29:25.411 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:29:25.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:29:25.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.560+0000 7f269ee00640 1 -- 172.21.15.17:0/704350484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 msgr2=0x7f269815fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.560+0000 7f269ee00640 1 --2- 172.21.15.17:0/704350484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 0x7f269815fb90 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f26980cfb50 tx=0x7f269001cd80 comp rx=0 tx=0).stop 2024-09-10T23:29:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.560+0000 7f269ee00640 1 -- 172.21.15.17:0/704350484 shutdown_connections 2024-09-10T23:29:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.560+0000 7f269ee00640 1 --2- 172.21.15.17:0/704350484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 0x7f269815fb90 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.560+0000 7f269ee00640 1 --2- 172.21.15.17:0/704350484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26980b4390 0x7f26980d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.560+0000 7f269ee00640 1 --2- 172.21.15.17:0/704350484 >> v2:172.21.15.77:3300/0 conn(0x7f26980cef60 0x7f26980cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.560+0000 7f269ee00640 1 -- 172.21.15.17:0/704350484 >> 172.21.15.17:0/704350484 conn(0x7f26980b3870 msgr2=0x7f26980b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 -- 172.21.15.17:0/704350484 shutdown_connections 2024-09-10T23:29:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 -- 172.21.15.17:0/704350484 wait complete. 2024-09-10T23:29:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 Processor -- start 2024-09-10T23:29:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 -- start start 2024-09-10T23:29:25.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26980b4390 0x7f26981f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:25.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26980cef60 0x7f2698152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:25.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 0x7f26981661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:25.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f269815e3c0 con 0x7f26980cf340 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f269815e240 con 0x7f26980cef60 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f269815e540 con 0x7f26980b4390 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 0x7f26981661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 0x7f26981661b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56534/0 (socket says 172.21.15.17:56534) 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ce00640 1 -- 172.21.15.17:0/435793001 learned_addr learned my addr 172.21.15.17:0/435793001 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f268f400640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26980cef60 0x7f2698152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f2697e00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26980b4390 0x7f26981f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ce00640 1 -- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26980b4390 msgr2=0x7f26981f8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ce00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26980b4390 0x7f26981f8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ce00640 1 -- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26980cef60 msgr2=0x7f2698152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ce00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26980cef60 0x7f2698152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ce00640 1 -- 172.21.15.17:0/435793001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2698165130 con 0x7f26980cf340 2024-09-10T23:29:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f269ce00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 0x7f26981661b0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f2690009bd0 tx=0x7f2690005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.564+0000 7f2694c00640 1 -- 172.21.15.17:0/435793001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26900bb070 con 0x7f26980cf340 2024-09-10T23:29:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.568+0000 7f2694c00640 1 -- 172.21.15.17:0/435793001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2690004d40 con 0x7f26980cf340 2024-09-10T23:29:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.568+0000 7f2694c00640 1 -- 172.21.15.17:0/435793001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26900b2040 con 0x7f26980cf340 2024-09-10T23:29:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.568+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26981653f0 con 0x7f26980cf340 2024-09-10T23:29:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.568+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26981659b0 con 0x7f26980cf340 2024-09-10T23:29:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.568+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269815fb90 con 0x7f26980cf340 2024-09-10T23:29:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.568+0000 7f2694c00640 1 -- 172.21.15.17:0/435793001 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f26900b5030 con 0x7f26980cf340 2024-09-10T23:29:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.568+0000 7f2694c00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26740725e0 0x7f2674074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:25.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.568+0000 7f2694c00640 1 -- 172.21.15.17:0/435793001 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f269012ce40 con 0x7f26980cf340 2024-09-10T23:29:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.568+0000 7f2697e00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26740725e0 0x7f2674074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.572+0000 7f2697e00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26740725e0 0x7f2674074aa0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f268800bc00 tx=0x7f268800b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:25.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.572+0000 7f2694c00640 1 -- 172.21.15.17:0/435793001 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2690016970 con 0x7f26980cf340 2024-09-10T23:29:25.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.780+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26980b1030 con 0x7f26980cf340 2024-09-10T23:29:25.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.780+0000 7f2694c00640 1 -- 172.21.15.17:0/435793001 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5236 (secure 0 0 0) 0x7f26900f7ca0 con 0x7f26980cf340 2024-09-10T23:29:25.783 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:25.783 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":144,"btime":"2024-09-10T23:29:25:379289+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3439807694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3439807694},{"type":"v1","addr":"172.21.15.77:6837","nonce":3439807694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":9772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2077624650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2077624650},{"type":"v1","addr":"172.21.15.77:6836","nonce":2077624650}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10638,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/294398472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":294398472},{"type":"v1","addr":"172.21.15.17:6834","nonce":294398472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:29:21.766077+0000","modified":"2024-09-10T23:29:24.781764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10641":{"gid":10641,"name":"c","rank":0,"incarnation":140,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4256418601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4256418601},{"type":"v1","addr":"172.21.15.17:6835","nonce":4256418601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10641,"qdb_cluster":[10641]},"id":13}]} 2024-09-10T23:29:25.783 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 144 2024-09-10T23:29:25.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26740725e0 msgr2=0x7f2674074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26740725e0 0x7f2674074aa0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f268800bc00 tx=0x7f268800b390 comp rx=0 tx=0).stop 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 msgr2=0x7f26981661b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 0x7f26981661b0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f2690009bd0 tx=0x7f2690005b00 comp rx=0 tx=0).stop 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 shutdown_connections 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f26740725e0 0x7f2674074aa0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26980cf340 0x7f26981661b0 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26980cef60 0x7f2698152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 --2- 172.21.15.17:0/435793001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26980b4390 0x7f26981f8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 >> 172.21.15.17:0/435793001 conn(0x7f26980b3870 msgr2=0x7f269815c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 shutdown_connections 2024-09-10T23:29:25.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.784+0000 7f269ee00640 1 -- 172.21.15.17:0/435793001 wait complete. 2024-09-10T23:29:25.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:29:25.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 -- 172.21.15.17:0/850551438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c15f350 msgr2=0x7f2c3c0b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 --2- 172.21.15.17:0/850551438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c15f350 0x7f2c3c0b3130 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c009900 tx=0x7f2c2c01c670 comp rx=0 tx=0).stop 2024-09-10T23:29:25.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 -- 172.21.15.17:0/850551438 shutdown_connections 2024-09-10T23:29:25.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 --2- 172.21.15.17:0/850551438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c3c15f730 0x7f2c3c0ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 --2- 172.21.15.17:0/850551438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c15f350 0x7f2c3c0b3130 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 -- 172.21.15.17:0/850551438 >> 172.21.15.17:0/850551438 conn(0x7f2c3c0d1d10 msgr2=0x7f2c3c0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:25.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 -- 172.21.15.17:0/850551438 shutdown_connections 2024-09-10T23:29:25.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 -- 172.21.15.17:0/850551438 wait complete. 2024-09-10T23:29:25.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 Processor -- start 2024-09-10T23:29:25.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 -- start start 2024-09-10T23:29:25.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c0cec60 0x7f2c3c1fb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:25.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c3c15f350 0x7f2c3c071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:25.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c3c15f730 0x7f2c3c156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c168fe0 con 0x7f2c3c0cec60 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3c168e60 con 0x7f2c3c15f730 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.952+0000 7f2c41c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3c169160 con 0x7f2c3c15f350 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c0cec60 0x7f2c3c1fb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c0cec60 0x7f2c3c1fb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56554/0 (socket says 172.21.15.17:56554) 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3aa00640 1 -- 172.21.15.17:0/1235688340 learned_addr learned my addr 172.21.15.17:0/1235688340 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c33e00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c3c15f350 0x7f2c3c071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3b400640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c3c15f730 0x7f2c3c156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3aa00640 1 -- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c3c15f350 msgr2=0x7f2c3c071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3aa00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c3c15f350 0x7f2c3c071c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3aa00640 1 -- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c3c15f730 msgr2=0x7f2c3c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3aa00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c3c15f730 0x7f2c3c156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3aa00640 1 -- 172.21.15.17:0/1235688340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3c1fba90 con 0x7f2c3c0cec60 2024-09-10T23:29:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3b400640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c3c15f730 0x7f2c3c156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c3aa00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c0cec60 0x7f2c3c1fb320 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c01cf10 tx=0x7f2c2c0a8570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c32a00640 1 -- 172.21.15.17:0/1235688340 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0a8960 con 0x7f2c3c0cec60 2024-09-10T23:29:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c32a00640 1 -- 172.21.15.17:0/1235688340 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c2c0a8b00 con 0x7f2c3c0cec60 2024-09-10T23:29:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3c1fbd70 con 0x7f2c3c0cec60 2024-09-10T23:29:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c32a00640 1 -- 172.21.15.17:0/1235688340 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c005020 con 0x7f2c3c0cec60 2024-09-10T23:29:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3c072150 con 0x7f2c3c0cec60 2024-09-10T23:29:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c3c0b3130 con 0x7f2c3c0cec60 2024-09-10T23:29:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.956+0000 7f2c32a00640 1 -- 172.21.15.17:0/1235688340 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2c2c0a7070 con 0x7f2c3c0cec60 2024-09-10T23:29:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.960+0000 7f2c32a00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c180725e0 0x7f2c18074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.960+0000 7f2c32a00640 1 -- 172.21.15.17:0/1235688340 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f2c2c12d610 con 0x7f2c3c0cec60 2024-09-10T23:29:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.960+0000 7f2c33e00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c180725e0 0x7f2c18074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:25.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.960+0000 7f2c33e00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c180725e0 0x7f2c18074aa0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0b7890 tx=0x7f2c2400a250 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:25.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:25.964+0000 7f2c32a00640 1 -- 172.21.15.17:0/1235688340 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2c2c0ac030 con 0x7f2c3c0cec60 2024-09-10T23:29:26.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.136+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c3c0b05d0 con 0x7f2c3c0cec60 2024-09-10T23:29:26.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c32a00640 1 -- 172.21.15.17:0/1235688340 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) ==== 74+0+16952 (secure 0 0 0) 0x7f2c3c0b2440 con 0x7f2c3c0cec60 2024-09-10T23:29:26.140 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:26.140 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":189,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:29:23.353839+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:29:19.490385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-10T23:29:20.728719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:29:26.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c180725e0 msgr2=0x7f2c18074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c180725e0 0x7f2c18074aa0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0b7890 tx=0x7f2c2400a250 comp rx=0 tx=0).stop 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c0cec60 msgr2=0x7f2c3c1fb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c0cec60 0x7f2c3c1fb320 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c01cf10 tx=0x7f2c2c0a8570 comp rx=0 tx=0).stop 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 shutdown_connections 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2c180725e0 0x7f2c18074aa0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c3c15f730 0x7f2c3c156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2c3c15f350 0x7f2c3c071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 --2- 172.21.15.17:0/1235688340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c3c0cec60 0x7f2c3c1fb320 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 >> 172.21.15.17:0/1235688340 conn(0x7f2c3c0d1d10 msgr2=0x7f2c3c0d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 shutdown_connections 2024-09-10T23:29:26.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.140+0000 7f2c41c00640 1 -- 172.21.15.17:0/1235688340 wait complete. 2024-09-10T23:29:26.163 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:29:26.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:29:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.308+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3382549945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd09c0d20c0 msgr2=0x7fd09c072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.308+0000 7fd0a1c00640 1 --2- 172.21.15.17:0/3382549945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd09c0d20c0 0x7fd09c072320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd088009840 tx=0x7fd08801c700 comp rx=0 tx=0).stop 2024-09-10T23:29:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.308+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3382549945 shutdown_connections 2024-09-10T23:29:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.308+0000 7fd0a1c00640 1 --2- 172.21.15.17:0/3382549945 >> v2:172.21.15.77:3300/0 conn(0x7fd09c15bc70 0x7fd09c0d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.308+0000 7fd0a1c00640 1 --2- 172.21.15.17:0/3382549945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd09c0d20c0 0x7fd09c072320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.308+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3382549945 >> 172.21.15.17:0/3382549945 conn(0x7fd09c09a9f0 msgr2=0x7fd09c09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.308+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3382549945 shutdown_connections 2024-09-10T23:29:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.308+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3382549945 wait complete. 2024-09-10T23:29:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 Processor -- start 2024-09-10T23:29:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 -- start start 2024-09-10T23:29:26.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c0d20c0 0x7fd09c154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:26.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd09c15b890 0x7fd09c14c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:26.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c15bc70 0x7fd09c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:26.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c071f60 con 0x7fd09c0d20c0 2024-09-10T23:29:26.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c071de0 con 0x7fd09c15bc70 2024-09-10T23:29:26.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd09c1686f0 con 0x7fd09c15b890 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c0d20c0 0x7fd09c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c0d20c0 0x7fd09c154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56566/0 (socket says 172.21.15.17:56566) 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09be00640 1 -- 172.21.15.17:0/3266980357 learned_addr learned my addr 172.21.15.17:0/3266980357 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09b400640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd09c15b890 0x7fd09c14c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1200640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c15bc70 0x7fd09c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09be00640 1 -- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd09c15b890 msgr2=0x7fd09c14c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09be00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd09c15b890 0x7fd09c14c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09be00640 1 -- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c15bc70 msgr2=0x7fd09c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09be00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c15bc70 0x7fd09c1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09be00640 1 -- 172.21.15.17:0/3266980357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c14c720 con 0x7fd09c0d20c0 2024-09-10T23:29:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd09be00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c0d20c0 0x7fd09c154270 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00c490 tx=0x7fd08c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:26.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd093e00640 1 -- 172.21.15.17:0/3266980357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c016020 con 0x7fd09c0d20c0 2024-09-10T23:29:26.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd093e00640 1 -- 172.21.15.17:0/3266980357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd08c012940 con 0x7fd09c0d20c0 2024-09-10T23:29:26.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd093e00640 1 -- 172.21.15.17:0/3266980357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c012d90 con 0x7fd09c0d20c0 2024-09-10T23:29:26.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c1553f0 con 0x7fd09c0d20c0 2024-09-10T23:29:26.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c153790 con 0x7fd09c0d20c0 2024-09-10T23:29:26.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.312+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09c1547b0 con 0x7fd09c0d20c0 2024-09-10T23:29:26.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.316+0000 7fd093e00640 1 -- 172.21.15.17:0/3266980357 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd08c01b400 con 0x7fd09c0d20c0 2024-09-10T23:29:26.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.316+0000 7fd093e00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd07c0725e0 0x7fd07c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:26.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.316+0000 7fd093e00640 1 -- 172.21.15.17:0/3266980357 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fd08c093340 con 0x7fd09c0d20c0 2024-09-10T23:29:26.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.316+0000 7fd09b400640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd07c0725e0 0x7fd07c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:26.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.316+0000 7fd09b400640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd07c0725e0 0x7fd07c074aa0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd0880af000 tx=0x7fd08801af40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:26.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.320+0000 7fd093e00640 1 -- 172.21.15.17:0/3266980357 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd08c020030 con 0x7fd09c0d20c0 2024-09-10T23:29:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.492+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd09c072320 con 0x7fd07c0725e0 2024-09-10T23:29:26.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.500+0000 7fd093e00640 1 -- 172.21.15.17:0/3266980357 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252482 (secure 0 0 0) 0x7fd0880fda60 con 0x7fd07c0725e0 2024-09-10T23:29:26.503 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:26.504 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:29:26.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd07c0725e0 msgr2=0x7fd07c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd07c0725e0 0x7fd07c074aa0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd0880af000 tx=0x7fd08801af40 comp rx=0 tx=0).stop 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c0d20c0 msgr2=0x7fd09c154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c0d20c0 0x7fd09c154270 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00c490 tx=0x7fd08c00c950 comp rx=0 tx=0).stop 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 shutdown_connections 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd07c0725e0 0x7fd07c074aa0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c15bc70 0x7fd09c1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd09c15b890 0x7fd09c14c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 --2- 172.21.15.17:0/3266980357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd09c0d20c0 0x7fd09c154270 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 >> 172.21.15.17:0/3266980357 conn(0x7fd09c09a9f0 msgr2=0x7fd09c15a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 shutdown_connections 2024-09-10T23:29:26.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.504+0000 7fd0a1c00640 1 -- 172.21.15.17:0/3266980357 wait complete. 2024-09-10T23:29:26.523 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":604,"stamp":"2024-09-10T23:29:26.493112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":534276,"kb_used_data":19772,"kb_used_omap":12,"kb_used_meta":514291,"kb_avail":754440444,"statfs":{"total":773094113280,"available":772547014656,"internally_reserved":0,"allocated":20246528,"data_stored":10126040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":526634545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001370"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.369135+0000","last_change":"2024-09-10T23:29:22.394950+0000","last_active":"2024-09-10T23:29:23.369135+0000","last_peered":"2024-09-10T23:29:23.369135+0000","last_clean":"2024-09-10T23:29:23.369135+0000","last_became_active":"2024-09-10T23:29:22.393246+0000","last_became_peered":"2024-09-10T23:29:22.393246+0000","last_unstale":"2024-09-10T23:29:23.369135+0000","last_undegraded":"2024-09-10T23:29:23.369135+0000","last_fullsized":"2024-09-10T23:29:23.369135+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:20.173626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.391217+0000","last_change":"2024-09-10T23:29:22.389815+0000","last_active":"2024-09-10T23:29:22.391217+0000","last_peered":"2024-09-10T23:29:22.391217+0000","last_clean":"2024-09-10T23:29:22.391217+0000","last_became_active":"2024-09-10T23:29:22.387698+0000","last_became_peered":"2024-09-10T23:29:22.387698+0000","last_unstale":"2024-09-10T23:29:22.391217+0000","last_undegraded":"2024-09-10T23:29:22.391217+0000","last_fullsized":"2024-09-10T23:29:22.391217+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:51.938193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362654+0000","last_change":"2024-09-10T23:29:22.378322+0000","last_active":"2024-09-10T23:29:23.362654+0000","last_peered":"2024-09-10T23:29:23.362654+0000","last_clean":"2024-09-10T23:29:23.362654+0000","last_became_active":"2024-09-10T23:29:22.378046+0000","last_became_peered":"2024-09-10T23:29:22.378046+0000","last_unstale":"2024-09-10T23:29:23.362654+0000","last_undegraded":"2024-09-10T23:29:23.362654+0000","last_fullsized":"2024-09-10T23:29:23.362654+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:28.091420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888751+0000","last_change":"2024-09-10T23:29:22.394816+0000","last_active":"2024-09-10T23:29:23.888751+0000","last_peered":"2024-09-10T23:29:23.888751+0000","last_clean":"2024-09-10T23:29:23.888751+0000","last_became_active":"2024-09-10T23:29:22.394273+0000","last_became_peered":"2024-09-10T23:29:22.394273+0000","last_unstale":"2024-09-10T23:29:23.888751+0000","last_undegraded":"2024-09-10T23:29:23.888751+0000","last_fullsized":"2024-09-10T23:29:23.888751+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:16.586664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882492+0000","last_change":"2024-09-10T23:29:22.374620+0000","last_active":"2024-09-10T23:29:23.882492+0000","last_peered":"2024-09-10T23:29:23.882492+0000","last_clean":"2024-09-10T23:29:23.882492+0000","last_became_active":"2024-09-10T23:29:22.371057+0000","last_became_peered":"2024-09-10T23:29:22.371057+0000","last_unstale":"2024-09-10T23:29:23.882492+0000","last_undegraded":"2024-09-10T23:29:23.882492+0000","last_fullsized":"2024-09-10T23:29:23.882492+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:31.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888435+0000","last_change":"2024-09-10T23:29:22.393154+0000","last_active":"2024-09-10T23:29:23.888435+0000","last_peered":"2024-09-10T23:29:23.888435+0000","last_clean":"2024-09-10T23:29:23.888435+0000","last_became_active":"2024-09-10T23:29:22.391791+0000","last_became_peered":"2024-09-10T23:29:22.391791+0000","last_unstale":"2024-09-10T23:29:23.888435+0000","last_undegraded":"2024-09-10T23:29:23.888435+0000","last_fullsized":"2024-09-10T23:29:23.888435+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:10.854676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882234+0000","last_change":"2024-09-10T23:29:22.367867+0000","last_active":"2024-09-10T23:29:23.882234+0000","last_peered":"2024-09-10T23:29:23.882234+0000","last_clean":"2024-09-10T23:29:23.882234+0000","last_became_active":"2024-09-10T23:29:22.367585+0000","last_became_peered":"2024-09-10T23:29:22.367585+0000","last_unstale":"2024-09-10T23:29:23.882234+0000","last_undegraded":"2024-09-10T23:29:23.882234+0000","last_fullsized":"2024-09-10T23:29:23.882234+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:51.775369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396507+0000","last_change":"2024-09-10T23:29:22.387555+0000","last_active":"2024-09-10T23:29:23.396507+0000","last_peered":"2024-09-10T23:29:23.396507+0000","last_clean":"2024-09-10T23:29:23.396507+0000","last_became_active":"2024-09-10T23:29:22.387256+0000","last_became_peered":"2024-09-10T23:29:22.387256+0000","last_unstale":"2024-09-10T23:29:23.396507+0000","last_undegraded":"2024-09-10T23:29:23.396507+0000","last_fullsized":"2024-09-10T23:29:23.396507+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:10.871824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884092+0000","last_change":"2024-09-10T23:29:22.381887+0000","last_active":"2024-09-10T23:29:23.884092+0000","last_peered":"2024-09-10T23:29:23.884092+0000","last_clean":"2024-09-10T23:29:23.884092+0000","last_became_active":"2024-09-10T23:29:22.381243+0000","last_became_peered":"2024-09-10T23:29:22.381243+0000","last_unstale":"2024-09-10T23:29:23.884092+0000","last_undegraded":"2024-09-10T23:29:23.884092+0000","last_fullsized":"2024-09-10T23:29:23.884092+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:03.925298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396949+0000","last_change":"2024-09-10T23:29:22.381449+0000","last_active":"2024-09-10T23:29:23.396949+0000","last_peered":"2024-09-10T23:29:23.396949+0000","last_clean":"2024-09-10T23:29:23.396949+0000","last_became_active":"2024-09-10T23:29:22.380234+0000","last_became_peered":"2024-09-10T23:29:22.380234+0000","last_unstale":"2024-09-10T23:29:23.396949+0000","last_undegraded":"2024-09-10T23:29:23.396949+0000","last_fullsized":"2024-09-10T23:29:23.396949+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:40.672808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362777+0000","last_change":"2024-09-10T23:29:22.386018+0000","last_active":"2024-09-10T23:29:23.362777+0000","last_peered":"2024-09-10T23:29:23.362777+0000","last_clean":"2024-09-10T23:29:23.362777+0000","last_became_active":"2024-09-10T23:29:22.385432+0000","last_became_peered":"2024-09-10T23:29:22.385432+0000","last_unstale":"2024-09-10T23:29:23.362777+0000","last_undegraded":"2024-09-10T23:29:23.362777+0000","last_fullsized":"2024-09-10T23:29:23.362777+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:16.400456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882440+0000","last_change":"2024-09-10T23:29:22.381390+0000","last_active":"2024-09-10T23:29:23.882440+0000","last_peered":"2024-09-10T23:29:23.882440+0000","last_clean":"2024-09-10T23:29:23.882440+0000","last_became_active":"2024-09-10T23:29:22.380896+0000","last_became_peered":"2024-09-10T23:29:22.380896+0000","last_unstale":"2024-09-10T23:29:23.882440+0000","last_undegraded":"2024-09-10T23:29:23.882440+0000","last_fullsized":"2024-09-10T23:29:23.882440+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:29.715145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888606+0000","last_change":"2024-09-10T23:29:22.391702+0000","last_active":"2024-09-10T23:29:23.888606+0000","last_peered":"2024-09-10T23:29:23.888606+0000","last_clean":"2024-09-10T23:29:23.888606+0000","last_became_active":"2024-09-10T23:29:22.391041+0000","last_became_peered":"2024-09-10T23:29:22.391041+0000","last_unstale":"2024-09-10T23:29:23.888606+0000","last_undegraded":"2024-09-10T23:29:23.888606+0000","last_fullsized":"2024-09-10T23:29:23.888606+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:35.766733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396718+0000","last_change":"2024-09-10T23:29:22.388569+0000","last_active":"2024-09-10T23:29:23.396718+0000","last_peered":"2024-09-10T23:29:23.396718+0000","last_clean":"2024-09-10T23:29:23.396718+0000","last_became_active":"2024-09-10T23:29:22.387986+0000","last_became_peered":"2024-09-10T23:29:22.387986+0000","last_unstale":"2024-09-10T23:29:23.396718+0000","last_undegraded":"2024-09-10T23:29:23.396718+0000","last_fullsized":"2024-09-10T23:29:23.396718+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:39.172072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680134+0000","last_change":"2024-09-10T23:29:22.390033+0000","last_active":"2024-09-10T23:29:23.680134+0000","last_peered":"2024-09-10T23:29:23.680134+0000","last_clean":"2024-09-10T23:29:23.680134+0000","last_became_active":"2024-09-10T23:29:22.389730+0000","last_became_peered":"2024-09-10T23:29:22.389730+0000","last_unstale":"2024-09-10T23:29:23.680134+0000","last_undegraded":"2024-09-10T23:29:23.680134+0000","last_fullsized":"2024-09-10T23:29:23.680134+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:40.839191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362102+0000","last_change":"2024-09-10T23:29:22.374759+0000","last_active":"2024-09-10T23:29:23.362102+0000","last_peered":"2024-09-10T23:29:23.362102+0000","last_clean":"2024-09-10T23:29:23.362102+0000","last_became_active":"2024-09-10T23:29:22.373897+0000","last_became_peered":"2024-09-10T23:29:22.373897+0000","last_unstale":"2024-09-10T23:29:23.362102+0000","last_undegraded":"2024-09-10T23:29:23.362102+0000","last_fullsized":"2024-09-10T23:29:23.362102+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:31.926308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884207+0000","last_change":"2024-09-10T23:29:22.381531+0000","last_active":"2024-09-10T23:29:23.884207+0000","last_peered":"2024-09-10T23:29:23.884207+0000","last_clean":"2024-09-10T23:29:23.884207+0000","last_became_active":"2024-09-10T23:29:22.380888+0000","last_became_peered":"2024-09-10T23:29:22.380888+0000","last_unstale":"2024-09-10T23:29:23.884207+0000","last_undegraded":"2024-09-10T23:29:23.884207+0000","last_fullsized":"2024-09-10T23:29:23.884207+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:43.569149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883831+0000","last_change":"2024-09-10T23:29:22.368741+0000","last_active":"2024-09-10T23:29:23.883831+0000","last_peered":"2024-09-10T23:29:23.883831+0000","last_clean":"2024-09-10T23:29:23.883831+0000","last_became_active":"2024-09-10T23:29:22.368360+0000","last_became_peered":"2024-09-10T23:29:22.368360+0000","last_unstale":"2024-09-10T23:29:23.883831+0000","last_undegraded":"2024-09-10T23:29:23.883831+0000","last_fullsized":"2024-09-10T23:29:23.883831+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:59.389814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.397023+0000","last_change":"2024-09-10T23:29:22.396966+0000","last_active":"2024-09-10T23:29:23.397023+0000","last_peered":"2024-09-10T23:29:23.397023+0000","last_clean":"2024-09-10T23:29:23.397023+0000","last_became_active":"2024-09-10T23:29:22.395846+0000","last_became_peered":"2024-09-10T23:29:22.395846+0000","last_unstale":"2024-09-10T23:29:23.397023+0000","last_undegraded":"2024-09-10T23:29:23.397023+0000","last_fullsized":"2024-09-10T23:29:23.397023+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:12.093480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396703+0000","last_change":"2024-09-10T23:29:22.387575+0000","last_active":"2024-09-10T23:29:23.396703+0000","last_peered":"2024-09-10T23:29:23.396703+0000","last_clean":"2024-09-10T23:29:23.396703+0000","last_became_active":"2024-09-10T23:29:22.387272+0000","last_became_peered":"2024-09-10T23:29:22.387272+0000","last_unstale":"2024-09-10T23:29:23.396703+0000","last_undegraded":"2024-09-10T23:29:23.396703+0000","last_fullsized":"2024-09-10T23:29:23.396703+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:01.891555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396693+0000","last_change":"2024-09-10T23:29:22.386216+0000","last_active":"2024-09-10T23:29:23.396693+0000","last_peered":"2024-09-10T23:29:23.396693+0000","last_clean":"2024-09-10T23:29:23.396693+0000","last_became_active":"2024-09-10T23:29:22.385930+0000","last_became_peered":"2024-09-10T23:29:22.385930+0000","last_unstale":"2024-09-10T23:29:23.396693+0000","last_undegraded":"2024-09-10T23:29:23.396693+0000","last_fullsized":"2024-09-10T23:29:23.396693+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:04.156357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396603+0000","last_change":"2024-09-10T23:29:22.388283+0000","last_active":"2024-09-10T23:29:23.396603+0000","last_peered":"2024-09-10T23:29:23.396603+0000","last_clean":"2024-09-10T23:29:23.396603+0000","last_became_active":"2024-09-10T23:29:22.387681+0000","last_became_peered":"2024-09-10T23:29:22.387681+0000","last_unstale":"2024-09-10T23:29:23.396603+0000","last_undegraded":"2024-09-10T23:29:23.396603+0000","last_fullsized":"2024-09-10T23:29:23.396603+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:55.393063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.390886+0000","last_change":"2024-09-10T23:29:22.383498+0000","last_active":"2024-09-10T23:29:22.390886+0000","last_peered":"2024-09-10T23:29:22.390886+0000","last_clean":"2024-09-10T23:29:22.390886+0000","last_became_active":"2024-09-10T23:29:22.382562+0000","last_became_peered":"2024-09-10T23:29:22.382562+0000","last_unstale":"2024-09-10T23:29:22.390886+0000","last_undegraded":"2024-09-10T23:29:22.390886+0000","last_fullsized":"2024-09-10T23:29:22.390886+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:37.462082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882193+0000","last_change":"2024-09-10T23:29:22.377749+0000","last_active":"2024-09-10T23:29:23.882193+0000","last_peered":"2024-09-10T23:29:23.882193+0000","last_clean":"2024-09-10T23:29:23.882193+0000","last_became_active":"2024-09-10T23:29:22.377471+0000","last_became_peered":"2024-09-10T23:29:22.377471+0000","last_unstale":"2024-09-10T23:29:23.882193+0000","last_undegraded":"2024-09-10T23:29:23.882193+0000","last_fullsized":"2024-09-10T23:29:23.882193+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:07.849058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884310+0000","last_change":"2024-09-10T23:29:22.369240+0000","last_active":"2024-09-10T23:29:23.884310+0000","last_peered":"2024-09-10T23:29:23.884310+0000","last_clean":"2024-09-10T23:29:23.884310+0000","last_became_active":"2024-09-10T23:29:22.368980+0000","last_became_peered":"2024-09-10T23:29:22.368980+0000","last_unstale":"2024-09-10T23:29:23.884310+0000","last_undegraded":"2024-09-10T23:29:23.884310+0000","last_fullsized":"2024-09-10T23:29:23.884310+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:40.889928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.369025+0000","last_change":"2024-09-10T23:29:22.392854+0000","last_active":"2024-09-10T23:29:23.369025+0000","last_peered":"2024-09-10T23:29:23.369025+0000","last_clean":"2024-09-10T23:29:23.369025+0000","last_became_active":"2024-09-10T23:29:22.392561+0000","last_became_peered":"2024-09-10T23:29:22.392561+0000","last_unstale":"2024-09-10T23:29:23.369025+0000","last_undegraded":"2024-09-10T23:29:23.369025+0000","last_fullsized":"2024-09-10T23:29:23.369025+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:31.926308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362909+0000","last_change":"2024-09-10T23:29:22.385720+0000","last_active":"2024-09-10T23:29:23.362909+0000","last_peered":"2024-09-10T23:29:23.362909+0000","last_clean":"2024-09-10T23:29:23.362909+0000","last_became_active":"2024-09-10T23:29:22.385022+0000","last_became_peered":"2024-09-10T23:29:22.385022+0000","last_unstale":"2024-09-10T23:29:23.362909+0000","last_undegraded":"2024-09-10T23:29:23.362909+0000","last_fullsized":"2024-09-10T23:29:23.362909+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:29.334544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882512+0000","last_change":"2024-09-10T23:29:22.383859+0000","last_active":"2024-09-10T23:29:23.882512+0000","last_peered":"2024-09-10T23:29:23.882512+0000","last_clean":"2024-09-10T23:29:23.882512+0000","last_became_active":"2024-09-10T23:29:22.383570+0000","last_became_peered":"2024-09-10T23:29:22.383570+0000","last_unstale":"2024-09-10T23:29:23.882512+0000","last_undegraded":"2024-09-10T23:29:23.882512+0000","last_fullsized":"2024-09-10T23:29:23.882512+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:25.390903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883550+0000","last_change":"2024-09-10T23:29:22.364688+0000","last_active":"2024-09-10T23:29:23.883550+0000","last_peered":"2024-09-10T23:29:23.883550+0000","last_clean":"2024-09-10T23:29:23.883550+0000","last_became_active":"2024-09-10T23:29:22.364380+0000","last_became_peered":"2024-09-10T23:29:22.364380+0000","last_unstale":"2024-09-10T23:29:23.883550+0000","last_undegraded":"2024-09-10T23:29:23.883550+0000","last_fullsized":"2024-09-10T23:29:23.883550+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:46.370456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680080+0000","last_change":"2024-09-10T23:29:22.368985+0000","last_active":"2024-09-10T23:29:23.680080+0000","last_peered":"2024-09-10T23:29:23.680080+0000","last_clean":"2024-09-10T23:29:23.680080+0000","last_became_active":"2024-09-10T23:29:22.368696+0000","last_became_peered":"2024-09-10T23:29:22.368696+0000","last_unstale":"2024-09-10T23:29:23.680080+0000","last_undegraded":"2024-09-10T23:29:23.680080+0000","last_fullsized":"2024-09-10T23:29:23.680080+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:00.015325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888487+0000","last_change":"2024-09-10T23:29:22.389296+0000","last_active":"2024-09-10T23:29:23.888487+0000","last_peered":"2024-09-10T23:29:23.888487+0000","last_clean":"2024-09-10T23:29:23.888487+0000","last_became_active":"2024-09-10T23:29:22.389008+0000","last_became_peered":"2024-09-10T23:29:22.389008+0000","last_unstale":"2024-09-10T23:29:23.888487+0000","last_undegraded":"2024-09-10T23:29:23.888487+0000","last_fullsized":"2024-09-10T23:29:23.888487+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:29.110812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888375+0000","last_change":"2024-09-10T23:29:22.385318+0000","last_active":"2024-09-10T23:29:23.888375+0000","last_peered":"2024-09-10T23:29:23.888375+0000","last_clean":"2024-09-10T23:29:23.888375+0000","last_became_active":"2024-09-10T23:29:22.385044+0000","last_became_peered":"2024-09-10T23:29:22.385044+0000","last_unstale":"2024-09-10T23:29:23.888375+0000","last_undegraded":"2024-09-10T23:29:23.888375+0000","last_fullsized":"2024-09-10T23:29:23.888375+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:22.653885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.390338+0000","last_change":"2024-09-10T23:29:22.382463+0000","last_active":"2024-09-10T23:29:22.390338+0000","last_peered":"2024-09-10T23:29:22.390338+0000","last_clean":"2024-09-10T23:29:22.390338+0000","last_became_active":"2024-09-10T23:29:22.382170+0000","last_became_peered":"2024-09-10T23:29:22.382170+0000","last_unstale":"2024-09-10T23:29:22.390338+0000","last_undegraded":"2024-09-10T23:29:22.390338+0000","last_fullsized":"2024-09-10T23:29:22.390338+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:04.293482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"188'4","reported_seq":19,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680292+0000","last_change":"2024-09-10T23:29:21.381336+0000","last_active":"2024-09-10T23:29:23.680292+0000","last_peered":"2024-09-10T23:29:23.680292+0000","last_clean":"2024-09-10T23:29:23.680292+0000","last_became_active":"2024-09-10T23:29:21.378807+0000","last_became_peered":"2024-09-10T23:29:21.378807+0000","last_unstale":"2024-09-10T23:29:23.680292+0000","last_undegraded":"2024-09-10T23:29:23.680292+0000","last_fullsized":"2024-09-10T23:29:23.680292+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:48.769087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368730+0000","last_change":"2024-09-10T23:29:22.382886+0000","last_active":"2024-09-10T23:29:23.368730+0000","last_peered":"2024-09-10T23:29:23.368730+0000","last_clean":"2024-09-10T23:29:23.368730+0000","last_became_active":"2024-09-10T23:29:22.382616+0000","last_became_peered":"2024-09-10T23:29:22.382616+0000","last_unstale":"2024-09-10T23:29:23.368730+0000","last_undegraded":"2024-09-10T23:29:23.368730+0000","last_fullsized":"2024-09-10T23:29:23.368730+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:36.537459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"188'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368931+0000","last_change":"2024-09-10T23:29:21.377774+0000","last_active":"2024-09-10T23:29:23.368931+0000","last_peered":"2024-09-10T23:29:23.368931+0000","last_clean":"2024-09-10T23:29:23.368931+0000","last_became_active":"2024-09-10T23:29:21.377303+0000","last_became_peered":"2024-09-10T23:29:21.377303+0000","last_unstale":"2024-09-10T23:29:23.368931+0000","last_undegraded":"2024-09-10T23:29:23.368931+0000","last_fullsized":"2024-09-10T23:29:23.368931+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:48.155816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396950+0000","last_change":"2024-09-10T23:29:22.395199+0000","last_active":"2024-09-10T23:29:23.396950+0000","last_peered":"2024-09-10T23:29:23.396950+0000","last_clean":"2024-09-10T23:29:23.396950+0000","last_became_active":"2024-09-10T23:29:22.394947+0000","last_became_peered":"2024-09-10T23:29:22.394947+0000","last_unstale":"2024-09-10T23:29:23.396950+0000","last_undegraded":"2024-09-10T23:29:23.396950+0000","last_fullsized":"2024-09-10T23:29:23.396950+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:33.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"188'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.400120+0000","last_change":"2024-09-10T23:29:21.374949+0000","last_active":"2024-09-10T23:29:22.400120+0000","last_peered":"2024-09-10T23:29:22.400120+0000","last_clean":"2024-09-10T23:29:22.400120+0000","last_became_active":"2024-09-10T23:29:21.374601+0000","last_became_peered":"2024-09-10T23:29:21.374601+0000","last_unstale":"2024-09-10T23:29:22.400120+0000","last_undegraded":"2024-09-10T23:29:22.400120+0000","last_fullsized":"2024-09-10T23:29:22.400120+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:34.340181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882705+0000","last_change":"2024-09-10T23:29:22.375598+0000","last_active":"2024-09-10T23:29:23.882705+0000","last_peered":"2024-09-10T23:29:23.882705+0000","last_clean":"2024-09-10T23:29:23.882705+0000","last_became_active":"2024-09-10T23:29:22.374252+0000","last_became_peered":"2024-09-10T23:29:22.374252+0000","last_unstale":"2024-09-10T23:29:23.882705+0000","last_undegraded":"2024-09-10T23:29:23.882705+0000","last_fullsized":"2024-09-10T23:29:23.882705+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:27.377251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"188'2","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883622+0000","last_change":"2024-09-10T23:29:21.369295+0000","last_active":"2024-09-10T23:29:23.883622+0000","last_peered":"2024-09-10T23:29:23.883622+0000","last_clean":"2024-09-10T23:29:23.883622+0000","last_became_active":"2024-09-10T23:29:21.368457+0000","last_became_peered":"2024-09-10T23:29:21.368457+0000","last_unstale":"2024-09-10T23:29:23.883622+0000","last_undegraded":"2024-09-10T23:29:23.883622+0000","last_fullsized":"2024-09-10T23:29:23.883622+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:15.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680280+0000","last_change":"2024-09-10T23:29:22.369914+0000","last_active":"2024-09-10T23:29:23.680280+0000","last_peered":"2024-09-10T23:29:23.680280+0000","last_clean":"2024-09-10T23:29:23.680280+0000","last_became_active":"2024-09-10T23:29:22.369597+0000","last_became_peered":"2024-09-10T23:29:22.369597+0000","last_unstale":"2024-09-10T23:29:23.680280+0000","last_undegraded":"2024-09-10T23:29:23.680280+0000","last_fullsized":"2024-09-10T23:29:23.680280+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:40.571460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"188'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888441+0000","last_change":"2024-09-10T23:29:21.382226+0000","last_active":"2024-09-10T23:29:23.888441+0000","last_peered":"2024-09-10T23:29:23.888441+0000","last_clean":"2024-09-10T23:29:23.888441+0000","last_became_active":"2024-09-10T23:29:21.381955+0000","last_became_peered":"2024-09-10T23:29:21.381955+0000","last_unstale":"2024-09-10T23:29:23.888441+0000","last_undegraded":"2024-09-10T23:29:23.888441+0000","last_fullsized":"2024-09-10T23:29:23.888441+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:04.747869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680404+0000","last_change":"2024-09-10T23:29:22.379994+0000","last_active":"2024-09-10T23:29:23.680404+0000","last_peered":"2024-09-10T23:29:23.680404+0000","last_clean":"2024-09-10T23:29:23.680404+0000","last_became_active":"2024-09-10T23:29:22.379708+0000","last_became_peered":"2024-09-10T23:29:22.379708+0000","last_unstale":"2024-09-10T23:29:23.680404+0000","last_undegraded":"2024-09-10T23:29:23.680404+0000","last_fullsized":"2024-09-10T23:29:23.680404+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:57.266908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888189+0000","last_change":"2024-09-10T23:29:21.380970+0000","last_active":"2024-09-10T23:29:23.888189+0000","last_peered":"2024-09-10T23:29:23.888189+0000","last_clean":"2024-09-10T23:29:23.888189+0000","last_became_active":"2024-09-10T23:29:21.380660+0000","last_became_peered":"2024-09-10T23:29:21.380660+0000","last_unstale":"2024-09-10T23:29:23.888189+0000","last_undegraded":"2024-09-10T23:29:23.888189+0000","last_fullsized":"2024-09-10T23:29:23.888189+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:59.229074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884418+0000","last_change":"2024-09-10T23:29:22.371692+0000","last_active":"2024-09-10T23:29:23.884418+0000","last_peered":"2024-09-10T23:29:23.884418+0000","last_clean":"2024-09-10T23:29:23.884418+0000","last_became_active":"2024-09-10T23:29:22.371409+0000","last_became_peered":"2024-09-10T23:29:22.371409+0000","last_unstale":"2024-09-10T23:29:23.884418+0000","last_undegraded":"2024-09-10T23:29:23.884418+0000","last_fullsized":"2024-09-10T23:29:23.884418+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:08.626024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.361951+0000","last_change":"2024-09-10T23:29:21.375897+0000","last_active":"2024-09-10T23:29:23.361951+0000","last_peered":"2024-09-10T23:29:23.361951+0000","last_clean":"2024-09-10T23:29:23.361951+0000","last_became_active":"2024-09-10T23:29:21.375612+0000","last_became_peered":"2024-09-10T23:29:21.375612+0000","last_unstale":"2024-09-10T23:29:23.361951+0000","last_undegraded":"2024-09-10T23:29:23.361951+0000","last_fullsized":"2024-09-10T23:29:23.361951+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:42.759130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680068+0000","last_change":"2024-09-10T23:29:22.371104+0000","last_active":"2024-09-10T23:29:23.680068+0000","last_peered":"2024-09-10T23:29:23.680068+0000","last_clean":"2024-09-10T23:29:23.680068+0000","last_became_active":"2024-09-10T23:29:22.370814+0000","last_became_peered":"2024-09-10T23:29:22.370814+0000","last_unstale":"2024-09-10T23:29:23.680068+0000","last_undegraded":"2024-09-10T23:29:23.680068+0000","last_fullsized":"2024-09-10T23:29:23.680068+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:07.659079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883077+0000","last_change":"2024-09-10T23:29:21.374463+0000","last_active":"2024-09-10T23:29:23.883077+0000","last_peered":"2024-09-10T23:29:23.883077+0000","last_clean":"2024-09-10T23:29:23.883077+0000","last_became_active":"2024-09-10T23:29:21.373116+0000","last_became_peered":"2024-09-10T23:29:21.373116+0000","last_unstale":"2024-09-10T23:29:23.883077+0000","last_undegraded":"2024-09-10T23:29:23.883077+0000","last_fullsized":"2024-09-10T23:29:23.883077+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:16.090645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362126+0000","last_change":"2024-09-10T23:29:22.375476+0000","last_active":"2024-09-10T23:29:23.362126+0000","last_peered":"2024-09-10T23:29:23.362126+0000","last_clean":"2024-09-10T23:29:23.362126+0000","last_became_active":"2024-09-10T23:29:22.375185+0000","last_became_peered":"2024-09-10T23:29:22.375185+0000","last_unstale":"2024-09-10T23:29:23.362126+0000","last_undegraded":"2024-09-10T23:29:23.362126+0000","last_fullsized":"2024-09-10T23:29:23.362126+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:20.173626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888898+0000","last_change":"2024-09-10T23:29:21.385187+0000","last_active":"2024-09-10T23:29:23.888898+0000","last_peered":"2024-09-10T23:29:23.888898+0000","last_clean":"2024-09-10T23:29:23.888898+0000","last_became_active":"2024-09-10T23:29:21.384828+0000","last_became_peered":"2024-09-10T23:29:21.384828+0000","last_unstale":"2024-09-10T23:29:23.888898+0000","last_undegraded":"2024-09-10T23:29:23.888898+0000","last_fullsized":"2024-09-10T23:29:23.888898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:07.351673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883259+0000","last_change":"2024-09-10T23:29:22.380333+0000","last_active":"2024-09-10T23:29:23.883259+0000","last_peered":"2024-09-10T23:29:23.883259+0000","last_clean":"2024-09-10T23:29:23.883259+0000","last_became_active":"2024-09-10T23:29:22.380066+0000","last_became_peered":"2024-09-10T23:29:22.380066+0000","last_unstale":"2024-09-10T23:29:23.883259+0000","last_undegraded":"2024-09-10T23:29:23.883259+0000","last_fullsized":"2024-09-10T23:29:23.883259+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:52.556614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"188'3","reported_seq":18,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883808+0000","last_change":"2024-09-10T23:29:21.373565+0000","last_active":"2024-09-10T23:29:23.883808+0000","last_peered":"2024-09-10T23:29:23.883808+0000","last_clean":"2024-09-10T23:29:23.883808+0000","last_became_active":"2024-09-10T23:29:21.373097+0000","last_became_peered":"2024-09-10T23:29:21.373097+0000","last_unstale":"2024-09-10T23:29:23.883808+0000","last_undegraded":"2024-09-10T23:29:23.883808+0000","last_fullsized":"2024-09-10T23:29:23.883808+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:29.820317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883144+0000","last_change":"2024-09-10T23:29:22.383633+0000","last_active":"2024-09-10T23:29:23.883144+0000","last_peered":"2024-09-10T23:29:23.883144+0000","last_clean":"2024-09-10T23:29:23.883144+0000","last_became_active":"2024-09-10T23:29:22.383329+0000","last_became_peered":"2024-09-10T23:29:22.383329+0000","last_unstale":"2024-09-10T23:29:23.883144+0000","last_undegraded":"2024-09-10T23:29:23.883144+0000","last_fullsized":"2024-09-10T23:29:23.883144+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:36.274971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"188'6","reported_seq":21,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888630+0000","last_change":"2024-09-10T23:29:21.385405+0000","last_active":"2024-09-10T23:29:23.888630+0000","last_peered":"2024-09-10T23:29:23.888630+0000","last_clean":"2024-09-10T23:29:23.888630+0000","last_became_active":"2024-09-10T23:29:21.385043+0000","last_became_peered":"2024-09-10T23:29:21.385043+0000","last_unstale":"2024-09-10T23:29:23.888630+0000","last_undegraded":"2024-09-10T23:29:23.888630+0000","last_fullsized":"2024-09-10T23:29:23.888630+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:48.155816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.383587+0000","last_change":"2024-09-10T23:29:22.377864+0000","last_active":"2024-09-10T23:29:22.383587+0000","last_peered":"2024-09-10T23:29:22.383587+0000","last_clean":"2024-09-10T23:29:22.383587+0000","last_became_active":"2024-09-10T23:29:22.377598+0000","last_became_peered":"2024-09-10T23:29:22.377598+0000","last_unstale":"2024-09-10T23:29:22.383587+0000","last_undegraded":"2024-09-10T23:29:22.383587+0000","last_fullsized":"2024-09-10T23:29:22.383587+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:53.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"188'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.400615+0000","last_change":"2024-09-10T23:29:21.370479+0000","last_active":"2024-09-10T23:29:22.400615+0000","last_peered":"2024-09-10T23:29:22.400615+0000","last_clean":"2024-09-10T23:29:22.400615+0000","last_became_active":"2024-09-10T23:29:21.370193+0000","last_became_peered":"2024-09-10T23:29:21.370193+0000","last_unstale":"2024-09-10T23:29:22.400615+0000","last_undegraded":"2024-09-10T23:29:22.400615+0000","last_fullsized":"2024-09-10T23:29:22.400615+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:45.758943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362915+0000","last_change":"2024-09-10T23:29:22.373776+0000","last_active":"2024-09-10T23:29:23.362915+0000","last_peered":"2024-09-10T23:29:23.362915+0000","last_clean":"2024-09-10T23:29:23.362915+0000","last_became_active":"2024-09-10T23:29:22.373508+0000","last_became_peered":"2024-09-10T23:29:22.373508+0000","last_unstale":"2024-09-10T23:29:23.362915+0000","last_undegraded":"2024-09-10T23:29:23.362915+0000","last_fullsized":"2024-09-10T23:29:23.362915+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:56.609648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362446+0000","last_change":"2024-09-10T23:29:21.375295+0000","last_active":"2024-09-10T23:29:23.362446+0000","last_peered":"2024-09-10T23:29:23.362446+0000","last_clean":"2024-09-10T23:29:23.362446+0000","last_became_active":"2024-09-10T23:29:21.374962+0000","last_became_peered":"2024-09-10T23:29:21.374962+0000","last_unstale":"2024-09-10T23:29:23.362446+0000","last_undegraded":"2024-09-10T23:29:23.362446+0000","last_fullsized":"2024-09-10T23:29:23.362446+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:05.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883963+0000","last_change":"2024-09-10T23:29:22.373465+0000","last_active":"2024-09-10T23:29:23.883963+0000","last_peered":"2024-09-10T23:29:23.883963+0000","last_clean":"2024-09-10T23:29:23.883963+0000","last_became_active":"2024-09-10T23:29:22.373202+0000","last_became_peered":"2024-09-10T23:29:22.373202+0000","last_unstale":"2024-09-10T23:29:23.883963+0000","last_undegraded":"2024-09-10T23:29:23.883963+0000","last_fullsized":"2024-09-10T23:29:23.883963+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:50.006903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882071+0000","last_change":"2024-09-10T23:29:21.372741+0000","last_active":"2024-09-10T23:29:23.882071+0000","last_peered":"2024-09-10T23:29:23.882071+0000","last_clean":"2024-09-10T23:29:23.882071+0000","last_became_active":"2024-09-10T23:29:21.372059+0000","last_became_peered":"2024-09-10T23:29:21.372059+0000","last_unstale":"2024-09-10T23:29:23.882071+0000","last_undegraded":"2024-09-10T23:29:23.882071+0000","last_fullsized":"2024-09-10T23:29:23.882071+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:34.763355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.889000+0000","last_change":"2024-09-10T23:29:22.390180+0000","last_active":"2024-09-10T23:29:23.889000+0000","last_peered":"2024-09-10T23:29:23.889000+0000","last_clean":"2024-09-10T23:29:23.889000+0000","last_became_active":"2024-09-10T23:29:22.386997+0000","last_became_peered":"2024-09-10T23:29:22.386997+0000","last_unstale":"2024-09-10T23:29:23.889000+0000","last_undegraded":"2024-09-10T23:29:23.889000+0000","last_fullsized":"2024-09-10T23:29:23.889000+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:30.823695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"188'8","reported_seq":23,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882251+0000","last_change":"2024-09-10T23:29:21.375354+0000","last_active":"2024-09-10T23:29:23.882251+0000","last_peered":"2024-09-10T23:29:23.882251+0000","last_clean":"2024-09-10T23:29:23.882251+0000","last_became_active":"2024-09-10T23:29:21.375054+0000","last_became_peered":"2024-09-10T23:29:21.375054+0000","last_unstale":"2024-09-10T23:29:23.882251+0000","last_undegraded":"2024-09-10T23:29:23.882251+0000","last_fullsized":"2024-09-10T23:29:23.882251+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:24.051089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396529+0000","last_change":"2024-09-10T23:29:22.394344+0000","last_active":"2024-09-10T23:29:23.396529+0000","last_peered":"2024-09-10T23:29:23.396529+0000","last_clean":"2024-09-10T23:29:23.396529+0000","last_became_active":"2024-09-10T23:29:22.394047+0000","last_became_peered":"2024-09-10T23:29:22.394047+0000","last_unstale":"2024-09-10T23:29:23.396529+0000","last_undegraded":"2024-09-10T23:29:23.396529+0000","last_fullsized":"2024-09-10T23:29:23.396529+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:04.127946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"188'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368986+0000","last_change":"2024-09-10T23:29:21.380962+0000","last_active":"2024-09-10T23:29:23.368986+0000","last_peered":"2024-09-10T23:29:23.368986+0000","last_clean":"2024-09-10T23:29:23.368986+0000","last_became_active":"2024-09-10T23:29:21.380139+0000","last_became_peered":"2024-09-10T23:29:21.380139+0000","last_unstale":"2024-09-10T23:29:23.368986+0000","last_undegraded":"2024-09-10T23:29:23.368986+0000","last_fullsized":"2024-09-10T23:29:23.368986+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:04.747869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368513+0000","last_change":"2024-09-10T23:29:22.393318+0000","last_active":"2024-09-10T23:29:23.368513+0000","last_peered":"2024-09-10T23:29:23.368513+0000","last_clean":"2024-09-10T23:29:23.368513+0000","last_became_active":"2024-09-10T23:29:22.392588+0000","last_became_peered":"2024-09-10T23:29:22.392588+0000","last_unstale":"2024-09-10T23:29:23.368513+0000","last_undegraded":"2024-09-10T23:29:23.368513+0000","last_fullsized":"2024-09-10T23:29:23.368513+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:57.284414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"188'2","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.369059+0000","last_change":"2024-09-10T23:29:21.381569+0000","last_active":"2024-09-10T23:29:23.369059+0000","last_peered":"2024-09-10T23:29:23.369059+0000","last_clean":"2024-09-10T23:29:23.369059+0000","last_became_active":"2024-09-10T23:29:21.381125+0000","last_became_peered":"2024-09-10T23:29:21.381125+0000","last_unstale":"2024-09-10T23:29:23.369059+0000","last_undegraded":"2024-09-10T23:29:23.369059+0000","last_fullsized":"2024-09-10T23:29:23.369059+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:08.541767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368770+0000","last_change":"2024-09-10T23:29:22.397074+0000","last_active":"2024-09-10T23:29:23.368770+0000","last_peered":"2024-09-10T23:29:23.368770+0000","last_clean":"2024-09-10T23:29:23.368770+0000","last_became_active":"2024-09-10T23:29:22.396766+0000","last_became_peered":"2024-09-10T23:29:22.396766+0000","last_unstale":"2024-09-10T23:29:23.368770+0000","last_undegraded":"2024-09-10T23:29:23.368770+0000","last_fullsized":"2024-09-10T23:29:23.368770+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:36.575886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"188'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.400821+0000","last_change":"2024-09-10T23:29:21.377375+0000","last_active":"2024-09-10T23:29:22.400821+0000","last_peered":"2024-09-10T23:29:22.400821+0000","last_clean":"2024-09-10T23:29:22.400821+0000","last_became_active":"2024-09-10T23:29:21.377112+0000","last_became_peered":"2024-09-10T23:29:21.377112+0000","last_unstale":"2024-09-10T23:29:22.400821+0000","last_undegraded":"2024-09-10T23:29:22.400821+0000","last_fullsized":"2024-09-10T23:29:22.400821+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:12.621152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396974+0000","last_change":"2024-09-10T23:29:22.391459+0000","last_active":"2024-09-10T23:29:23.396974+0000","last_peered":"2024-09-10T23:29:23.396974+0000","last_clean":"2024-09-10T23:29:23.396974+0000","last_became_active":"2024-09-10T23:29:22.390582+0000","last_became_peered":"2024-09-10T23:29:22.390582+0000","last_unstale":"2024-09-10T23:29:23.396974+0000","last_undegraded":"2024-09-10T23:29:23.396974+0000","last_fullsized":"2024-09-10T23:29:23.396974+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:49.772465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882504+0000","last_change":"2024-09-10T23:29:21.372719+0000","last_active":"2024-09-10T23:29:23.882504+0000","last_peered":"2024-09-10T23:29:23.882504+0000","last_clean":"2024-09-10T23:29:23.882504+0000","last_became_active":"2024-09-10T23:29:21.372413+0000","last_became_peered":"2024-09-10T23:29:21.372413+0000","last_unstale":"2024-09-10T23:29:23.882504+0000","last_undegraded":"2024-09-10T23:29:23.882504+0000","last_fullsized":"2024-09-10T23:29:23.882504+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:54.104596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.390418+0000","last_change":"2024-09-10T23:29:22.382502+0000","last_active":"2024-09-10T23:29:22.390418+0000","last_peered":"2024-09-10T23:29:22.390418+0000","last_clean":"2024-09-10T23:29:22.390418+0000","last_became_active":"2024-09-10T23:29:22.382214+0000","last_became_peered":"2024-09-10T23:29:22.382214+0000","last_unstale":"2024-09-10T23:29:22.390418+0000","last_undegraded":"2024-09-10T23:29:22.390418+0000","last_fullsized":"2024-09-10T23:29:22.390418+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:13.039026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"188'2","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882999+0000","last_change":"2024-09-10T23:29:21.380140+0000","last_active":"2024-09-10T23:29:23.882999+0000","last_peered":"2024-09-10T23:29:23.882999+0000","last_clean":"2024-09-10T23:29:23.882999+0000","last_became_active":"2024-09-10T23:29:21.379874+0000","last_became_peered":"2024-09-10T23:29:21.379874+0000","last_unstale":"2024-09-10T23:29:23.882999+0000","last_undegraded":"2024-09-10T23:29:23.882999+0000","last_fullsized":"2024-09-10T23:29:23.882999+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:39.868734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888857+0000","last_change":"2024-09-10T23:29:22.394132+0000","last_active":"2024-09-10T23:29:23.888857+0000","last_peered":"2024-09-10T23:29:23.888857+0000","last_clean":"2024-09-10T23:29:23.888857+0000","last_became_active":"2024-09-10T23:29:22.393800+0000","last_became_peered":"2024-09-10T23:29:22.393800+0000","last_unstale":"2024-09-10T23:29:23.888857+0000","last_undegraded":"2024-09-10T23:29:23.888857+0000","last_fullsized":"2024-09-10T23:29:23.888857+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:44.401505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.356828+0000","last_change":"2024-09-10T23:29:21.378278+0000","last_active":"2024-09-10T23:29:22.356828+0000","last_peered":"2024-09-10T23:29:22.356828+0000","last_clean":"2024-09-10T23:29:22.356828+0000","last_became_active":"2024-09-10T23:29:21.377935+0000","last_became_peered":"2024-09-10T23:29:21.377935+0000","last_unstale":"2024-09-10T23:29:22.356828+0000","last_undegraded":"2024-09-10T23:29:22.356828+0000","last_fullsized":"2024-09-10T23:29:22.356828+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:13.389490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884050+0000","last_change":"2024-09-10T23:29:22.378136+0000","last_active":"2024-09-10T23:29:23.884050+0000","last_peered":"2024-09-10T23:29:23.884050+0000","last_clean":"2024-09-10T23:29:23.884050+0000","last_became_active":"2024-09-10T23:29:22.377845+0000","last_became_peered":"2024-09-10T23:29:22.377845+0000","last_unstale":"2024-09-10T23:29:23.884050+0000","last_undegraded":"2024-09-10T23:29:23.884050+0000","last_fullsized":"2024-09-10T23:29:23.884050+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:57.674522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.679969+0000","last_change":"2024-09-10T23:29:21.373162+0000","last_active":"2024-09-10T23:29:23.679969+0000","last_peered":"2024-09-10T23:29:23.679969+0000","last_clean":"2024-09-10T23:29:23.679969+0000","last_became_active":"2024-09-10T23:29:21.372741+0000","last_became_peered":"2024-09-10T23:29:21.372741+0000","last_unstale":"2024-09-10T23:29:23.679969+0000","last_undegraded":"2024-09-10T23:29:23.679969+0000","last_fullsized":"2024-09-10T23:29:23.679969+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.153014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.397380+0000","last_change":"2024-09-10T23:29:22.380741+0000","last_active":"2024-09-10T23:29:23.397380+0000","last_peered":"2024-09-10T23:29:23.397380+0000","last_clean":"2024-09-10T23:29:23.397380+0000","last_became_active":"2024-09-10T23:29:22.380223+0000","last_became_peered":"2024-09-10T23:29:22.380223+0000","last_unstale":"2024-09-10T23:29:23.397380+0000","last_undegraded":"2024-09-10T23:29:23.397380+0000","last_fullsized":"2024-09-10T23:29:23.397380+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:10.778934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368323+0000","last_change":"2024-09-10T23:29:21.375548+0000","last_active":"2024-09-10T23:29:23.368323+0000","last_peered":"2024-09-10T23:29:23.368323+0000","last_clean":"2024-09-10T23:29:23.368323+0000","last_became_active":"2024-09-10T23:29:21.375264+0000","last_became_peered":"2024-09-10T23:29:21.375264+0000","last_unstale":"2024-09-10T23:29:23.368323+0000","last_undegraded":"2024-09-10T23:29:23.368323+0000","last_fullsized":"2024-09-10T23:29:23.368323+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:07.351673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396899+0000","last_change":"2024-09-10T23:29:22.379600+0000","last_active":"2024-09-10T23:29:23.396899+0000","last_peered":"2024-09-10T23:29:23.396899+0000","last_clean":"2024-09-10T23:29:23.396899+0000","last_became_active":"2024-09-10T23:29:22.379297+0000","last_became_peered":"2024-09-10T23:29:22.379297+0000","last_unstale":"2024-09-10T23:29:23.396899+0000","last_undegraded":"2024-09-10T23:29:23.396899+0000","last_fullsized":"2024-09-10T23:29:23.396899+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:42.156392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"188'2","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884451+0000","last_change":"2024-09-10T23:29:21.373196+0000","last_active":"2024-09-10T23:29:23.884451+0000","last_peered":"2024-09-10T23:29:23.884451+0000","last_clean":"2024-09-10T23:29:23.884451+0000","last_became_active":"2024-09-10T23:29:21.372793+0000","last_became_peered":"2024-09-10T23:29:21.372793+0000","last_unstale":"2024-09-10T23:29:23.884451+0000","last_undegraded":"2024-09-10T23:29:23.884451+0000","last_fullsized":"2024-09-10T23:29:23.884451+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:55.606270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362505+0000","last_change":"2024-09-10T23:29:22.384626+0000","last_active":"2024-09-10T23:29:23.362505+0000","last_peered":"2024-09-10T23:29:23.362505+0000","last_clean":"2024-09-10T23:29:23.362505+0000","last_became_active":"2024-09-10T23:29:22.384286+0000","last_became_peered":"2024-09-10T23:29:22.384286+0000","last_unstale":"2024-09-10T23:29:23.362505+0000","last_undegraded":"2024-09-10T23:29:23.362505+0000","last_fullsized":"2024-09-10T23:29:23.362505+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:44.401505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"189'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396988+0000","last_change":"2024-09-10T23:29:21.381692+0000","last_active":"2024-09-10T23:29:23.396988+0000","last_peered":"2024-09-10T23:29:23.396988+0000","last_clean":"2024-09-10T23:29:23.396988+0000","last_became_active":"2024-09-10T23:29:21.381404+0000","last_became_peered":"2024-09-10T23:29:21.381404+0000","last_unstale":"2024-09-10T23:29:23.396988+0000","last_undegraded":"2024-09-10T23:29:23.396988+0000","last_fullsized":"2024-09-10T23:29:23.396988+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:49.244664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882705+0000","last_change":"2024-09-10T23:29:22.370919+0000","last_active":"2024-09-10T23:29:23.882705+0000","last_peered":"2024-09-10T23:29:23.882705+0000","last_clean":"2024-09-10T23:29:23.882705+0000","last_became_active":"2024-09-10T23:29:22.370663+0000","last_became_peered":"2024-09-10T23:29:22.370663+0000","last_unstale":"2024-09-10T23:29:23.882705+0000","last_undegraded":"2024-09-10T23:29:23.882705+0000","last_fullsized":"2024-09-10T23:29:23.882705+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:41.090312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680124+0000","last_change":"2024-09-10T23:29:21.373208+0000","last_active":"2024-09-10T23:29:23.680124+0000","last_peered":"2024-09-10T23:29:23.680124+0000","last_clean":"2024-09-10T23:29:23.680124+0000","last_became_active":"2024-09-10T23:29:21.372895+0000","last_became_peered":"2024-09-10T23:29:21.372895+0000","last_unstale":"2024-09-10T23:29:23.680124+0000","last_undegraded":"2024-09-10T23:29:23.680124+0000","last_fullsized":"2024-09-10T23:29:23.680124+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:39.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368792+0000","last_change":"2024-09-10T23:29:22.387196+0000","last_active":"2024-09-10T23:29:23.368792+0000","last_peered":"2024-09-10T23:29:23.368792+0000","last_clean":"2024-09-10T23:29:23.368792+0000","last_became_active":"2024-09-10T23:29:22.384412+0000","last_became_peered":"2024-09-10T23:29:22.384412+0000","last_unstale":"2024-09-10T23:29:23.368792+0000","last_undegraded":"2024-09-10T23:29:23.368792+0000","last_fullsized":"2024-09-10T23:29:23.368792+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:10.854676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368603+0000","last_change":"2024-09-10T23:29:21.377287+0000","last_active":"2024-09-10T23:29:23.368603+0000","last_peered":"2024-09-10T23:29:23.368603+0000","last_clean":"2024-09-10T23:29:23.368603+0000","last_became_active":"2024-09-10T23:29:21.377008+0000","last_became_peered":"2024-09-10T23:29:21.377008+0000","last_unstale":"2024-09-10T23:29:23.368603+0000","last_undegraded":"2024-09-10T23:29:23.368603+0000","last_fullsized":"2024-09-10T23:29:23.368603+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:34.018214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396771+0000","last_change":"2024-09-10T23:29:22.386900+0000","last_active":"2024-09-10T23:29:23.396771+0000","last_peered":"2024-09-10T23:29:23.396771+0000","last_clean":"2024-09-10T23:29:23.396771+0000","last_became_active":"2024-09-10T23:29:22.386625+0000","last_became_peered":"2024-09-10T23:29:22.386625+0000","last_unstale":"2024-09-10T23:29:23.396771+0000","last_undegraded":"2024-09-10T23:29:23.396771+0000","last_fullsized":"2024-09-10T23:29:23.396771+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:51.271437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.397135+0000","last_change":"2024-09-10T23:29:21.372584+0000","last_active":"2024-09-10T23:29:23.397135+0000","last_peered":"2024-09-10T23:29:23.397135+0000","last_clean":"2024-09-10T23:29:23.397135+0000","last_became_active":"2024-09-10T23:29:21.372189+0000","last_became_peered":"2024-09-10T23:29:21.372189+0000","last_unstale":"2024-09-10T23:29:23.397135+0000","last_undegraded":"2024-09-10T23:29:23.397135+0000","last_fullsized":"2024-09-10T23:29:23.397135+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:26.483556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888864+0000","last_change":"2024-09-10T23:29:22.384161+0000","last_active":"2024-09-10T23:29:23.888864+0000","last_peered":"2024-09-10T23:29:23.888864+0000","last_clean":"2024-09-10T23:29:23.888864+0000","last_became_active":"2024-09-10T23:29:22.383518+0000","last_became_peered":"2024-09-10T23:29:22.383518+0000","last_unstale":"2024-09-10T23:29:23.888864+0000","last_undegraded":"2024-09-10T23:29:23.888864+0000","last_fullsized":"2024-09-10T23:29:23.888864+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:12.047577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883382+0000","last_change":"2024-09-10T23:29:21.365652+0000","last_active":"2024-09-10T23:29:23.883382+0000","last_peered":"2024-09-10T23:29:23.883382+0000","last_clean":"2024-09-10T23:29:23.883382+0000","last_became_active":"2024-09-10T23:29:21.363909+0000","last_became_peered":"2024-09-10T23:29:21.363909+0000","last_unstale":"2024-09-10T23:29:23.883382+0000","last_undegraded":"2024-09-10T23:29:23.883382+0000","last_fullsized":"2024-09-10T23:29:23.883382+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.226402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.889027+0000","last_change":"2024-09-10T23:29:22.384131+0000","last_active":"2024-09-10T23:29:23.889027+0000","last_peered":"2024-09-10T23:29:23.889027+0000","last_clean":"2024-09-10T23:29:23.889027+0000","last_became_active":"2024-09-10T23:29:22.383838+0000","last_became_peered":"2024-09-10T23:29:22.383838+0000","last_unstale":"2024-09-10T23:29:23.889027+0000","last_undegraded":"2024-09-10T23:29:23.889027+0000","last_fullsized":"2024-09-10T23:29:23.889027+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:06.916389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368595+0000","last_change":"2024-09-10T23:29:21.378278+0000","last_active":"2024-09-10T23:29:23.368595+0000","last_peered":"2024-09-10T23:29:23.368595+0000","last_clean":"2024-09-10T23:29:23.368595+0000","last_became_active":"2024-09-10T23:29:21.377987+0000","last_became_peered":"2024-09-10T23:29:21.377987+0000","last_unstale":"2024-09-10T23:29:23.368595+0000","last_undegraded":"2024-09-10T23:29:23.368595+0000","last_fullsized":"2024-09-10T23:29:23.368595+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:59.229074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362768+0000","last_change":"2024-09-10T23:29:22.377108+0000","last_active":"2024-09-10T23:29:23.362768+0000","last_peered":"2024-09-10T23:29:23.362768+0000","last_clean":"2024-09-10T23:29:23.362768+0000","last_became_active":"2024-09-10T23:29:22.376438+0000","last_became_peered":"2024-09-10T23:29:22.376438+0000","last_unstale":"2024-09-10T23:29:23.362768+0000","last_undegraded":"2024-09-10T23:29:23.362768+0000","last_fullsized":"2024-09-10T23:29:23.362768+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:38.762953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882375+0000","last_change":"2024-09-10T23:29:21.375355+0000","last_active":"2024-09-10T23:29:23.882375+0000","last_peered":"2024-09-10T23:29:23.882375+0000","last_clean":"2024-09-10T23:29:23.882375+0000","last_became_active":"2024-09-10T23:29:21.375080+0000","last_became_peered":"2024-09-10T23:29:21.375080+0000","last_unstale":"2024-09-10T23:29:23.882375+0000","last_undegraded":"2024-09-10T23:29:23.882375+0000","last_fullsized":"2024-09-10T23:29:23.882375+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:56.015062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368981+0000","last_change":"2024-09-10T23:29:22.393687+0000","last_active":"2024-09-10T23:29:23.368981+0000","last_peered":"2024-09-10T23:29:23.368981+0000","last_clean":"2024-09-10T23:29:23.368981+0000","last_became_active":"2024-09-10T23:29:22.393277+0000","last_became_peered":"2024-09-10T23:29:22.393277+0000","last_unstale":"2024-09-10T23:29:23.368981+0000","last_undegraded":"2024-09-10T23:29:23.368981+0000","last_fullsized":"2024-09-10T23:29:23.368981+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:07.998930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"188'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883411+0000","last_change":"2024-09-10T23:29:21.373347+0000","last_active":"2024-09-10T23:29:23.883411+0000","last_peered":"2024-09-10T23:29:23.883411+0000","last_clean":"2024-09-10T23:29:23.883411+0000","last_became_active":"2024-09-10T23:29:21.372317+0000","last_became_peered":"2024-09-10T23:29:21.372317+0000","last_unstale":"2024-09-10T23:29:23.883411+0000","last_undegraded":"2024-09-10T23:29:23.883411+0000","last_fullsized":"2024-09-10T23:29:23.883411+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:11.044199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":414,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888230+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:29:23.888230+0000","last_peered":"2024-09-10T23:29:23.888230+0000","last_clean":"2024-09-10T23:29:23.888230+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:29:23.888230+0000","last_undegraded":"2024-09-10T23:29:23.888230+0000","last_fullsized":"2024-09-10T23:29:23.888230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476907,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69564,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302276,"statfs":{"total":96636764160,"available":96565530624,"internally_reserved":0,"allocated":2392064,"data_stored":1120591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509612,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70136,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301704,"statfs":{"total":96636764160,"available":96564944896,"internally_reserved":0,"allocated":2985984,"data_stored":1710447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509611,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47408,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324432,"statfs":{"total":96636764160,"available":96588218368,"internally_reserved":0,"allocated":2383872,"data_stored":1118453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509612,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73776,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298064,"statfs":{"total":96636764160,"available":96561217536,"internally_reserved":0,"allocated":2379776,"data_stored":1118979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509611,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73776,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298064,"statfs":{"total":96636764160,"available":96561217536,"internally_reserved":0,"allocated":2379776,"data_stored":1118487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509612,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47404,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324436,"statfs":{"total":96636764160,"available":96588222464,"internally_reserved":0,"allocated":2375680,"data_stored":1118397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509611,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78508,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293332,"statfs":{"total":96636764160,"available":96556371968,"internally_reserved":0,"allocated":2973696,"data_stored":1708855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73704,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298136,"statfs":{"total":96636764160,"available":96561291264,"internally_reserved":0,"allocated":2375680,"data_stored":1111831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:29:26.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:29:26.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.716+0000 7f7bb3000640 1 -- 172.21.15.17:0/340655288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b90004810 msgr2=0x7f7b90004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.716+0000 7f7bb3000640 1 --2- 172.21.15.17:0/340655288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b90004810 0x7f7b90004c90 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f7b940016f0 tx=0x7f7b9401c750 comp rx=0 tx=0).stop 2024-09-10T23:29:26.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.716+0000 7f7bb3000640 1 -- 172.21.15.17:0/340655288 shutdown_connections 2024-09-10T23:29:26.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.716+0000 7f7bb3000640 1 --2- 172.21.15.17:0/340655288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b90004810 0x7f7b90004c90 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.716+0000 7f7bb3000640 1 -- 172.21.15.17:0/340655288 >> 172.21.15.17:0/340655288 conn(0x7f7bac0d1d60 msgr2=0x7f7bac0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:26.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.716+0000 7f7bb3000640 1 -- 172.21.15.17:0/340655288 shutdown_connections 2024-09-10T23:29:26.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.716+0000 7f7bb3000640 1 -- 172.21.15.17:0/340655288 wait complete. 2024-09-10T23:29:26.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 Processor -- start 2024-09-10T23:29:26.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 -- start start 2024-09-10T23:29:26.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b90004810 0x7f7bac15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:26.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bac14a6e0 0x7f7bac14a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:26.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bac1f8800 0x7f7bac0b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:26.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac071030 con 0x7f7bac1f8800 2024-09-10T23:29:26.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac070eb0 con 0x7f7b90004810 2024-09-10T23:29:26.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7bac0711b0 con 0x7f7bac14a6e0 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bac1f8800 0x7f7bac0b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bac1f8800 0x7f7bac0b62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56584/0 (socket says 172.21.15.17:56584) 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb1000640 1 -- 172.21.15.17:0/2293957770 learned_addr learned my addr 172.21.15.17:0/2293957770 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7ba3e00640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bac14a6e0 0x7f7bac14a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7babe00640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b90004810 0x7f7bac15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb1000640 1 -- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bac14a6e0 msgr2=0x7f7bac14a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb1000640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bac14a6e0 0x7f7bac14a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb1000640 1 -- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b90004810 msgr2=0x7f7bac15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb1000640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b90004810 0x7f7bac15bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb1000640 1 -- 172.21.15.17:0/2293957770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac15ae00 con 0x7f7bac1f8800 2024-09-10T23:29:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb1000640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bac1f8800 0x7f7bac0b62e0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0b7e10 tx=0x7f7ba4010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:26.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7ba8c00640 1 -- 172.21.15.17:0/2293957770 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4003980 con 0x7f7bac1f8800 2024-09-10T23:29:26.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7ba8c00640 1 -- 172.21.15.17:0/2293957770 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ba4015070 con 0x7f7bac1f8800 2024-09-10T23:29:26.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7ba8c00640 1 -- 172.21.15.17:0/2293957770 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4004030 con 0x7f7bac1f8800 2024-09-10T23:29:26.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac15b0e0 con 0x7f7bac1f8800 2024-09-10T23:29:26.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac15aa40 con 0x7f7bac1f8800 2024-09-10T23:29:26.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.720+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bac15f300 con 0x7f7bac1f8800 2024-09-10T23:29:26.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.724+0000 7f7ba8c00640 1 -- 172.21.15.17:0/2293957770 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7ba40041d0 con 0x7f7bac1f8800 2024-09-10T23:29:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.724+0000 7f7ba8c00640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b880725e0 0x7f7b88074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.724+0000 7f7ba8c00640 1 -- 172.21.15.17:0/2293957770 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f7ba4093f20 con 0x7f7bac1f8800 2024-09-10T23:29:26.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.724+0000 7f7babe00640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b880725e0 0x7f7b88074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:26.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.724+0000 7f7babe00640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b880725e0 0x7f7b88074aa0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7bac072ac0 tx=0x7f7b9c0011d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:26.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.728+0000 7f7ba8c00640 1 -- 172.21.15.17:0/2293957770 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7ba405ed80 con 0x7f7bac1f8800 2024-09-10T23:29:26.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.896+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7bac1f8cb0 con 0x7f7b880725e0 2024-09-10T23:29:26.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.900+0000 7f7ba8c00640 1 -- 172.21.15.17:0/2293957770 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252482 (secure 0 0 0) 0x7f7bac1f8cb0 con 0x7f7b880725e0 2024-09-10T23:29:26.907 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:26.908 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:29:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b880725e0 msgr2=0x7f7b88074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b880725e0 0x7f7b88074aa0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7bac072ac0 tx=0x7f7b9c0011d0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bac1f8800 msgr2=0x7f7bac0b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bac1f8800 0x7f7bac0b62e0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0b7e10 tx=0x7f7ba4010f40 comp rx=0 tx=0).stop 2024-09-10T23:29:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 shutdown_connections 2024-09-10T23:29:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7b880725e0 0x7f7b88074aa0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bac1f8800 0x7f7bac0b62e0 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7bac14a6e0 0x7f7bac14a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 --2- 172.21.15.17:0/2293957770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b90004810 0x7f7bac15bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:26.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 >> 172.21.15.17:0/2293957770 conn(0x7f7bac0d1d60 msgr2=0x7f7bac0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:26.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 shutdown_connections 2024-09-10T23:29:26.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:26.904+0000 7f7bb3000640 1 -- 172.21.15.17:0/2293957770 wait complete. 2024-09-10T23:29:26.926 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":604,"stamp":"2024-09-10T23:29:26.493112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":534276,"kb_used_data":19772,"kb_used_omap":12,"kb_used_meta":514291,"kb_avail":754440444,"statfs":{"total":773094113280,"available":772547014656,"internally_reserved":0,"allocated":20246528,"data_stored":10126040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":526634545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001370"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.369135+0000","last_change":"2024-09-10T23:29:22.394950+0000","last_active":"2024-09-10T23:29:23.369135+0000","last_peered":"2024-09-10T23:29:23.369135+0000","last_clean":"2024-09-10T23:29:23.369135+0000","last_became_active":"2024-09-10T23:29:22.393246+0000","last_became_peered":"2024-09-10T23:29:22.393246+0000","last_unstale":"2024-09-10T23:29:23.369135+0000","last_undegraded":"2024-09-10T23:29:23.369135+0000","last_fullsized":"2024-09-10T23:29:23.369135+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:20.173626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.391217+0000","last_change":"2024-09-10T23:29:22.389815+0000","last_active":"2024-09-10T23:29:22.391217+0000","last_peered":"2024-09-10T23:29:22.391217+0000","last_clean":"2024-09-10T23:29:22.391217+0000","last_became_active":"2024-09-10T23:29:22.387698+0000","last_became_peered":"2024-09-10T23:29:22.387698+0000","last_unstale":"2024-09-10T23:29:22.391217+0000","last_undegraded":"2024-09-10T23:29:22.391217+0000","last_fullsized":"2024-09-10T23:29:22.391217+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:56:51.938193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362654+0000","last_change":"2024-09-10T23:29:22.378322+0000","last_active":"2024-09-10T23:29:23.362654+0000","last_peered":"2024-09-10T23:29:23.362654+0000","last_clean":"2024-09-10T23:29:23.362654+0000","last_became_active":"2024-09-10T23:29:22.378046+0000","last_became_peered":"2024-09-10T23:29:22.378046+0000","last_unstale":"2024-09-10T23:29:23.362654+0000","last_undegraded":"2024-09-10T23:29:23.362654+0000","last_fullsized":"2024-09-10T23:29:23.362654+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:28.091420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888751+0000","last_change":"2024-09-10T23:29:22.394816+0000","last_active":"2024-09-10T23:29:23.888751+0000","last_peered":"2024-09-10T23:29:23.888751+0000","last_clean":"2024-09-10T23:29:23.888751+0000","last_became_active":"2024-09-10T23:29:22.394273+0000","last_became_peered":"2024-09-10T23:29:22.394273+0000","last_unstale":"2024-09-10T23:29:23.888751+0000","last_undegraded":"2024-09-10T23:29:23.888751+0000","last_fullsized":"2024-09-10T23:29:23.888751+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:16.586664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882492+0000","last_change":"2024-09-10T23:29:22.374620+0000","last_active":"2024-09-10T23:29:23.882492+0000","last_peered":"2024-09-10T23:29:23.882492+0000","last_clean":"2024-09-10T23:29:23.882492+0000","last_became_active":"2024-09-10T23:29:22.371057+0000","last_became_peered":"2024-09-10T23:29:22.371057+0000","last_unstale":"2024-09-10T23:29:23.882492+0000","last_undegraded":"2024-09-10T23:29:23.882492+0000","last_fullsized":"2024-09-10T23:29:23.882492+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:31.197087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888435+0000","last_change":"2024-09-10T23:29:22.393154+0000","last_active":"2024-09-10T23:29:23.888435+0000","last_peered":"2024-09-10T23:29:23.888435+0000","last_clean":"2024-09-10T23:29:23.888435+0000","last_became_active":"2024-09-10T23:29:22.391791+0000","last_became_peered":"2024-09-10T23:29:22.391791+0000","last_unstale":"2024-09-10T23:29:23.888435+0000","last_undegraded":"2024-09-10T23:29:23.888435+0000","last_fullsized":"2024-09-10T23:29:23.888435+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:10.854676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882234+0000","last_change":"2024-09-10T23:29:22.367867+0000","last_active":"2024-09-10T23:29:23.882234+0000","last_peered":"2024-09-10T23:29:23.882234+0000","last_clean":"2024-09-10T23:29:23.882234+0000","last_became_active":"2024-09-10T23:29:22.367585+0000","last_became_peered":"2024-09-10T23:29:22.367585+0000","last_unstale":"2024-09-10T23:29:23.882234+0000","last_undegraded":"2024-09-10T23:29:23.882234+0000","last_fullsized":"2024-09-10T23:29:23.882234+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:51.775369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396507+0000","last_change":"2024-09-10T23:29:22.387555+0000","last_active":"2024-09-10T23:29:23.396507+0000","last_peered":"2024-09-10T23:29:23.396507+0000","last_clean":"2024-09-10T23:29:23.396507+0000","last_became_active":"2024-09-10T23:29:22.387256+0000","last_became_peered":"2024-09-10T23:29:22.387256+0000","last_unstale":"2024-09-10T23:29:23.396507+0000","last_undegraded":"2024-09-10T23:29:23.396507+0000","last_fullsized":"2024-09-10T23:29:23.396507+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:10.871824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884092+0000","last_change":"2024-09-10T23:29:22.381887+0000","last_active":"2024-09-10T23:29:23.884092+0000","last_peered":"2024-09-10T23:29:23.884092+0000","last_clean":"2024-09-10T23:29:23.884092+0000","last_became_active":"2024-09-10T23:29:22.381243+0000","last_became_peered":"2024-09-10T23:29:22.381243+0000","last_unstale":"2024-09-10T23:29:23.884092+0000","last_undegraded":"2024-09-10T23:29:23.884092+0000","last_fullsized":"2024-09-10T23:29:23.884092+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:03.925298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396949+0000","last_change":"2024-09-10T23:29:22.381449+0000","last_active":"2024-09-10T23:29:23.396949+0000","last_peered":"2024-09-10T23:29:23.396949+0000","last_clean":"2024-09-10T23:29:23.396949+0000","last_became_active":"2024-09-10T23:29:22.380234+0000","last_became_peered":"2024-09-10T23:29:22.380234+0000","last_unstale":"2024-09-10T23:29:23.396949+0000","last_undegraded":"2024-09-10T23:29:23.396949+0000","last_fullsized":"2024-09-10T23:29:23.396949+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:40.672808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362777+0000","last_change":"2024-09-10T23:29:22.386018+0000","last_active":"2024-09-10T23:29:23.362777+0000","last_peered":"2024-09-10T23:29:23.362777+0000","last_clean":"2024-09-10T23:29:23.362777+0000","last_became_active":"2024-09-10T23:29:22.385432+0000","last_became_peered":"2024-09-10T23:29:22.385432+0000","last_unstale":"2024-09-10T23:29:23.362777+0000","last_undegraded":"2024-09-10T23:29:23.362777+0000","last_fullsized":"2024-09-10T23:29:23.362777+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:16.400456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882440+0000","last_change":"2024-09-10T23:29:22.381390+0000","last_active":"2024-09-10T23:29:23.882440+0000","last_peered":"2024-09-10T23:29:23.882440+0000","last_clean":"2024-09-10T23:29:23.882440+0000","last_became_active":"2024-09-10T23:29:22.380896+0000","last_became_peered":"2024-09-10T23:29:22.380896+0000","last_unstale":"2024-09-10T23:29:23.882440+0000","last_undegraded":"2024-09-10T23:29:23.882440+0000","last_fullsized":"2024-09-10T23:29:23.882440+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:29.715145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888606+0000","last_change":"2024-09-10T23:29:22.391702+0000","last_active":"2024-09-10T23:29:23.888606+0000","last_peered":"2024-09-10T23:29:23.888606+0000","last_clean":"2024-09-10T23:29:23.888606+0000","last_became_active":"2024-09-10T23:29:22.391041+0000","last_became_peered":"2024-09-10T23:29:22.391041+0000","last_unstale":"2024-09-10T23:29:23.888606+0000","last_undegraded":"2024-09-10T23:29:23.888606+0000","last_fullsized":"2024-09-10T23:29:23.888606+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:35.766733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396718+0000","last_change":"2024-09-10T23:29:22.388569+0000","last_active":"2024-09-10T23:29:23.396718+0000","last_peered":"2024-09-10T23:29:23.396718+0000","last_clean":"2024-09-10T23:29:23.396718+0000","last_became_active":"2024-09-10T23:29:22.387986+0000","last_became_peered":"2024-09-10T23:29:22.387986+0000","last_unstale":"2024-09-10T23:29:23.396718+0000","last_undegraded":"2024-09-10T23:29:23.396718+0000","last_fullsized":"2024-09-10T23:29:23.396718+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:39.172072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680134+0000","last_change":"2024-09-10T23:29:22.390033+0000","last_active":"2024-09-10T23:29:23.680134+0000","last_peered":"2024-09-10T23:29:23.680134+0000","last_clean":"2024-09-10T23:29:23.680134+0000","last_became_active":"2024-09-10T23:29:22.389730+0000","last_became_peered":"2024-09-10T23:29:22.389730+0000","last_unstale":"2024-09-10T23:29:23.680134+0000","last_undegraded":"2024-09-10T23:29:23.680134+0000","last_fullsized":"2024-09-10T23:29:23.680134+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:10:40.839191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362102+0000","last_change":"2024-09-10T23:29:22.374759+0000","last_active":"2024-09-10T23:29:23.362102+0000","last_peered":"2024-09-10T23:29:23.362102+0000","last_clean":"2024-09-10T23:29:23.362102+0000","last_became_active":"2024-09-10T23:29:22.373897+0000","last_became_peered":"2024-09-10T23:29:22.373897+0000","last_unstale":"2024-09-10T23:29:23.362102+0000","last_undegraded":"2024-09-10T23:29:23.362102+0000","last_fullsized":"2024-09-10T23:29:23.362102+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:31.926308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884207+0000","last_change":"2024-09-10T23:29:22.381531+0000","last_active":"2024-09-10T23:29:23.884207+0000","last_peered":"2024-09-10T23:29:23.884207+0000","last_clean":"2024-09-10T23:29:23.884207+0000","last_became_active":"2024-09-10T23:29:22.380888+0000","last_became_peered":"2024-09-10T23:29:22.380888+0000","last_unstale":"2024-09-10T23:29:23.884207+0000","last_undegraded":"2024-09-10T23:29:23.884207+0000","last_fullsized":"2024-09-10T23:29:23.884207+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:43.569149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883831+0000","last_change":"2024-09-10T23:29:22.368741+0000","last_active":"2024-09-10T23:29:23.883831+0000","last_peered":"2024-09-10T23:29:23.883831+0000","last_clean":"2024-09-10T23:29:23.883831+0000","last_became_active":"2024-09-10T23:29:22.368360+0000","last_became_peered":"2024-09-10T23:29:22.368360+0000","last_unstale":"2024-09-10T23:29:23.883831+0000","last_undegraded":"2024-09-10T23:29:23.883831+0000","last_fullsized":"2024-09-10T23:29:23.883831+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:59.389814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.397023+0000","last_change":"2024-09-10T23:29:22.396966+0000","last_active":"2024-09-10T23:29:23.397023+0000","last_peered":"2024-09-10T23:29:23.397023+0000","last_clean":"2024-09-10T23:29:23.397023+0000","last_became_active":"2024-09-10T23:29:22.395846+0000","last_became_peered":"2024-09-10T23:29:22.395846+0000","last_unstale":"2024-09-10T23:29:23.397023+0000","last_undegraded":"2024-09-10T23:29:23.397023+0000","last_fullsized":"2024-09-10T23:29:23.397023+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:12.093480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396703+0000","last_change":"2024-09-10T23:29:22.387575+0000","last_active":"2024-09-10T23:29:23.396703+0000","last_peered":"2024-09-10T23:29:23.396703+0000","last_clean":"2024-09-10T23:29:23.396703+0000","last_became_active":"2024-09-10T23:29:22.387272+0000","last_became_peered":"2024-09-10T23:29:22.387272+0000","last_unstale":"2024-09-10T23:29:23.396703+0000","last_undegraded":"2024-09-10T23:29:23.396703+0000","last_fullsized":"2024-09-10T23:29:23.396703+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:01.891555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396693+0000","last_change":"2024-09-10T23:29:22.386216+0000","last_active":"2024-09-10T23:29:23.396693+0000","last_peered":"2024-09-10T23:29:23.396693+0000","last_clean":"2024-09-10T23:29:23.396693+0000","last_became_active":"2024-09-10T23:29:22.385930+0000","last_became_peered":"2024-09-10T23:29:22.385930+0000","last_unstale":"2024-09-10T23:29:23.396693+0000","last_undegraded":"2024-09-10T23:29:23.396693+0000","last_fullsized":"2024-09-10T23:29:23.396693+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:04.156357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396603+0000","last_change":"2024-09-10T23:29:22.388283+0000","last_active":"2024-09-10T23:29:23.396603+0000","last_peered":"2024-09-10T23:29:23.396603+0000","last_clean":"2024-09-10T23:29:23.396603+0000","last_became_active":"2024-09-10T23:29:22.387681+0000","last_became_peered":"2024-09-10T23:29:22.387681+0000","last_unstale":"2024-09-10T23:29:23.396603+0000","last_undegraded":"2024-09-10T23:29:23.396603+0000","last_fullsized":"2024-09-10T23:29:23.396603+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:55.393063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.390886+0000","last_change":"2024-09-10T23:29:22.383498+0000","last_active":"2024-09-10T23:29:22.390886+0000","last_peered":"2024-09-10T23:29:22.390886+0000","last_clean":"2024-09-10T23:29:22.390886+0000","last_became_active":"2024-09-10T23:29:22.382562+0000","last_became_peered":"2024-09-10T23:29:22.382562+0000","last_unstale":"2024-09-10T23:29:22.390886+0000","last_undegraded":"2024-09-10T23:29:22.390886+0000","last_fullsized":"2024-09-10T23:29:22.390886+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:37.462082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882193+0000","last_change":"2024-09-10T23:29:22.377749+0000","last_active":"2024-09-10T23:29:23.882193+0000","last_peered":"2024-09-10T23:29:23.882193+0000","last_clean":"2024-09-10T23:29:23.882193+0000","last_became_active":"2024-09-10T23:29:22.377471+0000","last_became_peered":"2024-09-10T23:29:22.377471+0000","last_unstale":"2024-09-10T23:29:23.882193+0000","last_undegraded":"2024-09-10T23:29:23.882193+0000","last_fullsized":"2024-09-10T23:29:23.882193+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:07.849058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884310+0000","last_change":"2024-09-10T23:29:22.369240+0000","last_active":"2024-09-10T23:29:23.884310+0000","last_peered":"2024-09-10T23:29:23.884310+0000","last_clean":"2024-09-10T23:29:23.884310+0000","last_became_active":"2024-09-10T23:29:22.368980+0000","last_became_peered":"2024-09-10T23:29:22.368980+0000","last_unstale":"2024-09-10T23:29:23.884310+0000","last_undegraded":"2024-09-10T23:29:23.884310+0000","last_fullsized":"2024-09-10T23:29:23.884310+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:40.889928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.369025+0000","last_change":"2024-09-10T23:29:22.392854+0000","last_active":"2024-09-10T23:29:23.369025+0000","last_peered":"2024-09-10T23:29:23.369025+0000","last_clean":"2024-09-10T23:29:23.369025+0000","last_became_active":"2024-09-10T23:29:22.392561+0000","last_became_peered":"2024-09-10T23:29:22.392561+0000","last_unstale":"2024-09-10T23:29:23.369025+0000","last_undegraded":"2024-09-10T23:29:23.369025+0000","last_fullsized":"2024-09-10T23:29:23.369025+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:31.926308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362909+0000","last_change":"2024-09-10T23:29:22.385720+0000","last_active":"2024-09-10T23:29:23.362909+0000","last_peered":"2024-09-10T23:29:23.362909+0000","last_clean":"2024-09-10T23:29:23.362909+0000","last_became_active":"2024-09-10T23:29:22.385022+0000","last_became_peered":"2024-09-10T23:29:22.385022+0000","last_unstale":"2024-09-10T23:29:23.362909+0000","last_undegraded":"2024-09-10T23:29:23.362909+0000","last_fullsized":"2024-09-10T23:29:23.362909+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:54:29.334544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882512+0000","last_change":"2024-09-10T23:29:22.383859+0000","last_active":"2024-09-10T23:29:23.882512+0000","last_peered":"2024-09-10T23:29:23.882512+0000","last_clean":"2024-09-10T23:29:23.882512+0000","last_became_active":"2024-09-10T23:29:22.383570+0000","last_became_peered":"2024-09-10T23:29:22.383570+0000","last_unstale":"2024-09-10T23:29:23.882512+0000","last_undegraded":"2024-09-10T23:29:23.882512+0000","last_fullsized":"2024-09-10T23:29:23.882512+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:25.390903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883550+0000","last_change":"2024-09-10T23:29:22.364688+0000","last_active":"2024-09-10T23:29:23.883550+0000","last_peered":"2024-09-10T23:29:23.883550+0000","last_clean":"2024-09-10T23:29:23.883550+0000","last_became_active":"2024-09-10T23:29:22.364380+0000","last_became_peered":"2024-09-10T23:29:22.364380+0000","last_unstale":"2024-09-10T23:29:23.883550+0000","last_undegraded":"2024-09-10T23:29:23.883550+0000","last_fullsized":"2024-09-10T23:29:23.883550+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:46.370456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680080+0000","last_change":"2024-09-10T23:29:22.368985+0000","last_active":"2024-09-10T23:29:23.680080+0000","last_peered":"2024-09-10T23:29:23.680080+0000","last_clean":"2024-09-10T23:29:23.680080+0000","last_became_active":"2024-09-10T23:29:22.368696+0000","last_became_peered":"2024-09-10T23:29:22.368696+0000","last_unstale":"2024-09-10T23:29:23.680080+0000","last_undegraded":"2024-09-10T23:29:23.680080+0000","last_fullsized":"2024-09-10T23:29:23.680080+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:56:00.015325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888487+0000","last_change":"2024-09-10T23:29:22.389296+0000","last_active":"2024-09-10T23:29:23.888487+0000","last_peered":"2024-09-10T23:29:23.888487+0000","last_clean":"2024-09-10T23:29:23.888487+0000","last_became_active":"2024-09-10T23:29:22.389008+0000","last_became_peered":"2024-09-10T23:29:22.389008+0000","last_unstale":"2024-09-10T23:29:23.888487+0000","last_undegraded":"2024-09-10T23:29:23.888487+0000","last_fullsized":"2024-09-10T23:29:23.888487+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:39:29.110812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888375+0000","last_change":"2024-09-10T23:29:22.385318+0000","last_active":"2024-09-10T23:29:23.888375+0000","last_peered":"2024-09-10T23:29:23.888375+0000","last_clean":"2024-09-10T23:29:23.888375+0000","last_became_active":"2024-09-10T23:29:22.385044+0000","last_became_peered":"2024-09-10T23:29:22.385044+0000","last_unstale":"2024-09-10T23:29:23.888375+0000","last_undegraded":"2024-09-10T23:29:23.888375+0000","last_fullsized":"2024-09-10T23:29:23.888375+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:22.653885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.390338+0000","last_change":"2024-09-10T23:29:22.382463+0000","last_active":"2024-09-10T23:29:22.390338+0000","last_peered":"2024-09-10T23:29:22.390338+0000","last_clean":"2024-09-10T23:29:22.390338+0000","last_became_active":"2024-09-10T23:29:22.382170+0000","last_became_peered":"2024-09-10T23:29:22.382170+0000","last_unstale":"2024-09-10T23:29:22.390338+0000","last_undegraded":"2024-09-10T23:29:22.390338+0000","last_fullsized":"2024-09-10T23:29:22.390338+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:04.293482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"188'4","reported_seq":19,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680292+0000","last_change":"2024-09-10T23:29:21.381336+0000","last_active":"2024-09-10T23:29:23.680292+0000","last_peered":"2024-09-10T23:29:23.680292+0000","last_clean":"2024-09-10T23:29:23.680292+0000","last_became_active":"2024-09-10T23:29:21.378807+0000","last_became_peered":"2024-09-10T23:29:21.378807+0000","last_unstale":"2024-09-10T23:29:23.680292+0000","last_undegraded":"2024-09-10T23:29:23.680292+0000","last_fullsized":"2024-09-10T23:29:23.680292+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:48.769087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368730+0000","last_change":"2024-09-10T23:29:22.382886+0000","last_active":"2024-09-10T23:29:23.368730+0000","last_peered":"2024-09-10T23:29:23.368730+0000","last_clean":"2024-09-10T23:29:23.368730+0000","last_became_active":"2024-09-10T23:29:22.382616+0000","last_became_peered":"2024-09-10T23:29:22.382616+0000","last_unstale":"2024-09-10T23:29:23.368730+0000","last_undegraded":"2024-09-10T23:29:23.368730+0000","last_fullsized":"2024-09-10T23:29:23.368730+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:36.537459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"188'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368931+0000","last_change":"2024-09-10T23:29:21.377774+0000","last_active":"2024-09-10T23:29:23.368931+0000","last_peered":"2024-09-10T23:29:23.368931+0000","last_clean":"2024-09-10T23:29:23.368931+0000","last_became_active":"2024-09-10T23:29:21.377303+0000","last_became_peered":"2024-09-10T23:29:21.377303+0000","last_unstale":"2024-09-10T23:29:23.368931+0000","last_undegraded":"2024-09-10T23:29:23.368931+0000","last_fullsized":"2024-09-10T23:29:23.368931+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:48.155816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396950+0000","last_change":"2024-09-10T23:29:22.395199+0000","last_active":"2024-09-10T23:29:23.396950+0000","last_peered":"2024-09-10T23:29:23.396950+0000","last_clean":"2024-09-10T23:29:23.396950+0000","last_became_active":"2024-09-10T23:29:22.394947+0000","last_became_peered":"2024-09-10T23:29:22.394947+0000","last_unstale":"2024-09-10T23:29:23.396950+0000","last_undegraded":"2024-09-10T23:29:23.396950+0000","last_fullsized":"2024-09-10T23:29:23.396950+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:33.732330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"188'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.400120+0000","last_change":"2024-09-10T23:29:21.374949+0000","last_active":"2024-09-10T23:29:22.400120+0000","last_peered":"2024-09-10T23:29:22.400120+0000","last_clean":"2024-09-10T23:29:22.400120+0000","last_became_active":"2024-09-10T23:29:21.374601+0000","last_became_peered":"2024-09-10T23:29:21.374601+0000","last_unstale":"2024-09-10T23:29:22.400120+0000","last_undegraded":"2024-09-10T23:29:22.400120+0000","last_fullsized":"2024-09-10T23:29:22.400120+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:34.340181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882705+0000","last_change":"2024-09-10T23:29:22.375598+0000","last_active":"2024-09-10T23:29:23.882705+0000","last_peered":"2024-09-10T23:29:23.882705+0000","last_clean":"2024-09-10T23:29:23.882705+0000","last_became_active":"2024-09-10T23:29:22.374252+0000","last_became_peered":"2024-09-10T23:29:22.374252+0000","last_unstale":"2024-09-10T23:29:23.882705+0000","last_undegraded":"2024-09-10T23:29:23.882705+0000","last_fullsized":"2024-09-10T23:29:23.882705+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:18:27.377251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"188'2","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883622+0000","last_change":"2024-09-10T23:29:21.369295+0000","last_active":"2024-09-10T23:29:23.883622+0000","last_peered":"2024-09-10T23:29:23.883622+0000","last_clean":"2024-09-10T23:29:23.883622+0000","last_became_active":"2024-09-10T23:29:21.368457+0000","last_became_peered":"2024-09-10T23:29:21.368457+0000","last_unstale":"2024-09-10T23:29:23.883622+0000","last_undegraded":"2024-09-10T23:29:23.883622+0000","last_fullsized":"2024-09-10T23:29:23.883622+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:15.583287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680280+0000","last_change":"2024-09-10T23:29:22.369914+0000","last_active":"2024-09-10T23:29:23.680280+0000","last_peered":"2024-09-10T23:29:23.680280+0000","last_clean":"2024-09-10T23:29:23.680280+0000","last_became_active":"2024-09-10T23:29:22.369597+0000","last_became_peered":"2024-09-10T23:29:22.369597+0000","last_unstale":"2024-09-10T23:29:23.680280+0000","last_undegraded":"2024-09-10T23:29:23.680280+0000","last_fullsized":"2024-09-10T23:29:23.680280+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:40.571460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"188'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888441+0000","last_change":"2024-09-10T23:29:21.382226+0000","last_active":"2024-09-10T23:29:23.888441+0000","last_peered":"2024-09-10T23:29:23.888441+0000","last_clean":"2024-09-10T23:29:23.888441+0000","last_became_active":"2024-09-10T23:29:21.381955+0000","last_became_peered":"2024-09-10T23:29:21.381955+0000","last_unstale":"2024-09-10T23:29:23.888441+0000","last_undegraded":"2024-09-10T23:29:23.888441+0000","last_fullsized":"2024-09-10T23:29:23.888441+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:04.747869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680404+0000","last_change":"2024-09-10T23:29:22.379994+0000","last_active":"2024-09-10T23:29:23.680404+0000","last_peered":"2024-09-10T23:29:23.680404+0000","last_clean":"2024-09-10T23:29:23.680404+0000","last_became_active":"2024-09-10T23:29:22.379708+0000","last_became_peered":"2024-09-10T23:29:22.379708+0000","last_unstale":"2024-09-10T23:29:23.680404+0000","last_undegraded":"2024-09-10T23:29:23.680404+0000","last_fullsized":"2024-09-10T23:29:23.680404+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:17:57.266908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888189+0000","last_change":"2024-09-10T23:29:21.380970+0000","last_active":"2024-09-10T23:29:23.888189+0000","last_peered":"2024-09-10T23:29:23.888189+0000","last_clean":"2024-09-10T23:29:23.888189+0000","last_became_active":"2024-09-10T23:29:21.380660+0000","last_became_peered":"2024-09-10T23:29:21.380660+0000","last_unstale":"2024-09-10T23:29:23.888189+0000","last_undegraded":"2024-09-10T23:29:23.888189+0000","last_fullsized":"2024-09-10T23:29:23.888189+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:59.229074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884418+0000","last_change":"2024-09-10T23:29:22.371692+0000","last_active":"2024-09-10T23:29:23.884418+0000","last_peered":"2024-09-10T23:29:23.884418+0000","last_clean":"2024-09-10T23:29:23.884418+0000","last_became_active":"2024-09-10T23:29:22.371409+0000","last_became_peered":"2024-09-10T23:29:22.371409+0000","last_unstale":"2024-09-10T23:29:23.884418+0000","last_undegraded":"2024-09-10T23:29:23.884418+0000","last_fullsized":"2024-09-10T23:29:23.884418+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:30:08.626024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.361951+0000","last_change":"2024-09-10T23:29:21.375897+0000","last_active":"2024-09-10T23:29:23.361951+0000","last_peered":"2024-09-10T23:29:23.361951+0000","last_clean":"2024-09-10T23:29:23.361951+0000","last_became_active":"2024-09-10T23:29:21.375612+0000","last_became_peered":"2024-09-10T23:29:21.375612+0000","last_unstale":"2024-09-10T23:29:23.361951+0000","last_undegraded":"2024-09-10T23:29:23.361951+0000","last_fullsized":"2024-09-10T23:29:23.361951+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:42.759130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680068+0000","last_change":"2024-09-10T23:29:22.371104+0000","last_active":"2024-09-10T23:29:23.680068+0000","last_peered":"2024-09-10T23:29:23.680068+0000","last_clean":"2024-09-10T23:29:23.680068+0000","last_became_active":"2024-09-10T23:29:22.370814+0000","last_became_peered":"2024-09-10T23:29:22.370814+0000","last_unstale":"2024-09-10T23:29:23.680068+0000","last_undegraded":"2024-09-10T23:29:23.680068+0000","last_fullsized":"2024-09-10T23:29:23.680068+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:07.659079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883077+0000","last_change":"2024-09-10T23:29:21.374463+0000","last_active":"2024-09-10T23:29:23.883077+0000","last_peered":"2024-09-10T23:29:23.883077+0000","last_clean":"2024-09-10T23:29:23.883077+0000","last_became_active":"2024-09-10T23:29:21.373116+0000","last_became_peered":"2024-09-10T23:29:21.373116+0000","last_unstale":"2024-09-10T23:29:23.883077+0000","last_undegraded":"2024-09-10T23:29:23.883077+0000","last_fullsized":"2024-09-10T23:29:23.883077+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:16.090645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362126+0000","last_change":"2024-09-10T23:29:22.375476+0000","last_active":"2024-09-10T23:29:23.362126+0000","last_peered":"2024-09-10T23:29:23.362126+0000","last_clean":"2024-09-10T23:29:23.362126+0000","last_became_active":"2024-09-10T23:29:22.375185+0000","last_became_peered":"2024-09-10T23:29:22.375185+0000","last_unstale":"2024-09-10T23:29:23.362126+0000","last_undegraded":"2024-09-10T23:29:23.362126+0000","last_fullsized":"2024-09-10T23:29:23.362126+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:39:20.173626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888898+0000","last_change":"2024-09-10T23:29:21.385187+0000","last_active":"2024-09-10T23:29:23.888898+0000","last_peered":"2024-09-10T23:29:23.888898+0000","last_clean":"2024-09-10T23:29:23.888898+0000","last_became_active":"2024-09-10T23:29:21.384828+0000","last_became_peered":"2024-09-10T23:29:21.384828+0000","last_unstale":"2024-09-10T23:29:23.888898+0000","last_undegraded":"2024-09-10T23:29:23.888898+0000","last_fullsized":"2024-09-10T23:29:23.888898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:07.351673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883259+0000","last_change":"2024-09-10T23:29:22.380333+0000","last_active":"2024-09-10T23:29:23.883259+0000","last_peered":"2024-09-10T23:29:23.883259+0000","last_clean":"2024-09-10T23:29:23.883259+0000","last_became_active":"2024-09-10T23:29:22.380066+0000","last_became_peered":"2024-09-10T23:29:22.380066+0000","last_unstale":"2024-09-10T23:29:23.883259+0000","last_undegraded":"2024-09-10T23:29:23.883259+0000","last_fullsized":"2024-09-10T23:29:23.883259+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:49:52.556614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"188'3","reported_seq":18,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883808+0000","last_change":"2024-09-10T23:29:21.373565+0000","last_active":"2024-09-10T23:29:23.883808+0000","last_peered":"2024-09-10T23:29:23.883808+0000","last_clean":"2024-09-10T23:29:23.883808+0000","last_became_active":"2024-09-10T23:29:21.373097+0000","last_became_peered":"2024-09-10T23:29:21.373097+0000","last_unstale":"2024-09-10T23:29:23.883808+0000","last_undegraded":"2024-09-10T23:29:23.883808+0000","last_fullsized":"2024-09-10T23:29:23.883808+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:29.820317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883144+0000","last_change":"2024-09-10T23:29:22.383633+0000","last_active":"2024-09-10T23:29:23.883144+0000","last_peered":"2024-09-10T23:29:23.883144+0000","last_clean":"2024-09-10T23:29:23.883144+0000","last_became_active":"2024-09-10T23:29:22.383329+0000","last_became_peered":"2024-09-10T23:29:22.383329+0000","last_unstale":"2024-09-10T23:29:23.883144+0000","last_undegraded":"2024-09-10T23:29:23.883144+0000","last_fullsized":"2024-09-10T23:29:23.883144+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:36.274971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"188'6","reported_seq":21,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888630+0000","last_change":"2024-09-10T23:29:21.385405+0000","last_active":"2024-09-10T23:29:23.888630+0000","last_peered":"2024-09-10T23:29:23.888630+0000","last_clean":"2024-09-10T23:29:23.888630+0000","last_became_active":"2024-09-10T23:29:21.385043+0000","last_became_peered":"2024-09-10T23:29:21.385043+0000","last_unstale":"2024-09-10T23:29:23.888630+0000","last_undegraded":"2024-09-10T23:29:23.888630+0000","last_fullsized":"2024-09-10T23:29:23.888630+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:48.155816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.383587+0000","last_change":"2024-09-10T23:29:22.377864+0000","last_active":"2024-09-10T23:29:22.383587+0000","last_peered":"2024-09-10T23:29:22.383587+0000","last_clean":"2024-09-10T23:29:22.383587+0000","last_became_active":"2024-09-10T23:29:22.377598+0000","last_became_peered":"2024-09-10T23:29:22.377598+0000","last_unstale":"2024-09-10T23:29:22.383587+0000","last_undegraded":"2024-09-10T23:29:22.383587+0000","last_fullsized":"2024-09-10T23:29:22.383587+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:28:53.575581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"188'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.400615+0000","last_change":"2024-09-10T23:29:21.370479+0000","last_active":"2024-09-10T23:29:22.400615+0000","last_peered":"2024-09-10T23:29:22.400615+0000","last_clean":"2024-09-10T23:29:22.400615+0000","last_became_active":"2024-09-10T23:29:21.370193+0000","last_became_peered":"2024-09-10T23:29:21.370193+0000","last_unstale":"2024-09-10T23:29:22.400615+0000","last_undegraded":"2024-09-10T23:29:22.400615+0000","last_fullsized":"2024-09-10T23:29:22.400615+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:45.758943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362915+0000","last_change":"2024-09-10T23:29:22.373776+0000","last_active":"2024-09-10T23:29:23.362915+0000","last_peered":"2024-09-10T23:29:23.362915+0000","last_clean":"2024-09-10T23:29:23.362915+0000","last_became_active":"2024-09-10T23:29:22.373508+0000","last_became_peered":"2024-09-10T23:29:22.373508+0000","last_unstale":"2024-09-10T23:29:23.362915+0000","last_undegraded":"2024-09-10T23:29:23.362915+0000","last_fullsized":"2024-09-10T23:29:23.362915+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:56.609648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362446+0000","last_change":"2024-09-10T23:29:21.375295+0000","last_active":"2024-09-10T23:29:23.362446+0000","last_peered":"2024-09-10T23:29:23.362446+0000","last_clean":"2024-09-10T23:29:23.362446+0000","last_became_active":"2024-09-10T23:29:21.374962+0000","last_became_peered":"2024-09-10T23:29:21.374962+0000","last_unstale":"2024-09-10T23:29:23.362446+0000","last_undegraded":"2024-09-10T23:29:23.362446+0000","last_fullsized":"2024-09-10T23:29:23.362446+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:05.917717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883963+0000","last_change":"2024-09-10T23:29:22.373465+0000","last_active":"2024-09-10T23:29:23.883963+0000","last_peered":"2024-09-10T23:29:23.883963+0000","last_clean":"2024-09-10T23:29:23.883963+0000","last_became_active":"2024-09-10T23:29:22.373202+0000","last_became_peered":"2024-09-10T23:29:22.373202+0000","last_unstale":"2024-09-10T23:29:23.883963+0000","last_undegraded":"2024-09-10T23:29:23.883963+0000","last_fullsized":"2024-09-10T23:29:23.883963+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:40:50.006903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882071+0000","last_change":"2024-09-10T23:29:21.372741+0000","last_active":"2024-09-10T23:29:23.882071+0000","last_peered":"2024-09-10T23:29:23.882071+0000","last_clean":"2024-09-10T23:29:23.882071+0000","last_became_active":"2024-09-10T23:29:21.372059+0000","last_became_peered":"2024-09-10T23:29:21.372059+0000","last_unstale":"2024-09-10T23:29:23.882071+0000","last_undegraded":"2024-09-10T23:29:23.882071+0000","last_fullsized":"2024-09-10T23:29:23.882071+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:34.763355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.889000+0000","last_change":"2024-09-10T23:29:22.390180+0000","last_active":"2024-09-10T23:29:23.889000+0000","last_peered":"2024-09-10T23:29:23.889000+0000","last_clean":"2024-09-10T23:29:23.889000+0000","last_became_active":"2024-09-10T23:29:22.386997+0000","last_became_peered":"2024-09-10T23:29:22.386997+0000","last_unstale":"2024-09-10T23:29:23.889000+0000","last_undegraded":"2024-09-10T23:29:23.889000+0000","last_fullsized":"2024-09-10T23:29:23.889000+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:30.823695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"188'8","reported_seq":23,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882251+0000","last_change":"2024-09-10T23:29:21.375354+0000","last_active":"2024-09-10T23:29:23.882251+0000","last_peered":"2024-09-10T23:29:23.882251+0000","last_clean":"2024-09-10T23:29:23.882251+0000","last_became_active":"2024-09-10T23:29:21.375054+0000","last_became_peered":"2024-09-10T23:29:21.375054+0000","last_unstale":"2024-09-10T23:29:23.882251+0000","last_undegraded":"2024-09-10T23:29:23.882251+0000","last_fullsized":"2024-09-10T23:29:23.882251+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:24.051089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396529+0000","last_change":"2024-09-10T23:29:22.394344+0000","last_active":"2024-09-10T23:29:23.396529+0000","last_peered":"2024-09-10T23:29:23.396529+0000","last_clean":"2024-09-10T23:29:23.396529+0000","last_became_active":"2024-09-10T23:29:22.394047+0000","last_became_peered":"2024-09-10T23:29:22.394047+0000","last_unstale":"2024-09-10T23:29:23.396529+0000","last_undegraded":"2024-09-10T23:29:23.396529+0000","last_fullsized":"2024-09-10T23:29:23.396529+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:04.127946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"188'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368986+0000","last_change":"2024-09-10T23:29:21.380962+0000","last_active":"2024-09-10T23:29:23.368986+0000","last_peered":"2024-09-10T23:29:23.368986+0000","last_clean":"2024-09-10T23:29:23.368986+0000","last_became_active":"2024-09-10T23:29:21.380139+0000","last_became_peered":"2024-09-10T23:29:21.380139+0000","last_unstale":"2024-09-10T23:29:23.368986+0000","last_undegraded":"2024-09-10T23:29:23.368986+0000","last_fullsized":"2024-09-10T23:29:23.368986+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:58:04.747869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368513+0000","last_change":"2024-09-10T23:29:22.393318+0000","last_active":"2024-09-10T23:29:23.368513+0000","last_peered":"2024-09-10T23:29:23.368513+0000","last_clean":"2024-09-10T23:29:23.368513+0000","last_became_active":"2024-09-10T23:29:22.392588+0000","last_became_peered":"2024-09-10T23:29:22.392588+0000","last_unstale":"2024-09-10T23:29:23.368513+0000","last_undegraded":"2024-09-10T23:29:23.368513+0000","last_fullsized":"2024-09-10T23:29:23.368513+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:57.284414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"188'2","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.369059+0000","last_change":"2024-09-10T23:29:21.381569+0000","last_active":"2024-09-10T23:29:23.369059+0000","last_peered":"2024-09-10T23:29:23.369059+0000","last_clean":"2024-09-10T23:29:23.369059+0000","last_became_active":"2024-09-10T23:29:21.381125+0000","last_became_peered":"2024-09-10T23:29:21.381125+0000","last_unstale":"2024-09-10T23:29:23.369059+0000","last_undegraded":"2024-09-10T23:29:23.369059+0000","last_fullsized":"2024-09-10T23:29:23.369059+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:03:08.541767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368770+0000","last_change":"2024-09-10T23:29:22.397074+0000","last_active":"2024-09-10T23:29:23.368770+0000","last_peered":"2024-09-10T23:29:23.368770+0000","last_clean":"2024-09-10T23:29:23.368770+0000","last_became_active":"2024-09-10T23:29:22.396766+0000","last_became_peered":"2024-09-10T23:29:22.396766+0000","last_unstale":"2024-09-10T23:29:23.368770+0000","last_undegraded":"2024-09-10T23:29:23.368770+0000","last_fullsized":"2024-09-10T23:29:23.368770+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:36.575886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"188'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.400821+0000","last_change":"2024-09-10T23:29:21.377375+0000","last_active":"2024-09-10T23:29:22.400821+0000","last_peered":"2024-09-10T23:29:22.400821+0000","last_clean":"2024-09-10T23:29:22.400821+0000","last_became_active":"2024-09-10T23:29:21.377112+0000","last_became_peered":"2024-09-10T23:29:21.377112+0000","last_unstale":"2024-09-10T23:29:22.400821+0000","last_undegraded":"2024-09-10T23:29:22.400821+0000","last_fullsized":"2024-09-10T23:29:22.400821+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:12.621152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396974+0000","last_change":"2024-09-10T23:29:22.391459+0000","last_active":"2024-09-10T23:29:23.396974+0000","last_peered":"2024-09-10T23:29:23.396974+0000","last_clean":"2024-09-10T23:29:23.396974+0000","last_became_active":"2024-09-10T23:29:22.390582+0000","last_became_peered":"2024-09-10T23:29:22.390582+0000","last_unstale":"2024-09-10T23:29:23.396974+0000","last_undegraded":"2024-09-10T23:29:23.396974+0000","last_fullsized":"2024-09-10T23:29:23.396974+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:49.772465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882504+0000","last_change":"2024-09-10T23:29:21.372719+0000","last_active":"2024-09-10T23:29:23.882504+0000","last_peered":"2024-09-10T23:29:23.882504+0000","last_clean":"2024-09-10T23:29:23.882504+0000","last_became_active":"2024-09-10T23:29:21.372413+0000","last_became_peered":"2024-09-10T23:29:21.372413+0000","last_unstale":"2024-09-10T23:29:23.882504+0000","last_undegraded":"2024-09-10T23:29:23.882504+0000","last_fullsized":"2024-09-10T23:29:23.882504+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:54.104596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.390418+0000","last_change":"2024-09-10T23:29:22.382502+0000","last_active":"2024-09-10T23:29:22.390418+0000","last_peered":"2024-09-10T23:29:22.390418+0000","last_clean":"2024-09-10T23:29:22.390418+0000","last_became_active":"2024-09-10T23:29:22.382214+0000","last_became_peered":"2024-09-10T23:29:22.382214+0000","last_unstale":"2024-09-10T23:29:22.390418+0000","last_undegraded":"2024-09-10T23:29:22.390418+0000","last_fullsized":"2024-09-10T23:29:22.390418+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:13.039026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"188'2","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882999+0000","last_change":"2024-09-10T23:29:21.380140+0000","last_active":"2024-09-10T23:29:23.882999+0000","last_peered":"2024-09-10T23:29:23.882999+0000","last_clean":"2024-09-10T23:29:23.882999+0000","last_became_active":"2024-09-10T23:29:21.379874+0000","last_became_peered":"2024-09-10T23:29:21.379874+0000","last_unstale":"2024-09-10T23:29:23.882999+0000","last_undegraded":"2024-09-10T23:29:23.882999+0000","last_fullsized":"2024-09-10T23:29:23.882999+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:39.868734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888857+0000","last_change":"2024-09-10T23:29:22.394132+0000","last_active":"2024-09-10T23:29:23.888857+0000","last_peered":"2024-09-10T23:29:23.888857+0000","last_clean":"2024-09-10T23:29:23.888857+0000","last_became_active":"2024-09-10T23:29:22.393800+0000","last_became_peered":"2024-09-10T23:29:22.393800+0000","last_unstale":"2024-09-10T23:29:23.888857+0000","last_undegraded":"2024-09-10T23:29:23.888857+0000","last_fullsized":"2024-09-10T23:29:23.888857+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:44.401505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-10T23:29:22.356828+0000","last_change":"2024-09-10T23:29:21.378278+0000","last_active":"2024-09-10T23:29:22.356828+0000","last_peered":"2024-09-10T23:29:22.356828+0000","last_clean":"2024-09-10T23:29:22.356828+0000","last_became_active":"2024-09-10T23:29:21.377935+0000","last_became_peered":"2024-09-10T23:29:21.377935+0000","last_unstale":"2024-09-10T23:29:22.356828+0000","last_undegraded":"2024-09-10T23:29:22.356828+0000","last_fullsized":"2024-09-10T23:29:22.356828+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:13.389490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884050+0000","last_change":"2024-09-10T23:29:22.378136+0000","last_active":"2024-09-10T23:29:23.884050+0000","last_peered":"2024-09-10T23:29:23.884050+0000","last_clean":"2024-09-10T23:29:23.884050+0000","last_became_active":"2024-09-10T23:29:22.377845+0000","last_became_peered":"2024-09-10T23:29:22.377845+0000","last_unstale":"2024-09-10T23:29:23.884050+0000","last_undegraded":"2024-09-10T23:29:23.884050+0000","last_fullsized":"2024-09-10T23:29:23.884050+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:57.674522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.679969+0000","last_change":"2024-09-10T23:29:21.373162+0000","last_active":"2024-09-10T23:29:23.679969+0000","last_peered":"2024-09-10T23:29:23.679969+0000","last_clean":"2024-09-10T23:29:23.679969+0000","last_became_active":"2024-09-10T23:29:21.372741+0000","last_became_peered":"2024-09-10T23:29:21.372741+0000","last_unstale":"2024-09-10T23:29:23.679969+0000","last_undegraded":"2024-09-10T23:29:23.679969+0000","last_fullsized":"2024-09-10T23:29:23.679969+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:41.153014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.397380+0000","last_change":"2024-09-10T23:29:22.380741+0000","last_active":"2024-09-10T23:29:23.397380+0000","last_peered":"2024-09-10T23:29:23.397380+0000","last_clean":"2024-09-10T23:29:23.397380+0000","last_became_active":"2024-09-10T23:29:22.380223+0000","last_became_peered":"2024-09-10T23:29:22.380223+0000","last_unstale":"2024-09-10T23:29:23.397380+0000","last_undegraded":"2024-09-10T23:29:23.397380+0000","last_fullsized":"2024-09-10T23:29:23.397380+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:10.778934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368323+0000","last_change":"2024-09-10T23:29:21.375548+0000","last_active":"2024-09-10T23:29:23.368323+0000","last_peered":"2024-09-10T23:29:23.368323+0000","last_clean":"2024-09-10T23:29:23.368323+0000","last_became_active":"2024-09-10T23:29:21.375264+0000","last_became_peered":"2024-09-10T23:29:21.375264+0000","last_unstale":"2024-09-10T23:29:23.368323+0000","last_undegraded":"2024-09-10T23:29:23.368323+0000","last_fullsized":"2024-09-10T23:29:23.368323+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:07.351673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396899+0000","last_change":"2024-09-10T23:29:22.379600+0000","last_active":"2024-09-10T23:29:23.396899+0000","last_peered":"2024-09-10T23:29:23.396899+0000","last_clean":"2024-09-10T23:29:23.396899+0000","last_became_active":"2024-09-10T23:29:22.379297+0000","last_became_peered":"2024-09-10T23:29:22.379297+0000","last_unstale":"2024-09-10T23:29:23.396899+0000","last_undegraded":"2024-09-10T23:29:23.396899+0000","last_fullsized":"2024-09-10T23:29:23.396899+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:42.156392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"188'2","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.884451+0000","last_change":"2024-09-10T23:29:21.373196+0000","last_active":"2024-09-10T23:29:23.884451+0000","last_peered":"2024-09-10T23:29:23.884451+0000","last_clean":"2024-09-10T23:29:23.884451+0000","last_became_active":"2024-09-10T23:29:21.372793+0000","last_became_peered":"2024-09-10T23:29:21.372793+0000","last_unstale":"2024-09-10T23:29:23.884451+0000","last_undegraded":"2024-09-10T23:29:23.884451+0000","last_fullsized":"2024-09-10T23:29:23.884451+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:55.606270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362505+0000","last_change":"2024-09-10T23:29:22.384626+0000","last_active":"2024-09-10T23:29:23.362505+0000","last_peered":"2024-09-10T23:29:23.362505+0000","last_clean":"2024-09-10T23:29:23.362505+0000","last_became_active":"2024-09-10T23:29:22.384286+0000","last_became_peered":"2024-09-10T23:29:22.384286+0000","last_unstale":"2024-09-10T23:29:23.362505+0000","last_undegraded":"2024-09-10T23:29:23.362505+0000","last_fullsized":"2024-09-10T23:29:23.362505+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:44.401505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"189'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396988+0000","last_change":"2024-09-10T23:29:21.381692+0000","last_active":"2024-09-10T23:29:23.396988+0000","last_peered":"2024-09-10T23:29:23.396988+0000","last_clean":"2024-09-10T23:29:23.396988+0000","last_became_active":"2024-09-10T23:29:21.381404+0000","last_became_peered":"2024-09-10T23:29:21.381404+0000","last_unstale":"2024-09-10T23:29:23.396988+0000","last_undegraded":"2024-09-10T23:29:23.396988+0000","last_fullsized":"2024-09-10T23:29:23.396988+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:33:49.244664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882705+0000","last_change":"2024-09-10T23:29:22.370919+0000","last_active":"2024-09-10T23:29:23.882705+0000","last_peered":"2024-09-10T23:29:23.882705+0000","last_clean":"2024-09-10T23:29:23.882705+0000","last_became_active":"2024-09-10T23:29:22.370663+0000","last_became_peered":"2024-09-10T23:29:22.370663+0000","last_unstale":"2024-09-10T23:29:23.882705+0000","last_undegraded":"2024-09-10T23:29:23.882705+0000","last_fullsized":"2024-09-10T23:29:23.882705+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:41.090312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.680124+0000","last_change":"2024-09-10T23:29:21.373208+0000","last_active":"2024-09-10T23:29:23.680124+0000","last_peered":"2024-09-10T23:29:23.680124+0000","last_clean":"2024-09-10T23:29:23.680124+0000","last_became_active":"2024-09-10T23:29:21.372895+0000","last_became_peered":"2024-09-10T23:29:21.372895+0000","last_unstale":"2024-09-10T23:29:23.680124+0000","last_undegraded":"2024-09-10T23:29:23.680124+0000","last_fullsized":"2024-09-10T23:29:23.680124+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:44:39.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368792+0000","last_change":"2024-09-10T23:29:22.387196+0000","last_active":"2024-09-10T23:29:23.368792+0000","last_peered":"2024-09-10T23:29:23.368792+0000","last_clean":"2024-09-10T23:29:23.368792+0000","last_became_active":"2024-09-10T23:29:22.384412+0000","last_became_peered":"2024-09-10T23:29:22.384412+0000","last_unstale":"2024-09-10T23:29:23.368792+0000","last_undegraded":"2024-09-10T23:29:23.368792+0000","last_fullsized":"2024-09-10T23:29:23.368792+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:10.854676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368603+0000","last_change":"2024-09-10T23:29:21.377287+0000","last_active":"2024-09-10T23:29:23.368603+0000","last_peered":"2024-09-10T23:29:23.368603+0000","last_clean":"2024-09-10T23:29:23.368603+0000","last_became_active":"2024-09-10T23:29:21.377008+0000","last_became_peered":"2024-09-10T23:29:21.377008+0000","last_unstale":"2024-09-10T23:29:23.368603+0000","last_undegraded":"2024-09-10T23:29:23.368603+0000","last_fullsized":"2024-09-10T23:29:23.368603+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:34.018214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.396771+0000","last_change":"2024-09-10T23:29:22.386900+0000","last_active":"2024-09-10T23:29:23.396771+0000","last_peered":"2024-09-10T23:29:23.396771+0000","last_clean":"2024-09-10T23:29:23.396771+0000","last_became_active":"2024-09-10T23:29:22.386625+0000","last_became_peered":"2024-09-10T23:29:22.386625+0000","last_unstale":"2024-09-10T23:29:23.396771+0000","last_undegraded":"2024-09-10T23:29:23.396771+0000","last_fullsized":"2024-09-10T23:29:23.396771+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:51.271437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.397135+0000","last_change":"2024-09-10T23:29:21.372584+0000","last_active":"2024-09-10T23:29:23.397135+0000","last_peered":"2024-09-10T23:29:23.397135+0000","last_clean":"2024-09-10T23:29:23.397135+0000","last_became_active":"2024-09-10T23:29:21.372189+0000","last_became_peered":"2024-09-10T23:29:21.372189+0000","last_unstale":"2024-09-10T23:29:23.397135+0000","last_undegraded":"2024-09-10T23:29:23.397135+0000","last_fullsized":"2024-09-10T23:29:23.397135+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:26.483556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888864+0000","last_change":"2024-09-10T23:29:22.384161+0000","last_active":"2024-09-10T23:29:23.888864+0000","last_peered":"2024-09-10T23:29:23.888864+0000","last_clean":"2024-09-10T23:29:23.888864+0000","last_became_active":"2024-09-10T23:29:22.383518+0000","last_became_peered":"2024-09-10T23:29:22.383518+0000","last_unstale":"2024-09-10T23:29:23.888864+0000","last_undegraded":"2024-09-10T23:29:23.888864+0000","last_fullsized":"2024-09-10T23:29:23.888864+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:12.047577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883382+0000","last_change":"2024-09-10T23:29:21.365652+0000","last_active":"2024-09-10T23:29:23.883382+0000","last_peered":"2024-09-10T23:29:23.883382+0000","last_clean":"2024-09-10T23:29:23.883382+0000","last_became_active":"2024-09-10T23:29:21.363909+0000","last_became_peered":"2024-09-10T23:29:21.363909+0000","last_unstale":"2024-09-10T23:29:23.883382+0000","last_undegraded":"2024-09-10T23:29:23.883382+0000","last_fullsized":"2024-09-10T23:29:23.883382+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:14.226402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.889027+0000","last_change":"2024-09-10T23:29:22.384131+0000","last_active":"2024-09-10T23:29:23.889027+0000","last_peered":"2024-09-10T23:29:23.889027+0000","last_clean":"2024-09-10T23:29:23.889027+0000","last_became_active":"2024-09-10T23:29:22.383838+0000","last_became_peered":"2024-09-10T23:29:22.383838+0000","last_unstale":"2024-09-10T23:29:23.889027+0000","last_undegraded":"2024-09-10T23:29:23.889027+0000","last_fullsized":"2024-09-10T23:29:23.889027+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:06.916389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368595+0000","last_change":"2024-09-10T23:29:21.378278+0000","last_active":"2024-09-10T23:29:23.368595+0000","last_peered":"2024-09-10T23:29:23.368595+0000","last_clean":"2024-09-10T23:29:23.368595+0000","last_became_active":"2024-09-10T23:29:21.377987+0000","last_became_peered":"2024-09-10T23:29:21.377987+0000","last_unstale":"2024-09-10T23:29:23.368595+0000","last_undegraded":"2024-09-10T23:29:23.368595+0000","last_fullsized":"2024-09-10T23:29:23.368595+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:59.229074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.362768+0000","last_change":"2024-09-10T23:29:22.377108+0000","last_active":"2024-09-10T23:29:23.362768+0000","last_peered":"2024-09-10T23:29:23.362768+0000","last_clean":"2024-09-10T23:29:23.362768+0000","last_became_active":"2024-09-10T23:29:22.376438+0000","last_became_peered":"2024-09-10T23:29:22.376438+0000","last_unstale":"2024-09-10T23:29:23.362768+0000","last_undegraded":"2024-09-10T23:29:23.362768+0000","last_fullsized":"2024-09-10T23:29:23.362768+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:10:38.762953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.882375+0000","last_change":"2024-09-10T23:29:21.375355+0000","last_active":"2024-09-10T23:29:23.882375+0000","last_peered":"2024-09-10T23:29:23.882375+0000","last_clean":"2024-09-10T23:29:23.882375+0000","last_became_active":"2024-09-10T23:29:21.375080+0000","last_became_peered":"2024-09-10T23:29:21.375080+0000","last_unstale":"2024-09-10T23:29:23.882375+0000","last_undegraded":"2024-09-10T23:29:23.882375+0000","last_fullsized":"2024-09-10T23:29:23.882375+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:56.015062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.368981+0000","last_change":"2024-09-10T23:29:22.393687+0000","last_active":"2024-09-10T23:29:23.368981+0000","last_peered":"2024-09-10T23:29:23.368981+0000","last_clean":"2024-09-10T23:29:23.368981+0000","last_became_active":"2024-09-10T23:29:22.393277+0000","last_became_peered":"2024-09-10T23:29:22.393277+0000","last_unstale":"2024-09-10T23:29:23.368981+0000","last_undegraded":"2024-09-10T23:29:23.368981+0000","last_fullsized":"2024-09-10T23:29:23.368981+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:21.344334+0000","last_clean_scrub_stamp":"2024-09-10T23:29:21.344334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:07.998930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"188'1","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.883411+0000","last_change":"2024-09-10T23:29:21.373347+0000","last_active":"2024-09-10T23:29:23.883411+0000","last_peered":"2024-09-10T23:29:23.883411+0000","last_clean":"2024-09-10T23:29:23.883411+0000","last_became_active":"2024-09-10T23:29:21.372317+0000","last_became_peered":"2024-09-10T23:29:21.372317+0000","last_unstale":"2024-09-10T23:29:23.883411+0000","last_undegraded":"2024-09-10T23:29:23.883411+0000","last_fullsized":"2024-09-10T23:29:23.883411+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:29:20.340956+0000","last_clean_scrub_stamp":"2024-09-10T23:29:20.340956+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:11.044199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":414,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-10T23:29:23.888230+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:29:23.888230+0000","last_peered":"2024-09-10T23:29:23.888230+0000","last_clean":"2024-09-10T23:29:23.888230+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:29:23.888230+0000","last_undegraded":"2024-09-10T23:29:23.888230+0000","last_fullsized":"2024-09-10T23:29:23.888230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476907,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69564,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302276,"statfs":{"total":96636764160,"available":96565530624,"internally_reserved":0,"allocated":2392064,"data_stored":1120591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509612,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70136,"kb_used_data":2916,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301704,"statfs":{"total":96636764160,"available":96564944896,"internally_reserved":0,"allocated":2985984,"data_stored":1710447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509611,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47408,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324432,"statfs":{"total":96636764160,"available":96588218368,"internally_reserved":0,"allocated":2383872,"data_stored":1118453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509612,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73776,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298064,"statfs":{"total":96636764160,"available":96561217536,"internally_reserved":0,"allocated":2379776,"data_stored":1118979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509611,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73776,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94298064,"statfs":{"total":96636764160,"available":96561217536,"internally_reserved":0,"allocated":2379776,"data_stored":1118487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509612,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47404,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324436,"statfs":{"total":96636764160,"available":96588222464,"internally_reserved":0,"allocated":2375680,"data_stored":1118397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509611,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78508,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293332,"statfs":{"total":96636764160,"available":96556371968,"internally_reserved":0,"allocated":2973696,"data_stored":1708855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73704,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298136,"statfs":{"total":96636764160,"available":96561291264,"internally_reserved":0,"allocated":2375680,"data_stored":1111831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:29:26.931 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:29:26.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:29:27.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 -- 172.21.15.17:0/163221695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 msgr2=0x7fbe7c0730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 --2- 172.21.15.17:0/163221695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 0x7fbe7c0730e0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c071660 tx=0x7fbe6401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 -- 172.21.15.17:0/163221695 shutdown_connections 2024-09-10T23:29:27.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 --2- 172.21.15.17:0/163221695 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe7c073620 0x7fbe7c06ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 --2- 172.21.15.17:0/163221695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 0x7fbe7c0730e0 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 --2- 172.21.15.17:0/163221695 >> v2:172.21.15.77:3300/0 conn(0x7fbe7c074840 0x7fbe7c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 -- 172.21.15.17:0/163221695 >> 172.21.15.17:0/163221695 conn(0x7fbe7c0b1d50 msgr2=0x7fbe7c0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 -- 172.21.15.17:0/163221695 shutdown_connections 2024-09-10T23:29:27.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 -- 172.21.15.17:0/163221695 wait complete. 2024-09-10T23:29:27.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 Processor -- start 2024-09-10T23:29:27.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.120+0000 7fbe82200640 1 -- start start 2024-09-10T23:29:27.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe82200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe7c073620 0x7fbe7c13d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe82200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe7c074840 0x7fbe7c13a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe82200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 0x7fbe7c1f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe82200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7c152860 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe82200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7c1526e0 con 0x7fbe7c074840 2024-09-10T23:29:27.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe82200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe7c1529e0 con 0x7fbe7c073620 2024-09-10T23:29:27.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 0x7fbe7c1f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 0x7fbe7c1f7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43392/0 (socket says 172.21.15.17:43392) 2024-09-10T23:29:27.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7be00640 1 -- 172.21.15.17:0/1849455726 learned_addr learned my addr 172.21.15.17:0/1849455726 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:27.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7b400640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe7c073620 0x7fbe7c13d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe73e00640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe7c074840 0x7fbe7c13a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7be00640 1 -- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe7c073620 msgr2=0x7fbe7c13d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7be00640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe7c073620 0x7fbe7c13d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7be00640 1 -- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe7c074840 msgr2=0x7fbe7c13a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7be00640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe7c074840 0x7fbe7c13a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7be00640 1 -- 172.21.15.17:0/1849455726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7c0b5160 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7b400640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe7c073620 0x7fbe7c13d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:27.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe7be00640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 0x7fbe7c1f7f30 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400dac0 tx=0x7fbe7400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe73400640 1 -- 172.21.15.17:0/1849455726 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7400bdd0 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe73400640 1 -- 172.21.15.17:0/1849455726 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe74003980 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe73400640 1 -- 172.21.15.17:0/1849455726 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74003dd0 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7c13cbd0 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe7c1f8d60 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.124+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe7c152e90 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.128+0000 7fbe73400640 1 -- 172.21.15.17:0/1849455726 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbe74003f70 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.128+0000 7fbe73400640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe580725e0 0x7fbe58074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.128+0000 7fbe73400640 1 -- 172.21.15.17:0/1849455726 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fbe74093c90 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.128+0000 7fbe7b400640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe580725e0 0x7fbe58074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.128+0000 7fbe7b400640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe580725e0 0x7fbe58074aa0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0103d0 tx=0x7fbe6c00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.132+0000 7fbe73400640 1 -- 172.21.15.17:0/1849455726 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbe74020030 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.368+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fbe7c0b2bd0 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.368+0000 7fbe73400640 1 -- 172.21.15.17:0/1849455726 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) ==== 190+0+147 (secure 0 0 0) 0x7fbe74017030 con 0x7fbe7c15c0e0 2024-09-10T23:29:27.370 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:29:27.370 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:29:27.370 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:29:27.370 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:29:27.370 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:29:27.371 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:29:27.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe580725e0 msgr2=0x7fbe58074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe580725e0 0x7fbe58074aa0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0103d0 tx=0x7fbe6c00b390 comp rx=0 tx=0).stop 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 msgr2=0x7fbe7c1f7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 0x7fbe7c1f7f30 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400dac0 tx=0x7fbe7400df80 comp rx=0 tx=0).stop 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 shutdown_connections 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe580725e0 0x7fbe58074aa0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe7c15c0e0 0x7fbe7c1f7f30 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe7c074840 0x7fbe7c13a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 --2- 172.21.15.17:0/1849455726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe7c073620 0x7fbe7c13d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 >> 172.21.15.17:0/1849455726 conn(0x7fbe7c0b1d50 msgr2=0x7fbe7c15b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 shutdown_connections 2024-09-10T23:29:27.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.372+0000 7fbe82200640 1 -- 172.21.15.17:0/1849455726 wait complete. 2024-09-10T23:29:27.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:29:27.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.536+0000 7f2321c00640 1 -- 172.21.15.17:0/309987851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0cff20 msgr2=0x7f231c0d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.536+0000 7f2321c00640 1 --2- 172.21.15.17:0/309987851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0cff20 0x7f231c0d03b0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f2314009c80 tx=0x7f231401cda0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.536+0000 7f2321c00640 1 -- 172.21.15.17:0/309987851 shutdown_connections 2024-09-10T23:29:27.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.536+0000 7f2321c00640 1 --2- 172.21.15.17:0/309987851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0cff20 0x7f231c0d03b0 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.536+0000 7f2321c00640 1 --2- 172.21.15.17:0/309987851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231c0b48f0 0x7f231c0b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.536+0000 7f2321c00640 1 -- 172.21.15.17:0/309987851 >> 172.21.15.17:0/309987851 conn(0x7f231c06cfc0 msgr2=0x7f231c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.536+0000 7f2321c00640 1 -- 172.21.15.17:0/309987851 shutdown_connections 2024-09-10T23:29:27.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.536+0000 7f2321c00640 1 -- 172.21.15.17:0/309987851 wait complete. 2024-09-10T23:29:27.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 Processor -- start 2024-09-10T23:29:27.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 -- start start 2024-09-10T23:29:27.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0b48f0 0x7f231c1fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231c0cf4f0 0x7f231c0aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231c0cff20 0x7f231c151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f231c168bd0 con 0x7f231c0b48f0 2024-09-10T23:29:27.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f231c168a50 con 0x7f231c0cff20 2024-09-10T23:29:27.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f231c168d50 con 0x7f231c0cf4f0 2024-09-10T23:29:27.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0b48f0 0x7f231c1fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0b48f0 0x7f231c1fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43406/0 (socket says 172.21.15.17:43406) 2024-09-10T23:29:27.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231aa00640 1 -- 172.21.15.17:0/447818556 learned_addr learned my addr 172.21.15.17:0/447818556 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:27.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2313e00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231c0cf4f0 0x7f231c0aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231b400640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231c0cff20 0x7f231c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231aa00640 1 -- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231c0cf4f0 msgr2=0x7f231c0aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231aa00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231c0cf4f0 0x7f231c0aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231aa00640 1 -- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231c0cff20 msgr2=0x7f231c151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231aa00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231c0cff20 0x7f231c151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231aa00640 1 -- 172.21.15.17:0/447818556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c0ab4d0 con 0x7f231c0b48f0 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2313e00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231c0cf4f0 0x7f231c0aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231b400640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231c0cff20 0x7f231c151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f231aa00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0b48f0 0x7f231c1fb970 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f230c00c4c0 tx=0x7f230c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2312a00640 1 -- 172.21.15.17:0/447818556 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c017070 con 0x7f231c0b48f0 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2312a00640 1 -- 172.21.15.17:0/447818556 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f230c003600 con 0x7f231c0b48f0 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2312a00640 1 -- 172.21.15.17:0/447818556 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c003a50 con 0x7f231c0b48f0 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231c0ab770 con 0x7f231c0b48f0 2024-09-10T23:29:27.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.540+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231c1fb170 con 0x7f231c0b48f0 2024-09-10T23:29:27.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.544+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f231c0b37f0 con 0x7f231c0b48f0 2024-09-10T23:29:27.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.544+0000 7f2312a00640 1 -- 172.21.15.17:0/447818556 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f230c003bf0 con 0x7f231c0b48f0 2024-09-10T23:29:27.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.544+0000 7f2312a00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f80725e0 0x7f22f8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:27.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.544+0000 7f2312a00640 1 -- 172.21.15.17:0/447818556 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f230c092520 con 0x7f231c0b48f0 2024-09-10T23:29:27.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.544+0000 7f2313e00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f80725e0 0x7f22f8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:27.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.544+0000 7f2313e00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f80725e0 0x7f22f8074aa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f231c0aeb90 tx=0x7f2304008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:27.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.548+0000 7f2312a00640 1 -- 172.21.15.17:0/447818556 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f230c05db00 con 0x7f231c0b48f0 2024-09-10T23:29:27.616 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:29:27.616+0000 7f2ed2a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:29:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.760+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f231c0afeb0 con 0x7f231c0b48f0 2024-09-10T23:29:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.760+0000 7f2312a00640 1 -- 172.21.15.17:0/447818556 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5236 (secure 0 0 0) 0x7f230c066220 con 0x7f231c0b48f0 2024-09-10T23:29:27.762 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:27.763 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":144,"btime":"2024-09-10T23:29:25:379289+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3439807694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3439807694},{"type":"v1","addr":"172.21.15.77:6837","nonce":3439807694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":9772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2077624650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2077624650},{"type":"v1","addr":"172.21.15.77:6836","nonce":2077624650}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10638,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/294398472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":294398472},{"type":"v1","addr":"172.21.15.17:6834","nonce":294398472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:29:21.766077+0000","modified":"2024-09-10T23:29:24.781764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10641":{"gid":10641,"name":"c","rank":0,"incarnation":140,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4256418601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4256418601},{"type":"v1","addr":"172.21.15.17:6835","nonce":4256418601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10641,"qdb_cluster":[10641]},"id":13}]} 2024-09-10T23:29:27.763 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 144 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f80725e0 msgr2=0x7f22f8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f80725e0 0x7f22f8074aa0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f231c0aeb90 tx=0x7f2304008040 comp rx=0 tx=0).stop 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0b48f0 msgr2=0x7f231c1fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0b48f0 0x7f231c1fb970 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f230c00c4c0 tx=0x7f230c001e80 comp rx=0 tx=0).stop 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 shutdown_connections 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f80725e0 0x7f22f8074aa0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231c0cff20 0x7f231c151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231c0cf4f0 0x7f231c0aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 --2- 172.21.15.17:0/447818556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231c0b48f0 0x7f231c1fb970 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 >> 172.21.15.17:0/447818556 conn(0x7f231c06cfc0 msgr2=0x7f231c152160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:27.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 shutdown_connections 2024-09-10T23:29:27.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:27.764+0000 7f2321c00640 1 -- 172.21.15.17:0/447818556 wait complete. 2024-09-10T23:29:28.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 144, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:29:21.766077+0000', 'modified': '2024-09-10T23:29:24.781764+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10641}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10641': {'gid': 10641, 'name': 'c', 'rank': 0, 'incarnation': 140, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/4256418601', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 4256418601}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 4256418601}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10641, 'qdb_cluster': [10641]} 2024-09-10T23:29:28.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:29:28.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:29:28.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.340+0000 7f9b9a800640 1 -- 172.21.15.17:0/1024364133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9415bfa0 msgr2=0x7f9b940ae970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.340+0000 7f9b9a800640 1 --2- 172.21.15.17:0/1024364133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9415bfa0 0x7f9b940ae970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009870 tx=0x7f9b8401c750 comp rx=0 tx=0).stop 2024-09-10T23:29:28.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.340+0000 7f9b9a800640 1 -- 172.21.15.17:0/1024364133 shutdown_connections 2024-09-10T23:29:28.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.340+0000 7f9b9a800640 1 --2- 172.21.15.17:0/1024364133 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9415bfa0 0x7f9b940ae970 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.340+0000 7f9b9a800640 1 -- 172.21.15.17:0/1024364133 >> 172.21.15.17:0/1024364133 conn(0x7f9b940d1ca0 msgr2=0x7f9b940d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:28.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.340+0000 7f9b9a800640 1 -- 172.21.15.17:0/1024364133 shutdown_connections 2024-09-10T23:29:28.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.340+0000 7f9b9a800640 1 -- 172.21.15.17:0/1024364133 wait complete. 2024-09-10T23:29:28.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 Processor -- start 2024-09-10T23:29:28.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 -- start start 2024-09-10T23:29:28.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b940b1090 0x7f9b940c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b940cfef0 0x7f9b94156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9415bfa0 0x7f9b9414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9b94169c60 con 0x7f9b940b1090 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b94169ae0 con 0x7f9b940cfef0 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b94169de0 con 0x7f9b9415bfa0 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b940b1090 0x7f9b940c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b940b1090 0x7f9b940c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43422/0 (socket says 172.21.15.17:43422) 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93400640 1 -- 172.21.15.17:0/961249654 learned_addr learned my addr 172.21.15.17:0/961249654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93e00640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9415bfa0 0x7f9b9414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b8be00640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b940cfef0 0x7f9b94156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93400640 1 -- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9415bfa0 msgr2=0x7f9b9414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93400640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9415bfa0 0x7f9b9414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93400640 1 -- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b940cfef0 msgr2=0x7f9b94156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93400640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b940cfef0 0x7f9b94156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93400640 1 -- 172.21.15.17:0/961249654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b940cb580 con 0x7f9b940b1090 2024-09-10T23:29:28.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93e00640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9415bfa0 0x7f9b9414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:28.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b8be00640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b940cfef0 0x7f9b94156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:28.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b93400640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b940b1090 0x7f9b940c8d70 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f9b84000c10 tx=0x7f9b84005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:28.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b8b400640 1 -- 172.21.15.17:0/961249654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b840bb070 con 0x7f9b940b1090 2024-09-10T23:29:28.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b8b400640 1 -- 172.21.15.17:0/961249654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b840043f0 con 0x7f9b940b1090 2024-09-10T23:29:28.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b8b400640 1 -- 172.21.15.17:0/961249654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b840b2040 con 0x7f9b940b1090 2024-09-10T23:29:28.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 -- 172.21.15.17:0/961249654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b940c9450 con 0x7f9b940b1090 2024-09-10T23:29:28.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.344+0000 7f9b9a800640 1 -- 172.21.15.17:0/961249654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b940cbb20 con 0x7f9b940b1090 2024-09-10T23:29:28.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b8b400640 1 -- 172.21.15.17:0/961249654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9b840b5030 con 0x7f9b940b1090 2024-09-10T23:29:28.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b8b400640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b70072610 0x7f9b70074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b8b400640 1 -- 172.21.15.17:0/961249654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f9b8412c920 con 0x7f9b940b1090 2024-09-10T23:29:28.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b9dca0000 1 Processor -- start 2024-09-10T23:29:28.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b8be00640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b70072610 0x7f9b70074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b9dca0000 1 -- start start 2024-09-10T23:29:28.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b8be00640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b70072610 0x7f9b70074ad0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c000fc0 tx=0x7f9b7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:28.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2811c62f0 0x55d2811798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d281179e10 0x55d28117a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d28109a3f0 con 0x55d2811c59d0 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d280fd7b20 con 0x55d2811c62f0 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.348+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d280fc6f50 con 0x55d281179e10 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43436/0 (socket says 172.21.15.17:43436) 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 -- 172.21.15.17:0/3047126314 learned_addr learned my addr 172.21.15.17:0/3047126314 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 -- 172.21.15.17:0/3047126314 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d281179e10 msgr2=0x55d28117a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 --2- 172.21.15.17:0/3047126314 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d281179e10 0x55d28117a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 -- 172.21.15.17:0/3047126314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2811c62f0 msgr2=0x55d2811798d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 --2- 172.21.15.17:0/3047126314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2811c62f0 0x55d2811798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 -- 172.21.15.17:0/3047126314 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d280f8e590 con 0x55d2811c59d0 2024-09-10T23:29:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 --2- 172.21.15.17:0/3047126314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811c5db0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f9b840f73d0 tx=0x7f9b840f3e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ab6d25a86b896b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:28.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b83e00640 1 -- 172.21.15.17:0/3047126314 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b840f7dd0 con 0x55d2811c59d0 2024-09-10T23:29:28.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b83e00640 1 -- 172.21.15.17:0/3047126314 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b840f76d0 con 0x55d2811c59d0 2024-09-10T23:29:28.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b83e00640 1 -- 172.21.15.17:0/3047126314 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b840fc1b0 con 0x55d2811c59d0 2024-09-10T23:29:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 -- 172.21.15.17:0/3047126314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 msgr2=0x55d2811c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/3047126314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811c5db0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f9b840f73d0 tx=0x7f9b840f3e50 comp rx=0 tx=0).stop 2024-09-10T23:29:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 -- 172.21.15.17:0/3047126314 shutdown_connections 2024-09-10T23:29:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/3047126314 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d281179e10 0x55d28117a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/3047126314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2811c62f0 0x55d2811798d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/3047126314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811c5db0 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 -- 172.21.15.17:0/3047126314 >> 172.21.15.17:0/3047126314 conn(0x55d281063130 msgr2=0x55d2811a8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 -- 172.21.15.17:0/3047126314 shutdown_connections 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 -- 172.21.15.17:0/3047126314 wait complete. 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 -- start start 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 Processor -- start 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 0x55d2811a6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c59d0 0x55d28117bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c62f0 0x55d28117c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d280f615d0 con 0x55d2811c62f0 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d280fcad60 con 0x55d281179e10 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d280f6d500 con 0x55d2811c59d0 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b9dca0000 10 client.0 _ll_register_callbacks cb 0x55d280f71810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c62f0 0x55d28117c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c62f0 0x55d28117c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43452/0 (socket says 172.21.15.17:43452) 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93e00640 1 -- 172.21.15.17:0/1461275603 learned_addr learned my addr 172.21.15.17:0/1461275603 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.352+0000 7f9b93400640 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 0x55d2811a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b8be00640 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c59d0 0x55d28117bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b93e00640 1 -- 172.21.15.17:0/1461275603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c59d0 msgr2=0x55d28117bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:28.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b93e00640 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c59d0 0x55d28117bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b93e00640 1 -- 172.21.15.17:0/1461275603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 msgr2=0x55d2811a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b93e00640 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 0x55d2811a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b93e00640 1 -- 172.21.15.17:0/1461275603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d280f65170 con 0x55d2811c62f0 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b8be00640 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c59d0 0x55d28117bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b93e00640 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c62f0 0x55d28117c500 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00d400 tx=0x7f9b8c00d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57083b94dedfd7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 1 -- 172.21.15.17:0/1461275603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c018060 con 0x55d2811c62f0 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1461275603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d280f5f0f0 con 0x55d2811c62f0 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 1 -- 172.21.15.17:0/1461275603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f9b8c003db0 con 0x55d2811c62f0 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 1 -- 172.21.15.17:0/1461275603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f9b8c01e050 con 0x55d2811c62f0 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 10 client.10773 fetch_fsmap learned FSMap version 144 2024-09-10T23:29:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1461275603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55d28104bef0 con 0x55d2811c62f0 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 1 -- 172.21.15.17:0/1461275603 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d280f5f0f0 con 0x55d2811c62f0 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 1 -- 172.21.15.17:0/1461275603 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f9b8c021020 con 0x55d2811c62f0 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 10 client.10773 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 10 client.10773 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 20 client.10773 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55d28117cf10 0x55d28117d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 4 client.10773 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1461275603 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d280fd9a70 con 0x55d28117cf10 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b93400640 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55d28117cf10 0x55d28117d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b93400640 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55d28117cf10 0x55d28117d2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=914073faf7fd5817 server_cookie=b1d9e04a66c3b8a8 in_seq=0 out_seq=0 2024-09-10T23:29:28.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 10 client.10773 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:28.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 1 -- 172.21.15.17:0/1461275603 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d280fd9a70 con 0x55d28117cf10 2024-09-10T23:29:28.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 10 client.10773 handle_command_reply: tid=0 2024-09-10T23:29:28.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 client.10773 shutdown 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1461275603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c62f0 msgr2=0x55d28117c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c62f0 0x55d28117c500 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00d400 tx=0x7f9b8c00d800 comp rx=0 tx=0).stop 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1461275603 shutdown_connections 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c62f0 0x55d28117c500 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c59d0 0x55d28117bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55d28117cf10 0x55d28117d2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1461275603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 0x55d2811a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b80c00640 0 client.10773 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1461275603 >> 172.21.15.17:0/1461275603 conn(0x55d281063130 msgr2=0x55d281178fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1461275603 shutdown_connections 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1461275603 wait complete. 2024-09-10T23:29:28.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.356+0000 7f9b9dca0000 20 client.10773 trim_cache size 0 max 16384 2024-09-10T23:29:28.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b9dca0000 1 Processor -- start 2024-09-10T23:29:28.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b9dca0000 1 -- start start 2024-09-10T23:29:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d281179e10 0x55d2811e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811790b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2811c62f0 0x55d2811795f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9b941ffd50 con 0x55d2811c59d0 2024-09-10T23:29:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9406f530 con 0x55d2811c62f0 2024-09-10T23:29:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9b94152c30 con 0x55d281179e10 2024-09-10T23:29:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811790b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811790b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43468/0 (socket says 172.21.15.17:43468) 2024-09-10T23:29:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b8be00640 1 -- 172.21.15.17:0/1957449206 learned_addr learned my addr 172.21.15.17:0/1957449206 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b93e00640 1 --2- 172.21.15.17:0/1957449206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2811c62f0 0x55d2811795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.376+0000 7f9b93400640 1 --2- 172.21.15.17:0/1957449206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d281179e10 0x55d2811e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 -- 172.21.15.17:0/1957449206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d281179e10 msgr2=0x55d2811e1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:28.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 --2- 172.21.15.17:0/1957449206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d281179e10 0x55d2811e1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 -- 172.21.15.17:0/1957449206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2811c62f0 msgr2=0x55d2811795f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:28.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 --2- 172.21.15.17:0/1957449206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2811c62f0 0x55d2811795f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 -- 172.21.15.17:0/1957449206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d281022d90 con 0x55d2811c59d0 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 --2- 172.21.15.17:0/1957449206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811790b0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00da70 tx=0x7f9b7c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609db0549ed264a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b83400640 1 -- 172.21.15.17:0/1957449206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c014bb0 con 0x55d2811c59d0 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b83400640 1 -- 172.21.15.17:0/1957449206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b7c014d50 con 0x55d2811c59d0 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b83400640 1 -- 172.21.15.17:0/1957449206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c005020 con 0x55d2811c59d0 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1957449206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 msgr2=0x55d2811790b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1957449206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811790b0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00da70 tx=0x7f9b7c010000 comp rx=0 tx=0).stop 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1957449206 shutdown_connections 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1957449206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d2811c62f0 0x55d2811795f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1957449206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2811790b0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/1957449206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d281179e10 0x55d2811e1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1957449206 >> 172.21.15.17:0/1957449206 conn(0x55d281063130 msgr2=0x55d281181b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1957449206 shutdown_connections 2024-09-10T23:29:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 -- 172.21.15.17:0/1957449206 wait complete. 2024-09-10T23:29:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 -- start start 2024-09-10T23:29:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 Processor -- start 2024-09-10T23:29:28.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 0x55d28123fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2812402e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c62f0 0x55d281240820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d281086730 con 0x55d2811c59d0 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d280f92ec0 con 0x55d281179e10 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d280fcf390 con 0x55d2811c62f0 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b9dca0000 10 client.0 _ll_register_callbacks cb 0x7f9b8c001680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2812402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2812402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43480/0 (socket says 172.21.15.17:43480) 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 -- 172.21.15.17:0/910508904 learned_addr learned my addr 172.21.15.17:0/910508904 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b93400640 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 0x55d28123fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b93e00640 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c62f0 0x55d281240820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 -- 172.21.15.17:0/910508904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c62f0 msgr2=0x55d281240820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c62f0 0x55d281240820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 -- 172.21.15.17:0/910508904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 msgr2=0x55d28123fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 0x55d28123fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.380+0000 7f9b8be00640 1 -- 172.21.15.17:0/910508904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d280f8da90 con 0x55d2811c59d0 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b8be00640 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2812402e0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c022040 tx=0x7f9b7c0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a945fd09bf0e1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 1 -- 172.21.15.17:0/910508904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c005520 con 0x55d2811c59d0 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 1 -- 172.21.15.17:0/910508904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f9b7c025040 con 0x55d2811c59d0 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 -- 172.21.15.17:0/910508904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b7c014d50 con 0x55d2811c59d0 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 1 -- 172.21.15.17:0/910508904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f9b7c036050 con 0x55d2811c59d0 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 10 client.10779 fetch_fsmap learned FSMap version 144 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 -- 172.21.15.17:0/910508904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55d280f6c050 con 0x55d2811c59d0 2024-09-10T23:29:28.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 1 -- 172.21.15.17:0/910508904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b7c014d50 con 0x55d2811c59d0 2024-09-10T23:29:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 1 -- 172.21.15.17:0/910508904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f9b7c039020 con 0x55d2811c59d0 2024-09-10T23:29:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 10 client.10779 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:29:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 10 client.10779 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:29:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 20 client.10779 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55d2811d3430 0x55d2811d3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 4 client.10779 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 -- 172.21.15.17:0/910508904 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "status"}) -- 0x55d280fd5520 con 0x55d2811d3430 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b93400640 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55d2811d3430 0x55d2811d3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b93400640 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55d2811d3430 0x55d2811d3810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cae638777574d9a8 server_cookie=32e3fe6de11a8d4c in_seq=0 out_seq=0 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 10 client.10779 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 1 -- 172.21.15.17:0/910508904 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55d280fd5520 con 0x55d2811d3430 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 10 client.10779 handle_command_reply: tid=0 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 client.10779 shutdown 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 -- 172.21.15.17:0/910508904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 msgr2=0x55d2812402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2812402e0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c022040 tx=0x7f9b7c0052f0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 -- 172.21.15.17:0/910508904 shutdown_connections 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d2811c62f0 0x55d281240820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d2811c59d0 0x55d2812402e0 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55d2811d3430 0x55d2811d3810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 --2- 172.21.15.17:0/910508904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d281179e10 0x55d28123fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 -- 172.21.15.17:0/910508904 >> 172.21.15.17:0/910508904 conn(0x55d281063130 msgr2=0x55d2811780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b80c00640 0 client.10779 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 -- 172.21.15.17:0/910508904 shutdown_connections 2024-09-10T23:29:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 1 -- 172.21.15.17:0/910508904 wait complete. 2024-09-10T23:29:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9dca0000 20 client.10779 trim_cache size 0 max 16384 2024-09-10T23:29:28.391 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:29:28.391 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 10641, 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.0171477529999997, 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 144, 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 189, 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 189, 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 11.257444529000001 2024-09-10T23:29:28.392 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:29:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 -- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b70072610 msgr2=0x7f9b70074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b70072610 0x7f9b70074ad0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c000fc0 tx=0x7f9b7c009040 comp rx=0 tx=0).stop 2024-09-10T23:29:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 -- 172.21.15.17:0/961249654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b940b1090 msgr2=0x7f9b940c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b940b1090 0x7f9b940c8d70 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f9b84000c10 tx=0x7f9b84005db0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 -- 172.21.15.17:0/961249654 shutdown_connections 2024-09-10T23:29:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b70072610 0x7f9b70074ad0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9b9415bfa0 0x7f9b9414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b940cfef0 0x7f9b94156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 --2- 172.21.15.17:0/961249654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b940b1090 0x7f9b940c8d70 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 -- 172.21.15.17:0/961249654 >> 172.21.15.17:0/961249654 conn(0x7f9b940d1ca0 msgr2=0x7f9b94157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 -- 172.21.15.17:0/961249654 shutdown_connections 2024-09-10T23:29:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.384+0000 7f9b9a800640 1 -- 172.21.15.17:0/961249654 wait complete. 2024-09-10T23:29:28.406 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:29:28.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.552+0000 7f997aa00640 1 -- 172.21.15.17:0/4090271690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9958004d50 msgr2=0x7f99580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.552+0000 7f997aa00640 1 --2- 172.21.15.17:0/4090271690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9958004d50 0x7f99580051d0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f996c009ee0 tx=0x7f996c01d5f0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.552+0000 7f9978a00640 1 -- 172.21.15.17:0/4090271690 reap_dead start 2024-09-10T23:29:28.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.552+0000 7f997aa00640 1 -- 172.21.15.17:0/4090271690 shutdown_connections 2024-09-10T23:29:28.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.552+0000 7f997aa00640 1 -- 172.21.15.17:0/4090271690 >> 172.21.15.17:0/4090271690 conn(0x7f99740d1d60 msgr2=0x7f99740d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:28.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.552+0000 7f997aa00640 1 -- 172.21.15.17:0/4090271690 shutdown_connections 2024-09-10T23:29:28.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.552+0000 7f997aa00640 1 -- 172.21.15.17:0/4090271690 wait complete. 2024-09-10T23:29:28.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f997aa00640 1 Processor -- start 2024-09-10T23:29:28.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f997aa00640 1 -- start start 2024-09-10T23:29:28.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f997aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9958004d50 0x7f99740b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f997aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99741531b0 0x7f99740caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f997aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99740c8f10 0x7f99740c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f997aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9974071030 con 0x7f99740c8f10 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f997aa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9974070eb0 con 0x7f9958004d50 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f997aa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f99740711b0 con 0x7f99741531b0 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9978a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99740c8f10 0x7f99740c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9978a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99740c8f10 0x7f99740c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43490/0 (socket says 172.21.15.17:43490) 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9978a00640 1 -- 172.21.15.17:0/1754781833 learned_addr learned my addr 172.21.15.17:0/1754781833 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9973e00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9958004d50 0x7f99740b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f996be00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99741531b0 0x7f99740caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9978a00640 1 -- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99741531b0 msgr2=0x7f99740caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9978a00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99741531b0 0x7f99740caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9978a00640 1 -- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9958004d50 msgr2=0x7f99740b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9978a00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9958004d50 0x7f99740b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9978a00640 1 -- 172.21.15.17:0/1754781833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99740b0fe0 con 0x7f99740c8f10 2024-09-10T23:29:28.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9978a00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99740c8f10 0x7f99740c9390 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f996c099120 tx=0x7f996c004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:28.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9970c00640 1 -- 172.21.15.17:0/1754781833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c0ad050 con 0x7f99740c8f10 2024-09-10T23:29:28.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9970c00640 1 -- 172.21.15.17:0/1754781833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f996c0a7a90 con 0x7f99740c8f10 2024-09-10T23:29:28.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f9970c00640 1 -- 172.21.15.17:0/1754781833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c009200 con 0x7f99740c8f10 2024-09-10T23:29:28.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.556+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99740cb6d0 con 0x7f99740c8f10 2024-09-10T23:29:28.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.560+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99740b1840 con 0x7f99740c8f10 2024-09-10T23:29:28.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.560+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99740713a0 con 0x7f99740c8f10 2024-09-10T23:29:28.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.560+0000 7f9970c00640 1 -- 172.21.15.17:0/1754781833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f996c003980 con 0x7f99740c8f10 2024-09-10T23:29:28.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.560+0000 7f9970c00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99500725e0 0x7f9950074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:28.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.560+0000 7f9970c00640 1 -- 172.21.15.17:0/1754781833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f996c12e390 con 0x7f99740c8f10 2024-09-10T23:29:28.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.560+0000 7f9973e00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99500725e0 0x7f9950074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:28.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.564+0000 7f9973e00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99500725e0 0x7f9950074aa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9964001cd0 tx=0x7f9964006730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:28.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.564+0000 7f9970c00640 1 -- 172.21.15.17:0/1754781833 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f996c017300 con 0x7f99740c8f10 2024-09-10T23:29:28.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.776+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f99740b75c0 con 0x7f99740c8f10 2024-09-10T23:29:28.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.776+0000 7f9970c00640 1 -- 172.21.15.17:0/1754781833 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v144) ==== 53+0+73 (secure 0 0 0) 0x7f996c0f91f0 con 0x7f99740c8f10 2024-09-10T23:29:28.778 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99500725e0 msgr2=0x7f9950074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99500725e0 0x7f9950074aa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9964001cd0 tx=0x7f9964006730 comp rx=0 tx=0).stop 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99740c8f10 msgr2=0x7f99740c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99740c8f10 0x7f99740c9390 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f996c099120 tx=0x7f996c004f10 comp rx=0 tx=0).stop 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 shutdown_connections 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f99500725e0 0x7f9950074aa0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99740c8f10 0x7f99740c9390 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f99741531b0 0x7f99740caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 --2- 172.21.15.17:0/1754781833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9958004d50 0x7f99740b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 >> 172.21.15.17:0/1754781833 conn(0x7f99740d1d60 msgr2=0x7f997415e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:28.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 shutdown_connections 2024-09-10T23:29:28.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:28.780+0000 7f997aa00640 1 -- 172.21.15.17:0/1754781833 wait complete. 2024-09-10T23:29:28.799 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:29:28.799 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:29:28.799 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:29:28.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:29:28.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:29:28.800 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:29:28.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:29:28.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:29:28.800 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:29:28.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:28.801 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:29:28.810 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41602sec preferred_lft 41602sec 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:29:28.811 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:29:28.812 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:29:28.813 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:29:28.813 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:29:28.813 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:29:28.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:28.814 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:29:28.876 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:29:28.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:28.879 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:29:28.932 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:29:28.933 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:29:28.933 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:29:28.933 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:29:28.933 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:29:28.933 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:29:28.933 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:29:28.933 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:29:28.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:29:28.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:29:28.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:29:28.934 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:29:29.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:29:29.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:29:29.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:29.072 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:29:29.081 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:29:29.081 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:29:29.082 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:29:29.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:29.082 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:29:29.146 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:29:29.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:29:29.147 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:29:29.199 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:29:29.199 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:29:29.199 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:29:29.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:29:29.312 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:29:29.364 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:29:29.365 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:29:29.366 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:29:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:29:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:29:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:29:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:29:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:29:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:29:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:29:29.367 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:29:29.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:29.368 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:29:29.419 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:29:29.419 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:29:29.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:29:29.491 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:29:29.544 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:29:29.544 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:29:29.545 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:29:29.545 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:29:29.545 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:29:29.545 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:29:29.545 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:29:29.545 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:29:29.545 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:29:29.545 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:29:29.545 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:29:29.546 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:29:29.547 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:29:29.548 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:29:29.548 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:29:29.548 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:29:29.548 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:29:29.548 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:29:29.548 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:29:29.548 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:29:29.548 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:29:29.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:29.549 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:29:29.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:29:29.564+0000 7ff0b00a8580 -1 init, newargv = 0x55d0aba61160 newargc=15 2024-09-10T23:29:29.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[86903]: starting ceph client 2024-09-10T23:29:29.574 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[86903]: starting fuse 2024-09-10T23:29:29.576 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:29:29.576 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:29:29.576 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:29:29.576 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:29:29.576 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:29:29.576 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:29:29.576 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:29:29.577 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:29:29.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:29:29.705 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.86903.asok 2024-09-10T23:29:29.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:29:29.716 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.86903.asok 2024-09-10T23:29:29.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:29.716 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.86903.asok status 2024-09-10T23:29:29.891 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:29:29.891 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:29:29.891 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "86903", 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 10791, 2024-09-10T23:29:29.892 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 10791 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 779083904 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:29:29.893 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 779083904 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.10791 192.168.0.1:0/779083904", 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/779083904", 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 144, 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 189, 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:29:29.894 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:29:29.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:29.907 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:29:29.907 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:29:29.916 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:29:29.916 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:29:29.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:29.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:29:29.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-10T23:29:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.172+0000 7fd435000640 1 -- 172.21.15.17:0/2003189061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43015f400 msgr2=0x7fd4300cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.172+0000 7fd435000640 1 --2- 172.21.15.17:0/2003189061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43015f400 0x7fd4300cfca0 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fd420009900 tx=0x7fd42001c880 comp rx=0 tx=0).stop 2024-09-10T23:29:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.172+0000 7fd435000640 1 -- 172.21.15.17:0/2003189061 shutdown_connections 2024-09-10T23:29:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.172+0000 7fd435000640 1 --2- 172.21.15.17:0/2003189061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4300b2540 0x7fd4300cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.172+0000 7fd435000640 1 --2- 172.21.15.17:0/2003189061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd43015f400 0x7fd4300cfca0 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.172+0000 7fd435000640 1 -- 172.21.15.17:0/2003189061 >> 172.21.15.17:0/2003189061 conn(0x7fd4300d1da0 msgr2=0x7fd4300d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.172+0000 7fd435000640 1 -- 172.21.15.17:0/2003189061 shutdown_connections 2024-09-10T23:29:30.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.172+0000 7fd435000640 1 -- 172.21.15.17:0/2003189061 wait complete. 2024-09-10T23:29:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 Processor -- start 2024-09-10T23:29:30.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 -- start start 2024-09-10T23:29:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4300b2540 0x7fd4300cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4300b31b0 0x7fd4300b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd43015f400 0x7fd430152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd430168c60 con 0x7fd4300b2540 2024-09-10T23:29:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4300cdbc0 con 0x7fd43015f400 2024-09-10T23:29:30.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd430168de0 con 0x7fd4300b31b0 2024-09-10T23:29:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4300b2540 0x7fd4300cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4300b2540 0x7fd4300cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43504/0 (socket says 172.21.15.17:43504) 2024-09-10T23:29:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42de00640 1 -- 172.21.15.17:0/640847453 learned_addr learned my addr 172.21.15.17:0/640847453 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd425400640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4300b31b0 0x7fd4300b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42e800640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd43015f400 0x7fd430152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42de00640 1 -- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4300b31b0 msgr2=0x7fd4300b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42de00640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4300b31b0 0x7fd4300b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42de00640 1 -- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd43015f400 msgr2=0x7fd430152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42de00640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd43015f400 0x7fd430152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42de00640 1 -- 172.21.15.17:0/640847453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4300cb200 con 0x7fd4300b2540 2024-09-10T23:29:30.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42e800640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd43015f400 0x7fd430152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd42de00640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4300b2540 0x7fd4300cac20 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fd420009850 tx=0x7fd4200a57b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd426a00640 1 -- 172.21.15.17:0/640847453 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4200b2040 con 0x7fd4300b2540 2024-09-10T23:29:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd426a00640 1 -- 172.21.15.17:0/640847453 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd420004430 con 0x7fd4300b2540 2024-09-10T23:29:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd426a00640 1 -- 172.21.15.17:0/640847453 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420005260 con 0x7fd4300b2540 2024-09-10T23:29:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 -- 172.21.15.17:0/640847453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4300cb4e0 con 0x7fd4300b2540 2024-09-10T23:29:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.176+0000 7fd435000640 1 -- 172.21.15.17:0/640847453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4300cbaa0 con 0x7fd4300b2540 2024-09-10T23:29:30.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd426a00640 1 -- 172.21.15.17:0/640847453 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd420005400 con 0x7fd4300b2540 2024-09-10T23:29:30.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd426a00640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd40c072610 0x7fd40c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd4384c4000 1 Processor -- start 2024-09-10T23:29:30.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd426a00640 1 -- 172.21.15.17:0/640847453 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fd42012cdf0 con 0x7fd4300b2540 2024-09-10T23:29:30.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd4384c4000 1 -- start start 2024-09-10T23:29:30.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd425400640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd40c072610 0x7fd40c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5aee310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aee850 0x557ab5aa13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd425400640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd40c072610 0x7fd40c074ad0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd43006feb0 tx=0x7fd418009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5aa1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd4384c4000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557ab598bd30 con 0x557ab5aedf30 2024-09-10T23:29:30.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd4384c4000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557ab58ffaf0 con 0x557ab5aa1920 2024-09-10T23:29:30.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.180+0000 7fd4384c4000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557ab58eef20 con 0x557ab5aee850 2024-09-10T23:29:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5aee310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5aee310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43520/0 (socket says 172.21.15.17:43520) 2024-09-10T23:29:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42de00640 1 -- 172.21.15.17:0/531573617 learned_addr learned my addr 172.21.15.17:0/531573617 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd425400640 1 --2- 172.21.15.17:0/531573617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aee850 0x557ab5aa13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42e800640 1 --2- 172.21.15.17:0/531573617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5aa1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42de00640 1 -- 172.21.15.17:0/531573617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aee850 msgr2=0x557ab5aa13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42de00640 1 --2- 172.21.15.17:0/531573617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aee850 0x557ab5aa13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42de00640 1 -- 172.21.15.17:0/531573617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 msgr2=0x557ab5aa1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42de00640 1 --2- 172.21.15.17:0/531573617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5aa1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42de00640 1 -- 172.21.15.17:0/531573617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab5870100 con 0x557ab5aedf30 2024-09-10T23:29:30.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42de00640 1 --2- 172.21.15.17:0/531573617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5aee310 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fd4200b0040 tx=0x7fd4200f7970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74d86a14850aa76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd41ea00640 1 -- 172.21.15.17:0/531573617 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4200f76b0 con 0x557ab5aedf30 2024-09-10T23:29:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd41ea00640 1 -- 172.21.15.17:0/531573617 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4200fc070 con 0x557ab5aedf30 2024-09-10T23:29:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd41ea00640 1 -- 172.21.15.17:0/531573617 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4200f7ba0 con 0x557ab5aedf30 2024-09-10T23:29:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 -- 172.21.15.17:0/531573617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 msgr2=0x557ab5aee310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 --2- 172.21.15.17:0/531573617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5aee310 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7fd4200b0040 tx=0x7fd4200f7970 comp rx=0 tx=0).stop 2024-09-10T23:29:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 -- 172.21.15.17:0/531573617 shutdown_connections 2024-09-10T23:29:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 --2- 172.21.15.17:0/531573617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5aa1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 --2- 172.21.15.17:0/531573617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aee850 0x557ab5aa13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 --2- 172.21.15.17:0/531573617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5aee310 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 -- 172.21.15.17:0/531573617 >> 172.21.15.17:0/531573617 conn(0x557ab5aceff0 msgr2=0x557ab5ad13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 -- 172.21.15.17:0/531573617 shutdown_connections 2024-09-10T23:29:30.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 -- 172.21.15.17:0/531573617 wait complete. 2024-09-10T23:29:30.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 -- start start 2024-09-10T23:29:30.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 Processor -- start 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5ad0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 0x557ab5ad0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5ad0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557ab58944e0 con 0x557ab5aee850 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557ab58f2d30 con 0x557ab5aa1920 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557ab55b4680 con 0x557ab5aedf30 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd4384c4000 10 client.0 _ll_register_callbacks cb 0x557ab5a8f0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.184+0000 7fd42e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5ad0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5ad0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43528/0 (socket says 172.21.15.17:43528) 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42e800640 1 -- 172.21.15.17:0/1884454008 learned_addr learned my addr 172.21.15.17:0/1884454008 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42de00640 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5ad0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd425400640 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 0x557ab5ad0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42e800640 1 -- 172.21.15.17:0/1884454008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 msgr2=0x557ab5ad0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42e800640 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 0x557ab5ad0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42e800640 1 -- 172.21.15.17:0/1884454008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 msgr2=0x557ab5ad0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42e800640 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5ad0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42e800640 1 -- 172.21.15.17:0/1884454008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ab58a3c40 con 0x557ab5aee850 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42de00640 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5ad0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42e800640 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5ad0ea0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fd42800bf20 tx=0x7fd4280117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee445339d66b2e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 1 -- 172.21.15.17:0/1884454008 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428012650 con 0x557ab5aee850 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 1 -- 172.21.15.17:0/1884454008 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fd42801cc70 con 0x557ab5aee850 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 -- 172.21.15.17:0/1884454008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ab5887310 con 0x557ab5aee850 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 1 -- 172.21.15.17:0/1884454008 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7fd4280127f0 con 0x557ab5aee850 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 10 client.10803 fetch_fsmap learned FSMap version 144 2024-09-10T23:29:30.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 -- 172.21.15.17:0/1884454008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x557ab58edbc0 con 0x557ab5aee850 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 1 -- 172.21.15.17:0/1884454008 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557ab5887310 con 0x557ab5aee850 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 1 -- 172.21.15.17:0/1884454008 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7fd428023050 con 0x557ab5aee850 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 10 client.10803 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 10 client.10803 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 20 client.10803 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x557ab5ad18b0 0x557ab5b001f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 4 client.10803 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 -- 172.21.15.17:0/1884454008 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ab5901a40 con 0x557ab5ad18b0 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42de00640 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x557ab5ad18b0 0x557ab5b001f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd42de00640 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x557ab5ad18b0 0x557ab5b001f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cee1ebe3691c47d server_cookie=ae7ecad4d27460c0 in_seq=0 out_seq=0 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 10 client.10803 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 1 -- 172.21.15.17:0/1884454008 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557ab5901a40 con 0x557ab5ad18b0 2024-09-10T23:29:30.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 10 client.10803 handle_command_reply: tid=0 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 client.10803 shutdown 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 -- 172.21.15.17:0/1884454008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 msgr2=0x557ab5ad0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5ad0ea0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fd42800bf20 tx=0x7fd4280117b0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 -- 172.21.15.17:0/1884454008 shutdown_connections 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5ad0ea0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 0x557ab5ad0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x557ab5ad18b0 0x557ab5b001f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 --2- 172.21.15.17:0/1884454008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5ad0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd413400640 0 client.10803 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 -- 172.21.15.17:0/1884454008 >> 172.21.15.17:0/1884454008 conn(0x557ab5aceff0 msgr2=0x557ab5aa0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 -- 172.21.15.17:0/1884454008 shutdown_connections 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 1 -- 172.21.15.17:0/1884454008 wait complete. 2024-09-10T23:29:30.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.188+0000 7fd4384c4000 20 client.10803 trim_cache size 0 max 16384 2024-09-10T23:29:30.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd4384c4000 1 Processor -- start 2024-09-10T23:29:30.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd4384c4000 1 -- start start 2024-09-10T23:29:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aa1920 0x557ab5b60330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5b60870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aee850 0x557ab5b60db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd4384c4000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd430204550 con 0x557ab5aedf30 2024-09-10T23:29:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd4384c4000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd430203620 con 0x557ab5aee850 2024-09-10T23:29:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd4384c4000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd43006ee90 con 0x557ab5aa1920 2024-09-10T23:29:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd425400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5b60870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd425400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5b60870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43534/0 (socket says 172.21.15.17:43534) 2024-09-10T23:29:30.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd425400640 1 -- 172.21.15.17:0/2835770418 learned_addr learned my addr 172.21.15.17:0/2835770418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd42de00640 1 --2- 172.21.15.17:0/2835770418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aa1920 0x557ab5b60330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd42e800640 1 --2- 172.21.15.17:0/2835770418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aee850 0x557ab5b60db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd425400640 1 -- 172.21.15.17:0/2835770418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aa1920 msgr2=0x557ab5b60330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd425400640 1 --2- 172.21.15.17:0/2835770418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aa1920 0x557ab5b60330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd425400640 1 -- 172.21.15.17:0/2835770418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aee850 msgr2=0x557ab5b60db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd425400640 1 --2- 172.21.15.17:0/2835770418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aee850 0x557ab5b60db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd425400640 1 -- 172.21.15.17:0/2835770418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ab588d1d0 con 0x557ab5aedf30 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd425400640 1 --2- 172.21.15.17:0/2835770418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5b60870 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fd418006be0 tx=0x7fd418012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac964462c870ea31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd41e000640 1 -- 172.21.15.17:0/2835770418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4180077c0 con 0x557ab5aedf30 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd41e000640 1 -- 172.21.15.17:0/2835770418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd418007a50 con 0x557ab5aedf30 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.204+0000 7fd41e000640 1 -- 172.21.15.17:0/2835770418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4180225f0 con 0x557ab5aedf30 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- 172.21.15.17:0/2835770418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 msgr2=0x557ab5b60870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 --2- 172.21.15.17:0/2835770418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5b60870 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fd418006be0 tx=0x7fd418012000 comp rx=0 tx=0).stop 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- 172.21.15.17:0/2835770418 shutdown_connections 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 --2- 172.21.15.17:0/2835770418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aee850 0x557ab5b60db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 --2- 172.21.15.17:0/2835770418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aedf30 0x557ab5b60870 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 --2- 172.21.15.17:0/2835770418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aa1920 0x557ab5b60330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- 172.21.15.17:0/2835770418 >> 172.21.15.17:0/2835770418 conn(0x557ab5aceff0 msgr2=0x557ab5a9fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- 172.21.15.17:0/2835770418 shutdown_connections 2024-09-10T23:29:30.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- 172.21.15.17:0/2835770418 wait complete. 2024-09-10T23:29:30.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- start start 2024-09-10T23:29:30.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 Processor -- start 2024-09-10T23:29:30.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5b64160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 0x557ab5b646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5b64be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557ab58b1690 con 0x557ab5aee850 2024-09-10T23:29:30.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557ab59aeff0 con 0x557ab5aa1920 2024-09-10T23:29:30.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557ab58f7360 con 0x557ab5aedf30 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 10 client.0 _ll_register_callbacks cb 0x7fd42800b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5b64be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5b64be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43548/0 (socket says 172.21.15.17:43548) 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42de00640 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5b64160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42e800640 1 -- 172.21.15.17:0/160624903 learned_addr learned my addr 172.21.15.17:0/160624903 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd425400640 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 0x557ab5b646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42e800640 1 -- 172.21.15.17:0/160624903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 msgr2=0x557ab5b646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42e800640 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 0x557ab5b646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42e800640 1 -- 172.21.15.17:0/160624903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 msgr2=0x557ab5b64160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42e800640 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5b64160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42e800640 1 -- 172.21.15.17:0/160624903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ab58b5970 con 0x557ab5aee850 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd42e800640 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5b64be0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fd428000c10 tx=0x7fd42800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6455959ecc4f0a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd413400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd413400640 1 -- 172.21.15.17:0/160624903 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428005220 con 0x557ab5aee850 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd413400640 1 -- 172.21.15.17:0/160624903 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fd428011cb0 con 0x557ab5aee850 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- 172.21.15.17:0/160624903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ab58fd4f0 con 0x557ab5aee850 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd413400640 1 -- 172.21.15.17:0/160624903 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7fd428036050 con 0x557ab5aee850 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 10 client.10809 fetch_fsmap learned FSMap version 144 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.208+0000 7fd4384c4000 1 -- 172.21.15.17:0/160624903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x557ab5885560 con 0x557ab5aee850 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd413400640 1 -- 172.21.15.17:0/160624903 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557ab58fd4f0 con 0x557ab5aee850 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd413400640 1 -- 172.21.15.17:0/160624903 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7fd428039020 con 0x557ab5aee850 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 10 client.10809 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 10 client.10809 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 20 client.10809 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x557ab5b025f0 0x557ab5b02a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 4 client.10809 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 -- 172.21.15.17:0/160624903 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ab58fa920 con 0x557ab5b025f0 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd42de00640 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x557ab5b025f0 0x557ab5b02a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd42de00640 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x557ab5b025f0 0x557ab5b02a00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa00d674b22a82b server_cookie=e3f20a423f3a7907 in_seq=0 out_seq=0 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd413400640 10 client.10809 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd413400640 1 -- 172.21.15.17:0/160624903 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ab58fa920 con 0x557ab5b025f0 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd413400640 10 client.10809 handle_command_reply: tid=0 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 client.10809 shutdown 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 -- 172.21.15.17:0/160624903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 msgr2=0x557ab5b64be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5b64be0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fd428000c10 tx=0x7fd42800bbb0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 -- 172.21.15.17:0/160624903 shutdown_connections 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557ab5aee850 0x557ab5b64be0 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557ab5aedf30 0x557ab5b646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x557ab5b025f0 0x557ab5b02a00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 --2- 172.21.15.17:0/160624903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557ab5aa1920 0x557ab5b64160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 -- 172.21.15.17:0/160624903 >> 172.21.15.17:0/160624903 conn(0x557ab5aceff0 msgr2=0x557ab5aa03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd413400640 0 client.10809 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 -- 172.21.15.17:0/160624903 shutdown_connections 2024-09-10T23:29:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 1 -- 172.21.15.17:0/160624903 wait complete. 2024-09-10T23:29:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd4384c4000 20 client.10809 trim_cache size 0 max 16384 2024-09-10T23:29:30.217 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T23:29:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 -- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd40c072610 msgr2=0x7fd40c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd40c072610 0x7fd40c074ad0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd43006feb0 tx=0x7fd418009040 comp rx=0 tx=0).stop 2024-09-10T23:29:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 -- 172.21.15.17:0/640847453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4300b2540 msgr2=0x7fd4300cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4300b2540 0x7fd4300cac20 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fd420009850 tx=0x7fd4200a57b0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 -- 172.21.15.17:0/640847453 shutdown_connections 2024-09-10T23:29:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd40c072610 0x7fd40c074ad0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd43015f400 0x7fd430152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4300b31b0 0x7fd4300b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 --2- 172.21.15.17:0/640847453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4300b2540 0x7fd4300cac20 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 -- 172.21.15.17:0/640847453 >> 172.21.15.17:0/640847453 conn(0x7fd4300d1da0 msgr2=0x7fd430157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 -- 172.21.15.17:0/640847453 shutdown_connections 2024-09-10T23:29:30.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.212+0000 7fd435000640 1 -- 172.21.15.17:0/640847453 wait complete. 2024-09-10T23:29:30.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T23:29:30.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.380+0000 7f6225400640 1 -- 172.21.15.17:0/2515203180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62200d20a0 msgr2=0x7f6220166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.380+0000 7f6225400640 1 --2- 172.21.15.17:0/2515203180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62200d20a0 0x7f6220166710 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6218009bc0 tx=0x7f621801cba0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.380+0000 7f6225400640 1 -- 172.21.15.17:0/2515203180 shutdown_connections 2024-09-10T23:29:30.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.380+0000 7f6225400640 1 --2- 172.21.15.17:0/2515203180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62200d20a0 0x7f6220166710 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.380+0000 7f6225400640 1 -- 172.21.15.17:0/2515203180 >> 172.21.15.17:0/2515203180 conn(0x7f622009a9f0 msgr2=0x7f622009add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.380+0000 7f6225400640 1 -- 172.21.15.17:0/2515203180 shutdown_connections 2024-09-10T23:29:30.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.380+0000 7f6225400640 1 -- 172.21.15.17:0/2515203180 wait complete. 2024-09-10T23:29:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 Processor -- start 2024-09-10T23:29:30.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 -- start start 2024-09-10T23:29:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62200cfa20 0x7f6220159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62200d20a0 0x7f62200ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f622015bc70 0x7f62200ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6220169be0 con 0x7f62200d20a0 2024-09-10T23:29:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6220169a60 con 0x7f622015bc70 2024-09-10T23:29:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6220169d60 con 0x7f62200cfa20 2024-09-10T23:29:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62200d20a0 0x7f62200ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62200cfa20 0x7f6220159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62200d20a0 0x7f62200ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43552/0 (socket says 172.21.15.17:43552) 2024-09-10T23:29:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621f400640 1 -- 172.21.15.17:0/3599698472 learned_addr learned my addr 172.21.15.17:0/3599698472 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6224a00640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f622015bc70 0x7f62200ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621f400640 1 -- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62200cfa20 msgr2=0x7f6220159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621f400640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62200cfa20 0x7f6220159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621f400640 1 -- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f622015bc70 msgr2=0x7f62200ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621f400640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f622015bc70 0x7f62200ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621f400640 1 -- 172.21.15.17:0/3599698472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62200b6e60 con 0x7f62200d20a0 2024-09-10T23:29:30.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f621f400640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62200d20a0 0x7f62200ce0b0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c500 tx=0x7f620c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6217e00640 1 -- 172.21.15.17:0/3599698472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c017070 con 0x7f62200d20a0 2024-09-10T23:29:30.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6217e00640 1 -- 172.21.15.17:0/3599698472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f620c0053c0 con 0x7f62200d20a0 2024-09-10T23:29:30.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62200b7100 con 0x7f62200d20a0 2024-09-10T23:29:30.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6217e00640 1 -- 172.21.15.17:0/3599698472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c012890 con 0x7f62200d20a0 2024-09-10T23:29:30.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.384+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62200b76c0 con 0x7f62200d20a0 2024-09-10T23:29:30.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.388+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62200d1990 con 0x7f62200d20a0 2024-09-10T23:29:30.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.388+0000 7f6217e00640 1 -- 172.21.15.17:0/3599698472 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f620c003600 con 0x7f62200d20a0 2024-09-10T23:29:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.388+0000 7f6217e00640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62000725e0 0x7f6200074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.388+0000 7f6217e00640 1 -- 172.21.15.17:0/3599698472 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f620c0929b0 con 0x7f62200d20a0 2024-09-10T23:29:30.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.388+0000 7f621fe00640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62000725e0 0x7f6200074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.392+0000 7f621fe00640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62000725e0 0x7f6200074aa0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f62200b5ac0 tx=0x7f62100013c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.392+0000 7f6217e00640 1 -- 172.21.15.17:0/3599698472 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f620c05d820 con 0x7f62200d20a0 2024-09-10T23:29:30.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.604+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f62200754e0 con 0x7f62200d20a0 2024-09-10T23:29:30.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.604+0000 7f6217e00640 1 -- 172.21.15.17:0/3599698472 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f620c062250 con 0x7f62200d20a0 2024-09-10T23:29:30.606 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:29:30.606 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T23:29:30.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62000725e0 msgr2=0x7f6200074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62000725e0 0x7f6200074aa0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f62200b5ac0 tx=0x7f62100013c0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62200d20a0 msgr2=0x7f62200ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62200d20a0 0x7f62200ce0b0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c500 tx=0x7f620c00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 shutdown_connections 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62000725e0 0x7f6200074aa0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f622015bc70 0x7f62200ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62200d20a0 0x7f62200ce0b0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 --2- 172.21.15.17:0/3599698472 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62200cfa20 0x7f6220159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 >> 172.21.15.17:0/3599698472 conn(0x7f622009a9f0 msgr2=0x7f62201661e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 shutdown_connections 2024-09-10T23:29:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.608+0000 7f6225400640 1 -- 172.21.15.17:0/3599698472 wait complete. 2024-09-10T23:29:30.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:30.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-09-10T23:29:30.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 -- 172.21.15.17:0/2284399556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8005220 msgr2=0x7f5ab800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 --2- 172.21.15.17:0/2284399556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8005220 0x7f5ab800b9d0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c5c0 tx=0x7f5acc01d2c0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 -- 172.21.15.17:0/2284399556 shutdown_connections 2024-09-10T23:29:30.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 --2- 172.21.15.17:0/2284399556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8005220 0x7f5ab800b9d0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 -- 172.21.15.17:0/2284399556 >> 172.21.15.17:0/2284399556 conn(0x7f5ad40b17a0 msgr2=0x7f5ad40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 -- 172.21.15.17:0/2284399556 shutdown_connections 2024-09-10T23:29:30.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 -- 172.21.15.17:0/2284399556 wait complete. 2024-09-10T23:29:30.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 Processor -- start 2024-09-10T23:29:30.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 -- start start 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab8005220 0x7f5ad4150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad4153830 0x7f5ad4153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad41511d0 0x7f5ad4151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad4070420 con 0x7f5ad41511d0 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad40702a0 con 0x7f5ab8005220 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5adae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad4072690 con 0x7f5ad4153830 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5ad8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad41511d0 0x7f5ad4151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5ad8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad41511d0 0x7f5ad4151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43568/0 (socket says 172.21.15.17:43568) 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5ad8e00640 1 -- 172.21.15.17:0/524702403 learned_addr learned my addr 172.21.15.17:0/524702403 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab8005220 0x7f5ad4150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.780+0000 7f5acb400640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad4153830 0x7f5ad4153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad8e00640 1 -- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad4153830 msgr2=0x7f5ad4153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad4153830 0x7f5ad4153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad8e00640 1 -- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab8005220 msgr2=0x7f5ad4150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab8005220 0x7f5ad4150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad8e00640 1 -- 172.21.15.17:0/524702403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad40cc100 con 0x7f5ad41511d0 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab8005220 0x7f5ad4150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad41511d0 0x7f5ad4151650 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f5acc01b9c0 tx=0x7f5acc002000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad0c00640 1 -- 172.21.15.17:0/524702403 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc003d90 con 0x7f5ad41511d0 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad0c00640 1 -- 172.21.15.17:0/524702403 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5acc006070 con 0x7f5ad41511d0 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad0c00640 1 -- 172.21.15.17:0/524702403 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0064c0 con 0x7f5ad41511d0 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5adae00640 1 -- 172.21.15.17:0/524702403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad40cbe20 con 0x7f5ad41511d0 2024-09-10T23:29:30.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5adae00640 1 -- 172.21.15.17:0/524702403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad41e8020 con 0x7f5ad41511d0 2024-09-10T23:29:30.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad0c00640 1 -- 172.21.15.17:0/524702403 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5acc006660 con 0x7f5ad41511d0 2024-09-10T23:29:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad0c00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ab0072610 0x7f5ab0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.784+0000 7f5ad0c00640 1 -- 172.21.15.17:0/524702403 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f5acc12d690 con 0x7f5ad41511d0 2024-09-10T23:29:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 Processor -- start 2024-09-10T23:29:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- start start 2024-09-10T23:29:30.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ab0072610 0x7f5ab0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ab0072610 0x7f5ab0074ad0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009be0 tx=0x7f5ac40091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b77755fe80 0x55b777560260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b7775607a0 0x55b777516750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b777517070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b77736da40 con 0x55b77755fe80 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b77735ce70 con 0x55b777516c90 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b777360c80 con 0x55b7775607a0 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b77755fe80 0x55b777560260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b77755fe80 0x55b777560260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43584/0 (socket says 172.21.15.17:43584) 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 -- 172.21.15.17:0/2309585482 learned_addr learned my addr 172.21.15.17:0/2309585482 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 -- 172.21.15.17:0/2309585482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b7775607a0 msgr2=0x55b777516750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/2309585482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b7775607a0 0x55b777516750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 -- 172.21.15.17:0/2309585482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 msgr2=0x55b777517070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/2309585482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b777517070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/2309585482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b777517070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 -- 172.21.15.17:0/2309585482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7773a6040 con 0x55b77755fe80 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/2309585482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b777517070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:30.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/2309585482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b77755fe80 0x55b777560260 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4004090 tx=0x7f5ac4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7beb61ff4531d9b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ac8c00640 1 -- 172.21.15.17:0/2309585482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4003b80 con 0x55b77755fe80 2024-09-10T23:29:30.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ac8c00640 1 -- 172.21.15.17:0/2309585482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ac4003d20 con 0x55b77755fe80 2024-09-10T23:29:30.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ac8c00640 1 -- 172.21.15.17:0/2309585482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4029680 con 0x55b77755fe80 2024-09-10T23:29:30.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2309585482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b77755fe80 msgr2=0x55b777560260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/2309585482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b77755fe80 0x55b777560260 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4004090 tx=0x7f5ac4017000 comp rx=0 tx=0).stop 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2309585482 shutdown_connections 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/2309585482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b777517070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/2309585482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b7775607a0 0x55b777516750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/2309585482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b77755fe80 0x55b777560260 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2309585482 >> 172.21.15.17:0/2309585482 conn(0x55b77750e800 msgr2=0x55b777510c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2309585482 shutdown_connections 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2309585482 wait complete. 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 -- start start 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.788+0000 7f5ade1b9000 1 Processor -- start 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b777516c90 0x55b77754a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b77754ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7775607a0 0x55b77754b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b7773a0b60 con 0x55b777516c90 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b777306950 con 0x55b7775607a0 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b777312bb0 con 0x55b77755fe80 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 10 client.0 _ll_register_callbacks cb 0x55b7773033f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ad3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b777516c90 0x55b77754a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5acb400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b77754ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5acb400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b77754ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:51470/0 (socket says 172.21.15.17:51470) 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5acb400640 1 -- 172.21.15.17:0/3763186943 learned_addr learned my addr 172.21.15.17:0/3763186943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ad3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b777516c90 0x55b77754a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43592/0 (socket says 172.21.15.17:43592) 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7775607a0 0x55b77754b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ad3e00640 1 -- 172.21.15.17:0/3763186943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 msgr2=0x55b77754ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b77754ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ad3e00640 1 -- 172.21.15.17:0/3763186943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7775607a0 msgr2=0x55b77754b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7775607a0 0x55b77754b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ad3e00640 1 -- 172.21.15.17:0/3763186943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b777305b30 con 0x55b777516c90 2024-09-10T23:29:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b777516c90 0x55b77754a5d0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4028000 tx=0x7f5ac4012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e7329ac3bc6786 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ac1600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ac1600640 1 -- 172.21.15.17:0/3763186943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac402aaa0 con 0x55b777516c90 2024-09-10T23:29:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ac1600640 1 -- 172.21.15.17:0/3763186943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f5ac4034c80 con 0x55b777516c90 2024-09-10T23:29:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 -- 172.21.15.17:0/3763186943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7772f51e0 con 0x55b777516c90 2024-09-10T23:29:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ac1600640 1 -- 172.21.15.17:0/3763186943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f5ac402ac40 con 0x55b777516c90 2024-09-10T23:29:30.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 10 client.10827 fetch_fsmap learned FSMap version 144 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 -- 172.21.15.17:0/3763186943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55b7772fb0a0 con 0x55b777516c90 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ac1600640 1 -- 172.21.15.17:0/3763186943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b7772f51e0 con 0x55b777516c90 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ac1600640 1 -- 172.21.15.17:0/3763186943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f5ac403e080 con 0x55b777516c90 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 10 client.10827 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 10 client.10827 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 20 client.10827 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55b77756f120 0x55b777571510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 4 client.10827 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ade1b9000 1 -- 172.21.15.17:0/3763186943 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b77736f990 con 0x55b77756f120 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5acb400640 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55b77756f120 0x55b777571510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5acb400640 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55b77756f120 0x55b777571510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b039311b34abc4c1 server_cookie=ac6be0278ae5bff8 in_seq=0 out_seq=0 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.792+0000 7f5ac1600640 10 client.10827 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:30.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ac1600640 1 -- 172.21.15.17:0/3763186943 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b77736f990 con 0x55b77756f120 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ac1600640 10 client.10827 handle_command_reply: tid=0 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 client.10827 shutdown 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 -- 172.21.15.17:0/3763186943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b777516c90 msgr2=0x55b77754a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b777516c90 0x55b77754a5d0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4028000 tx=0x7f5ac4012d00 comp rx=0 tx=0).stop 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 -- 172.21.15.17:0/3763186943 shutdown_connections 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55b77756f120 0x55b777571510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b7775607a0 0x55b77754b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b77754ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/3763186943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b777516c90 0x55b77754a5d0 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 -- 172.21.15.17:0/3763186943 >> 172.21.15.17:0/3763186943 conn(0x55b77750e800 msgr2=0x55b777517890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ac1600640 0 client.10827 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 -- 172.21.15.17:0/3763186943 shutdown_connections 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 1 -- 172.21.15.17:0/3763186943 wait complete. 2024-09-10T23:29:30.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.796+0000 7f5ade1b9000 20 client.10827 trim_cache size 0 max 16384 2024-09-10T23:29:30.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.812+0000 7f5ade1b9000 1 Processor -- start 2024-09-10T23:29:30.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.812+0000 7f5ade1b9000 1 -- start start 2024-09-10T23:29:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.812+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b7775d1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b7775d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b7775d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad40cef30 con 0x55b7775607a0 2024-09-10T23:29:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad40ce290 con 0x55b777516c90 2024-09-10T23:29:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad40ce8e0 con 0x55b77755fe80 2024-09-10T23:29:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b7775d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b7775d2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43608/0 (socket says 172.21.15.17:43608) 2024-09-10T23:29:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 -- 172.21.15.17:0/2068843930 learned_addr learned my addr 172.21.15.17:0/2068843930 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5acb400640 1 --2- 172.21.15.17:0/2068843930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b7775d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/2068843930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b7775d1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 -- 172.21.15.17:0/2068843930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 msgr2=0x55b7775d23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/2068843930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b7775d23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 -- 172.21.15.17:0/2068843930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 msgr2=0x55b7775d1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/2068843930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b7775d1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 -- 172.21.15.17:0/2068843930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7773e1dc0 con 0x55b7775607a0 2024-09-10T23:29:30.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/2068843930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b7775d2910 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0f8140 tx=0x7f5acc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d346a1b8385b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ac3e00640 1 -- 172.21.15.17:0/2068843930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0be040 con 0x55b7775607a0 2024-09-10T23:29:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ac3e00640 1 -- 172.21.15.17:0/2068843930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5acc0f7f50 con 0x55b7775607a0 2024-09-10T23:29:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ac3e00640 1 -- 172.21.15.17:0/2068843930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0f8b40 con 0x55b7775607a0 2024-09-10T23:29:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2068843930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 msgr2=0x55b7775d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/2068843930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b7775d2910 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0f8140 tx=0x7f5acc00c3a0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2068843930 shutdown_connections 2024-09-10T23:29:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/2068843930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b7775d2910 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/2068843930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b7775d23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/2068843930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b7775d1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2068843930 >> 172.21.15.17:0/2068843930 conn(0x55b77750e800 msgr2=0x55b777510bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2068843930 shutdown_connections 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- 172.21.15.17:0/2068843930 wait complete. 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- start start 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 Processor -- start 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b777573cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b7775741f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b777574730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b777328f40 con 0x55b7775607a0 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b777328760 con 0x55b777516c90 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b77735ff90 con 0x55b77755fe80 2024-09-10T23:29:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ade1b9000 10 client.0 _ll_register_callbacks cb 0x7f5ac4012f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:30.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b777574730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b777574730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43622/0 (socket says 172.21.15.17:43622) 2024-09-10T23:29:30.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad8e00640 1 -- 172.21.15.17:0/1547077848 learned_addr learned my addr 172.21.15.17:0/1547077848 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5acb400640 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b7775741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.816+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b777573cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ad8e00640 1 -- 172.21.15.17:0/1547077848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 msgr2=0x55b7775741f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b7775741f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ad8e00640 1 -- 172.21.15.17:0/1547077848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 msgr2=0x55b777573cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b777573cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ad8e00640 1 -- 172.21.15.17:0/1547077848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7772f3620 con 0x55b7775607a0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ad8e00640 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b777574730 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f5acc002170 tx=0x7f5acc12bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe544014a14385e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 1 -- 172.21.15.17:0/1547077848 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0be070 con 0x55b7775607a0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 1 -- 172.21.15.17:0/1547077848 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f5acc0f76a0 con 0x55b7775607a0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 -- 172.21.15.17:0/1547077848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5acc0f7f50 con 0x55b7775607a0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 1 -- 172.21.15.17:0/1547077848 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f5acc101280 con 0x55b7775607a0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 10 client.10833 fetch_fsmap learned FSMap version 144 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 -- 172.21.15.17:0/1547077848 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55b777325af0 con 0x55b7775607a0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 1 -- 172.21.15.17:0/1547077848 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5acc0f7f50 con 0x55b7775607a0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 1 -- 172.21.15.17:0/1547077848 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f5acc124b30 con 0x55b7775607a0 2024-09-10T23:29:30.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 10 client.10833 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 10 client.10833 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 20 client.10833 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55b777574c70 0x55b777575080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 4 client.10833 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 -- 172.21.15.17:0/1547077848 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55b77736b440 con 0x55b777574c70 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55b777574c70 0x55b777575080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ad3e00640 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55b777574c70 0x55b777575080 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=798fbb35305a42e7 server_cookie=3e36b62a7b092ae6 in_seq=0 out_seq=0 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 10 client.10833 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 1 -- 172.21.15.17:0/1547077848 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b77736b440 con 0x55b777574c70 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 10 client.10833 handle_command_reply: tid=0 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 client.10833 shutdown 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 -- 172.21.15.17:0/1547077848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 msgr2=0x55b777574730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b777574730 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f5acc002170 tx=0x7f5acc12bcb0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 -- 172.21.15.17:0/1547077848 shutdown_connections 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7775607a0 0x55b777574730 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b77755fe80 0x55b7775741f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55b777574c70 0x55b777575080 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 --2- 172.21.15.17:0/1547077848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b777516c90 0x55b777573cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ac1600640 0 client.10833 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 -- 172.21.15.17:0/1547077848 >> 172.21.15.17:0/1547077848 conn(0x55b77750e800 msgr2=0x55b777511410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 -- 172.21.15.17:0/1547077848 shutdown_connections 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 1 -- 172.21.15.17:0/1547077848 wait complete. 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5ade1b9000 20 client.10833 trim_cache size 0 max 16384 2024-09-10T23:29:30.826 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:29:30.827 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:29:30.827 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "83cbf824-639d-45f0-82e6-bf6d3cb50fbc", 2024-09-10T23:29:30.827 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:29:30.827 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:29:30.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 -- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ab0072610 msgr2=0x7f5ab0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ab0072610 0x7f5ab0074ad0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009be0 tx=0x7f5ac40091e0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 -- 172.21.15.17:0/524702403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad41511d0 msgr2=0x7f5ad4151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad41511d0 0x7f5ad4151650 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f5acc01b9c0 tx=0x7f5acc002000 comp rx=0 tx=0).stop 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 -- 172.21.15.17:0/524702403 shutdown_connections 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ab0072610 0x7f5ab0074ad0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ad41511d0 0x7f5ad4151650 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ad4153830 0x7f5ad4153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 --2- 172.21.15.17:0/524702403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab8005220 0x7f5ad4150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.820+0000 7f5adae00640 1 -- 172.21.15.17:0/524702403 >> 172.21.15.17:0/524702403 conn(0x7f5ad40b17a0 msgr2=0x7f5ad406ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.824+0000 7f5adae00640 1 -- 172.21.15.17:0/524702403 shutdown_connections 2024-09-10T23:29:30.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.824+0000 7f5adae00640 1 -- 172.21.15.17:0/524702403 wait complete. 2024-09-10T23:29:30.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:29:30.843 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-10T23:29:30.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 -- 172.21.15.17:0/1274317980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe2815f3e0 msgr2=0x7efe28069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 --2- 172.21.15.17:0/1274317980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe2815f3e0 0x7efe28069450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe280b5d60 tx=0x7efe1801c780 comp rx=0 tx=0).stop 2024-09-10T23:29:30.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 -- 172.21.15.17:0/1274317980 shutdown_connections 2024-09-10T23:29:30.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 --2- 172.21.15.17:0/1274317980 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe2815f3e0 0x7efe28069450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 -- 172.21.15.17:0/1274317980 >> 172.21.15.17:0/1274317980 conn(0x7efe28074210 msgr2=0x7efe280745f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:30.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 -- 172.21.15.17:0/1274317980 shutdown_connections 2024-09-10T23:29:30.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 -- 172.21.15.17:0/1274317980 wait complete. 2024-09-10T23:29:30.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 Processor -- start 2024-09-10T23:29:30.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 -- start start 2024-09-10T23:29:30.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe280d09f0 0x7efe2814ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe280d0ef0 0x7efe28159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe2815f3e0 0x7efe2814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:30.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe2816a570 con 0x7efe280d09f0 2024-09-10T23:29:30.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe280b1580 con 0x7efe280d0ef0 2024-09-10T23:29:30.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe2e400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efe2816a6f0 con 0x7efe2815f3e0 2024-09-10T23:29:30.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe27400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe280d09f0 0x7efe2814ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe27400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe280d09f0 0x7efe2814ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43636/0 (socket says 172.21.15.17:43636) 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.992+0000 7efe27400640 1 -- 172.21.15.17:0/2793383784 learned_addr learned my addr 172.21.15.17:0/2793383784 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe1fe00640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe280d0ef0 0x7efe28159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe27e00640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe2815f3e0 0x7efe2814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe27400640 1 -- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe2815f3e0 msgr2=0x7efe2814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe27400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe2815f3e0 0x7efe2814ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe27400640 1 -- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe280d0ef0 msgr2=0x7efe28159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe27400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe280d0ef0 0x7efe28159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe27400640 1 -- 172.21.15.17:0/2793383784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe281593c0 con 0x7efe280d09f0 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe27e00640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe2815f3e0 0x7efe2814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe27400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe280d09f0 0x7efe2814ac00 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7efe18000c10 tx=0x7efe18005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe1f400640 1 -- 172.21.15.17:0/2793383784 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe180bb070 con 0x7efe280d09f0 2024-09-10T23:29:30.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe1f400640 1 -- 172.21.15.17:0/2793383784 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe18004330 con 0x7efe280d09f0 2024-09-10T23:29:30.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe1f400640 1 -- 172.21.15.17:0/2793383784 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe180b2040 con 0x7efe280d09f0 2024-09-10T23:29:30.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe2e400640 1 -- 172.21.15.17:0/2793383784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe281596a0 con 0x7efe280d09f0 2024-09-10T23:29:30.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe2e400640 1 -- 172.21.15.17:0/2793383784 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2814cf60 con 0x7efe280d09f0 2024-09-10T23:29:30.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:30.996+0000 7efe1f400640 1 -- 172.21.15.17:0/2793383784 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efe180b5030 con 0x7efe280d09f0 2024-09-10T23:29:31.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe1f400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe040725e0 0x7efe04074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe1f400640 1 -- 172.21.15.17:0/2793383784 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7efe1812ca10 con 0x7efe280d09f0 2024-09-10T23:29:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe31892000 1 Processor -- start 2024-09-10T23:29:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe1fe00640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe040725e0 0x7efe04074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe31892000 1 -- start start 2024-09-10T23:29:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe1fe00640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe040725e0 0x7efe04074aa0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7efe10007a60 tx=0x7efe10009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe31892000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8a1a0 0x562e22c8a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe31892000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 0x562e22c40680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe31892000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c40bc0 0x562e22c40fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe31892000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562e22b28cb0 con 0x562e22c40bc0 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe31892000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562e22a3e310 con 0x562e22c8aac0 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe31892000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562e22a9bb90 con 0x562e22c8a1a0 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c40bc0 0x562e22c40fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c40bc0 0x562e22c40fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43642/0 (socket says 172.21.15.17:43642) 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27e00640 1 -- 172.21.15.17:0/97216991 learned_addr learned my addr 172.21.15.17:0/97216991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8a1a0 0x562e22c8a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe1fe00640 1 --2- 172.21.15.17:0/97216991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 0x562e22c40680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27e00640 1 -- 172.21.15.17:0/97216991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8a1a0 msgr2=0x562e22c8a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27e00640 1 --2- 172.21.15.17:0/97216991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8a1a0 0x562e22c8a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27e00640 1 -- 172.21.15.17:0/97216991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 msgr2=0x562e22c40680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:31.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27e00640 1 --2- 172.21.15.17:0/97216991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 0x562e22c40680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27e00640 1 -- 172.21.15.17:0/97216991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e22a3fc60 con 0x562e22c40bc0 2024-09-10T23:29:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27400640 1 --2- 172.21.15.17:0/97216991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8a1a0 0x562e22c8a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:31.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe27e00640 1 --2- 172.21.15.17:0/97216991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c40bc0 0x562e22c40fa0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7efe20001cc0 tx=0x7efe20002180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87ce663be028f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe17e00640 1 -- 172.21.15.17:0/97216991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20019070 con 0x562e22c40bc0 2024-09-10T23:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe17e00640 1 -- 172.21.15.17:0/97216991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe20003c80 con 0x562e22c40bc0 2024-09-10T23:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.000+0000 7efe17e00640 1 -- 172.21.15.17:0/97216991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2000eb00 con 0x562e22c40bc0 2024-09-10T23:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- 172.21.15.17:0/97216991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c40bc0 msgr2=0x562e22c40fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 --2- 172.21.15.17:0/97216991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c40bc0 0x562e22c40fa0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7efe20001cc0 tx=0x7efe20002180 comp rx=0 tx=0).stop 2024-09-10T23:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- 172.21.15.17:0/97216991 shutdown_connections 2024-09-10T23:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 --2- 172.21.15.17:0/97216991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c40bc0 0x562e22c40fa0 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 --2- 172.21.15.17:0/97216991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 0x562e22c40680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 --2- 172.21.15.17:0/97216991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8a1a0 0x562e22c8a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- 172.21.15.17:0/97216991 >> 172.21.15.17:0/97216991 conn(0x562e22c46d20 msgr2=0x562e22c3ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- 172.21.15.17:0/97216991 shutdown_connections 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- 172.21.15.17:0/97216991 wait complete. 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- start start 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 Processor -- start 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c40bc0 0x562e22c91530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c91a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 0x562e22c91fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562e22a8edd0 con 0x562e22c8a1a0 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562e22a8afc0 con 0x562e22c8aac0 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562e22a304b0 con 0x562e22c40bc0 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 10 client.0 _ll_register_callbacks cb 0x562e22a0e7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c91a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c91a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43658/0 (socket says 172.21.15.17:43658) 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe1fe00640 1 -- 172.21.15.17:0/2783516777 learned_addr learned my addr 172.21.15.17:0/2783516777 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe27400640 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c40bc0 0x562e22c91530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe27e00640 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 0x562e22c91fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe1fe00640 1 -- 172.21.15.17:0/2783516777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c40bc0 msgr2=0x562e22c91530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe1fe00640 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c40bc0 0x562e22c91530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe1fe00640 1 -- 172.21.15.17:0/2783516777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 msgr2=0x562e22c91fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe1fe00640 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 0x562e22c91fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe1fe00640 1 -- 172.21.15.17:0/2783516777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e22a291f0 con 0x562e22c8a1a0 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe1fe00640 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c91a70 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7efe2806e2d0 tx=0x7efe10004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f10640f5dfc01c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe14c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe14c00640 1 -- 172.21.15.17:0/2783516777 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe10025020 con 0x562e22c8a1a0 2024-09-10T23:29:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe14c00640 1 -- 172.21.15.17:0/2783516777 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7efe10010040 con 0x562e22c8a1a0 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- 172.21.15.17:0/2783516777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e22a23330 con 0x562e22c8a1a0 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe14c00640 1 -- 172.21.15.17:0/2783516777 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7efe1002f050 con 0x562e22c8a1a0 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 10 client.10845 fetch_fsmap learned FSMap version 144 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- 172.21.15.17:0/2783516777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x562e22a0ffa0 con 0x562e22c8a1a0 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe14c00640 1 -- 172.21.15.17:0/2783516777 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562e22a23330 con 0x562e22c8a1a0 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe14c00640 1 -- 172.21.15.17:0/2783516777 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7efe10032020 con 0x562e22c8a1a0 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 10 client.10845 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 10 client.10845 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 20 client.10845 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x562e22c99900 0x562e22c9bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 4 client.10845 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.004+0000 7efe31892000 1 -- 172.21.15.17:0/2783516777 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e22a9dae0 con 0x562e22c99900 2024-09-10T23:29:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe27400640 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x562e22c99900 0x562e22c9bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe14c00640 10 client.10845 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe27400640 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x562e22c99900 0x562e22c9bcf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04973a8ab6dfdef server_cookie=17a5581071dfd75 in_seq=0 out_seq=0 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe14c00640 1 -- 172.21.15.17:0/2783516777 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e22a9dae0 con 0x562e22c99900 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe14c00640 10 client.10845 handle_command_reply: tid=0 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 client.10845 shutdown 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 -- 172.21.15.17:0/2783516777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 msgr2=0x562e22c91a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c91a70 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7efe2806e2d0 tx=0x7efe10004630 comp rx=0 tx=0).stop 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 -- 172.21.15.17:0/2783516777 shutdown_connections 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x562e22c99900 0x562e22c9bcf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c8aac0 0x562e22c91fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c91a70 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 --2- 172.21.15.17:0/2783516777 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c40bc0 0x562e22c91530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 -- 172.21.15.17:0/2783516777 >> 172.21.15.17:0/2783516777 conn(0x562e22c46d20 msgr2=0x562e22c3ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe14c00640 0 client.10845 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 -- 172.21.15.17:0/2783516777 shutdown_connections 2024-09-10T23:29:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 1 -- 172.21.15.17:0/2783516777 wait complete. 2024-09-10T23:29:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.008+0000 7efe31892000 20 client.10845 trim_cache size 0 max 16384 2024-09-10T23:29:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 Processor -- start 2024-09-10T23:29:31.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- start start 2024-09-10T23:29:31.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c94310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c94850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 0x562e22c94d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efe28204a80 con 0x562e22c8a1a0 2024-09-10T23:29:31.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe28203b10 con 0x562e22c40bc0 2024-09-10T23:29:31.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efe281558e0 con 0x562e22c8aac0 2024-09-10T23:29:31.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c94850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c94850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43670/0 (socket says 172.21.15.17:43670) 2024-09-10T23:29:31.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe1fe00640 1 -- 172.21.15.17:0/1736684879 learned_addr learned my addr 172.21.15.17:0/1736684879 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:31.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe27400640 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c94310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe27e00640 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 0x562e22c94d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe1fe00640 1 -- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 msgr2=0x562e22c94d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:31.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe1fe00640 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 0x562e22c94d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe1fe00640 1 -- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 msgr2=0x562e22c94310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:31.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe1fe00640 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c94310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe1fe00640 1 -- 172.21.15.17:0/1736684879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e22ae8660 con 0x562e22c8a1a0 2024-09-10T23:29:31.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe27e00640 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 0x562e22c94d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:31.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe27400640 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c94310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe1fe00640 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c94850 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7efe10001350 tx=0x7efe100079f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37df842a873eb065 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe17400640 1 -- 172.21.15.17:0/1736684879 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe10025070 con 0x562e22c8a1a0 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe17400640 1 -- 172.21.15.17:0/1736684879 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe1002a490 con 0x562e22c8a1a0 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe17400640 1 -- 172.21.15.17:0/1736684879 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1002aac0 con 0x562e22c8a1a0 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- 172.21.15.17:0/1736684879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 msgr2=0x562e22c94850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c94850 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7efe10001350 tx=0x7efe100079f0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- 172.21.15.17:0/1736684879 shutdown_connections 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 0x562e22c94d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c94850 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 --2- 172.21.15.17:0/1736684879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c94310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- 172.21.15.17:0/1736684879 >> 172.21.15.17:0/1736684879 conn(0x562e22c46d20 msgr2=0x562e22c40fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- 172.21.15.17:0/1736684879 shutdown_connections 2024-09-10T23:29:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- 172.21.15.17:0/1736684879 wait complete. 2024-09-10T23:29:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 -- start start 2024-09-10T23:29:31.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.028+0000 7efe31892000 1 Processor -- start 2024-09-10T23:29:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c97100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c97640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 0x562e22cbc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562e22c49d40 con 0x562e22c8a1a0 2024-09-10T23:29:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562e22c47100 con 0x562e22c40bc0 2024-09-10T23:29:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562e22a85ec0 con 0x562e22c8aac0 2024-09-10T23:29:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 10 client.0 _ll_register_callbacks cb 0x7efe10001db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:29:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c97640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c97640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43686/0 (socket says 172.21.15.17:43686) 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe1fe00640 1 -- 172.21.15.17:0/459470160 learned_addr learned my addr 172.21.15.17:0/459470160 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe27400640 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c97100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe27e00640 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 0x562e22cbc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe1fe00640 1 -- 172.21.15.17:0/459470160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 msgr2=0x562e22cbc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe1fe00640 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 0x562e22cbc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe1fe00640 1 -- 172.21.15.17:0/459470160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 msgr2=0x562e22c97100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe1fe00640 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c97100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe1fe00640 1 -- 172.21.15.17:0/459470160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e22a55090 con 0x562e22c8a1a0 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe27400640 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c97100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe1fe00640 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c97640 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7efe10001ec0 tx=0x7efe1002ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e2d4333c2a2610 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 1 -- 172.21.15.17:0/459470160 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1003a020 con 0x562e22c8a1a0 2024-09-10T23:29:31.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 -- 172.21.15.17:0/459470160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe1002a490 con 0x562e22c8a1a0 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 1 -- 172.21.15.17:0/459470160 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7efe10033800 con 0x562e22c8a1a0 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 1 -- 172.21.15.17:0/459470160 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7efe10044050 con 0x562e22c8a1a0 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 10 client.10851 fetch_fsmap learned FSMap version 144 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 -- 172.21.15.17:0/459470160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x562e22a215f0 con 0x562e22c8a1a0 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 1 -- 172.21.15.17:0/459470160 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe1002a490 con 0x562e22c8a1a0 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 1 -- 172.21.15.17:0/459470160 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7efe10047020 con 0x562e22c8a1a0 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 10 client.10851 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 10 client.10851 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 20 client.10851 populate_metadata read hostname 'smithi017' 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x562e22cbcc00 0x562e22cffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 4 client.10851 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 -- 172.21.15.17:0/459470160 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562e22a99590 con 0x562e22cbcc00 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe27400640 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x562e22cbcc00 0x562e22cffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:29:31.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe27400640 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x562e22cbcc00 0x562e22cffc70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=200f7bf430e854b7 server_cookie=e2d5dbc4814acf1d in_seq=0 out_seq=0 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 10 client.10851 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 1 -- 172.21.15.17:0/459470160 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+574 (crc 0 0 0) 0x562e22a99590 con 0x562e22cbcc00 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 10 client.10851 handle_command_reply: tid=0 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 client.10851 shutdown 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 -- 172.21.15.17:0/459470160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 msgr2=0x562e22c97640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c97640 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7efe10001ec0 tx=0x7efe1002ace0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 -- 172.21.15.17:0/459470160 shutdown_connections 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562e22c8aac0 0x562e22cbc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e22c8a1a0 0x562e22c97640 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x562e22cbcc00 0x562e22cffc70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 --2- 172.21.15.17:0/459470160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562e22c40bc0 0x562e22c97100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe14c00640 0 client.10851 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:29:31.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.032+0000 7efe31892000 1 -- 172.21.15.17:0/459470160 >> 172.21.15.17:0/459470160 conn(0x562e22c46d20 msgr2=0x562e22c40070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe31892000 1 -- 172.21.15.17:0/459470160 shutdown_connections 2024-09-10T23:29:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe31892000 1 -- 172.21.15.17:0/459470160 wait complete. 2024-09-10T23:29:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe31892000 20 client.10851 trim_cache size 0 max 16384 2024-09-10T23:29:31.040 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:29:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:29:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:29:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "83cbf824-639d-45f0-82e6-bf6d3cb50fbc": { 2024-09-10T23:29:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "~mds0", 2024-09-10T23:29:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "83cbf824-639d-45f0-82e6-bf6d3cb50fbc", 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive" 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "83cbf824-639d-45f0-82e6-bf6d3cb50fbc": { 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:29:30.820282+0000", 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "~mdsdir", 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:29:31.042 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:29:31.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 -- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe040725e0 msgr2=0x7efe04074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:31.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe040725e0 0x7efe04074aa0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7efe10007a60 tx=0x7efe10009040 comp rx=0 tx=0).stop 2024-09-10T23:29:31.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 -- 172.21.15.17:0/2793383784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe280d09f0 msgr2=0x7efe2814ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:29:31.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe280d09f0 0x7efe2814ac00 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7efe18000c10 tx=0x7efe18005db0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 -- 172.21.15.17:0/2793383784 shutdown_connections 2024-09-10T23:29:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efe040725e0 0x7efe04074aa0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe2815f3e0 0x7efe2814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe280d0ef0 0x7efe28159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 --2- 172.21.15.17:0/2793383784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe280d09f0 0x7efe2814ac00 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:29:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 -- 172.21.15.17:0/2793383784 >> 172.21.15.17:0/2793383784 conn(0x7efe28074210 msgr2=0x7efe280701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:29:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 -- 172.21.15.17:0/2793383784 shutdown_connections 2024-09-10T23:29:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:29:31.036+0000 7efe2e400640 1 -- 172.21.15.17:0/2793383784 wait complete. 2024-09-10T23:29:31.055 INFO:tasks.cephfs.filesystem:scrub status for tag:83cbf824-639d-45f0-82e6-bf6d3cb50fbc - {'path': '~mds0', 'tag': '83cbf824-639d-45f0-82e6-bf6d3cb50fbc', 'options': 'recursive'} 2024-09-10T23:29:38.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:29:38.567 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:30:01.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:01.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-10T23:30:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.216+0000 7f2fa2400640 1 -- 172.21.15.17:0/207096788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c15f400 msgr2=0x7f2f9c0cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.216+0000 7f2fa2400640 1 --2- 172.21.15.17:0/207096788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c15f400 0x7f2f9c0cfca0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0cf4c0 tx=0x7f2f8c01c870 comp rx=0 tx=0).stop 2024-09-10T23:30:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.216+0000 7f2fa2400640 1 -- 172.21.15.17:0/207096788 shutdown_connections 2024-09-10T23:30:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.216+0000 7f2fa2400640 1 --2- 172.21.15.17:0/207096788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f9c0b1530 0x7f2f9c0b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.216+0000 7f2fa2400640 1 --2- 172.21.15.17:0/207096788 >> v2:172.21.15.77:3300/0 conn(0x7f2f9c0b31b0 0x7f2f9c0d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.216+0000 7f2fa2400640 1 --2- 172.21.15.17:0/207096788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c15f400 0x7f2f9c0cfca0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.216+0000 7f2fa2400640 1 -- 172.21.15.17:0/207096788 >> 172.21.15.17:0/207096788 conn(0x7f2f9c0d1da0 msgr2=0x7f2f9c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.216+0000 7f2fa2400640 1 -- 172.21.15.17:0/207096788 shutdown_connections 2024-09-10T23:30:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.216+0000 7f2fa2400640 1 -- 172.21.15.17:0/207096788 wait complete. 2024-09-10T23:30:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 Processor -- start 2024-09-10T23:30:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 -- start start 2024-09-10T23:30:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f9c0b1530 0x7f2f9c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c0b31b0 0x7f2f9c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f9c15f400 0x7f2f9c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c0ccd20 con 0x7f2f9c0b31b0 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c0ccba0 con 0x7f2f9c0b1530 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c0ccea0 con 0x7f2f9c15f400 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c0b31b0 0x7f2f9c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c0b31b0 0x7f2f9c1516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55234/0 (socket says 172.21.15.17:55234) 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93e00640 1 -- 172.21.15.17:0/2774594632 learned_addr learned my addr 172.21.15.17:0/2774594632 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f9b400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f9c0b1530 0x7f2f9c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f9be00640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f9c15f400 0x7f2f9c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93e00640 1 -- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f9c15f400 msgr2=0x7f2f9c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93e00640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f9c15f400 0x7f2f9c0b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93e00640 1 -- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f9c0b1530 msgr2=0x7f2f9c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93e00640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f9c0b1530 0x7f2f9c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93e00640 1 -- 172.21.15.17:0/2774594632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9c158530 con 0x7f2f9c0b31b0 2024-09-10T23:30:01.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f9be00640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f9c15f400 0x7f2f9c0b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93e00640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c0b31b0 0x7f2f9c1516a0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400b550 tx=0x7f2f8400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93400640 1 -- 172.21.15.17:0/2774594632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84014070 con 0x7f2f9c0b31b0 2024-09-10T23:30:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93400640 1 -- 172.21.15.17:0/2774594632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f84010980 con 0x7f2f9c0b31b0 2024-09-10T23:30:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2f93400640 1 -- 172.21.15.17:0/2774594632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84010dd0 con 0x7f2f9c0b31b0 2024-09-10T23:30:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 -- 172.21.15.17:0/2774594632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9c1587d0 con 0x7f2f9c0b31b0 2024-09-10T23:30:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.220+0000 7f2fa2400640 1 -- 172.21.15.17:0/2774594632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9c156af0 con 0x7f2f9c0b31b0 2024-09-10T23:30:01.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2f93400640 1 -- 172.21.15.17:0/2774594632 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2f8400f3c0 con 0x7f2f9c0b31b0 2024-09-10T23:30:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2f93400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2f780725e0 0x7f2f78074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2f93400640 1 -- 172.21.15.17:0/2774594632 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f2f84093480 con 0x7f2f9c0b31b0 2024-09-10T23:30:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2f9b400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2f780725e0 0x7f2f78074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2fa58f2000 1 Processor -- start 2024-09-10T23:30:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2fa58f2000 1 -- start start 2024-09-10T23:30:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2f9b400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2f780725e0 0x7f2f78074aa0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0af000 tx=0x7f2f8c01b0b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f15580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11f15ac0 0x55ae11ecb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11ecbbc0 0x55ae11ecbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ae11db3cb0 con 0x55ae11f151a0 2024-09-10T23:30:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ae11cc9310 con 0x55ae11f15ac0 2024-09-10T23:30:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.224+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ae11d26b90 con 0x55ae11ecbbc0 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f15580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f15580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55242/0 (socket says 172.21.15.17:55242) 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9b400640 1 -- 172.21.15.17:0/4001144914 learned_addr learned my addr 172.21.15.17:0/4001144914 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f93e00640 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11f15ac0 0x55ae11ecb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9be00640 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11ecbbc0 0x55ae11ecbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9b400640 1 -- 172.21.15.17:0/4001144914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11ecbbc0 msgr2=0x55ae11ecbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9b400640 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11ecbbc0 0x55ae11ecbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9b400640 1 -- 172.21.15.17:0/4001144914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11f15ac0 msgr2=0x55ae11ecb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9b400640 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11f15ac0 0x55ae11ecb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9b400640 1 -- 172.21.15.17:0/4001144914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae11ccac60 con 0x55ae11f151a0 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f93e00640 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11f15ac0 0x55ae11ecb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f9b400640 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f15580 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009850 tx=0x7f2f8c0b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1693d3b82ca41b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f8be00640 1 -- 172.21.15.17:0/4001144914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0b2040 con 0x55ae11f151a0 2024-09-10T23:30:01.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f8be00640 1 -- 172.21.15.17:0/4001144914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f8c005100 con 0x55ae11f151a0 2024-09-10T23:30:01.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2f8be00640 1 -- 172.21.15.17:0/4001144914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c005550 con 0x55ae11f151a0 2024-09-10T23:30:01.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 -- 172.21.15.17:0/4001144914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 msgr2=0x55ae11f15580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f15580 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009850 tx=0x7f2f8c0b4000 comp rx=0 tx=0).stop 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 -- 172.21.15.17:0/4001144914 shutdown_connections 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11ecbbc0 0x55ae11ecbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11f15ac0 0x55ae11ecb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/4001144914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f15580 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 -- 172.21.15.17:0/4001144914 >> 172.21.15.17:0/4001144914 conn(0x55ae11ed1d20 msgr2=0x55ae11ec9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 -- 172.21.15.17:0/4001144914 shutdown_connections 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 -- 172.21.15.17:0/4001144914 wait complete. 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 -- start start 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 Processor -- start 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11f1c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11f1ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f1cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ae11d19dd0 con 0x55ae11f15ac0 2024-09-10T23:30:01.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ae11d15fc0 con 0x55ae11ecbbc0 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ae11cbb4b0 con 0x55ae11f151a0 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.228+0000 7f2fa58f2000 10 client.0 _ll_register_callbacks cb 0x55ae11c997d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f1cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11f1ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f9b400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11f1c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11f1ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:55176/0 (socket says 172.21.15.17:55176) 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f1cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55256/0 (socket says 172.21.15.17:55256) 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f93e00640 1 -- 172.21.15.17:0/1342547831 learned_addr learned my addr 172.21.15.17:0/1342547831 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f93e00640 1 -- 172.21.15.17:0/1342547831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 msgr2=0x55ae11f1c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f93e00640 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11f1c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f93e00640 1 -- 172.21.15.17:0/1342547831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 msgr2=0x55ae11f1cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f93e00640 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f1cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f93e00640 1 -- 172.21.15.17:0/1342547831 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55ae11cb41f0 con 0x55ae11f151a0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f9be00640 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f1cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f93e00640 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11f1ca70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2f84091780 tx=0x7f2f8405de60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2738d65eec213ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 10 client.0 ms_handle_connect on v2:172.21.15.77:3301/0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 1 -- 172.21.15.17:0/1342547831 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8401e040 con 0x55ae11f151a0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 1 -- 172.21.15.17:0/1342547831 <== mon.2 v2:172.21.15.77:3301/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f2f84083120 con 0x55ae11f151a0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 -- 172.21.15.17:0/1342547831 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ae11cae330 con 0x55ae11f151a0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 1 -- 172.21.15.17:0/1342547831 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f2f84083320 con 0x55ae11f151a0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 10 client.8681 fetch_fsmap learned FSMap version 144 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 -- 172.21.15.17:0/1342547831 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55ae11c9afa0 con 0x55ae11f151a0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 1 -- 172.21.15.17:0/1342547831 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ae11cae330 con 0x55ae11f151a0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 1 -- 172.21.15.17:0/1342547831 <== mon.2 v2:172.21.15.77:3301/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f2f840672a0 con 0x55ae11f151a0 2024-09-10T23:30:01.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 10 client.8681 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:30:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 10 client.8681 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:30:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 20 client.8681 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55ae11f24900 0x55ae11f26cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 4 client.8681 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 -- 172.21.15.17:0/1342547831 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae11d28ae0 con 0x55ae11f24900 2024-09-10T23:30:01.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f9b400640 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55ae11f24900 0x55ae11f26cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f9b400640 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55ae11f24900 0x55ae11f26cf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b8a456eb7968c7 server_cookie=433aba67fc5e659f in_seq=0 out_seq=0 2024-09-10T23:30:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 10 client.8681 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:30:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 1 -- 172.21.15.17:0/1342547831 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae11d28ae0 con 0x55ae11f24900 2024-09-10T23:30:01.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 10 client.8681 handle_command_reply: tid=0 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 client.8681 shutdown 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 -- 172.21.15.17:0/1342547831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 msgr2=0x55ae11f1ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11f1ca70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2f84091780 tx=0x7f2f8405de60 comp rx=0 tx=0).stop 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 -- 172.21.15.17:0/1342547831 shutdown_connections 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f1cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11f1ca70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55ae11f24900 0x55ae11f26cf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/1342547831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11f1c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2f88c00640 0 client.8681 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 -- 172.21.15.17:0/1342547831 >> 172.21.15.17:0/1342547831 conn(0x55ae11ed1d20 msgr2=0x55ae11ec9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 -- 172.21.15.17:0/1342547831 shutdown_connections 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 1 -- 172.21.15.17:0/1342547831 wait complete. 2024-09-10T23:30:01.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.232+0000 7f2fa58f2000 20 client.8681 trim_cache size 0 max 16384 2024-09-10T23:30:01.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2fa58f2000 1 Processor -- start 2024-09-10T23:30:01.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2fa58f2000 1 -- start start 2024-09-10T23:30:01.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11ecb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11ecb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f229a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c204750 con 0x55ae11f15ac0 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9c2037d0 con 0x55ae11ecbbc0 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9c1577a0 con 0x55ae11f151a0 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f229a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55264/0 (socket says 172.21.15.17:55264) 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9be00640 1 -- 172.21.15.17:0/200444999 learned_addr learned my addr 172.21.15.17:0/200444999 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f93e00640 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11ecb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9b400640 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11ecb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9be00640 1 -- 172.21.15.17:0/200444999 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 msgr2=0x55ae11ecb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9be00640 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11ecb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9be00640 1 -- 172.21.15.17:0/200444999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 msgr2=0x55ae11ecb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9be00640 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11ecb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9be00640 1 -- 172.21.15.17:0/200444999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae11d73660 con 0x55ae11f15ac0 2024-09-10T23:30:01.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9b400640 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11ecb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:01.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f9be00640 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f229a0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f2f940070b0 tx=0x7f2f9400acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa1f10a312879eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f8b400640 1 -- 172.21.15.17:0/200444999 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9401d070 con 0x55ae11f15ac0 2024-09-10T23:30:01.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f8b400640 1 -- 172.21.15.17:0/200444999 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f94013b70 con 0x55ae11f15ac0 2024-09-10T23:30:01.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.252+0000 7f2f8b400640 1 -- 172.21.15.17:0/200444999 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94018440 con 0x55ae11f15ac0 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- 172.21.15.17:0/200444999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 msgr2=0x55ae11f229a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f229a0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f2f940070b0 tx=0x7f2f9400acd0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- 172.21.15.17:0/200444999 shutdown_connections 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f15ac0 0x55ae11f229a0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f151a0 0x55ae11ecb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/200444999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11ecb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- 172.21.15.17:0/200444999 >> 172.21.15.17:0/200444999 conn(0x55ae11ed1d20 msgr2=0x55ae11eca960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- 172.21.15.17:0/200444999 shutdown_connections 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- 172.21.15.17:0/200444999 wait complete. 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- start start 2024-09-10T23:30:01.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 Processor -- start 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11f21fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f22500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f15ac0 0x55ae11f47210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55ae11ed4d40 con 0x55ae11f151a0 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ae11ed2100 con 0x55ae11ecbbc0 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55ae11d10ec0 con 0x55ae11f15ac0 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 10 client.0 _ll_register_callbacks cb 0x7f2f8405dae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f22500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f22500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55270/0 (socket says 172.21.15.17:55270) 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f93e00640 1 -- 172.21.15.17:0/2735360531 learned_addr learned my addr 172.21.15.17:0/2735360531 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f9b400640 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11f21fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f9be00640 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f15ac0 0x55ae11f47210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f93e00640 1 -- 172.21.15.17:0/2735360531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f15ac0 msgr2=0x55ae11f47210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f93e00640 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f15ac0 0x55ae11f47210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f93e00640 1 -- 172.21.15.17:0/2735360531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 msgr2=0x55ae11f21fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f93e00640 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11f21fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f93e00640 1 -- 172.21.15.17:0/2735360531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae11ce0090 con 0x55ae11f151a0 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f93e00640 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f22500 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f2f8405e270 tx=0x7f2f84067820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cbc39239fdefbe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f88c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f88c00640 1 -- 172.21.15.17:0/2735360531 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8401e040 con 0x55ae11f151a0 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f88c00640 1 -- 172.21.15.17:0/2735360531 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f2f84091570 con 0x55ae11f151a0 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- 172.21.15.17:0/2735360531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f94013b70 con 0x55ae11f151a0 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f88c00640 1 -- 172.21.15.17:0/2735360531 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f2f84089050 con 0x55ae11f151a0 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 10 client.10869 fetch_fsmap learned FSMap version 144 2024-09-10T23:30:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- 172.21.15.17:0/2735360531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x55ae11cac5f0 con 0x55ae11f151a0 2024-09-10T23:30:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f88c00640 1 -- 172.21.15.17:0/2735360531 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f94013b70 con 0x55ae11f151a0 2024-09-10T23:30:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2f88c00640 1 -- 172.21.15.17:0/2735360531 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7f2f84091040 con 0x55ae11f151a0 2024-09-10T23:30:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 10 client.10869 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:30:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 10 client.10869 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:30:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 20 client.10869 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55ae11f47c30 0x55ae11f92680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 4 client.10869 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:30:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.256+0000 7f2fa58f2000 1 -- 172.21.15.17:0/2735360531 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ae11d24590 con 0x55ae11f47c30 2024-09-10T23:30:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2f9b400640 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55ae11f47c30 0x55ae11f92680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2f9b400640 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55ae11f47c30 0x55ae11f92680 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b5955d5dec01209 server_cookie=6699c06655e780f8 in_seq=0 out_seq=0 2024-09-10T23:30:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2f88c00640 10 client.10869 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:30:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2f88c00640 1 -- 172.21.15.17:0/2735360531 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+380 (crc 0 0 0) 0x55ae11d24590 con 0x55ae11f47c30 2024-09-10T23:30:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2f88c00640 10 client.10869 handle_command_reply: tid=0 2024-09-10T23:30:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 client.10869 shutdown 2024-09-10T23:30:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 -- 172.21.15.17:0/2735360531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 msgr2=0x55ae11f22500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f22500 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f2f8405e270 tx=0x7f2f84067820 comp rx=0 tx=0).stop 2024-09-10T23:30:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 -- 172.21.15.17:0/2735360531 shutdown_connections 2024-09-10T23:30:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55ae11f15ac0 0x55ae11f47210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ae11f151a0 0x55ae11f22500 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x55ae11f47c30 0x55ae11f92680 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 --2- 172.21.15.17:0/2735360531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ae11ecbbc0 0x55ae11f21fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 -- 172.21.15.17:0/2735360531 >> 172.21.15.17:0/2735360531 conn(0x55ae11ed1d20 msgr2=0x55ae11ecb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2f88c00640 0 client.10869 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:30:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 -- 172.21.15.17:0/2735360531 shutdown_connections 2024-09-10T23:30:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 1 -- 172.21.15.17:0/2735360531 wait complete. 2024-09-10T23:30:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa58f2000 20 client.10869 trim_cache size 0 max 16384 2024-09-10T23:30:01.268 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "83cbf824-639d-45f0-82e6-bf6d3cb50fbc": { 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:29:30.820282+0000", 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "~mdsdir", 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:01.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:01.270 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:30:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 -- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2f780725e0 msgr2=0x7f2f78074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2f780725e0 0x7f2f78074aa0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0af000 tx=0x7f2f8c01b0b0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 -- 172.21.15.17:0/2774594632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c0b31b0 msgr2=0x7f2f9c1516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c0b31b0 0x7f2f9c1516a0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400b550 tx=0x7f2f8400ba10 comp rx=0 tx=0).stop 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 -- 172.21.15.17:0/2774594632 shutdown_connections 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2f780725e0 0x7f2f78074aa0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f9c15f400 0x7f2f9c0b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f9c0b31b0 0x7f2f9c1516a0 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 --2- 172.21.15.17:0/2774594632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f9c0b1530 0x7f2f9c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 -- 172.21.15.17:0/2774594632 >> 172.21.15.17:0/2774594632 conn(0x7f2f9c0d1da0 msgr2=0x7f2f9c0b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 -- 172.21.15.17:0/2774594632 shutdown_connections 2024-09-10T23:30:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.260+0000 7f2fa2400640 1 -- 172.21.15.17:0/2774594632 wait complete. 2024-09-10T23:30:01.280 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:30:01.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-10T23:30:01.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.428+0000 7fb188800640 1 -- 172.21.15.17:0/1920476618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 msgr2=0x7fb180072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.428+0000 7fb188800640 1 --2- 172.21.15.17:0/1920476618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 0x7fb180072fa0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fb17000aa10 tx=0x7fb17001dc00 comp rx=0 tx=0).stop 2024-09-10T23:30:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.428+0000 7fb188800640 1 -- 172.21.15.17:0/1920476618 shutdown_connections 2024-09-10T23:30:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.428+0000 7fb188800640 1 --2- 172.21.15.17:0/1920476618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1800cc6f0 0x7fb1800ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.428+0000 7fb188800640 1 --2- 172.21.15.17:0/1920476618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 0x7fb180072fa0 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.428+0000 7fb188800640 1 -- 172.21.15.17:0/1920476618 >> 172.21.15.17:0/1920476618 conn(0x7fb1800b17a0 msgr2=0x7fb1800b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.428+0000 7fb188800640 1 -- 172.21.15.17:0/1920476618 shutdown_connections 2024-09-10T23:30:01.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.428+0000 7fb188800640 1 -- 172.21.15.17:0/1920476618 wait complete. 2024-09-10T23:30:01.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 Processor -- start 2024-09-10T23:30:01.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 -- start start 2024-09-10T23:30:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 0x7fb1801462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1800cc6f0 0x7fb180152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb18015a3a0 0x7fb18014e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb1800cd410 con 0x7fb180072b70 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1800cd290 con 0x7fb18015a3a0 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb1800cd590 con 0x7fb1800cc6f0 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 0x7fb1801462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 0x7fb1801462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55286/0 (socket says 172.21.15.17:55286) 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185e00640 1 -- 172.21.15.17:0/955848809 learned_addr learned my addr 172.21.15.17:0/955848809 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb186800640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb18015a3a0 0x7fb18014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185400640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1800cc6f0 0x7fb180152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185e00640 1 -- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1800cc6f0 msgr2=0x7fb180152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185e00640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1800cc6f0 0x7fb180152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185e00640 1 -- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb18015a3a0 msgr2=0x7fb18014e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185e00640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb18015a3a0 0x7fb18014e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185e00640 1 -- 172.21.15.17:0/955848809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb180153770 con 0x7fb180072b70 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185400640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1800cc6f0 0x7fb180152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb186800640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb18015a3a0 0x7fb18014e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb185e00640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 0x7fb1801462f0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fb17400b440 tx=0x7fb17400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb17a000640 1 -- 172.21.15.17:0/955848809 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174015020 con 0x7fb180072b70 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb17a000640 1 -- 172.21.15.17:0/955848809 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb174011980 con 0x7fb180072b70 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb17a000640 1 -- 172.21.15.17:0/955848809 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174011dd0 con 0x7fb180072b70 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 -- 172.21.15.17:0/955848809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb180146ff0 con 0x7fb180072b70 2024-09-10T23:30:01.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.432+0000 7fb188800640 1 -- 172.21.15.17:0/955848809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1801475b0 con 0x7fb180072b70 2024-09-10T23:30:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb17a000640 1 -- 172.21.15.17:0/955848809 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb17401a400 con 0x7fb180072b70 2024-09-10T23:30:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb17a000640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb164072610 0x7fb164074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb17a000640 1 -- 172.21.15.17:0/955848809 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fb174093540 con 0x7fb180072b70 2024-09-10T23:30:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb18bb34000 1 Processor -- start 2024-09-10T23:30:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb185400640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb164072610 0x7fb164074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb18bb34000 1 -- start start 2024-09-10T23:30:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb185400640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb164072610 0x7fb164074ad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb1700b0000 tx=0x7fb17001c440 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fde00310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fddb33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddb3920 0x5619fddb3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb18bb34000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5619fdc9dd30 con 0x5619fddfff30 2024-09-10T23:30:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb18bb34000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5619fdc11af0 con 0x5619fddb3920 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb18bb34000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5619fdc00f20 con 0x5619fde00850 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.436+0000 7fb185e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fde00310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fde00310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55288/0 (socket says 172.21.15.17:55288) 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 -- 172.21.15.17:0/3072098105 learned_addr learned my addr 172.21.15.17:0/3072098105 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185400640 1 --2- 172.21.15.17:0/3072098105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fddb33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb186800640 1 --2- 172.21.15.17:0/3072098105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddb3920 0x5619fddb3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 -- 172.21.15.17:0/3072098105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 msgr2=0x5619fddb33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 --2- 172.21.15.17:0/3072098105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fddb33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 -- 172.21.15.17:0/3072098105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddb3920 msgr2=0x5619fddb3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 --2- 172.21.15.17:0/3072098105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddb3920 0x5619fddb3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 -- 172.21.15.17:0/3072098105 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619fdb82100 con 0x5619fddfff30 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 --2- 172.21.15.17:0/3072098105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fde00310 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fb174091840 tx=0x7fb17405df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9028fe32a7db08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb16ea00640 1 -- 172.21.15.17:0/3072098105 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1740671d0 con 0x5619fddfff30 2024-09-10T23:30:01.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb16ea00640 1 -- 172.21.15.17:0/3072098105 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb174062e60 con 0x5619fddfff30 2024-09-10T23:30:01.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb16ea00640 1 -- 172.21.15.17:0/3072098105 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174067880 con 0x5619fddfff30 2024-09-10T23:30:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 -- 172.21.15.17:0/3072098105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 msgr2=0x5619fde00310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3072098105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fde00310 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fb174091840 tx=0x7fb17405df50 comp rx=0 tx=0).stop 2024-09-10T23:30:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 -- 172.21.15.17:0/3072098105 shutdown_connections 2024-09-10T23:30:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3072098105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddb3920 0x5619fddb3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3072098105 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fddb33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3072098105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fde00310 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 -- 172.21.15.17:0/3072098105 >> 172.21.15.17:0/3072098105 conn(0x5619fdde0ff0 msgr2=0x5619fdde33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 -- 172.21.15.17:0/3072098105 shutdown_connections 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 -- 172.21.15.17:0/3072098105 wait complete. 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 -- start start 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 Processor -- start 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddb3920 0x5619fdde2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 0x5619fdde2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fdde2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5619fdba64e0 con 0x5619fddb3920 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5619fdc04d30 con 0x5619fddfff30 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5619fd8c6680 con 0x5619fde00850 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb18bb34000 10 client.0 _ll_register_callbacks cb 0x5619fdda10e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddb3920 0x5619fdde2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddb3920 0x5619fdde2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55290/0 (socket says 172.21.15.17:55290) 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185e00640 1 -- 172.21.15.17:0/234497031 learned_addr learned my addr 172.21.15.17:0/234497031 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb186800640 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fdde2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.440+0000 7fb185400640 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 0x5619fdde2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb185e00640 1 -- 172.21.15.17:0/234497031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 msgr2=0x5619fdde2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb185e00640 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fdde2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb185e00640 1 -- 172.21.15.17:0/234497031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 msgr2=0x5619fdde2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb185e00640 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 0x5619fdde2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb185e00640 1 -- 172.21.15.17:0/234497031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619fdbb5c40 con 0x5619fddb3920 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb185e00640 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddb3920 0x5619fdde2420 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7fb174093010 tx=0x7fb17405aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f066fbf830b8866a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 1 -- 172.21.15.17:0/234497031 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174090060 con 0x5619fddb3920 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 1 -- 172.21.15.17:0/234497031 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fb1740831c0 con 0x5619fddb3920 2024-09-10T23:30:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 -- 172.21.15.17:0/234497031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5619fdb99310 con 0x5619fddb3920 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 1 -- 172.21.15.17:0/234497031 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7fb174062e60 con 0x5619fddb3920 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 10 client.10881 fetch_fsmap learned FSMap version 144 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 -- 172.21.15.17:0/234497031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x5619fdbffbc0 con 0x5619fddb3920 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 1 -- 172.21.15.17:0/234497031 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5619fdb99310 con 0x5619fddb3920 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 1 -- 172.21.15.17:0/234497031 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7fb17405d5e0 con 0x5619fddb3920 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 10 client.10881 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 10 client.10881 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 20 client.10881 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x5619fdde38b0 0x5619fde121f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 4 client.10881 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 -- 172.21.15.17:0/234497031 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619fdc13a40 con 0x5619fdde38b0 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb185400640 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x5619fdde38b0 0x5619fde121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 10 client.10881 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:30:01.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb185400640 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x5619fdde38b0 0x5619fde121f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c9aa9f7e9b06f46 server_cookie=4dd4593ea90e1dff in_seq=0 out_seq=0 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 1 -- 172.21.15.17:0/234497031 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619fdc13a40 con 0x5619fdde38b0 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 10 client.10881 handle_command_reply: tid=0 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 client.10881 shutdown 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 -- 172.21.15.17:0/234497031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddb3920 msgr2=0x5619fdde2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddb3920 0x5619fdde2420 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7fb174093010 tx=0x7fb17405aa50 comp rx=0 tx=0).stop 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 -- 172.21.15.17:0/234497031 shutdown_connections 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fdde2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x5619fdde38b0 0x5619fde121f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 0x5619fdde2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 --2- 172.21.15.17:0/234497031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddb3920 0x5619fdde2420 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 -- 172.21.15.17:0/234497031 >> 172.21.15.17:0/234497031 conn(0x5619fdde0ff0 msgr2=0x5619fddb2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb163400640 0 client.10881 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:30:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 -- 172.21.15.17:0/234497031 shutdown_connections 2024-09-10T23:30:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 1 -- 172.21.15.17:0/234497031 wait complete. 2024-09-10T23:30:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.444+0000 7fb18bb34000 20 client.10881 trim_cache size 0 max 16384 2024-09-10T23:30:01.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb18bb34000 1 Processor -- start 2024-09-10T23:30:01.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb18bb34000 1 -- start start 2024-09-10T23:30:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddb3920 0x5619fdde23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fdde2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fde101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb18bb34000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb180204440 con 0x5619fddfff30 2024-09-10T23:30:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb18bb34000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1802034c0 con 0x5619fddb3920 2024-09-10T23:30:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb18bb34000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb180148810 con 0x5619fde00850 2024-09-10T23:30:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb185400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fdde2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb185400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fdde2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55292/0 (socket says 172.21.15.17:55292) 2024-09-10T23:30:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb185400640 1 -- 172.21.15.17:0/127890033 learned_addr learned my addr 172.21.15.17:0/127890033 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb185400640 1 -- 172.21.15.17:0/127890033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 msgr2=0x5619fde101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb185400640 1 --2- 172.21.15.17:0/127890033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fde101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb185400640 1 -- 172.21.15.17:0/127890033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddb3920 msgr2=0x5619fdde23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb185400640 1 --2- 172.21.15.17:0/127890033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddb3920 0x5619fdde23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb185400640 1 -- 172.21.15.17:0/127890033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619fddbc0b0 con 0x5619fddfff30 2024-09-10T23:30:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb185400640 1 --2- 172.21.15.17:0/127890033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fdde2920 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fb17000aa10 tx=0x7fb1700b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ee0e2a86124032 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb16e000640 1 -- 172.21.15.17:0/127890033 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1700d2070 con 0x5619fddfff30 2024-09-10T23:30:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb16e000640 1 -- 172.21.15.17:0/127890033 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1700ca030 con 0x5619fddfff30 2024-09-10T23:30:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.460+0000 7fb16e000640 1 -- 172.21.15.17:0/127890033 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1700b3040 con 0x5619fddfff30 2024-09-10T23:30:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- 172.21.15.17:0/127890033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 msgr2=0x5619fdde2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 --2- 172.21.15.17:0/127890033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fdde2920 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fb17000aa10 tx=0x7fb1700b4000 comp rx=0 tx=0).stop 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- 172.21.15.17:0/127890033 shutdown_connections 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 --2- 172.21.15.17:0/127890033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fde00850 0x5619fde101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 --2- 172.21.15.17:0/127890033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fddfff30 0x5619fdde2920 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 --2- 172.21.15.17:0/127890033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddb3920 0x5619fdde23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- 172.21.15.17:0/127890033 >> 172.21.15.17:0/127890033 conn(0x5619fdde0ff0 msgr2=0x5619fde0cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- 172.21.15.17:0/127890033 shutdown_connections 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- 172.21.15.17:0/127890033 wait complete. 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- start start 2024-09-10T23:30:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 Processor -- start 2024-09-10T23:30:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fddb3920 0x5619fde76370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 0x5619fde768b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fde00850 0x5619fde76df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5619fdcc0ff0 con 0x5619fde00850 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5619fdc108c0 con 0x5619fddfff30 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5619fdbc3690 con 0x5619fddb3920 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 10 client.0 _ll_register_callbacks cb 0x7fb17c009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb186800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fde00850 0x5619fde76df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb186800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fde00850 0x5619fde76df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55306/0 (socket says 172.21.15.17:55306) 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb186800640 1 -- 172.21.15.17:0/3795954898 learned_addr learned my addr 172.21.15.17:0/3795954898 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb185400640 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 0x5619fde768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb185e00640 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fddb3920 0x5619fde76370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb186800640 1 -- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fddb3920 msgr2=0x5619fde76370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb186800640 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fddb3920 0x5619fde76370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb186800640 1 -- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 msgr2=0x5619fde768b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb186800640 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 0x5619fde768b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb186800640 1 -- 172.21.15.17:0/3795954898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619fdb9f1d0 con 0x5619fde00850 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb185400640 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 0x5619fde768b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb185e00640 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fddb3920 0x5619fde76370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb186800640 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fde00850 0x5619fde76df0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7fb17c012770 tx=0x7fb17c012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf41520d1607970 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb163400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb163400640 1 -- 172.21.15.17:0/3795954898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c0109e0 con 0x5619fde00850 2024-09-10T23:30:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- 172.21.15.17:0/3795954898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1700ca030 con 0x5619fde00850 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb163400640 1 -- 172.21.15.17:0/3795954898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fb17c010b80 con 0x5619fde00850 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb163400640 1 -- 172.21.15.17:0/3795954898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7fb17c027050 con 0x5619fde00850 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 10 client.10887 fetch_fsmap learned FSMap version 144 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.464+0000 7fb18bb34000 1 -- 172.21.15.17:0/3795954898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) -- 0x5619fdbc7970 con 0x5619fde00850 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb163400640 1 -- 172.21.15.17:0/3795954898 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1700ca030 con 0x5619fde00850 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb163400640 1 -- 172.21.15.17:0/3795954898 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 144) ==== 3502+0+0 (secure 0 0 0) 0x7fb17c01a070 con 0x5619fde00850 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 10 client.10887 fetch_fsmap finished waiting for FSMap version 144 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 10 client.10887 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 20 client.10887 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x5619fde134c0 0x5619fde138d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 4 client.10887 mds_command: new command op to 10641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 -- 172.21.15.17:0/3795954898 --> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5619fdc0f4f0 con 0x5619fde134c0 2024-09-10T23:30:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb185e00640 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x5619fde134c0 0x5619fde138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb185e00640 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x5619fde134c0 0x5619fde138d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2076a0be168c5585 server_cookie=5ce16f4b351f3432 in_seq=0 out_seq=0 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb163400640 10 client.10887 ms_handle_connect on v2:172.21.15.17:6833/4256418601 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb163400640 1 -- 172.21.15.17:0/3795954898 <== mds.0 v2:172.21.15.17:6833/4256418601 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5619fdc0f4f0 con 0x5619fde134c0 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb163400640 10 client.10887 handle_command_reply: tid=0 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 client.10887 shutdown 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 -- 172.21.15.17:0/3795954898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fde00850 msgr2=0x5619fde76df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fde00850 0x5619fde76df0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7fb17c012770 tx=0x7fb17c012c30 comp rx=0 tx=0).stop 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 -- 172.21.15.17:0/3795954898 shutdown_connections 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5619fde00850 0x5619fde76df0 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.17:6833/4256418601,v1:172.21.15.17:6835/4256418601] conn(0x5619fde134c0 0x5619fde138d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5619fddfff30 0x5619fde768b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 --2- 172.21.15.17:0/3795954898 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5619fddb3920 0x5619fde76370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb163400640 0 client.10887 ms_handle_reset on v2:172.21.15.17:6833/4256418601 2024-09-10T23:30:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 -- 172.21.15.17:0/3795954898 >> 172.21.15.17:0/3795954898 conn(0x5619fdde0ff0 msgr2=0x5619fddfdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 -- 172.21.15.17:0/3795954898 shutdown_connections 2024-09-10T23:30:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 1 -- 172.21.15.17:0/3795954898 wait complete. 2024-09-10T23:30:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb18bb34000 20 client.10887 trim_cache size 0 max 16384 2024-09-10T23:30:01.476 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T23:30:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 -- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb164072610 msgr2=0x7fb164074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb164072610 0x7fb164074ad0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb1700b0000 tx=0x7fb17001c440 comp rx=0 tx=0).stop 2024-09-10T23:30:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 -- 172.21.15.17:0/955848809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 msgr2=0x7fb1801462f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 0x7fb1801462f0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fb17400b440 tx=0x7fb17400b900 comp rx=0 tx=0).stop 2024-09-10T23:30:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 -- 172.21.15.17:0/955848809 shutdown_connections 2024-09-10T23:30:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb164072610 0x7fb164074ad0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb18015a3a0 0x7fb18014e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1800cc6f0 0x7fb180152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 --2- 172.21.15.17:0/955848809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb180072b70 0x7fb1801462f0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 -- 172.21.15.17:0/955848809 >> 172.21.15.17:0/955848809 conn(0x7fb1800b17a0 msgr2=0x7fb180149930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 -- 172.21.15.17:0/955848809 shutdown_connections 2024-09-10T23:30:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.468+0000 7fb188800640 1 -- 172.21.15.17:0/955848809 wait complete. 2024-09-10T23:30:01.489 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T23:30:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 -- 172.21.15.17:0/909757662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc8415bc70 msgr2=0x7efc840cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 --2- 172.21.15.17:0/909757662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc8415bc70 0x7efc840cfa20 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7efc840c5560 tx=0x7efc7401c890 comp rx=0 tx=0).stop 2024-09-10T23:30:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 -- 172.21.15.17:0/909757662 shutdown_connections 2024-09-10T23:30:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 --2- 172.21.15.17:0/909757662 >> v2:172.21.15.77:3300/0 conn(0x7efc840cc570 0x7efc840d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 --2- 172.21.15.17:0/909757662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc8415bc70 0x7efc840cfa20 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 -- 172.21.15.17:0/909757662 >> 172.21.15.17:0/909757662 conn(0x7efc8409a9f0 msgr2=0x7efc8409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 -- 172.21.15.17:0/909757662 shutdown_connections 2024-09-10T23:30:01.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 -- 172.21.15.17:0/909757662 wait complete. 2024-09-10T23:30:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 Processor -- start 2024-09-10T23:30:01.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 -- start start 2024-09-10T23:30:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc840cc570 0x7efc840b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc840d1ed0 0x7efc84158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc8415bc70 0x7efc8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efc84168930 con 0x7efc840cc570 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc840ccbd0 con 0x7efc840d1ed0 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.635+0000 7efc83e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efc84168ab0 con 0x7efc8415bc70 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc82a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc840cc570 0x7efc840b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc82a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc840cc570 0x7efc840b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55322/0 (socket says 172.21.15.17:55322) 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc82a00640 1 -- 172.21.15.17:0/3509971442 learned_addr learned my addr 172.21.15.17:0/3509971442 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc82a00640 1 -- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc8415bc70 msgr2=0x7efc8406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc82a00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc8415bc70 0x7efc8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc82a00640 1 -- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc840d1ed0 msgr2=0x7efc84158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc82a00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc840d1ed0 0x7efc84158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc82a00640 1 -- 172.21.15.17:0/3509971442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc840b1c10 con 0x7efc840cc570 2024-09-10T23:30:01.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc82a00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc840cc570 0x7efc840b1630 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7efc740b0040 tx=0x7efc74004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc7aa00640 1 -- 172.21.15.17:0/3509971442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc740b2040 con 0x7efc840cc570 2024-09-10T23:30:01.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc7aa00640 1 -- 172.21.15.17:0/3509971442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc74004430 con 0x7efc840cc570 2024-09-10T23:30:01.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc7aa00640 1 -- 172.21.15.17:0/3509971442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74003860 con 0x7efc840cc570 2024-09-10T23:30:01.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc8415cc80 con 0x7efc840cc570 2024-09-10T23:30:01.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc8415c380 con 0x7efc840cc570 2024-09-10T23:30:01.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc840d1990 con 0x7efc840cc570 2024-09-10T23:30:01.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.639+0000 7efc7aa00640 1 -- 172.21.15.17:0/3509971442 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efc74003a00 con 0x7efc840cc570 2024-09-10T23:30:01.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.643+0000 7efc7aa00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc600725e0 0x7efc60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:01.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.643+0000 7efc7aa00640 1 -- 172.21.15.17:0/3509971442 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7efc7412d220 con 0x7efc840cc570 2024-09-10T23:30:01.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.643+0000 7efc7be00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc600725e0 0x7efc60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:01.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.643+0000 7efc7be00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc600725e0 0x7efc60074aa0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7efc8415f5e0 tx=0x7efc6c005cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:01.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.647+0000 7efc7aa00640 1 -- 172.21.15.17:0/3509971442 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efc740164b0 con 0x7efc840cc570 2024-09-10T23:30:01.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.855+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efc840d0630 con 0x7efc840cc570 2024-09-10T23:30:01.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc7aa00640 1 -- 172.21.15.17:0/3509971442 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7efc740f8760 con 0x7efc840cc570 2024-09-10T23:30:01.860 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:01.860 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T23:30:01.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc600725e0 msgr2=0x7efc60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc600725e0 0x7efc60074aa0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7efc8415f5e0 tx=0x7efc6c005cc0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc840cc570 msgr2=0x7efc840b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:01.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc840cc570 0x7efc840b1630 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7efc740b0040 tx=0x7efc74004040 comp rx=0 tx=0).stop 2024-09-10T23:30:01.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 shutdown_connections 2024-09-10T23:30:01.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc600725e0 0x7efc60074aa0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc8415bc70 0x7efc8406e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc840d1ed0 0x7efc84158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 --2- 172.21.15.17:0/3509971442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc840cc570 0x7efc840b1630 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:01.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 >> 172.21.15.17:0/3509971442 conn(0x7efc8409a9f0 msgr2=0x7efc8415a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:01.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 shutdown_connections 2024-09-10T23:30:01.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:01.859+0000 7efc83e00640 1 -- 172.21.15.17:0/3509971442 wait complete. 2024-09-10T23:30:01.882 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:30:01.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:30:01.965 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:30:02.051 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:30:02.051 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:30:02.051 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:30:02.052 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:02.060 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:30:02.060 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:02.115 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:30:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.303+0000 7f5af1e00640 1 -- 172.21.15.17:0/903439014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec15be40 msgr2=0x7f5aec0cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.303+0000 7f5af1e00640 1 --2- 172.21.15.17:0/903439014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec15be40 0x7f5aec0cfe70 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0c8dc0 tx=0x7f5adc01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.303+0000 7f5af1e00640 1 -- 172.21.15.17:0/903439014 shutdown_connections 2024-09-10T23:30:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.303+0000 7f5af1e00640 1 --2- 172.21.15.17:0/903439014 >> v2:172.21.15.77:3300/0 conn(0x7f5aec0af8d0 0x7f5aec0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.303+0000 7f5af1e00640 1 --2- 172.21.15.17:0/903439014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec15be40 0x7f5aec0cfe70 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.303+0000 7f5af1e00640 1 -- 172.21.15.17:0/903439014 >> 172.21.15.17:0/903439014 conn(0x7f5aec0d1d60 msgr2=0x7f5aec0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.303+0000 7f5af1e00640 1 -- 172.21.15.17:0/903439014 shutdown_connections 2024-09-10T23:30:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.303+0000 7f5af1e00640 1 -- 172.21.15.17:0/903439014 wait complete. 2024-09-10T23:30:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 Processor -- start 2024-09-10T23:30:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 -- start start 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec0af8d0 0x7f5aec0c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5aec0b3360 0x7f5aec15b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aec15be40 0x7f5aec1fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec168e10 con 0x7f5aec0af8d0 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec168c90 con 0x7f5aec15be40 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec168f90 con 0x7f5aec0b3360 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec0af8d0 0x7f5aec0c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec0af8d0 0x7f5aec0c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55348/0 (socket says 172.21.15.17:55348) 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeaa00640 1 -- 172.21.15.17:0/4177660136 learned_addr learned my addr 172.21.15.17:0/4177660136 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeb400640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aec15be40 0x7f5aec1fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5ae3e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5aec0b3360 0x7f5aec15b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeaa00640 1 -- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5aec0b3360 msgr2=0x7f5aec15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeaa00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5aec0b3360 0x7f5aec15b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeaa00640 1 -- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aec15be40 msgr2=0x7f5aec1fa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeaa00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aec15be40 0x7f5aec1fa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeaa00640 1 -- 172.21.15.17:0/4177660136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec0c8870 con 0x7f5aec0af8d0 2024-09-10T23:30:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5ae3e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5aec0b3360 0x7f5aec15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5aeaa00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec0af8d0 0x7f5aec0c6a00 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0b0040 tx=0x7f5adc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5ae3400640 1 -- 172.21.15.17:0/4177660136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0b2040 con 0x7f5aec0af8d0 2024-09-10T23:30:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5ae3400640 1 -- 172.21.15.17:0/4177660136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5adc005310 con 0x7f5aec0af8d0 2024-09-10T23:30:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec0cb010 con 0x7f5aec0af8d0 2024-09-10T23:30:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5ae3400640 1 -- 172.21.15.17:0/4177660136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0046d0 con 0x7f5aec0af8d0 2024-09-10T23:30:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.307+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec0cbad0 con 0x7f5aec0af8d0 2024-09-10T23:30:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.311+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aec0afce0 con 0x7f5aec0af8d0 2024-09-10T23:30:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.311+0000 7f5ae3400640 1 -- 172.21.15.17:0/4177660136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5adc004870 con 0x7f5aec0af8d0 2024-09-10T23:30:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.311+0000 7f5ae3400640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ac80725e0 0x7f5ac8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.311+0000 7f5ae3400640 1 -- 172.21.15.17:0/4177660136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f5adc12d2b0 con 0x7f5aec0af8d0 2024-09-10T23:30:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.311+0000 7f5ae3e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ac80725e0 0x7f5ac8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.311+0000 7f5ae3e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ac80725e0 0x7f5ac8074aa0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4007fd0 tx=0x7f5ad4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.315+0000 7f5ae3400640 1 -- 172.21.15.17:0/4177660136 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5adc0164b0 con 0x7f5aec0af8d0 2024-09-10T23:30:02.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.503+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5aec075590 con 0x7f5aec0af8d0 2024-09-10T23:30:02.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.503+0000 7f5ae3400640 1 -- 172.21.15.17:0/4177660136 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v189) ==== 80+0+0 (secure 0 0 0) 0x7f5adc0f87f0 con 0x7f5aec0af8d0 2024-09-10T23:30:02.506 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ac80725e0 msgr2=0x7f5ac8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ac80725e0 0x7f5ac8074aa0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4007fd0 tx=0x7f5ad4009040 comp rx=0 tx=0).stop 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec0af8d0 msgr2=0x7f5aec0c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec0af8d0 0x7f5aec0c6a00 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0b0040 tx=0x7f5adc004600 comp rx=0 tx=0).stop 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 shutdown_connections 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5ac80725e0 0x7f5ac8074aa0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aec15be40 0x7f5aec1fa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5aec0b3360 0x7f5aec15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 --2- 172.21.15.17:0/4177660136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5aec0af8d0 0x7f5aec0c6a00 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 >> 172.21.15.17:0/4177660136 conn(0x7f5aec0d1d60 msgr2=0x7f5aec165de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 shutdown_connections 2024-09-10T23:30:02.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.507+0000 7f5af1e00640 1 -- 172.21.15.17:0/4177660136 wait complete. 2024-09-10T23:30:02.528 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:30:02.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:02.529 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:30:02.547 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[86903]: fuse finished with error 0 and tester_r 0 2024-09-10T23:30:02.550 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:30:02.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:02.550 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:30:02.600 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:30:02.600 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:30:02.600 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:02.610 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:30:02.610 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:30:02.610 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:30:02.610 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:02.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:30:02.652 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:30:02.652 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:30:02.652 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:02.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:30:02.665 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:30:02.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.843+0000 7fd145800640 1 -- 172.21.15.17:0/4134825062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd140070ad0 msgr2=0x7fd14015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.843+0000 7fd145800640 1 --2- 172.21.15.17:0/4134825062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd140070ad0 0x7fd14015f060 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd1400cf010 tx=0x7fd13001cba0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.843+0000 7fd145800640 1 -- 172.21.15.17:0/4134825062 shutdown_connections 2024-09-10T23:30:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.843+0000 7fd145800640 1 --2- 172.21.15.17:0/4134825062 >> v2:172.21.15.77:3300/0 conn(0x7fd1400d1830 0x7fd14015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.843+0000 7fd145800640 1 --2- 172.21.15.17:0/4134825062 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd140070ad0 0x7fd14015f060 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.843+0000 7fd145800640 1 -- 172.21.15.17:0/4134825062 >> 172.21.15.17:0/4134825062 conn(0x7fd1400d1d60 msgr2=0x7fd1400d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.843+0000 7fd145800640 1 -- 172.21.15.17:0/4134825062 shutdown_connections 2024-09-10T23:30:02.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.843+0000 7fd145800640 1 -- 172.21.15.17:0/4134825062 wait complete. 2024-09-10T23:30:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 Processor -- start 2024-09-10T23:30:02.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 -- start start 2024-09-10T23:30:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd140070ad0 0x7fd14014fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1400cf320 0x7fd14006e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1400d1830 0x7fd14006f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd140169330 con 0x7fd1400d1830 2024-09-10T23:30:02.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1401691b0 con 0x7fd140070ad0 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1401694b0 con 0x7fd1400cf320 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1400d1830 0x7fd14006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1400d1830 0x7fd14006f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55358/0 (socket says 172.21.15.17:55358) 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13f400640 1 -- 172.21.15.17:0/365473696 learned_addr learned my addr 172.21.15.17:0/365473696 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13ea00640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd140070ad0 0x7fd14014fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd136000640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1400cf320 0x7fd14006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13f400640 1 -- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1400cf320 msgr2=0x7fd14006e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13f400640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1400cf320 0x7fd14006e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13f400640 1 -- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd140070ad0 msgr2=0x7fd14014fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13f400640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd140070ad0 0x7fd14014fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13f400640 1 -- 172.21.15.17:0/365473696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1400aede0 con 0x7fd1400d1830 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd136000640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1400cf320 0x7fd14006e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd13f400640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1400d1830 0x7fd14006f360 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fd13800c440 tx=0x7fd13800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd137400640 1 -- 172.21.15.17:0/365473696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138016020 con 0x7fd1400d1830 2024-09-10T23:30:02.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd137400640 1 -- 172.21.15.17:0/365473696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd138012940 con 0x7fd1400d1830 2024-09-10T23:30:02.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd140154470 con 0x7fd1400d1830 2024-09-10T23:30:02.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd137400640 1 -- 172.21.15.17:0/365473696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138012d90 con 0x7fd1400d1830 2024-09-10T23:30:02.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd140154a30 con 0x7fd1400d1830 2024-09-10T23:30:02.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.847+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1400cfc60 con 0x7fd1400d1830 2024-09-10T23:30:02.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.851+0000 7fd137400640 1 -- 172.21.15.17:0/365473696 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd13801b400 con 0x7fd1400d1830 2024-09-10T23:30:02.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.851+0000 7fd137400640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd11c0725e0 0x7fd11c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:02.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.851+0000 7fd137400640 1 -- 172.21.15.17:0/365473696 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fd138093390 con 0x7fd1400d1830 2024-09-10T23:30:02.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.851+0000 7fd13ea00640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd11c0725e0 0x7fd11c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:02.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.851+0000 7fd13ea00640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd11c0725e0 0x7fd11c074aa0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd1300af000 tx=0x7fd13001b3e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:02.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:02.855+0000 7fd137400640 1 -- 172.21.15.17:0/365473696 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd138020030 con 0x7fd1400d1830 2024-09-10T23:30:03.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.067+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd140150970 con 0x7fd1400d1830 2024-09-10T23:30:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.067+0000 7fd137400640 1 -- 172.21.15.17:0/365473696 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5236 (secure 0 0 0) 0x7fd1400aede0 con 0x7fd1400d1830 2024-09-10T23:30:03.069 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:03.069 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":144,"btime":"2024-09-10T23:29:25:379289+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3439807694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3439807694},{"type":"v1","addr":"172.21.15.77:6837","nonce":3439807694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":9772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2077624650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2077624650},{"type":"v1","addr":"172.21.15.77:6836","nonce":2077624650}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10638,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/294398472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":294398472},{"type":"v1","addr":"172.21.15.17:6834","nonce":294398472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:29:21.766077+0000","modified":"2024-09-10T23:29:24.781764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10641":{"gid":10641,"name":"c","rank":0,"incarnation":140,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4256418601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4256418601},{"type":"v1","addr":"172.21.15.17:6835","nonce":4256418601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10641,"qdb_cluster":[10641]},"id":13}]} 2024-09-10T23:30:03.069 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 144 2024-09-10T23:30:03.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.067+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd11c0725e0 msgr2=0x7fd11c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.067+0000 7fd145800640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd11c0725e0 0x7fd11c074aa0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd1300af000 tx=0x7fd13001b3e0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.067+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1400d1830 msgr2=0x7fd14006f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.067+0000 7fd145800640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1400d1830 0x7fd14006f360 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fd13800c440 tx=0x7fd13800c900 comp rx=0 tx=0).stop 2024-09-10T23:30:03.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.067+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 shutdown_connections 2024-09-10T23:30:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.067+0000 7fd145800640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd11c0725e0 0x7fd11c074aa0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.071+0000 7fd145800640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1400d1830 0x7fd14006f360 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.071+0000 7fd145800640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1400cf320 0x7fd14006e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.071+0000 7fd145800640 1 --2- 172.21.15.17:0/365473696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd140070ad0 0x7fd14014fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.071+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 >> 172.21.15.17:0/365473696 conn(0x7fd1400d1d60 msgr2=0x7fd1400d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.071+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 shutdown_connections 2024-09-10T23:30:03.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.071+0000 7fd145800640 1 -- 172.21.15.17:0/365473696 wait complete. 2024-09-10T23:30:03.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:30:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.235+0000 7f438ae00640 1 -- 172.21.15.17:0/2306819972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4368004810 msgr2=0x7f4368004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.235+0000 7f438ae00640 1 --2- 172.21.15.17:0/2306819972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4368004810 0x7f4368004c90 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f436c009b30 tx=0x7f436c01d230 comp rx=0 tx=0).stop 2024-09-10T23:30:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.235+0000 7f4388e00640 1 -- 172.21.15.17:0/2306819972 reap_dead start 2024-09-10T23:30:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.235+0000 7f438ae00640 1 -- 172.21.15.17:0/2306819972 shutdown_connections 2024-09-10T23:30:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.235+0000 7f438ae00640 1 -- 172.21.15.17:0/2306819972 >> 172.21.15.17:0/2306819972 conn(0x7f43840d1d10 msgr2=0x7f43840d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.235+0000 7f438ae00640 1 -- 172.21.15.17:0/2306819972 shutdown_connections 2024-09-10T23:30:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.235+0000 7f438ae00640 1 -- 172.21.15.17:0/2306819972 wait complete. 2024-09-10T23:30:03.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 Processor -- start 2024-09-10T23:30:03.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 -- start start 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4368004810 0x7f4384155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4384155b90 0x7f43840cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43840cbd20 0x7f43840ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43841608d0 con 0x7f4368004810 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43840b07c0 con 0x7f43840cbd20 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43840b1610 con 0x7f4384155b90 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4383e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4368004810 0x7f4384155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4383e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4368004810 0x7f4384155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55378/0 (socket says 172.21.15.17:55378) 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4383e00640 1 -- 172.21.15.17:0/1835921782 learned_addr learned my addr 172.21.15.17:0/1835921782 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4388e00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43840cbd20 0x7f43840ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f437be00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4384155b90 0x7f43840cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4383e00640 1 -- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4384155b90 msgr2=0x7f43840cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4383e00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4384155b90 0x7f43840cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4383e00640 1 -- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43840cbd20 msgr2=0x7f43840ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4383e00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43840cbd20 0x7f43840ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4383e00640 1 -- 172.21.15.17:0/1835921782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4384155550 con 0x7f4368004810 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4383e00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4368004810 0x7f4384155010 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f437400e5c0 tx=0x7f437400ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4380c00640 1 -- 172.21.15.17:0/1835921782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374015070 con 0x7f4368004810 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4380c00640 1 -- 172.21.15.17:0/1835921782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f437400ca00 con 0x7f4368004810 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f4380c00640 1 -- 172.21.15.17:0/1835921782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437400ce50 con 0x7f4368004810 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43840b09e0 con 0x7f4368004810 2024-09-10T23:30:03.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43840d2370 con 0x7f4368004810 2024-09-10T23:30:03.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.239+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43840cfaf0 con 0x7f4368004810 2024-09-10T23:30:03.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.243+0000 7f4380c00640 1 -- 172.21.15.17:0/1835921782 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4374011460 con 0x7f4368004810 2024-09-10T23:30:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.243+0000 7f4380c00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4360072780 0x7f4360074c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.243+0000 7f4380c00640 1 -- 172.21.15.17:0/1835921782 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f4374093aa0 con 0x7f4368004810 2024-09-10T23:30:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.243+0000 7f437be00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4360072780 0x7f4360074c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.243+0000 7f437be00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4360072780 0x7f4360074c40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f436c0ae000 tx=0x7f436c019fd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.247+0000 7f4380c00640 1 -- 172.21.15.17:0/1835921782 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4374095e20 con 0x7f4368004810 2024-09-10T23:30:03.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4384074af0 con 0x7f4368004810 2024-09-10T23:30:03.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f4380c00640 1 -- 172.21.15.17:0/1835921782 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5236 (secure 0 0 0) 0x7f4384155550 con 0x7f4368004810 2024-09-10T23:30:03.458 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:03.458 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":144,"btime":"2024-09-10T23:29:25:379289+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3439807694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3439807694},{"type":"v1","addr":"172.21.15.77:6837","nonce":3439807694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":9772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2077624650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2077624650},{"type":"v1","addr":"172.21.15.77:6836","nonce":2077624650}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10638,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/294398472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":294398472},{"type":"v1","addr":"172.21.15.17:6834","nonce":294398472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:29:21.766077+0000","modified":"2024-09-10T23:29:24.781764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10641":{"gid":10641,"name":"c","rank":0,"incarnation":140,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4256418601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4256418601},{"type":"v1","addr":"172.21.15.17:6835","nonce":4256418601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10641,"qdb_cluster":[10641]},"id":13}]} 2024-09-10T23:30:03.460 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 144 2024-09-10T23:30:03.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4360072780 msgr2=0x7f4360074c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4360072780 0x7f4360074c40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f436c0ae000 tx=0x7f436c019fd0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4368004810 msgr2=0x7f4384155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4368004810 0x7f4384155010 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f437400e5c0 tx=0x7f437400ea80 comp rx=0 tx=0).stop 2024-09-10T23:30:03.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 shutdown_connections 2024-09-10T23:30:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4360072780 0x7f4360074c40 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43840cbd20 0x7f43840ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4384155b90 0x7f43840cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 --2- 172.21.15.17:0/1835921782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4368004810 0x7f4384155010 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.455+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 >> 172.21.15.17:0/1835921782 conn(0x7f43840d1d10 msgr2=0x7f43840af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:03.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.459+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 shutdown_connections 2024-09-10T23:30:03.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.459+0000 7f438ae00640 1 -- 172.21.15.17:0/1835921782 wait complete. 2024-09-10T23:30:03.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:30:03.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.623+0000 7f7011800640 1 -- 172.21.15.17:0/260074508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0004d50 msgr2=0x7f6ff00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.623+0000 7f7011800640 1 --2- 172.21.15.17:0/260074508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0004d50 0x7f6ff00051d0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f7004009eb0 tx=0x7f700401d5f0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.623+0000 7f700b400640 1 -- 172.21.15.17:0/260074508 reap_dead start 2024-09-10T23:30:03.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.623+0000 7f7011800640 1 -- 172.21.15.17:0/260074508 shutdown_connections 2024-09-10T23:30:03.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.623+0000 7f7011800640 1 -- 172.21.15.17:0/260074508 >> 172.21.15.17:0/260074508 conn(0x7f700c0d1d60 msgr2=0x7f700c0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:03.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.623+0000 7f7011800640 1 -- 172.21.15.17:0/260074508 shutdown_connections 2024-09-10T23:30:03.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.623+0000 7f7011800640 1 -- 172.21.15.17:0/260074508 wait complete. 2024-09-10T23:30:03.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 Processor -- start 2024-09-10T23:30:03.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 -- start start 2024-09-10T23:30:03.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ff0004d50 0x7f700c1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c1573e0 0x7f700c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f700c157860 0x7f700c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f700c071030 con 0x7f700c1573e0 2024-09-10T23:30:03.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f700c070eb0 con 0x7f700c157860 2024-09-10T23:30:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f700c0711b0 con 0x7f6ff0004d50 2024-09-10T23:30:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c1573e0 0x7f700c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c1573e0 0x7f700c1569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55396/0 (socket says 172.21.15.17:55396) 2024-09-10T23:30:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700a000640 1 -- 172.21.15.17:0/4033882281 learned_addr learned my addr 172.21.15.17:0/4033882281 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700b400640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f700c157860 0x7f700c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700aa00640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ff0004d50 0x7f700c1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700a000640 1 -- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ff0004d50 msgr2=0x7f700c1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700a000640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ff0004d50 0x7f700c1546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700a000640 1 -- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f700c157860 msgr2=0x7f700c06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700a000640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f700c157860 0x7f700c06dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700a000640 1 -- 172.21.15.17:0/4033882281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c154c10 con 0x7f700c1573e0 2024-09-10T23:30:03.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f700a000640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c1573e0 0x7f700c1569a0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8011880 tx=0x7f6ff8011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:03.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7002a00640 1 -- 172.21.15.17:0/4033882281 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8004460 con 0x7f700c1573e0 2024-09-10T23:30:03.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7002a00640 1 -- 172.21.15.17:0/4033882281 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ff8016070 con 0x7f700c1573e0 2024-09-10T23:30:03.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7002a00640 1 -- 172.21.15.17:0/4033882281 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800fc50 con 0x7f700c1573e0 2024-09-10T23:30:03.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700c157d40 con 0x7f700c1573e0 2024-09-10T23:30:03.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f700c1561a0 con 0x7f700c1573e0 2024-09-10T23:30:03.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.627+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f700c15f060 con 0x7f700c1573e0 2024-09-10T23:30:03.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.631+0000 7f7002a00640 1 -- 172.21.15.17:0/4033882281 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6ff8003600 con 0x7f700c1573e0 2024-09-10T23:30:03.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.631+0000 7f7002a00640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6fec0725e0 0x7f6fec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.631+0000 7f7002a00640 1 -- 172.21.15.17:0/4033882281 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f6ff8093f10 con 0x7f700c1573e0 2024-09-10T23:30:03.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.631+0000 7f700aa00640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6fec0725e0 0x7f6fec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.631+0000 7f700aa00640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6fec0725e0 0x7f6fec074aa0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc001ec0 tx=0x7f6ffc001540 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:03.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.635+0000 7f7002a00640 1 -- 172.21.15.17:0/4033882281 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6ff805ed70 con 0x7f700c1573e0 2024-09-10T23:30:03.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f700c15d3d0 con 0x7f700c1573e0 2024-09-10T23:30:03.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7002a00640 1 -- 172.21.15.17:0/4033882281 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) ==== 74+0+16952 (secure 0 0 0) 0x7f6ff80637a0 con 0x7f700c1573e0 2024-09-10T23:30:03.817 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:03.817 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":189,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:29:23.353839+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:29:19.490385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-10T23:29:20.728719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:30:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6fec0725e0 msgr2=0x7f6fec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6fec0725e0 0x7f6fec074aa0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc001ec0 tx=0x7f6ffc001540 comp rx=0 tx=0).stop 2024-09-10T23:30:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c1573e0 msgr2=0x7f700c1569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c1573e0 0x7f700c1569a0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8011880 tx=0x7f6ff8011d40 comp rx=0 tx=0).stop 2024-09-10T23:30:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 shutdown_connections 2024-09-10T23:30:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6fec0725e0 0x7f6fec074aa0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f700c157860 0x7f700c06dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f700c1573e0 0x7f700c1569a0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 --2- 172.21.15.17:0/4033882281 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6ff0004d50 0x7f700c1546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.815+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 >> 172.21.15.17:0/4033882281 conn(0x7f700c0d1d60 msgr2=0x7f700c0b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.819+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 shutdown_connections 2024-09-10T23:30:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.819+0000 7f7011800640 1 -- 172.21.15.17:0/4033882281 wait complete. 2024-09-10T23:30:03.839 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:30:03.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:30:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.983+0000 7fa82c800640 1 -- 172.21.15.17:0/87490753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa824070ad0 msgr2=0x7fa82415f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.983+0000 7fa82c800640 1 --2- 172.21.15.17:0/87490753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa824070ad0 0x7fa82415f060 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7fa8240b7de0 tx=0x7fa81801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.983+0000 7fa82c800640 1 -- 172.21.15.17:0/87490753 shutdown_connections 2024-09-10T23:30:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.983+0000 7fa82c800640 1 --2- 172.21.15.17:0/87490753 >> v2:172.21.15.77:3300/0 conn(0x7fa8240cf320 0x7fa8240cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.983+0000 7fa82c800640 1 --2- 172.21.15.17:0/87490753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa824070ad0 0x7fa82415f060 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.983+0000 7fa82c800640 1 -- 172.21.15.17:0/87490753 >> 172.21.15.17:0/87490753 conn(0x7fa8240d1d60 msgr2=0x7fa8240d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.983+0000 7fa82c800640 1 -- 172.21.15.17:0/87490753 shutdown_connections 2024-09-10T23:30:03.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.983+0000 7fa82c800640 1 -- 172.21.15.17:0/87490753 wait complete. 2024-09-10T23:30:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 Processor -- start 2024-09-10T23:30:03.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 -- start start 2024-09-10T23:30:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa824070ad0 0x7fa824151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240cf320 0x7fa824151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8240d1830 0x7fa82415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa824169320 con 0x7fa8240cf320 2024-09-10T23:30:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8241691a0 con 0x7fa8240d1830 2024-09-10T23:30:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8241694a0 con 0x7fa824070ad0 2024-09-10T23:30:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240cf320 0x7fa824151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240cf320 0x7fa824151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55418/0 (socket says 172.21.15.17:55418) 2024-09-10T23:30:03.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829400640 1 -- 172.21.15.17:0/1689601229 learned_addr learned my addr 172.21.15.17:0/1689601229 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829e00640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa824070ad0 0x7fa824151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82a800640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8240d1830 0x7fa82415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829400640 1 -- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa824070ad0 msgr2=0x7fa824151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829400640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa824070ad0 0x7fa824151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829400640 1 -- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8240d1830 msgr2=0x7fa82415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829400640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8240d1830 0x7fa82415dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829400640 1 -- 172.21.15.17:0/1689601229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa824156da0 con 0x7fa8240cf320 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829e00640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa824070ad0 0x7fa824151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa829400640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240cf320 0x7fa824151150 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c3c0 tx=0x7fa81400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa81e000640 1 -- 172.21.15.17:0/1689601229 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814017070 con 0x7fa8240cf320 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa81e000640 1 -- 172.21.15.17:0/1689601229 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8140053c0 con 0x7fa8240cf320 2024-09-10T23:30:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa81e000640 1 -- 172.21.15.17:0/1689601229 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814003860 con 0x7fa8240cf320 2024-09-10T23:30:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa824157080 con 0x7fa8240cf320 2024-09-10T23:30:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8240c7150 con 0x7fa8240cf320 2024-09-10T23:30:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.987+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82415f060 con 0x7fa8240cf320 2024-09-10T23:30:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.991+0000 7fa81e000640 1 -- 172.21.15.17:0/1689601229 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa814003a00 con 0x7fa8240cf320 2024-09-10T23:30:03.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.991+0000 7fa81e000640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8080725e0 0x7fa808074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:03.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.991+0000 7fa81e000640 1 -- 172.21.15.17:0/1689601229 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fa8140929c0 con 0x7fa8240cf320 2024-09-10T23:30:03.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.991+0000 7fa829e00640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8080725e0 0x7fa808074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.991+0000 7fa829e00640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8080725e0 0x7fa808074aa0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa8180af000 tx=0x7fa81801b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:03.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:03.995+0000 7fa81e000640 1 -- 172.21.15.17:0/1689601229 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa81405df00 con 0x7fa8240cf320 2024-09-10T23:30:04.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.207+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa82409fde0 con 0x7fa8240cf320 2024-09-10T23:30:04.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.207+0000 7fa81e000640 1 -- 172.21.15.17:0/1689601229 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5236 (secure 0 0 0) 0x7fa81405d800 con 0x7fa8240cf320 2024-09-10T23:30:04.210 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:04.210 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":144,"btime":"2024-09-10T23:29:25:379289+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3439807694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3439807694},{"type":"v1","addr":"172.21.15.77:6837","nonce":3439807694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":9772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2077624650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2077624650},{"type":"v1","addr":"172.21.15.77:6836","nonce":2077624650}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10638,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/294398472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":294398472},{"type":"v1","addr":"172.21.15.17:6834","nonce":294398472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:29:21.766077+0000","modified":"2024-09-10T23:29:24.781764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10641":{"gid":10641,"name":"c","rank":0,"incarnation":140,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4256418601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4256418601},{"type":"v1","addr":"172.21.15.17:6835","nonce":4256418601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10641,"qdb_cluster":[10641]},"id":13}]} 2024-09-10T23:30:04.210 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 144 2024-09-10T23:30:04.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8080725e0 msgr2=0x7fa808074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8080725e0 0x7fa808074aa0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa8180af000 tx=0x7fa81801b100 comp rx=0 tx=0).stop 2024-09-10T23:30:04.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240cf320 msgr2=0x7fa824151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240cf320 0x7fa824151150 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c3c0 tx=0x7fa81400c880 comp rx=0 tx=0).stop 2024-09-10T23:30:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 shutdown_connections 2024-09-10T23:30:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8080725e0 0x7fa808074aa0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8240d1830 0x7fa82415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8240cf320 0x7fa824151150 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 --2- 172.21.15.17:0/1689601229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa824070ad0 0x7fa824151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 >> 172.21.15.17:0/1689601229 conn(0x7fa8240d1d60 msgr2=0x7fa824158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 shutdown_connections 2024-09-10T23:30:04.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.211+0000 7fa82c800640 1 -- 172.21.15.17:0/1689601229 wait complete. 2024-09-10T23:30:04.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:30:04.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.375+0000 7ff330000640 1 -- 172.21.15.17:0/2553127910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff310004dc0 msgr2=0x7ff310005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.375+0000 7ff330000640 1 --2- 172.21.15.17:0/2553127910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff310004dc0 0x7ff310005240 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7ff320009eb0 tx=0x7ff32001d5b0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.375+0000 7ff32e000640 1 -- 172.21.15.17:0/2553127910 reap_dead start 2024-09-10T23:30:04.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.375+0000 7ff330000640 1 -- 172.21.15.17:0/2553127910 shutdown_connections 2024-09-10T23:30:04.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.375+0000 7ff330000640 1 -- 172.21.15.17:0/2553127910 >> 172.21.15.17:0/2553127910 conn(0x7ff3280d1d60 msgr2=0x7ff3280d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 -- 172.21.15.17:0/2553127910 shutdown_connections 2024-09-10T23:30:04.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 -- 172.21.15.17:0/2553127910 wait complete. 2024-09-10T23:30:04.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 Processor -- start 2024-09-10T23:30:04.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 -- start start 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff310004dc0 0x7ff3281f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3280b3300 0x7ff32815df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3280c8330 0x7ff3280b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff328071030 con 0x7ff310004dc0 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff328070eb0 con 0x7ff3280b3300 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff3280711b0 con 0x7ff3280c8330 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff310004dc0 0x7ff3281f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff310004dc0 0x7ff3281f8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55426/0 (socket says 172.21.15.17:55426) 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32d600640 1 -- 172.21.15.17:0/1040731938 learned_addr learned my addr 172.21.15.17:0/1040731938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32e000640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3280c8330 0x7ff3280b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32cc00640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3280b3300 0x7ff32815df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32d600640 1 -- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3280c8330 msgr2=0x7ff3280b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32d600640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3280c8330 0x7ff3280b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32d600640 1 -- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3280b3300 msgr2=0x7ff32815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32d600640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3280b3300 0x7ff32815df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32d600640 1 -- 172.21.15.17:0/1040731938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3281f4900 con 0x7ff310004dc0 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff32d600640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff310004dc0 0x7ff3281f8760 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7ff31c003e20 tx=0x7ff31c001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff325600640 1 -- 172.21.15.17:0/1040731938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c011700 con 0x7ff310004dc0 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff325600640 1 -- 172.21.15.17:0/1040731938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff31c016020 con 0x7ff310004dc0 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff325600640 1 -- 172.21.15.17:0/1040731938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c011b80 con 0x7ff310004dc0 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3281f4be0 con 0x7ff310004dc0 2024-09-10T23:30:04.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.379+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3281f51a0 con 0x7ff310004dc0 2024-09-10T23:30:04.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.383+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32815f060 con 0x7ff310004dc0 2024-09-10T23:30:04.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.383+0000 7ff325600640 1 -- 172.21.15.17:0/1040731938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff31c01b410 con 0x7ff310004dc0 2024-09-10T23:30:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.383+0000 7ff325600640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff308072610 0x7ff308074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.383+0000 7ff325600640 1 -- 172.21.15.17:0/1040731938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7ff31c094150 con 0x7ff310004dc0 2024-09-10T23:30:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.383+0000 7ff32cc00640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff308072610 0x7ff308074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.387+0000 7ff32cc00640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff308072610 0x7ff308074ad0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff314001060 tx=0x7ff314004460 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.387+0000 7ff325600640 1 -- 172.21.15.17:0/1040731938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff31c020020 con 0x7ff310004dc0 2024-09-10T23:30:04.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.595+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff32806f8d0 con 0x7ff310004dc0 2024-09-10T23:30:04.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.595+0000 7ff325600640 1 -- 172.21.15.17:0/1040731938 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) ==== 95+0+5236 (secure 0 0 0) 0x7ff31c05f690 con 0x7ff310004dc0 2024-09-10T23:30:04.599 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:04.599 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":144,"btime":"2024-09-10T23:29:25:379289+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3439807694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3439807694},{"type":"v1","addr":"172.21.15.77:6837","nonce":3439807694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":9772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2077624650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2077624650},{"type":"v1","addr":"172.21.15.77:6836","nonce":2077624650}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10638,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/294398472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":294398472},{"type":"v1","addr":"172.21.15.17:6834","nonce":294398472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:29:21.766077+0000","modified":"2024-09-10T23:29:24.781764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10641},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10641":{"gid":10641,"name":"c","rank":0,"incarnation":140,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/4256418601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":4256418601},{"type":"v1","addr":"172.21.15.17:6835","nonce":4256418601}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10641,"qdb_cluster":[10641]},"id":13}]} 2024-09-10T23:30:04.599 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 144 2024-09-10T23:30:04.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff308072610 msgr2=0x7ff308074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff308072610 0x7ff308074ad0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff314001060 tx=0x7ff314004460 comp rx=0 tx=0).stop 2024-09-10T23:30:04.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff310004dc0 msgr2=0x7ff3281f8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff310004dc0 0x7ff3281f8760 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7ff31c003e20 tx=0x7ff31c001810 comp rx=0 tx=0).stop 2024-09-10T23:30:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 shutdown_connections 2024-09-10T23:30:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff308072610 0x7ff308074ad0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3280c8330 0x7ff3280b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3280b3300 0x7ff32815df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 --2- 172.21.15.17:0/1040731938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff310004dc0 0x7ff3281f8760 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 >> 172.21.15.17:0/1040731938 conn(0x7ff3280d1d60 msgr2=0x7ff3280b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 shutdown_connections 2024-09-10T23:30:04.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.599+0000 7ff330000640 1 -- 172.21.15.17:0/1040731938 wait complete. 2024-09-10T23:30:04.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:30:04.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.767+0000 7f57d5e00640 1 -- 172.21.15.17:0/1777218435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00b31c0 msgr2=0x7f57d006e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.767+0000 7f57d5e00640 1 --2- 172.21.15.17:0/1777218435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00b31c0 0x7f57d006e750 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f57d00b5120 tx=0x7f57c801cd60 comp rx=0 tx=0).stop 2024-09-10T23:30:04.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.767+0000 7f57d5e00640 1 -- 172.21.15.17:0/1777218435 shutdown_connections 2024-09-10T23:30:04.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.767+0000 7f57d5e00640 1 --2- 172.21.15.17:0/1777218435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00b31c0 0x7f57d006e750 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.767+0000 7f57d5e00640 1 --2- 172.21.15.17:0/1777218435 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57d013ccc0 0x7f57d00b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.767+0000 7f57d5e00640 1 --2- 172.21.15.17:0/1777218435 >> v2:172.21.15.77:3300/0 conn(0x7f57d00707e0 0x7f57d013c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.767+0000 7f57d5e00640 1 -- 172.21.15.17:0/1777218435 >> 172.21.15.17:0/1777218435 conn(0x7f57d006cfc0 msgr2=0x7f57d006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.767+0000 7f57d5e00640 1 -- 172.21.15.17:0/1777218435 shutdown_connections 2024-09-10T23:30:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.767+0000 7f57d5e00640 1 -- 172.21.15.17:0/1777218435 wait complete. 2024-09-10T23:30:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 Processor -- start 2024-09-10T23:30:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 -- start start 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00707e0 0x7f57d014ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57d00b31c0 0x7f57d013e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57d013ccc0 0x7f57d013e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f57d006f520 con 0x7f57d00707e0 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f57d006f3a0 con 0x7f57d00b31c0 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f57d015a370 con 0x7f57d013ccc0 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00707e0 0x7f57d014ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00707e0 0x7f57d014ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55444/0 (socket says 172.21.15.17:55444) 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cea00640 1 -- 172.21.15.17:0/4031834353 learned_addr learned my addr 172.21.15.17:0/4031834353 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57c7e00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57d00b31c0 0x7f57d013e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cf400640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57d013ccc0 0x7f57d013e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cea00640 1 -- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57d013ccc0 msgr2=0x7f57d013e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cea00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57d013ccc0 0x7f57d013e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cea00640 1 -- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57d00b31c0 msgr2=0x7f57d013e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cea00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57d00b31c0 0x7f57d013e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cea00640 1 -- 172.21.15.17:0/4031834353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d014f4a0 con 0x7f57d00707e0 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57cea00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00707e0 0x7f57d014ef60 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d7a0 tx=0x7f57c000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57c7400640 1 -- 172.21.15.17:0/4031834353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0017070 con 0x7f57d00707e0 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57c7400640 1 -- 172.21.15.17:0/4031834353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57c0009d20 con 0x7f57d00707e0 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57c7400640 1 -- 172.21.15.17:0/4031834353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c00106c0 con 0x7f57d00707e0 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d01f87d0 con 0x7f57d00707e0 2024-09-10T23:30:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d0151c50 con 0x7f57d00707e0 2024-09-10T23:30:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.771+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d006e750 con 0x7f57d00707e0 2024-09-10T23:30:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.775+0000 7f57c7400640 1 -- 172.21.15.17:0/4031834353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f57c0010860 con 0x7f57d00707e0 2024-09-10T23:30:04.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.775+0000 7f57c7400640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f57ac0725e0 0x7f57ac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:04.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.775+0000 7f57c7400640 1 -- 172.21.15.17:0/4031834353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f57c0093780 con 0x7f57d00707e0 2024-09-10T23:30:04.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.775+0000 7f57c7e00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f57ac0725e0 0x7f57ac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:04.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.775+0000 7f57c7e00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f57ac0725e0 0x7f57ac074aa0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f57d01502d0 tx=0x7f57b800b3e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:04.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.779+0000 7f57c7400640 1 -- 172.21.15.17:0/4031834353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f57c005e670 con 0x7f57d00707e0 2024-09-10T23:30:04.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.955+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57d0150f40 con 0x7f57d00707e0 2024-09-10T23:30:04.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.955+0000 7f57c7400640 1 -- 172.21.15.17:0/4031834353 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) ==== 74+0+16952 (secure 0 0 0) 0x7f57c00630a0 con 0x7f57d00707e0 2024-09-10T23:30:04.959 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:04.959 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":189,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:29:23.353839+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:29:19.490385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-10T23:29:20.728719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:30:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f57ac0725e0 msgr2=0x7f57ac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f57ac0725e0 0x7f57ac074aa0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f57d01502d0 tx=0x7f57b800b3e0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00707e0 msgr2=0x7f57d014ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00707e0 0x7f57d014ef60 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d7a0 tx=0x7f57c000dc60 comp rx=0 tx=0).stop 2024-09-10T23:30:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 shutdown_connections 2024-09-10T23:30:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f57ac0725e0 0x7f57ac074aa0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57d013ccc0 0x7f57d013e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57d00b31c0 0x7f57d013e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 --2- 172.21.15.17:0/4031834353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57d00707e0 0x7f57d014ef60 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 >> 172.21.15.17:0/4031834353 conn(0x7f57d006cfc0 msgr2=0x7f57d00727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 shutdown_connections 2024-09-10T23:30:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:04.959+0000 7f57d5e00640 1 -- 172.21.15.17:0/4031834353 wait complete. 2024-09-10T23:30:04.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:30:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.127+0000 7f4e18c00640 1 -- 172.21.15.17:0/3521438060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e140d1990 msgr2=0x7f4e140d1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.127+0000 7f4e18c00640 1 --2- 172.21.15.17:0/3521438060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e140d1990 0x7f4e140d1dc0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f4e140cf620 tx=0x7f4e0c01cd80 comp rx=0 tx=0).stop 2024-09-10T23:30:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.127+0000 7f4e18c00640 1 -- 172.21.15.17:0/3521438060 shutdown_connections 2024-09-10T23:30:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.127+0000 7f4e18c00640 1 --2- 172.21.15.17:0/3521438060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e140d1990 0x7f4e140d1dc0 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.127+0000 7f4e18c00640 1 --2- 172.21.15.17:0/3521438060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e1415bd60 0x7f4e140cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.127+0000 7f4e18c00640 1 --2- 172.21.15.17:0/3521438060 >> v2:172.21.15.77:3300/0 conn(0x7f4e1415b980 0x7f4e140cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.127+0000 7f4e18c00640 1 -- 172.21.15.17:0/3521438060 >> 172.21.15.17:0/3521438060 conn(0x7f4e1409a9f0 msgr2=0x7f4e1409add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.127+0000 7f4e18c00640 1 -- 172.21.15.17:0/3521438060 shutdown_connections 2024-09-10T23:30:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.127+0000 7f4e18c00640 1 -- 172.21.15.17:0/3521438060 wait complete. 2024-09-10T23:30:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 Processor -- start 2024-09-10T23:30:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 -- start start 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e140d1990 0x7f4e1406f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e1415b980 0x7f4e140b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e1415bd60 0x7f4e141fa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4e140b1270 con 0x7f4e1415bd60 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e140b10f0 con 0x7f4e1415b980 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4e140b13f0 con 0x7f4e140d1990 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e1415bd60 0x7f4e141fa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e1415bd60 0x7f4e141fa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55466/0 (socket says 172.21.15.17:55466) 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13e00640 1 -- 172.21.15.17:0/1774825650 learned_addr learned my addr 172.21.15.17:0/1774825650 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:05.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e0be00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e1415b980 0x7f4e140b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13400640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e140d1990 0x7f4e1406f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13e00640 1 -- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e140d1990 msgr2=0x7f4e1406f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13e00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e140d1990 0x7f4e1406f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13e00640 1 -- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e1415b980 msgr2=0x7f4e140b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13e00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e1415b980 0x7f4e140b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13e00640 1 -- 172.21.15.17:0/1774825650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1406a150 con 0x7f4e1415bd60 2024-09-10T23:30:05.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e13e00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e1415bd60 0x7f4e141fa900 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c01b430 tx=0x7f4e0c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e0b400640 1 -- 172.21.15.17:0/1774825650 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0bb070 con 0x7f4e1415bd60 2024-09-10T23:30:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e0b400640 1 -- 172.21.15.17:0/1774825650 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e0c004b40 con 0x7f4e1415bd60 2024-09-10T23:30:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e0b400640 1 -- 172.21.15.17:0/1774825650 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0b2040 con 0x7f4e1415bd60 2024-09-10T23:30:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1406fcd0 con 0x7f4e1415bd60 2024-09-10T23:30:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.131+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e141fb5c0 con 0x7f4e1415bd60 2024-09-10T23:30:05.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.135+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e141fb7c0 con 0x7f4e1415bd60 2024-09-10T23:30:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.135+0000 7f4e0b400640 1 -- 172.21.15.17:0/1774825650 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4e0c0b5030 con 0x7f4e1415bd60 2024-09-10T23:30:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.135+0000 7f4e0b400640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df0072610 0x7f4df0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:05.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.135+0000 7f4e0b400640 1 -- 172.21.15.17:0/1774825650 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f4e0c12cdc0 con 0x7f4e1415bd60 2024-09-10T23:30:05.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.135+0000 7f4e13400640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df0072610 0x7f4df0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:05.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.135+0000 7f4e13400640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df0072610 0x7f4df0074ad0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009b60 tx=0x7f4e040091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.139+0000 7f4e0b400640 1 -- 172.21.15.17:0/1774825650 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4e141fb7c0 con 0x7f4e1415bd60 2024-09-10T23:30:05.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.347+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4e140cf940 con 0x7f4e1415bd60 2024-09-10T23:30:05.351 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:30:05.351+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:30:05.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.351+0000 7f4e0b400640 1 -- 172.21.15.17:0/1774825650 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v145) ==== 161+0+0 (secure 0 0 0) 0x7f4e0c016970 con 0x7f4e1415bd60 2024-09-10T23:30:05.353 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:30:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df0072610 msgr2=0x7f4df0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df0072610 0x7f4df0074ad0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009b60 tx=0x7f4e040091e0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e1415bd60 msgr2=0x7f4e141fa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e1415bd60 0x7f4e141fa900 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c01b430 tx=0x7f4e0c003f60 comp rx=0 tx=0).stop 2024-09-10T23:30:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 shutdown_connections 2024-09-10T23:30:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4df0072610 0x7f4df0074ad0 secure :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009b60 tx=0x7f4e040091e0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e1415bd60 0x7f4e141fa900 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e1415b980 0x7f4e140b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 --2- 172.21.15.17:0/1774825650 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e140d1990 0x7f4e1406f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 >> 172.21.15.17:0/1774825650 conn(0x7f4e1409a9f0 msgr2=0x7f4e140af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:05.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 shutdown_connections 2024-09-10T23:30:05.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.355+0000 7f4e18c00640 1 -- 172.21.15.17:0/1774825650 wait complete. 2024-09-10T23:30:05.362 INFO:tasks.ceph.mds.c.smithi017.stderr: -2249> 2024-09-10T23:29:27.616+0000 7f2ed2a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:30:05.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:30:05.409 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:30:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.523+0000 7f3658a00640 1 -- 172.21.15.17:0/2923368729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f36540b31b0 msgr2=0x7f36540cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.523+0000 7f3658a00640 1 --2- 172.21.15.17:0/2923368729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f36540b31b0 0x7f36540cc8b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f36540cec20 tx=0x7f364c01cba0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.523+0000 7f3658a00640 1 -- 172.21.15.17:0/2923368729 shutdown_connections 2024-09-10T23:30:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.523+0000 7f3658a00640 1 --2- 172.21.15.17:0/2923368729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f36540b31b0 0x7f36540cc8b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.523+0000 7f3658a00640 1 --2- 172.21.15.17:0/2923368729 >> v2:172.21.15.77:3300/0 conn(0x7f36540b2540 0x7f36540d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.523+0000 7f3658a00640 1 -- 172.21.15.17:0/2923368729 >> 172.21.15.17:0/2923368729 conn(0x7f36540d1da0 msgr2=0x7f36540d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:05.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.523+0000 7f3658a00640 1 -- 172.21.15.17:0/2923368729 shutdown_connections 2024-09-10T23:30:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.523+0000 7f3658a00640 1 -- 172.21.15.17:0/2923368729 wait complete. 2024-09-10T23:30:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 Processor -- start 2024-09-10T23:30:05.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 -- start start 2024-09-10T23:30:05.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36540b2540 0x7f365414ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36540b31b0 0x7f3654156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f365415f400 0x7f36541f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3654168c60 con 0x7f36540b31b0 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f36540cdc50 con 0x7f36540b2540 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3654168de0 con 0x7f365415f400 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3649400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36540b31b0 0x7f3654156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3649400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36540b31b0 0x7f3654156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55478/0 (socket says 172.21.15.17:55478) 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3649400640 1 -- 172.21.15.17:0/79134654 learned_addr learned my addr 172.21.15.17:0/79134654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3651e00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36540b2540 0x7f365414ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:05.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3652800640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f365415f400 0x7f36541f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:05.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3649400640 1 -- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f365415f400 msgr2=0x7f36541f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3649400640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f365415f400 0x7f36541f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3649400640 1 -- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36540b2540 msgr2=0x7f365414ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3649400640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36540b2540 0x7f365414ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3649400640 1 -- 172.21.15.17:0/79134654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365415a550 con 0x7f36540b31b0 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3649400640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36540b31b0 0x7f3654156b60 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f363c00ea20 tx=0x7f363c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f364aa00640 1 -- 172.21.15.17:0/79134654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c00cd80 con 0x7f36540b31b0 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f364aa00640 1 -- 172.21.15.17:0/79134654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f363c010430 con 0x7f36540b31b0 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365415a830 con 0x7f36540b31b0 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f364aa00640 1 -- 172.21.15.17:0/79134654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c010860 con 0x7f36540b31b0 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.527+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365415adf0 con 0x7f36540b31b0 2024-09-10T23:30:05.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.531+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36540cc8b0 con 0x7f36540b31b0 2024-09-10T23:30:05.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.531+0000 7f364aa00640 1 -- 172.21.15.17:0/79134654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f363c029080 con 0x7f36540b31b0 2024-09-10T23:30:05.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.531+0000 7f364aa00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f36300725e0 0x7f3630074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:05.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.531+0000 7f364aa00640 1 -- 172.21.15.17:0/79134654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6187+0+0 (secure 0 0 0) 0x7f363c094430 con 0x7f36540b31b0 2024-09-10T23:30:05.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.531+0000 7f3651e00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f36300725e0 0x7f3630074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:05.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.535+0000 7f3651e00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f36300725e0 0x7f3630074aa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3644007fd0 tx=0x7f3644007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:05.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.535+0000 7f364aa00640 1 -- 172.21.15.17:0/79134654 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f363c05f350 con 0x7f36540b31b0 2024-09-10T23:30:05.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:05.743+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3654158d20 con 0x7f36540b31b0 2024-09-10T23:30:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.351+0000 7f364aa00640 1 -- 172.21.15.17:0/79134654 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v146) ==== 104+0+0 (secure 0 0 0) 0x7f363c063d80 con 0x7f36540b31b0 2024-09-10T23:30:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f36300725e0 msgr2=0x7f3630074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f36300725e0 0x7f3630074aa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3644007fd0 tx=0x7f3644007ec0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36540b31b0 msgr2=0x7f3654156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36540b31b0 0x7f3654156b60 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f363c00ea20 tx=0x7f363c00eee0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 shutdown_connections 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f36300725e0 0x7f3630074aa0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f365415f400 0x7f36541f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36540b31b0 0x7f3654156b60 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 --2- 172.21.15.17:0/79134654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36540b2540 0x7f365414ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 >> 172.21.15.17:0/79134654 conn(0x7f36540d1da0 msgr2=0x7f365415c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 shutdown_connections 2024-09-10T23:30:06.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.355+0000 7f3658a00640 1 -- 172.21.15.17:0/79134654 wait complete. 2024-09-10T23:30:06.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:30:06.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 -- 172.21.15.17:0/1988085400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cf4005920 msgr2=0x7f6cf4005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:06.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 --2- 172.21.15.17:0/1988085400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cf4005920 0x7f6cf4005da0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8001690 tx=0x7f6cf801c6e0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d15200640 1 -- 172.21.15.17:0/1988085400 reap_dead start 2024-09-10T23:30:06.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 -- 172.21.15.17:0/1988085400 shutdown_connections 2024-09-10T23:30:06.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 -- 172.21.15.17:0/1988085400 >> 172.21.15.17:0/1988085400 conn(0x7f6d100b17a0 msgr2=0x7f6d100b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:06.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 -- 172.21.15.17:0/1988085400 shutdown_connections 2024-09-10T23:30:06.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 -- 172.21.15.17:0/1988085400 wait complete. 2024-09-10T23:30:06.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 Processor -- start 2024-09-10T23:30:06.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 -- start start 2024-09-10T23:30:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cf4005920 0x7f6d101f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d101e8350 0x7f6d1013fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d1015aa40 0x7f6d1015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1015a800 con 0x7f6cf4005920 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1015a680 con 0x7f6d1015aa40 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d17200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1006e6f0 con 0x7f6d101e8350 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cf4005920 0x7f6d101f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cf4005920 0x7f6d101f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55498/0 (socket says 172.21.15.17:55498) 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d0fe00640 1 -- 172.21.15.17:0/4094355756 learned_addr learned my addr 172.21.15.17:0/4094355756 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d15200640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d1015aa40 0x7f6d1015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d07400640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d101e8350 0x7f6d1013fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d0fe00640 1 -- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d101e8350 msgr2=0x7f6d1013fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d0fe00640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d101e8350 0x7f6d1013fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d0fe00640 1 -- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d1015aa40 msgr2=0x7f6d1015aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d0fe00640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d1015aa40 0x7f6d1015aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d0fe00640 1 -- 172.21.15.17:0/4094355756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d101405c0 con 0x7f6cf4005920 2024-09-10T23:30:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.583+0000 7f6d15200640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d1015aa40 0x7f6d1015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d0fe00640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cf4005920 0x7f6d101f3040 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f6d00012690 tx=0x7f6d00012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d0cc00640 1 -- 172.21.15.17:0/4094355756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00010b40 con 0x7f6cf4005920 2024-09-10T23:30:06.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d0cc00640 1 -- 172.21.15.17:0/4094355756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d00017030 con 0x7f6cf4005920 2024-09-10T23:30:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d101f5c30 con 0x7f6cf4005920 2024-09-10T23:30:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d0cc00640 1 -- 172.21.15.17:0/4094355756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00012e90 con 0x7f6cf4005920 2024-09-10T23:30:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d101f61f0 con 0x7f6cf4005920 2024-09-10T23:30:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d100b2aa0 con 0x7f6cf4005920 2024-09-10T23:30:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d0cc00640 1 -- 172.21.15.17:0/4094355756 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6d00013450 con 0x7f6cf4005920 2024-09-10T23:30:06.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d0cc00640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cec0727b0 0x7f6cec074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:06.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.587+0000 7f6d0cc00640 1 -- 172.21.15.17:0/4094355756 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 6187+0+0 (secure 0 0 0) 0x7f6d00096f90 con 0x7f6cf4005920 2024-09-10T23:30:06.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.591+0000 7f6d07400640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cec0727b0 0x7f6cec074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:06.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.591+0000 7f6d07400640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cec0727b0 0x7f6cec074c70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8001660 tx=0x7f6cf80a8040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:06.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.595+0000 7f6d0cc00640 1 -- 172.21.15.17:0/4094355756 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6d00062480 con 0x7f6cf4005920 2024-09-10T23:30:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:06.771+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d1015d010 con 0x7f6cf4005920 2024-09-10T23:30:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.627+0000 7f6d0cc00640 1 -- 172.21.15.17:0/4094355756 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v191) ==== 181+0+0 (secure 0 0 0) 0x7f6d00061d80 con 0x7f6cf4005920 2024-09-10T23:30:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:30:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cec0727b0 msgr2=0x7f6cec074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cec0727b0 0x7f6cec074c70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8001660 tx=0x7f6cf80a8040 comp rx=0 tx=0).stop 2024-09-10T23:30:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cf4005920 msgr2=0x7f6d101f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cf4005920 0x7f6d101f3040 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f6d00012690 tx=0x7f6d00012b50 comp rx=0 tx=0).stop 2024-09-10T23:30:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 shutdown_connections 2024-09-10T23:30:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6cec0727b0 0x7f6cec074c70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d1015aa40 0x7f6d1015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6d101e8350 0x7f6d1013fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 --2- 172.21.15.17:0/4094355756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cf4005920 0x7f6d101f3040 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 >> 172.21.15.17:0/4094355756 conn(0x7f6d100b17a0 msgr2=0x7f6d101565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 shutdown_connections 2024-09-10T23:30:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.631+0000 7f6d17200640 1 -- 172.21.15.17:0/4094355756 wait complete. 2024-09-10T23:30:07.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:30:07.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 -- 172.21.15.17:0/4162543337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 msgr2=0x7f4aa40ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 --2- 172.21.15.17:0/4162543337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 0x7f4aa40ccb60 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009bc0 tx=0x7f4a9c01cba0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 -- 172.21.15.17:0/4162543337 shutdown_connections 2024-09-10T23:30:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 --2- 172.21.15.17:0/4162543337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 0x7f4aa40ccb60 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 --2- 172.21.15.17:0/4162543337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aa40cf040 0x7f4aa40cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 -- 172.21.15.17:0/4162543337 >> 172.21.15.17:0/4162543337 conn(0x7f4aa40b17a0 msgr2=0x7f4aa40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 -- 172.21.15.17:0/4162543337 shutdown_connections 2024-09-10T23:30:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 -- 172.21.15.17:0/4162543337 wait complete. 2024-09-10T23:30:07.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 Processor -- start 2024-09-10T23:30:07.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 -- start start 2024-09-10T23:30:07.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 0x7f4aa4146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aa40cf040 0x7f4aa41633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aa415a2a0 0x7f4aa4163930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa40cd510 con 0x7f4aa40cc730 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa40cd390 con 0x7f4aa415a2a0 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aaa200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa40cd690 con 0x7f4aa40cf040 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aa3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 0x7f4aa4146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aa3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 0x7f4aa4146580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48618/0 (socket says 172.21.15.17:48618) 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.815+0000 7f4aa3400640 1 -- 172.21.15.17:0/509833909 learned_addr learned my addr 172.21.15.17:0/509833909 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4a9be00640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aa40cf040 0x7f4aa41633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aa3e00640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aa415a2a0 0x7f4aa4163930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aa3400640 1 -- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aa40cf040 msgr2=0x7f4aa41633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aa3400640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aa40cf040 0x7f4aa41633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aa3400640 1 -- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aa415a2a0 msgr2=0x7f4aa4163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:07.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aa3400640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aa415a2a0 0x7f4aa4163930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:07.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aa3400640 1 -- 172.21.15.17:0/509833909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa4146ac0 con 0x7f4aa40cc730 2024-09-10T23:30:07.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aa3e00640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aa415a2a0 0x7f4aa4163930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:07.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aa3400640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 0x7f4aa4146580 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f4a94001ec0 tx=0x7f4a9400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:07.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4a9b400640 1 -- 172.21.15.17:0/509833909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94017070 con 0x7f4aa40cc730 2024-09-10T23:30:07.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4a9b400640 1 -- 172.21.15.17:0/509833909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a94003600 con 0x7f4aa40cc730 2024-09-10T23:30:07.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa415acd0 con 0x7f4aa40cc730 2024-09-10T23:30:07.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4a9b400640 1 -- 172.21.15.17:0/509833909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94003a50 con 0x7f4aa40cc730 2024-09-10T23:30:07.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa415b290 con 0x7f4aa40cc730 2024-09-10T23:30:07.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa40ccb60 con 0x7f4aa40cc730 2024-09-10T23:30:07.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4a9b400640 1 -- 172.21.15.17:0/509833909 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4a94003bf0 con 0x7f4aa40cc730 2024-09-10T23:30:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.819+0000 7f4a9b400640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a800725e0 0x7f4a80074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.823+0000 7f4a9b400640 1 -- 172.21.15.17:0/509833909 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5749+0+0 (secure 0 0 0) 0x7f4a94092800 con 0x7f4aa40cc730 2024-09-10T23:30:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.823+0000 7f4a9be00640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a800725e0 0x7f4a80074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.823+0000 7f4a9be00640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a800725e0 0x7f4a80074aa0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4158830 tx=0x7f4a8c00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.827+0000 7f4a9b400640 1 -- 172.21.15.17:0/509833909 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4a9405d850 con 0x7f4aa40cc730 2024-09-10T23:30:08.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:07.999+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4aa4073250 con 0x7f4aa40cc730 2024-09-10T23:30:08.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:30:08.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:30:08.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.635+0000 7f4a9b400640 1 -- 172.21.15.17:0/509833909 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v192) ==== 169+0+0 (secure 0 0 0) 0x7f4a94062280 con 0x7f4aa40cc730 2024-09-10T23:30:08.636 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:30:08.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a800725e0 msgr2=0x7f4a80074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a800725e0 0x7f4a80074aa0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4158830 tx=0x7f4a8c00b390 comp rx=0 tx=0).stop 2024-09-10T23:30:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 msgr2=0x7f4aa4146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 0x7f4aa4146580 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f4a94001ec0 tx=0x7f4a9400c890 comp rx=0 tx=0).stop 2024-09-10T23:30:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 shutdown_connections 2024-09-10T23:30:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a800725e0 0x7f4a80074aa0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4aa415a2a0 0x7f4aa4163930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4aa40cf040 0x7f4aa41633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 --2- 172.21.15.17:0/509833909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4aa40cc730 0x7f4aa4146580 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 >> 172.21.15.17:0/509833909 conn(0x7f4aa40b17a0 msgr2=0x7f4aa41588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:08.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 shutdown_connections 2024-09-10T23:30:08.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.639+0000 7f4aaa200640 1 -- 172.21.15.17:0/509833909 wait complete. 2024-09-10T23:30:08.667 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:30:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.867+0000 7f6593800640 1 -- 172.21.15.17:0/758972770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c1416c0 msgr2=0x7f658c0ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.867+0000 7f6593800640 1 --2- 172.21.15.17:0/758972770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c1416c0 0x7f658c0ce250 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f657c009840 tx=0x7f657c01f010 comp rx=0 tx=0).stop 2024-09-10T23:30:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.867+0000 7f6593800640 1 -- 172.21.15.17:0/758972770 shutdown_connections 2024-09-10T23:30:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.867+0000 7f6593800640 1 --2- 172.21.15.17:0/758972770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f658c141aa0 0x7f658c15f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.867+0000 7f6593800640 1 --2- 172.21.15.17:0/758972770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c1416c0 0x7f658c0ce250 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.867+0000 7f6593800640 1 -- 172.21.15.17:0/758972770 >> 172.21.15.17:0/758972770 conn(0x7f658c0b1730 msgr2=0x7f658c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.867+0000 7f6593800640 1 -- 172.21.15.17:0/758972770 shutdown_connections 2024-09-10T23:30:08.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.867+0000 7f6593800640 1 -- 172.21.15.17:0/758972770 wait complete. 2024-09-10T23:30:08.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 Processor -- start 2024-09-10T23:30:08.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 -- start start 2024-09-10T23:30:08.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f658c1416c0 0x7f658c151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c141aa0 0x7f658c13d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f658c141e80 0x7f658c13d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f658c15c7d0 con 0x7f658c141aa0 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f658c15ff20 con 0x7f658c141e80 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f658c15c950 con 0x7f658c1416c0 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6583e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c141aa0 0x7f658c13d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6583e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c141aa0 0x7f658c13d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48622/0 (socket says 172.21.15.17:48622) 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6583e00640 1 -- 172.21.15.17:0/4036141657 learned_addr learned my addr 172.21.15.17:0/4036141657 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6590e00640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f658c1416c0 0x7f658c151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6591800640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f658c141e80 0x7f658c13d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6583e00640 1 -- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f658c1416c0 msgr2=0x7f658c151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6583e00640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f658c1416c0 0x7f658c151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6583e00640 1 -- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f658c141e80 msgr2=0x7f658c13d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:08.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6583e00640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f658c141e80 0x7f658c13d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6583e00640 1 -- 172.21.15.17:0/4036141657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c152330 con 0x7f658c141aa0 2024-09-10T23:30:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6583e00640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c141aa0 0x7f658c13d360 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f657400d980 tx=0x7f657400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6589600640 1 -- 172.21.15.17:0/4036141657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574017070 con 0x7f658c141aa0 2024-09-10T23:30:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6589600640 1 -- 172.21.15.17:0/4036141657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6574009d20 con 0x7f658c141aa0 2024-09-10T23:30:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6589600640 1 -- 172.21.15.17:0/4036141657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574004280 con 0x7f658c141aa0 2024-09-10T23:30:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c15a5f0 con 0x7f658c141aa0 2024-09-10T23:30:08.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.871+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c15abb0 con 0x7f658c141aa0 2024-09-10T23:30:08.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.875+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c15cee0 con 0x7f658c141aa0 2024-09-10T23:30:08.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.875+0000 7f6589600640 1 -- 172.21.15.17:0/4036141657 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6574003600 con 0x7f658c141aa0 2024-09-10T23:30:08.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.875+0000 7f6589600640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65680725e0 0x7f6568074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:08.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.875+0000 7f6589600640 1 -- 172.21.15.17:0/4036141657 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5335+0+0 (secure 0 0 0) 0x7f6574093190 con 0x7f658c141aa0 2024-09-10T23:30:08.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.875+0000 7f6590e00640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65680725e0 0x7f6568074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:08.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.875+0000 7f6590e00640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65680725e0 0x7f6568074aa0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f657c0b2000 tx=0x7f657c01d850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:08.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:08.879+0000 7f6589600640 1 -- 172.21.15.17:0/4036141657 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f657405e380 con 0x7f658c141aa0 2024-09-10T23:30:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.055+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f658c0745b0 con 0x7f658c141aa0 2024-09-10T23:30:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6589600640 1 -- 172.21.15.17:0/4036141657 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v59) ==== 71+0+0 (secure 0 0 0) 0x7f6574062db0 con 0x7f658c141aa0 2024-09-10T23:30:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65680725e0 msgr2=0x7f6568074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65680725e0 0x7f6568074aa0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f657c0b2000 tx=0x7f657c01d850 comp rx=0 tx=0).stop 2024-09-10T23:30:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c141aa0 msgr2=0x7f658c13d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c141aa0 0x7f658c13d360 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f657400d980 tx=0x7f657400de40 comp rx=0 tx=0).stop 2024-09-10T23:30:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 shutdown_connections 2024-09-10T23:30:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65680725e0 0x7f6568074aa0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f658c141e80 0x7f658c13d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f658c141aa0 0x7f658c13d360 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 --2- 172.21.15.17:0/4036141657 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f658c1416c0 0x7f658c151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 >> 172.21.15.17:0/4036141657 conn(0x7f658c0b1730 msgr2=0x7f658c15f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 shutdown_connections 2024-09-10T23:30:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.063+0000 7f6593800640 1 -- 172.21.15.17:0/4036141657 wait complete. 2024-09-10T23:30:09.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-10T23:30:09.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.239+0000 7fa70f000640 1 -- 172.21.15.17:0/348464363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6ec004810 msgr2=0x7fa6ec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.239+0000 7fa70f000640 1 --2- 172.21.15.17:0/348464363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6ec004810 0x7fa6ec004c90 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0006fa0 tx=0x7fa6f001cee0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.239+0000 7fa70d000640 1 -- 172.21.15.17:0/348464363 reap_dead start 2024-09-10T23:30:09.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.239+0000 7fa70f000640 1 -- 172.21.15.17:0/348464363 shutdown_connections 2024-09-10T23:30:09.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.239+0000 7fa70f000640 1 -- 172.21.15.17:0/348464363 >> 172.21.15.17:0/348464363 conn(0x7fa7080b3870 msgr2=0x7fa7080b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:09.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.239+0000 7fa70f000640 1 -- 172.21.15.17:0/348464363 shutdown_connections 2024-09-10T23:30:09.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.239+0000 7fa70f000640 1 -- 172.21.15.17:0/348464363 wait complete. 2024-09-10T23:30:09.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 Processor -- start 2024-09-10T23:30:09.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 -- start start 2024-09-10T23:30:09.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6ec004810 0x7fa7081f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:09.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7080b4b70 0x7fa7081f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7080b6410 0x7fa7080b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa70815f790 con 0x7fa6ec004810 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa7080b45a0 con 0x7fa7080b6410 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa7080b21d0 con 0x7fa7080b4b70 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa707e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6ec004810 0x7fa7081f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa707e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6ec004810 0x7fa7081f5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48642/0 (socket says 172.21.15.17:48642) 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa707e00640 1 -- 172.21.15.17:0/977605061 learned_addr learned my addr 172.21.15.17:0/977605061 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa6ff400640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7080b4b70 0x7fa7081f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70d000640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7080b6410 0x7fa7080b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa707e00640 1 -- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7080b4b70 msgr2=0x7fa7081f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa707e00640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7080b4b70 0x7fa7081f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa707e00640 1 -- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7080b6410 msgr2=0x7fa7080b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa707e00640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7080b6410 0x7fa7080b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa707e00640 1 -- 172.21.15.17:0/977605061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7080b50c0 con 0x7fa6ec004810 2024-09-10T23:30:09.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70d000640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7080b6410 0x7fa7080b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:09.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa707e00640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6ec004810 0x7fa7081f5290 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8005ef0 tx=0x7fa6f8011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:09.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa704c00640 1 -- 172.21.15.17:0/977605061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8005320 con 0x7fa6ec004810 2024-09-10T23:30:09.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa704c00640 1 -- 172.21.15.17:0/977605061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6f8018020 con 0x7fa6ec004810 2024-09-10T23:30:09.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa704c00640 1 -- 172.21.15.17:0/977605061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8003860 con 0x7fa6ec004810 2024-09-10T23:30:09.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7080b53a0 con 0x7fa6ec004810 2024-09-10T23:30:09.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7080b5960 con 0x7fa6ec004810 2024-09-10T23:30:09.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.243+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa70806c470 con 0x7fa6ec004810 2024-09-10T23:30:09.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.247+0000 7fa704c00640 1 -- 172.21.15.17:0/977605061 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa6f8010040 con 0x7fa6ec004810 2024-09-10T23:30:09.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.247+0000 7fa704c00640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6e4072610 0x7fa6e4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:09.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.247+0000 7fa704c00640 1 -- 172.21.15.17:0/977605061 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5335+0+0 (secure 0 0 0) 0x7fa6f80964e0 con 0x7fa6ec004810 2024-09-10T23:30:09.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.247+0000 7fa6ff400640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6e4072610 0x7fa6e4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.247+0000 7fa6ff400640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6e4072610 0x7fa6e4074ad0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0006fa0 tx=0x7fa6f0019d20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:09.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.251+0000 7fa704c00640 1 -- 172.21.15.17:0/977605061 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa6f8022020 con 0x7fa6ec004810 2024-09-10T23:30:09.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.483+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7fa7080cec50 con 0x7fa6ec004810 2024-09-10T23:30:09.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.635+0000 7fa704c00640 1 -- 172.21.15.17:0/977605061 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v675) ==== 140+0+0 (secure 0 0 0) 0x7fa6f8061de0 con 0x7fa6ec004810 2024-09-10T23:30:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6e4072610 msgr2=0x7fa6e4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6e4072610 0x7fa6e4074ad0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0006fa0 tx=0x7fa6f0019d20 comp rx=0 tx=0).stop 2024-09-10T23:30:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6ec004810 msgr2=0x7fa7081f5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6ec004810 0x7fa7081f5290 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8005ef0 tx=0x7fa6f8011740 comp rx=0 tx=0).stop 2024-09-10T23:30:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 shutdown_connections 2024-09-10T23:30:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa6e4072610 0x7fa6e4074ad0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7080b6410 0x7fa7080b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7080b4b70 0x7fa7081f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 --2- 172.21.15.17:0/977605061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6ec004810 0x7fa7081f5290 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 >> 172.21.15.17:0/977605061 conn(0x7fa7080b3870 msgr2=0x7fa7080b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 shutdown_connections 2024-09-10T23:30:09.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.639+0000 7fa70f000640 1 -- 172.21.15.17:0/977605061 wait complete. 2024-09-10T23:30:09.659 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-10T23:30:09.659 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T23:30:09.659 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:30:09.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.803+0000 7ffb7a000640 1 -- 172.21.15.17:0/3856064875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 msgr2=0x7ffb740cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.803+0000 7ffb7a000640 1 --2- 172.21.15.17:0/3856064875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 0x7ffb740cc870 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009840 tx=0x7ffb5c01c820 comp rx=0 tx=0).stop 2024-09-10T23:30:09.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.803+0000 7ffb7a000640 1 -- 172.21.15.17:0/3856064875 shutdown_connections 2024-09-10T23:30:09.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.803+0000 7ffb7a000640 1 --2- 172.21.15.17:0/3856064875 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb740d1830 0x7ffb740ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.803+0000 7ffb7a000640 1 --2- 172.21.15.17:0/3856064875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 0x7ffb740cc870 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.803+0000 7ffb7a000640 1 -- 172.21.15.17:0/3856064875 >> 172.21.15.17:0/3856064875 conn(0x7ffb740d1d60 msgr2=0x7ffb740d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:09.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.803+0000 7ffb7a000640 1 -- 172.21.15.17:0/3856064875 shutdown_connections 2024-09-10T23:30:09.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.803+0000 7ffb7a000640 1 -- 172.21.15.17:0/3856064875 wait complete. 2024-09-10T23:30:09.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 Processor -- start 2024-09-10T23:30:09.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 -- start start 2024-09-10T23:30:09.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb74070ad0 0x7ffb7414e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:09.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb740d1830 0x7ffb7406e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:09.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 0x7ffb740c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:09.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74169300 con 0x7ffb7415f770 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74169180 con 0x7ffb740d1830 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ffb74169480 con 0x7ffb74070ad0 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 0x7ffb740c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 0x7ffb740c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48668/0 (socket says 172.21.15.17:48668) 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73e00640 1 -- 172.21.15.17:0/2029899684 learned_addr learned my addr 172.21.15.17:0/2029899684 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73400640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb74070ad0 0x7ffb7414e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb6aa00640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb740d1830 0x7ffb7406e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73e00640 1 -- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb74070ad0 msgr2=0x7ffb7414e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73e00640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb74070ad0 0x7ffb7414e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73e00640 1 -- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb740d1830 msgr2=0x7ffb7406e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73e00640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb740d1830 0x7ffb7406e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73e00640 1 -- 172.21.15.17:0/2029899684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb740c9d80 con 0x7ffb7415f770 2024-09-10T23:30:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb73e00640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 0x7ffb740c9840 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00ea20 tx=0x7ffb6c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb6be00640 1 -- 172.21.15.17:0/2029899684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00cde0 con 0x7ffb7415f770 2024-09-10T23:30:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb6be00640 1 -- 172.21.15.17:0/2029899684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb6c004c40 con 0x7ffb7415f770 2024-09-10T23:30:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb6be00640 1 -- 172.21.15.17:0/2029899684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c005280 con 0x7ffb7415f770 2024-09-10T23:30:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7406f140 con 0x7ffb7415f770 2024-09-10T23:30:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7406de00 con 0x7ffb7415f770 2024-09-10T23:30:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.807+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7415f060 con 0x7ffb7415f770 2024-09-10T23:30:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.811+0000 7ffb6be00640 1 -- 172.21.15.17:0/2029899684 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ffb6c00f040 con 0x7ffb7415f770 2024-09-10T23:30:09.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.811+0000 7ffb6be00640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb50072610 0x7ffb50074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:09.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.811+0000 7ffb6be00640 1 -- 172.21.15.17:0/2029899684 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5335+0+0 (secure 0 0 0) 0x7ffb6c0936e0 con 0x7ffb7415f770 2024-09-10T23:30:09.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.811+0000 7ffb73400640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb50072610 0x7ffb50074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:09.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.811+0000 7ffb73400640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb50072610 0x7ffb50074ad0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ffb7409ff90 tx=0x7ffb64001440 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.815+0000 7ffb6be00640 1 -- 172.21.15.17:0/2029899684 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ffb740c9d80 con 0x7ffb7415f770 2024-09-10T23:30:09.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.987+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb7406fcc0 con 0x7ffb7415f770 2024-09-10T23:30:09.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb6be00640 1 -- 172.21.15.17:0/2029899684 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) ==== 74+0+13255 (secure 0 0 0) 0x7ffb6c016030 con 0x7ffb7415f770 2024-09-10T23:30:09.991 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:09.992 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":192,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:30:08.631392+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/4256418601":"2024-09-11T23:30:05.352363+0000","172.21.15.17:6833/4256418601":"2024-09-11T23:30:05.352363+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb50072610 msgr2=0x7ffb50074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb50072610 0x7ffb50074ad0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ffb7409ff90 tx=0x7ffb64001440 comp rx=0 tx=0).stop 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 msgr2=0x7ffb740c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 0x7ffb740c9840 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00ea20 tx=0x7ffb6c00eee0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 shutdown_connections 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ffb50072610 0x7ffb50074ad0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb7415f770 0x7ffb740c9840 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb740d1830 0x7ffb7406e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 --2- 172.21.15.17:0/2029899684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb74070ad0 0x7ffb7414e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:09.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 >> 172.21.15.17:0/2029899684 conn(0x7ffb740d1d60 msgr2=0x7ffb740b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 shutdown_connections 2024-09-10T23:30:09.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:09.991+0000 7ffb7a000640 1 -- 172.21.15.17:0/2029899684 wait complete. 2024-09-10T23:30:10.014 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:30:10.014 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:30:10.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.163+0000 7f62ff600640 1 -- 172.21.15.17:0/1321371648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62e00041d0 msgr2=0x7f62e0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.163+0000 7f62ff600640 1 --2- 172.21.15.17:0/1321371648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62e00041d0 0x7f62e0004810 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009b30 tx=0x7f62e401d230 comp rx=0 tx=0).stop 2024-09-10T23:30:10.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.163+0000 7f62fd600640 1 -- 172.21.15.17:0/1321371648 reap_dead start 2024-09-10T23:30:10.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.163+0000 7f62ff600640 1 -- 172.21.15.17:0/1321371648 shutdown_connections 2024-09-10T23:30:10.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.163+0000 7f62ff600640 1 -- 172.21.15.17:0/1321371648 >> 172.21.15.17:0/1321371648 conn(0x7f62f809a9f0 msgr2=0x7f62f809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:10.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.163+0000 7f62ff600640 1 -- 172.21.15.17:0/1321371648 shutdown_connections 2024-09-10T23:30:10.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.163+0000 7f62ff600640 1 -- 172.21.15.17:0/1321371648 wait complete. 2024-09-10T23:30:10.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.163+0000 7f62ff600640 1 Processor -- start 2024-09-10T23:30:10.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 -- start start 2024-09-10T23:30:10.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62e00041d0 0x7f62f80b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f80c9050 0x7f62f81f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62f80c9490 0x7f62f81f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f62f80d2bf0 con 0x7f62f80c9050 2024-09-10T23:30:10.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f62f80d2a70 con 0x7f62f80c9490 2024-09-10T23:30:10.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f62f80cfde0 con 0x7f62e00041d0 2024-09-10T23:30:10.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f80c9050 0x7f62f81f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f80c9050 0x7f62f81f8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48678/0 (socket says 172.21.15.17:48678) 2024-09-10T23:30:10.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f7e00640 1 -- 172.21.15.17:0/21084936 learned_addr learned my addr 172.21.15.17:0/21084936 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62fcc00640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62e00041d0 0x7f62f80b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62fd600640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62f80c9490 0x7f62f81f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f7e00640 1 -- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62e00041d0 msgr2=0x7f62f80b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f7e00640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62e00041d0 0x7f62f80b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f7e00640 1 -- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62f80c9490 msgr2=0x7f62f81f8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f7e00640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62f80c9490 0x7f62f81f8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f7e00640 1 -- 172.21.15.17:0/21084936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f81f4ea0 con 0x7f62f80c9050 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62fd600640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62f80c9490 0x7f62f81f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f7e00640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f80c9050 0x7f62f81f8720 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f62e40af040 tx=0x7f62e40acd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f4c00640 1 -- 172.21.15.17:0/21084936 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e40bd020 con 0x7f62f80c9050 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f4c00640 1 -- 172.21.15.17:0/21084936 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62e4005020 con 0x7f62f80c9050 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62f4c00640 1 -- 172.21.15.17:0/21084936 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e40b1040 con 0x7f62f80c9050 2024-09-10T23:30:10.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f81f5150 con 0x7f62f80c9050 2024-09-10T23:30:10.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f81f5710 con 0x7f62f80c9050 2024-09-10T23:30:10.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.167+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f80b12e0 con 0x7f62f80c9050 2024-09-10T23:30:10.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.171+0000 7f62f4c00640 1 -- 172.21.15.17:0/21084936 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f62e4005450 con 0x7f62f80c9050 2024-09-10T23:30:10.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.171+0000 7f62f4c00640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62d80725e0 0x7f62d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.171+0000 7f62f4c00640 1 -- 172.21.15.17:0/21084936 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5335+0+0 (secure 0 0 0) 0x7f62e412ddf0 con 0x7f62f80c9050 2024-09-10T23:30:10.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.171+0000 7f62fcc00640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62d80725e0 0x7f62d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.171+0000 7f62fcc00640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62d80725e0 0x7f62d8074aa0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f62ec001060 tx=0x7f62ec0011f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:10.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.175+0000 7f62f4c00640 1 -- 172.21.15.17:0/21084936 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f62e4016f40 con 0x7f62f80c9050 2024-09-10T23:30:10.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.355+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62f815f0d0 con 0x7f62f80c9050 2024-09-10T23:30:10.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.355+0000 7f62f4c00640 1 -- 172.21.15.17:0/21084936 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) ==== 93+0+10 (secure 0 0 0) 0x7f62e40f8f50 con 0x7f62f80c9050 2024-09-10T23:30:10.359 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:30:10.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62d80725e0 msgr2=0x7f62d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62d80725e0 0x7f62d8074aa0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f62ec001060 tx=0x7f62ec0011f0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f80c9050 msgr2=0x7f62f81f8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f80c9050 0x7f62f81f8720 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f62e40af040 tx=0x7f62e40acd20 comp rx=0 tx=0).stop 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 shutdown_connections 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62d80725e0 0x7f62d8074aa0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62f80c9490 0x7f62f81f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62f80c9050 0x7f62f81f8720 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 --2- 172.21.15.17:0/21084936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62e00041d0 0x7f62f80b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 >> 172.21.15.17:0/21084936 conn(0x7f62f809a9f0 msgr2=0x7f62f80b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 shutdown_connections 2024-09-10T23:30:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.359+0000 7f62ff600640 1 -- 172.21.15.17:0/21084936 wait complete. 2024-09-10T23:30:10.381 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-10T23:30:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 -- 172.21.15.17:0/4111883091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff5015ef40 msgr2=0x7eff5015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 --2- 172.21.15.17:0/4111883091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff5015ef40 0x7eff5015afe0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7eff40009900 tx=0x7eff4001c8b0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 -- 172.21.15.17:0/4111883091 shutdown_connections 2024-09-10T23:30:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 --2- 172.21.15.17:0/4111883091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff500d0030 0x7eff500d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 --2- 172.21.15.17:0/4111883091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff5015ef40 0x7eff5015afe0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 -- 172.21.15.17:0/4111883091 >> 172.21.15.17:0/4111883091 conn(0x7eff5006cfc0 msgr2=0x7eff5006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 -- 172.21.15.17:0/4111883091 shutdown_connections 2024-09-10T23:30:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 -- 172.21.15.17:0/4111883091 wait complete. 2024-09-10T23:30:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 Processor -- start 2024-09-10T23:30:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 -- start start 2024-09-10T23:30:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff500d0030 0x7eff501fade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff5015e5d0 0x7eff50164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff5015ef40 0x7eff50146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7eff50167cb0 con 0x7eff500d0030 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff50167b30 con 0x7eff5015e5d0 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff56c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7eff50167e30 con 0x7eff5015ef40 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff4fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff500d0030 0x7eff501fade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff4fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff500d0030 0x7eff501fade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48688/0 (socket says 172.21.15.17:48688) 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff4fe00640 1 -- 172.21.15.17:0/3728246939 learned_addr learned my addr 172.21.15.17:0/3728246939 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff54c00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff5015ef40 0x7eff50146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff47e00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff5015e5d0 0x7eff50164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff4fe00640 1 -- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff5015ef40 msgr2=0x7eff50146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff4fe00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff5015ef40 0x7eff50146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff4fe00640 1 -- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff5015e5d0 msgr2=0x7eff50164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff4fe00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff5015e5d0 0x7eff50164280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff4fe00640 1 -- 172.21.15.17:0/3728246939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff50146c70 con 0x7eff500d0030 2024-09-10T23:30:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.527+0000 7eff4fe00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff500d0030 0x7eff501fade0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7eff40009850 tx=0x7eff40004220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff4cc00640 1 -- 172.21.15.17:0/3728246939 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff400b2040 con 0x7eff500d0030 2024-09-10T23:30:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff4cc00640 1 -- 172.21.15.17:0/3728246939 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff40005110 con 0x7eff500d0030 2024-09-10T23:30:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff501fb4e0 con 0x7eff500d0030 2024-09-10T23:30:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff4cc00640 1 -- 172.21.15.17:0/3728246939 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40005540 con 0x7eff500d0030 2024-09-10T23:30:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff501fbaa0 con 0x7eff500d0030 2024-09-10T23:30:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff501fbc70 con 0x7eff500d0030 2024-09-10T23:30:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff4cc00640 1 -- 172.21.15.17:0/3728246939 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7eff400046d0 con 0x7eff500d0030 2024-09-10T23:30:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff4cc00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff2c072610 0x7eff2c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff4cc00640 1 -- 172.21.15.17:0/3728246939 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5335+0+0 (secure 0 0 0) 0x7eff4012ccb0 con 0x7eff500d0030 2024-09-10T23:30:10.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.531+0000 7eff47e00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff2c072610 0x7eff2c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:10.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.535+0000 7eff47e00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff2c072610 0x7eff2c074ad0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7eff50163da0 tx=0x7eff38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:10.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.535+0000 7eff4cc00640 1 -- 172.21.15.17:0/3728246939 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7eff400bd070 con 0x7eff500d0030 2024-09-10T23:30:10.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:10.775+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7eff500d0430 con 0x7eff500d0030 2024-09-10T23:30:11.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.643+0000 7eff4cc00640 1 -- 172.21.15.17:0/3728246939 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v677) ==== 136+0+0 (secure 0 0 0) 0x7eff400164d0 con 0x7eff500d0030 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.643+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff2c072610 msgr2=0x7eff2c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.643+0000 7eff56c00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff2c072610 0x7eff2c074ad0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7eff50163da0 tx=0x7eff38009040 comp rx=0 tx=0).stop 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.643+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff500d0030 msgr2=0x7eff501fade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.643+0000 7eff56c00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff500d0030 0x7eff501fade0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7eff40009850 tx=0x7eff40004220 comp rx=0 tx=0).stop 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.647+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 shutdown_connections 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.647+0000 7eff56c00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7eff2c072610 0x7eff2c074ad0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.647+0000 7eff56c00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff5015ef40 0x7eff50146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.647+0000 7eff56c00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff5015e5d0 0x7eff50164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.647+0000 7eff56c00640 1 --2- 172.21.15.17:0/3728246939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff500d0030 0x7eff501fade0 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.647+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 >> 172.21.15.17:0/3728246939 conn(0x7eff5006cfc0 msgr2=0x7eff50068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:11.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.647+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 shutdown_connections 2024-09-10T23:30:11.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.647+0000 7eff56c00640 1 -- 172.21.15.17:0/3728246939 wait complete. 2024-09-10T23:30:11.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:30:11.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.823+0000 7f4d66400640 1 -- 172.21.15.17:0/1126311288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d44004d50 msgr2=0x7f4d440051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:11.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.823+0000 7f4d66400640 1 --2- 172.21.15.17:0/1126311288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d44004d50 0x7f4d440051b0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f4d58001dc0 tx=0x7f4d5801cb30 comp rx=0 tx=0).stop 2024-09-10T23:30:11.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.823+0000 7f4d5fe00640 1 -- 172.21.15.17:0/1126311288 reap_dead start 2024-09-10T23:30:11.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.823+0000 7f4d66400640 1 -- 172.21.15.17:0/1126311288 shutdown_connections 2024-09-10T23:30:11.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.823+0000 7f4d66400640 1 -- 172.21.15.17:0/1126311288 >> 172.21.15.17:0/1126311288 conn(0x7f4d6006cfc0 msgr2=0x7f4d6006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:11.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.823+0000 7f4d66400640 1 -- 172.21.15.17:0/1126311288 shutdown_connections 2024-09-10T23:30:11.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.823+0000 7f4d66400640 1 -- 172.21.15.17:0/1126311288 wait complete. 2024-09-10T23:30:11.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.823+0000 7f4d66400640 1 Processor -- start 2024-09-10T23:30:11.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.823+0000 7f4d66400640 1 -- start start 2024-09-10T23:30:11.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d66400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d44004d50 0x7f4d6014a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:11.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d66400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d600cb740 0x7f4d600cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:11.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d66400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d60158720 0x7f4d60158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:11.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d66400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4d600d0480 con 0x7f4d60158720 2024-09-10T23:30:11.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d66400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d60074330 con 0x7f4d44004d50 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d66400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4d600d0600 con 0x7f4d600cb740 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d60158720 0x7f4d60158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d60158720 0x7f4d60158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48706/0 (socket says 172.21.15.17:48706) 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5fe00640 1 -- 172.21.15.17:0/273827644 learned_addr learned my addr 172.21.15.17:0/273827644 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5f400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d44004d50 0x7f4d6014a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d57e00640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d600cb740 0x7f4d600cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5fe00640 1 -- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d600cb740 msgr2=0x7f4d600cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5fe00640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d600cb740 0x7f4d600cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5fe00640 1 -- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d44004d50 msgr2=0x7f4d6014a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5fe00640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d44004d50 0x7f4d6014a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:11.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5fe00640 1 -- 172.21.15.17:0/273827644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d60159450 con 0x7f4d60158720 2024-09-10T23:30:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d5fe00640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d60158720 0x7f4d60158ba0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f4d580ab040 tx=0x7f4d58006e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d57400640 1 -- 172.21.15.17:0/273827644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58006cb0 con 0x7f4d60158720 2024-09-10T23:30:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d57400640 1 -- 172.21.15.17:0/273827644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d580019f0 con 0x7f4d60158720 2024-09-10T23:30:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d57400640 1 -- 172.21.15.17:0/273827644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58006310 con 0x7f4d60158720 2024-09-10T23:30:11.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d60159730 con 0x7f4d60158720 2024-09-10T23:30:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d60159cf0 con 0x7f4d60158720 2024-09-10T23:30:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d60073930 con 0x7f4d60158720 2024-09-10T23:30:11.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.827+0000 7f4d57400640 1 -- 172.21.15.17:0/273827644 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4d580b6020 con 0x7f4d60158720 2024-09-10T23:30:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.831+0000 7f4d57400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d3c0725e0 0x7f4d3c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.831+0000 7f4d57400640 1 -- 172.21.15.17:0/273827644 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5335+0+0 (secure 0 0 0) 0x7f4d5812c790 con 0x7f4d60158720 2024-09-10T23:30:11.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.831+0000 7f4d5f400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d3c0725e0 0x7f4d3c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:11.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.831+0000 7f4d5f400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d3c0725e0 0x7f4d3c074aa0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009c60 tx=0x7f4d500091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:11.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:11.835+0000 7f4d57400640 1 -- 172.21.15.17:0/273827644 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4d580bf030 con 0x7f4d60158720 2024-09-10T23:30:12.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.007+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4d600cf540 con 0x7f4d60158720 2024-09-10T23:30:12.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.007+0000 7f4d57400640 1 -- 172.21.15.17:0/273827644 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v59) ==== 59+0+1998 (secure 0 0 0) 0x7f4d5812c080 con 0x7f4d60158720 2024-09-10T23:30:12.011 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:30:12.011 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:30:12.011 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:30:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:30:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:30:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d3c0725e0 msgr2=0x7f4d3c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d3c0725e0 0x7f4d3c074aa0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4d50009c60 tx=0x7f4d500091e0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d60158720 msgr2=0x7f4d60158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d60158720 0x7f4d60158ba0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f4d580ab040 tx=0x7f4d58006e80 comp rx=0 tx=0).stop 2024-09-10T23:30:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 shutdown_connections 2024-09-10T23:30:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4d3c0725e0 0x7f4d3c074aa0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d60158720 0x7f4d60158ba0 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4d600cb740 0x7f4d600cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 --2- 172.21.15.17:0/273827644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d44004d50 0x7f4d6014a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 >> 172.21.15.17:0/273827644 conn(0x7f4d6006cfc0 msgr2=0x7f4d60152bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 shutdown_connections 2024-09-10T23:30:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.011+0000 7f4d66400640 1 -- 172.21.15.17:0/273827644 wait complete. 2024-09-10T23:30:12.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:30:12.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.179+0000 7f8038200640 1 -- 172.21.15.17:0/3808379874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f803015be00 msgr2=0x7f803015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.179+0000 7f8038200640 1 --2- 172.21.15.17:0/3808379874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f803015be00 0x7f803015d4f0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f8024009840 tx=0x7f802401c7f0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.179+0000 7f8038200640 1 -- 172.21.15.17:0/3808379874 shutdown_connections 2024-09-10T23:30:12.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.179+0000 7f8038200640 1 --2- 172.21.15.17:0/3808379874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f803015be00 0x7f803015d4f0 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.179+0000 7f8038200640 1 -- 172.21.15.17:0/3808379874 >> 172.21.15.17:0/3808379874 conn(0x7f803009a9f0 msgr2=0x7f803009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.179+0000 7f8038200640 1 -- 172.21.15.17:0/3808379874 shutdown_connections 2024-09-10T23:30:12.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.179+0000 7f8038200640 1 -- 172.21.15.17:0/3808379874 wait complete. 2024-09-10T23:30:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 Processor -- start 2024-09-10T23:30:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 -- start start 2024-09-10T23:30:12.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80300b12e0 0x7f8030164de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80300d04f0 0x7f80300af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f803015be00 0x7f8030152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f803016a660 con 0x7f80300d04f0 2024-09-10T23:30:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f803016a4e0 con 0x7f80300b12e0 2024-09-10T23:30:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f803016a7e0 con 0x7f803015be00 2024-09-10T23:30:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8034e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80300d04f0 0x7f80300af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8034e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80300d04f0 0x7f80300af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48716/0 (socket says 172.21.15.17:48716) 2024-09-10T23:30:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8034e00640 1 -- 172.21.15.17:0/956946180 learned_addr learned my addr 172.21.15.17:0/956946180 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8035800640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80300b12e0 0x7f8030164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8036200640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f803015be00 0x7f8030152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8034e00640 1 -- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f803015be00 msgr2=0x7f8030152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8034e00640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f803015be00 0x7f8030152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8034e00640 1 -- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80300b12e0 msgr2=0x7f8030164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8034e00640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80300b12e0 0x7f8030164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8034e00640 1 -- 172.21.15.17:0/956946180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8030165570 con 0x7f80300d04f0 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8034e00640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80300d04f0 0x7f80300af4f0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c420 tx=0x7f801c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f802d600640 1 -- 172.21.15.17:0/956946180 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c017070 con 0x7f80300d04f0 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f802d600640 1 -- 172.21.15.17:0/956946180 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f801c003600 con 0x7f80300d04f0 2024-09-10T23:30:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f802d600640 1 -- 172.21.15.17:0/956946180 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c003a90 con 0x7f80300d04f0 2024-09-10T23:30:12.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8030165850 con 0x7f80300d04f0 2024-09-10T23:30:12.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.183+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8030165e10 con 0x7f80300d04f0 2024-09-10T23:30:12.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.187+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f803015d4f0 con 0x7f80300d04f0 2024-09-10T23:30:12.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.187+0000 7f802d600640 1 -- 172.21.15.17:0/956946180 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f801c003c30 con 0x7f80300d04f0 2024-09-10T23:30:12.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.187+0000 7f802d600640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80100725e0 0x7f8010074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.187+0000 7f802d600640 1 -- 172.21.15.17:0/956946180 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5335+0+0 (secure 0 0 0) 0x7f801c092640 con 0x7f80300d04f0 2024-09-10T23:30:12.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.187+0000 7f8035800640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80100725e0 0x7f8010074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.187+0000 7f8035800640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80100725e0 0x7f8010074aa0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f80240af000 tx=0x7f802401b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.191+0000 7f802d600640 1 -- 172.21.15.17:0/956946180 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f801c05d830 con 0x7f80300d04f0 2024-09-10T23:30:12.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.363+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f803015c840 con 0x7f80300d04f0 2024-09-10T23:30:12.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.367+0000 7f802d600640 1 -- 172.21.15.17:0/956946180 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v60)=0 v60) ==== 122+0+0 (secure 0 0 0) 0x7f801c062260 con 0x7f80300d04f0 2024-09-10T23:30:12.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80100725e0 msgr2=0x7f8010074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80100725e0 0x7f8010074aa0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f80240af000 tx=0x7f802401b030 comp rx=0 tx=0).stop 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80300d04f0 msgr2=0x7f80300af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80300d04f0 0x7f80300af4f0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c420 tx=0x7f801c00c8e0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 shutdown_connections 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80100725e0 0x7f8010074aa0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f803015be00 0x7f8030152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80300d04f0 0x7f80300af4f0 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 --2- 172.21.15.17:0/956946180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80300b12e0 0x7f8030164de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 >> 172.21.15.17:0/956946180 conn(0x7f803009a9f0 msgr2=0x7f80300d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 shutdown_connections 2024-09-10T23:30:12.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.371+0000 7f8038200640 1 -- 172.21.15.17:0/956946180 wait complete. 2024-09-10T23:30:12.393 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:30:12.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:30:12.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:30:12.571 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:30:12.571 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:30:12.571 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:12.582 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:30:12.582 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:30:12.582 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:12.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:30:12.592 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:30:12.592 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:12.631 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:30:12.631 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:30:12.631 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:12.640 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:30:12.641 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:30:12.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:30:12.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 -- 172.21.15.17:0/7761643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f80cf320 msgr2=0x7f61f80cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 --2- 172.21.15.17:0/7761643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f80cf320 0x7f61f80cfc60 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f61f80d2e60 tx=0x7f61f001cd80 comp rx=0 tx=0).stop 2024-09-10T23:30:12.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 -- 172.21.15.17:0/7761643 shutdown_connections 2024-09-10T23:30:12.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 --2- 172.21.15.17:0/7761643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f80cf320 0x7f61f80cfc60 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 --2- 172.21.15.17:0/7761643 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61f80d1830 0x7f61f815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 --2- 172.21.15.17:0/7761643 >> v2:172.21.15.77:3300/0 conn(0x7f61f8070ad0 0x7f61f815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 -- 172.21.15.17:0/7761643 >> 172.21.15.17:0/7761643 conn(0x7f61f80d1d60 msgr2=0x7f61f80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:12.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 -- 172.21.15.17:0/7761643 shutdown_connections 2024-09-10T23:30:12.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 -- 172.21.15.17:0/7761643 wait complete. 2024-09-10T23:30:12.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 Processor -- start 2024-09-10T23:30:12.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.819+0000 7f61fce00640 1 -- start start 2024-09-10T23:30:12.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61fce00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f8070ad0 0x7f61f8155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61fce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61f80cf320 0x7f61f815b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61fce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61f80d1830 0x7f61f815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61fce00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f61f80cd2f0 con 0x7f61f8070ad0 2024-09-10T23:30:12.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61fce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f61f80cd170 con 0x7f61f80d1830 2024-09-10T23:30:12.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61fce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f61f80cd470 con 0x7f61f80cf320 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f8070ad0 0x7f61f8155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f8070ad0 0x7f61f8155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48728/0 (socket says 172.21.15.17:48728) 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f5e00640 1 -- 172.21.15.17:0/2584978909 learned_addr learned my addr 172.21.15.17:0/2584978909 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f6800640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61f80d1830 0x7f61f815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61efe00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61f80cf320 0x7f61f815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f5e00640 1 -- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61f80cf320 msgr2=0x7f61f815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f5e00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61f80cf320 0x7f61f815b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f5e00640 1 -- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61f80d1830 msgr2=0x7f61f815b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f5e00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61f80d1830 0x7f61f815b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f5e00640 1 -- 172.21.15.17:0/2584978909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f814f780 con 0x7f61f8070ad0 2024-09-10T23:30:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61f5e00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f8070ad0 0x7f61f8155430 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c940 tx=0x7f61e800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61ee000640 1 -- 172.21.15.17:0/2584978909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8007bb0 con 0x7f61f8070ad0 2024-09-10T23:30:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61ee000640 1 -- 172.21.15.17:0/2584978909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61e800f450 con 0x7f61f8070ad0 2024-09-10T23:30:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61ee000640 1 -- 172.21.15.17:0/2584978909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8007e60 con 0x7f61f8070ad0 2024-09-10T23:30:12.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f80b1b30 con 0x7f61f8070ad0 2024-09-10T23:30:12.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f80b20f0 con 0x7f61f8070ad0 2024-09-10T23:30:12.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f80cfc60 con 0x7f61f8070ad0 2024-09-10T23:30:12.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.823+0000 7f61ee000640 1 -- 172.21.15.17:0/2584978909 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f61e800f8a0 con 0x7f61f8070ad0 2024-09-10T23:30:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.827+0000 7f61ee000640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61d40725e0 0x7f61d4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.827+0000 7f61ee000640 1 -- 172.21.15.17:0/2584978909 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5335+0+0 (secure 0 0 0) 0x7f61e80939f0 con 0x7f61f8070ad0 2024-09-10T23:30:12.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.827+0000 7f61efe00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61d40725e0 0x7f61d4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:12.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.827+0000 7f61efe00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61d40725e0 0x7f61d4074aa0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f61e0005fd0 tx=0x7f61e0005d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:12.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:12.831+0000 7f61ee000640 1 -- 172.21.15.17:0/2584978909 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f61f814f780 con 0x7f61f8070ad0 2024-09-10T23:30:13.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.039+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61f806a030 con 0x7f61f8070ad0 2024-09-10T23:30:13.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.039+0000 7f61ee000640 1 -- 172.21.15.17:0/2584978909 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) ==== 95+0+3915 (secure 0 0 0) 0x7f61e8014030 con 0x7f61f8070ad0 2024-09-10T23:30:13.042 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:13.042 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":146,"btime":"2024-09-10T23:30:06:354415+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/3439807694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3439807694},{"type":"v1","addr":"172.21.15.77:6837","nonce":3439807694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":9772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2077624650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2077624650},{"type":"v1","addr":"172.21.15.77:6836","nonce":2077624650}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139},{"gid":10027,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1014949185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1014949185},{"type":"v1","addr":"172.21.15.17:6835","nonce":1014949185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":146},{"gid":10638,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/294398472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":294398472},{"type":"v1","addr":"172.21.15.17:6834","nonce":294398472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":139}],"filesystems":[]} 2024-09-10T23:30:13.043 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 146 2024-09-10T23:30:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61d40725e0 msgr2=0x7f61d4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61d40725e0 0x7f61d4074aa0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f61e0005fd0 tx=0x7f61e0005d10 comp rx=0 tx=0).stop 2024-09-10T23:30:13.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f8070ad0 msgr2=0x7f61f8155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f8070ad0 0x7f61f8155430 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c940 tx=0x7f61e800ce00 comp rx=0 tx=0).stop 2024-09-10T23:30:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 shutdown_connections 2024-09-10T23:30:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f61d40725e0 0x7f61d4074aa0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61f80d1830 0x7f61f815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61f80cf320 0x7f61f815b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 --2- 172.21.15.17:0/2584978909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61f8070ad0 0x7f61f8155430 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 >> 172.21.15.17:0/2584978909 conn(0x7f61f80d1d60 msgr2=0x7f61f815e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 shutdown_connections 2024-09-10T23:30:13.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.043+0000 7f61fce00640 1 -- 172.21.15.17:0/2584978909 wait complete. 2024-09-10T23:30:13.064 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:30:13.064 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:30:13.064 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:30:13.064 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:30:13.064 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:30:13.065 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:30:13.065 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:30:13.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:30:13.065 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:30:13.065 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:30:13.065 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:30:13.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:30:13.066 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:30:13.066 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:30:13.066 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:30:13.066 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:30:13.077 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:30:13.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:30:13.078 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:30:13.078 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:30:13.079 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:30:13.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:30:13.080 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:30:13.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:30:13.122 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:30:13.122 DEBUG:teuthology.parallel:result is None 2024-09-10T23:30:13.123 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:30:13.123 DEBUG:teuthology.parallel:result is None 2024-09-10T23:30:13.124 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:30:13.124 DEBUG:teuthology.parallel:result is None 2024-09-10T23:30:13.124 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:30:13.124 DEBUG:teuthology.parallel:result is None 2024-09-10T23:30:13.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:30:13.210 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:30:13.210 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:30:13.215 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:30:13.215 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:30:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.275+0000 7f95cb200640 1 -- 172.21.15.17:0/3192709969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 msgr2=0x7f95a8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.275+0000 7f95cb200640 1 --2- 172.21.15.17:0/3192709969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 0x7f95a8003e40 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f95b4006f80 tx=0x7f95b401cf00 comp rx=0 tx=0).stop 2024-09-10T23:30:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.275+0000 7f95cb200640 1 -- 172.21.15.17:0/3192709969 shutdown_connections 2024-09-10T23:30:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.275+0000 7f95cb200640 1 --2- 172.21.15.17:0/3192709969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 0x7f95a8003e40 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.275+0000 7f95cb200640 1 -- 172.21.15.17:0/3192709969 >> 172.21.15.17:0/3192709969 conn(0x7f95c40d1d60 msgr2=0x7f95c40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.275+0000 7f95cb200640 1 -- 172.21.15.17:0/3192709969 shutdown_connections 2024-09-10T23:30:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.275+0000 7f95cb200640 1 -- 172.21.15.17:0/3192709969 wait complete. 2024-09-10T23:30:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 Processor -- start 2024-09-10T23:30:13.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 -- start start 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 0x7f95c415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c415a3c0 0x7f95c4159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c4159e70 0x7f95c40cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f95c40afe30 con 0x7f95a8003a60 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f95c40afcb0 con 0x7f95c4159e70 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f95c40affb0 con 0x7f95c415a3c0 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 0x7f95c415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 0x7f95c415d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48760/0 (socket says 172.21.15.17:48760) 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3e00640 1 -- 172.21.15.17:0/2097850917 learned_addr learned my addr 172.21.15.17:0/2097850917 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c9200640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c4159e70 0x7f95c40cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3400640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c415a3c0 0x7f95c4159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3e00640 1 -- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c415a3c0 msgr2=0x7f95c4159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3e00640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c415a3c0 0x7f95c4159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3e00640 1 -- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c4159e70 msgr2=0x7f95c40cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3e00640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c4159e70 0x7f95c40cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3e00640 1 -- 172.21.15.17:0/2097850917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c415c4f0 con 0x7f95a8003a60 2024-09-10T23:30:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3400640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c415a3c0 0x7f95c4159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95c3e00640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 0x7f95c415d290 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f95b40ab040 tx=0x7f95b4001d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95bbe00640 1 -- 172.21.15.17:0/2097850917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4006290 con 0x7f95a8003a60 2024-09-10T23:30:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95bbe00640 1 -- 172.21.15.17:0/2097850917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95b4006520 con 0x7f95a8003a60 2024-09-10T23:30:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c415c7d0 con 0x7f95a8003a60 2024-09-10T23:30:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95bbe00640 1 -- 172.21.15.17:0/2097850917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4003860 con 0x7f95a8003a60 2024-09-10T23:30:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c40cc060 con 0x7f95a8003a60 2024-09-10T23:30:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.279+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c40b0cd0 con 0x7f95a8003a60 2024-09-10T23:30:13.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.283+0000 7f95bbe00640 1 -- 172.21.15.17:0/2097850917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f95b40b6020 con 0x7f95a8003a60 2024-09-10T23:30:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.283+0000 7f95bbe00640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95a40725e0 0x7f95a4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.283+0000 7f95bbe00640 1 -- 172.21.15.17:0/2097850917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5335+0+0 (secure 0 0 0) 0x7f95b412bf60 con 0x7f95a8003a60 2024-09-10T23:30:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.283+0000 7f95c3400640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95a40725e0 0x7f95a4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.283+0000 7f95c3400640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95a40725e0 0x7f95a4074aa0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f95c40b2510 tx=0x7f95b00091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:13.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.287+0000 7f95bbe00640 1 -- 172.21.15.17:0/2097850917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f95b40b4070 con 0x7f95a8003a60 2024-09-10T23:30:13.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:13.475+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f95c40b1f40 con 0x7f95a8003a60 2024-09-10T23:30:14.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.383+0000 7f95bbe00640 1 -- 172.21.15.17:0/2097850917 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v197) ==== 97+0+0 (secure 0 0 0) 0x7f95b4016cb0 con 0x7f95a8003a60 2024-09-10T23:30:14.387 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:30:14.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95a40725e0 msgr2=0x7f95a4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95a40725e0 0x7f95a4074aa0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f95c40b2510 tx=0x7f95b00091e0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 msgr2=0x7f95c415d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 0x7f95c415d290 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f95b40ab040 tx=0x7f95b4001d30 comp rx=0 tx=0).stop 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 shutdown_connections 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f95a40725e0 0x7f95a4074aa0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c4159e70 0x7f95c40cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c415a3c0 0x7f95c4159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 --2- 172.21.15.17:0/2097850917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a8003a60 0x7f95c415d290 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 >> 172.21.15.17:0/2097850917 conn(0x7f95c40d1d60 msgr2=0x7f95c4070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 shutdown_connections 2024-09-10T23:30:14.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.387+0000 7f95cb200640 1 -- 172.21.15.17:0/2097850917 wait complete. 2024-09-10T23:30:14.415 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:30:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 -- 172.21.15.17:0/2873974614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a0152b40 msgr2=0x7fa8a00b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 --2- 172.21.15.17:0/2873974614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a0152b40 0x7fa8a00b48d0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7fa890009900 tx=0x7fa89001c8a0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 -- 172.21.15.17:0/2873974614 shutdown_connections 2024-09-10T23:30:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 --2- 172.21.15.17:0/2873974614 >> v2:172.21.15.77:3300/0 conn(0x7fa8a00d06f0 0x7fa8a00b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 --2- 172.21.15.17:0/2873974614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a0152b40 0x7fa8a00b48d0 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 -- 172.21.15.17:0/2873974614 >> 172.21.15.17:0/2873974614 conn(0x7fa8a006cfc0 msgr2=0x7fa8a006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 -- 172.21.15.17:0/2873974614 shutdown_connections 2024-09-10T23:30:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 -- 172.21.15.17:0/2873974614 wait complete. 2024-09-10T23:30:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 Processor -- start 2024-09-10T23:30:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 -- start start 2024-09-10T23:30:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a00d06f0 0x7fa8a00b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0152b40 0x7fa8a01441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a01602d0 0x7fa8a0073740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a0168c50 con 0x7fa8a00d06f0 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a0168ad0 con 0x7fa8a0152b40 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.567+0000 7fa8a6400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a0168dd0 con 0x7fa8a01602d0 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a00d06f0 0x7fa8a00b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a00d06f0 0x7fa8a00b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48778/0 (socket says 172.21.15.17:48778) 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89f400640 1 -- 172.21.15.17:0/2222095974 learned_addr learned my addr 172.21.15.17:0/2222095974 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa896a00640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0152b40 0x7fa8a01441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89fe00640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a01602d0 0x7fa8a0073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89f400640 1 -- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a01602d0 msgr2=0x7fa8a0073740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89f400640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a01602d0 0x7fa8a0073740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89f400640 1 -- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0152b40 msgr2=0x7fa8a01441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89f400640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0152b40 0x7fa8a01441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89f400640 1 -- 172.21.15.17:0/2222095974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a01446e0 con 0x7fa8a00d06f0 2024-09-10T23:30:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa896a00640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0152b40 0x7fa8a01441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa89f400640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a00d06f0 0x7fa8a00b1f30 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fa890009850 tx=0x7fa890004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa897e00640 1 -- 172.21.15.17:0/2222095974 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8900bb070 con 0x7fa8a00d06f0 2024-09-10T23:30:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa897e00640 1 -- 172.21.15.17:0/2222095974 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa890005070 con 0x7fa8a00d06f0 2024-09-10T23:30:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa897e00640 1 -- 172.21.15.17:0/2222095974 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8900b2040 con 0x7fa8a00d06f0 2024-09-10T23:30:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a00b0990 con 0x7fa8a00d06f0 2024-09-10T23:30:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a00afbd0 con 0x7fa8a00d06f0 2024-09-10T23:30:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a00b2ac0 con 0x7fa8a00d06f0 2024-09-10T23:30:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.571+0000 7fa897e00640 1 -- 172.21.15.17:0/2222095974 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa890005480 con 0x7fa8a00d06f0 2024-09-10T23:30:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.575+0000 7fa897e00640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa87c0725e0 0x7fa87c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.575+0000 7fa897e00640 1 -- 172.21.15.17:0/2222095974 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 5249+0+0 (secure 0 0 0) 0x7fa89012c860 con 0x7fa8a00d06f0 2024-09-10T23:30:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.575+0000 7fa896a00640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa87c0725e0 0x7fa87c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.575+0000 7fa896a00640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa87c0725e0 0x7fa87c074aa0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0149ec0 tx=0x7fa888009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.575+0000 7fa897e00640 1 -- 172.21.15.17:0/2222095974 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa890016490 con 0x7fa8a00d06f0 2024-09-10T23:30:14.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.811+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa8a00ce490 con 0x7fa8a00d06f0 2024-09-10T23:30:14.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.811+0000 7fa897e00640 1 -- 172.21.15.17:0/2222095974 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) ==== 80+0+5304 (secure 0 0 0) 0x7fa8900f80f0 con 0x7fa8a00d06f0 2024-09-10T23:30:14.813 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:14.813 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:30:14.813 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:30:14.814 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.815 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:30:14.816 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.817 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:30:14.818 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.819 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.820 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:30:14.822 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:30:14.823 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:30:14.825 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:30:14.826 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:30:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:30:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.811+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa87c0725e0 msgr2=0x7fa87c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.811+0000 7fa8a6400640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa87c0725e0 0x7fa87c074aa0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0149ec0 tx=0x7fa888009040 comp rx=0 tx=0).stop 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.811+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a00d06f0 msgr2=0x7fa8a00b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.811+0000 7fa8a6400640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a00d06f0 0x7fa8a00b1f30 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fa890009850 tx=0x7fa890004040 comp rx=0 tx=0).stop 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.815+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 shutdown_connections 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.815+0000 7fa8a6400640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa87c0725e0 0x7fa87c074aa0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.815+0000 7fa8a6400640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a01602d0 0x7fa8a0073740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.815+0000 7fa8a6400640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0152b40 0x7fa8a01441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.815+0000 7fa8a6400640 1 --2- 172.21.15.17:0/2222095974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8a00d06f0 0x7fa8a00b1f30 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.815+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 >> 172.21.15.17:0/2222095974 conn(0x7fa8a006cfc0 msgr2=0x7fa8a015dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.815+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 shutdown_connections 2024-09-10T23:30:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.815+0000 7fa8a6400640 1 -- 172.21.15.17:0/2222095974 wait complete. 2024-09-10T23:30:14.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:30:14.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 -- 172.21.15.17:0/3172802225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 msgr2=0x7f200415b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 --2- 172.21.15.17:0/3172802225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 0x7f200415b240 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f20040cc5a0 tx=0x7f1ff401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 -- 172.21.15.17:0/3172802225 shutdown_connections 2024-09-10T23:30:14.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 --2- 172.21.15.17:0/3172802225 >> v2:172.21.15.77:3300/0 conn(0x7f20040b32d0 0x7f20040cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 --2- 172.21.15.17:0/3172802225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 0x7f200415b240 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 -- 172.21.15.17:0/3172802225 >> 172.21.15.17:0/3172802225 conn(0x7f200406cfc0 msgr2=0x7f200406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:14.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 -- 172.21.15.17:0/3172802225 shutdown_connections 2024-09-10T23:30:14.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 -- 172.21.15.17:0/3172802225 wait complete. 2024-09-10T23:30:14.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 Processor -- start 2024-09-10T23:30:14.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 -- start start 2024-09-10T23:30:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 0x7f20040b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20040b32d0 0x7f20040cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20040cf230 0x7f20040b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2004168210 con 0x7f200406e750 2024-09-10T23:30:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2004168090 con 0x7f20040cf230 2024-09-10T23:30:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2008a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2004168390 con 0x7f20040b32d0 2024-09-10T23:30:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2001e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 0x7f20040b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2001e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 0x7f20040b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48806/0 (socket says 172.21.15.17:48806) 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2001e00640 1 -- 172.21.15.17:0/2513811639 learned_addr learned my addr 172.21.15.17:0/2513811639 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.979+0000 7f2002800640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20040cf230 0x7f20040b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f1ffbe00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20040b32d0 0x7f20040cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2001e00640 1 -- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20040b32d0 msgr2=0x7f20040cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2001e00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20040b32d0 0x7f20040cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2001e00640 1 -- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20040cf230 msgr2=0x7f20040b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2001e00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20040cf230 0x7f20040b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2001e00640 1 -- 172.21.15.17:0/2513811639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20040afe70 con 0x7f200406e750 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2002800640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20040cf230 0x7f20040b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2001e00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 0x7f20040b1fc0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40b0040 tx=0x7f1ff4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f1ffa000640 1 -- 172.21.15.17:0/2513811639 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff40b2040 con 0x7f200406e750 2024-09-10T23:30:14.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f1ffa000640 1 -- 172.21.15.17:0/2513811639 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ff4005030 con 0x7f200406e750 2024-09-10T23:30:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f1ffa000640 1 -- 172.21.15.17:0/2513811639 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4005480 con 0x7f200406e750 2024-09-10T23:30:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2004146350 con 0x7f200406e750 2024-09-10T23:30:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20040ce740 con 0x7f200406e750 2024-09-10T23:30:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2004146520 con 0x7f200406e750 2024-09-10T23:30:14.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.983+0000 7f1ffa000640 1 -- 172.21.15.17:0/2513811639 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1ff40bf060 con 0x7f200406e750 2024-09-10T23:30:14.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.987+0000 7f1ffa000640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe00725e0 0x7f1fe0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.987+0000 7f1ffa000640 1 -- 172.21.15.17:0/2513811639 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 5249+0+0 (secure 0 0 0) 0x7f1ff412c310 con 0x7f200406e750 2024-09-10T23:30:14.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.987+0000 7f1ffbe00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe00725e0 0x7f1fe0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:14.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.987+0000 7f1ffbe00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe00725e0 0x7f1fe0074aa0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f1fec005fd0 tx=0x7f1fec005db0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:14.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:14.991+0000 7f1ffa000640 1 -- 172.21.15.17:0/2513811639 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1ff40164b0 con 0x7f200406e750 2024-09-10T23:30:15.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.167+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f200415b240 con 0x7f200406e750 2024-09-10T23:30:15.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.167+0000 7f1ffa000640 1 -- 172.21.15.17:0/2513811639 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v197) ==== 84+0+65 (secure 0 0 0) 0x7f1ff40f7b10 con 0x7f200406e750 2024-09-10T23:30:15.169 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:15.170 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:30:15.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:30:15.170 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:30:15.170 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:30:15.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:15.170 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:30:15.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.167+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe00725e0 msgr2=0x7f1fe0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.167+0000 7f2008a00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe00725e0 0x7f1fe0074aa0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f1fec005fd0 tx=0x7f1fec005db0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.167+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 msgr2=0x7f20040b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.167+0000 7f2008a00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 0x7f20040b1fc0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f1ff40b0040 tx=0x7f1ff4004040 comp rx=0 tx=0).stop 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.171+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 shutdown_connections 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.171+0000 7f2008a00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe00725e0 0x7f1fe0074aa0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.171+0000 7f2008a00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20040cf230 0x7f20040b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.171+0000 7f2008a00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f20040b32d0 0x7f20040cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.171+0000 7f2008a00640 1 --2- 172.21.15.17:0/2513811639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f200406e750 0x7f20040b1fc0 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.171+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 >> 172.21.15.17:0/2513811639 conn(0x7f200406cfc0 msgr2=0x7f2004150900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:15.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.171+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 shutdown_connections 2024-09-10T23:30:15.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.171+0000 7f2008a00640 1 -- 172.21.15.17:0/2513811639 wait complete. 2024-09-10T23:30:15.190 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:30:15.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:30:15.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 -- 172.21.15.17:0/808755918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f5a0 msgr2=0x7fcd200ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 --2- 172.21.15.17:0/808755918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f5a0 0x7fcd200ce550 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fcd20070180 tx=0x7fcd0c01c830 comp rx=0 tx=0).stop 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 -- 172.21.15.17:0/808755918 shutdown_connections 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 --2- 172.21.15.17:0/808755918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f5a0 0x7fcd200ce550 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 --2- 172.21.15.17:0/808755918 >> v2:172.21.15.77:3300/0 conn(0x7fcd2015f1c0 0x7fcd200d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 -- 172.21.15.17:0/808755918 >> 172.21.15.17:0/808755918 conn(0x7fcd2009b040 msgr2=0x7fcd200d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 -- 172.21.15.17:0/808755918 shutdown_connections 2024-09-10T23:30:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 -- 172.21.15.17:0/808755918 wait complete. 2024-09-10T23:30:15.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 Processor -- start 2024-09-10T23:30:15.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 -- start start 2024-09-10T23:30:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd200ce020 0x7fcd2006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f1c0 0x7fcd20154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd2015f5a0 0x7fcd201552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcd201694a0 con 0x7fcd2015f1c0 2024-09-10T23:30:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd20169320 con 0x7fcd2015f5a0 2024-09-10T23:30:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.339+0000 7fcd28400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcd20169620 con 0x7fcd200ce020 2024-09-10T23:30:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd25000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f1c0 0x7fcd20154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd25000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f1c0 0x7fcd20154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48836/0 (socket says 172.21.15.17:48836) 2024-09-10T23:30:15.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd25000640 1 -- 172.21.15.17:0/2618863323 learned_addr learned my addr 172.21.15.17:0/2618863323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd25000640 1 -- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd200ce020 msgr2=0x7fcd2006ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd25000640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd200ce020 0x7fcd2006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd25000640 1 -- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd2015f5a0 msgr2=0x7fcd201552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd25000640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd2015f5a0 0x7fcd201552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd25000640 1 -- 172.21.15.17:0/2618863323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2015a090 con 0x7fcd2015f1c0 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd25000640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f1c0 0x7fcd20154db0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0b0040 tx=0x7fcd0c0a5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd1d600640 1 -- 172.21.15.17:0/2618863323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0b2040 con 0x7fcd2015f1c0 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd1d600640 1 -- 172.21.15.17:0/2618863323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd0c0043c0 con 0x7fcd2015f1c0 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd201656c0 con 0x7fcd2015f1c0 2024-09-10T23:30:15.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd1d600640 1 -- 172.21.15.17:0/2618863323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c003860 con 0x7fcd2015f1c0 2024-09-10T23:30:15.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd20165c80 con 0x7fcd2015f1c0 2024-09-10T23:30:15.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd200d2610 con 0x7fcd2015f1c0 2024-09-10T23:30:15.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.343+0000 7fcd1d600640 1 -- 172.21.15.17:0/2618863323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcd0c003a00 con 0x7fcd2015f1c0 2024-09-10T23:30:15.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.347+0000 7fcd1d600640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:15.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.347+0000 7fcd1d600640 1 -- 172.21.15.17:0/2618863323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 5249+0+0 (secure 0 0 0) 0x7fcd0c12d380 con 0x7fcd2015f1c0 2024-09-10T23:30:15.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.347+0000 7fcd25a00640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:15.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.347+0000 7fcd25a00640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400a9b0 tx=0x7fcd14005c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:15.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.351+0000 7fcd1d600640 1 -- 172.21.15.17:0/2618863323 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcd0c0164b0 con 0x7fcd2015f1c0 2024-09-10T23:30:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:15.523+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcd2015be60 con 0x7fcd2015f1c0 2024-09-10T23:30:16.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.387+0000 7fcd1d600640 1 -- 172.21.15.17:0/2618863323 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v198) ==== 138+0+0 (secure 0 0 0) 0x7fcd0c0f8b80 con 0x7fcd2015f1c0 2024-09-10T23:30:16.391 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:30:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 msgr2=0x7fcd00074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400a9b0 tx=0x7fcd14005c80 comp rx=0 tx=0).stop 2024-09-10T23:30:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f1c0 msgr2=0x7fcd20154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f1c0 0x7fcd20154db0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0b0040 tx=0x7fcd0c0a5760 comp rx=0 tx=0).stop 2024-09-10T23:30:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 shutdown_connections 2024-09-10T23:30:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcd000725e0 0x7fcd00074aa0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd2015f5a0 0x7fcd201552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd2015f1c0 0x7fcd20154db0 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 --2- 172.21.15.17:0/2618863323 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd200ce020 0x7fcd2006ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 >> 172.21.15.17:0/2618863323 conn(0x7fcd2009b040 msgr2=0x7fcd20072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 shutdown_connections 2024-09-10T23:30:16.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.391+0000 7fcd28400640 1 -- 172.21.15.17:0/2618863323 wait complete. 2024-09-10T23:30:16.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:30:16.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 -- 172.21.15.17:0/3805343658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6806e6f0 msgr2=0x7efc6815fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 --2- 172.21.15.17:0/3805343658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6806e6f0 0x7efc6815fcb0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7efc60009bc0 tx=0x7efc6001cba0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 -- 172.21.15.17:0/3805343658 shutdown_connections 2024-09-10T23:30:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 --2- 172.21.15.17:0/3805343658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6806e6f0 0x7efc6815fcb0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 --2- 172.21.15.17:0/3805343658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc68160460 0x7efc6815f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 -- 172.21.15.17:0/3805343658 >> 172.21.15.17:0/3805343658 conn(0x7efc680b17a0 msgr2=0x7efc680b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 -- 172.21.15.17:0/3805343658 shutdown_connections 2024-09-10T23:30:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 -- 172.21.15.17:0/3805343658 wait complete. 2024-09-10T23:30:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 Processor -- start 2024-09-10T23:30:16.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 -- start start 2024-09-10T23:30:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6806e6f0 0x7efc681303a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc68145800 0x7efc68164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc68160460 0x7efc6815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efc68168c90 con 0x7efc68145800 2024-09-10T23:30:16.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc68168b10 con 0x7efc6806e6f0 2024-09-10T23:30:16.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.579+0000 7efc6e000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efc68168e10 con 0x7efc68160460 2024-09-10T23:30:16.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc68145800 0x7efc68164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc68145800 0x7efc68164fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48846/0 (socket says 172.21.15.17:48846) 2024-09-10T23:30:16.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5fe00640 1 -- 172.21.15.17:0/1596643453 learned_addr learned my addr 172.21.15.17:0/1596643453 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:16.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc67400640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6806e6f0 0x7efc681303a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc67e00640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc68160460 0x7efc6815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5fe00640 1 -- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc68160460 msgr2=0x7efc6815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5fe00640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc68160460 0x7efc6815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5fe00640 1 -- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6806e6f0 msgr2=0x7efc681303a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5fe00640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6806e6f0 0x7efc681303a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5fe00640 1 -- 172.21.15.17:0/1596643453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc681308e0 con 0x7efc68145800 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5fe00640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc68145800 0x7efc68164fc0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7efc5000e9f0 tx=0x7efc5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5f400640 1 -- 172.21.15.17:0/1596643453 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5000cd80 con 0x7efc68145800 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5f400640 1 -- 172.21.15.17:0/1596643453 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc50004020 con 0x7efc68145800 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6813e740 con 0x7efc68145800 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc5f400640 1 -- 172.21.15.17:0/1596643453 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc50004450 con 0x7efc68145800 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6813ed00 con 0x7efc68145800 2024-09-10T23:30:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.583+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc680741d0 con 0x7efc68145800 2024-09-10T23:30:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.587+0000 7efc5f400640 1 -- 172.21.15.17:0/1596643453 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efc500047b0 con 0x7efc68145800 2024-09-10T23:30:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.587+0000 7efc5f400640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc440725e0 0x7efc44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.587+0000 7efc5f400640 1 -- 172.21.15.17:0/1596643453 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 5619+0+0 (secure 0 0 0) 0x7efc50093a90 con 0x7efc68145800 2024-09-10T23:30:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.587+0000 7efc67400640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc440725e0 0x7efc44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.587+0000 7efc67400640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc440725e0 0x7efc44074aa0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7efc58007fd0 tx=0x7efc58007f60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.591+0000 7efc5f400640 1 -- 172.21.15.17:0/1596643453 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efc5005ebe0 con 0x7efc68145800 2024-09-10T23:30:16.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:16.767+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efc68165bb0 con 0x7efc68145800 2024-09-10T23:30:17.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.395+0000 7efc5f400640 1 -- 172.21.15.17:0/1596643453 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v199) ==== 170+0+0 (secure 0 0 0) 0x7efc50063610 con 0x7efc68145800 2024-09-10T23:30:17.398 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:30:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc440725e0 msgr2=0x7efc44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc440725e0 0x7efc44074aa0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7efc58007fd0 tx=0x7efc58007f60 comp rx=0 tx=0).stop 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc68145800 msgr2=0x7efc68164fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc68145800 0x7efc68164fc0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7efc5000e9f0 tx=0x7efc5000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 shutdown_connections 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efc440725e0 0x7efc44074aa0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc68160460 0x7efc6815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc68145800 0x7efc68164fc0 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 --2- 172.21.15.17:0/1596643453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6806e6f0 0x7efc681303a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 >> 172.21.15.17:0/1596643453 conn(0x7efc680b17a0 msgr2=0x7efc68144440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 shutdown_connections 2024-09-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.399+0000 7efc6e000640 1 -- 172.21.15.17:0/1596643453 wait complete. 2024-09-10T23:30:17.440 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:30:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 -- 172.21.15.17:0/2802661727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 msgr2=0x7f43e00cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 --2- 172.21.15.17:0/2802661727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 0x7f43e00cfde0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f43e00c8da0 tx=0x7f43cc01c870 comp rx=0 tx=0).stop 2024-09-10T23:30:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 -- 172.21.15.17:0/2802661727 shutdown_connections 2024-09-10T23:30:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 --2- 172.21.15.17:0/2802661727 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e00b1740 0x7f43e00d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 --2- 172.21.15.17:0/2802661727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 0x7f43e00cfde0 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 --2- 172.21.15.17:0/2802661727 >> v2:172.21.15.77:3300/0 conn(0x7f43e015be00 0x7f43e015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 -- 172.21.15.17:0/2802661727 >> 172.21.15.17:0/2802661727 conn(0x7f43e009a9f0 msgr2=0x7f43e009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 -- 172.21.15.17:0/2802661727 shutdown_connections 2024-09-10T23:30:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 -- 172.21.15.17:0/2802661727 wait complete. 2024-09-10T23:30:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 Processor -- start 2024-09-10T23:30:17.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 -- start start 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 0x7f43e014e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e00b1740 0x7f43e006ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e015be00 0x7f43e006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f43e015d200 con 0x7f43e00b12e0 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43e015d080 con 0x7f43e00b1740 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f43e00b1c50 con 0x7f43e015be00 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 0x7f43e014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 0x7f43e014e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41744/0 (socket says 172.21.15.17:41744) 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e5400640 1 -- 172.21.15.17:0/1979689399 learned_addr learned my addr 172.21.15.17:0/1979689399 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e4a00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e00b1740 0x7f43e006ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:17.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e5e00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e015be00 0x7f43e006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e5400640 1 -- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e015be00 msgr2=0x7f43e006f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e5400640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e015be00 0x7f43e006f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e5400640 1 -- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e00b1740 msgr2=0x7f43e006ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e5400640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e00b1740 0x7f43e006ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e5400640 1 -- 172.21.15.17:0/1979689399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e01fbc80 con 0x7f43e00b12e0 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.591+0000 7f43e4a00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e00b1740 0x7f43e006ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.595+0000 7f43e5400640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 0x7f43e014e170 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f43d40058d0 tx=0x7f43d400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.595+0000 7f43dd600640 1 -- 172.21.15.17:0/1979689399 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4017070 con 0x7f43e00b12e0 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.595+0000 7f43dd600640 1 -- 172.21.15.17:0/1979689399 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43d4009d20 con 0x7f43e00b12e0 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.595+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e01faec0 con 0x7f43e00b12e0 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.595+0000 7f43dd600640 1 -- 172.21.15.17:0/1979689399 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40106c0 con 0x7f43e00b12e0 2024-09-10T23:30:17.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.595+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e01fb480 con 0x7f43e00b12e0 2024-09-10T23:30:17.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.595+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e015d4f0 con 0x7f43e00b12e0 2024-09-10T23:30:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.595+0000 7f43dd600640 1 -- 172.21.15.17:0/1979689399 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f43d4010860 con 0x7f43e00b12e0 2024-09-10T23:30:17.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.599+0000 7f43dd600640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c00725e0 0x7f43c0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:17.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.599+0000 7f43dd600640 1 -- 172.21.15.17:0/1979689399 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 6001+0+0 (secure 0 0 0) 0x7f43d4093cd0 con 0x7f43e00b12e0 2024-09-10T23:30:17.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.599+0000 7f43e4a00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c00725e0 0x7f43c0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:17.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.599+0000 7f43e4a00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c00725e0 0x7f43c0074aa0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0af000 tx=0x7f43cc01b0b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:17.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.599+0000 7f43dd600640 1 -- 172.21.15.17:0/1979689399 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f43d405f260 con 0x7f43e00b12e0 2024-09-10T23:30:17.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:17.815+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f43e00b10a0 con 0x7f43e00b12e0 2024-09-10T23:30:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.399+0000 7f43dd600640 1 -- 172.21.15.17:0/1979689399 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 29 and data pool 30 v148) ==== 174+0+0 (secure 0 0 0) 0x7f43d405eb60 con 0x7f43e00b12e0 2024-09-10T23:30:18.401 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 29 and data pool 30 2024-09-10T23:30:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c00725e0 msgr2=0x7f43c0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c00725e0 0x7f43c0074aa0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0af000 tx=0x7f43cc01b0b0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 msgr2=0x7f43e014e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 0x7f43e014e170 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f43d40058d0 tx=0x7f43d400dde0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 shutdown_connections 2024-09-10T23:30:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f43c00725e0 0x7f43c0074aa0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43e015be00 0x7f43e006f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43e00b1740 0x7f43e006ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 --2- 172.21.15.17:0/1979689399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43e00b12e0 0x7f43e014e170 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 >> 172.21.15.17:0/1979689399 conn(0x7f43e009a9f0 msgr2=0x7f43e0157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 shutdown_connections 2024-09-10T23:30:18.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.403+0000 7f43e7e00640 1 -- 172.21.15.17:0/1979689399 wait complete. 2024-09-10T23:30:18.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:30:18.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.591+0000 7f5382e00640 1 -- 172.21.15.17:0/995687163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 msgr2=0x7f537c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.591+0000 7f5382e00640 1 --2- 172.21.15.17:0/995687163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 0x7f537c070350 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f537c0af9d0 tx=0x7f537401cd70 comp rx=0 tx=0).stop 2024-09-10T23:30:18.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.591+0000 7f5382e00640 1 -- 172.21.15.17:0/995687163 shutdown_connections 2024-09-10T23:30:18.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.591+0000 7f5382e00640 1 --2- 172.21.15.17:0/995687163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 0x7f537c070350 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.591+0000 7f5382e00640 1 -- 172.21.15.17:0/995687163 >> 172.21.15.17:0/995687163 conn(0x7f537c0d03d0 msgr2=0x7f537c0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.591+0000 7f5382e00640 1 -- 172.21.15.17:0/995687163 shutdown_connections 2024-09-10T23:30:18.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.591+0000 7f5382e00640 1 -- 172.21.15.17:0/995687163 wait complete. 2024-09-10T23:30:18.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 Processor -- start 2024-09-10T23:30:18.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 -- start start 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f537c0d1120 0x7f537c149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f537c152c50 0x7f537c0ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 0x7f537c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f537c0b3e30 con 0x7f537c153030 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f537c0b56d0 con 0x7f537c0d1120 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f537c0b3fb0 con 0x7f537c152c50 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5380e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 0x7f537c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5380e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 0x7f537c0cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41766/0 (socket says 172.21.15.17:41766) 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5380e00640 1 -- 172.21.15.17:0/54973560 learned_addr learned my addr 172.21.15.17:0/54973560 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:18.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5373e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f537c152c50 0x7f537c0ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f537be00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f537c0d1120 0x7f537c149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5380e00640 1 -- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f537c152c50 msgr2=0x7f537c0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5380e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f537c152c50 0x7f537c0ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5380e00640 1 -- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f537c0d1120 msgr2=0x7f537c149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5380e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f537c0d1120 0x7f537c149170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5380e00640 1 -- 172.21.15.17:0/54973560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c0cf550 con 0x7f537c153030 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5380e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 0x7f537c0cede0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f5374009bd0 tx=0x7f5374003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5378c00640 1 -- 172.21.15.17:0/54973560 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53740bc070 con 0x7f537c153030 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5378c00640 1 -- 172.21.15.17:0/54973560 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53740ad8e0 con 0x7f537c153030 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5378c00640 1 -- 172.21.15.17:0/54973560 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53740b2040 con 0x7f537c153030 2024-09-10T23:30:18.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537c0cf830 con 0x7f537c153030 2024-09-10T23:30:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537c0cfdf0 con 0x7f537c153030 2024-09-10T23:30:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.595+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537c070350 con 0x7f537c153030 2024-09-10T23:30:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.599+0000 7f5378c00640 1 -- 172.21.15.17:0/54973560 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f53740b5070 con 0x7f537c153030 2024-09-10T23:30:18.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.599+0000 7f5378c00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f53580725e0 0x7f5358074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.599+0000 7f5378c00640 1 -- 172.21.15.17:0/54973560 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 6101+0+0 (secure 0 0 0) 0x7f537412d120 con 0x7f537c153030 2024-09-10T23:30:18.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.599+0000 7f537be00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f53580725e0 0x7f5358074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.599+0000 7f537be00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f53580725e0 0x7f5358074aa0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f537c0ce810 tx=0x7f536c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.603+0000 7f5378c00640 1 -- 172.21.15.17:0/54973560 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5374016990 con 0x7f537c153030 2024-09-10T23:30:18.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f537c06c330 con 0x7f537c153030 2024-09-10T23:30:18.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5378c00640 1 -- 172.21.15.17:0/54973560 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) ==== 74+0+16897 (secure 0 0 0) 0x7f53740f85d0 con 0x7f537c153030 2024-09-10T23:30:18.781 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:18.781 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":200,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:30:17.818608+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:30:15.536772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-10T23:30:16.779890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:30:18.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f53580725e0 msgr2=0x7f5358074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f53580725e0 0x7f5358074aa0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f537c0ce810 tx=0x7f536c009040 comp rx=0 tx=0).stop 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 msgr2=0x7f537c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 0x7f537c0cede0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f5374009bd0 tx=0x7f5374003f80 comp rx=0 tx=0).stop 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 shutdown_connections 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f53580725e0 0x7f5358074aa0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f537c153030 0x7f537c0cede0 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f537c152c50 0x7f537c0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 --2- 172.21.15.17:0/54973560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f537c0d1120 0x7f537c149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 >> 172.21.15.17:0/54973560 conn(0x7f537c0d03d0 msgr2=0x7f537c15ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 shutdown_connections 2024-09-10T23:30:18.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.779+0000 7f5382e00640 1 -- 172.21.15.17:0/54973560 wait complete. 2024-09-10T23:30:18.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:30:18.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.947+0000 7fcdcb200640 1 -- 172.21.15.17:0/339377076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb0004060 msgr2=0x7fcdb0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.947+0000 7fcdcb200640 1 --2- 172.21.15.17:0/339377076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdb0004060 0x7fcdb0004810 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4006f90 tx=0x7fcdb401f630 comp rx=0 tx=0).stop 2024-09-10T23:30:18.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.947+0000 7fcdca800640 1 -- 172.21.15.17:0/339377076 reap_dead start 2024-09-10T23:30:18.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.947+0000 7fcdcb200640 1 -- 172.21.15.17:0/339377076 shutdown_connections 2024-09-10T23:30:18.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.947+0000 7fcdcb200640 1 -- 172.21.15.17:0/339377076 >> 172.21.15.17:0/339377076 conn(0x7fcdcc09a9f0 msgr2=0x7fcdcc09add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:18.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.947+0000 7fcdcb200640 1 -- 172.21.15.17:0/339377076 shutdown_connections 2024-09-10T23:30:18.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.947+0000 7fcdcb200640 1 -- 172.21.15.17:0/339377076 wait complete. 2024-09-10T23:30:18.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 Processor -- start 2024-09-10T23:30:18.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 -- start start 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdb0004060 0x7fcdcc1f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc156f50 0x7fcdcc0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc0c9a20 0x7fcdcc0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0cfdb0 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0cfc30 con 0x7fcdcc156f50 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc0b1800 con 0x7fcdb0004060 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdca800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc0c9a20 0x7fcdcc0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdca800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc0c9a20 0x7fcdcc0b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41790/0 (socket says 172.21.15.17:41790) 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdca800640 1 -- 172.21.15.17:0/2364342908 learned_addr learned my addr 172.21.15.17:0/2364342908 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdc1400640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc156f50 0x7fcdcc0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdc9e00640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdb0004060 0x7fcdcc1f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdca800640 1 -- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdb0004060 msgr2=0x7fcdcc1f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdca800640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdb0004060 0x7fcdcc1f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdca800640 1 -- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc156f50 msgr2=0x7fcdcc0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:18.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdca800640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc156f50 0x7fcdcc0c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:18.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdca800640 1 -- 172.21.15.17:0/2364342908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc0c9f60 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdca800640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc0c9a20 0x7fcdcc0b0900 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0cf530 tx=0x7fcdc40019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdc2a00640 1 -- 172.21.15.17:0/2364342908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4011870 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdc2a00640 1 -- 172.21.15.17:0/2364342908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdc4017070 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdc2a00640 1 -- 172.21.15.17:0/2364342908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4011d80 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc1f7b70 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.951+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc1f8130 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.955+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdcc0b1d60 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.955+0000 7fcdc2a00640 1 -- 172.21.15.17:0/2364342908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcdc401c460 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.955+0000 7fcdc2a00640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcda80725e0 0x7fcda8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:18.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.955+0000 7fcdc2a00640 1 -- 172.21.15.17:0/2364342908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 6101+0+0 (secure 0 0 0) 0x7fcdc4093a80 con 0x7fcdcc0c9a20 2024-09-10T23:30:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.955+0000 7fcdc9e00640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcda80725e0 0x7fcda8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.955+0000 7fcdc9e00640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcda80725e0 0x7fcda8074aa0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009c60 tx=0x7fcdbc0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:18.959+0000 7fcdc2a00640 1 -- 172.21.15.17:0/2364342908 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcdc405efd0 con 0x7fcdcc0c9a20 2024-09-10T23:30:19.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.131+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdcc071600 con 0x7fcdcc0c9a20 2024-09-10T23:30:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdc2a00640 1 -- 172.21.15.17:0/2364342908 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) ==== 74+0+16897 (secure 0 0 0) 0x7fcdc405e8d0 con 0x7fcdcc0c9a20 2024-09-10T23:30:19.135 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:19.135 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":200,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:30:17.818608+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:30:15.536772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-10T23:30:16.779890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:30:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcda80725e0 msgr2=0x7fcda8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:19.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcda80725e0 0x7fcda8074aa0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009c60 tx=0x7fcdbc0091e0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc0c9a20 msgr2=0x7fcdcc0b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc0c9a20 0x7fcdcc0b0900 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0cf530 tx=0x7fcdc40019a0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 shutdown_connections 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcda80725e0 0x7fcda8074aa0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc0c9a20 0x7fcdcc0b0900 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdcc156f50 0x7fcdcc0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 --2- 172.21.15.17:0/2364342908 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcdb0004060 0x7fcdcc1f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 >> 172.21.15.17:0/2364342908 conn(0x7fcdcc09a9f0 msgr2=0x7fcdcc071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 shutdown_connections 2024-09-10T23:30:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.135+0000 7fcdcb200640 1 -- 172.21.15.17:0/2364342908 wait complete. 2024-09-10T23:30:19.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:30:19.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.303+0000 7f1e24200640 1 -- 172.21.15.17:0/1135206818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b31b0 msgr2=0x7f1e1c0d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:19.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.303+0000 7f1e24200640 1 --2- 172.21.15.17:0/1135206818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b31b0 0x7f1e1c0d03b0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009bc0 tx=0x7f1e1401cba0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.303+0000 7f1e24200640 1 -- 172.21.15.17:0/1135206818 shutdown_connections 2024-09-10T23:30:19.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.303+0000 7f1e24200640 1 --2- 172.21.15.17:0/1135206818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b31b0 0x7f1e1c0d03b0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.303+0000 7f1e24200640 1 -- 172.21.15.17:0/1135206818 >> 172.21.15.17:0/1135206818 conn(0x7f1e1c0d1da0 msgr2=0x7f1e1c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:19.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.303+0000 7f1e24200640 1 -- 172.21.15.17:0/1135206818 shutdown_connections 2024-09-10T23:30:19.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.303+0000 7f1e24200640 1 -- 172.21.15.17:0/1135206818 wait complete. 2024-09-10T23:30:19.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 Processor -- start 2024-09-10T23:30:19.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 -- start start 2024-09-10T23:30:19.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:19.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e1c0b31b0 0x7f1e1c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:19.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1c15f400 0x7f1e1c0c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:19.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c169e80 con 0x7f1e1c0b2540 2024-09-10T23:30:19.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c0cdcb0 con 0x7f1e1c15f400 2024-09-10T23:30:19.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e1c16a000 con 0x7f1e1c0b31b0 2024-09-10T23:30:19.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e21800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:19.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e21800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c15a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41806/0 (socket says 172.21.15.17:41806) 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e21800640 1 -- 172.21.15.17:0/2493722229 learned_addr learned my addr 172.21.15.17:0/2493722229 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e20e00640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e1c0b31b0 0x7f1e1c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e22200640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1c15f400 0x7f1e1c0c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e21800640 1 -- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e1c0b31b0 msgr2=0x7f1e1c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e21800640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e1c0b31b0 0x7f1e1c1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e21800640 1 -- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1c15f400 msgr2=0x7f1e1c0c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e21800640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1c15f400 0x7f1e1c0c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e21800640 1 -- 172.21.15.17:0/2493722229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e1c1f8220 con 0x7f1e1c0b2540 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e22200640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1c15f400 0x7f1e1c0c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e21800640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c15a670 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000c3f0 tx=0x7f1e1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:19.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e19600640 1 -- 172.21.15.17:0/2493722229 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e10017070 con 0x7f1e1c0b2540 2024-09-10T23:30:19.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e19600640 1 -- 172.21.15.17:0/2493722229 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e10003600 con 0x7f1e1c0b2540 2024-09-10T23:30:19.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e19600640 1 -- 172.21.15.17:0/2493722229 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e10003a50 con 0x7f1e1c0b2540 2024-09-10T23:30:19.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e1c1f8500 con 0x7f1e1c0b2540 2024-09-10T23:30:19.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.307+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e1c1f8ac0 con 0x7f1e1c0b2540 2024-09-10T23:30:19.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.311+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e1c0cc8b0 con 0x7f1e1c0b2540 2024-09-10T23:30:19.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.311+0000 7f1e19600640 1 -- 172.21.15.17:0/2493722229 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1e10003bf0 con 0x7f1e1c0b2540 2024-09-10T23:30:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.311+0000 7f1e19600640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dfc0725e0 0x7f1dfc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.311+0000 7f1e19600640 1 -- 172.21.15.17:0/2493722229 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 6101+0+0 (secure 0 0 0) 0x7f1e100929a0 con 0x7f1e1c0b2540 2024-09-10T23:30:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.311+0000 7f1e20e00640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dfc0725e0 0x7f1dfc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.311+0000 7f1e20e00640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dfc0725e0 0x7f1dfc074aa0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c15d6b0 tx=0x7f1e08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:19.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.315+0000 7f1e19600640 1 -- 172.21.15.17:0/2493722229 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1e1005ded0 con 0x7f1e1c0b2540 2024-09-10T23:30:19.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:19.531+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1e1c15d6e0 con 0x7f1e1c0b2540 2024-09-10T23:30:20.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.419+0000 7f1e19600640 1 -- 172.21.15.17:0/2493722229 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v151) ==== 118+0+0 (secure 0 0 0) 0x7f1e1005d7d0 con 0x7f1e1c0b2540 2024-09-10T23:30:20.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dfc0725e0 msgr2=0x7f1dfc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:20.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dfc0725e0 0x7f1dfc074aa0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c15d6b0 tx=0x7f1e08009040 comp rx=0 tx=0).stop 2024-09-10T23:30:20.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b2540 msgr2=0x7f1e1c15a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:20.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c15a670 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000c3f0 tx=0x7f1e1000c8b0 comp rx=0 tx=0).stop 2024-09-10T23:30:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 shutdown_connections 2024-09-10T23:30:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dfc0725e0 0x7f1dfc074aa0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1c15f400 0x7f1e1c0c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1e1c0b31b0 0x7f1e1c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 --2- 172.21.15.17:0/2493722229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c15a670 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 >> 172.21.15.17:0/2493722229 conn(0x7f1e1c0d1da0 msgr2=0x7f1e1c0cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 shutdown_connections 2024-09-10T23:30:20.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.423+0000 7f1e24200640 1 -- 172.21.15.17:0/2493722229 wait complete. 2024-09-10T23:30:20.447 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:30:20.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:30:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.599+0000 7f9067e00640 1 -- 172.21.15.17:0/1772607883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 msgr2=0x7f90680d2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.599+0000 7f9067e00640 1 --2- 172.21.15.17:0/1772607883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 0x7f90680d2770 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f9058009840 tx=0x7f905801f010 comp rx=0 tx=0).stop 2024-09-10T23:30:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.599+0000 7f9067e00640 1 -- 172.21.15.17:0/1772607883 shutdown_connections 2024-09-10T23:30:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.599+0000 7f9067e00640 1 --2- 172.21.15.17:0/1772607883 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f906815f570 0x7f9068071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.599+0000 7f9067e00640 1 --2- 172.21.15.17:0/1772607883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 0x7f90680d2770 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.599+0000 7f9067e00640 1 -- 172.21.15.17:0/1772607883 >> 172.21.15.17:0/1772607883 conn(0x7f90680d1c50 msgr2=0x7f90680d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.599+0000 7f9067e00640 1 -- 172.21.15.17:0/1772607883 shutdown_connections 2024-09-10T23:30:20.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.599+0000 7f9067e00640 1 -- 172.21.15.17:0/1772607883 wait complete. 2024-09-10T23:30:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 Processor -- start 2024-09-10T23:30:20.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 -- start start 2024-09-10T23:30:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068072520 0x7f906806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 0x7f90681f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f906815f570 0x7f906814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f90680afff0 con 0x7f906815f190 2024-09-10T23:30:20.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f90680afe70 con 0x7f9068072520 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f90680b0170 con 0x7f906815f570 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 0x7f90681f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 0x7f90681f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41818/0 (socket says 172.21.15.17:41818) 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905e000640 1 -- 172.21.15.17:0/1582269332 learned_addr learned my addr 172.21.15.17:0/1582269332 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9066a00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068072520 0x7f906806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067400640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f906815f570 0x7f906814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905e000640 1 -- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f906815f570 msgr2=0x7f906814ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905e000640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f906815f570 0x7f906814ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905e000640 1 -- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068072520 msgr2=0x7f906806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905e000640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068072520 0x7f906806f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:20.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905e000640 1 -- 172.21.15.17:0/1582269332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90681f4470 con 0x7f906815f190 2024-09-10T23:30:20.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9066a00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068072520 0x7f906806f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:20.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905e000640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 0x7f90681f4c30 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f905000d780 tx=0x7f905000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:20.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905fe00640 1 -- 172.21.15.17:0/1582269332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050017070 con 0x7f906815f190 2024-09-10T23:30:20.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905fe00640 1 -- 172.21.15.17:0/1582269332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f905000de90 con 0x7f906815f190 2024-09-10T23:30:20.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f905fe00640 1 -- 172.21.15.17:0/1582269332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050010460 con 0x7f906815f190 2024-09-10T23:30:20.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90681f5170 con 0x7f906815f190 2024-09-10T23:30:20.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90680c7ed0 con 0x7f906815f190 2024-09-10T23:30:20.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.603+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90680d2770 con 0x7f906815f190 2024-09-10T23:30:20.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.607+0000 7f905fe00640 1 -- 172.21.15.17:0/1582269332 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9050010600 con 0x7f906815f190 2024-09-10T23:30:20.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.607+0000 7f905fe00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:20.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.607+0000 7f905fe00640 1 -- 172.21.15.17:0/1582269332 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f9050093810 con 0x7f906815f190 2024-09-10T23:30:20.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.607+0000 7f9066a00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:20.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.607+0000 7f9066a00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f90580b2000 tx=0x7f905801d850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:20.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.611+0000 7f905fe00640 1 -- 172.21.15.17:0/1582269332 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f905005edf0 con 0x7f906815f190 2024-09-10T23:30:20.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:20.819+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f90680c91a0 con 0x7f906815f190 2024-09-10T23:30:21.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f905fe00640 1 -- 172.21.15.17:0/1582269332 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v152) ==== 122+0+0 (secure 0 0 0) 0x7f905005e6f0 con 0x7f906815f190 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 msgr2=0x7f9044074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f90580b2000 tx=0x7f905801d850 comp rx=0 tx=0).stop 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 msgr2=0x7f90681f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 0x7f90681f4c30 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f905000d780 tx=0x7f905000dc40 comp rx=0 tx=0).stop 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 shutdown_connections 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f90440725e0 0x7f9044074aa0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f906815f570 0x7f906814ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f906815f190 0x7f90681f4c30 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 --2- 172.21.15.17:0/1582269332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9068072520 0x7f906806f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 >> 172.21.15.17:0/1582269332 conn(0x7f90680d1c50 msgr2=0x7f906815c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 shutdown_connections 2024-09-10T23:30:21.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.427+0000 7f9067e00640 1 -- 172.21.15.17:0/1582269332 wait complete. 2024-09-10T23:30:21.454 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:30:21.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:30:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 -- 172.21.15.17:0/424138417 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f140cee30 msgr2=0x7f4f140b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 --2- 172.21.15.17:0/424138417 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f140cee30 0x7f4f140b1430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009bc0 tx=0x7f4f0c01cb10 comp rx=0 tx=0).stop 2024-09-10T23:30:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 -- 172.21.15.17:0/424138417 shutdown_connections 2024-09-10T23:30:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 --2- 172.21.15.17:0/424138417 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f140cee30 0x7f4f140b1430 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 --2- 172.21.15.17:0/424138417 >> v2:172.21.15.77:3300/0 conn(0x7f4f1415f730 0x7f4f140b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 -- 172.21.15.17:0/424138417 >> 172.21.15.17:0/424138417 conn(0x7f4f140d1d10 msgr2=0x7f4f140d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 -- 172.21.15.17:0/424138417 shutdown_connections 2024-09-10T23:30:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 -- 172.21.15.17:0/424138417 wait complete. 2024-09-10T23:30:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 Processor -- start 2024-09-10T23:30:21.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.603+0000 7f4f1b200640 1 -- start start 2024-09-10T23:30:21.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f1b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f140cee30 0x7f4f141f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f1b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1415f350 0x7f4f14163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f1b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1415f730 0x7f4f140c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f1b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4f14168bd0 con 0x7f4f1415f730 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f1b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4f140b2440 con 0x7f4f140cee30 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f1b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4f14168d50 con 0x7f4f1415f350 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f19200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1415f730 0x7f4f140c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f19200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1415f730 0x7f4f140c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41828/0 (socket says 172.21.15.17:41828) 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f19200640 1 -- 172.21.15.17:0/3600306026 learned_addr learned my addr 172.21.15.17:0/3600306026 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f13e00640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f140cee30 0x7f4f141f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f0be00640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1415f350 0x7f4f14163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f19200640 1 -- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1415f350 msgr2=0x7f4f14163f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f19200640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1415f350 0x7f4f14163f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f19200640 1 -- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f140cee30 msgr2=0x7f4f141f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f19200640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f140cee30 0x7f4f141f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f19200640 1 -- 172.21.15.17:0/3600306026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f14164600 con 0x7f4f1415f730 2024-09-10T23:30:21.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f0be00640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1415f350 0x7f4f14163f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f19200640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1415f730 0x7f4f140c8de0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c01a740 tx=0x7f4f0c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f10c00640 1 -- 172.21.15.17:0/3600306026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0ba020 con 0x7f4f1415f730 2024-09-10T23:30:21.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f10c00640 1 -- 172.21.15.17:0/3600306026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f0c004d40 con 0x7f4f1415f730 2024-09-10T23:30:21.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f10c00640 1 -- 172.21.15.17:0/3600306026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0b2040 con 0x7f4f1415f730 2024-09-10T23:30:21.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f141648e0 con 0x7f4f1415f730 2024-09-10T23:30:21.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f14164ea0 con 0x7f4f1415f730 2024-09-10T23:30:21.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f140b1430 con 0x7f4f1415f730 2024-09-10T23:30:21.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.607+0000 7f4f10c00640 1 -- 172.21.15.17:0/3600306026 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4f0c0b5070 con 0x7f4f1415f730 2024-09-10T23:30:21.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.611+0000 7f4f10c00640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef00725e0 0x7f4ef0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:21.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.611+0000 7f4f10c00640 1 -- 172.21.15.17:0/3600306026 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f4f0c12d6e0 con 0x7f4f1415f730 2024-09-10T23:30:21.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.611+0000 7f4f13e00640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef00725e0 0x7f4ef0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:21.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.611+0000 7f4f13e00640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef00725e0 0x7f4ef0074aa0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007fd0 tx=0x7f4f04007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:21.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.615+0000 7f4f10c00640 1 -- 172.21.15.17:0/3600306026 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4f0c0c4020 con 0x7f4f1415f730 2024-09-10T23:30:21.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f14071a10 con 0x7f4f1415f730 2024-09-10T23:30:21.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f10c00640 1 -- 172.21.15.17:0/3600306026 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5234 (secure 0 0 0) 0x7f4f0c016790 con 0x7f4f1415f730 2024-09-10T23:30:21.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:21.828 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":152,"btime":"2024-09-10T23:30:21:423641+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/762449917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":762449917},{"type":"v1","addr":"172.21.15.77:6836","nonce":762449917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/661473457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":661473457},{"type":"v1","addr":"172.21.15.17:6834","nonce":661473457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11049,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3378779893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3378779893},{"type":"v1","addr":"172.21.15.17:6835","nonce":3378779893}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:30:17.818575+0000","modified":"2024-09-10T23:30:20.823822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11055":{"gid":11055,"name":"b","rank":0,"incarnation":148,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2065743463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2065743463},{"type":"v1","addr":"172.21.15.77:6837","nonce":2065743463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11055,"qdb_cluster":[11055]},"id":14}]} 2024-09-10T23:30:21.829 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 152 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef00725e0 msgr2=0x7f4ef0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef00725e0 0x7f4ef0074aa0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007fd0 tx=0x7f4f04007ea0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1415f730 msgr2=0x7f4f140c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1415f730 0x7f4f140c8de0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c01a740 tx=0x7f4f0c009300 comp rx=0 tx=0).stop 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 shutdown_connections 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4ef00725e0 0x7f4ef0074aa0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f1415f730 0x7f4f140c8de0 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f1415f350 0x7f4f14163f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 --2- 172.21.15.17:0/3600306026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f140cee30 0x7f4f141f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 >> 172.21.15.17:0/3600306026 conn(0x7f4f140d1d10 msgr2=0x7f4f1406e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 shutdown_connections 2024-09-10T23:30:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.827+0000 7f4f1b200640 1 -- 172.21.15.17:0/3600306026 wait complete. 2024-09-10T23:30:21.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:30:21.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.995+0000 7fa002e00640 1 -- 172.21.15.17:0/1559508556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ffc152b40 msgr2=0x7f9ffc0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:21.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.995+0000 7fa002e00640 1 --2- 172.21.15.17:0/1559508556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ffc152b40 0x7f9ffc0b48d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009870 tx=0x7f9fec01c860 comp rx=0 tx=0).stop 2024-09-10T23:30:22.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.995+0000 7fa002e00640 1 -- 172.21.15.17:0/1559508556 shutdown_connections 2024-09-10T23:30:22.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.995+0000 7fa002e00640 1 --2- 172.21.15.17:0/1559508556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ffc152b40 0x7f9ffc0b48d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.995+0000 7fa002e00640 1 -- 172.21.15.17:0/1559508556 >> 172.21.15.17:0/1559508556 conn(0x7f9ffc06cfc0 msgr2=0x7f9ffc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.995+0000 7fa002e00640 1 -- 172.21.15.17:0/1559508556 shutdown_connections 2024-09-10T23:30:22.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.995+0000 7fa002e00640 1 -- 172.21.15.17:0/1559508556 wait complete. 2024-09-10T23:30:22.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa002e00640 1 Processor -- start 2024-09-10T23:30:22.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa002e00640 1 -- start start 2024-09-10T23:30:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa002e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ffc0d06f0 0x7f9ffc13f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa002e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ffc152b40 0x7f9ffc146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa002e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc1602d0 0x7f9ffc1468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa002e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc169cb0 con 0x7f9ffc1602d0 2024-09-10T23:30:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa002e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc169b30 con 0x7f9ffc0d06f0 2024-09-10T23:30:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa002e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc169e30 con 0x7f9ffc152b40 2024-09-10T23:30:22.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa000e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc1602d0 0x7f9ffc1468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa000e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc1602d0 0x7f9ffc1468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41834/0 (socket says 172.21.15.17:41834) 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa000e00640 1 -- 172.21.15.17:0/2933973333 learned_addr learned my addr 172.21.15.17:0/2933973333 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7f9ffbe00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ffc0d06f0 0x7f9ffc13f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7f9ff3e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ffc152b40 0x7f9ffc146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa000e00640 1 -- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ffc152b40 msgr2=0x7f9ffc146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa000e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ffc152b40 0x7f9ffc146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa000e00640 1 -- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ffc0d06f0 msgr2=0x7f9ffc13f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa000e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ffc0d06f0 0x7f9ffc13f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa000e00640 1 -- 172.21.15.17:0/2933973333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc140040 con 0x7f9ffc1602d0 2024-09-10T23:30:22.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa000e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc1602d0 0x7f9ffc1468b0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400cba0 tx=0x7f9ff400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7f9ff8c00640 1 -- 172.21.15.17:0/2933973333 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4016020 con 0x7f9ffc1602d0 2024-09-10T23:30:22.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7f9ff8c00640 1 -- 172.21.15.17:0/2933973333 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ff400ab60 con 0x7f9ffc1602d0 2024-09-10T23:30:22.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7f9ff8c00640 1 -- 172.21.15.17:0/2933973333 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4012420 con 0x7f9ffc1602d0 2024-09-10T23:30:22.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:21.999+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc140320 con 0x7f9ffc1602d0 2024-09-10T23:30:22.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.003+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc1408e0 con 0x7f9ffc1602d0 2024-09-10T23:30:22.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.003+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc13ce30 con 0x7f9ffc1602d0 2024-09-10T23:30:22.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.003+0000 7f9ff8c00640 1 -- 172.21.15.17:0/2933973333 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9ff40125c0 con 0x7f9ffc1602d0 2024-09-10T23:30:22.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.003+0000 7f9ff8c00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fd80725e0 0x7f9fd8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.003+0000 7f9ff8c00640 1 -- 172.21.15.17:0/2933973333 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f9ff40939d0 con 0x7f9ffc1602d0 2024-09-10T23:30:22.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.003+0000 7f9ffbe00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fd80725e0 0x7f9fd8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.003+0000 7f9ffbe00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fd80725e0 0x7f9fd8074aa0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0af000 tx=0x7f9fec01b0a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.007+0000 7f9ff8c00640 1 -- 172.21.15.17:0/2933973333 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9ffc13ce30 con 0x7f9ffc1602d0 2024-09-10T23:30:22.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.183+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ffc0b48d0 con 0x7f9ffc1602d0 2024-09-10T23:30:22.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.183+0000 7f9ff8c00640 1 -- 172.21.15.17:0/2933973333 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) ==== 74+0+16884 (secure 0 0 0) 0x7f9ff4020020 con 0x7f9ffc1602d0 2024-09-10T23:30:22.186 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:22.186 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":201,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:30:19.410160+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:30:15.536772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-10T23:30:16.779890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:30:22.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fd80725e0 msgr2=0x7f9fd8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fd80725e0 0x7f9fd8074aa0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0af000 tx=0x7f9fec01b0a0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc1602d0 msgr2=0x7f9ffc1468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc1602d0 0x7f9ffc1468b0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400cba0 tx=0x7f9ff400cc90 comp rx=0 tx=0).stop 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 shutdown_connections 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9fd80725e0 0x7f9fd8074aa0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc1602d0 0x7f9ffc1468b0 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ffc152b40 0x7f9ffc146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 --2- 172.21.15.17:0/2933973333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ffc0d06f0 0x7f9ffc13f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 >> 172.21.15.17:0/2933973333 conn(0x7f9ffc06cfc0 msgr2=0x7f9ffc15d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 shutdown_connections 2024-09-10T23:30:22.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.187+0000 7fa002e00640 1 -- 172.21.15.17:0/2933973333 wait complete. 2024-09-10T23:30:22.208 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:30:22.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:30:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.351+0000 7f96e1600640 1 -- 172.21.15.17:0/423515037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15ef40 msgr2=0x7f96dc15afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.351+0000 7f96e1600640 1 --2- 172.21.15.17:0/423515037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15ef40 0x7f96dc15afe0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009900 tx=0x7f96cc01c8b0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.351+0000 7f96e1600640 1 -- 172.21.15.17:0/423515037 shutdown_connections 2024-09-10T23:30:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.351+0000 7f96e1600640 1 --2- 172.21.15.17:0/423515037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc15e5d0 0x7f96dc0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.351+0000 7f96e1600640 1 --2- 172.21.15.17:0/423515037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15ef40 0x7f96dc15afe0 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.351+0000 7f96e1600640 1 -- 172.21.15.17:0/423515037 >> 172.21.15.17:0/423515037 conn(0x7f96dc06cfc0 msgr2=0x7f96dc06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.351+0000 7f96e1600640 1 -- 172.21.15.17:0/423515037 shutdown_connections 2024-09-10T23:30:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.351+0000 7f96e1600640 1 -- 172.21.15.17:0/423515037 wait complete. 2024-09-10T23:30:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 Processor -- start 2024-09-10T23:30:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 -- start start 2024-09-10T23:30:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0b4370 0x7f96dc157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15e5d0 0x7f96dc154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15ef40 0x7f96dc159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc1678e0 con 0x7f96dc15e5d0 2024-09-10T23:30:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc167760 con 0x7f96dc15ef40 2024-09-10T23:30:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f96dc167a60 con 0x7f96dc0b4370 2024-09-10T23:30:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15e5d0 0x7f96dc154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15e5d0 0x7f96dc154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41852/0 (socket says 172.21.15.17:41852) 2024-09-10T23:30:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d3e00640 1 -- 172.21.15.17:0/876929053 learned_addr learned my addr 172.21.15.17:0/876929053 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96daa00640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0b4370 0x7f96dc157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96db400640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15ef40 0x7f96dc159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d3e00640 1 -- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0b4370 msgr2=0x7f96dc157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d3e00640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0b4370 0x7f96dc157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d3e00640 1 -- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15ef40 msgr2=0x7f96dc159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d3e00640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15ef40 0x7f96dc159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d3e00640 1 -- 172.21.15.17:0/876929053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc0ccfb0 con 0x7f96dc15e5d0 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d3e00640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15e5d0 0x7f96dc154880 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f96c400d980 tx=0x7f96c400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d2a00640 1 -- 172.21.15.17:0/876929053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4017070 con 0x7f96dc15e5d0 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d2a00640 1 -- 172.21.15.17:0/876929053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96c4009d20 con 0x7f96dc15e5d0 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96d2a00640 1 -- 172.21.15.17:0/876929053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4004280 con 0x7f96dc15e5d0 2024-09-10T23:30:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc158190 con 0x7f96dc15e5d0 2024-09-10T23:30:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.355+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc15cbb0 con 0x7f96dc15e5d0 2024-09-10T23:30:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.359+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc0b3e30 con 0x7f96dc15e5d0 2024-09-10T23:30:22.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.359+0000 7f96d2a00640 1 -- 172.21.15.17:0/876929053 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f96c4003600 con 0x7f96dc15e5d0 2024-09-10T23:30:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.359+0000 7f96d2a00640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96b80725e0 0x7f96b8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.359+0000 7f96d2a00640 1 -- 172.21.15.17:0/876929053 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f96c40939c0 con 0x7f96dc15e5d0 2024-09-10T23:30:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.359+0000 7f96daa00640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96b80725e0 0x7f96b8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.359+0000 7f96daa00640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96b80725e0 0x7f96b8074aa0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0af000 tx=0x7f96cc01b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.363+0000 7f96d2a00640 1 -- 172.21.15.17:0/876929053 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f96c405e7a0 con 0x7f96dc15e5d0 2024-09-10T23:30:22.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.535+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96dc000970 con 0x7f96b80725e0 2024-09-10T23:30:22.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.539+0000 7f96d2a00640 1 -- 172.21.15.17:0/876929053 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251154 (secure 0 0 0) 0x7f96dc000970 con 0x7f96b80725e0 2024-09-10T23:30:22.545 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:22.547 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:30:22.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96b80725e0 msgr2=0x7f96b8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96b80725e0 0x7f96b8074aa0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0af000 tx=0x7f96cc01b0f0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15e5d0 msgr2=0x7f96dc154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15e5d0 0x7f96dc154880 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f96c400d980 tx=0x7f96c400de40 comp rx=0 tx=0).stop 2024-09-10T23:30:22.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 shutdown_connections 2024-09-10T23:30:22.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f96b80725e0 0x7f96b8074aa0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96dc15ef40 0x7f96dc159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96dc15e5d0 0x7f96dc154880 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 --2- 172.21.15.17:0/876929053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96dc0b4370 0x7f96dc157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 >> 172.21.15.17:0/876929053 conn(0x7f96dc06cfc0 msgr2=0x7f96dc15a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 shutdown_connections 2024-09-10T23:30:22.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.543+0000 7f96e1600640 1 -- 172.21.15.17:0/876929053 wait complete. 2024-09-10T23:30:22.566 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":644,"stamp":"2024-09-10T23:30:22.508517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":535424,"kb_used_data":20936,"kb_used_omap":12,"kb_used_meta":514291,"kb_avail":754439296,"statfs":{"total":773094113280,"available":772545839104,"internally_reserved":0,"allocated":21438464,"data_stored":10684527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":526634545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001633"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680622+0000","last_change":"2024-09-10T23:30:18.440391+0000","last_active":"2024-09-10T23:30:19.680622+0000","last_peered":"2024-09-10T23:30:19.680622+0000","last_clean":"2024-09-10T23:30:19.680622+0000","last_became_active":"2024-09-10T23:30:18.439926+0000","last_became_peered":"2024-09-10T23:30:18.439926+0000","last_unstale":"2024-09-10T23:30:19.680622+0000","last_undegraded":"2024-09-10T23:30:19.680622+0000","last_fullsized":"2024-09-10T23:30:19.680622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:44.295301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673620+0000","last_change":"2024-09-10T23:30:18.426349+0000","last_active":"2024-09-10T23:30:19.673620+0000","last_peered":"2024-09-10T23:30:19.673620+0000","last_clean":"2024-09-10T23:30:19.673620+0000","last_became_active":"2024-09-10T23:30:18.426097+0000","last_became_peered":"2024-09-10T23:30:18.426097+0000","last_unstale":"2024-09-10T23:30:19.673620+0000","last_undegraded":"2024-09-10T23:30:19.673620+0000","last_fullsized":"2024-09-10T23:30:19.673620+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.027470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409388+0000","last_change":"2024-09-10T23:30:17.409388+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409388+0000","last_undegraded":"2024-09-10T23:30:17.409388+0000","last_fullsized":"2024-09-10T23:30:17.409388+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425602+0000","last_change":"2024-09-10T23:30:18.435603+0000","last_active":"2024-09-10T23:30:19.425602+0000","last_peered":"2024-09-10T23:30:19.425602+0000","last_clean":"2024-09-10T23:30:19.425602+0000","last_became_active":"2024-09-10T23:30:18.435276+0000","last_became_peered":"2024-09-10T23:30:18.435276+0000","last_unstale":"2024-09-10T23:30:19.425602+0000","last_undegraded":"2024-09-10T23:30:19.425602+0000","last_fullsized":"2024-09-10T23:30:19.425602+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:33.263213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680433+0000","last_change":"2024-09-10T23:30:18.431319+0000","last_active":"2024-09-10T23:30:19.680433+0000","last_peered":"2024-09-10T23:30:19.680433+0000","last_clean":"2024-09-10T23:30:19.680433+0000","last_became_active":"2024-09-10T23:30:18.430960+0000","last_became_peered":"2024-09-10T23:30:18.430960+0000","last_unstale":"2024-09-10T23:30:19.680433+0000","last_undegraded":"2024-09-10T23:30:19.680433+0000","last_fullsized":"2024-09-10T23:30:19.680433+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:20.489147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:18.433402+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:18.432962+0000","last_became_peered":"2024-09-10T23:30:18.432962+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:43.563487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411081+0000","last_change":"2024-09-10T23:30:17.411081+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411081+0000","last_undegraded":"2024-09-10T23:30:17.411081+0000","last_fullsized":"2024-09-10T23:30:17.411081+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490652+0000","last_change":"2024-09-10T23:30:18.436129+0000","last_active":"2024-09-10T23:30:19.490652+0000","last_peered":"2024-09-10T23:30:19.490652+0000","last_clean":"2024-09-10T23:30:19.490652+0000","last_became_active":"2024-09-10T23:30:18.432600+0000","last_became_peered":"2024-09-10T23:30:18.432600+0000","last_unstale":"2024-09-10T23:30:19.490652+0000","last_undegraded":"2024-09-10T23:30:19.490652+0000","last_fullsized":"2024-09-10T23:30:19.490652+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:45.147222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673622+0000","last_change":"2024-09-10T23:30:18.418279+0000","last_active":"2024-09-10T23:30:19.673622+0000","last_peered":"2024-09-10T23:30:19.673622+0000","last_clean":"2024-09-10T23:30:19.673622+0000","last_became_active":"2024-09-10T23:30:18.418016+0000","last_became_peered":"2024-09-10T23:30:18.418016+0000","last_unstale":"2024-09-10T23:30:19.673622+0000","last_undegraded":"2024-09-10T23:30:19.673622+0000","last_fullsized":"2024-09-10T23:30:19.673622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:28.041686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.412410+0000","last_change":"2024-09-10T23:30:17.412410+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.412410+0000","last_undegraded":"2024-09-10T23:30:17.412410+0000","last_fullsized":"2024-09-10T23:30:17.412410+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425855+0000","last_change":"2024-09-10T23:30:18.430324+0000","last_active":"2024-09-10T23:30:19.425855+0000","last_peered":"2024-09-10T23:30:19.425855+0000","last_clean":"2024-09-10T23:30:19.425855+0000","last_became_active":"2024-09-10T23:30:18.429990+0000","last_became_peered":"2024-09-10T23:30:18.429990+0000","last_unstale":"2024-09-10T23:30:19.425855+0000","last_undegraded":"2024-09-10T23:30:19.425855+0000","last_fullsized":"2024-09-10T23:30:19.425855+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:57.601597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680462+0000","last_change":"2024-09-10T23:30:18.445466+0000","last_active":"2024-09-10T23:30:19.680462+0000","last_peered":"2024-09-10T23:30:19.680462+0000","last_clean":"2024-09-10T23:30:19.680462+0000","last_became_active":"2024-09-10T23:30:18.443772+0000","last_became_peered":"2024-09-10T23:30:18.443772+0000","last_unstale":"2024-09-10T23:30:19.680462+0000","last_undegraded":"2024-09-10T23:30:19.680462+0000","last_fullsized":"2024-09-10T23:30:19.680462+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:57.665627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490827+0000","last_change":"2024-09-10T23:30:18.434628+0000","last_active":"2024-09-10T23:30:19.490827+0000","last_peered":"2024-09-10T23:30:19.490827+0000","last_clean":"2024-09-10T23:30:19.490827+0000","last_became_active":"2024-09-10T23:30:18.434323+0000","last_became_peered":"2024-09-10T23:30:18.434323+0000","last_unstale":"2024-09-10T23:30:19.490827+0000","last_undegraded":"2024-09-10T23:30:19.490827+0000","last_fullsized":"2024-09-10T23:30:19.490827+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:44.464168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680538+0000","last_change":"2024-09-10T23:30:18.438166+0000","last_active":"2024-09-10T23:30:19.680538+0000","last_peered":"2024-09-10T23:30:19.680538+0000","last_clean":"2024-09-10T23:30:19.680538+0000","last_became_active":"2024-09-10T23:30:18.437380+0000","last_became_peered":"2024-09-10T23:30:18.437380+0000","last_unstale":"2024-09-10T23:30:19.680538+0000","last_undegraded":"2024-09-10T23:30:19.680538+0000","last_fullsized":"2024-09-10T23:30:19.680538+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:38.346963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673187+0000","last_change":"2024-09-10T23:30:18.419876+0000","last_active":"2024-09-10T23:30:19.673187+0000","last_peered":"2024-09-10T23:30:19.673187+0000","last_clean":"2024-09-10T23:30:19.673187+0000","last_became_active":"2024-09-10T23:30:18.419619+0000","last_became_peered":"2024-09-10T23:30:18.419619+0000","last_unstale":"2024-09-10T23:30:19.673187+0000","last_undegraded":"2024-09-10T23:30:19.673187+0000","last_fullsized":"2024-09-10T23:30:19.673187+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:10.606290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490788+0000","last_change":"2024-09-10T23:30:18.432783+0000","last_active":"2024-09-10T23:30:19.490788+0000","last_peered":"2024-09-10T23:30:19.490788+0000","last_clean":"2024-09-10T23:30:19.490788+0000","last_became_active":"2024-09-10T23:30:18.432259+0000","last_became_peered":"2024-09-10T23:30:18.432259+0000","last_unstale":"2024-09-10T23:30:19.490788+0000","last_undegraded":"2024-09-10T23:30:19.490788+0000","last_fullsized":"2024-09-10T23:30:19.490788+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:26.774814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681405+0000","last_change":"2024-09-10T23:30:18.448718+0000","last_active":"2024-09-10T23:30:19.681405+0000","last_peered":"2024-09-10T23:30:19.681405+0000","last_clean":"2024-09-10T23:30:19.681405+0000","last_became_active":"2024-09-10T23:30:18.446844+0000","last_became_peered":"2024-09-10T23:30:18.446844+0000","last_unstale":"2024-09-10T23:30:19.681405+0000","last_undegraded":"2024-09-10T23:30:19.681405+0000","last_fullsized":"2024-09-10T23:30:19.681405+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:29.166857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411964+0000","last_change":"2024-09-10T23:30:17.411964+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411964+0000","last_undegraded":"2024-09-10T23:30:17.411964+0000","last_fullsized":"2024-09-10T23:30:17.411964+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680532+0000","last_change":"2024-09-10T23:30:18.438704+0000","last_active":"2024-09-10T23:30:19.680532+0000","last_peered":"2024-09-10T23:30:19.680532+0000","last_clean":"2024-09-10T23:30:19.680532+0000","last_became_active":"2024-09-10T23:30:18.436192+0000","last_became_peered":"2024-09-10T23:30:18.436192+0000","last_unstale":"2024-09-10T23:30:19.680532+0000","last_undegraded":"2024-09-10T23:30:19.680532+0000","last_fullsized":"2024-09-10T23:30:19.680532+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:20.225885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491096+0000","last_change":"2024-09-10T23:30:18.434226+0000","last_active":"2024-09-10T23:30:19.491096+0000","last_peered":"2024-09-10T23:30:19.491096+0000","last_clean":"2024-09-10T23:30:19.491096+0000","last_became_active":"2024-09-10T23:30:18.433919+0000","last_became_peered":"2024-09-10T23:30:18.433919+0000","last_unstale":"2024-09-10T23:30:19.491096+0000","last_undegraded":"2024-09-10T23:30:19.491096+0000","last_fullsized":"2024-09-10T23:30:19.491096+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.591952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408998+0000","last_change":"2024-09-10T23:30:17.408998+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408998+0000","last_undegraded":"2024-09-10T23:30:17.408998+0000","last_fullsized":"2024-09-10T23:30:17.408998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673766+0000","last_change":"2024-09-10T23:30:18.432090+0000","last_active":"2024-09-10T23:30:19.673766+0000","last_peered":"2024-09-10T23:30:19.673766+0000","last_clean":"2024-09-10T23:30:19.673766+0000","last_became_active":"2024-09-10T23:30:18.430309+0000","last_became_peered":"2024-09-10T23:30:18.430309+0000","last_unstale":"2024-09-10T23:30:19.673766+0000","last_undegraded":"2024-09-10T23:30:19.673766+0000","last_fullsized":"2024-09-10T23:30:19.673766+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:26.449042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672993+0000","last_change":"2024-09-10T23:30:18.419267+0000","last_active":"2024-09-10T23:30:19.672993+0000","last_peered":"2024-09-10T23:30:19.672993+0000","last_clean":"2024-09-10T23:30:19.672993+0000","last_became_active":"2024-09-10T23:30:18.418970+0000","last_became_peered":"2024-09-10T23:30:18.418970+0000","last_unstale":"2024-09-10T23:30:19.672993+0000","last_undegraded":"2024-09-10T23:30:19.672993+0000","last_fullsized":"2024-09-10T23:30:19.672993+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:12.054872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680124+0000","last_change":"2024-09-10T23:30:18.430296+0000","last_active":"2024-09-10T23:30:19.680124+0000","last_peered":"2024-09-10T23:30:19.680124+0000","last_clean":"2024-09-10T23:30:19.680124+0000","last_became_active":"2024-09-10T23:30:18.430015+0000","last_became_peered":"2024-09-10T23:30:18.430015+0000","last_unstale":"2024-09-10T23:30:19.680124+0000","last_undegraded":"2024-09-10T23:30:19.680124+0000","last_fullsized":"2024-09-10T23:30:19.680124+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:43.868057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680876+0000","last_change":"2024-09-10T23:30:18.436029+0000","last_active":"2024-09-10T23:30:19.680876+0000","last_peered":"2024-09-10T23:30:19.680876+0000","last_clean":"2024-09-10T23:30:19.680876+0000","last_became_active":"2024-09-10T23:30:18.435737+0000","last_became_peered":"2024-09-10T23:30:18.435737+0000","last_unstale":"2024-09-10T23:30:19.680876+0000","last_undegraded":"2024-09-10T23:30:19.680876+0000","last_fullsized":"2024-09-10T23:30:19.680876+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:59.131863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411574+0000","last_change":"2024-09-10T23:30:17.411574+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411574+0000","last_undegraded":"2024-09-10T23:30:17.411574+0000","last_fullsized":"2024-09-10T23:30:17.411574+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425917+0000","last_change":"2024-09-10T23:30:18.434286+0000","last_active":"2024-09-10T23:30:19.425917+0000","last_peered":"2024-09-10T23:30:19.425917+0000","last_clean":"2024-09-10T23:30:19.425917+0000","last_became_active":"2024-09-10T23:30:18.434031+0000","last_became_peered":"2024-09-10T23:30:18.434031+0000","last_unstale":"2024-09-10T23:30:19.425917+0000","last_undegraded":"2024-09-10T23:30:19.425917+0000","last_fullsized":"2024-09-10T23:30:19.425917+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:13.918980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681217+0000","last_change":"2024-09-10T23:30:18.430415+0000","last_active":"2024-09-10T23:30:19.681217+0000","last_peered":"2024-09-10T23:30:19.681217+0000","last_clean":"2024-09-10T23:30:19.681217+0000","last_became_active":"2024-09-10T23:30:18.430059+0000","last_became_peered":"2024-09-10T23:30:18.430059+0000","last_unstale":"2024-09-10T23:30:19.681217+0000","last_undegraded":"2024-09-10T23:30:19.681217+0000","last_fullsized":"2024-09-10T23:30:19.681217+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:14.451454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673314+0000","last_change":"2024-09-10T23:30:18.436833+0000","last_active":"2024-09-10T23:30:19.673314+0000","last_peered":"2024-09-10T23:30:19.673314+0000","last_clean":"2024-09-10T23:30:19.673314+0000","last_became_active":"2024-09-10T23:30:18.436385+0000","last_became_peered":"2024-09-10T23:30:18.436385+0000","last_unstale":"2024-09-10T23:30:19.673314+0000","last_undegraded":"2024-09-10T23:30:19.673314+0000","last_fullsized":"2024-09-10T23:30:19.673314+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:48.896976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490730+0000","last_change":"2024-09-10T23:30:18.443963+0000","last_active":"2024-09-10T23:30:19.490730+0000","last_peered":"2024-09-10T23:30:19.490730+0000","last_clean":"2024-09-10T23:30:19.490730+0000","last_became_active":"2024-09-10T23:30:18.443624+0000","last_became_peered":"2024-09-10T23:30:18.443624+0000","last_unstale":"2024-09-10T23:30:19.490730+0000","last_undegraded":"2024-09-10T23:30:19.490730+0000","last_fullsized":"2024-09-10T23:30:19.490730+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:12.367128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673197+0000","last_change":"2024-09-10T23:30:18.426364+0000","last_active":"2024-09-10T23:30:19.673197+0000","last_peered":"2024-09-10T23:30:19.673197+0000","last_clean":"2024-09-10T23:30:19.673197+0000","last_became_active":"2024-09-10T23:30:18.426089+0000","last_became_peered":"2024-09-10T23:30:18.426089+0000","last_unstale":"2024-09-10T23:30:19.673197+0000","last_undegraded":"2024-09-10T23:30:19.673197+0000","last_fullsized":"2024-09-10T23:30:19.673197+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:54.103650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490986+0000","last_change":"2024-09-10T23:30:18.442390+0000","last_active":"2024-09-10T23:30:19.490986+0000","last_peered":"2024-09-10T23:30:19.490986+0000","last_clean":"2024-09-10T23:30:19.490986+0000","last_became_active":"2024-09-10T23:30:18.442008+0000","last_became_peered":"2024-09-10T23:30:18.442008+0000","last_unstale":"2024-09-10T23:30:19.490986+0000","last_undegraded":"2024-09-10T23:30:19.490986+0000","last_fullsized":"2024-09-10T23:30:19.490986+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:18.297755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408362+0000","last_change":"2024-09-10T23:30:17.408362+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408362+0000","last_undegraded":"2024-09-10T23:30:17.408362+0000","last_fullsized":"2024-09-10T23:30:17.408362+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"200'4","reported_seq":19,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673771+0000","last_change":"2024-09-10T23:30:17.428407+0000","last_active":"2024-09-10T23:30:19.673771+0000","last_peered":"2024-09-10T23:30:19.673771+0000","last_clean":"2024-09-10T23:30:19.673771+0000","last_became_active":"2024-09-10T23:30:17.428095+0000","last_became_peered":"2024-09-10T23:30:17.428095+0000","last_unstale":"2024-09-10T23:30:19.673771+0000","last_undegraded":"2024-09-10T23:30:19.673771+0000","last_fullsized":"2024-09-10T23:30:19.673771+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:44.817383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408920+0000","last_change":"2024-09-10T23:30:17.408920+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408920+0000","last_undegraded":"2024-09-10T23:30:17.408920+0000","last_fullsized":"2024-09-10T23:30:17.408920+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681483+0000","last_change":"2024-09-10T23:30:17.435885+0000","last_active":"2024-09-10T23:30:19.681483+0000","last_peered":"2024-09-10T23:30:19.681483+0000","last_clean":"2024-09-10T23:30:19.681483+0000","last_became_active":"2024-09-10T23:30:17.435638+0000","last_became_peered":"2024-09-10T23:30:17.435638+0000","last_unstale":"2024-09-10T23:30:19.681483+0000","last_undegraded":"2024-09-10T23:30:19.681483+0000","last_fullsized":"2024-09-10T23:30:19.681483+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:28.443604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681443+0000","last_change":"2024-09-10T23:30:18.446032+0000","last_active":"2024-09-10T23:30:19.681443+0000","last_peered":"2024-09-10T23:30:19.681443+0000","last_clean":"2024-09-10T23:30:19.681443+0000","last_became_active":"2024-09-10T23:30:18.445739+0000","last_became_peered":"2024-09-10T23:30:18.445739+0000","last_unstale":"2024-09-10T23:30:19.681443+0000","last_undegraded":"2024-09-10T23:30:19.681443+0000","last_fullsized":"2024-09-10T23:30:19.681443+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.138384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:17.426662+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:17.426379+0000","last_became_peered":"2024-09-10T23:30:17.426379+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:31.377540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409688+0000","last_change":"2024-09-10T23:30:17.409688+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409688+0000","last_undegraded":"2024-09-10T23:30:17.409688+0000","last_fullsized":"2024-09-10T23:30:17.409688+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674268+0000","last_change":"2024-09-10T23:30:17.424648+0000","last_active":"2024-09-10T23:30:19.674268+0000","last_peered":"2024-09-10T23:30:19.674268+0000","last_clean":"2024-09-10T23:30:19.674268+0000","last_became_active":"2024-09-10T23:30:17.424309+0000","last_became_peered":"2024-09-10T23:30:17.424309+0000","last_unstale":"2024-09-10T23:30:19.674268+0000","last_undegraded":"2024-09-10T23:30:19.674268+0000","last_fullsized":"2024-09-10T23:30:19.674268+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:44.144068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679901+0000","last_change":"2024-09-10T23:30:18.437987+0000","last_active":"2024-09-10T23:30:19.679901+0000","last_peered":"2024-09-10T23:30:19.679901+0000","last_clean":"2024-09-10T23:30:19.679901+0000","last_became_active":"2024-09-10T23:30:18.437707+0000","last_became_peered":"2024-09-10T23:30:18.437707+0000","last_unstale":"2024-09-10T23:30:19.679901+0000","last_undegraded":"2024-09-10T23:30:19.679901+0000","last_fullsized":"2024-09-10T23:30:19.679901+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:52.657720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680192+0000","last_change":"2024-09-10T23:30:17.438669+0000","last_active":"2024-09-10T23:30:19.680192+0000","last_peered":"2024-09-10T23:30:19.680192+0000","last_clean":"2024-09-10T23:30:19.680192+0000","last_became_active":"2024-09-10T23:30:17.438383+0000","last_became_peered":"2024-09-10T23:30:17.438383+0000","last_unstale":"2024-09-10T23:30:19.680192+0000","last_undegraded":"2024-09-10T23:30:19.680192+0000","last_fullsized":"2024-09-10T23:30:19.680192+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:58.970215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674014+0000","last_change":"2024-09-10T23:30:18.430231+0000","last_active":"2024-09-10T23:30:19.674014+0000","last_peered":"2024-09-10T23:30:19.674014+0000","last_clean":"2024-09-10T23:30:19.674014+0000","last_became_active":"2024-09-10T23:30:18.429920+0000","last_became_peered":"2024-09-10T23:30:18.429920+0000","last_unstale":"2024-09-10T23:30:19.674014+0000","last_undegraded":"2024-09-10T23:30:19.674014+0000","last_fullsized":"2024-09-10T23:30:19.674014+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:42.713962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425230+0000","last_change":"2024-09-10T23:30:17.425766+0000","last_active":"2024-09-10T23:30:19.425230+0000","last_peered":"2024-09-10T23:30:19.425230+0000","last_clean":"2024-09-10T23:30:19.425230+0000","last_became_active":"2024-09-10T23:30:17.424967+0000","last_became_peered":"2024-09-10T23:30:17.424967+0000","last_unstale":"2024-09-10T23:30:19.425230+0000","last_undegraded":"2024-09-10T23:30:19.425230+0000","last_fullsized":"2024-09-10T23:30:19.425230+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:55.277369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673775+0000","last_change":"2024-09-10T23:30:18.427654+0000","last_active":"2024-09-10T23:30:19.673775+0000","last_peered":"2024-09-10T23:30:19.673775+0000","last_clean":"2024-09-10T23:30:19.673775+0000","last_became_active":"2024-09-10T23:30:18.427356+0000","last_became_peered":"2024-09-10T23:30:18.427356+0000","last_unstale":"2024-09-10T23:30:19.673775+0000","last_undegraded":"2024-09-10T23:30:19.673775+0000","last_fullsized":"2024-09-10T23:30:19.673775+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:35.999756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-10T23:30:17.420337+0000","last_change":"2024-09-10T23:30:17.418976+0000","last_active":"2024-09-10T23:30:17.420337+0000","last_peered":"2024-09-10T23:30:17.420337+0000","last_clean":"2024-09-10T23:30:17.420337+0000","last_became_active":"2024-09-10T23:30:17.418442+0000","last_became_peered":"2024-09-10T23:30:17.418442+0000","last_unstale":"2024-09-10T23:30:17.420337+0000","last_undegraded":"2024-09-10T23:30:17.420337+0000","last_fullsized":"2024-09-10T23:30:17.420337+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.309934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674418+0000","last_change":"2024-09-10T23:30:18.425119+0000","last_active":"2024-09-10T23:30:19.674418+0000","last_peered":"2024-09-10T23:30:19.674418+0000","last_clean":"2024-09-10T23:30:19.674418+0000","last_became_active":"2024-09-10T23:30:18.424853+0000","last_became_peered":"2024-09-10T23:30:18.424853+0000","last_unstale":"2024-09-10T23:30:19.674418+0000","last_undegraded":"2024-09-10T23:30:19.674418+0000","last_fullsized":"2024-09-10T23:30:19.674418+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:31.576971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681004+0000","last_change":"2024-09-10T23:30:17.436490+0000","last_active":"2024-09-10T23:30:19.681004+0000","last_peered":"2024-09-10T23:30:19.681004+0000","last_clean":"2024-09-10T23:30:19.681004+0000","last_became_active":"2024-09-10T23:30:17.436203+0000","last_became_peered":"2024-09-10T23:30:17.436203+0000","last_unstale":"2024-09-10T23:30:19.681004+0000","last_undegraded":"2024-09-10T23:30:19.681004+0000","last_fullsized":"2024-09-10T23:30:19.681004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674470+0000","last_change":"2024-09-10T23:30:18.427676+0000","last_active":"2024-09-10T23:30:19.674470+0000","last_peered":"2024-09-10T23:30:19.674470+0000","last_clean":"2024-09-10T23:30:19.674470+0000","last_became_active":"2024-09-10T23:30:18.425145+0000","last_became_peered":"2024-09-10T23:30:18.425145+0000","last_unstale":"2024-09-10T23:30:19.674470+0000","last_undegraded":"2024-09-10T23:30:19.674470+0000","last_fullsized":"2024-09-10T23:30:19.674470+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425913+0000","last_change":"2024-09-10T23:30:17.431896+0000","last_active":"2024-09-10T23:30:19.425913+0000","last_peered":"2024-09-10T23:30:19.425913+0000","last_clean":"2024-09-10T23:30:19.425913+0000","last_became_active":"2024-09-10T23:30:17.430852+0000","last_became_peered":"2024-09-10T23:30:17.430852+0000","last_unstale":"2024-09-10T23:30:19.425913+0000","last_undegraded":"2024-09-10T23:30:19.425913+0000","last_fullsized":"2024-09-10T23:30:19.425913+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:03.399968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411064+0000","last_change":"2024-09-10T23:30:17.411064+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411064+0000","last_undegraded":"2024-09-10T23:30:17.411064+0000","last_fullsized":"2024-09-10T23:30:17.411064+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"200'3","reported_seq":18,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680857+0000","last_change":"2024-09-10T23:30:17.437999+0000","last_active":"2024-09-10T23:30:19.680857+0000","last_peered":"2024-09-10T23:30:19.680857+0000","last_clean":"2024-09-10T23:30:19.680857+0000","last_became_active":"2024-09-10T23:30:17.437724+0000","last_became_peered":"2024-09-10T23:30:17.437724+0000","last_unstale":"2024-09-10T23:30:19.680857+0000","last_undegraded":"2024-09-10T23:30:19.680857+0000","last_fullsized":"2024-09-10T23:30:19.680857+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:35.934846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.426144+0000","last_change":"2024-09-10T23:30:18.431666+0000","last_active":"2024-09-10T23:30:19.426144+0000","last_peered":"2024-09-10T23:30:19.426144+0000","last_clean":"2024-09-10T23:30:19.426144+0000","last_became_active":"2024-09-10T23:30:18.431392+0000","last_became_peered":"2024-09-10T23:30:18.431392+0000","last_unstale":"2024-09-10T23:30:19.426144+0000","last_undegraded":"2024-09-10T23:30:19.426144+0000","last_fullsized":"2024-09-10T23:30:19.426144+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:05.543871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"200'6","reported_seq":21,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491058+0000","last_change":"2024-09-10T23:30:17.427136+0000","last_active":"2024-09-10T23:30:19.491058+0000","last_peered":"2024-09-10T23:30:19.491058+0000","last_clean":"2024-09-10T23:30:19.491058+0000","last_became_active":"2024-09-10T23:30:17.426720+0000","last_became_peered":"2024-09-10T23:30:17.426720+0000","last_unstale":"2024-09-10T23:30:19.491058+0000","last_undegraded":"2024-09-10T23:30:19.491058+0000","last_fullsized":"2024-09-10T23:30:19.491058+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:42.586081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672998+0000","last_change":"2024-09-10T23:30:18.436906+0000","last_active":"2024-09-10T23:30:19.672998+0000","last_peered":"2024-09-10T23:30:19.672998+0000","last_clean":"2024-09-10T23:30:19.672998+0000","last_became_active":"2024-09-10T23:30:18.436447+0000","last_became_peered":"2024-09-10T23:30:18.436447+0000","last_unstale":"2024-09-10T23:30:19.672998+0000","last_undegraded":"2024-09-10T23:30:19.672998+0000","last_fullsized":"2024-09-10T23:30:19.672998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680784+0000","last_change":"2024-09-10T23:30:17.428623+0000","last_active":"2024-09-10T23:30:19.680784+0000","last_peered":"2024-09-10T23:30:19.680784+0000","last_clean":"2024-09-10T23:30:19.680784+0000","last_became_active":"2024-09-10T23:30:17.428332+0000","last_became_peered":"2024-09-10T23:30:17.428332+0000","last_unstale":"2024-09-10T23:30:19.680784+0000","last_undegraded":"2024-09-10T23:30:19.680784+0000","last_fullsized":"2024-09-10T23:30:19.680784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:44.204111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680358+0000","last_change":"2024-09-10T23:30:18.444027+0000","last_active":"2024-09-10T23:30:19.680358+0000","last_peered":"2024-09-10T23:30:19.680358+0000","last_clean":"2024-09-10T23:30:19.680358+0000","last_became_active":"2024-09-10T23:30:18.443479+0000","last_became_peered":"2024-09-10T23:30:18.443479+0000","last_unstale":"2024-09-10T23:30:19.680358+0000","last_undegraded":"2024-09-10T23:30:19.680358+0000","last_fullsized":"2024-09-10T23:30:19.680358+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:15.469850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673380+0000","last_change":"2024-09-10T23:30:17.417961+0000","last_active":"2024-09-10T23:30:19.673380+0000","last_peered":"2024-09-10T23:30:19.673380+0000","last_clean":"2024-09-10T23:30:19.673380+0000","last_became_active":"2024-09-10T23:30:17.417683+0000","last_became_peered":"2024-09-10T23:30:17.417683+0000","last_unstale":"2024-09-10T23:30:19.673380+0000","last_undegraded":"2024-09-10T23:30:19.673380+0000","last_fullsized":"2024-09-10T23:30:19.673380+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:45:55.340081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411074+0000","last_change":"2024-09-10T23:30:17.411074+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411074+0000","last_undegraded":"2024-09-10T23:30:17.411074+0000","last_fullsized":"2024-09-10T23:30:17.411074+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490429+0000","last_change":"2024-09-10T23:30:17.425540+0000","last_active":"2024-09-10T23:30:19.490429+0000","last_peered":"2024-09-10T23:30:19.490429+0000","last_clean":"2024-09-10T23:30:19.490429+0000","last_became_active":"2024-09-10T23:30:17.425256+0000","last_became_peered":"2024-09-10T23:30:17.425256+0000","last_unstale":"2024-09-10T23:30:19.490429+0000","last_undegraded":"2024-09-10T23:30:19.490429+0000","last_fullsized":"2024-09-10T23:30:19.490429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:37.019557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674115+0000","last_change":"2024-09-10T23:30:18.425671+0000","last_active":"2024-09-10T23:30:19.674115+0000","last_peered":"2024-09-10T23:30:19.674115+0000","last_clean":"2024-09-10T23:30:19.674115+0000","last_became_active":"2024-09-10T23:30:18.424769+0000","last_became_peered":"2024-09-10T23:30:18.424769+0000","last_unstale":"2024-09-10T23:30:19.674115+0000","last_undegraded":"2024-09-10T23:30:19.674115+0000","last_fullsized":"2024-09-10T23:30:19.674115+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:39.771480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"200'8","reported_seq":23,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679790+0000","last_change":"2024-09-10T23:30:17.425625+0000","last_active":"2024-09-10T23:30:19.679790+0000","last_peered":"2024-09-10T23:30:19.679790+0000","last_clean":"2024-09-10T23:30:19.679790+0000","last_became_active":"2024-09-10T23:30:17.425348+0000","last_became_peered":"2024-09-10T23:30:17.425348+0000","last_unstale":"2024-09-10T23:30:19.679790+0000","last_undegraded":"2024-09-10T23:30:19.679790+0000","last_fullsized":"2024-09-10T23:30:19.679790+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:53.025824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673146+0000","last_change":"2024-09-10T23:30:18.428571+0000","last_active":"2024-09-10T23:30:19.673146+0000","last_peered":"2024-09-10T23:30:19.673146+0000","last_clean":"2024-09-10T23:30:19.673146+0000","last_became_active":"2024-09-10T23:30:18.427496+0000","last_became_peered":"2024-09-10T23:30:18.427496+0000","last_unstale":"2024-09-10T23:30:19.673146+0000","last_undegraded":"2024-09-10T23:30:19.673146+0000","last_fullsized":"2024-09-10T23:30:19.673146+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:25.149316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-10T23:30:17.424153+0000","last_change":"2024-09-10T23:30:17.423434+0000","last_active":"2024-09-10T23:30:17.424153+0000","last_peered":"2024-09-10T23:30:17.424153+0000","last_clean":"2024-09-10T23:30:17.424153+0000","last_became_active":"2024-09-10T23:30:17.423143+0000","last_became_peered":"2024-09-10T23:30:17.423143+0000","last_unstale":"2024-09-10T23:30:17.424153+0000","last_undegraded":"2024-09-10T23:30:17.424153+0000","last_fullsized":"2024-09-10T23:30:17.424153+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:25.958953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680725+0000","last_change":"2024-09-10T23:30:18.442899+0000","last_active":"2024-09-10T23:30:19.680725+0000","last_peered":"2024-09-10T23:30:19.680725+0000","last_clean":"2024-09-10T23:30:19.680725+0000","last_became_active":"2024-09-10T23:30:18.442642+0000","last_became_peered":"2024-09-10T23:30:18.442642+0000","last_unstale":"2024-09-10T23:30:19.680725+0000","last_undegraded":"2024-09-10T23:30:19.680725+0000","last_fullsized":"2024-09-10T23:30:19.680725+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:09.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673407+0000","last_change":"2024-09-10T23:30:17.419308+0000","last_active":"2024-09-10T23:30:19.673407+0000","last_peered":"2024-09-10T23:30:19.673407+0000","last_clean":"2024-09-10T23:30:19.673407+0000","last_became_active":"2024-09-10T23:30:17.419027+0000","last_became_peered":"2024-09-10T23:30:17.419027+0000","last_unstale":"2024-09-10T23:30:19.673407+0000","last_undegraded":"2024-09-10T23:30:19.673407+0000","last_fullsized":"2024-09-10T23:30:19.673407+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:37.201310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409456+0000","last_change":"2024-09-10T23:30:17.409456+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409456+0000","last_undegraded":"2024-09-10T23:30:17.409456+0000","last_fullsized":"2024-09-10T23:30:17.409456+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681143+0000","last_change":"2024-09-10T23:30:17.427272+0000","last_active":"2024-09-10T23:30:19.681143+0000","last_peered":"2024-09-10T23:30:19.681143+0000","last_clean":"2024-09-10T23:30:19.681143+0000","last_became_active":"2024-09-10T23:30:17.426898+0000","last_became_peered":"2024-09-10T23:30:17.426898+0000","last_unstale":"2024-09-10T23:30:19.681143+0000","last_undegraded":"2024-09-10T23:30:19.681143+0000","last_fullsized":"2024-09-10T23:30:19.681143+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:17.943545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681625+0000","last_change":"2024-09-10T23:30:18.442632+0000","last_active":"2024-09-10T23:30:19.681625+0000","last_peered":"2024-09-10T23:30:19.681625+0000","last_clean":"2024-09-10T23:30:19.681625+0000","last_became_active":"2024-09-10T23:30:18.442386+0000","last_became_peered":"2024-09-10T23:30:18.442386+0000","last_unstale":"2024-09-10T23:30:19.681625+0000","last_undegraded":"2024-09-10T23:30:19.681625+0000","last_fullsized":"2024-09-10T23:30:19.681625+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:48.604686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681142+0000","last_change":"2024-09-10T23:30:17.427578+0000","last_active":"2024-09-10T23:30:19.681142+0000","last_peered":"2024-09-10T23:30:19.681142+0000","last_clean":"2024-09-10T23:30:19.681142+0000","last_became_active":"2024-09-10T23:30:17.424863+0000","last_became_peered":"2024-09-10T23:30:17.424863+0000","last_unstale":"2024-09-10T23:30:19.681142+0000","last_undegraded":"2024-09-10T23:30:19.681142+0000","last_fullsized":"2024-09-10T23:30:19.681142+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:32.433094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680070+0000","last_change":"2024-09-10T23:30:18.446294+0000","last_active":"2024-09-10T23:30:19.680070+0000","last_peered":"2024-09-10T23:30:19.680070+0000","last_clean":"2024-09-10T23:30:19.680070+0000","last_became_active":"2024-09-10T23:30:18.445592+0000","last_became_peered":"2024-09-10T23:30:18.445592+0000","last_unstale":"2024-09-10T23:30:19.680070+0000","last_undegraded":"2024-09-10T23:30:19.680070+0000","last_fullsized":"2024-09-10T23:30:19.680070+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:21.909190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680832+0000","last_change":"2024-09-10T23:30:17.436646+0000","last_active":"2024-09-10T23:30:19.680832+0000","last_peered":"2024-09-10T23:30:19.680832+0000","last_clean":"2024-09-10T23:30:19.680832+0000","last_became_active":"2024-09-10T23:30:17.435895+0000","last_became_peered":"2024-09-10T23:30:17.435895+0000","last_unstale":"2024-09-10T23:30:19.680832+0000","last_undegraded":"2024-09-10T23:30:19.680832+0000","last_fullsized":"2024-09-10T23:30:19.680832+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:39.922424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680075+0000","last_change":"2024-09-10T23:30:18.433819+0000","last_active":"2024-09-10T23:30:19.680075+0000","last_peered":"2024-09-10T23:30:19.680075+0000","last_clean":"2024-09-10T23:30:19.680075+0000","last_became_active":"2024-09-10T23:30:18.433550+0000","last_became_peered":"2024-09-10T23:30:18.433550+0000","last_unstale":"2024-09-10T23:30:19.680075+0000","last_undegraded":"2024-09-10T23:30:19.680075+0000","last_fullsized":"2024-09-10T23:30:19.680075+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:34.276101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673939+0000","last_change":"2024-09-10T23:30:17.414097+0000","last_active":"2024-09-10T23:30:19.673939+0000","last_peered":"2024-09-10T23:30:19.673939+0000","last_clean":"2024-09-10T23:30:19.673939+0000","last_became_active":"2024-09-10T23:30:17.413839+0000","last_became_peered":"2024-09-10T23:30:17.413839+0000","last_unstale":"2024-09-10T23:30:19.673939+0000","last_undegraded":"2024-09-10T23:30:19.673939+0000","last_fullsized":"2024-09-10T23:30:19.673939+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673192+0000","last_change":"2024-09-10T23:30:18.435156+0000","last_active":"2024-09-10T23:30:19.673192+0000","last_peered":"2024-09-10T23:30:19.673192+0000","last_clean":"2024-09-10T23:30:19.673192+0000","last_became_active":"2024-09-10T23:30:18.434885+0000","last_became_peered":"2024-09-10T23:30:18.434885+0000","last_unstale":"2024-09-10T23:30:19.673192+0000","last_undegraded":"2024-09-10T23:30:19.673192+0000","last_fullsized":"2024-09-10T23:30:19.673192+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:08.514251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673435+0000","last_change":"2024-09-10T23:30:17.409125+0000","last_active":"2024-09-10T23:30:19.673435+0000","last_peered":"2024-09-10T23:30:19.673435+0000","last_clean":"2024-09-10T23:30:19.673435+0000","last_became_active":"2024-09-10T23:30:17.408859+0000","last_became_peered":"2024-09-10T23:30:17.408859+0000","last_unstale":"2024-09-10T23:30:19.673435+0000","last_undegraded":"2024-09-10T23:30:19.673435+0000","last_fullsized":"2024-09-10T23:30:19.673435+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408508+0000","last_change":"2024-09-10T23:30:17.408508+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408508+0000","last_undegraded":"2024-09-10T23:30:17.408508+0000","last_fullsized":"2024-09-10T23:30:17.408508+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672778+0000","last_change":"2024-09-10T23:30:17.420097+0000","last_active":"2024-09-10T23:30:19.672778+0000","last_peered":"2024-09-10T23:30:19.672778+0000","last_clean":"2024-09-10T23:30:19.672778+0000","last_became_active":"2024-09-10T23:30:17.419810+0000","last_became_peered":"2024-09-10T23:30:17.419810+0000","last_unstale":"2024-09-10T23:30:19.672778+0000","last_undegraded":"2024-09-10T23:30:19.672778+0000","last_fullsized":"2024-09-10T23:30:19.672778+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:56.936472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673368+0000","last_change":"2024-09-10T23:30:18.419771+0000","last_active":"2024-09-10T23:30:19.673368+0000","last_peered":"2024-09-10T23:30:19.673368+0000","last_clean":"2024-09-10T23:30:19.673368+0000","last_became_active":"2024-09-10T23:30:18.419502+0000","last_became_peered":"2024-09-10T23:30:18.419502+0000","last_unstale":"2024-09-10T23:30:19.673368+0000","last_undegraded":"2024-09-10T23:30:19.673368+0000","last_fullsized":"2024-09-10T23:30:19.673368+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:44.400118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681564+0000","last_change":"2024-09-10T23:30:17.425729+0000","last_active":"2024-09-10T23:30:19.681564+0000","last_peered":"2024-09-10T23:30:19.681564+0000","last_clean":"2024-09-10T23:30:19.681564+0000","last_became_active":"2024-09-10T23:30:17.425302+0000","last_became_peered":"2024-09-10T23:30:17.425302+0000","last_unstale":"2024-09-10T23:30:19.681564+0000","last_undegraded":"2024-09-10T23:30:19.681564+0000","last_fullsized":"2024-09-10T23:30:19.681564+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:56.886964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680785+0000","last_change":"2024-09-10T23:30:18.436355+0000","last_active":"2024-09-10T23:30:19.680785+0000","last_peered":"2024-09-10T23:30:19.680785+0000","last_clean":"2024-09-10T23:30:19.680785+0000","last_became_active":"2024-09-10T23:30:18.435787+0000","last_became_peered":"2024-09-10T23:30:18.435787+0000","last_unstale":"2024-09-10T23:30:19.680785+0000","last_undegraded":"2024-09-10T23:30:19.680785+0000","last_fullsized":"2024-09-10T23:30:19.680785+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:57.394499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674464+0000","last_change":"2024-09-10T23:30:17.409966+0000","last_active":"2024-09-10T23:30:19.674464+0000","last_peered":"2024-09-10T23:30:19.674464+0000","last_clean":"2024-09-10T23:30:19.674464+0000","last_became_active":"2024-09-10T23:30:17.409718+0000","last_became_peered":"2024-09-10T23:30:17.409718+0000","last_unstale":"2024-09-10T23:30:19.674464+0000","last_undegraded":"2024-09-10T23:30:19.674464+0000","last_fullsized":"2024-09-10T23:30:19.674464+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:25.771659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490949+0000","last_change":"2024-09-10T23:30:18.445113+0000","last_active":"2024-09-10T23:30:19.490949+0000","last_peered":"2024-09-10T23:30:19.490949+0000","last_clean":"2024-09-10T23:30:19.490949+0000","last_became_active":"2024-09-10T23:30:18.444854+0000","last_became_peered":"2024-09-10T23:30:18.444854+0000","last_unstale":"2024-09-10T23:30:19.490949+0000","last_undegraded":"2024-09-10T23:30:19.490949+0000","last_fullsized":"2024-09-10T23:30:19.490949+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:50.338409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674429+0000","last_change":"2024-09-10T23:30:17.421620+0000","last_active":"2024-09-10T23:30:19.674429+0000","last_peered":"2024-09-10T23:30:19.674429+0000","last_clean":"2024-09-10T23:30:19.674429+0000","last_became_active":"2024-09-10T23:30:17.421324+0000","last_became_peered":"2024-09-10T23:30:17.421324+0000","last_unstale":"2024-09-10T23:30:19.674429+0000","last_undegraded":"2024-09-10T23:30:19.674429+0000","last_fullsized":"2024-09-10T23:30:19.674429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:11.363973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673416+0000","last_change":"2024-09-10T23:30:18.424759+0000","last_active":"2024-09-10T23:30:19.673416+0000","last_peered":"2024-09-10T23:30:19.673416+0000","last_clean":"2024-09-10T23:30:19.673416+0000","last_became_active":"2024-09-10T23:30:18.424453+0000","last_became_peered":"2024-09-10T23:30:18.424453+0000","last_unstale":"2024-09-10T23:30:19.673416+0000","last_undegraded":"2024-09-10T23:30:19.673416+0000","last_fullsized":"2024-09-10T23:30:19.673416+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:47.092041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681267+0000","last_change":"2024-09-10T23:30:17.434351+0000","last_active":"2024-09-10T23:30:19.681267+0000","last_peered":"2024-09-10T23:30:19.681267+0000","last_clean":"2024-09-10T23:30:19.681267+0000","last_became_active":"2024-09-10T23:30:17.433835+0000","last_became_peered":"2024-09-10T23:30:17.433835+0000","last_unstale":"2024-09-10T23:30:19.681267+0000","last_undegraded":"2024-09-10T23:30:19.681267+0000","last_fullsized":"2024-09-10T23:30:19.681267+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:01.966013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409285+0000","last_change":"2024-09-10T23:30:17.409285+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409285+0000","last_undegraded":"2024-09-10T23:30:17.409285+0000","last_fullsized":"2024-09-10T23:30:17.409285+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680899+0000","last_change":"2024-09-10T23:30:17.429711+0000","last_active":"2024-09-10T23:30:19.680899+0000","last_peered":"2024-09-10T23:30:19.680899+0000","last_clean":"2024-09-10T23:30:19.680899+0000","last_became_active":"2024-09-10T23:30:17.429344+0000","last_became_peered":"2024-09-10T23:30:17.429344+0000","last_unstale":"2024-09-10T23:30:19.680899+0000","last_undegraded":"2024-09-10T23:30:19.680899+0000","last_fullsized":"2024-09-10T23:30:19.680899+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:38.807426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.410516+0000","last_change":"2024-09-10T23:30:17.410516+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.410516+0000","last_undegraded":"2024-09-10T23:30:17.410516+0000","last_fullsized":"2024-09-10T23:30:17.410516+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425328+0000","last_change":"2024-09-10T23:30:17.427637+0000","last_active":"2024-09-10T23:30:19.425328+0000","last_peered":"2024-09-10T23:30:19.425328+0000","last_clean":"2024-09-10T23:30:19.425328+0000","last_became_active":"2024-09-10T23:30:17.427332+0000","last_became_peered":"2024-09-10T23:30:17.427332+0000","last_unstale":"2024-09-10T23:30:19.425328+0000","last_undegraded":"2024-09-10T23:30:19.425328+0000","last_fullsized":"2024-09-10T23:30:19.425328+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:04.590063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673512+0000","last_change":"2024-09-10T23:30:18.410894+0000","last_active":"2024-09-10T23:30:19.673512+0000","last_peered":"2024-09-10T23:30:19.673512+0000","last_clean":"2024-09-10T23:30:19.673512+0000","last_became_active":"2024-09-10T23:30:18.410504+0000","last_became_peered":"2024-09-10T23:30:18.410504+0000","last_unstale":"2024-09-10T23:30:19.673512+0000","last_undegraded":"2024-09-10T23:30:19.673512+0000","last_fullsized":"2024-09-10T23:30:19.673512+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:10.502957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679898+0000","last_change":"2024-09-10T23:30:17.435618+0000","last_active":"2024-09-10T23:30:19.679898+0000","last_peered":"2024-09-10T23:30:19.679898+0000","last_clean":"2024-09-10T23:30:19.679898+0000","last_became_active":"2024-09-10T23:30:17.435326+0000","last_became_peered":"2024-09-10T23:30:17.435326+0000","last_unstale":"2024-09-10T23:30:19.679898+0000","last_undegraded":"2024-09-10T23:30:19.679898+0000","last_fullsized":"2024-09-10T23:30:19.679898+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:38.614066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680764+0000","last_change":"2024-09-10T23:30:18.447807+0000","last_active":"2024-09-10T23:30:19.680764+0000","last_peered":"2024-09-10T23:30:19.680764+0000","last_clean":"2024-09-10T23:30:19.680764+0000","last_became_active":"2024-09-10T23:30:18.446742+0000","last_became_peered":"2024-09-10T23:30:18.446742+0000","last_unstale":"2024-09-10T23:30:19.680764+0000","last_undegraded":"2024-09-10T23:30:19.680764+0000","last_fullsized":"2024-09-10T23:30:19.680764+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:42.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679936+0000","last_change":"2024-09-10T23:30:17.426703+0000","last_active":"2024-09-10T23:30:19.679936+0000","last_peered":"2024-09-10T23:30:19.679936+0000","last_clean":"2024-09-10T23:30:19.679936+0000","last_became_active":"2024-09-10T23:30:17.425405+0000","last_became_peered":"2024-09-10T23:30:17.425405+0000","last_unstale":"2024-09-10T23:30:19.679936+0000","last_undegraded":"2024-09-10T23:30:19.679936+0000","last_fullsized":"2024-09-10T23:30:19.679936+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:10.559348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411488+0000","last_change":"2024-09-10T23:30:17.411488+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411488+0000","last_undegraded":"2024-09-10T23:30:17.411488+0000","last_fullsized":"2024-09-10T23:30:17.411488+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680337+0000","last_change":"2024-09-10T23:30:17.435242+0000","last_active":"2024-09-10T23:30:19.680337+0000","last_peered":"2024-09-10T23:30:19.680337+0000","last_clean":"2024-09-10T23:30:19.680337+0000","last_became_active":"2024-09-10T23:30:17.434970+0000","last_became_peered":"2024-09-10T23:30:17.434970+0000","last_unstale":"2024-09-10T23:30:19.680337+0000","last_undegraded":"2024-09-10T23:30:19.680337+0000","last_fullsized":"2024-09-10T23:30:19.680337+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":436,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679937+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:30:19.679937+0000","last_peered":"2024-09-10T23:30:19.679937+0000","last_clean":"2024-09-10T23:30:19.679937+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:30:19.679937+0000","last_undegraded":"2024-09-10T23:30:19.679937+0000","last_fullsized":"2024-09-10T23:30:19.679937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476918,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69716,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302124,"statfs":{"total":96636764160,"available":96565374976,"internally_reserved":0,"allocated":2555904,"data_stored":1193354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509623,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70288,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301552,"statfs":{"total":96636764160,"available":96564789248,"internally_reserved":0,"allocated":3133440,"data_stored":1782656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509622,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2547712,"data_stored":1193298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509623,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73924,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297916,"statfs":{"total":96636764160,"available":96561065984,"internally_reserved":0,"allocated":2535424,"data_stored":1191706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509622,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73912,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297928,"statfs":{"total":96636764160,"available":96561078272,"internally_reserved":0,"allocated":2527232,"data_stored":1185540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509623,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2519040,"data_stored":1184924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509622,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78644,"kb_used_data":3040,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293196,"statfs":{"total":96636764160,"available":96556232704,"internally_reserved":0,"allocated":3112960,"data_stored":1775292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73832,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298008,"statfs":{"total":96636764160,"available":96561160192,"internally_reserved":0,"allocated":2506752,"data_stored":1177757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:30:22.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:30:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.751+0000 7fc499400640 1 -- 172.21.15.17:0/4005842581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc49406df30 msgr2=0x7fc4940cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.751+0000 7fc499400640 1 --2- 172.21.15.17:0/4005842581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc49406df30 0x7fc4940cfc60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc484009900 tx=0x7fc48401c820 comp rx=0 tx=0).stop 2024-09-10T23:30:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.751+0000 7fc499400640 1 -- 172.21.15.17:0/4005842581 shutdown_connections 2024-09-10T23:30:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.751+0000 7fc499400640 1 --2- 172.21.15.17:0/4005842581 >> v2:172.21.15.77:3300/0 conn(0x7fc49415f060 0x7fc49415f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.751+0000 7fc499400640 1 --2- 172.21.15.17:0/4005842581 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc49406df30 0x7fc4940cfc60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.751+0000 7fc499400640 1 -- 172.21.15.17:0/4005842581 >> 172.21.15.17:0/4005842581 conn(0x7fc4940d1d60 msgr2=0x7fc4940d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.751+0000 7fc499400640 1 -- 172.21.15.17:0/4005842581 shutdown_connections 2024-09-10T23:30:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.751+0000 7fc499400640 1 -- 172.21.15.17:0/4005842581 wait complete. 2024-09-10T23:30:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 Processor -- start 2024-09-10T23:30:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 -- start start 2024-09-10T23:30:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc49406df30 0x7fc494150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc49415f060 0x7fc4941faa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc494161040 0x7fc4940c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc49416ae50 con 0x7fc49406df30 2024-09-10T23:30:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc49406ee80 con 0x7fc494161040 2024-09-10T23:30:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc49416afd0 con 0x7fc49415f060 2024-09-10T23:30:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc492800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc49406df30 0x7fc494150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc492800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc49406df30 0x7fc494150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41862/0 (socket says 172.21.15.17:41862) 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc492800640 1 -- 172.21.15.17:0/3891825615 learned_addr learned my addr 172.21.15.17:0/3891825615 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc48be00640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc49415f060 0x7fc4941faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc493200640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc494161040 0x7fc4940c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc492800640 1 -- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc49415f060 msgr2=0x7fc4941faa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc492800640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc49415f060 0x7fc4941faa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc492800640 1 -- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc494161040 msgr2=0x7fc4940c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc492800640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc494161040 0x7fc4940c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc492800640 1 -- 172.21.15.17:0/3891825615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4941fafa0 con 0x7fc49406df30 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc492800640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc49406df30 0x7fc494150900 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fc484009850 tx=0x7fc4840a5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc48aa00640 1 -- 172.21.15.17:0/3891825615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4840b2040 con 0x7fc49406df30 2024-09-10T23:30:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc48aa00640 1 -- 172.21.15.17:0/3891825615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc484004380 con 0x7fc49406df30 2024-09-10T23:30:22.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc48aa00640 1 -- 172.21.15.17:0/3891825615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4840052d0 con 0x7fc49406df30 2024-09-10T23:30:22.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4941fb240 con 0x7fc49406df30 2024-09-10T23:30:22.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4941fb800 con 0x7fc49406df30 2024-09-10T23:30:22.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.755+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4940cfc60 con 0x7fc49406df30 2024-09-10T23:30:22.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.759+0000 7fc48aa00640 1 -- 172.21.15.17:0/3891825615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc484005470 con 0x7fc49406df30 2024-09-10T23:30:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.759+0000 7fc48aa00640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4700725e0 0x7fc470074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.759+0000 7fc48aa00640 1 -- 172.21.15.17:0/3891825615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fc48412ce30 con 0x7fc49406df30 2024-09-10T23:30:22.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.759+0000 7fc48be00640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4700725e0 0x7fc470074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:22.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.759+0000 7fc48be00640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4700725e0 0x7fc470074aa0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009600 tx=0x7fc47c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:22.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.763+0000 7fc48aa00640 1 -- 172.21.15.17:0/3891825615 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc4840164d0 con 0x7fc49406df30 2024-09-10T23:30:22.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.935+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4940c7cf0 con 0x7fc4700725e0 2024-09-10T23:30:22.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.939+0000 7fc48aa00640 1 -- 172.21.15.17:0/3891825615 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251154 (secure 0 0 0) 0x7fc4940c7cf0 con 0x7fc4700725e0 2024-09-10T23:30:22.944 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:22.945 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:30:22.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4700725e0 msgr2=0x7fc470074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4700725e0 0x7fc470074aa0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009600 tx=0x7fc47c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc49406df30 msgr2=0x7fc494150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc49406df30 0x7fc494150900 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fc484009850 tx=0x7fc4840a5760 comp rx=0 tx=0).stop 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 shutdown_connections 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc4700725e0 0x7fc470074aa0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc494161040 0x7fc4940c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc49415f060 0x7fc4941faa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 --2- 172.21.15.17:0/3891825615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc49406df30 0x7fc494150900 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 >> 172.21.15.17:0/3891825615 conn(0x7fc4940d1d60 msgr2=0x7fc494158e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:22.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 shutdown_connections 2024-09-10T23:30:22.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:22.943+0000 7fc499400640 1 -- 172.21.15.17:0/3891825615 wait complete. 2024-09-10T23:30:22.966 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":644,"stamp":"2024-09-10T23:30:22.508517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":535424,"kb_used_data":20936,"kb_used_omap":12,"kb_used_meta":514291,"kb_avail":754439296,"statfs":{"total":773094113280,"available":772545839104,"internally_reserved":0,"allocated":21438464,"data_stored":10684527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":526634545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001633"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680622+0000","last_change":"2024-09-10T23:30:18.440391+0000","last_active":"2024-09-10T23:30:19.680622+0000","last_peered":"2024-09-10T23:30:19.680622+0000","last_clean":"2024-09-10T23:30:19.680622+0000","last_became_active":"2024-09-10T23:30:18.439926+0000","last_became_peered":"2024-09-10T23:30:18.439926+0000","last_unstale":"2024-09-10T23:30:19.680622+0000","last_undegraded":"2024-09-10T23:30:19.680622+0000","last_fullsized":"2024-09-10T23:30:19.680622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:44.295301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673620+0000","last_change":"2024-09-10T23:30:18.426349+0000","last_active":"2024-09-10T23:30:19.673620+0000","last_peered":"2024-09-10T23:30:19.673620+0000","last_clean":"2024-09-10T23:30:19.673620+0000","last_became_active":"2024-09-10T23:30:18.426097+0000","last_became_peered":"2024-09-10T23:30:18.426097+0000","last_unstale":"2024-09-10T23:30:19.673620+0000","last_undegraded":"2024-09-10T23:30:19.673620+0000","last_fullsized":"2024-09-10T23:30:19.673620+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.027470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409388+0000","last_change":"2024-09-10T23:30:17.409388+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409388+0000","last_undegraded":"2024-09-10T23:30:17.409388+0000","last_fullsized":"2024-09-10T23:30:17.409388+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425602+0000","last_change":"2024-09-10T23:30:18.435603+0000","last_active":"2024-09-10T23:30:19.425602+0000","last_peered":"2024-09-10T23:30:19.425602+0000","last_clean":"2024-09-10T23:30:19.425602+0000","last_became_active":"2024-09-10T23:30:18.435276+0000","last_became_peered":"2024-09-10T23:30:18.435276+0000","last_unstale":"2024-09-10T23:30:19.425602+0000","last_undegraded":"2024-09-10T23:30:19.425602+0000","last_fullsized":"2024-09-10T23:30:19.425602+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:33.263213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680433+0000","last_change":"2024-09-10T23:30:18.431319+0000","last_active":"2024-09-10T23:30:19.680433+0000","last_peered":"2024-09-10T23:30:19.680433+0000","last_clean":"2024-09-10T23:30:19.680433+0000","last_became_active":"2024-09-10T23:30:18.430960+0000","last_became_peered":"2024-09-10T23:30:18.430960+0000","last_unstale":"2024-09-10T23:30:19.680433+0000","last_undegraded":"2024-09-10T23:30:19.680433+0000","last_fullsized":"2024-09-10T23:30:19.680433+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:20.489147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:18.433402+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:18.432962+0000","last_became_peered":"2024-09-10T23:30:18.432962+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:43.563487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411081+0000","last_change":"2024-09-10T23:30:17.411081+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411081+0000","last_undegraded":"2024-09-10T23:30:17.411081+0000","last_fullsized":"2024-09-10T23:30:17.411081+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490652+0000","last_change":"2024-09-10T23:30:18.436129+0000","last_active":"2024-09-10T23:30:19.490652+0000","last_peered":"2024-09-10T23:30:19.490652+0000","last_clean":"2024-09-10T23:30:19.490652+0000","last_became_active":"2024-09-10T23:30:18.432600+0000","last_became_peered":"2024-09-10T23:30:18.432600+0000","last_unstale":"2024-09-10T23:30:19.490652+0000","last_undegraded":"2024-09-10T23:30:19.490652+0000","last_fullsized":"2024-09-10T23:30:19.490652+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:45.147222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673622+0000","last_change":"2024-09-10T23:30:18.418279+0000","last_active":"2024-09-10T23:30:19.673622+0000","last_peered":"2024-09-10T23:30:19.673622+0000","last_clean":"2024-09-10T23:30:19.673622+0000","last_became_active":"2024-09-10T23:30:18.418016+0000","last_became_peered":"2024-09-10T23:30:18.418016+0000","last_unstale":"2024-09-10T23:30:19.673622+0000","last_undegraded":"2024-09-10T23:30:19.673622+0000","last_fullsized":"2024-09-10T23:30:19.673622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:28.041686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.412410+0000","last_change":"2024-09-10T23:30:17.412410+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.412410+0000","last_undegraded":"2024-09-10T23:30:17.412410+0000","last_fullsized":"2024-09-10T23:30:17.412410+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425855+0000","last_change":"2024-09-10T23:30:18.430324+0000","last_active":"2024-09-10T23:30:19.425855+0000","last_peered":"2024-09-10T23:30:19.425855+0000","last_clean":"2024-09-10T23:30:19.425855+0000","last_became_active":"2024-09-10T23:30:18.429990+0000","last_became_peered":"2024-09-10T23:30:18.429990+0000","last_unstale":"2024-09-10T23:30:19.425855+0000","last_undegraded":"2024-09-10T23:30:19.425855+0000","last_fullsized":"2024-09-10T23:30:19.425855+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:57.601597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680462+0000","last_change":"2024-09-10T23:30:18.445466+0000","last_active":"2024-09-10T23:30:19.680462+0000","last_peered":"2024-09-10T23:30:19.680462+0000","last_clean":"2024-09-10T23:30:19.680462+0000","last_became_active":"2024-09-10T23:30:18.443772+0000","last_became_peered":"2024-09-10T23:30:18.443772+0000","last_unstale":"2024-09-10T23:30:19.680462+0000","last_undegraded":"2024-09-10T23:30:19.680462+0000","last_fullsized":"2024-09-10T23:30:19.680462+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:57.665627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490827+0000","last_change":"2024-09-10T23:30:18.434628+0000","last_active":"2024-09-10T23:30:19.490827+0000","last_peered":"2024-09-10T23:30:19.490827+0000","last_clean":"2024-09-10T23:30:19.490827+0000","last_became_active":"2024-09-10T23:30:18.434323+0000","last_became_peered":"2024-09-10T23:30:18.434323+0000","last_unstale":"2024-09-10T23:30:19.490827+0000","last_undegraded":"2024-09-10T23:30:19.490827+0000","last_fullsized":"2024-09-10T23:30:19.490827+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:44.464168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680538+0000","last_change":"2024-09-10T23:30:18.438166+0000","last_active":"2024-09-10T23:30:19.680538+0000","last_peered":"2024-09-10T23:30:19.680538+0000","last_clean":"2024-09-10T23:30:19.680538+0000","last_became_active":"2024-09-10T23:30:18.437380+0000","last_became_peered":"2024-09-10T23:30:18.437380+0000","last_unstale":"2024-09-10T23:30:19.680538+0000","last_undegraded":"2024-09-10T23:30:19.680538+0000","last_fullsized":"2024-09-10T23:30:19.680538+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:38.346963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673187+0000","last_change":"2024-09-10T23:30:18.419876+0000","last_active":"2024-09-10T23:30:19.673187+0000","last_peered":"2024-09-10T23:30:19.673187+0000","last_clean":"2024-09-10T23:30:19.673187+0000","last_became_active":"2024-09-10T23:30:18.419619+0000","last_became_peered":"2024-09-10T23:30:18.419619+0000","last_unstale":"2024-09-10T23:30:19.673187+0000","last_undegraded":"2024-09-10T23:30:19.673187+0000","last_fullsized":"2024-09-10T23:30:19.673187+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:10.606290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490788+0000","last_change":"2024-09-10T23:30:18.432783+0000","last_active":"2024-09-10T23:30:19.490788+0000","last_peered":"2024-09-10T23:30:19.490788+0000","last_clean":"2024-09-10T23:30:19.490788+0000","last_became_active":"2024-09-10T23:30:18.432259+0000","last_became_peered":"2024-09-10T23:30:18.432259+0000","last_unstale":"2024-09-10T23:30:19.490788+0000","last_undegraded":"2024-09-10T23:30:19.490788+0000","last_fullsized":"2024-09-10T23:30:19.490788+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:26.774814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681405+0000","last_change":"2024-09-10T23:30:18.448718+0000","last_active":"2024-09-10T23:30:19.681405+0000","last_peered":"2024-09-10T23:30:19.681405+0000","last_clean":"2024-09-10T23:30:19.681405+0000","last_became_active":"2024-09-10T23:30:18.446844+0000","last_became_peered":"2024-09-10T23:30:18.446844+0000","last_unstale":"2024-09-10T23:30:19.681405+0000","last_undegraded":"2024-09-10T23:30:19.681405+0000","last_fullsized":"2024-09-10T23:30:19.681405+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:29.166857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411964+0000","last_change":"2024-09-10T23:30:17.411964+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411964+0000","last_undegraded":"2024-09-10T23:30:17.411964+0000","last_fullsized":"2024-09-10T23:30:17.411964+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680532+0000","last_change":"2024-09-10T23:30:18.438704+0000","last_active":"2024-09-10T23:30:19.680532+0000","last_peered":"2024-09-10T23:30:19.680532+0000","last_clean":"2024-09-10T23:30:19.680532+0000","last_became_active":"2024-09-10T23:30:18.436192+0000","last_became_peered":"2024-09-10T23:30:18.436192+0000","last_unstale":"2024-09-10T23:30:19.680532+0000","last_undegraded":"2024-09-10T23:30:19.680532+0000","last_fullsized":"2024-09-10T23:30:19.680532+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:20.225885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491096+0000","last_change":"2024-09-10T23:30:18.434226+0000","last_active":"2024-09-10T23:30:19.491096+0000","last_peered":"2024-09-10T23:30:19.491096+0000","last_clean":"2024-09-10T23:30:19.491096+0000","last_became_active":"2024-09-10T23:30:18.433919+0000","last_became_peered":"2024-09-10T23:30:18.433919+0000","last_unstale":"2024-09-10T23:30:19.491096+0000","last_undegraded":"2024-09-10T23:30:19.491096+0000","last_fullsized":"2024-09-10T23:30:19.491096+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.591952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408998+0000","last_change":"2024-09-10T23:30:17.408998+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408998+0000","last_undegraded":"2024-09-10T23:30:17.408998+0000","last_fullsized":"2024-09-10T23:30:17.408998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673766+0000","last_change":"2024-09-10T23:30:18.432090+0000","last_active":"2024-09-10T23:30:19.673766+0000","last_peered":"2024-09-10T23:30:19.673766+0000","last_clean":"2024-09-10T23:30:19.673766+0000","last_became_active":"2024-09-10T23:30:18.430309+0000","last_became_peered":"2024-09-10T23:30:18.430309+0000","last_unstale":"2024-09-10T23:30:19.673766+0000","last_undegraded":"2024-09-10T23:30:19.673766+0000","last_fullsized":"2024-09-10T23:30:19.673766+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:26.449042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672993+0000","last_change":"2024-09-10T23:30:18.419267+0000","last_active":"2024-09-10T23:30:19.672993+0000","last_peered":"2024-09-10T23:30:19.672993+0000","last_clean":"2024-09-10T23:30:19.672993+0000","last_became_active":"2024-09-10T23:30:18.418970+0000","last_became_peered":"2024-09-10T23:30:18.418970+0000","last_unstale":"2024-09-10T23:30:19.672993+0000","last_undegraded":"2024-09-10T23:30:19.672993+0000","last_fullsized":"2024-09-10T23:30:19.672993+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:12.054872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680124+0000","last_change":"2024-09-10T23:30:18.430296+0000","last_active":"2024-09-10T23:30:19.680124+0000","last_peered":"2024-09-10T23:30:19.680124+0000","last_clean":"2024-09-10T23:30:19.680124+0000","last_became_active":"2024-09-10T23:30:18.430015+0000","last_became_peered":"2024-09-10T23:30:18.430015+0000","last_unstale":"2024-09-10T23:30:19.680124+0000","last_undegraded":"2024-09-10T23:30:19.680124+0000","last_fullsized":"2024-09-10T23:30:19.680124+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:43.868057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680876+0000","last_change":"2024-09-10T23:30:18.436029+0000","last_active":"2024-09-10T23:30:19.680876+0000","last_peered":"2024-09-10T23:30:19.680876+0000","last_clean":"2024-09-10T23:30:19.680876+0000","last_became_active":"2024-09-10T23:30:18.435737+0000","last_became_peered":"2024-09-10T23:30:18.435737+0000","last_unstale":"2024-09-10T23:30:19.680876+0000","last_undegraded":"2024-09-10T23:30:19.680876+0000","last_fullsized":"2024-09-10T23:30:19.680876+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:59.131863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411574+0000","last_change":"2024-09-10T23:30:17.411574+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411574+0000","last_undegraded":"2024-09-10T23:30:17.411574+0000","last_fullsized":"2024-09-10T23:30:17.411574+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425917+0000","last_change":"2024-09-10T23:30:18.434286+0000","last_active":"2024-09-10T23:30:19.425917+0000","last_peered":"2024-09-10T23:30:19.425917+0000","last_clean":"2024-09-10T23:30:19.425917+0000","last_became_active":"2024-09-10T23:30:18.434031+0000","last_became_peered":"2024-09-10T23:30:18.434031+0000","last_unstale":"2024-09-10T23:30:19.425917+0000","last_undegraded":"2024-09-10T23:30:19.425917+0000","last_fullsized":"2024-09-10T23:30:19.425917+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:13.918980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681217+0000","last_change":"2024-09-10T23:30:18.430415+0000","last_active":"2024-09-10T23:30:19.681217+0000","last_peered":"2024-09-10T23:30:19.681217+0000","last_clean":"2024-09-10T23:30:19.681217+0000","last_became_active":"2024-09-10T23:30:18.430059+0000","last_became_peered":"2024-09-10T23:30:18.430059+0000","last_unstale":"2024-09-10T23:30:19.681217+0000","last_undegraded":"2024-09-10T23:30:19.681217+0000","last_fullsized":"2024-09-10T23:30:19.681217+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:14.451454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673314+0000","last_change":"2024-09-10T23:30:18.436833+0000","last_active":"2024-09-10T23:30:19.673314+0000","last_peered":"2024-09-10T23:30:19.673314+0000","last_clean":"2024-09-10T23:30:19.673314+0000","last_became_active":"2024-09-10T23:30:18.436385+0000","last_became_peered":"2024-09-10T23:30:18.436385+0000","last_unstale":"2024-09-10T23:30:19.673314+0000","last_undegraded":"2024-09-10T23:30:19.673314+0000","last_fullsized":"2024-09-10T23:30:19.673314+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:48.896976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490730+0000","last_change":"2024-09-10T23:30:18.443963+0000","last_active":"2024-09-10T23:30:19.490730+0000","last_peered":"2024-09-10T23:30:19.490730+0000","last_clean":"2024-09-10T23:30:19.490730+0000","last_became_active":"2024-09-10T23:30:18.443624+0000","last_became_peered":"2024-09-10T23:30:18.443624+0000","last_unstale":"2024-09-10T23:30:19.490730+0000","last_undegraded":"2024-09-10T23:30:19.490730+0000","last_fullsized":"2024-09-10T23:30:19.490730+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:12.367128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673197+0000","last_change":"2024-09-10T23:30:18.426364+0000","last_active":"2024-09-10T23:30:19.673197+0000","last_peered":"2024-09-10T23:30:19.673197+0000","last_clean":"2024-09-10T23:30:19.673197+0000","last_became_active":"2024-09-10T23:30:18.426089+0000","last_became_peered":"2024-09-10T23:30:18.426089+0000","last_unstale":"2024-09-10T23:30:19.673197+0000","last_undegraded":"2024-09-10T23:30:19.673197+0000","last_fullsized":"2024-09-10T23:30:19.673197+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:54.103650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490986+0000","last_change":"2024-09-10T23:30:18.442390+0000","last_active":"2024-09-10T23:30:19.490986+0000","last_peered":"2024-09-10T23:30:19.490986+0000","last_clean":"2024-09-10T23:30:19.490986+0000","last_became_active":"2024-09-10T23:30:18.442008+0000","last_became_peered":"2024-09-10T23:30:18.442008+0000","last_unstale":"2024-09-10T23:30:19.490986+0000","last_undegraded":"2024-09-10T23:30:19.490986+0000","last_fullsized":"2024-09-10T23:30:19.490986+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:18.297755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408362+0000","last_change":"2024-09-10T23:30:17.408362+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408362+0000","last_undegraded":"2024-09-10T23:30:17.408362+0000","last_fullsized":"2024-09-10T23:30:17.408362+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"200'4","reported_seq":19,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673771+0000","last_change":"2024-09-10T23:30:17.428407+0000","last_active":"2024-09-10T23:30:19.673771+0000","last_peered":"2024-09-10T23:30:19.673771+0000","last_clean":"2024-09-10T23:30:19.673771+0000","last_became_active":"2024-09-10T23:30:17.428095+0000","last_became_peered":"2024-09-10T23:30:17.428095+0000","last_unstale":"2024-09-10T23:30:19.673771+0000","last_undegraded":"2024-09-10T23:30:19.673771+0000","last_fullsized":"2024-09-10T23:30:19.673771+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:44.817383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408920+0000","last_change":"2024-09-10T23:30:17.408920+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408920+0000","last_undegraded":"2024-09-10T23:30:17.408920+0000","last_fullsized":"2024-09-10T23:30:17.408920+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681483+0000","last_change":"2024-09-10T23:30:17.435885+0000","last_active":"2024-09-10T23:30:19.681483+0000","last_peered":"2024-09-10T23:30:19.681483+0000","last_clean":"2024-09-10T23:30:19.681483+0000","last_became_active":"2024-09-10T23:30:17.435638+0000","last_became_peered":"2024-09-10T23:30:17.435638+0000","last_unstale":"2024-09-10T23:30:19.681483+0000","last_undegraded":"2024-09-10T23:30:19.681483+0000","last_fullsized":"2024-09-10T23:30:19.681483+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:28.443604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681443+0000","last_change":"2024-09-10T23:30:18.446032+0000","last_active":"2024-09-10T23:30:19.681443+0000","last_peered":"2024-09-10T23:30:19.681443+0000","last_clean":"2024-09-10T23:30:19.681443+0000","last_became_active":"2024-09-10T23:30:18.445739+0000","last_became_peered":"2024-09-10T23:30:18.445739+0000","last_unstale":"2024-09-10T23:30:19.681443+0000","last_undegraded":"2024-09-10T23:30:19.681443+0000","last_fullsized":"2024-09-10T23:30:19.681443+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.138384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:17.426662+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:17.426379+0000","last_became_peered":"2024-09-10T23:30:17.426379+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:31.377540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409688+0000","last_change":"2024-09-10T23:30:17.409688+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409688+0000","last_undegraded":"2024-09-10T23:30:17.409688+0000","last_fullsized":"2024-09-10T23:30:17.409688+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674268+0000","last_change":"2024-09-10T23:30:17.424648+0000","last_active":"2024-09-10T23:30:19.674268+0000","last_peered":"2024-09-10T23:30:19.674268+0000","last_clean":"2024-09-10T23:30:19.674268+0000","last_became_active":"2024-09-10T23:30:17.424309+0000","last_became_peered":"2024-09-10T23:30:17.424309+0000","last_unstale":"2024-09-10T23:30:19.674268+0000","last_undegraded":"2024-09-10T23:30:19.674268+0000","last_fullsized":"2024-09-10T23:30:19.674268+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:44.144068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679901+0000","last_change":"2024-09-10T23:30:18.437987+0000","last_active":"2024-09-10T23:30:19.679901+0000","last_peered":"2024-09-10T23:30:19.679901+0000","last_clean":"2024-09-10T23:30:19.679901+0000","last_became_active":"2024-09-10T23:30:18.437707+0000","last_became_peered":"2024-09-10T23:30:18.437707+0000","last_unstale":"2024-09-10T23:30:19.679901+0000","last_undegraded":"2024-09-10T23:30:19.679901+0000","last_fullsized":"2024-09-10T23:30:19.679901+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:52.657720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680192+0000","last_change":"2024-09-10T23:30:17.438669+0000","last_active":"2024-09-10T23:30:19.680192+0000","last_peered":"2024-09-10T23:30:19.680192+0000","last_clean":"2024-09-10T23:30:19.680192+0000","last_became_active":"2024-09-10T23:30:17.438383+0000","last_became_peered":"2024-09-10T23:30:17.438383+0000","last_unstale":"2024-09-10T23:30:19.680192+0000","last_undegraded":"2024-09-10T23:30:19.680192+0000","last_fullsized":"2024-09-10T23:30:19.680192+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:58.970215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674014+0000","last_change":"2024-09-10T23:30:18.430231+0000","last_active":"2024-09-10T23:30:19.674014+0000","last_peered":"2024-09-10T23:30:19.674014+0000","last_clean":"2024-09-10T23:30:19.674014+0000","last_became_active":"2024-09-10T23:30:18.429920+0000","last_became_peered":"2024-09-10T23:30:18.429920+0000","last_unstale":"2024-09-10T23:30:19.674014+0000","last_undegraded":"2024-09-10T23:30:19.674014+0000","last_fullsized":"2024-09-10T23:30:19.674014+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:42.713962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425230+0000","last_change":"2024-09-10T23:30:17.425766+0000","last_active":"2024-09-10T23:30:19.425230+0000","last_peered":"2024-09-10T23:30:19.425230+0000","last_clean":"2024-09-10T23:30:19.425230+0000","last_became_active":"2024-09-10T23:30:17.424967+0000","last_became_peered":"2024-09-10T23:30:17.424967+0000","last_unstale":"2024-09-10T23:30:19.425230+0000","last_undegraded":"2024-09-10T23:30:19.425230+0000","last_fullsized":"2024-09-10T23:30:19.425230+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:55.277369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673775+0000","last_change":"2024-09-10T23:30:18.427654+0000","last_active":"2024-09-10T23:30:19.673775+0000","last_peered":"2024-09-10T23:30:19.673775+0000","last_clean":"2024-09-10T23:30:19.673775+0000","last_became_active":"2024-09-10T23:30:18.427356+0000","last_became_peered":"2024-09-10T23:30:18.427356+0000","last_unstale":"2024-09-10T23:30:19.673775+0000","last_undegraded":"2024-09-10T23:30:19.673775+0000","last_fullsized":"2024-09-10T23:30:19.673775+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:35.999756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-10T23:30:17.420337+0000","last_change":"2024-09-10T23:30:17.418976+0000","last_active":"2024-09-10T23:30:17.420337+0000","last_peered":"2024-09-10T23:30:17.420337+0000","last_clean":"2024-09-10T23:30:17.420337+0000","last_became_active":"2024-09-10T23:30:17.418442+0000","last_became_peered":"2024-09-10T23:30:17.418442+0000","last_unstale":"2024-09-10T23:30:17.420337+0000","last_undegraded":"2024-09-10T23:30:17.420337+0000","last_fullsized":"2024-09-10T23:30:17.420337+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.309934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674418+0000","last_change":"2024-09-10T23:30:18.425119+0000","last_active":"2024-09-10T23:30:19.674418+0000","last_peered":"2024-09-10T23:30:19.674418+0000","last_clean":"2024-09-10T23:30:19.674418+0000","last_became_active":"2024-09-10T23:30:18.424853+0000","last_became_peered":"2024-09-10T23:30:18.424853+0000","last_unstale":"2024-09-10T23:30:19.674418+0000","last_undegraded":"2024-09-10T23:30:19.674418+0000","last_fullsized":"2024-09-10T23:30:19.674418+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:31.576971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681004+0000","last_change":"2024-09-10T23:30:17.436490+0000","last_active":"2024-09-10T23:30:19.681004+0000","last_peered":"2024-09-10T23:30:19.681004+0000","last_clean":"2024-09-10T23:30:19.681004+0000","last_became_active":"2024-09-10T23:30:17.436203+0000","last_became_peered":"2024-09-10T23:30:17.436203+0000","last_unstale":"2024-09-10T23:30:19.681004+0000","last_undegraded":"2024-09-10T23:30:19.681004+0000","last_fullsized":"2024-09-10T23:30:19.681004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674470+0000","last_change":"2024-09-10T23:30:18.427676+0000","last_active":"2024-09-10T23:30:19.674470+0000","last_peered":"2024-09-10T23:30:19.674470+0000","last_clean":"2024-09-10T23:30:19.674470+0000","last_became_active":"2024-09-10T23:30:18.425145+0000","last_became_peered":"2024-09-10T23:30:18.425145+0000","last_unstale":"2024-09-10T23:30:19.674470+0000","last_undegraded":"2024-09-10T23:30:19.674470+0000","last_fullsized":"2024-09-10T23:30:19.674470+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425913+0000","last_change":"2024-09-10T23:30:17.431896+0000","last_active":"2024-09-10T23:30:19.425913+0000","last_peered":"2024-09-10T23:30:19.425913+0000","last_clean":"2024-09-10T23:30:19.425913+0000","last_became_active":"2024-09-10T23:30:17.430852+0000","last_became_peered":"2024-09-10T23:30:17.430852+0000","last_unstale":"2024-09-10T23:30:19.425913+0000","last_undegraded":"2024-09-10T23:30:19.425913+0000","last_fullsized":"2024-09-10T23:30:19.425913+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:03.399968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411064+0000","last_change":"2024-09-10T23:30:17.411064+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411064+0000","last_undegraded":"2024-09-10T23:30:17.411064+0000","last_fullsized":"2024-09-10T23:30:17.411064+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"200'3","reported_seq":18,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680857+0000","last_change":"2024-09-10T23:30:17.437999+0000","last_active":"2024-09-10T23:30:19.680857+0000","last_peered":"2024-09-10T23:30:19.680857+0000","last_clean":"2024-09-10T23:30:19.680857+0000","last_became_active":"2024-09-10T23:30:17.437724+0000","last_became_peered":"2024-09-10T23:30:17.437724+0000","last_unstale":"2024-09-10T23:30:19.680857+0000","last_undegraded":"2024-09-10T23:30:19.680857+0000","last_fullsized":"2024-09-10T23:30:19.680857+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:35.934846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.426144+0000","last_change":"2024-09-10T23:30:18.431666+0000","last_active":"2024-09-10T23:30:19.426144+0000","last_peered":"2024-09-10T23:30:19.426144+0000","last_clean":"2024-09-10T23:30:19.426144+0000","last_became_active":"2024-09-10T23:30:18.431392+0000","last_became_peered":"2024-09-10T23:30:18.431392+0000","last_unstale":"2024-09-10T23:30:19.426144+0000","last_undegraded":"2024-09-10T23:30:19.426144+0000","last_fullsized":"2024-09-10T23:30:19.426144+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:05.543871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"200'6","reported_seq":21,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491058+0000","last_change":"2024-09-10T23:30:17.427136+0000","last_active":"2024-09-10T23:30:19.491058+0000","last_peered":"2024-09-10T23:30:19.491058+0000","last_clean":"2024-09-10T23:30:19.491058+0000","last_became_active":"2024-09-10T23:30:17.426720+0000","last_became_peered":"2024-09-10T23:30:17.426720+0000","last_unstale":"2024-09-10T23:30:19.491058+0000","last_undegraded":"2024-09-10T23:30:19.491058+0000","last_fullsized":"2024-09-10T23:30:19.491058+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:42.586081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672998+0000","last_change":"2024-09-10T23:30:18.436906+0000","last_active":"2024-09-10T23:30:19.672998+0000","last_peered":"2024-09-10T23:30:19.672998+0000","last_clean":"2024-09-10T23:30:19.672998+0000","last_became_active":"2024-09-10T23:30:18.436447+0000","last_became_peered":"2024-09-10T23:30:18.436447+0000","last_unstale":"2024-09-10T23:30:19.672998+0000","last_undegraded":"2024-09-10T23:30:19.672998+0000","last_fullsized":"2024-09-10T23:30:19.672998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680784+0000","last_change":"2024-09-10T23:30:17.428623+0000","last_active":"2024-09-10T23:30:19.680784+0000","last_peered":"2024-09-10T23:30:19.680784+0000","last_clean":"2024-09-10T23:30:19.680784+0000","last_became_active":"2024-09-10T23:30:17.428332+0000","last_became_peered":"2024-09-10T23:30:17.428332+0000","last_unstale":"2024-09-10T23:30:19.680784+0000","last_undegraded":"2024-09-10T23:30:19.680784+0000","last_fullsized":"2024-09-10T23:30:19.680784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:44.204111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680358+0000","last_change":"2024-09-10T23:30:18.444027+0000","last_active":"2024-09-10T23:30:19.680358+0000","last_peered":"2024-09-10T23:30:19.680358+0000","last_clean":"2024-09-10T23:30:19.680358+0000","last_became_active":"2024-09-10T23:30:18.443479+0000","last_became_peered":"2024-09-10T23:30:18.443479+0000","last_unstale":"2024-09-10T23:30:19.680358+0000","last_undegraded":"2024-09-10T23:30:19.680358+0000","last_fullsized":"2024-09-10T23:30:19.680358+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:15.469850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673380+0000","last_change":"2024-09-10T23:30:17.417961+0000","last_active":"2024-09-10T23:30:19.673380+0000","last_peered":"2024-09-10T23:30:19.673380+0000","last_clean":"2024-09-10T23:30:19.673380+0000","last_became_active":"2024-09-10T23:30:17.417683+0000","last_became_peered":"2024-09-10T23:30:17.417683+0000","last_unstale":"2024-09-10T23:30:19.673380+0000","last_undegraded":"2024-09-10T23:30:19.673380+0000","last_fullsized":"2024-09-10T23:30:19.673380+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:45:55.340081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411074+0000","last_change":"2024-09-10T23:30:17.411074+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411074+0000","last_undegraded":"2024-09-10T23:30:17.411074+0000","last_fullsized":"2024-09-10T23:30:17.411074+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490429+0000","last_change":"2024-09-10T23:30:17.425540+0000","last_active":"2024-09-10T23:30:19.490429+0000","last_peered":"2024-09-10T23:30:19.490429+0000","last_clean":"2024-09-10T23:30:19.490429+0000","last_became_active":"2024-09-10T23:30:17.425256+0000","last_became_peered":"2024-09-10T23:30:17.425256+0000","last_unstale":"2024-09-10T23:30:19.490429+0000","last_undegraded":"2024-09-10T23:30:19.490429+0000","last_fullsized":"2024-09-10T23:30:19.490429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:37.019557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674115+0000","last_change":"2024-09-10T23:30:18.425671+0000","last_active":"2024-09-10T23:30:19.674115+0000","last_peered":"2024-09-10T23:30:19.674115+0000","last_clean":"2024-09-10T23:30:19.674115+0000","last_became_active":"2024-09-10T23:30:18.424769+0000","last_became_peered":"2024-09-10T23:30:18.424769+0000","last_unstale":"2024-09-10T23:30:19.674115+0000","last_undegraded":"2024-09-10T23:30:19.674115+0000","last_fullsized":"2024-09-10T23:30:19.674115+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:39.771480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"200'8","reported_seq":23,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679790+0000","last_change":"2024-09-10T23:30:17.425625+0000","last_active":"2024-09-10T23:30:19.679790+0000","last_peered":"2024-09-10T23:30:19.679790+0000","last_clean":"2024-09-10T23:30:19.679790+0000","last_became_active":"2024-09-10T23:30:17.425348+0000","last_became_peered":"2024-09-10T23:30:17.425348+0000","last_unstale":"2024-09-10T23:30:19.679790+0000","last_undegraded":"2024-09-10T23:30:19.679790+0000","last_fullsized":"2024-09-10T23:30:19.679790+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:53.025824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673146+0000","last_change":"2024-09-10T23:30:18.428571+0000","last_active":"2024-09-10T23:30:19.673146+0000","last_peered":"2024-09-10T23:30:19.673146+0000","last_clean":"2024-09-10T23:30:19.673146+0000","last_became_active":"2024-09-10T23:30:18.427496+0000","last_became_peered":"2024-09-10T23:30:18.427496+0000","last_unstale":"2024-09-10T23:30:19.673146+0000","last_undegraded":"2024-09-10T23:30:19.673146+0000","last_fullsized":"2024-09-10T23:30:19.673146+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:25.149316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-10T23:30:17.424153+0000","last_change":"2024-09-10T23:30:17.423434+0000","last_active":"2024-09-10T23:30:17.424153+0000","last_peered":"2024-09-10T23:30:17.424153+0000","last_clean":"2024-09-10T23:30:17.424153+0000","last_became_active":"2024-09-10T23:30:17.423143+0000","last_became_peered":"2024-09-10T23:30:17.423143+0000","last_unstale":"2024-09-10T23:30:17.424153+0000","last_undegraded":"2024-09-10T23:30:17.424153+0000","last_fullsized":"2024-09-10T23:30:17.424153+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:25.958953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680725+0000","last_change":"2024-09-10T23:30:18.442899+0000","last_active":"2024-09-10T23:30:19.680725+0000","last_peered":"2024-09-10T23:30:19.680725+0000","last_clean":"2024-09-10T23:30:19.680725+0000","last_became_active":"2024-09-10T23:30:18.442642+0000","last_became_peered":"2024-09-10T23:30:18.442642+0000","last_unstale":"2024-09-10T23:30:19.680725+0000","last_undegraded":"2024-09-10T23:30:19.680725+0000","last_fullsized":"2024-09-10T23:30:19.680725+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:09.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673407+0000","last_change":"2024-09-10T23:30:17.419308+0000","last_active":"2024-09-10T23:30:19.673407+0000","last_peered":"2024-09-10T23:30:19.673407+0000","last_clean":"2024-09-10T23:30:19.673407+0000","last_became_active":"2024-09-10T23:30:17.419027+0000","last_became_peered":"2024-09-10T23:30:17.419027+0000","last_unstale":"2024-09-10T23:30:19.673407+0000","last_undegraded":"2024-09-10T23:30:19.673407+0000","last_fullsized":"2024-09-10T23:30:19.673407+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:37.201310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409456+0000","last_change":"2024-09-10T23:30:17.409456+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409456+0000","last_undegraded":"2024-09-10T23:30:17.409456+0000","last_fullsized":"2024-09-10T23:30:17.409456+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681143+0000","last_change":"2024-09-10T23:30:17.427272+0000","last_active":"2024-09-10T23:30:19.681143+0000","last_peered":"2024-09-10T23:30:19.681143+0000","last_clean":"2024-09-10T23:30:19.681143+0000","last_became_active":"2024-09-10T23:30:17.426898+0000","last_became_peered":"2024-09-10T23:30:17.426898+0000","last_unstale":"2024-09-10T23:30:19.681143+0000","last_undegraded":"2024-09-10T23:30:19.681143+0000","last_fullsized":"2024-09-10T23:30:19.681143+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:17.943545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681625+0000","last_change":"2024-09-10T23:30:18.442632+0000","last_active":"2024-09-10T23:30:19.681625+0000","last_peered":"2024-09-10T23:30:19.681625+0000","last_clean":"2024-09-10T23:30:19.681625+0000","last_became_active":"2024-09-10T23:30:18.442386+0000","last_became_peered":"2024-09-10T23:30:18.442386+0000","last_unstale":"2024-09-10T23:30:19.681625+0000","last_undegraded":"2024-09-10T23:30:19.681625+0000","last_fullsized":"2024-09-10T23:30:19.681625+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:48.604686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681142+0000","last_change":"2024-09-10T23:30:17.427578+0000","last_active":"2024-09-10T23:30:19.681142+0000","last_peered":"2024-09-10T23:30:19.681142+0000","last_clean":"2024-09-10T23:30:19.681142+0000","last_became_active":"2024-09-10T23:30:17.424863+0000","last_became_peered":"2024-09-10T23:30:17.424863+0000","last_unstale":"2024-09-10T23:30:19.681142+0000","last_undegraded":"2024-09-10T23:30:19.681142+0000","last_fullsized":"2024-09-10T23:30:19.681142+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:32.433094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680070+0000","last_change":"2024-09-10T23:30:18.446294+0000","last_active":"2024-09-10T23:30:19.680070+0000","last_peered":"2024-09-10T23:30:19.680070+0000","last_clean":"2024-09-10T23:30:19.680070+0000","last_became_active":"2024-09-10T23:30:18.445592+0000","last_became_peered":"2024-09-10T23:30:18.445592+0000","last_unstale":"2024-09-10T23:30:19.680070+0000","last_undegraded":"2024-09-10T23:30:19.680070+0000","last_fullsized":"2024-09-10T23:30:19.680070+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:21.909190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680832+0000","last_change":"2024-09-10T23:30:17.436646+0000","last_active":"2024-09-10T23:30:19.680832+0000","last_peered":"2024-09-10T23:30:19.680832+0000","last_clean":"2024-09-10T23:30:19.680832+0000","last_became_active":"2024-09-10T23:30:17.435895+0000","last_became_peered":"2024-09-10T23:30:17.435895+0000","last_unstale":"2024-09-10T23:30:19.680832+0000","last_undegraded":"2024-09-10T23:30:19.680832+0000","last_fullsized":"2024-09-10T23:30:19.680832+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:39.922424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680075+0000","last_change":"2024-09-10T23:30:18.433819+0000","last_active":"2024-09-10T23:30:19.680075+0000","last_peered":"2024-09-10T23:30:19.680075+0000","last_clean":"2024-09-10T23:30:19.680075+0000","last_became_active":"2024-09-10T23:30:18.433550+0000","last_became_peered":"2024-09-10T23:30:18.433550+0000","last_unstale":"2024-09-10T23:30:19.680075+0000","last_undegraded":"2024-09-10T23:30:19.680075+0000","last_fullsized":"2024-09-10T23:30:19.680075+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:34.276101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673939+0000","last_change":"2024-09-10T23:30:17.414097+0000","last_active":"2024-09-10T23:30:19.673939+0000","last_peered":"2024-09-10T23:30:19.673939+0000","last_clean":"2024-09-10T23:30:19.673939+0000","last_became_active":"2024-09-10T23:30:17.413839+0000","last_became_peered":"2024-09-10T23:30:17.413839+0000","last_unstale":"2024-09-10T23:30:19.673939+0000","last_undegraded":"2024-09-10T23:30:19.673939+0000","last_fullsized":"2024-09-10T23:30:19.673939+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673192+0000","last_change":"2024-09-10T23:30:18.435156+0000","last_active":"2024-09-10T23:30:19.673192+0000","last_peered":"2024-09-10T23:30:19.673192+0000","last_clean":"2024-09-10T23:30:19.673192+0000","last_became_active":"2024-09-10T23:30:18.434885+0000","last_became_peered":"2024-09-10T23:30:18.434885+0000","last_unstale":"2024-09-10T23:30:19.673192+0000","last_undegraded":"2024-09-10T23:30:19.673192+0000","last_fullsized":"2024-09-10T23:30:19.673192+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:08.514251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673435+0000","last_change":"2024-09-10T23:30:17.409125+0000","last_active":"2024-09-10T23:30:19.673435+0000","last_peered":"2024-09-10T23:30:19.673435+0000","last_clean":"2024-09-10T23:30:19.673435+0000","last_became_active":"2024-09-10T23:30:17.408859+0000","last_became_peered":"2024-09-10T23:30:17.408859+0000","last_unstale":"2024-09-10T23:30:19.673435+0000","last_undegraded":"2024-09-10T23:30:19.673435+0000","last_fullsized":"2024-09-10T23:30:19.673435+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408508+0000","last_change":"2024-09-10T23:30:17.408508+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408508+0000","last_undegraded":"2024-09-10T23:30:17.408508+0000","last_fullsized":"2024-09-10T23:30:17.408508+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672778+0000","last_change":"2024-09-10T23:30:17.420097+0000","last_active":"2024-09-10T23:30:19.672778+0000","last_peered":"2024-09-10T23:30:19.672778+0000","last_clean":"2024-09-10T23:30:19.672778+0000","last_became_active":"2024-09-10T23:30:17.419810+0000","last_became_peered":"2024-09-10T23:30:17.419810+0000","last_unstale":"2024-09-10T23:30:19.672778+0000","last_undegraded":"2024-09-10T23:30:19.672778+0000","last_fullsized":"2024-09-10T23:30:19.672778+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:56.936472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673368+0000","last_change":"2024-09-10T23:30:18.419771+0000","last_active":"2024-09-10T23:30:19.673368+0000","last_peered":"2024-09-10T23:30:19.673368+0000","last_clean":"2024-09-10T23:30:19.673368+0000","last_became_active":"2024-09-10T23:30:18.419502+0000","last_became_peered":"2024-09-10T23:30:18.419502+0000","last_unstale":"2024-09-10T23:30:19.673368+0000","last_undegraded":"2024-09-10T23:30:19.673368+0000","last_fullsized":"2024-09-10T23:30:19.673368+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:44.400118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681564+0000","last_change":"2024-09-10T23:30:17.425729+0000","last_active":"2024-09-10T23:30:19.681564+0000","last_peered":"2024-09-10T23:30:19.681564+0000","last_clean":"2024-09-10T23:30:19.681564+0000","last_became_active":"2024-09-10T23:30:17.425302+0000","last_became_peered":"2024-09-10T23:30:17.425302+0000","last_unstale":"2024-09-10T23:30:19.681564+0000","last_undegraded":"2024-09-10T23:30:19.681564+0000","last_fullsized":"2024-09-10T23:30:19.681564+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:56.886964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680785+0000","last_change":"2024-09-10T23:30:18.436355+0000","last_active":"2024-09-10T23:30:19.680785+0000","last_peered":"2024-09-10T23:30:19.680785+0000","last_clean":"2024-09-10T23:30:19.680785+0000","last_became_active":"2024-09-10T23:30:18.435787+0000","last_became_peered":"2024-09-10T23:30:18.435787+0000","last_unstale":"2024-09-10T23:30:19.680785+0000","last_undegraded":"2024-09-10T23:30:19.680785+0000","last_fullsized":"2024-09-10T23:30:19.680785+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:57.394499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674464+0000","last_change":"2024-09-10T23:30:17.409966+0000","last_active":"2024-09-10T23:30:19.674464+0000","last_peered":"2024-09-10T23:30:19.674464+0000","last_clean":"2024-09-10T23:30:19.674464+0000","last_became_active":"2024-09-10T23:30:17.409718+0000","last_became_peered":"2024-09-10T23:30:17.409718+0000","last_unstale":"2024-09-10T23:30:19.674464+0000","last_undegraded":"2024-09-10T23:30:19.674464+0000","last_fullsized":"2024-09-10T23:30:19.674464+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:25.771659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490949+0000","last_change":"2024-09-10T23:30:18.445113+0000","last_active":"2024-09-10T23:30:19.490949+0000","last_peered":"2024-09-10T23:30:19.490949+0000","last_clean":"2024-09-10T23:30:19.490949+0000","last_became_active":"2024-09-10T23:30:18.444854+0000","last_became_peered":"2024-09-10T23:30:18.444854+0000","last_unstale":"2024-09-10T23:30:19.490949+0000","last_undegraded":"2024-09-10T23:30:19.490949+0000","last_fullsized":"2024-09-10T23:30:19.490949+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:50.338409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674429+0000","last_change":"2024-09-10T23:30:17.421620+0000","last_active":"2024-09-10T23:30:19.674429+0000","last_peered":"2024-09-10T23:30:19.674429+0000","last_clean":"2024-09-10T23:30:19.674429+0000","last_became_active":"2024-09-10T23:30:17.421324+0000","last_became_peered":"2024-09-10T23:30:17.421324+0000","last_unstale":"2024-09-10T23:30:19.674429+0000","last_undegraded":"2024-09-10T23:30:19.674429+0000","last_fullsized":"2024-09-10T23:30:19.674429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:11.363973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673416+0000","last_change":"2024-09-10T23:30:18.424759+0000","last_active":"2024-09-10T23:30:19.673416+0000","last_peered":"2024-09-10T23:30:19.673416+0000","last_clean":"2024-09-10T23:30:19.673416+0000","last_became_active":"2024-09-10T23:30:18.424453+0000","last_became_peered":"2024-09-10T23:30:18.424453+0000","last_unstale":"2024-09-10T23:30:19.673416+0000","last_undegraded":"2024-09-10T23:30:19.673416+0000","last_fullsized":"2024-09-10T23:30:19.673416+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:47.092041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681267+0000","last_change":"2024-09-10T23:30:17.434351+0000","last_active":"2024-09-10T23:30:19.681267+0000","last_peered":"2024-09-10T23:30:19.681267+0000","last_clean":"2024-09-10T23:30:19.681267+0000","last_became_active":"2024-09-10T23:30:17.433835+0000","last_became_peered":"2024-09-10T23:30:17.433835+0000","last_unstale":"2024-09-10T23:30:19.681267+0000","last_undegraded":"2024-09-10T23:30:19.681267+0000","last_fullsized":"2024-09-10T23:30:19.681267+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:01.966013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409285+0000","last_change":"2024-09-10T23:30:17.409285+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409285+0000","last_undegraded":"2024-09-10T23:30:17.409285+0000","last_fullsized":"2024-09-10T23:30:17.409285+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680899+0000","last_change":"2024-09-10T23:30:17.429711+0000","last_active":"2024-09-10T23:30:19.680899+0000","last_peered":"2024-09-10T23:30:19.680899+0000","last_clean":"2024-09-10T23:30:19.680899+0000","last_became_active":"2024-09-10T23:30:17.429344+0000","last_became_peered":"2024-09-10T23:30:17.429344+0000","last_unstale":"2024-09-10T23:30:19.680899+0000","last_undegraded":"2024-09-10T23:30:19.680899+0000","last_fullsized":"2024-09-10T23:30:19.680899+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:38.807426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.410516+0000","last_change":"2024-09-10T23:30:17.410516+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.410516+0000","last_undegraded":"2024-09-10T23:30:17.410516+0000","last_fullsized":"2024-09-10T23:30:17.410516+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425328+0000","last_change":"2024-09-10T23:30:17.427637+0000","last_active":"2024-09-10T23:30:19.425328+0000","last_peered":"2024-09-10T23:30:19.425328+0000","last_clean":"2024-09-10T23:30:19.425328+0000","last_became_active":"2024-09-10T23:30:17.427332+0000","last_became_peered":"2024-09-10T23:30:17.427332+0000","last_unstale":"2024-09-10T23:30:19.425328+0000","last_undegraded":"2024-09-10T23:30:19.425328+0000","last_fullsized":"2024-09-10T23:30:19.425328+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:04.590063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673512+0000","last_change":"2024-09-10T23:30:18.410894+0000","last_active":"2024-09-10T23:30:19.673512+0000","last_peered":"2024-09-10T23:30:19.673512+0000","last_clean":"2024-09-10T23:30:19.673512+0000","last_became_active":"2024-09-10T23:30:18.410504+0000","last_became_peered":"2024-09-10T23:30:18.410504+0000","last_unstale":"2024-09-10T23:30:19.673512+0000","last_undegraded":"2024-09-10T23:30:19.673512+0000","last_fullsized":"2024-09-10T23:30:19.673512+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:10.502957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679898+0000","last_change":"2024-09-10T23:30:17.435618+0000","last_active":"2024-09-10T23:30:19.679898+0000","last_peered":"2024-09-10T23:30:19.679898+0000","last_clean":"2024-09-10T23:30:19.679898+0000","last_became_active":"2024-09-10T23:30:17.435326+0000","last_became_peered":"2024-09-10T23:30:17.435326+0000","last_unstale":"2024-09-10T23:30:19.679898+0000","last_undegraded":"2024-09-10T23:30:19.679898+0000","last_fullsized":"2024-09-10T23:30:19.679898+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:38.614066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680764+0000","last_change":"2024-09-10T23:30:18.447807+0000","last_active":"2024-09-10T23:30:19.680764+0000","last_peered":"2024-09-10T23:30:19.680764+0000","last_clean":"2024-09-10T23:30:19.680764+0000","last_became_active":"2024-09-10T23:30:18.446742+0000","last_became_peered":"2024-09-10T23:30:18.446742+0000","last_unstale":"2024-09-10T23:30:19.680764+0000","last_undegraded":"2024-09-10T23:30:19.680764+0000","last_fullsized":"2024-09-10T23:30:19.680764+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:42.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679936+0000","last_change":"2024-09-10T23:30:17.426703+0000","last_active":"2024-09-10T23:30:19.679936+0000","last_peered":"2024-09-10T23:30:19.679936+0000","last_clean":"2024-09-10T23:30:19.679936+0000","last_became_active":"2024-09-10T23:30:17.425405+0000","last_became_peered":"2024-09-10T23:30:17.425405+0000","last_unstale":"2024-09-10T23:30:19.679936+0000","last_undegraded":"2024-09-10T23:30:19.679936+0000","last_fullsized":"2024-09-10T23:30:19.679936+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:10.559348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411488+0000","last_change":"2024-09-10T23:30:17.411488+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411488+0000","last_undegraded":"2024-09-10T23:30:17.411488+0000","last_fullsized":"2024-09-10T23:30:17.411488+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680337+0000","last_change":"2024-09-10T23:30:17.435242+0000","last_active":"2024-09-10T23:30:19.680337+0000","last_peered":"2024-09-10T23:30:19.680337+0000","last_clean":"2024-09-10T23:30:19.680337+0000","last_became_active":"2024-09-10T23:30:17.434970+0000","last_became_peered":"2024-09-10T23:30:17.434970+0000","last_unstale":"2024-09-10T23:30:19.680337+0000","last_undegraded":"2024-09-10T23:30:19.680337+0000","last_fullsized":"2024-09-10T23:30:19.680337+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":436,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679937+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:30:19.679937+0000","last_peered":"2024-09-10T23:30:19.679937+0000","last_clean":"2024-09-10T23:30:19.679937+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:30:19.679937+0000","last_undegraded":"2024-09-10T23:30:19.679937+0000","last_fullsized":"2024-09-10T23:30:19.679937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476918,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69716,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302124,"statfs":{"total":96636764160,"available":96565374976,"internally_reserved":0,"allocated":2555904,"data_stored":1193354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509623,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70288,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301552,"statfs":{"total":96636764160,"available":96564789248,"internally_reserved":0,"allocated":3133440,"data_stored":1782656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509622,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2547712,"data_stored":1193298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509623,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73924,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297916,"statfs":{"total":96636764160,"available":96561065984,"internally_reserved":0,"allocated":2535424,"data_stored":1191706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509622,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73912,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297928,"statfs":{"total":96636764160,"available":96561078272,"internally_reserved":0,"allocated":2527232,"data_stored":1185540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509623,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2519040,"data_stored":1184924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509622,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78644,"kb_used_data":3040,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293196,"statfs":{"total":96636764160,"available":96556232704,"internally_reserved":0,"allocated":3112960,"data_stored":1775292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73832,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298008,"statfs":{"total":96636764160,"available":96561160192,"internally_reserved":0,"allocated":2506752,"data_stored":1177757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:30:22.973 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:30:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.151+0000 7fbd3ca00640 1 -- 172.21.15.17:0/2846156693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d4800 msgr2=0x7fbd380d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.151+0000 7fbd3ca00640 1 --2- 172.21.15.17:0/2846156693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d4800 0x7fbd380d22c0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009900 tx=0x7fbd2001c8b0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.151+0000 7fbd3ca00640 1 -- 172.21.15.17:0/2846156693 shutdown_connections 2024-09-10T23:30:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.151+0000 7fbd3ca00640 1 --2- 172.21.15.17:0/2846156693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d4800 0x7fbd380d22c0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.151+0000 7fbd3ca00640 1 -- 172.21.15.17:0/2846156693 >> 172.21.15.17:0/2846156693 conn(0x7fbd380d3ce0 msgr2=0x7fbd380d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:23.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.151+0000 7fbd3ca00640 1 -- 172.21.15.17:0/2846156693 shutdown_connections 2024-09-10T23:30:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.151+0000 7fbd3ca00640 1 -- 172.21.15.17:0/2846156693 wait complete. 2024-09-10T23:30:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 Processor -- start 2024-09-10T23:30:23.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 -- start start 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd380b76b0 0x7fbd380c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d0450 0x7fbd381520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d4800 0x7fbd380cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3816bcf0 con 0x7fbd380d0450 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3816bb70 con 0x7fbd380b76b0 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3816be70 con 0x7fbd380d4800 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d0450 0x7fbd381520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d0450 0x7fbd381520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41880/0 (socket says 172.21.15.17:41880) 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2de00640 1 -- 172.21.15.17:0/3694008445 learned_addr learned my addr 172.21.15.17:0/3694008445 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd36800640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd380b76b0 0x7fbd380c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd37200640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d4800 0x7fbd380cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2de00640 1 -- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d4800 msgr2=0x7fbd380cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2de00640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d4800 0x7fbd380cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2de00640 1 -- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd380b76b0 msgr2=0x7fbd380c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2de00640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd380b76b0 0x7fbd380c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2de00640 1 -- 172.21.15.17:0/3694008445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd380cdd40 con 0x7fbd380d0450 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2de00640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d0450 0x7fbd381520c0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009850 tx=0x7fbd200a58a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2f400640 1 -- 172.21.15.17:0/3694008445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd200b2040 con 0x7fbd380d0450 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2f400640 1 -- 172.21.15.17:0/3694008445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd20005310 con 0x7fbd380d0450 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd380c83c0 con 0x7fbd380d0450 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd2f400640 1 -- 172.21.15.17:0/3694008445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20003700 con 0x7fbd380d0450 2024-09-10T23:30:23.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd380c8980 con 0x7fbd380d0450 2024-09-10T23:30:23.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.155+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd380d22c0 con 0x7fbd380d0450 2024-09-10T23:30:23.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.159+0000 7fbd2f400640 1 -- 172.21.15.17:0/3694008445 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbd200038a0 con 0x7fbd380d0450 2024-09-10T23:30:23.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.159+0000 7fbd2f400640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd14072610 0x7fbd14074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.159+0000 7fbd2f400640 1 -- 172.21.15.17:0/3694008445 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fbd2012db10 con 0x7fbd380d0450 2024-09-10T23:30:23.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.159+0000 7fbd36800640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd14072610 0x7fbd14074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.159+0000 7fbd36800640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd14072610 0x7fbd14074ad0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbd280016f0 tx=0x7fbd28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:23.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.163+0000 7fbd2f400640 1 -- 172.21.15.17:0/3694008445 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbd200164d0 con 0x7fbd380d0450 2024-09-10T23:30:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.335+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd380cef60 con 0x7fbd14072610 2024-09-10T23:30:23.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.339+0000 7fbd2f400640 1 -- 172.21.15.17:0/3694008445 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251154 (secure 0 0 0) 0x7fbd380cef60 con 0x7fbd14072610 2024-09-10T23:30:23.344 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:23.345 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:30:23.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd14072610 msgr2=0x7fbd14074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd14072610 0x7fbd14074ad0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbd280016f0 tx=0x7fbd28009040 comp rx=0 tx=0).stop 2024-09-10T23:30:23.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d0450 msgr2=0x7fbd381520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d0450 0x7fbd381520c0 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009850 tx=0x7fbd200a58a0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 shutdown_connections 2024-09-10T23:30:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbd14072610 0x7fbd14074ad0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd380d4800 0x7fbd380cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd380d0450 0x7fbd381520c0 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 --2- 172.21.15.17:0/3694008445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd380b76b0 0x7fbd380c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 >> 172.21.15.17:0/3694008445 conn(0x7fbd380d3ce0 msgr2=0x7fbd380ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 shutdown_connections 2024-09-10T23:30:23.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.343+0000 7fbd3ca00640 1 -- 172.21.15.17:0/3694008445 wait complete. 2024-09-10T23:30:23.365 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":644,"stamp":"2024-09-10T23:30:22.508517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":535424,"kb_used_data":20936,"kb_used_omap":12,"kb_used_meta":514291,"kb_avail":754439296,"statfs":{"total":773094113280,"available":772545839104,"internally_reserved":0,"allocated":21438464,"data_stored":10684527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":526634545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001633"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680622+0000","last_change":"2024-09-10T23:30:18.440391+0000","last_active":"2024-09-10T23:30:19.680622+0000","last_peered":"2024-09-10T23:30:19.680622+0000","last_clean":"2024-09-10T23:30:19.680622+0000","last_became_active":"2024-09-10T23:30:18.439926+0000","last_became_peered":"2024-09-10T23:30:18.439926+0000","last_unstale":"2024-09-10T23:30:19.680622+0000","last_undegraded":"2024-09-10T23:30:19.680622+0000","last_fullsized":"2024-09-10T23:30:19.680622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:44.295301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673620+0000","last_change":"2024-09-10T23:30:18.426349+0000","last_active":"2024-09-10T23:30:19.673620+0000","last_peered":"2024-09-10T23:30:19.673620+0000","last_clean":"2024-09-10T23:30:19.673620+0000","last_became_active":"2024-09-10T23:30:18.426097+0000","last_became_peered":"2024-09-10T23:30:18.426097+0000","last_unstale":"2024-09-10T23:30:19.673620+0000","last_undegraded":"2024-09-10T23:30:19.673620+0000","last_fullsized":"2024-09-10T23:30:19.673620+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.027470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409388+0000","last_change":"2024-09-10T23:30:17.409388+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409388+0000","last_undegraded":"2024-09-10T23:30:17.409388+0000","last_fullsized":"2024-09-10T23:30:17.409388+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425602+0000","last_change":"2024-09-10T23:30:18.435603+0000","last_active":"2024-09-10T23:30:19.425602+0000","last_peered":"2024-09-10T23:30:19.425602+0000","last_clean":"2024-09-10T23:30:19.425602+0000","last_became_active":"2024-09-10T23:30:18.435276+0000","last_became_peered":"2024-09-10T23:30:18.435276+0000","last_unstale":"2024-09-10T23:30:19.425602+0000","last_undegraded":"2024-09-10T23:30:19.425602+0000","last_fullsized":"2024-09-10T23:30:19.425602+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:33.263213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680433+0000","last_change":"2024-09-10T23:30:18.431319+0000","last_active":"2024-09-10T23:30:19.680433+0000","last_peered":"2024-09-10T23:30:19.680433+0000","last_clean":"2024-09-10T23:30:19.680433+0000","last_became_active":"2024-09-10T23:30:18.430960+0000","last_became_peered":"2024-09-10T23:30:18.430960+0000","last_unstale":"2024-09-10T23:30:19.680433+0000","last_undegraded":"2024-09-10T23:30:19.680433+0000","last_fullsized":"2024-09-10T23:30:19.680433+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:20.489147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:18.433402+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:18.432962+0000","last_became_peered":"2024-09-10T23:30:18.432962+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:43.563487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411081+0000","last_change":"2024-09-10T23:30:17.411081+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411081+0000","last_undegraded":"2024-09-10T23:30:17.411081+0000","last_fullsized":"2024-09-10T23:30:17.411081+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490652+0000","last_change":"2024-09-10T23:30:18.436129+0000","last_active":"2024-09-10T23:30:19.490652+0000","last_peered":"2024-09-10T23:30:19.490652+0000","last_clean":"2024-09-10T23:30:19.490652+0000","last_became_active":"2024-09-10T23:30:18.432600+0000","last_became_peered":"2024-09-10T23:30:18.432600+0000","last_unstale":"2024-09-10T23:30:19.490652+0000","last_undegraded":"2024-09-10T23:30:19.490652+0000","last_fullsized":"2024-09-10T23:30:19.490652+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:45.147222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673622+0000","last_change":"2024-09-10T23:30:18.418279+0000","last_active":"2024-09-10T23:30:19.673622+0000","last_peered":"2024-09-10T23:30:19.673622+0000","last_clean":"2024-09-10T23:30:19.673622+0000","last_became_active":"2024-09-10T23:30:18.418016+0000","last_became_peered":"2024-09-10T23:30:18.418016+0000","last_unstale":"2024-09-10T23:30:19.673622+0000","last_undegraded":"2024-09-10T23:30:19.673622+0000","last_fullsized":"2024-09-10T23:30:19.673622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:28.041686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.412410+0000","last_change":"2024-09-10T23:30:17.412410+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.412410+0000","last_undegraded":"2024-09-10T23:30:17.412410+0000","last_fullsized":"2024-09-10T23:30:17.412410+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425855+0000","last_change":"2024-09-10T23:30:18.430324+0000","last_active":"2024-09-10T23:30:19.425855+0000","last_peered":"2024-09-10T23:30:19.425855+0000","last_clean":"2024-09-10T23:30:19.425855+0000","last_became_active":"2024-09-10T23:30:18.429990+0000","last_became_peered":"2024-09-10T23:30:18.429990+0000","last_unstale":"2024-09-10T23:30:19.425855+0000","last_undegraded":"2024-09-10T23:30:19.425855+0000","last_fullsized":"2024-09-10T23:30:19.425855+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:57.601597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680462+0000","last_change":"2024-09-10T23:30:18.445466+0000","last_active":"2024-09-10T23:30:19.680462+0000","last_peered":"2024-09-10T23:30:19.680462+0000","last_clean":"2024-09-10T23:30:19.680462+0000","last_became_active":"2024-09-10T23:30:18.443772+0000","last_became_peered":"2024-09-10T23:30:18.443772+0000","last_unstale":"2024-09-10T23:30:19.680462+0000","last_undegraded":"2024-09-10T23:30:19.680462+0000","last_fullsized":"2024-09-10T23:30:19.680462+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:57.665627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490827+0000","last_change":"2024-09-10T23:30:18.434628+0000","last_active":"2024-09-10T23:30:19.490827+0000","last_peered":"2024-09-10T23:30:19.490827+0000","last_clean":"2024-09-10T23:30:19.490827+0000","last_became_active":"2024-09-10T23:30:18.434323+0000","last_became_peered":"2024-09-10T23:30:18.434323+0000","last_unstale":"2024-09-10T23:30:19.490827+0000","last_undegraded":"2024-09-10T23:30:19.490827+0000","last_fullsized":"2024-09-10T23:30:19.490827+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:44.464168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680538+0000","last_change":"2024-09-10T23:30:18.438166+0000","last_active":"2024-09-10T23:30:19.680538+0000","last_peered":"2024-09-10T23:30:19.680538+0000","last_clean":"2024-09-10T23:30:19.680538+0000","last_became_active":"2024-09-10T23:30:18.437380+0000","last_became_peered":"2024-09-10T23:30:18.437380+0000","last_unstale":"2024-09-10T23:30:19.680538+0000","last_undegraded":"2024-09-10T23:30:19.680538+0000","last_fullsized":"2024-09-10T23:30:19.680538+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:38.346963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673187+0000","last_change":"2024-09-10T23:30:18.419876+0000","last_active":"2024-09-10T23:30:19.673187+0000","last_peered":"2024-09-10T23:30:19.673187+0000","last_clean":"2024-09-10T23:30:19.673187+0000","last_became_active":"2024-09-10T23:30:18.419619+0000","last_became_peered":"2024-09-10T23:30:18.419619+0000","last_unstale":"2024-09-10T23:30:19.673187+0000","last_undegraded":"2024-09-10T23:30:19.673187+0000","last_fullsized":"2024-09-10T23:30:19.673187+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:10.606290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490788+0000","last_change":"2024-09-10T23:30:18.432783+0000","last_active":"2024-09-10T23:30:19.490788+0000","last_peered":"2024-09-10T23:30:19.490788+0000","last_clean":"2024-09-10T23:30:19.490788+0000","last_became_active":"2024-09-10T23:30:18.432259+0000","last_became_peered":"2024-09-10T23:30:18.432259+0000","last_unstale":"2024-09-10T23:30:19.490788+0000","last_undegraded":"2024-09-10T23:30:19.490788+0000","last_fullsized":"2024-09-10T23:30:19.490788+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:26.774814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681405+0000","last_change":"2024-09-10T23:30:18.448718+0000","last_active":"2024-09-10T23:30:19.681405+0000","last_peered":"2024-09-10T23:30:19.681405+0000","last_clean":"2024-09-10T23:30:19.681405+0000","last_became_active":"2024-09-10T23:30:18.446844+0000","last_became_peered":"2024-09-10T23:30:18.446844+0000","last_unstale":"2024-09-10T23:30:19.681405+0000","last_undegraded":"2024-09-10T23:30:19.681405+0000","last_fullsized":"2024-09-10T23:30:19.681405+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:29.166857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411964+0000","last_change":"2024-09-10T23:30:17.411964+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411964+0000","last_undegraded":"2024-09-10T23:30:17.411964+0000","last_fullsized":"2024-09-10T23:30:17.411964+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680532+0000","last_change":"2024-09-10T23:30:18.438704+0000","last_active":"2024-09-10T23:30:19.680532+0000","last_peered":"2024-09-10T23:30:19.680532+0000","last_clean":"2024-09-10T23:30:19.680532+0000","last_became_active":"2024-09-10T23:30:18.436192+0000","last_became_peered":"2024-09-10T23:30:18.436192+0000","last_unstale":"2024-09-10T23:30:19.680532+0000","last_undegraded":"2024-09-10T23:30:19.680532+0000","last_fullsized":"2024-09-10T23:30:19.680532+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:20.225885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491096+0000","last_change":"2024-09-10T23:30:18.434226+0000","last_active":"2024-09-10T23:30:19.491096+0000","last_peered":"2024-09-10T23:30:19.491096+0000","last_clean":"2024-09-10T23:30:19.491096+0000","last_became_active":"2024-09-10T23:30:18.433919+0000","last_became_peered":"2024-09-10T23:30:18.433919+0000","last_unstale":"2024-09-10T23:30:19.491096+0000","last_undegraded":"2024-09-10T23:30:19.491096+0000","last_fullsized":"2024-09-10T23:30:19.491096+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.591952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408998+0000","last_change":"2024-09-10T23:30:17.408998+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408998+0000","last_undegraded":"2024-09-10T23:30:17.408998+0000","last_fullsized":"2024-09-10T23:30:17.408998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673766+0000","last_change":"2024-09-10T23:30:18.432090+0000","last_active":"2024-09-10T23:30:19.673766+0000","last_peered":"2024-09-10T23:30:19.673766+0000","last_clean":"2024-09-10T23:30:19.673766+0000","last_became_active":"2024-09-10T23:30:18.430309+0000","last_became_peered":"2024-09-10T23:30:18.430309+0000","last_unstale":"2024-09-10T23:30:19.673766+0000","last_undegraded":"2024-09-10T23:30:19.673766+0000","last_fullsized":"2024-09-10T23:30:19.673766+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:26.449042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672993+0000","last_change":"2024-09-10T23:30:18.419267+0000","last_active":"2024-09-10T23:30:19.672993+0000","last_peered":"2024-09-10T23:30:19.672993+0000","last_clean":"2024-09-10T23:30:19.672993+0000","last_became_active":"2024-09-10T23:30:18.418970+0000","last_became_peered":"2024-09-10T23:30:18.418970+0000","last_unstale":"2024-09-10T23:30:19.672993+0000","last_undegraded":"2024-09-10T23:30:19.672993+0000","last_fullsized":"2024-09-10T23:30:19.672993+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:12.054872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680124+0000","last_change":"2024-09-10T23:30:18.430296+0000","last_active":"2024-09-10T23:30:19.680124+0000","last_peered":"2024-09-10T23:30:19.680124+0000","last_clean":"2024-09-10T23:30:19.680124+0000","last_became_active":"2024-09-10T23:30:18.430015+0000","last_became_peered":"2024-09-10T23:30:18.430015+0000","last_unstale":"2024-09-10T23:30:19.680124+0000","last_undegraded":"2024-09-10T23:30:19.680124+0000","last_fullsized":"2024-09-10T23:30:19.680124+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:43.868057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680876+0000","last_change":"2024-09-10T23:30:18.436029+0000","last_active":"2024-09-10T23:30:19.680876+0000","last_peered":"2024-09-10T23:30:19.680876+0000","last_clean":"2024-09-10T23:30:19.680876+0000","last_became_active":"2024-09-10T23:30:18.435737+0000","last_became_peered":"2024-09-10T23:30:18.435737+0000","last_unstale":"2024-09-10T23:30:19.680876+0000","last_undegraded":"2024-09-10T23:30:19.680876+0000","last_fullsized":"2024-09-10T23:30:19.680876+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:59.131863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411574+0000","last_change":"2024-09-10T23:30:17.411574+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411574+0000","last_undegraded":"2024-09-10T23:30:17.411574+0000","last_fullsized":"2024-09-10T23:30:17.411574+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425917+0000","last_change":"2024-09-10T23:30:18.434286+0000","last_active":"2024-09-10T23:30:19.425917+0000","last_peered":"2024-09-10T23:30:19.425917+0000","last_clean":"2024-09-10T23:30:19.425917+0000","last_became_active":"2024-09-10T23:30:18.434031+0000","last_became_peered":"2024-09-10T23:30:18.434031+0000","last_unstale":"2024-09-10T23:30:19.425917+0000","last_undegraded":"2024-09-10T23:30:19.425917+0000","last_fullsized":"2024-09-10T23:30:19.425917+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:13.918980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681217+0000","last_change":"2024-09-10T23:30:18.430415+0000","last_active":"2024-09-10T23:30:19.681217+0000","last_peered":"2024-09-10T23:30:19.681217+0000","last_clean":"2024-09-10T23:30:19.681217+0000","last_became_active":"2024-09-10T23:30:18.430059+0000","last_became_peered":"2024-09-10T23:30:18.430059+0000","last_unstale":"2024-09-10T23:30:19.681217+0000","last_undegraded":"2024-09-10T23:30:19.681217+0000","last_fullsized":"2024-09-10T23:30:19.681217+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:14.451454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673314+0000","last_change":"2024-09-10T23:30:18.436833+0000","last_active":"2024-09-10T23:30:19.673314+0000","last_peered":"2024-09-10T23:30:19.673314+0000","last_clean":"2024-09-10T23:30:19.673314+0000","last_became_active":"2024-09-10T23:30:18.436385+0000","last_became_peered":"2024-09-10T23:30:18.436385+0000","last_unstale":"2024-09-10T23:30:19.673314+0000","last_undegraded":"2024-09-10T23:30:19.673314+0000","last_fullsized":"2024-09-10T23:30:19.673314+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:48.896976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490730+0000","last_change":"2024-09-10T23:30:18.443963+0000","last_active":"2024-09-10T23:30:19.490730+0000","last_peered":"2024-09-10T23:30:19.490730+0000","last_clean":"2024-09-10T23:30:19.490730+0000","last_became_active":"2024-09-10T23:30:18.443624+0000","last_became_peered":"2024-09-10T23:30:18.443624+0000","last_unstale":"2024-09-10T23:30:19.490730+0000","last_undegraded":"2024-09-10T23:30:19.490730+0000","last_fullsized":"2024-09-10T23:30:19.490730+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:12.367128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673197+0000","last_change":"2024-09-10T23:30:18.426364+0000","last_active":"2024-09-10T23:30:19.673197+0000","last_peered":"2024-09-10T23:30:19.673197+0000","last_clean":"2024-09-10T23:30:19.673197+0000","last_became_active":"2024-09-10T23:30:18.426089+0000","last_became_peered":"2024-09-10T23:30:18.426089+0000","last_unstale":"2024-09-10T23:30:19.673197+0000","last_undegraded":"2024-09-10T23:30:19.673197+0000","last_fullsized":"2024-09-10T23:30:19.673197+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:54.103650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490986+0000","last_change":"2024-09-10T23:30:18.442390+0000","last_active":"2024-09-10T23:30:19.490986+0000","last_peered":"2024-09-10T23:30:19.490986+0000","last_clean":"2024-09-10T23:30:19.490986+0000","last_became_active":"2024-09-10T23:30:18.442008+0000","last_became_peered":"2024-09-10T23:30:18.442008+0000","last_unstale":"2024-09-10T23:30:19.490986+0000","last_undegraded":"2024-09-10T23:30:19.490986+0000","last_fullsized":"2024-09-10T23:30:19.490986+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:18.297755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408362+0000","last_change":"2024-09-10T23:30:17.408362+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408362+0000","last_undegraded":"2024-09-10T23:30:17.408362+0000","last_fullsized":"2024-09-10T23:30:17.408362+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"200'4","reported_seq":19,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673771+0000","last_change":"2024-09-10T23:30:17.428407+0000","last_active":"2024-09-10T23:30:19.673771+0000","last_peered":"2024-09-10T23:30:19.673771+0000","last_clean":"2024-09-10T23:30:19.673771+0000","last_became_active":"2024-09-10T23:30:17.428095+0000","last_became_peered":"2024-09-10T23:30:17.428095+0000","last_unstale":"2024-09-10T23:30:19.673771+0000","last_undegraded":"2024-09-10T23:30:19.673771+0000","last_fullsized":"2024-09-10T23:30:19.673771+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:44.817383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408920+0000","last_change":"2024-09-10T23:30:17.408920+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408920+0000","last_undegraded":"2024-09-10T23:30:17.408920+0000","last_fullsized":"2024-09-10T23:30:17.408920+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681483+0000","last_change":"2024-09-10T23:30:17.435885+0000","last_active":"2024-09-10T23:30:19.681483+0000","last_peered":"2024-09-10T23:30:19.681483+0000","last_clean":"2024-09-10T23:30:19.681483+0000","last_became_active":"2024-09-10T23:30:17.435638+0000","last_became_peered":"2024-09-10T23:30:17.435638+0000","last_unstale":"2024-09-10T23:30:19.681483+0000","last_undegraded":"2024-09-10T23:30:19.681483+0000","last_fullsized":"2024-09-10T23:30:19.681483+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:28.443604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681443+0000","last_change":"2024-09-10T23:30:18.446032+0000","last_active":"2024-09-10T23:30:19.681443+0000","last_peered":"2024-09-10T23:30:19.681443+0000","last_clean":"2024-09-10T23:30:19.681443+0000","last_became_active":"2024-09-10T23:30:18.445739+0000","last_became_peered":"2024-09-10T23:30:18.445739+0000","last_unstale":"2024-09-10T23:30:19.681443+0000","last_undegraded":"2024-09-10T23:30:19.681443+0000","last_fullsized":"2024-09-10T23:30:19.681443+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.138384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:17.426662+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:17.426379+0000","last_became_peered":"2024-09-10T23:30:17.426379+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:31.377540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409688+0000","last_change":"2024-09-10T23:30:17.409688+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409688+0000","last_undegraded":"2024-09-10T23:30:17.409688+0000","last_fullsized":"2024-09-10T23:30:17.409688+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674268+0000","last_change":"2024-09-10T23:30:17.424648+0000","last_active":"2024-09-10T23:30:19.674268+0000","last_peered":"2024-09-10T23:30:19.674268+0000","last_clean":"2024-09-10T23:30:19.674268+0000","last_became_active":"2024-09-10T23:30:17.424309+0000","last_became_peered":"2024-09-10T23:30:17.424309+0000","last_unstale":"2024-09-10T23:30:19.674268+0000","last_undegraded":"2024-09-10T23:30:19.674268+0000","last_fullsized":"2024-09-10T23:30:19.674268+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:44.144068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679901+0000","last_change":"2024-09-10T23:30:18.437987+0000","last_active":"2024-09-10T23:30:19.679901+0000","last_peered":"2024-09-10T23:30:19.679901+0000","last_clean":"2024-09-10T23:30:19.679901+0000","last_became_active":"2024-09-10T23:30:18.437707+0000","last_became_peered":"2024-09-10T23:30:18.437707+0000","last_unstale":"2024-09-10T23:30:19.679901+0000","last_undegraded":"2024-09-10T23:30:19.679901+0000","last_fullsized":"2024-09-10T23:30:19.679901+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:52.657720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680192+0000","last_change":"2024-09-10T23:30:17.438669+0000","last_active":"2024-09-10T23:30:19.680192+0000","last_peered":"2024-09-10T23:30:19.680192+0000","last_clean":"2024-09-10T23:30:19.680192+0000","last_became_active":"2024-09-10T23:30:17.438383+0000","last_became_peered":"2024-09-10T23:30:17.438383+0000","last_unstale":"2024-09-10T23:30:19.680192+0000","last_undegraded":"2024-09-10T23:30:19.680192+0000","last_fullsized":"2024-09-10T23:30:19.680192+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:58.970215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674014+0000","last_change":"2024-09-10T23:30:18.430231+0000","last_active":"2024-09-10T23:30:19.674014+0000","last_peered":"2024-09-10T23:30:19.674014+0000","last_clean":"2024-09-10T23:30:19.674014+0000","last_became_active":"2024-09-10T23:30:18.429920+0000","last_became_peered":"2024-09-10T23:30:18.429920+0000","last_unstale":"2024-09-10T23:30:19.674014+0000","last_undegraded":"2024-09-10T23:30:19.674014+0000","last_fullsized":"2024-09-10T23:30:19.674014+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:42.713962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425230+0000","last_change":"2024-09-10T23:30:17.425766+0000","last_active":"2024-09-10T23:30:19.425230+0000","last_peered":"2024-09-10T23:30:19.425230+0000","last_clean":"2024-09-10T23:30:19.425230+0000","last_became_active":"2024-09-10T23:30:17.424967+0000","last_became_peered":"2024-09-10T23:30:17.424967+0000","last_unstale":"2024-09-10T23:30:19.425230+0000","last_undegraded":"2024-09-10T23:30:19.425230+0000","last_fullsized":"2024-09-10T23:30:19.425230+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:55.277369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673775+0000","last_change":"2024-09-10T23:30:18.427654+0000","last_active":"2024-09-10T23:30:19.673775+0000","last_peered":"2024-09-10T23:30:19.673775+0000","last_clean":"2024-09-10T23:30:19.673775+0000","last_became_active":"2024-09-10T23:30:18.427356+0000","last_became_peered":"2024-09-10T23:30:18.427356+0000","last_unstale":"2024-09-10T23:30:19.673775+0000","last_undegraded":"2024-09-10T23:30:19.673775+0000","last_fullsized":"2024-09-10T23:30:19.673775+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:35.999756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-10T23:30:17.420337+0000","last_change":"2024-09-10T23:30:17.418976+0000","last_active":"2024-09-10T23:30:17.420337+0000","last_peered":"2024-09-10T23:30:17.420337+0000","last_clean":"2024-09-10T23:30:17.420337+0000","last_became_active":"2024-09-10T23:30:17.418442+0000","last_became_peered":"2024-09-10T23:30:17.418442+0000","last_unstale":"2024-09-10T23:30:17.420337+0000","last_undegraded":"2024-09-10T23:30:17.420337+0000","last_fullsized":"2024-09-10T23:30:17.420337+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.309934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674418+0000","last_change":"2024-09-10T23:30:18.425119+0000","last_active":"2024-09-10T23:30:19.674418+0000","last_peered":"2024-09-10T23:30:19.674418+0000","last_clean":"2024-09-10T23:30:19.674418+0000","last_became_active":"2024-09-10T23:30:18.424853+0000","last_became_peered":"2024-09-10T23:30:18.424853+0000","last_unstale":"2024-09-10T23:30:19.674418+0000","last_undegraded":"2024-09-10T23:30:19.674418+0000","last_fullsized":"2024-09-10T23:30:19.674418+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:31.576971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681004+0000","last_change":"2024-09-10T23:30:17.436490+0000","last_active":"2024-09-10T23:30:19.681004+0000","last_peered":"2024-09-10T23:30:19.681004+0000","last_clean":"2024-09-10T23:30:19.681004+0000","last_became_active":"2024-09-10T23:30:17.436203+0000","last_became_peered":"2024-09-10T23:30:17.436203+0000","last_unstale":"2024-09-10T23:30:19.681004+0000","last_undegraded":"2024-09-10T23:30:19.681004+0000","last_fullsized":"2024-09-10T23:30:19.681004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674470+0000","last_change":"2024-09-10T23:30:18.427676+0000","last_active":"2024-09-10T23:30:19.674470+0000","last_peered":"2024-09-10T23:30:19.674470+0000","last_clean":"2024-09-10T23:30:19.674470+0000","last_became_active":"2024-09-10T23:30:18.425145+0000","last_became_peered":"2024-09-10T23:30:18.425145+0000","last_unstale":"2024-09-10T23:30:19.674470+0000","last_undegraded":"2024-09-10T23:30:19.674470+0000","last_fullsized":"2024-09-10T23:30:19.674470+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425913+0000","last_change":"2024-09-10T23:30:17.431896+0000","last_active":"2024-09-10T23:30:19.425913+0000","last_peered":"2024-09-10T23:30:19.425913+0000","last_clean":"2024-09-10T23:30:19.425913+0000","last_became_active":"2024-09-10T23:30:17.430852+0000","last_became_peered":"2024-09-10T23:30:17.430852+0000","last_unstale":"2024-09-10T23:30:19.425913+0000","last_undegraded":"2024-09-10T23:30:19.425913+0000","last_fullsized":"2024-09-10T23:30:19.425913+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:03.399968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411064+0000","last_change":"2024-09-10T23:30:17.411064+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411064+0000","last_undegraded":"2024-09-10T23:30:17.411064+0000","last_fullsized":"2024-09-10T23:30:17.411064+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"200'3","reported_seq":18,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680857+0000","last_change":"2024-09-10T23:30:17.437999+0000","last_active":"2024-09-10T23:30:19.680857+0000","last_peered":"2024-09-10T23:30:19.680857+0000","last_clean":"2024-09-10T23:30:19.680857+0000","last_became_active":"2024-09-10T23:30:17.437724+0000","last_became_peered":"2024-09-10T23:30:17.437724+0000","last_unstale":"2024-09-10T23:30:19.680857+0000","last_undegraded":"2024-09-10T23:30:19.680857+0000","last_fullsized":"2024-09-10T23:30:19.680857+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:35.934846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.426144+0000","last_change":"2024-09-10T23:30:18.431666+0000","last_active":"2024-09-10T23:30:19.426144+0000","last_peered":"2024-09-10T23:30:19.426144+0000","last_clean":"2024-09-10T23:30:19.426144+0000","last_became_active":"2024-09-10T23:30:18.431392+0000","last_became_peered":"2024-09-10T23:30:18.431392+0000","last_unstale":"2024-09-10T23:30:19.426144+0000","last_undegraded":"2024-09-10T23:30:19.426144+0000","last_fullsized":"2024-09-10T23:30:19.426144+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:05.543871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"200'6","reported_seq":21,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491058+0000","last_change":"2024-09-10T23:30:17.427136+0000","last_active":"2024-09-10T23:30:19.491058+0000","last_peered":"2024-09-10T23:30:19.491058+0000","last_clean":"2024-09-10T23:30:19.491058+0000","last_became_active":"2024-09-10T23:30:17.426720+0000","last_became_peered":"2024-09-10T23:30:17.426720+0000","last_unstale":"2024-09-10T23:30:19.491058+0000","last_undegraded":"2024-09-10T23:30:19.491058+0000","last_fullsized":"2024-09-10T23:30:19.491058+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:42.586081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672998+0000","last_change":"2024-09-10T23:30:18.436906+0000","last_active":"2024-09-10T23:30:19.672998+0000","last_peered":"2024-09-10T23:30:19.672998+0000","last_clean":"2024-09-10T23:30:19.672998+0000","last_became_active":"2024-09-10T23:30:18.436447+0000","last_became_peered":"2024-09-10T23:30:18.436447+0000","last_unstale":"2024-09-10T23:30:19.672998+0000","last_undegraded":"2024-09-10T23:30:19.672998+0000","last_fullsized":"2024-09-10T23:30:19.672998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680784+0000","last_change":"2024-09-10T23:30:17.428623+0000","last_active":"2024-09-10T23:30:19.680784+0000","last_peered":"2024-09-10T23:30:19.680784+0000","last_clean":"2024-09-10T23:30:19.680784+0000","last_became_active":"2024-09-10T23:30:17.428332+0000","last_became_peered":"2024-09-10T23:30:17.428332+0000","last_unstale":"2024-09-10T23:30:19.680784+0000","last_undegraded":"2024-09-10T23:30:19.680784+0000","last_fullsized":"2024-09-10T23:30:19.680784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:44.204111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680358+0000","last_change":"2024-09-10T23:30:18.444027+0000","last_active":"2024-09-10T23:30:19.680358+0000","last_peered":"2024-09-10T23:30:19.680358+0000","last_clean":"2024-09-10T23:30:19.680358+0000","last_became_active":"2024-09-10T23:30:18.443479+0000","last_became_peered":"2024-09-10T23:30:18.443479+0000","last_unstale":"2024-09-10T23:30:19.680358+0000","last_undegraded":"2024-09-10T23:30:19.680358+0000","last_fullsized":"2024-09-10T23:30:19.680358+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:15.469850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673380+0000","last_change":"2024-09-10T23:30:17.417961+0000","last_active":"2024-09-10T23:30:19.673380+0000","last_peered":"2024-09-10T23:30:19.673380+0000","last_clean":"2024-09-10T23:30:19.673380+0000","last_became_active":"2024-09-10T23:30:17.417683+0000","last_became_peered":"2024-09-10T23:30:17.417683+0000","last_unstale":"2024-09-10T23:30:19.673380+0000","last_undegraded":"2024-09-10T23:30:19.673380+0000","last_fullsized":"2024-09-10T23:30:19.673380+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:45:55.340081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411074+0000","last_change":"2024-09-10T23:30:17.411074+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411074+0000","last_undegraded":"2024-09-10T23:30:17.411074+0000","last_fullsized":"2024-09-10T23:30:17.411074+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490429+0000","last_change":"2024-09-10T23:30:17.425540+0000","last_active":"2024-09-10T23:30:19.490429+0000","last_peered":"2024-09-10T23:30:19.490429+0000","last_clean":"2024-09-10T23:30:19.490429+0000","last_became_active":"2024-09-10T23:30:17.425256+0000","last_became_peered":"2024-09-10T23:30:17.425256+0000","last_unstale":"2024-09-10T23:30:19.490429+0000","last_undegraded":"2024-09-10T23:30:19.490429+0000","last_fullsized":"2024-09-10T23:30:19.490429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:37.019557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674115+0000","last_change":"2024-09-10T23:30:18.425671+0000","last_active":"2024-09-10T23:30:19.674115+0000","last_peered":"2024-09-10T23:30:19.674115+0000","last_clean":"2024-09-10T23:30:19.674115+0000","last_became_active":"2024-09-10T23:30:18.424769+0000","last_became_peered":"2024-09-10T23:30:18.424769+0000","last_unstale":"2024-09-10T23:30:19.674115+0000","last_undegraded":"2024-09-10T23:30:19.674115+0000","last_fullsized":"2024-09-10T23:30:19.674115+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:39.771480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"200'8","reported_seq":23,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679790+0000","last_change":"2024-09-10T23:30:17.425625+0000","last_active":"2024-09-10T23:30:19.679790+0000","last_peered":"2024-09-10T23:30:19.679790+0000","last_clean":"2024-09-10T23:30:19.679790+0000","last_became_active":"2024-09-10T23:30:17.425348+0000","last_became_peered":"2024-09-10T23:30:17.425348+0000","last_unstale":"2024-09-10T23:30:19.679790+0000","last_undegraded":"2024-09-10T23:30:19.679790+0000","last_fullsized":"2024-09-10T23:30:19.679790+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:53.025824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673146+0000","last_change":"2024-09-10T23:30:18.428571+0000","last_active":"2024-09-10T23:30:19.673146+0000","last_peered":"2024-09-10T23:30:19.673146+0000","last_clean":"2024-09-10T23:30:19.673146+0000","last_became_active":"2024-09-10T23:30:18.427496+0000","last_became_peered":"2024-09-10T23:30:18.427496+0000","last_unstale":"2024-09-10T23:30:19.673146+0000","last_undegraded":"2024-09-10T23:30:19.673146+0000","last_fullsized":"2024-09-10T23:30:19.673146+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:25.149316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-10T23:30:17.424153+0000","last_change":"2024-09-10T23:30:17.423434+0000","last_active":"2024-09-10T23:30:17.424153+0000","last_peered":"2024-09-10T23:30:17.424153+0000","last_clean":"2024-09-10T23:30:17.424153+0000","last_became_active":"2024-09-10T23:30:17.423143+0000","last_became_peered":"2024-09-10T23:30:17.423143+0000","last_unstale":"2024-09-10T23:30:17.424153+0000","last_undegraded":"2024-09-10T23:30:17.424153+0000","last_fullsized":"2024-09-10T23:30:17.424153+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:25.958953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680725+0000","last_change":"2024-09-10T23:30:18.442899+0000","last_active":"2024-09-10T23:30:19.680725+0000","last_peered":"2024-09-10T23:30:19.680725+0000","last_clean":"2024-09-10T23:30:19.680725+0000","last_became_active":"2024-09-10T23:30:18.442642+0000","last_became_peered":"2024-09-10T23:30:18.442642+0000","last_unstale":"2024-09-10T23:30:19.680725+0000","last_undegraded":"2024-09-10T23:30:19.680725+0000","last_fullsized":"2024-09-10T23:30:19.680725+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:09.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673407+0000","last_change":"2024-09-10T23:30:17.419308+0000","last_active":"2024-09-10T23:30:19.673407+0000","last_peered":"2024-09-10T23:30:19.673407+0000","last_clean":"2024-09-10T23:30:19.673407+0000","last_became_active":"2024-09-10T23:30:17.419027+0000","last_became_peered":"2024-09-10T23:30:17.419027+0000","last_unstale":"2024-09-10T23:30:19.673407+0000","last_undegraded":"2024-09-10T23:30:19.673407+0000","last_fullsized":"2024-09-10T23:30:19.673407+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:37.201310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409456+0000","last_change":"2024-09-10T23:30:17.409456+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409456+0000","last_undegraded":"2024-09-10T23:30:17.409456+0000","last_fullsized":"2024-09-10T23:30:17.409456+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681143+0000","last_change":"2024-09-10T23:30:17.427272+0000","last_active":"2024-09-10T23:30:19.681143+0000","last_peered":"2024-09-10T23:30:19.681143+0000","last_clean":"2024-09-10T23:30:19.681143+0000","last_became_active":"2024-09-10T23:30:17.426898+0000","last_became_peered":"2024-09-10T23:30:17.426898+0000","last_unstale":"2024-09-10T23:30:19.681143+0000","last_undegraded":"2024-09-10T23:30:19.681143+0000","last_fullsized":"2024-09-10T23:30:19.681143+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:17.943545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681625+0000","last_change":"2024-09-10T23:30:18.442632+0000","last_active":"2024-09-10T23:30:19.681625+0000","last_peered":"2024-09-10T23:30:19.681625+0000","last_clean":"2024-09-10T23:30:19.681625+0000","last_became_active":"2024-09-10T23:30:18.442386+0000","last_became_peered":"2024-09-10T23:30:18.442386+0000","last_unstale":"2024-09-10T23:30:19.681625+0000","last_undegraded":"2024-09-10T23:30:19.681625+0000","last_fullsized":"2024-09-10T23:30:19.681625+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:48.604686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681142+0000","last_change":"2024-09-10T23:30:17.427578+0000","last_active":"2024-09-10T23:30:19.681142+0000","last_peered":"2024-09-10T23:30:19.681142+0000","last_clean":"2024-09-10T23:30:19.681142+0000","last_became_active":"2024-09-10T23:30:17.424863+0000","last_became_peered":"2024-09-10T23:30:17.424863+0000","last_unstale":"2024-09-10T23:30:19.681142+0000","last_undegraded":"2024-09-10T23:30:19.681142+0000","last_fullsized":"2024-09-10T23:30:19.681142+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:32.433094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680070+0000","last_change":"2024-09-10T23:30:18.446294+0000","last_active":"2024-09-10T23:30:19.680070+0000","last_peered":"2024-09-10T23:30:19.680070+0000","last_clean":"2024-09-10T23:30:19.680070+0000","last_became_active":"2024-09-10T23:30:18.445592+0000","last_became_peered":"2024-09-10T23:30:18.445592+0000","last_unstale":"2024-09-10T23:30:19.680070+0000","last_undegraded":"2024-09-10T23:30:19.680070+0000","last_fullsized":"2024-09-10T23:30:19.680070+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:21.909190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680832+0000","last_change":"2024-09-10T23:30:17.436646+0000","last_active":"2024-09-10T23:30:19.680832+0000","last_peered":"2024-09-10T23:30:19.680832+0000","last_clean":"2024-09-10T23:30:19.680832+0000","last_became_active":"2024-09-10T23:30:17.435895+0000","last_became_peered":"2024-09-10T23:30:17.435895+0000","last_unstale":"2024-09-10T23:30:19.680832+0000","last_undegraded":"2024-09-10T23:30:19.680832+0000","last_fullsized":"2024-09-10T23:30:19.680832+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:39.922424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680075+0000","last_change":"2024-09-10T23:30:18.433819+0000","last_active":"2024-09-10T23:30:19.680075+0000","last_peered":"2024-09-10T23:30:19.680075+0000","last_clean":"2024-09-10T23:30:19.680075+0000","last_became_active":"2024-09-10T23:30:18.433550+0000","last_became_peered":"2024-09-10T23:30:18.433550+0000","last_unstale":"2024-09-10T23:30:19.680075+0000","last_undegraded":"2024-09-10T23:30:19.680075+0000","last_fullsized":"2024-09-10T23:30:19.680075+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:34.276101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673939+0000","last_change":"2024-09-10T23:30:17.414097+0000","last_active":"2024-09-10T23:30:19.673939+0000","last_peered":"2024-09-10T23:30:19.673939+0000","last_clean":"2024-09-10T23:30:19.673939+0000","last_became_active":"2024-09-10T23:30:17.413839+0000","last_became_peered":"2024-09-10T23:30:17.413839+0000","last_unstale":"2024-09-10T23:30:19.673939+0000","last_undegraded":"2024-09-10T23:30:19.673939+0000","last_fullsized":"2024-09-10T23:30:19.673939+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673192+0000","last_change":"2024-09-10T23:30:18.435156+0000","last_active":"2024-09-10T23:30:19.673192+0000","last_peered":"2024-09-10T23:30:19.673192+0000","last_clean":"2024-09-10T23:30:19.673192+0000","last_became_active":"2024-09-10T23:30:18.434885+0000","last_became_peered":"2024-09-10T23:30:18.434885+0000","last_unstale":"2024-09-10T23:30:19.673192+0000","last_undegraded":"2024-09-10T23:30:19.673192+0000","last_fullsized":"2024-09-10T23:30:19.673192+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:08.514251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673435+0000","last_change":"2024-09-10T23:30:17.409125+0000","last_active":"2024-09-10T23:30:19.673435+0000","last_peered":"2024-09-10T23:30:19.673435+0000","last_clean":"2024-09-10T23:30:19.673435+0000","last_became_active":"2024-09-10T23:30:17.408859+0000","last_became_peered":"2024-09-10T23:30:17.408859+0000","last_unstale":"2024-09-10T23:30:19.673435+0000","last_undegraded":"2024-09-10T23:30:19.673435+0000","last_fullsized":"2024-09-10T23:30:19.673435+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408508+0000","last_change":"2024-09-10T23:30:17.408508+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408508+0000","last_undegraded":"2024-09-10T23:30:17.408508+0000","last_fullsized":"2024-09-10T23:30:17.408508+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672778+0000","last_change":"2024-09-10T23:30:17.420097+0000","last_active":"2024-09-10T23:30:19.672778+0000","last_peered":"2024-09-10T23:30:19.672778+0000","last_clean":"2024-09-10T23:30:19.672778+0000","last_became_active":"2024-09-10T23:30:17.419810+0000","last_became_peered":"2024-09-10T23:30:17.419810+0000","last_unstale":"2024-09-10T23:30:19.672778+0000","last_undegraded":"2024-09-10T23:30:19.672778+0000","last_fullsized":"2024-09-10T23:30:19.672778+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:56.936472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673368+0000","last_change":"2024-09-10T23:30:18.419771+0000","last_active":"2024-09-10T23:30:19.673368+0000","last_peered":"2024-09-10T23:30:19.673368+0000","last_clean":"2024-09-10T23:30:19.673368+0000","last_became_active":"2024-09-10T23:30:18.419502+0000","last_became_peered":"2024-09-10T23:30:18.419502+0000","last_unstale":"2024-09-10T23:30:19.673368+0000","last_undegraded":"2024-09-10T23:30:19.673368+0000","last_fullsized":"2024-09-10T23:30:19.673368+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:44.400118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681564+0000","last_change":"2024-09-10T23:30:17.425729+0000","last_active":"2024-09-10T23:30:19.681564+0000","last_peered":"2024-09-10T23:30:19.681564+0000","last_clean":"2024-09-10T23:30:19.681564+0000","last_became_active":"2024-09-10T23:30:17.425302+0000","last_became_peered":"2024-09-10T23:30:17.425302+0000","last_unstale":"2024-09-10T23:30:19.681564+0000","last_undegraded":"2024-09-10T23:30:19.681564+0000","last_fullsized":"2024-09-10T23:30:19.681564+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:56.886964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680785+0000","last_change":"2024-09-10T23:30:18.436355+0000","last_active":"2024-09-10T23:30:19.680785+0000","last_peered":"2024-09-10T23:30:19.680785+0000","last_clean":"2024-09-10T23:30:19.680785+0000","last_became_active":"2024-09-10T23:30:18.435787+0000","last_became_peered":"2024-09-10T23:30:18.435787+0000","last_unstale":"2024-09-10T23:30:19.680785+0000","last_undegraded":"2024-09-10T23:30:19.680785+0000","last_fullsized":"2024-09-10T23:30:19.680785+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:57.394499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674464+0000","last_change":"2024-09-10T23:30:17.409966+0000","last_active":"2024-09-10T23:30:19.674464+0000","last_peered":"2024-09-10T23:30:19.674464+0000","last_clean":"2024-09-10T23:30:19.674464+0000","last_became_active":"2024-09-10T23:30:17.409718+0000","last_became_peered":"2024-09-10T23:30:17.409718+0000","last_unstale":"2024-09-10T23:30:19.674464+0000","last_undegraded":"2024-09-10T23:30:19.674464+0000","last_fullsized":"2024-09-10T23:30:19.674464+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:25.771659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490949+0000","last_change":"2024-09-10T23:30:18.445113+0000","last_active":"2024-09-10T23:30:19.490949+0000","last_peered":"2024-09-10T23:30:19.490949+0000","last_clean":"2024-09-10T23:30:19.490949+0000","last_became_active":"2024-09-10T23:30:18.444854+0000","last_became_peered":"2024-09-10T23:30:18.444854+0000","last_unstale":"2024-09-10T23:30:19.490949+0000","last_undegraded":"2024-09-10T23:30:19.490949+0000","last_fullsized":"2024-09-10T23:30:19.490949+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:50.338409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674429+0000","last_change":"2024-09-10T23:30:17.421620+0000","last_active":"2024-09-10T23:30:19.674429+0000","last_peered":"2024-09-10T23:30:19.674429+0000","last_clean":"2024-09-10T23:30:19.674429+0000","last_became_active":"2024-09-10T23:30:17.421324+0000","last_became_peered":"2024-09-10T23:30:17.421324+0000","last_unstale":"2024-09-10T23:30:19.674429+0000","last_undegraded":"2024-09-10T23:30:19.674429+0000","last_fullsized":"2024-09-10T23:30:19.674429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:11.363973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673416+0000","last_change":"2024-09-10T23:30:18.424759+0000","last_active":"2024-09-10T23:30:19.673416+0000","last_peered":"2024-09-10T23:30:19.673416+0000","last_clean":"2024-09-10T23:30:19.673416+0000","last_became_active":"2024-09-10T23:30:18.424453+0000","last_became_peered":"2024-09-10T23:30:18.424453+0000","last_unstale":"2024-09-10T23:30:19.673416+0000","last_undegraded":"2024-09-10T23:30:19.673416+0000","last_fullsized":"2024-09-10T23:30:19.673416+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:47.092041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681267+0000","last_change":"2024-09-10T23:30:17.434351+0000","last_active":"2024-09-10T23:30:19.681267+0000","last_peered":"2024-09-10T23:30:19.681267+0000","last_clean":"2024-09-10T23:30:19.681267+0000","last_became_active":"2024-09-10T23:30:17.433835+0000","last_became_peered":"2024-09-10T23:30:17.433835+0000","last_unstale":"2024-09-10T23:30:19.681267+0000","last_undegraded":"2024-09-10T23:30:19.681267+0000","last_fullsized":"2024-09-10T23:30:19.681267+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:01.966013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409285+0000","last_change":"2024-09-10T23:30:17.409285+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409285+0000","last_undegraded":"2024-09-10T23:30:17.409285+0000","last_fullsized":"2024-09-10T23:30:17.409285+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680899+0000","last_change":"2024-09-10T23:30:17.429711+0000","last_active":"2024-09-10T23:30:19.680899+0000","last_peered":"2024-09-10T23:30:19.680899+0000","last_clean":"2024-09-10T23:30:19.680899+0000","last_became_active":"2024-09-10T23:30:17.429344+0000","last_became_peered":"2024-09-10T23:30:17.429344+0000","last_unstale":"2024-09-10T23:30:19.680899+0000","last_undegraded":"2024-09-10T23:30:19.680899+0000","last_fullsized":"2024-09-10T23:30:19.680899+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:38.807426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.410516+0000","last_change":"2024-09-10T23:30:17.410516+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.410516+0000","last_undegraded":"2024-09-10T23:30:17.410516+0000","last_fullsized":"2024-09-10T23:30:17.410516+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425328+0000","last_change":"2024-09-10T23:30:17.427637+0000","last_active":"2024-09-10T23:30:19.425328+0000","last_peered":"2024-09-10T23:30:19.425328+0000","last_clean":"2024-09-10T23:30:19.425328+0000","last_became_active":"2024-09-10T23:30:17.427332+0000","last_became_peered":"2024-09-10T23:30:17.427332+0000","last_unstale":"2024-09-10T23:30:19.425328+0000","last_undegraded":"2024-09-10T23:30:19.425328+0000","last_fullsized":"2024-09-10T23:30:19.425328+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:04.590063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673512+0000","last_change":"2024-09-10T23:30:18.410894+0000","last_active":"2024-09-10T23:30:19.673512+0000","last_peered":"2024-09-10T23:30:19.673512+0000","last_clean":"2024-09-10T23:30:19.673512+0000","last_became_active":"2024-09-10T23:30:18.410504+0000","last_became_peered":"2024-09-10T23:30:18.410504+0000","last_unstale":"2024-09-10T23:30:19.673512+0000","last_undegraded":"2024-09-10T23:30:19.673512+0000","last_fullsized":"2024-09-10T23:30:19.673512+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:10.502957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679898+0000","last_change":"2024-09-10T23:30:17.435618+0000","last_active":"2024-09-10T23:30:19.679898+0000","last_peered":"2024-09-10T23:30:19.679898+0000","last_clean":"2024-09-10T23:30:19.679898+0000","last_became_active":"2024-09-10T23:30:17.435326+0000","last_became_peered":"2024-09-10T23:30:17.435326+0000","last_unstale":"2024-09-10T23:30:19.679898+0000","last_undegraded":"2024-09-10T23:30:19.679898+0000","last_fullsized":"2024-09-10T23:30:19.679898+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:38.614066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680764+0000","last_change":"2024-09-10T23:30:18.447807+0000","last_active":"2024-09-10T23:30:19.680764+0000","last_peered":"2024-09-10T23:30:19.680764+0000","last_clean":"2024-09-10T23:30:19.680764+0000","last_became_active":"2024-09-10T23:30:18.446742+0000","last_became_peered":"2024-09-10T23:30:18.446742+0000","last_unstale":"2024-09-10T23:30:19.680764+0000","last_undegraded":"2024-09-10T23:30:19.680764+0000","last_fullsized":"2024-09-10T23:30:19.680764+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:42.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679936+0000","last_change":"2024-09-10T23:30:17.426703+0000","last_active":"2024-09-10T23:30:19.679936+0000","last_peered":"2024-09-10T23:30:19.679936+0000","last_clean":"2024-09-10T23:30:19.679936+0000","last_became_active":"2024-09-10T23:30:17.425405+0000","last_became_peered":"2024-09-10T23:30:17.425405+0000","last_unstale":"2024-09-10T23:30:19.679936+0000","last_undegraded":"2024-09-10T23:30:19.679936+0000","last_fullsized":"2024-09-10T23:30:19.679936+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:10.559348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411488+0000","last_change":"2024-09-10T23:30:17.411488+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411488+0000","last_undegraded":"2024-09-10T23:30:17.411488+0000","last_fullsized":"2024-09-10T23:30:17.411488+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680337+0000","last_change":"2024-09-10T23:30:17.435242+0000","last_active":"2024-09-10T23:30:19.680337+0000","last_peered":"2024-09-10T23:30:19.680337+0000","last_clean":"2024-09-10T23:30:19.680337+0000","last_became_active":"2024-09-10T23:30:17.434970+0000","last_became_peered":"2024-09-10T23:30:17.434970+0000","last_unstale":"2024-09-10T23:30:19.680337+0000","last_undegraded":"2024-09-10T23:30:19.680337+0000","last_fullsized":"2024-09-10T23:30:19.680337+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":436,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679937+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:30:19.679937+0000","last_peered":"2024-09-10T23:30:19.679937+0000","last_clean":"2024-09-10T23:30:19.679937+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:30:19.679937+0000","last_undegraded":"2024-09-10T23:30:19.679937+0000","last_fullsized":"2024-09-10T23:30:19.679937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476918,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69716,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302124,"statfs":{"total":96636764160,"available":96565374976,"internally_reserved":0,"allocated":2555904,"data_stored":1193354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509623,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70288,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301552,"statfs":{"total":96636764160,"available":96564789248,"internally_reserved":0,"allocated":3133440,"data_stored":1782656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509622,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2547712,"data_stored":1193298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509623,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73924,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297916,"statfs":{"total":96636764160,"available":96561065984,"internally_reserved":0,"allocated":2535424,"data_stored":1191706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509622,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73912,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297928,"statfs":{"total":96636764160,"available":96561078272,"internally_reserved":0,"allocated":2527232,"data_stored":1185540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509623,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2519040,"data_stored":1184924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509622,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78644,"kb_used_data":3040,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293196,"statfs":{"total":96636764160,"available":96556232704,"internally_reserved":0,"allocated":3112960,"data_stored":1775292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73832,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298008,"statfs":{"total":96636764160,"available":96561160192,"internally_reserved":0,"allocated":2506752,"data_stored":1177757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:PG 30.3d is not active+clean 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.409388+0000', 'last_change': '2024-09-10T23:30:17.409388+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.409388+0000', 'last_undegraded': '2024-09-10T23:30:17.409388+0000', 'last_fullsized': '2024-09-10T23:30:17.409388+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:PG 30.39 is not active+clean 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.411081+0000', 'last_change': '2024-09-10T23:30:17.411081+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.411081+0000', 'last_undegraded': '2024-09-10T23:30:17.411081+0000', 'last_fullsized': '2024-09-10T23:30:17.411081+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:PG 30.36 is not active+clean 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.412410+0000', 'last_change': '2024-09-10T23:30:17.412410+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.412410+0000', 'last_undegraded': '2024-09-10T23:30:17.412410+0000', 'last_fullsized': '2024-09-10T23:30:17.412410+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:PG 30.2e is not active+clean 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.411964+0000', 'last_change': '2024-09-10T23:30:17.411964+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.411964+0000', 'last_undegraded': '2024-09-10T23:30:17.411964+0000', 'last_fullsized': '2024-09-10T23:30:17.411964+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:PG 30.2b is not active+clean 2024-09-10T23:30:23.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.408998+0000', 'last_change': '2024-09-10T23:30:17.408998+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.408998+0000', 'last_undegraded': '2024-09-10T23:30:17.408998+0000', 'last_fullsized': '2024-09-10T23:30:17.408998+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:PG 30.26 is not active+clean 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.411574+0000', 'last_change': '2024-09-10T23:30:17.411574+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.411574+0000', 'last_undegraded': '2024-09-10T23:30:17.411574+0000', 'last_fullsized': '2024-09-10T23:30:17.411574+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1c is not active+clean 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.408362+0000', 'last_change': '2024-09-10T23:30:17.408362+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.408362+0000', 'last_undegraded': '2024-09-10T23:30:17.408362+0000', 'last_fullsized': '2024-09-10T23:30:17.408362+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1d is not active+clean 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.408920+0000', 'last_change': '2024-09-10T23:30:17.408920+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.408920+0000', 'last_undegraded': '2024-09-10T23:30:17.408920+0000', 'last_fullsized': '2024-09-10T23:30:17.408920+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:PG 30.18 is not active+clean 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.409688+0000', 'last_change': '2024-09-10T23:30:17.409688+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.409688+0000', 'last_undegraded': '2024-09-10T23:30:17.409688+0000', 'last_fullsized': '2024-09-10T23:30:17.409688+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:PG 30.16 is not active+clean 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.411064+0000', 'last_change': '2024-09-10T23:30:17.411064+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.411064+0000', 'last_undegraded': '2024-09-10T23:30:17.411064+0000', 'last_fullsized': '2024-09-10T23:30:17.411064+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.370 INFO:tasks.ceph.ceph_manager.ceph:PG 30.12 is not active+clean 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.411074+0000', 'last_change': '2024-09-10T23:30:17.411074+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.411074+0000', 'last_undegraded': '2024-09-10T23:30:17.411074+0000', 'last_fullsized': '2024-09-10T23:30:17.411074+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:PG 30.e is not active+clean 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.409456+0000', 'last_change': '2024-09-10T23:30:17.409456+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.409456+0000', 'last_undegraded': '2024-09-10T23:30:17.409456+0000', 'last_fullsized': '2024-09-10T23:30:17.409456+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:PG 30.b is not active+clean 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.408508+0000', 'last_change': '2024-09-10T23:30:17.408508+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.408508+0000', 'last_undegraded': '2024-09-10T23:30:17.408508+0000', 'last_fullsized': '2024-09-10T23:30:17.408508+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:PG 30.0 is not active+clean 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.409285+0000', 'last_change': '2024-09-10T23:30:17.409285+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.409285+0000', 'last_undegraded': '2024-09-10T23:30:17.409285+0000', 'last_fullsized': '2024-09-10T23:30:17.409285+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1 is not active+clean 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.410516+0000', 'last_change': '2024-09-10T23:30:17.410516+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.410516+0000', 'last_undegraded': '2024-09-10T23:30:17.410516+0000', 'last_fullsized': '2024-09-10T23:30:17.410516+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1f is not active+clean 2024-09-10T23:30:23.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 199, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:30:17.411488+0000', 'last_change': '2024-09-10T23:30:17.411488+0000', 'last_active': '2024-09-10T23:30:17.392406+0000', 'last_peered': '2024-09-10T23:30:17.392406+0000', 'last_clean': '2024-09-10T23:30:17.392406+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:30:17.411488+0000', 'last_undegraded': '2024-09-10T23:30:17.411488+0000', 'last_fullsized': '2024-09-10T23:30:17.411488+0000', 'mapping_epoch': 199, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 199, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'last_clean_scrub_stamp': '2024-09-10T23:30:17.392406+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:30:23.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:30:23.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.555+0000 7fe3d8800640 1 -- 172.21.15.17:0/1794996592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b80052f0 msgr2=0x7fe3b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.555+0000 7fe3d8800640 1 --2- 172.21.15.17:0/1794996592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b80052f0 0x7fe3b800b9d0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc006fd0 tx=0x7fe3cc01caf0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.555+0000 7fe3d8800640 1 -- 172.21.15.17:0/1794996592 shutdown_connections 2024-09-10T23:30:23.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.555+0000 7fe3d8800640 1 --2- 172.21.15.17:0/1794996592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3b80052f0 0x7fe3b800b9d0 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.555+0000 7fe3d8800640 1 -- 172.21.15.17:0/1794996592 >> 172.21.15.17:0/1794996592 conn(0x7fe3d00d1d60 msgr2=0x7fe3d00d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:23.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.555+0000 7fe3d8800640 1 -- 172.21.15.17:0/1794996592 shutdown_connections 2024-09-10T23:30:23.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.555+0000 7fe3d8800640 1 -- 172.21.15.17:0/1794996592 wait complete. 2024-09-10T23:30:23.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.555+0000 7fe3d8800640 1 Processor -- start 2024-09-10T23:30:23.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.555+0000 7fe3d8800640 1 -- start start 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d8800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b80052f0 0x7fe3d01562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d8800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d01545e0 0x7fe3d0154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d8800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d01f5ff0 0x7fe3d01f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d8800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0071240 con 0x7fe3d01545e0 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d8800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d00710c0 con 0x7fe3d01f5ff0 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d8800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d015f060 con 0x7fe3b80052f0 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d01545e0 0x7fe3d0154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d01545e0 0x7fe3d0154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41900/0 (socket says 172.21.15.17:41900) 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5400640 1 -- 172.21.15.17:0/1939321134 learned_addr learned my addr 172.21.15.17:0/1939321134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5e00640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b80052f0 0x7fe3d01562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d6800640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d01f5ff0 0x7fe3d01f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5400640 1 -- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b80052f0 msgr2=0x7fe3d01562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5400640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b80052f0 0x7fe3d01562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5400640 1 -- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d01f5ff0 msgr2=0x7fe3d01f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5400640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d01f5ff0 0x7fe3d01f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5400640 1 -- 172.21.15.17:0/1939321134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d01550a0 con 0x7fe3d01545e0 2024-09-10T23:30:23.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d5400640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d01545e0 0x7fe3d0154a60 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0006680 tx=0x7fe3c00039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:23.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3ca000640 1 -- 172.21.15.17:0/1939321134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0011700 con 0x7fe3d01545e0 2024-09-10T23:30:23.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3ca000640 1 -- 172.21.15.17:0/1939321134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3c0016020 con 0x7fe3d01545e0 2024-09-10T23:30:23.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3ca000640 1 -- 172.21.15.17:0/1939321134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0011b40 con 0x7fe3d01545e0 2024-09-10T23:30:23.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d0155380 con 0x7fe3d01545e0 2024-09-10T23:30:23.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d00c7850 con 0x7fe3d01545e0 2024-09-10T23:30:23.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.559+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d00713c0 con 0x7fe3d01545e0 2024-09-10T23:30:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.563+0000 7fe3ca000640 1 -- 172.21.15.17:0/1939321134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe3c0011ce0 con 0x7fe3d01545e0 2024-09-10T23:30:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.563+0000 7fe3ca000640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3b4072610 0x7fe3b4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.563+0000 7fe3ca000640 1 -- 172.21.15.17:0/1939321134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fe3c0093ab0 con 0x7fe3d01545e0 2024-09-10T23:30:23.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.563+0000 7fe3d5e00640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3b4072610 0x7fe3b4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.563+0000 7fe3d5e00640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3b4072610 0x7fe3b4074ad0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4005e50 tx=0x7fe3c400b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.567+0000 7fe3ca000640 1 -- 172.21.15.17:0/1939321134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe3c0020030 con 0x7fe3d01545e0 2024-09-10T23:30:23.662 INFO:tasks.ceph.mds.b.smithi077.stderr:2024-09-10T23:30:23.666+0000 7f8ecf600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:30:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.799+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe3d00c7a20 con 0x7fe3d01545e0 2024-09-10T23:30:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.799+0000 7fe3ca000640 1 -- 172.21.15.17:0/1939321134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1308 (secure 0 0 0) 0x7fe3c005eff0 con 0x7fe3d01545e0 2024-09-10T23:30:23.802 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:23.802 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":912,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":201,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"creating+peering","count":16}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592756,"bytes_used":548274176,"bytes_avail":772545839104,"bytes_total":773094113280,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":152,"btime":"2024-09-10T23:30:21:423641+0000","id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"b","status":"up:active","gid":11055}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":35,"modified":"2024-09-10T23:28:14.476145+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:30:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3b4072610 msgr2=0x7fe3b4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3b4072610 0x7fe3b4074ad0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4005e50 tx=0x7fe3c400b260 comp rx=0 tx=0).stop 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d01545e0 msgr2=0x7fe3d0154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d01545e0 0x7fe3d0154a60 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0006680 tx=0x7fe3c00039d0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 shutdown_connections 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe3b4072610 0x7fe3b4074ad0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d01f5ff0 0x7fe3d01f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3d01545e0 0x7fe3d0154a60 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 --2- 172.21.15.17:0/1939321134 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3b80052f0 0x7fe3d01562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 >> 172.21.15.17:0/1939321134 conn(0x7fe3d00d1d60 msgr2=0x7fe3d00b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 shutdown_connections 2024-09-10T23:30:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.803+0000 7fe3d8800640 1 -- 172.21.15.17:0/1939321134 wait complete. 2024-09-10T23:30:23.825 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:30:23.825 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:30:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 -- 172.21.15.17:0/1890332766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 msgr2=0x7f0b00005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 --2- 172.21.15.17:0/1890332766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 0x7f0b00005da0 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009b40 tx=0x7f0b0401d250 comp rx=0 tx=0).stop 2024-09-10T23:30:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 -- 172.21.15.17:0/1890332766 shutdown_connections 2024-09-10T23:30:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 --2- 172.21.15.17:0/1890332766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 0x7f0b00005da0 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 -- 172.21.15.17:0/1890332766 >> 172.21.15.17:0/1890332766 conn(0x7f0b1c06cfc0 msgr2=0x7f0b1c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 -- 172.21.15.17:0/1890332766 shutdown_connections 2024-09-10T23:30:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 -- 172.21.15.17:0/1890332766 wait complete. 2024-09-10T23:30:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 Processor -- start 2024-09-10T23:30:23.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 -- start start 2024-09-10T23:30:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 0x7f0b1c14fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c06efa0 0x7f0b1c1f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b1c06f400 0x7f0b1c1f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c0cf130 con 0x7f0b00005920 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c0cefb0 con 0x7f0b1c06efa0 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b22400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1c0cf2b0 con 0x7f0b1c06f400 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.971+0000 7f0b1b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 0x7f0b1c14fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b1b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 0x7f0b1c14fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41910/0 (socket says 172.21.15.17:41910) 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b1b400640 1 -- 172.21.15.17:0/950137797 learned_addr learned my addr 172.21.15.17:0/950137797 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b13e00640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c06efa0 0x7f0b1c1f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b1be00640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b1c06f400 0x7f0b1c1f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b1b400640 1 -- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b1c06f400 msgr2=0x7f0b1c1f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b1b400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b1c06f400 0x7f0b1c1f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b1b400640 1 -- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c06efa0 msgr2=0x7f0b1c1f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b1b400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c06efa0 0x7f0b1c1f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b1b400640 1 -- 172.21.15.17:0/950137797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1c150490 con 0x7f0b00005920 2024-09-10T23:30:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b13e00640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c06efa0 0x7f0b1c1f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b1b400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 0x7f0b1c14fc60 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c001840 tx=0x7f0b0c00e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b13400640 1 -- 172.21.15.17:0/950137797 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c012850 con 0x7f0b00005920 2024-09-10T23:30:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b13400640 1 -- 172.21.15.17:0/950137797 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b0c012ae0 con 0x7f0b00005920 2024-09-10T23:30:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b13400640 1 -- 172.21.15.17:0/950137797 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c01a400 con 0x7f0b00005920 2024-09-10T23:30:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1c14e710 con 0x7f0b00005920 2024-09-10T23:30:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1c14efb0 con 0x7f0b00005920 2024-09-10T23:30:23.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b1c0d0210 con 0x7f0b00005920 2024-09-10T23:30:23.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.975+0000 7f0b13400640 1 -- 172.21.15.17:0/950137797 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0b0c0113d0 con 0x7f0b00005920 2024-09-10T23:30:23.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.979+0000 7f0b13400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0af8072610 0x7f0af8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.979+0000 7f0b13400640 1 -- 172.21.15.17:0/950137797 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f0b0c096810 con 0x7f0b00005920 2024-09-10T23:30:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.979+0000 7f0b13e00640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0af8072610 0x7f0af8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.979+0000 7f0b13e00640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0af8072610 0x7f0af8074ad0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0b040ad000 tx=0x7f0b04019ff0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:23.983+0000 7f0b13400640 1 -- 172.21.15.17:0/950137797 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0b0c016030 con 0x7f0b00005920 2024-09-10T23:30:24.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.151+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b1c14e8e0 con 0x7f0af8072610 2024-09-10T23:30:24.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.155+0000 7f0b13400640 1 -- 172.21.15.17:0/950137797 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251154 (secure 0 0 0) 0x7f0b1c14e8e0 con 0x7f0af8072610 2024-09-10T23:30:24.161 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:24.162 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:30:24.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0af8072610 msgr2=0x7f0af8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:24.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0af8072610 0x7f0af8074ad0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0b040ad000 tx=0x7f0b04019ff0 comp rx=0 tx=0).stop 2024-09-10T23:30:24.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 msgr2=0x7f0b1c14fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:24.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 0x7f0b1c14fc60 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c001840 tx=0x7f0b0c00e770 comp rx=0 tx=0).stop 2024-09-10T23:30:24.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 shutdown_connections 2024-09-10T23:30:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0af8072610 0x7f0af8074ad0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0b1c06f400 0x7f0b1c1f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b1c06efa0 0x7f0b1c1f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 --2- 172.21.15.17:0/950137797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b00005920 0x7f0b1c14fc60 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 >> 172.21.15.17:0/950137797 conn(0x7f0b1c06cfc0 msgr2=0x7f0b1c15a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 shutdown_connections 2024-09-10T23:30:24.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:24.159+0000 7f0b22400640 1 -- 172.21.15.17:0/950137797 wait complete. 2024-09-10T23:30:24.181 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":644,"stamp":"2024-09-10T23:30:22.508517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":535424,"kb_used_data":20936,"kb_used_omap":12,"kb_used_meta":514291,"kb_avail":754439296,"statfs":{"total":773094113280,"available":772545839104,"internally_reserved":0,"allocated":21438464,"data_stored":10684527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":526634545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001633"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680622+0000","last_change":"2024-09-10T23:30:18.440391+0000","last_active":"2024-09-10T23:30:19.680622+0000","last_peered":"2024-09-10T23:30:19.680622+0000","last_clean":"2024-09-10T23:30:19.680622+0000","last_became_active":"2024-09-10T23:30:18.439926+0000","last_became_peered":"2024-09-10T23:30:18.439926+0000","last_unstale":"2024-09-10T23:30:19.680622+0000","last_undegraded":"2024-09-10T23:30:19.680622+0000","last_fullsized":"2024-09-10T23:30:19.680622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:44.295301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673620+0000","last_change":"2024-09-10T23:30:18.426349+0000","last_active":"2024-09-10T23:30:19.673620+0000","last_peered":"2024-09-10T23:30:19.673620+0000","last_clean":"2024-09-10T23:30:19.673620+0000","last_became_active":"2024-09-10T23:30:18.426097+0000","last_became_peered":"2024-09-10T23:30:18.426097+0000","last_unstale":"2024-09-10T23:30:19.673620+0000","last_undegraded":"2024-09-10T23:30:19.673620+0000","last_fullsized":"2024-09-10T23:30:19.673620+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.027470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409388+0000","last_change":"2024-09-10T23:30:17.409388+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409388+0000","last_undegraded":"2024-09-10T23:30:17.409388+0000","last_fullsized":"2024-09-10T23:30:17.409388+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425602+0000","last_change":"2024-09-10T23:30:18.435603+0000","last_active":"2024-09-10T23:30:19.425602+0000","last_peered":"2024-09-10T23:30:19.425602+0000","last_clean":"2024-09-10T23:30:19.425602+0000","last_became_active":"2024-09-10T23:30:18.435276+0000","last_became_peered":"2024-09-10T23:30:18.435276+0000","last_unstale":"2024-09-10T23:30:19.425602+0000","last_undegraded":"2024-09-10T23:30:19.425602+0000","last_fullsized":"2024-09-10T23:30:19.425602+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:33.263213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680433+0000","last_change":"2024-09-10T23:30:18.431319+0000","last_active":"2024-09-10T23:30:19.680433+0000","last_peered":"2024-09-10T23:30:19.680433+0000","last_clean":"2024-09-10T23:30:19.680433+0000","last_became_active":"2024-09-10T23:30:18.430960+0000","last_became_peered":"2024-09-10T23:30:18.430960+0000","last_unstale":"2024-09-10T23:30:19.680433+0000","last_undegraded":"2024-09-10T23:30:19.680433+0000","last_fullsized":"2024-09-10T23:30:19.680433+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:20.489147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:18.433402+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:18.432962+0000","last_became_peered":"2024-09-10T23:30:18.432962+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:43.563487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411081+0000","last_change":"2024-09-10T23:30:17.411081+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411081+0000","last_undegraded":"2024-09-10T23:30:17.411081+0000","last_fullsized":"2024-09-10T23:30:17.411081+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490652+0000","last_change":"2024-09-10T23:30:18.436129+0000","last_active":"2024-09-10T23:30:19.490652+0000","last_peered":"2024-09-10T23:30:19.490652+0000","last_clean":"2024-09-10T23:30:19.490652+0000","last_became_active":"2024-09-10T23:30:18.432600+0000","last_became_peered":"2024-09-10T23:30:18.432600+0000","last_unstale":"2024-09-10T23:30:19.490652+0000","last_undegraded":"2024-09-10T23:30:19.490652+0000","last_fullsized":"2024-09-10T23:30:19.490652+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:45.147222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673622+0000","last_change":"2024-09-10T23:30:18.418279+0000","last_active":"2024-09-10T23:30:19.673622+0000","last_peered":"2024-09-10T23:30:19.673622+0000","last_clean":"2024-09-10T23:30:19.673622+0000","last_became_active":"2024-09-10T23:30:18.418016+0000","last_became_peered":"2024-09-10T23:30:18.418016+0000","last_unstale":"2024-09-10T23:30:19.673622+0000","last_undegraded":"2024-09-10T23:30:19.673622+0000","last_fullsized":"2024-09-10T23:30:19.673622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:28.041686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.412410+0000","last_change":"2024-09-10T23:30:17.412410+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.412410+0000","last_undegraded":"2024-09-10T23:30:17.412410+0000","last_fullsized":"2024-09-10T23:30:17.412410+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425855+0000","last_change":"2024-09-10T23:30:18.430324+0000","last_active":"2024-09-10T23:30:19.425855+0000","last_peered":"2024-09-10T23:30:19.425855+0000","last_clean":"2024-09-10T23:30:19.425855+0000","last_became_active":"2024-09-10T23:30:18.429990+0000","last_became_peered":"2024-09-10T23:30:18.429990+0000","last_unstale":"2024-09-10T23:30:19.425855+0000","last_undegraded":"2024-09-10T23:30:19.425855+0000","last_fullsized":"2024-09-10T23:30:19.425855+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:57.601597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680462+0000","last_change":"2024-09-10T23:30:18.445466+0000","last_active":"2024-09-10T23:30:19.680462+0000","last_peered":"2024-09-10T23:30:19.680462+0000","last_clean":"2024-09-10T23:30:19.680462+0000","last_became_active":"2024-09-10T23:30:18.443772+0000","last_became_peered":"2024-09-10T23:30:18.443772+0000","last_unstale":"2024-09-10T23:30:19.680462+0000","last_undegraded":"2024-09-10T23:30:19.680462+0000","last_fullsized":"2024-09-10T23:30:19.680462+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:57.665627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490827+0000","last_change":"2024-09-10T23:30:18.434628+0000","last_active":"2024-09-10T23:30:19.490827+0000","last_peered":"2024-09-10T23:30:19.490827+0000","last_clean":"2024-09-10T23:30:19.490827+0000","last_became_active":"2024-09-10T23:30:18.434323+0000","last_became_peered":"2024-09-10T23:30:18.434323+0000","last_unstale":"2024-09-10T23:30:19.490827+0000","last_undegraded":"2024-09-10T23:30:19.490827+0000","last_fullsized":"2024-09-10T23:30:19.490827+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:44.464168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680538+0000","last_change":"2024-09-10T23:30:18.438166+0000","last_active":"2024-09-10T23:30:19.680538+0000","last_peered":"2024-09-10T23:30:19.680538+0000","last_clean":"2024-09-10T23:30:19.680538+0000","last_became_active":"2024-09-10T23:30:18.437380+0000","last_became_peered":"2024-09-10T23:30:18.437380+0000","last_unstale":"2024-09-10T23:30:19.680538+0000","last_undegraded":"2024-09-10T23:30:19.680538+0000","last_fullsized":"2024-09-10T23:30:19.680538+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:38.346963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673187+0000","last_change":"2024-09-10T23:30:18.419876+0000","last_active":"2024-09-10T23:30:19.673187+0000","last_peered":"2024-09-10T23:30:19.673187+0000","last_clean":"2024-09-10T23:30:19.673187+0000","last_became_active":"2024-09-10T23:30:18.419619+0000","last_became_peered":"2024-09-10T23:30:18.419619+0000","last_unstale":"2024-09-10T23:30:19.673187+0000","last_undegraded":"2024-09-10T23:30:19.673187+0000","last_fullsized":"2024-09-10T23:30:19.673187+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:10.606290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490788+0000","last_change":"2024-09-10T23:30:18.432783+0000","last_active":"2024-09-10T23:30:19.490788+0000","last_peered":"2024-09-10T23:30:19.490788+0000","last_clean":"2024-09-10T23:30:19.490788+0000","last_became_active":"2024-09-10T23:30:18.432259+0000","last_became_peered":"2024-09-10T23:30:18.432259+0000","last_unstale":"2024-09-10T23:30:19.490788+0000","last_undegraded":"2024-09-10T23:30:19.490788+0000","last_fullsized":"2024-09-10T23:30:19.490788+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:26.774814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681405+0000","last_change":"2024-09-10T23:30:18.448718+0000","last_active":"2024-09-10T23:30:19.681405+0000","last_peered":"2024-09-10T23:30:19.681405+0000","last_clean":"2024-09-10T23:30:19.681405+0000","last_became_active":"2024-09-10T23:30:18.446844+0000","last_became_peered":"2024-09-10T23:30:18.446844+0000","last_unstale":"2024-09-10T23:30:19.681405+0000","last_undegraded":"2024-09-10T23:30:19.681405+0000","last_fullsized":"2024-09-10T23:30:19.681405+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:29.166857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411964+0000","last_change":"2024-09-10T23:30:17.411964+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411964+0000","last_undegraded":"2024-09-10T23:30:17.411964+0000","last_fullsized":"2024-09-10T23:30:17.411964+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680532+0000","last_change":"2024-09-10T23:30:18.438704+0000","last_active":"2024-09-10T23:30:19.680532+0000","last_peered":"2024-09-10T23:30:19.680532+0000","last_clean":"2024-09-10T23:30:19.680532+0000","last_became_active":"2024-09-10T23:30:18.436192+0000","last_became_peered":"2024-09-10T23:30:18.436192+0000","last_unstale":"2024-09-10T23:30:19.680532+0000","last_undegraded":"2024-09-10T23:30:19.680532+0000","last_fullsized":"2024-09-10T23:30:19.680532+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:20.225885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491096+0000","last_change":"2024-09-10T23:30:18.434226+0000","last_active":"2024-09-10T23:30:19.491096+0000","last_peered":"2024-09-10T23:30:19.491096+0000","last_clean":"2024-09-10T23:30:19.491096+0000","last_became_active":"2024-09-10T23:30:18.433919+0000","last_became_peered":"2024-09-10T23:30:18.433919+0000","last_unstale":"2024-09-10T23:30:19.491096+0000","last_undegraded":"2024-09-10T23:30:19.491096+0000","last_fullsized":"2024-09-10T23:30:19.491096+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.591952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408998+0000","last_change":"2024-09-10T23:30:17.408998+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408998+0000","last_undegraded":"2024-09-10T23:30:17.408998+0000","last_fullsized":"2024-09-10T23:30:17.408998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673766+0000","last_change":"2024-09-10T23:30:18.432090+0000","last_active":"2024-09-10T23:30:19.673766+0000","last_peered":"2024-09-10T23:30:19.673766+0000","last_clean":"2024-09-10T23:30:19.673766+0000","last_became_active":"2024-09-10T23:30:18.430309+0000","last_became_peered":"2024-09-10T23:30:18.430309+0000","last_unstale":"2024-09-10T23:30:19.673766+0000","last_undegraded":"2024-09-10T23:30:19.673766+0000","last_fullsized":"2024-09-10T23:30:19.673766+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:26.449042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672993+0000","last_change":"2024-09-10T23:30:18.419267+0000","last_active":"2024-09-10T23:30:19.672993+0000","last_peered":"2024-09-10T23:30:19.672993+0000","last_clean":"2024-09-10T23:30:19.672993+0000","last_became_active":"2024-09-10T23:30:18.418970+0000","last_became_peered":"2024-09-10T23:30:18.418970+0000","last_unstale":"2024-09-10T23:30:19.672993+0000","last_undegraded":"2024-09-10T23:30:19.672993+0000","last_fullsized":"2024-09-10T23:30:19.672993+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:12.054872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680124+0000","last_change":"2024-09-10T23:30:18.430296+0000","last_active":"2024-09-10T23:30:19.680124+0000","last_peered":"2024-09-10T23:30:19.680124+0000","last_clean":"2024-09-10T23:30:19.680124+0000","last_became_active":"2024-09-10T23:30:18.430015+0000","last_became_peered":"2024-09-10T23:30:18.430015+0000","last_unstale":"2024-09-10T23:30:19.680124+0000","last_undegraded":"2024-09-10T23:30:19.680124+0000","last_fullsized":"2024-09-10T23:30:19.680124+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:43.868057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680876+0000","last_change":"2024-09-10T23:30:18.436029+0000","last_active":"2024-09-10T23:30:19.680876+0000","last_peered":"2024-09-10T23:30:19.680876+0000","last_clean":"2024-09-10T23:30:19.680876+0000","last_became_active":"2024-09-10T23:30:18.435737+0000","last_became_peered":"2024-09-10T23:30:18.435737+0000","last_unstale":"2024-09-10T23:30:19.680876+0000","last_undegraded":"2024-09-10T23:30:19.680876+0000","last_fullsized":"2024-09-10T23:30:19.680876+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:59.131863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411574+0000","last_change":"2024-09-10T23:30:17.411574+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411574+0000","last_undegraded":"2024-09-10T23:30:17.411574+0000","last_fullsized":"2024-09-10T23:30:17.411574+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425917+0000","last_change":"2024-09-10T23:30:18.434286+0000","last_active":"2024-09-10T23:30:19.425917+0000","last_peered":"2024-09-10T23:30:19.425917+0000","last_clean":"2024-09-10T23:30:19.425917+0000","last_became_active":"2024-09-10T23:30:18.434031+0000","last_became_peered":"2024-09-10T23:30:18.434031+0000","last_unstale":"2024-09-10T23:30:19.425917+0000","last_undegraded":"2024-09-10T23:30:19.425917+0000","last_fullsized":"2024-09-10T23:30:19.425917+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:13.918980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681217+0000","last_change":"2024-09-10T23:30:18.430415+0000","last_active":"2024-09-10T23:30:19.681217+0000","last_peered":"2024-09-10T23:30:19.681217+0000","last_clean":"2024-09-10T23:30:19.681217+0000","last_became_active":"2024-09-10T23:30:18.430059+0000","last_became_peered":"2024-09-10T23:30:18.430059+0000","last_unstale":"2024-09-10T23:30:19.681217+0000","last_undegraded":"2024-09-10T23:30:19.681217+0000","last_fullsized":"2024-09-10T23:30:19.681217+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:14.451454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673314+0000","last_change":"2024-09-10T23:30:18.436833+0000","last_active":"2024-09-10T23:30:19.673314+0000","last_peered":"2024-09-10T23:30:19.673314+0000","last_clean":"2024-09-10T23:30:19.673314+0000","last_became_active":"2024-09-10T23:30:18.436385+0000","last_became_peered":"2024-09-10T23:30:18.436385+0000","last_unstale":"2024-09-10T23:30:19.673314+0000","last_undegraded":"2024-09-10T23:30:19.673314+0000","last_fullsized":"2024-09-10T23:30:19.673314+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:48.896976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490730+0000","last_change":"2024-09-10T23:30:18.443963+0000","last_active":"2024-09-10T23:30:19.490730+0000","last_peered":"2024-09-10T23:30:19.490730+0000","last_clean":"2024-09-10T23:30:19.490730+0000","last_became_active":"2024-09-10T23:30:18.443624+0000","last_became_peered":"2024-09-10T23:30:18.443624+0000","last_unstale":"2024-09-10T23:30:19.490730+0000","last_undegraded":"2024-09-10T23:30:19.490730+0000","last_fullsized":"2024-09-10T23:30:19.490730+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:12.367128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673197+0000","last_change":"2024-09-10T23:30:18.426364+0000","last_active":"2024-09-10T23:30:19.673197+0000","last_peered":"2024-09-10T23:30:19.673197+0000","last_clean":"2024-09-10T23:30:19.673197+0000","last_became_active":"2024-09-10T23:30:18.426089+0000","last_became_peered":"2024-09-10T23:30:18.426089+0000","last_unstale":"2024-09-10T23:30:19.673197+0000","last_undegraded":"2024-09-10T23:30:19.673197+0000","last_fullsized":"2024-09-10T23:30:19.673197+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:54.103650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490986+0000","last_change":"2024-09-10T23:30:18.442390+0000","last_active":"2024-09-10T23:30:19.490986+0000","last_peered":"2024-09-10T23:30:19.490986+0000","last_clean":"2024-09-10T23:30:19.490986+0000","last_became_active":"2024-09-10T23:30:18.442008+0000","last_became_peered":"2024-09-10T23:30:18.442008+0000","last_unstale":"2024-09-10T23:30:19.490986+0000","last_undegraded":"2024-09-10T23:30:19.490986+0000","last_fullsized":"2024-09-10T23:30:19.490986+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:18.297755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408362+0000","last_change":"2024-09-10T23:30:17.408362+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408362+0000","last_undegraded":"2024-09-10T23:30:17.408362+0000","last_fullsized":"2024-09-10T23:30:17.408362+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"200'4","reported_seq":19,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673771+0000","last_change":"2024-09-10T23:30:17.428407+0000","last_active":"2024-09-10T23:30:19.673771+0000","last_peered":"2024-09-10T23:30:19.673771+0000","last_clean":"2024-09-10T23:30:19.673771+0000","last_became_active":"2024-09-10T23:30:17.428095+0000","last_became_peered":"2024-09-10T23:30:17.428095+0000","last_unstale":"2024-09-10T23:30:19.673771+0000","last_undegraded":"2024-09-10T23:30:19.673771+0000","last_fullsized":"2024-09-10T23:30:19.673771+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:44.817383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408920+0000","last_change":"2024-09-10T23:30:17.408920+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408920+0000","last_undegraded":"2024-09-10T23:30:17.408920+0000","last_fullsized":"2024-09-10T23:30:17.408920+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681483+0000","last_change":"2024-09-10T23:30:17.435885+0000","last_active":"2024-09-10T23:30:19.681483+0000","last_peered":"2024-09-10T23:30:19.681483+0000","last_clean":"2024-09-10T23:30:19.681483+0000","last_became_active":"2024-09-10T23:30:17.435638+0000","last_became_peered":"2024-09-10T23:30:17.435638+0000","last_unstale":"2024-09-10T23:30:19.681483+0000","last_undegraded":"2024-09-10T23:30:19.681483+0000","last_fullsized":"2024-09-10T23:30:19.681483+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:28.443604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681443+0000","last_change":"2024-09-10T23:30:18.446032+0000","last_active":"2024-09-10T23:30:19.681443+0000","last_peered":"2024-09-10T23:30:19.681443+0000","last_clean":"2024-09-10T23:30:19.681443+0000","last_became_active":"2024-09-10T23:30:18.445739+0000","last_became_peered":"2024-09-10T23:30:18.445739+0000","last_unstale":"2024-09-10T23:30:19.681443+0000","last_undegraded":"2024-09-10T23:30:19.681443+0000","last_fullsized":"2024-09-10T23:30:19.681443+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.138384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:17.426662+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:17.426379+0000","last_became_peered":"2024-09-10T23:30:17.426379+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:31.377540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409688+0000","last_change":"2024-09-10T23:30:17.409688+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409688+0000","last_undegraded":"2024-09-10T23:30:17.409688+0000","last_fullsized":"2024-09-10T23:30:17.409688+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674268+0000","last_change":"2024-09-10T23:30:17.424648+0000","last_active":"2024-09-10T23:30:19.674268+0000","last_peered":"2024-09-10T23:30:19.674268+0000","last_clean":"2024-09-10T23:30:19.674268+0000","last_became_active":"2024-09-10T23:30:17.424309+0000","last_became_peered":"2024-09-10T23:30:17.424309+0000","last_unstale":"2024-09-10T23:30:19.674268+0000","last_undegraded":"2024-09-10T23:30:19.674268+0000","last_fullsized":"2024-09-10T23:30:19.674268+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:44.144068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679901+0000","last_change":"2024-09-10T23:30:18.437987+0000","last_active":"2024-09-10T23:30:19.679901+0000","last_peered":"2024-09-10T23:30:19.679901+0000","last_clean":"2024-09-10T23:30:19.679901+0000","last_became_active":"2024-09-10T23:30:18.437707+0000","last_became_peered":"2024-09-10T23:30:18.437707+0000","last_unstale":"2024-09-10T23:30:19.679901+0000","last_undegraded":"2024-09-10T23:30:19.679901+0000","last_fullsized":"2024-09-10T23:30:19.679901+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:52.657720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680192+0000","last_change":"2024-09-10T23:30:17.438669+0000","last_active":"2024-09-10T23:30:19.680192+0000","last_peered":"2024-09-10T23:30:19.680192+0000","last_clean":"2024-09-10T23:30:19.680192+0000","last_became_active":"2024-09-10T23:30:17.438383+0000","last_became_peered":"2024-09-10T23:30:17.438383+0000","last_unstale":"2024-09-10T23:30:19.680192+0000","last_undegraded":"2024-09-10T23:30:19.680192+0000","last_fullsized":"2024-09-10T23:30:19.680192+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:58.970215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674014+0000","last_change":"2024-09-10T23:30:18.430231+0000","last_active":"2024-09-10T23:30:19.674014+0000","last_peered":"2024-09-10T23:30:19.674014+0000","last_clean":"2024-09-10T23:30:19.674014+0000","last_became_active":"2024-09-10T23:30:18.429920+0000","last_became_peered":"2024-09-10T23:30:18.429920+0000","last_unstale":"2024-09-10T23:30:19.674014+0000","last_undegraded":"2024-09-10T23:30:19.674014+0000","last_fullsized":"2024-09-10T23:30:19.674014+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:42.713962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425230+0000","last_change":"2024-09-10T23:30:17.425766+0000","last_active":"2024-09-10T23:30:19.425230+0000","last_peered":"2024-09-10T23:30:19.425230+0000","last_clean":"2024-09-10T23:30:19.425230+0000","last_became_active":"2024-09-10T23:30:17.424967+0000","last_became_peered":"2024-09-10T23:30:17.424967+0000","last_unstale":"2024-09-10T23:30:19.425230+0000","last_undegraded":"2024-09-10T23:30:19.425230+0000","last_fullsized":"2024-09-10T23:30:19.425230+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:55.277369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673775+0000","last_change":"2024-09-10T23:30:18.427654+0000","last_active":"2024-09-10T23:30:19.673775+0000","last_peered":"2024-09-10T23:30:19.673775+0000","last_clean":"2024-09-10T23:30:19.673775+0000","last_became_active":"2024-09-10T23:30:18.427356+0000","last_became_peered":"2024-09-10T23:30:18.427356+0000","last_unstale":"2024-09-10T23:30:19.673775+0000","last_undegraded":"2024-09-10T23:30:19.673775+0000","last_fullsized":"2024-09-10T23:30:19.673775+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:35.999756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-10T23:30:17.420337+0000","last_change":"2024-09-10T23:30:17.418976+0000","last_active":"2024-09-10T23:30:17.420337+0000","last_peered":"2024-09-10T23:30:17.420337+0000","last_clean":"2024-09-10T23:30:17.420337+0000","last_became_active":"2024-09-10T23:30:17.418442+0000","last_became_peered":"2024-09-10T23:30:17.418442+0000","last_unstale":"2024-09-10T23:30:17.420337+0000","last_undegraded":"2024-09-10T23:30:17.420337+0000","last_fullsized":"2024-09-10T23:30:17.420337+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.309934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674418+0000","last_change":"2024-09-10T23:30:18.425119+0000","last_active":"2024-09-10T23:30:19.674418+0000","last_peered":"2024-09-10T23:30:19.674418+0000","last_clean":"2024-09-10T23:30:19.674418+0000","last_became_active":"2024-09-10T23:30:18.424853+0000","last_became_peered":"2024-09-10T23:30:18.424853+0000","last_unstale":"2024-09-10T23:30:19.674418+0000","last_undegraded":"2024-09-10T23:30:19.674418+0000","last_fullsized":"2024-09-10T23:30:19.674418+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:31.576971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681004+0000","last_change":"2024-09-10T23:30:17.436490+0000","last_active":"2024-09-10T23:30:19.681004+0000","last_peered":"2024-09-10T23:30:19.681004+0000","last_clean":"2024-09-10T23:30:19.681004+0000","last_became_active":"2024-09-10T23:30:17.436203+0000","last_became_peered":"2024-09-10T23:30:17.436203+0000","last_unstale":"2024-09-10T23:30:19.681004+0000","last_undegraded":"2024-09-10T23:30:19.681004+0000","last_fullsized":"2024-09-10T23:30:19.681004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674470+0000","last_change":"2024-09-10T23:30:18.427676+0000","last_active":"2024-09-10T23:30:19.674470+0000","last_peered":"2024-09-10T23:30:19.674470+0000","last_clean":"2024-09-10T23:30:19.674470+0000","last_became_active":"2024-09-10T23:30:18.425145+0000","last_became_peered":"2024-09-10T23:30:18.425145+0000","last_unstale":"2024-09-10T23:30:19.674470+0000","last_undegraded":"2024-09-10T23:30:19.674470+0000","last_fullsized":"2024-09-10T23:30:19.674470+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425913+0000","last_change":"2024-09-10T23:30:17.431896+0000","last_active":"2024-09-10T23:30:19.425913+0000","last_peered":"2024-09-10T23:30:19.425913+0000","last_clean":"2024-09-10T23:30:19.425913+0000","last_became_active":"2024-09-10T23:30:17.430852+0000","last_became_peered":"2024-09-10T23:30:17.430852+0000","last_unstale":"2024-09-10T23:30:19.425913+0000","last_undegraded":"2024-09-10T23:30:19.425913+0000","last_fullsized":"2024-09-10T23:30:19.425913+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:03.399968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411064+0000","last_change":"2024-09-10T23:30:17.411064+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411064+0000","last_undegraded":"2024-09-10T23:30:17.411064+0000","last_fullsized":"2024-09-10T23:30:17.411064+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"200'3","reported_seq":18,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680857+0000","last_change":"2024-09-10T23:30:17.437999+0000","last_active":"2024-09-10T23:30:19.680857+0000","last_peered":"2024-09-10T23:30:19.680857+0000","last_clean":"2024-09-10T23:30:19.680857+0000","last_became_active":"2024-09-10T23:30:17.437724+0000","last_became_peered":"2024-09-10T23:30:17.437724+0000","last_unstale":"2024-09-10T23:30:19.680857+0000","last_undegraded":"2024-09-10T23:30:19.680857+0000","last_fullsized":"2024-09-10T23:30:19.680857+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:35.934846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.426144+0000","last_change":"2024-09-10T23:30:18.431666+0000","last_active":"2024-09-10T23:30:19.426144+0000","last_peered":"2024-09-10T23:30:19.426144+0000","last_clean":"2024-09-10T23:30:19.426144+0000","last_became_active":"2024-09-10T23:30:18.431392+0000","last_became_peered":"2024-09-10T23:30:18.431392+0000","last_unstale":"2024-09-10T23:30:19.426144+0000","last_undegraded":"2024-09-10T23:30:19.426144+0000","last_fullsized":"2024-09-10T23:30:19.426144+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:05.543871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"200'6","reported_seq":21,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491058+0000","last_change":"2024-09-10T23:30:17.427136+0000","last_active":"2024-09-10T23:30:19.491058+0000","last_peered":"2024-09-10T23:30:19.491058+0000","last_clean":"2024-09-10T23:30:19.491058+0000","last_became_active":"2024-09-10T23:30:17.426720+0000","last_became_peered":"2024-09-10T23:30:17.426720+0000","last_unstale":"2024-09-10T23:30:19.491058+0000","last_undegraded":"2024-09-10T23:30:19.491058+0000","last_fullsized":"2024-09-10T23:30:19.491058+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:42.586081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672998+0000","last_change":"2024-09-10T23:30:18.436906+0000","last_active":"2024-09-10T23:30:19.672998+0000","last_peered":"2024-09-10T23:30:19.672998+0000","last_clean":"2024-09-10T23:30:19.672998+0000","last_became_active":"2024-09-10T23:30:18.436447+0000","last_became_peered":"2024-09-10T23:30:18.436447+0000","last_unstale":"2024-09-10T23:30:19.672998+0000","last_undegraded":"2024-09-10T23:30:19.672998+0000","last_fullsized":"2024-09-10T23:30:19.672998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680784+0000","last_change":"2024-09-10T23:30:17.428623+0000","last_active":"2024-09-10T23:30:19.680784+0000","last_peered":"2024-09-10T23:30:19.680784+0000","last_clean":"2024-09-10T23:30:19.680784+0000","last_became_active":"2024-09-10T23:30:17.428332+0000","last_became_peered":"2024-09-10T23:30:17.428332+0000","last_unstale":"2024-09-10T23:30:19.680784+0000","last_undegraded":"2024-09-10T23:30:19.680784+0000","last_fullsized":"2024-09-10T23:30:19.680784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:44.204111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680358+0000","last_change":"2024-09-10T23:30:18.444027+0000","last_active":"2024-09-10T23:30:19.680358+0000","last_peered":"2024-09-10T23:30:19.680358+0000","last_clean":"2024-09-10T23:30:19.680358+0000","last_became_active":"2024-09-10T23:30:18.443479+0000","last_became_peered":"2024-09-10T23:30:18.443479+0000","last_unstale":"2024-09-10T23:30:19.680358+0000","last_undegraded":"2024-09-10T23:30:19.680358+0000","last_fullsized":"2024-09-10T23:30:19.680358+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:15.469850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673380+0000","last_change":"2024-09-10T23:30:17.417961+0000","last_active":"2024-09-10T23:30:19.673380+0000","last_peered":"2024-09-10T23:30:19.673380+0000","last_clean":"2024-09-10T23:30:19.673380+0000","last_became_active":"2024-09-10T23:30:17.417683+0000","last_became_peered":"2024-09-10T23:30:17.417683+0000","last_unstale":"2024-09-10T23:30:19.673380+0000","last_undegraded":"2024-09-10T23:30:19.673380+0000","last_fullsized":"2024-09-10T23:30:19.673380+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:45:55.340081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411074+0000","last_change":"2024-09-10T23:30:17.411074+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411074+0000","last_undegraded":"2024-09-10T23:30:17.411074+0000","last_fullsized":"2024-09-10T23:30:17.411074+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490429+0000","last_change":"2024-09-10T23:30:17.425540+0000","last_active":"2024-09-10T23:30:19.490429+0000","last_peered":"2024-09-10T23:30:19.490429+0000","last_clean":"2024-09-10T23:30:19.490429+0000","last_became_active":"2024-09-10T23:30:17.425256+0000","last_became_peered":"2024-09-10T23:30:17.425256+0000","last_unstale":"2024-09-10T23:30:19.490429+0000","last_undegraded":"2024-09-10T23:30:19.490429+0000","last_fullsized":"2024-09-10T23:30:19.490429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:37.019557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674115+0000","last_change":"2024-09-10T23:30:18.425671+0000","last_active":"2024-09-10T23:30:19.674115+0000","last_peered":"2024-09-10T23:30:19.674115+0000","last_clean":"2024-09-10T23:30:19.674115+0000","last_became_active":"2024-09-10T23:30:18.424769+0000","last_became_peered":"2024-09-10T23:30:18.424769+0000","last_unstale":"2024-09-10T23:30:19.674115+0000","last_undegraded":"2024-09-10T23:30:19.674115+0000","last_fullsized":"2024-09-10T23:30:19.674115+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:39.771480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"200'8","reported_seq":23,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679790+0000","last_change":"2024-09-10T23:30:17.425625+0000","last_active":"2024-09-10T23:30:19.679790+0000","last_peered":"2024-09-10T23:30:19.679790+0000","last_clean":"2024-09-10T23:30:19.679790+0000","last_became_active":"2024-09-10T23:30:17.425348+0000","last_became_peered":"2024-09-10T23:30:17.425348+0000","last_unstale":"2024-09-10T23:30:19.679790+0000","last_undegraded":"2024-09-10T23:30:19.679790+0000","last_fullsized":"2024-09-10T23:30:19.679790+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:53.025824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673146+0000","last_change":"2024-09-10T23:30:18.428571+0000","last_active":"2024-09-10T23:30:19.673146+0000","last_peered":"2024-09-10T23:30:19.673146+0000","last_clean":"2024-09-10T23:30:19.673146+0000","last_became_active":"2024-09-10T23:30:18.427496+0000","last_became_peered":"2024-09-10T23:30:18.427496+0000","last_unstale":"2024-09-10T23:30:19.673146+0000","last_undegraded":"2024-09-10T23:30:19.673146+0000","last_fullsized":"2024-09-10T23:30:19.673146+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:25.149316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-10T23:30:17.424153+0000","last_change":"2024-09-10T23:30:17.423434+0000","last_active":"2024-09-10T23:30:17.424153+0000","last_peered":"2024-09-10T23:30:17.424153+0000","last_clean":"2024-09-10T23:30:17.424153+0000","last_became_active":"2024-09-10T23:30:17.423143+0000","last_became_peered":"2024-09-10T23:30:17.423143+0000","last_unstale":"2024-09-10T23:30:17.424153+0000","last_undegraded":"2024-09-10T23:30:17.424153+0000","last_fullsized":"2024-09-10T23:30:17.424153+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:25.958953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680725+0000","last_change":"2024-09-10T23:30:18.442899+0000","last_active":"2024-09-10T23:30:19.680725+0000","last_peered":"2024-09-10T23:30:19.680725+0000","last_clean":"2024-09-10T23:30:19.680725+0000","last_became_active":"2024-09-10T23:30:18.442642+0000","last_became_peered":"2024-09-10T23:30:18.442642+0000","last_unstale":"2024-09-10T23:30:19.680725+0000","last_undegraded":"2024-09-10T23:30:19.680725+0000","last_fullsized":"2024-09-10T23:30:19.680725+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:09.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673407+0000","last_change":"2024-09-10T23:30:17.419308+0000","last_active":"2024-09-10T23:30:19.673407+0000","last_peered":"2024-09-10T23:30:19.673407+0000","last_clean":"2024-09-10T23:30:19.673407+0000","last_became_active":"2024-09-10T23:30:17.419027+0000","last_became_peered":"2024-09-10T23:30:17.419027+0000","last_unstale":"2024-09-10T23:30:19.673407+0000","last_undegraded":"2024-09-10T23:30:19.673407+0000","last_fullsized":"2024-09-10T23:30:19.673407+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:37.201310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409456+0000","last_change":"2024-09-10T23:30:17.409456+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409456+0000","last_undegraded":"2024-09-10T23:30:17.409456+0000","last_fullsized":"2024-09-10T23:30:17.409456+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681143+0000","last_change":"2024-09-10T23:30:17.427272+0000","last_active":"2024-09-10T23:30:19.681143+0000","last_peered":"2024-09-10T23:30:19.681143+0000","last_clean":"2024-09-10T23:30:19.681143+0000","last_became_active":"2024-09-10T23:30:17.426898+0000","last_became_peered":"2024-09-10T23:30:17.426898+0000","last_unstale":"2024-09-10T23:30:19.681143+0000","last_undegraded":"2024-09-10T23:30:19.681143+0000","last_fullsized":"2024-09-10T23:30:19.681143+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:17.943545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681625+0000","last_change":"2024-09-10T23:30:18.442632+0000","last_active":"2024-09-10T23:30:19.681625+0000","last_peered":"2024-09-10T23:30:19.681625+0000","last_clean":"2024-09-10T23:30:19.681625+0000","last_became_active":"2024-09-10T23:30:18.442386+0000","last_became_peered":"2024-09-10T23:30:18.442386+0000","last_unstale":"2024-09-10T23:30:19.681625+0000","last_undegraded":"2024-09-10T23:30:19.681625+0000","last_fullsized":"2024-09-10T23:30:19.681625+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:48.604686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681142+0000","last_change":"2024-09-10T23:30:17.427578+0000","last_active":"2024-09-10T23:30:19.681142+0000","last_peered":"2024-09-10T23:30:19.681142+0000","last_clean":"2024-09-10T23:30:19.681142+0000","last_became_active":"2024-09-10T23:30:17.424863+0000","last_became_peered":"2024-09-10T23:30:17.424863+0000","last_unstale":"2024-09-10T23:30:19.681142+0000","last_undegraded":"2024-09-10T23:30:19.681142+0000","last_fullsized":"2024-09-10T23:30:19.681142+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:32.433094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680070+0000","last_change":"2024-09-10T23:30:18.446294+0000","last_active":"2024-09-10T23:30:19.680070+0000","last_peered":"2024-09-10T23:30:19.680070+0000","last_clean":"2024-09-10T23:30:19.680070+0000","last_became_active":"2024-09-10T23:30:18.445592+0000","last_became_peered":"2024-09-10T23:30:18.445592+0000","last_unstale":"2024-09-10T23:30:19.680070+0000","last_undegraded":"2024-09-10T23:30:19.680070+0000","last_fullsized":"2024-09-10T23:30:19.680070+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:21.909190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680832+0000","last_change":"2024-09-10T23:30:17.436646+0000","last_active":"2024-09-10T23:30:19.680832+0000","last_peered":"2024-09-10T23:30:19.680832+0000","last_clean":"2024-09-10T23:30:19.680832+0000","last_became_active":"2024-09-10T23:30:17.435895+0000","last_became_peered":"2024-09-10T23:30:17.435895+0000","last_unstale":"2024-09-10T23:30:19.680832+0000","last_undegraded":"2024-09-10T23:30:19.680832+0000","last_fullsized":"2024-09-10T23:30:19.680832+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:39.922424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680075+0000","last_change":"2024-09-10T23:30:18.433819+0000","last_active":"2024-09-10T23:30:19.680075+0000","last_peered":"2024-09-10T23:30:19.680075+0000","last_clean":"2024-09-10T23:30:19.680075+0000","last_became_active":"2024-09-10T23:30:18.433550+0000","last_became_peered":"2024-09-10T23:30:18.433550+0000","last_unstale":"2024-09-10T23:30:19.680075+0000","last_undegraded":"2024-09-10T23:30:19.680075+0000","last_fullsized":"2024-09-10T23:30:19.680075+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:34.276101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673939+0000","last_change":"2024-09-10T23:30:17.414097+0000","last_active":"2024-09-10T23:30:19.673939+0000","last_peered":"2024-09-10T23:30:19.673939+0000","last_clean":"2024-09-10T23:30:19.673939+0000","last_became_active":"2024-09-10T23:30:17.413839+0000","last_became_peered":"2024-09-10T23:30:17.413839+0000","last_unstale":"2024-09-10T23:30:19.673939+0000","last_undegraded":"2024-09-10T23:30:19.673939+0000","last_fullsized":"2024-09-10T23:30:19.673939+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673192+0000","last_change":"2024-09-10T23:30:18.435156+0000","last_active":"2024-09-10T23:30:19.673192+0000","last_peered":"2024-09-10T23:30:19.673192+0000","last_clean":"2024-09-10T23:30:19.673192+0000","last_became_active":"2024-09-10T23:30:18.434885+0000","last_became_peered":"2024-09-10T23:30:18.434885+0000","last_unstale":"2024-09-10T23:30:19.673192+0000","last_undegraded":"2024-09-10T23:30:19.673192+0000","last_fullsized":"2024-09-10T23:30:19.673192+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:08.514251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673435+0000","last_change":"2024-09-10T23:30:17.409125+0000","last_active":"2024-09-10T23:30:19.673435+0000","last_peered":"2024-09-10T23:30:19.673435+0000","last_clean":"2024-09-10T23:30:19.673435+0000","last_became_active":"2024-09-10T23:30:17.408859+0000","last_became_peered":"2024-09-10T23:30:17.408859+0000","last_unstale":"2024-09-10T23:30:19.673435+0000","last_undegraded":"2024-09-10T23:30:19.673435+0000","last_fullsized":"2024-09-10T23:30:19.673435+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.408508+0000","last_change":"2024-09-10T23:30:17.408508+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.408508+0000","last_undegraded":"2024-09-10T23:30:17.408508+0000","last_fullsized":"2024-09-10T23:30:17.408508+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672778+0000","last_change":"2024-09-10T23:30:17.420097+0000","last_active":"2024-09-10T23:30:19.672778+0000","last_peered":"2024-09-10T23:30:19.672778+0000","last_clean":"2024-09-10T23:30:19.672778+0000","last_became_active":"2024-09-10T23:30:17.419810+0000","last_became_peered":"2024-09-10T23:30:17.419810+0000","last_unstale":"2024-09-10T23:30:19.672778+0000","last_undegraded":"2024-09-10T23:30:19.672778+0000","last_fullsized":"2024-09-10T23:30:19.672778+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:56.936472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673368+0000","last_change":"2024-09-10T23:30:18.419771+0000","last_active":"2024-09-10T23:30:19.673368+0000","last_peered":"2024-09-10T23:30:19.673368+0000","last_clean":"2024-09-10T23:30:19.673368+0000","last_became_active":"2024-09-10T23:30:18.419502+0000","last_became_peered":"2024-09-10T23:30:18.419502+0000","last_unstale":"2024-09-10T23:30:19.673368+0000","last_undegraded":"2024-09-10T23:30:19.673368+0000","last_fullsized":"2024-09-10T23:30:19.673368+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:44.400118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681564+0000","last_change":"2024-09-10T23:30:17.425729+0000","last_active":"2024-09-10T23:30:19.681564+0000","last_peered":"2024-09-10T23:30:19.681564+0000","last_clean":"2024-09-10T23:30:19.681564+0000","last_became_active":"2024-09-10T23:30:17.425302+0000","last_became_peered":"2024-09-10T23:30:17.425302+0000","last_unstale":"2024-09-10T23:30:19.681564+0000","last_undegraded":"2024-09-10T23:30:19.681564+0000","last_fullsized":"2024-09-10T23:30:19.681564+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:56.886964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680785+0000","last_change":"2024-09-10T23:30:18.436355+0000","last_active":"2024-09-10T23:30:19.680785+0000","last_peered":"2024-09-10T23:30:19.680785+0000","last_clean":"2024-09-10T23:30:19.680785+0000","last_became_active":"2024-09-10T23:30:18.435787+0000","last_became_peered":"2024-09-10T23:30:18.435787+0000","last_unstale":"2024-09-10T23:30:19.680785+0000","last_undegraded":"2024-09-10T23:30:19.680785+0000","last_fullsized":"2024-09-10T23:30:19.680785+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:57.394499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674464+0000","last_change":"2024-09-10T23:30:17.409966+0000","last_active":"2024-09-10T23:30:19.674464+0000","last_peered":"2024-09-10T23:30:19.674464+0000","last_clean":"2024-09-10T23:30:19.674464+0000","last_became_active":"2024-09-10T23:30:17.409718+0000","last_became_peered":"2024-09-10T23:30:17.409718+0000","last_unstale":"2024-09-10T23:30:19.674464+0000","last_undegraded":"2024-09-10T23:30:19.674464+0000","last_fullsized":"2024-09-10T23:30:19.674464+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:25.771659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490949+0000","last_change":"2024-09-10T23:30:18.445113+0000","last_active":"2024-09-10T23:30:19.490949+0000","last_peered":"2024-09-10T23:30:19.490949+0000","last_clean":"2024-09-10T23:30:19.490949+0000","last_became_active":"2024-09-10T23:30:18.444854+0000","last_became_peered":"2024-09-10T23:30:18.444854+0000","last_unstale":"2024-09-10T23:30:19.490949+0000","last_undegraded":"2024-09-10T23:30:19.490949+0000","last_fullsized":"2024-09-10T23:30:19.490949+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:50.338409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674429+0000","last_change":"2024-09-10T23:30:17.421620+0000","last_active":"2024-09-10T23:30:19.674429+0000","last_peered":"2024-09-10T23:30:19.674429+0000","last_clean":"2024-09-10T23:30:19.674429+0000","last_became_active":"2024-09-10T23:30:17.421324+0000","last_became_peered":"2024-09-10T23:30:17.421324+0000","last_unstale":"2024-09-10T23:30:19.674429+0000","last_undegraded":"2024-09-10T23:30:19.674429+0000","last_fullsized":"2024-09-10T23:30:19.674429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:11.363973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673416+0000","last_change":"2024-09-10T23:30:18.424759+0000","last_active":"2024-09-10T23:30:19.673416+0000","last_peered":"2024-09-10T23:30:19.673416+0000","last_clean":"2024-09-10T23:30:19.673416+0000","last_became_active":"2024-09-10T23:30:18.424453+0000","last_became_peered":"2024-09-10T23:30:18.424453+0000","last_unstale":"2024-09-10T23:30:19.673416+0000","last_undegraded":"2024-09-10T23:30:19.673416+0000","last_fullsized":"2024-09-10T23:30:19.673416+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:47.092041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681267+0000","last_change":"2024-09-10T23:30:17.434351+0000","last_active":"2024-09-10T23:30:19.681267+0000","last_peered":"2024-09-10T23:30:19.681267+0000","last_clean":"2024-09-10T23:30:19.681267+0000","last_became_active":"2024-09-10T23:30:17.433835+0000","last_became_peered":"2024-09-10T23:30:17.433835+0000","last_unstale":"2024-09-10T23:30:19.681267+0000","last_undegraded":"2024-09-10T23:30:19.681267+0000","last_fullsized":"2024-09-10T23:30:19.681267+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:01.966013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.409285+0000","last_change":"2024-09-10T23:30:17.409285+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.409285+0000","last_undegraded":"2024-09-10T23:30:17.409285+0000","last_fullsized":"2024-09-10T23:30:17.409285+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680899+0000","last_change":"2024-09-10T23:30:17.429711+0000","last_active":"2024-09-10T23:30:19.680899+0000","last_peered":"2024-09-10T23:30:19.680899+0000","last_clean":"2024-09-10T23:30:19.680899+0000","last_became_active":"2024-09-10T23:30:17.429344+0000","last_became_peered":"2024-09-10T23:30:17.429344+0000","last_unstale":"2024-09-10T23:30:19.680899+0000","last_undegraded":"2024-09-10T23:30:19.680899+0000","last_fullsized":"2024-09-10T23:30:19.680899+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:38.807426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.410516+0000","last_change":"2024-09-10T23:30:17.410516+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.410516+0000","last_undegraded":"2024-09-10T23:30:17.410516+0000","last_fullsized":"2024-09-10T23:30:17.410516+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425328+0000","last_change":"2024-09-10T23:30:17.427637+0000","last_active":"2024-09-10T23:30:19.425328+0000","last_peered":"2024-09-10T23:30:19.425328+0000","last_clean":"2024-09-10T23:30:19.425328+0000","last_became_active":"2024-09-10T23:30:17.427332+0000","last_became_peered":"2024-09-10T23:30:17.427332+0000","last_unstale":"2024-09-10T23:30:19.425328+0000","last_undegraded":"2024-09-10T23:30:19.425328+0000","last_fullsized":"2024-09-10T23:30:19.425328+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:04.590063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673512+0000","last_change":"2024-09-10T23:30:18.410894+0000","last_active":"2024-09-10T23:30:19.673512+0000","last_peered":"2024-09-10T23:30:19.673512+0000","last_clean":"2024-09-10T23:30:19.673512+0000","last_became_active":"2024-09-10T23:30:18.410504+0000","last_became_peered":"2024-09-10T23:30:18.410504+0000","last_unstale":"2024-09-10T23:30:19.673512+0000","last_undegraded":"2024-09-10T23:30:19.673512+0000","last_fullsized":"2024-09-10T23:30:19.673512+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:10.502957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679898+0000","last_change":"2024-09-10T23:30:17.435618+0000","last_active":"2024-09-10T23:30:19.679898+0000","last_peered":"2024-09-10T23:30:19.679898+0000","last_clean":"2024-09-10T23:30:19.679898+0000","last_became_active":"2024-09-10T23:30:17.435326+0000","last_became_peered":"2024-09-10T23:30:17.435326+0000","last_unstale":"2024-09-10T23:30:19.679898+0000","last_undegraded":"2024-09-10T23:30:19.679898+0000","last_fullsized":"2024-09-10T23:30:19.679898+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:38.614066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680764+0000","last_change":"2024-09-10T23:30:18.447807+0000","last_active":"2024-09-10T23:30:19.680764+0000","last_peered":"2024-09-10T23:30:19.680764+0000","last_clean":"2024-09-10T23:30:19.680764+0000","last_became_active":"2024-09-10T23:30:18.446742+0000","last_became_peered":"2024-09-10T23:30:18.446742+0000","last_unstale":"2024-09-10T23:30:19.680764+0000","last_undegraded":"2024-09-10T23:30:19.680764+0000","last_fullsized":"2024-09-10T23:30:19.680764+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:42.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679936+0000","last_change":"2024-09-10T23:30:17.426703+0000","last_active":"2024-09-10T23:30:19.679936+0000","last_peered":"2024-09-10T23:30:19.679936+0000","last_clean":"2024-09-10T23:30:19.679936+0000","last_became_active":"2024-09-10T23:30:17.425405+0000","last_became_peered":"2024-09-10T23:30:17.425405+0000","last_unstale":"2024-09-10T23:30:19.679936+0000","last_undegraded":"2024-09-10T23:30:19.679936+0000","last_fullsized":"2024-09-10T23:30:19.679936+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:10.559348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2024-09-10T23:30:17.411488+0000","last_change":"2024-09-10T23:30:17.411488+0000","last_active":"2024-09-10T23:30:17.392406+0000","last_peered":"2024-09-10T23:30:17.392406+0000","last_clean":"2024-09-10T23:30:17.392406+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:30:17.411488+0000","last_undegraded":"2024-09-10T23:30:17.411488+0000","last_fullsized":"2024-09-10T23:30:17.411488+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680337+0000","last_change":"2024-09-10T23:30:17.435242+0000","last_active":"2024-09-10T23:30:19.680337+0000","last_peered":"2024-09-10T23:30:19.680337+0000","last_clean":"2024-09-10T23:30:19.680337+0000","last_became_active":"2024-09-10T23:30:17.434970+0000","last_became_peered":"2024-09-10T23:30:17.434970+0000","last_unstale":"2024-09-10T23:30:19.680337+0000","last_undegraded":"2024-09-10T23:30:19.680337+0000","last_fullsized":"2024-09-10T23:30:19.680337+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":436,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679937+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:30:19.679937+0000","last_peered":"2024-09-10T23:30:19.679937+0000","last_clean":"2024-09-10T23:30:19.679937+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:30:19.679937+0000","last_undegraded":"2024-09-10T23:30:19.679937+0000","last_fullsized":"2024-09-10T23:30:19.679937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476918,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69716,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302124,"statfs":{"total":96636764160,"available":96565374976,"internally_reserved":0,"allocated":2555904,"data_stored":1193354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509623,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70288,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301552,"statfs":{"total":96636764160,"available":96564789248,"internally_reserved":0,"allocated":3133440,"data_stored":1782656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509622,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2547712,"data_stored":1193298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509623,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73924,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297916,"statfs":{"total":96636764160,"available":96561065984,"internally_reserved":0,"allocated":2535424,"data_stored":1191706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509622,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73912,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297928,"statfs":{"total":96636764160,"available":96561078272,"internally_reserved":0,"allocated":2527232,"data_stored":1185540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509623,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2519040,"data_stored":1184924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509622,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78644,"kb_used_data":3040,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293196,"statfs":{"total":96636764160,"available":96556232704,"internally_reserved":0,"allocated":3112960,"data_stored":1775292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73832,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298008,"statfs":{"total":96636764160,"available":96561160192,"internally_reserved":0,"allocated":2506752,"data_stored":1177757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:30:27.187 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:30:27.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.343+0000 7fd0bb000640 1 -- 172.21.15.17:0/641685432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0b40d0200 msgr2=0x7fd0b40b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.343+0000 7fd0bb000640 1 --2- 172.21.15.17:0/641685432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0b40d0200 0x7fd0b40b1d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009870 tx=0x7fd0ac01f050 comp rx=0 tx=0).stop 2024-09-10T23:30:27.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 -- 172.21.15.17:0/641685432 shutdown_connections 2024-09-10T23:30:27.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 --2- 172.21.15.17:0/641685432 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0b40d0200 0x7fd0b40b1d20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 -- 172.21.15.17:0/641685432 >> 172.21.15.17:0/641685432 conn(0x7fd0b40d1d10 msgr2=0x7fd0b40d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:27.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 -- 172.21.15.17:0/641685432 shutdown_connections 2024-09-10T23:30:27.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 -- 172.21.15.17:0/641685432 wait complete. 2024-09-10T23:30:27.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 Processor -- start 2024-09-10T23:30:27.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 -- start start 2024-09-10T23:30:27.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b40d0200 0x7fd0b40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0b40d2830 0x7fd0b406f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b4160280 0x7fd0b4070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b40b2260 con 0x7fd0b4160280 2024-09-10T23:30:27.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b40b07c0 con 0x7fd0b40d0200 2024-09-10T23:30:27.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0bb000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b40b23e0 con 0x7fd0b40d2830 2024-09-10T23:30:27.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b9000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b4160280 0x7fd0b4070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b9000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b4160280 0x7fd0b4070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45300/0 (socket says 172.21.15.17:45300) 2024-09-10T23:30:27.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b9000640 1 -- 172.21.15.17:0/3900243641 learned_addr learned my addr 172.21.15.17:0/3900243641 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:27.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b3e00640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b40d0200 0x7fd0b40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0ab400640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0b40d2830 0x7fd0b406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b9000640 1 -- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0b40d2830 msgr2=0x7fd0b406f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b9000640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0b40d2830 0x7fd0b406f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b9000640 1 -- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b40d0200 msgr2=0x7fd0b40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b9000640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b40d0200 0x7fd0b40cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b9000640 1 -- 172.21.15.17:0/3900243641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b41f57c0 con 0x7fd0b4160280 2024-09-10T23:30:27.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.347+0000 7fd0b9000640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b4160280 0x7fd0b4070f20 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0b3040 tx=0x7fd0ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0b0c00640 1 -- 172.21.15.17:0/3900243641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0be070 con 0x7fd0b4160280 2024-09-10T23:30:27.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0b0c00640 1 -- 172.21.15.17:0/3900243641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0ac005320 con 0x7fd0b4160280 2024-09-10T23:30:27.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0b0c00640 1 -- 172.21.15.17:0/3900243641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac0b5040 con 0x7fd0b4160280 2024-09-10T23:30:27.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b40c7d30 con 0x7fd0b4160280 2024-09-10T23:30:27.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b41f4ce0 con 0x7fd0b4160280 2024-09-10T23:30:27.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b40b28d0 con 0x7fd0b4160280 2024-09-10T23:30:27.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0b0c00640 1 -- 172.21.15.17:0/3900243641 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd0ac0b8070 con 0x7fd0b4160280 2024-09-10T23:30:27.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0b0c00640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0900725e0 0x7fd090074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0b0c00640 1 -- 172.21.15.17:0/3900243641 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fd0ac12ff40 con 0x7fd0b4160280 2024-09-10T23:30:27.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.351+0000 7fd0b3e00640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0900725e0 0x7fd090074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.355+0000 7fd0b3e00640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0900725e0 0x7fd090074aa0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40014b0 tx=0x7fd0a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.355+0000 7fd0b0c00640 1 -- 172.21.15.17:0/3900243641 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd0ac018bb0 con 0x7fd0b4160280 2024-09-10T23:30:27.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.527+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0b40b5960 con 0x7fd0900725e0 2024-09-10T23:30:27.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.535+0000 7fd0b0c00640 1 -- 172.21.15.17:0/3900243641 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252390 (secure 0 0 0) 0x7fd0b40b5960 con 0x7fd0900725e0 2024-09-10T23:30:27.538 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:27.539 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0900725e0 msgr2=0x7fd090074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0900725e0 0x7fd090074aa0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40014b0 tx=0x7fd0a4009040 comp rx=0 tx=0).stop 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b4160280 msgr2=0x7fd0b4070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b4160280 0x7fd0b4070f20 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0b3040 tx=0x7fd0ac004600 comp rx=0 tx=0).stop 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 shutdown_connections 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd0900725e0 0x7fd090074aa0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0b4160280 0x7fd0b4070f20 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd0b40d2830 0x7fd0b406f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 --2- 172.21.15.17:0/3900243641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0b40d0200 0x7fd0b40cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 >> 172.21.15.17:0/3900243641 conn(0x7fd0b40d1d10 msgr2=0x7fd0b40b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 shutdown_connections 2024-09-10T23:30:27.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.539+0000 7fd0bb000640 1 -- 172.21.15.17:0/3900243641 wait complete. 2024-09-10T23:30:27.559 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":646,"stamp":"2024-09-10T23:30:26.509634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":535500,"kb_used_data":21000,"kb_used_omap":12,"kb_used_meta":514291,"kb_avail":754439220,"statfs":{"total":773094113280,"available":772545761280,"internally_reserved":0,"allocated":21504000,"data_stored":10718484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":526634545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.100706"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680622+0000","last_change":"2024-09-10T23:30:18.440391+0000","last_active":"2024-09-10T23:30:19.680622+0000","last_peered":"2024-09-10T23:30:19.680622+0000","last_clean":"2024-09-10T23:30:19.680622+0000","last_became_active":"2024-09-10T23:30:18.439926+0000","last_became_peered":"2024-09-10T23:30:18.439926+0000","last_unstale":"2024-09-10T23:30:19.680622+0000","last_undegraded":"2024-09-10T23:30:19.680622+0000","last_fullsized":"2024-09-10T23:30:19.680622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:44.295301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673620+0000","last_change":"2024-09-10T23:30:18.426349+0000","last_active":"2024-09-10T23:30:19.673620+0000","last_peered":"2024-09-10T23:30:19.673620+0000","last_clean":"2024-09-10T23:30:19.673620+0000","last_became_active":"2024-09-10T23:30:18.426097+0000","last_became_peered":"2024-09-10T23:30:18.426097+0000","last_unstale":"2024-09-10T23:30:19.673620+0000","last_undegraded":"2024-09-10T23:30:19.673620+0000","last_fullsized":"2024-09-10T23:30:19.673620+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:09:42.027470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.417806+0000","last_change":"2024-09-10T23:30:18.427936+0000","last_active":"2024-09-10T23:30:19.417806+0000","last_peered":"2024-09-10T23:30:19.417806+0000","last_clean":"2024-09-10T23:30:19.417806+0000","last_became_active":"2024-09-10T23:30:18.427677+0000","last_became_peered":"2024-09-10T23:30:18.427677+0000","last_unstale":"2024-09-10T23:30:19.417806+0000","last_undegraded":"2024-09-10T23:30:19.417806+0000","last_fullsized":"2024-09-10T23:30:19.417806+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:53:00.950342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425602+0000","last_change":"2024-09-10T23:30:18.435603+0000","last_active":"2024-09-10T23:30:19.425602+0000","last_peered":"2024-09-10T23:30:19.425602+0000","last_clean":"2024-09-10T23:30:19.425602+0000","last_became_active":"2024-09-10T23:30:18.435276+0000","last_became_peered":"2024-09-10T23:30:18.435276+0000","last_unstale":"2024-09-10T23:30:19.425602+0000","last_undegraded":"2024-09-10T23:30:19.425602+0000","last_fullsized":"2024-09-10T23:30:19.425602+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:33.263213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680433+0000","last_change":"2024-09-10T23:30:18.431319+0000","last_active":"2024-09-10T23:30:19.680433+0000","last_peered":"2024-09-10T23:30:19.680433+0000","last_clean":"2024-09-10T23:30:19.680433+0000","last_became_active":"2024-09-10T23:30:18.430960+0000","last_became_peered":"2024-09-10T23:30:18.430960+0000","last_unstale":"2024-09-10T23:30:19.680433+0000","last_undegraded":"2024-09-10T23:30:19.680433+0000","last_fullsized":"2024-09-10T23:30:19.680433+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:02:20.489147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:18.433402+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:18.432962+0000","last_became_peered":"2024-09-10T23:30:18.432962+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:43.563487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418186+0000","last_change":"2024-09-10T23:30:18.431200+0000","last_active":"2024-09-10T23:30:19.418186+0000","last_peered":"2024-09-10T23:30:19.418186+0000","last_clean":"2024-09-10T23:30:19.418186+0000","last_became_active":"2024-09-10T23:30:18.430813+0000","last_became_peered":"2024-09-10T23:30:18.430813+0000","last_unstale":"2024-09-10T23:30:19.418186+0000","last_undegraded":"2024-09-10T23:30:19.418186+0000","last_fullsized":"2024-09-10T23:30:19.418186+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:41.101418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490652+0000","last_change":"2024-09-10T23:30:18.436129+0000","last_active":"2024-09-10T23:30:19.490652+0000","last_peered":"2024-09-10T23:30:19.490652+0000","last_clean":"2024-09-10T23:30:19.490652+0000","last_became_active":"2024-09-10T23:30:18.432600+0000","last_became_peered":"2024-09-10T23:30:18.432600+0000","last_unstale":"2024-09-10T23:30:19.490652+0000","last_undegraded":"2024-09-10T23:30:19.490652+0000","last_fullsized":"2024-09-10T23:30:19.490652+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:45.147222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673622+0000","last_change":"2024-09-10T23:30:18.418279+0000","last_active":"2024-09-10T23:30:19.673622+0000","last_peered":"2024-09-10T23:30:19.673622+0000","last_clean":"2024-09-10T23:30:19.673622+0000","last_became_active":"2024-09-10T23:30:18.418016+0000","last_became_peered":"2024-09-10T23:30:18.418016+0000","last_unstale":"2024-09-10T23:30:19.673622+0000","last_undegraded":"2024-09-10T23:30:19.673622+0000","last_fullsized":"2024-09-10T23:30:19.673622+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:28.041686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418315+0000","last_change":"2024-09-10T23:30:18.432423+0000","last_active":"2024-09-10T23:30:19.418315+0000","last_peered":"2024-09-10T23:30:19.418315+0000","last_clean":"2024-09-10T23:30:19.418315+0000","last_became_active":"2024-09-10T23:30:18.431829+0000","last_became_peered":"2024-09-10T23:30:18.431829+0000","last_unstale":"2024-09-10T23:30:19.418315+0000","last_undegraded":"2024-09-10T23:30:19.418315+0000","last_fullsized":"2024-09-10T23:30:19.418315+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:09.565718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425855+0000","last_change":"2024-09-10T23:30:18.430324+0000","last_active":"2024-09-10T23:30:19.425855+0000","last_peered":"2024-09-10T23:30:19.425855+0000","last_clean":"2024-09-10T23:30:19.425855+0000","last_became_active":"2024-09-10T23:30:18.429990+0000","last_became_peered":"2024-09-10T23:30:18.429990+0000","last_unstale":"2024-09-10T23:30:19.425855+0000","last_undegraded":"2024-09-10T23:30:19.425855+0000","last_fullsized":"2024-09-10T23:30:19.425855+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:57.601597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680462+0000","last_change":"2024-09-10T23:30:18.445466+0000","last_active":"2024-09-10T23:30:19.680462+0000","last_peered":"2024-09-10T23:30:19.680462+0000","last_clean":"2024-09-10T23:30:19.680462+0000","last_became_active":"2024-09-10T23:30:18.443772+0000","last_became_peered":"2024-09-10T23:30:18.443772+0000","last_unstale":"2024-09-10T23:30:19.680462+0000","last_undegraded":"2024-09-10T23:30:19.680462+0000","last_fullsized":"2024-09-10T23:30:19.680462+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:57.665627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490827+0000","last_change":"2024-09-10T23:30:18.434628+0000","last_active":"2024-09-10T23:30:19.490827+0000","last_peered":"2024-09-10T23:30:19.490827+0000","last_clean":"2024-09-10T23:30:19.490827+0000","last_became_active":"2024-09-10T23:30:18.434323+0000","last_became_peered":"2024-09-10T23:30:18.434323+0000","last_unstale":"2024-09-10T23:30:19.490827+0000","last_undegraded":"2024-09-10T23:30:19.490827+0000","last_fullsized":"2024-09-10T23:30:19.490827+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:44.464168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680538+0000","last_change":"2024-09-10T23:30:18.438166+0000","last_active":"2024-09-10T23:30:19.680538+0000","last_peered":"2024-09-10T23:30:19.680538+0000","last_clean":"2024-09-10T23:30:19.680538+0000","last_became_active":"2024-09-10T23:30:18.437380+0000","last_became_peered":"2024-09-10T23:30:18.437380+0000","last_unstale":"2024-09-10T23:30:19.680538+0000","last_undegraded":"2024-09-10T23:30:19.680538+0000","last_fullsized":"2024-09-10T23:30:19.680538+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:38.346963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673187+0000","last_change":"2024-09-10T23:30:18.419876+0000","last_active":"2024-09-10T23:30:19.673187+0000","last_peered":"2024-09-10T23:30:19.673187+0000","last_clean":"2024-09-10T23:30:19.673187+0000","last_became_active":"2024-09-10T23:30:18.419619+0000","last_became_peered":"2024-09-10T23:30:18.419619+0000","last_unstale":"2024-09-10T23:30:19.673187+0000","last_undegraded":"2024-09-10T23:30:19.673187+0000","last_fullsized":"2024-09-10T23:30:19.673187+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:10.606290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490788+0000","last_change":"2024-09-10T23:30:18.432783+0000","last_active":"2024-09-10T23:30:19.490788+0000","last_peered":"2024-09-10T23:30:19.490788+0000","last_clean":"2024-09-10T23:30:19.490788+0000","last_became_active":"2024-09-10T23:30:18.432259+0000","last_became_peered":"2024-09-10T23:30:18.432259+0000","last_unstale":"2024-09-10T23:30:19.490788+0000","last_undegraded":"2024-09-10T23:30:19.490788+0000","last_fullsized":"2024-09-10T23:30:19.490788+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:26.774814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681405+0000","last_change":"2024-09-10T23:30:18.448718+0000","last_active":"2024-09-10T23:30:19.681405+0000","last_peered":"2024-09-10T23:30:19.681405+0000","last_clean":"2024-09-10T23:30:19.681405+0000","last_became_active":"2024-09-10T23:30:18.446844+0000","last_became_peered":"2024-09-10T23:30:18.446844+0000","last_unstale":"2024-09-10T23:30:19.681405+0000","last_undegraded":"2024-09-10T23:30:19.681405+0000","last_fullsized":"2024-09-10T23:30:19.681405+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:59:29.166857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418434+0000","last_change":"2024-09-10T23:30:18.432689+0000","last_active":"2024-09-10T23:30:19.418434+0000","last_peered":"2024-09-10T23:30:19.418434+0000","last_clean":"2024-09-10T23:30:19.418434+0000","last_became_active":"2024-09-10T23:30:18.432168+0000","last_became_peered":"2024-09-10T23:30:18.432168+0000","last_unstale":"2024-09-10T23:30:19.418434+0000","last_undegraded":"2024-09-10T23:30:19.418434+0000","last_fullsized":"2024-09-10T23:30:19.418434+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:23.668181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680532+0000","last_change":"2024-09-10T23:30:18.438704+0000","last_active":"2024-09-10T23:30:19.680532+0000","last_peered":"2024-09-10T23:30:19.680532+0000","last_clean":"2024-09-10T23:30:19.680532+0000","last_became_active":"2024-09-10T23:30:18.436192+0000","last_became_peered":"2024-09-10T23:30:18.436192+0000","last_unstale":"2024-09-10T23:30:19.680532+0000","last_undegraded":"2024-09-10T23:30:19.680532+0000","last_fullsized":"2024-09-10T23:30:19.680532+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:20.225885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491096+0000","last_change":"2024-09-10T23:30:18.434226+0000","last_active":"2024-09-10T23:30:19.491096+0000","last_peered":"2024-09-10T23:30:19.491096+0000","last_clean":"2024-09-10T23:30:19.491096+0000","last_became_active":"2024-09-10T23:30:18.433919+0000","last_became_peered":"2024-09-10T23:30:18.433919+0000","last_unstale":"2024-09-10T23:30:19.491096+0000","last_undegraded":"2024-09-10T23:30:19.491096+0000","last_fullsized":"2024-09-10T23:30:19.491096+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.591952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.417758+0000","last_change":"2024-09-10T23:30:18.424982+0000","last_active":"2024-09-10T23:30:19.417758+0000","last_peered":"2024-09-10T23:30:19.417758+0000","last_clean":"2024-09-10T23:30:19.417758+0000","last_became_active":"2024-09-10T23:30:18.424707+0000","last_became_peered":"2024-09-10T23:30:18.424707+0000","last_unstale":"2024-09-10T23:30:19.417758+0000","last_undegraded":"2024-09-10T23:30:19.417758+0000","last_fullsized":"2024-09-10T23:30:19.417758+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:03.834987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673766+0000","last_change":"2024-09-10T23:30:18.432090+0000","last_active":"2024-09-10T23:30:19.673766+0000","last_peered":"2024-09-10T23:30:19.673766+0000","last_clean":"2024-09-10T23:30:19.673766+0000","last_became_active":"2024-09-10T23:30:18.430309+0000","last_became_peered":"2024-09-10T23:30:18.430309+0000","last_unstale":"2024-09-10T23:30:19.673766+0000","last_undegraded":"2024-09-10T23:30:19.673766+0000","last_fullsized":"2024-09-10T23:30:19.673766+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:26.449042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672993+0000","last_change":"2024-09-10T23:30:18.419267+0000","last_active":"2024-09-10T23:30:19.672993+0000","last_peered":"2024-09-10T23:30:19.672993+0000","last_clean":"2024-09-10T23:30:19.672993+0000","last_became_active":"2024-09-10T23:30:18.418970+0000","last_became_peered":"2024-09-10T23:30:18.418970+0000","last_unstale":"2024-09-10T23:30:19.672993+0000","last_undegraded":"2024-09-10T23:30:19.672993+0000","last_fullsized":"2024-09-10T23:30:19.672993+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:12.054872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680124+0000","last_change":"2024-09-10T23:30:18.430296+0000","last_active":"2024-09-10T23:30:19.680124+0000","last_peered":"2024-09-10T23:30:19.680124+0000","last_clean":"2024-09-10T23:30:19.680124+0000","last_became_active":"2024-09-10T23:30:18.430015+0000","last_became_peered":"2024-09-10T23:30:18.430015+0000","last_unstale":"2024-09-10T23:30:19.680124+0000","last_undegraded":"2024-09-10T23:30:19.680124+0000","last_fullsized":"2024-09-10T23:30:19.680124+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:27:43.868057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680876+0000","last_change":"2024-09-10T23:30:18.436029+0000","last_active":"2024-09-10T23:30:19.680876+0000","last_peered":"2024-09-10T23:30:19.680876+0000","last_clean":"2024-09-10T23:30:19.680876+0000","last_became_active":"2024-09-10T23:30:18.435737+0000","last_became_peered":"2024-09-10T23:30:18.435737+0000","last_unstale":"2024-09-10T23:30:19.680876+0000","last_undegraded":"2024-09-10T23:30:19.680876+0000","last_fullsized":"2024-09-10T23:30:19.680876+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:59.131863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418520+0000","last_change":"2024-09-10T23:30:18.440078+0000","last_active":"2024-09-10T23:30:19.418520+0000","last_peered":"2024-09-10T23:30:19.418520+0000","last_clean":"2024-09-10T23:30:19.418520+0000","last_became_active":"2024-09-10T23:30:18.439804+0000","last_became_peered":"2024-09-10T23:30:18.439804+0000","last_unstale":"2024-09-10T23:30:19.418520+0000","last_undegraded":"2024-09-10T23:30:19.418520+0000","last_fullsized":"2024-09-10T23:30:19.418520+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:54.759944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425917+0000","last_change":"2024-09-10T23:30:18.434286+0000","last_active":"2024-09-10T23:30:19.425917+0000","last_peered":"2024-09-10T23:30:19.425917+0000","last_clean":"2024-09-10T23:30:19.425917+0000","last_became_active":"2024-09-10T23:30:18.434031+0000","last_became_peered":"2024-09-10T23:30:18.434031+0000","last_unstale":"2024-09-10T23:30:19.425917+0000","last_undegraded":"2024-09-10T23:30:19.425917+0000","last_fullsized":"2024-09-10T23:30:19.425917+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:13.918980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681217+0000","last_change":"2024-09-10T23:30:18.430415+0000","last_active":"2024-09-10T23:30:19.681217+0000","last_peered":"2024-09-10T23:30:19.681217+0000","last_clean":"2024-09-10T23:30:19.681217+0000","last_became_active":"2024-09-10T23:30:18.430059+0000","last_became_peered":"2024-09-10T23:30:18.430059+0000","last_unstale":"2024-09-10T23:30:19.681217+0000","last_undegraded":"2024-09-10T23:30:19.681217+0000","last_fullsized":"2024-09-10T23:30:19.681217+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:56:14.451454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673314+0000","last_change":"2024-09-10T23:30:18.436833+0000","last_active":"2024-09-10T23:30:19.673314+0000","last_peered":"2024-09-10T23:30:19.673314+0000","last_clean":"2024-09-10T23:30:19.673314+0000","last_became_active":"2024-09-10T23:30:18.436385+0000","last_became_peered":"2024-09-10T23:30:18.436385+0000","last_unstale":"2024-09-10T23:30:19.673314+0000","last_undegraded":"2024-09-10T23:30:19.673314+0000","last_fullsized":"2024-09-10T23:30:19.673314+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:48.896976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490730+0000","last_change":"2024-09-10T23:30:18.443963+0000","last_active":"2024-09-10T23:30:19.490730+0000","last_peered":"2024-09-10T23:30:19.490730+0000","last_clean":"2024-09-10T23:30:19.490730+0000","last_became_active":"2024-09-10T23:30:18.443624+0000","last_became_peered":"2024-09-10T23:30:18.443624+0000","last_unstale":"2024-09-10T23:30:19.490730+0000","last_undegraded":"2024-09-10T23:30:19.490730+0000","last_fullsized":"2024-09-10T23:30:19.490730+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:12.367128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673197+0000","last_change":"2024-09-10T23:30:18.426364+0000","last_active":"2024-09-10T23:30:19.673197+0000","last_peered":"2024-09-10T23:30:19.673197+0000","last_clean":"2024-09-10T23:30:19.673197+0000","last_became_active":"2024-09-10T23:30:18.426089+0000","last_became_peered":"2024-09-10T23:30:18.426089+0000","last_unstale":"2024-09-10T23:30:19.673197+0000","last_undegraded":"2024-09-10T23:30:19.673197+0000","last_fullsized":"2024-09-10T23:30:19.673197+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:54.103650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490986+0000","last_change":"2024-09-10T23:30:18.442390+0000","last_active":"2024-09-10T23:30:19.490986+0000","last_peered":"2024-09-10T23:30:19.490986+0000","last_clean":"2024-09-10T23:30:19.490986+0000","last_became_active":"2024-09-10T23:30:18.442008+0000","last_became_peered":"2024-09-10T23:30:18.442008+0000","last_unstale":"2024-09-10T23:30:19.490986+0000","last_undegraded":"2024-09-10T23:30:19.490986+0000","last_fullsized":"2024-09-10T23:30:19.490986+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:18.297755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.417909+0000","last_change":"2024-09-10T23:30:18.432218+0000","last_active":"2024-09-10T23:30:19.417909+0000","last_peered":"2024-09-10T23:30:19.417909+0000","last_clean":"2024-09-10T23:30:19.417909+0000","last_became_active":"2024-09-10T23:30:18.431905+0000","last_became_peered":"2024-09-10T23:30:18.431905+0000","last_unstale":"2024-09-10T23:30:19.417909+0000","last_undegraded":"2024-09-10T23:30:19.417909+0000","last_fullsized":"2024-09-10T23:30:19.417909+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:25.494753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"200'4","reported_seq":19,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673771+0000","last_change":"2024-09-10T23:30:17.428407+0000","last_active":"2024-09-10T23:30:19.673771+0000","last_peered":"2024-09-10T23:30:19.673771+0000","last_clean":"2024-09-10T23:30:19.673771+0000","last_became_active":"2024-09-10T23:30:17.428095+0000","last_became_peered":"2024-09-10T23:30:17.428095+0000","last_unstale":"2024-09-10T23:30:19.673771+0000","last_undegraded":"2024-09-10T23:30:19.673771+0000","last_fullsized":"2024-09-10T23:30:19.673771+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:44.817383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418209+0000","last_change":"2024-09-10T23:30:18.422392+0000","last_active":"2024-09-10T23:30:19.418209+0000","last_peered":"2024-09-10T23:30:19.418209+0000","last_clean":"2024-09-10T23:30:19.418209+0000","last_became_active":"2024-09-10T23:30:18.421976+0000","last_became_peered":"2024-09-10T23:30:18.421976+0000","last_unstale":"2024-09-10T23:30:19.418209+0000","last_undegraded":"2024-09-10T23:30:19.418209+0000","last_fullsized":"2024-09-10T23:30:19.418209+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:39.765433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681483+0000","last_change":"2024-09-10T23:30:17.435885+0000","last_active":"2024-09-10T23:30:19.681483+0000","last_peered":"2024-09-10T23:30:19.681483+0000","last_clean":"2024-09-10T23:30:19.681483+0000","last_became_active":"2024-09-10T23:30:17.435638+0000","last_became_peered":"2024-09-10T23:30:17.435638+0000","last_unstale":"2024-09-10T23:30:19.681483+0000","last_undegraded":"2024-09-10T23:30:19.681483+0000","last_fullsized":"2024-09-10T23:30:19.681483+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:28.443604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681443+0000","last_change":"2024-09-10T23:30:18.446032+0000","last_active":"2024-09-10T23:30:19.681443+0000","last_peered":"2024-09-10T23:30:19.681443+0000","last_clean":"2024-09-10T23:30:19.681443+0000","last_became_active":"2024-09-10T23:30:18.445739+0000","last_became_peered":"2024-09-10T23:30:18.445739+0000","last_unstale":"2024-09-10T23:30:19.681443+0000","last_undegraded":"2024-09-10T23:30:19.681443+0000","last_fullsized":"2024-09-10T23:30:19.681443+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:37.138384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490744+0000","last_change":"2024-09-10T23:30:17.426662+0000","last_active":"2024-09-10T23:30:19.490744+0000","last_peered":"2024-09-10T23:30:19.490744+0000","last_clean":"2024-09-10T23:30:19.490744+0000","last_became_active":"2024-09-10T23:30:17.426379+0000","last_became_peered":"2024-09-10T23:30:17.426379+0000","last_unstale":"2024-09-10T23:30:19.490744+0000","last_undegraded":"2024-09-10T23:30:19.490744+0000","last_fullsized":"2024-09-10T23:30:19.490744+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:31.377540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.417717+0000","last_change":"2024-09-10T23:30:18.428527+0000","last_active":"2024-09-10T23:30:19.417717+0000","last_peered":"2024-09-10T23:30:19.417717+0000","last_clean":"2024-09-10T23:30:19.417717+0000","last_became_active":"2024-09-10T23:30:18.428284+0000","last_became_peered":"2024-09-10T23:30:18.428284+0000","last_unstale":"2024-09-10T23:30:19.417717+0000","last_undegraded":"2024-09-10T23:30:19.417717+0000","last_fullsized":"2024-09-10T23:30:19.417717+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:50:36.168431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674268+0000","last_change":"2024-09-10T23:30:17.424648+0000","last_active":"2024-09-10T23:30:19.674268+0000","last_peered":"2024-09-10T23:30:19.674268+0000","last_clean":"2024-09-10T23:30:19.674268+0000","last_became_active":"2024-09-10T23:30:17.424309+0000","last_became_peered":"2024-09-10T23:30:17.424309+0000","last_unstale":"2024-09-10T23:30:19.674268+0000","last_undegraded":"2024-09-10T23:30:19.674268+0000","last_fullsized":"2024-09-10T23:30:19.674268+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:37:44.144068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679901+0000","last_change":"2024-09-10T23:30:18.437987+0000","last_active":"2024-09-10T23:30:19.679901+0000","last_peered":"2024-09-10T23:30:19.679901+0000","last_clean":"2024-09-10T23:30:19.679901+0000","last_became_active":"2024-09-10T23:30:18.437707+0000","last_became_peered":"2024-09-10T23:30:18.437707+0000","last_unstale":"2024-09-10T23:30:19.679901+0000","last_undegraded":"2024-09-10T23:30:19.679901+0000","last_fullsized":"2024-09-10T23:30:19.679901+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:52.657720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680192+0000","last_change":"2024-09-10T23:30:17.438669+0000","last_active":"2024-09-10T23:30:19.680192+0000","last_peered":"2024-09-10T23:30:19.680192+0000","last_clean":"2024-09-10T23:30:19.680192+0000","last_became_active":"2024-09-10T23:30:17.438383+0000","last_became_peered":"2024-09-10T23:30:17.438383+0000","last_unstale":"2024-09-10T23:30:19.680192+0000","last_undegraded":"2024-09-10T23:30:19.680192+0000","last_fullsized":"2024-09-10T23:30:19.680192+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:58.970215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674014+0000","last_change":"2024-09-10T23:30:18.430231+0000","last_active":"2024-09-10T23:30:19.674014+0000","last_peered":"2024-09-10T23:30:19.674014+0000","last_clean":"2024-09-10T23:30:19.674014+0000","last_became_active":"2024-09-10T23:30:18.429920+0000","last_became_peered":"2024-09-10T23:30:18.429920+0000","last_unstale":"2024-09-10T23:30:19.674014+0000","last_undegraded":"2024-09-10T23:30:19.674014+0000","last_fullsized":"2024-09-10T23:30:19.674014+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:42.713962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425230+0000","last_change":"2024-09-10T23:30:17.425766+0000","last_active":"2024-09-10T23:30:19.425230+0000","last_peered":"2024-09-10T23:30:19.425230+0000","last_clean":"2024-09-10T23:30:19.425230+0000","last_became_active":"2024-09-10T23:30:17.424967+0000","last_became_peered":"2024-09-10T23:30:17.424967+0000","last_unstale":"2024-09-10T23:30:19.425230+0000","last_undegraded":"2024-09-10T23:30:19.425230+0000","last_fullsized":"2024-09-10T23:30:19.425230+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:55.277369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673775+0000","last_change":"2024-09-10T23:30:18.427654+0000","last_active":"2024-09-10T23:30:19.673775+0000","last_peered":"2024-09-10T23:30:19.673775+0000","last_clean":"2024-09-10T23:30:19.673775+0000","last_became_active":"2024-09-10T23:30:18.427356+0000","last_became_peered":"2024-09-10T23:30:18.427356+0000","last_unstale":"2024-09-10T23:30:19.673775+0000","last_undegraded":"2024-09-10T23:30:19.673775+0000","last_fullsized":"2024-09-10T23:30:19.673775+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:35.999756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.417959+0000","last_change":"2024-09-10T23:30:17.418976+0000","last_active":"2024-09-10T23:30:19.417959+0000","last_peered":"2024-09-10T23:30:19.417959+0000","last_clean":"2024-09-10T23:30:19.417959+0000","last_became_active":"2024-09-10T23:30:17.418442+0000","last_became_peered":"2024-09-10T23:30:17.418442+0000","last_unstale":"2024-09-10T23:30:19.417959+0000","last_undegraded":"2024-09-10T23:30:19.417959+0000","last_fullsized":"2024-09-10T23:30:19.417959+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:58.522724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674418+0000","last_change":"2024-09-10T23:30:18.425119+0000","last_active":"2024-09-10T23:30:19.674418+0000","last_peered":"2024-09-10T23:30:19.674418+0000","last_clean":"2024-09-10T23:30:19.674418+0000","last_became_active":"2024-09-10T23:30:18.424853+0000","last_became_peered":"2024-09-10T23:30:18.424853+0000","last_unstale":"2024-09-10T23:30:19.674418+0000","last_undegraded":"2024-09-10T23:30:19.674418+0000","last_fullsized":"2024-09-10T23:30:19.674418+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:31.576971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681004+0000","last_change":"2024-09-10T23:30:17.436490+0000","last_active":"2024-09-10T23:30:19.681004+0000","last_peered":"2024-09-10T23:30:19.681004+0000","last_clean":"2024-09-10T23:30:19.681004+0000","last_became_active":"2024-09-10T23:30:17.436203+0000","last_became_peered":"2024-09-10T23:30:17.436203+0000","last_unstale":"2024-09-10T23:30:19.681004+0000","last_undegraded":"2024-09-10T23:30:19.681004+0000","last_fullsized":"2024-09-10T23:30:19.681004+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674470+0000","last_change":"2024-09-10T23:30:18.427676+0000","last_active":"2024-09-10T23:30:19.674470+0000","last_peered":"2024-09-10T23:30:19.674470+0000","last_clean":"2024-09-10T23:30:19.674470+0000","last_became_active":"2024-09-10T23:30:18.425145+0000","last_became_peered":"2024-09-10T23:30:18.425145+0000","last_unstale":"2024-09-10T23:30:19.674470+0000","last_undegraded":"2024-09-10T23:30:19.674470+0000","last_fullsized":"2024-09-10T23:30:19.674470+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425913+0000","last_change":"2024-09-10T23:30:17.431896+0000","last_active":"2024-09-10T23:30:19.425913+0000","last_peered":"2024-09-10T23:30:19.425913+0000","last_clean":"2024-09-10T23:30:19.425913+0000","last_became_active":"2024-09-10T23:30:17.430852+0000","last_became_peered":"2024-09-10T23:30:17.430852+0000","last_unstale":"2024-09-10T23:30:19.425913+0000","last_undegraded":"2024-09-10T23:30:19.425913+0000","last_fullsized":"2024-09-10T23:30:19.425913+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:03.399968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418636+0000","last_change":"2024-09-10T23:30:18.422611+0000","last_active":"2024-09-10T23:30:19.418636+0000","last_peered":"2024-09-10T23:30:19.418636+0000","last_clean":"2024-09-10T23:30:19.418636+0000","last_became_active":"2024-09-10T23:30:18.422040+0000","last_became_peered":"2024-09-10T23:30:18.422040+0000","last_unstale":"2024-09-10T23:30:19.418636+0000","last_undegraded":"2024-09-10T23:30:19.418636+0000","last_fullsized":"2024-09-10T23:30:19.418636+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:04.571392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"200'3","reported_seq":18,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680857+0000","last_change":"2024-09-10T23:30:17.437999+0000","last_active":"2024-09-10T23:30:19.680857+0000","last_peered":"2024-09-10T23:30:19.680857+0000","last_clean":"2024-09-10T23:30:19.680857+0000","last_became_active":"2024-09-10T23:30:17.437724+0000","last_became_peered":"2024-09-10T23:30:17.437724+0000","last_unstale":"2024-09-10T23:30:19.680857+0000","last_undegraded":"2024-09-10T23:30:19.680857+0000","last_fullsized":"2024-09-10T23:30:19.680857+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:09:35.934846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.426144+0000","last_change":"2024-09-10T23:30:18.431666+0000","last_active":"2024-09-10T23:30:19.426144+0000","last_peered":"2024-09-10T23:30:19.426144+0000","last_clean":"2024-09-10T23:30:19.426144+0000","last_became_active":"2024-09-10T23:30:18.431392+0000","last_became_peered":"2024-09-10T23:30:18.431392+0000","last_unstale":"2024-09-10T23:30:19.426144+0000","last_undegraded":"2024-09-10T23:30:19.426144+0000","last_fullsized":"2024-09-10T23:30:19.426144+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:05.543871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"200'6","reported_seq":21,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.491058+0000","last_change":"2024-09-10T23:30:17.427136+0000","last_active":"2024-09-10T23:30:19.491058+0000","last_peered":"2024-09-10T23:30:19.491058+0000","last_clean":"2024-09-10T23:30:19.491058+0000","last_became_active":"2024-09-10T23:30:17.426720+0000","last_became_peered":"2024-09-10T23:30:17.426720+0000","last_unstale":"2024-09-10T23:30:19.491058+0000","last_undegraded":"2024-09-10T23:30:19.491058+0000","last_fullsized":"2024-09-10T23:30:19.491058+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:42.586081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672998+0000","last_change":"2024-09-10T23:30:18.436906+0000","last_active":"2024-09-10T23:30:19.672998+0000","last_peered":"2024-09-10T23:30:19.672998+0000","last_clean":"2024-09-10T23:30:19.672998+0000","last_became_active":"2024-09-10T23:30:18.436447+0000","last_became_peered":"2024-09-10T23:30:18.436447+0000","last_unstale":"2024-09-10T23:30:19.672998+0000","last_undegraded":"2024-09-10T23:30:19.672998+0000","last_fullsized":"2024-09-10T23:30:19.672998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:41:21.211619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680784+0000","last_change":"2024-09-10T23:30:17.428623+0000","last_active":"2024-09-10T23:30:19.680784+0000","last_peered":"2024-09-10T23:30:19.680784+0000","last_clean":"2024-09-10T23:30:19.680784+0000","last_became_active":"2024-09-10T23:30:17.428332+0000","last_became_peered":"2024-09-10T23:30:17.428332+0000","last_unstale":"2024-09-10T23:30:19.680784+0000","last_undegraded":"2024-09-10T23:30:19.680784+0000","last_fullsized":"2024-09-10T23:30:19.680784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:44.204111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680358+0000","last_change":"2024-09-10T23:30:18.444027+0000","last_active":"2024-09-10T23:30:19.680358+0000","last_peered":"2024-09-10T23:30:19.680358+0000","last_clean":"2024-09-10T23:30:19.680358+0000","last_became_active":"2024-09-10T23:30:18.443479+0000","last_became_peered":"2024-09-10T23:30:18.443479+0000","last_unstale":"2024-09-10T23:30:19.680358+0000","last_undegraded":"2024-09-10T23:30:19.680358+0000","last_fullsized":"2024-09-10T23:30:19.680358+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:47:15.469850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673380+0000","last_change":"2024-09-10T23:30:17.417961+0000","last_active":"2024-09-10T23:30:19.673380+0000","last_peered":"2024-09-10T23:30:19.673380+0000","last_clean":"2024-09-10T23:30:19.673380+0000","last_became_active":"2024-09-10T23:30:17.417683+0000","last_became_peered":"2024-09-10T23:30:17.417683+0000","last_unstale":"2024-09-10T23:30:19.673380+0000","last_undegraded":"2024-09-10T23:30:19.673380+0000","last_fullsized":"2024-09-10T23:30:19.673380+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:45:55.340081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.417849+0000","last_change":"2024-09-10T23:30:18.434473+0000","last_active":"2024-09-10T23:30:19.417849+0000","last_peered":"2024-09-10T23:30:19.417849+0000","last_clean":"2024-09-10T23:30:19.417849+0000","last_became_active":"2024-09-10T23:30:18.434221+0000","last_became_peered":"2024-09-10T23:30:18.434221+0000","last_unstale":"2024-09-10T23:30:19.417849+0000","last_undegraded":"2024-09-10T23:30:19.417849+0000","last_fullsized":"2024-09-10T23:30:19.417849+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:24.662337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490429+0000","last_change":"2024-09-10T23:30:17.425540+0000","last_active":"2024-09-10T23:30:19.490429+0000","last_peered":"2024-09-10T23:30:19.490429+0000","last_clean":"2024-09-10T23:30:19.490429+0000","last_became_active":"2024-09-10T23:30:17.425256+0000","last_became_peered":"2024-09-10T23:30:17.425256+0000","last_unstale":"2024-09-10T23:30:19.490429+0000","last_undegraded":"2024-09-10T23:30:19.490429+0000","last_fullsized":"2024-09-10T23:30:19.490429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:37.019557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674115+0000","last_change":"2024-09-10T23:30:18.425671+0000","last_active":"2024-09-10T23:30:19.674115+0000","last_peered":"2024-09-10T23:30:19.674115+0000","last_clean":"2024-09-10T23:30:19.674115+0000","last_became_active":"2024-09-10T23:30:18.424769+0000","last_became_peered":"2024-09-10T23:30:18.424769+0000","last_unstale":"2024-09-10T23:30:19.674115+0000","last_undegraded":"2024-09-10T23:30:19.674115+0000","last_fullsized":"2024-09-10T23:30:19.674115+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:33:39.771480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"200'8","reported_seq":23,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679790+0000","last_change":"2024-09-10T23:30:17.425625+0000","last_active":"2024-09-10T23:30:19.679790+0000","last_peered":"2024-09-10T23:30:19.679790+0000","last_clean":"2024-09-10T23:30:19.679790+0000","last_became_active":"2024-09-10T23:30:17.425348+0000","last_became_peered":"2024-09-10T23:30:17.425348+0000","last_unstale":"2024-09-10T23:30:19.679790+0000","last_undegraded":"2024-09-10T23:30:19.679790+0000","last_fullsized":"2024-09-10T23:30:19.679790+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:53.025824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673146+0000","last_change":"2024-09-10T23:30:18.428571+0000","last_active":"2024-09-10T23:30:19.673146+0000","last_peered":"2024-09-10T23:30:19.673146+0000","last_clean":"2024-09-10T23:30:19.673146+0000","last_became_active":"2024-09-10T23:30:18.427496+0000","last_became_peered":"2024-09-10T23:30:18.427496+0000","last_unstale":"2024-09-10T23:30:19.673146+0000","last_undegraded":"2024-09-10T23:30:19.673146+0000","last_fullsized":"2024-09-10T23:30:19.673146+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:25.149316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418462+0000","last_change":"2024-09-10T23:30:17.423434+0000","last_active":"2024-09-10T23:30:19.418462+0000","last_peered":"2024-09-10T23:30:19.418462+0000","last_clean":"2024-09-10T23:30:19.418462+0000","last_became_active":"2024-09-10T23:30:17.423143+0000","last_became_peered":"2024-09-10T23:30:17.423143+0000","last_unstale":"2024-09-10T23:30:19.418462+0000","last_undegraded":"2024-09-10T23:30:19.418462+0000","last_fullsized":"2024-09-10T23:30:19.418462+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:45.063073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680725+0000","last_change":"2024-09-10T23:30:18.442899+0000","last_active":"2024-09-10T23:30:19.680725+0000","last_peered":"2024-09-10T23:30:19.680725+0000","last_clean":"2024-09-10T23:30:19.680725+0000","last_became_active":"2024-09-10T23:30:18.442642+0000","last_became_peered":"2024-09-10T23:30:18.442642+0000","last_unstale":"2024-09-10T23:30:19.680725+0000","last_undegraded":"2024-09-10T23:30:19.680725+0000","last_fullsized":"2024-09-10T23:30:19.680725+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:08:09.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673407+0000","last_change":"2024-09-10T23:30:17.419308+0000","last_active":"2024-09-10T23:30:19.673407+0000","last_peered":"2024-09-10T23:30:19.673407+0000","last_clean":"2024-09-10T23:30:19.673407+0000","last_became_active":"2024-09-10T23:30:17.419027+0000","last_became_peered":"2024-09-10T23:30:17.419027+0000","last_unstale":"2024-09-10T23:30:19.673407+0000","last_undegraded":"2024-09-10T23:30:19.673407+0000","last_fullsized":"2024-09-10T23:30:19.673407+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:37.201310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418715+0000","last_change":"2024-09-10T23:30:18.422331+0000","last_active":"2024-09-10T23:30:19.418715+0000","last_peered":"2024-09-10T23:30:19.418715+0000","last_clean":"2024-09-10T23:30:19.418715+0000","last_became_active":"2024-09-10T23:30:18.421664+0000","last_became_peered":"2024-09-10T23:30:18.421664+0000","last_unstale":"2024-09-10T23:30:19.418715+0000","last_undegraded":"2024-09-10T23:30:19.418715+0000","last_fullsized":"2024-09-10T23:30:19.418715+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:12.916998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"200'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681143+0000","last_change":"2024-09-10T23:30:17.427272+0000","last_active":"2024-09-10T23:30:19.681143+0000","last_peered":"2024-09-10T23:30:19.681143+0000","last_clean":"2024-09-10T23:30:19.681143+0000","last_became_active":"2024-09-10T23:30:17.426898+0000","last_became_peered":"2024-09-10T23:30:17.426898+0000","last_unstale":"2024-09-10T23:30:19.681143+0000","last_undegraded":"2024-09-10T23:30:19.681143+0000","last_fullsized":"2024-09-10T23:30:19.681143+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:26:17.943545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681625+0000","last_change":"2024-09-10T23:30:18.442632+0000","last_active":"2024-09-10T23:30:19.681625+0000","last_peered":"2024-09-10T23:30:19.681625+0000","last_clean":"2024-09-10T23:30:19.681625+0000","last_became_active":"2024-09-10T23:30:18.442386+0000","last_became_peered":"2024-09-10T23:30:18.442386+0000","last_unstale":"2024-09-10T23:30:19.681625+0000","last_undegraded":"2024-09-10T23:30:19.681625+0000","last_fullsized":"2024-09-10T23:30:19.681625+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:48.604686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681142+0000","last_change":"2024-09-10T23:30:17.427578+0000","last_active":"2024-09-10T23:30:19.681142+0000","last_peered":"2024-09-10T23:30:19.681142+0000","last_clean":"2024-09-10T23:30:19.681142+0000","last_became_active":"2024-09-10T23:30:17.424863+0000","last_became_peered":"2024-09-10T23:30:17.424863+0000","last_unstale":"2024-09-10T23:30:19.681142+0000","last_undegraded":"2024-09-10T23:30:19.681142+0000","last_fullsized":"2024-09-10T23:30:19.681142+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:32.433094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680070+0000","last_change":"2024-09-10T23:30:18.446294+0000","last_active":"2024-09-10T23:30:19.680070+0000","last_peered":"2024-09-10T23:30:19.680070+0000","last_clean":"2024-09-10T23:30:19.680070+0000","last_became_active":"2024-09-10T23:30:18.445592+0000","last_became_peered":"2024-09-10T23:30:18.445592+0000","last_unstale":"2024-09-10T23:30:19.680070+0000","last_undegraded":"2024-09-10T23:30:19.680070+0000","last_fullsized":"2024-09-10T23:30:19.680070+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:21.909190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680832+0000","last_change":"2024-09-10T23:30:17.436646+0000","last_active":"2024-09-10T23:30:19.680832+0000","last_peered":"2024-09-10T23:30:19.680832+0000","last_clean":"2024-09-10T23:30:19.680832+0000","last_became_active":"2024-09-10T23:30:17.435895+0000","last_became_peered":"2024-09-10T23:30:17.435895+0000","last_unstale":"2024-09-10T23:30:19.680832+0000","last_undegraded":"2024-09-10T23:30:19.680832+0000","last_fullsized":"2024-09-10T23:30:19.680832+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:39.922424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680075+0000","last_change":"2024-09-10T23:30:18.433819+0000","last_active":"2024-09-10T23:30:19.680075+0000","last_peered":"2024-09-10T23:30:19.680075+0000","last_clean":"2024-09-10T23:30:19.680075+0000","last_became_active":"2024-09-10T23:30:18.433550+0000","last_became_peered":"2024-09-10T23:30:18.433550+0000","last_unstale":"2024-09-10T23:30:19.680075+0000","last_undegraded":"2024-09-10T23:30:19.680075+0000","last_fullsized":"2024-09-10T23:30:19.680075+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:34.276101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673939+0000","last_change":"2024-09-10T23:30:17.414097+0000","last_active":"2024-09-10T23:30:19.673939+0000","last_peered":"2024-09-10T23:30:19.673939+0000","last_clean":"2024-09-10T23:30:19.673939+0000","last_became_active":"2024-09-10T23:30:17.413839+0000","last_became_peered":"2024-09-10T23:30:17.413839+0000","last_unstale":"2024-09-10T23:30:19.673939+0000","last_undegraded":"2024-09-10T23:30:19.673939+0000","last_fullsized":"2024-09-10T23:30:19.673939+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673192+0000","last_change":"2024-09-10T23:30:18.435156+0000","last_active":"2024-09-10T23:30:19.673192+0000","last_peered":"2024-09-10T23:30:19.673192+0000","last_clean":"2024-09-10T23:30:19.673192+0000","last_became_active":"2024-09-10T23:30:18.434885+0000","last_became_peered":"2024-09-10T23:30:18.434885+0000","last_unstale":"2024-09-10T23:30:19.673192+0000","last_undegraded":"2024-09-10T23:30:19.673192+0000","last_fullsized":"2024-09-10T23:30:19.673192+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:08.514251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673435+0000","last_change":"2024-09-10T23:30:17.409125+0000","last_active":"2024-09-10T23:30:19.673435+0000","last_peered":"2024-09-10T23:30:19.673435+0000","last_clean":"2024-09-10T23:30:19.673435+0000","last_became_active":"2024-09-10T23:30:17.408859+0000","last_became_peered":"2024-09-10T23:30:17.408859+0000","last_unstale":"2024-09-10T23:30:19.673435+0000","last_undegraded":"2024-09-10T23:30:19.673435+0000","last_fullsized":"2024-09-10T23:30:19.673435+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:28.145328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.417957+0000","last_change":"2024-09-10T23:30:18.433689+0000","last_active":"2024-09-10T23:30:19.417957+0000","last_peered":"2024-09-10T23:30:19.417957+0000","last_clean":"2024-09-10T23:30:19.417957+0000","last_became_active":"2024-09-10T23:30:18.433406+0000","last_became_peered":"2024-09-10T23:30:18.433406+0000","last_unstale":"2024-09-10T23:30:19.417957+0000","last_undegraded":"2024-09-10T23:30:19.417957+0000","last_fullsized":"2024-09-10T23:30:19.417957+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:42.985231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.672778+0000","last_change":"2024-09-10T23:30:17.420097+0000","last_active":"2024-09-10T23:30:19.672778+0000","last_peered":"2024-09-10T23:30:19.672778+0000","last_clean":"2024-09-10T23:30:19.672778+0000","last_became_active":"2024-09-10T23:30:17.419810+0000","last_became_peered":"2024-09-10T23:30:17.419810+0000","last_unstale":"2024-09-10T23:30:19.672778+0000","last_undegraded":"2024-09-10T23:30:19.672778+0000","last_fullsized":"2024-09-10T23:30:19.672778+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:56.936472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673368+0000","last_change":"2024-09-10T23:30:18.419771+0000","last_active":"2024-09-10T23:30:19.673368+0000","last_peered":"2024-09-10T23:30:19.673368+0000","last_clean":"2024-09-10T23:30:19.673368+0000","last_became_active":"2024-09-10T23:30:18.419502+0000","last_became_peered":"2024-09-10T23:30:18.419502+0000","last_unstale":"2024-09-10T23:30:19.673368+0000","last_undegraded":"2024-09-10T23:30:19.673368+0000","last_fullsized":"2024-09-10T23:30:19.673368+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:44.400118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681564+0000","last_change":"2024-09-10T23:30:17.425729+0000","last_active":"2024-09-10T23:30:19.681564+0000","last_peered":"2024-09-10T23:30:19.681564+0000","last_clean":"2024-09-10T23:30:19.681564+0000","last_became_active":"2024-09-10T23:30:17.425302+0000","last_became_peered":"2024-09-10T23:30:17.425302+0000","last_unstale":"2024-09-10T23:30:19.681564+0000","last_undegraded":"2024-09-10T23:30:19.681564+0000","last_fullsized":"2024-09-10T23:30:19.681564+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:56.886964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680785+0000","last_change":"2024-09-10T23:30:18.436355+0000","last_active":"2024-09-10T23:30:19.680785+0000","last_peered":"2024-09-10T23:30:19.680785+0000","last_clean":"2024-09-10T23:30:19.680785+0000","last_became_active":"2024-09-10T23:30:18.435787+0000","last_became_peered":"2024-09-10T23:30:18.435787+0000","last_unstale":"2024-09-10T23:30:19.680785+0000","last_undegraded":"2024-09-10T23:30:19.680785+0000","last_fullsized":"2024-09-10T23:30:19.680785+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:29:57.394499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"201'1","reported_seq":16,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:20.399709+0000","last_change":"2024-09-10T23:30:17.409966+0000","last_active":"2024-09-10T23:30:20.399709+0000","last_peered":"2024-09-10T23:30:20.399709+0000","last_clean":"2024-09-10T23:30:20.399709+0000","last_became_active":"2024-09-10T23:30:17.409718+0000","last_became_peered":"2024-09-10T23:30:17.409718+0000","last_unstale":"2024-09-10T23:30:20.399709+0000","last_undegraded":"2024-09-10T23:30:20.399709+0000","last_fullsized":"2024-09-10T23:30:20.399709+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:25.771659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.490949+0000","last_change":"2024-09-10T23:30:18.445113+0000","last_active":"2024-09-10T23:30:19.490949+0000","last_peered":"2024-09-10T23:30:19.490949+0000","last_clean":"2024-09-10T23:30:19.490949+0000","last_became_active":"2024-09-10T23:30:18.444854+0000","last_became_peered":"2024-09-10T23:30:18.444854+0000","last_unstale":"2024-09-10T23:30:19.490949+0000","last_undegraded":"2024-09-10T23:30:19.490949+0000","last_fullsized":"2024-09-10T23:30:19.490949+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:50.338409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.674429+0000","last_change":"2024-09-10T23:30:17.421620+0000","last_active":"2024-09-10T23:30:19.674429+0000","last_peered":"2024-09-10T23:30:19.674429+0000","last_clean":"2024-09-10T23:30:19.674429+0000","last_became_active":"2024-09-10T23:30:17.421324+0000","last_became_peered":"2024-09-10T23:30:17.421324+0000","last_unstale":"2024-09-10T23:30:19.674429+0000","last_undegraded":"2024-09-10T23:30:19.674429+0000","last_fullsized":"2024-09-10T23:30:19.674429+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:11.363973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673416+0000","last_change":"2024-09-10T23:30:18.424759+0000","last_active":"2024-09-10T23:30:19.673416+0000","last_peered":"2024-09-10T23:30:19.673416+0000","last_clean":"2024-09-10T23:30:19.673416+0000","last_became_active":"2024-09-10T23:30:18.424453+0000","last_became_peered":"2024-09-10T23:30:18.424453+0000","last_unstale":"2024-09-10T23:30:19.673416+0000","last_undegraded":"2024-09-10T23:30:19.673416+0000","last_fullsized":"2024-09-10T23:30:19.673416+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:47.092041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.681267+0000","last_change":"2024-09-10T23:30:17.434351+0000","last_active":"2024-09-10T23:30:19.681267+0000","last_peered":"2024-09-10T23:30:19.681267+0000","last_clean":"2024-09-10T23:30:19.681267+0000","last_became_active":"2024-09-10T23:30:17.433835+0000","last_became_peered":"2024-09-10T23:30:17.433835+0000","last_unstale":"2024-09-10T23:30:19.681267+0000","last_undegraded":"2024-09-10T23:30:19.681267+0000","last_fullsized":"2024-09-10T23:30:19.681267+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:01.966013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.417963+0000","last_change":"2024-09-10T23:30:18.434690+0000","last_active":"2024-09-10T23:30:19.417963+0000","last_peered":"2024-09-10T23:30:19.417963+0000","last_clean":"2024-09-10T23:30:19.417963+0000","last_became_active":"2024-09-10T23:30:18.433331+0000","last_became_peered":"2024-09-10T23:30:18.433331+0000","last_unstale":"2024-09-10T23:30:19.417963+0000","last_undegraded":"2024-09-10T23:30:19.417963+0000","last_fullsized":"2024-09-10T23:30:19.417963+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:50.660901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680899+0000","last_change":"2024-09-10T23:30:17.429711+0000","last_active":"2024-09-10T23:30:19.680899+0000","last_peered":"2024-09-10T23:30:19.680899+0000","last_clean":"2024-09-10T23:30:19.680899+0000","last_became_active":"2024-09-10T23:30:17.429344+0000","last_became_peered":"2024-09-10T23:30:17.429344+0000","last_unstale":"2024-09-10T23:30:19.680899+0000","last_undegraded":"2024-09-10T23:30:19.680899+0000","last_fullsized":"2024-09-10T23:30:19.680899+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:38.807426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418201+0000","last_change":"2024-09-10T23:30:18.436717+0000","last_active":"2024-09-10T23:30:19.418201+0000","last_peered":"2024-09-10T23:30:19.418201+0000","last_clean":"2024-09-10T23:30:19.418201+0000","last_became_active":"2024-09-10T23:30:18.436451+0000","last_became_peered":"2024-09-10T23:30:18.436451+0000","last_unstale":"2024-09-10T23:30:19.418201+0000","last_undegraded":"2024-09-10T23:30:19.418201+0000","last_fullsized":"2024-09-10T23:30:19.418201+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:06:39.611511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.425328+0000","last_change":"2024-09-10T23:30:17.427637+0000","last_active":"2024-09-10T23:30:19.425328+0000","last_peered":"2024-09-10T23:30:19.425328+0000","last_clean":"2024-09-10T23:30:19.425328+0000","last_became_active":"2024-09-10T23:30:17.427332+0000","last_became_peered":"2024-09-10T23:30:17.427332+0000","last_unstale":"2024-09-10T23:30:19.425328+0000","last_undegraded":"2024-09-10T23:30:19.425328+0000","last_fullsized":"2024-09-10T23:30:19.425328+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:04.590063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.673512+0000","last_change":"2024-09-10T23:30:18.410894+0000","last_active":"2024-09-10T23:30:19.673512+0000","last_peered":"2024-09-10T23:30:19.673512+0000","last_clean":"2024-09-10T23:30:19.673512+0000","last_became_active":"2024-09-10T23:30:18.410504+0000","last_became_peered":"2024-09-10T23:30:18.410504+0000","last_unstale":"2024-09-10T23:30:19.673512+0000","last_undegraded":"2024-09-10T23:30:19.673512+0000","last_fullsized":"2024-09-10T23:30:19.673512+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:10.502957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679898+0000","last_change":"2024-09-10T23:30:17.435618+0000","last_active":"2024-09-10T23:30:19.679898+0000","last_peered":"2024-09-10T23:30:19.679898+0000","last_clean":"2024-09-10T23:30:19.679898+0000","last_became_active":"2024-09-10T23:30:17.435326+0000","last_became_peered":"2024-09-10T23:30:17.435326+0000","last_unstale":"2024-09-10T23:30:19.679898+0000","last_undegraded":"2024-09-10T23:30:19.679898+0000","last_fullsized":"2024-09-10T23:30:19.679898+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:38.614066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680764+0000","last_change":"2024-09-10T23:30:18.447807+0000","last_active":"2024-09-10T23:30:19.680764+0000","last_peered":"2024-09-10T23:30:19.680764+0000","last_clean":"2024-09-10T23:30:19.680764+0000","last_became_active":"2024-09-10T23:30:18.446742+0000","last_became_peered":"2024-09-10T23:30:18.446742+0000","last_unstale":"2024-09-10T23:30:19.680764+0000","last_undegraded":"2024-09-10T23:30:19.680764+0000","last_fullsized":"2024-09-10T23:30:19.680764+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:42.717309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679936+0000","last_change":"2024-09-10T23:30:17.426703+0000","last_active":"2024-09-10T23:30:19.679936+0000","last_peered":"2024-09-10T23:30:19.679936+0000","last_clean":"2024-09-10T23:30:19.679936+0000","last_became_active":"2024-09-10T23:30:17.425405+0000","last_became_peered":"2024-09-10T23:30:17.425405+0000","last_unstale":"2024-09-10T23:30:19.679936+0000","last_undegraded":"2024-09-10T23:30:19.679936+0000","last_fullsized":"2024-09-10T23:30:19.679936+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:19:10.559348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.418335+0000","last_change":"2024-09-10T23:30:18.435970+0000","last_active":"2024-09-10T23:30:19.418335+0000","last_peered":"2024-09-10T23:30:19.418335+0000","last_clean":"2024-09-10T23:30:19.418335+0000","last_became_active":"2024-09-10T23:30:18.435650+0000","last_became_peered":"2024-09-10T23:30:18.435650+0000","last_unstale":"2024-09-10T23:30:19.418335+0000","last_undegraded":"2024-09-10T23:30:19.418335+0000","last_fullsized":"2024-09-10T23:30:19.418335+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:17.392406+0000","last_clean_scrub_stamp":"2024-09-10T23:30:17.392406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:45.620034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"200'2","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.680337+0000","last_change":"2024-09-10T23:30:17.435242+0000","last_active":"2024-09-10T23:30:19.680337+0000","last_peered":"2024-09-10T23:30:19.680337+0000","last_clean":"2024-09-10T23:30:19.680337+0000","last_became_active":"2024-09-10T23:30:17.434970+0000","last_became_peered":"2024-09-10T23:30:17.434970+0000","last_unstale":"2024-09-10T23:30:19.680337+0000","last_undegraded":"2024-09-10T23:30:19.680337+0000","last_fullsized":"2024-09-10T23:30:19.680337+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:30:16.389251+0000","last_clean_scrub_stamp":"2024-09-10T23:30:16.389251+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:03.670942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":436,"reported_epoch":201,"state":"active+clean","last_fresh":"2024-09-10T23:30:19.679937+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:30:19.679937+0000","last_peered":"2024-09-10T23:30:19.679937+0000","last_clean":"2024-09-10T23:30:19.679937+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:30:19.679937+0000","last_undegraded":"2024-09-10T23:30:19.679937+0000","last_fullsized":"2024-09-10T23:30:19.679937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476919,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69716,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302124,"statfs":{"total":96636764160,"available":96565374976,"internally_reserved":0,"allocated":2555904,"data_stored":1193354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509624,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70288,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301552,"statfs":{"total":96636764160,"available":96564789248,"internally_reserved":0,"allocated":3133440,"data_stored":1782656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68811210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509623,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47572,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324268,"statfs":{"total":96636764160,"available":96588050432,"internally_reserved":0,"allocated":2547712,"data_stored":1193298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509624,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73924,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297916,"statfs":{"total":96636764160,"available":96561065984,"internally_reserved":0,"allocated":2535424,"data_stored":1191706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509623,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73928,"kb_used_data":2480,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297912,"statfs":{"total":96636764160,"available":96561061888,"internally_reserved":0,"allocated":2539520,"data_stored":1192232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509624,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47552,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324288,"statfs":{"total":96636764160,"available":96588070912,"internally_reserved":0,"allocated":2531328,"data_stored":1191616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509623,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78660,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293180,"statfs":{"total":96636764160,"available":96556216320,"internally_reserved":0,"allocated":3125248,"data_stored":1781984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73860,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297980,"statfs":{"total":96636764160,"available":96561131520,"internally_reserved":0,"allocated":2535424,"data_stored":1191638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:30:27.563 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:30:27.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:30:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 -- 172.21.15.17:0/1908048174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac0b30e0 msgr2=0x7f25ac1654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 --2- 172.21.15.17:0/1908048174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac0b30e0 0x7f25ac1654c0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0b4770 tx=0x7f25a401cd50 comp rx=0 tx=0).stop 2024-09-10T23:30:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 -- 172.21.15.17:0/1908048174 shutdown_connections 2024-09-10T23:30:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 --2- 172.21.15.17:0/1908048174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac0b30e0 0x7f25ac1654c0 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 --2- 172.21.15.17:0/1908048174 >> v2:172.21.15.77:3300/0 conn(0x7f25ac15b8c0 0x7f25ac0d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 -- 172.21.15.17:0/1908048174 >> 172.21.15.17:0/1908048174 conn(0x7f25ac09a9f0 msgr2=0x7f25ac09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 -- 172.21.15.17:0/1908048174 shutdown_connections 2024-09-10T23:30:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 -- 172.21.15.17:0/1908048174 wait complete. 2024-09-10T23:30:27.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 Processor -- start 2024-09-10T23:30:27.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 -- start start 2024-09-10T23:30:27.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25ac0b30e0 0x7f25ac1f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25ac0d06b0 0x7f25ac0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac15b8c0 0x7f25ac152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac168bf0 con 0x7f25ac15b8c0 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac168a70 con 0x7f25ac0d06b0 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.755+0000 7f25b0a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f25ac168d70 con 0x7f25ac0b30e0 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac15b8c0 0x7f25ac152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25abe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac15b8c0 0x7f25ac152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45322/0 (socket says 172.21.15.17:45322) 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25abe00640 1 -- 172.21.15.17:0/3271282241 learned_addr learned my addr 172.21.15.17:0/3271282241 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25ab400640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25ac0b30e0 0x7f25ac1f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25a3e00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25ac0d06b0 0x7f25ac0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25abe00640 1 -- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25ac0b30e0 msgr2=0x7f25ac1f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25abe00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25ac0b30e0 0x7f25ac1f7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25abe00640 1 -- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25ac0d06b0 msgr2=0x7f25ac0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25abe00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25ac0d06b0 0x7f25ac0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25abe00640 1 -- 172.21.15.17:0/3271282241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac159b20 con 0x7f25ac15b8c0 2024-09-10T23:30:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25a3e00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25ac0d06b0 0x7f25ac0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25abe00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac15b8c0 0x7f25ac152b60 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f25a4019960 tx=0x7f25a4009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25a3400640 1 -- 172.21.15.17:0/3271282241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a40bb070 con 0x7f25ac15b8c0 2024-09-10T23:30:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25a3400640 1 -- 172.21.15.17:0/3271282241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25a4004d40 con 0x7f25ac15b8c0 2024-09-10T23:30:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25a3400640 1 -- 172.21.15.17:0/3271282241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a40b2040 con 0x7f25ac15b8c0 2024-09-10T23:30:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ac06f750 con 0x7f25ac15b8c0 2024-09-10T23:30:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ac15a750 con 0x7f25ac15b8c0 2024-09-10T23:30:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ac0d0170 con 0x7f25ac15b8c0 2024-09-10T23:30:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.759+0000 7f25a3400640 1 -- 172.21.15.17:0/3271282241 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f25a40b5030 con 0x7f25ac15b8c0 2024-09-10T23:30:27.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.763+0000 7f25a3400640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25880725e0 0x7f2588074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:27.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.763+0000 7f25a3400640 1 -- 172.21.15.17:0/3271282241 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f25a412ce00 con 0x7f25ac15b8c0 2024-09-10T23:30:27.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.763+0000 7f25ab400640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25880725e0 0x7f2588074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:27.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.763+0000 7f25ab400640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25880725e0 0x7f2588074aa0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f259c009b40 tx=0x7f259c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:27.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:27.767+0000 7f25a3400640 1 -- 172.21.15.17:0/3271282241 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f25a4016970 con 0x7f25ac15b8c0 2024-09-10T23:30:28.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.003+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f25ac1f81a0 con 0x7f25ac15b8c0 2024-09-10T23:30:28.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.003+0000 7f25a3400640 1 -- 172.21.15.17:0/3271282241 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) ==== 190+0+147 (secure 0 0 0) 0x7f25a40f7cf0 con 0x7f25ac15b8c0 2024-09-10T23:30:28.007 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:30:28.007 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:30:28.007 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:30:28.007 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:30:28.007 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:30:28.007 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:30:28.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25880725e0 msgr2=0x7f2588074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25880725e0 0x7f2588074aa0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f259c009b40 tx=0x7f259c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac15b8c0 msgr2=0x7f25ac152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac15b8c0 0x7f25ac152b60 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f25a4019960 tx=0x7f25a4009300 comp rx=0 tx=0).stop 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 shutdown_connections 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f25880725e0 0x7f2588074aa0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25ac15b8c0 0x7f25ac152b60 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25ac0d06b0 0x7f25ac0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 --2- 172.21.15.17:0/3271282241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f25ac0b30e0 0x7f25ac1f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 >> 172.21.15.17:0/3271282241 conn(0x7f25ac09a9f0 msgr2=0x7f25ac0aff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 shutdown_connections 2024-09-10T23:30:28.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.007+0000 7f25b0a00640 1 -- 172.21.15.17:0/3271282241 wait complete. 2024-09-10T23:30:28.029 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:30:28.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 -- 172.21.15.17:0/2842441014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 msgr2=0x7fd30c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 --2- 172.21.15.17:0/2842441014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 0x7fd30c070350 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009870 tx=0x7fd2fc01c7f0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 -- 172.21.15.17:0/2842441014 shutdown_connections 2024-09-10T23:30:28.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 --2- 172.21.15.17:0/2842441014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd30c0d1120 0x7fd30c0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 --2- 172.21.15.17:0/2842441014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 0x7fd30c070350 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 -- 172.21.15.17:0/2842441014 >> 172.21.15.17:0/2842441014 conn(0x7fd30c0d03d0 msgr2=0x7fd30c0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:28.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 -- 172.21.15.17:0/2842441014 shutdown_connections 2024-09-10T23:30:28.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 -- 172.21.15.17:0/2842441014 wait complete. 2024-09-10T23:30:28.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 Processor -- start 2024-09-10T23:30:28.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 -- start start 2024-09-10T23:30:28.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd30c0d1120 0x7fd30c153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 0x7fd30c149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd30c153030 0x7fd30c155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c071750 con 0x7fd30c152c50 2024-09-10T23:30:28.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd30c0715d0 con 0x7fd30c0d1120 2024-09-10T23:30:28.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd312c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd30c0b4a20 con 0x7fd30c153030 2024-09-10T23:30:28.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd303e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 0x7fd30c149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd303e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 0x7fd30c149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45340/0 (socket says 172.21.15.17:45340) 2024-09-10T23:30:28.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd303e00640 1 -- 172.21.15.17:0/1915960022 learned_addr learned my addr 172.21.15.17:0/1915960022 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:28.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd30be00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd30c0d1120 0x7fd30c153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd310c00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd30c153030 0x7fd30c155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd303e00640 1 -- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd30c153030 msgr2=0x7fd30c155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd303e00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd30c153030 0x7fd30c155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd303e00640 1 -- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd30c0d1120 msgr2=0x7fd30c153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd303e00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd30c0d1120 0x7fd30c153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd303e00640 1 -- 172.21.15.17:0/1915960022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c14ead0 con 0x7fd30c152c50 2024-09-10T23:30:28.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.175+0000 7fd30be00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd30c0d1120 0x7fd30c153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:28.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd303e00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 0x7fd30c149a30 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400d950 tx=0x7fd2f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:28.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd308c00640 1 -- 172.21.15.17:0/1915960022 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4017070 con 0x7fd30c152c50 2024-09-10T23:30:28.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd308c00640 1 -- 172.21.15.17:0/1915960022 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2f4009d20 con 0x7fd30c152c50 2024-09-10T23:30:28.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd30c14edb0 con 0x7fd30c152c50 2024-09-10T23:30:28.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd308c00640 1 -- 172.21.15.17:0/1915960022 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40106c0 con 0x7fd30c152c50 2024-09-10T23:30:28.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd30c149f70 con 0x7fd30c152c50 2024-09-10T23:30:28.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30c0cdfa0 con 0x7fd30c152c50 2024-09-10T23:30:28.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd308c00640 1 -- 172.21.15.17:0/1915960022 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd2f4010860 con 0x7fd30c152c50 2024-09-10T23:30:28.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd308c00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2e8072610 0x7fd2e8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.179+0000 7fd308c00640 1 -- 172.21.15.17:0/1915960022 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fd2f4093710 con 0x7fd30c152c50 2024-09-10T23:30:28.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.183+0000 7fd30be00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2e8072610 0x7fd2e8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.183+0000 7fd30be00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2e8072610 0x7fd2e8074ad0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0af000 tx=0x7fd2fc01b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:28.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.183+0000 7fd308c00640 1 -- 172.21.15.17:0/1915960022 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd2f405ecf0 con 0x7fd30c152c50 2024-09-10T23:30:28.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.395+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd30c15fba0 con 0x7fd30c152c50 2024-09-10T23:30:28.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.395+0000 7fd308c00640 1 -- 172.21.15.17:0/1915960022 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5234 (secure 0 0 0) 0x7fd2f405e5f0 con 0x7fd30c152c50 2024-09-10T23:30:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:28.397 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":152,"btime":"2024-09-10T23:30:21:423641+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/762449917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":762449917},{"type":"v1","addr":"172.21.15.77:6836","nonce":762449917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/661473457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":661473457},{"type":"v1","addr":"172.21.15.17:6834","nonce":661473457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11049,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3378779893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3378779893},{"type":"v1","addr":"172.21.15.17:6835","nonce":3378779893}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:30:17.818575+0000","modified":"2024-09-10T23:30:20.823822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11055":{"gid":11055,"name":"b","rank":0,"incarnation":148,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2065743463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2065743463},{"type":"v1","addr":"172.21.15.77:6837","nonce":2065743463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11055,"qdb_cluster":[11055]},"id":14}]} 2024-09-10T23:30:28.398 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 152 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2e8072610 msgr2=0x7fd2e8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2e8072610 0x7fd2e8074ad0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0af000 tx=0x7fd2fc01b030 comp rx=0 tx=0).stop 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 msgr2=0x7fd30c149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 0x7fd30c149a30 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400d950 tx=0x7fd2f400de10 comp rx=0 tx=0).stop 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 shutdown_connections 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd2e8072610 0x7fd2e8074ad0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd30c153030 0x7fd30c155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd30c152c50 0x7fd30c149a30 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 --2- 172.21.15.17:0/1915960022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd30c0d1120 0x7fd30c153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 >> 172.21.15.17:0/1915960022 conn(0x7fd30c0d03d0 msgr2=0x7fd30c0ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:28.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 shutdown_connections 2024-09-10T23:30:28.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.399+0000 7fd312c00640 1 -- 172.21.15.17:0/1915960022 wait complete. 2024-09-10T23:30:28.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 152, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:30:17.818575+0000', 'modified': '2024-09-10T23:30:20.823822+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11055}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11055': {'gid': 11055, 'name': 'b', 'rank': 0, 'incarnation': 148, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/2065743463', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6835', 'nonce': 2065743463}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 2065743463}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11055, 'qdb_cluster': [11055]} 2024-09-10T23:30:28.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:30:28.822 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T23:30:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 -- 172.21.15.17:0/188776727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 msgr2=0x7f9abc15b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 --2- 172.21.15.17:0/188776727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 0x7f9abc15b150 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009cb0 tx=0x7f9ab401cda0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 -- 172.21.15.17:0/188776727 shutdown_connections 2024-09-10T23:30:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 --2- 172.21.15.17:0/188776727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 0x7f9abc15b150 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 --2- 172.21.15.17:0/188776727 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9abc1546f0 0x7f9abc0726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 -- 172.21.15.17:0/188776727 >> 172.21.15.17:0/188776727 conn(0x7f9abc0b1730 msgr2=0x7f9abc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 -- 172.21.15.17:0/188776727 shutdown_connections 2024-09-10T23:30:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 -- 172.21.15.17:0/188776727 wait complete. 2024-09-10T23:30:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 Processor -- start 2024-09-10T23:30:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.971+0000 7f9ac2400640 1 -- start start 2024-09-10T23:30:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ac2400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9abc06ef80 0x7f9abc14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ac2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 0x7f9abc150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ac2400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9abc1546f0 0x7f9abc1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ac2400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc15e7b0 con 0x7f9abc0cf700 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ac2400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc15e630 con 0x7f9abc1546f0 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ac2400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc15e930 con 0x7f9abc06ef80 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 0x7f9abc150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 0x7f9abc150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45360/0 (socket says 172.21.15.17:45360) 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab2a00640 1 -- 172.21.15.17:0/2922602551 learned_addr learned my addr 172.21.15.17:0/2922602551 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9abb400640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9abc06ef80 0x7f9abc14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9abbe00640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9abc1546f0 0x7f9abc1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab2a00640 1 -- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9abc06ef80 msgr2=0x7f9abc14e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9abc06ef80 0x7f9abc14e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab2a00640 1 -- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9abc1546f0 msgr2=0x7f9abc1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9abc1546f0 0x7f9abc1507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab2a00640 1 -- 172.21.15.17:0/2922602551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc159a80 con 0x7f9abc0cf700 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9abbe00640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9abc1546f0 0x7f9abc1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 0x7f9abc150260 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c4b0 tx=0x7f9aa400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab3e00640 1 -- 172.21.15.17:0/2922602551 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40052d0 con 0x7f9abc0cf700 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab3e00640 1 -- 172.21.15.17:0/2922602551 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aa4005470 con 0x7f9abc0cf700 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab3e00640 1 -- 172.21.15.17:0/2922602551 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4012890 con 0x7f9abc0cf700 2024-09-10T23:30:28.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ac2400640 1 -- 172.21.15.17:0/2922602551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc1597a0 con 0x7f9abc0cf700 2024-09-10T23:30:28.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ac2400640 1 -- 172.21.15.17:0/2922602551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc0aa270 con 0x7f9abc0cf700 2024-09-10T23:30:28.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.975+0000 7f9ab3e00640 1 -- 172.21.15.17:0/2922602551 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9aa4003600 con 0x7f9abc0cf700 2024-09-10T23:30:28.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ab3e00640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a980725e0 0x7f9a98074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ab3e00640 1 -- 172.21.15.17:0/2922602551 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f9aa4092f10 con 0x7f9abc0cf700 2024-09-10T23:30:28.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 Processor -- start 2024-09-10T23:30:28.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abb400640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a980725e0 0x7f9a98074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 -- start start 2024-09-10T23:30:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abb400640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a980725e0 0x7f9a98074aa0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009b40 tx=0x7f9aac0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 0x557c2c6f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f12f0 0x557c2c6a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557c2c5c53f0 con 0x557c2c6a4e10 2024-09-10T23:30:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557c2c502b20 con 0x557c2c6f09d0 2024-09-10T23:30:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557c2c4f1f50 con 0x557c2c6f12f0 2024-09-10T23:30:28.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6a51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45368/0 (socket says 172.21.15.17:45368) 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abbe00640 1 -- 172.21.15.17:0/2654898857 learned_addr learned my addr 172.21.15.17:0/2654898857 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abb400640 1 --2- 172.21.15.17:0/2654898857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 0x557c2c6f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/2654898857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f12f0 0x557c2c6a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abbe00640 1 -- 172.21.15.17:0/2654898857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f12f0 msgr2=0x557c2c6a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abbe00640 1 --2- 172.21.15.17:0/2654898857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f12f0 0x557c2c6a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abbe00640 1 -- 172.21.15.17:0/2654898857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 msgr2=0x557c2c6f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abbe00640 1 --2- 172.21.15.17:0/2654898857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 0x557c2c6f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abbe00640 1 -- 172.21.15.17:0/2654898857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2c4b9590 con 0x557c2c6a4e10 2024-09-10T23:30:28.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9abbe00640 1 --2- 172.21.15.17:0/2654898857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6a51f0 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40b0040 tx=0x7f9ab4019b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10ec9529f4f2256 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9aabe00640 1 -- 172.21.15.17:0/2654898857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40b2040 con 0x557c2c6a4e10 2024-09-10T23:30:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9aabe00640 1 -- 172.21.15.17:0/2654898857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab4004a50 con 0x557c2c6a4e10 2024-09-10T23:30:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9aabe00640 1 -- 172.21.15.17:0/2654898857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4003980 con 0x557c2c6a4e10 2024-09-10T23:30:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 -- 172.21.15.17:0/2654898857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 msgr2=0x557c2c6a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2654898857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6a51f0 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40b0040 tx=0x7f9ab4019b40 comp rx=0 tx=0).stop 2024-09-10T23:30:28.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 -- 172.21.15.17:0/2654898857 shutdown_connections 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2654898857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6a51f0 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2654898857 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f12f0 0x557c2c6a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2654898857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 0x557c2c6f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.979+0000 7f9ac5836000 1 -- 172.21.15.17:0/2654898857 >> 172.21.15.17:0/2654898857 conn(0x557c2c58e130 msgr2=0x557c2c6d3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 -- 172.21.15.17:0/2654898857 shutdown_connections 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 -- 172.21.15.17:0/2654898857 wait complete. 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 -- start start 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 Processor -- start 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f09d0 0x557c2c6d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 0x557c2c6d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557c2c48c5d0 con 0x557c2c6a4e10 2024-09-10T23:30:28.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557c2c4f5d60 con 0x557c2c6f12f0 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557c2c498500 con 0x557c2c6f09d0 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 10 client.0 _ll_register_callbacks cb 0x557c2c49c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6d16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45374/0 (socket says 172.21.15.17:45374) 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abb400640 1 -- 172.21.15.17:0/1448926618 learned_addr learned my addr 172.21.15.17:0/1448926618 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f09d0 0x557c2c6d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abbe00640 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 0x557c2c6d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abb400640 1 -- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f09d0 msgr2=0x557c2c6d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abb400640 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f09d0 0x557c2c6d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abb400640 1 -- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 msgr2=0x557c2c6d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abb400640 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 0x557c2c6d23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abb400640 1 -- 172.21.15.17:0/1448926618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c2c490170 con 0x557c2c6a4e10 2024-09-10T23:30:28.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9abb400640 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6d16a0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f9aac004580 tx=0x7f9aac004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea6ce40d7c394f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9aa8c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1448926618 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac027420 con 0x557c2c6a4e10 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1448926618 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f9aac028e00 con 0x557c2c6a4e10 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 -- 172.21.15.17:0/1448926618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c2c48a0f0 con 0x557c2c6a4e10 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1448926618 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f9aac01d410 con 0x557c2c6a4e10 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 10 client.11202 fetch_fsmap learned FSMap version 152 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 -- 172.21.15.17:0/1448926618 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x557c2c576ef0 con 0x557c2c6a4e10 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1448926618 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557c2c48a0f0 con 0x557c2c6a4e10 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1448926618 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7f9aac02f050 con 0x557c2c6a4e10 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 10 client.11202 fetch_fsmap finished waiting for FSMap version 152 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 10 client.11202 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 20 client.11202 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:28.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x557c2c6d30f0 0x557c2c702c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:28.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 4 client.11202 mds_command: new command op to 11055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:28.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.983+0000 7f9ac5836000 1 -- 172.21.15.17:0/1448926618 --> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c2c504a70 con 0x557c2c6d30f0 2024-09-10T23:30:28.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x557c2c6d30f0 0x557c2c702c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x557c2c6d30f0 0x557c2c702c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5eb3f6a5777509d server_cookie=de83f69d595b56c3 in_seq=0 out_seq=0 2024-09-10T23:30:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9aa8c00640 10 client.11202 ms_handle_connect on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9aa8c00640 1 -- 172.21.15.17:0/1448926618 <== mds.0 v2:172.21.15.77:6835/2065743463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c2c504a70 con 0x557c2c6d30f0 2024-09-10T23:30:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9aa8c00640 10 client.11202 handle_command_reply: tid=0 2024-09-10T23:30:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 client.11202 shutdown 2024-09-10T23:30:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 -- 172.21.15.17:0/1448926618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 msgr2=0x557c2c6d16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6d16a0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f9aac004580 tx=0x7f9aac004740 comp rx=0 tx=0).stop 2024-09-10T23:30:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 -- 172.21.15.17:0/1448926618 shutdown_connections 2024-09-10T23:30:28.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x557c2c6d30f0 0x557c2c702c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 0x557c2c6d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6f09d0 0x557c2c6d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 --2- 172.21.15.17:0/1448926618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6a4e10 0x557c2c6d16a0 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:28.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9aa8c00640 0 client.11202 ms_handle_reset on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:28.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 -- 172.21.15.17:0/1448926618 >> 172.21.15.17:0/1448926618 conn(0x557c2c58e130 msgr2=0x557c2c6a3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:28.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 -- 172.21.15.17:0/1448926618 shutdown_connections 2024-09-10T23:30:28.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 1 -- 172.21.15.17:0/1448926618 wait complete. 2024-09-10T23:30:28.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:28.987+0000 7f9ac5836000 20 client.11202 trim_cache size 0 max 16384 2024-09-10T23:30:29.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ac5836000 1 Processor -- start 2024-09-10T23:30:29.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ac5836000 1 -- start start 2024-09-10T23:30:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 0x557c2c762dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 0x557c2c763310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f12f0 0x557c2c763850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ac5836000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc204480 con 0x557c2c6f12f0 2024-09-10T23:30:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ac5836000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc203500 con 0x557c2c6f09d0 2024-09-10T23:30:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ac5836000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc1f80a0 con 0x557c2c6a4e10 2024-09-10T23:30:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f12f0 0x557c2c763850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f12f0 0x557c2c763850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45378/0 (socket says 172.21.15.17:45378) 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abbe00640 1 -- 172.21.15.17:0/2738566737 learned_addr learned my addr 172.21.15.17:0/2738566737 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abb400640 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 0x557c2c762dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 0x557c2c763310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abbe00640 1 -- 172.21.15.17:0/2738566737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 msgr2=0x557c2c762dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abbe00640 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 0x557c2c762dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abbe00640 1 -- 172.21.15.17:0/2738566737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 msgr2=0x557c2c763310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abbe00640 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 0x557c2c763310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abbe00640 1 -- 172.21.15.17:0/2738566737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2c54dd90 con 0x557c2c6f12f0 2024-09-10T23:30:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 0x557c2c763310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9abbe00640 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f12f0 0x557c2c763850 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7f9ab401c810 tx=0x7f9ab40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96408299717cb289 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9aab400640 1 -- 172.21.15.17:0/2738566737 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40b2070 con 0x557c2c6f12f0 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9aab400640 1 -- 172.21.15.17:0/2738566737 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab4004a50 con 0x557c2c6f12f0 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.007+0000 7f9aab400640 1 -- 172.21.15.17:0/2738566737 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4003980 con 0x557c2c6f12f0 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- 172.21.15.17:0/2738566737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f12f0 msgr2=0x557c2c763850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f12f0 0x557c2c763850 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7f9ab401c810 tx=0x7f9ab40095c0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- 172.21.15.17:0/2738566737 shutdown_connections 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f12f0 0x557c2c763850 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f09d0 0x557c2c763310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2738566737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 0x557c2c762dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- 172.21.15.17:0/2738566737 >> 172.21.15.17:0/2738566737 conn(0x557c2c58e130 msgr2=0x557c2c6aca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- 172.21.15.17:0/2738566737 shutdown_connections 2024-09-10T23:30:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- 172.21.15.17:0/2738566737 wait complete. 2024-09-10T23:30:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- start start 2024-09-10T23:30:29.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 Processor -- start 2024-09-10T23:30:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 0x557c2c766c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f09d0 0x557c2c767140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 0x557c2c767680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x557c2c707ce0 con 0x557c2c6f09d0 2024-09-10T23:30:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x557c2c4fa390 con 0x557c2c6f12f0 2024-09-10T23:30:29.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x557c2c5018f0 con 0x557c2c6a4e10 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 10 client.0 _ll_register_callbacks cb 0x7f9aac011be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ab2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f09d0 0x557c2c767140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9abb400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 0x557c2c766c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ab2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f09d0 0x557c2c767140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45392/0 (socket says 172.21.15.17:45392) 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ab2a00640 1 -- 172.21.15.17:0/2378193407 learned_addr learned my addr 172.21.15.17:0/2378193407 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9abbe00640 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 0x557c2c767680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ab2a00640 1 -- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 msgr2=0x557c2c766c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 0x557c2c766c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ab2a00640 1 -- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 msgr2=0x557c2c767680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 0x557c2c767680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ab2a00640 1 -- 172.21.15.17:0/2378193407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c2c4b8a90 con 0x557c2c6f09d0 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ab2a00640 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f09d0 0x557c2c767140 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400ce70 tx=0x7f9aa405dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c347f8ee4aa3b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:29.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9aa8c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9aa8c00640 1 -- 172.21.15.17:0/2378193407 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40671d0 con 0x557c2c6f09d0 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9aa8c00640 1 -- 172.21.15.17:0/2378193407 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f9aa4059f40 con 0x557c2c6f09d0 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- 172.21.15.17:0/2378193407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ab4004a50 con 0x557c2c6f09d0 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9aa8c00640 1 -- 172.21.15.17:0/2378193407 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f9aa4077b60 con 0x557c2c6f09d0 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 10 client.11208 fetch_fsmap learned FSMap version 152 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9ac5836000 1 -- 172.21.15.17:0/2378193407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x557c2c497050 con 0x557c2c6f09d0 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.011+0000 7f9aa8c00640 1 -- 172.21.15.17:0/2378193407 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab4004a50 con 0x557c2c6f09d0 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9aa8c00640 1 -- 172.21.15.17:0/2378193407 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7f9aa405cf30 con 0x557c2c6f09d0 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 10 client.11208 fetch_fsmap finished waiting for FSMap version 152 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 10 client.11208 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 20 client.11208 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x557c2c706250 0x557c2c76fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 4 client.11208 mds_command: new command op to 11055 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 -- 172.21.15.17:0/2378193407 --> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] -- command(tid 0: {"prefix": "status"}) -- 0x557c2c500520 con 0x557c2c706250 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9abb400640 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x557c2c706250 0x557c2c76fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9abb400640 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x557c2c706250 0x557c2c76fe60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab11be6907938204 server_cookie=6ddd03db5ade28e3 in_seq=0 out_seq=0 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9aa8c00640 10 client.11208 ms_handle_connect on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9aa8c00640 1 -- 172.21.15.17:0/2378193407 <== mds.0 v2:172.21.15.77:6835/2065743463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x557c2c500520 con 0x557c2c706250 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9aa8c00640 10 client.11208 handle_command_reply: tid=0 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 client.11208 shutdown 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 -- 172.21.15.17:0/2378193407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f09d0 msgr2=0x557c2c767140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f09d0 0x557c2c767140 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400ce70 tx=0x7f9aa405dac0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 -- 172.21.15.17:0/2378193407 shutdown_connections 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x557c2c706250 0x557c2c76fe60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x557c2c6f12f0 0x557c2c767680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c2c6f09d0 0x557c2c767140 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 --2- 172.21.15.17:0/2378193407 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x557c2c6a4e10 0x557c2c766c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9aa8c00640 0 client.11208 ms_handle_reset on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 -- 172.21.15.17:0/2378193407 >> 172.21.15.17:0/2378193407 conn(0x557c2c58e130 msgr2=0x557c2c6ef5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 -- 172.21.15.17:0/2378193407 shutdown_connections 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 1 -- 172.21.15.17:0/2378193407 wait complete. 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac5836000 20 client.11208 trim_cache size 0 max 16384 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:30:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 11055, 2024-09-10T23:30:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:30:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:30:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:30:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 10.614955934999999, 2024-09-10T23:30:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 152, 2024-09-10T23:30:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 201, 2024-09-10T23:30:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 201, 2024-09-10T23:30:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 15.798128725 2024-09-10T23:30:29.022 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:30:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 -- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a980725e0 msgr2=0x7f9a98074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a980725e0 0x7f9a98074aa0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009b40 tx=0x7f9aac0091e0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 -- 172.21.15.17:0/2922602551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 msgr2=0x7f9abc150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 0x7f9abc150260 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c4b0 tx=0x7f9aa400c970 comp rx=0 tx=0).stop 2024-09-10T23:30:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 -- 172.21.15.17:0/2922602551 shutdown_connections 2024-09-10T23:30:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9a980725e0 0x7f9a98074aa0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9abc1546f0 0x7f9abc1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9abc0cf700 0x7f9abc150260 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 --2- 172.21.15.17:0/2922602551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9abc06ef80 0x7f9abc14e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 -- 172.21.15.17:0/2922602551 >> 172.21.15.17:0/2922602551 conn(0x7f9abc0b1730 msgr2=0x7f9abc151000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 -- 172.21.15.17:0/2922602551 shutdown_connections 2024-09-10T23:30:29.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.015+0000 7f9ac2400640 1 -- 172.21.15.17:0/2922602551 wait complete. 2024-09-10T23:30:29.037 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:30:29.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 -- 172.21.15.17:0/575224651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15ef40 msgr2=0x7f2d2c15afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:29.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 --2- 172.21.15.17:0/575224651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15ef40 0x7f2d2c15afe0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009900 tx=0x7f2d2001c8b0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 -- 172.21.15.17:0/575224651 shutdown_connections 2024-09-10T23:30:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 --2- 172.21.15.17:0/575224651 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d2c15e5d0 0x7f2d2c0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 --2- 172.21.15.17:0/575224651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15ef40 0x7f2d2c15afe0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 -- 172.21.15.17:0/575224651 >> 172.21.15.17:0/575224651 conn(0x7f2d2c06cfc0 msgr2=0x7f2d2c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 -- 172.21.15.17:0/575224651 shutdown_connections 2024-09-10T23:30:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 -- 172.21.15.17:0/575224651 wait complete. 2024-09-10T23:30:29.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 Processor -- start 2024-09-10T23:30:29.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 -- start start 2024-09-10T23:30:29.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d2c0b4370 0x7f2d2c151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15e5d0 0x7f2d2c14a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d2c15ef40 0x7f2d2c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c1678e0 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c167760 con 0x7f2d2c15ef40 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d33400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2c167a60 con 0x7f2d2c0b4370 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15e5d0 0x7f2d2c14a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15e5d0 0x7f2d2c14a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45406/0 (socket says 172.21.15.17:45406) 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.183+0000 7f2d2be00640 1 -- 172.21.15.17:0/375607855 learned_addr learned my addr 172.21.15.17:0/375607855 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d30a00640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d2c0b4370 0x7f2d2c151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d31400640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d2c15ef40 0x7f2d2c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d2be00640 1 -- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d2c0b4370 msgr2=0x7f2d2c151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d2be00640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d2c0b4370 0x7f2d2c151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d2be00640 1 -- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d2c15ef40 msgr2=0x7f2d2c14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d2be00640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d2c15ef40 0x7f2d2c14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d2be00640 1 -- 172.21.15.17:0/375607855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c154720 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d2be00640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15e5d0 0x7f2d2c14a7a0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800d980 tx=0x7f2d1800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:29.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d28c00640 1 -- 172.21.15.17:0/375607855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18017070 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d28c00640 1 -- 172.21.15.17:0/375607855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d18009d20 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2c154a00 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d28c00640 1 -- 172.21.15.17:0/375607855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18004280 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2c14bbc0 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2c0b3e30 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d28c00640 1 -- 172.21.15.17:0/375607855 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2d18003600 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d28c00640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2d0c0725e0 0x7f2d0c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:29.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.187+0000 7f2d28c00640 1 -- 172.21.15.17:0/375607855 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f2d18093910 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.191+0000 7f2d30a00640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2d0c0725e0 0x7f2d0c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:29.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.191+0000 7f2d30a00640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2d0c0725e0 0x7f2d0c074aa0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2d200af000 tx=0x7f2d2001b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:29.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.191+0000 7f2d28c00640 1 -- 172.21.15.17:0/375607855 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2d1805e770 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2d2c15a000 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d28c00640 1 -- 172.21.15.17:0/375607855 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v152) ==== 53+0+73 (secure 0 0 0) 0x7f2d180631a0 con 0x7f2d2c15e5d0 2024-09-10T23:30:29.408 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:30:29.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2d0c0725e0 msgr2=0x7f2d0c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:29.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2d0c0725e0 0x7f2d0c074aa0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2d200af000 tx=0x7f2d2001b0f0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15e5d0 msgr2=0x7f2d2c14a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:29.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15e5d0 0x7f2d2c14a7a0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800d980 tx=0x7f2d1800de40 comp rx=0 tx=0).stop 2024-09-10T23:30:29.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 shutdown_connections 2024-09-10T23:30:29.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2d0c0725e0 0x7f2d0c074aa0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d2c15ef40 0x7f2d2c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d2c15e5d0 0x7f2d2c14a7a0 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 --2- 172.21.15.17:0/375607855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d2c0b4370 0x7f2d2c151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:29.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 >> 172.21.15.17:0/375607855 conn(0x7f2d2c06cfc0 msgr2=0x7f2d2c0b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:29.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 shutdown_connections 2024-09-10T23:30:29.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29.407+0000 7f2d33400640 1 -- 172.21.15.17:0/375607855 wait complete. 2024-09-10T23:30:29.429 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:30:29.429 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:30:29.429 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:30:29.429 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:30:29.429 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:30:29.429 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:30:29.429 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:30:29.429 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:30:29.429 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:30:29.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:29.430 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:30:29.439 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:30:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:30:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:30:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:30:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:30:29.439 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41542sec preferred_lft 41542sec 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:30:29.440 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:30:29.441 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:30:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:30:29.442 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:30:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:30:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:30:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:30:29.442 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:30:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:30:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:30:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:30:29.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:29.443 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:30:29.505 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:30:29.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:29.507 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:30:29.560 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:30:29.560 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:30:29.560 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:30:29.560 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:30:29.560 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:30:29.560 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:30:29.560 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:30:29.560 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:30:29.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:30:29.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:30:29.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:30:29.561 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:30:29.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:30:29.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:30:29.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:29.705 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:30:29.714 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:30:29.715 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:30:29.715 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:30:29.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:29.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:30:29.783 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:30:29.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:30:29.783 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:30:29.843 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:30:29.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:30:29.843 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:30:29.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:30:29.972 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:30:30.029 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:30:30.030 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:30:30.031 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:30:30.032 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:30:30.032 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:30:30.032 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:30:30.032 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:30:30.032 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:30:30.032 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:30:30.032 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:30:30.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:30.033 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:30:30.087 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:30:30.088 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:30:30.134 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:30:30.156 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:30:30.209 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:30:30.209 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:30:30.209 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:30:30.209 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:30:30.209 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:30:30.209 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:30:30.209 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:30:30.210 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:30:30.211 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:30:30.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:30.212 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:30:30.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:30:30.227+0000 7ff3bbe48580 -1 init, newargv = 0x55e7b2cdff30 newargc=15 2024-09-10T23:30:30.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[88467]: starting ceph client 2024-09-10T23:30:30.237 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[88467]: starting fuse 2024-09-10T23:30:30.239 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:30:30.239 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:30:30.239 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:30:30.239 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:30:30.239 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:30:30.240 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:30:30.241 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:30:30.241 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:30:30.241 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:30:30.241 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:30:30.241 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:30:30.241 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:30:30.241 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:30:30.241 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:30:30.241 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:30:30.368 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.88467.asok 2024-09-10T23:30:30.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:30:30.379 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.88467.asok 2024-09-10T23:30:30.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:30.379 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.88467.asok status 2024-09-10T23:30:30.559 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:30:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:30:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:30:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:30:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:30:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:30:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:30:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "88467", 2024-09-10T23:30:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 11223, 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 11223 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:30:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3647810568 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3647810568 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.11223 192.168.0.1:0/3647810568", 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/3647810568", 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 152, 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 201, 2024-09-10T23:30:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:30:30.562 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:30:30.562 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:30:30.562 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:30:30.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:30.575 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:30:30.575 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:30:30.585 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:30:30.585 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:30:30.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:30.585 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:30:30.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:30.648 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-10T23:30:30.712 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:30:30.712 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:30:30.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:30.763 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-10T23:30:30.885 INFO:teuthology.orchestra.run.smithi017.stderr:6+0 records in 2024-09-10T23:30:30.885 INFO:teuthology.orchestra.run.smithi017.stderr:6+0 records out 2024-09-10T23:30:30.885 INFO:teuthology.orchestra.run.smithi017.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0656585 s, 95.8 MB/s 2024-09-10T23:30:30.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:30:30.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:30:30.930 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-10T23:30:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-10T23:30:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:30:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-10T23:30:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-10T23:30:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:30:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-10T23:30:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-10T23:30:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-10T23:30:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 20 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 20 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 10 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.936 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 30 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:30:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:30:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: mon down mkfs grace = 300 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:30:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = "" 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: mds cache max size = 1000 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: mds log max segments = 1 2024-09-10T23:30:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: mds verify scatter = False 2024-09-10T23:30:30.941 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-10T23:30:30.941 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-10T23:30:30.941 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:30:30.941 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-10T23:30:30.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.941 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-10T23:30:30.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.941 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:30:30.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.943 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-10T23:30:30.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.945 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-10T23:30:30.946 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.947 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 30 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:30:30.948 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:30:30.949 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:30:30.950 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:30:30.951 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2024-09-10T23:30:30.951 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-10T23:30:30.951 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-10T23:30:30.951 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-10T23:30:30.951 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-10T23:30:30.951 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-10T23:30:30.952 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-10T23:30:30.952 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-10T23:30:30.952 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-09-10T23:30:30.952 INFO:teuthology.orchestra.run.smithi077.stdout: mds cache max size = 1000 2024-09-10T23:30:30.952 INFO:teuthology.orchestra.run.smithi077.stdout: mds log max segments = 1 2024-09-10T23:30:30.952 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = False 2024-09-10T23:30:30.954 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:30:30.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:30:31.038 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-10T23:30:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-10T23:30:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:30:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 20 2024-09-10T23:30:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 20 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 10 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-10T23:30:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 30 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:30:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:30:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: mon down mkfs grace = 300 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = "" 2024-09-10T23:30:31.048 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout: mds cache max size = 1000 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout: mds log max segments = 1 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout: mds verify scatter = False 2024-09-10T23:30:31.049 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug scatterstat = False 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.051 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-10T23:30:31.052 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-10T23:30:31.053 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:30:31.054 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-10T23:30:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-10T23:30:31.056 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 30 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-10T23:30:31.057 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:30:31.058 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:30:31.059 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout: mds cache max size = 1000 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout: mds log max segments = 1 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = False 2024-09-10T23:30:31.060 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = False 2024-09-10T23:30:31.062 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:30:31.062 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:30:31.062 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-09-10T23:30:31.062 DEBUG:teuthology.orchestra.run.smithi017:> import json 2024-09-10T23:30:31.062 DEBUG:teuthology.orchestra.run.smithi017:> import sys 2024-09-10T23:30:31.062 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:30:31.062 DEBUG:teuthology.orchestra.run.smithi017:> try: 2024-09-10T23:30:31.062 DEBUG:teuthology.orchestra.run.smithi017:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-10T23:30:31.063 DEBUG:teuthology.orchestra.run.smithi017:> except OSError as e: 2024-09-10T23:30:31.063 DEBUG:teuthology.orchestra.run.smithi017:> sys.exit(e.errno) 2024-09-10T23:30:31.063 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:30:31.063 DEBUG:teuthology.orchestra.run.smithi017:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T23:30:31.063 DEBUG:teuthology.orchestra.run.smithi017:> print(json.dumps( 2024-09-10T23:30:31.063 DEBUG:teuthology.orchestra.run.smithi017:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T23:30:31.063 DEBUG:teuthology.orchestra.run.smithi017:> indent=2)) 2024-09-10T23:30:31.063 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:30:31.174 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:30:31.174 INFO:teuthology.orchestra.run.smithi017.stdout: "st_mode": 33204, 2024-09-10T23:30:31.174 INFO:teuthology.orchestra.run.smithi017.stdout: "st_ino": 1099511627777, 2024-09-10T23:30:31.174 INFO:teuthology.orchestra.run.smithi017.stdout: "st_dev": 44, 2024-09-10T23:30:31.175 INFO:teuthology.orchestra.run.smithi017.stdout: "st_nlink": 1, 2024-09-10T23:30:31.175 INFO:teuthology.orchestra.run.smithi017.stdout: "st_uid": 1000, 2024-09-10T23:30:31.175 INFO:teuthology.orchestra.run.smithi017.stdout: "st_gid": 1271, 2024-09-10T23:30:31.175 INFO:teuthology.orchestra.run.smithi017.stdout: "st_size": 6291456, 2024-09-10T23:30:31.175 INFO:teuthology.orchestra.run.smithi017.stdout: "st_atime": 1726011030.8187892, 2024-09-10T23:30:31.175 INFO:teuthology.orchestra.run.smithi017.stdout: "st_mtime": 1726011030.8671722, 2024-09-10T23:30:31.175 INFO:teuthology.orchestra.run.smithi017.stdout: "st_ctime": 1726011030.8671722 2024-09-10T23:30:31.175 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:30:31.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:30:31.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:30:31.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 -- 172.21.15.17:0/3388961869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 msgr2=0x7fb568165fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 --2- 172.21.15.17:0/3388961869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 0x7fb568165fe0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fb56809ba20 tx=0x7fb56001cd80 comp rx=0 tx=0).stop 2024-09-10T23:30:31.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 -- 172.21.15.17:0/3388961869 shutdown_connections 2024-09-10T23:30:31.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 --2- 172.21.15.17:0/3388961869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 0x7fb568165fe0 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 --2- 172.21.15.17:0/3388961869 >> v2:172.21.15.77:3300/0 conn(0x7fb5680b19f0 0x7fb568163a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 -- 172.21.15.17:0/3388961869 >> 172.21.15.17:0/3388961869 conn(0x7fb5680b3870 msgr2=0x7fb5680b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:31.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 -- 172.21.15.17:0/3388961869 shutdown_connections 2024-09-10T23:30:31.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 -- 172.21.15.17:0/3388961869 wait complete. 2024-09-10T23:30:31.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 Processor -- start 2024-09-10T23:30:31.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 -- start start 2024-09-10T23:30:31.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.371+0000 7fb56fa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 0x7fb568153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56fa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5680b19f0 0x7fb568163de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56fa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56815f550 0x7fb568155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56fa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681693b0 con 0x7fb5680b0d90 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56fa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb568169230 con 0x7fb56815f550 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56fa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb568169530 con 0x7fb5680b19f0 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 0x7fb568153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 0x7fb568153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45436/0 (socket says 172.21.15.17:45436) 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56d000640 1 -- 172.21.15.17:0/1333090083 learned_addr learned my addr 172.21.15.17:0/1333090083 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb567e00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5680b19f0 0x7fb568163de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56da00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56815f550 0x7fb568155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56d000640 1 -- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5680b19f0 msgr2=0x7fb568163de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56d000640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5680b19f0 0x7fb568163de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56d000640 1 -- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56815f550 msgr2=0x7fb568155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56d000640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56815f550 0x7fb568155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56d000640 1 -- 172.21.15.17:0/1333090083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56806e270 con 0x7fb5680b0d90 2024-09-10T23:30:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56d000640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 0x7fb568153170 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00b410 tx=0x7fb55c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb564c00640 1 -- 172.21.15.17:0/1333090083 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c015030 con 0x7fb5680b0d90 2024-09-10T23:30:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb564c00640 1 -- 172.21.15.17:0/1333090083 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb55c004020 con 0x7fb5680b0d90 2024-09-10T23:30:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb564c00640 1 -- 172.21.15.17:0/1333090083 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0044b0 con 0x7fb5680b0d90 2024-09-10T23:30:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56806e4f0 con 0x7fb5680b0d90 2024-09-10T23:30:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb568154a50 con 0x7fb5680b0d90 2024-09-10T23:30:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5680b12e0 con 0x7fb5680b0d90 2024-09-10T23:30:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.375+0000 7fb564c00640 1 -- 172.21.15.17:0/1333090083 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb55c022060 con 0x7fb5680b0d90 2024-09-10T23:30:31.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.379+0000 7fb564c00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5480725e0 0x7fb548074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.379+0000 7fb564c00640 1 -- 172.21.15.17:0/1333090083 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fb55c092de0 con 0x7fb5680b0d90 2024-09-10T23:30:31.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.379+0000 7fb567e00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5480725e0 0x7fb548074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.379+0000 7fb567e00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5480725e0 0x7fb548074aa0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb56806f650 tx=0x7fb55400b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:31.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.383+0000 7fb564c00640 1 -- 172.21.15.17:0/1333090083 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb56806e270 con 0x7fb5680b0d90 2024-09-10T23:30:31.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5680d0120 con 0x7fb5680b0d90 2024-09-10T23:30:31.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb564c00640 1 -- 172.21.15.17:0/1333090083 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5234 (secure 0 0 0) 0x7fb55c05dcd0 con 0x7fb5680b0d90 2024-09-10T23:30:31.593 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:30:31.593 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":152,"btime":"2024-09-10T23:30:21:423641+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/762449917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":762449917},{"type":"v1","addr":"172.21.15.77:6836","nonce":762449917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/661473457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":661473457},{"type":"v1","addr":"172.21.15.17:6834","nonce":661473457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11049,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3378779893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3378779893},{"type":"v1","addr":"172.21.15.17:6835","nonce":3378779893}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:30:17.818575+0000","modified":"2024-09-10T23:30:20.823822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11055":{"gid":11055,"name":"b","rank":0,"incarnation":148,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2065743463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2065743463},{"type":"v1","addr":"172.21.15.77:6837","nonce":2065743463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11055,"qdb_cluster":[11055]},"id":14}]} 2024-09-10T23:30:31.594 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 152 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5480725e0 msgr2=0x7fb548074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5480725e0 0x7fb548074aa0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb56806f650 tx=0x7fb55400b390 comp rx=0 tx=0).stop 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 msgr2=0x7fb568153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 0x7fb568153170 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00b410 tx=0x7fb55c00b8d0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 shutdown_connections 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5480725e0 0x7fb548074aa0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56815f550 0x7fb568155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5680b19f0 0x7fb568163de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 --2- 172.21.15.17:0/1333090083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5680b0d90 0x7fb568153170 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 >> 172.21.15.17:0/1333090083 conn(0x7fb5680b3870 msgr2=0x7fb5680cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 shutdown_connections 2024-09-10T23:30:31.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.591+0000 7fb56fa00640 1 -- 172.21.15.17:0/1333090083 wait complete. 2024-09-10T23:30:31.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-10T23:30:31.781 INFO:teuthology.orchestra.run.smithi077.stdout:{"message":"","return_code":0} 2024-09-10T23:30:31.782 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T23:30:31.782 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-09-10T23:30:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.827+0000 7fe479f19080 1 Processor -- start 2024-09-10T23:30:31.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.827+0000 7fe479f19080 1 -- start start 2024-09-10T23:30:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.827+0000 7fe479f19080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3bdb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.827+0000 7fe479f19080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc0370 0x5590b3bddc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.827+0000 7fe479f19080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590b3bc1bc0 0x5590b3b37f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5590b3ab1f40 con 0x5590b3bc0370 2024-09-10T23:30:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5590b3abed00 con 0x5590b3bc1bc0 2024-09-10T23:30:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5590b3a53a00 con 0x5590b3bbebf0 2024-09-10T23:30:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3bdb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3bdb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:43064/0 (socket says 172.21.15.17:43064) 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477200640 1 -- 172.21.15.17:0/1637780966 learned_addr learned my addr 172.21.15.17:0/1637780966 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe46fe00640 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc0370 0x5590b3bddc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477c00640 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590b3bc1bc0 0x5590b3b37f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477200640 1 -- 172.21.15.17:0/1637780966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590b3bc1bc0 msgr2=0x5590b3b37f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477200640 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590b3bc1bc0 0x5590b3b37f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477200640 1 -- 172.21.15.17:0/1637780966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc0370 msgr2=0x5590b3bddc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477200640 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc0370 0x5590b3bddc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477200640 1 -- 172.21.15.17:0/1637780966 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590b3bde6d0 con 0x5590b3bbebf0 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe46fe00640 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc0370 0x5590b3bddc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:31.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe477200640 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3bdb670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe468004f80 tx=0x7fe46801a7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da9c9e38d6405835 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe475e00640 1 -- 172.21.15.17:0/1637780966 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4680a7af0 con 0x5590b3bbebf0 2024-09-10T23:30:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe475e00640 1 -- 172.21.15.17:0/1637780966 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4680a7c90 con 0x5590b3bbebf0 2024-09-10T23:30:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe475e00640 1 -- 172.21.15.17:0/1637780966 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4680b06b0 con 0x5590b3bbebf0 2024-09-10T23:30:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- 172.21.15.17:0/1637780966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 msgr2=0x5590b3bdb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3bdb670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe468004f80 tx=0x7fe46801a7f0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- 172.21.15.17:0/1637780966 shutdown_connections 2024-09-10T23:30:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590b3bc1bc0 0x5590b3b37f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc0370 0x5590b3bddc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 --2- 172.21.15.17:0/1637780966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3bdb670 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- 172.21.15.17:0/1637780966 >> 172.21.15.17:0/1637780966 conn(0x5590b3b34700 msgr2=0x5590b3b4f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- 172.21.15.17:0/1637780966 shutdown_connections 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- 172.21.15.17:0/1637780966 wait complete. 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 Processor -- start 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- start start 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3b502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590b3bc0370 0x5590b3bda4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc1bc0 0x5590b3b48c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5590b3bdec10 con 0x5590b3bc1bc0 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5590b3bde970 con 0x5590b3bc0370 2024-09-10T23:30:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.831+0000 7fe479f19080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5590b3b50a30 con 0x5590b3bbebf0 2024-09-10T23:30:31.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3b502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe46fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590b3bc0370 0x5590b3bda4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3b502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:43070/0 (socket says 172.21.15.17:43070) 2024-09-10T23:30:31.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477200640 1 -- 172.21.15.17:0/2073805264 learned_addr learned my addr 172.21.15.17:0/2073805264 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:31.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477c00640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc1bc0 0x5590b3b48c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477200640 1 -- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590b3bc0370 msgr2=0x5590b3bda4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477200640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5590b3bc0370 0x5590b3bda4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477200640 1 -- 172.21.15.17:0/2073805264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc1bc0 msgr2=0x5590b3b48c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477200640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc1bc0 0x5590b3b48c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477200640 1 -- 172.21.15.17:0/2073805264 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590b3b367c0 con 0x5590b3bbebf0 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477c00640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5590b3bc1bc0 0x5590b3b48c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe477200640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3b502e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe46801f130 tx=0x7fe4680a7940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe474a00640 1 -- 172.21.15.17:0/2073805264 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4680b1a10 con 0x5590b3bbebf0 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe474a00640 1 -- 172.21.15.17:0/2073805264 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4680c3070 con 0x5590b3bbebf0 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe474a00640 1 -- 172.21.15.17:0/2073805264 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4680b1e50 con 0x5590b3bbebf0 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590b3b36a60 con 0x5590b3bbebf0 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5590b3b36fa0 con 0x5590b3bbebf0 2024-09-10T23:30:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.835+0000 7fe474a00640 1 -- 172.21.15.17:0/2073805264 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe4680c8460 con 0x5590b3bbebf0 2024-09-10T23:30:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe474a00640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe454071160 0x7fe454073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe474a00640 1 -- 172.21.15.17:0/2073805264 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fe468130840 con 0x5590b3bbebf0 2024-09-10T23:30:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe46fe00640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe454071160 0x7fe454073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x5590b3bdaa10 0x5590b3b376e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 --> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e201) -- 0x5590b3b37c20 con 0x5590b3bdaa10 2024-09-10T23:30:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe477c00640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x5590b3bdaa10 0x5590b3b376e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe46fe00640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe454071160 0x7fe454073620 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe46000f7f0 tx=0x7fe460002c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe477c00640 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x5590b3bdaa10 0x5590b3b376e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe477c00640 1 -- 172.21.15.17:0/2073805264 <== osd.2 v2:172.21.15.17:6816/2333448301 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v201'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe470002670 con 0x5590b3bdaa10 2024-09-10T23:30:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x5590b3bdaa10 msgr2=0x5590b3b376e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x5590b3bdaa10 0x5590b3b376e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:31.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe454071160 msgr2=0x7fe454073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe454071160 0x7fe454073620 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe46000f7f0 tx=0x7fe460002c60 comp rx=0 tx=0).stop 2024-09-10T23:30:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 msgr2=0x5590b3b502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 --2- 172.21.15.17:0/2073805264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5590b3bbebf0 0x5590b3b502e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe46801f130 tx=0x7fe4680a7940 comp rx=0 tx=0).stop 2024-09-10T23:30:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe477c00640 1 -- 172.21.15.17:0/2073805264 reap_dead start 2024-09-10T23:30:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 shutdown_connections 2024-09-10T23:30:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 >> 172.21.15.17:0/2073805264 conn(0x5590b3b34700 msgr2=0x5590b3b4f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 shutdown_connections 2024-09-10T23:30:31.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.839+0000 7fe479f19080 1 -- 172.21.15.17:0/2073805264 wait complete. 2024-09-10T23:30:31.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:31.846 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-09-10T23:30:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.995+0000 7fd5ad400640 1 -- 172.21.15.17:0/3142509522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a8161620 msgr2=0x7fd5a80b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.995+0000 7fd5ad400640 1 --2- 172.21.15.17:0/3142509522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a8161620 0x7fd5a80b2430 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8073d50 tx=0x7fd59801eff0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.995+0000 7fd5ad400640 1 -- 172.21.15.17:0/3142509522 shutdown_connections 2024-09-10T23:30:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.995+0000 7fd5ad400640 1 --2- 172.21.15.17:0/3142509522 >> v2:172.21.15.17:3300/0 conn(0x7fd5a80b2970 0x7fd5a80ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.995+0000 7fd5ad400640 1 --2- 172.21.15.17:0/3142509522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a8161620 0x7fd5a80b2430 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.995+0000 7fd5ad400640 1 -- 172.21.15.17:0/3142509522 >> 172.21.15.17:0/3142509522 conn(0x7fd5a80d1bc0 msgr2=0x7fd5a80d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.995+0000 7fd5ad400640 1 -- 172.21.15.17:0/3142509522 shutdown_connections 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.995+0000 7fd5ad400640 1 -- 172.21.15.17:0/3142509522 wait complete. 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.995+0000 7fd5ad400640 1 Processor -- start 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5ad400640 1 -- start start 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5ad400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a80b0b50 0x7fd5a80ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5ad400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a8161620 0x7fd5a80c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5ad400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a80c9a20 0x7fd5a8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5ad400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a80aede0 con 0x7fd5a80c9a20 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5ad400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a80d1970 con 0x7fd5a80b0b50 2024-09-10T23:30:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5ad400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a80aef60 con 0x7fd5a8161620 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5a7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a8161620 0x7fd5a80c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5aca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a80c9a20 0x7fd5a8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5a7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a80b0b50 0x7fd5a80ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5a7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a8161620 0x7fd5a80c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:43076/0 (socket says 172.21.15.17:43076) 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5a7400640 1 -- 172.21.15.17:0/3350313549 learned_addr learned my addr 172.21.15.17:0/3350313549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5aca00640 1 -- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a8161620 msgr2=0x7fd5a80c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5aca00640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a8161620 0x7fd5a80c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5aca00640 1 -- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a80b0b50 msgr2=0x7fd5a80ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5aca00640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a80b0b50 0x7fd5a80ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5aca00640 1 -- 172.21.15.17:0/3350313549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a81f5850 con 0x7fd5a80c9a20 2024-09-10T23:30:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5a7400640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a8161620 0x7fd5a80c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5aca00640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a80c9a20 0x7fd5a8153be0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000cad0 tx=0x7fd5a000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd59fe00640 1 -- 172.21.15.17:0/3350313549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0016020 con 0x7fd5a80c9a20 2024-09-10T23:30:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd59fe00640 1 -- 172.21.15.17:0/3350313549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5a000ab60 con 0x7fd5a80c9a20 2024-09-10T23:30:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd59fe00640 1 -- 172.21.15.17:0/3350313549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a000ce10 con 0x7fd5a80c9a20 2024-09-10T23:30:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5ad400640 1 -- 172.21.15.17:0/3350313549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a81f5e90 con 0x7fd5a80c9a20 2024-09-10T23:30:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:31.999+0000 7fd5ad400640 1 -- 172.21.15.17:0/3350313549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a81f6450 con 0x7fd5a80c9a20 2024-09-10T23:30:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd59fe00640 1 -- 172.21.15.17:0/3350313549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd5a0012420 con 0x7fd5a80c9a20 2024-09-10T23:30:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd59fe00640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5880725e0 0x7fd588074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5b1e4a000 1 Processor -- start 2024-09-10T23:30:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd59fe00640 1 -- 172.21.15.17:0/3350313549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fd5a00937b0 con 0x7fd5a80c9a20 2024-09-10T23:30:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5b1e4a000 1 -- start start 2024-09-10T23:30:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5880725e0 0x7fd588074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e75030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e2bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559957c39bb0 con 0x559957e75570 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559957c2a410 con 0x559957e74c50 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559957c87cc0 con 0x559957e2b730 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5880725e0 0x7fd588074aa0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd5980b2000 tx=0x7fd59801d830 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5a7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5a7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45458/0 (socket says 172.21.15.17:45458) 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5a7400640 1 -- 172.21.15.17:0/1620380655 learned_addr learned my addr 172.21.15.17:0/1620380655 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5a7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e75030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.003+0000 7fd5aca00640 1 --2- 172.21.15.17:0/1620380655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e2bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5a7400640 1 -- 172.21.15.17:0/1620380655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 msgr2=0x559957e2bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5a7400640 1 --2- 172.21.15.17:0/1620380655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e2bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5a7400640 1 -- 172.21.15.17:0/1620380655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 msgr2=0x559957e75030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5a7400640 1 --2- 172.21.15.17:0/1620380655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e75030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5a7400640 1 -- 172.21.15.17:0/1620380655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559957c2bd60 con 0x559957e75570 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5a7400640 1 --2- 172.21.15.17:0/1620380655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b1f0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fd594011650 tx=0x7fd594011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6735249807180e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd59cc00640 1 -- 172.21.15.17:0/1620380655 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59401e070 con 0x559957e75570 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd59cc00640 1 -- 172.21.15.17:0/1620380655 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd59400fc90 con 0x559957e75570 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd59cc00640 1 -- 172.21.15.17:0/1620380655 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594019430 con 0x559957e75570 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1620380655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 msgr2=0x559957e2b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1620380655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b1f0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fd594011650 tx=0x7fd594011b10 comp rx=0 tx=0).stop 2024-09-10T23:30:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1620380655 shutdown_connections 2024-09-10T23:30:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1620380655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e2bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1620380655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b1f0 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1620380655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e75030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1620380655 >> 172.21.15.17:0/1620380655 conn(0x559957e276e0 msgr2=0x559957e29ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1620380655 shutdown_connections 2024-09-10T23:30:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1620380655 wait complete. 2024-09-10T23:30:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 -- start start 2024-09-10T23:30:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 Processor -- start 2024-09-10T23:30:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e745a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e36a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e36f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559957c7af00 con 0x559957e75570 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559957c770f0 con 0x559957e74c50 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x559957c1c6b0 con 0x559957e2b730 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5b1e4a000 10 client.0 _ll_register_callbacks cb 0x559957c1b310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5aca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e36f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5aca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e36f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45468/0 (socket says 172.21.15.17:45468) 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5aca00640 1 -- 172.21.15.17:0/1311332392 learned_addr learned my addr 172.21.15.17:0/1311332392 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e745a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.007+0000 7fd5a7400640 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e36a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5aca00640 1 -- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 msgr2=0x559957e745a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5aca00640 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e745a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5aca00640 1 -- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 msgr2=0x559957e36a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5aca00640 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e36a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5aca00640 1 -- 172.21.15.17:0/1311332392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559957c152f0 con 0x559957e75570 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5aca00640 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e36f90 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000caa0 tx=0x7fd5a005e1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c7c706c699de15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 1 -- 172.21.15.17:0/1311332392 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0067860 con 0x559957e75570 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 1 -- 172.21.15.17:0/1311332392 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fd5a005d900 con 0x559957e75570 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1311332392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559957c0f430 con 0x559957e75570 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 1 -- 172.21.15.17:0/1311332392 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fd5a0073040 con 0x559957e75570 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 10 client.11250 fetch_fsmap learned FSMap version 152 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1311332392 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x559957c32f40 con 0x559957e75570 2024-09-10T23:30:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 1 -- 172.21.15.17:0/1311332392 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559957c0f430 con 0x559957e75570 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 1 -- 172.21.15.17:0/1311332392 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7fd5a008ace0 con 0x559957e75570 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 10 client.11250 fetch_fsmap finished waiting for FSMap version 152 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 10 client.11250 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 20 client.11250 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x559957e37cd0 0x559957e86f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 4 client.11250 mds_command: new command op to 11055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1311332392 --> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559957c89c10 con 0x559957e37cd0 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x559957e37cd0 0x559957e86f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x559957e37cd0 0x559957e86f10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcfb5e6741fb0f75 server_cookie=9ac4814d4afa7333 in_seq=0 out_seq=0 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 10 client.11250 ms_handle_connect on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 1 -- 172.21.15.17:0/1311332392 <== mds.0 v2:172.21.15.77:6835/2065743463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559957c89c10 con 0x559957e37cd0 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 10 client.11250 handle_command_reply: tid=0 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 client.11250 shutdown 2024-09-10T23:30:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1311332392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 msgr2=0x559957e36f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e36f90 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000caa0 tx=0x7fd5a005e1b0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1311332392 shutdown_connections 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x559957e37cd0 0x559957e86f10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e36f90 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e36a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/1311332392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e745a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd591600640 0 client.11250 ms_handle_reset on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1311332392 >> 172.21.15.17:0/1311332392 conn(0x559957e276e0 msgr2=0x559957e2a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1311332392 shutdown_connections 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.011+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/1311332392 wait complete. 2024-09-10T23:30:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.015+0000 7fd5b1e4a000 20 client.11250 trim_cache size 0 max 16384 2024-09-10T23:30:32.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5b1e4a000 1 Processor -- start 2024-09-10T23:30:32.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5b1e4a000 1 -- start start 2024-09-10T23:30:32.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e8a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e2aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x559957e30cf0 con 0x559957e75570 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a82014b0 con 0x559957e74c50 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a82004f0 con 0x559957e2b730 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5aca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5aca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45478/0 (socket says 172.21.15.17:45478) 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5aca00640 1 -- 172.21.15.17:0/2636817390 learned_addr learned my addr 172.21.15.17:0/2636817390 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e8a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.031+0000 7fd5a7400640 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e2aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 -- 172.21.15.17:0/2636817390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 msgr2=0x559957e8a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e8a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 -- 172.21.15.17:0/2636817390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 msgr2=0x559957e2aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e2aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 -- 172.21.15.17:0/2636817390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559957e2f750 con 0x559957e75570 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e8a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b020 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0000f90 tx=0x7fd5a0072d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eab4b40a5077be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd593e00640 1 -- 172.21.15.17:0/2636817390 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00630d0 con 0x559957e75570 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd593e00640 1 -- 172.21.15.17:0/2636817390 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5a005d900 con 0x559957e75570 2024-09-10T23:30:32.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd593e00640 1 -- 172.21.15.17:0/2636817390 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00652e0 con 0x559957e75570 2024-09-10T23:30:32.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/2636817390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 msgr2=0x559957e2b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b020 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0000f90 tx=0x7fd5a0072d10 comp rx=0 tx=0).stop 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/2636817390 shutdown_connections 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957e2b020 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957e2aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/2636817390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957e8a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/2636817390 >> 172.21.15.17:0/2636817390 conn(0x559957e276e0 msgr2=0x559957e8c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/2636817390 shutdown_connections 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/2636817390 wait complete. 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 -- start start 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 Processor -- start 2024-09-10T23:30:32.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957eeb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957eebda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957eec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a81f78d0 con 0x559957e75570 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a81f7280 con 0x559957e74c50 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55995793c8d0 con 0x559957e2b730 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5b1e4a000 10 client.0 _ll_register_callbacks cb 0x7fd5a005e560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957eec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957eec2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45488/0 (socket says 172.21.15.17:45488) 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 -- 172.21.15.17:0/587552860 learned_addr learned my addr 172.21.15.17:0/587552860 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957eeb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5a7400640 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957eebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5a7e00640 1 -- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 msgr2=0x559957eebda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957eebda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5a7e00640 1 -- 172.21.15.17:0/587552860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 msgr2=0x559957eec2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957eec2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5a7e00640 1 -- 172.21.15.17:0/587552860 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x559957cfbf10 con 0x559957e2b730 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5aca00640 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957eec2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 10 client.0 ms_handle_connect on v2:172.21.15.77:3301/0 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.035+0000 7fd5a7e00640 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957eeb860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd5980af000 tx=0x7fd59801bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4af6a68be2be801 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 1 -- 172.21.15.17:0/587552860 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980b5040 con 0x559957e2b730 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 1 -- 172.21.15.17:0/587552860 <== mon.2 v2:172.21.15.77:3301/0 2 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fd5980046d0 con 0x559957e2b730 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/587552860 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x559957e74830 con 0x559957e2b730 2024-09-10T23:30:32.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 1 -- 172.21.15.17:0/587552860 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fd5980de050 con 0x559957e2b730 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 10 client.8966 fetch_fsmap learned FSMap version 152 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/587552860 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x559957cd2db0 con 0x559957e2b730 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 1 -- 172.21.15.17:0/587552860 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559957e74830 con 0x559957e2b730 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 1 -- 172.21.15.17:0/587552860 <== mon.2 v2:172.21.15.77:3301/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7fd5980e1020 con 0x559957e2b730 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 10 client.8966 fetch_fsmap finished waiting for FSMap version 152 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 10 client.8966 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 20 client.8966 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x559957e88de0 0x559957e891f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 4 client.8966 mds_command: new command op to 11055 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/587552860 --> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x559957e315a0 con 0x559957e88de0 2024-09-10T23:30:32.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5a7400640 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x559957e88de0 0x559957e891f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.045 INFO:tasks.ceph.mds.b.smithi077.stderr:2024-09-10T23:30:32.046+0000 7f8eca600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 pv8 ap=4 DIRTYPARENT s=5242880 n(v0 rc2024-09-10T23:30:30.859749+0000 b5242880 1=1+0)->n(v0 rc2024-09-10T23:30:30.867172+0000 b6291456 1=1+0) (ifile lock->xlock w=1) (iquiesce lock w=1) cr={11223=0-12582912@1} caps={11223=pAsLsXsFc/-@5} | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x557c00c44b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-10T23:30:32.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5a7400640 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x559957e88de0 0x559957e891f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0643b7f476f3a13 server_cookie=e73013e9ee1a3eeb in_seq=0 out_seq=0 2024-09-10T23:30:32.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 10 client.8966 ms_handle_connect on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 1 -- 172.21.15.17:0/587552860 <== mds.0 v2:172.21.15.77:6835/2065743463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559957e315a0 con 0x559957e88de0 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 10 client.8966 handle_command_reply: tid=0 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 client.8966 shutdown 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 msgr2=0x559957eeb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957eeb860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd5980af000 tx=0x7fd59801bd90 comp rx=0 tx=0).stop 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/587552860 shutdown_connections 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x559957e88de0 0x559957e891f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559957e75570 0x559957eec2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559957e74c50 0x559957eebda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd591600640 0 client.8966 ms_handle_reset on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 --2- 172.21.15.17:0/587552860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559957e2b730 0x559957eeb860 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/587552860 >> 172.21.15.17:0/587552860 conn(0x559957e276e0 msgr2=0x559957e29ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/587552860 shutdown_connections 2024-09-10T23:30:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 1 -- 172.21.15.17:0/587552860 wait complete. 2024-09-10T23:30:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.039+0000 7fd5b1e4a000 20 client.8966 trim_cache size 0 max 16384 2024-09-10T23:30:32.048 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:30:32.048 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:30:32.048 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "fa362e3e-2eed-4618-b462-d9d266b57752", 2024-09-10T23:30:32.049 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:30:32.049 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:30:32.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 -- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5880725e0 msgr2=0x7fd588074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5880725e0 0x7fd588074aa0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd5980b2000 tx=0x7fd59801d830 comp rx=0 tx=0).stop 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 -- 172.21.15.17:0/3350313549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a80c9a20 msgr2=0x7fd5a8153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a80c9a20 0x7fd5a8153be0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000cad0 tx=0x7fd5a000cbc0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 -- 172.21.15.17:0/3350313549 shutdown_connections 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5880725e0 0x7fd588074aa0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a80c9a20 0x7fd5a8153be0 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5a8161620 0x7fd5a80c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 --2- 172.21.15.17:0/3350313549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5a80b0b50 0x7fd5a80ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 -- 172.21.15.17:0/3350313549 >> 172.21.15.17:0/3350313549 conn(0x7fd5a80d1bc0 msgr2=0x7fd5a8070740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 -- 172.21.15.17:0/3350313549 shutdown_connections 2024-09-10T23:30:32.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.043+0000 7fd5ad400640 1 -- 172.21.15.17:0/3350313549 wait complete. 2024-09-10T23:30:32.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:30:32.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-10T23:30:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 -- 172.21.15.17:0/2775590246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec15aa30 msgr2=0x7efeec0cf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 --2- 172.21.15.17:0/2775590246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec15aa30 0x7efeec0cf3a0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7efeec0cda00 tx=0x7efed801dbf0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 -- 172.21.15.17:0/2775590246 shutdown_connections 2024-09-10T23:30:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 --2- 172.21.15.17:0/2775590246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec15aa30 0x7efeec0cf3a0 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 --2- 172.21.15.17:0/2775590246 >> v2:172.21.15.77:3300/0 conn(0x7efeec158010 0x7efeec0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 -- 172.21.15.17:0/2775590246 >> 172.21.15.17:0/2775590246 conn(0x7efeec06c360 msgr2=0x7efeec06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 -- 172.21.15.17:0/2775590246 shutdown_connections 2024-09-10T23:30:32.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 -- 172.21.15.17:0/2775590246 wait complete. 2024-09-10T23:30:32.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 Processor -- start 2024-09-10T23:30:32.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.211+0000 7efef3e00640 1 -- start start 2024-09-10T23:30:32.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef3e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeec0b45a0 0x7efeec0ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec158010 0x7efeec14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeec15aa30 0x7efeec0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef3e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efeec0d03a0 con 0x7efeec158010 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef3e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efeec0d0220 con 0x7efeec0b45a0 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef3e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efeec1671b0 con 0x7efeec15aa30 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec158010 0x7efeec14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec158010 0x7efeec14e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45502/0 (socket says 172.21.15.17:45502) 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef1400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeec0b45a0 0x7efeec0ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef0a00640 1 -- 172.21.15.17:0/3958683324 learned_addr learned my addr 172.21.15.17:0/3958683324 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef1e00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeec15aa30 0x7efeec0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef0a00640 1 -- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeec15aa30 msgr2=0x7efeec0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef0a00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeec15aa30 0x7efeec0ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef0a00640 1 -- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeec0b45a0 msgr2=0x7efeec0ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef0a00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeec0b45a0 0x7efeec0ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef0a00640 1 -- 172.21.15.17:0/3958683324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec0735a0 con 0x7efeec158010 2024-09-10T23:30:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef0a00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec158010 0x7efeec14e730 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7efed8000c10 tx=0x7efed80a6940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efee9600640 1 -- 172.21.15.17:0/3958683324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed80bb020 con 0x7efeec158010 2024-09-10T23:30:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efee9600640 1 -- 172.21.15.17:0/3958683324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efed8005400 con 0x7efeec158010 2024-09-10T23:30:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef3e00640 1 -- 172.21.15.17:0/3958683324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeec0b0eb0 con 0x7efeec158010 2024-09-10T23:30:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efee9600640 1 -- 172.21.15.17:0/3958683324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed80b3040 con 0x7efeec158010 2024-09-10T23:30:32.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efef3e00640 1 -- 172.21.15.17:0/3958683324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeec0b1150 con 0x7efeec158010 2024-09-10T23:30:32.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.215+0000 7efee9600640 1 -- 172.21.15.17:0/3958683324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efed800b040 con 0x7efeec158010 2024-09-10T23:30:32.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efee9600640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efecc0725d0 0x7efecc074a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efee9600640 1 -- 172.21.15.17:0/3958683324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7efed812d6f0 con 0x7efeec158010 2024-09-10T23:30:32.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 Processor -- start 2024-09-10T23:30:32.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 -- start start 2024-09-10T23:30:32.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efecc0725d0 0x7efecc074a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efecc0725d0 0x7efecc074a90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7efee0009a10 tx=0x7efee0009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0ee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55cc79f8ccb0 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc79ea2310 con 0x55cc7a0eeac0 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cc79effb90 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0ee580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45518/0 (socket says 172.21.15.17:45518) 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 -- 172.21.15.17:0/4035182622 learned_addr learned my addr 172.21.15.17:0/4035182622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef0a00640 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1e00640 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 -- 172.21.15.17:0/4035182622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 msgr2=0x55cc7a0a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 -- 172.21.15.17:0/4035182622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 msgr2=0x55cc7a0a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 -- 172.21.15.17:0/4035182622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc79ea3c60 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef0a00640 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef1400640 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0ee580 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7efee000ec50 tx=0x7efee0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc11a96aa6fc47b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efede000640 1 -- 172.21.15.17:0/4035182622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee001b040 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efede000640 1 -- 172.21.15.17:0/4035182622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efee0024070 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efede000640 1 -- 172.21.15.17:0/4035182622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0013450 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 -- 172.21.15.17:0/4035182622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 msgr2=0x55cc7a0ee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0ee580 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7efee000ec50 tx=0x7efee0011000 comp rx=0 tx=0).stop 2024-09-10T23:30:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 -- 172.21.15.17:0/4035182622 shutdown_connections 2024-09-10T23:30:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 --2- 172.21.15.17:0/4035182622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0ee580 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.219+0000 7efef71d8000 1 -- 172.21.15.17:0/4035182622 >> 172.21.15.17:0/4035182622 conn(0x55cc7a0aad20 msgr2=0x55cc7a0a2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 -- 172.21.15.17:0/4035182622 shutdown_connections 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 -- 172.21.15.17:0/4035182622 wait complete. 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 -- start start 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 Processor -- start 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0f5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55cc79ef2dd0 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc79eeefc0 con 0x55cc7a0eeac0 2024-09-10T23:30:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cc79e944b0 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 10 client.0 _ll_register_callbacks cb 0x55cc79e727d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:43160/0 (socket says 172.21.15.17:43160) 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1400640 1 -- 172.21.15.17:0/1885553222 learned_addr learned my addr 172.21.15.17:0/1885553222 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1e00640 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1400640 1 -- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 msgr2=0x55cc7a0f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1400640 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1400640 1 -- 172.21.15.17:0/1885553222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 msgr2=0x55cc7a0f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1400640 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1400640 1 -- 172.21.15.17:0/1885553222 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55cc79e8d1f0 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef1400640 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0f5530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55cc79efa5e0 tx=0x7efee0013960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cb32e499c7cb57d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efed2a00640 10 client.0 ms_handle_connect on v2:172.21.15.77:3301/0 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efed2a00640 1 -- 172.21.15.17:0/1885553222 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee002e020 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efed2a00640 1 -- 172.21.15.17:0/1885553222 <== mon.2 v2:172.21.15.77:3301/0 2 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7efee000e770 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 -- 172.21.15.17:0/1885553222 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc79e87330 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efed2a00640 1 -- 172.21.15.17:0/1885553222 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7efee0038050 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 10 client.8975 fetch_fsmap learned FSMap version 152 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 -- 172.21.15.17:0/1885553222 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x55cc79e73fa0 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efed2a00640 1 -- 172.21.15.17:0/1885553222 <== mon.2 v2:172.21.15.77:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cc79e87330 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efed2a00640 1 -- 172.21.15.17:0/1885553222 <== mon.2 v2:172.21.15.77:3301/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7efee003b020 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 10 client.8975 fetch_fsmap finished waiting for FSMap version 152 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 10 client.8975 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 20 client.8975 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:32.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.223+0000 7efef71d8000 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x55cc7a0fd900 0x55cc7a0ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 4 client.8975 mds_command: new command op to 11055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:30:32.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 -- 172.21.15.17:0/1885553222 --> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc79f01ae0 con 0x55cc7a0fd900 2024-09-10T23:30:32.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef0a00640 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x55cc7a0fd900 0x55cc7a0ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef0a00640 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x55cc7a0fd900 0x55cc7a0ffcf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71c7b462150bd2e server_cookie=40a1de5583918fd in_seq=0 out_seq=0 2024-09-10T23:30:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efed2a00640 10 client.8975 ms_handle_connect on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efed2a00640 1 -- 172.21.15.17:0/1885553222 <== mds.0 v2:172.21.15.77:6835/2065743463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc79f01ae0 con 0x55cc7a0fd900 2024-09-10T23:30:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efed2a00640 10 client.8975 handle_command_reply: tid=0 2024-09-10T23:30:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 client.8975 shutdown 2024-09-10T23:30:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 -- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 msgr2=0x55cc7a0f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0f5530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55cc79efa5e0 tx=0x7efee0013960 comp rx=0 tx=0).stop 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 -- 172.21.15.17:0/1885553222 shutdown_connections 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x55cc7a0fd900 0x55cc7a0ffcf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 --2- 172.21.15.17:0/1885553222 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0f5530 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 -- 172.21.15.17:0/1885553222 >> 172.21.15.17:0/1885553222 conn(0x55cc7a0aad20 msgr2=0x55cc7a0a2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efed2a00640 0 client.8975 ms_handle_reset on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 -- 172.21.15.17:0/1885553222 shutdown_connections 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 1 -- 172.21.15.17:0/1885553222 wait complete. 2024-09-10T23:30:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.227+0000 7efef71d8000 20 client.8975 trim_cache size 0 max 16384 2024-09-10T23:30:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 Processor -- start 2024-09-10T23:30:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- start start 2024-09-10T23:30:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0a4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efeec202910 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efeec201a40 con 0x55cc7a0eeac0 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efeec1fa230 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0a4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45546/0 (socket says 172.21.15.17:45546) 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef0a00640 1 -- 172.21.15.17:0/2175444201 learned_addr learned my addr 172.21.15.17:0/2175444201 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef1400640 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef1e00640 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef0a00640 1 -- 172.21.15.17:0/2175444201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 msgr2=0x55cc7a0a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef0a00640 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef0a00640 1 -- 172.21.15.17:0/2175444201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 msgr2=0x55cc7a0a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef0a00640 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef0a00640 1 -- 172.21.15.17:0/2175444201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc79f4c660 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef1e00640 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:30:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef0a00640 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0a4070 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7efed80f8260 tx=0x7efed812b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6ff4858e7eb483 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efedd600640 1 -- 172.21.15.17:0/2175444201 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8112070 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efedd600640 1 -- 172.21.15.17:0/2175444201 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efed811d070 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efedd600640 1 -- 172.21.15.17:0/2175444201 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed80f8070 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- 172.21.15.17:0/2175444201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 msgr2=0x55cc7a0a4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0a4070 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7efed80f8260 tx=0x7efed812b950 comp rx=0 tx=0).stop 2024-09-10T23:30:32.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- 172.21.15.17:0/2175444201 shutdown_connections 2024-09-10T23:30:32.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a0a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0ee1a0 0x55cc7a0a4070 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 --2- 172.21.15.17:0/2175444201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0a4bc0 0x55cc7a0a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- 172.21.15.17:0/2175444201 >> 172.21.15.17:0/2175444201 conn(0x55cc7a0aad20 msgr2=0x55cc7a0a3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- 172.21.15.17:0/2175444201 shutdown_connections 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- 172.21.15.17:0/2175444201 wait complete. 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 -- start start 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.247+0000 7efef71d8000 1 Processor -- start 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0a4bc0 0x55cc7a1673e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0ee1a0 0x55cc7a167920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a167e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55cc7a0add40 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cc7a0ab100 con 0x55cc7a0eeac0 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55cc79ee9ec0 con 0x55cc7a0ee1a0 2024-09-10T23:30:32.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 10 client.0 _ll_register_callbacks cb 0x7efee000eb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0a4bc0 0x55cc7a1673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0a4bc0 0x55cc7a1673e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45556/0 (socket says 172.21.15.17:45556) 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1400640 1 -- 172.21.15.17:0/1794109019 learned_addr learned my addr 172.21.15.17:0/1794109019 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef0a00640 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0ee1a0 0x55cc7a167920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1e00640 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1400640 1 -- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0ee1a0 msgr2=0x55cc7a167920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1400640 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0ee1a0 0x55cc7a167920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1400640 1 -- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 msgr2=0x55cc7a167e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1400640 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a167e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1400640 1 -- 172.21.15.17:0/1794109019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc79eb9090 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef1400640 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0a4bc0 0x55cc7a1673e0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7efee0028a60 tx=0x7efee0028a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5ff9475050111d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:30:32.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 1 -- 172.21.15.17:0/1794109019 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee0041060 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 1 -- 172.21.15.17:0/1794109019 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7efee0013d60 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 -- 172.21.15.17:0/1794109019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efed811d070 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 1 -- 172.21.15.17:0/1794109019 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7efee0047050 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 10 client.11274 fetch_fsmap learned FSMap version 152 2024-09-10T23:30:32.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 -- 172.21.15.17:0/1794109019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x55cc79e855f0 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 1 -- 172.21.15.17:0/1794109019 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efed811d070 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 1 -- 172.21.15.17:0/1794109019 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7efee004a020 con 0x55cc7a0a4bc0 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 10 client.11274 fetch_fsmap finished waiting for FSMap version 152 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 10 client.11274 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 20 client.11274 populate_metadata read hostname 'smithi017' 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x55cc7a1236f0 0x55cc7a123b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 4 client.11274 mds_command: new command op to 11055 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 -- 172.21.15.17:0/1794109019 --> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc79efd590 con 0x55cc7a1236f0 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef0a00640 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x55cc7a1236f0 0x55cc7a123b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef0a00640 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x55cc7a1236f0 0x55cc7a123b00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=809713d27ad28025 server_cookie=eac56bd963453c53 in_seq=0 out_seq=0 2024-09-10T23:30:32.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 10 client.11274 ms_handle_connect on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:32.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 1 -- 172.21.15.17:0/1794109019 <== mds.0 v2:172.21.15.77:6835/2065743463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+571 (crc 0 0 0) 0x55cc79efd590 con 0x55cc7a1236f0 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 10 client.11274 handle_command_reply: tid=0 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 client.11274 shutdown 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 -- 172.21.15.17:0/1794109019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0a4bc0 msgr2=0x55cc7a1673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0a4bc0 0x55cc7a1673e0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7efee0028a60 tx=0x7efee0028a90 comp rx=0 tx=0).stop 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 -- 172.21.15.17:0/1794109019 shutdown_connections 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x55cc7a1236f0 0x55cc7a123b00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cc7a0eeac0 0x55cc7a167e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55cc7a0ee1a0 0x55cc7a167920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 --2- 172.21.15.17:0/1794109019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc7a0a4bc0 0x55cc7a1673e0 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efef71d8000 1 -- 172.21.15.17:0/1794109019 >> 172.21.15.17:0/1794109019 conn(0x55cc7a0aad20 msgr2=0x55cc7a0a4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.251+0000 7efed2a00640 0 client.11274 ms_handle_reset on v2:172.21.15.77:6835/2065743463 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef71d8000 1 -- 172.21.15.17:0/1794109019 shutdown_connections 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef71d8000 1 -- 172.21.15.17:0/1794109019 wait complete. 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef71d8000 20 client.11274 trim_cache size 0 max 16384 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stdout: "fa362e3e-2eed-4618-b462-d9d266b57752": { 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "fa362e3e-2eed-4618-b462-d9d266b57752", 2024-09-10T23:30:32.261 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,repair" 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: "fa362e3e-2eed-4618-b462-d9d266b57752": { 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:30:32.046184+0000", 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:30:32.262 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:30:32.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 -- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efecc0725d0 msgr2=0x7efecc074a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efecc0725d0 0x7efecc074a90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7efee0009a10 tx=0x7efee0009110 comp rx=0 tx=0).stop 2024-09-10T23:30:32.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 -- 172.21.15.17:0/3958683324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec158010 msgr2=0x7efeec14e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:30:32.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec158010 0x7efeec14e730 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7efed8000c10 tx=0x7efed80a6940 comp rx=0 tx=0).stop 2024-09-10T23:30:32.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 -- 172.21.15.17:0/3958683324 shutdown_connections 2024-09-10T23:30:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efecc0725d0 0x7efecc074a90 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efeec15aa30 0x7efeec0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efeec158010 0x7efeec14e730 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 --2- 172.21.15.17:0/3958683324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efeec0b45a0 0x7efeec0ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:30:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 -- 172.21.15.17:0/3958683324 >> 172.21.15.17:0/3958683324 conn(0x7efeec06c360 msgr2=0x7efeec0727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:30:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 -- 172.21.15.17:0/3958683324 shutdown_connections 2024-09-10T23:30:32.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:30:32.255+0000 7efef3e00640 1 -- 172.21.15.17:0/3958683324 wait complete. 2024-09-10T23:30:32.275 INFO:tasks.cephfs.filesystem:scrub status for tag:fa362e3e-2eed-4618-b462-d9d266b57752 - {'path': '/', 'tag': 'fa362e3e-2eed-4618-b462-d9d266b57752', 'options': 'recursive,repair'} 2024-09-10T23:30:38.685 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:30:38.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:31:02.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:02.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-10T23:31:02.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 -- 172.21.15.17:0/1081146557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340d2060 msgr2=0x7f7f340d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 --2- 172.21.15.17:0/1081146557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340d2060 0x7f7f340d24b0 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f7f340c78d0 tx=0x7f7f2001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 -- 172.21.15.17:0/1081146557 shutdown_connections 2024-09-10T23:31:02.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 --2- 172.21.15.17:0/1081146557 >> v2:172.21.15.77:3300/0 conn(0x7f7f340b40b0 0x7f7f340b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 --2- 172.21.15.17:0/1081146557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340d2060 0x7f7f340d24b0 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 -- 172.21.15.17:0/1081146557 >> 172.21.15.17:0/1081146557 conn(0x7f7f3409d0f0 msgr2=0x7f7f340d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 -- 172.21.15.17:0/1081146557 shutdown_connections 2024-09-10T23:31:02.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 -- 172.21.15.17:0/1081146557 wait complete. 2024-09-10T23:31:02.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 Processor -- start 2024-09-10T23:31:02.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.435+0000 7f7f3a000640 1 -- start start 2024-09-10T23:31:02.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f3a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340b40b0 0x7f7f3414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f3a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f340d2060 0x7f7f340b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f3a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f3415df10 0x7f7f340b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f3a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3416aff0 con 0x7f7f340b40b0 2024-09-10T23:31:02.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f3a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3416ae70 con 0x7f7f3415df10 2024-09-10T23:31:02.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f3a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f3416b170 con 0x7f7f340d2060 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f38c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340b40b0 0x7f7f3414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f38c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340b40b0 0x7f7f3414fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51532/0 (socket says 172.21.15.17:51532) 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f38c00640 1 -- 172.21.15.17:0/2165530948 learned_addr learned my addr 172.21.15.17:0/2165530948 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f33e00640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f340d2060 0x7f7f340b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f39600640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f3415df10 0x7f7f340b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f38c00640 1 -- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f340d2060 msgr2=0x7f7f340b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f38c00640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f340d2060 0x7f7f340b7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f38c00640 1 -- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f3415df10 msgr2=0x7f7f340b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f38c00640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f3415df10 0x7f7f340b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f38c00640 1 -- 172.21.15.17:0/2165530948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f340b3240 con 0x7f7f340b40b0 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f33e00640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f340d2060 0x7f7f340b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f39600640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f3415df10 0x7f7f340b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f38c00640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340b40b0 0x7f7f3414fe10 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800c3c0 tx=0x7f7f2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f30c00640 1 -- 172.21.15.17:0/2165530948 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f28017070 con 0x7f7f340b40b0 2024-09-10T23:31:02.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f30c00640 1 -- 172.21.15.17:0/2165530948 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f280053c0 con 0x7f7f340b40b0 2024-09-10T23:31:02.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f3a000640 1 -- 172.21.15.17:0/2165530948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f34156490 con 0x7f7f340b40b0 2024-09-10T23:31:02.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f30c00640 1 -- 172.21.15.17:0/2165530948 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f28003860 con 0x7f7f340b40b0 2024-09-10T23:31:02.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.439+0000 7f7f3a000640 1 -- 172.21.15.17:0/2165530948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f34156a50 con 0x7f7f340b40b0 2024-09-10T23:31:02.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f30c00640 1 -- 172.21.15.17:0/2165530948 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7f28003a00 con 0x7f7f340b40b0 2024-09-10T23:31:02.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f30c00640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f140725e0 0x7f7f14074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f30c00640 1 -- 172.21.15.17:0/2165530948 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f7f280929e0 con 0x7f7f340b40b0 2024-09-10T23:31:02.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f3ea0c000 1 Processor -- start 2024-09-10T23:31:02.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f33e00640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f140725e0 0x7f7f14074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f3ea0c000 1 -- start start 2024-09-10T23:31:02.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f33e00640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f140725e0 0x7f7f14074aa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f7f200af000 tx=0x7f7f2001b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 0x563ecf61d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf5d3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563ecf4bbcb0 con 0x563ecf61dac0 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563ecf3d1310 con 0x563ecf5d3bc0 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563ecf42eb90 con 0x563ecf61d1a0 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf5d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf5d3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51544/0 (socket says 172.21.15.17:51544) 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f39600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f33e00640 1 -- 172.21.15.17:0/2372718749 learned_addr learned my addr 172.21.15.17:0/2372718749 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f38c00640 1 --2- 172.21.15.17:0/2372718749 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 0x563ecf61d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f39600640 1 -- 172.21.15.17:0/2372718749 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 msgr2=0x563ecf61d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f39600640 1 --2- 172.21.15.17:0/2372718749 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 0x563ecf61d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f39600640 1 -- 172.21.15.17:0/2372718749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 msgr2=0x563ecf5d3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f39600640 1 --2- 172.21.15.17:0/2372718749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf5d3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f39600640 1 -- 172.21.15.17:0/2372718749 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ecf3d2c60 con 0x563ecf5d3bc0 2024-09-10T23:31:02.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f33e00640 1 --2- 172.21.15.17:0/2372718749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf5d3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:02.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.443+0000 7f7f39600640 1 --2- 172.21.15.17:0/2372718749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3fa0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009ed0 tx=0x7f7f2c010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d55ba28d90c3130 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f25600640 1 -- 172.21.15.17:0/2372718749 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c016070 con 0x563ecf5d3bc0 2024-09-10T23:31:02.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f25600640 1 -- 172.21.15.17:0/2372718749 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f2c01b750 con 0x563ecf5d3bc0 2024-09-10T23:31:02.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f25600640 1 -- 172.21.15.17:0/2372718749 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c01bb20 con 0x563ecf5d3bc0 2024-09-10T23:31:02.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/2372718749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 msgr2=0x563ecf5d3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/2372718749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3fa0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009ed0 tx=0x7f7f2c010740 comp rx=0 tx=0).stop 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/2372718749 shutdown_connections 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/2372718749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3fa0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/2372718749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf5d3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/2372718749 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 0x563ecf61d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/2372718749 >> 172.21.15.17:0/2372718749 conn(0x563ecf5d9d20 msgr2=0x563ecf5d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/2372718749 shutdown_connections 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/2372718749 wait complete. 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 -- start start 2024-09-10T23:31:02.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 Processor -- start 2024-09-10T23:31:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf5d3bc0 0x563ecf624530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf61d1a0 0x563ecf624a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 0x563ecf624fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563ecf421dd0 con 0x563ecf5d3bc0 2024-09-10T23:31:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563ecf41dfc0 con 0x563ecf61d1a0 2024-09-10T23:31:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563ecf3c34b0 con 0x563ecf61dac0 2024-09-10T23:31:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f3ea0c000 10 client.0 _ll_register_callbacks cb 0x563ecf3a17d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f38c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf5d3bc0 0x563ecf624530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f38c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf5d3bc0 0x563ecf624530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51550/0 (socket says 172.21.15.17:51550) 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f38c00640 1 -- 172.21.15.17:0/3327580047 learned_addr learned my addr 172.21.15.17:0/3327580047 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f33e00640 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf61d1a0 0x563ecf624a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f39600640 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 0x563ecf624fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f38c00640 1 -- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 msgr2=0x563ecf624fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f38c00640 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 0x563ecf624fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f38c00640 1 -- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf61d1a0 msgr2=0x563ecf624a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f38c00640 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf61d1a0 0x563ecf624a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f38c00640 1 -- 172.21.15.17:0/3327580047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ecf3bc1f0 con 0x563ecf5d3bc0 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f33e00640 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf61d1a0 0x563ecf624a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f39600640 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 0x563ecf624fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f38c00640 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf5d3bc0 0x563ecf624530 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f7f2805d7b0 tx=0x7f7f2805d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3381fb62e7370bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f1a000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.447+0000 7f7f1a000640 1 -- 172.21.15.17:0/3327580047 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2805d820 con 0x563ecf5d3bc0 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f1a000640 1 -- 172.21.15.17:0/3327580047 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f7f2805ca80 con 0x563ecf5d3bc0 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/3327580047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ecf3b6330 con 0x563ecf5d3bc0 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f1a000640 1 -- 172.21.15.17:0/3327580047 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f7f28062300 con 0x563ecf5d3bc0 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 10 client.11286 fetch_fsmap learned FSMap version 152 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/3327580047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x563ecf3a2fa0 con 0x563ecf5d3bc0 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f1a000640 1 -- 172.21.15.17:0/3327580047 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563ecf3b6330 con 0x563ecf5d3bc0 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f1a000640 1 -- 172.21.15.17:0/3327580047 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7f7f2807ece0 con 0x563ecf5d3bc0 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 10 client.11286 fetch_fsmap finished waiting for FSMap version 152 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 10 client.11286 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 20 client.11286 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x563ecf62c900 0x563ecf62ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 4 client.11286 mds_command: new command op to 11055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/3327580047 --> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ecf430ae0 con 0x563ecf62c900 2024-09-10T23:31:02.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f33e00640 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x563ecf62c900 0x563ecf62ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f33e00640 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x563ecf62c900 0x563ecf62ecf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4a7eb97861c5cf9 server_cookie=f8cf28e46dd290e7 in_seq=0 out_seq=0 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f1a000640 10 client.11286 ms_handle_connect on v2:172.21.15.77:6835/2065743463 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f1a000640 1 -- 172.21.15.17:0/3327580047 <== mds.0 v2:172.21.15.77:6835/2065743463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ecf430ae0 con 0x563ecf62c900 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f1a000640 10 client.11286 handle_command_reply: tid=0 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 client.11286 shutdown 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/3327580047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf5d3bc0 msgr2=0x563ecf624530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf5d3bc0 0x563ecf624530 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f7f2805d7b0 tx=0x7f7f2805d330 comp rx=0 tx=0).stop 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/3327580047 shutdown_connections 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x563ecf62c900 0x563ecf62ecf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 0x563ecf624fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf61d1a0 0x563ecf624a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/3327580047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf5d3bc0 0x563ecf624530 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f1a000640 0 client.11286 ms_handle_reset on v2:172.21.15.77:6835/2065743463 2024-09-10T23:31:02.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/3327580047 >> 172.21.15.17:0/3327580047 conn(0x563ecf5d9d20 msgr2=0x563ecf5d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/3327580047 shutdown_connections 2024-09-10T23:31:02.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/3327580047 wait complete. 2024-09-10T23:31:02.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.451+0000 7f7f3ea0c000 20 client.11286 trim_cache size 0 max 16384 2024-09-10T23:31:02.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 Processor -- start 2024-09-10T23:31:02.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 -- start start 2024-09-10T23:31:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 0x563ecf5d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf627310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34204620 con 0x563ecf61dac0 2024-09-10T23:31:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34203640 con 0x563ecf5d3bc0 2024-09-10T23:31:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f34150de0 con 0x563ecf61d1a0 2024-09-10T23:31:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f39600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf627310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f39600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf627310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51554/0 (socket says 172.21.15.17:51554) 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f39600640 1 -- 172.21.15.17:0/20544724 learned_addr learned my addr 172.21.15.17:0/20544724 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f38c00640 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f33e00640 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 0x563ecf5d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f39600640 1 -- 172.21.15.17:0/20544724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 msgr2=0x563ecf5d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f39600640 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 0x563ecf5d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f39600640 1 -- 172.21.15.17:0/20544724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 msgr2=0x563ecf5d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f39600640 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f39600640 1 -- 172.21.15.17:0/20544724 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ecf47b660 con 0x563ecf61dac0 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f38c00640 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f39600640 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf627310 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c010c40 tx=0x7f7f2c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f3cfd7a9d8c19d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f24c00640 1 -- 172.21.15.17:0/20544724 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c029070 con 0x563ecf61dac0 2024-09-10T23:31:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f24c00640 1 -- 172.21.15.17:0/20544724 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f2c01b550 con 0x563ecf61dac0 2024-09-10T23:31:02.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f24c00640 1 -- 172.21.15.17:0/20544724 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c016040 con 0x563ecf61dac0 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/20544724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 msgr2=0x563ecf627310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf627310 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c010c40 tx=0x7f7f2c004ac0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/20544724 shutdown_connections 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61dac0 0x563ecf627310 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61d1a0 0x563ecf5d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/20544724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf5d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/20544724 >> 172.21.15.17:0/20544724 conn(0x563ecf5d9d20 msgr2=0x563ecf5d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/20544724 shutdown_connections 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.471+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/20544724 wait complete. 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 -- start start 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 Processor -- start 2024-09-10T23:31:02.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf629fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61d1a0 0x563ecf62a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 0x563ecf64f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563ecf5dcd40 con 0x563ecf61d1a0 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563ecf5da100 con 0x563ecf5d3bc0 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563ecf418ec0 con 0x563ecf61dac0 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 10 client.0 _ll_register_callbacks cb 0x7f7f2805d5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61d1a0 0x563ecf62a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f33e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61d1a0 0x563ecf62a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51562/0 (socket says 172.21.15.17:51562) 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f33e00640 1 -- 172.21.15.17:0/470199116 learned_addr learned my addr 172.21.15.17:0/470199116 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f38c00640 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf629fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f39600640 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 0x563ecf64f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f33e00640 1 -- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 msgr2=0x563ecf64f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f33e00640 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 0x563ecf64f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f33e00640 1 -- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 msgr2=0x563ecf629fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f33e00640 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf629fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f33e00640 1 -- 172.21.15.17:0/470199116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ecf3e8090 con 0x563ecf61d1a0 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f33e00640 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61d1a0 0x563ecf62a500 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f7f2001ce30 tx=0x7f7f20009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c592bedeb41a62f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f1a000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f1a000640 1 -- 172.21.15.17:0/470199116 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f200bd040 con 0x563ecf61d1a0 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/470199116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f2c01b550 con 0x563ecf61d1a0 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f1a000640 1 -- 172.21.15.17:0/470199116 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f7f200048d0 con 0x563ecf61d1a0 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f1a000640 1 -- 172.21.15.17:0/470199116 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f7f200d5050 con 0x563ecf61d1a0 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 10 client.11292 fetch_fsmap learned FSMap version 152 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/470199116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=2+}) -- 0x563ecf3b45f0 con 0x563ecf61d1a0 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f1a000640 1 -- 172.21.15.17:0/470199116 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f2c01b550 con 0x563ecf61d1a0 2024-09-10T23:31:02.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f1a000640 1 -- 172.21.15.17:0/470199116 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 152) ==== 3502+0+0 (secure 0 0 0) 0x7f7f200d8020 con 0x563ecf61d1a0 2024-09-10T23:31:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 10 client.11292 fetch_fsmap finished waiting for FSMap version 152 2024-09-10T23:31:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 10 client.11292 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-10T23:31:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 20 client.11292 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x563ecf692850 0x563ecf692c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 4 client.11292 mds_command: new command op to 11055 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:31:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/470199116 --> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ecf42c590 con 0x563ecf692850 2024-09-10T23:31:02.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.475+0000 7f7f38c00640 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x563ecf692850 0x563ecf692c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f38c00640 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x563ecf692850 0x563ecf692c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d3ebf3af000d47b server_cookie=925d4d2f0d79be43 in_seq=0 out_seq=0 2024-09-10T23:31:02.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f1a000640 10 client.11292 ms_handle_connect on v2:172.21.15.77:6835/2065743463 2024-09-10T23:31:02.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f1a000640 1 -- 172.21.15.17:0/470199116 <== mds.0 v2:172.21.15.77:6835/2065743463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x563ecf42c590 con 0x563ecf692850 2024-09-10T23:31:02.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f1a000640 10 client.11292 handle_command_reply: tid=0 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 client.11292 shutdown 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/470199116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61d1a0 msgr2=0x563ecf62a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61d1a0 0x563ecf62a500 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f7f2001ce30 tx=0x7f7f20009260 comp rx=0 tx=0).stop 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/470199116 shutdown_connections 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:6835/2065743463,v1:172.21.15.77:6837/2065743463] conn(0x563ecf692850 0x563ecf692c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563ecf61dac0 0x563ecf64f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ecf61d1a0 0x563ecf62a500 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 --2- 172.21.15.17:0/470199116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563ecf5d3bc0 0x563ecf629fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f1a000640 0 client.11292 ms_handle_reset on v2:172.21.15.77:6835/2065743463 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/470199116 >> 172.21.15.17:0/470199116 conn(0x563ecf5d9d20 msgr2=0x563ecf5d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/470199116 shutdown_connections 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 1 -- 172.21.15.17:0/470199116 wait complete. 2024-09-10T23:31:02.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3ea0c000 20 client.11292 trim_cache size 0 max 16384 2024-09-10T23:31:02.485 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:02.485 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:31:02.485 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:31:02.485 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:31:02.485 INFO:teuthology.orchestra.run.smithi017.stdout: "fa362e3e-2eed-4618-b462-d9d266b57752": { 2024-09-10T23:31:02.485 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:30:32.046184+0000", 2024-09-10T23:31:02.485 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:31:02.485 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:31:02.485 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:31:02.486 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:31:02.486 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:31:02.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:02.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:02.486 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 -- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f140725e0 msgr2=0x7f7f14074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f140725e0 0x7f7f14074aa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f7f200af000 tx=0x7f7f2001b100 comp rx=0 tx=0).stop 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 -- 172.21.15.17:0/2165530948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340b40b0 msgr2=0x7f7f3414fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340b40b0 0x7f7f3414fe10 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800c3c0 tx=0x7f7f2800c880 comp rx=0 tx=0).stop 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 -- 172.21.15.17:0/2165530948 shutdown_connections 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f140725e0 0x7f7f14074aa0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f3415df10 0x7f7f340b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f340d2060 0x7f7f340b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 --2- 172.21.15.17:0/2165530948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f340b40b0 0x7f7f3414fe10 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 -- 172.21.15.17:0/2165530948 >> 172.21.15.17:0/2165530948 conn(0x7f7f3409d0f0 msgr2=0x7f7f340b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 -- 172.21.15.17:0/2165530948 shutdown_connections 2024-09-10T23:31:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.479+0000 7f7f3a000640 1 -- 172.21.15.17:0/2165530948 wait complete. 2024-09-10T23:31:02.501 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:31:02.501 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:31:02.501 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:31:02.501 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-09-10T23:31:02.501 DEBUG:teuthology.orchestra.run.smithi017:> import json 2024-09-10T23:31:02.501 DEBUG:teuthology.orchestra.run.smithi017:> import sys 2024-09-10T23:31:02.501 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:02.501 DEBUG:teuthology.orchestra.run.smithi017:> try: 2024-09-10T23:31:02.501 DEBUG:teuthology.orchestra.run.smithi017:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-10T23:31:02.501 DEBUG:teuthology.orchestra.run.smithi017:> except OSError as e: 2024-09-10T23:31:02.502 DEBUG:teuthology.orchestra.run.smithi017:> sys.exit(e.errno) 2024-09-10T23:31:02.502 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:02.502 DEBUG:teuthology.orchestra.run.smithi017:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T23:31:02.502 DEBUG:teuthology.orchestra.run.smithi017:> print(json.dumps( 2024-09-10T23:31:02.502 DEBUG:teuthology.orchestra.run.smithi017:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T23:31:02.502 DEBUG:teuthology.orchestra.run.smithi017:> indent=2)) 2024-09-10T23:31:02.502 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:31:02.575 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:02.575 INFO:teuthology.orchestra.run.smithi017.stdout: "st_mode": 33204, 2024-09-10T23:31:02.575 INFO:teuthology.orchestra.run.smithi017.stdout: "st_ino": 1099511627777, 2024-09-10T23:31:02.575 INFO:teuthology.orchestra.run.smithi017.stdout: "st_dev": 44, 2024-09-10T23:31:02.576 INFO:teuthology.orchestra.run.smithi017.stdout: "st_nlink": 1, 2024-09-10T23:31:02.576 INFO:teuthology.orchestra.run.smithi017.stdout: "st_uid": 1000, 2024-09-10T23:31:02.576 INFO:teuthology.orchestra.run.smithi017.stdout: "st_gid": 1271, 2024-09-10T23:31:02.576 INFO:teuthology.orchestra.run.smithi017.stdout: "st_size": 6291456, 2024-09-10T23:31:02.576 INFO:teuthology.orchestra.run.smithi017.stdout: "st_atime": 1726011030.8187892, 2024-09-10T23:31:02.576 INFO:teuthology.orchestra.run.smithi017.stdout: "st_mtime": 1726011030.8671722, 2024-09-10T23:31:02.576 INFO:teuthology.orchestra.run.smithi017.stdout: "st_ctime": 1726011030.8671722 2024-09-10T23:31:02.576 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:02.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:31:02.585 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:02.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.771+0000 7fafa7e00640 1 -- 172.21.15.17:0/3990588651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf88005220 msgr2=0x7faf8800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.771+0000 7fafa7e00640 1 --2- 172.21.15.17:0/3990588651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf88005220 0x7faf8800b9d0 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7fafa0070890 tx=0x7faf9801d5d0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.771+0000 7fafa7e00640 1 -- 172.21.15.17:0/3990588651 shutdown_connections 2024-09-10T23:31:02.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.771+0000 7fafa7e00640 1 --2- 172.21.15.17:0/3990588651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf88005220 0x7faf8800b9d0 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.771+0000 7fafa7e00640 1 -- 172.21.15.17:0/3990588651 >> 172.21.15.17:0/3990588651 conn(0x7fafa00b1850 msgr2=0x7fafa00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.771+0000 7fafa7e00640 1 -- 172.21.15.17:0/3990588651 shutdown_connections 2024-09-10T23:31:02.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.771+0000 7fafa7e00640 1 -- 172.21.15.17:0/3990588651 wait complete. 2024-09-10T23:31:02.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 Processor -- start 2024-09-10T23:31:02.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 -- start start 2024-09-10T23:31:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf88005220 0x7fafa0150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa0150030 0x7fafa0159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa014f1c0 0x7fafa014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fafa006fd10 con 0x7fafa014f1c0 2024-09-10T23:31:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fafa006fe90 con 0x7fafa0150030 2024-09-10T23:31:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fafa0070010 con 0x7faf88005220 2024-09-10T23:31:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa014f1c0 0x7fafa014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa014f1c0 0x7fafa014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51584/0 (socket says 172.21.15.17:51584) 2024-09-10T23:31:02.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5e00640 1 -- 172.21.15.17:0/2966073254 learned_addr learned my addr 172.21.15.17:0/2966073254 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa4a00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa0150030 0x7fafa0159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5400640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf88005220 0x7fafa0150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5e00640 1 -- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf88005220 msgr2=0x7fafa0150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5e00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf88005220 0x7fafa0150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5e00640 1 -- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa0150030 msgr2=0x7fafa0159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5e00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa0150030 0x7fafa0159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5e00640 1 -- 172.21.15.17:0/2966073254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa01f47a0 con 0x7fafa014f1c0 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa5e00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa014f1c0 0x7fafa014f670 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7faf9801de70 tx=0x7faf980abb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7faf9d600640 1 -- 172.21.15.17:0/2966073254 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf980ae040 con 0x7fafa014f1c0 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7faf9d600640 1 -- 172.21.15.17:0/2966073254 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf980bb070 con 0x7fafa014f1c0 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa01f4a80 con 0x7fafa014f1c0 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7faf9d600640 1 -- 172.21.15.17:0/2966073254 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98009ab0 con 0x7fafa014f1c0 2024-09-10T23:31:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa01f5040 con 0x7fafa014f1c0 2024-09-10T23:31:02.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.775+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa0075ad0 con 0x7fafa014f1c0 2024-09-10T23:31:02.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.779+0000 7faf9d600640 1 -- 172.21.15.17:0/2966073254 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7faf980a9510 con 0x7fafa014f1c0 2024-09-10T23:31:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.779+0000 7faf9d600640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf80072610 0x7faf80074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.779+0000 7faf9d600640 1 -- 172.21.15.17:0/2966073254 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7faf9812e740 con 0x7fafa014f1c0 2024-09-10T23:31:02.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.779+0000 7fafa5400640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf80072610 0x7faf80074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:02.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.779+0000 7fafa5400640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf80072610 0x7faf80074ad0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7faf94001910 tx=0x7faf94006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:02.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.783+0000 7faf9d600640 1 -- 172.21.15.17:0/2966073254 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7faf980172e0 con 0x7fafa014f1c0 2024-09-10T23:31:02.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.991+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafa015b920 con 0x7fafa014f1c0 2024-09-10T23:31:02.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.991+0000 7faf9d600640 1 -- 172.21.15.17:0/2966073254 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5234 (secure 0 0 0) 0x7faf98102310 con 0x7fafa014f1c0 2024-09-10T23:31:02.994 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:02.994 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":152,"btime":"2024-09-10T23:30:21:423641+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/762449917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":762449917},{"type":"v1","addr":"172.21.15.77:6836","nonce":762449917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/661473457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":661473457},{"type":"v1","addr":"172.21.15.17:6834","nonce":661473457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11049,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3378779893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3378779893},{"type":"v1","addr":"172.21.15.17:6835","nonce":3378779893}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:30:17.818575+0000","modified":"2024-09-10T23:30:20.823822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11055":{"gid":11055,"name":"b","rank":0,"incarnation":148,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2065743463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2065743463},{"type":"v1","addr":"172.21.15.77:6837","nonce":2065743463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11055,"qdb_cluster":[11055]},"id":14}]} 2024-09-10T23:31:02.994 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 152 2024-09-10T23:31:02.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf80072610 msgr2=0x7faf80074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf80072610 0x7faf80074ad0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7faf94001910 tx=0x7faf94006040 comp rx=0 tx=0).stop 2024-09-10T23:31:02.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa014f1c0 msgr2=0x7fafa014f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:02.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa014f1c0 0x7fafa014f670 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7faf9801de70 tx=0x7faf980abb70 comp rx=0 tx=0).stop 2024-09-10T23:31:02.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 shutdown_connections 2024-09-10T23:31:02.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7faf80072610 0x7faf80074ad0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa014f1c0 0x7fafa014f670 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa0150030 0x7fafa0159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 --2- 172.21.15.17:0/2966073254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf88005220 0x7fafa0150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:02.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 >> 172.21.15.17:0/2966073254 conn(0x7fafa00b1850 msgr2=0x7fafa00cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:02.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 shutdown_connections 2024-09-10T23:31:02.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:02.995+0000 7fafa7e00640 1 -- 172.21.15.17:0/2966073254 wait complete. 2024-09-10T23:31:03.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-10T23:31:03.189 INFO:teuthology.orchestra.run.smithi077.stdout:{"message":"","return_code":0} 2024-09-10T23:31:03.190 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T23:31:03.190 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-10T23:31:03.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.235+0000 7f1dee136080 1 Processor -- start 2024-09-10T23:31:03.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.235+0000 7f1dee136080 1 -- start start 2024-09-10T23:31:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fadbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55655fa04fe0 0x55655fad9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fada3b0 0x55655fb64e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55655f9aef40 con 0x55655fabbba0 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55655f9bbd00 con 0x55655fa04fe0 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55655f950a00 con 0x55655fada3b0 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fadbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fadbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51606/0 (socket says 172.21.15.17:51606) 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deb400640 1 -- 172.21.15.17:0/3664862319 learned_addr learned my addr 172.21.15.17:0/3664862319 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1debe00640 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fada3b0 0x55655fb64e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deaa00640 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55655fa04fe0 0x55655fad9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deb400640 1 -- 172.21.15.17:0/3664862319 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fada3b0 msgr2=0x55655fb64e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deb400640 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fada3b0 0x55655fb64e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deb400640 1 -- 172.21.15.17:0/3664862319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55655fa04fe0 msgr2=0x55655fad9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deb400640 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55655fa04fe0 0x55655fad9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deb400640 1 -- 172.21.15.17:0/3664862319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55655fada7c0 con 0x55655fabbba0 2024-09-10T23:31:03.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1debe00640 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fada3b0 0x55655fb64e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1deb400640 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fadbc30 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc002040 tx=0x7f1dd0004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5eef5003e748965 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1de9600640 1 -- 172.21.15.17:0/3664862319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0a4920 con 0x55655fabbba0 2024-09-10T23:31:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1de9600640 1 -- 172.21.15.17:0/3664862319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ddc0a4ac0 con 0x55655fabbba0 2024-09-10T23:31:03.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1de9600640 1 -- 172.21.15.17:0/3664862319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0a4cf0 con 0x55655fabbba0 2024-09-10T23:31:03.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- 172.21.15.17:0/3664862319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 msgr2=0x55655fadbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:03.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fadbc30 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc002040 tx=0x7f1dd0004130 comp rx=0 tx=0).stop 2024-09-10T23:31:03.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- 172.21.15.17:0/3664862319 shutdown_connections 2024-09-10T23:31:03.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fada3b0 0x55655fb64e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55655fa04fe0 0x55655fad9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- 172.21.15.17:0/3664862319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fadbc30 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- 172.21.15.17:0/3664862319 >> 172.21.15.17:0/3664862319 conn(0x55655fa03550 msgr2=0x55655fad9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- 172.21.15.17:0/3664862319 shutdown_connections 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- 172.21.15.17:0/3664862319 wait complete. 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 Processor -- start 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- start start 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fa04fe0 0x55655fac81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fabafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55655fada3b0 0x55655fadb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55655fad8830 con 0x55655fabbba0 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55655fad9570 con 0x55655fada3b0 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.239+0000 7f1dee136080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55655fad8ad0 con 0x55655fa04fe0 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fabafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fabafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51608/0 (socket says 172.21.15.17:51608) 2024-09-10T23:31:03.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deaa00640 1 -- 172.21.15.17:0/603803208 learned_addr learned my addr 172.21.15.17:0/603803208 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deb400640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fa04fe0 0x55655fac81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1debe00640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55655fada3b0 0x55655fadb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deaa00640 1 -- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fa04fe0 msgr2=0x55655fac81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deaa00640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fa04fe0 0x55655fac81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deaa00640 1 -- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55655fada3b0 msgr2=0x55655fadb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deaa00640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55655fada3b0 0x55655fadb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deaa00640 1 -- 172.21.15.17:0/603803208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55655fac72a0 con 0x55655fabbba0 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deb400640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55655fa04fe0 0x55655fac81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1deaa00640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fabafe0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8012bc0 tx=0x7f1dd80107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1de3e00640 1 -- 172.21.15.17:0/603803208 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800e890 con 0x55655fabbba0 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1de3e00640 1 -- 172.21.15.17:0/603803208 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd800ea30 con 0x55655fabbba0 2024-09-10T23:31:03.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1de3e00640 1 -- 172.21.15.17:0/603803208 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800ee80 con 0x55655fabbba0 2024-09-10T23:31:03.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55655fac7540 con 0x55655fabbba0 2024-09-10T23:31:03.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55655fac7a80 con 0x55655fabbba0 2024-09-10T23:31:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.243+0000 7f1de3e00640 1 -- 172.21.15.17:0/603803208 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1dd801a3a0 con 0x55655fabbba0 2024-09-10T23:31:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1de3e00640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dcc070ff0 0x7f1dcc0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1de3e00640 1 -- 172.21.15.17:0/603803208 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f1dd8095be0 con 0x55655fabbba0 2024-09-10T23:31:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x55655fac6af0 0x55655fac8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 --> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201) -- 0x55655fac9010 con 0x55655fac6af0 2024-09-10T23:31:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1deb400640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dcc070ff0 0x7f1dcc0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1debe00640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x55655fac6af0 0x55655fac8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1deb400640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dcc070ff0 0x7f1dcc0734b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0b5000 tx=0x7f1ddc0ae040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1debe00640 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x55655fac6af0 0x55655fac8ad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1debe00640 1 -- 172.21.15.17:0/603803208 <== osd.2 v2:172.21.15.17:6816/2333448301 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f1de4009ab0 con 0x55655fac6af0 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x55655fac6af0 msgr2=0x55655fac8ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x55655fac6af0 0x55655fac8ad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dcc070ff0 msgr2=0x7f1dcc0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1dcc070ff0 0x7f1dcc0734b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0b5000 tx=0x7f1ddc0ae040 comp rx=0 tx=0).stop 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 msgr2=0x55655fabafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 --2- 172.21.15.17:0/603803208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55655fabbba0 0x55655fabafe0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8012bc0 tx=0x7f1dd80107b0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1debe00640 1 -- 172.21.15.17:0/603803208 reap_dead start 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 shutdown_connections 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 >> 172.21.15.17:0/603803208 conn(0x55655fa03550 msgr2=0x55655fad7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 shutdown_connections 2024-09-10T23:31:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.247+0000 7f1dee136080 1 -- 172.21.15.17:0/603803208 wait complete. 2024-09-10T23:31:03.253 INFO:teuthology.orchestra.run.smithi017.stdout:Ysixmegssubdir  2024-09-10T23:31:03.253 DEBUG:teuthology.orchestra.run.smithi017:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-10T23:31:03.352 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 1099511627777, 2024-09-10T23:31:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "ancestors": [ 2024-09-10T23:31:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1099511627776, 2024-09-10T23:31:03.352 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "sixmegs", 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 8 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "dirino": 1, 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "dname": "subdir", 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "version": 11 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "pool": 30, 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: "old_pools": [] 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:03.353 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:03.357 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:31:03.357 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:31:03.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:31:03.575 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:31:03.575 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:31:03.575 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:03.575 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:03.584 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:03.584 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:03.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:31:03.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.823+0000 7f549e800640 1 -- 172.21.15.17:0/704465166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54980b0e70 msgr2=0x7f54980cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:03.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.823+0000 7f549e800640 1 --2- 172.21.15.17:0/704465166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54980b0e70 0x7f54980cfc10 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f5480009840 tx=0x7f548001c760 comp rx=0 tx=0).stop 2024-09-10T23:31:03.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.823+0000 7f549e800640 1 -- 172.21.15.17:0/704465166 shutdown_connections 2024-09-10T23:31:03.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.823+0000 7f549e800640 1 --2- 172.21.15.17:0/704465166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54980b0e70 0x7f54980cfc10 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.823+0000 7f549e800640 1 --2- 172.21.15.17:0/704465166 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f549815f470 0x7f54980cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.823+0000 7f549e800640 1 -- 172.21.15.17:0/704465166 >> 172.21.15.17:0/704465166 conn(0x7f54980d1da0 msgr2=0x7f54980d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:03.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 -- 172.21.15.17:0/704465166 shutdown_connections 2024-09-10T23:31:03.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 -- 172.21.15.17:0/704465166 wait complete. 2024-09-10T23:31:03.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 Processor -- start 2024-09-10T23:31:03.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 -- start start 2024-09-10T23:31:03.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54980b0e70 0x7f549814db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54980d2890 0x7f54980c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815f470 0x7f549815e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5498168ce0 con 0x7f549815f470 2024-09-10T23:31:03.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5498168b60 con 0x7f54980d2890 2024-09-10T23:31:03.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f549e800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5498168e60 con 0x7f54980b0e70 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815f470 0x7f549815e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815f470 0x7f549815e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51626/0 (socket says 172.21.15.17:51626) 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497e00640 1 -- 172.21.15.17:0/4096836973 learned_addr learned my addr 172.21.15.17:0/4096836973 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497400640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54980b0e70 0x7f549814db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f548ea00640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54980d2890 0x7f54980c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497e00640 1 -- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54980b0e70 msgr2=0x7f549814db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497e00640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54980b0e70 0x7f549814db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497e00640 1 -- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54980d2890 msgr2=0x7f54980c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497e00640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54980d2890 0x7f54980c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497e00640 1 -- 172.21.15.17:0/4096836973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54980c7680 con 0x7f549815f470 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f548ea00640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54980d2890 0x7f54980c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497400640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54980b0e70 0x7f549814db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f5497e00640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815f470 0x7f549815e580 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f549000c730 tx=0x7f549000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:03.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.827+0000 7f548fe00640 1 -- 172.21.15.17:0/4096836973 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490003db0 con 0x7f549815f470 2024-09-10T23:31:03.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.831+0000 7f548fe00640 1 -- 172.21.15.17:0/4096836973 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f549000ce40 con 0x7f549815f470 2024-09-10T23:31:03.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.831+0000 7f548fe00640 1 -- 172.21.15.17:0/4096836973 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54900052d0 con 0x7f549815f470 2024-09-10T23:31:03.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.831+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54980c7960 con 0x7f549815f470 2024-09-10T23:31:03.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.831+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549815caf0 con 0x7f549815f470 2024-09-10T23:31:03.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.831+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54980cdfb0 con 0x7f549815f470 2024-09-10T23:31:03.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.831+0000 7f548fe00640 1 -- 172.21.15.17:0/4096836973 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5490005470 con 0x7f549815f470 2024-09-10T23:31:03.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.831+0000 7f548fe00640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54740725e0 0x7f5474074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:03.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.831+0000 7f548fe00640 1 -- 172.21.15.17:0/4096836973 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f54900932f0 con 0x7f549815f470 2024-09-10T23:31:03.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.831+0000 7f5497400640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54740725e0 0x7f5474074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:03.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.835+0000 7f5497400640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54740725e0 0x7f5474074aa0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5488005fd0 tx=0x7f548800a540 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:03.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:03.835+0000 7f548fe00640 1 -- 172.21.15.17:0/4096836973 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f549005e7a0 con 0x7f549815f470 2024-09-10T23:31:04.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f549806db60 con 0x7f549815f470 2024-09-10T23:31:04.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f548fe00640 1 -- 172.21.15.17:0/4096836973 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v201) ==== 80+0+0 (secure 0 0 0) 0x7f549005e0a0 con 0x7f549815f470 2024-09-10T23:31:04.024 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:31:04.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54740725e0 msgr2=0x7f5474074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54740725e0 0x7f5474074aa0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5488005fd0 tx=0x7f548800a540 comp rx=0 tx=0).stop 2024-09-10T23:31:04.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815f470 msgr2=0x7f549815e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815f470 0x7f549815e580 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f549000c730 tx=0x7f549000cbf0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 shutdown_connections 2024-09-10T23:31:04.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54740725e0 0x7f5474074aa0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f549815f470 0x7f549815e580 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54980d2890 0x7f54980c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 --2- 172.21.15.17:0/4096836973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54980b0e70 0x7f549814db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 >> 172.21.15.17:0/4096836973 conn(0x7f54980d1da0 msgr2=0x7f54980aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 shutdown_connections 2024-09-10T23:31:04.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.023+0000 7f549e800640 1 -- 172.21.15.17:0/4096836973 wait complete. 2024-09-10T23:31:04.045 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:31:04.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:04.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:04.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[88467]: fuse finished with error 0 and tester_r 0 2024-09-10T23:31:04.067 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:31:04.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:04.067 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:31:04.237 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:31:04.238 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:31:04.238 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:04.247 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:31:04.247 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:31:04.247 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:04.247 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:04.291 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:31:04.291 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:31:04.292 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:31:04.292 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:04.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:31:04.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.479+0000 7f4135600640 1 -- 172.21.15.17:0/1132152914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f413006f930 msgr2=0x7f4130072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.479+0000 7f4135600640 1 --2- 172.21.15.17:0/1132152914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f413006f930 0x7f4130072800 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f4130070860 tx=0x7f412001c770 comp rx=0 tx=0).stop 2024-09-10T23:31:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.479+0000 7f4135600640 1 -- 172.21.15.17:0/1132152914 shutdown_connections 2024-09-10T23:31:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.479+0000 7f4135600640 1 --2- 172.21.15.17:0/1132152914 >> v2:172.21.15.77:3300/0 conn(0x7f41300cf180 0x7f41300cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.479+0000 7f4135600640 1 --2- 172.21.15.17:0/1132152914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f413006f930 0x7f4130072800 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.479+0000 7f4135600640 1 -- 172.21.15.17:0/1132152914 >> 172.21.15.17:0/1132152914 conn(0x7f41300b1850 msgr2=0x7f41300b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.479+0000 7f4135600640 1 -- 172.21.15.17:0/1132152914 shutdown_connections 2024-09-10T23:31:04.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.479+0000 7f4135600640 1 -- 172.21.15.17:0/1132152914 wait complete. 2024-09-10T23:31:04.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.479+0000 7f4135600640 1 Processor -- start 2024-09-10T23:31:04.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 -- start start 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f413006f930 0x7f4130142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f413006fd10 0x7f41300b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41300cf180 0x7f4130159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4130167b00 con 0x7f41300cf180 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4130167980 con 0x7f413006fd10 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4130167c80 con 0x7f413006f930 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41300cf180 0x7f4130159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41300cf180 0x7f4130159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51644/0 (socket says 172.21.15.17:51644) 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412f400640 1 -- 172.21.15.17:0/145553210 learned_addr learned my addr 172.21.15.17:0/145553210 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412ea00640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f413006f930 0x7f4130142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412e000640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f413006fd10 0x7f41300b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412f400640 1 -- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f413006f930 msgr2=0x7f4130142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412f400640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f413006f930 0x7f4130142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412f400640 1 -- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f413006fd10 msgr2=0x7f41300b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412f400640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f413006fd10 0x7f41300b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412f400640 1 -- 172.21.15.17:0/145553210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41300b4070 con 0x7f41300cf180 2024-09-10T23:31:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f412f400640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41300cf180 0x7f4130159a30 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f412800cce0 tx=0x7f412800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4126a00640 1 -- 172.21.15.17:0/145553210 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412800f450 con 0x7f41300cf180 2024-09-10T23:31:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4126a00640 1 -- 172.21.15.17:0/145553210 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f412800f6e0 con 0x7f41300cf180 2024-09-10T23:31:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4126a00640 1 -- 172.21.15.17:0/145553210 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412800fb30 con 0x7f41300cf180 2024-09-10T23:31:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413014a540 con 0x7f41300cf180 2024-09-10T23:31:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4130143520 con 0x7f41300cf180 2024-09-10T23:31:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.483+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4130075ad0 con 0x7f41300cf180 2024-09-10T23:31:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.487+0000 7f4126a00640 1 -- 172.21.15.17:0/145553210 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f412800fcd0 con 0x7f41300cf180 2024-09-10T23:31:04.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.487+0000 7f4126a00640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41100725e0 0x7f4110074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.487+0000 7f4126a00640 1 -- 172.21.15.17:0/145553210 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f4128093ee0 con 0x7f41300cf180 2024-09-10T23:31:04.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.487+0000 7f412ea00640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41100725e0 0x7f4110074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.487+0000 7f412ea00640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41100725e0 0x7f4110074aa0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f41200af000 tx=0x7f41200b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.491+0000 7f4126a00640 1 -- 172.21.15.17:0/145553210 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4128014030 con 0x7f41300cf180 2024-09-10T23:31:04.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.699+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f413014a330 con 0x7f41300cf180 2024-09-10T23:31:04.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4126a00640 1 -- 172.21.15.17:0/145553210 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5234 (secure 0 0 0) 0x7f412805ed40 con 0x7f41300cf180 2024-09-10T23:31:04.704 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:04.704 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":152,"btime":"2024-09-10T23:30:21:423641+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/762449917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":762449917},{"type":"v1","addr":"172.21.15.77:6836","nonce":762449917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/661473457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":661473457},{"type":"v1","addr":"172.21.15.17:6834","nonce":661473457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11049,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3378779893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3378779893},{"type":"v1","addr":"172.21.15.17:6835","nonce":3378779893}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:30:17.818575+0000","modified":"2024-09-10T23:30:20.823822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11055":{"gid":11055,"name":"b","rank":0,"incarnation":148,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2065743463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2065743463},{"type":"v1","addr":"172.21.15.77:6837","nonce":2065743463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11055,"qdb_cluster":[11055]},"id":14}]} 2024-09-10T23:31:04.704 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 152 2024-09-10T23:31:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41100725e0 msgr2=0x7f4110074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41100725e0 0x7f4110074aa0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f41200af000 tx=0x7f41200b2040 comp rx=0 tx=0).stop 2024-09-10T23:31:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41300cf180 msgr2=0x7f4130159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41300cf180 0x7f4130159a30 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f412800cce0 tx=0x7f412800a620 comp rx=0 tx=0).stop 2024-09-10T23:31:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 shutdown_connections 2024-09-10T23:31:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41100725e0 0x7f4110074aa0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41300cf180 0x7f4130159a30 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f413006fd10 0x7f41300b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 --2- 172.21.15.17:0/145553210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f413006f930 0x7f4130142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 >> 172.21.15.17:0/145553210 conn(0x7f41300b1850 msgr2=0x7f413014cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 shutdown_connections 2024-09-10T23:31:04.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.703+0000 7f4135600640 1 -- 172.21.15.17:0/145553210 wait complete. 2024-09-10T23:31:04.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:04.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 -- 172.21.15.17:0/1364337404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600d07d0 msgr2=0x7f3e60164a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 --2- 172.21.15.17:0/1364337404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600d07d0 0x7f3e60164a90 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f3e600d1500 tx=0x7f3e5801cd80 comp rx=0 tx=0).stop 2024-09-10T23:31:04.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 -- 172.21.15.17:0/1364337404 shutdown_connections 2024-09-10T23:31:04.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 --2- 172.21.15.17:0/1364337404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600d07d0 0x7f3e60164a90 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 --2- 172.21.15.17:0/1364337404 >> v2:172.21.15.77:3300/0 conn(0x7f3e600b0d90 0x7f3e600b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 --2- 172.21.15.17:0/1364337404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e6015f550 0x7f3e600b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 -- 172.21.15.17:0/1364337404 >> 172.21.15.17:0/1364337404 conn(0x7f3e600b3870 msgr2=0x7f3e600b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:04.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 -- 172.21.15.17:0/1364337404 shutdown_connections 2024-09-10T23:31:04.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 -- 172.21.15.17:0/1364337404 wait complete. 2024-09-10T23:31:04.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 Processor -- start 2024-09-10T23:31:04.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 -- start start 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600b0d90 0x7f3e60155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e600d07d0 0x7f3e600ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e6015f550 0x7f3e600c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3e60167c90 con 0x7f3e600b0d90 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3e60167b10 con 0x7f3e6015f550 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e65c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3e60167e10 con 0x7f3e600d07d0 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e5ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600b0d90 0x7f3e60155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e5ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600b0d90 0x7f3e60155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51674/0 (socket says 172.21.15.17:51674) 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e5ea00640 1 -- 172.21.15.17:0/2573809151 learned_addr learned my addr 172.21.15.17:0/2573809151 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e5f400640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e6015f550 0x7f3e600c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e57e00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e600d07d0 0x7f3e600ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e5ea00640 1 -- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e600d07d0 msgr2=0x7f3e600ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e5ea00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e600d07d0 0x7f3e600ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e5ea00640 1 -- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e6015f550 msgr2=0x7f3e600c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:04.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e5ea00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e6015f550 0x7f3e600c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:04.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.871+0000 7f3e5ea00640 1 -- 172.21.15.17:0/2573809151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e600c5890 con 0x7f3e600b0d90 2024-09-10T23:31:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e5ea00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600b0d90 0x7f3e60155c30 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d750 tx=0x7f3e5000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e56a00640 1 -- 172.21.15.17:0/2573809151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50017070 con 0x7f3e600b0d90 2024-09-10T23:31:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e56a00640 1 -- 172.21.15.17:0/2573809151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e50009d20 con 0x7f3e600b0d90 2024-09-10T23:31:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e56a00640 1 -- 172.21.15.17:0/2573809151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50005280 con 0x7f3e600b0d90 2024-09-10T23:31:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e601f9d60 con 0x7f3e600b0d90 2024-09-10T23:31:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e601f8fe0 con 0x7f3e600b0d90 2024-09-10T23:31:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e600ce730 con 0x7f3e600b0d90 2024-09-10T23:31:04.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e56a00640 1 -- 172.21.15.17:0/2573809151 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3e50005420 con 0x7f3e600b0d90 2024-09-10T23:31:04.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e56a00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e3c0725e0 0x7f3e3c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:04.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e56a00640 1 -- 172.21.15.17:0/2573809151 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f3e50093480 con 0x7f3e600b0d90 2024-09-10T23:31:04.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.875+0000 7f3e57e00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e3c0725e0 0x7f3e3c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:04.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.879+0000 7f3e57e00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e3c0725e0 0x7f3e3c074aa0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3e6015c990 tx=0x7f3e4800b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:04.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:04.879+0000 7f3e56a00640 1 -- 172.21.15.17:0/2573809151 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3e600c5890 con 0x7f3e600b0d90 2024-09-10T23:31:05.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.091+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e600b12e0 con 0x7f3e600b0d90 2024-09-10T23:31:05.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e56a00640 1 -- 172.21.15.17:0/2573809151 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5234 (secure 0 0 0) 0x7f3e5000de60 con 0x7f3e600b0d90 2024-09-10T23:31:05.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:05.095 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":152,"btime":"2024-09-10T23:30:21:423641+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/762449917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":762449917},{"type":"v1","addr":"172.21.15.77:6836","nonce":762449917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/661473457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":661473457},{"type":"v1","addr":"172.21.15.17:6834","nonce":661473457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11049,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3378779893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3378779893},{"type":"v1","addr":"172.21.15.17:6835","nonce":3378779893}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:30:17.818575+0000","modified":"2024-09-10T23:30:20.823822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11055":{"gid":11055,"name":"b","rank":0,"incarnation":148,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2065743463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2065743463},{"type":"v1","addr":"172.21.15.77:6837","nonce":2065743463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11055,"qdb_cluster":[11055]},"id":14}]} 2024-09-10T23:31:05.096 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 152 2024-09-10T23:31:05.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e3c0725e0 msgr2=0x7f3e3c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e3c0725e0 0x7f3e3c074aa0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3e6015c990 tx=0x7f3e4800b390 comp rx=0 tx=0).stop 2024-09-10T23:31:05.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600b0d90 msgr2=0x7f3e60155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600b0d90 0x7f3e60155c30 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d750 tx=0x7f3e5000dc10 comp rx=0 tx=0).stop 2024-09-10T23:31:05.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 shutdown_connections 2024-09-10T23:31:05.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3e3c0725e0 0x7f3e3c074aa0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e6015f550 0x7f3e600c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3e600d07d0 0x7f3e600ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 --2- 172.21.15.17:0/2573809151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e600b0d90 0x7f3e60155c30 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 >> 172.21.15.17:0/2573809151 conn(0x7f3e600b3870 msgr2=0x7f3e6015d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 shutdown_connections 2024-09-10T23:31:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.095+0000 7f3e65c00640 1 -- 172.21.15.17:0/2573809151 wait complete. 2024-09-10T23:31:05.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:05.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 -- 172.21.15.17:0/2870068704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c06f0b0 msgr2=0x7fb29c15a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 --2- 172.21.15.17:0/2870068704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c06f0b0 0x7fb29c15a370 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fb29c075000 tx=0x7fb28401c800 comp rx=0 tx=0).stop 2024-09-10T23:31:05.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 -- 172.21.15.17:0/2870068704 shutdown_connections 2024-09-10T23:31:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 --2- 172.21.15.17:0/2870068704 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb29c15a8b0 0x7fb29c15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 --2- 172.21.15.17:0/2870068704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c06f0b0 0x7fb29c15a370 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 --2- 172.21.15.17:0/2870068704 >> v2:172.21.15.77:3300/0 conn(0x7fb29c0708f0 0x7fb29c0b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 -- 172.21.15.17:0/2870068704 >> 172.21.15.17:0/2870068704 conn(0x7fb29c0b1850 msgr2=0x7fb29c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 -- 172.21.15.17:0/2870068704 shutdown_connections 2024-09-10T23:31:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 -- 172.21.15.17:0/2870068704 wait complete. 2024-09-10T23:31:05.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 Processor -- start 2024-09-10T23:31:05.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.263+0000 7fb2a2400640 1 -- start start 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb2a2400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb29c06f0b0 0x7fb29c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb2a2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c0708f0 0x7fb29c1f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb2a2400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb29c15a8b0 0x7fb29c0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb2a2400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c0ce270 con 0x7fb29c0708f0 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb2a2400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c0ce0f0 con 0x7fb29c06f0b0 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb2a2400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb29c0ce3f0 con 0x7fb29c15a8b0 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c0708f0 0x7fb29c1f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb29b400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb29c06f0b0 0x7fb29c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c0708f0 0x7fb29c1f92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51694/0 (socket says 172.21.15.17:51694) 2024-09-10T23:31:05.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293e00640 1 -- 172.21.15.17:0/1161757484 learned_addr learned my addr 172.21.15.17:0/1161757484 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb29be00640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb29c15a8b0 0x7fb29c0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293e00640 1 -- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb29c15a8b0 msgr2=0x7fb29c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293e00640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb29c15a8b0 0x7fb29c0b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293e00640 1 -- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb29c06f0b0 msgr2=0x7fb29c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293e00640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb29c06f0b0 0x7fb29c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293e00640 1 -- 172.21.15.17:0/1161757484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29c1f6210 con 0x7fb29c0708f0 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293e00640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c0708f0 0x7fb29c1f92e0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7fb2840b0040 tx=0x7fb2840040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293400640 1 -- 172.21.15.17:0/1161757484 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2840b2040 con 0x7fb29c0708f0 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293400640 1 -- 172.21.15.17:0/1161757484 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2840044b0 con 0x7fb29c0708f0 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293400640 1 -- 172.21.15.17:0/1161757484 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284005290 con 0x7fb29c0708f0 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29c156dd0 con 0x7fb29c0708f0 2024-09-10T23:31:05.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29c157390 con 0x7fb29c0708f0 2024-09-10T23:31:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb29c075ad0 con 0x7fb29c0708f0 2024-09-10T23:31:05.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.267+0000 7fb293400640 1 -- 172.21.15.17:0/1161757484 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb284005430 con 0x7fb29c0708f0 2024-09-10T23:31:05.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.271+0000 7fb293400640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2780725e0 0x7fb278074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:05.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.271+0000 7fb293400640 1 -- 172.21.15.17:0/1161757484 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fb28412cfc0 con 0x7fb29c0708f0 2024-09-10T23:31:05.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.271+0000 7fb29b400640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2780725e0 0x7fb278074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:05.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.271+0000 7fb29b400640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2780725e0 0x7fb278074aa0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009990 tx=0x7fb28c009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:05.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.275+0000 7fb293400640 1 -- 172.21.15.17:0/1161757484 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb2840164b0 con 0x7fb29c0708f0 2024-09-10T23:31:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.451+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb29c0b5090 con 0x7fb29c0708f0 2024-09-10T23:31:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.451+0000 7fb293400640 1 -- 172.21.15.17:0/1161757484 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) ==== 74+0+16884 (secure 0 0 0) 0x7fb2840f7eb0 con 0x7fb29c0708f0 2024-09-10T23:31:05.454 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:05.454 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":201,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:30:19.410160+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:30:15.536772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-10T23:30:16.779890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2780725e0 msgr2=0x7fb278074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2780725e0 0x7fb278074aa0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009990 tx=0x7fb28c009110 comp rx=0 tx=0).stop 2024-09-10T23:31:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c0708f0 msgr2=0x7fb29c1f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c0708f0 0x7fb29c1f92e0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7fb2840b0040 tx=0x7fb2840040c0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 shutdown_connections 2024-09-10T23:31:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb2780725e0 0x7fb278074aa0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb29c15a8b0 0x7fb29c0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb29c0708f0 0x7fb29c1f92e0 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 --2- 172.21.15.17:0/1161757484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb29c06f0b0 0x7fb29c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 >> 172.21.15.17:0/1161757484 conn(0x7fb29c0b1850 msgr2=0x7fb29c152330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 shutdown_connections 2024-09-10T23:31:05.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.455+0000 7fb2a2400640 1 -- 172.21.15.17:0/1161757484 wait complete. 2024-09-10T23:31:05.476 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:31:05.476 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 -- 172.21.15.17:0/883517861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b80b2fc0 msgr2=0x7f31b80d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 --2- 172.21.15.17:0/883517861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b80b2fc0 0x7f31b80d0660 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009900 tx=0x7f31a001c8a0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 -- 172.21.15.17:0/883517861 shutdown_connections 2024-09-10T23:31:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 --2- 172.21.15.17:0/883517861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b80b2fc0 0x7f31b80d0660 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 -- 172.21.15.17:0/883517861 >> 172.21.15.17:0/883517861 conn(0x7f31b80d1d40 msgr2=0x7f31b80d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 -- 172.21.15.17:0/883517861 shutdown_connections 2024-09-10T23:31:05.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 -- 172.21.15.17:0/883517861 wait complete. 2024-09-10T23:31:05.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 Processor -- start 2024-09-10T23:31:05.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 -- start start 2024-09-10T23:31:05.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b2fc0 0x7f31b806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:05.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b80cfb70 0x7f31b81fad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:05.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b815fc90 0x7f31b81fb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:05.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f31b816a140 con 0x7f31b815fc90 2024-09-10T23:31:05.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8169fc0 con 0x7f31b80cfb70 2024-09-10T23:31:05.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.623+0000 7f31bca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f31b816a2c0 con 0x7f31b80b2fc0 2024-09-10T23:31:05.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31b5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b2fc0 0x7f31b806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:05.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31b6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b815fc90 0x7f31b81fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:05.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31afe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b80cfb70 0x7f31b81fad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:05.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31b5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b2fc0 0x7f31b806ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:49520/0 (socket says 172.21.15.17:49520) 2024-09-10T23:31:05.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31b5e00640 1 -- 172.21.15.17:0/3156625651 learned_addr learned my addr 172.21.15.17:0/3156625651 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:05.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31afe00640 1 -- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b2fc0 msgr2=0x7f31b806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31afe00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b2fc0 0x7f31b806ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31afe00640 1 -- 172.21.15.17:0/3156625651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b815fc90 msgr2=0x7f31b81fb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31afe00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b815fc90 0x7f31b81fb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31afe00640 1 -- 172.21.15.17:0/3156625651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b80cec70 con 0x7f31b80cfb70 2024-09-10T23:31:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31afe00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b80cfb70 0x7f31b81fad30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f31a00ac000 tx=0x7f31a00040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31ae000640 1 -- 172.21.15.17:0/3156625651 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a00b2040 con 0x7f31b80cfb70 2024-09-10T23:31:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31ae000640 1 -- 172.21.15.17:0/3156625651 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31a00044d0 con 0x7f31b80cfb70 2024-09-10T23:31:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b80ce9f0 con 0x7f31b80cfb70 2024-09-10T23:31:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31ae000640 1 -- 172.21.15.17:0/3156625651 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003860 con 0x7f31b80cfb70 2024-09-10T23:31:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b815bcf0 con 0x7f31b80cfb70 2024-09-10T23:31:05.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b8160140 con 0x7f31b80cfb70 2024-09-10T23:31:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.627+0000 7f31ae000640 1 -- 172.21.15.17:0/3156625651 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f31a0003a00 con 0x7f31b80cfb70 2024-09-10T23:31:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.631+0000 7f31ae000640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f31940725e0 0x7f3194074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.631+0000 7f31ae000640 1 -- 172.21.15.17:0/3156625651 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f31a012d5d0 con 0x7f31b80cfb70 2024-09-10T23:31:05.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.631+0000 7f31b5e00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f31940725e0 0x7f3194074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:05.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.631+0000 7f31b5e00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f31940725e0 0x7f3194074aa0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f31a8000f70 tx=0x7f31a8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:05.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.635+0000 7f31ae000640 1 -- 172.21.15.17:0/3156625651 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f31b80ce9f0 con 0x7f31b80cfb70 2024-09-10T23:31:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.843+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31b815b790 con 0x7f31b80cfb70 2024-09-10T23:31:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.843+0000 7f31ae000640 1 -- 172.21.15.17:0/3156625651 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5234 (secure 0 0 0) 0x7f31a0016490 con 0x7f31b80cfb70 2024-09-10T23:31:05.846 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:05.846 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":152,"btime":"2024-09-10T23:30:21:423641+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/762449917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":762449917},{"type":"v1","addr":"172.21.15.77:6836","nonce":762449917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/661473457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":661473457},{"type":"v1","addr":"172.21.15.17:6834","nonce":661473457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11049,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3378779893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3378779893},{"type":"v1","addr":"172.21.15.17:6835","nonce":3378779893}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:30:17.818575+0000","modified":"2024-09-10T23:30:20.823822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11055":{"gid":11055,"name":"b","rank":0,"incarnation":148,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2065743463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2065743463},{"type":"v1","addr":"172.21.15.77:6837","nonce":2065743463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11055,"qdb_cluster":[11055]},"id":14}]} 2024-09-10T23:31:05.847 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 152 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f31940725e0 msgr2=0x7f3194074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f31940725e0 0x7f3194074aa0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f31a8000f70 tx=0x7f31a8009040 comp rx=0 tx=0).stop 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b80cfb70 msgr2=0x7f31b81fad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b80cfb70 0x7f31b81fad30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f31a00ac000 tx=0x7f31a00040c0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 shutdown_connections 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f31940725e0 0x7f3194074aa0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31b815fc90 0x7f31b81fb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31b80cfb70 0x7f31b81fad30 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 --2- 172.21.15.17:0/3156625651 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f31b80b2fc0 0x7f31b806ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 >> 172.21.15.17:0/3156625651 conn(0x7f31b80d1d40 msgr2=0x7f31b80b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 shutdown_connections 2024-09-10T23:31:05.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:05.847+0000 7f31bca00640 1 -- 172.21.15.17:0/3156625651 wait complete. 2024-09-10T23:31:05.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 -- 172.21.15.17:0/2163324271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100d0240 msgr2=0x7f42100af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 --2- 172.21.15.17:0/2163324271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100d0240 0x7f42100af690 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f4210073fe0 tx=0x7f41fc01c800 comp rx=0 tx=0).stop 2024-09-10T23:31:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 -- 172.21.15.17:0/2163324271 shutdown_connections 2024-09-10T23:31:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 --2- 172.21.15.17:0/2163324271 >> v2:172.21.15.77:3300/0 conn(0x7f421015f550 0x7f42100afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 --2- 172.21.15.17:0/2163324271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42100d0240 0x7f42100af690 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 -- 172.21.15.17:0/2163324271 >> 172.21.15.17:0/2163324271 conn(0x7f42100d1bc0 msgr2=0x7f42100d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 -- 172.21.15.17:0/2163324271 shutdown_connections 2024-09-10T23:31:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 -- 172.21.15.17:0/2163324271 wait complete. 2024-09-10T23:31:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 Processor -- start 2024-09-10T23:31:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 -- start start 2024-09-10T23:31:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42100d0240 0x7f42100c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421015f170 0x7f4210145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f421015f550 0x7f4210070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f42101690a0 con 0x7f421015f170 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4210168f20 con 0x7f421015f550 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4210169220 con 0x7f42100d0240 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4214c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421015f170 0x7f4210145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4214c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421015f170 0x7f4210145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51730/0 (socket says 172.21.15.17:51730) 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4214c00640 1 -- 172.21.15.17:0/3247109361 learned_addr learned my addr 172.21.15.17:0/3247109361 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4215600640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42100d0240 0x7f42100c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.015+0000 7f4216000640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f421015f550 0x7f4210070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f4214c00640 1 -- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42100d0240 msgr2=0x7f42100c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f4214c00640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42100d0240 0x7f42100c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f4214c00640 1 -- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f421015f550 msgr2=0x7f4210070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f4214c00640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f421015f550 0x7f4210070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f4214c00640 1 -- 172.21.15.17:0/3247109361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42100c4ee0 con 0x7f421015f170 2024-09-10T23:31:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f4214c00640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421015f170 0x7f4210145120 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f41fc000c10 tx=0x7f41fc005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f420d600640 1 -- 172.21.15.17:0/3247109361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0bf070 con 0x7f421015f170 2024-09-10T23:31:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f420d600640 1 -- 172.21.15.17:0/3247109361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41fc0a85f0 con 0x7f421015f170 2024-09-10T23:31:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f420d600640 1 -- 172.21.15.17:0/3247109361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc0054b0 con 0x7f421015f170 2024-09-10T23:31:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4210145660 con 0x7f421015f170 2024-09-10T23:31:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42101fb5e0 con 0x7f421015f170 2024-09-10T23:31:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42100af6a0 con 0x7f421015f170 2024-09-10T23:31:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f420d600640 1 -- 172.21.15.17:0/3247109361 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f41fc0046d0 con 0x7f421015f170 2024-09-10T23:31:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.019+0000 7f420d600640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41f00725e0 0x7f41f0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.023+0000 7f420d600640 1 -- 172.21.15.17:0/3247109361 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f41fc12d7d0 con 0x7f421015f170 2024-09-10T23:31:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.023+0000 7f4215600640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41f00725e0 0x7f41f0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.023+0000 7f4215600640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41f00725e0 0x7f41f0074aa0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f42100b2670 tx=0x7f4204001440 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.023+0000 7f420d600640 1 -- 172.21.15.17:0/3247109361 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4210145660 con 0x7f421015f170 2024-09-10T23:31:06.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.235+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f421006f680 con 0x7f421015f170 2024-09-10T23:31:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.235+0000 7f420d600640 1 -- 172.21.15.17:0/3247109361 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+5234 (secure 0 0 0) 0x7f41fc0ac030 con 0x7f421015f170 2024-09-10T23:31:06.237 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:06.237 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":152,"btime":"2024-09-10T23:30:21:423641+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/762449917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":762449917},{"type":"v1","addr":"172.21.15.77:6836","nonce":762449917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/661473457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":661473457},{"type":"v1","addr":"172.21.15.17:6834","nonce":661473457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11049,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3378779893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3378779893},{"type":"v1","addr":"172.21.15.17:6835","nonce":3378779893}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:30:17.818575+0000","modified":"2024-09-10T23:30:20.823822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11055":{"gid":11055,"name":"b","rank":0,"incarnation":148,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2065743463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2065743463},{"type":"v1","addr":"172.21.15.77:6837","nonce":2065743463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11055,"qdb_cluster":[11055]},"id":14}]} 2024-09-10T23:31:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 152 2024-09-10T23:31:06.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.235+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41f00725e0 msgr2=0x7f41f0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.235+0000 7f4216a00640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41f00725e0 0x7f41f0074aa0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f42100b2670 tx=0x7f4204001440 comp rx=0 tx=0).stop 2024-09-10T23:31:06.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.235+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421015f170 msgr2=0x7f4210145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.235+0000 7f4216a00640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421015f170 0x7f4210145120 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f41fc000c10 tx=0x7f41fc005dd0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.239+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 shutdown_connections 2024-09-10T23:31:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.239+0000 7f4216a00640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41f00725e0 0x7f41f0074aa0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.239+0000 7f4216a00640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f421015f550 0x7f4210070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.239+0000 7f4216a00640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421015f170 0x7f4210145120 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.239+0000 7f4216a00640 1 --2- 172.21.15.17:0/3247109361 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42100d0240 0x7f42100c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.239+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 >> 172.21.15.17:0/3247109361 conn(0x7f42100d1bc0 msgr2=0x7f4210156050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.239+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 shutdown_connections 2024-09-10T23:31:06.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.239+0000 7f4216a00640 1 -- 172.21.15.17:0/3247109361 wait complete. 2024-09-10T23:31:06.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:06.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.403+0000 7fa575600640 1 -- 172.21.15.17:0/3247414575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700cfb70 msgr2=0x7fa5700cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.403+0000 7fa575600640 1 --2- 172.21.15.17:0/3247414575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700cfb70 0x7fa5700cff50 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7fa560009900 tx=0x7fa56001c8b0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.403+0000 7fa575600640 1 -- 172.21.15.17:0/3247414575 shutdown_connections 2024-09-10T23:31:06.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.403+0000 7fa575600640 1 --2- 172.21.15.17:0/3247414575 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa57015fc90 0x7fa570160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.403+0000 7fa575600640 1 --2- 172.21.15.17:0/3247414575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700cfb70 0x7fa5700cff50 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.403+0000 7fa575600640 1 -- 172.21.15.17:0/3247414575 >> 172.21.15.17:0/3247414575 conn(0x7fa5700d1d40 msgr2=0x7fa5700d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.403+0000 7fa575600640 1 -- 172.21.15.17:0/3247414575 shutdown_connections 2024-09-10T23:31:06.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.403+0000 7fa575600640 1 -- 172.21.15.17:0/3247414575 wait complete. 2024-09-10T23:31:06.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 Processor -- start 2024-09-10T23:31:06.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 -- start start 2024-09-10T23:31:06.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700b2fc0 0x7fa570165d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5700cfb70 0x7fa57014c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57015fc90 0x7fa570071a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa5700b0ad0 con 0x7fa5700b2fc0 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa5700b0950 con 0x7fa57015fc90 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa570168f60 con 0x7fa5700cfb70 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700b2fc0 0x7fa570165d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700b2fc0 0x7fa570165d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51746/0 (socket says 172.21.15.17:51746) 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56ea00640 1 -- 172.21.15.17:0/1476757231 learned_addr learned my addr 172.21.15.17:0/1476757231 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56f400640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57015fc90 0x7fa570071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa566000640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5700cfb70 0x7fa57014c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56ea00640 1 -- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5700cfb70 msgr2=0x7fa57014c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56ea00640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5700cfb70 0x7fa57014c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56ea00640 1 -- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57015fc90 msgr2=0x7fa570071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56ea00640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57015fc90 0x7fa570071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56ea00640 1 -- 172.21.15.17:0/1476757231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5701fbb40 con 0x7fa5700b2fc0 2024-09-10T23:31:06.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa566000640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5700cfb70 0x7fa57014c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:06.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa56ea00640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700b2fc0 0x7fa570165d30 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7fa560009850 tx=0x7fa5600a5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa567400640 1 -- 172.21.15.17:0/1476757231 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5600b2040 con 0x7fa5700b2fc0 2024-09-10T23:31:06.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa567400640 1 -- 172.21.15.17:0/1476757231 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5600053e0 con 0x7fa5700b2fc0 2024-09-10T23:31:06.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa567400640 1 -- 172.21.15.17:0/1476757231 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5600046d0 con 0x7fa5700b2fc0 2024-09-10T23:31:06.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa570165250 con 0x7fa5700b2fc0 2024-09-10T23:31:06.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.407+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa570165810 con 0x7fa5700b2fc0 2024-09-10T23:31:06.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.411+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa570160110 con 0x7fa5700b2fc0 2024-09-10T23:31:06.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.411+0000 7fa567400640 1 -- 172.21.15.17:0/1476757231 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa560004890 con 0x7fa5700b2fc0 2024-09-10T23:31:06.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.411+0000 7fa567400640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa54c0725e0 0x7fa54c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.411+0000 7fa567400640 1 -- 172.21.15.17:0/1476757231 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fa56012dab0 con 0x7fa5700b2fc0 2024-09-10T23:31:06.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.411+0000 7fa566000640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa54c0725e0 0x7fa54c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.415+0000 7fa566000640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa54c0725e0 0x7fa54c074aa0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa570166370 tx=0x7fa558009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.415+0000 7fa567400640 1 -- 172.21.15.17:0/1476757231 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa5600164d0 con 0x7fa5700b2fc0 2024-09-10T23:31:06.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.595+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5700cf2c0 con 0x7fa5700b2fc0 2024-09-10T23:31:06.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.595+0000 7fa567400640 1 -- 172.21.15.17:0/1476757231 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) ==== 74+0+16884 (secure 0 0 0) 0x7fa5600f8ff0 con 0x7fa5700b2fc0 2024-09-10T23:31:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:06.599 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":201,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:30:19.410160+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:30:15.536772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-10T23:30:16.779890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa54c0725e0 msgr2=0x7fa54c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa54c0725e0 0x7fa54c074aa0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa570166370 tx=0x7fa558009040 comp rx=0 tx=0).stop 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700b2fc0 msgr2=0x7fa570165d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700b2fc0 0x7fa570165d30 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7fa560009850 tx=0x7fa5600a5770 comp rx=0 tx=0).stop 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 shutdown_connections 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa54c0725e0 0x7fa54c074aa0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa57015fc90 0x7fa570071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa5700cfb70 0x7fa57014c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 --2- 172.21.15.17:0/1476757231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5700b2fc0 0x7fa570165d30 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 >> 172.21.15.17:0/1476757231 conn(0x7fa5700d1d40 msgr2=0x7fa5700b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 shutdown_connections 2024-09-10T23:31:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.599+0000 7fa575600640 1 -- 172.21.15.17:0/1476757231 wait complete. 2024-09-10T23:31:06.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:31:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 -- 172.21.15.17:0/3976200944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 msgr2=0x7fedbc0af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 --2- 172.21.15.17:0/3976200944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 0x7fedbc0af480 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7fedbc073a10 tx=0x7fedb401cd80 comp rx=0 tx=0).stop 2024-09-10T23:31:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 -- 172.21.15.17:0/3976200944 shutdown_connections 2024-09-10T23:31:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 --2- 172.21.15.17:0/3976200944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 0x7fedbc0af480 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 --2- 172.21.15.17:0/3976200944 >> v2:172.21.15.77:3300/0 conn(0x7fedbc0cdf60 0x7fedbc0d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 --2- 172.21.15.17:0/3976200944 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedbc0ce4b0 0x7fedbc0cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 -- 172.21.15.17:0/3976200944 >> 172.21.15.17:0/3976200944 conn(0x7fedbc0d1d40 msgr2=0x7fedbc0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 -- 172.21.15.17:0/3976200944 shutdown_connections 2024-09-10T23:31:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 -- 172.21.15.17:0/3976200944 wait complete. 2024-09-10T23:31:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 Processor -- start 2024-09-10T23:31:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 -- start start 2024-09-10T23:31:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedbc0cdf60 0x7fedbc0b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedbc0ce4b0 0x7fedbc14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 0x7fedbc0c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc0ccfb0 con 0x7fedbc0ce890 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc0cce30 con 0x7fedbc0ce4b0 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.767+0000 7fedc1c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fedbc0cd130 con 0x7fedbc0cdf60 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 0x7fedbc0c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 0x7fedbc0c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59156/0 (socket says 172.21.15.17:59156) 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbb400640 1 -- 172.21.15.17:0/4148318384 learned_addr learned my addr 172.21.15.17:0/4148318384 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbaa00640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedbc0cdf60 0x7fedbc0b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedb2000640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedbc0ce4b0 0x7fedbc14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbb400640 1 -- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedbc0cdf60 msgr2=0x7fedbc0b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbb400640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedbc0cdf60 0x7fedbc0b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbb400640 1 -- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedbc0ce4b0 msgr2=0x7fedbc14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbb400640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedbc0ce4b0 0x7fedbc14b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbb400640 1 -- 172.21.15.17:0/4148318384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc0c8c10 con 0x7fedbc0ce890 2024-09-10T23:31:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedbb400640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 0x7fedbc0c8430 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fedb401b430 tx=0x7fedb4005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedb3400640 1 -- 172.21.15.17:0/4148318384 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb40bb070 con 0x7fedbc0ce890 2024-09-10T23:31:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedb3400640 1 -- 172.21.15.17:0/4148318384 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedb4004d40 con 0x7fedbc0ce890 2024-09-10T23:31:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedb3400640 1 -- 172.21.15.17:0/4148318384 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb40b2040 con 0x7fedbc0ce890 2024-09-10T23:31:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedbc0c8970 con 0x7fedbc0ce890 2024-09-10T23:31:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc0b3150 con 0x7fedbc0ce890 2024-09-10T23:31:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedbc0cfb20 con 0x7fedbc0ce890 2024-09-10T23:31:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.771+0000 7fedb3400640 1 -- 172.21.15.17:0/4148318384 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fedb40b5030 con 0x7fedbc0ce890 2024-09-10T23:31:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.775+0000 7fedb3400640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed98072610 0x7fed98074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.775+0000 7fedb3400640 1 -- 172.21.15.17:0/4148318384 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fedb412cf60 con 0x7fedbc0ce890 2024-09-10T23:31:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.775+0000 7fedbaa00640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed98072610 0x7fed98074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.775+0000 7fedbaa00640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed98072610 0x7fed98074ad0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fedac004630 tx=0x7fedac00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.779+0000 7fedb3400640 1 -- 172.21.15.17:0/4148318384 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fedbc0c8c10 con 0x7fedbc0ce890 2024-09-10T23:31:06.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.983+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fedbc0d0100 con 0x7fedbc0ce890 2024-09-10T23:31:06.987 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:31:06.987+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:31:06.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.987+0000 7fedb3400640 1 -- 172.21.15.17:0/4148318384 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v153) ==== 161+0+0 (secure 0 0 0) 0x7fedb4016970 con 0x7fedbc0ce890 2024-09-10T23:31:06.990 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:31:06.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed98072610 msgr2=0x7fed98074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed98072610 0x7fed98074ad0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fedac004630 tx=0x7fedac00b390 comp rx=0 tx=0).stop 2024-09-10T23:31:06.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 msgr2=0x7fedbc0c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:06.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 0x7fedbc0c8430 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fedb401b430 tx=0x7fedb4005b00 comp rx=0 tx=0).stop 2024-09-10T23:31:06.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 shutdown_connections 2024-09-10T23:31:06.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fed98072610 0x7fed98074ad0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedbc0ce890 0x7fedbc0c8430 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedbc0ce4b0 0x7fedbc14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 --2- 172.21.15.17:0/4148318384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedbc0cdf60 0x7fedbc0b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:06.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 >> 172.21.15.17:0/4148318384 conn(0x7fedbc0d1d40 msgr2=0x7fedbc0b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:06.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 shutdown_connections 2024-09-10T23:31:06.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:06.991+0000 7fedc1c00640 1 -- 172.21.15.17:0/4148318384 wait complete. 2024-09-10T23:31:07.004 INFO:tasks.ceph.mds.b.smithi077.stderr: -6205> 2024-09-10T23:30:23.666+0000 7f8ecf600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:31:07.008 INFO:tasks.ceph.mds.b.smithi077.stderr: -3881> 2024-09-10T23:30:32.046+0000 7f8eca600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 pv8 ap=4 DIRTYPARENT s=5242880 n(v0 rc2024-09-10T23:30:30.859749+0000 b5242880 1=1+0)->n(v0 rc2024-09-10T23:30:30.867172+0000 b6291456 1=1+0) (ifile lock->xlock w=1) (iquiesce lock w=1) cr={11223=0-12582912@1} caps={11223=pAsLsXsFc/-@5} | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x557c00c44b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-10T23:31:07.014 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:31:07.055 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:31:07.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 -- 172.21.15.17:0/3388737701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9840c5470 msgr2=0x7fb984160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 --2- 172.21.15.17:0/3388737701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9840c5470 0x7fb984160050 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009840 tx=0x7fb96c01c6b0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 -- 172.21.15.17:0/3388737701 shutdown_connections 2024-09-10T23:31:07.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 --2- 172.21.15.17:0/3388737701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9840c5470 0x7fb984160050 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 -- 172.21.15.17:0/3388737701 >> 172.21.15.17:0/3388737701 conn(0x7fb9840d1de0 msgr2=0x7fb9840d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:07.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 -- 172.21.15.17:0/3388737701 shutdown_connections 2024-09-10T23:31:07.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 -- 172.21.15.17:0/3388737701 wait complete. 2024-09-10T23:31:07.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 Processor -- start 2024-09-10T23:31:07.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 -- start start 2024-09-10T23:31:07.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9840c5470 0x7fb98415e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9840ce770 0x7fb9840cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb98415f3d0 0x7fb984140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb98416a4a0 con 0x7fb9840ce770 2024-09-10T23:31:07.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9841607a0 con 0x7fb9840c5470 2024-09-10T23:31:07.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb988a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb98416a620 con 0x7fb98415f3d0 2024-09-10T23:31:07.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb97be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9840ce770 0x7fb9840cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb97be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9840ce770 0x7fb9840cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59162/0 (socket says 172.21.15.17:59162) 2024-09-10T23:31:07.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb97be00640 1 -- 172.21.15.17:0/2858939203 learned_addr learned my addr 172.21.15.17:0/2858939203 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:07.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb981e00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9840c5470 0x7fb98415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.163+0000 7fb982800640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb98415f3d0 0x7fb984140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97be00640 1 -- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb98415f3d0 msgr2=0x7fb984140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97be00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb98415f3d0 0x7fb984140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97be00640 1 -- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9840c5470 msgr2=0x7fb98415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97be00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9840c5470 0x7fb98415e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97be00640 1 -- 172.21.15.17:0/2858939203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9840cbe30 con 0x7fb9840ce770 2024-09-10T23:31:07.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97be00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9840ce770 0x7fb9840cae50 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009790 tx=0x7fb96c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:07.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97a000640 1 -- 172.21.15.17:0/2858939203 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0047d0 con 0x7fb9840ce770 2024-09-10T23:31:07.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9840c8f50 con 0x7fb9840ce770 2024-09-10T23:31:07.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97a000640 1 -- 172.21.15.17:0/2858939203 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb96c004970 con 0x7fb9840ce770 2024-09-10T23:31:07.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97a000640 1 -- 172.21.15.17:0/2858939203 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c004d60 con 0x7fb9840ce770 2024-09-10T23:31:07.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9840c9510 con 0x7fb9840ce770 2024-09-10T23:31:07.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9840cec00 con 0x7fb9840ce770 2024-09-10T23:31:07.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97a000640 1 -- 172.21.15.17:0/2858939203 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb96c0b0400 con 0x7fb9840ce770 2024-09-10T23:31:07.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97a000640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9600725e0 0x7fb960074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:07.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.167+0000 7fb97a000640 1 -- 172.21.15.17:0/2858939203 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6187+0+0 (secure 0 0 0) 0x7fb96c12cda0 con 0x7fb9840ce770 2024-09-10T23:31:07.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.171+0000 7fb981e00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9600725e0 0x7fb960074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:07.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.171+0000 7fb981e00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9600725e0 0x7fb960074aa0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb974007fd0 tx=0x7fb974009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:07.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.171+0000 7fb97a000640 1 -- 172.21.15.17:0/2858939203 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb96c0ac030 con 0x7fb9840ce770 2024-09-10T23:31:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.383+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb9840b7d60 con 0x7fb9840ce770 2024-09-10T23:31:07.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb97a000640 1 -- 172.21.15.17:0/2858939203 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v154) ==== 104+0+0 (secure 0 0 0) 0x7fb96c016330 con 0x7fb9840ce770 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9600725e0 msgr2=0x7fb960074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9600725e0 0x7fb960074aa0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb974007fd0 tx=0x7fb974009040 comp rx=0 tx=0).stop 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9840ce770 msgr2=0x7fb9840cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9840ce770 0x7fb9840cae50 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009790 tx=0x7fb96c005dc0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 shutdown_connections 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb9600725e0 0x7fb960074aa0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb98415f3d0 0x7fb984140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9840ce770 0x7fb9840cae50 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 --2- 172.21.15.17:0/2858939203 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9840c5470 0x7fb98415e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 >> 172.21.15.17:0/2858939203 conn(0x7fb9840d1de0 msgr2=0x7fb9840cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 shutdown_connections 2024-09-10T23:31:07.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:07.991+0000 7fb988a00640 1 -- 172.21.15.17:0/2858939203 wait complete. 2024-09-10T23:31:08.019 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:31:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 -- 172.21.15.17:0/2514482214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc0c9b30 msgr2=0x7f81bc15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 --2- 172.21.15.17:0/2514482214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc0c9b30 0x7f81bc15f770 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f81bc06d460 tx=0x7f81b401c9a0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 -- 172.21.15.17:0/2514482214 shutdown_connections 2024-09-10T23:31:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 --2- 172.21.15.17:0/2514482214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc0c9b30 0x7f81bc15f770 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 --2- 172.21.15.17:0/2514482214 >> v2:172.21.15.77:3300/0 conn(0x7f81bc0703e0 0x7f81bc0743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 --2- 172.21.15.17:0/2514482214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc15bbc0 0x7f81bc073e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 -- 172.21.15.17:0/2514482214 >> 172.21.15.17:0/2514482214 conn(0x7f81bc0cc590 msgr2=0x7f81bc0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:08.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 -- 172.21.15.17:0/2514482214 shutdown_connections 2024-09-10T23:31:08.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 -- 172.21.15.17:0/2514482214 wait complete. 2024-09-10T23:31:08.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 Processor -- start 2024-09-10T23:31:08.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.171+0000 7f81c3400640 1 -- start start 2024-09-10T23:31:08.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0c9b30 0x7f81bc13ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc15bbc0 0x7f81bc1fb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c3400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc14f720 0x7f81bc13fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c3400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc0cade0 con 0x7f81bc15bbc0 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c3400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc0cac60 con 0x7f81bc0c9b30 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c3400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc0caf60 con 0x7f81bc14f720 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc15bbc0 0x7f81bc1fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c0a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0c9b30 0x7f81bc13ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc15bbc0 0x7f81bc1fb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59170/0 (socket says 172.21.15.17:59170) 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81bbe00640 1 -- 172.21.15.17:0/2472810136 learned_addr learned my addr 172.21.15.17:0/2472810136 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c1400640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc14f720 0x7f81bc13fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81bbe00640 1 -- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc14f720 msgr2=0x7f81bc13fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81bbe00640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc14f720 0x7f81bc13fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81bbe00640 1 -- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0c9b30 msgr2=0x7f81bc13ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81bbe00640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0c9b30 0x7f81bc13ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81bbe00640 1 -- 172.21.15.17:0/2472810136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc1fbab0 con 0x7f81bc15bbc0 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c0a00640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0c9b30 0x7f81bc13ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81bbe00640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc15bbc0 0x7f81bc1fb220 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f81a800d770 tx=0x7f81a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81b8c00640 1 -- 172.21.15.17:0/2472810136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8017070 con 0x7f81bc15bbc0 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81b8c00640 1 -- 172.21.15.17:0/2472810136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81a8009cc0 con 0x7f81bc15bbc0 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81b8c00640 1 -- 172.21.15.17:0/2472810136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a80106c0 con 0x7f81bc15bbc0 2024-09-10T23:31:08.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc1fbd90 con 0x7f81bc15bbc0 2024-09-10T23:31:08.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc13f6f0 con 0x7f81bc15bbc0 2024-09-10T23:31:08.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc0cb4f0 con 0x7f81bc15bbc0 2024-09-10T23:31:08.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.175+0000 7f81b8c00640 1 -- 172.21.15.17:0/2472810136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f81a8010860 con 0x7f81bc15bbc0 2024-09-10T23:31:08.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.179+0000 7f81b8c00640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f819c072610 0x7f819c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:08.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.179+0000 7f81b8c00640 1 -- 172.21.15.17:0/2472810136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6187+0+0 (secure 0 0 0) 0x7f81a8093800 con 0x7f81bc15bbc0 2024-09-10T23:31:08.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.179+0000 7f81c0a00640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f819c072610 0x7f819c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:08.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.179+0000 7f81c0a00640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f819c072610 0x7f819c074ad0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f81b000bf40 tx=0x7f81b000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:08.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.183+0000 7f81b8c00640 1 -- 172.21.15.17:0/2472810136 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f81a805e610 con 0x7f81bc15bbc0 2024-09-10T23:31:08.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.355+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81bc15b3d0 con 0x7f81bc15bbc0 2024-09-10T23:31:08.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:31:08.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:31:08.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.995+0000 7f81b8c00640 1 -- 172.21.15.17:0/2472810136 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v203) ==== 181+0+0 (secure 0 0 0) 0x7f81a8063040 con 0x7f81bc15bbc0 2024-09-10T23:31:08.999 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f819c072610 msgr2=0x7f819c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f819c072610 0x7f819c074ad0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f81b000bf40 tx=0x7f81b000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc15bbc0 msgr2=0x7f81bc1fb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc15bbc0 0x7f81bc1fb220 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f81a800d770 tx=0x7f81a800dc30 comp rx=0 tx=0).stop 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 shutdown_connections 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f819c072610 0x7f819c074ad0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81bc14f720 0x7f81bc13fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81bc15bbc0 0x7f81bc1fb220 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 --2- 172.21.15.17:0/2472810136 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc0c9b30 0x7f81bc13ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 >> 172.21.15.17:0/2472810136 conn(0x7f81bc0cc590 msgr2=0x7f81bc15a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:09.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 shutdown_connections 2024-09-10T23:31:09.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:08.999+0000 7f81c3400640 1 -- 172.21.15.17:0/2472810136 wait complete. 2024-09-10T23:31:09.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:31:09.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 -- 172.21.15.17:0/1838184861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6500cc860 msgr2=0x7ff6500cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 --2- 172.21.15.17:0/1838184861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6500cc860 0x7ff6500cccf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff648009c80 tx=0x7ff64801cd10 comp rx=0 tx=0).stop 2024-09-10T23:31:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 -- 172.21.15.17:0/1838184861 shutdown_connections 2024-09-10T23:31:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 --2- 172.21.15.17:0/1838184861 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6500cc860 0x7ff6500cccf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 --2- 172.21.15.17:0/1838184861 >> v2:172.21.15.77:3300/0 conn(0x7ff6500ce7c0 0x7ff650070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 -- 172.21.15.17:0/1838184861 >> 172.21.15.17:0/1838184861 conn(0x7ff6500d1b50 msgr2=0x7ff6500d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 -- 172.21.15.17:0/1838184861 shutdown_connections 2024-09-10T23:31:09.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 -- 172.21.15.17:0/1838184861 wait complete. 2024-09-10T23:31:09.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 Processor -- start 2024-09-10T23:31:09.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.179+0000 7ff64fe00640 1 -- start start 2024-09-10T23:31:09.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6500cc860 0x7ff6500b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:09.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6500ce7c0 0x7ff6500c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:09.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6500ceba0 0x7ff650144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:09.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff650168d00 con 0x7ff6500ceba0 2024-09-10T23:31:09.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff6500715c0 con 0x7ff6500ce7c0 2024-09-10T23:31:09.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff650168e80 con 0x7ff6500cc860 2024-09-10T23:31:09.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6500ceba0 0x7ff650144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:09.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6500ceba0 0x7ff650144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59184/0 (socket says 172.21.15.17:59184) 2024-09-10T23:31:09.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64f400640 1 -- 172.21.15.17:0/1227207146 learned_addr learned my addr 172.21.15.17:0/1227207146 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:09.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64ea00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6500cc860 0x7ff6500b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:09.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff647e00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6500ce7c0 0x7ff6500c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:09.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64f400640 1 -- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6500cc860 msgr2=0x7ff6500b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:09.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64f400640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6500cc860 0x7ff6500b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64f400640 1 -- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6500ce7c0 msgr2=0x7ff6500c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:09.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64f400640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6500ce7c0 0x7ff6500c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:09.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64f400640 1 -- 172.21.15.17:0/1227207146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff650145500 con 0x7ff6500ceba0 2024-09-10T23:31:09.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64f400640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6500ceba0 0x7ff650144a60 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7ff648009bd0 tx=0x7ff648003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:09.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff647400640 1 -- 172.21.15.17:0/1227207146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6480bb070 con 0x7ff6500ceba0 2024-09-10T23:31:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff647400640 1 -- 172.21.15.17:0/1227207146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff648004d40 con 0x7ff6500ceba0 2024-09-10T23:31:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6500b6a20 con 0x7ff6500ceba0 2024-09-10T23:31:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff647400640 1 -- 172.21.15.17:0/1227207146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6480b2040 con 0x7ff6500ceba0 2024-09-10T23:31:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff650155280 con 0x7ff6500ceba0 2024-09-10T23:31:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.183+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6500cccf0 con 0x7ff6500ceba0 2024-09-10T23:31:09.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.187+0000 7ff647400640 1 -- 172.21.15.17:0/1227207146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff6480b5030 con 0x7ff6500ceba0 2024-09-10T23:31:09.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.187+0000 7ff647400640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff62c0725e0 0x7ff62c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:09.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.187+0000 7ff647400640 1 -- 172.21.15.17:0/1227207146 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 5749+0+0 (secure 0 0 0) 0x7ff64812cc90 con 0x7ff6500ceba0 2024-09-10T23:31:09.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.187+0000 7ff64ea00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff62c0725e0 0x7ff62c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:09.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.187+0000 7ff64ea00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff62c0725e0 0x7ff62c074aa0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff640009be0 tx=0x7ff6400091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:09.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.191+0000 7ff647400640 1 -- 172.21.15.17:0/1227207146 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff648016990 con 0x7ff6500ceba0 2024-09-10T23:31:09.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:09.363+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff6500b0fb0 con 0x7ff6500ceba0 2024-09-10T23:31:10.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.003+0000 7ff647400640 1 -- 172.21.15.17:0/1227207146 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v204) ==== 169+0+0 (secure 0 0 0) 0x7ff6480f7c50 con 0x7ff6500ceba0 2024-09-10T23:31:10.006 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff62c0725e0 msgr2=0x7ff62c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff62c0725e0 0x7ff62c074aa0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff640009be0 tx=0x7ff6400091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6500ceba0 msgr2=0x7ff650144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6500ceba0 0x7ff650144a60 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7ff648009bd0 tx=0x7ff648003f80 comp rx=0 tx=0).stop 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 shutdown_connections 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff62c0725e0 0x7ff62c074aa0 secure :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff640009be0 tx=0x7ff6400091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6500ceba0 0x7ff650144a60 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6500ce7c0 0x7ff6500c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 --2- 172.21.15.17:0/1227207146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff6500cc860 0x7ff6500b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.007+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 >> 172.21.15.17:0/1227207146 conn(0x7ff6500d1b50 msgr2=0x7ff65006dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:10.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.011+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 shutdown_connections 2024-09-10T23:31:10.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.011+0000 7ff64fe00640 1 -- 172.21.15.17:0/1227207146 wait complete. 2024-09-10T23:31:10.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:31:10.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.187+0000 7f28c6600640 1 -- 172.21.15.17:0/2773163802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c006fd10 msgr2=0x7f28c015b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.187+0000 7f28c6600640 1 --2- 172.21.15.17:0/2773163802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c006fd10 0x7f28c015b7b0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f28c0070b10 tx=0x7f28a801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.187+0000 7f28c6600640 1 -- 172.21.15.17:0/2773163802 shutdown_connections 2024-09-10T23:31:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.187+0000 7f28c6600640 1 --2- 172.21.15.17:0/2773163802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c006fd10 0x7f28c015b7b0 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.187+0000 7f28c6600640 1 --2- 172.21.15.17:0/2773163802 >> v2:172.21.15.77:3300/0 conn(0x7f28c006f930 0x7f28c0072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.187+0000 7f28c6600640 1 -- 172.21.15.17:0/2773163802 >> 172.21.15.17:0/2773163802 conn(0x7f28c00b1850 msgr2=0x7f28c00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 -- 172.21.15.17:0/2773163802 shutdown_connections 2024-09-10T23:31:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 -- 172.21.15.17:0/2773163802 wait complete. 2024-09-10T23:31:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 Processor -- start 2024-09-10T23:31:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 -- start start 2024-09-10T23:31:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28c006f930 0x7f28c0145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28c006fd10 0x7f28c0153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c015bcf0 0x7f28c0153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f28c0167b00 con 0x7f28c015bcf0 2024-09-10T23:31:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f28c0167980 con 0x7f28c006f930 2024-09-10T23:31:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28c6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f28c0167c80 con 0x7f28c006fd10 2024-09-10T23:31:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c015bcf0 0x7f28c0153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c015bcf0 0x7f28c0153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59200/0 (socket says 172.21.15.17:59200) 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bfe00640 1 -- 172.21.15.17:0/2238857931 learned_addr learned my addr 172.21.15.17:0/2238857931 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bf400640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28c006f930 0x7f28c0145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28b7e00640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28c006fd10 0x7f28c0153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bfe00640 1 -- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28c006fd10 msgr2=0x7f28c0153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bfe00640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28c006fd10 0x7f28c0153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bfe00640 1 -- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28c006f930 msgr2=0x7f28c0145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bfe00640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28c006f930 0x7f28c0145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bfe00640 1 -- 172.21.15.17:0/2238857931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c01463b0 con 0x7f28c015bcf0 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28b7e00640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28c006fd10 0x7f28c0153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28bfe00640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c015bcf0 0x7f28c0153c50 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f28b800b9a0 tx=0x7f28b800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28b7400640 1 -- 172.21.15.17:0/2238857931 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8019070 con 0x7f28c015bcf0 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.191+0000 7f28b7400640 1 -- 172.21.15.17:0/2238857931 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28b800cc90 con 0x7f28c015bcf0 2024-09-10T23:31:10.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.195+0000 7f28b7400640 1 -- 172.21.15.17:0/2238857931 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b80146a0 con 0x7f28c015bcf0 2024-09-10T23:31:10.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.195+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c01f8dd0 con 0x7f28c015bcf0 2024-09-10T23:31:10.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.195+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c0154560 con 0x7f28c015bcf0 2024-09-10T23:31:10.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.195+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c0075ad0 con 0x7f28c015bcf0 2024-09-10T23:31:10.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.195+0000 7f28b7400640 1 -- 172.21.15.17:0/2238857931 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f28b801e440 con 0x7f28c015bcf0 2024-09-10T23:31:10.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.195+0000 7f28b7400640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f289c0725e0 0x7f289c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:10.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.195+0000 7f28b7400640 1 -- 172.21.15.17:0/2238857931 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5335+0+0 (secure 0 0 0) 0x7f28b8092ff0 con 0x7f28c015bcf0 2024-09-10T23:31:10.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.195+0000 7f28bf400640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f289c0725e0 0x7f289c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.199+0000 7f28bf400640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f289c0725e0 0x7f289c074aa0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f28b000abe0 tx=0x7f28b000a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.199+0000 7f28b7400640 1 -- 172.21.15.17:0/2238857931 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f28c01463b0 con 0x7f28c015bcf0 2024-09-10T23:31:10.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.375+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f28c0072800 con 0x7f28c015bcf0 2024-09-10T23:31:10.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.379+0000 7f28b7400640 1 -- 172.21.15.17:0/2238857931 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v61) ==== 71+0+0 (secure 0 0 0) 0x7f28b805e1c0 con 0x7f28c015bcf0 2024-09-10T23:31:10.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f289c0725e0 msgr2=0x7f289c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f289c0725e0 0x7f289c074aa0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f28b000abe0 tx=0x7f28b000a2d0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c015bcf0 msgr2=0x7f28c0153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c015bcf0 0x7f28c0153c50 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f28b800b9a0 tx=0x7f28b800be60 comp rx=0 tx=0).stop 2024-09-10T23:31:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 shutdown_connections 2024-09-10T23:31:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f289c0725e0 0x7f289c074aa0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c015bcf0 0x7f28c0153c50 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28c006fd10 0x7f28c0153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 --2- 172.21.15.17:0/2238857931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28c006f930 0x7f28c0145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 >> 172.21.15.17:0/2238857931 conn(0x7f28c00b1850 msgr2=0x7f28c015cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 shutdown_connections 2024-09-10T23:31:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.383+0000 7f28c6600640 1 -- 172.21.15.17:0/2238857931 wait complete. 2024-09-10T23:31:10.404 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-10T23:31:10.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.547+0000 7fdfdfc00640 1 -- 172.21.15.17:0/794910121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80b19f0 msgr2=0x7fdfd8163a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.547+0000 7fdfdfc00640 1 --2- 172.21.15.17:0/794910121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80b19f0 0x7fdfd8163a90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009840 tx=0x7fdfc401c820 comp rx=0 tx=0).stop 2024-09-10T23:31:10.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 -- 172.21.15.17:0/794910121 shutdown_connections 2024-09-10T23:31:10.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 --2- 172.21.15.17:0/794910121 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfd80b0d90 0x7fdfd8165fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 --2- 172.21.15.17:0/794910121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80b19f0 0x7fdfd8163a90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 -- 172.21.15.17:0/794910121 >> 172.21.15.17:0/794910121 conn(0x7fdfd80b3870 msgr2=0x7fdfd80b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:10.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 -- 172.21.15.17:0/794910121 shutdown_connections 2024-09-10T23:31:10.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 -- 172.21.15.17:0/794910121 wait complete. 2024-09-10T23:31:10.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 Processor -- start 2024-09-10T23:31:10.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 -- start start 2024-09-10T23:31:10.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfd80b0d90 0x7fdfd806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:10.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80b19f0 0x7fdfd8152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd815f550 0x7fdfd8165410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd8169370 con 0x7fdfd80b19f0 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd81691f0 con 0x7fdfd815f550 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdfc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd81694f0 con 0x7fdfd80b0d90 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfd7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80b19f0 0x7fdfd8152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfd7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80b19f0 0x7fdfd8152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59214/0 (socket says 172.21.15.17:59214) 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfd7e00640 1 -- 172.21.15.17:0/3303355187 learned_addr learned my addr 172.21.15.17:0/3303355187 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfddc00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd815f550 0x7fdfd8165410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfdd200640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfd80b0d90 0x7fdfd806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfd7e00640 1 -- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfd80b0d90 msgr2=0x7fdfd806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfd7e00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfd80b0d90 0x7fdfd806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfd7e00640 1 -- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd815f550 msgr2=0x7fdfd8165410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:10.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfd7e00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd815f550 0x7fdfd8165410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:10.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.551+0000 7fdfd7e00640 1 -- 172.21.15.17:0/3303355187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd8153730 con 0x7fdfd80b19f0 2024-09-10T23:31:10.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfd7e00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80b19f0 0x7fdfd8152db0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fdfc401aed0 tx=0x7fdfc40a5700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:10.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfd4c00640 1 -- 172.21.15.17:0/3303355187 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40b2040 con 0x7fdfd80b19f0 2024-09-10T23:31:10.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfd4c00640 1 -- 172.21.15.17:0/3303355187 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfc4004430 con 0x7fdfd80b19f0 2024-09-10T23:31:10.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfd4c00640 1 -- 172.21.15.17:0/3303355187 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4005280 con 0x7fdfd80b19f0 2024-09-10T23:31:10.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd81f8510 con 0x7fdfd80b19f0 2024-09-10T23:31:10.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd81f8ad0 con 0x7fdfd80b19f0 2024-09-10T23:31:10.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd80b12e0 con 0x7fdfd80b19f0 2024-09-10T23:31:10.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfd4c00640 1 -- 172.21.15.17:0/3303355187 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdfc40b5070 con 0x7fdfd80b19f0 2024-09-10T23:31:10.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfd4c00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdfb80725e0 0x7fdfb8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:10.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.555+0000 7fdfd4c00640 1 -- 172.21.15.17:0/3303355187 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5335+0+0 (secure 0 0 0) 0x7fdfc412caa0 con 0x7fdfd80b19f0 2024-09-10T23:31:10.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.559+0000 7fdfdd200640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdfb80725e0 0x7fdfb8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:10.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.559+0000 7fdfdd200640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdfb80725e0 0x7fdfb8074aa0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8157610 tx=0x7fdfcc007ea0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:10.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.559+0000 7fdfd4c00640 1 -- 172.21.15.17:0/3303355187 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdfc4016410 con 0x7fdfd80b19f0 2024-09-10T23:31:10.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:10.799+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7fdfd80cc290 con 0x7fdfd80b19f0 2024-09-10T23:31:11.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfd4c00640 1 -- 172.21.15.17:0/3303355187 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v719) ==== 133+0+0 (secure 0 0 0) 0x7fdfc40f7c80 con 0x7fdfd80b19f0 2024-09-10T23:31:11.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdfb80725e0 msgr2=0x7fdfb8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdfb80725e0 0x7fdfb8074aa0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8157610 tx=0x7fdfcc007ea0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80b19f0 msgr2=0x7fdfd8152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80b19f0 0x7fdfd8152db0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fdfc401aed0 tx=0x7fdfc40a5700 comp rx=0 tx=0).stop 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 shutdown_connections 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdfb80725e0 0x7fdfb8074aa0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd815f550 0x7fdfd8165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdfd80b19f0 0x7fdfd8152db0 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 --2- 172.21.15.17:0/3303355187 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfd80b0d90 0x7fdfd806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 >> 172.21.15.17:0/3303355187 conn(0x7fdfd80b3870 msgr2=0x7fdfd815e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 shutdown_connections 2024-09-10T23:31:11.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.007+0000 7fdfdfc00640 1 -- 172.21.15.17:0/3303355187 wait complete. 2024-09-10T23:31:11.031 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-10T23:31:11.031 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T23:31:11.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:11.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.175+0000 7f28b8000640 1 -- 172.21.15.17:0/594438845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b006e1c0 msgr2=0x7f28b0161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.175+0000 7f28b8000640 1 --2- 172.21.15.17:0/594438845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b006e1c0 0x7f28b0161ec0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f289c009900 tx=0x7f289c01f0d0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.175+0000 7f28b8000640 1 -- 172.21.15.17:0/594438845 shutdown_connections 2024-09-10T23:31:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.175+0000 7f28b8000640 1 --2- 172.21.15.17:0/594438845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b006e1c0 0x7f28b0161ec0 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.175+0000 7f28b8000640 1 -- 172.21.15.17:0/594438845 >> 172.21.15.17:0/594438845 conn(0x7f28b00d1d40 msgr2=0x7f28b00d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.175+0000 7f28b8000640 1 -- 172.21.15.17:0/594438845 shutdown_connections 2024-09-10T23:31:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.175+0000 7f28b8000640 1 -- 172.21.15.17:0/594438845 wait complete. 2024-09-10T23:31:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.175+0000 7f28b8000640 1 Processor -- start 2024-09-10T23:31:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.175+0000 7f28b8000640 1 -- start start 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b8000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b006d6d0 0x7f28b015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b8000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b006e1c0 0x7f28b01f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b8000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b0162400 0x7f28b0071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b8000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0162870 con 0x7f28b0162400 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b8000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f28b01629f0 con 0x7f28b006e1c0 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b8000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f28b0162b70 con 0x7f28b006d6d0 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b0162400 0x7f28b0071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b0162400 0x7f28b0071db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59230/0 (socket says 172.21.15.17:59230) 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b6000640 1 -- 172.21.15.17:0/1052820558 learned_addr learned my addr 172.21.15.17:0/1052820558 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b4c00640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b006e1c0 0x7f28b01f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b5600640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b006d6d0 0x7f28b015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b6000640 1 -- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b006d6d0 msgr2=0x7f28b015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b6000640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b006d6d0 0x7f28b015a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b6000640 1 -- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b006e1c0 msgr2=0x7f28b01f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b6000640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b006e1c0 0x7f28b01f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b6000640 1 -- 172.21.15.17:0/1052820558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b015ea70 con 0x7f28b0162400 2024-09-10T23:31:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b6000640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b0162400 0x7f28b0071db0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f28a800c740 tx=0x7f28a800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28ad600640 1 -- 172.21.15.17:0/1052820558 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8003b80 con 0x7f28b0162400 2024-09-10T23:31:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28ad600640 1 -- 172.21.15.17:0/1052820558 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28a800ce50 con 0x7f28b0162400 2024-09-10T23:31:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28ad600640 1 -- 172.21.15.17:0/1052820558 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a800a850 con 0x7f28b0162400 2024-09-10T23:31:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b01f56f0 con 0x7f28b0162400 2024-09-10T23:31:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b015ed30 con 0x7f28b0162400 2024-09-10T23:31:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.179+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b0161ec0 con 0x7f28b0162400 2024-09-10T23:31:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.183+0000 7f28ad600640 1 -- 172.21.15.17:0/1052820558 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f28a800a9f0 con 0x7f28b0162400 2024-09-10T23:31:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.183+0000 7f28ad600640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f28900725e0 0x7f2890074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.183+0000 7f28ad600640 1 -- 172.21.15.17:0/1052820558 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5335+0+0 (secure 0 0 0) 0x7f28a8092df0 con 0x7f28b0162400 2024-09-10T23:31:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.183+0000 7f28b5600640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f28900725e0 0x7f2890074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.183+0000 7f28b5600640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f28900725e0 0x7f2890074aa0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f28a4007fd0 tx=0x7f28a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.187+0000 7f28ad600640 1 -- 172.21.15.17:0/1052820558 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f28a805df50 con 0x7f28b0162400 2024-09-10T23:31:11.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.363+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28b00b1c20 con 0x7f28b0162400 2024-09-10T23:31:11.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.363+0000 7f28ad600640 1 -- 172.21.15.17:0/1052820558 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) ==== 74+0+13255 (secure 0 0 0) 0x7f28a8062980 con 0x7f28b0162400 2024-09-10T23:31:11.366 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:11.366 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":204,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:10.000789+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":199,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/2065743463":"2024-09-11T23:31:06.988567+0000","172.21.15.77:6835/2065743463":"2024-09-11T23:31:06.988567+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:11.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f28900725e0 msgr2=0x7f2890074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f28900725e0 0x7f2890074aa0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f28a4007fd0 tx=0x7f28a4009040 comp rx=0 tx=0).stop 2024-09-10T23:31:11.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b0162400 msgr2=0x7f28b0071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b0162400 0x7f28b0071db0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f28a800c740 tx=0x7f28a800cc00 comp rx=0 tx=0).stop 2024-09-10T23:31:11.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 shutdown_connections 2024-09-10T23:31:11.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f28900725e0 0x7f2890074aa0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28b0162400 0x7f28b0071db0 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28b006e1c0 0x7f28b01f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 --2- 172.21.15.17:0/1052820558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28b006d6d0 0x7f28b015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 >> 172.21.15.17:0/1052820558 conn(0x7f28b00d1d40 msgr2=0x7f28b006dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 shutdown_connections 2024-09-10T23:31:11.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.367+0000 7f28b8000640 1 -- 172.21.15.17:0/1052820558 wait complete. 2024-09-10T23:31:11.389 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:31:11.389 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:31:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.535+0000 7f2053200640 1 -- 172.21.15.17:0/766383774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0cfe70 msgr2=0x7f204c0d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.535+0000 7f2053200640 1 --2- 172.21.15.17:0/766383774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0cfe70 0x7f204c0d0250 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f203c009930 tx=0x7f203c01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.535+0000 7f2053200640 1 -- 172.21.15.17:0/766383774 shutdown_connections 2024-09-10T23:31:11.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.535+0000 7f2053200640 1 --2- 172.21.15.17:0/766383774 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f204c0ce0f0 0x7f204c0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.535+0000 7f2053200640 1 --2- 172.21.15.17:0/766383774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0cfe70 0x7f204c0d0250 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.535+0000 7f2053200640 1 -- 172.21.15.17:0/766383774 >> 172.21.15.17:0/766383774 conn(0x7f204c0d1e30 msgr2=0x7f204c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.535+0000 7f2053200640 1 -- 172.21.15.17:0/766383774 shutdown_connections 2024-09-10T23:31:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.535+0000 7f2053200640 1 -- 172.21.15.17:0/766383774 wait complete. 2024-09-10T23:31:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2053200640 1 Processor -- start 2024-09-10T23:31:11.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2053200640 1 -- start start 2024-09-10T23:31:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2053200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f204c0ce0f0 0x7f204c0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2053200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f204c0cfe70 0x7f204c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2053200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0d2950 0x7f204c0b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2053200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f204c0afb90 con 0x7f204c0d2950 2024-09-10T23:31:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2053200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f204c0afa10 con 0x7f204c0ce0f0 2024-09-10T23:31:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2053200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f204c0afd10 con 0x7f204c0cfe70 2024-09-10T23:31:11.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2051200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0d2950 0x7f204c0b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2051200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0d2950 0x7f204c0b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59240/0 (socket says 172.21.15.17:59240) 2024-09-10T23:31:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2043400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f204c0cfe70 0x7f204c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2051200640 1 -- 172.21.15.17:0/4079877525 learned_addr learned my addr 172.21.15.17:0/4079877525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f204be00640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f204c0ce0f0 0x7f204c0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2051200640 1 -- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f204c0cfe70 msgr2=0x7f204c154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2051200640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f204c0cfe70 0x7f204c154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2051200640 1 -- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f204c0ce0f0 msgr2=0x7f204c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2051200640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f204c0ce0f0 0x7f204c0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2051200640 1 -- 172.21.15.17:0/4079877525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204c156200 con 0x7f204c0d2950 2024-09-10T23:31:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2051200640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0d2950 0x7f204c0b62c0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f204400ea20 tx=0x7f204400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2048c00640 1 -- 172.21.15.17:0/4079877525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204400cde0 con 0x7f204c0d2950 2024-09-10T23:31:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2048c00640 1 -- 172.21.15.17:0/4079877525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2044004c40 con 0x7f204c0d2950 2024-09-10T23:31:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204c1564e0 con 0x7f204c0d2950 2024-09-10T23:31:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.539+0000 7f2048c00640 1 -- 172.21.15.17:0/4079877525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044005280 con 0x7f204c0d2950 2024-09-10T23:31:11.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.543+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204c157240 con 0x7f204c0d2950 2024-09-10T23:31:11.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.543+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204c0d0250 con 0x7f204c0d2950 2024-09-10T23:31:11.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.543+0000 7f2048c00640 1 -- 172.21.15.17:0/4079877525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f204400f040 con 0x7f204c0d2950 2024-09-10T23:31:11.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.543+0000 7f2048c00640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20280725e0 0x7f2028074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.543+0000 7f2048c00640 1 -- 172.21.15.17:0/4079877525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5335+0+0 (secure 0 0 0) 0x7f2044093740 con 0x7f204c0d2950 2024-09-10T23:31:11.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.543+0000 7f204be00640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20280725e0 0x7f2028074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.547+0000 7f204be00640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20280725e0 0x7f2028074aa0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f203c0af000 tx=0x7f203c01b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.547+0000 7f2048c00640 1 -- 172.21.15.17:0/4079877525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2044016030 con 0x7f204c0d2950 2024-09-10T23:31:11.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.723+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f204c0b2130 con 0x7f204c0d2950 2024-09-10T23:31:11.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2048c00640 1 -- 172.21.15.17:0/4079877525 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v204) ==== 93+0+10 (secure 0 0 0) 0x7f204405e930 con 0x7f204c0d2950 2024-09-10T23:31:11.727 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:31:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20280725e0 msgr2=0x7f2028074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20280725e0 0x7f2028074aa0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f203c0af000 tx=0x7f203c01b120 comp rx=0 tx=0).stop 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0d2950 msgr2=0x7f204c0b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0d2950 0x7f204c0b62c0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f204400ea20 tx=0x7f204400eee0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 shutdown_connections 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f20280725e0 0x7f2028074aa0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f204c0d2950 0x7f204c0b62c0 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f204c0cfe70 0x7f204c154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 --2- 172.21.15.17:0/4079877525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f204c0ce0f0 0x7f204c0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 >> 172.21.15.17:0/4079877525 conn(0x7f204c0d1e30 msgr2=0x7f204c0b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 shutdown_connections 2024-09-10T23:31:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.727+0000 7f2053200640 1 -- 172.21.15.17:0/4079877525 wait complete. 2024-09-10T23:31:11.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-09-10T23:31:11.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.895+0000 7f4c4ee00640 1 -- 172.21.15.17:0/1474980486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c4815fc90 msgr2=0x7f4c481600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.895+0000 7f4c4ee00640 1 --2- 172.21.15.17:0/1474980486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c4815fc90 0x7f4c481600f0 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f4c40009c80 tx=0x7f4c4001cd70 comp rx=0 tx=0).stop 2024-09-10T23:31:11.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.895+0000 7f4c4ee00640 1 -- 172.21.15.17:0/1474980486 shutdown_connections 2024-09-10T23:31:11.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.895+0000 7f4c4ee00640 1 --2- 172.21.15.17:0/1474980486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c4815fc90 0x7f4c481600f0 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.895+0000 7f4c4ee00640 1 --2- 172.21.15.17:0/1474980486 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c480b2fc0 0x7f4c480d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.895+0000 7f4c4ee00640 1 -- 172.21.15.17:0/1474980486 >> 172.21.15.17:0/1474980486 conn(0x7f4c480d1d40 msgr2=0x7f4c480d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:11.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.895+0000 7f4c4ee00640 1 -- 172.21.15.17:0/1474980486 shutdown_connections 2024-09-10T23:31:11.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.895+0000 7f4c4ee00640 1 -- 172.21.15.17:0/1474980486 wait complete. 2024-09-10T23:31:11.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 Processor -- start 2024-09-10T23:31:11.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 -- start start 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c480b2fc0 0x7f4c481589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c480cfb70 0x7f4c480b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4815fc90 0x7f4c48157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c480b0a90 con 0x7f4c480b2fc0 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4c480b0910 con 0x7f4c4815fc90 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4c48168f60 con 0x7f4c480cfb70 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c47e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c480b2fc0 0x7f4c481589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c47e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c480b2fc0 0x7f4c481589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59268/0 (socket says 172.21.15.17:59268) 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c47e00640 1 -- 172.21.15.17:0/190268632 learned_addr learned my addr 172.21.15.17:0/190268632 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c3fe00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c480cfb70 0x7f4c480b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ce00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4815fc90 0x7f4c48157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c47e00640 1 -- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c480cfb70 msgr2=0x7f4c480b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c47e00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c480cfb70 0x7f4c480b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c47e00640 1 -- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4815fc90 msgr2=0x7f4c48157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c47e00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4815fc90 0x7f4c48157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c47e00640 1 -- 172.21.15.17:0/190268632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c48158010 con 0x7f4c480b2fc0 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c47e00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c480b2fc0 0x7f4c481589e0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800c530 tx=0x7f4c3800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c44c00640 1 -- 172.21.15.17:0/190268632 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38017070 con 0x7f4c480b2fc0 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c44c00640 1 -- 172.21.15.17:0/190268632 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c38003600 con 0x7f4c480b2fc0 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c44c00640 1 -- 172.21.15.17:0/190268632 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38003a50 con 0x7f4c480b2fc0 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c481582d0 con 0x7f4c480b2fc0 2024-09-10T23:31:11.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4814ade0 con 0x7f4c480b2fc0 2024-09-10T23:31:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.899+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c481600f0 con 0x7f4c480b2fc0 2024-09-10T23:31:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.903+0000 7f4c44c00640 1 -- 172.21.15.17:0/190268632 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4c38003bf0 con 0x7f4c480b2fc0 2024-09-10T23:31:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.903+0000 7f4c44c00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c24072610 0x7f4c24074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:11.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.903+0000 7f4c44c00640 1 -- 172.21.15.17:0/190268632 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5335+0+0 (secure 0 0 0) 0x7f4c380927d0 con 0x7f4c480b2fc0 2024-09-10T23:31:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.903+0000 7f4c3fe00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c24072610 0x7f4c24074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:11.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.903+0000 7f4c3fe00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c24072610 0x7f4c24074ad0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4c480cbf30 tx=0x7f4c300091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:11.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:11.907+0000 7f4c44c00640 1 -- 172.21.15.17:0/190268632 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4c3805e0d0 con 0x7f4c480b2fc0 2024-09-10T23:31:12.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:12.143+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) -- 0x7f4c48158780 con 0x7f4c480b2fc0 2024-09-10T23:31:13.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.015+0000 7f4c44c00640 1 -- 172.21.15.17:0/190268632 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v721) ==== 150+0+0 (secure 0 0 0) 0x7f4c3805d9d0 con 0x7f4c480b2fc0 2024-09-10T23:31:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c24072610 msgr2=0x7f4c24074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c24072610 0x7f4c24074ad0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4c480cbf30 tx=0x7f4c300091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c480b2fc0 msgr2=0x7f4c481589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c480b2fc0 0x7f4c481589e0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800c530 tx=0x7f4c3800c9f0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 shutdown_connections 2024-09-10T23:31:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c24072610 0x7f4c24074ad0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4815fc90 0x7f4c48157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c480cfb70 0x7f4c480b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 --2- 172.21.15.17:0/190268632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c480b2fc0 0x7f4c481589e0 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 >> 172.21.15.17:0/190268632 conn(0x7f4c480d1d40 msgr2=0x7f4c480ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 shutdown_connections 2024-09-10T23:31:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.019+0000 7f4c4ee00640 1 -- 172.21.15.17:0/190268632 wait complete. 2024-09-10T23:31:13.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:31:13.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.195+0000 7f8eaee00640 1 -- 172.21.15.17:0/2095017687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ea80b07b0 msgr2=0x7f8ea80d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.195+0000 7f8eaee00640 1 --2- 172.21.15.17:0/2095017687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ea80b07b0 0x7f8ea80d0660 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009bf0 tx=0x7f8ea001cbe0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.195+0000 7f8eaee00640 1 -- 172.21.15.17:0/2095017687 shutdown_connections 2024-09-10T23:31:13.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.195+0000 7f8eaee00640 1 --2- 172.21.15.17:0/2095017687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ea80b07b0 0x7f8ea80d0660 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.195+0000 7f8eaee00640 1 -- 172.21.15.17:0/2095017687 >> 172.21.15.17:0/2095017687 conn(0x7f8ea80d1d40 msgr2=0x7f8ea80d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.195+0000 7f8eaee00640 1 -- 172.21.15.17:0/2095017687 shutdown_connections 2024-09-10T23:31:13.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.195+0000 7f8eaee00640 1 -- 172.21.15.17:0/2095017687 wait complete. 2024-09-10T23:31:13.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 Processor -- start 2024-09-10T23:31:13.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 -- start start 2024-09-10T23:31:13.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ea80b07b0 0x7f8ea814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ea80b2fc0 0x7f8ea81500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ea80cfb70 0x7f8ea815e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea816a260 con 0x7f8ea80cfb70 2024-09-10T23:31:13.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea816a0e0 con 0x7f8ea80b07b0 2024-09-10T23:31:13.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea816a3e0 con 0x7f8ea80b2fc0 2024-09-10T23:31:13.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eace00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ea80cfb70 0x7f8ea815e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eace00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ea80cfb70 0x7f8ea815e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59276/0 (socket says 172.21.15.17:59276) 2024-09-10T23:31:13.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eace00640 1 -- 172.21.15.17:0/2411865330 learned_addr learned my addr 172.21.15.17:0/2411865330 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:13.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8ea7e00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ea80b07b0 0x7f8ea814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8e9fe00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ea80b2fc0 0x7f8ea81500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eace00640 1 -- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ea80b2fc0 msgr2=0x7f8ea81500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eace00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ea80b2fc0 0x7f8ea81500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eace00640 1 -- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ea80b07b0 msgr2=0x7f8ea814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eace00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ea80b07b0 0x7f8ea814fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eace00640 1 -- 172.21.15.17:0/2411865330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea80cc810 con 0x7f8ea80cfb70 2024-09-10T23:31:13.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eace00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ea80cfb70 0x7f8ea815e260 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f8ea001a810 tx=0x7f8ea0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8ea4c00640 1 -- 172.21.15.17:0/2411865330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00bc070 con 0x7f8ea80cfb70 2024-09-10T23:31:13.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8ea4c00640 1 -- 172.21.15.17:0/2411865330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ea0004460 con 0x7f8ea80cfb70 2024-09-10T23:31:13.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea815f110 con 0x7f8ea80cfb70 2024-09-10T23:31:13.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8ea4c00640 1 -- 172.21.15.17:0/2411865330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00b2040 con 0x7f8ea80cfb70 2024-09-10T23:31:13.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.199+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea80ccab0 con 0x7f8ea80cfb70 2024-09-10T23:31:13.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.203+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea815fc90 con 0x7f8ea80cfb70 2024-09-10T23:31:13.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.203+0000 7f8ea4c00640 1 -- 172.21.15.17:0/2411865330 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8ea00b5070 con 0x7f8ea80cfb70 2024-09-10T23:31:13.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.203+0000 7f8ea4c00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e840725e0 0x7f8e84074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.203+0000 7f8ea4c00640 1 -- 172.21.15.17:0/2411865330 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5335+0+0 (secure 0 0 0) 0x7f8ea012cd20 con 0x7f8ea80cfb70 2024-09-10T23:31:13.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.203+0000 7f8ea7e00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e840725e0 0x7f8e84074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.207+0000 7f8ea7e00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e840725e0 0x7f8e84074aa0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8e98007fd0 tx=0x7f8e98009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.207+0000 7f8ea4c00640 1 -- 172.21.15.17:0/2411865330 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8ea00167d0 con 0x7f8ea80cfb70 2024-09-10T23:31:13.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8ea8150f20 con 0x7f8ea80cfb70 2024-09-10T23:31:13.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8ea4c00640 1 -- 172.21.15.17:0/2411865330 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v61) ==== 59+0+1998 (secure 0 0 0) 0x7f8ea00f7f20 con 0x7f8ea80cfb70 2024-09-10T23:31:13.389 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:31:13.389 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:31:13.390 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:31:13.391 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:31:13.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e840725e0 msgr2=0x7f8e84074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e840725e0 0x7f8e84074aa0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8e98007fd0 tx=0x7f8e98009040 comp rx=0 tx=0).stop 2024-09-10T23:31:13.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ea80cfb70 msgr2=0x7f8ea815e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ea80cfb70 0x7f8ea815e260 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f8ea001a810 tx=0x7f8ea0004270 comp rx=0 tx=0).stop 2024-09-10T23:31:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 shutdown_connections 2024-09-10T23:31:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8e840725e0 0x7f8e84074aa0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ea80cfb70 0x7f8ea815e260 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ea80b2fc0 0x7f8ea81500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 --2- 172.21.15.17:0/2411865330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ea80b07b0 0x7f8ea814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.387+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 >> 172.21.15.17:0/2411865330 conn(0x7f8ea80d1d40 msgr2=0x7f8ea815b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.391+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 shutdown_connections 2024-09-10T23:31:13.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.391+0000 7f8eaee00640 1 -- 172.21.15.17:0/2411865330 wait complete. 2024-09-10T23:31:13.410 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:31:13.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 -- 172.21.15.17:0/2286700627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 msgr2=0x7f8ab00b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 --2- 172.21.15.17:0/2286700627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 0x7f8ab00b19b0 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009c80 tx=0x7f8aa801cda0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 -- 172.21.15.17:0/2286700627 shutdown_connections 2024-09-10T23:31:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 --2- 172.21.15.17:0/2286700627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 0x7f8ab00b19b0 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 --2- 172.21.15.17:0/2286700627 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ab00b1050 0x7f8ab00cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 -- 172.21.15.17:0/2286700627 >> 172.21.15.17:0/2286700627 conn(0x7f8ab00d1dc0 msgr2=0x7f8ab00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 -- 172.21.15.17:0/2286700627 shutdown_connections 2024-09-10T23:31:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 -- 172.21.15.17:0/2286700627 wait complete. 2024-09-10T23:31:13.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 Processor -- start 2024-09-10T23:31:13.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 -- start start 2024-09-10T23:31:13.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b1050 0x7f8ab00c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 0x7f8ab0154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ab015c0c0 0x7f8ab01fb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0168f10 con 0x7f8ab00b1530 2024-09-10T23:31:13.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0168d90 con 0x7f8ab00b1050 2024-09-10T23:31:13.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8ab5400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab0169090 con 0x7f8ab015c0c0 2024-09-10T23:31:13.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8aa7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 0x7f8ab0154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8aa7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 0x7f8ab0154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59302/0 (socket says 172.21.15.17:59302) 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.559+0000 7f8aa7e00640 1 -- 172.21.15.17:0/1013325118 learned_addr learned my addr 172.21.15.17:0/1013325118 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aae800640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b1050 0x7f8ab00c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aaf200640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ab015c0c0 0x7f8ab01fb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa7e00640 1 -- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ab015c0c0 msgr2=0x7f8ab01fb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa7e00640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ab015c0c0 0x7f8ab01fb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa7e00640 1 -- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b1050 msgr2=0x7f8ab00c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa7e00640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b1050 0x7f8ab00c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa7e00640 1 -- 172.21.15.17:0/1013325118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00c9a00 con 0x7f8ab00b1530 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aae800640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b1050 0x7f8ab00c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa7e00640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 0x7f8ab0154050 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800ea20 tx=0x7f8a9800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa6a00640 1 -- 172.21.15.17:0/1013325118 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9800cd80 con 0x7f8ab00b1530 2024-09-10T23:31:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa6a00640 1 -- 172.21.15.17:0/1013325118 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a98004020 con 0x7f8ab00b1530 2024-09-10T23:31:13.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa6a00640 1 -- 172.21.15.17:0/1013325118 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98004430 con 0x7f8ab00b1530 2024-09-10T23:31:13.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab01fbcf0 con 0x7f8ab00b1530 2024-09-10T23:31:13.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab006d6c0 con 0x7f8ab00b1530 2024-09-10T23:31:13.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab00b19b0 con 0x7f8ab00b1530 2024-09-10T23:31:13.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.563+0000 7f8aa6a00640 1 -- 172.21.15.17:0/1013325118 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8a98003600 con 0x7f8ab00b1530 2024-09-10T23:31:13.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.567+0000 7f8aa6a00640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a8c0725e0 0x7f8a8c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:13.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.567+0000 7f8aa6a00640 1 -- 172.21.15.17:0/1013325118 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5335+0+0 (secure 0 0 0) 0x7f8a98093b90 con 0x7f8ab00b1530 2024-09-10T23:31:13.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.567+0000 7f8aae800640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a8c0725e0 0x7f8a8c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:13.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.567+0000 7f8aae800640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a8c0725e0 0x7f8a8c074aa0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00016b0 tx=0x7f8aa0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:13.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.567+0000 7f8aa6a00640 1 -- 172.21.15.17:0/1013325118 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8ab00c9a00 con 0x7f8ab00b1530 2024-09-10T23:31:13.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.743+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8ab0159210 con 0x7f8ab00b1530 2024-09-10T23:31:13.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.747+0000 7f8aa6a00640 1 -- 172.21.15.17:0/1013325118 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v62)=0 v62) ==== 122+0+0 (secure 0 0 0) 0x7f8a9805f3d0 con 0x7f8ab00b1530 2024-09-10T23:31:13.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a8c0725e0 msgr2=0x7f8a8c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a8c0725e0 0x7f8a8c074aa0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00016b0 tx=0x7f8aa0009040 comp rx=0 tx=0).stop 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 msgr2=0x7f8ab0154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 0x7f8ab0154050 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800ea20 tx=0x7f8a9800eee0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 shutdown_connections 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a8c0725e0 0x7f8a8c074aa0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8ab015c0c0 0x7f8ab01fb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ab00b1530 0x7f8ab0154050 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 --2- 172.21.15.17:0/1013325118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ab00b1050 0x7f8ab00c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 >> 172.21.15.17:0/1013325118 conn(0x7f8ab00d1dc0 msgr2=0x7f8ab00d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 shutdown_connections 2024-09-10T23:31:13.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:13.751+0000 7f8ab5400640 1 -- 172.21.15.17:0/1013325118 wait complete. 2024-09-10T23:31:13.772 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:31:13.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:31:13.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:31:13.935 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:31:13.936 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:13.936 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:13.945 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:31:13.945 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:31:13.946 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:13.955 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:31:13.955 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:13.955 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:13.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:31:13.995 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:31:13.995 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:14.004 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:31:14.004 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:31:14.004 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.183+0000 7f7733400640 1 -- 172.21.15.17:0/2257628255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0cfb70 msgr2=0x7f772c0cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.183+0000 7f7733400640 1 --2- 172.21.15.17:0/2257628255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0cfb70 0x7f772c0cff50 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f7720009900 tx=0x7f772001c8b0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.183+0000 7f7733400640 1 -- 172.21.15.17:0/2257628255 shutdown_connections 2024-09-10T23:31:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.183+0000 7f7733400640 1 --2- 172.21.15.17:0/2257628255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f772c0b2fc0 0x7f772c0d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.183+0000 7f7733400640 1 --2- 172.21.15.17:0/2257628255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0cfb70 0x7f772c0cff50 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.183+0000 7f7733400640 1 -- 172.21.15.17:0/2257628255 >> 172.21.15.17:0/2257628255 conn(0x7f772c0d1d40 msgr2=0x7f772c0d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.183+0000 7f7733400640 1 -- 172.21.15.17:0/2257628255 shutdown_connections 2024-09-10T23:31:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.183+0000 7f7733400640 1 -- 172.21.15.17:0/2257628255 wait complete. 2024-09-10T23:31:14.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 Processor -- start 2024-09-10T23:31:14.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 -- start start 2024-09-10T23:31:14.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f772c0b15a0 0x7f772c14c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0b2fc0 0x7f772c14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f772c0cfb70 0x7f772c154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f772c168f60 con 0x7f772c0b2fc0 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f772c0b09f0 con 0x7f772c0cfb70 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f772c1690e0 con 0x7f772c0b15a0 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f772be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0b2fc0 0x7f772c14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f772be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0b2fc0 0x7f772c14e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59310/0 (socket says 172.21.15.17:59310) 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f772be00640 1 -- 172.21.15.17:0/1512316170 learned_addr learned my addr 172.21.15.17:0/1512316170 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7730a00640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f772c0b15a0 0x7f772c14c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7731400640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f772c0cfb70 0x7f772c154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f772be00640 1 -- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f772c0b15a0 msgr2=0x7f772c14c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f772be00640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f772c0b15a0 0x7f772c14c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f772be00640 1 -- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f772c0cfb70 msgr2=0x7f772c154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f772be00640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f772c0cfb70 0x7f772c154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f772be00640 1 -- 172.21.15.17:0/1512316170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772c14ec90 con 0x7f772c0b2fc0 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7731400640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f772c0cfb70 0x7f772c154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f772be00640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0b2fc0 0x7f772c14e2b0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f771800c970 tx=0x7f771800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7728c00640 1 -- 172.21.15.17:0/1512316170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718007c70 con 0x7f772c0b2fc0 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7728c00640 1 -- 172.21.15.17:0/1512316170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f771800f450 con 0x7f772c0b2fc0 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772c1f8fa0 con 0x7f772c0b2fc0 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7728c00640 1 -- 172.21.15.17:0/1512316170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771800f8a0 con 0x7f772c0b2fc0 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772c14c690 con 0x7f772c0b2fc0 2024-09-10T23:31:14.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.187+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772c0b1a00 con 0x7f772c0b2fc0 2024-09-10T23:31:14.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.191+0000 7f7728c00640 1 -- 172.21.15.17:0/1512316170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7718020030 con 0x7f772c0b2fc0 2024-09-10T23:31:14.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.191+0000 7f7728c00640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f770c0725e0 0x7f770c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:14.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.191+0000 7f7728c00640 1 -- 172.21.15.17:0/1512316170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5335+0+0 (secure 0 0 0) 0x7f7718093570 con 0x7f772c0b2fc0 2024-09-10T23:31:14.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.191+0000 7f7730a00640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f770c0725e0 0x7f770c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:14.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.191+0000 7f7730a00640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f770c0725e0 0x7f770c074aa0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f77200af000 tx=0x7f772001b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:14.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.195+0000 7f7728c00640 1 -- 172.21.15.17:0/1512316170 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7718014030 con 0x7f772c0b2fc0 2024-09-10T23:31:14.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f772c0cd350 con 0x7f772c0b2fc0 2024-09-10T23:31:14.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7728c00640 1 -- 172.21.15.17:0/1512316170 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) ==== 95+0+3912 (secure 0 0 0) 0x7f771805edb0 con 0x7f772c0b2fc0 2024-09-10T23:31:14.404 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:14.404 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":154,"btime":"2024-09-10T23:31:07:991162+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/762449917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":762449917},{"type":"v1","addr":"172.21.15.77:6836","nonce":762449917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":9041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1067588984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1067588984},{"type":"v1","addr":"172.21.15.77:6837","nonce":1067588984}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":11046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/661473457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":661473457},{"type":"v1","addr":"172.21.15.17:6834","nonce":661473457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147},{"gid":11049,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/3378779893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":3378779893},{"type":"v1","addr":"172.21.15.17:6835","nonce":3378779893}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[]} 2024-09-10T23:31:14.404 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 154 2024-09-10T23:31:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f770c0725e0 msgr2=0x7f770c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f770c0725e0 0x7f770c074aa0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f77200af000 tx=0x7f772001b0f0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0b2fc0 msgr2=0x7f772c14e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0b2fc0 0x7f772c14e2b0 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f771800c970 tx=0x7f771800ce30 comp rx=0 tx=0).stop 2024-09-10T23:31:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 shutdown_connections 2024-09-10T23:31:14.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f770c0725e0 0x7f770c074aa0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f772c0cfb70 0x7f772c154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f772c0b2fc0 0x7f772c14e2b0 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 --2- 172.21.15.17:0/1512316170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f772c0b15a0 0x7f772c14c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 >> 172.21.15.17:0/1512316170 conn(0x7f772c0d1d40 msgr2=0x7f772c1565d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:14.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 shutdown_connections 2024-09-10T23:31:14.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.403+0000 7f7733400640 1 -- 172.21.15.17:0/1512316170 wait complete. 2024-09-10T23:31:14.426 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:31:14.426 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:31:14.426 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:31:14.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:31:14.427 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:31:14.427 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:31:14.427 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:31:14.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:31:14.427 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:31:14.428 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:31:14.428 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:31:14.428 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:31:14.428 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:31:14.428 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:31:14.428 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:31:14.428 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:31:14.439 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:31:14.440 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:31:14.441 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:31:14.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:31:14.445 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:31:14.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:31:14.447 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:31:14.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:31:14.489 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:31:14.489 DEBUG:teuthology.parallel:result is None 2024-09-10T23:31:14.491 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:31:14.491 DEBUG:teuthology.parallel:result is None 2024-09-10T23:31:14.495 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:31:14.495 DEBUG:teuthology.parallel:result is None 2024-09-10T23:31:14.496 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:31:14.497 DEBUG:teuthology.parallel:result is None 2024-09-10T23:31:14.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:31:14.576 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:31:14.577 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:31:14.586 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:31:14.587 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:31:14.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 -- 172.21.15.17:0/4215293888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae0004d50 msgr2=0x7f2ae00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:14.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 --2- 172.21.15.17:0/4215293888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ae0004d50 0x7f2ae00051d0 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c670 tx=0x7f2af001d320 comp rx=0 tx=0).stop 2024-09-10T23:31:14.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afe600640 1 -- 172.21.15.17:0/4215293888 reap_dead start 2024-09-10T23:31:14.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 -- 172.21.15.17:0/4215293888 shutdown_connections 2024-09-10T23:31:14.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 -- 172.21.15.17:0/4215293888 >> 172.21.15.17:0/4215293888 conn(0x7f2af80ccf70 msgr2=0x7f2af80cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:14.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 -- 172.21.15.17:0/4215293888 shutdown_connections 2024-09-10T23:31:14.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 -- 172.21.15.17:0/4215293888 wait complete. 2024-09-10T23:31:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 Processor -- start 2024-09-10T23:31:14.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 -- start start 2024-09-10T23:31:14.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ae0004d50 0x7f2af81f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:14.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2af81e70d0 0x7f2af815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:14.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af815c1e0 0x7f2af815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:14.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2af80cde20 con 0x7f2af81e70d0 2024-09-10T23:31:14.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2af80cdca0 con 0x7f2af815c1e0 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2b00600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2af80ae4c0 con 0x7f2ae0004d50 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afd200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2af81e70d0 0x7f2af815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afd200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2af81e70d0 0x7f2af815e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59348/0 (socket says 172.21.15.17:59348) 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afd200640 1 -- 172.21.15.17:0/2838394520 learned_addr learned my addr 172.21.15.17:0/2838394520 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afdc00640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ae0004d50 0x7f2af81f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afe600640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af815c1e0 0x7f2af815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afd200640 1 -- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ae0004d50 msgr2=0x7f2af81f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afd200640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ae0004d50 0x7f2af81f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afd200640 1 -- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af815c1e0 msgr2=0x7f2af815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afd200640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af815c1e0 0x7f2af815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afd200640 1 -- 172.21.15.17:0/2838394520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af81e8d50 con 0x7f2af81e70d0 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2afd200640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2af81e70d0 0x7f2af815e7f0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4011b40 tx=0x7f2ae4011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2af5600640 1 -- 172.21.15.17:0/2838394520 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae401e070 con 0x7f2af81e70d0 2024-09-10T23:31:14.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2af5600640 1 -- 172.21.15.17:0/2838394520 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ae4019430 con 0x7f2af81e70d0 2024-09-10T23:31:14.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.651+0000 7f2af5600640 1 -- 172.21.15.17:0/2838394520 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4019840 con 0x7f2af81e70d0 2024-09-10T23:31:14.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.655+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af81e8ff0 con 0x7f2af81e70d0 2024-09-10T23:31:14.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.655+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af81e75d0 con 0x7f2af81e70d0 2024-09-10T23:31:14.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.655+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af806ef60 con 0x7f2af81e70d0 2024-09-10T23:31:14.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.655+0000 7f2af5600640 1 -- 172.21.15.17:0/2838394520 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2ae40199e0 con 0x7f2af81e70d0 2024-09-10T23:31:14.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.655+0000 7f2af5600640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ad8072610 0x7f2ad8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:14.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.655+0000 7f2af5600640 1 -- 172.21.15.17:0/2838394520 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5335+0+0 (secure 0 0 0) 0x7f2ae4093ff0 con 0x7f2af81e70d0 2024-09-10T23:31:14.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.655+0000 7f2afdc00640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ad8072610 0x7f2ad8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:14.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.655+0000 7f2afdc00640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ad8072610 0x7f2ad8074ad0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009c60 tx=0x7f2aec0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:14.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.659+0000 7f2af5600640 1 -- 172.21.15.17:0/2838394520 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2ae405f7e0 con 0x7f2af81e70d0 2024-09-10T23:31:14.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:14.847+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2af80d0250 con 0x7f2af81e70d0 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2af5600640 1 -- 172.21.15.17:0/2838394520 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v206) ==== 97+0+0 (secure 0 0 0) 0x7f2ae405f0e0 con 0x7f2af81e70d0 2024-09-10T23:31:15.036 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:31:15.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ad8072610 msgr2=0x7f2ad8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ad8072610 0x7f2ad8074ad0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009c60 tx=0x7f2aec0091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2af81e70d0 msgr2=0x7f2af815e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2af81e70d0 0x7f2af815e7f0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4011b40 tx=0x7f2ae4011f40 comp rx=0 tx=0).stop 2024-09-10T23:31:15.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 shutdown_connections 2024-09-10T23:31:15.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2ad8072610 0x7f2ad8074ad0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2af815c1e0 0x7f2af815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2af81e70d0 0x7f2af815e7f0 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 --2- 172.21.15.17:0/2838394520 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2ae0004d50 0x7f2af81f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 >> 172.21.15.17:0/2838394520 conn(0x7f2af80ccf70 msgr2=0x7f2af80731a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.035+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 shutdown_connections 2024-09-10T23:31:15.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.039+0000 7f2b00600640 1 -- 172.21.15.17:0/2838394520 wait complete. 2024-09-10T23:31:15.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:31:15.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.207+0000 7f54f9800640 1 -- 172.21.15.17:0/1928074621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54d8004810 msgr2=0x7f54d8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.207+0000 7f54f9800640 1 --2- 172.21.15.17:0/1928074621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54d8004810 0x7f54d8004c90 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f54dc001830 tx=0x7f54dc01f010 comp rx=0 tx=0).stop 2024-09-10T23:31:15.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.207+0000 7f54f3400640 1 -- 172.21.15.17:0/1928074621 reap_dead start 2024-09-10T23:31:15.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.207+0000 7f54f9800640 1 -- 172.21.15.17:0/1928074621 shutdown_connections 2024-09-10T23:31:15.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.207+0000 7f54f9800640 1 -- 172.21.15.17:0/1928074621 >> 172.21.15.17:0/1928074621 conn(0x7f54f40d1d40 msgr2=0x7f54f40d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.207+0000 7f54f9800640 1 -- 172.21.15.17:0/1928074621 shutdown_connections 2024-09-10T23:31:15.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.207+0000 7f54f9800640 1 -- 172.21.15.17:0/1928074621 wait complete. 2024-09-10T23:31:15.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 Processor -- start 2024-09-10T23:31:15.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 -- start start 2024-09-10T23:31:15.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54d8004810 0x7f54f40b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f415a3a0 0x7f54f415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f4159e90 0x7f54f40cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f54f4160760 con 0x7f54f4159e90 2024-09-10T23:31:15.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f54f41605e0 con 0x7f54d8004810 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f54f41608e0 con 0x7f54f415a3a0 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f4159e90 0x7f54f40cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f2a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54d8004810 0x7f54f40b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f2a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54d8004810 0x7f54f40b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:34962/0 (socket says 172.21.15.17:34962) 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f2a00640 1 -- 172.21.15.17:0/2040014151 learned_addr learned my addr 172.21.15.17:0/2040014151 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54ebe00640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f415a3a0 0x7f54f415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f2a00640 1 -- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f415a3a0 msgr2=0x7f54f415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f2a00640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f415a3a0 0x7f54f415ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f2a00640 1 -- 172.21.15.17:0/2040014151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f4159e90 msgr2=0x7f54f40cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f2a00640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f4159e90 0x7f54f40cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f2a00640 1 -- 172.21.15.17:0/2040014151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f40c6960 con 0x7f54d8004810 2024-09-10T23:31:15.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f2a00640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54d8004810 0x7f54f40b1cc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f54e4006660 tx=0x7f54e40039d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54eaa00640 1 -- 172.21.15.17:0/2040014151 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4015070 con 0x7f54d8004810 2024-09-10T23:31:15.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54eaa00640 1 -- 172.21.15.17:0/2040014151 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54e4011900 con 0x7f54d8004810 2024-09-10T23:31:15.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54eaa00640 1 -- 172.21.15.17:0/2040014151 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4011d50 con 0x7f54d8004810 2024-09-10T23:31:15.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f415cf40 con 0x7f54d8004810 2024-09-10T23:31:15.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f40c6eb0 con 0x7f54d8004810 2024-09-10T23:31:15.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.211+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f415fc90 con 0x7f54d8004810 2024-09-10T23:31:15.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.215+0000 7f54eaa00640 1 -- 172.21.15.17:0/2040014151 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f54e40103c0 con 0x7f54d8004810 2024-09-10T23:31:15.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.215+0000 7f54eaa00640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54d00725e0 0x7f54d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.215+0000 7f54eaa00640 1 -- 172.21.15.17:0/2040014151 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(208..208 src has 1..208) ==== 5249+0+0 (secure 0 0 0) 0x7f54e4094610 con 0x7f54d8004810 2024-09-10T23:31:15.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.215+0000 7f54ebe00640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54d00725e0 0x7f54d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.215+0000 7f54ebe00640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54d00725e0 0x7f54d0074aa0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0ac000 tx=0x7f54dc0a8f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.219+0000 7f54eaa00640 1 -- 172.21.15.17:0/2040014151 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f54e405f8d0 con 0x7f54d8004810 2024-09-10T23:31:15.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.451+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f54f40b40f0 con 0x7f54d8004810 2024-09-10T23:31:15.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54eaa00640 1 -- 172.21.15.17:0/2040014151 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) ==== 80+0+5304 (secure 0 0 0) 0x7f54e4064300 con 0x7f54d8004810 2024-09-10T23:31:15.456 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:15.456 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:15.456 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:31:15.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.456 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:31:15.456 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:31:15.456 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.456 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.457 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:15.458 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:15.461 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:31:15.462 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:15.463 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.464 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:15.465 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:31:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:31:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:31:15.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.470 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:31:15.471 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54d00725e0 msgr2=0x7f54d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54d00725e0 0x7f54d0074aa0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0ac000 tx=0x7f54dc0a8f90 comp rx=0 tx=0).stop 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54d8004810 msgr2=0x7f54f40b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54d8004810 0x7f54f40b1cc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f54e4006660 tx=0x7f54e40039d0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 shutdown_connections 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54d00725e0 0x7f54d0074aa0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f4159e90 0x7f54f40cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54f415a3a0 0x7f54f415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 --2- 172.21.15.17:0/2040014151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54d8004810 0x7f54f40b1cc0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 >> 172.21.15.17:0/2040014151 conn(0x7f54f40d1d40 msgr2=0x7f54f406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 shutdown_connections 2024-09-10T23:31:15.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.455+0000 7f54f9800640 1 -- 172.21.15.17:0/2040014151 wait complete. 2024-09-10T23:31:15.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:31:15.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 -- 172.21.15.17:0/198296037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 msgr2=0x7ff228071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 --2- 172.21.15.17:0/198296037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 0x7ff228071170 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7ff210009840 tx=0x7ff21001c7f0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 -- 172.21.15.17:0/198296037 shutdown_connections 2024-09-10T23:31:15.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 --2- 172.21.15.17:0/198296037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2280b39f0 0x7ff2280b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 --2- 172.21.15.17:0/198296037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 0x7ff228071170 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 -- 172.21.15.17:0/198296037 >> 172.21.15.17:0/198296037 conn(0x7ff2280d0ae0 msgr2=0x7ff2280d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 -- 172.21.15.17:0/198296037 shutdown_connections 2024-09-10T23:31:15.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 -- 172.21.15.17:0/198296037 wait complete. 2024-09-10T23:31:15.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 Processor -- start 2024-09-10T23:31:15.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.623+0000 7ff22cc00640 1 -- start start 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff22cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 0x7ff22815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff22cc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff228070d90 0x7ff22813b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff22cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2280b39f0 0x7ff2281641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff22cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff228167df0 con 0x7ff22806f6b0 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff22cc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff228167c70 con 0x7ff2280b39f0 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff22cc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff228167f70 con 0x7ff228070d90 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 0x7ff22815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 0x7ff22815a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59394/0 (socket says 172.21.15.17:59394) 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227400640 1 -- 172.21.15.17:0/2468224550 learned_addr learned my addr 172.21.15.17:0/2468224550 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:15.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff21fe00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff228070d90 0x7ff22813b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227e00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2280b39f0 0x7ff2281641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227400640 1 -- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff228070d90 msgr2=0x7ff22813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227400640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff228070d90 0x7ff22813b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227400640 1 -- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2280b39f0 msgr2=0x7ff2281641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227400640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2280b39f0 0x7ff2281641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227400640 1 -- 172.21.15.17:0/2468224550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2281fb1d0 con 0x7ff22806f6b0 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227e00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2280b39f0 0x7ff2281641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff227400640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 0x7ff22815a5f0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7ff21800c530 tx=0x7ff21800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff21f400640 1 -- 172.21.15.17:0/2468224550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218017070 con 0x7ff22806f6b0 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff21f400640 1 -- 172.21.15.17:0/2468224550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff218003600 con 0x7ff22806f6b0 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff21f400640 1 -- 172.21.15.17:0/2468224550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218003a50 con 0x7ff22806f6b0 2024-09-10T23:31:15.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2281fb4b0 con 0x7ff22806f6b0 2024-09-10T23:31:15.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2281fba70 con 0x7ff22806f6b0 2024-09-10T23:31:15.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff228071170 con 0x7ff22806f6b0 2024-09-10T23:31:15.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.627+0000 7ff21f400640 1 -- 172.21.15.17:0/2468224550 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff218003bf0 con 0x7ff22806f6b0 2024-09-10T23:31:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.631+0000 7ff21f400640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2040725e0 0x7ff204074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.631+0000 7ff21f400640 1 -- 172.21.15.17:0/2468224550 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(208..208 src has 1..208) ==== 5249+0+0 (secure 0 0 0) 0x7ff2180926d0 con 0x7ff22806f6b0 2024-09-10T23:31:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.631+0000 7ff21fe00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2040725e0 0x7ff204074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.631+0000 7ff21fe00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2040725e0 0x7ff204074aa0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff2100af000 tx=0x7ff21001b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.635+0000 7ff21f400640 1 -- 172.21.15.17:0/2468224550 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff21805d9d0 con 0x7ff22806f6b0 2024-09-10T23:31:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff2280b2220 con 0x7ff22806f6b0 2024-09-10T23:31:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff21f400640 1 -- 172.21.15.17:0/2468224550 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v208) ==== 84+0+65 (secure 0 0 0) 0x7ff218062400 con 0x7ff22806f6b0 2024-09-10T23:31:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:15.813 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:31:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:31:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:31:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:15.813 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2040725e0 msgr2=0x7ff204074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2040725e0 0x7ff204074aa0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff2100af000 tx=0x7ff21001b030 comp rx=0 tx=0).stop 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 msgr2=0x7ff22815a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 0x7ff22815a5f0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7ff21800c530 tx=0x7ff21800c9f0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 shutdown_connections 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff2040725e0 0x7ff204074aa0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2280b39f0 0x7ff2281641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff228070d90 0x7ff22813b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 --2- 172.21.15.17:0/2468224550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff22806f6b0 0x7ff22815a5f0 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 >> 172.21.15.17:0/2468224550 conn(0x7ff2280d0ae0 msgr2=0x7ff22806c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 shutdown_connections 2024-09-10T23:31:15.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.811+0000 7ff22cc00640 1 -- 172.21.15.17:0/2468224550 wait complete. 2024-09-10T23:31:15.834 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:31:15.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:31:15.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 -- 172.21.15.17:0/2157863023 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a415a980 msgr2=0x7fe6a415adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 --2- 172.21.15.17:0/2157863023 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a415a980 0x7fe6a415adf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009c80 tx=0x7fe69c01cd10 comp rx=0 tx=0).stop 2024-09-10T23:31:15.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 -- 172.21.15.17:0/2157863023 shutdown_connections 2024-09-10T23:31:15.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 --2- 172.21.15.17:0/2157863023 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a415a980 0x7fe6a415adf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 --2- 172.21.15.17:0/2157863023 >> v2:172.21.15.77:3300/0 conn(0x7fe6a413d0b0 0x7fe6a413d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 -- 172.21.15.17:0/2157863023 >> 172.21.15.17:0/2157863023 conn(0x7fe6a40cc590 msgr2=0x7fe6a40cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:15.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 -- 172.21.15.17:0/2157863023 shutdown_connections 2024-09-10T23:31:15.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 -- 172.21.15.17:0/2157863023 wait complete. 2024-09-10T23:31:15.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 Processor -- start 2024-09-10T23:31:15.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.983+0000 7fe6a8a00640 1 -- start start 2024-09-10T23:31:15.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a8a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40ca160 0x7fe6a40b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a8a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a413d0b0 0x7fe6a4152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a415a980 0x7fe6a413ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a8a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4070670 con 0x7fe6a415a980 2024-09-10T23:31:15.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a8a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a40704f0 con 0x7fe6a40ca160 2024-09-10T23:31:15.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a8a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a40707f0 con 0x7fe6a413d0b0 2024-09-10T23:31:15.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a415a980 0x7fe6a413ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a415a980 0x7fe6a413ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59410/0 (socket says 172.21.15.17:59410) 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a2800640 1 -- 172.21.15.17:0/40460418 learned_addr learned my addr 172.21.15.17:0/40460418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a1e00640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40ca160 0x7fe6a40b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe699400640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a413d0b0 0x7fe6a4152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a2800640 1 -- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a413d0b0 msgr2=0x7fe6a4152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a2800640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a413d0b0 0x7fe6a4152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a2800640 1 -- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40ca160 msgr2=0x7fe6a40b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a2800640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40ca160 0x7fe6a40b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a2800640 1 -- 172.21.15.17:0/40460418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a4151c10 con 0x7fe6a415a980 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe699400640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a413d0b0 0x7fe6a4152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a1e00640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40ca160 0x7fe6a40b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a2800640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a415a980 0x7fe6a413ae30 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009bd0 tx=0x7fe69c0092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe69aa00640 1 -- 172.21.15.17:0/40460418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0bb070 con 0x7fe6a415a980 2024-09-10T23:31:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe69aa00640 1 -- 172.21.15.17:0/40460418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe69c004d40 con 0x7fe6a415a980 2024-09-10T23:31:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe69aa00640 1 -- 172.21.15.17:0/40460418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0b2040 con 0x7fe6a415a980 2024-09-10T23:31:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a8a00640 1 -- 172.21.15.17:0/40460418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a4151ef0 con 0x7fe6a415a980 2024-09-10T23:31:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe6a8a00640 1 -- 172.21.15.17:0/40460418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a41524b0 con 0x7fe6a415a980 2024-09-10T23:31:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.987+0000 7fe693400640 1 -- 172.21.15.17:0/40460418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a413d810 con 0x7fe6a415a980 2024-09-10T23:31:15.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.991+0000 7fe69aa00640 1 -- 172.21.15.17:0/40460418 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe69c0b5030 con 0x7fe6a415a980 2024-09-10T23:31:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.991+0000 7fe69aa00640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6800725e0 0x7fe680074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.991+0000 7fe69aa00640 1 -- 172.21.15.17:0/40460418 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(208..208 src has 1..208) ==== 5249+0+0 (secure 0 0 0) 0x7fe69c12cb60 con 0x7fe6a415a980 2024-09-10T23:31:15.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.991+0000 7fe6a1e00640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6800725e0 0x7fe680074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.991+0000 7fe6a1e00640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6800725e0 0x7fe680074aa0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe69400e4a0 tx=0x7fe694010040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:15.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:15.995+0000 7fe69aa00640 1 -- 172.21.15.17:0/40460418 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe69c0f1de0 con 0x7fe6a415a980 2024-09-10T23:31:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:16.171+0000 7fe693400640 1 -- 172.21.15.17:0/40460418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe6a40b15a0 con 0x7fe6a415a980 2024-09-10T23:31:17.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.043+0000 7fe69aa00640 1 -- 172.21.15.17:0/40460418 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v209) ==== 138+0+0 (secure 0 0 0) 0x7fe69c016990 con 0x7fe6a415a980 2024-09-10T23:31:17.045 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:31:17.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 -- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6800725e0 msgr2=0x7fe680074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6800725e0 0x7fe680074aa0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe69400e4a0 tx=0x7fe694010040 comp rx=0 tx=0).stop 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 -- 172.21.15.17:0/40460418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a415a980 msgr2=0x7fe6a413ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a415a980 0x7fe6a413ae30 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009bd0 tx=0x7fe69c0092e0 comp rx=0 tx=0).stop 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 -- 172.21.15.17:0/40460418 shutdown_connections 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe6800725e0 0x7fe680074aa0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a415a980 0x7fe6a413ae30 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6a413d0b0 0x7fe6a4152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 --2- 172.21.15.17:0/40460418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6a40ca160 0x7fe6a40b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 -- 172.21.15.17:0/40460418 >> 172.21.15.17:0/40460418 conn(0x7fe6a40cc590 msgr2=0x7fe6a40ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 -- 172.21.15.17:0/40460418 shutdown_connections 2024-09-10T23:31:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.047+0000 7fe693400640 1 -- 172.21.15.17:0/40460418 wait complete. 2024-09-10T23:31:17.078 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:31:17.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.235+0000 7fbe7a400640 1 -- 172.21.15.17:0/2397997930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe58004810 msgr2=0x7fbe58004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:17.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.235+0000 7fbe7a400640 1 --2- 172.21.15.17:0/2397997930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe58004810 0x7fbe58004c90 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0016c0 tx=0x7fbe5c01c790 comp rx=0 tx=0).stop 2024-09-10T23:31:17.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.235+0000 7fbe73e00640 1 -- 172.21.15.17:0/2397997930 reap_dead start 2024-09-10T23:31:17.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.235+0000 7fbe7a400640 1 -- 172.21.15.17:0/2397997930 shutdown_connections 2024-09-10T23:31:17.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.235+0000 7fbe7a400640 1 -- 172.21.15.17:0/2397997930 >> 172.21.15.17:0/2397997930 conn(0x7fbe740d1dc0 msgr2=0x7fbe740d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:17.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.235+0000 7fbe7a400640 1 -- 172.21.15.17:0/2397997930 shutdown_connections 2024-09-10T23:31:17.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.235+0000 7fbe7a400640 1 -- 172.21.15.17:0/2397997930 wait complete. 2024-09-10T23:31:17.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.235+0000 7fbe7a400640 1 Processor -- start 2024-09-10T23:31:17.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.235+0000 7fbe7a400640 1 -- start start 2024-09-10T23:31:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe7a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe58004810 0x7fbe74155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe7a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe74155610 0x7fbe740b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe7a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe741f6280 0x7fbe740c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe7a400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbe74164ce0 con 0x7fbe58004810 2024-09-10T23:31:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe7a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe74164b60 con 0x7fbe741f6280 2024-09-10T23:31:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe7a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbe74164e60 con 0x7fbe74155610 2024-09-10T23:31:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe58004810 0x7fbe74155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe58004810 0x7fbe74155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44156/0 (socket says 172.21.15.17:44156) 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73400640 1 -- 172.21.15.17:0/1062342531 learned_addr learned my addr 172.21.15.17:0/1062342531 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73e00640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe741f6280 0x7fbe740c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe6be00640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe74155610 0x7fbe740b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73400640 1 -- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe74155610 msgr2=0x7fbe740b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe74155610 0x7fbe740b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73400640 1 -- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe741f6280 msgr2=0x7fbe740c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe741f6280 0x7fbe740c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73400640 1 -- 172.21.15.17:0/1062342531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe740b6340 con 0x7fbe58004810 2024-09-10T23:31:17.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe73400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe58004810 0x7fbe74155c20 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7fbe640126c0 tx=0x7fbe64012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:17.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe6b400640 1 -- 172.21.15.17:0/1062342531 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64010ae0 con 0x7fbe58004810 2024-09-10T23:31:17.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe6b400640 1 -- 172.21.15.17:0/1062342531 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe64010c80 con 0x7fbe58004810 2024-09-10T23:31:17.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe740b6620 con 0x7fbe58004810 2024-09-10T23:31:17.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe6b400640 1 -- 172.21.15.17:0/1062342531 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe640136b0 con 0x7fbe58004810 2024-09-10T23:31:17.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe741f5d60 con 0x7fbe58004810 2024-09-10T23:31:17.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.239+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe741f5f60 con 0x7fbe58004810 2024-09-10T23:31:17.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.243+0000 7fbe6b400640 1 -- 172.21.15.17:0/1062342531 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbe64013850 con 0x7fbe58004810 2024-09-10T23:31:17.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.243+0000 7fbe6b400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe50072610 0x7fbe50074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:17.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.243+0000 7fbe6b400640 1 -- 172.21.15.17:0/1062342531 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5619+0+0 (secure 0 0 0) 0x7fbe64096f40 con 0x7fbe58004810 2024-09-10T23:31:17.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.243+0000 7fbe6be00640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe50072610 0x7fbe50074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:17.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.243+0000 7fbe6be00640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe50072610 0x7fbe50074ad0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbe740b1490 tx=0x7fbe5c019580 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:17.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.247+0000 7fbe6b400640 1 -- 172.21.15.17:0/1062342531 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbe741f5f60 con 0x7fbe58004810 2024-09-10T23:31:17.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:17.423+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbe740ce6a0 con 0x7fbe58004810 2024-09-10T23:31:18.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.047+0000 7fbe6b400640 1 -- 172.21.15.17:0/1062342531 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v210) ==== 170+0+0 (secure 0 0 0) 0x7fbe64022020 con 0x7fbe58004810 2024-09-10T23:31:18.048 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:31:18.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe50072610 msgr2=0x7fbe50074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe50072610 0x7fbe50074ad0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbe740b1490 tx=0x7fbe5c019580 comp rx=0 tx=0).stop 2024-09-10T23:31:18.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe58004810 msgr2=0x7fbe74155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe58004810 0x7fbe74155c20 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7fbe640126c0 tx=0x7fbe64012b80 comp rx=0 tx=0).stop 2024-09-10T23:31:18.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 shutdown_connections 2024-09-10T23:31:18.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbe50072610 0x7fbe50074ad0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe741f6280 0x7fbe740c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe74155610 0x7fbe740b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 --2- 172.21.15.17:0/1062342531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbe58004810 0x7fbe74155c20 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 >> 172.21.15.17:0/1062342531 conn(0x7fbe740d1dc0 msgr2=0x7fbe7415ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:18.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 shutdown_connections 2024-09-10T23:31:18.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.051+0000 7fbe7a400640 1 -- 172.21.15.17:0/1062342531 wait complete. 2024-09-10T23:31:18.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:31:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.243+0000 7fd423a00640 1 -- 172.21.15.17:0/680979744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0cfe70 msgr2=0x7fd41c0d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.243+0000 7fd423a00640 1 --2- 172.21.15.17:0/680979744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0cfe70 0x7fd41c0d0250 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7fd410009900 tx=0x7fd41001c8a0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.243+0000 7fd423a00640 1 -- 172.21.15.17:0/680979744 shutdown_connections 2024-09-10T23:31:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.243+0000 7fd423a00640 1 --2- 172.21.15.17:0/680979744 >> v2:172.21.15.77:3300/0 conn(0x7fd41c0ce0f0 0x7fd41c0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.243+0000 7fd423a00640 1 --2- 172.21.15.17:0/680979744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0cfe70 0x7fd41c0d0250 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.243+0000 7fd423a00640 1 -- 172.21.15.17:0/680979744 >> 172.21.15.17:0/680979744 conn(0x7fd41c0d1e30 msgr2=0x7fd41c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.243+0000 7fd423a00640 1 -- 172.21.15.17:0/680979744 shutdown_connections 2024-09-10T23:31:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.243+0000 7fd423a00640 1 -- 172.21.15.17:0/680979744 wait complete. 2024-09-10T23:31:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 Processor -- start 2024-09-10T23:31:18.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 -- start start 2024-09-10T23:31:18.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd41c0ce0f0 0x7fd41c0b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd41c0cfe70 0x7fd41c0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0d2950 0x7fd41c1fb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0afb60 con 0x7fd41c0d2950 2024-09-10T23:31:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0af9e0 con 0x7fd41c0ce0f0 2024-09-10T23:31:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c0afce0 con 0x7fd41c0cfe70 2024-09-10T23:31:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0d2950 0x7fd41c1fb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd41c0ce0f0 0x7fd41c0b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0d2950 0x7fd41c1fb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44176/0 (socket says 172.21.15.17:44176) 2024-09-10T23:31:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd41c0ce0f0 0x7fd41c0b7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:51730/0 (socket says 172.21.15.17:51730) 2024-09-10T23:31:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421a00640 1 -- 172.21.15.17:0/1158205403 learned_addr learned my addr 172.21.15.17:0/1158205403 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:18.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd41be00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd41c0cfe70 0x7fd41c0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421a00640 1 -- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd41c0cfe70 msgr2=0x7fd41c0cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421a00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd41c0cfe70 0x7fd41c0cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421a00640 1 -- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd41c0ce0f0 msgr2=0x7fd41c0b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421a00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd41c0ce0f0 0x7fd41c0b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421a00640 1 -- 172.21.15.17:0/1158205403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c0cbe40 con 0x7fd41c0d2950 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421000640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd41c0ce0f0 0x7fd41c0b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd421a00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0d2950 0x7fd41c1fb4a0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fd41400ea80 tx=0x7fd41400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd418c00640 1 -- 172.21.15.17:0/1158205403 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414004b30 con 0x7fd41c0d2950 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd418c00640 1 -- 172.21.15.17:0/1158205403 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd414004cf0 con 0x7fd41c0d2950 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd418c00640 1 -- 172.21.15.17:0/1158205403 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414005280 con 0x7fd41c0d2950 2024-09-10T23:31:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c1face0 con 0x7fd41c0d2950 2024-09-10T23:31:18.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c0cbb60 con 0x7fd41c0d2950 2024-09-10T23:31:18.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.247+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c0d0250 con 0x7fd41c0d2950 2024-09-10T23:31:18.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.251+0000 7fd418c00640 1 -- 172.21.15.17:0/1158205403 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd414005420 con 0x7fd41c0d2950 2024-09-10T23:31:18.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.251+0000 7fd418c00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3fc0725e0 0x7fd3fc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:18.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.251+0000 7fd418c00640 1 -- 172.21.15.17:0/1158205403 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 6001+0+0 (secure 0 0 0) 0x7fd414093ea0 con 0x7fd41c0d2950 2024-09-10T23:31:18.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.251+0000 7fd421000640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3fc0725e0 0x7fd3fc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:18.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.251+0000 7fd421000640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3fc0725e0 0x7fd3fc074aa0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd4100af000 tx=0x7fd41001b0e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:18.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.255+0000 7fd418c00640 1 -- 172.21.15.17:0/1158205403 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd41405ee90 con 0x7fd41c0d2950 2024-09-10T23:31:18.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:18.467+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd41c06f440 con 0x7fd41c0d2950 2024-09-10T23:31:19.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.075+0000 7fd418c00640 1 -- 172.21.15.17:0/1158205403 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 31 and data pool 32 v157) ==== 174+0+0 (secure 0 0 0) 0x7fd4140638c0 con 0x7fd41c0d2950 2024-09-10T23:31:19.083 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 31 and data pool 32 2024-09-10T23:31:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.087+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3fc0725e0 msgr2=0x7fd3fc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.087+0000 7fd423a00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3fc0725e0 0x7fd3fc074aa0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd4100af000 tx=0x7fd41001b0e0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.087+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0d2950 msgr2=0x7fd41c1fb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.087+0000 7fd423a00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0d2950 0x7fd41c1fb4a0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fd41400ea80 tx=0x7fd41400ef40 comp rx=0 tx=0).stop 2024-09-10T23:31:19.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.091+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 shutdown_connections 2024-09-10T23:31:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.091+0000 7fd423a00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd3fc0725e0 0x7fd3fc074aa0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.091+0000 7fd423a00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd41c0d2950 0x7fd41c1fb4a0 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.091+0000 7fd423a00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd41c0cfe70 0x7fd41c0cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.091+0000 7fd423a00640 1 --2- 172.21.15.17:0/1158205403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd41c0ce0f0 0x7fd41c0b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.091+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 >> 172.21.15.17:0/1158205403 conn(0x7fd41c0d1e30 msgr2=0x7fd41c15abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.091+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 shutdown_connections 2024-09-10T23:31:19.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.091+0000 7fd423a00640 1 -- 172.21.15.17:0/1158205403 wait complete. 2024-09-10T23:31:19.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3049623104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f40cfea0 msgr2=0x7fd1f40d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 --2- 172.21.15.17:0/3049623104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f40cfea0 0x7fd1f40d2860 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009840 tx=0x7fd1e401f010 comp rx=0 tx=0).stop 2024-09-10T23:31:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3049623104 shutdown_connections 2024-09-10T23:31:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 --2- 172.21.15.17:0/3049623104 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1f40d0280 0x7fd1f40ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 --2- 172.21.15.17:0/3049623104 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f40cfea0 0x7fd1f40d2860 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3049623104 >> 172.21.15.17:0/3049623104 conn(0x7fd1f40d1d40 msgr2=0x7fd1f40d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3049623104 shutdown_connections 2024-09-10T23:31:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3049623104 wait complete. 2024-09-10T23:31:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 Processor -- start 2024-09-10T23:31:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.271+0000 7fd1f9e00640 1 -- start start 2024-09-10T23:31:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f9e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f40cd110 0x7fd1f41f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f9e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1f40cfea0 0x7fd1f40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1f40d0280 0x7fd1f4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f9e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f40b1b30 con 0x7fd1f40d0280 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f9e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f40b19b0 con 0x7fd1f40cd110 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f9e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f40b1cb0 con 0x7fd1f40cfea0 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1f40d0280 0x7fd1f4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1f40d0280 0x7fd1f4071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44178/0 (socket says 172.21.15.17:44178) 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f3400640 1 -- 172.21.15.17:0/3827030769 learned_addr learned my addr 172.21.15.17:0/3827030769 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f2a00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f40cd110 0x7fd1f41f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1ebe00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1f40cfea0 0x7fd1f40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f3400640 1 -- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1f40cfea0 msgr2=0x7fd1f40c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f3400640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1f40cfea0 0x7fd1f40c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f3400640 1 -- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f40cd110 msgr2=0x7fd1f41f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f3400640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f40cd110 0x7fd1f41f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f3400640 1 -- 172.21.15.17:0/3827030769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f40b66f0 con 0x7fd1f40d0280 2024-09-10T23:31:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f3400640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1f40d0280 0x7fd1f4071ab0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00ec70 tx=0x7fd1ec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1eb400640 1 -- 172.21.15.17:0/3827030769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec003b80 con 0x7fd1f40d0280 2024-09-10T23:31:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1eb400640 1 -- 172.21.15.17:0/3827030769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1ec003d20 con 0x7fd1f40d0280 2024-09-10T23:31:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f41f5510 con 0x7fd1f40d0280 2024-09-10T23:31:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1eb400640 1 -- 172.21.15.17:0/3827030769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec004280 con 0x7fd1f40d0280 2024-09-10T23:31:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f40c9350 con 0x7fd1f40d0280 2024-09-10T23:31:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.275+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f414a9f0 con 0x7fd1f40d0280 2024-09-10T23:31:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.279+0000 7fd1eb400640 1 -- 172.21.15.17:0/3827030769 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd1ec004420 con 0x7fd1f40d0280 2024-09-10T23:31:19.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.279+0000 7fd1eb400640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1d00725e0 0x7fd1d0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.279+0000 7fd1eb400640 1 -- 172.21.15.17:0/3827030769 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 6101+0+0 (secure 0 0 0) 0x7fd1ec094010 con 0x7fd1f40d0280 2024-09-10T23:31:19.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.279+0000 7fd1f2a00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1d00725e0 0x7fd1d0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.279+0000 7fd1f2a00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1d00725e0 0x7fd1d0074aa0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40b2000 tx=0x7fd1e401d850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:19.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.283+0000 7fd1eb400640 1 -- 172.21.15.17:0/3827030769 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd1f414a9f0 con 0x7fd1f40d0280 2024-09-10T23:31:19.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.459+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1f40d2860 con 0x7fd1f40d0280 2024-09-10T23:31:19.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.459+0000 7fd1eb400640 1 -- 172.21.15.17:0/3827030769 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) ==== 74+0+16965 (secure 0 0 0) 0x7fd1ec05ee70 con 0x7fd1f40d0280 2024-09-10T23:31:19.462 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:19.462 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":211,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:18.471496+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:16.186449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:17.438325+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1d00725e0 msgr2=0x7fd1d0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1d00725e0 0x7fd1d0074aa0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40b2000 tx=0x7fd1e401d850 comp rx=0 tx=0).stop 2024-09-10T23:31:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1f40d0280 msgr2=0x7fd1f4071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1f40d0280 0x7fd1f4071ab0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00ec70 tx=0x7fd1ec00c6a0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 shutdown_connections 2024-09-10T23:31:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1d00725e0 0x7fd1d0074aa0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1f40d0280 0x7fd1f4071ab0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1f40cfea0 0x7fd1f40c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 --2- 172.21.15.17:0/3827030769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1f40cd110 0x7fd1f41f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 >> 172.21.15.17:0/3827030769 conn(0x7fd1f40d1d40 msgr2=0x7fd1f40b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 shutdown_connections 2024-09-10T23:31:19.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.463+0000 7fd1f9e00640 1 -- 172.21.15.17:0/3827030769 wait complete. 2024-09-10T23:31:19.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.627+0000 7f8787400640 1 -- 172.21.15.17:0/1190134235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87680052f0 msgr2=0x7f876800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.627+0000 7f8787400640 1 --2- 172.21.15.17:0/1190134235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87680052f0 0x7f876800b9d0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7f87800b0c40 tx=0x7f877801d1f0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.627+0000 7f8787400640 1 -- 172.21.15.17:0/1190134235 shutdown_connections 2024-09-10T23:31:19.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.627+0000 7f8787400640 1 --2- 172.21.15.17:0/1190134235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87680052f0 0x7f876800b9d0 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.627+0000 7f8787400640 1 -- 172.21.15.17:0/1190134235 >> 172.21.15.17:0/1190134235 conn(0x7f87800d1d40 msgr2=0x7f87800d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 -- 172.21.15.17:0/1190134235 shutdown_connections 2024-09-10T23:31:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 -- 172.21.15.17:0/1190134235 wait complete. 2024-09-10T23:31:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 Processor -- start 2024-09-10T23:31:19.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 -- start start 2024-09-10T23:31:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87680052f0 0x7f878015eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f878006e4d0 0x7f8780152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f878006e950 0x7f8780153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f87800d06c0 con 0x7f878006e950 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f87800d0540 con 0x7f87680052f0 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f87800d0840 con 0x7f878006e4d0 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8785400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f878006e950 0x7f8780153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8785400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f878006e950 0x7f8780153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44188/0 (socket says 172.21.15.17:44188) 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8785400640 1 -- 172.21.15.17:0/1248340295 learned_addr learned my addr 172.21.15.17:0/1248340295 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f877fe00640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f878006e4d0 0x7f8780152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8784a00640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87680052f0 0x7f878015eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8785400640 1 -- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f878006e4d0 msgr2=0x7f8780152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8785400640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f878006e4d0 0x7f8780152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8785400640 1 -- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87680052f0 msgr2=0x7f878015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8785400640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87680052f0 0x7f878015eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8785400640 1 -- 172.21.15.17:0/1248340295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87801f4690 con 0x7f878006e950 2024-09-10T23:31:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8785400640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f878006e950 0x7f8780153430 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f87780af040 tx=0x7f87780ac480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f877cc00640 1 -- 172.21.15.17:0/1248340295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87780b1040 con 0x7f878006e950 2024-09-10T23:31:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f877cc00640 1 -- 172.21.15.17:0/1248340295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87780bd070 con 0x7f878006e950 2024-09-10T23:31:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f877cc00640 1 -- 172.21.15.17:0/1248340295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87780acb60 con 0x7f878006e950 2024-09-10T23:31:19.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.631+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87801f4950 con 0x7f878006e950 2024-09-10T23:31:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.635+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87801f4f10 con 0x7f878006e950 2024-09-10T23:31:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.635+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87800b01e0 con 0x7f878006e950 2024-09-10T23:31:19.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.635+0000 7f877cc00640 1 -- 172.21.15.17:0/1248340295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f877800f040 con 0x7f878006e950 2024-09-10T23:31:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.635+0000 7f877cc00640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87600725e0 0x7f8760074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.635+0000 7f877cc00640 1 -- 172.21.15.17:0/1248340295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 6101+0+0 (secure 0 0 0) 0x7f877812dd10 con 0x7f878006e950 2024-09-10T23:31:19.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.635+0000 7f8784a00640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87600725e0 0x7f8760074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.635+0000 7f8784a00640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87600725e0 0x7f8760074aa0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f878015f840 tx=0x7f8774006b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:19.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.639+0000 7f877cc00640 1 -- 172.21.15.17:0/1248340295 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8778133020 con 0x7f878006e950 2024-09-10T23:31:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.815+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f878006d9a0 con 0x7f878006e950 2024-09-10T23:31:19.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.815+0000 7f877cc00640 1 -- 172.21.15.17:0/1248340295 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) ==== 74+0+16965 (secure 0 0 0) 0x7f8778016f00 con 0x7f878006e950 2024-09-10T23:31:19.818 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:19.818 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":211,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:18.471496+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:16.186449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:17.438325+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87600725e0 msgr2=0x7f8760074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87600725e0 0x7f8760074aa0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f878015f840 tx=0x7f8774006b80 comp rx=0 tx=0).stop 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f878006e950 msgr2=0x7f8780153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f878006e950 0x7f8780153430 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f87780af040 tx=0x7f87780ac480 comp rx=0 tx=0).stop 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 shutdown_connections 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f87600725e0 0x7f8760074aa0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f878006e950 0x7f8780153430 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f878006e4d0 0x7f8780152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 --2- 172.21.15.17:0/1248340295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87680052f0 0x7f878015eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 >> 172.21.15.17:0/1248340295 conn(0x7f87800d1d40 msgr2=0x7f87800b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:19.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 shutdown_connections 2024-09-10T23:31:19.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.819+0000 7f8787400640 1 -- 172.21.15.17:0/1248340295 wait complete. 2024-09-10T23:31:19.840 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:31:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.987+0000 7f102ac00640 1 -- 172.21.15.17:0/2292544033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1024158010 msgr2=0x7f10240b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.987+0000 7f102ac00640 1 --2- 172.21.15.17:0/2292544033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1024158010 0x7f10240b2c60 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f10240748f0 tx=0x7f101401dbf0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.987+0000 7f102ac00640 1 -- 172.21.15.17:0/2292544033 shutdown_connections 2024-09-10T23:31:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.987+0000 7f102ac00640 1 --2- 172.21.15.17:0/2292544033 >> v2:172.21.15.77:3300/0 conn(0x7f102415aa30 0x7f10240cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.987+0000 7f102ac00640 1 --2- 172.21.15.17:0/2292544033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1024158010 0x7f10240b2c60 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.987+0000 7f102ac00640 1 -- 172.21.15.17:0/2292544033 >> 172.21.15.17:0/2292544033 conn(0x7f102406c360 msgr2=0x7f102406c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.987+0000 7f102ac00640 1 -- 172.21.15.17:0/2292544033 shutdown_connections 2024-09-10T23:31:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.987+0000 7f102ac00640 1 -- 172.21.15.17:0/2292544033 wait complete. 2024-09-10T23:31:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 Processor -- start 2024-09-10T23:31:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 -- start start 2024-09-10T23:31:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10240b45a0 0x7f10241f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1024158010 0x7f1024073fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f102415aa30 0x7f1024163550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f10240d0340 con 0x7f102415aa30 2024-09-10T23:31:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10240d01c0 con 0x7f10240b45a0 2024-09-10T23:31:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f10241671b0 con 0x7f1024158010 2024-09-10T23:31:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1028c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f102415aa30 0x7f1024163550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1028c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f102415aa30 0x7f1024163550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44206/0 (socket says 172.21.15.17:44206) 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1028c00640 1 -- 172.21.15.17:0/788526057 learned_addr learned my addr 172.21.15.17:0/788526057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1023e00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10240b45a0 0x7f10241f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f101b400640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1024158010 0x7f1024073fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1028c00640 1 -- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1024158010 msgr2=0x7f1024073fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1028c00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1024158010 0x7f1024073fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1028c00640 1 -- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10240b45a0 msgr2=0x7f10241f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1028c00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10240b45a0 0x7f10241f7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1028c00640 1 -- 172.21.15.17:0/788526057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10241f8540 con 0x7f102415aa30 2024-09-10T23:31:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1028c00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f102415aa30 0x7f1024163550 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f101c00c760 tx=0x7f101c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1020c00640 1 -- 172.21.15.17:0/788526057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c003b80 con 0x7f102415aa30 2024-09-10T23:31:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1020c00640 1 -- 172.21.15.17:0/788526057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f101c003d40 con 0x7f102415aa30 2024-09-10T23:31:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f1020c00640 1 -- 172.21.15.17:0/788526057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c00aab0 con 0x7f102415aa30 2024-09-10T23:31:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10241f8820 con 0x7f102415aa30 2024-09-10T23:31:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.991+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10241f8de0 con 0x7f102415aa30 2024-09-10T23:31:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.995+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f102406a4b0 con 0x7f102415aa30 2024-09-10T23:31:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.995+0000 7f1020c00640 1 -- 172.21.15.17:0/788526057 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f101c00ac50 con 0x7f102415aa30 2024-09-10T23:31:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.995+0000 7f1020c00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10000725e0 0x7f1000074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.995+0000 7f1020c00640 1 -- 172.21.15.17:0/788526057 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 6101+0+0 (secure 0 0 0) 0x7f101c092ff0 con 0x7f102415aa30 2024-09-10T23:31:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.995+0000 7f1023e00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10000725e0 0x7f1000074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:19.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:19.995+0000 7f1023e00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10000725e0 0x7f1000074aa0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f10140b0000 tx=0x7f101401c430 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:20.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:20.003+0000 7f1020c00640 1 -- 172.21.15.17:0/788526057 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f101c05def0 con 0x7f102415aa30 2024-09-10T23:31:20.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:20.215+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f10240aed50 con 0x7f102415aa30 2024-09-10T23:31:21.045 INFO:tasks.ceph.mds.d.smithi077.stderr:2024-09-10T23:31:21.049+0000 7f0260000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:31:21.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.087+0000 7f1020c00640 1 -- 172.21.15.17:0/788526057 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v160) ==== 118+0+0 (secure 0 0 0) 0x7f101c062920 con 0x7f102415aa30 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10000725e0 msgr2=0x7f1000074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10000725e0 0x7f1000074aa0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f10140b0000 tx=0x7f101401c430 comp rx=0 tx=0).stop 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f102415aa30 msgr2=0x7f1024163550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f102415aa30 0x7f1024163550 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f101c00c760 tx=0x7f101c00cc20 comp rx=0 tx=0).stop 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 shutdown_connections 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f10000725e0 0x7f1000074aa0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f102415aa30 0x7f1024163550 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1024158010 0x7f1024073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 --2- 172.21.15.17:0/788526057 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10240b45a0 0x7f10241f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 >> 172.21.15.17:0/788526057 conn(0x7f102406c360 msgr2=0x7f102406fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:21.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 shutdown_connections 2024-09-10T23:31:21.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.091+0000 7f102ac00640 1 -- 172.21.15.17:0/788526057 wait complete. 2024-09-10T23:31:21.120 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:31:21.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:31:21.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 -- 172.21.15.17:0/841332226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd415e370 msgr2=0x7f0fd40d20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:21.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 --2- 172.21.15.17:0/841332226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd415e370 0x7f0fd40d20f0 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f0fd408cde0 tx=0x7f0fc001c6b0 comp rx=0 tx=0).stop 2024-09-10T23:31:21.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 -- 172.21.15.17:0/841332226 shutdown_connections 2024-09-10T23:31:21.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 --2- 172.21.15.17:0/841332226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd415e370 0x7f0fd40d20f0 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:21.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 --2- 172.21.15.17:0/841332226 >> v2:172.21.15.77:3300/0 conn(0x7f0fd415df90 0x7f0fd40d4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 -- 172.21.15.17:0/841332226 >> 172.21.15.17:0/841332226 conn(0x7f0fd409d250 msgr2=0x7f0fd40d4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 -- 172.21.15.17:0/841332226 shutdown_connections 2024-09-10T23:31:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 -- 172.21.15.17:0/841332226 wait complete. 2024-09-10T23:31:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 Processor -- start 2024-09-10T23:31:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 -- start start 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd40d2630 0x7f0fd415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd415df90 0x7f0fd4150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd4153e80 0x7f0fd41fb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd416b360 con 0x7f0fd40d2630 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd416b1e0 con 0x7f0fd415df90 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fdbc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd416b4e0 con 0x7f0fd4153e80 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fd9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd40d2630 0x7f0fd415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fd9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd40d2630 0x7f0fd415b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44236/0 (socket says 172.21.15.17:44236) 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fd9200640 1 -- 172.21.15.17:0/4126965150 learned_addr learned my addr 172.21.15.17:0/4126965150 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fd3e00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd415df90 0x7f0fd4150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.275+0000 7f0fd9c00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd4153e80 0x7f0fd41fb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd9200640 1 -- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd4153e80 msgr2=0x7f0fd41fb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd9200640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd4153e80 0x7f0fd41fb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd9200640 1 -- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd415df90 msgr2=0x7f0fd4150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd9200640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd415df90 0x7f0fd4150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd9200640 1 -- 172.21.15.17:0/4126965150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd415bb00 con 0x7f0fd40d2630 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd9200640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd40d2630 0x7f0fd415b470 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800d980 tx=0x7f0fc800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd0c00640 1 -- 172.21.15.17:0/4126965150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8017070 con 0x7f0fd40d2630 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd0c00640 1 -- 172.21.15.17:0/4126965150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fc8009d20 con 0x7f0fd40d2630 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd0c00640 1 -- 172.21.15.17:0/4126965150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80106c0 con 0x7f0fd40d2630 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd415bde0 con 0x7f0fd40d2630 2024-09-10T23:31:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd4154330 con 0x7f0fd40d2630 2024-09-10T23:31:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd40d4810 con 0x7f0fd40d2630 2024-09-10T23:31:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd0c00640 1 -- 172.21.15.17:0/4126965150 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0fc8010860 con 0x7f0fd40d2630 2024-09-10T23:31:21.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.279+0000 7f0fd0c00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb4072610 0x7f0fb4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:21.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.283+0000 7f0fd0c00640 1 -- 172.21.15.17:0/4126965150 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f0fc8093710 con 0x7f0fd40d2630 2024-09-10T23:31:21.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.283+0000 7f0fd3e00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb4072610 0x7f0fb4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:21.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.283+0000 7f0fd3e00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb4072610 0x7f0fb4074ad0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00af000 tx=0x7f0fc001aef0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:21.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.283+0000 7f0fd0c00640 1 -- 172.21.15.17:0/4126965150 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f0fc805e580 con 0x7f0fd40d2630 2024-09-10T23:31:21.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:21.491+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0fd415c740 con 0x7f0fd40d2630 2024-09-10T23:31:22.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.095+0000 7f0fd0c00640 1 -- 172.21.15.17:0/4126965150 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v161) ==== 122+0+0 (secure 0 0 0) 0x7f0fc8062fb0 con 0x7f0fd40d2630 2024-09-10T23:31:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb4072610 msgr2=0x7f0fb4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb4072610 0x7f0fb4074ad0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00af000 tx=0x7f0fc001aef0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd40d2630 msgr2=0x7f0fd415b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd40d2630 0x7f0fd415b470 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800d980 tx=0x7f0fc800de40 comp rx=0 tx=0).stop 2024-09-10T23:31:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 shutdown_connections 2024-09-10T23:31:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0fb4072610 0x7f0fb4074ad0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0fd4153e80 0x7f0fd41fb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fd415df90 0x7f0fd4150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 --2- 172.21.15.17:0/4126965150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fd40d2630 0x7f0fd415b470 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 >> 172.21.15.17:0/4126965150 conn(0x7f0fd409d250 msgr2=0x7f0fd40b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 shutdown_connections 2024-09-10T23:31:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.099+0000 7f0fdbc00640 1 -- 172.21.15.17:0/4126965150 wait complete. 2024-09-10T23:31:22.124 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:31:22.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.271+0000 7fbf89600640 1 -- 172.21.15.17:0/336078569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf840ce370 msgr2=0x7fbf84152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.271+0000 7fbf89600640 1 --2- 172.21.15.17:0/336078569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf840ce370 0x7fbf84152cc0 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7fbf84070270 tx=0x7fbf6c01c8a0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.271+0000 7fbf89600640 1 -- 172.21.15.17:0/336078569 shutdown_connections 2024-09-10T23:31:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.271+0000 7fbf89600640 1 --2- 172.21.15.17:0/336078569 >> v2:172.21.15.77:3300/0 conn(0x7fbf84069510 0x7fbf840cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.271+0000 7fbf89600640 1 --2- 172.21.15.17:0/336078569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf840ce370 0x7fbf84152cc0 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.271+0000 7fbf89600640 1 -- 172.21.15.17:0/336078569 >> 172.21.15.17:0/336078569 conn(0x7fbf840ccf70 msgr2=0x7fbf840cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.271+0000 7fbf89600640 1 -- 172.21.15.17:0/336078569 shutdown_connections 2024-09-10T23:31:22.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.271+0000 7fbf89600640 1 -- 172.21.15.17:0/336078569 wait complete. 2024-09-10T23:31:22.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 Processor -- start 2024-09-10T23:31:22.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 -- start start 2024-09-10T23:31:22.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf84069510 0x7fbf8414be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf840ce370 0x7fbf841fb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415fae0 0x7fbf841fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8415c840 con 0x7fbf8415fae0 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8415c6c0 con 0x7fbf84069510 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbf8415c9c0 con 0x7fbf840ce370 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415fae0 0x7fbf841fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415fae0 0x7fbf841fbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44254/0 (socket says 172.21.15.17:44254) 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf83400640 1 -- 172.21.15.17:0/1886475852 learned_addr learned my addr 172.21.15.17:0/1886475852 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf82a00640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf84069510 0x7fbf8414be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf7be00640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf840ce370 0x7fbf841fb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf83400640 1 -- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf840ce370 msgr2=0x7fbf841fb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf83400640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf840ce370 0x7fbf841fb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf83400640 1 -- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf84069510 msgr2=0x7fbf8414be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf83400640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf84069510 0x7fbf8414be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf83400640 1 -- 172.21.15.17:0/1886475852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8414f050 con 0x7fbf8415fae0 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf7be00640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf840ce370 0x7fbf841fb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:22.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf83400640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415fae0 0x7fbf841fbc10 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00ea20 tx=0x7fbf7c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf7aa00640 1 -- 172.21.15.17:0/1886475852 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00cde0 con 0x7fbf8415fae0 2024-09-10T23:31:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf7aa00640 1 -- 172.21.15.17:0/1886475852 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf7c004c40 con 0x7fbf8415fae0 2024-09-10T23:31:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf7aa00640 1 -- 172.21.15.17:0/1886475852 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c005280 con 0x7fbf8415fae0 2024-09-10T23:31:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8414c3b0 con 0x7fbf8415fae0 2024-09-10T23:31:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.275+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf8414d380 con 0x7fbf8415fae0 2024-09-10T23:31:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.279+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf8415cee0 con 0x7fbf8415fae0 2024-09-10T23:31:22.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.279+0000 7fbf7aa00640 1 -- 172.21.15.17:0/1886475852 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbf7c00f040 con 0x7fbf8415fae0 2024-09-10T23:31:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.279+0000 7fbf7aa00640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf600725e0 0x7fbf60074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.279+0000 7fbf7aa00640 1 -- 172.21.15.17:0/1886475852 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fbf7c093a00 con 0x7fbf8415fae0 2024-09-10T23:31:22.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.279+0000 7fbf82a00640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf600725e0 0x7fbf60074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.279+0000 7fbf82a00640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf600725e0 0x7fbf60074aa0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fbf74007fd0 tx=0x7fbf74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.283+0000 7fbf7aa00640 1 -- 172.21.15.17:0/1886475852 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbf7c016030 con 0x7fbf8415fae0 2024-09-10T23:31:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.491+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf840d0250 con 0x7fbf8415fae0 2024-09-10T23:31:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.491+0000 7fbf7aa00640 1 -- 172.21.15.17:0/1886475852 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 161 v161) ==== 95+0+5234 (secure 0 0 0) 0x7fbf7c05e8f0 con 0x7fbf8415fae0 2024-09-10T23:31:22.495 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:22.495 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":161,"btime":"2024-09-10T23:31:22:092426+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1912731352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1912731352},{"type":"v1","addr":"172.21.15.77:6837","nonce":1912731352}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156},{"gid":11448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3122453626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3122453626},{"type":"v1","addr":"172.21.15.17:6834","nonce":3122453626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2814757943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2814757943},{"type":"v1","addr":"172.21.15.17:6835","nonce":2814757943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[{"mdsmap":{"epoch":161,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:18.471461+0000","modified":"2024-09-10T23:31:21.496202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11463":{"gid":11463,"name":"d","rank":0,"incarnation":157,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/20480727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":20480727},{"type":"v1","addr":"172.21.15.77:6836","nonce":20480727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11463,"qdb_cluster":[11463]},"id":15}]} 2024-09-10T23:31:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 161 2024-09-10T23:31:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf600725e0 msgr2=0x7fbf60074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf600725e0 0x7fbf60074aa0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fbf74007fd0 tx=0x7fbf74009040 comp rx=0 tx=0).stop 2024-09-10T23:31:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415fae0 msgr2=0x7fbf841fbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415fae0 0x7fbf841fbc10 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00ea20 tx=0x7fbf7c00eee0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 shutdown_connections 2024-09-10T23:31:22.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbf600725e0 0x7fbf60074aa0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf8415fae0 0x7fbf841fbc10 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf840ce370 0x7fbf841fb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 --2- 172.21.15.17:0/1886475852 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf84069510 0x7fbf8414be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 >> 172.21.15.17:0/1886475852 conn(0x7fbf840ccf70 msgr2=0x7fbf84073af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 shutdown_connections 2024-09-10T23:31:22.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.495+0000 7fbf89600640 1 -- 172.21.15.17:0/1886475852 wait complete. 2024-09-10T23:31:22.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.663+0000 7f81f1600640 1 -- 172.21.15.17:0/2506654122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81d0004810 msgr2=0x7f81d0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.663+0000 7f81f1600640 1 --2- 172.21.15.17:0/2506654122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81d0004810 0x7f81d0004c90 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0b1270 tx=0x7f81d401ce70 comp rx=0 tx=0).stop 2024-09-10T23:31:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.663+0000 7f81f1600640 1 -- 172.21.15.17:0/2506654122 shutdown_connections 2024-09-10T23:31:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.663+0000 7f81f1600640 1 --2- 172.21.15.17:0/2506654122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81d0004810 0x7f81d0004c90 unknown :-1 s=CLOSED pgs=2434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.663+0000 7f81f1600640 1 -- 172.21.15.17:0/2506654122 >> 172.21.15.17:0/2506654122 conn(0x7f81ec0d1da0 msgr2=0x7f81ec0d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.663+0000 7f81f1600640 1 -- 172.21.15.17:0/2506654122 shutdown_connections 2024-09-10T23:31:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.663+0000 7f81f1600640 1 -- 172.21.15.17:0/2506654122 wait complete. 2024-09-10T23:31:22.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.663+0000 7f81f1600640 1 Processor -- start 2024-09-10T23:31:22.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.663+0000 7f81f1600640 1 -- start start 2024-09-10T23:31:22.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81f1600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0004810 0x7f81ec0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81f1600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81ec0cad80 0x7f81ec1f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81f1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81ec1fba50 0x7f81ec1fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81f1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec0b1880 con 0x7f81ec1fba50 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81f1600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec0b1700 con 0x7f81d0004810 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81f1600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f81ec0b1a00 con 0x7f81ec0cad80 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81ec1fba50 0x7f81ec1fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81ec1fba50 0x7f81ec1fbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44268/0 (socket says 172.21.15.17:44268) 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eb400640 1 -- 172.21.15.17:0/2520414769 learned_addr learned my addr 172.21.15.17:0/2520414769 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81e3e00640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81ec0cad80 0x7f81ec1f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eaa00640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0004810 0x7f81ec0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eb400640 1 -- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81ec0cad80 msgr2=0x7f81ec1f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eb400640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81ec0cad80 0x7f81ec1f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eb400640 1 -- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0004810 msgr2=0x7f81ec0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eb400640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0004810 0x7f81ec0b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eb400640 1 -- 172.21.15.17:0/2520414769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec0cb580 con 0x7f81ec1fba50 2024-09-10T23:31:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81eb400640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81ec1fba50 0x7f81ec1fbed0 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f81e4010a90 tx=0x7f81e4010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81e2a00640 1 -- 172.21.15.17:0/2520414769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4003d90 con 0x7f81ec1fba50 2024-09-10T23:31:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81e2a00640 1 -- 172.21.15.17:0/2520414769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81e4015070 con 0x7f81ec1fba50 2024-09-10T23:31:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81e2a00640 1 -- 172.21.15.17:0/2520414769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e400eca0 con 0x7f81ec1fba50 2024-09-10T23:31:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec0cb860 con 0x7f81ec1fba50 2024-09-10T23:31:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec1fb530 con 0x7f81ec1fba50 2024-09-10T23:31:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.667+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ec1fb730 con 0x7f81ec1fba50 2024-09-10T23:31:22.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.671+0000 7f81e2a00640 1 -- 172.21.15.17:0/2520414769 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f81e4004050 con 0x7f81ec1fba50 2024-09-10T23:31:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.671+0000 7f81e2a00640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81c8072610 0x7f81c8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:22.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.671+0000 7f81e2a00640 1 -- 172.21.15.17:0/2520414769 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f81e4093860 con 0x7f81ec1fba50 2024-09-10T23:31:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.671+0000 7f81eaa00640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81c8072610 0x7f81c8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:22.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.671+0000 7f81eaa00640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81c8072610 0x7f81c8074ad0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f81dc000c10 tx=0x7f81dc006b50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.675+0000 7f81e2a00640 1 -- 172.21.15.17:0/2520414769 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f81ec1fb730 con 0x7f81ec1fba50 2024-09-10T23:31:22.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.851+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81ec0b1f60 con 0x7f81ec1fba50 2024-09-10T23:31:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.851+0000 7f81e2a00640 1 -- 172.21.15.17:0/2520414769 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) ==== 74+0+16952 (secure 0 0 0) 0x7f81e4021070 con 0x7f81ec1fba50 2024-09-10T23:31:22.854 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:22.854 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":212,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:20.076985+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:16.186449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:17.438325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81c8072610 msgr2=0x7f81c8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81c8072610 0x7f81c8074ad0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f81dc000c10 tx=0x7f81dc006b50 comp rx=0 tx=0).stop 2024-09-10T23:31:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81ec1fba50 msgr2=0x7f81ec1fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81ec1fba50 0x7f81ec1fbed0 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f81e4010a90 tx=0x7f81e4010e90 comp rx=0 tx=0).stop 2024-09-10T23:31:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 shutdown_connections 2024-09-10T23:31:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f81c8072610 0x7f81c8074ad0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81ec1fba50 0x7f81ec1fbed0 unknown :-1 s=CLOSED pgs=2435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f81ec0cad80 0x7f81ec1f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 --2- 172.21.15.17:0/2520414769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0004810 0x7f81ec0b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:22.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 >> 172.21.15.17:0/2520414769 conn(0x7f81ec0d1da0 msgr2=0x7f81ec071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:22.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 shutdown_connections 2024-09-10T23:31:22.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:22.855+0000 7f81f1600640 1 -- 172.21.15.17:0/2520414769 wait complete. 2024-09-10T23:31:22.875 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:31:22.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:31:23.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.019+0000 7fd5a0800640 1 -- 172.21.15.17:0/2448835275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5980cfb70 msgr2=0x7fd5980cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.019+0000 7fd5a0800640 1 --2- 172.21.15.17:0/2448835275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5980cfb70 0x7fd5980cff50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009840 tx=0x7fd58c01c7f0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.019+0000 7fd5a0800640 1 -- 172.21.15.17:0/2448835275 shutdown_connections 2024-09-10T23:31:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.019+0000 7fd5a0800640 1 --2- 172.21.15.17:0/2448835275 >> v2:172.21.15.77:3300/0 conn(0x7fd5980b2fc0 0x7fd5980d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.019+0000 7fd5a0800640 1 --2- 172.21.15.17:0/2448835275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5980cfb70 0x7fd5980cff50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.019+0000 7fd5a0800640 1 -- 172.21.15.17:0/2448835275 >> 172.21.15.17:0/2448835275 conn(0x7fd5980d1d40 msgr2=0x7fd5980d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.019+0000 7fd5a0800640 1 -- 172.21.15.17:0/2448835275 shutdown_connections 2024-09-10T23:31:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.019+0000 7fd5a0800640 1 -- 172.21.15.17:0/2448835275 wait complete. 2024-09-10T23:31:23.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 Processor -- start 2024-09-10T23:31:23.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 -- start start 2024-09-10T23:31:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5980b15a0 0x7fd5981661a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5980b2fc0 0x7fd598155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5980cfb70 0x7fd598155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd5980b0a50 con 0x7fd5980cfb70 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5980b08d0 con 0x7fd5980b2fc0 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd598168f60 con 0x7fd5980b15a0 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5980cfb70 0x7fd598155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5980cfb70 0x7fd598155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44278/0 (socket says 172.21.15.17:44278) 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59e800640 1 -- 172.21.15.17:0/3510830748 learned_addr learned my addr 172.21.15.17:0/3510830748 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59d400640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5980b2fc0 0x7fd598155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59de00640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5980b15a0 0x7fd5981661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59e800640 1 -- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5980b15a0 msgr2=0x7fd5981661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59e800640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5980b15a0 0x7fd5981661a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59e800640 1 -- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5980b2fc0 msgr2=0x7fd598155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59e800640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5980b2fc0 0x7fd598155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59e800640 1 -- 172.21.15.17:0/3510830748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5980c7480 con 0x7fd5980cfb70 2024-09-10T23:31:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd59e800640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5980cfb70 0x7fd598155750 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7fd59400cbf0 tx=0x7fd59400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd592000640 1 -- 172.21.15.17:0/3510830748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594016020 con 0x7fd5980cfb70 2024-09-10T23:31:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd592000640 1 -- 172.21.15.17:0/3510830748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd59400ab00 con 0x7fd5980cfb70 2024-09-10T23:31:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd592000640 1 -- 172.21.15.17:0/3510830748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594012420 con 0x7fd5980cfb70 2024-09-10T23:31:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5980c7760 con 0x7fd5980cfb70 2024-09-10T23:31:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.023+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5980c7d20 con 0x7fd5980cfb70 2024-09-10T23:31:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.027+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5980b1a00 con 0x7fd5980cfb70 2024-09-10T23:31:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.027+0000 7fd592000640 1 -- 172.21.15.17:0/3510830748 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd5940125c0 con 0x7fd5980cfb70 2024-09-10T23:31:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.027+0000 7fd592000640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.027+0000 7fd592000640 1 -- 172.21.15.17:0/3510830748 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fd594093a30 con 0x7fd5980cfb70 2024-09-10T23:31:23.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.027+0000 7fd59de00640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.027+0000 7fd59de00640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0af000 tx=0x7fd58c01b030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:23.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.031+0000 7fd592000640 1 -- 172.21.15.17:0/3510830748 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd594020020 con 0x7fd5980cfb70 2024-09-10T23:31:23.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.215+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd59806f8f0 con 0x7fd57c0725e0 2024-09-10T23:31:23.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.223+0000 7fd592000640 1 -- 172.21.15.17:0/3510830748 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251715 (secure 0 0 0) 0x7fd59806f8f0 con 0x7fd57c0725e0 2024-09-10T23:31:23.226 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:23.228 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:31:23.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 msgr2=0x7fd57c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0af000 tx=0x7fd58c01b030 comp rx=0 tx=0).stop 2024-09-10T23:31:23.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5980cfb70 msgr2=0x7fd598155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5980cfb70 0x7fd598155750 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7fd59400cbf0 tx=0x7fd59400cce0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 shutdown_connections 2024-09-10T23:31:23.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd57c0725e0 0x7fd57c074aa0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5980cfb70 0x7fd598155750 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5980b2fc0 0x7fd598155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 --2- 172.21.15.17:0/3510830748 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5980b15a0 0x7fd5981661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 >> 172.21.15.17:0/3510830748 conn(0x7fd5980d1d40 msgr2=0x7fd5980b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:23.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 shutdown_connections 2024-09-10T23:31:23.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.227+0000 7fd5a0800640 1 -- 172.21.15.17:0/3510830748 wait complete. 2024-09-10T23:31:23.247 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":685,"stamp":"2024-09-10T23:31:22.524975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590562,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":544800,"kb_used_data":21988,"kb_used_omap":12,"kb_used_meta":522611,"kb_avail":754429920,"statfs":{"total":773094113280,"available":772536238080,"internally_reserved":0,"allocated":22515712,"data_stored":11195652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":535154225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.472247"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.061879+0000","last_change":"2024-09-10T23:31:18.061879+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.061879+0000","last_undegraded":"2024-09-10T23:31:18.061879+0000","last_fullsized":"2024-09-10T23:31:18.061879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194431+0000","last_change":"2024-09-10T23:31:19.087458+0000","last_active":"2024-09-10T23:31:20.194431+0000","last_peered":"2024-09-10T23:31:20.194431+0000","last_clean":"2024-09-10T23:31:20.194431+0000","last_became_active":"2024-09-10T23:31:19.087143+0000","last_became_peered":"2024-09-10T23:31:19.087143+0000","last_unstale":"2024-09-10T23:31:20.194431+0000","last_undegraded":"2024-09-10T23:31:20.194431+0000","last_fullsized":"2024-09-10T23:31:20.194431+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:41.103255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192394+0000","last_change":"2024-09-10T23:31:19.089631+0000","last_active":"2024-09-10T23:31:20.192394+0000","last_peered":"2024-09-10T23:31:20.192394+0000","last_clean":"2024-09-10T23:31:20.192394+0000","last_became_active":"2024-09-10T23:31:19.089105+0000","last_became_peered":"2024-09-10T23:31:19.089105+0000","last_unstale":"2024-09-10T23:31:20.192394+0000","last_undegraded":"2024-09-10T23:31:20.192394+0000","last_fullsized":"2024-09-10T23:31:20.192394+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192198+0000","last_change":"2024-09-10T23:31:19.087326+0000","last_active":"2024-09-10T23:31:20.192198+0000","last_peered":"2024-09-10T23:31:20.192198+0000","last_clean":"2024-09-10T23:31:20.192198+0000","last_became_active":"2024-09-10T23:31:19.087006+0000","last_became_peered":"2024-09-10T23:31:19.087006+0000","last_unstale":"2024-09-10T23:31:20.192198+0000","last_undegraded":"2024-09-10T23:31:20.192198+0000","last_fullsized":"2024-09-10T23:31:20.192198+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:57.556182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102882+0000","last_change":"2024-09-10T23:31:19.106580+0000","last_active":"2024-09-10T23:31:20.102882+0000","last_peered":"2024-09-10T23:31:20.102882+0000","last_clean":"2024-09-10T23:31:20.102882+0000","last_became_active":"2024-09-10T23:31:19.105999+0000","last_became_peered":"2024-09-10T23:31:19.105999+0000","last_unstale":"2024-09-10T23:31:20.102882+0000","last_undegraded":"2024-09-10T23:31:20.102882+0000","last_fullsized":"2024-09-10T23:31:20.102882+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.026835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.061011+0000","last_change":"2024-09-10T23:31:18.061011+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.061011+0000","last_undegraded":"2024-09-10T23:31:18.061011+0000","last_fullsized":"2024-09-10T23:31:18.061011+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105071+0000","last_change":"2024-09-10T23:31:19.091216+0000","last_active":"2024-09-10T23:31:20.105071+0000","last_peered":"2024-09-10T23:31:20.105071+0000","last_clean":"2024-09-10T23:31:20.105071+0000","last_became_active":"2024-09-10T23:31:19.090918+0000","last_became_peered":"2024-09-10T23:31:19.090918+0000","last_unstale":"2024-09-10T23:31:20.105071+0000","last_undegraded":"2024-09-10T23:31:20.105071+0000","last_fullsized":"2024-09-10T23:31:20.105071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:42.530144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102256+0000","last_change":"2024-09-10T23:31:19.098246+0000","last_active":"2024-09-10T23:31:20.102256+0000","last_peered":"2024-09-10T23:31:20.102256+0000","last_clean":"2024-09-10T23:31:20.102256+0000","last_became_active":"2024-09-10T23:31:19.097975+0000","last_became_peered":"2024-09-10T23:31:19.097975+0000","last_unstale":"2024-09-10T23:31:20.102256+0000","last_undegraded":"2024-09-10T23:31:20.102256+0000","last_fullsized":"2024-09-10T23:31:20.102256+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:40.965172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.060775+0000","last_change":"2024-09-10T23:31:18.060775+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.060775+0000","last_undegraded":"2024-09-10T23:31:18.060775+0000","last_fullsized":"2024-09-10T23:31:18.060775+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192639+0000","last_change":"2024-09-10T23:31:19.098520+0000","last_active":"2024-09-10T23:31:20.192639+0000","last_peered":"2024-09-10T23:31:20.192639+0000","last_clean":"2024-09-10T23:31:20.192639+0000","last_became_active":"2024-09-10T23:31:19.098200+0000","last_became_peered":"2024-09-10T23:31:19.098200+0000","last_unstale":"2024-09-10T23:31:20.192639+0000","last_undegraded":"2024-09-10T23:31:20.192639+0000","last_fullsized":"2024-09-10T23:31:20.192639+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.151774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192798+0000","last_change":"2024-09-10T23:31:19.098678+0000","last_active":"2024-09-10T23:31:20.192798+0000","last_peered":"2024-09-10T23:31:20.192798+0000","last_clean":"2024-09-10T23:31:20.192798+0000","last_became_active":"2024-09-10T23:31:19.098170+0000","last_became_peered":"2024-09-10T23:31:19.098170+0000","last_unstale":"2024-09-10T23:31:20.192798+0000","last_undegraded":"2024-09-10T23:31:20.192798+0000","last_fullsized":"2024-09-10T23:31:20.192798+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:07.897360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.060211+0000","last_change":"2024-09-10T23:31:18.060211+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.060211+0000","last_undegraded":"2024-09-10T23:31:18.060211+0000","last_fullsized":"2024-09-10T23:31:18.060211+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094472+0000","last_change":"2024-09-10T23:31:19.094064+0000","last_active":"2024-09-10T23:31:20.094472+0000","last_peered":"2024-09-10T23:31:20.094472+0000","last_clean":"2024-09-10T23:31:20.094472+0000","last_became_active":"2024-09-10T23:31:19.093135+0000","last_became_peered":"2024-09-10T23:31:19.093135+0000","last_unstale":"2024-09-10T23:31:20.094472+0000","last_undegraded":"2024-09-10T23:31:20.094472+0000","last_fullsized":"2024-09-10T23:31:20.094472+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:50.756718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086960+0000","last_change":"2024-09-10T23:31:19.080589+0000","last_active":"2024-09-10T23:31:20.086960+0000","last_peered":"2024-09-10T23:31:20.086960+0000","last_clean":"2024-09-10T23:31:20.086960+0000","last_became_active":"2024-09-10T23:31:19.077949+0000","last_became_peered":"2024-09-10T23:31:19.077949+0000","last_unstale":"2024-09-10T23:31:20.086960+0000","last_undegraded":"2024-09-10T23:31:20.086960+0000","last_fullsized":"2024-09-10T23:31:20.086960+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:09.621898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198488+0000","last_change":"2024-09-10T23:31:19.101714+0000","last_active":"2024-09-10T23:31:20.198488+0000","last_peered":"2024-09-10T23:31:20.198488+0000","last_clean":"2024-09-10T23:31:20.198488+0000","last_became_active":"2024-09-10T23:31:19.101460+0000","last_became_peered":"2024-09-10T23:31:19.101460+0000","last_unstale":"2024-09-10T23:31:20.198488+0000","last_undegraded":"2024-09-10T23:31:20.198488+0000","last_fullsized":"2024-09-10T23:31:20.198488+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:37.667145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192396+0000","last_change":"2024-09-10T23:31:19.083240+0000","last_active":"2024-09-10T23:31:20.192396+0000","last_peered":"2024-09-10T23:31:20.192396+0000","last_clean":"2024-09-10T23:31:20.192396+0000","last_became_active":"2024-09-10T23:31:19.082969+0000","last_became_peered":"2024-09-10T23:31:19.082969+0000","last_unstale":"2024-09-10T23:31:20.192396+0000","last_undegraded":"2024-09-10T23:31:20.192396+0000","last_fullsized":"2024-09-10T23:31:20.192396+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:01.871980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094849+0000","last_change":"2024-09-10T23:31:19.106578+0000","last_active":"2024-09-10T23:31:20.094849+0000","last_peered":"2024-09-10T23:31:20.094849+0000","last_clean":"2024-09-10T23:31:20.094849+0000","last_became_active":"2024-09-10T23:31:19.105865+0000","last_became_peered":"2024-09-10T23:31:19.105865+0000","last_unstale":"2024-09-10T23:31:20.094849+0000","last_undegraded":"2024-09-10T23:31:20.094849+0000","last_fullsized":"2024-09-10T23:31:20.094849+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:16.330127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192776+0000","last_change":"2024-09-10T23:31:19.082731+0000","last_active":"2024-09-10T23:31:20.192776+0000","last_peered":"2024-09-10T23:31:20.192776+0000","last_clean":"2024-09-10T23:31:20.192776+0000","last_became_active":"2024-09-10T23:31:19.080384+0000","last_became_peered":"2024-09-10T23:31:19.080384+0000","last_unstale":"2024-09-10T23:31:20.192776+0000","last_undegraded":"2024-09-10T23:31:20.192776+0000","last_fullsized":"2024-09-10T23:31:20.192776+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:42.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198839+0000","last_change":"2024-09-10T23:31:19.103536+0000","last_active":"2024-09-10T23:31:20.198839+0000","last_peered":"2024-09-10T23:31:20.198839+0000","last_clean":"2024-09-10T23:31:20.198839+0000","last_became_active":"2024-09-10T23:31:19.102843+0000","last_became_peered":"2024-09-10T23:31:19.102843+0000","last_unstale":"2024-09-10T23:31:20.198839+0000","last_undegraded":"2024-09-10T23:31:20.198839+0000","last_fullsized":"2024-09-10T23:31:20.198839+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:36.001349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194183+0000","last_change":"2024-09-10T23:31:19.099157+0000","last_active":"2024-09-10T23:31:20.194183+0000","last_peered":"2024-09-10T23:31:20.194183+0000","last_clean":"2024-09-10T23:31:20.194183+0000","last_became_active":"2024-09-10T23:31:19.098878+0000","last_became_peered":"2024-09-10T23:31:19.098878+0000","last_unstale":"2024-09-10T23:31:20.194183+0000","last_undegraded":"2024-09-10T23:31:20.194183+0000","last_fullsized":"2024-09-10T23:31:20.194183+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:04.700681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105122+0000","last_change":"2024-09-10T23:31:19.099725+0000","last_active":"2024-09-10T23:31:20.105122+0000","last_peered":"2024-09-10T23:31:20.105122+0000","last_clean":"2024-09-10T23:31:20.105122+0000","last_became_active":"2024-09-10T23:31:19.097618+0000","last_became_peered":"2024-09-10T23:31:19.097618+0000","last_unstale":"2024-09-10T23:31:20.105122+0000","last_undegraded":"2024-09-10T23:31:20.105122+0000","last_fullsized":"2024-09-10T23:31:20.105122+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:50.857332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094498+0000","last_change":"2024-09-10T23:31:19.097297+0000","last_active":"2024-09-10T23:31:20.094498+0000","last_peered":"2024-09-10T23:31:20.094498+0000","last_clean":"2024-09-10T23:31:20.094498+0000","last_became_active":"2024-09-10T23:31:19.097013+0000","last_became_peered":"2024-09-10T23:31:19.097013+0000","last_unstale":"2024-09-10T23:31:20.094498+0000","last_undegraded":"2024-09-10T23:31:20.094498+0000","last_fullsized":"2024-09-10T23:31:20.094498+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:13.020807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198693+0000","last_change":"2024-09-10T23:31:19.104434+0000","last_active":"2024-09-10T23:31:20.198693+0000","last_peered":"2024-09-10T23:31:20.198693+0000","last_clean":"2024-09-10T23:31:20.198693+0000","last_became_active":"2024-09-10T23:31:19.102729+0000","last_became_peered":"2024-09-10T23:31:19.102729+0000","last_unstale":"2024-09-10T23:31:20.198693+0000","last_undegraded":"2024-09-10T23:31:20.198693+0000","last_fullsized":"2024-09-10T23:31:20.198693+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:25.236930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094157+0000","last_change":"2024-09-10T23:31:19.092835+0000","last_active":"2024-09-10T23:31:20.094157+0000","last_peered":"2024-09-10T23:31:20.094157+0000","last_clean":"2024-09-10T23:31:20.094157+0000","last_became_active":"2024-09-10T23:31:19.092569+0000","last_became_peered":"2024-09-10T23:31:19.092569+0000","last_unstale":"2024-09-10T23:31:20.094157+0000","last_undegraded":"2024-09-10T23:31:20.094157+0000","last_fullsized":"2024-09-10T23:31:20.094157+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:45.600976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194606+0000","last_change":"2024-09-10T23:31:19.095134+0000","last_active":"2024-09-10T23:31:20.194606+0000","last_peered":"2024-09-10T23:31:20.194606+0000","last_clean":"2024-09-10T23:31:20.194606+0000","last_became_active":"2024-09-10T23:31:19.093338+0000","last_became_peered":"2024-09-10T23:31:19.093338+0000","last_unstale":"2024-09-10T23:31:20.194606+0000","last_undegraded":"2024-09-10T23:31:20.194606+0000","last_fullsized":"2024-09-10T23:31:20.194606+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:24.793170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105453+0000","last_change":"2024-09-10T23:31:19.094860+0000","last_active":"2024-09-10T23:31:20.105453+0000","last_peered":"2024-09-10T23:31:20.105453+0000","last_clean":"2024-09-10T23:31:20.105453+0000","last_became_active":"2024-09-10T23:31:19.092128+0000","last_became_peered":"2024-09-10T23:31:19.092128+0000","last_unstale":"2024-09-10T23:31:20.105453+0000","last_undegraded":"2024-09-10T23:31:20.105453+0000","last_fullsized":"2024-09-10T23:31:20.105453+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:22.506375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102610+0000","last_change":"2024-09-10T23:31:19.109738+0000","last_active":"2024-09-10T23:31:20.102610+0000","last_peered":"2024-09-10T23:31:20.102610+0000","last_clean":"2024-09-10T23:31:20.102610+0000","last_became_active":"2024-09-10T23:31:19.109432+0000","last_became_peered":"2024-09-10T23:31:19.109432+0000","last_unstale":"2024-09-10T23:31:20.102610+0000","last_undegraded":"2024-09-10T23:31:20.102610+0000","last_fullsized":"2024-09-10T23:31:20.102610+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:10.827017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.059817+0000","last_change":"2024-09-10T23:31:18.059817+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.059817+0000","last_undegraded":"2024-09-10T23:31:18.059817+0000","last_fullsized":"2024-09-10T23:31:18.059817+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087141+0000","last_change":"2024-09-10T23:31:19.081052+0000","last_active":"2024-09-10T23:31:20.087141+0000","last_peered":"2024-09-10T23:31:20.087141+0000","last_clean":"2024-09-10T23:31:20.087141+0000","last_became_active":"2024-09-10T23:31:19.080723+0000","last_became_peered":"2024-09-10T23:31:19.080723+0000","last_unstale":"2024-09-10T23:31:20.087141+0000","last_undegraded":"2024-09-10T23:31:20.087141+0000","last_fullsized":"2024-09-10T23:31:20.087141+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086951+0000","last_change":"2024-09-10T23:31:19.103280+0000","last_active":"2024-09-10T23:31:20.086951+0000","last_peered":"2024-09-10T23:31:20.086951+0000","last_clean":"2024-09-10T23:31:20.086951+0000","last_became_active":"2024-09-10T23:31:19.102558+0000","last_became_peered":"2024-09-10T23:31:19.102558+0000","last_unstale":"2024-09-10T23:31:20.086951+0000","last_undegraded":"2024-09-10T23:31:20.086951+0000","last_fullsized":"2024-09-10T23:31:20.086951+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193133+0000","last_change":"2024-09-10T23:31:19.093287+0000","last_active":"2024-09-10T23:31:20.193133+0000","last_peered":"2024-09-10T23:31:20.193133+0000","last_clean":"2024-09-10T23:31:20.193133+0000","last_became_active":"2024-09-10T23:31:19.093017+0000","last_became_peered":"2024-09-10T23:31:19.093017+0000","last_unstale":"2024-09-10T23:31:20.193133+0000","last_undegraded":"2024-09-10T23:31:20.193133+0000","last_fullsized":"2024-09-10T23:31:20.193133+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:33.239210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.059426+0000","last_change":"2024-09-10T23:31:18.059426+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.059426+0000","last_undegraded":"2024-09-10T23:31:18.059426+0000","last_fullsized":"2024-09-10T23:31:18.059426+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192217+0000","last_change":"2024-09-10T23:31:19.093746+0000","last_active":"2024-09-10T23:31:20.192217+0000","last_peered":"2024-09-10T23:31:20.192217+0000","last_clean":"2024-09-10T23:31:20.192217+0000","last_became_active":"2024-09-10T23:31:19.093431+0000","last_became_peered":"2024-09-10T23:31:19.093431+0000","last_unstale":"2024-09-10T23:31:20.192217+0000","last_undegraded":"2024-09-10T23:31:20.192217+0000","last_fullsized":"2024-09-10T23:31:20.192217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:53.986164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.078584+0000","last_change":"2024-09-10T23:31:18.076743+0000","last_active":"2024-09-10T23:31:18.078584+0000","last_peered":"2024-09-10T23:31:18.078584+0000","last_clean":"2024-09-10T23:31:18.078584+0000","last_became_active":"2024-09-10T23:31:18.076117+0000","last_became_peered":"2024-09-10T23:31:18.076117+0000","last_unstale":"2024-09-10T23:31:18.078584+0000","last_undegraded":"2024-09-10T23:31:18.078584+0000","last_fullsized":"2024-09-10T23:31:18.078584+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198594+0000","last_change":"2024-09-10T23:31:19.110826+0000","last_active":"2024-09-10T23:31:20.198594+0000","last_peered":"2024-09-10T23:31:20.198594+0000","last_clean":"2024-09-10T23:31:20.198594+0000","last_became_active":"2024-09-10T23:31:19.110510+0000","last_became_peered":"2024-09-10T23:31:19.110510+0000","last_unstale":"2024-09-10T23:31:20.198594+0000","last_undegraded":"2024-09-10T23:31:20.198594+0000","last_fullsized":"2024-09-10T23:31:20.198594+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:00.524828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094383+0000","last_change":"2024-09-10T23:31:18.084510+0000","last_active":"2024-09-10T23:31:20.094383+0000","last_peered":"2024-09-10T23:31:20.094383+0000","last_clean":"2024-09-10T23:31:20.094383+0000","last_became_active":"2024-09-10T23:31:18.084162+0000","last_became_peered":"2024-09-10T23:31:18.084162+0000","last_unstale":"2024-09-10T23:31:20.094383+0000","last_undegraded":"2024-09-10T23:31:20.094383+0000","last_fullsized":"2024-09-10T23:31:20.094383+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.097899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.066071+0000","last_change":"2024-09-10T23:31:18.066071+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.066071+0000","last_undegraded":"2024-09-10T23:31:18.066071+0000","last_fullsized":"2024-09-10T23:31:18.066071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087404+0000","last_change":"2024-09-10T23:31:18.073162+0000","last_active":"2024-09-10T23:31:20.087404+0000","last_peered":"2024-09-10T23:31:20.087404+0000","last_clean":"2024-09-10T23:31:20.087404+0000","last_became_active":"2024-09-10T23:31:18.072848+0000","last_became_peered":"2024-09-10T23:31:18.072848+0000","last_unstale":"2024-09-10T23:31:20.087404+0000","last_undegraded":"2024-09-10T23:31:20.087404+0000","last_fullsized":"2024-09-10T23:31:20.087404+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:43.878999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087312+0000","last_change":"2024-09-10T23:31:19.086134+0000","last_active":"2024-09-10T23:31:20.087312+0000","last_peered":"2024-09-10T23:31:20.087312+0000","last_clean":"2024-09-10T23:31:20.087312+0000","last_became_active":"2024-09-10T23:31:19.085823+0000","last_became_peered":"2024-09-10T23:31:19.085823+0000","last_unstale":"2024-09-10T23:31:20.087312+0000","last_undegraded":"2024-09-10T23:31:20.087312+0000","last_fullsized":"2024-09-10T23:31:20.087312+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198587+0000","last_change":"2024-09-10T23:31:18.085745+0000","last_active":"2024-09-10T23:31:20.198587+0000","last_peered":"2024-09-10T23:31:20.198587+0000","last_clean":"2024-09-10T23:31:20.198587+0000","last_became_active":"2024-09-10T23:31:18.085478+0000","last_became_peered":"2024-09-10T23:31:18.085478+0000","last_unstale":"2024-09-10T23:31:20.198587+0000","last_undegraded":"2024-09-10T23:31:20.198587+0000","last_fullsized":"2024-09-10T23:31:20.198587+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105410+0000","last_change":"2024-09-10T23:31:19.106907+0000","last_active":"2024-09-10T23:31:20.105410+0000","last_peered":"2024-09-10T23:31:20.105410+0000","last_clean":"2024-09-10T23:31:20.105410+0000","last_became_active":"2024-09-10T23:31:19.106522+0000","last_became_peered":"2024-09-10T23:31:19.106522+0000","last_unstale":"2024-09-10T23:31:20.105410+0000","last_undegraded":"2024-09-10T23:31:20.105410+0000","last_fullsized":"2024-09-10T23:31:20.105410+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:18.131377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087064+0000","last_change":"2024-09-10T23:31:18.072466+0000","last_active":"2024-09-10T23:31:20.087064+0000","last_peered":"2024-09-10T23:31:20.087064+0000","last_clean":"2024-09-10T23:31:20.087064+0000","last_became_active":"2024-09-10T23:31:18.071711+0000","last_became_peered":"2024-09-10T23:31:18.071711+0000","last_unstale":"2024-09-10T23:31:20.087064+0000","last_undegraded":"2024-09-10T23:31:20.087064+0000","last_fullsized":"2024-09-10T23:31:20.087064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:10.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192519+0000","last_change":"2024-09-10T23:31:19.081454+0000","last_active":"2024-09-10T23:31:20.192519+0000","last_peered":"2024-09-10T23:31:20.192519+0000","last_clean":"2024-09-10T23:31:20.192519+0000","last_became_active":"2024-09-10T23:31:19.080030+0000","last_became_peered":"2024-09-10T23:31:19.080030+0000","last_unstale":"2024-09-10T23:31:20.192519+0000","last_undegraded":"2024-09-10T23:31:20.192519+0000","last_fullsized":"2024-09-10T23:31:20.192519+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:55.794776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192620+0000","last_change":"2024-09-10T23:31:18.071545+0000","last_active":"2024-09-10T23:31:20.192620+0000","last_peered":"2024-09-10T23:31:20.192620+0000","last_clean":"2024-09-10T23:31:20.192620+0000","last_became_active":"2024-09-10T23:31:18.070999+0000","last_became_peered":"2024-09-10T23:31:18.070999+0000","last_unstale":"2024-09-10T23:31:20.192620+0000","last_undegraded":"2024-09-10T23:31:20.192620+0000","last_fullsized":"2024-09-10T23:31:20.192620+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:13.320251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102930+0000","last_change":"2024-09-10T23:31:19.108690+0000","last_active":"2024-09-10T23:31:20.102930+0000","last_peered":"2024-09-10T23:31:20.102930+0000","last_clean":"2024-09-10T23:31:20.102930+0000","last_became_active":"2024-09-10T23:31:19.108427+0000","last_became_peered":"2024-09-10T23:31:19.108427+0000","last_unstale":"2024-09-10T23:31:20.102930+0000","last_undegraded":"2024-09-10T23:31:20.102930+0000","last_fullsized":"2024-09-10T23:31:20.102930+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:46.359285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.073823+0000","last_change":"2024-09-10T23:31:18.068409+0000","last_active":"2024-09-10T23:31:18.073823+0000","last_peered":"2024-09-10T23:31:18.073823+0000","last_clean":"2024-09-10T23:31:18.073823+0000","last_became_active":"2024-09-10T23:31:18.068106+0000","last_became_peered":"2024-09-10T23:31:18.068106+0000","last_unstale":"2024-09-10T23:31:18.073823+0000","last_undegraded":"2024-09-10T23:31:18.073823+0000","last_fullsized":"2024-09-10T23:31:18.073823+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:01.406376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105021+0000","last_change":"2024-09-10T23:31:19.100589+0000","last_active":"2024-09-10T23:31:20.105021+0000","last_peered":"2024-09-10T23:31:20.105021+0000","last_clean":"2024-09-10T23:31:20.105021+0000","last_became_active":"2024-09-10T23:31:19.100313+0000","last_became_peered":"2024-09-10T23:31:19.100313+0000","last_unstale":"2024-09-10T23:31:20.105021+0000","last_undegraded":"2024-09-10T23:31:20.105021+0000","last_fullsized":"2024-09-10T23:31:20.105021+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:27.446745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087425+0000","last_change":"2024-09-10T23:31:18.077014+0000","last_active":"2024-09-10T23:31:20.087425+0000","last_peered":"2024-09-10T23:31:20.087425+0000","last_clean":"2024-09-10T23:31:20.087425+0000","last_became_active":"2024-09-10T23:31:18.076754+0000","last_became_peered":"2024-09-10T23:31:18.076754+0000","last_unstale":"2024-09-10T23:31:20.087425+0000","last_undegraded":"2024-09-10T23:31:20.087425+0000","last_fullsized":"2024-09-10T23:31:20.087425+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:27.536844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094124+0000","last_change":"2024-09-10T23:31:19.098486+0000","last_active":"2024-09-10T23:31:20.094124+0000","last_peered":"2024-09-10T23:31:20.094124+0000","last_clean":"2024-09-10T23:31:20.094124+0000","last_became_active":"2024-09-10T23:31:19.098206+0000","last_became_peered":"2024-09-10T23:31:19.098206+0000","last_unstale":"2024-09-10T23:31:20.094124+0000","last_undegraded":"2024-09-10T23:31:20.094124+0000","last_fullsized":"2024-09-10T23:31:20.094124+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:35.669124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192768+0000","last_change":"2024-09-10T23:31:18.079188+0000","last_active":"2024-09-10T23:31:20.192768+0000","last_peered":"2024-09-10T23:31:20.192768+0000","last_clean":"2024-09-10T23:31:20.192768+0000","last_became_active":"2024-09-10T23:31:18.078875+0000","last_became_peered":"2024-09-10T23:31:18.078875+0000","last_unstale":"2024-09-10T23:31:20.192768+0000","last_undegraded":"2024-09-10T23:31:20.192768+0000","last_fullsized":"2024-09-10T23:31:20.192768+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:21.354649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192579+0000","last_change":"2024-09-10T23:31:19.107187+0000","last_active":"2024-09-10T23:31:20.192579+0000","last_peered":"2024-09-10T23:31:20.192579+0000","last_clean":"2024-09-10T23:31:20.192579+0000","last_became_active":"2024-09-10T23:31:19.106681+0000","last_became_peered":"2024-09-10T23:31:19.106681+0000","last_unstale":"2024-09-10T23:31:20.192579+0000","last_undegraded":"2024-09-10T23:31:20.192579+0000","last_fullsized":"2024-09-10T23:31:20.192579+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.920623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"211'3","reported_seq":18,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102559+0000","last_change":"2024-09-10T23:31:18.073660+0000","last_active":"2024-09-10T23:31:20.102559+0000","last_peered":"2024-09-10T23:31:20.102559+0000","last_clean":"2024-09-10T23:31:20.102559+0000","last_became_active":"2024-09-10T23:31:18.072881+0000","last_became_peered":"2024-09-10T23:31:18.072881+0000","last_unstale":"2024-09-10T23:31:20.102559+0000","last_undegraded":"2024-09-10T23:31:20.102559+0000","last_fullsized":"2024-09-10T23:31:20.102559+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:17.944201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105092+0000","last_change":"2024-09-10T23:31:19.096083+0000","last_active":"2024-09-10T23:31:20.105092+0000","last_peered":"2024-09-10T23:31:20.105092+0000","last_clean":"2024-09-10T23:31:20.105092+0000","last_became_active":"2024-09-10T23:31:19.095779+0000","last_became_peered":"2024-09-10T23:31:19.095779+0000","last_unstale":"2024-09-10T23:31:20.105092+0000","last_undegraded":"2024-09-10T23:31:20.105092+0000","last_fullsized":"2024-09-10T23:31:20.105092+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:50.287034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.072525+0000","last_change":"2024-09-10T23:31:18.065614+0000","last_active":"2024-09-10T23:31:18.072525+0000","last_peered":"2024-09-10T23:31:18.072525+0000","last_clean":"2024-09-10T23:31:18.072525+0000","last_became_active":"2024-09-10T23:31:18.065239+0000","last_became_peered":"2024-09-10T23:31:18.065239+0000","last_unstale":"2024-09-10T23:31:18.072525+0000","last_undegraded":"2024-09-10T23:31:18.072525+0000","last_fullsized":"2024-09-10T23:31:18.072525+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:16.379329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193990+0000","last_change":"2024-09-10T23:31:19.090713+0000","last_active":"2024-09-10T23:31:20.193990+0000","last_peered":"2024-09-10T23:31:20.193990+0000","last_clean":"2024-09-10T23:31:20.193990+0000","last_became_active":"2024-09-10T23:31:19.089009+0000","last_became_peered":"2024-09-10T23:31:19.089009+0000","last_unstale":"2024-09-10T23:31:20.193990+0000","last_undegraded":"2024-09-10T23:31:20.193990+0000","last_fullsized":"2024-09-10T23:31:20.193990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:07.556427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198523+0000","last_change":"2024-09-10T23:31:18.082553+0000","last_active":"2024-09-10T23:31:20.198523+0000","last_peered":"2024-09-10T23:31:20.198523+0000","last_clean":"2024-09-10T23:31:20.198523+0000","last_became_active":"2024-09-10T23:31:18.082228+0000","last_became_peered":"2024-09-10T23:31:18.082228+0000","last_unstale":"2024-09-10T23:31:20.198523+0000","last_undegraded":"2024-09-10T23:31:20.198523+0000","last_fullsized":"2024-09-10T23:31:20.198523+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:41.522911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105367+0000","last_change":"2024-09-10T23:31:19.094510+0000","last_active":"2024-09-10T23:31:20.105367+0000","last_peered":"2024-09-10T23:31:20.105367+0000","last_clean":"2024-09-10T23:31:20.105367+0000","last_became_active":"2024-09-10T23:31:19.092810+0000","last_became_peered":"2024-09-10T23:31:19.092810+0000","last_unstale":"2024-09-10T23:31:20.105367+0000","last_undegraded":"2024-09-10T23:31:20.105367+0000","last_fullsized":"2024-09-10T23:31:20.105367+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:22.361882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102270+0000","last_change":"2024-09-10T23:31:18.086364+0000","last_active":"2024-09-10T23:31:20.102270+0000","last_peered":"2024-09-10T23:31:20.102270+0000","last_clean":"2024-09-10T23:31:20.102270+0000","last_became_active":"2024-09-10T23:31:18.086107+0000","last_became_peered":"2024-09-10T23:31:18.086107+0000","last_unstale":"2024-09-10T23:31:20.102270+0000","last_undegraded":"2024-09-10T23:31:20.102270+0000","last_fullsized":"2024-09-10T23:31:20.102270+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:20.135593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198696+0000","last_change":"2024-09-10T23:31:19.107551+0000","last_active":"2024-09-10T23:31:20.198696+0000","last_peered":"2024-09-10T23:31:20.198696+0000","last_clean":"2024-09-10T23:31:20.198696+0000","last_became_active":"2024-09-10T23:31:19.107264+0000","last_became_peered":"2024-09-10T23:31:19.107264+0000","last_unstale":"2024-09-10T23:31:20.198696+0000","last_undegraded":"2024-09-10T23:31:20.198696+0000","last_fullsized":"2024-09-10T23:31:20.198696+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:06.312069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102064+0000","last_change":"2024-09-10T23:31:18.081471+0000","last_active":"2024-09-10T23:31:20.102064+0000","last_peered":"2024-09-10T23:31:20.102064+0000","last_clean":"2024-09-10T23:31:20.102064+0000","last_became_active":"2024-09-10T23:31:18.080940+0000","last_became_peered":"2024-09-10T23:31:18.080940+0000","last_unstale":"2024-09-10T23:31:20.102064+0000","last_undegraded":"2024-09-10T23:31:20.102064+0000","last_fullsized":"2024-09-10T23:31:20.102064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:43.514503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102911+0000","last_change":"2024-09-10T23:31:19.105155+0000","last_active":"2024-09-10T23:31:20.102911+0000","last_peered":"2024-09-10T23:31:20.102911+0000","last_clean":"2024-09-10T23:31:20.102911+0000","last_became_active":"2024-09-10T23:31:19.104892+0000","last_became_peered":"2024-09-10T23:31:19.104892+0000","last_unstale":"2024-09-10T23:31:20.102911+0000","last_undegraded":"2024-09-10T23:31:20.102911+0000","last_fullsized":"2024-09-10T23:31:20.102911+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:37.315477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"211'8","reported_seq":23,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192327+0000","last_change":"2024-09-10T23:31:18.080071+0000","last_active":"2024-09-10T23:31:20.192327+0000","last_peered":"2024-09-10T23:31:20.192327+0000","last_clean":"2024-09-10T23:31:20.192327+0000","last_became_active":"2024-09-10T23:31:18.079813+0000","last_became_peered":"2024-09-10T23:31:18.079813+0000","last_unstale":"2024-09-10T23:31:20.192327+0000","last_undegraded":"2024-09-10T23:31:20.192327+0000","last_fullsized":"2024-09-10T23:31:20.192327+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:25.626605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102174+0000","last_change":"2024-09-10T23:31:19.102720+0000","last_active":"2024-09-10T23:31:20.102174+0000","last_peered":"2024-09-10T23:31:20.102174+0000","last_clean":"2024-09-10T23:31:20.102174+0000","last_became_active":"2024-09-10T23:31:19.102397+0000","last_became_peered":"2024-09-10T23:31:19.102397+0000","last_unstale":"2024-09-10T23:31:20.102174+0000","last_undegraded":"2024-09-10T23:31:20.102174+0000","last_fullsized":"2024-09-10T23:31:20.102174+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.681149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.075407+0000","last_change":"2024-09-10T23:31:18.073203+0000","last_active":"2024-09-10T23:31:18.075407+0000","last_peered":"2024-09-10T23:31:18.075407+0000","last_clean":"2024-09-10T23:31:18.075407+0000","last_became_active":"2024-09-10T23:31:18.072769+0000","last_became_peered":"2024-09-10T23:31:18.072769+0000","last_unstale":"2024-09-10T23:31:18.075407+0000","last_undegraded":"2024-09-10T23:31:18.075407+0000","last_fullsized":"2024-09-10T23:31:18.075407+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:49.230178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102172+0000","last_change":"2024-09-10T23:31:19.104376+0000","last_active":"2024-09-10T23:31:20.102172+0000","last_peered":"2024-09-10T23:31:20.102172+0000","last_clean":"2024-09-10T23:31:20.102172+0000","last_became_active":"2024-09-10T23:31:19.102719+0000","last_became_peered":"2024-09-10T23:31:19.102719+0000","last_unstale":"2024-09-10T23:31:20.102172+0000","last_undegraded":"2024-09-10T23:31:20.102172+0000","last_fullsized":"2024-09-10T23:31:20.102172+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:56.299808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194495+0000","last_change":"2024-09-10T23:31:18.074043+0000","last_active":"2024-09-10T23:31:20.194495+0000","last_peered":"2024-09-10T23:31:20.194495+0000","last_clean":"2024-09-10T23:31:20.194495+0000","last_became_active":"2024-09-10T23:31:18.073766+0000","last_became_peered":"2024-09-10T23:31:18.073766+0000","last_unstale":"2024-09-10T23:31:20.194495+0000","last_undegraded":"2024-09-10T23:31:20.194495+0000","last_fullsized":"2024-09-10T23:31:20.194495+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:41.950907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193217+0000","last_change":"2024-09-10T23:31:19.102248+0000","last_active":"2024-09-10T23:31:20.193217+0000","last_peered":"2024-09-10T23:31:20.193217+0000","last_clean":"2024-09-10T23:31:20.193217+0000","last_became_active":"2024-09-10T23:31:19.101921+0000","last_became_peered":"2024-09-10T23:31:19.101921+0000","last_unstale":"2024-09-10T23:31:20.193217+0000","last_undegraded":"2024-09-10T23:31:20.193217+0000","last_fullsized":"2024-09-10T23:31:20.193217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:33.277637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094509+0000","last_change":"2024-09-10T23:31:18.084654+0000","last_active":"2024-09-10T23:31:20.094509+0000","last_peered":"2024-09-10T23:31:20.094509+0000","last_clean":"2024-09-10T23:31:20.094509+0000","last_became_active":"2024-09-10T23:31:18.084150+0000","last_became_peered":"2024-09-10T23:31:18.084150+0000","last_unstale":"2024-09-10T23:31:20.094509+0000","last_undegraded":"2024-09-10T23:31:20.094509+0000","last_fullsized":"2024-09-10T23:31:20.094509+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:28.813302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192910+0000","last_change":"2024-09-10T23:31:19.107063+0000","last_active":"2024-09-10T23:31:20.192910+0000","last_peered":"2024-09-10T23:31:20.192910+0000","last_clean":"2024-09-10T23:31:20.192910+0000","last_became_active":"2024-09-10T23:31:19.106793+0000","last_became_peered":"2024-09-10T23:31:19.106793+0000","last_unstale":"2024-09-10T23:31:20.192910+0000","last_undegraded":"2024-09-10T23:31:20.192910+0000","last_fullsized":"2024-09-10T23:31:20.192910+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:58.414351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198722+0000","last_change":"2024-09-10T23:31:18.075017+0000","last_active":"2024-09-10T23:31:20.198722+0000","last_peered":"2024-09-10T23:31:20.198722+0000","last_clean":"2024-09-10T23:31:20.198722+0000","last_became_active":"2024-09-10T23:31:18.073860+0000","last_became_peered":"2024-09-10T23:31:18.073860+0000","last_unstale":"2024-09-10T23:31:20.198722+0000","last_undegraded":"2024-09-10T23:31:20.198722+0000","last_fullsized":"2024-09-10T23:31:20.198722+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:09.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192182+0000","last_change":"2024-09-10T23:31:19.084774+0000","last_active":"2024-09-10T23:31:20.192182+0000","last_peered":"2024-09-10T23:31:20.192182+0000","last_clean":"2024-09-10T23:31:20.192182+0000","last_became_active":"2024-09-10T23:31:19.083516+0000","last_became_peered":"2024-09-10T23:31:19.083516+0000","last_unstale":"2024-09-10T23:31:20.192182+0000","last_undegraded":"2024-09-10T23:31:20.192182+0000","last_fullsized":"2024-09-10T23:31:20.192182+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193021+0000","last_change":"2024-09-10T23:31:18.070568+0000","last_active":"2024-09-10T23:31:20.193021+0000","last_peered":"2024-09-10T23:31:20.193021+0000","last_clean":"2024-09-10T23:31:20.193021+0000","last_became_active":"2024-09-10T23:31:18.070110+0000","last_became_peered":"2024-09-10T23:31:18.070110+0000","last_unstale":"2024-09-10T23:31:20.193021+0000","last_undegraded":"2024-09-10T23:31:20.193021+0000","last_fullsized":"2024-09-10T23:31:20.193021+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:17.124144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194213+0000","last_change":"2024-09-10T23:31:19.094490+0000","last_active":"2024-09-10T23:31:20.194213+0000","last_peered":"2024-09-10T23:31:20.194213+0000","last_clean":"2024-09-10T23:31:20.194213+0000","last_became_active":"2024-09-10T23:31:19.094236+0000","last_became_peered":"2024-09-10T23:31:19.094236+0000","last_unstale":"2024-09-10T23:31:20.194213+0000","last_undegraded":"2024-09-10T23:31:20.194213+0000","last_fullsized":"2024-09-10T23:31:20.194213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:28.628059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094462+0000","last_change":"2024-09-10T23:31:18.068183+0000","last_active":"2024-09-10T23:31:20.094462+0000","last_peered":"2024-09-10T23:31:20.094462+0000","last_clean":"2024-09-10T23:31:20.094462+0000","last_became_active":"2024-09-10T23:31:18.067814+0000","last_became_peered":"2024-09-10T23:31:18.067814+0000","last_unstale":"2024-09-10T23:31:20.094462+0000","last_undegraded":"2024-09-10T23:31:20.094462+0000","last_fullsized":"2024-09-10T23:31:20.094462+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:42.363754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094491+0000","last_change":"2024-09-10T23:31:19.099060+0000","last_active":"2024-09-10T23:31:20.094491+0000","last_peered":"2024-09-10T23:31:20.094491+0000","last_clean":"2024-09-10T23:31:20.094491+0000","last_became_active":"2024-09-10T23:31:19.098576+0000","last_became_peered":"2024-09-10T23:31:19.098576+0000","last_unstale":"2024-09-10T23:31:20.094491+0000","last_undegraded":"2024-09-10T23:31:20.094491+0000","last_fullsized":"2024-09-10T23:31:20.094491+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:27.428492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093973+0000","last_change":"2024-09-10T23:31:18.076954+0000","last_active":"2024-09-10T23:31:20.093973+0000","last_peered":"2024-09-10T23:31:20.093973+0000","last_clean":"2024-09-10T23:31:20.093973+0000","last_became_active":"2024-09-10T23:31:18.076673+0000","last_became_peered":"2024-09-10T23:31:18.076673+0000","last_unstale":"2024-09-10T23:31:20.093973+0000","last_undegraded":"2024-09-10T23:31:20.093973+0000","last_fullsized":"2024-09-10T23:31:20.093973+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:37.993408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094762+0000","last_change":"2024-09-10T23:31:19.102914+0000","last_active":"2024-09-10T23:31:20.094762+0000","last_peered":"2024-09-10T23:31:20.094762+0000","last_clean":"2024-09-10T23:31:20.094762+0000","last_became_active":"2024-09-10T23:31:19.102662+0000","last_became_peered":"2024-09-10T23:31:19.102662+0000","last_unstale":"2024-09-10T23:31:20.094762+0000","last_undegraded":"2024-09-10T23:31:20.094762+0000","last_fullsized":"2024-09-10T23:31:20.094762+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:03.963145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086835+0000","last_change":"2024-09-10T23:31:18.074711+0000","last_active":"2024-09-10T23:31:20.086835+0000","last_peered":"2024-09-10T23:31:20.086835+0000","last_clean":"2024-09-10T23:31:20.086835+0000","last_became_active":"2024-09-10T23:31:18.074079+0000","last_became_peered":"2024-09-10T23:31:18.074079+0000","last_unstale":"2024-09-10T23:31:20.086835+0000","last_undegraded":"2024-09-10T23:31:20.086835+0000","last_fullsized":"2024-09-10T23:31:20.086835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:21.499142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104963+0000","last_change":"2024-09-10T23:31:19.091779+0000","last_active":"2024-09-10T23:31:20.104963+0000","last_peered":"2024-09-10T23:31:20.104963+0000","last_clean":"2024-09-10T23:31:20.104963+0000","last_became_active":"2024-09-10T23:31:19.091404+0000","last_became_peered":"2024-09-10T23:31:19.091404+0000","last_unstale":"2024-09-10T23:31:20.104963+0000","last_undegraded":"2024-09-10T23:31:20.104963+0000","last_fullsized":"2024-09-10T23:31:20.104963+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:02.528031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192714+0000","last_change":"2024-09-10T23:31:18.082254+0000","last_active":"2024-09-10T23:31:20.192714+0000","last_peered":"2024-09-10T23:31:20.192714+0000","last_clean":"2024-09-10T23:31:20.192714+0000","last_became_active":"2024-09-10T23:31:18.081963+0000","last_became_peered":"2024-09-10T23:31:18.081963+0000","last_unstale":"2024-09-10T23:31:20.192714+0000","last_undegraded":"2024-09-10T23:31:20.192714+0000","last_fullsized":"2024-09-10T23:31:20.192714+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198454+0000","last_change":"2024-09-10T23:31:19.104473+0000","last_active":"2024-09-10T23:31:20.198454+0000","last_peered":"2024-09-10T23:31:20.198454+0000","last_clean":"2024-09-10T23:31:20.198454+0000","last_became_active":"2024-09-10T23:31:19.104186+0000","last_became_peered":"2024-09-10T23:31:19.104186+0000","last_unstale":"2024-09-10T23:31:20.198454+0000","last_undegraded":"2024-09-10T23:31:20.198454+0000","last_fullsized":"2024-09-10T23:31:20.198454+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:20.987147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"212'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104384+0000","last_change":"2024-09-10T23:31:18.079920+0000","last_active":"2024-09-10T23:31:20.104384+0000","last_peered":"2024-09-10T23:31:20.104384+0000","last_clean":"2024-09-10T23:31:20.104384+0000","last_became_active":"2024-09-10T23:31:18.079584+0000","last_became_peered":"2024-09-10T23:31:18.079584+0000","last_unstale":"2024-09-10T23:31:20.104384+0000","last_undegraded":"2024-09-10T23:31:20.104384+0000","last_fullsized":"2024-09-10T23:31:20.104384+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:33.922546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192416+0000","last_change":"2024-09-10T23:31:19.080253+0000","last_active":"2024-09-10T23:31:20.192416+0000","last_peered":"2024-09-10T23:31:20.192416+0000","last_clean":"2024-09-10T23:31:20.192416+0000","last_became_active":"2024-09-10T23:31:19.079908+0000","last_became_peered":"2024-09-10T23:31:19.079908+0000","last_unstale":"2024-09-10T23:31:20.192416+0000","last_undegraded":"2024-09-10T23:31:20.192416+0000","last_fullsized":"2024-09-10T23:31:20.192416+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087252+0000","last_change":"2024-09-10T23:31:18.080655+0000","last_active":"2024-09-10T23:31:20.087252+0000","last_peered":"2024-09-10T23:31:20.087252+0000","last_clean":"2024-09-10T23:31:20.087252+0000","last_became_active":"2024-09-10T23:31:18.080370+0000","last_became_peered":"2024-09-10T23:31:18.080370+0000","last_unstale":"2024-09-10T23:31:20.087252+0000","last_undegraded":"2024-09-10T23:31:20.087252+0000","last_fullsized":"2024-09-10T23:31:20.087252+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:55.916497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102543+0000","last_change":"2024-09-10T23:31:19.106872+0000","last_active":"2024-09-10T23:31:20.102543+0000","last_peered":"2024-09-10T23:31:20.102543+0000","last_clean":"2024-09-10T23:31:20.102543+0000","last_became_active":"2024-09-10T23:31:19.106326+0000","last_became_peered":"2024-09-10T23:31:19.106326+0000","last_unstale":"2024-09-10T23:31:20.102543+0000","last_undegraded":"2024-09-10T23:31:20.102543+0000","last_fullsized":"2024-09-10T23:31:20.102543+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:27.217918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087413+0000","last_change":"2024-09-10T23:31:18.074710+0000","last_active":"2024-09-10T23:31:20.087413+0000","last_peered":"2024-09-10T23:31:20.087413+0000","last_clean":"2024-09-10T23:31:20.087413+0000","last_became_active":"2024-09-10T23:31:18.074405+0000","last_became_peered":"2024-09-10T23:31:18.074405+0000","last_unstale":"2024-09-10T23:31:20.087413+0000","last_undegraded":"2024-09-10T23:31:20.087413+0000","last_fullsized":"2024-09-10T23:31:20.087413+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:46.035443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087213+0000","last_change":"2024-09-10T23:31:19.090048+0000","last_active":"2024-09-10T23:31:20.087213+0000","last_peered":"2024-09-10T23:31:20.087213+0000","last_clean":"2024-09-10T23:31:20.087213+0000","last_became_active":"2024-09-10T23:31:19.088979+0000","last_became_peered":"2024-09-10T23:31:19.088979+0000","last_unstale":"2024-09-10T23:31:20.087213+0000","last_undegraded":"2024-09-10T23:31:20.087213+0000","last_fullsized":"2024-09-10T23:31:20.087213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:43.080975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094212+0000","last_change":"2024-09-10T23:31:18.068905+0000","last_active":"2024-09-10T23:31:20.094212+0000","last_peered":"2024-09-10T23:31:20.094212+0000","last_clean":"2024-09-10T23:31:20.094212+0000","last_became_active":"2024-09-10T23:31:18.068607+0000","last_became_peered":"2024-09-10T23:31:18.068607+0000","last_unstale":"2024-09-10T23:31:20.094212+0000","last_undegraded":"2024-09-10T23:31:20.094212+0000","last_fullsized":"2024-09-10T23:31:20.094212+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:36.784830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.064604+0000","last_change":"2024-09-10T23:31:18.064604+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.064604+0000","last_undegraded":"2024-09-10T23:31:18.064604+0000","last_fullsized":"2024-09-10T23:31:18.064604+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102406+0000","last_change":"2024-09-10T23:31:18.076160+0000","last_active":"2024-09-10T23:31:20.102406+0000","last_peered":"2024-09-10T23:31:20.102406+0000","last_clean":"2024-09-10T23:31:20.102406+0000","last_became_active":"2024-09-10T23:31:18.075439+0000","last_became_peered":"2024-09-10T23:31:18.075439+0000","last_unstale":"2024-09-10T23:31:20.102406+0000","last_undegraded":"2024-09-10T23:31:20.102406+0000","last_fullsized":"2024-09-10T23:31:20.102406+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.238398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194378+0000","last_change":"2024-09-10T23:31:19.087302+0000","last_active":"2024-09-10T23:31:20.194378+0000","last_peered":"2024-09-10T23:31:20.194378+0000","last_clean":"2024-09-10T23:31:20.194378+0000","last_became_active":"2024-09-10T23:31:19.087002+0000","last_became_peered":"2024-09-10T23:31:19.087002+0000","last_unstale":"2024-09-10T23:31:20.194378+0000","last_undegraded":"2024-09-10T23:31:20.194378+0000","last_fullsized":"2024-09-10T23:31:20.194378+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:16.875377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192740+0000","last_change":"2024-09-10T23:31:18.071251+0000","last_active":"2024-09-10T23:31:20.192740+0000","last_peered":"2024-09-10T23:31:20.192740+0000","last_clean":"2024-09-10T23:31:20.192740+0000","last_became_active":"2024-09-10T23:31:18.070638+0000","last_became_peered":"2024-09-10T23:31:18.070638+0000","last_unstale":"2024-09-10T23:31:20.192740+0000","last_undegraded":"2024-09-10T23:31:20.192740+0000","last_fullsized":"2024-09-10T23:31:20.192740+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094695+0000","last_change":"2024-09-10T23:31:19.096247+0000","last_active":"2024-09-10T23:31:20.094695+0000","last_peered":"2024-09-10T23:31:20.094695+0000","last_clean":"2024-09-10T23:31:20.094695+0000","last_became_active":"2024-09-10T23:31:19.095981+0000","last_became_peered":"2024-09-10T23:31:19.095981+0000","last_unstale":"2024-09-10T23:31:20.094695+0000","last_undegraded":"2024-09-10T23:31:20.094695+0000","last_fullsized":"2024-09-10T23:31:20.094695+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:24.795258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093794+0000","last_change":"2024-09-10T23:31:18.072179+0000","last_active":"2024-09-10T23:31:20.093794+0000","last_peered":"2024-09-10T23:31:20.093794+0000","last_clean":"2024-09-10T23:31:20.093794+0000","last_became_active":"2024-09-10T23:31:18.071874+0000","last_became_peered":"2024-09-10T23:31:18.071874+0000","last_unstale":"2024-09-10T23:31:20.093794+0000","last_undegraded":"2024-09-10T23:31:20.093794+0000","last_fullsized":"2024-09-10T23:31:20.093794+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:57.312073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.062253+0000","last_change":"2024-09-10T23:31:18.062253+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.062253+0000","last_undegraded":"2024-09-10T23:31:18.062253+0000","last_fullsized":"2024-09-10T23:31:18.062253+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105346+0000","last_change":"2024-09-10T23:31:18.079488+0000","last_active":"2024-09-10T23:31:20.105346+0000","last_peered":"2024-09-10T23:31:20.105346+0000","last_clean":"2024-09-10T23:31:20.105346+0000","last_became_active":"2024-09-10T23:31:18.077598+0000","last_became_peered":"2024-09-10T23:31:18.077598+0000","last_unstale":"2024-09-10T23:31:20.105346+0000","last_undegraded":"2024-09-10T23:31:20.105346+0000","last_fullsized":"2024-09-10T23:31:20.105346+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:44.046563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":455,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198199+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:31:20.198199+0000","last_peered":"2024-09-10T23:31:20.198199+0000","last_clean":"2024-09-10T23:31:20.198199+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:31:20.198199+0000","last_undegraded":"2024-09-10T23:31:20.198199+0000","last_fullsized":"2024-09-10T23:31:20.198199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":194,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476930,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74004,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297836,"statfs":{"total":96636764160,"available":96560984064,"internally_reserved":0,"allocated":2682880,"data_stored":1259240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509635,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74576,"kb_used_data":3188,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297264,"statfs":{"total":96636764160,"available":96560398336,"internally_reserved":0,"allocated":3264512,"data_stored":1842928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73071050},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509634,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47684,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324156,"statfs":{"total":96636764160,"available":96587935744,"internally_reserved":0,"allocated":2662400,"data_stored":1252436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509635,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74048,"kb_used_data":2604,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297792,"statfs":{"total":96636764160,"available":96560939008,"internally_reserved":0,"allocated":2666496,"data_stored":1252506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74052,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297788,"statfs":{"total":96636764160,"available":96560934912,"internally_reserved":0,"allocated":2670592,"data_stored":1253088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509635,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47676,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324164,"statfs":{"total":96636764160,"available":96587943936,"internally_reserved":0,"allocated":2662400,"data_stored":1252436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78800,"kb_used_data":3192,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293040,"statfs":{"total":96636764160,"available":96556072960,"internally_reserved":0,"allocated":3268608,"data_stored":1844416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73960,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297880,"statfs":{"total":96636764160,"available":96561029120,"internally_reserved":0,"allocated":2637824,"data_stored":1238602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:31:23.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:31:23.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.439+0000 7fba39800640 1 -- 172.21.15.17:0/3126947204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba180051d0 msgr2=0x7fba1800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.439+0000 7fba39800640 1 --2- 172.21.15.17:0/3126947204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba180051d0 0x7fba1800b9d0 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00c660 tx=0x7fba2c01d2e0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.439+0000 7fba39800640 1 -- 172.21.15.17:0/3126947204 shutdown_connections 2024-09-10T23:31:23.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.439+0000 7fba39800640 1 --2- 172.21.15.17:0/3126947204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba180051d0 0x7fba1800b9d0 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.439+0000 7fba39800640 1 -- 172.21.15.17:0/3126947204 >> 172.21.15.17:0/3126947204 conn(0x7fba340d1d40 msgr2=0x7fba340d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:23.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.439+0000 7fba39800640 1 -- 172.21.15.17:0/3126947204 shutdown_connections 2024-09-10T23:31:23.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.439+0000 7fba39800640 1 -- 172.21.15.17:0/3126947204 wait complete. 2024-09-10T23:31:23.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 Processor -- start 2024-09-10T23:31:23.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 -- start start 2024-09-10T23:31:23.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba180051d0 0x7fba340cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba34155040 0x7fba340b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba340c62f0 0x7fba340c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fba340d2bf0 con 0x7fba340c62f0 2024-09-10T23:31:23.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba340d2a70 con 0x7fba34155040 2024-09-10T23:31:23.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fba340ce670 con 0x7fba180051d0 2024-09-10T23:31:23.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba33400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba340c62f0 0x7fba340c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba33400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba340c62f0 0x7fba340c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44300/0 (socket says 172.21.15.17:44300) 2024-09-10T23:31:23.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba33400640 1 -- 172.21.15.17:0/3216961486 learned_addr learned my addr 172.21.15.17:0/3216961486 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:23.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba2be00640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba34155040 0x7fba340b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba32a00640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba180051d0 0x7fba340cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba33400640 1 -- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba180051d0 msgr2=0x7fba340cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba33400640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba180051d0 0x7fba340cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba33400640 1 -- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba34155040 msgr2=0x7fba340b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba33400640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba34155040 0x7fba340b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba33400640 1 -- 172.21.15.17:0/3216961486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba341554c0 con 0x7fba340c62f0 2024-09-10T23:31:23.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba33400640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba340c62f0 0x7fba340c7000 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7fba2c01db80 tx=0x7fba2c0ada50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:23.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba2aa00640 1 -- 172.21.15.17:0/3216961486 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00c280 con 0x7fba340c62f0 2024-09-10T23:31:23.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba2aa00640 1 -- 172.21.15.17:0/3216961486 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba2c003c70 con 0x7fba340c62f0 2024-09-10T23:31:23.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba2aa00640 1 -- 172.21.15.17:0/3216961486 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0020a0 con 0x7fba340c62f0 2024-09-10T23:31:23.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba340b5a90 con 0x7fba340c62f0 2024-09-10T23:31:23.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba340c8e10 con 0x7fba340c62f0 2024-09-10T23:31:23.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.443+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba340cebd0 con 0x7fba340c62f0 2024-09-10T23:31:23.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.447+0000 7fba2aa00640 1 -- 172.21.15.17:0/3216961486 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fba2c0062d0 con 0x7fba340c62f0 2024-09-10T23:31:23.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.447+0000 7fba2aa00640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.447+0000 7fba2aa00640 1 -- 172.21.15.17:0/3216961486 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fba2c12dbc0 con 0x7fba340c62f0 2024-09-10T23:31:23.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.447+0000 7fba32a00640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.447+0000 7fba32a00640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fba3406e000 tx=0x7fba240091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:23.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.451+0000 7fba2aa00640 1 -- 172.21.15.17:0/3216961486 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fba2c017090 con 0x7fba340c62f0 2024-09-10T23:31:23.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.619+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba340b0450 con 0x7fba100725e0 2024-09-10T23:31:23.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.627+0000 7fba2aa00640 1 -- 172.21.15.17:0/3216961486 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251715 (secure 0 0 0) 0x7fba340b0450 con 0x7fba100725e0 2024-09-10T23:31:23.630 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:23.632 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:31:23.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 msgr2=0x7fba10074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fba3406e000 tx=0x7fba240091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba340c62f0 msgr2=0x7fba340c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba340c62f0 0x7fba340c7000 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7fba2c01db80 tx=0x7fba2c0ada50 comp rx=0 tx=0).stop 2024-09-10T23:31:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 shutdown_connections 2024-09-10T23:31:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fba100725e0 0x7fba10074aa0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba340c62f0 0x7fba340c7000 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba34155040 0x7fba340b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 --2- 172.21.15.17:0/3216961486 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba180051d0 0x7fba340cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 >> 172.21.15.17:0/3216961486 conn(0x7fba340d1d40 msgr2=0x7fba340af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 shutdown_connections 2024-09-10T23:31:23.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.631+0000 7fba39800640 1 -- 172.21.15.17:0/3216961486 wait complete. 2024-09-10T23:31:23.651 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":685,"stamp":"2024-09-10T23:31:22.524975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590562,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":544800,"kb_used_data":21988,"kb_used_omap":12,"kb_used_meta":522611,"kb_avail":754429920,"statfs":{"total":773094113280,"available":772536238080,"internally_reserved":0,"allocated":22515712,"data_stored":11195652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":535154225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.472247"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.061879+0000","last_change":"2024-09-10T23:31:18.061879+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.061879+0000","last_undegraded":"2024-09-10T23:31:18.061879+0000","last_fullsized":"2024-09-10T23:31:18.061879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194431+0000","last_change":"2024-09-10T23:31:19.087458+0000","last_active":"2024-09-10T23:31:20.194431+0000","last_peered":"2024-09-10T23:31:20.194431+0000","last_clean":"2024-09-10T23:31:20.194431+0000","last_became_active":"2024-09-10T23:31:19.087143+0000","last_became_peered":"2024-09-10T23:31:19.087143+0000","last_unstale":"2024-09-10T23:31:20.194431+0000","last_undegraded":"2024-09-10T23:31:20.194431+0000","last_fullsized":"2024-09-10T23:31:20.194431+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:41.103255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192394+0000","last_change":"2024-09-10T23:31:19.089631+0000","last_active":"2024-09-10T23:31:20.192394+0000","last_peered":"2024-09-10T23:31:20.192394+0000","last_clean":"2024-09-10T23:31:20.192394+0000","last_became_active":"2024-09-10T23:31:19.089105+0000","last_became_peered":"2024-09-10T23:31:19.089105+0000","last_unstale":"2024-09-10T23:31:20.192394+0000","last_undegraded":"2024-09-10T23:31:20.192394+0000","last_fullsized":"2024-09-10T23:31:20.192394+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192198+0000","last_change":"2024-09-10T23:31:19.087326+0000","last_active":"2024-09-10T23:31:20.192198+0000","last_peered":"2024-09-10T23:31:20.192198+0000","last_clean":"2024-09-10T23:31:20.192198+0000","last_became_active":"2024-09-10T23:31:19.087006+0000","last_became_peered":"2024-09-10T23:31:19.087006+0000","last_unstale":"2024-09-10T23:31:20.192198+0000","last_undegraded":"2024-09-10T23:31:20.192198+0000","last_fullsized":"2024-09-10T23:31:20.192198+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:57.556182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102882+0000","last_change":"2024-09-10T23:31:19.106580+0000","last_active":"2024-09-10T23:31:20.102882+0000","last_peered":"2024-09-10T23:31:20.102882+0000","last_clean":"2024-09-10T23:31:20.102882+0000","last_became_active":"2024-09-10T23:31:19.105999+0000","last_became_peered":"2024-09-10T23:31:19.105999+0000","last_unstale":"2024-09-10T23:31:20.102882+0000","last_undegraded":"2024-09-10T23:31:20.102882+0000","last_fullsized":"2024-09-10T23:31:20.102882+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.026835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.061011+0000","last_change":"2024-09-10T23:31:18.061011+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.061011+0000","last_undegraded":"2024-09-10T23:31:18.061011+0000","last_fullsized":"2024-09-10T23:31:18.061011+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105071+0000","last_change":"2024-09-10T23:31:19.091216+0000","last_active":"2024-09-10T23:31:20.105071+0000","last_peered":"2024-09-10T23:31:20.105071+0000","last_clean":"2024-09-10T23:31:20.105071+0000","last_became_active":"2024-09-10T23:31:19.090918+0000","last_became_peered":"2024-09-10T23:31:19.090918+0000","last_unstale":"2024-09-10T23:31:20.105071+0000","last_undegraded":"2024-09-10T23:31:20.105071+0000","last_fullsized":"2024-09-10T23:31:20.105071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:42.530144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102256+0000","last_change":"2024-09-10T23:31:19.098246+0000","last_active":"2024-09-10T23:31:20.102256+0000","last_peered":"2024-09-10T23:31:20.102256+0000","last_clean":"2024-09-10T23:31:20.102256+0000","last_became_active":"2024-09-10T23:31:19.097975+0000","last_became_peered":"2024-09-10T23:31:19.097975+0000","last_unstale":"2024-09-10T23:31:20.102256+0000","last_undegraded":"2024-09-10T23:31:20.102256+0000","last_fullsized":"2024-09-10T23:31:20.102256+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:40.965172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.060775+0000","last_change":"2024-09-10T23:31:18.060775+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.060775+0000","last_undegraded":"2024-09-10T23:31:18.060775+0000","last_fullsized":"2024-09-10T23:31:18.060775+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192639+0000","last_change":"2024-09-10T23:31:19.098520+0000","last_active":"2024-09-10T23:31:20.192639+0000","last_peered":"2024-09-10T23:31:20.192639+0000","last_clean":"2024-09-10T23:31:20.192639+0000","last_became_active":"2024-09-10T23:31:19.098200+0000","last_became_peered":"2024-09-10T23:31:19.098200+0000","last_unstale":"2024-09-10T23:31:20.192639+0000","last_undegraded":"2024-09-10T23:31:20.192639+0000","last_fullsized":"2024-09-10T23:31:20.192639+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.151774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192798+0000","last_change":"2024-09-10T23:31:19.098678+0000","last_active":"2024-09-10T23:31:20.192798+0000","last_peered":"2024-09-10T23:31:20.192798+0000","last_clean":"2024-09-10T23:31:20.192798+0000","last_became_active":"2024-09-10T23:31:19.098170+0000","last_became_peered":"2024-09-10T23:31:19.098170+0000","last_unstale":"2024-09-10T23:31:20.192798+0000","last_undegraded":"2024-09-10T23:31:20.192798+0000","last_fullsized":"2024-09-10T23:31:20.192798+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:07.897360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.060211+0000","last_change":"2024-09-10T23:31:18.060211+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.060211+0000","last_undegraded":"2024-09-10T23:31:18.060211+0000","last_fullsized":"2024-09-10T23:31:18.060211+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094472+0000","last_change":"2024-09-10T23:31:19.094064+0000","last_active":"2024-09-10T23:31:20.094472+0000","last_peered":"2024-09-10T23:31:20.094472+0000","last_clean":"2024-09-10T23:31:20.094472+0000","last_became_active":"2024-09-10T23:31:19.093135+0000","last_became_peered":"2024-09-10T23:31:19.093135+0000","last_unstale":"2024-09-10T23:31:20.094472+0000","last_undegraded":"2024-09-10T23:31:20.094472+0000","last_fullsized":"2024-09-10T23:31:20.094472+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:50.756718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086960+0000","last_change":"2024-09-10T23:31:19.080589+0000","last_active":"2024-09-10T23:31:20.086960+0000","last_peered":"2024-09-10T23:31:20.086960+0000","last_clean":"2024-09-10T23:31:20.086960+0000","last_became_active":"2024-09-10T23:31:19.077949+0000","last_became_peered":"2024-09-10T23:31:19.077949+0000","last_unstale":"2024-09-10T23:31:20.086960+0000","last_undegraded":"2024-09-10T23:31:20.086960+0000","last_fullsized":"2024-09-10T23:31:20.086960+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:09.621898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198488+0000","last_change":"2024-09-10T23:31:19.101714+0000","last_active":"2024-09-10T23:31:20.198488+0000","last_peered":"2024-09-10T23:31:20.198488+0000","last_clean":"2024-09-10T23:31:20.198488+0000","last_became_active":"2024-09-10T23:31:19.101460+0000","last_became_peered":"2024-09-10T23:31:19.101460+0000","last_unstale":"2024-09-10T23:31:20.198488+0000","last_undegraded":"2024-09-10T23:31:20.198488+0000","last_fullsized":"2024-09-10T23:31:20.198488+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:37.667145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192396+0000","last_change":"2024-09-10T23:31:19.083240+0000","last_active":"2024-09-10T23:31:20.192396+0000","last_peered":"2024-09-10T23:31:20.192396+0000","last_clean":"2024-09-10T23:31:20.192396+0000","last_became_active":"2024-09-10T23:31:19.082969+0000","last_became_peered":"2024-09-10T23:31:19.082969+0000","last_unstale":"2024-09-10T23:31:20.192396+0000","last_undegraded":"2024-09-10T23:31:20.192396+0000","last_fullsized":"2024-09-10T23:31:20.192396+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:01.871980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094849+0000","last_change":"2024-09-10T23:31:19.106578+0000","last_active":"2024-09-10T23:31:20.094849+0000","last_peered":"2024-09-10T23:31:20.094849+0000","last_clean":"2024-09-10T23:31:20.094849+0000","last_became_active":"2024-09-10T23:31:19.105865+0000","last_became_peered":"2024-09-10T23:31:19.105865+0000","last_unstale":"2024-09-10T23:31:20.094849+0000","last_undegraded":"2024-09-10T23:31:20.094849+0000","last_fullsized":"2024-09-10T23:31:20.094849+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:16.330127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192776+0000","last_change":"2024-09-10T23:31:19.082731+0000","last_active":"2024-09-10T23:31:20.192776+0000","last_peered":"2024-09-10T23:31:20.192776+0000","last_clean":"2024-09-10T23:31:20.192776+0000","last_became_active":"2024-09-10T23:31:19.080384+0000","last_became_peered":"2024-09-10T23:31:19.080384+0000","last_unstale":"2024-09-10T23:31:20.192776+0000","last_undegraded":"2024-09-10T23:31:20.192776+0000","last_fullsized":"2024-09-10T23:31:20.192776+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:42.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198839+0000","last_change":"2024-09-10T23:31:19.103536+0000","last_active":"2024-09-10T23:31:20.198839+0000","last_peered":"2024-09-10T23:31:20.198839+0000","last_clean":"2024-09-10T23:31:20.198839+0000","last_became_active":"2024-09-10T23:31:19.102843+0000","last_became_peered":"2024-09-10T23:31:19.102843+0000","last_unstale":"2024-09-10T23:31:20.198839+0000","last_undegraded":"2024-09-10T23:31:20.198839+0000","last_fullsized":"2024-09-10T23:31:20.198839+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:36.001349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194183+0000","last_change":"2024-09-10T23:31:19.099157+0000","last_active":"2024-09-10T23:31:20.194183+0000","last_peered":"2024-09-10T23:31:20.194183+0000","last_clean":"2024-09-10T23:31:20.194183+0000","last_became_active":"2024-09-10T23:31:19.098878+0000","last_became_peered":"2024-09-10T23:31:19.098878+0000","last_unstale":"2024-09-10T23:31:20.194183+0000","last_undegraded":"2024-09-10T23:31:20.194183+0000","last_fullsized":"2024-09-10T23:31:20.194183+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:04.700681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105122+0000","last_change":"2024-09-10T23:31:19.099725+0000","last_active":"2024-09-10T23:31:20.105122+0000","last_peered":"2024-09-10T23:31:20.105122+0000","last_clean":"2024-09-10T23:31:20.105122+0000","last_became_active":"2024-09-10T23:31:19.097618+0000","last_became_peered":"2024-09-10T23:31:19.097618+0000","last_unstale":"2024-09-10T23:31:20.105122+0000","last_undegraded":"2024-09-10T23:31:20.105122+0000","last_fullsized":"2024-09-10T23:31:20.105122+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:50.857332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094498+0000","last_change":"2024-09-10T23:31:19.097297+0000","last_active":"2024-09-10T23:31:20.094498+0000","last_peered":"2024-09-10T23:31:20.094498+0000","last_clean":"2024-09-10T23:31:20.094498+0000","last_became_active":"2024-09-10T23:31:19.097013+0000","last_became_peered":"2024-09-10T23:31:19.097013+0000","last_unstale":"2024-09-10T23:31:20.094498+0000","last_undegraded":"2024-09-10T23:31:20.094498+0000","last_fullsized":"2024-09-10T23:31:20.094498+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:13.020807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198693+0000","last_change":"2024-09-10T23:31:19.104434+0000","last_active":"2024-09-10T23:31:20.198693+0000","last_peered":"2024-09-10T23:31:20.198693+0000","last_clean":"2024-09-10T23:31:20.198693+0000","last_became_active":"2024-09-10T23:31:19.102729+0000","last_became_peered":"2024-09-10T23:31:19.102729+0000","last_unstale":"2024-09-10T23:31:20.198693+0000","last_undegraded":"2024-09-10T23:31:20.198693+0000","last_fullsized":"2024-09-10T23:31:20.198693+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:25.236930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094157+0000","last_change":"2024-09-10T23:31:19.092835+0000","last_active":"2024-09-10T23:31:20.094157+0000","last_peered":"2024-09-10T23:31:20.094157+0000","last_clean":"2024-09-10T23:31:20.094157+0000","last_became_active":"2024-09-10T23:31:19.092569+0000","last_became_peered":"2024-09-10T23:31:19.092569+0000","last_unstale":"2024-09-10T23:31:20.094157+0000","last_undegraded":"2024-09-10T23:31:20.094157+0000","last_fullsized":"2024-09-10T23:31:20.094157+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:45.600976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194606+0000","last_change":"2024-09-10T23:31:19.095134+0000","last_active":"2024-09-10T23:31:20.194606+0000","last_peered":"2024-09-10T23:31:20.194606+0000","last_clean":"2024-09-10T23:31:20.194606+0000","last_became_active":"2024-09-10T23:31:19.093338+0000","last_became_peered":"2024-09-10T23:31:19.093338+0000","last_unstale":"2024-09-10T23:31:20.194606+0000","last_undegraded":"2024-09-10T23:31:20.194606+0000","last_fullsized":"2024-09-10T23:31:20.194606+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:24.793170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105453+0000","last_change":"2024-09-10T23:31:19.094860+0000","last_active":"2024-09-10T23:31:20.105453+0000","last_peered":"2024-09-10T23:31:20.105453+0000","last_clean":"2024-09-10T23:31:20.105453+0000","last_became_active":"2024-09-10T23:31:19.092128+0000","last_became_peered":"2024-09-10T23:31:19.092128+0000","last_unstale":"2024-09-10T23:31:20.105453+0000","last_undegraded":"2024-09-10T23:31:20.105453+0000","last_fullsized":"2024-09-10T23:31:20.105453+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:22.506375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102610+0000","last_change":"2024-09-10T23:31:19.109738+0000","last_active":"2024-09-10T23:31:20.102610+0000","last_peered":"2024-09-10T23:31:20.102610+0000","last_clean":"2024-09-10T23:31:20.102610+0000","last_became_active":"2024-09-10T23:31:19.109432+0000","last_became_peered":"2024-09-10T23:31:19.109432+0000","last_unstale":"2024-09-10T23:31:20.102610+0000","last_undegraded":"2024-09-10T23:31:20.102610+0000","last_fullsized":"2024-09-10T23:31:20.102610+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:10.827017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.059817+0000","last_change":"2024-09-10T23:31:18.059817+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.059817+0000","last_undegraded":"2024-09-10T23:31:18.059817+0000","last_fullsized":"2024-09-10T23:31:18.059817+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087141+0000","last_change":"2024-09-10T23:31:19.081052+0000","last_active":"2024-09-10T23:31:20.087141+0000","last_peered":"2024-09-10T23:31:20.087141+0000","last_clean":"2024-09-10T23:31:20.087141+0000","last_became_active":"2024-09-10T23:31:19.080723+0000","last_became_peered":"2024-09-10T23:31:19.080723+0000","last_unstale":"2024-09-10T23:31:20.087141+0000","last_undegraded":"2024-09-10T23:31:20.087141+0000","last_fullsized":"2024-09-10T23:31:20.087141+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086951+0000","last_change":"2024-09-10T23:31:19.103280+0000","last_active":"2024-09-10T23:31:20.086951+0000","last_peered":"2024-09-10T23:31:20.086951+0000","last_clean":"2024-09-10T23:31:20.086951+0000","last_became_active":"2024-09-10T23:31:19.102558+0000","last_became_peered":"2024-09-10T23:31:19.102558+0000","last_unstale":"2024-09-10T23:31:20.086951+0000","last_undegraded":"2024-09-10T23:31:20.086951+0000","last_fullsized":"2024-09-10T23:31:20.086951+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193133+0000","last_change":"2024-09-10T23:31:19.093287+0000","last_active":"2024-09-10T23:31:20.193133+0000","last_peered":"2024-09-10T23:31:20.193133+0000","last_clean":"2024-09-10T23:31:20.193133+0000","last_became_active":"2024-09-10T23:31:19.093017+0000","last_became_peered":"2024-09-10T23:31:19.093017+0000","last_unstale":"2024-09-10T23:31:20.193133+0000","last_undegraded":"2024-09-10T23:31:20.193133+0000","last_fullsized":"2024-09-10T23:31:20.193133+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:33.239210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.059426+0000","last_change":"2024-09-10T23:31:18.059426+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.059426+0000","last_undegraded":"2024-09-10T23:31:18.059426+0000","last_fullsized":"2024-09-10T23:31:18.059426+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192217+0000","last_change":"2024-09-10T23:31:19.093746+0000","last_active":"2024-09-10T23:31:20.192217+0000","last_peered":"2024-09-10T23:31:20.192217+0000","last_clean":"2024-09-10T23:31:20.192217+0000","last_became_active":"2024-09-10T23:31:19.093431+0000","last_became_peered":"2024-09-10T23:31:19.093431+0000","last_unstale":"2024-09-10T23:31:20.192217+0000","last_undegraded":"2024-09-10T23:31:20.192217+0000","last_fullsized":"2024-09-10T23:31:20.192217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:53.986164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.078584+0000","last_change":"2024-09-10T23:31:18.076743+0000","last_active":"2024-09-10T23:31:18.078584+0000","last_peered":"2024-09-10T23:31:18.078584+0000","last_clean":"2024-09-10T23:31:18.078584+0000","last_became_active":"2024-09-10T23:31:18.076117+0000","last_became_peered":"2024-09-10T23:31:18.076117+0000","last_unstale":"2024-09-10T23:31:18.078584+0000","last_undegraded":"2024-09-10T23:31:18.078584+0000","last_fullsized":"2024-09-10T23:31:18.078584+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198594+0000","last_change":"2024-09-10T23:31:19.110826+0000","last_active":"2024-09-10T23:31:20.198594+0000","last_peered":"2024-09-10T23:31:20.198594+0000","last_clean":"2024-09-10T23:31:20.198594+0000","last_became_active":"2024-09-10T23:31:19.110510+0000","last_became_peered":"2024-09-10T23:31:19.110510+0000","last_unstale":"2024-09-10T23:31:20.198594+0000","last_undegraded":"2024-09-10T23:31:20.198594+0000","last_fullsized":"2024-09-10T23:31:20.198594+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:00.524828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094383+0000","last_change":"2024-09-10T23:31:18.084510+0000","last_active":"2024-09-10T23:31:20.094383+0000","last_peered":"2024-09-10T23:31:20.094383+0000","last_clean":"2024-09-10T23:31:20.094383+0000","last_became_active":"2024-09-10T23:31:18.084162+0000","last_became_peered":"2024-09-10T23:31:18.084162+0000","last_unstale":"2024-09-10T23:31:20.094383+0000","last_undegraded":"2024-09-10T23:31:20.094383+0000","last_fullsized":"2024-09-10T23:31:20.094383+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.097899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.066071+0000","last_change":"2024-09-10T23:31:18.066071+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.066071+0000","last_undegraded":"2024-09-10T23:31:18.066071+0000","last_fullsized":"2024-09-10T23:31:18.066071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087404+0000","last_change":"2024-09-10T23:31:18.073162+0000","last_active":"2024-09-10T23:31:20.087404+0000","last_peered":"2024-09-10T23:31:20.087404+0000","last_clean":"2024-09-10T23:31:20.087404+0000","last_became_active":"2024-09-10T23:31:18.072848+0000","last_became_peered":"2024-09-10T23:31:18.072848+0000","last_unstale":"2024-09-10T23:31:20.087404+0000","last_undegraded":"2024-09-10T23:31:20.087404+0000","last_fullsized":"2024-09-10T23:31:20.087404+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:43.878999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087312+0000","last_change":"2024-09-10T23:31:19.086134+0000","last_active":"2024-09-10T23:31:20.087312+0000","last_peered":"2024-09-10T23:31:20.087312+0000","last_clean":"2024-09-10T23:31:20.087312+0000","last_became_active":"2024-09-10T23:31:19.085823+0000","last_became_peered":"2024-09-10T23:31:19.085823+0000","last_unstale":"2024-09-10T23:31:20.087312+0000","last_undegraded":"2024-09-10T23:31:20.087312+0000","last_fullsized":"2024-09-10T23:31:20.087312+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198587+0000","last_change":"2024-09-10T23:31:18.085745+0000","last_active":"2024-09-10T23:31:20.198587+0000","last_peered":"2024-09-10T23:31:20.198587+0000","last_clean":"2024-09-10T23:31:20.198587+0000","last_became_active":"2024-09-10T23:31:18.085478+0000","last_became_peered":"2024-09-10T23:31:18.085478+0000","last_unstale":"2024-09-10T23:31:20.198587+0000","last_undegraded":"2024-09-10T23:31:20.198587+0000","last_fullsized":"2024-09-10T23:31:20.198587+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105410+0000","last_change":"2024-09-10T23:31:19.106907+0000","last_active":"2024-09-10T23:31:20.105410+0000","last_peered":"2024-09-10T23:31:20.105410+0000","last_clean":"2024-09-10T23:31:20.105410+0000","last_became_active":"2024-09-10T23:31:19.106522+0000","last_became_peered":"2024-09-10T23:31:19.106522+0000","last_unstale":"2024-09-10T23:31:20.105410+0000","last_undegraded":"2024-09-10T23:31:20.105410+0000","last_fullsized":"2024-09-10T23:31:20.105410+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:18.131377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087064+0000","last_change":"2024-09-10T23:31:18.072466+0000","last_active":"2024-09-10T23:31:20.087064+0000","last_peered":"2024-09-10T23:31:20.087064+0000","last_clean":"2024-09-10T23:31:20.087064+0000","last_became_active":"2024-09-10T23:31:18.071711+0000","last_became_peered":"2024-09-10T23:31:18.071711+0000","last_unstale":"2024-09-10T23:31:20.087064+0000","last_undegraded":"2024-09-10T23:31:20.087064+0000","last_fullsized":"2024-09-10T23:31:20.087064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:10.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192519+0000","last_change":"2024-09-10T23:31:19.081454+0000","last_active":"2024-09-10T23:31:20.192519+0000","last_peered":"2024-09-10T23:31:20.192519+0000","last_clean":"2024-09-10T23:31:20.192519+0000","last_became_active":"2024-09-10T23:31:19.080030+0000","last_became_peered":"2024-09-10T23:31:19.080030+0000","last_unstale":"2024-09-10T23:31:20.192519+0000","last_undegraded":"2024-09-10T23:31:20.192519+0000","last_fullsized":"2024-09-10T23:31:20.192519+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:55.794776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192620+0000","last_change":"2024-09-10T23:31:18.071545+0000","last_active":"2024-09-10T23:31:20.192620+0000","last_peered":"2024-09-10T23:31:20.192620+0000","last_clean":"2024-09-10T23:31:20.192620+0000","last_became_active":"2024-09-10T23:31:18.070999+0000","last_became_peered":"2024-09-10T23:31:18.070999+0000","last_unstale":"2024-09-10T23:31:20.192620+0000","last_undegraded":"2024-09-10T23:31:20.192620+0000","last_fullsized":"2024-09-10T23:31:20.192620+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:13.320251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102930+0000","last_change":"2024-09-10T23:31:19.108690+0000","last_active":"2024-09-10T23:31:20.102930+0000","last_peered":"2024-09-10T23:31:20.102930+0000","last_clean":"2024-09-10T23:31:20.102930+0000","last_became_active":"2024-09-10T23:31:19.108427+0000","last_became_peered":"2024-09-10T23:31:19.108427+0000","last_unstale":"2024-09-10T23:31:20.102930+0000","last_undegraded":"2024-09-10T23:31:20.102930+0000","last_fullsized":"2024-09-10T23:31:20.102930+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:46.359285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.073823+0000","last_change":"2024-09-10T23:31:18.068409+0000","last_active":"2024-09-10T23:31:18.073823+0000","last_peered":"2024-09-10T23:31:18.073823+0000","last_clean":"2024-09-10T23:31:18.073823+0000","last_became_active":"2024-09-10T23:31:18.068106+0000","last_became_peered":"2024-09-10T23:31:18.068106+0000","last_unstale":"2024-09-10T23:31:18.073823+0000","last_undegraded":"2024-09-10T23:31:18.073823+0000","last_fullsized":"2024-09-10T23:31:18.073823+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:01.406376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105021+0000","last_change":"2024-09-10T23:31:19.100589+0000","last_active":"2024-09-10T23:31:20.105021+0000","last_peered":"2024-09-10T23:31:20.105021+0000","last_clean":"2024-09-10T23:31:20.105021+0000","last_became_active":"2024-09-10T23:31:19.100313+0000","last_became_peered":"2024-09-10T23:31:19.100313+0000","last_unstale":"2024-09-10T23:31:20.105021+0000","last_undegraded":"2024-09-10T23:31:20.105021+0000","last_fullsized":"2024-09-10T23:31:20.105021+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:27.446745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087425+0000","last_change":"2024-09-10T23:31:18.077014+0000","last_active":"2024-09-10T23:31:20.087425+0000","last_peered":"2024-09-10T23:31:20.087425+0000","last_clean":"2024-09-10T23:31:20.087425+0000","last_became_active":"2024-09-10T23:31:18.076754+0000","last_became_peered":"2024-09-10T23:31:18.076754+0000","last_unstale":"2024-09-10T23:31:20.087425+0000","last_undegraded":"2024-09-10T23:31:20.087425+0000","last_fullsized":"2024-09-10T23:31:20.087425+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:27.536844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094124+0000","last_change":"2024-09-10T23:31:19.098486+0000","last_active":"2024-09-10T23:31:20.094124+0000","last_peered":"2024-09-10T23:31:20.094124+0000","last_clean":"2024-09-10T23:31:20.094124+0000","last_became_active":"2024-09-10T23:31:19.098206+0000","last_became_peered":"2024-09-10T23:31:19.098206+0000","last_unstale":"2024-09-10T23:31:20.094124+0000","last_undegraded":"2024-09-10T23:31:20.094124+0000","last_fullsized":"2024-09-10T23:31:20.094124+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:35.669124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192768+0000","last_change":"2024-09-10T23:31:18.079188+0000","last_active":"2024-09-10T23:31:20.192768+0000","last_peered":"2024-09-10T23:31:20.192768+0000","last_clean":"2024-09-10T23:31:20.192768+0000","last_became_active":"2024-09-10T23:31:18.078875+0000","last_became_peered":"2024-09-10T23:31:18.078875+0000","last_unstale":"2024-09-10T23:31:20.192768+0000","last_undegraded":"2024-09-10T23:31:20.192768+0000","last_fullsized":"2024-09-10T23:31:20.192768+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:21.354649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192579+0000","last_change":"2024-09-10T23:31:19.107187+0000","last_active":"2024-09-10T23:31:20.192579+0000","last_peered":"2024-09-10T23:31:20.192579+0000","last_clean":"2024-09-10T23:31:20.192579+0000","last_became_active":"2024-09-10T23:31:19.106681+0000","last_became_peered":"2024-09-10T23:31:19.106681+0000","last_unstale":"2024-09-10T23:31:20.192579+0000","last_undegraded":"2024-09-10T23:31:20.192579+0000","last_fullsized":"2024-09-10T23:31:20.192579+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.920623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"211'3","reported_seq":18,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102559+0000","last_change":"2024-09-10T23:31:18.073660+0000","last_active":"2024-09-10T23:31:20.102559+0000","last_peered":"2024-09-10T23:31:20.102559+0000","last_clean":"2024-09-10T23:31:20.102559+0000","last_became_active":"2024-09-10T23:31:18.072881+0000","last_became_peered":"2024-09-10T23:31:18.072881+0000","last_unstale":"2024-09-10T23:31:20.102559+0000","last_undegraded":"2024-09-10T23:31:20.102559+0000","last_fullsized":"2024-09-10T23:31:20.102559+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:17.944201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105092+0000","last_change":"2024-09-10T23:31:19.096083+0000","last_active":"2024-09-10T23:31:20.105092+0000","last_peered":"2024-09-10T23:31:20.105092+0000","last_clean":"2024-09-10T23:31:20.105092+0000","last_became_active":"2024-09-10T23:31:19.095779+0000","last_became_peered":"2024-09-10T23:31:19.095779+0000","last_unstale":"2024-09-10T23:31:20.105092+0000","last_undegraded":"2024-09-10T23:31:20.105092+0000","last_fullsized":"2024-09-10T23:31:20.105092+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:50.287034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.072525+0000","last_change":"2024-09-10T23:31:18.065614+0000","last_active":"2024-09-10T23:31:18.072525+0000","last_peered":"2024-09-10T23:31:18.072525+0000","last_clean":"2024-09-10T23:31:18.072525+0000","last_became_active":"2024-09-10T23:31:18.065239+0000","last_became_peered":"2024-09-10T23:31:18.065239+0000","last_unstale":"2024-09-10T23:31:18.072525+0000","last_undegraded":"2024-09-10T23:31:18.072525+0000","last_fullsized":"2024-09-10T23:31:18.072525+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:16.379329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193990+0000","last_change":"2024-09-10T23:31:19.090713+0000","last_active":"2024-09-10T23:31:20.193990+0000","last_peered":"2024-09-10T23:31:20.193990+0000","last_clean":"2024-09-10T23:31:20.193990+0000","last_became_active":"2024-09-10T23:31:19.089009+0000","last_became_peered":"2024-09-10T23:31:19.089009+0000","last_unstale":"2024-09-10T23:31:20.193990+0000","last_undegraded":"2024-09-10T23:31:20.193990+0000","last_fullsized":"2024-09-10T23:31:20.193990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:07.556427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198523+0000","last_change":"2024-09-10T23:31:18.082553+0000","last_active":"2024-09-10T23:31:20.198523+0000","last_peered":"2024-09-10T23:31:20.198523+0000","last_clean":"2024-09-10T23:31:20.198523+0000","last_became_active":"2024-09-10T23:31:18.082228+0000","last_became_peered":"2024-09-10T23:31:18.082228+0000","last_unstale":"2024-09-10T23:31:20.198523+0000","last_undegraded":"2024-09-10T23:31:20.198523+0000","last_fullsized":"2024-09-10T23:31:20.198523+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:41.522911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105367+0000","last_change":"2024-09-10T23:31:19.094510+0000","last_active":"2024-09-10T23:31:20.105367+0000","last_peered":"2024-09-10T23:31:20.105367+0000","last_clean":"2024-09-10T23:31:20.105367+0000","last_became_active":"2024-09-10T23:31:19.092810+0000","last_became_peered":"2024-09-10T23:31:19.092810+0000","last_unstale":"2024-09-10T23:31:20.105367+0000","last_undegraded":"2024-09-10T23:31:20.105367+0000","last_fullsized":"2024-09-10T23:31:20.105367+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:22.361882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102270+0000","last_change":"2024-09-10T23:31:18.086364+0000","last_active":"2024-09-10T23:31:20.102270+0000","last_peered":"2024-09-10T23:31:20.102270+0000","last_clean":"2024-09-10T23:31:20.102270+0000","last_became_active":"2024-09-10T23:31:18.086107+0000","last_became_peered":"2024-09-10T23:31:18.086107+0000","last_unstale":"2024-09-10T23:31:20.102270+0000","last_undegraded":"2024-09-10T23:31:20.102270+0000","last_fullsized":"2024-09-10T23:31:20.102270+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:20.135593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198696+0000","last_change":"2024-09-10T23:31:19.107551+0000","last_active":"2024-09-10T23:31:20.198696+0000","last_peered":"2024-09-10T23:31:20.198696+0000","last_clean":"2024-09-10T23:31:20.198696+0000","last_became_active":"2024-09-10T23:31:19.107264+0000","last_became_peered":"2024-09-10T23:31:19.107264+0000","last_unstale":"2024-09-10T23:31:20.198696+0000","last_undegraded":"2024-09-10T23:31:20.198696+0000","last_fullsized":"2024-09-10T23:31:20.198696+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:06.312069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102064+0000","last_change":"2024-09-10T23:31:18.081471+0000","last_active":"2024-09-10T23:31:20.102064+0000","last_peered":"2024-09-10T23:31:20.102064+0000","last_clean":"2024-09-10T23:31:20.102064+0000","last_became_active":"2024-09-10T23:31:18.080940+0000","last_became_peered":"2024-09-10T23:31:18.080940+0000","last_unstale":"2024-09-10T23:31:20.102064+0000","last_undegraded":"2024-09-10T23:31:20.102064+0000","last_fullsized":"2024-09-10T23:31:20.102064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:43.514503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102911+0000","last_change":"2024-09-10T23:31:19.105155+0000","last_active":"2024-09-10T23:31:20.102911+0000","last_peered":"2024-09-10T23:31:20.102911+0000","last_clean":"2024-09-10T23:31:20.102911+0000","last_became_active":"2024-09-10T23:31:19.104892+0000","last_became_peered":"2024-09-10T23:31:19.104892+0000","last_unstale":"2024-09-10T23:31:20.102911+0000","last_undegraded":"2024-09-10T23:31:20.102911+0000","last_fullsized":"2024-09-10T23:31:20.102911+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:37.315477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"211'8","reported_seq":23,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192327+0000","last_change":"2024-09-10T23:31:18.080071+0000","last_active":"2024-09-10T23:31:20.192327+0000","last_peered":"2024-09-10T23:31:20.192327+0000","last_clean":"2024-09-10T23:31:20.192327+0000","last_became_active":"2024-09-10T23:31:18.079813+0000","last_became_peered":"2024-09-10T23:31:18.079813+0000","last_unstale":"2024-09-10T23:31:20.192327+0000","last_undegraded":"2024-09-10T23:31:20.192327+0000","last_fullsized":"2024-09-10T23:31:20.192327+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:25.626605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102174+0000","last_change":"2024-09-10T23:31:19.102720+0000","last_active":"2024-09-10T23:31:20.102174+0000","last_peered":"2024-09-10T23:31:20.102174+0000","last_clean":"2024-09-10T23:31:20.102174+0000","last_became_active":"2024-09-10T23:31:19.102397+0000","last_became_peered":"2024-09-10T23:31:19.102397+0000","last_unstale":"2024-09-10T23:31:20.102174+0000","last_undegraded":"2024-09-10T23:31:20.102174+0000","last_fullsized":"2024-09-10T23:31:20.102174+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.681149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.075407+0000","last_change":"2024-09-10T23:31:18.073203+0000","last_active":"2024-09-10T23:31:18.075407+0000","last_peered":"2024-09-10T23:31:18.075407+0000","last_clean":"2024-09-10T23:31:18.075407+0000","last_became_active":"2024-09-10T23:31:18.072769+0000","last_became_peered":"2024-09-10T23:31:18.072769+0000","last_unstale":"2024-09-10T23:31:18.075407+0000","last_undegraded":"2024-09-10T23:31:18.075407+0000","last_fullsized":"2024-09-10T23:31:18.075407+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:49.230178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102172+0000","last_change":"2024-09-10T23:31:19.104376+0000","last_active":"2024-09-10T23:31:20.102172+0000","last_peered":"2024-09-10T23:31:20.102172+0000","last_clean":"2024-09-10T23:31:20.102172+0000","last_became_active":"2024-09-10T23:31:19.102719+0000","last_became_peered":"2024-09-10T23:31:19.102719+0000","last_unstale":"2024-09-10T23:31:20.102172+0000","last_undegraded":"2024-09-10T23:31:20.102172+0000","last_fullsized":"2024-09-10T23:31:20.102172+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:56.299808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194495+0000","last_change":"2024-09-10T23:31:18.074043+0000","last_active":"2024-09-10T23:31:20.194495+0000","last_peered":"2024-09-10T23:31:20.194495+0000","last_clean":"2024-09-10T23:31:20.194495+0000","last_became_active":"2024-09-10T23:31:18.073766+0000","last_became_peered":"2024-09-10T23:31:18.073766+0000","last_unstale":"2024-09-10T23:31:20.194495+0000","last_undegraded":"2024-09-10T23:31:20.194495+0000","last_fullsized":"2024-09-10T23:31:20.194495+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:41.950907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193217+0000","last_change":"2024-09-10T23:31:19.102248+0000","last_active":"2024-09-10T23:31:20.193217+0000","last_peered":"2024-09-10T23:31:20.193217+0000","last_clean":"2024-09-10T23:31:20.193217+0000","last_became_active":"2024-09-10T23:31:19.101921+0000","last_became_peered":"2024-09-10T23:31:19.101921+0000","last_unstale":"2024-09-10T23:31:20.193217+0000","last_undegraded":"2024-09-10T23:31:20.193217+0000","last_fullsized":"2024-09-10T23:31:20.193217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:33.277637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094509+0000","last_change":"2024-09-10T23:31:18.084654+0000","last_active":"2024-09-10T23:31:20.094509+0000","last_peered":"2024-09-10T23:31:20.094509+0000","last_clean":"2024-09-10T23:31:20.094509+0000","last_became_active":"2024-09-10T23:31:18.084150+0000","last_became_peered":"2024-09-10T23:31:18.084150+0000","last_unstale":"2024-09-10T23:31:20.094509+0000","last_undegraded":"2024-09-10T23:31:20.094509+0000","last_fullsized":"2024-09-10T23:31:20.094509+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:28.813302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192910+0000","last_change":"2024-09-10T23:31:19.107063+0000","last_active":"2024-09-10T23:31:20.192910+0000","last_peered":"2024-09-10T23:31:20.192910+0000","last_clean":"2024-09-10T23:31:20.192910+0000","last_became_active":"2024-09-10T23:31:19.106793+0000","last_became_peered":"2024-09-10T23:31:19.106793+0000","last_unstale":"2024-09-10T23:31:20.192910+0000","last_undegraded":"2024-09-10T23:31:20.192910+0000","last_fullsized":"2024-09-10T23:31:20.192910+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:58.414351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198722+0000","last_change":"2024-09-10T23:31:18.075017+0000","last_active":"2024-09-10T23:31:20.198722+0000","last_peered":"2024-09-10T23:31:20.198722+0000","last_clean":"2024-09-10T23:31:20.198722+0000","last_became_active":"2024-09-10T23:31:18.073860+0000","last_became_peered":"2024-09-10T23:31:18.073860+0000","last_unstale":"2024-09-10T23:31:20.198722+0000","last_undegraded":"2024-09-10T23:31:20.198722+0000","last_fullsized":"2024-09-10T23:31:20.198722+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:09.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192182+0000","last_change":"2024-09-10T23:31:19.084774+0000","last_active":"2024-09-10T23:31:20.192182+0000","last_peered":"2024-09-10T23:31:20.192182+0000","last_clean":"2024-09-10T23:31:20.192182+0000","last_became_active":"2024-09-10T23:31:19.083516+0000","last_became_peered":"2024-09-10T23:31:19.083516+0000","last_unstale":"2024-09-10T23:31:20.192182+0000","last_undegraded":"2024-09-10T23:31:20.192182+0000","last_fullsized":"2024-09-10T23:31:20.192182+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193021+0000","last_change":"2024-09-10T23:31:18.070568+0000","last_active":"2024-09-10T23:31:20.193021+0000","last_peered":"2024-09-10T23:31:20.193021+0000","last_clean":"2024-09-10T23:31:20.193021+0000","last_became_active":"2024-09-10T23:31:18.070110+0000","last_became_peered":"2024-09-10T23:31:18.070110+0000","last_unstale":"2024-09-10T23:31:20.193021+0000","last_undegraded":"2024-09-10T23:31:20.193021+0000","last_fullsized":"2024-09-10T23:31:20.193021+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:17.124144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194213+0000","last_change":"2024-09-10T23:31:19.094490+0000","last_active":"2024-09-10T23:31:20.194213+0000","last_peered":"2024-09-10T23:31:20.194213+0000","last_clean":"2024-09-10T23:31:20.194213+0000","last_became_active":"2024-09-10T23:31:19.094236+0000","last_became_peered":"2024-09-10T23:31:19.094236+0000","last_unstale":"2024-09-10T23:31:20.194213+0000","last_undegraded":"2024-09-10T23:31:20.194213+0000","last_fullsized":"2024-09-10T23:31:20.194213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:28.628059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094462+0000","last_change":"2024-09-10T23:31:18.068183+0000","last_active":"2024-09-10T23:31:20.094462+0000","last_peered":"2024-09-10T23:31:20.094462+0000","last_clean":"2024-09-10T23:31:20.094462+0000","last_became_active":"2024-09-10T23:31:18.067814+0000","last_became_peered":"2024-09-10T23:31:18.067814+0000","last_unstale":"2024-09-10T23:31:20.094462+0000","last_undegraded":"2024-09-10T23:31:20.094462+0000","last_fullsized":"2024-09-10T23:31:20.094462+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:42.363754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094491+0000","last_change":"2024-09-10T23:31:19.099060+0000","last_active":"2024-09-10T23:31:20.094491+0000","last_peered":"2024-09-10T23:31:20.094491+0000","last_clean":"2024-09-10T23:31:20.094491+0000","last_became_active":"2024-09-10T23:31:19.098576+0000","last_became_peered":"2024-09-10T23:31:19.098576+0000","last_unstale":"2024-09-10T23:31:20.094491+0000","last_undegraded":"2024-09-10T23:31:20.094491+0000","last_fullsized":"2024-09-10T23:31:20.094491+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:27.428492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093973+0000","last_change":"2024-09-10T23:31:18.076954+0000","last_active":"2024-09-10T23:31:20.093973+0000","last_peered":"2024-09-10T23:31:20.093973+0000","last_clean":"2024-09-10T23:31:20.093973+0000","last_became_active":"2024-09-10T23:31:18.076673+0000","last_became_peered":"2024-09-10T23:31:18.076673+0000","last_unstale":"2024-09-10T23:31:20.093973+0000","last_undegraded":"2024-09-10T23:31:20.093973+0000","last_fullsized":"2024-09-10T23:31:20.093973+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:37.993408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094762+0000","last_change":"2024-09-10T23:31:19.102914+0000","last_active":"2024-09-10T23:31:20.094762+0000","last_peered":"2024-09-10T23:31:20.094762+0000","last_clean":"2024-09-10T23:31:20.094762+0000","last_became_active":"2024-09-10T23:31:19.102662+0000","last_became_peered":"2024-09-10T23:31:19.102662+0000","last_unstale":"2024-09-10T23:31:20.094762+0000","last_undegraded":"2024-09-10T23:31:20.094762+0000","last_fullsized":"2024-09-10T23:31:20.094762+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:03.963145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086835+0000","last_change":"2024-09-10T23:31:18.074711+0000","last_active":"2024-09-10T23:31:20.086835+0000","last_peered":"2024-09-10T23:31:20.086835+0000","last_clean":"2024-09-10T23:31:20.086835+0000","last_became_active":"2024-09-10T23:31:18.074079+0000","last_became_peered":"2024-09-10T23:31:18.074079+0000","last_unstale":"2024-09-10T23:31:20.086835+0000","last_undegraded":"2024-09-10T23:31:20.086835+0000","last_fullsized":"2024-09-10T23:31:20.086835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:21.499142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104963+0000","last_change":"2024-09-10T23:31:19.091779+0000","last_active":"2024-09-10T23:31:20.104963+0000","last_peered":"2024-09-10T23:31:20.104963+0000","last_clean":"2024-09-10T23:31:20.104963+0000","last_became_active":"2024-09-10T23:31:19.091404+0000","last_became_peered":"2024-09-10T23:31:19.091404+0000","last_unstale":"2024-09-10T23:31:20.104963+0000","last_undegraded":"2024-09-10T23:31:20.104963+0000","last_fullsized":"2024-09-10T23:31:20.104963+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:02.528031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192714+0000","last_change":"2024-09-10T23:31:18.082254+0000","last_active":"2024-09-10T23:31:20.192714+0000","last_peered":"2024-09-10T23:31:20.192714+0000","last_clean":"2024-09-10T23:31:20.192714+0000","last_became_active":"2024-09-10T23:31:18.081963+0000","last_became_peered":"2024-09-10T23:31:18.081963+0000","last_unstale":"2024-09-10T23:31:20.192714+0000","last_undegraded":"2024-09-10T23:31:20.192714+0000","last_fullsized":"2024-09-10T23:31:20.192714+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198454+0000","last_change":"2024-09-10T23:31:19.104473+0000","last_active":"2024-09-10T23:31:20.198454+0000","last_peered":"2024-09-10T23:31:20.198454+0000","last_clean":"2024-09-10T23:31:20.198454+0000","last_became_active":"2024-09-10T23:31:19.104186+0000","last_became_peered":"2024-09-10T23:31:19.104186+0000","last_unstale":"2024-09-10T23:31:20.198454+0000","last_undegraded":"2024-09-10T23:31:20.198454+0000","last_fullsized":"2024-09-10T23:31:20.198454+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:20.987147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"212'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104384+0000","last_change":"2024-09-10T23:31:18.079920+0000","last_active":"2024-09-10T23:31:20.104384+0000","last_peered":"2024-09-10T23:31:20.104384+0000","last_clean":"2024-09-10T23:31:20.104384+0000","last_became_active":"2024-09-10T23:31:18.079584+0000","last_became_peered":"2024-09-10T23:31:18.079584+0000","last_unstale":"2024-09-10T23:31:20.104384+0000","last_undegraded":"2024-09-10T23:31:20.104384+0000","last_fullsized":"2024-09-10T23:31:20.104384+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:33.922546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192416+0000","last_change":"2024-09-10T23:31:19.080253+0000","last_active":"2024-09-10T23:31:20.192416+0000","last_peered":"2024-09-10T23:31:20.192416+0000","last_clean":"2024-09-10T23:31:20.192416+0000","last_became_active":"2024-09-10T23:31:19.079908+0000","last_became_peered":"2024-09-10T23:31:19.079908+0000","last_unstale":"2024-09-10T23:31:20.192416+0000","last_undegraded":"2024-09-10T23:31:20.192416+0000","last_fullsized":"2024-09-10T23:31:20.192416+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087252+0000","last_change":"2024-09-10T23:31:18.080655+0000","last_active":"2024-09-10T23:31:20.087252+0000","last_peered":"2024-09-10T23:31:20.087252+0000","last_clean":"2024-09-10T23:31:20.087252+0000","last_became_active":"2024-09-10T23:31:18.080370+0000","last_became_peered":"2024-09-10T23:31:18.080370+0000","last_unstale":"2024-09-10T23:31:20.087252+0000","last_undegraded":"2024-09-10T23:31:20.087252+0000","last_fullsized":"2024-09-10T23:31:20.087252+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:55.916497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102543+0000","last_change":"2024-09-10T23:31:19.106872+0000","last_active":"2024-09-10T23:31:20.102543+0000","last_peered":"2024-09-10T23:31:20.102543+0000","last_clean":"2024-09-10T23:31:20.102543+0000","last_became_active":"2024-09-10T23:31:19.106326+0000","last_became_peered":"2024-09-10T23:31:19.106326+0000","last_unstale":"2024-09-10T23:31:20.102543+0000","last_undegraded":"2024-09-10T23:31:20.102543+0000","last_fullsized":"2024-09-10T23:31:20.102543+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:27.217918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087413+0000","last_change":"2024-09-10T23:31:18.074710+0000","last_active":"2024-09-10T23:31:20.087413+0000","last_peered":"2024-09-10T23:31:20.087413+0000","last_clean":"2024-09-10T23:31:20.087413+0000","last_became_active":"2024-09-10T23:31:18.074405+0000","last_became_peered":"2024-09-10T23:31:18.074405+0000","last_unstale":"2024-09-10T23:31:20.087413+0000","last_undegraded":"2024-09-10T23:31:20.087413+0000","last_fullsized":"2024-09-10T23:31:20.087413+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:46.035443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087213+0000","last_change":"2024-09-10T23:31:19.090048+0000","last_active":"2024-09-10T23:31:20.087213+0000","last_peered":"2024-09-10T23:31:20.087213+0000","last_clean":"2024-09-10T23:31:20.087213+0000","last_became_active":"2024-09-10T23:31:19.088979+0000","last_became_peered":"2024-09-10T23:31:19.088979+0000","last_unstale":"2024-09-10T23:31:20.087213+0000","last_undegraded":"2024-09-10T23:31:20.087213+0000","last_fullsized":"2024-09-10T23:31:20.087213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:43.080975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094212+0000","last_change":"2024-09-10T23:31:18.068905+0000","last_active":"2024-09-10T23:31:20.094212+0000","last_peered":"2024-09-10T23:31:20.094212+0000","last_clean":"2024-09-10T23:31:20.094212+0000","last_became_active":"2024-09-10T23:31:18.068607+0000","last_became_peered":"2024-09-10T23:31:18.068607+0000","last_unstale":"2024-09-10T23:31:20.094212+0000","last_undegraded":"2024-09-10T23:31:20.094212+0000","last_fullsized":"2024-09-10T23:31:20.094212+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:36.784830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.064604+0000","last_change":"2024-09-10T23:31:18.064604+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.064604+0000","last_undegraded":"2024-09-10T23:31:18.064604+0000","last_fullsized":"2024-09-10T23:31:18.064604+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102406+0000","last_change":"2024-09-10T23:31:18.076160+0000","last_active":"2024-09-10T23:31:20.102406+0000","last_peered":"2024-09-10T23:31:20.102406+0000","last_clean":"2024-09-10T23:31:20.102406+0000","last_became_active":"2024-09-10T23:31:18.075439+0000","last_became_peered":"2024-09-10T23:31:18.075439+0000","last_unstale":"2024-09-10T23:31:20.102406+0000","last_undegraded":"2024-09-10T23:31:20.102406+0000","last_fullsized":"2024-09-10T23:31:20.102406+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.238398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194378+0000","last_change":"2024-09-10T23:31:19.087302+0000","last_active":"2024-09-10T23:31:20.194378+0000","last_peered":"2024-09-10T23:31:20.194378+0000","last_clean":"2024-09-10T23:31:20.194378+0000","last_became_active":"2024-09-10T23:31:19.087002+0000","last_became_peered":"2024-09-10T23:31:19.087002+0000","last_unstale":"2024-09-10T23:31:20.194378+0000","last_undegraded":"2024-09-10T23:31:20.194378+0000","last_fullsized":"2024-09-10T23:31:20.194378+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:16.875377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192740+0000","last_change":"2024-09-10T23:31:18.071251+0000","last_active":"2024-09-10T23:31:20.192740+0000","last_peered":"2024-09-10T23:31:20.192740+0000","last_clean":"2024-09-10T23:31:20.192740+0000","last_became_active":"2024-09-10T23:31:18.070638+0000","last_became_peered":"2024-09-10T23:31:18.070638+0000","last_unstale":"2024-09-10T23:31:20.192740+0000","last_undegraded":"2024-09-10T23:31:20.192740+0000","last_fullsized":"2024-09-10T23:31:20.192740+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094695+0000","last_change":"2024-09-10T23:31:19.096247+0000","last_active":"2024-09-10T23:31:20.094695+0000","last_peered":"2024-09-10T23:31:20.094695+0000","last_clean":"2024-09-10T23:31:20.094695+0000","last_became_active":"2024-09-10T23:31:19.095981+0000","last_became_peered":"2024-09-10T23:31:19.095981+0000","last_unstale":"2024-09-10T23:31:20.094695+0000","last_undegraded":"2024-09-10T23:31:20.094695+0000","last_fullsized":"2024-09-10T23:31:20.094695+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:24.795258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093794+0000","last_change":"2024-09-10T23:31:18.072179+0000","last_active":"2024-09-10T23:31:20.093794+0000","last_peered":"2024-09-10T23:31:20.093794+0000","last_clean":"2024-09-10T23:31:20.093794+0000","last_became_active":"2024-09-10T23:31:18.071874+0000","last_became_peered":"2024-09-10T23:31:18.071874+0000","last_unstale":"2024-09-10T23:31:20.093794+0000","last_undegraded":"2024-09-10T23:31:20.093794+0000","last_fullsized":"2024-09-10T23:31:20.093794+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:57.312073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.062253+0000","last_change":"2024-09-10T23:31:18.062253+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.062253+0000","last_undegraded":"2024-09-10T23:31:18.062253+0000","last_fullsized":"2024-09-10T23:31:18.062253+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105346+0000","last_change":"2024-09-10T23:31:18.079488+0000","last_active":"2024-09-10T23:31:20.105346+0000","last_peered":"2024-09-10T23:31:20.105346+0000","last_clean":"2024-09-10T23:31:20.105346+0000","last_became_active":"2024-09-10T23:31:18.077598+0000","last_became_peered":"2024-09-10T23:31:18.077598+0000","last_unstale":"2024-09-10T23:31:20.105346+0000","last_undegraded":"2024-09-10T23:31:20.105346+0000","last_fullsized":"2024-09-10T23:31:20.105346+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:44.046563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":455,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198199+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:31:20.198199+0000","last_peered":"2024-09-10T23:31:20.198199+0000","last_clean":"2024-09-10T23:31:20.198199+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:31:20.198199+0000","last_undegraded":"2024-09-10T23:31:20.198199+0000","last_fullsized":"2024-09-10T23:31:20.198199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":194,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476930,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74004,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297836,"statfs":{"total":96636764160,"available":96560984064,"internally_reserved":0,"allocated":2682880,"data_stored":1259240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509635,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74576,"kb_used_data":3188,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297264,"statfs":{"total":96636764160,"available":96560398336,"internally_reserved":0,"allocated":3264512,"data_stored":1842928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73071050},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509634,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47684,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324156,"statfs":{"total":96636764160,"available":96587935744,"internally_reserved":0,"allocated":2662400,"data_stored":1252436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509635,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74048,"kb_used_data":2604,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297792,"statfs":{"total":96636764160,"available":96560939008,"internally_reserved":0,"allocated":2666496,"data_stored":1252506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74052,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297788,"statfs":{"total":96636764160,"available":96560934912,"internally_reserved":0,"allocated":2670592,"data_stored":1253088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509635,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47676,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324164,"statfs":{"total":96636764160,"available":96587943936,"internally_reserved":0,"allocated":2662400,"data_stored":1252436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78800,"kb_used_data":3192,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293040,"statfs":{"total":96636764160,"available":96556072960,"internally_reserved":0,"allocated":3268608,"data_stored":1844416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73960,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297880,"statfs":{"total":96636764160,"available":96561029120,"internally_reserved":0,"allocated":2637824,"data_stored":1238602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:31:23.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:31:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 -- 172.21.15.17:0/1536213899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 msgr2=0x7f18980b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 --2- 172.21.15.17:0/1536213899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 0x7f18980b3ea0 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f1890009cb0 tx=0x7f189001cda0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 -- 172.21.15.17:0/1536213899 shutdown_connections 2024-09-10T23:31:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 --2- 172.21.15.17:0/1536213899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 0x7f18980b3ea0 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 --2- 172.21.15.17:0/1536213899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1898070d90 0x7f189815f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 -- 172.21.15.17:0/1536213899 >> 172.21.15.17:0/1536213899 conn(0x7f18980d0ae0 msgr2=0x7f18980d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 -- 172.21.15.17:0/1536213899 shutdown_connections 2024-09-10T23:31:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 -- 172.21.15.17:0/1536213899 wait complete. 2024-09-10T23:31:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 Processor -- start 2024-09-10T23:31:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.839+0000 7f189ea00640 1 -- start start 2024-09-10T23:31:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f189806f6b0 0x7f1898139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1898070d90 0x7f18980ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 0x7f189813f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1898167e40 con 0x7f18980b39f0 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189ea00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1898167cc0 con 0x7f1898070d90 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189ea00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1898167fc0 con 0x7f189806f6b0 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 0x7f189813f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 0x7f189813f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44318/0 (socket says 172.21.15.17:44318) 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189e000640 1 -- 172.21.15.17:0/676535712 learned_addr learned my addr 172.21.15.17:0/676535712 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189d600640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f189806f6b0 0x7f1898139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189cc00640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1898070d90 0x7f18980ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189e000640 1 -- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f189806f6b0 msgr2=0x7f1898139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189e000640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f189806f6b0 0x7f1898139960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189e000640 1 -- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1898070d90 msgr2=0x7f18980ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189e000640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1898070d90 0x7f18980ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189e000640 1 -- 172.21.15.17:0/676535712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189813b470 con 0x7f18980b39f0 2024-09-10T23:31:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189e000640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 0x7f189813f040 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f189001a9d0 tx=0x7f18900092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f1895600640 1 -- 172.21.15.17:0/676535712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18900ba020 con 0x7f18980b39f0 2024-09-10T23:31:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f1895600640 1 -- 172.21.15.17:0/676535712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1890004d40 con 0x7f18980b39f0 2024-09-10T23:31:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f1895600640 1 -- 172.21.15.17:0/676535712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18900b2040 con 0x7f18980b39f0 2024-09-10T23:31:23.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f189813b750 con 0x7f18980b39f0 2024-09-10T23:31:23.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f189813b120 con 0x7f18980b39f0 2024-09-10T23:31:23.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.843+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f189815f0c0 con 0x7f18980b39f0 2024-09-10T23:31:23.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.847+0000 7f1895600640 1 -- 172.21.15.17:0/676535712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f18900b5070 con 0x7f18980b39f0 2024-09-10T23:31:23.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.847+0000 7f1895600640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18780725e0 0x7f1878074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:23.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.847+0000 7f1895600640 1 -- 172.21.15.17:0/676535712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f189012d6e0 con 0x7f18980b39f0 2024-09-10T23:31:23.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.847+0000 7f189d600640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18780725e0 0x7f1878074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:23.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.847+0000 7f189d600640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18780725e0 0x7f1878074aa0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f188c005d90 tx=0x7f188c005c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:23.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:23.851+0000 7f1895600640 1 -- 172.21.15.17:0/676535712 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f18900c4020 con 0x7f18980b39f0 2024-09-10T23:31:24.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.019+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f189806cf30 con 0x7f18780725e0 2024-09-10T23:31:24.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f1895600640 1 -- 172.21.15.17:0/676535712 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251715 (secure 0 0 0) 0x7f189806cf30 con 0x7f18780725e0 2024-09-10T23:31:24.030 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:24.031 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:31:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18780725e0 msgr2=0x7f1878074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18780725e0 0x7f1878074aa0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f188c005d90 tx=0x7f188c005c60 comp rx=0 tx=0).stop 2024-09-10T23:31:24.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 msgr2=0x7f189813f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 0x7f189813f040 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f189001a9d0 tx=0x7f18900092c0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 shutdown_connections 2024-09-10T23:31:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f18780725e0 0x7f1878074aa0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18980b39f0 0x7f189813f040 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1898070d90 0x7f18980ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 --2- 172.21.15.17:0/676535712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f189806f6b0 0x7f1898139960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.027+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 >> 172.21.15.17:0/676535712 conn(0x7f18980d0ae0 msgr2=0x7f18980b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:24.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.031+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 shutdown_connections 2024-09-10T23:31:24.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.031+0000 7f189ea00640 1 -- 172.21.15.17:0/676535712 wait complete. 2024-09-10T23:31:24.051 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":685,"stamp":"2024-09-10T23:31:22.524975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590562,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":135,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":544800,"kb_used_data":21988,"kb_used_omap":12,"kb_used_meta":522611,"kb_avail":754429920,"statfs":{"total":773094113280,"available":772536238080,"internally_reserved":0,"allocated":22515712,"data_stored":11195652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":535154225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.472247"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.061879+0000","last_change":"2024-09-10T23:31:18.061879+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.061879+0000","last_undegraded":"2024-09-10T23:31:18.061879+0000","last_fullsized":"2024-09-10T23:31:18.061879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194431+0000","last_change":"2024-09-10T23:31:19.087458+0000","last_active":"2024-09-10T23:31:20.194431+0000","last_peered":"2024-09-10T23:31:20.194431+0000","last_clean":"2024-09-10T23:31:20.194431+0000","last_became_active":"2024-09-10T23:31:19.087143+0000","last_became_peered":"2024-09-10T23:31:19.087143+0000","last_unstale":"2024-09-10T23:31:20.194431+0000","last_undegraded":"2024-09-10T23:31:20.194431+0000","last_fullsized":"2024-09-10T23:31:20.194431+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:41.103255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192394+0000","last_change":"2024-09-10T23:31:19.089631+0000","last_active":"2024-09-10T23:31:20.192394+0000","last_peered":"2024-09-10T23:31:20.192394+0000","last_clean":"2024-09-10T23:31:20.192394+0000","last_became_active":"2024-09-10T23:31:19.089105+0000","last_became_peered":"2024-09-10T23:31:19.089105+0000","last_unstale":"2024-09-10T23:31:20.192394+0000","last_undegraded":"2024-09-10T23:31:20.192394+0000","last_fullsized":"2024-09-10T23:31:20.192394+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192198+0000","last_change":"2024-09-10T23:31:19.087326+0000","last_active":"2024-09-10T23:31:20.192198+0000","last_peered":"2024-09-10T23:31:20.192198+0000","last_clean":"2024-09-10T23:31:20.192198+0000","last_became_active":"2024-09-10T23:31:19.087006+0000","last_became_peered":"2024-09-10T23:31:19.087006+0000","last_unstale":"2024-09-10T23:31:20.192198+0000","last_undegraded":"2024-09-10T23:31:20.192198+0000","last_fullsized":"2024-09-10T23:31:20.192198+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:57.556182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102882+0000","last_change":"2024-09-10T23:31:19.106580+0000","last_active":"2024-09-10T23:31:20.102882+0000","last_peered":"2024-09-10T23:31:20.102882+0000","last_clean":"2024-09-10T23:31:20.102882+0000","last_became_active":"2024-09-10T23:31:19.105999+0000","last_became_peered":"2024-09-10T23:31:19.105999+0000","last_unstale":"2024-09-10T23:31:20.102882+0000","last_undegraded":"2024-09-10T23:31:20.102882+0000","last_fullsized":"2024-09-10T23:31:20.102882+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.026835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.061011+0000","last_change":"2024-09-10T23:31:18.061011+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.061011+0000","last_undegraded":"2024-09-10T23:31:18.061011+0000","last_fullsized":"2024-09-10T23:31:18.061011+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105071+0000","last_change":"2024-09-10T23:31:19.091216+0000","last_active":"2024-09-10T23:31:20.105071+0000","last_peered":"2024-09-10T23:31:20.105071+0000","last_clean":"2024-09-10T23:31:20.105071+0000","last_became_active":"2024-09-10T23:31:19.090918+0000","last_became_peered":"2024-09-10T23:31:19.090918+0000","last_unstale":"2024-09-10T23:31:20.105071+0000","last_undegraded":"2024-09-10T23:31:20.105071+0000","last_fullsized":"2024-09-10T23:31:20.105071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:42.530144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102256+0000","last_change":"2024-09-10T23:31:19.098246+0000","last_active":"2024-09-10T23:31:20.102256+0000","last_peered":"2024-09-10T23:31:20.102256+0000","last_clean":"2024-09-10T23:31:20.102256+0000","last_became_active":"2024-09-10T23:31:19.097975+0000","last_became_peered":"2024-09-10T23:31:19.097975+0000","last_unstale":"2024-09-10T23:31:20.102256+0000","last_undegraded":"2024-09-10T23:31:20.102256+0000","last_fullsized":"2024-09-10T23:31:20.102256+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:40.965172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.060775+0000","last_change":"2024-09-10T23:31:18.060775+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.060775+0000","last_undegraded":"2024-09-10T23:31:18.060775+0000","last_fullsized":"2024-09-10T23:31:18.060775+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192639+0000","last_change":"2024-09-10T23:31:19.098520+0000","last_active":"2024-09-10T23:31:20.192639+0000","last_peered":"2024-09-10T23:31:20.192639+0000","last_clean":"2024-09-10T23:31:20.192639+0000","last_became_active":"2024-09-10T23:31:19.098200+0000","last_became_peered":"2024-09-10T23:31:19.098200+0000","last_unstale":"2024-09-10T23:31:20.192639+0000","last_undegraded":"2024-09-10T23:31:20.192639+0000","last_fullsized":"2024-09-10T23:31:20.192639+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.151774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192798+0000","last_change":"2024-09-10T23:31:19.098678+0000","last_active":"2024-09-10T23:31:20.192798+0000","last_peered":"2024-09-10T23:31:20.192798+0000","last_clean":"2024-09-10T23:31:20.192798+0000","last_became_active":"2024-09-10T23:31:19.098170+0000","last_became_peered":"2024-09-10T23:31:19.098170+0000","last_unstale":"2024-09-10T23:31:20.192798+0000","last_undegraded":"2024-09-10T23:31:20.192798+0000","last_fullsized":"2024-09-10T23:31:20.192798+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:07.897360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.060211+0000","last_change":"2024-09-10T23:31:18.060211+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.060211+0000","last_undegraded":"2024-09-10T23:31:18.060211+0000","last_fullsized":"2024-09-10T23:31:18.060211+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094472+0000","last_change":"2024-09-10T23:31:19.094064+0000","last_active":"2024-09-10T23:31:20.094472+0000","last_peered":"2024-09-10T23:31:20.094472+0000","last_clean":"2024-09-10T23:31:20.094472+0000","last_became_active":"2024-09-10T23:31:19.093135+0000","last_became_peered":"2024-09-10T23:31:19.093135+0000","last_unstale":"2024-09-10T23:31:20.094472+0000","last_undegraded":"2024-09-10T23:31:20.094472+0000","last_fullsized":"2024-09-10T23:31:20.094472+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:50.756718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086960+0000","last_change":"2024-09-10T23:31:19.080589+0000","last_active":"2024-09-10T23:31:20.086960+0000","last_peered":"2024-09-10T23:31:20.086960+0000","last_clean":"2024-09-10T23:31:20.086960+0000","last_became_active":"2024-09-10T23:31:19.077949+0000","last_became_peered":"2024-09-10T23:31:19.077949+0000","last_unstale":"2024-09-10T23:31:20.086960+0000","last_undegraded":"2024-09-10T23:31:20.086960+0000","last_fullsized":"2024-09-10T23:31:20.086960+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:09.621898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198488+0000","last_change":"2024-09-10T23:31:19.101714+0000","last_active":"2024-09-10T23:31:20.198488+0000","last_peered":"2024-09-10T23:31:20.198488+0000","last_clean":"2024-09-10T23:31:20.198488+0000","last_became_active":"2024-09-10T23:31:19.101460+0000","last_became_peered":"2024-09-10T23:31:19.101460+0000","last_unstale":"2024-09-10T23:31:20.198488+0000","last_undegraded":"2024-09-10T23:31:20.198488+0000","last_fullsized":"2024-09-10T23:31:20.198488+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:37.667145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192396+0000","last_change":"2024-09-10T23:31:19.083240+0000","last_active":"2024-09-10T23:31:20.192396+0000","last_peered":"2024-09-10T23:31:20.192396+0000","last_clean":"2024-09-10T23:31:20.192396+0000","last_became_active":"2024-09-10T23:31:19.082969+0000","last_became_peered":"2024-09-10T23:31:19.082969+0000","last_unstale":"2024-09-10T23:31:20.192396+0000","last_undegraded":"2024-09-10T23:31:20.192396+0000","last_fullsized":"2024-09-10T23:31:20.192396+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:01.871980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094849+0000","last_change":"2024-09-10T23:31:19.106578+0000","last_active":"2024-09-10T23:31:20.094849+0000","last_peered":"2024-09-10T23:31:20.094849+0000","last_clean":"2024-09-10T23:31:20.094849+0000","last_became_active":"2024-09-10T23:31:19.105865+0000","last_became_peered":"2024-09-10T23:31:19.105865+0000","last_unstale":"2024-09-10T23:31:20.094849+0000","last_undegraded":"2024-09-10T23:31:20.094849+0000","last_fullsized":"2024-09-10T23:31:20.094849+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:16.330127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192776+0000","last_change":"2024-09-10T23:31:19.082731+0000","last_active":"2024-09-10T23:31:20.192776+0000","last_peered":"2024-09-10T23:31:20.192776+0000","last_clean":"2024-09-10T23:31:20.192776+0000","last_became_active":"2024-09-10T23:31:19.080384+0000","last_became_peered":"2024-09-10T23:31:19.080384+0000","last_unstale":"2024-09-10T23:31:20.192776+0000","last_undegraded":"2024-09-10T23:31:20.192776+0000","last_fullsized":"2024-09-10T23:31:20.192776+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:42.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198839+0000","last_change":"2024-09-10T23:31:19.103536+0000","last_active":"2024-09-10T23:31:20.198839+0000","last_peered":"2024-09-10T23:31:20.198839+0000","last_clean":"2024-09-10T23:31:20.198839+0000","last_became_active":"2024-09-10T23:31:19.102843+0000","last_became_peered":"2024-09-10T23:31:19.102843+0000","last_unstale":"2024-09-10T23:31:20.198839+0000","last_undegraded":"2024-09-10T23:31:20.198839+0000","last_fullsized":"2024-09-10T23:31:20.198839+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:36.001349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194183+0000","last_change":"2024-09-10T23:31:19.099157+0000","last_active":"2024-09-10T23:31:20.194183+0000","last_peered":"2024-09-10T23:31:20.194183+0000","last_clean":"2024-09-10T23:31:20.194183+0000","last_became_active":"2024-09-10T23:31:19.098878+0000","last_became_peered":"2024-09-10T23:31:19.098878+0000","last_unstale":"2024-09-10T23:31:20.194183+0000","last_undegraded":"2024-09-10T23:31:20.194183+0000","last_fullsized":"2024-09-10T23:31:20.194183+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:04.700681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105122+0000","last_change":"2024-09-10T23:31:19.099725+0000","last_active":"2024-09-10T23:31:20.105122+0000","last_peered":"2024-09-10T23:31:20.105122+0000","last_clean":"2024-09-10T23:31:20.105122+0000","last_became_active":"2024-09-10T23:31:19.097618+0000","last_became_peered":"2024-09-10T23:31:19.097618+0000","last_unstale":"2024-09-10T23:31:20.105122+0000","last_undegraded":"2024-09-10T23:31:20.105122+0000","last_fullsized":"2024-09-10T23:31:20.105122+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:50.857332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094498+0000","last_change":"2024-09-10T23:31:19.097297+0000","last_active":"2024-09-10T23:31:20.094498+0000","last_peered":"2024-09-10T23:31:20.094498+0000","last_clean":"2024-09-10T23:31:20.094498+0000","last_became_active":"2024-09-10T23:31:19.097013+0000","last_became_peered":"2024-09-10T23:31:19.097013+0000","last_unstale":"2024-09-10T23:31:20.094498+0000","last_undegraded":"2024-09-10T23:31:20.094498+0000","last_fullsized":"2024-09-10T23:31:20.094498+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:13.020807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198693+0000","last_change":"2024-09-10T23:31:19.104434+0000","last_active":"2024-09-10T23:31:20.198693+0000","last_peered":"2024-09-10T23:31:20.198693+0000","last_clean":"2024-09-10T23:31:20.198693+0000","last_became_active":"2024-09-10T23:31:19.102729+0000","last_became_peered":"2024-09-10T23:31:19.102729+0000","last_unstale":"2024-09-10T23:31:20.198693+0000","last_undegraded":"2024-09-10T23:31:20.198693+0000","last_fullsized":"2024-09-10T23:31:20.198693+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:25.236930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094157+0000","last_change":"2024-09-10T23:31:19.092835+0000","last_active":"2024-09-10T23:31:20.094157+0000","last_peered":"2024-09-10T23:31:20.094157+0000","last_clean":"2024-09-10T23:31:20.094157+0000","last_became_active":"2024-09-10T23:31:19.092569+0000","last_became_peered":"2024-09-10T23:31:19.092569+0000","last_unstale":"2024-09-10T23:31:20.094157+0000","last_undegraded":"2024-09-10T23:31:20.094157+0000","last_fullsized":"2024-09-10T23:31:20.094157+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:45.600976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194606+0000","last_change":"2024-09-10T23:31:19.095134+0000","last_active":"2024-09-10T23:31:20.194606+0000","last_peered":"2024-09-10T23:31:20.194606+0000","last_clean":"2024-09-10T23:31:20.194606+0000","last_became_active":"2024-09-10T23:31:19.093338+0000","last_became_peered":"2024-09-10T23:31:19.093338+0000","last_unstale":"2024-09-10T23:31:20.194606+0000","last_undegraded":"2024-09-10T23:31:20.194606+0000","last_fullsized":"2024-09-10T23:31:20.194606+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:24.793170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105453+0000","last_change":"2024-09-10T23:31:19.094860+0000","last_active":"2024-09-10T23:31:20.105453+0000","last_peered":"2024-09-10T23:31:20.105453+0000","last_clean":"2024-09-10T23:31:20.105453+0000","last_became_active":"2024-09-10T23:31:19.092128+0000","last_became_peered":"2024-09-10T23:31:19.092128+0000","last_unstale":"2024-09-10T23:31:20.105453+0000","last_undegraded":"2024-09-10T23:31:20.105453+0000","last_fullsized":"2024-09-10T23:31:20.105453+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:22.506375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102610+0000","last_change":"2024-09-10T23:31:19.109738+0000","last_active":"2024-09-10T23:31:20.102610+0000","last_peered":"2024-09-10T23:31:20.102610+0000","last_clean":"2024-09-10T23:31:20.102610+0000","last_became_active":"2024-09-10T23:31:19.109432+0000","last_became_peered":"2024-09-10T23:31:19.109432+0000","last_unstale":"2024-09-10T23:31:20.102610+0000","last_undegraded":"2024-09-10T23:31:20.102610+0000","last_fullsized":"2024-09-10T23:31:20.102610+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:10.827017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.059817+0000","last_change":"2024-09-10T23:31:18.059817+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.059817+0000","last_undegraded":"2024-09-10T23:31:18.059817+0000","last_fullsized":"2024-09-10T23:31:18.059817+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087141+0000","last_change":"2024-09-10T23:31:19.081052+0000","last_active":"2024-09-10T23:31:20.087141+0000","last_peered":"2024-09-10T23:31:20.087141+0000","last_clean":"2024-09-10T23:31:20.087141+0000","last_became_active":"2024-09-10T23:31:19.080723+0000","last_became_peered":"2024-09-10T23:31:19.080723+0000","last_unstale":"2024-09-10T23:31:20.087141+0000","last_undegraded":"2024-09-10T23:31:20.087141+0000","last_fullsized":"2024-09-10T23:31:20.087141+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086951+0000","last_change":"2024-09-10T23:31:19.103280+0000","last_active":"2024-09-10T23:31:20.086951+0000","last_peered":"2024-09-10T23:31:20.086951+0000","last_clean":"2024-09-10T23:31:20.086951+0000","last_became_active":"2024-09-10T23:31:19.102558+0000","last_became_peered":"2024-09-10T23:31:19.102558+0000","last_unstale":"2024-09-10T23:31:20.086951+0000","last_undegraded":"2024-09-10T23:31:20.086951+0000","last_fullsized":"2024-09-10T23:31:20.086951+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193133+0000","last_change":"2024-09-10T23:31:19.093287+0000","last_active":"2024-09-10T23:31:20.193133+0000","last_peered":"2024-09-10T23:31:20.193133+0000","last_clean":"2024-09-10T23:31:20.193133+0000","last_became_active":"2024-09-10T23:31:19.093017+0000","last_became_peered":"2024-09-10T23:31:19.093017+0000","last_unstale":"2024-09-10T23:31:20.193133+0000","last_undegraded":"2024-09-10T23:31:20.193133+0000","last_fullsized":"2024-09-10T23:31:20.193133+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:33.239210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.059426+0000","last_change":"2024-09-10T23:31:18.059426+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.059426+0000","last_undegraded":"2024-09-10T23:31:18.059426+0000","last_fullsized":"2024-09-10T23:31:18.059426+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192217+0000","last_change":"2024-09-10T23:31:19.093746+0000","last_active":"2024-09-10T23:31:20.192217+0000","last_peered":"2024-09-10T23:31:20.192217+0000","last_clean":"2024-09-10T23:31:20.192217+0000","last_became_active":"2024-09-10T23:31:19.093431+0000","last_became_peered":"2024-09-10T23:31:19.093431+0000","last_unstale":"2024-09-10T23:31:20.192217+0000","last_undegraded":"2024-09-10T23:31:20.192217+0000","last_fullsized":"2024-09-10T23:31:20.192217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:53.986164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.078584+0000","last_change":"2024-09-10T23:31:18.076743+0000","last_active":"2024-09-10T23:31:18.078584+0000","last_peered":"2024-09-10T23:31:18.078584+0000","last_clean":"2024-09-10T23:31:18.078584+0000","last_became_active":"2024-09-10T23:31:18.076117+0000","last_became_peered":"2024-09-10T23:31:18.076117+0000","last_unstale":"2024-09-10T23:31:18.078584+0000","last_undegraded":"2024-09-10T23:31:18.078584+0000","last_fullsized":"2024-09-10T23:31:18.078584+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198594+0000","last_change":"2024-09-10T23:31:19.110826+0000","last_active":"2024-09-10T23:31:20.198594+0000","last_peered":"2024-09-10T23:31:20.198594+0000","last_clean":"2024-09-10T23:31:20.198594+0000","last_became_active":"2024-09-10T23:31:19.110510+0000","last_became_peered":"2024-09-10T23:31:19.110510+0000","last_unstale":"2024-09-10T23:31:20.198594+0000","last_undegraded":"2024-09-10T23:31:20.198594+0000","last_fullsized":"2024-09-10T23:31:20.198594+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:00.524828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094383+0000","last_change":"2024-09-10T23:31:18.084510+0000","last_active":"2024-09-10T23:31:20.094383+0000","last_peered":"2024-09-10T23:31:20.094383+0000","last_clean":"2024-09-10T23:31:20.094383+0000","last_became_active":"2024-09-10T23:31:18.084162+0000","last_became_peered":"2024-09-10T23:31:18.084162+0000","last_unstale":"2024-09-10T23:31:20.094383+0000","last_undegraded":"2024-09-10T23:31:20.094383+0000","last_fullsized":"2024-09-10T23:31:20.094383+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.097899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.066071+0000","last_change":"2024-09-10T23:31:18.066071+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.066071+0000","last_undegraded":"2024-09-10T23:31:18.066071+0000","last_fullsized":"2024-09-10T23:31:18.066071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087404+0000","last_change":"2024-09-10T23:31:18.073162+0000","last_active":"2024-09-10T23:31:20.087404+0000","last_peered":"2024-09-10T23:31:20.087404+0000","last_clean":"2024-09-10T23:31:20.087404+0000","last_became_active":"2024-09-10T23:31:18.072848+0000","last_became_peered":"2024-09-10T23:31:18.072848+0000","last_unstale":"2024-09-10T23:31:20.087404+0000","last_undegraded":"2024-09-10T23:31:20.087404+0000","last_fullsized":"2024-09-10T23:31:20.087404+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:43.878999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087312+0000","last_change":"2024-09-10T23:31:19.086134+0000","last_active":"2024-09-10T23:31:20.087312+0000","last_peered":"2024-09-10T23:31:20.087312+0000","last_clean":"2024-09-10T23:31:20.087312+0000","last_became_active":"2024-09-10T23:31:19.085823+0000","last_became_peered":"2024-09-10T23:31:19.085823+0000","last_unstale":"2024-09-10T23:31:20.087312+0000","last_undegraded":"2024-09-10T23:31:20.087312+0000","last_fullsized":"2024-09-10T23:31:20.087312+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198587+0000","last_change":"2024-09-10T23:31:18.085745+0000","last_active":"2024-09-10T23:31:20.198587+0000","last_peered":"2024-09-10T23:31:20.198587+0000","last_clean":"2024-09-10T23:31:20.198587+0000","last_became_active":"2024-09-10T23:31:18.085478+0000","last_became_peered":"2024-09-10T23:31:18.085478+0000","last_unstale":"2024-09-10T23:31:20.198587+0000","last_undegraded":"2024-09-10T23:31:20.198587+0000","last_fullsized":"2024-09-10T23:31:20.198587+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105410+0000","last_change":"2024-09-10T23:31:19.106907+0000","last_active":"2024-09-10T23:31:20.105410+0000","last_peered":"2024-09-10T23:31:20.105410+0000","last_clean":"2024-09-10T23:31:20.105410+0000","last_became_active":"2024-09-10T23:31:19.106522+0000","last_became_peered":"2024-09-10T23:31:19.106522+0000","last_unstale":"2024-09-10T23:31:20.105410+0000","last_undegraded":"2024-09-10T23:31:20.105410+0000","last_fullsized":"2024-09-10T23:31:20.105410+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:18.131377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087064+0000","last_change":"2024-09-10T23:31:18.072466+0000","last_active":"2024-09-10T23:31:20.087064+0000","last_peered":"2024-09-10T23:31:20.087064+0000","last_clean":"2024-09-10T23:31:20.087064+0000","last_became_active":"2024-09-10T23:31:18.071711+0000","last_became_peered":"2024-09-10T23:31:18.071711+0000","last_unstale":"2024-09-10T23:31:20.087064+0000","last_undegraded":"2024-09-10T23:31:20.087064+0000","last_fullsized":"2024-09-10T23:31:20.087064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:10.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192519+0000","last_change":"2024-09-10T23:31:19.081454+0000","last_active":"2024-09-10T23:31:20.192519+0000","last_peered":"2024-09-10T23:31:20.192519+0000","last_clean":"2024-09-10T23:31:20.192519+0000","last_became_active":"2024-09-10T23:31:19.080030+0000","last_became_peered":"2024-09-10T23:31:19.080030+0000","last_unstale":"2024-09-10T23:31:20.192519+0000","last_undegraded":"2024-09-10T23:31:20.192519+0000","last_fullsized":"2024-09-10T23:31:20.192519+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:55.794776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192620+0000","last_change":"2024-09-10T23:31:18.071545+0000","last_active":"2024-09-10T23:31:20.192620+0000","last_peered":"2024-09-10T23:31:20.192620+0000","last_clean":"2024-09-10T23:31:20.192620+0000","last_became_active":"2024-09-10T23:31:18.070999+0000","last_became_peered":"2024-09-10T23:31:18.070999+0000","last_unstale":"2024-09-10T23:31:20.192620+0000","last_undegraded":"2024-09-10T23:31:20.192620+0000","last_fullsized":"2024-09-10T23:31:20.192620+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:13.320251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102930+0000","last_change":"2024-09-10T23:31:19.108690+0000","last_active":"2024-09-10T23:31:20.102930+0000","last_peered":"2024-09-10T23:31:20.102930+0000","last_clean":"2024-09-10T23:31:20.102930+0000","last_became_active":"2024-09-10T23:31:19.108427+0000","last_became_peered":"2024-09-10T23:31:19.108427+0000","last_unstale":"2024-09-10T23:31:20.102930+0000","last_undegraded":"2024-09-10T23:31:20.102930+0000","last_fullsized":"2024-09-10T23:31:20.102930+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:46.359285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.073823+0000","last_change":"2024-09-10T23:31:18.068409+0000","last_active":"2024-09-10T23:31:18.073823+0000","last_peered":"2024-09-10T23:31:18.073823+0000","last_clean":"2024-09-10T23:31:18.073823+0000","last_became_active":"2024-09-10T23:31:18.068106+0000","last_became_peered":"2024-09-10T23:31:18.068106+0000","last_unstale":"2024-09-10T23:31:18.073823+0000","last_undegraded":"2024-09-10T23:31:18.073823+0000","last_fullsized":"2024-09-10T23:31:18.073823+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:01.406376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105021+0000","last_change":"2024-09-10T23:31:19.100589+0000","last_active":"2024-09-10T23:31:20.105021+0000","last_peered":"2024-09-10T23:31:20.105021+0000","last_clean":"2024-09-10T23:31:20.105021+0000","last_became_active":"2024-09-10T23:31:19.100313+0000","last_became_peered":"2024-09-10T23:31:19.100313+0000","last_unstale":"2024-09-10T23:31:20.105021+0000","last_undegraded":"2024-09-10T23:31:20.105021+0000","last_fullsized":"2024-09-10T23:31:20.105021+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:27.446745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087425+0000","last_change":"2024-09-10T23:31:18.077014+0000","last_active":"2024-09-10T23:31:20.087425+0000","last_peered":"2024-09-10T23:31:20.087425+0000","last_clean":"2024-09-10T23:31:20.087425+0000","last_became_active":"2024-09-10T23:31:18.076754+0000","last_became_peered":"2024-09-10T23:31:18.076754+0000","last_unstale":"2024-09-10T23:31:20.087425+0000","last_undegraded":"2024-09-10T23:31:20.087425+0000","last_fullsized":"2024-09-10T23:31:20.087425+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:27.536844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094124+0000","last_change":"2024-09-10T23:31:19.098486+0000","last_active":"2024-09-10T23:31:20.094124+0000","last_peered":"2024-09-10T23:31:20.094124+0000","last_clean":"2024-09-10T23:31:20.094124+0000","last_became_active":"2024-09-10T23:31:19.098206+0000","last_became_peered":"2024-09-10T23:31:19.098206+0000","last_unstale":"2024-09-10T23:31:20.094124+0000","last_undegraded":"2024-09-10T23:31:20.094124+0000","last_fullsized":"2024-09-10T23:31:20.094124+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:35.669124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192768+0000","last_change":"2024-09-10T23:31:18.079188+0000","last_active":"2024-09-10T23:31:20.192768+0000","last_peered":"2024-09-10T23:31:20.192768+0000","last_clean":"2024-09-10T23:31:20.192768+0000","last_became_active":"2024-09-10T23:31:18.078875+0000","last_became_peered":"2024-09-10T23:31:18.078875+0000","last_unstale":"2024-09-10T23:31:20.192768+0000","last_undegraded":"2024-09-10T23:31:20.192768+0000","last_fullsized":"2024-09-10T23:31:20.192768+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:21.354649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192579+0000","last_change":"2024-09-10T23:31:19.107187+0000","last_active":"2024-09-10T23:31:20.192579+0000","last_peered":"2024-09-10T23:31:20.192579+0000","last_clean":"2024-09-10T23:31:20.192579+0000","last_became_active":"2024-09-10T23:31:19.106681+0000","last_became_peered":"2024-09-10T23:31:19.106681+0000","last_unstale":"2024-09-10T23:31:20.192579+0000","last_undegraded":"2024-09-10T23:31:20.192579+0000","last_fullsized":"2024-09-10T23:31:20.192579+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.920623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"211'3","reported_seq":18,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102559+0000","last_change":"2024-09-10T23:31:18.073660+0000","last_active":"2024-09-10T23:31:20.102559+0000","last_peered":"2024-09-10T23:31:20.102559+0000","last_clean":"2024-09-10T23:31:20.102559+0000","last_became_active":"2024-09-10T23:31:18.072881+0000","last_became_peered":"2024-09-10T23:31:18.072881+0000","last_unstale":"2024-09-10T23:31:20.102559+0000","last_undegraded":"2024-09-10T23:31:20.102559+0000","last_fullsized":"2024-09-10T23:31:20.102559+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:17.944201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105092+0000","last_change":"2024-09-10T23:31:19.096083+0000","last_active":"2024-09-10T23:31:20.105092+0000","last_peered":"2024-09-10T23:31:20.105092+0000","last_clean":"2024-09-10T23:31:20.105092+0000","last_became_active":"2024-09-10T23:31:19.095779+0000","last_became_peered":"2024-09-10T23:31:19.095779+0000","last_unstale":"2024-09-10T23:31:20.105092+0000","last_undegraded":"2024-09-10T23:31:20.105092+0000","last_fullsized":"2024-09-10T23:31:20.105092+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:50.287034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.072525+0000","last_change":"2024-09-10T23:31:18.065614+0000","last_active":"2024-09-10T23:31:18.072525+0000","last_peered":"2024-09-10T23:31:18.072525+0000","last_clean":"2024-09-10T23:31:18.072525+0000","last_became_active":"2024-09-10T23:31:18.065239+0000","last_became_peered":"2024-09-10T23:31:18.065239+0000","last_unstale":"2024-09-10T23:31:18.072525+0000","last_undegraded":"2024-09-10T23:31:18.072525+0000","last_fullsized":"2024-09-10T23:31:18.072525+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:16.379329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193990+0000","last_change":"2024-09-10T23:31:19.090713+0000","last_active":"2024-09-10T23:31:20.193990+0000","last_peered":"2024-09-10T23:31:20.193990+0000","last_clean":"2024-09-10T23:31:20.193990+0000","last_became_active":"2024-09-10T23:31:19.089009+0000","last_became_peered":"2024-09-10T23:31:19.089009+0000","last_unstale":"2024-09-10T23:31:20.193990+0000","last_undegraded":"2024-09-10T23:31:20.193990+0000","last_fullsized":"2024-09-10T23:31:20.193990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:07.556427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198523+0000","last_change":"2024-09-10T23:31:18.082553+0000","last_active":"2024-09-10T23:31:20.198523+0000","last_peered":"2024-09-10T23:31:20.198523+0000","last_clean":"2024-09-10T23:31:20.198523+0000","last_became_active":"2024-09-10T23:31:18.082228+0000","last_became_peered":"2024-09-10T23:31:18.082228+0000","last_unstale":"2024-09-10T23:31:20.198523+0000","last_undegraded":"2024-09-10T23:31:20.198523+0000","last_fullsized":"2024-09-10T23:31:20.198523+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:41.522911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105367+0000","last_change":"2024-09-10T23:31:19.094510+0000","last_active":"2024-09-10T23:31:20.105367+0000","last_peered":"2024-09-10T23:31:20.105367+0000","last_clean":"2024-09-10T23:31:20.105367+0000","last_became_active":"2024-09-10T23:31:19.092810+0000","last_became_peered":"2024-09-10T23:31:19.092810+0000","last_unstale":"2024-09-10T23:31:20.105367+0000","last_undegraded":"2024-09-10T23:31:20.105367+0000","last_fullsized":"2024-09-10T23:31:20.105367+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:22.361882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102270+0000","last_change":"2024-09-10T23:31:18.086364+0000","last_active":"2024-09-10T23:31:20.102270+0000","last_peered":"2024-09-10T23:31:20.102270+0000","last_clean":"2024-09-10T23:31:20.102270+0000","last_became_active":"2024-09-10T23:31:18.086107+0000","last_became_peered":"2024-09-10T23:31:18.086107+0000","last_unstale":"2024-09-10T23:31:20.102270+0000","last_undegraded":"2024-09-10T23:31:20.102270+0000","last_fullsized":"2024-09-10T23:31:20.102270+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:20.135593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198696+0000","last_change":"2024-09-10T23:31:19.107551+0000","last_active":"2024-09-10T23:31:20.198696+0000","last_peered":"2024-09-10T23:31:20.198696+0000","last_clean":"2024-09-10T23:31:20.198696+0000","last_became_active":"2024-09-10T23:31:19.107264+0000","last_became_peered":"2024-09-10T23:31:19.107264+0000","last_unstale":"2024-09-10T23:31:20.198696+0000","last_undegraded":"2024-09-10T23:31:20.198696+0000","last_fullsized":"2024-09-10T23:31:20.198696+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:06.312069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102064+0000","last_change":"2024-09-10T23:31:18.081471+0000","last_active":"2024-09-10T23:31:20.102064+0000","last_peered":"2024-09-10T23:31:20.102064+0000","last_clean":"2024-09-10T23:31:20.102064+0000","last_became_active":"2024-09-10T23:31:18.080940+0000","last_became_peered":"2024-09-10T23:31:18.080940+0000","last_unstale":"2024-09-10T23:31:20.102064+0000","last_undegraded":"2024-09-10T23:31:20.102064+0000","last_fullsized":"2024-09-10T23:31:20.102064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:43.514503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102911+0000","last_change":"2024-09-10T23:31:19.105155+0000","last_active":"2024-09-10T23:31:20.102911+0000","last_peered":"2024-09-10T23:31:20.102911+0000","last_clean":"2024-09-10T23:31:20.102911+0000","last_became_active":"2024-09-10T23:31:19.104892+0000","last_became_peered":"2024-09-10T23:31:19.104892+0000","last_unstale":"2024-09-10T23:31:20.102911+0000","last_undegraded":"2024-09-10T23:31:20.102911+0000","last_fullsized":"2024-09-10T23:31:20.102911+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:37.315477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"211'8","reported_seq":23,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192327+0000","last_change":"2024-09-10T23:31:18.080071+0000","last_active":"2024-09-10T23:31:20.192327+0000","last_peered":"2024-09-10T23:31:20.192327+0000","last_clean":"2024-09-10T23:31:20.192327+0000","last_became_active":"2024-09-10T23:31:18.079813+0000","last_became_peered":"2024-09-10T23:31:18.079813+0000","last_unstale":"2024-09-10T23:31:20.192327+0000","last_undegraded":"2024-09-10T23:31:20.192327+0000","last_fullsized":"2024-09-10T23:31:20.192327+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:25.626605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102174+0000","last_change":"2024-09-10T23:31:19.102720+0000","last_active":"2024-09-10T23:31:20.102174+0000","last_peered":"2024-09-10T23:31:20.102174+0000","last_clean":"2024-09-10T23:31:20.102174+0000","last_became_active":"2024-09-10T23:31:19.102397+0000","last_became_peered":"2024-09-10T23:31:19.102397+0000","last_unstale":"2024-09-10T23:31:20.102174+0000","last_undegraded":"2024-09-10T23:31:20.102174+0000","last_fullsized":"2024-09-10T23:31:20.102174+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.681149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":10,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-10T23:31:18.075407+0000","last_change":"2024-09-10T23:31:18.073203+0000","last_active":"2024-09-10T23:31:18.075407+0000","last_peered":"2024-09-10T23:31:18.075407+0000","last_clean":"2024-09-10T23:31:18.075407+0000","last_became_active":"2024-09-10T23:31:18.072769+0000","last_became_peered":"2024-09-10T23:31:18.072769+0000","last_unstale":"2024-09-10T23:31:18.075407+0000","last_undegraded":"2024-09-10T23:31:18.075407+0000","last_fullsized":"2024-09-10T23:31:18.075407+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:49.230178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102172+0000","last_change":"2024-09-10T23:31:19.104376+0000","last_active":"2024-09-10T23:31:20.102172+0000","last_peered":"2024-09-10T23:31:20.102172+0000","last_clean":"2024-09-10T23:31:20.102172+0000","last_became_active":"2024-09-10T23:31:19.102719+0000","last_became_peered":"2024-09-10T23:31:19.102719+0000","last_unstale":"2024-09-10T23:31:20.102172+0000","last_undegraded":"2024-09-10T23:31:20.102172+0000","last_fullsized":"2024-09-10T23:31:20.102172+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:56.299808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194495+0000","last_change":"2024-09-10T23:31:18.074043+0000","last_active":"2024-09-10T23:31:20.194495+0000","last_peered":"2024-09-10T23:31:20.194495+0000","last_clean":"2024-09-10T23:31:20.194495+0000","last_became_active":"2024-09-10T23:31:18.073766+0000","last_became_peered":"2024-09-10T23:31:18.073766+0000","last_unstale":"2024-09-10T23:31:20.194495+0000","last_undegraded":"2024-09-10T23:31:20.194495+0000","last_fullsized":"2024-09-10T23:31:20.194495+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:41.950907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193217+0000","last_change":"2024-09-10T23:31:19.102248+0000","last_active":"2024-09-10T23:31:20.193217+0000","last_peered":"2024-09-10T23:31:20.193217+0000","last_clean":"2024-09-10T23:31:20.193217+0000","last_became_active":"2024-09-10T23:31:19.101921+0000","last_became_peered":"2024-09-10T23:31:19.101921+0000","last_unstale":"2024-09-10T23:31:20.193217+0000","last_undegraded":"2024-09-10T23:31:20.193217+0000","last_fullsized":"2024-09-10T23:31:20.193217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:33.277637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094509+0000","last_change":"2024-09-10T23:31:18.084654+0000","last_active":"2024-09-10T23:31:20.094509+0000","last_peered":"2024-09-10T23:31:20.094509+0000","last_clean":"2024-09-10T23:31:20.094509+0000","last_became_active":"2024-09-10T23:31:18.084150+0000","last_became_peered":"2024-09-10T23:31:18.084150+0000","last_unstale":"2024-09-10T23:31:20.094509+0000","last_undegraded":"2024-09-10T23:31:20.094509+0000","last_fullsized":"2024-09-10T23:31:20.094509+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:28.813302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192910+0000","last_change":"2024-09-10T23:31:19.107063+0000","last_active":"2024-09-10T23:31:20.192910+0000","last_peered":"2024-09-10T23:31:20.192910+0000","last_clean":"2024-09-10T23:31:20.192910+0000","last_became_active":"2024-09-10T23:31:19.106793+0000","last_became_peered":"2024-09-10T23:31:19.106793+0000","last_unstale":"2024-09-10T23:31:20.192910+0000","last_undegraded":"2024-09-10T23:31:20.192910+0000","last_fullsized":"2024-09-10T23:31:20.192910+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:58.414351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198722+0000","last_change":"2024-09-10T23:31:18.075017+0000","last_active":"2024-09-10T23:31:20.198722+0000","last_peered":"2024-09-10T23:31:20.198722+0000","last_clean":"2024-09-10T23:31:20.198722+0000","last_became_active":"2024-09-10T23:31:18.073860+0000","last_became_peered":"2024-09-10T23:31:18.073860+0000","last_unstale":"2024-09-10T23:31:20.198722+0000","last_undegraded":"2024-09-10T23:31:20.198722+0000","last_fullsized":"2024-09-10T23:31:20.198722+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:09.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192182+0000","last_change":"2024-09-10T23:31:19.084774+0000","last_active":"2024-09-10T23:31:20.192182+0000","last_peered":"2024-09-10T23:31:20.192182+0000","last_clean":"2024-09-10T23:31:20.192182+0000","last_became_active":"2024-09-10T23:31:19.083516+0000","last_became_peered":"2024-09-10T23:31:19.083516+0000","last_unstale":"2024-09-10T23:31:20.192182+0000","last_undegraded":"2024-09-10T23:31:20.192182+0000","last_fullsized":"2024-09-10T23:31:20.192182+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193021+0000","last_change":"2024-09-10T23:31:18.070568+0000","last_active":"2024-09-10T23:31:20.193021+0000","last_peered":"2024-09-10T23:31:20.193021+0000","last_clean":"2024-09-10T23:31:20.193021+0000","last_became_active":"2024-09-10T23:31:18.070110+0000","last_became_peered":"2024-09-10T23:31:18.070110+0000","last_unstale":"2024-09-10T23:31:20.193021+0000","last_undegraded":"2024-09-10T23:31:20.193021+0000","last_fullsized":"2024-09-10T23:31:20.193021+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:17.124144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194213+0000","last_change":"2024-09-10T23:31:19.094490+0000","last_active":"2024-09-10T23:31:20.194213+0000","last_peered":"2024-09-10T23:31:20.194213+0000","last_clean":"2024-09-10T23:31:20.194213+0000","last_became_active":"2024-09-10T23:31:19.094236+0000","last_became_peered":"2024-09-10T23:31:19.094236+0000","last_unstale":"2024-09-10T23:31:20.194213+0000","last_undegraded":"2024-09-10T23:31:20.194213+0000","last_fullsized":"2024-09-10T23:31:20.194213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:28.628059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094462+0000","last_change":"2024-09-10T23:31:18.068183+0000","last_active":"2024-09-10T23:31:20.094462+0000","last_peered":"2024-09-10T23:31:20.094462+0000","last_clean":"2024-09-10T23:31:20.094462+0000","last_became_active":"2024-09-10T23:31:18.067814+0000","last_became_peered":"2024-09-10T23:31:18.067814+0000","last_unstale":"2024-09-10T23:31:20.094462+0000","last_undegraded":"2024-09-10T23:31:20.094462+0000","last_fullsized":"2024-09-10T23:31:20.094462+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:42.363754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094491+0000","last_change":"2024-09-10T23:31:19.099060+0000","last_active":"2024-09-10T23:31:20.094491+0000","last_peered":"2024-09-10T23:31:20.094491+0000","last_clean":"2024-09-10T23:31:20.094491+0000","last_became_active":"2024-09-10T23:31:19.098576+0000","last_became_peered":"2024-09-10T23:31:19.098576+0000","last_unstale":"2024-09-10T23:31:20.094491+0000","last_undegraded":"2024-09-10T23:31:20.094491+0000","last_fullsized":"2024-09-10T23:31:20.094491+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:27.428492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093973+0000","last_change":"2024-09-10T23:31:18.076954+0000","last_active":"2024-09-10T23:31:20.093973+0000","last_peered":"2024-09-10T23:31:20.093973+0000","last_clean":"2024-09-10T23:31:20.093973+0000","last_became_active":"2024-09-10T23:31:18.076673+0000","last_became_peered":"2024-09-10T23:31:18.076673+0000","last_unstale":"2024-09-10T23:31:20.093973+0000","last_undegraded":"2024-09-10T23:31:20.093973+0000","last_fullsized":"2024-09-10T23:31:20.093973+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:37.993408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094762+0000","last_change":"2024-09-10T23:31:19.102914+0000","last_active":"2024-09-10T23:31:20.094762+0000","last_peered":"2024-09-10T23:31:20.094762+0000","last_clean":"2024-09-10T23:31:20.094762+0000","last_became_active":"2024-09-10T23:31:19.102662+0000","last_became_peered":"2024-09-10T23:31:19.102662+0000","last_unstale":"2024-09-10T23:31:20.094762+0000","last_undegraded":"2024-09-10T23:31:20.094762+0000","last_fullsized":"2024-09-10T23:31:20.094762+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:03.963145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086835+0000","last_change":"2024-09-10T23:31:18.074711+0000","last_active":"2024-09-10T23:31:20.086835+0000","last_peered":"2024-09-10T23:31:20.086835+0000","last_clean":"2024-09-10T23:31:20.086835+0000","last_became_active":"2024-09-10T23:31:18.074079+0000","last_became_peered":"2024-09-10T23:31:18.074079+0000","last_unstale":"2024-09-10T23:31:20.086835+0000","last_undegraded":"2024-09-10T23:31:20.086835+0000","last_fullsized":"2024-09-10T23:31:20.086835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:21.499142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104963+0000","last_change":"2024-09-10T23:31:19.091779+0000","last_active":"2024-09-10T23:31:20.104963+0000","last_peered":"2024-09-10T23:31:20.104963+0000","last_clean":"2024-09-10T23:31:20.104963+0000","last_became_active":"2024-09-10T23:31:19.091404+0000","last_became_peered":"2024-09-10T23:31:19.091404+0000","last_unstale":"2024-09-10T23:31:20.104963+0000","last_undegraded":"2024-09-10T23:31:20.104963+0000","last_fullsized":"2024-09-10T23:31:20.104963+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:02.528031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192714+0000","last_change":"2024-09-10T23:31:18.082254+0000","last_active":"2024-09-10T23:31:20.192714+0000","last_peered":"2024-09-10T23:31:20.192714+0000","last_clean":"2024-09-10T23:31:20.192714+0000","last_became_active":"2024-09-10T23:31:18.081963+0000","last_became_peered":"2024-09-10T23:31:18.081963+0000","last_unstale":"2024-09-10T23:31:20.192714+0000","last_undegraded":"2024-09-10T23:31:20.192714+0000","last_fullsized":"2024-09-10T23:31:20.192714+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198454+0000","last_change":"2024-09-10T23:31:19.104473+0000","last_active":"2024-09-10T23:31:20.198454+0000","last_peered":"2024-09-10T23:31:20.198454+0000","last_clean":"2024-09-10T23:31:20.198454+0000","last_became_active":"2024-09-10T23:31:19.104186+0000","last_became_peered":"2024-09-10T23:31:19.104186+0000","last_unstale":"2024-09-10T23:31:20.198454+0000","last_undegraded":"2024-09-10T23:31:20.198454+0000","last_fullsized":"2024-09-10T23:31:20.198454+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:20.987147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"212'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104384+0000","last_change":"2024-09-10T23:31:18.079920+0000","last_active":"2024-09-10T23:31:20.104384+0000","last_peered":"2024-09-10T23:31:20.104384+0000","last_clean":"2024-09-10T23:31:20.104384+0000","last_became_active":"2024-09-10T23:31:18.079584+0000","last_became_peered":"2024-09-10T23:31:18.079584+0000","last_unstale":"2024-09-10T23:31:20.104384+0000","last_undegraded":"2024-09-10T23:31:20.104384+0000","last_fullsized":"2024-09-10T23:31:20.104384+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:33.922546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192416+0000","last_change":"2024-09-10T23:31:19.080253+0000","last_active":"2024-09-10T23:31:20.192416+0000","last_peered":"2024-09-10T23:31:20.192416+0000","last_clean":"2024-09-10T23:31:20.192416+0000","last_became_active":"2024-09-10T23:31:19.079908+0000","last_became_peered":"2024-09-10T23:31:19.079908+0000","last_unstale":"2024-09-10T23:31:20.192416+0000","last_undegraded":"2024-09-10T23:31:20.192416+0000","last_fullsized":"2024-09-10T23:31:20.192416+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087252+0000","last_change":"2024-09-10T23:31:18.080655+0000","last_active":"2024-09-10T23:31:20.087252+0000","last_peered":"2024-09-10T23:31:20.087252+0000","last_clean":"2024-09-10T23:31:20.087252+0000","last_became_active":"2024-09-10T23:31:18.080370+0000","last_became_peered":"2024-09-10T23:31:18.080370+0000","last_unstale":"2024-09-10T23:31:20.087252+0000","last_undegraded":"2024-09-10T23:31:20.087252+0000","last_fullsized":"2024-09-10T23:31:20.087252+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:55.916497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102543+0000","last_change":"2024-09-10T23:31:19.106872+0000","last_active":"2024-09-10T23:31:20.102543+0000","last_peered":"2024-09-10T23:31:20.102543+0000","last_clean":"2024-09-10T23:31:20.102543+0000","last_became_active":"2024-09-10T23:31:19.106326+0000","last_became_peered":"2024-09-10T23:31:19.106326+0000","last_unstale":"2024-09-10T23:31:20.102543+0000","last_undegraded":"2024-09-10T23:31:20.102543+0000","last_fullsized":"2024-09-10T23:31:20.102543+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:27.217918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087413+0000","last_change":"2024-09-10T23:31:18.074710+0000","last_active":"2024-09-10T23:31:20.087413+0000","last_peered":"2024-09-10T23:31:20.087413+0000","last_clean":"2024-09-10T23:31:20.087413+0000","last_became_active":"2024-09-10T23:31:18.074405+0000","last_became_peered":"2024-09-10T23:31:18.074405+0000","last_unstale":"2024-09-10T23:31:20.087413+0000","last_undegraded":"2024-09-10T23:31:20.087413+0000","last_fullsized":"2024-09-10T23:31:20.087413+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:46.035443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087213+0000","last_change":"2024-09-10T23:31:19.090048+0000","last_active":"2024-09-10T23:31:20.087213+0000","last_peered":"2024-09-10T23:31:20.087213+0000","last_clean":"2024-09-10T23:31:20.087213+0000","last_became_active":"2024-09-10T23:31:19.088979+0000","last_became_peered":"2024-09-10T23:31:19.088979+0000","last_unstale":"2024-09-10T23:31:20.087213+0000","last_undegraded":"2024-09-10T23:31:20.087213+0000","last_fullsized":"2024-09-10T23:31:20.087213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:43.080975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094212+0000","last_change":"2024-09-10T23:31:18.068905+0000","last_active":"2024-09-10T23:31:20.094212+0000","last_peered":"2024-09-10T23:31:20.094212+0000","last_clean":"2024-09-10T23:31:20.094212+0000","last_became_active":"2024-09-10T23:31:18.068607+0000","last_became_peered":"2024-09-10T23:31:18.068607+0000","last_unstale":"2024-09-10T23:31:20.094212+0000","last_undegraded":"2024-09-10T23:31:20.094212+0000","last_fullsized":"2024-09-10T23:31:20.094212+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:36.784830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.064604+0000","last_change":"2024-09-10T23:31:18.064604+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.064604+0000","last_undegraded":"2024-09-10T23:31:18.064604+0000","last_fullsized":"2024-09-10T23:31:18.064604+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102406+0000","last_change":"2024-09-10T23:31:18.076160+0000","last_active":"2024-09-10T23:31:20.102406+0000","last_peered":"2024-09-10T23:31:20.102406+0000","last_clean":"2024-09-10T23:31:20.102406+0000","last_became_active":"2024-09-10T23:31:18.075439+0000","last_became_peered":"2024-09-10T23:31:18.075439+0000","last_unstale":"2024-09-10T23:31:20.102406+0000","last_undegraded":"2024-09-10T23:31:20.102406+0000","last_fullsized":"2024-09-10T23:31:20.102406+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.238398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194378+0000","last_change":"2024-09-10T23:31:19.087302+0000","last_active":"2024-09-10T23:31:20.194378+0000","last_peered":"2024-09-10T23:31:20.194378+0000","last_clean":"2024-09-10T23:31:20.194378+0000","last_became_active":"2024-09-10T23:31:19.087002+0000","last_became_peered":"2024-09-10T23:31:19.087002+0000","last_unstale":"2024-09-10T23:31:20.194378+0000","last_undegraded":"2024-09-10T23:31:20.194378+0000","last_fullsized":"2024-09-10T23:31:20.194378+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:16.875377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192740+0000","last_change":"2024-09-10T23:31:18.071251+0000","last_active":"2024-09-10T23:31:20.192740+0000","last_peered":"2024-09-10T23:31:20.192740+0000","last_clean":"2024-09-10T23:31:20.192740+0000","last_became_active":"2024-09-10T23:31:18.070638+0000","last_became_peered":"2024-09-10T23:31:18.070638+0000","last_unstale":"2024-09-10T23:31:20.192740+0000","last_undegraded":"2024-09-10T23:31:20.192740+0000","last_fullsized":"2024-09-10T23:31:20.192740+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094695+0000","last_change":"2024-09-10T23:31:19.096247+0000","last_active":"2024-09-10T23:31:20.094695+0000","last_peered":"2024-09-10T23:31:20.094695+0000","last_clean":"2024-09-10T23:31:20.094695+0000","last_became_active":"2024-09-10T23:31:19.095981+0000","last_became_peered":"2024-09-10T23:31:19.095981+0000","last_unstale":"2024-09-10T23:31:20.094695+0000","last_undegraded":"2024-09-10T23:31:20.094695+0000","last_fullsized":"2024-09-10T23:31:20.094695+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:24.795258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093794+0000","last_change":"2024-09-10T23:31:18.072179+0000","last_active":"2024-09-10T23:31:20.093794+0000","last_peered":"2024-09-10T23:31:20.093794+0000","last_clean":"2024-09-10T23:31:20.093794+0000","last_became_active":"2024-09-10T23:31:18.071874+0000","last_became_peered":"2024-09-10T23:31:18.071874+0000","last_unstale":"2024-09-10T23:31:20.093794+0000","last_undegraded":"2024-09-10T23:31:20.093794+0000","last_fullsized":"2024-09-10T23:31:20.093794+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:57.312073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-10T23:31:18.062253+0000","last_change":"2024-09-10T23:31:18.062253+0000","last_active":"2024-09-10T23:31:18.046084+0000","last_peered":"2024-09-10T23:31:18.046084+0000","last_clean":"2024-09-10T23:31:18.046084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:18.062253+0000","last_undegraded":"2024-09-10T23:31:18.062253+0000","last_fullsized":"2024-09-10T23:31:18.062253+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105346+0000","last_change":"2024-09-10T23:31:18.079488+0000","last_active":"2024-09-10T23:31:20.105346+0000","last_peered":"2024-09-10T23:31:20.105346+0000","last_clean":"2024-09-10T23:31:20.105346+0000","last_became_active":"2024-09-10T23:31:18.077598+0000","last_became_peered":"2024-09-10T23:31:18.077598+0000","last_unstale":"2024-09-10T23:31:20.105346+0000","last_undegraded":"2024-09-10T23:31:20.105346+0000","last_fullsized":"2024-09-10T23:31:20.105346+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:44.046563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":455,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198199+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:31:20.198199+0000","last_peered":"2024-09-10T23:31:20.198199+0000","last_clean":"2024-09-10T23:31:20.198199+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:31:20.198199+0000","last_undegraded":"2024-09-10T23:31:20.198199+0000","last_fullsized":"2024-09-10T23:31:20.198199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":194,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476930,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74004,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297836,"statfs":{"total":96636764160,"available":96560984064,"internally_reserved":0,"allocated":2682880,"data_stored":1259240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509635,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74576,"kb_used_data":3188,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297264,"statfs":{"total":96636764160,"available":96560398336,"internally_reserved":0,"allocated":3264512,"data_stored":1842928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73071050},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509634,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47684,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324156,"statfs":{"total":96636764160,"available":96587935744,"internally_reserved":0,"allocated":2662400,"data_stored":1252436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509635,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74048,"kb_used_data":2604,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297792,"statfs":{"total":96636764160,"available":96560939008,"internally_reserved":0,"allocated":2666496,"data_stored":1252506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74052,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297788,"statfs":{"total":96636764160,"available":96560934912,"internally_reserved":0,"allocated":2670592,"data_stored":1253088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509635,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47676,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324164,"statfs":{"total":96636764160,"available":96587943936,"internally_reserved":0,"allocated":2662400,"data_stored":1252436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78800,"kb_used_data":3192,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293040,"statfs":{"total":96636764160,"available":96556072960,"internally_reserved":0,"allocated":3268608,"data_stored":1844416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73960,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297880,"statfs":{"total":96636764160,"available":96561029120,"internally_reserved":0,"allocated":2637824,"data_stored":1238602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:31:24.055 INFO:tasks.ceph.ceph_manager.ceph:PG 32.1f is not active+clean 2024-09-10T23:31:24.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 210, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:31:18.061879+0000', 'last_change': '2024-09-10T23:31:18.061879+0000', 'last_active': '2024-09-10T23:31:18.046084+0000', 'last_peered': '2024-09-10T23:31:18.046084+0000', 'last_clean': '2024-09-10T23:31:18.046084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:31:18.061879+0000', 'last_undegraded': '2024-09-10T23:31:18.061879+0000', 'last_fullsized': '2024-09-10T23:31:18.061879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_clean_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:31:24.055 INFO:tasks.ceph.ceph_manager.ceph:PG 32.1a is not active+clean 2024-09-10T23:31:24.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 210, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:31:18.061011+0000', 'last_change': '2024-09-10T23:31:18.061011+0000', 'last_active': '2024-09-10T23:31:18.046084+0000', 'last_peered': '2024-09-10T23:31:18.046084+0000', 'last_clean': '2024-09-10T23:31:18.046084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:31:18.061011+0000', 'last_undegraded': '2024-09-10T23:31:18.061011+0000', 'last_fullsized': '2024-09-10T23:31:18.061011+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_clean_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:31:24.055 INFO:tasks.ceph.ceph_manager.ceph:PG 32.17 is not active+clean 2024-09-10T23:31:24.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 210, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:31:18.060775+0000', 'last_change': '2024-09-10T23:31:18.060775+0000', 'last_active': '2024-09-10T23:31:18.046084+0000', 'last_peered': '2024-09-10T23:31:18.046084+0000', 'last_clean': '2024-09-10T23:31:18.046084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:31:18.060775+0000', 'last_undegraded': '2024-09-10T23:31:18.060775+0000', 'last_fullsized': '2024-09-10T23:31:18.060775+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_clean_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:PG 32.14 is not active+clean 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 210, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:31:18.060211+0000', 'last_change': '2024-09-10T23:31:18.060211+0000', 'last_active': '2024-09-10T23:31:18.046084+0000', 'last_peered': '2024-09-10T23:31:18.046084+0000', 'last_clean': '2024-09-10T23:31:18.046084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:31:18.060211+0000', 'last_undegraded': '2024-09-10T23:31:18.060211+0000', 'last_fullsized': '2024-09-10T23:31:18.060211+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_clean_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:PG 32.4 is not active+clean 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 210, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:31:18.059817+0000', 'last_change': '2024-09-10T23:31:18.059817+0000', 'last_active': '2024-09-10T23:31:18.046084+0000', 'last_peered': '2024-09-10T23:31:18.046084+0000', 'last_clean': '2024-09-10T23:31:18.046084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:31:18.059817+0000', 'last_undegraded': '2024-09-10T23:31:18.059817+0000', 'last_fullsized': '2024-09-10T23:31:18.059817+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_clean_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:PG 32.0 is not active+clean 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 210, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:31:18.059426+0000', 'last_change': '2024-09-10T23:31:18.059426+0000', 'last_active': '2024-09-10T23:31:18.046084+0000', 'last_peered': '2024-09-10T23:31:18.046084+0000', 'last_clean': '2024-09-10T23:31:18.046084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:31:18.059426+0000', 'last_undegraded': '2024-09-10T23:31:18.059426+0000', 'last_fullsized': '2024-09-10T23:31:18.059426+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_clean_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:PG 32.23 is not active+clean 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 210, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:31:18.066071+0000', 'last_change': '2024-09-10T23:31:18.066071+0000', 'last_active': '2024-09-10T23:31:18.046084+0000', 'last_peered': '2024-09-10T23:31:18.046084+0000', 'last_clean': '2024-09-10T23:31:18.046084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:31:18.066071+0000', 'last_undegraded': '2024-09-10T23:31:18.066071+0000', 'last_fullsized': '2024-09-10T23:31:18.066071+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_clean_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:PG 32.3d is not active+clean 2024-09-10T23:31:24.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 210, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:31:18.064604+0000', 'last_change': '2024-09-10T23:31:18.064604+0000', 'last_active': '2024-09-10T23:31:18.046084+0000', 'last_peered': '2024-09-10T23:31:18.046084+0000', 'last_clean': '2024-09-10T23:31:18.046084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:31:18.064604+0000', 'last_undegraded': '2024-09-10T23:31:18.064604+0000', 'last_fullsized': '2024-09-10T23:31:18.064604+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_clean_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:31:24.057 INFO:tasks.ceph.ceph_manager.ceph:PG 32.21 is not active+clean 2024-09-10T23:31:24.057 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '32.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 210, 'state': 'creating+peering', 'last_fresh': '2024-09-10T23:31:18.062253+0000', 'last_change': '2024-09-10T23:31:18.062253+0000', 'last_active': '2024-09-10T23:31:18.046084+0000', 'last_peered': '2024-09-10T23:31:18.046084+0000', 'last_clean': '2024-09-10T23:31:18.046084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T23:31:18.062253+0000', 'last_undegraded': '2024-09-10T23:31:18.062253+0000', 'last_fullsized': '2024-09-10T23:31:18.062253+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'last_clean_scrub_stamp': '2024-09-10T23:31:18.046084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T23:31:24.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T23:31:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.243+0000 7fbad9400640 1 -- 172.21.15.17:0/2804211260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad415f620 msgr2=0x7fbad40d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.243+0000 7fbad9400640 1 --2- 172.21.15.17:0/2804211260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad415f620 0x7fbad40d2890 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009840 tx=0x7fbabc01c6d0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.243+0000 7fbad9400640 1 -- 172.21.15.17:0/2804211260 shutdown_connections 2024-09-10T23:31:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.243+0000 7fbad9400640 1 --2- 172.21.15.17:0/2804211260 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbad40d03f0 0x7fbad40aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.243+0000 7fbad9400640 1 --2- 172.21.15.17:0/2804211260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad415f620 0x7fbad40d2890 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.243+0000 7fbad9400640 1 -- 172.21.15.17:0/2804211260 >> 172.21.15.17:0/2804211260 conn(0x7fbad40d1d70 msgr2=0x7fbad40d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.243+0000 7fbad9400640 1 -- 172.21.15.17:0/2804211260 shutdown_connections 2024-09-10T23:31:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.243+0000 7fbad9400640 1 -- 172.21.15.17:0/2804211260 wait complete. 2024-09-10T23:31:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.243+0000 7fbad9400640 1 Processor -- start 2024-09-10T23:31:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 -- start start 2024-09-10T23:31:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad40d03f0 0x7fbad40cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbad415f240 0x7fbad4154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbad415f620 0x7fbad4147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4169190 con 0x7fbad40d03f0 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4169010 con 0x7fbad415f240 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbad4169310 con 0x7fbad415f620 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad40d03f0 0x7fbad40cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad40d03f0 0x7fbad40cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44338/0 (socket says 172.21.15.17:44338) 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad2800640 1 -- 172.21.15.17:0/127102849 learned_addr learned my addr 172.21.15.17:0/127102849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad3200640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbad415f620 0x7fbad4147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbacbe00640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbad415f240 0x7fbad4154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad2800640 1 -- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbad415f620 msgr2=0x7fbad4147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad2800640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbad415f620 0x7fbad4147a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad2800640 1 -- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbad415f240 msgr2=0x7fbad4154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad2800640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbad415f240 0x7fbad4154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad2800640 1 -- 172.21.15.17:0/127102849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad4155d40 con 0x7fbad40d03f0 2024-09-10T23:31:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad2800640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad40d03f0 0x7fbad40cf1c0 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c450 tx=0x7fbac400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbacaa00640 1 -- 172.21.15.17:0/127102849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4016020 con 0x7fbad40d03f0 2024-09-10T23:31:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbacaa00640 1 -- 172.21.15.17:0/127102849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbac4012920 con 0x7fbad40d03f0 2024-09-10T23:31:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbacaa00640 1 -- 172.21.15.17:0/127102849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4012d70 con 0x7fbad40d03f0 2024-09-10T23:31:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad41486e0 con 0x7fbad40d03f0 2024-09-10T23:31:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad40b76a0 con 0x7fbad40d03f0 2024-09-10T23:31:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.247+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad40aeb00 con 0x7fbad40d03f0 2024-09-10T23:31:24.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.251+0000 7fbacaa00640 1 -- 172.21.15.17:0/127102849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbac401b400 con 0x7fbad40d03f0 2024-09-10T23:31:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.251+0000 7fbacaa00640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbab00725e0 0x7fbab0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.251+0000 7fbacaa00640 1 -- 172.21.15.17:0/127102849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fbac4093250 con 0x7fbad40d03f0 2024-09-10T23:31:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.251+0000 7fbacbe00640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbab00725e0 0x7fbab0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.251+0000 7fbacbe00640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbab00725e0 0x7fbab0074aa0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0af000 tx=0x7fbabc01af10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:24.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.255+0000 7fbacaa00640 1 -- 172.21.15.17:0/127102849 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbac4020030 con 0x7fbad40d03f0 2024-09-10T23:31:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.495+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbad406d150 con 0x7fbad40d03f0 2024-09-10T23:31:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.495+0000 7fbacaa00640 1 -- 172.21.15.17:0/127102849 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2631 (secure 0 0 0) 0x7fbac405e150 con 0x7fbad40d03f0 2024-09-10T23:31:24.497 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:24.498 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":973,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":212,"num_osds":8,"num_up_osds":8,"osd_up_since":1726010125,"num_in_osds":8,"osd_in_since":1726010114,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":88},{"state_name":"creating+peering","count":9}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":590562,"bytes_used":557875200,"bytes_avail":772536238080,"bytes_total":773094113280,"inactive_pgs_ratio":0.092783503234386444,"write_bytes_sec":1684,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":161,"btime":"2024-09-10T23:31:22:092426+0000","id":15,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":15,"rank":0,"name":"d","status":"up:active","gid":11463}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":39,"modified":"2024-09-10T23:31:18.523838+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T23:31:24.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbab00725e0 msgr2=0x7fbab0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbab00725e0 0x7fbab0074aa0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0af000 tx=0x7fbabc01af10 comp rx=0 tx=0).stop 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad40d03f0 msgr2=0x7fbad40cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad40d03f0 0x7fbad40cf1c0 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7fbac400c450 tx=0x7fbac400c910 comp rx=0 tx=0).stop 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 shutdown_connections 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbab00725e0 0x7fbab0074aa0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbad415f620 0x7fbad4147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbad415f240 0x7fbad4154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 --2- 172.21.15.17:0/127102849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbad40d03f0 0x7fbad40cf1c0 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 >> 172.21.15.17:0/127102849 conn(0x7fbad40d1d70 msgr2=0x7fbad4159560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 shutdown_connections 2024-09-10T23:31:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.499+0000 7fbad9400640 1 -- 172.21.15.17:0/127102849 wait complete. 2024-09-10T23:31:24.519 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T23:31:24.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:31:24.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 -- 172.21.15.17:0/2320196663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 msgr2=0x7f726c0ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 --2- 172.21.15.17:0/2320196663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 0x7f726c0ce580 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f726c073f70 tx=0x7f726401ccf0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 -- 172.21.15.17:0/2320196663 shutdown_connections 2024-09-10T23:31:24.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 --2- 172.21.15.17:0/2320196663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 0x7f726c0ce580 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 --2- 172.21.15.17:0/2320196663 >> v2:172.21.15.77:3300/0 conn(0x7f726c0d2a60 0x7f726c0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 --2- 172.21.15.17:0/2320196663 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f726c15bf20 0x7f726c0cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 -- 172.21.15.17:0/2320196663 >> 172.21.15.17:0/2320196663 conn(0x7f726c0d1e40 msgr2=0x7f726c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:24.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 -- 172.21.15.17:0/2320196663 shutdown_connections 2024-09-10T23:31:24.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 -- 172.21.15.17:0/2320196663 wait complete. 2024-09-10T23:31:24.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 Processor -- start 2024-09-10T23:31:24.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.663+0000 7f7274000640 1 -- start start 2024-09-10T23:31:24.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7274000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 0x7f726c1f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:24.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7274000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d2a60 0x7f726c06df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:24.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7274000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f726c15bf20 0x7f726c06e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:24.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7274000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f726c0b5800 con 0x7f726c0cd3d0 2024-09-10T23:31:24.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7274000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f726c0b5680 con 0x7f726c0d2a60 2024-09-10T23:31:24.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7274000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f726c0b5980 con 0x7f726c15bf20 2024-09-10T23:31:24.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7271600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 0x7f726c1f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:24.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7271600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 0x7f726c1f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44356/0 (socket says 172.21.15.17:44356) 2024-09-10T23:31:24.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7271600640 1 -- 172.21.15.17:0/1649001373 learned_addr learned my addr 172.21.15.17:0/1649001373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:24.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7272000640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f726c15bf20 0x7f726c06e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:24.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7270c00640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d2a60 0x7f726c06df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:24.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7271600640 1 -- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f726c15bf20 msgr2=0x7f726c06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7271600640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f726c15bf20 0x7f726c06e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7271600640 1 -- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d2a60 msgr2=0x7f726c06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7271600640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d2a60 0x7f726c06df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7271600640 1 -- 172.21.15.17:0/1649001373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c1fb020 con 0x7f726c0cd3d0 2024-09-10T23:31:24.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7271600640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 0x7f726c1f7080 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f726000d950 tx=0x7f726000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:24.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7269600640 1 -- 172.21.15.17:0/1649001373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260017070 con 0x7f726c0cd3d0 2024-09-10T23:31:24.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7269600640 1 -- 172.21.15.17:0/1649001373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7260009d20 con 0x7f726c0cd3d0 2024-09-10T23:31:24.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7269600640 1 -- 172.21.15.17:0/1649001373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72600106c0 con 0x7f726c0cd3d0 2024-09-10T23:31:24.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c1fb300 con 0x7f726c0cd3d0 2024-09-10T23:31:24.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c1fb8c0 con 0x7f726c0cd3d0 2024-09-10T23:31:24.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.667+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c0ce580 con 0x7f726c0cd3d0 2024-09-10T23:31:24.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.671+0000 7f7269600640 1 -- 172.21.15.17:0/1649001373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7260010860 con 0x7f726c0cd3d0 2024-09-10T23:31:24.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.671+0000 7f7269600640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f724c072610 0x7f724c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:24.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.671+0000 7f7269600640 1 -- 172.21.15.17:0/1649001373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f7260093750 con 0x7f726c0cd3d0 2024-09-10T23:31:24.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.671+0000 7f7270c00640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f724c072610 0x7f724c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:24.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.671+0000 7f7270c00640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f724c072610 0x7f724c074ad0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f726c15b420 tx=0x7f725800b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:24.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.675+0000 7f7269600640 1 -- 172.21.15.17:0/1649001373 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f726005e5b0 con 0x7f726c0cd3d0 2024-09-10T23:31:24.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.843+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f726c1fadd0 con 0x7f724c072610 2024-09-10T23:31:24.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.851+0000 7f7269600640 1 -- 172.21.15.17:0/1649001373 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252477 (secure 0 0 0) 0x7f726c1fadd0 con 0x7f724c072610 2024-09-10T23:31:24.854 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:24.855 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:31:24.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.851+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f724c072610 msgr2=0x7f724c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.851+0000 7f7274000640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f724c072610 0x7f724c074ad0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f726c15b420 tx=0x7f725800b390 comp rx=0 tx=0).stop 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.851+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 msgr2=0x7f726c1f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.855+0000 7f7274000640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 0x7f726c1f7080 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f726000d950 tx=0x7f726000de10 comp rx=0 tx=0).stop 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.855+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 shutdown_connections 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.855+0000 7f7274000640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f724c072610 0x7f724c074ad0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.855+0000 7f7274000640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f726c15bf20 0x7f726c06e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.855+0000 7f7274000640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f726c0d2a60 0x7f726c06df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.855+0000 7f7274000640 1 --2- 172.21.15.17:0/1649001373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0cd3d0 0x7f726c1f7080 unknown :-1 s=CLOSED pgs=2448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.855+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 >> 172.21.15.17:0/1649001373 conn(0x7f726c0d1e40 msgr2=0x7f726c0b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.855+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 shutdown_connections 2024-09-10T23:31:24.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:24.855+0000 7f7274000640 1 -- 172.21.15.17:0/1649001373 wait complete. 2024-09-10T23:31:24.874 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":686,"stamp":"2024-09-10T23:31:24.525542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":544864,"kb_used_data":22048,"kb_used_omap":12,"kb_used_meta":522611,"kb_avail":754429856,"statfs":{"total":773094113280,"available":772536172544,"internally_reserved":0,"allocated":22577152,"data_stored":11218428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":535154225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.469230"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193885+0000","last_change":"2024-09-10T23:31:19.087993+0000","last_active":"2024-09-10T23:31:20.193885+0000","last_peered":"2024-09-10T23:31:20.193885+0000","last_clean":"2024-09-10T23:31:20.193885+0000","last_became_active":"2024-09-10T23:31:19.085990+0000","last_became_peered":"2024-09-10T23:31:19.085990+0000","last_unstale":"2024-09-10T23:31:20.193885+0000","last_undegraded":"2024-09-10T23:31:20.193885+0000","last_fullsized":"2024-09-10T23:31:20.193885+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:11.695613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194431+0000","last_change":"2024-09-10T23:31:19.087458+0000","last_active":"2024-09-10T23:31:20.194431+0000","last_peered":"2024-09-10T23:31:20.194431+0000","last_clean":"2024-09-10T23:31:20.194431+0000","last_became_active":"2024-09-10T23:31:19.087143+0000","last_became_peered":"2024-09-10T23:31:19.087143+0000","last_unstale":"2024-09-10T23:31:20.194431+0000","last_undegraded":"2024-09-10T23:31:20.194431+0000","last_fullsized":"2024-09-10T23:31:20.194431+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:41.103255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192394+0000","last_change":"2024-09-10T23:31:19.089631+0000","last_active":"2024-09-10T23:31:20.192394+0000","last_peered":"2024-09-10T23:31:20.192394+0000","last_clean":"2024-09-10T23:31:20.192394+0000","last_became_active":"2024-09-10T23:31:19.089105+0000","last_became_peered":"2024-09-10T23:31:19.089105+0000","last_unstale":"2024-09-10T23:31:20.192394+0000","last_undegraded":"2024-09-10T23:31:20.192394+0000","last_fullsized":"2024-09-10T23:31:20.192394+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192198+0000","last_change":"2024-09-10T23:31:19.087326+0000","last_active":"2024-09-10T23:31:20.192198+0000","last_peered":"2024-09-10T23:31:20.192198+0000","last_clean":"2024-09-10T23:31:20.192198+0000","last_became_active":"2024-09-10T23:31:19.087006+0000","last_became_peered":"2024-09-10T23:31:19.087006+0000","last_unstale":"2024-09-10T23:31:20.192198+0000","last_undegraded":"2024-09-10T23:31:20.192198+0000","last_fullsized":"2024-09-10T23:31:20.192198+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:57.556182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102882+0000","last_change":"2024-09-10T23:31:19.106580+0000","last_active":"2024-09-10T23:31:20.102882+0000","last_peered":"2024-09-10T23:31:20.102882+0000","last_clean":"2024-09-10T23:31:20.102882+0000","last_became_active":"2024-09-10T23:31:19.105999+0000","last_became_peered":"2024-09-10T23:31:19.105999+0000","last_unstale":"2024-09-10T23:31:20.102882+0000","last_undegraded":"2024-09-10T23:31:20.102882+0000","last_fullsized":"2024-09-10T23:31:20.102882+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.026835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193456+0000","last_change":"2024-09-10T23:31:19.091314+0000","last_active":"2024-09-10T23:31:20.193456+0000","last_peered":"2024-09-10T23:31:20.193456+0000","last_clean":"2024-09-10T23:31:20.193456+0000","last_became_active":"2024-09-10T23:31:19.090925+0000","last_became_peered":"2024-09-10T23:31:19.090925+0000","last_unstale":"2024-09-10T23:31:20.193456+0000","last_undegraded":"2024-09-10T23:31:20.193456+0000","last_fullsized":"2024-09-10T23:31:20.193456+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:11.937267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105071+0000","last_change":"2024-09-10T23:31:19.091216+0000","last_active":"2024-09-10T23:31:20.105071+0000","last_peered":"2024-09-10T23:31:20.105071+0000","last_clean":"2024-09-10T23:31:20.105071+0000","last_became_active":"2024-09-10T23:31:19.090918+0000","last_became_peered":"2024-09-10T23:31:19.090918+0000","last_unstale":"2024-09-10T23:31:20.105071+0000","last_undegraded":"2024-09-10T23:31:20.105071+0000","last_fullsized":"2024-09-10T23:31:20.105071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:42.530144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102256+0000","last_change":"2024-09-10T23:31:19.098246+0000","last_active":"2024-09-10T23:31:20.102256+0000","last_peered":"2024-09-10T23:31:20.102256+0000","last_clean":"2024-09-10T23:31:20.102256+0000","last_became_active":"2024-09-10T23:31:19.097975+0000","last_became_peered":"2024-09-10T23:31:19.097975+0000","last_unstale":"2024-09-10T23:31:20.102256+0000","last_undegraded":"2024-09-10T23:31:20.102256+0000","last_fullsized":"2024-09-10T23:31:20.102256+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:40.965172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194091+0000","last_change":"2024-09-10T23:31:19.098322+0000","last_active":"2024-09-10T23:31:20.194091+0000","last_peered":"2024-09-10T23:31:20.194091+0000","last_clean":"2024-09-10T23:31:20.194091+0000","last_became_active":"2024-09-10T23:31:19.098043+0000","last_became_peered":"2024-09-10T23:31:19.098043+0000","last_unstale":"2024-09-10T23:31:20.194091+0000","last_undegraded":"2024-09-10T23:31:20.194091+0000","last_fullsized":"2024-09-10T23:31:20.194091+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:53.009367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192639+0000","last_change":"2024-09-10T23:31:19.098520+0000","last_active":"2024-09-10T23:31:20.192639+0000","last_peered":"2024-09-10T23:31:20.192639+0000","last_clean":"2024-09-10T23:31:20.192639+0000","last_became_active":"2024-09-10T23:31:19.098200+0000","last_became_peered":"2024-09-10T23:31:19.098200+0000","last_unstale":"2024-09-10T23:31:20.192639+0000","last_undegraded":"2024-09-10T23:31:20.192639+0000","last_fullsized":"2024-09-10T23:31:20.192639+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.151774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192798+0000","last_change":"2024-09-10T23:31:19.098678+0000","last_active":"2024-09-10T23:31:20.192798+0000","last_peered":"2024-09-10T23:31:20.192798+0000","last_clean":"2024-09-10T23:31:20.192798+0000","last_became_active":"2024-09-10T23:31:19.098170+0000","last_became_peered":"2024-09-10T23:31:19.098170+0000","last_unstale":"2024-09-10T23:31:20.192798+0000","last_undegraded":"2024-09-10T23:31:20.192798+0000","last_fullsized":"2024-09-10T23:31:20.192798+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:07.897360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193717+0000","last_change":"2024-09-10T23:31:19.086756+0000","last_active":"2024-09-10T23:31:20.193717+0000","last_peered":"2024-09-10T23:31:20.193717+0000","last_clean":"2024-09-10T23:31:20.193717+0000","last_became_active":"2024-09-10T23:31:19.086487+0000","last_became_peered":"2024-09-10T23:31:19.086487+0000","last_unstale":"2024-09-10T23:31:20.193717+0000","last_undegraded":"2024-09-10T23:31:20.193717+0000","last_fullsized":"2024-09-10T23:31:20.193717+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:04.173334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094472+0000","last_change":"2024-09-10T23:31:19.094064+0000","last_active":"2024-09-10T23:31:20.094472+0000","last_peered":"2024-09-10T23:31:20.094472+0000","last_clean":"2024-09-10T23:31:20.094472+0000","last_became_active":"2024-09-10T23:31:19.093135+0000","last_became_peered":"2024-09-10T23:31:19.093135+0000","last_unstale":"2024-09-10T23:31:20.094472+0000","last_undegraded":"2024-09-10T23:31:20.094472+0000","last_fullsized":"2024-09-10T23:31:20.094472+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:50.756718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086960+0000","last_change":"2024-09-10T23:31:19.080589+0000","last_active":"2024-09-10T23:31:20.086960+0000","last_peered":"2024-09-10T23:31:20.086960+0000","last_clean":"2024-09-10T23:31:20.086960+0000","last_became_active":"2024-09-10T23:31:19.077949+0000","last_became_peered":"2024-09-10T23:31:19.077949+0000","last_unstale":"2024-09-10T23:31:20.086960+0000","last_undegraded":"2024-09-10T23:31:20.086960+0000","last_fullsized":"2024-09-10T23:31:20.086960+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:09.621898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198488+0000","last_change":"2024-09-10T23:31:19.101714+0000","last_active":"2024-09-10T23:31:20.198488+0000","last_peered":"2024-09-10T23:31:20.198488+0000","last_clean":"2024-09-10T23:31:20.198488+0000","last_became_active":"2024-09-10T23:31:19.101460+0000","last_became_peered":"2024-09-10T23:31:19.101460+0000","last_unstale":"2024-09-10T23:31:20.198488+0000","last_undegraded":"2024-09-10T23:31:20.198488+0000","last_fullsized":"2024-09-10T23:31:20.198488+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:37.667145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192396+0000","last_change":"2024-09-10T23:31:19.083240+0000","last_active":"2024-09-10T23:31:20.192396+0000","last_peered":"2024-09-10T23:31:20.192396+0000","last_clean":"2024-09-10T23:31:20.192396+0000","last_became_active":"2024-09-10T23:31:19.082969+0000","last_became_peered":"2024-09-10T23:31:19.082969+0000","last_unstale":"2024-09-10T23:31:20.192396+0000","last_undegraded":"2024-09-10T23:31:20.192396+0000","last_fullsized":"2024-09-10T23:31:20.192396+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:01.871980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094849+0000","last_change":"2024-09-10T23:31:19.106578+0000","last_active":"2024-09-10T23:31:20.094849+0000","last_peered":"2024-09-10T23:31:20.094849+0000","last_clean":"2024-09-10T23:31:20.094849+0000","last_became_active":"2024-09-10T23:31:19.105865+0000","last_became_peered":"2024-09-10T23:31:19.105865+0000","last_unstale":"2024-09-10T23:31:20.094849+0000","last_undegraded":"2024-09-10T23:31:20.094849+0000","last_fullsized":"2024-09-10T23:31:20.094849+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:16.330127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192776+0000","last_change":"2024-09-10T23:31:19.082731+0000","last_active":"2024-09-10T23:31:20.192776+0000","last_peered":"2024-09-10T23:31:20.192776+0000","last_clean":"2024-09-10T23:31:20.192776+0000","last_became_active":"2024-09-10T23:31:19.080384+0000","last_became_peered":"2024-09-10T23:31:19.080384+0000","last_unstale":"2024-09-10T23:31:20.192776+0000","last_undegraded":"2024-09-10T23:31:20.192776+0000","last_fullsized":"2024-09-10T23:31:20.192776+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:42.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198839+0000","last_change":"2024-09-10T23:31:19.103536+0000","last_active":"2024-09-10T23:31:20.198839+0000","last_peered":"2024-09-10T23:31:20.198839+0000","last_clean":"2024-09-10T23:31:20.198839+0000","last_became_active":"2024-09-10T23:31:19.102843+0000","last_became_peered":"2024-09-10T23:31:19.102843+0000","last_unstale":"2024-09-10T23:31:20.198839+0000","last_undegraded":"2024-09-10T23:31:20.198839+0000","last_fullsized":"2024-09-10T23:31:20.198839+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:36.001349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194183+0000","last_change":"2024-09-10T23:31:19.099157+0000","last_active":"2024-09-10T23:31:20.194183+0000","last_peered":"2024-09-10T23:31:20.194183+0000","last_clean":"2024-09-10T23:31:20.194183+0000","last_became_active":"2024-09-10T23:31:19.098878+0000","last_became_peered":"2024-09-10T23:31:19.098878+0000","last_unstale":"2024-09-10T23:31:20.194183+0000","last_undegraded":"2024-09-10T23:31:20.194183+0000","last_fullsized":"2024-09-10T23:31:20.194183+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:04.700681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105122+0000","last_change":"2024-09-10T23:31:19.099725+0000","last_active":"2024-09-10T23:31:20.105122+0000","last_peered":"2024-09-10T23:31:20.105122+0000","last_clean":"2024-09-10T23:31:20.105122+0000","last_became_active":"2024-09-10T23:31:19.097618+0000","last_became_peered":"2024-09-10T23:31:19.097618+0000","last_unstale":"2024-09-10T23:31:20.105122+0000","last_undegraded":"2024-09-10T23:31:20.105122+0000","last_fullsized":"2024-09-10T23:31:20.105122+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:50.857332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094498+0000","last_change":"2024-09-10T23:31:19.097297+0000","last_active":"2024-09-10T23:31:20.094498+0000","last_peered":"2024-09-10T23:31:20.094498+0000","last_clean":"2024-09-10T23:31:20.094498+0000","last_became_active":"2024-09-10T23:31:19.097013+0000","last_became_peered":"2024-09-10T23:31:19.097013+0000","last_unstale":"2024-09-10T23:31:20.094498+0000","last_undegraded":"2024-09-10T23:31:20.094498+0000","last_fullsized":"2024-09-10T23:31:20.094498+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:13.020807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198693+0000","last_change":"2024-09-10T23:31:19.104434+0000","last_active":"2024-09-10T23:31:20.198693+0000","last_peered":"2024-09-10T23:31:20.198693+0000","last_clean":"2024-09-10T23:31:20.198693+0000","last_became_active":"2024-09-10T23:31:19.102729+0000","last_became_peered":"2024-09-10T23:31:19.102729+0000","last_unstale":"2024-09-10T23:31:20.198693+0000","last_undegraded":"2024-09-10T23:31:20.198693+0000","last_fullsized":"2024-09-10T23:31:20.198693+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:25.236930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094157+0000","last_change":"2024-09-10T23:31:19.092835+0000","last_active":"2024-09-10T23:31:20.094157+0000","last_peered":"2024-09-10T23:31:20.094157+0000","last_clean":"2024-09-10T23:31:20.094157+0000","last_became_active":"2024-09-10T23:31:19.092569+0000","last_became_peered":"2024-09-10T23:31:19.092569+0000","last_unstale":"2024-09-10T23:31:20.094157+0000","last_undegraded":"2024-09-10T23:31:20.094157+0000","last_fullsized":"2024-09-10T23:31:20.094157+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:45.600976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194606+0000","last_change":"2024-09-10T23:31:19.095134+0000","last_active":"2024-09-10T23:31:20.194606+0000","last_peered":"2024-09-10T23:31:20.194606+0000","last_clean":"2024-09-10T23:31:20.194606+0000","last_became_active":"2024-09-10T23:31:19.093338+0000","last_became_peered":"2024-09-10T23:31:19.093338+0000","last_unstale":"2024-09-10T23:31:20.194606+0000","last_undegraded":"2024-09-10T23:31:20.194606+0000","last_fullsized":"2024-09-10T23:31:20.194606+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:24.793170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105453+0000","last_change":"2024-09-10T23:31:19.094860+0000","last_active":"2024-09-10T23:31:20.105453+0000","last_peered":"2024-09-10T23:31:20.105453+0000","last_clean":"2024-09-10T23:31:20.105453+0000","last_became_active":"2024-09-10T23:31:19.092128+0000","last_became_peered":"2024-09-10T23:31:19.092128+0000","last_unstale":"2024-09-10T23:31:20.105453+0000","last_undegraded":"2024-09-10T23:31:20.105453+0000","last_fullsized":"2024-09-10T23:31:20.105453+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:22.506375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102610+0000","last_change":"2024-09-10T23:31:19.109738+0000","last_active":"2024-09-10T23:31:20.102610+0000","last_peered":"2024-09-10T23:31:20.102610+0000","last_clean":"2024-09-10T23:31:20.102610+0000","last_became_active":"2024-09-10T23:31:19.109432+0000","last_became_peered":"2024-09-10T23:31:19.109432+0000","last_unstale":"2024-09-10T23:31:20.102610+0000","last_undegraded":"2024-09-10T23:31:20.102610+0000","last_fullsized":"2024-09-10T23:31:20.102610+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:10.827017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193848+0000","last_change":"2024-09-10T23:31:19.098988+0000","last_active":"2024-09-10T23:31:20.193848+0000","last_peered":"2024-09-10T23:31:20.193848+0000","last_clean":"2024-09-10T23:31:20.193848+0000","last_became_active":"2024-09-10T23:31:19.098748+0000","last_became_peered":"2024-09-10T23:31:19.098748+0000","last_unstale":"2024-09-10T23:31:20.193848+0000","last_undegraded":"2024-09-10T23:31:20.193848+0000","last_fullsized":"2024-09-10T23:31:20.193848+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:24.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087141+0000","last_change":"2024-09-10T23:31:19.081052+0000","last_active":"2024-09-10T23:31:20.087141+0000","last_peered":"2024-09-10T23:31:20.087141+0000","last_clean":"2024-09-10T23:31:20.087141+0000","last_became_active":"2024-09-10T23:31:19.080723+0000","last_became_peered":"2024-09-10T23:31:19.080723+0000","last_unstale":"2024-09-10T23:31:20.087141+0000","last_undegraded":"2024-09-10T23:31:20.087141+0000","last_fullsized":"2024-09-10T23:31:20.087141+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086951+0000","last_change":"2024-09-10T23:31:19.103280+0000","last_active":"2024-09-10T23:31:20.086951+0000","last_peered":"2024-09-10T23:31:20.086951+0000","last_clean":"2024-09-10T23:31:20.086951+0000","last_became_active":"2024-09-10T23:31:19.102558+0000","last_became_peered":"2024-09-10T23:31:19.102558+0000","last_unstale":"2024-09-10T23:31:20.086951+0000","last_undegraded":"2024-09-10T23:31:20.086951+0000","last_fullsized":"2024-09-10T23:31:20.086951+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193133+0000","last_change":"2024-09-10T23:31:19.093287+0000","last_active":"2024-09-10T23:31:20.193133+0000","last_peered":"2024-09-10T23:31:20.193133+0000","last_clean":"2024-09-10T23:31:20.193133+0000","last_became_active":"2024-09-10T23:31:19.093017+0000","last_became_peered":"2024-09-10T23:31:19.093017+0000","last_unstale":"2024-09-10T23:31:20.193133+0000","last_undegraded":"2024-09-10T23:31:20.193133+0000","last_fullsized":"2024-09-10T23:31:20.193133+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:33.239210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193137+0000","last_change":"2024-09-10T23:31:19.099804+0000","last_active":"2024-09-10T23:31:20.193137+0000","last_peered":"2024-09-10T23:31:20.193137+0000","last_clean":"2024-09-10T23:31:20.193137+0000","last_became_active":"2024-09-10T23:31:19.099522+0000","last_became_peered":"2024-09-10T23:31:19.099522+0000","last_unstale":"2024-09-10T23:31:20.193137+0000","last_undegraded":"2024-09-10T23:31:20.193137+0000","last_fullsized":"2024-09-10T23:31:20.193137+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:22.241487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192217+0000","last_change":"2024-09-10T23:31:19.093746+0000","last_active":"2024-09-10T23:31:20.192217+0000","last_peered":"2024-09-10T23:31:20.192217+0000","last_clean":"2024-09-10T23:31:20.192217+0000","last_became_active":"2024-09-10T23:31:19.093431+0000","last_became_peered":"2024-09-10T23:31:19.093431+0000","last_unstale":"2024-09-10T23:31:20.192217+0000","last_undegraded":"2024-09-10T23:31:20.192217+0000","last_fullsized":"2024-09-10T23:31:20.192217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:53.986164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"211'4","reported_seq":19,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193924+0000","last_change":"2024-09-10T23:31:18.076743+0000","last_active":"2024-09-10T23:31:20.193924+0000","last_peered":"2024-09-10T23:31:20.193924+0000","last_clean":"2024-09-10T23:31:20.193924+0000","last_became_active":"2024-09-10T23:31:18.076117+0000","last_became_peered":"2024-09-10T23:31:18.076117+0000","last_unstale":"2024-09-10T23:31:20.193924+0000","last_undegraded":"2024-09-10T23:31:20.193924+0000","last_fullsized":"2024-09-10T23:31:20.193924+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:26.269280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198594+0000","last_change":"2024-09-10T23:31:19.110826+0000","last_active":"2024-09-10T23:31:20.198594+0000","last_peered":"2024-09-10T23:31:20.198594+0000","last_clean":"2024-09-10T23:31:20.198594+0000","last_became_active":"2024-09-10T23:31:19.110510+0000","last_became_peered":"2024-09-10T23:31:19.110510+0000","last_unstale":"2024-09-10T23:31:20.198594+0000","last_undegraded":"2024-09-10T23:31:20.198594+0000","last_fullsized":"2024-09-10T23:31:20.198594+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:00.524828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094383+0000","last_change":"2024-09-10T23:31:18.084510+0000","last_active":"2024-09-10T23:31:20.094383+0000","last_peered":"2024-09-10T23:31:20.094383+0000","last_clean":"2024-09-10T23:31:20.094383+0000","last_became_active":"2024-09-10T23:31:18.084162+0000","last_became_peered":"2024-09-10T23:31:18.084162+0000","last_unstale":"2024-09-10T23:31:20.094383+0000","last_undegraded":"2024-09-10T23:31:20.094383+0000","last_fullsized":"2024-09-10T23:31:20.094383+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.097899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193502+0000","last_change":"2024-09-10T23:31:19.092163+0000","last_active":"2024-09-10T23:31:20.193502+0000","last_peered":"2024-09-10T23:31:20.193502+0000","last_clean":"2024-09-10T23:31:20.193502+0000","last_became_active":"2024-09-10T23:31:19.091894+0000","last_became_peered":"2024-09-10T23:31:19.091894+0000","last_unstale":"2024-09-10T23:31:20.193502+0000","last_undegraded":"2024-09-10T23:31:20.193502+0000","last_fullsized":"2024-09-10T23:31:20.193502+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:37.659216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087404+0000","last_change":"2024-09-10T23:31:18.073162+0000","last_active":"2024-09-10T23:31:20.087404+0000","last_peered":"2024-09-10T23:31:20.087404+0000","last_clean":"2024-09-10T23:31:20.087404+0000","last_became_active":"2024-09-10T23:31:18.072848+0000","last_became_peered":"2024-09-10T23:31:18.072848+0000","last_unstale":"2024-09-10T23:31:20.087404+0000","last_undegraded":"2024-09-10T23:31:20.087404+0000","last_fullsized":"2024-09-10T23:31:20.087404+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:43.878999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087312+0000","last_change":"2024-09-10T23:31:19.086134+0000","last_active":"2024-09-10T23:31:20.087312+0000","last_peered":"2024-09-10T23:31:20.087312+0000","last_clean":"2024-09-10T23:31:20.087312+0000","last_became_active":"2024-09-10T23:31:19.085823+0000","last_became_peered":"2024-09-10T23:31:19.085823+0000","last_unstale":"2024-09-10T23:31:20.087312+0000","last_undegraded":"2024-09-10T23:31:20.087312+0000","last_fullsized":"2024-09-10T23:31:20.087312+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198587+0000","last_change":"2024-09-10T23:31:18.085745+0000","last_active":"2024-09-10T23:31:20.198587+0000","last_peered":"2024-09-10T23:31:20.198587+0000","last_clean":"2024-09-10T23:31:20.198587+0000","last_became_active":"2024-09-10T23:31:18.085478+0000","last_became_peered":"2024-09-10T23:31:18.085478+0000","last_unstale":"2024-09-10T23:31:20.198587+0000","last_undegraded":"2024-09-10T23:31:20.198587+0000","last_fullsized":"2024-09-10T23:31:20.198587+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105410+0000","last_change":"2024-09-10T23:31:19.106907+0000","last_active":"2024-09-10T23:31:20.105410+0000","last_peered":"2024-09-10T23:31:20.105410+0000","last_clean":"2024-09-10T23:31:20.105410+0000","last_became_active":"2024-09-10T23:31:19.106522+0000","last_became_peered":"2024-09-10T23:31:19.106522+0000","last_unstale":"2024-09-10T23:31:20.105410+0000","last_undegraded":"2024-09-10T23:31:20.105410+0000","last_fullsized":"2024-09-10T23:31:20.105410+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:18.131377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087064+0000","last_change":"2024-09-10T23:31:18.072466+0000","last_active":"2024-09-10T23:31:20.087064+0000","last_peered":"2024-09-10T23:31:20.087064+0000","last_clean":"2024-09-10T23:31:20.087064+0000","last_became_active":"2024-09-10T23:31:18.071711+0000","last_became_peered":"2024-09-10T23:31:18.071711+0000","last_unstale":"2024-09-10T23:31:20.087064+0000","last_undegraded":"2024-09-10T23:31:20.087064+0000","last_fullsized":"2024-09-10T23:31:20.087064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:10.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192519+0000","last_change":"2024-09-10T23:31:19.081454+0000","last_active":"2024-09-10T23:31:20.192519+0000","last_peered":"2024-09-10T23:31:20.192519+0000","last_clean":"2024-09-10T23:31:20.192519+0000","last_became_active":"2024-09-10T23:31:19.080030+0000","last_became_peered":"2024-09-10T23:31:19.080030+0000","last_unstale":"2024-09-10T23:31:20.192519+0000","last_undegraded":"2024-09-10T23:31:20.192519+0000","last_fullsized":"2024-09-10T23:31:20.192519+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:55.794776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192620+0000","last_change":"2024-09-10T23:31:18.071545+0000","last_active":"2024-09-10T23:31:20.192620+0000","last_peered":"2024-09-10T23:31:20.192620+0000","last_clean":"2024-09-10T23:31:20.192620+0000","last_became_active":"2024-09-10T23:31:18.070999+0000","last_became_peered":"2024-09-10T23:31:18.070999+0000","last_unstale":"2024-09-10T23:31:20.192620+0000","last_undegraded":"2024-09-10T23:31:20.192620+0000","last_fullsized":"2024-09-10T23:31:20.192620+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:13.320251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102930+0000","last_change":"2024-09-10T23:31:19.108690+0000","last_active":"2024-09-10T23:31:20.102930+0000","last_peered":"2024-09-10T23:31:20.102930+0000","last_clean":"2024-09-10T23:31:20.102930+0000","last_became_active":"2024-09-10T23:31:19.108427+0000","last_became_peered":"2024-09-10T23:31:19.108427+0000","last_unstale":"2024-09-10T23:31:20.102930+0000","last_undegraded":"2024-09-10T23:31:20.102930+0000","last_fullsized":"2024-09-10T23:31:20.102930+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:46.359285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193051+0000","last_change":"2024-09-10T23:31:18.068409+0000","last_active":"2024-09-10T23:31:20.193051+0000","last_peered":"2024-09-10T23:31:20.193051+0000","last_clean":"2024-09-10T23:31:20.193051+0000","last_became_active":"2024-09-10T23:31:18.068106+0000","last_became_peered":"2024-09-10T23:31:18.068106+0000","last_unstale":"2024-09-10T23:31:20.193051+0000","last_undegraded":"2024-09-10T23:31:20.193051+0000","last_fullsized":"2024-09-10T23:31:20.193051+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:23.000401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105021+0000","last_change":"2024-09-10T23:31:19.100589+0000","last_active":"2024-09-10T23:31:20.105021+0000","last_peered":"2024-09-10T23:31:20.105021+0000","last_clean":"2024-09-10T23:31:20.105021+0000","last_became_active":"2024-09-10T23:31:19.100313+0000","last_became_peered":"2024-09-10T23:31:19.100313+0000","last_unstale":"2024-09-10T23:31:20.105021+0000","last_undegraded":"2024-09-10T23:31:20.105021+0000","last_fullsized":"2024-09-10T23:31:20.105021+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:27.446745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087425+0000","last_change":"2024-09-10T23:31:18.077014+0000","last_active":"2024-09-10T23:31:20.087425+0000","last_peered":"2024-09-10T23:31:20.087425+0000","last_clean":"2024-09-10T23:31:20.087425+0000","last_became_active":"2024-09-10T23:31:18.076754+0000","last_became_peered":"2024-09-10T23:31:18.076754+0000","last_unstale":"2024-09-10T23:31:20.087425+0000","last_undegraded":"2024-09-10T23:31:20.087425+0000","last_fullsized":"2024-09-10T23:31:20.087425+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:27.536844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094124+0000","last_change":"2024-09-10T23:31:19.098486+0000","last_active":"2024-09-10T23:31:20.094124+0000","last_peered":"2024-09-10T23:31:20.094124+0000","last_clean":"2024-09-10T23:31:20.094124+0000","last_became_active":"2024-09-10T23:31:19.098206+0000","last_became_peered":"2024-09-10T23:31:19.098206+0000","last_unstale":"2024-09-10T23:31:20.094124+0000","last_undegraded":"2024-09-10T23:31:20.094124+0000","last_fullsized":"2024-09-10T23:31:20.094124+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:35.669124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192768+0000","last_change":"2024-09-10T23:31:18.079188+0000","last_active":"2024-09-10T23:31:20.192768+0000","last_peered":"2024-09-10T23:31:20.192768+0000","last_clean":"2024-09-10T23:31:20.192768+0000","last_became_active":"2024-09-10T23:31:18.078875+0000","last_became_peered":"2024-09-10T23:31:18.078875+0000","last_unstale":"2024-09-10T23:31:20.192768+0000","last_undegraded":"2024-09-10T23:31:20.192768+0000","last_fullsized":"2024-09-10T23:31:20.192768+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:21.354649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192579+0000","last_change":"2024-09-10T23:31:19.107187+0000","last_active":"2024-09-10T23:31:20.192579+0000","last_peered":"2024-09-10T23:31:20.192579+0000","last_clean":"2024-09-10T23:31:20.192579+0000","last_became_active":"2024-09-10T23:31:19.106681+0000","last_became_peered":"2024-09-10T23:31:19.106681+0000","last_unstale":"2024-09-10T23:31:20.192579+0000","last_undegraded":"2024-09-10T23:31:20.192579+0000","last_fullsized":"2024-09-10T23:31:20.192579+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.920623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"211'3","reported_seq":18,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102559+0000","last_change":"2024-09-10T23:31:18.073660+0000","last_active":"2024-09-10T23:31:20.102559+0000","last_peered":"2024-09-10T23:31:20.102559+0000","last_clean":"2024-09-10T23:31:20.102559+0000","last_became_active":"2024-09-10T23:31:18.072881+0000","last_became_peered":"2024-09-10T23:31:18.072881+0000","last_unstale":"2024-09-10T23:31:20.102559+0000","last_undegraded":"2024-09-10T23:31:20.102559+0000","last_fullsized":"2024-09-10T23:31:20.102559+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:17.944201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105092+0000","last_change":"2024-09-10T23:31:19.096083+0000","last_active":"2024-09-10T23:31:20.105092+0000","last_peered":"2024-09-10T23:31:20.105092+0000","last_clean":"2024-09-10T23:31:20.105092+0000","last_became_active":"2024-09-10T23:31:19.095779+0000","last_became_peered":"2024-09-10T23:31:19.095779+0000","last_unstale":"2024-09-10T23:31:20.105092+0000","last_undegraded":"2024-09-10T23:31:20.105092+0000","last_fullsized":"2024-09-10T23:31:20.105092+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:50.287034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"211'6","reported_seq":21,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193946+0000","last_change":"2024-09-10T23:31:18.065614+0000","last_active":"2024-09-10T23:31:20.193946+0000","last_peered":"2024-09-10T23:31:20.193946+0000","last_clean":"2024-09-10T23:31:20.193946+0000","last_became_active":"2024-09-10T23:31:18.065239+0000","last_became_peered":"2024-09-10T23:31:18.065239+0000","last_unstale":"2024-09-10T23:31:20.193946+0000","last_undegraded":"2024-09-10T23:31:20.193946+0000","last_fullsized":"2024-09-10T23:31:20.193946+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:53.989498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193990+0000","last_change":"2024-09-10T23:31:19.090713+0000","last_active":"2024-09-10T23:31:20.193990+0000","last_peered":"2024-09-10T23:31:20.193990+0000","last_clean":"2024-09-10T23:31:20.193990+0000","last_became_active":"2024-09-10T23:31:19.089009+0000","last_became_peered":"2024-09-10T23:31:19.089009+0000","last_unstale":"2024-09-10T23:31:20.193990+0000","last_undegraded":"2024-09-10T23:31:20.193990+0000","last_fullsized":"2024-09-10T23:31:20.193990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:07.556427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198523+0000","last_change":"2024-09-10T23:31:18.082553+0000","last_active":"2024-09-10T23:31:20.198523+0000","last_peered":"2024-09-10T23:31:20.198523+0000","last_clean":"2024-09-10T23:31:20.198523+0000","last_became_active":"2024-09-10T23:31:18.082228+0000","last_became_peered":"2024-09-10T23:31:18.082228+0000","last_unstale":"2024-09-10T23:31:20.198523+0000","last_undegraded":"2024-09-10T23:31:20.198523+0000","last_fullsized":"2024-09-10T23:31:20.198523+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:41.522911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105367+0000","last_change":"2024-09-10T23:31:19.094510+0000","last_active":"2024-09-10T23:31:20.105367+0000","last_peered":"2024-09-10T23:31:20.105367+0000","last_clean":"2024-09-10T23:31:20.105367+0000","last_became_active":"2024-09-10T23:31:19.092810+0000","last_became_peered":"2024-09-10T23:31:19.092810+0000","last_unstale":"2024-09-10T23:31:20.105367+0000","last_undegraded":"2024-09-10T23:31:20.105367+0000","last_fullsized":"2024-09-10T23:31:20.105367+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:22.361882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102270+0000","last_change":"2024-09-10T23:31:18.086364+0000","last_active":"2024-09-10T23:31:20.102270+0000","last_peered":"2024-09-10T23:31:20.102270+0000","last_clean":"2024-09-10T23:31:20.102270+0000","last_became_active":"2024-09-10T23:31:18.086107+0000","last_became_peered":"2024-09-10T23:31:18.086107+0000","last_unstale":"2024-09-10T23:31:20.102270+0000","last_undegraded":"2024-09-10T23:31:20.102270+0000","last_fullsized":"2024-09-10T23:31:20.102270+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:20.135593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198696+0000","last_change":"2024-09-10T23:31:19.107551+0000","last_active":"2024-09-10T23:31:20.198696+0000","last_peered":"2024-09-10T23:31:20.198696+0000","last_clean":"2024-09-10T23:31:20.198696+0000","last_became_active":"2024-09-10T23:31:19.107264+0000","last_became_peered":"2024-09-10T23:31:19.107264+0000","last_unstale":"2024-09-10T23:31:20.198696+0000","last_undegraded":"2024-09-10T23:31:20.198696+0000","last_fullsized":"2024-09-10T23:31:20.198696+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:06.312069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102064+0000","last_change":"2024-09-10T23:31:18.081471+0000","last_active":"2024-09-10T23:31:20.102064+0000","last_peered":"2024-09-10T23:31:20.102064+0000","last_clean":"2024-09-10T23:31:20.102064+0000","last_became_active":"2024-09-10T23:31:18.080940+0000","last_became_peered":"2024-09-10T23:31:18.080940+0000","last_unstale":"2024-09-10T23:31:20.102064+0000","last_undegraded":"2024-09-10T23:31:20.102064+0000","last_fullsized":"2024-09-10T23:31:20.102064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:43.514503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102911+0000","last_change":"2024-09-10T23:31:19.105155+0000","last_active":"2024-09-10T23:31:20.102911+0000","last_peered":"2024-09-10T23:31:20.102911+0000","last_clean":"2024-09-10T23:31:20.102911+0000","last_became_active":"2024-09-10T23:31:19.104892+0000","last_became_peered":"2024-09-10T23:31:19.104892+0000","last_unstale":"2024-09-10T23:31:20.102911+0000","last_undegraded":"2024-09-10T23:31:20.102911+0000","last_fullsized":"2024-09-10T23:31:20.102911+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:37.315477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"211'8","reported_seq":23,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192327+0000","last_change":"2024-09-10T23:31:18.080071+0000","last_active":"2024-09-10T23:31:20.192327+0000","last_peered":"2024-09-10T23:31:20.192327+0000","last_clean":"2024-09-10T23:31:20.192327+0000","last_became_active":"2024-09-10T23:31:18.079813+0000","last_became_peered":"2024-09-10T23:31:18.079813+0000","last_unstale":"2024-09-10T23:31:20.192327+0000","last_undegraded":"2024-09-10T23:31:20.192327+0000","last_fullsized":"2024-09-10T23:31:20.192327+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:25.626605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102174+0000","last_change":"2024-09-10T23:31:19.102720+0000","last_active":"2024-09-10T23:31:20.102174+0000","last_peered":"2024-09-10T23:31:20.102174+0000","last_clean":"2024-09-10T23:31:20.102174+0000","last_became_active":"2024-09-10T23:31:19.102397+0000","last_became_peered":"2024-09-10T23:31:19.102397+0000","last_unstale":"2024-09-10T23:31:20.102174+0000","last_undegraded":"2024-09-10T23:31:20.102174+0000","last_fullsized":"2024-09-10T23:31:20.102174+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.681149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194051+0000","last_change":"2024-09-10T23:31:18.073203+0000","last_active":"2024-09-10T23:31:20.194051+0000","last_peered":"2024-09-10T23:31:20.194051+0000","last_clean":"2024-09-10T23:31:20.194051+0000","last_became_active":"2024-09-10T23:31:18.072769+0000","last_became_peered":"2024-09-10T23:31:18.072769+0000","last_unstale":"2024-09-10T23:31:20.194051+0000","last_undegraded":"2024-09-10T23:31:20.194051+0000","last_fullsized":"2024-09-10T23:31:20.194051+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:31.481224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102172+0000","last_change":"2024-09-10T23:31:19.104376+0000","last_active":"2024-09-10T23:31:20.102172+0000","last_peered":"2024-09-10T23:31:20.102172+0000","last_clean":"2024-09-10T23:31:20.102172+0000","last_became_active":"2024-09-10T23:31:19.102719+0000","last_became_peered":"2024-09-10T23:31:19.102719+0000","last_unstale":"2024-09-10T23:31:20.102172+0000","last_undegraded":"2024-09-10T23:31:20.102172+0000","last_fullsized":"2024-09-10T23:31:20.102172+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:56.299808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194495+0000","last_change":"2024-09-10T23:31:18.074043+0000","last_active":"2024-09-10T23:31:20.194495+0000","last_peered":"2024-09-10T23:31:20.194495+0000","last_clean":"2024-09-10T23:31:20.194495+0000","last_became_active":"2024-09-10T23:31:18.073766+0000","last_became_peered":"2024-09-10T23:31:18.073766+0000","last_unstale":"2024-09-10T23:31:20.194495+0000","last_undegraded":"2024-09-10T23:31:20.194495+0000","last_fullsized":"2024-09-10T23:31:20.194495+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:41.950907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193217+0000","last_change":"2024-09-10T23:31:19.102248+0000","last_active":"2024-09-10T23:31:20.193217+0000","last_peered":"2024-09-10T23:31:20.193217+0000","last_clean":"2024-09-10T23:31:20.193217+0000","last_became_active":"2024-09-10T23:31:19.101921+0000","last_became_peered":"2024-09-10T23:31:19.101921+0000","last_unstale":"2024-09-10T23:31:20.193217+0000","last_undegraded":"2024-09-10T23:31:20.193217+0000","last_fullsized":"2024-09-10T23:31:20.193217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:33.277637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094509+0000","last_change":"2024-09-10T23:31:18.084654+0000","last_active":"2024-09-10T23:31:20.094509+0000","last_peered":"2024-09-10T23:31:20.094509+0000","last_clean":"2024-09-10T23:31:20.094509+0000","last_became_active":"2024-09-10T23:31:18.084150+0000","last_became_peered":"2024-09-10T23:31:18.084150+0000","last_unstale":"2024-09-10T23:31:20.094509+0000","last_undegraded":"2024-09-10T23:31:20.094509+0000","last_fullsized":"2024-09-10T23:31:20.094509+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:28.813302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192910+0000","last_change":"2024-09-10T23:31:19.107063+0000","last_active":"2024-09-10T23:31:20.192910+0000","last_peered":"2024-09-10T23:31:20.192910+0000","last_clean":"2024-09-10T23:31:20.192910+0000","last_became_active":"2024-09-10T23:31:19.106793+0000","last_became_peered":"2024-09-10T23:31:19.106793+0000","last_unstale":"2024-09-10T23:31:20.192910+0000","last_undegraded":"2024-09-10T23:31:20.192910+0000","last_fullsized":"2024-09-10T23:31:20.192910+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:58.414351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198722+0000","last_change":"2024-09-10T23:31:18.075017+0000","last_active":"2024-09-10T23:31:20.198722+0000","last_peered":"2024-09-10T23:31:20.198722+0000","last_clean":"2024-09-10T23:31:20.198722+0000","last_became_active":"2024-09-10T23:31:18.073860+0000","last_became_peered":"2024-09-10T23:31:18.073860+0000","last_unstale":"2024-09-10T23:31:20.198722+0000","last_undegraded":"2024-09-10T23:31:20.198722+0000","last_fullsized":"2024-09-10T23:31:20.198722+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:09.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192182+0000","last_change":"2024-09-10T23:31:19.084774+0000","last_active":"2024-09-10T23:31:20.192182+0000","last_peered":"2024-09-10T23:31:20.192182+0000","last_clean":"2024-09-10T23:31:20.192182+0000","last_became_active":"2024-09-10T23:31:19.083516+0000","last_became_peered":"2024-09-10T23:31:19.083516+0000","last_unstale":"2024-09-10T23:31:20.192182+0000","last_undegraded":"2024-09-10T23:31:20.192182+0000","last_fullsized":"2024-09-10T23:31:20.192182+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193021+0000","last_change":"2024-09-10T23:31:18.070568+0000","last_active":"2024-09-10T23:31:20.193021+0000","last_peered":"2024-09-10T23:31:20.193021+0000","last_clean":"2024-09-10T23:31:20.193021+0000","last_became_active":"2024-09-10T23:31:18.070110+0000","last_became_peered":"2024-09-10T23:31:18.070110+0000","last_unstale":"2024-09-10T23:31:20.193021+0000","last_undegraded":"2024-09-10T23:31:20.193021+0000","last_fullsized":"2024-09-10T23:31:20.193021+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:17.124144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194213+0000","last_change":"2024-09-10T23:31:19.094490+0000","last_active":"2024-09-10T23:31:20.194213+0000","last_peered":"2024-09-10T23:31:20.194213+0000","last_clean":"2024-09-10T23:31:20.194213+0000","last_became_active":"2024-09-10T23:31:19.094236+0000","last_became_peered":"2024-09-10T23:31:19.094236+0000","last_unstale":"2024-09-10T23:31:20.194213+0000","last_undegraded":"2024-09-10T23:31:20.194213+0000","last_fullsized":"2024-09-10T23:31:20.194213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:28.628059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094462+0000","last_change":"2024-09-10T23:31:18.068183+0000","last_active":"2024-09-10T23:31:20.094462+0000","last_peered":"2024-09-10T23:31:20.094462+0000","last_clean":"2024-09-10T23:31:20.094462+0000","last_became_active":"2024-09-10T23:31:18.067814+0000","last_became_peered":"2024-09-10T23:31:18.067814+0000","last_unstale":"2024-09-10T23:31:20.094462+0000","last_undegraded":"2024-09-10T23:31:20.094462+0000","last_fullsized":"2024-09-10T23:31:20.094462+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:42.363754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094491+0000","last_change":"2024-09-10T23:31:19.099060+0000","last_active":"2024-09-10T23:31:20.094491+0000","last_peered":"2024-09-10T23:31:20.094491+0000","last_clean":"2024-09-10T23:31:20.094491+0000","last_became_active":"2024-09-10T23:31:19.098576+0000","last_became_peered":"2024-09-10T23:31:19.098576+0000","last_unstale":"2024-09-10T23:31:20.094491+0000","last_undegraded":"2024-09-10T23:31:20.094491+0000","last_fullsized":"2024-09-10T23:31:20.094491+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:27.428492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093973+0000","last_change":"2024-09-10T23:31:18.076954+0000","last_active":"2024-09-10T23:31:20.093973+0000","last_peered":"2024-09-10T23:31:20.093973+0000","last_clean":"2024-09-10T23:31:20.093973+0000","last_became_active":"2024-09-10T23:31:18.076673+0000","last_became_peered":"2024-09-10T23:31:18.076673+0000","last_unstale":"2024-09-10T23:31:20.093973+0000","last_undegraded":"2024-09-10T23:31:20.093973+0000","last_fullsized":"2024-09-10T23:31:20.093973+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:37.993408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094762+0000","last_change":"2024-09-10T23:31:19.102914+0000","last_active":"2024-09-10T23:31:20.094762+0000","last_peered":"2024-09-10T23:31:20.094762+0000","last_clean":"2024-09-10T23:31:20.094762+0000","last_became_active":"2024-09-10T23:31:19.102662+0000","last_became_peered":"2024-09-10T23:31:19.102662+0000","last_unstale":"2024-09-10T23:31:20.094762+0000","last_undegraded":"2024-09-10T23:31:20.094762+0000","last_fullsized":"2024-09-10T23:31:20.094762+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:03.963145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086835+0000","last_change":"2024-09-10T23:31:18.074711+0000","last_active":"2024-09-10T23:31:20.086835+0000","last_peered":"2024-09-10T23:31:20.086835+0000","last_clean":"2024-09-10T23:31:20.086835+0000","last_became_active":"2024-09-10T23:31:18.074079+0000","last_became_peered":"2024-09-10T23:31:18.074079+0000","last_unstale":"2024-09-10T23:31:20.086835+0000","last_undegraded":"2024-09-10T23:31:20.086835+0000","last_fullsized":"2024-09-10T23:31:20.086835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:21.499142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104963+0000","last_change":"2024-09-10T23:31:19.091779+0000","last_active":"2024-09-10T23:31:20.104963+0000","last_peered":"2024-09-10T23:31:20.104963+0000","last_clean":"2024-09-10T23:31:20.104963+0000","last_became_active":"2024-09-10T23:31:19.091404+0000","last_became_peered":"2024-09-10T23:31:19.091404+0000","last_unstale":"2024-09-10T23:31:20.104963+0000","last_undegraded":"2024-09-10T23:31:20.104963+0000","last_fullsized":"2024-09-10T23:31:20.104963+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:02.528031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192714+0000","last_change":"2024-09-10T23:31:18.082254+0000","last_active":"2024-09-10T23:31:20.192714+0000","last_peered":"2024-09-10T23:31:20.192714+0000","last_clean":"2024-09-10T23:31:20.192714+0000","last_became_active":"2024-09-10T23:31:18.081963+0000","last_became_peered":"2024-09-10T23:31:18.081963+0000","last_unstale":"2024-09-10T23:31:20.192714+0000","last_undegraded":"2024-09-10T23:31:20.192714+0000","last_fullsized":"2024-09-10T23:31:20.192714+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198454+0000","last_change":"2024-09-10T23:31:19.104473+0000","last_active":"2024-09-10T23:31:20.198454+0000","last_peered":"2024-09-10T23:31:20.198454+0000","last_clean":"2024-09-10T23:31:20.198454+0000","last_became_active":"2024-09-10T23:31:19.104186+0000","last_became_peered":"2024-09-10T23:31:19.104186+0000","last_unstale":"2024-09-10T23:31:20.198454+0000","last_undegraded":"2024-09-10T23:31:20.198454+0000","last_fullsized":"2024-09-10T23:31:20.198454+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:20.987147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"212'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104384+0000","last_change":"2024-09-10T23:31:18.079920+0000","last_active":"2024-09-10T23:31:20.104384+0000","last_peered":"2024-09-10T23:31:20.104384+0000","last_clean":"2024-09-10T23:31:20.104384+0000","last_became_active":"2024-09-10T23:31:18.079584+0000","last_became_peered":"2024-09-10T23:31:18.079584+0000","last_unstale":"2024-09-10T23:31:20.104384+0000","last_undegraded":"2024-09-10T23:31:20.104384+0000","last_fullsized":"2024-09-10T23:31:20.104384+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:33.922546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192416+0000","last_change":"2024-09-10T23:31:19.080253+0000","last_active":"2024-09-10T23:31:20.192416+0000","last_peered":"2024-09-10T23:31:20.192416+0000","last_clean":"2024-09-10T23:31:20.192416+0000","last_became_active":"2024-09-10T23:31:19.079908+0000","last_became_peered":"2024-09-10T23:31:19.079908+0000","last_unstale":"2024-09-10T23:31:20.192416+0000","last_undegraded":"2024-09-10T23:31:20.192416+0000","last_fullsized":"2024-09-10T23:31:20.192416+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087252+0000","last_change":"2024-09-10T23:31:18.080655+0000","last_active":"2024-09-10T23:31:20.087252+0000","last_peered":"2024-09-10T23:31:20.087252+0000","last_clean":"2024-09-10T23:31:20.087252+0000","last_became_active":"2024-09-10T23:31:18.080370+0000","last_became_peered":"2024-09-10T23:31:18.080370+0000","last_unstale":"2024-09-10T23:31:20.087252+0000","last_undegraded":"2024-09-10T23:31:20.087252+0000","last_fullsized":"2024-09-10T23:31:20.087252+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:55.916497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102543+0000","last_change":"2024-09-10T23:31:19.106872+0000","last_active":"2024-09-10T23:31:20.102543+0000","last_peered":"2024-09-10T23:31:20.102543+0000","last_clean":"2024-09-10T23:31:20.102543+0000","last_became_active":"2024-09-10T23:31:19.106326+0000","last_became_peered":"2024-09-10T23:31:19.106326+0000","last_unstale":"2024-09-10T23:31:20.102543+0000","last_undegraded":"2024-09-10T23:31:20.102543+0000","last_fullsized":"2024-09-10T23:31:20.102543+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:27.217918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087413+0000","last_change":"2024-09-10T23:31:18.074710+0000","last_active":"2024-09-10T23:31:20.087413+0000","last_peered":"2024-09-10T23:31:20.087413+0000","last_clean":"2024-09-10T23:31:20.087413+0000","last_became_active":"2024-09-10T23:31:18.074405+0000","last_became_peered":"2024-09-10T23:31:18.074405+0000","last_unstale":"2024-09-10T23:31:20.087413+0000","last_undegraded":"2024-09-10T23:31:20.087413+0000","last_fullsized":"2024-09-10T23:31:20.087413+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:46.035443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087213+0000","last_change":"2024-09-10T23:31:19.090048+0000","last_active":"2024-09-10T23:31:20.087213+0000","last_peered":"2024-09-10T23:31:20.087213+0000","last_clean":"2024-09-10T23:31:20.087213+0000","last_became_active":"2024-09-10T23:31:19.088979+0000","last_became_peered":"2024-09-10T23:31:19.088979+0000","last_unstale":"2024-09-10T23:31:20.087213+0000","last_undegraded":"2024-09-10T23:31:20.087213+0000","last_fullsized":"2024-09-10T23:31:20.087213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:43.080975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094212+0000","last_change":"2024-09-10T23:31:18.068905+0000","last_active":"2024-09-10T23:31:20.094212+0000","last_peered":"2024-09-10T23:31:20.094212+0000","last_clean":"2024-09-10T23:31:20.094212+0000","last_became_active":"2024-09-10T23:31:18.068607+0000","last_became_peered":"2024-09-10T23:31:18.068607+0000","last_unstale":"2024-09-10T23:31:20.094212+0000","last_undegraded":"2024-09-10T23:31:20.094212+0000","last_fullsized":"2024-09-10T23:31:20.094212+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:36.784830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193684+0000","last_change":"2024-09-10T23:31:19.082522+0000","last_active":"2024-09-10T23:31:20.193684+0000","last_peered":"2024-09-10T23:31:20.193684+0000","last_clean":"2024-09-10T23:31:20.193684+0000","last_became_active":"2024-09-10T23:31:19.082252+0000","last_became_peered":"2024-09-10T23:31:19.082252+0000","last_unstale":"2024-09-10T23:31:20.193684+0000","last_undegraded":"2024-09-10T23:31:20.193684+0000","last_fullsized":"2024-09-10T23:31:20.193684+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:42.478978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102406+0000","last_change":"2024-09-10T23:31:18.076160+0000","last_active":"2024-09-10T23:31:20.102406+0000","last_peered":"2024-09-10T23:31:20.102406+0000","last_clean":"2024-09-10T23:31:20.102406+0000","last_became_active":"2024-09-10T23:31:18.075439+0000","last_became_peered":"2024-09-10T23:31:18.075439+0000","last_unstale":"2024-09-10T23:31:20.102406+0000","last_undegraded":"2024-09-10T23:31:20.102406+0000","last_fullsized":"2024-09-10T23:31:20.102406+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.238398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194378+0000","last_change":"2024-09-10T23:31:19.087302+0000","last_active":"2024-09-10T23:31:20.194378+0000","last_peered":"2024-09-10T23:31:20.194378+0000","last_clean":"2024-09-10T23:31:20.194378+0000","last_became_active":"2024-09-10T23:31:19.087002+0000","last_became_peered":"2024-09-10T23:31:19.087002+0000","last_unstale":"2024-09-10T23:31:20.194378+0000","last_undegraded":"2024-09-10T23:31:20.194378+0000","last_fullsized":"2024-09-10T23:31:20.194378+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:16.875377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192740+0000","last_change":"2024-09-10T23:31:18.071251+0000","last_active":"2024-09-10T23:31:20.192740+0000","last_peered":"2024-09-10T23:31:20.192740+0000","last_clean":"2024-09-10T23:31:20.192740+0000","last_became_active":"2024-09-10T23:31:18.070638+0000","last_became_peered":"2024-09-10T23:31:18.070638+0000","last_unstale":"2024-09-10T23:31:20.192740+0000","last_undegraded":"2024-09-10T23:31:20.192740+0000","last_fullsized":"2024-09-10T23:31:20.192740+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094695+0000","last_change":"2024-09-10T23:31:19.096247+0000","last_active":"2024-09-10T23:31:20.094695+0000","last_peered":"2024-09-10T23:31:20.094695+0000","last_clean":"2024-09-10T23:31:20.094695+0000","last_became_active":"2024-09-10T23:31:19.095981+0000","last_became_peered":"2024-09-10T23:31:19.095981+0000","last_unstale":"2024-09-10T23:31:20.094695+0000","last_undegraded":"2024-09-10T23:31:20.094695+0000","last_fullsized":"2024-09-10T23:31:20.094695+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:24.795258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093794+0000","last_change":"2024-09-10T23:31:18.072179+0000","last_active":"2024-09-10T23:31:20.093794+0000","last_peered":"2024-09-10T23:31:20.093794+0000","last_clean":"2024-09-10T23:31:20.093794+0000","last_became_active":"2024-09-10T23:31:18.071874+0000","last_became_peered":"2024-09-10T23:31:18.071874+0000","last_unstale":"2024-09-10T23:31:20.093794+0000","last_undegraded":"2024-09-10T23:31:20.093794+0000","last_fullsized":"2024-09-10T23:31:20.093794+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:57.312073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193377+0000","last_change":"2024-09-10T23:31:19.086232+0000","last_active":"2024-09-10T23:31:20.193377+0000","last_peered":"2024-09-10T23:31:20.193377+0000","last_clean":"2024-09-10T23:31:20.193377+0000","last_became_active":"2024-09-10T23:31:19.085902+0000","last_became_peered":"2024-09-10T23:31:19.085902+0000","last_unstale":"2024-09-10T23:31:20.193377+0000","last_undegraded":"2024-09-10T23:31:20.193377+0000","last_fullsized":"2024-09-10T23:31:20.193377+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:40.663571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105346+0000","last_change":"2024-09-10T23:31:18.079488+0000","last_active":"2024-09-10T23:31:20.105346+0000","last_peered":"2024-09-10T23:31:20.105346+0000","last_clean":"2024-09-10T23:31:20.105346+0000","last_became_active":"2024-09-10T23:31:18.077598+0000","last_became_peered":"2024-09-10T23:31:18.077598+0000","last_unstale":"2024-09-10T23:31:20.105346+0000","last_undegraded":"2024-09-10T23:31:20.105346+0000","last_fullsized":"2024-09-10T23:31:20.105346+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:44.046563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":455,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198199+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:31:20.198199+0000","last_peered":"2024-09-10T23:31:20.198199+0000","last_clean":"2024-09-10T23:31:20.198199+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:31:20.198199+0000","last_undegraded":"2024-09-10T23:31:20.198199+0000","last_fullsized":"2024-09-10T23:31:20.198199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476930,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74004,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297836,"statfs":{"total":96636764160,"available":96560984064,"internally_reserved":0,"allocated":2682880,"data_stored":1259240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509635,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74576,"kb_used_data":3188,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297264,"statfs":{"total":96636764160,"available":96560398336,"internally_reserved":0,"allocated":3264512,"data_stored":1842928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73071050},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509634,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47684,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324156,"statfs":{"total":96636764160,"available":96587935744,"internally_reserved":0,"allocated":2662400,"data_stored":1252436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509635,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74048,"kb_used_data":2604,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297792,"statfs":{"total":96636764160,"available":96560939008,"internally_reserved":0,"allocated":2666496,"data_stored":1252506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74052,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297788,"statfs":{"total":96636764160,"available":96560934912,"internally_reserved":0,"allocated":2670592,"data_stored":1253088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509635,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47676,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324164,"statfs":{"total":96636764160,"available":96587943936,"internally_reserved":0,"allocated":2662400,"data_stored":1252436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78800,"kb_used_data":3192,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293040,"statfs":{"total":96636764160,"available":96556072960,"internally_reserved":0,"allocated":3268608,"data_stored":1844416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74024,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297816,"statfs":{"total":96636764160,"available":96560963584,"internally_reserved":0,"allocated":2699264,"data_stored":1261378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:31:27.879 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:31:28.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 -- 172.21.15.17:0/475420812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004155360 msgr2=0x7f2004073d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 --2- 172.21.15.17:0/475420812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004155360 0x7f2004073d70 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f20040b3920 tx=0x7f1ff001c800 comp rx=0 tx=0).stop 2024-09-10T23:31:28.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 -- 172.21.15.17:0/475420812 shutdown_connections 2024-09-10T23:31:28.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 --2- 172.21.15.17:0/475420812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2004155360 0x7f2004073d70 unknown :-1 s=CLOSED pgs=2450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 --2- 172.21.15.17:0/475420812 >> v2:172.21.15.77:3300/0 conn(0x7f2004154f80 0x7f2004073830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 -- 172.21.15.17:0/475420812 >> 172.21.15.17:0/475420812 conn(0x7f20040d0c30 msgr2=0x7f20040d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:28.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 -- 172.21.15.17:0/475420812 shutdown_connections 2024-09-10T23:31:28.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 -- 172.21.15.17:0/475420812 wait complete. 2024-09-10T23:31:28.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 Processor -- start 2024-09-10T23:31:28.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.035+0000 7f200bc00640 1 -- start start 2024-09-10T23:31:28.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f200bc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040cfa20 0x7f200415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f200bc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2004154f80 0x7f200414d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f200bc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2004155360 0x7f20041f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f200bc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2004167fd0 con 0x7f20040cfa20 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f200bc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2004167e50 con 0x7f2004154f80 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f200bc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2004168150 con 0x7f2004155360 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040cfa20 0x7f200415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040cfa20 0x7f200415cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59786/0 (socket says 172.21.15.17:59786) 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009200640 1 -- 172.21.15.17:0/110504592 learned_addr learned my addr 172.21.15.17:0/110504592 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2003e00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2004154f80 0x7f200414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009c00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2004155360 0x7f20041f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009200640 1 -- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2004155360 msgr2=0x7f20041f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009200640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2004155360 0x7f20041f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009200640 1 -- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2004154f80 msgr2=0x7f200414d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009200640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2004154f80 0x7f200414d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009200640 1 -- 172.21.15.17:0/110504592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20040b1f80 con 0x7f20040cfa20 2024-09-10T23:31:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2009200640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040cfa20 0x7f200415cc40 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800d980 tx=0x7f1ff800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2000c00640 1 -- 172.21.15.17:0/110504592 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8017030 con 0x7f20040cfa20 2024-09-10T23:31:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2000c00640 1 -- 172.21.15.17:0/110504592 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ff8009b20 con 0x7f20040cfa20 2024-09-10T23:31:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20040ca710 con 0x7f20040cfa20 2024-09-10T23:31:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2000c00640 1 -- 172.21.15.17:0/110504592 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8004020 con 0x7f20040cfa20 2024-09-10T23:31:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20041f8210 con 0x7f20040cfa20 2024-09-10T23:31:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20040ce800 con 0x7f20040cfa20 2024-09-10T23:31:28.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.039+0000 7f2000c00640 1 -- 172.21.15.17:0/110504592 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1ff8024060 con 0x7f20040cfa20 2024-09-10T23:31:28.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.043+0000 7f2000c00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe40725e0 0x7f1fe4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.043+0000 7f2000c00640 1 -- 172.21.15.17:0/110504592 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f1ff8093690 con 0x7f20040cfa20 2024-09-10T23:31:28.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.043+0000 7f2003e00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe40725e0 0x7f1fe4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.043+0000 7f2003e00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe40725e0 0x7f1fe4074aa0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00af000 tx=0x7f1ff001b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:28.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.047+0000 7f2000c00640 1 -- 172.21.15.17:0/110504592 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1ff805eb50 con 0x7f20040cfa20 2024-09-10T23:31:28.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.219+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20040caf60 con 0x7f1fe40725e0 2024-09-10T23:31:28.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.223+0000 7f2000c00640 1 -- 172.21.15.17:0/110504592 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252391 (secure 0 0 0) 0x7f20040caf60 con 0x7f1fe40725e0 2024-09-10T23:31:28.228 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:28.229 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:31:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe40725e0 msgr2=0x7f1fe4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe40725e0 0x7f1fe4074aa0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00af000 tx=0x7f1ff001b040 comp rx=0 tx=0).stop 2024-09-10T23:31:28.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040cfa20 msgr2=0x7f200415cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040cfa20 0x7f200415cc40 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800d980 tx=0x7f1ff800de40 comp rx=0 tx=0).stop 2024-09-10T23:31:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 shutdown_connections 2024-09-10T23:31:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1fe40725e0 0x7f1fe4074aa0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2004155360 0x7f20041f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2004154f80 0x7f200414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 --2- 172.21.15.17:0/110504592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20040cfa20 0x7f200415cc40 unknown :-1 s=CLOSED pgs=2451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 >> 172.21.15.17:0/110504592 conn(0x7f20040d0c30 msgr2=0x7f2004073a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 shutdown_connections 2024-09-10T23:31:28.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.227+0000 7f200bc00640 1 -- 172.21.15.17:0/110504592 wait complete. 2024-09-10T23:31:28.248 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":687,"stamp":"2024-09-10T23:31:26.526152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":544936,"kb_used_data":22120,"kb_used_omap":12,"kb_used_meta":522611,"kb_avail":754429784,"statfs":{"total":773094113280,"available":772536098816,"internally_reserved":0,"allocated":22650880,"data_stored":11258580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":535154225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002453"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193885+0000","last_change":"2024-09-10T23:31:19.087993+0000","last_active":"2024-09-10T23:31:20.193885+0000","last_peered":"2024-09-10T23:31:20.193885+0000","last_clean":"2024-09-10T23:31:20.193885+0000","last_became_active":"2024-09-10T23:31:19.085990+0000","last_became_peered":"2024-09-10T23:31:19.085990+0000","last_unstale":"2024-09-10T23:31:20.193885+0000","last_undegraded":"2024-09-10T23:31:20.193885+0000","last_fullsized":"2024-09-10T23:31:20.193885+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:17:11.695613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194431+0000","last_change":"2024-09-10T23:31:19.087458+0000","last_active":"2024-09-10T23:31:20.194431+0000","last_peered":"2024-09-10T23:31:20.194431+0000","last_clean":"2024-09-10T23:31:20.194431+0000","last_became_active":"2024-09-10T23:31:19.087143+0000","last_became_peered":"2024-09-10T23:31:19.087143+0000","last_unstale":"2024-09-10T23:31:20.194431+0000","last_undegraded":"2024-09-10T23:31:20.194431+0000","last_fullsized":"2024-09-10T23:31:20.194431+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:41.103255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192394+0000","last_change":"2024-09-10T23:31:19.089631+0000","last_active":"2024-09-10T23:31:20.192394+0000","last_peered":"2024-09-10T23:31:20.192394+0000","last_clean":"2024-09-10T23:31:20.192394+0000","last_became_active":"2024-09-10T23:31:19.089105+0000","last_became_peered":"2024-09-10T23:31:19.089105+0000","last_unstale":"2024-09-10T23:31:20.192394+0000","last_undegraded":"2024-09-10T23:31:20.192394+0000","last_fullsized":"2024-09-10T23:31:20.192394+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192198+0000","last_change":"2024-09-10T23:31:19.087326+0000","last_active":"2024-09-10T23:31:20.192198+0000","last_peered":"2024-09-10T23:31:20.192198+0000","last_clean":"2024-09-10T23:31:20.192198+0000","last_became_active":"2024-09-10T23:31:19.087006+0000","last_became_peered":"2024-09-10T23:31:19.087006+0000","last_unstale":"2024-09-10T23:31:20.192198+0000","last_undegraded":"2024-09-10T23:31:20.192198+0000","last_fullsized":"2024-09-10T23:31:20.192198+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:57.556182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102882+0000","last_change":"2024-09-10T23:31:19.106580+0000","last_active":"2024-09-10T23:31:20.102882+0000","last_peered":"2024-09-10T23:31:20.102882+0000","last_clean":"2024-09-10T23:31:20.102882+0000","last_became_active":"2024-09-10T23:31:19.105999+0000","last_became_peered":"2024-09-10T23:31:19.105999+0000","last_unstale":"2024-09-10T23:31:20.102882+0000","last_undegraded":"2024-09-10T23:31:20.102882+0000","last_fullsized":"2024-09-10T23:31:20.102882+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:50.026835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193456+0000","last_change":"2024-09-10T23:31:19.091314+0000","last_active":"2024-09-10T23:31:20.193456+0000","last_peered":"2024-09-10T23:31:20.193456+0000","last_clean":"2024-09-10T23:31:20.193456+0000","last_became_active":"2024-09-10T23:31:19.090925+0000","last_became_peered":"2024-09-10T23:31:19.090925+0000","last_unstale":"2024-09-10T23:31:20.193456+0000","last_undegraded":"2024-09-10T23:31:20.193456+0000","last_fullsized":"2024-09-10T23:31:20.193456+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:11.937267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105071+0000","last_change":"2024-09-10T23:31:19.091216+0000","last_active":"2024-09-10T23:31:20.105071+0000","last_peered":"2024-09-10T23:31:20.105071+0000","last_clean":"2024-09-10T23:31:20.105071+0000","last_became_active":"2024-09-10T23:31:19.090918+0000","last_became_peered":"2024-09-10T23:31:19.090918+0000","last_unstale":"2024-09-10T23:31:20.105071+0000","last_undegraded":"2024-09-10T23:31:20.105071+0000","last_fullsized":"2024-09-10T23:31:20.105071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:42.530144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102256+0000","last_change":"2024-09-10T23:31:19.098246+0000","last_active":"2024-09-10T23:31:20.102256+0000","last_peered":"2024-09-10T23:31:20.102256+0000","last_clean":"2024-09-10T23:31:20.102256+0000","last_became_active":"2024-09-10T23:31:19.097975+0000","last_became_peered":"2024-09-10T23:31:19.097975+0000","last_unstale":"2024-09-10T23:31:20.102256+0000","last_undegraded":"2024-09-10T23:31:20.102256+0000","last_fullsized":"2024-09-10T23:31:20.102256+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:40.965172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194091+0000","last_change":"2024-09-10T23:31:19.098322+0000","last_active":"2024-09-10T23:31:20.194091+0000","last_peered":"2024-09-10T23:31:20.194091+0000","last_clean":"2024-09-10T23:31:20.194091+0000","last_became_active":"2024-09-10T23:31:19.098043+0000","last_became_peered":"2024-09-10T23:31:19.098043+0000","last_unstale":"2024-09-10T23:31:20.194091+0000","last_undegraded":"2024-09-10T23:31:20.194091+0000","last_fullsized":"2024-09-10T23:31:20.194091+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:53.009367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192639+0000","last_change":"2024-09-10T23:31:19.098520+0000","last_active":"2024-09-10T23:31:20.192639+0000","last_peered":"2024-09-10T23:31:20.192639+0000","last_clean":"2024-09-10T23:31:20.192639+0000","last_became_active":"2024-09-10T23:31:19.098200+0000","last_became_peered":"2024-09-10T23:31:19.098200+0000","last_unstale":"2024-09-10T23:31:20.192639+0000","last_undegraded":"2024-09-10T23:31:20.192639+0000","last_fullsized":"2024-09-10T23:31:20.192639+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:15:41.151774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192798+0000","last_change":"2024-09-10T23:31:19.098678+0000","last_active":"2024-09-10T23:31:20.192798+0000","last_peered":"2024-09-10T23:31:20.192798+0000","last_clean":"2024-09-10T23:31:20.192798+0000","last_became_active":"2024-09-10T23:31:19.098170+0000","last_became_peered":"2024-09-10T23:31:19.098170+0000","last_unstale":"2024-09-10T23:31:20.192798+0000","last_undegraded":"2024-09-10T23:31:20.192798+0000","last_fullsized":"2024-09-10T23:31:20.192798+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:07.897360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193717+0000","last_change":"2024-09-10T23:31:19.086756+0000","last_active":"2024-09-10T23:31:20.193717+0000","last_peered":"2024-09-10T23:31:20.193717+0000","last_clean":"2024-09-10T23:31:20.193717+0000","last_became_active":"2024-09-10T23:31:19.086487+0000","last_became_peered":"2024-09-10T23:31:19.086487+0000","last_unstale":"2024-09-10T23:31:20.193717+0000","last_undegraded":"2024-09-10T23:31:20.193717+0000","last_fullsized":"2024-09-10T23:31:20.193717+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:04.173334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094472+0000","last_change":"2024-09-10T23:31:19.094064+0000","last_active":"2024-09-10T23:31:20.094472+0000","last_peered":"2024-09-10T23:31:20.094472+0000","last_clean":"2024-09-10T23:31:20.094472+0000","last_became_active":"2024-09-10T23:31:19.093135+0000","last_became_peered":"2024-09-10T23:31:19.093135+0000","last_unstale":"2024-09-10T23:31:20.094472+0000","last_undegraded":"2024-09-10T23:31:20.094472+0000","last_fullsized":"2024-09-10T23:31:20.094472+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:50.756718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086960+0000","last_change":"2024-09-10T23:31:19.080589+0000","last_active":"2024-09-10T23:31:20.086960+0000","last_peered":"2024-09-10T23:31:20.086960+0000","last_clean":"2024-09-10T23:31:20.086960+0000","last_became_active":"2024-09-10T23:31:19.077949+0000","last_became_peered":"2024-09-10T23:31:19.077949+0000","last_unstale":"2024-09-10T23:31:20.086960+0000","last_undegraded":"2024-09-10T23:31:20.086960+0000","last_fullsized":"2024-09-10T23:31:20.086960+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:09.621898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198488+0000","last_change":"2024-09-10T23:31:19.101714+0000","last_active":"2024-09-10T23:31:20.198488+0000","last_peered":"2024-09-10T23:31:20.198488+0000","last_clean":"2024-09-10T23:31:20.198488+0000","last_became_active":"2024-09-10T23:31:19.101460+0000","last_became_peered":"2024-09-10T23:31:19.101460+0000","last_unstale":"2024-09-10T23:31:20.198488+0000","last_undegraded":"2024-09-10T23:31:20.198488+0000","last_fullsized":"2024-09-10T23:31:20.198488+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:37.667145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192396+0000","last_change":"2024-09-10T23:31:19.083240+0000","last_active":"2024-09-10T23:31:20.192396+0000","last_peered":"2024-09-10T23:31:20.192396+0000","last_clean":"2024-09-10T23:31:20.192396+0000","last_became_active":"2024-09-10T23:31:19.082969+0000","last_became_peered":"2024-09-10T23:31:19.082969+0000","last_unstale":"2024-09-10T23:31:20.192396+0000","last_undegraded":"2024-09-10T23:31:20.192396+0000","last_fullsized":"2024-09-10T23:31:20.192396+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:01.871980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094849+0000","last_change":"2024-09-10T23:31:19.106578+0000","last_active":"2024-09-10T23:31:20.094849+0000","last_peered":"2024-09-10T23:31:20.094849+0000","last_clean":"2024-09-10T23:31:20.094849+0000","last_became_active":"2024-09-10T23:31:19.105865+0000","last_became_peered":"2024-09-10T23:31:19.105865+0000","last_unstale":"2024-09-10T23:31:20.094849+0000","last_undegraded":"2024-09-10T23:31:20.094849+0000","last_fullsized":"2024-09-10T23:31:20.094849+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:16.330127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192776+0000","last_change":"2024-09-10T23:31:19.082731+0000","last_active":"2024-09-10T23:31:20.192776+0000","last_peered":"2024-09-10T23:31:20.192776+0000","last_clean":"2024-09-10T23:31:20.192776+0000","last_became_active":"2024-09-10T23:31:19.080384+0000","last_became_peered":"2024-09-10T23:31:19.080384+0000","last_unstale":"2024-09-10T23:31:20.192776+0000","last_undegraded":"2024-09-10T23:31:20.192776+0000","last_fullsized":"2024-09-10T23:31:20.192776+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:49:42.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198839+0000","last_change":"2024-09-10T23:31:19.103536+0000","last_active":"2024-09-10T23:31:20.198839+0000","last_peered":"2024-09-10T23:31:20.198839+0000","last_clean":"2024-09-10T23:31:20.198839+0000","last_became_active":"2024-09-10T23:31:19.102843+0000","last_became_peered":"2024-09-10T23:31:19.102843+0000","last_unstale":"2024-09-10T23:31:20.198839+0000","last_undegraded":"2024-09-10T23:31:20.198839+0000","last_fullsized":"2024-09-10T23:31:20.198839+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:36.001349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194183+0000","last_change":"2024-09-10T23:31:19.099157+0000","last_active":"2024-09-10T23:31:20.194183+0000","last_peered":"2024-09-10T23:31:20.194183+0000","last_clean":"2024-09-10T23:31:20.194183+0000","last_became_active":"2024-09-10T23:31:19.098878+0000","last_became_peered":"2024-09-10T23:31:19.098878+0000","last_unstale":"2024-09-10T23:31:20.194183+0000","last_undegraded":"2024-09-10T23:31:20.194183+0000","last_fullsized":"2024-09-10T23:31:20.194183+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:06:04.700681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105122+0000","last_change":"2024-09-10T23:31:19.099725+0000","last_active":"2024-09-10T23:31:20.105122+0000","last_peered":"2024-09-10T23:31:20.105122+0000","last_clean":"2024-09-10T23:31:20.105122+0000","last_became_active":"2024-09-10T23:31:19.097618+0000","last_became_peered":"2024-09-10T23:31:19.097618+0000","last_unstale":"2024-09-10T23:31:20.105122+0000","last_undegraded":"2024-09-10T23:31:20.105122+0000","last_fullsized":"2024-09-10T23:31:20.105122+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:50.857332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094498+0000","last_change":"2024-09-10T23:31:19.097297+0000","last_active":"2024-09-10T23:31:20.094498+0000","last_peered":"2024-09-10T23:31:20.094498+0000","last_clean":"2024-09-10T23:31:20.094498+0000","last_became_active":"2024-09-10T23:31:19.097013+0000","last_became_peered":"2024-09-10T23:31:19.097013+0000","last_unstale":"2024-09-10T23:31:20.094498+0000","last_undegraded":"2024-09-10T23:31:20.094498+0000","last_fullsized":"2024-09-10T23:31:20.094498+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:13.020807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198693+0000","last_change":"2024-09-10T23:31:19.104434+0000","last_active":"2024-09-10T23:31:20.198693+0000","last_peered":"2024-09-10T23:31:20.198693+0000","last_clean":"2024-09-10T23:31:20.198693+0000","last_became_active":"2024-09-10T23:31:19.102729+0000","last_became_peered":"2024-09-10T23:31:19.102729+0000","last_unstale":"2024-09-10T23:31:20.198693+0000","last_undegraded":"2024-09-10T23:31:20.198693+0000","last_fullsized":"2024-09-10T23:31:20.198693+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:25.236930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094157+0000","last_change":"2024-09-10T23:31:19.092835+0000","last_active":"2024-09-10T23:31:20.094157+0000","last_peered":"2024-09-10T23:31:20.094157+0000","last_clean":"2024-09-10T23:31:20.094157+0000","last_became_active":"2024-09-10T23:31:19.092569+0000","last_became_peered":"2024-09-10T23:31:19.092569+0000","last_unstale":"2024-09-10T23:31:20.094157+0000","last_undegraded":"2024-09-10T23:31:20.094157+0000","last_fullsized":"2024-09-10T23:31:20.094157+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:01:45.600976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194606+0000","last_change":"2024-09-10T23:31:19.095134+0000","last_active":"2024-09-10T23:31:20.194606+0000","last_peered":"2024-09-10T23:31:20.194606+0000","last_clean":"2024-09-10T23:31:20.194606+0000","last_became_active":"2024-09-10T23:31:19.093338+0000","last_became_peered":"2024-09-10T23:31:19.093338+0000","last_unstale":"2024-09-10T23:31:20.194606+0000","last_undegraded":"2024-09-10T23:31:20.194606+0000","last_fullsized":"2024-09-10T23:31:20.194606+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:24.793170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105453+0000","last_change":"2024-09-10T23:31:19.094860+0000","last_active":"2024-09-10T23:31:20.105453+0000","last_peered":"2024-09-10T23:31:20.105453+0000","last_clean":"2024-09-10T23:31:20.105453+0000","last_became_active":"2024-09-10T23:31:19.092128+0000","last_became_peered":"2024-09-10T23:31:19.092128+0000","last_unstale":"2024-09-10T23:31:20.105453+0000","last_undegraded":"2024-09-10T23:31:20.105453+0000","last_fullsized":"2024-09-10T23:31:20.105453+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:22.506375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102610+0000","last_change":"2024-09-10T23:31:19.109738+0000","last_active":"2024-09-10T23:31:20.102610+0000","last_peered":"2024-09-10T23:31:20.102610+0000","last_clean":"2024-09-10T23:31:20.102610+0000","last_became_active":"2024-09-10T23:31:19.109432+0000","last_became_peered":"2024-09-10T23:31:19.109432+0000","last_unstale":"2024-09-10T23:31:20.102610+0000","last_undegraded":"2024-09-10T23:31:20.102610+0000","last_fullsized":"2024-09-10T23:31:20.102610+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:10.827017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193848+0000","last_change":"2024-09-10T23:31:19.098988+0000","last_active":"2024-09-10T23:31:20.193848+0000","last_peered":"2024-09-10T23:31:20.193848+0000","last_clean":"2024-09-10T23:31:20.193848+0000","last_became_active":"2024-09-10T23:31:19.098748+0000","last_became_peered":"2024-09-10T23:31:19.098748+0000","last_unstale":"2024-09-10T23:31:20.193848+0000","last_undegraded":"2024-09-10T23:31:20.193848+0000","last_fullsized":"2024-09-10T23:31:20.193848+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:24.576789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087141+0000","last_change":"2024-09-10T23:31:19.081052+0000","last_active":"2024-09-10T23:31:20.087141+0000","last_peered":"2024-09-10T23:31:20.087141+0000","last_clean":"2024-09-10T23:31:20.087141+0000","last_became_active":"2024-09-10T23:31:19.080723+0000","last_became_peered":"2024-09-10T23:31:19.080723+0000","last_unstale":"2024-09-10T23:31:20.087141+0000","last_undegraded":"2024-09-10T23:31:20.087141+0000","last_fullsized":"2024-09-10T23:31:20.087141+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:42.699478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086951+0000","last_change":"2024-09-10T23:31:19.103280+0000","last_active":"2024-09-10T23:31:20.086951+0000","last_peered":"2024-09-10T23:31:20.086951+0000","last_clean":"2024-09-10T23:31:20.086951+0000","last_became_active":"2024-09-10T23:31:19.102558+0000","last_became_peered":"2024-09-10T23:31:19.102558+0000","last_unstale":"2024-09-10T23:31:20.086951+0000","last_undegraded":"2024-09-10T23:31:20.086951+0000","last_fullsized":"2024-09-10T23:31:20.086951+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193133+0000","last_change":"2024-09-10T23:31:19.093287+0000","last_active":"2024-09-10T23:31:20.193133+0000","last_peered":"2024-09-10T23:31:20.193133+0000","last_clean":"2024-09-10T23:31:20.193133+0000","last_became_active":"2024-09-10T23:31:19.093017+0000","last_became_peered":"2024-09-10T23:31:19.093017+0000","last_unstale":"2024-09-10T23:31:20.193133+0000","last_undegraded":"2024-09-10T23:31:20.193133+0000","last_fullsized":"2024-09-10T23:31:20.193133+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:33.239210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193137+0000","last_change":"2024-09-10T23:31:19.099804+0000","last_active":"2024-09-10T23:31:20.193137+0000","last_peered":"2024-09-10T23:31:20.193137+0000","last_clean":"2024-09-10T23:31:20.193137+0000","last_became_active":"2024-09-10T23:31:19.099522+0000","last_became_peered":"2024-09-10T23:31:19.099522+0000","last_unstale":"2024-09-10T23:31:20.193137+0000","last_undegraded":"2024-09-10T23:31:20.193137+0000","last_fullsized":"2024-09-10T23:31:20.193137+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:22.241487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192217+0000","last_change":"2024-09-10T23:31:19.093746+0000","last_active":"2024-09-10T23:31:20.192217+0000","last_peered":"2024-09-10T23:31:20.192217+0000","last_clean":"2024-09-10T23:31:20.192217+0000","last_became_active":"2024-09-10T23:31:19.093431+0000","last_became_peered":"2024-09-10T23:31:19.093431+0000","last_unstale":"2024-09-10T23:31:20.192217+0000","last_undegraded":"2024-09-10T23:31:20.192217+0000","last_fullsized":"2024-09-10T23:31:20.192217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:53.986164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"211'4","reported_seq":19,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193924+0000","last_change":"2024-09-10T23:31:18.076743+0000","last_active":"2024-09-10T23:31:20.193924+0000","last_peered":"2024-09-10T23:31:20.193924+0000","last_clean":"2024-09-10T23:31:20.193924+0000","last_became_active":"2024-09-10T23:31:18.076117+0000","last_became_peered":"2024-09-10T23:31:18.076117+0000","last_unstale":"2024-09-10T23:31:20.193924+0000","last_undegraded":"2024-09-10T23:31:20.193924+0000","last_fullsized":"2024-09-10T23:31:20.193924+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:26.269280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198594+0000","last_change":"2024-09-10T23:31:19.110826+0000","last_active":"2024-09-10T23:31:20.198594+0000","last_peered":"2024-09-10T23:31:20.198594+0000","last_clean":"2024-09-10T23:31:20.198594+0000","last_became_active":"2024-09-10T23:31:19.110510+0000","last_became_peered":"2024-09-10T23:31:19.110510+0000","last_unstale":"2024-09-10T23:31:20.198594+0000","last_undegraded":"2024-09-10T23:31:20.198594+0000","last_fullsized":"2024-09-10T23:31:20.198594+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:00.524828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094383+0000","last_change":"2024-09-10T23:31:18.084510+0000","last_active":"2024-09-10T23:31:20.094383+0000","last_peered":"2024-09-10T23:31:20.094383+0000","last_clean":"2024-09-10T23:31:20.094383+0000","last_became_active":"2024-09-10T23:31:18.084162+0000","last_became_peered":"2024-09-10T23:31:18.084162+0000","last_unstale":"2024-09-10T23:31:20.094383+0000","last_undegraded":"2024-09-10T23:31:20.094383+0000","last_fullsized":"2024-09-10T23:31:20.094383+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:14.097899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193502+0000","last_change":"2024-09-10T23:31:19.092163+0000","last_active":"2024-09-10T23:31:20.193502+0000","last_peered":"2024-09-10T23:31:20.193502+0000","last_clean":"2024-09-10T23:31:20.193502+0000","last_became_active":"2024-09-10T23:31:19.091894+0000","last_became_peered":"2024-09-10T23:31:19.091894+0000","last_unstale":"2024-09-10T23:31:20.193502+0000","last_undegraded":"2024-09-10T23:31:20.193502+0000","last_fullsized":"2024-09-10T23:31:20.193502+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:37.659216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087404+0000","last_change":"2024-09-10T23:31:18.073162+0000","last_active":"2024-09-10T23:31:20.087404+0000","last_peered":"2024-09-10T23:31:20.087404+0000","last_clean":"2024-09-10T23:31:20.087404+0000","last_became_active":"2024-09-10T23:31:18.072848+0000","last_became_peered":"2024-09-10T23:31:18.072848+0000","last_unstale":"2024-09-10T23:31:20.087404+0000","last_undegraded":"2024-09-10T23:31:20.087404+0000","last_fullsized":"2024-09-10T23:31:20.087404+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:43.878999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087312+0000","last_change":"2024-09-10T23:31:19.086134+0000","last_active":"2024-09-10T23:31:20.087312+0000","last_peered":"2024-09-10T23:31:20.087312+0000","last_clean":"2024-09-10T23:31:20.087312+0000","last_became_active":"2024-09-10T23:31:19.085823+0000","last_became_peered":"2024-09-10T23:31:19.085823+0000","last_unstale":"2024-09-10T23:31:20.087312+0000","last_undegraded":"2024-09-10T23:31:20.087312+0000","last_fullsized":"2024-09-10T23:31:20.087312+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198587+0000","last_change":"2024-09-10T23:31:18.085745+0000","last_active":"2024-09-10T23:31:20.198587+0000","last_peered":"2024-09-10T23:31:20.198587+0000","last_clean":"2024-09-10T23:31:20.198587+0000","last_became_active":"2024-09-10T23:31:18.085478+0000","last_became_peered":"2024-09-10T23:31:18.085478+0000","last_unstale":"2024-09-10T23:31:20.198587+0000","last_undegraded":"2024-09-10T23:31:20.198587+0000","last_fullsized":"2024-09-10T23:31:20.198587+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105410+0000","last_change":"2024-09-10T23:31:19.106907+0000","last_active":"2024-09-10T23:31:20.105410+0000","last_peered":"2024-09-10T23:31:20.105410+0000","last_clean":"2024-09-10T23:31:20.105410+0000","last_became_active":"2024-09-10T23:31:19.106522+0000","last_became_peered":"2024-09-10T23:31:19.106522+0000","last_unstale":"2024-09-10T23:31:20.105410+0000","last_undegraded":"2024-09-10T23:31:20.105410+0000","last_fullsized":"2024-09-10T23:31:20.105410+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:18.131377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087064+0000","last_change":"2024-09-10T23:31:18.072466+0000","last_active":"2024-09-10T23:31:20.087064+0000","last_peered":"2024-09-10T23:31:20.087064+0000","last_clean":"2024-09-10T23:31:20.087064+0000","last_became_active":"2024-09-10T23:31:18.071711+0000","last_became_peered":"2024-09-10T23:31:18.071711+0000","last_unstale":"2024-09-10T23:31:20.087064+0000","last_undegraded":"2024-09-10T23:31:20.087064+0000","last_fullsized":"2024-09-10T23:31:20.087064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:10.808100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192519+0000","last_change":"2024-09-10T23:31:19.081454+0000","last_active":"2024-09-10T23:31:20.192519+0000","last_peered":"2024-09-10T23:31:20.192519+0000","last_clean":"2024-09-10T23:31:20.192519+0000","last_became_active":"2024-09-10T23:31:19.080030+0000","last_became_peered":"2024-09-10T23:31:19.080030+0000","last_unstale":"2024-09-10T23:31:20.192519+0000","last_undegraded":"2024-09-10T23:31:20.192519+0000","last_fullsized":"2024-09-10T23:31:20.192519+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:55.794776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192620+0000","last_change":"2024-09-10T23:31:18.071545+0000","last_active":"2024-09-10T23:31:20.192620+0000","last_peered":"2024-09-10T23:31:20.192620+0000","last_clean":"2024-09-10T23:31:20.192620+0000","last_became_active":"2024-09-10T23:31:18.070999+0000","last_became_peered":"2024-09-10T23:31:18.070999+0000","last_unstale":"2024-09-10T23:31:20.192620+0000","last_undegraded":"2024-09-10T23:31:20.192620+0000","last_fullsized":"2024-09-10T23:31:20.192620+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:13.320251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102930+0000","last_change":"2024-09-10T23:31:19.108690+0000","last_active":"2024-09-10T23:31:20.102930+0000","last_peered":"2024-09-10T23:31:20.102930+0000","last_clean":"2024-09-10T23:31:20.102930+0000","last_became_active":"2024-09-10T23:31:19.108427+0000","last_became_peered":"2024-09-10T23:31:19.108427+0000","last_unstale":"2024-09-10T23:31:20.102930+0000","last_undegraded":"2024-09-10T23:31:20.102930+0000","last_fullsized":"2024-09-10T23:31:20.102930+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:46.359285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193051+0000","last_change":"2024-09-10T23:31:18.068409+0000","last_active":"2024-09-10T23:31:20.193051+0000","last_peered":"2024-09-10T23:31:20.193051+0000","last_clean":"2024-09-10T23:31:20.193051+0000","last_became_active":"2024-09-10T23:31:18.068106+0000","last_became_peered":"2024-09-10T23:31:18.068106+0000","last_unstale":"2024-09-10T23:31:20.193051+0000","last_undegraded":"2024-09-10T23:31:20.193051+0000","last_fullsized":"2024-09-10T23:31:20.193051+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:23.000401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105021+0000","last_change":"2024-09-10T23:31:19.100589+0000","last_active":"2024-09-10T23:31:20.105021+0000","last_peered":"2024-09-10T23:31:20.105021+0000","last_clean":"2024-09-10T23:31:20.105021+0000","last_became_active":"2024-09-10T23:31:19.100313+0000","last_became_peered":"2024-09-10T23:31:19.100313+0000","last_unstale":"2024-09-10T23:31:20.105021+0000","last_undegraded":"2024-09-10T23:31:20.105021+0000","last_fullsized":"2024-09-10T23:31:20.105021+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:27.446745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087425+0000","last_change":"2024-09-10T23:31:18.077014+0000","last_active":"2024-09-10T23:31:20.087425+0000","last_peered":"2024-09-10T23:31:20.087425+0000","last_clean":"2024-09-10T23:31:20.087425+0000","last_became_active":"2024-09-10T23:31:18.076754+0000","last_became_peered":"2024-09-10T23:31:18.076754+0000","last_unstale":"2024-09-10T23:31:20.087425+0000","last_undegraded":"2024-09-10T23:31:20.087425+0000","last_fullsized":"2024-09-10T23:31:20.087425+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:27.536844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094124+0000","last_change":"2024-09-10T23:31:19.098486+0000","last_active":"2024-09-10T23:31:20.094124+0000","last_peered":"2024-09-10T23:31:20.094124+0000","last_clean":"2024-09-10T23:31:20.094124+0000","last_became_active":"2024-09-10T23:31:19.098206+0000","last_became_peered":"2024-09-10T23:31:19.098206+0000","last_unstale":"2024-09-10T23:31:20.094124+0000","last_undegraded":"2024-09-10T23:31:20.094124+0000","last_fullsized":"2024-09-10T23:31:20.094124+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:35.669124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192768+0000","last_change":"2024-09-10T23:31:18.079188+0000","last_active":"2024-09-10T23:31:20.192768+0000","last_peered":"2024-09-10T23:31:20.192768+0000","last_clean":"2024-09-10T23:31:20.192768+0000","last_became_active":"2024-09-10T23:31:18.078875+0000","last_became_peered":"2024-09-10T23:31:18.078875+0000","last_unstale":"2024-09-10T23:31:20.192768+0000","last_undegraded":"2024-09-10T23:31:20.192768+0000","last_fullsized":"2024-09-10T23:31:20.192768+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:21.354649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192579+0000","last_change":"2024-09-10T23:31:19.107187+0000","last_active":"2024-09-10T23:31:20.192579+0000","last_peered":"2024-09-10T23:31:20.192579+0000","last_clean":"2024-09-10T23:31:20.192579+0000","last_became_active":"2024-09-10T23:31:19.106681+0000","last_became_peered":"2024-09-10T23:31:19.106681+0000","last_unstale":"2024-09-10T23:31:20.192579+0000","last_undegraded":"2024-09-10T23:31:20.192579+0000","last_fullsized":"2024-09-10T23:31:20.192579+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:14.920623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"211'3","reported_seq":18,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102559+0000","last_change":"2024-09-10T23:31:18.073660+0000","last_active":"2024-09-10T23:31:20.102559+0000","last_peered":"2024-09-10T23:31:20.102559+0000","last_clean":"2024-09-10T23:31:20.102559+0000","last_became_active":"2024-09-10T23:31:18.072881+0000","last_became_peered":"2024-09-10T23:31:18.072881+0000","last_unstale":"2024-09-10T23:31:20.102559+0000","last_undegraded":"2024-09-10T23:31:20.102559+0000","last_fullsized":"2024-09-10T23:31:20.102559+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:12:17.944201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105092+0000","last_change":"2024-09-10T23:31:19.096083+0000","last_active":"2024-09-10T23:31:20.105092+0000","last_peered":"2024-09-10T23:31:20.105092+0000","last_clean":"2024-09-10T23:31:20.105092+0000","last_became_active":"2024-09-10T23:31:19.095779+0000","last_became_peered":"2024-09-10T23:31:19.095779+0000","last_unstale":"2024-09-10T23:31:20.105092+0000","last_undegraded":"2024-09-10T23:31:20.105092+0000","last_fullsized":"2024-09-10T23:31:20.105092+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:50.287034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"211'6","reported_seq":21,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193946+0000","last_change":"2024-09-10T23:31:18.065614+0000","last_active":"2024-09-10T23:31:20.193946+0000","last_peered":"2024-09-10T23:31:20.193946+0000","last_clean":"2024-09-10T23:31:20.193946+0000","last_became_active":"2024-09-10T23:31:18.065239+0000","last_became_peered":"2024-09-10T23:31:18.065239+0000","last_unstale":"2024-09-10T23:31:20.193946+0000","last_undegraded":"2024-09-10T23:31:20.193946+0000","last_fullsized":"2024-09-10T23:31:20.193946+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:08:53.989498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193990+0000","last_change":"2024-09-10T23:31:19.090713+0000","last_active":"2024-09-10T23:31:20.193990+0000","last_peered":"2024-09-10T23:31:20.193990+0000","last_clean":"2024-09-10T23:31:20.193990+0000","last_became_active":"2024-09-10T23:31:19.089009+0000","last_became_peered":"2024-09-10T23:31:19.089009+0000","last_unstale":"2024-09-10T23:31:20.193990+0000","last_undegraded":"2024-09-10T23:31:20.193990+0000","last_fullsized":"2024-09-10T23:31:20.193990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:07.556427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198523+0000","last_change":"2024-09-10T23:31:18.082553+0000","last_active":"2024-09-10T23:31:20.198523+0000","last_peered":"2024-09-10T23:31:20.198523+0000","last_clean":"2024-09-10T23:31:20.198523+0000","last_became_active":"2024-09-10T23:31:18.082228+0000","last_became_peered":"2024-09-10T23:31:18.082228+0000","last_unstale":"2024-09-10T23:31:20.198523+0000","last_undegraded":"2024-09-10T23:31:20.198523+0000","last_fullsized":"2024-09-10T23:31:20.198523+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:41.522911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105367+0000","last_change":"2024-09-10T23:31:19.094510+0000","last_active":"2024-09-10T23:31:20.105367+0000","last_peered":"2024-09-10T23:31:20.105367+0000","last_clean":"2024-09-10T23:31:20.105367+0000","last_became_active":"2024-09-10T23:31:19.092810+0000","last_became_peered":"2024-09-10T23:31:19.092810+0000","last_unstale":"2024-09-10T23:31:20.105367+0000","last_undegraded":"2024-09-10T23:31:20.105367+0000","last_fullsized":"2024-09-10T23:31:20.105367+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:22.361882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102270+0000","last_change":"2024-09-10T23:31:18.086364+0000","last_active":"2024-09-10T23:31:20.102270+0000","last_peered":"2024-09-10T23:31:20.102270+0000","last_clean":"2024-09-10T23:31:20.102270+0000","last_became_active":"2024-09-10T23:31:18.086107+0000","last_became_peered":"2024-09-10T23:31:18.086107+0000","last_unstale":"2024-09-10T23:31:20.102270+0000","last_undegraded":"2024-09-10T23:31:20.102270+0000","last_fullsized":"2024-09-10T23:31:20.102270+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:03:20.135593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198696+0000","last_change":"2024-09-10T23:31:19.107551+0000","last_active":"2024-09-10T23:31:20.198696+0000","last_peered":"2024-09-10T23:31:20.198696+0000","last_clean":"2024-09-10T23:31:20.198696+0000","last_became_active":"2024-09-10T23:31:19.107264+0000","last_became_peered":"2024-09-10T23:31:19.107264+0000","last_unstale":"2024-09-10T23:31:20.198696+0000","last_undegraded":"2024-09-10T23:31:20.198696+0000","last_fullsized":"2024-09-10T23:31:20.198696+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:06.312069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102064+0000","last_change":"2024-09-10T23:31:18.081471+0000","last_active":"2024-09-10T23:31:20.102064+0000","last_peered":"2024-09-10T23:31:20.102064+0000","last_clean":"2024-09-10T23:31:20.102064+0000","last_became_active":"2024-09-10T23:31:18.080940+0000","last_became_peered":"2024-09-10T23:31:18.080940+0000","last_unstale":"2024-09-10T23:31:20.102064+0000","last_undegraded":"2024-09-10T23:31:20.102064+0000","last_fullsized":"2024-09-10T23:31:20.102064+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:43.514503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102911+0000","last_change":"2024-09-10T23:31:19.105155+0000","last_active":"2024-09-10T23:31:20.102911+0000","last_peered":"2024-09-10T23:31:20.102911+0000","last_clean":"2024-09-10T23:31:20.102911+0000","last_became_active":"2024-09-10T23:31:19.104892+0000","last_became_peered":"2024-09-10T23:31:19.104892+0000","last_unstale":"2024-09-10T23:31:20.102911+0000","last_undegraded":"2024-09-10T23:31:20.102911+0000","last_fullsized":"2024-09-10T23:31:20.102911+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:37.315477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"211'8","reported_seq":23,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192327+0000","last_change":"2024-09-10T23:31:18.080071+0000","last_active":"2024-09-10T23:31:20.192327+0000","last_peered":"2024-09-10T23:31:20.192327+0000","last_clean":"2024-09-10T23:31:20.192327+0000","last_became_active":"2024-09-10T23:31:18.079813+0000","last_became_peered":"2024-09-10T23:31:18.079813+0000","last_unstale":"2024-09-10T23:31:20.192327+0000","last_undegraded":"2024-09-10T23:31:20.192327+0000","last_fullsized":"2024-09-10T23:31:20.192327+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:25.626605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102174+0000","last_change":"2024-09-10T23:31:19.102720+0000","last_active":"2024-09-10T23:31:20.102174+0000","last_peered":"2024-09-10T23:31:20.102174+0000","last_clean":"2024-09-10T23:31:20.102174+0000","last_became_active":"2024-09-10T23:31:19.102397+0000","last_became_peered":"2024-09-10T23:31:19.102397+0000","last_unstale":"2024-09-10T23:31:20.102174+0000","last_undegraded":"2024-09-10T23:31:20.102174+0000","last_fullsized":"2024-09-10T23:31:20.102174+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:42.681149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194051+0000","last_change":"2024-09-10T23:31:18.073203+0000","last_active":"2024-09-10T23:31:20.194051+0000","last_peered":"2024-09-10T23:31:20.194051+0000","last_clean":"2024-09-10T23:31:20.194051+0000","last_became_active":"2024-09-10T23:31:18.072769+0000","last_became_peered":"2024-09-10T23:31:18.072769+0000","last_unstale":"2024-09-10T23:31:20.194051+0000","last_undegraded":"2024-09-10T23:31:20.194051+0000","last_fullsized":"2024-09-10T23:31:20.194051+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:37:31.481224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102172+0000","last_change":"2024-09-10T23:31:19.104376+0000","last_active":"2024-09-10T23:31:20.102172+0000","last_peered":"2024-09-10T23:31:20.102172+0000","last_clean":"2024-09-10T23:31:20.102172+0000","last_became_active":"2024-09-10T23:31:19.102719+0000","last_became_peered":"2024-09-10T23:31:19.102719+0000","last_unstale":"2024-09-10T23:31:20.102172+0000","last_undegraded":"2024-09-10T23:31:20.102172+0000","last_fullsized":"2024-09-10T23:31:20.102172+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:56.299808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194495+0000","last_change":"2024-09-10T23:31:18.074043+0000","last_active":"2024-09-10T23:31:20.194495+0000","last_peered":"2024-09-10T23:31:20.194495+0000","last_clean":"2024-09-10T23:31:20.194495+0000","last_became_active":"2024-09-10T23:31:18.073766+0000","last_became_peered":"2024-09-10T23:31:18.073766+0000","last_unstale":"2024-09-10T23:31:20.194495+0000","last_undegraded":"2024-09-10T23:31:20.194495+0000","last_fullsized":"2024-09-10T23:31:20.194495+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:18:41.950907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193217+0000","last_change":"2024-09-10T23:31:19.102248+0000","last_active":"2024-09-10T23:31:20.193217+0000","last_peered":"2024-09-10T23:31:20.193217+0000","last_clean":"2024-09-10T23:31:20.193217+0000","last_became_active":"2024-09-10T23:31:19.101921+0000","last_became_peered":"2024-09-10T23:31:19.101921+0000","last_unstale":"2024-09-10T23:31:20.193217+0000","last_undegraded":"2024-09-10T23:31:20.193217+0000","last_fullsized":"2024-09-10T23:31:20.193217+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:33.277637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094509+0000","last_change":"2024-09-10T23:31:18.084654+0000","last_active":"2024-09-10T23:31:20.094509+0000","last_peered":"2024-09-10T23:31:20.094509+0000","last_clean":"2024-09-10T23:31:20.094509+0000","last_became_active":"2024-09-10T23:31:18.084150+0000","last_became_peered":"2024-09-10T23:31:18.084150+0000","last_unstale":"2024-09-10T23:31:20.094509+0000","last_undegraded":"2024-09-10T23:31:20.094509+0000","last_fullsized":"2024-09-10T23:31:20.094509+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:00:28.813302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192910+0000","last_change":"2024-09-10T23:31:19.107063+0000","last_active":"2024-09-10T23:31:20.192910+0000","last_peered":"2024-09-10T23:31:20.192910+0000","last_clean":"2024-09-10T23:31:20.192910+0000","last_became_active":"2024-09-10T23:31:19.106793+0000","last_became_peered":"2024-09-10T23:31:19.106793+0000","last_unstale":"2024-09-10T23:31:20.192910+0000","last_undegraded":"2024-09-10T23:31:20.192910+0000","last_fullsized":"2024-09-10T23:31:20.192910+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:58.414351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198722+0000","last_change":"2024-09-10T23:31:18.075017+0000","last_active":"2024-09-10T23:31:20.198722+0000","last_peered":"2024-09-10T23:31:20.198722+0000","last_clean":"2024-09-10T23:31:20.198722+0000","last_became_active":"2024-09-10T23:31:18.073860+0000","last_became_peered":"2024-09-10T23:31:18.073860+0000","last_unstale":"2024-09-10T23:31:20.198722+0000","last_undegraded":"2024-09-10T23:31:20.198722+0000","last_fullsized":"2024-09-10T23:31:20.198722+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:09.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192182+0000","last_change":"2024-09-10T23:31:19.084774+0000","last_active":"2024-09-10T23:31:20.192182+0000","last_peered":"2024-09-10T23:31:20.192182+0000","last_clean":"2024-09-10T23:31:20.192182+0000","last_became_active":"2024-09-10T23:31:19.083516+0000","last_became_peered":"2024-09-10T23:31:19.083516+0000","last_unstale":"2024-09-10T23:31:20.192182+0000","last_undegraded":"2024-09-10T23:31:20.192182+0000","last_fullsized":"2024-09-10T23:31:20.192182+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:20.993785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193021+0000","last_change":"2024-09-10T23:31:18.070568+0000","last_active":"2024-09-10T23:31:20.193021+0000","last_peered":"2024-09-10T23:31:20.193021+0000","last_clean":"2024-09-10T23:31:20.193021+0000","last_became_active":"2024-09-10T23:31:18.070110+0000","last_became_peered":"2024-09-10T23:31:18.070110+0000","last_unstale":"2024-09-10T23:31:20.193021+0000","last_undegraded":"2024-09-10T23:31:20.193021+0000","last_fullsized":"2024-09-10T23:31:20.193021+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:21:17.124144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194213+0000","last_change":"2024-09-10T23:31:19.094490+0000","last_active":"2024-09-10T23:31:20.194213+0000","last_peered":"2024-09-10T23:31:20.194213+0000","last_clean":"2024-09-10T23:31:20.194213+0000","last_became_active":"2024-09-10T23:31:19.094236+0000","last_became_peered":"2024-09-10T23:31:19.094236+0000","last_unstale":"2024-09-10T23:31:20.194213+0000","last_undegraded":"2024-09-10T23:31:20.194213+0000","last_fullsized":"2024-09-10T23:31:20.194213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:28.628059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094462+0000","last_change":"2024-09-10T23:31:18.068183+0000","last_active":"2024-09-10T23:31:20.094462+0000","last_peered":"2024-09-10T23:31:20.094462+0000","last_clean":"2024-09-10T23:31:20.094462+0000","last_became_active":"2024-09-10T23:31:18.067814+0000","last_became_peered":"2024-09-10T23:31:18.067814+0000","last_unstale":"2024-09-10T23:31:20.094462+0000","last_undegraded":"2024-09-10T23:31:20.094462+0000","last_fullsized":"2024-09-10T23:31:20.094462+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:42.363754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094491+0000","last_change":"2024-09-10T23:31:19.099060+0000","last_active":"2024-09-10T23:31:20.094491+0000","last_peered":"2024-09-10T23:31:20.094491+0000","last_clean":"2024-09-10T23:31:20.094491+0000","last_became_active":"2024-09-10T23:31:19.098576+0000","last_became_peered":"2024-09-10T23:31:19.098576+0000","last_unstale":"2024-09-10T23:31:20.094491+0000","last_undegraded":"2024-09-10T23:31:20.094491+0000","last_fullsized":"2024-09-10T23:31:20.094491+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:27.428492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093973+0000","last_change":"2024-09-10T23:31:18.076954+0000","last_active":"2024-09-10T23:31:20.093973+0000","last_peered":"2024-09-10T23:31:20.093973+0000","last_clean":"2024-09-10T23:31:20.093973+0000","last_became_active":"2024-09-10T23:31:18.076673+0000","last_became_peered":"2024-09-10T23:31:18.076673+0000","last_unstale":"2024-09-10T23:31:20.093973+0000","last_undegraded":"2024-09-10T23:31:20.093973+0000","last_fullsized":"2024-09-10T23:31:20.093973+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:46:37.993408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094762+0000","last_change":"2024-09-10T23:31:19.102914+0000","last_active":"2024-09-10T23:31:20.094762+0000","last_peered":"2024-09-10T23:31:20.094762+0000","last_clean":"2024-09-10T23:31:20.094762+0000","last_became_active":"2024-09-10T23:31:19.102662+0000","last_became_peered":"2024-09-10T23:31:19.102662+0000","last_unstale":"2024-09-10T23:31:20.094762+0000","last_undegraded":"2024-09-10T23:31:20.094762+0000","last_fullsized":"2024-09-10T23:31:20.094762+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:03.963145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.086835+0000","last_change":"2024-09-10T23:31:18.074711+0000","last_active":"2024-09-10T23:31:20.086835+0000","last_peered":"2024-09-10T23:31:20.086835+0000","last_clean":"2024-09-10T23:31:20.086835+0000","last_became_active":"2024-09-10T23:31:18.074079+0000","last_became_peered":"2024-09-10T23:31:18.074079+0000","last_unstale":"2024-09-10T23:31:20.086835+0000","last_undegraded":"2024-09-10T23:31:20.086835+0000","last_fullsized":"2024-09-10T23:31:20.086835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:21.499142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104963+0000","last_change":"2024-09-10T23:31:19.091779+0000","last_active":"2024-09-10T23:31:20.104963+0000","last_peered":"2024-09-10T23:31:20.104963+0000","last_clean":"2024-09-10T23:31:20.104963+0000","last_became_active":"2024-09-10T23:31:19.091404+0000","last_became_peered":"2024-09-10T23:31:19.091404+0000","last_unstale":"2024-09-10T23:31:20.104963+0000","last_undegraded":"2024-09-10T23:31:20.104963+0000","last_fullsized":"2024-09-10T23:31:20.104963+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:02.528031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"211'2","reported_seq":17,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192714+0000","last_change":"2024-09-10T23:31:18.082254+0000","last_active":"2024-09-10T23:31:20.192714+0000","last_peered":"2024-09-10T23:31:20.192714+0000","last_clean":"2024-09-10T23:31:20.192714+0000","last_became_active":"2024-09-10T23:31:18.081963+0000","last_became_peered":"2024-09-10T23:31:18.081963+0000","last_unstale":"2024-09-10T23:31:20.192714+0000","last_undegraded":"2024-09-10T23:31:20.192714+0000","last_fullsized":"2024-09-10T23:31:20.192714+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:59.300815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198454+0000","last_change":"2024-09-10T23:31:19.104473+0000","last_active":"2024-09-10T23:31:20.198454+0000","last_peered":"2024-09-10T23:31:20.198454+0000","last_clean":"2024-09-10T23:31:20.198454+0000","last_became_active":"2024-09-10T23:31:19.104186+0000","last_became_peered":"2024-09-10T23:31:19.104186+0000","last_unstale":"2024-09-10T23:31:20.198454+0000","last_undegraded":"2024-09-10T23:31:20.198454+0000","last_fullsized":"2024-09-10T23:31:20.198454+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:20.987147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"212'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.104384+0000","last_change":"2024-09-10T23:31:18.079920+0000","last_active":"2024-09-10T23:31:20.104384+0000","last_peered":"2024-09-10T23:31:20.104384+0000","last_clean":"2024-09-10T23:31:20.104384+0000","last_became_active":"2024-09-10T23:31:18.079584+0000","last_became_peered":"2024-09-10T23:31:18.079584+0000","last_unstale":"2024-09-10T23:31:20.104384+0000","last_undegraded":"2024-09-10T23:31:20.104384+0000","last_fullsized":"2024-09-10T23:31:20.104384+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:33.922546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192416+0000","last_change":"2024-09-10T23:31:19.080253+0000","last_active":"2024-09-10T23:31:20.192416+0000","last_peered":"2024-09-10T23:31:20.192416+0000","last_clean":"2024-09-10T23:31:20.192416+0000","last_became_active":"2024-09-10T23:31:19.079908+0000","last_became_peered":"2024-09-10T23:31:19.079908+0000","last_unstale":"2024-09-10T23:31:20.192416+0000","last_undegraded":"2024-09-10T23:31:20.192416+0000","last_fullsized":"2024-09-10T23:31:20.192416+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:47:44.441502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087252+0000","last_change":"2024-09-10T23:31:18.080655+0000","last_active":"2024-09-10T23:31:20.087252+0000","last_peered":"2024-09-10T23:31:20.087252+0000","last_clean":"2024-09-10T23:31:20.087252+0000","last_became_active":"2024-09-10T23:31:18.080370+0000","last_became_peered":"2024-09-10T23:31:18.080370+0000","last_unstale":"2024-09-10T23:31:20.087252+0000","last_undegraded":"2024-09-10T23:31:20.087252+0000","last_fullsized":"2024-09-10T23:31:20.087252+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:55.916497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102543+0000","last_change":"2024-09-10T23:31:19.106872+0000","last_active":"2024-09-10T23:31:20.102543+0000","last_peered":"2024-09-10T23:31:20.102543+0000","last_clean":"2024-09-10T23:31:20.102543+0000","last_became_active":"2024-09-10T23:31:19.106326+0000","last_became_peered":"2024-09-10T23:31:19.106326+0000","last_unstale":"2024-09-10T23:31:20.102543+0000","last_undegraded":"2024-09-10T23:31:20.102543+0000","last_fullsized":"2024-09-10T23:31:20.102543+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:27.217918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087413+0000","last_change":"2024-09-10T23:31:18.074710+0000","last_active":"2024-09-10T23:31:20.087413+0000","last_peered":"2024-09-10T23:31:20.087413+0000","last_clean":"2024-09-10T23:31:20.087413+0000","last_became_active":"2024-09-10T23:31:18.074405+0000","last_became_peered":"2024-09-10T23:31:18.074405+0000","last_unstale":"2024-09-10T23:31:20.087413+0000","last_undegraded":"2024-09-10T23:31:20.087413+0000","last_fullsized":"2024-09-10T23:31:20.087413+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:46.035443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.087213+0000","last_change":"2024-09-10T23:31:19.090048+0000","last_active":"2024-09-10T23:31:20.087213+0000","last_peered":"2024-09-10T23:31:20.087213+0000","last_clean":"2024-09-10T23:31:20.087213+0000","last_became_active":"2024-09-10T23:31:19.088979+0000","last_became_peered":"2024-09-10T23:31:19.088979+0000","last_unstale":"2024-09-10T23:31:20.087213+0000","last_undegraded":"2024-09-10T23:31:20.087213+0000","last_fullsized":"2024-09-10T23:31:20.087213+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:58:43.080975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094212+0000","last_change":"2024-09-10T23:31:18.068905+0000","last_active":"2024-09-10T23:31:20.094212+0000","last_peered":"2024-09-10T23:31:20.094212+0000","last_clean":"2024-09-10T23:31:20.094212+0000","last_became_active":"2024-09-10T23:31:18.068607+0000","last_became_peered":"2024-09-10T23:31:18.068607+0000","last_unstale":"2024-09-10T23:31:20.094212+0000","last_undegraded":"2024-09-10T23:31:20.094212+0000","last_fullsized":"2024-09-10T23:31:20.094212+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:36.784830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193684+0000","last_change":"2024-09-10T23:31:19.082522+0000","last_active":"2024-09-10T23:31:20.193684+0000","last_peered":"2024-09-10T23:31:20.193684+0000","last_clean":"2024-09-10T23:31:20.193684+0000","last_became_active":"2024-09-10T23:31:19.082252+0000","last_became_peered":"2024-09-10T23:31:19.082252+0000","last_unstale":"2024-09-10T23:31:20.193684+0000","last_undegraded":"2024-09-10T23:31:20.193684+0000","last_fullsized":"2024-09-10T23:31:20.193684+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:42.478978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.102406+0000","last_change":"2024-09-10T23:31:18.076160+0000","last_active":"2024-09-10T23:31:20.102406+0000","last_peered":"2024-09-10T23:31:20.102406+0000","last_clean":"2024-09-10T23:31:20.102406+0000","last_became_active":"2024-09-10T23:31:18.075439+0000","last_became_peered":"2024-09-10T23:31:18.075439+0000","last_unstale":"2024-09-10T23:31:20.102406+0000","last_undegraded":"2024-09-10T23:31:20.102406+0000","last_fullsized":"2024-09-10T23:31:20.102406+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:37.238398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.194378+0000","last_change":"2024-09-10T23:31:19.087302+0000","last_active":"2024-09-10T23:31:20.194378+0000","last_peered":"2024-09-10T23:31:20.194378+0000","last_clean":"2024-09-10T23:31:20.194378+0000","last_became_active":"2024-09-10T23:31:19.087002+0000","last_became_peered":"2024-09-10T23:31:19.087002+0000","last_unstale":"2024-09-10T23:31:20.194378+0000","last_undegraded":"2024-09-10T23:31:20.194378+0000","last_fullsized":"2024-09-10T23:31:20.194378+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:16.875377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.192740+0000","last_change":"2024-09-10T23:31:18.071251+0000","last_active":"2024-09-10T23:31:20.192740+0000","last_peered":"2024-09-10T23:31:20.192740+0000","last_clean":"2024-09-10T23:31:20.192740+0000","last_became_active":"2024-09-10T23:31:18.070638+0000","last_became_peered":"2024-09-10T23:31:18.070638+0000","last_unstale":"2024-09-10T23:31:20.192740+0000","last_undegraded":"2024-09-10T23:31:20.192740+0000","last_fullsized":"2024-09-10T23:31:20.192740+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:08.178949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.094695+0000","last_change":"2024-09-10T23:31:19.096247+0000","last_active":"2024-09-10T23:31:20.094695+0000","last_peered":"2024-09-10T23:31:20.094695+0000","last_clean":"2024-09-10T23:31:20.094695+0000","last_became_active":"2024-09-10T23:31:19.095981+0000","last_became_peered":"2024-09-10T23:31:19.095981+0000","last_unstale":"2024-09-10T23:31:20.094695+0000","last_undegraded":"2024-09-10T23:31:20.094695+0000","last_fullsized":"2024-09-10T23:31:20.094695+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:24.795258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":15,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.093794+0000","last_change":"2024-09-10T23:31:18.072179+0000","last_active":"2024-09-10T23:31:20.093794+0000","last_peered":"2024-09-10T23:31:20.093794+0000","last_clean":"2024-09-10T23:31:20.093794+0000","last_became_active":"2024-09-10T23:31:18.071874+0000","last_became_peered":"2024-09-10T23:31:18.071874+0000","last_unstale":"2024-09-10T23:31:20.093794+0000","last_undegraded":"2024-09-10T23:31:20.093794+0000","last_fullsized":"2024-09-10T23:31:20.093794+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:57.312073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.193377+0000","last_change":"2024-09-10T23:31:19.086232+0000","last_active":"2024-09-10T23:31:20.193377+0000","last_peered":"2024-09-10T23:31:20.193377+0000","last_clean":"2024-09-10T23:31:20.193377+0000","last_became_active":"2024-09-10T23:31:19.085902+0000","last_became_peered":"2024-09-10T23:31:19.085902+0000","last_unstale":"2024-09-10T23:31:20.193377+0000","last_undegraded":"2024-09-10T23:31:20.193377+0000","last_fullsized":"2024-09-10T23:31:20.193377+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:18.046084+0000","last_clean_scrub_stamp":"2024-09-10T23:31:18.046084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:40.663571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"211'1","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.105346+0000","last_change":"2024-09-10T23:31:18.079488+0000","last_active":"2024-09-10T23:31:20.105346+0000","last_peered":"2024-09-10T23:31:20.105346+0000","last_clean":"2024-09-10T23:31:20.105346+0000","last_became_active":"2024-09-10T23:31:18.077598+0000","last_became_peered":"2024-09-10T23:31:18.077598+0000","last_unstale":"2024-09-10T23:31:20.105346+0000","last_undegraded":"2024-09-10T23:31:20.105346+0000","last_fullsized":"2024-09-10T23:31:20.105346+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":209,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:17.038851+0000","last_clean_scrub_stamp":"2024-09-10T23:31:17.038851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:44.046563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":455,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-10T23:31:20.198199+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:31:20.198199+0000","last_peered":"2024-09-10T23:31:20.198199+0000","last_clean":"2024-09-10T23:31:20.198199+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:31:20.198199+0000","last_undegraded":"2024-09-10T23:31:20.198199+0000","last_fullsized":"2024-09-10T23:31:20.198199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476931,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74004,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297836,"statfs":{"total":96636764160,"available":96560984064,"internally_reserved":0,"allocated":2682880,"data_stored":1259240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509636,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74580,"kb_used_data":3200,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297260,"statfs":{"total":96636764160,"available":96560394240,"internally_reserved":0,"allocated":3276800,"data_stored":1849620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73071050},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509635,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47688,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324152,"statfs":{"total":96636764160,"available":96587931648,"internally_reserved":0,"allocated":2674688,"data_stored":1259128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509636,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74064,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297776,"statfs":{"total":96636764160,"available":96560922624,"internally_reserved":0,"allocated":2678784,"data_stored":1259198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509635,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74068,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297772,"statfs":{"total":96636764160,"available":96560918528,"internally_reserved":0,"allocated":2682880,"data_stored":1259780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509636,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47692,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324148,"statfs":{"total":96636764160,"available":96587927552,"internally_reserved":0,"allocated":2674688,"data_stored":1259128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509635,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78816,"kb_used_data":3204,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293024,"statfs":{"total":96636764160,"available":96556056576,"internally_reserved":0,"allocated":3280896,"data_stored":1851108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74024,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297816,"statfs":{"total":96636764160,"available":96560963584,"internally_reserved":0,"allocated":2699264,"data_stored":1261378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:31:28.252 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:31:28.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:31:28.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.443+0000 7fe285400640 1 -- 172.21.15.17:0/1080605792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28015aa30 msgr2=0x7fe2800cf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.443+0000 7fe285400640 1 --2- 172.21.15.17:0/1080605792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28015aa30 0x7fe2800cf3a0 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0098f0 tx=0x7fe26c01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.443+0000 7fe285400640 1 -- 172.21.15.17:0/1080605792 shutdown_connections 2024-09-10T23:31:28.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.443+0000 7fe285400640 1 --2- 172.21.15.17:0/1080605792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe28015aa30 0x7fe2800cf3a0 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.443+0000 7fe285400640 1 --2- 172.21.15.17:0/1080605792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe280158010 0x7fe2800b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.443+0000 7fe285400640 1 -- 172.21.15.17:0/1080605792 >> 172.21.15.17:0/1080605792 conn(0x7fe28006c360 msgr2=0x7fe28006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:28.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 -- 172.21.15.17:0/1080605792 shutdown_connections 2024-09-10T23:31:28.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 -- 172.21.15.17:0/1080605792 wait complete. 2024-09-10T23:31:28.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 Processor -- start 2024-09-10T23:31:28.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 -- start start 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2800b45a0 0x7fe28014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe280158010 0x7fe28014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28015aa30 0x7fe2800adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe2800d0370 con 0x7fe280158010 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2800d01f0 con 0x7fe28015aa30 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe2801671b0 con 0x7fe2800b45a0 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe280158010 0x7fe28014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe280158010 0x7fe28014d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59818/0 (socket says 172.21.15.17:59818) 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27de00640 1 -- 172.21.15.17:0/110605188 learned_addr learned my addr 172.21.15.17:0/110605188 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27f200640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28015aa30 0x7fe2800adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27e800640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2800b45a0 0x7fe28014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27de00640 1 -- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2800b45a0 msgr2=0x7fe28014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27de00640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2800b45a0 0x7fe28014fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27de00640 1 -- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28015aa30 msgr2=0x7fe2800adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27de00640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28015aa30 0x7fe2800adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27de00640 1 -- 172.21.15.17:0/110605188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe280076350 con 0x7fe280158010 2024-09-10T23:31:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27f200640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28015aa30 0x7fe2800adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27e800640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2800b45a0 0x7fe28014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:28.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe27de00640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe280158010 0x7fe28014d560 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fe26c000c10 tx=0x7fe26c005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:28.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe276a00640 1 -- 172.21.15.17:0/110605188 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0b2040 con 0x7fe280158010 2024-09-10T23:31:28.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe276a00640 1 -- 172.21.15.17:0/110605188 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe26c004130 con 0x7fe280158010 2024-09-10T23:31:28.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe276a00640 1 -- 172.21.15.17:0/110605188 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26c003600 con 0x7fe280158010 2024-09-10T23:31:28.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.447+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28015a860 con 0x7fe280158010 2024-09-10T23:31:28.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.451+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28014f120 con 0x7fe280158010 2024-09-10T23:31:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.451+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28006a4b0 con 0x7fe280158010 2024-09-10T23:31:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.451+0000 7fe276a00640 1 -- 172.21.15.17:0/110605188 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe26c0b5070 con 0x7fe280158010 2024-09-10T23:31:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.451+0000 7fe276a00640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2600725e0 0x7fe260074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.451+0000 7fe276a00640 1 -- 172.21.15.17:0/110605188 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fe26c12cf10 con 0x7fe280158010 2024-09-10T23:31:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.451+0000 7fe27e800640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2600725e0 0x7fe260074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.455+0000 7fe27e800640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2600725e0 0x7fe260074aa0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe27000abd0 tx=0x7fe27000a2f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:28.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.455+0000 7fe276a00640 1 -- 172.21.15.17:0/110605188 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe26c0c4020 con 0x7fe280158010 2024-09-10T23:31:28.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.699+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe2800b2c60 con 0x7fe280158010 2024-09-10T23:31:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.699+0000 7fe276a00640 1 -- 172.21.15.17:0/110605188 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v31) ==== 190+0+147 (secure 0 0 0) 0x7fe26c0164d0 con 0x7fe280158010 2024-09-10T23:31:28.702 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:31:28.703 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:31:28.703 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:31:28.703 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:31:28.703 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:31:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:31:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2600725e0 msgr2=0x7fe260074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2600725e0 0x7fe260074aa0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe27000abd0 tx=0x7fe27000a2f0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe280158010 msgr2=0x7fe28014d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe280158010 0x7fe28014d560 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fe26c000c10 tx=0x7fe26c005e10 comp rx=0 tx=0).stop 2024-09-10T23:31:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 shutdown_connections 2024-09-10T23:31:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2600725e0 0x7fe260074aa0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28015aa30 0x7fe2800adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe280158010 0x7fe28014d560 unknown :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 --2- 172.21.15.17:0/110605188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe2800b45a0 0x7fe28014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 >> 172.21.15.17:0/110605188 conn(0x7fe28006c360 msgr2=0x7fe2801508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 shutdown_connections 2024-09-10T23:31:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.703+0000 7fe285400640 1 -- 172.21.15.17:0/110605188 wait complete. 2024-09-10T23:31:28.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:28.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 -- 172.21.15.17:0/4268348380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0af960 msgr2=0x7f755c15b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 --2- 172.21.15.17:0/4268348380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0af960 0x7f755c15b3f0 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f755c06e930 tx=0x7f755001c8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 -- 172.21.15.17:0/4268348380 shutdown_connections 2024-09-10T23:31:28.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 --2- 172.21.15.17:0/4268348380 >> v2:172.21.15.77:3300/0 conn(0x7f755c0afd40 0x7f755c06f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 --2- 172.21.15.17:0/4268348380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0af960 0x7f755c15b3f0 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 -- 172.21.15.17:0/4268348380 >> 172.21.15.17:0/4268348380 conn(0x7f755c0ccf70 msgr2=0x7f755c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:28.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 -- 172.21.15.17:0/4268348380 shutdown_connections 2024-09-10T23:31:28.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 -- 172.21.15.17:0/4268348380 wait complete. 2024-09-10T23:31:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 Processor -- start 2024-09-10T23:31:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.871+0000 7f7563600640 1 -- start start 2024-09-10T23:31:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7563600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f755c0af960 0x7f755c1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7563600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0afd40 0x7f755c06c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7563600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f755c0cdc20 0x7f755c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7563600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f755c0697f0 con 0x7f755c0afd40 2024-09-10T23:31:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7563600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f755c069670 con 0x7f755c0af960 2024-09-10T23:31:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7563600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f755c0ce880 con 0x7f755c0cdc20 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f755be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0afd40 0x7f755c06c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f755be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0afd40 0x7f755c06c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59832/0 (socket says 172.21.15.17:59832) 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f755be00640 1 -- 172.21.15.17:0/713181550 learned_addr learned my addr 172.21.15.17:0/713181550 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7560c00640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f755c0af960 0x7f755c1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7561600640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f755c0cdc20 0x7f755c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f755be00640 1 -- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f755c0cdc20 msgr2=0x7f755c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f755be00640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f755c0cdc20 0x7f755c06ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f755be00640 1 -- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f755c0af960 msgr2=0x7f755c1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f755be00640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f755c0af960 0x7f755c1466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f755be00640 1 -- 172.21.15.17:0/713181550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755c14a3c0 con 0x7f755c0afd40 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f755be00640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0afd40 0x7f755c06c8e0 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f754800d7a0 tx=0x7f754800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7558c00640 1 -- 172.21.15.17:0/713181550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548017020 con 0x7f755c0afd40 2024-09-10T23:31:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7558c00640 1 -- 172.21.15.17:0/713181550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7548009820 con 0x7f755c0afd40 2024-09-10T23:31:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7558c00640 1 -- 172.21.15.17:0/713181550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548009c50 con 0x7f755c0afd40 2024-09-10T23:31:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f755c1551d0 con 0x7f755c0afd40 2024-09-10T23:31:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755c155790 con 0x7f755c0afd40 2024-09-10T23:31:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f755c15b3f0 con 0x7f755c0afd40 2024-09-10T23:31:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.875+0000 7f7558c00640 1 -- 172.21.15.17:0/713181550 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7548003600 con 0x7f755c0afd40 2024-09-10T23:31:28.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.879+0000 7f7558c00640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f753c0725e0 0x7f753c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:28.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.879+0000 7f7558c00640 1 -- 172.21.15.17:0/713181550 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f75480939d0 con 0x7f755c0afd40 2024-09-10T23:31:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.879+0000 7f7560c00640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f753c0725e0 0x7f753c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:28.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.879+0000 7f7560c00640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f753c0725e0 0x7f753c074aa0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f75500af000 tx=0x7f755001b100 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:28.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:28.883+0000 7f7558c00640 1 -- 172.21.15.17:0/713181550 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7548021020 con 0x7f755c0afd40 2024-09-10T23:31:29.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.091+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f755c146be0 con 0x7f755c0afd40 2024-09-10T23:31:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.091+0000 7f7558c00640 1 -- 172.21.15.17:0/713181550 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 161 v161) ==== 95+0+5234 (secure 0 0 0) 0x7f754805efb0 con 0x7f755c0afd40 2024-09-10T23:31:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:29.095 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":161,"btime":"2024-09-10T23:31:22:092426+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1912731352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1912731352},{"type":"v1","addr":"172.21.15.77:6837","nonce":1912731352}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156},{"gid":11448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3122453626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3122453626},{"type":"v1","addr":"172.21.15.17:6834","nonce":3122453626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2814757943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2814757943},{"type":"v1","addr":"172.21.15.17:6835","nonce":2814757943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[{"mdsmap":{"epoch":161,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:18.471461+0000","modified":"2024-09-10T23:31:21.496202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11463":{"gid":11463,"name":"d","rank":0,"incarnation":157,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/20480727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":20480727},{"type":"v1","addr":"172.21.15.77:6836","nonce":20480727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11463,"qdb_cluster":[11463]},"id":15}]} 2024-09-10T23:31:29.095 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 161 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f753c0725e0 msgr2=0x7f753c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f753c0725e0 0x7f753c074aa0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f75500af000 tx=0x7f755001b100 comp rx=0 tx=0).stop 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0afd40 msgr2=0x7f755c06c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0afd40 0x7f755c06c8e0 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f754800d7a0 tx=0x7f754800dc60 comp rx=0 tx=0).stop 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 shutdown_connections 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f753c0725e0 0x7f753c074aa0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f755c0cdc20 0x7f755c06ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f755c0afd40 0x7f755c06c8e0 unknown :-1 s=CLOSED pgs=2456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 --2- 172.21.15.17:0/713181550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f755c0af960 0x7f755c1466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 >> 172.21.15.17:0/713181550 conn(0x7f755c0ccf70 msgr2=0x7f755c1589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 shutdown_connections 2024-09-10T23:31:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.095+0000 7f7563600640 1 -- 172.21.15.17:0/713181550 wait complete. 2024-09-10T23:31:29.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 161, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:31:18.471461+0000', 'modified': '2024-09-10T23:31:21.496202+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11463': {'gid': 11463, 'name': 'd', 'rank': 0, 'incarnation': 157, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6836/20480727', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 20480727}, {'type': 'v1', 'addr': '172.21.15.77:6836', 'nonce': 20480727}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11463, 'qdb_cluster': [11463]} 2024-09-10T23:31:29.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:31:29.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T23:31:29.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 -- 172.21.15.17:0/3871902390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c06fc50 msgr2=0x7f096c15b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 --2- 172.21.15.17:0/3871902390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c06fc50 0x7f096c15b2f0 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f0960009840 tx=0x7f096001c820 comp rx=0 tx=0).stop 2024-09-10T23:31:29.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 -- 172.21.15.17:0/3871902390 shutdown_connections 2024-09-10T23:31:29.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 --2- 172.21.15.17:0/3871902390 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f096c0745e0 0x7f096c15e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 --2- 172.21.15.17:0/3871902390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c06fc50 0x7f096c15b2f0 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 -- 172.21.15.17:0/3871902390 >> 172.21.15.17:0/3871902390 conn(0x7f096c0b1850 msgr2=0x7f096c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 -- 172.21.15.17:0/3871902390 shutdown_connections 2024-09-10T23:31:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 -- 172.21.15.17:0/3871902390 wait complete. 2024-09-10T23:31:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 Processor -- start 2024-09-10T23:31:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 -- start start 2024-09-10T23:31:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f096c06fc50 0x7f096c1643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f096c070030 0x7f096c1f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c0745e0 0x7f096c1fac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f096c06f010 con 0x7f096c0745e0 2024-09-10T23:31:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f096c06ee90 con 0x7f096c06fc50 2024-09-10T23:31:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0974600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f096c06f190 con 0x7f096c070030 2024-09-10T23:31:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.671+0000 7f0972600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c0745e0 0x7f096c1fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0972600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c0745e0 0x7f096c1fac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59844/0 (socket says 172.21.15.17:59844) 2024-09-10T23:31:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0972600640 1 -- 172.21.15.17:0/1748017431 learned_addr learned my addr 172.21.15.17:0/1748017431 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0971200640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f096c070030 0x7f096c1f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0971c00640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f096c06fc50 0x7f096c1643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0972600640 1 -- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f096c070030 msgr2=0x7f096c1f8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0972600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f096c070030 0x7f096c1f8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0972600640 1 -- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f096c06fc50 msgr2=0x7f096c1643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0972600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f096c06fc50 0x7f096c1643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0972600640 1 -- 172.21.15.17:0/1748017431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c1648f0 con 0x7f096c0745e0 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0972600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c0745e0 0x7f096c1fac50 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f096400cb50 tx=0x7f096400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0969600640 1 -- 172.21.15.17:0/1748017431 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964016020 con 0x7f096c0745e0 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0969600640 1 -- 172.21.15.17:0/1748017431 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f096400ab40 con 0x7f096c0745e0 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0969600640 1 -- 172.21.15.17:0/1748017431 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964012420 con 0x7f096c0745e0 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0974600640 1 -- 172.21.15.17:0/1748017431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c1fb5c0 con 0x7f096c0745e0 2024-09-10T23:31:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0974600640 1 -- 172.21.15.17:0/1748017431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c1f7800 con 0x7f096c0745e0 2024-09-10T23:31:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.675+0000 7f0969600640 1 -- 172.21.15.17:0/1748017431 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f096401b400 con 0x7f096c0745e0 2024-09-10T23:31:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0969600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f094c0725e0 0x7f094c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0969600640 1 -- 172.21.15.17:0/1748017431 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f0964093920 con 0x7f096c0745e0 2024-09-10T23:31:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 Processor -- start 2024-09-10T23:31:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0971c00640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f094c0725e0 0x7f094c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 -- start start 2024-09-10T23:31:29.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0971c00640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f094c0725e0 0x7f094c074aa0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f09600af000 tx=0x7f096001b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:29.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 0x558aa8aa2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 0x558aa8a568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558aa89773f0 con 0x558aa8a56e10 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558aa88b4b20 con 0x558aa8aa29d0 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558aa88a3f50 con 0x558aa8aa32f0 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0972600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0971200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 0x558aa8a568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0972600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59854/0 (socket says 172.21.15.17:59854) 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0971c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 0x558aa8aa2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0972600640 1 -- 172.21.15.17:0/2345809936 learned_addr learned my addr 172.21.15.17:0/2345809936 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0972600640 1 -- 172.21.15.17:0/2345809936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 msgr2=0x558aa8a568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0972600640 1 --2- 172.21.15.17:0/2345809936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 0x558aa8a568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0972600640 1 -- 172.21.15.17:0/2345809936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 msgr2=0x558aa8aa2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:29.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0972600640 1 --2- 172.21.15.17:0/2345809936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 0x558aa8aa2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0972600640 1 -- 172.21.15.17:0/2345809936 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aa886b590 con 0x558aa8a56e10 2024-09-10T23:31:29.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0972600640 1 --2- 172.21.15.17:0/2345809936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a571f0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f0964005a70 tx=0x7f096405e1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816882d1e3295557 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:29.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f095e000640 1 -- 172.21.15.17:0/2345809936 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096405e760 con 0x558aa8a56e10 2024-09-10T23:31:29.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f095e000640 1 -- 172.21.15.17:0/2345809936 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0964063240 con 0x558aa8a56e10 2024-09-10T23:31:29.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f095e000640 1 -- 172.21.15.17:0/2345809936 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964067c60 con 0x558aa8a56e10 2024-09-10T23:31:29.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 -- 172.21.15.17:0/2345809936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 msgr2=0x558aa8a571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.679+0000 7f0977951000 1 --2- 172.21.15.17:0/2345809936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a571f0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f0964005a70 tx=0x7f096405e1b0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- 172.21.15.17:0/2345809936 shutdown_connections 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 --2- 172.21.15.17:0/2345809936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a571f0 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 --2- 172.21.15.17:0/2345809936 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 0x558aa8a568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 --2- 172.21.15.17:0/2345809936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 0x558aa8aa2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- 172.21.15.17:0/2345809936 >> 172.21.15.17:0/2345809936 conn(0x558aa8940130 msgr2=0x558aa8a85e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- 172.21.15.17:0/2345809936 shutdown_connections 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- 172.21.15.17:0/2345809936 wait complete. 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- start start 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 Processor -- start 2024-09-10T23:31:29.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa29d0 0x558aa8a83e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 0x558aa8a843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x558aa883e5d0 con 0x558aa8a56e10 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558aa88a7d60 con 0x558aa8aa32f0 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558aa884a500 con 0x558aa8aa29d0 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 10 client.0 _ll_register_callbacks cb 0x558aa884e810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a836a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59860/0 (socket says 172.21.15.17:59860) 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971200640 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa29d0 0x558aa8a83e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971c00640 1 -- 172.21.15.17:0/355430973 learned_addr learned my addr 172.21.15.17:0/355430973 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0972600640 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 0x558aa8a843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971c00640 1 -- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa29d0 msgr2=0x558aa8a83e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971c00640 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa29d0 0x558aa8a83e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971c00640 1 -- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 msgr2=0x558aa8a843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971c00640 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 0x558aa8a843b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971c00640 1 -- 172.21.15.17:0/355430973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aa8842170 con 0x558aa8a56e10 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971200640 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa29d0 0x558aa8a83e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0972600640 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 0x558aa8a843b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0971c00640 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a836a0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7f0960009840 tx=0x7f09600091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1258b6a6331c1274 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0952a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0952a00640 1 -- 172.21.15.17:0/355430973 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960004b50 con 0x558aa8a56e10 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0952a00640 1 -- 172.21.15.17:0/355430973 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f0960004cf0 con 0x558aa8a56e10 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- 172.21.15.17:0/355430973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558aa883c0f0 con 0x558aa8a56e10 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0952a00640 1 -- 172.21.15.17:0/355430973 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=161) ==== 24+0+0 (secure 0 0 0) 0x7f09600d5050 con 0x558aa8a56e10 2024-09-10T23:31:29.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 10 client.11619 fetch_fsmap learned FSMap version 161 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0977951000 1 -- 172.21.15.17:0/355430973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=161,monmap=2+}) -- 0x558aa8928ef0 con 0x558aa8a56e10 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.683+0000 7f0952a00640 1 -- 172.21.15.17:0/355430973 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558aa883c0f0 con 0x558aa8a56e10 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0952a00640 1 -- 172.21.15.17:0/355430973 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 161) ==== 3502+0+0 (secure 0 0 0) 0x7f09600d8020 con 0x558aa8a56e10 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 10 client.11619 fetch_fsmap finished waiting for FSMap version 161 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 10 client.11619 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 20 client.11619 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x558aa8a850f0 0x558aa8ab4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 4 client.11619 mds_command: new command op to 11463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 -- 172.21.15.17:0/355430973 --> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558aa88b6a70 con 0x558aa8a850f0 2024-09-10T23:31:29.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0971200640 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x558aa8a850f0 0x558aa8ab4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0971200640 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x558aa8a850f0 0x558aa8ab4c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b6872a01edb0aba server_cookie=44be11fea227bc2d in_seq=0 out_seq=0 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0952a00640 10 client.11619 ms_handle_connect on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0952a00640 1 -- 172.21.15.17:0/355430973 <== mds.0 v2:172.21.15.77:6834/20480727 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558aa88b6a70 con 0x558aa8a850f0 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0952a00640 10 client.11619 handle_command_reply: tid=0 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 client.11619 shutdown 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 -- 172.21.15.17:0/355430973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 msgr2=0x558aa8a836a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a836a0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7f0960009840 tx=0x7f09600091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 -- 172.21.15.17:0/355430973 shutdown_connections 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 0x558aa8a843b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x558aa8a850f0 0x558aa8ab4c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa29d0 0x558aa8a83e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 --2- 172.21.15.17:0/355430973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8a836a0 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0952a00640 0 client.11619 ms_handle_reset on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:29.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 -- 172.21.15.17:0/355430973 >> 172.21.15.17:0/355430973 conn(0x558aa8940130 msgr2=0x558aa8a55fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:29.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 -- 172.21.15.17:0/355430973 shutdown_connections 2024-09-10T23:31:29.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 1 -- 172.21.15.17:0/355430973 wait complete. 2024-09-10T23:31:29.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.687+0000 7f0977951000 20 client.11619 trim_cache size 0 max 16384 2024-09-10T23:31:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0977951000 1 Processor -- start 2024-09-10T23:31:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0977951000 1 -- start start 2024-09-10T23:31:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0977951000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8b14fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0977951000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 0x558aa8b15520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0977951000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 0x558aa8b15a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0977951000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f096c204620 con 0x558aa8a56e10 2024-09-10T23:31:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0977951000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f096c203600 con 0x558aa8aa29d0 2024-09-10T23:31:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0977951000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f096c0aae70 con 0x558aa8aa32f0 2024-09-10T23:31:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8b14fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8b14fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59876/0 (socket says 172.21.15.17:59876) 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971c00640 1 -- 172.21.15.17:0/1250956256 learned_addr learned my addr 172.21.15.17:0/1250956256 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971200640 1 --2- 172.21.15.17:0/1250956256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 0x558aa8b15520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0972600640 1 --2- 172.21.15.17:0/1250956256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 0x558aa8b15a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971c00640 1 -- 172.21.15.17:0/1250956256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 msgr2=0x558aa8b15a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971c00640 1 --2- 172.21.15.17:0/1250956256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 0x558aa8b15a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971c00640 1 -- 172.21.15.17:0/1250956256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 msgr2=0x558aa8b15520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971c00640 1 --2- 172.21.15.17:0/1250956256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 0x558aa8b15520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971c00640 1 -- 172.21.15.17:0/1250956256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aa88ffd90 con 0x558aa8a56e10 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f0971c00640 1 --2- 172.21.15.17:0/1250956256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8b14fe0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f096001a450 tx=0x7f09600041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d60289212c9fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f095d600640 1 -- 172.21.15.17:0/1250956256 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600de070 con 0x558aa8a56e10 2024-09-10T23:31:29.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f095d600640 1 -- 172.21.15.17:0/1250956256 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09600cd070 con 0x558aa8a56e10 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.707+0000 7f095d600640 1 -- 172.21.15.17:0/1250956256 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960003da0 con 0x558aa8a56e10 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- 172.21.15.17:0/1250956256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 msgr2=0x558aa8b14fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 --2- 172.21.15.17:0/1250956256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8b14fe0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f096001a450 tx=0x7f09600041a0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- 172.21.15.17:0/1250956256 shutdown_connections 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 --2- 172.21.15.17:0/1250956256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8aa32f0 0x558aa8b15a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 --2- 172.21.15.17:0/1250956256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa29d0 0x558aa8b15520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 --2- 172.21.15.17:0/1250956256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8a56e10 0x558aa8b14fe0 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- 172.21.15.17:0/1250956256 >> 172.21.15.17:0/1250956256 conn(0x558aa8940130 msgr2=0x558aa8a5ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- 172.21.15.17:0/1250956256 shutdown_connections 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- 172.21.15.17:0/1250956256 wait complete. 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- start start 2024-09-10T23:31:29.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 Processor -- start 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8a56e10 0x558aa8b19020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8aa29d0 0x558aa8b19560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 0x558aa8b19aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f096c202fe0 con 0x558aa8aa29d0 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558aa8ab9ce0 con 0x558aa8aa32f0 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x558aa88b38f0 con 0x558aa8a56e10 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 10 client.0 _ll_register_callbacks cb 0x7f09600042a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8aa29d0 0x558aa8b19560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8aa29d0 0x558aa8b19560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59892/0 (socket says 172.21.15.17:59892) 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971200640 1 -- 172.21.15.17:0/2386213276 learned_addr learned my addr 172.21.15.17:0/2386213276 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:29.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971c00640 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8a56e10 0x558aa8b19020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0972600640 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 0x558aa8b19aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971200640 1 -- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8a56e10 msgr2=0x558aa8b19020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971200640 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8a56e10 0x558aa8b19020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971200640 1 -- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 msgr2=0x558aa8b19aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971200640 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 0x558aa8b19aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971200640 1 -- 172.21.15.17:0/2386213276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aa886aa90 con 0x558aa8aa29d0 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971c00640 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8a56e10 0x558aa8b19020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0971200640 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8aa29d0 0x558aa8b19560 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x558aa883c400 tx=0x7f095800d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0fd23c61298070 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0952a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0952a00640 1 -- 172.21.15.17:0/2386213276 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095801b860 con 0x558aa8aa29d0 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0952a00640 1 -- 172.21.15.17:0/2386213276 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f0958023c40 con 0x558aa8aa29d0 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- 172.21.15.17:0/2386213276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09600cd070 con 0x558aa8aa29d0 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0952a00640 1 -- 172.21.15.17:0/2386213276 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=161) ==== 24+0+0 (secure 0 0 0) 0x7f0958023e40 con 0x558aa8aa29d0 2024-09-10T23:31:29.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 10 client.11625 fetch_fsmap learned FSMap version 161 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.711+0000 7f0977951000 1 -- 172.21.15.17:0/2386213276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=161,monmap=2+}) -- 0x558aa8849050 con 0x558aa8aa29d0 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0952a00640 1 -- 172.21.15.17:0/2386213276 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09600cd070 con 0x558aa8aa29d0 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0952a00640 1 -- 172.21.15.17:0/2386213276 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 161) ==== 3502+0+0 (secure 0 0 0) 0x7f095802a050 con 0x558aa8aa29d0 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 10 client.11625 fetch_fsmap finished waiting for FSMap version 161 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 10 client.11625 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 20 client.11625 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x558aa8ab8380 0x558aa8b22280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 4 client.11625 mds_command: new command op to 11463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 -- 172.21.15.17:0/2386213276 --> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] -- command(tid 0: {"prefix": "status"}) -- 0x558aa88b2520 con 0x558aa8ab8380 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0971c00640 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x558aa8ab8380 0x558aa8b22280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0971c00640 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x558aa8ab8380 0x558aa8b22280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8f781e0ff04688c server_cookie=bb824a795fc88126 in_seq=0 out_seq=0 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0952a00640 10 client.11625 ms_handle_connect on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:29.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0952a00640 1 -- 172.21.15.17:0/2386213276 <== mds.0 v2:172.21.15.77:6834/20480727 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x558aa88b2520 con 0x558aa8ab8380 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0952a00640 10 client.11625 handle_command_reply: tid=0 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 client.11625 shutdown 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 -- 172.21.15.17:0/2386213276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8aa29d0 msgr2=0x558aa8b19560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8aa29d0 0x558aa8b19560 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x558aa883c400 tx=0x7f095800d590 comp rx=0 tx=0).stop 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 -- 172.21.15.17:0/2386213276 shutdown_connections 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa8aa32f0 0x558aa8b19aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558aa8aa29d0 0x558aa8b19560 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x558aa8ab8380 0x558aa8b22280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 --2- 172.21.15.17:0/2386213276 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558aa8a56e10 0x558aa8b19020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 -- 172.21.15.17:0/2386213276 >> 172.21.15.17:0/2386213276 conn(0x558aa8940130 msgr2=0x558aa8aa15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0952a00640 0 client.11625 ms_handle_reset on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:29.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 -- 172.21.15.17:0/2386213276 shutdown_connections 2024-09-10T23:31:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 1 -- 172.21.15.17:0/2386213276 wait complete. 2024-09-10T23:31:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0977951000 20 client.11625 trim_cache size 0 max 16384 2024-09-10T23:31:29.726 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:31:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:31:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 11463, 2024-09-10T23:31:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:31:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:31:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:31:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 10.638607809, 2024-09-10T23:31:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 161, 2024-09-10T23:31:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 212, 2024-09-10T23:31:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 212, 2024-09-10T23:31:29.727 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 15.126423280999999 2024-09-10T23:31:29.727 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 -- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f094c0725e0 msgr2=0x7f094c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f094c0725e0 0x7f094c074aa0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f09600af000 tx=0x7f096001b060 comp rx=0 tx=0).stop 2024-09-10T23:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 -- 172.21.15.17:0/1748017431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c0745e0 msgr2=0x7f096c1fac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c0745e0 0x7f096c1fac50 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f096400cb50 tx=0x7f096400cc40 comp rx=0 tx=0).stop 2024-09-10T23:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 -- 172.21.15.17:0/1748017431 shutdown_connections 2024-09-10T23:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f094c0725e0 0x7f094c074aa0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f096c0745e0 0x7f096c1fac50 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f096c070030 0x7f096c1f8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 --2- 172.21.15.17:0/1748017431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f096c06fc50 0x7f096c1643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 -- 172.21.15.17:0/1748017431 >> 172.21.15.17:0/1748017431 conn(0x7f096c0b1850 msgr2=0x7f096c0b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 -- 172.21.15.17:0/1748017431 shutdown_connections 2024-09-10T23:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.715+0000 7f0974600640 1 -- 172.21.15.17:0/1748017431 wait complete. 2024-09-10T23:31:29.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:31:29.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 -- 172.21.15.17:0/684427295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb406fc50 msgr2=0x7f8cb415b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 --2- 172.21.15.17:0/684427295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb406fc50 0x7f8cb415b2f0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800aa10 tx=0x7f8ca801dc30 comp rx=0 tx=0).stop 2024-09-10T23:31:29.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 -- 172.21.15.17:0/684427295 shutdown_connections 2024-09-10T23:31:29.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 --2- 172.21.15.17:0/684427295 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cb40745e0 0x7f8cb415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 --2- 172.21.15.17:0/684427295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb406fc50 0x7f8cb415b2f0 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 -- 172.21.15.17:0/684427295 >> 172.21.15.17:0/684427295 conn(0x7f8cb40b1850 msgr2=0x7f8cb40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:29.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 -- 172.21.15.17:0/684427295 shutdown_connections 2024-09-10T23:31:29.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 -- 172.21.15.17:0/684427295 wait complete. 2024-09-10T23:31:29.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 Processor -- start 2024-09-10T23:31:29.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 -- start start 2024-09-10T23:31:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb406fc50 0x7f8cb41641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cb4070030 0x7f8cb41fabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40745e0 0x7f8cb41f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb406f060 con 0x7f8cb40745e0 2024-09-10T23:31:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb406eee0 con 0x7f8cb406fc50 2024-09-10T23:31:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cbb400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb406f1e0 con 0x7f8cb4070030 2024-09-10T23:31:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40745e0 0x7f8cb41f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40745e0 0x7f8cb41f7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59914/0 (socket says 172.21.15.17:59914) 2024-09-10T23:31:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb9400640 1 -- 172.21.15.17:0/1801655910 learned_addr learned my addr 172.21.15.17:0/1801655910 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cb4070030 0x7f8cb41fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb8a00640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb406fc50 0x7f8cb41641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb9400640 1 -- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cb4070030 msgr2=0x7f8cb41fabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb9400640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cb4070030 0x7f8cb41fabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb9400640 1 -- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb406fc50 msgr2=0x7f8cb41641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb9400640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb406fc50 0x7f8cb41641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.883+0000 7f8cb9400640 1 -- 172.21.15.17:0/1801655910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb41fb4e0 con 0x7f8cb40745e0 2024-09-10T23:31:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cb9400640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40745e0 0x7f8cb41f7f00 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c7b0 tx=0x7f8cac00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cb0c00640 1 -- 172.21.15.17:0/1801655910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac003b80 con 0x7f8cb40745e0 2024-09-10T23:31:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cb0c00640 1 -- 172.21.15.17:0/1801655910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cac003d20 con 0x7f8cb40745e0 2024-09-10T23:31:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cb0c00640 1 -- 172.21.15.17:0/1801655910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00aab0 con 0x7f8cb40745e0 2024-09-10T23:31:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb41fb7c0 con 0x7f8cb40745e0 2024-09-10T23:31:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb41f7700 con 0x7f8cb40745e0 2024-09-10T23:31:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb415b2f0 con 0x7f8cb40745e0 2024-09-10T23:31:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cb0c00640 1 -- 172.21.15.17:0/1801655910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8cac00ac50 con 0x7f8cb40745e0 2024-09-10T23:31:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cb0c00640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c940725e0 0x7f8c94074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:29.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.887+0000 7f8cb0c00640 1 -- 172.21.15.17:0/1801655910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f8cac093000 con 0x7f8cb40745e0 2024-09-10T23:31:29.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.891+0000 7f8cb8a00640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c940725e0 0x7f8c94074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:29.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.891+0000 7f8cb8a00640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c940725e0 0x7f8c94074aa0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80b0000 tx=0x7f8ca801c470 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:29.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:29.891+0000 7f8cb0c00640 1 -- 172.21.15.17:0/1801655910 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8cb415edb0 con 0x7f8cb40745e0 2024-09-10T23:31:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.103+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8cb415de00 con 0x7f8cb40745e0 2024-09-10T23:31:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.103+0000 7f8cb0c00640 1 -- 172.21.15.17:0/1801655910 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v161) ==== 53+0+73 (secure 0 0 0) 0x7f8cac05df90 con 0x7f8cb40745e0 2024-09-10T23:31:30.105 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:31:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.103+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c940725e0 msgr2=0x7f8c94074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.103+0000 7f8cbb400640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c940725e0 0x7f8c94074aa0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80b0000 tx=0x7f8ca801c470 comp rx=0 tx=0).stop 2024-09-10T23:31:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.103+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40745e0 msgr2=0x7f8cb41f7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.103+0000 7f8cbb400640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40745e0 0x7f8cb41f7f00 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c7b0 tx=0x7f8cac00cc70 comp rx=0 tx=0).stop 2024-09-10T23:31:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.107+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 shutdown_connections 2024-09-10T23:31:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.107+0000 7f8cbb400640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8c940725e0 0x7f8c94074aa0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.107+0000 7f8cbb400640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cb40745e0 0x7f8cb41f7f00 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.107+0000 7f8cbb400640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8cb4070030 0x7f8cb41fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:30.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.107+0000 7f8cbb400640 1 --2- 172.21.15.17:0/1801655910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cb406fc50 0x7f8cb41641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:30.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.107+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 >> 172.21.15.17:0/1801655910 conn(0x7f8cb40b1850 msgr2=0x7f8cb4159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:30.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.107+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 shutdown_connections 2024-09-10T23:31:30.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30.107+0000 7f8cbb400640 1 -- 172.21.15.17:0/1801655910 wait complete. 2024-09-10T23:31:30.126 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:31:30.126 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:31:30.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:31:30.126 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:31:30.126 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:30.126 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:31:30.126 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:31:30.126 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:31:30.127 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:31:30.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:30.127 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:31:30.136 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:31:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:31:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:31:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41481sec preferred_lft 41481sec 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:30.137 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:31:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:31:30.138 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:31:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:31:30.138 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:31:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:31:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:30.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:30.140 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:31:30.196 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:31:30.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:30.198 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:31:30.248 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:31:30.248 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:31:30.248 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:31:30.248 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:31:30.248 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:31:30.248 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:31:30.248 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:31:30.248 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:31:30.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:31:30.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:31:30.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:31:30.249 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:31:30.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:31:30.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:31:30.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:30.386 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:31:30.440 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:31:30.440 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:31:30.440 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:31:30.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:30.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:31:30.506 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:31:30.506 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:31:30.506 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:30.555 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:31:30.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:31:30.555 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:30.610 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:31:30.674 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:31:30.728 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:31:30.728 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:31:30.728 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:31:30.728 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:31:30.729 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:30.730 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:30.731 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:30.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:30.732 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:31:30.782 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:31:30.783 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:31:30.825 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:31:30.845 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:31:30.896 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:31:30.896 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:31:30.896 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:31:30.896 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:31:30.896 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:31:30.896 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:31:30.896 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:31:30.897 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:30.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:30.899 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:31:30.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:31:30.919+0000 7f85682e2580 -1 init, newargv = 0x5622c7ef7af0 newargc=15 2024-09-10T23:31:30.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[89984]: starting ceph client 2024-09-10T23:31:30.929 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[89984]: starting fuse 2024-09-10T23:31:30.930 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:31:30.930 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:31:30.931 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:31:30.932 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:31:30.933 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:31:30.933 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:30.933 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:31:30.933 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:31:31.057 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.89984.asok 2024-09-10T23:31:31.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:31:31.068 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.89984.asok 2024-09-10T23:31:31.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:31.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.89984.asok status 2024-09-10T23:31:31.247 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:31.247 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:31:31.247 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:31:31.247 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "89984", 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 11637, 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 11637 2024-09-10T23:31:31.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1086446955 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1086446955 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.11637 192.168.0.1:0/1086446955", 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/1086446955", 2024-09-10T23:31:31.249 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:31:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 161, 2024-09-10T23:31:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 212, 2024-09-10T23:31:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:31:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:31:31.250 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:31:31.250 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:31.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:31.262 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:31:31.262 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:31.272 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:31:31.272 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:31.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:31.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:31.339 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:31.339 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:31.391 DEBUG:teuthology.orchestra.run.smithi017:> stdin-killer -- python3 -c ' 2024-09-10T23:31:31.391 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:31:31.391 DEBUG:teuthology.orchestra.run.smithi017:> import uuid 2024-09-10T23:31:31.391 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:31.391 DEBUG:teuthology.orchestra.run.smithi017:> n = 1000 2024-09-10T23:31:31.391 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = False 2024-09-10T23:31:31.391 DEBUG:teuthology.orchestra.run.smithi017:> if 0 > 0: 2024-09-10T23:31:31.391 DEBUG:teuthology.orchestra.run.smithi017:> create_hard_links = True 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> path = "/home/ubuntu/cephtest/mnt.0/scrub-new-files/file" 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> dpath = os.path.dirname(path) 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> fnameprefix = os.path.basename(path) 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> os.makedirs(dpath, exist_ok=True) 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> try: 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> for i in range(n): 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> with open(fpath, '"'"'w'"'"') as f: 2024-09-10T23:31:31.392 DEBUG:teuthology.orchestra.run.smithi017:> f.write(f"{i}") 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> f.flush() 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(f.fileno()) 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> os.unlink(fpath) 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> if create_hard_links: 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> for j in range(0): 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> if False: 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> os.fsync(dirfd) 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> finally: 2024-09-10T23:31:31.393 DEBUG:teuthology.orchestra.run.smithi017:> os.close(dirfd) 2024-09-10T23:31:31.394 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:31:33.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:31:33.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:33.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.15:0 scrub status 2024-09-10T23:31:34.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 -- 172.21.15.17:0/770847418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15c000 msgr2=0x7f7d1c06e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 --2- 172.21.15.17:0/770847418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15c000 0x7f7d1c06e830 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0d0a90 tx=0x7f7d0801c810 comp rx=0 tx=0).stop 2024-09-10T23:31:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 -- 172.21.15.17:0/770847418 shutdown_connections 2024-09-10T23:31:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 --2- 172.21.15.17:0/770847418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15c000 0x7f7d1c06e830 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 --2- 172.21.15.17:0/770847418 >> v2:172.21.15.77:3300/0 conn(0x7f7d1c15bc20 0x7f7d1c06f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 -- 172.21.15.17:0/770847418 >> 172.21.15.17:0/770847418 conn(0x7f7d1c06c360 msgr2=0x7f7d1c06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 -- 172.21.15.17:0/770847418 shutdown_connections 2024-09-10T23:31:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 -- 172.21.15.17:0/770847418 wait complete. 2024-09-10T23:31:34.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 Processor -- start 2024-09-10T23:31:34.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 -- start start 2024-09-10T23:31:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d1c06fae0 0x7f7d1c1fbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15bc20 0x7f7d1c14b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d1c15c000 0x7f7d1c150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c169440 con 0x7f7d1c15bc20 2024-09-10T23:31:34.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c1692c0 con 0x7f7d1c15c000 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d23800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1c1695c0 con 0x7f7d1c06fae0 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d1be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15bc20 0x7f7d1c14b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d1be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15bc20 0x7f7d1c14b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59936/0 (socket says 172.21.15.17:59936) 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.011+0000 7f7d1be00640 1 -- 172.21.15.17:0/1853434834 learned_addr learned my addr 172.21.15.17:0/1853434834 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d20e00640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d1c06fae0 0x7f7d1c1fbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d21800640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d1c15c000 0x7f7d1c150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d1be00640 1 -- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d1c06fae0 msgr2=0x7f7d1c1fbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d1be00640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d1c06fae0 0x7f7d1c1fbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d1be00640 1 -- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d1c15c000 msgr2=0x7f7d1c150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d1be00640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d1c15c000 0x7f7d1c150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d1be00640 1 -- 172.21.15.17:0/1853434834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c1fc4b0 con 0x7f7d1c15bc20 2024-09-10T23:31:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d1be00640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15bc20 0x7f7d1c14b700 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7f7d08000c10 tx=0x7f7d08005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d18c00640 1 -- 172.21.15.17:0/1853434834 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d080ba020 con 0x7f7d1c15bc20 2024-09-10T23:31:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d18c00640 1 -- 172.21.15.17:0/1853434834 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d08004330 con 0x7f7d1c15bc20 2024-09-10T23:31:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d23800640 1 -- 172.21.15.17:0/1853434834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1c1651a0 con 0x7f7d1c15bc20 2024-09-10T23:31:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d18c00640 1 -- 172.21.15.17:0/1853434834 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d080b2040 con 0x7f7d1c15bc20 2024-09-10T23:31:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d23800640 1 -- 172.21.15.17:0/1853434834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1c165760 con 0x7f7d1c15bc20 2024-09-10T23:31:34.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.015+0000 7f7d18c00640 1 -- 172.21.15.17:0/1853434834 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7d080b5070 con 0x7f7d1c15bc20 2024-09-10T23:31:34.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d18c00640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cfc0725e0 0x7f7cfc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 Processor -- start 2024-09-10T23:31:34.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d18c00640 1 -- 172.21.15.17:0/1853434834 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f7d0812c840 con 0x7f7d1c15bc20 2024-09-10T23:31:34.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 -- start start 2024-09-10T23:31:34.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cfc0725e0 0x7f7cfc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cfc0725e0 0x7f7cfc074aa0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f7d10004630 tx=0x7f7d1000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae31a0 0x55f30bae3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae3ac0 0x55f30ba99680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30ba99fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f30b981cb0 con 0x55f30bae31a0 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f30b897310 con 0x55f30ba99bc0 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f30b8f4b90 con 0x55f30bae3ac0 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae31a0 0x55f30bae3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae31a0 0x55f30bae3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59944/0 (socket says 172.21.15.17:59944) 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 -- 172.21.15.17:0/3467801652 learned_addr learned my addr 172.21.15.17:0/3467801652 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d21800640 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30ba99fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d1be00640 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae3ac0 0x55f30ba99680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 -- 172.21.15.17:0/3467801652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae3ac0 msgr2=0x55f30ba99680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae3ac0 0x55f30ba99680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 -- 172.21.15.17:0/3467801652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 msgr2=0x55f30ba99fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30ba99fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 -- 172.21.15.17:0/3467801652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30b898c60 con 0x55f30bae31a0 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d1be00640 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae3ac0 0x55f30ba99680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d20e00640 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae31a0 0x55f30bae3580 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f7d10003cb0 tx=0x7f7d10013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1abfe5cdee4e7ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d0d600640 1 -- 172.21.15.17:0/3467801652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1001e420 con 0x55f30bae31a0 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d0d600640 1 -- 172.21.15.17:0/3467801652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d1001e6b0 con 0x55f30bae31a0 2024-09-10T23:31:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d0d600640 1 -- 172.21.15.17:0/3467801652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1001ea80 con 0x55f30bae31a0 2024-09-10T23:31:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 -- 172.21.15.17:0/3467801652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae31a0 msgr2=0x55f30bae3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae31a0 0x55f30bae3580 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f7d10003cb0 tx=0x7f7d10013000 comp rx=0 tx=0).stop 2024-09-10T23:31:34.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 -- 172.21.15.17:0/3467801652 shutdown_connections 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30ba99fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae3ac0 0x55f30ba99680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/3467801652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae31a0 0x55f30bae3580 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 -- 172.21.15.17:0/3467801652 >> 172.21.15.17:0/3467801652 conn(0x55f30ba9fd20 msgr2=0x55f30ba97f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 -- 172.21.15.17:0/3467801652 shutdown_connections 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.019+0000 7f7d26b5b000 1 -- 172.21.15.17:0/3467801652 wait complete. 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 -- start start 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 Processor -- start 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30ba99bc0 0x55f30baea530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae31a0 0x55f30baeaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30baeafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f30b8e7dd0 con 0x55f30bae3ac0 2024-09-10T23:31:34.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f30b8e3fc0 con 0x55f30bae31a0 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f30b8894b0 con 0x55f30ba99bc0 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 10 client.0 _ll_register_callbacks cb 0x55f30b8677d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d21800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30baeafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d21800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30baeafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59946/0 (socket says 172.21.15.17:59946) 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d1be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae31a0 0x55f30baeaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d21800640 1 -- 172.21.15.17:0/2649669819 learned_addr learned my addr 172.21.15.17:0/2649669819 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d20e00640 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30ba99bc0 0x55f30baea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d1be00640 1 -- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30ba99bc0 msgr2=0x55f30baea530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d1be00640 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30ba99bc0 0x55f30baea530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d1be00640 1 -- 172.21.15.17:0/2649669819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 msgr2=0x55f30baeafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d1be00640 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30baeafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d1be00640 1 -- 172.21.15.17:0/2649669819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f30b8821f0 con 0x55f30bae31a0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d21800640 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30baeafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d1be00640 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae31a0 0x55f30baeaa70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7d0801a440 tx=0x7f7d080f6ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a5efeeebc27632 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d02000640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d02000640 1 -- 172.21.15.17:0/2649669819 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08100860 con 0x55f30bae31a0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d02000640 1 -- 172.21.15.17:0/2649669819 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f7d08005280 con 0x55f30bae31a0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 -- 172.21.15.17:0/2649669819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f30b87c330 con 0x55f30bae31a0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d02000640 1 -- 172.21.15.17:0/2649669819 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=161) ==== 24+0+0 (secure 0 0 0) 0x7f7d080f71b0 con 0x55f30bae31a0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 10 client.10621 fetch_fsmap learned FSMap version 161 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 -- 172.21.15.17:0/2649669819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=161,monmap=2+}) -- 0x55f30b868fa0 con 0x55f30bae31a0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d02000640 1 -- 172.21.15.17:0/2649669819 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d0810f020 con 0x55f30bae31a0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d02000640 1 -- 172.21.15.17:0/2649669819 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 161) ==== 3502+0+0 (secure 0 0 0) 0x7f7d08123ce0 con 0x55f30bae31a0 2024-09-10T23:31:34.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 10 client.10621 fetch_fsmap finished waiting for FSMap version 161 2024-09-10T23:31:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 10 client.10621 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.d 2024-09-10T23:31:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 20 client.10621 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x55f30baf2900 0x55f30baf4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 4 client.10621 mds_command: new command op to 11463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d26b5b000 1 -- 172.21.15.17:0/2649669819 --> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f30b8f6ae0 con 0x55f30baf2900 2024-09-10T23:31:34.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.023+0000 7f7d20e00640 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x55f30baf2900 0x55f30baf4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d20e00640 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x55f30baf2900 0x55f30baf4cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36382ebaec27edf8 server_cookie=bd7b9e8907debe27 in_seq=0 out_seq=0 2024-09-10T23:31:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d02000640 10 client.10621 ms_handle_connect on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d02000640 1 -- 172.21.15.17:0/2649669819 <== mds.0 v2:172.21.15.77:6834/20480727 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f30b8f6ae0 con 0x55f30baf2900 2024-09-10T23:31:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d02000640 10 client.10621 handle_command_reply: tid=0 2024-09-10T23:31:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 client.10621 shutdown 2024-09-10T23:31:34.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 -- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae31a0 msgr2=0x55f30baeaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae31a0 0x55f30baeaa70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7d0801a440 tx=0x7f7d080f6ff0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 -- 172.21.15.17:0/2649669819 shutdown_connections 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30baeafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae31a0 0x55f30baeaa70 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x55f30baf2900 0x55f30baf4cf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/2649669819 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30ba99bc0 0x55f30baea530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d02000640 0 client.10621 ms_handle_reset on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 -- 172.21.15.17:0/2649669819 >> 172.21.15.17:0/2649669819 conn(0x55f30ba9fd20 msgr2=0x55f30ba97f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 -- 172.21.15.17:0/2649669819 shutdown_connections 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 1 -- 172.21.15.17:0/2649669819 wait complete. 2024-09-10T23:31:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.027+0000 7f7d26b5b000 20 client.10621 trim_cache size 0 max 16384 2024-09-10T23:31:34.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.043+0000 7f7d26b5b000 1 Processor -- start 2024-09-10T23:31:34.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.043+0000 7f7d26b5b000 1 -- start start 2024-09-10T23:31:34.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30ba99bc0 0x55f30bb54a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 0x55f30bb54f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae3ac0 0x55f30bb554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c204cc0 con 0x55f30ba99bc0 2024-09-10T23:31:34.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c203d70 con 0x55f30bae3ac0 2024-09-10T23:31:34.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1c0cf650 con 0x55f30bae31a0 2024-09-10T23:31:34.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d20e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30ba99bc0 0x55f30bb54a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d20e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30ba99bc0 0x55f30bb54a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59960/0 (socket says 172.21.15.17:59960) 2024-09-10T23:31:34.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d20e00640 1 -- 172.21.15.17:0/1685215738 learned_addr learned my addr 172.21.15.17:0/1685215738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d1be00640 1 --2- 172.21.15.17:0/1685215738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 0x55f30bb54f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d21800640 1 --2- 172.21.15.17:0/1685215738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae3ac0 0x55f30bb554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d20e00640 1 -- 172.21.15.17:0/1685215738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 msgr2=0x55f30bb54f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d20e00640 1 --2- 172.21.15.17:0/1685215738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 0x55f30bb54f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d20e00640 1 -- 172.21.15.17:0/1685215738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae3ac0 msgr2=0x55f30bb554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d20e00640 1 --2- 172.21.15.17:0/1685215738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae3ac0 0x55f30bb554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d20e00640 1 -- 172.21.15.17:0/1685215738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f30b941660 con 0x55f30ba99bc0 2024-09-10T23:31:34.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d20e00640 1 --2- 172.21.15.17:0/1685215738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30ba99bc0 0x55f30bb54a20 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x55f30b8ef5e0 tx=0x7f7d10004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f7cc60db3a3578 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d0cc00640 1 -- 172.21.15.17:0/1685215738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1001e6e0 con 0x55f30ba99bc0 2024-09-10T23:31:34.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d0cc00640 1 -- 172.21.15.17:0/1685215738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d1003f070 con 0x55f30ba99bc0 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d0cc00640 1 -- 172.21.15.17:0/1685215738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1001eb00 con 0x55f30ba99bc0 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 -- 172.21.15.17:0/1685215738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30ba99bc0 msgr2=0x55f30bb54a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/1685215738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30ba99bc0 0x55f30bb54a20 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x55f30b8ef5e0 tx=0x7f7d10004740 comp rx=0 tx=0).stop 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 -- 172.21.15.17:0/1685215738 shutdown_connections 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/1685215738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30bae3ac0 0x55f30bb554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/1685215738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 0x55f30bb54f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/1685215738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30ba99bc0 0x55f30bb54a20 unknown :-1 s=CLOSED pgs=2472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 -- 172.21.15.17:0/1685215738 >> 172.21.15.17:0/1685215738 conn(0x55f30ba9fd20 msgr2=0x55f30ba9b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 -- 172.21.15.17:0/1685215738 shutdown_connections 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 -- 172.21.15.17:0/1685215738 wait complete. 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 -- start start 2024-09-10T23:31:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.047+0000 7f7d26b5b000 1 Processor -- start 2024-09-10T23:31:34.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30baf9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 0x55f30baf9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30bb15210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55f30baa2d40 con 0x55f30bae3ac0 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f30baa0100 con 0x55f30ba99bc0 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55f30b8deec0 con 0x55f30bae31a0 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 10 client.0 _ll_register_callbacks cb 0x7f7d08005b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d21800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30bb15210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d20e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30baf9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d1be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 0x55f30baf9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d20e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30baf9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:35008/0 (socket says 172.21.15.17:35008) 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d20e00640 1 -- 172.21.15.17:0/361679317 learned_addr learned my addr 172.21.15.17:0/361679317 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d20e00640 1 -- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 msgr2=0x55f30baf9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d20e00640 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 0x55f30baf9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d20e00640 1 -- 172.21.15.17:0/361679317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 msgr2=0x55f30bb15210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d20e00640 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30bb15210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d20e00640 1 -- 172.21.15.17:0/361679317 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f30b8ae090 con 0x55f30ba99bc0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d20e00640 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30baf9660 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7d10011fd0 tx=0x7f7d1000bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2d52c7ba764c26a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 1 -- 172.21.15.17:0/361679317 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1001eaa0 con 0x55f30ba99bc0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 1 -- 172.21.15.17:0/361679317 <== mon.1 v2:172.21.15.77:3300/0 2 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f7d1001ec40 con 0x55f30ba99bc0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- 172.21.15.17:0/361679317 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d1003f070 con 0x55f30ba99bc0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 1 -- 172.21.15.17:0/361679317 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=161) ==== 24+0+0 (secure 0 0 0) 0x7f7d1001ee60 con 0x55f30ba99bc0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 10 client.10627 fetch_fsmap learned FSMap version 161 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- 172.21.15.17:0/361679317 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=161,monmap=2+}) -- 0x55f30b87a5f0 con 0x55f30ba99bc0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 1 -- 172.21.15.17:0/361679317 <== mon.1 v2:172.21.15.77:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d1003f070 con 0x55f30ba99bc0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 1 -- 172.21.15.17:0/361679317 <== mon.1 v2:172.21.15.77:3300/0 5 ==== fsmap(e 161) ==== 3502+0+0 (secure 0 0 0) 0x7f7d10053020 con 0x55f30ba99bc0 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 10 client.10627 fetch_fsmap finished waiting for FSMap version 161 2024-09-10T23:31:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 10 client.10627 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.d 2024-09-10T23:31:34.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 20 client.10627 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:34.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x55f30bb15ba0 0x55f30bb60680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 4 client.10627 mds_command: new command op to 11463 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:31:34.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- 172.21.15.17:0/361679317 --> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f30b8f2590 con 0x55f30bb15ba0 2024-09-10T23:31:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d1be00640 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x55f30bb15ba0 0x55f30bb60680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d1be00640 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x55f30bb15ba0 0x55f30bb60680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ab7886543d9cb4f server_cookie=7247bf083f804f6d in_seq=0 out_seq=0 2024-09-10T23:31:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 10 client.10627 ms_handle_connect on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 1 -- 172.21.15.17:0/361679317 <== mds.0 v2:172.21.15.77:6834/20480727 1 ==== command_reply(tid 0: 0 ) ==== 8+0+86 (crc 0 0 0) 0x55f30b8f2590 con 0x55f30bb15ba0 2024-09-10T23:31:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 10 client.10627 handle_command_reply: tid=0 2024-09-10T23:31:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 client.10627 shutdown 2024-09-10T23:31:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 msgr2=0x55f30baf9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30baf9660 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7d10011fd0 tx=0x7f7d1000bf90 comp rx=0 tx=0).stop 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- 172.21.15.17:0/361679317 shutdown_connections 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f30bae3ac0 0x55f30bb15210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x55f30bb15ba0 0x55f30bb60680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f30bae31a0 0x55f30baf9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 --2- 172.21.15.17:0/361679317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f30ba99bc0 0x55f30baf9660 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- 172.21.15.17:0/361679317 >> 172.21.15.17:0/361679317 conn(0x55f30ba9fd20 msgr2=0x55f30baf4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d02000640 0 client.10627 ms_handle_reset on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- 172.21.15.17:0/361679317 shutdown_connections 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.051+0000 7f7d26b5b000 1 -- 172.21.15.17:0/361679317 wait complete. 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d26b5b000 20 client.10627 trim_cache size 0 max 16384 2024-09-10T23:31:34.058 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:31:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:31:34.059 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": {} 2024-09-10T23:31:34.059 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 -- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cfc0725e0 msgr2=0x7f7cfc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cfc0725e0 0x7f7cfc074aa0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f7d10004630 tx=0x7f7d1000b390 comp rx=0 tx=0).stop 2024-09-10T23:31:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 -- 172.21.15.17:0/1853434834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15bc20 msgr2=0x7f7d1c14b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15bc20 0x7f7d1c14b700 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7f7d08000c10 tx=0x7f7d08005e10 comp rx=0 tx=0).stop 2024-09-10T23:31:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 -- 172.21.15.17:0/1853434834 shutdown_connections 2024-09-10T23:31:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7cfc0725e0 0x7f7cfc074aa0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d1c15c000 0x7f7d1c150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d1c15bc20 0x7f7d1c14b700 unknown :-1 s=CLOSED pgs=2470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 --2- 172.21.15.17:0/1853434834 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d1c06fae0 0x7f7d1c1fbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 -- 172.21.15.17:0/1853434834 >> 172.21.15.17:0/1853434834 conn(0x7f7d1c06c360 msgr2=0x7f7d1c151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 -- 172.21.15.17:0/1853434834 shutdown_connections 2024-09-10T23:31:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.055+0000 7f7d23800640 1 -- 172.21.15.17:0/1853434834 wait complete. 2024-09-10T23:31:34.075 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:31:34.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.15:0 damage ls 2024-09-10T23:31:34.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 -- 172.21.15.17:0/2933816632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d08f0 msgr2=0x7f08600ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 --2- 172.21.15.17:0/2933816632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d08f0 0x7f08600ccad0 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7f0860073a30 tx=0x7f085801ccc0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 -- 172.21.15.17:0/2933816632 shutdown_connections 2024-09-10T23:31:34.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 --2- 172.21.15.17:0/2933816632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d08f0 0x7f08600ccad0 unknown :-1 s=CLOSED pgs=2473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 --2- 172.21.15.17:0/2933816632 >> v2:172.21.15.77:3300/0 conn(0x7f086015bf10 0x7f08600b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 -- 172.21.15.17:0/2933816632 >> 172.21.15.17:0/2933816632 conn(0x7f08600d1fc0 msgr2=0x7f08600d23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 -- 172.21.15.17:0/2933816632 shutdown_connections 2024-09-10T23:31:34.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 -- 172.21.15.17:0/2933816632 wait complete. 2024-09-10T23:31:34.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 Processor -- start 2024-09-10T23:31:34.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 -- start start 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08600d08f0 0x7f08600aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d2ae0 0x7f08601f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f086015bf10 0x7f0860150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0860168fd0 con 0x7f08600d2ae0 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0860168e50 con 0x7f08600d08f0 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f0866400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0860169150 con 0x7f086015bf10 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f085ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d2ae0 0x7f08601f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f085f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08600d08f0 0x7f08600aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f085ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d2ae0 0x7f08601f84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59984/0 (socket says 172.21.15.17:59984) 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f085ea00640 1 -- 172.21.15.17:0/2039841669 learned_addr learned my addr 172.21.15.17:0/2039841669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.223+0000 7f085fe00640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f086015bf10 0x7f0860150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f085ea00640 1 -- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f086015bf10 msgr2=0x7f0860150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f085ea00640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f086015bf10 0x7f0860150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f085ea00640 1 -- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08600d08f0 msgr2=0x7f08600aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f085ea00640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08600d08f0 0x7f08600aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f085ea00640 1 -- 172.21.15.17:0/2039841669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08600712b0 con 0x7f08600d2ae0 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f085ea00640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d2ae0 0x7f08601f84e0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c500 tx=0x7f084c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f0857400640 1 -- 172.21.15.17:0/2039841669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c017070 con 0x7f08600d2ae0 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f0857400640 1 -- 172.21.15.17:0/2039841669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f084c0053c0 con 0x7f08600d2ae0 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f0866400640 1 -- 172.21.15.17:0/2039841669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08600af350 con 0x7f08600d2ae0 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f0857400640 1 -- 172.21.15.17:0/2039841669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c012890 con 0x7f08600d2ae0 2024-09-10T23:31:34.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f0866400640 1 -- 172.21.15.17:0/2039841669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08601f7ce0 con 0x7f08600d2ae0 2024-09-10T23:31:34.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f0857400640 1 -- 172.21.15.17:0/2039841669 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f084c003600 con 0x7f08600d2ae0 2024-09-10T23:31:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f0857400640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08400725e0 0x7f0840074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.227+0000 7f0857400640 1 -- 172.21.15.17:0/2039841669 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f084c092990 con 0x7f08600d2ae0 2024-09-10T23:31:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085f400640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08400725e0 0x7f0840074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 Processor -- start 2024-09-10T23:31:34.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 -- start start 2024-09-10T23:31:34.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085f400640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08400725e0 0x7f0840074aa0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f085000bb50 tx=0x7f085000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34df30 0x562a2a34e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3013e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a301d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a2a1ebd30 con 0x562a2a301920 2024-09-10T23:31:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562a2a15faf0 con 0x562a2a34df30 2024-09-10T23:31:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562a2a14ef20 con 0x562a2a34e850 2024-09-10T23:31:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a301d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34df30 0x562a2a34e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a301d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59990/0 (socket says 172.21.15.17:59990) 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085fe00640 1 -- 172.21.15.17:0/3956151290 learned_addr learned my addr 172.21.15.17:0/3956151290 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34df30 0x562a2a34e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:35054/0 (socket says 172.21.15.17:35054) 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3013e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.17:58694/0 (socket says 172.21.15.17:58694) 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085ea00640 1 -- 172.21.15.17:0/3956151290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34df30 msgr2=0x562a2a34e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085ea00640 1 --2- 172.21.15.17:0/3956151290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34df30 0x562a2a34e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085ea00640 1 -- 172.21.15.17:0/3956151290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 msgr2=0x562a2a301d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085ea00640 1 --2- 172.21.15.17:0/3956151290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a301d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085ea00640 1 -- 172.21.15.17:0/3956151290 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a2a0d0100 con 0x562a2a34e850 2024-09-10T23:31:34.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f085ea00640 1 --2- 172.21.15.17:0/3956151290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3013e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f084c090d20 tx=0x7f084c000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4e4b84e54713f87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f084be00640 1 -- 172.21.15.17:0/3956151290 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c062230 con 0x562a2a34e850 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f084be00640 1 -- 172.21.15.17:0/3956151290 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f084c066c50 con 0x562a2a34e850 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f084be00640 1 -- 172.21.15.17:0/3956151290 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c05cc80 con 0x562a2a34e850 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 -- 172.21.15.17:0/3956151290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 msgr2=0x562a2a3013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 --2- 172.21.15.17:0/3956151290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3013e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f084c090d20 tx=0x7f084c000ee0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 -- 172.21.15.17:0/3956151290 shutdown_connections 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 --2- 172.21.15.17:0/3956151290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a301d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 --2- 172.21.15.17:0/3956151290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3013e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 --2- 172.21.15.17:0/3956151290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34df30 0x562a2a34e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 -- 172.21.15.17:0/3956151290 >> 172.21.15.17:0/3956151290 conn(0x562a2a32eff0 msgr2=0x562a2a3313e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 -- 172.21.15.17:0/3956151290 shutdown_connections 2024-09-10T23:31:34.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.231+0000 7f08698db000 1 -- 172.21.15.17:0/3956151290 wait complete. 2024-09-10T23:31:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 -- start start 2024-09-10T23:31:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 Processor -- start 2024-09-10T23:31:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a330420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34df30 0x562a2a330960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34e850 0x562a2a330ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a2a0f44e0 con 0x562a2a301920 2024-09-10T23:31:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562a2a152d30 con 0x562a2a34e850 2024-09-10T23:31:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562a29e14680 con 0x562a2a34df30 2024-09-10T23:31:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 10 client.0 _ll_register_callbacks cb 0x562a2a2ef0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a330420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a330420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60006/0 (socket says 172.21.15.17:60006) 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085f400640 1 -- 172.21.15.17:0/1715123259 learned_addr learned my addr 172.21.15.17:0/1715123259 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085ea00640 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34df30 0x562a2a330960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085fe00640 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34e850 0x562a2a330ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085f400640 1 -- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34df30 msgr2=0x562a2a330960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085f400640 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34df30 0x562a2a330960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085f400640 1 -- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34e850 msgr2=0x562a2a330ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085f400640 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34e850 0x562a2a330ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085f400640 1 -- 172.21.15.17:0/1715123259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a2a103c40 con 0x562a2a301920 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085ea00640 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34df30 0x562a2a330960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085f400640 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a330420 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7f0850022d50 tx=0x7f0850013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430f95a15c13eeec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f0848c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:31:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f0848c00640 1 -- 172.21.15.17:0/1715123259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0850020cb0 con 0x562a2a301920 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f0848c00640 1 -- 172.21.15.17:0/1715123259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f08500220d0 con 0x562a2a301920 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 -- 172.21.15.17:0/1715123259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562a2a0e7310 con 0x562a2a301920 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f0848c00640 1 -- 172.21.15.17:0/1715123259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=161) ==== 24+0+0 (secure 0 0 0) 0x7f0850039050 con 0x562a2a301920 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 10 client.11667 fetch_fsmap learned FSMap version 161 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 -- 172.21.15.17:0/1715123259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=161,monmap=2+}) -- 0x562a2a14dbc0 con 0x562a2a301920 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f0848c00640 1 -- 172.21.15.17:0/1715123259 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562a2a0e7310 con 0x562a2a301920 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f0848c00640 1 -- 172.21.15.17:0/1715123259 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 161) ==== 3502+0+0 (secure 0 0 0) 0x7f085003c020 con 0x562a2a301920 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 10 client.11667 fetch_fsmap finished waiting for FSMap version 161 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 10 client.11667 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.d 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 20 client.11667 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x562a2a3318b0 0x562a2a3601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 4 client.11667 mds_command: new command op to 11463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f08698db000 1 -- 172.21.15.17:0/1715123259 --> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a2a161a40 con 0x562a2a3318b0 2024-09-10T23:31:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.235+0000 7f085ea00640 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x562a2a3318b0 0x562a2a3601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f085ea00640 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x562a2a3318b0 0x562a2a3601f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86cdb77d3c5e56f3 server_cookie=1a6320805a49835d in_seq=0 out_seq=0 2024-09-10T23:31:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f0848c00640 10 client.11667 ms_handle_connect on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f0848c00640 1 -- 172.21.15.17:0/1715123259 <== mds.0 v2:172.21.15.77:6834/20480727 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a2a161a40 con 0x562a2a3318b0 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f0848c00640 10 client.11667 handle_command_reply: tid=0 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 client.11667 shutdown 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 -- 172.21.15.17:0/1715123259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 msgr2=0x562a2a330420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a330420 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7f0850022d50 tx=0x7f0850013070 comp rx=0 tx=0).stop 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 -- 172.21.15.17:0/1715123259 shutdown_connections 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a34e850 0x562a2a330ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x562a2a3318b0 0x562a2a3601f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34df30 0x562a2a330960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 --2- 172.21.15.17:0/1715123259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a301920 0x562a2a330420 unknown :-1 s=CLOSED pgs=2475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f0848c00640 0 client.11667 ms_handle_reset on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 -- 172.21.15.17:0/1715123259 >> 172.21.15.17:0/1715123259 conn(0x562a2a32eff0 msgr2=0x562a2a300ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 -- 172.21.15.17:0/1715123259 shutdown_connections 2024-09-10T23:31:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 1 -- 172.21.15.17:0/1715123259 wait complete. 2024-09-10T23:31:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.239+0000 7f08698db000 20 client.11667 trim_cache size 0 max 16384 2024-09-10T23:31:34.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.251+0000 7f08698db000 1 Processor -- start 2024-09-10T23:31:34.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.251+0000 7f08698db000 1 -- start start 2024-09-10T23:31:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 0x562a2a363a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a34cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a34d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0860164150 con 0x562a2a34df30 2024-09-10T23:31:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0860163130 con 0x562a2a301920 2024-09-10T23:31:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f08601571e0 con 0x562a2a34e850 2024-09-10T23:31:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f085ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a34cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f085ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a34cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60022/0 (socket says 172.21.15.17:60022) 2024-09-10T23:31:34.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f085ea00640 1 -- 172.21.15.17:0/353985206 learned_addr learned my addr 172.21.15.17:0/353985206 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f085ea00640 1 -- 172.21.15.17:0/353985206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 msgr2=0x562a2a34d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f085ea00640 1 --2- 172.21.15.17:0/353985206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a34d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f085ea00640 1 -- 172.21.15.17:0/353985206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 msgr2=0x562a2a363a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f085ea00640 1 --2- 172.21.15.17:0/353985206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 0x562a2a363a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f085ea00640 1 -- 172.21.15.17:0/353985206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a2a0ed1d0 con 0x562a2a34df30 2024-09-10T23:31:34.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f085ea00640 1 --2- 172.21.15.17:0/353985206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a34cd70 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f084c05d790 tx=0x7f084c090bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3782019492642ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f084b400640 1 -- 172.21.15.17:0/353985206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c062230 con 0x562a2a34df30 2024-09-10T23:31:34.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f084b400640 1 -- 172.21.15.17:0/353985206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f084c05ca60 con 0x562a2a34df30 2024-09-10T23:31:34.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f084b400640 1 -- 172.21.15.17:0/353985206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c064430 con 0x562a2a34df30 2024-09-10T23:31:34.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 -- 172.21.15.17:0/353985206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 msgr2=0x562a2a34cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 --2- 172.21.15.17:0/353985206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a34cd70 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f084c05d790 tx=0x7f084c090bf0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 -- 172.21.15.17:0/353985206 shutdown_connections 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 --2- 172.21.15.17:0/353985206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a34d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 --2- 172.21.15.17:0/353985206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a34cd70 unknown :-1 s=CLOSED pgs=2476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 --2- 172.21.15.17:0/353985206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 0x562a2a363a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 -- 172.21.15.17:0/353985206 >> 172.21.15.17:0/353985206 conn(0x562a2a32eff0 msgr2=0x562a2a35aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 -- 172.21.15.17:0/353985206 shutdown_connections 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 -- 172.21.15.17:0/353985206 wait complete. 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 -- start start 2024-09-10T23:31:34.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 Processor -- start 2024-09-10T23:31:34.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 0x562a2a3c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.255+0000 7f08698db000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a3c4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x562a2a11a890 con 0x562a2a34df30 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x562a2a15e8c0 con 0x562a2a301920 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x562a2a111690 con 0x562a2a34e850 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 10 client.0 _ll_register_callbacks cb 0x7f0850010bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a3c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a3c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60036/0 (socket says 172.21.15.17:60036) 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085ea00640 1 -- 172.21.15.17:0/114741552 learned_addr learned my addr 172.21.15.17:0/114741552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085f400640 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 0x562a2a3c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085ea00640 1 -- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 msgr2=0x562a2a3c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085fe00640 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085ea00640 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085ea00640 1 -- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 msgr2=0x562a2a3c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085ea00640 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 0x562a2a3c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085ea00640 1 -- 172.21.15.17:0/114741552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a2a115970 con 0x562a2a34df30 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085f400640 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 0x562a2a3c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085fe00640 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085ea00640 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a3c4490 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f084c05d740 tx=0x7f084c059730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292f51cf1e8b407 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 1 -- 172.21.15.17:0/114741552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c07b070 con 0x562a2a34df30 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 1 -- 172.21.15.17:0/114741552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f084c064430 con 0x562a2a34df30 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- 172.21.15.17:0/114741552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f084c05ca60 con 0x562a2a34df30 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 1 -- 172.21.15.17:0/114741552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=161) ==== 24+0+0 (secure 0 0 0) 0x7f084c062230 con 0x562a2a34df30 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 10 client.11673 fetch_fsmap learned FSMap version 161 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- 172.21.15.17:0/114741552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=161,monmap=2+}) -- 0x562a2a0e5560 con 0x562a2a34df30 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 1 -- 172.21.15.17:0/114741552 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f084c05ca60 con 0x562a2a34df30 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 1 -- 172.21.15.17:0/114741552 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 161) ==== 3502+0+0 (secure 0 0 0) 0x7f084c082b90 con 0x562a2a34df30 2024-09-10T23:31:34.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 10 client.11673 fetch_fsmap finished waiting for FSMap version 161 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 10 client.11673 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.d 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 20 client.11673 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x562a2a360f40 0x562a2a361350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 4 client.11673 mds_command: new command op to 11463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- 172.21.15.17:0/114741552 --> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562a2a15d4f0 con 0x562a2a360f40 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085f400640 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x562a2a360f40 0x562a2a361350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f085f400640 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x562a2a360f40 0x562a2a361350 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45ced55e04fa1560 server_cookie=28046f13561f80d6 in_seq=0 out_seq=0 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 10 client.11673 ms_handle_connect on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 1 -- 172.21.15.17:0/114741552 <== mds.0 v2:172.21.15.77:6834/20480727 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562a2a15d4f0 con 0x562a2a360f40 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 10 client.11673 handle_command_reply: tid=0 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 client.11673 shutdown 2024-09-10T23:31:34.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- 172.21.15.17:0/114741552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 msgr2=0x562a2a3c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a3c4490 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f084c05d740 tx=0x7f084c059730 comp rx=0 tx=0).stop 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- 172.21.15.17:0/114741552 shutdown_connections 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:6834/20480727,v1:172.21.15.77:6836/20480727] conn(0x562a2a360f40 0x562a2a361350 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x562a2a34e850 0x562a2a3c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562a2a34df30 0x562a2a3c4490 unknown :-1 s=CLOSED pgs=2477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f0848c00640 0 client.11673 ms_handle_reset on v2:172.21.15.77:6834/20480727 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 --2- 172.21.15.17:0/114741552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x562a2a301920 0x562a2a3c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- 172.21.15.17:0/114741552 >> 172.21.15.17:0/114741552 conn(0x562a2a32eff0 msgr2=0x562a2a34bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- 172.21.15.17:0/114741552 shutdown_connections 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 1 -- 172.21.15.17:0/114741552 wait complete. 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.259+0000 7f08698db000 20 client.11673 trim_cache size 0 max 16384 2024-09-10T23:31:34.266 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2024-09-10T23:31:34.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 -- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08400725e0 msgr2=0x7f0840074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08400725e0 0x7f0840074aa0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f085000bb50 tx=0x7f085000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 -- 172.21.15.17:0/2039841669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d2ae0 msgr2=0x7f08601f84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d2ae0 0x7f08601f84e0 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c500 tx=0x7f084c00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 -- 172.21.15.17:0/2039841669 shutdown_connections 2024-09-10T23:31:34.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f08400725e0 0x7f0840074aa0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f086015bf10 0x7f0860150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08600d2ae0 0x7f08601f84e0 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 --2- 172.21.15.17:0/2039841669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08600d08f0 0x7f08600aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 -- 172.21.15.17:0/2039841669 >> 172.21.15.17:0/2039841669 conn(0x7f08600d1fc0 msgr2=0x7f08600d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 -- 172.21.15.17:0/2039841669 shutdown_connections 2024-09-10T23:31:34.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.263+0000 7f0866400640 1 -- 172.21.15.17:0/2039841669 wait complete. 2024-09-10T23:31:34.282 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:31:34.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:31:34.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:31:34.479 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:31:34.479 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:31:34.479 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:34.479 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:34.488 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:34.488 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:34.539 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:31:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.763+0000 7fcfd7400640 1 -- 172.21.15.17:0/4278343082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd015dc70 msgr2=0x7fcfd00d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.763+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4278343082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd015dc70 0x7fcfd00d0ab0 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0072310 tx=0x7fcfc401c600 comp rx=0 tx=0).stop 2024-09-10T23:31:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.763+0000 7fcfd7400640 1 -- 172.21.15.17:0/4278343082 shutdown_connections 2024-09-10T23:31:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.763+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4278343082 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd0161df0 0x7fcfd006eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.763+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4278343082 >> v2:172.21.15.77:3300/0 conn(0x7fcfd0072be0 0x7fcfd01618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.763+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4278343082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd015dc70 0x7fcfd00d0ab0 unknown :-1 s=CLOSED pgs=2478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.763+0000 7fcfd7400640 1 -- 172.21.15.17:0/4278343082 >> 172.21.15.17:0/4278343082 conn(0x7fcfd00cff90 msgr2=0x7fcfd00d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.763+0000 7fcfd7400640 1 -- 172.21.15.17:0/4278343082 shutdown_connections 2024-09-10T23:31:34.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.763+0000 7fcfd7400640 1 -- 172.21.15.17:0/4278343082 wait complete. 2024-09-10T23:31:34.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 Processor -- start 2024-09-10T23:31:34.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 -- start start 2024-09-10T23:31:34.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd0072be0 0x7fcfd015e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd015dc70 0x7fcfd0155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd0161df0 0x7fcfd0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd00adab0 con 0x7fcfd0072be0 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd00ad930 con 0x7fcfd0161df0 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd00adc30 con 0x7fcfd015dc70 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd0072be0 0x7fcfd015e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd4a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd0072be0 0x7fcfd015e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60044/0 (socket says 172.21.15.17:60044) 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd4a00640 1 -- 172.21.15.17:0/4012009690 learned_addr learned my addr 172.21.15.17:0/4012009690 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfcfe00640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd015dc70 0x7fcfd0155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd5400640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd0161df0 0x7fcfd0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd4a00640 1 -- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd015dc70 msgr2=0x7fcfd0155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd4a00640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd015dc70 0x7fcfd0155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd4a00640 1 -- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd0161df0 msgr2=0x7fcfd0151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd4a00640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd0161df0 0x7fcfd0151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd4a00640 1 -- 172.21.15.17:0/4012009690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd0160af0 con 0x7fcfd0072be0 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd4a00640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd0072be0 0x7fcfd015e990 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fcfc401cae0 tx=0x7fcfc40b06a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfccc00640 1 -- 172.21.15.17:0/4012009690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40b0c00 con 0x7fcfd0072be0 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfccc00640 1 -- 172.21.15.17:0/4012009690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfc40b0da0 con 0x7fcfd0072be0 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd0153d30 con 0x7fcfd0072be0 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfccc00640 1 -- 172.21.15.17:0/4012009690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4004290 con 0x7fcfd0072be0 2024-09-10T23:31:34.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd01542f0 con 0x7fcfd0072be0 2024-09-10T23:31:34.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.767+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd00d0ab0 con 0x7fcfd0072be0 2024-09-10T23:31:34.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.771+0000 7fcfccc00640 1 -- 172.21.15.17:0/4012009690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fcfc4005070 con 0x7fcfd0072be0 2024-09-10T23:31:34.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.771+0000 7fcfccc00640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb00725e0 0x7fcfb0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:34.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.771+0000 7fcfccc00640 1 -- 172.21.15.17:0/4012009690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fcfc412d100 con 0x7fcfd0072be0 2024-09-10T23:31:34.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.771+0000 7fcfcfe00640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb00725e0 0x7fcfb0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:34.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.771+0000 7fcfcfe00640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb00725e0 0x7fcfb0074aa0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fcfd015e490 tx=0x7fcfbc00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:34.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.775+0000 7fcfccc00640 1 -- 172.21.15.17:0/4012009690 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fcfc40ac030 con 0x7fcfd0072be0 2024-09-10T23:31:34.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.959+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcfd006ffc0 con 0x7fcfd0072be0 2024-09-10T23:31:34.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.959+0000 7fcfccc00640 1 -- 172.21.15.17:0/4012009690 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v212) ==== 80+0+0 (secure 0 0 0) 0x7fcfc40164b0 con 0x7fcfd0072be0 2024-09-10T23:31:34.961 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:31:34.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.959+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb00725e0 msgr2=0x7fcfb0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.959+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb00725e0 0x7fcfb0074aa0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fcfd015e490 tx=0x7fcfbc00b390 comp rx=0 tx=0).stop 2024-09-10T23:31:34.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.959+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd0072be0 msgr2=0x7fcfd015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:34.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.959+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd0072be0 0x7fcfd015e990 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fcfc401cae0 tx=0x7fcfc40b06a0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.963+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 shutdown_connections 2024-09-10T23:31:34.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.963+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fcfb00725e0 0x7fcfb0074aa0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.963+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfd0161df0 0x7fcfd0151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.963+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcfd015dc70 0x7fcfd0155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.963+0000 7fcfd7400640 1 --2- 172.21.15.17:0/4012009690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfd0072be0 0x7fcfd015e990 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:34.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.963+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 >> 172.21.15.17:0/4012009690 conn(0x7fcfd00cff90 msgr2=0x7fcfd00b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:34.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.963+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 shutdown_connections 2024-09-10T23:31:34.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:34.963+0000 7fcfd7400640 1 -- 172.21.15.17:0/4012009690 wait complete. 2024-09-10T23:31:34.982 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:31:34.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:34.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:35.001 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[89984]: fuse finished with error 0 and tester_r 0 2024-09-10T23:31:35.015 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:31:35.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:35.015 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:31:35.187 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:31:35.187 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:31:35.187 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:35.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:31:35.197 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:31:35.197 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:35.197 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:35.239 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:31:35.239 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:31:35.239 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:31:35.239 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:35.249 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:31:35.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:35.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.427+0000 7fed0ca00640 1 -- 172.21.15.17:0/4100713540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed080ce680 msgr2=0x7fed080cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:35.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.427+0000 7fed0ca00640 1 --2- 172.21.15.17:0/4100713540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed080ce680 0x7fed080cea60 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7fed08072ed0 tx=0x7fecf801c8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.427+0000 7fed0ca00640 1 -- 172.21.15.17:0/4100713540 shutdown_connections 2024-09-10T23:31:35.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.427+0000 7fed0ca00640 1 --2- 172.21.15.17:0/4100713540 >> v2:172.21.15.77:3300/0 conn(0x7fed080cfb90 0x7fed0815fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.427+0000 7fed0ca00640 1 --2- 172.21.15.17:0/4100713540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed080ce680 0x7fed080cea60 unknown :-1 s=CLOSED pgs=2480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.427+0000 7fed0ca00640 1 -- 172.21.15.17:0/4100713540 >> 172.21.15.17:0/4100713540 conn(0x7fed080d1db0 msgr2=0x7fed080d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.427+0000 7fed0ca00640 1 -- 172.21.15.17:0/4100713540 shutdown_connections 2024-09-10T23:31:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.427+0000 7fed0ca00640 1 -- 172.21.15.17:0/4100713540 wait complete. 2024-09-10T23:31:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 Processor -- start 2024-09-10T23:31:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 -- start start 2024-09-10T23:31:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080ce680 0x7fed0815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed080cfb90 0x7fed08157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08160370 0x7fed081658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fed08169490 con 0x7fed08160370 2024-09-10T23:31:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed08169310 con 0x7fed080ce680 2024-09-10T23:31:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fed08169610 con 0x7fed080cfb90 2024-09-10T23:31:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed06800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08160370 0x7fed081658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed05e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080ce680 0x7fed0815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed05e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080ce680 0x7fed0815bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:35114/0 (socket says 172.21.15.17:35114) 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed05e00640 1 -- 172.21.15.17:0/1237793896 learned_addr learned my addr 172.21.15.17:0/1237793896 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fecffe00640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed080cfb90 0x7fed08157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed06800640 1 -- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed080cfb90 msgr2=0x7fed08157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed06800640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed080cfb90 0x7fed08157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed06800640 1 -- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080ce680 msgr2=0x7fed0815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed06800640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080ce680 0x7fed0815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed06800640 1 -- 172.21.15.17:0/1237793896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed08151d60 con 0x7fed08160370 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed06800640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08160370 0x7fed081658a0 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7fed0000c760 tx=0x7fed0000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fecfe000640 1 -- 172.21.15.17:0/1237793896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00003b80 con 0x7fed08160370 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fecfe000640 1 -- 172.21.15.17:0/1237793896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed00003d20 con 0x7fed08160370 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fecfe000640 1 -- 172.21.15.17:0/1237793896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00005330 con 0x7fed08160370 2024-09-10T23:31:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed08152040 con 0x7fed08160370 2024-09-10T23:31:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0815c4b0 con 0x7fed08160370 2024-09-10T23:31:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.431+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed081590d0 con 0x7fed08160370 2024-09-10T23:31:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.435+0000 7fecfe000640 1 -- 172.21.15.17:0/1237793896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fed000054d0 con 0x7fed08160370 2024-09-10T23:31:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.435+0000 7fecfe000640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fece40725e0 0x7fece4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.435+0000 7fecfe000640 1 -- 172.21.15.17:0/1237793896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fed00092f70 con 0x7fed08160370 2024-09-10T23:31:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.435+0000 7fed05e00640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fece40725e0 0x7fece4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:35.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.435+0000 7fed05e00640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fece40725e0 0x7fece4074aa0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fed08159540 tx=0x7fecf80a7040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:35.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.439+0000 7fecfe000640 1 -- 172.21.15.17:0/1237793896 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fed0005de60 con 0x7fed08160370 2024-09-10T23:31:35.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.647+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed080cea60 con 0x7fed08160370 2024-09-10T23:31:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.647+0000 7fecfe000640 1 -- 172.21.15.17:0/1237793896 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 161 v161) ==== 95+0+5234 (secure 0 0 0) 0x7fed00062890 con 0x7fed08160370 2024-09-10T23:31:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:35.651 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":161,"btime":"2024-09-10T23:31:22:092426+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1912731352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1912731352},{"type":"v1","addr":"172.21.15.77:6837","nonce":1912731352}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156},{"gid":11448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3122453626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3122453626},{"type":"v1","addr":"172.21.15.17:6834","nonce":3122453626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2814757943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2814757943},{"type":"v1","addr":"172.21.15.17:6835","nonce":2814757943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[{"mdsmap":{"epoch":161,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:18.471461+0000","modified":"2024-09-10T23:31:21.496202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11463":{"gid":11463,"name":"d","rank":0,"incarnation":157,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/20480727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":20480727},{"type":"v1","addr":"172.21.15.77:6836","nonce":20480727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11463,"qdb_cluster":[11463]},"id":15}]} 2024-09-10T23:31:35.651 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 161 2024-09-10T23:31:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fece40725e0 msgr2=0x7fece4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fece40725e0 0x7fece4074aa0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fed08159540 tx=0x7fecf80a7040 comp rx=0 tx=0).stop 2024-09-10T23:31:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08160370 msgr2=0x7fed081658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08160370 0x7fed081658a0 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7fed0000c760 tx=0x7fed0000cc20 comp rx=0 tx=0).stop 2024-09-10T23:31:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 shutdown_connections 2024-09-10T23:31:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fece40725e0 0x7fece4074aa0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08160370 0x7fed081658a0 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fed080cfb90 0x7fed08157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 --2- 172.21.15.17:0/1237793896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed080ce680 0x7fed0815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 >> 172.21.15.17:0/1237793896 conn(0x7fed080d1db0 msgr2=0x7fed080722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 shutdown_connections 2024-09-10T23:31:35.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.651+0000 7fed0ca00640 1 -- 172.21.15.17:0/1237793896 wait complete. 2024-09-10T23:31:35.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:35.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.815+0000 7f5878e00640 1 -- 172.21.15.17:0/1671722646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587406fc50 msgr2=0x7f587415b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.815+0000 7f5878e00640 1 --2- 172.21.15.17:0/1671722646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587406fc50 0x7f587415b2f0 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f5874073f40 tx=0x7f586401c6e0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.815+0000 7f5878e00640 1 -- 172.21.15.17:0/1671722646 shutdown_connections 2024-09-10T23:31:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.815+0000 7f5878e00640 1 --2- 172.21.15.17:0/1671722646 >> v2:172.21.15.77:3300/0 conn(0x7f58740745e0 0x7f587415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.815+0000 7f5878e00640 1 --2- 172.21.15.17:0/1671722646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f587406fc50 0x7f587415b2f0 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.815+0000 7f5878e00640 1 -- 172.21.15.17:0/1671722646 >> 172.21.15.17:0/1671722646 conn(0x7f58740b1850 msgr2=0x7f58740b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.815+0000 7f5878e00640 1 -- 172.21.15.17:0/1671722646 shutdown_connections 2024-09-10T23:31:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.815+0000 7f5878e00640 1 -- 172.21.15.17:0/1671722646 wait complete. 2024-09-10T23:31:35.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 Processor -- start 2024-09-10T23:31:35.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 -- start start 2024-09-10T23:31:35.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f587406fc50 0x7f587414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:35.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5874070030 0x7f5874152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:35.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58740745e0 0x7f5874153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:35.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58740cfe90 con 0x7f58740745e0 2024-09-10T23:31:35.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58740cfd10 con 0x7f5874070030 2024-09-10T23:31:35.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f58740d0010 con 0x7f587406fc50 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5872800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58740745e0 0x7f5874153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5872800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58740745e0 0x7f5874153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60084/0 (socket says 172.21.15.17:60084) 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5872800640 1 -- 172.21.15.17:0/2614526213 learned_addr learned my addr 172.21.15.17:0/2614526213 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5871e00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f587406fc50 0x7f587414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f586be00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5874070030 0x7f5874152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5872800640 1 -- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f587406fc50 msgr2=0x7f587414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5872800640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f587406fc50 0x7f587414d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5872800640 1 -- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5874070030 msgr2=0x7f5874152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5872800640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5874070030 0x7f5874152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5872800640 1 -- 172.21.15.17:0/2614526213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587414d8e0 con 0x7f58740745e0 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5872800640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58740745e0 0x7f5874153010 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c780 tx=0x7f586c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f586a000640 1 -- 172.21.15.17:0/2614526213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c016020 con 0x7f58740745e0 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f586a000640 1 -- 172.21.15.17:0/2614526213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f586c00aae0 con 0x7f58740745e0 2024-09-10T23:31:35.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587414dbc0 con 0x7f58740745e0 2024-09-10T23:31:35.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f586a000640 1 -- 172.21.15.17:0/2614526213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c012420 con 0x7f58740745e0 2024-09-10T23:31:35.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.819+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587414e180 con 0x7f58740745e0 2024-09-10T23:31:35.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.823+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587415b2f0 con 0x7f58740745e0 2024-09-10T23:31:35.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.823+0000 7f586a000640 1 -- 172.21.15.17:0/2614526213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f586c01a3b0 con 0x7f58740745e0 2024-09-10T23:31:35.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.823+0000 7f586a000640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58500725e0 0x7f5850074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:35.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.823+0000 7f586a000640 1 -- 172.21.15.17:0/2614526213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f586c0936c0 con 0x7f58740745e0 2024-09-10T23:31:35.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.823+0000 7f5871e00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58500725e0 0x7f5850074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:35.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.823+0000 7f5871e00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58500725e0 0x7f5850074aa0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f58640af000 tx=0x7f586401af20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:35.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:35.827+0000 7f586a000640 1 -- 172.21.15.17:0/2614526213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f586c020030 con 0x7f58740745e0 2024-09-10T23:31:36.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.035+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58740b55a0 con 0x7f58740745e0 2024-09-10T23:31:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.035+0000 7f586a000640 1 -- 172.21.15.17:0/2614526213 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 161 v161) ==== 95+0+5234 (secure 0 0 0) 0x7f586c05ebf0 con 0x7f58740745e0 2024-09-10T23:31:36.038 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:36.038 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":161,"btime":"2024-09-10T23:31:22:092426+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1912731352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1912731352},{"type":"v1","addr":"172.21.15.77:6837","nonce":1912731352}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156},{"gid":11448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3122453626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3122453626},{"type":"v1","addr":"172.21.15.17:6834","nonce":3122453626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2814757943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2814757943},{"type":"v1","addr":"172.21.15.17:6835","nonce":2814757943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[{"mdsmap":{"epoch":161,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:18.471461+0000","modified":"2024-09-10T23:31:21.496202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11463":{"gid":11463,"name":"d","rank":0,"incarnation":157,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/20480727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":20480727},{"type":"v1","addr":"172.21.15.77:6836","nonce":20480727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11463,"qdb_cluster":[11463]},"id":15}]} 2024-09-10T23:31:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 161 2024-09-10T23:31:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58500725e0 msgr2=0x7f5850074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58500725e0 0x7f5850074aa0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f58640af000 tx=0x7f586401af20 comp rx=0 tx=0).stop 2024-09-10T23:31:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58740745e0 msgr2=0x7f5874153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58740745e0 0x7f5874153010 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c780 tx=0x7f586c00cc40 comp rx=0 tx=0).stop 2024-09-10T23:31:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 shutdown_connections 2024-09-10T23:31:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58500725e0 0x7f5850074aa0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58740745e0 0x7f5874153010 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5874070030 0x7f5874152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 --2- 172.21.15.17:0/2614526213 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f587406fc50 0x7f587414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 >> 172.21.15.17:0/2614526213 conn(0x7f58740b1850 msgr2=0x7f587415dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:36.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 shutdown_connections 2024-09-10T23:31:36.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.039+0000 7f5878e00640 1 -- 172.21.15.17:0/2614526213 wait complete. 2024-09-10T23:31:36.060 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 -- 172.21.15.17:0/1220068520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc06fc50 msgr2=0x7f01fc15b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 --2- 172.21.15.17:0/1220068520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc06fc50 0x7f01fc15b2f0 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f01fc073980 tx=0x7f01ec01dbf0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 -- 172.21.15.17:0/1220068520 shutdown_connections 2024-09-10T23:31:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 --2- 172.21.15.17:0/1220068520 >> v2:172.21.15.77:3300/0 conn(0x7f01fc070030 0x7f01fc0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 --2- 172.21.15.17:0/1220068520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc06fc50 0x7f01fc15b2f0 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 -- 172.21.15.17:0/1220068520 >> 172.21.15.17:0/1220068520 conn(0x7f01fc0b1850 msgr2=0x7f01fc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 -- 172.21.15.17:0/1220068520 shutdown_connections 2024-09-10T23:31:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 -- 172.21.15.17:0/1220068520 wait complete. 2024-09-10T23:31:36.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 Processor -- start 2024-09-10T23:31:36.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 -- start start 2024-09-10T23:31:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01fc06fc50 0x7f01fc1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc070030 0x7f01fc0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc0745e0 0x7f01fc153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc167200 con 0x7f01fc0745e0 2024-09-10T23:31:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc06f390 con 0x7f01fc070030 2024-09-10T23:31:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0203a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f01fc167380 con 0x7f01fc06fc50 2024-09-10T23:31:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc0745e0 0x7f01fc153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc0745e0 0x7f01fc153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60100/0 (socket says 172.21.15.17:60100) 2024-09-10T23:31:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201a00640 1 -- 172.21.15.17:0/3529189017 learned_addr learned my addr 172.21.15.17:0/3529189017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201000640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01fc06fc50 0x7f01fc1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f01f3e00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc070030 0x7f01fc0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201a00640 1 -- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01fc06fc50 msgr2=0x7f01fc1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201a00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01fc06fc50 0x7f01fc1511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201a00640 1 -- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc070030 msgr2=0x7f01fc0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201a00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc070030 0x7f01fc0b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201a00640 1 -- 172.21.15.17:0/3529189017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc0af540 con 0x7f01fc0745e0 2024-09-10T23:31:36.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.207+0000 7f0201000640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01fc06fc50 0x7f01fc1511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:31:36.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.211+0000 7f0201a00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc0745e0 0x7f01fc153fa0 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f01f400eb20 tx=0x7f01f400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.211+0000 7f01f9600640 1 -- 172.21.15.17:0/3529189017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4004b30 con 0x7f01fc0745e0 2024-09-10T23:31:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.211+0000 7f01f9600640 1 -- 172.21.15.17:0/3529189017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01f4004cf0 con 0x7f01fc0745e0 2024-09-10T23:31:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.211+0000 7f01f9600640 1 -- 172.21.15.17:0/3529189017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4005280 con 0x7f01fc0745e0 2024-09-10T23:31:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.211+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc0b3d50 con 0x7f01fc0745e0 2024-09-10T23:31:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.211+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc1fb9d0 con 0x7f01fc0745e0 2024-09-10T23:31:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.211+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc075ad0 con 0x7f01fc0745e0 2024-09-10T23:31:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.211+0000 7f01f9600640 1 -- 172.21.15.17:0/3529189017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f01f4005420 con 0x7f01fc0745e0 2024-09-10T23:31:36.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.215+0000 7f01f9600640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01d80725e0 0x7f01d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.215+0000 7f01f9600640 1 -- 172.21.15.17:0/3529189017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f01f4093fe0 con 0x7f01fc0745e0 2024-09-10T23:31:36.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.215+0000 7f0201000640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01d80725e0 0x7f01d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.215+0000 7f0201000640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01d80725e0 0x7f01d8074aa0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0b0000 tx=0x7f01ec01c430 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:36.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.219+0000 7f01f9600640 1 -- 172.21.15.17:0/3529189017 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f01f405ee80 con 0x7f01fc0745e0 2024-09-10T23:31:36.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.391+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01fc0b55a0 con 0x7f01fc0745e0 2024-09-10T23:31:36.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f01f9600640 1 -- 172.21.15.17:0/3529189017 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) ==== 74+0+16952 (secure 0 0 0) 0x7f01f40638b0 con 0x7f01fc0745e0 2024-09-10T23:31:36.422 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:36.422 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":212,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:20.076985+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:16.186449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:17.438325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:36.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01d80725e0 msgr2=0x7f01d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01d80725e0 0x7f01d8074aa0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0b0000 tx=0x7f01ec01c430 comp rx=0 tx=0).stop 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc0745e0 msgr2=0x7f01fc153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc0745e0 0x7f01fc153fa0 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f01f400eb20 tx=0x7f01f400c2d0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 shutdown_connections 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f01d80725e0 0x7f01d8074aa0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01fc0745e0 0x7f01fc153fa0 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01fc070030 0x7f01fc0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 --2- 172.21.15.17:0/3529189017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01fc06fc50 0x7f01fc1511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 >> 172.21.15.17:0/3529189017 conn(0x7f01fc0b1850 msgr2=0x7f01fc15dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 shutdown_connections 2024-09-10T23:31:36.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.395+0000 7f0203a00640 1 -- 172.21.15.17:0/3529189017 wait complete. 2024-09-10T23:31:36.425 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:31:36.425 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:36.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 -- 172.21.15.17:0/4276754937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 msgr2=0x7f7634072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 --2- 172.21.15.17:0/4276754937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 0x7f7634072800 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f7634070860 tx=0x7f762801c770 comp rx=0 tx=0).stop 2024-09-10T23:31:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 -- 172.21.15.17:0/4276754937 shutdown_connections 2024-09-10T23:31:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 --2- 172.21.15.17:0/4276754937 >> v2:172.21.15.77:3300/0 conn(0x7f76340cf180 0x7f76340cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 --2- 172.21.15.17:0/4276754937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 0x7f7634072800 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 -- 172.21.15.17:0/4276754937 >> 172.21.15.17:0/4276754937 conn(0x7f76340b1850 msgr2=0x7f76340b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 -- 172.21.15.17:0/4276754937 shutdown_connections 2024-09-10T23:31:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 -- 172.21.15.17:0/4276754937 wait complete. 2024-09-10T23:31:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 Processor -- start 2024-09-10T23:31:36.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 -- start start 2024-09-10T23:31:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 0x7f7634148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f763406fd10 0x7f7634137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76340cf180 0x7f7634154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7634167b00 con 0x7f763406f930 2024-09-10T23:31:36.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7634167980 con 0x7f763406fd10 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f763c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7634167c80 con 0x7f76340cf180 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f7639800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 0x7f7634148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f7639800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 0x7f7634148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60118/0 (socket says 172.21.15.17:60118) 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.571+0000 7f7639800640 1 -- 172.21.15.17:0/163727277 learned_addr learned my addr 172.21.15.17:0/163727277 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7638e00640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f763406fd10 0x7f7634137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f763a200640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76340cf180 0x7f7634154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7639800640 1 -- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76340cf180 msgr2=0x7f7634154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7639800640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76340cf180 0x7f7634154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7639800640 1 -- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f763406fd10 msgr2=0x7f7634137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7639800640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f763406fd10 0x7f7634137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7639800640 1 -- 172.21.15.17:0/163727277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7634070ac0 con 0x7f763406f930 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7639800640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 0x7f7634148cb0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f762801a3a0 tx=0x7f76280a6700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:36.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7631600640 1 -- 172.21.15.17:0/163727277 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76280be070 con 0x7f763406f930 2024-09-10T23:31:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7631600640 1 -- 172.21.15.17:0/163727277 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76280a6c40 con 0x7f763406f930 2024-09-10T23:31:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7631600640 1 -- 172.21.15.17:0/163727277 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628005040 con 0x7f763406f930 2024-09-10T23:31:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76341491f0 con 0x7f763406f930 2024-09-10T23:31:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7634149470 con 0x7f763406f930 2024-09-10T23:31:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7634075ad0 con 0x7f763406f930 2024-09-10T23:31:36.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.575+0000 7f7631600640 1 -- 172.21.15.17:0/163727277 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f76280051e0 con 0x7f763406f930 2024-09-10T23:31:36.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.579+0000 7f7631600640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76140725e0 0x7f7614074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.579+0000 7f7631600640 1 -- 172.21.15.17:0/163727277 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7f762812cc80 con 0x7f763406f930 2024-09-10T23:31:36.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.579+0000 7f7638e00640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76140725e0 0x7f7614074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.579+0000 7f7638e00640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76140725e0 0x7f7614074aa0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f763414c3f0 tx=0x7f7620009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.583+0000 7f7631600640 1 -- 172.21.15.17:0/163727277 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f76341491f0 con 0x7f763406f930 2024-09-10T23:31:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.791+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f763414a3c0 con 0x7f763406f930 2024-09-10T23:31:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.791+0000 7f7631600640 1 -- 172.21.15.17:0/163727277 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 161 v161) ==== 95+0+5234 (secure 0 0 0) 0x7f763414a3c0 con 0x7f763406f930 2024-09-10T23:31:36.795 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:36.795 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":161,"btime":"2024-09-10T23:31:22:092426+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1912731352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1912731352},{"type":"v1","addr":"172.21.15.77:6837","nonce":1912731352}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156},{"gid":11448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3122453626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3122453626},{"type":"v1","addr":"172.21.15.17:6834","nonce":3122453626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2814757943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2814757943},{"type":"v1","addr":"172.21.15.17:6835","nonce":2814757943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[{"mdsmap":{"epoch":161,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:18.471461+0000","modified":"2024-09-10T23:31:21.496202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11463":{"gid":11463,"name":"d","rank":0,"incarnation":157,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/20480727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":20480727},{"type":"v1","addr":"172.21.15.77:6836","nonce":20480727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11463,"qdb_cluster":[11463]},"id":15}]} 2024-09-10T23:31:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 161 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76140725e0 msgr2=0x7f7614074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76140725e0 0x7f7614074aa0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f763414c3f0 tx=0x7f7620009040 comp rx=0 tx=0).stop 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 msgr2=0x7f7634148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 0x7f7634148cb0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f762801a3a0 tx=0x7f76280a6700 comp rx=0 tx=0).stop 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 shutdown_connections 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f76140725e0 0x7f7614074aa0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f76340cf180 0x7f7634154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f763406fd10 0x7f7634137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 --2- 172.21.15.17:0/163727277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f763406f930 0x7f7634148cb0 unknown :-1 s=CLOSED pgs=2488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 >> 172.21.15.17:0/163727277 conn(0x7f76340b1850 msgr2=0x7f7634068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 shutdown_connections 2024-09-10T23:31:36.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.795+0000 7f763c200640 1 -- 172.21.15.17:0/163727277 wait complete. 2024-09-10T23:31:36.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 -- 172.21.15.17:0/1578838217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc870162150 msgr2=0x7fc87006cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 --2- 172.21.15.17:0/1578838217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc870162150 0x7fc87006cd70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc858009870 tx=0x7fc85801c740 comp rx=0 tx=0).stop 2024-09-10T23:31:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 -- 172.21.15.17:0/1578838217 shutdown_connections 2024-09-10T23:31:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 --2- 172.21.15.17:0/1578838217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc870162150 0x7fc87006cd70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 -- 172.21.15.17:0/1578838217 >> 172.21.15.17:0/1578838217 conn(0x7fc8700d0c90 msgr2=0x7fc8700d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 -- 172.21.15.17:0/1578838217 shutdown_connections 2024-09-10T23:31:36.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 -- 172.21.15.17:0/1578838217 wait complete. 2024-09-10T23:31:36.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 Processor -- start 2024-09-10T23:31:36.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 -- start start 2024-09-10T23:31:36.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc870071250 0x7fc87014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc870154f00 0x7fc870154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc870162150 0x7fc8701546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc87016bf30 con 0x7fc870162150 2024-09-10T23:31:36.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc87016bdb0 con 0x7fc870154f00 2024-09-10T23:31:36.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc875a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc87016c0b0 con 0x7fc870071250 2024-09-10T23:31:36.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc86f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc870162150 0x7fc8701546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc867e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc870154f00 0x7fc870154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc86ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc870071250 0x7fc87014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc86f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc870162150 0x7fc8701546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57092/0 (socket says 172.21.15.17:57092) 2024-09-10T23:31:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc86f400640 1 -- 172.21.15.17:0/1920948753 learned_addr learned my addr 172.21.15.17:0/1920948753 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc86f400640 1 -- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc870071250 msgr2=0x7fc87014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc86f400640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc870071250 0x7fc87014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc86f400640 1 -- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc870154f00 msgr2=0x7fc870154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc86f400640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc870154f00 0x7fc870154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.963+0000 7fc86f400640 1 -- 172.21.15.17:0/1920948753 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc870157790 con 0x7fc870162150 2024-09-10T23:31:36.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc86f400640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc870162150 0x7fc8701546c0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7fc86800c700 tx=0x7fc86800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:36.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc866a00640 1 -- 172.21.15.17:0/1920948753 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868003b80 con 0x7fc870162150 2024-09-10T23:31:36.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc866a00640 1 -- 172.21.15.17:0/1920948753 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc868003d20 con 0x7fc870162150 2024-09-10T23:31:36.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc866a00640 1 -- 172.21.15.17:0/1920948753 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86800aab0 con 0x7fc870162150 2024-09-10T23:31:36.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc870157a70 con 0x7fc870162150 2024-09-10T23:31:36.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc870150050 con 0x7fc870162150 2024-09-10T23:31:36.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87006cd70 con 0x7fc870162150 2024-09-10T23:31:36.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc866a00640 1 -- 172.21.15.17:0/1920948753 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc86800ac50 con 0x7fc870162150 2024-09-10T23:31:36.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc866a00640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc84c072610 0x7fc84c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:36.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc866a00640 1 -- 172.21.15.17:0/1920948753 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fc868093140 con 0x7fc870162150 2024-09-10T23:31:36.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.967+0000 7fc86ea00640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc84c072610 0x7fc84c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:36.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.971+0000 7fc86ea00640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc84c072610 0x7fc84c074ad0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc860000c10 tx=0x7fc860007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:36.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:36.971+0000 7fc866a00640 1 -- 172.21.15.17:0/1920948753 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc86805dfa0 con 0x7fc870162150 2024-09-10T23:31:37.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8700d0690 con 0x7fc870162150 2024-09-10T23:31:37.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc866a00640 1 -- 172.21.15.17:0/1920948753 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 161 v161) ==== 95+0+5234 (secure 0 0 0) 0x7fc8680629d0 con 0x7fc870162150 2024-09-10T23:31:37.185 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:37.185 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":161,"btime":"2024-09-10T23:31:22:092426+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1912731352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1912731352},{"type":"v1","addr":"172.21.15.77:6837","nonce":1912731352}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156},{"gid":11448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3122453626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3122453626},{"type":"v1","addr":"172.21.15.17:6834","nonce":3122453626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2814757943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2814757943},{"type":"v1","addr":"172.21.15.17:6835","nonce":2814757943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[{"mdsmap":{"epoch":161,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:18.471461+0000","modified":"2024-09-10T23:31:21.496202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11463":{"gid":11463,"name":"d","rank":0,"incarnation":157,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6836/20480727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":20480727},{"type":"v1","addr":"172.21.15.77:6836","nonce":20480727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11463,"qdb_cluster":[11463]},"id":15}]} 2024-09-10T23:31:37.185 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 161 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc84c072610 msgr2=0x7fc84c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc84c072610 0x7fc84c074ad0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc860000c10 tx=0x7fc860007ec0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc870162150 msgr2=0x7fc8701546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc870162150 0x7fc8701546c0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7fc86800c700 tx=0x7fc86800cbc0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 shutdown_connections 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc84c072610 0x7fc84c074ad0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc870162150 0x7fc8701546c0 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc870154f00 0x7fc870154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 --2- 172.21.15.17:0/1920948753 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc870071250 0x7fc87014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 >> 172.21.15.17:0/1920948753 conn(0x7fc8700d0c90 msgr2=0x7fc870070580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:37.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 shutdown_connections 2024-09-10T23:31:37.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.183+0000 7fc875a00640 1 -- 172.21.15.17:0/1920948753 wait complete. 2024-09-10T23:31:37.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:37.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 -- 172.21.15.17:0/177163733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc37c15fc90 msgr2=0x7fc37c160110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 --2- 172.21.15.17:0/177163733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc37c15fc90 0x7fc37c160110 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc374009bc0 tx=0x7fc37401cb70 comp rx=0 tx=0).stop 2024-09-10T23:31:37.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 -- 172.21.15.17:0/177163733 shutdown_connections 2024-09-10T23:31:37.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 --2- 172.21.15.17:0/177163733 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc37c15fc90 0x7fc37c160110 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 --2- 172.21.15.17:0/177163733 >> v2:172.21.15.77:3300/0 conn(0x7fc37c0cfb70 0x7fc37c0cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 -- 172.21.15.17:0/177163733 >> 172.21.15.17:0/177163733 conn(0x7fc37c0d1d40 msgr2=0x7fc37c0d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:37.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 -- 172.21.15.17:0/177163733 shutdown_connections 2024-09-10T23:31:37.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 -- 172.21.15.17:0/177163733 wait complete. 2024-09-10T23:31:37.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 Processor -- start 2024-09-10T23:31:37.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 -- start start 2024-09-10T23:31:37.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.351+0000 7fc383000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc37c0b2fc0 0x7fc37c0cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:37.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc383000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c0cfb70 0x7fc37c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:37.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc383000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc37c15fc90 0x7fc37c0b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc383000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c168f60 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc383000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c0b09d0 con 0x7fc37c0cfb70 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc383000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc37c1690e0 con 0x7fc37c15fc90 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc37be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc37c0b2fc0 0x7fc37c0cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc37be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc37c0b2fc0 0x7fc37c0cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57106/0 (socket says 172.21.15.17:57106) 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc37be00640 1 -- 172.21.15.17:0/4292146845 learned_addr learned my addr 172.21.15.17:0/4292146845 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc381000640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc37c15fc90 0x7fc37c0b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc373e00640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c0cfb70 0x7fc37c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc37be00640 1 -- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc37c15fc90 msgr2=0x7fc37c0b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc37be00640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc37c15fc90 0x7fc37c0b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc37be00640 1 -- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c0cfb70 msgr2=0x7fc37c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc37be00640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c0cfb70 0x7fc37c0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc37be00640 1 -- 172.21.15.17:0/4292146845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c0b5ed0 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc37be00640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc37c0b2fc0 0x7fc37c0cde10 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00ea10 tx=0x7fc36c00eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:37.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc378c00640 1 -- 172.21.15.17:0/4292146845 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00cde0 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc378c00640 1 -- 172.21.15.17:0/4292146845 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc36c004020 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c0b61b0 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc378c00640 1 -- 172.21.15.17:0/4292146845 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c004470 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37c0b6770 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c160110 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.355+0000 7fc378c00640 1 -- 172.21.15.17:0/4292146845 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc36c003600 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.359+0000 7fc378c00640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3580725e0 0x7fc358074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:37.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.359+0000 7fc378c00640 1 -- 172.21.15.17:0/4292146845 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fc36c093d10 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.359+0000 7fc373e00640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3580725e0 0x7fc358074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:37.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.359+0000 7fc373e00640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3580725e0 0x7fc358074aa0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0ced80 tx=0x7fc364001420 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:37.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.363+0000 7fc378c00640 1 -- 172.21.15.17:0/4292146845 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc36c099020 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.535+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc37c0b6b70 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.535+0000 7fc378c00640 1 -- 172.21.15.17:0/4292146845 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) ==== 74+0+16952 (secure 0 0 0) 0x7fc36c05ec00 con 0x7fc37c0b2fc0 2024-09-10T23:31:37.539 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:37.539 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":212,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:20.076985+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:16.186449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"211","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:17.438325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:37.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3580725e0 msgr2=0x7fc358074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3580725e0 0x7fc358074aa0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0ced80 tx=0x7fc364001420 comp rx=0 tx=0).stop 2024-09-10T23:31:37.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc37c0b2fc0 msgr2=0x7fc37c0cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc37c0b2fc0 0x7fc37c0cde10 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00ea10 tx=0x7fc36c00eed0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 shutdown_connections 2024-09-10T23:31:37.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc3580725e0 0x7fc358074aa0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc37c15fc90 0x7fc37c0b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc37c0cfb70 0x7fc37c0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 --2- 172.21.15.17:0/4292146845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc37c0b2fc0 0x7fc37c0cde10 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 >> 172.21.15.17:0/4292146845 conn(0x7fc37c0d1d40 msgr2=0x7fc37c070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:37.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 shutdown_connections 2024-09-10T23:31:37.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.539+0000 7fc383000640 1 -- 172.21.15.17:0/4292146845 wait complete. 2024-09-10T23:31:37.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:31:37.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 -- 172.21.15.17:0/664706083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1d40d0180 msgr2=0x7fd1d415f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 --2- 172.21.15.17:0/664706083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1d40d0180 0x7fd1d415f9c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009840 tx=0x7fd1c001c820 comp rx=0 tx=0).stop 2024-09-10T23:31:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 -- 172.21.15.17:0/664706083 shutdown_connections 2024-09-10T23:31:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 --2- 172.21.15.17:0/664706083 >> v2:172.21.15.77:3300/0 conn(0x7fd1d415ff00 0x7fd1d406e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 --2- 172.21.15.17:0/664706083 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1d40d0180 0x7fd1d415f9c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 -- 172.21.15.17:0/664706083 >> 172.21.15.17:0/664706083 conn(0x7fd1d40b1850 msgr2=0x7fd1d40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 -- 172.21.15.17:0/664706083 shutdown_connections 2024-09-10T23:31:37.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 -- 172.21.15.17:0/664706083 wait complete. 2024-09-10T23:31:37.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 Processor -- start 2024-09-10T23:31:37.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 -- start start 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1d40d0180 0x7fd1d4155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4145570 0x7fd1d4165eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1d415ff00 0x7fd1d41433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d4168d10 con 0x7fd1d415ff00 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d4168b90 con 0x7fd1d4145570 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.707+0000 7fd1db800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d4168e90 con 0x7fd1d40d0180 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1d415ff00 0x7fd1d41433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1d415ff00 0x7fd1d41433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57112/0 (socket says 172.21.15.17:57112) 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d9800640 1 -- 172.21.15.17:0/3599469652 learned_addr learned my addr 172.21.15.17:0/3599469652 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d9800640 1 -- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1d40d0180 msgr2=0x7fd1d4155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d9800640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1d40d0180 0x7fd1d4155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d9800640 1 -- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4145570 msgr2=0x7fd1d4165eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d3e00640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4145570 0x7fd1d4165eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d9800640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4145570 0x7fd1d4165eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d9800640 1 -- 172.21.15.17:0/3599469652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d41309b0 con 0x7fd1d415ff00 2024-09-10T23:31:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d3e00640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4145570 0x7fd1d4165eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:37.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d9800640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1d415ff00 0x7fd1d41433c0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00eab0 tx=0x7fd1cc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d0c00640 1 -- 172.21.15.17:0/3599469652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00cea0 con 0x7fd1d415ff00 2024-09-10T23:31:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d0c00640 1 -- 172.21.15.17:0/3599469652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1cc004b30 con 0x7fd1d415ff00 2024-09-10T23:31:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d4130c90 con 0x7fd1d415ff00 2024-09-10T23:31:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d0c00640 1 -- 172.21.15.17:0/3599469652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc005020 con 0x7fd1d415ff00 2024-09-10T23:31:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d4131250 con 0x7fd1d415ff00 2024-09-10T23:31:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d4075ad0 con 0x7fd1d415ff00 2024-09-10T23:31:37.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.711+0000 7fd1d0c00640 1 -- 172.21.15.17:0/3599469652 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd1cc0051c0 con 0x7fd1d415ff00 2024-09-10T23:31:37.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.715+0000 7fd1d0c00640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1b40725e0 0x7fd1b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:37.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.715+0000 7fd1d0c00640 1 -- 172.21.15.17:0/3599469652 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 6101+0+0 (secure 0 0 0) 0x7fd1cc094160 con 0x7fd1d415ff00 2024-09-10T23:31:37.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.715+0000 7fd1d8e00640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1b40725e0 0x7fd1b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:37.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.715+0000 7fd1d8e00640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1b40725e0 0x7fd1b4074aa0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80046c0 tx=0x7fd1c80078b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:37.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.719+0000 7fd1d0c00640 1 -- 172.21.15.17:0/3599469652 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd1cc05f620 con 0x7fd1d415ff00 2024-09-10T23:31:37.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.927+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd1d4072be0 con 0x7fd1d415ff00 2024-09-10T23:31:37.929 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:31:37.927+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:31:37.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.927+0000 7fd1d0c00640 1 -- 172.21.15.17:0/3599469652 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v162) ==== 161+0+0 (secure 0 0 0) 0x7fd1d4072be0 con 0x7fd1d415ff00 2024-09-10T23:31:37.931 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:31:37.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1b40725e0 msgr2=0x7fd1b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1b40725e0 0x7fd1b4074aa0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80046c0 tx=0x7fd1c80078b0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1d415ff00 msgr2=0x7fd1d41433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:37.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1d415ff00 0x7fd1d41433c0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00eab0 tx=0x7fd1cc00ef70 comp rx=0 tx=0).stop 2024-09-10T23:31:37.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 shutdown_connections 2024-09-10T23:31:37.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd1b40725e0 0x7fd1b4074aa0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1d415ff00 0x7fd1d41433c0 unknown :-1 s=CLOSED pgs=2493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4145570 0x7fd1d4165eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 --2- 172.21.15.17:0/3599469652 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd1d40d0180 0x7fd1d4155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:37.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 >> 172.21.15.17:0/3599469652 conn(0x7fd1d40b1850 msgr2=0x7fd1d40730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:37.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 shutdown_connections 2024-09-10T23:31:37.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:37.931+0000 7fd1db800640 1 -- 172.21.15.17:0/3599469652 wait complete. 2024-09-10T23:31:37.953 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:31:38.002 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:31:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.103+0000 7fac13e00640 1 -- 172.21.15.17:0/3569266308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac140b4ea0 msgr2=0x7fac1415b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.103+0000 7fac13e00640 1 --2- 172.21.15.17:0/3569266308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac140b4ea0 0x7fac1415b1b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fac0400a950 tx=0x7fac04020360 comp rx=0 tx=0).stop 2024-09-10T23:31:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.103+0000 7fac13e00640 1 -- 172.21.15.17:0/3569266308 shutdown_connections 2024-09-10T23:31:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.103+0000 7fac13e00640 1 --2- 172.21.15.17:0/3569266308 >> v2:172.21.15.77:3300/0 conn(0x7fac140b5280 0x7fac1406f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.103+0000 7fac13e00640 1 --2- 172.21.15.17:0/3569266308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac140b4ea0 0x7fac1415b1b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:38.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.103+0000 7fac13e00640 1 -- 172.21.15.17:0/3569266308 >> 172.21.15.17:0/3569266308 conn(0x7fac140b2310 msgr2=0x7fac140b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:38.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.103+0000 7fac13e00640 1 -- 172.21.15.17:0/3569266308 shutdown_connections 2024-09-10T23:31:38.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.103+0000 7fac13e00640 1 -- 172.21.15.17:0/3569266308 wait complete. 2024-09-10T23:31:38.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 Processor -- start 2024-09-10T23:31:38.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 -- start start 2024-09-10T23:31:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac140b32f0 0x7fac14157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac140b4ea0 0x7fac14156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac140b5280 0x7fac141585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fac14069330 con 0x7fac140b32f0 2024-09-10T23:31:38.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac140691b0 con 0x7fac140b4ea0 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fac140694b0 con 0x7fac140b5280 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac140b32f0 0x7fac14157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac140b32f0 0x7fac14157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57116/0 (socket says 172.21.15.17:57116) 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12a00640 1 -- 172.21.15.17:0/4087071556 learned_addr learned my addr 172.21.15.17:0/4087071556 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13400640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac140b5280 0x7fac141585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12000640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac140b4ea0 0x7fac14156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12a00640 1 -- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac140b5280 msgr2=0x7fac141585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12a00640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac140b5280 0x7fac141585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12a00640 1 -- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac140b4ea0 msgr2=0x7fac14156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12a00640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac140b4ea0 0x7fac14156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12a00640 1 -- 172.21.15.17:0/4087071556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac14156ce0 con 0x7fac140b32f0 2024-09-10T23:31:38.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac12a00640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac140b32f0 0x7fac14157d80 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7fac0401ea10 tx=0x7fac04005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac0b400640 1 -- 172.21.15.17:0/4087071556 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac040b5070 con 0x7fac140b32f0 2024-09-10T23:31:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac0b400640 1 -- 172.21.15.17:0/4087071556 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac040b6040 con 0x7fac140b32f0 2024-09-10T23:31:38.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac0b400640 1 -- 172.21.15.17:0/4087071556 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac040b0d10 con 0x7fac140b32f0 2024-09-10T23:31:38.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac14156fc0 con 0x7fac140b32f0 2024-09-10T23:31:38.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac14157580 con 0x7fac140b32f0 2024-09-10T23:31:38.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.107+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1415b1b0 con 0x7fac140b32f0 2024-09-10T23:31:38.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.111+0000 7fac0b400640 1 -- 172.21.15.17:0/4087071556 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fac0400b040 con 0x7fac140b32f0 2024-09-10T23:31:38.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.111+0000 7fac0b400640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fabf40725e0 0x7fabf4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:38.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.111+0000 7fac0b400640 1 -- 172.21.15.17:0/4087071556 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 6187+0+0 (secure 0 0 0) 0x7fac04130d50 con 0x7fac140b32f0 2024-09-10T23:31:38.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.111+0000 7fac12000640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fabf40725e0 0x7fabf4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:38.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.111+0000 7fac12000640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fabf40725e0 0x7fabf4074aa0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fac14158fd0 tx=0x7fac00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:38.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.115+0000 7fac0b400640 1 -- 172.21.15.17:0/4087071556 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fac040c8020 con 0x7fac140b32f0 2024-09-10T23:31:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.323+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fac14150b80 con 0x7fac140b32f0 2024-09-10T23:31:38.810 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:31:38.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:31:38.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.935+0000 7fac0b400640 1 -- 172.21.15.17:0/4087071556 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v163) ==== 104+0+0 (secure 0 0 0) 0x7fac04019ec0 con 0x7fac140b32f0 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fabf40725e0 msgr2=0x7fabf4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fabf40725e0 0x7fabf4074aa0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fac14158fd0 tx=0x7fac00009040 comp rx=0 tx=0).stop 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac140b32f0 msgr2=0x7fac14157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac140b32f0 0x7fac14157d80 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7fac0401ea10 tx=0x7fac04005dd0 comp rx=0 tx=0).stop 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 shutdown_connections 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fabf40725e0 0x7fabf4074aa0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac140b5280 0x7fac141585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac140b4ea0 0x7fac14156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 --2- 172.21.15.17:0/4087071556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac140b32f0 0x7fac14157d80 unknown :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:38.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 >> 172.21.15.17:0/4087071556 conn(0x7fac140b2310 msgr2=0x7fac140cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 shutdown_connections 2024-09-10T23:31:38.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:38.939+0000 7fac13e00640 1 -- 172.21.15.17:0/4087071556 wait complete. 2024-09-10T23:31:38.962 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:31:39.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.111+0000 7f2f15200640 1 -- 172.21.15.17:0/2420905885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100703e0 msgr2=0x7f2f100ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:39.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.111+0000 7f2f15200640 1 --2- 172.21.15.17:0/2420905885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100703e0 0x7f2f100ca4d0 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009840 tx=0x7f2f100cb930 comp rx=0 tx=0).stop 2024-09-10T23:31:39.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 -- 172.21.15.17:0/2420905885 shutdown_connections 2024-09-10T23:31:39.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 --2- 172.21.15.17:0/2420905885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f100703e0 0x7f2f100ca4d0 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:39.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 -- 172.21.15.17:0/2420905885 >> 172.21.15.17:0/2420905885 conn(0x7f2f100cc590 msgr2=0x7f2f100cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:39.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 -- 172.21.15.17:0/2420905885 shutdown_connections 2024-09-10T23:31:39.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 -- 172.21.15.17:0/2420905885 wait complete. 2024-09-10T23:31:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 Processor -- start 2024-09-10T23:31:39.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 -- start start 2024-09-10T23:31:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f100c9b30 0x7f2f10152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015bbc0 0x7f2f100ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f1014e910 0x7f2f10140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1016a5f0 con 0x7f2f1015bbc0 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1016a470 con 0x7f2f1014e910 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f15200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1016a770 con 0x7f2f100c9b30 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015bbc0 0x7f2f100ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015bbc0 0x7f2f100ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57128/0 (socket says 172.21.15.17:57128) 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f07e00640 1 -- 172.21.15.17:0/1419062678 learned_addr learned my addr 172.21.15.17:0/1419062678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f0de00640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f100c9b30 0x7f2f10152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f0e800640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f1014e910 0x7f2f10140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f07e00640 1 -- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f100c9b30 msgr2=0x7f2f10152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f07e00640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f100c9b30 0x7f2f10152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:39.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f07e00640 1 -- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f1014e910 msgr2=0x7f2f10140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:39.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f07e00640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f1014e910 0x7f2f10140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:39.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f07e00640 1 -- 172.21.15.17:0/1419062678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f101553c0 con 0x7f2f1015bbc0 2024-09-10T23:31:39.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.115+0000 7f2f07e00640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015bbc0 0x7f2f100ce3f0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8000c10 tx=0x7f2ef80a8590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:39.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f06000640 1 -- 172.21.15.17:0/1419062678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8005030 con 0x7f2f1015bbc0 2024-09-10T23:31:39.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f06000640 1 -- 172.21.15.17:0/1419062678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ef80051d0 con 0x7f2f1015bbc0 2024-09-10T23:31:39.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f101556a0 con 0x7f2f1015bbc0 2024-09-10T23:31:39.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f06000640 1 -- 172.21.15.17:0/1419062678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef80055c0 con 0x7f2f1015bbc0 2024-09-10T23:31:39.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f10140550 con 0x7f2f1015bbc0 2024-09-10T23:31:39.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f101558e0 con 0x7f2f1015bbc0 2024-09-10T23:31:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f06000640 1 -- 172.21.15.17:0/1419062678 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2ef80046d0 con 0x7f2f1015bbc0 2024-09-10T23:31:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f06000640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2eec0725e0 0x7f2eec074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f06000640 1 -- 172.21.15.17:0/1419062678 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 6187+0+0 (secure 0 0 0) 0x7f2ef812d860 con 0x7f2f1015bbc0 2024-09-10T23:31:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.119+0000 7f2f0de00640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2eec0725e0 0x7f2eec074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.123+0000 7f2f0de00640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2eec0725e0 0x7f2eec074aa0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2f000098e0 tx=0x7f2f00009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:39.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.123+0000 7f2f06000640 1 -- 172.21.15.17:0/1419062678 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2f101558e0 con 0x7f2f1015bbc0 2024-09-10T23:31:39.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.299+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2f10073e90 con 0x7f2f1015bbc0 2024-09-10T23:31:39.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.939+0000 7f2f06000640 1 -- 172.21.15.17:0/1419062678 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v214) ==== 181+0+0 (secure 0 0 0) 0x7f2ef80ac030 con 0x7f2f1015bbc0 2024-09-10T23:31:39.941 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:31:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2eec0725e0 msgr2=0x7f2eec074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2eec0725e0 0x7f2eec074aa0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2f000098e0 tx=0x7f2f00009060 comp rx=0 tx=0).stop 2024-09-10T23:31:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015bbc0 msgr2=0x7f2f100ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015bbc0 0x7f2f100ce3f0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8000c10 tx=0x7f2ef80a8590 comp rx=0 tx=0).stop 2024-09-10T23:31:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 shutdown_connections 2024-09-10T23:31:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2eec0725e0 0x7f2eec074aa0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:39.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f1014e910 0x7f2f10140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:39.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f1015bbc0 0x7f2f100ce3f0 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:39.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 --2- 172.21.15.17:0/1419062678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f100c9b30 0x7f2f10152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:39.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 >> 172.21.15.17:0/1419062678 conn(0x7f2f100cc590 msgr2=0x7f2f1006e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:39.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 shutdown_connections 2024-09-10T23:31:39.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:39.943+0000 7f2f15200640 1 -- 172.21.15.17:0/1419062678 wait complete. 2024-09-10T23:31:39.967 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:31:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.115+0000 7fe9af800640 1 -- 172.21.15.17:0/2566454398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 msgr2=0x7fe9a815ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.115+0000 7fe9af800640 1 --2- 172.21.15.17:0/2566454398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 0x7fe9a815ade0 secure :-1 s=READY pgs=2499 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000ad90 tx=0x7fe9a001dc20 comp rx=0 tx=0).stop 2024-09-10T23:31:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.115+0000 7fe9af800640 1 -- 172.21.15.17:0/2566454398 shutdown_connections 2024-09-10T23:31:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.115+0000 7fe9af800640 1 --2- 172.21.15.17:0/2566454398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 0x7fe9a815ade0 unknown :-1 s=CLOSED pgs=2499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.115+0000 7fe9af800640 1 --2- 172.21.15.17:0/2566454398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9a813d0b0 0x7fe9a813d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.115+0000 7fe9af800640 1 -- 172.21.15.17:0/2566454398 >> 172.21.15.17:0/2566454398 conn(0x7fe9a80cc590 msgr2=0x7fe9a80cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:40.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.115+0000 7fe9af800640 1 -- 172.21.15.17:0/2566454398 shutdown_connections 2024-09-10T23:31:40.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.115+0000 7fe9af800640 1 -- 172.21.15.17:0/2566454398 wait complete. 2024-09-10T23:31:40.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 Processor -- start 2024-09-10T23:31:40.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 -- start start 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9a80ca160 0x7fe9a813b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a813d0b0 0x7fe9a80b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 0x7fe9a80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a80706c0 con 0x7fe9a815a980 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a8070540 con 0x7fe9a813d0b0 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a8070840 con 0x7fe9a80ca160 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ad800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 0x7fe9a80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ad800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 0x7fe9a80b4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57146/0 (socket says 172.21.15.17:57146) 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ad800640 1 -- 172.21.15.17:0/1596862016 learned_addr learned my addr 172.21.15.17:0/1596862016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ace00640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9a80ca160 0x7fe9a813b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:40.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9a7e00640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a813d0b0 0x7fe9a80b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ad800640 1 -- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9a80ca160 msgr2=0x7fe9a813b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ad800640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9a80ca160 0x7fe9a813b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ad800640 1 -- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a813d0b0 msgr2=0x7fe9a80b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ad800640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a813d0b0 0x7fe9a80b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ad800640 1 -- 172.21.15.17:0/1596862016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a80b3430 con 0x7fe9a815a980 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9a7e00640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a813d0b0 0x7fe9a80b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ace00640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9a80ca160 0x7fe9a813b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9ad800640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 0x7fe9a80b4f60 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7fe9a001da50 tx=0x7fe9a0003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9a4c00640 1 -- 172.21.15.17:0/1596862016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a00b3040 con 0x7fe9a815a980 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9a4c00640 1 -- 172.21.15.17:0/1596862016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a00044b0 con 0x7fe9a815a980 2024-09-10T23:31:40.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9a4c00640 1 -- 172.21.15.17:0/1596862016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a00ae440 con 0x7fe9a815a980 2024-09-10T23:31:40.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a80b3710 con 0x7fe9a815a980 2024-09-10T23:31:40.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.119+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a80b3cd0 con 0x7fe9a815a980 2024-09-10T23:31:40.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.123+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a813d810 con 0x7fe9a815a980 2024-09-10T23:31:40.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.123+0000 7fe9a4c00640 1 -- 172.21.15.17:0/1596862016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe9a00ae5e0 con 0x7fe9a815a980 2024-09-10T23:31:40.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.123+0000 7fe9a4c00640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9880725e0 0x7fe988074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:40.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.123+0000 7fe9a4c00640 1 -- 172.21.15.17:0/1596862016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5749+0+0 (secure 0 0 0) 0x7fe9a012d8f0 con 0x7fe9a815a980 2024-09-10T23:31:40.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.123+0000 7fe9ace00640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9880725e0 0x7fe988074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:40.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.127+0000 7fe9ace00640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9880725e0 0x7fe988074aa0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00a8b0 tx=0x7fe99c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:40.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.127+0000 7fe9a4c00640 1 -- 172.21.15.17:0/1596862016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe9a00178a0 con 0x7fe9a815a980 2024-09-10T23:31:40.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.303+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe9a815d370 con 0x7fe9a815a980 2024-09-10T23:31:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.943+0000 7fe9a4c00640 1 -- 172.21.15.17:0/1596862016 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v215) ==== 169+0+0 (secure 0 0 0) 0x7fe9a00f8f00 con 0x7fe9a815a980 2024-09-10T23:31:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:31:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.947+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9880725e0 msgr2=0x7fe988074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9880725e0 0x7fe988074aa0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00a8b0 tx=0x7fe99c008040 comp rx=0 tx=0).stop 2024-09-10T23:31:40.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 msgr2=0x7fe9a80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 0x7fe9a80b4f60 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7fe9a001da50 tx=0x7fe9a0003f60 comp rx=0 tx=0).stop 2024-09-10T23:31:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 shutdown_connections 2024-09-10T23:31:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe9880725e0 0x7fe988074aa0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a815a980 0x7fe9a80b4f60 unknown :-1 s=CLOSED pgs=2500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9a813d0b0 0x7fe9a80b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 --2- 172.21.15.17:0/1596862016 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe9a80ca160 0x7fe9a813b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 >> 172.21.15.17:0/1596862016 conn(0x7fe9a80cc590 msgr2=0x7fe9a815b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 shutdown_connections 2024-09-10T23:31:40.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:40.951+0000 7fe9af800640 1 -- 172.21.15.17:0/1596862016 wait complete. 2024-09-10T23:31:40.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:31:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 -- 172.21.15.17:0/2491635821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc0cfb90 msgr2=0x7f58bc15fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 --2- 172.21.15.17:0/2491635821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc0cfb90 0x7f58bc15fe30 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0b3760 tx=0x7f58a401c810 comp rx=0 tx=0).stop 2024-09-10T23:31:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 -- 172.21.15.17:0/2491635821 shutdown_connections 2024-09-10T23:31:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 --2- 172.21.15.17:0/2491635821 >> v2:172.21.15.77:3300/0 conn(0x7f58bc160370 0x7f58bc1607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 --2- 172.21.15.17:0/2491635821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc0cfb90 0x7f58bc15fe30 unknown :-1 s=CLOSED pgs=2501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 --2- 172.21.15.17:0/2491635821 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58bc0ce680 0x7f58bc0cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 -- 172.21.15.17:0/2491635821 >> 172.21.15.17:0/2491635821 conn(0x7f58bc0d1db0 msgr2=0x7f58bc0d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 -- 172.21.15.17:0/2491635821 shutdown_connections 2024-09-10T23:31:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 -- 172.21.15.17:0/2491635821 wait complete. 2024-09-10T23:31:41.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 Processor -- start 2024-09-10T23:31:41.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 -- start start 2024-09-10T23:31:41.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58bc0ce680 0x7f58bc0b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:41.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58bc0cfb90 0x7f58bc15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:41.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc160370 0x7f58bc0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:41.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc0cd540 con 0x7f58bc160370 2024-09-10T23:31:41.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc0cd3c0 con 0x7f58bc0ce680 2024-09-10T23:31:41.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.127+0000 7f58c2000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f58bc0b1730 con 0x7f58bc0cfb90 2024-09-10T23:31:41.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc160370 0x7f58bc0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:41.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc160370 0x7f58bc0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57162/0 (socket says 172.21.15.17:57162) 2024-09-10T23:31:41.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bbe00640 1 -- 172.21.15.17:0/3786739345 learned_addr learned my addr 172.21.15.17:0/3786739345 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:41.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bb400640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58bc0ce680 0x7f58bc0b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58b3e00640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58bc0cfb90 0x7f58bc15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bbe00640 1 -- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58bc0cfb90 msgr2=0x7f58bc15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bbe00640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58bc0cfb90 0x7f58bc15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bbe00640 1 -- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58bc0ce680 msgr2=0x7f58bc0b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bbe00640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58bc0ce680 0x7f58bc0b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bbe00640 1 -- 172.21.15.17:0/3786739345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc0b5fa0 con 0x7f58bc160370 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58bbe00640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc160370 0x7f58bc0b1c00 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f58b400cce0 tx=0x7f58b400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58b3400640 1 -- 172.21.15.17:0/3786739345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b400f450 con 0x7f58bc160370 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58b3400640 1 -- 172.21.15.17:0/3786739345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58b400f6e0 con 0x7f58bc160370 2024-09-10T23:31:41.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58bc0b25e0 con 0x7f58bc160370 2024-09-10T23:31:41.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58b3400640 1 -- 172.21.15.17:0/3786739345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b400fb30 con 0x7f58bc160370 2024-09-10T23:31:41.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58bc0b2ba0 con 0x7f58bc160370 2024-09-10T23:31:41.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58bc15fe30 con 0x7f58bc160370 2024-09-10T23:31:41.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.131+0000 7f58b3400640 1 -- 172.21.15.17:0/3786739345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f58b400fcd0 con 0x7f58bc160370 2024-09-10T23:31:41.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.135+0000 7f58b3400640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58980725e0 0x7f5898074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:41.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.135+0000 7f58b3400640 1 -- 172.21.15.17:0/3786739345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5335+0+0 (secure 0 0 0) 0x7f58b4093b10 con 0x7f58bc160370 2024-09-10T23:31:41.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.135+0000 7f58bb400640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58980725e0 0x7f5898074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:41.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.135+0000 7f58bb400640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58980725e0 0x7f5898074aa0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f58ac004630 tx=0x7f58ac00b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:41.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.139+0000 7f58b3400640 1 -- 172.21.15.17:0/3786739345 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f58b4014030 con 0x7f58bc160370 2024-09-10T23:31:41.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.323+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f58bc0d12d0 con 0x7f58bc160370 2024-09-10T23:31:41.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58b3400640 1 -- 172.21.15.17:0/3786739345 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v63) ==== 71+0+0 (secure 0 0 0) 0x7f58b405ed00 con 0x7f58bc160370 2024-09-10T23:31:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58980725e0 msgr2=0x7f5898074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58980725e0 0x7f5898074aa0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f58ac004630 tx=0x7f58ac00b2e0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc160370 msgr2=0x7f58bc0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc160370 0x7f58bc0b1c00 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7f58b400cce0 tx=0x7f58b400a620 comp rx=0 tx=0).stop 2024-09-10T23:31:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 shutdown_connections 2024-09-10T23:31:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f58980725e0 0x7f5898074aa0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58bc160370 0x7f58bc0b1c00 unknown :-1 s=CLOSED pgs=2502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f58bc0cfb90 0x7f58bc15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 --2- 172.21.15.17:0/3786739345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58bc0ce680 0x7f58bc0b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.327+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 >> 172.21.15.17:0/3786739345 conn(0x7f58bc0d1db0 msgr2=0x7f58bc070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.331+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 shutdown_connections 2024-09-10T23:31:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.331+0000 7f58c2000640 1 -- 172.21.15.17:0/3786739345 wait complete. 2024-09-10T23:31:41.349 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-09-10T23:31:41.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.491+0000 7fd61ac00640 1 -- 172.21.15.17:0/4228953537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 msgr2=0x7fd614072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.491+0000 7fd61ac00640 1 --2- 172.21.15.17:0/4228953537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 0x7fd614072800 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7fd604009900 tx=0x7fd60401c8a0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 -- 172.21.15.17:0/4228953537 shutdown_connections 2024-09-10T23:31:41.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 --2- 172.21.15.17:0/4228953537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6140cf180 0x7fd6140cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 --2- 172.21.15.17:0/4228953537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 0x7fd614072800 unknown :-1 s=CLOSED pgs=2503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 -- 172.21.15.17:0/4228953537 >> 172.21.15.17:0/4228953537 conn(0x7fd6140b1850 msgr2=0x7fd6140b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 -- 172.21.15.17:0/4228953537 shutdown_connections 2024-09-10T23:31:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 -- 172.21.15.17:0/4228953537 wait complete. 2024-09-10T23:31:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 Processor -- start 2024-09-10T23:31:41.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 -- start start 2024-09-10T23:31:41.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 0x7fd614146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd61406fd10 0x7fd614159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6140cf180 0x7fd614159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd614167b00 con 0x7fd61406f930 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd614167980 con 0x7fd6140cf180 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd61ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd614167c80 con 0x7fd61406fd10 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd613e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 0x7fd614146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd613e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 0x7fd614146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57192/0 (socket says 172.21.15.17:57192) 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd613e00640 1 -- 172.21.15.17:0/1977494866 learned_addr learned my addr 172.21.15.17:0/1977494866 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd60be00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd61406fd10 0x7fd614159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd618c00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6140cf180 0x7fd614159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd613e00640 1 -- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd61406fd10 msgr2=0x7fd614159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd613e00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd61406fd10 0x7fd614159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd613e00640 1 -- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6140cf180 msgr2=0x7fd614159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd613e00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6140cf180 0x7fd614159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd613e00640 1 -- 172.21.15.17:0/1977494866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd614153170 con 0x7fd61406f930 2024-09-10T23:31:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd613e00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 0x7fd614146510 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fd6040b0040 tx=0x7fd6040a55e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.495+0000 7fd610c00640 1 -- 172.21.15.17:0/1977494866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6040b2040 con 0x7fd61406f930 2024-09-10T23:31:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.499+0000 7fd610c00640 1 -- 172.21.15.17:0/1977494866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd604004470 con 0x7fd61406f930 2024-09-10T23:31:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.499+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd614153450 con 0x7fd61406f930 2024-09-10T23:31:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.499+0000 7fd610c00640 1 -- 172.21.15.17:0/1977494866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604005290 con 0x7fd61406f930 2024-09-10T23:31:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.499+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd614153a10 con 0x7fd61406f930 2024-09-10T23:31:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.499+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd614075ad0 con 0x7fd61406f930 2024-09-10T23:31:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.499+0000 7fd610c00640 1 -- 172.21.15.17:0/1977494866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd604005430 con 0x7fd61406f930 2024-09-10T23:31:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.499+0000 7fd610c00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5f0072610 0x7fd5f0074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.499+0000 7fd610c00640 1 -- 172.21.15.17:0/1977494866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5335+0+0 (secure 0 0 0) 0x7fd60412c730 con 0x7fd61406f930 2024-09-10T23:31:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.499+0000 7fd60be00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5f0072610 0x7fd5f0074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.503+0000 7fd60be00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5f0072610 0x7fd5f0074ad0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd61415abd0 tx=0x7fd5fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.503+0000 7fd610c00640 1 -- 172.21.15.17:0/1977494866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd604016490 con 0x7fd61406f930 2024-09-10T23:31:41.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.751+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) -- 0x7fd614072800 con 0x7fd61406f930 2024-09-10T23:31:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.947+0000 7fd610c00640 1 -- 172.21.15.17:0/1977494866 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v745) ==== 147+0+0 (secure 0 0 0) 0x7fd6040f7f90 con 0x7fd61406f930 2024-09-10T23:31:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5f0072610 msgr2=0x7fd5f0074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5f0072610 0x7fd5f0074ad0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd61415abd0 tx=0x7fd5fc009040 comp rx=0 tx=0).stop 2024-09-10T23:31:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 msgr2=0x7fd614146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:41.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 0x7fd614146510 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fd6040b0040 tx=0x7fd6040a55e0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 shutdown_connections 2024-09-10T23:31:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd5f0072610 0x7fd5f0074ad0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6140cf180 0x7fd614159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd61406fd10 0x7fd614159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 --2- 172.21.15.17:0/1977494866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd61406f930 0x7fd614146510 unknown :-1 s=CLOSED pgs=2504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 >> 172.21.15.17:0/1977494866 conn(0x7fd6140b1850 msgr2=0x7fd614151260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 shutdown_connections 2024-09-10T23:31:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:41.951+0000 7fd61ac00640 1 -- 172.21.15.17:0/1977494866 wait complete. 2024-09-10T23:31:41.973 INFO:tasks.cephfs_test_runner:test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-10T23:31:41.973 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T23:31:41.973 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 -- 172.21.15.17:0/2154877539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f163006fc50 msgr2=0x7f163015b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 --2- 172.21.15.17:0/2154877539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f163006fc50 0x7f163015b2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1624009840 tx=0x7f162401c820 comp rx=0 tx=0).stop 2024-09-10T23:31:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 -- 172.21.15.17:0/2154877539 shutdown_connections 2024-09-10T23:31:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 --2- 172.21.15.17:0/2154877539 >> v2:172.21.15.77:3300/0 conn(0x7f1630070030 0x7f16300cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 --2- 172.21.15.17:0/2154877539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f163006fc50 0x7f163015b2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 -- 172.21.15.17:0/2154877539 >> 172.21.15.17:0/2154877539 conn(0x7f16300b1850 msgr2=0x7f16300b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 -- 172.21.15.17:0/2154877539 shutdown_connections 2024-09-10T23:31:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 -- 172.21.15.17:0/2154877539 wait complete. 2024-09-10T23:31:42.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 Processor -- start 2024-09-10T23:31:42.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 -- start start 2024-09-10T23:31:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.119+0000 7f1637e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f163006fc50 0x7f16300cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1637e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630070030 0x7f1630155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1637e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16300745e0 0x7f16300aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1637e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1630167800 con 0x7f16300745e0 2024-09-10T23:31:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1637e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1630167680 con 0x7f1630070030 2024-09-10T23:31:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1637e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1630167980 con 0x7f163006fc50 2024-09-10T23:31:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16300745e0 0x7f16300aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f163006fc50 0x7f16300cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16300745e0 0x7f16300aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57196/0 (socket says 172.21.15.17:57196) 2024-09-10T23:31:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635e00640 1 -- 172.21.15.17:0/1365208262 learned_addr learned my addr 172.21.15.17:0/1365208262 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1634a00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630070030 0x7f1630155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635e00640 1 -- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f163006fc50 msgr2=0x7f16300cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635e00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f163006fc50 0x7f16300cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635e00640 1 -- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630070030 msgr2=0x7f1630155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635e00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630070030 0x7f1630155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635e00640 1 -- 172.21.15.17:0/1365208262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1630156a40 con 0x7f16300745e0 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1635e00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16300745e0 0x7f16300aeaf0 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f1628009f90 tx=0x7f162800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f162d600640 1 -- 172.21.15.17:0/1365208262 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628003980 con 0x7f16300745e0 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f162d600640 1 -- 172.21.15.17:0/1365208262 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1628003c30 con 0x7f16300745e0 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f162d600640 1 -- 172.21.15.17:0/1365208262 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628004280 con 0x7f16300745e0 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1630156d20 con 0x7f16300745e0 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f163013c230 con 0x7f16300745e0 2024-09-10T23:31:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.123+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1630075ad0 con 0x7f16300745e0 2024-09-10T23:31:42.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.127+0000 7f162d600640 1 -- 172.21.15.17:0/1365208262 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f162800b040 con 0x7f16300745e0 2024-09-10T23:31:42.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.127+0000 7f162d600640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16100725e0 0x7f1610074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.127+0000 7f162d600640 1 -- 172.21.15.17:0/1365208262 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5335+0+0 (secure 0 0 0) 0x7f1628093600 con 0x7f16300745e0 2024-09-10T23:31:42.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.127+0000 7f1635400640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16100725e0 0x7f1610074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.127+0000 7f1635400640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16100725e0 0x7f1610074aa0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f16240af000 tx=0x7f162401b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.131+0000 7f162d600640 1 -- 172.21.15.17:0/1365208262 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f162805e7f0 con 0x7f16300745e0 2024-09-10T23:31:42.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.303+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f163015b2f0 con 0x7f16300745e0 2024-09-10T23:31:42.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.303+0000 7f162d600640 1 -- 172.21.15.17:0/1365208262 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v215) ==== 74+0+13251 (secure 0 0 0) 0x7f1628063220 con 0x7f16300745e0 2024-09-10T23:31:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:42.307 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":215,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:40.942522+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6836/20480727":"2024-09-11T23:31:37.929735+0000","172.21.15.77:6834/20480727":"2024-09-11T23:31:37.929735+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16100725e0 msgr2=0x7f1610074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16100725e0 0x7f1610074aa0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f16240af000 tx=0x7f162401b060 comp rx=0 tx=0).stop 2024-09-10T23:31:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16300745e0 msgr2=0x7f16300aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16300745e0 0x7f16300aeaf0 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f1628009f90 tx=0x7f162800c800 comp rx=0 tx=0).stop 2024-09-10T23:31:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 shutdown_connections 2024-09-10T23:31:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f16100725e0 0x7f1610074aa0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16300745e0 0x7f16300aeaf0 unknown :-1 s=CLOSED pgs=2505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630070030 0x7f1630155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 --2- 172.21.15.17:0/1365208262 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f163006fc50 0x7f16300cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 >> 172.21.15.17:0/1365208262 conn(0x7f16300b1850 msgr2=0x7f16301546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 shutdown_connections 2024-09-10T23:31:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.307+0000 7f1637e00640 1 -- 172.21.15.17:0/1365208262 wait complete. 2024-09-10T23:31:42.328 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T23:15:26.315157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T23:31:42.328 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T23:31:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.475+0000 7f4093200640 1 -- 172.21.15.17:0/3389499903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c15bf10 msgr2=0x7f408c0b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.475+0000 7f4093200640 1 --2- 172.21.15.17:0/3389499903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c15bf10 0x7f408c0b1450 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7f408c0b8070 tx=0x7f407c01c800 comp rx=0 tx=0).stop 2024-09-10T23:31:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.475+0000 7f4093200640 1 -- 172.21.15.17:0/3389499903 shutdown_connections 2024-09-10T23:31:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.475+0000 7f4093200640 1 --2- 172.21.15.17:0/3389499903 >> v2:172.21.15.77:3300/0 conn(0x7f408c0d2ae0 0x7f408c0d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.475+0000 7f4093200640 1 --2- 172.21.15.17:0/3389499903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c15bf10 0x7f408c0b1450 unknown :-1 s=CLOSED pgs=2507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.475+0000 7f4093200640 1 -- 172.21.15.17:0/3389499903 >> 172.21.15.17:0/3389499903 conn(0x7f408c0d1fc0 msgr2=0x7f408c0d23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.475+0000 7f4093200640 1 -- 172.21.15.17:0/3389499903 shutdown_connections 2024-09-10T23:31:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.475+0000 7f4093200640 1 -- 172.21.15.17:0/3389499903 wait complete. 2024-09-10T23:31:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 Processor -- start 2024-09-10T23:31:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 -- start start 2024-09-10T23:31:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f408c0d0720 0x7f408c0ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c0d2ae0 0x7f408c151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f408c15bf10 0x7f408c0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f408c169280 con 0x7f408c0d2ae0 2024-09-10T23:31:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f408c169100 con 0x7f408c15bf10 2024-09-10T23:31:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f408c169400 con 0x7f408c0d0720 2024-09-10T23:31:42.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4083e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c0d2ae0 0x7f408c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4083e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c0d2ae0 0x7f408c151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57204/0 (socket says 172.21.15.17:57204) 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4083e00640 1 -- 172.21.15.17:0/3763930968 learned_addr learned my addr 172.21.15.17:0/3763930968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f408be00640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f408c0d0720 0x7f408c0ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4083e00640 1 -- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f408c0d0720 msgr2=0x7f408c0ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4083e00640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f408c0d0720 0x7f408c0ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4091200640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f408c15bf10 0x7f408c0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4083e00640 1 -- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f408c15bf10 msgr2=0x7f408c0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4083e00640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f408c15bf10 0x7f408c0b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4083e00640 1 -- 172.21.15.17:0/3763930968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c06e410 con 0x7f408c0d2ae0 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f408be00640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f408c0d0720 0x7f408c0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4091200640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f408c15bf10 0x7f408c0b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4083e00640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c0d2ae0 0x7f408c151120 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7f407400d950 tx=0x7f407400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:42.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4088c00640 1 -- 172.21.15.17:0/3763930968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074017070 con 0x7f408c0d2ae0 2024-09-10T23:31:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4088c00640 1 -- 172.21.15.17:0/3763930968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4074009d20 con 0x7f408c0d2ae0 2024-09-10T23:31:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4088c00640 1 -- 172.21.15.17:0/3763930968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40740106c0 con 0x7f408c0d2ae0 2024-09-10T23:31:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408c1f7b00 con 0x7f408c0d2ae0 2024-09-10T23:31:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.479+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408c1f80c0 con 0x7f408c0d2ae0 2024-09-10T23:31:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.483+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f408c0c55f0 con 0x7f408c0d2ae0 2024-09-10T23:31:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.483+0000 7f4088c00640 1 -- 172.21.15.17:0/3763930968 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4074010860 con 0x7f408c0d2ae0 2024-09-10T23:31:42.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.483+0000 7f4088c00640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f40680725e0 0x7f4068074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.483+0000 7f4088c00640 1 -- 172.21.15.17:0/3763930968 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5335+0+0 (secure 0 0 0) 0x7f4074093560 con 0x7f408c0d2ae0 2024-09-10T23:31:42.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.483+0000 7f408be00640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f40680725e0 0x7f4068074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.483+0000 7f408be00640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f40680725e0 0x7f4068074aa0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f407c0af000 tx=0x7f407c01b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:42.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.487+0000 7f4088c00640 1 -- 172.21.15.17:0/3763930968 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f407405ed10 con 0x7f408c0d2ae0 2024-09-10T23:31:42.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f408c0d01c0 con 0x7f408c0d2ae0 2024-09-10T23:31:42.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4088c00640 1 -- 172.21.15.17:0/3763930968 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v215) ==== 93+0+10 (secure 0 0 0) 0x7f407405e610 con 0x7f408c0d2ae0 2024-09-10T23:31:42.664 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-09-10T23:31:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f40680725e0 msgr2=0x7f4068074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f40680725e0 0x7f4068074aa0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f407c0af000 tx=0x7f407c01b040 comp rx=0 tx=0).stop 2024-09-10T23:31:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c0d2ae0 msgr2=0x7f408c151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c0d2ae0 0x7f408c151120 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7f407400d950 tx=0x7f407400de10 comp rx=0 tx=0).stop 2024-09-10T23:31:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 shutdown_connections 2024-09-10T23:31:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f40680725e0 0x7f4068074aa0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f408c15bf10 0x7f408c0b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f408c0d2ae0 0x7f408c151120 unknown :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 --2- 172.21.15.17:0/3763930968 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f408c0d0720 0x7f408c0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 >> 172.21.15.17:0/3763930968 conn(0x7f408c0d1fc0 msgr2=0x7f408c152820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 shutdown_connections 2024-09-10T23:31:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.663+0000 7f4093200640 1 -- 172.21.15.17:0/3763930968 wait complete. 2024-09-10T23:31:42.686 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-09-10T23:31:42.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 -- 172.21.15.17:0/2938802292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0d0600 msgr2=0x7f2cfc0af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 --2- 172.21.15.17:0/2938802292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0d0600 0x7f2cfc0af480 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009bc0 tx=0x7f2cf401cba0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 -- 172.21.15.17:0/2938802292 shutdown_connections 2024-09-10T23:31:42.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 --2- 172.21.15.17:0/2938802292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0d0600 0x7f2cfc0af480 unknown :-1 s=CLOSED pgs=2510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 --2- 172.21.15.17:0/2938802292 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cfc0cdf60 0x7f2cfc0cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 -- 172.21.15.17:0/2938802292 >> 172.21.15.17:0/2938802292 conn(0x7f2cfc0d1d40 msgr2=0x7f2cfc0d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:42.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 -- 172.21.15.17:0/2938802292 shutdown_connections 2024-09-10T23:31:42.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 -- 172.21.15.17:0/2938802292 wait complete. 2024-09-10T23:31:42.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 Processor -- start 2024-09-10T23:31:42.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.831+0000 7f2d03400640 1 -- start start 2024-09-10T23:31:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d03400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0cdf60 0x7f2cfc0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d03400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cfc0ce4b0 0x7f2cfc14e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d03400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cfc0d0600 0x7f2cfc06d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d03400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc168e80 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d03400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc168d00 con 0x7f2cfc0ce4b0 2024-09-10T23:31:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d03400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2cfc169000 con 0x7f2cfc0d0600 2024-09-10T23:31:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d00a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0cdf60 0x7f2cfc0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d00a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0cdf60 0x7f2cfc0b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57226/0 (socket says 172.21.15.17:57226) 2024-09-10T23:31:42.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d00a00640 1 -- 172.21.15.17:0/387685624 learned_addr learned my addr 172.21.15.17:0/387685624 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2cfbe00640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cfc0ce4b0 0x7f2cfc14e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d01400640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cfc0d0600 0x7f2cfc06d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d00a00640 1 -- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cfc0d0600 msgr2=0x7f2cfc06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d00a00640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cfc0d0600 0x7f2cfc06d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d00a00640 1 -- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cfc0ce4b0 msgr2=0x7f2cfc14e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d00a00640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cfc0ce4b0 0x7f2cfc14e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:42.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d00a00640 1 -- 172.21.15.17:0/387685624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cfc1f7c70 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d00a00640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0cdf60 0x7f2cfc0b2d20 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c450 tx=0x7f2cf000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2cf8c00640 1 -- 172.21.15.17:0/387685624 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0016020 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2cf8c00640 1 -- 172.21.15.17:0/387685624 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cf0012920 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cfc14c9c0 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2cf8c00640 1 -- 172.21.15.17:0/387685624 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0012d70 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cfc1f7f10 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cfc0cfb20 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.835+0000 7f2cf8c00640 1 -- 172.21.15.17:0/387685624 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2cf001b400 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.839+0000 7f2cf8c00640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2cdc0725e0 0x7f2cdc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.839+0000 7f2cf8c00640 1 -- 172.21.15.17:0/387685624 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5335+0+0 (secure 0 0 0) 0x7f2cf00930e0 con 0x7f2cfc0cdf60 2024-09-10T23:31:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.839+0000 7f2cfbe00640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2cdc0725e0 0x7f2cdc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:42.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.839+0000 7f2cfbe00640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2cdc0725e0 0x7f2cdc074aa0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80058d0 tx=0x7f2ce8005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:42.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:42.843+0000 7f2cf8c00640 1 -- 172.21.15.17:0/387685624 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f2cf0020030 con 0x7f2cfc0cdf60 2024-09-10T23:31:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.075+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) -- 0x7f2cfc15d0d0 con 0x7f2cfc0cdf60 2024-09-10T23:31:43.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.955+0000 7f2cf8c00640 1 -- 172.21.15.17:0/387685624 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v747) ==== 136+0+0 (secure 0 0 0) 0x7f2cf005e940 con 0x7f2cfc0cdf60 2024-09-10T23:31:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2cdc0725e0 msgr2=0x7f2cdc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2cdc0725e0 0x7f2cdc074aa0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80058d0 tx=0x7f2ce8005860 comp rx=0 tx=0).stop 2024-09-10T23:31:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0cdf60 msgr2=0x7f2cfc0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0cdf60 0x7f2cfc0b2d20 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c450 tx=0x7f2cf000c910 comp rx=0 tx=0).stop 2024-09-10T23:31:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 shutdown_connections 2024-09-10T23:31:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f2cdc0725e0 0x7f2cdc074aa0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cfc0d0600 0x7f2cfc06d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cfc0ce4b0 0x7f2cfc14e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:43.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 --2- 172.21.15.17:0/387685624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cfc0cdf60 0x7f2cfc0b2d20 unknown :-1 s=CLOSED pgs=2511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:43.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 >> 172.21.15.17:0/387685624 conn(0x7f2cfc0d1d40 msgr2=0x7f2cfc14ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:43.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 shutdown_connections 2024-09-10T23:31:43.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:43.959+0000 7f2d03400640 1 -- 172.21.15.17:0/387685624 wait complete. 2024-09-10T23:31:43.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T23:31:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 -- 172.21.15.17:0/63938713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 msgr2=0x7f4c680cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 --2- 172.21.15.17:0/63938713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 0x7f4c680cdfd0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009900 tx=0x7f4c5801c8b0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 -- 172.21.15.17:0/63938713 shutdown_connections 2024-09-10T23:31:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 --2- 172.21.15.17:0/63938713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 0x7f4c680cdfd0 unknown :-1 s=CLOSED pgs=2513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 -- 172.21.15.17:0/63938713 >> 172.21.15.17:0/63938713 conn(0x7f4c680d1da0 msgr2=0x7f4c680d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 -- 172.21.15.17:0/63938713 shutdown_connections 2024-09-10T23:31:44.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 -- 172.21.15.17:0/63938713 wait complete. 2024-09-10T23:31:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 Processor -- start 2024-09-10T23:31:44.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 -- start start 2024-09-10T23:31:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c680b0e70 0x7f4c681f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c680d2890 0x7f4c680cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 0x7f4c681fbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6816a710 con 0x7f4c6815f470 2024-09-10T23:31:44.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6816a590 con 0x7f4c680d2890 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.139+0000 7f4c6d400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6816a890 con 0x7f4c680b0e70 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c67200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 0x7f4c681fbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c67200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 0x7f4c681fbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57232/0 (socket says 172.21.15.17:57232) 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c67200640 1 -- 172.21.15.17:0/78711430 learned_addr learned my addr 172.21.15.17:0/78711430 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c5fe00640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c680d2890 0x7f4c680cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c66800640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c680b0e70 0x7f4c681f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c67200640 1 -- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c680b0e70 msgr2=0x7f4c681f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c67200640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c680b0e70 0x7f4c681f91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c67200640 1 -- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c680d2890 msgr2=0x7f4c680cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c67200640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c680d2890 0x7f4c680cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c67200640 1 -- 172.21.15.17:0/78711430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c681f86e0 con 0x7f4c6815f470 2024-09-10T23:31:44.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c67200640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 0x7f4c681fbcd0 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c7a0 tx=0x7f4c6000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:44.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c5ea00640 1 -- 172.21.15.17:0/78711430 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60003b80 con 0x7f4c6815f470 2024-09-10T23:31:44.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c5ea00640 1 -- 172.21.15.17:0/78711430 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c60003d40 con 0x7f4c6815f470 2024-09-10T23:31:44.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c681fc750 con 0x7f4c6815f470 2024-09-10T23:31:44.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c5ea00640 1 -- 172.21.15.17:0/78711430 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000aa50 con 0x7f4c6815f470 2024-09-10T23:31:44.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c681f89a0 con 0x7f4c6815f470 2024-09-10T23:31:44.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c680cc0d0 con 0x7f4c6815f470 2024-09-10T23:31:44.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.143+0000 7f4c5ea00640 1 -- 172.21.15.17:0/78711430 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4c6000abf0 con 0x7f4c6815f470 2024-09-10T23:31:44.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.147+0000 7f4c5ea00640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c440725e0 0x7f4c44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:44.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.147+0000 7f4c5ea00640 1 -- 172.21.15.17:0/78711430 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5335+0+0 (secure 0 0 0) 0x7f4c60092f50 con 0x7f4c6815f470 2024-09-10T23:31:44.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.147+0000 7f4c66800640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c440725e0 0x7f4c44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:44.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.147+0000 7f4c66800640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c440725e0 0x7f4c44074aa0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4c580af000 tx=0x7f4c5801b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.151+0000 7f4c5ea00640 1 -- 172.21.15.17:0/78711430 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4c6005e710 con 0x7f4c6815f470 2024-09-10T23:31:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4c680cdfb0 con 0x7f4c6815f470 2024-09-10T23:31:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c5ea00640 1 -- 172.21.15.17:0/78711430 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v63) ==== 59+0+1998 (secure 0 0 0) 0x7f4c6005e010 con 0x7f4c6815f470 2024-09-10T23:31:44.329 INFO:teuthology.orchestra.run.smithi017.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T23:31:44.329 INFO:teuthology.orchestra.run.smithi017.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T23:31:44.329 INFO:teuthology.orchestra.run.smithi017.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T23:31:44.329 INFO:teuthology.orchestra.run.smithi017.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T23:31:44.329 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3814.850018 2024-09-10T23:31:44.329 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4065.349804 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3867.293898 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7562.835860 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3610.408506 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4039.799213 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3646.468846 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3551.093160 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds 20/20 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced debug_ms 2/2 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_frag true 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_debug_scatterstat true 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T23:31:44.330 INFO:teuthology.orchestra.run.smithi017.stdout:mds dev mds_verify_scatter true 2024-09-10T23:31:44.331 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T23:31:44.331 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T23:31:44.331 INFO:teuthology.orchestra.run.smithi017.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T23:31:44.331 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced client_mount_timeout 600 2024-09-10T23:31:44.331 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_client 20/20 2024-09-10T23:31:44.331 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced debug_ms 1/1 2024-09-10T23:31:44.331 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T23:31:44.331 INFO:teuthology.orchestra.run.smithi017.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T23:31:44.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c440725e0 msgr2=0x7f4c44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c440725e0 0x7f4c44074aa0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4c580af000 tx=0x7f4c5801b0f0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 msgr2=0x7f4c681fbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 0x7f4c681fbcd0 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c7a0 tx=0x7f4c6000cc60 comp rx=0 tx=0).stop 2024-09-10T23:31:44.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 shutdown_connections 2024-09-10T23:31:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4c440725e0 0x7f4c44074aa0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c6815f470 0x7f4c681fbcd0 unknown :-1 s=CLOSED pgs=2514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c680d2890 0x7f4c680cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 --2- 172.21.15.17:0/78711430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c680b0e70 0x7f4c681f91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 >> 172.21.15.17:0/78711430 conn(0x7f4c680d1da0 msgr2=0x7f4c680b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 shutdown_connections 2024-09-10T23:31:44.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.327+0000 7f4c6d400640 1 -- 172.21.15.17:0/78711430 wait complete. 2024-09-10T23:31:44.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T23:31:44.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.499+0000 7fbf01600640 1 -- 172.21.15.17:0/4022318663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee0005920 msgr2=0x7fbee0005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.499+0000 7fbf01600640 1 --2- 172.21.15.17:0/4022318663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee0005920 0x7fbee0005da0 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7fbefc15ae60 tx=0x7fbee401d1f0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.499+0000 7fbf01600640 1 -- 172.21.15.17:0/4022318663 shutdown_connections 2024-09-10T23:31:44.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.499+0000 7fbf01600640 1 --2- 172.21.15.17:0/4022318663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee0005920 0x7fbee0005da0 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.499+0000 7fbf01600640 1 -- 172.21.15.17:0/4022318663 >> 172.21.15.17:0/4022318663 conn(0x7fbefc06c360 msgr2=0x7fbefc06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:44.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.499+0000 7fbf01600640 1 -- 172.21.15.17:0/4022318663 shutdown_connections 2024-09-10T23:31:44.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.499+0000 7fbf01600640 1 -- 172.21.15.17:0/4022318663 wait complete. 2024-09-10T23:31:44.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 Processor -- start 2024-09-10T23:31:44.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 -- start start 2024-09-10T23:31:44.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee0005920 0x7fbefc145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:44.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbefc1482e0 0x7fbefc0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:44.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbefc0b25e0 0x7fbefc1f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:44.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc0b4b70 con 0x7fbefc0b25e0 2024-09-10T23:31:44.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc0b49f0 con 0x7fbee0005920 2024-09-10T23:31:44.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbefc0b4cf0 con 0x7fbefc1482e0 2024-09-10T23:31:44.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbefc0b25e0 0x7fbefc1f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbefc0b25e0 0x7fbefc1f79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57250/0 (socket says 172.21.15.17:57250) 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefb400640 1 -- 172.21.15.17:0/467035754 learned_addr learned my addr 172.21.15.17:0/467035754 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefaa00640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee0005920 0x7fbefc145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbef3e00640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbefc1482e0 0x7fbefc0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefb400640 1 -- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbefc1482e0 msgr2=0x7fbefc0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefb400640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbefc1482e0 0x7fbefc0b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefb400640 1 -- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee0005920 msgr2=0x7fbefc145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefb400640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee0005920 0x7fbefc145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefb400640 1 -- 172.21.15.17:0/467035754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbefc0b1630 con 0x7fbefc0b25e0 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbefb400640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbefc0b25e0 0x7fbefc1f79d0 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 crypto rx=0x7fbefc06f630 tx=0x7fbef4006700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbef2a00640 1 -- 172.21.15.17:0/467035754 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4003d90 con 0x7fbefc0b25e0 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbef2a00640 1 -- 172.21.15.17:0/467035754 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbef4006830 con 0x7fbefc0b25e0 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbef2a00640 1 -- 172.21.15.17:0/467035754 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011ae0 con 0x7fbefc0b25e0 2024-09-10T23:31:44.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbefc0afc00 con 0x7fbefc0b25e0 2024-09-10T23:31:44.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbefc0b1b80 con 0x7fbefc0b25e0 2024-09-10T23:31:44.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.503+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbefc06a4b0 con 0x7fbefc0b25e0 2024-09-10T23:31:44.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.507+0000 7fbef2a00640 1 -- 172.21.15.17:0/467035754 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbef4010040 con 0x7fbefc0b25e0 2024-09-10T23:31:44.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.507+0000 7fbef2a00640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbed80725e0 0x7fbed8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:44.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.507+0000 7fbef2a00640 1 -- 172.21.15.17:0/467035754 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5335+0+0 (secure 0 0 0) 0x7fbef4096850 con 0x7fbefc0b25e0 2024-09-10T23:31:44.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.507+0000 7fbefaa00640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbed80725e0 0x7fbed8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:44.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.507+0000 7fbefaa00640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbed80725e0 0x7fbed8074aa0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbeec000fe0 tx=0x7fbeec006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.511+0000 7fbef2a00640 1 -- 172.21.15.17:0/467035754 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbef40619b0 con 0x7fbefc0b25e0 2024-09-10T23:31:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.687+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbefc0cf480 con 0x7fbefc0b25e0 2024-09-10T23:31:44.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.691+0000 7fbef2a00640 1 -- 172.21.15.17:0/467035754 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) ==== 122+0+0 (secure 0 0 0) 0x7fbef40663e0 con 0x7fbefc0b25e0 2024-09-10T23:31:44.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.691+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbed80725e0 msgr2=0x7fbed8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.691+0000 7fbf01600640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbed80725e0 0x7fbed8074aa0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbeec000fe0 tx=0x7fbeec006040 comp rx=0 tx=0).stop 2024-09-10T23:31:44.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.691+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbefc0b25e0 msgr2=0x7fbefc1f79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:44.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.691+0000 7fbf01600640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbefc0b25e0 0x7fbefc1f79d0 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 crypto rx=0x7fbefc06f630 tx=0x7fbef4006700 comp rx=0 tx=0).stop 2024-09-10T23:31:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.695+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 shutdown_connections 2024-09-10T23:31:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.695+0000 7fbf01600640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbed80725e0 0x7fbed8074aa0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.695+0000 7fbf01600640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbefc0b25e0 0x7fbefc1f79d0 unknown :-1 s=CLOSED pgs=2517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.695+0000 7fbf01600640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbefc1482e0 0x7fbefc0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.695+0000 7fbf01600640 1 --2- 172.21.15.17:0/467035754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbee0005920 0x7fbefc145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.695+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 >> 172.21.15.17:0/467035754 conn(0x7fbefc06c360 msgr2=0x7fbefc153920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.695+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 shutdown_connections 2024-09-10T23:31:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:44.695+0000 7fbf01600640 1 -- 172.21.15.17:0/467035754 wait complete. 2024-09-10T23:31:44.715 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:31:44.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:31:44.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:31:44.903 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:31:44.903 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:44.903 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:44.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:31:44.912 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:31:44.912 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:44.921 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:31:44.922 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:44.922 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:44.967 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:31:44.967 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:31:44.967 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:44.977 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:31:44.977 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T23:31:44.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 -- 172.21.15.17:0/2854981711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400d0280 msgr2=0x7fdb400cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 --2- 172.21.15.17:0/2854981711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400d0280 0x7fdb400cebb0 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7fdb40073e10 tx=0x7fdb3801f580 comp rx=0 tx=0).stop 2024-09-10T23:31:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 -- 172.21.15.17:0/2854981711 shutdown_connections 2024-09-10T23:31:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 --2- 172.21.15.17:0/2854981711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400d0280 0x7fdb400cebb0 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 --2- 172.21.15.17:0/2854981711 >> v2:172.21.15.77:3300/0 conn(0x7fdb400cd110 0x7fdb400ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 --2- 172.21.15.17:0/2854981711 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb400cfea0 0x7fdb400d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 -- 172.21.15.17:0/2854981711 >> 172.21.15.17:0/2854981711 conn(0x7fdb400d1d40 msgr2=0x7fdb400d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 -- 172.21.15.17:0/2854981711 shutdown_connections 2024-09-10T23:31:45.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 -- 172.21.15.17:0/2854981711 wait complete. 2024-09-10T23:31:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 Processor -- start 2024-09-10T23:31:45.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 -- start start 2024-09-10T23:31:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400cd110 0x7fdb401538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb400cfea0 0x7fdb40150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb400d0280 0x7fdb400b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4015ffb0 con 0x7fdb400cd110 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4015fe30 con 0x7fdb400d0280 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.155+0000 7fdb46400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdb40160130 con 0x7fdb400cfea0 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400cd110 0x7fdb401538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400cd110 0x7fdb401538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57272/0 (socket says 172.21.15.17:57272) 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3f400640 1 -- 172.21.15.17:0/2865315010 learned_addr learned my addr 172.21.15.17:0/2865315010 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3fe00640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb400d0280 0x7fdb400b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb37e00640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb400cfea0 0x7fdb40150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3f400640 1 -- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb400cfea0 msgr2=0x7fdb40150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3f400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb400cfea0 0x7fdb40150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3f400640 1 -- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb400d0280 msgr2=0x7fdb400b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3f400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb400d0280 0x7fdb400b63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3f400640 1 -- 172.21.15.17:0/2865315010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb400b4730 con 0x7fdb400cd110 2024-09-10T23:31:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb3f400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400cd110 0x7fdb401538f0 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c970 tx=0x7fdb3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb37400640 1 -- 172.21.15.17:0/2865315010 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30007c70 con 0x7fdb400cd110 2024-09-10T23:31:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb37400640 1 -- 172.21.15.17:0/2865315010 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb3000f450 con 0x7fdb400cd110 2024-09-10T23:31:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb40153fd0 con 0x7fdb400cd110 2024-09-10T23:31:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb37400640 1 -- 172.21.15.17:0/2865315010 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000f8a0 con 0x7fdb400cd110 2024-09-10T23:31:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb40154590 con 0x7fdb400cd110 2024-09-10T23:31:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb400d2860 con 0x7fdb400cd110 2024-09-10T23:31:45.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.159+0000 7fdb37400640 1 -- 172.21.15.17:0/2865315010 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdb30020030 con 0x7fdb400cd110 2024-09-10T23:31:45.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.163+0000 7fdb37400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdb1c0725e0 0x7fdb1c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:45.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.163+0000 7fdb37400640 1 -- 172.21.15.17:0/2865315010 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5335+0+0 (secure 0 0 0) 0x7fdb300934f0 con 0x7fdb400cd110 2024-09-10T23:31:45.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.163+0000 7fdb37e00640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdb1c0725e0 0x7fdb1c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:45.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.163+0000 7fdb37e00640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdb1c0725e0 0x7fdb1c074aa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fdb400cbb60 tx=0x7fdb2800a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.167+0000 7fdb37400640 1 -- 172.21.15.17:0/2865315010 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdb30014030 con 0x7fdb400cd110 2024-09-10T23:31:45.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.371+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb400d24a0 con 0x7fdb400cd110 2024-09-10T23:31:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.371+0000 7fdb37400640 1 -- 172.21.15.17:0/2865315010 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 163 v163) ==== 95+0+3919 (secure 0 0 0) 0x7fdb3005e6e0 con 0x7fdb400cd110 2024-09-10T23:31:45.375 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:45.375 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":163,"btime":"2024-09-10T23:31:38:932274+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1912731352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1912731352},{"type":"v1","addr":"172.21.15.77:6837","nonce":1912731352}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156},{"gid":10699,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2784287928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2784287928},{"type":"v1","addr":"172.21.15.77:6836","nonce":2784287928}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163},{"gid":11448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3122453626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3122453626},{"type":"v1","addr":"172.21.15.17:6834","nonce":3122453626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":155},{"gid":11460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/2814757943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2814757943},{"type":"v1","addr":"172.21.15.17:6835","nonce":2814757943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[]} 2024-09-10T23:31:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 163 2024-09-10T23:31:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdb1c0725e0 msgr2=0x7fdb1c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdb1c0725e0 0x7fdb1c074aa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fdb400cbb60 tx=0x7fdb2800a2d0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400cd110 msgr2=0x7fdb401538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400cd110 0x7fdb401538f0 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c970 tx=0x7fdb3000ce30 comp rx=0 tx=0).stop 2024-09-10T23:31:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 shutdown_connections 2024-09-10T23:31:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdb1c0725e0 0x7fdb1c074aa0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb400d0280 0x7fdb400b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb400cfea0 0x7fdb40150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 --2- 172.21.15.17:0/2865315010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb400cd110 0x7fdb401538f0 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 >> 172.21.15.17:0/2865315010 conn(0x7fdb400d1d40 msgr2=0x7fdb40071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 shutdown_connections 2024-09-10T23:31:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.375+0000 7fdb46400640 1 -- 172.21.15.17:0/2865315010 wait complete. 2024-09-10T23:31:45.397 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T23:31:45.397 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T23:31:45.397 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:31:45.398 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:31:45.398 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T23:31:45.398 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T23:31:45.398 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:31:45.398 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:31:45.399 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T23:31:45.399 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T23:31:45.399 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:31:45.399 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:31:45.399 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T23:31:45.399 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T23:31:45.399 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:31:45.399 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:31:45.412 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:31:45.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T23:31:45.413 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:31:45.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T23:31:45.415 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:31:45.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T23:31:45.416 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:31:45.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T23:31:45.460 INFO:tasks.ceph.mds.b:Started 2024-09-10T23:31:45.460 DEBUG:teuthology.parallel:result is None 2024-09-10T23:31:45.461 INFO:tasks.ceph.mds.d:Started 2024-09-10T23:31:45.461 DEBUG:teuthology.parallel:result is None 2024-09-10T23:31:45.462 INFO:tasks.ceph.mds.a:Started 2024-09-10T23:31:45.462 DEBUG:teuthology.parallel:result is None 2024-09-10T23:31:45.463 INFO:tasks.ceph.mds.c:Started 2024-09-10T23:31:45.463 DEBUG:teuthology.parallel:result is None 2024-09-10T23:31:45.463 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T23:31:45.549 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-09-10T23:31:45.549 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:31:45.552 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-10T23:31:45.552 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-10T23:31:45.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 -- 172.21.15.17:0/3714258167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 msgr2=0x7f9d54072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 --2- 172.21.15.17:0/3714258167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 0x7f9d54072800 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7f9d54072790 tx=0x7f9d4401c8c0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 -- 172.21.15.17:0/3714258167 shutdown_connections 2024-09-10T23:31:45.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 --2- 172.21.15.17:0/3714258167 >> v2:172.21.15.77:3300/0 conn(0x7f9d5406fd10 0x7f9d5415b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 --2- 172.21.15.17:0/3714258167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 0x7f9d54072800 unknown :-1 s=CLOSED pgs=2527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 -- 172.21.15.17:0/3714258167 >> 172.21.15.17:0/3714258167 conn(0x7f9d540b1850 msgr2=0x7f9d540b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:45.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 -- 172.21.15.17:0/3714258167 shutdown_connections 2024-09-10T23:31:45.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 -- 172.21.15.17:0/3714258167 wait complete. 2024-09-10T23:31:45.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 Processor -- start 2024-09-10T23:31:45.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 -- start start 2024-09-10T23:31:45.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 0x7f9d54152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d5406fd10 0x7f9d541f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d5415bcf0 0x7f9d5414c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9d54167b00 con 0x7f9d5406f930 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d54167980 con 0x7f9d5415bcf0 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d5a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9d54167c80 con 0x7f9d5406fd10 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 0x7f9d54152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 0x7f9d54152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57334/0 (socket says 172.21.15.17:57334) 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53400640 1 -- 172.21.15.17:0/1936779816 learned_addr learned my addr 172.21.15.17:0/1936779816 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d4aa00640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d5406fd10 0x7f9d541f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53e00640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d5415bcf0 0x7f9d5414c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:45.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53400640 1 -- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d5406fd10 msgr2=0x7f9d541f82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53400640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d5406fd10 0x7f9d541f82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53400640 1 -- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d5415bcf0 msgr2=0x7f9d5414c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53400640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d5415bcf0 0x7f9d5414c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53400640 1 -- 172.21.15.17:0/1936779816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d541525c0 con 0x7f9d5406f930 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.615+0000 7f9d53e00640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d5415bcf0 0x7f9d5414c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d53400640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 0x7f9d54152080 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f9d440194d0 tx=0x7f9d440a6720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d4be00640 1 -- 172.21.15.17:0/1936779816 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d440bd070 con 0x7f9d5406f930 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d4be00640 1 -- 172.21.15.17:0/1936779816 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d44004200 con 0x7f9d5406f930 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d4be00640 1 -- 172.21.15.17:0/1936779816 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44005070 con 0x7f9d5406f930 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d541f8820 con 0x7f9d5406f930 2024-09-10T23:31:45.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d54154210 con 0x7f9d5406f930 2024-09-10T23:31:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d54075ad0 con 0x7f9d5406f930 2024-09-10T23:31:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d4be00640 1 -- 172.21.15.17:0/1936779816 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9d44005210 con 0x7f9d5406f930 2024-09-10T23:31:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d4be00640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d300725e0 0x7f9d30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d4be00640 1 -- 172.21.15.17:0/1936779816 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5335+0+0 (secure 0 0 0) 0x7f9d4412d3b0 con 0x7f9d5406f930 2024-09-10T23:31:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.619+0000 7f9d4aa00640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d300725e0 0x7f9d30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.623+0000 7f9d4aa00640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d300725e0 0x7f9d30074aa0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9d540af530 tx=0x7f9d3c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:45.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.623+0000 7f9d4be00640 1 -- 172.21.15.17:0/1936779816 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9d541f8820 con 0x7f9d5406f930 2024-09-10T23:31:45.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.807+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9d54072800 con 0x7f9d5406f930 2024-09-10T23:31:45.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.975+0000 7f9d4be00640 1 -- 172.21.15.17:0/1936779816 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v217) ==== 97+0+0 (secure 0 0 0) 0x7f9d440164b0 con 0x7f9d5406f930 2024-09-10T23:31:45.979 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-09-10T23:31:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d300725e0 msgr2=0x7f9d30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d300725e0 0x7f9d30074aa0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9d540af530 tx=0x7f9d3c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 msgr2=0x7f9d54152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 0x7f9d54152080 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f9d440194d0 tx=0x7f9d440a6720 comp rx=0 tx=0).stop 2024-09-10T23:31:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 shutdown_connections 2024-09-10T23:31:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9d300725e0 0x7f9d30074aa0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d5415bcf0 0x7f9d5414c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d5406fd10 0x7f9d541f82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 --2- 172.21.15.17:0/1936779816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406f930 0x7f9d54152080 unknown :-1 s=CLOSED pgs=2528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 >> 172.21.15.17:0/1936779816 conn(0x7f9d540b1850 msgr2=0x7f9d540cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 shutdown_connections 2024-09-10T23:31:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:45.979+0000 7f9d5a400640 1 -- 172.21.15.17:0/1936779816 wait complete. 2024-09-10T23:31:46.005 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T23:31:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.147+0000 7f7f7aa00640 1 -- 172.21.15.17:0/263827673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740691b0 msgr2=0x7f7f74070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.147+0000 7f7f7aa00640 1 --2- 172.21.15.17:0/263827673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740691b0 0x7f7f74070280 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009900 tx=0x7f7f5c01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.147+0000 7f7f7aa00640 1 -- 172.21.15.17:0/263827673 shutdown_connections 2024-09-10T23:31:46.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.147+0000 7f7f7aa00640 1 --2- 172.21.15.17:0/263827673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f740b4820 0x7f7f740b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.147+0000 7f7f7aa00640 1 --2- 172.21.15.17:0/263827673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740691b0 0x7f7f74070280 unknown :-1 s=CLOSED pgs=2530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.147+0000 7f7f7aa00640 1 -- 172.21.15.17:0/263827673 >> 172.21.15.17:0/263827673 conn(0x7f7f740ccf70 msgr2=0x7f7f740cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.147+0000 7f7f7aa00640 1 -- 172.21.15.17:0/263827673 shutdown_connections 2024-09-10T23:31:46.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.147+0000 7f7f7aa00640 1 -- 172.21.15.17:0/263827673 wait complete. 2024-09-10T23:31:46.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f7aa00640 1 Processor -- start 2024-09-10T23:31:46.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f7aa00640 1 -- start start 2024-09-10T23:31:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f7aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f740691b0 0x7f7f7413d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f7aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740b4820 0x7f7f7413a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f7aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7415e700 0x7f7f740ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f7aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7f74168080 con 0x7f7f740b4820 2024-09-10T23:31:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f7aa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f740b5810 con 0x7f7f7415e700 2024-09-10T23:31:46.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f7aa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7f74168200 con 0x7f7f740691b0 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f6be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740b4820 0x7f7f7413a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f6be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740b4820 0x7f7f7413a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57346/0 (socket says 172.21.15.17:57346) 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f6be00640 1 -- 172.21.15.17:0/130315697 learned_addr learned my addr 172.21.15.17:0/130315697 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f73e00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f740691b0 0x7f7f7413d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f78a00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7415e700 0x7f7f740ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f6be00640 1 -- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f740691b0 msgr2=0x7f7f7413d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f6be00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f740691b0 0x7f7f7413d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f6be00640 1 -- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7415e700 msgr2=0x7f7f740ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f6be00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7415e700 0x7f7f740ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f6be00640 1 -- 172.21.15.17:0/130315697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7413dd90 con 0x7f7f740b4820 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f6be00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740b4820 0x7f7f7413a450 secure :-1 s=READY pgs=2531 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009850 tx=0x7f7f5c0a57a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f70c00640 1 -- 172.21.15.17:0/130315697 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0b2040 con 0x7f7f740b4820 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f70c00640 1 -- 172.21.15.17:0/130315697 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f5c004230 con 0x7f7f740b4820 2024-09-10T23:31:46.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f70c00640 1 -- 172.21.15.17:0/130315697 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c003600 con 0x7f7f740b4820 2024-09-10T23:31:46.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.151+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f741fb570 con 0x7f7f740b4820 2024-09-10T23:31:46.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.155+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f741fbb30 con 0x7f7f740b4820 2024-09-10T23:31:46.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.155+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f74070280 con 0x7f7f740b4820 2024-09-10T23:31:46.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.155+0000 7f7f70c00640 1 -- 172.21.15.17:0/130315697 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7f5c0037a0 con 0x7f7f740b4820 2024-09-10T23:31:46.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.155+0000 7f7f70c00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f500725e0 0x7f7f50074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.155+0000 7f7f70c00640 1 -- 172.21.15.17:0/130315697 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(219..219 src has 1..219) ==== 5249+0+0 (secure 0 0 0) 0x7f7f5c12d5a0 con 0x7f7f740b4820 2024-09-10T23:31:46.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.155+0000 7f7f73e00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f500725e0 0x7f7f50074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.159+0000 7f7f73e00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f500725e0 0x7f7f50074aa0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7f64000f70 tx=0x7f7f64009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.159+0000 7f7f70c00640 1 -- 172.21.15.17:0/130315697 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7f5c0c6020 con 0x7f7f740b4820 2024-09-10T23:31:46.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7f7406dc80 con 0x7f7f740b4820 2024-09-10T23:31:46.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f70c00640 1 -- 172.21.15.17:0/130315697 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) ==== 80+0+5304 (secure 0 0 0) 0x7f7f7413dd90 con 0x7f7f740b4820 2024-09-10T23:31:46.396 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:46.396 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:46.396 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-09-10T23:31:46.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.396 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-09-10T23:31:46.396 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmkUErERAA0fK70g2oHQhbqLVQWkKSFQ==", 2024-09-10T23:31:46.396 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.396 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmmBHhHRAAYBPVcu0HjiIxPdst/AytBQ==", 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.397 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:46.398 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:46.398 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:46.398 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.398 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.398 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-09-10T23:31:46.398 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmjzLIGBAA+YcdIxHZMrLMGG4Wpe+lag==", 2024-09-10T23:31:46.398 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.399 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:46.399 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:46.399 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:46.399 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.399 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-09-10T23:31:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm4BIcJRAAowxY8L4SAxsioiR/FPVx+w==", 2024-09-10T23:31:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.401 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-09-10T23:31:46.401 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDe0uBm+HD1CRAAzuGWx3RLIEQ4v1U2Lt1uNg==", 2024-09-10T23:31:46.401 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.401 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:46.401 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:46.401 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.402 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-09-10T23:31:46.402 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDh0uBm5QgYHRAAlFMS7RRgrj40gpNyXAP7cg==", 2024-09-10T23:31:46.402 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.402 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:46.402 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:46.402 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.402 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.403 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-09-10T23:31:46.403 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDk0uBmZLk1MxAAoTPmgPCAfrSLBvz2kHPCTw==", 2024-09-10T23:31:46.403 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.403 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:46.403 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:46.403 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.404 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-09-10T23:31:46.404 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDo0uBm2klGDhAAELmcjMNlJOdjuT6gbSy48g==", 2024-09-10T23:31:46.404 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.404 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:46.404 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:46.404 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.405 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-09-10T23:31:46.405 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDu0uBmJQiFHxAA6GJd2TzjdoSFRAzDiiWNRg==", 2024-09-10T23:31:46.405 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.405 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:46.405 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:46.405 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.406 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-09-10T23:31:46.406 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDx0uBm7lghNRAAoDZEJDuffwpyToxSH1uN3A==", 2024-09-10T23:31:46.406 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.406 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:46.406 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:46.406 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD10uBmDirJDRAAkQqgl7h5egVXEv0Z/fnUZQ==", 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.408 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-09-10T23:31:46.408 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQD40uBm7U2MIhAAeyGJQXIRBjq4YSAKDPoMHQ==", 2024-09-10T23:31:46.408 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.408 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-09-10T23:31:46.408 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-09-10T23:31:46.408 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ==", 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T23:31:46.409 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBm/sO6MhAAhN7MKpaQlgYL6sOQPwnQaw==", 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-09-10T23:31:46.410 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmFG8ZLxAALBKqgUI6L6s+0/UXnH7+FQ==", 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmEEDOOBAA1eXudIbn4QpM7zHB7YaZnQ==", 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-09-10T23:31:46.411 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDb0uBmbozVLxAAls9LsXyi/zYpRMwQwCgVcQ==", 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.412 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmbDU2DBAAmc3xt5WVlcn3wN6QicLhmA==", 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQDc0uBmVVsxCBAAeSl5YvQUJLJo4Zte3I8FbQ==", 2024-09-10T23:31:46.413 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-09-10T23:31:46.414 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-09-10T23:31:46.414 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-09-10T23:31:46.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-09-10T23:31:46.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.414 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-10T23:31:46.414 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f500725e0 msgr2=0x7f7f50074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f500725e0 0x7f7f50074aa0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7f64000f70 tx=0x7f7f64009040 comp rx=0 tx=0).stop 2024-09-10T23:31:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740b4820 msgr2=0x7f7f7413a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740b4820 0x7f7f7413a450 secure :-1 s=READY pgs=2531 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009850 tx=0x7f7f5c0a57a0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 shutdown_connections 2024-09-10T23:31:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7f500725e0 0x7f7f50074aa0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f7415e700 0x7f7f740ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f740b4820 0x7f7f7413a450 unknown :-1 s=CLOSED pgs=2531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 --2- 172.21.15.17:0/130315697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7f740691b0 0x7f7f7413d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 >> 172.21.15.17:0/130315697 conn(0x7f7f740ccf70 msgr2=0x7f7f741648b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 shutdown_connections 2024-09-10T23:31:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.395+0000 7f7f7aa00640 1 -- 172.21.15.17:0/130315697 wait complete. 2024-09-10T23:31:46.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T23:31:46.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 -- 172.21.15.17:0/1638686308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8624070030 msgr2=0x7f86240cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 --2- 172.21.15.17:0/1638686308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8624070030 0x7f86240cec10 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7f8624074f80 tx=0x7f861c01dc70 comp rx=0 tx=0).stop 2024-09-10T23:31:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 -- 172.21.15.17:0/1638686308 shutdown_connections 2024-09-10T23:31:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 --2- 172.21.15.17:0/1638686308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8624070030 0x7f86240cec10 unknown :-1 s=CLOSED pgs=2532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 --2- 172.21.15.17:0/1638686308 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86240745e0 0x7f862415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 --2- 172.21.15.17:0/1638686308 >> v2:172.21.15.77:3300/0 conn(0x7f862406fc50 0x7f862415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 -- 172.21.15.17:0/1638686308 >> 172.21.15.17:0/1638686308 conn(0x7f86240b1850 msgr2=0x7f86240b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 -- 172.21.15.17:0/1638686308 shutdown_connections 2024-09-10T23:31:46.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 -- 172.21.15.17:0/1638686308 wait complete. 2024-09-10T23:31:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 Processor -- start 2024-09-10T23:31:46.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 -- start start 2024-09-10T23:31:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f862406fc50 0x7f862414a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8624070030 0x7f8624147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86240745e0 0x7f8624147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f862406f290 con 0x7f862406fc50 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f862406f110 con 0x7f8624070030 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8629a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f862406f410 con 0x7f86240745e0 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8622a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f862406fc50 0x7f862414a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8622a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f862406fc50 0x7f862414a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57372/0 (socket says 172.21.15.17:57372) 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.563+0000 7f8622a00640 1 -- 172.21.15.17:0/3004006694 learned_addr learned my addr 172.21.15.17:0/3004006694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f861be00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8624070030 0x7f8624147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8623400640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86240745e0 0x7f8624147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8622a00640 1 -- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86240745e0 msgr2=0x7f8624147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8622a00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86240745e0 0x7f8624147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8622a00640 1 -- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8624070030 msgr2=0x7f8624147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8622a00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8624070030 0x7f8624147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8622a00640 1 -- 172.21.15.17:0/3004006694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862414abd0 con 0x7f862406fc50 2024-09-10T23:31:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f861be00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8624070030 0x7f8624147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8623400640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86240745e0 0x7f8624147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8622a00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f862406fc50 0x7f862414a4f0 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f861400e9f0 tx=0x7f861400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f861aa00640 1 -- 172.21.15.17:0/3004006694 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861400ccc0 con 0x7f862406fc50 2024-09-10T23:31:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f861aa00640 1 -- 172.21.15.17:0/3004006694 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8614010430 con 0x7f862406fc50 2024-09-10T23:31:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f861aa00640 1 -- 172.21.15.17:0/3004006694 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614010840 con 0x7f862406fc50 2024-09-10T23:31:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f862414aeb0 con 0x7f862406fc50 2024-09-10T23:31:46.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86241fb6b0 con 0x7f862406fc50 2024-09-10T23:31:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8624075ab0 con 0x7f862406fc50 2024-09-10T23:31:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f861aa00640 1 -- 172.21.15.17:0/3004006694 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f86140109e0 con 0x7f862406fc50 2024-09-10T23:31:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f861aa00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86000725e0 0x7f8600074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.567+0000 7f861aa00640 1 -- 172.21.15.17:0/3004006694 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(219..219 src has 1..219) ==== 5249+0+0 (secure 0 0 0) 0x7f8614093b50 con 0x7f862406fc50 2024-09-10T23:31:46.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.571+0000 7f861be00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86000725e0 0x7f8600074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.571+0000 7f861be00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86000725e0 0x7f8600074aa0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f862414e890 tx=0x7f860c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.575+0000 7f861aa00640 1 -- 172.21.15.17:0/3004006694 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f861405f3e0 con 0x7f862406fc50 2024-09-10T23:31:46.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.751+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f86240cec10 con 0x7f862406fc50 2024-09-10T23:31:46.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.751+0000 7f861aa00640 1 -- 172.21.15.17:0/3004006694 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v219) ==== 84+0+65 (secure 0 0 0) 0x7f861405ece0 con 0x7f862406fc50 2024-09-10T23:31:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:46.755 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-09-10T23:31:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-10T23:31:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-09-10T23:31:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-09-10T23:31:46.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:46.755 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-09-10T23:31:46.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86000725e0 msgr2=0x7f8600074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86000725e0 0x7f8600074aa0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f862414e890 tx=0x7f860c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f862406fc50 msgr2=0x7f862414a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f862406fc50 0x7f862414a4f0 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f861400e9f0 tx=0x7f861400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 shutdown_connections 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f86000725e0 0x7f8600074aa0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86240745e0 0x7f8624147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8624070030 0x7f8624147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 --2- 172.21.15.17:0/3004006694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f862406fc50 0x7f862414a4f0 unknown :-1 s=CLOSED pgs=2533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 >> 172.21.15.17:0/3004006694 conn(0x7f86240b1850 msgr2=0x7f862415a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 shutdown_connections 2024-09-10T23:31:46.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.755+0000 7f8629a00640 1 -- 172.21.15.17:0/3004006694 wait complete. 2024-09-10T23:31:46.777 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T23:31:46.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T23:31:46.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 -- 172.21.15.17:0/2247311223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628070190 msgr2=0x7f0628070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 --2- 172.21.15.17:0/2247311223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628070190 0x7f0628070620 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7f0620009bc0 tx=0x7f062001cba0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 -- 172.21.15.17:0/2247311223 shutdown_connections 2024-09-10T23:31:46.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 --2- 172.21.15.17:0/2247311223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628070190 0x7f0628070620 unknown :-1 s=CLOSED pgs=2535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 --2- 172.21.15.17:0/2247311223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0628074730 0x7f062806e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 -- 172.21.15.17:0/2247311223 >> 172.21.15.17:0/2247311223 conn(0x7f06280cc590 msgr2=0x7f06280cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:46.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 -- 172.21.15.17:0/2247311223 shutdown_connections 2024-09-10T23:31:46.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 -- 172.21.15.17:0/2247311223 wait complete. 2024-09-10T23:31:46.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 Processor -- start 2024-09-10T23:31:46.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 -- start start 2024-09-10T23:31:46.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0628070190 0x7f06281369c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628074730 0x7f062813b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0628144090 0x7f0628159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0628167b20 con 0x7f0628074730 2024-09-10T23:31:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06280ce530 con 0x7f0628070190 2024-09-10T23:31:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f062cc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0628167ca0 con 0x7f0628144090 2024-09-10T23:31:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f061fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628074730 0x7f062813b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f061fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628074730 0x7f062813b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55502/0 (socket says 172.21.15.17:55502) 2024-09-10T23:31:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f061fe00640 1 -- 172.21.15.17:0/2992194924 learned_addr learned my addr 172.21.15.17:0/2992194924 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f0625e00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0628070190 0x7f06281369c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f0626800640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0628144090 0x7f0628159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f061fe00640 1 -- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0628144090 msgr2=0x7f0628159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f061fe00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0628144090 0x7f0628159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f061fe00640 1 -- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0628070190 msgr2=0x7f06281369c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:46.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f061fe00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0628070190 0x7f06281369c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:46.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.926+0000 7f061fe00640 1 -- 172.21.15.17:0/2992194924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06280b2b80 con 0x7f0628074730 2024-09-10T23:31:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f061fe00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628074730 0x7f062813b960 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 crypto rx=0x7f061000d980 tx=0x7f061000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f061e000640 1 -- 172.21.15.17:0/2992194924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0610017070 con 0x7f0628074730 2024-09-10T23:31:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f061e000640 1 -- 172.21.15.17:0/2992194924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0610009d20 con 0x7f0628074730 2024-09-10T23:31:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f061e000640 1 -- 172.21.15.17:0/2992194924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06100106c0 con 0x7f0628074730 2024-09-10T23:31:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062813c620 con 0x7f0628074730 2024-09-10T23:31:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062813c900 con 0x7f0628074730 2024-09-10T23:31:46.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0628070620 con 0x7f0628074730 2024-09-10T23:31:46.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f061e000640 1 -- 172.21.15.17:0/2992194924 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0610010860 con 0x7f0628074730 2024-09-10T23:31:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f061e000640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0604072610 0x7f0604074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.930+0000 7f061e000640 1 -- 172.21.15.17:0/2992194924 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(219..219 src has 1..219) ==== 5249+0+0 (secure 0 0 0) 0x7f06100938c0 con 0x7f0628074730 2024-09-10T23:31:46.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.934+0000 7f0625e00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0604072610 0x7f0604074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:46.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.934+0000 7f0625e00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0604072610 0x7f0604074ad0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0618001870 tx=0x7f0618001380 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:46.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:46.934+0000 7f061e000640 1 -- 172.21.15.17:0/2992194924 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f061005eb80 con 0x7f0628074730 2024-09-10T23:31:47.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.110+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f062813da50 con 0x7f0628074730 2024-09-10T23:31:47.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f061e000640 1 -- 172.21.15.17:0/2992194924 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v220) ==== 138+0+0 (secure 0 0 0) 0x7f06100635b0 con 0x7f0628074730 2024-09-10T23:31:47.999 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0604072610 msgr2=0x7f0604074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0604072610 0x7f0604074ad0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0618001870 tx=0x7f0618001380 comp rx=0 tx=0).stop 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628074730 msgr2=0x7f062813b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628074730 0x7f062813b960 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 crypto rx=0x7f061000d980 tx=0x7f061000de40 comp rx=0 tx=0).stop 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 shutdown_connections 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0604072610 0x7f0604074ad0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0628144090 0x7f0628159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0628074730 0x7f062813b960 unknown :-1 s=CLOSED pgs=2536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 --2- 172.21.15.17:0/2992194924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0628070190 0x7f06281369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 >> 172.21.15.17:0/2992194924 conn(0x7f06280cc590 msgr2=0x7f062813cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 shutdown_connections 2024-09-10T23:31:48.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:47.998+0000 7f062cc00640 1 -- 172.21.15.17:0/2992194924 wait complete. 2024-09-10T23:31:48.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T23:31:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.186+0000 7efd3e200640 1 -- 172.21.15.17:0/2773537730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd381600f0 msgr2=0x7efd381605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.186+0000 7efd3e200640 1 --2- 172.21.15.17:0/2773537730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd381600f0 0x7efd381605a0 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7efd380739b0 tx=0x7efd3001cd80 comp rx=0 tx=0).stop 2024-09-10T23:31:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 -- 172.21.15.17:0/2773537730 shutdown_connections 2024-09-10T23:31:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 --2- 172.21.15.17:0/2773537730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd381600f0 0x7efd381605a0 unknown :-1 s=CLOSED pgs=2537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 --2- 172.21.15.17:0/2773537730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd380d28b0 0x7efd3815fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 --2- 172.21.15.17:0/2773537730 >> v2:172.21.15.77:3300/0 conn(0x7efd380cfdd0 0x7efd380d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 -- 172.21.15.17:0/2773537730 >> 172.21.15.17:0/2773537730 conn(0x7efd380d1d90 msgr2=0x7efd380d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 -- 172.21.15.17:0/2773537730 shutdown_connections 2024-09-10T23:31:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 -- 172.21.15.17:0/2773537730 wait complete. 2024-09-10T23:31:48.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 Processor -- start 2024-09-10T23:31:48.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 -- start start 2024-09-10T23:31:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd380cfdd0 0x7efd3815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380d28b0 0x7efd38158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd381600f0 0x7efd380709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efd380b16c0 con 0x7efd380cfdd0 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd380b08d0 con 0x7efd380d28b0 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd3e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efd380b1840 con 0x7efd381600f0 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd380cfdd0 0x7efd3815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd380cfdd0 0x7efd3815ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55520/0 (socket says 172.21.15.17:55520) 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37400640 1 -- 172.21.15.17:0/3260431149 learned_addr learned my addr 172.21.15.17:0/3260431149 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37e00640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd381600f0 0x7efd380709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd2fe00640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380d28b0 0x7efd38158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37400640 1 -- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd381600f0 msgr2=0x7efd380709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37400640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd381600f0 0x7efd380709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37400640 1 -- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380d28b0 msgr2=0x7efd38158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37400640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380d28b0 0x7efd38158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37400640 1 -- 172.21.15.17:0/3260431149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3815f4b0 con 0x7efd380cfdd0 2024-09-10T23:31:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd37400640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd380cfdd0 0x7efd3815ef70 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7efd2800e9f0 tx=0x7efd2800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.190+0000 7efd2f400640 1 -- 172.21.15.17:0/3260431149 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2800ccc0 con 0x7efd380cfdd0 2024-09-10T23:31:48.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.194+0000 7efd2f400640 1 -- 172.21.15.17:0/3260431149 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd28010430 con 0x7efd380cfdd0 2024-09-10T23:31:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.194+0000 7efd2f400640 1 -- 172.21.15.17:0/3260431149 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28010840 con 0x7efd380cfdd0 2024-09-10T23:31:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.194+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd380ccce0 con 0x7efd380cfdd0 2024-09-10T23:31:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.194+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd380cd2a0 con 0x7efd380cfdd0 2024-09-10T23:31:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.194+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd3815fbb0 con 0x7efd380cfdd0 2024-09-10T23:31:48.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.194+0000 7efd2f400640 1 -- 172.21.15.17:0/3260431149 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efd28029080 con 0x7efd380cfdd0 2024-09-10T23:31:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.194+0000 7efd2f400640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd140725e0 0x7efd14074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:48.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.194+0000 7efd2f400640 1 -- 172.21.15.17:0/3260431149 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(220..220 src has 1..220) ==== 5619+0+0 (secure 0 0 0) 0x7efd280941e0 con 0x7efd380cfdd0 2024-09-10T23:31:48.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.194+0000 7efd2fe00640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd140725e0 0x7efd14074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:48.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.198+0000 7efd2fe00640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd140725e0 0x7efd14074aa0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7efd200058d0 tx=0x7efd20005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:48.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.198+0000 7efd2f400640 1 -- 172.21.15.17:0/3260431149 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efd2805f330 con 0x7efd380cfdd0 2024-09-10T23:31:48.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:48.374+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efd38158750 con 0x7efd380cfdd0 2024-09-10T23:31:49.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.006+0000 7efd2f400640 1 -- 172.21.15.17:0/3260431149 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v221) ==== 170+0+0 (secure 0 0 0) 0x7efd28063d60 con 0x7efd380cfdd0 2024-09-10T23:31:49.008 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-09-10T23:31:49.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd140725e0 msgr2=0x7efd14074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd140725e0 0x7efd14074aa0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7efd200058d0 tx=0x7efd20005860 comp rx=0 tx=0).stop 2024-09-10T23:31:49.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd380cfdd0 msgr2=0x7efd3815ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd380cfdd0 0x7efd3815ef70 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7efd2800e9f0 tx=0x7efd2800eeb0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 shutdown_connections 2024-09-10T23:31:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efd140725e0 0x7efd14074aa0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd381600f0 0x7efd380709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd380d28b0 0x7efd38158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 --2- 172.21.15.17:0/3260431149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd380cfdd0 0x7efd3815ef70 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 >> 172.21.15.17:0/3260431149 conn(0x7efd380d1d90 msgr2=0x7efd38071820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 shutdown_connections 2024-09-10T23:31:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.010+0000 7efd3e200640 1 -- 172.21.15.17:0/3260431149 wait complete. 2024-09-10T23:31:49.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T23:31:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 -- 172.21.15.17:0/3685198213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 msgr2=0x7f69980b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 --2- 172.21.15.17:0/3685198213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 0x7f69980b1f30 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f69980b7e70 tx=0x7f699001cd80 comp rx=0 tx=0).stop 2024-09-10T23:31:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 -- 172.21.15.17:0/3685198213 shutdown_connections 2024-09-10T23:31:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 --2- 172.21.15.17:0/3685198213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 0x7f69980b1f30 unknown :-1 s=CLOSED pgs=2540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 --2- 172.21.15.17:0/3685198213 >> v2:172.21.15.77:3300/0 conn(0x7f69980c54e0 0x7f69980cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 -- 172.21.15.17:0/3685198213 >> 172.21.15.17:0/3685198213 conn(0x7f69980d1dc0 msgr2=0x7f69980d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 -- 172.21.15.17:0/3685198213 shutdown_connections 2024-09-10T23:31:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 -- 172.21.15.17:0/3685198213 wait complete. 2024-09-10T23:31:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 Processor -- start 2024-09-10T23:31:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.202+0000 7f699f400640 1 -- start start 2024-09-10T23:31:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 0x7f6998071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69980c54e0 0x7f69981531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69980cfed0 0x7f69980afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699f400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6998169190 con 0x7f69980b1ac0 2024-09-10T23:31:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699f400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6998169010 con 0x7f69980c54e0 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699f400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6998169310 con 0x7f69980cfed0 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 0x7f6998071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 0x7f6998071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55548/0 (socket says 172.21.15.17:55548) 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699ca00640 1 -- 172.21.15.17:0/4287967642 learned_addr learned my addr 172.21.15.17:0/4287967642 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f6997e00640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69980c54e0 0x7f69981531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699d400640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69980cfed0 0x7f69980afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699ca00640 1 -- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69980cfed0 msgr2=0x7f69980afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699ca00640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69980cfed0 0x7f69980afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699ca00640 1 -- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69980c54e0 msgr2=0x7f69981531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699ca00640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69980c54e0 0x7f69981531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699ca00640 1 -- 172.21.15.17:0/4287967642 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69980b6e30 con 0x7f69980b1ac0 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699d400640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69980cfed0 0x7f69980afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f6997e00640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69980c54e0 0x7f69981531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:49.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699ca00640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 0x7f6998071f60 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f698c001ec0 tx=0x7f698c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:49.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f6994c00640 1 -- 172.21.15.17:0/4287967642 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c017070 con 0x7f69980b1ac0 2024-09-10T23:31:49.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f6994c00640 1 -- 172.21.15.17:0/4287967642 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f698c003600 con 0x7f69980b1ac0 2024-09-10T23:31:49.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69980b70a0 con 0x7f69980b1ac0 2024-09-10T23:31:49.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f6994c00640 1 -- 172.21.15.17:0/4287967642 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c003a50 con 0x7f69980b1ac0 2024-09-10T23:31:49.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6998166790 con 0x7f69980b1ac0 2024-09-10T23:31:49.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.206+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69980b1f30 con 0x7f69980b1ac0 2024-09-10T23:31:49.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.210+0000 7f6994c00640 1 -- 172.21.15.17:0/4287967642 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f698c003bf0 con 0x7f69980b1ac0 2024-09-10T23:31:49.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.210+0000 7f6994c00640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69780725e0 0x7f6978074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.210+0000 7f6994c00640 1 -- 172.21.15.17:0/4287967642 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 6001+0+0 (secure 0 0 0) 0x7f698c092a40 con 0x7f69980b1ac0 2024-09-10T23:31:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.210+0000 7f6997e00640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69780725e0 0x7f6978074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.210+0000 7f6997e00640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69780725e0 0x7f6978074aa0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f69981fb310 tx=0x7f69840091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.214+0000 7f6994c00640 1 -- 172.21.15.17:0/4287967642 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f698c05df50 con 0x7f69980b1ac0 2024-09-10T23:31:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:49.426+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f69980b7c20 con 0x7f69980b1ac0 2024-09-10T23:31:50.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.006+0000 7f6994c00640 1 -- 172.21.15.17:0/4287967642 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 33 and data pool 34 v166) ==== 174+0+0 (secure 0 0 0) 0x7f698c05d850 con 0x7f69980b1ac0 2024-09-10T23:31:50.010 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 33 and data pool 34 2024-09-10T23:31:50.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.014+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69780725e0 msgr2=0x7f6978074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.014+0000 7f699f400640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69780725e0 0x7f6978074aa0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f69981fb310 tx=0x7f69840091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.014+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 msgr2=0x7f6998071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.014+0000 7f699f400640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 0x7f6998071f60 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f698c001ec0 tx=0x7f698c00c890 comp rx=0 tx=0).stop 2024-09-10T23:31:50.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.022+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 shutdown_connections 2024-09-10T23:31:50.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.022+0000 7f699f400640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69780725e0 0x7f6978074aa0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.022+0000 7f699f400640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69980cfed0 0x7f69980afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.022+0000 7f699f400640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69980c54e0 0x7f69981531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.022+0000 7f699f400640 1 --2- 172.21.15.17:0/4287967642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69980b1ac0 0x7f6998071f60 unknown :-1 s=CLOSED pgs=2541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.022+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 >> 172.21.15.17:0/4287967642 conn(0x7f69980d1dc0 msgr2=0x7f69980b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:50.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.026+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 shutdown_connections 2024-09-10T23:31:50.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.026+0000 7f699f400640 1 -- 172.21.15.17:0/4287967642 wait complete. 2024-09-10T23:31:50.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:50.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.218+0000 7f116be00640 1 -- 172.21.15.17:0/1281019316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640cfa70 msgr2=0x7f11640b3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.218+0000 7f116be00640 1 --2- 172.21.15.17:0/1281019316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640cfa70 0x7f11640b3fc0 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f115c009bc0 tx=0x7f115c01cba0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.218+0000 7f116be00640 1 -- 172.21.15.17:0/1281019316 shutdown_connections 2024-09-10T23:31:50.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.218+0000 7f116be00640 1 --2- 172.21.15.17:0/1281019316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640cfa70 0x7f11640b3fc0 unknown :-1 s=CLOSED pgs=2543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.218+0000 7f116be00640 1 -- 172.21.15.17:0/1281019316 >> 172.21.15.17:0/1281019316 conn(0x7f11640d3f50 msgr2=0x7f11640d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:50.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.218+0000 7f116be00640 1 -- 172.21.15.17:0/1281019316 shutdown_connections 2024-09-10T23:31:50.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.218+0000 7f116be00640 1 -- 172.21.15.17:0/1281019316 wait complete. 2024-09-10T23:31:50.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 Processor -- start 2024-09-10T23:31:50.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 -- start start 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11640cfa70 0x7f11640cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11640d1d80 0x7f11641fb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640d4a40 0x7f11641fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f116416c380 con 0x7f11640d4a40 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f116416c200 con 0x7f11640cfa70 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f116416c500 con 0x7f11640d1d80 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640d4a40 0x7f11641fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11640cfa70 0x7f11640cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640d4a40 0x7f11641fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55568/0 (socket says 172.21.15.17:55568) 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169e00640 1 -- 172.21.15.17:0/914326765 learned_addr learned my addr 172.21.15.17:0/914326765 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:50.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1168a00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11640d1d80 0x7f11641fb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169e00640 1 -- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11640d1d80 msgr2=0x7f11641fb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169e00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11640d1d80 0x7f11641fb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169e00640 1 -- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11640cfa70 msgr2=0x7f11640cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169e00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11640cfa70 0x7f11640cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169e00640 1 -- 172.21.15.17:0/914326765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11640b79f0 con 0x7f11640d4a40 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1169e00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640d4a40 0x7f11641fb880 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f115c0197b0 tx=0x7f115c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1161600640 1 -- 172.21.15.17:0/914326765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c0bb070 con 0x7f11640d4a40 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1161600640 1 -- 172.21.15.17:0/914326765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f115c004d40 con 0x7f11640d4a40 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11640b7cd0 con 0x7f11640d4a40 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f1161600640 1 -- 172.21.15.17:0/914326765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c0b2040 con 0x7f11640d4a40 2024-09-10T23:31:50.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.222+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11640b8290 con 0x7f11640d4a40 2024-09-10T23:31:50.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.226+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11640d2160 con 0x7f11640d4a40 2024-09-10T23:31:50.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.226+0000 7f1161600640 1 -- 172.21.15.17:0/914326765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f115c0b5030 con 0x7f11640d4a40 2024-09-10T23:31:50.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.226+0000 7f1161600640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11440725e0 0x7f1144074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.226+0000 7f1161600640 1 -- 172.21.15.17:0/914326765 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(222..222 src has 1..222) ==== 6101+0+0 (secure 0 0 0) 0x7f115c12d670 con 0x7f11640d4a40 2024-09-10T23:31:50.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.226+0000 7f1169400640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11440725e0 0x7f1144074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.226+0000 7f1169400640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11440725e0 0x7f1144074aa0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1158007fd0 tx=0x7f1158009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:50.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.230+0000 7f1161600640 1 -- 172.21.15.17:0/914326765 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f115c016790 con 0x7f11640d4a40 2024-09-10T23:31:50.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.406+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11640b8ff0 con 0x7f11640d4a40 2024-09-10T23:31:50.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.406+0000 7f1161600640 1 -- 172.21.15.17:0/914326765 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v222) ==== 74+0+16901 (secure 0 0 0) 0x7f115c101240 con 0x7f11640d4a40 2024-09-10T23:31:50.410 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:50.410 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":222,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:49.430029+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:47.126569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:48.387269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11440725e0 msgr2=0x7f1144074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11440725e0 0x7f1144074aa0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1158007fd0 tx=0x7f1158009040 comp rx=0 tx=0).stop 2024-09-10T23:31:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640d4a40 msgr2=0x7f11641fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640d4a40 0x7f11641fb880 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f115c0197b0 tx=0x7f115c004270 comp rx=0 tx=0).stop 2024-09-10T23:31:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 shutdown_connections 2024-09-10T23:31:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f11440725e0 0x7f1144074aa0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11640d4a40 0x7f11641fb880 unknown :-1 s=CLOSED pgs=2544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f11640d1d80 0x7f11641fb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 --2- 172.21.15.17:0/914326765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11640cfa70 0x7f11640cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 >> 172.21.15.17:0/914326765 conn(0x7f11640d3f50 msgr2=0x7f11640b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 shutdown_connections 2024-09-10T23:31:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.410+0000 7f116be00640 1 -- 172.21.15.17:0/914326765 wait complete. 2024-09-10T23:31:50.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:50.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 -- 172.21.15.17:0/2388106403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a38069510 msgr2=0x7f8a380cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 --2- 172.21.15.17:0/2388106403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a38069510 0x7f8a380cda90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009c80 tx=0x7f8a3001cda0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 -- 172.21.15.17:0/2388106403 shutdown_connections 2024-09-10T23:31:50.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 --2- 172.21.15.17:0/2388106403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a38069510 0x7f8a380cda90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 --2- 172.21.15.17:0/2388106403 >> v2:172.21.15.77:3300/0 conn(0x7f8a380ce370 0x7f8a38152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 -- 172.21.15.17:0/2388106403 >> 172.21.15.17:0/2388106403 conn(0x7f8a380ccf70 msgr2=0x7f8a380cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:50.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 -- 172.21.15.17:0/2388106403 shutdown_connections 2024-09-10T23:31:50.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 -- 172.21.15.17:0/2388106403 wait complete. 2024-09-10T23:31:50.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 Processor -- start 2024-09-10T23:31:50.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 -- start start 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38069510 0x7f8a38152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a380ce370 0x7f8a3813e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a3815fae0 0x7f8a3813ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3815c8c0 con 0x7f8a38069510 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3815c740 con 0x7f8a380ce370 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ea00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3815ca40 con 0x7f8a3815fae0 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a37e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38069510 0x7f8a38152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a37e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38069510 0x7f8a38152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55572/0 (socket says 172.21.15.17:55572) 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a37e00640 1 -- 172.21.15.17:0/3309712402 learned_addr learned my addr 172.21.15.17:0/3309712402 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a2fe00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a380ce370 0x7f8a3813e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a3ca00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a3815fae0 0x7f8a3813ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a37e00640 1 -- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a3815fae0 msgr2=0x7f8a3813ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a37e00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a3815fae0 0x7f8a3813ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a37e00640 1 -- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a380ce370 msgr2=0x7f8a3813e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a37e00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a380ce370 0x7f8a3813e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a37e00640 1 -- 172.21.15.17:0/3309712402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a381552e0 con 0x7f8a38069510 2024-09-10T23:31:50.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.578+0000 7f8a37e00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38069510 0x7f8a38152510 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800c3c0 tx=0x7f8a2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:50.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a34c00640 1 -- 172.21.15.17:0/3309712402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28017070 con 0x7f8a38069510 2024-09-10T23:31:50.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a34c00640 1 -- 172.21.15.17:0/3309712402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a280053c0 con 0x7f8a38069510 2024-09-10T23:31:50.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a34c00640 1 -- 172.21.15.17:0/3309712402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28003860 con 0x7f8a38069510 2024-09-10T23:31:50.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a38155580 con 0x7f8a38069510 2024-09-10T23:31:50.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a38155b40 con 0x7f8a38069510 2024-09-10T23:31:50.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a3815cf60 con 0x7f8a38069510 2024-09-10T23:31:50.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a34c00640 1 -- 172.21.15.17:0/3309712402 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8a28003a00 con 0x7f8a38069510 2024-09-10T23:31:50.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a34c00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a140725e0 0x7f8a14074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a34c00640 1 -- 172.21.15.17:0/3309712402 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(222..222 src has 1..222) ==== 6101+0+0 (secure 0 0 0) 0x7f8a280929c0 con 0x7f8a38069510 2024-09-10T23:31:50.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.582+0000 7f8a2fe00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a140725e0 0x7f8a14074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.586+0000 7f8a2fe00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a140725e0 0x7f8a14074aa0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8a3815f3d0 tx=0x7f8a200091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:50.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.586+0000 7f8a34c00640 1 -- 172.21.15.17:0/3309712402 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8a2805d820 con 0x7f8a38069510 2024-09-10T23:31:50.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a380ccce0 con 0x7f8a38069510 2024-09-10T23:31:50.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a34c00640 1 -- 172.21.15.17:0/3309712402 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v222) ==== 74+0+16901 (secure 0 0 0) 0x7f8a28062250 con 0x7f8a38069510 2024-09-10T23:31:50.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:50.766 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":222,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:49.430029+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:47.126569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:48.387269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a140725e0 msgr2=0x7f8a14074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a140725e0 0x7f8a14074aa0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f8a3815f3d0 tx=0x7f8a200091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38069510 msgr2=0x7f8a38152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38069510 0x7f8a38152510 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800c3c0 tx=0x7f8a2800c880 comp rx=0 tx=0).stop 2024-09-10T23:31:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 shutdown_connections 2024-09-10T23:31:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a140725e0 0x7f8a14074aa0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a3815fae0 0x7f8a3813ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a380ce370 0x7f8a3813e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 --2- 172.21.15.17:0/3309712402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a38069510 0x7f8a38152510 unknown :-1 s=CLOSED pgs=2545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 >> 172.21.15.17:0/3309712402 conn(0x7f8a380ccf70 msgr2=0x7f8a380cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 shutdown_connections 2024-09-10T23:31:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.762+0000 7f8a3ea00640 1 -- 172.21.15.17:0/3309712402 wait complete. 2024-09-10T23:31:50.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T23:31:50.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.934+0000 7f7efae00640 1 -- 172.21.15.17:0/1027028899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40b0700 msgr2=0x7f7ef41602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.934+0000 7f7efae00640 1 --2- 172.21.15.17:0/1027028899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40b0700 0x7f7ef41602c0 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40739b0 tx=0x7f7eec01cba0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 -- 172.21.15.17:0/1027028899 shutdown_connections 2024-09-10T23:31:50.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 --2- 172.21.15.17:0/1027028899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40b0700 0x7f7ef41602c0 unknown :-1 s=CLOSED pgs=2546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 --2- 172.21.15.17:0/1027028899 >> v2:172.21.15.77:3300/0 conn(0x7f7ef40cfdd0 0x7f7ef40d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 -- 172.21.15.17:0/1027028899 >> 172.21.15.17:0/1027028899 conn(0x7f7ef40d1d90 msgr2=0x7f7ef40d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:50.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 -- 172.21.15.17:0/1027028899 shutdown_connections 2024-09-10T23:31:50.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 -- 172.21.15.17:0/1027028899 wait complete. 2024-09-10T23:31:50.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 Processor -- start 2024-09-10T23:31:50.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 -- start start 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40b0700 0x7f7ef41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40cfdd0 0x7f7ef415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef40d28b0 0x7f7ef415d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef40b2980 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef40b2800 con 0x7f7ef40b0700 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7efae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef4168ec0 con 0x7f7ef40d28b0 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7eebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40cfdd0 0x7f7ef415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7eebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40cfdd0 0x7f7ef415ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55598/0 (socket says 172.21.15.17:55598) 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7eebe00640 1 -- 172.21.15.17:0/3910238511 learned_addr learned my addr 172.21.15.17:0/3910238511 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:50.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7ef8e00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef40d28b0 0x7f7ef415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7ef3e00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40b0700 0x7f7ef41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7eebe00640 1 -- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef40d28b0 msgr2=0x7f7ef415d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7eebe00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef40d28b0 0x7f7ef415d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7eebe00640 1 -- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40b0700 msgr2=0x7f7ef41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:50.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7eebe00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40b0700 0x7f7ef41551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:50.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7eebe00640 1 -- 172.21.15.17:0/3910238511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef40cca50 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7ef3e00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40b0700 0x7f7ef41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:50.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.938+0000 7f7eebe00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40cfdd0 0x7f7ef415ab80 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00b3e0 tx=0x7f7edc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:50.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7ef0c00640 1 -- 172.21.15.17:0/3910238511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc015020 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7ef0c00640 1 -- 172.21.15.17:0/3910238511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7edc011920 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef40ccd30 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7ef0c00640 1 -- 172.21.15.17:0/3910238511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc011db0 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef40cd2f0 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef40d01b0 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7ef0c00640 1 -- 172.21.15.17:0/3910238511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f7edc01a400 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7ef0c00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7ed00725e0 0x7f7ed0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:50.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7ef0c00640 1 -- 172.21.15.17:0/3910238511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(222..222 src has 1..222) ==== 6101+0+0 (secure 0 0 0) 0x7f7edc0932d0 con 0x7f7ef40cfdd0 2024-09-10T23:31:50.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.942+0000 7f7ef3e00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7ed00725e0 0x7f7ed0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:50.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.946+0000 7f7ef3e00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7ed00725e0 0x7f7ed0074aa0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40058d0 tx=0x7f7ee4005860 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:50.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:50.946+0000 7f7ef0c00640 1 -- 172.21.15.17:0/3910238511 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f7edc01f030 con 0x7f7ef40cfdd0 2024-09-10T23:31:51.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:51.162+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7ef4158190 con 0x7f7ef40cfdd0 2024-09-10T23:31:51.986 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:31:51.982+0000 7f2cb6e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:31:52.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7ef0c00640 1 -- 172.21.15.17:0/3910238511 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v168) ==== 118+0+0 (secure 0 0 0) 0x7f7edc05e810 con 0x7f7ef40cfdd0 2024-09-10T23:31:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7ed00725e0 msgr2=0x7f7ed0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7ed00725e0 0x7f7ed0074aa0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40058d0 tx=0x7f7ee4005860 comp rx=0 tx=0).stop 2024-09-10T23:31:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40cfdd0 msgr2=0x7f7ef415ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40cfdd0 0x7f7ef415ab80 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00b3e0 tx=0x7f7edc00b8a0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 shutdown_connections 2024-09-10T23:31:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f7ed00725e0 0x7f7ed0074aa0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef40d28b0 0x7f7ef415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ef40cfdd0 0x7f7ef415ab80 unknown :-1 s=CLOSED pgs=2547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 --2- 172.21.15.17:0/3910238511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef40b0700 0x7f7ef41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.030+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 >> 172.21.15.17:0/3910238511 conn(0x7f7ef40d1d90 msgr2=0x7f7ef4158990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:52.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.034+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 shutdown_connections 2024-09-10T23:31:52.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.034+0000 7f7efae00640 1 -- 172.21.15.17:0/3910238511 wait complete. 2024-09-10T23:31:52.056 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T23:31:52.056 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T23:31:52.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.206+0000 7fb378200640 1 -- 172.21.15.17:0/2033839149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015cf80 msgr2=0x7fb37006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.206+0000 7fb378200640 1 --2- 172.21.15.17:0/2033839149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015cf80 0x7fb37006ed70 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7fb3700cdeb0 tx=0x7fb36801d7b0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.206+0000 7fb378200640 1 -- 172.21.15.17:0/2033839149 shutdown_connections 2024-09-10T23:31:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.206+0000 7fb378200640 1 --2- 172.21.15.17:0/2033839149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015cf80 0x7fb37006ed70 unknown :-1 s=CLOSED pgs=2548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.206+0000 7fb378200640 1 --2- 172.21.15.17:0/2033839149 >> v2:172.21.15.77:3300/0 conn(0x7fb37015c000 0x7fb37006e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.206+0000 7fb378200640 1 -- 172.21.15.17:0/2033839149 >> 172.21.15.17:0/2033839149 conn(0x7fb37006c360 msgr2=0x7fb37006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 -- 172.21.15.17:0/2033839149 shutdown_connections 2024-09-10T23:31:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 -- 172.21.15.17:0/2033839149 wait complete. 2024-09-10T23:31:52.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 Processor -- start 2024-09-10T23:31:52.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 -- start start 2024-09-10T23:31:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015bc20 0x7fb370153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb37015c000 0x7fb370164e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb37015cf80 0x7fb370165340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb370168c60 con 0x7fb37015bc20 2024-09-10T23:31:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb370168de0 con 0x7fb37015c000 2024-09-10T23:31:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb370168f60 con 0x7fb37015cf80 2024-09-10T23:31:52.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb375800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015bc20 0x7fb370153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb375800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015bc20 0x7fb370153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55616/0 (socket says 172.21.15.17:55616) 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb375800640 1 -- 172.21.15.17:0/2445849365 learned_addr learned my addr 172.21.15.17:0/2445849365 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb374e00640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb37015c000 0x7fb370164e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb376200640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb37015cf80 0x7fb370165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb375800640 1 -- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb37015cf80 msgr2=0x7fb370165340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb375800640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb37015cf80 0x7fb370165340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb375800640 1 -- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb37015c000 msgr2=0x7fb370164e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb375800640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb37015c000 0x7fb370164e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb375800640 1 -- 172.21.15.17:0/2445849365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3700ce7d0 con 0x7fb37015bc20 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb375800640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015bc20 0x7fb370153860 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7fb36400c490 tx=0x7fb364001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb36d600640 1 -- 172.21.15.17:0/2445849365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364017070 con 0x7fb37015bc20 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb36d600640 1 -- 172.21.15.17:0/2445849365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb364003600 con 0x7fb37015bc20 2024-09-10T23:31:52.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3700ceab0 con 0x7fb37015bc20 2024-09-10T23:31:52.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.210+0000 7fb36d600640 1 -- 172.21.15.17:0/2445849365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364003a90 con 0x7fb37015bc20 2024-09-10T23:31:52.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.214+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3700cf070 con 0x7fb37015bc20 2024-09-10T23:31:52.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.214+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb37006a4b0 con 0x7fb37015bc20 2024-09-10T23:31:52.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.214+0000 7fb36d600640 1 -- 172.21.15.17:0/2445849365 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb364003c30 con 0x7fb37015bc20 2024-09-10T23:31:52.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.214+0000 7fb36d600640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:52.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.214+0000 7fb36d600640 1 -- 172.21.15.17:0/2445849365 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7fb364092a80 con 0x7fb37015bc20 2024-09-10T23:31:52.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.214+0000 7fb374e00640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:52.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.214+0000 7fb374e00640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb35c005e10 tx=0x7fb35c005da0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:52.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.218+0000 7fb36d600640 1 -- 172.21.15.17:0/2445849365 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fb364094e20 con 0x7fb37015bc20 2024-09-10T23:31:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:52.426+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb37006f5a0 con 0x7fb37015bc20 2024-09-10T23:31:53.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.034+0000 7fb36d600640 1 -- 172.21.15.17:0/2445849365 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v169) ==== 122+0+0 (secure 0 0 0) 0x7fb36405dfc0 con 0x7fb37015bc20 2024-09-10T23:31:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 msgr2=0x7fb350074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb35c005e10 tx=0x7fb35c005da0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015bc20 msgr2=0x7fb370153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015bc20 0x7fb370153860 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7fb36400c490 tx=0x7fb364001e80 comp rx=0 tx=0).stop 2024-09-10T23:31:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 shutdown_connections 2024-09-10T23:31:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb3500725e0 0x7fb350074aa0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb37015cf80 0x7fb370165340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb37015c000 0x7fb370164e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 --2- 172.21.15.17:0/2445849365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb37015bc20 0x7fb370153860 unknown :-1 s=CLOSED pgs=2549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 >> 172.21.15.17:0/2445849365 conn(0x7fb37006c360 msgr2=0x7fb37015a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 shutdown_connections 2024-09-10T23:31:53.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.038+0000 7fb378200640 1 -- 172.21.15.17:0/2445849365 wait complete. 2024-09-10T23:31:53.064 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T23:31:53.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:53.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 -- 172.21.15.17:0/1959736340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8000cfb20 msgr2=0x7fd8000d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 --2- 172.21.15.17:0/1959736340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8000cfb20 0x7fd8000d0600 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009bc0 tx=0x7fd7f801cba0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 -- 172.21.15.17:0/1959736340 shutdown_connections 2024-09-10T23:31:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 --2- 172.21.15.17:0/1959736340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8000cfb20 0x7fd8000d0600 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 -- 172.21.15.17:0/1959736340 >> 172.21.15.17:0/1959736340 conn(0x7fd8000d1d40 msgr2=0x7fd8000d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 -- 172.21.15.17:0/1959736340 shutdown_connections 2024-09-10T23:31:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 -- 172.21.15.17:0/1959736340 wait complete. 2024-09-10T23:31:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 Processor -- start 2024-09-10T23:31:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 -- start start 2024-09-10T23:31:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8000cdf60 0x7fd8001520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8000ce4b0 0x7fd800151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8000cfb20 0x7fd8000b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd80016a840 con 0x7fd8000cdf60 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd80016a6c0 con 0x7fd8000cfb20 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd805e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd80016a9c0 con 0x7fd8000ce4b0 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd7fea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8000cdf60 0x7fd8001520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.214+0000 7fd7fea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8000cdf60 0x7fd8001520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55630/0 (socket says 172.21.15.17:55630) 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7fea00640 1 -- 172.21.15.17:0/52700706 learned_addr learned my addr 172.21.15.17:0/52700706 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7ff400640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8000cfb20 0x7fd8000b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7f7e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8000ce4b0 0x7fd800151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7fea00640 1 -- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8000ce4b0 msgr2=0x7fd800151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7fea00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8000ce4b0 0x7fd800151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7fea00640 1 -- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8000cfb20 msgr2=0x7fd8000b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7fea00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8000cfb20 0x7fd8000b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7fea00640 1 -- 172.21.15.17:0/52700706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8000b3d80 con 0x7fd8000cdf60 2024-09-10T23:31:53.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7f7e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8000ce4b0 0x7fd800151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:53.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7fea00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8000cdf60 0x7fd8001520a0 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c500 tx=0x7fd7f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7f7400640 1 -- 172.21.15.17:0/52700706 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0017070 con 0x7fd8000cdf60 2024-09-10T23:31:53.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7f7400640 1 -- 172.21.15.17:0/52700706 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f0003600 con 0x7fd8000cdf60 2024-09-10T23:31:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7f7400640 1 -- 172.21.15.17:0/52700706 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0003a90 con 0x7fd8000cdf60 2024-09-10T23:31:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8000b4060 con 0x7fd8000cdf60 2024-09-10T23:31:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8000b1550 con 0x7fd8000cdf60 2024-09-10T23:31:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8000b1970 con 0x7fd8000cdf60 2024-09-10T23:31:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.218+0000 7fd7f7400640 1 -- 172.21.15.17:0/52700706 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd7f0003c30 con 0x7fd8000cdf60 2024-09-10T23:31:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.222+0000 7fd7f7400640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7dc0725e0 0x7fd7dc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.222+0000 7fd7f7400640 1 -- 172.21.15.17:0/52700706 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7fd7f0092ab0 con 0x7fd8000cdf60 2024-09-10T23:31:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.222+0000 7fd7f7e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7dc0725e0 0x7fd7dc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.222+0000 7fd7f7e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7dc0725e0 0x7fd7dc074aa0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8007a60 tx=0x7fd7e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.226+0000 7fd7f7400640 1 -- 172.21.15.17:0/52700706 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd8000b1970 con 0x7fd8000cdf60 2024-09-10T23:31:53.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8000b1790 con 0x7fd8000cdf60 2024-09-10T23:31:53.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd7f7400640 1 -- 172.21.15.17:0/52700706 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5237 (secure 0 0 0) 0x7fd8000b1790 con 0x7fd8000cdf60 2024-09-10T23:31:53.437 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:53.437 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":169,"btime":"2024-09-10T23:31:53:033605+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:31:52.432930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11823":{"gid":11823,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1849575634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1849575634},{"type":"v1","addr":"172.21.15.17:6835","nonce":1849575634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11823,"qdb_cluster":[11823]},"id":16}]} 2024-09-10T23:31:53.437 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 169 2024-09-10T23:31:53.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7dc0725e0 msgr2=0x7fd7dc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7dc0725e0 0x7fd7dc074aa0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8007a60 tx=0x7fd7e8009040 comp rx=0 tx=0).stop 2024-09-10T23:31:53.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8000cdf60 msgr2=0x7fd8001520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8000cdf60 0x7fd8001520a0 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c500 tx=0x7fd7f000c9c0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 shutdown_connections 2024-09-10T23:31:53.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd7dc0725e0 0x7fd7dc074aa0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8000cfb20 0x7fd8000b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd8000ce4b0 0x7fd800151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 --2- 172.21.15.17:0/52700706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8000cdf60 0x7fd8001520a0 unknown :-1 s=CLOSED pgs=2551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 >> 172.21.15.17:0/52700706 conn(0x7fd8000d1d40 msgr2=0x7fd8000ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 shutdown_connections 2024-09-10T23:31:53.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.434+0000 7fd805e00640 1 -- 172.21.15.17:0/52700706 wait complete. 2024-09-10T23:31:53.458 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:31:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 -- 172.21.15.17:0/347545691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c1600d0 msgr2=0x7f774c166970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 --2- 172.21.15.17:0/347545691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c1600d0 0x7f774c166970 secure :-1 s=READY pgs=2553 cs=0 l=1 rev1=1 crypto rx=0x7f7744009c80 tx=0x7f774401cda0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 -- 172.21.15.17:0/347545691 shutdown_connections 2024-09-10T23:31:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 --2- 172.21.15.17:0/347545691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c1600d0 0x7f774c166970 unknown :-1 s=CLOSED pgs=2553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 -- 172.21.15.17:0/347545691 >> 172.21.15.17:0/347545691 conn(0x7f774c0b1850 msgr2=0x7f774c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 -- 172.21.15.17:0/347545691 shutdown_connections 2024-09-10T23:31:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 -- 172.21.15.17:0/347545691 wait complete. 2024-09-10T23:31:53.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 Processor -- start 2024-09-10T23:31:53.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 -- start start 2024-09-10T23:31:53.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f774c0d0180 0x7f774c138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c145570 0x7f774c13c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f774c1600d0 0x7f774c13c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f774c169ee0 con 0x7f774c145570 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f774c169d60 con 0x7f774c0d0180 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7753e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f774c16a060 con 0x7f774c1600d0 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7750a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c145570 0x7f774c13c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7750a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c145570 0x7f774c13c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55638/0 (socket says 172.21.15.17:55638) 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7750a00640 1 -- 172.21.15.17:0/5757996 learned_addr learned my addr 172.21.15.17:0/5757996 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7751400640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f774c0d0180 0x7f774c138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7751e00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f774c1600d0 0x7f774c13c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7750a00640 1 -- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f774c1600d0 msgr2=0x7f774c13c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7750a00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f774c1600d0 0x7f774c13c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7750a00640 1 -- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f774c0d0180 msgr2=0x7f774c138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7750a00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f774c0d0180 0x7f774c138050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7750a00640 1 -- 172.21.15.17:0/5757996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774c13f310 con 0x7f774c145570 2024-09-10T23:31:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.602+0000 7f7751e00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f774c1600d0 0x7f774c13c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7750a00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c145570 0x7f774c13c250 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7f773800c450 tx=0x7f773800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7749600640 1 -- 172.21.15.17:0/5757996 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738012830 con 0x7f774c145570 2024-09-10T23:31:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7749600640 1 -- 172.21.15.17:0/5757996 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7738017070 con 0x7f774c145570 2024-09-10T23:31:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f774c1f9120 con 0x7f774c145570 2024-09-10T23:31:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7749600640 1 -- 172.21.15.17:0/5757996 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738012d80 con 0x7f774c145570 2024-09-10T23:31:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f774c1f96e0 con 0x7f774c145570 2024-09-10T23:31:53.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774c075ad0 con 0x7f774c145570 2024-09-10T23:31:53.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7749600640 1 -- 172.21.15.17:0/5757996 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f773801c460 con 0x7f774c145570 2024-09-10T23:31:53.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7749600640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f772c072610 0x7f772c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7749600640 1 -- 172.21.15.17:0/5757996 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7f77380931a0 con 0x7f774c145570 2024-09-10T23:31:53.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.606+0000 7f7751400640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f772c072610 0x7f772c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.610+0000 7f7751400640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f772c072610 0x7f772c074ad0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f77400016f0 tx=0x7f7740009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.610+0000 7f7749600640 1 -- 172.21.15.17:0/5757996 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f773805e6e0 con 0x7f774c145570 2024-09-10T23:31:53.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.790+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f774c15f9c0 con 0x7f774c145570 2024-09-10T23:31:53.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.790+0000 7f7749600640 1 -- 172.21.15.17:0/5757996 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v223) ==== 74+0+16888 (secure 0 0 0) 0x7f773805dfe0 con 0x7f774c145570 2024-09-10T23:31:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:53.794 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":223,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:31:51.021290+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:47.126569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:48.387269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"223","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:31:53.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f772c072610 msgr2=0x7f772c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f772c072610 0x7f772c074ad0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f77400016f0 tx=0x7f7740009040 comp rx=0 tx=0).stop 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c145570 msgr2=0x7f774c13c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c145570 0x7f774c13c250 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7f773800c450 tx=0x7f773800c910 comp rx=0 tx=0).stop 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 shutdown_connections 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f772c072610 0x7f772c074ad0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f774c1600d0 0x7f774c13c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f774c145570 0x7f774c13c250 unknown :-1 s=CLOSED pgs=2554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 --2- 172.21.15.17:0/5757996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f774c0d0180 0x7f774c138050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 >> 172.21.15.17:0/5757996 conn(0x7f774c0b1850 msgr2=0x7f774c141160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 shutdown_connections 2024-09-10T23:31:53.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.794+0000 7f7753e00640 1 -- 172.21.15.17:0/5757996 wait complete. 2024-09-10T23:31:53.817 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:31:53.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:31:53.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 -- 172.21.15.17:0/4205108039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc0745e0 msgr2=0x7ff0fc15b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 --2- 172.21.15.17:0/4205108039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc0745e0 0x7ff0fc15b2f0 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc073980 tx=0x7ff0e401c800 comp rx=0 tx=0).stop 2024-09-10T23:31:53.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 -- 172.21.15.17:0/4205108039 shutdown_connections 2024-09-10T23:31:53.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 --2- 172.21.15.17:0/4205108039 >> v2:172.21.15.77:3300/0 conn(0x7ff0fc070030 0x7ff0fc0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 --2- 172.21.15.17:0/4205108039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc0745e0 0x7ff0fc15b2f0 unknown :-1 s=CLOSED pgs=2556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 -- 172.21.15.17:0/4205108039 >> 172.21.15.17:0/4205108039 conn(0x7ff0fc0b1850 msgr2=0x7ff0fc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:53.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 -- 172.21.15.17:0/4205108039 shutdown_connections 2024-09-10T23:31:53.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 -- 172.21.15.17:0/4205108039 wait complete. 2024-09-10T23:31:53.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 Processor -- start 2024-09-10T23:31:53.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 -- start start 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc06fc50 0x7ff0fc14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0fc070030 0x7ff0fc14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0fc0745e0 0x7ff0fc14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc167200 con 0x7ff0fc06fc50 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc06f390 con 0x7ff0fc0745e0 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff100c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff0fc167380 con 0x7ff0fc070030 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0f9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc06fc50 0x7ff0fc14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0f9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc06fc50 0x7ff0fc14d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55664/0 (socket says 172.21.15.17:55664) 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0f9e00640 1 -- 172.21.15.17:0/490407290 learned_addr learned my addr 172.21.15.17:0/490407290 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0fa800640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0fc0745e0 0x7ff0fc14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0f3e00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0fc070030 0x7ff0fc14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0f9e00640 1 -- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0fc070030 msgr2=0x7ff0fc14b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0f9e00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0fc070030 0x7ff0fc14b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0f9e00640 1 -- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0fc0745e0 msgr2=0x7ff0fc14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0f9e00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0fc0745e0 0x7ff0fc14f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0f9e00640 1 -- 172.21.15.17:0/490407290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0fc14d8a0 con 0x7ff0fc06fc50 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.962+0000 7ff0fa800640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0fc0745e0 0x7ff0fc14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.966+0000 7ff0f9e00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc06fc50 0x7ff0fc14d180 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c500 tx=0x7ff0ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.966+0000 7ff0f2000640 1 -- 172.21.15.17:0/490407290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec017070 con 0x7ff0fc06fc50 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.966+0000 7ff0f2000640 1 -- 172.21.15.17:0/490407290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0ec003600 con 0x7ff0fc06fc50 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.966+0000 7ff0f2000640 1 -- 172.21.15.17:0/490407290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec003a90 con 0x7ff0fc06fc50 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.966+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0fc14db80 con 0x7ff0fc06fc50 2024-09-10T23:31:53.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.966+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0fc14e140 con 0x7ff0fc06fc50 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.966+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0fc075ad0 con 0x7ff0fc06fc50 2024-09-10T23:31:53.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.966+0000 7ff0f2000640 1 -- 172.21.15.17:0/490407290 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff0ec003c30 con 0x7ff0fc06fc50 2024-09-10T23:31:53.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.966+0000 7ff0f2000640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0d80725e0 0x7ff0d8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:53.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.970+0000 7ff0f2000640 1 -- 172.21.15.17:0/490407290 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7ff0ec092c40 con 0x7ff0fc06fc50 2024-09-10T23:31:53.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.970+0000 7ff0f3e00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0d80725e0 0x7ff0d8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:53.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.970+0000 7ff0f3e00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0d80725e0 0x7ff0d8074aa0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40af000 tx=0x7ff0e401b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:53.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:53.970+0000 7ff0f2000640 1 -- 172.21.15.17:0/490407290 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff0ec05e240 con 0x7ff0fc06fc50 2024-09-10T23:31:54.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.142+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0fc0b55a0 con 0x7ff0d80725e0 2024-09-10T23:31:54.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff0f2000640 1 -- 172.21.15.17:0/490407290 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250586 (secure 0 0 0) 0x7ff0fc0b55a0 con 0x7ff0d80725e0 2024-09-10T23:31:54.154 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:54.156 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:31:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0d80725e0 msgr2=0x7ff0d8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0d80725e0 0x7ff0d8074aa0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40af000 tx=0x7ff0e401b040 comp rx=0 tx=0).stop 2024-09-10T23:31:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc06fc50 msgr2=0x7ff0fc14d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc06fc50 0x7ff0fc14d180 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00c500 tx=0x7ff0ec00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 shutdown_connections 2024-09-10T23:31:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0d80725e0 0x7ff0d8074aa0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0fc0745e0 0x7ff0fc14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0fc070030 0x7ff0fc14b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 --2- 172.21.15.17:0/490407290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0fc06fc50 0x7ff0fc14d180 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 >> 172.21.15.17:0/490407290 conn(0x7ff0fc0b1850 msgr2=0x7ff0fc15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 shutdown_connections 2024-09-10T23:31:54.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.150+0000 7ff100c00640 1 -- 172.21.15.17:0/490407290 wait complete. 2024-09-10T23:31:54.175 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":711,"stamp":"2024-09-10T23:31:52.532691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":576332,"kb_used_data":22996,"kb_used_omap":12,"kb_used_meta":553139,"kb_avail":754398388,"statfs":{"total":773094113280,"available":772503949312,"internally_reserved":0,"allocated":23547904,"data_stored":11684600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":566414897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.525515"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.039335+0000","last_change":"2024-09-10T23:31:50.035569+0000","last_active":"2024-09-10T23:31:50.039335+0000","last_peered":"2024-09-10T23:31:50.039335+0000","last_clean":"2024-09-10T23:31:50.039335+0000","last_became_active":"2024-09-10T23:31:50.035043+0000","last_became_peered":"2024-09-10T23:31:50.035043+0000","last_unstale":"2024-09-10T23:31:50.039335+0000","last_undegraded":"2024-09-10T23:31:50.039335+0000","last_fullsized":"2024-09-10T23:31:50.039335+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:46.564319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.056190+0000","last_change":"2024-09-10T23:31:50.053661+0000","last_active":"2024-09-10T23:31:50.056190+0000","last_peered":"2024-09-10T23:31:50.056190+0000","last_clean":"2024-09-10T23:31:50.056190+0000","last_became_active":"2024-09-10T23:31:50.053409+0000","last_became_peered":"2024-09-10T23:31:50.053409+0000","last_unstale":"2024-09-10T23:31:50.056190+0000","last_undegraded":"2024-09-10T23:31:50.056190+0000","last_fullsized":"2024-09-10T23:31:50.056190+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:57.687168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.058620+0000","last_change":"2024-09-10T23:31:50.057475+0000","last_active":"2024-09-10T23:31:50.058620+0000","last_peered":"2024-09-10T23:31:50.058620+0000","last_clean":"2024-09-10T23:31:50.058620+0000","last_became_active":"2024-09-10T23:31:50.057151+0000","last_became_peered":"2024-09-10T23:31:50.057151+0000","last_unstale":"2024-09-10T23:31:50.058620+0000","last_undegraded":"2024-09-10T23:31:50.058620+0000","last_fullsized":"2024-09-10T23:31:50.058620+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:56.373548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:31:49.001016+0000","last_change":"2024-09-10T23:31:49.001016+0000","last_active":"2024-09-10T23:31:49.001016+0000","last_peered":"2024-09-10T23:31:49.001016+0000","last_clean":"2024-09-10T23:31:49.001016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:49.001016+0000","last_undegraded":"2024-09-10T23:31:49.001016+0000","last_fullsized":"2024-09-10T23:31:49.001016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050884+0000","last_change":"2024-09-10T23:31:50.041935+0000","last_active":"2024-09-10T23:31:50.050884+0000","last_peered":"2024-09-10T23:31:50.050884+0000","last_clean":"2024-09-10T23:31:50.050884+0000","last_became_active":"2024-09-10T23:31:50.041666+0000","last_became_peered":"2024-09-10T23:31:50.041666+0000","last_unstale":"2024-09-10T23:31:50.050884+0000","last_undegraded":"2024-09-10T23:31:50.050884+0000","last_fullsized":"2024-09-10T23:31:50.050884+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:31.983389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.046725+0000","last_change":"2024-09-10T23:31:50.045748+0000","last_active":"2024-09-10T23:31:50.046725+0000","last_peered":"2024-09-10T23:31:50.046725+0000","last_clean":"2024-09-10T23:31:50.046725+0000","last_became_active":"2024-09-10T23:31:50.045468+0000","last_became_peered":"2024-09-10T23:31:50.045468+0000","last_unstale":"2024-09-10T23:31:50.046725+0000","last_undegraded":"2024-09-10T23:31:50.046725+0000","last_fullsized":"2024-09-10T23:31:50.046725+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:45.875556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.052670+0000","last_change":"2024-09-10T23:31:50.049646+0000","last_active":"2024-09-10T23:31:50.052670+0000","last_peered":"2024-09-10T23:31:50.052670+0000","last_clean":"2024-09-10T23:31:50.052670+0000","last_became_active":"2024-09-10T23:31:50.048700+0000","last_became_peered":"2024-09-10T23:31:50.048700+0000","last_unstale":"2024-09-10T23:31:50.052670+0000","last_undegraded":"2024-09-10T23:31:50.052670+0000","last_fullsized":"2024-09-10T23:31:50.052670+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:09.165664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:31:49.001016+0000","last_change":"2024-09-10T23:31:49.001016+0000","last_active":"2024-09-10T23:31:49.001016+0000","last_peered":"2024-09-10T23:31:49.001016+0000","last_clean":"2024-09-10T23:31:49.001016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:49.001016+0000","last_undegraded":"2024-09-10T23:31:49.001016+0000","last_fullsized":"2024-09-10T23:31:49.001016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.056476+0000","last_change":"2024-09-10T23:31:50.056024+0000","last_active":"2024-09-10T23:31:50.056476+0000","last_peered":"2024-09-10T23:31:50.056476+0000","last_clean":"2024-09-10T23:31:50.056476+0000","last_became_active":"2024-09-10T23:31:50.055616+0000","last_became_peered":"2024-09-10T23:31:50.055616+0000","last_unstale":"2024-09-10T23:31:50.056476+0000","last_undegraded":"2024-09-10T23:31:50.056476+0000","last_fullsized":"2024-09-10T23:31:50.056476+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:59.279430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.056377+0000","last_change":"2024-09-10T23:31:50.055656+0000","last_active":"2024-09-10T23:31:50.056377+0000","last_peered":"2024-09-10T23:31:50.056377+0000","last_clean":"2024-09-10T23:31:50.056377+0000","last_became_active":"2024-09-10T23:31:50.055349+0000","last_became_peered":"2024-09-10T23:31:50.055349+0000","last_unstale":"2024-09-10T23:31:50.056377+0000","last_undegraded":"2024-09-10T23:31:50.056377+0000","last_fullsized":"2024-09-10T23:31:50.056377+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:51.407958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.040809+0000","last_change":"2024-09-10T23:31:50.032596+0000","last_active":"2024-09-10T23:31:50.040809+0000","last_peered":"2024-09-10T23:31:50.040809+0000","last_clean":"2024-09-10T23:31:50.040809+0000","last_became_active":"2024-09-10T23:31:50.032322+0000","last_became_peered":"2024-09-10T23:31:50.032322+0000","last_unstale":"2024-09-10T23:31:50.040809+0000","last_undegraded":"2024-09-10T23:31:50.040809+0000","last_fullsized":"2024-09-10T23:31:50.040809+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:29.003110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.054044+0000","last_change":"2024-09-10T23:31:50.052837+0000","last_active":"2024-09-10T23:31:50.054044+0000","last_peered":"2024-09-10T23:31:50.054044+0000","last_clean":"2024-09-10T23:31:50.054044+0000","last_became_active":"2024-09-10T23:31:50.051639+0000","last_became_peered":"2024-09-10T23:31:50.051639+0000","last_unstale":"2024-09-10T23:31:50.054044+0000","last_undegraded":"2024-09-10T23:31:50.054044+0000","last_fullsized":"2024-09-10T23:31:50.054044+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:29.369283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:31:49.001016+0000","last_change":"2024-09-10T23:31:49.001016+0000","last_active":"2024-09-10T23:31:49.001016+0000","last_peered":"2024-09-10T23:31:49.001016+0000","last_clean":"2024-09-10T23:31:49.001016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:49.001016+0000","last_undegraded":"2024-09-10T23:31:49.001016+0000","last_fullsized":"2024-09-10T23:31:49.001016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050059+0000","last_change":"2024-09-10T23:31:50.033811+0000","last_active":"2024-09-10T23:31:50.050059+0000","last_peered":"2024-09-10T23:31:50.050059+0000","last_clean":"2024-09-10T23:31:50.050059+0000","last_became_active":"2024-09-10T23:31:50.033510+0000","last_became_peered":"2024-09-10T23:31:50.033510+0000","last_unstale":"2024-09-10T23:31:50.050059+0000","last_undegraded":"2024-09-10T23:31:50.050059+0000","last_fullsized":"2024-09-10T23:31:50.050059+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:34.891682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.044774+0000","last_change":"2024-09-10T23:31:50.033257+0000","last_active":"2024-09-10T23:31:50.044774+0000","last_peered":"2024-09-10T23:31:50.044774+0000","last_clean":"2024-09-10T23:31:50.044774+0000","last_became_active":"2024-09-10T23:31:50.026122+0000","last_became_peered":"2024-09-10T23:31:50.026122+0000","last_unstale":"2024-09-10T23:31:50.044774+0000","last_undegraded":"2024-09-10T23:31:50.044774+0000","last_fullsized":"2024-09-10T23:31:50.044774+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:01.651318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.049648+0000","last_change":"2024-09-10T23:31:50.038032+0000","last_active":"2024-09-10T23:31:50.049648+0000","last_peered":"2024-09-10T23:31:50.049648+0000","last_clean":"2024-09-10T23:31:50.049648+0000","last_became_active":"2024-09-10T23:31:50.037769+0000","last_became_peered":"2024-09-10T23:31:50.037769+0000","last_unstale":"2024-09-10T23:31:50.049648+0000","last_undegraded":"2024-09-10T23:31:50.049648+0000","last_fullsized":"2024-09-10T23:31:50.049648+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:17.997608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.059666+0000","last_change":"2024-09-10T23:31:50.059094+0000","last_active":"2024-09-10T23:31:50.059666+0000","last_peered":"2024-09-10T23:31:50.059666+0000","last_clean":"2024-09-10T23:31:50.059666+0000","last_became_active":"2024-09-10T23:31:50.058752+0000","last_became_peered":"2024-09-10T23:31:50.058752+0000","last_unstale":"2024-09-10T23:31:50.059666+0000","last_undegraded":"2024-09-10T23:31:50.059666+0000","last_fullsized":"2024-09-10T23:31:50.059666+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:59.418468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.059076+0000","last_change":"2024-09-10T23:31:50.053843+0000","last_active":"2024-09-10T23:31:50.059076+0000","last_peered":"2024-09-10T23:31:50.059076+0000","last_clean":"2024-09-10T23:31:50.059076+0000","last_became_active":"2024-09-10T23:31:50.053171+0000","last_became_peered":"2024-09-10T23:31:50.053171+0000","last_unstale":"2024-09-10T23:31:50.059076+0000","last_undegraded":"2024-09-10T23:31:50.059076+0000","last_fullsized":"2024-09-10T23:31:50.059076+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:06.624056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051538+0000","last_change":"2024-09-10T23:31:50.049444+0000","last_active":"2024-09-10T23:31:50.051538+0000","last_peered":"2024-09-10T23:31:50.051538+0000","last_clean":"2024-09-10T23:31:50.051538+0000","last_became_active":"2024-09-10T23:31:50.049177+0000","last_became_peered":"2024-09-10T23:31:50.049177+0000","last_unstale":"2024-09-10T23:31:50.051538+0000","last_undegraded":"2024-09-10T23:31:50.051538+0000","last_fullsized":"2024-09-10T23:31:50.051538+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:06.557253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.047073+0000","last_change":"2024-09-10T23:31:50.042445+0000","last_active":"2024-09-10T23:31:50.047073+0000","last_peered":"2024-09-10T23:31:50.047073+0000","last_clean":"2024-09-10T23:31:50.047073+0000","last_became_active":"2024-09-10T23:31:50.042131+0000","last_became_peered":"2024-09-10T23:31:50.042131+0000","last_unstale":"2024-09-10T23:31:50.047073+0000","last_undegraded":"2024-09-10T23:31:50.047073+0000","last_fullsized":"2024-09-10T23:31:50.047073+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:15.396434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050854+0000","last_change":"2024-09-10T23:31:50.041304+0000","last_active":"2024-09-10T23:31:50.050854+0000","last_peered":"2024-09-10T23:31:50.050854+0000","last_clean":"2024-09-10T23:31:50.050854+0000","last_became_active":"2024-09-10T23:31:50.040810+0000","last_became_peered":"2024-09-10T23:31:50.040810+0000","last_unstale":"2024-09-10T23:31:50.050854+0000","last_undegraded":"2024-09-10T23:31:50.050854+0000","last_fullsized":"2024-09-10T23:31:50.050854+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:13.277365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.037806+0000","last_change":"2024-09-10T23:31:50.033734+0000","last_active":"2024-09-10T23:31:50.037806+0000","last_peered":"2024-09-10T23:31:50.037806+0000","last_clean":"2024-09-10T23:31:50.037806+0000","last_became_active":"2024-09-10T23:31:50.033491+0000","last_became_peered":"2024-09-10T23:31:50.033491+0000","last_unstale":"2024-09-10T23:31:50.037806+0000","last_undegraded":"2024-09-10T23:31:50.037806+0000","last_fullsized":"2024-09-10T23:31:50.037806+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:25.530844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.042731+0000","last_change":"2024-09-10T23:31:50.027276+0000","last_active":"2024-09-10T23:31:50.042731+0000","last_peered":"2024-09-10T23:31:50.042731+0000","last_clean":"2024-09-10T23:31:50.042731+0000","last_became_active":"2024-09-10T23:31:50.026998+0000","last_became_peered":"2024-09-10T23:31:50.026998+0000","last_unstale":"2024-09-10T23:31:50.042731+0000","last_undegraded":"2024-09-10T23:31:50.042731+0000","last_fullsized":"2024-09-10T23:31:50.042731+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:45.499641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.041576+0000","last_change":"2024-09-10T23:31:50.037962+0000","last_active":"2024-09-10T23:31:50.041576+0000","last_peered":"2024-09-10T23:31:50.041576+0000","last_clean":"2024-09-10T23:31:50.041576+0000","last_became_active":"2024-09-10T23:31:50.037665+0000","last_became_peered":"2024-09-10T23:31:50.037665+0000","last_unstale":"2024-09-10T23:31:50.041576+0000","last_undegraded":"2024-09-10T23:31:50.041576+0000","last_fullsized":"2024-09-10T23:31:50.041576+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:01.925769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.042457+0000","last_change":"2024-09-10T23:31:50.040610+0000","last_active":"2024-09-10T23:31:50.042457+0000","last_peered":"2024-09-10T23:31:50.042457+0000","last_clean":"2024-09-10T23:31:50.042457+0000","last_became_active":"2024-09-10T23:31:50.040350+0000","last_became_peered":"2024-09-10T23:31:50.040350+0000","last_unstale":"2024-09-10T23:31:50.042457+0000","last_undegraded":"2024-09-10T23:31:50.042457+0000","last_fullsized":"2024-09-10T23:31:50.042457+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:18.496197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.055936+0000","last_change":"2024-09-10T23:31:50.051489+0000","last_active":"2024-09-10T23:31:50.055936+0000","last_peered":"2024-09-10T23:31:50.055936+0000","last_clean":"2024-09-10T23:31:50.055936+0000","last_became_active":"2024-09-10T23:31:50.051186+0000","last_became_peered":"2024-09-10T23:31:50.051186+0000","last_unstale":"2024-09-10T23:31:50.055936+0000","last_undegraded":"2024-09-10T23:31:50.055936+0000","last_fullsized":"2024-09-10T23:31:50.055936+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:44.526664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.058626+0000","last_change":"2024-09-10T23:31:50.057666+0000","last_active":"2024-09-10T23:31:50.058626+0000","last_peered":"2024-09-10T23:31:50.058626+0000","last_clean":"2024-09-10T23:31:50.058626+0000","last_became_active":"2024-09-10T23:31:50.057034+0000","last_became_peered":"2024-09-10T23:31:50.057034+0000","last_unstale":"2024-09-10T23:31:50.058626+0000","last_undegraded":"2024-09-10T23:31:50.058626+0000","last_fullsized":"2024-09-10T23:31:50.058626+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:20.981767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.037632+0000","last_change":"2024-09-10T23:31:50.033479+0000","last_active":"2024-09-10T23:31:50.037632+0000","last_peered":"2024-09-10T23:31:50.037632+0000","last_clean":"2024-09-10T23:31:50.037632+0000","last_became_active":"2024-09-10T23:31:50.033205+0000","last_became_peered":"2024-09-10T23:31:50.033205+0000","last_unstale":"2024-09-10T23:31:50.037632+0000","last_undegraded":"2024-09-10T23:31:50.037632+0000","last_fullsized":"2024-09-10T23:31:50.037632+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:30.740474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050670+0000","last_change":"2024-09-10T23:31:50.048000+0000","last_active":"2024-09-10T23:31:50.050670+0000","last_peered":"2024-09-10T23:31:50.050670+0000","last_clean":"2024-09-10T23:31:50.050670+0000","last_became_active":"2024-09-10T23:31:50.047279+0000","last_became_peered":"2024-09-10T23:31:50.047279+0000","last_unstale":"2024-09-10T23:31:50.050670+0000","last_undegraded":"2024-09-10T23:31:50.050670+0000","last_fullsized":"2024-09-10T23:31:50.050670+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:13.210938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.048806+0000","last_change":"2024-09-10T23:31:50.033661+0000","last_active":"2024-09-10T23:31:50.048806+0000","last_peered":"2024-09-10T23:31:50.048806+0000","last_clean":"2024-09-10T23:31:50.048806+0000","last_became_active":"2024-09-10T23:31:50.033434+0000","last_became_peered":"2024-09-10T23:31:50.033434+0000","last_unstale":"2024-09-10T23:31:50.048806+0000","last_undegraded":"2024-09-10T23:31:50.048806+0000","last_fullsized":"2024-09-10T23:31:50.048806+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:54.816029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.057720+0000","last_change":"2024-09-10T23:31:50.056654+0000","last_active":"2024-09-10T23:31:50.057720+0000","last_peered":"2024-09-10T23:31:50.057720+0000","last_clean":"2024-09-10T23:31:50.057720+0000","last_became_active":"2024-09-10T23:31:50.056394+0000","last_became_peered":"2024-09-10T23:31:50.056394+0000","last_unstale":"2024-09-10T23:31:50.057720+0000","last_undegraded":"2024-09-10T23:31:50.057720+0000","last_fullsized":"2024-09-10T23:31:50.057720+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:27.689437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051342+0000","last_change":"2024-09-10T23:31:50.049905+0000","last_active":"2024-09-10T23:31:50.051342+0000","last_peered":"2024-09-10T23:31:50.051342+0000","last_clean":"2024-09-10T23:31:50.051342+0000","last_became_active":"2024-09-10T23:31:50.049092+0000","last_became_peered":"2024-09-10T23:31:50.049092+0000","last_unstale":"2024-09-10T23:31:50.051342+0000","last_undegraded":"2024-09-10T23:31:50.051342+0000","last_fullsized":"2024-09-10T23:31:50.051342+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:59.369894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"222'4","reported_seq":17,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.061949+0000","last_change":"2024-09-10T23:31:49.031425+0000","last_active":"2024-09-10T23:31:50.061949+0000","last_peered":"2024-09-10T23:31:50.061949+0000","last_clean":"2024-09-10T23:31:50.061949+0000","last_became_active":"2024-09-10T23:31:49.031058+0000","last_became_peered":"2024-09-10T23:31:49.031058+0000","last_unstale":"2024-09-10T23:31:50.061949+0000","last_undegraded":"2024-09-10T23:31:50.061949+0000","last_fullsized":"2024-09-10T23:31:50.061949+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:41.077738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.053851+0000","last_change":"2024-09-10T23:31:50.043830+0000","last_active":"2024-09-10T23:31:50.053851+0000","last_peered":"2024-09-10T23:31:50.053851+0000","last_clean":"2024-09-10T23:31:50.053851+0000","last_became_active":"2024-09-10T23:31:50.043556+0000","last_became_peered":"2024-09-10T23:31:50.043556+0000","last_unstale":"2024-09-10T23:31:50.053851+0000","last_undegraded":"2024-09-10T23:31:50.053851+0000","last_fullsized":"2024-09-10T23:31:50.053851+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:48:10.916520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.047933+0000","last_change":"2024-09-10T23:31:49.034629+0000","last_active":"2024-09-10T23:31:50.047933+0000","last_peered":"2024-09-10T23:31:50.047933+0000","last_clean":"2024-09-10T23:31:50.047933+0000","last_became_active":"2024-09-10T23:31:49.034347+0000","last_became_peered":"2024-09-10T23:31:49.034347+0000","last_unstale":"2024-09-10T23:31:50.047933+0000","last_undegraded":"2024-09-10T23:31:50.047933+0000","last_fullsized":"2024-09-10T23:31:50.047933+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:14.838166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.062117+0000","last_change":"2024-09-10T23:31:50.060440+0000","last_active":"2024-09-10T23:31:50.062117+0000","last_peered":"2024-09-10T23:31:50.062117+0000","last_clean":"2024-09-10T23:31:50.062117+0000","last_became_active":"2024-09-10T23:31:50.058307+0000","last_became_peered":"2024-09-10T23:31:50.058307+0000","last_unstale":"2024-09-10T23:31:50.062117+0000","last_undegraded":"2024-09-10T23:31:50.062117+0000","last_fullsized":"2024-09-10T23:31:50.062117+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:55.442453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.065797+0000","last_change":"2024-09-10T23:31:49.036759+0000","last_active":"2024-09-10T23:31:50.065797+0000","last_peered":"2024-09-10T23:31:50.065797+0000","last_clean":"2024-09-10T23:31:50.065797+0000","last_became_active":"2024-09-10T23:31:49.036454+0000","last_became_peered":"2024-09-10T23:31:49.036454+0000","last_unstale":"2024-09-10T23:31:50.065797+0000","last_undegraded":"2024-09-10T23:31:50.065797+0000","last_fullsized":"2024-09-10T23:31:50.065797+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:14.900913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051860+0000","last_change":"2024-09-10T23:31:50.035611+0000","last_active":"2024-09-10T23:31:50.051860+0000","last_peered":"2024-09-10T23:31:50.051860+0000","last_clean":"2024-09-10T23:31:50.051860+0000","last_became_active":"2024-09-10T23:31:50.035335+0000","last_became_peered":"2024-09-10T23:31:50.035335+0000","last_unstale":"2024-09-10T23:31:50.051860+0000","last_undegraded":"2024-09-10T23:31:50.051860+0000","last_fullsized":"2024-09-10T23:31:50.051860+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:41.376054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.057306+0000","last_change":"2024-09-10T23:31:49.043675+0000","last_active":"2024-09-10T23:31:50.057306+0000","last_peered":"2024-09-10T23:31:50.057306+0000","last_clean":"2024-09-10T23:31:50.057306+0000","last_became_active":"2024-09-10T23:31:49.043449+0000","last_became_peered":"2024-09-10T23:31:49.043449+0000","last_unstale":"2024-09-10T23:31:50.057306+0000","last_undegraded":"2024-09-10T23:31:50.057306+0000","last_fullsized":"2024-09-10T23:31:50.057306+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:52.458309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.041149+0000","last_change":"2024-09-10T23:31:50.026626+0000","last_active":"2024-09-10T23:31:50.041149+0000","last_peered":"2024-09-10T23:31:50.041149+0000","last_clean":"2024-09-10T23:31:50.041149+0000","last_became_active":"2024-09-10T23:31:50.026348+0000","last_became_peered":"2024-09-10T23:31:50.026348+0000","last_unstale":"2024-09-10T23:31:50.041149+0000","last_undegraded":"2024-09-10T23:31:50.041149+0000","last_fullsized":"2024-09-10T23:31:50.041149+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:31.480055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.049816+0000","last_change":"2024-09-10T23:31:49.030347+0000","last_active":"2024-09-10T23:31:50.049816+0000","last_peered":"2024-09-10T23:31:50.049816+0000","last_clean":"2024-09-10T23:31:50.049816+0000","last_became_active":"2024-09-10T23:31:49.030093+0000","last_became_peered":"2024-09-10T23:31:49.030093+0000","last_unstale":"2024-09-10T23:31:50.049816+0000","last_undegraded":"2024-09-10T23:31:50.049816+0000","last_fullsized":"2024-09-10T23:31:50.049816+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:35.949314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051509+0000","last_change":"2024-09-10T23:31:50.047785+0000","last_active":"2024-09-10T23:31:50.051509+0000","last_peered":"2024-09-10T23:31:50.051509+0000","last_clean":"2024-09-10T23:31:50.051509+0000","last_became_active":"2024-09-10T23:31:50.047511+0000","last_became_peered":"2024-09-10T23:31:50.047511+0000","last_unstale":"2024-09-10T23:31:50.051509+0000","last_undegraded":"2024-09-10T23:31:50.051509+0000","last_fullsized":"2024-09-10T23:31:50.051509+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:00.428421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.057814+0000","last_change":"2024-09-10T23:31:49.036841+0000","last_active":"2024-09-10T23:31:50.057814+0000","last_peered":"2024-09-10T23:31:50.057814+0000","last_clean":"2024-09-10T23:31:50.057814+0000","last_became_active":"2024-09-10T23:31:49.036387+0000","last_became_peered":"2024-09-10T23:31:49.036387+0000","last_unstale":"2024-09-10T23:31:50.057814+0000","last_undegraded":"2024-09-10T23:31:50.057814+0000","last_fullsized":"2024-09-10T23:31:50.057814+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:13.360755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.043085+0000","last_change":"2024-09-10T23:31:50.033290+0000","last_active":"2024-09-10T23:31:50.043085+0000","last_peered":"2024-09-10T23:31:50.043085+0000","last_clean":"2024-09-10T23:31:50.043085+0000","last_became_active":"2024-09-10T23:31:50.033029+0000","last_became_peered":"2024-09-10T23:31:50.033029+0000","last_unstale":"2024-09-10T23:31:50.043085+0000","last_undegraded":"2024-09-10T23:31:50.043085+0000","last_fullsized":"2024-09-10T23:31:50.043085+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:13.739683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.032784+0000","last_change":"2024-09-10T23:31:49.034926+0000","last_active":"2024-09-10T23:31:50.032784+0000","last_peered":"2024-09-10T23:31:50.032784+0000","last_clean":"2024-09-10T23:31:50.032784+0000","last_became_active":"2024-09-10T23:31:49.034635+0000","last_became_peered":"2024-09-10T23:31:49.034635+0000","last_unstale":"2024-09-10T23:31:50.032784+0000","last_undegraded":"2024-09-10T23:31:50.032784+0000","last_fullsized":"2024-09-10T23:31:50.032784+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:41.767267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:31:49.001016+0000","last_change":"2024-09-10T23:31:49.001016+0000","last_active":"2024-09-10T23:31:49.001016+0000","last_peered":"2024-09-10T23:31:49.001016+0000","last_clean":"2024-09-10T23:31:49.001016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:49.001016+0000","last_undegraded":"2024-09-10T23:31:49.001016+0000","last_fullsized":"2024-09-10T23:31:49.001016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.019773+0000","last_change":"2024-09-10T23:31:49.035436+0000","last_active":"2024-09-10T23:31:50.019773+0000","last_peered":"2024-09-10T23:31:50.019773+0000","last_clean":"2024-09-10T23:31:50.019773+0000","last_became_active":"2024-09-10T23:31:49.031642+0000","last_became_peered":"2024-09-10T23:31:49.031642+0000","last_unstale":"2024-09-10T23:31:50.019773+0000","last_undegraded":"2024-09-10T23:31:50.019773+0000","last_fullsized":"2024-09-10T23:31:50.019773+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:52.052911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:31:49.001016+0000","last_change":"2024-09-10T23:31:49.001016+0000","last_active":"2024-09-10T23:31:49.001016+0000","last_peered":"2024-09-10T23:31:49.001016+0000","last_clean":"2024-09-10T23:31:49.001016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:49.001016+0000","last_undegraded":"2024-09-10T23:31:49.001016+0000","last_fullsized":"2024-09-10T23:31:49.001016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":1,"reported_epoch":220,"state":"creating+peering","last_fresh":"2024-09-10T23:31:48.010242+0000","last_change":"2024-09-10T23:31:48.010242+0000","last_active":"2024-09-10T23:31:47.998018+0000","last_peered":"2024-09-10T23:31:47.998018+0000","last_clean":"2024-09-10T23:31:47.998018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:48.010242+0000","last_undegraded":"2024-09-10T23:31:48.010242+0000","last_fullsized":"2024-09-10T23:31:48.010242+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.058546+0000","last_change":"2024-09-10T23:31:50.053452+0000","last_active":"2024-09-10T23:31:50.058546+0000","last_peered":"2024-09-10T23:31:50.058546+0000","last_clean":"2024-09-10T23:31:50.058546+0000","last_became_active":"2024-09-10T23:31:50.052636+0000","last_became_peered":"2024-09-10T23:31:50.052636+0000","last_unstale":"2024-09-10T23:31:50.058546+0000","last_undegraded":"2024-09-10T23:31:50.058546+0000","last_fullsized":"2024-09-10T23:31:50.058546+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:15.742616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.032946+0000","last_change":"2024-09-10T23:31:49.035402+0000","last_active":"2024-09-10T23:31:50.032946+0000","last_peered":"2024-09-10T23:31:50.032946+0000","last_clean":"2024-09-10T23:31:50.032946+0000","last_became_active":"2024-09-10T23:31:49.035105+0000","last_became_peered":"2024-09-10T23:31:49.035105+0000","last_unstale":"2024-09-10T23:31:50.032946+0000","last_undegraded":"2024-09-10T23:31:50.032946+0000","last_fullsized":"2024-09-10T23:31:50.032946+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:58.496011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.053367+0000","last_change":"2024-09-10T23:31:50.052462+0000","last_active":"2024-09-10T23:31:50.053367+0000","last_peered":"2024-09-10T23:31:50.053367+0000","last_clean":"2024-09-10T23:31:50.053367+0000","last_became_active":"2024-09-10T23:31:50.052111+0000","last_became_peered":"2024-09-10T23:31:50.052111+0000","last_unstale":"2024-09-10T23:31:50.053367+0000","last_undegraded":"2024-09-10T23:31:50.053367+0000","last_fullsized":"2024-09-10T23:31:50.053367+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:38.852292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"0'0","reported_seq":1,"reported_epoch":220,"state":"creating+peering","last_fresh":"2024-09-10T23:31:48.007694+0000","last_change":"2024-09-10T23:31:48.007694+0000","last_active":"2024-09-10T23:31:47.998018+0000","last_peered":"2024-09-10T23:31:47.998018+0000","last_clean":"2024-09-10T23:31:47.998018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:48.007694+0000","last_undegraded":"2024-09-10T23:31:48.007694+0000","last_fullsized":"2024-09-10T23:31:48.007694+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.045644+0000","last_change":"2024-09-10T23:31:50.041276+0000","last_active":"2024-09-10T23:31:50.045644+0000","last_peered":"2024-09-10T23:31:50.045644+0000","last_clean":"2024-09-10T23:31:50.045644+0000","last_became_active":"2024-09-10T23:31:50.040065+0000","last_became_peered":"2024-09-10T23:31:50.040065+0000","last_unstale":"2024-09-10T23:31:50.045644+0000","last_undegraded":"2024-09-10T23:31:50.045644+0000","last_fullsized":"2024-09-10T23:31:50.045644+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:58.172850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"222'6","reported_seq":19,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.062090+0000","last_change":"2024-09-10T23:31:49.017875+0000","last_active":"2024-09-10T23:31:50.062090+0000","last_peered":"2024-09-10T23:31:50.062090+0000","last_clean":"2024-09-10T23:31:50.062090+0000","last_became_active":"2024-09-10T23:31:49.017531+0000","last_became_peered":"2024-09-10T23:31:49.017531+0000","last_unstale":"2024-09-10T23:31:50.062090+0000","last_undegraded":"2024-09-10T23:31:50.062090+0000","last_fullsized":"2024-09-10T23:31:50.062090+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:02.232643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050910+0000","last_change":"2024-09-10T23:31:50.041060+0000","last_active":"2024-09-10T23:31:50.050910+0000","last_peered":"2024-09-10T23:31:50.050910+0000","last_clean":"2024-09-10T23:31:50.050910+0000","last_became_active":"2024-09-10T23:31:50.040706+0000","last_became_peered":"2024-09-10T23:31:50.040706+0000","last_unstale":"2024-09-10T23:31:50.050910+0000","last_undegraded":"2024-09-10T23:31:50.050910+0000","last_fullsized":"2024-09-10T23:31:50.050910+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:23.049885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.049759+0000","last_change":"2024-09-10T23:31:49.029712+0000","last_active":"2024-09-10T23:31:50.049759+0000","last_peered":"2024-09-10T23:31:50.049759+0000","last_clean":"2024-09-10T23:31:50.049759+0000","last_became_active":"2024-09-10T23:31:49.029454+0000","last_became_peered":"2024-09-10T23:31:49.029454+0000","last_unstale":"2024-09-10T23:31:50.049759+0000","last_undegraded":"2024-09-10T23:31:50.049759+0000","last_fullsized":"2024-09-10T23:31:50.049759+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:07:40.436118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.039263+0000","last_change":"2024-09-10T23:31:50.035928+0000","last_active":"2024-09-10T23:31:50.039263+0000","last_peered":"2024-09-10T23:31:50.039263+0000","last_clean":"2024-09-10T23:31:50.039263+0000","last_became_active":"2024-09-10T23:31:50.035661+0000","last_became_peered":"2024-09-10T23:31:50.035661+0000","last_unstale":"2024-09-10T23:31:50.039263+0000","last_undegraded":"2024-09-10T23:31:50.039263+0000","last_fullsized":"2024-09-10T23:31:50.039263+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:27.254740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":1,"reported_epoch":220,"state":"creating+peering","last_fresh":"2024-09-10T23:31:48.008310+0000","last_change":"2024-09-10T23:31:48.008310+0000","last_active":"2024-09-10T23:31:47.998018+0000","last_peered":"2024-09-10T23:31:47.998018+0000","last_clean":"2024-09-10T23:31:47.998018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:48.008310+0000","last_undegraded":"2024-09-10T23:31:48.008310+0000","last_fullsized":"2024-09-10T23:31:48.008310+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051256+0000","last_change":"2024-09-10T23:31:50.039233+0000","last_active":"2024-09-10T23:31:50.051256+0000","last_peered":"2024-09-10T23:31:50.051256+0000","last_clean":"2024-09-10T23:31:50.051256+0000","last_became_active":"2024-09-10T23:31:50.038976+0000","last_became_peered":"2024-09-10T23:31:50.038976+0000","last_unstale":"2024-09-10T23:31:50.051256+0000","last_undegraded":"2024-09-10T23:31:50.051256+0000","last_fullsized":"2024-09-10T23:31:50.051256+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:54.805077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":1,"reported_epoch":220,"state":"creating+peering","last_fresh":"2024-09-10T23:31:48.008909+0000","last_change":"2024-09-10T23:31:48.008909+0000","last_active":"2024-09-10T23:31:47.998018+0000","last_peered":"2024-09-10T23:31:47.998018+0000","last_clean":"2024-09-10T23:31:47.998018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:48.008909+0000","last_undegraded":"2024-09-10T23:31:48.008909+0000","last_fullsized":"2024-09-10T23:31:48.008909+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051781+0000","last_change":"2024-09-10T23:31:50.046866+0000","last_active":"2024-09-10T23:31:50.051781+0000","last_peered":"2024-09-10T23:31:50.051781+0000","last_clean":"2024-09-10T23:31:50.051781+0000","last_became_active":"2024-09-10T23:31:50.046607+0000","last_became_peered":"2024-09-10T23:31:50.046607+0000","last_unstale":"2024-09-10T23:31:50.051781+0000","last_undegraded":"2024-09-10T23:31:50.051781+0000","last_fullsized":"2024-09-10T23:31:50.051781+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:41.309111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"0'0","reported_seq":1,"reported_epoch":220,"state":"creating+peering","last_fresh":"2024-09-10T23:31:48.007857+0000","last_change":"2024-09-10T23:31:48.007857+0000","last_active":"2024-09-10T23:31:47.998018+0000","last_peered":"2024-09-10T23:31:47.998018+0000","last_clean":"2024-09-10T23:31:47.998018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:48.007857+0000","last_undegraded":"2024-09-10T23:31:48.007857+0000","last_fullsized":"2024-09-10T23:31:48.007857+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.037601+0000","last_change":"2024-09-10T23:31:50.029327+0000","last_active":"2024-09-10T23:31:50.037601+0000","last_peered":"2024-09-10T23:31:50.037601+0000","last_clean":"2024-09-10T23:31:50.037601+0000","last_became_active":"2024-09-10T23:31:50.028972+0000","last_became_peered":"2024-09-10T23:31:50.028972+0000","last_unstale":"2024-09-10T23:31:50.037601+0000","last_undegraded":"2024-09-10T23:31:50.037601+0000","last_fullsized":"2024-09-10T23:31:50.037601+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:41.064173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.059522+0000","last_change":"2024-09-10T23:31:49.039733+0000","last_active":"2024-09-10T23:31:50.059522+0000","last_peered":"2024-09-10T23:31:50.059522+0000","last_clean":"2024-09-10T23:31:50.059522+0000","last_became_active":"2024-09-10T23:31:49.039316+0000","last_became_peered":"2024-09-10T23:31:49.039316+0000","last_unstale":"2024-09-10T23:31:50.059522+0000","last_undegraded":"2024-09-10T23:31:50.059522+0000","last_fullsized":"2024-09-10T23:31:50.059522+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:12.651412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.044883+0000","last_change":"2024-09-10T23:31:50.040924+0000","last_active":"2024-09-10T23:31:50.044883+0000","last_peered":"2024-09-10T23:31:50.044883+0000","last_clean":"2024-09-10T23:31:50.044883+0000","last_became_active":"2024-09-10T23:31:50.040606+0000","last_became_peered":"2024-09-10T23:31:50.040606+0000","last_unstale":"2024-09-10T23:31:50.044883+0000","last_undegraded":"2024-09-10T23:31:50.044883+0000","last_fullsized":"2024-09-10T23:31:50.044883+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:11.920104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.062070+0000","last_change":"2024-09-10T23:31:49.032089+0000","last_active":"2024-09-10T23:31:50.062070+0000","last_peered":"2024-09-10T23:31:50.062070+0000","last_clean":"2024-09-10T23:31:50.062070+0000","last_became_active":"2024-09-10T23:31:49.031493+0000","last_became_peered":"2024-09-10T23:31:49.031493+0000","last_unstale":"2024-09-10T23:31:50.062070+0000","last_undegraded":"2024-09-10T23:31:50.062070+0000","last_fullsized":"2024-09-10T23:31:50.062070+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:15.552910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:31:49.001016+0000","last_change":"2024-09-10T23:31:49.001016+0000","last_active":"2024-09-10T23:31:49.001016+0000","last_peered":"2024-09-10T23:31:49.001016+0000","last_clean":"2024-09-10T23:31:49.001016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:49.001016+0000","last_undegraded":"2024-09-10T23:31:49.001016+0000","last_fullsized":"2024-09-10T23:31:49.001016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.d","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.060741+0000","last_change":"2024-09-10T23:31:49.041174+0000","last_active":"2024-09-10T23:31:50.060741+0000","last_peered":"2024-09-10T23:31:50.060741+0000","last_clean":"2024-09-10T23:31:50.060741+0000","last_became_active":"2024-09-10T23:31:49.040937+0000","last_became_peered":"2024-09-10T23:31:49.040937+0000","last_unstale":"2024-09-10T23:31:50.060741+0000","last_undegraded":"2024-09-10T23:31:50.060741+0000","last_fullsized":"2024-09-10T23:31:50.060741+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:31.823914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.039310+0000","last_change":"2024-09-10T23:31:50.035283+0000","last_active":"2024-09-10T23:31:50.039310+0000","last_peered":"2024-09-10T23:31:50.039310+0000","last_clean":"2024-09-10T23:31:50.039310+0000","last_became_active":"2024-09-10T23:31:50.034729+0000","last_became_peered":"2024-09-10T23:31:50.034729+0000","last_unstale":"2024-09-10T23:31:50.039310+0000","last_undegraded":"2024-09-10T23:31:50.039310+0000","last_fullsized":"2024-09-10T23:31:50.039310+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:49.837627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.048200+0000","last_change":"2024-09-10T23:31:49.028002+0000","last_active":"2024-09-10T23:31:50.048200+0000","last_peered":"2024-09-10T23:31:50.048200+0000","last_clean":"2024-09-10T23:31:50.048200+0000","last_became_active":"2024-09-10T23:31:49.027714+0000","last_became_peered":"2024-09-10T23:31:49.027714+0000","last_unstale":"2024-09-10T23:31:50.048200+0000","last_undegraded":"2024-09-10T23:31:50.048200+0000","last_fullsized":"2024-09-10T23:31:50.048200+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:57.617633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.041120+0000","last_change":"2024-09-10T23:31:50.026424+0000","last_active":"2024-09-10T23:31:50.041120+0000","last_peered":"2024-09-10T23:31:50.041120+0000","last_clean":"2024-09-10T23:31:50.041120+0000","last_became_active":"2024-09-10T23:31:50.026114+0000","last_became_peered":"2024-09-10T23:31:50.026114+0000","last_unstale":"2024-09-10T23:31:50.041120+0000","last_undegraded":"2024-09-10T23:31:50.041120+0000","last_fullsized":"2024-09-10T23:31:50.041120+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:13.493974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.054074+0000","last_change":"2024-09-10T23:31:49.037801+0000","last_active":"2024-09-10T23:31:50.054074+0000","last_peered":"2024-09-10T23:31:50.054074+0000","last_clean":"2024-09-10T23:31:50.054074+0000","last_became_active":"2024-09-10T23:31:49.037534+0000","last_became_peered":"2024-09-10T23:31:49.037534+0000","last_unstale":"2024-09-10T23:31:50.054074+0000","last_undegraded":"2024-09-10T23:31:50.054074+0000","last_fullsized":"2024-09-10T23:31:50.054074+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:49.276698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.046393+0000","last_change":"2024-09-10T23:31:50.043209+0000","last_active":"2024-09-10T23:31:50.046393+0000","last_peered":"2024-09-10T23:31:50.046393+0000","last_clean":"2024-09-10T23:31:50.046393+0000","last_became_active":"2024-09-10T23:31:50.042928+0000","last_became_peered":"2024-09-10T23:31:50.042928+0000","last_unstale":"2024-09-10T23:31:50.046393+0000","last_undegraded":"2024-09-10T23:31:50.046393+0000","last_fullsized":"2024-09-10T23:31:50.046393+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:41.781949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.019914+0000","last_change":"2024-09-10T23:31:49.036098+0000","last_active":"2024-09-10T23:31:50.019914+0000","last_peered":"2024-09-10T23:31:50.019914+0000","last_clean":"2024-09-10T23:31:50.019914+0000","last_became_active":"2024-09-10T23:31:49.035829+0000","last_became_peered":"2024-09-10T23:31:49.035829+0000","last_unstale":"2024-09-10T23:31:50.019914+0000","last_undegraded":"2024-09-10T23:31:50.019914+0000","last_fullsized":"2024-09-10T23:31:50.019914+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:03.478766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:31:49.001016+0000","last_change":"2024-09-10T23:31:49.001016+0000","last_active":"2024-09-10T23:31:49.001016+0000","last_peered":"2024-09-10T23:31:49.001016+0000","last_clean":"2024-09-10T23:31:49.001016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:49.001016+0000","last_undegraded":"2024-09-10T23:31:49.001016+0000","last_fullsized":"2024-09-10T23:31:49.001016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.016656+0000","last_change":"2024-09-10T23:31:49.029220+0000","last_active":"2024-09-10T23:31:50.016656+0000","last_peered":"2024-09-10T23:31:50.016656+0000","last_clean":"2024-09-10T23:31:50.016656+0000","last_became_active":"2024-09-10T23:31:49.028956+0000","last_became_peered":"2024-09-10T23:31:49.028956+0000","last_unstale":"2024-09-10T23:31:50.016656+0000","last_undegraded":"2024-09-10T23:31:50.016656+0000","last_fullsized":"2024-09-10T23:31:50.016656+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:33.585946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.052293+0000","last_change":"2024-09-10T23:31:50.041842+0000","last_active":"2024-09-10T23:31:50.052293+0000","last_peered":"2024-09-10T23:31:50.052293+0000","last_clean":"2024-09-10T23:31:50.052293+0000","last_became_active":"2024-09-10T23:31:50.041526+0000","last_became_peered":"2024-09-10T23:31:50.041526+0000","last_unstale":"2024-09-10T23:31:50.052293+0000","last_undegraded":"2024-09-10T23:31:50.052293+0000","last_fullsized":"2024-09-10T23:31:50.052293+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:17.229214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":1,"reported_epoch":220,"state":"creating+peering","last_fresh":"2024-09-10T23:31:48.007339+0000","last_change":"2024-09-10T23:31:48.007339+0000","last_active":"2024-09-10T23:31:47.998018+0000","last_peered":"2024-09-10T23:31:47.998018+0000","last_clean":"2024-09-10T23:31:47.998018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:48.007339+0000","last_undegraded":"2024-09-10T23:31:48.007339+0000","last_fullsized":"2024-09-10T23:31:48.007339+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.047488+0000","last_change":"2024-09-10T23:31:50.045561+0000","last_active":"2024-09-10T23:31:50.047488+0000","last_peered":"2024-09-10T23:31:50.047488+0000","last_clean":"2024-09-10T23:31:50.047488+0000","last_became_active":"2024-09-10T23:31:50.045274+0000","last_became_peered":"2024-09-10T23:31:50.045274+0000","last_unstale":"2024-09-10T23:31:50.047488+0000","last_undegraded":"2024-09-10T23:31:50.047488+0000","last_fullsized":"2024-09-10T23:31:50.047488+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:12.106706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"0'0","reported_seq":1,"reported_epoch":220,"state":"creating+peering","last_fresh":"2024-09-10T23:31:48.008133+0000","last_change":"2024-09-10T23:31:48.008133+0000","last_active":"2024-09-10T23:31:47.998018+0000","last_peered":"2024-09-10T23:31:47.998018+0000","last_clean":"2024-09-10T23:31:47.998018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:48.008133+0000","last_undegraded":"2024-09-10T23:31:48.008133+0000","last_fullsized":"2024-09-10T23:31:48.008133+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.046071+0000","last_change":"2024-09-10T23:31:50.040825+0000","last_active":"2024-09-10T23:31:50.046071+0000","last_peered":"2024-09-10T23:31:50.046071+0000","last_clean":"2024-09-10T23:31:50.046071+0000","last_became_active":"2024-09-10T23:31:50.040557+0000","last_became_peered":"2024-09-10T23:31:50.040557+0000","last_unstale":"2024-09-10T23:31:50.046071+0000","last_undegraded":"2024-09-10T23:31:50.046071+0000","last_fullsized":"2024-09-10T23:31:50.046071+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:59:14.035907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.054894+0000","last_change":"2024-09-10T23:31:49.031787+0000","last_active":"2024-09-10T23:31:50.054894+0000","last_peered":"2024-09-10T23:31:50.054894+0000","last_clean":"2024-09-10T23:31:50.054894+0000","last_became_active":"2024-09-10T23:31:49.031121+0000","last_became_peered":"2024-09-10T23:31:49.031121+0000","last_unstale":"2024-09-10T23:31:50.054894+0000","last_undegraded":"2024-09-10T23:31:50.054894+0000","last_fullsized":"2024-09-10T23:31:50.054894+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:20.708652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.054545+0000","last_change":"2024-09-10T23:31:50.053913+0000","last_active":"2024-09-10T23:31:50.054545+0000","last_peered":"2024-09-10T23:31:50.054545+0000","last_clean":"2024-09-10T23:31:50.054545+0000","last_became_active":"2024-09-10T23:31:50.053618+0000","last_became_peered":"2024-09-10T23:31:50.053618+0000","last_unstale":"2024-09-10T23:31:50.054545+0000","last_undegraded":"2024-09-10T23:31:50.054545+0000","last_fullsized":"2024-09-10T23:31:50.054545+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:53.589857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.029666+0000","last_change":"2024-09-10T23:31:49.038418+0000","last_active":"2024-09-10T23:31:50.029666+0000","last_peered":"2024-09-10T23:31:50.029666+0000","last_clean":"2024-09-10T23:31:50.029666+0000","last_became_active":"2024-09-10T23:31:49.038173+0000","last_became_peered":"2024-09-10T23:31:49.038173+0000","last_unstale":"2024-09-10T23:31:50.029666+0000","last_undegraded":"2024-09-10T23:31:50.029666+0000","last_fullsized":"2024-09-10T23:31:50.029666+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:33.207662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.046386+0000","last_change":"2024-09-10T23:31:50.044426+0000","last_active":"2024-09-10T23:31:50.046386+0000","last_peered":"2024-09-10T23:31:50.046386+0000","last_clean":"2024-09-10T23:31:50.046386+0000","last_became_active":"2024-09-10T23:31:50.044142+0000","last_became_peered":"2024-09-10T23:31:50.044142+0000","last_unstale":"2024-09-10T23:31:50.046386+0000","last_undegraded":"2024-09-10T23:31:50.046386+0000","last_fullsized":"2024-09-10T23:31:50.046386+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:26.749709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.029239+0000","last_change":"2024-09-10T23:31:49.036826+0000","last_active":"2024-09-10T23:31:50.029239+0000","last_peered":"2024-09-10T23:31:50.029239+0000","last_clean":"2024-09-10T23:31:50.029239+0000","last_became_active":"2024-09-10T23:31:49.036509+0000","last_became_peered":"2024-09-10T23:31:49.036509+0000","last_unstale":"2024-09-10T23:31:50.029239+0000","last_undegraded":"2024-09-10T23:31:50.029239+0000","last_fullsized":"2024-09-10T23:31:50.029239+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:39.573831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:31:49.001016+0000","last_change":"2024-09-10T23:31:49.001016+0000","last_active":"2024-09-10T23:31:49.001016+0000","last_peered":"2024-09-10T23:31:49.001016+0000","last_clean":"2024-09-10T23:31:49.001016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:49.001016+0000","last_undegraded":"2024-09-10T23:31:49.001016+0000","last_fullsized":"2024-09-10T23:31:49.001016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.047458+0000","last_change":"2024-09-10T23:31:49.033149+0000","last_active":"2024-09-10T23:31:50.047458+0000","last_peered":"2024-09-10T23:31:50.047458+0000","last_clean":"2024-09-10T23:31:50.047458+0000","last_became_active":"2024-09-10T23:31:49.032889+0000","last_became_peered":"2024-09-10T23:31:49.032889+0000","last_unstale":"2024-09-10T23:31:50.047458+0000","last_undegraded":"2024-09-10T23:31:50.047458+0000","last_fullsized":"2024-09-10T23:31:50.047458+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:35.522859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.049867+0000","last_change":"2024-09-10T23:31:50.034063+0000","last_active":"2024-09-10T23:31:50.049867+0000","last_peered":"2024-09-10T23:31:50.049867+0000","last_clean":"2024-09-10T23:31:50.049867+0000","last_became_active":"2024-09-10T23:31:50.033713+0000","last_became_peered":"2024-09-10T23:31:50.033713+0000","last_unstale":"2024-09-10T23:31:50.049867+0000","last_undegraded":"2024-09-10T23:31:50.049867+0000","last_fullsized":"2024-09-10T23:31:50.049867+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:56.181370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.044329+0000","last_change":"2024-09-10T23:31:49.033083+0000","last_active":"2024-09-10T23:31:50.044329+0000","last_peered":"2024-09-10T23:31:50.044329+0000","last_clean":"2024-09-10T23:31:50.044329+0000","last_became_active":"2024-09-10T23:31:49.032802+0000","last_became_peered":"2024-09-10T23:31:49.032802+0000","last_unstale":"2024-09-10T23:31:50.044329+0000","last_undegraded":"2024-09-10T23:31:50.044329+0000","last_fullsized":"2024-09-10T23:31:50.044329+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:06.909587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.055397+0000","last_change":"2024-09-10T23:31:50.050193+0000","last_active":"2024-09-10T23:31:50.055397+0000","last_peered":"2024-09-10T23:31:50.055397+0000","last_clean":"2024-09-10T23:31:50.055397+0000","last_became_active":"2024-09-10T23:31:50.049461+0000","last_became_peered":"2024-09-10T23:31:50.049461+0000","last_unstale":"2024-09-10T23:31:50.055397+0000","last_undegraded":"2024-09-10T23:31:50.055397+0000","last_fullsized":"2024-09-10T23:31:50.055397+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:56.584046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.028848+0000","last_change":"2024-09-10T23:31:49.032420+0000","last_active":"2024-09-10T23:31:50.028848+0000","last_peered":"2024-09-10T23:31:50.028848+0000","last_clean":"2024-09-10T23:31:50.028848+0000","last_became_active":"2024-09-10T23:31:49.032159+0000","last_became_peered":"2024-09-10T23:31:49.032159+0000","last_unstale":"2024-09-10T23:31:50.028848+0000","last_undegraded":"2024-09-10T23:31:50.028848+0000","last_fullsized":"2024-09-10T23:31:50.028848+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:54.696869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050527+0000","last_change":"2024-09-10T23:31:50.045398+0000","last_active":"2024-09-10T23:31:50.050527+0000","last_peered":"2024-09-10T23:31:50.050527+0000","last_clean":"2024-09-10T23:31:50.050527+0000","last_became_active":"2024-09-10T23:31:50.045140+0000","last_became_peered":"2024-09-10T23:31:50.045140+0000","last_unstale":"2024-09-10T23:31:50.050527+0000","last_undegraded":"2024-09-10T23:31:50.050527+0000","last_fullsized":"2024-09-10T23:31:50.050527+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:27.878662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.052464+0000","last_change":"2024-09-10T23:31:49.031582+0000","last_active":"2024-09-10T23:31:50.052464+0000","last_peered":"2024-09-10T23:31:50.052464+0000","last_clean":"2024-09-10T23:31:50.052464+0000","last_became_active":"2024-09-10T23:31:49.030822+0000","last_became_peered":"2024-09-10T23:31:49.030822+0000","last_unstale":"2024-09-10T23:31:50.052464+0000","last_undegraded":"2024-09-10T23:31:50.052464+0000","last_fullsized":"2024-09-10T23:31:50.052464+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:05.844297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T23:31:49.001016+0000","last_change":"2024-09-10T23:31:49.001016+0000","last_active":"2024-09-10T23:31:49.001016+0000","last_peered":"2024-09-10T23:31:49.001016+0000","last_clean":"2024-09-10T23:31:49.001016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T23:31:49.001016+0000","last_undegraded":"2024-09-10T23:31:49.001016+0000","last_fullsized":"2024-09-10T23:31:49.001016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":475,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.029655+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:31:50.029655+0000","last_peered":"2024-09-10T23:31:50.029655+0000","last_clean":"2024-09-10T23:31:50.029655+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:31:50.029655+0000","last_undegraded":"2024-09-10T23:31:50.029655+0000","last_fullsized":"2024-09-10T23:31:50.029655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476936,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74128,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297712,"statfs":{"total":96636764160,"available":96560857088,"internally_reserved":0,"allocated":2809856,"data_stored":1319982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509641,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92740,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94279100,"statfs":{"total":96636764160,"available":96541798400,"internally_reserved":0,"allocated":3387392,"data_stored":1903149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509640,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51968,"kb_used_data":2728,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319872,"statfs":{"total":96636764160,"available":96583548928,"internally_reserved":0,"allocated":2793472,"data_stored":1312781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509641,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74172,"kb_used_data":2728,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297668,"statfs":{"total":96636764160,"available":96560812032,"internally_reserved":0,"allocated":2793472,"data_stored":1312781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509640,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78332,"kb_used_data":2728,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293508,"statfs":{"total":96636764160,"available":96556552192,"internally_reserved":0,"allocated":2793472,"data_stored":1312781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509641,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51988,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319852,"statfs":{"total":96636764160,"available":96583528448,"internally_reserved":0,"allocated":2813952,"data_stored":1320072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509640,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78912,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292928,"statfs":{"total":96636764160,"available":96555958272,"internally_reserved":0,"allocated":3387392,"data_stored":1903149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74092,"kb_used_data":2704,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297748,"statfs":{"total":96636764160,"available":96560893952,"internally_reserved":0,"allocated":2768896,"data_stored":1299905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:31:54.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:31:54.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 -- 172.21.15.17:0/1968742917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0745e0 msgr2=0x7fd89c15b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/1968742917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0745e0 0x7fd89c15b2f0 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7fd89c154eb0 tx=0x7fd88c01c800 comp rx=0 tx=0).stop 2024-09-10T23:31:54.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 -- 172.21.15.17:0/1968742917 shutdown_connections 2024-09-10T23:31:54.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/1968742917 >> v2:172.21.15.77:3300/0 conn(0x7fd89c15e870 0x7fd89c06fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/1968742917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0745e0 0x7fd89c15b2f0 unknown :-1 s=CLOSED pgs=2559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 -- 172.21.15.17:0/1968742917 >> 172.21.15.17:0/1968742917 conn(0x7fd89c0b1850 msgr2=0x7fd89c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 -- 172.21.15.17:0/1968742917 shutdown_connections 2024-09-10T23:31:54.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 -- 172.21.15.17:0/1968742917 wait complete. 2024-09-10T23:31:54.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 Processor -- start 2024-09-10T23:31:54.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.362+0000 7fd8a0e00640 1 -- start start 2024-09-10T23:31:54.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd8a0e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0745e0 0x7fd89c1483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd8a0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0cfb00 0x7fd89c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd8a0e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c15e870 0x7fd89c1477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd8a0e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c06f030 con 0x7fd89c0cfb00 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd8a0e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c0d01d0 con 0x7fd89c15e870 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd8a0e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c06f1b0 con 0x7fd89c0745e0 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd893e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0cfb00 0x7fd89c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd893e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0cfb00 0x7fd89c0cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55682/0 (socket says 172.21.15.17:55682) 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd893e00640 1 -- 172.21.15.17:0/3996818573 learned_addr learned my addr 172.21.15.17:0/3996818573 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd899e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0745e0 0x7fd89c1483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd89a800640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c15e870 0x7fd89c1477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd893e00640 1 -- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0745e0 msgr2=0x7fd89c1483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd893e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0745e0 0x7fd89c1483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd893e00640 1 -- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c15e870 msgr2=0x7fd89c1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd893e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c15e870 0x7fd89c1477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd893e00640 1 -- 172.21.15.17:0/3996818573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c14dc40 con 0x7fd89c0cfb00 2024-09-10T23:31:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd89a800640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c15e870 0x7fd89c1477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd893e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0cfb00 0x7fd89c0cd890 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7fd8840058d0 tx=0x7fd88400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd892000640 1 -- 172.21.15.17:0/3996818573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884017070 con 0x7fd89c0cfb00 2024-09-10T23:31:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd892000640 1 -- 172.21.15.17:0/3996818573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd884009d20 con 0x7fd89c0cfb00 2024-09-10T23:31:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd892000640 1 -- 172.21.15.17:0/3996818573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8840106c0 con 0x7fd89c0cfb00 2024-09-10T23:31:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c1f54b0 con 0x7fd89c0cfb00 2024-09-10T23:31:54.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c148b20 con 0x7fd89c0cfb00 2024-09-10T23:31:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89c075ad0 con 0x7fd89c0cfb00 2024-09-10T23:31:54.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.366+0000 7fd892000640 1 -- 172.21.15.17:0/3996818573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd884010860 con 0x7fd89c0cfb00 2024-09-10T23:31:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.370+0000 7fd892000640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8780725e0 0x7fd878074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.370+0000 7fd892000640 1 -- 172.21.15.17:0/3996818573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7fd8840938b0 con 0x7fd89c0cfb00 2024-09-10T23:31:54.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.370+0000 7fd899e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8780725e0 0x7fd878074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.370+0000 7fd899e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8780725e0 0x7fd878074aa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0af000 tx=0x7fd88c01b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.374+0000 7fd892000640 1 -- 172.21.15.17:0/3996818573 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd88405edf0 con 0x7fd89c0cfb00 2024-09-10T23:31:54.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.542+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd89c14e7f0 con 0x7fd8780725e0 2024-09-10T23:31:54.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd892000640 1 -- 172.21.15.17:0/3996818573 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252478 (secure 0 0 0) 0x7fd89c14e7f0 con 0x7fd8780725e0 2024-09-10T23:31:54.554 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:31:54.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8780725e0 msgr2=0x7fd878074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8780725e0 0x7fd878074aa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0af000 tx=0x7fd88c01b040 comp rx=0 tx=0).stop 2024-09-10T23:31:54.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0cfb00 msgr2=0x7fd89c0cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0cfb00 0x7fd89c0cd890 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7fd8840058d0 tx=0x7fd88400dde0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 shutdown_connections 2024-09-10T23:31:54.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd8780725e0 0x7fd878074aa0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd89c15e870 0x7fd89c1477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd89c0cfb00 0x7fd89c0cd890 unknown :-1 s=CLOSED pgs=2560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 --2- 172.21.15.17:0/3996818573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd89c0745e0 0x7fd89c1483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 >> 172.21.15.17:0/3996818573 conn(0x7fd89c0b1850 msgr2=0x7fd89c0af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 shutdown_connections 2024-09-10T23:31:54.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.550+0000 7fd8a0e00640 1 -- 172.21.15.17:0/3996818573 wait complete. 2024-09-10T23:31:54.575 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":712,"stamp":"2024-09-10T23:31:54.533191+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":576376,"kb_used_data":23048,"kb_used_omap":12,"kb_used_meta":553139,"kb_avail":754398344,"statfs":{"total":773094113280,"available":772503904256,"internally_reserved":0,"allocated":23601152,"data_stored":11711425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":566414897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001607"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.039335+0000","last_change":"2024-09-10T23:31:50.035569+0000","last_active":"2024-09-10T23:31:50.039335+0000","last_peered":"2024-09-10T23:31:50.039335+0000","last_clean":"2024-09-10T23:31:50.039335+0000","last_became_active":"2024-09-10T23:31:50.035043+0000","last_became_peered":"2024-09-10T23:31:50.035043+0000","last_unstale":"2024-09-10T23:31:50.039335+0000","last_undegraded":"2024-09-10T23:31:50.039335+0000","last_fullsized":"2024-09-10T23:31:50.039335+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:46.564319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.056190+0000","last_change":"2024-09-10T23:31:50.053661+0000","last_active":"2024-09-10T23:31:50.056190+0000","last_peered":"2024-09-10T23:31:50.056190+0000","last_clean":"2024-09-10T23:31:50.056190+0000","last_became_active":"2024-09-10T23:31:50.053409+0000","last_became_peered":"2024-09-10T23:31:50.053409+0000","last_unstale":"2024-09-10T23:31:50.056190+0000","last_undegraded":"2024-09-10T23:31:50.056190+0000","last_fullsized":"2024-09-10T23:31:50.056190+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:38:57.687168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.058620+0000","last_change":"2024-09-10T23:31:50.057475+0000","last_active":"2024-09-10T23:31:50.058620+0000","last_peered":"2024-09-10T23:31:50.058620+0000","last_clean":"2024-09-10T23:31:50.058620+0000","last_became_active":"2024-09-10T23:31:50.057151+0000","last_became_peered":"2024-09-10T23:31:50.057151+0000","last_unstale":"2024-09-10T23:31:50.058620+0000","last_undegraded":"2024-09-10T23:31:50.058620+0000","last_fullsized":"2024-09-10T23:31:50.058620+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:56.373548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":13,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497711+0000","last_change":"2024-09-10T23:31:50.049467+0000","last_active":"2024-09-10T23:31:51.497711+0000","last_peered":"2024-09-10T23:31:51.497711+0000","last_clean":"2024-09-10T23:31:51.497711+0000","last_became_active":"2024-09-10T23:31:50.049195+0000","last_became_peered":"2024-09-10T23:31:50.049195+0000","last_unstale":"2024-09-10T23:31:51.497711+0000","last_undegraded":"2024-09-10T23:31:51.497711+0000","last_fullsized":"2024-09-10T23:31:51.497711+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:32:55.818923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050884+0000","last_change":"2024-09-10T23:31:50.041935+0000","last_active":"2024-09-10T23:31:50.050884+0000","last_peered":"2024-09-10T23:31:50.050884+0000","last_clean":"2024-09-10T23:31:50.050884+0000","last_became_active":"2024-09-10T23:31:50.041666+0000","last_became_peered":"2024-09-10T23:31:50.041666+0000","last_unstale":"2024-09-10T23:31:50.050884+0000","last_undegraded":"2024-09-10T23:31:50.050884+0000","last_fullsized":"2024-09-10T23:31:50.050884+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:31.983389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.046725+0000","last_change":"2024-09-10T23:31:50.045748+0000","last_active":"2024-09-10T23:31:50.046725+0000","last_peered":"2024-09-10T23:31:50.046725+0000","last_clean":"2024-09-10T23:31:50.046725+0000","last_became_active":"2024-09-10T23:31:50.045468+0000","last_became_peered":"2024-09-10T23:31:50.045468+0000","last_unstale":"2024-09-10T23:31:50.046725+0000","last_undegraded":"2024-09-10T23:31:50.046725+0000","last_fullsized":"2024-09-10T23:31:50.046725+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:45.875556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.052670+0000","last_change":"2024-09-10T23:31:50.049646+0000","last_active":"2024-09-10T23:31:50.052670+0000","last_peered":"2024-09-10T23:31:50.052670+0000","last_clean":"2024-09-10T23:31:50.052670+0000","last_became_active":"2024-09-10T23:31:50.048700+0000","last_became_peered":"2024-09-10T23:31:50.048700+0000","last_unstale":"2024-09-10T23:31:50.052670+0000","last_undegraded":"2024-09-10T23:31:50.052670+0000","last_fullsized":"2024-09-10T23:31:50.052670+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:09.165664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":13,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.496469+0000","last_change":"2024-09-10T23:31:50.046184+0000","last_active":"2024-09-10T23:31:51.496469+0000","last_peered":"2024-09-10T23:31:51.496469+0000","last_clean":"2024-09-10T23:31:51.496469+0000","last_became_active":"2024-09-10T23:31:50.045565+0000","last_became_peered":"2024-09-10T23:31:50.045565+0000","last_unstale":"2024-09-10T23:31:51.496469+0000","last_undegraded":"2024-09-10T23:31:51.496469+0000","last_fullsized":"2024-09-10T23:31:51.496469+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:47.824229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.056476+0000","last_change":"2024-09-10T23:31:50.056024+0000","last_active":"2024-09-10T23:31:50.056476+0000","last_peered":"2024-09-10T23:31:50.056476+0000","last_clean":"2024-09-10T23:31:50.056476+0000","last_became_active":"2024-09-10T23:31:50.055616+0000","last_became_peered":"2024-09-10T23:31:50.055616+0000","last_unstale":"2024-09-10T23:31:50.056476+0000","last_undegraded":"2024-09-10T23:31:50.056476+0000","last_fullsized":"2024-09-10T23:31:50.056476+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:59.279430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.056377+0000","last_change":"2024-09-10T23:31:50.055656+0000","last_active":"2024-09-10T23:31:50.056377+0000","last_peered":"2024-09-10T23:31:50.056377+0000","last_clean":"2024-09-10T23:31:50.056377+0000","last_became_active":"2024-09-10T23:31:50.055349+0000","last_became_peered":"2024-09-10T23:31:50.055349+0000","last_unstale":"2024-09-10T23:31:50.056377+0000","last_undegraded":"2024-09-10T23:31:50.056377+0000","last_fullsized":"2024-09-10T23:31:50.056377+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:01:51.407958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.040809+0000","last_change":"2024-09-10T23:31:50.032596+0000","last_active":"2024-09-10T23:31:50.040809+0000","last_peered":"2024-09-10T23:31:50.040809+0000","last_clean":"2024-09-10T23:31:50.040809+0000","last_became_active":"2024-09-10T23:31:50.032322+0000","last_became_peered":"2024-09-10T23:31:50.032322+0000","last_unstale":"2024-09-10T23:31:50.040809+0000","last_undegraded":"2024-09-10T23:31:50.040809+0000","last_fullsized":"2024-09-10T23:31:50.040809+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:29.003110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.054044+0000","last_change":"2024-09-10T23:31:50.052837+0000","last_active":"2024-09-10T23:31:50.054044+0000","last_peered":"2024-09-10T23:31:50.054044+0000","last_clean":"2024-09-10T23:31:50.054044+0000","last_became_active":"2024-09-10T23:31:50.051639+0000","last_became_peered":"2024-09-10T23:31:50.051639+0000","last_unstale":"2024-09-10T23:31:50.054044+0000","last_undegraded":"2024-09-10T23:31:50.054044+0000","last_fullsized":"2024-09-10T23:31:50.054044+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:29.369283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":13,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497277+0000","last_change":"2024-09-10T23:31:50.047034+0000","last_active":"2024-09-10T23:31:51.497277+0000","last_peered":"2024-09-10T23:31:51.497277+0000","last_clean":"2024-09-10T23:31:51.497277+0000","last_became_active":"2024-09-10T23:31:50.046209+0000","last_became_peered":"2024-09-10T23:31:50.046209+0000","last_unstale":"2024-09-10T23:31:51.497277+0000","last_undegraded":"2024-09-10T23:31:51.497277+0000","last_fullsized":"2024-09-10T23:31:51.497277+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:11.136540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050059+0000","last_change":"2024-09-10T23:31:50.033811+0000","last_active":"2024-09-10T23:31:50.050059+0000","last_peered":"2024-09-10T23:31:50.050059+0000","last_clean":"2024-09-10T23:31:50.050059+0000","last_became_active":"2024-09-10T23:31:50.033510+0000","last_became_peered":"2024-09-10T23:31:50.033510+0000","last_unstale":"2024-09-10T23:31:50.050059+0000","last_undegraded":"2024-09-10T23:31:50.050059+0000","last_fullsized":"2024-09-10T23:31:50.050059+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:34.891682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.044774+0000","last_change":"2024-09-10T23:31:50.033257+0000","last_active":"2024-09-10T23:31:50.044774+0000","last_peered":"2024-09-10T23:31:50.044774+0000","last_clean":"2024-09-10T23:31:50.044774+0000","last_became_active":"2024-09-10T23:31:50.026122+0000","last_became_peered":"2024-09-10T23:31:50.026122+0000","last_unstale":"2024-09-10T23:31:50.044774+0000","last_undegraded":"2024-09-10T23:31:50.044774+0000","last_fullsized":"2024-09-10T23:31:50.044774+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:01.651318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.049648+0000","last_change":"2024-09-10T23:31:50.038032+0000","last_active":"2024-09-10T23:31:50.049648+0000","last_peered":"2024-09-10T23:31:50.049648+0000","last_clean":"2024-09-10T23:31:50.049648+0000","last_became_active":"2024-09-10T23:31:50.037769+0000","last_became_peered":"2024-09-10T23:31:50.037769+0000","last_unstale":"2024-09-10T23:31:50.049648+0000","last_undegraded":"2024-09-10T23:31:50.049648+0000","last_fullsized":"2024-09-10T23:31:50.049648+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:17.997608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.059666+0000","last_change":"2024-09-10T23:31:50.059094+0000","last_active":"2024-09-10T23:31:50.059666+0000","last_peered":"2024-09-10T23:31:50.059666+0000","last_clean":"2024-09-10T23:31:50.059666+0000","last_became_active":"2024-09-10T23:31:50.058752+0000","last_became_peered":"2024-09-10T23:31:50.058752+0000","last_unstale":"2024-09-10T23:31:50.059666+0000","last_undegraded":"2024-09-10T23:31:50.059666+0000","last_fullsized":"2024-09-10T23:31:50.059666+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:59.418468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.059076+0000","last_change":"2024-09-10T23:31:50.053843+0000","last_active":"2024-09-10T23:31:50.059076+0000","last_peered":"2024-09-10T23:31:50.059076+0000","last_clean":"2024-09-10T23:31:50.059076+0000","last_became_active":"2024-09-10T23:31:50.053171+0000","last_became_peered":"2024-09-10T23:31:50.053171+0000","last_unstale":"2024-09-10T23:31:50.059076+0000","last_undegraded":"2024-09-10T23:31:50.059076+0000","last_fullsized":"2024-09-10T23:31:50.059076+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:06.624056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051538+0000","last_change":"2024-09-10T23:31:50.049444+0000","last_active":"2024-09-10T23:31:50.051538+0000","last_peered":"2024-09-10T23:31:50.051538+0000","last_clean":"2024-09-10T23:31:50.051538+0000","last_became_active":"2024-09-10T23:31:50.049177+0000","last_became_peered":"2024-09-10T23:31:50.049177+0000","last_unstale":"2024-09-10T23:31:50.051538+0000","last_undegraded":"2024-09-10T23:31:50.051538+0000","last_fullsized":"2024-09-10T23:31:50.051538+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:34:06.557253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.047073+0000","last_change":"2024-09-10T23:31:50.042445+0000","last_active":"2024-09-10T23:31:50.047073+0000","last_peered":"2024-09-10T23:31:50.047073+0000","last_clean":"2024-09-10T23:31:50.047073+0000","last_became_active":"2024-09-10T23:31:50.042131+0000","last_became_peered":"2024-09-10T23:31:50.042131+0000","last_unstale":"2024-09-10T23:31:50.047073+0000","last_undegraded":"2024-09-10T23:31:50.047073+0000","last_fullsized":"2024-09-10T23:31:50.047073+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:15.396434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050854+0000","last_change":"2024-09-10T23:31:50.041304+0000","last_active":"2024-09-10T23:31:50.050854+0000","last_peered":"2024-09-10T23:31:50.050854+0000","last_clean":"2024-09-10T23:31:50.050854+0000","last_became_active":"2024-09-10T23:31:50.040810+0000","last_became_peered":"2024-09-10T23:31:50.040810+0000","last_unstale":"2024-09-10T23:31:50.050854+0000","last_undegraded":"2024-09-10T23:31:50.050854+0000","last_fullsized":"2024-09-10T23:31:50.050854+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:17:13.277365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.037806+0000","last_change":"2024-09-10T23:31:50.033734+0000","last_active":"2024-09-10T23:31:50.037806+0000","last_peered":"2024-09-10T23:31:50.037806+0000","last_clean":"2024-09-10T23:31:50.037806+0000","last_became_active":"2024-09-10T23:31:50.033491+0000","last_became_peered":"2024-09-10T23:31:50.033491+0000","last_unstale":"2024-09-10T23:31:50.037806+0000","last_undegraded":"2024-09-10T23:31:50.037806+0000","last_fullsized":"2024-09-10T23:31:50.037806+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:25.530844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.042731+0000","last_change":"2024-09-10T23:31:50.027276+0000","last_active":"2024-09-10T23:31:50.042731+0000","last_peered":"2024-09-10T23:31:50.042731+0000","last_clean":"2024-09-10T23:31:50.042731+0000","last_became_active":"2024-09-10T23:31:50.026998+0000","last_became_peered":"2024-09-10T23:31:50.026998+0000","last_unstale":"2024-09-10T23:31:50.042731+0000","last_undegraded":"2024-09-10T23:31:50.042731+0000","last_fullsized":"2024-09-10T23:31:50.042731+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:45.499641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.041576+0000","last_change":"2024-09-10T23:31:50.037962+0000","last_active":"2024-09-10T23:31:50.041576+0000","last_peered":"2024-09-10T23:31:50.041576+0000","last_clean":"2024-09-10T23:31:50.041576+0000","last_became_active":"2024-09-10T23:31:50.037665+0000","last_became_peered":"2024-09-10T23:31:50.037665+0000","last_unstale":"2024-09-10T23:31:50.041576+0000","last_undegraded":"2024-09-10T23:31:50.041576+0000","last_fullsized":"2024-09-10T23:31:50.041576+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:01.925769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.042457+0000","last_change":"2024-09-10T23:31:50.040610+0000","last_active":"2024-09-10T23:31:50.042457+0000","last_peered":"2024-09-10T23:31:50.042457+0000","last_clean":"2024-09-10T23:31:50.042457+0000","last_became_active":"2024-09-10T23:31:50.040350+0000","last_became_peered":"2024-09-10T23:31:50.040350+0000","last_unstale":"2024-09-10T23:31:50.042457+0000","last_undegraded":"2024-09-10T23:31:50.042457+0000","last_fullsized":"2024-09-10T23:31:50.042457+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:18.496197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.055936+0000","last_change":"2024-09-10T23:31:50.051489+0000","last_active":"2024-09-10T23:31:50.055936+0000","last_peered":"2024-09-10T23:31:50.055936+0000","last_clean":"2024-09-10T23:31:50.055936+0000","last_became_active":"2024-09-10T23:31:50.051186+0000","last_became_peered":"2024-09-10T23:31:50.051186+0000","last_unstale":"2024-09-10T23:31:50.055936+0000","last_undegraded":"2024-09-10T23:31:50.055936+0000","last_fullsized":"2024-09-10T23:31:50.055936+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:52:44.526664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.058626+0000","last_change":"2024-09-10T23:31:50.057666+0000","last_active":"2024-09-10T23:31:50.058626+0000","last_peered":"2024-09-10T23:31:50.058626+0000","last_clean":"2024-09-10T23:31:50.058626+0000","last_became_active":"2024-09-10T23:31:50.057034+0000","last_became_peered":"2024-09-10T23:31:50.057034+0000","last_unstale":"2024-09-10T23:31:50.058626+0000","last_undegraded":"2024-09-10T23:31:50.058626+0000","last_fullsized":"2024-09-10T23:31:50.058626+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:20.981767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.037632+0000","last_change":"2024-09-10T23:31:50.033479+0000","last_active":"2024-09-10T23:31:50.037632+0000","last_peered":"2024-09-10T23:31:50.037632+0000","last_clean":"2024-09-10T23:31:50.037632+0000","last_became_active":"2024-09-10T23:31:50.033205+0000","last_became_peered":"2024-09-10T23:31:50.033205+0000","last_unstale":"2024-09-10T23:31:50.037632+0000","last_undegraded":"2024-09-10T23:31:50.037632+0000","last_fullsized":"2024-09-10T23:31:50.037632+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:30.740474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050670+0000","last_change":"2024-09-10T23:31:50.048000+0000","last_active":"2024-09-10T23:31:50.050670+0000","last_peered":"2024-09-10T23:31:50.050670+0000","last_clean":"2024-09-10T23:31:50.050670+0000","last_became_active":"2024-09-10T23:31:50.047279+0000","last_became_peered":"2024-09-10T23:31:50.047279+0000","last_unstale":"2024-09-10T23:31:50.050670+0000","last_undegraded":"2024-09-10T23:31:50.050670+0000","last_fullsized":"2024-09-10T23:31:50.050670+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:50:13.210938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.048806+0000","last_change":"2024-09-10T23:31:50.033661+0000","last_active":"2024-09-10T23:31:50.048806+0000","last_peered":"2024-09-10T23:31:50.048806+0000","last_clean":"2024-09-10T23:31:50.048806+0000","last_became_active":"2024-09-10T23:31:50.033434+0000","last_became_peered":"2024-09-10T23:31:50.033434+0000","last_unstale":"2024-09-10T23:31:50.048806+0000","last_undegraded":"2024-09-10T23:31:50.048806+0000","last_fullsized":"2024-09-10T23:31:50.048806+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:12:54.816029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.057720+0000","last_change":"2024-09-10T23:31:50.056654+0000","last_active":"2024-09-10T23:31:50.057720+0000","last_peered":"2024-09-10T23:31:50.057720+0000","last_clean":"2024-09-10T23:31:50.057720+0000","last_became_active":"2024-09-10T23:31:50.056394+0000","last_became_peered":"2024-09-10T23:31:50.056394+0000","last_unstale":"2024-09-10T23:31:50.057720+0000","last_undegraded":"2024-09-10T23:31:50.057720+0000","last_fullsized":"2024-09-10T23:31:50.057720+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:35:27.689437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051342+0000","last_change":"2024-09-10T23:31:50.049905+0000","last_active":"2024-09-10T23:31:50.051342+0000","last_peered":"2024-09-10T23:31:50.051342+0000","last_clean":"2024-09-10T23:31:50.051342+0000","last_became_active":"2024-09-10T23:31:50.049092+0000","last_became_peered":"2024-09-10T23:31:50.049092+0000","last_unstale":"2024-09-10T23:31:50.051342+0000","last_undegraded":"2024-09-10T23:31:50.051342+0000","last_fullsized":"2024-09-10T23:31:50.051342+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:59.369894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"222'4","reported_seq":17,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.061949+0000","last_change":"2024-09-10T23:31:49.031425+0000","last_active":"2024-09-10T23:31:50.061949+0000","last_peered":"2024-09-10T23:31:50.061949+0000","last_clean":"2024-09-10T23:31:50.061949+0000","last_became_active":"2024-09-10T23:31:49.031058+0000","last_became_peered":"2024-09-10T23:31:49.031058+0000","last_unstale":"2024-09-10T23:31:50.061949+0000","last_undegraded":"2024-09-10T23:31:50.061949+0000","last_fullsized":"2024-09-10T23:31:50.061949+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:41.077738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.053851+0000","last_change":"2024-09-10T23:31:50.043830+0000","last_active":"2024-09-10T23:31:50.053851+0000","last_peered":"2024-09-10T23:31:50.053851+0000","last_clean":"2024-09-10T23:31:50.053851+0000","last_became_active":"2024-09-10T23:31:50.043556+0000","last_became_peered":"2024-09-10T23:31:50.043556+0000","last_unstale":"2024-09-10T23:31:50.053851+0000","last_undegraded":"2024-09-10T23:31:50.053851+0000","last_fullsized":"2024-09-10T23:31:50.053851+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:48:10.916520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.047933+0000","last_change":"2024-09-10T23:31:49.034629+0000","last_active":"2024-09-10T23:31:50.047933+0000","last_peered":"2024-09-10T23:31:50.047933+0000","last_clean":"2024-09-10T23:31:50.047933+0000","last_became_active":"2024-09-10T23:31:49.034347+0000","last_became_peered":"2024-09-10T23:31:49.034347+0000","last_unstale":"2024-09-10T23:31:50.047933+0000","last_undegraded":"2024-09-10T23:31:50.047933+0000","last_fullsized":"2024-09-10T23:31:50.047933+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:05:14.838166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.062117+0000","last_change":"2024-09-10T23:31:50.060440+0000","last_active":"2024-09-10T23:31:50.062117+0000","last_peered":"2024-09-10T23:31:50.062117+0000","last_clean":"2024-09-10T23:31:50.062117+0000","last_became_active":"2024-09-10T23:31:50.058307+0000","last_became_peered":"2024-09-10T23:31:50.058307+0000","last_unstale":"2024-09-10T23:31:50.062117+0000","last_undegraded":"2024-09-10T23:31:50.062117+0000","last_fullsized":"2024-09-10T23:31:50.062117+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:53:55.442453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.065797+0000","last_change":"2024-09-10T23:31:49.036759+0000","last_active":"2024-09-10T23:31:50.065797+0000","last_peered":"2024-09-10T23:31:50.065797+0000","last_clean":"2024-09-10T23:31:50.065797+0000","last_became_active":"2024-09-10T23:31:49.036454+0000","last_became_peered":"2024-09-10T23:31:49.036454+0000","last_unstale":"2024-09-10T23:31:50.065797+0000","last_undegraded":"2024-09-10T23:31:50.065797+0000","last_fullsized":"2024-09-10T23:31:50.065797+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:14.900913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051860+0000","last_change":"2024-09-10T23:31:50.035611+0000","last_active":"2024-09-10T23:31:50.051860+0000","last_peered":"2024-09-10T23:31:50.051860+0000","last_clean":"2024-09-10T23:31:50.051860+0000","last_became_active":"2024-09-10T23:31:50.035335+0000","last_became_peered":"2024-09-10T23:31:50.035335+0000","last_unstale":"2024-09-10T23:31:50.051860+0000","last_undegraded":"2024-09-10T23:31:50.051860+0000","last_fullsized":"2024-09-10T23:31:50.051860+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:41.376054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.057306+0000","last_change":"2024-09-10T23:31:49.043675+0000","last_active":"2024-09-10T23:31:50.057306+0000","last_peered":"2024-09-10T23:31:50.057306+0000","last_clean":"2024-09-10T23:31:50.057306+0000","last_became_active":"2024-09-10T23:31:49.043449+0000","last_became_peered":"2024-09-10T23:31:49.043449+0000","last_unstale":"2024-09-10T23:31:50.057306+0000","last_undegraded":"2024-09-10T23:31:50.057306+0000","last_fullsized":"2024-09-10T23:31:50.057306+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:52.458309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.041149+0000","last_change":"2024-09-10T23:31:50.026626+0000","last_active":"2024-09-10T23:31:50.041149+0000","last_peered":"2024-09-10T23:31:50.041149+0000","last_clean":"2024-09-10T23:31:50.041149+0000","last_became_active":"2024-09-10T23:31:50.026348+0000","last_became_peered":"2024-09-10T23:31:50.026348+0000","last_unstale":"2024-09-10T23:31:50.041149+0000","last_undegraded":"2024-09-10T23:31:50.041149+0000","last_fullsized":"2024-09-10T23:31:50.041149+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:31.480055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.049816+0000","last_change":"2024-09-10T23:31:49.030347+0000","last_active":"2024-09-10T23:31:50.049816+0000","last_peered":"2024-09-10T23:31:50.049816+0000","last_clean":"2024-09-10T23:31:50.049816+0000","last_became_active":"2024-09-10T23:31:49.030093+0000","last_became_peered":"2024-09-10T23:31:49.030093+0000","last_unstale":"2024-09-10T23:31:50.049816+0000","last_undegraded":"2024-09-10T23:31:50.049816+0000","last_fullsized":"2024-09-10T23:31:50.049816+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:35.949314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051509+0000","last_change":"2024-09-10T23:31:50.047785+0000","last_active":"2024-09-10T23:31:50.051509+0000","last_peered":"2024-09-10T23:31:50.051509+0000","last_clean":"2024-09-10T23:31:50.051509+0000","last_became_active":"2024-09-10T23:31:50.047511+0000","last_became_peered":"2024-09-10T23:31:50.047511+0000","last_unstale":"2024-09-10T23:31:50.051509+0000","last_undegraded":"2024-09-10T23:31:50.051509+0000","last_fullsized":"2024-09-10T23:31:50.051509+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:00.428421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.057814+0000","last_change":"2024-09-10T23:31:49.036841+0000","last_active":"2024-09-10T23:31:50.057814+0000","last_peered":"2024-09-10T23:31:50.057814+0000","last_clean":"2024-09-10T23:31:50.057814+0000","last_became_active":"2024-09-10T23:31:49.036387+0000","last_became_peered":"2024-09-10T23:31:49.036387+0000","last_unstale":"2024-09-10T23:31:50.057814+0000","last_undegraded":"2024-09-10T23:31:50.057814+0000","last_fullsized":"2024-09-10T23:31:50.057814+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:13.360755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.043085+0000","last_change":"2024-09-10T23:31:50.033290+0000","last_active":"2024-09-10T23:31:50.043085+0000","last_peered":"2024-09-10T23:31:50.043085+0000","last_clean":"2024-09-10T23:31:50.043085+0000","last_became_active":"2024-09-10T23:31:50.033029+0000","last_became_peered":"2024-09-10T23:31:50.033029+0000","last_unstale":"2024-09-10T23:31:50.043085+0000","last_undegraded":"2024-09-10T23:31:50.043085+0000","last_fullsized":"2024-09-10T23:31:50.043085+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:13.739683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.032784+0000","last_change":"2024-09-10T23:31:49.034926+0000","last_active":"2024-09-10T23:31:50.032784+0000","last_peered":"2024-09-10T23:31:50.032784+0000","last_clean":"2024-09-10T23:31:50.032784+0000","last_became_active":"2024-09-10T23:31:49.034635+0000","last_became_peered":"2024-09-10T23:31:49.034635+0000","last_unstale":"2024-09-10T23:31:50.032784+0000","last_undegraded":"2024-09-10T23:31:50.032784+0000","last_fullsized":"2024-09-10T23:31:50.032784+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:41.767267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":13,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497721+0000","last_change":"2024-09-10T23:31:50.046729+0000","last_active":"2024-09-10T23:31:51.497721+0000","last_peered":"2024-09-10T23:31:51.497721+0000","last_clean":"2024-09-10T23:31:51.497721+0000","last_became_active":"2024-09-10T23:31:50.045889+0000","last_became_peered":"2024-09-10T23:31:50.045889+0000","last_unstale":"2024-09-10T23:31:51.497721+0000","last_undegraded":"2024-09-10T23:31:51.497721+0000","last_fullsized":"2024-09-10T23:31:51.497721+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:53.349443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.019773+0000","last_change":"2024-09-10T23:31:49.035436+0000","last_active":"2024-09-10T23:31:50.019773+0000","last_peered":"2024-09-10T23:31:50.019773+0000","last_clean":"2024-09-10T23:31:50.019773+0000","last_became_active":"2024-09-10T23:31:49.031642+0000","last_became_peered":"2024-09-10T23:31:49.031642+0000","last_unstale":"2024-09-10T23:31:50.019773+0000","last_undegraded":"2024-09-10T23:31:50.019773+0000","last_fullsized":"2024-09-10T23:31:50.019773+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:34:52.052911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":13,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497252+0000","last_change":"2024-09-10T23:31:50.045172+0000","last_active":"2024-09-10T23:31:51.497252+0000","last_peered":"2024-09-10T23:31:51.497252+0000","last_clean":"2024-09-10T23:31:51.497252+0000","last_became_active":"2024-09-10T23:31:50.044367+0000","last_became_peered":"2024-09-10T23:31:50.044367+0000","last_unstale":"2024-09-10T23:31:51.497252+0000","last_undegraded":"2024-09-10T23:31:51.497252+0000","last_fullsized":"2024-09-10T23:31:51.497252+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:57.571153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":15,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497411+0000","last_change":"2024-09-10T23:31:49.038099+0000","last_active":"2024-09-10T23:31:51.497411+0000","last_peered":"2024-09-10T23:31:51.497411+0000","last_clean":"2024-09-10T23:31:51.497411+0000","last_became_active":"2024-09-10T23:31:49.037832+0000","last_became_peered":"2024-09-10T23:31:49.037832+0000","last_unstale":"2024-09-10T23:31:51.497411+0000","last_undegraded":"2024-09-10T23:31:51.497411+0000","last_fullsized":"2024-09-10T23:31:51.497411+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:22:57.201321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.058546+0000","last_change":"2024-09-10T23:31:50.053452+0000","last_active":"2024-09-10T23:31:50.058546+0000","last_peered":"2024-09-10T23:31:50.058546+0000","last_clean":"2024-09-10T23:31:50.058546+0000","last_became_active":"2024-09-10T23:31:50.052636+0000","last_became_peered":"2024-09-10T23:31:50.052636+0000","last_unstale":"2024-09-10T23:31:50.058546+0000","last_undegraded":"2024-09-10T23:31:50.058546+0000","last_fullsized":"2024-09-10T23:31:50.058546+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:15.742616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.032946+0000","last_change":"2024-09-10T23:31:49.035402+0000","last_active":"2024-09-10T23:31:50.032946+0000","last_peered":"2024-09-10T23:31:50.032946+0000","last_clean":"2024-09-10T23:31:50.032946+0000","last_became_active":"2024-09-10T23:31:49.035105+0000","last_became_peered":"2024-09-10T23:31:49.035105+0000","last_unstale":"2024-09-10T23:31:50.032946+0000","last_undegraded":"2024-09-10T23:31:50.032946+0000","last_fullsized":"2024-09-10T23:31:50.032946+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:58.496011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.053367+0000","last_change":"2024-09-10T23:31:50.052462+0000","last_active":"2024-09-10T23:31:50.053367+0000","last_peered":"2024-09-10T23:31:50.053367+0000","last_clean":"2024-09-10T23:31:50.053367+0000","last_became_active":"2024-09-10T23:31:50.052111+0000","last_became_peered":"2024-09-10T23:31:50.052111+0000","last_unstale":"2024-09-10T23:31:50.053367+0000","last_undegraded":"2024-09-10T23:31:50.053367+0000","last_fullsized":"2024-09-10T23:31:50.053367+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:56:38.852292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"222'3","reported_seq":18,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497365+0000","last_change":"2024-09-10T23:31:49.035643+0000","last_active":"2024-09-10T23:31:51.497365+0000","last_peered":"2024-09-10T23:31:51.497365+0000","last_clean":"2024-09-10T23:31:51.497365+0000","last_became_active":"2024-09-10T23:31:49.035338+0000","last_became_peered":"2024-09-10T23:31:49.035338+0000","last_unstale":"2024-09-10T23:31:51.497365+0000","last_undegraded":"2024-09-10T23:31:51.497365+0000","last_fullsized":"2024-09-10T23:31:51.497365+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:03:00.939682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.045644+0000","last_change":"2024-09-10T23:31:50.041276+0000","last_active":"2024-09-10T23:31:50.045644+0000","last_peered":"2024-09-10T23:31:50.045644+0000","last_clean":"2024-09-10T23:31:50.045644+0000","last_became_active":"2024-09-10T23:31:50.040065+0000","last_became_peered":"2024-09-10T23:31:50.040065+0000","last_unstale":"2024-09-10T23:31:50.045644+0000","last_undegraded":"2024-09-10T23:31:50.045644+0000","last_fullsized":"2024-09-10T23:31:50.045644+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:58.172850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"222'6","reported_seq":19,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.062090+0000","last_change":"2024-09-10T23:31:49.017875+0000","last_active":"2024-09-10T23:31:50.062090+0000","last_peered":"2024-09-10T23:31:50.062090+0000","last_clean":"2024-09-10T23:31:50.062090+0000","last_became_active":"2024-09-10T23:31:49.017531+0000","last_became_peered":"2024-09-10T23:31:49.017531+0000","last_unstale":"2024-09-10T23:31:50.062090+0000","last_undegraded":"2024-09-10T23:31:50.062090+0000","last_fullsized":"2024-09-10T23:31:50.062090+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:02.232643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050910+0000","last_change":"2024-09-10T23:31:50.041060+0000","last_active":"2024-09-10T23:31:50.050910+0000","last_peered":"2024-09-10T23:31:50.050910+0000","last_clean":"2024-09-10T23:31:50.050910+0000","last_became_active":"2024-09-10T23:31:50.040706+0000","last_became_peered":"2024-09-10T23:31:50.040706+0000","last_unstale":"2024-09-10T23:31:50.050910+0000","last_undegraded":"2024-09-10T23:31:50.050910+0000","last_fullsized":"2024-09-10T23:31:50.050910+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:23.049885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.049759+0000","last_change":"2024-09-10T23:31:49.029712+0000","last_active":"2024-09-10T23:31:50.049759+0000","last_peered":"2024-09-10T23:31:50.049759+0000","last_clean":"2024-09-10T23:31:50.049759+0000","last_became_active":"2024-09-10T23:31:49.029454+0000","last_became_peered":"2024-09-10T23:31:49.029454+0000","last_unstale":"2024-09-10T23:31:50.049759+0000","last_undegraded":"2024-09-10T23:31:50.049759+0000","last_fullsized":"2024-09-10T23:31:50.049759+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:07:40.436118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.039263+0000","last_change":"2024-09-10T23:31:50.035928+0000","last_active":"2024-09-10T23:31:50.039263+0000","last_peered":"2024-09-10T23:31:50.039263+0000","last_clean":"2024-09-10T23:31:50.039263+0000","last_became_active":"2024-09-10T23:31:50.035661+0000","last_became_peered":"2024-09-10T23:31:50.035661+0000","last_unstale":"2024-09-10T23:31:50.039263+0000","last_undegraded":"2024-09-10T23:31:50.039263+0000","last_fullsized":"2024-09-10T23:31:50.039263+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:48:27.254740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":15,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497262+0000","last_change":"2024-09-10T23:31:49.030396+0000","last_active":"2024-09-10T23:31:51.497262+0000","last_peered":"2024-09-10T23:31:51.497262+0000","last_clean":"2024-09-10T23:31:51.497262+0000","last_became_active":"2024-09-10T23:31:49.030086+0000","last_became_peered":"2024-09-10T23:31:49.030086+0000","last_unstale":"2024-09-10T23:31:51.497262+0000","last_undegraded":"2024-09-10T23:31:51.497262+0000","last_fullsized":"2024-09-10T23:31:51.497262+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:55:30.564939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051256+0000","last_change":"2024-09-10T23:31:50.039233+0000","last_active":"2024-09-10T23:31:50.051256+0000","last_peered":"2024-09-10T23:31:50.051256+0000","last_clean":"2024-09-10T23:31:50.051256+0000","last_became_active":"2024-09-10T23:31:50.038976+0000","last_became_peered":"2024-09-10T23:31:50.038976+0000","last_unstale":"2024-09-10T23:31:50.051256+0000","last_undegraded":"2024-09-10T23:31:50.051256+0000","last_fullsized":"2024-09-10T23:31:50.051256+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:39:54.805077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":15,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.496715+0000","last_change":"2024-09-10T23:31:49.028894+0000","last_active":"2024-09-10T23:31:51.496715+0000","last_peered":"2024-09-10T23:31:51.496715+0000","last_clean":"2024-09-10T23:31:51.496715+0000","last_became_active":"2024-09-10T23:31:49.028600+0000","last_became_peered":"2024-09-10T23:31:49.028600+0000","last_unstale":"2024-09-10T23:31:51.496715+0000","last_undegraded":"2024-09-10T23:31:51.496715+0000","last_fullsized":"2024-09-10T23:31:51.496715+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:05.220583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.051781+0000","last_change":"2024-09-10T23:31:50.046866+0000","last_active":"2024-09-10T23:31:50.051781+0000","last_peered":"2024-09-10T23:31:50.051781+0000","last_clean":"2024-09-10T23:31:50.051781+0000","last_became_active":"2024-09-10T23:31:50.046607+0000","last_became_peered":"2024-09-10T23:31:50.046607+0000","last_unstale":"2024-09-10T23:31:50.051781+0000","last_undegraded":"2024-09-10T23:31:50.051781+0000","last_fullsized":"2024-09-10T23:31:50.051781+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:26:41.309111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"222'8","reported_seq":23,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.496538+0000","last_change":"2024-09-10T23:31:49.034577+0000","last_active":"2024-09-10T23:31:51.496538+0000","last_peered":"2024-09-10T23:31:51.496538+0000","last_clean":"2024-09-10T23:31:51.496538+0000","last_became_active":"2024-09-10T23:31:49.034279+0000","last_became_peered":"2024-09-10T23:31:49.034279+0000","last_unstale":"2024-09-10T23:31:51.496538+0000","last_undegraded":"2024-09-10T23:31:51.496538+0000","last_fullsized":"2024-09-10T23:31:51.496538+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:15.920516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.037601+0000","last_change":"2024-09-10T23:31:50.029327+0000","last_active":"2024-09-10T23:31:50.037601+0000","last_peered":"2024-09-10T23:31:50.037601+0000","last_clean":"2024-09-10T23:31:50.037601+0000","last_became_active":"2024-09-10T23:31:50.028972+0000","last_became_peered":"2024-09-10T23:31:50.028972+0000","last_unstale":"2024-09-10T23:31:50.037601+0000","last_undegraded":"2024-09-10T23:31:50.037601+0000","last_fullsized":"2024-09-10T23:31:50.037601+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:09:41.064173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.059522+0000","last_change":"2024-09-10T23:31:49.039733+0000","last_active":"2024-09-10T23:31:50.059522+0000","last_peered":"2024-09-10T23:31:50.059522+0000","last_clean":"2024-09-10T23:31:50.059522+0000","last_became_active":"2024-09-10T23:31:49.039316+0000","last_became_peered":"2024-09-10T23:31:49.039316+0000","last_unstale":"2024-09-10T23:31:50.059522+0000","last_undegraded":"2024-09-10T23:31:50.059522+0000","last_fullsized":"2024-09-10T23:31:50.059522+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:12.651412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.044883+0000","last_change":"2024-09-10T23:31:50.040924+0000","last_active":"2024-09-10T23:31:50.044883+0000","last_peered":"2024-09-10T23:31:50.044883+0000","last_clean":"2024-09-10T23:31:50.044883+0000","last_became_active":"2024-09-10T23:31:50.040606+0000","last_became_peered":"2024-09-10T23:31:50.040606+0000","last_unstale":"2024-09-10T23:31:50.044883+0000","last_undegraded":"2024-09-10T23:31:50.044883+0000","last_fullsized":"2024-09-10T23:31:50.044883+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:29:11.920104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.062070+0000","last_change":"2024-09-10T23:31:49.032089+0000","last_active":"2024-09-10T23:31:50.062070+0000","last_peered":"2024-09-10T23:31:50.062070+0000","last_clean":"2024-09-10T23:31:50.062070+0000","last_became_active":"2024-09-10T23:31:49.031493+0000","last_became_peered":"2024-09-10T23:31:49.031493+0000","last_unstale":"2024-09-10T23:31:50.062070+0000","last_undegraded":"2024-09-10T23:31:50.062070+0000","last_fullsized":"2024-09-10T23:31:50.062070+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:15.552910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":13,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497777+0000","last_change":"2024-09-10T23:31:50.042906+0000","last_active":"2024-09-10T23:31:51.497777+0000","last_peered":"2024-09-10T23:31:51.497777+0000","last_clean":"2024-09-10T23:31:51.497777+0000","last_became_active":"2024-09-10T23:31:50.042649+0000","last_became_peered":"2024-09-10T23:31:50.042649+0000","last_unstale":"2024-09-10T23:31:51.497777+0000","last_undegraded":"2024-09-10T23:31:51.497777+0000","last_fullsized":"2024-09-10T23:31:51.497777+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:25:41.651228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"222'1","reported_seq":14,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.060741+0000","last_change":"2024-09-10T23:31:49.041174+0000","last_active":"2024-09-10T23:31:50.060741+0000","last_peered":"2024-09-10T23:31:50.060741+0000","last_clean":"2024-09-10T23:31:50.060741+0000","last_became_active":"2024-09-10T23:31:49.040937+0000","last_became_peered":"2024-09-10T23:31:49.040937+0000","last_unstale":"2024-09-10T23:31:50.060741+0000","last_undegraded":"2024-09-10T23:31:50.060741+0000","last_fullsized":"2024-09-10T23:31:50.060741+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:46:31.823914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.039310+0000","last_change":"2024-09-10T23:31:50.035283+0000","last_active":"2024-09-10T23:31:50.039310+0000","last_peered":"2024-09-10T23:31:50.039310+0000","last_clean":"2024-09-10T23:31:50.039310+0000","last_became_active":"2024-09-10T23:31:50.034729+0000","last_became_peered":"2024-09-10T23:31:50.034729+0000","last_unstale":"2024-09-10T23:31:50.039310+0000","last_undegraded":"2024-09-10T23:31:50.039310+0000","last_fullsized":"2024-09-10T23:31:50.039310+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:49.837627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.048200+0000","last_change":"2024-09-10T23:31:49.028002+0000","last_active":"2024-09-10T23:31:50.048200+0000","last_peered":"2024-09-10T23:31:50.048200+0000","last_clean":"2024-09-10T23:31:50.048200+0000","last_became_active":"2024-09-10T23:31:49.027714+0000","last_became_peered":"2024-09-10T23:31:49.027714+0000","last_unstale":"2024-09-10T23:31:50.048200+0000","last_undegraded":"2024-09-10T23:31:50.048200+0000","last_fullsized":"2024-09-10T23:31:50.048200+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:31:57.617633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.041120+0000","last_change":"2024-09-10T23:31:50.026424+0000","last_active":"2024-09-10T23:31:50.041120+0000","last_peered":"2024-09-10T23:31:50.041120+0000","last_clean":"2024-09-10T23:31:50.041120+0000","last_became_active":"2024-09-10T23:31:50.026114+0000","last_became_peered":"2024-09-10T23:31:50.026114+0000","last_unstale":"2024-09-10T23:31:50.041120+0000","last_undegraded":"2024-09-10T23:31:50.041120+0000","last_fullsized":"2024-09-10T23:31:50.041120+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:40:13.493974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"222'2","reported_seq":15,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.054074+0000","last_change":"2024-09-10T23:31:49.037801+0000","last_active":"2024-09-10T23:31:50.054074+0000","last_peered":"2024-09-10T23:31:50.054074+0000","last_clean":"2024-09-10T23:31:50.054074+0000","last_became_active":"2024-09-10T23:31:49.037534+0000","last_became_peered":"2024-09-10T23:31:49.037534+0000","last_unstale":"2024-09-10T23:31:50.054074+0000","last_undegraded":"2024-09-10T23:31:50.054074+0000","last_fullsized":"2024-09-10T23:31:50.054074+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:11:49.276698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.046393+0000","last_change":"2024-09-10T23:31:50.043209+0000","last_active":"2024-09-10T23:31:50.046393+0000","last_peered":"2024-09-10T23:31:50.046393+0000","last_clean":"2024-09-10T23:31:50.046393+0000","last_became_active":"2024-09-10T23:31:50.042928+0000","last_became_peered":"2024-09-10T23:31:50.042928+0000","last_unstale":"2024-09-10T23:31:50.046393+0000","last_undegraded":"2024-09-10T23:31:50.046393+0000","last_fullsized":"2024-09-10T23:31:50.046393+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:59:41.781949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.019914+0000","last_change":"2024-09-10T23:31:49.036098+0000","last_active":"2024-09-10T23:31:50.019914+0000","last_peered":"2024-09-10T23:31:50.019914+0000","last_clean":"2024-09-10T23:31:50.019914+0000","last_became_active":"2024-09-10T23:31:49.035829+0000","last_became_peered":"2024-09-10T23:31:49.035829+0000","last_unstale":"2024-09-10T23:31:50.019914+0000","last_undegraded":"2024-09-10T23:31:50.019914+0000","last_fullsized":"2024-09-10T23:31:50.019914+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:52:03.478766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":13,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497075+0000","last_change":"2024-09-10T23:31:50.040014+0000","last_active":"2024-09-10T23:31:51.497075+0000","last_peered":"2024-09-10T23:31:51.497075+0000","last_clean":"2024-09-10T23:31:51.497075+0000","last_became_active":"2024-09-10T23:31:50.039729+0000","last_became_peered":"2024-09-10T23:31:50.039729+0000","last_unstale":"2024-09-10T23:31:51.497075+0000","last_undegraded":"2024-09-10T23:31:51.497075+0000","last_fullsized":"2024-09-10T23:31:51.497075+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:21:51.807689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.016656+0000","last_change":"2024-09-10T23:31:49.029220+0000","last_active":"2024-09-10T23:31:50.016656+0000","last_peered":"2024-09-10T23:31:50.016656+0000","last_clean":"2024-09-10T23:31:50.016656+0000","last_became_active":"2024-09-10T23:31:49.028956+0000","last_became_peered":"2024-09-10T23:31:49.028956+0000","last_unstale":"2024-09-10T23:31:50.016656+0000","last_undegraded":"2024-09-10T23:31:50.016656+0000","last_fullsized":"2024-09-10T23:31:50.016656+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:33.585946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.052293+0000","last_change":"2024-09-10T23:31:50.041842+0000","last_active":"2024-09-10T23:31:50.052293+0000","last_peered":"2024-09-10T23:31:50.052293+0000","last_clean":"2024-09-10T23:31:50.052293+0000","last_became_active":"2024-09-10T23:31:50.041526+0000","last_became_peered":"2024-09-10T23:31:50.041526+0000","last_unstale":"2024-09-10T23:31:50.052293+0000","last_undegraded":"2024-09-10T23:31:50.052293+0000","last_fullsized":"2024-09-10T23:31:50.052293+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:17.229214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":15,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.496562+0000","last_change":"2024-09-10T23:31:49.023870+0000","last_active":"2024-09-10T23:31:51.496562+0000","last_peered":"2024-09-10T23:31:51.496562+0000","last_clean":"2024-09-10T23:31:51.496562+0000","last_became_active":"2024-09-10T23:31:49.023610+0000","last_became_peered":"2024-09-10T23:31:49.023610+0000","last_unstale":"2024-09-10T23:31:51.496562+0000","last_undegraded":"2024-09-10T23:31:51.496562+0000","last_fullsized":"2024-09-10T23:31:51.496562+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:48.898466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.047488+0000","last_change":"2024-09-10T23:31:50.045561+0000","last_active":"2024-09-10T23:31:50.047488+0000","last_peered":"2024-09-10T23:31:50.047488+0000","last_clean":"2024-09-10T23:31:50.047488+0000","last_became_active":"2024-09-10T23:31:50.045274+0000","last_became_peered":"2024-09-10T23:31:50.045274+0000","last_unstale":"2024-09-10T23:31:50.047488+0000","last_undegraded":"2024-09-10T23:31:50.047488+0000","last_fullsized":"2024-09-10T23:31:50.047488+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:12.106706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"222'2","reported_seq":17,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497467+0000","last_change":"2024-09-10T23:31:49.024583+0000","last_active":"2024-09-10T23:31:51.497467+0000","last_peered":"2024-09-10T23:31:51.497467+0000","last_clean":"2024-09-10T23:31:51.497467+0000","last_became_active":"2024-09-10T23:31:49.024271+0000","last_became_peered":"2024-09-10T23:31:49.024271+0000","last_unstale":"2024-09-10T23:31:51.497467+0000","last_undegraded":"2024-09-10T23:31:51.497467+0000","last_fullsized":"2024-09-10T23:31:51.497467+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:18.050848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.046071+0000","last_change":"2024-09-10T23:31:50.040825+0000","last_active":"2024-09-10T23:31:50.046071+0000","last_peered":"2024-09-10T23:31:50.046071+0000","last_clean":"2024-09-10T23:31:50.046071+0000","last_became_active":"2024-09-10T23:31:50.040557+0000","last_became_peered":"2024-09-10T23:31:50.040557+0000","last_unstale":"2024-09-10T23:31:50.046071+0000","last_undegraded":"2024-09-10T23:31:50.046071+0000","last_fullsized":"2024-09-10T23:31:50.046071+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:59:14.035907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.054894+0000","last_change":"2024-09-10T23:31:49.031787+0000","last_active":"2024-09-10T23:31:50.054894+0000","last_peered":"2024-09-10T23:31:50.054894+0000","last_clean":"2024-09-10T23:31:50.054894+0000","last_became_active":"2024-09-10T23:31:49.031121+0000","last_became_peered":"2024-09-10T23:31:49.031121+0000","last_unstale":"2024-09-10T23:31:50.054894+0000","last_undegraded":"2024-09-10T23:31:50.054894+0000","last_fullsized":"2024-09-10T23:31:50.054894+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:20.708652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.054545+0000","last_change":"2024-09-10T23:31:50.053913+0000","last_active":"2024-09-10T23:31:50.054545+0000","last_peered":"2024-09-10T23:31:50.054545+0000","last_clean":"2024-09-10T23:31:50.054545+0000","last_became_active":"2024-09-10T23:31:50.053618+0000","last_became_peered":"2024-09-10T23:31:50.053618+0000","last_unstale":"2024-09-10T23:31:50.054545+0000","last_undegraded":"2024-09-10T23:31:50.054545+0000","last_fullsized":"2024-09-10T23:31:50.054545+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:53.589857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.029666+0000","last_change":"2024-09-10T23:31:49.038418+0000","last_active":"2024-09-10T23:31:50.029666+0000","last_peered":"2024-09-10T23:31:50.029666+0000","last_clean":"2024-09-10T23:31:50.029666+0000","last_became_active":"2024-09-10T23:31:49.038173+0000","last_became_peered":"2024-09-10T23:31:49.038173+0000","last_unstale":"2024-09-10T23:31:50.029666+0000","last_undegraded":"2024-09-10T23:31:50.029666+0000","last_fullsized":"2024-09-10T23:31:50.029666+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:33.207662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.046386+0000","last_change":"2024-09-10T23:31:50.044426+0000","last_active":"2024-09-10T23:31:50.046386+0000","last_peered":"2024-09-10T23:31:50.046386+0000","last_clean":"2024-09-10T23:31:50.046386+0000","last_became_active":"2024-09-10T23:31:50.044142+0000","last_became_peered":"2024-09-10T23:31:50.044142+0000","last_unstale":"2024-09-10T23:31:50.046386+0000","last_undegraded":"2024-09-10T23:31:50.046386+0000","last_fullsized":"2024-09-10T23:31:50.046386+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:26.749709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.029239+0000","last_change":"2024-09-10T23:31:49.036826+0000","last_active":"2024-09-10T23:31:50.029239+0000","last_peered":"2024-09-10T23:31:50.029239+0000","last_clean":"2024-09-10T23:31:50.029239+0000","last_became_active":"2024-09-10T23:31:49.036509+0000","last_became_peered":"2024-09-10T23:31:49.036509+0000","last_unstale":"2024-09-10T23:31:50.029239+0000","last_undegraded":"2024-09-10T23:31:50.029239+0000","last_fullsized":"2024-09-10T23:31:50.029239+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:39.573831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":13,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.496498+0000","last_change":"2024-09-10T23:31:50.054904+0000","last_active":"2024-09-10T23:31:51.496498+0000","last_peered":"2024-09-10T23:31:51.496498+0000","last_clean":"2024-09-10T23:31:51.496498+0000","last_became_active":"2024-09-10T23:31:50.054616+0000","last_became_peered":"2024-09-10T23:31:50.054616+0000","last_unstale":"2024-09-10T23:31:51.496498+0000","last_undegraded":"2024-09-10T23:31:51.496498+0000","last_fullsized":"2024-09-10T23:31:51.496498+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:35:44.953960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.047458+0000","last_change":"2024-09-10T23:31:49.033149+0000","last_active":"2024-09-10T23:31:50.047458+0000","last_peered":"2024-09-10T23:31:50.047458+0000","last_clean":"2024-09-10T23:31:50.047458+0000","last_became_active":"2024-09-10T23:31:49.032889+0000","last_became_peered":"2024-09-10T23:31:49.032889+0000","last_unstale":"2024-09-10T23:31:50.047458+0000","last_undegraded":"2024-09-10T23:31:50.047458+0000","last_fullsized":"2024-09-10T23:31:50.047458+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:35.522859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.049867+0000","last_change":"2024-09-10T23:31:50.034063+0000","last_active":"2024-09-10T23:31:50.049867+0000","last_peered":"2024-09-10T23:31:50.049867+0000","last_clean":"2024-09-10T23:31:50.049867+0000","last_became_active":"2024-09-10T23:31:50.033713+0000","last_became_peered":"2024-09-10T23:31:50.033713+0000","last_unstale":"2024-09-10T23:31:50.049867+0000","last_undegraded":"2024-09-10T23:31:50.049867+0000","last_fullsized":"2024-09-10T23:31:50.049867+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:56.181370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.044329+0000","last_change":"2024-09-10T23:31:49.033083+0000","last_active":"2024-09-10T23:31:50.044329+0000","last_peered":"2024-09-10T23:31:50.044329+0000","last_clean":"2024-09-10T23:31:50.044329+0000","last_became_active":"2024-09-10T23:31:49.032802+0000","last_became_peered":"2024-09-10T23:31:49.032802+0000","last_unstale":"2024-09-10T23:31:50.044329+0000","last_undegraded":"2024-09-10T23:31:50.044329+0000","last_fullsized":"2024-09-10T23:31:50.044329+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:11:06.909587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.055397+0000","last_change":"2024-09-10T23:31:50.050193+0000","last_active":"2024-09-10T23:31:50.055397+0000","last_peered":"2024-09-10T23:31:50.055397+0000","last_clean":"2024-09-10T23:31:50.055397+0000","last_became_active":"2024-09-10T23:31:50.049461+0000","last_became_peered":"2024-09-10T23:31:50.049461+0000","last_unstale":"2024-09-10T23:31:50.055397+0000","last_undegraded":"2024-09-10T23:31:50.055397+0000","last_fullsized":"2024-09-10T23:31:50.055397+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:29:56.584046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.028848+0000","last_change":"2024-09-10T23:31:49.032420+0000","last_active":"2024-09-10T23:31:50.028848+0000","last_peered":"2024-09-10T23:31:50.028848+0000","last_clean":"2024-09-10T23:31:50.028848+0000","last_became_active":"2024-09-10T23:31:49.032159+0000","last_became_peered":"2024-09-10T23:31:49.032159+0000","last_unstale":"2024-09-10T23:31:50.028848+0000","last_undegraded":"2024-09-10T23:31:50.028848+0000","last_fullsized":"2024-09-10T23:31:50.028848+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:54.696869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":10,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.050527+0000","last_change":"2024-09-10T23:31:50.045398+0000","last_active":"2024-09-10T23:31:50.050527+0000","last_peered":"2024-09-10T23:31:50.050527+0000","last_clean":"2024-09-10T23:31:50.050527+0000","last_became_active":"2024-09-10T23:31:50.045140+0000","last_became_peered":"2024-09-10T23:31:50.045140+0000","last_unstale":"2024-09-10T23:31:50.050527+0000","last_undegraded":"2024-09-10T23:31:50.050527+0000","last_fullsized":"2024-09-10T23:31:50.050527+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:58:27.878662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":13,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.052464+0000","last_change":"2024-09-10T23:31:49.031582+0000","last_active":"2024-09-10T23:31:50.052464+0000","last_peered":"2024-09-10T23:31:50.052464+0000","last_clean":"2024-09-10T23:31:50.052464+0000","last_became_active":"2024-09-10T23:31:49.030822+0000","last_became_peered":"2024-09-10T23:31:49.030822+0000","last_unstale":"2024-09-10T23:31:50.052464+0000","last_undegraded":"2024-09-10T23:31:50.052464+0000","last_fullsized":"2024-09-10T23:31:50.052464+0000","mapping_epoch":220,"log_start":"0'0","ondisk_log_start":"0'0","created":220,"last_epoch_clean":221,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:47.998018+0000","last_clean_scrub_stamp":"2024-09-10T23:31:47.998018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:05.844297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":13,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-10T23:31:51.497506+0000","last_change":"2024-09-10T23:31:50.046454+0000","last_active":"2024-09-10T23:31:51.497506+0000","last_peered":"2024-09-10T23:31:51.497506+0000","last_clean":"2024-09-10T23:31:51.497506+0000","last_became_active":"2024-09-10T23:31:50.045583+0000","last_became_peered":"2024-09-10T23:31:50.045583+0000","last_unstale":"2024-09-10T23:31:51.497506+0000","last_undegraded":"2024-09-10T23:31:51.497506+0000","last_fullsized":"2024-09-10T23:31:51.497506+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":221,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:31:49.001016+0000","last_clean_scrub_stamp":"2024-09-10T23:31:49.001016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:16.449888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":475,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-10T23:31:50.029655+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:31:50.029655+0000","last_peered":"2024-09-10T23:31:50.029655+0000","last_clean":"2024-09-10T23:31:50.029655+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:31:50.029655+0000","last_undegraded":"2024-09-10T23:31:50.029655+0000","last_fullsized":"2024-09-10T23:31:50.029655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476936,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74128,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297712,"statfs":{"total":96636764160,"available":96560857088,"internally_reserved":0,"allocated":2809856,"data_stored":1319982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509641,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92740,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94279100,"statfs":{"total":96636764160,"available":96541798400,"internally_reserved":0,"allocated":3387392,"data_stored":1903149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509640,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51968,"kb_used_data":2728,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319872,"statfs":{"total":96636764160,"available":96583548928,"internally_reserved":0,"allocated":2793472,"data_stored":1312781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509641,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74172,"kb_used_data":2728,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297668,"statfs":{"total":96636764160,"available":96560812032,"internally_reserved":0,"allocated":2793472,"data_stored":1312781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509640,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78332,"kb_used_data":2728,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293508,"statfs":{"total":96636764160,"available":96556552192,"internally_reserved":0,"allocated":2793472,"data_stored":1312781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509641,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51988,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319852,"statfs":{"total":96636764160,"available":96583528448,"internally_reserved":0,"allocated":2813952,"data_stored":1320072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509640,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78912,"kb_used_data":3308,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292928,"statfs":{"total":96636764160,"available":96555958272,"internally_reserved":0,"allocated":3387392,"data_stored":1903149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74136,"kb_used_data":2756,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297704,"statfs":{"total":96636764160,"available":96560848896,"internally_reserved":0,"allocated":2822144,"data_stored":1326730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:31:54.579 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:31:54.579 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T23:31:54.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.770+0000 7f35a5a00640 1 -- 172.21.15.17:0/5564337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3584004d50 msgr2=0x7f35840051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.770+0000 7f35a5a00640 1 --2- 172.21.15.17:0/5564337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3584004d50 0x7f35840051d0 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7f35980096f0 tx=0x7f359801f450 comp rx=0 tx=0).stop 2024-09-10T23:31:54.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.770+0000 7f359f400640 1 -- 172.21.15.17:0/5564337 reap_dead start 2024-09-10T23:31:54.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.770+0000 7f35a5a00640 1 -- 172.21.15.17:0/5564337 shutdown_connections 2024-09-10T23:31:54.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.770+0000 7f35a5a00640 1 -- 172.21.15.17:0/5564337 >> 172.21.15.17:0/5564337 conn(0x7f35a006c360 msgr2=0x7f35a006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:54.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.770+0000 7f35a5a00640 1 -- 172.21.15.17:0/5564337 shutdown_connections 2024-09-10T23:31:54.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.770+0000 7f35a5a00640 1 -- 172.21.15.17:0/5564337 wait complete. 2024-09-10T23:31:54.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f35a5a00640 1 Processor -- start 2024-09-10T23:31:54.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f35a5a00640 1 -- start start 2024-09-10T23:31:54.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f35a5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3584004d50 0x7f35a0150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f35a5a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35a0073820 0x7f35a009dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f35a5a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a01f8170 0x7f35a009b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f35a5a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f35a00d01b0 con 0x7f3584004d50 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f35a5a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f35a00d0030 con 0x7f35a01f8170 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f35a5a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f35a00d0330 con 0x7f35a0073820 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3584004d50 0x7f35a0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3584004d50 0x7f35a0150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55700/0 (socket says 172.21.15.17:55700) 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359ea00640 1 -- 172.21.15.17:0/3927355802 learned_addr learned my addr 172.21.15.17:0/3927355802 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f3596000640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35a0073820 0x7f35a009dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359f400640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a01f8170 0x7f35a009b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359ea00640 1 -- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35a0073820 msgr2=0x7f35a009dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359ea00640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35a0073820 0x7f35a009dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359ea00640 1 -- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a01f8170 msgr2=0x7f35a009b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359ea00640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a01f8170 0x7f35a009b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:54.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359ea00640 1 -- 172.21.15.17:0/3927355802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a009e020 con 0x7f3584004d50 2024-09-10T23:31:54.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f359ea00640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3584004d50 0x7f35a0150370 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f3590006450 tx=0x7f35900039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f3597400640 1 -- 172.21.15.17:0/3927355802 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3590015070 con 0x7f3584004d50 2024-09-10T23:31:54.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f3597400640 1 -- 172.21.15.17:0/3927355802 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3590011860 con 0x7f3584004d50 2024-09-10T23:31:54.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a0073dc0 con 0x7f3584004d50 2024-09-10T23:31:54.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.774+0000 7f3597400640 1 -- 172.21.15.17:0/3927355802 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3590011cb0 con 0x7f3584004d50 2024-09-10T23:31:54.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.778+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a0074380 con 0x7f3584004d50 2024-09-10T23:31:54.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.778+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a006a4b0 con 0x7f3584004d50 2024-09-10T23:31:54.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.778+0000 7f3597400640 1 -- 172.21.15.17:0/3927355802 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f35900103c0 con 0x7f3584004d50 2024-09-10T23:31:54.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.778+0000 7f3597400640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f357c072610 0x7f357c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:54.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.778+0000 7f3597400640 1 -- 172.21.15.17:0/3927355802 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7f3590094340 con 0x7f3584004d50 2024-09-10T23:31:54.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.778+0000 7f3596000640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f357c072610 0x7f357c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:54.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.782+0000 7f3596000640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f357c072610 0x7f357c074ad0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f35a0074b00 tx=0x7f3588004480 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:54.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:54.782+0000 7f3597400640 1 -- 172.21.15.17:0/3927355802 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f359005f1a0 con 0x7f3584004d50 2024-09-10T23:31:55.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.018+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f35a00ce3b0 con 0x7f3584004d50 2024-09-10T23:31:55.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.022+0000 7f3597400640 1 -- 172.21.15.17:0/3927355802 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v32) ==== 190+0+147 (secure 0 0 0) 0x7f3590063bd0 con 0x7f3584004d50 2024-09-10T23:31:55.025 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-10T23:31:55.025 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQDc0uBm1OfeKBAA3W8iKrBS2xPr+1JdecG3TQ== 2024-09-10T23:31:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: caps mds = "allow" 2024-09-10T23:31:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: caps mon = "allow r" 2024-09-10T23:31:55.026 INFO:teuthology.orchestra.run.smithi017.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T23:31:55.026 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-09-10T23:31:55.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f357c072610 msgr2=0x7f357c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f357c072610 0x7f357c074ad0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f35a0074b00 tx=0x7f3588004480 comp rx=0 tx=0).stop 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3584004d50 msgr2=0x7f35a0150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3584004d50 0x7f35a0150370 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f3590006450 tx=0x7f35900039d0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 shutdown_connections 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f357c072610 0x7f357c074ad0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35a01f8170 0x7f35a009b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f35a0073820 0x7f35a009dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 --2- 172.21.15.17:0/3927355802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3584004d50 0x7f35a0150370 unknown :-1 s=CLOSED pgs=2563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 >> 172.21.15.17:0/3927355802 conn(0x7f35a006c360 msgr2=0x7f35a00cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 shutdown_connections 2024-09-10T23:31:55.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.026+0000 7f35a5a00640 1 -- 172.21.15.17:0/3927355802 wait complete. 2024-09-10T23:31:55.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.190+0000 7f69dba00640 1 -- 172.21.15.17:0/58442243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d40cd5a0 msgr2=0x7f69d40b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.190+0000 7f69dba00640 1 --2- 172.21.15.17:0/58442243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d40cd5a0 0x7f69d40b5350 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009c80 tx=0x7f69cc01cc80 comp rx=0 tx=0).stop 2024-09-10T23:31:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.190+0000 7f69dba00640 1 -- 172.21.15.17:0/58442243 shutdown_connections 2024-09-10T23:31:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.190+0000 7f69dba00640 1 --2- 172.21.15.17:0/58442243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d40cd5a0 0x7f69d40b5350 unknown :-1 s=CLOSED pgs=2565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.190+0000 7f69dba00640 1 --2- 172.21.15.17:0/58442243 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69d40d2a60 0x7f69d40cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.190+0000 7f69dba00640 1 -- 172.21.15.17:0/58442243 >> 172.21.15.17:0/58442243 conn(0x7f69d40d1e40 msgr2=0x7f69d40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.190+0000 7f69dba00640 1 -- 172.21.15.17:0/58442243 shutdown_connections 2024-09-10T23:31:55.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.190+0000 7f69dba00640 1 -- 172.21.15.17:0/58442243 wait complete. 2024-09-10T23:31:55.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 Processor -- start 2024-09-10T23:31:55.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 -- start start 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69d40cd5a0 0x7f69d41f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d40d2a60 0x7f69d415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d415bf20 0x7f69d415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f69d4168da0 con 0x7f69d415bf20 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f69d40b66a0 con 0x7f69d40d2a60 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f69d4168f20 con 0x7f69d40cd5a0 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d415bf20 0x7f69d415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d415bf20 0x7f69d415b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55706/0 (socket says 172.21.15.17:55706) 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9a00640 1 -- 172.21.15.17:0/110310930 learned_addr learned my addr 172.21.15.17:0/110310930 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:55.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d3e00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d40d2a60 0x7f69d415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9000640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69d40cd5a0 0x7f69d41f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9a00640 1 -- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69d40cd5a0 msgr2=0x7f69d41f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9a00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69d40cd5a0 0x7f69d41f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9a00640 1 -- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d40d2a60 msgr2=0x7f69d415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9a00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d40d2a60 0x7f69d415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9a00640 1 -- 172.21.15.17:0/110310930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d41f6800 con 0x7f69d415bf20 2024-09-10T23:31:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d9a00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d415bf20 0x7f69d415b270 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009bd0 tx=0x7f69cc0a5970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d0c00640 1 -- 172.21.15.17:0/110310930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0bb070 con 0x7f69d415bf20 2024-09-10T23:31:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d0c00640 1 -- 172.21.15.17:0/110310930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69cc004d40 con 0x7f69d415bf20 2024-09-10T23:31:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69d0c00640 1 -- 172.21.15.17:0/110310930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0b2040 con 0x7f69d415bf20 2024-09-10T23:31:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d4153780 con 0x7f69d415bf20 2024-09-10T23:31:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.194+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d4153d40 con 0x7f69d415bf20 2024-09-10T23:31:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.198+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d40b5350 con 0x7f69d415bf20 2024-09-10T23:31:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.198+0000 7f69d0c00640 1 -- 172.21.15.17:0/110310930 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f69cc0b5030 con 0x7f69d415bf20 2024-09-10T23:31:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.198+0000 7f69d0c00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69b40725e0 0x7f69b4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.198+0000 7f69d0c00640 1 -- 172.21.15.17:0/110310930 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7f69cc12cfd0 con 0x7f69d415bf20 2024-09-10T23:31:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.198+0000 7f69d9000640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69b40725e0 0x7f69b4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.198+0000 7f69d9000640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69b40725e0 0x7f69b4074aa0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f69c8001650 tx=0x7f69c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:55.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.202+0000 7f69d0c00640 1 -- 172.21.15.17:0/110310930 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f69cc016990 con 0x7f69d415bf20 2024-09-10T23:31:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.414+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69d40b6a70 con 0x7f69d415bf20 2024-09-10T23:31:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.414+0000 7f69d0c00640 1 -- 172.21.15.17:0/110310930 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5237 (secure 0 0 0) 0x7f69cc0f7e30 con 0x7f69d415bf20 2024-09-10T23:31:55.417 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:55.417 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":169,"btime":"2024-09-10T23:31:53:033605+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:31:52.432930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11823":{"gid":11823,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1849575634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1849575634},{"type":"v1","addr":"172.21.15.17:6835","nonce":1849575634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11823,"qdb_cluster":[11823]},"id":16}]} 2024-09-10T23:31:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 169 2024-09-10T23:31:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.414+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69b40725e0 msgr2=0x7f69b4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.414+0000 7f69dba00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69b40725e0 0x7f69b4074aa0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f69c8001650 tx=0x7f69c8009040 comp rx=0 tx=0).stop 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.414+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d415bf20 msgr2=0x7f69d415b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.414+0000 7f69dba00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d415bf20 0x7f69d415b270 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009bd0 tx=0x7f69cc0a5970 comp rx=0 tx=0).stop 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.418+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 shutdown_connections 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.418+0000 7f69dba00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f69b40725e0 0x7f69b4074aa0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.418+0000 7f69dba00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d415bf20 0x7f69d415b270 unknown :-1 s=CLOSED pgs=2566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.418+0000 7f69dba00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69d40d2a60 0x7f69d415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.418+0000 7f69dba00640 1 --2- 172.21.15.17:0/110310930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f69d40cd5a0 0x7f69d41f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.418+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 >> 172.21.15.17:0/110310930 conn(0x7f69d40d1e40 msgr2=0x7f69d4155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.418+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 shutdown_connections 2024-09-10T23:31:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.418+0000 7f69dba00640 1 -- 172.21.15.17:0/110310930 wait complete. 2024-09-10T23:31:55.841 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 169, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:31:49.429993+0000', 'modified': '2024-09-10T23:31:52.432930+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11823}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11823': {'gid': 11823, 'name': 'c', 'rank': 0, 'incarnation': 166, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6835/1849575634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 1849575634}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 1849575634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11823, 'qdb_cluster': [11823]} 2024-09-10T23:31:55.842 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:31:55.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:31:55.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.994+0000 7fb9a1200640 1 -- 172.21.15.17:0/2980956637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb980003a10 msgr2=0x7fb980003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.994+0000 7fb9a1200640 1 --2- 172.21.15.17:0/2980956637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb980003a10 0x7fb980003e30 secure :-1 s=READY pgs=2568 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009b60 tx=0x7fb98c01d270 comp rx=0 tx=0).stop 2024-09-10T23:31:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.994+0000 7fb99a800640 1 -- 172.21.15.17:0/2980956637 reap_dead start 2024-09-10T23:31:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.994+0000 7fb9a1200640 1 -- 172.21.15.17:0/2980956637 shutdown_connections 2024-09-10T23:31:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.994+0000 7fb9a1200640 1 -- 172.21.15.17:0/2980956637 >> 172.21.15.17:0/2980956637 conn(0x7fb99c0b1850 msgr2=0x7fb99c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.994+0000 7fb9a1200640 1 -- 172.21.15.17:0/2980956637 shutdown_connections 2024-09-10T23:31:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.994+0000 7fb9a1200640 1 -- 172.21.15.17:0/2980956637 wait complete. 2024-09-10T23:31:55.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.994+0000 7fb9a1200640 1 Processor -- start 2024-09-10T23:31:55.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.994+0000 7fb9a1200640 1 -- start start 2024-09-10T23:31:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb9a1200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb980003a10 0x7fb99c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb9a1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c14f6a0 0x7fb99c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb9a1200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb99c0b4a80 0x7fb99c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb9a1200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1658e0 con 0x7fb99c14f6a0 2024-09-10T23:31:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb9a1200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c165760 con 0x7fb980003a10 2024-09-10T23:31:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb9a1200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb99c165a60 con 0x7fb99c0b4a80 2024-09-10T23:31:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c14f6a0 0x7fb99c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c14f6a0 0x7fb99c0b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55726/0 (socket says 172.21.15.17:55726) 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999400640 1 -- 172.21.15.17:0/307857080 learned_addr learned my addr 172.21.15.17:0/307857080 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999e00640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb980003a10 0x7fb99c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb99a800640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb99c0b4a80 0x7fb99c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999400640 1 -- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb99c0b4a80 msgr2=0x7fb99c0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999400640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb99c0b4a80 0x7fb99c0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999400640 1 -- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb980003a10 msgr2=0x7fb99c0aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999400640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb980003a10 0x7fb99c0aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999400640 1 -- 172.21.15.17:0/307857080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c152c90 con 0x7fb99c14f6a0 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999e00640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb980003a10 0x7fb99c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb999400640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c14f6a0 0x7fb99c0b3dc0 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e650 tx=0x7fb98800eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb992000640 1 -- 172.21.15.17:0/307857080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988015020 con 0x7fb99c14f6a0 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb992000640 1 -- 172.21.15.17:0/307857080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb98800ee20 con 0x7fb99c14f6a0 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb992000640 1 -- 172.21.15.17:0/307857080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98800ca20 con 0x7fb99c14f6a0 2024-09-10T23:31:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb9a1200640 1 -- 172.21.15.17:0/307857080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c1f7980 con 0x7fb99c14f6a0 2024-09-10T23:31:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:55.998+0000 7fb9a1200640 1 -- 172.21.15.17:0/307857080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c1f7f40 con 0x7fb99c14f6a0 2024-09-10T23:31:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb992000640 1 -- 172.21.15.17:0/307857080 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb98800cbc0 con 0x7fb99c14f6a0 2024-09-10T23:31:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb992000640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb97c072610 0x7fb97c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb9a451b000 1 Processor -- start 2024-09-10T23:31:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb992000640 1 -- 172.21.15.17:0/307857080 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7fb988093c60 con 0x7fb99c14f6a0 2024-09-10T23:31:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb9a451b000 1 -- start start 2024-09-10T23:31:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb97c072610 0x7fb97c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb97c072610 0x7fb97c074ad0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0ae000 tx=0x7fb98c01a010 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4cfd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 0x55dfc4cfe1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb9a451b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dfc4c1e3f0 con 0x55dfc4d499d0 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb9a451b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dfc4b5bb20 con 0x55dfc4cfde10 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb9a451b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dfc4b4af50 con 0x55dfc4d4a2f0 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55742/0 (socket says 172.21.15.17:55742) 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 -- 172.21.15.17:0/3997908583 learned_addr learned my addr 172.21.15.17:0/3997908583 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb99a800640 1 --2- 172.21.15.17:0/3997908583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 0x55dfc4cfe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999400640 1 --2- 172.21.15.17:0/3997908583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4cfd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 -- 172.21.15.17:0/3997908583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 msgr2=0x55dfc4cfd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 --2- 172.21.15.17:0/3997908583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4cfd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 -- 172.21.15.17:0/3997908583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 msgr2=0x55dfc4cfe1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 --2- 172.21.15.17:0/3997908583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 0x55dfc4cfe1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 -- 172.21.15.17:0/3997908583 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc4b12590 con 0x55dfc4d499d0 2024-09-10T23:31:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb999e00640 1 --2- 172.21.15.17:0/3997908583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49db0 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7fb98c000c10 tx=0x7fb98c0b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79afe4b42ee23ebe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb986a00640 1 -- 172.21.15.17:0/3997908583 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0b1040 con 0x55dfc4d499d0 2024-09-10T23:31:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb986a00640 1 -- 172.21.15.17:0/3997908583 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb98c0bc030 con 0x55dfc4d499d0 2024-09-10T23:31:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.002+0000 7fb986a00640 1 -- 172.21.15.17:0/3997908583 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c004e80 con 0x55dfc4d499d0 2024-09-10T23:31:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- 172.21.15.17:0/3997908583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 msgr2=0x55dfc4d49db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3997908583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49db0 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7fb98c000c10 tx=0x7fb98c0b6000 comp rx=0 tx=0).stop 2024-09-10T23:31:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- 172.21.15.17:0/3997908583 shutdown_connections 2024-09-10T23:31:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3997908583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 0x55dfc4cfe1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3997908583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4cfd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3997908583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49db0 unknown :-1 s=CLOSED pgs=2570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- 172.21.15.17:0/3997908583 >> 172.21.15.17:0/3997908583 conn(0x55dfc4be7130 msgr2=0x55dfc4d2ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- 172.21.15.17:0/3997908583 shutdown_connections 2024-09-10T23:31:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- 172.21.15.17:0/3997908583 wait complete. 2024-09-10T23:31:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- start start 2024-09-10T23:31:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 Processor -- start 2024-09-10T23:31:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4cfde10 0x55dfc4d2a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d2ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4d4a2f0 0x55dfc4d2b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dfc4ae55d0 con 0x55dfc4d499d0 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dfc4b4ed60 con 0x55dfc4d4a2f0 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dfc4af1500 con 0x55dfc4cfde10 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 10 client.0 _ll_register_callbacks cb 0x55dfc4af5810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d2ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d2ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55752/0 (socket says 172.21.15.17:55752) 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999400640 1 -- 172.21.15.17:0/1877584868 learned_addr learned my addr 172.21.15.17:0/1877584868 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999e00640 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4cfde10 0x55dfc4d2a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb99a800640 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4d4a2f0 0x55dfc4d2b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999400640 1 -- 172.21.15.17:0/1877584868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4cfde10 msgr2=0x55dfc4d2a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999400640 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4cfde10 0x55dfc4d2a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999400640 1 -- 172.21.15.17:0/1877584868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4d4a2f0 msgr2=0x55dfc4d2b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999400640 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4d4a2f0 0x55dfc4d2b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999400640 1 -- 172.21.15.17:0/1877584868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc4ae9170 con 0x55dfc4d499d0 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb999400640 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d2ae70 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c630 tx=0x7fb98805a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca60141d2a140775 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb97b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb97b400640 1 -- 172.21.15.17:0/1877584868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98805f090 con 0x55dfc4d499d0 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb9a451b000 1 -- 172.21.15.17:0/1877584868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dfc4ae30f0 con 0x55dfc4d499d0 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb97b400640 1 -- 172.21.15.17:0/1877584868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7fb98805dbf0 con 0x55dfc4d499d0 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.006+0000 7fb97b400640 1 -- 172.21.15.17:0/1877584868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7fb98807d050 con 0x55dfc4d499d0 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 10 client.11955 fetch_fsmap learned FSMap version 169 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 -- 172.21.15.17:0/1877584868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x55dfc4bcfef0 con 0x55dfc4d499d0 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb97b400640 1 -- 172.21.15.17:0/1877584868 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55dfc4ae30f0 con 0x55dfc4d499d0 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb97b400640 1 -- 172.21.15.17:0/1877584868 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7fb98805a2e0 con 0x55dfc4d499d0 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 10 client.11955 fetch_fsmap finished waiting for FSMap version 169 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 10 client.11955 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 20 client.11955 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] conn(0x55dfc4d2c0f0 0x55dfc4d5bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 4 client.11955 mds_command: new command op to 11823 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:31:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 -- 172.21.15.17:0/1877584868 --> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfc4b5da70 con 0x55dfc4d2c0f0 2024-09-10T23:31:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb999e00640 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] conn(0x55dfc4d2c0f0 0x55dfc4d5bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb999e00640 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] conn(0x55dfc4d2c0f0 0x55dfc4d5bc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d51d8335b4affab4 server_cookie=87a3e89495678f1a in_seq=0 out_seq=0 2024-09-10T23:31:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb97b400640 10 client.11955 ms_handle_connect on v2:172.21.15.17:6833/1849575634 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb97b400640 1 -- 172.21.15.17:0/1877584868 <== mds.0 v2:172.21.15.17:6833/1849575634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dfc4b5da70 con 0x55dfc4d2c0f0 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb97b400640 10 client.11955 handle_command_reply: tid=0 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 client.11955 shutdown 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 -- 172.21.15.17:0/1877584868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 msgr2=0x55dfc4d2ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d2ae70 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c630 tx=0x7fb98805a8f0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 -- 172.21.15.17:0/1877584868 shutdown_connections 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] conn(0x55dfc4d2c0f0 0x55dfc4d5bc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4d4a2f0 0x55dfc4d2b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb97b400640 0 client.11955 ms_handle_reset on v2:172.21.15.17:6833/1849575634 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d2ae70 unknown :-1 s=CLOSED pgs=2571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 --2- 172.21.15.17:0/1877584868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4cfde10 0x55dfc4d2a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 -- 172.21.15.17:0/1877584868 >> 172.21.15.17:0/1877584868 conn(0x55dfc4be7130 msgr2=0x55dfc4cfcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:56.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 -- 172.21.15.17:0/1877584868 shutdown_connections 2024-09-10T23:31:56.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 1 -- 172.21.15.17:0/1877584868 wait complete. 2024-09-10T23:31:56.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.010+0000 7fb9a451b000 20 client.11955 trim_cache size 0 max 16384 2024-09-10T23:31:56.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb9a451b000 1 Processor -- start 2024-09-10T23:31:56.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb9a451b000 1 -- start start 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 0x55dfc4d48cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4d5bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb9a451b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c204e60 con 0x55dfc4d499d0 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb9a451b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c203e80 con 0x55dfc4cfde10 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb9a451b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb99c2031e0 con 0x55dfc4d4a2f0 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55768/0 (socket says 172.21.15.17:55768) 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999400640 1 -- 172.21.15.17:0/3960865396 learned_addr learned my addr 172.21.15.17:0/3960865396 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999e00640 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 0x55dfc4d48cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999400640 1 -- 172.21.15.17:0/3960865396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 msgr2=0x55dfc4d5bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb99a800640 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4d5bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999400640 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4d5bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999400640 1 -- 172.21.15.17:0/3960865396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 msgr2=0x55dfc4d48cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999400640 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 0x55dfc4d48cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999400640 1 -- 172.21.15.17:0/3960865396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc4ba6d90 con 0x55dfc4d499d0 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999e00640 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 0x55dfc4d48cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb999400640 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49200 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7fb98805a9a0 tx=0x7fb988091e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950895fe79420f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb986000640 1 -- 172.21.15.17:0/3960865396 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98805f090 con 0x55dfc4d499d0 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb986000640 1 -- 172.21.15.17:0/3960865396 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb988067e90 con 0x55dfc4d499d0 2024-09-10T23:31:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.030+0000 7fb986000640 1 -- 172.21.15.17:0/3960865396 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98805e990 con 0x55dfc4d499d0 2024-09-10T23:31:56.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- 172.21.15.17:0/3960865396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 msgr2=0x55dfc4d49200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49200 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7fb98805a9a0 tx=0x7fb988091e30 comp rx=0 tx=0).stop 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- 172.21.15.17:0/3960865396 shutdown_connections 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4d5bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4d499d0 0x55dfc4d49200 unknown :-1 s=CLOSED pgs=2572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3960865396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4cfde10 0x55dfc4d48cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- 172.21.15.17:0/3960865396 >> 172.21.15.17:0/3960865396 conn(0x55dfc4be7130 msgr2=0x55dfc4d485b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- 172.21.15.17:0/3960865396 shutdown_connections 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- 172.21.15.17:0/3960865396 wait complete. 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- start start 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 Processor -- start 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4cfde10 0x55dfc4dc0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4dc0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4dc12e0 0x55dfc4d5dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55dfc4ae55d0 con 0x55dfc4cfde10 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dfc4d60ce0 con 0x55dfc4dc12e0 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55dfc4b53390 con 0x55dfc4d4a2f0 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 10 client.0 _ll_register_callbacks cb 0x7fb9880017b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4cfde10 0x55dfc4dc0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4cfde10 0x55dfc4dc0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55772/0 (socket says 172.21.15.17:55772) 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999e00640 1 -- 172.21.15.17:0/3063386754 learned_addr learned my addr 172.21.15.17:0/3063386754 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb99a800640 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4dc12e0 0x55dfc4d5dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999400640 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4dc0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999e00640 1 -- 172.21.15.17:0/3063386754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 msgr2=0x55dfc4dc0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999e00640 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4dc0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999e00640 1 -- 172.21.15.17:0/3063386754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4dc12e0 msgr2=0x55dfc4d5dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:31:56.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999e00640 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4dc12e0 0x55dfc4d5dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999e00640 1 -- 172.21.15.17:0/3063386754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc4b11a90 con 0x55dfc4cfde10 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999400640 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4dc0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb999e00640 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4cfde10 0x55dfc4dc0860 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7fb98c01cce0 tx=0x7fb98c009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56daa26ffc53a410 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb97b400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb97b400640 1 -- 172.21.15.17:0/3063386754 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0b1040 con 0x55dfc4cfde10 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb97b400640 1 -- 172.21.15.17:0/3063386754 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7fb98c004c20 con 0x55dfc4cfde10 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- 172.21.15.17:0/3063386754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb988067e90 con 0x55dfc4cfde10 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb97b400640 1 -- 172.21.15.17:0/3063386754 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7fb98c0e0050 con 0x55dfc4cfde10 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 10 client.11961 fetch_fsmap learned FSMap version 169 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.034+0000 7fb9a451b000 1 -- 172.21.15.17:0/3063386754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x55dfc4af0050 con 0x55dfc4cfde10 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb97b400640 1 -- 172.21.15.17:0/3063386754 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb988067e90 con 0x55dfc4cfde10 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb97b400640 1 -- 172.21.15.17:0/3063386754 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7fb98c0e3020 con 0x55dfc4cfde10 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 10 client.11961 fetch_fsmap finished waiting for FSMap version 169 2024-09-10T23:31:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 10 client.11961 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:31:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 20 client.11961 populate_metadata read hostname 'smithi017' 2024-09-10T23:31:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] conn(0x55dfc4d5e990 0x55dfc4d5ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 4 client.11961 mds_command: new command op to 11823 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:31:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 -- 172.21.15.17:0/3063386754 --> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] -- command(tid 0: {"prefix": "status"}) -- 0x55dfc4b59520 con 0x55dfc4d5e990 2024-09-10T23:31:56.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb999400640 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] conn(0x55dfc4d5e990 0x55dfc4d5ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb999400640 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] conn(0x55dfc4d5e990 0x55dfc4d5ed70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac968d87edf43f89 server_cookie=455bdac90d8366d8 in_seq=0 out_seq=0 2024-09-10T23:31:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb97b400640 10 client.11961 ms_handle_connect on v2:172.21.15.17:6833/1849575634 2024-09-10T23:31:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb97b400640 1 -- 172.21.15.17:0/3063386754 <== mds.0 v2:172.21.15.17:6833/1849575634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55dfc4b59520 con 0x55dfc4d5e990 2024-09-10T23:31:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb97b400640 10 client.11961 handle_command_reply: tid=0 2024-09-10T23:31:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 client.11961 shutdown 2024-09-10T23:31:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 -- 172.21.15.17:0/3063386754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4cfde10 msgr2=0x55dfc4dc0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4cfde10 0x55dfc4dc0860 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7fb98c01cce0 tx=0x7fb98c009910 comp rx=0 tx=0).stop 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 -- 172.21.15.17:0/3063386754 shutdown_connections 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.17:6833/1849575634,v1:172.21.15.17:6835/1849575634] conn(0x55dfc4d5e990 0x55dfc4d5ed70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfc4dc12e0 0x55dfc4d5dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55dfc4d4a2f0 0x55dfc4dc0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 --2- 172.21.15.17:0/3063386754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc4cfde10 0x55dfc4dc0860 unknown :-1 s=CLOSED pgs=2573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb97b400640 0 client.11961 ms_handle_reset on v2:172.21.15.17:6833/1849575634 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 -- 172.21.15.17:0/3063386754 >> 172.21.15.17:0/3063386754 conn(0x55dfc4be7130 msgr2=0x55dfc4d485b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 -- 172.21.15.17:0/3063386754 shutdown_connections 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 1 -- 172.21.15.17:0/3063386754 wait complete. 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a451b000 20 client.11961 trim_cache size 0 max 16384 2024-09-10T23:31:56.045 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 11823, 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.0297149389999998, 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 169, 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 223, 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 223, 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 10.486218166 2024-09-10T23:31:56.046 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 -- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb97c072610 msgr2=0x7fb97c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb97c072610 0x7fb97c074ad0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0ae000 tx=0x7fb98c01a010 comp rx=0 tx=0).stop 2024-09-10T23:31:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 -- 172.21.15.17:0/307857080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c14f6a0 msgr2=0x7fb99c0b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c14f6a0 0x7fb99c0b3dc0 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e650 tx=0x7fb98800eb10 comp rx=0 tx=0).stop 2024-09-10T23:31:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 -- 172.21.15.17:0/307857080 shutdown_connections 2024-09-10T23:31:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb97c072610 0x7fb97c074ad0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb99c0b4a80 0x7fb99c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb99c14f6a0 0x7fb99c0b3dc0 unknown :-1 s=CLOSED pgs=2569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 --2- 172.21.15.17:0/307857080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb980003a10 0x7fb99c0aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 -- 172.21.15.17:0/307857080 >> 172.21.15.17:0/307857080 conn(0x7fb99c0b1850 msgr2=0x7fb99c15c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 -- 172.21.15.17:0/307857080 shutdown_connections 2024-09-10T23:31:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.038+0000 7fb9a1200640 1 -- 172.21.15.17:0/307857080 wait complete. 2024-09-10T23:31:56.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T23:31:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 -- 172.21.15.17:0/595668989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9700745e0 msgr2=0x7ff97015e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 --2- 172.21.15.17:0/595668989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9700745e0 0x7ff97015e870 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 crypto rx=0x7ff95800aa10 tx=0x7ff95801da50 comp rx=0 tx=0).stop 2024-09-10T23:31:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 -- 172.21.15.17:0/595668989 shutdown_connections 2024-09-10T23:31:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 --2- 172.21.15.17:0/595668989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9700745e0 0x7ff97015e870 unknown :-1 s=CLOSED pgs=2574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 --2- 172.21.15.17:0/595668989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff97006fc50 0x7ff97015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 -- 172.21.15.17:0/595668989 >> 172.21.15.17:0/595668989 conn(0x7ff9700b1850 msgr2=0x7ff9700b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 -- 172.21.15.17:0/595668989 shutdown_connections 2024-09-10T23:31:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 -- 172.21.15.17:0/595668989 wait complete. 2024-09-10T23:31:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 Processor -- start 2024-09-10T23:31:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 -- start start 2024-09-10T23:31:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97006fc50 0x7ff9700b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff970070030 0x7ff9701f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9700745e0 0x7ff970150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff97006f060 con 0x7ff970070030 2024-09-10T23:31:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff97006eee0 con 0x7ff97006fc50 2024-09-10T23:31:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff975200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff97006f1e0 con 0x7ff9700745e0 2024-09-10T23:31:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff967e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff970070030 0x7ff9701f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff967e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff970070030 0x7ff9701f85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55794/0 (socket says 172.21.15.17:55794) 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff967e00640 1 -- 172.21.15.17:0/3863068567 learned_addr learned my addr 172.21.15.17:0/3863068567 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff96de00640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97006fc50 0x7ff9700b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.206+0000 7ff96e800640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9700745e0 0x7ff970150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff967e00640 1 -- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9700745e0 msgr2=0x7ff970150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff967e00640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9700745e0 0x7ff970150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff967e00640 1 -- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97006fc50 msgr2=0x7ff9700b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff967e00640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97006fc50 0x7ff9700b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff967e00640 1 -- 172.21.15.17:0/3863068567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9701f8af0 con 0x7ff970070030 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff967e00640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff970070030 0x7ff9701f85b0 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7ff95800a960 tx=0x7ff9580040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff966000640 1 -- 172.21.15.17:0/3863068567 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9580b3070 con 0x7ff970070030 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff966000640 1 -- 172.21.15.17:0/3863068567 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9580044e0 con 0x7ff970070030 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff966000640 1 -- 172.21.15.17:0/3863068567 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958005590 con 0x7ff970070030 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97014e200 con 0x7ff970070030 2024-09-10T23:31:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9700b48f0 con 0x7ff970070030 2024-09-10T23:31:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff970075ad0 con 0x7ff970070030 2024-09-10T23:31:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff966000640 1 -- 172.21.15.17:0/3863068567 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff95800b040 con 0x7ff970070030 2024-09-10T23:31:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.210+0000 7ff966000640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff94c072780 0x7ff94c074c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.214+0000 7ff966000640 1 -- 172.21.15.17:0/3863068567 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7ff95812ce90 con 0x7ff970070030 2024-09-10T23:31:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.214+0000 7ff96de00640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff94c072780 0x7ff94c074c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.214+0000 7ff96de00640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff94c072780 0x7ff94c074c40 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff9600058d0 tx=0x7ff960005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:56.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.218+0000 7ff966000640 1 -- 172.21.15.17:0/3863068567 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff9580be030 con 0x7ff970070030 2024-09-10T23:31:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.426+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff9700b55a0 con 0x7ff970070030 2024-09-10T23:31:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.426+0000 7ff966000640 1 -- 172.21.15.17:0/3863068567 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v169) ==== 53+0+73 (secure 0 0 0) 0x7ff95812e070 con 0x7ff970070030 2024-09-10T23:31:56.430 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff94c072780 msgr2=0x7ff94c074c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff94c072780 0x7ff94c074c40 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff9600058d0 tx=0x7ff960005f90 comp rx=0 tx=0).stop 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff970070030 msgr2=0x7ff9701f85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff970070030 0x7ff9701f85b0 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7ff95800a960 tx=0x7ff9580040e0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 shutdown_connections 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff94c072780 0x7ff94c074c40 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9700745e0 0x7ff970150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff970070030 0x7ff9701f85b0 unknown :-1 s=CLOSED pgs=2575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 --2- 172.21.15.17:0/3863068567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97006fc50 0x7ff9700b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 >> 172.21.15.17:0/3863068567 conn(0x7ff9700b1850 msgr2=0x7ff97015b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 shutdown_connections 2024-09-10T23:31:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56.430+0000 7ff975200640 1 -- 172.21.15.17:0/3863068567 wait complete. 2024-09-10T23:31:56.451 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T23:31:56.451 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T23:31:56.451 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-09-10T23:31:56.451 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T23:31:56.451 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:56.451 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T23:31:56.451 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T23:31:56.452 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T23:31:56.452 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:31:56.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:56.452 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-09-10T23:31:56.461 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-10T23:31:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41455sec preferred_lft 41455sec 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 02:42:95:03:f9:7c brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-10T23:31:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-09-10T23:31:56.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:56.465 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T23:31:56.524 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-09-10T23:31:56.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:56.527 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-09-10T23:31:56.583 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-09-10T23:31:56.583 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T23:31:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-10T23:31:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-10T23:31:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-10T23:31:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T23:31:56.584 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T23:31:56.584 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-09-10T23:31:56.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T23:31:56.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T23:31:56.585 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T23:31:56.585 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-09-10T23:31:56.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T23:31:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:31:56.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:56.722 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:31:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:31:56.731 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:31:56.732 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:31:56.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:56.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-09-10T23:31:56.794 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T23:31:56.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:31:56.794 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:56.843 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T23:31:56.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T23:31:56.843 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:56.894 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:31:56.955 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:31:57.008 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:31:57.008 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:31:57.009 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:31:57.010 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:57.011 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:57.011 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:57.011 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:57.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:57.012 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:31:57.063 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T23:31:57.063 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T23:31:57.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-09-10T23:31:57.134 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T23:31:57.188 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-09-10T23:31:57.188 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-09-10T23:31:57.188 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/run/lock 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-09-10T23:31:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/fs/nfsd 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/run/rpc_pipefs 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T23:31:57.190 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-09-10T23:31:57.191 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:57.191 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:31:57.191 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:57.191 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:31:57.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:57.192 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-09-10T23:31:57.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-09-10T23:31:57.206+0000 7f8ebae49580 -1 init, newargv = 0x55db2b57b220 newargc=15 2024-09-10T23:31:57.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[91237]: starting ceph client 2024-09-10T23:31:57.217 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[91237]: starting fuse 2024-09-10T23:31:57.219 INFO:teuthology.orchestra.run.smithi017.stdout:44 2024-09-10T23:31:57.220 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-09-10T23:31:57.220 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T23:31:57.221 DEBUG:teuthology.orchestra.run.smithi017:> 2024-09-10T23:31:57.222 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-09-10T23:31:57.222 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-09-10T23:31:57.345 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.91237.asok 2024-09-10T23:31:57.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T23:31:57.357 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.91237.asok 2024-09-10T23:31:57.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:57.357 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.91237.asok status 2024-09-10T23:31:57.535 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:31:57.535 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-09-10T23:31:57.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T23:31:57.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T23:31:57.535 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "91237", 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 11973, 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-09-10T23:31:57.536 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 11973 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 728895304 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 728895304 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.11973 192.168.0.1:0/728895304", 2024-09-10T23:31:57.537 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/728895304", 2024-09-10T23:31:57.538 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-09-10T23:31:57.538 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 169, 2024-09-10T23:31:57.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 223, 2024-09-10T23:31:57.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-09-10T23:31:57.538 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-09-10T23:31:57.538 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-09-10T23:31:57.538 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:31:57.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:57.550 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-09-10T23:31:57.550 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:57.560 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-09-10T23:31:57.560 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:57.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:57.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:57.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:57.623 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2024-09-10T23:31:57.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:57.681 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2024-09-10T23:31:57.735 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:57.735 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:57.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:57.787 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/parentfile bs=1M conv=fdatasync count=6 seek=0) 2024-09-10T23:31:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:6+0 records in 2024-09-10T23:31:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:6+0 records out 2024-09-10T23:31:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.071697 s, 87.8 MB/s 2024-09-10T23:31:57.913 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:57.913 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:57.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:57.922 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/child/childfile bs=1M conv=fdatasync count=6 seek=0) 2024-09-10T23:31:58.045 INFO:teuthology.orchestra.run.smithi017.stderr:6+0 records in 2024-09-10T23:31:58.045 INFO:teuthology.orchestra.run.smithi017.stderr:6+0 records out 2024-09-10T23:31:58.045 INFO:teuthology.orchestra.run.smithi017.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0679545 s, 92.6 MB/s 2024-09-10T23:31:58.047 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:31:58.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:31:58.092 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-10T23:31:58.092 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-10T23:31:58.092 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:31:58.092 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-10T23:31:58.092 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.092 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-10T23:31:58.092 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.092 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-10T23:31:58.092 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-10T23:31:58.093 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.094 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-10T23:31:58.095 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.096 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 20 2024-09-10T23:31:58.097 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 20 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 10 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:31:58.098 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 30 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:31:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:31:58.100 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout: mon down mkfs grace = 300 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = "" 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-09-10T23:31:58.101 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-09-10T23:31:58.102 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-09-10T23:31:58.102 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-09-10T23:31:58.102 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-09-10T23:31:58.102 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2024-09-10T23:31:58.102 INFO:teuthology.orchestra.run.smithi017.stdout: mds cache max size = 1000 2024-09-10T23:31:58.102 INFO:teuthology.orchestra.run.smithi017.stdout: mds log max segments = 1 2024-09-10T23:31:58.102 INFO:teuthology.orchestra.run.smithi017.stdout: mds verify scatter = False 2024-09-10T23:31:58.102 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug scatterstat = False 2024-09-10T23:31:58.102 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-10T23:31:58.103 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:31:58.104 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-10T23:31:58.105 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-10T23:31:58.106 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-10T23:31:58.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:31:58.108 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 30 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-10T23:31:58.109 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:31:58.110 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-10T23:31:58.111 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-09-10T23:31:58.112 INFO:teuthology.orchestra.run.smithi077.stdout: mds cache max size = 1000 2024-09-10T23:31:58.113 INFO:teuthology.orchestra.run.smithi077.stdout: mds log max segments = 1 2024-09-10T23:31:58.113 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = False 2024-09-10T23:31:58.113 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = False 2024-09-10T23:31:58.115 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:31:58.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T23:31:58.201 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-10T23:31:58.201 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-10T23:31:58.201 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.202 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:31:58.203 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-10T23:31:58.204 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.205 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.206 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 20 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 20 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 10 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:31:58.207 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 30 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.208 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:31:58.209 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: mon down mkfs grace = 300 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-10T23:31:58.210 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = "" 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout: mds cache max size = 1000 2024-09-10T23:31:58.211 INFO:teuthology.orchestra.run.smithi017.stdout: mds log max segments = 1 2024-09-10T23:31:58.212 INFO:teuthology.orchestra.run.smithi017.stdout: mds verify scatter = False 2024-09-10T23:31:58.212 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug scatterstat = False 2024-09-10T23:31:58.212 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-10T23:31:58.212 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-10T23:31:58.212 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T23:31:58.212 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-10T23:31:58.212 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.213 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T23:31:58.214 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.17,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442 2024-09-10T23:31:58.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-10T23:31:58.216 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.217 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-10T23:31:58.218 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 30 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-10T23:31:58.219 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T23:31:58.220 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-10T23:31:58.221 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-10T23:31:58.222 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-10T23:31:58.223 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-10T23:31:58.223 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-09-10T23:31:58.223 INFO:teuthology.orchestra.run.smithi077.stdout: mds cache max size = 1000 2024-09-10T23:31:58.223 INFO:teuthology.orchestra.run.smithi077.stdout: mds log max segments = 1 2024-09-10T23:31:58.223 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = False 2024-09-10T23:31:58.223 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = False 2024-09-10T23:31:58.224 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:58.225 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:58.275 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:31:58.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.462+0000 7f231d600640 1 -- 172.21.15.17:0/1588715971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231806f930 msgr2=0x7f2318072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.462+0000 7f231d600640 1 --2- 172.21.15.17:0/1588715971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231806f930 0x7f2318072800 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 crypto rx=0x7f2308009900 tx=0x7f230801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.462+0000 7f231d600640 1 -- 172.21.15.17:0/1588715971 shutdown_connections 2024-09-10T23:31:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.462+0000 7f231d600640 1 --2- 172.21.15.17:0/1588715971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f231806f930 0x7f2318072800 unknown :-1 s=CLOSED pgs=2580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.462+0000 7f231d600640 1 -- 172.21.15.17:0/1588715971 >> 172.21.15.17:0/1588715971 conn(0x7f23180b1850 msgr2=0x7f23180b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.462+0000 7f231d600640 1 -- 172.21.15.17:0/1588715971 shutdown_connections 2024-09-10T23:31:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.462+0000 7f231d600640 1 -- 172.21.15.17:0/1588715971 wait complete. 2024-09-10T23:31:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.462+0000 7f231d600640 1 Processor -- start 2024-09-10T23:31:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.462+0000 7f231d600640 1 -- start start 2024-09-10T23:31:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f231d600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231806f930 0x7f23181363f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f231d600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231806fd10 0x7f231806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f231d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180cf180 0x7f231806eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f231d600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f2318169110 con 0x7f23180cf180 2024-09-10T23:31:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f231d600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2318168f90 con 0x7f231806fd10 2024-09-10T23:31:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f231d600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f2318169290 con 0x7f231806f930 2024-09-10T23:31:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2317400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180cf180 0x7f231806eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2317400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180cf180 0x7f231806eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46386/0 (socket says 172.21.15.17:46386) 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2317400640 1 -- 172.21.15.17:0/4103311664 learned_addr learned my addr 172.21.15.17:0/4103311664 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2316a00640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231806f930 0x7f23181363f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f230fe00640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231806fd10 0x7f231806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2317400640 1 -- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231806f930 msgr2=0x7f23181363f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2317400640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231806f930 0x7f23181363f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2317400640 1 -- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231806fd10 msgr2=0x7f231806eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2317400640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231806fd10 0x7f231806eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2317400640 1 -- 172.21.15.17:0/4103311664 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2318139a00 con 0x7f23180cf180 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f2317400640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180cf180 0x7f231806eff0 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f231000c730 tx=0x7f231000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f230ea00640 1 -- 172.21.15.17:0/4103311664 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310003b80 con 0x7f23180cf180 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f230ea00640 1 -- 172.21.15.17:0/4103311664 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2310003d40 con 0x7f23180cf180 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f230ea00640 1 -- 172.21.15.17:0/4103311664 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23100052d0 con 0x7f23180cf180 2024-09-10T23:31:58.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23181f7ba0 con 0x7f23180cf180 2024-09-10T23:31:58.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2318136930 con 0x7f23180cf180 2024-09-10T23:31:58.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.466+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2318075ad0 con 0x7f23180cf180 2024-09-10T23:31:58.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.470+0000 7f230ea00640 1 -- 172.21.15.17:0/4103311664 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f2310005680 con 0x7f23180cf180 2024-09-10T23:31:58.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.470+0000 7f230ea00640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f40725e0 0x7f22f4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.470+0000 7f230ea00640 1 -- 172.21.15.17:0/4103311664 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7f23100932a0 con 0x7f23180cf180 2024-09-10T23:31:58.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.470+0000 7f2316a00640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f40725e0 0x7f22f4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.470+0000 7f2316a00640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f40725e0 0x7f22f4074aa0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f23080af000 tx=0x7f230801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:58.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.474+0000 7f230ea00640 1 -- 172.21.15.17:0/4103311664 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f231005e190 con 0x7f23180cf180 2024-09-10T23:31:58.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.658+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2318072800 con 0x7f23180cf180 2024-09-10T23:31:58.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.658+0000 7f230ea00640 1 -- 172.21.15.17:0/4103311664 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v223) ==== 80+0+0 (secure 0 0 0) 0x7f2310062bc0 con 0x7f23180cf180 2024-09-10T23:31:58.662 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f40725e0 msgr2=0x7f22f4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f40725e0 0x7f22f4074aa0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f23080af000 tx=0x7f230801b120 comp rx=0 tx=0).stop 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180cf180 msgr2=0x7f231806eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180cf180 0x7f231806eff0 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7f231000c730 tx=0x7f231000cbf0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 shutdown_connections 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f22f40725e0 0x7f22f4074aa0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180cf180 0x7f231806eff0 unknown :-1 s=CLOSED pgs=2581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f231806fd10 0x7f231806eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 --2- 172.21.15.17:0/4103311664 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f231806f930 0x7f23181363f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 >> 172.21.15.17:0/4103311664 conn(0x7f23180b1850 msgr2=0x7f231814a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 shutdown_connections 2024-09-10T23:31:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.662+0000 7f231d600640 1 -- 172.21.15.17:0/4103311664 wait complete. 2024-09-10T23:31:58.683 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:31:58.683 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:31:58.692 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T23:31:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.878+0000 7f48c8400640 1 -- 172.21.15.17:0/428450985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b2fc0 msgr2=0x7f48c00d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.878+0000 7f48c8400640 1 --2- 172.21.15.17:0/428450985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b2fc0 0x7f48c00d0490 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009900 tx=0x7f48ac01c8b0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.878+0000 7f48c8400640 1 -- 172.21.15.17:0/428450985 shutdown_connections 2024-09-10T23:31:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.878+0000 7f48c8400640 1 --2- 172.21.15.17:0/428450985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b2fc0 0x7f48c00d0490 unknown :-1 s=CLOSED pgs=2582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.878+0000 7f48c8400640 1 --2- 172.21.15.17:0/428450985 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48c00cfb70 0x7f48c00cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.878+0000 7f48c8400640 1 -- 172.21.15.17:0/428450985 >> 172.21.15.17:0/428450985 conn(0x7f48c00d1d40 msgr2=0x7f48c00d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.878+0000 7f48c8400640 1 -- 172.21.15.17:0/428450985 shutdown_connections 2024-09-10T23:31:58.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.878+0000 7f48c8400640 1 -- 172.21.15.17:0/428450985 wait complete. 2024-09-10T23:31:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 Processor -- start 2024-09-10T23:31:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 -- start start 2024-09-10T23:31:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b15a0 0x7f48c00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c00b2fc0 0x7f48c0151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48c00cfb70 0x7f48c00c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f48c0168f60 con 0x7f48c00b15a0 2024-09-10T23:31:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48c00b09d0 con 0x7f48c00b2fc0 2024-09-10T23:31:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f48c01690e0 con 0x7f48c00cfb70 2024-09-10T23:31:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b15a0 0x7f48c00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b15a0 0x7f48c00c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46402/0 (socket says 172.21.15.17:46402) 2024-09-10T23:31:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5a00640 1 -- 172.21.15.17:0/593708567 learned_addr learned my addr 172.21.15.17:0/593708567 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5000640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c00b2fc0 0x7f48c0151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c6400640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48c00cfb70 0x7f48c00c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5a00640 1 -- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48c00cfb70 msgr2=0x7f48c00c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5a00640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48c00cfb70 0x7f48c00c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5a00640 1 -- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c00b2fc0 msgr2=0x7f48c0151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5a00640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c00b2fc0 0x7f48c0151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5a00640 1 -- 172.21.15.17:0/593708567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c01f5810 con 0x7f48c00b15a0 2024-09-10T23:31:58.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c5a00640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b15a0 0x7f48c00c8e10 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7f48b400d750 tx=0x7f48b400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48bd600640 1 -- 172.21.15.17:0/593708567 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b4017070 con 0x7f48c00b15a0 2024-09-10T23:31:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48bd600640 1 -- 172.21.15.17:0/593708567 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48b4009d20 con 0x7f48c00b15a0 2024-09-10T23:31:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48bd600640 1 -- 172.21.15.17:0/593708567 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b4005280 con 0x7f48c00b15a0 2024-09-10T23:31:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c01f5af0 con 0x7f48c00b15a0 2024-09-10T23:31:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c01f60b0 con 0x7f48c00b15a0 2024-09-10T23:31:58.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.882+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c01f6490 con 0x7f48c00b15a0 2024-09-10T23:31:58.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.886+0000 7f48bd600640 1 -- 172.21.15.17:0/593708567 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f48b4005420 con 0x7f48c00b15a0 2024-09-10T23:31:58.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.886+0000 7f48bd600640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48a00725e0 0x7f48a0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.886+0000 7f48bd600640 1 -- 172.21.15.17:0/593708567 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7f48b4093590 con 0x7f48c00b15a0 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.886+0000 7f48c5000640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48a00725e0 0x7f48a0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.886+0000 7f48c5000640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48a00725e0 0x7f48a0074aa0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0af000 tx=0x7f48ac01b0f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:58.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:58.890+0000 7f48bd600640 1 -- 172.21.15.17:0/593708567 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f48c01f6490 con 0x7f48c00b15a0 2024-09-10T23:31:59.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f48c00b1a00 con 0x7f48c00b15a0 2024-09-10T23:31:59.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48bd600640 1 -- 172.21.15.17:0/593708567 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v223) ==== 80+0+0 (secure 0 0 0) 0x7f48b400de60 con 0x7f48c00b15a0 2024-09-10T23:31:59.077 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-09-10T23:31:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48a00725e0 msgr2=0x7f48a0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48a00725e0 0x7f48a0074aa0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0af000 tx=0x7f48ac01b0f0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b15a0 msgr2=0x7f48c00c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b15a0 0x7f48c00c8e10 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7f48b400d750 tx=0x7f48b400dc10 comp rx=0 tx=0).stop 2024-09-10T23:31:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 shutdown_connections 2024-09-10T23:31:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f48a00725e0 0x7f48a0074aa0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f48c00cfb70 0x7f48c00c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c00b2fc0 0x7f48c0151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 --2- 172.21.15.17:0/593708567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48c00b15a0 0x7f48c00c8e10 unknown :-1 s=CLOSED pgs=2583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 >> 172.21.15.17:0/593708567 conn(0x7f48c00d1d40 msgr2=0x7f48c01553c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.074+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 shutdown_connections 2024-09-10T23:31:59.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.078+0000 7f48c8400640 1 -- 172.21.15.17:0/593708567 wait complete. 2024-09-10T23:31:59.099 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-09-10T23:31:59.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:59.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T23:31:59.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[91237]: fuse finished with error 0 and tester_r 0 2024-09-10T23:31:59.124 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:31:59.193 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:31:59.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:31:59.193 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T23:31:59.203 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:31:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.390+0000 7f5f68800640 1 -- 172.21.15.17:0/2803205556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f48003a10 msgr2=0x7f5f48003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.390+0000 7f5f68800640 1 --2- 172.21.15.17:0/2803205556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f48003a10 0x7f5f48003e30 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009b60 tx=0x7f5f5401d270 comp rx=0 tx=0).stop 2024-09-10T23:31:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.390+0000 7f5f66800640 1 -- 172.21.15.17:0/2803205556 reap_dead start 2024-09-10T23:31:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.390+0000 7f5f68800640 1 -- 172.21.15.17:0/2803205556 shutdown_connections 2024-09-10T23:31:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.390+0000 7f5f68800640 1 -- 172.21.15.17:0/2803205556 >> 172.21.15.17:0/2803205556 conn(0x7f5f600d1db0 msgr2=0x7f5f600d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.390+0000 7f5f68800640 1 -- 172.21.15.17:0/2803205556 shutdown_connections 2024-09-10T23:31:59.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.390+0000 7f5f68800640 1 -- 172.21.15.17:0/2803205556 wait complete. 2024-09-10T23:31:59.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.390+0000 7f5f68800640 1 Processor -- start 2024-09-10T23:31:59.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.390+0000 7f5f68800640 1 -- start start 2024-09-10T23:31:59.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f68800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f48003a10 0x7f5f6015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f68800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f60166800 0x7f5f601630d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f68800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f60163610 0x7f5f6015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f68800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601670f0 con 0x7f5f48003a10 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f68800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60160b50 con 0x7f5f60163610 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f68800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5f60167270 con 0x7f5f60166800 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f48003a10 0x7f5f6015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f48003a10 0x7f5f6015a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46424/0 (socket says 172.21.15.17:46424) 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65e00640 1 -- 172.21.15.17:0/4265347977 learned_addr learned my addr 172.21.15.17:0/4265347977 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65400640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f60166800 0x7f5f601630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f66800640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f60163610 0x7f5f6015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65e00640 1 -- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f60166800 msgr2=0x7f5f601630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65e00640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f60166800 0x7f5f601630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65e00640 1 -- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f60163610 msgr2=0x7f5f6015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65e00640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f60163610 0x7f5f6015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65e00640 1 -- 172.21.15.17:0/4265347977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f60165b00 con 0x7f5f48003a10 2024-09-10T23:31:59.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f65e00640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f48003a10 0x7f5f6015a4e0 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7f5f5401d0a0 tx=0x7f5f54005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f5a000640 1 -- 172.21.15.17:0/4265347977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f540ba020 con 0x7f5f48003a10 2024-09-10T23:31:59.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f5a000640 1 -- 172.21.15.17:0/4265347977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f540049c0 con 0x7f5f48003a10 2024-09-10T23:31:59.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6015abb0 con 0x7f5f48003a10 2024-09-10T23:31:59.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f5a000640 1 -- 172.21.15.17:0/4265347977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f540b1040 con 0x7f5f48003a10 2024-09-10T23:31:59.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6015bf20 con 0x7f5f48003a10 2024-09-10T23:31:59.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.394+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6015fe30 con 0x7f5f48003a10 2024-09-10T23:31:59.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.398+0000 7f5f5a000640 1 -- 172.21.15.17:0/4265347977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5f540c8430 con 0x7f5f48003a10 2024-09-10T23:31:59.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.398+0000 7f5f5a000640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f440725e0 0x7f5f44074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.398+0000 7f5f5a000640 1 -- 172.21.15.17:0/4265347977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7f5f5412e640 con 0x7f5f48003a10 2024-09-10T23:31:59.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.398+0000 7f5f65400640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f440725e0 0x7f5f44074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.398+0000 7f5f65400640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f440725e0 0x7f5f44074aa0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5f600c8e30 tx=0x7f5f500091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.398+0000 7f5f5a000640 1 -- 172.21.15.17:0/4265347977 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5f540c4030 con 0x7f5f48003a10 2024-09-10T23:31:59.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.606+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f6015dc10 con 0x7f5f48003a10 2024-09-10T23:31:59.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.606+0000 7f5f5a000640 1 -- 172.21.15.17:0/4265347977 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5237 (secure 0 0 0) 0x7f5f60165b00 con 0x7f5f48003a10 2024-09-10T23:31:59.610 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:31:59.611 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":169,"btime":"2024-09-10T23:31:53:033605+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:31:52.432930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11823":{"gid":11823,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6835/1849575634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":1849575634},{"type":"v1","addr":"172.21.15.17:6835","nonce":1849575634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11823,"qdb_cluster":[11823]},"id":16}]} 2024-09-10T23:31:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 169 2024-09-10T23:31:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f440725e0 msgr2=0x7f5f44074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f440725e0 0x7f5f44074aa0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5f600c8e30 tx=0x7f5f500091e0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f48003a10 msgr2=0x7f5f6015a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f48003a10 0x7f5f6015a4e0 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7f5f5401d0a0 tx=0x7f5f54005620 comp rx=0 tx=0).stop 2024-09-10T23:31:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 shutdown_connections 2024-09-10T23:31:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5f440725e0 0x7f5f44074aa0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f60163610 0x7f5f6015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f60166800 0x7f5f601630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 --2- 172.21.15.17:0/4265347977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f48003a10 0x7f5f6015a4e0 unknown :-1 s=CLOSED pgs=2586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 >> 172.21.15.17:0/4265347977 conn(0x7f5f600d1db0 msgr2=0x7f5f6015f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 shutdown_connections 2024-09-10T23:31:59.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.610+0000 7f5f68800640 1 -- 172.21.15.17:0/4265347977 wait complete. 2024-09-10T23:31:59.632 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T23:31:59.802 INFO:teuthology.orchestra.run.smithi017.stdout:{"message":"","return_code":0} 2024-09-10T23:31:59.803 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T23:31:59.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:31:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.946+0000 7fd63e600640 1 -- 172.21.15.17:0/237655255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63806ca70 msgr2=0x7fd63815f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.946+0000 7fd63e600640 1 --2- 172.21.15.17:0/237655255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63806ca70 0x7fd63815f880 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7fd6380b38f0 tx=0x7fd63001cd80 comp rx=0 tx=0).stop 2024-09-10T23:31:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.946+0000 7fd63e600640 1 -- 172.21.15.17:0/237655255 shutdown_connections 2024-09-10T23:31:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.946+0000 7fd63e600640 1 --2- 172.21.15.17:0/237655255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd63806ca70 0x7fd63815f880 unknown :-1 s=CLOSED pgs=2587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.946+0000 7fd63e600640 1 --2- 172.21.15.17:0/237655255 >> v2:172.21.15.77:3300/0 conn(0x7fd6381583d0 0x7fd63815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.946+0000 7fd63e600640 1 -- 172.21.15.17:0/237655255 >> 172.21.15.17:0/237655255 conn(0x7fd6380d0c10 msgr2=0x7fd6380d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:31:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 -- 172.21.15.17:0/237655255 shutdown_connections 2024-09-10T23:31:59.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 -- 172.21.15.17:0/237655255 wait complete. 2024-09-10T23:31:59.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 Processor -- start 2024-09-10T23:31:59.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 -- start start 2024-09-10T23:31:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63806ca70 0x7fd6381524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6381583d0 0x7fd6381557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd638162390 0x7fd638160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd63816b160 con 0x7fd6381583d0 2024-09-10T23:31:59.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd63816afe0 con 0x7fd638162390 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd63816b2e0 con 0x7fd63806ca70 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6381583d0 0x7fd6381557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6381583d0 0x7fd6381557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46442/0 (socket says 172.21.15.17:46442) 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62fe00640 1 -- 172.21.15.17:0/4229607694 learned_addr learned my addr 172.21.15.17:0/4229607694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd637e00640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd638162390 0x7fd638160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd637400640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63806ca70 0x7fd6381524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62fe00640 1 -- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63806ca70 msgr2=0x7fd6381524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62fe00640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63806ca70 0x7fd6381524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62fe00640 1 -- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd638162390 msgr2=0x7fd638160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:31:59.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62fe00640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd638162390 0x7fd638160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:31:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62fe00640 1 -- 172.21.15.17:0/4229607694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63815f1d0 con 0x7fd6381583d0 2024-09-10T23:31:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd637e00640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd638162390 0x7fd638160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:31:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62fe00640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6381583d0 0x7fd6381557a0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7fd62000b410 tx=0x7fd62000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62f400640 1 -- 172.21.15.17:0/4229607694 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620015030 con 0x7fd6381583d0 2024-09-10T23:31:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62f400640 1 -- 172.21.15.17:0/4229607694 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd620004020 con 0x7fd6381583d0 2024-09-10T23:31:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd62f400640 1 -- 172.21.15.17:0/4229607694 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200044b0 con 0x7fd6381583d0 2024-09-10T23:31:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6380cebf0 con 0x7fd6381583d0 2024-09-10T23:31:59.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.950+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd63814c720 con 0x7fd6381583d0 2024-09-10T23:31:59.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.954+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd63815f880 con 0x7fd6381583d0 2024-09-10T23:31:59.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.954+0000 7fd62f400640 1 -- 172.21.15.17:0/4229607694 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd620022060 con 0x7fd6381583d0 2024-09-10T23:31:59.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.954+0000 7fd62f400640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6140725e0 0x7fd614074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:31:59.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.954+0000 7fd62f400640 1 -- 172.21.15.17:0/4229607694 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 6101+0+0 (secure 0 0 0) 0x7fd620092f30 con 0x7fd6381583d0 2024-09-10T23:31:59.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.954+0000 7fd637400640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6140725e0 0x7fd614074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:31:59.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.958+0000 7fd637400640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6140725e0 0x7fd614074aa0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd628005d90 tx=0x7fd628005c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:31:59.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:31:59.958+0000 7fd62f400640 1 -- 172.21.15.17:0/4229607694 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd62005e470 con 0x7fd6381583d0 2024-09-10T23:32:00.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.166+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd63806d1a0 con 0x7fd6381583d0 2024-09-10T23:32:00.171 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:32:00.166+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:32:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.170+0000 7fd62f400640 1 -- 172.21.15.17:0/4229607694 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v170) ==== 161+0+0 (secure 0 0 0) 0x7fd62005dd70 con 0x7fd6381583d0 2024-09-10T23:32:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:32:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6140725e0 msgr2=0x7fd614074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6140725e0 0x7fd614074aa0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd628005d90 tx=0x7fd628005c60 comp rx=0 tx=0).stop 2024-09-10T23:32:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6381583d0 msgr2=0x7fd6381557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6381583d0 0x7fd6381557a0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7fd62000b410 tx=0x7fd62000b8d0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 shutdown_connections 2024-09-10T23:32:00.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6140725e0 0x7fd614074aa0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd638162390 0x7fd638160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6381583d0 0x7fd6381557a0 unknown :-1 s=CLOSED pgs=2588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 --2- 172.21.15.17:0/4229607694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd63806ca70 0x7fd6381524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 >> 172.21.15.17:0/4229607694 conn(0x7fd6380d0c10 msgr2=0x7fd63806c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 shutdown_connections 2024-09-10T23:32:00.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.174+0000 7fd63e600640 1 -- 172.21.15.17:0/4229607694 wait complete. 2024-09-10T23:32:00.187 INFO:tasks.ceph.mds.c.smithi017.stderr: -4957> 2024-09-10T23:31:51.982+0000 7f2cb6e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:32:00.198 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapval 10000000000.00000000 parentfile_head - 2024-09-10T23:32:00.238 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:32:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 Processor -- start 2024-09-10T23:32:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 -- start start 2024-09-10T23:32:00.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3984003100 0x563812067700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563811fdd4a0 0x563811fdc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638120f44b0 0x5638120f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563811f3df40 con 0x5638120f44b0 2024-09-10T23:32:00.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563811f4ad00 con 0x7f3984003100 2024-09-10T23:32:00.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563811edfa00 con 0x563811fdd4a0 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638120f44b0 0x5638120f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638120f44b0 0x5638120f48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46462/0 (socket says 172.21.15.17:46462) 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399de00640 1 -- 172.21.15.17:0/3529705264 learned_addr learned my addr 172.21.15.17:0/3529705264 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399ca00640 1 --2- 172.21.15.17:0/3529705264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563811fdd4a0 0x563811fdc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399d400640 1 --2- 172.21.15.17:0/3529705264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3984003100 0x563812067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399de00640 1 -- 172.21.15.17:0/3529705264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563811fdd4a0 msgr2=0x563811fdc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399de00640 1 --2- 172.21.15.17:0/3529705264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563811fdd4a0 0x563811fdc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399de00640 1 -- 172.21.15.17:0/3529705264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3984003100 msgr2=0x563812067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399de00640 1 --2- 172.21.15.17:0/3529705264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3984003100 0x563812067700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399de00640 1 -- 172.21.15.17:0/3529705264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563811fdda70 con 0x5638120f44b0 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f399de00640 1 --2- 172.21.15.17:0/3529705264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638120f44b0 0x5638120f48c0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x563811fde780 tx=0x7f39980019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d007be9518c6bbf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f3997400640 1 -- 172.21.15.17:0/3529705264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399801b070 con 0x5638120f44b0 2024-09-10T23:32:00.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f3997400640 1 -- 172.21.15.17:0/3529705264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3998012690 con 0x5638120f44b0 2024-09-10T23:32:00.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f3997400640 1 -- 172.21.15.17:0/3529705264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998012ac0 con 0x5638120f44b0 2024-09-10T23:32:00.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 -- 172.21.15.17:0/3529705264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638120f44b0 msgr2=0x5638120f48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 --2- 172.21.15.17:0/3529705264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638120f44b0 0x5638120f48c0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x563811fde780 tx=0x7f39980019f0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 -- 172.21.15.17:0/3529705264 shutdown_connections 2024-09-10T23:32:00.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 --2- 172.21.15.17:0/3529705264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638120f44b0 0x5638120f48c0 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 --2- 172.21.15.17:0/3529705264 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563811fdd4a0 0x563811fdc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 --2- 172.21.15.17:0/3529705264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3984003100 0x563812067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 -- 172.21.15.17:0/3529705264 >> 172.21.15.17:0/3529705264 conn(0x563811fc0700 msgr2=0x563811fdb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 -- 172.21.15.17:0/3529705264 shutdown_connections 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.246+0000 7f39a0106080 1 -- 172.21.15.17:0/3529705264 wait complete. 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 Processor -- start 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 -- start start 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563811fdd4a0 0x5638120664b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638120f44b0 0x5638120f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3984003100 0x563812068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5638120f22d0 con 0x7f3984003100 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563811fddd10 con 0x563811fdd4a0 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563811fddfb0 con 0x5638120f44b0 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3984003100 0x563812068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3984003100 0x563812068060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46468/0 (socket says 172.21.15.17:46468) 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399de00640 1 -- 172.21.15.17:0/2557569167 learned_addr learned my addr 172.21.15.17:0/2557569167 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399d400640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563811fdd4a0 0x5638120664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399ca00640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638120f44b0 0x5638120f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399de00640 1 -- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638120f44b0 msgr2=0x5638120f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399de00640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638120f44b0 0x5638120f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399de00640 1 -- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563811fdd4a0 msgr2=0x5638120664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399de00640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563811fdd4a0 0x5638120664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399de00640 1 -- 172.21.15.17:0/2557569167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638120f4070 con 0x7f3984003100 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399ca00640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5638120f44b0 0x5638120f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f399de00640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3984003100 0x563812068060 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f3998012de0 tx=0x7f3998012e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f3996000640 1 -- 172.21.15.17:0/2557569167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399801b040 con 0x7f3984003100 2024-09-10T23:32:00.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f3996000640 1 -- 172.21.15.17:0/2557569167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3998002d60 con 0x7f3984003100 2024-09-10T23:32:00.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563811fc1a20 con 0x7f3984003100 2024-09-10T23:32:00.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f3996000640 1 -- 172.21.15.17:0/2557569167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39980042d0 con 0x7f3984003100 2024-09-10T23:32:00.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.250+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563811fc1f60 con 0x7f3984003100 2024-09-10T23:32:00.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f3996000640 1 -- 172.21.15.17:0/2557569167 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f399801e070 con 0x7f3984003100 2024-09-10T23:32:00.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f3996000640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3980070fc0 0x7f3980073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f3996000640 1 -- 172.21.15.17:0/2557569167 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f3998095350 con 0x7f3984003100 2024-09-10T23:32:00.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x563812049970 0x563812049d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 --> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] -- osd_op(unknown.0.0:1 33.10 33:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224) -- 0x56381204a290 con 0x563812049970 2024-09-10T23:32:00.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f399d400640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3980070fc0 0x7f3980073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f399ca00640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x563812049970 0x563812049d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f399ca00640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x563812049970 0x563812049d50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f399d400640 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3980070fc0 0x7f3980073480 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f39900044c0 tx=0x7f3990002040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f399ca00640 1 -- 172.21.15.17:0/2557569167 <== osd.3 v2:172.21.15.17:6800/1907203974 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-vals-by-keys out=527b] v0'0 uv10 ondisk = 0) ==== 164+0+527 (crc 0 0 0) 0x7f398c00b040 con 0x563812049970 2024-09-10T23:32:00.259 INFO:teuthology.orchestra.run.smithi017.stderr:Writing to - 2024-09-10T23:32:00.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x563812049970 msgr2=0x563812049d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x563812049970 0x563812049d50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3980070fc0 msgr2=0x7f3980073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3980070fc0 0x7f3980073480 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f39900044c0 tx=0x7f3990002040 comp rx=0 tx=0).stop 2024-09-10T23:32:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3984003100 msgr2=0x563812068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 --2- 172.21.15.17:0/2557569167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3984003100 0x563812068060 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f3998012de0 tx=0x7f3998012e10 comp rx=0 tx=0).stop 2024-09-10T23:32:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f399de00640 1 -- 172.21.15.17:0/2557569167 reap_dead start 2024-09-10T23:32:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 shutdown_connections 2024-09-10T23:32:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 >> 172.21.15.17:0/2557569167 conn(0x563811fc0700 msgr2=0x563811f8fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.254+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 shutdown_connections 2024-09-10T23:32:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.258+0000 7f39a0106080 1 -- 172.21.15.17:0/2557569167 wait complete. 2024-09-10T23:32:00.263 INFO:teuthology.orchestra.run.smithi017.stdout:i������f&�5����@@"`�����������f&�5���f:a2(8`���f&�58`���f&�5�����������f:a20������������ 2024-09-10T23:32:00.263 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 shadow_head 2024-09-10T23:32:00.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b9a013080 1 Processor -- start 2024-09-10T23:32:00.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b9a013080 1 -- start start 2024-09-10T23:32:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b9a013080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c9121ff450 0x55c9122a7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b9a013080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c9121ff830 0x55c9122a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b9a013080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c912287d00 0x55c9122a3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b9a013080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c912289d80 con 0x55c912287d00 2024-09-10T23:32:00.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b9a013080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c91211da00 con 0x55c9121ff830 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b9a013080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c912289f00 con 0x55c9121ff450 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b97c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c912287d00 0x55c9122a3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b97c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c912287d00 0x55c9122a3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46474/0 (socket says 172.21.15.17:46474) 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b97c00640 1 -- 172.21.15.17:0/2440676031 learned_addr learned my addr 172.21.15.17:0/2440676031 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b97200640 1 --2- 172.21.15.17:0/2440676031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c9121ff450 0x55c9122a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b8fe00640 1 --2- 172.21.15.17:0/2440676031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c9121ff830 0x55c9122a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b97c00640 1 -- 172.21.15.17:0/2440676031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c9121ff450 msgr2=0x55c9122a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b97c00640 1 --2- 172.21.15.17:0/2440676031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c9121ff450 0x55c9122a7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b97c00640 1 -- 172.21.15.17:0/2440676031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c9121ff830 msgr2=0x55c9122a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b97c00640 1 --2- 172.21.15.17:0/2440676031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c9121ff830 0x55c9122a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.350+0000 7f9b97c00640 1 -- 172.21.15.17:0/2440676031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c91211ca20 con 0x55c912287d00 2024-09-10T23:32:00.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b97c00640 1 --2- 172.21.15.17:0/2440676031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c912287d00 0x55c9122a3ec0 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c720 tx=0x7f9b9000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914517d3d92cbfd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b95e00640 1 -- 172.21.15.17:0/2440676031 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90004020 con 0x55c912287d00 2024-09-10T23:32:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b95e00640 1 -- 172.21.15.17:0/2440676031 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b900042b0 con 0x55c912287d00 2024-09-10T23:32:00.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b95e00640 1 -- 172.21.15.17:0/2440676031 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000aa80 con 0x55c912287d00 2024-09-10T23:32:00.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 -- 172.21.15.17:0/2440676031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c912287d00 msgr2=0x55c9122a3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 --2- 172.21.15.17:0/2440676031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c912287d00 0x55c9122a3ec0 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c720 tx=0x7f9b9000cbe0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 -- 172.21.15.17:0/2440676031 shutdown_connections 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 --2- 172.21.15.17:0/2440676031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c912287d00 0x55c9122a3ec0 unknown :-1 s=CLOSED pgs=2597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 --2- 172.21.15.17:0/2440676031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c9121ff830 0x55c9122a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 --2- 172.21.15.17:0/2440676031 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c9121ff450 0x55c9122a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 -- 172.21.15.17:0/2440676031 >> 172.21.15.17:0/2440676031 conn(0x55c9121d0550 msgr2=0x55c9121d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 -- 172.21.15.17:0/2440676031 shutdown_connections 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 -- 172.21.15.17:0/2440676031 wait complete. 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 Processor -- start 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 -- start start 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c9121ff450 0x55c9122127b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9121ff830 0x55c9122a3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c912287d00 0x55c9122a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c912287a60 con 0x55c9121ff830 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c9122a8a10 con 0x55c9121ff450 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b9a013080 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c9122adc90 con 0x55c912287d00 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b8fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9121ff830 0x55c9122a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b8fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9121ff830 0x55c9122a3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46488/0 (socket says 172.21.15.17:46488) 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b97200640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c9121ff450 0x55c9122127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b8fe00640 1 -- 172.21.15.17:0/993123839 learned_addr learned my addr 172.21.15.17:0/993123839 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b97c00640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c912287d00 0x55c9122a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b8fe00640 1 -- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c912287d00 msgr2=0x55c9122a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b8fe00640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c912287d00 0x55c9122a1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b8fe00640 1 -- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c9121ff450 msgr2=0x55c9122127b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b8fe00640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c9121ff450 0x55c9122127b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b8fe00640 1 -- 172.21.15.17:0/993123839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9120f6c10 con 0x55c9121ff830 2024-09-10T23:32:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b8fe00640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9121ff830 0x55c9122a3220 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7f9b80008720 tx=0x7f9b80008be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.354+0000 7f9b94a00640 1 -- 172.21.15.17:0/993123839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8001a070 con 0x55c9121ff830 2024-09-10T23:32:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b94a00640 1 -- 172.21.15.17:0/993123839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b8000ad70 con 0x55c9121ff830 2024-09-10T23:32:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b94a00640 1 -- 172.21.15.17:0/993123839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80015680 con 0x55c9121ff830 2024-09-10T23:32:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9122adab0 con 0x55c9121ff830 2024-09-10T23:32:00.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9122ad2d0 con 0x55c9121ff830 2024-09-10T23:32:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b94a00640 1 -- 172.21.15.17:0/993123839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9b80015820 con 0x55c9121ff830 2024-09-10T23:32:00.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b94a00640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b74070ff0 0x7f9b740734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b94a00640 1 -- 172.21.15.17:0/993123839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f9b800926b0 con 0x55c9121ff830 2024-09-10T23:32:00.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b9a013080 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x55c9122a3760 0x55c9122aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 --> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] -- osd_op(unknown.0.0:1 33.10 33:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=523b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e224) -- 0x55c91233cf20 con 0x55c9122a3760 2024-09-10T23:32:00.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b97200640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b74070ff0 0x7f9b740734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.358+0000 7f9b97c00640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x55c9122a3760 0x55c9122aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b97200640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b74070ff0 0x7f9b740734b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9b880ab000 tx=0x7f9b88019a50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b97c00640 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x55c9122a3760 0x55c9122aca10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b97c00640 1 -- 172.21.15.17:0/993123839 <== osd.3 v2:172.21.15.17:6800/1907203974 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v224'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9b90002030 con 0x55c9122a3760 2024-09-10T23:32:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x55c9122a3760 msgr2=0x55c9122aca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x55c9122a3760 0x55c9122aca10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b74070ff0 msgr2=0x7f9b740734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9b74070ff0 0x7f9b740734b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9b880ab000 tx=0x7f9b88019a50 comp rx=0 tx=0).stop 2024-09-10T23:32:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9121ff830 msgr2=0x55c9122a3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 --2- 172.21.15.17:0/993123839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9121ff830 0x55c9122a3220 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7f9b80008720 tx=0x7f9b80008be0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b97c00640 1 -- 172.21.15.17:0/993123839 reap_dead start 2024-09-10T23:32:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 shutdown_connections 2024-09-10T23:32:00.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 >> 172.21.15.17:0/993123839 conn(0x55c9121d0550 msgr2=0x55c9122a3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 shutdown_connections 2024-09-10T23:32:00.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.362+0000 7f9b9a013080 1 -- 172.21.15.17:0/993123839 wait complete. 2024-09-10T23:32:00.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_hack_allow_loading_invalid_metadata True 2024-09-10T23:32:00.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.554+0000 7f02c6e00640 1 -- 172.21.15.17:0/141282315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c015bc20 msgr2=0x7f02c006f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.554+0000 7f02c6e00640 1 --2- 172.21.15.17:0/141282315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c015bc20 0x7f02c006f5a0 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7f02c00cdeb0 tx=0x7f02b001c830 comp rx=0 tx=0).stop 2024-09-10T23:32:00.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.554+0000 7f02c6e00640 1 -- 172.21.15.17:0/141282315 shutdown_connections 2024-09-10T23:32:00.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.554+0000 7f02c6e00640 1 --2- 172.21.15.17:0/141282315 >> v2:172.21.15.77:3300/0 conn(0x7f02c015c000 0x7f02c006e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.554+0000 7f02c6e00640 1 --2- 172.21.15.17:0/141282315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c015bc20 0x7f02c006f5a0 unknown :-1 s=CLOSED pgs=2599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.554+0000 7f02c6e00640 1 -- 172.21.15.17:0/141282315 >> 172.21.15.17:0/141282315 conn(0x7f02c006c360 msgr2=0x7f02c006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.554+0000 7f02c6e00640 1 -- 172.21.15.17:0/141282315 shutdown_connections 2024-09-10T23:32:00.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.554+0000 7f02c6e00640 1 -- 172.21.15.17:0/141282315 wait complete. 2024-09-10T23:32:00.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c6e00640 1 Processor -- start 2024-09-10T23:32:00.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c6e00640 1 -- start start 2024-09-10T23:32:00.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c6e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c006fae0 0x7f02c009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c6e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c015bc20 0x7f02c009d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c6e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c015c000 0x7f02c01455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c6e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f02c0169440 con 0x7f02c006fae0 2024-09-10T23:32:00.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c6e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01692c0 con 0x7f02c015bc20 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c6e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f02c01695c0 con 0x7f02c015c000 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c006fae0 0x7f02c009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c006fae0 0x7f02c009aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46506/0 (socket says 172.21.15.17:46506) 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bfe00640 1 -- 172.21.15.17:0/742143026 learned_addr learned my addr 172.21.15.17:0/742143026 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02b7e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c015bc20 0x7f02c009d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c4e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c015c000 0x7f02c01455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bfe00640 1 -- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c015c000 msgr2=0x7f02c01455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bfe00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c015c000 0x7f02c01455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bfe00640 1 -- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c015bc20 msgr2=0x7f02c009d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bfe00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c015bc20 0x7f02c009d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bfe00640 1 -- 172.21.15.17:0/742143026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c009dba0 con 0x7f02c006fae0 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02b7e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c015bc20 0x7f02c009d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:00.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c4e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c015c000 0x7f02c01455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:00.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bfe00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c006fae0 0x7f02c009aa10 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7f02b00b0040 tx=0x7f02b00a5710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bcc00640 1 -- 172.21.15.17:0/742143026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b00bb070 con 0x7f02c006fae0 2024-09-10T23:32:00.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bcc00640 1 -- 172.21.15.17:0/742143026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02b0005030 con 0x7f02c006fae0 2024-09-10T23:32:00.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02bcc00640 1 -- 172.21.15.17:0/742143026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b00b2040 con 0x7f02c006fae0 2024-09-10T23:32:00.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.558+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c00b38a0 con 0x7f02c006fae0 2024-09-10T23:32:00.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.562+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c00b3e60 con 0x7f02c006fae0 2024-09-10T23:32:00.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.562+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c00b4290 con 0x7f02c006fae0 2024-09-10T23:32:00.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.562+0000 7f02bcc00640 1 -- 172.21.15.17:0/742143026 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f02b0005480 con 0x7f02c006fae0 2024-09-10T23:32:00.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.562+0000 7f02bcc00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f029c0725e0 0x7f029c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.562+0000 7f02bcc00640 1 -- 172.21.15.17:0/742143026 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f02b012cb70 con 0x7f02c006fae0 2024-09-10T23:32:00.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.562+0000 7f02b7e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f029c0725e0 0x7f029c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.562+0000 7f02b7e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f029c0725e0 0x7f029c074aa0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f02a8005cb0 tx=0x7f02a80094b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.566+0000 7f02bcc00640 1 -- 172.21.15.17:0/742143026 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f02b00164b0 con 0x7f02c006fae0 2024-09-10T23:32:00.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.742+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}] v 0) -- 0x7f02c015dfb0 con 0x7f02c006fae0 2024-09-10T23:32:00.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02bcc00640 1 -- 172.21.15.17:0/742143026 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}]=0 v65)=0 v65) ==== 140+0+0 (secure 0 0 0) 0x7f02b00f8060 con 0x7f02c006fae0 2024-09-10T23:32:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f029c0725e0 msgr2=0x7f029c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f029c0725e0 0x7f029c074aa0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f02a8005cb0 tx=0x7f02a80094b0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c006fae0 msgr2=0x7f02c009aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c006fae0 0x7f02c009aa10 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7f02b00b0040 tx=0x7f02b00a5710 comp rx=0 tx=0).stop 2024-09-10T23:32:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 shutdown_connections 2024-09-10T23:32:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f029c0725e0 0x7f029c074aa0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f02c015c000 0x7f02c01455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c015bc20 0x7f02c009d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 --2- 172.21.15.17:0/742143026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02c006fae0 0x7f02c009aa10 unknown :-1 s=CLOSED pgs=2600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 >> 172.21.15.17:0/742143026 conn(0x7f02c006c360 msgr2=0x7f02c0157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 shutdown_connections 2024-09-10T23:32:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.746+0000 7f02c6e00640 1 -- 172.21.15.17:0/742143026 wait complete. 2024-09-10T23:32:00.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-10T23:32:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.914+0000 7f93ee200640 1 -- 172.21.15.17:0/1659977595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93e80cfdd0 msgr2=0x7f93e80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.914+0000 7f93ee200640 1 --2- 172.21.15.17:0/1659977595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93e80cfdd0 0x7f93e80d01b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009900 tx=0x7f93d801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.914+0000 7f93ee200640 1 -- 172.21.15.17:0/1659977595 shutdown_connections 2024-09-10T23:32:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.914+0000 7f93ee200640 1 --2- 172.21.15.17:0/1659977595 >> v2:172.21.15.77:3300/0 conn(0x7f93e80b0700 0x7f93e81602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.914+0000 7f93ee200640 1 --2- 172.21.15.17:0/1659977595 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93e80cfdd0 0x7f93e80d01b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.914+0000 7f93ee200640 1 -- 172.21.15.17:0/1659977595 >> 172.21.15.17:0/1659977595 conn(0x7f93e80d1d90 msgr2=0x7f93e80d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 -- 172.21.15.17:0/1659977595 shutdown_connections 2024-09-10T23:32:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 -- 172.21.15.17:0/1659977595 wait complete. 2024-09-10T23:32:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 Processor -- start 2024-09-10T23:32:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 -- start start 2024-09-10T23:32:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93e80b0700 0x7f93e81480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80cfdd0 0x7f93e815e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e80d28b0 0x7f93e8165970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f93e80b2900 con 0x7f93e80d28b0 2024-09-10T23:32:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f93e80b2780 con 0x7f93e80cfdd0 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93ee200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f93e8168ec0 con 0x7f93e80b0700 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93dea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80cfdd0 0x7f93e815e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93e7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93e80b0700 0x7f93e81480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93dea00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80cfdd0 0x7f93e815e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:55248/0 (socket says 172.21.15.17:55248) 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93dea00640 1 -- 172.21.15.17:0/1612558485 learned_addr learned my addr 172.21.15.17:0/1612558485 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93e7e00640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e80d28b0 0x7f93e8165970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93dea00640 1 -- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93e80b0700 msgr2=0x7f93e81480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93dea00640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93e80b0700 0x7f93e81480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93dea00640 1 -- 172.21.15.17:0/1612558485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e80d28b0 msgr2=0x7f93e8165970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93dea00640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e80d28b0 0x7f93e8165970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93dea00640 1 -- 172.21.15.17:0/1612558485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e81f7a00 con 0x7f93e80cfdd0 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.918+0000 7f93dea00640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80cfdd0 0x7f93e815e810 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c420 tx=0x7f93d000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93dfe00640 1 -- 172.21.15.17:0/1612558485 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0017070 con 0x7f93e80cfdd0 2024-09-10T23:32:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93dfe00640 1 -- 172.21.15.17:0/1612558485 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93d00053c0 con 0x7f93e80cfdd0 2024-09-10T23:32:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93dfe00640 1 -- 172.21.15.17:0/1612558485 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0003860 con 0x7f93e80cfdd0 2024-09-10T23:32:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e8148630 con 0x7f93e80cfdd0 2024-09-10T23:32:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e815f540 con 0x7f93e80cfdd0 2024-09-10T23:32:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e8146480 con 0x7f93e80cfdd0 2024-09-10T23:32:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93dfe00640 1 -- 172.21.15.17:0/1612558485 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f93d0003a00 con 0x7f93e80cfdd0 2024-09-10T23:32:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93dfe00640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93c4072610 0x7f93c4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93dfe00640 1 -- 172.21.15.17:0/1612558485 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f93d0092be0 con 0x7f93e80cfdd0 2024-09-10T23:32:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.922+0000 7f93e7400640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93c4072610 0x7f93c4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.926+0000 7f93e7400640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93c4072610 0x7f93c4074ad0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f93d80af000 tx=0x7f93d801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:00.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:00.926+0000 7f93dfe00640 1 -- 172.21.15.17:0/1612558485 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f93d0021080 con 0x7f93e80cfdd0 2024-09-10T23:32:01.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.138+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f93e80d01b0 con 0x7f93e80cfdd0 2024-09-10T23:32:01.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.178+0000 7f93dfe00640 1 -- 172.21.15.17:0/1612558485 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v171) ==== 162+0+0 (secure 0 0 0) 0x7f93e80d0bd0 con 0x7f93e80cfdd0 2024-09-10T23:32:01.182 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-10T23:32:01.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93c4072610 msgr2=0x7f93c4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93c4072610 0x7f93c4074ad0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f93d80af000 tx=0x7f93d801b120 comp rx=0 tx=0).stop 2024-09-10T23:32:01.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80cfdd0 msgr2=0x7f93e815e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80cfdd0 0x7f93e815e810 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c420 tx=0x7f93d000c8e0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 shutdown_connections 2024-09-10T23:32:01.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f93c4072610 0x7f93c4074ad0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93e80d28b0 0x7f93e8165970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80cfdd0 0x7f93e815e810 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 --2- 172.21.15.17:0/1612558485 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93e80b0700 0x7f93e81480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 >> 172.21.15.17:0/1612558485 conn(0x7f93e80d1d90 msgr2=0x7f93e81581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 shutdown_connections 2024-09-10T23:32:01.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.182+0000 7f93ee200640 1 -- 172.21.15.17:0/1612558485 wait complete. 2024-09-10T23:32:01.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:32:01.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.350+0000 7fa950c00640 1 -- 172.21.15.17:0/3275988116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa94c0708f0 msgr2=0x7fa94c0b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.350+0000 7fa950c00640 1 --2- 172.21.15.17:0/3275988116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa94c0708f0 0x7fa94c0b5090 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009bc0 tx=0x7fa93c01cb10 comp rx=0 tx=0).stop 2024-09-10T23:32:01.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.350+0000 7fa950c00640 1 -- 172.21.15.17:0/3275988116 shutdown_connections 2024-09-10T23:32:01.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.350+0000 7fa950c00640 1 --2- 172.21.15.17:0/3275988116 >> v2:172.21.15.77:3300/0 conn(0x7fa94c06f0b0 0x7fa94c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.350+0000 7fa950c00640 1 --2- 172.21.15.17:0/3275988116 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa94c0708f0 0x7fa94c0b5090 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.350+0000 7fa950c00640 1 -- 172.21.15.17:0/3275988116 >> 172.21.15.17:0/3275988116 conn(0x7fa94c0b1850 msgr2=0x7fa94c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 -- 172.21.15.17:0/3275988116 shutdown_connections 2024-09-10T23:32:01.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 -- 172.21.15.17:0/3275988116 wait complete. 2024-09-10T23:32:01.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 Processor -- start 2024-09-10T23:32:01.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 -- start start 2024-09-10T23:32:01.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa94c06f0b0 0x7fa94c158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0708f0 0x7fa94c140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa94c15a8b0 0x7fa94c0adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c0cf260 con 0x7fa94c0708f0 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c0cf0e0 con 0x7fa94c06f0b0 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa950c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa94c0cf3e0 con 0x7fa94c15a8b0 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa941400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0708f0 0x7fa94c140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa941400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0708f0 0x7fa94c140450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46524/0 (socket says 172.21.15.17:46524) 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa941400640 1 -- 172.21.15.17:0/1782445844 learned_addr learned my addr 172.21.15.17:0/1782445844 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa949e00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa94c06f0b0 0x7fa94c158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa94a800640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa94c15a8b0 0x7fa94c0adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa941400640 1 -- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa94c15a8b0 msgr2=0x7fa94c0adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa941400640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa94c15a8b0 0x7fa94c0adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa941400640 1 -- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa94c06f0b0 msgr2=0x7fa94c158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa941400640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa94c06f0b0 0x7fa94c158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa941400640 1 -- 172.21.15.17:0/1782445844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94c1596a0 con 0x7fa94c0708f0 2024-09-10T23:32:01.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.354+0000 7fa941400640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0708f0 0x7fa94c140450 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7fa93400e9f0 tx=0x7fa93400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa942a00640 1 -- 172.21.15.17:0/1782445844 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93400cde0 con 0x7fa94c0708f0 2024-09-10T23:32:01.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa942a00640 1 -- 172.21.15.17:0/1782445844 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa934010520 con 0x7fa94c0708f0 2024-09-10T23:32:01.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa942a00640 1 -- 172.21.15.17:0/1782445844 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934010970 con 0x7fa94c0708f0 2024-09-10T23:32:01.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94c159980 con 0x7fa94c0708f0 2024-09-10T23:32:01.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa94c150750 con 0x7fa94c0708f0 2024-09-10T23:32:01.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94c075ad0 con 0x7fa94c0708f0 2024-09-10T23:32:01.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa942a00640 1 -- 172.21.15.17:0/1782445844 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa934010b10 con 0x7fa94c0708f0 2024-09-10T23:32:01.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa942a00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa928072610 0x7fa928074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:01.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa942a00640 1 -- 172.21.15.17:0/1782445844 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7fa934093ef0 con 0x7fa94c0708f0 2024-09-10T23:32:01.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.358+0000 7fa949e00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa928072610 0x7fa928074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:01.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.362+0000 7fa949e00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa928072610 0x7fa928074ad0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0af000 tx=0x7fa93c01b350 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:01.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.362+0000 7fa942a00640 1 -- 172.21.15.17:0/1782445844 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa93405ed00 con 0x7fa94c0708f0 2024-09-10T23:32:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.570+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa94c15a370 con 0x7fa94c0708f0 2024-09-10T23:32:01.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.570+0000 7fa942a00640 1 -- 172.21.15.17:0/1782445844 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 172 v172) ==== 95+0+5230 (secure 0 0 0) 0x7fa934063730 con 0x7fa94c0708f0 2024-09-10T23:32:01.574 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:32:01.574 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":172,"btime":"2024-09-10T23:32:01:183300+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":172,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:32:01.183285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":224,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":12012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_12012":{"gid":12012,"name":"c","rank":0,"incarnation":172,"state":"up:replay","state_seq":1,"addr":"172.21.15.17:6835/2426812353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2426812353},{"type":"v1","addr":"172.21.15.17:6835","nonce":2426812353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":16}]} 2024-09-10T23:32:01.574 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 172 2024-09-10T23:32:01.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa928072610 msgr2=0x7fa928074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa928072610 0x7fa928074ad0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0af000 tx=0x7fa93c01b350 comp rx=0 tx=0).stop 2024-09-10T23:32:01.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0708f0 msgr2=0x7fa94c140450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:01.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0708f0 0x7fa94c140450 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7fa93400e9f0 tx=0x7fa93400eeb0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 shutdown_connections 2024-09-10T23:32:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa928072610 0x7fa928074ad0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa94c15a8b0 0x7fa94c0adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0708f0 0x7fa94c140450 unknown :-1 s=CLOSED pgs=2602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 --2- 172.21.15.17:0/1782445844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa94c06f0b0 0x7fa94c158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 >> 172.21.15.17:0/1782445844 conn(0x7fa94c0b1850 msgr2=0x7fa94c153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 shutdown_connections 2024-09-10T23:32:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:01.574+0000 7fa950c00640 1 -- 172.21.15.17:0/1782445844 wait complete. 2024-09-10T23:32:01.997 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 172, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:31:49.429993+0000', 'modified': '2024-09-10T23:32:01.183285+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 224, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 12012}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_12012': {'gid': 12012, 'name': 'c', 'rank': 0, 'incarnation': 172, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.17:6835/2426812353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 2426812353}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2426812353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:32:01.998 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_12012:up:replay 2024-09-10T23:32:02.998 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:32:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.154+0000 7f4770e00640 1 -- 172.21.15.17:0/3774877111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 msgr2=0x7f476c0d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.154+0000 7f4770e00640 1 --2- 172.21.15.17:0/3774877111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 0x7f476c0d0660 secure :-1 s=READY pgs=2604 cs=0 l=1 rev1=1 crypto rx=0x7f4764009bc0 tx=0x7f476401cba0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.154+0000 7f4770e00640 1 -- 172.21.15.17:0/3774877111 shutdown_connections 2024-09-10T23:32:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.154+0000 7f4770e00640 1 --2- 172.21.15.17:0/3774877111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 0x7f476c0d0660 unknown :-1 s=CLOSED pgs=2604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.154+0000 7f4770e00640 1 -- 172.21.15.17:0/3774877111 >> 172.21.15.17:0/3774877111 conn(0x7f476c0d1d40 msgr2=0x7f476c0d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.154+0000 7f4770e00640 1 -- 172.21.15.17:0/3774877111 shutdown_connections 2024-09-10T23:32:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.154+0000 7f4770e00640 1 -- 172.21.15.17:0/3774877111 wait complete. 2024-09-10T23:32:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 Processor -- start 2024-09-10T23:32:03.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 -- start start 2024-09-10T23:32:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 0x7f476c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f476c0b2fc0 0x7f476c0b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f476c0cfb70 0x7f476c1fa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f476c16a210 con 0x7f476c0b07b0 2024-09-10T23:32:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f476c16a090 con 0x7f476c0cfb70 2024-09-10T23:32:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f476c16a390 con 0x7f476c0b2fc0 2024-09-10T23:32:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4769e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 0x7f476c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4769e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 0x7f476c0ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46546/0 (socket says 172.21.15.17:46546) 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4769e00640 1 -- 172.21.15.17:0/3727521738 learned_addr learned my addr 172.21.15.17:0/3727521738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f476a800640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f476c0cfb70 0x7f476c1fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4763e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f476c0b2fc0 0x7f476c0b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4769e00640 1 -- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f476c0b2fc0 msgr2=0x7f476c0b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4769e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f476c0b2fc0 0x7f476c0b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4769e00640 1 -- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f476c0cfb70 msgr2=0x7f476c1fa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4769e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f476c0cfb70 0x7f476c1fa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4769e00640 1 -- 172.21.15.17:0/3727521738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c0b7aa0 con 0x7f476c0b07b0 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4763e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f476c0b2fc0 0x7f476c0b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4769e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 0x7f476c0ce8c0 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f475c00c430 tx=0x7f475c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4762000640 1 -- 172.21.15.17:0/3727521738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c011790 con 0x7f476c0b07b0 2024-09-10T23:32:03.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4762000640 1 -- 172.21.15.17:0/3727521738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f475c017070 con 0x7f476c0b07b0 2024-09-10T23:32:03.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c0cb680 con 0x7f476c0b07b0 2024-09-10T23:32:03.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4762000640 1 -- 172.21.15.17:0/3727521738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c011ce0 con 0x7f476c0b07b0 2024-09-10T23:32:03.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.158+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c0b5120 con 0x7f476c0b07b0 2024-09-10T23:32:03.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.162+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f476c15fc90 con 0x7f476c0b07b0 2024-09-10T23:32:03.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.162+0000 7f4762000640 1 -- 172.21.15.17:0/3727521738 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f475c01c460 con 0x7f476c0b07b0 2024-09-10T23:32:03.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.162+0000 7f4762000640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4748072610 0x7f4748074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:03.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.162+0000 7f4762000640 1 -- 172.21.15.17:0/3727521738 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f475c0931f0 con 0x7f476c0b07b0 2024-09-10T23:32:03.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.162+0000 7f4763e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4748072610 0x7f4748074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.162+0000 7f4763e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4748072610 0x7f4748074ad0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f476c15fb50 tx=0x7f4754009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.166+0000 7f4762000640 1 -- 172.21.15.17:0/3727521738 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f475c05e720 con 0x7f476c0b07b0 2024-09-10T23:32:03.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f476c0cc530 con 0x7f476c0b07b0 2024-09-10T23:32:03.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4762000640 1 -- 172.21.15.17:0/3727521738 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 174 v174) ==== 95+0+5230 (secure 0 0 0) 0x7f475c05e020 con 0x7f476c0b07b0 2024-09-10T23:32:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:32:03.385 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":174,"btime":"2024-09-10T23:32:03:186924+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":174,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:32:02.188275+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":224,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":12012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_12012":{"gid":12012,"name":"c","rank":0,"incarnation":172,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.17:6835/2426812353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2426812353},{"type":"v1","addr":"172.21.15.17:6835","nonce":2426812353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":16}]} 2024-09-10T23:32:03.385 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 174 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4748072610 msgr2=0x7f4748074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4748072610 0x7f4748074ad0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f476c15fb50 tx=0x7f4754009040 comp rx=0 tx=0).stop 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 msgr2=0x7f476c0ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 0x7f476c0ce8c0 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f475c00c430 tx=0x7f475c00c8f0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 shutdown_connections 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4748072610 0x7f4748074ad0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f476c0cfb70 0x7f476c1fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f476c0b2fc0 0x7f476c0b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 --2- 172.21.15.17:0/3727521738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f476c0b07b0 0x7f476c0ce8c0 unknown :-1 s=CLOSED pgs=2605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:03.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 >> 172.21.15.17:0/3727521738 conn(0x7f476c0d1d40 msgr2=0x7f476c157750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:03.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 shutdown_connections 2024-09-10T23:32:03.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:03.382+0000 7f4770e00640 1 -- 172.21.15.17:0/3727521738 wait complete. 2024-09-10T23:32:03.810 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 174, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:31:49.429993+0000', 'modified': '2024-09-10T23:32:02.188275+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 224, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 12012}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_12012': {'gid': 12012, 'name': 'c', 'rank': 0, 'incarnation': 172, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.17:6835/2426812353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 2426812353}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2426812353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T23:32:03.810 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_12012:up:rejoin 2024-09-10T23:32:04.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:32:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.966+0000 7fe31d400640 1 -- 172.21.15.17:0/996994630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2fc004d50 msgr2=0x7fe2fc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.966+0000 7fe31d400640 1 --2- 172.21.15.17:0/996994630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2fc004d50 0x7fe2fc0051d0 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 crypto rx=0x7fe310009f10 tx=0x7fe31001d5d0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.966+0000 7fe31ca00640 1 -- 172.21.15.17:0/996994630 reap_dead start 2024-09-10T23:32:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.966+0000 7fe31d400640 1 -- 172.21.15.17:0/996994630 shutdown_connections 2024-09-10T23:32:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.966+0000 7fe31d400640 1 -- 172.21.15.17:0/996994630 >> 172.21.15.17:0/996994630 conn(0x7fe3180d0ae0 msgr2=0x7fe3180d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.966+0000 7fe31d400640 1 -- 172.21.15.17:0/996994630 shutdown_connections 2024-09-10T23:32:04.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.966+0000 7fe31d400640 1 -- 172.21.15.17:0/996994630 wait complete. 2024-09-10T23:32:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 Processor -- start 2024-09-10T23:32:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 -- start start 2024-09-10T23:32:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2fc004d50 0x7fe3181f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3181f7d70 0x7fe3180a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3180aa3c0 0x7fe318139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180b3e80 con 0x7fe2fc004d50 2024-09-10T23:32:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180b4000 con 0x7fe3180aa3c0 2024-09-10T23:32:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe3180b4180 con 0x7fe3181f7d70 2024-09-10T23:32:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe317e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2fc004d50 0x7fe3181f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe317e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2fc004d50 0x7fe3181f7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46570/0 (socket says 172.21.15.17:46570) 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe317e00640 1 -- 172.21.15.17:0/1728721661 learned_addr learned my addr 172.21.15.17:0/1728721661 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe30fe00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3181f7d70 0x7fe3180a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31ca00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3180aa3c0 0x7fe318139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe317e00640 1 -- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3181f7d70 msgr2=0x7fe3180a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe317e00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3181f7d70 0x7fe3180a9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe317e00640 1 -- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3180aa3c0 msgr2=0x7fe318139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe317e00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3180aa3c0 0x7fe318139bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe317e00640 1 -- 172.21.15.17:0/1728721661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3181f5400 con 0x7fe2fc004d50 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe30fe00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3181f7d70 0x7fe3180a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31ca00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3180aa3c0 0x7fe318139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe317e00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2fc004d50 0x7fe3181f7830 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7fe308001060 tx=0x7fe3080039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe314c00640 1 -- 172.21.15.17:0/1728721661 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe308015070 con 0x7fe2fc004d50 2024-09-10T23:32:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe314c00640 1 -- 172.21.15.17:0/1728721661 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe30800f980 con 0x7fe2fc004d50 2024-09-10T23:32:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3180aabb0 con 0x7fe2fc004d50 2024-09-10T23:32:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe314c00640 1 -- 172.21.15.17:0/1728721661 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30800fdd0 con 0x7fe2fc004d50 2024-09-10T23:32:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.970+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3180ab170 con 0x7fe2fc004d50 2024-09-10T23:32:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.974+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31806fbb0 con 0x7fe2fc004d50 2024-09-10T23:32:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.974+0000 7fe314c00640 1 -- 172.21.15.17:0/1728721661 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe308011430 con 0x7fe2fc004d50 2024-09-10T23:32:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.974+0000 7fe314c00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2f4072610 0x7fe2f4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.974+0000 7fe314c00640 1 -- 172.21.15.17:0/1728721661 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7fe308094230 con 0x7fe2fc004d50 2024-09-10T23:32:04.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.974+0000 7fe30fe00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2f4072610 0x7fe2f4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.974+0000 7fe30fe00640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2f4072610 0x7fe2f4074ad0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe3180cc3d0 tx=0x7fe30000d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:04.978+0000 7fe314c00640 1 -- 172.21.15.17:0/1728721661 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe30805f6a0 con 0x7fe2fc004d50 2024-09-10T23:32:05.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.194+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3181f55d0 con 0x7fe2fc004d50 2024-09-10T23:32:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.194+0000 7fe314c00640 1 -- 172.21.15.17:0/1728721661 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+5239 (secure 0 0 0) 0x7fe30805efa0 con 0x7fe2fc004d50 2024-09-10T23:32:05.199 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:32:05.199 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":175,"btime":"2024-09-10T23:32:04:193424+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:32:04.193419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":224,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":12012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_12012":{"gid":12012,"name":"c","rank":0,"incarnation":172,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2426812353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2426812353},{"type":"v1","addr":"172.21.15.17:6835","nonce":2426812353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":12012,"qdb_cluster":[12012]},"id":16}]} 2024-09-10T23:32:05.199 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 175 2024-09-10T23:32:05.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2f4072610 msgr2=0x7fe2f4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2f4072610 0x7fe2f4074ad0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe3180cc3d0 tx=0x7fe30000d040 comp rx=0 tx=0).stop 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2fc004d50 msgr2=0x7fe3181f7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2fc004d50 0x7fe3181f7830 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7fe308001060 tx=0x7fe3080039d0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 shutdown_connections 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2f4072610 0x7fe2f4074ad0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3180aa3c0 0x7fe318139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe3181f7d70 0x7fe3180a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 --2- 172.21.15.17:0/1728721661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2fc004d50 0x7fe3181f7830 unknown :-1 s=CLOSED pgs=2608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 >> 172.21.15.17:0/1728721661 conn(0x7fe3180d0ae0 msgr2=0x7fe3181433b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 shutdown_connections 2024-09-10T23:32:05.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.198+0000 7fe31d400640 1 -- 172.21.15.17:0/1728721661 wait complete. 2024-09-10T23:32:05.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 175, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:31:49.429993+0000', 'modified': '2024-09-10T23:32:04.193419+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 224, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 12012}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_12012': {'gid': 12012, 'name': 'c', 'rank': 0, 'incarnation': 172, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.17:6835/2426812353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 2426812353}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2426812353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 12012, 'qdb_cluster': [12012]} 2024-09-10T23:32:05.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:32:05.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:32:05.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 -- 172.21.15.17:0/2564047288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f201c0745e0 msgr2=0x7f201c15b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 --2- 172.21.15.17:0/2564047288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f201c0745e0 0x7f201c15b2f0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7f201c073c90 tx=0x7f200c01c8c0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 -- 172.21.15.17:0/2564047288 shutdown_connections 2024-09-10T23:32:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 --2- 172.21.15.17:0/2564047288 >> v2:172.21.15.77:3300/0 conn(0x7f201c0cfb00 0x7f201c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 --2- 172.21.15.17:0/2564047288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f201c0745e0 0x7f201c15b2f0 unknown :-1 s=CLOSED pgs=2609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 -- 172.21.15.17:0/2564047288 >> 172.21.15.17:0/2564047288 conn(0x7f201c0b1850 msgr2=0x7f201c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 -- 172.21.15.17:0/2564047288 shutdown_connections 2024-09-10T23:32:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 -- 172.21.15.17:0/2564047288 wait complete. 2024-09-10T23:32:05.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 Processor -- start 2024-09-10T23:32:05.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.774+0000 7f2022c00640 1 -- start start 2024-09-10T23:32:05.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2022c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f201c0745e0 0x7f201c14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2022c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f201c0cfb00 0x7f201c14fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2022c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f201c15e870 0x7f201c13b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2022c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f201c168520 con 0x7f201c15e870 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2022c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f201c06f490 con 0x7f201c0745e0 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2022c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f201c1686a0 con 0x7f201c0cfb00 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f201be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f201c0745e0 0x7f201c14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f201be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f201c0745e0 0x7f201c14f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:55332/0 (socket says 172.21.15.17:55332) 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f201be00640 1 -- 172.21.15.17:0/4044364326 learned_addr learned my addr 172.21.15.17:0/4044364326 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2020c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f201c15e870 0x7f201c13b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2013400640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f201c0cfb00 0x7f201c14fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f201be00640 1 -- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f201c0cfb00 msgr2=0x7f201c14fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f201be00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f201c0cfb00 0x7f201c14fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f201be00640 1 -- 172.21.15.17:0/4044364326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f201c15e870 msgr2=0x7f201c13b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f201be00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f201c15e870 0x7f201c13b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f201be00640 1 -- 172.21.15.17:0/4044364326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c1f9480 con 0x7f201c0745e0 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2020c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f201c15e870 0x7f201c13b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f201be00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f201c0745e0 0x7f201c14f010 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f200c0b0040 tx=0x7f200c004220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2018c00640 1 -- 172.21.15.17:0/4044364326 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0b2040 con 0x7f201c0745e0 2024-09-10T23:32:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2018c00640 1 -- 172.21.15.17:0/4044364326 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f200c005160 con 0x7f201c0745e0 2024-09-10T23:32:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2018c00640 1 -- 172.21.15.17:0/4044364326 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0055b0 con 0x7f201c0745e0 2024-09-10T23:32:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2022c00640 1 -- 172.21.15.17:0/4044364326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c1f9760 con 0x7f201c0745e0 2024-09-10T23:32:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.778+0000 7f2022c00640 1 -- 172.21.15.17:0/4044364326 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c1f9d20 con 0x7f201c0745e0 2024-09-10T23:32:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2018c00640 1 -- 172.21.15.17:0/4044364326 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f200c0046d0 con 0x7f201c0745e0 2024-09-10T23:32:05.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2025f6f000 1 Processor -- start 2024-09-10T23:32:05.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2018c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ff80725e0 0x7f1ff8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2025f6f000 1 -- start start 2024-09-10T23:32:05.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2018c00640 1 -- 172.21.15.17:0/4044364326 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f200c12c750 con 0x7f201c0745e0 2024-09-10T23:32:05.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2020c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ff80725e0 0x7f1ff8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4f5dc0 0x55905d4f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f66e0 0x55905d4a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4aa220 0x55905d4aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2025f6f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55905d3c63f0 con 0x55905d4f66e0 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2025f6f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55905d303b20 con 0x55905d4aa220 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2025f6f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55905d2f2f50 con 0x55905d4f5dc0 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2013400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f66e0 0x55905d4a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2013400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f66e0 0x55905d4a9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46598/0 (socket says 172.21.15.17:46598) 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2013400640 1 -- 172.21.15.17:0/2502863971 learned_addr learned my addr 172.21.15.17:0/2502863971 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f201be00640 1 --2- 172.21.15.17:0/2502863971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4f5dc0 0x55905d4f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2020c00640 1 --2- 172.21.15.17:0/2502863971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4aa220 0x55905d4aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2020c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ff80725e0 0x7f1ff8074aa0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f2014005fd0 tx=0x7f2014007540 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2013400640 1 -- 172.21.15.17:0/2502863971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4f5dc0 msgr2=0x55905d4f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2013400640 1 --2- 172.21.15.17:0/2502863971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4f5dc0 0x55905d4f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2013400640 1 -- 172.21.15.17:0/2502863971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4aa220 msgr2=0x55905d4aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2013400640 1 --2- 172.21.15.17:0/2502863971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4aa220 0x55905d4aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2013400640 1 -- 172.21.15.17:0/2502863971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905d2ba590 con 0x55905d4f66e0 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2013400640 1 --2- 172.21.15.17:0/2502863971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f66e0 0x55905d4a9ce0 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7f2004009930 tx=0x7f2004009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e56b6cac49c2f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2010c00640 1 -- 172.21.15.17:0/2502863971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004017070 con 0x55905d4f66e0 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2010c00640 1 -- 172.21.15.17:0/2502863971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f200400eb70 con 0x55905d4f66e0 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.782+0000 7f2010c00640 1 -- 172.21.15.17:0/2502863971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004004020 con 0x55905d4f66e0 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- 172.21.15.17:0/2502863971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f66e0 msgr2=0x55905d4a9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 --2- 172.21.15.17:0/2502863971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f66e0 0x55905d4a9ce0 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7f2004009930 tx=0x7f2004009df0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- 172.21.15.17:0/2502863971 shutdown_connections 2024-09-10T23:32:05.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 --2- 172.21.15.17:0/2502863971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4aa220 0x55905d4aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 --2- 172.21.15.17:0/2502863971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f66e0 0x55905d4a9ce0 unknown :-1 s=CLOSED pgs=2610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 --2- 172.21.15.17:0/2502863971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4f5dc0 0x55905d4f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- 172.21.15.17:0/2502863971 >> 172.21.15.17:0/2502863971 conn(0x55905d38f130 msgr2=0x55905d4d4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- 172.21.15.17:0/2502863971 shutdown_connections 2024-09-10T23:32:05.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- 172.21.15.17:0/2502863971 wait complete. 2024-09-10T23:32:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- start start 2024-09-10T23:32:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 Processor -- start 2024-09-10T23:32:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4aa220 0x55905d4e0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f5dc0 0x55905d4e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4f66e0 0x55905d4e0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55905d28d5d0 con 0x55905d4f5dc0 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55905d2f6d60 con 0x55905d4f66e0 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55905d299500 con 0x55905d4aa220 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 10 client.0 _ll_register_callbacks cb 0x55905d29d810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2013400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f5dc0 0x55905d4e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2013400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f5dc0 0x55905d4e08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46614/0 (socket says 172.21.15.17:46614) 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2013400640 1 -- 172.21.15.17:0/1035760515 learned_addr learned my addr 172.21.15.17:0/1035760515 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f201be00640 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4aa220 0x55905d4e0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2020c00640 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4f66e0 0x55905d4e0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2013400640 1 -- 172.21.15.17:0/1035760515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4aa220 msgr2=0x55905d4e0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2013400640 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4aa220 0x55905d4e0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2013400640 1 -- 172.21.15.17:0/1035760515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4f66e0 msgr2=0x55905d4e0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2013400640 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4f66e0 0x55905d4e0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2013400640 1 -- 172.21.15.17:0/1035760515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905d291170 con 0x55905d4f5dc0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2013400640 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f5dc0 0x55905d4e08a0 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x7f200400e5a0 tx=0x7f200400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86042c6ce0290f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2009600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2009600640 1 -- 172.21.15.17:0/1035760515 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004017070 con 0x55905d4f5dc0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2009600640 1 -- 172.21.15.17:0/1035760515 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f2004025cd0 con 0x55905d4f5dc0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- 172.21.15.17:0/1035760515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55905d28b0f0 con 0x55905d4f5dc0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2009600640 1 -- 172.21.15.17:0/1035760515 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f200402c050 con 0x55905d4f5dc0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 10 client.12069 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.786+0000 7f2025f6f000 1 -- 172.21.15.17:0/1035760515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55905d377ef0 con 0x55905d4f5dc0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2009600640 1 -- 172.21.15.17:0/1035760515 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55905d28b0f0 con 0x55905d4f5dc0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2009600640 1 -- 172.21.15.17:0/1035760515 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f200402f020 con 0x55905d4f5dc0 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 10 client.12069 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:05.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 10 client.12069 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 20 client.12069 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55905d4e17f0 0x55905d507070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 4 client.12069 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 -- 172.21.15.17:0/1035760515 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55905d305a70 con 0x55905d4e17f0 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f201be00640 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55905d4e17f0 0x55905d507070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f201be00640 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55905d4e17f0 0x55905d507070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db4fa221a4ffb547 server_cookie=14e49f220784bce9 in_seq=0 out_seq=0 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2009600640 10 client.12069 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2009600640 1 -- 172.21.15.17:0/1035760515 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55905d305a70 con 0x55905d4e17f0 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2009600640 10 client.12069 handle_command_reply: tid=0 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 client.12069 shutdown 2024-09-10T23:32:05.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 -- 172.21.15.17:0/1035760515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f5dc0 msgr2=0x55905d4e08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f5dc0 0x55905d4e08a0 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x7f200400e5a0 tx=0x7f200400ecb0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 -- 172.21.15.17:0/1035760515 shutdown_connections 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55905d4e17f0 0x55905d507070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4f66e0 0x55905d4e0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4f5dc0 0x55905d4e08a0 unknown :-1 s=CLOSED pgs=2611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1035760515 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4aa220 0x55905d4e0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2009600640 0 client.12069 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 -- 172.21.15.17:0/1035760515 >> 172.21.15.17:0/1035760515 conn(0x55905d38f130 msgr2=0x55905d4a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 -- 172.21.15.17:0/1035760515 shutdown_connections 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 1 -- 172.21.15.17:0/1035760515 wait complete. 2024-09-10T23:32:05.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.790+0000 7f2025f6f000 20 client.12069 trim_cache size 0 max 16384 2024-09-10T23:32:05.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 Processor -- start 2024-09-10T23:32:05.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 -- start start 2024-09-10T23:32:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4adef0 0x55905d507070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d38f130 0x55905d5075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4aa220 0x55905d507af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55905d2fb390 con 0x55905d4aa220 2024-09-10T23:32:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55905d28d5d0 con 0x55905d4adef0 2024-09-10T23:32:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55905d377a60 con 0x55905d38f130 2024-09-10T23:32:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2020c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4aa220 0x55905d507af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2020c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4aa220 0x55905d507af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46620/0 (socket says 172.21.15.17:46620) 2024-09-10T23:32:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2020c00640 1 -- 172.21.15.17:0/1831847894 learned_addr learned my addr 172.21.15.17:0/1831847894 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2020c00640 1 -- 172.21.15.17:0/1831847894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d38f130 msgr2=0x55905d5075b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:05.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2020c00640 1 --2- 172.21.15.17:0/1831847894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d38f130 0x55905d5075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2020c00640 1 -- 172.21.15.17:0/1831847894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4adef0 msgr2=0x55905d507070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2020c00640 1 --2- 172.21.15.17:0/1831847894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4adef0 0x55905d507070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2020c00640 1 -- 172.21.15.17:0/1831847894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905d34ed90 con 0x55905d4aa220 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2020c00640 1 --2- 172.21.15.17:0/1831847894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4aa220 0x55905d507af0 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f201400da20 tx=0x7f2014012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3992989128734cea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f200be00640 1 -- 172.21.15.17:0/1831847894 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201401fd50 con 0x55905d4aa220 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f200be00640 1 -- 172.21.15.17:0/1831847894 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2014028440 con 0x55905d4aa220 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f200be00640 1 -- 172.21.15.17:0/1831847894 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014028830 con 0x55905d4aa220 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 -- 172.21.15.17:0/1831847894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4aa220 msgr2=0x55905d507af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1831847894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4aa220 0x55905d507af0 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f201400da20 tx=0x7f2014012000 comp rx=0 tx=0).stop 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 -- 172.21.15.17:0/1831847894 shutdown_connections 2024-09-10T23:32:05.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1831847894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d4aa220 0x55905d507af0 unknown :-1 s=CLOSED pgs=2612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1831847894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d38f130 0x55905d5075b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1831847894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4adef0 0x55905d507070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 -- 172.21.15.17:0/1831847894 >> 172.21.15.17:0/1831847894 conn(0x55905d4a4410 msgr2=0x55905d4e1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.810+0000 7f2025f6f000 1 -- 172.21.15.17:0/1831847894 shutdown_connections 2024-09-10T23:32:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 -- 172.21.15.17:0/1831847894 wait complete. 2024-09-10T23:32:05.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 -- start start 2024-09-10T23:32:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 Processor -- start 2024-09-10T23:32:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d38f130 0x55905d509d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4aa220 0x55905d50a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4adef0 0x55905d5295a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55905d3b2730 con 0x55905d38f130 2024-09-10T23:32:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55905d2f6070 con 0x55905d4aa220 2024-09-10T23:32:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55905d3028f0 con 0x55905d4adef0 2024-09-10T23:32:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 10 client.0 _ll_register_callbacks cb 0x7f200c005b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:05.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f201be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d38f130 0x55905d509d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f201be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d38f130 0x55905d509d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46628/0 (socket says 172.21.15.17:46628) 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f201be00640 1 -- 172.21.15.17:0/1341170420 learned_addr learned my addr 172.21.15.17:0/1341170420 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f201be00640 1 -- 172.21.15.17:0/1341170420 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4adef0 msgr2=0x55905d5295a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f201be00640 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4adef0 0x55905d5295a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f201be00640 1 -- 172.21.15.17:0/1341170420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4aa220 msgr2=0x55905d50a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f201be00640 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4aa220 0x55905d50a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f201be00640 1 -- 172.21.15.17:0/1341170420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905d2b9a90 con 0x55905d38f130 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f201be00640 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d38f130 0x55905d509d20 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f200c12aa90 tx=0x7f200c100440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73b0e818f812ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2009600640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2009600640 1 -- 172.21.15.17:0/1341170420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c12ae60 con 0x55905d38f130 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2009600640 1 -- 172.21.15.17:0/1341170420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f200c0f3860 con 0x55905d38f130 2024-09-10T23:32:05.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 -- 172.21.15.17:0/1341170420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2014028440 con 0x55905d38f130 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2009600640 1 -- 172.21.15.17:0/1341170420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f200c12a050 con 0x55905d38f130 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 10 client.12075 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 -- 172.21.15.17:0/1341170420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55905d298050 con 0x55905d38f130 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2009600640 1 -- 172.21.15.17:0/1341170420 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2014028440 con 0x55905d38f130 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2009600640 1 -- 172.21.15.17:0/1341170420 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f200c1005b0 con 0x55905d38f130 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 10 client.12075 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 10 client.12075 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 20 client.12075 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55905d4f5dc0 0x55905d529f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 4 client.12075 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2025f6f000 1 -- 172.21.15.17:0/1341170420 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "status"}) -- 0x55905d301520 con 0x55905d4f5dc0 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.814+0000 7f2013400640 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55905d4f5dc0 0x55905d529f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2013400640 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55905d4f5dc0 0x55905d529f60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cf4ee2134a96022 server_cookie=d22904a3bd3eab78 in_seq=0 out_seq=0 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2009600640 10 client.12075 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2009600640 1 -- 172.21.15.17:0/1341170420 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55905d301520 con 0x55905d4f5dc0 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2009600640 10 client.12075 handle_command_reply: tid=0 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 client.12075 shutdown 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 -- 172.21.15.17:0/1341170420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d38f130 msgr2=0x55905d509d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d38f130 0x55905d509d20 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f200c12aa90 tx=0x7f200c100440 comp rx=0 tx=0).stop 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 -- 172.21.15.17:0/1341170420 shutdown_connections 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55905d4f5dc0 0x55905d529f60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55905d4adef0 0x55905d5295a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55905d4aa220 0x55905d50a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2009600640 0 client.12075 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 --2- 172.21.15.17:0/1341170420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55905d38f130 0x55905d509d20 unknown :-1 s=CLOSED pgs=2613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 -- 172.21.15.17:0/1341170420 >> 172.21.15.17:0/1341170420 conn(0x55905d4a4410 msgr2=0x55905d4e23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 -- 172.21.15.17:0/1341170420 shutdown_connections 2024-09-10T23:32:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 1 -- 172.21.15.17:0/1341170420 wait complete. 2024-09-10T23:32:05.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2025f6f000 20 client.12075 trim_cache size 0 max 16384 2024-09-10T23:32:05.825 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:32:05.825 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:32:05.825 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:32:05.825 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 12012, 2024-09-10T23:32:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:32:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:32:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:32:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 4.6322814770000003, 2024-09-10T23:32:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 175, 2024-09-10T23:32:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 224, 2024-09-10T23:32:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 224, 2024-09-10T23:32:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 5.5784405890000004 2024-09-10T23:32:05.826 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 -- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ff80725e0 msgr2=0x7f1ff8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ff80725e0 0x7f1ff8074aa0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f2014005fd0 tx=0x7f2014007540 comp rx=0 tx=0).stop 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 -- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f201c0745e0 msgr2=0x7f201c14f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f201c0745e0 0x7f201c14f010 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f200c0b0040 tx=0x7f200c004220 comp rx=0 tx=0).stop 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 -- 172.21.15.17:0/4044364326 shutdown_connections 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1ff80725e0 0x7f1ff8074aa0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f201c15e870 0x7f201c13b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f201c0cfb00 0x7f201c14fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 --2- 172.21.15.17:0/4044364326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f201c0745e0 0x7f201c14f010 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 -- 172.21.15.17:0/4044364326 >> 172.21.15.17:0/4044364326 conn(0x7f201c0b1850 msgr2=0x7f201c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 -- 172.21.15.17:0/4044364326 shutdown_connections 2024-09-10T23:32:05.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.818+0000 7f2022c00640 1 -- 172.21.15.17:0/4044364326 wait complete. 2024-09-10T23:32:05.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:32:05.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub start / recursive,repair 2024-09-10T23:32:05.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.986+0000 7fb8c1600640 1 -- 172.21.15.17:0/3077271188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8bc15f3c0 msgr2=0x7fb8bc0cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.986+0000 7fb8c1600640 1 --2- 172.21.15.17:0/3077271188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8bc15f3c0 0x7fb8bc0cfcf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009840 tx=0x7fb8ac01c740 comp rx=0 tx=0).stop 2024-09-10T23:32:05.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 -- 172.21.15.17:0/3077271188 shutdown_connections 2024-09-10T23:32:05.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 --2- 172.21.15.17:0/3077271188 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8bc0d0900 0x7fb8bc0d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 --2- 172.21.15.17:0/3077271188 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8bc15f3c0 0x7fb8bc0cfcf0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 -- 172.21.15.17:0/3077271188 >> 172.21.15.17:0/3077271188 conn(0x7fb8bc0d1cf0 msgr2=0x7fb8bc0d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:05.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 -- 172.21.15.17:0/3077271188 shutdown_connections 2024-09-10T23:32:05.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 -- 172.21.15.17:0/3077271188 wait complete. 2024-09-10T23:32:05.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 Processor -- start 2024-09-10T23:32:05.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 -- start start 2024-09-10T23:32:05.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8bc0d0900 0x7fb8bc1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8bc15f3c0 0x7fb8bc15c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8bc15f7a0 0x7fb8bc15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1694b0 con 0x7fb8bc15f7a0 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc169330 con 0x7fb8bc15f3c0 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8c1600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc169630 con 0x7fb8bc0d0900 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8bc15f7a0 0x7fb8bc15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8bc15f7a0 0x7fb8bc15cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46634/0 (socket says 172.21.15.17:46634) 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8bb400640 1 -- 172.21.15.17:0/479783712 learned_addr learned my addr 172.21.15.17:0/479783712 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8baa00640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8bc0d0900 0x7fb8bc1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8b2000640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8bc15f3c0 0x7fb8bc15c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8bb400640 1 -- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8bc0d0900 msgr2=0x7fb8bc1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8bb400640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8bc0d0900 0x7fb8bc1518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8bb400640 1 -- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8bc15f3c0 msgr2=0x7fb8bc15c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8bb400640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8bc15f3c0 0x7fb8bc15c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8bb400640 1 -- 172.21.15.17:0/479783712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc0b6d90 con 0x7fb8bc15f7a0 2024-09-10T23:32:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8bb400640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8bc15f7a0 0x7fb8bc15cde0 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400cbb0 tx=0x7fb8b400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8b3400640 1 -- 172.21.15.17:0/479783712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4016020 con 0x7fb8bc15f7a0 2024-09-10T23:32:05.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.990+0000 7fb8b3400640 1 -- 172.21.15.17:0/479783712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8b400ab00 con 0x7fb8bc15f7a0 2024-09-10T23:32:05.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.994+0000 7fb8c1600640 1 -- 172.21.15.17:0/479783712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc1568c0 con 0x7fb8bc15f7a0 2024-09-10T23:32:05.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.994+0000 7fb8b3400640 1 -- 172.21.15.17:0/479783712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4012420 con 0x7fb8bc15f7a0 2024-09-10T23:32:05.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.994+0000 7fb8c1600640 1 -- 172.21.15.17:0/479783712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8bc156e80 con 0x7fb8bc15f7a0 2024-09-10T23:32:05.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.994+0000 7fb8b3400640 1 -- 172.21.15.17:0/479783712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb8b401b400 con 0x7fb8bc15f7a0 2024-09-10T23:32:05.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.994+0000 7fb8b3400640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8980725e0 0x7fb898074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:05.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.994+0000 7fb8b3400640 1 -- 172.21.15.17:0/479783712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7fb8b4093a80 con 0x7fb8bc15f7a0 2024-09-10T23:32:05.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.994+0000 7fb8c4913000 1 Processor -- start 2024-09-10T23:32:05.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.994+0000 7fb8c4913000 1 -- start start 2024-09-10T23:32:05.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.994+0000 7fb8baa00640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8980725e0 0x7fb898074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 0x564a8e4a0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e4561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e456730 0x564a8e456b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564a8e264bb0 con 0x564a8e456730 2024-09-10T23:32:06.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564a8e255410 con 0x564a8e49fc50 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564a8e2b2cc0 con 0x564a8e4a0570 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8baa00640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8980725e0 0x7fb898074aa0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0af000 tx=0x7fb8ac01af80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e456730 0x564a8e456b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8baa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 0x564a8e4a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e456730 0x564a8e456b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46648/0 (socket says 172.21.15.17:46648) 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8bb400640 1 -- 172.21.15.17:0/1730354807 learned_addr learned my addr 172.21.15.17:0/1730354807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8b2000640 1 --2- 172.21.15.17:0/1730354807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e4561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8bb400640 1 -- 172.21.15.17:0/1730354807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 msgr2=0x564a8e4561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8bb400640 1 --2- 172.21.15.17:0/1730354807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e4561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8bb400640 1 -- 172.21.15.17:0/1730354807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 msgr2=0x564a8e4a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8bb400640 1 --2- 172.21.15.17:0/1730354807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 0x564a8e4a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8bb400640 1 -- 172.21.15.17:0/1730354807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8e256d60 con 0x564a8e456730 2024-09-10T23:32:06.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8b2000640 1 --2- 172.21.15.17:0/1730354807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e4561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:06.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8bb400640 1 --2- 172.21.15.17:0/1730354807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e456730 0x564a8e456b10 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400a430 tx=0x7fb8b405e380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9675af2db6e64cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8ab400640 1 -- 172.21.15.17:0/1730354807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4063350 con 0x564a8e456730 2024-09-10T23:32:06.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8ab400640 1 -- 172.21.15.17:0/1730354807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8b4067d70 con 0x564a8e456730 2024-09-10T23:32:06.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8ab400640 1 -- 172.21.15.17:0/1730354807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b405fdc0 con 0x564a8e456730 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 -- 172.21.15.17:0/1730354807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e456730 msgr2=0x564a8e456b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 --2- 172.21.15.17:0/1730354807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e456730 0x564a8e456b10 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400a430 tx=0x7fb8b405e380 comp rx=0 tx=0).stop 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 -- 172.21.15.17:0/1730354807 shutdown_connections 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 --2- 172.21.15.17:0/1730354807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e456730 0x564a8e456b10 unknown :-1 s=CLOSED pgs=2616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 --2- 172.21.15.17:0/1730354807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e4561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 --2- 172.21.15.17:0/1730354807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 0x564a8e4a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 -- 172.21.15.17:0/1730354807 >> 172.21.15.17:0/1730354807 conn(0x564a8e4526e0 msgr2=0x564a8e454ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 -- 172.21.15.17:0/1730354807 shutdown_connections 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 -- 172.21.15.17:0/1730354807 wait complete. 2024-09-10T23:32:06.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 -- start start 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:05.998+0000 7fb8c4913000 1 Processor -- start 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 0x564a8e49f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e49fc50 0x564a8e461a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e461f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564a8e2a5f00 con 0x564a8e4a0570 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564a8e2a20f0 con 0x564a8e456730 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564a8e2476b0 con 0x564a8e49fc50 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 10 client.0 _ll_register_callbacks cb 0x564a8e246310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e461f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e461f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46660/0 (socket says 172.21.15.17:46660) 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8bb400640 1 -- 172.21.15.17:0/3747239291 learned_addr learned my addr 172.21.15.17:0/3747239291 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8baa00640 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 0x564a8e49f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8b2000640 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e49fc50 0x564a8e461a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8bb400640 1 -- 172.21.15.17:0/3747239291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e49fc50 msgr2=0x564a8e461a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8bb400640 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e49fc50 0x564a8e461a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8bb400640 1 -- 172.21.15.17:0/3747239291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 msgr2=0x564a8e49f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8bb400640 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 0x564a8e49f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8bb400640 1 -- 172.21.15.17:0/3747239291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8e2402f0 con 0x564a8e4a0570 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8bb400640 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e461f90 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7fb8b405e800 tx=0x7fb8b405ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f24cad0d46cfb9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb89fe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb89fe00640 1 -- 172.21.15.17:0/3747239291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b408f060 con 0x564a8e4a0570 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 -- 172.21.15.17:0/3747239291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a8e23a430 con 0x564a8e4a0570 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb89fe00640 1 -- 172.21.15.17:0/3747239291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7fb8b405dad0 con 0x564a8e4a0570 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb89fe00640 1 -- 172.21.15.17:0/3747239291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7fb8b4063100 con 0x564a8e4a0570 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 10 client.12087 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:06.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 -- 172.21.15.17:0/3747239291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x564a8e25df40 con 0x564a8e4a0570 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb89fe00640 1 -- 172.21.15.17:0/3747239291 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564a8e23a430 con 0x564a8e4a0570 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb89fe00640 1 -- 172.21.15.17:0/3747239291 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7fb8b4018b10 con 0x564a8e4a0570 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 10 client.12087 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 10 client.12087 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 20 client.12087 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x564a8e462cd0 0x564a8e4b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 4 client.12087 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8c4913000 1 -- 172.21.15.17:0/3747239291 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a8e2b4c10 con 0x564a8e462cd0 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8baa00640 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x564a8e462cd0 0x564a8e4b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb8baa00640 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x564a8e462cd0 0x564a8e4b1f10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b08ef308afb25c40 server_cookie=837998483a152f37 in_seq=0 out_seq=0 2024-09-10T23:32:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb89fe00640 10 client.12087 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb89fe00640 1 -- 172.21.15.17:0/3747239291 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a8e2b4c10 con 0x564a8e462cd0 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.002+0000 7fb89fe00640 10 client.12087 handle_command_reply: tid=0 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 client.12087 shutdown 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 -- 172.21.15.17:0/3747239291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 msgr2=0x564a8e461f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e461f90 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7fb8b405e800 tx=0x7fb8b405ad90 comp rx=0 tx=0).stop 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 -- 172.21.15.17:0/3747239291 shutdown_connections 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x564a8e462cd0 0x564a8e4b1f10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e461f90 unknown :-1 s=CLOSED pgs=2617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e49fc50 0x564a8e461a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3747239291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 0x564a8e49f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb89fe00640 0 client.12087 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 -- 172.21.15.17:0/3747239291 >> 172.21.15.17:0/3747239291 conn(0x564a8e4526e0 msgr2=0x564a8e4552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 -- 172.21.15.17:0/3747239291 shutdown_connections 2024-09-10T23:32:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 1 -- 172.21.15.17:0/3747239291 wait complete. 2024-09-10T23:32:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.006+0000 7fb8c4913000 20 client.12087 trim_cache size 0 max 16384 2024-09-10T23:32:06.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.022+0000 7fb8c4913000 1 Processor -- start 2024-09-10T23:32:06.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.022+0000 7fb8c4913000 1 -- start start 2024-09-10T23:32:06.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e456730 0x564a8e4b5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 0x564a8e4b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e455ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x564a8e45bcf0 con 0x564a8e4a0570 2024-09-10T23:32:06.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc204f30 con 0x564a8e49fc50 2024-09-10T23:32:06.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc203f90 con 0x564a8e456730 2024-09-10T23:32:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e455ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8bb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e455ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46674/0 (socket says 172.21.15.17:46674) 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8bb400640 1 -- 172.21.15.17:0/1135386684 learned_addr learned my addr 172.21.15.17:0/1135386684 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8baa00640 1 --2- 172.21.15.17:0/1135386684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e456730 0x564a8e4b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8b2000640 1 --2- 172.21.15.17:0/1135386684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 0x564a8e4b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8bb400640 1 -- 172.21.15.17:0/1135386684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e456730 msgr2=0x564a8e4b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8bb400640 1 --2- 172.21.15.17:0/1135386684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e456730 0x564a8e4b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8bb400640 1 -- 172.21.15.17:0/1135386684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 msgr2=0x564a8e4b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8bb400640 1 --2- 172.21.15.17:0/1135386684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 0x564a8e4b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8bb400640 1 -- 172.21.15.17:0/1135386684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8e326f10 con 0x564a8e4a0570 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8bb400640 1 --2- 172.21.15.17:0/1135386684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e455ae0 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40632c0 tx=0x7fb8b405acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33d47886b54f020 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8aaa00640 1 -- 172.21.15.17:0/1135386684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b407d070 con 0x564a8e4a0570 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8aaa00640 1 -- 172.21.15.17:0/1135386684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8b4067d70 con 0x564a8e4a0570 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8aaa00640 1 -- 172.21.15.17:0/1135386684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b405dd10 con 0x564a8e4a0570 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 -- 172.21.15.17:0/1135386684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 msgr2=0x564a8e455ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 --2- 172.21.15.17:0/1135386684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e455ae0 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40632c0 tx=0x7fb8b405acf0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 -- 172.21.15.17:0/1135386684 shutdown_connections 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 --2- 172.21.15.17:0/1135386684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e4a0570 0x564a8e455ae0 unknown :-1 s=CLOSED pgs=2618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 --2- 172.21.15.17:0/1135386684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e49fc50 0x564a8e4b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 --2- 172.21.15.17:0/1135386684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e456730 0x564a8e4b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 -- 172.21.15.17:0/1135386684 >> 172.21.15.17:0/1135386684 conn(0x564a8e4526e0 msgr2=0x564a8e4b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 -- 172.21.15.17:0/1135386684 shutdown_connections 2024-09-10T23:32:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 -- 172.21.15.17:0/1135386684 wait complete. 2024-09-10T23:32:06.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 -- start start 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.026+0000 7fb8c4913000 1 Processor -- start 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 0x564a8e516a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e49fc50 0x564a8e516fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e5174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc203940 con 0x564a8e49fc50 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc164e90 con 0x564a8e456730 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x564a8df678d0 con 0x564a8e4a0570 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 10 client.0 _ll_register_callbacks cb 0x7fb8b4063050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8b2000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e49fc50 0x564a8e516fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8baa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 0x564a8e516a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8b2000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e49fc50 0x564a8e516fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46684/0 (socket says 172.21.15.17:46684) 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8b2000640 1 -- 172.21.15.17:0/3438756697 learned_addr learned my addr 172.21.15.17:0/3438756697 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8bb400640 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e5174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8b2000640 1 -- 172.21.15.17:0/3438756697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 msgr2=0x564a8e5174f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8b2000640 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e5174f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8b2000640 1 -- 172.21.15.17:0/3438756697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 msgr2=0x564a8e516a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8b2000640 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 0x564a8e516a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8b2000640 1 -- 172.21.15.17:0/3438756697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8e2fddb0 con 0x564a8e49fc50 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8bb400640 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e5174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8b2000640 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e49fc50 0x564a8e516fb0 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc074e00 tx=0x7fb8a4012b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7c7ea90ece1deb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb89fe00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb89fe00640 1 -- 172.21.15.17:0/3438756697 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4022060 con 0x564a8e49fc50 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb89fe00640 1 -- 172.21.15.17:0/3438756697 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7fb8a4004250 con 0x564a8e49fc50 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 -- 172.21.15.17:0/3438756697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b4067d70 con 0x564a8e49fc50 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb89fe00640 1 -- 172.21.15.17:0/3438756697 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7fb8a4028050 con 0x564a8e49fc50 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 10 client.12093 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 -- 172.21.15.17:0/3438756697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x564a8e238820 con 0x564a8e49fc50 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb89fe00640 1 -- 172.21.15.17:0/3438756697 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8b4067d70 con 0x564a8e49fc50 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb89fe00640 1 -- 172.21.15.17:0/3438756697 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7fb8a402b020 con 0x564a8e49fc50 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 10 client.12093 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 10 client.12093 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 20 client.12093 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x564a8e4b3e90 0x564a8e4b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 4 client.12093 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 -- 172.21.15.17:0/3438756697 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x564a8e2b06c0 con 0x564a8e4b3e90 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8baa00640 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x564a8e4b3e90 0x564a8e4b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb89fe00640 10 client.12093 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8baa00640 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x564a8e4b3e90 0x564a8e4b42a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13d5e3a4af51510c server_cookie=f5b52d933cb5754f in_seq=0 out_seq=0 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb89fe00640 1 -- 172.21.15.17:0/3438756697 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564a8e2b06c0 con 0x564a8e4b3e90 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb89fe00640 10 client.12093 handle_command_reply: tid=0 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.030+0000 7fb8c4913000 1 client.12093 shutdown 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 -- 172.21.15.17:0/3438756697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e49fc50 msgr2=0x564a8e516fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e49fc50 0x564a8e516fb0 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc074e00 tx=0x7fb8a4012b40 comp rx=0 tx=0).stop 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 -- 172.21.15.17:0/3438756697 shutdown_connections 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x564a8e4b3e90 0x564a8e4b42a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x564a8e4a0570 0x564a8e5174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a8e49fc50 0x564a8e516fb0 unknown :-1 s=CLOSED pgs=2619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 --2- 172.21.15.17:0/3438756697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564a8e456730 0x564a8e516a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 -- 172.21.15.17:0/3438756697 >> 172.21.15.17:0/3438756697 conn(0x564a8e4526e0 msgr2=0x564a8e454ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb89fe00640 0 client.12093 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 -- 172.21.15.17:0/3438756697 shutdown_connections 2024-09-10T23:32:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 1 -- 172.21.15.17:0/3438756697 wait complete. 2024-09-10T23:32:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c4913000 20 client.12093 trim_cache size 0 max 16384 2024-09-10T23:32:06.041 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:32:06.041 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:32:06.041 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "2d178d1a-1c2b-4b3a-bac9-2473baf9bb71", 2024-09-10T23:32:06.041 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:32:06.041 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 -- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8980725e0 msgr2=0x7fb898074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8980725e0 0x7fb898074aa0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0af000 tx=0x7fb8ac01af80 comp rx=0 tx=0).stop 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 -- 172.21.15.17:0/479783712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8bc15f7a0 msgr2=0x7fb8bc15cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8bc15f7a0 0x7fb8bc15cde0 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400cbb0 tx=0x7fb8b400cca0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 -- 172.21.15.17:0/479783712 shutdown_connections 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb8980725e0 0x7fb898074aa0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8bc15f7a0 0x7fb8bc15cde0 unknown :-1 s=CLOSED pgs=2615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8bc15f3c0 0x7fb8bc15c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 --2- 172.21.15.17:0/479783712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb8bc0d0900 0x7fb8bc1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 -- 172.21.15.17:0/479783712 >> 172.21.15.17:0/479783712 conn(0x7fb8bc0d1cf0 msgr2=0x7fb8bc06e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 -- 172.21.15.17:0/479783712 shutdown_connections 2024-09-10T23:32:06.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.034+0000 7fb8c1600640 1 -- 172.21.15.17:0/479783712 wait complete. 2024-09-10T23:32:06.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:32:06.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-10T23:32:06.189 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-09-10T23:32:06.186+0000 7ffb0bc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:32:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 -- 172.21.15.17:0/4230519784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc15d2e0 msgr2=0x7f41dc15cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 --2- 172.21.15.17:0/4230519784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc15d2e0 0x7f41dc15cce0 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0697d0 tx=0x7f41c801c890 comp rx=0 tx=0).stop 2024-09-10T23:32:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 -- 172.21.15.17:0/4230519784 shutdown_connections 2024-09-10T23:32:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 --2- 172.21.15.17:0/4230519784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc15d2e0 0x7f41dc15cce0 unknown :-1 s=CLOSED pgs=2620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 --2- 172.21.15.17:0/4230519784 >> v2:172.21.15.77:3300/0 conn(0x7f41dc15c3c0 0x7f41dc15c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 -- 172.21.15.17:0/4230519784 >> 172.21.15.17:0/4230519784 conn(0x7f41dc0ccd80 msgr2=0x7f41dc0cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 -- 172.21.15.17:0/4230519784 shutdown_connections 2024-09-10T23:32:06.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 -- 172.21.15.17:0/4230519784 wait complete. 2024-09-10T23:32:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 Processor -- start 2024-09-10T23:32:06.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 -- start start 2024-09-10T23:32:06.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc0746d0 0x7f41dc151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41dc15c3c0 0x7f41dc0cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41dc15d2e0 0x7f41dc0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc06d270 con 0x7f41dc0746d0 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc06d0f0 con 0x7f41dc15c3c0 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e3000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc06d3f0 con 0x7f41dc15d2e0 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc0746d0 0x7f41dc151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc0746d0 0x7f41dc151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46700/0 (socket says 172.21.15.17:46700) 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1c00640 1 -- 172.21.15.17:0/375737502 learned_addr learned my addr 172.21.15.17:0/375737502 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1200640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41dc15c3c0 0x7f41dc0cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e2600640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41dc15d2e0 0x7f41dc0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1c00640 1 -- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41dc15d2e0 msgr2=0x7f41dc0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1c00640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41dc15d2e0 0x7f41dc0cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1c00640 1 -- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41dc15c3c0 msgr2=0x7f41dc0cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1c00640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41dc15c3c0 0x7f41dc0cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1c00640 1 -- 172.21.15.17:0/375737502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc1533e0 con 0x7f41dc0746d0 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e2600640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41dc15d2e0 0x7f41dc0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.206+0000 7f41e1c00640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc0746d0 0x7f41dc151b30 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 crypto rx=0x7f41d000e9f0 tx=0x7f41d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41d9600640 1 -- 172.21.15.17:0/375737502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d000cd80 con 0x7f41dc0746d0 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41d9600640 1 -- 172.21.15.17:0/375737502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41d0010430 con 0x7f41dc0746d0 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41d9600640 1 -- 172.21.15.17:0/375737502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0010860 con 0x7f41dc0746d0 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41e3000640 1 -- 172.21.15.17:0/375737502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41dc153680 con 0x7f41dc0746d0 2024-09-10T23:32:06.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41e3000640 1 -- 172.21.15.17:0/375737502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc155d60 con 0x7f41dc0746d0 2024-09-10T23:32:06.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41d9600640 1 -- 172.21.15.17:0/375737502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f41d0010a00 con 0x7f41dc0746d0 2024-09-10T23:32:06.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41d9600640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41bc0725e0 0x7f41bc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41d9600640 1 -- 172.21.15.17:0/375737502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f41d0093f60 con 0x7f41dc0746d0 2024-09-10T23:32:06.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41e7997000 1 Processor -- start 2024-09-10T23:32:06.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41e1200640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41bc0725e0 0x7f41bc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.210+0000 7f41e7997000 1 -- start start 2024-09-10T23:32:06.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e1200640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41bc0725e0 0x7f41bc074aa0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f41c80af000 tx=0x7f41c801b0d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x5636207f7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f7ac0 0x5636207ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x563620695cb0 con 0x5636207adbc0 2024-09-10T23:32:06.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5636205ab310 con 0x5636207f7ac0 2024-09-10T23:32:06.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x563620608b90 con 0x5636207f71a0 2024-09-10T23:32:06.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46706/0 (socket says 172.21.15.17:46706) 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e2600640 1 -- 172.21.15.17:0/1985291206 learned_addr learned my addr 172.21.15.17:0/1985291206 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e1200640 1 --2- 172.21.15.17:0/1985291206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f7ac0 0x5636207ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e1c00640 1 --2- 172.21.15.17:0/1985291206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x5636207f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e2600640 1 -- 172.21.15.17:0/1985291206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 msgr2=0x5636207f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e2600640 1 --2- 172.21.15.17:0/1985291206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x5636207f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e2600640 1 -- 172.21.15.17:0/1985291206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f7ac0 msgr2=0x5636207ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e2600640 1 --2- 172.21.15.17:0/1985291206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f7ac0 0x5636207ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e2600640 1 -- 172.21.15.17:0/1985291206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636205acc60 con 0x5636207adbc0 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e2600640 1 --2- 172.21.15.17:0/1985291206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207adfa0 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f41d4001cc0 tx=0x7f41d4002180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e3d5a1d22e6582 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41ce000640 1 -- 172.21.15.17:0/1985291206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4019070 con 0x5636207adbc0 2024-09-10T23:32:06.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41ce000640 1 -- 172.21.15.17:0/1985291206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41d4003b90 con 0x5636207adbc0 2024-09-10T23:32:06.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41ce000640 1 -- 172.21.15.17:0/1985291206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d400e8a0 con 0x5636207adbc0 2024-09-10T23:32:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 -- 172.21.15.17:0/1985291206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 msgr2=0x5636207adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 --2- 172.21.15.17:0/1985291206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207adfa0 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f41d4001cc0 tx=0x7f41d4002180 comp rx=0 tx=0).stop 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 -- 172.21.15.17:0/1985291206 shutdown_connections 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 --2- 172.21.15.17:0/1985291206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207adfa0 unknown :-1 s=CLOSED pgs=2622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 --2- 172.21.15.17:0/1985291206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f7ac0 0x5636207ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 --2- 172.21.15.17:0/1985291206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x5636207f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 -- 172.21.15.17:0/1985291206 >> 172.21.15.17:0/1985291206 conn(0x5636207b3d20 msgr2=0x5636207abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 -- 172.21.15.17:0/1985291206 shutdown_connections 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 -- 172.21.15.17:0/1985291206 wait complete. 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 -- start start 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.214+0000 7f41e7997000 1 Processor -- start 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207fe530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f71a0 0x5636207fea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f7ac0 0x5636207fefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5636205fbdd0 con 0x5636207adbc0 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5636205f7fc0 con 0x5636207f71a0 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x56362059d4b0 con 0x5636207f7ac0 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 10 client.0 _ll_register_callbacks cb 0x56362057b7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207fe530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207fe530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46708/0 (socket says 172.21.15.17:46708) 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1c00640 1 -- 172.21.15.17:0/105092578 learned_addr learned my addr 172.21.15.17:0/105092578 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1200640 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f71a0 0x5636207fea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e2600640 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f7ac0 0x5636207fefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1c00640 1 -- 172.21.15.17:0/105092578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f7ac0 msgr2=0x5636207fefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1c00640 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f7ac0 0x5636207fefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1c00640 1 -- 172.21.15.17:0/105092578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f71a0 msgr2=0x5636207fea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1c00640 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f71a0 0x5636207fea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1c00640 1 -- 172.21.15.17:0/105092578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636205961f0 con 0x5636207adbc0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e2600640 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f7ac0 0x5636207fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1c00640 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207fe530 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7f41d000e9c0 tx=0x7f41d005eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8df67cba2b3ddbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41c2a00640 1 -- 172.21.15.17:0/105092578 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0068310 con 0x5636207adbc0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41c2a00640 1 -- 172.21.15.17:0/105092578 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f41d005e120 con 0x5636207adbc0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 -- 172.21.15.17:0/105092578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563620590330 con 0x5636207adbc0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41c2a00640 1 -- 172.21.15.17:0/105092578 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f41d008a050 con 0x5636207adbc0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 10 client.12105 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 -- 172.21.15.17:0/105092578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x56362057cfa0 con 0x5636207adbc0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41c2a00640 1 -- 172.21.15.17:0/105092578 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563620590330 con 0x5636207adbc0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41c2a00640 1 -- 172.21.15.17:0/105092578 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f41d005a810 con 0x5636207adbc0 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 10 client.12105 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:06.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 10 client.12105 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 20 client.12105 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x563620806900 0x563620808cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 4 client.12105 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 -- 172.21.15.17:0/105092578 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56362060aae0 con 0x563620806900 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1200640 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x563620806900 0x563620808cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e1200640 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x563620806900 0x563620808cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41fdf26d067724cc server_cookie=f33de9b0fe7eebce in_seq=0 out_seq=0 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41c2a00640 10 client.12105 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41c2a00640 1 -- 172.21.15.17:0/105092578 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56362060aae0 con 0x563620806900 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41c2a00640 10 client.12105 handle_command_reply: tid=0 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.218+0000 7f41e7997000 1 client.12105 shutdown 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 -- 172.21.15.17:0/105092578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 msgr2=0x5636207fe530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207fe530 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7f41d000e9c0 tx=0x7f41d005eb10 comp rx=0 tx=0).stop 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 -- 172.21.15.17:0/105092578 shutdown_connections 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x563620806900 0x563620808cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f7ac0 0x5636207fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207f71a0 0x5636207fea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41c2a00640 0 client.12105 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 --2- 172.21.15.17:0/105092578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x5636207fe530 unknown :-1 s=CLOSED pgs=2623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 -- 172.21.15.17:0/105092578 >> 172.21.15.17:0/105092578 conn(0x5636207b3d20 msgr2=0x5636207abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 -- 172.21.15.17:0/105092578 shutdown_connections 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 1 -- 172.21.15.17:0/105092578 wait complete. 2024-09-10T23:32:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.222+0000 7f41e7997000 20 client.12105 trim_cache size 0 max 16384 2024-09-10T23:32:06.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e7997000 1 Processor -- start 2024-09-10T23:32:06.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e7997000 1 -- start start 2024-09-10T23:32:06.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e7997000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207b3d20 0x563620869a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e7997000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207adbc0 0x563620869f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e7997000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x56362086a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e7997000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc2042b0 con 0x5636207b3d20 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e7997000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc203340 con 0x5636207adbc0 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e7997000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc0ae2c0 con 0x5636207f71a0 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207b3d20 0x563620869a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207b3d20 0x563620869a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46714/0 (socket says 172.21.15.17:46714) 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e1c00640 1 -- 172.21.15.17:0/1463557678 learned_addr learned my addr 172.21.15.17:0/1463557678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e1200640 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207adbc0 0x563620869f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.238+0000 7f41e2600640 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x56362086a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 -- 172.21.15.17:0/1463557678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 msgr2=0x56362086a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x56362086a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 -- 172.21.15.17:0/1463557678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207adbc0 msgr2=0x563620869f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207adbc0 0x563620869f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 -- 172.21.15.17:0/1463557678 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563620655660 con 0x5636207b3d20 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e2600640 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x56362086a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207b3d20 0x563620869a30 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f41d005c130 tx=0x7f41d0063a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c6b6ed5d0d2089 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41cd600640 1 -- 172.21.15.17:0/1463557678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d007e070 con 0x5636207b3d20 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41cd600640 1 -- 172.21.15.17:0/1463557678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41d005a810 con 0x5636207b3d20 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41cd600640 1 -- 172.21.15.17:0/1463557678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0086020 con 0x5636207b3d20 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- 172.21.15.17:0/1463557678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207b3d20 msgr2=0x563620869a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207b3d20 0x563620869a30 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f41d005c130 tx=0x7f41d0063a30 comp rx=0 tx=0).stop 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- 172.21.15.17:0/1463557678 shutdown_connections 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x56362086a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207adbc0 0x563620869f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 --2- 172.21.15.17:0/1463557678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207b3d20 0x563620869a30 unknown :-1 s=CLOSED pgs=2624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- 172.21.15.17:0/1463557678 >> 172.21.15.17:0/1463557678 conn(0x5636207aa270 msgr2=0x5636207adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- 172.21.15.17:0/1463557678 shutdown_connections 2024-09-10T23:32:06.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- 172.21.15.17:0/1463557678 wait complete. 2024-09-10T23:32:06.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- start start 2024-09-10T23:32:06.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 Processor -- start 2024-09-10T23:32:06.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x56362086d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207b3d20 0x56362086dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x56362086e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5636205f7fc0 con 0x5636207adbc0 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5636205fbdd0 con 0x5636207b3d20 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5636207b6d40 con 0x5636207f71a0 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 10 client.0 _ll_register_callbacks cb 0x7f41d005e630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x56362086d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x56362086d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46726/0 (socket says 172.21.15.17:46726) 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 -- 172.21.15.17:0/2797253712 learned_addr learned my addr 172.21.15.17:0/2797253712 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 -- 172.21.15.17:0/2797253712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 msgr2=0x56362086e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x56362086e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 -- 172.21.15.17:0/2797253712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207b3d20 msgr2=0x56362086dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207b3d20 0x56362086dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 -- 172.21.15.17:0/2797253712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636205c2090 con 0x5636207adbc0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e1c00640 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x56362086d590 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f41d005ae50 tx=0x7f41d005ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbb3370437084b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41c2a00640 1 -- 172.21.15.17:0/2797253712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0051060 con 0x5636207adbc0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41c2a00640 1 -- 172.21.15.17:0/2797253712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(224..224 src has 1..224) ==== 6187+0+0 (secure 0 0 0) 0x7f41d005e330 con 0x5636207adbc0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.242+0000 7f41e7997000 1 -- 172.21.15.17:0/2797253712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41d005a810 con 0x5636207adbc0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41c2a00640 1 -- 172.21.15.17:0/2797253712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f41d0057050 con 0x5636207adbc0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 10 client.12111 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 -- 172.21.15.17:0/2797253712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x56362058e5f0 con 0x5636207adbc0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41c2a00640 1 -- 172.21.15.17:0/2797253712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41d005a810 con 0x5636207adbc0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41c2a00640 1 -- 172.21.15.17:0/2797253712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f41d005a020 con 0x5636207adbc0 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 10 client.12111 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 10 client.12111 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 20 client.12111 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:06.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5636207f7ac0 0x5636208296c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 4 client.12111 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 -- 172.21.15.17:0/2797253712 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56362080f010 con 0x5636207f7ac0 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e1200640 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5636207f7ac0 0x5636208296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e1200640 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5636207f7ac0 0x5636208296c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e5b3c17161fd67f server_cookie=c1c2b3f224603131 in_seq=0 out_seq=0 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41c2a00640 10 client.12111 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41c2a00640 1 -- 172.21.15.17:0/2797253712 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+571 (crc 0 0 0) 0x56362080f010 con 0x5636207f7ac0 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41c2a00640 10 client.12111 handle_command_reply: tid=0 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 client.12111 shutdown 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 -- 172.21.15.17:0/2797253712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 msgr2=0x56362086d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x56362086d590 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f41d005ae50 tx=0x7f41d005ac70 comp rx=0 tx=0).stop 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 -- 172.21.15.17:0/2797253712 shutdown_connections 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5636207f7ac0 0x5636208296c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5636207f71a0 0x56362086e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5636207b3d20 0x56362086dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41c2a00640 0 client.12111 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 --2- 172.21.15.17:0/2797253712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636207adbc0 0x56362086d590 unknown :-1 s=CLOSED pgs=2625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 -- 172.21.15.17:0/2797253712 >> 172.21.15.17:0/2797253712 conn(0x5636207aa270 msgr2=0x5636207ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 -- 172.21.15.17:0/2797253712 shutdown_connections 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 1 -- 172.21.15.17:0/2797253712 wait complete. 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e7997000 20 client.12111 trim_cache size 0 max 16384 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:32:06.254 INFO:teuthology.orchestra.run.smithi017.stdout: "2d178d1a-1c2b-4b3a-bac9-2473baf9bb71": { 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "2d178d1a-1c2b-4b3a-bac9-2473baf9bb71", 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,repair" 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "2d178d1a-1c2b-4b3a-bac9-2473baf9bb71": { 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:32:06.030783+0000", 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:32:06.255 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:32:06.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:32:06.256 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:32:06.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 -- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41bc0725e0 msgr2=0x7f41bc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41bc0725e0 0x7f41bc074aa0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f41c80af000 tx=0x7f41c801b0d0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 -- 172.21.15.17:0/375737502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc0746d0 msgr2=0x7f41dc151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc0746d0 0x7f41dc151b30 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 crypto rx=0x7f41d000e9f0 tx=0x7f41d000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 -- 172.21.15.17:0/375737502 shutdown_connections 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f41bc0725e0 0x7f41bc074aa0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41dc15d2e0 0x7f41dc0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41dc15c3c0 0x7f41dc0cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 --2- 172.21.15.17:0/375737502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41dc0746d0 0x7f41dc151b30 unknown :-1 s=CLOSED pgs=2621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 -- 172.21.15.17:0/375737502 >> 172.21.15.17:0/375737502 conn(0x7f41dc0ccd80 msgr2=0x7f41dc0b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 -- 172.21.15.17:0/375737502 shutdown_connections 2024-09-10T23:32:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:06.246+0000 7f41e3000640 1 -- 172.21.15.17:0/375737502 wait complete. 2024-09-10T23:32:06.269 INFO:tasks.cephfs.filesystem:scrub status for tag:2d178d1a-1c2b-4b3a-bac9-2473baf9bb71 - {'path': '/', 'tag': '2d178d1a-1c2b-4b3a-bac9-2473baf9bb71', 'options': 'recursive,repair'} 2024-09-10T23:32:08.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:32:08.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:32:36.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:32:36.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-10T23:32:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.430+0000 7fd6dca00640 1 -- 172.21.15.17:0/3036369626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6bc003a10 msgr2=0x7fd6bc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.430+0000 7fd6dca00640 1 --2- 172.21.15.17:0/3036369626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6bc003a10 0x7fd6bc003e30 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009b60 tx=0x7fd6c801d2b0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.430+0000 7fd6d6800640 1 -- 172.21.15.17:0/3036369626 reap_dead start 2024-09-10T23:32:36.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.430+0000 7fd6dca00640 1 -- 172.21.15.17:0/3036369626 shutdown_connections 2024-09-10T23:32:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.430+0000 7fd6dca00640 1 -- 172.21.15.17:0/3036369626 >> 172.21.15.17:0/3036369626 conn(0x7fd6d80d1de0 msgr2=0x7fd6d80d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.430+0000 7fd6dca00640 1 -- 172.21.15.17:0/3036369626 shutdown_connections 2024-09-10T23:32:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.430+0000 7fd6dca00640 1 -- 172.21.15.17:0/3036369626 wait complete. 2024-09-10T23:32:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.430+0000 7fd6dca00640 1 Processor -- start 2024-09-10T23:32:36.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.430+0000 7fd6dca00640 1 -- start start 2024-09-10T23:32:36.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6dca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6bc003a10 0x7fd6d815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6dca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6d80c6930 0x7fd6d80c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6dca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8150980 0x7fd6d8150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6dca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80cf510 con 0x7fd6bc003a10 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6dca00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80cf390 con 0x7fd6d8150980 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6dca00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d80cf690 con 0x7fd6d80c6930 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6bc003a10 0x7fd6d815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6bc003a10 0x7fd6d815c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44396/0 (socket says 172.21.15.17:44396) 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6cfe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6d80c6930 0x7fd6d80c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d5e00640 1 -- 172.21.15.17:0/1453568984 learned_addr learned my addr 172.21.15.17:0/1453568984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d6800640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8150980 0x7fd6d8150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d5e00640 1 -- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6d80c6930 msgr2=0x7fd6d80c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6d80c6930 0x7fd6d80c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d5e00640 1 -- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8150980 msgr2=0x7fd6d8150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8150980 0x7fd6d8150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d5e00640 1 -- 172.21.15.17:0/1453568984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d815c950 con 0x7fd6bc003a10 2024-09-10T23:32:36.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6bc003a10 0x7fd6d815c100 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7fd6c801d0e0 tx=0x7fd6c80055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6ce000640 1 -- 172.21.15.17:0/1453568984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80b1040 con 0x7fd6bc003a10 2024-09-10T23:32:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6ce000640 1 -- 172.21.15.17:0/1453568984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6c8004030 con 0x7fd6bc003a10 2024-09-10T23:32:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6dca00640 1 -- 172.21.15.17:0/1453568984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d815cc30 con 0x7fd6bc003a10 2024-09-10T23:32:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6ce000640 1 -- 172.21.15.17:0/1453568984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8004440 con 0x7fd6bc003a10 2024-09-10T23:32:36.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.434+0000 7fd6dca00640 1 -- 172.21.15.17:0/1453568984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d815d1f0 con 0x7fd6bc003a10 2024-09-10T23:32:36.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6ce000640 1 -- 172.21.15.17:0/1453568984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd6c80046d0 con 0x7fd6bc003a10 2024-09-10T23:32:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6dff06000 1 Processor -- start 2024-09-10T23:32:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6ce000640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6b4072610 0x7fd6b4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6ce000640 1 -- 172.21.15.17:0/1453568984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7fd6c812db80 con 0x7fd6bc003a10 2024-09-10T23:32:36.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6dff06000 1 -- start start 2024-09-10T23:32:36.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d6800640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6b4072610 0x7fd6b4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f140d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f0ee680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 0x55b61f0eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6dff06000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b61efd6cb0 con 0x55b61f1409b0 2024-09-10T23:32:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6dff06000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b61eeec310 con 0x55b61f1412d0 2024-09-10T23:32:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6dff06000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b61ef49b90 con 0x55b61f0eebc0 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d6800640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6b4072610 0x7fd6b4074ad0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80ceb50 tx=0x7fd6d0009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f140d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44400/0 (socket says 172.21.15.17:44400) 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d5e00640 1 -- 172.21.15.17:0/853777764 learned_addr learned my addr 172.21.15.17:0/853777764 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6cfe00640 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f0ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d6800640 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 0x55b61f0eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d5e00640 1 -- 172.21.15.17:0/853777764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 msgr2=0x55b61f0eefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 0x55b61f0eefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d5e00640 1 -- 172.21.15.17:0/853777764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 msgr2=0x55b61f0ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f0ee680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6d5e00640 1 -- 172.21.15.17:0/853777764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b61eeedc60 con 0x55b61f1409b0 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.438+0000 7fd6cfe00640 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f0ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f140d90 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80f8750 tx=0x7fd6c80f8460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421f02aafb5590da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6c6a00640 1 -- 172.21.15.17:0/853777764 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80f8560 con 0x55b61f1409b0 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6c6a00640 1 -- 172.21.15.17:0/853777764 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6c80fd480 con 0x55b61f1409b0 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6c6a00640 1 -- 172.21.15.17:0/853777764 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8101ea0 con 0x55b61f1409b0 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 -- 172.21.15.17:0/853777764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 msgr2=0x55b61f140d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f140d90 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80f8750 tx=0x7fd6c80f8460 comp rx=0 tx=0).stop 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 -- 172.21.15.17:0/853777764 shutdown_connections 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 0x55b61f0eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f0ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 --2- 172.21.15.17:0/853777764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f140d90 unknown :-1 s=CLOSED pgs=2629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 -- 172.21.15.17:0/853777764 >> 172.21.15.17:0/853777764 conn(0x55b61f0f4d20 msgr2=0x55b61f0ecf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 -- 172.21.15.17:0/853777764 shutdown_connections 2024-09-10T23:32:36.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 -- 172.21.15.17:0/853777764 wait complete. 2024-09-10T23:32:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 -- start start 2024-09-10T23:32:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 Processor -- start 2024-09-10T23:32:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 0x55b61f147d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 0x55b61f148280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f1487c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b61ef3cdd0 con 0x55b61f1412d0 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b61ef38fc0 con 0x55b61f0eebc0 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b61eede4b0 con 0x55b61f1409b0 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6dff06000 10 client.0 _ll_register_callbacks cb 0x55b61eebc7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f1487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f1487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44416/0 (socket says 172.21.15.17:44416) 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d6800640 1 -- 172.21.15.17:0/3788687074 learned_addr learned my addr 172.21.15.17:0/3788687074 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 0x55b61f147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6cfe00640 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 0x55b61f148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d6800640 1 -- 172.21.15.17:0/3788687074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 msgr2=0x55b61f148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d6800640 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 0x55b61f148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d6800640 1 -- 172.21.15.17:0/3788687074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 msgr2=0x55b61f147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d6800640 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 0x55b61f147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d6800640 1 -- 172.21.15.17:0/3788687074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b61eed71f0 con 0x55b61f1412d0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6d6800640 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f1487c0 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8075600 tx=0x7fd6d0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ae9e942ba247de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.442+0000 7fd6bb400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6bb400640 1 -- 172.21.15.17:0/3788687074 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0011e80 con 0x55b61f1412d0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6bb400640 1 -- 172.21.15.17:0/3788687074 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7fd6d0004b30 con 0x55b61f1412d0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 -- 172.21.15.17:0/3788687074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b61eed1330 con 0x55b61f1412d0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6bb400640 1 -- 172.21.15.17:0/3788687074 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7fd6d0031050 con 0x55b61f1412d0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 10 client.12123 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 -- 172.21.15.17:0/3788687074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55b61eebdfa0 con 0x55b61f1412d0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6bb400640 1 -- 172.21.15.17:0/3788687074 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b61eed1330 con 0x55b61f1412d0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6bb400640 1 -- 172.21.15.17:0/3788687074 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7fd6d0034020 con 0x55b61f1412d0 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 10 client.12123 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 10 client.12123 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 20 client.12123 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55b61f150110 0x55b61f152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 4 client.12123 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 -- 172.21.15.17:0/3788687074 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b61ef4bae0 con 0x55b61f150110 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55b61f150110 0x55b61f152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55b61f150110 0x55b61f152500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b09bc334c20255e server_cookie=530b64aad5cff636 in_seq=0 out_seq=0 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6bb400640 10 client.12123 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6bb400640 1 -- 172.21.15.17:0/3788687074 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b61ef4bae0 con 0x55b61f150110 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6bb400640 10 client.12123 handle_command_reply: tid=0 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 client.12123 shutdown 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 -- 172.21.15.17:0/3788687074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 msgr2=0x55b61f1487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f1487c0 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8075600 tx=0x7fd6d0004ac0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 -- 172.21.15.17:0/3788687074 shutdown_connections 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55b61f150110 0x55b61f152500 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f1487c0 unknown :-1 s=CLOSED pgs=2630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 0x55b61f148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 --2- 172.21.15.17:0/3788687074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 0x55b61f147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 -- 172.21.15.17:0/3788687074 >> 172.21.15.17:0/3788687074 conn(0x55b61f0f4d20 msgr2=0x55b61f0ecf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6bb400640 0 client.12123 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 -- 172.21.15.17:0/3788687074 shutdown_connections 2024-09-10T23:32:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 1 -- 172.21.15.17:0/3788687074 wait complete. 2024-09-10T23:32:36.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.446+0000 7fd6dff06000 20 client.12123 trim_cache size 0 max 16384 2024-09-10T23:32:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 Processor -- start 2024-09-10T23:32:36.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 -- start start 2024-09-10T23:32:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 0x55b61f1b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f1b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f1b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80b0a90 con 0x55b61f1409b0 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81fa0c0 con 0x55b61f1412d0 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d81f8900 con 0x55b61f0eebc0 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f1b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f1b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44426/0 (socket says 172.21.15.17:44426) 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6cfe00640 1 -- 172.21.15.17:0/431827006 learned_addr learned my addr 172.21.15.17:0/431827006 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 0x55b61f1b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6d6800640 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f1b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6cfe00640 1 -- 172.21.15.17:0/431827006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 msgr2=0x55b61f1b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6cfe00640 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 0x55b61f1b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6cfe00640 1 -- 172.21.15.17:0/431827006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 msgr2=0x55b61f1b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6cfe00640 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f1b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6cfe00640 1 -- 172.21.15.17:0/431827006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b61ef96660 con 0x55b61f1409b0 2024-09-10T23:32:36.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6d6800640 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f1b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6cfe00640 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f1b2770 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0001ec0 tx=0x7fd6c0006490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a04f470aed841 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6c6000640 1 -- 172.21.15.17:0/431827006 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0003d90 con 0x55b61f1409b0 2024-09-10T23:32:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6c6000640 1 -- 172.21.15.17:0/431827006 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6c001d410 con 0x55b61f1409b0 2024-09-10T23:32:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6c6000640 1 -- 172.21.15.17:0/431827006 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c001d860 con 0x55b61f1409b0 2024-09-10T23:32:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 -- 172.21.15.17:0/431827006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 msgr2=0x55b61f1b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f1b2770 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0001ec0 tx=0x7fd6c0006490 comp rx=0 tx=0).stop 2024-09-10T23:32:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 -- 172.21.15.17:0/431827006 shutdown_connections 2024-09-10T23:32:36.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f1412d0 0x55b61f1b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1409b0 0x55b61f1b2770 unknown :-1 s=CLOSED pgs=2631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 --2- 172.21.15.17:0/431827006 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f0eebc0 0x55b61f1b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 -- 172.21.15.17:0/431827006 >> 172.21.15.17:0/431827006 conn(0x55b61f0f4d20 msgr2=0x55b61f0f0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 -- 172.21.15.17:0/431827006 shutdown_connections 2024-09-10T23:32:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.466+0000 7fd6dff06000 1 -- 172.21.15.17:0/431827006 wait complete. 2024-09-10T23:32:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 -- start start 2024-09-10T23:32:36.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 Processor -- start 2024-09-10T23:32:36.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 0x55b61f156e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 0x55b61f1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f172a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55b61eeec310 con 0x55b61f1412d0 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55b61ef33ec0 con 0x55b61f0eebc0 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55b61f0f7d40 con 0x55b61f1409b0 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 10 client.0 _ll_register_callbacks cb 0x7fd6d0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f172a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f172a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44430/0 (socket says 172.21.15.17:44430) 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d6800640 1 -- 172.21.15.17:0/2626630063 learned_addr learned my addr 172.21.15.17:0/2626630063 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 0x55b61f156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6cfe00640 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 0x55b61f1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d6800640 1 -- 172.21.15.17:0/2626630063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 msgr2=0x55b61f1573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d6800640 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 0x55b61f1573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d6800640 1 -- 172.21.15.17:0/2626630063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 msgr2=0x55b61f156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d6800640 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 0x55b61f156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d6800640 1 -- 172.21.15.17:0/2626630063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b61ef03090 con 0x55b61f1412d0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 0x55b61f156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d6800640 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f172a20 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000ff40 tx=0x7fd6d000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee04d659471a0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6bb400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6bb400640 1 -- 172.21.15.17:0/2626630063 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0039070 con 0x55b61f1412d0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6bb400640 1 -- 172.21.15.17:0/2626630063 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7fd6d0035600 con 0x55b61f1412d0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 -- 172.21.15.17:0/2626630063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6c001d410 con 0x55b61f1412d0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6bb400640 1 -- 172.21.15.17:0/2626630063 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7fd6d0044050 con 0x55b61f1412d0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 10 client.12129 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 -- 172.21.15.17:0/2626630063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55b61eecf5f0 con 0x55b61f1412d0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6bb400640 1 -- 172.21.15.17:0/2626630063 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6c001d410 con 0x55b61f1412d0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6bb400640 1 -- 172.21.15.17:0/2626630063 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7fd6d0047020 con 0x55b61f1412d0 2024-09-10T23:32:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 10 client.12129 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 10 client.12129 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 20 client.12129 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55b61f1bbe80 0x55b61f1be270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 4 client.12129 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6dff06000 1 -- 172.21.15.17:0/2626630063 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b61ef47590 con 0x55b61f1bbe80 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.470+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55b61f1bbe80 0x55b61f1be270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6d5e00640 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55b61f1bbe80 0x55b61f1be270 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81109a034d9e5dcc server_cookie=22b74894531f5db0 in_seq=0 out_seq=0 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6bb400640 10 client.12129 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6bb400640 1 -- 172.21.15.17:0/2626630063 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55b61ef47590 con 0x55b61f1bbe80 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6bb400640 10 client.12129 handle_command_reply: tid=0 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 client.12129 shutdown 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 -- 172.21.15.17:0/2626630063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 msgr2=0x55b61f172a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f172a20 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000ff40 tx=0x7fd6d000ff70 comp rx=0 tx=0).stop 2024-09-10T23:32:36.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 -- 172.21.15.17:0/2626630063 shutdown_connections 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55b61f1bbe80 0x55b61f1be270 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b61f1412d0 0x55b61f172a20 unknown :-1 s=CLOSED pgs=2632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55b61f1409b0 0x55b61f1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 --2- 172.21.15.17:0/2626630063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55b61f0eebc0 0x55b61f156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6bb400640 0 client.12129 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 -- 172.21.15.17:0/2626630063 >> 172.21.15.17:0/2626630063 conn(0x55b61f0f4d20 msgr2=0x55b61f152500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 -- 172.21.15.17:0/2626630063 shutdown_connections 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 1 -- 172.21.15.17:0/2626630063 wait complete. 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dff06000 20 client.12129 trim_cache size 0 max 16384 2024-09-10T23:32:36.480 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "2d178d1a-1c2b-4b3a-bac9-2473baf9bb71": { 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:32:06.030783+0000", 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:32:36.481 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:32:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 -- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6b4072610 msgr2=0x7fd6b4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6b4072610 0x7fd6b4074ad0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80ceb50 tx=0x7fd6d0009500 comp rx=0 tx=0).stop 2024-09-10T23:32:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 -- 172.21.15.17:0/1453568984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6bc003a10 msgr2=0x7fd6d815c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6bc003a10 0x7fd6d815c100 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7fd6c801d0e0 tx=0x7fd6c80055d0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 -- 172.21.15.17:0/1453568984 shutdown_connections 2024-09-10T23:32:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd6b4072610 0x7fd6b4074ad0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d8150980 0x7fd6d8150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd6d80c6930 0x7fd6d80c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 --2- 172.21.15.17:0/1453568984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6bc003a10 0x7fd6d815c100 unknown :-1 s=CLOSED pgs=2628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 -- 172.21.15.17:0/1453568984 >> 172.21.15.17:0/1453568984 conn(0x7fd6d80d1de0 msgr2=0x7fd6d80d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 -- 172.21.15.17:0/1453568984 shutdown_connections 2024-09-10T23:32:36.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.474+0000 7fd6dca00640 1 -- 172.21.15.17:0/1453568984 wait complete. 2024-09-10T23:32:36.496 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:32:36.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:32:36.496 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub start / recursive,repair 2024-09-10T23:32:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.642+0000 7f71aa400640 1 -- 172.21.15.17:0/2746899311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 msgr2=0x7f7188003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.642+0000 7f71aa400640 1 --2- 172.21.15.17:0/2746899311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 0x7f7188003e80 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f7194009b60 tx=0x7f719401d270 comp rx=0 tx=0).stop 2024-09-10T23:32:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 -- 172.21.15.17:0/2746899311 shutdown_connections 2024-09-10T23:32:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 --2- 172.21.15.17:0/2746899311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 0x7f7188003e80 unknown :-1 s=CLOSED pgs=2634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 -- 172.21.15.17:0/2746899311 >> 172.21.15.17:0/2746899311 conn(0x7f71a40d1d40 msgr2=0x7f71a40d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 -- 172.21.15.17:0/2746899311 shutdown_connections 2024-09-10T23:32:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 -- 172.21.15.17:0/2746899311 wait complete. 2024-09-10T23:32:36.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 Processor -- start 2024-09-10T23:32:36.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 -- start start 2024-09-10T23:32:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 0x7f71a40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71a40c4bf0 0x7f71a40ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71a4152ee0 0x7f71a415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f71a40d0880 con 0x7f7188003a60 2024-09-10T23:32:36.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f71a40d0700 con 0x7f71a40c4bf0 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71aa400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f71a40d0a00 con 0x7f71a4152ee0 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 0x7f71a40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 0x7f71a40ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44442/0 (socket says 172.21.15.17:44442) 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3400640 1 -- 172.21.15.17:0/1270000249 learned_addr learned my addr 172.21.15.17:0/1270000249 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f719be00640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71a40c4bf0 0x7f71a40ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3e00640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71a4152ee0 0x7f71a415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3400640 1 -- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71a4152ee0 msgr2=0x7f71a415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71a4152ee0 0x7f71a415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3400640 1 -- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71a40c4bf0 msgr2=0x7f71a40ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71a40c4bf0 0x7f71a40ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3400640 1 -- 172.21.15.17:0/1270000249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a40cd630 con 0x7f7188003a60 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f719be00640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71a40c4bf0 0x7f71a40ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:36.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.646+0000 7f71a3400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 0x7f71a40ca360 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7f71940af040 tx=0x7f71940056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.650+0000 7f719b400640 1 -- 172.21.15.17:0/1270000249 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71940ba070 con 0x7f7188003a60 2024-09-10T23:32:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.650+0000 7f719b400640 1 -- 172.21.15.17:0/1270000249 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7194004a80 con 0x7f7188003a60 2024-09-10T23:32:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.650+0000 7f719b400640 1 -- 172.21.15.17:0/1270000249 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71940b1040 con 0x7f7188003a60 2024-09-10T23:32:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.650+0000 7f71aa400640 1 -- 172.21.15.17:0/1270000249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a415f1a0 con 0x7f7188003a60 2024-09-10T23:32:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.650+0000 7f71aa400640 1 -- 172.21.15.17:0/1270000249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a40cb160 con 0x7f7188003a60 2024-09-10T23:32:36.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.650+0000 7f719b400640 1 -- 172.21.15.17:0/1270000249 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f71940bf450 con 0x7f7188003a60 2024-09-10T23:32:36.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.650+0000 7f719b400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71800725e0 0x7f7180074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f719b400640 1 -- 172.21.15.17:0/1270000249 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f719412de30 con 0x7f7188003a60 2024-09-10T23:32:36.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 Processor -- start 2024-09-10T23:32:36.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f719be00640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71800725e0 0x7f7180074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 -- start start 2024-09-10T23:32:36.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f719be00640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71800725e0 0x7f7180074aa0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f71a40cb780 tx=0x7f718c001120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bf07030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 0x55c44bebd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bebdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c44bccbbb0 con 0x55c44bebd730 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c44bcbc410 con 0x55c44bf06c50 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c44bd19cc0 con 0x55c44bf07570 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bebdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bebdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44444/0 (socket says 172.21.15.17:44444) 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3e00640 1 -- 172.21.15.17:0/1062761481 learned_addr learned my addr 172.21.15.17:0/1062761481 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3400640 1 --2- 172.21.15.17:0/1062761481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bf07030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f719be00640 1 --2- 172.21.15.17:0/1062761481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 0x55c44bebd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3e00640 1 -- 172.21.15.17:0/1062761481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 msgr2=0x55c44bebd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3e00640 1 --2- 172.21.15.17:0/1062761481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 0x55c44bebd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3e00640 1 -- 172.21.15.17:0/1062761481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 msgr2=0x55c44bf07030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3e00640 1 --2- 172.21.15.17:0/1062761481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bf07030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3e00640 1 -- 172.21.15.17:0/1062761481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44bcbdd60 con 0x55c44bebd730 2024-09-10T23:32:36.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71a3e00640 1 --2- 172.21.15.17:0/1062761481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bebdb10 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f71a40d0ee0 tx=0x7f719c006590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04934860b0d1676 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f7193e00640 1 -- 172.21.15.17:0/1062761481 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c011b80 con 0x55c44bebd730 2024-09-10T23:32:36.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f7193e00640 1 -- 172.21.15.17:0/1062761481 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f719c016070 con 0x55c44bebd730 2024-09-10T23:32:36.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f7193e00640 1 -- 172.21.15.17:0/1062761481 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c012640 con 0x55c44bebd730 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1062761481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 msgr2=0x55c44bebdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1062761481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bebdb10 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f71a40d0ee0 tx=0x7f719c006590 comp rx=0 tx=0).stop 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1062761481 shutdown_connections 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1062761481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bebdb10 unknown :-1 s=CLOSED pgs=2636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1062761481 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 0x55c44bebd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1062761481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bf07030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1062761481 >> 172.21.15.17:0/1062761481 conn(0x55c44beb96e0 msgr2=0x55c44bebbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1062761481 shutdown_connections 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.654+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1062761481 wait complete. 2024-09-10T23:32:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 -- start start 2024-09-10T23:32:36.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 Processor -- start 2024-09-10T23:32:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bec8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 0x55c44bec8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c44bd0cf00 con 0x55c44bebd730 2024-09-10T23:32:36.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c44bd090f0 con 0x55c44bf06c50 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c44bcae6b0 con 0x55c44bf07570 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 10 client.0 _ll_register_callbacks cb 0x55c44bcad310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf065a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44452/0 (socket says 172.21.15.17:44452) 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3400640 1 -- 172.21.15.17:0/3627102413 learned_addr learned my addr 172.21.15.17:0/3627102413 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f719be00640 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bec8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3e00640 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 0x55c44bec8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3400640 1 -- 172.21.15.17:0/3627102413 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 msgr2=0x55c44bec8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3400640 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 0x55c44bec8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3400640 1 -- 172.21.15.17:0/3627102413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 msgr2=0x55c44bec8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3400640 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bec8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3400640 1 -- 172.21.15.17:0/3627102413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c44bca72f0 con 0x55c44bebd730 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71a3400640 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf065a0 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 crypto rx=0x7f719401d0a0 tx=0x7f71940f9150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f215a992900cc64d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f7190c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f7190c00640 1 -- 172.21.15.17:0/3627102413 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71940f83e0 con 0x55c44bebd730 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f7190c00640 1 -- 172.21.15.17:0/3627102413 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f71940e6170 con 0x55c44bebd730 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 -- 172.21.15.17:0/3627102413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c44bca1430 con 0x55c44bebd730 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f7190c00640 1 -- 172.21.15.17:0/3627102413 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f71940f8780 con 0x55c44bebd730 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 10 client.12141 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 -- 172.21.15.17:0/3627102413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55c44bcc4f40 con 0x55c44bebd730 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f7190c00640 1 -- 172.21.15.17:0/3627102413 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c44bca1430 con 0x55c44bebd730 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f7190c00640 1 -- 172.21.15.17:0/3627102413 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f71940f7ed0 con 0x55c44bebd730 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 10 client.12141 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 10 client.12141 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 20 client.12141 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55c44bec9c40 0x55c44beca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 4 client.12141 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f71ad8f0000 1 -- 172.21.15.17:0/3627102413 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c44bd1bc10 con 0x55c44bec9c40 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f719be00640 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55c44bec9c40 0x55c44beca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f719be00640 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55c44bec9c40 0x55c44beca020 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2547f9051b3c33fc server_cookie=f0f93921304a2fda in_seq=0 out_seq=0 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.658+0000 7f7190c00640 10 client.12141 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f7190c00640 1 -- 172.21.15.17:0/3627102413 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c44bd1bc10 con 0x55c44bec9c40 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f7190c00640 10 client.12141 handle_command_reply: tid=0 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 client.12141 shutdown 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 -- 172.21.15.17:0/3627102413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 msgr2=0x55c44bf065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf065a0 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 crypto rx=0x7f719401d0a0 tx=0x7f71940f9150 comp rx=0 tx=0).stop 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 -- 172.21.15.17:0/3627102413 shutdown_connections 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55c44bec9c40 0x55c44beca020 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf07570 0x55c44bec8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bec8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/3627102413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf065a0 unknown :-1 s=CLOSED pgs=2637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 -- 172.21.15.17:0/3627102413 >> 172.21.15.17:0/3627102413 conn(0x55c44beb96e0 msgr2=0x55c44bebc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f7190c00640 0 client.12141 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 -- 172.21.15.17:0/3627102413 shutdown_connections 2024-09-10T23:32:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 1 -- 172.21.15.17:0/3627102413 wait complete. 2024-09-10T23:32:36.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.662+0000 7f71ad8f0000 20 client.12141 trim_cache size 0 max 16384 2024-09-10T23:32:36.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.678+0000 7f71ad8f0000 1 Processor -- start 2024-09-10T23:32:36.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.678+0000 7f71ad8f0000 1 -- start start 2024-09-10T23:32:36.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bebd730 0x55c44bebcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bebd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bf07570 0x55c44bec7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55c44bec2cf0 con 0x55c44bf07570 2024-09-10T23:32:36.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f71a4204e10 con 0x55c44bf06c50 2024-09-10T23:32:36.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f71a4203e80 con 0x55c44bebd730 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bf07570 0x55c44bec7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bf07570 0x55c44bec7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44460/0 (socket says 172.21.15.17:44460) 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3e00640 1 -- 172.21.15.17:0/2308904940 learned_addr learned my addr 172.21.15.17:0/2308904940 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f719be00640 1 --2- 172.21.15.17:0/2308904940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bebd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3400640 1 --2- 172.21.15.17:0/2308904940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bebd730 0x55c44bebcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3e00640 1 -- 172.21.15.17:0/2308904940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bebd730 msgr2=0x55c44bebcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3e00640 1 --2- 172.21.15.17:0/2308904940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bebd730 0x55c44bebcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3e00640 1 -- 172.21.15.17:0/2308904940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 msgr2=0x55c44bebd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3e00640 1 --2- 172.21.15.17:0/2308904940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bebd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3e00640 1 -- 172.21.15.17:0/2308904940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44bd8df10 con 0x55c44bf07570 2024-09-10T23:32:36.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71a3e00640 1 --2- 172.21.15.17:0/2308904940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bf07570 0x55c44bec7a00 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7f719c006d20 tx=0x7f719c0014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585dc6a607c3bf39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f7193400640 1 -- 172.21.15.17:0/2308904940 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c011b80 con 0x55c44bf07570 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f7193400640 1 -- 172.21.15.17:0/2308904940 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f719c020040 con 0x55c44bf07570 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f7193400640 1 -- 172.21.15.17:0/2308904940 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c0126a0 con 0x55c44bf07570 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 -- 172.21.15.17:0/2308904940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bf07570 msgr2=0x55c44bec7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/2308904940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bf07570 0x55c44bec7a00 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7f719c006d20 tx=0x7f719c0014b0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 -- 172.21.15.17:0/2308904940 shutdown_connections 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/2308904940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bf07570 0x55c44bec7a00 unknown :-1 s=CLOSED pgs=2638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/2308904940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf06c50 0x55c44bebd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/2308904940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bebd730 0x55c44bebcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 -- 172.21.15.17:0/2308904940 >> 172.21.15.17:0/2308904940 conn(0x55c44beb96e0 msgr2=0x55c44bf1e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 -- 172.21.15.17:0/2308904940 shutdown_connections 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 -- 172.21.15.17:0/2308904940 wait complete. 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 -- start start 2024-09-10T23:32:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.682+0000 7f71ad8f0000 1 Processor -- start 2024-09-10T23:32:36.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf7e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf06c50 0x55c44bf7e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf07570 0x55c44bf7ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f71a4203830 con 0x55c44bebd730 2024-09-10T23:32:36.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f71a42032b0 con 0x55c44bf07570 2024-09-10T23:32:36.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55c44b9ce8d0 con 0x55c44bf06c50 2024-09-10T23:32:36.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 10 client.0 _ll_register_callbacks cb 0x7f7194009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf7e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf7e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44476/0 (socket says 172.21.15.17:44476) 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3400640 1 -- 172.21.15.17:0/1010757672 learned_addr learned my addr 172.21.15.17:0/1010757672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f719be00640 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf06c50 0x55c44bf7e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3e00640 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf07570 0x55c44bf7ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3400640 1 -- 172.21.15.17:0/1010757672 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf06c50 msgr2=0x55c44bf7e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3400640 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf06c50 0x55c44bf7e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3400640 1 -- 172.21.15.17:0/1010757672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf07570 msgr2=0x55c44bf7ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3400640 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf07570 0x55c44bf7ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3400640 1 -- 172.21.15.17:0/1010757672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c44bd64db0 con 0x55c44bebd730 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71a3400640 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf7e180 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f7194005010 tx=0x7f7194005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6175f97c0ac63e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 1 -- 172.21.15.17:0/1010757672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71940f83e0 con 0x55c44bebd730 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 1 -- 172.21.15.17:0/1010757672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f71940f47c0 con 0x55c44bebd730 2024-09-10T23:32:36.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1010757672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f719c020040 con 0x55c44bebd730 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 1 -- 172.21.15.17:0/1010757672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f71940f8a40 con 0x55c44bebd730 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 10 client.12147 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1010757672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55c44bc9f820 con 0x55c44bebd730 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 1 -- 172.21.15.17:0/1010757672 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f719c020040 con 0x55c44bebd730 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 1 -- 172.21.15.17:0/1010757672 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f71940f7940 con 0x55c44bebd730 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 10 client.12147 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 10 client.12147 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 20 client.12147 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55c44bf1a810 0x55c44bf1ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 4 client.12147 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1010757672 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x55c44bd176c0 con 0x55c44bf1a810 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f719be00640 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55c44bf1a810 0x55c44bf1ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f719be00640 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55c44bf1a810 0x55c44bf1ac20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2363edd85d98f009 server_cookie=b64184323598d63d in_seq=0 out_seq=0 2024-09-10T23:32:36.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 10 client.12147 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 1 -- 172.21.15.17:0/1010757672 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c44bd176c0 con 0x55c44bf1a810 2024-09-10T23:32:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 10 client.12147 handle_command_reply: tid=0 2024-09-10T23:32:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 client.12147 shutdown 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1010757672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 msgr2=0x55c44bf7e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf7e180 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f7194005010 tx=0x7f7194005b50 comp rx=0 tx=0).stop 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1010757672 shutdown_connections 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55c44bf1a810 0x55c44bf1ac20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c44bf07570 0x55c44bf7ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c44bf06c50 0x55c44bf7e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 --2- 172.21.15.17:0/1010757672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c44bebd730 0x55c44bf7e180 unknown :-1 s=CLOSED pgs=2639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1010757672 >> 172.21.15.17:0/1010757672 conn(0x55c44beb96e0 msgr2=0x55c44bebbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.686+0000 7f7190c00640 0 client.12147 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1010757672 shutdown_connections 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71ad8f0000 1 -- 172.21.15.17:0/1010757672 wait complete. 2024-09-10T23:32:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71ad8f0000 20 client.12147 trim_cache size 0 max 16384 2024-09-10T23:32:36.695 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:32:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2024-09-10T23:32:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "3a6e6e99-208d-4714-a441-0d222f381ac0", 2024-09-10T23:32:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2024-09-10T23:32:36.695 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:32:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 -- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71800725e0 msgr2=0x7f7180074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71800725e0 0x7f7180074aa0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f71a40cb780 tx=0x7f718c001120 comp rx=0 tx=0).stop 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 -- 172.21.15.17:0/1270000249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 msgr2=0x7f71a40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 0x7f71a40ca360 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7f71940af040 tx=0x7f71940056a0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 -- 172.21.15.17:0/1270000249 shutdown_connections 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f71800725e0 0x7f7180074aa0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71a4152ee0 0x7f71a415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71a40c4bf0 0x7f71a40ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 --2- 172.21.15.17:0/1270000249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7188003a60 0x7f71a40ca360 unknown :-1 s=CLOSED pgs=2635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 -- 172.21.15.17:0/1270000249 >> 172.21.15.17:0/1270000249 conn(0x7f71a40d1d40 msgr2=0x7f71a40cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 -- 172.21.15.17:0/1270000249 shutdown_connections 2024-09-10T23:32:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.690+0000 7f71aa400640 1 -- 172.21.15.17:0/1270000249 wait complete. 2024-09-10T23:32:36.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:32:36.711 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-10T23:32:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.854+0000 7f1368000640 1 -- 172.21.15.17:0/1608764294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 msgr2=0x7f13600cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.854+0000 7f1368000640 1 --2- 172.21.15.17:0/1608764294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 0x7f13600cfbc0 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f13600cd900 tx=0x7f135801ccf0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.854+0000 7f1368000640 1 -- 172.21.15.17:0/1608764294 shutdown_connections 2024-09-10T23:32:36.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.854+0000 7f1368000640 1 --2- 172.21.15.17:0/1608764294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 0x7f13600cfbc0 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.854+0000 7f1368000640 1 --2- 172.21.15.17:0/1608764294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f13600cf380 0x7f13600ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.854+0000 7f1368000640 1 --2- 172.21.15.17:0/1608764294 >> v2:172.21.15.77:3300/0 conn(0x7f1360158610 0x7f136015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.854+0000 7f1368000640 1 -- 172.21.15.17:0/1608764294 >> 172.21.15.17:0/1608764294 conn(0x7f136006c360 msgr2=0x7f136006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.854+0000 7f1368000640 1 -- 172.21.15.17:0/1608764294 shutdown_connections 2024-09-10T23:32:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.854+0000 7f1368000640 1 -- 172.21.15.17:0/1608764294 wait complete. 2024-09-10T23:32:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1368000640 1 Processor -- start 2024-09-10T23:32:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1368000640 1 -- start start 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1368000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 0x7f13601f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1368000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13600cf380 0x7f1360074360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1368000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1360158610 0x7f13601fa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1368000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f136015ef30 con 0x7f13600ce8f0 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1368000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f136015edb0 con 0x7f13600cf380 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1368000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f136015f0b0 con 0x7f1360158610 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1365600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 0x7f13601f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1365600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 0x7f13601f8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50954/0 (socket says 172.21.15.17:50954) 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1365600640 1 -- 172.21.15.17:0/2931562966 learned_addr learned my addr 172.21.15.17:0/2931562966 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1364c00640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13600cf380 0x7f1360074360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1366000640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1360158610 0x7f13601fa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1365600640 1 -- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1360158610 msgr2=0x7f13601fa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1365600640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1360158610 0x7f13601fa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1365600640 1 -- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13600cf380 msgr2=0x7f1360074360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1365600640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13600cf380 0x7f1360074360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1365600640 1 -- 172.21.15.17:0/2931562966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13601fb710 con 0x7f13600ce8f0 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1365600640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 0x7f13601f8a50 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f135400d750 tx=0x7f135400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f135d600640 1 -- 172.21.15.17:0/2931562966 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354017070 con 0x7f13600ce8f0 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f135d600640 1 -- 172.21.15.17:0/2931562966 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1354009d20 con 0x7f13600ce8f0 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f135d600640 1 -- 172.21.15.17:0/2931562966 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135400de60 con 0x7f13600ce8f0 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.858+0000 7f1368000640 1 -- 172.21.15.17:0/2931562966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13601fb9f0 con 0x7f13600ce8f0 2024-09-10T23:32:36.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.862+0000 7f1368000640 1 -- 172.21.15.17:0/2931562966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13601fbfb0 con 0x7f13600ce8f0 2024-09-10T23:32:36.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.862+0000 7f135d600640 1 -- 172.21.15.17:0/2931562966 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1354004280 con 0x7f13600ce8f0 2024-09-10T23:32:36.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.862+0000 7f135d600640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13400725e0 0x7f1340074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 Processor -- start 2024-09-10T23:32:36.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f135d600640 1 -- 172.21.15.17:0/2931562966 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f1354093820 con 0x7f13600ce8f0 2024-09-10T23:32:36.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- start start 2024-09-10T23:32:36.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1364c00640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13400725e0 0x7f1340074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1364c00640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13400725e0 0x7f1340074aa0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f1360157e70 tx=0x7f134c005f40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7f30580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f30ac0 0x5630f7ee6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7ee6bc0 0x5630f7ee6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5630f7dcecb0 con 0x5630f7ee6bc0 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5630f7ce4310 con 0x5630f7f301a0 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5630f7d41b90 con 0x5630f7f30ac0 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1366000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7ee6bc0 0x5630f7ee6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1366000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7ee6bc0 0x5630f7ee6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50966/0 (socket says 172.21.15.17:50966) 2024-09-10T23:32:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1366000640 1 -- 172.21.15.17:0/3942146545 learned_addr learned my addr 172.21.15.17:0/3942146545 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1365600640 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7f30580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1364c00640 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f30ac0 0x5630f7ee6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1366000640 1 -- 172.21.15.17:0/3942146545 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f30ac0 msgr2=0x5630f7ee6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1366000640 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f30ac0 0x5630f7ee6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1366000640 1 -- 172.21.15.17:0/3942146545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 msgr2=0x5630f7f30580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1366000640 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7f30580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1366000640 1 -- 172.21.15.17:0/3942146545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f7ce5c60 con 0x5630f7ee6bc0 2024-09-10T23:32:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1365600640 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7f30580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1366000640 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7ee6bc0 0x5630f7ee6fa0 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f1358009bd0 tx=0x7f1358019a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84e81dc5328de04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1352000640 1 -- 172.21.15.17:0/3942146545 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13580b2040 con 0x5630f7ee6bc0 2024-09-10T23:32:36.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1352000640 1 -- 172.21.15.17:0/3942146545 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13580bc070 con 0x5630f7ee6bc0 2024-09-10T23:32:36.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f1352000640 1 -- 172.21.15.17:0/3942146545 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358004c50 con 0x5630f7ee6bc0 2024-09-10T23:32:36.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- 172.21.15.17:0/3942146545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7ee6bc0 msgr2=0x5630f7ee6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7ee6bc0 0x5630f7ee6fa0 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f1358009bd0 tx=0x7f1358019a90 comp rx=0 tx=0).stop 2024-09-10T23:32:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- 172.21.15.17:0/3942146545 shutdown_connections 2024-09-10T23:32:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7ee6bc0 0x5630f7ee6fa0 unknown :-1 s=CLOSED pgs=2642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f30ac0 0x5630f7ee6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 --2- 172.21.15.17:0/3942146545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7f30580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- 172.21.15.17:0/3942146545 >> 172.21.15.17:0/3942146545 conn(0x5630f7eecd20 msgr2=0x5630f7ee4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- 172.21.15.17:0/3942146545 shutdown_connections 2024-09-10T23:32:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- 172.21.15.17:0/3942146545 wait complete. 2024-09-10T23:32:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 -- start start 2024-09-10T23:32:36.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.866+0000 7f136b476000 1 Processor -- start 2024-09-10T23:32:36.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7ee6bc0 0x5630f7f37530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f301a0 0x5630f7f37a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f37fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5630f7d34dd0 con 0x5630f7f30ac0 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5630f7d30fc0 con 0x5630f7ee6bc0 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5630f7cd64b0 con 0x5630f7f301a0 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 10 client.0 _ll_register_callbacks cb 0x5630f7cb47d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1366000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f37fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1365600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7ee6bc0 0x5630f7f37530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1365600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7ee6bc0 0x5630f7f37530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.17:35758/0 (socket says 172.21.15.17:35758) 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1365600640 1 -- 172.21.15.17:0/562789058 learned_addr learned my addr 172.21.15.17:0/562789058 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1364c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f301a0 0x5630f7f37a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1366000640 1 -- 172.21.15.17:0/562789058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f301a0 msgr2=0x5630f7f37a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1366000640 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f301a0 0x5630f7f37a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1366000640 1 -- 172.21.15.17:0/562789058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7ee6bc0 msgr2=0x5630f7f37530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1366000640 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7ee6bc0 0x5630f7f37530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1366000640 1 -- 172.21.15.17:0/562789058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f7ccf1f0 con 0x5630f7f30ac0 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1365600640 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7ee6bc0 0x5630f7f37530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1366000640 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f37fb0 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x5630f7d3c5e0 tx=0x7f1358005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40161c5256e36e09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1346a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1346a00640 1 -- 172.21.15.17:0/562789058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13580b2070 con 0x5630f7f30ac0 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 -- 172.21.15.17:0/562789058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5630f7cc9330 con 0x5630f7f30ac0 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1346a00640 1 -- 172.21.15.17:0/562789058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f13580c1d40 con 0x5630f7f30ac0 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1346a00640 1 -- 172.21.15.17:0/562789058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f1358003980 con 0x5630f7f30ac0 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 10 client.12159 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:36.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 -- 172.21.15.17:0/562789058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x5630f7cb5fa0 con 0x5630f7f30ac0 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1346a00640 1 -- 172.21.15.17:0/562789058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5630f7cc9330 con 0x5630f7f30ac0 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1346a00640 1 -- 172.21.15.17:0/562789058 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f1358003b20 con 0x5630f7f30ac0 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 10 client.12159 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 10 client.12159 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 20 client.12159 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5630f7f3f900 0x5630f7f41cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 4 client.12159 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f136b476000 1 -- 172.21.15.17:0/562789058 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630f7d43ae0 con 0x5630f7f3f900 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1365600640 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5630f7f3f900 0x5630f7f41cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1365600640 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5630f7f3f900 0x5630f7f41cf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=634de33f8fcedcf6 server_cookie=ff09db1cc3fd0520 in_seq=0 out_seq=0 2024-09-10T23:32:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.870+0000 7f1346a00640 10 client.12159 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f1346a00640 1 -- 172.21.15.17:0/562789058 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630f7d43ae0 con 0x5630f7f3f900 2024-09-10T23:32:36.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f1346a00640 10 client.12159 handle_command_reply: tid=0 2024-09-10T23:32:36.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 client.12159 shutdown 2024-09-10T23:32:36.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 -- 172.21.15.17:0/562789058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 msgr2=0x5630f7f37fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f37fb0 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x5630f7d3c5e0 tx=0x7f1358005d90 comp rx=0 tx=0).stop 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 -- 172.21.15.17:0/562789058 shutdown_connections 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5630f7f3f900 0x5630f7f41cf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f37fb0 unknown :-1 s=CLOSED pgs=2643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7f301a0 0x5630f7f37a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 --2- 172.21.15.17:0/562789058 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7ee6bc0 0x5630f7f37530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f1346a00640 0 client.12159 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 -- 172.21.15.17:0/562789058 >> 172.21.15.17:0/562789058 conn(0x5630f7eecd20 msgr2=0x5630f7ee4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 -- 172.21.15.17:0/562789058 shutdown_connections 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 1 -- 172.21.15.17:0/562789058 wait complete. 2024-09-10T23:32:36.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.874+0000 7f136b476000 20 client.12159 trim_cache size 0 max 16384 2024-09-10T23:32:36.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.890+0000 7f136b476000 1 Processor -- start 2024-09-10T23:32:36.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.890+0000 7f136b476000 1 -- start start 2024-09-10T23:32:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.890+0000 7f136b476000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 0x5630f7f3ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.890+0000 7f136b476000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7ee6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.890+0000 7f136b476000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7ee65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.890+0000 7f136b476000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1360204e30 con 0x5630f7f30ac0 2024-09-10T23:32:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.890+0000 7f136b476000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1360203ee0 con 0x5630f7f301a0 2024-09-10T23:32:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.890+0000 7f136b476000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f13601598e0 con 0x5630f7ee6bc0 2024-09-10T23:32:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1366000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7ee65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1366000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7ee65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50994/0 (socket says 172.21.15.17:50994) 2024-09-10T23:32:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1366000640 1 -- 172.21.15.17:0/2022663362 learned_addr learned my addr 172.21.15.17:0/2022663362 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1364c00640 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7ee6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1365600640 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 0x5630f7f3ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1366000640 1 -- 172.21.15.17:0/2022663362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 msgr2=0x5630f7f3ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1366000640 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 0x5630f7f3ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1366000640 1 -- 172.21.15.17:0/2022663362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 msgr2=0x5630f7ee6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1366000640 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7ee6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1366000640 1 -- 172.21.15.17:0/2022663362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f7d8e660 con 0x5630f7f30ac0 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1364c00640 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7ee6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1366000640 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7ee65b0 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7f135801b3a0 tx=0x7f1358003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979496eb5a30899a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1351600640 1 -- 172.21.15.17:0/2022663362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13580ce070 con 0x5630f7f30ac0 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1351600640 1 -- 172.21.15.17:0/2022663362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13580bc070 con 0x5630f7f30ac0 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f1351600640 1 -- 172.21.15.17:0/2022663362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13580b2040 con 0x5630f7f30ac0 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 -- 172.21.15.17:0/2022663362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 msgr2=0x5630f7ee65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7ee65b0 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7f135801b3a0 tx=0x7f1358003fd0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 -- 172.21.15.17:0/2022663362 shutdown_connections 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7ee65b0 unknown :-1 s=CLOSED pgs=2644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7ee6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 --2- 172.21.15.17:0/2022663362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 0x5630f7f3ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 -- 172.21.15.17:0/2022663362 >> 172.21.15.17:0/2022663362 conn(0x5630f7eecd20 msgr2=0x5630f7ee5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 -- 172.21.15.17:0/2022663362 shutdown_connections 2024-09-10T23:32:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 -- 172.21.15.17:0/2022663362 wait complete. 2024-09-10T23:32:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 -- start start 2024-09-10T23:32:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 Processor -- start 2024-09-10T23:32:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 0x5630f7f3d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7f3d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.894+0000 7f136b476000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f62210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x5630f7eefd40 con 0x5630f7f30ac0 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5630f7eed100 con 0x5630f7f301a0 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x5630f7d2bec0 con 0x5630f7ee6bc0 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 10 client.0 _ll_register_callbacks cb 0x7f134c005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1366000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f62210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1366000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f62210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51000/0 (socket says 172.21.15.17:51000) 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1366000640 1 -- 172.21.15.17:0/52485761 learned_addr learned my addr 172.21.15.17:0/52485761 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1365600640 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 0x5630f7f3d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1364c00640 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7f3d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1366000640 1 -- 172.21.15.17:0/52485761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 msgr2=0x5630f7f3d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1366000640 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 0x5630f7f3d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1366000640 1 -- 172.21.15.17:0/52485761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 msgr2=0x5630f7f3d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:32:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1366000640 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7f3d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1366000640 1 -- 172.21.15.17:0/52485761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f7cfb090 con 0x5630f7f30ac0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1366000640 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f62210 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7f1358009bd0 tx=0x7f1358004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83680fc53c28b047 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 1 -- 172.21.15.17:0/52485761 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13580ce070 con 0x5630f7f30ac0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 1 -- 172.21.15.17:0/52485761 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f13580a5ab0 con 0x5630f7f30ac0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- 172.21.15.17:0/52485761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13580bc070 con 0x5630f7f30ac0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 1 -- 172.21.15.17:0/52485761 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f13580d8050 con 0x5630f7f30ac0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 10 client.12165 fetch_fsmap learned FSMap version 175 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- 172.21.15.17:0/52485761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x5630f7cc75f0 con 0x5630f7f30ac0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 1 -- 172.21.15.17:0/52485761 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13580bc070 con 0x5630f7f30ac0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 1 -- 172.21.15.17:0/52485761 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f13580db020 con 0x5630f7f30ac0 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 10 client.12165 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 10 client.12165 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 20 client.12165 populate_metadata read hostname 'smithi017' 2024-09-10T23:32:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5630f7f62c00 0x5630f7fa5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:32:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 4 client.12165 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:32:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- 172.21.15.17:0/52485761 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5630f7d3f590 con 0x5630f7f62c00 2024-09-10T23:32:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1365600640 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5630f7f62c00 0x5630f7fa5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:32:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 10 client.12165 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1365600640 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5630f7f62c00 0x5630f7fa5850 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49aa1aa6d6d039c9 server_cookie=24f4cb1572af5dec in_seq=0 out_seq=0 2024-09-10T23:32:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 1 -- 172.21.15.17:0/52485761 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+855 (crc 0 0 0) 0x5630f7d3f590 con 0x5630f7f62c00 2024-09-10T23:32:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 10 client.12165 handle_command_reply: tid=0 2024-09-10T23:32:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 client.12165 shutdown 2024-09-10T23:32:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- 172.21.15.17:0/52485761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 msgr2=0x5630f7f62210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f62210 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7f1358009bd0 tx=0x7f1358004690 comp rx=0 tx=0).stop 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- 172.21.15.17:0/52485761 shutdown_connections 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x5630f7f62c00 0x5630f7fa5850 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5630f7f30ac0 0x5630f7f62210 unknown :-1 s=CLOSED pgs=2645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5630f7f301a0 0x5630f7f3d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 --2- 172.21.15.17:0/52485761 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5630f7ee6bc0 0x5630f7f3d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- 172.21.15.17:0/52485761 >> 172.21.15.17:0/52485761 conn(0x5630f7eecd20 msgr2=0x5630f7ee6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f1346a00640 0 client.12165 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- 172.21.15.17:0/52485761 shutdown_connections 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 1 -- 172.21.15.17:0/52485761 wait complete. 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.898+0000 7f136b476000 20 client.12165 trim_cache size 0 max 16384 2024-09-10T23:32:36.906 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "3a6e6e99-208d-4714-a441-0d222f381ac0": { 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "3a6e6e99-208d-4714-a441-0d222f381ac0", 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,repair" 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "3a6e6e99-208d-4714-a441-0d222f381ac0": { 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:32:36.686442+0000", 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:32:36.907 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "2d178d1a-1c2b-4b3a-bac9-2473baf9bb71": { 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:32:06.030783+0000", 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:32:36.908 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:32:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 -- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13400725e0 msgr2=0x7f1340074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13400725e0 0x7f1340074aa0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f1360157e70 tx=0x7f134c005f40 comp rx=0 tx=0).stop 2024-09-10T23:32:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 -- 172.21.15.17:0/2931562966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 msgr2=0x7f13601f8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:32:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 0x7f13601f8a50 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f135400d750 tx=0x7f135400dc10 comp rx=0 tx=0).stop 2024-09-10T23:32:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 -- 172.21.15.17:0/2931562966 shutdown_connections 2024-09-10T23:32:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f13400725e0 0x7f1340074aa0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1360158610 0x7f13601fa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13600cf380 0x7f1360074360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 --2- 172.21.15.17:0/2931562966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13600ce8f0 0x7f13601f8a50 unknown :-1 s=CLOSED pgs=2641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:32:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 -- 172.21.15.17:0/2931562966 >> 172.21.15.17:0/2931562966 conn(0x7f136006c360 msgr2=0x7f1360153030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:32:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 -- 172.21.15.17:0/2931562966 shutdown_connections 2024-09-10T23:32:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:32:36.902+0000 7f1368000640 1 -- 172.21.15.17:0/2931562966 wait complete. 2024-09-10T23:32:36.923 INFO:tasks.cephfs.filesystem:scrub status for tag:3a6e6e99-208d-4714-a441-0d222f381ac0 - {'path': '/', 'tag': '3a6e6e99-208d-4714-a441-0d222f381ac0', 'options': 'recursive,repair'} 2024-09-10T23:32:38.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:32:38.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:33:06.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:33:06.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-10T23:33:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 -- 172.21.15.17:0/2813280672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 msgr2=0x7f9af40d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 --2- 172.21.15.17:0/2813280672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 0x7f9af40d0230 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 crypto rx=0x7f9af40b2bb0 tx=0x7f9adc01c890 comp rx=0 tx=0).stop 2024-09-10T23:33:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 -- 172.21.15.17:0/2813280672 shutdown_connections 2024-09-10T23:33:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 --2- 172.21.15.17:0/2813280672 >> v2:172.21.15.77:3300/0 conn(0x7f9af40d0770 0x7f9af40af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 --2- 172.21.15.17:0/2813280672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 0x7f9af40d0230 unknown :-1 s=CLOSED pgs=2646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 -- 172.21.15.17:0/2813280672 >> 172.21.15.17:0/2813280672 conn(0x7f9af40d1bb0 msgr2=0x7f9af40d1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 -- 172.21.15.17:0/2813280672 shutdown_connections 2024-09-10T23:33:07.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 -- 172.21.15.17:0/2813280672 wait complete. 2024-09-10T23:33:07.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 Processor -- start 2024-09-10T23:33:07.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 -- start start 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9af40d0770 0x7f9af4149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af415f1f0 0x7f9af40c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 0x7f9af40b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4168e00 con 0x7f9af415f5d0 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4168c80 con 0x7f9af415f1f0 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9afa200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9af4168f80 con 0x7f9af40d0770 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 0x7f9af40b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 0x7f9af40b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56414/0 (socket says 172.21.15.17:56414) 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af9800640 1 -- 172.21.15.17:0/404928051 learned_addr learned my addr 172.21.15.17:0/404928051 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:07.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af8e00640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9af40d0770 0x7f9af4149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9aebe00640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af415f1f0 0x7f9af40c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af9800640 1 -- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9af40d0770 msgr2=0x7f9af4149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af9800640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9af40d0770 0x7f9af4149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af9800640 1 -- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af415f1f0 msgr2=0x7f9af40c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af9800640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af415f1f0 0x7f9af40c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af9800640 1 -- 172.21.15.17:0/404928051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af41534b0 con 0x7f9af415f5d0 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9af8e00640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9af40d0770 0x7f9af4149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.086+0000 7f9aebe00640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af415f1f0 0x7f9af40c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.090+0000 7f9af9800640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 0x7f9af40b6dc0 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00ea20 tx=0x7f9aec00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.090+0000 7f9af1600640 1 -- 172.21.15.17:0/404928051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00cde0 con 0x7f9af415f5d0 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.090+0000 7f9af1600640 1 -- 172.21.15.17:0/404928051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aec004c20 con 0x7f9af415f5d0 2024-09-10T23:33:07.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.090+0000 7f9af1600640 1 -- 172.21.15.17:0/404928051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec005020 con 0x7f9af415f5d0 2024-09-10T23:33:07.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.090+0000 7f9afa200640 1 -- 172.21.15.17:0/404928051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af41526f0 con 0x7f9af415f5d0 2024-09-10T23:33:07.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.090+0000 7f9afa200640 1 -- 172.21.15.17:0/404928051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af4152cb0 con 0x7f9af415f5d0 2024-09-10T23:33:07.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.090+0000 7f9af1600640 1 -- 172.21.15.17:0/404928051 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9aec00f040 con 0x7f9af415f5d0 2024-09-10T23:33:07.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af1600640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ad00725e0 0x7f9ad0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 Processor -- start 2024-09-10T23:33:07.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af1600640 1 -- 172.21.15.17:0/404928051 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f9aec093ba0 con 0x7f9af415f5d0 2024-09-10T23:33:07.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 -- start start 2024-09-10T23:33:07.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af8e00640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ad00725e0 0x7f9ad0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 0x55610f3d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2f20 0x55610f388a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3893b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55610f26ccb0 con 0x55610f388fd0 2024-09-10T23:33:07.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55610f182310 con 0x55610f3d2f20 2024-09-10T23:33:07.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55610f1dfb90 con 0x55610f3d2600 2024-09-10T23:33:07.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af8e00640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ad00725e0 0x7f9ad0074aa0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4003ec0 tx=0x7f9ae4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:07.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af8e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 0x55610f3d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3893b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56424/0 (socket says 172.21.15.17:56424) 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af9800640 1 -- 172.21.15.17:0/3550541279 learned_addr learned my addr 172.21.15.17:0/3550541279 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9aebe00640 1 --2- 172.21.15.17:0/3550541279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2f20 0x55610f388a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af9800640 1 -- 172.21.15.17:0/3550541279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 msgr2=0x55610f3d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af9800640 1 --2- 172.21.15.17:0/3550541279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 0x55610f3d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af9800640 1 -- 172.21.15.17:0/3550541279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2f20 msgr2=0x55610f388a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af9800640 1 --2- 172.21.15.17:0/3550541279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2f20 0x55610f388a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af9800640 1 -- 172.21.15.17:0/3550541279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610f183c60 con 0x55610f388fd0 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9af9800640 1 --2- 172.21.15.17:0/3550541279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3893b0 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7f9aec091d30 tx=0x7f9aec05e140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ae138d1a5374a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9ae9600640 1 -- 172.21.15.17:0/3550541279 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec01f040 con 0x55610f388fd0 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9ae9600640 1 -- 172.21.15.17:0/3550541279 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aec063070 con 0x55610f388fd0 2024-09-10T23:33:07.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9ae9600640 1 -- 172.21.15.17:0/3550541279 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec05fe30 con 0x55610f388fd0 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 -- 172.21.15.17:0/3550541279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 msgr2=0x55610f3893b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3550541279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3893b0 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7f9aec091d30 tx=0x7f9aec05e140 comp rx=0 tx=0).stop 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 -- 172.21.15.17:0/3550541279 shutdown_connections 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3550541279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3893b0 unknown :-1 s=CLOSED pgs=2648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3550541279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2f20 0x55610f388a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3550541279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 0x55610f3d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 -- 172.21.15.17:0/3550541279 >> 172.21.15.17:0/3550541279 conn(0x55610f38ad20 msgr2=0x55610f382f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 -- 172.21.15.17:0/3550541279 shutdown_connections 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.094+0000 7f9afebb1000 1 -- 172.21.15.17:0/3550541279 wait complete. 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 -- start start 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 Processor -- start 2024-09-10T23:33:07.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3bca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 0x55610f3bcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2f20 0x55610f3bd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55610f1d2dd0 con 0x55610f388fd0 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55610f1cefc0 con 0x55610f3d2600 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55610f1744b0 con 0x55610f3d2f20 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 10 client.0 _ll_register_callbacks cb 0x55610f1527d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3bca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3bca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56430/0 (socket says 172.21.15.17:56430) 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af8e00640 1 -- 172.21.15.17:0/3761275808 learned_addr learned my addr 172.21.15.17:0/3761275808 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af9800640 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2f20 0x55610f3bd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9aebe00640 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 0x55610f3bcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af8e00640 1 -- 172.21.15.17:0/3761275808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2f20 msgr2=0x55610f3bd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af8e00640 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2f20 0x55610f3bd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af8e00640 1 -- 172.21.15.17:0/3761275808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 msgr2=0x55610f3bcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af8e00640 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 0x55610f3bcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af8e00640 1 -- 172.21.15.17:0/3761275808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610f16d1f0 con 0x55610f388fd0 2024-09-10T23:33:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9af8e00640 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3bca50 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007080 tx=0x7f9ae4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848ea9a5520ecc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9ae2000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:33:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9ae2000640 1 -- 172.21.15.17:0/3761275808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400e9f0 con 0x55610f388fd0 2024-09-10T23:33:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9ae2000640 1 -- 172.21.15.17:0/3761275808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f9ae4025d20 con 0x55610f388fd0 2024-09-10T23:33:07.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 -- 172.21.15.17:0/3761275808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55610f167330 con 0x55610f388fd0 2024-09-10T23:33:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9ae2000640 1 -- 172.21.15.17:0/3761275808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f9ae400eb90 con 0x55610f388fd0 2024-09-10T23:33:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 10 client.12177 fetch_fsmap learned FSMap version 175 2024-09-10T23:33:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 -- 172.21.15.17:0/3761275808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55610f153fa0 con 0x55610f388fd0 2024-09-10T23:33:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9ae2000640 1 -- 172.21.15.17:0/3761275808 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55610f167330 con 0x55610f388fd0 2024-09-10T23:33:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9ae2000640 1 -- 172.21.15.17:0/3761275808 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f9ae402c050 con 0x55610f388fd0 2024-09-10T23:33:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 10 client.12177 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 10 client.12177 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 20 client.12177 populate_metadata read hostname 'smithi017' 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55610f3bdee0 0x55610f3e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 4 client.12177 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9afebb1000 1 -- 172.21.15.17:0/3761275808 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55610f1e1ae0 con 0x55610f3bdee0 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.098+0000 7f9aebe00640 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55610f3bdee0 0x55610f3e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9ae2000640 10 client.12177 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9aebe00640 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55610f3bdee0 0x55610f3e38b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c0080b6fa400f6 server_cookie=c4f5643f013e91bb in_seq=0 out_seq=0 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9ae2000640 1 -- 172.21.15.17:0/3761275808 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55610f1e1ae0 con 0x55610f3bdee0 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9ae2000640 10 client.12177 handle_command_reply: tid=0 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 client.12177 shutdown 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 -- 172.21.15.17:0/3761275808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 msgr2=0x55610f3bca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3bca50 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007080 tx=0x7f9ae4011000 comp rx=0 tx=0).stop 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 -- 172.21.15.17:0/3761275808 shutdown_connections 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55610f3bdee0 0x55610f3e38b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2f20 0x55610f3bd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 0x55610f3bcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 --2- 172.21.15.17:0/3761275808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f3bca50 unknown :-1 s=CLOSED pgs=2649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 -- 172.21.15.17:0/3761275808 >> 172.21.15.17:0/3761275808 conn(0x55610f38ad20 msgr2=0x55610f38a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9ae2000640 0 client.12177 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 -- 172.21.15.17:0/3761275808 shutdown_connections 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 1 -- 172.21.15.17:0/3761275808 wait complete. 2024-09-10T23:33:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.102+0000 7f9afebb1000 20 client.12177 trim_cache size 0 max 16384 2024-09-10T23:33:07.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.118+0000 7f9afebb1000 1 Processor -- start 2024-09-10T23:33:07.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- start start 2024-09-10T23:33:07.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f38ad20 0x55610f445c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f446170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 0x55610f4466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9af4200610 con 0x55610f388fd0 2024-09-10T23:33:07.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9af406ecd0 con 0x55610f38ad20 2024-09-10T23:33:07.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9af40ca130 con 0x55610f3d2600 2024-09-10T23:33:07.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9aebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f446170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9aebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f446170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56442/0 (socket says 172.21.15.17:56442) 2024-09-10T23:33:07.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9aebe00640 1 -- 172.21.15.17:0/2554967447 learned_addr learned my addr 172.21.15.17:0/2554967447 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:07.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9af8e00640 1 --2- 172.21.15.17:0/2554967447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f38ad20 0x55610f445c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9af9800640 1 --2- 172.21.15.17:0/2554967447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 0x55610f4466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9aebe00640 1 -- 172.21.15.17:0/2554967447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 msgr2=0x55610f4466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9aebe00640 1 --2- 172.21.15.17:0/2554967447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 0x55610f4466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9aebe00640 1 -- 172.21.15.17:0/2554967447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f38ad20 msgr2=0x55610f445c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9aebe00640 1 --2- 172.21.15.17:0/2554967447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f38ad20 0x55610f445c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9aebe00640 1 -- 172.21.15.17:0/2554967447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610f22c660 con 0x55610f388fd0 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9aebe00640 1 --2- 172.21.15.17:0/2554967447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f446170 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7f9adc01af40 tx=0x7f9adc01b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd0fdc4e648eeff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9ae8c00640 1 -- 172.21.15.17:0/2554967447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0b2040 con 0x55610f388fd0 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9ae8c00640 1 -- 172.21.15.17:0/2554967447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9adc0bd030 con 0x55610f388fd0 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9ae8c00640 1 -- 172.21.15.17:0/2554967447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc005370 con 0x55610f388fd0 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- 172.21.15.17:0/2554967447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 msgr2=0x55610f446170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 --2- 172.21.15.17:0/2554967447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f446170 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7f9adc01af40 tx=0x7f9adc01b0d0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- 172.21.15.17:0/2554967447 shutdown_connections 2024-09-10T23:33:07.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 --2- 172.21.15.17:0/2554967447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f3d2600 0x55610f4466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 --2- 172.21.15.17:0/2554967447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f446170 unknown :-1 s=CLOSED pgs=2650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 --2- 172.21.15.17:0/2554967447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f38ad20 0x55610f445c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- 172.21.15.17:0/2554967447 >> 172.21.15.17:0/2554967447 conn(0x55610f3bd270 msgr2=0x55610f3835d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:07.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- 172.21.15.17:0/2554967447 shutdown_connections 2024-09-10T23:33:07.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- 172.21.15.17:0/2554967447 wait complete. 2024-09-10T23:33:07.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 -- start start 2024-09-10T23:33:07.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.122+0000 7f9afebb1000 1 Processor -- start 2024-09-10T23:33:07.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f4493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f38ad20 0x55610f4498f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 0x55610f449e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55610f174700 con 0x55610f388fd0 2024-09-10T23:33:07.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55610f195310 con 0x55610f3d2600 2024-09-10T23:33:07.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55610f38b100 con 0x55610f38ad20 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 10 client.0 _ll_register_callbacks cb 0x7f9ae40067e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f4493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f4493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56454/0 (socket says 172.21.15.17:56454) 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af8e00640 1 -- 172.21.15.17:0/880000092 learned_addr learned my addr 172.21.15.17:0/880000092 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af9800640 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 0x55610f449e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9aebe00640 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f38ad20 0x55610f4498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af8e00640 1 -- 172.21.15.17:0/880000092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f38ad20 msgr2=0x55610f4498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af8e00640 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f38ad20 0x55610f4498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af8e00640 1 -- 172.21.15.17:0/880000092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 msgr2=0x55610f449e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af8e00640 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 0x55610f449e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af8e00640 1 -- 172.21.15.17:0/880000092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610f199090 con 0x55610f388fd0 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9af8e00640 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f4493b0 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007760 tx=0x7f9ae4007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2279885e27ea2bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:07.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 1 -- 172.21.15.17:0/880000092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4034070 con 0x55610f388fd0 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 1 -- 172.21.15.17:0/880000092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f9ae4005240 con 0x55610f388fd0 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 -- 172.21.15.17:0/880000092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9adc0bd030 con 0x55610f388fd0 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 1 -- 172.21.15.17:0/880000092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f9ae403e050 con 0x55610f388fd0 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 10 client.12183 fetch_fsmap learned FSMap version 175 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 -- 172.21.15.17:0/880000092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55610f1655f0 con 0x55610f388fd0 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 1 -- 172.21.15.17:0/880000092 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9adc0bd030 con 0x55610f388fd0 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 1 -- 172.21.15.17:0/880000092 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f9ae402c030 con 0x55610f388fd0 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 10 client.12183 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 10 client.12183 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 20 client.12183 populate_metadata read hostname 'smithi017' 2024-09-10T23:33:07.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55610f3d2f20 0x55610f405800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 4 client.12183 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 -- 172.21.15.17:0/880000092 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55610f1dd590 con 0x55610f3d2f20 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9aebe00640 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55610f3d2f20 0x55610f405800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 10 client.12183 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9aebe00640 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55610f3d2f20 0x55610f405800 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=837a24a98213a7e7 server_cookie=d4ce599e9b856e17 in_seq=0 out_seq=0 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 1 -- 172.21.15.17:0/880000092 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x55610f1dd590 con 0x55610f3d2f20 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 10 client.12183 handle_command_reply: tid=0 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 client.12183 shutdown 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 -- 172.21.15.17:0/880000092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 msgr2=0x55610f4493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f4493b0 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4007760 tx=0x7f9ae4007790 comp rx=0 tx=0).stop 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 -- 172.21.15.17:0/880000092 shutdown_connections 2024-09-10T23:33:07.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55610f3d2f20 0x55610f405800 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55610f3d2600 0x55610f449e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55610f38ad20 0x55610f4498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 --2- 172.21.15.17:0/880000092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55610f388fd0 0x55610f4493b0 unknown :-1 s=CLOSED pgs=2651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9ae2000640 0 client.12183 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:33:07.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.126+0000 7f9afebb1000 1 -- 172.21.15.17:0/880000092 >> 172.21.15.17:0/880000092 conn(0x55610f3bd270 msgr2=0x55610f3e38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:07.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afebb1000 1 -- 172.21.15.17:0/880000092 shutdown_connections 2024-09-10T23:33:07.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afebb1000 1 -- 172.21.15.17:0/880000092 wait complete. 2024-09-10T23:33:07.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afebb1000 20 client.12183 trim_cache size 0 max 16384 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {}, 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_stats": { 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "3a6e6e99-208d-4714-a441-0d222f381ac0": { 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:32:36.686442+0000", 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:33:07.138 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: "2d178d1a-1c2b-4b3a-bac9-2473baf9bb71": { 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: "start_time": "2024-09-10T23:32:06.030783+0000", 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_started": 0, 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_passed": 0, 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_failed": 0, 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: "uninline_skipped": 0 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-10T23:33:07.139 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:07.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 -- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ad00725e0 msgr2=0x7f9ad0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ad00725e0 0x7f9ad0074aa0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4003ec0 tx=0x7f9ae4009040 comp rx=0 tx=0).stop 2024-09-10T23:33:07.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 -- 172.21.15.17:0/404928051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 msgr2=0x7f9af40b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 0x7f9af40b6dc0 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00ea20 tx=0x7f9aec00eee0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 -- 172.21.15.17:0/404928051 shutdown_connections 2024-09-10T23:33:07.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9ad00725e0 0x7f9ad0074aa0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9af415f5d0 0x7f9af40b6dc0 unknown :-1 s=CLOSED pgs=2647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9af415f1f0 0x7f9af40c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 --2- 172.21.15.17:0/404928051 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9af40d0770 0x7f9af4149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 -- 172.21.15.17:0/404928051 >> 172.21.15.17:0/404928051 conn(0x7f9af40d1bb0 msgr2=0x7f9af4156570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:07.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 -- 172.21.15.17:0/404928051 shutdown_connections 2024-09-10T23:33:07.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.130+0000 7f9afa200640 1 -- 172.21.15.17:0/404928051 wait complete. 2024-09-10T23:33:07.151 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T23:33:07.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:33:07.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.698+0000 7f6609200640 1 -- 172.21.15.17:0/516149044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 msgr2=0x7f660415b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.698+0000 7f6609200640 1 --2- 172.21.15.17:0/516149044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 0x7f660415b7b0 secure :-1 s=READY pgs=2652 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009900 tx=0x7f65ec01c8e0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 -- 172.21.15.17:0/516149044 shutdown_connections 2024-09-10T23:33:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 --2- 172.21.15.17:0/516149044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f660415bcf0 0x7f66040cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 --2- 172.21.15.17:0/516149044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 0x7f660415b7b0 unknown :-1 s=CLOSED pgs=2652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 -- 172.21.15.17:0/516149044 >> 172.21.15.17:0/516149044 conn(0x7f66040b1850 msgr2=0x7f66040b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 -- 172.21.15.17:0/516149044 shutdown_connections 2024-09-10T23:33:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 -- 172.21.15.17:0/516149044 wait complete. 2024-09-10T23:33:07.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 Processor -- start 2024-09-10T23:33:07.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 -- start start 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f660406f930 0x7f6604138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 0x7f66041f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f660415bcf0 0x7f66041f9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6604167b00 con 0x7f6604072800 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6604167980 con 0x7f660406f930 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6609200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6604167c80 con 0x7f660415bcf0 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f65fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 0x7f66041f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f65fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 0x7f66041f8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56470/0 (socket says 172.21.15.17:56470) 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f65fbe00640 1 -- 172.21.15.17:0/2011490093 learned_addr learned my addr 172.21.15.17:0/2011490093 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6601e00640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f660406f930 0x7f6604138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f6602800640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f660415bcf0 0x7f66041f9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f65fbe00640 1 -- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f660415bcf0 msgr2=0x7f66041f9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f65fbe00640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f660415bcf0 0x7f66041f9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f65fbe00640 1 -- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f660406f930 msgr2=0x7f6604138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f65fbe00640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f660406f930 0x7f6604138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f65fbe00640 1 -- 172.21.15.17:0/2011490093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6604152d90 con 0x7f6604072800 2024-09-10T23:33:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.702+0000 7f65fbe00640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 0x7f66041f8d00 secure :-1 s=READY pgs=2653 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009850 tx=0x7f65ec0a5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:07.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f65fa000640 1 -- 172.21.15.17:0/2011490093 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0b2040 con 0x7f6604072800 2024-09-10T23:33:07.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f65fa000640 1 -- 172.21.15.17:0/2011490093 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65ec004400 con 0x7f6604072800 2024-09-10T23:33:07.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f65fa000640 1 -- 172.21.15.17:0/2011490093 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0052d0 con 0x7f6604072800 2024-09-10T23:33:07.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6604153070 con 0x7f6604072800 2024-09-10T23:33:07.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6604153630 con 0x7f6604072800 2024-09-10T23:33:07.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6604075ad0 con 0x7f6604072800 2024-09-10T23:33:07.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f65fa000640 1 -- 172.21.15.17:0/2011490093 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f65ec005470 con 0x7f6604072800 2024-09-10T23:33:07.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f65fa000640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65e00725e0 0x7f65e0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:07.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f65fa000640 1 -- 172.21.15.17:0/2011490093 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f65ec12cbc0 con 0x7f6604072800 2024-09-10T23:33:07.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.706+0000 7f6601e00640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65e00725e0 0x7f65e0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:07.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.710+0000 7f6601e00640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65e00725e0 0x7f65e0074aa0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f6604154150 tx=0x7f65f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:07.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.710+0000 7f65fa000640 1 -- 172.21.15.17:0/2011490093 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f65ec0164d0 con 0x7f6604072800 2024-09-10T23:33:07.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.918+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f660415b7b0 con 0x7f6604072800 2024-09-10T23:33:07.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.918+0000 7f65fa000640 1 -- 172.21.15.17:0/2011490093 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+5239 (secure 0 0 0) 0x7f65ec0f8050 con 0x7f6604072800 2024-09-10T23:33:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:07.923 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":175,"btime":"2024-09-10T23:32:04:193424+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:32:04.193419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":224,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":12012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_12012":{"gid":12012,"name":"c","rank":0,"incarnation":172,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2426812353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2426812353},{"type":"v1","addr":"172.21.15.17:6835","nonce":2426812353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":12012,"qdb_cluster":[12012]},"id":16}]} 2024-09-10T23:33:07.924 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 175 2024-09-10T23:33:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65e00725e0 msgr2=0x7f65e0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65e00725e0 0x7f65e0074aa0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f6604154150 tx=0x7f65f4009040 comp rx=0 tx=0).stop 2024-09-10T23:33:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 msgr2=0x7f66041f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 0x7f66041f8d00 secure :-1 s=READY pgs=2653 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009850 tx=0x7f65ec0a5760 comp rx=0 tx=0).stop 2024-09-10T23:33:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 shutdown_connections 2024-09-10T23:33:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f65e00725e0 0x7f65e0074aa0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f660415bcf0 0x7f66041f9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604072800 0x7f66041f8d00 unknown :-1 s=CLOSED pgs=2653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 --2- 172.21.15.17:0/2011490093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f660406f930 0x7f6604138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:07.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 >> 172.21.15.17:0/2011490093 conn(0x7f66040b1850 msgr2=0x7f6604154460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:07.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 shutdown_connections 2024-09-10T23:33:07.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:07.922+0000 7f6609200640 1 -- 172.21.15.17:0/2011490093 wait complete. 2024-09-10T23:33:07.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 175, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T23:31:49.429993+0000', 'modified': '2024-09-10T23:32:04.193419+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 224, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 12012}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_12012': {'gid': 12012, 'name': 'c', 'rank': 0, 'incarnation': 172, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.17:6835/2426812353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6833', 'nonce': 2426812353}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 2426812353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 12012, 'qdb_cluster': [12012]} 2024-09-10T23:33:07.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T23:33:07.946 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T23:33:08.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 -- 172.21.15.17:0/1152262714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 msgr2=0x7f62440d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 --2- 172.21.15.17:0/1152262714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 0x7f62440d2860 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 crypto rx=0x7f62440743b0 tx=0x7f623801f0b0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 -- 172.21.15.17:0/1152262714 shutdown_connections 2024-09-10T23:33:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 --2- 172.21.15.17:0/1152262714 >> v2:172.21.15.77:3300/0 conn(0x7f62440cd110 0x7f62440ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 --2- 172.21.15.17:0/1152262714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 0x7f62440d2860 unknown :-1 s=CLOSED pgs=2654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 -- 172.21.15.17:0/1152262714 >> 172.21.15.17:0/1152262714 conn(0x7f62440d1d40 msgr2=0x7f62440d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 -- 172.21.15.17:0/1152262714 shutdown_connections 2024-09-10T23:33:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 -- 172.21.15.17:0/1152262714 wait complete. 2024-09-10T23:33:08.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 Processor -- start 2024-09-10T23:33:08.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.090+0000 7f624c800640 1 -- start start 2024-09-10T23:33:08.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f624c800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62440cd110 0x7f6244153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f624c800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 0x7f62440c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f624c800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62440d0280 0x7f62440c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f624c800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f62440b1b30 con 0x7f62440cfea0 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f624c800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f62440b19b0 con 0x7f62440d0280 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f624c800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f62440b1cb0 con 0x7f62440cd110 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 0x7f62440c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62440cd110 0x7f6244153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 0x7f62440c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56488/0 (socket says 172.21.15.17:56488) 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249400640 1 -- 172.21.15.17:0/1094546876 learned_addr learned my addr 172.21.15.17:0/1094546876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f624a800640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62440d0280 0x7f62440c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249400640 1 -- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62440cd110 msgr2=0x7f6244153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249400640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62440cd110 0x7f6244153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249400640 1 -- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62440d0280 msgr2=0x7f62440c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249400640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62440d0280 0x7f62440c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249400640 1 -- 172.21.15.17:0/1094546876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62441540b0 con 0x7f62440cfea0 2024-09-10T23:33:08.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f6249400640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 0x7f62440c7890 secure :-1 s=READY pgs=2655 cs=0 l=1 rev1=1 crypto rx=0x7f623400d950 tx=0x7f623400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f623e000640 1 -- 172.21.15.17:0/1094546876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234017070 con 0x7f62440cfea0 2024-09-10T23:33:08.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f623e000640 1 -- 172.21.15.17:0/1094546876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6234009d20 con 0x7f62440cfea0 2024-09-10T23:33:08.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f623e000640 1 -- 172.21.15.17:0/1094546876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62340106c0 con 0x7f62440cfea0 2024-09-10T23:33:08.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f624c800640 1 -- 172.21.15.17:0/1094546876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62440b4fe0 con 0x7f62440cfea0 2024-09-10T23:33:08.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.094+0000 7f624c800640 1 -- 172.21.15.17:0/1094546876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62440b7870 con 0x7f62440cfea0 2024-09-10T23:33:08.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f623e000640 1 -- 172.21.15.17:0/1094546876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6234010860 con 0x7f62440cfea0 2024-09-10T23:33:08.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f623e000640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62280725e0 0x7f6228074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624fcba000 1 Processor -- start 2024-09-10T23:33:08.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f623e000640 1 -- 172.21.15.17:0/1094546876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f6234093860 con 0x7f62440cfea0 2024-09-10T23:33:08.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f6249e00640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62280725e0 0x7f6228074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624fcba000 1 -- start start 2024-09-10T23:33:08.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f6249e00640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62280725e0 0x7f6228074aa0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f62380b2000 tx=0x7f623801d8f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624fcba000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7cdf9d0 0x55d8c7cdfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624fcba000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c938d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624fcba000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7c941f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624fcba000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d8c7bb43f0 con 0x55d8c7c93e10 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624fcba000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d8c7af1b20 con 0x55d8c7ce02f0 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624fcba000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d8c7ae0f50 con 0x55d8c7cdf9d0 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7c941f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7c941f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56504/0 (socket says 172.21.15.17:56504) 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624a800640 1 -- 172.21.15.17:0/1356675871 learned_addr learned my addr 172.21.15.17:0/1356675871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f6249e00640 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7cdf9d0 0x55d8c7cdfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f6249400640 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624a800640 1 -- 172.21.15.17:0/1356675871 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7cdf9d0 msgr2=0x55d8c7cdfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624a800640 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7cdf9d0 0x55d8c7cdfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624a800640 1 -- 172.21.15.17:0/1356675871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7ce02f0 msgr2=0x55d8c7c938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624a800640 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624a800640 1 -- 172.21.15.17:0/1356675871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c7aa8590 con 0x55d8c7c93e10 2024-09-10T23:33:08.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f6249400640 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:08.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.098+0000 7f624a800640 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7c941f0 secure :-1 s=READY pgs=2656 cs=0 l=1 rev1=1 crypto rx=0x7f624000b480 tx=0x7f6240009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e73065369b5bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f6232a00640 1 -- 172.21.15.17:0/1356675871 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240003980 con 0x55d8c7c93e10 2024-09-10T23:33:08.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f6232a00640 1 -- 172.21.15.17:0/1356675871 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6240003b20 con 0x55d8c7c93e10 2024-09-10T23:33:08.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f6232a00640 1 -- 172.21.15.17:0/1356675871 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624000a710 con 0x55d8c7c93e10 2024-09-10T23:33:08.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 -- 172.21.15.17:0/1356675871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 msgr2=0x55d8c7c941f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7c941f0 secure :-1 s=READY pgs=2656 cs=0 l=1 rev1=1 crypto rx=0x7f624000b480 tx=0x7f6240009630 comp rx=0 tx=0).stop 2024-09-10T23:33:08.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 -- 172.21.15.17:0/1356675871 shutdown_connections 2024-09-10T23:33:08.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7c941f0 unknown :-1 s=CLOSED pgs=2656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 --2- 172.21.15.17:0/1356675871 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7cdf9d0 0x55d8c7cdfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 -- 172.21.15.17:0/1356675871 >> 172.21.15.17:0/1356675871 conn(0x55d8c7b7d130 msgr2=0x55d8c7cc2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 -- 172.21.15.17:0/1356675871 shutdown_connections 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 -- 172.21.15.17:0/1356675871 wait complete. 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 -- start start 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 Processor -- start 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 0x55d8c7c95240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7c95780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c95cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d8c7a7b5d0 con 0x55d8c7ce02f0 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d8c7ae4d60 con 0x55d8c7cdf9d0 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d8c7a87500 con 0x55d8c7c93e10 2024-09-10T23:33:08.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624fcba000 10 client.0 _ll_register_callbacks cb 0x55d8c7a8b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c95cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c95cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56516/0 (socket says 172.21.15.17:56516) 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624a800640 1 -- 172.21.15.17:0/2335496710 learned_addr learned my addr 172.21.15.17:0/2335496710 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f6249e00640 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 0x55d8c7c95240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f6249400640 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7c95780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624a800640 1 -- 172.21.15.17:0/2335496710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 msgr2=0x55d8c7c95240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624a800640 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 0x55d8c7c95240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624a800640 1 -- 172.21.15.17:0/2335496710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 msgr2=0x55d8c7c95780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624a800640 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7c95780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624a800640 1 -- 172.21.15.17:0/2335496710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8c7a7f170 con 0x55d8c7ce02f0 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f624a800640 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c95cc0 secure :-1 s=READY pgs=2657 cs=0 l=1 rev1=1 crypto rx=0x7f6240015000 tx=0x7f6240003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39da6a2b7daab9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.102+0000 7f6227400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6227400640 1 -- 172.21.15.17:0/2335496710 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240024070 con 0x55d8c7ce02f0 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6227400640 1 -- 172.21.15.17:0/2335496710 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f624000ab20 con 0x55d8c7ce02f0 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 -- 172.21.15.17:0/2335496710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d8c7a790f0 con 0x55d8c7ce02f0 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6227400640 1 -- 172.21.15.17:0/2335496710 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f624002f050 con 0x55d8c7ce02f0 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 10 client.12201 fetch_fsmap learned FSMap version 175 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 -- 172.21.15.17:0/2335496710 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55d8c7b65ef0 con 0x55d8c7ce02f0 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6227400640 1 -- 172.21.15.17:0/2335496710 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d8c7a790f0 con 0x55d8c7ce02f0 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6227400640 1 -- 172.21.15.17:0/2335496710 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f6240032020 con 0x55d8c7ce02f0 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 10 client.12201 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 10 client.12201 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:33:08.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 20 client.12201 populate_metadata read hostname 'smithi017' 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55d8c7ceec70 0x55d8c7cf1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 4 client.12201 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 -- 172.21.15.17:0/2335496710 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8c7af3a70 con 0x55d8c7ceec70 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6249e00640 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55d8c7ceec70 0x55d8c7cf1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6249e00640 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55d8c7ceec70 0x55d8c7cf1060 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b17646d4d54d16 server_cookie=4bd077331742e21b in_seq=0 out_seq=0 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6227400640 10 client.12201 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6227400640 1 -- 172.21.15.17:0/2335496710 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d8c7af3a70 con 0x55d8c7ceec70 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6227400640 10 client.12201 handle_command_reply: tid=0 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 client.12201 shutdown 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 -- 172.21.15.17:0/2335496710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 msgr2=0x55d8c7c95cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c95cc0 secure :-1 s=READY pgs=2657 cs=0 l=1 rev1=1 crypto rx=0x7f6240015000 tx=0x7f6240003f20 comp rx=0 tx=0).stop 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 -- 172.21.15.17:0/2335496710 shutdown_connections 2024-09-10T23:33:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55d8c7ceec70 0x55d8c7cf1060 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7c95cc0 unknown :-1 s=CLOSED pgs=2657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7c95780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 --2- 172.21.15.17:0/2335496710 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 0x55d8c7c95240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f6227400640 0 client.12201 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:33:08.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 -- 172.21.15.17:0/2335496710 >> 172.21.15.17:0/2335496710 conn(0x55d8c7b7d130 msgr2=0x55d8c7c92fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 -- 172.21.15.17:0/2335496710 shutdown_connections 2024-09-10T23:33:08.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 1 -- 172.21.15.17:0/2335496710 wait complete. 2024-09-10T23:33:08.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.106+0000 7f624fcba000 20 client.12201 trim_cache size 0 max 16384 2024-09-10T23:33:08.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624fcba000 1 Processor -- start 2024-09-10T23:33:08.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624fcba000 1 -- start start 2024-09-10T23:33:08.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624fcba000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 0x55d8c7d511b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624fcba000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7d516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624fcba000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7d51c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624fcba000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6244200af0 con 0x55d8c7ce02f0 2024-09-10T23:33:08.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624fcba000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f62441f5740 con 0x55d8c7cdf9d0 2024-09-10T23:33:08.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624fcba000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f62442004a0 con 0x55d8c7c93e10 2024-09-10T23:33:08.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7d51c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7d51c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56532/0 (socket says 172.21.15.17:56532) 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624a800640 1 -- 172.21.15.17:0/3245616920 learned_addr learned my addr 172.21.15.17:0/3245616920 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f6249e00640 1 --2- 172.21.15.17:0/3245616920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 0x55d8c7d511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f6249400640 1 --2- 172.21.15.17:0/3245616920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7d516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624a800640 1 -- 172.21.15.17:0/3245616920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 msgr2=0x55d8c7d511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624a800640 1 --2- 172.21.15.17:0/3245616920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 0x55d8c7d511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624a800640 1 -- 172.21.15.17:0/3245616920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 msgr2=0x55d8c7d516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624a800640 1 --2- 172.21.15.17:0/3245616920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7d516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624a800640 1 -- 172.21.15.17:0/3245616920 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c7b3cd90 con 0x55d8c7ce02f0 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f624a800640 1 --2- 172.21.15.17:0/3245616920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7d51c30 secure :-1 s=READY pgs=2658 cs=0 l=1 rev1=1 crypto rx=0x7f6240003cc0 tx=0x7f6240009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d6cc0b8e82a0fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f6232000640 1 -- 172.21.15.17:0/3245616920 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240024070 con 0x55d8c7ce02f0 2024-09-10T23:33:08.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f6232000640 1 -- 172.21.15.17:0/3245616920 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6240009970 con 0x55d8c7ce02f0 2024-09-10T23:33:08.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.126+0000 7f6232000640 1 -- 172.21.15.17:0/3245616920 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624000a920 con 0x55d8c7ce02f0 2024-09-10T23:33:08.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- 172.21.15.17:0/3245616920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 msgr2=0x55d8c7d51c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 --2- 172.21.15.17:0/3245616920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7d51c30 secure :-1 s=READY pgs=2658 cs=0 l=1 rev1=1 crypto rx=0x7f6240003cc0 tx=0x7f6240009630 comp rx=0 tx=0).stop 2024-09-10T23:33:08.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- 172.21.15.17:0/3245616920 shutdown_connections 2024-09-10T23:33:08.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 --2- 172.21.15.17:0/3245616920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7ce02f0 0x55d8c7d51c30 unknown :-1 s=CLOSED pgs=2658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 --2- 172.21.15.17:0/3245616920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7d516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 --2- 172.21.15.17:0/3245616920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7c93e10 0x55d8c7d511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- 172.21.15.17:0/3245616920 >> 172.21.15.17:0/3245616920 conn(0x55d8c7b7d130 msgr2=0x55d8c7c93180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- 172.21.15.17:0/3245616920 shutdown_connections 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- 172.21.15.17:0/3245616920 wait complete. 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- start start 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 Processor -- start 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7cf6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7d11580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7ce02f0 0x55d8c7d11ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x55d8c7ae4070 con 0x55d8c7c93e10 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d8c7ae9390 con 0x55d8c7cdf9d0 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x55d8c7af08f0 con 0x55d8c7ce02f0 2024-09-10T23:33:08.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 10 client.0 _ll_register_callbacks cb 0x7f6238009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7cf6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7cf6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56546/0 (socket says 172.21.15.17:56546) 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249e00640 1 -- 172.21.15.17:0/4251538459 learned_addr learned my addr 172.21.15.17:0/4251538459 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249400640 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7d11580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624a800640 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7ce02f0 0x55d8c7d11ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249e00640 1 -- 172.21.15.17:0/4251538459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7ce02f0 msgr2=0x55d8c7d11ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249e00640 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7ce02f0 0x55d8c7d11ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249e00640 1 -- 172.21.15.17:0/4251538459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 msgr2=0x55d8c7d11580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249e00640 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7d11580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249e00640 1 -- 172.21.15.17:0/4251538459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8c7aa7a90 con 0x55d8c7c93e10 2024-09-10T23:33:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6249e00640 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7cf6160 secure :-1 s=READY pgs=2659 cs=0 l=1 rev1=1 crypto rx=0x7f6238009230 tx=0x7f6238009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c7281893167ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6227400640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6227400640 1 -- 172.21.15.17:0/4251538459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62380b5040 con 0x55d8c7c93e10 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6227400640 1 -- 172.21.15.17:0/4251538459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f62380b0440 con 0x55d8c7c93e10 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- 172.21.15.17:0/4251538459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6240009970 con 0x55d8c7c93e10 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f6227400640 1 -- 172.21.15.17:0/4251538459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=175) ==== 24+0+0 (secure 0 0 0) 0x7f62380df050 con 0x55d8c7c93e10 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 10 client.12207 fetch_fsmap learned FSMap version 175 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.130+0000 7f624fcba000 1 -- 172.21.15.17:0/4251538459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=175,monmap=2+}) -- 0x55d8c7a86050 con 0x55d8c7c93e10 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f6227400640 1 -- 172.21.15.17:0/4251538459 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6240009970 con 0x55d8c7c93e10 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f6227400640 1 -- 172.21.15.17:0/4251538459 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 175) ==== 3502+0+0 (secure 0 0 0) 0x7f62380e2020 con 0x55d8c7c93e10 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 10 client.12207 fetch_fsmap finished waiting for FSMap version 175 2024-09-10T23:33:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 10 client.12207 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 20 client.12207 populate_metadata read hostname 'smithi017' 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55d8c7d12000 0x55d8c7d551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 4 client.12207 mds_command: new command op to 12012 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 -- 172.21.15.17:0/4251538459 --> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] -- command(tid 0: {"prefix": "status"}) -- 0x55d8c7aef520 con 0x55d8c7d12000 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f6249400640 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55d8c7d12000 0x55d8c7d551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f6249400640 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55d8c7d12000 0x55d8c7d551f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=286b3a628de243a server_cookie=a3f8cbbb362e4a70 in_seq=0 out_seq=0 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f6227400640 10 client.12207 ms_handle_connect on v2:172.21.15.17:6833/2426812353 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f6227400640 1 -- 172.21.15.17:0/4251538459 <== mds.0 v2:172.21.15.17:6833/2426812353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55d8c7aef520 con 0x55d8c7d12000 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f6227400640 10 client.12207 handle_command_reply: tid=0 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 client.12207 shutdown 2024-09-10T23:33:08.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 -- 172.21.15.17:0/4251538459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 msgr2=0x55d8c7cf6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7cf6160 secure :-1 s=READY pgs=2659 cs=0 l=1 rev1=1 crypto rx=0x7f6238009230 tx=0x7f6238009260 comp rx=0 tx=0).stop 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 -- 172.21.15.17:0/4251538459 shutdown_connections 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.17:6833/2426812353,v1:172.21.15.17:6835/2426812353] conn(0x55d8c7d12000 0x55d8c7d551f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55d8c7ce02f0 0x55d8c7d11ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d8c7cdf9d0 0x55d8c7d11580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 --2- 172.21.15.17:0/4251538459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8c7c93e10 0x55d8c7cf6160 unknown :-1 s=CLOSED pgs=2659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f6227400640 0 client.12207 ms_handle_reset on v2:172.21.15.17:6833/2426812353 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 -- 172.21.15.17:0/4251538459 >> 172.21.15.17:0/4251538459 conn(0x55d8c7b7d130 msgr2=0x55d8c7cf1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 -- 172.21.15.17:0/4251538459 shutdown_connections 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 1 -- 172.21.15.17:0/4251538459 wait complete. 2024-09-10T23:33:08.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624fcba000 20 client.12207 trim_cache size 0 max 16384 2024-09-10T23:33:08.143 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442", 2024-09-10T23:33:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-09-10T23:33:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 12012, 2024-09-10T23:33:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-09-10T23:33:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-09-10T23:33:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-09-10T23:33:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 66.948845059000007, 2024-09-10T23:33:08.143 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 175, 2024-09-10T23:33:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 226, 2024-09-10T23:33:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 224, 2024-09-10T23:33:08.144 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 67.895005601999998 2024-09-10T23:33:08.144 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:08.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 -- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62280725e0 msgr2=0x7f6228074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62280725e0 0x7f6228074aa0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f62380b2000 tx=0x7f623801d8f0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 -- 172.21.15.17:0/1094546876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 msgr2=0x7f62440c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 0x7f62440c7890 secure :-1 s=READY pgs=2655 cs=0 l=1 rev1=1 crypto rx=0x7f623400d950 tx=0x7f623400de10 comp rx=0 tx=0).stop 2024-09-10T23:33:08.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 -- 172.21.15.17:0/1094546876 shutdown_connections 2024-09-10T23:33:08.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f62280725e0 0x7f6228074aa0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62440d0280 0x7f62440c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440cfea0 0x7f62440c7890 unknown :-1 s=CLOSED pgs=2655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 --2- 172.21.15.17:0/1094546876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62440cd110 0x7f6244153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 -- 172.21.15.17:0/1094546876 >> 172.21.15.17:0/1094546876 conn(0x7f62440d1d40 msgr2=0x7f62440cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 -- 172.21.15.17:0/1094546876 shutdown_connections 2024-09-10T23:33:08.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.134+0000 7f624c800640 1 -- 172.21.15.17:0/1094546876 wait complete. 2024-09-10T23:33:08.157 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T23:33:08.157 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:33:08.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T23:33:08.299 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T23:33:08.300 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:33:08.300 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:33:08.300 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:33:08.309 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:33:08.309 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:33:08.309 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:33:08.309 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:33:08.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:33:08.321 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:33:08.321 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:33:08.321 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:33:08.359 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:33:08.359 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T23:33:08.359 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:33:08.359 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:33:08.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:33:08.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:33:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.546+0000 7fd479c00640 1 -- 172.21.15.17:0/2476807782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 msgr2=0x7fd4741600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.546+0000 7fd479c00640 1 --2- 172.21.15.17:0/2476807782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 0x7fd4741600f0 secure :-1 s=READY pgs=2661 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009bc0 tx=0x7fd46c01cb70 comp rx=0 tx=0).stop 2024-09-10T23:33:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.546+0000 7fd479c00640 1 -- 172.21.15.17:0/2476807782 shutdown_connections 2024-09-10T23:33:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.546+0000 7fd479c00640 1 --2- 172.21.15.17:0/2476807782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 0x7fd4741600f0 unknown :-1 s=CLOSED pgs=2661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.546+0000 7fd479c00640 1 --2- 172.21.15.17:0/2476807782 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4740cfb70 0x7fd4740cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.546+0000 7fd479c00640 1 -- 172.21.15.17:0/2476807782 >> 172.21.15.17:0/2476807782 conn(0x7fd4740d1d40 msgr2=0x7fd4740d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.546+0000 7fd479c00640 1 -- 172.21.15.17:0/2476807782 shutdown_connections 2024-09-10T23:33:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.546+0000 7fd479c00640 1 -- 172.21.15.17:0/2476807782 wait complete. 2024-09-10T23:33:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 Processor -- start 2024-09-10T23:33:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 -- start start 2024-09-10T23:33:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4740b2fc0 0x7fd4740c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740cfb70 0x7fd4740c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 0x7fd4740c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fd474168f60 con 0x7fd47415fc90 2024-09-10T23:33:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4740b0990 con 0x7fd4740cfb70 2024-09-10T23:33:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fd4741690e0 con 0x7fd4740b2fc0 2024-09-10T23:33:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd473400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 0x7fd4740c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd473400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 0x7fd4740c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56572/0 (socket says 172.21.15.17:56572) 2024-09-10T23:33:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd472a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4740b2fc0 0x7fd4740c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd473400640 1 -- 172.21.15.17:0/3050498045 learned_addr learned my addr 172.21.15.17:0/3050498045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd46be00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740cfb70 0x7fd4740c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd473400640 1 -- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4740b2fc0 msgr2=0x7fd4740c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd473400640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4740b2fc0 0x7fd4740c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd473400640 1 -- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740cfb70 msgr2=0x7fd4740c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd473400640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740cfb70 0x7fd4740c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd473400640 1 -- 172.21.15.17:0/3050498045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd474151520 con 0x7fd47415fc90 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd473400640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 0x7fd4740c5ad0 secure :-1 s=READY pgs=2662 cs=0 l=1 rev1=1 crypto rx=0x7fd46c01a7a0 tx=0x7fd46c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd46aa00640 1 -- 172.21.15.17:0/3050498045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0bb070 con 0x7fd47415fc90 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd46aa00640 1 -- 172.21.15.17:0/3050498045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd46c004d40 con 0x7fd47415fc90 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4740ce880 con 0x7fd47415fc90 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd46aa00640 1 -- 172.21.15.17:0/3050498045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0b2040 con 0x7fd47415fc90 2024-09-10T23:33:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4740cee40 con 0x7fd47415fc90 2024-09-10T23:33:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.550+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4741600f0 con 0x7fd47415fc90 2024-09-10T23:33:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.554+0000 7fd46aa00640 1 -- 172.21.15.17:0/3050498045 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fd46c0b5030 con 0x7fd47415fc90 2024-09-10T23:33:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.554+0000 7fd46aa00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4500725e0 0x7fd450074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.554+0000 7fd46aa00640 1 -- 172.21.15.17:0/3050498045 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7fd46c12cfc0 con 0x7fd47415fc90 2024-09-10T23:33:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.554+0000 7fd472a00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4500725e0 0x7fd450074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.554+0000 7fd472a00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4500725e0 0x7fd450074aa0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd464005d90 tx=0x7fd46400b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.558+0000 7fd46aa00640 1 -- 172.21.15.17:0/3050498045 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fd46c016790 con 0x7fd47415fc90 2024-09-10T23:33:08.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.770+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd474071d50 con 0x7fd47415fc90 2024-09-10T23:33:08.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.770+0000 7fd46aa00640 1 -- 172.21.15.17:0/3050498045 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+5239 (secure 0 0 0) 0x7fd46c0f7d70 con 0x7fd47415fc90 2024-09-10T23:33:08.774 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:08.775 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":175,"btime":"2024-09-10T23:32:04:193424+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:32:04.193419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":224,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":12012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_12012":{"gid":12012,"name":"c","rank":0,"incarnation":172,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2426812353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2426812353},{"type":"v1","addr":"172.21.15.17:6835","nonce":2426812353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":12012,"qdb_cluster":[12012]},"id":16}]} 2024-09-10T23:33:08.775 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 175 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4500725e0 msgr2=0x7fd450074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4500725e0 0x7fd450074aa0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd464005d90 tx=0x7fd46400b390 comp rx=0 tx=0).stop 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 msgr2=0x7fd4740c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 0x7fd4740c5ad0 secure :-1 s=READY pgs=2662 cs=0 l=1 rev1=1 crypto rx=0x7fd46c01a7a0 tx=0x7fd46c009260 comp rx=0 tx=0).stop 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 shutdown_connections 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fd4500725e0 0x7fd450074aa0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd47415fc90 0x7fd4740c5ad0 unknown :-1 s=CLOSED pgs=2662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4740cfb70 0x7fd4740c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 --2- 172.21.15.17:0/3050498045 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4740b2fc0 0x7fd4740c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 >> 172.21.15.17:0/3050498045 conn(0x7fd4740d1d40 msgr2=0x7fd474071640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 shutdown_connections 2024-09-10T23:33:08.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.774+0000 7fd479c00640 1 -- 172.21.15.17:0/3050498045 wait complete. 2024-09-10T23:33:08.798 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:33:08.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 -- 172.21.15.17:0/185483779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c15f550 msgr2=0x7f5d7c0d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 --2- 172.21.15.17:0/185483779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c15f550 0x7f5d7c0d0070 secure :-1 s=READY pgs=2663 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009900 tx=0x7f5d6801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 -- 172.21.15.17:0/185483779 shutdown_connections 2024-09-10T23:33:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 --2- 172.21.15.17:0/185483779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c15f550 0x7f5d7c0d0070 unknown :-1 s=CLOSED pgs=2663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 --2- 172.21.15.17:0/185483779 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d7c15f170 0x7f5d7c0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 -- 172.21.15.17:0/185483779 >> 172.21.15.17:0/185483779 conn(0x7f5d7c0d1bc0 msgr2=0x7f5d7c0d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 -- 172.21.15.17:0/185483779 shutdown_connections 2024-09-10T23:33:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 -- 172.21.15.17:0/185483779 wait complete. 2024-09-10T23:33:08.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 Processor -- start 2024-09-10T23:33:08.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.966+0000 7f5d82a00640 1 -- start start 2024-09-10T23:33:08.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c0b30d0 0x7f5d7c0cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c15f170 0x7f5d7c150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d7c15f550 0x7f5d7c0cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c169140 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c168fc0 con 0x7f5d7c15f170 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7c1692c0 con 0x7f5d7c15f550 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d81600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c0b30d0 0x7f5d7c0cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d81600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c0b30d0 0x7f5d7c0cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56604/0 (socket says 172.21.15.17:56604) 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d81600640 1 -- 172.21.15.17:0/3850007479 learned_addr learned my addr 172.21.15.17:0/3850007479 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d80c00640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c15f170 0x7f5d7c150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82000640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d7c15f550 0x7f5d7c0cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d81600640 1 -- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d7c15f550 msgr2=0x7f5d7c0cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d81600640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d7c15f550 0x7f5d7c0cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d81600640 1 -- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c15f170 msgr2=0x7f5d7c150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d81600640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c15f170 0x7f5d7c150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:08.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d81600640 1 -- 172.21.15.17:0/3850007479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c150570 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d81600640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c0b30d0 0x7f5d7c0cee50 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000d9b0 tx=0x7f5d7000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d79600640 1 -- 172.21.15.17:0/3850007479 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70017070 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d79600640 1 -- 172.21.15.17:0/3850007479 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d70009cc0 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d79600640 1 -- 172.21.15.17:0/3850007479 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70005280 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7c15de40 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7c0cc9e0 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.970+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7c0b12f0 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.974+0000 7f5d79600640 1 -- 172.21.15.17:0/3850007479 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5d70005420 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.974+0000 7f5d79600640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d5c0725e0 0x7f5d5c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:08.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.974+0000 7f5d79600640 1 -- 172.21.15.17:0/3850007479 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f5d700936a0 con 0x7f5d7c0b30d0 2024-09-10T23:33:08.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.974+0000 7f5d80c00640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d5c0725e0 0x7f5d5c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:08.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.974+0000 7f5d80c00640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d5c0725e0 0x7f5d5c074aa0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5d680af000 tx=0x7f5d6801b120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:08.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:08.978+0000 7f5d79600640 1 -- 172.21.15.17:0/3850007479 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5d7005e4e0 con 0x7f5d7c0b30d0 2024-09-10T23:33:09.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:33:09.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:33:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.194+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d7c15c210 con 0x7f5d7c0b30d0 2024-09-10T23:33:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.194+0000 7f5d79600640 1 -- 172.21.15.17:0/3850007479 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+5239 (secure 0 0 0) 0x7f5d70067250 con 0x7f5d7c0b30d0 2024-09-10T23:33:09.199 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:09.199 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":175,"btime":"2024-09-10T23:32:04:193424+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:32:04.193419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":224,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":12012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_12012":{"gid":12012,"name":"c","rank":0,"incarnation":172,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2426812353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2426812353},{"type":"v1","addr":"172.21.15.17:6835","nonce":2426812353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":12012,"qdb_cluster":[12012]},"id":16}]} 2024-09-10T23:33:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 175 2024-09-10T23:33:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d5c0725e0 msgr2=0x7f5d5c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d5c0725e0 0x7f5d5c074aa0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5d680af000 tx=0x7f5d6801b120 comp rx=0 tx=0).stop 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c0b30d0 msgr2=0x7f5d7c0cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c0b30d0 0x7f5d7c0cee50 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000d9b0 tx=0x7f5d7000de70 comp rx=0 tx=0).stop 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 shutdown_connections 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5d5c0725e0 0x7f5d5c074aa0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5d7c15f550 0x7f5d7c0cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d7c15f170 0x7f5d7c150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 --2- 172.21.15.17:0/3850007479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d7c0b30d0 0x7f5d7c0cee50 unknown :-1 s=CLOSED pgs=2664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 >> 172.21.15.17:0/3850007479 conn(0x7f5d7c0d1bc0 msgr2=0x7f5d7c15b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 shutdown_connections 2024-09-10T23:33:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.198+0000 7f5d82a00640 1 -- 172.21.15.17:0/3850007479 wait complete. 2024-09-10T23:33:09.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:33:09.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 -- 172.21.15.17:0/703499278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600b27b0 msgr2=0x7f4a600d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 --2- 172.21.15.17:0/703499278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600b27b0 0x7f4a600d2860 secure :-1 s=READY pgs=2666 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009bc0 tx=0x7f4a5801f3b0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 -- 172.21.15.17:0/703499278 shutdown_connections 2024-09-10T23:33:09.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 --2- 172.21.15.17:0/703499278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600b27b0 0x7f4a600d2860 unknown :-1 s=CLOSED pgs=2666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 -- 172.21.15.17:0/703499278 >> 172.21.15.17:0/703499278 conn(0x7f4a600d1d40 msgr2=0x7f4a600d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:09.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 -- 172.21.15.17:0/703499278 shutdown_connections 2024-09-10T23:33:09.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 -- 172.21.15.17:0/703499278 wait complete. 2024-09-10T23:33:09.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 Processor -- start 2024-09-10T23:33:09.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 -- start start 2024-09-10T23:33:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a600b27b0 0x7f4a601536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a600cd110 0x7f4a601f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600cfea0 0x7f4a600c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f4a601670f0 con 0x7f4a600cfea0 2024-09-10T23:33:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4a600d05d0 con 0x7f4a600b27b0 2024-09-10T23:33:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a64c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f4a60167270 con 0x7f4a600cd110 2024-09-10T23:33:09.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a5e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600cfea0 0x7f4a600c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a5e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600cfea0 0x7f4a600c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56628/0 (socket says 172.21.15.17:56628) 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a5e800640 1 -- 172.21.15.17:0/2278716450 learned_addr learned my addr 172.21.15.17:0/2278716450 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a5de00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a600b27b0 0x7f4a601536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a57e00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a600cd110 0x7f4a601f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a5e800640 1 -- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a600cd110 msgr2=0x7f4a601f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a5e800640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a600cd110 0x7f4a601f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a5e800640 1 -- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a600b27b0 msgr2=0x7f4a601536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a5e800640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a600b27b0 0x7f4a601536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.366+0000 7f4a5e800640 1 -- 172.21.15.17:0/2278716450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a600ca400 con 0x7f4a600cfea0 2024-09-10T23:33:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a5e800640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600cfea0 0x7f4a600c9820 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f4a5801cfe0 tx=0x7f4a580af580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a56000640 1 -- 172.21.15.17:0/2278716450 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a580b4040 con 0x7f4a600cfea0 2024-09-10T23:33:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a56000640 1 -- 172.21.15.17:0/2278716450 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a580bf070 con 0x7f4a600cfea0 2024-09-10T23:33:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a56000640 1 -- 172.21.15.17:0/2278716450 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a580b09b0 con 0x7f4a600cfea0 2024-09-10T23:33:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a600ca6e0 con 0x7f4a600cfea0 2024-09-10T23:33:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a600c9300 con 0x7f4a600cfea0 2024-09-10T23:33:09.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a600c8e10 con 0x7f4a600cfea0 2024-09-10T23:33:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a56000640 1 -- 172.21.15.17:0/2278716450 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f4a580b0b70 con 0x7f4a600cfea0 2024-09-10T23:33:09.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a56000640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a3c0725e0 0x7f4a3c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a56000640 1 -- 172.21.15.17:0/2278716450 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f4a58131720 con 0x7f4a600cfea0 2024-09-10T23:33:09.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.370+0000 7f4a5de00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a3c0725e0 0x7f4a3c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.374+0000 7f4a5de00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a3c0725e0 0x7f4a3c074aa0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f4a500098e0 tx=0x7f4a50009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:09.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.374+0000 7f4a56000640 1 -- 172.21.15.17:0/2278716450 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f4a58018f10 con 0x7f4a600cfea0 2024-09-10T23:33:09.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.550+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a600d2860 con 0x7f4a600cfea0 2024-09-10T23:33:09.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.550+0000 7f4a56000640 1 -- 172.21.15.17:0/2278716450 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v226) ==== 74+0+17157 (secure 0 0 0) 0x7f4a58105240 con 0x7f4a600cfea0 2024-09-10T23:33:09.554 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:09.554 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":226,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:32:19.886447+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:47.126569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:48.387269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"223","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":225,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":225,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.2","mappings":[{"from":0,"to":1}]},{"pgid":"34.b","mappings":[{"from":0,"to":1}]},{"pgid":"34.11","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/1849575634":"2024-09-11T23:32:00.172130+0000","172.21.15.17:6833/1849575634":"2024-09-11T23:32:00.172130+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:33:09.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a3c0725e0 msgr2=0x7f4a3c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a3c0725e0 0x7f4a3c074aa0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f4a500098e0 tx=0x7f4a50009060 comp rx=0 tx=0).stop 2024-09-10T23:33:09.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600cfea0 msgr2=0x7f4a600c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600cfea0 0x7f4a600c9820 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f4a5801cfe0 tx=0x7f4a580af580 comp rx=0 tx=0).stop 2024-09-10T23:33:09.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 shutdown_connections 2024-09-10T23:33:09.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f4a3c0725e0 0x7f4a3c074aa0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a600cfea0 0x7f4a600c9820 unknown :-1 s=CLOSED pgs=2667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a600cd110 0x7f4a601f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 --2- 172.21.15.17:0/2278716450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a600b27b0 0x7f4a601536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 >> 172.21.15.17:0/2278716450 conn(0x7f4a600d1d40 msgr2=0x7f4a6015a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:09.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 shutdown_connections 2024-09-10T23:33:09.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.554+0000 7f4a64c00640 1 -- 172.21.15.17:0/2278716450 wait complete. 2024-09-10T23:33:09.576 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:33:09.576 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:33:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.718+0000 7fdd43a00640 1 -- 172.21.15.17:0/2643742531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c0745e0 msgr2=0x7fdd3c15b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.718+0000 7fdd43a00640 1 --2- 172.21.15.17:0/2643742531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c0745e0 0x7fdd3c15b2f0 secure :-1 s=READY pgs=2668 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400aa10 tx=0x7fdd2401dc30 comp rx=0 tx=0).stop 2024-09-10T23:33:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.718+0000 7fdd43a00640 1 -- 172.21.15.17:0/2643742531 shutdown_connections 2024-09-10T23:33:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.718+0000 7fdd43a00640 1 --2- 172.21.15.17:0/2643742531 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd3c070030 0x7fdd3c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.718+0000 7fdd43a00640 1 --2- 172.21.15.17:0/2643742531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c0745e0 0x7fdd3c15b2f0 unknown :-1 s=CLOSED pgs=2668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.718+0000 7fdd43a00640 1 -- 172.21.15.17:0/2643742531 >> 172.21.15.17:0/2643742531 conn(0x7fdd3c0b1850 msgr2=0x7fdd3c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.718+0000 7fdd43a00640 1 -- 172.21.15.17:0/2643742531 shutdown_connections 2024-09-10T23:33:09.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.718+0000 7fdd43a00640 1 -- 172.21.15.17:0/2643742531 wait complete. 2024-09-10T23:33:09.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 Processor -- start 2024-09-10T23:33:09.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 -- start start 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c06fc50 0x7fdd3c14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd3c070030 0x7fdd3c13ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3c0745e0 0x7fdd3c13e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c167200 con 0x7fdd3c06fc50 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c06f370 con 0x7fdd3c0745e0 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3c167380 con 0x7fdd3c070030 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c06fc50 0x7fdd3c14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c06fc50 0x7fdd3c14d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56654/0 (socket says 172.21.15.17:56654) 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41000640 1 -- 172.21.15.17:0/3490324677 learned_addr learned my addr 172.21.15.17:0/3490324677 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41a00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3c0745e0 0x7fdd3c13e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd33e00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd3c070030 0x7fdd3c13ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41000640 1 -- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd3c070030 msgr2=0x7fdd3c13ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41000640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd3c070030 0x7fdd3c13ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41000640 1 -- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3c0745e0 msgr2=0x7fdd3c13e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41000640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3c0745e0 0x7fdd3c13e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41000640 1 -- 172.21.15.17:0/3490324677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c1508c0 con 0x7fdd3c06fc50 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd33e00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd3c070030 0x7fdd3c13ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd41000640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c06fc50 0x7fdd3c14d180 secure :-1 s=READY pgs=2669 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c500 tx=0x7fdd2c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd39600640 1 -- 172.21.15.17:0/3490324677 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c017070 con 0x7fdd3c06fc50 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd39600640 1 -- 172.21.15.17:0/3490324677 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd2c0053c0 con 0x7fdd3c06fc50 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd39600640 1 -- 172.21.15.17:0/3490324677 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c012890 con 0x7fdd3c06fc50 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c14c6a0 con 0x7fdd3c06fc50 2024-09-10T23:33:09.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.722+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c13ba50 con 0x7fdd3c06fc50 2024-09-10T23:33:09.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.726+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3c075ad0 con 0x7fdd3c06fc50 2024-09-10T23:33:09.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.726+0000 7fdd39600640 1 -- 172.21.15.17:0/3490324677 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fdd2c003600 con 0x7fdd3c06fc50 2024-09-10T23:33:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.726+0000 7fdd39600640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd180725e0 0x7fdd18074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.726+0000 7fdd39600640 1 -- 172.21.15.17:0/3490324677 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7fdd2c092a60 con 0x7fdd3c06fc50 2024-09-10T23:33:09.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.726+0000 7fdd33e00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd180725e0 0x7fdd18074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:09.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.726+0000 7fdd33e00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd180725e0 0x7fdd18074aa0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fdd240b0000 tx=0x7fdd2401c470 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:09.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.730+0000 7fdd39600640 1 -- 172.21.15.17:0/3490324677 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fdd2c05d820 con 0x7fdd3c06fc50 2024-09-10T23:33:09.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.938+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd3c0b55a0 con 0x7fdd3c06fc50 2024-09-10T23:33:09.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.938+0000 7fdd39600640 1 -- 172.21.15.17:0/3490324677 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+5239 (secure 0 0 0) 0x7fdd2c062250 con 0x7fdd3c06fc50 2024-09-10T23:33:09.941 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:09.942 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":175,"btime":"2024-09-10T23:32:04:193424+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:32:04.193419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":224,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":12012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_12012":{"gid":12012,"name":"c","rank":0,"incarnation":172,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2426812353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2426812353},{"type":"v1","addr":"172.21.15.17:6835","nonce":2426812353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":12012,"qdb_cluster":[12012]},"id":16}]} 2024-09-10T23:33:09.942 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 175 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd180725e0 msgr2=0x7fdd18074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd180725e0 0x7fdd18074aa0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fdd240b0000 tx=0x7fdd2401c470 comp rx=0 tx=0).stop 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c06fc50 msgr2=0x7fdd3c14d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c06fc50 0x7fdd3c14d180 secure :-1 s=READY pgs=2669 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c500 tx=0x7fdd2c00c9c0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 shutdown_connections 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fdd180725e0 0x7fdd18074aa0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd3c0745e0 0x7fdd3c13e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd3c070030 0x7fdd3c13ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 --2- 172.21.15.17:0/3490324677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd3c06fc50 0x7fdd3c14d180 unknown :-1 s=CLOSED pgs=2669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 >> 172.21.15.17:0/3490324677 conn(0x7fdd3c0b1850 msgr2=0x7fdd3c153880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:09.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 shutdown_connections 2024-09-10T23:33:09.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:09.942+0000 7fdd43a00640 1 -- 172.21.15.17:0/3490324677 wait complete. 2024-09-10T23:33:09.965 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:33:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 -- 172.21.15.17:0/1962548456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8180d07d0 msgr2=0x7fc8180b1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 --2- 172.21.15.17:0/1962548456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8180d07d0 0x7fc8180b1820 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 crypto rx=0x7fc810009bc0 tx=0x7fc81001cba0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 -- 172.21.15.17:0/1962548456 shutdown_connections 2024-09-10T23:33:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 --2- 172.21.15.17:0/1962548456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8180d07d0 0x7fc8180b1820 unknown :-1 s=CLOSED pgs=2671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 --2- 172.21.15.17:0/1962548456 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc81815f550 0x7fc8180b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 -- 172.21.15.17:0/1962548456 >> 172.21.15.17:0/1962548456 conn(0x7fc8180b3870 msgr2=0x7fc8180b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 -- 172.21.15.17:0/1962548456 shutdown_connections 2024-09-10T23:33:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 -- 172.21.15.17:0/1962548456 wait complete. 2024-09-10T23:33:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 Processor -- start 2024-09-10T23:33:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.114+0000 7fc81f200640 1 -- start start 2024-09-10T23:33:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8180b0d90 0x7fc818154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8180d07d0 0x7fc818163de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815f550 0x7fc818157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc818168f70 con 0x7fc81815f550 2024-09-10T23:33:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc818168df0 con 0x7fc8180b0d90 2024-09-10T23:33:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc8181690f0 con 0x7fc8180d07d0 2024-09-10T23:33:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815f550 0x7fc818157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815f550 0x7fc818157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56672/0 (socket says 172.21.15.17:56672) 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81d200640 1 -- 172.21.15.17:0/2134673298 learned_addr learned my addr 172.21.15.17:0/2134673298 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc817e00640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8180b0d90 0x7fc818154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc80f400640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8180d07d0 0x7fc818163de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81d200640 1 -- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8180d07d0 msgr2=0x7fc818163de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81d200640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8180d07d0 0x7fc818163de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81d200640 1 -- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8180b0d90 msgr2=0x7fc818154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81d200640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8180b0d90 0x7fc818154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81d200640 1 -- 172.21.15.17:0/2134673298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc818157de0 con 0x7fc81815f550 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81d200640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815f550 0x7fc818157320 secure :-1 s=READY pgs=2672 cs=0 l=1 rev1=1 crypto rx=0x7fc810009b10 tx=0x7fc810003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc814c00640 1 -- 172.21.15.17:0/2134673298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8100b2040 con 0x7fc81815f550 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc814c00640 1 -- 172.21.15.17:0/2134673298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc810004d40 con 0x7fc81815f550 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8180cd780 con 0x7fc81815f550 2024-09-10T23:33:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc814c00640 1 -- 172.21.15.17:0/2134673298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810004210 con 0x7fc81815f550 2024-09-10T23:33:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8180cdd40 con 0x7fc81815f550 2024-09-10T23:33:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8180b12e0 con 0x7fc81815f550 2024-09-10T23:33:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.118+0000 7fc814c00640 1 -- 172.21.15.17:0/2134673298 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc8100b5070 con 0x7fc81815f550 2024-09-10T23:33:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.122+0000 7fc814c00640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc7f40725e0 0x7fc7f4074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.122+0000 7fc814c00640 1 -- 172.21.15.17:0/2134673298 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7fc81012d200 con 0x7fc81815f550 2024-09-10T23:33:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.122+0000 7fc817e00640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc7f40725e0 0x7fc7f4074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.122+0000 7fc817e00640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc7f40725e0 0x7fc7f4074aa0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc808009ad0 tx=0x7fc8080091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:10.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.126+0000 7fc814c00640 1 -- 172.21.15.17:0/2134673298 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fc8100a5e20 con 0x7fc81815f550 2024-09-10T23:33:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.334+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8180d0120 con 0x7fc81815f550 2024-09-10T23:33:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.334+0000 7fc814c00640 1 -- 172.21.15.17:0/2134673298 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 175 v175) ==== 95+0+5239 (secure 0 0 0) 0x7fc810016790 con 0x7fc81815f550 2024-09-10T23:33:10.338 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:10.338 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":175,"btime":"2024-09-10T23:32:04:193424+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164}],"filesystems":[{"mdsmap":{"epoch":175,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T23:31:49.429993+0000","modified":"2024-09-10T23:32:04.193419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":224,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":12012},"failed":[],"damaged":[],"stopped":[],"info":{"gid_12012":{"gid":12012,"name":"c","rank":0,"incarnation":172,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6835/2426812353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":2426812353},{"type":"v1","addr":"172.21.15.17:6835","nonce":2426812353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":12012,"qdb_cluster":[12012]},"id":16}]} 2024-09-10T23:33:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 175 2024-09-10T23:33:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc7f40725e0 msgr2=0x7fc7f4074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc7f40725e0 0x7fc7f4074aa0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc808009ad0 tx=0x7fc8080091e0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815f550 msgr2=0x7fc818157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815f550 0x7fc818157320 secure :-1 s=READY pgs=2672 cs=0 l=1 rev1=1 crypto rx=0x7fc810009b10 tx=0x7fc810003f60 comp rx=0 tx=0).stop 2024-09-10T23:33:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 shutdown_connections 2024-09-10T23:33:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc7f40725e0 0x7fc7f4074aa0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81815f550 0x7fc818157320 unknown :-1 s=CLOSED pgs=2672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc8180d07d0 0x7fc818163de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 --2- 172.21.15.17:0/2134673298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8180b0d90 0x7fc818154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 >> 172.21.15.17:0/2134673298 conn(0x7fc8180b3870 msgr2=0x7fc81806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 shutdown_connections 2024-09-10T23:33:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.338+0000 7fc81f200640 1 -- 172.21.15.17:0/2134673298 wait complete. 2024-09-10T23:33:10.359 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:33:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 -- 172.21.15.17:0/2272236020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180b2fc0 msgr2=0x7f81180d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 --2- 172.21.15.17:0/2272236020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180b2fc0 0x7f81180d0660 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 crypto rx=0x7f8118074410 tx=0x7f810801c7d0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 -- 172.21.15.17:0/2272236020 shutdown_connections 2024-09-10T23:33:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 --2- 172.21.15.17:0/2272236020 >> v2:172.21.15.77:3300/0 conn(0x7f811815fc90 0x7f8118160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 --2- 172.21.15.17:0/2272236020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180b2fc0 0x7f81180d0660 unknown :-1 s=CLOSED pgs=2674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 -- 172.21.15.17:0/2272236020 >> 172.21.15.17:0/2272236020 conn(0x7f81180d1d40 msgr2=0x7f81180d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 -- 172.21.15.17:0/2272236020 shutdown_connections 2024-09-10T23:33:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 -- 172.21.15.17:0/2272236020 wait complete. 2024-09-10T23:33:10.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 Processor -- start 2024-09-10T23:33:10.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.502+0000 7f8120800640 1 -- start start 2024-09-10T23:33:10.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8120800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81180b2fc0 0x7f8118159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8120800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180cfb70 0x7f811814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8120800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f811815fc90 0x7f81181faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8120800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f81180b0a30 con 0x7f81180cfb70 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8120800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81180b08b0 con 0x7f81180b2fc0 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8120800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8118168f60 con 0x7f811815fc90 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180cfb70 0x7f811814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180cfb70 0x7f811814dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56698/0 (socket says 172.21.15.17:56698) 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811d400640 1 -- 172.21.15.17:0/565610437 learned_addr learned my addr 172.21.15.17:0/565610437 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811de00640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81180b2fc0 0x7f8118159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811e800640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f811815fc90 0x7f81181faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811d400640 1 -- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f811815fc90 msgr2=0x7f81181faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811d400640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f811815fc90 0x7f81181faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811d400640 1 -- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81180b2fc0 msgr2=0x7f8118159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811d400640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81180b2fc0 0x7f8118159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811d400640 1 -- 172.21.15.17:0/565610437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81181fb540 con 0x7f81180cfb70 2024-09-10T23:33:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f811d400640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180cfb70 0x7f811814dd40 secure :-1 s=READY pgs=2675 cs=0 l=1 rev1=1 crypto rx=0x7f8108000c10 tx=0x7f81080040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8112000640 1 -- 172.21.15.17:0/565610437 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81080b2040 con 0x7f81180cfb70 2024-09-10T23:33:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8112000640 1 -- 172.21.15.17:0/565610437 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81080044b0 con 0x7f81180cfb70 2024-09-10T23:33:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8112000640 1 -- 172.21.15.17:0/565610437 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108003840 con 0x7f81180cfb70 2024-09-10T23:33:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81181fb820 con 0x7f81180cfb70 2024-09-10T23:33:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81181599a0 con 0x7f81180cfb70 2024-09-10T23:33:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.506+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81181594d0 con 0x7f81180cfb70 2024-09-10T23:33:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.510+0000 7f8112000640 1 -- 172.21.15.17:0/565610437 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f81080b5070 con 0x7f81180cfb70 2024-09-10T23:33:10.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.510+0000 7f8112000640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80fc0725e0 0x7f80fc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.510+0000 7f8112000640 1 -- 172.21.15.17:0/565610437 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f810812d570 con 0x7f81180cfb70 2024-09-10T23:33:10.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.510+0000 7f811de00640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80fc0725e0 0x7f80fc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.510+0000 7f811de00640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80fc0725e0 0x7f80fc074aa0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f810c000f70 tx=0x7f810c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.514+0000 7f8112000640 1 -- 172.21.15.17:0/565610437 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f81080163f0 con 0x7f81180cfb70 2024-09-10T23:33:10.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.686+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8118160140 con 0x7f81180cfb70 2024-09-10T23:33:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.686+0000 7f8112000640 1 -- 172.21.15.17:0/565610437 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v226) ==== 74+0+17157 (secure 0 0 0) 0x7f81080f8a00 con 0x7f81180cfb70 2024-09-10T23:33:10.691 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:10.691 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":226,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:32:19.886447+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2024-09-10T23:31:47.126569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"222","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"cephfs_data","create_time":"2024-09-10T23:31:48.387269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"223","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":225,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":225,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.2","mappings":[{"from":0,"to":1}]},{"pgid":"34.b","mappings":[{"from":0,"to":1}]},{"pgid":"34.11","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/1849575634":"2024-09-11T23:32:00.172130+0000","172.21.15.17:6833/1849575634":"2024-09-11T23:32:00.172130+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:33:10.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80fc0725e0 msgr2=0x7f80fc074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80fc0725e0 0x7f80fc074aa0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f810c000f70 tx=0x7f810c009040 comp rx=0 tx=0).stop 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180cfb70 msgr2=0x7f811814dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180cfb70 0x7f811814dd40 secure :-1 s=READY pgs=2675 cs=0 l=1 rev1=1 crypto rx=0x7f8108000c10 tx=0x7f81080040c0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 shutdown_connections 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f80fc0725e0 0x7f80fc074aa0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f811815fc90 0x7f81181faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81180cfb70 0x7f811814dd40 unknown :-1 s=CLOSED pgs=2675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 --2- 172.21.15.17:0/565610437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81180b2fc0 0x7f8118159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 >> 172.21.15.17:0/565610437 conn(0x7f81180d1d40 msgr2=0x7f81180715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 shutdown_connections 2024-09-10T23:33:10.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.690+0000 7f8120800640 1 -- 172.21.15.17:0/565610437 wait complete. 2024-09-10T23:33:10.712 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T23:33:10.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 -- 172.21.15.17:0/2286581458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04741600d0 msgr2=0x7f047406e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 --2- 172.21.15.17:0/2286581458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04741600d0 0x7f047406e820 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7f04740d0890 tx=0x7f046c01cd40 comp rx=0 tx=0).stop 2024-09-10T23:33:10.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 -- 172.21.15.17:0/2286581458 shutdown_connections 2024-09-10T23:33:10.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 --2- 172.21.15.17:0/2286581458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04741600d0 0x7f047406e820 unknown :-1 s=CLOSED pgs=2676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 --2- 172.21.15.17:0/2286581458 >> v2:172.21.15.77:3300/0 conn(0x7f0474145570 0x7f04740cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 -- 172.21.15.17:0/2286581458 >> 172.21.15.17:0/2286581458 conn(0x7f04740b1850 msgr2=0x7f04740b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:10.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 -- 172.21.15.17:0/2286581458 shutdown_connections 2024-09-10T23:33:10.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 -- 172.21.15.17:0/2286581458 wait complete. 2024-09-10T23:33:10.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 Processor -- start 2024-09-10T23:33:10.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 -- start start 2024-09-10T23:33:10.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04740cffb0 0x7f04740cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0474145570 0x7f047413e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741600d0 0x7f047415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0474168d10 con 0x7f0474145570 2024-09-10T23:33:10.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0474168b90 con 0x7f04740cffb0 2024-09-10T23:33:10.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f047ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0474168e90 con 0x7f04741600d0 2024-09-10T23:33:10.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f046be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0474145570 0x7f047413e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f046be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0474145570 0x7f047413e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56710/0 (socket says 172.21.15.17:56710) 2024-09-10T23:33:10.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f0473e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04740cffb0 0x7f04740cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f046be00640 1 -- 172.21.15.17:0/4215937765 learned_addr learned my addr 172.21.15.17:0/4215937765 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:10.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f0478c00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741600d0 0x7f047415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f046be00640 1 -- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741600d0 msgr2=0x7f047415ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f046be00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741600d0 0x7f047415ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f046be00640 1 -- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04740cffb0 msgr2=0x7f04740cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:10.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f046be00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04740cffb0 0x7f04740cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:10.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.858+0000 7f046be00640 1 -- 172.21.15.17:0/4215937765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04741f80e0 con 0x7f0474145570 2024-09-10T23:33:10.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f046be00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0474145570 0x7f047413e820 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 crypto rx=0x7f045c00c450 tx=0x7f045c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:10.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f0470c00640 1 -- 172.21.15.17:0/4215937765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c012830 con 0x7f0474145570 2024-09-10T23:33:10.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f0470c00640 1 -- 172.21.15.17:0/4215937765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f045c017070 con 0x7f0474145570 2024-09-10T23:33:10.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04741f7560 con 0x7f0474145570 2024-09-10T23:33:10.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f0470c00640 1 -- 172.21.15.17:0/4215937765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c012d80 con 0x7f0474145570 2024-09-10T23:33:10.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04741f7e00 con 0x7f0474145570 2024-09-10T23:33:10.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0474075ad0 con 0x7f0474145570 2024-09-10T23:33:10.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f0470c00640 1 -- 172.21.15.17:0/4215937765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f045c01c460 con 0x7f0474145570 2024-09-10T23:33:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f0470c00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0450072610 0x7f0450074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.862+0000 7f0470c00640 1 -- 172.21.15.17:0/4215937765 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 6274+0+0 (secure 0 0 0) 0x7f045c093150 con 0x7f0474145570 2024-09-10T23:33:10.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.866+0000 7f0473e00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0450072610 0x7f0450074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:10.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.866+0000 7f0473e00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0450072610 0x7f0450074ad0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0474156530 tx=0x7f046400a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:10.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:10.866+0000 7f0470c00640 1 -- 172.21.15.17:0/4215937765 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f045c05df00 con 0x7f0474145570 2024-09-10T23:33:11.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.078+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f04740cfa70 con 0x7f0474145570 2024-09-10T23:33:11.081 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-10T23:33:11.078+0000 7f039e600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T23:33:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.078+0000 7f0470c00640 1 -- 172.21.15.17:0/4215937765 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v176) ==== 161+0+0 (secure 0 0 0) 0x7f045c062930 con 0x7f0474145570 2024-09-10T23:33:11.083 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T23:33:11.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0450072610 msgr2=0x7f0450074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:11.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0450072610 0x7f0450074ad0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0474156530 tx=0x7f046400a2d0 comp rx=0 tx=0).stop 2024-09-10T23:33:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0474145570 msgr2=0x7f047413e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0474145570 0x7f047413e820 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 crypto rx=0x7f045c00c450 tx=0x7f045c00c910 comp rx=0 tx=0).stop 2024-09-10T23:33:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 shutdown_connections 2024-09-10T23:33:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0450072610 0x7f0450074ad0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04741600d0 0x7f047415ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0474145570 0x7f047413e820 unknown :-1 s=CLOSED pgs=2677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 --2- 172.21.15.17:0/4215937765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04740cffb0 0x7f04740cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 >> 172.21.15.17:0/4215937765 conn(0x7f04740b1850 msgr2=0x7f04740b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:11.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 shutdown_connections 2024-09-10T23:33:11.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.082+0000 7f047ac00640 1 -- 172.21.15.17:0/4215937765 wait complete. 2024-09-10T23:33:11.096 INFO:tasks.ceph.mds.c.smithi017.stderr: -2694> 2024-09-10T23:32:06.186+0000 7ffb0bc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T23:33:11.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T23:33:11.143 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-09-10T23:33:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 -- 172.21.15.17:0/2216290522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80ce7a0 msgr2=0x7fa8b80ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 --2- 172.21.15.17:0/2216290522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80ce7a0 0x7fa8b80ceb80 secure :-1 s=READY pgs=2679 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8074040 tx=0x7fa8a801c830 comp rx=0 tx=0).stop 2024-09-10T23:33:11.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 -- 172.21.15.17:0/2216290522 shutdown_connections 2024-09-10T23:33:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 --2- 172.21.15.17:0/2216290522 >> v2:172.21.15.77:3300/0 conn(0x7fa8b80af050 0x7fa8b80af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 --2- 172.21.15.17:0/2216290522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80ce7a0 0x7fa8b80ceb80 unknown :-1 s=CLOSED pgs=2679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 -- 172.21.15.17:0/2216290522 >> 172.21.15.17:0/2216290522 conn(0x7fa8b80d1d90 msgr2=0x7fa8b80d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 -- 172.21.15.17:0/2216290522 shutdown_connections 2024-09-10T23:33:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 -- 172.21.15.17:0/2216290522 wait complete. 2024-09-10T23:33:11.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 Processor -- start 2024-09-10T23:33:11.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.254+0000 7fa8be200640 1 -- start start 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8be200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80af050 0x7fa8b80c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8be200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80ce7a0 0x7fa8b8159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8be200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b81fc680 0x7fa8b8150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8be200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b81691a0 con 0x7fa8b80af050 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8be200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b8169020 con 0x7fa8b80ce7a0 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8be200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b8169320 con 0x7fa8b81fc680 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80af050 0x7fa8b80c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80af050 0x7fa8b80c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56738/0 (socket says 172.21.15.17:56738) 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7400640 1 -- 172.21.15.17:0/3001226843 learned_addr learned my addr 172.21.15.17:0/3001226843 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:11.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8afe00640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80ce7a0 0x7fa8b8159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7e00640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b81fc680 0x7fa8b8150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7400640 1 -- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b81fc680 msgr2=0x7fa8b8150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7400640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b81fc680 0x7fa8b8150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7400640 1 -- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80ce7a0 msgr2=0x7fa8b8159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7400640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80ce7a0 0x7fa8b8159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7400640 1 -- 172.21.15.17:0/3001226843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b81f86b0 con 0x7fa8b80af050 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7e00640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b81fc680 0x7fa8b8150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8afe00640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80ce7a0 0x7fa8b8159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8b7400640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80af050 0x7fa8b80c8290 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8019440 tx=0x7fa8a80a5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8af400640 1 -- 172.21.15.17:0/3001226843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80b2040 con 0x7fa8b80af050 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8af400640 1 -- 172.21.15.17:0/3001226843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8a80043a0 con 0x7fa8b80af050 2024-09-10T23:33:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b81f8990 con 0x7fa8b80af050 2024-09-10T23:33:11.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8af400640 1 -- 172.21.15.17:0/3001226843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8005290 con 0x7fa8b80af050 2024-09-10T23:33:11.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b81f83a0 con 0x7fa8b80af050 2024-09-10T23:33:11.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b80af460 con 0x7fa8b80af050 2024-09-10T23:33:11.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.258+0000 7fa8af400640 1 -- 172.21.15.17:0/3001226843 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fa8a8005430 con 0x7fa8b80af050 2024-09-10T23:33:11.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.262+0000 7fa8af400640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8940725e0 0x7fa894074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:11.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.262+0000 7fa8af400640 1 -- 172.21.15.17:0/3001226843 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 6360+0+0 (secure 0 0 0) 0x7fa8a812d550 con 0x7fa8b80af050 2024-09-10T23:33:11.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.262+0000 7fa8afe00640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8940725e0 0x7fa894074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:11.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.262+0000 7fa8afe00640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8940725e0 0x7fa894074aa0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa8b815ad50 tx=0x7fa8a0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.266+0000 7fa8af400640 1 -- 172.21.15.17:0/3001226843 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fa8a80c4060 con 0x7fa8b80af050 2024-09-10T23:33:11.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:11.474+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa8b8071270 con 0x7fa8b80af050 2024-09-10T23:33:12.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.082+0000 7fa8af400640 1 -- 172.21.15.17:0/3001226843 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v177) ==== 104+0+0 (secure 0 0 0) 0x7fa8a80164b0 con 0x7fa8b80af050 2024-09-10T23:33:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8940725e0 msgr2=0x7fa894074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8940725e0 0x7fa894074aa0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa8b815ad50 tx=0x7fa8a0009040 comp rx=0 tx=0).stop 2024-09-10T23:33:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80af050 msgr2=0x7fa8b80c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80af050 0x7fa8b80c8290 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8019440 tx=0x7fa8a80a5680 comp rx=0 tx=0).stop 2024-09-10T23:33:12.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 shutdown_connections 2024-09-10T23:33:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fa8940725e0 0x7fa894074aa0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8b81fc680 0x7fa8b8150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8b80ce7a0 0x7fa8b8159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 --2- 172.21.15.17:0/3001226843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b80af050 0x7fa8b80c8290 unknown :-1 s=CLOSED pgs=2680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 >> 172.21.15.17:0/3001226843 conn(0x7fa8b80d1d90 msgr2=0x7fa8b80d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 shutdown_connections 2024-09-10T23:33:12.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.086+0000 7fa8be200640 1 -- 172.21.15.17:0/3001226843 wait complete. 2024-09-10T23:33:12.111 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T23:33:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.310+0000 7f1a73000640 1 -- 172.21.15.17:0/2584951239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a54005190 msgr2=0x7f1a5400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.310+0000 7f1a73000640 1 --2- 172.21.15.17:0/2584951239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a54005190 0x7f1a5400b9d0 secure :-1 s=READY pgs=2682 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009eb0 tx=0x7f1a6401d5b0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.310+0000 7f1a72600640 1 -- 172.21.15.17:0/2584951239 reap_dead start 2024-09-10T23:33:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.310+0000 7f1a73000640 1 -- 172.21.15.17:0/2584951239 shutdown_connections 2024-09-10T23:33:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.310+0000 7f1a73000640 1 -- 172.21.15.17:0/2584951239 >> 172.21.15.17:0/2584951239 conn(0x7f1a6c0d1bc0 msgr2=0x7f1a6c0d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.310+0000 7f1a73000640 1 -- 172.21.15.17:0/2584951239 shutdown_connections 2024-09-10T23:33:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.310+0000 7f1a73000640 1 -- 172.21.15.17:0/2584951239 wait complete. 2024-09-10T23:33:12.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 Processor -- start 2024-09-10T23:33:12.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 -- start start 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a54005190 0x7f1a6c1f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a6c154610 0x7f1a6c153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1a6c0cc1f0 0x7f1a6c0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0d1860 con 0x7f1a6c154610 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c06d470 con 0x7f1a54005190 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c0b5f60 con 0x7f1a6c0cc1f0 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a6c154610 0x7f1a6c153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a6c154610 0x7f1a6c153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56762/0 (socket says 172.21.15.17:56762) 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71200640 1 -- 172.21.15.17:0/3202728766 learned_addr learned my addr 172.21.15.17:0/3202728766 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71c00640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a54005190 0x7f1a6c1f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a72600640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1a6c0cc1f0 0x7f1a6c0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71200640 1 -- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1a6c0cc1f0 msgr2=0x7f1a6c0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71200640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1a6c0cc1f0 0x7f1a6c0b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71200640 1 -- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a54005190 msgr2=0x7f1a6c1f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71200640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a54005190 0x7f1a6c1f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71200640 1 -- 172.21.15.17:0/3202728766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c1f5190 con 0x7f1a6c154610 2024-09-10T23:33:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a71200640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a6c154610 0x7f1a6c153d40 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7f1a58001230 tx=0x7f1a580066c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a69600640 1 -- 172.21.15.17:0/3202728766 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58015070 con 0x7f1a6c154610 2024-09-10T23:33:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a69600640 1 -- 172.21.15.17:0/3202728766 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a58011920 con 0x7f1a6c154610 2024-09-10T23:33:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a69600640 1 -- 172.21.15.17:0/3202728766 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58011d70 con 0x7f1a6c154610 2024-09-10T23:33:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c0b5c10 con 0x7f1a6c154610 2024-09-10T23:33:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.314+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c0ce630 con 0x7f1a6c154610 2024-09-10T23:33:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.318+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6c0d10a0 con 0x7f1a6c154610 2024-09-10T23:33:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.318+0000 7f1a69600640 1 -- 172.21.15.17:0/3202728766 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1a580103c0 con 0x7f1a6c154610 2024-09-10T23:33:12.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.318+0000 7f1a69600640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1a4c072610 0x7f1a4c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:12.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.318+0000 7f1a69600640 1 -- 172.21.15.17:0/3202728766 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 6360+0+0 (secure 0 0 0) 0x7f1a580945f0 con 0x7f1a6c154610 2024-09-10T23:33:12.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.318+0000 7f1a71c00640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1a4c072610 0x7f1a4c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:12.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.322+0000 7f1a71c00640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1a4c072610 0x7f1a4c074ad0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1a60000c10 tx=0x7f1a60006b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:12.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.322+0000 7f1a69600640 1 -- 172.21.15.17:0/3202728766 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1a6c1f5190 con 0x7f1a6c154610 2024-09-10T23:33:12.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:12.498+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1a6c0b18d0 con 0x7f1a6c154610 2024-09-10T23:33:13.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.086+0000 7f1a69600640 1 -- 172.21.15.17:0/3202728766 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v228) ==== 181+0+0 (secure 0 0 0) 0x7f1a5805f350 con 0x7f1a6c154610 2024-09-10T23:33:13.090 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-09-10T23:33:13.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1a4c072610 msgr2=0x7f1a4c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1a4c072610 0x7f1a4c074ad0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1a60000c10 tx=0x7f1a60006b20 comp rx=0 tx=0).stop 2024-09-10T23:33:13.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a6c154610 msgr2=0x7f1a6c153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a6c154610 0x7f1a6c153d40 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7f1a58001230 tx=0x7f1a580066c0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 shutdown_connections 2024-09-10T23:33:13.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1a4c072610 0x7f1a4c074ad0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1a6c0cc1f0 0x7f1a6c0b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a6c154610 0x7f1a6c153d40 unknown :-1 s=CLOSED pgs=2683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 --2- 172.21.15.17:0/3202728766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a54005190 0x7f1a6c1f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 >> 172.21.15.17:0/3202728766 conn(0x7f1a6c0d1bc0 msgr2=0x7f1a6c154d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:13.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 shutdown_connections 2024-09-10T23:33:13.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.090+0000 7f1a73000640 1 -- 172.21.15.17:0/3202728766 wait complete. 2024-09-10T23:33:13.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T23:33:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.278+0000 7f8fa7200640 1 -- 172.21.15.17:0/3005597381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84004080 msgr2=0x7f8f84004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.278+0000 7f8fa7200640 1 --2- 172.21.15.17:0/3005597381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f84004080 0x7f8f84004810 secure :-1 s=READY pgs=2685 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800c2e0 tx=0x7f8f8801cf20 comp rx=0 tx=0).stop 2024-09-10T23:33:13.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.278+0000 7f8fa5200640 1 -- 172.21.15.17:0/3005597381 reap_dead start 2024-09-10T23:33:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.278+0000 7f8fa7200640 1 -- 172.21.15.17:0/3005597381 shutdown_connections 2024-09-10T23:33:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.278+0000 7f8fa7200640 1 -- 172.21.15.17:0/3005597381 >> 172.21.15.17:0/3005597381 conn(0x7f8fa00cc590 msgr2=0x7f8fa00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.278+0000 7f8fa7200640 1 -- 172.21.15.17:0/3005597381 shutdown_connections 2024-09-10T23:33:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.278+0000 7f8fa7200640 1 -- 172.21.15.17:0/3005597381 wait complete. 2024-09-10T23:33:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.278+0000 7f8fa7200640 1 Processor -- start 2024-09-10T23:33:13.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.278+0000 7f8fa7200640 1 -- start start 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f84004080 0x7f8fa013a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa00b5840 0x7f8fa00c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa00af6b0 0x7f8fa00c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa0167260 con 0x7f8fa00af6b0 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa015b320 con 0x7f8f84004080 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa01673e0 con 0x7f8fa00b5840 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa00af6b0 0x7f8fa00c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa00af6b0 0x7f8fa00c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56782/0 (socket says 172.21.15.17:56782) 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8f9fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f84004080 0x7f8fa013a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa5200640 1 -- 172.21.15.17:0/2152083428 learned_addr learned my addr 172.21.15.17:0/2152083428 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8f97e00640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa00b5840 0x7f8fa00c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa5200640 1 -- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa00b5840 msgr2=0x7f8fa00c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa5200640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa00b5840 0x7f8fa00c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa5200640 1 -- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f84004080 msgr2=0x7f8fa013a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa5200640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f84004080 0x7f8fa013a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa5200640 1 -- 172.21.15.17:0/2152083428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa013edc0 con 0x7f8fa00af6b0 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa5200640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa00af6b0 0x7f8fa00c93a0 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00cd3a0 tx=0x7f8f980019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8f9cc00640 1 -- 172.21.15.17:0/2152083428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f98015020 con 0x7f8fa00af6b0 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8f9cc00640 1 -- 172.21.15.17:0/2152083428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f98011960 con 0x7f8fa00af6b0 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8f9cc00640 1 -- 172.21.15.17:0/2152083428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f98011db0 con 0x7f8fa00af6b0 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa013c9f0 con 0x7f8fa00af6b0 2024-09-10T23:33:13.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa0072830 con 0x7f8fa00af6b0 2024-09-10T23:33:13.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa015f830 con 0x7f8fa00af6b0 2024-09-10T23:33:13.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.282+0000 7f8f9cc00640 1 -- 172.21.15.17:0/2152083428 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8f9801a400 con 0x7f8fa00af6b0 2024-09-10T23:33:13.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.286+0000 7f8f9cc00640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8f7c0725e0 0x7f8f7c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:13.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.286+0000 7f8f9cc00640 1 -- 172.21.15.17:0/2152083428 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(228..228 src has 1..228) ==== 5922+0+0 (secure 0 0 0) 0x7f8f98093ff0 con 0x7f8fa00af6b0 2024-09-10T23:33:13.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.286+0000 7f8f9fe00640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8f7c0725e0 0x7f8f7c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:13.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.286+0000 7f8f9fe00640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8f7c0725e0 0x7f8f7c074aa0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f8f900045b0 tx=0x7f8f9000d390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:13.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.290+0000 7f8f9cc00640 1 -- 172.21.15.17:0/2152083428 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8f9801f020 con 0x7f8fa00af6b0 2024-09-10T23:33:13.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:13.466+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8fa00ca160 con 0x7f8fa00af6b0 2024-09-10T23:33:14.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.089+0000 7f8f9cc00640 1 -- 172.21.15.17:0/2152083428 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v229) ==== 169+0+0 (secure 0 0 0) 0x7f8f9805f620 con 0x7f8fa00af6b0 2024-09-10T23:33:14.092 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-09-10T23:33:14.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8f7c0725e0 msgr2=0x7f8f7c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8f7c0725e0 0x7f8f7c074aa0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f8f900045b0 tx=0x7f8f9000d390 comp rx=0 tx=0).stop 2024-09-10T23:33:14.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa00af6b0 msgr2=0x7f8fa00c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa00af6b0 0x7f8fa00c93a0 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00cd3a0 tx=0x7f8f980019c0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 shutdown_connections 2024-09-10T23:33:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8f7c0725e0 0x7f8f7c074aa0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa00af6b0 0x7f8fa00c93a0 unknown :-1 s=CLOSED pgs=2686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa00b5840 0x7f8fa00c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 --2- 172.21.15.17:0/2152083428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f84004080 0x7f8fa013a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 >> 172.21.15.17:0/2152083428 conn(0x7f8fa00cc590 msgr2=0x7f8fa013b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 shutdown_connections 2024-09-10T23:33:14.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.093+0000 7f8fa7200640 1 -- 172.21.15.17:0/2152083428 wait complete. 2024-09-10T23:33:14.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T23:33:14.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.261+0000 7f3f3c200640 1 -- 172.21.15.17:0/3214976606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f34070030 msgr2=0x7f3f340cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.261+0000 7f3f3c200640 1 --2- 172.21.15.17:0/3214976606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f34070030 0x7f3f340cec10 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009c80 tx=0x7f3f2c01cda0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.261+0000 7f3f3c200640 1 -- 172.21.15.17:0/3214976606 shutdown_connections 2024-09-10T23:33:14.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.261+0000 7f3f3c200640 1 --2- 172.21.15.17:0/3214976606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f34070030 0x7f3f340cec10 unknown :-1 s=CLOSED pgs=2687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.261+0000 7f3f3c200640 1 --2- 172.21.15.17:0/3214976606 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f3406fc50 0x7f3f3415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.261+0000 7f3f3c200640 1 -- 172.21.15.17:0/3214976606 >> 172.21.15.17:0/3214976606 conn(0x7f3f340b1850 msgr2=0x7f3f340b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:14.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.261+0000 7f3f3c200640 1 -- 172.21.15.17:0/3214976606 shutdown_connections 2024-09-10T23:33:14.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.261+0000 7f3f3c200640 1 -- 172.21.15.17:0/3214976606 wait complete. 2024-09-10T23:33:14.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 Processor -- start 2024-09-10T23:33:14.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 -- start start 2024-09-10T23:33:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f3406fc50 0x7f3f34139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f34070030 0x7f3f34139060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f340745e0 0x7f3f3413c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:14.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f3f341651f0 con 0x7f3f340745e0 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3406f370 con 0x7f3f34070030 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f3f34165370 con 0x7f3f3406fc50 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f340745e0 0x7f3f3413c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f340745e0 0x7f3f3413c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56796/0 (socket says 172.21.15.17:56796) 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3a200640 1 -- 172.21.15.17:0/2060099177 learned_addr learned my addr 172.21.15.17:0/2060099177 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f38e00640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f34070030 0x7f3f34139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f39800640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f3406fc50 0x7f3f34139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3a200640 1 -- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f3406fc50 msgr2=0x7f3f34139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3a200640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f3406fc50 0x7f3f34139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3a200640 1 -- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f34070030 msgr2=0x7f3f34139060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3a200640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f34070030 0x7f3f34139060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3a200640 1 -- 172.21.15.17:0/2060099177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f341f95e0 con 0x7f3f340745e0 2024-09-10T23:33:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3a200640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f340745e0 0x7f3f3413c260 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009bd0 tx=0x7f3f2c0a5990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:14.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f31600640 1 -- 172.21.15.17:0/2060099177 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0bb070 con 0x7f3f340745e0 2024-09-10T23:33:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f31600640 1 -- 172.21.15.17:0/2060099177 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f2c004d40 con 0x7f3f340745e0 2024-09-10T23:33:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f341f98c0 con 0x7f3f340745e0 2024-09-10T23:33:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f31600640 1 -- 172.21.15.17:0/2060099177 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0b2040 con 0x7f3f340745e0 2024-09-10T23:33:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.265+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f341f9e80 con 0x7f3f340745e0 2024-09-10T23:33:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.269+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f34075ad0 con 0x7f3f340745e0 2024-09-10T23:33:14.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.269+0000 7f3f31600640 1 -- 172.21.15.17:0/2060099177 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f3f2c0b5030 con 0x7f3f340745e0 2024-09-10T23:33:14.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.269+0000 7f3f31600640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f140725e0 0x7f3f14074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:14.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.269+0000 7f3f31600640 1 -- 172.21.15.17:0/2060099177 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f3f2c12cf10 con 0x7f3f340745e0 2024-09-10T23:33:14.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.269+0000 7f3f39800640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f140725e0 0x7f3f14074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:14.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.273+0000 7f3f39800640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f140725e0 0x7f3f14074aa0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3f28006fd0 tx=0x7f3f28008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.273+0000 7f3f31600640 1 -- 172.21.15.17:0/2060099177 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f3f2c016990 con 0x7f3f340745e0 2024-09-10T23:33:14.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.453+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f3f3415b2f0 con 0x7f3f340745e0 2024-09-10T23:33:14.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f31600640 1 -- 172.21.15.17:0/2060099177 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v66) ==== 71+0+0 (secure 0 0 0) 0x7f3f2c0f8670 con 0x7f3f340745e0 2024-09-10T23:33:14.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f140725e0 msgr2=0x7f3f14074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f140725e0 0x7f3f14074aa0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3f28006fd0 tx=0x7f3f28008040 comp rx=0 tx=0).stop 2024-09-10T23:33:14.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f340745e0 msgr2=0x7f3f3413c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f340745e0 0x7f3f3413c260 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009bd0 tx=0x7f3f2c0a5990 comp rx=0 tx=0).stop 2024-09-10T23:33:14.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 shutdown_connections 2024-09-10T23:33:14.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3f140725e0 0x7f3f14074aa0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f340745e0 0x7f3f3413c260 unknown :-1 s=CLOSED pgs=2688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f34070030 0x7f3f34139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 --2- 172.21.15.17:0/2060099177 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f3406fc50 0x7f3f34139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 >> 172.21.15.17:0/2060099177 conn(0x7f3f340b1850 msgr2=0x7f3f3415d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:14.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 shutdown_connections 2024-09-10T23:33:14.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.457+0000 7f3f3c200640 1 -- 172.21.15.17:0/2060099177 wait complete. 2024-09-10T23:33:14.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-09-10T23:33:14.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.625+0000 7f3301400640 1 -- 172.21.15.17:0/3623612849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e0003a60 msgr2=0x7f32e0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.625+0000 7f3301400640 1 --2- 172.21.15.17:0/3623612849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e0003a60 0x7f32e0003e80 secure :-1 s=READY pgs=2690 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009b60 tx=0x7f32ec01d270 comp rx=0 tx=0).stop 2024-09-10T23:33:14.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.625+0000 7f3301400640 1 -- 172.21.15.17:0/3623612849 shutdown_connections 2024-09-10T23:33:14.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.625+0000 7f3301400640 1 --2- 172.21.15.17:0/3623612849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32e0003a60 0x7f32e0003e80 unknown :-1 s=CLOSED pgs=2690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.625+0000 7f3301400640 1 -- 172.21.15.17:0/3623612849 >> 172.21.15.17:0/3623612849 conn(0x7f32fc0d1bc0 msgr2=0x7f32fc0d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:14.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.625+0000 7f3301400640 1 -- 172.21.15.17:0/3623612849 shutdown_connections 2024-09-10T23:33:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.625+0000 7f3301400640 1 -- 172.21.15.17:0/3623612849 wait complete. 2024-09-10T23:33:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 Processor -- start 2024-09-10T23:33:14.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 -- start start 2024-09-10T23:33:14.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e0003a60 0x7f32fc0b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:14.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32fc14fa00 0x7f32fc1f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:14.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32fc1f7da0 0x7f32fc14bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:14.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc0afb60 con 0x7f32fc14fa00 2024-09-10T23:33:14.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc0af9e0 con 0x7f32e0003a60 2024-09-10T23:33:14.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f32fc0afce0 con 0x7f32fc1f7da0 2024-09-10T23:33:14.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32fc14fa00 0x7f32fc1f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:14.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32fc14fa00 0x7f32fc1f7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56828/0 (socket says 172.21.15.17:56828) 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f3e00640 1 -- 172.21.15.17:0/3436669590 learned_addr learned my addr 172.21.15.17:0/3436669590 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32fbe00640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e0003a60 0x7f32fc0b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3300a00640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32fc1f7da0 0x7f32fc14bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f3e00640 1 -- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32fc1f7da0 msgr2=0x7f32fc14bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f3e00640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32fc1f7da0 0x7f32fc14bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f3e00640 1 -- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e0003a60 msgr2=0x7f32fc0b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f3e00640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e0003a60 0x7f32fc0b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f3e00640 1 -- 172.21.15.17:0/3436669590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32fc0b6420 con 0x7f32fc14fa00 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3300a00640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32fc1f7da0 0x7f32fc14bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f3e00640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32fc14fa00 0x7f32fc1f7860 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 crypto rx=0x7f32e4006630 tx=0x7f32e40039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f8c00640 1 -- 172.21.15.17:0/3436669590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4015070 con 0x7f32fc14fa00 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f8c00640 1 -- 172.21.15.17:0/3436669590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32e4011920 con 0x7f32fc14fa00 2024-09-10T23:33:14.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f32f8c00640 1 -- 172.21.15.17:0/3436669590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4011d70 con 0x7f32fc14fa00 2024-09-10T23:33:14.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32fc0b6700 con 0x7f32fc14fa00 2024-09-10T23:33:14.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32fc0b6cc0 con 0x7f32fc14fa00 2024-09-10T23:33:14.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.629+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32fc0b0240 con 0x7f32fc14fa00 2024-09-10T23:33:14.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.633+0000 7f32f8c00640 1 -- 172.21.15.17:0/3436669590 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f32e40103c0 con 0x7f32fc14fa00 2024-09-10T23:33:14.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.633+0000 7f32f8c00640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32d8072610 0x7f32d8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:14.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.633+0000 7f32f8c00640 1 -- 172.21.15.17:0/3436669590 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f32e4093fe0 con 0x7f32fc14fa00 2024-09-10T23:33:14.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.633+0000 7f32fbe00640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32d8072610 0x7f32d8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:14.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.633+0000 7f32fbe00640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32d8072610 0x7f32d8074ad0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0ae000 tx=0x7f32ec01a010 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:14.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.637+0000 7f32f8c00640 1 -- 172.21.15.17:0/3436669590 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f32e405f150 con 0x7f32fc14fa00 2024-09-10T23:33:14.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:14.873+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) -- 0x7f32fc15c390 con 0x7f32fc14fa00 2024-09-10T23:33:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.089+0000 7f32f8c00640 1 -- 172.21.15.17:0/3436669590 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v811) ==== 133+0+0 (secure 0 0 0) 0x7f32e4063b80 con 0x7f32fc14fa00 2024-09-10T23:33:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32d8072610 msgr2=0x7f32d8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32d8072610 0x7f32d8074ad0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0ae000 tx=0x7f32ec01a010 comp rx=0 tx=0).stop 2024-09-10T23:33:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32fc14fa00 msgr2=0x7f32fc1f7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32fc14fa00 0x7f32fc1f7860 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 crypto rx=0x7f32e4006630 tx=0x7f32e40039d0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 shutdown_connections 2024-09-10T23:33:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f32d8072610 0x7f32d8074ad0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32fc1f7da0 0x7f32fc14bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32fc14fa00 0x7f32fc1f7860 unknown :-1 s=CLOSED pgs=2691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 --2- 172.21.15.17:0/3436669590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32e0003a60 0x7f32fc0b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 >> 172.21.15.17:0/3436669590 conn(0x7f32fc0d1bc0 msgr2=0x7f32fc0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 shutdown_connections 2024-09-10T23:33:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:15.093+0000 7f3301400640 1 -- 172.21.15.17:0/3436669590 wait complete. 2024-09-10T23:33:15.118 INFO:tasks.cephfs_test_runner:test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-10T23:33:15.118 INFO:tasks.cephfs_test_runner: 2024-09-10T23:33:15.118 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T23:33:15.118 INFO:tasks.cephfs_test_runner:Ran 15 tests in 1015.650s 2024-09-10T23:33:15.118 INFO:tasks.cephfs_test_runner: 2024-09-10T23:33:15.119 INFO:tasks.cephfs_test_runner:OK 2024-09-10T23:33:15.119 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T23:33:15.128 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T23:33:15.166 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T23:33:15.167 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:33:15.167 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:33:15.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:33:15.176 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-10T23:33:15.176 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:33:15.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3857 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T23:33:15.227 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:33:15.227 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:33:15.237 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:33:15.237 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-10T23:33:15.237 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T23:33:15.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9443 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T23:33:15.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:33:15.288 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T23:33:15.297 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T23:33:15.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:33:15.298 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T23:33:15.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:33:15.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T23:33:15.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:33:15.822 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-09-10T23:33:15.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:33:15.950 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-10T23:33:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T23:33:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T23:33:15.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:33:15.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T23:33:16.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:33:16.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T23:33:16.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T23:33:16.464 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-09-10T23:33:16.615 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T23:33:16.624 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T23:33:16.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:33:16.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.769+0000 7f42cf200640 1 -- 172.21.15.17:0/928919577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 msgr2=0x7f42c80b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.769+0000 7f42cf200640 1 --2- 172.21.15.17:0/928919577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 0x7f42c80b31f0 secure :-1 s=READY pgs=2693 cs=0 l=1 rev1=1 crypto rx=0x7f42b800a950 tx=0x7f42b801db70 comp rx=0 tx=0).stop 2024-09-10T23:33:16.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.769+0000 7f42cf200640 1 -- 172.21.15.17:0/928919577 shutdown_connections 2024-09-10T23:33:16.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.769+0000 7f42cf200640 1 --2- 172.21.15.17:0/928919577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 0x7f42c80b31f0 unknown :-1 s=CLOSED pgs=2693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.769+0000 7f42cf200640 1 -- 172.21.15.17:0/928919577 >> 172.21.15.17:0/928919577 conn(0x7f42c80b24f0 msgr2=0x7f42c80d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:16.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.769+0000 7f42cf200640 1 -- 172.21.15.17:0/928919577 shutdown_connections 2024-09-10T23:33:16.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.769+0000 7f42cf200640 1 -- 172.21.15.17:0/928919577 wait complete. 2024-09-10T23:33:16.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 Processor -- start 2024-09-10T23:33:16.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 -- start start 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 0x7f42c815c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42c80b3c70 0x7f42c80aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c815dbf0 0x7f42c815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f42c8167d70 con 0x7f42c806d8f0 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f42c80b49a0 con 0x7f42c815dbf0 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f42c8167ef0 con 0x7f42c80b3c70 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 0x7f42c815c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 0x7f42c815c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32934/0 (socket says 172.21.15.17:32934) 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cde00640 1 -- 172.21.15.17:0/3112755631 learned_addr learned my addr 172.21.15.17:0/3112755631 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cd400640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42c80b3c70 0x7f42c80aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42ce800640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c815dbf0 0x7f42c815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cde00640 1 -- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42c80b3c70 msgr2=0x7f42c80aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cde00640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42c80b3c70 0x7f42c80aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cde00640 1 -- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c815dbf0 msgr2=0x7f42c815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cde00640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c815dbf0 0x7f42c815ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cde00640 1 -- 172.21.15.17:0/3112755631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c80af1f0 con 0x7f42c806d8f0 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42ce800640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c815dbf0 0x7f42c815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cde00640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 0x7f42c815c420 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c400 tx=0x7f42bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42c2000640 1 -- 172.21.15.17:0/3112755631 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc011790 con 0x7f42c806d8f0 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42c2000640 1 -- 172.21.15.17:0/3112755631 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42bc017070 con 0x7f42c806d8f0 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c81f8390 con 0x7f42c806d8f0 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42c2000640 1 -- 172.21.15.17:0/3112755631 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc011cc0 con 0x7f42c806d8f0 2024-09-10T23:33:16.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.773+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c815b940 con 0x7f42c806d8f0 2024-09-10T23:33:16.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.777+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c80b31f0 con 0x7f42c806d8f0 2024-09-10T23:33:16.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.777+0000 7f42c2000640 1 -- 172.21.15.17:0/3112755631 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f42bc01c460 con 0x7f42c806d8f0 2024-09-10T23:33:16.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.777+0000 7f42c2000640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f42ac0725e0 0x7f42ac074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:16.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.777+0000 7f42c2000640 1 -- 172.21.15.17:0/3112755631 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f42bc092f90 con 0x7f42c806d8f0 2024-09-10T23:33:16.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.777+0000 7f42cd400640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f42ac0725e0 0x7f42ac074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:16.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.777+0000 7f42cd400640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f42ac0725e0 0x7f42ac074aa0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f42b80b0000 tx=0x7f42b801c3b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:16.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.781+0000 7f42c2000640 1 -- 172.21.15.17:0/3112755631 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f42c815ea50 con 0x7f42c806d8f0 2024-09-10T23:33:16.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.949+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42c80730c0 con 0x7f42ac0725e0 2024-09-10T23:33:16.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42c2000640 1 -- 172.21.15.17:0/3112755631 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13473 (secure 0 0 0) 0x7f42c80730c0 con 0x7f42ac0725e0 2024-09-10T23:33:16.956 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:16.956 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f42ac0725e0 msgr2=0x7f42ac074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f42ac0725e0 0x7f42ac074aa0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f42b80b0000 tx=0x7f42b801c3b0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 msgr2=0x7f42c815c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 0x7f42c815c420 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c400 tx=0x7f42bc00c8c0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 shutdown_connections 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f42ac0725e0 0x7f42ac074aa0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c815dbf0 0x7f42c815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f42c80b3c70 0x7f42c80aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 --2- 172.21.15.17:0/3112755631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c806d8f0 0x7f42c815c420 unknown :-1 s=CLOSED pgs=2694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 >> 172.21.15.17:0/3112755631 conn(0x7f42c80b24f0 msgr2=0x7f42c80b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:16.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 shutdown_connections 2024-09-10T23:33:16.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:16.953+0000 7f42cf200640 1 -- 172.21.15.17:0/3112755631 wait complete. 2024-09-10T23:33:16.978 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":759,"stamp":"2024-09-10T23:33:16.555629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":589344,"kb_used_data":36012,"kb_used_omap":12,"kb_used_meta":553139,"kb_avail":754385376,"statfs":{"total":773094113280,"available":772490625024,"internally_reserved":0,"allocated":36876288,"data_stored":24650476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":566414897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12617831,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-106,"num_write":-95,"num_write_kb":-12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001344"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":489,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-10T23:33:14.105780+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:33:14.105780+0000","last_peered":"2024-09-10T23:33:14.105780+0000","last_clean":"2024-09-10T23:33:14.105780+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:33:14.105780+0000","last_undegraded":"2024-09-10T23:33:14.105780+0000","last_fullsized":"2024-09-10T23:33:14.105780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476953,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74216,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297624,"statfs":{"total":96636764160,"available":96560766976,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509658,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92848,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94278992,"statfs":{"total":96636764160,"available":96541687808,"internally_reserved":0,"allocated":3493888,"data_stored":1955840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509657,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52056,"kb_used_data":2816,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319784,"statfs":{"total":96636764160,"available":96583458816,"internally_reserved":0,"allocated":2883584,"data_stored":1359378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509658,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80404,"kb_used_data":8960,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94291436,"statfs":{"total":96636764160,"available":96554430464,"internally_reserved":0,"allocated":9175040,"data_stored":7650834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509657,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80468,"kb_used_data":4864,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94291372,"statfs":{"total":96636764160,"available":96554364928,"internally_reserved":0,"allocated":4980736,"data_stored":3456530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509658,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52072,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319768,"statfs":{"total":96636764160,"available":96583442432,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509657,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81048,"kb_used_data":5444,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290792,"statfs":{"total":96636764160,"available":96553771008,"internally_reserved":0,"allocated":5574656,"data_stored":4046898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575065,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76232,"kb_used_data":4852,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94295608,"statfs":{"total":96636764160,"available":96558702592,"internally_reserved":0,"allocated":4968448,"data_stored":3450052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:33:16.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:33:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.121+0000 7fe311400640 1 -- 172.21.15.17:0/1827513024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0b07b0 msgr2=0x7fe30c0d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.121+0000 7fe311400640 1 --2- 172.21.15.17:0/1827513024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0b07b0 0x7fe30c0d0660 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 crypto rx=0x7fe304009c80 tx=0x7fe30401cda0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.121+0000 7fe311400640 1 -- 172.21.15.17:0/1827513024 shutdown_connections 2024-09-10T23:33:17.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.121+0000 7fe311400640 1 --2- 172.21.15.17:0/1827513024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0b07b0 0x7fe30c0d0660 unknown :-1 s=CLOSED pgs=2696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.121+0000 7fe311400640 1 -- 172.21.15.17:0/1827513024 >> 172.21.15.17:0/1827513024 conn(0x7fe30c0d1d40 msgr2=0x7fe30c0d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:17.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.121+0000 7fe311400640 1 -- 172.21.15.17:0/1827513024 shutdown_connections 2024-09-10T23:33:17.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.121+0000 7fe311400640 1 -- 172.21.15.17:0/1827513024 wait complete. 2024-09-10T23:33:17.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 Processor -- start 2024-09-10T23:33:17.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 -- start start 2024-09-10T23:33:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0b07b0 0x7fe30c06f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe30c0b2fc0 0x7fe30c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0cfb70 0x7fe30c147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c16a210 con 0x7fe30c0cfb70 2024-09-10T23:33:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c16a090 con 0x7fe30c0b07b0 2024-09-10T23:33:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c16a390 con 0x7fe30c0b2fc0 2024-09-10T23:33:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0cfb70 0x7fe30c147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0cfb70 0x7fe30c147850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32948/0 (socket says 172.21.15.17:32948) 2024-09-10T23:33:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30b200640 1 -- 172.21.15.17:0/55624628 learned_addr learned my addr 172.21.15.17:0/55624628 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30a800640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0b07b0 0x7fe30c06f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe303e00640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe30c0b2fc0 0x7fe30c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30b200640 1 -- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe30c0b2fc0 msgr2=0x7fe30c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30b200640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe30c0b2fc0 0x7fe30c155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30b200640 1 -- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0b07b0 msgr2=0x7fe30c06f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30b200640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0b07b0 0x7fe30c06f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30b200640 1 -- 172.21.15.17:0/55624628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c1579f0 con 0x7fe30c0cfb70 2024-09-10T23:33:17.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe30b200640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0cfb70 0x7fe30c147850 secure :-1 s=READY pgs=2697 cs=0 l=1 rev1=1 crypto rx=0x7fe304009bd0 tx=0x7fe3040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:17.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe302a00640 1 -- 172.21.15.17:0/55624628 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3040bb070 con 0x7fe30c0cfb70 2024-09-10T23:33:17.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe302a00640 1 -- 172.21.15.17:0/55624628 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3040047d0 con 0x7fe30c0cfb70 2024-09-10T23:33:17.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe302a00640 1 -- 172.21.15.17:0/55624628 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3040b2040 con 0x7fe30c0cfb70 2024-09-10T23:33:17.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c1563a0 con 0x7fe30c0cfb70 2024-09-10T23:33:17.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.125+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c157f90 con 0x7fe30c0cfb70 2024-09-10T23:33:17.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.129+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c15fc90 con 0x7fe30c0cfb70 2024-09-10T23:33:17.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.129+0000 7fe302a00640 1 -- 172.21.15.17:0/55624628 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe3040b5030 con 0x7fe30c0cfb70 2024-09-10T23:33:17.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.129+0000 7fe302a00640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2e80725e0 0x7fe2e8074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.129+0000 7fe302a00640 1 -- 172.21.15.17:0/55624628 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7fe30412d170 con 0x7fe30c0cfb70 2024-09-10T23:33:17.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.129+0000 7fe30a800640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2e80725e0 0x7fe2e8074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.129+0000 7fe30a800640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2e80725e0 0x7fe2e8074aa0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc007fd0 tx=0x7fe2fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:17.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.133+0000 7fe302a00640 1 -- 172.21.15.17:0/55624628 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe304016990 con 0x7fe30c0cfb70 2024-09-10T23:33:17.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe30c155390 con 0x7fe2e80725e0 2024-09-10T23:33:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe302a00640 1 -- 172.21.15.17:0/55624628 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13473 (secure 0 0 0) 0x7fe30c155390 con 0x7fe2e80725e0 2024-09-10T23:33:17.309 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:17.309 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2e80725e0 msgr2=0x7fe2e8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2e80725e0 0x7fe2e8074aa0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc007fd0 tx=0x7fe2fc009040 comp rx=0 tx=0).stop 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0cfb70 msgr2=0x7fe30c147850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0cfb70 0x7fe30c147850 secure :-1 s=READY pgs=2697 cs=0 l=1 rev1=1 crypto rx=0x7fe304009bd0 tx=0x7fe3040045e0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 shutdown_connections 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe2e80725e0 0x7fe2e8074aa0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30c0cfb70 0x7fe30c147850 unknown :-1 s=CLOSED pgs=2697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe30c0b2fc0 0x7fe30c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 --2- 172.21.15.17:0/55624628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0b07b0 0x7fe30c06f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 >> 172.21.15.17:0/55624628 conn(0x7fe30c0d1d40 msgr2=0x7fe30c158340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:17.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 shutdown_connections 2024-09-10T23:33:17.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.305+0000 7fe311400640 1 -- 172.21.15.17:0/55624628 wait complete. 2024-09-10T23:33:17.331 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":759,"stamp":"2024-09-10T23:33:16.555629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":589344,"kb_used_data":36012,"kb_used_omap":12,"kb_used_meta":553139,"kb_avail":754385376,"statfs":{"total":773094113280,"available":772490625024,"internally_reserved":0,"allocated":36876288,"data_stored":24650476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":566414897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12617831,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-106,"num_write":-95,"num_write_kb":-12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001344"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":489,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-10T23:33:14.105780+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:33:14.105780+0000","last_peered":"2024-09-10T23:33:14.105780+0000","last_clean":"2024-09-10T23:33:14.105780+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:33:14.105780+0000","last_undegraded":"2024-09-10T23:33:14.105780+0000","last_fullsized":"2024-09-10T23:33:14.105780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476953,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74216,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297624,"statfs":{"total":96636764160,"available":96560766976,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509658,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92848,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94278992,"statfs":{"total":96636764160,"available":96541687808,"internally_reserved":0,"allocated":3493888,"data_stored":1955840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509657,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52056,"kb_used_data":2816,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319784,"statfs":{"total":96636764160,"available":96583458816,"internally_reserved":0,"allocated":2883584,"data_stored":1359378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509658,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80404,"kb_used_data":8960,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94291436,"statfs":{"total":96636764160,"available":96554430464,"internally_reserved":0,"allocated":9175040,"data_stored":7650834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509657,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80468,"kb_used_data":4864,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94291372,"statfs":{"total":96636764160,"available":96554364928,"internally_reserved":0,"allocated":4980736,"data_stored":3456530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509658,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52072,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319768,"statfs":{"total":96636764160,"available":96583442432,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509657,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81048,"kb_used_data":5444,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290792,"statfs":{"total":96636764160,"available":96553771008,"internally_reserved":0,"allocated":5574656,"data_stored":4046898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575065,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76232,"kb_used_data":4852,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94295608,"statfs":{"total":96636764160,"available":96558702592,"internally_reserved":0,"allocated":4968448,"data_stored":3450052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:33:17.332 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T23:33:17.332 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:33:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.473+0000 7f9f5b000640 1 -- 172.21.15.17:0/3104722986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f38004d50 msgr2=0x7f9f380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.473+0000 7f9f5b000640 1 --2- 172.21.15.17:0/3104722986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f38004d50 0x7f9f380051d0 secure :-1 s=READY pgs=2699 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009f10 tx=0x7f9f4c01d5d0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.473+0000 7f9f59000640 1 -- 172.21.15.17:0/3104722986 reap_dead start 2024-09-10T23:33:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.473+0000 7f9f5b000640 1 -- 172.21.15.17:0/3104722986 shutdown_connections 2024-09-10T23:33:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.473+0000 7f9f5b000640 1 -- 172.21.15.17:0/3104722986 >> 172.21.15.17:0/3104722986 conn(0x7f9f540d1d40 msgr2=0x7f9f540d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.473+0000 7f9f5b000640 1 -- 172.21.15.17:0/3104722986 shutdown_connections 2024-09-10T23:33:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.473+0000 7f9f5b000640 1 -- 172.21.15.17:0/3104722986 wait complete. 2024-09-10T23:33:17.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 Processor -- start 2024-09-10T23:33:17.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 -- start start 2024-09-10T23:33:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f38004d50 0x7f9f54154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f540b5fd0 0x7f9f540b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f541e53b0 0x7f9f541e5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5415f6c0 con 0x7f9f540b5fd0 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9f540af480 con 0x7f9f541e53b0 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9f540b7b30 con 0x7f9f38004d50 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f540b5fd0 0x7f9f540b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f540b5fd0 0x7f9f540b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32960/0 (socket says 172.21.15.17:32960) 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f4be00640 1 -- 172.21.15.17:0/1924230546 learned_addr learned my addr 172.21.15.17:0/1924230546 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f59000640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f541e53b0 0x7f9f541e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f53e00640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f38004d50 0x7f9f54154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f4be00640 1 -- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f38004d50 msgr2=0x7f9f54154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f4be00640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f38004d50 0x7f9f54154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f4be00640 1 -- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f541e53b0 msgr2=0x7f9f541e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f4be00640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f541e53b0 0x7f9f541e5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f4be00640 1 -- 172.21.15.17:0/1924230546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f540b6a90 con 0x7f9f540b5fd0 2024-09-10T23:33:17.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f4be00640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f540b5fd0 0x7f9f540b6450 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c001060 tx=0x7f9f3c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:17.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f50c00640 1 -- 172.21.15.17:0/1924230546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c015070 con 0x7f9f540b5fd0 2024-09-10T23:33:17.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f50c00640 1 -- 172.21.15.17:0/1924230546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f3c011840 con 0x7f9f540b5fd0 2024-09-10T23:33:17.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f540b6d70 con 0x7f9f540b5fd0 2024-09-10T23:33:17.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f50c00640 1 -- 172.21.15.17:0/1924230546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c011c90 con 0x7f9f540b5fd0 2024-09-10T23:33:17.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.477+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f540b7330 con 0x7f9f540b5fd0 2024-09-10T23:33:17.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.481+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f540cfb20 con 0x7f9f540b5fd0 2024-09-10T23:33:17.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.481+0000 7f9f50c00640 1 -- 172.21.15.17:0/1924230546 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f9f3c0103c0 con 0x7f9f540b5fd0 2024-09-10T23:33:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.481+0000 7f9f50c00640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9f300725e0 0x7f9f30074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.481+0000 7f9f50c00640 1 -- 172.21.15.17:0/1924230546 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f9f3c094130 con 0x7f9f540b5fd0 2024-09-10T23:33:17.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.481+0000 7f9f53e00640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9f300725e0 0x7f9f30074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.481+0000 7f9f53e00640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9f300725e0 0x7f9f30074aa0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9f44009d80 tx=0x7f9f440091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:17.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.485+0000 7f9f50c00640 1 -- 172.21.15.17:0/1924230546 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f9f3c05f240 con 0x7f9f540b5fd0 2024-09-10T23:33:17.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.657+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f540d0100 con 0x7f9f300725e0 2024-09-10T23:33:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.657+0000 7f9f50c00640 1 -- 172.21.15.17:0/1924230546 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13473 (secure 0 0 0) 0x7f9f540d0100 con 0x7f9f300725e0 2024-09-10T23:33:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:17.662 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:33:17.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9f300725e0 msgr2=0x7f9f30074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9f300725e0 0x7f9f30074aa0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9f44009d80 tx=0x7f9f440091e0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f540b5fd0 msgr2=0x7f9f540b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f540b5fd0 0x7f9f540b6450 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c001060 tx=0x7f9f3c0039d0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 shutdown_connections 2024-09-10T23:33:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f9f300725e0 0x7f9f30074aa0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f541e53b0 0x7f9f541e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f540b5fd0 0x7f9f540b6450 unknown :-1 s=CLOSED pgs=2700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 --2- 172.21.15.17:0/1924230546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9f38004d50 0x7f9f54154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 >> 172.21.15.17:0/1924230546 conn(0x7f9f540d1d40 msgr2=0x7f9f5406d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 shutdown_connections 2024-09-10T23:33:17.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.661+0000 7f9f5b000640 1 -- 172.21.15.17:0/1924230546 wait complete. 2024-09-10T23:33:17.683 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":759,"stamp":"2024-09-10T23:33:16.555629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":589344,"kb_used_data":36012,"kb_used_omap":12,"kb_used_meta":553139,"kb_avail":754385376,"statfs":{"total":773094113280,"available":772490625024,"internally_reserved":0,"allocated":36876288,"data_stored":24650476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":566414897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12617831,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-106,"num_write":-95,"num_write_kb":-12353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001344"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":489,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-10T23:33:14.105780+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:33:14.105780+0000","last_peered":"2024-09-10T23:33:14.105780+0000","last_clean":"2024-09-10T23:33:14.105780+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:33:14.105780+0000","last_undegraded":"2024-09-10T23:33:14.105780+0000","last_fullsized":"2024-09-10T23:33:14.105780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476953,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74216,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297624,"statfs":{"total":96636764160,"available":96560766976,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509658,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92848,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94278992,"statfs":{"total":96636764160,"available":96541687808,"internally_reserved":0,"allocated":3493888,"data_stored":1955840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509657,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52056,"kb_used_data":2816,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319784,"statfs":{"total":96636764160,"available":96583458816,"internally_reserved":0,"allocated":2883584,"data_stored":1359378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509658,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80404,"kb_used_data":8960,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94291436,"statfs":{"total":96636764160,"available":96554430464,"internally_reserved":0,"allocated":9175040,"data_stored":7650834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509657,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80468,"kb_used_data":4864,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94291372,"statfs":{"total":96636764160,"available":96554364928,"internally_reserved":0,"allocated":4980736,"data_stored":3456530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509658,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52072,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319768,"statfs":{"total":96636764160,"available":96583442432,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509657,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81048,"kb_used_data":5444,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94290792,"statfs":{"total":96636764160,"available":96553771008,"internally_reserved":0,"allocated":5574656,"data_stored":4046898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575065,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76232,"kb_used_data":4852,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94295608,"statfs":{"total":96636764160,"available":96558702592,"internally_reserved":0,"allocated":4968448,"data_stored":3450052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:33:17.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T23:33:17.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.825+0000 7efce8200640 1 -- 172.21.15.17:0/636914670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcc8003a40 msgr2=0x7efcc8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.825+0000 7efce8200640 1 --2- 172.21.15.17:0/636914670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcc8003a40 0x7efcc8003e60 secure :-1 s=READY pgs=2702 cs=0 l=1 rev1=1 crypto rx=0x7efce0070d10 tx=0x7efcd401d2d0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.825+0000 7efce6200640 1 -- 172.21.15.17:0/636914670 reap_dead start 2024-09-10T23:33:17.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.825+0000 7efce8200640 1 -- 172.21.15.17:0/636914670 shutdown_connections 2024-09-10T23:33:17.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.825+0000 7efce8200640 1 -- 172.21.15.17:0/636914670 >> 172.21.15.17:0/636914670 conn(0x7efce00b1850 msgr2=0x7efce00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:17.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.825+0000 7efce8200640 1 -- 172.21.15.17:0/636914670 shutdown_connections 2024-09-10T23:33:17.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.825+0000 7efce8200640 1 -- 172.21.15.17:0/636914670 wait complete. 2024-09-10T23:33:17.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 Processor -- start 2024-09-10T23:33:17.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 -- start start 2024-09-10T23:33:17.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcc8003a40 0x7efce00b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce00b0a50 0x7efce01fc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efce01fc550 0x7efce01362b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7efce0167100 con 0x7efcc8003a40 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efce0166f80 con 0x7efce00b0a50 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7efce0167280 con 0x7efce01fc550 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcc8003a40 0x7efce00b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcc8003a40 0x7efce00b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32978/0 (socket says 172.21.15.17:32978) 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce5800640 1 -- 172.21.15.17:0/876770932 learned_addr learned my addr 172.21.15.17:0/876770932 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce6200640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efce01fc550 0x7efce01362b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce4e00640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce00b0a50 0x7efce01fc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce5800640 1 -- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efce01fc550 msgr2=0x7efce01362b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce5800640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efce01fc550 0x7efce01362b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce5800640 1 -- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce00b0a50 msgr2=0x7efce01fc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce5800640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce00b0a50 0x7efce01fc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce5800640 1 -- 172.21.15.17:0/876770932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce00b36d0 con 0x7efcc8003a40 2024-09-10T23:33:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce5800640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcc8003a40 0x7efce00b4770 secure :-1 s=READY pgs=2703 cs=0 l=1 rev1=1 crypto rx=0x7efcd401d100 tx=0x7efcd40adeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efcdd600640 1 -- 172.21.15.17:0/876770932 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd40bc020 con 0x7efcc8003a40 2024-09-10T23:33:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efcdd600640 1 -- 172.21.15.17:0/876770932 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcd4005330 con 0x7efcc8003a40 2024-09-10T23:33:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efcdd600640 1 -- 172.21.15.17:0/876770932 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd40b1040 con 0x7efcc8003a40 2024-09-10T23:33:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce00b39b0 con 0x7efcc8003a40 2024-09-10T23:33:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.829+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce00b3f70 con 0x7efcc8003a40 2024-09-10T23:33:17.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.833+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce0075ad0 con 0x7efcc8003a40 2024-09-10T23:33:17.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.833+0000 7efcdd600640 1 -- 172.21.15.17:0/876770932 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7efcd40046d0 con 0x7efcc8003a40 2024-09-10T23:33:17.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.833+0000 7efcdd600640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcc00725e0 0x7efcc0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:17.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.833+0000 7efcdd600640 1 -- 172.21.15.17:0/876770932 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7efcd412ec00 con 0x7efcc8003a40 2024-09-10T23:33:17.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.833+0000 7efce4e00640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcc00725e0 0x7efcc0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:17.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.833+0000 7efce4e00640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcc00725e0 0x7efcc0074aa0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7efccc000fc0 tx=0x7efccc0067b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:17.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:17.837+0000 7efcdd600640 1 -- 172.21.15.17:0/876770932 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7efcd40c6030 con 0x7efcc8003a40 2024-09-10T23:33:18.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.009+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efce015b7b0 con 0x7efcc8003a40 2024-09-10T23:33:18.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.009+0000 7efcdd600640 1 -- 172.21.15.17:0/876770932 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v229) ==== 74+0+13385 (secure 0 0 0) 0x7efcd4016fe0 con 0x7efcc8003a40 2024-09-10T23:33:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:18.015 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":229,"fsid":"ea7b88b2-cb2c-4bdd-bf27-30f6eb68b442","created":"2024-09-10T23:15:10.839521+0000","modified":"2024-09-10T23:33:14.091110+0000","last_up_change":"2024-09-10T23:15:25.735261+0000","last_in_change":"2024-09-10T23:15:14.579735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T23:15:26.315157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"28b1dc72-2c49-4bc9-9803-d4c4ef108f7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6825","nonce":2280070654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6827","nonce":2280070654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6831","nonce":2280070654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":2280070654},{"type":"v1","addr":"172.21.15.17:6829","nonce":2280070654}]},"public_addr":"172.21.15.17:6825/2280070654","cluster_addr":"172.21.15.17:6827/2280070654","heartbeat_back_addr":"172.21.15.17:6831/2280070654","heartbeat_front_addr":"172.21.15.17:6829/2280070654","state":["exists","up"]},{"osd":1,"uuid":"d51150ef-7e0f-43ba-a1ac-75614e6c3a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":225,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6809","nonce":132168374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6811","nonce":132168374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6815","nonce":132168374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":132168374},{"type":"v1","addr":"172.21.15.17:6813","nonce":132168374}]},"public_addr":"172.21.15.17:6809/132168374","cluster_addr":"172.21.15.17:6811/132168374","heartbeat_back_addr":"172.21.15.17:6815/132168374","heartbeat_front_addr":"172.21.15.17:6813/132168374","state":["exists","up"]},{"osd":2,"uuid":"e54744d6-eaf8-4bae-9641-2990477143c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6817","nonce":2333448301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6819","nonce":2333448301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6823","nonce":2333448301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2333448301},{"type":"v1","addr":"172.21.15.17:6821","nonce":2333448301}]},"public_addr":"172.21.15.17:6817/2333448301","cluster_addr":"172.21.15.17:6819/2333448301","heartbeat_back_addr":"172.21.15.17:6823/2333448301","heartbeat_front_addr":"172.21.15.17:6821/2333448301","state":["exists","up"]},{"osd":3,"uuid":"954fb5c5-85f7-40f0-8faa-198e6d1efd78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6801","nonce":1907203974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6803","nonce":1907203974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6807","nonce":1907203974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":1907203974},{"type":"v1","addr":"172.21.15.17:6805","nonce":1907203974}]},"public_addr":"172.21.15.17:6801/1907203974","cluster_addr":"172.21.15.17:6803/1907203974","heartbeat_back_addr":"172.21.15.17:6807/1907203974","heartbeat_front_addr":"172.21.15.17:6805/1907203974","state":["exists","up"]},{"osd":4,"uuid":"597cbd01-5fb5-41a8-b847-9a7183e259e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":225,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6803","nonce":328051167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6805","nonce":328051167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6809","nonce":328051167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":328051167},{"type":"v1","addr":"172.21.15.77:6807","nonce":328051167}]},"public_addr":"172.21.15.77:6803/328051167","cluster_addr":"172.21.15.77:6805/328051167","heartbeat_back_addr":"172.21.15.77:6809/328051167","heartbeat_front_addr":"172.21.15.77:6807/328051167","state":["exists","up"]},{"osd":5,"uuid":"fb58fd63-b1c8-4016-9c56-b4038e6e6901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6827","nonce":209138323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6829","nonce":209138323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6833","nonce":209138323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":209138323},{"type":"v1","addr":"172.21.15.77:6831","nonce":209138323}]},"public_addr":"172.21.15.77:6827/209138323","cluster_addr":"172.21.15.77:6829/209138323","heartbeat_back_addr":"172.21.15.77:6833/209138323","heartbeat_front_addr":"172.21.15.77:6831/209138323","state":["exists","up"]},{"osd":6,"uuid":"150cca06-fd47-4852-a69b-20244531d93e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6819","nonce":1112476977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6821","nonce":1112476977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6825","nonce":1112476977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":1112476977},{"type":"v1","addr":"172.21.15.77:6823","nonce":1112476977}]},"public_addr":"172.21.15.77:6819/1112476977","cluster_addr":"172.21.15.77:6821/1112476977","heartbeat_back_addr":"172.21.15.77:6825/1112476977","heartbeat_front_addr":"172.21.15.77:6823/1112476977","state":["exists","up"]},{"osd":7,"uuid":"09f6ab2a-1995-4690-8b7f-240550242914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":221,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6811","nonce":1526018425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6813","nonce":1526018425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6817","nonce":1526018425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1526018425},{"type":"v1","addr":"172.21.15.77:6815","nonce":1526018425}]},"public_addr":"172.21.15.77:6811/1526018425","cluster_addr":"172.21.15.77:6813/1526018425","heartbeat_back_addr":"172.21.15.77:6817/1526018425","heartbeat_front_addr":"172.21.15.77:6815/1526018425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.520457+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.424711+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.951642+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.187828+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.631872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.807367+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:21.910386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T23:15:22.123789+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6835/2426812353":"2024-09-11T23:33:11.082144+0000","172.21.15.17:6833/2426812353":"2024-09-11T23:33:11.082144+0000","172.21.15.17:6835/1849575634":"2024-09-11T23:32:00.172130+0000","172.21.15.17:6833/1849575634":"2024-09-11T23:32:00.172130+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T23:33:18.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcc00725e0 msgr2=0x7efcc0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcc00725e0 0x7efcc0074aa0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7efccc000fc0 tx=0x7efccc0067b0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcc8003a40 msgr2=0x7efce00b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcc8003a40 0x7efce00b4770 secure :-1 s=READY pgs=2703 cs=0 l=1 rev1=1 crypto rx=0x7efcd401d100 tx=0x7efcd40adeb0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 shutdown_connections 2024-09-10T23:33:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7efcc00725e0 0x7efcc0074aa0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efce01fc550 0x7efce01362b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce00b0a50 0x7efce01fc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 --2- 172.21.15.17:0/876770932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcc8003a40 0x7efce00b4770 unknown :-1 s=CLOSED pgs=2703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 >> 172.21.15.17:0/876770932 conn(0x7efce00b1850 msgr2=0x7efce015cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 shutdown_connections 2024-09-10T23:33:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:18.013+0000 7efce8200640 1 -- 172.21.15.17:0/876770932 wait complete. 2024-09-10T23:33:19.037 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T23:33:19.037 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:33:19.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 -- 172.21.15.17:0/244690152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f401c154ea0 msgr2=0x7f401c15ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 --2- 172.21.15.17:0/244690152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f401c154ea0 0x7f401c15ba70 secure :-1 s=READY pgs=2704 cs=0 l=1 rev1=1 crypto rx=0x7f401c0cd680 tx=0x7f400c01c890 comp rx=0 tx=0).stop 2024-09-10T23:33:19.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 -- 172.21.15.17:0/244690152 shutdown_connections 2024-09-10T23:33:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 --2- 172.21.15.17:0/244690152 >> v2:172.21.15.77:3300/0 conn(0x7f401c073fd0 0x7f401c0cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 --2- 172.21.15.17:0/244690152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f401c154ea0 0x7f401c15ba70 unknown :-1 s=CLOSED pgs=2704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 -- 172.21.15.17:0/244690152 >> 172.21.15.17:0/244690152 conn(0x7f401c0d0c30 msgr2=0x7f401c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 -- 172.21.15.17:0/244690152 shutdown_connections 2024-09-10T23:33:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 -- 172.21.15.17:0/244690152 wait complete. 2024-09-10T23:33:19.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 Processor -- start 2024-09-10T23:33:19.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.197+0000 7f4020c00640 1 -- start start 2024-09-10T23:33:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4020c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f401c073fd0 0x7f401c13b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4020c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f401c0ae940 0x7f401c14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4020c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f401c154ea0 0x7f401c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4020c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f401c167bb0 con 0x7f401c073fd0 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4020c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f401c167a30 con 0x7f401c154ea0 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4020c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f401c167d30 con 0x7f401c0ae940 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4019e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f401c073fd0 0x7f401c13b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4019e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f401c073fd0 0x7f401c13b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32988/0 (socket says 172.21.15.17:32988) 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4019e00640 1 -- 172.21.15.17:0/3926143659 learned_addr learned my addr 172.21.15.17:0/3926143659 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4013e00640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f401c0ae940 0x7f401c14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f401a800640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f401c154ea0 0x7f401c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4019e00640 1 -- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f401c0ae940 msgr2=0x7f401c14f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4019e00640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f401c0ae940 0x7f401c14f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4019e00640 1 -- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f401c154ea0 msgr2=0x7f401c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4019e00640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f401c154ea0 0x7f401c14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4019e00640 1 -- 172.21.15.17:0/3926143659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401c0b49a0 con 0x7f401c073fd0 2024-09-10T23:33:19.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4019e00640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f401c073fd0 0x7f401c13b490 secure :-1 s=READY pgs=2705 cs=0 l=1 rev1=1 crypto rx=0x7f400c0194a0 tx=0x7f400c0a8410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4012000640 1 -- 172.21.15.17:0/3926143659 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c004240 con 0x7f401c073fd0 2024-09-10T23:33:19.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4012000640 1 -- 172.21.15.17:0/3926143659 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f400c0a8600 con 0x7f401c073fd0 2024-09-10T23:33:19.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4012000640 1 -- 172.21.15.17:0/3926143659 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c005290 con 0x7f401c073fd0 2024-09-10T23:33:19.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401c0b4c80 con 0x7f401c073fd0 2024-09-10T23:33:19.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f401c0b5240 con 0x7f401c073fd0 2024-09-10T23:33:19.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.201+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f401c0cb280 con 0x7f401c073fd0 2024-09-10T23:33:19.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f4012000640 1 -- 172.21.15.17:0/3926143659 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f400c0c1060 con 0x7f401c073fd0 2024-09-10T23:33:19.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f4012000640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ff8072610 0x7f3ff8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f4012000640 1 -- 172.21.15.17:0/3926143659 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f400c12c890 con 0x7f401c073fd0 2024-09-10T23:33:19.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f4012000640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7f3ff8078b50 0x7f3ff807af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f4012000640 1 -- 172.21.15.17:0/3926143659 --> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f400c0bfe50 con 0x7f3ff8078b50 2024-09-10T23:33:19.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f4012000640 1 -- 172.21.15.17:0/3926143659 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=229) ==== 24+0+0 (secure 0 0 0) 0x7f400c1312a0 con 0x7f401c073fd0 2024-09-10T23:33:19.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f4013e00640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ff8072610 0x7f3ff8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f401a800640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7f3ff8078b50 0x7f3ff807af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f4013e00640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ff8072610 0x7f3ff8074ad0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f401c0b6d00 tx=0x7f4004009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f401a800640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7f3ff8078b50 0x7f3ff807af90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.205+0000 7f4012000640 1 -- 172.21.15.17:0/3926143659 <== osd.0 v2:172.21.15.17:6824/2280070654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f400c0bfe50 con 0x7f3ff8078b50 2024-09-10T23:33:19.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 --> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f401c154b20 con 0x7f3ff8078b50 2024-09-10T23:33:19.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4012000640 1 -- 172.21.15.17:0/3926143659 <== osd.0 v2:172.21.15.17:6824/2280070654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f401c154b20 con 0x7f3ff8078b50 2024-09-10T23:33:19.224 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:19.224 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:33:19.224 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:19.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7f3ff8078b50 msgr2=0x7f3ff807af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.17:6824/2280070654,v1:172.21.15.17:6825/2280070654] conn(0x7f3ff8078b50 0x7f3ff807af90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ff8072610 msgr2=0x7f3ff8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f3ff8072610 0x7f3ff8074ad0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f401c0b6d00 tx=0x7f4004009040 comp rx=0 tx=0).stop 2024-09-10T23:33:19.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f401c073fd0 msgr2=0x7f401c13b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 --2- 172.21.15.17:0/3926143659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f401c073fd0 0x7f401c13b490 secure :-1 s=READY pgs=2705 cs=0 l=1 rev1=1 crypto rx=0x7f400c0194a0 tx=0x7f400c0a8410 comp rx=0 tx=0).stop 2024-09-10T23:33:19.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f401a800640 1 -- 172.21.15.17:0/3926143659 reap_dead start 2024-09-10T23:33:19.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 shutdown_connections 2024-09-10T23:33:19.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 >> 172.21.15.17:0/3926143659 conn(0x7f401c0d0c30 msgr2=0x7f401c0d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:19.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 shutdown_connections 2024-09-10T23:33:19.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.221+0000 7f4020c00640 1 -- 172.21.15.17:0/3926143659 wait complete. 2024-09-10T23:33:19.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T23:33:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.385+0000 7f8a8fe00640 1 -- 172.21.15.17:0/3276694806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a900b47f0 msgr2=0x7f8a9015b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.385+0000 7f8a8fe00640 1 --2- 172.21.15.17:0/3276694806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a900b47f0 0x7f8a9015b030 secure :-1 s=READY pgs=2706 cs=0 l=1 rev1=1 crypto rx=0x7f8a90069270 tx=0x7f8a8801d7b0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.385+0000 7f8a8fe00640 1 -- 172.21.15.17:0/3276694806 shutdown_connections 2024-09-10T23:33:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.385+0000 7f8a8fe00640 1 --2- 172.21.15.17:0/3276694806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a900b47f0 0x7f8a9015b030 unknown :-1 s=CLOSED pgs=2706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.385+0000 7f8a8fe00640 1 --2- 172.21.15.17:0/3276694806 >> v2:172.21.15.77:3300/0 conn(0x7f8a90154f40 0x7f8a900b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.385+0000 7f8a8fe00640 1 -- 172.21.15.17:0/3276694806 >> 172.21.15.17:0/3276694806 conn(0x7f8a9006f0c0 msgr2=0x7f8a9006f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.385+0000 7f8a8fe00640 1 -- 172.21.15.17:0/3276694806 shutdown_connections 2024-09-10T23:33:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.385+0000 7f8a8fe00640 1 -- 172.21.15.17:0/3276694806 wait complete. 2024-09-10T23:33:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 Processor -- start 2024-09-10T23:33:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 -- start start 2024-09-10T23:33:19.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a90074d30 0x7f8a901fba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a900b47f0 0x7f8a900b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a90154f40 0x7f8a9015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90167db0 con 0x7f8a90154f40 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90167c30 con 0x7f8a900b47f0 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f8a90167f30 con 0x7f8a90074d30 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a90154f40 0x7f8a9015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a90154f40 0x7f8a9015ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33008/0 (socket says 172.21.15.17:33008) 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8f400640 1 -- 172.21.15.17:0/238824346 learned_addr learned my addr 172.21.15.17:0/238824346 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8ea00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a90074d30 0x7f8a901fba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a87e00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a900b47f0 0x7f8a900b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8f400640 1 -- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a90074d30 msgr2=0x7f8a901fba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8f400640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a90074d30 0x7f8a901fba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8f400640 1 -- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a900b47f0 msgr2=0x7f8a900b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8f400640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a900b47f0 0x7f8a900b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8f400640 1 -- 172.21.15.17:0/238824346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9015d3a0 con 0x7f8a90154f40 2024-09-10T23:33:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8f400640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a90154f40 0x7f8a9015ca30 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7f8a8801cd90 tx=0x7f8a880092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a86a00640 1 -- 172.21.15.17:0/238824346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a880bb070 con 0x7f8a90154f40 2024-09-10T23:33:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a86a00640 1 -- 172.21.15.17:0/238824346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a88004d40 con 0x7f8a90154f40 2024-09-10T23:33:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a86a00640 1 -- 172.21.15.17:0/238824346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a880b2040 con 0x7f8a90154f40 2024-09-10T23:33:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9015d680 con 0x7f8a90154f40 2024-09-10T23:33:19.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.389+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a900b23d0 con 0x7f8a90154f40 2024-09-10T23:33:19.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.393+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9015b030 con 0x7f8a90154f40 2024-09-10T23:33:19.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.393+0000 7f8a86a00640 1 -- 172.21.15.17:0/238824346 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f8a880b5030 con 0x7f8a90154f40 2024-09-10T23:33:19.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.393+0000 7f8a86a00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a6c0725e0 0x7f8a6c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.393+0000 7f8a86a00640 1 -- 172.21.15.17:0/238824346 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f8a8812cbf0 con 0x7f8a90154f40 2024-09-10T23:33:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.393+0000 7f8a8ea00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a6c0725e0 0x7f8a6c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.393+0000 7f8a8ea00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a6c0725e0 0x7f8a6c074aa0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000bb50 tx=0x7f8a8000b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.397+0000 7f8a86a00640 1 -- 172.21.15.17:0/238824346 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f8a88016970 con 0x7f8a90154f40 2024-09-10T23:33:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.569+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f8a900d0c30 con 0x7f8a6c0725e0 2024-09-10T23:33:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a86a00640 1 -- 172.21.15.17:0/238824346 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8a900d0c30 con 0x7f8a6c0725e0 2024-09-10T23:33:19.575 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T23:33:19.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a6c0725e0 msgr2=0x7f8a6c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a6c0725e0 0x7f8a6c074aa0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000bb50 tx=0x7f8a8000b2e0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a90154f40 msgr2=0x7f8a9015ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a90154f40 0x7f8a9015ca30 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7f8a8801cd90 tx=0x7f8a880092c0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 shutdown_connections 2024-09-10T23:33:19.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f8a6c0725e0 0x7f8a6c074aa0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a90154f40 0x7f8a9015ca30 unknown :-1 s=CLOSED pgs=2707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a900b47f0 0x7f8a900b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 --2- 172.21.15.17:0/238824346 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a90074d30 0x7f8a901fba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 >> 172.21.15.17:0/238824346 conn(0x7f8a9006f0c0 msgr2=0x7f8a9014fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:19.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 shutdown_connections 2024-09-10T23:33:19.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.573+0000 7f8a8fe00640 1 -- 172.21.15.17:0/238824346 wait complete. 2024-09-10T23:33:19.598 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T23:33:19.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:33:19.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 -- 172.21.15.17:0/3999913499 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a00cb4e0 msgr2=0x7ff0a00743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 --2- 172.21.15.17:0/3999913499 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a00cb4e0 0x7ff0a00743d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff098009bc0 tx=0x7ff09801ca80 comp rx=0 tx=0).stop 2024-09-10T23:33:19.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 -- 172.21.15.17:0/3999913499 shutdown_connections 2024-09-10T23:33:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 --2- 172.21.15.17:0/3999913499 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a00cb4e0 0x7ff0a00743d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 --2- 172.21.15.17:0/3999913499 >> v2:172.21.15.77:3300/0 conn(0x7ff0a015bbc0 0x7ff0a0073e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 -- 172.21.15.17:0/3999913499 >> 172.21.15.17:0/3999913499 conn(0x7ff0a00cc590 msgr2=0x7ff0a00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 -- 172.21.15.17:0/3999913499 shutdown_connections 2024-09-10T23:33:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 -- 172.21.15.17:0/3999913499 wait complete. 2024-09-10T23:33:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 Processor -- start 2024-09-10T23:33:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.745+0000 7ff0a7e00640 1 -- start start 2024-09-10T23:33:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a00cb4e0 0x7ff0a014ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a015bbc0 0x7ff0a01f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0a0149cf0 0x7ff0a0158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a7e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a0169460 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a01692e0 con 0x7ff0a0149cf0 2024-09-10T23:33:19.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a01695e0 con 0x7ff0a015bbc0 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a00cb4e0 0x7ff0a014ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a00cb4e0 0x7ff0a014ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33016/0 (socket says 172.21.15.17:33016) 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5400640 1 -- 172.21.15.17:0/2403710971 learned_addr learned my addr 172.21.15.17:0/2403710971 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a4a00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a015bbc0 0x7ff0a01f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5e00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0a0149cf0 0x7ff0a0158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5400640 1 -- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a015bbc0 msgr2=0x7ff0a01f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5400640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0a015bbc0 0x7ff0a01f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5400640 1 -- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0a0149cf0 msgr2=0x7ff0a0158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5400640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0a0149cf0 0x7ff0a0158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5400640 1 -- 172.21.15.17:0/2403710971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a01555a0 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5e00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0a0149cf0 0x7ff0a0158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a5400640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a00cb4e0 0x7ff0a014ab00 secure :-1 s=READY pgs=2708 cs=0 l=1 rev1=1 crypto rx=0x7ff09400e970 tx=0x7ff09400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff09d600640 1 -- 172.21.15.17:0/2403710971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09400cd80 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff09d600640 1 -- 172.21.15.17:0/2403710971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff094004020 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a014b270 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff09d600640 1 -- 172.21.15.17:0/2403710971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094004470 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a014b830 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.749+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0a014bb70 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff09d600640 1 -- 172.21.15.17:0/2403710971 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff094003600 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff09d600640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0800725e0 0x7ff080074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff09d600640 1 -- 172.21.15.17:0/2403710971 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7ff094093de0 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff09d600640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7ff080078b20 0x7ff08007af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff09d600640 1 -- 172.21.15.17:0/2403710971 --> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff08007b630 con 0x7ff080078b20 2024-09-10T23:33:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff09d600640 1 -- 172.21.15.17:0/2403710971 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=229) ==== 24+0+0 (secure 0 0 0) 0x7ff094094190 con 0x7ff0a00cb4e0 2024-09-10T23:33:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff0a4a00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0800725e0 0x7ff080074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff0a5e00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7ff080078b20 0x7ff08007af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff0a4a00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0800725e0 0x7ff080074aa0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0159170 tx=0x7ff08c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff0a5e00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7ff080078b20 0x7ff08007af60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.753+0000 7ff09d600640 1 -- 172.21.15.17:0/2403710971 <== osd.1 v2:172.21.15.17:6808/132168374 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff08007b630 con 0x7ff080078b20 2024-09-10T23:33:19.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 --> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff0a015f770 con 0x7ff080078b20 2024-09-10T23:33:19.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff09d600640 1 -- 172.21.15.17:0/2403710971 <== osd.1 v2:172.21.15.17:6808/132168374 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff0a015f770 con 0x7ff080078b20 2024-09-10T23:33:19.772 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:19.772 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:33:19.773 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:19.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7ff080078b20 msgr2=0x7ff08007af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.17:6808/132168374,v1:172.21.15.17:6809/132168374] conn(0x7ff080078b20 0x7ff08007af60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0800725e0 msgr2=0x7ff080074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff0800725e0 0x7ff080074aa0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0159170 tx=0x7ff08c009040 comp rx=0 tx=0).stop 2024-09-10T23:33:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a00cb4e0 msgr2=0x7ff0a014ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 --2- 172.21.15.17:0/2403710971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0a00cb4e0 0x7ff0a014ab00 secure :-1 s=READY pgs=2708 cs=0 l=1 rev1=1 crypto rx=0x7ff09400e970 tx=0x7ff09400ee30 comp rx=0 tx=0).stop 2024-09-10T23:33:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a5e00640 1 -- 172.21.15.17:0/2403710971 reap_dead start 2024-09-10T23:33:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 shutdown_connections 2024-09-10T23:33:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 >> 172.21.15.17:0/2403710971 conn(0x7ff0a00cc590 msgr2=0x7ff0a01578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 shutdown_connections 2024-09-10T23:33:19.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.769+0000 7ff0a7e00640 1 -- 172.21.15.17:0/2403710971 wait complete. 2024-09-10T23:33:19.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T23:33:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 -- 172.21.15.17:0/3941004325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 msgr2=0x7f6044161af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 --2- 172.21.15.17:0/3941004325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 0x7f6044161af0 secure :-1 s=READY pgs=2710 cs=0 l=1 rev1=1 crypto rx=0x7f6034009840 tx=0x7f603401c820 comp rx=0 tx=0).stop 2024-09-10T23:33:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 -- 172.21.15.17:0/3941004325 shutdown_connections 2024-09-10T23:33:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 --2- 172.21.15.17:0/3941004325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6044162740 0x7f60440b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 --2- 172.21.15.17:0/3941004325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 0x7f6044161af0 unknown :-1 s=CLOSED pgs=2710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 -- 172.21.15.17:0/3941004325 >> 172.21.15.17:0/3941004325 conn(0x7f60440d3f20 msgr2=0x7f60440d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 -- 172.21.15.17:0/3941004325 shutdown_connections 2024-09-10T23:33:19.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 -- 172.21.15.17:0/3941004325 wait complete. 2024-09-10T23:33:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 Processor -- start 2024-09-10T23:33:19.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 -- start start 2024-09-10T23:33:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 0x7f6044150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604415e1b0 0x7f604415bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6044162740 0x7f604415c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f604416b240 con 0x7f604415ddd0 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f604416b0c0 con 0x7f6044162740 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f604aa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f604416b3c0 con 0x7f604415e1b0 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6043e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 0x7f6044150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6043e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 0x7f6044150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33040/0 (socket says 172.21.15.17:33040) 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6043e00640 1 -- 172.21.15.17:0/3691098904 learned_addr learned my addr 172.21.15.17:0/3691098904 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f603be00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604415e1b0 0x7f604415bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6048a00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6044162740 0x7f604415c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6043e00640 1 -- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604415e1b0 msgr2=0x7f604415bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6043e00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604415e1b0 0x7f604415bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6043e00640 1 -- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6044162740 msgr2=0x7f604415c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:19.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6043e00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6044162740 0x7f604415c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6043e00640 1 -- 172.21.15.17:0/3691098904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6044155770 con 0x7f604415ddd0 2024-09-10T23:33:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f603be00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604415e1b0 0x7f604415bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.937+0000 7f6048a00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6044162740 0x7f604415c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f6043e00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 0x7f6044150aa0 secure :-1 s=READY pgs=2711 cs=0 l=1 rev1=1 crypto rx=0x7f6034009790 tx=0x7f6034004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f6040c00640 1 -- 172.21.15.17:0/3691098904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60340b2040 con 0x7f604415ddd0 2024-09-10T23:33:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f6040c00640 1 -- 172.21.15.17:0/3691098904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6034005020 con 0x7f604415ddd0 2024-09-10T23:33:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6044155a50 con 0x7f604415ddd0 2024-09-10T23:33:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f6040c00640 1 -- 172.21.15.17:0/3691098904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034005430 con 0x7f604415ddd0 2024-09-10T23:33:19.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6044151310 con 0x7f604415ddd0 2024-09-10T23:33:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6044156110 con 0x7f604415ddd0 2024-09-10T23:33:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f6040c00640 1 -- 172.21.15.17:0/3691098904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f60340b5070 con 0x7f604415ddd0 2024-09-10T23:33:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f6040c00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60200725e0 0x7f6020074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:19.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f6040c00640 1 -- 172.21.15.17:0/3691098904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f603412ca00 con 0x7f604415ddd0 2024-09-10T23:33:19.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.941+0000 7f603be00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60200725e0 0x7f6020074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:19.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.945+0000 7f603be00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60200725e0 0x7f6020074aa0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f602c007fd0 tx=0x7f602c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:19.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:19.945+0000 7f6040c00640 1 -- 172.21.15.17:0/3691098904 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6044156110 con 0x7f604415ddd0 2024-09-10T23:33:20.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f60440b7290 con 0x7f60200725e0 2024-09-10T23:33:20.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f6040c00640 1 -- 172.21.15.17:0/3691098904 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f60440b7290 con 0x7f60200725e0 2024-09-10T23:33:20.129 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60200725e0 msgr2=0x7f6020074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60200725e0 0x7f6020074aa0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f602c007fd0 tx=0x7f602c009040 comp rx=0 tx=0).stop 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 msgr2=0x7f6044150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 0x7f6044150aa0 secure :-1 s=READY pgs=2711 cs=0 l=1 rev1=1 crypto rx=0x7f6034009790 tx=0x7f6034004040 comp rx=0 tx=0).stop 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 shutdown_connections 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f60200725e0 0x7f6020074aa0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6044162740 0x7f604415c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f604415e1b0 0x7f604415bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 --2- 172.21.15.17:0/3691098904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f604415ddd0 0x7f6044150aa0 unknown :-1 s=CLOSED pgs=2711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 >> 172.21.15.17:0/3691098904 conn(0x7f60440d3f20 msgr2=0x7f60440d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:20.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 shutdown_connections 2024-09-10T23:33:20.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.125+0000 7f604aa00640 1 -- 172.21.15.17:0/3691098904 wait complete. 2024-09-10T23:33:20.151 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T23:33:20.151 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:33:20.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.297+0000 7f54eb200640 1 -- 172.21.15.17:0/926521038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54ec1612c0 msgr2=0x7f54ec0d49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.297+0000 7f54eb200640 1 --2- 172.21.15.17:0/926521038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54ec1612c0 0x7f54ec0d49a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009840 tx=0x7f54dc01f010 comp rx=0 tx=0).stop 2024-09-10T23:33:20.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.297+0000 7f54eb200640 1 -- 172.21.15.17:0/926521038 shutdown_connections 2024-09-10T23:33:20.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.297+0000 7f54eb200640 1 --2- 172.21.15.17:0/926521038 >> v2:172.21.15.77:3300/0 conn(0x7f54ec1616a0 0x7f54ec0b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.297+0000 7f54eb200640 1 --2- 172.21.15.17:0/926521038 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54ec1612c0 0x7f54ec0d49a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.297+0000 7f54eb200640 1 -- 172.21.15.17:0/926521038 >> 172.21.15.17:0/926521038 conn(0x7f54ec09d070 msgr2=0x7f54ec0d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:20.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.297+0000 7f54eb200640 1 -- 172.21.15.17:0/926521038 shutdown_connections 2024-09-10T23:33:20.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.297+0000 7f54eb200640 1 -- 172.21.15.17:0/926521038 wait complete. 2024-09-10T23:33:20.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 Processor -- start 2024-09-10T23:33:20.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 -- start start 2024-09-10T23:33:20.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec0d2100 0x7f54ec1f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54ec1612c0 0x7f54ec159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54ec1616a0 0x7f54ec157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec0b5110 con 0x7f54ec0d2100 2024-09-10T23:33:20.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec0b4f90 con 0x7f54ec1612c0 2024-09-10T23:33:20.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f54ec0b5290 con 0x7f54ec1616a0 2024-09-10T23:33:20.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec0d2100 0x7f54ec1f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec0d2100 0x7f54ec1f7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33046/0 (socket says 172.21.15.17:33046) 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9e00640 1 -- 172.21.15.17:0/4066349146 learned_addr learned my addr 172.21.15.17:0/4066349146 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54ea800640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54ec1616a0 0x7f54ec157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9400640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54ec1612c0 0x7f54ec159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9e00640 1 -- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54ec1616a0 msgr2=0x7f54ec157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9e00640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54ec1616a0 0x7f54ec157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9e00640 1 -- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54ec1612c0 msgr2=0x7f54ec159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9e00640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54ec1612c0 0x7f54ec159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9e00640 1 -- 172.21.15.17:0/4066349146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec148060 con 0x7f54ec0d2100 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9400640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54ec1612c0 0x7f54ec159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54ea800640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54ec1616a0 0x7f54ec157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e9e00640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec0d2100 0x7f54ec1f7830 secure :-1 s=READY pgs=2713 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009790 tx=0x7f54dc004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:20.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e2000640 1 -- 172.21.15.17:0/4066349146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0b5040 con 0x7f54ec0d2100 2024-09-10T23:33:20.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec15a360 con 0x7f54ec0d2100 2024-09-10T23:33:20.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e2000640 1 -- 172.21.15.17:0/4066349146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54dc005020 con 0x7f54ec0d2100 2024-09-10T23:33:20.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54e2000640 1 -- 172.21.15.17:0/4066349146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc005450 con 0x7f54ec0d2100 2024-09-10T23:33:20.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec0b7db0 con 0x7f54ec0d2100 2024-09-10T23:33:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.301+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54ec0d49a0 con 0x7f54ec0d2100 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54e2000640 1 -- 172.21.15.17:0/4066349146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f54dc0b8070 con 0x7f54ec0d2100 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54e2000640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54cc072610 0x7f54cc074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54e2000640 1 -- 172.21.15.17:0/4066349146 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f54dc12fcf0 con 0x7f54ec0d2100 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54e2000640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7f54cc078b50 0x7f54cc07af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54e2000640 1 -- 172.21.15.17:0/4066349146 --> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54dc0acec0 con 0x7f54cc078b50 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54e9400640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54cc072610 0x7f54cc074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54e2000640 1 -- 172.21.15.17:0/4066349146 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=229) ==== 24+0+0 (secure 0 0 0) 0x7f54dc1300a0 con 0x7f54ec0d2100 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54ea800640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7f54cc078b50 0x7f54cc07af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54e9400640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54cc072610 0x7f54cc074ad0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f54ec1f8ff0 tx=0x7f54d80091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54ea800640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7f54cc078b50 0x7f54cc07af90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.305+0000 7f54e2000640 1 -- 172.21.15.17:0/4066349146 <== osd.2 v2:172.21.15.17:6816/2333448301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54dc0acec0 con 0x7f54cc078b50 2024-09-10T23:33:20.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 --> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54ec06c450 con 0x7f54cc078b50 2024-09-10T23:33:20.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54e2000640 1 -- 172.21.15.17:0/4066349146 <== osd.2 v2:172.21.15.17:6816/2333448301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f54ec06c450 con 0x7f54cc078b50 2024-09-10T23:33:20.324 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:20.325 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:33:20.325 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7f54cc078b50 msgr2=0x7f54cc07af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.17:6816/2333448301,v1:172.21.15.17:6817/2333448301] conn(0x7f54cc078b50 0x7f54cc07af90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54cc072610 msgr2=0x7f54cc074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54cc072610 0x7f54cc074ad0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f54ec1f8ff0 tx=0x7f54d80091e0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec0d2100 msgr2=0x7f54ec1f7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 --2- 172.21.15.17:0/4066349146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec0d2100 0x7f54ec1f7830 secure :-1 s=READY pgs=2713 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009790 tx=0x7f54dc004620 comp rx=0 tx=0).stop 2024-09-10T23:33:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54ea800640 1 -- 172.21.15.17:0/4066349146 reap_dead start 2024-09-10T23:33:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 shutdown_connections 2024-09-10T23:33:20.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 >> 172.21.15.17:0/4066349146 conn(0x7f54ec09d070 msgr2=0x7f54ec0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:20.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 shutdown_connections 2024-09-10T23:33:20.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.321+0000 7f54eb200640 1 -- 172.21.15.17:0/4066349146 wait complete. 2024-09-10T23:33:20.343 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T23:33:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.485+0000 7fbcf8c00640 1 -- 172.21.15.17:0/4065107722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf40b0e70 msgr2=0x7fbcf40d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.485+0000 7fbcf8c00640 1 --2- 172.21.15.17:0/4065107722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf40b0e70 0x7fbcf40d0320 secure :-1 s=READY pgs=2715 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40c5870 tx=0x7fbcdc01c740 comp rx=0 tx=0).stop 2024-09-10T23:33:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.485+0000 7fbcf8c00640 1 -- 172.21.15.17:0/4065107722 shutdown_connections 2024-09-10T23:33:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.485+0000 7fbcf8c00640 1 --2- 172.21.15.17:0/4065107722 >> v2:172.21.15.77:3300/0 conn(0x7fbcf40d2890 0x7fbcf40cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.485+0000 7fbcf8c00640 1 --2- 172.21.15.17:0/4065107722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf40b0e70 0x7fbcf40d0320 unknown :-1 s=CLOSED pgs=2715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.485+0000 7fbcf8c00640 1 -- 172.21.15.17:0/4065107722 >> 172.21.15.17:0/4065107722 conn(0x7fbcf40d1da0 msgr2=0x7fbcf40d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.485+0000 7fbcf8c00640 1 -- 172.21.15.17:0/4065107722 shutdown_connections 2024-09-10T23:33:20.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.485+0000 7fbcf8c00640 1 -- 172.21.15.17:0/4065107722 wait complete. 2024-09-10T23:33:20.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 Processor -- start 2024-09-10T23:33:20.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 -- start start 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40b0e70 0x7fbcf41f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40d2890 0x7fbcf4153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf415f470 0x7fbcf4159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4168b60 con 0x7fbcf415f470 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf40b2370 con 0x7fbcf40b0e70 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf4168ce0 con 0x7fbcf40d2890 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf415f470 0x7fbcf4159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf415f470 0x7fbcf4159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33066/0 (socket says 172.21.15.17:33066) 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf2800640 1 -- 172.21.15.17:0/3710140975 learned_addr learned my addr 172.21.15.17:0/3710140975 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf1e00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40b0e70 0x7fbcf41f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcebe00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40d2890 0x7fbcf4153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf2800640 1 -- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40d2890 msgr2=0x7fbcf4153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf2800640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40d2890 0x7fbcf4153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf2800640 1 -- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40b0e70 msgr2=0x7fbcf41f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf2800640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40b0e70 0x7fbcf41f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf2800640 1 -- 172.21.15.17:0/3710140975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf41573c0 con 0x7fbcf415f470 2024-09-10T23:33:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf2800640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf415f470 0x7fbcf4159e00 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00ea20 tx=0x7fbcec00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcea000640 1 -- 172.21.15.17:0/3710140975 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00cde0 con 0x7fbcf415f470 2024-09-10T23:33:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcea000640 1 -- 172.21.15.17:0/3710140975 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcec004c40 con 0x7fbcf415f470 2024-09-10T23:33:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf41576a0 con 0x7fbcf415f470 2024-09-10T23:33:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcea000640 1 -- 172.21.15.17:0/3710140975 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec005280 con 0x7fbcf415f470 2024-09-10T23:33:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.489+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf41f54c0 con 0x7fbcf415f470 2024-09-10T23:33:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.493+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf40cdfd0 con 0x7fbcf415f470 2024-09-10T23:33:20.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.493+0000 7fbcea000640 1 -- 172.21.15.17:0/3710140975 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fbcec00f040 con 0x7fbcf415f470 2024-09-10T23:33:20.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.493+0000 7fbcea000640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcd00725e0 0x7fbcd0074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.493+0000 7fbcea000640 1 -- 172.21.15.17:0/3710140975 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7fbcec093800 con 0x7fbcf415f470 2024-09-10T23:33:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.493+0000 7fbcf1e00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcd00725e0 0x7fbcd0074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.493+0000 7fbcf1e00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcd00725e0 0x7fbcd0074aa0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fbce4007fd0 tx=0x7fbce4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:20.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.497+0000 7fbcea000640 1 -- 172.21.15.17:0/3710140975 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fbcec016030 con 0x7fbcf415f470 2024-09-10T23:33:20.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.669+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fbcf4156640 con 0x7fbcd00725e0 2024-09-10T23:33:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcea000640 1 -- 172.21.15.17:0/3710140975 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbcf4156640 con 0x7fbcd00725e0 2024-09-10T23:33:20.676 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T23:33:20.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcd00725e0 msgr2=0x7fbcd0074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcd00725e0 0x7fbcd0074aa0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fbce4007fd0 tx=0x7fbce4009040 comp rx=0 tx=0).stop 2024-09-10T23:33:20.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf415f470 msgr2=0x7fbcf4159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf415f470 0x7fbcf4159e00 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00ea20 tx=0x7fbcec00eee0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 shutdown_connections 2024-09-10T23:33:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fbcd00725e0 0x7fbcd0074aa0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbcf415f470 0x7fbcf4159e00 unknown :-1 s=CLOSED pgs=2716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf40d2890 0x7fbcf4153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 --2- 172.21.15.17:0/3710140975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf40b0e70 0x7fbcf41f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 >> 172.21.15.17:0/3710140975 conn(0x7fbcf40d1da0 msgr2=0x7fbcf415bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 shutdown_connections 2024-09-10T23:33:20.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.673+0000 7fbcf8c00640 1 -- 172.21.15.17:0/3710140975 wait complete. 2024-09-10T23:33:20.697 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T23:33:20.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:33:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.841+0000 7f4658600640 1 -- 172.21.15.17:0/3163001162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f465015f430 msgr2=0x7f46500cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.841+0000 7f4658600640 1 --2- 172.21.15.17:0/3163001162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f465015f430 0x7f46500cfb20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4644009870 tx=0x7f464401c860 comp rx=0 tx=0).stop 2024-09-10T23:33:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.841+0000 7f4658600640 1 -- 172.21.15.17:0/3163001162 shutdown_connections 2024-09-10T23:33:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.841+0000 7f4658600640 1 --2- 172.21.15.17:0/3163001162 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f465015f430 0x7f46500cfb20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.841+0000 7f4658600640 1 -- 172.21.15.17:0/3163001162 >> 172.21.15.17:0/3163001162 conn(0x7f46500d1d40 msgr2=0x7f46500d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 -- 172.21.15.17:0/3163001162 shutdown_connections 2024-09-10T23:33:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 -- 172.21.15.17:0/3163001162 wait complete. 2024-09-10T23:33:20.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 Processor -- start 2024-09-10T23:33:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 -- start start 2024-09-10T23:33:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46500aedc0 0x7f4650150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46500cdfe0 0x7f46500b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f465015f430 0x7f46500b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f465016a0a0 con 0x7f46500cdfe0 2024-09-10T23:33:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4650169f20 con 0x7f46500aedc0 2024-09-10T23:33:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4658600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f465016a220 con 0x7f465015f430 2024-09-10T23:33:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46500cdfe0 0x7f46500b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46500cdfe0 0x7f46500b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33078/0 (socket says 172.21.15.17:33078) 2024-09-10T23:33:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655200640 1 -- 172.21.15.17:0/1679750241 learned_addr learned my addr 172.21.15.17:0/1679750241 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655c00640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46500aedc0 0x7f4650150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4656600640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f465015f430 0x7f46500b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655200640 1 -- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f465015f430 msgr2=0x7f46500b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655200640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f465015f430 0x7f46500b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655200640 1 -- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46500aedc0 msgr2=0x7f4650150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655200640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46500aedc0 0x7f4650150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655200640 1 -- 172.21.15.17:0/1679750241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46500d1b70 con 0x7f46500cdfe0 2024-09-10T23:33:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f4655200640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46500cdfe0 0x7f46500b3bb0 secure :-1 s=READY pgs=2718 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c460 tx=0x7f463c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f464d600640 1 -- 172.21.15.17:0/1679750241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c016020 con 0x7f46500cdfe0 2024-09-10T23:33:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.845+0000 7f464d600640 1 -- 172.21.15.17:0/1679750241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f463c012a00 con 0x7f46500cdfe0 2024-09-10T23:33:20.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465015efa0 con 0x7f46500cdfe0 2024-09-10T23:33:20.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f464d600640 1 -- 172.21.15.17:0/1679750241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c011380 con 0x7f46500cdfe0 2024-09-10T23:33:20.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46500ccd20 con 0x7f46500cdfe0 2024-09-10T23:33:20.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46500af270 con 0x7f46500cdfe0 2024-09-10T23:33:20.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f464d600640 1 -- 172.21.15.17:0/1679750241 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f463c011520 con 0x7f46500cdfe0 2024-09-10T23:33:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f464d600640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46300725e0 0x7f4630074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f464d600640 1 -- 172.21.15.17:0/1679750241 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f463c093680 con 0x7f46500cdfe0 2024-09-10T23:33:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f464d600640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7f4630078b20 0x7f463007af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f464d600640 1 -- 172.21.15.17:0/1679750241 --> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f463c026e50 con 0x7f4630078b20 2024-09-10T23:33:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f464d600640 1 -- 172.21.15.17:0/1679750241 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=229) ==== 24+0+0 (secure 0 0 0) 0x7f463c093a30 con 0x7f46500cdfe0 2024-09-10T23:33:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f4655c00640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46300725e0 0x7f4630074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.849+0000 7f4656600640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7f4630078b20 0x7f463007af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.853+0000 7f4655c00640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46300725e0 0x7f4630074aa0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f46440af000 tx=0x7f46440b2040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.853+0000 7f4656600640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7f4630078b20 0x7f463007af60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:20.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.853+0000 7f464d600640 1 -- 172.21.15.17:0/1679750241 <== osd.3 v2:172.21.15.17:6800/1907203974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f463c026e50 con 0x7f4630078b20 2024-09-10T23:33:20.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 --> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f46500cc250 con 0x7f4630078b20 2024-09-10T23:33:20.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f464d600640 1 -- 172.21.15.17:0/1679750241 <== osd.3 v2:172.21.15.17:6800/1907203974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f46500cc250 con 0x7f4630078b20 2024-09-10T23:33:20.870 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:20.870 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:33:20.870 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:20.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7f4630078b20 msgr2=0x7f463007af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.17:6800/1907203974,v1:172.21.15.17:6801/1907203974] conn(0x7f4630078b20 0x7f463007af60 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:20.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46300725e0 msgr2=0x7f4630074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f46300725e0 0x7f4630074aa0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f46440af000 tx=0x7f46440b2040 comp rx=0 tx=0).stop 2024-09-10T23:33:20.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46500cdfe0 msgr2=0x7f46500b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:20.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 --2- 172.21.15.17:0/1679750241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46500cdfe0 0x7f46500b3bb0 secure :-1 s=READY pgs=2718 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c460 tx=0x7f463c00c920 comp rx=0 tx=0).stop 2024-09-10T23:33:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4656600640 1 -- 172.21.15.17:0/1679750241 reap_dead start 2024-09-10T23:33:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 shutdown_connections 2024-09-10T23:33:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 >> 172.21.15.17:0/1679750241 conn(0x7f46500d1d40 msgr2=0x7f465006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 shutdown_connections 2024-09-10T23:33:20.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:20.865+0000 7f4658600640 1 -- 172.21.15.17:0/1679750241 wait complete. 2024-09-10T23:33:20.888 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T23:33:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 -- 172.21.15.17:0/2487344408 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f8815e870 msgr2=0x7f6f8806fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 --2- 172.21.15.17:0/2487344408 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f8815e870 0x7f6f8806fc50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009840 tx=0x7f6f7001c820 comp rx=0 tx=0).stop 2024-09-10T23:33:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 -- 172.21.15.17:0/2487344408 shutdown_connections 2024-09-10T23:33:21.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 --2- 172.21.15.17:0/2487344408 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f8815e870 0x7f6f8806fc50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 --2- 172.21.15.17:0/2487344408 >> v2:172.21.15.77:3300/0 conn(0x7f6f880745e0 0x7f6f8815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 -- 172.21.15.17:0/2487344408 >> 172.21.15.17:0/2487344408 conn(0x7f6f880b1850 msgr2=0x7f6f880b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 -- 172.21.15.17:0/2487344408 shutdown_connections 2024-09-10T23:33:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 -- 172.21.15.17:0/2487344408 wait complete. 2024-09-10T23:33:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 Processor -- start 2024-09-10T23:33:21.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.033+0000 7f6f8d000640 1 -- start start 2024-09-10T23:33:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f8d000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f880745e0 0x7f6f8813a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f8d000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f880cfb00 0x7f6f881f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f8d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8815e870 0x7f6f88156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f8d000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8806f030 con 0x7f6f8815e870 2024-09-10T23:33:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f8d000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f880d01b0 con 0x7f6f880745e0 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f8d000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8806f1b0 con 0x7f6f880cfb00 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f86800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8815e870 0x7f6f88156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f86800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8815e870 0x7f6f88156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33094/0 (socket says 172.21.15.17:33094) 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f86800640 1 -- 172.21.15.17:0/3320362087 learned_addr learned my addr 172.21.15.17:0/3320362087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f7fe00640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f880cfb00 0x7f6f881f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f85e00640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f880745e0 0x7f6f8813a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f86800640 1 -- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f880cfb00 msgr2=0x7f6f881f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f86800640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f880cfb00 0x7f6f881f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f86800640 1 -- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f880745e0 msgr2=0x7f6f8813a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f86800640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f880745e0 0x7f6f8813a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f86800640 1 -- 172.21.15.17:0/3320362087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f880b5120 con 0x7f6f8815e870 2024-09-10T23:33:21.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f86800640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8815e870 0x7f6f88156070 secure :-1 s=READY pgs=2720 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000cbc0 tx=0x7f6f8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f7e000640 1 -- 172.21.15.17:0/3320362087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80016020 con 0x7f6f8815e870 2024-09-10T23:33:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f88154fd0 con 0x7f6f8815e870 2024-09-10T23:33:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f7e000640 1 -- 172.21.15.17:0/3320362087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f8000ab00 con 0x7f6f8815e870 2024-09-10T23:33:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f7e000640 1 -- 172.21.15.17:0/3320362087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80012420 con 0x7f6f8815e870 2024-09-10T23:33:21.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f88155590 con 0x7f6f8815e870 2024-09-10T23:33:21.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.037+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f88075ad0 con 0x7f6f8815e870 2024-09-10T23:33:21.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.041+0000 7f6f7e000640 1 -- 172.21.15.17:0/3320362087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f6f80004a50 con 0x7f6f8815e870 2024-09-10T23:33:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.041+0000 7f6f7e000640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f640725e0 0x7f6f64074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.041+0000 7f6f7e000640 1 -- 172.21.15.17:0/3320362087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f6f80093d60 con 0x7f6f8815e870 2024-09-10T23:33:21.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.041+0000 7f6f85e00640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f640725e0 0x7f6f64074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.041+0000 7f6f85e00640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f640725e0 0x7f6f64074aa0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f6f8815a8b0 tx=0x7f6f780091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.045+0000 7f6f7e000640 1 -- 172.21.15.17:0/3320362087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f6f80020020 con 0x7f6f8815e870 2024-09-10T23:33:21.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.221+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6f8815b2f0 con 0x7f6f640725e0 2024-09-10T23:33:21.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.221+0000 7f6f7e000640 1 -- 172.21.15.17:0/3320362087 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6f8815b2f0 con 0x7f6f640725e0 2024-09-10T23:33:21.226 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T23:33:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f640725e0 msgr2=0x7f6f64074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f640725e0 0x7f6f64074aa0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f6f8815a8b0 tx=0x7f6f780091e0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8815e870 msgr2=0x7f6f88156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8815e870 0x7f6f88156070 secure :-1 s=READY pgs=2720 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000cbc0 tx=0x7f6f8000ccb0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 shutdown_connections 2024-09-10T23:33:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f6f640725e0 0x7f6f64074aa0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f8815e870 0x7f6f88156070 unknown :-1 s=CLOSED pgs=2720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6f880cfb00 0x7f6f881f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 --2- 172.21.15.17:0/3320362087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f880745e0 0x7f6f8813a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 >> 172.21.15.17:0/3320362087 conn(0x7f6f880b1850 msgr2=0x7f6f880b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 shutdown_connections 2024-09-10T23:33:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.225+0000 7f6f8d000640 1 -- 172.21.15.17:0/3320362087 wait complete. 2024-09-10T23:33:21.249 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T23:33:21.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:33:21.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.397+0000 7f54d1600640 1 -- 172.21.15.17:0/2320060354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54b0004810 msgr2=0x7f54b0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.397+0000 7f54d1600640 1 --2- 172.21.15.17:0/2320060354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54b0004810 0x7f54b0004c90 secure :-1 s=READY pgs=2722 cs=0 l=1 rev1=1 crypto rx=0x7f54b40016c0 tx=0x7f54b401c730 comp rx=0 tx=0).stop 2024-09-10T23:33:21.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.397+0000 7f54d1600640 1 -- 172.21.15.17:0/2320060354 shutdown_connections 2024-09-10T23:33:21.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.397+0000 7f54d1600640 1 --2- 172.21.15.17:0/2320060354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54b0004810 0x7f54b0004c90 unknown :-1 s=CLOSED pgs=2722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.397+0000 7f54d1600640 1 -- 172.21.15.17:0/2320060354 >> 172.21.15.17:0/2320060354 conn(0x7f54cc0d1d40 msgr2=0x7f54cc0d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.397+0000 7f54d1600640 1 -- 172.21.15.17:0/2320060354 shutdown_connections 2024-09-10T23:33:21.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.397+0000 7f54d1600640 1 -- 172.21.15.17:0/2320060354 wait complete. 2024-09-10T23:33:21.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.397+0000 7f54d1600640 1 Processor -- start 2024-09-10T23:33:21.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.397+0000 7f54d1600640 1 -- start start 2024-09-10T23:33:21.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54d1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54b0004810 0x7f54cc0c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54d1600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54cc1f65f0 0x7f54cc1f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54d1600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54cc0cec60 0x7f54cc0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54d1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0cffc0 con 0x7f54b0004810 2024-09-10T23:33:21.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54d1600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0cfe40 con 0x7f54cc1f65f0 2024-09-10T23:33:21.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54d1600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc0d0140 con 0x7f54cc0cec60 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54caa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54b0004810 0x7f54cc0c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54caa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54b0004810 0x7f54cc0c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33100/0 (socket says 172.21.15.17:33100) 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54caa00640 1 -- 172.21.15.17:0/2114056579 learned_addr learned my addr 172.21.15.17:0/2114056579 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54cb400640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54cc0cec60 0x7f54cc0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54c2000640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54cc1f65f0 0x7f54cc1f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54caa00640 1 -- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54cc0cec60 msgr2=0x7f54cc0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54caa00640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f54cc0cec60 0x7f54cc0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54caa00640 1 -- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54cc1f65f0 msgr2=0x7f54cc1f6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54caa00640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54cc1f65f0 0x7f54cc1f6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54caa00640 1 -- 172.21.15.17:0/2114056579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc1f38b0 con 0x7f54b0004810 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54caa00640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54b0004810 0x7f54cc0c7cd0 secure :-1 s=READY pgs=2723 cs=0 l=1 rev1=1 crypto rx=0x7f54bc011a40 tx=0x7f54bc011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54c3400640 1 -- 172.21.15.17:0/2114056579 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc01e070 con 0x7f54b0004810 2024-09-10T23:33:21.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54c3400640 1 -- 172.21.15.17:0/2114056579 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54bc00fe70 con 0x7f54b0004810 2024-09-10T23:33:21.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54c3400640 1 -- 172.21.15.17:0/2114056579 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0042b0 con 0x7f54b0004810 2024-09-10T23:33:21.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc0c8590 con 0x7f54b0004810 2024-09-10T23:33:21.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc1f2dd0 con 0x7f54b0004810 2024-09-10T23:33:21.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54cc155cf0 con 0x7f54b0004810 2024-09-10T23:33:21.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.401+0000 7f54c3400640 1 -- 172.21.15.17:0/2114056579 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f54bc003600 con 0x7f54b0004810 2024-09-10T23:33:21.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54c3400640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54a8072610 0x7f54a8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54c3400640 1 -- 172.21.15.17:0/2114056579 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f54bc0949c0 con 0x7f54b0004810 2024-09-10T23:33:21.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54c3400640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f54a8078b50 0x7f54a807af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54c3400640 1 -- 172.21.15.17:0/2114056579 --> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54bc018ec0 con 0x7f54a8078b50 2024-09-10T23:33:21.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54c3400640 1 -- 172.21.15.17:0/2114056579 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=229) ==== 24+0+0 (secure 0 0 0) 0x7f54bc094d70 con 0x7f54b0004810 2024-09-10T23:33:21.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54c2000640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54a8072610 0x7f54a8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54cb400640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f54a8078b50 0x7f54a807af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54cb400640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f54a8078b50 0x7f54a807af90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54c2000640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54a8072610 0x7f54a8074ad0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f54b0004790 tx=0x7f54b4019520 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.405+0000 7f54c3400640 1 -- 172.21.15.17:0/2114056579 <== osd.4 v2:172.21.15.77:6802/328051167 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54bc018ec0 con 0x7f54a8078b50 2024-09-10T23:33:21.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 --> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54cc0d0630 con 0x7f54a8078b50 2024-09-10T23:33:21.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54c3400640 1 -- 172.21.15.17:0/2114056579 <== osd.4 v2:172.21.15.77:6802/328051167 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f54cc0d0630 con 0x7f54a8078b50 2024-09-10T23:33:21.424 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:21.425 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:33:21.425 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f54a8078b50 msgr2=0x7f54a807af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6802/328051167,v1:172.21.15.77:6803/328051167] conn(0x7f54a8078b50 0x7f54a807af90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54a8072610 msgr2=0x7f54a8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f54a8072610 0x7f54a8074ad0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f54b0004790 tx=0x7f54b4019520 comp rx=0 tx=0).stop 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54b0004810 msgr2=0x7f54cc0c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 --2- 172.21.15.17:0/2114056579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54b0004810 0x7f54cc0c7cd0 secure :-1 s=READY pgs=2723 cs=0 l=1 rev1=1 crypto rx=0x7f54bc011a40 tx=0x7f54bc011f00 comp rx=0 tx=0).stop 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54cb400640 1 -- 172.21.15.17:0/2114056579 reap_dead start 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 shutdown_connections 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 >> 172.21.15.17:0/2114056579 conn(0x7f54cc0d1d40 msgr2=0x7f54cc15ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 shutdown_connections 2024-09-10T23:33:21.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.421+0000 7f54d1600640 1 -- 172.21.15.17:0/2114056579 wait complete. 2024-09-10T23:33:21.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T23:33:21.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 -- 172.21.15.17:0/1536607735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f81600d0 msgr2=0x7fe7f8166970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 --2- 172.21.15.17:0/1536607735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f81600d0 0x7fe7f8166970 secure :-1 s=READY pgs=2725 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009c80 tx=0x7fe7f001cda0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 -- 172.21.15.17:0/1536607735 shutdown_connections 2024-09-10T23:33:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 --2- 172.21.15.17:0/1536607735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f81600d0 0x7fe7f8166970 unknown :-1 s=CLOSED pgs=2725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 -- 172.21.15.17:0/1536607735 >> 172.21.15.17:0/1536607735 conn(0x7fe7f80b1850 msgr2=0x7fe7f80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 -- 172.21.15.17:0/1536607735 shutdown_connections 2024-09-10T23:33:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 -- 172.21.15.17:0/1536607735 wait complete. 2024-09-10T23:33:21.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 Processor -- start 2024-09-10T23:33:21.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 -- start start 2024-09-10T23:33:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f80d0180 0x7fe7f8155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7f8145570 0x7fe7f815e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7f81600d0 0x7fe7f8142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f8169ee0 con 0x7fe7f80d0180 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f8169d60 con 0x7fe7f8145570 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7ffe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f816a060 con 0x7fe7f81600d0 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f80d0180 0x7fe7f8155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f80d0180 0x7fe7f8155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33128/0 (socket says 172.21.15.17:33128) 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fd400640 1 -- 172.21.15.17:0/388360812 learned_addr learned my addr 172.21.15.17:0/388360812 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fde00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7f81600d0 0x7fe7f8142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fca00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7f8145570 0x7fe7f815e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fd400640 1 -- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7f81600d0 msgr2=0x7fe7f8142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fd400640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7f81600d0 0x7fe7f8142a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fd400640 1 -- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7f8145570 msgr2=0x7fe7f815e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fd400640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7f8145570 0x7fe7f815e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fd400640 1 -- 172.21.15.17:0/388360812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f8143fb0 con 0x7fe7f80d0180 2024-09-10T23:33:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fde00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7f81600d0 0x7fe7f8142a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fca00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7f8145570 0x7fe7f815e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.589+0000 7fe7fd400640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f80d0180 0x7fe7f8155e30 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c490 tx=0x7fe7ec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.593+0000 7fe7f5600640 1 -- 172.21.15.17:0/388360812 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0052d0 con 0x7fe7f80d0180 2024-09-10T23:33:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.593+0000 7fe7f5600640 1 -- 172.21.15.17:0/388360812 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7ec005470 con 0x7fe7f80d0180 2024-09-10T23:33:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.593+0000 7fe7f5600640 1 -- 172.21.15.17:0/388360812 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec012890 con 0x7fe7f80d0180 2024-09-10T23:33:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.593+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f815ebb0 con 0x7fe7f80d0180 2024-09-10T23:33:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.593+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f8141fb0 con 0x7fe7f80d0180 2024-09-10T23:33:21.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.593+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f80008e0 con 0x7fe7f80d0180 2024-09-10T23:33:21.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.593+0000 7fe7f5600640 1 -- 172.21.15.17:0/388360812 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fe7ec003600 con 0x7fe7f80d0180 2024-09-10T23:33:21.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.593+0000 7fe7f5600640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe7d8072610 0x7fe7d8074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.593+0000 7fe7f5600640 1 -- 172.21.15.17:0/388360812 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7fe7ec092ca0 con 0x7fe7f80d0180 2024-09-10T23:33:21.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.597+0000 7fe7fca00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe7d8072610 0x7fe7d8074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.597+0000 7fe7fca00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe7d8072610 0x7fe7d8074ad0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe7f81f8710 tx=0x7fe7e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.597+0000 7fe7f5600640 1 -- 172.21.15.17:0/388360812 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7fe7ec05e4a0 con 0x7fe7f80d0180 2024-09-10T23:33:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.773+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fe7f81421b0 con 0x7fe7d8072610 2024-09-10T23:33:21.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.773+0000 7fe7f5600640 1 -- 172.21.15.17:0/388360812 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe7f81421b0 con 0x7fe7d8072610 2024-09-10T23:33:21.778 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T23:33:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe7d8072610 msgr2=0x7fe7d8074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe7d8072610 0x7fe7d8074ad0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe7f81f8710 tx=0x7fe7e4009040 comp rx=0 tx=0).stop 2024-09-10T23:33:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f80d0180 msgr2=0x7fe7f8155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f80d0180 0x7fe7f8155e30 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c490 tx=0x7fe7ec00c950 comp rx=0 tx=0).stop 2024-09-10T23:33:21.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 shutdown_connections 2024-09-10T23:33:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fe7d8072610 0x7fe7d8074ad0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7f81600d0 0x7fe7f8142a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7f8145570 0x7fe7f815e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 --2- 172.21.15.17:0/388360812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7f80d0180 0x7fe7f8155e30 unknown :-1 s=CLOSED pgs=2726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 >> 172.21.15.17:0/388360812 conn(0x7fe7f80b1850 msgr2=0x7fe7f8072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 shutdown_connections 2024-09-10T23:33:21.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.777+0000 7fe7ffe00640 1 -- 172.21.15.17:0/388360812 wait complete. 2024-09-10T23:33:21.799 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T23:33:21.799 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:33:21.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.945+0000 7f0670600640 1 -- 172.21.15.17:0/3830119644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f066815bbc0 msgr2=0x7f0668073e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.945+0000 7f0670600640 1 --2- 172.21.15.17:0/3830119644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f066815bbc0 0x7f0668073e90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f065c009870 tx=0x7f065c01c740 comp rx=0 tx=0).stop 2024-09-10T23:33:21.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.945+0000 7f0670600640 1 -- 172.21.15.17:0/3830119644 shutdown_connections 2024-09-10T23:33:21.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.945+0000 7f0670600640 1 --2- 172.21.15.17:0/3830119644 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f066815bbc0 0x7f0668073e90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.945+0000 7f0670600640 1 -- 172.21.15.17:0/3830119644 >> 172.21.15.17:0/3830119644 conn(0x7f06680cc590 msgr2=0x7f06680cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.945+0000 7f0670600640 1 -- 172.21.15.17:0/3830119644 shutdown_connections 2024-09-10T23:33:21.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.945+0000 7f0670600640 1 -- 172.21.15.17:0/3830119644 wait complete. 2024-09-10T23:33:21.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0670600640 1 Processor -- start 2024-09-10T23:33:21.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0670600640 1 -- start start 2024-09-10T23:33:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0670600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06680cb4e0 0x7f0668145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0670600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f066815bbc0 0x7f0668158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0670600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066815aa50 0x7f0668158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0670600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f066816a9f0 con 0x7f06680cb4e0 2024-09-10T23:33:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0670600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f066816a870 con 0x7f066815aa50 2024-09-10T23:33:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0670600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f066816ab70 con 0x7f066815bbc0 2024-09-10T23:33:21.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06680cb4e0 0x7f0668145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06680cb4e0 0x7f0668145130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33134/0 (socket says 172.21.15.17:33134) 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066dc00640 1 -- 172.21.15.17:0/726896206 learned_addr learned my addr 172.21.15.17:0/726896206 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066d200640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f066815bbc0 0x7f0668158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066dc00640 1 -- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f066815bbc0 msgr2=0x7f0668158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066dc00640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f066815bbc0 0x7f0668158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066e600640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066815aa50 0x7f0668158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066dc00640 1 -- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066815aa50 msgr2=0x7f0668158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066dc00640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066815aa50 0x7f0668158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066dc00640 1 -- 172.21.15.17:0/726896206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0668151c60 con 0x7f06680cb4e0 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066d200640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f066815bbc0 0x7f0668158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066e600640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f066815aa50 0x7f0668158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:21.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f066dc00640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06680cb4e0 0x7f0668145130 secure :-1 s=READY pgs=2728 cs=0 l=1 rev1=1 crypto rx=0x7f065c098120 tx=0x7f065c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0665600640 1 -- 172.21.15.17:0/726896206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c0be070 con 0x7f06680cb4e0 2024-09-10T23:33:21.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0665600640 1 -- 172.21.15.17:0/726896206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f065c005040 con 0x7f06680cb4e0 2024-09-10T23:33:21.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0668150ea0 con 0x7f06680cb4e0 2024-09-10T23:33:21.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.949+0000 7f0665600640 1 -- 172.21.15.17:0/726896206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c005450 con 0x7f06680cb4e0 2024-09-10T23:33:21.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0668151460 con 0x7f06680cb4e0 2024-09-10T23:33:21.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0668073e90 con 0x7f06680cb4e0 2024-09-10T23:33:21.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f0665600640 1 -- 172.21.15.17:0/726896206 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f065c0a6650 con 0x7f06680cb4e0 2024-09-10T23:33:21.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f0665600640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06480725e0 0x7f0648074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f0665600640 1 -- 172.21.15.17:0/726896206 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f065c12cc40 con 0x7f06680cb4e0 2024-09-10T23:33:21.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f0665600640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7f0648078b20 0x7f064807af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:21.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f0665600640 1 -- 172.21.15.17:0/726896206 --> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f065c0b1ea0 con 0x7f0648078b20 2024-09-10T23:33:21.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f0665600640 1 -- 172.21.15.17:0/726896206 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=229) ==== 24+0+0 (secure 0 0 0) 0x7f065c1312a0 con 0x7f06680cb4e0 2024-09-10T23:33:21.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f066d200640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06480725e0 0x7f0648074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.953+0000 7f066e600640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7f0648078b20 0x7f064807af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:21.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.957+0000 7f066d200640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06480725e0 0x7f0648074aa0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f06680b2c90 tx=0x7f0654009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.957+0000 7f066e600640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7f0648078b20 0x7f064807af60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:21.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.957+0000 7f0665600640 1 -- 172.21.15.17:0/726896206 <== osd.5 v2:172.21.15.77:6826/209138323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f065c0b1ea0 con 0x7f0648078b20 2024-09-10T23:33:21.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 --> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f06680cd380 con 0x7f0648078b20 2024-09-10T23:33:21.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0665600640 1 -- 172.21.15.17:0/726896206 <== osd.5 v2:172.21.15.77:6826/209138323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f06680cd380 con 0x7f0648078b20 2024-09-10T23:33:21.975 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:21.975 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:33:21.975 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7f0648078b20 msgr2=0x7f064807af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0670600640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6826/209138323,v1:172.21.15.77:6827/209138323] conn(0x7f0648078b20 0x7f064807af60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06480725e0 msgr2=0x7f0648074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0670600640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f06480725e0 0x7f0648074aa0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f06680b2c90 tx=0x7f0654009040 comp rx=0 tx=0).stop 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06680cb4e0 msgr2=0x7f0668145130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0670600640 1 --2- 172.21.15.17:0/726896206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06680cb4e0 0x7f0668145130 secure :-1 s=READY pgs=2728 cs=0 l=1 rev1=1 crypto rx=0x7f065c098120 tx=0x7f065c004610 comp rx=0 tx=0).stop 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f066e600640 1 -- 172.21.15.17:0/726896206 reap_dead start 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 shutdown_connections 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.969+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 >> 172.21.15.17:0/726896206 conn(0x7f06680cc590 msgr2=0x7f066806e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.973+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 shutdown_connections 2024-09-10T23:33:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:21.973+0000 7f0670600640 1 -- 172.21.15.17:0/726896206 wait complete. 2024-09-10T23:33:21.993 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T23:33:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.137+0000 7ff791600640 1 -- 172.21.15.17:0/1869287858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7700053a0 msgr2=0x7ff77000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.137+0000 7ff791600640 1 --2- 172.21.15.17:0/1869287858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7700053a0 0x7ff77000b9d0 secure :-1 s=READY pgs=2730 cs=0 l=1 rev1=1 crypto rx=0x7ff784001f50 tx=0x7ff78401cc40 comp rx=0 tx=0).stop 2024-09-10T23:33:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.137+0000 7ff791600640 1 -- 172.21.15.17:0/1869287858 shutdown_connections 2024-09-10T23:33:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.137+0000 7ff791600640 1 --2- 172.21.15.17:0/1869287858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7700053a0 0x7ff77000b9d0 unknown :-1 s=CLOSED pgs=2730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.137+0000 7ff791600640 1 -- 172.21.15.17:0/1869287858 >> 172.21.15.17:0/1869287858 conn(0x7ff78c0d0c10 msgr2=0x7ff78c0d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.137+0000 7ff791600640 1 -- 172.21.15.17:0/1869287858 shutdown_connections 2024-09-10T23:33:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.137+0000 7ff791600640 1 -- 172.21.15.17:0/1869287858 wait complete. 2024-09-10T23:33:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 Processor -- start 2024-09-10T23:33:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 -- start start 2024-09-10T23:33:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7700053a0 0x7ff78c1fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff78c1562a0 0x7ff78c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff78c1f93c0 0x7ff78c070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c1603e0 con 0x7ff78c1562a0 2024-09-10T23:33:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c160260 con 0x7ff7700053a0 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c160560 con 0x7ff78c1f93c0 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff783e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff78c1562a0 0x7ff78c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff783e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff78c1562a0 0x7ff78c155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33156/0 (socket says 172.21.15.17:33156) 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff783e00640 1 -- 172.21.15.17:0/1997409482 learned_addr learned my addr 172.21.15.17:0/1997409482 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff78b400640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff78c1f93c0 0x7ff78c070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff783e00640 1 -- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff78c1f93c0 msgr2=0x7ff78c070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff783e00640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff78c1f93c0 0x7ff78c070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff783e00640 1 -- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7700053a0 msgr2=0x7ff78c1fb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff78aa00640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7700053a0 0x7ff78c1fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff783e00640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7700053a0 0x7ff78c1fb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff783e00640 1 -- 172.21.15.17:0/1997409482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c1fc340 con 0x7ff78c1562a0 2024-09-10T23:33:22.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff78b400640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff78c1f93c0 0x7ff78c070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff78aa00640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7700053a0 0x7ff78c1fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T23:33:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff783e00640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff78c1562a0 0x7ff78c155c60 secure :-1 s=READY pgs=2731 cs=0 l=1 rev1=1 crypto rx=0x7ff774006430 tx=0x7ff7740039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff782a00640 1 -- 172.21.15.17:0/1997409482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774015070 con 0x7ff78c1562a0 2024-09-10T23:33:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff782a00640 1 -- 172.21.15.17:0/1997409482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff774011860 con 0x7ff78c1562a0 2024-09-10T23:33:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78c1fbaa0 con 0x7ff78c1562a0 2024-09-10T23:33:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff782a00640 1 -- 172.21.15.17:0/1997409482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774011cb0 con 0x7ff78c1562a0 2024-09-10T23:33:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.141+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78c1fc060 con 0x7ff78c1562a0 2024-09-10T23:33:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.145+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff78c15cc80 con 0x7ff78c1562a0 2024-09-10T23:33:22.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.145+0000 7ff782a00640 1 -- 172.21.15.17:0/1997409482 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7ff7740103c0 con 0x7ff78c1562a0 2024-09-10T23:33:22.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.145+0000 7ff782a00640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff768072610 0x7ff768074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.145+0000 7ff782a00640 1 -- 172.21.15.17:0/1997409482 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7ff774094080 con 0x7ff78c1562a0 2024-09-10T23:33:22.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.145+0000 7ff78aa00640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff768072610 0x7ff768074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.145+0000 7ff78aa00640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff768072610 0x7ff768074ad0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009b20 tx=0x7ff77c0091e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.149+0000 7ff782a00640 1 -- 172.21.15.17:0/1997409482 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7ff77405f870 con 0x7ff78c1562a0 2024-09-10T23:33:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.325+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff78c0b1540 con 0x7ff768072610 2024-09-10T23:33:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.325+0000 7ff782a00640 1 -- 172.21.15.17:0/1997409482 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff78c0b1540 con 0x7ff768072610 2024-09-10T23:33:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff768072610 msgr2=0x7ff768074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff768072610 0x7ff768074ad0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009b20 tx=0x7ff77c0091e0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff78c1562a0 msgr2=0x7ff78c155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff78c1562a0 0x7ff78c155c60 secure :-1 s=READY pgs=2731 cs=0 l=1 rev1=1 crypto rx=0x7ff774006430 tx=0x7ff7740039d0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 shutdown_connections 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7ff768072610 0x7ff768074ad0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff78c1f93c0 0x7ff78c070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff78c1562a0 0x7ff78c155c60 unknown :-1 s=CLOSED pgs=2731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 --2- 172.21.15.17:0/1997409482 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7700053a0 0x7ff78c1fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 >> 172.21.15.17:0/1997409482 conn(0x7ff78c0d0c10 msgr2=0x7ff78c0cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 shutdown_connections 2024-09-10T23:33:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.329+0000 7ff791600640 1 -- 172.21.15.17:0/1997409482 wait complete. 2024-09-10T23:33:22.351 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T23:33:22.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:33:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.497+0000 7fb57f800640 1 -- 172.21.15.17:0/3588341740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5780cfb70 msgr2=0x7fb5780cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.497+0000 7fb57f800640 1 --2- 172.21.15.17:0/3588341740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5780cfb70 0x7fb5780cff50 secure :-1 s=READY pgs=2733 cs=0 l=1 rev1=1 crypto rx=0x7fb578074410 tx=0x7fb56c01c890 comp rx=0 tx=0).stop 2024-09-10T23:33:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.497+0000 7fb57f800640 1 -- 172.21.15.17:0/3588341740 shutdown_connections 2024-09-10T23:33:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.497+0000 7fb57f800640 1 --2- 172.21.15.17:0/3588341740 >> v2:172.21.15.77:3300/0 conn(0x7fb5780b2fc0 0x7fb5780d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.497+0000 7fb57f800640 1 --2- 172.21.15.17:0/3588341740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5780cfb70 0x7fb5780cff50 unknown :-1 s=CLOSED pgs=2733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.497+0000 7fb57f800640 1 -- 172.21.15.17:0/3588341740 >> 172.21.15.17:0/3588341740 conn(0x7fb5780d1d40 msgr2=0x7fb5780d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.497+0000 7fb57f800640 1 -- 172.21.15.17:0/3588341740 shutdown_connections 2024-09-10T23:33:22.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.497+0000 7fb57f800640 1 -- 172.21.15.17:0/3588341740 wait complete. 2024-09-10T23:33:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 Processor -- start 2024-09-10T23:33:22.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 -- start start 2024-09-10T23:33:22.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5780b15a0 0x7fb5780c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5780b2fc0 0x7fb5780c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5780cfb70 0x7fb57814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780b0ad0 con 0x7fb5780cfb70 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780b0950 con 0x7fb5780b2fc0 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fb578168f60 con 0x7fb5780b15a0 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5780cfb70 0x7fb57814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5780cfb70 0x7fb57814c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33188/0 (socket says 172.21.15.17:33188) 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57d800640 1 -- 172.21.15.17:0/3288489570 learned_addr learned my addr 172.21.15.17:0/3288489570 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb577e00640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5780b2fc0 0x7fb5780c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57ce00640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5780b15a0 0x7fb5780c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57d800640 1 -- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5780b15a0 msgr2=0x7fb5780c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57d800640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5780b15a0 0x7fb5780c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57d800640 1 -- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5780b2fc0 msgr2=0x7fb5780c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57d800640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5780b2fc0 0x7fb5780c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57d800640 1 -- 172.21.15.17:0/3288489570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57814cc00 con 0x7fb5780cfb70 2024-09-10T23:33:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57d800640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5780cfb70 0x7fb57814c6c0 secure :-1 s=READY pgs=2734 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c770 tx=0x7fb57000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb574c00640 1 -- 172.21.15.17:0/3288489570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570017070 con 0x7fb5780cfb70 2024-09-10T23:33:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb574c00640 1 -- 172.21.15.17:0/3288489570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb570005070 con 0x7fb5780cfb70 2024-09-10T23:33:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb574c00640 1 -- 172.21.15.17:0/3288489570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700054c0 con 0x7fb5780cfb70 2024-09-10T23:33:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5780b79e0 con 0x7fb5780cfb70 2024-09-10T23:33:22.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.501+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb578166290 con 0x7fb5780cfb70 2024-09-10T23:33:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5780b4b70 con 0x7fb5780cfb70 2024-09-10T23:33:22.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb574c00640 1 -- 172.21.15.17:0/3288489570 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fb570005660 con 0x7fb5780cfb70 2024-09-10T23:33:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb574c00640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5580725e0 0x7fb558074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb574c00640 1 -- 172.21.15.17:0/3288489570 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7fb570092a10 con 0x7fb5780cfb70 2024-09-10T23:33:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb574c00640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7fb558078b20 0x7fb55807af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb574c00640 1 -- 172.21.15.17:0/3288489570 --> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb55807b630 con 0x7fb558078b20 2024-09-10T23:33:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb574c00640 1 -- 172.21.15.17:0/3288489570 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=229) ==== 24+0+0 (secure 0 0 0) 0x7fb5700972a0 con 0x7fb5780cfb70 2024-09-10T23:33:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb57ce00640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5580725e0 0x7fb558074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb577e00640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7fb558078b20 0x7fb55807af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb57ce00640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5580725e0 0x7fb558074aa0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0af000 tx=0x7fb56c01b0d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.505+0000 7fb577e00640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7fb558078b20 0x7fb55807af60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.509+0000 7fb574c00640 1 -- 172.21.15.17:0/3288489570 <== osd.6 v2:172.21.15.77:6818/1112476977 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb55807b630 con 0x7fb558078b20 2024-09-10T23:33:22.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 --> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb5780b7bb0 con 0x7fb558078b20 2024-09-10T23:33:22.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb574c00640 1 -- 172.21.15.17:0/3288489570 <== osd.6 v2:172.21.15.77:6818/1112476977 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb56400bd30 con 0x7fb558078b20 2024-09-10T23:33:22.526 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:22.526 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:33:22.527 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:22.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7fb558078b20 msgr2=0x7fb55807af60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6818/1112476977,v1:172.21.15.77:6819/1112476977] conn(0x7fb558078b20 0x7fb55807af60 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5580725e0 msgr2=0x7fb558074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fb5580725e0 0x7fb558074aa0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0af000 tx=0x7fb56c01b0d0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5780cfb70 msgr2=0x7fb57814c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 --2- 172.21.15.17:0/3288489570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5780cfb70 0x7fb57814c6c0 secure :-1 s=READY pgs=2734 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c770 tx=0x7fb57000cc30 comp rx=0 tx=0).stop 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57d800640 1 -- 172.21.15.17:0/3288489570 reap_dead start 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 shutdown_connections 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 >> 172.21.15.17:0/3288489570 conn(0x7fb5780d1d40 msgr2=0x7fb578156670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 shutdown_connections 2024-09-10T23:33:22.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.521+0000 7fb57f800640 1 -- 172.21.15.17:0/3288489570 wait complete. 2024-09-10T23:33:22.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T23:33:22.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 -- 172.21.15.17:0/785652275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640ce4b0 msgr2=0x7f66640cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 --2- 172.21.15.17:0/785652275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640ce4b0 0x7f66640cfb20 secure :-1 s=READY pgs=2736 cs=0 l=1 rev1=1 crypto rx=0x7f6654009840 tx=0x7f665401d280 comp rx=0 tx=0).stop 2024-09-10T23:33:22.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 -- 172.21.15.17:0/785652275 shutdown_connections 2024-09-10T23:33:22.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 --2- 172.21.15.17:0/785652275 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66640d0600 0x7f66640af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 --2- 172.21.15.17:0/785652275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640ce4b0 0x7f66640cfb20 unknown :-1 s=CLOSED pgs=2736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 -- 172.21.15.17:0/785652275 >> 172.21.15.17:0/785652275 conn(0x7f66640d1d40 msgr2=0x7f66640d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 -- 172.21.15.17:0/785652275 shutdown_connections 2024-09-10T23:33:22.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 -- 172.21.15.17:0/785652275 wait complete. 2024-09-10T23:33:22.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 Processor -- start 2024-09-10T23:33:22.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.689+0000 7f6669e00640 1 -- start start 2024-09-10T23:33:22.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6669e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66640cdf60 0x7f666414cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6669e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66640ce4b0 0x7f66640b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6669e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640d0600 0x7f6664071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6669e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f6664168e80 con 0x7f66640d0600 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6669e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6664168d00 con 0x7f66640cdf60 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6669e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f6664169000 con 0x7f66640ce4b0 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6663400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640d0600 0x7f6664071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6663400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640d0600 0x7f6664071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33204/0 (socket says 172.21.15.17:33204) 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6663400640 1 -- 172.21.15.17:0/1827517003 learned_addr learned my addr 172.21.15.17:0/1827517003 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6662a00640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66640cdf60 0x7f666414cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6662000640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66640ce4b0 0x7f66640b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6663400640 1 -- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66640ce4b0 msgr2=0x7f66640b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6663400640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66640ce4b0 0x7f66640b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6663400640 1 -- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66640cdf60 msgr2=0x7f666414cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6663400640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66640cdf60 0x7f666414cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6663400640 1 -- 172.21.15.17:0/1827517003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666414d4d0 con 0x7f66640d0600 2024-09-10T23:33:22.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6663400640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640d0600 0x7f6664071c00 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 crypto rx=0x7f665c00cd10 tx=0x7f665c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f665b400640 1 -- 172.21.15.17:0/1827517003 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c00f450 con 0x7f66640d0600 2024-09-10T23:33:22.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f665b400640 1 -- 172.21.15.17:0/1827517003 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f665c00f700 con 0x7f66640d0600 2024-09-10T23:33:22.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f665b400640 1 -- 172.21.15.17:0/1827517003 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c00fb50 con 0x7f66640d0600 2024-09-10T23:33:22.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666414d7b0 con 0x7f66640d0600 2024-09-10T23:33:22.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666414dd70 con 0x7f66640d0600 2024-09-10T23:33:22.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.693+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66640cfb20 con 0x7f66640d0600 2024-09-10T23:33:22.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.697+0000 7f665b400640 1 -- 172.21.15.17:0/1827517003 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f665c00e3b0 con 0x7f66640d0600 2024-09-10T23:33:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.697+0000 7f665b400640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66440725e0 0x7f6644074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.697+0000 7f665b400640 1 -- 172.21.15.17:0/1827517003 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f665c093b70 con 0x7f66640d0600 2024-09-10T23:33:22.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.697+0000 7f6662a00640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66440725e0 0x7f6644074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:22.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.697+0000 7f6662a00640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66440725e0 0x7f6644074aa0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f66540af000 tx=0x7f665401b060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.701+0000 7f665b400640 1 -- 172.21.15.17:0/1827517003 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f665c014030 con 0x7f66640d0600 2024-09-10T23:33:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.877+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f666415df60 con 0x7f66440725e0 2024-09-10T23:33:22.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.877+0000 7f665b400640 1 -- 172.21.15.17:0/1827517003 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f666415df60 con 0x7f66440725e0 2024-09-10T23:33:22.882 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T23:33:22.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66440725e0 msgr2=0x7f6644074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66440725e0 0x7f6644074aa0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f66540af000 tx=0x7f665401b060 comp rx=0 tx=0).stop 2024-09-10T23:33:22.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640d0600 msgr2=0x7f6664071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:22.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640d0600 0x7f6664071c00 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 crypto rx=0x7f665c00cd10 tx=0x7f665c00a620 comp rx=0 tx=0).stop 2024-09-10T23:33:22.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 shutdown_connections 2024-09-10T23:33:22.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f66440725e0 0x7f6644074aa0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66640d0600 0x7f6664071c00 unknown :-1 s=CLOSED pgs=2737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f66640ce4b0 0x7f66640b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 --2- 172.21.15.17:0/1827517003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66640cdf60 0x7f666414cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:22.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 >> 172.21.15.17:0/1827517003 conn(0x7f66640d1d40 msgr2=0x7f66640ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:22.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 shutdown_connections 2024-09-10T23:33:22.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:22.881+0000 7f6669e00640 1 -- 172.21.15.17:0/1827517003 wait complete. 2024-09-10T23:33:22.905 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T23:33:22.905 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T23:33:23.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 -- 172.21.15.17:0/2997371727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664004810 msgr2=0x7fc664004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 --2- 172.21.15.17:0/2997371727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664004810 0x7fc664004c90 secure :-1 s=READY pgs=2739 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0af720 tx=0x7fc66801ce00 comp rx=0 tx=0).stop 2024-09-10T23:33:23.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 -- 172.21.15.17:0/2997371727 shutdown_connections 2024-09-10T23:33:23.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 --2- 172.21.15.17:0/2997371727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664004810 0x7fc664004c90 unknown :-1 s=CLOSED pgs=2739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 -- 172.21.15.17:0/2997371727 >> 172.21.15.17:0/2997371727 conn(0x7fc67c0cc590 msgr2=0x7fc67c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:23.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 -- 172.21.15.17:0/2997371727 shutdown_connections 2024-09-10T23:33:23.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 -- 172.21.15.17:0/2997371727 wait complete. 2024-09-10T23:33:23.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 Processor -- start 2024-09-10T23:33:23.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 -- start start 2024-09-10T23:33:23.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc664004810 0x7fc67c14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc67c1528a0 0x7fc67c149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc67c15f260 0x7fc67c151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c15fd40 con 0x7fc67c15f260 2024-09-10T23:33:23.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc67c15fbc0 con 0x7fc664004810 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc683400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7fc67c15fec0 con 0x7fc67c1528a0 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc681400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc67c15f260 0x7fc67c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc681400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc67c15f260 0x7fc67c151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33224/0 (socket says 172.21.15.17:33224) 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc681400640 1 -- 172.21.15.17:0/2542702984 learned_addr learned my addr 172.21.15.17:0/2542702984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.053+0000 7fc680a00640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc664004810 0x7fc67c14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc67be00640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc67c1528a0 0x7fc67c149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc681400640 1 -- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc67c1528a0 msgr2=0x7fc67c149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc681400640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc67c1528a0 0x7fc67c149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc681400640 1 -- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc664004810 msgr2=0x7fc67c14de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc681400640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc664004810 0x7fc67c14de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc681400640 1 -- 172.21.15.17:0/2542702984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67c14f320 con 0x7fc67c15f260 2024-09-10T23:33:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc680a00640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc664004810 0x7fc67c14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc681400640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc67c15f260 0x7fc67c151610 secure :-1 s=READY pgs=2740 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0c9fe0 tx=0x7fc67400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc678c00640 1 -- 172.21.15.17:0/2542702984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67400fe10 con 0x7fc67c15f260 2024-09-10T23:33:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc678c00640 1 -- 172.21.15.17:0/2542702984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc674004b30 con 0x7fc67c15f260 2024-09-10T23:33:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc678c00640 1 -- 172.21.15.17:0/2542702984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674003980 con 0x7fc67c15f260 2024-09-10T23:33:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc67c14e350 con 0x7fc67c15f260 2024-09-10T23:33:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc67c14f5c0 con 0x7fc67c15f260 2024-09-10T23:33:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc67c160420 con 0x7fc67c15f260 2024-09-10T23:33:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc678c00640 1 -- 172.21.15.17:0/2542702984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7fc674003b20 con 0x7fc67c15f260 2024-09-10T23:33:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.057+0000 7fc678c00640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc65c072610 0x7fc65c074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.061+0000 7fc678c00640 1 -- 172.21.15.17:0/2542702984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7fc674094790 con 0x7fc67c15f260 2024-09-10T23:33:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.061+0000 7fc678c00640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fc65c078b50 0x7fc65c07af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.061+0000 7fc678c00640 1 -- 172.21.15.17:0/2542702984 --> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc65c07b660 con 0x7fc65c078b50 2024-09-10T23:33:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.061+0000 7fc678c00640 1 -- 172.21.15.17:0/2542702984 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=229) ==== 24+0+0 (secure 0 0 0) 0x7fc674094c20 con 0x7fc67c15f260 2024-09-10T23:33:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.061+0000 7fc680a00640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc65c072610 0x7fc65c074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.061+0000 7fc67be00640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fc65c078b50 0x7fc65c07af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.061+0000 7fc680a00640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc65c072610 0x7fc65c074ad0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc670000c10 tx=0x7fc670006b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.061+0000 7fc67be00640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fc65c078b50 0x7fc65c07af90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.061+0000 7fc678c00640 1 -- 172.21.15.17:0/2542702984 <== osd.7 v2:172.21.15.77:6810/1526018425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc65c07b660 con 0x7fc65c078b50 2024-09-10T23:33:23.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.073+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 --> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc67c0cd380 con 0x7fc65c078b50 2024-09-10T23:33:23.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc678c00640 1 -- 172.21.15.17:0/2542702984 <== osd.7 v2:172.21.15.77:6810/1526018425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc67c0cd380 con 0x7fc65c078b50 2024-09-10T23:33:23.079 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-10T23:33:23.079 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T23:33:23.080 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-10T23:33:23.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fc65c078b50 msgr2=0x7fc65c07af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6810/1526018425,v1:172.21.15.77:6811/1526018425] conn(0x7fc65c078b50 0x7fc65c07af90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc65c072610 msgr2=0x7fc65c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7fc65c072610 0x7fc65c074ad0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc670000c10 tx=0x7fc670006b80 comp rx=0 tx=0).stop 2024-09-10T23:33:23.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc67c15f260 msgr2=0x7fc67c151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 --2- 172.21.15.17:0/2542702984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc67c15f260 0x7fc67c151610 secure :-1 s=READY pgs=2740 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0c9fe0 tx=0x7fc67400f3c0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc681400640 1 -- 172.21.15.17:0/2542702984 reap_dead start 2024-09-10T23:33:23.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 shutdown_connections 2024-09-10T23:33:23.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 >> 172.21.15.17:0/2542702984 conn(0x7fc67c0cc590 msgr2=0x7fc67c1578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:23.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 shutdown_connections 2024-09-10T23:33:23.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.077+0000 7fc683400640 1 -- 172.21.15.17:0/2542702984 wait complete. 2024-09-10T23:33:23.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T23:33:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.241+0000 7f056c800640 1 -- 172.21.15.17:0/795299811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 msgr2=0x7f05640cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.241+0000 7f056c800640 1 --2- 172.21.15.17:0/795299811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 0x7f05640cec10 secure :-1 s=READY pgs=2741 cs=0 l=1 rev1=1 crypto rx=0x7f0564074f80 tx=0x7f056001cd80 comp rx=0 tx=0).stop 2024-09-10T23:33:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.241+0000 7f056c800640 1 -- 172.21.15.17:0/795299811 shutdown_connections 2024-09-10T23:33:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.241+0000 7f056c800640 1 --2- 172.21.15.17:0/795299811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 0x7f05640cec10 unknown :-1 s=CLOSED pgs=2741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.241+0000 7f056c800640 1 --2- 172.21.15.17:0/795299811 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05640745e0 0x7f056415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.241+0000 7f056c800640 1 --2- 172.21.15.17:0/795299811 >> v2:172.21.15.77:3300/0 conn(0x7f056406fc50 0x7f056415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.241+0000 7f056c800640 1 -- 172.21.15.17:0/795299811 >> 172.21.15.17:0/795299811 conn(0x7f05640b1850 msgr2=0x7f05640b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.241+0000 7f056c800640 1 -- 172.21.15.17:0/795299811 shutdown_connections 2024-09-10T23:33:23.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.241+0000 7f056c800640 1 -- 172.21.15.17:0/795299811 wait complete. 2024-09-10T23:33:23.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 Processor -- start 2024-09-10T23:33:23.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 -- start start 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056406fc50 0x7f0564150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 0x7f05640b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05640745e0 0x7f05641faf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f056406f2b0 con 0x7f0564070030 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f056406f130 con 0x7f056406fc50 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f056406f430 con 0x7f05640745e0 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 0x7f05640b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 0x7f05640b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33238/0 (socket says 172.21.15.17:33238) 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569400640 1 -- 172.21.15.17:0/3432160337 learned_addr learned my addr 172.21.15.17:0/3432160337 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056a800640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05640745e0 0x7f05641faf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569e00640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056406fc50 0x7f0564150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569400640 1 -- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05640745e0 msgr2=0x7f05641faf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569400640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05640745e0 0x7f05641faf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569400640 1 -- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056406fc50 msgr2=0x7f0564150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569400640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056406fc50 0x7f0564150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569400640 1 -- 172.21.15.17:0/3432160337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0564150d60 con 0x7f0564070030 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569e00640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056406fc50 0x7f0564150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f0569400640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 0x7f05640b0750 secure :-1 s=READY pgs=2742 cs=0 l=1 rev1=1 crypto rx=0x7f055400b410 tx=0x7f055400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f055e000640 1 -- 172.21.15.17:0/3432160337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554015020 con 0x7f0564070030 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f055e000640 1 -- 172.21.15.17:0/3432160337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0554011920 con 0x7f0564070030 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f055e000640 1 -- 172.21.15.17:0/3432160337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554011d70 con 0x7f0564070030 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05640b0fa0 con 0x7f0564070030 2024-09-10T23:33:23.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.245+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05640ae920 con 0x7f0564070030 2024-09-10T23:33:23.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.249+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0564075ad0 con 0x7f0564070030 2024-09-10T23:33:23.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.249+0000 7f055e000640 1 -- 172.21.15.17:0/3432160337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f055401a400 con 0x7f0564070030 2024-09-10T23:33:23.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.249+0000 7f055e000640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05480725e0 0x7f0548074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.249+0000 7f055e000640 1 -- 172.21.15.17:0/3432160337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f05540932f0 con 0x7f0564070030 2024-09-10T23:33:23.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.249+0000 7f0569e00640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05480725e0 0x7f0548074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.253+0000 7f0569e00640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05480725e0 0x7f0548074aa0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0564152890 tx=0x7f0558008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:23.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.253+0000 7f055e000640 1 -- 172.21.15.17:0/3432160337 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f055401f020 con 0x7f0564070030 2024-09-10T23:33:23.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f05640b5600 con 0x7f05480725e0 2024-09-10T23:33:23.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f055e000640 1 -- 172.21.15.17:0/3432160337 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0558009140 con 0x7f05480725e0 2024-09-10T23:33:23.432 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T23:33:23.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05480725e0 msgr2=0x7f0548074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05480725e0 0x7f0548074aa0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0564152890 tx=0x7f0558008040 comp rx=0 tx=0).stop 2024-09-10T23:33:23.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 msgr2=0x7f05640b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 0x7f05640b0750 secure :-1 s=READY pgs=2742 cs=0 l=1 rev1=1 crypto rx=0x7f055400b410 tx=0x7f055400b8d0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 shutdown_connections 2024-09-10T23:33:23.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f05480725e0 0x7f0548074aa0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05640745e0 0x7f05641faf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0564070030 0x7f05640b0750 unknown :-1 s=CLOSED pgs=2742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 --2- 172.21.15.17:0/3432160337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056406fc50 0x7f0564150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 >> 172.21.15.17:0/3432160337 conn(0x7f05640b1850 msgr2=0x7f056415b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:23.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 shutdown_connections 2024-09-10T23:33:23.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.429+0000 7f056c800640 1 -- 172.21.15.17:0/3432160337 wait complete. 2024-09-10T23:33:23.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:33:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.597+0000 7f1e07200640 1 -- 172.21.15.17:0/2691148043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dec004da0 msgr2=0x7f1dec005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.597+0000 7f1e07200640 1 --2- 172.21.15.17:0/2691148043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1dec004da0 0x7f1dec005220 secure :-1 s=READY pgs=2744 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009e00 tx=0x7f1e0001d130 comp rx=0 tx=0).stop 2024-09-10T23:33:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.597+0000 7f1e06800640 1 -- 172.21.15.17:0/2691148043 reap_dead start 2024-09-10T23:33:23.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.597+0000 7f1e07200640 1 -- 172.21.15.17:0/2691148043 shutdown_connections 2024-09-10T23:33:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.597+0000 7f1e07200640 1 -- 172.21.15.17:0/2691148043 >> 172.21.15.17:0/2691148043 conn(0x7f1e080d1bc0 msgr2=0x7f1e080d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.597+0000 7f1e07200640 1 -- 172.21.15.17:0/2691148043 shutdown_connections 2024-09-10T23:33:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.597+0000 7f1e07200640 1 -- 172.21.15.17:0/2691148043 wait complete. 2024-09-10T23:33:23.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 Processor -- start 2024-09-10T23:33:23.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 -- start start 2024-09-10T23:33:23.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec004da0 0x7f1e0806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e08153ed0 0x7f1e0814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e080b0020 0x7f1e080b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f1e080b2d00 con 0x7f1e080b0020 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e080b2b80 con 0x7f1e08153ed0 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f1e080b2e80 con 0x7f1dec004da0 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e06800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e080b0020 0x7f1e080b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e06800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e080b0020 0x7f1e080b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33266/0 (socket says 172.21.15.17:33266) 2024-09-10T23:33:23.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e06800640 1 -- 172.21.15.17:0/3375664341 learned_addr learned my addr 172.21.15.17:0/3375664341 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e05e00640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec004da0 0x7f1e0806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1dffe00640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e08153ed0 0x7f1e0814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e06800640 1 -- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec004da0 msgr2=0x7f1e0806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e06800640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec004da0 0x7f1e0806de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e06800640 1 -- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e08153ed0 msgr2=0x7f1e0814dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e06800640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e08153ed0 0x7f1e0814dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e06800640 1 -- 172.21.15.17:0/3375664341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0806e580 con 0x7f1e080b0020 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e06800640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e080b0020 0x7f1e080b0460 secure :-1 s=READY pgs=2745 cs=0 l=1 rev1=1 crypto rx=0x7f1e00002240 tx=0x7f1e000add50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1dfe000640 1 -- 172.21.15.17:0/3375664341 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e000b1040 con 0x7f1e080b0020 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1dfe000640 1 -- 172.21.15.17:0/3375664341 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e000bc070 con 0x7f1e080b0020 2024-09-10T23:33:23.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1dfe000640 1 -- 172.21.15.17:0/3375664341 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e000ade40 con 0x7f1e080b0020 2024-09-10T23:33:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0806e860 con 0x7f1e080b0020 2024-09-10T23:33:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.601+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e080c5790 con 0x7f1e080b0020 2024-09-10T23:33:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.605+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e080d27f0 con 0x7f1e080b0020 2024-09-10T23:33:23.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.605+0000 7f1dfe000640 1 -- 172.21.15.17:0/3375664341 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f1e0000f040 con 0x7f1e080b0020 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.605+0000 7f1dfe000640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1de4072610 0x7f1de4074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.605+0000 7f1dfe000640 1 -- 172.21.15.17:0/3375664341 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f1e0012da50 con 0x7f1e080b0020 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.605+0000 7f1e05e00640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1de4072610 0x7f1de4074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.605+0000 7f1e05e00640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1de4072610 0x7f1de4074ad0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f1df8006fd0 tx=0x7f1df8006b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.609+0000 7f1dfe000640 1 -- 172.21.15.17:0/3375664341 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f1e000a5e20 con 0x7f1e080b0020 2024-09-10T23:33:23.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e080b09a0 con 0x7f1de4072610 2024-09-10T23:33:23.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1dfe000640 1 -- 172.21.15.17:0/3375664341 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13420 (secure 0 0 0) 0x7f1e080b09a0 con 0x7f1de4072610 2024-09-10T23:33:23.785 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:23.785 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:33:23.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1de4072610 msgr2=0x7f1de4074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1de4072610 0x7f1de4074ad0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f1df8006fd0 tx=0x7f1df8006b80 comp rx=0 tx=0).stop 2024-09-10T23:33:23.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e080b0020 msgr2=0x7f1e080b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:23.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e080b0020 0x7f1e080b0460 secure :-1 s=READY pgs=2745 cs=0 l=1 rev1=1 crypto rx=0x7f1e00002240 tx=0x7f1e000add50 comp rx=0 tx=0).stop 2024-09-10T23:33:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 shutdown_connections 2024-09-10T23:33:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f1de4072610 0x7f1de4074ad0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e080b0020 0x7f1e080b0460 unknown :-1 s=CLOSED pgs=2745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e08153ed0 0x7f1e0814dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 --2- 172.21.15.17:0/3375664341 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1dec004da0 0x7f1e0806de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.781+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 >> 172.21.15.17:0/3375664341 conn(0x7f1e080d1bc0 msgr2=0x7f1e0815e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.785+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 shutdown_connections 2024-09-10T23:33:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:23.785+0000 7f1e07200640 1 -- 172.21.15.17:0/3375664341 wait complete. 2024-09-10T23:33:23.807 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":762,"stamp":"2024-09-10T23:33:22.556962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":577156,"kb_used_data":23816,"kb_used_omap":12,"kb_used_meta":553139,"kb_avail":754397564,"statfs":{"total":773094113280,"available":772503105536,"internally_reserved":0,"allocated":24387584,"data_stored":12104512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":566414897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12582912,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-8,"num_write_kb":-12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.459144"},"pg_stats":[{"pgid":"1.0","version":"19'72","reported_seq":489,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-10T23:33:14.105780+0000","last_change":"2024-09-10T23:15:28.548208+0000","last_active":"2024-09-10T23:33:14.105780+0000","last_peered":"2024-09-10T23:33:14.105780+0000","last_clean":"2024-09-10T23:33:14.105780+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:33:14.105780+0000","last_undegraded":"2024-09-10T23:33:14.105780+0000","last_fullsized":"2024-09-10T23:33:14.105780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T23:15:26.737903+0000","last_clean_scrub_stamp":"2024-09-10T23:15:26.737903+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:17.757652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74216,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297624,"statfs":{"total":96636764160,"available":96560766976,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509659,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92848,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94278992,"statfs":{"total":96636764160,"available":96541687808,"internally_reserved":0,"allocated":3493888,"data_stored":1955840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52068,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319772,"statfs":{"total":96636764160,"available":96583446528,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74280,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297560,"statfs":{"total":96636764160,"available":96560701440,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509658,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78440,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293400,"statfs":{"total":96636764160,"available":96556441600,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52072,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319768,"statfs":{"total":96636764160,"available":96583442432,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509658,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79016,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292824,"statfs":{"total":96636764160,"available":96555851776,"internally_reserved":0,"allocated":3493888,"data_stored":1955840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575066,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74216,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297624,"statfs":{"total":96636764160,"available":96560766976,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:33:23.810 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T23:15:26.737903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=23, tm_min=15, tm_sec=26, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=23, tm_min=33, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T23:33:23.810 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T23:33:39.078 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:33:39.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:33:43.812 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T23:33:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.965+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2480433359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb40d0190 msgr2=0x7f5bb40b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.965+0000 7f5bb8e00640 1 --2- 172.21.15.17:0/2480433359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb40d0190 0x7f5bb40b2160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009c80 tx=0x7f5bac01cd10 comp rx=0 tx=0).stop 2024-09-10T23:33:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.965+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2480433359 shutdown_connections 2024-09-10T23:33:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.965+0000 7f5bb8e00640 1 --2- 172.21.15.17:0/2480433359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb40d0190 0x7f5bb40b2160 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.965+0000 7f5bb8e00640 1 --2- 172.21.15.17:0/2480433359 >> v2:172.21.15.77:3300/0 conn(0x7f5bb4161790 0x7f5bb406e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.965+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2480433359 >> 172.21.15.17:0/2480433359 conn(0x7f5bb40d1b80 msgr2=0x7f5bb40d1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.965+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2480433359 shutdown_connections 2024-09-10T23:33:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.965+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2480433359 wait complete. 2024-09-10T23:33:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 Processor -- start 2024-09-10T23:33:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 -- start start 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb40d0190 0x7f5bb40cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb41613b0 0x7f5bb414d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb4161790 0x7f5bb414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb416b150 con 0x7f5bb4161790 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb416afd0 con 0x7f5bb41613b0 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb416b2d0 con 0x7f5bb40d0190 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb4161790 0x7f5bb414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb2a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb41613b0 0x7f5bb414d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb3400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb40d0190 0x7f5bb40cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb4161790 0x7f5bb414dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48542/0 (socket says 172.21.15.17:48542) 2024-09-10T23:33:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb3e00640 1 -- 172.21.15.17:0/2359751633 learned_addr learned my addr 172.21.15.17:0/2359751633 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb2a00640 1 -- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb40d0190 msgr2=0x7f5bb40cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb2a00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb40d0190 0x7f5bb40cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb2a00640 1 -- 172.21.15.17:0/2359751633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb4161790 msgr2=0x7f5bb414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb2a00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb4161790 0x7f5bb414dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb2a00640 1 -- 172.21.15.17:0/2359751633 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb41f7dd0 con 0x7f5bb41613b0 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb3e00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb4161790 0x7f5bb414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb2a00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb41613b0 0x7f5bb414d6f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e9f0 tx=0x7f5ba000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bab400640 1 -- 172.21.15.17:0/2359751633 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000ccc0 con 0x7f5bb41613b0 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bab400640 1 -- 172.21.15.17:0/2359751633 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ba0004020 con 0x7f5bb41613b0 2024-09-10T23:33:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bab400640 1 -- 172.21.15.17:0/2359751633 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000ce60 con 0x7f5bb41613b0 2024-09-10T23:33:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb41f80b0 con 0x7f5bb41613b0 2024-09-10T23:33:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb41f8670 con 0x7f5bb41613b0 2024-09-10T23:33:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.969+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb40b2160 con 0x7f5bb41613b0 2024-09-10T23:33:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.973+0000 7f5bab400640 1 -- 172.21.15.17:0/2359751633 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f5ba0003600 con 0x7f5bb41613b0 2024-09-10T23:33:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.973+0000 7f5bab400640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5b94072610 0x7f5b94074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.973+0000 7f5bab400640 1 -- 172.21.15.17:0/2359751633 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f5ba00938d0 con 0x7f5bb41613b0 2024-09-10T23:33:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.973+0000 7f5bb3400640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5b94072610 0x7f5b94074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:43.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.973+0000 7f5bb3400640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5b94072610 0x7f5b94074ad0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4007fd0 tx=0x7f5ba4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:43.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:43.977+0000 7f5bab400640 1 -- 172.21.15.17:0/2359751633 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f5ba005ea70 con 0x7f5bb41613b0 2024-09-10T23:33:44.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 --> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5bb40b7b00 con 0x7f5b94072610 2024-09-10T23:33:44.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bab400640 1 -- 172.21.15.17:0/2359751633 <== mgr.4108 v2:172.21.15.77:6800/2773663503 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13371 (secure 0 0 0) 0x7f5bb40b7b00 con 0x7f5b94072610 2024-09-10T23:33:44.153 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:44.153 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5b94072610 msgr2=0x7f5b94074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5b94072610 0x7f5b94074ad0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4007fd0 tx=0x7f5ba4009040 comp rx=0 tx=0).stop 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb41613b0 msgr2=0x7f5bb414d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb41613b0 0x7f5bb414d6f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e9f0 tx=0x7f5ba000eeb0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 shutdown_connections 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f5b94072610 0x7f5b94074ad0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bb4161790 0x7f5bb414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb41613b0 0x7f5bb414d6f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 --2- 172.21.15.17:0/2359751633 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bb40d0190 0x7f5bb40cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 >> 172.21.15.17:0/2359751633 conn(0x7f5bb40d1b80 msgr2=0x7f5bb4154160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 shutdown_connections 2024-09-10T23:33:44.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.149+0000 7f5bb8e00640 1 -- 172.21.15.17:0/2359751633 wait complete. 2024-09-10T23:33:44.174 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":772,"stamp":"2024-09-10T23:33:42.561107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":577140,"kb_used_data":23816,"kb_used_omap":12,"kb_used_meta":553139,"kb_avail":754397580,"statfs":{"total":773094113280,"available":772503121920,"internally_reserved":0,"allocated":24387584,"data_stored":12104512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":566414897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002682"},"pg_stats":[{"pgid":"1.0","version":"229'74","reported_seq":500,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-10T23:33:23.646218+0000","last_change":"2024-09-10T23:33:23.646150+0000","last_active":"2024-09-10T23:33:23.646218+0000","last_peered":"2024-09-10T23:33:23.646218+0000","last_clean":"2024-09-10T23:33:23.646218+0000","last_became_active":"2024-09-10T23:15:28.546964+0000","last_became_peered":"2024-09-10T23:15:28.546964+0000","last_unstale":"2024-09-10T23:33:23.646218+0000","last_undegraded":"2024-09-10T23:33:23.646218+0000","last_fullsized":"2024-09-10T23:33:23.646218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"229'74","last_scrub_stamp":"2024-09-10T23:33:23.646075+0000","last_deep_scrub":"229'74","last_deep_scrub_stamp":"2024-09-10T23:33:23.646075+0000","last_clean_scrub_stamp":"2024-09-10T23:33:23.646075+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:47.067190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":16,"seq":68719476958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74216,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297624,"statfs":{"total":96636764160,"available":96560766976,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509663,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92836,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94279004,"statfs":{"total":96636764160,"available":96541700096,"internally_reserved":0,"allocated":3493888,"data_stored":1955840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52068,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319772,"statfs":{"total":96636764160,"available":96583446528,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509663,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74280,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297560,"statfs":{"total":96636764160,"available":96560701440,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78440,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94293400,"statfs":{"total":96636764160,"available":96556441600,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509663,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52072,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319768,"statfs":{"total":96636764160,"available":96583442432,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509662,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79012,"kb_used_data":3412,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94292828,"statfs":{"total":96636764160,"available":96555855872,"internally_reserved":0,"allocated":3493888,"data_stored":1955840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575070,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74216,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94297624,"statfs":{"total":96636764160,"available":96560766976,"internally_reserved":0,"allocated":2899968,"data_stored":1365472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73071047},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T23:33:44.175 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T23:33:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.317+0000 7f9457800640 1 -- 172.21.15.17:0/907003642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9438003a40 msgr2=0x7f9438003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.317+0000 7f9457800640 1 --2- 172.21.15.17:0/907003642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9438003a40 0x7f9438003e60 secure :-1 s=READY pgs=2747 cs=0 l=1 rev1=1 crypto rx=0x7f9444009b60 tx=0x7f944401d180 comp rx=0 tx=0).stop 2024-09-10T23:33:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.317+0000 7f9455800640 1 -- 172.21.15.17:0/907003642 reap_dead start 2024-09-10T23:33:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.317+0000 7f9457800640 1 -- 172.21.15.17:0/907003642 shutdown_connections 2024-09-10T23:33:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.317+0000 7f9457800640 1 -- 172.21.15.17:0/907003642 >> 172.21.15.17:0/907003642 conn(0x7f945006c360 msgr2=0x7f945006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.317+0000 7f9457800640 1 -- 172.21.15.17:0/907003642 shutdown_connections 2024-09-10T23:33:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.317+0000 7f9457800640 1 -- 172.21.15.17:0/907003642 wait complete. 2024-09-10T23:33:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.317+0000 7f9457800640 1 Processor -- start 2024-09-10T23:33:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.317+0000 7f9457800640 1 -- start start 2024-09-10T23:33:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9457800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9438003a40 0x7f9450144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9457800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94501580d0 0x7f94501fb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9457800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f945015aad0 0x7f945015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9457800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f9450167e90 con 0x7f945015aad0 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9457800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9450167d10 con 0x7f94501580d0 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9457800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f9450168010 con 0x7f9438003a40 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9455800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f945015aad0 0x7f945015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9455800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f945015aad0 0x7f945015af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48564/0 (socket says 172.21.15.17:48564) 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9455800640 1 -- 172.21.15.17:0/3461414312 learned_addr learned my addr 172.21.15.17:0/3461414312 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f944fe00640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94501580d0 0x7f94501fb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9454e00640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9438003a40 0x7f9450144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9455800640 1 -- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9438003a40 msgr2=0x7f9450144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9455800640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9438003a40 0x7f9450144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9455800640 1 -- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94501580d0 msgr2=0x7f94501fb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9455800640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94501580d0 0x7f94501fb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9455800640 1 -- 172.21.15.17:0/3461414312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9450145110 con 0x7f945015aad0 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9455800640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f945015aad0 0x7f945015af50 secure :-1 s=READY pgs=2748 cs=0 l=1 rev1=1 crypto rx=0x7f94500cded0 tx=0x7f9448006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f944cc00640 1 -- 172.21.15.17:0/3461414312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9448015020 con 0x7f945015aad0 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f944cc00640 1 -- 172.21.15.17:0/3461414312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9448011900 con 0x7f945015aad0 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f944cc00640 1 -- 172.21.15.17:0/3461414312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9448011d50 con 0x7f945015aad0 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9450158600 con 0x7f945015aad0 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945015a2d0 con 0x7f945015aad0 2024-09-10T23:33:44.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945006a4b0 con 0x7f945015aad0 2024-09-10T23:33:44.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.321+0000 7f944cc00640 1 -- 172.21.15.17:0/3461414312 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f944801a400 con 0x7f945015aad0 2024-09-10T23:33:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.325+0000 7f944cc00640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94300725e0 0x7f9430074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.325+0000 7f944cc00640 1 -- 172.21.15.17:0/3461414312 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f9448093e30 con 0x7f945015aad0 2024-09-10T23:33:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.325+0000 7f9454e00640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94300725e0 0x7f9430074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.325+0000 7f9454e00640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94300725e0 0x7f9430074aa0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f94440ae000 tx=0x7f9444019f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.329+0000 7f944cc00640 1 -- 172.21.15.17:0/3461414312 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f944801f020 con 0x7f945015aad0 2024-09-10T23:33:44.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.501+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f94500b4d50 con 0x7f945015aad0 2024-09-10T23:33:44.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f944cc00640 1 -- 172.21.15.17:0/3461414312 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v67)=0 v67) ==== 123+0+0 (secure 0 0 0) 0x7f9450145110 con 0x7f945015aad0 2024-09-10T23:33:44.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f944cc00640 1 -- 172.21.15.17:0/3461414312 <== mon.0 v2:172.21.15.17:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f944805ea50 con 0x7f945015aad0 2024-09-10T23:33:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94300725e0 msgr2=0x7f9430074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94300725e0 0x7f9430074aa0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f94440ae000 tx=0x7f9444019f20 comp rx=0 tx=0).stop 2024-09-10T23:33:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f945015aad0 msgr2=0x7f945015af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f945015aad0 0x7f945015af50 secure :-1 s=READY pgs=2748 cs=0 l=1 rev1=1 crypto rx=0x7f94500cded0 tx=0x7f9448006430 comp rx=0 tx=0).stop 2024-09-10T23:33:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 shutdown_connections 2024-09-10T23:33:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f94300725e0 0x7f9430074aa0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f945015aad0 0x7f945015af50 unknown :-1 s=CLOSED pgs=2748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94501580d0 0x7f94501fb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 --2- 172.21.15.17:0/3461414312 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9438003a40 0x7f9450144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 >> 172.21.15.17:0/3461414312 conn(0x7f945006c360 msgr2=0x7f9450154470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 shutdown_connections 2024-09-10T23:33:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.505+0000 7f9457800640 1 -- 172.21.15.17:0/3461414312 wait complete. 2024-09-10T23:33:44.530 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T23:33:44.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T23:33:44.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.673+0000 7f049d000640 1 -- 172.21.15.17:0/1031788174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f049806fc50 msgr2=0x7f049815b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.673+0000 7f049d000640 1 --2- 172.21.15.17:0/1031788174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f049806fc50 0x7f049815b2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0488009900 tx=0x7f048801c8e0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.673+0000 7f049d000640 1 -- 172.21.15.17:0/1031788174 shutdown_connections 2024-09-10T23:33:44.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.673+0000 7f049d000640 1 --2- 172.21.15.17:0/1031788174 >> v2:172.21.15.77:3300/0 conn(0x7f0498070030 0x7f04980cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.673+0000 7f049d000640 1 --2- 172.21.15.17:0/1031788174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f049806fc50 0x7f049815b2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.673+0000 7f049d000640 1 -- 172.21.15.17:0/1031788174 >> 172.21.15.17:0/1031788174 conn(0x7f04980b1850 msgr2=0x7f04980b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.673+0000 7f049d000640 1 -- 172.21.15.17:0/1031788174 shutdown_connections 2024-09-10T23:33:44.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.673+0000 7f049d000640 1 -- 172.21.15.17:0/1031788174 wait complete. 2024-09-10T23:33:44.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 Processor -- start 2024-09-10T23:33:44.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 -- start start 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f049806fc50 0x7f04981fbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0498070030 0x7f04980a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04980745e0 0x7f0498140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 -- 0x7f0498167200 con 0x7f04980745e0 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f049806f380 con 0x7f0498070030 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 -- 0x7f0498167380 con 0x7f049806fc50 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0496800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04980745e0 0x7f0498140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0496800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04980745e0 0x7f0498140c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48574/0 (socket says 172.21.15.17:48574) 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0496800640 1 -- 172.21.15.17:0/731511240 learned_addr learned my addr 172.21.15.17:0/731511240 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0495e00640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f049806fc50 0x7f04981fbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0495400640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0498070030 0x7f04980a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0496800640 1 -- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f049806fc50 msgr2=0x7f04981fbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0496800640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f049806fc50 0x7f04981fbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0496800640 1 -- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0498070030 msgr2=0x7f04980a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0496800640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0498070030 0x7f04980a9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0496800640 1 -- 172.21.15.17:0/731511240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04980a9cc0 con 0x7f04980745e0 2024-09-10T23:33:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f0496800640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04980745e0 0x7f0498140c50 secure :-1 s=READY pgs=2749 cs=0 l=1 rev1=1 crypto rx=0x7f049000af70 tx=0x7f049000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f048e000640 1 -- 172.21.15.17:0/731511240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490003b80 con 0x7f04980745e0 2024-09-10T23:33:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f048e000640 1 -- 172.21.15.17:0/731511240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f0490003e30 con 0x7f04980745e0 2024-09-10T23:33:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f048e000640 1 -- 172.21.15.17:0/731511240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490004260 con 0x7f04980745e0 2024-09-10T23:33:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04980a9fa0 con 0x7f04980745e0 2024-09-10T23:33:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04980aa560 con 0x7f04980745e0 2024-09-10T23:33:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.677+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049815b2f0 con 0x7f04980745e0 2024-09-10T23:33:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.681+0000 7f048e000640 1 -- 172.21.15.17:0/731511240 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) ==== 96394+0+0 (secure 0 0 0) 0x7f0490015070 con 0x7f04980745e0 2024-09-10T23:33:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.681+0000 7f048e000640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0478072610 0x7f0478074ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T23:33:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.681+0000 7f048e000640 1 -- 172.21.15.17:0/731511240 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5421+0+0 (secure 0 0 0) 0x7f04900938c0 con 0x7f04980745e0 2024-09-10T23:33:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.681+0000 7f0495e00640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0478072610 0x7f0478074ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T23:33:44.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.681+0000 7f0495e00640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0478072610 0x7f0478074ad0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f04880af000 tx=0x7f04880a8040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T23:33:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.685+0000 7f048e000640 1 -- 172.21.15.17:0/731511240 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187845 (secure 0 0 0) 0x7f049005e9d0 con 0x7f04980745e0 2024-09-10T23:33:44.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.893+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0498154490 con 0x7f04980745e0 2024-09-10T23:33:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.893+0000 7f048e000640 1 -- 172.21.15.17:0/731511240 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 177 v177) ==== 95+0+3913 (secure 0 0 0) 0x7f0490063400 con 0x7f04980745e0 2024-09-10T23:33:44.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-10T23:33:44.899 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":177,"btime":"2024-09-10T23:33:12:084292+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/249080048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":249080048},{"type":"v1","addr":"172.21.15.77:6837","nonce":249080048}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":10771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1047453247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1047453247},{"type":"v1","addr":"172.21.15.77:6836","nonce":1047453247}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6834/3676328894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3676328894},{"type":"v1","addr":"172.21.15.17:6834","nonce":3676328894}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":164},{"gid":12264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/536881655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6833","nonce":536881655},{"type":"v1","addr":"172.21.15.17:6835","nonce":536881655}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":177}],"filesystems":[]} 2024-09-10T23:33:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 177 2024-09-10T23:33:44.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0478072610 msgr2=0x7f0478074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0478072610 0x7f0478074ad0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f04880af000 tx=0x7f04880a8040 comp rx=0 tx=0).stop 2024-09-10T23:33:44.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04980745e0 msgr2=0x7f0498140c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T23:33:44.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04980745e0 0x7f0498140c50 secure :-1 s=READY pgs=2749 cs=0 l=1 rev1=1 crypto rx=0x7f049000af70 tx=0x7f049000c7a0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 shutdown_connections 2024-09-10T23:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:6800/2773663503,v1:172.21.15.77:6801/2773663503] conn(0x7f0478072610 0x7f0478074ad0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04980745e0 0x7f0498140c50 unknown :-1 s=CLOSED pgs=2749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0498070030 0x7f04980a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 --2- 172.21.15.17:0/731511240 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f049806fc50 0x7f04981fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T23:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 >> 172.21.15.17:0/731511240 conn(0x7f04980b1850 msgr2=0x7f0498153680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T23:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 shutdown_connections 2024-09-10T23:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-10T23:33:44.897+0000 7f049d000640 1 -- 172.21.15.17:0/731511240 wait complete. 2024-09-10T23:33:44.921 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T23:33:44.922 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T23:33:44.922 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T23:33:44.922 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:44.934 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T23:33:44.934 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T23:33:44.934 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:44.988 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T23:33:44.988 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T23:33:44.988 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:45.003 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T23:33:45.003 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T23:33:45.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:45.062 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T23:33:45.062 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T23:33:45.062 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T23:33:45.062 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:45.149 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T23:33:45.149 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T23:33:45.149 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:45.242 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T23:33:45.242 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T23:33:45.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:45.340 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T23:33:45.340 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T23:33:45.340 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:45.426 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T23:33:45.426 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T23:33:45.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:45.512 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T23:33:45.512 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T23:33:45.512 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:45.604 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T23:33:45.605 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T23:33:45.605 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:45.683 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T23:33:45.683 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T23:33:45.683 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:46.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-10T23:33:46.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-10T23:33:46.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-10T23:33:46.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-10T23:33:46.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-10T23:33:51.785 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T23:33:51.786 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T23:33:51.787 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T23:33:51.787 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:51.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-10T23:33:51.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-10T23:33:51.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-10T23:33:51.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-10T23:33:51.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-10T23:33:51.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-10T23:33:51.847 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T23:33:51.847 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T23:33:51.847 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:51.909 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T23:33:51.909 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T23:33:51.909 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T23:33:51.909 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:51.930 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T23:33:51.931 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T23:33:51.931 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:51.948 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T23:33:51.948 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T23:33:51.948 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T23:33:52.010 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T23:33:52.010 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T23:33:52.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-09-10T23:33:52.051 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:33:52.051 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T23:33:52.372 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:33:52.373 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T23:33:52.589 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:33:52.589 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T23:33:52.927 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:33:52.927 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T23:33:53.126 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:33:53.126 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T23:33:53.415 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:33:53.415 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T23:33:53.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:33:53.642 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T23:33:53.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:33:53.835 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T23:33:54.018 INFO:tasks.ceph:Archiving mon data... 2024-09-10T23:33:54.019 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775/data/mon.a.tgz 2024-09-10T23:33:54.020 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-10T23:33:54.029 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.wxOX7nZ1s3 2024-09-10T23:33:54.030 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wxOX7nZ1s3 2024-09-10T23:33:54.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.wxOX7nZ1s3 2024-09-10T23:33:54.268 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.wxOX7nZ1s3 is 475KB 2024-09-10T23:33:54.334 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.wxOX7nZ1s3 2024-09-10T23:33:54.342 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775/data/mon.b.tgz 2024-09-10T23:33:54.342 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-10T23:33:54.351 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.IfBnNsOF8c 2024-09-10T23:33:54.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.IfBnNsOF8c 2024-09-10T23:33:54.504 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.IfBnNsOF8c 2024-09-10T23:33:54.576 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.IfBnNsOF8c is 475KB 2024-09-10T23:33:54.639 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.IfBnNsOF8c 2024-09-10T23:33:54.648 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775/data/mon.c.tgz 2024-09-10T23:33:54.648 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-10T23:33:54.695 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.JQHJHOkKvp 2024-09-10T23:33:54.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.JQHJHOkKvp 2024-09-10T23:33:54.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.JQHJHOkKvp 2024-09-10T23:33:54.916 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.JQHJHOkKvp is 475KB 2024-09-10T23:33:54.979 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.JQHJHOkKvp 2024-09-10T23:33:54.987 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T23:33:54.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T23:33:54.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T23:33:55.060 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T23:33:55.100 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T23:33:55.100 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T23:33:55.102 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775/remote/smithi017/crash 2024-09-10T23:33:55.102 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T23:33:55.123 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775/remote/smithi077/crash 2024-09-10T23:33:55.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T23:33:55.161 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T23:33:55.161 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:33:55.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T23:33:55.251 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T23:33:55.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T23:33:55.311 INFO:tasks.ceph:Compressing logs... 2024-09-10T23:33:55.311 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:33:55.322 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T23:33:55.352 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77971.log 2024-09-10T23:33:55.353 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79593.log 2024-09-10T23:33:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36228.log 2024-09-10T23:33:55.354 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77971.log.gz 2024-09-10T23:33:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49916.log 2024-09-10T23:33:55.357 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79593.log.gz 2024-09-10T23:33:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72300.log 2024-09-10T23:33:55.357 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36228.log.gz 2024-09-10T23:33:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71372.log 2024-09-10T23:33:55.357 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49916.log.gz 2024-09-10T23:33:55.358 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36705.log 2024-09-10T23:33:55.358 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72300.log.gz 2024-09-10T23:33:55.358 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52450.log 2024-09-10T23:33:55.358 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71372.log.gz 2024-09-10T23:33:55.359 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54786.log 2024-09-10T23:33:55.359 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36705.log.gz 2024-09-10T23:33:55.360 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86951.log 2024-09-10T23:33:55.360 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52450.log.gz 2024-09-10T23:33:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54400.log 2024-09-10T23:33:55.361 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54786.log.gz 2024-09-10T23:33:55.362 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90515.log 2024-09-10T23:33:55.362 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.86951.log.gz 2024-09-10T23:33:55.363 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58060.log 2024-09-10T23:33:55.363 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54400.log.gz 2024-09-10T23:33:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28944.log 2024-09-10T23:33:55.364 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90515.log.gz 2024-09-10T23:33:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34740.log 2024-09-10T23:33:55.365 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58060.log.gz 2024-09-10T23:33:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79465.log 2024-09-10T23:33:55.365 INFO:teuthology.orchestra.run.smithi017.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28944.log.gz 2024-09-10T23:33:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55091.log 2024-09-10T23:33:55.366 INFO:teuthology.orchestra.run.smithi017.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34740.log.gz 2024-09-10T23:33:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36510.log 2024-09-10T23:33:55.368 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.79465.log.gz 2024-09-10T23:33:55.368 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52424.log 2024-09-10T23:33:55.368 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55091.log.gz 2024-09-10T23:33:55.369 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54180.log 2024-09-10T23:33:55.369 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36510.log.gz 2024-09-10T23:33:55.369 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79975.log 2024-09-10T23:33:55.369 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52424.log.gz 2024-09-10T23:33:55.370 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90541.log 2024-09-10T23:33:55.370 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54180.log.gz 2024-09-10T23:33:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77028.log 2024-09-10T23:33:55.372 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.79975.log.gz 2024-09-10T23:33:55.372 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83499.log 2024-09-10T23:33:55.372 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90541.log.gz 2024-09-10T23:33:55.373 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49695.log 2024-09-10T23:33:55.373 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77028.log.gz 2024-09-10T23:33:55.374 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89928.log 2024-09-10T23:33:55.374 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83499.log.gz 2024-09-10T23:33:55.375 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34056.log 2024-09-10T23:33:55.375 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49695.log.gz 2024-09-10T23:33:55.376 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33529.log 2024-09-10T23:33:55.376 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89928.log.gz 2024-09-10T23:33:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92182.log 2024-09-10T23:33:55.377 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34056.log.gz 2024-09-10T23:33:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89878.log 2024-09-10T23:33:55.377 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33529.log.gz 2024-09-10T23:33:55.378 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87547.log 2024-09-10T23:33:55.378 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92182.log.gz 2024-09-10T23:33:55.378 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73955.log 2024-09-10T23:33:55.379 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.89878.log.gz 2024-09-10T23:33:55.379 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52528.log 2024-09-10T23:33:55.379 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87547.log.gz 2024-09-10T23:33:55.380 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87476.log 2024-09-10T23:33:55.380 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73955.log.gz 2024-09-10T23:33:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81065.log 2024-09-10T23:33:55.381 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52528.log.gz 2024-09-10T23:33:55.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91401.log 2024-09-10T23:33:55.382 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87476.log.gz 2024-09-10T23:33:55.383 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81065.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T23:33:55.383 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81065.log.gz 2024-09-10T23:33:55.383 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92586.log 2024-09-10T23:33:55.384 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91401.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91401.log.gz 2024-09-10T23:33:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58509.log 2024-09-10T23:33:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80764.log 2024-09-10T23:33:55.386 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92586.log.gz 2024-09-10T23:33:55.386 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54100.log 2024-09-10T23:33:55.386 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58509.log.gz 2024-09-10T23:33:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49825.log 2024-09-10T23:33:55.387 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80764.log.gz 2024-09-10T23:33:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54655.log 2024-09-10T23:33:55.388 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29112.log 2024-09-10T23:33:55.389 INFO:teuthology.orchestra.run.smithi017.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54100.log.gz 2024-09-10T23:33:55.389 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34332.log 2024-09-10T23:33:55.389 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49825.log.gz 2024-09-10T23:33:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88986.log 2024-09-10T23:33:55.391 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54655.log.gz 2024-09-10T23:33:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34332.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34332.log.gz 2024-09-10T23:33:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83168.log 2024-09-10T23:33:55.392 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29009.log 2024-09-10T23:33:55.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29112.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T23:33:55.392 INFO:teuthology.orchestra.run.smithi077.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29112.log.gz 2024-09-10T23:33:55.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29009.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T23:33:55.393 INFO:teuthology.orchestra.run.smithi077.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29009.log.gz 2024-09-10T23:33:55.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28937.log 2024-09-10T23:33:55.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34680.log 2024-09-10T23:33:55.398 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.28937.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28937.log.gz 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29088.log 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.1.34680.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29088.log: 88.8% -- replaced with /var/log/ceph/ceph-client.1.34680.log.gz 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29088.log.gz 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29064.log 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28985.log 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.29064.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29064.log.gz 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.28985.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28985.log.gz 2024-09-10T23:33:55.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29033.log 2024-09-10T23:33:55.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28961.log 2024-09-10T23:33:55.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29033.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T23:33:55.402 INFO:teuthology.orchestra.run.smithi077.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29033.log.gz 2024-09-10T23:33:55.404 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35046.log 2024-09-10T23:33:55.404 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88986.log.gz 2024-09-10T23:33:55.404 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86206.log 2024-09-10T23:33:55.404 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83168.log.gz 2024-09-10T23:33:55.404 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78156.log 2024-09-10T23:33:55.404 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35046.log.gz 2024-09-10T23:33:55.404 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77785.log 2024-09-10T23:33:55.404 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86206.log.gz 2024-09-10T23:33:55.404 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.78156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91889.log 2024-09-10T23:33:55.405 INFO:teuthology.orchestra.run.smithi017.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T23:33:55.405 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34552.log 2024-09-10T23:33:55.405 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77785.log.gz 2024-09-10T23:33:55.405 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85872.log 2024-09-10T23:33:55.405 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.91889.log.gz 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87942.log 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34552.log.gz 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28991.log 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.85872.log.gz 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80827.log 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87942.log.gz 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50090.log 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28991.log.gz 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54445.log 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80827.log.gz 2024-09-10T23:33:55.406 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57322.log 2024-09-10T23:33:55.407 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50090.log.gz 2024-09-10T23:33:55.407 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36124.log 2024-09-10T23:33:55.407 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54445.log.gz 2024-09-10T23:33:55.407 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56910.log 2024-09-10T23:33:55.407 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57322.log.gz 2024-09-10T23:33:55.409 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.28961.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T23:33:55.409 INFO:teuthology.orchestra.run.smithi077.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28961.log.gz 2024-09-10T23:33:55.409 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T23:33:55.409 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.d.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T23:33:55.409 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T23:33:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57885.log 2024-09-10T23:33:55.412 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36124.log.gz 2024-09-10T23:33:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90893.log 2024-09-10T23:33:55.412 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56910.log.gz 2024-09-10T23:33:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36679.log 2024-09-10T23:33:55.412 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57885.log.gz 2024-09-10T23:33:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52398.log 2024-09-10T23:33:55.412 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90893.log.gz 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82816.log 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36679.log.gz 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90227.log 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52398.log.gz 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34290.log 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82816.log.gz 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49598.log 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90227.log.gz 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36787.log 2024-09-10T23:33:55.413 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34290.log.gz 2024-09-10T23:33:55.417 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mds.b.log: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T23:33:55.417 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T23:33:55.417 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49799.log 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49598.log.gz 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83421.log 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36787.log.gz 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58426.log 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49799.log.gz 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52233.log 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.83421.log.gz 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79567.log 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58426.log.gz 2024-09-10T23:33:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84251.log 2024-09-10T23:33:55.420 INFO:teuthology.orchestra.run.smithi017.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52233.log.gz 2024-09-10T23:33:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89643.log 2024-09-10T23:33:55.420 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79567.log.gz 2024-09-10T23:33:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.84251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56116.log 2024-09-10T23:33:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83604.log 2024-09-10T23:33:55.421 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89643.log.gz 2024-09-10T23:33:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57173.log 2024-09-10T23:33:55.421 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56116.log.gz 2024-09-10T23:33:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83604.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83604.log.gz 2024-09-10T23:33:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84118.log 2024-09-10T23:33:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52005.log 2024-09-10T23:33:55.422 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57173.log.gz 2024-09-10T23:33:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.84118.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84118.log.gz 2024-09-10T23:33:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57014.log 2024-09-10T23:33:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58744.log 2024-09-10T23:33:55.425 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34799.log 2024-09-10T23:33:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57014.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52005.log.gz 2024-09-10T23:33:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50817.log 2024-09-10T23:33:55.426 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57014.log.gz 2024-09-10T23:33:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58744.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58744.log.gz 2024-09-10T23:33:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35687.log 2024-09-10T23:33:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86258.log 2024-09-10T23:33:55.428 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50817.log.gz 2024-09-10T23:33:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74660.log 2024-09-10T23:33:55.428 INFO:teuthology.orchestra.run.smithi017.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.35687.log.gz 2024-09-10T23:33:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35830.log 2024-09-10T23:33:55.429 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86258.log.gz 2024-09-10T23:33:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72356.log 2024-09-10T23:33:55.430 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74660.log.gz 2024-09-10T23:33:55.431 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71424.log 2024-09-10T23:33:55.431 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35830.log.gz 2024-09-10T23:33:55.432 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.3.34799.log: 88.1% -- replaced with /var/log/ceph/ceph-client.3.34799.log.gz 2024-09-10T23:33:55.433 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.72356.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T23:33:55.433 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71424.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71424.log.gz 2024-09-10T23:33:55.433 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36328.log 2024-09-10T23:33:55.434 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.0.log: -- /var/log/ceph/ceph-client.admin.49124.log 2024-09-10T23:33:55.435 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36354.log 2024-09-10T23:33:55.435 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36328.log.gz 2024-09-10T23:33:55.437 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34330.log 2024-09-10T23:33:55.437 INFO:teuthology.orchestra.run.smithi017.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49124.log.gz 2024-09-10T23:33:55.437 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36046.log 2024-09-10T23:33:55.438 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36354.log.gz 2024-09-10T23:33:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34264.log 2024-09-10T23:33:55.439 INFO:teuthology.orchestra.run.smithi017.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34330.log.gz 2024-09-10T23:33:55.440 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55838.log 2024-09-10T23:33:55.440 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36046.log.gz 2024-09-10T23:33:55.441 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49721.log 2024-09-10T23:33:55.441 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34264.log.gz 2024-09-10T23:33:55.442 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53525.log 2024-09-10T23:33:55.442 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55838.log.gz 2024-09-10T23:33:55.443 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74107.log 2024-09-10T23:33:55.444 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49721.log.gz 2024-09-10T23:33:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88309.log 2024-09-10T23:33:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53525.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53525.log.gz 2024-09-10T23:33:55.446 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77945.log 2024-09-10T23:33:55.446 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74107.log.gz 2024-09-10T23:33:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83525.log 2024-09-10T23:33:55.447 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88309.log.gz 2024-09-10T23:33:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84092.log 2024-09-10T23:33:55.448 INFO:teuthology.orchestra.run.smithi017.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.77945.log.gz 2024-09-10T23:33:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77433.log 2024-09-10T23:33:55.449 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83525.log.gz 2024-09-10T23:33:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.84092.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.84092.log.gz 2024-09-10T23:33:55.450 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.71865.log 2024-09-10T23:33:55.451 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77197.log 2024-09-10T23:33:55.451 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77433.log.gz 2024-09-10T23:33:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54812.log 2024-09-10T23:33:55.452 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71865.log.gz 2024-09-10T23:33:55.453 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77197.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.77197.log.gz -5 2024-09-10T23:33:55.453 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33974.log 2024-09-10T23:33:55.454 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80735.log 2024-09-10T23:33:55.454 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54812.log.gz 2024-09-10T23:33:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33974.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23936.log 2024-09-10T23:33:55.455 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33974.log.gz 2024-09-10T23:33:55.456 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54629.log 2024-09-10T23:33:55.456 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80735.log.gz 2024-09-10T23:33:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73760.log 2024-09-10T23:33:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.tmp-client.admin.23936.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23936.log.gz 2024-09-10T23:33:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88152.log 2024-09-10T23:33:55.458 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54629.log.gz 2024-09-10T23:33:55.459 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73760.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73760.log.gz -5 2024-09-10T23:33:55.459 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53499.log 2024-09-10T23:33:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.88152.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50668.log 2024-09-10T23:33:55.461 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88152.log.gz 2024-09-10T23:33:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86323.log 2024-09-10T23:33:55.461 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53499.log.gz 2024-09-10T23:33:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58244.log 2024-09-10T23:33:55.463 INFO:teuthology.orchestra.run.smithi017.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50668.log.gz 2024-09-10T23:33:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86415.log 2024-09-10T23:33:55.465 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86323.log.gz 2024-09-10T23:33:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87129.log 2024-09-10T23:33:55.465 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58244.log.gz 2024-09-10T23:33:55.466 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86415.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86415.log.gz 2024-09-10T23:33:55.466 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72146.log 2024-09-10T23:33:55.467 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57660.log/var/log/ceph/ceph-client.admin.87129.log: 2024-09-10T23:33:55.468 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82790.log 2024-09-10T23:33:55.468 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87129.log.gz -- replaced with /var/log/ceph/ceph-client.admin.72146.log.gz 2024-09-10T23:33:55.468 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-10T23:33:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52157.log 2024-09-10T23:33:55.469 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57660.log.gz 2024-09-10T23:33:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82790.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82790.log.gzgzip 2024-09-10T23:33:55.470 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53581.log 2024-09-10T23:33:55.471 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55582.log 2024-09-10T23:33:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53912.log 2024-09-10T23:33:55.473 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53581.log.gz 2024-09-10T23:33:55.473 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52157.log.gz 2024-09-10T23:33:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76794.log 2024-09-10T23:33:55.474 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55582.log.gz 2024-09-10T23:33:55.474 INFO:teuthology.orchestra.run.smithi077.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T23:33:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87294.log 2024-09-10T23:33:55.475 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53912.log.gz 2024-09-10T23:33:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55519.log 2024-09-10T23:33:55.476 INFO:teuthology.orchestra.run.smithi017.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.76794.log.gz 2024-09-10T23:33:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77997.log 2024-09-10T23:33:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87294.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87294.log.gz 2024-09-10T23:33:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53107.log 2024-09-10T23:33:55.478 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55519.log.gz 2024-09-10T23:33:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77997.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77997.log.gzgzip 2024-09-10T23:33:55.479 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55578.log 2024-09-10T23:33:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56884.log 2024-09-10T23:33:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53107.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53107.log.gz 2024-09-10T23:33:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87450.log 2024-09-10T23:33:55.481 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55578.log.gz 2024-09-10T23:33:55.482 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79671.log 2024-09-10T23:33:55.482 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56884.log.gz 2024-09-10T23:33:55.483 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.87450.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35185.log 2024-09-10T23:33:55.483 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79671.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87450.log.gz 2024-09-10T23:33:55.484 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79671.log.gz 2024-09-10T23:33:55.484 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51980.log 2024-09-10T23:33:55.485 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52207.log 2024-09-10T23:33:55.485 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35185.log.gz 2024-09-10T23:33:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34212.log 2024-09-10T23:33:55.486 INFO:teuthology.orchestra.run.smithi017.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51980.log.gz 2024-09-10T23:33:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51246.log 2024-09-10T23:33:55.487 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52207.log.gz 2024-09-10T23:33:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34212.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34212.log.gz 2024-09-10T23:33:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36406.log 2024-09-10T23:33:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.51246.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.73659.log 2024-09-10T23:33:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36406.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51246.log.gz 2024-09-10T23:33:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28851.log 2024-09-10T23:33:55.491 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36406.log.gz 2024-09-10T23:33:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92260.log 2024-09-10T23:33:55.492 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28851.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.73659.log.gz 2024-09-10T23:33:55.493 INFO:teuthology.orchestra.run.smithi017.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.28851.log.gz 2024-09-10T23:33:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86004.log 2024-09-10T23:33:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80369.log 2024-09-10T23:33:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92260.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92260.log.gz 2024-09-10T23:33:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86004.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86004.log.gz 2024-09-10T23:33:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92208.log 2024-09-10T23:33:55.495 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50467.log 2024-09-10T23:33:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80369.log: /var/log/ceph/ceph-client.admin.92208.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80369.log.gz 2024-09-10T23:33:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2024-09-10T23:33:55.497 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92208.log.gz 2024-09-10T23:33:55.497 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57501.log 2024-09-10T23:33:55.498 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50467.log.gz 2024-09-10T23:33:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89539.log 2024-09-10T23:33:55.499 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2024-09-10T23:33:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54270.log 2024-09-10T23:33:55.500 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57501.log.gz 2024-09-10T23:33:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71658.log 2024-09-10T23:33:55.501 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89539.log.gz 2024-09-10T23:33:55.502 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87424.log 2024-09-10T23:33:55.502 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54270.log.gz 2024-09-10T23:33:55.503 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71658.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71658.log.gz 2024-09-10T23:33:55.503 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76950.log 2024-09-10T23:33:55.504 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76872.log 2024-09-10T23:33:55.504 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87424.log.gz 2024-09-10T23:33:55.506 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83324.log 2024-09-10T23:33:55.506 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76950.log.gz 2024-09-10T23:33:55.506 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36150.log 2024-09-10T23:33:55.507 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76872.log.gz 2024-09-10T23:33:55.508 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83395.log 2024-09-10T23:33:55.508 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83324.log.gz 2024-09-10T23:33:55.508 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92924.log 2024-09-10T23:33:55.509 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36150.log.gz 2024-09-10T23:33:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54868.log 2024-09-10T23:33:55.510 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83395.log.gz 2024-09-10T23:33:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56168.log 2024-09-10T23:33:55.511 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92924.log.gz 2024-09-10T23:33:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54868.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54868.log.gz 2024-09-10T23:33:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77329.log 2024-09-10T23:33:55.513 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77893.log 2024-09-10T23:33:55.514 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56168.log: /var/log/ceph/ceph-client.admin.77329.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56168.log.gz 2024-09-10T23:33:55.514 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76460.log 2024-09-10T23:33:55.514 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77329.log.gz 2024-09-10T23:33:55.515 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36020.log 2024-09-10T23:33:55.515 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77893.log.gz 2024-09-10T23:33:55.516 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34186.log 2024-09-10T23:33:55.516 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76460.log.gz 2024-09-10T23:33:55.517 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90867.log 2024-09-10T23:33:55.517 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36020.log.gz 2024-09-10T23:33:55.518 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34186.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34186.log.gz 2024-09-10T23:33:55.518 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29009.log 2024-09-10T23:33:55.519 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92482.log 2024-09-10T23:33:55.520 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90867.log: /var/log/ceph/ceph-client.admin.29009.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90867.log.gz 2024-09-10T23:33:55.521 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36484.log 2024-09-10T23:33:55.521 INFO:teuthology.orchestra.run.smithi017.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29009.log.gz 2024-09-10T23:33:55.521 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73609.log 2024-09-10T23:33:55.522 INFO:teuthology.orchestra.run.smithi017.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.92482.log.gz 2024-09-10T23:33:55.523 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77171.log 2024-09-10T23:33:55.523 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36484.log.gz 2024-09-10T23:33:55.523 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34551.log 2024-09-10T23:33:55.524 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77171.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.73609.log.gz 2024-09-10T23:33:55.525 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90305.log 2024-09-10T23:33:55.525 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77171.log.gz 2024-09-10T23:33:55.526 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49442.log 2024-09-10T23:33:55.526 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34551.log.gz 2024-09-10T23:33:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90305.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90305.log.gz 2024-09-10T23:33:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73929.log 2024-09-10T23:33:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87862.log 2024-09-10T23:33:55.529 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49442.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49442.log.gz 2024-09-10T23:33:55.529 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73929.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73929.log.gz 2024-09-10T23:33:55.529 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55406.log 2024-09-10T23:33:55.530 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88830.log 2024-09-10T23:33:55.530 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87862.log.gz 2024-09-10T23:33:55.531 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.55406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86075.log 2024-09-10T23:33:55.532 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92234.log 2024-09-10T23:33:55.533 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88830.log.gz 2024-09-10T23:33:55.533 INFO:teuthology.orchestra.run.smithi017.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.55406.log.gz 2024-09-10T23:33:55.533 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77576.log 2024-09-10T23:33:55.534 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86075.log.gz 2024-09-10T23:33:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74036.log 2024-09-10T23:33:55.535 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92234.log.gz 2024-09-10T23:33:55.536 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77145.log 2024-09-10T23:33:55.536 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77576.log.gz 2024-09-10T23:33:55.537 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80586.log 2024-09-10T23:33:55.537 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74036.log.gz 2024-09-10T23:33:55.538 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52502.log 2024-09-10T23:33:55.538 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77145.log.gz 2024-09-10T23:33:55.539 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80586.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.80586.log.gz -5 2024-09-10T23:33:55.539 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54688.log 2024-09-10T23:33:55.540 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58086.log 2024-09-10T23:33:55.540 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52502.log.gz 2024-09-10T23:33:55.541 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87601.log 2024-09-10T23:33:55.541 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54688.log.gz 2024-09-10T23:33:55.542 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77722.log 2024-09-10T23:33:55.542 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58086.log.gz 2024-09-10T23:33:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90775.log 87.2% 2024-09-10T23:33:55.544 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87601.log.gz 2024-09-10T23:33:55.545 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73786.log 2024-09-10T23:33:55.545 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77722.log.gz 2024-09-10T23:33:55.546 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90775.log: gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.90775.log.gz 2024-09-10T23:33:55.546 INFO:teuthology.orchestra.run.smithi017.stderr: /var/log/ceph/ceph-client.admin.88765.log 2024-09-10T23:33:55.547 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55117.log 2024-09-10T23:33:55.547 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73786.log.gz 2024-09-10T23:33:55.548 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88765.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88765.log.gz 2024-09-10T23:33:55.548 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28764.log 2024-09-10T23:33:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36562.log 2024-09-10T23:33:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55117.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55117.log.gz 2024-09-10T23:33:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28764.log.gz 2024-09-10T23:33:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72198.log 2024-09-10T23:33:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28805.log 2024-09-10T23:33:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36562.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36562.log.gz 2024-09-10T23:33:55.555 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74842.log 2024-09-10T23:33:55.555 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72198.log.gz 2024-09-10T23:33:55.555 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28805.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T23:33:55.555 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28805.log.gz 2024-09-10T23:33:55.555 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77223.log 2024-09-10T23:33:55.555 INFO:teuthology.orchestra.run.smithi017.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.74842.log.gz 2024-09-10T23:33:55.556 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89800.log 2024-09-10T23:33:55.556 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86497.log 2024-09-10T23:33:55.557 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77223.log.gz 2024-09-10T23:33:55.558 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50285.log 2024-09-10T23:33:55.558 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89800.log.gz 2024-09-10T23:33:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86497.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86497.log.gz 2024-09-10T23:33:55.559 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80935.log 2024-09-10T23:33:55.560 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50285.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50285.log.gz 2024-09-10T23:33:55.560 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86744.log 2024-09-10T23:33:55.561 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57796.log 2024-09-10T23:33:55.561 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80935.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80935.log.gz 2024-09-10T23:33:55.562 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75027.log 2024-09-10T23:33:55.562 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86744.log.gz 2024-09-10T23:33:55.563 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89565.log 87.6% 2024-09-10T23:33:55.563 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57796.log.gz 2024-09-10T23:33:55.564 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34532.log 2024-09-10T23:33:55.566 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.75027.log: /var/log/ceph/ceph-client.admin.89565.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89565.log.gz 2024-09-10T23:33:55.566 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71398.log 2024-09-10T23:33:55.567 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34532.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34532.log.gz 2024-09-10T23:33:55.568 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79849.log 2024-09-10T23:33:55.569 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71398.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71398.log.gz 2024-09-10T23:33:55.570 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52781.log 2024-09-10T23:33:55.570 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79849.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79849.log.gz 2024-09-10T23:33:55.571 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57326.log 2024-09-10T23:33:55.573 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52781.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52781.log.gz 2024-09-10T23:33:55.573 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35354.log 2024-09-10T23:33:55.574 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57326.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57326.log.gz 2024-09-10T23:33:55.574 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53215.log 2024-09-10T23:33:55.576 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35354.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35354.log.gz 2024-09-10T23:33:55.577 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35020.log 2024-09-10T23:33:55.577 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53215.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53215.log.gz 2024-09-10T23:33:55.578 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80025.log 2024-09-10T23:33:55.579 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35020.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35020.log.gz 2024-09-10T23:33:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55039.log 2024-09-10T23:33:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80025.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80025.log.gz 2024-09-10T23:33:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82950.log 2024-09-10T23:33:55.583 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55039.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55039.log.gz 2024-09-10T23:33:55.584 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5/var/log/ceph/ceph-client.admin.82950.log: --verbose -- /var/log/ceph/ceph-client.admin.34940.log 2024-09-10T23:33:55.584 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.82950.log.gz 2024-09-10T23:33:55.585 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49572.log 2024-09-10T23:33:55.587 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34940.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34940.log.gz 2024-09-10T23:33:55.587 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58112.log 2024-09-10T23:33:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49572.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49572.log.gz 2024-09-10T23:33:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55350.log 2024-09-10T23:33:55.590 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58112.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58112.log.gz 2024-09-10T23:33:55.591 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71528.log 2024-09-10T23:33:55.591 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55350.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55350.log.gz 2024-09-10T23:33:55.592 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90593.log 2024-09-10T23:33:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71528.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71528.log.gz 2024-09-10T23:33:55.594 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81196.log 2024-09-10T23:33:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90593.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90593.log.gz 2024-09-10T23:33:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74324.log 2024-09-10T23:33:55.597 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81196.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.81196.log.gz 2024-09-10T23:33:55.598 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80792.log 2024-09-10T23:33:55.598 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74324.log.gz 2024-09-10T23:33:55.599 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34526.log 2024-09-10T23:33:55.601 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80792.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80792.log.gz 2024-09-10T23:33:55.601 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53241.log 2024-09-10T23:33:55.602 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34526.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34526.log.gz 2024-09-10T23:33:55.603 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33607.log 2024-09-10T23:33:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53241.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53241.log.gz 2024-09-10T23:33:55.605 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52937.log 2024-09-10T23:33:55.605 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33607.log.gz 2024-09-10T23:33:55.606 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93004.log 2024-09-10T23:33:55.608 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52937.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52937.log.gz 2024-09-10T23:33:55.608 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35772.log 2024-09-10T23:33:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93004.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93004.log.gz 2024-09-10T23:33:55.610 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92076.log 2024-09-10T23:33:55.611 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35772.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35772.log.gz 2024-09-10T23:33:55.612 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85898.log 2024-09-10T23:33:55.613 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92076.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92076.log.gz 2024-09-10T23:33:55.614 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52729.log 2024-09-10T23:33:55.615 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85898.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85898.log.gz 2024-09-10T23:33:55.615 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55897.log 2024-09-10T23:33:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52729.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52729.log.gz 2024-09-10T23:33:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28839.log 2024-09-10T23:33:55.620 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.55897.log: /var/log/ceph/ceph-client.admin.28839.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.28839.log.gz 2024-09-10T23:33:55.620 INFO:teuthology.orchestra.run.smithi017.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.55897.log.gz 2024-09-10T23:33:55.620 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53616.log 2024-09-10T23:33:55.621 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87705.log 2024-09-10T23:33:55.622 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53616.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53616.log.gz 2024-09-10T23:33:55.623 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89513.log 2024-09-10T23:33:55.624 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87705.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87705.log.gz 2024-09-10T23:33:55.624 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74356.log 2024-09-10T23:33:55.626 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89513.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89513.log.gz 2024-09-10T23:33:55.627 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88256.log 2024-09-10T23:33:55.628 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74356.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74356.log.gz 2024-09-10T23:33:55.628 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76232.log 2024-09-10T23:33:55.629 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88256.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88256.log.gz 2024-09-10T23:33:55.630 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35994.log 2024-09-10T23:33:55.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76232.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.76232.log.gz 2024-09-10T23:33:55.632 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74421.log 2024-09-10T23:33:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35994.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35994.log.gz 2024-09-10T23:33:55.633 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87077.log 2024-09-10T23:33:55.635 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74421.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74421.log.gz 2024-09-10T23:33:55.636 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83815.log 2024-09-10T23:33:55.637 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87077.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.87077.log.gz 2024-09-10T23:33:55.637 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76538.log 2024-09-10T23:33:55.638 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83815.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83815.log.gz 2024-09-10T23:33:55.639 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92102.log 2024-09-10T23:33:55.641 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76538.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76538.log.gz 2024-09-10T23:33:55.641 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58797.log 2024-09-10T23:33:55.642 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92102.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92102.log.gz 2024-09-10T23:33:55.642 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74265.log 2024-09-10T23:33:55.644 INFO:teuthology.orchestra.run.smithi077.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T23:33:55.645 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58797.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.58797.log.gz 2024-09-10T23:33:55.645 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56936.log 2024-09-10T23:33:55.646 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74265.log.gz 2024-09-10T23:33:55.646 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86903.log 2024-09-10T23:33:55.648 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56936.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56936.log.gz 2024-09-10T23:33:55.648 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91237.log 2024-09-10T23:33:55.650 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.86903.log: 92.3% -- replaced with /var/log/ceph/ceph-client.0.86903.log.gz 2024-09-10T23:33:55.651 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.91237.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T23:33:55.655 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35713.log 2024-09-10T23:33:55.660 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81376.log 2024-09-10T23:33:55.661 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35713.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35713.log.gz 2024-09-10T23:33:55.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55788.log 2024-09-10T23:33:55.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81376.log: 94.6% -- replaced with /var/log/ceph/ceph-client.0.91237.log.gz 2024-09-10T23:33:55.665 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81376.log.gz 2024-09-10T23:33:55.667 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71891.log 2024-09-10T23:33:55.668 INFO:teuthology.orchestra.run.smithi017.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55788.log.gz 2024-09-10T23:33:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90723.log 2024-09-10T23:33:55.670 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71891.log.gz 2024-09-10T23:33:55.672 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71950.log 2024-09-10T23:33:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90723.log: 87.4%/var/log/ceph/ceph-client.admin.71950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2024-09-10T23:33:55.675 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90723.log.gz 2024-09-10T23:33:55.675 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71950.log.gz 2024-09-10T23:33:55.677 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82662.log 2024-09-10T23:33:55.680 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82662.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2024-09-10T23:33:55.681 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2024-09-10T23:33:55.682 INFO:teuthology.orchestra.run.smithi017.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82662.log.gz 2024-09-10T23:33:55.685 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83051.log/var/log/ceph/ceph-client.admin.35525.log: 2024-09-10T23:33:55.686 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gz 2024-09-10T23:33:55.689 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5/var/log/ceph/ceph-client.admin.83051.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83051.log.gz 2024-09-10T23:33:55.689 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.88882.log 2024-09-10T23:33:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88882.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88882.log.gz 2024-09-10T23:33:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88563.log 2024-09-10T23:33:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88563.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.88563.log.gz 2024-09-10T23:33:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83103.log 2024-09-10T23:33:55.698 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83103.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83103.log.gz 2024-09-10T23:33:55.699 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34531.log 2024-09-10T23:33:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58718.log 2024-09-10T23:33:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34531.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34531.log.gz 2024-09-10T23:33:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58718.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.91341.log 2024-09-10T23:33:55.704 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58718.log.gz 2024-09-10T23:33:55.707 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91341.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91341.log.gz 2024-09-10T23:33:55.707 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33273.log 2024-09-10T23:33:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55143.log 2024-09-10T23:33:55.710 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33273.log.gz 2024-09-10T23:33:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5/var/log/ceph/ceph-client.admin.55143.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55143.log.gz 2024-09-10T23:33:55.714 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.83904.log 2024-09-10T23:33:55.716 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83904.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83904.log.gz 2024-09-10T23:33:55.716 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89773.log 2024-09-10T23:33:55.719 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89773.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89773.log.gz 2024-09-10T23:33:55.719 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71103.log 2024-09-10T23:33:55.723 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71103.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71103.log.gz 2024-09-10T23:33:55.723 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77811.log 2024-09-10T23:33:55.725 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77811.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77811.log.gz 2024-09-10T23:33:55.726 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36590.log 2024-09-10T23:33:55.729 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36590.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36590.log.gz 2024-09-10T23:33:55.729 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50363.log 2024-09-10T23:33:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50363.log.gz 2024-09-10T23:33:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92560.log 2024-09-10T23:33:55.735 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92560.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92560.log.gz 2024-09-10T23:33:55.735 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36967.log 2024-09-10T23:33:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71775.log 2024-09-10T23:33:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36967.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36967.log.gz 2024-09-10T23:33:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28827.log 2024-09-10T23:33:55.740 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71775.log.gz 2024-09-10T23:33:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28827.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.28827.log.gz 2024-09-10T23:33:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81302.log 2024-09-10T23:33:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.81302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71554.log 2024-09-10T23:33:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55461.log 2024-09-10T23:33:55.755 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71554.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71554.log.gz 2024-09-10T23:33:55.755 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74010.log 2024-09-10T23:33:55.755 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55461.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55461.log.gz 2024-09-10T23:33:55.757 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74010.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74010.log.gz 2024-09-10T23:33:55.759 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83761.log 2024-09-10T23:33:55.764 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35799.log 2024-09-10T23:33:55.765 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83761.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83761.log.gz 2024-09-10T23:33:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82976.log 2024-09-10T23:33:55.769 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35799.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35799.log.gz 2024-09-10T23:33:55.772 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74291.log 2024-09-10T23:33:55.773 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82976.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82976.log.gz 2024-09-10T23:33:55.776 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74556.log 2024-09-10T23:33:55.777 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74291.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74291.log.gz 2024-09-10T23:33:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90832.log 2024-09-10T23:33:55.781 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74556.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74556.log.gz 2024-09-10T23:33:55.785 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90832.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90832.log.gz 2024-09-10T23:33:55.786 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76616.log 2024-09-10T23:33:55.787 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86232.log 2024-09-10T23:33:55.788 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76616.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76616.log.gz 2024-09-10T23:33:55.792 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55758.log 2024-09-10T23:33:55.794 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86232.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86232.log.gz 2024-09-10T23:33:55.797 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55758.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55758.log.gz 2024-09-10T23:33:55.799 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91941.log 2024-09-10T23:33:55.804 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50867.log 2024-09-10T23:33:55.806 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91941.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.91941.log.gz 2024-09-10T23:33:55.808 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85509.log 2024-09-10T23:33:55.810 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50867.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50867.log.gz 2024-09-10T23:33:55.811 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49980.log 2024-09-10T23:33:55.813 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85509.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85509.log.gz 2024-09-10T23:33:55.816 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49520.log 2024-09-10T23:33:55.818 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58481.log 2024-09-10T23:33:55.818 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49980.log.gz 2024-09-10T23:33:55.822 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58481.log: /var/log/ceph/ceph-client.admin.49520.log: 87.3% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49520.log.gz 2024-09-10T23:33:55.822 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92742.log 2024-09-10T23:33:55.824 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33711.log 2024-09-10T23:33:55.827 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92742.log: -- replaced with /var/log/ceph/ceph-client.admin.58481.log.gz 2024-09-10T23:33:55.828 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92742.log.gz 2024-09-10T23:33:55.828 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54838.log 2024-09-10T23:33:55.830 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33711.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.33711.log.gz 2024-09-10T23:33:55.833 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54838.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54838.log.gz 2024-09-10T23:33:55.835 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91131.log 2024-09-10T23:33:55.840 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56800.log 2024-09-10T23:33:55.842 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91131.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.91131.log.gz 2024-09-10T23:33:55.844 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76564.log 2024-09-10T23:33:55.845 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56800.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56800.log.gz 2024-09-10T23:33:55.846 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76512.log 2024-09-10T23:33:55.849 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76564.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76564.log.gz 2024-09-10T23:33:55.849 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56474.log 2024-09-10T23:33:55.852 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54044.log 2024-09-10T23:33:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56474.log: 87.6% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76512.log.gz 2024-09-10T23:33:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54044.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54044.log.gz 2024-09-10T23:33:55.859 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56474.log.gz 2024-09-10T23:33:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74582.log 2024-09-10T23:33:55.864 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55946.log 2024-09-10T23:33:55.865 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74582.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74582.log.gz 2024-09-10T23:33:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72011.log 2024-09-10T23:33:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55946.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55946.log.gz 2024-09-10T23:33:55.871 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83671.log 2024-09-10T23:33:55.872 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72011.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72011.log.gz 2024-09-10T23:33:55.876 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87575.log 2024-09-10T23:33:55.877 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83671.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83671.log.gz 2024-09-10T23:33:55.880 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29312.log 2024-09-10T23:33:55.881 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87575.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87575.log.gz 2024-09-10T23:33:55.882 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33449.log 2024-09-10T23:33:55.884 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.29312.log: 86.9%/var/log/ceph/ceph-client.admin.33449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56038.log 2024-09-10T23:33:55.887 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56038.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56038.log.gz 2024-09-10T23:33:55.887 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29312.log.gz 2024-09-10T23:33:55.888 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49773.log 2024-09-10T23:33:55.891 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49773.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49773.log.gz 2024-09-10T23:33:55.891 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85846.log 2024-09-10T23:33:55.892 INFO:teuthology.orchestra.run.smithi017.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33449.log.gz 2024-09-10T23:33:55.893 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54243.log 2024-09-10T23:33:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54243.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54243.log.gz 2024-09-10T23:33:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83843.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85846.log.gz 2024-09-10T23:33:55.898 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-10T23:33:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83843.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83843.log.gz 2024-09-10T23:33:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54720.log 2024-09-10T23:33:55.904 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54720.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54720.log.gz 2024-09-10T23:33:55.904 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74447.log 2024-09-10T23:33:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74447.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74447.log.gz 2024-09-10T23:33:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81039.log 2024-09-10T23:33:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81039.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81039.log.gz 2024-09-10T23:33:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56988.log 2024-09-10T23:33:55.913 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56988.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56988.log.gz 2024-09-10T23:33:55.913 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90036.log 2024-09-10T23:33:55.917 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90036.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.90036.log.gz 2024-09-10T23:33:55.917 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58561.log 2024-09-10T23:33:55.920 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36813.log 2024-09-10T23:33:55.920 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58561.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58561.log.gz 2024-09-10T23:33:55.923 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36813.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36813.log.gz 2024-09-10T23:33:55.923 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50545.log 2024-09-10T23:33:55.926 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50545.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50545.log.gz 2024-09-10T23:33:55.926 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82764.log 2024-09-10T23:33:55.927 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81143.log 2024-09-10T23:33:55.932 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81143.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.81143.log.gz 2024-09-10T23:33:55.932 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82764.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82764.log.gz 2024-09-10T23:33:55.932 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85585.log 2024-09-10T23:33:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85585.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.85585.log.gz 2024-09-10T23:33:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89012.log 2024-09-10T23:33:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89012.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89012.log.gz 2024-09-10T23:33:55.939 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88230.log 2024-09-10T23:33:55.942 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88230.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88230.log.gz 2024-09-10T23:33:55.942 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77249.log 2024-09-10T23:33:55.943 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58164.log 2024-09-10T23:33:55.948 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58164.log.gz 2024-09-10T23:33:55.948 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77249.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77249.log.gz 2024-09-10T23:33:55.948 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53046.log 2024-09-10T23:33:55.951 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53046.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53046.log.gz 2024-09-10T23:33:55.951 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51347.log 2024-09-10T23:33:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51347.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51347.log.gz 2024-09-10T23:33:55.954 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72067.log 2024-09-10T23:33:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72067.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72067.log.gz 2024-09-10T23:33:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89248.log 2024-09-10T23:33:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89248.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89248.log.gz 2024-09-10T23:33:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74712.log 2024-09-10T23:33:55.969 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T23:33:55.971 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89038.log 2024-09-10T23:33:55.971 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74712.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74712.log.gz 2024-09-10T23:33:55.971 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89038.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89038.log.gz 2024-09-10T23:33:55.971 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77275.log 2024-09-10T23:33:55.976 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51447.log 2024-09-10T23:33:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77275.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77275.log.gz 2024-09-10T23:33:55.980 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71262.log 2024-09-10T23:33:55.981 INFO:teuthology.orchestra.run.smithi077.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T23:33:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51447.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51447.log.gz 2024-09-10T23:33:55.984 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34343.log 2024-09-10T23:33:55.985 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71262.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71262.log.gz 2024-09-10T23:33:55.988 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89170.log 2024-09-10T23:33:55.989 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34343.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34343.log.gz 2024-09-10T23:33:55.992 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72224.log 2024-09-10T23:33:55.993 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89170.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89170.log.gz 2024-09-10T23:33:55.996 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83986.log 2024-09-10T23:33:55.997 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72224.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72224.log.gz 2024-09-10T23:33:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83986.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83986.log.gz 2024-09-10T23:33:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73819.log 2024-09-10T23:33:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51676.log 2024-09-10T23:33:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73819.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73819.log.gz 2024-09-10T23:33:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91993.log 2024-09-10T23:33:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51676.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51676.log.gz 2024-09-10T23:33:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49416.log 2024-09-10T23:33:56.017 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91993.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91993.log.gz 2024-09-10T23:33:56.020 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28980.log 2024-09-10T23:33:56.021 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49416.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49416.log.gz 2024-09-10T23:33:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87796.log 2024-09-10T23:33:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28980.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28980.log.gz 2024-09-10T23:33:56.028 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91314.log 2024-09-10T23:33:56.029 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87796.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87796.log.gz 2024-09-10T23:33:56.033 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91314.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91314.log.gz 2024-09-10T23:33:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51397.log 2024-09-10T23:33:56.040 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53395.log 2024-09-10T23:33:56.042 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51397.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51397.log.gz 2024-09-10T23:33:56.044 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76642.log 2024-09-10T23:33:56.045 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53395.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53395.log.gz 2024-09-10T23:33:56.048 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83298.log 2024-09-10T23:33:56.050 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76642.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.76642.log.gz 2024-09-10T23:33:56.052 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79875.log 2024-09-10T23:33:56.053 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83298.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83298.log.gz 2024-09-10T23:33:56.056 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91839.log 2024-09-10T23:33:56.058 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79875.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.79875.log.gz 2024-09-10T23:33:56.060 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73559.log 2024-09-10T23:33:56.062 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91839.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.91839.log.gz 2024-09-10T23:33:56.064 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33761.log 2024-09-10T23:33:56.066 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73559.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.73559.log.gz 2024-09-10T23:33:56.069 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33761.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33761.log.gz 2024-09-10T23:33:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80527.log 2024-09-10T23:33:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35609.log 2024-09-10T23:33:56.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80527.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80527.log.gz 2024-09-10T23:33:56.080 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72120.log 2024-09-10T23:33:56.081 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35609.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35609.log.gz 2024-09-10T23:33:56.084 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34327.log 2024-09-10T23:33:56.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72120.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72120.log.gz 2024-09-10T23:33:56.088 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77841.log 2024-09-10T23:33:56.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34327.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34327.log.gz 2024-09-10T23:33:56.092 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76976.log 2024-09-10T23:33:56.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77841.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77841.log.gz 2024-09-10T23:33:56.096 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83552.log 2024-09-10T23:33:56.097 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76976.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76976.log.gz 2024-09-10T23:33:56.100 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92872.log 2024-09-10T23:33:56.101 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83552.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83552.log.gz 2024-09-10T23:33:56.105 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92872.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92872.log.gz 2024-09-10T23:33:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89281.log 2024-09-10T23:33:56.112 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33501.log 2024-09-10T23:33:56.113 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89281.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89281.log.gz 2024-09-10T23:33:56.116 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85820.log 2024-09-10T23:33:56.117 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33501.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33501.log.gz 2024-09-10T23:33:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87521.log 2024-09-10T23:33:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85820.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85820.log.gz 2024-09-10T23:33:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53267.log 2024-09-10T23:33:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87521.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.87521.log.gz 2024-09-10T23:33:56.128 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35557.log 2024-09-10T23:33:56.129 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53267.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53267.log.gz 2024-09-10T23:33:56.132 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92980.log 2024-09-10T23:33:56.133 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35557.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35557.log.gz 2024-09-10T23:33:56.137 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92980.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92980.log.gz 2024-09-10T23:33:56.139 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89378.log 2024-09-10T23:33:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33659.log 2024-09-10T23:33:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89378.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89378.log.gz 2024-09-10T23:33:56.148 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37023.log 2024-09-10T23:33:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33659.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33659.log.gz 2024-09-10T23:33:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80501.log 2024-09-10T23:33:56.156 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.37023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56064.log 2024-09-10T23:33:56.157 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80501.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80501.log.gz 2024-09-10T23:33:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56064.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56064.log.gz 2024-09-10T23:33:56.163 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28923.log 2024-09-10T23:33:56.168 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74502.log 2024-09-10T23:33:56.169 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28923.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28923.log.gz 2024-09-10T23:33:56.170 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35856.log 2024-09-10T23:33:56.172 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83473.log 2024-09-10T23:33:56.173 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35856.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35856.log.gz 2024-09-10T23:33:56.180 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74502.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74502.log.gz 2024-09-10T23:33:56.181 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36653.log 2024-09-10T23:33:56.182 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83473.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83473.log.gz 2024-09-10T23:33:56.184 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36891.log 2024-09-10T23:33:56.185 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36653.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36653.log.gz 2024-09-10T23:33:56.186 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83272.log 2024-09-10T23:33:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36891.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36891.log.gz 2024-09-10T23:33:56.193 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T23:33:56.194 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83272.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83272.log.gz 2024-09-10T23:33:56.199 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90279.log 2024-09-10T23:33:56.204 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71502.log 2024-09-10T23:33:56.205 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90279.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90279.log.gz 2024-09-10T23:33:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91610.log 2024-09-10T23:33:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71502.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71502.log.gz 2024-09-10T23:33:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86718.log 2024-09-10T23:33:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91610.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91610.log.gz 2024-09-10T23:33:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86718.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86718.log.gz 2024-09-10T23:33:56.219 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90626.log 2024-09-10T23:33:56.224 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90437.log 2024-09-10T23:33:56.225 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90626.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90626.log.gz 2024-09-10T23:33:56.228 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77919.log 2024-09-10T23:33:56.229 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90437.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90437.log.gz 2024-09-10T23:33:56.232 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49884.log 2024-09-10T23:33:56.233 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77919.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77919.log.gz 2024-09-10T23:33:56.236 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80853.log 2024-09-10T23:33:56.237 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49884.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49884.log.gz 2024-09-10T23:33:56.240 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92508.log 2024-09-10T23:33:56.241 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80853.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80853.log.gz 2024-09-10T23:33:56.244 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86640.log 2024-09-10T23:33:56.245 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92508.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92508.log.gz 2024-09-10T23:33:56.248 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71985.log 2024-09-10T23:33:56.249 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86640.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86640.log.gz 2024-09-10T23:33:56.253 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71985.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71985.log.gz 2024-09-10T23:33:56.255 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86614.log 2024-09-10T23:33:56.260 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33339.log 2024-09-10T23:33:56.261 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86614.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86614.log.gz 2024-09-10T23:33:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29404.log 2024-09-10T23:33:56.265 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33339.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33339.log.gz 2024-09-10T23:33:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90357.log 2024-09-10T23:33:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.29404.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29404.log.gz 2024-09-10T23:33:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83136.log 2024-09-10T23:33:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90357.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90357.log.gz 2024-09-10T23:33:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71155.log 2024-09-10T23:33:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83136.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83136.log.gz 2024-09-10T23:33:56.280 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83735.log 2024-09-10T23:33:56.282 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71155.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.71155.log.gz 2024-09-10T23:33:56.284 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50601.log 2024-09-10T23:33:56.285 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83735.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83735.log.gz 2024-09-10T23:33:56.291 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.50601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57425.log 2024-09-10T23:33:56.296 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89404.log 2024-09-10T23:33:56.297 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57425.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57425.log.gz 2024-09-10T23:33:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49384.log 2024-09-10T23:33:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89404.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89404.log.gz 2024-09-10T23:33:56.304 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86154.log 2024-09-10T23:33:56.305 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49384.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49384.log.gz 2024-09-10T23:33:56.308 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51828.log 2024-09-10T23:33:56.309 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86154.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86154.log.gz 2024-09-10T23:33:56.312 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88742.log 2024-09-10T23:33:56.314 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51828.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51828.log.gz 2024-09-10T23:33:56.316 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52755.log 2024-09-10T23:33:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88742.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88742.log.gz 2024-09-10T23:33:56.319 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49669.log 2024-09-10T23:33:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52755.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52755.log.gz 2024-09-10T23:33:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49669.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49669.log.gz 2024-09-10T23:33:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58452.log 2024-09-10T23:33:56.332 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49546.log 2024-09-10T23:33:56.333 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58452.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58452.log.gz 2024-09-10T23:33:56.336 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34754.log 2024-09-10T23:33:56.337 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49546.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49546.log.gz 2024-09-10T23:33:56.339 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57121.log 2024-09-10T23:33:56.344 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84194.log 2024-09-10T23:33:56.345 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34754.log.gz 2024-09-10T23:33:56.348 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.57121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51174.log 2024-09-10T23:33:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.84194.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84194.log.gz 2024-09-10T23:33:56.354 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51174.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51174.log.gz 2024-09-10T23:33:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87653.log 2024-09-10T23:33:56.360 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89144.log 2024-09-10T23:33:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87653.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87653.log.gz 2024-09-10T23:33:56.364 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90086.log 2024-09-10T23:33:56.365 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89144.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89144.log.gz 2024-09-10T23:33:56.368 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89669.log 2024-09-10T23:33:56.370 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90086.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.90086.log.gz 2024-09-10T23:33:56.372 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73851.log 2024-09-10T23:33:56.373 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89669.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89669.log.gz 2024-09-10T23:33:56.374 INFO:teuthology.orchestra.run.smithi017.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.57121.log.gz 2024-09-10T23:33:56.376 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55546.log 2024-09-10T23:33:56.377 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73851.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73851.log.gz 2024-09-10T23:33:56.380 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74133.log 2024-09-10T23:33:56.381 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55546.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55546.log.gz 2024-09-10T23:33:56.384 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91464.log 2024-09-10T23:33:56.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74133.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74133.log.gz 2024-09-10T23:33:56.389 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91464.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.91464.log.gz 2024-09-10T23:33:56.391 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34543.log 2024-09-10T23:33:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77667.log 2024-09-10T23:33:56.397 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34543.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34543.log.gz 2024-09-10T23:33:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81246.log 2024-09-10T23:33:56.401 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77667.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77667.log.gz 2024-09-10T23:33:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85457.log 2024-09-10T23:33:56.405 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81246.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81246.log.gz 2024-09-10T23:33:56.408 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89826.log 2024-09-10T23:33:56.409 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85457.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85457.log.gz 2024-09-10T23:33:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86180.log 2024-09-10T23:33:56.412 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89826.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89826.log.gz 2024-09-10T23:33:56.417 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86180.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86180.log.gz 2024-09-10T23:33:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77381.log 2024-09-10T23:33:56.424 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90489.log 2024-09-10T23:33:56.425 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77381.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77381.log.gz 2024-09-10T23:33:56.428 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74686.log 2024-09-10T23:33:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90489.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90489.log.gz 2024-09-10T23:33:56.432 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82712.log 2024-09-10T23:33:56.433 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74686.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74686.log.gz 2024-09-10T23:33:56.436 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50767.log 2024-09-10T23:33:56.437 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82712.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82712.log.gz 2024-09-10T23:33:56.440 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92357.log 2024-09-10T23:33:56.442 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50767.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50767.log.gz 2024-09-10T23:33:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36865.log 2024-09-10T23:33:56.445 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92357.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92357.log.gz 2024-09-10T23:33:56.448 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82894.log 2024-09-10T23:33:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36865.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36865.log.gz 2024-09-10T23:33:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82894.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82894.log.gz 2024-09-10T23:33:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51523.log 2024-09-10T23:33:56.460 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91053.log 2024-09-10T23:33:56.462 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51523.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51523.log.gz 2024-09-10T23:33:56.464 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71346.log 2024-09-10T23:33:56.465 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91053.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91053.log.gz 2024-09-10T23:33:56.468 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33153.log 2024-09-10T23:33:56.469 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71346.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71346.log.gz 2024-09-10T23:33:56.472 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56507.log 2024-09-10T23:33:56.473 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33153.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33153.log.gz 2024-09-10T23:33:56.476 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57532.log 2024-09-10T23:33:56.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56507.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56507.log.gz 2024-09-10T23:33:56.480 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53835.log 2024-09-10T23:33:56.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57532.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57532.log.gz 2024-09-10T23:33:56.484 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87970.log 2024-09-10T23:33:56.485 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53835.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53835.log.gz 2024-09-10T23:33:56.490 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87970.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87970.log.gz 2024-09-10T23:33:56.491 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56657.log 2024-09-10T23:33:56.496 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58951.log 2024-09-10T23:33:56.497 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56657.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56657.log.gz 2024-09-10T23:33:56.501 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58951.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58951.log.gz 2024-09-10T23:33:56.502 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80298.log 2024-09-10T23:33:56.504 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92846.log 2024-09-10T23:33:56.506 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80298.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80298.log.gz 2024-09-10T23:33:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50032.log 2024-09-10T23:33:56.510 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92846.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92846.log.gz 2024-09-10T23:33:56.513 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T23:33:56.513 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50032.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50032.log.gz 2024-09-10T23:33:56.519 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56685.log 2024-09-10T23:33:56.520 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92534.log 2024-09-10T23:33:56.522 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56685.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56685.log.gz 2024-09-10T23:33:56.524 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92664.log 2024-09-10T23:33:56.525 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92534.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92534.log.gz 2024-09-10T23:33:56.529 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92664.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.92664.log.gz 2024-09-10T23:33:56.531 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92305.log 2024-09-10T23:33:56.536 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74895.log 2024-09-10T23:33:56.537 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92305.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.92305.log.gz 2024-09-10T23:33:56.540 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36072.log 2024-09-10T23:33:56.541 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74895.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74895.log.gz 2024-09-10T23:33:56.544 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87262.log 2024-09-10T23:33:56.545 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36072.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36072.log.gz 2024-09-10T23:33:56.548 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35635.log 2024-09-10T23:33:56.549 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87262.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87262.log.gz 2024-09-10T23:33:56.552 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55248.log 2024-09-10T23:33:56.553 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35635.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35635.log.gz 2024-09-10T23:33:56.556 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52340.log 2024-09-10T23:33:56.558 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55248.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55248.log.gz 2024-09-10T23:33:56.560 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54497.log 2024-09-10T23:33:56.561 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52340.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52340.log.gz 2024-09-10T23:33:56.565 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54497.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54497.log.gz 2024-09-10T23:33:56.567 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77407.log 2024-09-10T23:33:56.572 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76820.log 2024-09-10T23:33:56.573 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77407.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77407.log.gz 2024-09-10T23:33:56.576 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80909.log 2024-09-10T23:33:56.577 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76820.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76820.log.gz 2024-09-10T23:33:56.580 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88638.log 2024-09-10T23:33:56.581 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80909.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80909.log.gz 2024-09-10T23:33:56.584 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51296.log 2024-09-10T23:33:56.586 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88638.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.88638.log.gz 2024-09-10T23:33:56.588 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74738.log 2024-09-10T23:33:56.590 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51296.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51296.log.gz 2024-09-10T23:33:56.592 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90658.log 2024-09-10T23:33:56.593 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74738.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74738.log.gz 2024-09-10T23:33:56.597 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90658.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90658.log.gz 2024-09-10T23:33:56.599 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87179.log 2024-09-10T23:33:56.607 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77355.log 2024-09-10T23:33:56.607 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87179.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.87179.log.gz 2024-09-10T23:33:56.608 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80168.log 2024-09-10T23:33:56.609 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77355.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77355.log.gz 2024-09-10T23:33:56.612 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53551.log 2024-09-10T23:33:56.613 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80168.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80168.log.gz 2024-09-10T23:33:56.616 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74159.log 2024-09-10T23:33:56.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53551.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53551.log.gz 2024-09-10T23:33:56.621 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74159.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74159.log.gz 2024-09-10T23:33:56.622 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49277.log 2024-09-10T23:33:56.623 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34134.log 2024-09-10T23:33:56.629 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54018.log 2024-09-10T23:33:56.629 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34134.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49277.log.gz 2024-09-10T23:33:56.629 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34134.log.gz 2024-09-10T23:33:56.630 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54018.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54018.log.gz 2024-09-10T23:33:56.631 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53081.log 2024-09-10T23:33:56.637 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53081.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53081.log.gz 2024-09-10T23:33:56.639 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57234.log 2024-09-10T23:33:56.640 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37071.log 2024-09-10T23:33:56.642 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57234.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57234.log.gz 2024-09-10T23:33:56.644 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91371.log 2024-09-10T23:33:56.645 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52283.log 2024-09-10T23:33:56.645 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37071.log.gz 2024-09-10T23:33:56.649 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91371.log: /var/log/ceph/ceph-client.admin.52283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57320.log 2024-09-10T23:33:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56539.log 2024-09-10T23:33:56.652 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.91371.log.gz 2024-09-10T23:33:56.653 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56539.log: /var/log/ceph/ceph-client.admin.57320.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56539.log.gz 2024-09-10T23:33:56.653 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57320.log.gz 2024-09-10T23:33:56.655 INFO:teuthology.orchestra.run.smithi017.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52283.log.gz 2024-09-10T23:33:56.659 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58614.log 2024-09-10T23:33:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76768.log 2024-09-10T23:33:56.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58614.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58614.log.gz 2024-09-10T23:33:56.668 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50125.log 2024-09-10T23:33:56.669 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76768.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76768.log.gz 2024-09-10T23:33:56.672 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85978.log 2024-09-10T23:33:56.673 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50125.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50125.log.gz 2024-09-10T23:33:56.676 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87914.log 2024-09-10T23:33:56.677 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85978.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85978.log.gz 2024-09-10T23:33:56.680 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77002.log 2024-09-10T23:33:56.682 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87914.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.87914.log.gz 2024-09-10T23:33:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80084.log 2024-09-10T23:33:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77002.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77002.log.gz 2024-09-10T23:33:56.688 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88048.log 2024-09-10T23:33:56.689 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80084.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80084.log.gz 2024-09-10T23:33:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88048.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88048.log.gz 2024-09-10T23:33:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93030.log 2024-09-10T23:33:56.696 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34336.log 2024-09-10T23:33:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.93030.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93030.log.gz 2024-09-10T23:33:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50389.log 2024-09-10T23:33:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34336.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34336.log.gz 2024-09-10T23:33:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50389.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50389.log.gz 2024-09-10T23:33:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57766.log 2024-09-10T23:33:56.710 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57766.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57766.log.gz 2024-09-10T23:33:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74764.log 2024-09-10T23:33:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34238.log 2024-09-10T23:33:56.718 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74764.log: /var/log/ceph/ceph-client.admin.34238.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34238.log.gz 2024-09-10T23:33:56.718 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49851.log 2024-09-10T23:33:56.719 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55488.log 2024-09-10T23:33:56.720 INFO:teuthology.orchestra.run.smithi017.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74764.log.gz 2024-09-10T23:33:56.720 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49851.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49851.log.gz 2024-09-10T23:33:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55488.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55488.log.gz 2024-09-10T23:33:56.727 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89984.log 2024-09-10T23:33:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88022.log 2024-09-10T23:33:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.89984.log: /var/log/ceph/ceph-client.admin.88022.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88022.log.gz 2024-09-10T23:33:56.739 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53293.log 2024-09-10T23:33:56.746 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33555.log 2024-09-10T23:33:56.746 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53293.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53293.log.gz 2024-09-10T23:33:56.748 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50207.log 2024-09-10T23:33:56.749 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33555.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33555.log.gz 2024-09-10T23:33:56.753 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50207.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50207.log.gz 2024-09-10T23:33:56.755 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87627.log 2024-09-10T23:33:56.760 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79773.log 2024-09-10T23:33:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87627.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87627.log.gz 2024-09-10T23:33:56.764 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86532.log 2024-09-10T23:33:56.766 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79773.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.79773.log.gz 2024-09-10T23:33:56.769 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86532.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.86532.log.gz 2024-09-10T23:33:56.771 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56830.log 2024-09-10T23:33:56.776 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57911.log 2024-09-10T23:33:56.778 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56830.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56830.log.gz 2024-09-10T23:33:56.780 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54603.log 2024-09-10T23:33:56.781 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57911.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57911.log.gz 2024-09-10T23:33:56.784 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49224.log 2024-09-10T23:33:56.785 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54603.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54603.log.gz 2024-09-10T23:33:56.788 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49643.log 2024-09-10T23:33:56.790 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49224.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49224.log.gz 2024-09-10T23:33:56.792 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77693.log 2024-09-10T23:33:56.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-10T23:33:56.793 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49643.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49643.log.gz 2024-09-10T23:33:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77693.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77693.log.gz 2024-09-10T23:33:56.799 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86389.log 2024-09-10T23:33:56.801 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.84251.log.gz 2024-09-10T23:33:56.804 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36458.log 2024-09-10T23:33:56.805 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86389.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86389.log.gz 2024-09-10T23:33:56.810 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36458.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36458.log.gz 2024-09-10T23:33:56.811 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81091.log 2024-09-10T23:33:56.816 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36098.log 2024-09-10T23:33:56.817 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81091.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81091.log.gz 2024-09-10T23:33:56.820 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36618.log 2024-09-10T23:33:56.821 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36098.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36098.log.gz 2024-09-10T23:33:56.824 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74868.log 2024-09-10T23:33:56.825 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36618.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36618.log.gz 2024-09-10T23:33:56.832 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74868.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74868.log.gz 2024-09-10T23:33:56.832 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56369.log 2024-09-10T23:33:56.836 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89695.log 2024-09-10T23:33:56.837 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56369.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56369.log.gz 2024-09-10T23:33:56.840 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90143.log 2024-09-10T23:33:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89695.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.89695.log.gz 2024-09-10T23:33:56.844 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56421.log 2024-09-10T23:33:56.845 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90143.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90143.log.gz 2024-09-10T23:33:56.849 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56421.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56421.log.gz 2024-09-10T23:33:56.851 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56774.log 2024-09-10T23:33:56.856 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77641.log 2024-09-10T23:33:56.857 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56774.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56774.log.gz 2024-09-10T23:33:56.860 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34755.log 2024-09-10T23:33:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77641.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77641.log.gz 2024-09-10T23:33:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34755.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34755.log.gz 2024-09-10T23:33:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58400.log 2024-09-10T23:33:56.872 INFO:teuthology.orchestra.run.smithi017.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.72356.log.gz 2024-09-10T23:33:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53018.log 2024-09-10T23:33:56.874 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58400.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58400.log.gz 2024-09-10T23:33:56.876 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.78156.log.gz 2024-09-10T23:33:56.877 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53018.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53018.log.gz 2024-09-10T23:33:56.879 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57321.log 2024-09-10T23:33:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74790.log 2024-09-10T23:33:56.885 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57321.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57321.log.gz 2024-09-10T23:33:56.888 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71710.log 2024-09-10T23:33:56.889 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74790.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74790.log.gz 2024-09-10T23:33:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71632.log 2024-09-10T23:33:56.893 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71710.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71710.log.gz 2024-09-10T23:33:56.896 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76486.log 2024-09-10T23:33:56.897 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71632.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71632.log.gz 2024-09-10T23:33:56.901 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76486.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76486.log.gz 2024-09-10T23:33:56.903 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53968.log 2024-09-10T23:33:56.908 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55581.log 2024-09-10T23:33:56.910 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53968.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53968.log.gz 2024-09-10T23:33:56.912 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35499.log 2024-09-10T23:33:56.913 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55581.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55581.log.gz 2024-09-10T23:33:56.916 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81169.log 2024-09-10T23:33:56.917 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35499.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35499.log.gz 2024-09-10T23:33:56.920 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53345.log 2024-09-10T23:33:56.921 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81169.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81169.log.gz 2024-09-10T23:33:56.928 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88100.log 2024-09-10T23:33:56.930 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53345.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53345.log.gz 2024-09-10T23:33:56.932 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71003.log 2024-09-10T23:33:56.933 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88100.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88100.log.gz 2024-09-10T23:33:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71743.log 2024-09-10T23:33:56.938 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71003.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71003.log.gz 2024-09-10T23:33:56.940 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79723.log 2024-09-10T23:33:56.941 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71743.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71743.log.gz 2024-09-10T23:33:56.944 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88411.log 2024-09-10T23:33:56.946 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79723.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.79723.log.gz 2024-09-10T23:33:56.948 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91181.log 2024-09-10T23:33:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88411.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88411.log.gz 2024-09-10T23:33:56.953 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91181.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91181.log.gz 2024-09-10T23:33:56.955 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88798.log 2024-09-10T23:33:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58640.log 2024-09-10T23:33:56.961 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88798.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88798.log.gz 2024-09-10T23:33:56.964 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84066.log 2024-09-10T23:33:56.965 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58640.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58640.log.gz 2024-09-10T23:33:56.968 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92820.log 2024-09-10T23:33:56.970 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.84066.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.84066.log.gz 2024-09-10T23:33:56.972 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78023.log 2024-09-10T23:33:56.974 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92820.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92820.log.gz 2024-09-10T23:33:56.976 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92156.log 2024-09-10T23:33:56.977 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.78023.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78023.log.gz 2024-09-10T23:33:56.980 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74211.log 2024-09-10T23:33:56.981 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92156.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92156.log.gz 2024-09-10T23:33:56.984 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88467.log 2024-09-10T23:33:56.985 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74211.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74211.log.gz 2024-09-10T23:33:56.991 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.88467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50259.log 2024-09-10T23:33:56.996 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80553.log 2024-09-10T23:33:56.997 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50259.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50259.log.gz 2024-09-10T23:33:56.999 INFO:teuthology.orchestra.run.smithi017.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.0.88467.log.gz 2024-09-10T23:33:57.000 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87764.log 2024-09-10T23:33:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80553.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80553.log.gz 2024-09-10T23:33:57.002 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91027.log 2024-09-10T23:33:57.005 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91027.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91027.log.gz 2024-09-10T23:33:57.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87764.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87764.log.gz 2024-09-10T23:33:57.011 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34545.log 2024-09-10T23:33:57.016 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T23:33:57.017 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34545.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34545.log.gz 2024-09-10T23:33:57.020 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49174.log 2024-09-10T23:33:57.024 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33475.log 2024-09-10T23:33:57.026 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49174.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49174.log.gz 2024-09-10T23:33:57.028 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92331.log 2024-09-10T23:33:57.029 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33475.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33475.log.gz 2024-09-10T23:33:57.031 INFO:teuthology.orchestra.run.smithi017.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T23:33:57.032 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90175.log 2024-09-10T23:33:57.033 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92331.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.92331.log.gz 2024-09-10T23:33:57.036 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57989.log 2024-09-10T23:33:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90175.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90175.log.gz 2024-09-10T23:33:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34732.log 2024-09-10T23:33:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57989.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57989.log.gz 2024-09-10T23:33:57.045 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34732.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34732.log.gz 2024-09-10T23:33:57.047 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34160.log 2024-09-10T23:33:57.052 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57963.log 2024-09-10T23:33:57.053 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34160.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34160.log.gz 2024-09-10T23:33:57.056 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89747.log 2024-09-10T23:33:57.057 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57963.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57963.log.gz 2024-09-10T23:33:57.060 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52625.log 2024-09-10T23:33:57.061 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89747.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89747.log.gz 2024-09-10T23:33:57.064 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80116.log 2024-09-10T23:33:57.065 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52625.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52625.log.gz 2024-09-10T23:33:57.068 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86127.log 2024-09-10T23:33:57.069 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80116.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80116.log.gz 2024-09-10T23:33:57.070 INFO:teuthology.orchestra.run.smithi017.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.75027.log.gz 2024-09-10T23:33:57.072 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92794.log 2024-09-10T23:33:57.073 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86127.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86127.log.gz 2024-09-10T23:33:57.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92794.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92794.log.gz 2024-09-10T23:33:57.079 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74185.log 2024-09-10T23:33:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33581.log 2024-09-10T23:33:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74185.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74185.log.gz 2024-09-10T23:33:57.088 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90804.log 2024-09-10T23:33:57.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33581.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33581.log.gz 2024-09-10T23:33:57.092 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36432.log 2024-09-10T23:33:57.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90804.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90804.log.gz 2024-09-10T23:33:57.096 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91490.log 2024-09-10T23:33:57.097 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36432.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36432.log.gz 2024-09-10T23:33:57.100 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83220.log 2024-09-10T23:33:57.101 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91490.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91490.log.gz 2024-09-10T23:33:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34340.log 2024-09-10T23:33:57.105 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83220.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83220.log.gz 2024-09-10T23:33:57.108 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54525.log 2024-09-10T23:33:57.109 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34340.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34340.log.gz 2024-09-10T23:33:57.113 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54525.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54525.log.gz 2024-09-10T23:33:57.115 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54070.log 2024-09-10T23:33:57.120 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91686.log 2024-09-10T23:33:57.121 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54070.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54070.log.gz 2024-09-10T23:33:57.124 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71053.log 2024-09-10T23:33:57.126 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91686.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.91686.log.gz 2024-09-10T23:33:57.128 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51221.log 2024-09-10T23:33:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71053.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71053.log.gz 2024-09-10T23:33:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87731.log 2024-09-10T23:33:57.133 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51221.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51221.log.gz 2024-09-10T23:33:57.136 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91736.log 2024-09-10T23:33:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87731.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87731.log.gz 2024-09-10T23:33:57.140 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90463.log 2024-09-10T23:33:57.142 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91736.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.91736.log.gz 2024-09-10T23:33:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71450.log 2024-09-10T23:33:57.145 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90463.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90463.log.gz 2024-09-10T23:33:57.149 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71450.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71450.log.gz 2024-09-10T23:33:57.151 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50441.log 2024-09-10T23:33:57.156 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53163.log 2024-09-10T23:33:57.157 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50441.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50441.log.gz 2024-09-10T23:33:57.160 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51881.log 2024-09-10T23:33:57.161 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53163.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53163.log.gz 2024-09-10T23:33:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80961.log 2024-09-10T23:33:57.166 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51881.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51881.log.gz 2024-09-10T23:33:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89721.log 2024-09-10T23:33:57.169 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80961.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80961.log.gz 2024-09-10T23:33:57.172 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84012.log 2024-09-10T23:33:57.173 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89721.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89721.log.gz 2024-09-10T23:33:57.176 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80395.log 2024-09-10T23:33:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.84012.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84012.log.gz 2024-09-10T23:33:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54348.log 2024-09-10T23:33:57.181 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80395.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80395.log.gz 2024-09-10T23:33:57.185 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54348.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54348.log.gz 2024-09-10T23:33:57.187 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89617.log 2024-09-10T23:33:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72250.log 2024-09-10T23:33:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89617.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89617.log.gz 2024-09-10T23:33:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91424.log 2024-09-10T23:33:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72250.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.72250.log.gz 2024-09-10T23:33:57.200 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33685.log 2024-09-10T23:33:57.201 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91424.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91424.log.gz 2024-09-10T23:33:57.204 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83787.log 2024-09-10T23:33:57.205 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33685.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33685.log.gz 2024-09-10T23:33:57.208 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86666.log 2024-09-10T23:33:57.209 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83787.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83787.log.gz 2024-09-10T23:33:57.212 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36176.log 2024-09-10T23:33:57.214 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86666.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86666.log.gz 2024-09-10T23:33:57.214 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36176.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36176.log.gz 2024-09-10T23:33:57.215 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53737.log 2024-09-10T23:33:57.220 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54551.log 2024-09-10T23:33:57.221 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53737.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53737.log.gz 2024-09-10T23:33:57.224 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36536.log 2024-09-10T23:33:57.225 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54551.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54551.log.gz 2024-09-10T23:33:57.228 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55013.log 2024-09-10T23:33:57.229 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36536.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36536.log.gz 2024-09-10T23:33:57.232 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52963.log 2024-09-10T23:33:57.233 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55013.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55013.log.gz 2024-09-10T23:33:57.237 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52963.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52963.log.gz 2024-09-10T23:33:57.240 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28986.log 2024-09-10T23:33:57.244 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57833.log 2024-09-10T23:33:57.245 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28986.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28986.log.gz 2024-09-10T23:33:57.248 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34108.log 2024-09-10T23:33:57.249 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57833.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57833.log.gz 2024-09-10T23:33:57.251 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72172.log 2024-09-10T23:33:57.252 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34108.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34108.log.gz 2024-09-10T23:33:57.256 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82562.log 2024-09-10T23:33:57.257 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72172.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72172.log.gz 2024-09-10T23:33:57.263 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89430.log 2024-09-10T23:33:57.263 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82562.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82562.log.gz 2024-09-10T23:33:57.263 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52599.log 2024-09-10T23:33:57.264 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89430.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89430.log.gz 2024-09-10T23:33:57.268 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83246.log 2024-09-10T23:33:57.269 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52599.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52599.log.gz 2024-09-10T23:33:57.273 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83246.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83246.log.gz 2024-09-10T23:33:57.275 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57064.log 2024-09-10T23:33:57.280 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34966.log 2024-09-10T23:33:57.281 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57064.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57064.log.gz 2024-09-10T23:33:57.284 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52989.log 2024-09-10T23:33:57.285 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34966.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34966.log.gz 2024-09-10T23:33:57.286 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53732.log 2024-09-10T23:33:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52989.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52989.log.gz 2024-09-10T23:33:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33391.log 2024-09-10T23:33:57.293 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53732.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53732.log.gz 2024-09-10T23:33:57.297 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33391.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33391.log.gz 2024-09-10T23:33:57.299 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84144.log 2024-09-10T23:33:57.304 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92612.log 2024-09-10T23:33:57.306 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.84144.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.84144.log.gz 2024-09-10T23:33:57.308 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83960.log 2024-09-10T23:33:57.310 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92612.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92612.log.gz 2024-09-10T23:33:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74971.log 2024-09-10T23:33:57.313 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83960.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83960.log.gz 2024-09-10T23:33:57.316 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85535.log 2024-09-10T23:33:57.317 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74971.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74971.log.gz 2024-09-10T23:33:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92638.log 2024-09-10T23:33:57.321 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85535.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.85535.log.gz 2024-09-10T23:33:57.325 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92638.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92638.log.gz 2024-09-10T23:33:57.327 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56220.log 2024-09-10T23:33:57.332 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35072.log 2024-09-10T23:33:57.333 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56220.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56220.log.gz 2024-09-10T23:33:57.336 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51933.log 2024-09-10T23:33:57.339 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35072.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35072.log.gz 2024-09-10T23:33:57.339 INFO:teuthology.orchestra.run.smithi017.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.81302.log.gz 2024-09-10T23:33:57.339 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90385.log 2024-09-10T23:33:57.340 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51933.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51933.log.gz 2024-09-10T23:33:57.343 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88074.log 2024-09-10T23:33:57.345 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90385.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90385.log.gz 2024-09-10T23:33:57.348 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51626.log 2024-09-10T23:33:57.349 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88074.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88074.log.gz 2024-09-10T23:33:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49327.log 2024-09-10T23:33:57.354 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51626.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51626.log.gz 2024-09-10T23:33:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49327.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49327.log.gz 2024-09-10T23:33:57.359 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89591.log 2024-09-10T23:33:57.364 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87996.log 2024-09-10T23:33:57.365 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89591.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89591.log.gz 2024-09-10T23:33:57.368 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83194.log 2024-09-10T23:33:57.369 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87996.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87996.log.gz 2024-09-10T23:33:57.372 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56713.log 2024-09-10T23:33:57.373 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83194.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83194.log.gz 2024-09-10T23:33:57.376 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79415.log 2024-09-10T23:33:57.378 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56713.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56713.log.gz 2024-09-10T23:33:57.380 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91516.log 2024-09-10T23:33:57.382 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79415.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.79415.log.gz 2024-09-10T23:33:57.384 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76434.log 2024-09-10T23:33:57.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91516.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91516.log.gz 2024-09-10T23:33:57.388 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34030.log 2024-09-10T23:33:57.389 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76434.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76434.log.gz 2024-09-10T23:33:57.393 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34030.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34030.log.gz 2024-09-10T23:33:57.395 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79925.log 2024-09-10T23:33:57.400 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87320.log 2024-09-10T23:33:57.402 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79925.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.79925.log.gz 2024-09-10T23:33:57.404 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76382.log 2024-09-10T23:33:57.405 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87320.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87320.log.gz 2024-09-10T23:33:57.407 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51017.log 2024-09-10T23:33:57.408 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76382.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76382.log.gz 2024-09-10T23:33:57.412 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34004.log 2024-09-10T23:33:57.414 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51017.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51017.log.gz 2024-09-10T23:33:57.416 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54374.log 2024-09-10T23:33:57.417 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34004.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34004.log.gz 2024-09-10T23:33:57.419 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58535.log 2024-09-10T23:33:57.423 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54374.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54374.log.gz 2024-09-10T23:33:57.425 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58535.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58535.log.gz 2024-09-10T23:33:57.427 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55732.log 2024-09-10T23:33:57.432 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80194.log 2024-09-10T23:33:57.433 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55732.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55732.log.gz 2024-09-10T23:33:57.436 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54217.log 2024-09-10T23:33:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80194.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80194.log.gz 2024-09-10T23:33:57.439 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71476.log 2024-09-10T23:33:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50337.log 2024-09-10T23:33:57.444 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54217.log.gz 2024-09-10T23:33:57.445 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71476.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71476.log.gz 2024-09-10T23:33:57.449 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50337.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50337.log.gz 2024-09-10T23:33:57.451 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55583.log 2024-09-10T23:33:57.456 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82738.log 2024-09-10T23:33:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55583.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55583.log.gz 2024-09-10T23:33:57.460 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85634.log 2024-09-10T23:33:57.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82738.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.82738.log.gz 2024-09-10T23:33:57.463 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89118.log 2024-09-10T23:33:57.467 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85634.log: /var/log/ceph/ceph-client.admin.89118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88204.log 2024-09-10T23:33:57.468 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.85634.log.gz 2024-09-10T23:33:57.472 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89118.log.gz 2024-09-10T23:33:57.472 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89459.log 2024-09-10T23:33:57.473 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88204.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88204.log.gz 2024-09-10T23:33:57.476 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33365.log 2024-09-10T23:33:57.478 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89459.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89459.log.gz 2024-09-10T23:33:57.480 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85788.log 2024-09-10T23:33:57.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33365.log: 93.1% 87.7% -- replaced with /var/log/ceph/ceph-client.0.89984.log.gz 2024-09-10T23:33:57.482 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33365.log.gz 2024-09-10T23:33:57.483 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35583.log 2024-09-10T23:33:57.485 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85788.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56343.log 2024-09-10T23:33:57.486 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35583.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35583.log.gz 2024-09-10T23:33:57.486 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85788.log.gz 2024-09-10T23:33:57.489 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56343.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56343.log.gz 2024-09-10T23:33:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86771.log 2024-09-10T23:33:57.492 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77061.log 2024-09-10T23:33:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77061.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77061.log.gz 2024-09-10T23:33:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86771.log.gz 2024-09-10T23:33:57.496 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.92898.log 2024-09-10T23:33:57.499 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92898.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92898.log.gz 2024-09-10T23:33:57.499 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87229.log 2024-09-10T23:33:57.505 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87229.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.87229.log.gz 2024-09-10T23:33:57.505 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80709.log 2024-09-10T23:33:57.506 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80709.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80709.log.gz 2024-09-10T23:33:57.506 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53319.log 2024-09-10T23:33:57.511 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53319.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53319.log.gz 2024-09-10T23:33:57.511 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57686.log 2024-09-10T23:33:57.511 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57686.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57686.log.gz 2024-09-10T23:33:57.512 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92456.log 2024-09-10T23:33:57.514 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92456.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92456.log.gz 2024-09-10T23:33:57.515 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91554.log 2024-09-10T23:33:57.517 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91554.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91554.log.gz 2024-09-10T23:33:57.518 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77485.log 2024-09-10T23:33:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77485.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77485.log.gz 2024-09-10T23:33:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92383.log 2024-09-10T23:33:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92383.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92383.log.gz 2024-09-10T23:33:57.524 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89066.log 2024-09-10T23:33:57.527 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89066.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89066.log.gz 2024-09-10T23:33:57.527 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80449.log 2024-09-10T23:33:57.529 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80449.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80449.log.gz 2024-09-10T23:33:57.530 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90567.log 2024-09-10T23:33:57.533 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90567.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90567.log.gz 2024-09-10T23:33:57.533 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58587.log 2024-09-10T23:33:57.536 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58587.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58587.log.gz 2024-09-10T23:33:57.536 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52372.log 2024-09-10T23:33:57.539 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52372.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52372.log.gz 2024-09-10T23:33:57.539 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58303.log 2024-09-10T23:33:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52055.log 2024-09-10T23:33:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58303.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58303.log.gz 2024-09-10T23:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36761.log 2024-09-10T23:33:57.546 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52055.log.gz 2024-09-10T23:33:57.546 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34992.log 2024-09-10T23:33:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36761.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36761.log.gz 2024-09-10T23:33:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92950.log 2024-09-10T23:33:57.550 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92950.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.92950.log.gz 2024-09-10T23:33:57.552 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34992.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34992.log.gz 2024-09-10T23:33:57.552 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88335.log 2024-09-10T23:33:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88335.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88335.log.gz 2024-09-10T23:33:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78099.log 2024-09-10T23:33:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.78099.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78099.log.gz 2024-09-10T23:33:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34756.log 2024-09-10T23:33:57.563 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90975.log 2024-09-10T23:33:57.564 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34756.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34756.log.gz 2024-09-10T23:33:57.564 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90975.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90975.log.gz 2024-09-10T23:33:57.564 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79365.log 2024-09-10T23:33:57.566 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52703.log 2024-09-10T23:33:57.567 INFO:teuthology.orchestra.run.smithi017.stderr:gzip 91.0% -- replaced with /var/log/ceph/ceph-client.admin.79365.log.gz 2024-09-10T23:33:57.568 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52703.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.85483.log 2024-09-10T23:33:57.568 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52703.log.gz 2024-09-10T23:33:57.571 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85483.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85483.log.gz 2024-09-10T23:33:57.571 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71294.log 2024-09-10T23:33:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71294.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71294.log.gz 2024-09-10T23:33:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90919.log 2024-09-10T23:33:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73981.log 2024-09-10T23:33:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90919.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90919.log.gz 2024-09-10T23:33:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73981.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56631.log 2024-09-10T23:33:57.580 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73981.log.gz 2024-09-10T23:33:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56748.log 2024-09-10T23:33:57.585 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.56631.log: /var/log/ceph/ceph-client.admin.56748.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56631.log.gz 2024-09-10T23:33:57.585 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56748.log.gz 2024-09-10T23:33:57.585 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.57264.log 2024-09-10T23:33:57.587 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88540.log 2024-09-10T23:33:57.588 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57264.log.gz 2024-09-10T23:33:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34344.log 2024-09-10T23:33:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34344.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34344.log.gz 2024-09-10T23:33:57.595 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88540.log.gz 2024-09-10T23:33:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35911.log 2024-09-10T23:33:57.598 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35911.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35911.log.gz 2024-09-10T23:33:57.598 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T23:33:57.603 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33889.log 2024-09-10T23:33:57.606 INFO:teuthology.orchestra.run.smithi017.stderr: 89.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80272.log 2024-09-10T23:33:57.608 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33889.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T23:33:57.609 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80272.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.33889.log.gz 2024-09-10T23:33:57.610 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T23:33:57.611 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80272.log.gz 2024-09-10T23:33:57.612 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54577.log 2024-09-10T23:33:57.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56142.log 2024-09-10T23:33:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54577.log: /var/log/ceph/ceph-client.admin.56142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56395.log 2024-09-10T23:33:57.620 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54577.log.gz 2024-09-10T23:33:57.620 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56142.log.gz 2024-09-10T23:33:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80246.log 2024-09-10T23:33:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56395.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56395.log.gz 2024-09-10T23:33:57.627 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71580.log 2024-09-10T23:33:57.628 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80246.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80246.log.gz 2024-09-10T23:33:57.629 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57608.log 2024-09-10T23:33:57.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71580.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71580.log.gz 2024-09-10T23:33:57.632 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52476.log 2024-09-10T23:33:57.633 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57608.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57608.log.gz 2024-09-10T23:33:57.634 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58190.log 2024-09-10T23:33:57.636 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52476.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52476.log.gz 2024-09-10T23:33:57.640 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50717.log 2024-09-10T23:33:57.641 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58190.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58190.log.gz 2024-09-10T23:33:57.642 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76898.log 2024-09-10T23:33:57.644 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50717.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50717.log.gz 2024-09-10T23:33:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76898.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76898.log.gz 2024-09-10T23:33:57.655 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88126.log 2024-09-10T23:33:57.660 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34342.log 2024-09-10T23:33:57.661 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88126.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88126.log.gz 2024-09-10T23:33:57.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T23:33:57.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34342.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34342.log.gz 2024-09-10T23:33:57.666 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36839.log 2024-09-10T23:33:57.675 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87398.log 2024-09-10T23:33:57.677 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36839.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36839.log.gz 2024-09-10T23:33:57.680 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56317.log 2024-09-10T23:33:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87398.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87398.log.gz 2024-09-10T23:33:57.684 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35941.log 2024-09-10T23:33:57.685 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56317.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56317.log.gz 2024-09-10T23:33:57.688 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77093.log 2024-09-10T23:33:57.689 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35941.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35941.log.gz 2024-09-10T23:33:57.693 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77093.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77093.log.gz 2024-09-10T23:33:57.695 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88282.log 2024-09-10T23:33:57.700 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91105.log 2024-09-10T23:33:57.701 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88282.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88282.log.gz 2024-09-10T23:33:57.704 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34769.log 2024-09-10T23:33:57.705 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91105.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91105.log.gz 2024-09-10T23:33:57.708 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51726.log 2024-09-10T23:33:57.709 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34769.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34769.log.gz 2024-09-10T23:33:57.712 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88690.log 2024-09-10T23:33:57.713 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51726.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51726.log.gz 2024-09-10T23:33:57.716 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89092.log 2024-09-10T23:33:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88690.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.88690.log.gz 2024-09-10T23:33:57.720 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81013.log 2024-09-10T23:33:57.721 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89092.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89092.log.gz 2024-09-10T23:33:57.724 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36917.log 2024-09-10T23:33:57.725 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81013.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81013.log.gz 2024-09-10T23:33:57.730 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36917.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36917.log.gz 2024-09-10T23:33:57.731 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74473.log 2024-09-10T23:33:57.736 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74921.log 2024-09-10T23:33:57.737 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74473.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74473.log.gz 2024-09-10T23:33:57.741 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53643.log 2024-09-10T23:33:57.742 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34082.log 2024-09-10T23:33:57.742 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74921.log.gz 2024-09-10T23:33:57.743 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57634.log 2024-09-10T23:33:57.745 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34082.log: /var/log/ceph/ceph-client.admin.53643.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34082.log.gz 2024-09-10T23:33:57.745 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53643.log.gz 2024-09-10T23:33:57.748 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92130.log 2024-09-10T23:33:57.751 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91636.log 2024-09-10T23:33:57.751 INFO:teuthology.orchestra.run.smithi017.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57634.log.gz 2024-09-10T23:33:57.751 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92130.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92130.log.gz 2024-09-10T23:33:57.752 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71922.log 2024-09-10T23:33:57.754 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91636.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.91636.log.gz 2024-09-10T23:33:57.757 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71922.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71922.log.gz 2024-09-10T23:33:57.759 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82842.log 2024-09-10T23:33:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83637.log 2024-09-10T23:33:57.765 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82842.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82842.log.gz 2024-09-10T23:33:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53731.log 2024-09-10T23:33:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83637.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83637.log.gz 2024-09-10T23:33:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53451.log 2024-09-10T23:33:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53731.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53731.log.gz 2024-09-10T23:33:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76332.log 2024-09-10T23:33:57.780 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.53451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90749.log 2024-09-10T23:33:57.782 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76332.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.76332.log.gz 2024-09-10T23:33:57.784 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85950.log 2024-09-10T23:33:57.785 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90749.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90749.log.gz 2024-09-10T23:33:57.788 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80051.log 2024-09-10T23:33:57.789 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85950.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85950.log.gz 2024-09-10T23:33:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80051.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80051.log.gz 2024-09-10T23:33:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51473.log 2024-09-10T23:33:57.800 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52677.log 2024-09-10T23:33:57.802 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51473.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51473.log.gz 2024-09-10T23:33:57.804 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90411.log 2024-09-10T23:33:57.805 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52677.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52677.log.gz 2024-09-10T23:33:57.808 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52554.log 2024-09-10T23:33:57.809 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90411.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90411.log.gz 2024-09-10T23:33:57.812 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54931.log 2024-09-10T23:33:57.813 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52554.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52554.log.gz 2024-09-10T23:33:57.816 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56194.log 2024-09-10T23:33:57.817 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54931.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54931.log.gz 2024-09-10T23:33:57.820 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79515.log 2024-09-10T23:33:57.821 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56194.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56194.log.gz 2024-09-10T23:33:57.825 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79515.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79515.log.gz 2024-09-10T23:33:57.827 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56448.log 2024-09-10T23:33:57.832 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49468.log 2024-09-10T23:33:57.833 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56448.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56448.log.gz 2024-09-10T23:33:57.834 INFO:teuthology.orchestra.run.smithi017.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.53451.log.gz 2024-09-10T23:33:57.836 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36380.log 2024-09-10T23:33:57.837 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49468.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49468.log.gz 2024-09-10T23:33:57.840 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50151.log 2024-09-10T23:33:57.841 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36380.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36380.log.gz 2024-09-10T23:33:57.844 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88361.log 2024-09-10T23:33:57.845 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50151.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50151.log.gz 2024-09-10T23:33:57.848 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86584.log 2024-09-10T23:33:57.850 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88361.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.88361.log.gz 2024-09-10T23:33:57.852 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86692.log 2024-09-10T23:33:57.854 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86584.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86584.log.gz 2024-09-10T23:33:57.860 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86692.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.86692.log.gz 2024-09-10T23:33:57.861 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88960.log 2024-09-10T23:33:57.864 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35739.log 2024-09-10T23:33:57.865 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88960.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88960.log.gz 2024-09-10T23:33:57.868 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36202.log 2024-09-10T23:33:57.869 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35739.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35739.log.gz 2024-09-10T23:33:57.872 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35124.log 2024-09-10T23:33:57.873 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36202.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36202.log.gz 2024-09-10T23:33:57.876 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90253.log 2024-09-10T23:33:57.878 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35124.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35124.log.gz 2024-09-10T23:33:57.880 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79619.log 2024-09-10T23:33:57.881 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90253.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90253.log.gz 2024-09-10T23:33:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33421.log 2024-09-10T23:33:57.885 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79619.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79619.log.gz 2024-09-10T23:33:57.887 INFO:teuthology.orchestra.run.smithi017.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T23:33:57.888 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80879.log 2024-09-10T23:33:57.889 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33421.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33421.log.gz 2024-09-10T23:33:57.893 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80879.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80879.log.gz 2024-09-10T23:33:57.895 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91079.log 2024-09-10T23:33:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35449.log 2024-09-10T23:33:57.901 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91079.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.91079.log.gz 2024-09-10T23:33:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83021.log 2024-09-10T23:33:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.2.35449.log: 89.8% -- replaced with /var/log/ceph/ceph-client.2.35449.log.gz 2024-09-10T23:33:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54896.log 2024-09-10T23:33:57.910 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83021.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83021.log.gz 2024-09-10T23:33:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77544.log 2024-09-10T23:33:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54896.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54896.log.gz 2024-09-10T23:33:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58847.log 2024-09-10T23:33:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77544.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77544.log.gz 2024-09-10T23:33:57.920 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50967.log 2024-09-10T23:33:57.923 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58847.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58847.log.gz 2024-09-10T23:33:57.924 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82612.log 2024-09-10T23:33:57.926 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50967.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50967.log.gz 2024-09-10T23:33:57.930 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82612.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82612.log.gz 2024-09-10T23:33:57.931 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77303.log 2024-09-10T23:33:57.936 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73710.log 2024-09-10T23:33:57.937 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77303.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77303.log.gz 2024-09-10T23:33:57.940 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82924.log 2024-09-10T23:33:57.942 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73710.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.73710.log.gz 2024-09-10T23:33:57.944 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57558.log 2024-09-10T23:33:57.945 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82924.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82924.log.gz 2024-09-10T23:33:57.948 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85732.log 2024-09-10T23:33:57.950 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57558.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57558.log.gz 2024-09-10T23:33:57.952 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88908.log 2024-09-10T23:33:57.954 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85732.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.85732.log.gz 2024-09-10T23:33:57.956 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87679.log 2024-09-10T23:33:57.957 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88908.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88908.log.gz 2024-09-10T23:33:57.960 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52807.log 2024-09-10T23:33:57.961 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87679.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87679.log.gz 2024-09-10T23:33:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52807.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52807.log.gz 2024-09-10T23:33:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29259.log 2024-09-10T23:33:57.975 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90331.log 2024-09-10T23:33:57.975 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.29259.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29259.log.gz 2024-09-10T23:33:57.976 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80142.log 2024-09-10T23:33:57.977 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90331.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90331.log.gz 2024-09-10T23:33:57.980 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28893.log 2024-09-10T23:33:57.981 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80142.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80142.log.gz 2024-09-10T23:33:57.984 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86847.log 2024-09-10T23:33:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28893.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28893.log.gz 2024-09-10T23:33:57.988 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79697.log 2024-09-10T23:33:57.989 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86847.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86847.log.gz 2024-09-10T23:33:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55274.log 2024-09-10T23:33:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79697.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79697.log.gz 2024-09-10T23:33:57.996 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87888.log 2024-09-10T23:33:57.997 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55274.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55274.log.gz 2024-09-10T23:33:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87888.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87888.log.gz 2024-09-10T23:33:58.003 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53189.log 2024-09-10T23:33:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85924.log 2024-09-10T23:33:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53189.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53189.log.gz 2024-09-10T23:33:58.012 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87001.log 2024-09-10T23:33:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85924.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85924.log.gz 2024-09-10T23:33:58.016 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28815.log 2024-09-10T23:33:58.017 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87001.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87001.log.gz 2024-09-10T23:33:58.020 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79541.log 2024-09-10T23:33:58.021 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28815.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.28815.log.gz 2024-09-10T23:33:58.024 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54983.log 2024-09-10T23:33:58.025 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79541.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79541.log.gz 2024-09-10T23:33:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74608.log 2024-09-10T23:33:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54983.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54983.log.gz 2024-09-10T23:33:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74608.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74608.log.gz 2024-09-10T23:33:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54471.log 2024-09-10T23:33:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77750.log 2024-09-10T23:33:58.043 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54471.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54471.log.gz 2024-09-10T23:33:58.044 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83578.log 2024-09-10T23:33:58.045 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77750.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77750.log.gz 2024-09-10T23:33:58.047 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36735.log 2024-09-10T23:33:58.052 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83578.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83578.log.gz 2024-09-10T23:33:58.052 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80987.log 2024-09-10T23:33:58.053 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36735.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36735.log.gz 2024-09-10T23:33:58.057 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80987.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.80987.log.gz 2024-09-10T23:33:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54957.log 2024-09-10T23:33:58.064 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92768.log 2024-09-10T23:33:58.065 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54957.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54957.log.gz 2024-09-10T23:33:58.068 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86101.log 2024-09-10T23:33:58.069 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92768.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92768.log.gz 2024-09-10T23:33:58.071 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80423.log 2024-09-10T23:33:58.076 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86101.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71205.log 2024-09-10T23:33:58.077 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80423.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80423.log.gz 2024-09-10T23:33:58.079 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86101.log.gz 2024-09-10T23:33:58.082 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71205.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71205.log.gz 2024-09-10T23:33:58.083 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54150.log 2024-09-10T23:33:58.088 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28990.log 2024-09-10T23:33:58.089 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54150.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54150.log.gz 2024-09-10T23:33:58.092 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73903.log 2024-09-10T23:33:58.093 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28990.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28990.log.gz 2024-09-10T23:33:58.096 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50415.log 2024-09-10T23:33:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73903.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73903.log.gz 2024-09-10T23:33:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53938.log 2024-09-10T23:33:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50415.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50415.log.gz 2024-09-10T23:33:58.104 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79645.log 2024-09-10T23:33:58.105 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53938.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53938.log.gz 2024-09-10T23:33:58.108 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53137.log 2024-09-10T23:33:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79645.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79645.log.gz 2024-09-10T23:33:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86049.log 2024-09-10T23:33:58.113 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53137.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53137.log.gz 2024-09-10T23:33:58.117 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86049.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86049.log.gz 2024-09-10T23:33:58.119 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56858.log 2024-09-10T23:33:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2024-09-10T23:33:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56858.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56858.log.gz 2024-09-10T23:33:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77119.log 2024-09-10T23:33:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.29008.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2024-09-10T23:33:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58270.log 2024-09-10T23:33:58.133 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77119.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77119.log.gz 2024-09-10T23:33:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58270.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58270.log.gz 2024-09-10T23:33:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82868.log 2024-09-10T23:33:58.144 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58903.log 2024-09-10T23:33:58.145 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.82868.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82868.log.gz 2024-09-10T23:33:58.148 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54322.log 2024-09-10T23:33:58.152 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.58903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86558.log 2024-09-10T23:33:58.153 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54322.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54322.log.gz 2024-09-10T23:33:58.156 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53675.log 2024-09-10T23:33:58.157 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86558.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86558.log.gz 2024-09-10T23:33:58.160 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80343.log 2024-09-10T23:33:58.162 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53675.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53675.log.gz 2024-09-10T23:33:58.165 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80343.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80343.log.gz 2024-09-10T23:33:58.167 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76846.log 2024-09-10T23:33:58.172 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92716.log 2024-09-10T23:33:58.173 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76846.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76846.log.gz 2024-09-10T23:33:58.176 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36254.log 2024-09-10T23:33:58.177 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92716.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92716.log.gz 2024-09-10T23:33:58.180 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83077.log 2024-09-10T23:33:58.181 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36254.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36254.log.gz 2024-09-10T23:33:58.184 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57207.log 2024-09-10T23:33:58.185 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83077.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83077.log.gz 2024-09-10T23:33:58.188 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72037.log 2024-09-10T23:33:58.189 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57207.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57207.log.gz 2024-09-10T23:33:58.192 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92019.log 2024-09-10T23:33:58.193 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72037.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72037.log.gz 2024-09-10T23:33:58.196 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58770.log 2024-09-10T23:33:58.198 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92019.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92019.log.gz 2024-09-10T23:33:58.201 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58770.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58770.log.gz 2024-09-10T23:33:58.203 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91001.log 2024-09-10T23:33:58.208 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76408.log 2024-09-10T23:33:58.209 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91001.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91001.log.gz 2024-09-10T23:33:58.212 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83350.log 2024-09-10T23:33:58.213 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76408.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76408.log.gz 2024-09-10T23:33:58.216 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51577.log 2024-09-10T23:33:58.217 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83350.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83350.log.gz 2024-09-10T23:33:58.220 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74530.log 2024-09-10T23:33:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51577.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51577.log.gz 2024-09-10T23:33:58.224 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55222.log 2024-09-10T23:33:58.225 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74530.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74530.log.gz 2024-09-10T23:33:58.228 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51069.log 2024-09-10T23:33:58.229 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55222.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55222.log.gz 2024-09-10T23:33:58.234 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51069.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51069.log.gz 2024-09-10T23:33:58.235 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52651.log 2024-09-10T23:33:58.240 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78049.log 2024-09-10T23:33:58.241 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52651.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52651.log.gz 2024-09-10T23:33:58.244 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74816.log 2024-09-10T23:33:58.246 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.78049.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.78049.log.gz 2024-09-10T23:33:58.248 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74634.log 2024-09-10T23:33:58.249 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74816.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74816.log.gz 2024-09-10T23:33:58.252 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85683.log 2024-09-10T23:33:58.253 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74634.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74634.log.gz 2024-09-10T23:33:58.256 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35310.log 2024-09-10T23:33:58.258 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.85683.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.85683.log.gz 2024-09-10T23:33:58.260 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55065.log 2024-09-10T23:33:58.262 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.35310.log: 89.8% -- replaced with /var/log/ceph/ceph-client.0.35310.log.gz 2024-09-10T23:33:58.264 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29013.log 2024-09-10T23:33:58.265 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55065.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55065.log.gz 2024-09-10T23:33:58.269 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.29013.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29013.log.gz 2024-09-10T23:33:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86441.log 2024-09-10T23:33:58.276 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52872.log 2024-09-10T23:33:58.277 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86441.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86441.log.gz 2024-09-10T23:33:58.280 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88856.log 2024-09-10T23:33:58.281 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52872.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52872.log.gz 2024-09-10T23:33:58.284 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80683.log 2024-09-10T23:33:58.285 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88856.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88856.log.gz 2024-09-10T23:33:58.288 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50233.log 2024-09-10T23:33:58.289 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80683.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80683.log.gz 2024-09-10T23:33:58.292 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71320.log 2024-09-10T23:33:58.293 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50233.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50233.log.gz 2024-09-10T23:33:58.296 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77511.log 2024-09-10T23:33:58.297 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71320.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71320.log.gz 2024-09-10T23:33:58.300 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35968.log 2024-09-10T23:33:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77511.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77511.log.gz 2024-09-10T23:33:58.305 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35968.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35968.log.gz 2024-09-10T23:33:58.307 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83930.log 2024-09-10T23:33:58.312 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55300.log 2024-09-10T23:33:58.313 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83930.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83930.log.gz 2024-09-10T23:33:58.316 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56962.log 2024-09-10T23:33:58.318 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55300.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55300.log.gz 2024-09-10T23:33:58.320 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88588.log 2024-09-10T23:33:58.321 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56962.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56962.log.gz 2024-09-10T23:33:58.324 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80475.log 2024-09-10T23:33:58.326 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88588.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.88588.log.gz 2024-09-10T23:33:58.328 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35884.log 2024-09-10T23:33:58.329 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80475.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80475.log.gz 2024-09-10T23:33:58.332 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33947.log 2024-09-10T23:33:58.333 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35884.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35884.log.gz 2024-09-10T23:33:58.336 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90201.log 2024-09-10T23:33:58.337 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33947.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33947.log.gz 2024-09-10T23:33:58.341 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90201.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90201.log.gz 2024-09-10T23:33:58.343 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80618.log 2024-09-10T23:33:58.348 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71684.log 2024-09-10T23:33:58.349 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80618.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80618.log.gz 2024-09-10T23:33:58.352 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79823.log 2024-09-10T23:33:58.353 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71684.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71684.log.gz 2024-09-10T23:33:58.356 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89487.log 2024-09-10T23:33:58.358 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.79823.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79823.log.gz 2024-09-10T23:33:58.360 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92690.log 2024-09-10T23:33:58.361 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89487.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89487.log.gz 2024-09-10T23:33:58.364 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83447.log 2024-09-10T23:33:58.365 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92690.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92690.log.gz 2024-09-10T23:33:58.369 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57937.log 2024-09-10T23:33:58.369 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83447.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83447.log.gz 2024-09-10T23:33:58.371 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80220.log 2024-09-10T23:33:58.372 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57937.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57937.log.gz 2024-09-10T23:33:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.80220.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80220.log.gz 2024-09-10T23:33:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55195.log 2024-09-10T23:33:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76924.log 2024-09-10T23:33:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55195.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55195.log.gz 2024-09-10T23:33:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91580.log 2024-09-10T23:33:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76924.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76924.log.gz 2024-09-10T23:33:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83878.log 2024-09-10T23:33:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91580.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91580.log.gz 2024-09-10T23:33:58.395 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86797.log 2024-09-10T23:33:58.397 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.83878.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83878.log.gz 2024-09-10T23:33:58.398 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74237.log 2024-09-10T23:33:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86797.log: /var/log/ceph/ceph-client.admin.74237.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74237.log.gz 2024-09-10T23:33:58.403 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91789.log 2024-09-10T23:33:58.404 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.86797.log.gz 2024-09-10T23:33:58.408 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58666.log 2024-09-10T23:33:58.409 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.91789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35661.log 2024-09-10T23:33:58.410 INFO:teuthology.orchestra.run.smithi017.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.91789.log.gz 2024-09-10T23:33:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58666.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58666.log.gz 2024-09-10T23:33:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76590.log 2024-09-10T23:33:58.413 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35661.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35661.log.gz 2024-09-10T23:33:58.414 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33633.log 2024-09-10T23:33:58.419 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76590.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76590.log.gz 2024-09-10T23:33:58.420 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58335.log 2024-09-10T23:33:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33633.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33633.log.gz 2024-09-10T23:33:58.424 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50311.log 2024-09-10T23:33:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58335.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58335.log.gz 2024-09-10T23:33:58.426 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90949.log 2024-09-10T23:33:58.428 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58216.log 2024-09-10T23:33:58.428 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50311.log.gz 2024-09-10T23:33:58.429 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.90949.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90949.log.gz 2024-09-10T23:33:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58216.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58216.log.gz 2024-09-10T23:33:58.435 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87346.log 2024-09-10T23:33:58.440 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49747.log 2024-09-10T23:33:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87346.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87346.log.gz 2024-09-10T23:33:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33240.log 2024-09-10T23:33:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49747.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49747.log.gz 2024-09-10T23:33:58.448 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58692.log 2024-09-10T23:33:58.449 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33240.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33240.log.gz 2024-09-10T23:33:58.452 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57716.log 2024-09-10T23:33:58.453 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58692.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58692.log.gz 2024-09-10T23:33:58.455 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73877.log 2024-09-10T23:33:58.457 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57716.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57716.log.gz 2024-09-10T23:33:58.461 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.73877.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73877.log.gz 2024-09-10T23:33:58.463 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55169.log 2024-09-10T23:33:58.468 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34739.log 2024-09-10T23:33:58.471 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.55169.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55169.log.gz 2024-09-10T23:33:58.472 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89313.log 2024-09-10T23:33:58.473 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34739.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34739.log.gz 2024-09-10T23:33:58.476 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81350.log 2024-09-10T23:33:58.477 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89313.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89313.log.gz 2024-09-10T23:33:58.480 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52107.log 2024-09-10T23:33:58.481 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81350.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81350.log.gz 2024-09-10T23:33:58.484 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49494.log 2024-09-10T23:33:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52107.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52107.log.gz 2024-09-10T23:33:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92430.log 2024-09-10T23:33:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49494.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49494.log.gz 2024-09-10T23:33:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29012.log 2024-09-10T23:33:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.92430.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92430.log.gz 2024-09-10T23:33:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.29012.log: -- /var/log/ceph/ceph-client.admin.87027.log 2024-09-10T23:33:58.496 INFO:teuthology.orchestra.run.smithi017.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29012.log.gz 2024-09-10T23:33:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.87027.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.87027.log.gz 2024-09-10T23:33:58.503 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.87372.log 2024-09-10T23:33:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54296.log 2024-09-10T23:33:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.87372.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87372.log.gz 2024-09-10T23:33:58.512 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50006.log 2024-09-10T23:33:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.54296.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54296.log.gz 2024-09-10T23:33:58.516 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56605.log 2024-09-10T23:33:58.517 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50006.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50006.log.gz 2024-09-10T23:33:58.520 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71606.log 2024-09-10T23:33:58.522 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56605.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56605.log.gz 2024-09-10T23:33:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76282.log 2024-09-10T23:33:58.526 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71606.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71606.log.gz 2024-09-10T23:33:58.528 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88934.log 2024-09-10T23:33:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76282.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.76282.log.gz 2024-09-10T23:33:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56090.log 2024-09-10T23:33:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88934.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88934.log.gz 2024-09-10T23:33:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56090.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56090.log.gz 2024-09-10T23:33:58.539 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34751.log 2024-09-10T23:33:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28960.log 2024-09-10T23:33:58.545 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34751.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34751.log.gz 2024-09-10T23:33:58.548 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74081.log 2024-09-10T23:33:58.549 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.28960.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28960.log.gz 2024-09-10T23:33:58.550 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86469.log 2024-09-10T23:33:58.552 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.74081.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74081.log.gz 2024-09-10T23:33:58.556 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50917.log 2024-09-10T23:33:58.557 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86469.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86469.log.gz 2024-09-10T23:33:58.558 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89196.log 2024-09-10T23:33:58.563 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50917.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50917.log.gz 2024-09-10T23:33:58.563 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89196.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89196.log.gz 2024-09-10T23:33:58.563 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84040.log 2024-09-10T23:33:58.568 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81117.log 2024-09-10T23:33:58.569 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.84040.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.84040.log.gz 2024-09-10T23:33:58.572 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2024-09-10T23:33:58.573 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.81117.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.81117.log.gz 2024-09-10T23:33:58.576 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51122.log 2024-09-10T23:33:58.577 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50062.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2024-09-10T23:33:58.580 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89852.log 2024-09-10T23:33:58.582 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.51122.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51122.log.gz 2024-09-10T23:33:58.584 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53733.log 2024-09-10T23:33:58.585 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89852.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89852.log.gz 2024-09-10T23:33:58.588 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76742.log 2024-09-10T23:33:58.589 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.53733.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53733.log.gz 2024-09-10T23:33:58.590 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56006.log 2024-09-10T23:33:58.592 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76742.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76742.log.gz 2024-09-10T23:33:58.596 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58138.log 2024-09-10T23:33:58.597 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56006.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56006.log.gz 2024-09-10T23:33:58.601 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58138.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58138.log.gz 2024-09-10T23:33:58.603 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86291.log 2024-09-10T23:33:58.608 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56291.log 2024-09-10T23:33:58.609 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.86291.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86291.log.gz 2024-09-10T23:33:58.612 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76692.log 2024-09-10T23:33:58.613 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56291.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56291.log.gz 2024-09-10T23:33:58.615 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71839.log 2024-09-10T23:33:58.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.76692.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.76692.log.gz 2024-09-10T23:33:58.620 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77459.log 2024-09-10T23:33:58.621 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.71839.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71839.log.gz 2024-09-10T23:33:58.624 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57859.log 2024-09-10T23:33:58.627 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77459.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77459.log.gz 2024-09-10T23:33:58.627 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77867.log 2024-09-10T23:33:58.629 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.77867.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77867.log.gz 2024-09-10T23:33:58.631 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34548.log 2024-09-10T23:33:58.632 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.57859.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57859.log.gz 2024-09-10T23:33:58.636 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50177.log 2024-09-10T23:33:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34548.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34548.log.gz 2024-09-10T23:33:58.640 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56265.log 2024-09-10T23:33:58.641 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50177.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50177.log.gz 2024-09-10T23:33:58.644 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52840.log 2024-09-10T23:33:58.645 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.56265.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56265.log.gz 2024-09-10T23:33:58.648 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72094.log 2024-09-10T23:33:58.649 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.52840.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52840.log.gz 2024-09-10T23:33:58.650 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58015.log 2024-09-10T23:33:58.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.72094.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72094.log.gz 2024-09-10T23:33:58.657 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.58015.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58015.log.gz 2024-09-10T23:33:58.659 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.89222.log 2024-09-10T23:33:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35098.log 2024-09-10T23:33:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.89222.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89222.log.gz 2024-09-10T23:33:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88178.log 2024-09-10T23:33:58.669 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35098.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35098.log.gz 2024-09-10T23:33:58.673 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.88178.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88178.log.gz 2024-09-10T23:33:59.442 INFO:teuthology.orchestra.run.smithi017.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.0.50601.log.gz 2024-09-10T23:34:00.906 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T23:34:01.446 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T23:34:02.394 INFO:teuthology.orchestra.run.smithi017.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T23:34:02.852 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T23:34:03.012 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T23:34:04.443 INFO:teuthology.orchestra.run.smithi017.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T23:34:04.585 INFO:teuthology.orchestra.run.smithi017.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T23:34:04.657 INFO:teuthology.orchestra.run.smithi017.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T23:34:04.940 INFO:teuthology.orchestra.run.smithi017.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.37023.log.gz 2024-09-10T23:34:06.060 INFO:teuthology.orchestra.run.smithi017.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T23:34:06.061 INFO:teuthology.orchestra.run.smithi017.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.58903.log.gz 2024-09-10T23:34:21.311 INFO:teuthology.orchestra.run.smithi077.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T23:34:21.313 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-10T23:34:21.313 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m25.954s 2024-09-10T23:34:21.313 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m50.161s 2024-09-10T23:34:21.313 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m3.816s 2024-09-10T23:34:30.418 INFO:teuthology.orchestra.run.smithi017.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T23:34:30.420 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-10T23:34:30.420 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m35.095s 2024-09-10T23:34:30.420 INFO:teuthology.orchestra.run.smithi017.stderr:user 1m32.187s 2024-09-10T23:34:30.420 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m7.635s 2024-09-10T23:34:30.421 INFO:tasks.ceph:Archiving logs... 2024-09-10T23:34:30.421 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775/remote/smithi017/log 2024-09-10T23:34:30.423 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:34:39.810 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775/remote/smithi077/log 2024-09-10T23:34:39.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T23:34:45.590 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T23:34:45.600 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T23:34:45.600 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:34:45.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T23:34:45.685 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T23:34:45.693 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T23:34:45.693 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:34:45.697 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T23:34:45.710 INFO:teuthology.orchestra.run.smithi017.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T23:34:45.710 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================== 2024-09-10T23:34:45.710 INFO:teuthology.orchestra.run.smithi017.stdout:*hv01.front.sepi 67.205.162.81 3 u 62 128 377 0.082 -0.712 0.140 2024-09-10T23:34:45.710 INFO:teuthology.orchestra.run.smithi017.stdout:+hv02.front.sepi 63.231.80.2 3 u 65 128 377 0.089 -1.191 0.180 2024-09-10T23:34:45.710 INFO:teuthology.orchestra.run.smithi017.stdout:+hv03.front.sepi 74.6.168.72 3 u 64 128 377 0.079 -0.656 0.291 2024-09-10T23:34:45.710 INFO:teuthology.orchestra.run.smithi017.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-10T23:34:45.712 INFO:teuthology.orchestra.run.smithi077.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T23:34:45.712 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================== 2024-09-10T23:34:45.712 INFO:teuthology.orchestra.run.smithi077.stdout:*hv01.front.sepi 67.205.162.81 3 u 2 64 377 0.109 -6.182 0.661 2024-09-10T23:34:45.712 INFO:teuthology.orchestra.run.smithi077.stdout:+hv02.front.sepi 63.231.80.2 3 u 4 64 377 0.088 -7.364 0.817 2024-09-10T23:34:45.712 INFO:teuthology.orchestra.run.smithi077.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.080 -5.385 1.069 2024-09-10T23:34:45.712 INFO:teuthology.orchestra.run.smithi077.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-10T23:34:45.713 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T23:34:45.732 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T23:34:45.732 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T23:34:45.781 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T23:34:45.831 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T23:34:45.882 INFO:teuthology.task.internal:Duration was 1887.335961 seconds 2024-09-10T23:34:45.882 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T23:34:45.933 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T23:34:45.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:34:45.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T23:34:46.038 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T23:34:46.038 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-10T23:34:46.038 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:34:46.059 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-09-10T23:34:46.059 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T23:34:46.079 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T23:34:46.079 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:34:46.110 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T23:34:46.163 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T23:34:46.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:34:46.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T23:34:46.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T23:34:46.288 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T23:34:46.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:34:46.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T23:34:46.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T23:34:46.337 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:34:46.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:34:46.368 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-10T23:34:46.385 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-09-10T23:34:46.402 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:34:46.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:34:46.438 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T23:34:46.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T23:34:46.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T23:34:46.461 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T23:34:46.462 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775/remote/smithi017 2024-09-10T23:34:46.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:34:46.506 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899775/remote/smithi077 2024-09-10T23:34:46.507 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T23:34:46.532 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T23:34:46.532 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:34:46.549 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T23:34:46.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T23:34:46.591 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T23:34:46.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T23:34:46.615 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T23:34:46.615 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:34:46.619 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T23:34:46.624 INFO:teuthology.orchestra.run.smithi017.stdout: 658141 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:34 /home/ubuntu/cephtest 2024-09-10T23:34:46.628 INFO:teuthology.orchestra.run.smithi077.stdout: 658141 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 23:34 /home/ubuntu/cephtest 2024-09-10T23:34:46.630 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T23:34:46.666 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T23:34:46.769 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} duration: 1887.3359611034393 flavor: default mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology success: true 2024-09-10T23:34:46.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T23:34:46.869 INFO:teuthology.run:pass